2023-12-12T09:26:35.557 INFO:root:teuthology version: 0.0.1.dev216+g5f3731e 2023-12-12T09:26:35.557 DEBUG:teuthology.run:Teuthology command: teuthology --archive /home/teuthworker/archive/mchangir-2023-12-12_08:46:52-fs-wip-mchangir-testing-20231205.064351-testing-default-smithi/7488201 --owner mchangir --name mchangir-2023-12-12_08:46:52-fs-wip-mchangir-testing-20231205.064351-testing-default-smithi --description fs/multifs/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore-ec/bluestore-comp overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug} tasks/multifs-auth} --verbose -- /home/teuthworker/archive/mchangir-2023-12-12_08:46:52-fs-wip-mchangir-testing-20231205.064351-testing-default-smithi/7488201/orig.config.yaml 2023-12-12T09:26:35.598 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-12T09:26:35.679 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/mchangir-2023-12-12_08:46:52-fs-wip-mchangir-testing-20231205.064351-testing-default-smithi/7488201 branch: wip-mchangir-testing-20231205.064351 description: fs/multifs/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore-ec/bluestore-comp overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug} tasks/multifs-auth} email: mchangir@redhat.com first_in_suite: false job_id: '7488201' kernel: client: branch: testing flavor: default kdb: true sha1: cd68252d7b4d7802f3cae7f5945b38e9b20dad4c ktype: upstream last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: mchangir-2023-12-12_08:46:52-fs-wip-mchangir-testing-20231205.064351-testing-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-mchangir-testing-20231205.064351 ceph: conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 global: ms die on skipped message: false mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bluestore block size: 96636764160 bluestore compression mode: aggressive bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - \(POOL_APP_NOT_ENABLED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding sha1: f1fbf3c583d03e19f5e58eb618e78d8e10d075f9 ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} install: ceph: flavor: default sha1: f1fbf3c583d03e19f5e58eb618e78d8e10d075f9 kclient: syntax: v2 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-mchangir-testing-20231205.064351 sha1: f1fbf3c583d03e19f5e58eb618e78d8e10d075f9 owner: mchangir priority: 1000 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 seed: 5473 sha1: f1fbf3c583d03e19f5e58eb618e78d8e10d075f9 sleep_before_teardown: 0 subset: 600/1024 suite: fs suite_branch: wip-mchangir-testing-20231205.064351 suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_f1fbf3c583d03e19f5e58eb618e78d8e10d075f9/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: f1fbf3c583d03e19f5e58eb618e78d8e10d075f9 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi073.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJfB+WnNO4Q4SywKPSkwZk2/Zd+Ney84PpLBglK+6wh/UIsK2PKGkXlyhKIqM6MCW47LpVlYo3PbTYTXrBstD2U= smithi142.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPU8jjooQsHvVnYhduA/IXP/8/qDJskzOBkP387Siv1tz3bzcf4gua6HdskSn2d7JQH3l7TUJJ+oYyUwVWO8lA0= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - kclient: null - cephfs_test_runner: fail_on_skip: false modules: - tasks.cephfs.test_multifs_auth teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: 5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73 timestamp: 2023-12-12_08:46:52 tube: smithi user: mchangir verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.232157 2023-12-12T09:26:35.680 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_f1fbf3c583d03e19f5e58eb618e78d8e10d075f9/qa; will attempt to use it 2023-12-12T09:26:35.680 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_f1fbf3c583d03e19f5e58eb618e78d8e10d075f9/qa/tasks 2023-12-12T09:26:35.680 INFO:teuthology.run_tasks:Running task internal.check_packages... 2023-12-12T09:26:35.682 INFO:teuthology.task.internal:Checking packages... 2023-12-12T09:26:35.706 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash 'f1fbf3c583d03e19f5e58eb618e78d8e10d075f9' 2023-12-12T09:26:35.706 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-12-12T09:26:35.706 INFO:teuthology.packaging:ref: None 2023-12-12T09:26:35.706 INFO:teuthology.packaging:tag: None 2023-12-12T09:26:35.706 INFO:teuthology.packaging:branch: wip-mchangir-testing-20231205.064351 2023-12-12T09:26:35.706 INFO:teuthology.packaging:sha1: f1fbf3c583d03e19f5e58eb618e78d8e10d075f9 2023-12-12T09:26:35.706 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-mchangir-testing-20231205.064351 2023-12-12T09:26:35.929 INFO:teuthology.task.internal:Found packages for ceph version 19.0.0-96.gf1fbf3c5 2023-12-12T09:26:35.931 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2023-12-12T09:26:35.939 INFO:teuthology.task.internal:no buildpackages task found 2023-12-12T09:26:35.939 INFO:teuthology.run_tasks:Running task internal.save_config... 2023-12-12T09:26:35.961 INFO:teuthology.task.internal:Saving configuration 2023-12-12T09:26:35.978 INFO:teuthology.run_tasks:Running task internal.check_lock... 2023-12-12T09:26:35.985 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-12T09:26:36.011 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi073.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/mchangir-2023-12-12_08:46:52-fs-wip-mchangir-testing-20231205.064351-testing-default-smithi/7488201', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-12 09:21:30.023496', 'locked_by': 'mchangir', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJfB+WnNO4Q4SywKPSkwZk2/Zd+Ney84PpLBglK+6wh/UIsK2PKGkXlyhKIqM6MCW47LpVlYo3PbTYTXrBstD2U='} 2023-12-12T09:26:36.036 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi142.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/mchangir-2023-12-12_08:46:52-fs-wip-mchangir-testing-20231205.064351-testing-default-smithi/7488201', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-12 09:21:30.021937', 'locked_by': 'mchangir', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPU8jjooQsHvVnYhduA/IXP/8/qDJskzOBkP387Siv1tz3bzcf4gua6HdskSn2d7JQH3l7TUJJ+oYyUwVWO8lA0='} 2023-12-12T09:26:36.036 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2023-12-12T09:26:36.044 INFO:teuthology.task.internal:roles: ubuntu@smithi073.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'] 2023-12-12T09:26:36.044 INFO:teuthology.task.internal:roles: ubuntu@smithi142.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1'] 2023-12-12T09:26:36.044 INFO:teuthology.run_tasks:Running task console_log... 2023-12-12T09:26:36.117 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f606d0e1e50>, signals=[15]) 2023-12-12T09:26:36.118 INFO:teuthology.run_tasks:Running task internal.connect... 2023-12-12T09:26:36.125 INFO:teuthology.task.internal:Opening connections... 2023-12-12T09:26:36.125 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi073.front.sepia.ceph.com 2023-12-12T09:26:36.127 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi073.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-12T09:26:36.211 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi142.front.sepia.ceph.com 2023-12-12T09:26:36.212 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-12T09:26:36.293 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2023-12-12T09:26:36.303 DEBUG:teuthology.orchestra.run.smithi073:> uname -m 2023-12-12T09:26:36.321 INFO:teuthology.orchestra.run.smithi073.stdout:x86_64 2023-12-12T09:26:36.321 DEBUG:teuthology.orchestra.run.smithi073:> cat /etc/os-release 2023-12-12T09:26:36.378 INFO:teuthology.orchestra.run.smithi073.stdout:NAME="CentOS Stream" 2023-12-12T09:26:36.378 INFO:teuthology.orchestra.run.smithi073.stdout:VERSION="9" 2023-12-12T09:26:36.378 INFO:teuthology.orchestra.run.smithi073.stdout:ID="centos" 2023-12-12T09:26:36.378 INFO:teuthology.orchestra.run.smithi073.stdout:ID_LIKE="rhel fedora" 2023-12-12T09:26:36.378 INFO:teuthology.orchestra.run.smithi073.stdout:VERSION_ID="9" 2023-12-12T09:26:36.378 INFO:teuthology.orchestra.run.smithi073.stdout:PLATFORM_ID="platform:el9" 2023-12-12T09:26:36.378 INFO:teuthology.orchestra.run.smithi073.stdout:PRETTY_NAME="CentOS Stream 9" 2023-12-12T09:26:36.379 INFO:teuthology.orchestra.run.smithi073.stdout:ANSI_COLOR="0;31" 2023-12-12T09:26:36.379 INFO:teuthology.orchestra.run.smithi073.stdout:LOGO="fedora-logo-icon" 2023-12-12T09:26:36.379 INFO:teuthology.orchestra.run.smithi073.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-12-12T09:26:36.379 INFO:teuthology.orchestra.run.smithi073.stdout:HOME_URL="https://centos.org/" 2023-12-12T09:26:36.379 INFO:teuthology.orchestra.run.smithi073.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-12T09:26:36.379 INFO:teuthology.orchestra.run.smithi073.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-12-12T09:26:36.379 INFO:teuthology.orchestra.run.smithi073.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-12-12T09:26:36.379 INFO:teuthology.lock.ops:Updating smithi073.front.sepia.ceph.com on lock server 2023-12-12T09:26:36.404 DEBUG:teuthology.orchestra.run.smithi142:> uname -m 2023-12-12T09:26:36.421 INFO:teuthology.orchestra.run.smithi142.stdout:x86_64 2023-12-12T09:26:36.422 DEBUG:teuthology.orchestra.run.smithi142:> cat /etc/os-release 2023-12-12T09:26:36.477 INFO:teuthology.orchestra.run.smithi142.stdout:NAME="CentOS Stream" 2023-12-12T09:26:36.477 INFO:teuthology.orchestra.run.smithi142.stdout:VERSION="9" 2023-12-12T09:26:36.477 INFO:teuthology.orchestra.run.smithi142.stdout:ID="centos" 2023-12-12T09:26:36.477 INFO:teuthology.orchestra.run.smithi142.stdout:ID_LIKE="rhel fedora" 2023-12-12T09:26:36.477 INFO:teuthology.orchestra.run.smithi142.stdout:VERSION_ID="9" 2023-12-12T09:26:36.477 INFO:teuthology.orchestra.run.smithi142.stdout:PLATFORM_ID="platform:el9" 2023-12-12T09:26:36.477 INFO:teuthology.orchestra.run.smithi142.stdout:PRETTY_NAME="CentOS Stream 9" 2023-12-12T09:26:36.477 INFO:teuthology.orchestra.run.smithi142.stdout:ANSI_COLOR="0;31" 2023-12-12T09:26:36.477 INFO:teuthology.orchestra.run.smithi142.stdout:LOGO="fedora-logo-icon" 2023-12-12T09:26:36.477 INFO:teuthology.orchestra.run.smithi142.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-12-12T09:26:36.477 INFO:teuthology.orchestra.run.smithi142.stdout:HOME_URL="https://centos.org/" 2023-12-12T09:26:36.478 INFO:teuthology.orchestra.run.smithi142.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-12T09:26:36.478 INFO:teuthology.orchestra.run.smithi142.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-12-12T09:26:36.478 INFO:teuthology.orchestra.run.smithi142.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-12-12T09:26:36.478 INFO:teuthology.lock.ops:Updating smithi142.front.sepia.ceph.com on lock server 2023-12-12T09:26:36.504 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2023-12-12T09:26:36.513 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2023-12-12T09:26:36.520 INFO:teuthology.task.internal:Checking for old test directory... 2023-12-12T09:26:36.520 DEBUG:teuthology.orchestra.run.smithi073:> test '!' -e /home/ubuntu/cephtest 2023-12-12T09:26:36.523 DEBUG:teuthology.orchestra.run.smithi142:> test '!' -e /home/ubuntu/cephtest 2023-12-12T09:26:36.539 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2023-12-12T09:26:36.546 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2023-12-12T09:26:36.546 DEBUG:teuthology.orchestra.run.smithi073:> test -z $(ls -A /var/lib/ceph) 2023-12-12T09:26:36.579 DEBUG:teuthology.orchestra.run.smithi142:> test -z $(ls -A /var/lib/ceph) 2023-12-12T09:26:36.736 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2023-12-12T09:26:36.792 INFO:teuthology.run_tasks:Running task kernel... 2023-12-12T09:26:36.806 INFO:teuthology.task.kernel:normalize config orig: {'client': {'branch': 'testing'}, 'flavor': 'default', 'kdb': True, 'sha1': 'cd68252d7b4d7802f3cae7f5945b38e9b20dad4c'} 2023-12-12T09:26:36.806 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'branch': 'testing'}, 'client.1': {'branch': 'testing'}} 2023-12-12T09:26:36.807 INFO:teuthology.task.kernel:config {'client.0': {'branch': 'testing'}, 'client.1': {'branch': 'testing'}}, timeout 300 2023-12-12T09:26:36.807 DEBUG:teuthology.orchestra.run.smithi073:> test -f /run/.containerenv -o -f /.dockerenv 2023-12-12T09:26:36.807 DEBUG:teuthology.orchestra.run.smithi142:> test -f /run/.containerenv -o -f /.dockerenv 2023-12-12T09:26:36.823 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-12T09:26:36.824 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&ref=testing 2023-12-12T09:26:36.827 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-12T09:26:36.828 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&ref=testing 2023-12-12T09:26:37.127 DEBUG:teuthology.task.kernel:sha1 for client.1 is cd68252d7b4d7802f3cae7f5945b38e9b20dad4c 2023-12-12T09:26:37.127 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "cd68252d7b4d7802f3cae7f5945b38e9b20dad4c"... 2023-12-12T09:26:37.127 DEBUG:teuthology.orchestra.run.smithi142:> uname -r 2023-12-12T09:26:37.130 DEBUG:teuthology.task.kernel:sha1 for client.0 is cd68252d7b4d7802f3cae7f5945b38e9b20dad4c 2023-12-12T09:26:37.130 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "cd68252d7b4d7802f3cae7f5945b38e9b20dad4c"... 2023-12-12T09:26:37.131 DEBUG:teuthology.orchestra.run.smithi073:> uname -r 2023-12-12T09:26:37.144 INFO:teuthology.orchestra.run.smithi142.stdout:5.14.0-361.el9.x86_64 2023-12-12T09:26:37.144 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-361.el9.x86_64 vs cd68252d7b4d7802f3cae7f5945b38e9b20dad4c 2023-12-12T09:26:37.145 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2023-12-12T09:26:37.145 DEBUG:teuthology.orchestra.run.smithi142:> sudo yum upgrade -y linux-firmware 2023-12-12T09:26:37.148 INFO:teuthology.orchestra.run.smithi073.stdout:5.14.0-361.el9.x86_64 2023-12-12T09:26:37.148 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-361.el9.x86_64 vs cd68252d7b4d7802f3cae7f5945b38e9b20dad4c 2023-12-12T09:26:37.148 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2023-12-12T09:26:37.148 DEBUG:teuthology.orchestra.run.smithi073:> sudo yum upgrade -y linux-firmware 2023-12-12T09:26:39.221 INFO:teuthology.orchestra.run.smithi142.stdout:CentOS-9 - AppStream 13 MB/s | 6.4 MB 00:00 2023-12-12T09:26:39.347 INFO:teuthology.orchestra.run.smithi073.stdout:CentOS-9 - AppStream 15 MB/s | 6.4 MB 00:00 2023-12-12T09:26:40.672 INFO:teuthology.orchestra.run.smithi073.stdout:CentOS-9 - BaseOS 6.8 MB/s | 2.0 MB 00:00 2023-12-12T09:26:40.872 INFO:teuthology.orchestra.run.smithi142.stdout:CentOS-9 - BaseOS 3.5 MB/s | 2.0 MB 00:00 2023-12-12T09:26:41.580 INFO:teuthology.orchestra.run.smithi073.stdout:CentOS Stream 9 - BaseOS 14 MB/s | 7.9 MB 00:00 2023-12-12T09:26:42.187 INFO:teuthology.orchestra.run.smithi142.stdout:CentOS Stream 9 - BaseOS 8.3 MB/s | 7.9 MB 00:00 2023-12-12T09:26:43.880 INFO:teuthology.orchestra.run.smithi142.stdout:CentOS Stream 9 - AppStream 29 MB/s | 18 MB 00:00 2023-12-12T09:26:44.533 INFO:teuthology.orchestra.run.smithi073.stdout:CentOS Stream 9 - AppStream 9.6 MB/s | 18 MB 00:01 2023-12-12T09:26:48.415 INFO:teuthology.orchestra.run.smithi073.stdout:CentOS Stream 9 - CRB 10 MB/s | 5.8 MB 00:00 2023-12-12T09:26:49.882 INFO:teuthology.orchestra.run.smithi073.stdout:CentOS Stream 9 - Extras packages 40 kB/s | 15 kB 00:00 2023-12-12T09:26:51.042 INFO:teuthology.orchestra.run.smithi073.stdout:Extra Packages for Enterprise Linux 19 MB/s | 20 MB 00:01 2023-12-12T09:26:55.725 INFO:teuthology.orchestra.run.smithi073.stdout:lab-extras 45 kB/s | 1.7 kB 00:00 2023-12-12T09:26:57.924 INFO:teuthology.orchestra.run.smithi073.stdout:Dependencies resolved. 2023-12-12T09:26:57.938 INFO:teuthology.orchestra.run.smithi073.stdout:================================================================================ 2023-12-12T09:26:57.938 INFO:teuthology.orchestra.run.smithi073.stdout: Package Arch Version Repository Size 2023-12-12T09:26:57.938 INFO:teuthology.orchestra.run.smithi073.stdout:================================================================================ 2023-12-12T09:26:57.939 INFO:teuthology.orchestra.run.smithi073.stdout:Upgrading: 2023-12-12T09:26:57.939 INFO:teuthology.orchestra.run.smithi073.stdout: linux-firmware noarch 20231030-141.el9 CentOS-BaseOS 328 M 2023-12-12T09:26:57.939 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-12T09:26:57.939 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction Summary 2023-12-12T09:26:57.939 INFO:teuthology.orchestra.run.smithi073.stdout:================================================================================ 2023-12-12T09:26:57.939 INFO:teuthology.orchestra.run.smithi073.stdout:Upgrade 1 Package 2023-12-12T09:26:57.939 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-12T09:26:57.939 INFO:teuthology.orchestra.run.smithi073.stdout:Total download size: 328 M 2023-12-12T09:26:57.939 INFO:teuthology.orchestra.run.smithi073.stdout:Downloading Packages: 2023-12-12T09:27:01.884 INFO:teuthology.orchestra.run.smithi073.stdout:linux-firmware-20231030-141.el9.noarch.rpm 83 MB/s | 328 MB 00:03 2023-12-12T09:27:01.885 INFO:teuthology.orchestra.run.smithi073.stdout:-------------------------------------------------------------------------------- 2023-12-12T09:27:01.886 INFO:teuthology.orchestra.run.smithi073.stdout:Total 83 MB/s | 328 MB 00:03 2023-12-12T09:27:01.886 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction check 2023-12-12T09:27:01.976 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction check succeeded. 2023-12-12T09:27:01.976 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction test 2023-12-12T09:27:03.545 INFO:teuthology.orchestra.run.smithi142.stdout:CentOS Stream 9 - CRB 367 kB/s | 5.8 MB 00:16 2023-12-12T09:27:04.146 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction test succeeded. 2023-12-12T09:27:04.147 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction 2023-12-12T09:27:05.322 INFO:teuthology.orchestra.run.smithi142.stdout:CentOS Stream 9 - Extras packages 21 kB/s | 15 kB 00:00 2023-12-12T09:27:06.416 INFO:teuthology.orchestra.run.smithi142.stdout:Extra Packages for Enterprise Linux 20 MB/s | 20 MB 00:00 2023-12-12T09:27:10.108 INFO:teuthology.orchestra.run.smithi073.stdout: Preparing : 1/1 2023-12-12T09:27:10.466 INFO:teuthology.orchestra.run.smithi073.stdout: Upgrading : linux-firmware-20231030-141.el9.noarch 1/2 2023-12-12T09:27:10.540 INFO:teuthology.orchestra.run.smithi073.stdout: Cleanup : linux-firmware-20230814-139.el9.noarch 2/2 2023-12-12T09:27:11.063 INFO:teuthology.orchestra.run.smithi142.stdout:lab-extras 28 kB/s | 1.7 kB 00:00 2023-12-12T09:27:11.658 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: linux-firmware-20230814-139.el9.noarch 2/2 2023-12-12T09:27:11.658 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : linux-firmware-20231030-141.el9.noarch 1/2 2023-12-12T09:27:12.029 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : linux-firmware-20230814-139.el9.noarch 2/2 2023-12-12T09:27:12.029 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-12T09:27:12.030 INFO:teuthology.orchestra.run.smithi073.stdout:Upgraded: 2023-12-12T09:27:12.030 INFO:teuthology.orchestra.run.smithi073.stdout: linux-firmware-20231030-141.el9.noarch 2023-12-12T09:27:12.030 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-12T09:27:12.030 INFO:teuthology.orchestra.run.smithi073.stdout:Complete! 2023-12-12T09:27:12.334 INFO:teuthology.task.kernel:Downloading kernel cd68252d7b4d7802f3cae7f5945b38e9b20dad4c on client.0... 2023-12-12T09:27:12.334 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=cd68252d7b4d7802f3cae7f5945b38e9b20dad4c 2023-12-12T09:27:12.565 INFO:teuthology.task.kernel:fetching, builder baseurl is https://4.chacra.ceph.com/r/kernel/testing/cd68252d7b4d7802f3cae7f5945b38e9b20dad4c/centos/9/flavors/default/x86_64/ 2023-12-12T09:27:12.566 DEBUG:teuthology.orchestra.run.smithi073:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.6.0_gcd68252d7b4d-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://4.chacra.ceph.com/r/kernel/testing/cd68252d7b4d7802f3cae7f5945b38e9b20dad4c/centos/9/flavors/default/x86_64/ --input-file=- 2023-12-12T09:27:12.568 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi073.front.sepia.ceph.com to complete... 2023-12-12T09:27:13.361 INFO:teuthology.orchestra.run.smithi142.stdout:Dependencies resolved. 2023-12-12T09:27:13.366 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2023-12-12T09:27:13.366 INFO:teuthology.orchestra.run.smithi142.stdout: Package Arch Version Repository Size 2023-12-12T09:27:13.366 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2023-12-12T09:27:13.366 INFO:teuthology.orchestra.run.smithi142.stdout:Upgrading: 2023-12-12T09:27:13.366 INFO:teuthology.orchestra.run.smithi142.stdout: linux-firmware noarch 20231030-141.el9 CentOS-BaseOS 328 M 2023-12-12T09:27:13.366 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-12-12T09:27:13.366 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction Summary 2023-12-12T09:27:13.366 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2023-12-12T09:27:13.366 INFO:teuthology.orchestra.run.smithi142.stdout:Upgrade 1 Package 2023-12-12T09:27:13.367 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-12-12T09:27:13.367 INFO:teuthology.orchestra.run.smithi142.stdout:Total download size: 328 M 2023-12-12T09:27:13.367 INFO:teuthology.orchestra.run.smithi142.stdout:Downloading Packages: 2023-12-12T09:27:17.347 INFO:teuthology.orchestra.run.smithi142.stdout:linux-firmware-20231030-141.el9.noarch.rpm 82 MB/s | 328 MB 00:03 2023-12-12T09:27:17.348 INFO:teuthology.orchestra.run.smithi142.stdout:-------------------------------------------------------------------------------- 2023-12-12T09:27:17.349 INFO:teuthology.orchestra.run.smithi142.stdout:Total 82 MB/s | 328 MB 00:03 2023-12-12T09:27:17.349 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction check 2023-12-12T09:27:17.441 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction check succeeded. 2023-12-12T09:27:17.442 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction test 2023-12-12T09:27:19.618 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction test succeeded. 2023-12-12T09:27:19.619 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction 2023-12-12T09:27:23.526 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12 09:27:23 URL:https://4.chacra.ceph.com/r/kernel/testing/cd68252d7b4d7802f3cae7f5945b38e9b20dad4c/centos/9/flavors/default/x86_64/kernel-6.6.0_gcd68252d7b4d-1.x86_64.rpm [321162729/321162729] -> "/tmp/kernel.x86_64.rpm" [1] 2023-12-12T09:27:23.526 INFO:teuthology.orchestra.run.smithi073.stderr:FINISHED --2023-12-12 09:27:23-- 2023-12-12T09:27:23.526 INFO:teuthology.orchestra.run.smithi073.stderr:Total wall clock time: 11s 2023-12-12T09:27:23.526 INFO:teuthology.orchestra.run.smithi073.stderr:Downloaded: 1 files, 306M in 11s (28.8 MB/s) 2023-12-12T09:27:23.529 INFO:teuthology.task.kernel:Installing kernel cd68252d7b4d7802f3cae7f5945b38e9b20dad4c on client.0... 2023-12-12T09:27:23.529 DEBUG:teuthology.orchestra.run.smithi073:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2023-12-12T09:27:25.256 INFO:teuthology.orchestra.run.smithi142.stdout: Preparing : 1/1 2023-12-12T09:27:25.379 INFO:teuthology.orchestra.run.smithi073.stdout:Verifying... ######################################## 2023-12-12T09:27:25.504 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing... ######################################## 2023-12-12T09:27:25.584 INFO:teuthology.orchestra.run.smithi073.stdout:Updating / installing... 2023-12-12T09:27:25.587 INFO:teuthology.orchestra.run.smithi142.stdout: Upgrading : linux-firmware-20231030-141.el9.noarch 1/2 2023-12-12T09:27:25.668 INFO:teuthology.orchestra.run.smithi142.stdout: Cleanup : linux-firmware-20230814-139.el9.noarch 2/2 2023-12-12T09:27:26.559 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: linux-firmware-20230814-139.el9.noarch 2/2 2023-12-12T09:27:26.559 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : linux-firmware-20231030-141.el9.noarch 1/2 2023-12-12T09:27:26.943 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : linux-firmware-20230814-139.el9.noarch 2/2 2023-12-12T09:27:26.943 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-12-12T09:27:26.943 INFO:teuthology.orchestra.run.smithi142.stdout:Upgraded: 2023-12-12T09:27:26.943 INFO:teuthology.orchestra.run.smithi142.stdout: linux-firmware-20231030-141.el9.noarch 2023-12-12T09:27:26.943 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-12-12T09:27:26.944 INFO:teuthology.orchestra.run.smithi142.stdout:Complete! 2023-12-12T09:27:27.230 INFO:teuthology.task.kernel:Downloading kernel cd68252d7b4d7802f3cae7f5945b38e9b20dad4c on client.1... 2023-12-12T09:27:27.231 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=cd68252d7b4d7802f3cae7f5945b38e9b20dad4c 2023-12-12T09:27:27.371 INFO:teuthology.task.kernel:fetching, builder baseurl is https://4.chacra.ceph.com/r/kernel/testing/cd68252d7b4d7802f3cae7f5945b38e9b20dad4c/centos/9/flavors/default/x86_64/ 2023-12-12T09:27:27.371 DEBUG:teuthology.orchestra.run.smithi142:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.6.0_gcd68252d7b4d-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://4.chacra.ceph.com/r/kernel/testing/cd68252d7b4d7802f3cae7f5945b38e9b20dad4c/centos/9/flavors/default/x86_64/ --input-file=- 2023-12-12T09:27:27.374 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi142.front.sepia.ceph.com to complete... 2023-12-12T09:27:32.650 INFO:teuthology.orchestra.run.smithi073.stdout:kernel-6.6.0_gcd68252d7b4d-1 ######################################## 2023-12-12T09:27:38.303 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12 09:27:38 URL:https://4.chacra.ceph.com/r/kernel/testing/cd68252d7b4d7802f3cae7f5945b38e9b20dad4c/centos/9/flavors/default/x86_64/kernel-6.6.0_gcd68252d7b4d-1.x86_64.rpm [321162729/321162729] -> "/tmp/kernel.x86_64.rpm" [1] 2023-12-12T09:27:38.303 INFO:teuthology.orchestra.run.smithi142.stderr:FINISHED --2023-12-12 09:27:38-- 2023-12-12T09:27:38.303 INFO:teuthology.orchestra.run.smithi142.stderr:Total wall clock time: 11s 2023-12-12T09:27:38.303 INFO:teuthology.orchestra.run.smithi142.stderr:Downloaded: 1 files, 306M in 11s (28.9 MB/s) 2023-12-12T09:27:38.306 INFO:teuthology.task.kernel:Installing kernel cd68252d7b4d7802f3cae7f5945b38e9b20dad4c on client.1... 2023-12-12T09:27:38.306 DEBUG:teuthology.orchestra.run.smithi142:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2023-12-12T09:27:40.159 INFO:teuthology.orchestra.run.smithi142.stdout:Verifying... ######################################## 2023-12-12T09:27:40.219 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing... ######################################## 2023-12-12T09:27:40.298 INFO:teuthology.orchestra.run.smithi142.stdout:Updating / installing... 2023-12-12T09:27:47.381 INFO:teuthology.orchestra.run.smithi142.stdout:kernel-6.6.0_gcd68252d7b4d-1 ######################################## 2023-12-12T09:27:48.332 INFO:teuthology.orchestra.run.smithi073.stderr:dracut: Disabling early microcode, because kernel does not support it. CONFIG_MICROCODE_[AMD|INTEL]!=y 2023-12-12T09:28:02.315 INFO:teuthology.orchestra.run.smithi142.stderr:dracut: Disabling early microcode, because kernel does not support it. CONFIG_MICROCODE_[AMD|INTEL]!=y 2023-12-12T09:28:09.508 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi073.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2023-12-12T09:28:09.508 DEBUG:teuthology.orchestra.run.smithi073:> rpm -qlp /tmp/kernel.x86_64.rpm 2023-12-12T09:28:09.585 INFO:teuthology.orchestra.run.smithi073.stdout:/boot/System.map-6.6.0-gcd68252d7b4d 2023-12-12T09:28:09.585 INFO:teuthology.orchestra.run.smithi073.stdout:/boot/config-6.6.0-gcd68252d7b4d 2023-12-12T09:28:09.585 INFO:teuthology.orchestra.run.smithi073.stdout:/boot/vmlinuz-6.6.0-gcd68252d7b4d 2023-12-12T09:28:09.585 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d 2023-12-12T09:28:09.585 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel 2023-12-12T09:28:09.585 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch 2023-12-12T09:28:09.585 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86 2023-12-12T09:28:09.585 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto 2023-12-12T09:28:09.586 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/blowfish-x86_64.ko 2023-12-12T09:28:09.586 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2023-12-12T09:28:09.586 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2023-12-12T09:28:09.586 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/camellia-x86_64.ko 2023-12-12T09:28:09.586 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2023-12-12T09:28:09.586 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2023-12-12T09:28:09.586 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/crc32-pclmul.ko 2023-12-12T09:28:09.586 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/crc32c-intel.ko 2023-12-12T09:28:09.586 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2023-12-12T09:28:09.586 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2023-12-12T09:28:09.586 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2023-12-12T09:28:09.586 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2023-12-12T09:28:09.586 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/serpent-avx2.ko 2023-12-12T09:28:09.586 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2023-12-12T09:28:09.587 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/sha1-ssse3.ko 2023-12-12T09:28:09.587 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/sha256-ssse3.ko 2023-12-12T09:28:09.587 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/sha512-ssse3.ko 2023-12-12T09:28:09.587 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2023-12-12T09:28:09.587 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2023-12-12T09:28:09.587 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/twofish-x86_64.ko 2023-12-12T09:28:09.587 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/kernel 2023-12-12T09:28:09.587 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/kernel/cpu 2023-12-12T09:28:09.587 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/kernel/cpu/mce 2023-12-12T09:28:09.587 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2023-12-12T09:28:09.587 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/kvm 2023-12-12T09:28:09.587 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/kvm/kvm-amd.ko 2023-12-12T09:28:09.587 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/kvm/kvm-intel.ko 2023-12-12T09:28:09.587 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/kvm/kvm.ko 2023-12-12T09:28:09.588 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto 2023-12-12T09:28:09.588 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/ansi_cprng.ko 2023-12-12T09:28:09.588 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/anubis.ko 2023-12-12T09:28:09.588 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/arc4.ko 2023-12-12T09:28:09.588 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/async_tx 2023-12-12T09:28:09.588 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/async_tx/async_memcpy.ko 2023-12-12T09:28:09.588 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/async_tx/async_pq.ko 2023-12-12T09:28:09.588 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/async_tx/async_raid6_recov.ko 2023-12-12T09:28:09.588 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/async_tx/async_tx.ko 2023-12-12T09:28:09.588 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/async_tx/async_xor.ko 2023-12-12T09:28:09.588 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/async_tx/raid6test.ko 2023-12-12T09:28:09.588 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/authenc.ko 2023-12-12T09:28:09.588 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/authencesn.ko 2023-12-12T09:28:09.588 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/blake2b_generic.ko 2023-12-12T09:28:09.589 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/blowfish_common.ko 2023-12-12T09:28:09.589 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/blowfish_generic.ko 2023-12-12T09:28:09.589 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/camellia_generic.ko 2023-12-12T09:28:09.589 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/cast5_generic.ko 2023-12-12T09:28:09.589 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/cast6_generic.ko 2023-12-12T09:28:09.589 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/cast_common.ko 2023-12-12T09:28:09.589 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/ccm.ko 2023-12-12T09:28:09.589 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/cmac.ko 2023-12-12T09:28:09.589 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/crc32_generic.ko 2023-12-12T09:28:09.589 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/crypto_engine.ko 2023-12-12T09:28:09.589 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/crypto_user.ko 2023-12-12T09:28:09.589 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/cts.ko 2023-12-12T09:28:09.589 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/des_generic.ko 2023-12-12T09:28:09.590 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/dh_generic.ko 2023-12-12T09:28:09.590 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/echainiv.ko 2023-12-12T09:28:09.590 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/essiv.ko 2023-12-12T09:28:09.590 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/fcrypt.ko 2023-12-12T09:28:09.590 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/khazad.ko 2023-12-12T09:28:09.590 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/lz4.ko 2023-12-12T09:28:09.590 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/lz4hc.ko 2023-12-12T09:28:09.590 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/md4.ko 2023-12-12T09:28:09.590 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/michael_mic.ko 2023-12-12T09:28:09.590 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/pcbc.ko 2023-12-12T09:28:09.590 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/pcrypt.ko 2023-12-12T09:28:09.590 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/rmd160.ko 2023-12-12T09:28:09.590 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/seed.ko 2023-12-12T09:28:09.590 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/serpent_generic.ko 2023-12-12T09:28:09.591 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/tcrypt.ko 2023-12-12T09:28:09.591 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/tea.ko 2023-12-12T09:28:09.591 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/twofish_common.ko 2023-12-12T09:28:09.591 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/twofish_generic.ko 2023-12-12T09:28:09.591 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/vmac.ko 2023-12-12T09:28:09.591 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/wp512.ko 2023-12-12T09:28:09.591 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/xcbc.ko 2023-12-12T09:28:09.591 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/xor.ko 2023-12-12T09:28:09.591 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/xxhash_generic.ko 2023-12-12T09:28:09.591 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers 2023-12-12T09:28:09.591 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/acpi 2023-12-12T09:28:09.591 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/acpi/acpi_ipmi.ko 2023-12-12T09:28:09.591 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/acpi/acpi_pad.ko 2023-12-12T09:28:09.591 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/acpi/custom_method.ko 2023-12-12T09:28:09.592 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/acpi/ec_sys.ko 2023-12-12T09:28:09.592 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/acpi/platform_profile.ko 2023-12-12T09:28:09.592 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/acpi/sbs.ko 2023-12-12T09:28:09.592 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/acpi/sbshc.ko 2023-12-12T09:28:09.592 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/acpi/video.ko 2023-12-12T09:28:09.592 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata 2023-12-12T09:28:09.592 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/acard-ahci.ko 2023-12-12T09:28:09.592 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/ahci_platform.ko 2023-12-12T09:28:09.592 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/ata_generic.ko 2023-12-12T09:28:09.592 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/libahci_platform.ko 2023-12-12T09:28:09.592 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_acpi.ko 2023-12-12T09:28:09.592 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_ali.ko 2023-12-12T09:28:09.592 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_amd.ko 2023-12-12T09:28:09.592 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_artop.ko 2023-12-12T09:28:09.593 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_atiixp.ko 2023-12-12T09:28:09.593 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_atp867x.ko 2023-12-12T09:28:09.593 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_cmd640.ko 2023-12-12T09:28:09.593 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_cmd64x.ko 2023-12-12T09:28:09.593 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_cypress.ko 2023-12-12T09:28:09.593 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_efar.ko 2023-12-12T09:28:09.593 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_hpt366.ko 2023-12-12T09:28:09.593 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_hpt37x.ko 2023-12-12T09:28:09.593 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_hpt3x2n.ko 2023-12-12T09:28:09.593 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_hpt3x3.ko 2023-12-12T09:28:09.593 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_it8213.ko 2023-12-12T09:28:09.593 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_it821x.ko 2023-12-12T09:28:09.593 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_jmicron.ko 2023-12-12T09:28:09.593 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_marvell.ko 2023-12-12T09:28:09.594 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_mpiix.ko 2023-12-12T09:28:09.594 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_netcell.ko 2023-12-12T09:28:09.594 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_ninja32.ko 2023-12-12T09:28:09.594 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_ns87410.ko 2023-12-12T09:28:09.594 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_ns87415.ko 2023-12-12T09:28:09.594 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_oldpiix.ko 2023-12-12T09:28:09.594 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_opti.ko 2023-12-12T09:28:09.594 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_optidma.ko 2023-12-12T09:28:09.594 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_pcmcia.ko 2023-12-12T09:28:09.594 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_pdc2027x.ko 2023-12-12T09:28:09.594 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_pdc202xx_old.ko 2023-12-12T09:28:09.594 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_piccolo.ko 2023-12-12T09:28:09.594 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_rdc.ko 2023-12-12T09:28:09.594 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_sch.ko 2023-12-12T09:28:09.594 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_serverworks.ko 2023-12-12T09:28:09.595 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_sil680.ko 2023-12-12T09:28:09.595 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_sis.ko 2023-12-12T09:28:09.595 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_sl82c105.ko 2023-12-12T09:28:09.595 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_triflex.ko 2023-12-12T09:28:09.595 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_via.ko 2023-12-12T09:28:09.595 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pdc_adma.ko 2023-12-12T09:28:09.595 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_inic162x.ko 2023-12-12T09:28:09.595 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_mv.ko 2023-12-12T09:28:09.595 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_nv.ko 2023-12-12T09:28:09.595 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_promise.ko 2023-12-12T09:28:09.595 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_qstor.ko 2023-12-12T09:28:09.595 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_sil.ko 2023-12-12T09:28:09.595 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_sil24.ko 2023-12-12T09:28:09.595 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_sis.ko 2023-12-12T09:28:09.596 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_svw.ko 2023-12-12T09:28:09.596 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_sx4.ko 2023-12-12T09:28:09.596 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_uli.ko 2023-12-12T09:28:09.596 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_via.ko 2023-12-12T09:28:09.596 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_vsc.ko 2023-12-12T09:28:09.596 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/auxdisplay 2023-12-12T09:28:09.596 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/auxdisplay/ks0108.ko 2023-12-12T09:28:09.596 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/base 2023-12-12T09:28:09.596 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/base/regmap 2023-12-12T09:28:09.596 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/base/regmap/regmap-i2c.ko 2023-12-12T09:28:09.596 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/base/regmap/regmap-mmio.ko 2023-12-12T09:28:09.596 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/bcma 2023-12-12T09:28:09.596 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/bcma/bcma.ko 2023-12-12T09:28:09.596 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block 2023-12-12T09:28:09.596 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/aoe 2023-12-12T09:28:09.597 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/aoe/aoe.ko 2023-12-12T09:28:09.597 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/brd.ko 2023-12-12T09:28:09.597 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/drbd 2023-12-12T09:28:09.597 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/drbd/drbd.ko 2023-12-12T09:28:09.597 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/floppy.ko 2023-12-12T09:28:09.597 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/loop.ko 2023-12-12T09:28:09.597 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/mtip32xx 2023-12-12T09:28:09.597 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/mtip32xx/mtip32xx.ko 2023-12-12T09:28:09.597 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/nbd.ko 2023-12-12T09:28:09.597 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/null_blk 2023-12-12T09:28:09.597 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/null_blk/null_blk.ko 2023-12-12T09:28:09.597 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/pktcdvd.ko 2023-12-12T09:28:09.597 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/rbd.ko 2023-12-12T09:28:09.597 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/virtio_blk.ko 2023-12-12T09:28:09.597 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/xen-blkback 2023-12-12T09:28:09.598 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/xen-blkback/xen-blkback.ko 2023-12-12T09:28:09.598 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/xen-blkfront.ko 2023-12-12T09:28:09.598 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/zram 2023-12-12T09:28:09.598 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/zram/zram.ko 2023-12-12T09:28:09.598 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char 2023-12-12T09:28:09.598 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/hangcheck-timer.ko 2023-12-12T09:28:09.598 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/hw_random 2023-12-12T09:28:09.598 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/hw_random/amd-rng.ko 2023-12-12T09:28:09.598 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/hw_random/intel-rng.ko 2023-12-12T09:28:09.598 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/hw_random/timeriomem-rng.ko 2023-12-12T09:28:09.598 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/hw_random/via-rng.ko 2023-12-12T09:28:09.598 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/hw_random/virtio-rng.ko 2023-12-12T09:28:09.598 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/ipmi 2023-12-12T09:28:09.598 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/ipmi/ipmi_devintf.ko 2023-12-12T09:28:09.599 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2023-12-12T09:28:09.599 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2023-12-12T09:28:09.599 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/ipmi/ipmi_si.ko 2023-12-12T09:28:09.599 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/ipmi/ipmi_ssif.ko 2023-12-12T09:28:09.599 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2023-12-12T09:28:09.599 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/lp.ko 2023-12-12T09:28:09.599 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/mwave 2023-12-12T09:28:09.599 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/mwave/mwave.ko 2023-12-12T09:28:09.599 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/ppdev.ko 2023-12-12T09:28:09.599 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/tlclk.ko 2023-12-12T09:28:09.599 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/tpm 2023-12-12T09:28:09.599 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/tpm/tpm.ko 2023-12-12T09:28:09.599 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/tpm/tpm_atmel.ko 2023-12-12T09:28:09.599 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/tpm/tpm_infineon.ko 2023-12-12T09:28:09.600 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/tpm/tpm_nsc.ko 2023-12-12T09:28:09.600 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/tpm/tpm_tis.ko 2023-12-12T09:28:09.600 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/tpm/tpm_tis_core.ko 2023-12-12T09:28:09.600 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/uv_mmtimer.ko 2023-12-12T09:28:09.600 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/virtio_console.ko 2023-12-12T09:28:09.600 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/cpufreq 2023-12-12T09:28:09.600 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/cpufreq/acpi-cpufreq.ko 2023-12-12T09:28:09.600 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2023-12-12T09:28:09.600 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/cpufreq/p4-clockmod.ko 2023-12-12T09:28:09.600 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/cpufreq/pcc-cpufreq.ko 2023-12-12T09:28:09.600 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/cpufreq/powernow-k8.ko 2023-12-12T09:28:09.600 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/cpufreq/speedstep-lib.ko 2023-12-12T09:28:09.600 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto 2023-12-12T09:28:09.600 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/ccp 2023-12-12T09:28:09.600 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/ccp/ccp-crypto.ko 2023-12-12T09:28:09.601 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/ccp/ccp.ko 2023-12-12T09:28:09.601 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/intel 2023-12-12T09:28:09.601 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/intel/qat 2023-12-12T09:28:09.601 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/intel/qat/qat_common 2023-12-12T09:28:09.601 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2023-12-12T09:28:09.601 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2023-12-12T09:28:09.601 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2023-12-12T09:28:09.601 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/padlock-aes.ko 2023-12-12T09:28:09.601 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/padlock-sha.ko 2023-12-12T09:28:09.601 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/virtio 2023-12-12T09:28:09.601 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/virtio/virtio_crypto.ko 2023-12-12T09:28:09.601 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/dca 2023-12-12T09:28:09.601 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/dca/dca.ko 2023-12-12T09:28:09.601 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/devfreq 2023-12-12T09:28:09.601 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/devfreq/governor_simpleondemand.ko 2023-12-12T09:28:09.602 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/dma 2023-12-12T09:28:09.602 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/dma/dw 2023-12-12T09:28:09.602 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/dma/dw/dw_dmac.ko 2023-12-12T09:28:09.602 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/dma/ioat 2023-12-12T09:28:09.602 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/dma/ioat/ioatdma.ko 2023-12-12T09:28:09.602 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac 2023-12-12T09:28:09.602 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/amd64_edac.ko 2023-12-12T09:28:09.602 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/e752x_edac.ko 2023-12-12T09:28:09.602 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/edac_mce_amd.ko 2023-12-12T09:28:09.602 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/i3000_edac.ko 2023-12-12T09:28:09.602 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/i3200_edac.ko 2023-12-12T09:28:09.602 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/i5100_edac.ko 2023-12-12T09:28:09.602 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/i5400_edac.ko 2023-12-12T09:28:09.602 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/i7300_edac.ko 2023-12-12T09:28:09.603 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/i7core_edac.ko 2023-12-12T09:28:09.603 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/i82975x_edac.ko 2023-12-12T09:28:09.603 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/ie31200_edac.ko 2023-12-12T09:28:09.603 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/sb_edac.ko 2023-12-12T09:28:09.603 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/x38_edac.ko 2023-12-12T09:28:09.603 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/firmware 2023-12-12T09:28:09.603 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/firmware/edd.ko 2023-12-12T09:28:09.603 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/firmware/iscsi_ibft.ko 2023-12-12T09:28:09.603 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio 2023-12-12T09:28:09.603 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-ich.ko 2023-12-12T09:28:09.603 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-viperboard.ko 2023-12-12T09:28:09.603 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid 2023-12-12T09:28:09.603 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-appleir.ko 2023-12-12T09:28:09.604 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-aureal.ko 2023-12-12T09:28:09.604 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-axff.ko 2023-12-12T09:28:09.604 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-dr.ko 2023-12-12T09:28:09.604 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-elecom.ko 2023-12-12T09:28:09.604 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-elo.ko 2023-12-12T09:28:09.604 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-emsff.ko 2023-12-12T09:28:09.604 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-gaff.ko 2023-12-12T09:28:09.604 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-gt683r.ko 2023-12-12T09:28:09.604 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-gyration.ko 2023-12-12T09:28:09.604 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-holtek-kbd.ko 2023-12-12T09:28:09.604 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-holtek-mouse.ko 2023-12-12T09:28:09.604 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-holtekff.ko 2023-12-12T09:28:09.604 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-hyperv.ko 2023-12-12T09:28:09.604 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-icade.ko 2023-12-12T09:28:09.605 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-keytouch.ko 2023-12-12T09:28:09.605 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-kye.ko 2023-12-12T09:28:09.605 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-lcpower.ko 2023-12-12T09:28:09.605 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-led.ko 2023-12-12T09:28:09.605 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-lenovo.ko 2023-12-12T09:28:09.605 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-logitech-dj.ko 2023-12-12T09:28:09.605 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-logitech-hidpp.ko 2023-12-12T09:28:09.605 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-multitouch.ko 2023-12-12T09:28:09.605 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-ortek.ko 2023-12-12T09:28:09.605 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-penmount.ko 2023-12-12T09:28:09.605 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-petalynx.ko 2023-12-12T09:28:09.605 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-picolcd.ko 2023-12-12T09:28:09.605 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-pl.ko 2023-12-12T09:28:09.605 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-plantronics.ko 2023-12-12T09:28:09.605 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-primax.ko 2023-12-12T09:28:09.605 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-rmi.ko 2023-12-12T09:28:09.606 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-arvo.ko 2023-12-12T09:28:09.606 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-common.ko 2023-12-12T09:28:09.606 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-isku.ko 2023-12-12T09:28:09.606 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-kone.ko 2023-12-12T09:28:09.606 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-koneplus.ko 2023-12-12T09:28:09.606 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-konepure.ko 2023-12-12T09:28:09.606 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-kovaplus.ko 2023-12-12T09:28:09.606 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-lua.ko 2023-12-12T09:28:09.606 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-pyra.ko 2023-12-12T09:28:09.606 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-ryos.ko 2023-12-12T09:28:09.606 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-savu.ko 2023-12-12T09:28:09.606 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat.ko 2023-12-12T09:28:09.606 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-saitek.ko 2023-12-12T09:28:09.606 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-samsung.ko 2023-12-12T09:28:09.607 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-sensor-hub.ko 2023-12-12T09:28:09.607 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-sjoy.ko 2023-12-12T09:28:09.607 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-sony.ko 2023-12-12T09:28:09.607 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-speedlink.ko 2023-12-12T09:28:09.607 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-steelseries.ko 2023-12-12T09:28:09.607 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-sunplus.ko 2023-12-12T09:28:09.607 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-thrustmaster.ko 2023-12-12T09:28:09.607 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-tivo.ko 2023-12-12T09:28:09.607 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-tmff.ko 2023-12-12T09:28:09.607 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-topseed.ko 2023-12-12T09:28:09.607 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-twinhan.ko 2023-12-12T09:28:09.607 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-uclogic.ko 2023-12-12T09:28:09.607 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-waltop.ko 2023-12-12T09:28:09.607 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-wiimote.ko 2023-12-12T09:28:09.607 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-xinmo.ko 2023-12-12T09:28:09.607 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-zpff.ko 2023-12-12T09:28:09.608 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-zydacron.ko 2023-12-12T09:28:09.608 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/uhid.ko 2023-12-12T09:28:09.608 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/wacom.ko 2023-12-12T09:28:09.608 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hv 2023-12-12T09:28:09.608 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hv/hv_balloon.ko 2023-12-12T09:28:09.608 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hv/hv_utils.ko 2023-12-12T09:28:09.608 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hv/hv_vmbus.ko 2023-12-12T09:28:09.608 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon 2023-12-12T09:28:09.608 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/abituguru.ko 2023-12-12T09:28:09.608 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/abituguru3.ko 2023-12-12T09:28:09.608 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/acpi_power_meter.ko 2023-12-12T09:28:09.608 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ad7414.ko 2023-12-12T09:28:09.608 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ad7418.ko 2023-12-12T09:28:09.608 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adc128d818.ko 2023-12-12T09:28:09.609 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adm1025.ko 2023-12-12T09:28:09.609 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adm1026.ko 2023-12-12T09:28:09.609 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adm1029.ko 2023-12-12T09:28:09.609 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adm1031.ko 2023-12-12T09:28:09.609 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adm9240.ko 2023-12-12T09:28:09.609 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ads7828.ko 2023-12-12T09:28:09.609 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adt7410.ko 2023-12-12T09:28:09.609 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adt7411.ko 2023-12-12T09:28:09.609 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adt7462.ko 2023-12-12T09:28:09.609 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adt7470.ko 2023-12-12T09:28:09.609 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adt7475.ko 2023-12-12T09:28:09.609 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adt7x10.ko 2023-12-12T09:28:09.609 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/amc6821.ko 2023-12-12T09:28:09.609 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/applesmc.ko 2023-12-12T09:28:09.610 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/asb100.ko 2023-12-12T09:28:09.610 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/asc7621.ko 2023-12-12T09:28:09.610 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/asus_atk0110.ko 2023-12-12T09:28:09.610 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/atxp1.ko 2023-12-12T09:28:09.610 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/coretemp.ko 2023-12-12T09:28:09.610 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/dell-smm-hwmon.ko 2023-12-12T09:28:09.610 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/dme1737.ko 2023-12-12T09:28:09.610 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ds1621.ko 2023-12-12T09:28:09.610 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ds620.ko 2023-12-12T09:28:09.610 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/emc1403.ko 2023-12-12T09:28:09.610 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/emc6w201.ko 2023-12-12T09:28:09.610 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/f71805f.ko 2023-12-12T09:28:09.610 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/f71882fg.ko 2023-12-12T09:28:09.610 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/f75375s.ko 2023-12-12T09:28:09.611 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/fam15h_power.ko 2023-12-12T09:28:09.611 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/fschmd.ko 2023-12-12T09:28:09.611 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/g760a.ko 2023-12-12T09:28:09.611 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/g762.ko 2023-12-12T09:28:09.611 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/gl518sm.ko 2023-12-12T09:28:09.611 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/gl520sm.ko 2023-12-12T09:28:09.611 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/hwmon-vid.ko 2023-12-12T09:28:09.611 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/i5500_temp.ko 2023-12-12T09:28:09.611 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/i5k_amb.ko 2023-12-12T09:28:09.611 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ibmaem.ko 2023-12-12T09:28:09.611 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ibmpex.ko 2023-12-12T09:28:09.611 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ina209.ko 2023-12-12T09:28:09.611 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ina2xx.ko 2023-12-12T09:28:09.611 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/it87.ko 2023-12-12T09:28:09.612 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/k10temp.ko 2023-12-12T09:28:09.612 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/k8temp.ko 2023-12-12T09:28:09.612 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lineage-pem.ko 2023-12-12T09:28:09.612 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm63.ko 2023-12-12T09:28:09.612 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm73.ko 2023-12-12T09:28:09.612 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm75.ko 2023-12-12T09:28:09.612 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm77.ko 2023-12-12T09:28:09.612 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm78.ko 2023-12-12T09:28:09.612 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm80.ko 2023-12-12T09:28:09.612 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm83.ko 2023-12-12T09:28:09.612 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm85.ko 2023-12-12T09:28:09.612 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm87.ko 2023-12-12T09:28:09.612 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm90.ko 2023-12-12T09:28:09.612 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm92.ko 2023-12-12T09:28:09.612 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm93.ko 2023-12-12T09:28:09.613 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm95234.ko 2023-12-12T09:28:09.613 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm95241.ko 2023-12-12T09:28:09.613 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm95245.ko 2023-12-12T09:28:09.613 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ltc2945.ko 2023-12-12T09:28:09.613 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ltc4151.ko 2023-12-12T09:28:09.613 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ltc4215.ko 2023-12-12T09:28:09.613 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ltc4222.ko 2023-12-12T09:28:09.613 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ltc4245.ko 2023-12-12T09:28:09.613 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ltc4260.ko 2023-12-12T09:28:09.613 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ltc4261.ko 2023-12-12T09:28:09.613 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/max16065.ko 2023-12-12T09:28:09.613 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/max1619.ko 2023-12-12T09:28:09.613 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/max1668.ko 2023-12-12T09:28:09.613 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/max197.ko 2023-12-12T09:28:09.613 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/max6639.ko 2023-12-12T09:28:09.614 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/max6650.ko 2023-12-12T09:28:09.614 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/max6697.ko 2023-12-12T09:28:09.614 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/mcp3021.ko 2023-12-12T09:28:09.614 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/nct6683.ko 2023-12-12T09:28:09.614 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/nct6775-core.ko 2023-12-12T09:28:09.614 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/nct6775.ko 2023-12-12T09:28:09.614 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/nct7802.ko 2023-12-12T09:28:09.614 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pc87360.ko 2023-12-12T09:28:09.614 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pc87427.ko 2023-12-12T09:28:09.614 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pcf8591.ko 2023-12-12T09:28:09.614 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus 2023-12-12T09:28:09.614 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/adm1275.ko 2023-12-12T09:28:09.614 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/lm25066.ko 2023-12-12T09:28:09.614 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/ltc2978.ko 2023-12-12T09:28:09.615 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/max16064.ko 2023-12-12T09:28:09.615 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/max34440.ko 2023-12-12T09:28:09.615 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/max8688.ko 2023-12-12T09:28:09.615 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/pmbus.ko 2023-12-12T09:28:09.615 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2023-12-12T09:28:09.615 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/tps40422.ko 2023-12-12T09:28:09.615 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/ucd9000.ko 2023-12-12T09:28:09.615 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/ucd9200.ko 2023-12-12T09:28:09.615 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/zl6100.ko 2023-12-12T09:28:09.615 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/powr1220.ko 2023-12-12T09:28:09.615 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/sch5627.ko 2023-12-12T09:28:09.615 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/sch5636.ko 2023-12-12T09:28:09.615 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/sch56xx-common.ko 2023-12-12T09:28:09.615 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/sht15.ko 2023-12-12T09:28:09.615 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/sht21.ko 2023-12-12T09:28:09.616 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/shtc1.ko 2023-12-12T09:28:09.616 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/sis5595.ko 2023-12-12T09:28:09.616 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/smsc47b397.ko 2023-12-12T09:28:09.616 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/smsc47m1.ko 2023-12-12T09:28:09.616 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/smsc47m192.ko 2023-12-12T09:28:09.616 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/thmc50.ko 2023-12-12T09:28:09.616 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/tmp102.ko 2023-12-12T09:28:09.616 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/tmp103.ko 2023-12-12T09:28:09.616 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/tmp401.ko 2023-12-12T09:28:09.616 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/tmp421.ko 2023-12-12T09:28:09.616 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/via-cputemp.ko 2023-12-12T09:28:09.616 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/via686a.ko 2023-12-12T09:28:09.616 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/vt1211.ko 2023-12-12T09:28:09.616 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/vt8231.ko 2023-12-12T09:28:09.616 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/w83627ehf.ko 2023-12-12T09:28:09.617 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/w83627hf.ko 2023-12-12T09:28:09.617 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/w83781d.ko 2023-12-12T09:28:09.617 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/w83791d.ko 2023-12-12T09:28:09.617 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/w83792d.ko 2023-12-12T09:28:09.617 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/w83793.ko 2023-12-12T09:28:09.617 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/w83795.ko 2023-12-12T09:28:09.617 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/w83l785ts.ko 2023-12-12T09:28:09.617 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/w83l786ng.ko 2023-12-12T09:28:09.617 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c 2023-12-12T09:28:09.617 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/algos 2023-12-12T09:28:09.617 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2023-12-12T09:28:09.617 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2023-12-12T09:28:09.617 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses 2023-12-12T09:28:09.617 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2023-12-12T09:28:09.617 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-amd756.ko 2023-12-12T09:28:09.618 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-amd8111.ko 2023-12-12T09:28:09.618 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2023-12-12T09:28:09.618 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-designware-core.ko 2023-12-12T09:28:09.618 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2023-12-12T09:28:09.618 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2023-12-12T09:28:09.618 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2023-12-12T09:28:09.618 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-i801.ko 2023-12-12T09:28:09.618 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-isch.ko 2023-12-12T09:28:09.618 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-ismt.ko 2023-12-12T09:28:09.618 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2023-12-12T09:28:09.618 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-nforce2.ko 2023-12-12T09:28:09.618 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-parport.ko 2023-12-12T09:28:09.618 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2023-12-12T09:28:09.619 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-piix4.ko 2023-12-12T09:28:09.619 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-scmi.ko 2023-12-12T09:28:09.619 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-simtec.ko 2023-12-12T09:28:09.619 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-sis96x.ko 2023-12-12T09:28:09.619 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2023-12-12T09:28:09.619 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-via.ko 2023-12-12T09:28:09.619 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-viapro.ko 2023-12-12T09:28:09.619 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-viperboard.ko 2023-12-12T09:28:09.619 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/i2c-dev.ko 2023-12-12T09:28:09.619 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/i2c-mux.ko 2023-12-12T09:28:09.619 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/i2c-slave-eeprom.ko 2023-12-12T09:28:09.619 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/i2c-smbus.ko 2023-12-12T09:28:09.619 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/i2c-stub.ko 2023-12-12T09:28:09.619 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband 2023-12-12T09:28:09.620 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/core 2023-12-12T09:28:09.620 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/core/ib_cm.ko 2023-12-12T09:28:09.620 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/core/ib_core.ko 2023-12-12T09:28:09.620 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/core/ib_umad.ko 2023-12-12T09:28:09.620 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/core/ib_uverbs.ko 2023-12-12T09:28:09.620 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/core/iw_cm.ko 2023-12-12T09:28:09.620 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/core/rdma_cm.ko 2023-12-12T09:28:09.620 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/core/rdma_ucm.ko 2023-12-12T09:28:09.620 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw 2023-12-12T09:28:09.620 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw/cxgb4 2023-12-12T09:28:09.620 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2023-12-12T09:28:09.620 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw/mlx4 2023-12-12T09:28:09.620 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2023-12-12T09:28:09.620 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw/mlx5 2023-12-12T09:28:09.621 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2023-12-12T09:28:09.621 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw/mthca 2023-12-12T09:28:09.621 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2023-12-12T09:28:09.621 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp 2023-12-12T09:28:09.621 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp/ipoib 2023-12-12T09:28:09.621 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2023-12-12T09:28:09.621 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp/iser 2023-12-12T09:28:09.621 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2023-12-12T09:28:09.621 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp/isert 2023-12-12T09:28:09.621 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2023-12-12T09:28:09.621 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp/srp 2023-12-12T09:28:09.621 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2023-12-12T09:28:09.621 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp/srpt 2023-12-12T09:28:09.621 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2023-12-12T09:28:09.621 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input 2023-12-12T09:28:09.621 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/gameport 2023-12-12T09:28:09.622 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/gameport/emu10k1-gp.ko 2023-12-12T09:28:09.622 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/gameport/fm801-gp.ko 2023-12-12T09:28:09.622 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/gameport/gameport.ko 2023-12-12T09:28:09.622 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/joydev.ko 2023-12-12T09:28:09.622 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/keyboard 2023-12-12T09:28:09.622 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/keyboard/gpio_keys.ko 2023-12-12T09:28:09.622 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/mouse 2023-12-12T09:28:09.622 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/mouse/appletouch.ko 2023-12-12T09:28:09.622 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/mouse/bcm5974.ko 2023-12-12T09:28:09.622 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/mouse/cyapatp.ko 2023-12-12T09:28:09.622 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/mouse/elan_i2c.ko 2023-12-12T09:28:09.622 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/mouse/sermouse.ko 2023-12-12T09:28:09.622 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/mouse/synaptics_i2c.ko 2023-12-12T09:28:09.622 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/mouse/synaptics_usb.ko 2023-12-12T09:28:09.622 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/mouse/vsxxxaa.ko 2023-12-12T09:28:09.623 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/rmi4 2023-12-12T09:28:09.623 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/rmi4/rmi_core.ko 2023-12-12T09:28:09.623 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/serio 2023-12-12T09:28:09.623 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/serio/altera_ps2.ko 2023-12-12T09:28:09.623 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/serio/arc_ps2.ko 2023-12-12T09:28:09.623 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/serio/hyperv-keyboard.ko 2023-12-12T09:28:09.623 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/serio/serio_raw.ko 2023-12-12T09:28:09.623 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/sparse-keymap.ko 2023-12-12T09:28:09.623 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/iommu 2023-12-12T09:28:09.623 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/iommu/amd 2023-12-12T09:28:09.623 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/iommu/amd/iommu_v2.ko 2023-12-12T09:28:09.623 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds 2023-12-12T09:28:09.623 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-blinkm.ko 2023-12-12T09:28:09.623 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-lm3530.ko 2023-12-12T09:28:09.624 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-lp3944.ko 2023-12-12T09:28:09.624 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-ss4200.ko 2023-12-12T09:28:09.624 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/trigger 2023-12-12T09:28:09.624 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/trigger/ledtrig-audio.ko 2023-12-12T09:28:09.624 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2023-12-12T09:28:09.624 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/trigger/ledtrig-camera.ko 2023-12-12T09:28:09.624 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2023-12-12T09:28:09.624 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2023-12-12T09:28:09.624 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2023-12-12T09:28:09.624 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/trigger/ledtrig-timer.ko 2023-12-12T09:28:09.624 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/trigger/ledtrig-transient.ko 2023-12-12T09:28:09.624 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md 2023-12-12T09:28:09.624 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/bcache 2023-12-12T09:28:09.624 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/bcache/bcache.ko 2023-12-12T09:28:09.624 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-bio-prison.ko 2023-12-12T09:28:09.625 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-cache-smq.ko 2023-12-12T09:28:09.625 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-cache.ko 2023-12-12T09:28:09.625 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-crypt.ko 2023-12-12T09:28:09.625 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-delay.ko 2023-12-12T09:28:09.625 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-flakey.ko 2023-12-12T09:28:09.625 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-log-userspace.ko 2023-12-12T09:28:09.625 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-multipath.ko 2023-12-12T09:28:09.625 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-queue-length.ko 2023-12-12T09:28:09.625 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-raid.ko 2023-12-12T09:28:09.625 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-round-robin.ko 2023-12-12T09:28:09.625 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-service-time.ko 2023-12-12T09:28:09.625 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-switch.ko 2023-12-12T09:28:09.625 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-thin-pool.ko 2023-12-12T09:28:09.625 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-verity.ko 2023-12-12T09:28:09.625 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/faulty.ko 2023-12-12T09:28:09.626 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/linear.ko 2023-12-12T09:28:09.626 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/multipath.ko 2023-12-12T09:28:09.626 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/persistent-data 2023-12-12T09:28:09.626 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2023-12-12T09:28:09.626 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/raid0.ko 2023-12-12T09:28:09.626 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/raid1.ko 2023-12-12T09:28:09.626 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/raid10.ko 2023-12-12T09:28:09.626 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/raid456.ko 2023-12-12T09:28:09.626 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/message 2023-12-12T09:28:09.626 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/message/fusion 2023-12-12T09:28:09.626 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/message/fusion/mptbase.ko 2023-12-12T09:28:09.626 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/message/fusion/mptctl.ko 2023-12-12T09:28:09.626 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/message/fusion/mptfc.ko 2023-12-12T09:28:09.626 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/message/fusion/mptlan.ko 2023-12-12T09:28:09.626 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/message/fusion/mptsas.ko 2023-12-12T09:28:09.626 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/message/fusion/mptscsih.ko 2023-12-12T09:28:09.627 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/message/fusion/mptspi.ko 2023-12-12T09:28:09.627 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd 2023-12-12T09:28:09.627 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/lpc_ich.ko 2023-12-12T09:28:09.627 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/lpc_sch.ko 2023-12-12T09:28:09.627 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/mfd-core.ko 2023-12-12T09:28:09.627 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/sm501.ko 2023-12-12T09:28:09.627 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/viperboard.ko 2023-12-12T09:28:09.627 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/vx855.ko 2023-12-12T09:28:09.627 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/wl1273-core.ko 2023-12-12T09:28:09.627 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc 2023-12-12T09:28:09.627 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/altera-stapl 2023-12-12T09:28:09.627 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2023-12-12T09:28:09.627 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/apds9802als.ko 2023-12-12T09:28:09.627 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/apds990x.ko 2023-12-12T09:28:09.627 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/bh1770glc.ko 2023-12-12T09:28:09.628 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/cb710 2023-12-12T09:28:09.628 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/cb710/cb710.ko 2023-12-12T09:28:09.628 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/eeprom 2023-12-12T09:28:09.628 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/eeprom/at24.ko 2023-12-12T09:28:09.628 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/eeprom/eeprom.ko 2023-12-12T09:28:09.628 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2023-12-12T09:28:09.628 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/eeprom/max6875.ko 2023-12-12T09:28:09.628 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/enclosure.ko 2023-12-12T09:28:09.628 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/hpilo.ko 2023-12-12T09:28:09.628 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/isl29003.ko 2023-12-12T09:28:09.628 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/isl29020.ko 2023-12-12T09:28:09.628 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/lis3lv02d 2023-12-12T09:28:09.628 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2023-12-12T09:28:09.628 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2023-12-12T09:28:09.629 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/mei 2023-12-12T09:28:09.629 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/mei/mei-me.ko 2023-12-12T09:28:09.629 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/mei/mei-txe.ko 2023-12-12T09:28:09.629 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/mei/mei.ko 2023-12-12T09:28:09.629 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/sgi-gru 2023-12-12T09:28:09.629 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/sgi-gru/gru.ko 2023-12-12T09:28:09.629 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/sgi-xp 2023-12-12T09:28:09.629 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/sgi-xp/xp.ko 2023-12-12T09:28:09.629 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/sgi-xp/xpc.ko 2023-12-12T09:28:09.629 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/sgi-xp/xpnet.ko 2023-12-12T09:28:09.629 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/tifm_7xx1.ko 2023-12-12T09:28:09.629 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/tifm_core.ko 2023-12-12T09:28:09.629 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/tsl2550.ko 2023-12-12T09:28:09.629 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/vmw_balloon.ko 2023-12-12T09:28:09.629 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/vmw_vmci 2023-12-12T09:28:09.630 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2023-12-12T09:28:09.630 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net 2023-12-12T09:28:09.630 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/bonding 2023-12-12T09:28:09.630 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/bonding/bonding.ko 2023-12-12T09:28:09.630 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/dsa 2023-12-12T09:28:09.630 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/dsa/b53 2023-12-12T09:28:09.630 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/dsa/b53/b53_common.ko 2023-12-12T09:28:09.630 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/dsa/bcm-sf2.ko 2023-12-12T09:28:09.630 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/dsa/mv88e6060.ko 2023-12-12T09:28:09.630 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/dsa/mv88e6xxx 2023-12-12T09:28:09.630 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2023-12-12T09:28:09.630 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/dummy.ko 2023-12-12T09:28:09.630 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/eql.ko 2023-12-12T09:28:09.630 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet 2023-12-12T09:28:09.631 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/3com 2023-12-12T09:28:09.631 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2023-12-12T09:28:09.631 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2023-12-12T09:28:09.631 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/3com/3c59x.ko 2023-12-12T09:28:09.631 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/3com/typhoon.ko 2023-12-12T09:28:09.631 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/8390 2023-12-12T09:28:09.631 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/8390/8390.ko 2023-12-12T09:28:09.631 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2023-12-12T09:28:09.631 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2023-12-12T09:28:09.631 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2023-12-12T09:28:09.631 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/adaptec 2023-12-12T09:28:09.631 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/adaptec/starfire.ko 2023-12-12T09:28:09.631 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/agere 2023-12-12T09:28:09.631 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/agere/et131x.ko 2023-12-12T09:28:09.631 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/alteon 2023-12-12T09:28:09.632 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/alteon/acenic.ko 2023-12-12T09:28:09.632 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/altera 2023-12-12T09:28:09.632 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/altera/altera_tse.ko 2023-12-12T09:28:09.632 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/amd 2023-12-12T09:28:09.632 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/amd/amd8111e.ko 2023-12-12T09:28:09.632 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2023-12-12T09:28:09.632 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/amd/pcnet32.ko 2023-12-12T09:28:09.632 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/atheros 2023-12-12T09:28:09.632 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/atheros/alx 2023-12-12T09:28:09.632 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2023-12-12T09:28:09.632 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/atheros/atl1c 2023-12-12T09:28:09.632 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2023-12-12T09:28:09.632 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/atheros/atl1e 2023-12-12T09:28:09.632 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2023-12-12T09:28:09.632 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/atheros/atlx 2023-12-12T09:28:09.633 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2023-12-12T09:28:09.633 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2023-12-12T09:28:09.633 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/broadcom 2023-12-12T09:28:09.633 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/broadcom/b44.ko 2023-12-12T09:28:09.633 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2023-12-12T09:28:09.633 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/broadcom/bnx2x 2023-12-12T09:28:09.633 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2023-12-12T09:28:09.633 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/broadcom/cnic.ko 2023-12-12T09:28:09.633 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/broadcom/genet 2023-12-12T09:28:09.633 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2023-12-12T09:28:09.633 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/broadcom/tg3.ko 2023-12-12T09:28:09.633 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/brocade 2023-12-12T09:28:09.633 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/brocade/bna 2023-12-12T09:28:09.633 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2023-12-12T09:28:09.633 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio 2023-12-12T09:28:09.634 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio/cxgb 2023-12-12T09:28:09.634 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2023-12-12T09:28:09.634 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio/cxgb3 2023-12-12T09:28:09.634 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2023-12-12T09:28:09.634 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio/cxgb4 2023-12-12T09:28:09.634 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2023-12-12T09:28:09.634 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2023-12-12T09:28:09.634 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2023-12-12T09:28:09.634 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio/libcxgb 2023-12-12T09:28:09.634 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2023-12-12T09:28:09.634 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/cisco 2023-12-12T09:28:09.634 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/cisco/enic 2023-12-12T09:28:09.634 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2023-12-12T09:28:09.634 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dec 2023-12-12T09:28:09.634 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dec/tulip 2023-12-12T09:28:09.635 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2023-12-12T09:28:09.635 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2023-12-12T09:28:09.635 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2023-12-12T09:28:09.635 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2023-12-12T09:28:09.635 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2023-12-12T09:28:09.635 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2023-12-12T09:28:09.635 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dlink 2023-12-12T09:28:09.635 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dlink/dl2k.ko 2023-12-12T09:28:09.635 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dlink/sundance.ko 2023-12-12T09:28:09.635 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dnet.ko 2023-12-12T09:28:09.635 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/emulex 2023-12-12T09:28:09.635 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/emulex/benet 2023-12-12T09:28:09.635 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2023-12-12T09:28:09.635 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/ethoc.ko 2023-12-12T09:28:09.635 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/fealnx.ko 2023-12-12T09:28:09.636 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel 2023-12-12T09:28:09.636 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/e100.ko 2023-12-12T09:28:09.636 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/e1000 2023-12-12T09:28:09.636 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2023-12-12T09:28:09.636 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/e1000e 2023-12-12T09:28:09.636 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2023-12-12T09:28:09.636 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/fm10k 2023-12-12T09:28:09.636 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2023-12-12T09:28:09.636 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/i40e 2023-12-12T09:28:09.636 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2023-12-12T09:28:09.636 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/iavf 2023-12-12T09:28:09.636 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2023-12-12T09:28:09.636 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/igb 2023-12-12T09:28:09.636 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/igb/igb.ko 2023-12-12T09:28:09.636 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/igbvf 2023-12-12T09:28:09.636 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2023-12-12T09:28:09.637 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/ixgbe 2023-12-12T09:28:09.637 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2023-12-12T09:28:09.637 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/ixgbevf 2023-12-12T09:28:09.637 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2023-12-12T09:28:09.637 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/jme.ko 2023-12-12T09:28:09.637 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/marvell 2023-12-12T09:28:09.637 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2023-12-12T09:28:09.637 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/marvell/skge.ko 2023-12-12T09:28:09.637 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/marvell/sky2.ko 2023-12-12T09:28:09.637 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/mellanox 2023-12-12T09:28:09.637 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/mellanox/mlx4 2023-12-12T09:28:09.637 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2023-12-12T09:28:09.637 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2023-12-12T09:28:09.637 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/mellanox/mlx5 2023-12-12T09:28:09.638 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/mellanox/mlx5/core 2023-12-12T09:28:09.638 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2023-12-12T09:28:09.638 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/micrel 2023-12-12T09:28:09.638 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2023-12-12T09:28:09.638 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/myricom 2023-12-12T09:28:09.638 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/myricom/myri10ge 2023-12-12T09:28:09.638 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2023-12-12T09:28:09.638 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/natsemi 2023-12-12T09:28:09.638 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2023-12-12T09:28:09.638 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2023-12-12T09:28:09.638 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/neterion 2023-12-12T09:28:09.638 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/neterion/s2io.ko 2023-12-12T09:28:09.638 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/nvidia 2023-12-12T09:28:09.638 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2023-12-12T09:28:09.639 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/packetengines 2023-12-12T09:28:09.639 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2023-12-12T09:28:09.639 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2023-12-12T09:28:09.639 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/qlogic 2023-12-12T09:28:09.639 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/qlogic/netxen 2023-12-12T09:28:09.639 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2023-12-12T09:28:09.639 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2023-12-12T09:28:09.639 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/qlogic/qlcnic 2023-12-12T09:28:09.639 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2023-12-12T09:28:09.639 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/rdc 2023-12-12T09:28:09.639 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/rdc/r6040.ko 2023-12-12T09:28:09.639 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/realtek 2023-12-12T09:28:09.639 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/realtek/8139cp.ko 2023-12-12T09:28:09.639 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/realtek/8139too.ko 2023-12-12T09:28:09.640 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/realtek/atp.ko 2023-12-12T09:28:09.640 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/realtek/r8169.ko 2023-12-12T09:28:09.640 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/rocker 2023-12-12T09:28:09.640 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/rocker/rocker.ko 2023-12-12T09:28:09.640 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/sfc 2023-12-12T09:28:09.640 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/sfc/sfc.ko 2023-12-12T09:28:09.640 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/silan 2023-12-12T09:28:09.640 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/silan/sc92031.ko 2023-12-12T09:28:09.640 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/sis 2023-12-12T09:28:09.640 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/sis/sis190.ko 2023-12-12T09:28:09.640 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/sis/sis900.ko 2023-12-12T09:28:09.640 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/smsc 2023-12-12T09:28:09.640 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/smsc/epic100.ko 2023-12-12T09:28:09.640 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2023-12-12T09:28:09.640 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2023-12-12T09:28:09.641 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2023-12-12T09:28:09.641 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/stmicro 2023-12-12T09:28:09.641 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/stmicro/stmmac 2023-12-12T09:28:09.641 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2023-12-12T09:28:09.641 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2023-12-12T09:28:09.641 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/sun 2023-12-12T09:28:09.641 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/sun/cassini.ko 2023-12-12T09:28:09.641 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/sun/niu.ko 2023-12-12T09:28:09.641 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/sun/sungem.ko 2023-12-12T09:28:09.641 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/sun/sunhme.ko 2023-12-12T09:28:09.641 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/tehuti 2023-12-12T09:28:09.641 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2023-12-12T09:28:09.641 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/ti 2023-12-12T09:28:09.641 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/ti/tlan.ko 2023-12-12T09:28:09.641 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/via 2023-12-12T09:28:09.642 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/via/via-rhine.ko 2023-12-12T09:28:09.642 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/via/via-velocity.ko 2023-12-12T09:28:09.642 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/wiznet 2023-12-12T09:28:09.642 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/wiznet/w5100.ko 2023-12-12T09:28:09.642 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/wiznet/w5300.ko 2023-12-12T09:28:09.642 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/xircom 2023-12-12T09:28:09.642 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2023-12-12T09:28:09.642 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/geneve.ko 2023-12-12T09:28:09.642 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/hyperv 2023-12-12T09:28:09.642 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/hyperv/hv_netvsc.ko 2023-12-12T09:28:09.642 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ieee802154 2023-12-12T09:28:09.642 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ieee802154/fakelb.ko 2023-12-12T09:28:09.642 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ifb.ko 2023-12-12T09:28:09.642 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ipvlan 2023-12-12T09:28:09.643 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ipvlan/ipvlan.ko 2023-12-12T09:28:09.643 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/macvlan.ko 2023-12-12T09:28:09.643 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/macvtap.ko 2023-12-12T09:28:09.643 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/mdio 2023-12-12T09:28:09.643 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/mdio.ko 2023-12-12T09:28:09.643 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2023-12-12T09:28:09.643 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/mdio/mdio-bitbang.ko 2023-12-12T09:28:09.643 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/mdio/mdio-regmap.ko 2023-12-12T09:28:09.643 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/mii.ko 2023-12-12T09:28:09.643 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/net_failover.ko 2023-12-12T09:28:09.643 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/netconsole.ko 2023-12-12T09:28:09.643 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/nlmon.ko 2023-12-12T09:28:09.643 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/pcs 2023-12-12T09:28:09.643 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/pcs/pcs-lynx.ko 2023-12-12T09:28:09.644 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/pcs/pcs_xpcs.ko 2023-12-12T09:28:09.644 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy 2023-12-12T09:28:09.644 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/amd.ko 2023-12-12T09:28:09.644 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/bcm-phy-lib.ko 2023-12-12T09:28:09.644 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/bcm-phy-ptp.ko 2023-12-12T09:28:09.644 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/bcm7xxx.ko 2023-12-12T09:28:09.644 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/bcm87xx.ko 2023-12-12T09:28:09.644 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/broadcom.ko 2023-12-12T09:28:09.644 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/cicada.ko 2023-12-12T09:28:09.644 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/davicom.ko 2023-12-12T09:28:09.644 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/dp83640.ko 2023-12-12T09:28:09.644 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/et1011c.ko 2023-12-12T09:28:09.644 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/icplus.ko 2023-12-12T09:28:09.644 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/lxt.ko 2023-12-12T09:28:09.644 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/marvell.ko 2023-12-12T09:28:09.645 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/micrel.ko 2023-12-12T09:28:09.645 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/national.ko 2023-12-12T09:28:09.645 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/phylink.ko 2023-12-12T09:28:09.645 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/qsemi.ko 2023-12-12T09:28:09.645 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/realtek.ko 2023-12-12T09:28:09.645 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/smsc.ko 2023-12-12T09:28:09.645 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/ste10Xp.ko 2023-12-12T09:28:09.645 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/vitesse.ko 2023-12-12T09:28:09.645 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ppp 2023-12-12T09:28:09.645 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ppp/bsd_comp.ko 2023-12-12T09:28:09.645 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ppp/ppp_async.ko 2023-12-12T09:28:09.645 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ppp/ppp_deflate.ko 2023-12-12T09:28:09.645 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ppp/ppp_generic.ko 2023-12-12T09:28:09.645 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ppp/ppp_mppe.ko 2023-12-12T09:28:09.645 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ppp/ppp_synctty.ko 2023-12-12T09:28:09.646 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ppp/pppoe.ko 2023-12-12T09:28:09.646 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ppp/pppox.ko 2023-12-12T09:28:09.646 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ppp/pptp.ko 2023-12-12T09:28:09.646 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/slip 2023-12-12T09:28:09.646 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/slip/slhc.ko 2023-12-12T09:28:09.646 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/slip/slip.ko 2023-12-12T09:28:09.646 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/sungem_phy.ko 2023-12-12T09:28:09.646 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/tap.ko 2023-12-12T09:28:09.646 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/team 2023-12-12T09:28:09.646 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/team/team.ko 2023-12-12T09:28:09.646 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/team/team_mode_activebackup.ko 2023-12-12T09:28:09.646 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/team/team_mode_broadcast.ko 2023-12-12T09:28:09.646 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/team/team_mode_loadbalance.ko 2023-12-12T09:28:09.646 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/team/team_mode_random.ko 2023-12-12T09:28:09.646 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/team/team_mode_roundrobin.ko 2023-12-12T09:28:09.647 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/tun.ko 2023-12-12T09:28:09.647 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/veth.ko 2023-12-12T09:28:09.647 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/virtio_net.ko 2023-12-12T09:28:09.647 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/vmxnet3 2023-12-12T09:28:09.647 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/vmxnet3/vmxnet3.ko 2023-12-12T09:28:09.647 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/vxlan 2023-12-12T09:28:09.647 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/vxlan/vxlan.ko 2023-12-12T09:28:09.647 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/xen-netback 2023-12-12T09:28:09.647 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/xen-netback/xen-netback.ko 2023-12-12T09:28:09.647 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/xen-netfront.ko 2023-12-12T09:28:09.647 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ntb 2023-12-12T09:28:09.647 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ntb/ntb.ko 2023-12-12T09:28:09.647 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/nvme 2023-12-12T09:28:09.647 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/nvme/host 2023-12-12T09:28:09.647 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/nvme/host/nvme-core.ko 2023-12-12T09:28:09.648 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/nvme/host/nvme.ko 2023-12-12T09:28:09.648 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/parport 2023-12-12T09:28:09.648 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/parport/parport.ko 2023-12-12T09:28:09.648 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/parport/parport_cs.ko 2023-12-12T09:28:09.648 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/parport/parport_pc.ko 2023-12-12T09:28:09.648 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/parport/parport_serial.ko 2023-12-12T09:28:09.648 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pci 2023-12-12T09:28:09.648 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pci/hotplug 2023-12-12T09:28:09.648 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2023-12-12T09:28:09.648 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pci/pcie 2023-12-12T09:28:09.648 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pci/pcie/aer_inject.ko 2023-12-12T09:28:09.648 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pci/xen-pcifront.ko 2023-12-12T09:28:09.648 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pcmcia 2023-12-12T09:28:09.648 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pcmcia/i82092.ko 2023-12-12T09:28:09.648 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pcmcia/pd6729.ko 2023-12-12T09:28:09.649 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pcmcia/yenta_socket.ko 2023-12-12T09:28:09.649 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pinctrl 2023-12-12T09:28:09.649 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pinctrl/intel 2023-12-12T09:28:09.649 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2023-12-12T09:28:09.649 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform 2023-12-12T09:28:09.649 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86 2023-12-12T09:28:09.649 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/acer-wmi.ko 2023-12-12T09:28:09.649 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/acerhdf.ko 2023-12-12T09:28:09.649 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/apple-gmux.ko 2023-12-12T09:28:09.649 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/asus-laptop.ko 2023-12-12T09:28:09.649 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/asus-nb-wmi.ko 2023-12-12T09:28:09.649 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/asus-wmi.ko 2023-12-12T09:28:09.649 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/classmate-laptop.ko 2023-12-12T09:28:09.649 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/eeepc-laptop.ko 2023-12-12T09:28:09.649 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/eeepc-wmi.ko 2023-12-12T09:28:09.650 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/fujitsu-laptop.ko 2023-12-12T09:28:09.650 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/fujitsu-tablet.ko 2023-12-12T09:28:09.650 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/hdaps.ko 2023-12-12T09:28:09.650 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/intel 2023-12-12T09:28:09.650 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/intel/intel-rst.ko 2023-12-12T09:28:09.650 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/intel_ips.ko 2023-12-12T09:28:09.650 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/msi-wmi.ko 2023-12-12T09:28:09.650 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/mxm-wmi.ko 2023-12-12T09:28:09.650 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/panasonic-laptop.ko 2023-12-12T09:28:09.650 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/samsung-laptop.ko 2023-12-12T09:28:09.650 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/samsung-q10.ko 2023-12-12T09:28:09.650 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/topstar-laptop.ko 2023-12-12T09:28:09.650 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2023-12-12T09:28:09.650 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/toshiba_haps.ko 2023-12-12T09:28:09.650 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/wmi-bmof.ko 2023-12-12T09:28:09.651 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/wmi.ko 2023-12-12T09:28:09.651 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/powercap 2023-12-12T09:28:09.651 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/powercap/intel_rapl_common.ko 2023-12-12T09:28:09.651 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/powercap/intel_rapl_msr.ko 2023-12-12T09:28:09.651 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pps 2023-12-12T09:28:09.651 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pps/clients 2023-12-12T09:28:09.651 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pps/clients/pps-gpio.ko 2023-12-12T09:28:09.651 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pps/clients/pps-ldisc.ko 2023-12-12T09:28:09.651 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pps/clients/pps_parport.ko 2023-12-12T09:28:09.651 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pps/pps_core.ko 2023-12-12T09:28:09.651 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ptp 2023-12-12T09:28:09.651 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ptp/ptp.ko 2023-12-12T09:28:09.651 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ptp/ptp_kvm.ko 2023-12-12T09:28:09.651 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc 2023-12-12T09:28:09.652 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-bq32k.ko 2023-12-12T09:28:09.652 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-ds1286.ko 2023-12-12T09:28:09.652 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-ds1307.ko 2023-12-12T09:28:09.652 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-ds1374.ko 2023-12-12T09:28:09.652 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-ds1511.ko 2023-12-12T09:28:09.652 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-ds1553.ko 2023-12-12T09:28:09.652 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-ds1672.ko 2023-12-12T09:28:09.652 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-ds1742.ko 2023-12-12T09:28:09.652 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-ds2404.ko 2023-12-12T09:28:09.652 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-ds3232.ko 2023-12-12T09:28:09.652 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-em3027.ko 2023-12-12T09:28:09.652 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-fm3130.ko 2023-12-12T09:28:09.652 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-isl12022.ko 2023-12-12T09:28:09.652 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-isl1208.ko 2023-12-12T09:28:09.652 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-m41t80.ko 2023-12-12T09:28:09.653 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-m48t35.ko 2023-12-12T09:28:09.653 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-m48t59.ko 2023-12-12T09:28:09.653 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-max6900.ko 2023-12-12T09:28:09.653 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-msm6242.ko 2023-12-12T09:28:09.653 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-pcf2127.ko 2023-12-12T09:28:09.653 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-pcf85063.ko 2023-12-12T09:28:09.653 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-pcf8523.ko 2023-12-12T09:28:09.653 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-pcf8563.ko 2023-12-12T09:28:09.653 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-pcf8583.ko 2023-12-12T09:28:09.653 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-rp5c01.ko 2023-12-12T09:28:09.653 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-rs5c372.ko 2023-12-12T09:28:09.653 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-rv3029c2.ko 2023-12-12T09:28:09.653 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-rx8025.ko 2023-12-12T09:28:09.653 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-rx8581.ko 2023-12-12T09:28:09.654 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-stk17ta8.ko 2023-12-12T09:28:09.654 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-x1205.ko 2023-12-12T09:28:09.654 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi 2023-12-12T09:28:09.654 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/3w-9xxx.ko 2023-12-12T09:28:09.654 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/3w-sas.ko 2023-12-12T09:28:09.654 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/3w-xxxx.ko 2023-12-12T09:28:09.654 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/BusLogic.ko 2023-12-12T09:28:09.654 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/a100u2w.ko 2023-12-12T09:28:09.654 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/aacraid 2023-12-12T09:28:09.654 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/aacraid/aacraid.ko 2023-12-12T09:28:09.654 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/advansys.ko 2023-12-12T09:28:09.654 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/aic7xxx 2023-12-12T09:28:09.654 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2023-12-12T09:28:09.655 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2023-12-12T09:28:09.655 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/am53c974.ko 2023-12-12T09:28:09.655 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/arcmsr 2023-12-12T09:28:09.655 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/arcmsr/arcmsr.ko 2023-12-12T09:28:09.655 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/atp870u.ko 2023-12-12T09:28:09.655 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/be2iscsi 2023-12-12T09:28:09.655 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2023-12-12T09:28:09.655 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/bfa 2023-12-12T09:28:09.655 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/bfa/bfa.ko 2023-12-12T09:28:09.655 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/bnx2fc 2023-12-12T09:28:09.655 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2023-12-12T09:28:09.655 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/bnx2i 2023-12-12T09:28:09.655 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/bnx2i/bnx2i.ko 2023-12-12T09:28:09.655 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/ch.ko 2023-12-12T09:28:09.655 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/csiostor 2023-12-12T09:28:09.656 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/csiostor/csiostor.ko 2023-12-12T09:28:09.656 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/cxgbi 2023-12-12T09:28:09.656 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/cxgbi/cxgb3i 2023-12-12T09:28:09.656 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2023-12-12T09:28:09.656 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/cxgbi/cxgb4i 2023-12-12T09:28:09.656 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2023-12-12T09:28:09.656 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2023-12-12T09:28:09.656 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/dc395x.ko 2023-12-12T09:28:09.656 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/device_handler 2023-12-12T09:28:09.656 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2023-12-12T09:28:09.656 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2023-12-12T09:28:09.656 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2023-12-12T09:28:09.656 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2023-12-12T09:28:09.656 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/dmx3191d.ko 2023-12-12T09:28:09.656 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/esas2r 2023-12-12T09:28:09.657 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/esas2r/esas2r.ko 2023-12-12T09:28:09.657 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/esp_scsi.ko 2023-12-12T09:28:09.657 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/fcoe 2023-12-12T09:28:09.657 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/fcoe/fcoe.ko 2023-12-12T09:28:09.657 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/fcoe/libfcoe.ko 2023-12-12T09:28:09.657 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/fnic 2023-12-12T09:28:09.657 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/fnic/fnic.ko 2023-12-12T09:28:09.657 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/hpsa.ko 2023-12-12T09:28:09.657 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/hptiop.ko 2023-12-12T09:28:09.657 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/hv_storvsc.ko 2023-12-12T09:28:09.657 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/initio.ko 2023-12-12T09:28:09.657 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/ipr.ko 2023-12-12T09:28:09.657 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/ips.ko 2023-12-12T09:28:09.657 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/isci 2023-12-12T09:28:09.657 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/isci/isci.ko 2023-12-12T09:28:09.658 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2023-12-12T09:28:09.658 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/iscsi_tcp.ko 2023-12-12T09:28:09.658 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/libfc 2023-12-12T09:28:09.658 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/libfc/libfc.ko 2023-12-12T09:28:09.658 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/libiscsi.ko 2023-12-12T09:28:09.658 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/libiscsi_tcp.ko 2023-12-12T09:28:09.658 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/libsas 2023-12-12T09:28:09.658 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/libsas/libsas.ko 2023-12-12T09:28:09.658 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/lpfc 2023-12-12T09:28:09.658 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/lpfc/lpfc.ko 2023-12-12T09:28:09.658 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/megaraid 2023-12-12T09:28:09.658 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/megaraid.ko 2023-12-12T09:28:09.658 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2023-12-12T09:28:09.658 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2023-12-12T09:28:09.658 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2023-12-12T09:28:09.659 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/mpt3sas 2023-12-12T09:28:09.659 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2023-12-12T09:28:09.659 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/mvsas 2023-12-12T09:28:09.659 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/mvsas/mvsas.ko 2023-12-12T09:28:09.659 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/mvumi.ko 2023-12-12T09:28:09.659 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/pm8001 2023-12-12T09:28:09.659 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/pm8001/pm80xx.ko 2023-12-12T09:28:09.659 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/pmcraid.ko 2023-12-12T09:28:09.659 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/qla1280.ko 2023-12-12T09:28:09.659 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/qla2xxx 2023-12-12T09:28:09.659 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2023-12-12T09:28:09.659 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2023-12-12T09:28:09.659 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/qla4xxx 2023-12-12T09:28:09.659 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2023-12-12T09:28:09.659 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/raid_class.ko 2023-12-12T09:28:09.660 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/scsi_debug.ko 2023-12-12T09:28:09.660 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/scsi_transport_fc.ko 2023-12-12T09:28:09.660 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/scsi_transport_iscsi.ko 2023-12-12T09:28:09.660 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/scsi_transport_sas.ko 2023-12-12T09:28:09.660 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/scsi_transport_spi.ko 2023-12-12T09:28:09.660 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/scsi_transport_srp.ko 2023-12-12T09:28:09.660 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/ses.ko 2023-12-12T09:28:09.660 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/st.ko 2023-12-12T09:28:09.660 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/stex.ko 2023-12-12T09:28:09.660 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/sym53c8xx_2 2023-12-12T09:28:09.660 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2023-12-12T09:28:09.660 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/virtio_scsi.ko 2023-12-12T09:28:09.660 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/vmw_pvscsi.ko 2023-12-12T09:28:09.661 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/wd719x.ko 2023-12-12T09:28:09.661 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ssb 2023-12-12T09:28:09.661 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ssb/ssb.ko 2023-12-12T09:28:09.661 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target 2023-12-12T09:28:09.661 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/iscsi 2023-12-12T09:28:09.661 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2023-12-12T09:28:09.661 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/loopback 2023-12-12T09:28:09.661 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/loopback/tcm_loop.ko 2023-12-12T09:28:09.661 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/target_core_file.ko 2023-12-12T09:28:09.661 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/target_core_iblock.ko 2023-12-12T09:28:09.661 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/target_core_mod.ko 2023-12-12T09:28:09.661 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/target_core_pscsi.ko 2023-12-12T09:28:09.661 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/target_core_user.ko 2023-12-12T09:28:09.661 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/tcm_fc 2023-12-12T09:28:09.661 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/tcm_fc/tcm_fc.ko 2023-12-12T09:28:09.661 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal 2023-12-12T09:28:09.662 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel 2023-12-12T09:28:09.662 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal 2023-12-12T09:28:09.662 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2023-12-12T09:28:09.662 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2023-12-12T09:28:09.662 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2023-12-12T09:28:09.662 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2023-12-12T09:28:09.662 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2023-12-12T09:28:09.662 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2023-12-12T09:28:09.662 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2023-12-12T09:28:09.662 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2023-12-12T09:28:09.662 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2023-12-12T09:28:09.662 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2023-12-12T09:28:09.662 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2023-12-12T09:28:09.662 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2023-12-12T09:28:09.663 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2023-12-12T09:28:09.663 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2023-12-12T09:28:09.663 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2023-12-12T09:28:09.663 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty 2023-12-12T09:28:09.663 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/ipwireless 2023-12-12T09:28:09.663 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/ipwireless/ipwireless.ko 2023-12-12T09:28:09.663 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/n_gsm.ko 2023-12-12T09:28:09.663 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/n_hdlc.ko 2023-12-12T09:28:09.663 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/nozomi.ko 2023-12-12T09:28:09.663 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/serial 2023-12-12T09:28:09.663 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/serial/8250 2023-12-12T09:28:09.663 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/serial/8250/serial_cs.ko 2023-12-12T09:28:09.663 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/serial/arc_uart.ko 2023-12-12T09:28:09.663 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/serial/jsm 2023-12-12T09:28:09.663 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/serial/jsm/jsm.ko 2023-12-12T09:28:09.663 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ufs 2023-12-12T09:28:09.664 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ufs/core 2023-12-12T09:28:09.664 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ufs/core/ufshcd-core.ko 2023-12-12T09:28:09.664 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ufs/host 2023-12-12T09:28:09.664 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ufs/host/ufshcd-pci.ko 2023-12-12T09:28:09.664 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/uio 2023-12-12T09:28:09.664 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/uio/uio.ko 2023-12-12T09:28:09.664 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/uio/uio_aec.ko 2023-12-12T09:28:09.664 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/uio/uio_cif.ko 2023-12-12T09:28:09.664 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/uio/uio_pci_generic.ko 2023-12-12T09:28:09.664 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/uio/uio_sercos3.ko 2023-12-12T09:28:09.664 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb 2023-12-12T09:28:09.664 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/class 2023-12-12T09:28:09.664 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/class/cdc-acm.ko 2023-12-12T09:28:09.664 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/class/cdc-wdm.ko 2023-12-12T09:28:09.664 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/class/usblp.ko 2023-12-12T09:28:09.665 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/class/usbtmc.ko 2023-12-12T09:28:09.665 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/host 2023-12-12T09:28:09.665 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/host/sl811-hcd.ko 2023-12-12T09:28:09.665 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/image 2023-12-12T09:28:09.665 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/image/mdc800.ko 2023-12-12T09:28:09.665 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/image/microtek.ko 2023-12-12T09:28:09.665 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc 2023-12-12T09:28:09.665 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/adutux.ko 2023-12-12T09:28:09.665 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/appledisplay.ko 2023-12-12T09:28:09.665 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/emi26.ko 2023-12-12T09:28:09.665 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/emi62.ko 2023-12-12T09:28:09.665 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/ezusb.ko 2023-12-12T09:28:09.665 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/idmouse.ko 2023-12-12T09:28:09.665 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/iowarrior.ko 2023-12-12T09:28:09.665 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/isight_firmware.ko 2023-12-12T09:28:09.666 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/ldusb.ko 2023-12-12T09:28:09.666 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/legousbtower.ko 2023-12-12T09:28:09.666 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/sisusbvga 2023-12-12T09:28:09.666 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2023-12-12T09:28:09.666 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/trancevibrator.ko 2023-12-12T09:28:09.666 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/usb3503.ko 2023-12-12T09:28:09.666 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/usblcd.ko 2023-12-12T09:28:09.666 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/usbsevseg.ko 2023-12-12T09:28:09.666 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/uss720.ko 2023-12-12T09:28:09.670 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/yurex.ko 2023-12-12T09:28:09.670 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/phy 2023-12-12T09:28:09.670 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/phy/phy-generic.ko 2023-12-12T09:28:09.670 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial 2023-12-12T09:28:09.670 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/aircable.ko 2023-12-12T09:28:09.670 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/ark3116.ko 2023-12-12T09:28:09.670 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/belkin_sa.ko 2023-12-12T09:28:09.670 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/ch341.ko 2023-12-12T09:28:09.670 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/cp210x.ko 2023-12-12T09:28:09.670 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/cyberjack.ko 2023-12-12T09:28:09.670 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/cypress_m8.ko 2023-12-12T09:28:09.670 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/digi_acceleport.ko 2023-12-12T09:28:09.670 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/empeg.ko 2023-12-12T09:28:09.671 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/ftdi_sio.ko 2023-12-12T09:28:09.671 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/garmin_gps.ko 2023-12-12T09:28:09.671 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/io_edgeport.ko 2023-12-12T09:28:09.671 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/io_ti.ko 2023-12-12T09:28:09.671 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/ipaq.ko 2023-12-12T09:28:09.671 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/ipw.ko 2023-12-12T09:28:09.671 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/ir-usb.ko 2023-12-12T09:28:09.671 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/iuu_phoenix.ko 2023-12-12T09:28:09.671 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/keyspan.ko 2023-12-12T09:28:09.671 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/keyspan_pda.ko 2023-12-12T09:28:09.671 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/kl5kusb105.ko 2023-12-12T09:28:09.671 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/kobil_sct.ko 2023-12-12T09:28:09.671 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/mct_u232.ko 2023-12-12T09:28:09.671 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/mos7720.ko 2023-12-12T09:28:09.672 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/mos7840.ko 2023-12-12T09:28:09.672 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/navman.ko 2023-12-12T09:28:09.672 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/omninet.ko 2023-12-12T09:28:09.672 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/opticon.ko 2023-12-12T09:28:09.672 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/option.ko 2023-12-12T09:28:09.672 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/oti6858.ko 2023-12-12T09:28:09.672 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/pl2303.ko 2023-12-12T09:28:09.672 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/qcaux.ko 2023-12-12T09:28:09.672 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/qcserial.ko 2023-12-12T09:28:09.672 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/quatech2.ko 2023-12-12T09:28:09.672 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/safe_serial.ko 2023-12-12T09:28:09.672 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/sierra.ko 2023-12-12T09:28:09.672 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/spcp8x5.ko 2023-12-12T09:28:09.672 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/ssu100.ko 2023-12-12T09:28:09.673 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/symbolserial.ko 2023-12-12T09:28:09.673 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2023-12-12T09:28:09.673 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/usb-serial-simple.ko 2023-12-12T09:28:09.673 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/usb_debug.ko 2023-12-12T09:28:09.673 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/usb_wwan.ko 2023-12-12T09:28:09.673 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/visor.ko 2023-12-12T09:28:09.673 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/whiteheat.ko 2023-12-12T09:28:09.673 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/xsens_mt.ko 2023-12-12T09:28:09.673 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage 2023-12-12T09:28:09.673 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/uas.ko 2023-12-12T09:28:09.673 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-alauda.ko 2023-12-12T09:28:09.673 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-cypress.ko 2023-12-12T09:28:09.673 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-datafab.ko 2023-12-12T09:28:09.673 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-eneub6250.ko 2023-12-12T09:28:09.673 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-freecom.ko 2023-12-12T09:28:09.674 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-isd200.ko 2023-12-12T09:28:09.674 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-jumpshot.ko 2023-12-12T09:28:09.674 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-karma.ko 2023-12-12T09:28:09.674 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-onetouch.ko 2023-12-12T09:28:09.674 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-realtek.ko 2023-12-12T09:28:09.674 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-sddr09.ko 2023-12-12T09:28:09.674 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-sddr55.ko 2023-12-12T09:28:09.674 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-usbat.ko 2023-12-12T09:28:09.674 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/usb-storage.ko 2023-12-12T09:28:09.674 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/usbip 2023-12-12T09:28:09.674 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/usbip/usbip-core.ko 2023-12-12T09:28:09.674 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/usbip/usbip-host.ko 2023-12-12T09:28:09.674 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/usbip/vhci-hcd.ko 2023-12-12T09:28:09.674 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vfio 2023-12-12T09:28:09.675 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vfio/pci 2023-12-12T09:28:09.675 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vfio/pci/vfio-pci-core.ko 2023-12-12T09:28:09.675 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vfio/pci/vfio-pci.ko 2023-12-12T09:28:09.675 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vfio/vfio.ko 2023-12-12T09:28:09.675 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vfio/vfio_iommu_type1.ko 2023-12-12T09:28:09.675 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vhost 2023-12-12T09:28:09.675 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vhost/vhost.ko 2023-12-12T09:28:09.675 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vhost/vhost_iotlb.ko 2023-12-12T09:28:09.675 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vhost/vhost_net.ko 2023-12-12T09:28:09.675 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vhost/vhost_scsi.ko 2023-12-12T09:28:09.675 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video 2023-12-12T09:28:09.675 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight 2023-12-12T09:28:09.675 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight/apple_bl.ko 2023-12-12T09:28:09.675 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight/lcd.ko 2023-12-12T09:28:09.676 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight/platform_lcd.ko 2023-12-12T09:28:09.676 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/virtio 2023-12-12T09:28:09.676 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/virtio/virtio.ko 2023-12-12T09:28:09.676 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/virtio/virtio_balloon.ko 2023-12-12T09:28:09.676 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/virtio/virtio_mmio.ko 2023-12-12T09:28:09.676 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/virtio/virtio_pci.ko 2023-12-12T09:28:09.676 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2023-12-12T09:28:09.676 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2023-12-12T09:28:09.676 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/virtio/virtio_ring.ko 2023-12-12T09:28:09.676 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1 2023-12-12T09:28:09.676 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/masters 2023-12-12T09:28:09.676 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/masters/ds2482.ko 2023-12-12T09:28:09.676 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/masters/ds2490.ko 2023-12-12T09:28:09.676 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves 2023-12-12T09:28:09.676 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_ds2406.ko 2023-12-12T09:28:09.677 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_ds2408.ko 2023-12-12T09:28:09.677 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_ds2413.ko 2023-12-12T09:28:09.677 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_ds2423.ko 2023-12-12T09:28:09.677 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_ds2431.ko 2023-12-12T09:28:09.677 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_ds2433.ko 2023-12-12T09:28:09.677 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_ds2780.ko 2023-12-12T09:28:09.677 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_ds2781.ko 2023-12-12T09:28:09.677 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_ds28e04.ko 2023-12-12T09:28:09.677 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_smem.ko 2023-12-12T09:28:09.677 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_therm.ko 2023-12-12T09:28:09.677 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/wire.ko 2023-12-12T09:28:09.677 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog 2023-12-12T09:28:09.677 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/alim1535_wdt.ko 2023-12-12T09:28:09.677 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/alim7101_wdt.ko 2023-12-12T09:28:09.677 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/f71808e_wdt.ko 2023-12-12T09:28:09.677 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/hpwdt.ko 2023-12-12T09:28:09.678 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/i6300esb.ko 2023-12-12T09:28:09.678 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/iTCO_vendor_support.ko 2023-12-12T09:28:09.678 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/iTCO_wdt.ko 2023-12-12T09:28:09.678 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/ib700wdt.ko 2023-12-12T09:28:09.678 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/ibmasr.ko 2023-12-12T09:28:09.678 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/ie6xx_wdt.ko 2023-12-12T09:28:09.678 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/it8712f_wdt.ko 2023-12-12T09:28:09.678 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/it87_wdt.ko 2023-12-12T09:28:09.678 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/machzwd.ko 2023-12-12T09:28:09.678 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/nv_tco.ko 2023-12-12T09:28:09.678 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/pcwd_pci.ko 2023-12-12T09:28:09.678 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/pcwd_usb.ko 2023-12-12T09:28:09.678 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2023-12-12T09:28:09.678 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/sch311x_wdt.ko 2023-12-12T09:28:09.679 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/softdog.ko 2023-12-12T09:28:09.679 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/sp5100_tco.ko 2023-12-12T09:28:09.679 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/via_wdt.ko 2023-12-12T09:28:09.679 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/w83627hf_wdt.ko 2023-12-12T09:28:09.679 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/w83877f_wdt.ko 2023-12-12T09:28:09.679 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/w83977f_wdt.ko 2023-12-12T09:28:09.679 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/wdt_pci.ko 2023-12-12T09:28:09.679 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/xen_wdt.ko 2023-12-12T09:28:09.679 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/xen 2023-12-12T09:28:09.679 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/xen/xen-acpi-processor.ko 2023-12-12T09:28:09.679 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/xen/xen-evtchn.ko 2023-12-12T09:28:09.679 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/xen/xen-gntalloc.ko 2023-12-12T09:28:09.679 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/xen/xen-gntdev.ko 2023-12-12T09:28:09.679 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/xen/xen-pciback 2023-12-12T09:28:09.679 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2023-12-12T09:28:09.680 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/xen/xen-privcmd.ko 2023-12-12T09:28:09.680 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/xen/xenfs 2023-12-12T09:28:09.680 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/xen/xenfs/xenfs.ko 2023-12-12T09:28:09.680 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs 2023-12-12T09:28:09.680 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/9p 2023-12-12T09:28:09.680 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/9p/9p.ko 2023-12-12T09:28:09.680 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/affs 2023-12-12T09:28:09.680 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/affs/affs.ko 2023-12-12T09:28:09.680 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/befs 2023-12-12T09:28:09.680 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/befs/befs.ko 2023-12-12T09:28:09.680 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/binfmt_misc.ko 2023-12-12T09:28:09.680 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/btrfs 2023-12-12T09:28:09.680 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/btrfs/btrfs.ko 2023-12-12T09:28:09.680 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/cachefiles 2023-12-12T09:28:09.680 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/cachefiles/cachefiles.ko 2023-12-12T09:28:09.681 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ceph 2023-12-12T09:28:09.681 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ceph/ceph.ko 2023-12-12T09:28:09.681 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/coda 2023-12-12T09:28:09.681 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/coda/coda.ko 2023-12-12T09:28:09.681 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/cramfs 2023-12-12T09:28:09.681 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/cramfs/cramfs.ko 2023-12-12T09:28:09.681 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/dlm 2023-12-12T09:28:09.681 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/dlm/dlm.ko 2023-12-12T09:28:09.681 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ecryptfs 2023-12-12T09:28:09.681 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ecryptfs/ecryptfs.ko 2023-12-12T09:28:09.681 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/f2fs 2023-12-12T09:28:09.681 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/f2fs/f2fs.ko 2023-12-12T09:28:09.681 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/fat 2023-12-12T09:28:09.681 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/fat/fat.ko 2023-12-12T09:28:09.681 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/fat/msdos.ko 2023-12-12T09:28:09.682 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/fat/vfat.ko 2023-12-12T09:28:09.682 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/fscache 2023-12-12T09:28:09.682 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/fscache/fscache.ko 2023-12-12T09:28:09.682 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/fuse 2023-12-12T09:28:09.682 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/fuse/cuse.ko 2023-12-12T09:28:09.682 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/fuse/fuse.ko 2023-12-12T09:28:09.682 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/gfs2 2023-12-12T09:28:09.682 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/gfs2/gfs2.ko 2023-12-12T09:28:09.682 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/hfs 2023-12-12T09:28:09.682 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/hfs/hfs.ko 2023-12-12T09:28:09.682 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/hfsplus 2023-12-12T09:28:09.682 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/hfsplus/hfsplus.ko 2023-12-12T09:28:09.682 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/isofs 2023-12-12T09:28:09.682 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/isofs/isofs.ko 2023-12-12T09:28:09.683 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/jfs 2023-12-12T09:28:09.683 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/jfs/jfs.ko 2023-12-12T09:28:09.683 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/lockd 2023-12-12T09:28:09.683 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/lockd/lockd.ko 2023-12-12T09:28:09.683 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/minix 2023-12-12T09:28:09.683 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/minix/minix.ko 2023-12-12T09:28:09.683 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/netfs 2023-12-12T09:28:09.683 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/netfs/netfs.ko 2023-12-12T09:28:09.683 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs 2023-12-12T09:28:09.683 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs/blocklayout 2023-12-12T09:28:09.683 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2023-12-12T09:28:09.683 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs/filelayout 2023-12-12T09:28:09.683 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2023-12-12T09:28:09.683 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs/flexfilelayout 2023-12-12T09:28:09.683 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2023-12-12T09:28:09.683 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs/nfs.ko 2023-12-12T09:28:09.684 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs/nfsv3.ko 2023-12-12T09:28:09.684 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs/nfsv4.ko 2023-12-12T09:28:09.684 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs_common 2023-12-12T09:28:09.684 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs_common/grace.ko 2023-12-12T09:28:09.684 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs_common/nfs_acl.ko 2023-12-12T09:28:09.684 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfsd 2023-12-12T09:28:09.684 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfsd/nfsd.ko 2023-12-12T09:28:09.684 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nilfs2 2023-12-12T09:28:09.684 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nilfs2/nilfs2.ko 2023-12-12T09:28:09.684 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls 2023-12-12T09:28:09.684 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-celtic.ko 2023-12-12T09:28:09.684 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-centeuro.ko 2023-12-12T09:28:09.684 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-croatian.ko 2023-12-12T09:28:09.684 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-cyrillic.ko 2023-12-12T09:28:09.684 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-gaelic.ko 2023-12-12T09:28:09.685 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-greek.ko 2023-12-12T09:28:09.685 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-iceland.ko 2023-12-12T09:28:09.685 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-inuit.ko 2023-12-12T09:28:09.685 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-roman.ko 2023-12-12T09:28:09.685 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-romanian.ko 2023-12-12T09:28:09.685 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-turkish.ko 2023-12-12T09:28:09.685 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp1250.ko 2023-12-12T09:28:09.685 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp1251.ko 2023-12-12T09:28:09.685 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp1255.ko 2023-12-12T09:28:09.685 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp737.ko 2023-12-12T09:28:09.685 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp775.ko 2023-12-12T09:28:09.685 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp850.ko 2023-12-12T09:28:09.685 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp852.ko 2023-12-12T09:28:09.685 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp855.ko 2023-12-12T09:28:09.686 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp857.ko 2023-12-12T09:28:09.686 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp860.ko 2023-12-12T09:28:09.686 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp861.ko 2023-12-12T09:28:09.686 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp862.ko 2023-12-12T09:28:09.686 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp863.ko 2023-12-12T09:28:09.686 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp864.ko 2023-12-12T09:28:09.686 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp865.ko 2023-12-12T09:28:09.686 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp866.ko 2023-12-12T09:28:09.686 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp869.ko 2023-12-12T09:28:09.686 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp874.ko 2023-12-12T09:28:09.686 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp932.ko 2023-12-12T09:28:09.686 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp936.ko 2023-12-12T09:28:09.686 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp949.ko 2023-12-12T09:28:09.686 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp950.ko 2023-12-12T09:28:09.686 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_euc-jp.ko 2023-12-12T09:28:09.687 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-1.ko 2023-12-12T09:28:09.687 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-13.ko 2023-12-12T09:28:09.687 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-14.ko 2023-12-12T09:28:09.687 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-15.ko 2023-12-12T09:28:09.687 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-2.ko 2023-12-12T09:28:09.687 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-3.ko 2023-12-12T09:28:09.687 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-4.ko 2023-12-12T09:28:09.687 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-5.ko 2023-12-12T09:28:09.687 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-6.ko 2023-12-12T09:28:09.687 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-7.ko 2023-12-12T09:28:09.687 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-9.ko 2023-12-12T09:28:09.687 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_koi8-r.ko 2023-12-12T09:28:09.687 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_koi8-ru.ko 2023-12-12T09:28:09.687 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_koi8-u.ko 2023-12-12T09:28:09.687 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_ucs2_utils.ko 2023-12-12T09:28:09.687 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_utf8.ko 2023-12-12T09:28:09.688 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2 2023-12-12T09:28:09.688 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2/cluster 2023-12-12T09:28:09.688 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2023-12-12T09:28:09.688 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2/dlm 2023-12-12T09:28:09.688 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2023-12-12T09:28:09.688 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2/dlmfs 2023-12-12T09:28:09.688 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2023-12-12T09:28:09.688 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2/ocfs2.ko 2023-12-12T09:28:09.688 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2023-12-12T09:28:09.688 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2/ocfs2_stack_user.ko 2023-12-12T09:28:09.688 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2/ocfs2_stackglue.ko 2023-12-12T09:28:09.688 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/overlayfs 2023-12-12T09:28:09.688 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/overlayfs/overlay.ko 2023-12-12T09:28:09.688 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/pstore 2023-12-12T09:28:09.689 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/pstore/ramoops.ko 2023-12-12T09:28:09.689 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/reiserfs 2023-12-12T09:28:09.689 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/reiserfs/reiserfs.ko 2023-12-12T09:28:09.689 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/romfs 2023-12-12T09:28:09.689 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/romfs/romfs.ko 2023-12-12T09:28:09.689 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/smb 2023-12-12T09:28:09.689 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/smb/client 2023-12-12T09:28:09.689 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/smb/client/cifs.ko 2023-12-12T09:28:09.689 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/smb/common 2023-12-12T09:28:09.689 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/smb/common/cifs_arc4.ko 2023-12-12T09:28:09.689 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/smb/common/cifs_md4.ko 2023-12-12T09:28:09.689 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/squashfs 2023-12-12T09:28:09.689 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/squashfs/squashfs.ko 2023-12-12T09:28:09.689 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/sysv 2023-12-12T09:28:09.689 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/sysv/sysv.ko 2023-12-12T09:28:09.690 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/udf 2023-12-12T09:28:09.690 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/udf/udf.ko 2023-12-12T09:28:09.690 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ufs 2023-12-12T09:28:09.690 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ufs/ufs.ko 2023-12-12T09:28:09.690 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/xfs 2023-12-12T09:28:09.690 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/xfs/xfs.ko 2023-12-12T09:28:09.690 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/kernel 2023-12-12T09:28:09.690 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/kernel/rcu 2023-12-12T09:28:09.690 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/kernel/rcu/rcutorture.ko 2023-12-12T09:28:09.690 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/kernel/torture.ko 2023-12-12T09:28:09.690 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/kernel/trace 2023-12-12T09:28:09.690 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/kernel/trace/ring_buffer_benchmark.ko 2023-12-12T09:28:09.690 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib 2023-12-12T09:28:09.690 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/asn1_encoder.ko 2023-12-12T09:28:09.690 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/crc-itu-t.ko 2023-12-12T09:28:09.691 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/crc8.ko 2023-12-12T09:28:09.691 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/crypto 2023-12-12T09:28:09.691 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/crypto/libarc4.ko 2023-12-12T09:28:09.691 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/crypto/libdes.ko 2023-12-12T09:28:09.691 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/libcrc32c.ko 2023-12-12T09:28:09.691 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/lru_cache.ko 2023-12-12T09:28:09.691 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/lz4 2023-12-12T09:28:09.691 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/lz4/lz4_compress.ko 2023-12-12T09:28:09.691 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/lz4/lz4hc_compress.ko 2023-12-12T09:28:09.691 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/math 2023-12-12T09:28:09.691 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/math/cordic.ko 2023-12-12T09:28:09.691 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/raid6 2023-12-12T09:28:09.691 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/raid6/raid6_pq.ko 2023-12-12T09:28:09.691 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/reed_solomon 2023-12-12T09:28:09.692 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/reed_solomon/reed_solomon.ko 2023-12-12T09:28:09.692 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/ts_bm.ko 2023-12-12T09:28:09.692 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/ts_fsm.ko 2023-12-12T09:28:09.692 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/ts_kmp.ko 2023-12-12T09:28:09.692 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/zstd 2023-12-12T09:28:09.692 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/zstd/zstd_compress.ko 2023-12-12T09:28:09.692 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/mm 2023-12-12T09:28:09.692 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/mm/hwpoison-inject.ko 2023-12-12T09:28:09.692 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net 2023-12-12T09:28:09.692 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/6lowpan 2023-12-12T09:28:09.692 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/6lowpan/6lowpan.ko 2023-12-12T09:28:09.692 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/6lowpan/nhc_dest.ko 2023-12-12T09:28:09.692 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/6lowpan/nhc_fragment.ko 2023-12-12T09:28:09.692 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/6lowpan/nhc_hop.ko 2023-12-12T09:28:09.692 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/6lowpan/nhc_ipv6.ko 2023-12-12T09:28:09.693 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/6lowpan/nhc_mobility.ko 2023-12-12T09:28:09.693 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/6lowpan/nhc_routing.ko 2023-12-12T09:28:09.693 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/6lowpan/nhc_udp.ko 2023-12-12T09:28:09.693 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/802 2023-12-12T09:28:09.693 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/802/garp.ko 2023-12-12T09:28:09.693 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/802/mrp.ko 2023-12-12T09:28:09.693 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/802/p8022.ko 2023-12-12T09:28:09.693 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/802/psnap.ko 2023-12-12T09:28:09.693 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/802/stp.ko 2023-12-12T09:28:09.693 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/8021q 2023-12-12T09:28:09.693 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/8021q/8021q.ko 2023-12-12T09:28:09.693 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/9p 2023-12-12T09:28:09.693 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/9p/9pnet.ko 2023-12-12T09:28:09.693 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/9p/9pnet_fd.ko 2023-12-12T09:28:09.693 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/9p/9pnet_rdma.ko 2023-12-12T09:28:09.693 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/9p/9pnet_virtio.ko 2023-12-12T09:28:09.694 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/batman-adv 2023-12-12T09:28:09.694 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/batman-adv/batman-adv.ko 2023-12-12T09:28:09.694 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge 2023-12-12T09:28:09.694 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/br_netfilter.ko 2023-12-12T09:28:09.694 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/bridge.ko 2023-12-12T09:28:09.694 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter 2023-12-12T09:28:09.694 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_802_3.ko 2023-12-12T09:28:09.694 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_among.ko 2023-12-12T09:28:09.694 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_arp.ko 2023-12-12T09:28:09.694 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_arpreply.ko 2023-12-12T09:28:09.694 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_dnat.ko 2023-12-12T09:28:09.694 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_ip.ko 2023-12-12T09:28:09.694 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_ip6.ko 2023-12-12T09:28:09.694 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_limit.ko 2023-12-12T09:28:09.695 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_log.ko 2023-12-12T09:28:09.695 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_mark.ko 2023-12-12T09:28:09.695 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_mark_m.ko 2023-12-12T09:28:09.695 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_nflog.ko 2023-12-12T09:28:09.695 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_pkttype.ko 2023-12-12T09:28:09.695 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_redirect.ko 2023-12-12T09:28:09.695 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_snat.ko 2023-12-12T09:28:09.695 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_stp.ko 2023-12-12T09:28:09.695 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_vlan.ko 2023-12-12T09:28:09.695 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebtable_broute.ko 2023-12-12T09:28:09.695 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebtable_filter.ko 2023-12-12T09:28:09.695 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebtable_nat.ko 2023-12-12T09:28:09.695 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebtables.ko 2023-12-12T09:28:09.695 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2023-12-12T09:28:09.696 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2023-12-12T09:28:09.696 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2023-12-12T09:28:09.696 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ceph 2023-12-12T09:28:09.696 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ceph/libceph.ko 2023-12-12T09:28:09.696 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/core 2023-12-12T09:28:09.696 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/core/failover.ko 2023-12-12T09:28:09.696 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/core/pktgen.ko 2023-12-12T09:28:09.696 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dccp 2023-12-12T09:28:09.696 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dccp/dccp.ko 2023-12-12T09:28:09.696 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dccp/dccp_diag.ko 2023-12-12T09:28:09.696 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dccp/dccp_ipv4.ko 2023-12-12T09:28:09.696 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dccp/dccp_ipv6.ko 2023-12-12T09:28:09.696 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dns_resolver 2023-12-12T09:28:09.696 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dns_resolver/dns_resolver.ko 2023-12-12T09:28:09.696 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dsa 2023-12-12T09:28:09.697 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dsa/dsa_core.ko 2023-12-12T09:28:09.697 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dsa/tag_brcm.ko 2023-12-12T09:28:09.697 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dsa/tag_dsa.ko 2023-12-12T09:28:09.697 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dsa/tag_none.ko 2023-12-12T09:28:09.697 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dsa/tag_trailer.ko 2023-12-12T09:28:09.697 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ieee802154 2023-12-12T09:28:09.697 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ieee802154/6lowpan 2023-12-12T09:28:09.697 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2023-12-12T09:28:09.697 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ieee802154/ieee802154.ko 2023-12-12T09:28:09.697 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ieee802154/ieee802154_socket.ko 2023-12-12T09:28:09.697 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4 2023-12-12T09:28:09.697 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/ah4.ko 2023-12-12T09:28:09.697 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/esp4.ko 2023-12-12T09:28:09.697 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/fou.ko 2023-12-12T09:28:09.698 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/gre.ko 2023-12-12T09:28:09.698 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/inet_diag.ko 2023-12-12T09:28:09.698 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/ip_gre.ko 2023-12-12T09:28:09.698 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/ip_tunnel.ko 2023-12-12T09:28:09.698 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/ip_vti.ko 2023-12-12T09:28:09.698 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/ipcomp.ko 2023-12-12T09:28:09.698 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/ipip.ko 2023-12-12T09:28:09.698 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter 2023-12-12T09:28:09.698 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/arp_tables.ko 2023-12-12T09:28:09.698 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/arpt_mangle.ko 2023-12-12T09:28:09.698 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/arptable_filter.ko 2023-12-12T09:28:09.698 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/ipt_ECN.ko 2023-12-12T09:28:09.698 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2023-12-12T09:28:09.698 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/ipt_ah.ko 2023-12-12T09:28:09.699 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2023-12-12T09:28:09.699 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/iptable_mangle.ko 2023-12-12T09:28:09.699 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/iptable_nat.ko 2023-12-12T09:28:09.699 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/iptable_raw.ko 2023-12-12T09:28:09.699 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/iptable_security.ko 2023-12-12T09:28:09.699 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2023-12-12T09:28:09.699 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2023-12-12T09:28:09.699 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2023-12-12T09:28:09.699 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2023-12-12T09:28:09.699 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2023-12-12T09:28:09.699 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2023-12-12T09:28:09.699 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2023-12-12T09:28:09.699 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2023-12-12T09:28:09.699 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2023-12-12T09:28:09.700 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2023-12-12T09:28:09.700 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_bic.ko 2023-12-12T09:28:09.700 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_dctcp.ko 2023-12-12T09:28:09.700 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_diag.ko 2023-12-12T09:28:09.700 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_highspeed.ko 2023-12-12T09:28:09.700 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_htcp.ko 2023-12-12T09:28:09.700 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_hybla.ko 2023-12-12T09:28:09.700 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_illinois.ko 2023-12-12T09:28:09.700 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_lp.ko 2023-12-12T09:28:09.700 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_scalable.ko 2023-12-12T09:28:09.700 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_vegas.ko 2023-12-12T09:28:09.700 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_veno.ko 2023-12-12T09:28:09.700 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_westwood.ko 2023-12-12T09:28:09.700 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_yeah.ko 2023-12-12T09:28:09.700 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tunnel4.ko 2023-12-12T09:28:09.700 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/udp_diag.ko 2023-12-12T09:28:09.701 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/udp_tunnel.ko 2023-12-12T09:28:09.701 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/xfrm4_tunnel.ko 2023-12-12T09:28:09.701 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6 2023-12-12T09:28:09.701 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/ah6.ko 2023-12-12T09:28:09.701 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/esp6.ko 2023-12-12T09:28:09.701 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/fou6.ko 2023-12-12T09:28:09.701 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/ip6_tunnel.ko 2023-12-12T09:28:09.701 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/ip6_udp_tunnel.ko 2023-12-12T09:28:09.701 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/ip6_vti.ko 2023-12-12T09:28:09.701 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/ipcomp6.ko 2023-12-12T09:28:09.701 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter 2023-12-12T09:28:09.701 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6_tables.ko 2023-12-12T09:28:09.701 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2023-12-12T09:28:09.701 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2023-12-12T09:28:09.702 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6t_ah.ko 2023-12-12T09:28:09.702 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2023-12-12T09:28:09.702 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6t_frag.ko 2023-12-12T09:28:09.702 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2023-12-12T09:28:09.702 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2023-12-12T09:28:09.702 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6t_mh.ko 2023-12-12T09:28:09.702 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2023-12-12T09:28:09.702 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6t_rt.ko 2023-12-12T09:28:09.702 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6table_filter.ko 2023-12-12T09:28:09.702 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2023-12-12T09:28:09.702 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6table_nat.ko 2023-12-12T09:28:09.702 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6table_raw.ko 2023-12-12T09:28:09.702 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6table_security.ko 2023-12-12T09:28:09.702 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2023-12-12T09:28:09.702 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2023-12-12T09:28:09.703 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2023-12-12T09:28:09.703 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2023-12-12T09:28:09.703 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2023-12-12T09:28:09.703 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2023-12-12T09:28:09.703 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2023-12-12T09:28:09.703 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2023-12-12T09:28:09.703 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/sit.ko 2023-12-12T09:28:09.703 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/tunnel6.ko 2023-12-12T09:28:09.703 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/xfrm6_tunnel.ko 2023-12-12T09:28:09.703 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/key 2023-12-12T09:28:09.703 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/key/af_key.ko 2023-12-12T09:28:09.703 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/l2tp 2023-12-12T09:28:09.703 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/l2tp/l2tp_core.ko 2023-12-12T09:28:09.703 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/l2tp/l2tp_debugfs.ko 2023-12-12T09:28:09.703 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/l2tp/l2tp_eth.ko 2023-12-12T09:28:09.704 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/l2tp/l2tp_ip.ko 2023-12-12T09:28:09.704 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/l2tp/l2tp_ip6.ko 2023-12-12T09:28:09.704 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/l2tp/l2tp_netlink.ko 2023-12-12T09:28:09.704 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/l2tp/l2tp_ppp.ko 2023-12-12T09:28:09.704 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/llc 2023-12-12T09:28:09.704 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/llc/llc.ko 2023-12-12T09:28:09.704 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/mac802154 2023-12-12T09:28:09.704 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/mac802154/mac802154.ko 2023-12-12T09:28:09.704 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/mpls 2023-12-12T09:28:09.704 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/mpls/mpls_gso.ko 2023-12-12T09:28:09.704 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter 2023-12-12T09:28:09.704 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset 2023-12-12T09:28:09.704 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set.ko 2023-12-12T09:28:09.704 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2023-12-12T09:28:09.705 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2023-12-12T09:28:09.705 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2023-12-12T09:28:09.705 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2023-12-12T09:28:09.705 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2023-12-12T09:28:09.705 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2023-12-12T09:28:09.705 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2023-12-12T09:28:09.705 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2023-12-12T09:28:09.705 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2023-12-12T09:28:09.705 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2023-12-12T09:28:09.705 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2023-12-12T09:28:09.705 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2023-12-12T09:28:09.705 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2023-12-12T09:28:09.705 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2023-12-12T09:28:09.705 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_list_set.ko 2023-12-12T09:28:09.706 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs 2023-12-12T09:28:09.706 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs.ko 2023-12-12T09:28:09.706 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2023-12-12T09:28:09.706 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2023-12-12T09:28:09.706 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2023-12-12T09:28:09.706 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2023-12-12T09:28:09.706 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2023-12-12T09:28:09.706 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2023-12-12T09:28:09.706 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2023-12-12T09:28:09.706 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2023-12-12T09:28:09.706 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2023-12-12T09:28:09.706 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2023-12-12T09:28:09.706 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2023-12-12T09:28:09.706 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2023-12-12T09:28:09.707 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2023-12-12T09:28:09.707 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conncount.ko 2023-12-12T09:28:09.707 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack.ko 2023-12-12T09:28:09.707 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_amanda.ko 2023-12-12T09:28:09.707 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_broadcast.ko 2023-12-12T09:28:09.707 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_ftp.ko 2023-12-12T09:28:09.707 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_h323.ko 2023-12-12T09:28:09.707 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_irc.ko 2023-12-12T09:28:09.707 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2023-12-12T09:28:09.707 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_netlink.ko 2023-12-12T09:28:09.707 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_pptp.ko 2023-12-12T09:28:09.707 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_sane.ko 2023-12-12T09:28:09.707 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_sip.ko 2023-12-12T09:28:09.707 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_snmp.ko 2023-12-12T09:28:09.708 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_tftp.ko 2023-12-12T09:28:09.708 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_dup_netdev.ko 2023-12-12T09:28:09.708 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_flow_table.ko 2023-12-12T09:28:09.708 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_flow_table_inet.ko 2023-12-12T09:28:09.708 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_log_syslog.ko 2023-12-12T09:28:09.708 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_nat.ko 2023-12-12T09:28:09.708 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_nat_amanda.ko 2023-12-12T09:28:09.708 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_nat_ftp.ko 2023-12-12T09:28:09.708 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_nat_irc.ko 2023-12-12T09:28:09.708 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_nat_sip.ko 2023-12-12T09:28:09.708 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_nat_tftp.ko 2023-12-12T09:28:09.708 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_synproxy_core.ko 2023-12-12T09:28:09.708 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_tables.ko 2023-12-12T09:28:09.708 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nfnetlink.ko 2023-12-12T09:28:09.708 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nfnetlink_acct.ko 2023-12-12T09:28:09.709 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nfnetlink_log.ko 2023-12-12T09:28:09.709 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nfnetlink_osf.ko 2023-12-12T09:28:09.709 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nfnetlink_queue.ko 2023-12-12T09:28:09.709 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_chain_nat.ko 2023-12-12T09:28:09.709 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_compat.ko 2023-12-12T09:28:09.709 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_ct.ko 2023-12-12T09:28:09.709 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_dup_netdev.ko 2023-12-12T09:28:09.709 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_fib.ko 2023-12-12T09:28:09.709 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_fwd_netdev.ko 2023-12-12T09:28:09.709 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_hash.ko 2023-12-12T09:28:09.709 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_limit.ko 2023-12-12T09:28:09.709 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_log.ko 2023-12-12T09:28:09.709 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_masq.ko 2023-12-12T09:28:09.709 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_nat.ko 2023-12-12T09:28:09.710 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_numgen.ko 2023-12-12T09:28:09.710 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_queue.ko 2023-12-12T09:28:09.710 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_quota.ko 2023-12-12T09:28:09.710 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_redir.ko 2023-12-12T09:28:09.710 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_reject.ko 2023-12-12T09:28:09.710 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_reject_inet.ko 2023-12-12T09:28:09.710 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_socket.ko 2023-12-12T09:28:09.710 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_tunnel.ko 2023-12-12T09:28:09.710 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_AUDIT.ko 2023-12-12T09:28:09.710 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_CHECKSUM.ko 2023-12-12T09:28:09.710 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_CLASSIFY.ko 2023-12-12T09:28:09.710 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_CONNSECMARK.ko 2023-12-12T09:28:09.710 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_CT.ko 2023-12-12T09:28:09.710 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_DSCP.ko 2023-12-12T09:28:09.710 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_HL.ko 2023-12-12T09:28:09.711 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_HMARK.ko 2023-12-12T09:28:09.711 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_IDLETIMER.ko 2023-12-12T09:28:09.711 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_LED.ko 2023-12-12T09:28:09.711 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_LOG.ko 2023-12-12T09:28:09.711 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_MASQUERADE.ko 2023-12-12T09:28:09.711 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_NETMAP.ko 2023-12-12T09:28:09.711 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_NFLOG.ko 2023-12-12T09:28:09.711 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_NFQUEUE.ko 2023-12-12T09:28:09.711 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_RATEEST.ko 2023-12-12T09:28:09.711 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_REDIRECT.ko 2023-12-12T09:28:09.711 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_SECMARK.ko 2023-12-12T09:28:09.711 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_TCPMSS.ko 2023-12-12T09:28:09.711 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2023-12-12T09:28:09.711 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_TEE.ko 2023-12-12T09:28:09.711 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_TPROXY.ko 2023-12-12T09:28:09.712 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_TRACE.ko 2023-12-12T09:28:09.712 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_addrtype.ko 2023-12-12T09:28:09.712 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_bpf.ko 2023-12-12T09:28:09.712 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_cgroup.ko 2023-12-12T09:28:09.712 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_cluster.ko 2023-12-12T09:28:09.712 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_comment.ko 2023-12-12T09:28:09.712 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_connbytes.ko 2023-12-12T09:28:09.712 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_connlabel.ko 2023-12-12T09:28:09.712 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_connlimit.ko 2023-12-12T09:28:09.712 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_connmark.ko 2023-12-12T09:28:09.712 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_conntrack.ko 2023-12-12T09:28:09.712 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_cpu.ko 2023-12-12T09:28:09.712 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_dccp.ko 2023-12-12T09:28:09.712 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_devgroup.ko 2023-12-12T09:28:09.712 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_dscp.ko 2023-12-12T09:28:09.712 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_ecn.ko 2023-12-12T09:28:09.713 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_esp.ko 2023-12-12T09:28:09.713 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_hashlimit.ko 2023-12-12T09:28:09.713 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_helper.ko 2023-12-12T09:28:09.713 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_hl.ko 2023-12-12T09:28:09.713 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_ipcomp.ko 2023-12-12T09:28:09.713 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_iprange.ko 2023-12-12T09:28:09.713 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_ipvs.ko 2023-12-12T09:28:09.713 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_l2tp.ko 2023-12-12T09:28:09.713 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_length.ko 2023-12-12T09:28:09.713 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_limit.ko 2023-12-12T09:28:09.713 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_mac.ko 2023-12-12T09:28:09.713 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_mark.ko 2023-12-12T09:28:09.713 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_multiport.ko 2023-12-12T09:28:09.713 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_nat.ko 2023-12-12T09:28:09.713 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_nfacct.ko 2023-12-12T09:28:09.714 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_osf.ko 2023-12-12T09:28:09.714 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_owner.ko 2023-12-12T09:28:09.714 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_physdev.ko 2023-12-12T09:28:09.714 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_pkttype.ko 2023-12-12T09:28:09.714 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_policy.ko 2023-12-12T09:28:09.714 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_quota.ko 2023-12-12T09:28:09.714 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_rateest.ko 2023-12-12T09:28:09.714 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_realm.ko 2023-12-12T09:28:09.714 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_recent.ko 2023-12-12T09:28:09.714 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_sctp.ko 2023-12-12T09:28:09.714 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_set.ko 2023-12-12T09:28:09.714 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_socket.ko 2023-12-12T09:28:09.714 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_state.ko 2023-12-12T09:28:09.714 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_statistic.ko 2023-12-12T09:28:09.715 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_string.ko 2023-12-12T09:28:09.715 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_tcpmss.ko 2023-12-12T09:28:09.715 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_time.ko 2023-12-12T09:28:09.715 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_u32.ko 2023-12-12T09:28:09.715 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netlink 2023-12-12T09:28:09.715 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netlink/netlink_diag.ko 2023-12-12T09:28:09.715 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/nsh 2023-12-12T09:28:09.715 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/nsh/nsh.ko 2023-12-12T09:28:09.715 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/openvswitch 2023-12-12T09:28:09.715 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/openvswitch/openvswitch.ko 2023-12-12T09:28:09.715 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/openvswitch/vport-geneve.ko 2023-12-12T09:28:09.715 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/openvswitch/vport-gre.ko 2023-12-12T09:28:09.715 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/openvswitch/vport-vxlan.ko 2023-12-12T09:28:09.715 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/packet 2023-12-12T09:28:09.715 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/packet/af_packet_diag.ko 2023-12-12T09:28:09.716 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/rds 2023-12-12T09:28:09.716 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/rds/rds.ko 2023-12-12T09:28:09.716 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/rds/rds_rdma.ko 2023-12-12T09:28:09.716 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/rds/rds_tcp.ko 2023-12-12T09:28:09.716 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched 2023-12-12T09:28:09.716 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/act_csum.ko 2023-12-12T09:28:09.716 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/act_gact.ko 2023-12-12T09:28:09.716 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/act_ipt.ko 2023-12-12T09:28:09.716 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/act_mirred.ko 2023-12-12T09:28:09.716 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/act_nat.ko 2023-12-12T09:28:09.716 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/act_pedit.ko 2023-12-12T09:28:09.716 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/act_police.ko 2023-12-12T09:28:09.716 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/act_simple.ko 2023-12-12T09:28:09.716 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/act_skbedit.ko 2023-12-12T09:28:09.716 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/act_vlan.ko 2023-12-12T09:28:09.716 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/cls_basic.ko 2023-12-12T09:28:09.717 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/cls_bpf.ko 2023-12-12T09:28:09.717 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/cls_flow.ko 2023-12-12T09:28:09.717 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/cls_fw.ko 2023-12-12T09:28:09.717 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/cls_route.ko 2023-12-12T09:28:09.717 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/cls_u32.ko 2023-12-12T09:28:09.717 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/em_cmp.ko 2023-12-12T09:28:09.717 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/em_ipset.ko 2023-12-12T09:28:09.717 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/em_meta.ko 2023-12-12T09:28:09.717 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/em_nbyte.ko 2023-12-12T09:28:09.717 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/em_text.ko 2023-12-12T09:28:09.717 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/em_u32.ko 2023-12-12T09:28:09.717 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_choke.ko 2023-12-12T09:28:09.717 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_codel.ko 2023-12-12T09:28:09.717 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_drr.ko 2023-12-12T09:28:09.717 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_fq.ko 2023-12-12T09:28:09.718 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_gred.ko 2023-12-12T09:28:09.718 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_hfsc.ko 2023-12-12T09:28:09.718 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_hhf.ko 2023-12-12T09:28:09.718 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_htb.ko 2023-12-12T09:28:09.718 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_ingress.ko 2023-12-12T09:28:09.718 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_mqprio.ko 2023-12-12T09:28:09.718 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_mqprio_lib.ko 2023-12-12T09:28:09.718 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_multiq.ko 2023-12-12T09:28:09.718 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_netem.ko 2023-12-12T09:28:09.718 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_pie.ko 2023-12-12T09:28:09.718 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_plug.ko 2023-12-12T09:28:09.718 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_prio.ko 2023-12-12T09:28:09.718 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_qfq.ko 2023-12-12T09:28:09.718 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_red.ko 2023-12-12T09:28:09.718 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_sfb.ko 2023-12-12T09:28:09.719 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_sfq.ko 2023-12-12T09:28:09.719 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_tbf.ko 2023-12-12T09:28:09.719 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_teql.ko 2023-12-12T09:28:09.719 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sctp 2023-12-12T09:28:09.719 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sctp/sctp.ko 2023-12-12T09:28:09.719 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sctp/sctp_diag.ko 2023-12-12T09:28:09.719 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sunrpc 2023-12-12T09:28:09.719 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sunrpc/auth_gss 2023-12-12T09:28:09.719 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2023-12-12T09:28:09.719 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2023-12-12T09:28:09.719 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sunrpc/sunrpc.ko 2023-12-12T09:28:09.719 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sunrpc/xprtrdma 2023-12-12T09:28:09.719 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2023-12-12T09:28:09.719 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/tipc 2023-12-12T09:28:09.720 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/tipc/diag.ko 2023-12-12T09:28:09.720 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/tipc/tipc.ko 2023-12-12T09:28:09.720 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/unix 2023-12-12T09:28:09.720 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/unix/unix_diag.ko 2023-12-12T09:28:09.720 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/vmw_vsock 2023-12-12T09:28:09.720 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2023-12-12T09:28:09.720 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2023-12-12T09:28:09.720 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/vmw_vsock/vsock.ko 2023-12-12T09:28:09.720 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/vmw_vsock/vsock_diag.ko 2023-12-12T09:28:09.720 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/vmw_vsock/vsock_loopback.ko 2023-12-12T09:28:09.720 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/xfrm 2023-12-12T09:28:09.720 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/xfrm/xfrm_ipcomp.ko 2023-12-12T09:28:09.720 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/security 2023-12-12T09:28:09.720 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/security/keys 2023-12-12T09:28:09.720 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/security/keys/encrypted-keys 2023-12-12T09:28:09.721 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2023-12-12T09:28:09.721 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/security/keys/trusted-keys 2023-12-12T09:28:09.721 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/security/keys/trusted-keys/trusted.ko 2023-12-12T09:28:09.721 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/virt 2023-12-12T09:28:09.721 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/virt/lib 2023-12-12T09:28:09.721 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/virt/lib/irqbypass.ko 2023-12-12T09:28:09.721 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/modules.alias 2023-12-12T09:28:09.721 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/modules.alias.bin 2023-12-12T09:28:09.721 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/modules.builtin 2023-12-12T09:28:09.721 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/modules.builtin.alias.bin 2023-12-12T09:28:09.721 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/modules.builtin.bin 2023-12-12T09:28:09.721 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/modules.builtin.modinfo 2023-12-12T09:28:09.721 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/modules.dep 2023-12-12T09:28:09.721 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/modules.dep.bin 2023-12-12T09:28:09.722 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/modules.devname 2023-12-12T09:28:09.722 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/modules.order 2023-12-12T09:28:09.722 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/modules.softdep 2023-12-12T09:28:09.722 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/modules.symbols 2023-12-12T09:28:09.722 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.6.0-gcd68252d7b4d/modules.symbols.bin 2023-12-12T09:28:09.722 DEBUG:teuthology.task.kernel:get_image_version: 6.6.0-gcd68252d7b4d 2023-12-12T09:28:09.723 DEBUG:teuthology.orchestra.run.smithi073:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2023-12-12T09:28:09.744 INFO:teuthology.orchestra.run.smithi073.stdout:postinstall scriptlet (using /bin/sh): 2023-12-12T09:28:09.744 INFO:teuthology.orchestra.run.smithi073.stdout:if [ -x /sbin/installkernel -a -r /boot/vmlinuz-6.6.0-gcd68252d7b4d -a -r /boot/System.map-6.6.0-gcd68252d7b4d ]; then 2023-12-12T09:28:09.745 INFO:teuthology.orchestra.run.smithi073.stdout:cp /boot/vmlinuz-6.6.0-gcd68252d7b4d /boot/.vmlinuz-6.6.0-gcd68252d7b4d-rpm 2023-12-12T09:28:09.745 INFO:teuthology.orchestra.run.smithi073.stdout:cp /boot/System.map-6.6.0-gcd68252d7b4d /boot/.System.map-6.6.0-gcd68252d7b4d-rpm 2023-12-12T09:28:09.745 INFO:teuthology.orchestra.run.smithi073.stdout:rm -f /boot/vmlinuz-6.6.0-gcd68252d7b4d /boot/System.map-6.6.0-gcd68252d7b4d 2023-12-12T09:28:09.745 INFO:teuthology.orchestra.run.smithi073.stdout:/sbin/installkernel 6.6.0-gcd68252d7b4d /boot/.vmlinuz-6.6.0-gcd68252d7b4d-rpm /boot/.System.map-6.6.0-gcd68252d7b4d-rpm 2023-12-12T09:28:09.745 INFO:teuthology.orchestra.run.smithi073.stdout:rm -f /boot/.vmlinuz-6.6.0-gcd68252d7b4d-rpm /boot/.System.map-6.6.0-gcd68252d7b4d-rpm 2023-12-12T09:28:09.745 INFO:teuthology.orchestra.run.smithi073.stdout:fi 2023-12-12T09:28:09.745 INFO:teuthology.orchestra.run.smithi073.stdout:preuninstall scriptlet (using /bin/sh): 2023-12-12T09:28:09.745 INFO:teuthology.orchestra.run.smithi073.stdout:if [ -x /sbin/new-kernel-pkg ]; then 2023-12-12T09:28:09.745 INFO:teuthology.orchestra.run.smithi073.stdout:new-kernel-pkg --remove 6.6.0-gcd68252d7b4d --rminitrd --initrdfile=/boot/initramfs-6.6.0-gcd68252d7b4d.img 2023-12-12T09:28:09.745 INFO:teuthology.orchestra.run.smithi073.stdout:elif [ -x /usr/bin/kernel-install ]; then 2023-12-12T09:28:09.745 INFO:teuthology.orchestra.run.smithi073.stdout:kernel-install remove 6.6.0-gcd68252d7b4d 2023-12-12T09:28:09.745 INFO:teuthology.orchestra.run.smithi073.stdout:fi 2023-12-12T09:28:09.745 INFO:teuthology.orchestra.run.smithi073.stdout:postuninstall scriptlet (using /bin/sh): 2023-12-12T09:28:09.745 INFO:teuthology.orchestra.run.smithi073.stdout:if [ -x /sbin/update-bootloader ]; then 2023-12-12T09:28:09.745 INFO:teuthology.orchestra.run.smithi073.stdout:/sbin/update-bootloader --remove 6.6.0-gcd68252d7b4d 2023-12-12T09:28:09.745 INFO:teuthology.orchestra.run.smithi073.stdout:fi 2023-12-12T09:28:09.746 DEBUG:teuthology.orchestra.run.smithi073:> sudo rpm -qi grub2-tools 2023-12-12T09:28:09.821 INFO:teuthology.orchestra.run.smithi073.stdout:Name : grub2-tools 2023-12-12T09:28:09.822 INFO:teuthology.orchestra.run.smithi073.stdout:Epoch : 1 2023-12-12T09:28:09.822 INFO:teuthology.orchestra.run.smithi073.stdout:Version : 2.06 2023-12-12T09:28:09.822 INFO:teuthology.orchestra.run.smithi073.stdout:Release : 68.el9 2023-12-12T09:28:09.822 INFO:teuthology.orchestra.run.smithi073.stdout:Architecture: x86_64 2023-12-12T09:28:09.822 INFO:teuthology.orchestra.run.smithi073.stdout:Install Date: Fri 01 Sep 2023 09:14:30 PM UTC 2023-12-12T09:28:09.822 INFO:teuthology.orchestra.run.smithi073.stdout:Group : Unspecified 2023-12-12T09:28:09.822 INFO:teuthology.orchestra.run.smithi073.stdout:Size : 8264254 2023-12-12T09:28:09.822 INFO:teuthology.orchestra.run.smithi073.stdout:License : GPLv3+ 2023-12-12T09:28:09.822 INFO:teuthology.orchestra.run.smithi073.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2023-12-12T09:28:09.822 INFO:teuthology.orchestra.run.smithi073.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2023-12-12T09:28:09.822 INFO:teuthology.orchestra.run.smithi073.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2023-12-12T09:28:09.823 INFO:teuthology.orchestra.run.smithi073.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2023-12-12T09:28:09.823 INFO:teuthology.orchestra.run.smithi073.stdout:Packager : builder@centos.org 2023-12-12T09:28:09.823 INFO:teuthology.orchestra.run.smithi073.stdout:Vendor : CentOS 2023-12-12T09:28:09.823 INFO:teuthology.orchestra.run.smithi073.stdout:URL : http://www.gnu.org/software/grub/ 2023-12-12T09:28:09.823 INFO:teuthology.orchestra.run.smithi073.stdout:Summary : Support tools for GRUB. 2023-12-12T09:28:09.823 INFO:teuthology.orchestra.run.smithi073.stdout:Description : 2023-12-12T09:28:09.823 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-12T09:28:09.823 INFO:teuthology.orchestra.run.smithi073.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2023-12-12T09:28:09.823 INFO:teuthology.orchestra.run.smithi073.stdout:customizable bootloader with modular architecture. It supports a rich 2023-12-12T09:28:09.823 INFO:teuthology.orchestra.run.smithi073.stdout:variety of kernel formats, file systems, computer architectures and 2023-12-12T09:28:09.823 INFO:teuthology.orchestra.run.smithi073.stdout:hardware devices. 2023-12-12T09:28:09.823 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-12T09:28:09.823 INFO:teuthology.orchestra.run.smithi073.stdout:This subpackage provides tools for support of all platforms. 2023-12-12T09:28:09.824 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2023-12-12T09:28:09.824 INFO:teuthology.task.kernel:Updating grub on smithi073 to boot 6.6.0-gcd68252d7b4d 2023-12-12T09:28:09.825 DEBUG:teuthology.orchestra.run.smithi073:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2023-12-12T09:28:10.473 INFO:teuthology.orchestra.run.smithi073.stderr:Generating grub configuration file ... 2023-12-12T09:28:11.874 INFO:teuthology.orchestra.run.smithi073.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2023-12-12T09:28:11.907 INFO:teuthology.orchestra.run.smithi073.stderr:done 2023-12-12T09:28:11.918 DEBUG:teuthology.orchestra.run.smithi073:> mktemp 2023-12-12T09:28:11.932 INFO:teuthology.orchestra.run.smithi073.stdout:/tmp/tmp.LeDwgCVkhV 2023-12-12T09:28:11.933 DEBUG:teuthology.orchestra.run.smithi073:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.LeDwgCVkhV 2023-12-12T09:28:12.002 DEBUG:teuthology.orchestra.run.smithi073:> sudo chmod 0666 /tmp/tmp.LeDwgCVkhV 2023-12-12T09:28:12.145 DEBUG:teuthology.orchestra.remote:smithi073:/tmp/tmp.LeDwgCVkhV is 6KB 2023-12-12T09:28:12.194 DEBUG:teuthology.orchestra.run.smithi073:> rm -fr /tmp/tmp.LeDwgCVkhV 2023-12-12T09:28:12.208 DEBUG:teuthology.orchestra.run.smithi073:> sudo /bin/ls /boot/loader/entries || true 2023-12-12T09:28:12.273 INFO:teuthology.orchestra.run.smithi073.stdout:15949e3c88704300882482eddfd7baae-0-rescue.conf 2023-12-12T09:28:12.273 INFO:teuthology.orchestra.run.smithi073.stdout:15949e3c88704300882482eddfd7baae-5.14.0-239.el9.x86_64.conf 2023-12-12T09:28:12.273 INFO:teuthology.orchestra.run.smithi073.stdout:15949e3c88704300882482eddfd7baae-5.14.0-361.el9.x86_64.conf 2023-12-12T09:28:12.273 INFO:teuthology.orchestra.run.smithi073.stdout:15949e3c88704300882482eddfd7baae-6.6.0-gcd68252d7b4d.conf 2023-12-12T09:28:12.274 DEBUG:teuthology.orchestra.run.smithi073:> sudo grub2-set-default 15949e3c88704300882482eddfd7baae-6.6.0-gcd68252d7b4d 2023-12-12T09:28:12.421 DEBUG:teuthology.orchestra.run.smithi073:> sudo shutdown -r now 2023-12-12T09:28:23.342 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi142.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2023-12-12T09:28:23.342 DEBUG:teuthology.orchestra.run.smithi142:> rpm -qlp /tmp/kernel.x86_64.rpm 2023-12-12T09:28:23.420 INFO:teuthology.orchestra.run.smithi142.stdout:/boot/System.map-6.6.0-gcd68252d7b4d 2023-12-12T09:28:23.420 INFO:teuthology.orchestra.run.smithi142.stdout:/boot/config-6.6.0-gcd68252d7b4d 2023-12-12T09:28:23.420 INFO:teuthology.orchestra.run.smithi142.stdout:/boot/vmlinuz-6.6.0-gcd68252d7b4d 2023-12-12T09:28:23.420 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d 2023-12-12T09:28:23.420 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel 2023-12-12T09:28:23.420 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch 2023-12-12T09:28:23.420 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86 2023-12-12T09:28:23.420 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto 2023-12-12T09:28:23.420 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/blowfish-x86_64.ko 2023-12-12T09:28:23.421 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2023-12-12T09:28:23.421 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2023-12-12T09:28:23.421 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/camellia-x86_64.ko 2023-12-12T09:28:23.421 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2023-12-12T09:28:23.421 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2023-12-12T09:28:23.421 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/crc32-pclmul.ko 2023-12-12T09:28:23.421 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/crc32c-intel.ko 2023-12-12T09:28:23.421 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2023-12-12T09:28:23.421 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2023-12-12T09:28:23.421 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2023-12-12T09:28:23.421 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2023-12-12T09:28:23.421 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/serpent-avx2.ko 2023-12-12T09:28:23.421 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2023-12-12T09:28:23.421 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/sha1-ssse3.ko 2023-12-12T09:28:23.421 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/sha256-ssse3.ko 2023-12-12T09:28:23.422 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/sha512-ssse3.ko 2023-12-12T09:28:23.422 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2023-12-12T09:28:23.422 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2023-12-12T09:28:23.422 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/twofish-x86_64.ko 2023-12-12T09:28:23.422 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/kernel 2023-12-12T09:28:23.422 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/kernel/cpu 2023-12-12T09:28:23.422 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/kernel/cpu/mce 2023-12-12T09:28:23.422 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2023-12-12T09:28:23.422 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/kvm 2023-12-12T09:28:23.422 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/kvm/kvm-amd.ko 2023-12-12T09:28:23.422 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/kvm/kvm-intel.ko 2023-12-12T09:28:23.422 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/kvm/kvm.ko 2023-12-12T09:28:23.422 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto 2023-12-12T09:28:23.422 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/ansi_cprng.ko 2023-12-12T09:28:23.423 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/anubis.ko 2023-12-12T09:28:23.423 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/arc4.ko 2023-12-12T09:28:23.423 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/async_tx 2023-12-12T09:28:23.423 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/async_tx/async_memcpy.ko 2023-12-12T09:28:23.423 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/async_tx/async_pq.ko 2023-12-12T09:28:23.423 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/async_tx/async_raid6_recov.ko 2023-12-12T09:28:23.423 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/async_tx/async_tx.ko 2023-12-12T09:28:23.423 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/async_tx/async_xor.ko 2023-12-12T09:28:23.423 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/async_tx/raid6test.ko 2023-12-12T09:28:23.423 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/authenc.ko 2023-12-12T09:28:23.423 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/authencesn.ko 2023-12-12T09:28:23.423 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/blake2b_generic.ko 2023-12-12T09:28:23.423 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/blowfish_common.ko 2023-12-12T09:28:23.423 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/blowfish_generic.ko 2023-12-12T09:28:23.423 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/camellia_generic.ko 2023-12-12T09:28:23.424 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/cast5_generic.ko 2023-12-12T09:28:23.424 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/cast6_generic.ko 2023-12-12T09:28:23.424 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/cast_common.ko 2023-12-12T09:28:23.424 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/ccm.ko 2023-12-12T09:28:23.424 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/cmac.ko 2023-12-12T09:28:23.424 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/crc32_generic.ko 2023-12-12T09:28:23.424 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/crypto_engine.ko 2023-12-12T09:28:23.424 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/crypto_user.ko 2023-12-12T09:28:23.424 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/cts.ko 2023-12-12T09:28:23.424 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/des_generic.ko 2023-12-12T09:28:23.424 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/dh_generic.ko 2023-12-12T09:28:23.424 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/echainiv.ko 2023-12-12T09:28:23.424 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/essiv.ko 2023-12-12T09:28:23.424 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/fcrypt.ko 2023-12-12T09:28:23.424 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/khazad.ko 2023-12-12T09:28:23.424 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/lz4.ko 2023-12-12T09:28:23.425 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/lz4hc.ko 2023-12-12T09:28:23.425 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/md4.ko 2023-12-12T09:28:23.425 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/michael_mic.ko 2023-12-12T09:28:23.425 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/pcbc.ko 2023-12-12T09:28:23.425 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/pcrypt.ko 2023-12-12T09:28:23.425 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/rmd160.ko 2023-12-12T09:28:23.425 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/seed.ko 2023-12-12T09:28:23.425 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/serpent_generic.ko 2023-12-12T09:28:23.425 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/tcrypt.ko 2023-12-12T09:28:23.425 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/tea.ko 2023-12-12T09:28:23.425 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/twofish_common.ko 2023-12-12T09:28:23.425 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/twofish_generic.ko 2023-12-12T09:28:23.425 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/vmac.ko 2023-12-12T09:28:23.425 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/wp512.ko 2023-12-12T09:28:23.425 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/xcbc.ko 2023-12-12T09:28:23.426 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/xor.ko 2023-12-12T09:28:23.426 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/xxhash_generic.ko 2023-12-12T09:28:23.426 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers 2023-12-12T09:28:23.426 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/acpi 2023-12-12T09:28:23.426 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/acpi/acpi_ipmi.ko 2023-12-12T09:28:23.426 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/acpi/acpi_pad.ko 2023-12-12T09:28:23.426 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/acpi/custom_method.ko 2023-12-12T09:28:23.426 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/acpi/ec_sys.ko 2023-12-12T09:28:23.426 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/acpi/platform_profile.ko 2023-12-12T09:28:23.426 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/acpi/sbs.ko 2023-12-12T09:28:23.426 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/acpi/sbshc.ko 2023-12-12T09:28:23.426 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/acpi/video.ko 2023-12-12T09:28:23.426 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata 2023-12-12T09:28:23.426 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/acard-ahci.ko 2023-12-12T09:28:23.426 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/ahci_platform.ko 2023-12-12T09:28:23.427 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/ata_generic.ko 2023-12-12T09:28:23.427 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/libahci_platform.ko 2023-12-12T09:28:23.427 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_acpi.ko 2023-12-12T09:28:23.427 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_ali.ko 2023-12-12T09:28:23.427 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_amd.ko 2023-12-12T09:28:23.427 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_artop.ko 2023-12-12T09:28:23.427 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_atiixp.ko 2023-12-12T09:28:23.427 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_atp867x.ko 2023-12-12T09:28:23.427 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_cmd640.ko 2023-12-12T09:28:23.427 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_cmd64x.ko 2023-12-12T09:28:23.427 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_cypress.ko 2023-12-12T09:28:23.427 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_efar.ko 2023-12-12T09:28:23.427 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_hpt366.ko 2023-12-12T09:28:23.427 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_hpt37x.ko 2023-12-12T09:28:23.427 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_hpt3x2n.ko 2023-12-12T09:28:23.427 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_hpt3x3.ko 2023-12-12T09:28:23.428 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_it8213.ko 2023-12-12T09:28:23.428 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_it821x.ko 2023-12-12T09:28:23.428 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_jmicron.ko 2023-12-12T09:28:23.428 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_marvell.ko 2023-12-12T09:28:23.428 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_mpiix.ko 2023-12-12T09:28:23.428 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_netcell.ko 2023-12-12T09:28:23.428 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_ninja32.ko 2023-12-12T09:28:23.428 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_ns87410.ko 2023-12-12T09:28:23.428 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_ns87415.ko 2023-12-12T09:28:23.428 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_oldpiix.ko 2023-12-12T09:28:23.428 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_opti.ko 2023-12-12T09:28:23.428 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_optidma.ko 2023-12-12T09:28:23.428 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_pcmcia.ko 2023-12-12T09:28:23.428 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_pdc2027x.ko 2023-12-12T09:28:23.428 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_pdc202xx_old.ko 2023-12-12T09:28:23.429 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_piccolo.ko 2023-12-12T09:28:23.429 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_rdc.ko 2023-12-12T09:28:23.429 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_sch.ko 2023-12-12T09:28:23.429 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_serverworks.ko 2023-12-12T09:28:23.429 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_sil680.ko 2023-12-12T09:28:23.429 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_sis.ko 2023-12-12T09:28:23.429 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_sl82c105.ko 2023-12-12T09:28:23.429 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_triflex.ko 2023-12-12T09:28:23.429 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_via.ko 2023-12-12T09:28:23.429 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pdc_adma.ko 2023-12-12T09:28:23.429 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_inic162x.ko 2023-12-12T09:28:23.429 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_mv.ko 2023-12-12T09:28:23.429 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_nv.ko 2023-12-12T09:28:23.429 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_promise.ko 2023-12-12T09:28:23.429 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_qstor.ko 2023-12-12T09:28:23.430 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_sil.ko 2023-12-12T09:28:23.430 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_sil24.ko 2023-12-12T09:28:23.430 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_sis.ko 2023-12-12T09:28:23.430 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_svw.ko 2023-12-12T09:28:23.430 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_sx4.ko 2023-12-12T09:28:23.430 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_uli.ko 2023-12-12T09:28:23.430 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_via.ko 2023-12-12T09:28:23.430 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_vsc.ko 2023-12-12T09:28:23.430 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/auxdisplay 2023-12-12T09:28:23.430 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/auxdisplay/ks0108.ko 2023-12-12T09:28:23.430 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/base 2023-12-12T09:28:23.430 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/base/regmap 2023-12-12T09:28:23.430 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/base/regmap/regmap-i2c.ko 2023-12-12T09:28:23.430 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/base/regmap/regmap-mmio.ko 2023-12-12T09:28:23.430 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/bcma 2023-12-12T09:28:23.431 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/bcma/bcma.ko 2023-12-12T09:28:23.431 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block 2023-12-12T09:28:23.431 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/aoe 2023-12-12T09:28:23.431 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/aoe/aoe.ko 2023-12-12T09:28:23.431 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/brd.ko 2023-12-12T09:28:23.431 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/drbd 2023-12-12T09:28:23.431 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/drbd/drbd.ko 2023-12-12T09:28:23.431 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/floppy.ko 2023-12-12T09:28:23.431 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/loop.ko 2023-12-12T09:28:23.431 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/mtip32xx 2023-12-12T09:28:23.431 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/mtip32xx/mtip32xx.ko 2023-12-12T09:28:23.431 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/nbd.ko 2023-12-12T09:28:23.431 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/null_blk 2023-12-12T09:28:23.431 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/null_blk/null_blk.ko 2023-12-12T09:28:23.431 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/pktcdvd.ko 2023-12-12T09:28:23.431 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/rbd.ko 2023-12-12T09:28:23.432 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/virtio_blk.ko 2023-12-12T09:28:23.432 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/xen-blkback 2023-12-12T09:28:23.432 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/xen-blkback/xen-blkback.ko 2023-12-12T09:28:23.432 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/xen-blkfront.ko 2023-12-12T09:28:23.432 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/zram 2023-12-12T09:28:23.432 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/zram/zram.ko 2023-12-12T09:28:23.432 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char 2023-12-12T09:28:23.432 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/hangcheck-timer.ko 2023-12-12T09:28:23.432 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/hw_random 2023-12-12T09:28:23.432 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/hw_random/amd-rng.ko 2023-12-12T09:28:23.432 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/hw_random/intel-rng.ko 2023-12-12T09:28:23.432 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/hw_random/timeriomem-rng.ko 2023-12-12T09:28:23.432 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/hw_random/via-rng.ko 2023-12-12T09:28:23.432 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/hw_random/virtio-rng.ko 2023-12-12T09:28:23.432 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/ipmi 2023-12-12T09:28:23.433 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/ipmi/ipmi_devintf.ko 2023-12-12T09:28:23.433 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2023-12-12T09:28:23.433 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2023-12-12T09:28:23.433 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/ipmi/ipmi_si.ko 2023-12-12T09:28:23.433 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/ipmi/ipmi_ssif.ko 2023-12-12T09:28:23.433 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2023-12-12T09:28:23.433 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/lp.ko 2023-12-12T09:28:23.433 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/mwave 2023-12-12T09:28:23.433 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/mwave/mwave.ko 2023-12-12T09:28:23.433 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/ppdev.ko 2023-12-12T09:28:23.433 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/tlclk.ko 2023-12-12T09:28:23.433 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/tpm 2023-12-12T09:28:23.433 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/tpm/tpm.ko 2023-12-12T09:28:23.433 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/tpm/tpm_atmel.ko 2023-12-12T09:28:23.433 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/tpm/tpm_infineon.ko 2023-12-12T09:28:23.433 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/tpm/tpm_nsc.ko 2023-12-12T09:28:23.434 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/tpm/tpm_tis.ko 2023-12-12T09:28:23.434 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/tpm/tpm_tis_core.ko 2023-12-12T09:28:23.434 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/uv_mmtimer.ko 2023-12-12T09:28:23.434 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/virtio_console.ko 2023-12-12T09:28:23.434 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/cpufreq 2023-12-12T09:28:23.434 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/cpufreq/acpi-cpufreq.ko 2023-12-12T09:28:23.434 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2023-12-12T09:28:23.434 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/cpufreq/p4-clockmod.ko 2023-12-12T09:28:23.434 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/cpufreq/pcc-cpufreq.ko 2023-12-12T09:28:23.434 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/cpufreq/powernow-k8.ko 2023-12-12T09:28:23.434 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/cpufreq/speedstep-lib.ko 2023-12-12T09:28:23.434 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto 2023-12-12T09:28:23.434 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/ccp 2023-12-12T09:28:23.434 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/ccp/ccp-crypto.ko 2023-12-12T09:28:23.435 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/ccp/ccp.ko 2023-12-12T09:28:23.435 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/intel 2023-12-12T09:28:23.435 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/intel/qat 2023-12-12T09:28:23.435 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/intel/qat/qat_common 2023-12-12T09:28:23.435 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2023-12-12T09:28:23.435 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2023-12-12T09:28:23.435 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2023-12-12T09:28:23.435 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/padlock-aes.ko 2023-12-12T09:28:23.435 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/padlock-sha.ko 2023-12-12T09:28:23.435 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/virtio 2023-12-12T09:28:23.435 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/virtio/virtio_crypto.ko 2023-12-12T09:28:23.435 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/dca 2023-12-12T09:28:23.435 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/dca/dca.ko 2023-12-12T09:28:23.435 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/devfreq 2023-12-12T09:28:23.435 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/devfreq/governor_simpleondemand.ko 2023-12-12T09:28:23.435 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/dma 2023-12-12T09:28:23.436 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/dma/dw 2023-12-12T09:28:23.436 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/dma/dw/dw_dmac.ko 2023-12-12T09:28:23.436 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/dma/ioat 2023-12-12T09:28:23.436 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/dma/ioat/ioatdma.ko 2023-12-12T09:28:23.436 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac 2023-12-12T09:28:23.436 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/amd64_edac.ko 2023-12-12T09:28:23.436 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/e752x_edac.ko 2023-12-12T09:28:23.436 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/edac_mce_amd.ko 2023-12-12T09:28:23.436 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/i3000_edac.ko 2023-12-12T09:28:23.436 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/i3200_edac.ko 2023-12-12T09:28:23.436 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/i5100_edac.ko 2023-12-12T09:28:23.436 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/i5400_edac.ko 2023-12-12T09:28:23.436 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/i7300_edac.ko 2023-12-12T09:28:23.436 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/i7core_edac.ko 2023-12-12T09:28:23.437 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/i82975x_edac.ko 2023-12-12T09:28:23.437 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/ie31200_edac.ko 2023-12-12T09:28:23.437 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/sb_edac.ko 2023-12-12T09:28:23.437 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/x38_edac.ko 2023-12-12T09:28:23.437 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/firmware 2023-12-12T09:28:23.437 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/firmware/edd.ko 2023-12-12T09:28:23.437 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/firmware/iscsi_ibft.ko 2023-12-12T09:28:23.437 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio 2023-12-12T09:28:23.437 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-ich.ko 2023-12-12T09:28:23.437 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-viperboard.ko 2023-12-12T09:28:23.437 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid 2023-12-12T09:28:23.437 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-appleir.ko 2023-12-12T09:28:23.437 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-aureal.ko 2023-12-12T09:28:23.437 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-axff.ko 2023-12-12T09:28:23.437 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-dr.ko 2023-12-12T09:28:23.438 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-elecom.ko 2023-12-12T09:28:23.438 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-elo.ko 2023-12-12T09:28:23.438 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-emsff.ko 2023-12-12T09:28:23.438 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-gaff.ko 2023-12-12T09:28:23.438 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-gt683r.ko 2023-12-12T09:28:23.438 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-gyration.ko 2023-12-12T09:28:23.438 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-holtek-kbd.ko 2023-12-12T09:28:23.438 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-holtek-mouse.ko 2023-12-12T09:28:23.438 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-holtekff.ko 2023-12-12T09:28:23.438 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-hyperv.ko 2023-12-12T09:28:23.438 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-icade.ko 2023-12-12T09:28:23.438 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-keytouch.ko 2023-12-12T09:28:23.438 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-kye.ko 2023-12-12T09:28:23.438 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-lcpower.ko 2023-12-12T09:28:23.438 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-led.ko 2023-12-12T09:28:23.439 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-lenovo.ko 2023-12-12T09:28:23.439 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-logitech-dj.ko 2023-12-12T09:28:23.439 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-logitech-hidpp.ko 2023-12-12T09:28:23.439 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-multitouch.ko 2023-12-12T09:28:23.439 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-ortek.ko 2023-12-12T09:28:23.439 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-penmount.ko 2023-12-12T09:28:23.439 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-petalynx.ko 2023-12-12T09:28:23.439 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-picolcd.ko 2023-12-12T09:28:23.439 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-pl.ko 2023-12-12T09:28:23.439 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-plantronics.ko 2023-12-12T09:28:23.439 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-primax.ko 2023-12-12T09:28:23.439 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-rmi.ko 2023-12-12T09:28:23.439 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-arvo.ko 2023-12-12T09:28:23.439 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-common.ko 2023-12-12T09:28:23.439 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-isku.ko 2023-12-12T09:28:23.440 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-kone.ko 2023-12-12T09:28:23.440 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-koneplus.ko 2023-12-12T09:28:23.440 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-konepure.ko 2023-12-12T09:28:23.440 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-kovaplus.ko 2023-12-12T09:28:23.440 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-lua.ko 2023-12-12T09:28:23.440 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-pyra.ko 2023-12-12T09:28:23.440 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-ryos.ko 2023-12-12T09:28:23.440 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-savu.ko 2023-12-12T09:28:23.440 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat.ko 2023-12-12T09:28:23.440 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-saitek.ko 2023-12-12T09:28:23.440 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-samsung.ko 2023-12-12T09:28:23.440 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-sensor-hub.ko 2023-12-12T09:28:23.440 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-sjoy.ko 2023-12-12T09:28:23.440 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-sony.ko 2023-12-12T09:28:23.440 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-speedlink.ko 2023-12-12T09:28:23.441 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-steelseries.ko 2023-12-12T09:28:23.441 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-sunplus.ko 2023-12-12T09:28:23.441 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-thrustmaster.ko 2023-12-12T09:28:23.441 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-tivo.ko 2023-12-12T09:28:23.441 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-tmff.ko 2023-12-12T09:28:23.441 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-topseed.ko 2023-12-12T09:28:23.441 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-twinhan.ko 2023-12-12T09:28:23.441 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-uclogic.ko 2023-12-12T09:28:23.441 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-waltop.ko 2023-12-12T09:28:23.441 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-wiimote.ko 2023-12-12T09:28:23.441 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-xinmo.ko 2023-12-12T09:28:23.441 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-zpff.ko 2023-12-12T09:28:23.441 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-zydacron.ko 2023-12-12T09:28:23.441 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/uhid.ko 2023-12-12T09:28:23.441 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/wacom.ko 2023-12-12T09:28:23.441 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hv 2023-12-12T09:28:23.442 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hv/hv_balloon.ko 2023-12-12T09:28:23.442 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hv/hv_utils.ko 2023-12-12T09:28:23.442 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hv/hv_vmbus.ko 2023-12-12T09:28:23.442 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon 2023-12-12T09:28:23.442 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/abituguru.ko 2023-12-12T09:28:23.442 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/abituguru3.ko 2023-12-12T09:28:23.442 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/acpi_power_meter.ko 2023-12-12T09:28:23.442 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ad7414.ko 2023-12-12T09:28:23.442 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ad7418.ko 2023-12-12T09:28:23.442 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adc128d818.ko 2023-12-12T09:28:23.442 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adm1025.ko 2023-12-12T09:28:23.442 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adm1026.ko 2023-12-12T09:28:23.442 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adm1029.ko 2023-12-12T09:28:23.442 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adm1031.ko 2023-12-12T09:28:23.442 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adm9240.ko 2023-12-12T09:28:23.443 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ads7828.ko 2023-12-12T09:28:23.443 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adt7410.ko 2023-12-12T09:28:23.443 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adt7411.ko 2023-12-12T09:28:23.443 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adt7462.ko 2023-12-12T09:28:23.443 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adt7470.ko 2023-12-12T09:28:23.443 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adt7475.ko 2023-12-12T09:28:23.443 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adt7x10.ko 2023-12-12T09:28:23.443 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/amc6821.ko 2023-12-12T09:28:23.443 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/applesmc.ko 2023-12-12T09:28:23.443 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/asb100.ko 2023-12-12T09:28:23.443 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/asc7621.ko 2023-12-12T09:28:23.443 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/asus_atk0110.ko 2023-12-12T09:28:23.443 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/atxp1.ko 2023-12-12T09:28:23.443 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/coretemp.ko 2023-12-12T09:28:23.443 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/dell-smm-hwmon.ko 2023-12-12T09:28:23.444 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/dme1737.ko 2023-12-12T09:28:23.444 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ds1621.ko 2023-12-12T09:28:23.444 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ds620.ko 2023-12-12T09:28:23.444 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/emc1403.ko 2023-12-12T09:28:23.444 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/emc6w201.ko 2023-12-12T09:28:23.444 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/f71805f.ko 2023-12-12T09:28:23.444 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/f71882fg.ko 2023-12-12T09:28:23.444 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/f75375s.ko 2023-12-12T09:28:23.444 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/fam15h_power.ko 2023-12-12T09:28:23.444 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/fschmd.ko 2023-12-12T09:28:23.444 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/g760a.ko 2023-12-12T09:28:23.444 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/g762.ko 2023-12-12T09:28:23.444 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/gl518sm.ko 2023-12-12T09:28:23.444 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/gl520sm.ko 2023-12-12T09:28:23.444 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/hwmon-vid.ko 2023-12-12T09:28:23.444 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/i5500_temp.ko 2023-12-12T09:28:23.445 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/i5k_amb.ko 2023-12-12T09:28:23.445 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ibmaem.ko 2023-12-12T09:28:23.445 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ibmpex.ko 2023-12-12T09:28:23.445 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ina209.ko 2023-12-12T09:28:23.445 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ina2xx.ko 2023-12-12T09:28:23.445 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/it87.ko 2023-12-12T09:28:23.445 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/k10temp.ko 2023-12-12T09:28:23.445 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/k8temp.ko 2023-12-12T09:28:23.445 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lineage-pem.ko 2023-12-12T09:28:23.445 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm63.ko 2023-12-12T09:28:23.445 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm73.ko 2023-12-12T09:28:23.445 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm75.ko 2023-12-12T09:28:23.445 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm77.ko 2023-12-12T09:28:23.446 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm78.ko 2023-12-12T09:28:23.446 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm80.ko 2023-12-12T09:28:23.446 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm83.ko 2023-12-12T09:28:23.446 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm85.ko 2023-12-12T09:28:23.446 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm87.ko 2023-12-12T09:28:23.446 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm90.ko 2023-12-12T09:28:23.446 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm92.ko 2023-12-12T09:28:23.446 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm93.ko 2023-12-12T09:28:23.446 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm95234.ko 2023-12-12T09:28:23.446 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm95241.ko 2023-12-12T09:28:23.446 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm95245.ko 2023-12-12T09:28:23.446 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ltc2945.ko 2023-12-12T09:28:23.446 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ltc4151.ko 2023-12-12T09:28:23.446 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ltc4215.ko 2023-12-12T09:28:23.446 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ltc4222.ko 2023-12-12T09:28:23.447 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ltc4245.ko 2023-12-12T09:28:23.447 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ltc4260.ko 2023-12-12T09:28:23.447 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ltc4261.ko 2023-12-12T09:28:23.447 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/max16065.ko 2023-12-12T09:28:23.447 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/max1619.ko 2023-12-12T09:28:23.447 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/max1668.ko 2023-12-12T09:28:23.447 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/max197.ko 2023-12-12T09:28:23.447 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/max6639.ko 2023-12-12T09:28:23.447 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/max6650.ko 2023-12-12T09:28:23.447 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/max6697.ko 2023-12-12T09:28:23.447 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/mcp3021.ko 2023-12-12T09:28:23.447 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/nct6683.ko 2023-12-12T09:28:23.447 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/nct6775-core.ko 2023-12-12T09:28:23.447 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/nct6775.ko 2023-12-12T09:28:23.447 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/nct7802.ko 2023-12-12T09:28:23.448 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pc87360.ko 2023-12-12T09:28:23.448 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pc87427.ko 2023-12-12T09:28:23.448 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pcf8591.ko 2023-12-12T09:28:23.448 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus 2023-12-12T09:28:23.448 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/adm1275.ko 2023-12-12T09:28:23.448 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/lm25066.ko 2023-12-12T09:28:23.448 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/ltc2978.ko 2023-12-12T09:28:23.448 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/max16064.ko 2023-12-12T09:28:23.448 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/max34440.ko 2023-12-12T09:28:23.448 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/max8688.ko 2023-12-12T09:28:23.448 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/pmbus.ko 2023-12-12T09:28:23.448 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2023-12-12T09:28:23.448 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/tps40422.ko 2023-12-12T09:28:23.448 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/ucd9000.ko 2023-12-12T09:28:23.448 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/ucd9200.ko 2023-12-12T09:28:23.448 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/zl6100.ko 2023-12-12T09:28:23.449 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/powr1220.ko 2023-12-12T09:28:23.449 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/sch5627.ko 2023-12-12T09:28:23.449 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/sch5636.ko 2023-12-12T09:28:23.449 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/sch56xx-common.ko 2023-12-12T09:28:23.449 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/sht15.ko 2023-12-12T09:28:23.449 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/sht21.ko 2023-12-12T09:28:23.449 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/shtc1.ko 2023-12-12T09:28:23.449 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/sis5595.ko 2023-12-12T09:28:23.449 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/smsc47b397.ko 2023-12-12T09:28:23.449 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/smsc47m1.ko 2023-12-12T09:28:23.449 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/smsc47m192.ko 2023-12-12T09:28:23.449 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/thmc50.ko 2023-12-12T09:28:23.449 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/tmp102.ko 2023-12-12T09:28:23.449 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/tmp103.ko 2023-12-12T09:28:23.449 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/tmp401.ko 2023-12-12T09:28:23.449 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/tmp421.ko 2023-12-12T09:28:23.450 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/via-cputemp.ko 2023-12-12T09:28:23.450 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/via686a.ko 2023-12-12T09:28:23.450 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/vt1211.ko 2023-12-12T09:28:23.450 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/vt8231.ko 2023-12-12T09:28:23.450 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/w83627ehf.ko 2023-12-12T09:28:23.450 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/w83627hf.ko 2023-12-12T09:28:23.450 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/w83781d.ko 2023-12-12T09:28:23.450 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/w83791d.ko 2023-12-12T09:28:23.450 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/w83792d.ko 2023-12-12T09:28:23.450 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/w83793.ko 2023-12-12T09:28:23.450 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/w83795.ko 2023-12-12T09:28:23.450 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/w83l785ts.ko 2023-12-12T09:28:23.450 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/w83l786ng.ko 2023-12-12T09:28:23.450 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c 2023-12-12T09:28:23.451 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/algos 2023-12-12T09:28:23.451 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2023-12-12T09:28:23.451 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2023-12-12T09:28:23.451 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses 2023-12-12T09:28:23.451 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2023-12-12T09:28:23.451 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-amd756.ko 2023-12-12T09:28:23.451 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-amd8111.ko 2023-12-12T09:28:23.451 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2023-12-12T09:28:23.451 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-designware-core.ko 2023-12-12T09:28:23.451 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2023-12-12T09:28:23.451 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2023-12-12T09:28:23.451 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2023-12-12T09:28:23.451 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-i801.ko 2023-12-12T09:28:23.451 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-isch.ko 2023-12-12T09:28:23.451 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-ismt.ko 2023-12-12T09:28:23.451 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2023-12-12T09:28:23.452 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-nforce2.ko 2023-12-12T09:28:23.452 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-parport.ko 2023-12-12T09:28:23.452 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2023-12-12T09:28:23.452 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-piix4.ko 2023-12-12T09:28:23.452 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-scmi.ko 2023-12-12T09:28:23.452 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-simtec.ko 2023-12-12T09:28:23.452 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-sis96x.ko 2023-12-12T09:28:23.452 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2023-12-12T09:28:23.452 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-via.ko 2023-12-12T09:28:23.452 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-viapro.ko 2023-12-12T09:28:23.452 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-viperboard.ko 2023-12-12T09:28:23.452 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/i2c-dev.ko 2023-12-12T09:28:23.452 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/i2c-mux.ko 2023-12-12T09:28:23.452 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/i2c-slave-eeprom.ko 2023-12-12T09:28:23.452 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/i2c-smbus.ko 2023-12-12T09:28:23.452 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/i2c-stub.ko 2023-12-12T09:28:23.453 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband 2023-12-12T09:28:23.453 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/core 2023-12-12T09:28:23.453 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/core/ib_cm.ko 2023-12-12T09:28:23.453 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/core/ib_core.ko 2023-12-12T09:28:23.453 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/core/ib_umad.ko 2023-12-12T09:28:23.453 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/core/ib_uverbs.ko 2023-12-12T09:28:23.453 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/core/iw_cm.ko 2023-12-12T09:28:23.453 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/core/rdma_cm.ko 2023-12-12T09:28:23.453 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/core/rdma_ucm.ko 2023-12-12T09:28:23.453 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw 2023-12-12T09:28:23.453 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw/cxgb4 2023-12-12T09:28:23.453 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2023-12-12T09:28:23.453 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw/mlx4 2023-12-12T09:28:23.453 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2023-12-12T09:28:23.453 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw/mlx5 2023-12-12T09:28:23.454 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2023-12-12T09:28:23.454 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw/mthca 2023-12-12T09:28:23.454 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2023-12-12T09:28:23.454 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp 2023-12-12T09:28:23.454 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp/ipoib 2023-12-12T09:28:23.454 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2023-12-12T09:28:23.454 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp/iser 2023-12-12T09:28:23.454 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2023-12-12T09:28:23.454 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp/isert 2023-12-12T09:28:23.454 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2023-12-12T09:28:23.454 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp/srp 2023-12-12T09:28:23.454 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2023-12-12T09:28:23.454 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp/srpt 2023-12-12T09:28:23.454 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2023-12-12T09:28:23.454 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input 2023-12-12T09:28:23.455 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/gameport 2023-12-12T09:28:23.455 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/gameport/emu10k1-gp.ko 2023-12-12T09:28:23.455 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/gameport/fm801-gp.ko 2023-12-12T09:28:23.455 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/gameport/gameport.ko 2023-12-12T09:28:23.455 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/joydev.ko 2023-12-12T09:28:23.455 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/keyboard 2023-12-12T09:28:23.455 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/keyboard/gpio_keys.ko 2023-12-12T09:28:23.455 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/mouse 2023-12-12T09:28:23.455 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/mouse/appletouch.ko 2023-12-12T09:28:23.455 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/mouse/bcm5974.ko 2023-12-12T09:28:23.455 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/mouse/cyapatp.ko 2023-12-12T09:28:23.455 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/mouse/elan_i2c.ko 2023-12-12T09:28:23.455 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/mouse/sermouse.ko 2023-12-12T09:28:23.455 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/mouse/synaptics_i2c.ko 2023-12-12T09:28:23.455 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/mouse/synaptics_usb.ko 2023-12-12T09:28:23.456 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/mouse/vsxxxaa.ko 2023-12-12T09:28:23.456 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/rmi4 2023-12-12T09:28:23.456 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/rmi4/rmi_core.ko 2023-12-12T09:28:23.456 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/serio 2023-12-12T09:28:23.456 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/serio/altera_ps2.ko 2023-12-12T09:28:23.456 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/serio/arc_ps2.ko 2023-12-12T09:28:23.456 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/serio/hyperv-keyboard.ko 2023-12-12T09:28:23.456 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/serio/serio_raw.ko 2023-12-12T09:28:23.456 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/sparse-keymap.ko 2023-12-12T09:28:23.456 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/iommu 2023-12-12T09:28:23.456 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/iommu/amd 2023-12-12T09:28:23.456 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/iommu/amd/iommu_v2.ko 2023-12-12T09:28:23.456 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds 2023-12-12T09:28:23.456 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-blinkm.ko 2023-12-12T09:28:23.456 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-lm3530.ko 2023-12-12T09:28:23.456 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-lp3944.ko 2023-12-12T09:28:23.457 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-ss4200.ko 2023-12-12T09:28:23.457 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/trigger 2023-12-12T09:28:23.457 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/trigger/ledtrig-audio.ko 2023-12-12T09:28:23.457 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2023-12-12T09:28:23.457 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/trigger/ledtrig-camera.ko 2023-12-12T09:28:23.457 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2023-12-12T09:28:23.457 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2023-12-12T09:28:23.457 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2023-12-12T09:28:23.457 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/trigger/ledtrig-timer.ko 2023-12-12T09:28:23.457 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/trigger/ledtrig-transient.ko 2023-12-12T09:28:23.457 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md 2023-12-12T09:28:23.457 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/bcache 2023-12-12T09:28:23.457 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/bcache/bcache.ko 2023-12-12T09:28:23.457 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-bio-prison.ko 2023-12-12T09:28:23.457 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-cache-smq.ko 2023-12-12T09:28:23.457 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-cache.ko 2023-12-12T09:28:23.458 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-crypt.ko 2023-12-12T09:28:23.458 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-delay.ko 2023-12-12T09:28:23.458 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-flakey.ko 2023-12-12T09:28:23.458 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-log-userspace.ko 2023-12-12T09:28:23.458 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-multipath.ko 2023-12-12T09:28:23.458 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-queue-length.ko 2023-12-12T09:28:23.458 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-raid.ko 2023-12-12T09:28:23.458 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-round-robin.ko 2023-12-12T09:28:23.458 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-service-time.ko 2023-12-12T09:28:23.458 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-switch.ko 2023-12-12T09:28:23.458 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-thin-pool.ko 2023-12-12T09:28:23.458 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-verity.ko 2023-12-12T09:28:23.458 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/faulty.ko 2023-12-12T09:28:23.458 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/linear.ko 2023-12-12T09:28:23.459 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/multipath.ko 2023-12-12T09:28:23.459 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/persistent-data 2023-12-12T09:28:23.459 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2023-12-12T09:28:23.459 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/raid0.ko 2023-12-12T09:28:23.459 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/raid1.ko 2023-12-12T09:28:23.459 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/raid10.ko 2023-12-12T09:28:23.459 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/raid456.ko 2023-12-12T09:28:23.459 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/message 2023-12-12T09:28:23.459 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/message/fusion 2023-12-12T09:28:23.459 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/message/fusion/mptbase.ko 2023-12-12T09:28:23.459 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/message/fusion/mptctl.ko 2023-12-12T09:28:23.459 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/message/fusion/mptfc.ko 2023-12-12T09:28:23.459 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/message/fusion/mptlan.ko 2023-12-12T09:28:23.459 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/message/fusion/mptsas.ko 2023-12-12T09:28:23.459 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/message/fusion/mptscsih.ko 2023-12-12T09:28:23.460 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/message/fusion/mptspi.ko 2023-12-12T09:28:23.460 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd 2023-12-12T09:28:23.460 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/lpc_ich.ko 2023-12-12T09:28:23.460 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/lpc_sch.ko 2023-12-12T09:28:23.460 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/mfd-core.ko 2023-12-12T09:28:23.460 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/sm501.ko 2023-12-12T09:28:23.460 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/viperboard.ko 2023-12-12T09:28:23.460 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/vx855.ko 2023-12-12T09:28:23.460 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/wl1273-core.ko 2023-12-12T09:28:23.460 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc 2023-12-12T09:28:23.460 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/altera-stapl 2023-12-12T09:28:23.460 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2023-12-12T09:28:23.460 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/apds9802als.ko 2023-12-12T09:28:23.460 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/apds990x.ko 2023-12-12T09:28:23.460 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/bh1770glc.ko 2023-12-12T09:28:23.460 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/cb710 2023-12-12T09:28:23.461 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/cb710/cb710.ko 2023-12-12T09:28:23.461 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/eeprom 2023-12-12T09:28:23.461 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/eeprom/at24.ko 2023-12-12T09:28:23.461 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/eeprom/eeprom.ko 2023-12-12T09:28:23.461 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2023-12-12T09:28:23.461 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/eeprom/max6875.ko 2023-12-12T09:28:23.461 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/enclosure.ko 2023-12-12T09:28:23.461 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/hpilo.ko 2023-12-12T09:28:23.461 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/isl29003.ko 2023-12-12T09:28:23.461 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/isl29020.ko 2023-12-12T09:28:23.461 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/lis3lv02d 2023-12-12T09:28:23.461 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2023-12-12T09:28:23.461 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2023-12-12T09:28:23.461 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/mei 2023-12-12T09:28:23.462 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/mei/mei-me.ko 2023-12-12T09:28:23.462 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/mei/mei-txe.ko 2023-12-12T09:28:23.462 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/mei/mei.ko 2023-12-12T09:28:23.462 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/sgi-gru 2023-12-12T09:28:23.462 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/sgi-gru/gru.ko 2023-12-12T09:28:23.462 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/sgi-xp 2023-12-12T09:28:23.462 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/sgi-xp/xp.ko 2023-12-12T09:28:23.462 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/sgi-xp/xpc.ko 2023-12-12T09:28:23.462 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/sgi-xp/xpnet.ko 2023-12-12T09:28:23.462 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/tifm_7xx1.ko 2023-12-12T09:28:23.462 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/tifm_core.ko 2023-12-12T09:28:23.462 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/tsl2550.ko 2023-12-12T09:28:23.462 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/vmw_balloon.ko 2023-12-12T09:28:23.462 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/vmw_vmci 2023-12-12T09:28:23.462 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2023-12-12T09:28:23.463 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net 2023-12-12T09:28:23.463 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/bonding 2023-12-12T09:28:23.463 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/bonding/bonding.ko 2023-12-12T09:28:23.463 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/dsa 2023-12-12T09:28:23.463 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/dsa/b53 2023-12-12T09:28:23.463 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/dsa/b53/b53_common.ko 2023-12-12T09:28:23.463 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/dsa/bcm-sf2.ko 2023-12-12T09:28:23.463 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/dsa/mv88e6060.ko 2023-12-12T09:28:23.463 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/dsa/mv88e6xxx 2023-12-12T09:28:23.463 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2023-12-12T09:28:23.463 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/dummy.ko 2023-12-12T09:28:23.463 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/eql.ko 2023-12-12T09:28:23.463 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet 2023-12-12T09:28:23.463 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/3com 2023-12-12T09:28:23.463 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2023-12-12T09:28:23.464 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2023-12-12T09:28:23.464 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/3com/3c59x.ko 2023-12-12T09:28:23.464 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/3com/typhoon.ko 2023-12-12T09:28:23.464 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/8390 2023-12-12T09:28:23.464 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/8390/8390.ko 2023-12-12T09:28:23.464 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2023-12-12T09:28:23.464 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2023-12-12T09:28:23.464 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2023-12-12T09:28:23.464 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/adaptec 2023-12-12T09:28:23.464 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/adaptec/starfire.ko 2023-12-12T09:28:23.464 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/agere 2023-12-12T09:28:23.464 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/agere/et131x.ko 2023-12-12T09:28:23.464 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/alteon 2023-12-12T09:28:23.464 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/alteon/acenic.ko 2023-12-12T09:28:23.464 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/altera 2023-12-12T09:28:23.464 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/altera/altera_tse.ko 2023-12-12T09:28:23.465 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/amd 2023-12-12T09:28:23.465 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/amd/amd8111e.ko 2023-12-12T09:28:23.465 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2023-12-12T09:28:23.465 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/amd/pcnet32.ko 2023-12-12T09:28:23.465 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/atheros 2023-12-12T09:28:23.465 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/atheros/alx 2023-12-12T09:28:23.465 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2023-12-12T09:28:23.465 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/atheros/atl1c 2023-12-12T09:28:23.465 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2023-12-12T09:28:23.465 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/atheros/atl1e 2023-12-12T09:28:23.465 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2023-12-12T09:28:23.465 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/atheros/atlx 2023-12-12T09:28:23.465 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2023-12-12T09:28:23.465 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2023-12-12T09:28:23.465 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/broadcom 2023-12-12T09:28:23.466 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/broadcom/b44.ko 2023-12-12T09:28:23.466 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2023-12-12T09:28:23.466 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/broadcom/bnx2x 2023-12-12T09:28:23.466 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2023-12-12T09:28:23.466 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/broadcom/cnic.ko 2023-12-12T09:28:23.466 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/broadcom/genet 2023-12-12T09:28:23.466 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2023-12-12T09:28:23.466 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/broadcom/tg3.ko 2023-12-12T09:28:23.466 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/brocade 2023-12-12T09:28:23.466 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/brocade/bna 2023-12-12T09:28:23.466 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2023-12-12T09:28:23.466 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio 2023-12-12T09:28:23.466 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio/cxgb 2023-12-12T09:28:23.466 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2023-12-12T09:28:23.466 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio/cxgb3 2023-12-12T09:28:23.466 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2023-12-12T09:28:23.467 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio/cxgb4 2023-12-12T09:28:23.467 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2023-12-12T09:28:23.467 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2023-12-12T09:28:23.467 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2023-12-12T09:28:23.467 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio/libcxgb 2023-12-12T09:28:23.467 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2023-12-12T09:28:23.467 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/cisco 2023-12-12T09:28:23.467 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/cisco/enic 2023-12-12T09:28:23.467 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2023-12-12T09:28:23.467 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dec 2023-12-12T09:28:23.467 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dec/tulip 2023-12-12T09:28:23.467 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2023-12-12T09:28:23.467 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2023-12-12T09:28:23.467 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2023-12-12T09:28:23.468 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2023-12-12T09:28:23.468 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2023-12-12T09:28:23.468 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2023-12-12T09:28:23.468 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dlink 2023-12-12T09:28:23.468 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dlink/dl2k.ko 2023-12-12T09:28:23.468 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dlink/sundance.ko 2023-12-12T09:28:23.468 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dnet.ko 2023-12-12T09:28:23.468 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/emulex 2023-12-12T09:28:23.468 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/emulex/benet 2023-12-12T09:28:23.468 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2023-12-12T09:28:23.468 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/ethoc.ko 2023-12-12T09:28:23.468 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/fealnx.ko 2023-12-12T09:28:23.468 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel 2023-12-12T09:28:23.468 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/e100.ko 2023-12-12T09:28:23.468 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/e1000 2023-12-12T09:28:23.469 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2023-12-12T09:28:23.469 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/e1000e 2023-12-12T09:28:23.469 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2023-12-12T09:28:23.469 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/fm10k 2023-12-12T09:28:23.469 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2023-12-12T09:28:23.469 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/i40e 2023-12-12T09:28:23.469 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2023-12-12T09:28:23.469 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/iavf 2023-12-12T09:28:23.469 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2023-12-12T09:28:23.469 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/igb 2023-12-12T09:28:23.469 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/igb/igb.ko 2023-12-12T09:28:23.469 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/igbvf 2023-12-12T09:28:23.469 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2023-12-12T09:28:23.469 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/ixgbe 2023-12-12T09:28:23.470 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2023-12-12T09:28:23.470 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/ixgbevf 2023-12-12T09:28:23.470 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2023-12-12T09:28:23.470 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/jme.ko 2023-12-12T09:28:23.470 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/marvell 2023-12-12T09:28:23.470 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2023-12-12T09:28:23.470 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/marvell/skge.ko 2023-12-12T09:28:23.470 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/marvell/sky2.ko 2023-12-12T09:28:23.470 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/mellanox 2023-12-12T09:28:23.470 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/mellanox/mlx4 2023-12-12T09:28:23.470 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2023-12-12T09:28:23.470 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2023-12-12T09:28:23.470 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/mellanox/mlx5 2023-12-12T09:28:23.470 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/mellanox/mlx5/core 2023-12-12T09:28:23.470 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2023-12-12T09:28:23.471 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/micrel 2023-12-12T09:28:23.471 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2023-12-12T09:28:23.471 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/myricom 2023-12-12T09:28:23.471 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/myricom/myri10ge 2023-12-12T09:28:23.471 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2023-12-12T09:28:23.471 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/natsemi 2023-12-12T09:28:23.471 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2023-12-12T09:28:23.471 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2023-12-12T09:28:23.471 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/neterion 2023-12-12T09:28:23.471 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/neterion/s2io.ko 2023-12-12T09:28:23.471 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/nvidia 2023-12-12T09:28:23.471 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2023-12-12T09:28:23.471 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/packetengines 2023-12-12T09:28:23.471 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2023-12-12T09:28:23.471 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2023-12-12T09:28:23.472 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/qlogic 2023-12-12T09:28:23.472 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/qlogic/netxen 2023-12-12T09:28:23.472 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2023-12-12T09:28:23.472 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2023-12-12T09:28:23.472 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/qlogic/qlcnic 2023-12-12T09:28:23.472 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2023-12-12T09:28:23.472 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/rdc 2023-12-12T09:28:23.472 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/rdc/r6040.ko 2023-12-12T09:28:23.472 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/realtek 2023-12-12T09:28:23.472 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/realtek/8139cp.ko 2023-12-12T09:28:23.472 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/realtek/8139too.ko 2023-12-12T09:28:23.472 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/realtek/atp.ko 2023-12-12T09:28:23.472 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/realtek/r8169.ko 2023-12-12T09:28:23.472 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/rocker 2023-12-12T09:28:23.472 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/rocker/rocker.ko 2023-12-12T09:28:23.473 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/sfc 2023-12-12T09:28:23.473 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/sfc/sfc.ko 2023-12-12T09:28:23.473 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/silan 2023-12-12T09:28:23.473 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/silan/sc92031.ko 2023-12-12T09:28:23.473 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/sis 2023-12-12T09:28:23.473 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/sis/sis190.ko 2023-12-12T09:28:23.473 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/sis/sis900.ko 2023-12-12T09:28:23.473 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/smsc 2023-12-12T09:28:23.473 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/smsc/epic100.ko 2023-12-12T09:28:23.473 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2023-12-12T09:28:23.473 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2023-12-12T09:28:23.473 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2023-12-12T09:28:23.473 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/stmicro 2023-12-12T09:28:23.473 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/stmicro/stmmac 2023-12-12T09:28:23.474 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2023-12-12T09:28:23.474 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2023-12-12T09:28:23.474 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/sun 2023-12-12T09:28:23.474 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/sun/cassini.ko 2023-12-12T09:28:23.474 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/sun/niu.ko 2023-12-12T09:28:23.474 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/sun/sungem.ko 2023-12-12T09:28:23.474 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/sun/sunhme.ko 2023-12-12T09:28:23.474 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/tehuti 2023-12-12T09:28:23.474 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2023-12-12T09:28:23.474 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/ti 2023-12-12T09:28:23.474 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/ti/tlan.ko 2023-12-12T09:28:23.474 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/via 2023-12-12T09:28:23.474 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/via/via-rhine.ko 2023-12-12T09:28:23.474 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/via/via-velocity.ko 2023-12-12T09:28:23.474 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/wiznet 2023-12-12T09:28:23.475 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/wiznet/w5100.ko 2023-12-12T09:28:23.475 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/wiznet/w5300.ko 2023-12-12T09:28:23.475 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/xircom 2023-12-12T09:28:23.475 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2023-12-12T09:28:23.475 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/geneve.ko 2023-12-12T09:28:23.475 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/hyperv 2023-12-12T09:28:23.475 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/hyperv/hv_netvsc.ko 2023-12-12T09:28:23.475 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ieee802154 2023-12-12T09:28:23.475 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ieee802154/fakelb.ko 2023-12-12T09:28:23.475 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ifb.ko 2023-12-12T09:28:23.475 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ipvlan 2023-12-12T09:28:23.475 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ipvlan/ipvlan.ko 2023-12-12T09:28:23.475 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/macvlan.ko 2023-12-12T09:28:23.475 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/macvtap.ko 2023-12-12T09:28:23.475 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/mdio 2023-12-12T09:28:23.476 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/mdio.ko 2023-12-12T09:28:23.476 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2023-12-12T09:28:23.476 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/mdio/mdio-bitbang.ko 2023-12-12T09:28:23.476 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/mdio/mdio-regmap.ko 2023-12-12T09:28:23.476 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/mii.ko 2023-12-12T09:28:23.476 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/net_failover.ko 2023-12-12T09:28:23.476 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/netconsole.ko 2023-12-12T09:28:23.476 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/nlmon.ko 2023-12-12T09:28:23.476 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/pcs 2023-12-12T09:28:23.476 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/pcs/pcs-lynx.ko 2023-12-12T09:28:23.476 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/pcs/pcs_xpcs.ko 2023-12-12T09:28:23.476 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy 2023-12-12T09:28:23.476 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/amd.ko 2023-12-12T09:28:23.476 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/bcm-phy-lib.ko 2023-12-12T09:28:23.476 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/bcm-phy-ptp.ko 2023-12-12T09:28:23.477 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/bcm7xxx.ko 2023-12-12T09:28:23.477 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/bcm87xx.ko 2023-12-12T09:28:23.477 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/broadcom.ko 2023-12-12T09:28:23.477 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/cicada.ko 2023-12-12T09:28:23.477 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/davicom.ko 2023-12-12T09:28:23.477 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/dp83640.ko 2023-12-12T09:28:23.477 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/et1011c.ko 2023-12-12T09:28:23.477 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/icplus.ko 2023-12-12T09:28:23.477 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/lxt.ko 2023-12-12T09:28:23.477 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/marvell.ko 2023-12-12T09:28:23.477 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/micrel.ko 2023-12-12T09:28:23.477 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/national.ko 2023-12-12T09:28:23.477 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/phylink.ko 2023-12-12T09:28:23.477 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/qsemi.ko 2023-12-12T09:28:23.477 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/realtek.ko 2023-12-12T09:28:23.478 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/smsc.ko 2023-12-12T09:28:23.478 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/ste10Xp.ko 2023-12-12T09:28:23.478 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/vitesse.ko 2023-12-12T09:28:23.478 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ppp 2023-12-12T09:28:23.478 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ppp/bsd_comp.ko 2023-12-12T09:28:23.478 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ppp/ppp_async.ko 2023-12-12T09:28:23.478 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ppp/ppp_deflate.ko 2023-12-12T09:28:23.478 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ppp/ppp_generic.ko 2023-12-12T09:28:23.478 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ppp/ppp_mppe.ko 2023-12-12T09:28:23.478 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ppp/ppp_synctty.ko 2023-12-12T09:28:23.478 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ppp/pppoe.ko 2023-12-12T09:28:23.478 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ppp/pppox.ko 2023-12-12T09:28:23.478 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ppp/pptp.ko 2023-12-12T09:28:23.478 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/slip 2023-12-12T09:28:23.478 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/slip/slhc.ko 2023-12-12T09:28:23.479 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/slip/slip.ko 2023-12-12T09:28:23.479 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/sungem_phy.ko 2023-12-12T09:28:23.479 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/tap.ko 2023-12-12T09:28:23.479 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/team 2023-12-12T09:28:23.479 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/team/team.ko 2023-12-12T09:28:23.479 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/team/team_mode_activebackup.ko 2023-12-12T09:28:23.479 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/team/team_mode_broadcast.ko 2023-12-12T09:28:23.479 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/team/team_mode_loadbalance.ko 2023-12-12T09:28:23.479 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/team/team_mode_random.ko 2023-12-12T09:28:23.479 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/team/team_mode_roundrobin.ko 2023-12-12T09:28:23.479 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/tun.ko 2023-12-12T09:28:23.480 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/veth.ko 2023-12-12T09:28:23.480 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/virtio_net.ko 2023-12-12T09:28:23.480 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/vmxnet3 2023-12-12T09:28:23.480 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/vmxnet3/vmxnet3.ko 2023-12-12T09:28:23.480 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/vxlan 2023-12-12T09:28:23.480 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/vxlan/vxlan.ko 2023-12-12T09:28:23.480 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/xen-netback 2023-12-12T09:28:23.480 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/xen-netback/xen-netback.ko 2023-12-12T09:28:23.480 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/xen-netfront.ko 2023-12-12T09:28:23.480 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ntb 2023-12-12T09:28:23.480 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ntb/ntb.ko 2023-12-12T09:28:23.480 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/nvme 2023-12-12T09:28:23.480 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/nvme/host 2023-12-12T09:28:23.480 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/nvme/host/nvme-core.ko 2023-12-12T09:28:23.480 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/nvme/host/nvme.ko 2023-12-12T09:28:23.481 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/parport 2023-12-12T09:28:23.481 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/parport/parport.ko 2023-12-12T09:28:23.481 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/parport/parport_cs.ko 2023-12-12T09:28:23.481 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/parport/parport_pc.ko 2023-12-12T09:28:23.481 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/parport/parport_serial.ko 2023-12-12T09:28:23.481 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pci 2023-12-12T09:28:23.481 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pci/hotplug 2023-12-12T09:28:23.481 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2023-12-12T09:28:23.481 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pci/pcie 2023-12-12T09:28:23.481 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pci/pcie/aer_inject.ko 2023-12-12T09:28:23.481 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pci/xen-pcifront.ko 2023-12-12T09:28:23.481 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pcmcia 2023-12-12T09:28:23.481 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pcmcia/i82092.ko 2023-12-12T09:28:23.481 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pcmcia/pd6729.ko 2023-12-12T09:28:23.481 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pcmcia/yenta_socket.ko 2023-12-12T09:28:23.482 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pinctrl 2023-12-12T09:28:23.482 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pinctrl/intel 2023-12-12T09:28:23.482 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2023-12-12T09:28:23.482 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform 2023-12-12T09:28:23.482 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86 2023-12-12T09:28:23.482 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/acer-wmi.ko 2023-12-12T09:28:23.482 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/acerhdf.ko 2023-12-12T09:28:23.482 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/apple-gmux.ko 2023-12-12T09:28:23.482 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/asus-laptop.ko 2023-12-12T09:28:23.482 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/asus-nb-wmi.ko 2023-12-12T09:28:23.482 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/asus-wmi.ko 2023-12-12T09:28:23.482 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/classmate-laptop.ko 2023-12-12T09:28:23.482 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/eeepc-laptop.ko 2023-12-12T09:28:23.482 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/eeepc-wmi.ko 2023-12-12T09:28:23.482 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/fujitsu-laptop.ko 2023-12-12T09:28:23.483 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/fujitsu-tablet.ko 2023-12-12T09:28:23.483 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/hdaps.ko 2023-12-12T09:28:23.483 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/intel 2023-12-12T09:28:23.483 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/intel/intel-rst.ko 2023-12-12T09:28:23.483 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/intel_ips.ko 2023-12-12T09:28:23.483 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/msi-wmi.ko 2023-12-12T09:28:23.483 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/mxm-wmi.ko 2023-12-12T09:28:23.483 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/panasonic-laptop.ko 2023-12-12T09:28:23.483 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/samsung-laptop.ko 2023-12-12T09:28:23.483 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/samsung-q10.ko 2023-12-12T09:28:23.483 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/topstar-laptop.ko 2023-12-12T09:28:23.483 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2023-12-12T09:28:23.483 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/toshiba_haps.ko 2023-12-12T09:28:23.483 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/wmi-bmof.ko 2023-12-12T09:28:23.483 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/wmi.ko 2023-12-12T09:28:23.484 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/powercap 2023-12-12T09:28:23.484 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/powercap/intel_rapl_common.ko 2023-12-12T09:28:23.484 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/powercap/intel_rapl_msr.ko 2023-12-12T09:28:23.484 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pps 2023-12-12T09:28:23.484 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pps/clients 2023-12-12T09:28:23.484 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pps/clients/pps-gpio.ko 2023-12-12T09:28:23.484 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pps/clients/pps-ldisc.ko 2023-12-12T09:28:23.484 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pps/clients/pps_parport.ko 2023-12-12T09:28:23.484 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pps/pps_core.ko 2023-12-12T09:28:23.484 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ptp 2023-12-12T09:28:23.484 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ptp/ptp.ko 2023-12-12T09:28:23.484 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ptp/ptp_kvm.ko 2023-12-12T09:28:23.484 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc 2023-12-12T09:28:23.484 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-bq32k.ko 2023-12-12T09:28:23.484 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-ds1286.ko 2023-12-12T09:28:23.485 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-ds1307.ko 2023-12-12T09:28:23.485 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-ds1374.ko 2023-12-12T09:28:23.485 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-ds1511.ko 2023-12-12T09:28:23.485 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-ds1553.ko 2023-12-12T09:28:23.485 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-ds1672.ko 2023-12-12T09:28:23.485 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-ds1742.ko 2023-12-12T09:28:23.485 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-ds2404.ko 2023-12-12T09:28:23.485 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-ds3232.ko 2023-12-12T09:28:23.485 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-em3027.ko 2023-12-12T09:28:23.485 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-fm3130.ko 2023-12-12T09:28:23.485 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-isl12022.ko 2023-12-12T09:28:23.485 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-isl1208.ko 2023-12-12T09:28:23.485 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-m41t80.ko 2023-12-12T09:28:23.485 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-m48t35.ko 2023-12-12T09:28:23.485 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-m48t59.ko 2023-12-12T09:28:23.485 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-max6900.ko 2023-12-12T09:28:23.486 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-msm6242.ko 2023-12-12T09:28:23.486 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-pcf2127.ko 2023-12-12T09:28:23.486 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-pcf85063.ko 2023-12-12T09:28:23.486 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-pcf8523.ko 2023-12-12T09:28:23.486 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-pcf8563.ko 2023-12-12T09:28:23.486 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-pcf8583.ko 2023-12-12T09:28:23.486 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-rp5c01.ko 2023-12-12T09:28:23.486 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-rs5c372.ko 2023-12-12T09:28:23.486 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-rv3029c2.ko 2023-12-12T09:28:23.486 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-rx8025.ko 2023-12-12T09:28:23.486 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-rx8581.ko 2023-12-12T09:28:23.486 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-stk17ta8.ko 2023-12-12T09:28:23.486 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-x1205.ko 2023-12-12T09:28:23.486 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi 2023-12-12T09:28:23.486 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/3w-9xxx.ko 2023-12-12T09:28:23.487 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/3w-sas.ko 2023-12-12T09:28:23.487 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/3w-xxxx.ko 2023-12-12T09:28:23.487 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/BusLogic.ko 2023-12-12T09:28:23.487 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/a100u2w.ko 2023-12-12T09:28:23.487 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/aacraid 2023-12-12T09:28:23.487 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/aacraid/aacraid.ko 2023-12-12T09:28:23.487 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/advansys.ko 2023-12-12T09:28:23.487 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/aic7xxx 2023-12-12T09:28:23.487 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2023-12-12T09:28:23.487 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2023-12-12T09:28:23.487 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/am53c974.ko 2023-12-12T09:28:23.487 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/arcmsr 2023-12-12T09:28:23.487 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/arcmsr/arcmsr.ko 2023-12-12T09:28:23.487 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/atp870u.ko 2023-12-12T09:28:23.487 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/be2iscsi 2023-12-12T09:28:23.488 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2023-12-12T09:28:23.488 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/bfa 2023-12-12T09:28:23.488 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/bfa/bfa.ko 2023-12-12T09:28:23.488 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/bnx2fc 2023-12-12T09:28:23.488 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2023-12-12T09:28:23.488 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/bnx2i 2023-12-12T09:28:23.488 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/bnx2i/bnx2i.ko 2023-12-12T09:28:23.488 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/ch.ko 2023-12-12T09:28:23.488 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/csiostor 2023-12-12T09:28:23.488 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/csiostor/csiostor.ko 2023-12-12T09:28:23.488 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/cxgbi 2023-12-12T09:28:23.488 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/cxgbi/cxgb3i 2023-12-12T09:28:23.488 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2023-12-12T09:28:23.488 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/cxgbi/cxgb4i 2023-12-12T09:28:23.488 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2023-12-12T09:28:23.489 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2023-12-12T09:28:23.489 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/dc395x.ko 2023-12-12T09:28:23.489 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/device_handler 2023-12-12T09:28:23.489 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2023-12-12T09:28:23.489 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2023-12-12T09:28:23.489 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2023-12-12T09:28:23.489 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2023-12-12T09:28:23.489 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/dmx3191d.ko 2023-12-12T09:28:23.489 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/esas2r 2023-12-12T09:28:23.489 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/esas2r/esas2r.ko 2023-12-12T09:28:23.489 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/esp_scsi.ko 2023-12-12T09:28:23.489 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/fcoe 2023-12-12T09:28:23.489 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/fcoe/fcoe.ko 2023-12-12T09:28:23.489 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/fcoe/libfcoe.ko 2023-12-12T09:28:23.490 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/fnic 2023-12-12T09:28:23.490 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/fnic/fnic.ko 2023-12-12T09:28:23.490 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/hpsa.ko 2023-12-12T09:28:23.490 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/hptiop.ko 2023-12-12T09:28:23.490 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/hv_storvsc.ko 2023-12-12T09:28:23.490 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/initio.ko 2023-12-12T09:28:23.490 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/ipr.ko 2023-12-12T09:28:23.490 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/ips.ko 2023-12-12T09:28:23.490 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/isci 2023-12-12T09:28:23.490 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/isci/isci.ko 2023-12-12T09:28:23.490 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2023-12-12T09:28:23.490 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/iscsi_tcp.ko 2023-12-12T09:28:23.490 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/libfc 2023-12-12T09:28:23.490 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/libfc/libfc.ko 2023-12-12T09:28:23.490 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/libiscsi.ko 2023-12-12T09:28:23.490 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/libiscsi_tcp.ko 2023-12-12T09:28:23.491 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/libsas 2023-12-12T09:28:23.491 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/libsas/libsas.ko 2023-12-12T09:28:23.491 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/lpfc 2023-12-12T09:28:23.491 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/lpfc/lpfc.ko 2023-12-12T09:28:23.491 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/megaraid 2023-12-12T09:28:23.491 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/megaraid.ko 2023-12-12T09:28:23.491 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2023-12-12T09:28:23.491 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2023-12-12T09:28:23.491 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2023-12-12T09:28:23.491 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/mpt3sas 2023-12-12T09:28:23.491 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2023-12-12T09:28:23.491 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/mvsas 2023-12-12T09:28:23.491 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/mvsas/mvsas.ko 2023-12-12T09:28:23.491 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/mvumi.ko 2023-12-12T09:28:23.491 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/pm8001 2023-12-12T09:28:23.492 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/pm8001/pm80xx.ko 2023-12-12T09:28:23.492 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/pmcraid.ko 2023-12-12T09:28:23.492 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/qla1280.ko 2023-12-12T09:28:23.492 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/qla2xxx 2023-12-12T09:28:23.492 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2023-12-12T09:28:23.492 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2023-12-12T09:28:23.492 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/qla4xxx 2023-12-12T09:28:23.492 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2023-12-12T09:28:23.492 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/raid_class.ko 2023-12-12T09:28:23.492 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/scsi_debug.ko 2023-12-12T09:28:23.492 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/scsi_transport_fc.ko 2023-12-12T09:28:23.492 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/scsi_transport_iscsi.ko 2023-12-12T09:28:23.492 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/scsi_transport_sas.ko 2023-12-12T09:28:23.492 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/scsi_transport_spi.ko 2023-12-12T09:28:23.492 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/scsi_transport_srp.ko 2023-12-12T09:28:23.493 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/ses.ko 2023-12-12T09:28:23.493 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/st.ko 2023-12-12T09:28:23.493 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/stex.ko 2023-12-12T09:28:23.493 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/sym53c8xx_2 2023-12-12T09:28:23.493 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2023-12-12T09:28:23.493 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/virtio_scsi.ko 2023-12-12T09:28:23.493 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/vmw_pvscsi.ko 2023-12-12T09:28:23.493 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/wd719x.ko 2023-12-12T09:28:23.493 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ssb 2023-12-12T09:28:23.493 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ssb/ssb.ko 2023-12-12T09:28:23.493 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target 2023-12-12T09:28:23.493 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/iscsi 2023-12-12T09:28:23.493 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2023-12-12T09:28:23.493 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/loopback 2023-12-12T09:28:23.493 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/loopback/tcm_loop.ko 2023-12-12T09:28:23.494 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/target_core_file.ko 2023-12-12T09:28:23.494 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/target_core_iblock.ko 2023-12-12T09:28:23.494 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/target_core_mod.ko 2023-12-12T09:28:23.494 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/target_core_pscsi.ko 2023-12-12T09:28:23.494 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/target_core_user.ko 2023-12-12T09:28:23.494 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/tcm_fc 2023-12-12T09:28:23.494 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/tcm_fc/tcm_fc.ko 2023-12-12T09:28:23.494 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal 2023-12-12T09:28:23.494 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel 2023-12-12T09:28:23.494 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal 2023-12-12T09:28:23.494 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2023-12-12T09:28:23.494 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2023-12-12T09:28:23.494 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2023-12-12T09:28:23.494 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2023-12-12T09:28:23.494 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2023-12-12T09:28:23.495 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2023-12-12T09:28:23.495 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2023-12-12T09:28:23.495 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2023-12-12T09:28:23.495 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2023-12-12T09:28:23.495 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2023-12-12T09:28:23.495 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2023-12-12T09:28:23.495 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2023-12-12T09:28:23.495 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2023-12-12T09:28:23.495 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2023-12-12T09:28:23.495 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2023-12-12T09:28:23.495 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty 2023-12-12T09:28:23.495 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/ipwireless 2023-12-12T09:28:23.495 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/ipwireless/ipwireless.ko 2023-12-12T09:28:23.495 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/n_gsm.ko 2023-12-12T09:28:23.495 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/n_hdlc.ko 2023-12-12T09:28:23.495 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/nozomi.ko 2023-12-12T09:28:23.496 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/serial 2023-12-12T09:28:23.496 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/serial/8250 2023-12-12T09:28:23.496 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/serial/8250/serial_cs.ko 2023-12-12T09:28:23.496 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/serial/arc_uart.ko 2023-12-12T09:28:23.496 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/serial/jsm 2023-12-12T09:28:23.496 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/serial/jsm/jsm.ko 2023-12-12T09:28:23.496 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ufs 2023-12-12T09:28:23.496 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ufs/core 2023-12-12T09:28:23.496 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ufs/core/ufshcd-core.ko 2023-12-12T09:28:23.496 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ufs/host 2023-12-12T09:28:23.496 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ufs/host/ufshcd-pci.ko 2023-12-12T09:28:23.496 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/uio 2023-12-12T09:28:23.496 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/uio/uio.ko 2023-12-12T09:28:23.496 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/uio/uio_aec.ko 2023-12-12T09:28:23.496 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/uio/uio_cif.ko 2023-12-12T09:28:23.497 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/uio/uio_pci_generic.ko 2023-12-12T09:28:23.497 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/uio/uio_sercos3.ko 2023-12-12T09:28:23.497 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb 2023-12-12T09:28:23.497 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/class 2023-12-12T09:28:23.497 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/class/cdc-acm.ko 2023-12-12T09:28:23.497 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/class/cdc-wdm.ko 2023-12-12T09:28:23.497 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/class/usblp.ko 2023-12-12T09:28:23.497 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/class/usbtmc.ko 2023-12-12T09:28:23.497 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/host 2023-12-12T09:28:23.497 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/host/sl811-hcd.ko 2023-12-12T09:28:23.497 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/image 2023-12-12T09:28:23.497 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/image/mdc800.ko 2023-12-12T09:28:23.497 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/image/microtek.ko 2023-12-12T09:28:23.497 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc 2023-12-12T09:28:23.497 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/adutux.ko 2023-12-12T09:28:23.497 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/appledisplay.ko 2023-12-12T09:28:23.498 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/emi26.ko 2023-12-12T09:28:23.498 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/emi62.ko 2023-12-12T09:28:23.498 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/ezusb.ko 2023-12-12T09:28:23.498 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/idmouse.ko 2023-12-12T09:28:23.498 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/iowarrior.ko 2023-12-12T09:28:23.498 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/isight_firmware.ko 2023-12-12T09:28:23.498 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/ldusb.ko 2023-12-12T09:28:23.498 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/legousbtower.ko 2023-12-12T09:28:23.498 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/sisusbvga 2023-12-12T09:28:23.498 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2023-12-12T09:28:23.498 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/trancevibrator.ko 2023-12-12T09:28:23.498 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/usb3503.ko 2023-12-12T09:28:23.498 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/usblcd.ko 2023-12-12T09:28:23.498 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/usbsevseg.ko 2023-12-12T09:28:23.498 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/uss720.ko 2023-12-12T09:28:23.498 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/yurex.ko 2023-12-12T09:28:23.499 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/phy 2023-12-12T09:28:23.499 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/phy/phy-generic.ko 2023-12-12T09:28:23.499 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial 2023-12-12T09:28:23.499 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/aircable.ko 2023-12-12T09:28:23.499 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/ark3116.ko 2023-12-12T09:28:23.499 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/belkin_sa.ko 2023-12-12T09:28:23.499 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/ch341.ko 2023-12-12T09:28:23.499 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/cp210x.ko 2023-12-12T09:28:23.499 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/cyberjack.ko 2023-12-12T09:28:23.499 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/cypress_m8.ko 2023-12-12T09:28:23.499 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/digi_acceleport.ko 2023-12-12T09:28:23.499 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/empeg.ko 2023-12-12T09:28:23.499 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/ftdi_sio.ko 2023-12-12T09:28:23.499 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/garmin_gps.ko 2023-12-12T09:28:23.499 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/io_edgeport.ko 2023-12-12T09:28:23.500 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/io_ti.ko 2023-12-12T09:28:23.500 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/ipaq.ko 2023-12-12T09:28:23.500 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/ipw.ko 2023-12-12T09:28:23.500 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/ir-usb.ko 2023-12-12T09:28:23.500 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/iuu_phoenix.ko 2023-12-12T09:28:23.500 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/keyspan.ko 2023-12-12T09:28:23.500 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/keyspan_pda.ko 2023-12-12T09:28:23.500 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/kl5kusb105.ko 2023-12-12T09:28:23.500 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/kobil_sct.ko 2023-12-12T09:28:23.500 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/mct_u232.ko 2023-12-12T09:28:23.500 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/mos7720.ko 2023-12-12T09:28:23.500 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/mos7840.ko 2023-12-12T09:28:23.500 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/navman.ko 2023-12-12T09:28:23.500 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/omninet.ko 2023-12-12T09:28:23.500 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/opticon.ko 2023-12-12T09:28:23.501 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/option.ko 2023-12-12T09:28:23.501 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/oti6858.ko 2023-12-12T09:28:23.501 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/pl2303.ko 2023-12-12T09:28:23.501 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/qcaux.ko 2023-12-12T09:28:23.501 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/qcserial.ko 2023-12-12T09:28:23.501 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/quatech2.ko 2023-12-12T09:28:23.501 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/safe_serial.ko 2023-12-12T09:28:23.501 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/sierra.ko 2023-12-12T09:28:23.501 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/spcp8x5.ko 2023-12-12T09:28:23.501 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/ssu100.ko 2023-12-12T09:28:23.501 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/symbolserial.ko 2023-12-12T09:28:23.501 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2023-12-12T09:28:23.501 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/usb-serial-simple.ko 2023-12-12T09:28:23.501 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/usb_debug.ko 2023-12-12T09:28:23.501 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/usb_wwan.ko 2023-12-12T09:28:23.501 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/visor.ko 2023-12-12T09:28:23.502 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/whiteheat.ko 2023-12-12T09:28:23.502 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/xsens_mt.ko 2023-12-12T09:28:23.502 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage 2023-12-12T09:28:23.502 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/uas.ko 2023-12-12T09:28:23.502 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-alauda.ko 2023-12-12T09:28:23.502 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-cypress.ko 2023-12-12T09:28:23.502 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-datafab.ko 2023-12-12T09:28:23.502 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-eneub6250.ko 2023-12-12T09:28:23.502 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-freecom.ko 2023-12-12T09:28:23.502 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-isd200.ko 2023-12-12T09:28:23.502 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-jumpshot.ko 2023-12-12T09:28:23.502 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-karma.ko 2023-12-12T09:28:23.502 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-onetouch.ko 2023-12-12T09:28:23.502 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-realtek.ko 2023-12-12T09:28:23.502 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-sddr09.ko 2023-12-12T09:28:23.503 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-sddr55.ko 2023-12-12T09:28:23.503 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-usbat.ko 2023-12-12T09:28:23.503 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/usb-storage.ko 2023-12-12T09:28:23.503 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/usbip 2023-12-12T09:28:23.503 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/usbip/usbip-core.ko 2023-12-12T09:28:23.503 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/usbip/usbip-host.ko 2023-12-12T09:28:23.503 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/usbip/vhci-hcd.ko 2023-12-12T09:28:23.503 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vfio 2023-12-12T09:28:23.503 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vfio/pci 2023-12-12T09:28:23.503 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vfio/pci/vfio-pci-core.ko 2023-12-12T09:28:23.503 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vfio/pci/vfio-pci.ko 2023-12-12T09:28:23.503 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vfio/vfio.ko 2023-12-12T09:28:23.503 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vfio/vfio_iommu_type1.ko 2023-12-12T09:28:23.503 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vhost 2023-12-12T09:28:23.503 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vhost/vhost.ko 2023-12-12T09:28:23.503 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vhost/vhost_iotlb.ko 2023-12-12T09:28:23.504 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vhost/vhost_net.ko 2023-12-12T09:28:23.504 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vhost/vhost_scsi.ko 2023-12-12T09:28:23.504 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video 2023-12-12T09:28:23.504 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight 2023-12-12T09:28:23.504 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight/apple_bl.ko 2023-12-12T09:28:23.504 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight/lcd.ko 2023-12-12T09:28:23.504 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight/platform_lcd.ko 2023-12-12T09:28:23.504 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/virtio 2023-12-12T09:28:23.504 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/virtio/virtio.ko 2023-12-12T09:28:23.504 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/virtio/virtio_balloon.ko 2023-12-12T09:28:23.504 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/virtio/virtio_mmio.ko 2023-12-12T09:28:23.504 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/virtio/virtio_pci.ko 2023-12-12T09:28:23.504 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2023-12-12T09:28:23.504 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2023-12-12T09:28:23.504 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/virtio/virtio_ring.ko 2023-12-12T09:28:23.505 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1 2023-12-12T09:28:23.505 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/masters 2023-12-12T09:28:23.505 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/masters/ds2482.ko 2023-12-12T09:28:23.505 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/masters/ds2490.ko 2023-12-12T09:28:23.505 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves 2023-12-12T09:28:23.505 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_ds2406.ko 2023-12-12T09:28:23.505 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_ds2408.ko 2023-12-12T09:28:23.505 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_ds2413.ko 2023-12-12T09:28:23.505 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_ds2423.ko 2023-12-12T09:28:23.505 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_ds2431.ko 2023-12-12T09:28:23.505 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_ds2433.ko 2023-12-12T09:28:23.505 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_ds2780.ko 2023-12-12T09:28:23.505 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_ds2781.ko 2023-12-12T09:28:23.505 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_ds28e04.ko 2023-12-12T09:28:23.505 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_smem.ko 2023-12-12T09:28:23.505 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_therm.ko 2023-12-12T09:28:23.506 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/wire.ko 2023-12-12T09:28:23.506 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog 2023-12-12T09:28:23.506 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/alim1535_wdt.ko 2023-12-12T09:28:23.506 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/alim7101_wdt.ko 2023-12-12T09:28:23.506 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/f71808e_wdt.ko 2023-12-12T09:28:23.506 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/hpwdt.ko 2023-12-12T09:28:23.506 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/i6300esb.ko 2023-12-12T09:28:23.506 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/iTCO_vendor_support.ko 2023-12-12T09:28:23.506 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/iTCO_wdt.ko 2023-12-12T09:28:23.506 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/ib700wdt.ko 2023-12-12T09:28:23.506 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/ibmasr.ko 2023-12-12T09:28:23.506 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/ie6xx_wdt.ko 2023-12-12T09:28:23.506 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/it8712f_wdt.ko 2023-12-12T09:28:23.506 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/it87_wdt.ko 2023-12-12T09:28:23.506 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/machzwd.ko 2023-12-12T09:28:23.507 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/nv_tco.ko 2023-12-12T09:28:23.507 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/pcwd_pci.ko 2023-12-12T09:28:23.507 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/pcwd_usb.ko 2023-12-12T09:28:23.507 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2023-12-12T09:28:23.507 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/sch311x_wdt.ko 2023-12-12T09:28:23.507 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/softdog.ko 2023-12-12T09:28:23.507 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/sp5100_tco.ko 2023-12-12T09:28:23.507 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/via_wdt.ko 2023-12-12T09:28:23.507 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/w83627hf_wdt.ko 2023-12-12T09:28:23.507 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/w83877f_wdt.ko 2023-12-12T09:28:23.507 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/w83977f_wdt.ko 2023-12-12T09:28:23.507 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/wdt_pci.ko 2023-12-12T09:28:23.507 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/xen_wdt.ko 2023-12-12T09:28:23.507 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/xen 2023-12-12T09:28:23.507 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/xen/xen-acpi-processor.ko 2023-12-12T09:28:23.508 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/xen/xen-evtchn.ko 2023-12-12T09:28:23.508 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/xen/xen-gntalloc.ko 2023-12-12T09:28:23.508 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/xen/xen-gntdev.ko 2023-12-12T09:28:23.508 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/xen/xen-pciback 2023-12-12T09:28:23.508 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2023-12-12T09:28:23.508 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/xen/xen-privcmd.ko 2023-12-12T09:28:23.508 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/xen/xenfs 2023-12-12T09:28:23.508 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/xen/xenfs/xenfs.ko 2023-12-12T09:28:23.508 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs 2023-12-12T09:28:23.508 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/9p 2023-12-12T09:28:23.508 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/9p/9p.ko 2023-12-12T09:28:23.508 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/affs 2023-12-12T09:28:23.508 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/affs/affs.ko 2023-12-12T09:28:23.508 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/befs 2023-12-12T09:28:23.508 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/befs/befs.ko 2023-12-12T09:28:23.509 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/binfmt_misc.ko 2023-12-12T09:28:23.509 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/btrfs 2023-12-12T09:28:23.509 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/btrfs/btrfs.ko 2023-12-12T09:28:23.509 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/cachefiles 2023-12-12T09:28:23.509 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/cachefiles/cachefiles.ko 2023-12-12T09:28:23.509 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ceph 2023-12-12T09:28:23.509 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ceph/ceph.ko 2023-12-12T09:28:23.509 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/coda 2023-12-12T09:28:23.509 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/coda/coda.ko 2023-12-12T09:28:23.509 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/cramfs 2023-12-12T09:28:23.509 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/cramfs/cramfs.ko 2023-12-12T09:28:23.509 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/dlm 2023-12-12T09:28:23.509 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/dlm/dlm.ko 2023-12-12T09:28:23.509 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ecryptfs 2023-12-12T09:28:23.509 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ecryptfs/ecryptfs.ko 2023-12-12T09:28:23.509 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/f2fs 2023-12-12T09:28:23.510 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/f2fs/f2fs.ko 2023-12-12T09:28:23.510 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/fat 2023-12-12T09:28:23.510 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/fat/fat.ko 2023-12-12T09:28:23.510 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/fat/msdos.ko 2023-12-12T09:28:23.510 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/fat/vfat.ko 2023-12-12T09:28:23.510 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/fscache 2023-12-12T09:28:23.510 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/fscache/fscache.ko 2023-12-12T09:28:23.510 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/fuse 2023-12-12T09:28:23.510 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/fuse/cuse.ko 2023-12-12T09:28:23.510 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/fuse/fuse.ko 2023-12-12T09:28:23.510 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/gfs2 2023-12-12T09:28:23.510 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/gfs2/gfs2.ko 2023-12-12T09:28:23.510 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/hfs 2023-12-12T09:28:23.510 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/hfs/hfs.ko 2023-12-12T09:28:23.510 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/hfsplus 2023-12-12T09:28:23.511 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/hfsplus/hfsplus.ko 2023-12-12T09:28:23.511 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/isofs 2023-12-12T09:28:23.511 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/isofs/isofs.ko 2023-12-12T09:28:23.511 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/jfs 2023-12-12T09:28:23.511 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/jfs/jfs.ko 2023-12-12T09:28:23.511 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/lockd 2023-12-12T09:28:23.511 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/lockd/lockd.ko 2023-12-12T09:28:23.511 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/minix 2023-12-12T09:28:23.511 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/minix/minix.ko 2023-12-12T09:28:23.511 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/netfs 2023-12-12T09:28:23.511 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/netfs/netfs.ko 2023-12-12T09:28:23.511 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs 2023-12-12T09:28:23.511 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs/blocklayout 2023-12-12T09:28:23.511 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2023-12-12T09:28:23.511 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs/filelayout 2023-12-12T09:28:23.511 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2023-12-12T09:28:23.512 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs/flexfilelayout 2023-12-12T09:28:23.512 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2023-12-12T09:28:23.512 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs/nfs.ko 2023-12-12T09:28:23.512 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs/nfsv3.ko 2023-12-12T09:28:23.512 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs/nfsv4.ko 2023-12-12T09:28:23.512 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs_common 2023-12-12T09:28:23.512 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs_common/grace.ko 2023-12-12T09:28:23.512 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs_common/nfs_acl.ko 2023-12-12T09:28:23.512 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfsd 2023-12-12T09:28:23.512 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfsd/nfsd.ko 2023-12-12T09:28:23.512 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nilfs2 2023-12-12T09:28:23.512 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nilfs2/nilfs2.ko 2023-12-12T09:28:23.512 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls 2023-12-12T09:28:23.512 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-celtic.ko 2023-12-12T09:28:23.512 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-centeuro.ko 2023-12-12T09:28:23.513 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-croatian.ko 2023-12-12T09:28:23.513 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-cyrillic.ko 2023-12-12T09:28:23.513 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-gaelic.ko 2023-12-12T09:28:23.513 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-greek.ko 2023-12-12T09:28:23.513 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-iceland.ko 2023-12-12T09:28:23.513 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-inuit.ko 2023-12-12T09:28:23.513 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-roman.ko 2023-12-12T09:28:23.513 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-romanian.ko 2023-12-12T09:28:23.513 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-turkish.ko 2023-12-12T09:28:23.513 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp1250.ko 2023-12-12T09:28:23.513 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp1251.ko 2023-12-12T09:28:23.513 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp1255.ko 2023-12-12T09:28:23.513 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp737.ko 2023-12-12T09:28:23.513 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp775.ko 2023-12-12T09:28:23.513 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp850.ko 2023-12-12T09:28:23.513 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp852.ko 2023-12-12T09:28:23.514 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp855.ko 2023-12-12T09:28:23.514 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp857.ko 2023-12-12T09:28:23.514 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp860.ko 2023-12-12T09:28:23.514 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp861.ko 2023-12-12T09:28:23.514 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp862.ko 2023-12-12T09:28:23.514 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp863.ko 2023-12-12T09:28:23.514 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp864.ko 2023-12-12T09:28:23.514 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp865.ko 2023-12-12T09:28:23.514 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp866.ko 2023-12-12T09:28:23.514 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp869.ko 2023-12-12T09:28:23.514 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp874.ko 2023-12-12T09:28:23.514 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp932.ko 2023-12-12T09:28:23.514 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp936.ko 2023-12-12T09:28:23.514 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp949.ko 2023-12-12T09:28:23.514 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp950.ko 2023-12-12T09:28:23.515 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_euc-jp.ko 2023-12-12T09:28:23.515 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-1.ko 2023-12-12T09:28:23.515 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-13.ko 2023-12-12T09:28:23.515 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-14.ko 2023-12-12T09:28:23.515 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-15.ko 2023-12-12T09:28:23.515 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-2.ko 2023-12-12T09:28:23.515 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-3.ko 2023-12-12T09:28:23.515 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-4.ko 2023-12-12T09:28:23.515 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-5.ko 2023-12-12T09:28:23.515 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-6.ko 2023-12-12T09:28:23.515 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-7.ko 2023-12-12T09:28:23.515 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-9.ko 2023-12-12T09:28:23.515 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_koi8-r.ko 2023-12-12T09:28:23.515 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_koi8-ru.ko 2023-12-12T09:28:23.515 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_koi8-u.ko 2023-12-12T09:28:23.515 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_ucs2_utils.ko 2023-12-12T09:28:23.516 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_utf8.ko 2023-12-12T09:28:23.516 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2 2023-12-12T09:28:23.516 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2/cluster 2023-12-12T09:28:23.516 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2023-12-12T09:28:23.516 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2/dlm 2023-12-12T09:28:23.516 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2023-12-12T09:28:23.516 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2/dlmfs 2023-12-12T09:28:23.516 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2023-12-12T09:28:23.516 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2/ocfs2.ko 2023-12-12T09:28:23.516 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2023-12-12T09:28:23.516 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2/ocfs2_stack_user.ko 2023-12-12T09:28:23.516 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2/ocfs2_stackglue.ko 2023-12-12T09:28:23.516 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/overlayfs 2023-12-12T09:28:23.516 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/overlayfs/overlay.ko 2023-12-12T09:28:23.516 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/pstore 2023-12-12T09:28:23.517 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/pstore/ramoops.ko 2023-12-12T09:28:23.517 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/reiserfs 2023-12-12T09:28:23.517 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/reiserfs/reiserfs.ko 2023-12-12T09:28:23.517 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/romfs 2023-12-12T09:28:23.517 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/romfs/romfs.ko 2023-12-12T09:28:23.517 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/smb 2023-12-12T09:28:23.517 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/smb/client 2023-12-12T09:28:23.517 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/smb/client/cifs.ko 2023-12-12T09:28:23.517 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/smb/common 2023-12-12T09:28:23.517 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/smb/common/cifs_arc4.ko 2023-12-12T09:28:23.517 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/smb/common/cifs_md4.ko 2023-12-12T09:28:23.517 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/squashfs 2023-12-12T09:28:23.517 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/squashfs/squashfs.ko 2023-12-12T09:28:23.517 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/sysv 2023-12-12T09:28:23.517 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/sysv/sysv.ko 2023-12-12T09:28:23.518 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/udf 2023-12-12T09:28:23.518 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/udf/udf.ko 2023-12-12T09:28:23.518 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ufs 2023-12-12T09:28:23.518 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ufs/ufs.ko 2023-12-12T09:28:23.518 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/xfs 2023-12-12T09:28:23.518 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/xfs/xfs.ko 2023-12-12T09:28:23.518 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/kernel 2023-12-12T09:28:23.518 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/kernel/rcu 2023-12-12T09:28:23.518 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/kernel/rcu/rcutorture.ko 2023-12-12T09:28:23.518 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/kernel/torture.ko 2023-12-12T09:28:23.518 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/kernel/trace 2023-12-12T09:28:23.518 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/kernel/trace/ring_buffer_benchmark.ko 2023-12-12T09:28:23.518 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib 2023-12-12T09:28:23.518 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/asn1_encoder.ko 2023-12-12T09:28:23.518 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/crc-itu-t.ko 2023-12-12T09:28:23.519 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/crc8.ko 2023-12-12T09:28:23.519 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/crypto 2023-12-12T09:28:23.519 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/crypto/libarc4.ko 2023-12-12T09:28:23.519 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/crypto/libdes.ko 2023-12-12T09:28:23.519 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/libcrc32c.ko 2023-12-12T09:28:23.519 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/lru_cache.ko 2023-12-12T09:28:23.519 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/lz4 2023-12-12T09:28:23.519 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/lz4/lz4_compress.ko 2023-12-12T09:28:23.519 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/lz4/lz4hc_compress.ko 2023-12-12T09:28:23.519 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/math 2023-12-12T09:28:23.519 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/math/cordic.ko 2023-12-12T09:28:23.519 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/raid6 2023-12-12T09:28:23.519 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/raid6/raid6_pq.ko 2023-12-12T09:28:23.519 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/reed_solomon 2023-12-12T09:28:23.519 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/reed_solomon/reed_solomon.ko 2023-12-12T09:28:23.519 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/ts_bm.ko 2023-12-12T09:28:23.520 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/ts_fsm.ko 2023-12-12T09:28:23.520 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/ts_kmp.ko 2023-12-12T09:28:23.520 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/zstd 2023-12-12T09:28:23.520 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/zstd/zstd_compress.ko 2023-12-12T09:28:23.520 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/mm 2023-12-12T09:28:23.520 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/mm/hwpoison-inject.ko 2023-12-12T09:28:23.520 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net 2023-12-12T09:28:23.520 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/6lowpan 2023-12-12T09:28:23.520 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/6lowpan/6lowpan.ko 2023-12-12T09:28:23.520 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/6lowpan/nhc_dest.ko 2023-12-12T09:28:23.520 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/6lowpan/nhc_fragment.ko 2023-12-12T09:28:23.520 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/6lowpan/nhc_hop.ko 2023-12-12T09:28:23.520 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/6lowpan/nhc_ipv6.ko 2023-12-12T09:28:23.520 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/6lowpan/nhc_mobility.ko 2023-12-12T09:28:23.520 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/6lowpan/nhc_routing.ko 2023-12-12T09:28:23.521 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/6lowpan/nhc_udp.ko 2023-12-12T09:28:23.521 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/802 2023-12-12T09:28:23.521 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/802/garp.ko 2023-12-12T09:28:23.521 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/802/mrp.ko 2023-12-12T09:28:23.521 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/802/p8022.ko 2023-12-12T09:28:23.521 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/802/psnap.ko 2023-12-12T09:28:23.521 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/802/stp.ko 2023-12-12T09:28:23.521 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/8021q 2023-12-12T09:28:23.521 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/8021q/8021q.ko 2023-12-12T09:28:23.521 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/9p 2023-12-12T09:28:23.521 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/9p/9pnet.ko 2023-12-12T09:28:23.521 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/9p/9pnet_fd.ko 2023-12-12T09:28:23.521 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/9p/9pnet_rdma.ko 2023-12-12T09:28:23.521 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/9p/9pnet_virtio.ko 2023-12-12T09:28:23.521 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/batman-adv 2023-12-12T09:28:23.521 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/batman-adv/batman-adv.ko 2023-12-12T09:28:23.522 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge 2023-12-12T09:28:23.522 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/br_netfilter.ko 2023-12-12T09:28:23.522 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/bridge.ko 2023-12-12T09:28:23.522 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter 2023-12-12T09:28:23.522 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_802_3.ko 2023-12-12T09:28:23.522 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_among.ko 2023-12-12T09:28:23.522 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_arp.ko 2023-12-12T09:28:23.522 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_arpreply.ko 2023-12-12T09:28:23.522 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_dnat.ko 2023-12-12T09:28:23.522 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_ip.ko 2023-12-12T09:28:23.522 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_ip6.ko 2023-12-12T09:28:23.522 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_limit.ko 2023-12-12T09:28:23.522 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_log.ko 2023-12-12T09:28:23.522 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_mark.ko 2023-12-12T09:28:23.522 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_mark_m.ko 2023-12-12T09:28:23.523 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_nflog.ko 2023-12-12T09:28:23.523 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_pkttype.ko 2023-12-12T09:28:23.523 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_redirect.ko 2023-12-12T09:28:23.523 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_snat.ko 2023-12-12T09:28:23.523 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_stp.ko 2023-12-12T09:28:23.523 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_vlan.ko 2023-12-12T09:28:23.523 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebtable_broute.ko 2023-12-12T09:28:23.523 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebtable_filter.ko 2023-12-12T09:28:23.523 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebtable_nat.ko 2023-12-12T09:28:23.523 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebtables.ko 2023-12-12T09:28:23.523 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2023-12-12T09:28:23.523 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2023-12-12T09:28:23.523 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2023-12-12T09:28:23.523 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ceph 2023-12-12T09:28:23.523 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ceph/libceph.ko 2023-12-12T09:28:23.524 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/core 2023-12-12T09:28:23.524 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/core/failover.ko 2023-12-12T09:28:23.524 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/core/pktgen.ko 2023-12-12T09:28:23.524 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dccp 2023-12-12T09:28:23.524 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dccp/dccp.ko 2023-12-12T09:28:23.524 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dccp/dccp_diag.ko 2023-12-12T09:28:23.524 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dccp/dccp_ipv4.ko 2023-12-12T09:28:23.524 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dccp/dccp_ipv6.ko 2023-12-12T09:28:23.524 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dns_resolver 2023-12-12T09:28:23.524 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dns_resolver/dns_resolver.ko 2023-12-12T09:28:23.524 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dsa 2023-12-12T09:28:23.524 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dsa/dsa_core.ko 2023-12-12T09:28:23.524 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dsa/tag_brcm.ko 2023-12-12T09:28:23.524 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dsa/tag_dsa.ko 2023-12-12T09:28:23.524 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dsa/tag_none.ko 2023-12-12T09:28:23.524 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dsa/tag_trailer.ko 2023-12-12T09:28:23.525 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ieee802154 2023-12-12T09:28:23.525 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ieee802154/6lowpan 2023-12-12T09:28:23.525 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2023-12-12T09:28:23.525 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ieee802154/ieee802154.ko 2023-12-12T09:28:23.525 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ieee802154/ieee802154_socket.ko 2023-12-12T09:28:23.525 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4 2023-12-12T09:28:23.525 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/ah4.ko 2023-12-12T09:28:23.525 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/esp4.ko 2023-12-12T09:28:23.525 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/fou.ko 2023-12-12T09:28:23.525 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/gre.ko 2023-12-12T09:28:23.525 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/inet_diag.ko 2023-12-12T09:28:23.525 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/ip_gre.ko 2023-12-12T09:28:23.525 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/ip_tunnel.ko 2023-12-12T09:28:23.525 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/ip_vti.ko 2023-12-12T09:28:23.525 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/ipcomp.ko 2023-12-12T09:28:23.526 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/ipip.ko 2023-12-12T09:28:23.526 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter 2023-12-12T09:28:23.526 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/arp_tables.ko 2023-12-12T09:28:23.526 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/arpt_mangle.ko 2023-12-12T09:28:23.526 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/arptable_filter.ko 2023-12-12T09:28:23.526 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/ipt_ECN.ko 2023-12-12T09:28:23.526 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2023-12-12T09:28:23.526 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/ipt_ah.ko 2023-12-12T09:28:23.526 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2023-12-12T09:28:23.526 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/iptable_mangle.ko 2023-12-12T09:28:23.526 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/iptable_nat.ko 2023-12-12T09:28:23.526 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/iptable_raw.ko 2023-12-12T09:28:23.526 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/iptable_security.ko 2023-12-12T09:28:23.526 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2023-12-12T09:28:23.526 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2023-12-12T09:28:23.527 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2023-12-12T09:28:23.527 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2023-12-12T09:28:23.527 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2023-12-12T09:28:23.527 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2023-12-12T09:28:23.527 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2023-12-12T09:28:23.527 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2023-12-12T09:28:23.527 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2023-12-12T09:28:23.527 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2023-12-12T09:28:23.527 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_bic.ko 2023-12-12T09:28:23.527 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_dctcp.ko 2023-12-12T09:28:23.527 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_diag.ko 2023-12-12T09:28:23.527 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_highspeed.ko 2023-12-12T09:28:23.527 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_htcp.ko 2023-12-12T09:28:23.527 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_hybla.ko 2023-12-12T09:28:23.527 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_illinois.ko 2023-12-12T09:28:23.527 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_lp.ko 2023-12-12T09:28:23.528 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_scalable.ko 2023-12-12T09:28:23.528 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_vegas.ko 2023-12-12T09:28:23.528 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_veno.ko 2023-12-12T09:28:23.528 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_westwood.ko 2023-12-12T09:28:23.528 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_yeah.ko 2023-12-12T09:28:23.528 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tunnel4.ko 2023-12-12T09:28:23.528 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/udp_diag.ko 2023-12-12T09:28:23.528 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/udp_tunnel.ko 2023-12-12T09:28:23.528 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/xfrm4_tunnel.ko 2023-12-12T09:28:23.528 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6 2023-12-12T09:28:23.528 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/ah6.ko 2023-12-12T09:28:23.528 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/esp6.ko 2023-12-12T09:28:23.528 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/fou6.ko 2023-12-12T09:28:23.528 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/ip6_tunnel.ko 2023-12-12T09:28:23.528 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/ip6_udp_tunnel.ko 2023-12-12T09:28:23.529 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/ip6_vti.ko 2023-12-12T09:28:23.529 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/ipcomp6.ko 2023-12-12T09:28:23.529 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter 2023-12-12T09:28:23.529 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6_tables.ko 2023-12-12T09:28:23.529 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2023-12-12T09:28:23.529 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2023-12-12T09:28:23.529 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6t_ah.ko 2023-12-12T09:28:23.529 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2023-12-12T09:28:23.529 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6t_frag.ko 2023-12-12T09:28:23.529 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2023-12-12T09:28:23.529 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2023-12-12T09:28:23.529 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6t_mh.ko 2023-12-12T09:28:23.529 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2023-12-12T09:28:23.529 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6t_rt.ko 2023-12-12T09:28:23.529 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6table_filter.ko 2023-12-12T09:28:23.529 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2023-12-12T09:28:23.530 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6table_nat.ko 2023-12-12T09:28:23.530 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6table_raw.ko 2023-12-12T09:28:23.530 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6table_security.ko 2023-12-12T09:28:23.530 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2023-12-12T09:28:23.530 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2023-12-12T09:28:23.530 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2023-12-12T09:28:23.530 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2023-12-12T09:28:23.530 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2023-12-12T09:28:23.530 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2023-12-12T09:28:23.530 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2023-12-12T09:28:23.530 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2023-12-12T09:28:23.530 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/sit.ko 2023-12-12T09:28:23.530 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/tunnel6.ko 2023-12-12T09:28:23.530 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/xfrm6_tunnel.ko 2023-12-12T09:28:23.530 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/key 2023-12-12T09:28:23.531 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/key/af_key.ko 2023-12-12T09:28:23.531 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/l2tp 2023-12-12T09:28:23.531 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/l2tp/l2tp_core.ko 2023-12-12T09:28:23.531 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/l2tp/l2tp_debugfs.ko 2023-12-12T09:28:23.531 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/l2tp/l2tp_eth.ko 2023-12-12T09:28:23.531 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/l2tp/l2tp_ip.ko 2023-12-12T09:28:23.531 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/l2tp/l2tp_ip6.ko 2023-12-12T09:28:23.531 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/l2tp/l2tp_netlink.ko 2023-12-12T09:28:23.531 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/l2tp/l2tp_ppp.ko 2023-12-12T09:28:23.531 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/llc 2023-12-12T09:28:23.531 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/llc/llc.ko 2023-12-12T09:28:23.531 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/mac802154 2023-12-12T09:28:23.531 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/mac802154/mac802154.ko 2023-12-12T09:28:23.531 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/mpls 2023-12-12T09:28:23.531 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/mpls/mpls_gso.ko 2023-12-12T09:28:23.531 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter 2023-12-12T09:28:23.532 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset 2023-12-12T09:28:23.532 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set.ko 2023-12-12T09:28:23.532 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2023-12-12T09:28:23.532 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2023-12-12T09:28:23.532 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2023-12-12T09:28:23.532 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2023-12-12T09:28:23.532 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2023-12-12T09:28:23.532 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2023-12-12T09:28:23.532 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2023-12-12T09:28:23.532 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2023-12-12T09:28:23.532 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2023-12-12T09:28:23.532 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2023-12-12T09:28:23.532 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2023-12-12T09:28:23.532 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2023-12-12T09:28:23.532 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2023-12-12T09:28:23.532 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2023-12-12T09:28:23.533 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_list_set.ko 2023-12-12T09:28:23.533 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs 2023-12-12T09:28:23.533 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs.ko 2023-12-12T09:28:23.533 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2023-12-12T09:28:23.533 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2023-12-12T09:28:23.533 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2023-12-12T09:28:23.533 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2023-12-12T09:28:23.533 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2023-12-12T09:28:23.533 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2023-12-12T09:28:23.533 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2023-12-12T09:28:23.533 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2023-12-12T09:28:23.533 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2023-12-12T09:28:23.533 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2023-12-12T09:28:23.533 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2023-12-12T09:28:23.533 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2023-12-12T09:28:23.534 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2023-12-12T09:28:23.534 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conncount.ko 2023-12-12T09:28:23.534 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack.ko 2023-12-12T09:28:23.534 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_amanda.ko 2023-12-12T09:28:23.534 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_broadcast.ko 2023-12-12T09:28:23.534 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_ftp.ko 2023-12-12T09:28:23.534 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_h323.ko 2023-12-12T09:28:23.534 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_irc.ko 2023-12-12T09:28:23.534 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2023-12-12T09:28:23.534 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_netlink.ko 2023-12-12T09:28:23.534 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_pptp.ko 2023-12-12T09:28:23.534 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_sane.ko 2023-12-12T09:28:23.534 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_sip.ko 2023-12-12T09:28:23.534 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_snmp.ko 2023-12-12T09:28:23.534 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_tftp.ko 2023-12-12T09:28:23.535 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_dup_netdev.ko 2023-12-12T09:28:23.535 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_flow_table.ko 2023-12-12T09:28:23.535 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_flow_table_inet.ko 2023-12-12T09:28:23.535 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_log_syslog.ko 2023-12-12T09:28:23.535 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_nat.ko 2023-12-12T09:28:23.535 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_nat_amanda.ko 2023-12-12T09:28:23.535 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_nat_ftp.ko 2023-12-12T09:28:23.535 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_nat_irc.ko 2023-12-12T09:28:23.535 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_nat_sip.ko 2023-12-12T09:28:23.535 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_nat_tftp.ko 2023-12-12T09:28:23.535 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_synproxy_core.ko 2023-12-12T09:28:23.535 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_tables.ko 2023-12-12T09:28:23.535 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nfnetlink.ko 2023-12-12T09:28:23.535 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nfnetlink_acct.ko 2023-12-12T09:28:23.535 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nfnetlink_log.ko 2023-12-12T09:28:23.536 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nfnetlink_osf.ko 2023-12-12T09:28:23.536 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nfnetlink_queue.ko 2023-12-12T09:28:23.536 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_chain_nat.ko 2023-12-12T09:28:23.536 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_compat.ko 2023-12-12T09:28:23.536 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_ct.ko 2023-12-12T09:28:23.536 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_dup_netdev.ko 2023-12-12T09:28:23.536 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_fib.ko 2023-12-12T09:28:23.536 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_fwd_netdev.ko 2023-12-12T09:28:23.536 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_hash.ko 2023-12-12T09:28:23.536 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_limit.ko 2023-12-12T09:28:23.536 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_log.ko 2023-12-12T09:28:23.536 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_masq.ko 2023-12-12T09:28:23.536 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_nat.ko 2023-12-12T09:28:23.536 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_numgen.ko 2023-12-12T09:28:23.536 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_queue.ko 2023-12-12T09:28:23.536 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_quota.ko 2023-12-12T09:28:23.537 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_redir.ko 2023-12-12T09:28:23.537 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_reject.ko 2023-12-12T09:28:23.537 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_reject_inet.ko 2023-12-12T09:28:23.537 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_socket.ko 2023-12-12T09:28:23.537 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_tunnel.ko 2023-12-12T09:28:23.537 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_AUDIT.ko 2023-12-12T09:28:23.537 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_CHECKSUM.ko 2023-12-12T09:28:23.537 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_CLASSIFY.ko 2023-12-12T09:28:23.537 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_CONNSECMARK.ko 2023-12-12T09:28:23.537 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_CT.ko 2023-12-12T09:28:23.537 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_DSCP.ko 2023-12-12T09:28:23.537 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_HL.ko 2023-12-12T09:28:23.537 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_HMARK.ko 2023-12-12T09:28:23.537 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_IDLETIMER.ko 2023-12-12T09:28:23.537 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_LED.ko 2023-12-12T09:28:23.538 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_LOG.ko 2023-12-12T09:28:23.538 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_MASQUERADE.ko 2023-12-12T09:28:23.538 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_NETMAP.ko 2023-12-12T09:28:23.538 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_NFLOG.ko 2023-12-12T09:28:23.538 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_NFQUEUE.ko 2023-12-12T09:28:23.538 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_RATEEST.ko 2023-12-12T09:28:23.538 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_REDIRECT.ko 2023-12-12T09:28:23.538 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_SECMARK.ko 2023-12-12T09:28:23.538 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_TCPMSS.ko 2023-12-12T09:28:23.538 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2023-12-12T09:28:23.538 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_TEE.ko 2023-12-12T09:28:23.538 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_TPROXY.ko 2023-12-12T09:28:23.538 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_TRACE.ko 2023-12-12T09:28:23.538 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_addrtype.ko 2023-12-12T09:28:23.538 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_bpf.ko 2023-12-12T09:28:23.539 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_cgroup.ko 2023-12-12T09:28:23.539 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_cluster.ko 2023-12-12T09:28:23.539 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_comment.ko 2023-12-12T09:28:23.539 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_connbytes.ko 2023-12-12T09:28:23.539 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_connlabel.ko 2023-12-12T09:28:23.539 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_connlimit.ko 2023-12-12T09:28:23.539 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_connmark.ko 2023-12-12T09:28:23.539 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_conntrack.ko 2023-12-12T09:28:23.539 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_cpu.ko 2023-12-12T09:28:23.539 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_dccp.ko 2023-12-12T09:28:23.539 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_devgroup.ko 2023-12-12T09:28:23.539 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_dscp.ko 2023-12-12T09:28:23.539 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_ecn.ko 2023-12-12T09:28:23.539 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_esp.ko 2023-12-12T09:28:23.539 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_hashlimit.ko 2023-12-12T09:28:23.539 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_helper.ko 2023-12-12T09:28:23.540 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_hl.ko 2023-12-12T09:28:23.540 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_ipcomp.ko 2023-12-12T09:28:23.540 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_iprange.ko 2023-12-12T09:28:23.540 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_ipvs.ko 2023-12-12T09:28:23.540 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_l2tp.ko 2023-12-12T09:28:23.540 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_length.ko 2023-12-12T09:28:23.540 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_limit.ko 2023-12-12T09:28:23.540 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_mac.ko 2023-12-12T09:28:23.540 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_mark.ko 2023-12-12T09:28:23.540 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_multiport.ko 2023-12-12T09:28:23.540 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_nat.ko 2023-12-12T09:28:23.540 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_nfacct.ko 2023-12-12T09:28:23.540 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_osf.ko 2023-12-12T09:28:23.540 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_owner.ko 2023-12-12T09:28:23.540 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_physdev.ko 2023-12-12T09:28:23.541 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_pkttype.ko 2023-12-12T09:28:23.541 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_policy.ko 2023-12-12T09:28:23.541 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_quota.ko 2023-12-12T09:28:23.541 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_rateest.ko 2023-12-12T09:28:23.541 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_realm.ko 2023-12-12T09:28:23.541 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_recent.ko 2023-12-12T09:28:23.541 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_sctp.ko 2023-12-12T09:28:23.541 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_set.ko 2023-12-12T09:28:23.541 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_socket.ko 2023-12-12T09:28:23.541 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_state.ko 2023-12-12T09:28:23.541 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_statistic.ko 2023-12-12T09:28:23.541 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_string.ko 2023-12-12T09:28:23.541 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_tcpmss.ko 2023-12-12T09:28:23.541 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_time.ko 2023-12-12T09:28:23.541 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_u32.ko 2023-12-12T09:28:23.542 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netlink 2023-12-12T09:28:23.542 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netlink/netlink_diag.ko 2023-12-12T09:28:23.542 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/nsh 2023-12-12T09:28:23.542 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/nsh/nsh.ko 2023-12-12T09:28:23.542 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/openvswitch 2023-12-12T09:28:23.542 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/openvswitch/openvswitch.ko 2023-12-12T09:28:23.542 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/openvswitch/vport-geneve.ko 2023-12-12T09:28:23.542 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/openvswitch/vport-gre.ko 2023-12-12T09:28:23.542 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/openvswitch/vport-vxlan.ko 2023-12-12T09:28:23.542 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/packet 2023-12-12T09:28:23.542 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/packet/af_packet_diag.ko 2023-12-12T09:28:23.542 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/rds 2023-12-12T09:28:23.542 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/rds/rds.ko 2023-12-12T09:28:23.542 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/rds/rds_rdma.ko 2023-12-12T09:28:23.542 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/rds/rds_tcp.ko 2023-12-12T09:28:23.543 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched 2023-12-12T09:28:23.543 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/act_csum.ko 2023-12-12T09:28:23.543 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/act_gact.ko 2023-12-12T09:28:23.543 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/act_ipt.ko 2023-12-12T09:28:23.543 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/act_mirred.ko 2023-12-12T09:28:23.543 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/act_nat.ko 2023-12-12T09:28:23.543 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/act_pedit.ko 2023-12-12T09:28:23.543 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/act_police.ko 2023-12-12T09:28:23.543 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/act_simple.ko 2023-12-12T09:28:23.543 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/act_skbedit.ko 2023-12-12T09:28:23.543 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/act_vlan.ko 2023-12-12T09:28:23.543 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/cls_basic.ko 2023-12-12T09:28:23.543 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/cls_bpf.ko 2023-12-12T09:28:23.543 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/cls_flow.ko 2023-12-12T09:28:23.543 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/cls_fw.ko 2023-12-12T09:28:23.543 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/cls_route.ko 2023-12-12T09:28:23.544 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/cls_u32.ko 2023-12-12T09:28:23.544 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/em_cmp.ko 2023-12-12T09:28:23.544 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/em_ipset.ko 2023-12-12T09:28:23.544 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/em_meta.ko 2023-12-12T09:28:23.544 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/em_nbyte.ko 2023-12-12T09:28:23.544 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/em_text.ko 2023-12-12T09:28:23.544 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/em_u32.ko 2023-12-12T09:28:23.544 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_choke.ko 2023-12-12T09:28:23.544 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_codel.ko 2023-12-12T09:28:23.544 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_drr.ko 2023-12-12T09:28:23.544 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_fq.ko 2023-12-12T09:28:23.544 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_gred.ko 2023-12-12T09:28:23.544 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_hfsc.ko 2023-12-12T09:28:23.544 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_hhf.ko 2023-12-12T09:28:23.544 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_htb.ko 2023-12-12T09:28:23.545 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_ingress.ko 2023-12-12T09:28:23.545 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_mqprio.ko 2023-12-12T09:28:23.545 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_mqprio_lib.ko 2023-12-12T09:28:23.545 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_multiq.ko 2023-12-12T09:28:23.545 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_netem.ko 2023-12-12T09:28:23.545 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_pie.ko 2023-12-12T09:28:23.545 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_plug.ko 2023-12-12T09:28:23.545 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_prio.ko 2023-12-12T09:28:23.545 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_qfq.ko 2023-12-12T09:28:23.545 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_red.ko 2023-12-12T09:28:23.545 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_sfb.ko 2023-12-12T09:28:23.545 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_sfq.ko 2023-12-12T09:28:23.545 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_tbf.ko 2023-12-12T09:28:23.545 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_teql.ko 2023-12-12T09:28:23.545 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sctp 2023-12-12T09:28:23.546 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sctp/sctp.ko 2023-12-12T09:28:23.546 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sctp/sctp_diag.ko 2023-12-12T09:28:23.546 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sunrpc 2023-12-12T09:28:23.546 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sunrpc/auth_gss 2023-12-12T09:28:23.546 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2023-12-12T09:28:23.546 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2023-12-12T09:28:23.546 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sunrpc/sunrpc.ko 2023-12-12T09:28:23.546 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sunrpc/xprtrdma 2023-12-12T09:28:23.546 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2023-12-12T09:28:23.546 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/tipc 2023-12-12T09:28:23.546 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/tipc/diag.ko 2023-12-12T09:28:23.546 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/tipc/tipc.ko 2023-12-12T09:28:23.546 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/unix 2023-12-12T09:28:23.546 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/unix/unix_diag.ko 2023-12-12T09:28:23.546 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/vmw_vsock 2023-12-12T09:28:23.547 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2023-12-12T09:28:23.547 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2023-12-12T09:28:23.547 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/vmw_vsock/vsock.ko 2023-12-12T09:28:23.547 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/vmw_vsock/vsock_diag.ko 2023-12-12T09:28:23.547 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/vmw_vsock/vsock_loopback.ko 2023-12-12T09:28:23.547 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/xfrm 2023-12-12T09:28:23.547 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/xfrm/xfrm_ipcomp.ko 2023-12-12T09:28:23.547 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/security 2023-12-12T09:28:23.547 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/security/keys 2023-12-12T09:28:23.547 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/security/keys/encrypted-keys 2023-12-12T09:28:23.547 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2023-12-12T09:28:23.547 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/security/keys/trusted-keys 2023-12-12T09:28:23.547 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/security/keys/trusted-keys/trusted.ko 2023-12-12T09:28:23.547 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/virt 2023-12-12T09:28:23.547 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/virt/lib 2023-12-12T09:28:23.547 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/virt/lib/irqbypass.ko 2023-12-12T09:28:23.548 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/modules.alias 2023-12-12T09:28:23.548 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/modules.alias.bin 2023-12-12T09:28:23.548 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/modules.builtin 2023-12-12T09:28:23.548 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/modules.builtin.alias.bin 2023-12-12T09:28:23.548 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/modules.builtin.bin 2023-12-12T09:28:23.548 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/modules.builtin.modinfo 2023-12-12T09:28:23.548 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/modules.dep 2023-12-12T09:28:23.548 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/modules.dep.bin 2023-12-12T09:28:23.548 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/modules.devname 2023-12-12T09:28:23.548 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/modules.order 2023-12-12T09:28:23.548 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/modules.softdep 2023-12-12T09:28:23.548 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/modules.symbols 2023-12-12T09:28:23.548 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.6.0-gcd68252d7b4d/modules.symbols.bin 2023-12-12T09:28:23.549 DEBUG:teuthology.task.kernel:get_image_version: 6.6.0-gcd68252d7b4d 2023-12-12T09:28:23.549 DEBUG:teuthology.orchestra.run.smithi142:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2023-12-12T09:28:23.571 INFO:teuthology.orchestra.run.smithi142.stdout:postinstall scriptlet (using /bin/sh): 2023-12-12T09:28:23.571 INFO:teuthology.orchestra.run.smithi142.stdout:if [ -x /sbin/installkernel -a -r /boot/vmlinuz-6.6.0-gcd68252d7b4d -a -r /boot/System.map-6.6.0-gcd68252d7b4d ]; then 2023-12-12T09:28:23.571 INFO:teuthology.orchestra.run.smithi142.stdout:cp /boot/vmlinuz-6.6.0-gcd68252d7b4d /boot/.vmlinuz-6.6.0-gcd68252d7b4d-rpm 2023-12-12T09:28:23.571 INFO:teuthology.orchestra.run.smithi142.stdout:cp /boot/System.map-6.6.0-gcd68252d7b4d /boot/.System.map-6.6.0-gcd68252d7b4d-rpm 2023-12-12T09:28:23.571 INFO:teuthology.orchestra.run.smithi142.stdout:rm -f /boot/vmlinuz-6.6.0-gcd68252d7b4d /boot/System.map-6.6.0-gcd68252d7b4d 2023-12-12T09:28:23.571 INFO:teuthology.orchestra.run.smithi142.stdout:/sbin/installkernel 6.6.0-gcd68252d7b4d /boot/.vmlinuz-6.6.0-gcd68252d7b4d-rpm /boot/.System.map-6.6.0-gcd68252d7b4d-rpm 2023-12-12T09:28:23.571 INFO:teuthology.orchestra.run.smithi142.stdout:rm -f /boot/.vmlinuz-6.6.0-gcd68252d7b4d-rpm /boot/.System.map-6.6.0-gcd68252d7b4d-rpm 2023-12-12T09:28:23.571 INFO:teuthology.orchestra.run.smithi142.stdout:fi 2023-12-12T09:28:23.572 INFO:teuthology.orchestra.run.smithi142.stdout:preuninstall scriptlet (using /bin/sh): 2023-12-12T09:28:23.572 INFO:teuthology.orchestra.run.smithi142.stdout:if [ -x /sbin/new-kernel-pkg ]; then 2023-12-12T09:28:23.572 INFO:teuthology.orchestra.run.smithi142.stdout:new-kernel-pkg --remove 6.6.0-gcd68252d7b4d --rminitrd --initrdfile=/boot/initramfs-6.6.0-gcd68252d7b4d.img 2023-12-12T09:28:23.572 INFO:teuthology.orchestra.run.smithi142.stdout:elif [ -x /usr/bin/kernel-install ]; then 2023-12-12T09:28:23.572 INFO:teuthology.orchestra.run.smithi142.stdout:kernel-install remove 6.6.0-gcd68252d7b4d 2023-12-12T09:28:23.572 INFO:teuthology.orchestra.run.smithi142.stdout:fi 2023-12-12T09:28:23.572 INFO:teuthology.orchestra.run.smithi142.stdout:postuninstall scriptlet (using /bin/sh): 2023-12-12T09:28:23.572 INFO:teuthology.orchestra.run.smithi142.stdout:if [ -x /sbin/update-bootloader ]; then 2023-12-12T09:28:23.572 INFO:teuthology.orchestra.run.smithi142.stdout:/sbin/update-bootloader --remove 6.6.0-gcd68252d7b4d 2023-12-12T09:28:23.572 INFO:teuthology.orchestra.run.smithi142.stdout:fi 2023-12-12T09:28:23.573 DEBUG:teuthology.orchestra.run.smithi142:> sudo rpm -qi grub2-tools 2023-12-12T09:28:23.655 INFO:teuthology.orchestra.run.smithi142.stdout:Name : grub2-tools 2023-12-12T09:28:23.655 INFO:teuthology.orchestra.run.smithi142.stdout:Epoch : 1 2023-12-12T09:28:23.655 INFO:teuthology.orchestra.run.smithi142.stdout:Version : 2.06 2023-12-12T09:28:23.655 INFO:teuthology.orchestra.run.smithi142.stdout:Release : 68.el9 2023-12-12T09:28:23.655 INFO:teuthology.orchestra.run.smithi142.stdout:Architecture: x86_64 2023-12-12T09:28:23.655 INFO:teuthology.orchestra.run.smithi142.stdout:Install Date: Fri 01 Sep 2023 09:14:30 PM UTC 2023-12-12T09:28:23.655 INFO:teuthology.orchestra.run.smithi142.stdout:Group : Unspecified 2023-12-12T09:28:23.655 INFO:teuthology.orchestra.run.smithi142.stdout:Size : 8264254 2023-12-12T09:28:23.655 INFO:teuthology.orchestra.run.smithi142.stdout:License : GPLv3+ 2023-12-12T09:28:23.655 INFO:teuthology.orchestra.run.smithi142.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2023-12-12T09:28:23.655 INFO:teuthology.orchestra.run.smithi142.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2023-12-12T09:28:23.655 INFO:teuthology.orchestra.run.smithi142.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2023-12-12T09:28:23.656 INFO:teuthology.orchestra.run.smithi142.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2023-12-12T09:28:23.656 INFO:teuthology.orchestra.run.smithi142.stdout:Packager : builder@centos.org 2023-12-12T09:28:23.656 INFO:teuthology.orchestra.run.smithi142.stdout:Vendor : CentOS 2023-12-12T09:28:23.656 INFO:teuthology.orchestra.run.smithi142.stdout:URL : http://www.gnu.org/software/grub/ 2023-12-12T09:28:23.656 INFO:teuthology.orchestra.run.smithi142.stdout:Summary : Support tools for GRUB. 2023-12-12T09:28:23.656 INFO:teuthology.orchestra.run.smithi142.stdout:Description : 2023-12-12T09:28:23.656 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-12-12T09:28:23.656 INFO:teuthology.orchestra.run.smithi142.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2023-12-12T09:28:23.656 INFO:teuthology.orchestra.run.smithi142.stdout:customizable bootloader with modular architecture. It supports a rich 2023-12-12T09:28:23.656 INFO:teuthology.orchestra.run.smithi142.stdout:variety of kernel formats, file systems, computer architectures and 2023-12-12T09:28:23.656 INFO:teuthology.orchestra.run.smithi142.stdout:hardware devices. 2023-12-12T09:28:23.656 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-12-12T09:28:23.656 INFO:teuthology.orchestra.run.smithi142.stdout:This subpackage provides tools for support of all platforms. 2023-12-12T09:28:23.657 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2023-12-12T09:28:23.657 INFO:teuthology.task.kernel:Updating grub on smithi142 to boot 6.6.0-gcd68252d7b4d 2023-12-12T09:28:23.657 DEBUG:teuthology.orchestra.run.smithi142:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2023-12-12T09:28:24.226 INFO:teuthology.orchestra.run.smithi142.stderr:Generating grub configuration file ... 2023-12-12T09:28:25.691 INFO:teuthology.orchestra.run.smithi142.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2023-12-12T09:28:25.727 INFO:teuthology.orchestra.run.smithi142.stderr:done 2023-12-12T09:28:25.729 DEBUG:teuthology.orchestra.run.smithi142:> mktemp 2023-12-12T09:28:25.744 INFO:teuthology.orchestra.run.smithi142.stdout:/tmp/tmp.2eVinbVf3F 2023-12-12T09:28:25.744 DEBUG:teuthology.orchestra.run.smithi142:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.2eVinbVf3F 2023-12-12T09:28:25.825 DEBUG:teuthology.orchestra.run.smithi142:> sudo chmod 0666 /tmp/tmp.2eVinbVf3F 2023-12-12T09:28:25.965 DEBUG:teuthology.orchestra.remote:smithi142:/tmp/tmp.2eVinbVf3F is 6KB 2023-12-12T09:28:26.014 DEBUG:teuthology.orchestra.run.smithi142:> rm -fr /tmp/tmp.2eVinbVf3F 2023-12-12T09:28:26.028 DEBUG:teuthology.orchestra.run.smithi142:> sudo /bin/ls /boot/loader/entries || true 2023-12-12T09:28:26.093 INFO:teuthology.orchestra.run.smithi142.stdout:15949e3c88704300882482eddfd7baae-0-rescue.conf 2023-12-12T09:28:26.093 INFO:teuthology.orchestra.run.smithi142.stdout:15949e3c88704300882482eddfd7baae-5.14.0-239.el9.x86_64.conf 2023-12-12T09:28:26.093 INFO:teuthology.orchestra.run.smithi142.stdout:15949e3c88704300882482eddfd7baae-5.14.0-361.el9.x86_64.conf 2023-12-12T09:28:26.093 INFO:teuthology.orchestra.run.smithi142.stdout:15949e3c88704300882482eddfd7baae-6.6.0-gcd68252d7b4d.conf 2023-12-12T09:28:26.094 DEBUG:teuthology.orchestra.run.smithi142:> sudo grub2-set-default 15949e3c88704300882482eddfd7baae-6.6.0-gcd68252d7b4d 2023-12-12T09:28:26.229 DEBUG:teuthology.orchestra.run.smithi142:> sudo shutdown -r now 2023-12-12T09:28:42.438 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2023-12-12T09:28:42.439 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi073.front.sepia.ceph.com' 2023-12-12T09:28:42.440 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi073.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-12T09:28:56.246 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2023-12-12T09:28:56.247 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi142.front.sepia.ceph.com' 2023-12-12T09:28:56.248 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-12T09:29:00.774 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.73 2023-12-12T09:29:09.783 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi073.front.sepia.ceph.com' 2023-12-12T09:29:09.784 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi073.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-12T09:29:12.834 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.73 2023-12-12T09:29:14.594 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.142 2023-12-12T09:29:23.602 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi142.front.sepia.ceph.com' 2023-12-12T09:29:23.603 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-12T09:29:24.836 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi073.front.sepia.ceph.com' 2023-12-12T09:29:24.837 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi073.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-12T09:29:26.658 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.142 2023-12-12T09:29:38.670 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi142.front.sepia.ceph.com' 2023-12-12T09:29:38.671 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-12T09:29:43.270 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.73 2023-12-12T09:29:57.090 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.142 2023-12-12T09:29:58.272 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi073.front.sepia.ceph.com' 2023-12-12T09:29:58.273 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi073.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-12T09:29:59.224 DEBUG:teuthology.orchestra.run.smithi073:> true 2023-12-12T09:29:59.869 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi073.front.sepia.ceph.com' 2023-12-12T09:29:59.869 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.6.0-gcd68252d7b4d"... 2023-12-12T09:29:59.870 DEBUG:teuthology.orchestra.run.smithi073:> uname -r 2023-12-12T09:29:59.911 INFO:teuthology.orchestra.run.smithi073.stdout:6.6.0-gcd68252d7b4d 2023-12-12T09:29:59.911 DEBUG:teuthology.task.kernel:current kernel version is 6.6.0-gcd68252d7b4d vs 6.6.0-gcd68252d7b4d 2023-12-12T09:29:59.911 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-12-12T09:29:59.911 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2023-12-12T09:30:00.912 DEBUG:teuthology.parallel:result is None 2023-12-12T09:30:12.092 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi142.front.sepia.ceph.com' 2023-12-12T09:30:12.092 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-12T09:30:12.481 DEBUG:teuthology.orchestra.run.smithi142:> true 2023-12-12T09:30:13.115 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi142.front.sepia.ceph.com' 2023-12-12T09:30:13.115 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.6.0-gcd68252d7b4d"... 2023-12-12T09:30:13.115 DEBUG:teuthology.orchestra.run.smithi142:> uname -r 2023-12-12T09:30:13.157 INFO:teuthology.orchestra.run.smithi142.stdout:6.6.0-gcd68252d7b4d 2023-12-12T09:30:13.157 DEBUG:teuthology.task.kernel:current kernel version is 6.6.0-gcd68252d7b4d vs 6.6.0-gcd68252d7b4d 2023-12-12T09:30:13.157 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-12-12T09:30:13.157 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2023-12-12T09:30:14.158 DEBUG:teuthology.parallel:result is None 2023-12-12T09:30:14.159 INFO:teuthology.run_tasks:Running task internal.base... 2023-12-12T09:30:14.170 INFO:teuthology.task.internal:Creating test directory... 2023-12-12T09:30:14.170 DEBUG:teuthology.orchestra.run.smithi073:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-12-12T09:30:14.177 DEBUG:teuthology.orchestra.run.smithi142:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-12-12T09:30:14.226 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2023-12-12T09:30:14.234 INFO:teuthology.run_tasks:Running task internal.archive... 2023-12-12T09:30:14.296 INFO:teuthology.task.internal:Creating archive directory... 2023-12-12T09:30:14.296 DEBUG:teuthology.orchestra.run.smithi073:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-12-12T09:30:14.301 DEBUG:teuthology.orchestra.run.smithi142:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-12-12T09:30:14.365 INFO:teuthology.run_tasks:Running task internal.coredump... 2023-12-12T09:30:14.385 INFO:teuthology.task.internal:Enabling coredump saving... 2023-12-12T09:30:14.385 DEBUG:teuthology.orchestra.run.smithi073:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-12-12T09:30:14.390 DEBUG:teuthology.orchestra.run.smithi142:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-12-12T09:30:14.509 INFO:teuthology.orchestra.run.smithi073.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-12-12T09:30:14.537 INFO:teuthology.orchestra.run.smithi142.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-12-12T09:30:14.560 INFO:teuthology.orchestra.run.smithi073.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-12-12T09:30:14.596 INFO:teuthology.orchestra.run.smithi142.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-12-12T09:30:14.600 INFO:teuthology.run_tasks:Running task internal.sudo... 2023-12-12T09:30:14.608 INFO:teuthology.task.internal:Configuring sudo... 2023-12-12T09:30:14.608 DEBUG:teuthology.orchestra.run.smithi073:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-12-12T09:30:14.617 DEBUG:teuthology.orchestra.run.smithi142:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-12-12T09:30:14.750 INFO:teuthology.run_tasks:Running task internal.syslog... 2023-12-12T09:30:14.759 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2023-12-12T09:30:14.759 DEBUG:teuthology.orchestra.run.smithi073:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-12-12T09:30:14.768 DEBUG:teuthology.orchestra.run.smithi142:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-12-12T09:30:14.829 DEBUG:teuthology.orchestra.run.smithi073:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-12-12T09:30:14.930 DEBUG:teuthology.orchestra.run.smithi073:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-12-12T09:30:15.077 DEBUG:teuthology.orchestra.run.smithi073:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-12-12T09:30:15.188 DEBUG:teuthology.orchestra.run.smithi073:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-12-12T09:30:15.324 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2023-12-12T09:30:15.324 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-12-12T09:30:15.446 DEBUG:teuthology.orchestra.run.smithi142:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-12-12T09:30:15.524 DEBUG:teuthology.orchestra.run.smithi142:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-12-12T09:30:15.609 DEBUG:teuthology.orchestra.run.smithi142:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-12-12T09:30:15.678 DEBUG:teuthology.orchestra.run.smithi142:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-12-12T09:30:15.753 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2023-12-12T09:30:15.753 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-12-12T09:30:15.828 DEBUG:teuthology.orchestra.run.smithi073:> sudo service rsyslog restart 2023-12-12T09:30:15.837 DEBUG:teuthology.orchestra.run.smithi142:> sudo service rsyslog restart 2023-12-12T09:30:15.970 INFO:teuthology.orchestra.run.smithi142.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-12-12T09:30:16.016 INFO:teuthology.orchestra.run.smithi073.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-12-12T09:30:16.309 INFO:teuthology.run_tasks:Running task internal.timer... 2023-12-12T09:30:16.317 INFO:teuthology.task.internal:Starting timer... 2023-12-12T09:30:16.317 INFO:teuthology.run_tasks:Running task pcp... 2023-12-12T09:30:16.364 INFO:teuthology.run_tasks:Running task selinux... 2023-12-12T09:30:16.418 DEBUG:teuthology.orchestra.run.smithi073:> sudo service auditd rotate 2023-12-12T09:30:16.530 INFO:teuthology.orchestra.run.smithi073.stdout:Rotating logs: 2023-12-12T09:30:16.534 DEBUG:teuthology.orchestra.run.smithi142:> sudo service auditd rotate 2023-12-12T09:30:16.664 INFO:teuthology.orchestra.run.smithi142.stdout:Rotating logs: 2023-12-12T09:30:16.667 DEBUG:teuthology.task.selinux:Getting current SELinux state 2023-12-12T09:30:16.668 DEBUG:teuthology.orchestra.run.smithi073:> /usr/sbin/getenforce 2023-12-12T09:30:16.735 INFO:teuthology.orchestra.run.smithi073.stdout:Permissive 2023-12-12T09:30:16.735 DEBUG:teuthology.orchestra.run.smithi142:> /usr/sbin/getenforce 2023-12-12T09:30:16.778 INFO:teuthology.orchestra.run.smithi142.stdout:Permissive 2023-12-12T09:30:16.779 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi073.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi142.front.sepia.ceph.com': 'permissive'} 2023-12-12T09:30:16.779 DEBUG:teuthology.orchestra.run.smithi073:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-12-12T09:30:16.873 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-12T09:30:16.874 DEBUG:teuthology.orchestra.run.smithi142:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-12-12T09:30:16.953 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-12T09:30:16.954 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2023-12-12T09:30:16.954 DEBUG:teuthology.orchestra.run.smithi073:> sudo /usr/sbin/setenforce permissive 2023-12-12T09:30:17.064 DEBUG:teuthology.orchestra.run.smithi142:> sudo /usr/sbin/setenforce permissive 2023-12-12T09:30:17.158 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2023-12-12T09:30:17.170 INFO:teuthology.repo_utils:/home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main was just updated or references a specific commit; assuming it is current 2023-12-12T09:30:17.170 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2023-12-12T09:30:17.188 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2023-12-12T09:30:17.189 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi073.front.sepia.ceph.com,smithi142.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2023-12-12T09:40:22.734 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi073.front.sepia.ceph.com'), Remote(name='ubuntu@smithi142.front.sepia.ceph.com')] 2023-12-12T09:40:22.735 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi073.front.sepia.ceph.com' 2023-12-12T09:40:22.736 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi073.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-12T09:40:22.876 DEBUG:teuthology.orchestra.run.smithi073:> true 2023-12-12T09:40:23.043 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi073.front.sepia.ceph.com' 2023-12-12T09:40:23.044 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi142.front.sepia.ceph.com' 2023-12-12T09:40:23.044 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-12T09:40:23.179 DEBUG:teuthology.orchestra.run.smithi142:> true 2023-12-12T09:40:23.323 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi142.front.sepia.ceph.com' 2023-12-12T09:40:23.323 INFO:teuthology.run_tasks:Running task clock... 2023-12-12T09:40:23.333 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2023-12-12T09:40:23.334 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-12-12T09:40:23.334 DEBUG:teuthology.orchestra.run.smithi073:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-12-12T09:40:23.343 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-12-12T09:40:23.344 DEBUG:teuthology.orchestra.run.smithi142:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-12-12T09:40:23.443 INFO:teuthology.orchestra.run.smithi073.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-12-12T09:40:23.451 INFO:teuthology.orchestra.run.smithi142.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-12-12T09:40:23.494 INFO:teuthology.orchestra.run.smithi073.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-12-12T09:40:23.503 INFO:teuthology.orchestra.run.smithi142.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-12-12T09:40:23.591 INFO:teuthology.orchestra.run.smithi142.stderr:sudo: ntpd: command not found 2023-12-12T09:40:23.593 INFO:teuthology.orchestra.run.smithi073.stderr:sudo: ntpd: command not found 2023-12-12T09:40:23.633 INFO:teuthology.orchestra.run.smithi142.stdout:506 Cannot talk to daemon 2023-12-12T09:40:23.635 INFO:teuthology.orchestra.run.smithi073.stdout:506 Cannot talk to daemon 2023-12-12T09:40:23.685 INFO:teuthology.orchestra.run.smithi142.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-12-12T09:40:23.687 INFO:teuthology.orchestra.run.smithi073.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-12-12T09:40:23.737 INFO:teuthology.orchestra.run.smithi142.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-12-12T09:40:23.737 INFO:teuthology.orchestra.run.smithi073.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-12-12T09:40:23.865 INFO:teuthology.orchestra.run.smithi073.stderr:bash: line 1: ntpq: command not found 2023-12-12T09:40:23.866 INFO:teuthology.orchestra.run.smithi142.stderr:bash: line 1: ntpq: command not found 2023-12-12T09:40:23.875 INFO:teuthology.orchestra.run.smithi073.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-12-12T09:40:23.875 INFO:teuthology.orchestra.run.smithi073.stdout:=============================================================================== 2023-12-12T09:40:23.875 INFO:teuthology.orchestra.run.smithi073.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-12T09:40:23.875 INFO:teuthology.orchestra.run.smithi073.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-12T09:40:23.875 INFO:teuthology.orchestra.run.smithi073.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-12T09:40:23.875 INFO:teuthology.orchestra.run.smithi073.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-12T09:40:23.876 INFO:teuthology.orchestra.run.smithi142.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-12-12T09:40:23.876 INFO:teuthology.orchestra.run.smithi142.stdout:=============================================================================== 2023-12-12T09:40:23.876 INFO:teuthology.orchestra.run.smithi142.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-12T09:40:23.876 INFO:teuthology.orchestra.run.smithi142.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-12T09:40:23.876 INFO:teuthology.orchestra.run.smithi142.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-12T09:40:23.876 INFO:teuthology.orchestra.run.smithi142.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-12T09:40:23.877 INFO:teuthology.run_tasks:Running task install... 2023-12-12T09:40:23.886 DEBUG:teuthology.task.install:project ceph 2023-12-12T09:40:23.886 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'f1fbf3c583d03e19f5e58eb618e78d8e10d075f9'}} 2023-12-12T09:40:23.887 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'f1fbf3c583d03e19f5e58eb618e78d8e10d075f9'} 2023-12-12T09:40:23.887 INFO:teuthology.task.install:Using flavor: default 2023-12-12T09:40:23.893 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2023-12-12T09:40:23.893 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']} 2023-12-12T09:40:23.893 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'f1fbf3c583d03e19f5e58eb618e78d8e10d075f9', 'tag': None, 'wait_for_package': False} 2023-12-12T09:40:23.894 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=f1fbf3c583d03e19f5e58eb618e78d8e10d075f9 2023-12-12T09:40:23.896 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'f1fbf3c583d03e19f5e58eb618e78d8e10d075f9', 'tag': None, 'wait_for_package': False} 2023-12-12T09:40:23.896 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=f1fbf3c583d03e19f5e58eb618e78d8e10d075f9 2023-12-12T09:40:24.039 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/wip-mchangir-testing-20231205.064351/f1fbf3c583d03e19f5e58eb618e78d8e10d075f9/centos/9/flavors/default/ 2023-12-12T09:40:24.039 INFO:teuthology.task.install.rpm:Package version is 19.0.0-96.gf1fbf3c5 2023-12-12T09:40:24.108 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/wip-mchangir-testing-20231205.064351/f1fbf3c583d03e19f5e58eb618e78d8e10d075f9/centos/9/flavors/default/ 2023-12-12T09:40:24.108 INFO:teuthology.task.install.rpm:Package version is 19.0.0-96.gf1fbf3c5 2023-12-12T09:40:24.205 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/wip-mchangir-testing-20231205.064351/f1fbf3c583d03e19f5e58eb618e78d8e10d075f9/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-mchangir-testing-20231205.064351/f1fbf3c583d03e19f5e58eb618e78d8e10d075f9/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-mchangir-testing-20231205.064351/f1fbf3c583d03e19f5e58eb618e78d8e10d075f9/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-12-12T09:40:24.205 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2023-12-12T09:40:24.205 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-12-12T09:40:24.272 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/wip-mchangir-testing-20231205.064351/f1fbf3c583d03e19f5e58eb618e78d8e10d075f9/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-mchangir-testing-20231205.064351/f1fbf3c583d03e19f5e58eb618e78d8e10d075f9/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-mchangir-testing-20231205.064351/f1fbf3c583d03e19f5e58eb618e78d8e10d075f9/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-12-12T09:40:24.273 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2023-12-12T09:40:24.273 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-12-12T09:40:24.307 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2023-12-12T09:40:24.307 DEBUG:teuthology.orchestra.run.smithi073:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/f1fbf3c583d03e19f5e58eb618e78d8e10d075f9/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-12-12T09:40:24.367 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2023-12-12T09:40:24.368 DEBUG:teuthology.orchestra.run.smithi142:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/f1fbf3c583d03e19f5e58eb618e78d8e10d075f9/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-12-12T09:40:24.444 DEBUG:teuthology.orchestra.run.smithi073:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-12-12T09:40:24.502 DEBUG:teuthology.orchestra.run.smithi142:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-12-12T09:40:24.576 DEBUG:teuthology.orchestra.run.smithi073:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-12-12T09:40:24.630 DEBUG:teuthology.orchestra.run.smithi142:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-12-12T09:40:24.664 INFO:teuthology.orchestra.run.smithi073.stdout:check_obsoletes = 1 2023-12-12T09:40:24.668 DEBUG:teuthology.orchestra.run.smithi073:> sudo yum clean all 2023-12-12T09:40:24.716 INFO:teuthology.orchestra.run.smithi142.stdout:check_obsoletes = 1 2023-12-12T09:40:24.720 DEBUG:teuthology.orchestra.run.smithi142:> sudo yum clean all 2023-12-12T09:40:25.035 INFO:teuthology.orchestra.run.smithi073.stdout:73 files removed 2023-12-12T09:40:25.067 INFO:teuthology.orchestra.run.smithi142.stdout:73 files removed 2023-12-12T09:40:25.074 DEBUG:teuthology.orchestra.run.smithi073:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2023-12-12T09:40:25.106 DEBUG:teuthology.orchestra.run.smithi142:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2023-12-12T09:40:26.543 INFO:teuthology.orchestra.run.smithi073.stdout:ceph packages for x86_64 81 kB/s | 78 kB 00:00 2023-12-12T09:40:26.547 INFO:teuthology.orchestra.run.smithi142.stdout:ceph packages for x86_64 83 kB/s | 78 kB 00:00 2023-12-12T09:40:27.085 INFO:teuthology.orchestra.run.smithi073.stdout:ceph noarch packages 21 kB/s | 9.5 kB 00:00 2023-12-12T09:40:27.147 INFO:teuthology.orchestra.run.smithi142.stdout:ceph noarch packages 19 kB/s | 9.5 kB 00:00 2023-12-12T09:40:27.602 INFO:teuthology.orchestra.run.smithi073.stdout:ceph source packages 4.2 kB/s | 1.9 kB 00:00 2023-12-12T09:40:27.697 INFO:teuthology.orchestra.run.smithi142.stdout:ceph source packages 3.9 kB/s | 1.9 kB 00:00 2023-12-12T09:40:28.231 INFO:teuthology.orchestra.run.smithi073.stdout:CentOS-9 - AppStream 12 MB/s | 6.4 MB 00:00 2023-12-12T09:40:28.268 INFO:teuthology.orchestra.run.smithi142.stdout:CentOS-9 - AppStream 13 MB/s | 6.4 MB 00:00 2023-12-12T09:40:29.818 INFO:teuthology.orchestra.run.smithi142.stdout:CentOS-9 - BaseOS 6.4 MB/s | 2.0 MB 00:00 2023-12-12T09:40:29.865 INFO:teuthology.orchestra.run.smithi073.stdout:CentOS-9 - BaseOS 5.0 MB/s | 2.0 MB 00:00 2023-12-12T09:40:30.852 INFO:teuthology.orchestra.run.smithi073.stdout:CentOS Stream 9 - BaseOS 13 MB/s | 7.9 MB 00:00 2023-12-12T09:40:32.481 INFO:teuthology.orchestra.run.smithi142.stdout:CentOS Stream 9 - BaseOS 3.4 MB/s | 7.9 MB 00:02 2023-12-12T09:40:32.754 INFO:teuthology.orchestra.run.smithi073.stdout:CentOS Stream 9 - AppStream 26 MB/s | 18 MB 00:00 2023-12-12T09:40:36.865 INFO:teuthology.orchestra.run.smithi142.stdout:CentOS Stream 9 - AppStream 5.7 MB/s | 18 MB 00:03 2023-12-12T09:40:37.188 INFO:teuthology.orchestra.run.smithi073.stdout:CentOS Stream 9 - CRB 7.5 MB/s | 5.8 MB 00:00 2023-12-12T09:40:38.722 INFO:teuthology.orchestra.run.smithi073.stdout:CentOS Stream 9 - Extras packages 61 kB/s | 15 kB 00:00 2023-12-12T09:40:40.716 INFO:teuthology.orchestra.run.smithi073.stdout:Extra Packages for Enterprise Linux 11 MB/s | 20 MB 00:01 2023-12-12T09:40:41.599 INFO:teuthology.orchestra.run.smithi142.stdout:CentOS Stream 9 - CRB 5.8 MB/s | 5.8 MB 00:01 2023-12-12T09:40:44.408 INFO:teuthology.orchestra.run.smithi142.stdout:CentOS Stream 9 - Extras packages 9.9 kB/s | 15 kB 00:01 2023-12-12T09:40:46.149 INFO:teuthology.orchestra.run.smithi142.stdout:Extra Packages for Enterprise Linux 13 MB/s | 20 MB 00:01 2023-12-12T09:40:46.224 INFO:teuthology.orchestra.run.smithi073.stdout:lab-extras 17 kB/s | 1.7 kB 00:00 2023-12-12T09:40:48.858 INFO:teuthology.orchestra.run.smithi073.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2023-12-12T09:40:48.859 INFO:teuthology.orchestra.run.smithi073.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2023-12-12T09:40:48.878 INFO:teuthology.orchestra.run.smithi073.stdout:Package NetworkManager-1:1.44.0-2.el9.x86_64 is already installed. 2023-12-12T09:40:48.879 INFO:teuthology.orchestra.run.smithi073.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2023-12-12T09:40:48.880 INFO:teuthology.orchestra.run.smithi073.stdout:Package util-linux-2.37.4-15.el9.x86_64 is already installed. 2023-12-12T09:40:48.881 INFO:teuthology.orchestra.run.smithi073.stdout:Package libacl-devel-2.3.1-3.el9.x86_64 is already installed. 2023-12-12T09:40:48.884 INFO:teuthology.orchestra.run.smithi073.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2023-12-12T09:40:48.887 INFO:teuthology.orchestra.run.smithi073.stdout:Package xfsdump-3.1.12-3.el9.x86_64 is already installed. 2023-12-12T09:40:48.888 INFO:teuthology.orchestra.run.smithi073.stdout:Package xfsprogs-5.19.0-4.el9.x86_64 is already installed. 2023-12-12T09:40:48.967 INFO:teuthology.orchestra.run.smithi073.stdout:Dependencies resolved. 2023-12-12T09:40:48.992 INFO:teuthology.orchestra.run.smithi073.stdout:========================================================================================== 2023-12-12T09:40:48.992 INFO:teuthology.orchestra.run.smithi073.stdout: Package Arch Version Repository Size 2023-12-12T09:40:48.992 INFO:teuthology.orchestra.run.smithi073.stdout:========================================================================================== 2023-12-12T09:40:48.992 INFO:teuthology.orchestra.run.smithi073.stdout:Installing: 2023-12-12T09:40:48.993 INFO:teuthology.orchestra.run.smithi073.stdout: bison x86_64 3.7.4-5.el9 CentOS-AppStream 920 k 2023-12-12T09:40:48.993 INFO:teuthology.orchestra.run.smithi073.stdout: ceph x86_64 2:19.0.0-96.gf1fbf3c5.el9 ceph 6.5 k 2023-12-12T09:40:48.993 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-base x86_64 2:19.0.0-96.gf1fbf3c5.el9 ceph 5.2 M 2023-12-12T09:40:48.993 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-fuse x86_64 2:19.0.0-96.gf1fbf3c5.el9 ceph 860 k 2023-12-12T09:40:48.993 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-96.gf1fbf3c5.el9 ceph 141 k 2023-12-12T09:40:48.993 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mgr x86_64 2:19.0.0-96.gf1fbf3c5.el9 ceph 1.5 M 2023-12-12T09:40:48.993 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mgr-cephadm noarch 2:19.0.0-96.gf1fbf3c5.el9 ceph-noarch 133 k 2023-12-12T09:40:48.993 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mgr-dashboard noarch 2:19.0.0-96.gf1fbf3c5.el9 ceph-noarch 1.8 M 2023-12-12T09:40:48.993 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-96.gf1fbf3c5.el9 ceph-noarch 7.4 M 2023-12-12T09:40:48.993 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mgr-rook noarch 2:19.0.0-96.gf1fbf3c5.el9 ceph-noarch 50 k 2023-12-12T09:40:48.993 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-radosgw x86_64 2:19.0.0-96.gf1fbf3c5.el9 ceph 8.6 M 2023-12-12T09:40:48.993 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-test x86_64 2:19.0.0-96.gf1fbf3c5.el9 ceph 41 M 2023-12-12T09:40:48.993 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-volume noarch 2:19.0.0-96.gf1fbf3c5.el9 ceph-noarch 262 k 2023-12-12T09:40:48.993 INFO:teuthology.orchestra.run.smithi073.stdout: cephadm noarch 2:19.0.0-96.gf1fbf3c5.el9 ceph-noarch 803 k 2023-12-12T09:40:48.994 INFO:teuthology.orchestra.run.smithi073.stdout: cephfs-mirror x86_64 2:19.0.0-96.gf1fbf3c5.el9 ceph 217 k 2023-12-12T09:40:48.994 INFO:teuthology.orchestra.run.smithi073.stdout: cephfs-top noarch 2:19.0.0-96.gf1fbf3c5.el9 ceph-noarch 18 k 2023-12-12T09:40:48.994 INFO:teuthology.orchestra.run.smithi073.stdout: elfutils-libelf-devel x86_64 0.190-1.el9 CentOS-AppStream 21 k 2023-12-12T09:40:48.994 INFO:teuthology.orchestra.run.smithi073.stdout: flex x86_64 2.6.4-9.el9 CentOS-AppStream 307 k 2023-12-12T09:40:48.994 INFO:teuthology.orchestra.run.smithi073.stdout: libaio-devel x86_64 0.3.111-13.el9 CentOS-AppStream 10 k 2023-12-12T09:40:48.994 INFO:teuthology.orchestra.run.smithi073.stdout: libcephfs-devel x86_64 2:19.0.0-96.gf1fbf3c5.el9 ceph 31 k 2023-12-12T09:40:48.994 INFO:teuthology.orchestra.run.smithi073.stdout: libcephfs2 x86_64 2:19.0.0-96.gf1fbf3c5.el9 ceph 718 k 2023-12-12T09:40:48.994 INFO:teuthology.orchestra.run.smithi073.stdout: librados-devel x86_64 2:19.0.0-96.gf1fbf3c5.el9 ceph 126 k 2023-12-12T09:40:48.994 INFO:teuthology.orchestra.run.smithi073.stdout: libtool x86_64 2.4.6-45.el9 CentOS-AppStream 578 k 2023-12-12T09:40:48.995 INFO:teuthology.orchestra.run.smithi073.stdout: libuuid-devel x86_64 2.37.4-15.el9 CentOS-AppStream 24 k 2023-12-12T09:40:48.995 INFO:teuthology.orchestra.run.smithi073.stdout: openssl-devel x86_64 1:3.0.7-25.el9 appstream 4.1 M 2023-12-12T09:40:48.995 INFO:teuthology.orchestra.run.smithi073.stdout: postgresql x86_64 13.11-1.el9 CentOS-AppStream 1.5 M 2023-12-12T09:40:48.995 INFO:teuthology.orchestra.run.smithi073.stdout: postgresql-contrib x86_64 13.11-1.el9 CentOS-AppStream 811 k 2023-12-12T09:40:48.995 INFO:teuthology.orchestra.run.smithi073.stdout: postgresql-server x86_64 13.11-1.el9 CentOS-AppStream 5.7 M 2023-12-12T09:40:48.995 INFO:teuthology.orchestra.run.smithi073.stdout: python3-cephfs x86_64 2:19.0.0-96.gf1fbf3c5.el9 ceph 161 k 2023-12-12T09:40:48.995 INFO:teuthology.orchestra.run.smithi073.stdout: python3-rados x86_64 2:19.0.0-96.gf1fbf3c5.el9 ceph 320 k 2023-12-12T09:40:48.995 INFO:teuthology.orchestra.run.smithi073.stdout: python3-rbd x86_64 2:19.0.0-96.gf1fbf3c5.el9 ceph 297 k 2023-12-12T09:40:48.995 INFO:teuthology.orchestra.run.smithi073.stdout: python3-rgw x86_64 2:19.0.0-96.gf1fbf3c5.el9 ceph 99 k 2023-12-12T09:40:48.995 INFO:teuthology.orchestra.run.smithi073.stdout: rbd-fuse x86_64 2:19.0.0-96.gf1fbf3c5.el9 ceph 85 k 2023-12-12T09:40:48.995 INFO:teuthology.orchestra.run.smithi073.stdout: rbd-mirror x86_64 2:19.0.0-96.gf1fbf3c5.el9 ceph 3.0 M 2023-12-12T09:40:48.995 INFO:teuthology.orchestra.run.smithi073.stdout: rbd-nbd x86_64 2:19.0.0-96.gf1fbf3c5.el9 ceph 170 k 2023-12-12T09:40:48.996 INFO:teuthology.orchestra.run.smithi073.stdout: xfsprogs-devel x86_64 5.19.0-4.el9 CentOS-AppStream 85 k 2023-12-12T09:40:48.996 INFO:teuthology.orchestra.run.smithi073.stdout:Upgrading: 2023-12-12T09:40:48.996 INFO:teuthology.orchestra.run.smithi073.stdout: NetworkManager x86_64 1:1.45.7-1.el9 baseos 2.3 M 2023-12-12T09:40:48.996 INFO:teuthology.orchestra.run.smithi073.stdout: NetworkManager-libnm x86_64 1:1.45.7-1.el9 baseos 1.8 M 2023-12-12T09:40:48.996 INFO:teuthology.orchestra.run.smithi073.stdout: NetworkManager-team x86_64 1:1.45.7-1.el9 baseos 43 k 2023-12-12T09:40:48.996 INFO:teuthology.orchestra.run.smithi073.stdout: NetworkManager-tui x86_64 1:1.45.7-1.el9 baseos 246 k 2023-12-12T09:40:48.996 INFO:teuthology.orchestra.run.smithi073.stdout: acl x86_64 2.3.1-4.el9 CentOS-BaseOS 69 k 2023-12-12T09:40:48.996 INFO:teuthology.orchestra.run.smithi073.stdout: elfutils-debuginfod-client x86_64 0.190-1.el9 CentOS-BaseOS 36 k 2023-12-12T09:40:48.996 INFO:teuthology.orchestra.run.smithi073.stdout: elfutils-libelf x86_64 0.190-1.el9 CentOS-BaseOS 192 k 2023-12-12T09:40:48.996 INFO:teuthology.orchestra.run.smithi073.stdout: elfutils-libs x86_64 0.190-1.el9 CentOS-BaseOS 255 k 2023-12-12T09:40:48.996 INFO:teuthology.orchestra.run.smithi073.stdout: libacl x86_64 2.3.1-4.el9 CentOS-BaseOS 22 k 2023-12-12T09:40:48.996 INFO:teuthology.orchestra.run.smithi073.stdout: libacl-devel x86_64 2.3.1-4.el9 CentOS-AppStream 68 k 2023-12-12T09:40:48.997 INFO:teuthology.orchestra.run.smithi073.stdout: librados2 x86_64 2:19.0.0-96.gf1fbf3c5.el9 ceph 3.3 M 2023-12-12T09:40:48.997 INFO:teuthology.orchestra.run.smithi073.stdout: librbd1 x86_64 2:19.0.0-96.gf1fbf3c5.el9 ceph 3.0 M 2023-12-12T09:40:48.997 INFO:teuthology.orchestra.run.smithi073.stdout: openssl x86_64 1:3.0.7-25.el9 baseos 1.2 M 2023-12-12T09:40:48.997 INFO:teuthology.orchestra.run.smithi073.stdout: openssl-libs x86_64 1:3.0.7-25.el9 baseos 2.2 M 2023-12-12T09:40:48.997 INFO:teuthology.orchestra.run.smithi073.stdout: xfsdump x86_64 3.1.12-4.el9 CentOS-BaseOS 321 k 2023-12-12T09:40:48.997 INFO:teuthology.orchestra.run.smithi073.stdout:Installing dependencies: 2023-12-12T09:40:48.997 INFO:teuthology.orchestra.run.smithi073.stdout: automake noarch 1.16.2-8.el9 CentOS-AppStream 662 k 2023-12-12T09:40:48.997 INFO:teuthology.orchestra.run.smithi073.stdout: boost-program-options x86_64 1.75.0-8.el9 CentOS-AppStream 106 k 2023-12-12T09:40:48.997 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-common x86_64 2:19.0.0-96.gf1fbf3c5.el9 ceph 19 M 2023-12-12T09:40:48.997 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-grafana-dashboards noarch 2:19.0.0-96.gf1fbf3c5.el9 ceph-noarch 28 k 2023-12-12T09:40:48.997 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mds x86_64 2:19.0.0-96.gf1fbf3c5.el9 ceph 2.1 M 2023-12-12T09:40:48.997 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mgr-modules-core noarch 2:19.0.0-96.gf1fbf3c5.el9 ceph-noarch 243 k 2023-12-12T09:40:48.997 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mon x86_64 2:19.0.0-96.gf1fbf3c5.el9 ceph 4.4 M 2023-12-12T09:40:48.998 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-osd x86_64 2:19.0.0-96.gf1fbf3c5.el9 ceph 18 M 2023-12-12T09:40:48.998 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-prometheus-alerts noarch 2:19.0.0-96.gf1fbf3c5.el9 ceph-noarch 15 k 2023-12-12T09:40:48.998 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-selinux x86_64 2:19.0.0-96.gf1fbf3c5.el9 ceph 24 k 2023-12-12T09:40:48.998 INFO:teuthology.orchestra.run.smithi073.stdout: flexiblas x86_64 3.0.4-8.el9 CentOS-AppStream 32 k 2023-12-12T09:40:48.998 INFO:teuthology.orchestra.run.smithi073.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 CentOS-AppStream 3.0 M 2023-12-12T09:40:48.998 INFO:teuthology.orchestra.run.smithi073.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 CentOS-AppStream 17 k 2023-12-12T09:40:48.998 INFO:teuthology.orchestra.run.smithi073.stdout: fuse x86_64 2.9.9-15.el9 CentOS-BaseOS 79 k 2023-12-12T09:40:48.998 INFO:teuthology.orchestra.run.smithi073.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2023-12-12T09:40:48.998 INFO:teuthology.orchestra.run.smithi073.stdout: jq x86_64 1.6-16.el9 CentOS-AppStream 186 k 2023-12-12T09:40:48.998 INFO:teuthology.orchestra.run.smithi073.stdout: libarrow x86_64 9.0.0-10.el9 epel 4.4 M 2023-12-12T09:40:48.998 INFO:teuthology.orchestra.run.smithi073.stdout: libarrow-doc noarch 9.0.0-10.el9 epel 26 k 2023-12-12T09:40:48.998 INFO:teuthology.orchestra.run.smithi073.stdout: libcephsqlite x86_64 2:19.0.0-96.gf1fbf3c5.el9 ceph 163 k 2023-12-12T09:40:48.998 INFO:teuthology.orchestra.run.smithi073.stdout: libgfortran x86_64 11.4.1-2.3.el9 CentOS-BaseOS 803 k 2023-12-12T09:40:48.999 INFO:teuthology.orchestra.run.smithi073.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2023-12-12T09:40:48.999 INFO:teuthology.orchestra.run.smithi073.stdout: libpmemobj x86_64 1.12.1-1.el9 CentOS-AppStream 159 k 2023-12-12T09:40:48.999 INFO:teuthology.orchestra.run.smithi073.stdout: libquadmath x86_64 11.4.1-2.3.el9 CentOS-BaseOS 195 k 2023-12-12T09:40:48.999 INFO:teuthology.orchestra.run.smithi073.stdout: librabbitmq x86_64 0.11.0-7.el9 CentOS-AppStream 44 k 2023-12-12T09:40:48.999 INFO:teuthology.orchestra.run.smithi073.stdout: libradosstriper1 x86_64 2:19.0.0-96.gf1fbf3c5.el9 ceph 476 k 2023-12-12T09:40:48.999 INFO:teuthology.orchestra.run.smithi073.stdout: librdkafka x86_64 1.6.1-102.el9 CentOS-AppStream 661 k 2023-12-12T09:40:48.999 INFO:teuthology.orchestra.run.smithi073.stdout: librgw2 x86_64 2:19.0.0-96.gf1fbf3c5.el9 ceph 4.8 M 2023-12-12T09:40:48.999 INFO:teuthology.orchestra.run.smithi073.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2023-12-12T09:40:48.999 INFO:teuthology.orchestra.run.smithi073.stdout: libzstd-devel x86_64 1.5.1-2.el9 CentOS-AppStream 46 k 2023-12-12T09:40:48.999 INFO:teuthology.orchestra.run.smithi073.stdout: lttng-ust x86_64 2.12.0-6.el9 CentOS-AppStream 282 k 2023-12-12T09:40:48.999 INFO:teuthology.orchestra.run.smithi073.stdout: lua x86_64 5.4.4-4.el9 CentOS-AppStream 187 k 2023-12-12T09:40:48.999 INFO:teuthology.orchestra.run.smithi073.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2023-12-12T09:40:48.999 INFO:teuthology.orchestra.run.smithi073.stdout: oniguruma x86_64 6.9.6-1.el9.5 CentOS-AppStream 217 k 2023-12-12T09:40:49.000 INFO:teuthology.orchestra.run.smithi073.stdout: openblas x86_64 0.3.21-2.el9 CentOS-AppStream 34 k 2023-12-12T09:40:49.000 INFO:teuthology.orchestra.run.smithi073.stdout: openblas-openmp x86_64 0.3.21-2.el9 CentOS-AppStream 4.7 M 2023-12-12T09:40:49.000 INFO:teuthology.orchestra.run.smithi073.stdout: parquet-libs x86_64 9.0.0-10.el9 epel 838 k 2023-12-12T09:40:49.000 INFO:teuthology.orchestra.run.smithi073.stdout: postgresql-private-libs x86_64 13.11-1.el9 CentOS-AppStream 134 k 2023-12-12T09:40:49.000 INFO:teuthology.orchestra.run.smithi073.stdout: python3-asyncssh noarch 2.13.2-3.el9 epel 548 k 2023-12-12T09:40:49.000 INFO:teuthology.orchestra.run.smithi073.stdout: python3-babel noarch 2.9.1-2.el9 CentOS-AppStream 5.8 M 2023-12-12T09:40:49.000 INFO:teuthology.orchestra.run.smithi073.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2023-12-12T09:40:49.000 INFO:teuthology.orchestra.run.smithi073.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2023-12-12T09:40:49.000 INFO:teuthology.orchestra.run.smithi073.stdout: python3-ceph-argparse x86_64 2:19.0.0-96.gf1fbf3c5.el9 ceph 45 k 2023-12-12T09:40:49.000 INFO:teuthology.orchestra.run.smithi073.stdout: python3-ceph-common x86_64 2:19.0.0-96.gf1fbf3c5.el9 ceph 129 k 2023-12-12T09:40:49.000 INFO:teuthology.orchestra.run.smithi073.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2023-12-12T09:40:49.000 INFO:teuthology.orchestra.run.smithi073.stdout: python3-cffi x86_64 1.14.5-5.el9 CentOS-BaseOS 241 k 2023-12-12T09:40:49.000 INFO:teuthology.orchestra.run.smithi073.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2023-12-12T09:40:49.001 INFO:teuthology.orchestra.run.smithi073.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2023-12-12T09:40:49.001 INFO:teuthology.orchestra.run.smithi073.stdout: python3-cryptography x86_64 36.0.1-4.el9 CentOS-BaseOS 1.1 M 2023-12-12T09:40:49.001 INFO:teuthology.orchestra.run.smithi073.stdout: python3-devel x86_64 3.9.17-2.el9 appstream 245 k 2023-12-12T09:40:49.001 INFO:teuthology.orchestra.run.smithi073.stdout: python3-google-auth noarch 1:2.23.4-1.el9 epel 197 k 2023-12-12T09:40:49.001 INFO:teuthology.orchestra.run.smithi073.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2023-12-12T09:40:49.001 INFO:teuthology.orchestra.run.smithi073.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2023-12-12T09:40:49.001 INFO:teuthology.orchestra.run.smithi073.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2023-12-12T09:40:49.001 INFO:teuthology.orchestra.run.smithi073.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2023-12-12T09:40:49.001 INFO:teuthology.orchestra.run.smithi073.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2023-12-12T09:40:49.001 INFO:teuthology.orchestra.run.smithi073.stdout: python3-jinja2 noarch 2.11.3-4.el9 CentOS-AppStream 228 k 2023-12-12T09:40:49.001 INFO:teuthology.orchestra.run.smithi073.stdout: python3-jsonpatch noarch 1.21-16.el9 CentOS-AppStream 24 k 2023-12-12T09:40:49.001 INFO:teuthology.orchestra.run.smithi073.stdout: python3-jsonpointer noarch 2.0-4.el9 CentOS-AppStream 18 k 2023-12-12T09:40:49.001 INFO:teuthology.orchestra.run.smithi073.stdout: python3-jwt noarch 2.4.0-1.el9 epel 41 k 2023-12-12T09:40:49.002 INFO:teuthology.orchestra.run.smithi073.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2023-12-12T09:40:49.002 INFO:teuthology.orchestra.run.smithi073.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2023-12-12T09:40:49.002 INFO:teuthology.orchestra.run.smithi073.stdout: python3-mako noarch 1.1.4-6.el9 CentOS-AppStream 144 k 2023-12-12T09:40:49.002 INFO:teuthology.orchestra.run.smithi073.stdout: python3-markupsafe x86_64 1.1.1-12.el9 CentOS-AppStream 32 k 2023-12-12T09:40:49.002 INFO:teuthology.orchestra.run.smithi073.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2023-12-12T09:40:49.002 INFO:teuthology.orchestra.run.smithi073.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2023-12-12T09:40:49.002 INFO:teuthology.orchestra.run.smithi073.stdout: python3-numpy x86_64 1:1.20.1-5.el9 CentOS-AppStream 4.8 M 2023-12-12T09:40:49.002 INFO:teuthology.orchestra.run.smithi073.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 CentOS-AppStream 217 k 2023-12-12T09:40:49.003 INFO:teuthology.orchestra.run.smithi073.stdout: python3-oauthlib noarch 3.1.1-5.el9 CentOS-AppStream 174 k 2023-12-12T09:40:49.003 INFO:teuthology.orchestra.run.smithi073.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2023-12-12T09:40:49.003 INFO:teuthology.orchestra.run.smithi073.stdout: python3-ply noarch 3.11-14.el9 CentOS-BaseOS 103 k 2023-12-12T09:40:49.003 INFO:teuthology.orchestra.run.smithi073.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2023-12-12T09:40:49.003 INFO:teuthology.orchestra.run.smithi073.stdout: python3-prettytable noarch 0.7.2-27.el9 CentOS-AppStream 41 k 2023-12-12T09:40:49.003 INFO:teuthology.orchestra.run.smithi073.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2023-12-12T09:40:49.003 INFO:teuthology.orchestra.run.smithi073.stdout: python3-pyasn1 noarch 0.4.8-6.el9 CentOS-AppStream 132 k 2023-12-12T09:40:49.003 INFO:teuthology.orchestra.run.smithi073.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 CentOS-AppStream 211 k 2023-12-12T09:40:49.004 INFO:teuthology.orchestra.run.smithi073.stdout: python3-pycparser noarch 2.20-6.el9 CentOS-BaseOS 124 k 2023-12-12T09:40:49.004 INFO:teuthology.orchestra.run.smithi073.stdout: python3-pytz noarch 2021.1-5.el9 CentOS-AppStream 47 k 2023-12-12T09:40:49.004 INFO:teuthology.orchestra.run.smithi073.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2023-12-12T09:40:49.004 INFO:teuthology.orchestra.run.smithi073.stdout: python3-requests noarch 2.25.1-7.el9 CentOS-BaseOS 113 k 2023-12-12T09:40:49.004 INFO:teuthology.orchestra.run.smithi073.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 CentOS-AppStream 43 k 2023-12-12T09:40:49.004 INFO:teuthology.orchestra.run.smithi073.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2023-12-12T09:40:49.004 INFO:teuthology.orchestra.run.smithi073.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2023-12-12T09:40:49.004 INFO:teuthology.orchestra.run.smithi073.stdout: python3-scipy x86_64 1.6.2-8.el9 CentOS-AppStream 16 M 2023-12-12T09:40:49.004 INFO:teuthology.orchestra.run.smithi073.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2023-12-12T09:40:49.004 INFO:teuthology.orchestra.run.smithi073.stdout: python3-toml noarch 0.10.2-6.el9 CentOS-AppStream 39 k 2023-12-12T09:40:49.004 INFO:teuthology.orchestra.run.smithi073.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2023-12-12T09:40:49.004 INFO:teuthology.orchestra.run.smithi073.stdout: python3-urllib3 noarch 1.26.5-4.el9 CentOS-BaseOS 187 k 2023-12-12T09:40:49.004 INFO:teuthology.orchestra.run.smithi073.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2023-12-12T09:40:49.005 INFO:teuthology.orchestra.run.smithi073.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2023-12-12T09:40:49.005 INFO:teuthology.orchestra.run.smithi073.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2023-12-12T09:40:49.005 INFO:teuthology.orchestra.run.smithi073.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2023-12-12T09:40:49.005 INFO:teuthology.orchestra.run.smithi073.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2023-12-12T09:40:49.005 INFO:teuthology.orchestra.run.smithi073.stdout: socat x86_64 1.7.4.1-5.el9 CentOS-AppStream 300 k 2023-12-12T09:40:49.005 INFO:teuthology.orchestra.run.smithi073.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2023-12-12T09:40:49.005 INFO:teuthology.orchestra.run.smithi073.stdout: uuid x86_64 1.6.2-55.el9 CentOS-AppStream 56 k 2023-12-12T09:40:49.005 INFO:teuthology.orchestra.run.smithi073.stdout: xmlstarlet x86_64 1.6.1-20.el9 CentOS-AppStream 63 k 2023-12-12T09:40:49.005 INFO:teuthology.orchestra.run.smithi073.stdout: zlib-devel x86_64 1.2.11-40.el9 CentOS-AppStream 44 k 2023-12-12T09:40:49.005 INFO:teuthology.orchestra.run.smithi073.stdout:Installing weak dependencies: 2023-12-12T09:40:49.005 INFO:teuthology.orchestra.run.smithi073.stdout: python3-jwt+crypto noarch 2.4.0-1.el9 epel 9.0 k 2023-12-12T09:40:49.005 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-12T09:40:49.006 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction Summary 2023-12-12T09:40:49.006 INFO:teuthology.orchestra.run.smithi073.stdout:========================================================================================== 2023-12-12T09:40:49.006 INFO:teuthology.orchestra.run.smithi073.stdout:Install 134 Packages 2023-12-12T09:40:49.006 INFO:teuthology.orchestra.run.smithi073.stdout:Upgrade 15 Packages 2023-12-12T09:40:49.006 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-12T09:40:49.006 INFO:teuthology.orchestra.run.smithi073.stdout:Total download size: 204 M 2023-12-12T09:40:49.007 INFO:teuthology.orchestra.run.smithi073.stdout:Downloading Packages: 2023-12-12T09:40:49.484 INFO:teuthology.orchestra.run.smithi073.stdout:(1/149): ceph-19.0.0-96.gf1fbf3c5.el9.x86_64.rp 23 kB/s | 6.5 kB 00:00 2023-12-12T09:40:49.818 INFO:teuthology.orchestra.run.smithi073.stdout:(2/149): ceph-fuse-19.0.0-96.gf1fbf3c5.el9.x86_ 2.5 MB/s | 860 kB 00:00 2023-12-12T09:40:49.959 INFO:teuthology.orchestra.run.smithi073.stdout:(3/149): ceph-base-19.0.0-96.gf1fbf3c5.el9.x86_ 6.9 MB/s | 5.2 MB 00:00 2023-12-12T09:40:49.993 INFO:teuthology.orchestra.run.smithi073.stdout:(4/149): ceph-immutable-object-cache-19.0.0-96. 807 kB/s | 141 kB 00:00 2023-12-12T09:40:50.219 INFO:teuthology.orchestra.run.smithi073.stdout:(5/149): ceph-mgr-19.0.0-96.gf1fbf3c5.el9.x86_6 6.5 MB/s | 1.5 MB 00:00 2023-12-12T09:40:50.294 INFO:teuthology.orchestra.run.smithi073.stdout:(6/149): ceph-mds-19.0.0-96.gf1fbf3c5.el9.x86_6 6.3 MB/s | 2.1 MB 00:00 2023-12-12T09:40:51.061 INFO:teuthology.orchestra.run.smithi073.stdout:(7/149): ceph-mon-19.0.0-96.gf1fbf3c5.el9.x86_6 5.2 MB/s | 4.4 MB 00:00 2023-12-12T09:40:51.536 INFO:teuthology.orchestra.run.smithi073.stdout:(8/149): ceph-osd-19.0.0-96.gf1fbf3c5.el9.x86_6 14 MB/s | 18 MB 00:01 2023-12-12T09:40:51.595 INFO:teuthology.orchestra.run.smithi073.stdout:(9/149): ceph-selinux-19.0.0-96.gf1fbf3c5.el9.x 422 kB/s | 24 kB 00:00 2023-12-12T09:40:51.759 INFO:teuthology.orchestra.run.smithi142.stdout:lab-extras 43 kB/s | 1.7 kB 00:00 2023-12-12T09:40:52.412 INFO:teuthology.orchestra.run.smithi073.stdout:(10/149): ceph-radosgw-19.0.0-96.gf1fbf3c5.el9. 6.4 MB/s | 8.6 MB 00:01 2023-12-12T09:40:52.512 INFO:teuthology.orchestra.run.smithi073.stdout:(11/149): cephfs-mirror-19.0.0-96.gf1fbf3c5.el9 2.1 MB/s | 217 kB 00:00 2023-12-12T09:40:52.621 INFO:teuthology.orchestra.run.smithi073.stdout:(12/149): libcephfs-devel-19.0.0-96.gf1fbf3c5.e 290 kB/s | 31 kB 00:00 2023-12-12T09:40:52.946 INFO:teuthology.orchestra.run.smithi073.stdout:(13/149): ceph-common-19.0.0-96.gf1fbf3c5.el9.x 5.1 MB/s | 19 MB 00:03 2023-12-12T09:40:53.013 INFO:teuthology.orchestra.run.smithi073.stdout:(14/149): libcephsqlite-19.0.0-96.gf1fbf3c5.el9 2.4 MB/s | 163 kB 00:00 2023-12-12T09:40:53.080 INFO:teuthology.orchestra.run.smithi073.stdout:(15/149): librados-devel-19.0.0-96.gf1fbf3c5.el 1.9 MB/s | 126 kB 00:00 2023-12-12T09:40:53.147 INFO:teuthology.orchestra.run.smithi073.stdout:(16/149): libcephfs2-19.0.0-96.gf1fbf3c5.el9.x8 1.3 MB/s | 718 kB 00:00 2023-12-12T09:40:53.189 INFO:teuthology.orchestra.run.smithi073.stdout:(17/149): libradosstriper1-19.0.0-96.gf1fbf3c5. 4.3 MB/s | 476 kB 00:00 2023-12-12T09:40:53.522 INFO:teuthology.orchestra.run.smithi073.stdout:(18/149): python3-ceph-argparse-19.0.0-96.gf1fb 136 kB/s | 45 kB 00:00 2023-12-12T09:40:53.614 INFO:teuthology.orchestra.run.smithi073.stdout:(19/149): python3-ceph-common-19.0.0-96.gf1fbf3 1.4 MB/s | 129 kB 00:00 2023-12-12T09:40:53.706 INFO:teuthology.orchestra.run.smithi073.stdout:(20/149): python3-cephfs-19.0.0-96.gf1fbf3c5.el 1.7 MB/s | 161 kB 00:00 2023-12-12T09:40:53.873 INFO:teuthology.orchestra.run.smithi073.stdout:(21/149): librgw2-19.0.0-96.gf1fbf3c5.el9.x86_6 6.6 MB/s | 4.8 MB 00:00 2023-12-12T09:40:53.907 INFO:teuthology.orchestra.run.smithi073.stdout:(22/149): python3-rados-19.0.0-96.gf1fbf3c5.el9 1.6 MB/s | 320 kB 00:00 2023-12-12T09:40:53.949 INFO:teuthology.orchestra.run.smithi073.stdout:(23/149): python3-rbd-19.0.0-96.gf1fbf3c5.el9.x 3.9 MB/s | 297 kB 00:00 2023-12-12T09:40:53.982 INFO:teuthology.orchestra.run.smithi073.stdout:(24/149): python3-rgw-19.0.0-96.gf1fbf3c5.el9.x 1.3 MB/s | 99 kB 00:00 2023-12-12T09:40:54.330 INFO:teuthology.orchestra.run.smithi142.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2023-12-12T09:40:54.332 INFO:teuthology.orchestra.run.smithi142.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2023-12-12T09:40:54.351 INFO:teuthology.orchestra.run.smithi142.stdout:Package NetworkManager-1:1.44.0-2.el9.x86_64 is already installed. 2023-12-12T09:40:54.353 INFO:teuthology.orchestra.run.smithi142.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2023-12-12T09:40:54.354 INFO:teuthology.orchestra.run.smithi142.stdout:Package util-linux-2.37.4-15.el9.x86_64 is already installed. 2023-12-12T09:40:54.355 INFO:teuthology.orchestra.run.smithi142.stdout:Package libacl-devel-2.3.1-3.el9.x86_64 is already installed. 2023-12-12T09:40:54.358 INFO:teuthology.orchestra.run.smithi142.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2023-12-12T09:40:54.362 INFO:teuthology.orchestra.run.smithi142.stdout:Package xfsdump-3.1.12-3.el9.x86_64 is already installed. 2023-12-12T09:40:54.363 INFO:teuthology.orchestra.run.smithi142.stdout:Package xfsprogs-5.19.0-4.el9.x86_64 is already installed. 2023-12-12T09:40:54.441 INFO:teuthology.orchestra.run.smithi142.stdout:Dependencies resolved. 2023-12-12T09:40:54.441 INFO:teuthology.orchestra.run.smithi073.stdout:(25/149): ceph-test-19.0.0-96.gf1fbf3c5.el9.x86 14 MB/s | 41 MB 00:02 2023-12-12T09:40:54.459 INFO:teuthology.orchestra.run.smithi142.stdout:========================================================================================== 2023-12-12T09:40:54.459 INFO:teuthology.orchestra.run.smithi142.stdout: Package Arch Version Repository Size 2023-12-12T09:40:54.459 INFO:teuthology.orchestra.run.smithi142.stdout:========================================================================================== 2023-12-12T09:40:54.459 INFO:teuthology.orchestra.run.smithi142.stdout:Installing: 2023-12-12T09:40:54.459 INFO:teuthology.orchestra.run.smithi142.stdout: bison x86_64 3.7.4-5.el9 CentOS-AppStream 920 k 2023-12-12T09:40:54.459 INFO:teuthology.orchestra.run.smithi142.stdout: ceph x86_64 2:19.0.0-96.gf1fbf3c5.el9 ceph 6.5 k 2023-12-12T09:40:54.460 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-base x86_64 2:19.0.0-96.gf1fbf3c5.el9 ceph 5.2 M 2023-12-12T09:40:54.460 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-fuse x86_64 2:19.0.0-96.gf1fbf3c5.el9 ceph 860 k 2023-12-12T09:40:54.460 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-96.gf1fbf3c5.el9 ceph 141 k 2023-12-12T09:40:54.460 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mgr x86_64 2:19.0.0-96.gf1fbf3c5.el9 ceph 1.5 M 2023-12-12T09:40:54.460 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mgr-cephadm noarch 2:19.0.0-96.gf1fbf3c5.el9 ceph-noarch 133 k 2023-12-12T09:40:54.460 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mgr-dashboard noarch 2:19.0.0-96.gf1fbf3c5.el9 ceph-noarch 1.8 M 2023-12-12T09:40:54.460 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-96.gf1fbf3c5.el9 ceph-noarch 7.4 M 2023-12-12T09:40:54.460 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mgr-rook noarch 2:19.0.0-96.gf1fbf3c5.el9 ceph-noarch 50 k 2023-12-12T09:40:54.460 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-radosgw x86_64 2:19.0.0-96.gf1fbf3c5.el9 ceph 8.6 M 2023-12-12T09:40:54.460 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-test x86_64 2:19.0.0-96.gf1fbf3c5.el9 ceph 41 M 2023-12-12T09:40:54.460 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-volume noarch 2:19.0.0-96.gf1fbf3c5.el9 ceph-noarch 262 k 2023-12-12T09:40:54.460 INFO:teuthology.orchestra.run.smithi142.stdout: cephadm noarch 2:19.0.0-96.gf1fbf3c5.el9 ceph-noarch 803 k 2023-12-12T09:40:54.460 INFO:teuthology.orchestra.run.smithi142.stdout: cephfs-mirror x86_64 2:19.0.0-96.gf1fbf3c5.el9 ceph 217 k 2023-12-12T09:40:54.461 INFO:teuthology.orchestra.run.smithi142.stdout: cephfs-top noarch 2:19.0.0-96.gf1fbf3c5.el9 ceph-noarch 18 k 2023-12-12T09:40:54.461 INFO:teuthology.orchestra.run.smithi142.stdout: elfutils-libelf-devel x86_64 0.190-1.el9 CentOS-AppStream 21 k 2023-12-12T09:40:54.461 INFO:teuthology.orchestra.run.smithi142.stdout: flex x86_64 2.6.4-9.el9 CentOS-AppStream 307 k 2023-12-12T09:40:54.461 INFO:teuthology.orchestra.run.smithi142.stdout: libaio-devel x86_64 0.3.111-13.el9 CentOS-AppStream 10 k 2023-12-12T09:40:54.461 INFO:teuthology.orchestra.run.smithi142.stdout: libcephfs-devel x86_64 2:19.0.0-96.gf1fbf3c5.el9 ceph 31 k 2023-12-12T09:40:54.461 INFO:teuthology.orchestra.run.smithi142.stdout: libcephfs2 x86_64 2:19.0.0-96.gf1fbf3c5.el9 ceph 718 k 2023-12-12T09:40:54.461 INFO:teuthology.orchestra.run.smithi142.stdout: librados-devel x86_64 2:19.0.0-96.gf1fbf3c5.el9 ceph 126 k 2023-12-12T09:40:54.461 INFO:teuthology.orchestra.run.smithi142.stdout: libtool x86_64 2.4.6-45.el9 CentOS-AppStream 578 k 2023-12-12T09:40:54.461 INFO:teuthology.orchestra.run.smithi142.stdout: libuuid-devel x86_64 2.37.4-15.el9 CentOS-AppStream 24 k 2023-12-12T09:40:54.461 INFO:teuthology.orchestra.run.smithi142.stdout: openssl-devel x86_64 1:3.0.7-25.el9 appstream 4.1 M 2023-12-12T09:40:54.461 INFO:teuthology.orchestra.run.smithi142.stdout: postgresql x86_64 13.11-1.el9 CentOS-AppStream 1.5 M 2023-12-12T09:40:54.461 INFO:teuthology.orchestra.run.smithi142.stdout: postgresql-contrib x86_64 13.11-1.el9 CentOS-AppStream 811 k 2023-12-12T09:40:54.461 INFO:teuthology.orchestra.run.smithi142.stdout: postgresql-server x86_64 13.11-1.el9 CentOS-AppStream 5.7 M 2023-12-12T09:40:54.461 INFO:teuthology.orchestra.run.smithi142.stdout: python3-cephfs x86_64 2:19.0.0-96.gf1fbf3c5.el9 ceph 161 k 2023-12-12T09:40:54.462 INFO:teuthology.orchestra.run.smithi142.stdout: python3-rados x86_64 2:19.0.0-96.gf1fbf3c5.el9 ceph 320 k 2023-12-12T09:40:54.462 INFO:teuthology.orchestra.run.smithi142.stdout: python3-rbd x86_64 2:19.0.0-96.gf1fbf3c5.el9 ceph 297 k 2023-12-12T09:40:54.462 INFO:teuthology.orchestra.run.smithi142.stdout: python3-rgw x86_64 2:19.0.0-96.gf1fbf3c5.el9 ceph 99 k 2023-12-12T09:40:54.462 INFO:teuthology.orchestra.run.smithi142.stdout: rbd-fuse x86_64 2:19.0.0-96.gf1fbf3c5.el9 ceph 85 k 2023-12-12T09:40:54.462 INFO:teuthology.orchestra.run.smithi142.stdout: rbd-mirror x86_64 2:19.0.0-96.gf1fbf3c5.el9 ceph 3.0 M 2023-12-12T09:40:54.462 INFO:teuthology.orchestra.run.smithi142.stdout: rbd-nbd x86_64 2:19.0.0-96.gf1fbf3c5.el9 ceph 170 k 2023-12-12T09:40:54.462 INFO:teuthology.orchestra.run.smithi142.stdout: xfsprogs-devel x86_64 5.19.0-4.el9 CentOS-AppStream 85 k 2023-12-12T09:40:54.462 INFO:teuthology.orchestra.run.smithi142.stdout:Upgrading: 2023-12-12T09:40:54.462 INFO:teuthology.orchestra.run.smithi142.stdout: NetworkManager x86_64 1:1.45.7-1.el9 baseos 2.3 M 2023-12-12T09:40:54.462 INFO:teuthology.orchestra.run.smithi142.stdout: NetworkManager-libnm x86_64 1:1.45.7-1.el9 baseos 1.8 M 2023-12-12T09:40:54.462 INFO:teuthology.orchestra.run.smithi142.stdout: NetworkManager-team x86_64 1:1.45.7-1.el9 baseos 43 k 2023-12-12T09:40:54.462 INFO:teuthology.orchestra.run.smithi142.stdout: NetworkManager-tui x86_64 1:1.45.7-1.el9 baseos 246 k 2023-12-12T09:40:54.462 INFO:teuthology.orchestra.run.smithi142.stdout: acl x86_64 2.3.1-4.el9 CentOS-BaseOS 69 k 2023-12-12T09:40:54.463 INFO:teuthology.orchestra.run.smithi142.stdout: elfutils-debuginfod-client x86_64 0.190-1.el9 CentOS-BaseOS 36 k 2023-12-12T09:40:54.463 INFO:teuthology.orchestra.run.smithi142.stdout: elfutils-libelf x86_64 0.190-1.el9 CentOS-BaseOS 192 k 2023-12-12T09:40:54.463 INFO:teuthology.orchestra.run.smithi142.stdout: elfutils-libs x86_64 0.190-1.el9 CentOS-BaseOS 255 k 2023-12-12T09:40:54.463 INFO:teuthology.orchestra.run.smithi142.stdout: libacl x86_64 2.3.1-4.el9 CentOS-BaseOS 22 k 2023-12-12T09:40:54.463 INFO:teuthology.orchestra.run.smithi142.stdout: libacl-devel x86_64 2.3.1-4.el9 CentOS-AppStream 68 k 2023-12-12T09:40:54.463 INFO:teuthology.orchestra.run.smithi142.stdout: librados2 x86_64 2:19.0.0-96.gf1fbf3c5.el9 ceph 3.3 M 2023-12-12T09:40:54.463 INFO:teuthology.orchestra.run.smithi142.stdout: librbd1 x86_64 2:19.0.0-96.gf1fbf3c5.el9 ceph 3.0 M 2023-12-12T09:40:54.464 INFO:teuthology.orchestra.run.smithi142.stdout: openssl x86_64 1:3.0.7-25.el9 baseos 1.2 M 2023-12-12T09:40:54.464 INFO:teuthology.orchestra.run.smithi142.stdout: openssl-libs x86_64 1:3.0.7-25.el9 baseos 2.2 M 2023-12-12T09:40:54.464 INFO:teuthology.orchestra.run.smithi142.stdout: xfsdump x86_64 3.1.12-4.el9 CentOS-BaseOS 321 k 2023-12-12T09:40:54.464 INFO:teuthology.orchestra.run.smithi142.stdout:Installing dependencies: 2023-12-12T09:40:54.464 INFO:teuthology.orchestra.run.smithi142.stdout: automake noarch 1.16.2-8.el9 CentOS-AppStream 662 k 2023-12-12T09:40:54.464 INFO:teuthology.orchestra.run.smithi142.stdout: boost-program-options x86_64 1.75.0-8.el9 CentOS-AppStream 106 k 2023-12-12T09:40:54.464 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-common x86_64 2:19.0.0-96.gf1fbf3c5.el9 ceph 19 M 2023-12-12T09:40:54.464 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-grafana-dashboards noarch 2:19.0.0-96.gf1fbf3c5.el9 ceph-noarch 28 k 2023-12-12T09:40:54.464 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mds x86_64 2:19.0.0-96.gf1fbf3c5.el9 ceph 2.1 M 2023-12-12T09:40:54.464 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mgr-modules-core noarch 2:19.0.0-96.gf1fbf3c5.el9 ceph-noarch 243 k 2023-12-12T09:40:54.464 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mon x86_64 2:19.0.0-96.gf1fbf3c5.el9 ceph 4.4 M 2023-12-12T09:40:54.464 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-osd x86_64 2:19.0.0-96.gf1fbf3c5.el9 ceph 18 M 2023-12-12T09:40:54.464 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-prometheus-alerts noarch 2:19.0.0-96.gf1fbf3c5.el9 ceph-noarch 15 k 2023-12-12T09:40:54.464 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-selinux x86_64 2:19.0.0-96.gf1fbf3c5.el9 ceph 24 k 2023-12-12T09:40:54.465 INFO:teuthology.orchestra.run.smithi142.stdout: flexiblas x86_64 3.0.4-8.el9 CentOS-AppStream 32 k 2023-12-12T09:40:54.465 INFO:teuthology.orchestra.run.smithi142.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 CentOS-AppStream 3.0 M 2023-12-12T09:40:54.465 INFO:teuthology.orchestra.run.smithi142.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 CentOS-AppStream 17 k 2023-12-12T09:40:54.465 INFO:teuthology.orchestra.run.smithi142.stdout: fuse x86_64 2.9.9-15.el9 CentOS-BaseOS 79 k 2023-12-12T09:40:54.465 INFO:teuthology.orchestra.run.smithi142.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2023-12-12T09:40:54.465 INFO:teuthology.orchestra.run.smithi142.stdout: jq x86_64 1.6-16.el9 CentOS-AppStream 186 k 2023-12-12T09:40:54.465 INFO:teuthology.orchestra.run.smithi142.stdout: libarrow x86_64 9.0.0-10.el9 epel 4.4 M 2023-12-12T09:40:54.465 INFO:teuthology.orchestra.run.smithi142.stdout: libarrow-doc noarch 9.0.0-10.el9 epel 26 k 2023-12-12T09:40:54.465 INFO:teuthology.orchestra.run.smithi142.stdout: libcephsqlite x86_64 2:19.0.0-96.gf1fbf3c5.el9 ceph 163 k 2023-12-12T09:40:54.465 INFO:teuthology.orchestra.run.smithi142.stdout: libgfortran x86_64 11.4.1-2.3.el9 CentOS-BaseOS 803 k 2023-12-12T09:40:54.465 INFO:teuthology.orchestra.run.smithi142.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2023-12-12T09:40:54.465 INFO:teuthology.orchestra.run.smithi142.stdout: libpmemobj x86_64 1.12.1-1.el9 CentOS-AppStream 159 k 2023-12-12T09:40:54.465 INFO:teuthology.orchestra.run.smithi142.stdout: libquadmath x86_64 11.4.1-2.3.el9 CentOS-BaseOS 195 k 2023-12-12T09:40:54.465 INFO:teuthology.orchestra.run.smithi142.stdout: librabbitmq x86_64 0.11.0-7.el9 CentOS-AppStream 44 k 2023-12-12T09:40:54.466 INFO:teuthology.orchestra.run.smithi142.stdout: libradosstriper1 x86_64 2:19.0.0-96.gf1fbf3c5.el9 ceph 476 k 2023-12-12T09:40:54.466 INFO:teuthology.orchestra.run.smithi142.stdout: librdkafka x86_64 1.6.1-102.el9 CentOS-AppStream 661 k 2023-12-12T09:40:54.466 INFO:teuthology.orchestra.run.smithi142.stdout: librgw2 x86_64 2:19.0.0-96.gf1fbf3c5.el9 ceph 4.8 M 2023-12-12T09:40:54.466 INFO:teuthology.orchestra.run.smithi142.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2023-12-12T09:40:54.466 INFO:teuthology.orchestra.run.smithi142.stdout: libzstd-devel x86_64 1.5.1-2.el9 CentOS-AppStream 46 k 2023-12-12T09:40:54.466 INFO:teuthology.orchestra.run.smithi142.stdout: lttng-ust x86_64 2.12.0-6.el9 CentOS-AppStream 282 k 2023-12-12T09:40:54.466 INFO:teuthology.orchestra.run.smithi142.stdout: lua x86_64 5.4.4-4.el9 CentOS-AppStream 187 k 2023-12-12T09:40:54.466 INFO:teuthology.orchestra.run.smithi142.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2023-12-12T09:40:54.466 INFO:teuthology.orchestra.run.smithi142.stdout: oniguruma x86_64 6.9.6-1.el9.5 CentOS-AppStream 217 k 2023-12-12T09:40:54.466 INFO:teuthology.orchestra.run.smithi142.stdout: openblas x86_64 0.3.21-2.el9 CentOS-AppStream 34 k 2023-12-12T09:40:54.466 INFO:teuthology.orchestra.run.smithi142.stdout: openblas-openmp x86_64 0.3.21-2.el9 CentOS-AppStream 4.7 M 2023-12-12T09:40:54.466 INFO:teuthology.orchestra.run.smithi142.stdout: parquet-libs x86_64 9.0.0-10.el9 epel 838 k 2023-12-12T09:40:54.466 INFO:teuthology.orchestra.run.smithi142.stdout: postgresql-private-libs x86_64 13.11-1.el9 CentOS-AppStream 134 k 2023-12-12T09:40:54.466 INFO:teuthology.orchestra.run.smithi142.stdout: python3-asyncssh noarch 2.13.2-3.el9 epel 548 k 2023-12-12T09:40:54.467 INFO:teuthology.orchestra.run.smithi142.stdout: python3-babel noarch 2.9.1-2.el9 CentOS-AppStream 5.8 M 2023-12-12T09:40:54.467 INFO:teuthology.orchestra.run.smithi142.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2023-12-12T09:40:54.467 INFO:teuthology.orchestra.run.smithi142.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2023-12-12T09:40:54.467 INFO:teuthology.orchestra.run.smithi142.stdout: python3-ceph-argparse x86_64 2:19.0.0-96.gf1fbf3c5.el9 ceph 45 k 2023-12-12T09:40:54.467 INFO:teuthology.orchestra.run.smithi142.stdout: python3-ceph-common x86_64 2:19.0.0-96.gf1fbf3c5.el9 ceph 129 k 2023-12-12T09:40:54.467 INFO:teuthology.orchestra.run.smithi142.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2023-12-12T09:40:54.467 INFO:teuthology.orchestra.run.smithi142.stdout: python3-cffi x86_64 1.14.5-5.el9 CentOS-BaseOS 241 k 2023-12-12T09:40:54.467 INFO:teuthology.orchestra.run.smithi142.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2023-12-12T09:40:54.467 INFO:teuthology.orchestra.run.smithi142.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2023-12-12T09:40:54.467 INFO:teuthology.orchestra.run.smithi142.stdout: python3-cryptography x86_64 36.0.1-4.el9 CentOS-BaseOS 1.1 M 2023-12-12T09:40:54.467 INFO:teuthology.orchestra.run.smithi142.stdout: python3-devel x86_64 3.9.17-2.el9 appstream 245 k 2023-12-12T09:40:54.467 INFO:teuthology.orchestra.run.smithi142.stdout: python3-google-auth noarch 1:2.23.4-1.el9 epel 197 k 2023-12-12T09:40:54.467 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2023-12-12T09:40:54.467 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2023-12-12T09:40:54.468 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2023-12-12T09:40:54.468 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2023-12-12T09:40:54.468 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2023-12-12T09:40:54.468 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jinja2 noarch 2.11.3-4.el9 CentOS-AppStream 228 k 2023-12-12T09:40:54.468 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jsonpatch noarch 1.21-16.el9 CentOS-AppStream 24 k 2023-12-12T09:40:54.468 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jsonpointer noarch 2.0-4.el9 CentOS-AppStream 18 k 2023-12-12T09:40:54.468 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jwt noarch 2.4.0-1.el9 epel 41 k 2023-12-12T09:40:54.468 INFO:teuthology.orchestra.run.smithi142.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2023-12-12T09:40:54.468 INFO:teuthology.orchestra.run.smithi142.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2023-12-12T09:40:54.468 INFO:teuthology.orchestra.run.smithi142.stdout: python3-mako noarch 1.1.4-6.el9 CentOS-AppStream 144 k 2023-12-12T09:40:54.468 INFO:teuthology.orchestra.run.smithi142.stdout: python3-markupsafe x86_64 1.1.1-12.el9 CentOS-AppStream 32 k 2023-12-12T09:40:54.468 INFO:teuthology.orchestra.run.smithi142.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2023-12-12T09:40:54.468 INFO:teuthology.orchestra.run.smithi142.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2023-12-12T09:40:54.468 INFO:teuthology.orchestra.run.smithi142.stdout: python3-numpy x86_64 1:1.20.1-5.el9 CentOS-AppStream 4.8 M 2023-12-12T09:40:54.469 INFO:teuthology.orchestra.run.smithi142.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 CentOS-AppStream 217 k 2023-12-12T09:40:54.469 INFO:teuthology.orchestra.run.smithi142.stdout: python3-oauthlib noarch 3.1.1-5.el9 CentOS-AppStream 174 k 2023-12-12T09:40:54.469 INFO:teuthology.orchestra.run.smithi142.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2023-12-12T09:40:54.469 INFO:teuthology.orchestra.run.smithi142.stdout: python3-ply noarch 3.11-14.el9 CentOS-BaseOS 103 k 2023-12-12T09:40:54.469 INFO:teuthology.orchestra.run.smithi142.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2023-12-12T09:40:54.469 INFO:teuthology.orchestra.run.smithi142.stdout: python3-prettytable noarch 0.7.2-27.el9 CentOS-AppStream 41 k 2023-12-12T09:40:54.469 INFO:teuthology.orchestra.run.smithi142.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2023-12-12T09:40:54.469 INFO:teuthology.orchestra.run.smithi142.stdout: python3-pyasn1 noarch 0.4.8-6.el9 CentOS-AppStream 132 k 2023-12-12T09:40:54.469 INFO:teuthology.orchestra.run.smithi142.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 CentOS-AppStream 211 k 2023-12-12T09:40:54.469 INFO:teuthology.orchestra.run.smithi142.stdout: python3-pycparser noarch 2.20-6.el9 CentOS-BaseOS 124 k 2023-12-12T09:40:54.469 INFO:teuthology.orchestra.run.smithi142.stdout: python3-pytz noarch 2021.1-5.el9 CentOS-AppStream 47 k 2023-12-12T09:40:54.470 INFO:teuthology.orchestra.run.smithi142.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2023-12-12T09:40:54.470 INFO:teuthology.orchestra.run.smithi142.stdout: python3-requests noarch 2.25.1-7.el9 CentOS-BaseOS 113 k 2023-12-12T09:40:54.470 INFO:teuthology.orchestra.run.smithi142.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 CentOS-AppStream 43 k 2023-12-12T09:40:54.470 INFO:teuthology.orchestra.run.smithi142.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2023-12-12T09:40:54.470 INFO:teuthology.orchestra.run.smithi142.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2023-12-12T09:40:54.470 INFO:teuthology.orchestra.run.smithi142.stdout: python3-scipy x86_64 1.6.2-8.el9 CentOS-AppStream 16 M 2023-12-12T09:40:54.470 INFO:teuthology.orchestra.run.smithi142.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2023-12-12T09:40:54.470 INFO:teuthology.orchestra.run.smithi142.stdout: python3-toml noarch 0.10.2-6.el9 CentOS-AppStream 39 k 2023-12-12T09:40:54.470 INFO:teuthology.orchestra.run.smithi142.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2023-12-12T09:40:54.470 INFO:teuthology.orchestra.run.smithi142.stdout: python3-urllib3 noarch 1.26.5-4.el9 CentOS-BaseOS 187 k 2023-12-12T09:40:54.470 INFO:teuthology.orchestra.run.smithi142.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2023-12-12T09:40:54.471 INFO:teuthology.orchestra.run.smithi142.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2023-12-12T09:40:54.471 INFO:teuthology.orchestra.run.smithi142.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2023-12-12T09:40:54.471 INFO:teuthology.orchestra.run.smithi142.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2023-12-12T09:40:54.471 INFO:teuthology.orchestra.run.smithi142.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2023-12-12T09:40:54.471 INFO:teuthology.orchestra.run.smithi142.stdout: socat x86_64 1.7.4.1-5.el9 CentOS-AppStream 300 k 2023-12-12T09:40:54.471 INFO:teuthology.orchestra.run.smithi142.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2023-12-12T09:40:54.471 INFO:teuthology.orchestra.run.smithi142.stdout: uuid x86_64 1.6.2-55.el9 CentOS-AppStream 56 k 2023-12-12T09:40:54.471 INFO:teuthology.orchestra.run.smithi142.stdout: xmlstarlet x86_64 1.6.1-20.el9 CentOS-AppStream 63 k 2023-12-12T09:40:54.471 INFO:teuthology.orchestra.run.smithi142.stdout: zlib-devel x86_64 1.2.11-40.el9 CentOS-AppStream 44 k 2023-12-12T09:40:54.471 INFO:teuthology.orchestra.run.smithi142.stdout:Installing weak dependencies: 2023-12-12T09:40:54.471 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jwt+crypto noarch 2.4.0-1.el9 epel 9.0 k 2023-12-12T09:40:54.471 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-12-12T09:40:54.471 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction Summary 2023-12-12T09:40:54.471 INFO:teuthology.orchestra.run.smithi142.stdout:========================================================================================== 2023-12-12T09:40:54.471 INFO:teuthology.orchestra.run.smithi142.stdout:Install 134 Packages 2023-12-12T09:40:54.472 INFO:teuthology.orchestra.run.smithi142.stdout:Upgrade 15 Packages 2023-12-12T09:40:54.472 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-12-12T09:40:54.472 INFO:teuthology.orchestra.run.smithi073.stdout:(26/149): rbd-fuse-19.0.0-96.gf1fbf3c5.el9.x86_ 165 kB/s | 85 kB 00:00 2023-12-12T09:40:54.473 INFO:teuthology.orchestra.run.smithi142.stdout:Total download size: 204 M 2023-12-12T09:40:54.473 INFO:teuthology.orchestra.run.smithi142.stdout:Downloading Packages: 2023-12-12T09:40:54.525 INFO:teuthology.orchestra.run.smithi073.stdout:(27/149): ceph-grafana-dashboards-19.0.0-96.gf1 493 kB/s | 28 kB 00:00 2023-12-12T09:40:54.633 INFO:teuthology.orchestra.run.smithi073.stdout:(28/149): rbd-mirror-19.0.0-96.gf1fbf3c5.el9.x8 4.6 MB/s | 3.0 MB 00:00 2023-12-12T09:40:54.659 INFO:teuthology.orchestra.run.smithi073.stdout:(29/149): ceph-mgr-cephadm-19.0.0-96.gf1fbf3c5. 1.0 MB/s | 133 kB 00:00 2023-12-12T09:40:54.776 INFO:teuthology.orchestra.run.smithi073.stdout:(30/149): rbd-nbd-19.0.0-96.gf1fbf3c5.el9.x86_6 509 kB/s | 170 kB 00:00 2023-12-12T09:40:55.126 INFO:teuthology.orchestra.run.smithi073.stdout:(31/149): ceph-mgr-modules-core-19.0.0-96.gf1fb 696 kB/s | 243 kB 00:00 2023-12-12T09:40:55.185 INFO:teuthology.orchestra.run.smithi073.stdout:(32/149): ceph-mgr-dashboard-19.0.0-96.gf1fbf3c 3.4 MB/s | 1.8 MB 00:00 2023-12-12T09:40:55.210 INFO:teuthology.orchestra.run.smithi073.stdout:(33/149): ceph-mgr-rook-19.0.0-96.gf1fbf3c5.el9 607 kB/s | 50 kB 00:00 2023-12-12T09:40:55.344 INFO:teuthology.orchestra.run.smithi073.stdout:(34/149): ceph-mgr-diskprediction-local-19.0.0- 11 MB/s | 7.4 MB 00:00 2023-12-12T09:40:55.369 INFO:teuthology.orchestra.run.smithi073.stdout:(35/149): ceph-prometheus-alerts-19.0.0-96.gf1f 82 kB/s | 15 kB 00:00 2023-12-12T09:40:55.403 INFO:teuthology.orchestra.run.smithi073.stdout:(36/149): ceph-volume-19.0.0-96.gf1fbf3c5.el9.n 1.3 MB/s | 262 kB 00:00 2023-12-12T09:40:55.428 INFO:teuthology.orchestra.run.smithi073.stdout:(37/149): cephfs-top-19.0.0-96.gf1fbf3c5.el9.no 314 kB/s | 18 kB 00:00 2023-12-12T09:40:55.620 INFO:teuthology.orchestra.run.smithi073.stdout:(38/149): cephadm-19.0.0-96.gf1fbf3c5.el9.noarc 2.9 MB/s | 803 kB 00:00 2023-12-12T09:40:55.721 INFO:teuthology.orchestra.run.smithi073.stdout:(39/149): bison-3.7.4-5.el9.x86_64.rpm 3.1 MB/s | 920 kB 00:00 2023-12-12T09:40:55.771 INFO:teuthology.orchestra.run.smithi073.stdout:(40/149): automake-1.16.2-8.el9.noarch.rpm 1.8 MB/s | 662 kB 00:00 2023-12-12T09:40:55.794 INFO:teuthology.orchestra.run.smithi142.stdout:(1/149): ceph-base-19.0.0-96.gf1fbf3c5.el9.x86_ 6.8 MB/s | 5.2 MB 00:00 2023-12-12T09:40:55.796 INFO:teuthology.orchestra.run.smithi073.stdout:(41/149): boost-program-options-1.75.0-8.el9.x8 614 kB/s | 106 kB 00:00 2023-12-12T09:40:55.822 INFO:teuthology.orchestra.run.smithi073.stdout:(42/149): elfutils-libelf-devel-0.190-1.el9.x86 222 kB/s | 21 kB 00:00 2023-12-12T09:40:55.855 INFO:teuthology.orchestra.run.smithi073.stdout:(43/149): flex-2.6.4-9.el9.x86_64.rpm 3.6 MB/s | 307 kB 00:00 2023-12-12T09:40:55.905 INFO:teuthology.orchestra.run.smithi073.stdout:(44/149): flexiblas-3.0.4-8.el9.x86_64.rpm 395 kB/s | 32 kB 00:00 2023-12-12T09:40:55.980 INFO:teuthology.orchestra.run.smithi073.stdout:(45/149): flexiblas-openblas-openmp-3.0.4-8.el9 138 kB/s | 17 kB 00:00 2023-12-12T09:40:56.064 INFO:teuthology.orchestra.run.smithi073.stdout:(46/149): flexiblas-netlib-3.0.4-8.el9.x86_64.r 13 MB/s | 3.0 MB 00:00 2023-12-12T09:40:56.090 INFO:teuthology.orchestra.run.smithi073.stdout:(47/149): jq-1.6-16.el9.x86_64.rpm 1.0 MB/s | 186 kB 00:00 2023-12-12T09:40:56.114 INFO:teuthology.orchestra.run.smithi073.stdout:(48/149): libaio-devel-0.3.111-13.el9.x86_64.rp 81 kB/s | 10 kB 00:00 2023-12-12T09:40:56.140 INFO:teuthology.orchestra.run.smithi073.stdout:(49/149): librabbitmq-0.11.0-7.el9.x86_64.rpm 905 kB/s | 44 kB 00:00 2023-12-12T09:40:56.173 INFO:teuthology.orchestra.run.smithi073.stdout:(50/149): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.9 MB/s | 159 kB 00:00 2023-12-12T09:40:56.207 INFO:teuthology.orchestra.run.smithi073.stdout:(51/149): librdkafka-1.6.1-102.el9.x86_64.rpm 7.1 MB/s | 661 kB 00:00 2023-12-12T09:40:56.257 INFO:teuthology.orchestra.run.smithi073.stdout:(52/149): libtool-2.4.6-45.el9.x86_64.rpm 5.2 MB/s | 578 kB 00:00 2023-12-12T09:40:56.324 INFO:teuthology.orchestra.run.smithi073.stdout:(53/149): libuuid-devel-2.37.4-15.el9.x86_64.rp 220 kB/s | 24 kB 00:00 2023-12-12T09:40:56.349 INFO:teuthology.orchestra.run.smithi073.stdout:(54/149): libzstd-devel-1.5.1-2.el9.x86_64.rpm 341 kB/s | 46 kB 00:00 2023-12-12T09:40:56.383 INFO:teuthology.orchestra.run.smithi073.stdout:(55/149): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.2 MB/s | 282 kB 00:00 2023-12-12T09:40:56.386 INFO:teuthology.orchestra.run.smithi142.stdout:(2/149): ceph-fuse-19.0.0-96.gf1fbf3c5.el9.x86_ 1.4 MB/s | 860 kB 00:00 2023-12-12T09:40:56.417 INFO:teuthology.orchestra.run.smithi073.stdout:(56/149): lua-5.4.4-4.el9.x86_64.rpm 2.9 MB/s | 187 kB 00:00 2023-12-12T09:40:56.442 INFO:teuthology.orchestra.run.smithi073.stdout:(57/149): oniguruma-6.9.6-1.el9.5.x86_64.rpm 2.4 MB/s | 217 kB 00:00 2023-12-12T09:40:56.452 INFO:teuthology.orchestra.run.smithi142.stdout:(3/149): ceph-immutable-object-cache-19.0.0-96. 2.1 MB/s | 141 kB 00:00 2023-12-12T09:40:56.468 INFO:teuthology.orchestra.run.smithi073.stdout:(58/149): openblas-0.3.21-2.el9.x86_64.rpm 411 kB/s | 34 kB 00:00 2023-12-12T09:40:56.609 INFO:teuthology.orchestra.run.smithi073.stdout:(59/149): postgresql-13.11-1.el9.x86_64.rpm 9.2 MB/s | 1.5 MB 00:00 2023-12-12T09:40:56.637 INFO:teuthology.orchestra.run.smithi142.stdout:(4/149): ceph-mds-19.0.0-96.gf1fbf3c5.el9.x86_6 11 MB/s | 2.1 MB 00:00 2023-12-12T09:40:56.735 INFO:teuthology.orchestra.run.smithi073.stdout:(60/149): openblas-openmp-0.3.21-2.el9.x86_64.r 16 MB/s | 4.7 MB 00:00 2023-12-12T09:40:56.768 INFO:teuthology.orchestra.run.smithi073.stdout:(61/149): postgresql-contrib-13.11-1.el9.x86_64 2.7 MB/s | 811 kB 00:00 2023-12-12T09:40:56.778 INFO:teuthology.orchestra.run.smithi142.stdout:(5/149): ceph-mgr-19.0.0-96.gf1fbf3c5.el9.x86_6 10 MB/s | 1.5 MB 00:00 2023-12-12T09:40:56.794 INFO:teuthology.orchestra.run.smithi073.stdout:(62/149): postgresql-private-libs-13.11-1.el9.x 781 kB/s | 134 kB 00:00 2023-12-12T09:40:56.969 INFO:teuthology.orchestra.run.smithi073.stdout:(63/149): python3-babel-2.9.1-2.el9.noarch.rpm 29 MB/s | 5.8 MB 00:00 2023-12-12T09:40:57.077 INFO:teuthology.orchestra.run.smithi073.stdout:(64/149): postgresql-server-13.11-1.el9.x86_64. 19 MB/s | 5.7 MB 00:00 2023-12-12T09:40:57.104 INFO:teuthology.orchestra.run.smithi142.stdout:(6/149): ceph-mon-19.0.0-96.gf1fbf3c5.el9.x86_6 14 MB/s | 4.4 MB 00:00 2023-12-12T09:40:57.127 INFO:teuthology.orchestra.run.smithi073.stdout:(65/149): python3-jinja2-2.11.3-4.el9.noarch.rp 687 kB/s | 228 kB 00:00 2023-12-12T09:40:57.153 INFO:teuthology.orchestra.run.smithi073.stdout:(66/149): python3-jsonpatch-1.21-16.el9.noarch. 137 kB/s | 24 kB 00:00 2023-12-12T09:40:57.179 INFO:teuthology.orchestra.run.smithi073.stdout:(67/149): python3-jsonpointer-2.0-4.el9.noarch. 367 kB/s | 18 kB 00:00 2023-12-12T09:40:57.203 INFO:teuthology.orchestra.run.smithi073.stdout:(68/149): python3-mako-1.1.4-6.el9.noarch.rpm 1.9 MB/s | 144 kB 00:00 2023-12-12T09:40:57.229 INFO:teuthology.orchestra.run.smithi073.stdout:(69/149): python3-markupsafe-1.1.1-12.el9.x86_6 430 kB/s | 32 kB 00:00 2023-12-12T09:40:57.262 INFO:teuthology.orchestra.run.smithi073.stdout:(70/149): python3-numpy-f2py-1.20.1-5.el9.x86_6 3.7 MB/s | 217 kB 00:00 2023-12-12T09:40:57.379 INFO:teuthology.orchestra.run.smithi073.stdout:(71/149): python3-numpy-1.20.1-5.el9.x86_64.rpm 27 MB/s | 4.8 MB 00:00 2023-12-12T09:40:57.404 INFO:teuthology.orchestra.run.smithi073.stdout:(72/149): python3-oauthlib-3.1.1-5.el9.noarch.r 1.0 MB/s | 174 kB 00:00 2023-12-12T09:40:57.429 INFO:teuthology.orchestra.run.smithi073.stdout:(73/149): python3-prettytable-0.7.2-27.el9.noar 271 kB/s | 41 kB 00:00 2023-12-12T09:40:57.463 INFO:teuthology.orchestra.run.smithi073.stdout:(74/149): python3-pytz-2021.1-5.el9.noarch.rpm 1.5 MB/s | 47 kB 00:00 2023-12-12T09:40:57.512 INFO:teuthology.orchestra.run.smithi142.stdout:(7/149): ceph-19.0.0-96.gf1fbf3c5.el9.x86_64.rp 2.6 kB/s | 6.5 kB 00:02 2023-12-12T09:40:57.530 INFO:teuthology.orchestra.run.smithi073.stdout:(75/149): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.3 MB/s | 132 kB 00:00 2023-12-12T09:40:57.564 INFO:teuthology.orchestra.run.smithi073.stdout:(76/149): python3-pyasn1-modules-0.4.8-6.el9.no 1.6 MB/s | 211 kB 00:00 2023-12-12T09:40:57.589 INFO:teuthology.orchestra.run.smithi073.stdout:(77/149): python3-requests-oauthlib-1.3.0-12.el 349 kB/s | 43 kB 00:00 2023-12-12T09:40:57.614 INFO:teuthology.orchestra.run.smithi073.stdout:(78/149): python3-toml-0.10.2-6.el9.noarch.rpm 795 kB/s | 39 kB 00:00 2023-12-12T09:40:57.788 INFO:teuthology.orchestra.run.smithi142.stdout:(8/149): ceph-common-19.0.0-96.gf1fbf3c5.el9.x8 6.9 MB/s | 19 MB 00:02 2023-12-12T09:40:57.890 INFO:teuthology.orchestra.run.smithi073.stdout:(79/149): python3-scipy-1.6.2-8.el9.x86_64.rpm 48 MB/s | 16 MB 00:00 2023-12-12T09:40:57.948 INFO:teuthology.orchestra.run.smithi073.stdout:(80/149): socat-1.7.4.1-5.el9.x86_64.rpm 841 kB/s | 300 kB 00:00 2023-12-12T09:40:57.973 INFO:teuthology.orchestra.run.smithi073.stdout:(81/149): uuid-1.6.2-55.el9.x86_64.rpm 164 kB/s | 56 kB 00:00 2023-12-12T09:40:58.015 INFO:teuthology.orchestra.run.smithi073.stdout:(82/149): xfsprogs-devel-5.19.0-4.el9.x86_64.rp 2.1 MB/s | 85 kB 00:00 2023-12-12T09:40:58.040 INFO:teuthology.orchestra.run.smithi073.stdout:(83/149): zlib-devel-1.2.11-40.el9.x86_64.rpm 677 kB/s | 44 kB 00:00 2023-12-12T09:40:58.066 INFO:teuthology.orchestra.run.smithi073.stdout:(84/149): xmlstarlet-1.6.1-20.el9.x86_64.rpm 691 kB/s | 63 kB 00:00 2023-12-12T09:40:58.099 INFO:teuthology.orchestra.run.smithi073.stdout:(85/149): fuse-2.9.9-15.el9.x86_64.rpm 1.3 MB/s | 79 kB 00:00 2023-12-12T09:40:58.129 INFO:teuthology.orchestra.run.smithi142.stdout:(9/149): ceph-selinux-19.0.0-96.gf1fbf3c5.el9.x 71 kB/s | 24 kB 00:00 2023-12-12T09:40:58.133 INFO:teuthology.orchestra.run.smithi073.stdout:(86/149): libgfortran-11.4.1-2.3.el9.x86_64.rpm 8.7 MB/s | 803 kB 00:00 2023-12-12T09:40:58.166 INFO:teuthology.orchestra.run.smithi073.stdout:(87/149): libquadmath-11.4.1-2.3.el9.x86_64.rpm 2.1 MB/s | 195 kB 00:00 2023-12-12T09:40:58.217 INFO:teuthology.orchestra.run.smithi073.stdout:(88/149): python3-cffi-1.14.5-5.el9.x86_64.rpm 2.9 MB/s | 241 kB 00:00 2023-12-12T09:40:58.259 INFO:teuthology.orchestra.run.smithi073.stdout:(89/149): python3-cryptography-36.0.1-4.el9.x86 9.3 MB/s | 1.1 MB 00:00 2023-12-12T09:40:58.292 INFO:teuthology.orchestra.run.smithi073.stdout:(90/149): python3-ply-3.11-14.el9.noarch.rpm 826 kB/s | 103 kB 00:00 2023-12-12T09:40:58.359 INFO:teuthology.orchestra.run.smithi073.stdout:(91/149): python3-requests-2.25.1-7.el9.noarch. 1.7 MB/s | 113 kB 00:00 2023-12-12T09:40:58.393 INFO:teuthology.orchestra.run.smithi073.stdout:(92/149): python3-pycparser-2.20-6.el9.noarch.r 1.2 MB/s | 124 kB 00:00 2023-12-12T09:40:58.410 INFO:teuthology.orchestra.run.smithi073.stdout:(93/149): python3-urllib3-1.26.5-4.el9.noarch.r 1.6 MB/s | 187 kB 00:00 2023-12-12T09:40:58.438 INFO:teuthology.orchestra.run.smithi142.stdout:(10/149): ceph-osd-19.0.0-96.gf1fbf3c5.el9.x86_ 13 MB/s | 18 MB 00:01 2023-12-12T09:40:58.505 INFO:teuthology.orchestra.run.smithi142.stdout:(11/149): cephfs-mirror-19.0.0-96.gf1fbf3c5.el9 3.2 MB/s | 217 kB 00:00 2023-12-12T09:40:58.646 INFO:teuthology.orchestra.run.smithi073.stdout:(94/149): python3-devel-3.9.17-2.el9.x86_64.rpm 1.0 MB/s | 245 kB 00:00 2023-12-12T09:40:58.805 INFO:teuthology.orchestra.run.smithi142.stdout:(12/149): libcephfs-devel-19.0.0-96.gf1fbf3c5.e 104 kB/s | 31 kB 00:00 2023-12-12T09:40:58.827 INFO:teuthology.orchestra.run.smithi073.stdout:(95/149): openssl-devel-3.0.7-25.el9.x86_64.rpm 8.9 MB/s | 4.1 MB 00:00 2023-12-12T09:40:58.861 INFO:teuthology.orchestra.run.smithi073.stdout:(96/149): gperftools-libs-2.9.1-2.el9.x86_64.rp 688 kB/s | 309 kB 00:00 2023-12-12T09:40:58.947 INFO:teuthology.orchestra.run.smithi142.stdout:(13/149): libcephfs2-19.0.0-96.gf1fbf3c5.el9.x8 5.0 MB/s | 718 kB 00:00 2023-12-12T09:40:58.970 INFO:teuthology.orchestra.run.smithi073.stdout:(97/149): liboath-2.6.7-2.el9.x86_64.rpm 1.0 MB/s | 49 kB 00:00 2023-12-12T09:40:59.020 INFO:teuthology.orchestra.run.smithi073.stdout:(98/149): libunwind-1.6.2-1.el9.x86_64.rpm 1.4 MB/s | 67 kB 00:00 2023-12-12T09:40:59.030 INFO:teuthology.orchestra.run.smithi142.stdout:(14/149): libcephsqlite-19.0.0-96.gf1fbf3c5.el9 1.9 MB/s | 163 kB 00:00 2023-12-12T09:40:59.054 INFO:teuthology.orchestra.run.smithi073.stdout:(99/149): libarrow-doc-9.0.0-10.el9.noarch.rpm 117 kB/s | 26 kB 00:00 2023-12-12T09:40:59.087 INFO:teuthology.orchestra.run.smithi073.stdout:(100/149): luarocks-3.9.2-1.el9.noarch.rpm 2.2 MB/s | 151 kB 00:00 2023-12-12T09:40:59.106 INFO:teuthology.orchestra.run.smithi142.stdout:(15/149): librados-devel-19.0.0-96.gf1fbf3c5.el 1.7 MB/s | 126 kB 00:00 2023-12-12T09:40:59.196 INFO:teuthology.orchestra.run.smithi073.stdout:(101/149): python3-asyncssh-2.13.2-3.el9.noarch 5.0 MB/s | 548 kB 00:00 2023-12-12T09:40:59.235 INFO:teuthology.orchestra.run.smithi142.stdout:(16/149): libradosstriper1-19.0.0-96.gf1fbf3c5. 3.6 MB/s | 476 kB 00:00 2023-12-12T09:40:59.246 INFO:teuthology.orchestra.run.smithi073.stdout:(102/149): parquet-libs-9.0.0-10.el9.x86_64.rpm 4.3 MB/s | 838 kB 00:00 2023-12-12T09:40:59.271 INFO:teuthology.orchestra.run.smithi073.stdout:(103/149): python3-bcrypt-3.2.2-1.el9.x86_64.rp 585 kB/s | 43 kB 00:00 2023-12-12T09:40:59.313 INFO:teuthology.orchestra.run.smithi073.stdout:(104/149): python3-cachetools-4.2.4-1.el9.noarc 488 kB/s | 32 kB 00:00 2023-12-12T09:40:59.363 INFO:teuthology.orchestra.run.smithi073.stdout:(105/149): python3-certifi-2021.10.8-2.el9.noar 164 kB/s | 15 kB 00:00 2023-12-12T09:40:59.397 INFO:teuthology.orchestra.run.smithi073.stdout:(106/149): python3-cheroot-8.6.0-4.el9.noarch.r 2.0 MB/s | 172 kB 00:00 2023-12-12T09:40:59.489 INFO:teuthology.orchestra.run.smithi073.stdout:(107/149): libarrow-9.0.0-10.el9.x86_64.rpm 5.2 MB/s | 4.4 MB 00:00 2023-12-12T09:40:59.548 INFO:teuthology.orchestra.run.smithi073.stdout:(108/149): python3-google-auth-2.23.4-1.el9.noa 1.3 MB/s | 197 kB 00:00 2023-12-12T09:40:59.573 INFO:teuthology.orchestra.run.smithi073.stdout:(109/149): python3-jaraco-8.2.1-3.el9.noarch.rp 129 kB/s | 11 kB 00:00 2023-12-12T09:40:59.607 INFO:teuthology.orchestra.run.smithi073.stdout:(110/149): python3-cherrypy-18.6.1-2.el9.noarch 1.4 MB/s | 358 kB 00:00 2023-12-12T09:40:59.632 INFO:teuthology.orchestra.run.smithi073.stdout:(111/149): python3-jaraco-classes-3.2.1-5.el9.n 213 kB/s | 18 kB 00:00 2023-12-12T09:40:59.657 INFO:teuthology.orchestra.run.smithi073.stdout:(112/149): python3-jaraco-collections-3.0.0-8.e 279 kB/s | 23 kB 00:00 2023-12-12T09:40:59.682 INFO:teuthology.orchestra.run.smithi073.stdout:(113/149): python3-jaraco-functools-3.5.0-2.el9 260 kB/s | 19 kB 00:00 2023-12-12T09:40:59.716 INFO:teuthology.orchestra.run.smithi073.stdout:(114/149): python3-jwt+crypto-2.4.0-1.el9.noarc 158 kB/s | 9.0 kB 00:00 2023-12-12T09:40:59.741 INFO:teuthology.orchestra.run.smithi073.stdout:(115/149): python3-jaraco-text-3.2.0-6.el9.noar 237 kB/s | 20 kB 00:00 2023-12-12T09:40:59.766 INFO:teuthology.orchestra.run.smithi073.stdout:(116/149): python3-jwt-2.4.0-1.el9.noarch.rpm 491 kB/s | 41 kB 00:00 2023-12-12T09:40:59.798 INFO:teuthology.orchestra.run.smithi142.stdout:(17/149): librgw2-19.0.0-96.gf1fbf3c5.el9.x86_6 8.5 MB/s | 4.8 MB 00:00 2023-12-12T09:40:59.800 INFO:teuthology.orchestra.run.smithi073.stdout:(117/149): python3-logutils-0.3.5-21.el9.noarch 800 kB/s | 46 kB 00:00 2023-12-12T09:40:59.828 INFO:teuthology.orchestra.run.smithi073.stdout:(118/149): python3-more-itertools-8.12.0-2.el9. 1.3 MB/s | 79 kB 00:00 2023-12-12T09:40:59.853 INFO:teuthology.orchestra.run.smithi073.stdout:(119/149): python3-natsort-7.1.1-5.el9.noarch.r 1.1 MB/s | 58 kB 00:00 2023-12-12T09:40:59.865 INFO:teuthology.orchestra.run.smithi142.stdout:(18/149): python3-ceph-argparse-19.0.0-96.gf1fb 688 kB/s | 45 kB 00:00 2023-12-12T09:40:59.895 INFO:teuthology.orchestra.run.smithi073.stdout:(120/149): python3-kubernetes-26.1.0-2.el9.noar 5.8 MB/s | 1.0 MB 00:00 2023-12-12T09:40:59.945 INFO:teuthology.orchestra.run.smithi073.stdout:(121/149): python3-portend-3.1.0-2.el9.noarch.r 179 kB/s | 16 kB 00:00 2023-12-12T09:40:59.957 INFO:teuthology.orchestra.run.smithi142.stdout:(19/149): python3-ceph-common-19.0.0-96.gf1fbf3 1.4 MB/s | 129 kB 00:00 2023-12-12T09:40:59.971 INFO:teuthology.orchestra.run.smithi073.stdout:(122/149): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.2 MB/s | 90 kB 00:00 2023-12-12T09:41:00.004 INFO:teuthology.orchestra.run.smithi073.stdout:(123/149): python3-pecan-1.4.2-3.el9.noarch.rpm 1.5 MB/s | 272 kB 00:00 2023-12-12T09:41:00.029 INFO:teuthology.orchestra.run.smithi073.stdout:(124/149): python3-repoze-lru-0.7-16.el9.noarch 371 kB/s | 31 kB 00:00 2023-12-12T09:41:00.063 INFO:teuthology.orchestra.run.smithi073.stdout:(125/149): python3-routes-2.5.1-5.el9.noarch.rp 2.0 MB/s | 188 kB 00:00 2023-12-12T09:41:00.089 INFO:teuthology.orchestra.run.smithi073.stdout:(126/149): python3-tempora-5.0.0-2.el9.noarch.r 618 kB/s | 36 kB 00:00 2023-12-12T09:41:00.114 INFO:teuthology.orchestra.run.smithi073.stdout:(127/149): python3-rsa-4.9-2.el9.noarch.rpm 545 kB/s | 59 kB 00:00 2023-12-12T09:41:00.139 INFO:teuthology.orchestra.run.smithi073.stdout:(128/149): python3-typing-extensions-4.4.0-2.el 684 kB/s | 51 kB 00:00 2023-12-12T09:41:00.173 INFO:teuthology.orchestra.run.smithi073.stdout:(129/149): python3-webob-1.8.7-6.el9.noarch.rpm 2.7 MB/s | 230 kB 00:00 2023-12-12T09:41:00.290 INFO:teuthology.orchestra.run.smithi073.stdout:(130/149): python3-websocket-client-1.2.3-2.el9 512 kB/s | 90 kB 00:00 2023-12-12T09:41:00.307 INFO:teuthology.orchestra.run.smithi142.stdout:(20/149): python3-cephfs-19.0.0-96.gf1fbf3c5.el 462 kB/s | 161 kB 00:00 2023-12-12T09:41:00.340 INFO:teuthology.orchestra.run.smithi073.stdout:(131/149): python3-zc-lockfile-2.0-10.el9.noarc 120 kB/s | 20 kB 00:00 2023-12-12T09:41:00.373 INFO:teuthology.orchestra.run.smithi073.stdout:(132/149): python3-werkzeug-2.0.3-3.el9.1.noarc 1.8 MB/s | 427 kB 00:00 2023-12-12T09:41:00.407 INFO:teuthology.orchestra.run.smithi073.stdout:(133/149): re2-20211101-3.el9.x86_64.rpm 1.6 MB/s | 192 kB 00:00 2023-12-12T09:41:00.408 INFO:teuthology.orchestra.run.smithi142.stdout:(21/149): python3-rados-19.0.0-96.gf1fbf3c5.el9 3.2 MB/s | 320 kB 00:00 2023-12-12T09:41:00.482 INFO:teuthology.orchestra.run.smithi073.stdout:(134/149): thrift-0.15.0-2.el9.x86_64.rpm 11 MB/s | 1.6 MB 00:00 2023-12-12T09:41:00.516 INFO:teuthology.orchestra.run.smithi073.stdout:(135/149): libacl-devel-2.3.1-4.el9.x86_64.rpm 2.0 MB/s | 68 kB 00:00 2023-12-12T09:41:00.550 INFO:teuthology.orchestra.run.smithi073.stdout:(136/149): acl-2.3.1-4.el9.x86_64.rpm 2.0 MB/s | 69 kB 00:00 2023-12-12T09:41:00.566 INFO:teuthology.orchestra.run.smithi142.stdout:(22/149): ceph-radosgw-19.0.0-96.gf1fbf3c5.el9. 2.8 MB/s | 8.6 MB 00:03 2023-12-12T09:41:00.583 INFO:teuthology.orchestra.run.smithi073.stdout:(137/149): elfutils-debuginfod-client-0.190-1.e 1.1 MB/s | 36 kB 00:00 2023-12-12T09:41:00.600 INFO:teuthology.orchestra.run.smithi142.stdout:(23/149): python3-rbd-19.0.0-96.gf1fbf3c5.el9.x 1.5 MB/s | 297 kB 00:00 2023-12-12T09:41:00.625 INFO:teuthology.orchestra.run.smithi073.stdout:(138/149): elfutils-libelf-0.190-1.el9.x86_64.r 4.6 MB/s | 192 kB 00:00 2023-12-12T09:41:00.667 INFO:teuthology.orchestra.run.smithi073.stdout:(139/149): elfutils-libs-0.190-1.el9.x86_64.rpm 6.1 MB/s | 255 kB 00:00 2023-12-12T09:41:00.692 INFO:teuthology.orchestra.run.smithi073.stdout:(140/149): libacl-2.3.1-4.el9.x86_64.rpm 900 kB/s | 22 kB 00:00 2023-12-12T09:41:00.751 INFO:teuthology.orchestra.run.smithi073.stdout:(141/149): xfsdump-3.1.12-4.el9.x86_64.rpm 5.4 MB/s | 321 kB 00:00 2023-12-12T09:41:00.993 INFO:teuthology.orchestra.run.smithi073.stdout:(142/149): NetworkManager-1.45.7-1.el9.x86_64.r 9.4 MB/s | 2.3 MB 00:00 2023-12-12T09:41:01.034 INFO:teuthology.orchestra.run.smithi142.stdout:(24/149): ceph-test-19.0.0-96.gf1fbf3c5.el9.x86 14 MB/s | 41 MB 00:02 2023-12-12T09:41:01.059 INFO:teuthology.orchestra.run.smithi142.stdout:(25/149): rbd-fuse-19.0.0-96.gf1fbf3c5.el9.x86_ 186 kB/s | 85 kB 00:00 2023-12-12T09:41:01.068 INFO:teuthology.orchestra.run.smithi073.stdout:(143/149): librados2-19.0.0-96.gf1fbf3c5.el9.x8 4.8 MB/s | 3.3 MB 00:00 2023-12-12T09:41:01.084 INFO:teuthology.orchestra.run.smithi142.stdout:(26/149): python3-rgw-19.0.0-96.gf1fbf3c5.el9.x 192 kB/s | 99 kB 00:00 2023-12-12T09:41:01.134 INFO:teuthology.orchestra.run.smithi142.stdout:(27/149): rbd-nbd-19.0.0-96.gf1fbf3c5.el9.x86_6 2.2 MB/s | 170 kB 00:00 2023-12-12T09:41:01.160 INFO:teuthology.orchestra.run.smithi142.stdout:(28/149): ceph-grafana-dashboards-19.0.0-96.gf1 376 kB/s | 28 kB 00:00 2023-12-12T09:41:01.177 INFO:teuthology.orchestra.run.smithi073.stdout:(144/149): librbd1-19.0.0-96.gf1fbf3c5.el9.x86_ 3.9 MB/s | 3.0 MB 00:00 2023-12-12T09:41:01.210 INFO:teuthology.orchestra.run.smithi142.stdout:(29/149): ceph-mgr-cephadm-19.0.0-96.gf1fbf3c5. 1.7 MB/s | 133 kB 00:00 2023-12-12T09:41:01.252 INFO:teuthology.orchestra.run.smithi073.stdout:(145/149): NetworkManager-libnm-1.45.7-1.el9.x8 6.9 MB/s | 1.8 MB 00:00 2023-12-12T09:41:01.279 INFO:teuthology.orchestra.run.smithi073.stdout:(146/149): NetworkManager-team-1.45.7-1.el9.x86 207 kB/s | 43 kB 00:00 2023-12-12T09:41:01.335 INFO:teuthology.orchestra.run.smithi142.stdout:(30/149): ceph-mgr-dashboard-19.0.0-96.gf1fbf3c 10 MB/s | 1.8 MB 00:00 2023-12-12T09:41:01.345 INFO:teuthology.orchestra.run.smithi073.stdout:(147/149): openssl-3.0.7-25.el9.x86_64.rpm 13 MB/s | 1.2 MB 00:00 2023-12-12T09:41:01.378 INFO:teuthology.orchestra.run.smithi073.stdout:(148/149): NetworkManager-tui-1.45.7-1.el9.x86_ 1.2 MB/s | 246 kB 00:00 2023-12-12T09:41:01.394 INFO:teuthology.orchestra.run.smithi142.stdout:(31/149): ceph-mgr-modules-core-19.0.0-96.gf1fb 4.1 MB/s | 243 kB 00:00 2023-12-12T09:41:01.452 INFO:teuthology.orchestra.run.smithi142.stdout:(32/149): ceph-mgr-rook-19.0.0-96.gf1fbf3c5.el9 873 kB/s | 50 kB 00:00 2023-12-12T09:41:01.529 INFO:teuthology.orchestra.run.smithi073.stdout:(149/149): openssl-libs-3.0.7-25.el9.x86_64.rpm 8.6 MB/s | 2.2 MB 00:00 2023-12-12T09:41:01.544 INFO:teuthology.orchestra.run.smithi073.stdout:-------------------------------------------------------------------------------- 2023-12-12T09:41:01.544 INFO:teuthology.orchestra.run.smithi073.stdout:Total 16 MB/s | 204 MB 00:12 2023-12-12T09:41:01.761 INFO:teuthology.orchestra.run.smithi142.stdout:(33/149): ceph-prometheus-alerts-19.0.0-96.gf1f 49 kB/s | 15 kB 00:00 2023-12-12T09:41:01.828 INFO:teuthology.orchestra.run.smithi142.stdout:(34/149): ceph-volume-19.0.0-96.gf1fbf3c5.el9.n 3.9 MB/s | 262 kB 00:00 2023-12-12T09:41:01.971 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction check 2023-12-12T09:41:02.170 INFO:teuthology.orchestra.run.smithi142.stdout:(35/149): ceph-mgr-diskprediction-local-19.0.0- 7.7 MB/s | 7.4 MB 00:00 2023-12-12T09:41:02.237 INFO:teuthology.orchestra.run.smithi142.stdout:(36/149): cephadm-19.0.0-96.gf1fbf3c5.el9.noarc 1.9 MB/s | 803 kB 00:00 2023-12-12T09:41:02.250 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction check succeeded. 2023-12-12T09:41:02.250 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction test 2023-12-12T09:41:02.262 INFO:teuthology.orchestra.run.smithi142.stdout:(37/149): cephfs-top-19.0.0-96.gf1fbf3c5.el9.no 200 kB/s | 18 kB 00:00 2023-12-12T09:41:02.471 INFO:teuthology.orchestra.run.smithi142.stdout:(38/149): automake-1.16.2-8.el9.noarch.rpm 2.8 MB/s | 662 kB 00:00 2023-12-12T09:41:02.521 INFO:teuthology.orchestra.run.smithi142.stdout:(39/149): bison-3.7.4-5.el9.x86_64.rpm 3.5 MB/s | 920 kB 00:00 2023-12-12T09:41:02.546 INFO:teuthology.orchestra.run.smithi142.stdout:(40/149): boost-program-options-1.75.0-8.el9.x8 1.5 MB/s | 106 kB 00:00 2023-12-12T09:41:02.572 INFO:teuthology.orchestra.run.smithi142.stdout:(41/149): elfutils-libelf-devel-0.190-1.el9.x86 441 kB/s | 21 kB 00:00 2023-12-12T09:41:02.605 INFO:teuthology.orchestra.run.smithi142.stdout:(42/149): flex-2.6.4-9.el9.x86_64.rpm 5.2 MB/s | 307 kB 00:00 2023-12-12T09:41:02.630 INFO:teuthology.orchestra.run.smithi142.stdout:(43/149): flexiblas-3.0.4-8.el9.x86_64.rpm 573 kB/s | 32 kB 00:00 2023-12-12T09:41:02.731 INFO:teuthology.orchestra.run.smithi142.stdout:(44/149): flexiblas-netlib-3.0.4-8.el9.x86_64.r 24 MB/s | 3.0 MB 00:00 2023-12-12T09:41:02.747 INFO:teuthology.orchestra.run.smithi142.stdout:(45/149): flexiblas-openblas-openmp-3.0.4-8.el9 166 kB/s | 17 kB 00:00 2023-12-12T09:41:02.773 INFO:teuthology.orchestra.run.smithi142.stdout:(46/149): libaio-devel-0.3.111-13.el9.x86_64.rp 426 kB/s | 10 kB 00:00 2023-12-12T09:41:02.807 INFO:teuthology.orchestra.run.smithi142.stdout:(47/149): jq-1.6-16.el9.x86_64.rpm 3.2 MB/s | 186 kB 00:00 2023-12-12T09:41:02.832 INFO:teuthology.orchestra.run.smithi142.stdout:(48/149): libpmemobj-1.12.1-1.el9.x86_64.rpm 2.8 MB/s | 159 kB 00:00 2023-12-12T09:41:02.857 INFO:teuthology.orchestra.run.smithi142.stdout:(49/149): librabbitmq-0.11.0-7.el9.x86_64.rpm 918 kB/s | 44 kB 00:00 2023-12-12T09:41:02.901 INFO:teuthology.orchestra.run.smithi142.stdout:(50/149): librdkafka-1.6.1-102.el9.x86_64.rpm 9.9 MB/s | 661 kB 00:00 2023-12-12T09:41:02.933 INFO:teuthology.orchestra.run.smithi142.stdout:(51/149): libtool-2.4.6-45.el9.x86_64.rpm 8.2 MB/s | 578 kB 00:00 2023-12-12T09:41:02.958 INFO:teuthology.orchestra.run.smithi142.stdout:(52/149): libuuid-devel-2.37.4-15.el9.x86_64.rp 458 kB/s | 24 kB 00:00 2023-12-12T09:41:02.983 INFO:teuthology.orchestra.run.smithi142.stdout:(53/149): libzstd-devel-1.5.1-2.el9.x86_64.rpm 943 kB/s | 46 kB 00:00 2023-12-12T09:41:03.026 INFO:teuthology.orchestra.run.smithi142.stdout:(54/149): lttng-ust-2.12.0-6.el9.x86_64.rpm 4.2 MB/s | 282 kB 00:00 2023-12-12T09:41:03.059 INFO:teuthology.orchestra.run.smithi142.stdout:(55/149): lua-5.4.4-4.el9.x86_64.rpm 2.5 MB/s | 187 kB 00:00 2023-12-12T09:41:03.094 INFO:teuthology.orchestra.run.smithi142.stdout:(56/149): oniguruma-6.9.6-1.el9.5.x86_64.rpm 3.3 MB/s | 217 kB 00:00 2023-12-12T09:41:03.118 INFO:teuthology.orchestra.run.smithi142.stdout:(57/149): openblas-0.3.21-2.el9.x86_64.rpm 611 kB/s | 34 kB 00:00 2023-12-12T09:41:03.243 INFO:teuthology.orchestra.run.smithi142.stdout:(58/149): openblas-openmp-0.3.21-2.el9.x86_64.r 32 MB/s | 4.7 MB 00:00 2023-12-12T09:41:03.294 INFO:teuthology.orchestra.run.smithi142.stdout:(59/149): postgresql-13.11-1.el9.x86_64.rpm 9.4 MB/s | 1.5 MB 00:00 2023-12-12T09:41:03.336 INFO:teuthology.orchestra.run.smithi142.stdout:(60/149): postgresql-contrib-13.11-1.el9.x86_64 8.8 MB/s | 811 kB 00:00 2023-12-12T09:41:03.362 INFO:teuthology.orchestra.run.smithi142.stdout:(61/149): postgresql-private-libs-13.11-1.el9.x 2.2 MB/s | 134 kB 00:00 2023-12-12T09:41:03.513 INFO:teuthology.orchestra.run.smithi142.stdout:(62/149): postgresql-server-13.11-1.el9.x86_64. 33 MB/s | 5.7 MB 00:00 2023-12-12T09:41:03.611 INFO:teuthology.orchestra.run.smithi142.stdout:(63/149): rbd-mirror-19.0.0-96.gf1fbf3c5.el9.x8 1.2 MB/s | 3.0 MB 00:02 2023-12-12T09:41:03.712 INFO:teuthology.orchestra.run.smithi142.stdout:(64/149): python3-babel-2.9.1-2.el9.noarch.rpm 17 MB/s | 5.8 MB 00:00 2023-12-12T09:41:03.736 INFO:teuthology.orchestra.run.smithi142.stdout:(65/149): python3-jinja2-2.11.3-4.el9.noarch.rp 1.1 MB/s | 228 kB 00:00 2023-12-12T09:41:03.770 INFO:teuthology.orchestra.run.smithi142.stdout:(66/149): python3-jsonpatch-1.21-16.el9.noarch. 759 kB/s | 24 kB 00:00 2023-12-12T09:41:03.795 INFO:teuthology.orchestra.run.smithi142.stdout:(67/149): python3-jsonpointer-2.0-4.el9.noarch. 317 kB/s | 18 kB 00:00 2023-12-12T09:41:03.864 INFO:teuthology.orchestra.run.smithi142.stdout:(68/149): python3-mako-1.1.4-6.el9.noarch.rpm 1.1 MB/s | 144 kB 00:00 2023-12-12T09:41:03.904 INFO:teuthology.orchestra.run.smithi142.stdout:(69/149): python3-markupsafe-1.1.1-12.el9.x86_6 297 kB/s | 32 kB 00:00 2023-12-12T09:41:04.030 INFO:teuthology.orchestra.run.smithi142.stdout:(70/149): python3-numpy-1.20.1-5.el9.x86_64.rpm 21 MB/s | 4.8 MB 00:00 2023-12-12T09:41:04.055 INFO:teuthology.orchestra.run.smithi142.stdout:(71/149): python3-numpy-f2py-1.20.1-5.el9.x86_6 1.1 MB/s | 217 kB 00:00 2023-12-12T09:41:04.080 INFO:teuthology.orchestra.run.smithi142.stdout:(72/149): python3-oauthlib-3.1.1-5.el9.noarch.r 1.1 MB/s | 174 kB 00:00 2023-12-12T09:41:04.114 INFO:teuthology.orchestra.run.smithi142.stdout:(73/149): python3-prettytable-0.7.2-27.el9.noar 1.3 MB/s | 41 kB 00:00 2023-12-12T09:41:04.147 INFO:teuthology.orchestra.run.smithi142.stdout:(74/149): python3-pyasn1-0.4.8-6.el9.noarch.rpm 2.0 MB/s | 132 kB 00:00 2023-12-12T09:41:04.172 INFO:teuthology.orchestra.run.smithi142.stdout:(75/149): python3-pyasn1-modules-0.4.8-6.el9.no 2.3 MB/s | 211 kB 00:00 2023-12-12T09:41:04.198 INFO:teuthology.orchestra.run.smithi142.stdout:(76/149): python3-pytz-2021.1-5.el9.noarch.rpm 588 kB/s | 47 kB 00:00 2023-12-12T09:41:04.240 INFO:teuthology.orchestra.run.smithi142.stdout:(77/149): python3-requests-oauthlib-1.3.0-12.el 654 kB/s | 43 kB 00:00 2023-12-12T09:41:04.425 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction test succeeded. 2023-12-12T09:41:04.425 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction 2023-12-12T09:41:04.498 INFO:teuthology.orchestra.run.smithi142.stdout:(78/149): python3-scipy-1.6.2-8.el9.x86_64.rpm 48 MB/s | 16 MB 00:00 2023-12-12T09:41:04.523 INFO:teuthology.orchestra.run.smithi142.stdout:(79/149): python3-toml-0.10.2-6.el9.noarch.rpm 119 kB/s | 39 kB 00:00 2023-12-12T09:41:04.548 INFO:teuthology.orchestra.run.smithi142.stdout:(80/149): socat-1.7.4.1-5.el9.x86_64.rpm 1.0 MB/s | 300 kB 00:00 2023-12-12T09:41:04.590 INFO:teuthology.orchestra.run.smithi142.stdout:(81/149): uuid-1.6.2-55.el9.x86_64.rpm 1.4 MB/s | 56 kB 00:00 2023-12-12T09:41:04.616 INFO:teuthology.orchestra.run.smithi142.stdout:(82/149): xmlstarlet-1.6.1-20.el9.x86_64.rpm 965 kB/s | 63 kB 00:00 2023-12-12T09:41:04.641 INFO:teuthology.orchestra.run.smithi142.stdout:(83/149): xfsprogs-devel-5.19.0-4.el9.x86_64.rp 941 kB/s | 85 kB 00:00 2023-12-12T09:41:04.666 INFO:teuthology.orchestra.run.smithi142.stdout:(84/149): zlib-devel-1.2.11-40.el9.x86_64.rpm 905 kB/s | 44 kB 00:00 2023-12-12T09:41:04.700 INFO:teuthology.orchestra.run.smithi142.stdout:(85/149): fuse-2.9.9-15.el9.x86_64.rpm 959 kB/s | 79 kB 00:00 2023-12-12T09:41:04.742 INFO:teuthology.orchestra.run.smithi142.stdout:(86/149): libgfortran-11.4.1-2.3.el9.x86_64.rpm 7.9 MB/s | 803 kB 00:00 2023-12-12T09:41:04.775 INFO:teuthology.orchestra.run.smithi142.stdout:(87/149): libquadmath-11.4.1-2.3.el9.x86_64.rpm 2.8 MB/s | 195 kB 00:00 2023-12-12T09:41:04.800 INFO:teuthology.orchestra.run.smithi142.stdout:(88/149): python3-cffi-1.14.5-5.el9.x86_64.rpm 2.5 MB/s | 241 kB 00:00 2023-12-12T09:41:04.851 INFO:teuthology.orchestra.run.smithi142.stdout:(89/149): python3-cryptography-36.0.1-4.el9.x86 11 MB/s | 1.1 MB 00:00 2023-12-12T09:41:04.876 INFO:teuthology.orchestra.run.smithi142.stdout:(90/149): python3-ply-3.11-14.el9.noarch.rpm 1.6 MB/s | 103 kB 00:00 2023-12-12T09:41:04.901 INFO:teuthology.orchestra.run.smithi142.stdout:(91/149): python3-pycparser-2.20-6.el9.noarch.r 1.3 MB/s | 124 kB 00:00 2023-12-12T09:41:04.927 INFO:teuthology.orchestra.run.smithi142.stdout:(92/149): python3-requests-2.25.1-7.el9.noarch. 1.5 MB/s | 113 kB 00:00 2023-12-12T09:41:04.985 INFO:teuthology.orchestra.run.smithi142.stdout:(93/149): python3-urllib3-1.26.5-4.el9.noarch.r 2.2 MB/s | 187 kB 00:00 2023-12-12T09:41:05.444 INFO:teuthology.orchestra.run.smithi142.stdout:(94/149): gperftools-libs-2.9.1-2.el9.x86_64.rp 674 kB/s | 309 kB 00:00 2023-12-12T09:41:05.528 INFO:teuthology.orchestra.run.smithi142.stdout:(95/149): python3-devel-3.9.17-2.el9.x86_64.rpm 410 kB/s | 245 kB 00:00 2023-12-12T09:41:05.803 INFO:teuthology.orchestra.run.smithi142.stdout:(96/149): libarrow-doc-9.0.0-10.el9.noarch.rpm 95 kB/s | 26 kB 00:00 2023-12-12T09:41:05.895 INFO:teuthology.orchestra.run.smithi142.stdout:(97/149): liboath-2.6.7-2.el9.x86_64.rpm 533 kB/s | 49 kB 00:00 2023-12-12T09:41:05.978 INFO:teuthology.orchestra.run.smithi142.stdout:(98/149): libunwind-1.6.2-1.el9.x86_64.rpm 818 kB/s | 67 kB 00:00 2023-12-12T09:41:06.131 INFO:teuthology.orchestra.run.smithi142.stdout:(99/149): luarocks-3.9.2-1.el9.noarch.rpm 993 kB/s | 151 kB 00:00 2023-12-12T09:41:06.279 INFO:teuthology.orchestra.run.smithi142.stdout:(100/149): openssl-devel-3.0.7-25.el9.x86_64.rp 3.0 MB/s | 4.1 MB 00:01 2023-12-12T09:41:06.629 INFO:teuthology.orchestra.run.smithi142.stdout:(101/149): parquet-libs-9.0.0-10.el9.x86_64.rpm 1.6 MB/s | 838 kB 00:00 2023-12-12T09:41:06.688 INFO:teuthology.orchestra.run.smithi142.stdout:(102/149): python3-bcrypt-3.2.2-1.el9.x86_64.rp 755 kB/s | 43 kB 00:00 2023-12-12T09:41:06.754 INFO:teuthology.orchestra.run.smithi142.stdout:(103/149): python3-cachetools-4.2.4-1.el9.noarc 487 kB/s | 32 kB 00:00 2023-12-12T09:41:06.821 INFO:teuthology.orchestra.run.smithi142.stdout:(104/149): python3-certifi-2021.10.8-2.el9.noar 228 kB/s | 15 kB 00:00 2023-12-12T09:41:06.930 INFO:teuthology.orchestra.run.smithi142.stdout:(105/149): python3-asyncssh-2.13.2-3.el9.noarch 843 kB/s | 548 kB 00:00 2023-12-12T09:41:06.997 INFO:teuthology.orchestra.run.smithi142.stdout:(106/149): python3-cheroot-8.6.0-4.el9.noarch.r 985 kB/s | 172 kB 00:00 2023-12-12T09:41:07.131 INFO:teuthology.orchestra.run.smithi142.stdout:(107/149): python3-google-auth-2.23.4-1.el9.noa 1.5 MB/s | 197 kB 00:00 2023-12-12T09:41:07.198 INFO:teuthology.orchestra.run.smithi142.stdout:(108/149): python3-cherrypy-18.6.1-2.el9.noarch 1.3 MB/s | 358 kB 00:00 2023-12-12T09:41:07.223 INFO:teuthology.orchestra.run.smithi142.stdout:(109/149): python3-jaraco-8.2.1-3.el9.noarch.rp 117 kB/s | 11 kB 00:00 2023-12-12T09:41:07.298 INFO:teuthology.orchestra.run.smithi142.stdout:(110/149): python3-jaraco-classes-3.2.1-5.el9.n 239 kB/s | 18 kB 00:00 2023-12-12T09:41:07.323 INFO:teuthology.orchestra.run.smithi142.stdout:(111/149): python3-jaraco-collections-3.0.0-8.e 234 kB/s | 23 kB 00:00 2023-12-12T09:41:07.382 INFO:teuthology.orchestra.run.smithi142.stdout:(112/149): python3-jaraco-functools-3.5.0-2.el9 340 kB/s | 19 kB 00:00 2023-12-12T09:41:07.407 INFO:teuthology.orchestra.run.smithi142.stdout:(113/149): python3-jaraco-text-3.2.0-6.el9.noar 239 kB/s | 20 kB 00:00 2023-12-12T09:41:07.466 INFO:teuthology.orchestra.run.smithi142.stdout:(114/149): python3-jwt+crypto-2.4.0-1.el9.noarc 158 kB/s | 9.0 kB 00:00 2023-12-12T09:41:07.491 INFO:teuthology.orchestra.run.smithi142.stdout:(115/149): python3-jwt-2.4.0-1.el9.noarch.rpm 497 kB/s | 41 kB 00:00 2023-12-12T09:41:07.558 INFO:teuthology.orchestra.run.smithi142.stdout:(116/149): python3-logutils-0.3.5-21.el9.noarch 702 kB/s | 46 kB 00:00 2023-12-12T09:41:07.625 INFO:teuthology.orchestra.run.smithi142.stdout:(117/149): python3-more-itertools-8.12.0-2.el9. 1.2 MB/s | 79 kB 00:00 2023-12-12T09:41:07.684 INFO:teuthology.orchestra.run.smithi142.stdout:(118/149): python3-natsort-7.1.1-5.el9.noarch.r 1.0 MB/s | 58 kB 00:00 2023-12-12T09:41:07.884 INFO:teuthology.orchestra.run.smithi142.stdout:(119/149): python3-pecan-1.4.2-3.el9.noarch.rpm 1.3 MB/s | 272 kB 00:00 2023-12-12T09:41:07.942 INFO:teuthology.orchestra.run.smithi142.stdout:(120/149): python3-portend-3.1.0-2.el9.noarch.r 286 kB/s | 16 kB 00:00 2023-12-12T09:41:08.034 INFO:teuthology.orchestra.run.smithi142.stdout:(121/149): python3-pyOpenSSL-21.0.0-1.el9.noarc 988 kB/s | 90 kB 00:00 2023-12-12T09:41:08.177 INFO:teuthology.orchestra.run.smithi142.stdout:(122/149): libarrow-9.0.0-10.el9.x86_64.rpm 1.6 MB/s | 4.4 MB 00:02 2023-12-12T09:41:08.218 INFO:teuthology.orchestra.run.smithi142.stdout:(123/149): python3-kubernetes-26.1.0-2.el9.noar 1.4 MB/s | 1.0 MB 00:00 2023-12-12T09:41:08.244 INFO:teuthology.orchestra.run.smithi142.stdout:(124/149): python3-repoze-lru-0.7-16.el9.noarch 148 kB/s | 31 kB 00:00 2023-12-12T09:41:08.277 INFO:teuthology.orchestra.run.smithi142.stdout:(125/149): python3-rsa-4.9-2.el9.noarch.rpm 1.0 MB/s | 59 kB 00:00 2023-12-12T09:41:08.303 INFO:teuthology.orchestra.run.smithi142.stdout:(126/149): python3-tempora-5.0.0-2.el9.noarch.r 617 kB/s | 36 kB 00:00 2023-12-12T09:41:08.328 INFO:teuthology.orchestra.run.smithi142.stdout:(127/149): python3-routes-2.5.1-5.el9.noarch.rp 1.2 MB/s | 188 kB 00:00 2023-12-12T09:41:08.353 INFO:teuthology.orchestra.run.smithi142.stdout:(128/149): python3-typing-extensions-4.4.0-2.el 679 kB/s | 51 kB 00:00 2023-12-12T09:41:08.445 INFO:teuthology.orchestra.run.smithi142.stdout:(129/149): python3-websocket-client-1.2.3-2.el9 771 kB/s | 90 kB 00:00 2023-12-12T09:41:08.479 INFO:teuthology.orchestra.run.smithi142.stdout:(130/149): python3-webob-1.8.7-6.el9.noarch.rpm 1.3 MB/s | 230 kB 00:00 2023-12-12T09:41:08.495 INFO:teuthology.orchestra.run.smithi142.stdout:(131/149): python3-zc-lockfile-2.0-10.el9.noarc 404 kB/s | 20 kB 00:00 2023-12-12T09:41:08.621 INFO:teuthology.orchestra.run.smithi142.stdout:(132/149): re2-20211101-3.el9.x86_64.rpm 1.3 MB/s | 192 kB 00:00 2023-12-12T09:41:08.688 INFO:teuthology.orchestra.run.smithi142.stdout:(133/149): python3-werkzeug-2.0.3-3.el9.1.noarc 1.2 MB/s | 427 kB 00:00 2023-12-12T09:41:09.171 INFO:teuthology.orchestra.run.smithi142.stdout:(134/149): librbd1-19.0.0-96.gf1fbf3c5.el9.x86_ 6.3 MB/s | 3.0 MB 00:00 2023-12-12T09:41:09.205 INFO:teuthology.orchestra.run.smithi142.stdout:(135/149): libacl-devel-2.3.1-4.el9.x86_64.rpm 2.0 MB/s | 68 kB 00:00 2023-12-12T09:41:09.288 INFO:teuthology.orchestra.run.smithi142.stdout:(136/149): librados2-19.0.0-96.gf1fbf3c5.el9.x8 5.0 MB/s | 3.3 MB 00:00 2023-12-12T09:41:09.314 INFO:teuthology.orchestra.run.smithi142.stdout:(137/149): acl-2.3.1-4.el9.x86_64.rpm 638 kB/s | 69 kB 00:00 2023-12-12T09:41:09.339 INFO:teuthology.orchestra.run.smithi142.stdout:(138/149): elfutils-debuginfod-client-0.190-1.e 750 kB/s | 36 kB 00:00 2023-12-12T09:41:09.373 INFO:teuthology.orchestra.run.smithi142.stdout:(139/149): elfutils-libelf-0.190-1.el9.x86_64.r 3.3 MB/s | 192 kB 00:00 2023-12-12T09:41:09.406 INFO:teuthology.orchestra.run.smithi142.stdout:(140/149): elfutils-libs-0.190-1.el9.x86_64.rpm 3.9 MB/s | 255 kB 00:00 2023-12-12T09:41:09.432 INFO:teuthology.orchestra.run.smithi142.stdout:(141/149): libacl-2.3.1-4.el9.x86_64.rpm 394 kB/s | 22 kB 00:00 2023-12-12T09:41:09.465 INFO:teuthology.orchestra.run.smithi142.stdout:(142/149): xfsdump-3.1.12-4.el9.x86_64.rpm 5.5 MB/s | 321 kB 00:00 2023-12-12T09:41:09.616 INFO:teuthology.orchestra.run.smithi142.stdout:(143/149): thrift-0.15.0-2.el9.x86_64.rpm 1.4 MB/s | 1.6 MB 00:01 2023-12-12T09:41:09.732 INFO:teuthology.orchestra.run.smithi142.stdout:(144/149): NetworkManager-team-1.45.7-1.el9.x86 373 kB/s | 43 kB 00:00 2023-12-12T09:41:09.858 INFO:teuthology.orchestra.run.smithi142.stdout:(145/149): NetworkManager-tui-1.45.7-1.el9.x86_ 1.9 MB/s | 246 kB 00:00 2023-12-12T09:41:10.000 INFO:teuthology.orchestra.run.smithi142.stdout:(146/149): NetworkManager-libnm-1.45.7-1.el9.x8 3.3 MB/s | 1.8 MB 00:00 2023-12-12T09:41:10.142 INFO:teuthology.orchestra.run.smithi142.stdout:(147/149): NetworkManager-1.45.7-1.el9.x86_64.r 3.2 MB/s | 2.3 MB 00:00 2023-12-12T09:41:10.184 INFO:teuthology.orchestra.run.smithi142.stdout:(148/149): openssl-3.0.7-25.el9.x86_64.rpm 3.7 MB/s | 1.2 MB 00:00 2023-12-12T09:41:10.559 INFO:teuthology.orchestra.run.smithi142.stdout:(149/149): openssl-libs-3.0.7-25.el9.x86_64.rpm 3.9 MB/s | 2.2 MB 00:00 2023-12-12T09:41:10.574 INFO:teuthology.orchestra.run.smithi142.stdout:-------------------------------------------------------------------------------- 2023-12-12T09:41:10.574 INFO:teuthology.orchestra.run.smithi142.stdout:Total 13 MB/s | 204 MB 00:16 2023-12-12T09:41:10.983 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction check 2023-12-12T09:41:11.048 INFO:teuthology.orchestra.run.smithi073.stdout: Preparing : 1/1 2023-12-12T09:41:11.232 INFO:teuthology.orchestra.run.smithi073.stdout: Upgrading : openssl-libs-1:3.0.7-25.el9.x86_64 1/164 2023-12-12T09:41:11.265 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction check succeeded. 2023-12-12T09:41:11.265 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction test 2023-12-12T09:41:11.269 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : thrift-0.15.0-2.el9.x86_64 2/164 2023-12-12T09:41:11.378 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 3/164 2023-12-12T09:41:11.434 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 4/164 2023-12-12T09:41:11.462 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/164 2023-12-12T09:41:11.531 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/164 2023-12-12T09:41:11.932 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/164 2023-12-12T09:41:11.976 INFO:teuthology.orchestra.run.smithi073.stdout: Upgrading : librados2-2:19.0.0-96.gf1fbf3c5.el9.x86_64 8/164 2023-12-12T09:41:12.132 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: librados2-2:19.0.0-96.gf1fbf3c5.el9.x86_64 8/164 2023-12-12T09:41:12.169 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : libcephfs2-2:19.0.0-96.gf1fbf3c5.el9.x86_64 9/164 2023-12-12T09:41:12.299 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: libcephfs2-2:19.0.0-96.gf1fbf3c5.el9.x86_64 9/164 2023-12-12T09:41:12.334 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-rados-2:19.0.0-96.gf1fbf3c5.el9.x86_64 10/164 2023-12-12T09:41:12.406 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : postgresql-private-libs-13.11-1.el9.x86_64 11/164 2023-12-12T09:41:12.744 INFO:teuthology.orchestra.run.smithi073.stdout: Upgrading : elfutils-libelf-0.190-1.el9.x86_64 12/164 2023-12-12T09:41:12.799 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : postgresql-13.11-1.el9.x86_64 13/164 2023-12-12T09:41:12.824 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : libcephsqlite-2:19.0.0-96.gf1fbf3c5.el9.x86_64 14/164 2023-12-12T09:41:13.013 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: libcephsqlite-2:19.0.0-96.gf1fbf3c5.el9.x86_64 14/164 2023-12-12T09:41:13.041 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : libradosstriper1-2:19.0.0-96.gf1fbf3c5.el9.x86_6 15/164 2023-12-12T09:41:13.388 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: libradosstriper1-2:19.0.0-96.gf1fbf3c5.el9.x86_6 15/164 2023-12-12T09:41:13.458 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction test succeeded. 2023-12-12T09:41:13.458 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction 2023-12-12T09:41:13.571 INFO:teuthology.orchestra.run.smithi073.stdout: Upgrading : NetworkManager-libnm-1:1.45.7-1.el9.x86_64 16/164 2023-12-12T09:41:13.643 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: NetworkManager-libnm-1:1.45.7-1.el9.x86_64 16/164 2023-12-12T09:41:13.832 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: NetworkManager-1:1.45.7-1.el9.x86_64 17/164 2023-12-12T09:41:13.882 INFO:teuthology.orchestra.run.smithi073.stdout: Upgrading : NetworkManager-1:1.45.7-1.el9.x86_64 17/164 2023-12-12T09:41:14.217 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: NetworkManager-1:1.45.7-1.el9.x86_64 17/164 2023-12-12T09:41:14.381 INFO:teuthology.orchestra.run.smithi073.stdout: Upgrading : libacl-2.3.1-4.el9.x86_64 18/164 2023-12-12T09:41:14.429 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 19/164 2023-12-12T09:41:14.538 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : liboath-2.6.7-2.el9.x86_64 20/164 2023-12-12T09:41:14.611 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-urllib3-1.26.5-4.el9.noarch 21/164 2023-12-12T09:41:14.644 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-requests-2.25.1-7.el9.noarch 22/164 2023-12-12T09:41:14.692 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : libquadmath-11.4.1-2.3.el9.x86_64 23/164 2023-12-12T09:41:14.752 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : libgfortran-11.4.1-2.3.el9.x86_64 24/164 2023-12-12T09:41:14.852 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 25/164 2023-12-12T09:41:14.899 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 26/164 2023-12-12T09:41:14.947 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 27/164 2023-12-12T09:41:15.055 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 28/164 2023-12-12T09:41:15.093 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-ceph-common-2:19.0.0-96.gf1fbf3c5.el9.x8 29/164 2023-12-12T09:41:15.142 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-ceph-argparse-2:19.0.0-96.gf1fbf3c5.el9. 30/164 2023-12-12T09:41:15.244 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-cephfs-2:19.0.0-96.gf1fbf3c5.el9.x86_64 31/164 2023-12-12T09:41:15.414 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 32/164 2023-12-12T09:41:15.485 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 33/164 2023-12-12T09:41:16.169 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-rsa-4.9-2.el9.noarch 34/164 2023-12-12T09:41:16.266 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 35/164 2023-12-12T09:41:16.319 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-jinja2-2.11.3-4.el9.noarch 36/164 2023-12-12T09:41:16.369 INFO:teuthology.orchestra.run.smithi073.stdout: Upgrading : elfutils-libs-0.190-1.el9.x86_64 37/164 2023-12-12T09:41:16.416 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : librados-devel-2:19.0.0-96.gf1fbf3c5.el9.x86_64 38/164 2023-12-12T09:41:16.477 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 39/164 2023-12-12T09:41:16.698 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 40/164 2023-12-12T09:41:16.965 INFO:teuthology.orchestra.run.smithi073.stdout: Upgrading : openssl-1:3.0.7-25.el9.x86_64 41/164 2023-12-12T09:41:17.128 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : re2-1:20211101-3.el9.x86_64 42/164 2023-12-12T09:41:17.165 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : libarrow-9.0.0-10.el9.x86_64 43/164 2023-12-12T09:41:17.234 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 44/164 2023-12-12T09:41:17.325 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 45/164 2023-12-12T09:41:17.374 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 46/164 2023-12-12T09:41:17.422 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 47/164 2023-12-12T09:41:17.491 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 48/164 2023-12-12T09:41:17.547 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 49/164 2023-12-12T09:41:17.607 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 50/164 2023-12-12T09:41:17.792 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 51/164 2023-12-12T09:41:17.847 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 52/164 2023-12-12T09:41:17.894 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 53/164 2023-12-12T09:41:18.020 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 54/164 2023-12-12T09:41:18.064 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-google-auth-1:2.23.4-1.el9.noarch 55/164 2023-12-12T09:41:18.115 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 56/164 2023-12-12T09:41:18.171 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 57/164 2023-12-12T09:41:18.321 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : libarrow-doc-9.0.0-10.el9.noarch 58/164 2023-12-12T09:41:18.376 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-devel-3.9.17-2.el9.x86_64 59/164 2023-12-12T09:41:18.442 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-ply-3.11-14.el9.noarch 60/164 2023-12-12T09:41:18.516 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 61/164 2023-12-12T09:41:18.796 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 62/164 2023-12-12T09:41:18.864 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 63/164 2023-12-12T09:41:19.033 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 64/164 2023-12-12T09:41:19.091 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-asyncssh-2.13.2-3.el9.noarch 65/164 2023-12-12T09:41:19.116 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-jwt-2.4.0-1.el9.noarch 66/164 2023-12-12T09:41:19.163 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-jwt+crypto-2.4.0-1.el9.noarch 67/164 2023-12-12T09:41:19.207 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 68/164 2023-12-12T09:41:19.243 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : fuse-2.9.9-15.el9.x86_64 69/164 2023-12-12T09:41:19.284 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : zlib-devel-1.2.11-40.el9.x86_64 70/164 2023-12-12T09:41:19.349 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 71/164 2023-12-12T09:41:19.435 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : uuid-1.6.2-55.el9.x86_64 72/164 2023-12-12T09:41:19.487 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 73/164 2023-12-12T09:41:19.617 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 74/164 2023-12-12T09:41:19.654 INFO:teuthology.orchestra.run.smithi142.stdout: Preparing : 1/1 2023-12-12T09:41:19.665 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 75/164 2023-12-12T09:41:19.708 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 76/164 2023-12-12T09:41:19.795 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 77/164 2023-12-12T09:41:19.797 INFO:teuthology.orchestra.run.smithi142.stdout: Upgrading : openssl-libs-1:3.0.7-25.el9.x86_64 1/164 2023-12-12T09:41:19.833 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : thrift-0.15.0-2.el9.x86_64 2/164 2023-12-12T09:41:19.845 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 78/164 2023-12-12T09:41:19.909 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 3/164 2023-12-12T09:41:19.981 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 4/164 2023-12-12T09:41:19.992 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 79/164 2023-12-12T09:41:20.017 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/164 2023-12-12T09:41:20.034 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 80/164 2023-12-12T09:41:20.120 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/164 2023-12-12T09:41:20.154 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 81/164 2023-12-12T09:41:20.231 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 82/164 2023-12-12T09:41:20.531 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/164 2023-12-12T09:41:20.573 INFO:teuthology.orchestra.run.smithi142.stdout: Upgrading : librados2-2:19.0.0-96.gf1fbf3c5.el9.x86_64 8/164 2023-12-12T09:41:20.729 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: librados2-2:19.0.0-96.gf1fbf3c5.el9.x86_64 8/164 2023-12-12T09:41:20.757 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : libcephfs2-2:19.0.0-96.gf1fbf3c5.el9.x86_64 9/164 2023-12-12T09:41:20.889 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: libcephfs2-2:19.0.0-96.gf1fbf3c5.el9.x86_64 9/164 2023-12-12T09:41:20.914 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-rados-2:19.0.0-96.gf1fbf3c5.el9.x86_64 10/164 2023-12-12T09:41:20.968 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : postgresql-private-libs-13.11-1.el9.x86_64 11/164 2023-12-12T09:41:21.127 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 83/164 2023-12-12T09:41:21.180 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 84/164 2023-12-12T09:41:21.214 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 85/164 2023-12-12T09:41:21.247 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 86/164 2023-12-12T09:41:21.259 INFO:teuthology.orchestra.run.smithi142.stdout: Upgrading : elfutils-libelf-0.190-1.el9.x86_64 12/164 2023-12-12T09:41:21.322 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : postgresql-13.11-1.el9.x86_64 13/164 2023-12-12T09:41:21.346 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : libcephsqlite-2:19.0.0-96.gf1fbf3c5.el9.x86_64 14/164 2023-12-12T09:41:21.489 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : openblas-0.3.21-2.el9.x86_64 87/164 2023-12-12T09:41:21.510 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: libcephsqlite-2:19.0.0-96.gf1fbf3c5.el9.x86_64 14/164 2023-12-12T09:41:21.518 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 88/164 2023-12-12T09:41:21.547 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : libradosstriper1-2:19.0.0-96.gf1fbf3c5.el9.x86_6 15/164 2023-12-12T09:41:21.616 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 89/164 2023-12-12T09:41:21.853 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: libradosstriper1-2:19.0.0-96.gf1fbf3c5.el9.x86_6 15/164 2023-12-12T09:41:21.993 INFO:teuthology.orchestra.run.smithi142.stdout: Upgrading : NetworkManager-libnm-1:1.45.7-1.el9.x86_64 16/164 2023-12-12T09:41:22.081 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: NetworkManager-libnm-1:1.45.7-1.el9.x86_64 16/164 2023-12-12T09:41:22.250 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: NetworkManager-1:1.45.7-1.el9.x86_64 17/164 2023-12-12T09:41:22.329 INFO:teuthology.orchestra.run.smithi142.stdout: Upgrading : NetworkManager-1:1.45.7-1.el9.x86_64 17/164 2023-12-12T09:41:22.415 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 90/164 2023-12-12T09:41:22.546 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 91/164 2023-12-12T09:41:22.660 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: NetworkManager-1:1.45.7-1.el9.x86_64 17/164 2023-12-12T09:41:22.823 INFO:teuthology.orchestra.run.smithi142.stdout: Upgrading : libacl-2.3.1-4.el9.x86_64 18/164 2023-12-12T09:41:22.859 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 19/164 2023-12-12T09:41:22.973 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : liboath-2.6.7-2.el9.x86_64 20/164 2023-12-12T09:41:23.042 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-urllib3-1.26.5-4.el9.noarch 21/164 2023-12-12T09:41:23.074 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-requests-2.25.1-7.el9.noarch 22/164 2023-12-12T09:41:23.129 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : libquadmath-11.4.1-2.3.el9.x86_64 23/164 2023-12-12T09:41:23.183 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : libgfortran-11.4.1-2.3.el9.x86_64 24/164 2023-12-12T09:41:23.286 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 25/164 2023-12-12T09:41:23.326 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 26/164 2023-12-12T09:41:23.359 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 27/164 2023-12-12T09:41:23.495 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 28/164 2023-12-12T09:41:23.539 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-ceph-common-2:19.0.0-96.gf1fbf3c5.el9.x8 29/164 2023-12-12T09:41:23.583 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-ceph-argparse-2:19.0.0-96.gf1fbf3c5.el9. 30/164 2023-12-12T09:41:23.663 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-cephfs-2:19.0.0-96.gf1fbf3c5.el9.x86_64 31/164 2023-12-12T09:41:23.831 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 32/164 2023-12-12T09:41:23.898 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 33/164 2023-12-12T09:41:24.097 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 92/164 2023-12-12T09:41:24.215 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 93/164 2023-12-12T09:41:24.266 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : oniguruma-6.9.6-1.el9.5.x86_64 94/164 2023-12-12T09:41:24.315 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : jq-1.6-16.el9.x86_64 95/164 2023-12-12T09:41:24.438 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : lua-5.4.4-4.el9.x86_64 96/164 2023-12-12T09:41:24.484 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : luarocks-3.9.2-1.el9.noarch 97/164 2023-12-12T09:41:24.518 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 98/164 2023-12-12T09:41:24.561 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : libuuid-devel-2.37.4-15.el9.x86_64 99/164 2023-12-12T09:41:24.579 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-rsa-4.9-2.el9.noarch 34/164 2023-12-12T09:41:24.678 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 35/164 2023-12-12T09:41:24.724 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-jinja2-2.11.3-4.el9.noarch 36/164 2023-12-12T09:41:24.772 INFO:teuthology.orchestra.run.smithi142.stdout: Upgrading : elfutils-libs-0.190-1.el9.x86_64 37/164 2023-12-12T09:41:24.811 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : librados-devel-2:19.0.0-96.gf1fbf3c5.el9.x86_64 38/164 2023-12-12T09:41:24.871 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 39/164 2023-12-12T09:41:24.993 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 100/164 2023-12-12T09:41:25.059 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 40/164 2023-12-12T09:41:25.107 INFO:teuthology.orchestra.run.smithi142.stdout: Upgrading : openssl-1:3.0.7-25.el9.x86_64 41/164 2023-12-12T09:41:25.247 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : re2-1:20211101-3.el9.x86_64 42/164 2023-12-12T09:41:25.293 INFO:teuthology.orchestra.run.smithi073.stdout: Upgrading : librbd1-2:19.0.0-96.gf1fbf3c5.el9.x86_64 101/164 2023-12-12T09:41:25.442 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: librbd1-2:19.0.0-96.gf1fbf3c5.el9.x86_64 101/164 2023-12-12T09:41:25.482 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-rbd-2:19.0.0-96.gf1fbf3c5.el9.x86_64 102/164 2023-12-12T09:41:25.504 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : libarrow-9.0.0-10.el9.x86_64 43/164 2023-12-12T09:41:25.546 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 103/164 2023-12-12T09:41:25.587 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 44/164 2023-12-12T09:41:25.693 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 45/164 2023-12-12T09:41:25.754 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 46/164 2023-12-12T09:41:25.797 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 47/164 2023-12-12T09:41:25.865 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 48/164 2023-12-12T09:41:25.927 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 49/164 2023-12-12T09:41:25.987 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 50/164 2023-12-12T09:41:26.075 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : parquet-libs-9.0.0-10.el9.x86_64 104/164 2023-12-12T09:41:26.102 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : librgw2-2:19.0.0-96.gf1fbf3c5.el9.x86_64 105/164 2023-12-12T09:41:26.175 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 51/164 2023-12-12T09:41:26.194 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: librgw2-2:19.0.0-96.gf1fbf3c5.el9.x86_64 105/164 2023-12-12T09:41:26.217 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 52/164 2023-12-12T09:41:26.246 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-rgw-2:19.0.0-96.gf1fbf3c5.el9.x86_64 106/164 2023-12-12T09:41:26.262 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 53/164 2023-12-12T09:41:26.388 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 54/164 2023-12-12T09:41:26.418 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-google-auth-1:2.23.4-1.el9.noarch 55/164 2023-12-12T09:41:26.473 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 56/164 2023-12-12T09:41:26.508 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 57/164 2023-12-12T09:41:26.659 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : libarrow-doc-9.0.0-10.el9.noarch 58/164 2023-12-12T09:41:26.712 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-devel-3.9.17-2.el9.x86_64 59/164 2023-12-12T09:41:26.781 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-ply-3.11-14.el9.noarch 60/164 2023-12-12T09:41:26.861 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 61/164 2023-12-12T09:41:27.128 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 62/164 2023-12-12T09:41:27.182 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 63/164 2023-12-12T09:41:27.358 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 64/164 2023-12-12T09:41:27.411 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-asyncssh-2.13.2-3.el9.noarch 65/164 2023-12-12T09:41:27.435 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-jwt-2.4.0-1.el9.noarch 66/164 2023-12-12T09:41:27.473 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-jwt+crypto-2.4.0-1.el9.noarch 67/164 2023-12-12T09:41:27.518 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 68/164 2023-12-12T09:41:27.563 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : fuse-2.9.9-15.el9.x86_64 69/164 2023-12-12T09:41:27.607 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : zlib-devel-1.2.11-40.el9.x86_64 70/164 2023-12-12T09:41:27.664 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 71/164 2023-12-12T09:41:27.732 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : uuid-1.6.2-55.el9.x86_64 72/164 2023-12-12T09:41:27.781 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 73/164 2023-12-12T09:41:27.947 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 74/164 2023-12-12T09:41:28.329 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 75/164 2023-12-12T09:41:28.373 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 76/164 2023-12-12T09:41:28.440 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 77/164 2023-12-12T09:41:28.481 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 78/164 2023-12-12T09:41:28.588 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 79/164 2023-12-12T09:41:28.627 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 80/164 2023-12-12T09:41:28.755 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 81/164 2023-12-12T09:41:28.755 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: ceph-common-2:19.0.0-96.gf1fbf3c5.el9.x86_64 107/164 2023-12-12T09:41:28.793 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-common-2:19.0.0-96.gf1fbf3c5.el9.x86_64 107/164 2023-12-12T09:41:28.817 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 82/164 2023-12-12T09:41:29.438 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: ceph-common-2:19.0.0-96.gf1fbf3c5.el9.x86_64 107/164 2023-12-12T09:41:29.479 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-base-2:19.0.0-96.gf1fbf3c5.el9.x86_64 108/164 2023-12-12T09:41:29.670 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: ceph-base-2:19.0.0-96.gf1fbf3c5.el9.x86_64 108/164 2023-12-12T09:41:29.671 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2023-12-12T09:41:29.671 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2023-12-12T09:41:29.671 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-12T09:41:29.714 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-selinux-2:19.0.0-96.gf1fbf3c5.el9.x86_64 109/164 2023-12-12T09:41:29.766 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 83/164 2023-12-12T09:41:29.824 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 84/164 2023-12-12T09:41:29.859 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 85/164 2023-12-12T09:41:29.884 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 86/164 2023-12-12T09:41:30.097 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : openblas-0.3.21-2.el9.x86_64 87/164 2023-12-12T09:41:30.121 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 88/164 2023-12-12T09:41:30.222 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 89/164 2023-12-12T09:41:31.025 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 90/164 2023-12-12T09:41:31.156 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 91/164 2023-12-12T09:41:32.692 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 92/164 2023-12-12T09:41:32.790 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 93/164 2023-12-12T09:41:32.838 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : oniguruma-6.9.6-1.el9.5.x86_64 94/164 2023-12-12T09:41:32.884 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : jq-1.6-16.el9.x86_64 95/164 2023-12-12T09:41:33.003 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : lua-5.4.4-4.el9.x86_64 96/164 2023-12-12T09:41:33.044 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : luarocks-3.9.2-1.el9.noarch 97/164 2023-12-12T09:41:33.085 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 98/164 2023-12-12T09:41:33.128 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : libuuid-devel-2.37.4-15.el9.x86_64 99/164 2023-12-12T09:41:33.509 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 100/164 2023-12-12T09:41:33.542 INFO:teuthology.orchestra.run.smithi142.stdout: Upgrading : librbd1-2:19.0.0-96.gf1fbf3c5.el9.x86_64 101/164 2023-12-12T09:41:33.665 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: librbd1-2:19.0.0-96.gf1fbf3c5.el9.x86_64 101/164 2023-12-12T09:41:33.698 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-rbd-2:19.0.0-96.gf1fbf3c5.el9.x86_64 102/164 2023-12-12T09:41:33.752 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 103/164 2023-12-12T09:41:34.280 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : parquet-libs-9.0.0-10.el9.x86_64 104/164 2023-12-12T09:41:34.312 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : librgw2-2:19.0.0-96.gf1fbf3c5.el9.x86_64 105/164 2023-12-12T09:41:34.404 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: librgw2-2:19.0.0-96.gf1fbf3c5.el9.x86_64 105/164 2023-12-12T09:41:34.431 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-rgw-2:19.0.0-96.gf1fbf3c5.el9.x86_64 106/164 2023-12-12T09:41:36.839 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-common-2:19.0.0-96.gf1fbf3c5.el9.x86_64 107/164 2023-12-12T09:41:36.877 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-common-2:19.0.0-96.gf1fbf3c5.el9.x86_64 107/164 2023-12-12T09:41:37.514 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-common-2:19.0.0-96.gf1fbf3c5.el9.x86_64 107/164 2023-12-12T09:41:37.564 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-base-2:19.0.0-96.gf1fbf3c5.el9.x86_64 108/164 2023-12-12T09:41:37.710 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-base-2:19.0.0-96.gf1fbf3c5.el9.x86_64 108/164 2023-12-12T09:41:37.710 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2023-12-12T09:41:37.710 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2023-12-12T09:41:37.710 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-12-12T09:41:37.748 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-selinux-2:19.0.0-96.gf1fbf3c5.el9.x86_64 109/164 2023-12-12T09:41:42.323 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: ceph-selinux-2:19.0.0-96.gf1fbf3c5.el9.x86_64 109/164 2023-12-12T09:41:42.323 INFO:teuthology.orchestra.run.smithi073.stdout:skipping the directory /sys 2023-12-12T09:41:42.323 INFO:teuthology.orchestra.run.smithi073.stdout:skipping the directory /proc 2023-12-12T09:41:42.323 INFO:teuthology.orchestra.run.smithi073.stdout:skipping the directory /mnt 2023-12-12T09:41:42.323 INFO:teuthology.orchestra.run.smithi073.stdout:skipping the directory /var/tmp 2023-12-12T09:41:42.323 INFO:teuthology.orchestra.run.smithi073.stdout:skipping the directory /home 2023-12-12T09:41:42.323 INFO:teuthology.orchestra.run.smithi073.stdout:skipping the directory /root 2023-12-12T09:41:42.323 INFO:teuthology.orchestra.run.smithi073.stdout:skipping the directory /tmp 2023-12-12T09:41:42.323 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-12T09:41:42.535 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-volume-2:19.0.0-96.gf1fbf3c5.el9.noarch 110/164 2023-12-12T09:41:42.583 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: ceph-volume-2:19.0.0-96.gf1fbf3c5.el9.noarch 110/164 2023-12-12T09:41:42.583 INFO:teuthology.orchestra.run.smithi073.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-12T09:41:42.583 INFO:teuthology.orchestra.run.smithi073.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2023-12-12T09:41:42.584 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-12T09:41:44.254 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-osd-2:19.0.0-96.gf1fbf3c5.el9.x86_64 111/164 2023-12-12T09:41:44.344 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: ceph-osd-2:19.0.0-96.gf1fbf3c5.el9.x86_64 111/164 2023-12-12T09:41:44.344 INFO:teuthology.orchestra.run.smithi073.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-12T09:41:44.344 INFO:teuthology.orchestra.run.smithi073.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2023-12-12T09:41:44.345 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2023-12-12T09:41:44.345 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2023-12-12T09:41:44.345 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-12T09:41:44.571 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-mds-2:19.0.0-96.gf1fbf3c5.el9.x86_64 112/164 2023-12-12T09:41:44.653 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: ceph-mds-2:19.0.0-96.gf1fbf3c5.el9.x86_64 112/164 2023-12-12T09:41:44.653 INFO:teuthology.orchestra.run.smithi073.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-12T09:41:44.654 INFO:teuthology.orchestra.run.smithi073.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2023-12-12T09:41:44.654 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2023-12-12T09:41:44.654 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2023-12-12T09:41:44.654 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-12T09:41:45.147 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-mon-2:19.0.0-96.gf1fbf3c5.el9.x86_64 113/164 2023-12-12T09:41:45.218 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: ceph-mon-2:19.0.0-96.gf1fbf3c5.el9.x86_64 113/164 2023-12-12T09:41:45.218 INFO:teuthology.orchestra.run.smithi073.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-12T09:41:45.218 INFO:teuthology.orchestra.run.smithi073.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2023-12-12T09:41:45.218 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2023-12-12T09:41:45.218 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2023-12-12T09:41:45.218 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-12T09:41:45.332 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : automake-1.16.2-8.el9.noarch 114/164 2023-12-12T09:41:45.899 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: cephadm-2:19.0.0-96.gf1fbf3c5.el9.noarch 115/164 2023-12-12T09:41:45.941 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : cephadm-2:19.0.0-96.gf1fbf3c5.el9.noarch 115/164 2023-12-12T09:41:45.985 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-96.gf1fbf3c5.el9 116/164 2023-12-12T09:41:46.091 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-96.gf1fbf3c5.el 117/164 2023-12-12T09:41:46.121 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-96.gf1fbf3c5.el9.noarc 118/164 2023-12-12T09:41:46.445 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-96.gf1fbf3c5.el9.noarc 118/164 2023-12-12T09:41:46.480 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-96.gf1fbf3c5.el9.noa 119/164 2023-12-12T09:41:47.610 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-96.gf1fbf3c5.el9.noa 119/164 2023-12-12T09:41:47.639 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-96.gf1fbf 120/164 2023-12-12T09:41:47.779 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-96.gf1fbf 120/164 2023-12-12T09:41:47.946 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-96.gf1fbf3c5.el9. 121/164 2023-12-12T09:41:47.982 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-mgr-2:19.0.0-96.gf1fbf3c5.el9.x86_64 122/164 2023-12-12T09:41:48.063 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: ceph-mgr-2:19.0.0-96.gf1fbf3c5.el9.x86_64 122/164 2023-12-12T09:41:48.063 INFO:teuthology.orchestra.run.smithi073.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-12T09:41:48.063 INFO:teuthology.orchestra.run.smithi073.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2023-12-12T09:41:48.063 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2023-12-12T09:41:48.063 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2023-12-12T09:41:48.063 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-12T09:41:48.117 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-mgr-rook-2:19.0.0-96.gf1fbf3c5.el9.noarch 123/164 2023-12-12T09:41:48.155 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-96.gf1fbf3c5.el9.noarch 123/164 2023-12-12T09:41:48.241 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-2:19.0.0-96.gf1fbf3c5.el9.x86_64 124/164 2023-12-12T09:41:49.086 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : libtool-2.4.6-45.el9.x86_64 125/164 2023-12-12T09:41:49.152 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-radosgw-2:19.0.0-96.gf1fbf3c5.el9.x86_64 126/164 2023-12-12T09:41:49.243 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-96.gf1fbf3c5.el9.x86_64 126/164 2023-12-12T09:41:49.243 INFO:teuthology.orchestra.run.smithi073.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-12T09:41:49.243 INFO:teuthology.orchestra.run.smithi073.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2023-12-12T09:41:49.243 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2023-12-12T09:41:49.243 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2023-12-12T09:41:49.243 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-12T09:41:49.302 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-96.gf1fbf3c 127/164 2023-12-12T09:41:49.375 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-96.gf1fbf3c 127/164 2023-12-12T09:41:49.375 INFO:teuthology.orchestra.run.smithi073.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-12T09:41:49.375 INFO:teuthology.orchestra.run.smithi073.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2023-12-12T09:41:49.376 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-12T09:41:49.437 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : cephfs-mirror-2:19.0.0-96.gf1fbf3c5.el9.x86_64 128/164 2023-12-12T09:41:49.540 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-96.gf1fbf3c5.el9.x86_64 128/164 2023-12-12T09:41:49.540 INFO:teuthology.orchestra.run.smithi073.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-12T09:41:49.540 INFO:teuthology.orchestra.run.smithi073.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2023-12-12T09:41:49.540 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2023-12-12T09:41:49.540 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2023-12-12T09:41:49.540 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-12T09:41:49.904 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : rbd-mirror-2:19.0.0-96.gf1fbf3c5.el9.x86_64 129/164 2023-12-12T09:41:50.006 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: rbd-mirror-2:19.0.0-96.gf1fbf3c5.el9.x86_64 129/164 2023-12-12T09:41:50.006 INFO:teuthology.orchestra.run.smithi073.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-12T09:41:50.007 INFO:teuthology.orchestra.run.smithi073.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2023-12-12T09:41:50.007 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2023-12-12T09:41:50.007 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2023-12-12T09:41:50.007 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-12T09:41:50.282 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-selinux-2:19.0.0-96.gf1fbf3c5.el9.x86_64 109/164 2023-12-12T09:41:50.282 INFO:teuthology.orchestra.run.smithi142.stdout:skipping the directory /sys 2023-12-12T09:41:50.282 INFO:teuthology.orchestra.run.smithi142.stdout:skipping the directory /proc 2023-12-12T09:41:50.282 INFO:teuthology.orchestra.run.smithi142.stdout:skipping the directory /mnt 2023-12-12T09:41:50.282 INFO:teuthology.orchestra.run.smithi142.stdout:skipping the directory /var/tmp 2023-12-12T09:41:50.282 INFO:teuthology.orchestra.run.smithi142.stdout:skipping the directory /home 2023-12-12T09:41:50.282 INFO:teuthology.orchestra.run.smithi142.stdout:skipping the directory /root 2023-12-12T09:41:50.282 INFO:teuthology.orchestra.run.smithi142.stdout:skipping the directory /tmp 2023-12-12T09:41:50.282 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-12-12T09:41:50.500 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-volume-2:19.0.0-96.gf1fbf3c5.el9.noarch 110/164 2023-12-12T09:41:50.550 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-volume-2:19.0.0-96.gf1fbf3c5.el9.noarch 110/164 2023-12-12T09:41:50.550 INFO:teuthology.orchestra.run.smithi142.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-12T09:41:50.550 INFO:teuthology.orchestra.run.smithi142.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2023-12-12T09:41:50.550 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-12-12T09:41:52.288 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-osd-2:19.0.0-96.gf1fbf3c5.el9.x86_64 111/164 2023-12-12T09:41:52.368 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-osd-2:19.0.0-96.gf1fbf3c5.el9.x86_64 111/164 2023-12-12T09:41:52.369 INFO:teuthology.orchestra.run.smithi142.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-12T09:41:52.369 INFO:teuthology.orchestra.run.smithi142.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2023-12-12T09:41:52.369 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2023-12-12T09:41:52.369 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2023-12-12T09:41:52.369 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-12-12T09:41:52.597 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-mds-2:19.0.0-96.gf1fbf3c5.el9.x86_64 112/164 2023-12-12T09:41:52.673 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-mds-2:19.0.0-96.gf1fbf3c5.el9.x86_64 112/164 2023-12-12T09:41:52.673 INFO:teuthology.orchestra.run.smithi142.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-12T09:41:52.674 INFO:teuthology.orchestra.run.smithi142.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2023-12-12T09:41:52.674 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2023-12-12T09:41:52.674 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2023-12-12T09:41:52.674 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-12-12T09:41:53.158 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-mon-2:19.0.0-96.gf1fbf3c5.el9.x86_64 113/164 2023-12-12T09:41:53.226 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-mon-2:19.0.0-96.gf1fbf3c5.el9.x86_64 113/164 2023-12-12T09:41:53.227 INFO:teuthology.orchestra.run.smithi142.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-12T09:41:53.227 INFO:teuthology.orchestra.run.smithi142.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2023-12-12T09:41:53.227 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2023-12-12T09:41:53.227 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2023-12-12T09:41:53.227 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-12-12T09:41:53.341 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : automake-1.16.2-8.el9.noarch 114/164 2023-12-12T09:41:53.994 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: cephadm-2:19.0.0-96.gf1fbf3c5.el9.noarch 115/164 2023-12-12T09:41:54.025 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : cephadm-2:19.0.0-96.gf1fbf3c5.el9.noarch 115/164 2023-12-12T09:41:54.069 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-96.gf1fbf3c5.el9 116/164 2023-12-12T09:41:54.125 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-test-2:19.0.0-96.gf1fbf3c5.el9.x86_64 130/164 2023-12-12T09:41:54.163 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-96.gf1fbf3c5.el 117/164 2023-12-12T09:41:54.180 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : rbd-fuse-2:19.0.0-96.gf1fbf3c5.el9.x86_64 131/164 2023-12-12T09:41:54.196 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-96.gf1fbf3c5.el9.noarc 118/164 2023-12-12T09:41:54.236 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : rbd-nbd-2:19.0.0-96.gf1fbf3c5.el9.x86_64 132/164 2023-12-12T09:41:54.275 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : xfsprogs-devel-5.19.0-4.el9.x86_64 133/164 2023-12-12T09:41:54.515 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-96.gf1fbf3c5.el9.noarc 118/164 2023-12-12T09:41:54.547 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-96.gf1fbf3c5.el9.noa 119/164 2023-12-12T09:41:54.582 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : elfutils-libelf-devel-0.190-1.el9.x86_64 134/164 2023-12-12T09:41:54.706 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : postgresql-contrib-13.11-1.el9.x86_64 135/164 2023-12-12T09:41:54.737 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-fuse-2:19.0.0-96.gf1fbf3c5.el9.x86_64 136/164 2023-12-12T09:41:54.802 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : libcephfs-devel-2:19.0.0-96.gf1fbf3c5.el9.x86_64 137/164 2023-12-12T09:41:54.892 INFO:teuthology.orchestra.run.smithi073.stdout: Upgrading : elfutils-debuginfod-client-0.190-1.el9.x86_64 138/164 2023-12-12T09:41:54.960 INFO:teuthology.orchestra.run.smithi073.stdout: Upgrading : libacl-devel-2.3.1-4.el9.x86_64 139/164 2023-12-12T09:41:55.001 INFO:teuthology.orchestra.run.smithi073.stdout: Upgrading : acl-2.3.1-4.el9.x86_64 140/164 2023-12-12T09:41:55.054 INFO:teuthology.orchestra.run.smithi073.stdout: Upgrading : NetworkManager-team-1:1.45.7-1.el9.x86_64 141/164 2023-12-12T09:41:55.100 INFO:teuthology.orchestra.run.smithi073.stdout: Upgrading : NetworkManager-tui-1:1.45.7-1.el9.x86_64 142/164 2023-12-12T09:41:55.671 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-96.gf1fbf3c5.el9.noa 119/164 2023-12-12T09:41:55.697 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-96.gf1fbf 120/164 2023-12-12T09:41:55.837 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-96.gf1fbf 120/164 2023-12-12T09:41:56.004 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-96.gf1fbf3c5.el9. 121/164 2023-12-12T09:41:56.034 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-mgr-2:19.0.0-96.gf1fbf3c5.el9.x86_64 122/164 2023-12-12T09:41:56.103 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-mgr-2:19.0.0-96.gf1fbf3c5.el9.x86_64 122/164 2023-12-12T09:41:56.103 INFO:teuthology.orchestra.run.smithi142.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-12T09:41:56.103 INFO:teuthology.orchestra.run.smithi142.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2023-12-12T09:41:56.103 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2023-12-12T09:41:56.104 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2023-12-12T09:41:56.104 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-12-12T09:41:56.104 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: postgresql-server-13.11-1.el9.x86_64 143/164 2023-12-12T09:41:56.148 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : postgresql-server-13.11-1.el9.x86_64 143/164 2023-12-12T09:41:56.158 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-mgr-rook-2:19.0.0-96.gf1fbf3c5.el9.noarch 123/164 2023-12-12T09:41:56.198 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-96.gf1fbf3c5.el9.noarch 123/164 2023-12-12T09:41:56.204 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: postgresql-server-13.11-1.el9.x86_64 143/164 2023-12-12T09:41:56.281 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-2:19.0.0-96.gf1fbf3c5.el9.x86_64 124/164 2023-12-12T09:41:57.131 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : libtool-2.4.6-45.el9.x86_64 125/164 2023-12-12T09:41:57.168 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-radosgw-2:19.0.0-96.gf1fbf3c5.el9.x86_64 126/164 2023-12-12T09:41:57.243 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-96.gf1fbf3c5.el9.x86_64 126/164 2023-12-12T09:41:57.243 INFO:teuthology.orchestra.run.smithi142.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-12T09:41:57.243 INFO:teuthology.orchestra.run.smithi142.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2023-12-12T09:41:57.243 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2023-12-12T09:41:57.243 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2023-12-12T09:41:57.243 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-12-12T09:41:57.286 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-96.gf1fbf3c 127/164 2023-12-12T09:41:57.352 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-96.gf1fbf3c 127/164 2023-12-12T09:41:57.352 INFO:teuthology.orchestra.run.smithi142.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-12T09:41:57.353 INFO:teuthology.orchestra.run.smithi142.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2023-12-12T09:41:57.353 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-12-12T09:41:57.411 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : cephfs-mirror-2:19.0.0-96.gf1fbf3c5.el9.x86_64 128/164 2023-12-12T09:41:57.491 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-96.gf1fbf3c5.el9.x86_64 128/164 2023-12-12T09:41:57.519 INFO:teuthology.orchestra.run.smithi142.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-12T09:41:57.519 INFO:teuthology.orchestra.run.smithi142.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2023-12-12T09:41:57.519 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2023-12-12T09:41:57.519 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2023-12-12T09:41:57.519 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-12-12T09:41:57.527 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : cephfs-top-2:19.0.0-96.gf1fbf3c5.el9.noarch 144/164 2023-12-12T09:41:57.664 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : openssl-devel-1:3.0.7-25.el9.x86_64 145/164 2023-12-12T09:41:57.719 INFO:teuthology.orchestra.run.smithi073.stdout: Upgrading : xfsdump-3.1.12-4.el9.x86_64 146/164 2023-12-12T09:41:57.799 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 147/164 2023-12-12T09:41:57.845 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : rbd-mirror-2:19.0.0-96.gf1fbf3c5.el9.x86_64 129/164 2023-12-12T09:41:57.928 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: rbd-mirror-2:19.0.0-96.gf1fbf3c5.el9.x86_64 129/164 2023-12-12T09:41:57.928 INFO:teuthology.orchestra.run.smithi142.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-12T09:41:57.928 INFO:teuthology.orchestra.run.smithi142.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2023-12-12T09:41:57.928 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2023-12-12T09:41:57.928 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2023-12-12T09:41:57.928 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-12-12T09:41:57.960 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : flex-2.6.4-9.el9.x86_64 148/164 2023-12-12T09:41:58.031 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : bison-3.7.4-5.el9.x86_64 149/164 2023-12-12T09:41:58.057 INFO:teuthology.orchestra.run.smithi073.stdout: Cleanup : NetworkManager-tui-1:1.44.0-2.el9.x86_64 150/164 2023-12-12T09:41:58.100 INFO:teuthology.orchestra.run.smithi073.stdout: Cleanup : elfutils-debuginfod-client-0.189-3.el9.x86_64 151/164 2023-12-12T09:41:58.142 INFO:teuthology.orchestra.run.smithi073.stdout: Cleanup : elfutils-libs-0.189-3.el9.x86_64 152/164 2023-12-12T09:41:58.143 INFO:teuthology.orchestra.run.smithi073.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 153/164 2023-12-12T09:41:58.282 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 153/164 2023-12-12T09:41:58.333 INFO:teuthology.orchestra.run.smithi073.stdout: Cleanup : libacl-devel-2.3.1-3.el9.x86_64 154/164 2023-12-12T09:41:58.402 INFO:teuthology.orchestra.run.smithi073.stdout: Cleanup : openssl-1:3.0.7-24.el9.x86_64 155/164 2023-12-12T09:41:58.444 INFO:teuthology.orchestra.run.smithi073.stdout: Cleanup : acl-2.3.1-3.el9.x86_64 156/164 2023-12-12T09:41:58.445 INFO:teuthology.orchestra.run.smithi073.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 157/164 2023-12-12T09:41:58.582 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 157/164 2023-12-12T09:41:58.604 INFO:teuthology.orchestra.run.smithi073.stdout: Cleanup : NetworkManager-team-1:1.44.0-2.el9.x86_64 158/164 2023-12-12T09:41:58.644 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 159/164 2023-12-12T09:41:58.645 INFO:teuthology.orchestra.run.smithi073.stdout: Cleanup : NetworkManager-1:1.44.0-2.el9.x86_64 159/164 2023-12-12T09:41:58.970 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 159/164 2023-12-12T09:41:58.970 INFO:teuthology.orchestra.run.smithi073.stdout: Cleanup : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 160/164 2023-12-12T09:41:59.104 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: NetworkManager-libnm-1:1.44.0-2.el9.x86_64 160/164 2023-12-12T09:41:59.140 INFO:teuthology.orchestra.run.smithi073.stdout: Cleanup : openssl-libs-1:3.0.7-24.el9.x86_64 161/164 2023-12-12T09:41:59.173 INFO:teuthology.orchestra.run.smithi073.stdout: Cleanup : libacl-2.3.1-3.el9.x86_64 162/164 2023-12-12T09:41:59.224 INFO:teuthology.orchestra.run.smithi073.stdout: Cleanup : elfutils-libelf-0.189-3.el9.x86_64 163/164 2023-12-12T09:41:59.343 INFO:teuthology.orchestra.run.smithi073.stdout: Cleanup : xfsdump-3.1.12-3.el9.x86_64 164/164 2023-12-12T09:41:59.611 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: xfsdump-3.1.12-3.el9.x86_64 164/164 2023-12-12T09:41:59.612 INFO:teuthology.orchestra.run.smithi073.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2023-12-12T09:41:59.612 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-12T09:42:02.059 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-test-2:19.0.0-96.gf1fbf3c5.el9.x86_64 130/164 2023-12-12T09:42:02.123 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : rbd-fuse-2:19.0.0-96.gf1fbf3c5.el9.x86_64 131/164 2023-12-12T09:42:02.178 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : rbd-nbd-2:19.0.0-96.gf1fbf3c5.el9.x86_64 132/164 2023-12-12T09:42:02.217 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : xfsprogs-devel-5.19.0-4.el9.x86_64 133/164 2023-12-12T09:42:02.494 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : elfutils-libelf-devel-0.190-1.el9.x86_64 134/164 2023-12-12T09:42:02.621 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : postgresql-contrib-13.11-1.el9.x86_64 135/164 2023-12-12T09:42:02.654 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-fuse-2:19.0.0-96.gf1fbf3c5.el9.x86_64 136/164 2023-12-12T09:42:02.694 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : libcephfs-devel-2:19.0.0-96.gf1fbf3c5.el9.x86_64 137/164 2023-12-12T09:42:02.788 INFO:teuthology.orchestra.run.smithi142.stdout: Upgrading : elfutils-debuginfod-client-0.190-1.el9.x86_64 138/164 2023-12-12T09:42:02.858 INFO:teuthology.orchestra.run.smithi142.stdout: Upgrading : libacl-devel-2.3.1-4.el9.x86_64 139/164 2023-12-12T09:42:02.907 INFO:teuthology.orchestra.run.smithi142.stdout: Upgrading : acl-2.3.1-4.el9.x86_64 140/164 2023-12-12T09:42:02.959 INFO:teuthology.orchestra.run.smithi142.stdout: Upgrading : NetworkManager-team-1:1.45.7-1.el9.x86_64 141/164 2023-12-12T09:42:03.006 INFO:teuthology.orchestra.run.smithi142.stdout: Upgrading : NetworkManager-tui-1:1.45.7-1.el9.x86_64 142/164 2023-12-12T09:42:03.910 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: postgresql-server-13.11-1.el9.x86_64 143/164 2023-12-12T09:42:03.962 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : postgresql-server-13.11-1.el9.x86_64 143/164 2023-12-12T09:42:04.022 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: postgresql-server-13.11-1.el9.x86_64 143/164 2023-12-12T09:42:04.546 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-2:19.0.0-96.gf1fbf3c5.el9.x86_64 1/164 2023-12-12T09:42:04.547 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-base-2:19.0.0-96.gf1fbf3c5.el9.x86_64 2/164 2023-12-12T09:42:04.547 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-common-2:19.0.0-96.gf1fbf3c5.el9.x86_64 3/164 2023-12-12T09:42:04.547 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-fuse-2:19.0.0-96.gf1fbf3c5.el9.x86_64 4/164 2023-12-12T09:42:04.547 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-96.gf1fbf3c 5/164 2023-12-12T09:42:04.547 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-mds-2:19.0.0-96.gf1fbf3c5.el9.x86_64 6/164 2023-12-12T09:42:04.547 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-mgr-2:19.0.0-96.gf1fbf3c5.el9.x86_64 7/164 2023-12-12T09:42:04.547 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-mon-2:19.0.0-96.gf1fbf3c5.el9.x86_64 8/164 2023-12-12T09:42:04.547 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-osd-2:19.0.0-96.gf1fbf3c5.el9.x86_64 9/164 2023-12-12T09:42:04.547 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-radosgw-2:19.0.0-96.gf1fbf3c5.el9.x86_64 10/164 2023-12-12T09:42:04.547 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-selinux-2:19.0.0-96.gf1fbf3c5.el9.x86_64 11/164 2023-12-12T09:42:04.547 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-test-2:19.0.0-96.gf1fbf3c5.el9.x86_64 12/164 2023-12-12T09:42:04.547 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : cephfs-mirror-2:19.0.0-96.gf1fbf3c5.el9.x86_64 13/164 2023-12-12T09:42:04.548 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libcephfs-devel-2:19.0.0-96.gf1fbf3c5.el9.x86_64 14/164 2023-12-12T09:42:04.548 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libcephfs2-2:19.0.0-96.gf1fbf3c5.el9.x86_64 15/164 2023-12-12T09:42:04.548 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libcephsqlite-2:19.0.0-96.gf1fbf3c5.el9.x86_64 16/164 2023-12-12T09:42:04.548 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : librados-devel-2:19.0.0-96.gf1fbf3c5.el9.x86_64 17/164 2023-12-12T09:42:04.548 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libradosstriper1-2:19.0.0-96.gf1fbf3c5.el9.x86_6 18/164 2023-12-12T09:42:04.548 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : librgw2-2:19.0.0-96.gf1fbf3c5.el9.x86_64 19/164 2023-12-12T09:42:04.548 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-ceph-argparse-2:19.0.0-96.gf1fbf3c5.el9. 20/164 2023-12-12T09:42:04.548 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-ceph-common-2:19.0.0-96.gf1fbf3c5.el9.x8 21/164 2023-12-12T09:42:04.548 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-cephfs-2:19.0.0-96.gf1fbf3c5.el9.x86_64 22/164 2023-12-12T09:42:04.548 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-rados-2:19.0.0-96.gf1fbf3c5.el9.x86_64 23/164 2023-12-12T09:42:04.548 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-rbd-2:19.0.0-96.gf1fbf3c5.el9.x86_64 24/164 2023-12-12T09:42:04.548 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-rgw-2:19.0.0-96.gf1fbf3c5.el9.x86_64 25/164 2023-12-12T09:42:04.548 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : rbd-fuse-2:19.0.0-96.gf1fbf3c5.el9.x86_64 26/164 2023-12-12T09:42:04.548 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : rbd-mirror-2:19.0.0-96.gf1fbf3c5.el9.x86_64 27/164 2023-12-12T09:42:04.549 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : rbd-nbd-2:19.0.0-96.gf1fbf3c5.el9.x86_64 28/164 2023-12-12T09:42:04.549 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-96.gf1fbf3c5.el 29/164 2023-12-12T09:42:04.549 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-96.gf1fbf3c5.el9.noarc 30/164 2023-12-12T09:42:04.549 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-96.gf1fbf3c5.el9.noa 31/164 2023-12-12T09:42:04.549 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-96.gf1fbf 32/164 2023-12-12T09:42:04.549 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-96.gf1fbf3c5.el9. 33/164 2023-12-12T09:42:04.549 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-mgr-rook-2:19.0.0-96.gf1fbf3c5.el9.noarch 34/164 2023-12-12T09:42:04.563 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-96.gf1fbf3c5.el9 35/164 2023-12-12T09:42:04.563 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-volume-2:19.0.0-96.gf1fbf3c5.el9.noarch 36/164 2023-12-12T09:42:04.563 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : cephadm-2:19.0.0-96.gf1fbf3c5.el9.noarch 37/164 2023-12-12T09:42:04.563 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : cephfs-top-2:19.0.0-96.gf1fbf3c5.el9.noarch 38/164 2023-12-12T09:42:04.563 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : automake-1.16.2-8.el9.noarch 39/164 2023-12-12T09:42:04.563 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : bison-3.7.4-5.el9.x86_64 40/164 2023-12-12T09:42:04.563 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 41/164 2023-12-12T09:42:04.563 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : elfutils-libelf-devel-0.190-1.el9.x86_64 42/164 2023-12-12T09:42:04.563 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : flex-2.6.4-9.el9.x86_64 43/164 2023-12-12T09:42:04.564 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 44/164 2023-12-12T09:42:04.564 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 45/164 2023-12-12T09:42:04.564 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 46/164 2023-12-12T09:42:04.564 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : jq-1.6-16.el9.x86_64 47/164 2023-12-12T09:42:04.564 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 48/164 2023-12-12T09:42:04.564 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 49/164 2023-12-12T09:42:04.564 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 50/164 2023-12-12T09:42:04.564 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 51/164 2023-12-12T09:42:04.564 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 52/164 2023-12-12T09:42:04.564 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libuuid-devel-2.37.4-15.el9.x86_64 53/164 2023-12-12T09:42:04.564 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 54/164 2023-12-12T09:42:04.564 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 55/164 2023-12-12T09:42:04.565 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : lua-5.4.4-4.el9.x86_64 56/164 2023-12-12T09:42:04.565 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : oniguruma-6.9.6-1.el9.5.x86_64 57/164 2023-12-12T09:42:04.565 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 58/164 2023-12-12T09:42:04.565 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 59/164 2023-12-12T09:42:04.565 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : postgresql-13.11-1.el9.x86_64 60/164 2023-12-12T09:42:04.565 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : postgresql-contrib-13.11-1.el9.x86_64 61/164 2023-12-12T09:42:04.565 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : postgresql-private-libs-13.11-1.el9.x86_64 62/164 2023-12-12T09:42:04.565 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : postgresql-server-13.11-1.el9.x86_64 63/164 2023-12-12T09:42:04.565 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 64/164 2023-12-12T09:42:04.565 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-jinja2-2.11.3-4.el9.noarch 65/164 2023-12-12T09:42:04.565 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 66/164 2023-12-12T09:42:04.565 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 67/164 2023-12-12T09:42:04.565 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 68/164 2023-12-12T09:42:04.565 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 69/164 2023-12-12T09:42:04.566 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 70/164 2023-12-12T09:42:04.566 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 71/164 2023-12-12T09:42:04.566 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 72/164 2023-12-12T09:42:04.566 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 73/164 2023-12-12T09:42:04.566 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 74/164 2023-12-12T09:42:04.566 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 75/164 2023-12-12T09:42:04.566 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 76/164 2023-12-12T09:42:04.566 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 77/164 2023-12-12T09:42:04.566 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 78/164 2023-12-12T09:42:04.566 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 79/164 2023-12-12T09:42:04.566 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 80/164 2023-12-12T09:42:04.566 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 81/164 2023-12-12T09:42:04.566 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : xfsprogs-devel-5.19.0-4.el9.x86_64 82/164 2023-12-12T09:42:04.567 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 83/164 2023-12-12T09:42:04.567 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : zlib-devel-1.2.11-40.el9.x86_64 84/164 2023-12-12T09:42:04.567 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 85/164 2023-12-12T09:42:04.567 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libgfortran-11.4.1-2.3.el9.x86_64 86/164 2023-12-12T09:42:04.567 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libquadmath-11.4.1-2.3.el9.x86_64 87/164 2023-12-12T09:42:04.567 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 88/164 2023-12-12T09:42:04.567 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 89/164 2023-12-12T09:42:04.567 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-ply-3.11-14.el9.noarch 90/164 2023-12-12T09:42:04.567 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 91/164 2023-12-12T09:42:04.567 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-requests-2.25.1-7.el9.noarch 92/164 2023-12-12T09:42:04.567 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-urllib3-1.26.5-4.el9.noarch 93/164 2023-12-12T09:42:04.567 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : openssl-devel-1:3.0.7-25.el9.x86_64 94/164 2023-12-12T09:42:04.567 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 95/164 2023-12-12T09:42:04.567 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 96/164 2023-12-12T09:42:04.568 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libarrow-9.0.0-10.el9.x86_64 97/164 2023-12-12T09:42:04.568 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libarrow-doc-9.0.0-10.el9.noarch 98/164 2023-12-12T09:42:04.568 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 99/164 2023-12-12T09:42:04.568 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 100/164 2023-12-12T09:42:04.568 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 101/164 2023-12-12T09:42:04.568 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : parquet-libs-9.0.0-10.el9.x86_64 102/164 2023-12-12T09:42:04.568 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-asyncssh-2.13.2-3.el9.noarch 103/164 2023-12-12T09:42:04.568 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 104/164 2023-12-12T09:42:04.568 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 105/164 2023-12-12T09:42:04.568 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 106/164 2023-12-12T09:42:04.568 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 107/164 2023-12-12T09:42:04.568 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 108/164 2023-12-12T09:42:04.568 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-google-auth-1:2.23.4-1.el9.noarch 109/164 2023-12-12T09:42:04.568 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 110/164 2023-12-12T09:42:04.569 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 111/164 2023-12-12T09:42:04.569 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 112/164 2023-12-12T09:42:04.569 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 113/164 2023-12-12T09:42:04.569 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 114/164 2023-12-12T09:42:04.569 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-jwt+crypto-2.4.0-1.el9.noarch 115/164 2023-12-12T09:42:04.569 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-jwt-2.4.0-1.el9.noarch 116/164 2023-12-12T09:42:04.569 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 117/164 2023-12-12T09:42:04.569 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 118/164 2023-12-12T09:42:04.569 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 119/164 2023-12-12T09:42:04.569 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 120/164 2023-12-12T09:42:04.569 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 121/164 2023-12-12T09:42:04.570 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 122/164 2023-12-12T09:42:04.570 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 123/164 2023-12-12T09:42:04.570 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 124/164 2023-12-12T09:42:04.570 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 125/164 2023-12-12T09:42:04.570 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 126/164 2023-12-12T09:42:04.570 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 127/164 2023-12-12T09:42:04.570 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 128/164 2023-12-12T09:42:04.571 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 129/164 2023-12-12T09:42:04.571 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 130/164 2023-12-12T09:42:04.571 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 131/164 2023-12-12T09:42:04.571 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 132/164 2023-12-12T09:42:04.571 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : re2-1:20211101-3.el9.x86_64 133/164 2023-12-12T09:42:04.571 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 134/164 2023-12-12T09:42:04.571 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : librados2-2:19.0.0-96.gf1fbf3c5.el9.x86_64 135/164 2023-12-12T09:42:04.571 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 136/164 2023-12-12T09:42:04.571 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : librbd1-2:19.0.0-96.gf1fbf3c5.el9.x86_64 137/164 2023-12-12T09:42:04.571 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 138/164 2023-12-12T09:42:04.571 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libacl-devel-2.3.1-4.el9.x86_64 139/164 2023-12-12T09:42:04.571 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libacl-devel-2.3.1-3.el9.x86_64 140/164 2023-12-12T09:42:04.571 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : acl-2.3.1-4.el9.x86_64 141/164 2023-12-12T09:42:04.571 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : acl-2.3.1-3.el9.x86_64 142/164 2023-12-12T09:42:04.572 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : elfutils-debuginfod-client-0.190-1.el9.x86_64 143/164 2023-12-12T09:42:04.572 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : elfutils-debuginfod-client-0.189-3.el9.x86_64 144/164 2023-12-12T09:42:04.572 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : elfutils-libelf-0.190-1.el9.x86_64 145/164 2023-12-12T09:42:04.572 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : elfutils-libelf-0.189-3.el9.x86_64 146/164 2023-12-12T09:42:04.572 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : elfutils-libs-0.190-1.el9.x86_64 147/164 2023-12-12T09:42:04.572 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : elfutils-libs-0.189-3.el9.x86_64 148/164 2023-12-12T09:42:04.572 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libacl-2.3.1-4.el9.x86_64 149/164 2023-12-12T09:42:04.572 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libacl-2.3.1-3.el9.x86_64 150/164 2023-12-12T09:42:04.572 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : xfsdump-3.1.12-4.el9.x86_64 151/164 2023-12-12T09:42:04.573 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : xfsdump-3.1.12-3.el9.x86_64 152/164 2023-12-12T09:42:04.573 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : NetworkManager-1:1.45.7-1.el9.x86_64 153/164 2023-12-12T09:42:04.573 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : NetworkManager-1:1.44.0-2.el9.x86_64 154/164 2023-12-12T09:42:04.573 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : NetworkManager-libnm-1:1.45.7-1.el9.x86_64 155/164 2023-12-12T09:42:04.573 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 156/164 2023-12-12T09:42:04.573 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : NetworkManager-team-1:1.45.7-1.el9.x86_64 157/164 2023-12-12T09:42:04.573 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : NetworkManager-team-1:1.44.0-2.el9.x86_64 158/164 2023-12-12T09:42:04.573 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : NetworkManager-tui-1:1.45.7-1.el9.x86_64 159/164 2023-12-12T09:42:04.573 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : NetworkManager-tui-1:1.44.0-2.el9.x86_64 160/164 2023-12-12T09:42:04.573 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : openssl-1:3.0.7-25.el9.x86_64 161/164 2023-12-12T09:42:04.573 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : openssl-1:3.0.7-24.el9.x86_64 162/164 2023-12-12T09:42:04.573 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : openssl-libs-1:3.0.7-25.el9.x86_64 163/164 2023-12-12T09:42:05.348 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : cephfs-top-2:19.0.0-96.gf1fbf3c5.el9.noarch 144/164 2023-12-12T09:42:05.463 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : openssl-devel-1:3.0.7-25.el9.x86_64 145/164 2023-12-12T09:42:05.524 INFO:teuthology.orchestra.run.smithi142.stdout: Upgrading : xfsdump-3.1.12-4.el9.x86_64 146/164 2023-12-12T09:42:05.586 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 147/164 2023-12-12T09:42:05.730 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : flex-2.6.4-9.el9.x86_64 148/164 2023-12-12T09:42:05.770 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : bison-3.7.4-5.el9.x86_64 149/164 2023-12-12T09:42:05.804 INFO:teuthology.orchestra.run.smithi142.stdout: Cleanup : NetworkManager-tui-1:1.44.0-2.el9.x86_64 150/164 2023-12-12T09:42:05.838 INFO:teuthology.orchestra.run.smithi142.stdout: Cleanup : elfutils-debuginfod-client-0.189-3.el9.x86_64 151/164 2023-12-12T09:42:05.881 INFO:teuthology.orchestra.run.smithi142.stdout: Cleanup : elfutils-libs-0.189-3.el9.x86_64 152/164 2023-12-12T09:42:05.881 INFO:teuthology.orchestra.run.smithi142.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 153/164 2023-12-12T09:42:06.012 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 153/164 2023-12-12T09:42:06.063 INFO:teuthology.orchestra.run.smithi142.stdout: Cleanup : libacl-devel-2.3.1-3.el9.x86_64 154/164 2023-12-12T09:42:06.109 INFO:teuthology.orchestra.run.smithi142.stdout: Cleanup : openssl-1:3.0.7-24.el9.x86_64 155/164 2023-12-12T09:42:06.142 INFO:teuthology.orchestra.run.smithi142.stdout: Cleanup : acl-2.3.1-3.el9.x86_64 156/164 2023-12-12T09:42:06.142 INFO:teuthology.orchestra.run.smithi142.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 157/164 2023-12-12T09:42:06.271 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 157/164 2023-12-12T09:42:06.318 INFO:teuthology.orchestra.run.smithi142.stdout: Cleanup : NetworkManager-team-1:1.44.0-2.el9.x86_64 158/164 2023-12-12T09:42:06.358 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 159/164 2023-12-12T09:42:06.358 INFO:teuthology.orchestra.run.smithi142.stdout: Cleanup : NetworkManager-1:1.44.0-2.el9.x86_64 159/164 2023-12-12T09:42:06.702 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 159/164 2023-12-12T09:42:06.702 INFO:teuthology.orchestra.run.smithi142.stdout: Cleanup : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 160/164 2023-12-12T09:42:06.810 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : openssl-libs-1:3.0.7-24.el9.x86_64 164/164 2023-12-12T09:42:06.811 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-12T09:42:06.811 INFO:teuthology.orchestra.run.smithi073.stdout:Upgraded: 2023-12-12T09:42:06.811 INFO:teuthology.orchestra.run.smithi073.stdout: NetworkManager-1:1.45.7-1.el9.x86_64 2023-12-12T09:42:06.811 INFO:teuthology.orchestra.run.smithi073.stdout: NetworkManager-libnm-1:1.45.7-1.el9.x86_64 2023-12-12T09:42:06.811 INFO:teuthology.orchestra.run.smithi073.stdout: NetworkManager-team-1:1.45.7-1.el9.x86_64 2023-12-12T09:42:06.811 INFO:teuthology.orchestra.run.smithi073.stdout: NetworkManager-tui-1:1.45.7-1.el9.x86_64 2023-12-12T09:42:06.811 INFO:teuthology.orchestra.run.smithi073.stdout: acl-2.3.1-4.el9.x86_64 2023-12-12T09:42:06.811 INFO:teuthology.orchestra.run.smithi073.stdout: elfutils-debuginfod-client-0.190-1.el9.x86_64 2023-12-12T09:42:06.811 INFO:teuthology.orchestra.run.smithi073.stdout: elfutils-libelf-0.190-1.el9.x86_64 2023-12-12T09:42:06.811 INFO:teuthology.orchestra.run.smithi073.stdout: elfutils-libs-0.190-1.el9.x86_64 2023-12-12T09:42:06.811 INFO:teuthology.orchestra.run.smithi073.stdout: libacl-2.3.1-4.el9.x86_64 2023-12-12T09:42:06.811 INFO:teuthology.orchestra.run.smithi073.stdout: libacl-devel-2.3.1-4.el9.x86_64 2023-12-12T09:42:06.812 INFO:teuthology.orchestra.run.smithi073.stdout: librados2-2:19.0.0-96.gf1fbf3c5.el9.x86_64 2023-12-12T09:42:06.812 INFO:teuthology.orchestra.run.smithi073.stdout: librbd1-2:19.0.0-96.gf1fbf3c5.el9.x86_64 2023-12-12T09:42:06.812 INFO:teuthology.orchestra.run.smithi073.stdout: openssl-1:3.0.7-25.el9.x86_64 2023-12-12T09:42:06.812 INFO:teuthology.orchestra.run.smithi073.stdout: openssl-libs-1:3.0.7-25.el9.x86_64 2023-12-12T09:42:06.812 INFO:teuthology.orchestra.run.smithi073.stdout: xfsdump-3.1.12-4.el9.x86_64 2023-12-12T09:42:06.812 INFO:teuthology.orchestra.run.smithi073.stdout:Installed: 2023-12-12T09:42:06.812 INFO:teuthology.orchestra.run.smithi073.stdout: automake-1.16.2-8.el9.noarch 2023-12-12T09:42:06.812 INFO:teuthology.orchestra.run.smithi073.stdout: bison-3.7.4-5.el9.x86_64 2023-12-12T09:42:06.812 INFO:teuthology.orchestra.run.smithi073.stdout: boost-program-options-1.75.0-8.el9.x86_64 2023-12-12T09:42:06.812 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-2:19.0.0-96.gf1fbf3c5.el9.x86_64 2023-12-12T09:42:06.812 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-base-2:19.0.0-96.gf1fbf3c5.el9.x86_64 2023-12-12T09:42:06.812 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-common-2:19.0.0-96.gf1fbf3c5.el9.x86_64 2023-12-12T09:42:06.812 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-fuse-2:19.0.0-96.gf1fbf3c5.el9.x86_64 2023-12-12T09:42:06.812 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-grafana-dashboards-2:19.0.0-96.gf1fbf3c5.el9.noarch 2023-12-12T09:42:06.812 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-immutable-object-cache-2:19.0.0-96.gf1fbf3c5.el9.x86_64 2023-12-12T09:42:06.813 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mds-2:19.0.0-96.gf1fbf3c5.el9.x86_64 2023-12-12T09:42:06.813 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mgr-2:19.0.0-96.gf1fbf3c5.el9.x86_64 2023-12-12T09:42:06.813 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mgr-cephadm-2:19.0.0-96.gf1fbf3c5.el9.noarch 2023-12-12T09:42:06.813 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mgr-dashboard-2:19.0.0-96.gf1fbf3c5.el9.noarch 2023-12-12T09:42:06.813 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mgr-diskprediction-local-2:19.0.0-96.gf1fbf3c5.el9.noarch 2023-12-12T09:42:06.813 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mgr-modules-core-2:19.0.0-96.gf1fbf3c5.el9.noarch 2023-12-12T09:42:06.813 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mgr-rook-2:19.0.0-96.gf1fbf3c5.el9.noarch 2023-12-12T09:42:06.813 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mon-2:19.0.0-96.gf1fbf3c5.el9.x86_64 2023-12-12T09:42:06.813 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-osd-2:19.0.0-96.gf1fbf3c5.el9.x86_64 2023-12-12T09:42:06.813 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-prometheus-alerts-2:19.0.0-96.gf1fbf3c5.el9.noarch 2023-12-12T09:42:06.813 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-radosgw-2:19.0.0-96.gf1fbf3c5.el9.x86_64 2023-12-12T09:42:06.813 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-selinux-2:19.0.0-96.gf1fbf3c5.el9.x86_64 2023-12-12T09:42:06.813 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-test-2:19.0.0-96.gf1fbf3c5.el9.x86_64 2023-12-12T09:42:06.813 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-volume-2:19.0.0-96.gf1fbf3c5.el9.noarch 2023-12-12T09:42:06.814 INFO:teuthology.orchestra.run.smithi073.stdout: cephadm-2:19.0.0-96.gf1fbf3c5.el9.noarch 2023-12-12T09:42:06.814 INFO:teuthology.orchestra.run.smithi073.stdout: cephfs-mirror-2:19.0.0-96.gf1fbf3c5.el9.x86_64 2023-12-12T09:42:06.814 INFO:teuthology.orchestra.run.smithi073.stdout: cephfs-top-2:19.0.0-96.gf1fbf3c5.el9.noarch 2023-12-12T09:42:06.814 INFO:teuthology.orchestra.run.smithi073.stdout: elfutils-libelf-devel-0.190-1.el9.x86_64 2023-12-12T09:42:06.814 INFO:teuthology.orchestra.run.smithi073.stdout: flex-2.6.4-9.el9.x86_64 2023-12-12T09:42:06.814 INFO:teuthology.orchestra.run.smithi073.stdout: flexiblas-3.0.4-8.el9.x86_64 2023-12-12T09:42:06.814 INFO:teuthology.orchestra.run.smithi073.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2023-12-12T09:42:06.814 INFO:teuthology.orchestra.run.smithi073.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2023-12-12T09:42:06.814 INFO:teuthology.orchestra.run.smithi073.stdout: fuse-2.9.9-15.el9.x86_64 2023-12-12T09:42:06.814 INFO:teuthology.orchestra.run.smithi073.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2023-12-12T09:42:06.814 INFO:teuthology.orchestra.run.smithi073.stdout: jq-1.6-16.el9.x86_64 2023-12-12T09:42:06.814 INFO:teuthology.orchestra.run.smithi073.stdout: libaio-devel-0.3.111-13.el9.x86_64 2023-12-12T09:42:06.814 INFO:teuthology.orchestra.run.smithi073.stdout: libarrow-9.0.0-10.el9.x86_64 2023-12-12T09:42:06.814 INFO:teuthology.orchestra.run.smithi073.stdout: libarrow-doc-9.0.0-10.el9.noarch 2023-12-12T09:42:06.815 INFO:teuthology.orchestra.run.smithi073.stdout: libcephfs-devel-2:19.0.0-96.gf1fbf3c5.el9.x86_64 2023-12-12T09:42:06.815 INFO:teuthology.orchestra.run.smithi073.stdout: libcephfs2-2:19.0.0-96.gf1fbf3c5.el9.x86_64 2023-12-12T09:42:06.815 INFO:teuthology.orchestra.run.smithi073.stdout: libcephsqlite-2:19.0.0-96.gf1fbf3c5.el9.x86_64 2023-12-12T09:42:06.815 INFO:teuthology.orchestra.run.smithi073.stdout: libgfortran-11.4.1-2.3.el9.x86_64 2023-12-12T09:42:06.815 INFO:teuthology.orchestra.run.smithi073.stdout: liboath-2.6.7-2.el9.x86_64 2023-12-12T09:42:06.815 INFO:teuthology.orchestra.run.smithi073.stdout: libpmemobj-1.12.1-1.el9.x86_64 2023-12-12T09:42:06.815 INFO:teuthology.orchestra.run.smithi073.stdout: libquadmath-11.4.1-2.3.el9.x86_64 2023-12-12T09:42:06.815 INFO:teuthology.orchestra.run.smithi073.stdout: librabbitmq-0.11.0-7.el9.x86_64 2023-12-12T09:42:06.815 INFO:teuthology.orchestra.run.smithi073.stdout: librados-devel-2:19.0.0-96.gf1fbf3c5.el9.x86_64 2023-12-12T09:42:06.815 INFO:teuthology.orchestra.run.smithi073.stdout: libradosstriper1-2:19.0.0-96.gf1fbf3c5.el9.x86_64 2023-12-12T09:42:06.815 INFO:teuthology.orchestra.run.smithi073.stdout: librdkafka-1.6.1-102.el9.x86_64 2023-12-12T09:42:06.815 INFO:teuthology.orchestra.run.smithi073.stdout: librgw2-2:19.0.0-96.gf1fbf3c5.el9.x86_64 2023-12-12T09:42:06.815 INFO:teuthology.orchestra.run.smithi073.stdout: libtool-2.4.6-45.el9.x86_64 2023-12-12T09:42:06.815 INFO:teuthology.orchestra.run.smithi073.stdout: libunwind-1.6.2-1.el9.x86_64 2023-12-12T09:42:06.815 INFO:teuthology.orchestra.run.smithi073.stdout: libuuid-devel-2.37.4-15.el9.x86_64 2023-12-12T09:42:06.816 INFO:teuthology.orchestra.run.smithi073.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2023-12-12T09:42:06.816 INFO:teuthology.orchestra.run.smithi073.stdout: lttng-ust-2.12.0-6.el9.x86_64 2023-12-12T09:42:06.816 INFO:teuthology.orchestra.run.smithi073.stdout: lua-5.4.4-4.el9.x86_64 2023-12-12T09:42:06.816 INFO:teuthology.orchestra.run.smithi073.stdout: luarocks-3.9.2-1.el9.noarch 2023-12-12T09:42:06.816 INFO:teuthology.orchestra.run.smithi073.stdout: oniguruma-6.9.6-1.el9.5.x86_64 2023-12-12T09:42:06.816 INFO:teuthology.orchestra.run.smithi073.stdout: openblas-0.3.21-2.el9.x86_64 2023-12-12T09:42:06.816 INFO:teuthology.orchestra.run.smithi073.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2023-12-12T09:42:06.816 INFO:teuthology.orchestra.run.smithi073.stdout: openssl-devel-1:3.0.7-25.el9.x86_64 2023-12-12T09:42:06.816 INFO:teuthology.orchestra.run.smithi073.stdout: parquet-libs-9.0.0-10.el9.x86_64 2023-12-12T09:42:06.816 INFO:teuthology.orchestra.run.smithi073.stdout: postgresql-13.11-1.el9.x86_64 2023-12-12T09:42:06.816 INFO:teuthology.orchestra.run.smithi073.stdout: postgresql-contrib-13.11-1.el9.x86_64 2023-12-12T09:42:06.816 INFO:teuthology.orchestra.run.smithi073.stdout: postgresql-private-libs-13.11-1.el9.x86_64 2023-12-12T09:42:06.816 INFO:teuthology.orchestra.run.smithi073.stdout: postgresql-server-13.11-1.el9.x86_64 2023-12-12T09:42:06.816 INFO:teuthology.orchestra.run.smithi073.stdout: python3-asyncssh-2.13.2-3.el9.noarch 2023-12-12T09:42:06.816 INFO:teuthology.orchestra.run.smithi073.stdout: python3-babel-2.9.1-2.el9.noarch 2023-12-12T09:42:06.817 INFO:teuthology.orchestra.run.smithi073.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2023-12-12T09:42:06.817 INFO:teuthology.orchestra.run.smithi073.stdout: python3-cachetools-4.2.4-1.el9.noarch 2023-12-12T09:42:06.817 INFO:teuthology.orchestra.run.smithi073.stdout: python3-ceph-argparse-2:19.0.0-96.gf1fbf3c5.el9.x86_64 2023-12-12T09:42:06.817 INFO:teuthology.orchestra.run.smithi073.stdout: python3-ceph-common-2:19.0.0-96.gf1fbf3c5.el9.x86_64 2023-12-12T09:42:06.817 INFO:teuthology.orchestra.run.smithi073.stdout: python3-cephfs-2:19.0.0-96.gf1fbf3c5.el9.x86_64 2023-12-12T09:42:06.817 INFO:teuthology.orchestra.run.smithi073.stdout: python3-certifi-2021.10.8-2.el9.noarch 2023-12-12T09:42:06.817 INFO:teuthology.orchestra.run.smithi073.stdout: python3-cffi-1.14.5-5.el9.x86_64 2023-12-12T09:42:06.817 INFO:teuthology.orchestra.run.smithi073.stdout: python3-cheroot-8.6.0-4.el9.noarch 2023-12-12T09:42:06.817 INFO:teuthology.orchestra.run.smithi073.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2023-12-12T09:42:06.817 INFO:teuthology.orchestra.run.smithi073.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2023-12-12T09:42:06.817 INFO:teuthology.orchestra.run.smithi073.stdout: python3-devel-3.9.17-2.el9.x86_64 2023-12-12T09:42:06.817 INFO:teuthology.orchestra.run.smithi073.stdout: python3-google-auth-1:2.23.4-1.el9.noarch 2023-12-12T09:42:06.817 INFO:teuthology.orchestra.run.smithi073.stdout: python3-jaraco-8.2.1-3.el9.noarch 2023-12-12T09:42:06.817 INFO:teuthology.orchestra.run.smithi073.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2023-12-12T09:42:06.818 INFO:teuthology.orchestra.run.smithi073.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2023-12-12T09:42:06.818 INFO:teuthology.orchestra.run.smithi073.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2023-12-12T09:42:06.818 INFO:teuthology.orchestra.run.smithi073.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2023-12-12T09:42:06.818 INFO:teuthology.orchestra.run.smithi073.stdout: python3-jinja2-2.11.3-4.el9.noarch 2023-12-12T09:42:06.818 INFO:teuthology.orchestra.run.smithi073.stdout: python3-jsonpatch-1.21-16.el9.noarch 2023-12-12T09:42:06.818 INFO:teuthology.orchestra.run.smithi073.stdout: python3-jsonpointer-2.0-4.el9.noarch 2023-12-12T09:42:06.818 INFO:teuthology.orchestra.run.smithi073.stdout: python3-jwt-2.4.0-1.el9.noarch 2023-12-12T09:42:06.818 INFO:teuthology.orchestra.run.smithi073.stdout: python3-jwt+crypto-2.4.0-1.el9.noarch 2023-12-12T09:42:06.818 INFO:teuthology.orchestra.run.smithi073.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2023-12-12T09:42:06.819 INFO:teuthology.orchestra.run.smithi073.stdout: python3-logutils-0.3.5-21.el9.noarch 2023-12-12T09:42:06.819 INFO:teuthology.orchestra.run.smithi073.stdout: python3-mako-1.1.4-6.el9.noarch 2023-12-12T09:42:06.819 INFO:teuthology.orchestra.run.smithi073.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2023-12-12T09:42:06.819 INFO:teuthology.orchestra.run.smithi073.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2023-12-12T09:42:06.819 INFO:teuthology.orchestra.run.smithi073.stdout: python3-natsort-7.1.1-5.el9.noarch 2023-12-12T09:42:06.819 INFO:teuthology.orchestra.run.smithi073.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2023-12-12T09:42:06.819 INFO:teuthology.orchestra.run.smithi073.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2023-12-12T09:42:06.819 INFO:teuthology.orchestra.run.smithi073.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2023-12-12T09:42:06.819 INFO:teuthology.orchestra.run.smithi073.stdout: python3-pecan-1.4.2-3.el9.noarch 2023-12-12T09:42:06.819 INFO:teuthology.orchestra.run.smithi073.stdout: python3-ply-3.11-14.el9.noarch 2023-12-12T09:42:06.819 INFO:teuthology.orchestra.run.smithi073.stdout: python3-portend-3.1.0-2.el9.noarch 2023-12-12T09:42:06.819 INFO:teuthology.orchestra.run.smithi073.stdout: python3-prettytable-0.7.2-27.el9.noarch 2023-12-12T09:42:06.819 INFO:teuthology.orchestra.run.smithi073.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2023-12-12T09:42:06.819 INFO:teuthology.orchestra.run.smithi073.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2023-12-12T09:42:06.819 INFO:teuthology.orchestra.run.smithi073.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2023-12-12T09:42:06.820 INFO:teuthology.orchestra.run.smithi073.stdout: python3-pycparser-2.20-6.el9.noarch 2023-12-12T09:42:06.820 INFO:teuthology.orchestra.run.smithi073.stdout: python3-pytz-2021.1-5.el9.noarch 2023-12-12T09:42:06.820 INFO:teuthology.orchestra.run.smithi073.stdout: python3-rados-2:19.0.0-96.gf1fbf3c5.el9.x86_64 2023-12-12T09:42:06.820 INFO:teuthology.orchestra.run.smithi073.stdout: python3-rbd-2:19.0.0-96.gf1fbf3c5.el9.x86_64 2023-12-12T09:42:06.820 INFO:teuthology.orchestra.run.smithi073.stdout: python3-repoze-lru-0.7-16.el9.noarch 2023-12-12T09:42:06.820 INFO:teuthology.orchestra.run.smithi073.stdout: python3-requests-2.25.1-7.el9.noarch 2023-12-12T09:42:06.820 INFO:teuthology.orchestra.run.smithi073.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2023-12-12T09:42:06.820 INFO:teuthology.orchestra.run.smithi073.stdout: python3-rgw-2:19.0.0-96.gf1fbf3c5.el9.x86_64 2023-12-12T09:42:06.820 INFO:teuthology.orchestra.run.smithi073.stdout: python3-routes-2.5.1-5.el9.noarch 2023-12-12T09:42:06.820 INFO:teuthology.orchestra.run.smithi073.stdout: python3-rsa-4.9-2.el9.noarch 2023-12-12T09:42:06.820 INFO:teuthology.orchestra.run.smithi073.stdout: python3-scipy-1.6.2-8.el9.x86_64 2023-12-12T09:42:06.820 INFO:teuthology.orchestra.run.smithi073.stdout: python3-tempora-5.0.0-2.el9.noarch 2023-12-12T09:42:06.820 INFO:teuthology.orchestra.run.smithi073.stdout: python3-toml-0.10.2-6.el9.noarch 2023-12-12T09:42:06.820 INFO:teuthology.orchestra.run.smithi073.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2023-12-12T09:42:06.821 INFO:teuthology.orchestra.run.smithi073.stdout: python3-urllib3-1.26.5-4.el9.noarch 2023-12-12T09:42:06.821 INFO:teuthology.orchestra.run.smithi073.stdout: python3-webob-1.8.7-6.el9.noarch 2023-12-12T09:42:06.821 INFO:teuthology.orchestra.run.smithi073.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2023-12-12T09:42:06.821 INFO:teuthology.orchestra.run.smithi073.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2023-12-12T09:42:06.821 INFO:teuthology.orchestra.run.smithi073.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2023-12-12T09:42:06.821 INFO:teuthology.orchestra.run.smithi073.stdout: rbd-fuse-2:19.0.0-96.gf1fbf3c5.el9.x86_64 2023-12-12T09:42:06.821 INFO:teuthology.orchestra.run.smithi073.stdout: rbd-mirror-2:19.0.0-96.gf1fbf3c5.el9.x86_64 2023-12-12T09:42:06.821 INFO:teuthology.orchestra.run.smithi073.stdout: rbd-nbd-2:19.0.0-96.gf1fbf3c5.el9.x86_64 2023-12-12T09:42:06.821 INFO:teuthology.orchestra.run.smithi073.stdout: re2-1:20211101-3.el9.x86_64 2023-12-12T09:42:06.821 INFO:teuthology.orchestra.run.smithi073.stdout: socat-1.7.4.1-5.el9.x86_64 2023-12-12T09:42:06.821 INFO:teuthology.orchestra.run.smithi073.stdout: thrift-0.15.0-2.el9.x86_64 2023-12-12T09:42:06.821 INFO:teuthology.orchestra.run.smithi073.stdout: uuid-1.6.2-55.el9.x86_64 2023-12-12T09:42:06.821 INFO:teuthology.orchestra.run.smithi073.stdout: xfsprogs-devel-5.19.0-4.el9.x86_64 2023-12-12T09:42:06.821 INFO:teuthology.orchestra.run.smithi073.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2023-12-12T09:42:06.822 INFO:teuthology.orchestra.run.smithi073.stdout: zlib-devel-1.2.11-40.el9.x86_64 2023-12-12T09:42:06.822 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-12T09:42:06.822 INFO:teuthology.orchestra.run.smithi073.stdout:Complete! 2023-12-12T09:42:06.843 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: NetworkManager-libnm-1:1.44.0-2.el9.x86_64 160/164 2023-12-12T09:42:06.879 INFO:teuthology.orchestra.run.smithi142.stdout: Cleanup : openssl-libs-1:3.0.7-24.el9.x86_64 161/164 2023-12-12T09:42:06.912 INFO:teuthology.orchestra.run.smithi142.stdout: Cleanup : libacl-2.3.1-3.el9.x86_64 162/164 2023-12-12T09:42:06.947 INFO:teuthology.orchestra.run.smithi142.stdout: Cleanup : elfutils-libelf-0.189-3.el9.x86_64 163/164 2023-12-12T09:42:07.065 INFO:teuthology.orchestra.run.smithi142.stdout: Cleanup : xfsdump-3.1.12-3.el9.x86_64 164/164 2023-12-12T09:42:07.326 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: xfsdump-3.1.12-3.el9.x86_64 164/164 2023-12-12T09:42:07.326 INFO:teuthology.orchestra.run.smithi142.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2023-12-12T09:42:07.326 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-12-12T09:42:07.394 DEBUG:teuthology.parallel:result is None 2023-12-12T09:42:11.985 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-2:19.0.0-96.gf1fbf3c5.el9.x86_64 1/164 2023-12-12T09:42:11.985 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-base-2:19.0.0-96.gf1fbf3c5.el9.x86_64 2/164 2023-12-12T09:42:11.985 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-common-2:19.0.0-96.gf1fbf3c5.el9.x86_64 3/164 2023-12-12T09:42:11.985 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-fuse-2:19.0.0-96.gf1fbf3c5.el9.x86_64 4/164 2023-12-12T09:42:11.985 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-96.gf1fbf3c 5/164 2023-12-12T09:42:11.985 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-mds-2:19.0.0-96.gf1fbf3c5.el9.x86_64 6/164 2023-12-12T09:42:11.985 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-mgr-2:19.0.0-96.gf1fbf3c5.el9.x86_64 7/164 2023-12-12T09:42:11.985 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-mon-2:19.0.0-96.gf1fbf3c5.el9.x86_64 8/164 2023-12-12T09:42:11.985 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-osd-2:19.0.0-96.gf1fbf3c5.el9.x86_64 9/164 2023-12-12T09:42:11.985 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-radosgw-2:19.0.0-96.gf1fbf3c5.el9.x86_64 10/164 2023-12-12T09:42:11.985 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-selinux-2:19.0.0-96.gf1fbf3c5.el9.x86_64 11/164 2023-12-12T09:42:11.985 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-test-2:19.0.0-96.gf1fbf3c5.el9.x86_64 12/164 2023-12-12T09:42:11.986 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : cephfs-mirror-2:19.0.0-96.gf1fbf3c5.el9.x86_64 13/164 2023-12-12T09:42:11.986 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libcephfs-devel-2:19.0.0-96.gf1fbf3c5.el9.x86_64 14/164 2023-12-12T09:42:11.986 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libcephfs2-2:19.0.0-96.gf1fbf3c5.el9.x86_64 15/164 2023-12-12T09:42:11.986 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libcephsqlite-2:19.0.0-96.gf1fbf3c5.el9.x86_64 16/164 2023-12-12T09:42:11.986 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : librados-devel-2:19.0.0-96.gf1fbf3c5.el9.x86_64 17/164 2023-12-12T09:42:11.986 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libradosstriper1-2:19.0.0-96.gf1fbf3c5.el9.x86_6 18/164 2023-12-12T09:42:11.986 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : librgw2-2:19.0.0-96.gf1fbf3c5.el9.x86_64 19/164 2023-12-12T09:42:11.986 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-ceph-argparse-2:19.0.0-96.gf1fbf3c5.el9. 20/164 2023-12-12T09:42:11.986 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-ceph-common-2:19.0.0-96.gf1fbf3c5.el9.x8 21/164 2023-12-12T09:42:11.986 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-cephfs-2:19.0.0-96.gf1fbf3c5.el9.x86_64 22/164 2023-12-12T09:42:11.986 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-rados-2:19.0.0-96.gf1fbf3c5.el9.x86_64 23/164 2023-12-12T09:42:11.986 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-rbd-2:19.0.0-96.gf1fbf3c5.el9.x86_64 24/164 2023-12-12T09:42:11.986 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-rgw-2:19.0.0-96.gf1fbf3c5.el9.x86_64 25/164 2023-12-12T09:42:11.986 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : rbd-fuse-2:19.0.0-96.gf1fbf3c5.el9.x86_64 26/164 2023-12-12T09:42:11.987 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : rbd-mirror-2:19.0.0-96.gf1fbf3c5.el9.x86_64 27/164 2023-12-12T09:42:11.987 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : rbd-nbd-2:19.0.0-96.gf1fbf3c5.el9.x86_64 28/164 2023-12-12T09:42:11.987 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-96.gf1fbf3c5.el 29/164 2023-12-12T09:42:12.003 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-96.gf1fbf3c5.el9.noarc 30/164 2023-12-12T09:42:12.003 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-96.gf1fbf3c5.el9.noa 31/164 2023-12-12T09:42:12.003 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-96.gf1fbf 32/164 2023-12-12T09:42:12.003 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-96.gf1fbf3c5.el9. 33/164 2023-12-12T09:42:12.003 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-mgr-rook-2:19.0.0-96.gf1fbf3c5.el9.noarch 34/164 2023-12-12T09:42:12.003 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-96.gf1fbf3c5.el9 35/164 2023-12-12T09:42:12.003 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-volume-2:19.0.0-96.gf1fbf3c5.el9.noarch 36/164 2023-12-12T09:42:12.003 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : cephadm-2:19.0.0-96.gf1fbf3c5.el9.noarch 37/164 2023-12-12T09:42:12.003 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : cephfs-top-2:19.0.0-96.gf1fbf3c5.el9.noarch 38/164 2023-12-12T09:42:12.004 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : automake-1.16.2-8.el9.noarch 39/164 2023-12-12T09:42:12.004 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : bison-3.7.4-5.el9.x86_64 40/164 2023-12-12T09:42:12.004 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 41/164 2023-12-12T09:42:12.004 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : elfutils-libelf-devel-0.190-1.el9.x86_64 42/164 2023-12-12T09:42:12.004 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : flex-2.6.4-9.el9.x86_64 43/164 2023-12-12T09:42:12.004 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 44/164 2023-12-12T09:42:12.004 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 45/164 2023-12-12T09:42:12.004 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 46/164 2023-12-12T09:42:12.004 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : jq-1.6-16.el9.x86_64 47/164 2023-12-12T09:42:12.004 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 48/164 2023-12-12T09:42:12.004 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 49/164 2023-12-12T09:42:12.004 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 50/164 2023-12-12T09:42:12.004 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 51/164 2023-12-12T09:42:12.005 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 52/164 2023-12-12T09:42:12.005 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libuuid-devel-2.37.4-15.el9.x86_64 53/164 2023-12-12T09:42:12.005 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 54/164 2023-12-12T09:42:12.005 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 55/164 2023-12-12T09:42:12.005 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : lua-5.4.4-4.el9.x86_64 56/164 2023-12-12T09:42:12.005 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : oniguruma-6.9.6-1.el9.5.x86_64 57/164 2023-12-12T09:42:12.005 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 58/164 2023-12-12T09:42:12.005 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 59/164 2023-12-12T09:42:12.005 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : postgresql-13.11-1.el9.x86_64 60/164 2023-12-12T09:42:12.005 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : postgresql-contrib-13.11-1.el9.x86_64 61/164 2023-12-12T09:42:12.005 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : postgresql-private-libs-13.11-1.el9.x86_64 62/164 2023-12-12T09:42:12.006 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : postgresql-server-13.11-1.el9.x86_64 63/164 2023-12-12T09:42:12.006 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 64/164 2023-12-12T09:42:12.006 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-jinja2-2.11.3-4.el9.noarch 65/164 2023-12-12T09:42:12.006 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 66/164 2023-12-12T09:42:12.006 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 67/164 2023-12-12T09:42:12.006 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 68/164 2023-12-12T09:42:12.006 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 69/164 2023-12-12T09:42:12.006 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 70/164 2023-12-12T09:42:12.006 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 71/164 2023-12-12T09:42:12.006 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 72/164 2023-12-12T09:42:12.006 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 73/164 2023-12-12T09:42:12.006 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 74/164 2023-12-12T09:42:12.007 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 75/164 2023-12-12T09:42:12.007 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 76/164 2023-12-12T09:42:12.007 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 77/164 2023-12-12T09:42:12.007 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 78/164 2023-12-12T09:42:12.007 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 79/164 2023-12-12T09:42:12.007 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 80/164 2023-12-12T09:42:12.007 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 81/164 2023-12-12T09:42:12.007 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : xfsprogs-devel-5.19.0-4.el9.x86_64 82/164 2023-12-12T09:42:12.007 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 83/164 2023-12-12T09:42:12.007 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : zlib-devel-1.2.11-40.el9.x86_64 84/164 2023-12-12T09:42:12.007 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 85/164 2023-12-12T09:42:12.007 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libgfortran-11.4.1-2.3.el9.x86_64 86/164 2023-12-12T09:42:12.008 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libquadmath-11.4.1-2.3.el9.x86_64 87/164 2023-12-12T09:42:12.008 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 88/164 2023-12-12T09:42:12.008 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 89/164 2023-12-12T09:42:12.008 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-ply-3.11-14.el9.noarch 90/164 2023-12-12T09:42:12.008 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 91/164 2023-12-12T09:42:12.008 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-requests-2.25.1-7.el9.noarch 92/164 2023-12-12T09:42:12.008 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-urllib3-1.26.5-4.el9.noarch 93/164 2023-12-12T09:42:12.008 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : openssl-devel-1:3.0.7-25.el9.x86_64 94/164 2023-12-12T09:42:12.008 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 95/164 2023-12-12T09:42:12.008 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 96/164 2023-12-12T09:42:12.008 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libarrow-9.0.0-10.el9.x86_64 97/164 2023-12-12T09:42:12.008 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libarrow-doc-9.0.0-10.el9.noarch 98/164 2023-12-12T09:42:12.009 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 99/164 2023-12-12T09:42:12.009 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 100/164 2023-12-12T09:42:12.009 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 101/164 2023-12-12T09:42:12.009 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : parquet-libs-9.0.0-10.el9.x86_64 102/164 2023-12-12T09:42:12.009 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-asyncssh-2.13.2-3.el9.noarch 103/164 2023-12-12T09:42:12.009 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 104/164 2023-12-12T09:42:12.009 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 105/164 2023-12-12T09:42:12.009 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 106/164 2023-12-12T09:42:12.009 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 107/164 2023-12-12T09:42:12.009 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 108/164 2023-12-12T09:42:12.009 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-google-auth-1:2.23.4-1.el9.noarch 109/164 2023-12-12T09:42:12.009 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 110/164 2023-12-12T09:42:12.009 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 111/164 2023-12-12T09:42:12.010 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 112/164 2023-12-12T09:42:12.010 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 113/164 2023-12-12T09:42:12.010 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 114/164 2023-12-12T09:42:12.010 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-jwt+crypto-2.4.0-1.el9.noarch 115/164 2023-12-12T09:42:12.010 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-jwt-2.4.0-1.el9.noarch 116/164 2023-12-12T09:42:12.010 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 117/164 2023-12-12T09:42:12.010 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 118/164 2023-12-12T09:42:12.010 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 119/164 2023-12-12T09:42:12.011 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 120/164 2023-12-12T09:42:12.011 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 121/164 2023-12-12T09:42:12.011 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 122/164 2023-12-12T09:42:12.011 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 123/164 2023-12-12T09:42:12.011 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 124/164 2023-12-12T09:42:12.011 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 125/164 2023-12-12T09:42:12.011 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 126/164 2023-12-12T09:42:12.011 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 127/164 2023-12-12T09:42:12.011 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 128/164 2023-12-12T09:42:12.011 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 129/164 2023-12-12T09:42:12.011 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 130/164 2023-12-12T09:42:12.011 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 131/164 2023-12-12T09:42:12.012 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 132/164 2023-12-12T09:42:12.012 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : re2-1:20211101-3.el9.x86_64 133/164 2023-12-12T09:42:12.012 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 134/164 2023-12-12T09:42:12.012 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : librados2-2:19.0.0-96.gf1fbf3c5.el9.x86_64 135/164 2023-12-12T09:42:12.012 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 136/164 2023-12-12T09:42:12.012 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : librbd1-2:19.0.0-96.gf1fbf3c5.el9.x86_64 137/164 2023-12-12T09:42:12.012 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 138/164 2023-12-12T09:42:12.012 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libacl-devel-2.3.1-4.el9.x86_64 139/164 2023-12-12T09:42:12.012 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libacl-devel-2.3.1-3.el9.x86_64 140/164 2023-12-12T09:42:12.012 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : acl-2.3.1-4.el9.x86_64 141/164 2023-12-12T09:42:12.012 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : acl-2.3.1-3.el9.x86_64 142/164 2023-12-12T09:42:12.012 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : elfutils-debuginfod-client-0.190-1.el9.x86_64 143/164 2023-12-12T09:42:12.013 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : elfutils-debuginfod-client-0.189-3.el9.x86_64 144/164 2023-12-12T09:42:12.013 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : elfutils-libelf-0.190-1.el9.x86_64 145/164 2023-12-12T09:42:12.013 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : elfutils-libelf-0.189-3.el9.x86_64 146/164 2023-12-12T09:42:12.013 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : elfutils-libs-0.190-1.el9.x86_64 147/164 2023-12-12T09:42:12.013 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : elfutils-libs-0.189-3.el9.x86_64 148/164 2023-12-12T09:42:12.013 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libacl-2.3.1-4.el9.x86_64 149/164 2023-12-12T09:42:12.013 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libacl-2.3.1-3.el9.x86_64 150/164 2023-12-12T09:42:12.013 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : xfsdump-3.1.12-4.el9.x86_64 151/164 2023-12-12T09:42:12.013 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : xfsdump-3.1.12-3.el9.x86_64 152/164 2023-12-12T09:42:12.013 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : NetworkManager-1:1.45.7-1.el9.x86_64 153/164 2023-12-12T09:42:12.013 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : NetworkManager-1:1.44.0-2.el9.x86_64 154/164 2023-12-12T09:42:12.013 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : NetworkManager-libnm-1:1.45.7-1.el9.x86_64 155/164 2023-12-12T09:42:12.013 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 156/164 2023-12-12T09:42:12.014 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : NetworkManager-team-1:1.45.7-1.el9.x86_64 157/164 2023-12-12T09:42:12.014 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : NetworkManager-team-1:1.44.0-2.el9.x86_64 158/164 2023-12-12T09:42:12.014 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : NetworkManager-tui-1:1.45.7-1.el9.x86_64 159/164 2023-12-12T09:42:12.014 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : NetworkManager-tui-1:1.44.0-2.el9.x86_64 160/164 2023-12-12T09:42:12.014 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : openssl-1:3.0.7-25.el9.x86_64 161/164 2023-12-12T09:42:12.014 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : openssl-1:3.0.7-24.el9.x86_64 162/164 2023-12-12T09:42:12.014 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : openssl-libs-1:3.0.7-25.el9.x86_64 163/164 2023-12-12T09:42:14.120 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : openssl-libs-1:3.0.7-24.el9.x86_64 164/164 2023-12-12T09:42:14.121 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-12-12T09:42:14.121 INFO:teuthology.orchestra.run.smithi142.stdout:Upgraded: 2023-12-12T09:42:14.121 INFO:teuthology.orchestra.run.smithi142.stdout: NetworkManager-1:1.45.7-1.el9.x86_64 2023-12-12T09:42:14.121 INFO:teuthology.orchestra.run.smithi142.stdout: NetworkManager-libnm-1:1.45.7-1.el9.x86_64 2023-12-12T09:42:14.121 INFO:teuthology.orchestra.run.smithi142.stdout: NetworkManager-team-1:1.45.7-1.el9.x86_64 2023-12-12T09:42:14.121 INFO:teuthology.orchestra.run.smithi142.stdout: NetworkManager-tui-1:1.45.7-1.el9.x86_64 2023-12-12T09:42:14.121 INFO:teuthology.orchestra.run.smithi142.stdout: acl-2.3.1-4.el9.x86_64 2023-12-12T09:42:14.121 INFO:teuthology.orchestra.run.smithi142.stdout: elfutils-debuginfod-client-0.190-1.el9.x86_64 2023-12-12T09:42:14.121 INFO:teuthology.orchestra.run.smithi142.stdout: elfutils-libelf-0.190-1.el9.x86_64 2023-12-12T09:42:14.121 INFO:teuthology.orchestra.run.smithi142.stdout: elfutils-libs-0.190-1.el9.x86_64 2023-12-12T09:42:14.122 INFO:teuthology.orchestra.run.smithi142.stdout: libacl-2.3.1-4.el9.x86_64 2023-12-12T09:42:14.122 INFO:teuthology.orchestra.run.smithi142.stdout: libacl-devel-2.3.1-4.el9.x86_64 2023-12-12T09:42:14.122 INFO:teuthology.orchestra.run.smithi142.stdout: librados2-2:19.0.0-96.gf1fbf3c5.el9.x86_64 2023-12-12T09:42:14.122 INFO:teuthology.orchestra.run.smithi142.stdout: librbd1-2:19.0.0-96.gf1fbf3c5.el9.x86_64 2023-12-12T09:42:14.122 INFO:teuthology.orchestra.run.smithi142.stdout: openssl-1:3.0.7-25.el9.x86_64 2023-12-12T09:42:14.122 INFO:teuthology.orchestra.run.smithi142.stdout: openssl-libs-1:3.0.7-25.el9.x86_64 2023-12-12T09:42:14.122 INFO:teuthology.orchestra.run.smithi142.stdout: xfsdump-3.1.12-4.el9.x86_64 2023-12-12T09:42:14.122 INFO:teuthology.orchestra.run.smithi142.stdout:Installed: 2023-12-12T09:42:14.122 INFO:teuthology.orchestra.run.smithi142.stdout: automake-1.16.2-8.el9.noarch 2023-12-12T09:42:14.122 INFO:teuthology.orchestra.run.smithi142.stdout: bison-3.7.4-5.el9.x86_64 2023-12-12T09:42:14.122 INFO:teuthology.orchestra.run.smithi142.stdout: boost-program-options-1.75.0-8.el9.x86_64 2023-12-12T09:42:14.122 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-2:19.0.0-96.gf1fbf3c5.el9.x86_64 2023-12-12T09:42:14.123 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-base-2:19.0.0-96.gf1fbf3c5.el9.x86_64 2023-12-12T09:42:14.123 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-common-2:19.0.0-96.gf1fbf3c5.el9.x86_64 2023-12-12T09:42:14.123 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-fuse-2:19.0.0-96.gf1fbf3c5.el9.x86_64 2023-12-12T09:42:14.123 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-grafana-dashboards-2:19.0.0-96.gf1fbf3c5.el9.noarch 2023-12-12T09:42:14.123 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-immutable-object-cache-2:19.0.0-96.gf1fbf3c5.el9.x86_64 2023-12-12T09:42:14.123 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mds-2:19.0.0-96.gf1fbf3c5.el9.x86_64 2023-12-12T09:42:14.123 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mgr-2:19.0.0-96.gf1fbf3c5.el9.x86_64 2023-12-12T09:42:14.123 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mgr-cephadm-2:19.0.0-96.gf1fbf3c5.el9.noarch 2023-12-12T09:42:14.124 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mgr-dashboard-2:19.0.0-96.gf1fbf3c5.el9.noarch 2023-12-12T09:42:14.124 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mgr-diskprediction-local-2:19.0.0-96.gf1fbf3c5.el9.noarch 2023-12-12T09:42:14.124 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mgr-modules-core-2:19.0.0-96.gf1fbf3c5.el9.noarch 2023-12-12T09:42:14.124 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mgr-rook-2:19.0.0-96.gf1fbf3c5.el9.noarch 2023-12-12T09:42:14.124 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mon-2:19.0.0-96.gf1fbf3c5.el9.x86_64 2023-12-12T09:42:14.124 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-osd-2:19.0.0-96.gf1fbf3c5.el9.x86_64 2023-12-12T09:42:14.124 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-prometheus-alerts-2:19.0.0-96.gf1fbf3c5.el9.noarch 2023-12-12T09:42:14.124 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-radosgw-2:19.0.0-96.gf1fbf3c5.el9.x86_64 2023-12-12T09:42:14.124 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-selinux-2:19.0.0-96.gf1fbf3c5.el9.x86_64 2023-12-12T09:42:14.125 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-test-2:19.0.0-96.gf1fbf3c5.el9.x86_64 2023-12-12T09:42:14.125 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-volume-2:19.0.0-96.gf1fbf3c5.el9.noarch 2023-12-12T09:42:14.125 INFO:teuthology.orchestra.run.smithi142.stdout: cephadm-2:19.0.0-96.gf1fbf3c5.el9.noarch 2023-12-12T09:42:14.125 INFO:teuthology.orchestra.run.smithi142.stdout: cephfs-mirror-2:19.0.0-96.gf1fbf3c5.el9.x86_64 2023-12-12T09:42:14.125 INFO:teuthology.orchestra.run.smithi142.stdout: cephfs-top-2:19.0.0-96.gf1fbf3c5.el9.noarch 2023-12-12T09:42:14.125 INFO:teuthology.orchestra.run.smithi142.stdout: elfutils-libelf-devel-0.190-1.el9.x86_64 2023-12-12T09:42:14.125 INFO:teuthology.orchestra.run.smithi142.stdout: flex-2.6.4-9.el9.x86_64 2023-12-12T09:42:14.125 INFO:teuthology.orchestra.run.smithi142.stdout: flexiblas-3.0.4-8.el9.x86_64 2023-12-12T09:42:14.125 INFO:teuthology.orchestra.run.smithi142.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2023-12-12T09:42:14.126 INFO:teuthology.orchestra.run.smithi142.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2023-12-12T09:42:14.126 INFO:teuthology.orchestra.run.smithi142.stdout: fuse-2.9.9-15.el9.x86_64 2023-12-12T09:42:14.126 INFO:teuthology.orchestra.run.smithi142.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2023-12-12T09:42:14.126 INFO:teuthology.orchestra.run.smithi142.stdout: jq-1.6-16.el9.x86_64 2023-12-12T09:42:14.126 INFO:teuthology.orchestra.run.smithi142.stdout: libaio-devel-0.3.111-13.el9.x86_64 2023-12-12T09:42:14.126 INFO:teuthology.orchestra.run.smithi142.stdout: libarrow-9.0.0-10.el9.x86_64 2023-12-12T09:42:14.126 INFO:teuthology.orchestra.run.smithi142.stdout: libarrow-doc-9.0.0-10.el9.noarch 2023-12-12T09:42:14.126 INFO:teuthology.orchestra.run.smithi142.stdout: libcephfs-devel-2:19.0.0-96.gf1fbf3c5.el9.x86_64 2023-12-12T09:42:14.126 INFO:teuthology.orchestra.run.smithi142.stdout: libcephfs2-2:19.0.0-96.gf1fbf3c5.el9.x86_64 2023-12-12T09:42:14.126 INFO:teuthology.orchestra.run.smithi142.stdout: libcephsqlite-2:19.0.0-96.gf1fbf3c5.el9.x86_64 2023-12-12T09:42:14.126 INFO:teuthology.orchestra.run.smithi142.stdout: libgfortran-11.4.1-2.3.el9.x86_64 2023-12-12T09:42:14.127 INFO:teuthology.orchestra.run.smithi142.stdout: liboath-2.6.7-2.el9.x86_64 2023-12-12T09:42:14.127 INFO:teuthology.orchestra.run.smithi142.stdout: libpmemobj-1.12.1-1.el9.x86_64 2023-12-12T09:42:14.127 INFO:teuthology.orchestra.run.smithi142.stdout: libquadmath-11.4.1-2.3.el9.x86_64 2023-12-12T09:42:14.127 INFO:teuthology.orchestra.run.smithi142.stdout: librabbitmq-0.11.0-7.el9.x86_64 2023-12-12T09:42:14.127 INFO:teuthology.orchestra.run.smithi142.stdout: librados-devel-2:19.0.0-96.gf1fbf3c5.el9.x86_64 2023-12-12T09:42:14.127 INFO:teuthology.orchestra.run.smithi142.stdout: libradosstriper1-2:19.0.0-96.gf1fbf3c5.el9.x86_64 2023-12-12T09:42:14.127 INFO:teuthology.orchestra.run.smithi142.stdout: librdkafka-1.6.1-102.el9.x86_64 2023-12-12T09:42:14.127 INFO:teuthology.orchestra.run.smithi142.stdout: librgw2-2:19.0.0-96.gf1fbf3c5.el9.x86_64 2023-12-12T09:42:14.127 INFO:teuthology.orchestra.run.smithi142.stdout: libtool-2.4.6-45.el9.x86_64 2023-12-12T09:42:14.128 INFO:teuthology.orchestra.run.smithi142.stdout: libunwind-1.6.2-1.el9.x86_64 2023-12-12T09:42:14.128 INFO:teuthology.orchestra.run.smithi142.stdout: libuuid-devel-2.37.4-15.el9.x86_64 2023-12-12T09:42:14.128 INFO:teuthology.orchestra.run.smithi142.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2023-12-12T09:42:14.128 INFO:teuthology.orchestra.run.smithi142.stdout: lttng-ust-2.12.0-6.el9.x86_64 2023-12-12T09:42:14.128 INFO:teuthology.orchestra.run.smithi142.stdout: lua-5.4.4-4.el9.x86_64 2023-12-12T09:42:14.128 INFO:teuthology.orchestra.run.smithi142.stdout: luarocks-3.9.2-1.el9.noarch 2023-12-12T09:42:14.128 INFO:teuthology.orchestra.run.smithi142.stdout: oniguruma-6.9.6-1.el9.5.x86_64 2023-12-12T09:42:14.128 INFO:teuthology.orchestra.run.smithi142.stdout: openblas-0.3.21-2.el9.x86_64 2023-12-12T09:42:14.128 INFO:teuthology.orchestra.run.smithi142.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2023-12-12T09:42:14.128 INFO:teuthology.orchestra.run.smithi142.stdout: openssl-devel-1:3.0.7-25.el9.x86_64 2023-12-12T09:42:14.128 INFO:teuthology.orchestra.run.smithi142.stdout: parquet-libs-9.0.0-10.el9.x86_64 2023-12-12T09:42:14.128 INFO:teuthology.orchestra.run.smithi142.stdout: postgresql-13.11-1.el9.x86_64 2023-12-12T09:42:14.129 INFO:teuthology.orchestra.run.smithi142.stdout: postgresql-contrib-13.11-1.el9.x86_64 2023-12-12T09:42:14.129 INFO:teuthology.orchestra.run.smithi142.stdout: postgresql-private-libs-13.11-1.el9.x86_64 2023-12-12T09:42:14.129 INFO:teuthology.orchestra.run.smithi142.stdout: postgresql-server-13.11-1.el9.x86_64 2023-12-12T09:42:14.129 INFO:teuthology.orchestra.run.smithi142.stdout: python3-asyncssh-2.13.2-3.el9.noarch 2023-12-12T09:42:14.129 INFO:teuthology.orchestra.run.smithi142.stdout: python3-babel-2.9.1-2.el9.noarch 2023-12-12T09:42:14.129 INFO:teuthology.orchestra.run.smithi142.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2023-12-12T09:42:14.130 INFO:teuthology.orchestra.run.smithi142.stdout: python3-cachetools-4.2.4-1.el9.noarch 2023-12-12T09:42:14.130 INFO:teuthology.orchestra.run.smithi142.stdout: python3-ceph-argparse-2:19.0.0-96.gf1fbf3c5.el9.x86_64 2023-12-12T09:42:14.130 INFO:teuthology.orchestra.run.smithi142.stdout: python3-ceph-common-2:19.0.0-96.gf1fbf3c5.el9.x86_64 2023-12-12T09:42:14.130 INFO:teuthology.orchestra.run.smithi142.stdout: python3-cephfs-2:19.0.0-96.gf1fbf3c5.el9.x86_64 2023-12-12T09:42:14.131 INFO:teuthology.orchestra.run.smithi142.stdout: python3-certifi-2021.10.8-2.el9.noarch 2023-12-12T09:42:14.131 INFO:teuthology.orchestra.run.smithi142.stdout: python3-cffi-1.14.5-5.el9.x86_64 2023-12-12T09:42:14.131 INFO:teuthology.orchestra.run.smithi142.stdout: python3-cheroot-8.6.0-4.el9.noarch 2023-12-12T09:42:14.131 INFO:teuthology.orchestra.run.smithi142.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2023-12-12T09:42:14.131 INFO:teuthology.orchestra.run.smithi142.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2023-12-12T09:42:14.131 INFO:teuthology.orchestra.run.smithi142.stdout: python3-devel-3.9.17-2.el9.x86_64 2023-12-12T09:42:14.131 INFO:teuthology.orchestra.run.smithi142.stdout: python3-google-auth-1:2.23.4-1.el9.noarch 2023-12-12T09:42:14.131 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jaraco-8.2.1-3.el9.noarch 2023-12-12T09:42:14.131 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2023-12-12T09:42:14.131 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2023-12-12T09:42:14.131 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2023-12-12T09:42:14.132 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2023-12-12T09:42:14.132 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jinja2-2.11.3-4.el9.noarch 2023-12-12T09:42:14.132 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jsonpatch-1.21-16.el9.noarch 2023-12-12T09:42:14.132 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jsonpointer-2.0-4.el9.noarch 2023-12-12T09:42:14.132 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jwt-2.4.0-1.el9.noarch 2023-12-12T09:42:14.132 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jwt+crypto-2.4.0-1.el9.noarch 2023-12-12T09:42:14.132 INFO:teuthology.orchestra.run.smithi142.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2023-12-12T09:42:14.132 INFO:teuthology.orchestra.run.smithi142.stdout: python3-logutils-0.3.5-21.el9.noarch 2023-12-12T09:42:14.133 INFO:teuthology.orchestra.run.smithi142.stdout: python3-mako-1.1.4-6.el9.noarch 2023-12-12T09:42:14.133 INFO:teuthology.orchestra.run.smithi142.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2023-12-12T09:42:14.133 INFO:teuthology.orchestra.run.smithi142.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2023-12-12T09:42:14.133 INFO:teuthology.orchestra.run.smithi142.stdout: python3-natsort-7.1.1-5.el9.noarch 2023-12-12T09:42:14.133 INFO:teuthology.orchestra.run.smithi142.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2023-12-12T09:42:14.133 INFO:teuthology.orchestra.run.smithi142.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2023-12-12T09:42:14.134 INFO:teuthology.orchestra.run.smithi142.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2023-12-12T09:42:14.134 INFO:teuthology.orchestra.run.smithi142.stdout: python3-pecan-1.4.2-3.el9.noarch 2023-12-12T09:42:14.134 INFO:teuthology.orchestra.run.smithi142.stdout: python3-ply-3.11-14.el9.noarch 2023-12-12T09:42:14.134 INFO:teuthology.orchestra.run.smithi142.stdout: python3-portend-3.1.0-2.el9.noarch 2023-12-12T09:42:14.134 INFO:teuthology.orchestra.run.smithi142.stdout: python3-prettytable-0.7.2-27.el9.noarch 2023-12-12T09:42:14.135 INFO:teuthology.orchestra.run.smithi142.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2023-12-12T09:42:14.135 INFO:teuthology.orchestra.run.smithi142.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2023-12-12T09:42:14.135 INFO:teuthology.orchestra.run.smithi142.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2023-12-12T09:42:14.135 INFO:teuthology.orchestra.run.smithi142.stdout: python3-pycparser-2.20-6.el9.noarch 2023-12-12T09:42:14.135 INFO:teuthology.orchestra.run.smithi142.stdout: python3-pytz-2021.1-5.el9.noarch 2023-12-12T09:42:14.135 INFO:teuthology.orchestra.run.smithi142.stdout: python3-rados-2:19.0.0-96.gf1fbf3c5.el9.x86_64 2023-12-12T09:42:14.135 INFO:teuthology.orchestra.run.smithi142.stdout: python3-rbd-2:19.0.0-96.gf1fbf3c5.el9.x86_64 2023-12-12T09:42:14.136 INFO:teuthology.orchestra.run.smithi142.stdout: python3-repoze-lru-0.7-16.el9.noarch 2023-12-12T09:42:14.136 INFO:teuthology.orchestra.run.smithi142.stdout: python3-requests-2.25.1-7.el9.noarch 2023-12-12T09:42:14.136 INFO:teuthology.orchestra.run.smithi142.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2023-12-12T09:42:14.136 INFO:teuthology.orchestra.run.smithi142.stdout: python3-rgw-2:19.0.0-96.gf1fbf3c5.el9.x86_64 2023-12-12T09:42:14.136 INFO:teuthology.orchestra.run.smithi142.stdout: python3-routes-2.5.1-5.el9.noarch 2023-12-12T09:42:14.136 INFO:teuthology.orchestra.run.smithi142.stdout: python3-rsa-4.9-2.el9.noarch 2023-12-12T09:42:14.136 INFO:teuthology.orchestra.run.smithi142.stdout: python3-scipy-1.6.2-8.el9.x86_64 2023-12-12T09:42:14.136 INFO:teuthology.orchestra.run.smithi142.stdout: python3-tempora-5.0.0-2.el9.noarch 2023-12-12T09:42:14.136 INFO:teuthology.orchestra.run.smithi142.stdout: python3-toml-0.10.2-6.el9.noarch 2023-12-12T09:42:14.136 INFO:teuthology.orchestra.run.smithi142.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2023-12-12T09:42:14.136 INFO:teuthology.orchestra.run.smithi142.stdout: python3-urllib3-1.26.5-4.el9.noarch 2023-12-12T09:42:14.136 INFO:teuthology.orchestra.run.smithi142.stdout: python3-webob-1.8.7-6.el9.noarch 2023-12-12T09:42:14.136 INFO:teuthology.orchestra.run.smithi142.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2023-12-12T09:42:14.137 INFO:teuthology.orchestra.run.smithi142.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2023-12-12T09:42:14.137 INFO:teuthology.orchestra.run.smithi142.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2023-12-12T09:42:14.137 INFO:teuthology.orchestra.run.smithi142.stdout: rbd-fuse-2:19.0.0-96.gf1fbf3c5.el9.x86_64 2023-12-12T09:42:14.137 INFO:teuthology.orchestra.run.smithi142.stdout: rbd-mirror-2:19.0.0-96.gf1fbf3c5.el9.x86_64 2023-12-12T09:42:14.137 INFO:teuthology.orchestra.run.smithi142.stdout: rbd-nbd-2:19.0.0-96.gf1fbf3c5.el9.x86_64 2023-12-12T09:42:14.137 INFO:teuthology.orchestra.run.smithi142.stdout: re2-1:20211101-3.el9.x86_64 2023-12-12T09:42:14.137 INFO:teuthology.orchestra.run.smithi142.stdout: socat-1.7.4.1-5.el9.x86_64 2023-12-12T09:42:14.137 INFO:teuthology.orchestra.run.smithi142.stdout: thrift-0.15.0-2.el9.x86_64 2023-12-12T09:42:14.137 INFO:teuthology.orchestra.run.smithi142.stdout: uuid-1.6.2-55.el9.x86_64 2023-12-12T09:42:14.137 INFO:teuthology.orchestra.run.smithi142.stdout: xfsprogs-devel-5.19.0-4.el9.x86_64 2023-12-12T09:42:14.137 INFO:teuthology.orchestra.run.smithi142.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2023-12-12T09:42:14.138 INFO:teuthology.orchestra.run.smithi142.stdout: zlib-devel-1.2.11-40.el9.x86_64 2023-12-12T09:42:14.138 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-12-12T09:42:14.138 INFO:teuthology.orchestra.run.smithi142.stdout:Complete! 2023-12-12T09:42:14.722 DEBUG:teuthology.parallel:result is None 2023-12-12T09:42:14.723 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=f1fbf3c583d03e19f5e58eb618e78d8e10d075f9 2023-12-12T09:42:14.946 DEBUG:teuthology.orchestra.run.smithi073:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-12-12T09:42:15.022 INFO:teuthology.orchestra.run.smithi073.stdout:19.0.0-96.gf1fbf3c5.el9 2023-12-12T09:42:15.023 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-96.gf1fbf3c5.el9 2023-12-12T09:42:15.023 INFO:teuthology.task.install:The correct ceph version 19.0.0-96.gf1fbf3c5 is installed. 2023-12-12T09:42:15.025 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=f1fbf3c583d03e19f5e58eb618e78d8e10d075f9 2023-12-12T09:42:15.246 DEBUG:teuthology.orchestra.run.smithi142:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-12-12T09:42:15.304 INFO:teuthology.orchestra.run.smithi142.stdout:19.0.0-96.gf1fbf3c5.el9 2023-12-12T09:42:15.304 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-96.gf1fbf3c5.el9 2023-12-12T09:42:15.304 INFO:teuthology.task.install:The correct ceph version 19.0.0-96.gf1fbf3c5 is installed. 2023-12-12T09:42:15.306 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2023-12-12T09:42:15.310 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2023-12-12T09:42:15.310 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-12-12T09:42:15.409 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2023-12-12T09:42:15.410 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-12-12T09:42:15.487 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2023-12-12T09:42:15.488 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2023-12-12T09:42:15.488 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd of=/usr/bin/daemon-helper 2023-12-12T09:42:15.572 DEBUG:teuthology.orchestra.run.smithi073:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-12-12T09:42:15.699 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2023-12-12T09:42:15.699 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd of=/usr/bin/daemon-helper 2023-12-12T09:42:15.774 DEBUG:teuthology.orchestra.run.smithi142:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-12-12T09:42:15.887 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2023-12-12T09:42:15.888 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2023-12-12T09:42:15.888 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd of=/usr/bin/adjust-ulimits 2023-12-12T09:42:15.975 DEBUG:teuthology.orchestra.run.smithi073:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-12-12T09:42:16.099 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2023-12-12T09:42:16.099 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd of=/usr/bin/adjust-ulimits 2023-12-12T09:42:16.188 DEBUG:teuthology.orchestra.run.smithi142:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-12-12T09:42:16.303 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2023-12-12T09:42:16.304 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2023-12-12T09:42:16.304 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd of=/usr/bin/stdin-killer 2023-12-12T09:42:16.392 DEBUG:teuthology.orchestra.run.smithi073:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-12-12T09:42:16.519 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2023-12-12T09:42:16.519 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd of=/usr/bin/stdin-killer 2023-12-12T09:42:16.604 DEBUG:teuthology.orchestra.run.smithi142:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-12-12T09:42:16.724 INFO:teuthology.run_tasks:Running task ceph... 2023-12-12T09:42:16.805 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2023-12-12T09:42:16.805 DEBUG:teuthology.orchestra.run.smithi073:> sudo chmod 777 /var/log/ceph 2023-12-12T09:42:16.815 DEBUG:teuthology.orchestra.run.smithi142:> sudo chmod 777 /var/log/ceph 2023-12-12T09:42:16.901 INFO:tasks.ceph:Disabling ceph logrotate... 2023-12-12T09:42:16.901 DEBUG:teuthology.orchestra.run.smithi073:> sudo rm -f -- /etc/logrotate.d/ceph 2023-12-12T09:42:16.910 DEBUG:teuthology.orchestra.run.smithi142:> sudo rm -f -- /etc/logrotate.d/ceph 2023-12-12T09:42:16.999 INFO:tasks.ceph:Creating extra log directories... 2023-12-12T09:42:16.999 DEBUG:teuthology.orchestra.run.smithi073:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-12-12T09:42:17.007 DEBUG:teuthology.orchestra.run.smithi142:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-12-12T09:42:17.103 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2023-12-12T09:42:17.103 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2023-12-12T09:42:17.104 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2023-12-12T09:42:17.104 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2023-12-12T09:42:17.104 DEBUG:teuthology.orchestra.run.smithi073:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-12-12T09:42:17.155 DEBUG:teuthology.orchestra.run.smithi073:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-12-12T09:42:17.423 DEBUG:teuthology.orchestra.run.smithi073:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2023-12-12T09:42:17.524 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2023-12-12T09:42:17.524 DEBUG:teuthology.orchestra.run.smithi142:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-12-12T09:42:17.572 DEBUG:teuthology.orchestra.run.smithi142:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-12-12T09:42:17.786 DEBUG:teuthology.orchestra.run.smithi142:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2023-12-12T09:42:17.863 INFO:tasks.ceph:Creating ceph cluster ceph... 2023-12-12T09:42:17.863 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2023-12-12T09:42:17.864 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/mchangir-2023-12-12_08:46:52-fs-wip-mchangir-testing-20231205.064351-testing-default-smithi/7488201', 'branch': 'wip-mchangir-testing-20231205.064351', 'description': 'fs/multifs/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore-ec/bluestore-comp overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug} tasks/multifs-auth}', 'email': 'mchangir@redhat.com', 'first_in_suite': False, 'job_id': '7488201', 'kernel': {'client': {'branch': 'testing'}, 'flavor': 'default', 'kdb': True, 'sha1': 'cd68252d7b4d7802f3cae7f5945b38e9b20dad4c'}, 'ktype': 'upstream', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'mchangir-2023-12-12_08:46:52-fs-wip-mchangir-testing-20231205.064351-testing-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'wip-mchangir-testing-20231205.064351'}, 'ceph': {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'sha1': 'f1fbf3c583d03e19f5e58eb618e78d8e10d075f9'}, 'ceph-deploy': {'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}}}, 'install': {'ceph': {'flavor': 'default', 'sha1': 'f1fbf3c583d03e19f5e58eb618e78d8e10d075f9'}}, 'kclient': {'syntax': 'v2'}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-mchangir-testing-20231205.064351', 'sha1': 'f1fbf3c583d03e19f5e58eb618e78d8e10d075f9'}}, 'owner': 'mchangir', 'priority': 1000, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1']], 'seed': 5473, 'sha1': 'f1fbf3c583d03e19f5e58eb618e78d8e10d075f9', 'sleep_before_teardown': 0, 'subset': '600/1024', 'suite': 'fs', 'suite_branch': 'wip-mchangir-testing-20231205.064351', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_f1fbf3c583d03e19f5e58eb618e78d8e10d075f9/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': 'f1fbf3c583d03e19f5e58eb618e78d8e10d075f9', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi073.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJfB+WnNO4Q4SywKPSkwZk2/Zd+Ney84PpLBglK+6wh/UIsK2PKGkXlyhKIqM6MCW47LpVlYo3PbTYTXrBstD2U=', 'smithi142.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPU8jjooQsHvVnYhduA/IXP/8/qDJskzOBkP387Siv1tz3bzcf4gua6HdskSn2d7JQH3l7TUJJ+oYyUwVWO8lA0='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'client': {'branch': 'testing'}, 'flavor': 'default', 'kdb': True, 'sha1': 'cd68252d7b4d7802f3cae7f5945b38e9b20dad4c'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'f1fbf3c583d03e19f5e58eb618e78d8e10d075f9'}}, {'ceph': {'create_rbd_pool': False, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'sha1': 'f1fbf3c583d03e19f5e58eb618e78d8e10d075f9', 'cluster': 'ceph'}}, {'kclient': None}, {'cephfs_test_runner': {'fail_on_skip': False, 'modules': ['tasks.cephfs.test_multifs_auth']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ["local function is_kupstream() return yaml.ktype == 'upstream' end", "local function is_kdistro() return yaml.ktype == 'distro' end", 'local function is_fuse() return false end', 'local function syntax_version() return yaml.overrides.kclient.syntax end']}, 'teuthology_branch': 'main', 'teuthology_sha1': '5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73', 'timestamp': '2023-12-12_08:46:52', 'tube': 'smithi', 'user': 'mchangir', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.232157'} 2023-12-12T09:42:17.864 DEBUG:teuthology.orchestra.run.smithi073:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-12-12T09:42:17.873 DEBUG:teuthology.orchestra.run.smithi142:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-12-12T09:42:17.924 DEBUG:teuthology.orchestra.run.smithi073:> sudo install -d -m0777 -- /var/run/ceph 2023-12-12T09:42:17.930 DEBUG:teuthology.orchestra.run.smithi142:> sudo install -d -m0777 -- /var/run/ceph 2023-12-12T09:42:18.036 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2023-12-12T09:42:18.037 DEBUG:teuthology.orchestra.run.smithi073:> dd if=/scratch_devs of=/dev/stdout 2023-12-12T09:42:18.096 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-12-12T09:42:18.097 DEBUG:teuthology.orchestra.run.smithi073:> stat /dev/vg_nvme/lv_1 2023-12-12T09:42:18.148 INFO:teuthology.orchestra.run.smithi073.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-12-12T09:42:18.149 INFO:teuthology.orchestra.run.smithi073.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-12T09:42:18.149 INFO:teuthology.orchestra.run.smithi073.stdout:Device: 5h/5d Inode: 632 Links: 1 2023-12-12T09:42:18.149 INFO:teuthology.orchestra.run.smithi073.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-12T09:42:18.149 INFO:teuthology.orchestra.run.smithi073.stdout:Context: system_u:object_r:device_t:s0 2023-12-12T09:42:18.149 INFO:teuthology.orchestra.run.smithi073.stdout:Access: 2023-12-12 09:42:00.059356153 +0000 2023-12-12T09:42:18.149 INFO:teuthology.orchestra.run.smithi073.stdout:Modify: 2023-12-12 09:39:33.699395564 +0000 2023-12-12T09:42:18.149 INFO:teuthology.orchestra.run.smithi073.stdout:Change: 2023-12-12 09:39:33.699395564 +0000 2023-12-12T09:42:18.149 INFO:teuthology.orchestra.run.smithi073.stdout: Birth: 2023-12-12 09:39:33.699395564 +0000 2023-12-12T09:42:18.149 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-12-12T09:42:18.230 INFO:teuthology.orchestra.run.smithi073.stderr:1+0 records in 2023-12-12T09:42:18.231 INFO:teuthology.orchestra.run.smithi073.stderr:1+0 records out 2023-12-12T09:42:18.231 INFO:teuthology.orchestra.run.smithi073.stderr:512 bytes copied, 0.000360178 s, 1.4 MB/s 2023-12-12T09:42:18.234 DEBUG:teuthology.orchestra.run.smithi073:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-12-12T09:42:18.288 DEBUG:teuthology.orchestra.run.smithi073:> stat /dev/vg_nvme/lv_2 2023-12-12T09:42:18.349 INFO:teuthology.orchestra.run.smithi073.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-12-12T09:42:18.349 INFO:teuthology.orchestra.run.smithi073.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-12T09:42:18.349 INFO:teuthology.orchestra.run.smithi073.stdout:Device: 5h/5d Inode: 652 Links: 1 2023-12-12T09:42:18.349 INFO:teuthology.orchestra.run.smithi073.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-12T09:42:18.349 INFO:teuthology.orchestra.run.smithi073.stdout:Context: system_u:object_r:device_t:s0 2023-12-12T09:42:18.349 INFO:teuthology.orchestra.run.smithi073.stdout:Access: 2023-12-12 09:42:00.059356153 +0000 2023-12-12T09:42:18.349 INFO:teuthology.orchestra.run.smithi073.stdout:Modify: 2023-12-12 09:39:34.743370928 +0000 2023-12-12T09:42:18.350 INFO:teuthology.orchestra.run.smithi073.stdout:Change: 2023-12-12 09:39:34.743370928 +0000 2023-12-12T09:42:18.350 INFO:teuthology.orchestra.run.smithi073.stdout: Birth: 2023-12-12 09:39:34.743370928 +0000 2023-12-12T09:42:18.350 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-12-12T09:42:18.440 INFO:teuthology.orchestra.run.smithi073.stderr:1+0 records in 2023-12-12T09:42:18.440 INFO:teuthology.orchestra.run.smithi073.stderr:1+0 records out 2023-12-12T09:42:18.440 INFO:teuthology.orchestra.run.smithi073.stderr:512 bytes copied, 0.000314102 s, 1.6 MB/s 2023-12-12T09:42:18.444 DEBUG:teuthology.orchestra.run.smithi073:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-12-12T09:42:18.509 DEBUG:teuthology.orchestra.run.smithi073:> stat /dev/vg_nvme/lv_3 2023-12-12T09:42:18.562 INFO:teuthology.orchestra.run.smithi073.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-12-12T09:42:18.563 INFO:teuthology.orchestra.run.smithi073.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-12T09:42:18.563 INFO:teuthology.orchestra.run.smithi073.stdout:Device: 5h/5d Inode: 669 Links: 1 2023-12-12T09:42:18.563 INFO:teuthology.orchestra.run.smithi073.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-12T09:42:18.563 INFO:teuthology.orchestra.run.smithi073.stdout:Context: system_u:object_r:device_t:s0 2023-12-12T09:42:18.563 INFO:teuthology.orchestra.run.smithi073.stdout:Access: 2023-12-12 09:42:00.060356130 +0000 2023-12-12T09:42:18.563 INFO:teuthology.orchestra.run.smithi073.stdout:Modify: 2023-12-12 09:39:35.812345702 +0000 2023-12-12T09:42:18.563 INFO:teuthology.orchestra.run.smithi073.stdout:Change: 2023-12-12 09:39:35.812345702 +0000 2023-12-12T09:42:18.563 INFO:teuthology.orchestra.run.smithi073.stdout: Birth: 2023-12-12 09:39:35.812345702 +0000 2023-12-12T09:42:18.563 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-12-12T09:42:18.650 INFO:teuthology.orchestra.run.smithi073.stderr:1+0 records in 2023-12-12T09:42:18.650 INFO:teuthology.orchestra.run.smithi073.stderr:1+0 records out 2023-12-12T09:42:18.650 INFO:teuthology.orchestra.run.smithi073.stderr:512 bytes copied, 0.000314097 s, 1.6 MB/s 2023-12-12T09:42:18.654 DEBUG:teuthology.orchestra.run.smithi073:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-12-12T09:42:18.708 DEBUG:teuthology.orchestra.run.smithi073:> stat /dev/vg_nvme/lv_4 2023-12-12T09:42:18.757 INFO:teuthology.orchestra.run.smithi073.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-12-12T09:42:18.757 INFO:teuthology.orchestra.run.smithi073.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-12T09:42:18.757 INFO:teuthology.orchestra.run.smithi073.stdout:Device: 5h/5d Inode: 691 Links: 1 2023-12-12T09:42:18.757 INFO:teuthology.orchestra.run.smithi073.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-12T09:42:18.757 INFO:teuthology.orchestra.run.smithi073.stdout:Context: system_u:object_r:device_t:s0 2023-12-12T09:42:18.757 INFO:teuthology.orchestra.run.smithi073.stdout:Access: 2023-12-12 09:42:00.061356107 +0000 2023-12-12T09:42:18.757 INFO:teuthology.orchestra.run.smithi073.stdout:Modify: 2023-12-12 09:39:36.881320477 +0000 2023-12-12T09:42:18.758 INFO:teuthology.orchestra.run.smithi073.stdout:Change: 2023-12-12 09:39:36.881320477 +0000 2023-12-12T09:42:18.758 INFO:teuthology.orchestra.run.smithi073.stdout: Birth: 2023-12-12 09:39:36.881320477 +0000 2023-12-12T09:42:18.758 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-12-12T09:42:18.893 INFO:teuthology.orchestra.run.smithi073.stderr:1+0 records in 2023-12-12T09:42:18.894 INFO:teuthology.orchestra.run.smithi073.stderr:1+0 records out 2023-12-12T09:42:18.894 INFO:teuthology.orchestra.run.smithi073.stderr:512 bytes copied, 0.000307001 s, 1.7 MB/s 2023-12-12T09:42:18.897 DEBUG:teuthology.orchestra.run.smithi073:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-12-12T09:42:18.950 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-12-12T09:42:18.950 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2023-12-12T09:42:18.950 DEBUG:teuthology.orchestra.run.smithi142:> dd if=/scratch_devs of=/dev/stdout 2023-12-12T09:42:19.007 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-12-12T09:42:19.008 DEBUG:teuthology.orchestra.run.smithi142:> stat /dev/vg_nvme/lv_1 2023-12-12T09:42:19.049 INFO:teuthology.orchestra.run.smithi142.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-12-12T09:42:19.049 INFO:teuthology.orchestra.run.smithi142.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-12T09:42:19.049 INFO:teuthology.orchestra.run.smithi142.stdout:Device: 5h/5d Inode: 632 Links: 1 2023-12-12T09:42:19.049 INFO:teuthology.orchestra.run.smithi142.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-12T09:42:19.049 INFO:teuthology.orchestra.run.smithi142.stdout:Context: system_u:object_r:device_t:s0 2023-12-12T09:42:19.049 INFO:teuthology.orchestra.run.smithi142.stdout:Access: 2023-12-12 09:42:07.787230963 +0000 2023-12-12T09:42:19.049 INFO:teuthology.orchestra.run.smithi142.stdout:Modify: 2023-12-12 09:39:30.007000008 +0000 2023-12-12T09:42:19.049 INFO:teuthology.orchestra.run.smithi142.stdout:Change: 2023-12-12 09:39:30.007000008 +0000 2023-12-12T09:42:19.049 INFO:teuthology.orchestra.run.smithi142.stdout: Birth: 2023-12-12 09:39:30.007000008 +0000 2023-12-12T09:42:19.050 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-12-12T09:42:19.163 INFO:teuthology.orchestra.run.smithi142.stderr:1+0 records in 2023-12-12T09:42:19.163 INFO:teuthology.orchestra.run.smithi142.stderr:1+0 records out 2023-12-12T09:42:19.163 INFO:teuthology.orchestra.run.smithi142.stderr:512 bytes copied, 0.000352813 s, 1.5 MB/s 2023-12-12T09:42:19.167 DEBUG:teuthology.orchestra.run.smithi142:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-12-12T09:42:19.209 DEBUG:teuthology.orchestra.run.smithi142:> stat /dev/vg_nvme/lv_2 2023-12-12T09:42:19.293 INFO:teuthology.orchestra.run.smithi142.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-12-12T09:42:19.293 INFO:teuthology.orchestra.run.smithi142.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-12T09:42:19.293 INFO:teuthology.orchestra.run.smithi142.stdout:Device: 5h/5d Inode: 652 Links: 1 2023-12-12T09:42:19.293 INFO:teuthology.orchestra.run.smithi142.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-12T09:42:19.293 INFO:teuthology.orchestra.run.smithi142.stdout:Context: system_u:object_r:device_t:s0 2023-12-12T09:42:19.293 INFO:teuthology.orchestra.run.smithi142.stdout:Access: 2023-12-12 09:42:07.787230963 +0000 2023-12-12T09:42:19.293 INFO:teuthology.orchestra.run.smithi142.stdout:Modify: 2023-12-12 09:39:31.039979862 +0000 2023-12-12T09:42:19.293 INFO:teuthology.orchestra.run.smithi142.stdout:Change: 2023-12-12 09:39:31.039979862 +0000 2023-12-12T09:42:19.294 INFO:teuthology.orchestra.run.smithi142.stdout: Birth: 2023-12-12 09:39:31.039979862 +0000 2023-12-12T09:42:19.294 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-12-12T09:42:19.427 INFO:teuthology.orchestra.run.smithi142.stderr:1+0 records in 2023-12-12T09:42:19.427 INFO:teuthology.orchestra.run.smithi142.stderr:1+0 records out 2023-12-12T09:42:19.427 INFO:teuthology.orchestra.run.smithi142.stderr:512 bytes copied, 0.000343058 s, 1.5 MB/s 2023-12-12T09:42:19.431 DEBUG:teuthology.orchestra.run.smithi142:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-12-12T09:42:19.486 DEBUG:teuthology.orchestra.run.smithi142:> stat /dev/vg_nvme/lv_3 2023-12-12T09:42:19.536 INFO:teuthology.orchestra.run.smithi142.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-12-12T09:42:19.536 INFO:teuthology.orchestra.run.smithi142.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-12T09:42:19.536 INFO:teuthology.orchestra.run.smithi142.stdout:Device: 5h/5d Inode: 669 Links: 1 2023-12-12T09:42:19.536 INFO:teuthology.orchestra.run.smithi142.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-12T09:42:19.536 INFO:teuthology.orchestra.run.smithi142.stdout:Context: system_u:object_r:device_t:s0 2023-12-12T09:42:19.536 INFO:teuthology.orchestra.run.smithi142.stdout:Access: 2023-12-12 09:42:07.788230944 +0000 2023-12-12T09:42:19.536 INFO:teuthology.orchestra.run.smithi142.stdout:Modify: 2023-12-12 09:39:32.133958527 +0000 2023-12-12T09:42:19.536 INFO:teuthology.orchestra.run.smithi142.stdout:Change: 2023-12-12 09:39:32.133958527 +0000 2023-12-12T09:42:19.536 INFO:teuthology.orchestra.run.smithi142.stdout: Birth: 2023-12-12 09:39:32.133958527 +0000 2023-12-12T09:42:19.537 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-12-12T09:42:19.617 INFO:teuthology.orchestra.run.smithi142.stderr:1+0 records in 2023-12-12T09:42:19.617 INFO:teuthology.orchestra.run.smithi142.stderr:1+0 records out 2023-12-12T09:42:19.617 INFO:teuthology.orchestra.run.smithi142.stderr:512 bytes copied, 0.000889225 s, 576 kB/s 2023-12-12T09:42:19.619 DEBUG:teuthology.orchestra.run.smithi142:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-12-12T09:42:19.671 DEBUG:teuthology.orchestra.run.smithi142:> stat /dev/vg_nvme/lv_4 2023-12-12T09:42:19.716 INFO:teuthology.orchestra.run.smithi142.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-12-12T09:42:19.717 INFO:teuthology.orchestra.run.smithi142.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-12T09:42:19.717 INFO:teuthology.orchestra.run.smithi142.stdout:Device: 5h/5d Inode: 691 Links: 1 2023-12-12T09:42:19.717 INFO:teuthology.orchestra.run.smithi142.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-12T09:42:19.717 INFO:teuthology.orchestra.run.smithi142.stdout:Context: system_u:object_r:device_t:s0 2023-12-12T09:42:19.717 INFO:teuthology.orchestra.run.smithi142.stdout:Access: 2023-12-12 09:42:07.789230924 +0000 2023-12-12T09:42:19.718 INFO:teuthology.orchestra.run.smithi142.stdout:Modify: 2023-12-12 09:39:33.179938127 +0000 2023-12-12T09:42:19.718 INFO:teuthology.orchestra.run.smithi142.stdout:Change: 2023-12-12 09:39:33.180938108 +0000 2023-12-12T09:42:19.718 INFO:teuthology.orchestra.run.smithi142.stdout: Birth: 2023-12-12 09:39:33.179938127 +0000 2023-12-12T09:42:19.718 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-12-12T09:42:19.855 INFO:teuthology.orchestra.run.smithi142.stderr:1+0 records in 2023-12-12T09:42:19.855 INFO:teuthology.orchestra.run.smithi142.stderr:1+0 records out 2023-12-12T09:42:19.855 INFO:teuthology.orchestra.run.smithi142.stderr:512 bytes copied, 0.000380553 s, 1.3 MB/s 2023-12-12T09:42:19.859 DEBUG:teuthology.orchestra.run.smithi142:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-12-12T09:42:19.918 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-12-12T09:42:19.918 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi073.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi142.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-12-12T09:42:19.919 INFO:tasks.ceph:Generating config... 2023-12-12T09:42:19.920 INFO:tasks.ceph:[client] client mount timeout = 600 2023-12-12T09:42:19.920 INFO:tasks.ceph:[client] debug client = 20 2023-12-12T09:42:19.920 INFO:tasks.ceph:[client] debug ms = 1 2023-12-12T09:42:19.920 INFO:tasks.ceph:[client] rados mon op timeout = 900 2023-12-12T09:42:19.920 INFO:tasks.ceph:[client] rados osd op timeout = 900 2023-12-12T09:42:19.920 INFO:tasks.ceph:[global] ms die on skipped message = False 2023-12-12T09:42:19.921 INFO:tasks.ceph:[mds] debug mds = 20 2023-12-12T09:42:19.921 INFO:tasks.ceph:[mds] debug mds balancer = 20 2023-12-12T09:42:19.921 INFO:tasks.ceph:[mds] debug ms = 1 2023-12-12T09:42:19.921 INFO:tasks.ceph:[mds] mds debug frag = True 2023-12-12T09:42:19.921 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2023-12-12T09:42:19.921 INFO:tasks.ceph:[mds] mds op complaint time = 180 2023-12-12T09:42:19.921 INFO:tasks.ceph:[mds] mds verify scatter = True 2023-12-12T09:42:19.921 INFO:tasks.ceph:[mds] osd op complaint time = 180 2023-12-12T09:42:19.921 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2023-12-12T09:42:19.921 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2023-12-12T09:42:19.921 INFO:tasks.ceph:[mgr] debug mgr = 20 2023-12-12T09:42:19.921 INFO:tasks.ceph:[mgr] debug ms = 1 2023-12-12T09:42:19.921 INFO:tasks.ceph:[mon] debug mon = 20 2023-12-12T09:42:19.921 INFO:tasks.ceph:[mon] debug ms = 1 2023-12-12T09:42:19.921 INFO:tasks.ceph:[mon] debug paxos = 20 2023-12-12T09:42:19.922 INFO:tasks.ceph:[mon] mon op complaint time = 120 2023-12-12T09:42:19.922 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2023-12-12T09:42:19.922 INFO:tasks.ceph:[osd] bluestore compression mode = aggressive 2023-12-12T09:42:19.922 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2023-12-12T09:42:19.922 INFO:tasks.ceph:[osd] debug bluefs = 20 2023-12-12T09:42:19.922 INFO:tasks.ceph:[osd] debug bluestore = 20 2023-12-12T09:42:19.922 INFO:tasks.ceph:[osd] debug ms = 1 2023-12-12T09:42:19.922 INFO:tasks.ceph:[osd] debug osd = 20 2023-12-12T09:42:19.923 INFO:tasks.ceph:[osd] debug rocksdb = 10 2023-12-12T09:42:19.923 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2023-12-12T09:42:19.923 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2023-12-12T09:42:19.923 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2023-12-12T09:42:19.923 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2023-12-12T09:42:19.923 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2023-12-12T09:42:19.924 INFO:tasks.ceph:[osd] osd op complaint time = 180 2023-12-12T09:42:19.924 INFO:tasks.ceph:Setting up mon.a... 2023-12-12T09:42:19.924 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2023-12-12T09:42:20.073 INFO:teuthology.orchestra.run.smithi073.stdout:creating /etc/ceph/ceph.keyring 2023-12-12T09:42:20.082 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2023-12-12T09:42:20.211 DEBUG:teuthology.orchestra.run.smithi073:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-12-12T09:42:20.303 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.73'), ('mon.b', '172.21.15.142'), ('mon.c', '[v2:172.21.15.142:3301,v1:172.21.15.142:6790]')] 2023-12-12T09:42:20.304 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.73,172.21.15.142,[v2:172.21.15.142:3301,v1:172.21.15.142:6790]', 'ms die on skipped message': False}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bluestore block size': 96636764160, 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2023-12-12T09:42:20.305 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2023-12-12T09:42:20.305 DEBUG:teuthology.orchestra.run.smithi073:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2023-12-12T09:42:20.358 DEBUG:teuthology.orchestra.run.smithi073:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.73 --add b 172.21.15.142 --addv c '[v2:172.21.15.142:3301,v1:172.21.15.142:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2023-12-12T09:42:20.514 INFO:teuthology.orchestra.run.smithi073.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2023-12-12T09:42:20.515 INFO:teuthology.orchestra.run.smithi073.stdout:monmaptool: generated fsid ba240992-02b8-4c7e-92f2-27eb29ac433b 2023-12-12T09:42:20.515 INFO:teuthology.orchestra.run.smithi073.stdout:setting min_mon_release = pacific 2023-12-12T09:42:20.515 INFO:teuthology.orchestra.run.smithi073.stdout:epoch 0 2023-12-12T09:42:20.515 INFO:teuthology.orchestra.run.smithi073.stdout:fsid ba240992-02b8-4c7e-92f2-27eb29ac433b 2023-12-12T09:42:20.515 INFO:teuthology.orchestra.run.smithi073.stdout:last_changed 2023-12-12T09:42:20.515017+0000 2023-12-12T09:42:20.515 INFO:teuthology.orchestra.run.smithi073.stdout:created 2023-12-12T09:42:20.515017+0000 2023-12-12T09:42:20.516 INFO:teuthology.orchestra.run.smithi073.stdout:min_mon_release 16 (pacific) 2023-12-12T09:42:20.516 INFO:teuthology.orchestra.run.smithi073.stdout:election_strategy: 1 2023-12-12T09:42:20.516 INFO:teuthology.orchestra.run.smithi073.stdout:0: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.a 2023-12-12T09:42:20.516 INFO:teuthology.orchestra.run.smithi073.stdout:1: [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] mon.b 2023-12-12T09:42:20.516 INFO:teuthology.orchestra.run.smithi073.stdout:2: [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] mon.c 2023-12-12T09:42:20.516 INFO:teuthology.orchestra.run.smithi073.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2023-12-12T09:42:20.518 DEBUG:teuthology.orchestra.run.smithi073:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2023-12-12T09:42:20.575 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID ba240992-02b8-4c7e-92f2-27eb29ac433b... 2023-12-12T09:42:20.577 DEBUG:teuthology.orchestra.run.smithi073:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-12-12T09:42:20.582 DEBUG:teuthology.orchestra.run.smithi142:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-12-12T09:42:20.750 INFO:teuthology.orchestra.run.smithi073.stdout:[global] 2023-12-12T09:42:20.750 INFO:teuthology.orchestra.run.smithi073.stdout: chdir = "" 2023-12-12T09:42:20.750 INFO:teuthology.orchestra.run.smithi073.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-12-12T09:42:20.750 INFO:teuthology.orchestra.run.smithi073.stdout: auth supported = cephx 2023-12-12T09:42:20.750 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-12T09:42:20.750 INFO:teuthology.orchestra.run.smithi073.stdout: filestore xattr use omap = true 2023-12-12T09:42:20.750 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-12T09:42:20.750 INFO:teuthology.orchestra.run.smithi073.stdout: mon clock drift allowed = 1.000 2023-12-12T09:42:20.750 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-12T09:42:20.750 INFO:teuthology.orchestra.run.smithi073.stdout: osd crush chooseleaf type = 0 2023-12-12T09:42:20.751 INFO:teuthology.orchestra.run.smithi073.stdout: auth debug = true 2023-12-12T09:42:20.751 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-12T09:42:20.751 INFO:teuthology.orchestra.run.smithi073.stdout: ms die on old message = true 2023-12-12T09:42:20.751 INFO:teuthology.orchestra.run.smithi073.stdout: ms die on bug = true 2023-12-12T09:42:20.751 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-12T09:42:20.751 INFO:teuthology.orchestra.run.smithi073.stdout: mon max pg per osd = 10000 # >= luminous 2023-12-12T09:42:20.751 INFO:teuthology.orchestra.run.smithi073.stdout: mon pg warn max object skew = 0 2023-12-12T09:42:20.751 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-12T09:42:20.751 INFO:teuthology.orchestra.run.smithi073.stdout: # disable pg_autoscaler by default for new pools 2023-12-12T09:42:20.751 INFO:teuthology.orchestra.run.smithi073.stdout: osd_pool_default_pg_autoscale_mode = off 2023-12-12T09:42:20.751 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-12T09:42:20.752 INFO:teuthology.orchestra.run.smithi073.stdout: osd pool default size = 2 2023-12-12T09:42:20.752 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-12T09:42:20.752 INFO:teuthology.orchestra.run.smithi073.stdout: mon osd allow primary affinity = true 2023-12-12T09:42:20.752 INFO:teuthology.orchestra.run.smithi073.stdout: mon osd allow pg remap = true 2023-12-12T09:42:20.752 INFO:teuthology.orchestra.run.smithi073.stdout: mon warn on legacy crush tunables = false 2023-12-12T09:42:20.752 INFO:teuthology.orchestra.run.smithi073.stdout: mon warn on crush straw calc version zero = false 2023-12-12T09:42:20.752 INFO:teuthology.orchestra.run.smithi073.stdout: mon warn on no sortbitwise = false 2023-12-12T09:42:20.752 INFO:teuthology.orchestra.run.smithi073.stdout: mon warn on osd down out interval zero = false 2023-12-12T09:42:20.752 INFO:teuthology.orchestra.run.smithi073.stdout: mon warn on too few osds = false 2023-12-12T09:42:20.752 INFO:teuthology.orchestra.run.smithi073.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-12-12T09:42:20.752 INFO:teuthology.orchestra.run.smithi073.stdout: mon_warn_on_pool_no_redundancy = false 2023-12-12T09:42:20.752 INFO:teuthology.orchestra.run.smithi073.stdout: mon_allow_pool_size_one = true 2023-12-12T09:42:20.752 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-12T09:42:20.752 INFO:teuthology.orchestra.run.smithi073.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-12-12T09:42:20.752 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-12T09:42:20.752 INFO:teuthology.orchestra.run.smithi073.stdout: osd default data pool replay window = 5 2023-12-12T09:42:20.753 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-12T09:42:20.753 INFO:teuthology.orchestra.run.smithi073.stdout: mon allow pool delete = true 2023-12-12T09:42:20.753 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-12T09:42:20.753 INFO:teuthology.orchestra.run.smithi073.stdout: mon cluster log file level = debug 2023-12-12T09:42:20.753 INFO:teuthology.orchestra.run.smithi073.stdout: debug asserts on shutdown = true 2023-12-12T09:42:20.753 INFO:teuthology.orchestra.run.smithi073.stdout: mon health detail to clog = false 2023-12-12T09:42:20.753 INFO:teuthology.orchestra.run.smithi073.stdout: mon host = "172.21.15.73,172.21.15.142,[v2:172.21.15.142:3301,v1:172.21.15.142:6790]" 2023-12-12T09:42:20.753 INFO:teuthology.orchestra.run.smithi073.stdout: ms die on skipped message = False 2023-12-12T09:42:20.753 INFO:teuthology.orchestra.run.smithi073.stdout: fsid = ba240992-02b8-4c7e-92f2-27eb29ac433b 2023-12-12T09:42:20.753 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-12T09:42:20.753 INFO:teuthology.orchestra.run.smithi073.stdout:[osd] 2023-12-12T09:42:20.753 INFO:teuthology.orchestra.run.smithi073.stdout: osd journal size = 100 2023-12-12T09:42:20.753 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-12T09:42:20.753 INFO:teuthology.orchestra.run.smithi073.stdout: osd scrub load threshold = 5.0 2023-12-12T09:42:20.753 INFO:teuthology.orchestra.run.smithi073.stdout: osd scrub max interval = 600 2023-12-12T09:42:20.753 INFO:teuthology.orchestra.run.smithi073.stdout: osd mclock profile = high_recovery_ops 2023-12-12T09:42:20.754 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-12T09:42:20.754 INFO:teuthology.orchestra.run.smithi073.stdout: osd recover clone overlap = true 2023-12-12T09:42:20.754 INFO:teuthology.orchestra.run.smithi073.stdout: osd recovery max chunk = 1048576 2023-12-12T09:42:20.754 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-12T09:42:20.754 INFO:teuthology.orchestra.run.smithi073.stdout: osd debug shutdown = true 2023-12-12T09:42:20.754 INFO:teuthology.orchestra.run.smithi073.stdout: osd debug op order = true 2023-12-12T09:42:20.754 INFO:teuthology.orchestra.run.smithi073.stdout: osd debug verify stray on activate = true 2023-12-12T09:42:20.754 INFO:teuthology.orchestra.run.smithi073.stdout: osd debug trim objects = true 2023-12-12T09:42:20.754 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-12T09:42:20.754 INFO:teuthology.orchestra.run.smithi073.stdout: osd open classes on start = true 2023-12-12T09:42:20.755 INFO:teuthology.orchestra.run.smithi073.stdout: osd debug pg log writeout = true 2023-12-12T09:42:20.755 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-12T09:42:20.755 INFO:teuthology.orchestra.run.smithi073.stdout: osd deep scrub update digest min age = 30 2023-12-12T09:42:20.755 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-12T09:42:20.755 INFO:teuthology.orchestra.run.smithi073.stdout: osd map max advance = 10 2023-12-12T09:42:20.755 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-12T09:42:20.755 INFO:teuthology.orchestra.run.smithi073.stdout: journal zero on create = true 2023-12-12T09:42:20.755 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-12T09:42:20.755 INFO:teuthology.orchestra.run.smithi073.stdout: filestore ondisk finisher threads = 3 2023-12-12T09:42:20.755 INFO:teuthology.orchestra.run.smithi073.stdout: filestore apply finisher threads = 3 2023-12-12T09:42:20.755 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-12T09:42:20.756 INFO:teuthology.orchestra.run.smithi073.stdout: bdev debug aio = true 2023-12-12T09:42:20.756 INFO:teuthology.orchestra.run.smithi073.stdout: osd debug misdirected ops = true 2023-12-12T09:42:20.756 INFO:teuthology.orchestra.run.smithi073.stdout: bluestore block size = 96636764160 2023-12-12T09:42:20.756 INFO:teuthology.orchestra.run.smithi073.stdout: bluestore compression mode = aggressive 2023-12-12T09:42:20.756 INFO:teuthology.orchestra.run.smithi073.stdout: bluestore fsck on mount = True 2023-12-12T09:42:20.756 INFO:teuthology.orchestra.run.smithi073.stdout: debug bluefs = 20 2023-12-12T09:42:20.756 INFO:teuthology.orchestra.run.smithi073.stdout: debug bluestore = 20 2023-12-12T09:42:20.756 INFO:teuthology.orchestra.run.smithi073.stdout: debug ms = 1 2023-12-12T09:42:20.756 INFO:teuthology.orchestra.run.smithi073.stdout: debug osd = 20 2023-12-12T09:42:20.756 INFO:teuthology.orchestra.run.smithi073.stdout: debug rocksdb = 10 2023-12-12T09:42:20.757 INFO:teuthology.orchestra.run.smithi073.stdout: mon osd backfillfull_ratio = 0.85 2023-12-12T09:42:20.757 INFO:teuthology.orchestra.run.smithi073.stdout: mon osd full ratio = 0.9 2023-12-12T09:42:20.757 INFO:teuthology.orchestra.run.smithi073.stdout: mon osd nearfull ratio = 0.8 2023-12-12T09:42:20.757 INFO:teuthology.orchestra.run.smithi073.stdout: osd failsafe full ratio = 0.95 2023-12-12T09:42:20.757 INFO:teuthology.orchestra.run.smithi073.stdout: osd objectstore = bluestore 2023-12-12T09:42:20.757 INFO:teuthology.orchestra.run.smithi073.stdout: osd op complaint time = 180 2023-12-12T09:42:20.757 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-12T09:42:20.757 INFO:teuthology.orchestra.run.smithi073.stdout:[mgr] 2023-12-12T09:42:20.757 INFO:teuthology.orchestra.run.smithi073.stdout: debug ms = 1 2023-12-12T09:42:20.757 INFO:teuthology.orchestra.run.smithi073.stdout: debug mgr = 20 2023-12-12T09:42:20.757 INFO:teuthology.orchestra.run.smithi073.stdout: debug mon = 20 2023-12-12T09:42:20.757 INFO:teuthology.orchestra.run.smithi073.stdout: debug auth = 20 2023-12-12T09:42:20.757 INFO:teuthology.orchestra.run.smithi073.stdout: mon reweight min pgs per osd = 4 2023-12-12T09:42:20.757 INFO:teuthology.orchestra.run.smithi073.stdout: mon reweight min bytes per osd = 10 2023-12-12T09:42:20.757 INFO:teuthology.orchestra.run.smithi073.stdout: mgr/telemetry/nag = false 2023-12-12T09:42:20.758 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-12T09:42:20.758 INFO:teuthology.orchestra.run.smithi073.stdout:[mon] 2023-12-12T09:42:20.758 INFO:teuthology.orchestra.run.smithi073.stdout: debug ms = 1 2023-12-12T09:42:20.758 INFO:teuthology.orchestra.run.smithi073.stdout: debug mon = 20 2023-12-12T09:42:20.758 INFO:teuthology.orchestra.run.smithi073.stdout: debug paxos = 20 2023-12-12T09:42:20.758 INFO:teuthology.orchestra.run.smithi073.stdout: debug auth = 20 2023-12-12T09:42:20.758 INFO:teuthology.orchestra.run.smithi073.stdout: mon data avail warn = 5 2023-12-12T09:42:20.758 INFO:teuthology.orchestra.run.smithi073.stdout: mon mgr mkfs grace = 240 2023-12-12T09:42:20.758 INFO:teuthology.orchestra.run.smithi073.stdout: mon reweight min pgs per osd = 4 2023-12-12T09:42:20.758 INFO:teuthology.orchestra.run.smithi073.stdout: mon osd reporter subtree level = osd 2023-12-12T09:42:20.758 INFO:teuthology.orchestra.run.smithi073.stdout: mon osd prime pg temp = true 2023-12-12T09:42:20.758 INFO:teuthology.orchestra.run.smithi073.stdout: mon reweight min bytes per osd = 10 2023-12-12T09:42:20.759 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-12T09:42:20.759 INFO:teuthology.orchestra.run.smithi073.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-12-12T09:42:20.759 INFO:teuthology.orchestra.run.smithi073.stdout: auth mon ticket ttl = 660 # 11m 2023-12-12T09:42:20.759 INFO:teuthology.orchestra.run.smithi073.stdout: auth service ticket ttl = 240 # 4m 2023-12-12T09:42:20.759 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-12T09:42:20.759 INFO:teuthology.orchestra.run.smithi073.stdout: # don't complain about insecure global_id in the test suite 2023-12-12T09:42:20.759 INFO:teuthology.orchestra.run.smithi073.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-12-12T09:42:20.759 INFO:teuthology.orchestra.run.smithi073.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-12-12T09:42:20.759 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-12T09:42:20.759 INFO:teuthology.orchestra.run.smithi073.stdout: # 1m isn't quite enough 2023-12-12T09:42:20.759 INFO:teuthology.orchestra.run.smithi073.stdout: mon_down_mkfs_grace = 2m 2023-12-12T09:42:20.759 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-12T09:42:20.759 INFO:teuthology.orchestra.run.smithi073.stdout: mon_warn_on_filestore_osds = false 2023-12-12T09:42:20.760 INFO:teuthology.orchestra.run.smithi073.stdout: mon op complaint time = 120 2023-12-12T09:42:20.760 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-12T09:42:20.760 INFO:teuthology.orchestra.run.smithi073.stdout:[client] 2023-12-12T09:42:20.760 INFO:teuthology.orchestra.run.smithi073.stdout: rgw cache enabled = true 2023-12-12T09:42:20.760 INFO:teuthology.orchestra.run.smithi073.stdout: rgw enable ops log = true 2023-12-12T09:42:20.760 INFO:teuthology.orchestra.run.smithi073.stdout: rgw enable usage log = true 2023-12-12T09:42:20.760 INFO:teuthology.orchestra.run.smithi073.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-12-12T09:42:20.760 INFO:teuthology.orchestra.run.smithi073.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-12-12T09:42:20.760 INFO:teuthology.orchestra.run.smithi073.stdout: client mount timeout = 600 2023-12-12T09:42:20.760 INFO:teuthology.orchestra.run.smithi073.stdout: debug client = 20 2023-12-12T09:42:20.760 INFO:teuthology.orchestra.run.smithi073.stdout: debug ms = 1 2023-12-12T09:42:20.760 INFO:teuthology.orchestra.run.smithi073.stdout: rados mon op timeout = 900 2023-12-12T09:42:20.760 INFO:teuthology.orchestra.run.smithi073.stdout: rados osd op timeout = 900 2023-12-12T09:42:20.760 INFO:teuthology.orchestra.run.smithi073.stdout:[mon.a] 2023-12-12T09:42:20.761 INFO:teuthology.orchestra.run.smithi073.stdout:[mon.b] 2023-12-12T09:42:20.761 INFO:teuthology.orchestra.run.smithi073.stdout:[mon.c] 2023-12-12T09:42:20.761 INFO:teuthology.orchestra.run.smithi073.stdout:[mds.a] 2023-12-12T09:42:20.761 INFO:teuthology.orchestra.run.smithi073.stdout:[mds.c] 2023-12-12T09:42:20.761 INFO:teuthology.orchestra.run.smithi073.stdout:[mds.b] 2023-12-12T09:42:20.761 INFO:teuthology.orchestra.run.smithi073.stdout:[mds.d] 2023-12-12T09:42:20.761 INFO:teuthology.orchestra.run.smithi073.stdout:[mds] 2023-12-12T09:42:20.761 INFO:teuthology.orchestra.run.smithi073.stdout: debug mds = 20 2023-12-12T09:42:20.761 INFO:teuthology.orchestra.run.smithi073.stdout: debug mds balancer = 20 2023-12-12T09:42:20.761 INFO:teuthology.orchestra.run.smithi073.stdout: debug ms = 1 2023-12-12T09:42:20.761 INFO:teuthology.orchestra.run.smithi073.stdout: mds debug frag = True 2023-12-12T09:42:20.761 INFO:teuthology.orchestra.run.smithi073.stdout: mds debug scatterstat = True 2023-12-12T09:42:20.761 INFO:teuthology.orchestra.run.smithi073.stdout: mds op complaint time = 180 2023-12-12T09:42:20.762 INFO:teuthology.orchestra.run.smithi073.stdout: mds verify scatter = True 2023-12-12T09:42:20.762 INFO:teuthology.orchestra.run.smithi073.stdout: osd op complaint time = 180 2023-12-12T09:42:20.762 INFO:teuthology.orchestra.run.smithi073.stdout: rados mon op timeout = 900 2023-12-12T09:42:20.762 INFO:teuthology.orchestra.run.smithi073.stdout: rados osd op timeout = 900 2023-12-12T09:42:20.762 INFO:teuthology.orchestra.run.smithi142.stdout:[global] 2023-12-12T09:42:20.762 INFO:teuthology.orchestra.run.smithi142.stdout: chdir = "" 2023-12-12T09:42:20.762 INFO:teuthology.orchestra.run.smithi142.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-12-12T09:42:20.762 INFO:teuthology.orchestra.run.smithi142.stdout: auth supported = cephx 2023-12-12T09:42:20.762 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-12-12T09:42:20.763 INFO:teuthology.orchestra.run.smithi142.stdout: filestore xattr use omap = true 2023-12-12T09:42:20.763 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-12-12T09:42:20.763 INFO:teuthology.orchestra.run.smithi142.stdout: mon clock drift allowed = 1.000 2023-12-12T09:42:20.763 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-12-12T09:42:20.763 INFO:teuthology.orchestra.run.smithi142.stdout: osd crush chooseleaf type = 0 2023-12-12T09:42:20.763 INFO:teuthology.orchestra.run.smithi142.stdout: auth debug = true 2023-12-12T09:42:20.763 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-12-12T09:42:20.763 INFO:teuthology.orchestra.run.smithi142.stdout: ms die on old message = true 2023-12-12T09:42:20.763 INFO:teuthology.orchestra.run.smithi142.stdout: ms die on bug = true 2023-12-12T09:42:20.763 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-12-12T09:42:20.763 INFO:teuthology.orchestra.run.smithi142.stdout: mon max pg per osd = 10000 # >= luminous 2023-12-12T09:42:20.763 INFO:teuthology.orchestra.run.smithi142.stdout: mon pg warn max object skew = 0 2023-12-12T09:42:20.763 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-12-12T09:42:20.763 INFO:teuthology.orchestra.run.smithi142.stdout: # disable pg_autoscaler by default for new pools 2023-12-12T09:42:20.764 INFO:teuthology.orchestra.run.smithi142.stdout: osd_pool_default_pg_autoscale_mode = off 2023-12-12T09:42:20.764 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-12-12T09:42:20.764 INFO:teuthology.orchestra.run.smithi142.stdout: osd pool default size = 2 2023-12-12T09:42:20.764 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-12-12T09:42:20.764 INFO:teuthology.orchestra.run.smithi142.stdout: mon osd allow primary affinity = true 2023-12-12T09:42:20.764 INFO:teuthology.orchestra.run.smithi142.stdout: mon osd allow pg remap = true 2023-12-12T09:42:20.764 INFO:teuthology.orchestra.run.smithi142.stdout: mon warn on legacy crush tunables = false 2023-12-12T09:42:20.764 INFO:teuthology.orchestra.run.smithi142.stdout: mon warn on crush straw calc version zero = false 2023-12-12T09:42:20.764 INFO:teuthology.orchestra.run.smithi142.stdout: mon warn on no sortbitwise = false 2023-12-12T09:42:20.764 INFO:teuthology.orchestra.run.smithi142.stdout: mon warn on osd down out interval zero = false 2023-12-12T09:42:20.765 INFO:teuthology.orchestra.run.smithi142.stdout: mon warn on too few osds = false 2023-12-12T09:42:20.765 INFO:teuthology.orchestra.run.smithi142.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-12-12T09:42:20.765 INFO:teuthology.orchestra.run.smithi142.stdout: mon_warn_on_pool_no_redundancy = false 2023-12-12T09:42:20.765 INFO:teuthology.orchestra.run.smithi142.stdout: mon_allow_pool_size_one = true 2023-12-12T09:42:20.765 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-12-12T09:42:20.765 INFO:teuthology.orchestra.run.smithi142.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-12-12T09:42:20.765 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-12-12T09:42:20.765 INFO:teuthology.orchestra.run.smithi142.stdout: osd default data pool replay window = 5 2023-12-12T09:42:20.765 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-12-12T09:42:20.765 INFO:teuthology.orchestra.run.smithi142.stdout: mon allow pool delete = true 2023-12-12T09:42:20.766 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-12-12T09:42:20.766 INFO:teuthology.orchestra.run.smithi142.stdout: mon cluster log file level = debug 2023-12-12T09:42:20.766 INFO:teuthology.orchestra.run.smithi142.stdout: debug asserts on shutdown = true 2023-12-12T09:42:20.766 INFO:teuthology.orchestra.run.smithi142.stdout: mon health detail to clog = false 2023-12-12T09:42:20.766 INFO:teuthology.orchestra.run.smithi142.stdout: mon host = "172.21.15.73,172.21.15.142,[v2:172.21.15.142:3301,v1:172.21.15.142:6790]" 2023-12-12T09:42:20.766 INFO:teuthology.orchestra.run.smithi142.stdout: ms die on skipped message = False 2023-12-12T09:42:20.766 INFO:teuthology.orchestra.run.smithi142.stdout: fsid = ba240992-02b8-4c7e-92f2-27eb29ac433b 2023-12-12T09:42:20.766 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-12-12T09:42:20.767 INFO:teuthology.orchestra.run.smithi142.stdout:[osd] 2023-12-12T09:42:20.767 INFO:teuthology.orchestra.run.smithi142.stdout: osd journal size = 100 2023-12-12T09:42:20.767 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-12-12T09:42:20.767 INFO:teuthology.orchestra.run.smithi142.stdout: osd scrub load threshold = 5.0 2023-12-12T09:42:20.767 INFO:teuthology.orchestra.run.smithi142.stdout: osd scrub max interval = 600 2023-12-12T09:42:20.767 INFO:teuthology.orchestra.run.smithi142.stdout: osd mclock profile = high_recovery_ops 2023-12-12T09:42:20.767 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-12-12T09:42:20.767 INFO:teuthology.orchestra.run.smithi142.stdout: osd recover clone overlap = true 2023-12-12T09:42:20.767 INFO:teuthology.orchestra.run.smithi142.stdout: osd recovery max chunk = 1048576 2023-12-12T09:42:20.767 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-12-12T09:42:20.767 INFO:teuthology.orchestra.run.smithi142.stdout: osd debug shutdown = true 2023-12-12T09:42:20.768 INFO:teuthology.orchestra.run.smithi142.stdout: osd debug op order = true 2023-12-12T09:42:20.768 INFO:teuthology.orchestra.run.smithi142.stdout: osd debug verify stray on activate = true 2023-12-12T09:42:20.768 INFO:teuthology.orchestra.run.smithi142.stdout: osd debug trim objects = true 2023-12-12T09:42:20.768 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-12-12T09:42:20.768 INFO:teuthology.orchestra.run.smithi142.stdout: osd open classes on start = true 2023-12-12T09:42:20.768 INFO:teuthology.orchestra.run.smithi142.stdout: osd debug pg log writeout = true 2023-12-12T09:42:20.768 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-12-12T09:42:20.768 INFO:teuthology.orchestra.run.smithi142.stdout: osd deep scrub update digest min age = 30 2023-12-12T09:42:20.768 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-12-12T09:42:20.768 INFO:teuthology.orchestra.run.smithi142.stdout: osd map max advance = 10 2023-12-12T09:42:20.768 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-12-12T09:42:20.768 INFO:teuthology.orchestra.run.smithi142.stdout: journal zero on create = true 2023-12-12T09:42:20.768 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-12-12T09:42:20.768 INFO:teuthology.orchestra.run.smithi142.stdout: filestore ondisk finisher threads = 3 2023-12-12T09:42:20.769 INFO:teuthology.orchestra.run.smithi142.stdout: filestore apply finisher threads = 3 2023-12-12T09:42:20.769 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-12-12T09:42:20.769 INFO:teuthology.orchestra.run.smithi142.stdout: bdev debug aio = true 2023-12-12T09:42:20.769 INFO:teuthology.orchestra.run.smithi142.stdout: osd debug misdirected ops = true 2023-12-12T09:42:20.769 INFO:teuthology.orchestra.run.smithi142.stdout: bluestore block size = 96636764160 2023-12-12T09:42:20.769 INFO:teuthology.orchestra.run.smithi142.stdout: bluestore compression mode = aggressive 2023-12-12T09:42:20.769 INFO:teuthology.orchestra.run.smithi142.stdout: bluestore fsck on mount = True 2023-12-12T09:42:20.769 INFO:teuthology.orchestra.run.smithi142.stdout: debug bluefs = 20 2023-12-12T09:42:20.769 INFO:teuthology.orchestra.run.smithi142.stdout: debug bluestore = 20 2023-12-12T09:42:20.769 INFO:teuthology.orchestra.run.smithi142.stdout: debug ms = 1 2023-12-12T09:42:20.769 INFO:teuthology.orchestra.run.smithi142.stdout: debug osd = 20 2023-12-12T09:42:20.769 INFO:teuthology.orchestra.run.smithi142.stdout: debug rocksdb = 10 2023-12-12T09:42:20.769 INFO:teuthology.orchestra.run.smithi142.stdout: mon osd backfillfull_ratio = 0.85 2023-12-12T09:42:20.769 INFO:teuthology.orchestra.run.smithi142.stdout: mon osd full ratio = 0.9 2023-12-12T09:42:20.770 INFO:teuthology.orchestra.run.smithi142.stdout: mon osd nearfull ratio = 0.8 2023-12-12T09:42:20.770 INFO:teuthology.orchestra.run.smithi142.stdout: osd failsafe full ratio = 0.95 2023-12-12T09:42:20.770 INFO:teuthology.orchestra.run.smithi142.stdout: osd objectstore = bluestore 2023-12-12T09:42:20.770 INFO:teuthology.orchestra.run.smithi142.stdout: osd op complaint time = 180 2023-12-12T09:42:20.770 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-12-12T09:42:20.770 INFO:teuthology.orchestra.run.smithi142.stdout:[mgr] 2023-12-12T09:42:20.770 INFO:teuthology.orchestra.run.smithi142.stdout: debug ms = 1 2023-12-12T09:42:20.770 INFO:teuthology.orchestra.run.smithi142.stdout: debug mgr = 20 2023-12-12T09:42:20.770 INFO:teuthology.orchestra.run.smithi142.stdout: debug mon = 20 2023-12-12T09:42:20.770 INFO:teuthology.orchestra.run.smithi142.stdout: debug auth = 20 2023-12-12T09:42:20.770 INFO:teuthology.orchestra.run.smithi142.stdout: mon reweight min pgs per osd = 4 2023-12-12T09:42:20.770 INFO:teuthology.orchestra.run.smithi142.stdout: mon reweight min bytes per osd = 10 2023-12-12T09:42:20.771 INFO:teuthology.orchestra.run.smithi142.stdout: mgr/telemetry/nag = false 2023-12-12T09:42:20.771 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-12-12T09:42:20.771 INFO:teuthology.orchestra.run.smithi142.stdout:[mon] 2023-12-12T09:42:20.771 INFO:teuthology.orchestra.run.smithi142.stdout: debug ms = 1 2023-12-12T09:42:20.771 INFO:teuthology.orchestra.run.smithi142.stdout: debug mon = 20 2023-12-12T09:42:20.771 INFO:teuthology.orchestra.run.smithi142.stdout: debug paxos = 20 2023-12-12T09:42:20.771 INFO:teuthology.orchestra.run.smithi142.stdout: debug auth = 20 2023-12-12T09:42:20.771 INFO:teuthology.orchestra.run.smithi142.stdout: mon data avail warn = 5 2023-12-12T09:42:20.771 INFO:teuthology.orchestra.run.smithi142.stdout: mon mgr mkfs grace = 240 2023-12-12T09:42:20.771 INFO:teuthology.orchestra.run.smithi142.stdout: mon reweight min pgs per osd = 4 2023-12-12T09:42:20.771 INFO:teuthology.orchestra.run.smithi142.stdout: mon osd reporter subtree level = osd 2023-12-12T09:42:20.771 INFO:teuthology.orchestra.run.smithi142.stdout: mon osd prime pg temp = true 2023-12-12T09:42:20.771 INFO:teuthology.orchestra.run.smithi142.stdout: mon reweight min bytes per osd = 10 2023-12-12T09:42:20.771 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-12-12T09:42:20.772 INFO:teuthology.orchestra.run.smithi142.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-12-12T09:42:20.772 INFO:teuthology.orchestra.run.smithi142.stdout: auth mon ticket ttl = 660 # 11m 2023-12-12T09:42:20.772 INFO:teuthology.orchestra.run.smithi142.stdout: auth service ticket ttl = 240 # 4m 2023-12-12T09:42:20.772 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-12-12T09:42:20.772 INFO:teuthology.orchestra.run.smithi142.stdout: # don't complain about insecure global_id in the test suite 2023-12-12T09:42:20.772 INFO:teuthology.orchestra.run.smithi142.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-12-12T09:42:20.772 INFO:teuthology.orchestra.run.smithi142.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-12-12T09:42:20.772 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-12-12T09:42:20.772 INFO:teuthology.orchestra.run.smithi142.stdout: # 1m isn't quite enough 2023-12-12T09:42:20.772 INFO:teuthology.orchestra.run.smithi142.stdout: mon_down_mkfs_grace = 2m 2023-12-12T09:42:20.772 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-12-12T09:42:20.772 INFO:teuthology.orchestra.run.smithi142.stdout: mon_warn_on_filestore_osds = false 2023-12-12T09:42:20.773 INFO:teuthology.orchestra.run.smithi142.stdout: mon op complaint time = 120 2023-12-12T09:42:20.773 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-12-12T09:42:20.773 INFO:teuthology.orchestra.run.smithi142.stdout:[client] 2023-12-12T09:42:20.773 INFO:teuthology.orchestra.run.smithi142.stdout: rgw cache enabled = true 2023-12-12T09:42:20.773 INFO:teuthology.orchestra.run.smithi142.stdout: rgw enable ops log = true 2023-12-12T09:42:20.773 INFO:teuthology.orchestra.run.smithi142.stdout: rgw enable usage log = true 2023-12-12T09:42:20.773 INFO:teuthology.orchestra.run.smithi142.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-12-12T09:42:20.773 INFO:teuthology.orchestra.run.smithi142.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-12-12T09:42:20.773 INFO:teuthology.orchestra.run.smithi142.stdout: client mount timeout = 600 2023-12-12T09:42:20.773 INFO:teuthology.orchestra.run.smithi142.stdout: debug client = 20 2023-12-12T09:42:20.773 INFO:teuthology.orchestra.run.smithi142.stdout: debug ms = 1 2023-12-12T09:42:20.773 INFO:teuthology.orchestra.run.smithi142.stdout: rados mon op timeout = 900 2023-12-12T09:42:20.773 INFO:teuthology.orchestra.run.smithi142.stdout: rados osd op timeout = 900 2023-12-12T09:42:20.773 INFO:teuthology.orchestra.run.smithi142.stdout:[mon.a] 2023-12-12T09:42:20.773 INFO:teuthology.orchestra.run.smithi142.stdout:[mon.b] 2023-12-12T09:42:20.774 INFO:teuthology.orchestra.run.smithi142.stdout:[mon.c] 2023-12-12T09:42:20.774 INFO:teuthology.orchestra.run.smithi142.stdout:[mds.a] 2023-12-12T09:42:20.774 INFO:teuthology.orchestra.run.smithi142.stdout:[mds.c] 2023-12-12T09:42:20.774 INFO:teuthology.orchestra.run.smithi142.stdout:[mds.b] 2023-12-12T09:42:20.774 INFO:teuthology.orchestra.run.smithi142.stdout:[mds.d] 2023-12-12T09:42:20.774 INFO:teuthology.orchestra.run.smithi142.stdout:[mds] 2023-12-12T09:42:20.774 INFO:teuthology.orchestra.run.smithi142.stdout: debug mds = 20 2023-12-12T09:42:20.774 INFO:teuthology.orchestra.run.smithi142.stdout: debug mds balancer = 20 2023-12-12T09:42:20.774 INFO:teuthology.orchestra.run.smithi142.stdout: debug ms = 1 2023-12-12T09:42:20.774 INFO:teuthology.orchestra.run.smithi142.stdout: mds debug frag = True 2023-12-12T09:42:20.774 INFO:teuthology.orchestra.run.smithi142.stdout: mds debug scatterstat = True 2023-12-12T09:42:20.774 INFO:teuthology.orchestra.run.smithi142.stdout: mds op complaint time = 180 2023-12-12T09:42:20.774 INFO:teuthology.orchestra.run.smithi142.stdout: mds verify scatter = True 2023-12-12T09:42:20.775 INFO:teuthology.orchestra.run.smithi142.stdout: osd op complaint time = 180 2023-12-12T09:42:20.775 INFO:teuthology.orchestra.run.smithi142.stdout: rados mon op timeout = 900 2023-12-12T09:42:20.775 INFO:teuthology.orchestra.run.smithi142.stdout: rados osd op timeout = 900 2023-12-12T09:42:20.805 INFO:tasks.ceph:Creating admin key on mon.a... 2023-12-12T09:42:20.805 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2023-12-12T09:42:20.947 INFO:tasks.ceph:Copying monmap to all nodes... 2023-12-12T09:42:20.947 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2023-12-12T09:42:20.947 DEBUG:teuthology.orchestra.run.smithi073:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2023-12-12T09:42:20.998 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2023-12-12T09:42:20.998 DEBUG:teuthology.orchestra.run.smithi073:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2023-12-12T09:42:21.050 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi073.front.sepia.ceph.com 2023-12-12T09:42:21.050 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2023-12-12T09:42:21.050 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd of=/etc/ceph/ceph.keyring 2023-12-12T09:42:21.050 DEBUG:teuthology.orchestra.run.smithi073:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-12-12T09:42:21.196 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2023-12-12T09:42:21.196 DEBUG:teuthology.orchestra.run.smithi073:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-12-12T09:42:21.293 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi142.front.sepia.ceph.com 2023-12-12T09:42:21.293 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2023-12-12T09:42:21.293 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd of=/etc/ceph/ceph.keyring 2023-12-12T09:42:21.293 DEBUG:teuthology.orchestra.run.smithi142:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-12-12T09:42:21.448 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2023-12-12T09:42:21.448 DEBUG:teuthology.orchestra.run.smithi142:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-12-12T09:42:21.546 INFO:tasks.ceph:Setting up mon nodes... 2023-12-12T09:42:21.547 INFO:tasks.ceph:Setting up mgr nodes... 2023-12-12T09:42:21.547 DEBUG:teuthology.orchestra.run.smithi073:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2023-12-12T09:42:21.727 INFO:teuthology.orchestra.run.smithi073.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2023-12-12T09:42:21.737 DEBUG:teuthology.orchestra.run.smithi142:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2023-12-12T09:42:21.939 INFO:teuthology.orchestra.run.smithi142.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2023-12-12T09:42:21.949 INFO:tasks.ceph:Setting up mds nodes... 2023-12-12T09:42:21.950 DEBUG:teuthology.orchestra.run.smithi073:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2023-12-12T09:42:22.142 INFO:teuthology.orchestra.run.smithi073.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2023-12-12T09:42:22.152 DEBUG:teuthology.orchestra.run.smithi073:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2023-12-12T09:42:22.241 DEBUG:teuthology.orchestra.run.smithi073:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2023-12-12T09:42:22.421 INFO:teuthology.orchestra.run.smithi073.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2023-12-12T09:42:22.429 DEBUG:teuthology.orchestra.run.smithi073:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2023-12-12T09:42:22.518 DEBUG:teuthology.orchestra.run.smithi142:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2023-12-12T09:42:22.677 INFO:teuthology.orchestra.run.smithi142.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2023-12-12T09:42:22.683 DEBUG:teuthology.orchestra.run.smithi142:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2023-12-12T09:42:22.769 DEBUG:teuthology.orchestra.run.smithi142:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2023-12-12T09:42:22.915 INFO:teuthology.orchestra.run.smithi142.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2023-12-12T09:42:22.921 DEBUG:teuthology.orchestra.run.smithi142:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2023-12-12T09:42:22.995 INFO:tasks.ceph_client:Setting up client nodes... 2023-12-12T09:42:22.995 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2023-12-12T09:42:23.128 INFO:teuthology.orchestra.run.smithi073.stdout:creating /etc/ceph/ceph.client.0.keyring 2023-12-12T09:42:23.177 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2023-12-12T09:42:23.294 INFO:teuthology.orchestra.run.smithi142.stdout:creating /etc/ceph/ceph.client.1.keyring 2023-12-12T09:42:23.335 INFO:tasks.ceph:Running mkfs on osd nodes... 2023-12-12T09:42:23.335 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi073.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi142.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-12-12T09:42:23.335 DEBUG:teuthology.orchestra.run.smithi073:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2023-12-12T09:42:23.438 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-12-12T09:42:23.438 INFO:tasks.ceph:role: osd.0 2023-12-12T09:42:23.438 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi073.front.sepia.ceph.com 2023-12-12T09:42:23.438 DEBUG:teuthology.orchestra.run.smithi073:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-12-12T09:42:23.538 INFO:teuthology.orchestra.run.smithi073.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-12-12T09:42:23.538 INFO:teuthology.orchestra.run.smithi073.stdout: = sectsz=512 attr=2, projid32bit=1 2023-12-12T09:42:23.538 INFO:teuthology.orchestra.run.smithi073.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-12-12T09:42:23.539 INFO:teuthology.orchestra.run.smithi073.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-12-12T09:42:23.539 INFO:teuthology.orchestra.run.smithi073.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-12-12T09:42:23.539 INFO:teuthology.orchestra.run.smithi073.stdout: = sunit=0 swidth=0 blks 2023-12-12T09:42:23.539 INFO:teuthology.orchestra.run.smithi073.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-12-12T09:42:23.539 INFO:teuthology.orchestra.run.smithi073.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-12-12T09:42:23.539 INFO:teuthology.orchestra.run.smithi073.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-12-12T09:42:23.539 INFO:teuthology.orchestra.run.smithi073.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-12-12T09:42:24.058 INFO:teuthology.orchestra.run.smithi073.stdout:Discarding blocks...Done. 2023-12-12T09:42:24.064 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi073.front.sepia.ceph.com -o noatime 2023-12-12T09:42:24.065 DEBUG:teuthology.orchestra.run.smithi073:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2023-12-12T09:42:24.267 DEBUG:teuthology.orchestra.run.smithi073:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2023-12-12T09:42:24.382 DEBUG:teuthology.orchestra.run.smithi073:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2023-12-12T09:42:24.472 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-12-12T09:42:24.472 INFO:tasks.ceph:role: osd.1 2023-12-12T09:42:24.472 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi073.front.sepia.ceph.com 2023-12-12T09:42:24.473 DEBUG:teuthology.orchestra.run.smithi073:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-12-12T09:42:24.570 INFO:teuthology.orchestra.run.smithi073.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-12-12T09:42:24.571 INFO:teuthology.orchestra.run.smithi073.stdout: = sectsz=512 attr=2, projid32bit=1 2023-12-12T09:42:24.571 INFO:teuthology.orchestra.run.smithi073.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-12-12T09:42:24.571 INFO:teuthology.orchestra.run.smithi073.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-12-12T09:42:24.571 INFO:teuthology.orchestra.run.smithi073.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-12-12T09:42:24.571 INFO:teuthology.orchestra.run.smithi073.stdout: = sunit=0 swidth=0 blks 2023-12-12T09:42:24.571 INFO:teuthology.orchestra.run.smithi073.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-12-12T09:42:24.571 INFO:teuthology.orchestra.run.smithi073.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-12-12T09:42:24.571 INFO:teuthology.orchestra.run.smithi073.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-12-12T09:42:24.571 INFO:teuthology.orchestra.run.smithi073.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-12-12T09:42:25.057 INFO:teuthology.orchestra.run.smithi073.stdout:Discarding blocks...Done. 2023-12-12T09:42:25.066 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi073.front.sepia.ceph.com -o noatime 2023-12-12T09:42:25.066 DEBUG:teuthology.orchestra.run.smithi073:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2023-12-12T09:42:25.206 DEBUG:teuthology.orchestra.run.smithi073:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2023-12-12T09:42:25.301 DEBUG:teuthology.orchestra.run.smithi073:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2023-12-12T09:42:25.383 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-12-12T09:42:25.383 INFO:tasks.ceph:role: osd.2 2023-12-12T09:42:25.383 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi073.front.sepia.ceph.com 2023-12-12T09:42:25.383 DEBUG:teuthology.orchestra.run.smithi073:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-12-12T09:42:25.484 INFO:teuthology.orchestra.run.smithi073.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-12-12T09:42:25.484 INFO:teuthology.orchestra.run.smithi073.stdout: = sectsz=512 attr=2, projid32bit=1 2023-12-12T09:42:25.484 INFO:teuthology.orchestra.run.smithi073.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-12-12T09:42:25.484 INFO:teuthology.orchestra.run.smithi073.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-12-12T09:42:25.484 INFO:teuthology.orchestra.run.smithi073.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-12-12T09:42:25.484 INFO:teuthology.orchestra.run.smithi073.stdout: = sunit=0 swidth=0 blks 2023-12-12T09:42:25.484 INFO:teuthology.orchestra.run.smithi073.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-12-12T09:42:25.485 INFO:teuthology.orchestra.run.smithi073.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-12-12T09:42:25.485 INFO:teuthology.orchestra.run.smithi073.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-12-12T09:42:25.485 INFO:teuthology.orchestra.run.smithi073.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-12-12T09:42:26.008 INFO:teuthology.orchestra.run.smithi073.stdout:Discarding blocks...Done. 2023-12-12T09:42:26.014 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi073.front.sepia.ceph.com -o noatime 2023-12-12T09:42:26.014 DEBUG:teuthology.orchestra.run.smithi073:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2023-12-12T09:42:26.225 DEBUG:teuthology.orchestra.run.smithi073:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2023-12-12T09:42:26.327 DEBUG:teuthology.orchestra.run.smithi073:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2023-12-12T09:42:26.417 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-12-12T09:42:26.417 INFO:tasks.ceph:role: osd.3 2023-12-12T09:42:26.417 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi073.front.sepia.ceph.com 2023-12-12T09:42:26.418 DEBUG:teuthology.orchestra.run.smithi073:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-12-12T09:42:26.512 INFO:teuthology.orchestra.run.smithi073.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-12-12T09:42:26.513 INFO:teuthology.orchestra.run.smithi073.stdout: = sectsz=512 attr=2, projid32bit=1 2023-12-12T09:42:26.513 INFO:teuthology.orchestra.run.smithi073.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-12-12T09:42:26.513 INFO:teuthology.orchestra.run.smithi073.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-12-12T09:42:26.513 INFO:teuthology.orchestra.run.smithi073.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-12-12T09:42:26.513 INFO:teuthology.orchestra.run.smithi073.stdout: = sunit=0 swidth=0 blks 2023-12-12T09:42:26.513 INFO:teuthology.orchestra.run.smithi073.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-12-12T09:42:26.513 INFO:teuthology.orchestra.run.smithi073.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-12-12T09:42:26.513 INFO:teuthology.orchestra.run.smithi073.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-12-12T09:42:26.513 INFO:teuthology.orchestra.run.smithi073.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-12-12T09:42:26.967 INFO:teuthology.orchestra.run.smithi073.stdout:Discarding blocks...Done. 2023-12-12T09:42:26.974 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi073.front.sepia.ceph.com -o noatime 2023-12-12T09:42:26.974 DEBUG:teuthology.orchestra.run.smithi073:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2023-12-12T09:42:27.124 DEBUG:teuthology.orchestra.run.smithi073:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2023-12-12T09:42:27.215 DEBUG:teuthology.orchestra.run.smithi073:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-12-12T09:42:27.349 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:42:27.347+0000 7f13b11e0500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2023-12-12T09:42:27.349 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:42:27.348+0000 7f13b11e0500 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2023-12-12T09:42:27.349 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:42:27.348+0000 7f13b11e0500 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-12-12T09:42:27.349 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:42:27.348+0000 7f13b11e0500 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-12-12T09:42:27.349 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:42:27.348+0000 7f13b11e0500 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-12-12T09:42:27.353 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:42:27.353+0000 7f13b11e0500 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2023-12-12T09:42:30.533 DEBUG:teuthology.orchestra.run.smithi073:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2023-12-12T09:42:30.633 DEBUG:teuthology.orchestra.run.smithi073:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-12-12T09:42:30.774 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:42:30.772+0000 7ff7e9214500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2023-12-12T09:42:30.774 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:42:30.773+0000 7ff7e9214500 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2023-12-12T09:42:30.774 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:42:30.773+0000 7ff7e9214500 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-12-12T09:42:30.774 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:42:30.773+0000 7ff7e9214500 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-12-12T09:42:30.774 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:42:30.773+0000 7ff7e9214500 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-12-12T09:42:30.776 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:42:30.775+0000 7ff7e9214500 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2023-12-12T09:42:33.701 DEBUG:teuthology.orchestra.run.smithi073:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2023-12-12T09:42:33.804 DEBUG:teuthology.orchestra.run.smithi073:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-12-12T09:42:33.946 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:42:33.945+0000 7fb85100f500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2023-12-12T09:42:33.947 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:42:33.945+0000 7fb85100f500 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2023-12-12T09:42:33.947 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:42:33.946+0000 7fb85100f500 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-12-12T09:42:33.947 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:42:33.946+0000 7fb85100f500 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-12-12T09:42:33.947 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:42:33.946+0000 7fb85100f500 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-12-12T09:42:33.948 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:42:33.948+0000 7fb85100f500 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2023-12-12T09:42:36.881 DEBUG:teuthology.orchestra.run.smithi073:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2023-12-12T09:42:36.976 DEBUG:teuthology.orchestra.run.smithi073:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-12-12T09:42:37.115 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:42:37.114+0000 7f4c9721d500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2023-12-12T09:42:37.116 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:42:37.115+0000 7f4c9721d500 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2023-12-12T09:42:37.116 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:42:37.115+0000 7f4c9721d500 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-12-12T09:42:37.116 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:42:37.115+0000 7f4c9721d500 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-12-12T09:42:37.116 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:42:37.115+0000 7f4c9721d500 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-12-12T09:42:37.117 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:42:37.117+0000 7f4c9721d500 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2023-12-12T09:42:40.047 DEBUG:teuthology.orchestra.run.smithi073:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2023-12-12T09:42:40.144 DEBUG:teuthology.orchestra.run.smithi142:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2023-12-12T09:42:40.248 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-12-12T09:42:40.248 INFO:tasks.ceph:role: osd.4 2023-12-12T09:42:40.248 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi142.front.sepia.ceph.com 2023-12-12T09:42:40.248 DEBUG:teuthology.orchestra.run.smithi142:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-12-12T09:42:40.347 INFO:teuthology.orchestra.run.smithi142.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-12-12T09:42:40.347 INFO:teuthology.orchestra.run.smithi142.stdout: = sectsz=512 attr=2, projid32bit=1 2023-12-12T09:42:40.347 INFO:teuthology.orchestra.run.smithi142.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-12-12T09:42:40.347 INFO:teuthology.orchestra.run.smithi142.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-12-12T09:42:40.347 INFO:teuthology.orchestra.run.smithi142.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-12-12T09:42:40.347 INFO:teuthology.orchestra.run.smithi142.stdout: = sunit=0 swidth=0 blks 2023-12-12T09:42:40.347 INFO:teuthology.orchestra.run.smithi142.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-12-12T09:42:40.347 INFO:teuthology.orchestra.run.smithi142.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-12-12T09:42:40.348 INFO:teuthology.orchestra.run.smithi142.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-12-12T09:42:40.348 INFO:teuthology.orchestra.run.smithi142.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-12-12T09:42:40.860 INFO:teuthology.orchestra.run.smithi142.stdout:Discarding blocks...Done. 2023-12-12T09:42:40.866 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi142.front.sepia.ceph.com -o noatime 2023-12-12T09:42:40.866 DEBUG:teuthology.orchestra.run.smithi142:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2023-12-12T09:42:41.055 DEBUG:teuthology.orchestra.run.smithi142:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2023-12-12T09:42:41.167 DEBUG:teuthology.orchestra.run.smithi142:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2023-12-12T09:42:41.253 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-12-12T09:42:41.253 INFO:tasks.ceph:role: osd.5 2023-12-12T09:42:41.253 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi142.front.sepia.ceph.com 2023-12-12T09:42:41.253 DEBUG:teuthology.orchestra.run.smithi142:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-12-12T09:42:41.346 INFO:teuthology.orchestra.run.smithi142.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-12-12T09:42:41.346 INFO:teuthology.orchestra.run.smithi142.stdout: = sectsz=512 attr=2, projid32bit=1 2023-12-12T09:42:41.346 INFO:teuthology.orchestra.run.smithi142.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-12-12T09:42:41.346 INFO:teuthology.orchestra.run.smithi142.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-12-12T09:42:41.346 INFO:teuthology.orchestra.run.smithi142.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-12-12T09:42:41.346 INFO:teuthology.orchestra.run.smithi142.stdout: = sunit=0 swidth=0 blks 2023-12-12T09:42:41.346 INFO:teuthology.orchestra.run.smithi142.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-12-12T09:42:41.346 INFO:teuthology.orchestra.run.smithi142.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-12-12T09:42:41.346 INFO:teuthology.orchestra.run.smithi142.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-12-12T09:42:41.347 INFO:teuthology.orchestra.run.smithi142.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-12-12T09:42:41.826 INFO:teuthology.orchestra.run.smithi142.stdout:Discarding blocks...Done. 2023-12-12T09:42:41.831 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi142.front.sepia.ceph.com -o noatime 2023-12-12T09:42:41.832 DEBUG:teuthology.orchestra.run.smithi142:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2023-12-12T09:42:41.960 DEBUG:teuthology.orchestra.run.smithi142:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2023-12-12T09:42:42.047 DEBUG:teuthology.orchestra.run.smithi142:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2023-12-12T09:42:42.132 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-12-12T09:42:42.132 INFO:tasks.ceph:role: osd.6 2023-12-12T09:42:42.132 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi142.front.sepia.ceph.com 2023-12-12T09:42:42.132 DEBUG:teuthology.orchestra.run.smithi142:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-12-12T09:42:42.217 INFO:teuthology.orchestra.run.smithi142.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-12-12T09:42:42.217 INFO:teuthology.orchestra.run.smithi142.stdout: = sectsz=512 attr=2, projid32bit=1 2023-12-12T09:42:42.217 INFO:teuthology.orchestra.run.smithi142.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-12-12T09:42:42.217 INFO:teuthology.orchestra.run.smithi142.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-12-12T09:42:42.217 INFO:teuthology.orchestra.run.smithi142.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-12-12T09:42:42.217 INFO:teuthology.orchestra.run.smithi142.stdout: = sunit=0 swidth=0 blks 2023-12-12T09:42:42.217 INFO:teuthology.orchestra.run.smithi142.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-12-12T09:42:42.217 INFO:teuthology.orchestra.run.smithi142.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-12-12T09:42:42.217 INFO:teuthology.orchestra.run.smithi142.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-12-12T09:42:42.217 INFO:teuthology.orchestra.run.smithi142.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-12-12T09:42:42.744 INFO:teuthology.orchestra.run.smithi142.stdout:Discarding blocks...Done. 2023-12-12T09:42:42.750 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi142.front.sepia.ceph.com -o noatime 2023-12-12T09:42:42.751 DEBUG:teuthology.orchestra.run.smithi142:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2023-12-12T09:42:42.949 DEBUG:teuthology.orchestra.run.smithi142:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2023-12-12T09:42:43.055 DEBUG:teuthology.orchestra.run.smithi142:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2023-12-12T09:42:43.144 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-12-12T09:42:43.144 INFO:tasks.ceph:role: osd.7 2023-12-12T09:42:43.144 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi142.front.sepia.ceph.com 2023-12-12T09:42:43.144 DEBUG:teuthology.orchestra.run.smithi142:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-12-12T09:42:43.241 INFO:teuthology.orchestra.run.smithi142.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-12-12T09:42:43.241 INFO:teuthology.orchestra.run.smithi142.stdout: = sectsz=512 attr=2, projid32bit=1 2023-12-12T09:42:43.241 INFO:teuthology.orchestra.run.smithi142.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-12-12T09:42:43.241 INFO:teuthology.orchestra.run.smithi142.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-12-12T09:42:43.242 INFO:teuthology.orchestra.run.smithi142.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-12-12T09:42:43.242 INFO:teuthology.orchestra.run.smithi142.stdout: = sunit=0 swidth=0 blks 2023-12-12T09:42:43.242 INFO:teuthology.orchestra.run.smithi142.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-12-12T09:42:43.242 INFO:teuthology.orchestra.run.smithi142.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-12-12T09:42:43.242 INFO:teuthology.orchestra.run.smithi142.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-12-12T09:42:43.242 INFO:teuthology.orchestra.run.smithi142.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-12-12T09:42:43.693 INFO:teuthology.orchestra.run.smithi142.stdout:Discarding blocks...Done. 2023-12-12T09:42:43.698 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi142.front.sepia.ceph.com -o noatime 2023-12-12T09:42:43.698 DEBUG:teuthology.orchestra.run.smithi142:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2023-12-12T09:42:43.839 DEBUG:teuthology.orchestra.run.smithi142:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2023-12-12T09:42:43.932 DEBUG:teuthology.orchestra.run.smithi142:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-12-12T09:42:44.069 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:42:44.068+0000 7efdd560f500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2023-12-12T09:42:44.070 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:42:44.070+0000 7efdd560f500 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2023-12-12T09:42:44.070 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:42:44.070+0000 7efdd560f500 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-12-12T09:42:44.071 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:42:44.070+0000 7efdd560f500 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-12-12T09:42:44.071 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:42:44.070+0000 7efdd560f500 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-12-12T09:42:44.075 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:42:44.075+0000 7efdd560f500 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2023-12-12T09:42:47.257 DEBUG:teuthology.orchestra.run.smithi142:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2023-12-12T09:42:47.353 DEBUG:teuthology.orchestra.run.smithi142:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-12-12T09:42:47.486 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:42:47.486+0000 7fd9a7eab500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2023-12-12T09:42:47.487 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:42:47.486+0000 7fd9a7eab500 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2023-12-12T09:42:47.487 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:42:47.486+0000 7fd9a7eab500 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-12-12T09:42:47.487 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:42:47.486+0000 7fd9a7eab500 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-12-12T09:42:47.487 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:42:47.486+0000 7fd9a7eab500 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-12-12T09:42:47.489 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:42:47.488+0000 7fd9a7eab500 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2023-12-12T09:42:47.866 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T09:42:47.875 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T09:42:50.435 DEBUG:teuthology.orchestra.run.smithi142:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2023-12-12T09:42:50.531 DEBUG:teuthology.orchestra.run.smithi142:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-12-12T09:42:50.673 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:42:50.672+0000 7f2e5f5e2500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2023-12-12T09:42:50.674 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:42:50.673+0000 7f2e5f5e2500 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2023-12-12T09:42:50.674 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:42:50.673+0000 7f2e5f5e2500 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-12-12T09:42:50.674 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:42:50.673+0000 7f2e5f5e2500 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-12-12T09:42:50.674 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:42:50.673+0000 7f2e5f5e2500 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-12-12T09:42:50.675 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:42:50.675+0000 7f2e5f5e2500 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2023-12-12T09:42:53.611 DEBUG:teuthology.orchestra.run.smithi142:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2023-12-12T09:42:53.711 DEBUG:teuthology.orchestra.run.smithi142:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-12-12T09:42:53.851 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:42:53.851+0000 7f18d332b500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2023-12-12T09:42:53.852 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:42:53.852+0000 7f18d332b500 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2023-12-12T09:42:53.852 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:42:53.852+0000 7f18d332b500 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-12-12T09:42:53.852 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:42:53.852+0000 7f18d332b500 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-12-12T09:42:53.852 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:42:53.852+0000 7f18d332b500 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-12-12T09:42:53.854 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:42:53.854+0000 7f18d332b500 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2023-12-12T09:42:56.779 DEBUG:teuthology.orchestra.run.smithi142:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2023-12-12T09:42:56.879 INFO:tasks.ceph:Reading keys from all nodes... 2023-12-12T09:42:56.879 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2023-12-12T09:42:56.879 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2023-12-12T09:42:56.982 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2023-12-12T09:42:56.982 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2023-12-12T09:42:57.080 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2023-12-12T09:42:57.080 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2023-12-12T09:42:57.171 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2023-12-12T09:42:57.171 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2023-12-12T09:42:57.267 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2023-12-12T09:42:57.267 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2023-12-12T09:42:57.364 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2023-12-12T09:42:57.364 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2023-12-12T09:42:57.459 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2023-12-12T09:42:57.459 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2023-12-12T09:42:57.602 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2023-12-12T09:42:57.602 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2023-12-12T09:42:57.706 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2023-12-12T09:42:57.706 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2023-12-12T09:42:57.802 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2023-12-12T09:42:57.802 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2023-12-12T09:42:57.903 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2023-12-12T09:42:57.903 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2023-12-12T09:42:58.000 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2023-12-12T09:42:58.000 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2023-12-12T09:42:58.097 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2023-12-12T09:42:58.097 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2023-12-12T09:42:58.195 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2023-12-12T09:42:58.195 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2023-12-12T09:42:58.289 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2023-12-12T09:42:58.289 DEBUG:teuthology.orchestra.run.smithi073:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2023-12-12T09:42:58.350 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2023-12-12T09:42:58.350 DEBUG:teuthology.orchestra.run.smithi142:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2023-12-12T09:42:58.410 INFO:tasks.ceph:Adding keys to all mons... 2023-12-12T09:42:58.410 DEBUG:teuthology.orchestra.run.smithi073:> sudo tee -a /etc/ceph/ceph.keyring 2023-12-12T09:42:58.419 DEBUG:teuthology.orchestra.run.smithi142:> sudo tee -a /etc/ceph/ceph.keyring 2023-12-12T09:42:58.509 INFO:teuthology.orchestra.run.smithi073.stdout:[mgr.y] 2023-12-12T09:42:58.509 INFO:teuthology.orchestra.run.smithi073.stdout: key = AQD9KnhlWTNgKxAAmpMhLYOvVwJkRPAEtHSQAg== 2023-12-12T09:42:58.509 INFO:teuthology.orchestra.run.smithi073.stdout:[mds.a] 2023-12-12T09:42:58.509 INFO:teuthology.orchestra.run.smithi073.stdout: key = AQD+KnhltpiJCBAAkARF8P9XMNmVBOclyUE0FQ== 2023-12-12T09:42:58.509 INFO:teuthology.orchestra.run.smithi073.stdout:[mds.c] 2023-12-12T09:42:58.509 INFO:teuthology.orchestra.run.smithi073.stdout: key = AQD+KnhlmFweGRAAOp4JMzmBBBakD0PZJ+h3kA== 2023-12-12T09:42:58.509 INFO:teuthology.orchestra.run.smithi073.stdout:[osd.0] 2023-12-12T09:42:58.510 INFO:teuthology.orchestra.run.smithi073.stdout: key = AQADK3hlOX7MFBAAOOzt4ZXOGwlGwyySWJgz4Q== 2023-12-12T09:42:58.510 INFO:teuthology.orchestra.run.smithi073.stdout:[osd.1] 2023-12-12T09:42:58.510 INFO:teuthology.orchestra.run.smithi073.stdout: key = AQAGK3hl+zgiLhAAO2mzDGz2F88weMdDaHYN9w== 2023-12-12T09:42:58.510 INFO:teuthology.orchestra.run.smithi073.stdout:[osd.2] 2023-12-12T09:42:58.510 INFO:teuthology.orchestra.run.smithi073.stdout: key = AQAJK3hlRjtuOBAAmRB8r8bmB4W8yfGT+XaT8A== 2023-12-12T09:42:58.510 INFO:teuthology.orchestra.run.smithi073.stdout:[osd.3] 2023-12-12T09:42:58.510 INFO:teuthology.orchestra.run.smithi073.stdout: key = AQANK3hlmDDlBhAAGk3Yf40DqtpTTcDlbCsnCg== 2023-12-12T09:42:58.510 INFO:teuthology.orchestra.run.smithi073.stdout:[mgr.x] 2023-12-12T09:42:58.510 INFO:teuthology.orchestra.run.smithi073.stdout: key = AQD9Knhls5L9NxAAQ8z4BOLLDQvKzZhSGc7oCg== 2023-12-12T09:42:58.510 INFO:teuthology.orchestra.run.smithi073.stdout:[mds.b] 2023-12-12T09:42:58.510 INFO:teuthology.orchestra.run.smithi073.stdout: key = AQD+KnhlmYRlKBAAVfJyNKwqFR1brRr+uFNhPA== 2023-12-12T09:42:58.510 INFO:teuthology.orchestra.run.smithi073.stdout:[mds.d] 2023-12-12T09:42:58.510 INFO:teuthology.orchestra.run.smithi073.stdout: key = AQD+Knhl2IWUNhAA0/c8VA4L8iJXGUmjQ0Y6Tw== 2023-12-12T09:42:58.510 INFO:teuthology.orchestra.run.smithi073.stdout:[osd.4] 2023-12-12T09:42:58.510 INFO:teuthology.orchestra.run.smithi073.stdout: key = AQAUK3hlQqQlBBAALgzKsaHojYauYpl7vx86uQ== 2023-12-12T09:42:58.511 INFO:teuthology.orchestra.run.smithi073.stdout:[osd.5] 2023-12-12T09:42:58.511 INFO:teuthology.orchestra.run.smithi073.stdout: key = AQAXK3hl2/oEHRAAQKg28eQUCVyqKo7+mE1mpA== 2023-12-12T09:42:58.511 INFO:teuthology.orchestra.run.smithi073.stdout:[osd.6] 2023-12-12T09:42:58.511 INFO:teuthology.orchestra.run.smithi073.stdout: key = AQAaK3hleownKBAADG0Bq08cGxCwBfMPkR30pg== 2023-12-12T09:42:58.511 INFO:teuthology.orchestra.run.smithi073.stdout:[osd.7] 2023-12-12T09:42:58.511 INFO:teuthology.orchestra.run.smithi073.stdout: key = AQAdK3hlqOPJMhAAF/cz3Xce+skpwDFCsb+8BQ== 2023-12-12T09:42:58.511 INFO:teuthology.orchestra.run.smithi073.stdout:[client.0] 2023-12-12T09:42:58.511 INFO:teuthology.orchestra.run.smithi073.stdout: key = AQD/Knhl/4KuBxAAdAlGb7dYkXXlgPJp0Qcecg== 2023-12-12T09:42:58.511 INFO:teuthology.orchestra.run.smithi073.stdout:[client.1] 2023-12-12T09:42:58.511 INFO:teuthology.orchestra.run.smithi073.stdout: key = AQD/KnhlLq6aERAAgTQwqvltAggkGpb77Zngsg== 2023-12-12T09:42:58.511 INFO:teuthology.orchestra.run.smithi142.stdout:[mgr.y] 2023-12-12T09:42:58.512 INFO:teuthology.orchestra.run.smithi142.stdout: key = AQD9KnhlWTNgKxAAmpMhLYOvVwJkRPAEtHSQAg== 2023-12-12T09:42:58.512 INFO:teuthology.orchestra.run.smithi142.stdout:[mds.a] 2023-12-12T09:42:58.512 INFO:teuthology.orchestra.run.smithi142.stdout: key = AQD+KnhltpiJCBAAkARF8P9XMNmVBOclyUE0FQ== 2023-12-12T09:42:58.512 INFO:teuthology.orchestra.run.smithi142.stdout:[mds.c] 2023-12-12T09:42:58.512 INFO:teuthology.orchestra.run.smithi142.stdout: key = AQD+KnhlmFweGRAAOp4JMzmBBBakD0PZJ+h3kA== 2023-12-12T09:42:58.512 INFO:teuthology.orchestra.run.smithi142.stdout:[osd.0] 2023-12-12T09:42:58.512 INFO:teuthology.orchestra.run.smithi142.stdout: key = AQADK3hlOX7MFBAAOOzt4ZXOGwlGwyySWJgz4Q== 2023-12-12T09:42:58.512 INFO:teuthology.orchestra.run.smithi142.stdout:[osd.1] 2023-12-12T09:42:58.512 INFO:teuthology.orchestra.run.smithi142.stdout: key = AQAGK3hl+zgiLhAAO2mzDGz2F88weMdDaHYN9w== 2023-12-12T09:42:58.512 INFO:teuthology.orchestra.run.smithi142.stdout:[osd.2] 2023-12-12T09:42:58.512 INFO:teuthology.orchestra.run.smithi142.stdout: key = AQAJK3hlRjtuOBAAmRB8r8bmB4W8yfGT+XaT8A== 2023-12-12T09:42:58.512 INFO:teuthology.orchestra.run.smithi142.stdout:[osd.3] 2023-12-12T09:42:58.512 INFO:teuthology.orchestra.run.smithi142.stdout: key = AQANK3hlmDDlBhAAGk3Yf40DqtpTTcDlbCsnCg== 2023-12-12T09:42:58.512 INFO:teuthology.orchestra.run.smithi142.stdout:[mgr.x] 2023-12-12T09:42:58.513 INFO:teuthology.orchestra.run.smithi142.stdout: key = AQD9Knhls5L9NxAAQ8z4BOLLDQvKzZhSGc7oCg== 2023-12-12T09:42:58.513 INFO:teuthology.orchestra.run.smithi142.stdout:[mds.b] 2023-12-12T09:42:58.513 INFO:teuthology.orchestra.run.smithi142.stdout: key = AQD+KnhlmYRlKBAAVfJyNKwqFR1brRr+uFNhPA== 2023-12-12T09:42:58.513 INFO:teuthology.orchestra.run.smithi142.stdout:[mds.d] 2023-12-12T09:42:58.513 INFO:teuthology.orchestra.run.smithi142.stdout: key = AQD+Knhl2IWUNhAA0/c8VA4L8iJXGUmjQ0Y6Tw== 2023-12-12T09:42:58.513 INFO:teuthology.orchestra.run.smithi142.stdout:[osd.4] 2023-12-12T09:42:58.513 INFO:teuthology.orchestra.run.smithi142.stdout: key = AQAUK3hlQqQlBBAALgzKsaHojYauYpl7vx86uQ== 2023-12-12T09:42:58.513 INFO:teuthology.orchestra.run.smithi142.stdout:[osd.5] 2023-12-12T09:42:58.513 INFO:teuthology.orchestra.run.smithi142.stdout: key = AQAXK3hl2/oEHRAAQKg28eQUCVyqKo7+mE1mpA== 2023-12-12T09:42:58.513 INFO:teuthology.orchestra.run.smithi142.stdout:[osd.6] 2023-12-12T09:42:58.513 INFO:teuthology.orchestra.run.smithi142.stdout: key = AQAaK3hleownKBAADG0Bq08cGxCwBfMPkR30pg== 2023-12-12T09:42:58.513 INFO:teuthology.orchestra.run.smithi142.stdout:[osd.7] 2023-12-12T09:42:58.513 INFO:teuthology.orchestra.run.smithi142.stdout: key = AQAdK3hlqOPJMhAAF/cz3Xce+skpwDFCsb+8BQ== 2023-12-12T09:42:58.513 INFO:teuthology.orchestra.run.smithi142.stdout:[client.0] 2023-12-12T09:42:58.513 INFO:teuthology.orchestra.run.smithi142.stdout: key = AQD/Knhl/4KuBxAAdAlGb7dYkXXlgPJp0Qcecg== 2023-12-12T09:42:58.514 INFO:teuthology.orchestra.run.smithi142.stdout:[client.1] 2023-12-12T09:42:58.514 INFO:teuthology.orchestra.run.smithi142.stdout: key = AQD/KnhlLq6aERAAgTQwqvltAggkGpb77Zngsg== 2023-12-12T09:42:58.515 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-12-12T09:42:58.521 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-12-12T09:42:58.671 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-12-12T09:42:58.678 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-12-12T09:42:58.824 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-12-12T09:42:58.829 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-12-12T09:42:58.974 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-12T09:42:58.979 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-12T09:42:59.124 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-12T09:42:59.133 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-12T09:42:59.275 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-12T09:42:59.280 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-12T09:42:59.420 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-12T09:42:59.425 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-12T09:42:59.574 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-12-12T09:42:59.580 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-12-12T09:42:59.725 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-12-12T09:42:59.731 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-12-12T09:42:59.873 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-12-12T09:42:59.880 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-12-12T09:43:00.024 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-12T09:43:00.029 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-12T09:43:00.172 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-12T09:43:00.179 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-12T09:43:00.327 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-12T09:43:00.335 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-12T09:43:00.484 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-12T09:43:00.489 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-12T09:43:00.626 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-12-12T09:43:00.631 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-12-12T09:43:00.782 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-12-12T09:43:00.791 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-12-12T09:43:00.937 INFO:tasks.ceph:Running mkfs on mon nodes... 2023-12-12T09:43:00.937 DEBUG:teuthology.orchestra.run.smithi073:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2023-12-12T09:43:01.025 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-12-12T09:43:01.184 DEBUG:teuthology.orchestra.run.smithi073:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2023-12-12T09:43:01.275 DEBUG:teuthology.orchestra.run.smithi142:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2023-12-12T09:43:01.377 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-12-12T09:43:01.538 DEBUG:teuthology.orchestra.run.smithi142:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2023-12-12T09:43:01.626 DEBUG:teuthology.orchestra.run.smithi142:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2023-12-12T09:43:01.722 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-12-12T09:43:01.882 DEBUG:teuthology.orchestra.run.smithi142:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2023-12-12T09:43:01.960 DEBUG:teuthology.orchestra.run.smithi073:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-12-12T09:43:01.969 DEBUG:teuthology.orchestra.run.smithi142:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-12-12T09:43:02.025 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2023-12-12T09:43:02.025 INFO:tasks.ceph.mon.a:Restarting daemon 2023-12-12T09:43:02.025 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2023-12-12T09:43:02.034 INFO:tasks.ceph.mon.a:Started 2023-12-12T09:43:02.034 INFO:tasks.ceph.mon.b:Restarting daemon 2023-12-12T09:43:02.035 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2023-12-12T09:43:02.042 INFO:tasks.ceph.mon.b:Started 2023-12-12T09:43:02.042 INFO:tasks.ceph.mon.c:Restarting daemon 2023-12-12T09:43:02.043 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2023-12-12T09:43:02.048 INFO:tasks.ceph.mon.c:Started 2023-12-12T09:43:02.048 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2023-12-12T09:43:02.048 INFO:tasks.ceph.mgr.y:Restarting daemon 2023-12-12T09:43:02.048 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2023-12-12T09:43:02.056 INFO:tasks.ceph.mgr.y:Started 2023-12-12T09:43:02.057 INFO:tasks.ceph.mgr.x:Restarting daemon 2023-12-12T09:43:02.057 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2023-12-12T09:43:02.062 INFO:tasks.ceph.mgr.x:Started 2023-12-12T09:43:02.062 INFO:tasks.ceph:Setting crush tunables to default 2023-12-12T09:43:02.062 DEBUG:teuthology.orchestra.run.smithi073:> sudo ceph --cluster ceph osd crush tunables default 2023-12-12T09:43:02.240 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:02.239+0000 7f60bf036640 1 Processor -- start 2023-12-12T09:43:02.240 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:02.239+0000 7f60bf036640 1 -- start start 2023-12-12T09:43:02.241 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:02.240+0000 7f60bf036640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f60b814f9c0 0x7f60b80ac380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:02.241 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:02.240+0000 7f60bf036640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f60b80a6cb0 0x7f60b80a7110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:02.241 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:02.240+0000 7f60bf036640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60b80c6fe0 con 0x7f60b8152810 2023-12-12T09:43:02.241 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:02.240+0000 7f60bf036640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60b8156890 con 0x7f60b80a6cb0 2023-12-12T09:43:02.241 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:02.240+0000 7f60bf036640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60b81523c0 con 0x7f60b814f9c0 2023-12-12T09:43:02.242 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:02.240+0000 7f60bd5d3640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f60b8152810 0x7f60b8152c90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:42168/0 (socket says 172.21.15.73:42168) 2023-12-12T09:43:02.242 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:02.240+0000 7f60bd5d3640 1 -- 172.21.15.73:0/2392113063 learned_addr learned my addr 172.21.15.73:0/2392113063 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-12T09:43:02.242 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:02.240+0000 7f60bcdd2640 1 --2- 172.21.15.73:0/2392113063 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f60b814f9c0 0x7f60b80ac380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:02.245 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:02.240+0000 7f60b7fff640 1 --2- 172.21.15.73:0/2392113063 >> v2:172.21.15.142:3300/0 conn(0x7f60b80a6cb0 0x7f60b80a7110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:02.246 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:02.241+0000 7f60bcdd2640 1 -- 172.21.15.73:0/2392113063 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f60b814f9c0 msgr2=0x7f60b80ac380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-12-12T09:43:02.246 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:02.241+0000 7f60bcdd2640 1 -- 172.21.15.73:0/2392113063 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f60b814f9c0 msgr2=0x7f60b80ac380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-12-12T09:43:02.246 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:02.241+0000 7f60bcdd2640 1 --2- 172.21.15.73:0/2392113063 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f60b814f9c0 0x7f60b80ac380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-12-12T09:43:02.248 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:02.241+0000 7f60bcdd2640 1 --2- 172.21.15.73:0/2392113063 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f60b814f9c0 0x7f60b80ac380 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-12T09:43:02.248 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:02.241+0000 7f60b7fff640 1 -- 172.21.15.73:0/2392113063 >> v2:172.21.15.142:3300/0 conn(0x7f60b80a6cb0 msgr2=0x7f60b80a7110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-12-12T09:43:02.248 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:02.241+0000 7f60b7fff640 1 -- 172.21.15.73:0/2392113063 >> v2:172.21.15.142:3300/0 conn(0x7f60b80a6cb0 msgr2=0x7f60b80a7110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-12-12T09:43:02.248 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:02.241+0000 7f60b7fff640 1 --2- 172.21.15.73:0/2392113063 >> v2:172.21.15.142:3300/0 conn(0x7f60b80a6cb0 0x7f60b80a7110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-12-12T09:43:02.248 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:02.241+0000 7f60b7fff640 1 --2- 172.21.15.73:0/2392113063 >> v2:172.21.15.142:3300/0 conn(0x7f60b80a6cb0 0x7f60b80a7110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-12T09:43:02.444 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:02.442+0000 7f60bcdd2640 1 --2- 172.21.15.73:0/2392113063 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f60b814f9c0 0x7f60b80ac380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:02.444 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:02.442+0000 7f60b7fff640 1 --2- 172.21.15.73:0/2392113063 >> v2:172.21.15.142:3300/0 conn(0x7f60b80a6cb0 0x7f60b80a7110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:02.444 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:02.443+0000 7f60bcdd2640 1 -- 172.21.15.73:0/2392113063 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f60b814f9c0 msgr2=0x7f60b80ac380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-12-12T09:43:02.444 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:02.443+0000 7f60bcdd2640 1 -- 172.21.15.73:0/2392113063 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f60b814f9c0 msgr2=0x7f60b80ac380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-12-12T09:43:02.444 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:02.443+0000 7f60bcdd2640 1 --2- 172.21.15.73:0/2392113063 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f60b814f9c0 0x7f60b80ac380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-12-12T09:43:02.444 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:02.443+0000 7f60b7fff640 1 -- 172.21.15.73:0/2392113063 >> v2:172.21.15.142:3300/0 conn(0x7f60b80a6cb0 msgr2=0x7f60b80a7110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-12-12T09:43:02.444 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:02.443+0000 7f60b7fff640 1 -- 172.21.15.73:0/2392113063 >> v2:172.21.15.142:3300/0 conn(0x7f60b80a6cb0 msgr2=0x7f60b80a7110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-12-12T09:43:02.444 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:02.443+0000 7f60b7fff640 1 --2- 172.21.15.73:0/2392113063 >> v2:172.21.15.142:3300/0 conn(0x7f60b80a6cb0 0x7f60b80a7110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-12-12T09:43:02.444 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:02.443+0000 7f60bcdd2640 1 --2- 172.21.15.73:0/2392113063 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f60b814f9c0 0x7f60b80ac380 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-12-12T09:43:02.444 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:02.443+0000 7f60b7fff640 1 --2- 172.21.15.73:0/2392113063 >> v2:172.21.15.142:3300/0 conn(0x7f60b80a6cb0 0x7f60b80a7110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-12-12T09:43:02.492 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:02.490+0000 7f60b77fe640 1 -- 172.21.15.73:0/2392113063 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3547770933 0 0) 0x7f60b80c6fe0 con 0x7f60b8152810 2023-12-12T09:43:02.492 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:02.491+0000 7f60b77fe640 1 -- 172.21.15.73:0/2392113063 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f60a8003520 con 0x7f60b8152810 2023-12-12T09:43:02.494 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:02.493+0000 7f60b77fe640 1 -- 172.21.15.73:0/2392113063 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1700345530 0 0) 0x7f60a8003520 con 0x7f60b8152810 2023-12-12T09:43:02.494 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:02.493+0000 7f60b77fe640 1 -- 172.21.15.73:0/2392113063 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f60b814f9c0 msgr2=0x7f60b80ac380 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-12-12T09:43:02.494 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:02.493+0000 7f60b77fe640 1 --2- 172.21.15.73:0/2392113063 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f60b814f9c0 0x7f60b80ac380 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:02.494 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:02.493+0000 7f60b77fe640 1 -- 172.21.15.73:0/2392113063 >> v2:172.21.15.142:3300/0 conn(0x7f60b80a6cb0 msgr2=0x7f60b80a7110 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-12-12T09:43:02.494 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:02.493+0000 7f60b77fe640 1 --2- 172.21.15.73:0/2392113063 >> v2:172.21.15.142:3300/0 conn(0x7f60b80a6cb0 0x7f60b80a7110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:02.495 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:02.493+0000 7f60b77fe640 1 -- 172.21.15.73:0/2392113063 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60b8155d10 con 0x7f60b8152810 2023-12-12T09:43:02.495 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:02.493+0000 7f60b77fe640 1 -- 172.21.15.73:0/2392113063 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3186547832 0 0) 0x7f60b00019f0 con 0x7f60b8152810 2023-12-12T09:43:02.495 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:02.493+0000 7f60b77fe640 1 -- 172.21.15.73:0/2392113063 >> v1:172.21.15.73:6789/0 conn(0x7f60b8152810 legacy=0x7f60b8152c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:02.495 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:02.493+0000 7f60b77fe640 1 --2- 172.21.15.73:0/2392113063 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f60a8003970 0x7f60a8003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:02.495 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:02.493+0000 7f60b77fe640 1 --2- 172.21.15.73:0/2392113063 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f60a80047c0 0x7f60a8004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:02.495 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:02.493+0000 7f60b77fe640 1 --2- 172.21.15.73:0/2392113063 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f60b814f9c0 0x7f60a80051a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:02.495 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:02.494+0000 7f60b77fe640 1 -- 172.21.15.73:0/2392113063 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60b8156890 con 0x7f60a80047c0 2023-12-12T09:43:02.495 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:02.494+0000 7f60b77fe640 1 -- 172.21.15.73:0/2392113063 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60b81523c0 con 0x7f60a8003970 2023-12-12T09:43:02.496 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:02.494+0000 7f60b77fe640 1 -- 172.21.15.73:0/2392113063 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60a800ff20 con 0x7f60b814f9c0 2023-12-12T09:43:02.496 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:02.494+0000 7f60bcdd2640 1 --2- 172.21.15.73:0/2392113063 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f60a8003970 0x7f60a8003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:02.496 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:02.494+0000 7f60b7fff640 1 --2- 172.21.15.73:0/2392113063 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f60a80047c0 0x7f60a8004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:02.496 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:02.495+0000 7f60bd5d3640 1 --2- 172.21.15.73:0/2392113063 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f60b814f9c0 0x7f60a80051a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:02.496 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:02.495+0000 7f60b7fff640 1 -- 172.21.15.73:0/2392113063 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f60b814f9c0 msgr2=0x7f60a80051a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:43:02.496 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:02.495+0000 7f60b7fff640 1 --2- 172.21.15.73:0/2392113063 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f60b814f9c0 0x7f60a80051a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:02.497 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:02.495+0000 7f60b7fff640 1 -- 172.21.15.73:0/2392113063 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f60a8003970 msgr2=0x7f60a8003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:43:02.497 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:02.495+0000 7f60b7fff640 1 --2- 172.21.15.73:0/2392113063 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f60a8003970 0x7f60a8003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:02.497 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:02.495+0000 7f60b7fff640 1 -- 172.21.15.73:0/2392113063 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60a8003520 con 0x7f60a80047c0 2023-12-12T09:43:02.497 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:02.495+0000 7f60bd5d3640 1 --2- 172.21.15.73:0/2392113063 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f60b814f9c0 0x7f60a80051a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:43:02.498 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:02.497+0000 7f60b7fff640 1 --2- 172.21.15.73:0/2392113063 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f60a80047c0 0x7f60a8004c40 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f60b80ac8c0 tx=0x7f60a80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9968d6f17e4e1f36 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:43:02.499 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:02.498+0000 7f60b77fe640 1 -- 172.21.15.73:0/2392113063 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60a402c810 con 0x7f60a80047c0 2023-12-12T09:43:02.499 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:02.499+0000 7f60b77fe640 1 -- 172.21.15.73:0/2392113063 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60a4030070 con 0x7f60a80047c0 2023-12-12T09:43:02.500 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:02.499+0000 7f60b77fe640 1 -- 172.21.15.73:0/2392113063 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60a402cbd0 con 0x7f60a80047c0 2023-12-12T09:43:02.501 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:02.500+0000 7f60bf036640 1 -- 172.21.15.73:0/2392113063 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f60a80047c0 msgr2=0x7f60a8004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:02.501 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:02.500+0000 7f60bf036640 1 --2- 172.21.15.73:0/2392113063 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f60a80047c0 0x7f60a8004c40 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f60b80ac8c0 tx=0x7f60a80057f0 comp rx=0 tx=0).stop 2023-12-12T09:43:02.501 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:02.500+0000 7f60bd5d3640 1 -- 172.21.15.73:0/2392113063 reap_dead start 2023-12-12T09:43:02.501 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:02.500+0000 7f60bf036640 1 -- 172.21.15.73:0/2392113063 shutdown_connections 2023-12-12T09:43:02.501 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:02.500+0000 7f60bf036640 1 -- 172.21.15.73:0/2392113063 >> 172.21.15.73:0/2392113063 conn(0x7f60b80a9970 msgr2=0x7f60b80a9d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:43:02.501 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:02.500+0000 7f60bf036640 1 -- 172.21.15.73:0/2392113063 shutdown_connections 2023-12-12T09:43:02.501 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:02.500+0000 7f60bf036640 1 -- 172.21.15.73:0/2392113063 wait complete. 2023-12-12T09:43:02.504 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:02.504+0000 7f60bf036640 1 Processor -- start 2023-12-12T09:43:02.505 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:02.504+0000 7f60bf036640 1 -- start start 2023-12-12T09:43:02.507 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:02.505+0000 7f60bf036640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f60a80047c0 0x7f60b81e9ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:02.507 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:02.505+0000 7f60bf036640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f60b81e6820 0x7f60b8148340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:02.507 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:02.505+0000 7f60bf036640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f60b80c2cc0 0x7f60b80c3140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:02.507 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:02.505+0000 7f60bf036640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60b81e5b50 con 0x7f60b80c2cc0 2023-12-12T09:43:02.507 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:02.505+0000 7f60bf036640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60b81ea010 con 0x7f60a80047c0 2023-12-12T09:43:02.507 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:02.505+0000 7f60bf036640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60b81e6390 con 0x7f60b81e6820 2023-12-12T09:43:02.507 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:02.506+0000 7f60bd5d3640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f60b80c2cc0 0x7f60b80c3140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:02.507 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:02.506+0000 7f60b7fff640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f60b81e6820 0x7f60b8148340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:02.507 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:02.506+0000 7f60b7fff640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f60b81e6820 0x7f60b8148340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.73:46236/0 (socket says 172.21.15.73:46236) 2023-12-12T09:43:02.507 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:02.506+0000 7f60b7fff640 1 -- 172.21.15.73:0/871503771 learned_addr learned my addr 172.21.15.73:0/871503771 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:43:02.507 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:02.506+0000 7f60bcdd2640 1 --2- 172.21.15.73:0/871503771 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f60a80047c0 0x7f60b81e9ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:02.508 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:02.507+0000 7f60bd5d3640 1 -- 172.21.15.73:0/871503771 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f60b81e6820 msgr2=0x7f60b8148340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:02.508 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:02.507+0000 7f60bd5d3640 1 --2- 172.21.15.73:0/871503771 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f60b81e6820 0x7f60b8148340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:02.509 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:02.507+0000 7f60bd5d3640 1 -- 172.21.15.73:0/871503771 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f60a80047c0 msgr2=0x7f60b81e9ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:02.509 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:02.507+0000 7f60bd5d3640 1 --2- 172.21.15.73:0/871503771 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f60a80047c0 0x7f60b81e9ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:02.509 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:02.507+0000 7f60bd5d3640 1 -- 172.21.15.73:0/871503771 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60b80c28a0 con 0x7f60b80c2cc0 2023-12-12T09:43:02.509 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:02.507+0000 7f60b7fff640 1 --2- 172.21.15.73:0/871503771 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f60b81e6820 0x7f60b8148340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-12T09:43:02.509 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:02.507+0000 7f60bd5d3640 1 --2- 172.21.15.73:0/871503771 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f60b80c2cc0 0x7f60b80c3140 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f60b80c8680 tx=0x7f60b000b4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:43:02.509 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:02.507+0000 7f60b57fa640 1 -- 172.21.15.73:0/871503771 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60b0004d60 con 0x7f60b80c2cc0 2023-12-12T09:43:02.509 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:02.507+0000 7f60b57fa640 1 -- 172.21.15.73:0/871503771 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60b000bb20 con 0x7f60b80c2cc0 2023-12-12T09:43:02.509 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:02.507+0000 7f60bf036640 1 -- 172.21.15.73:0/871503771 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60b81e5d40 con 0x7f60b80c2cc0 2023-12-12T09:43:02.509 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:02.507+0000 7f60b57fa640 1 -- 172.21.15.73:0/871503771 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60b000be90 con 0x7f60b80c2cc0 2023-12-12T09:43:02.509 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:02.507+0000 7f60bf036640 1 -- 172.21.15.73:0/871503771 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60b8148880 con 0x7f60b80c2cc0 2023-12-12T09:43:02.510 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:02.508+0000 7f60b57fa640 1 -- 172.21.15.73:0/871503771 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f60b0007110 con 0x7f60b80c2cc0 2023-12-12T09:43:02.510 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:02.509+0000 7f60b57fa640 1 -- 172.21.15.73:0/871503771 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f60b001d8c0 con 0x7f60b80c2cc0 2023-12-12T09:43:02.510 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:02.509+0000 7f60bf036640 1 -- 172.21.15.73:0/871503771 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60b8148a10 con 0x7f60b80c2cc0 2023-12-12T09:43:02.513 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:02.513+0000 7f60b57fa640 1 -- 172.21.15.73:0/871503771 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7f60b001da80 con 0x7f60b80c2cc0 2023-12-12T09:43:02.587 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:02.586+0000 7f60bf036640 1 -- 172.21.15.73:0/871503771 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7f60b8067580 con 0x7f60b80c2cc0 2023-12-12T09:43:02.590 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:02.589+0000 7f60b57fa640 1 -- 172.21.15.73:0/871503771 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7f60b001dc20 con 0x7f60b80c2cc0 2023-12-12T09:43:02.591 INFO:teuthology.orchestra.run.smithi073.stderr:adjusted tunables profile to default 2023-12-12T09:43:02.593 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:02.591+0000 7f60bf036640 1 -- 172.21.15.73:0/871503771 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f60b80c2cc0 msgr2=0x7f60b80c3140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:02.593 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:02.591+0000 7f60bf036640 1 --2- 172.21.15.73:0/871503771 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f60b80c2cc0 0x7f60b80c3140 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f60b80c8680 tx=0x7f60b000b4a0 comp rx=0 tx=0).stop 2023-12-12T09:43:02.593 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:02.592+0000 7f60bf036640 1 -- 172.21.15.73:0/871503771 shutdown_connections 2023-12-12T09:43:02.593 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:02.592+0000 7f60bf036640 1 --2- 172.21.15.73:0/871503771 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f60b80c2cc0 0x7f60b80c3140 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:02.593 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:02.592+0000 7f60bf036640 1 --2- 172.21.15.73:0/871503771 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f60b81e6820 0x7f60b8148340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:02.593 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:02.592+0000 7f60bf036640 1 --2- 172.21.15.73:0/871503771 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f60a80047c0 0x7f60b81e9ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:02.593 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:02.592+0000 7f60bf036640 1 -- 172.21.15.73:0/871503771 >> 172.21.15.73:0/871503771 conn(0x7f60b80a9970 msgr2=0x7f60b80c46c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:43:02.593 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:02.592+0000 7f60bf036640 1 -- 172.21.15.73:0/871503771 shutdown_connections 2023-12-12T09:43:02.593 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:02.592+0000 7f60bf036640 1 -- 172.21.15.73:0/871503771 wait complete. 2023-12-12T09:43:02.610 INFO:tasks.ceph:check_enable_crimson: False 2023-12-12T09:43:02.610 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2023-12-12T09:43:02.610 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2023-12-12T09:43:02.610 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2023-12-12T09:43:02.692 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2023-12-12T09:43:02.692 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2023-12-12T09:43:02.821 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2023-12-12T09:43:02.821 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2023-12-12T09:43:02.912 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2023-12-12T09:43:02.912 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2023-12-12T09:43:03.040 INFO:tasks.ceph.mgr.x.smithi142.stderr:2023-12-12T09:43:03.040+0000 7f2df1446040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-12-12T09:43:03.042 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2023-12-12T09:43:03.042 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2023-12-12T09:43:03.103 INFO:tasks.ceph.mgr.x.smithi142.stderr:2023-12-12T09:43:03.103+0000 7f2df1446040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-12-12T09:43:03.105 INFO:tasks.ceph.mgr.y.smithi073.stderr:2023-12-12T09:43:03.104+0000 7fc1a5452040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-12-12T09:43:03.132 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2023-12-12T09:43:03.133 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2023-12-12T09:43:03.169 INFO:tasks.ceph.mgr.y.smithi073.stderr:2023-12-12T09:43:03.168+0000 7fc1a5452040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-12-12T09:43:03.215 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2023-12-12T09:43:03.215 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2023-12-12T09:43:03.346 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2023-12-12T09:43:03.346 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2023-12-12T09:43:03.476 DEBUG:teuthology.orchestra.run.smithi142:> sudo ceph --cluster ceph osd new dd9074be-dbe2-4c34-9896-a4223d8d3940 0 2023-12-12T09:43:03.666 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:03.665+0000 7ff3d8e64640 1 Processor -- start 2023-12-12T09:43:03.666 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:03.665+0000 7ff3d8e64640 1 -- start start 2023-12-12T09:43:03.668 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:03.667+0000 7ff3d8e64640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7ff3d40c6590 0x7ff3d40c6970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:03.668 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:03.667+0000 7ff3d8e64640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7ff3d40c81e0 0x7ff3d406c0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:03.668 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:03.667+0000 7ff3d8e64640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3d406c630 con 0x7ff3d4154b40 2023-12-12T09:43:03.668 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:03.667+0000 7ff3d8e64640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3d4154430 con 0x7ff3d40c81e0 2023-12-12T09:43:03.668 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:03.667+0000 7ff3d8e64640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3d40c4540 con 0x7ff3d40c6590 2023-12-12T09:43:03.668 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:03.667+0000 7ff3d37fe640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7ff3d40c6590 0x7ff3d40c6970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:03.668 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:03.667+0000 7ff3d37fe640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7ff3d40c6590 0x7ff3d40c6970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:34264/0 (socket says 172.21.15.142:34264) 2023-12-12T09:43:03.669 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:03.667+0000 7ff3d37fe640 1 -- 172.21.15.142:0/1879247060 learned_addr learned my addr 172.21.15.142:0/1879247060 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-12-12T09:43:03.669 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:03.667+0000 7ff3cbfff640 1 --2- 172.21.15.142:0/1879247060 >> v2:172.21.15.73:3300/0 conn(0x7ff3d40c81e0 0x7ff3d406c0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:03.669 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:03.668+0000 7ff3d37fe640 1 -- 172.21.15.142:0/1879247060 >> v2:172.21.15.73:3300/0 conn(0x7ff3d40c81e0 msgr2=0x7ff3d406c0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:43:03.669 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:03.668+0000 7ff3d37fe640 1 --2- 172.21.15.142:0/1879247060 >> v2:172.21.15.73:3300/0 conn(0x7ff3d40c81e0 0x7ff3d406c0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:03.669 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:03.668+0000 7ff3d37fe640 1 -- 172.21.15.142:0/1879247060 >> v1:172.21.15.73:6789/0 conn(0x7ff3d4154b40 legacy=0x7ff3d41579c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:43:03.669 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:03.668+0000 7ff3d37fe640 1 -- 172.21.15.142:0/1879247060 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3d40c5030 con 0x7ff3d40c6590 2023-12-12T09:43:03.671 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:03.669+0000 7ff3d37fe640 1 --2- 172.21.15.142:0/1879247060 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff3d40c6590 0x7ff3d40c6970 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7ff3d408b0e0 tx=0x7ff3c402b910 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8c900743555bffbd server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:43:03.671 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:03.669+0000 7ff3d2ffd640 1 -- 172.21.15.142:0/1879247060 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3c4031870 con 0x7ff3d40c6590 2023-12-12T09:43:03.671 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:03.669+0000 7ff3d2ffd640 1 -- 172.21.15.142:0/1879247060 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3c40319d0 con 0x7ff3d40c6590 2023-12-12T09:43:03.671 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:03.669+0000 7ff3d2ffd640 1 -- 172.21.15.142:0/1879247060 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3c4031d60 con 0x7ff3d40c6590 2023-12-12T09:43:03.671 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:03.670+0000 7ff3d8e64640 1 -- 172.21.15.142:0/1879247060 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff3d40c6590 msgr2=0x7ff3d40c6970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:03.671 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:03.670+0000 7ff3d8e64640 1 --2- 172.21.15.142:0/1879247060 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff3d40c6590 0x7ff3d40c6970 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7ff3d408b0e0 tx=0x7ff3c402b910 comp rx=0 tx=0).stop 2023-12-12T09:43:03.671 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:03.670+0000 7ff3d8e64640 1 -- 172.21.15.142:0/1879247060 shutdown_connections 2023-12-12T09:43:03.671 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:03.670+0000 7ff3d8e64640 1 --2- 172.21.15.142:0/1879247060 >> v2:172.21.15.73:3300/0 conn(0x7ff3d40c81e0 0x7ff3d406c0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:03.671 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:03.670+0000 7ff3d8e64640 1 --2- 172.21.15.142:0/1879247060 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff3d40c6590 0x7ff3d40c6970 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:03.672 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:03.670+0000 7ff3d8e64640 1 -- 172.21.15.142:0/1879247060 >> 172.21.15.142:0/1879247060 conn(0x7ff3d40ab770 msgr2=0x7ff3d40abb80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:43:03.672 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:03.670+0000 7ff3d8e64640 1 -- 172.21.15.142:0/1879247060 shutdown_connections 2023-12-12T09:43:03.672 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:03.670+0000 7ff3d8e64640 1 -- 172.21.15.142:0/1879247060 wait complete. 2023-12-12T09:43:03.679 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:03.671+0000 7ff3d8e64640 1 Processor -- start 2023-12-12T09:43:03.679 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:03.672+0000 7ff3d8e64640 1 -- start start 2023-12-12T09:43:03.679 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:03.672+0000 7ff3d8e64640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff3d40c6590 0x7ff3d40c3580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:03.679 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:03.672+0000 7ff3d8e64640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff3d40c81e0 0x7ff3d4150af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:03.679 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:03.672+0000 7ff3d8e64640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff3d4154b40 0x7ff3d41edde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:03.679 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:03.672+0000 7ff3d8e64640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3d40c1910 con 0x7ff3d40c81e0 2023-12-12T09:43:03.679 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:03.672+0000 7ff3d8e64640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3d41ed950 con 0x7ff3d40c6590 2023-12-12T09:43:03.679 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:03.672+0000 7ff3d8e64640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3d4144f80 con 0x7ff3d4154b40 2023-12-12T09:43:03.679 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:03.673+0000 7ff3d3fff640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff3d4154b40 0x7ff3d41edde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:03.680 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:03.673+0000 7ff3d37fe640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff3d40c6590 0x7ff3d40c3580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:03.680 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:03.673+0000 7ff3d37fe640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff3d40c6590 0x7ff3d40c3580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:34266/0 (socket says 172.21.15.142:34266) 2023-12-12T09:43:03.680 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:03.673+0000 7ff3d3fff640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff3d4154b40 0x7ff3d41edde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.142:39126/0 (socket says 172.21.15.142:39126) 2023-12-12T09:43:03.680 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:03.673+0000 7ff3d37fe640 1 -- 172.21.15.142:0/1549918418 learned_addr learned my addr 172.21.15.142:0/1549918418 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-12-12T09:43:03.680 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:03.673+0000 7ff3cbfff640 1 --2- 172.21.15.142:0/1549918418 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff3d40c81e0 0x7ff3d4150af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:03.680 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:03.673+0000 7ff3d3fff640 1 -- 172.21.15.142:0/1549918418 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff3d40c6590 msgr2=0x7ff3d40c3580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:03.680 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:03.673+0000 7ff3d3fff640 1 --2- 172.21.15.142:0/1549918418 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff3d40c6590 0x7ff3d40c3580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:03.680 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:03.673+0000 7ff3d3fff640 1 -- 172.21.15.142:0/1549918418 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff3d40c81e0 msgr2=0x7ff3d4150af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:03.680 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:03.673+0000 7ff3d3fff640 1 --2- 172.21.15.142:0/1549918418 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff3d40c81e0 0x7ff3d4150af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:03.680 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:03.673+0000 7ff3d3fff640 1 -- 172.21.15.142:0/1549918418 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3c40094d0 con 0x7ff3d4154b40 2023-12-12T09:43:03.680 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:03.673+0000 7ff3d3fff640 1 --2- 172.21.15.142:0/1549918418 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff3d4154b40 0x7ff3d41edde0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7ff3cc00c780 tx=0x7ff3cc00cc40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:43:03.680 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:03.674+0000 7ff3d0ff9640 1 -- 172.21.15.142:0/1549918418 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3cc00aa50 con 0x7ff3d4154b40 2023-12-12T09:43:03.680 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:03.674+0000 7ff3d0ff9640 1 -- 172.21.15.142:0/1549918418 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3cc00abb0 con 0x7ff3d4154b40 2023-12-12T09:43:03.681 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:03.674+0000 7ff3d8e64640 1 -- 172.21.15.142:0/1549918418 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3d41eae60 con 0x7ff3d4154b40 2023-12-12T09:43:03.681 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:03.674+0000 7ff3d0ff9640 1 -- 172.21.15.142:0/1549918418 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3cc00ce30 con 0x7ff3d4154b40 2023-12-12T09:43:03.681 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:03.674+0000 7ff3d8e64640 1 -- 172.21.15.142:0/1549918418 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3d40bd850 con 0x7ff3d4154b40 2023-12-12T09:43:03.681 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:03.674+0000 7ff3d0ff9640 1 -- 172.21.15.142:0/1549918418 <== mon.2 v2:172.21.15.142:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7ff3cc004bf0 con 0x7ff3d4154b40 2023-12-12T09:43:03.681 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:03.674+0000 7ff3d0ff9640 1 -- 172.21.15.142:0/1549918418 <== mon.2 v2:172.21.15.142:3301/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 725+0+0 (secure 0 0 0) 0x7ff3cc012420 con 0x7ff3d4154b40 2023-12-12T09:43:03.681 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:03.675+0000 7ff3d8e64640 1 -- 172.21.15.142:0/1549918418 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff3d40c0800 con 0x7ff3d4154b40 2023-12-12T09:43:03.681 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:03.678+0000 7ff3d0ff9640 1 -- 172.21.15.142:0/1549918418 <== mon.2 v2:172.21.15.142:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7ff3cc039ce0 con 0x7ff3d4154b40 2023-12-12T09:43:03.733 INFO:tasks.ceph.mgr.x.smithi142.stderr:2023-12-12T09:43:03.733+0000 7f2df1446040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-12-12T09:43:03.756 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:03.755+0000 7ff3d8e64640 1 -- 172.21.15.142:0/1549918418 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_command({"prefix": "osd new", "uuid": "dd9074be-dbe2-4c34-9896-a4223d8d3940", "id": 0} v 0) v1 -- 0x7ff3d4154610 con 0x7ff3d4154b40 2023-12-12T09:43:03.763 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:03.763+0000 7ff3d0ff9640 1 -- 172.21.15.142:0/1549918418 <== mon.2 v2:172.21.15.142:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "dd9074be-dbe2-4c34-9896-a4223d8d3940", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7ff3cc028070 con 0x7ff3d4154b40 2023-12-12T09:43:03.763 INFO:teuthology.orchestra.run.smithi142.stdout:0 2023-12-12T09:43:03.765 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:03.764+0000 7ff3d8e64640 1 -- 172.21.15.142:0/1549918418 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff3d4154b40 msgr2=0x7ff3d41edde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:03.765 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:03.764+0000 7ff3d8e64640 1 --2- 172.21.15.142:0/1549918418 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff3d4154b40 0x7ff3d41edde0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7ff3cc00c780 tx=0x7ff3cc00cc40 comp rx=0 tx=0).stop 2023-12-12T09:43:03.765 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:03.764+0000 7ff3d8e64640 1 -- 172.21.15.142:0/1549918418 shutdown_connections 2023-12-12T09:43:03.766 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:03.764+0000 7ff3d8e64640 1 --2- 172.21.15.142:0/1549918418 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff3d4154b40 0x7ff3d41edde0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:03.766 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:03.764+0000 7ff3d8e64640 1 --2- 172.21.15.142:0/1549918418 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff3d40c81e0 0x7ff3d4150af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:03.766 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:03.764+0000 7ff3d8e64640 1 --2- 172.21.15.142:0/1549918418 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff3d40c6590 0x7ff3d40c3580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:03.766 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:03.765+0000 7ff3d8e64640 1 -- 172.21.15.142:0/1549918418 >> 172.21.15.142:0/1549918418 conn(0x7ff3d40ab770 msgr2=0x7ff3d40abb50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:43:03.766 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:03.765+0000 7ff3d8e64640 1 -- 172.21.15.142:0/1549918418 shutdown_connections 2023-12-12T09:43:03.766 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:03.765+0000 7ff3d8e64640 1 -- 172.21.15.142:0/1549918418 wait complete. 2023-12-12T09:43:03.782 DEBUG:teuthology.orchestra.run.smithi142:> sudo ceph --cluster ceph osd new c4a05052-96d4-4758-a4e1-1a37f1e07fed 1 2023-12-12T09:43:03.800 INFO:tasks.ceph.mgr.x.smithi142.stderr:2023-12-12T09:43:03.800+0000 7f2df1446040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-12-12T09:43:03.819 INFO:tasks.ceph.mgr.y.smithi073.stderr:2023-12-12T09:43:03.818+0000 7fc1a5452040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-12-12T09:43:03.854 INFO:tasks.ceph.mgr.x.smithi142.stderr:2023-12-12T09:43:03.854+0000 7f2df1446040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-12-12T09:43:03.882 INFO:tasks.ceph.mgr.y.smithi073.stderr:2023-12-12T09:43:03.879+0000 7fc1a5452040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-12-12T09:43:03.920 INFO:tasks.ceph.mgr.x.smithi142.stderr:2023-12-12T09:43:03.919+0000 7f2df1446040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-12-12T09:43:03.930 INFO:tasks.ceph.mgr.y.smithi073.stderr:2023-12-12T09:43:03.930+0000 7fc1a5452040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-12-12T09:43:03.972 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:03.971+0000 7fb36753c640 1 Processor -- start 2023-12-12T09:43:03.972 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:03.971+0000 7fb36753c640 1 -- start start 2023-12-12T09:43:03.972 INFO:tasks.ceph.mgr.x.smithi142.stderr:2023-12-12T09:43:03.972+0000 7f2df1446040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-12-12T09:43:03.973 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:03.973+0000 7fb36753c640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb3600c81e0 0x7fb3600c6970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:03.973 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:03.973+0000 7fb36753c640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fb36006c0f0 0x7fb36015ed50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:03.973 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:03.973+0000 7fb36753c640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3600c4540 con 0x7fb3600c6590 2023-12-12T09:43:03.974 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:03.973+0000 7fb36753c640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb360154430 con 0x7fb36006c0f0 2023-12-12T09:43:03.974 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:03.973+0000 7fb36753c640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3600c5030 con 0x7fb3600c81e0 2023-12-12T09:43:03.974 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:03.973+0000 7fb366d3b640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fb36006c0f0 0x7fb36015ed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:03.974 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:03.973+0000 7fb365d39640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb3600c81e0 0x7fb3600c6970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:03.974 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:03.973+0000 7fb365d39640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb3600c81e0 0x7fb3600c6970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.142:39128/0 (socket says 172.21.15.142:39128) 2023-12-12T09:43:03.974 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:03.973+0000 7fb365d39640 1 -- 172.21.15.142:0/2559269676 learned_addr learned my addr 172.21.15.142:0/2559269676 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-12-12T09:43:03.974 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:03.973+0000 7fb366d3b640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fb36006c0f0 0x7fb36015ed50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:34272/0 (socket says 172.21.15.142:34272) 2023-12-12T09:43:03.975 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:03.974+0000 7fb365d39640 1 -- 172.21.15.142:0/2559269676 >> v2:172.21.15.142:3300/0 conn(0x7fb36006c0f0 msgr2=0x7fb36015ed50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:43:03.975 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:03.974+0000 7fb365d39640 1 --2- 172.21.15.142:0/2559269676 >> v2:172.21.15.142:3300/0 conn(0x7fb36006c0f0 0x7fb36015ed50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:03.975 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:03.974+0000 7fb365d39640 1 -- 172.21.15.142:0/2559269676 >> v1:172.21.15.73:6789/0 conn(0x7fb3600c6590 legacy=0x7fb360154b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:03.975 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:03.974+0000 7fb365d39640 1 -- 172.21.15.142:0/2559269676 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3600c7e00 con 0x7fb3600c81e0 2023-12-12T09:43:03.975 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:03.974+0000 7fb366d3b640 1 --2- 172.21.15.142:0/2559269676 >> v2:172.21.15.142:3300/0 conn(0x7fb36006c0f0 0x7fb36015ed50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-12T09:43:03.976 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:03.975+0000 7fb365d39640 1 --2- 172.21.15.142:0/2559269676 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb3600c81e0 0x7fb3600c6970 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fb350009860 tx=0x7fb35002b980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8bde11d39152bca6 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:43:03.976 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:03.975+0000 7fb365538640 1 -- 172.21.15.142:0/2559269676 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb350030840 con 0x7fb3600c81e0 2023-12-12T09:43:03.976 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:03.975+0000 7fb365538640 1 -- 172.21.15.142:0/2559269676 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3500309a0 con 0x7fb3600c81e0 2023-12-12T09:43:03.976 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:03.975+0000 7fb365538640 1 -- 172.21.15.142:0/2559269676 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb350030d30 con 0x7fb3600c81e0 2023-12-12T09:43:03.976 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:03.976+0000 7fb36753c640 1 -- 172.21.15.142:0/2559269676 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb3600c81e0 msgr2=0x7fb3600c6970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:03.977 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:03.976+0000 7fb36753c640 1 --2- 172.21.15.142:0/2559269676 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb3600c81e0 0x7fb3600c6970 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fb350009860 tx=0x7fb35002b980 comp rx=0 tx=0).stop 2023-12-12T09:43:03.977 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:03.976+0000 7fb36753c640 1 -- 172.21.15.142:0/2559269676 shutdown_connections 2023-12-12T09:43:03.977 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:03.976+0000 7fb36753c640 1 --2- 172.21.15.142:0/2559269676 >> v2:172.21.15.142:3300/0 conn(0x7fb36006c0f0 0x7fb36015ed50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:03.977 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:03.976+0000 7fb36753c640 1 --2- 172.21.15.142:0/2559269676 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb3600c81e0 0x7fb3600c6970 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:03.977 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:03.976+0000 7fb36753c640 1 -- 172.21.15.142:0/2559269676 >> 172.21.15.142:0/2559269676 conn(0x7fb3600ab770 msgr2=0x7fb3600abb80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:43:03.977 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:03.976+0000 7fb36753c640 1 -- 172.21.15.142:0/2559269676 shutdown_connections 2023-12-12T09:43:03.977 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:03.976+0000 7fb36753c640 1 -- 172.21.15.142:0/2559269676 wait complete. 2023-12-12T09:43:03.979 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:03.977+0000 7fb36753c640 1 Processor -- start 2023-12-12T09:43:03.979 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:03.978+0000 7fb36753c640 1 -- start start 2023-12-12T09:43:03.981 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:03.978+0000 7fb36753c640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb36006c0f0 0x7fb3601ed860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:03.981 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:03.978+0000 7fb36753c640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb3600c6590 0x7fb36014ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:03.981 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:03.978+0000 7fb36753c640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb3600c81e0 0x7fb36014b050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:03.982 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:03.978+0000 7fb36753c640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3600c10f0 con 0x7fb3600c6590 2023-12-12T09:43:03.982 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:03.978+0000 7fb36753c640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3601ee230 con 0x7fb3600c81e0 2023-12-12T09:43:03.982 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:03.978+0000 7fb36753c640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3600c1380 con 0x7fb36006c0f0 2023-12-12T09:43:03.982 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:03.979+0000 7fb36653a640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb36006c0f0 0x7fb3601ed860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:03.982 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:03.979+0000 7fb366d3b640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb3600c81e0 0x7fb36014b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:03.982 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:03.979+0000 7fb36653a640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb36006c0f0 0x7fb3601ed860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.142:39136/0 (socket says 172.21.15.142:39136) 2023-12-12T09:43:03.983 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:03.979+0000 7fb36653a640 1 -- 172.21.15.142:0/2304498460 learned_addr learned my addr 172.21.15.142:0/2304498460 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-12-12T09:43:03.983 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:03.979+0000 7fb365d39640 1 --2- 172.21.15.142:0/2304498460 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb3600c6590 0x7fb36014ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:03.983 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:03.979+0000 7fb36653a640 1 -- 172.21.15.142:0/2304498460 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb3600c81e0 msgr2=0x7fb36014b050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:03.983 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:03.979+0000 7fb36653a640 1 --2- 172.21.15.142:0/2304498460 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb3600c81e0 0x7fb36014b050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:03.983 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:03.979+0000 7fb36653a640 1 -- 172.21.15.142:0/2304498460 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb3600c6590 msgr2=0x7fb36014ab10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:03.983 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:03.979+0000 7fb36653a640 1 --2- 172.21.15.142:0/2304498460 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb3600c6590 0x7fb36014ab10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:03.983 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:03.979+0000 7fb36653a640 1 -- 172.21.15.142:0/2304498460 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb358009a70 con 0x7fb36006c0f0 2023-12-12T09:43:03.983 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:03.979+0000 7fb36653a640 1 --2- 172.21.15.142:0/2304498460 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb36006c0f0 0x7fb3601ed860 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fb35c00c480 tx=0x7fb35c00c880 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:43:03.984 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:03.980+0000 7fb356ffd640 1 -- 172.21.15.142:0/2304498460 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb35c0052d0 con 0x7fb36006c0f0 2023-12-12T09:43:03.984 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:03.980+0000 7fb356ffd640 1 -- 172.21.15.142:0/2304498460 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb35c005430 con 0x7fb36006c0f0 2023-12-12T09:43:03.984 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:03.980+0000 7fb356ffd640 1 -- 172.21.15.142:0/2304498460 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb35c003830 con 0x7fb36006c0f0 2023-12-12T09:43:03.984 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:03.980+0000 7fb36753c640 1 -- 172.21.15.142:0/2304498460 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb350009470 con 0x7fb36006c0f0 2023-12-12T09:43:03.984 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:03.980+0000 7fb36753c640 1 -- 172.21.15.142:0/2304498460 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3600aeae0 con 0x7fb36006c0f0 2023-12-12T09:43:03.984 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:03.980+0000 7fb356ffd640 1 -- 172.21.15.142:0/2304498460 <== mon.2 v2:172.21.15.142:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fb35c003c90 con 0x7fb36006c0f0 2023-12-12T09:43:03.984 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:03.980+0000 7fb356ffd640 1 -- 172.21.15.142:0/2304498460 <== mon.2 v2:172.21.15.142:3301/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 840+0+0 (secure 0 0 0) 0x7fb35c01c440 con 0x7fb36006c0f0 2023-12-12T09:43:03.984 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:03.981+0000 7fb36753c640 1 -- 172.21.15.142:0/2304498460 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb3600c6020 con 0x7fb36006c0f0 2023-12-12T09:43:03.985 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:03.985+0000 7fb356ffd640 1 -- 172.21.15.142:0/2304498460 <== mon.2 v2:172.21.15.142:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7fb35c017070 con 0x7fb36006c0f0 2023-12-12T09:43:04.002 INFO:tasks.ceph.mgr.y.smithi073.stderr:2023-12-12T09:43:04.002+0000 7fc1a5452040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-12-12T09:43:04.052 INFO:tasks.ceph.mgr.y.smithi073.stderr:2023-12-12T09:43:04.051+0000 7fc1a5452040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-12-12T09:43:04.064 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:04.064+0000 7fb36753c640 1 -- 172.21.15.142:0/2304498460 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_command({"prefix": "osd new", "uuid": "c4a05052-96d4-4758-a4e1-1a37f1e07fed", "id": 1} v 0) v1 -- 0x7fb360067400 con 0x7fb36006c0f0 2023-12-12T09:43:04.072 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:04.071+0000 7fb356ffd640 1 -- 172.21.15.142:0/2304498460 <== mon.2 v2:172.21.15.142:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "c4a05052-96d4-4758-a4e1-1a37f1e07fed", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7fb35c011590 con 0x7fb36006c0f0 2023-12-12T09:43:04.072 INFO:teuthology.orchestra.run.smithi142.stdout:1 2023-12-12T09:43:04.073 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:04.073+0000 7fb36753c640 1 -- 172.21.15.142:0/2304498460 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb36006c0f0 msgr2=0x7fb3601ed860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:04.073 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:04.073+0000 7fb36753c640 1 --2- 172.21.15.142:0/2304498460 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb36006c0f0 0x7fb3601ed860 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fb35c00c480 tx=0x7fb35c00c880 comp rx=0 tx=0).stop 2023-12-12T09:43:04.073 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:04.073+0000 7fb36753c640 1 -- 172.21.15.142:0/2304498460 shutdown_connections 2023-12-12T09:43:04.074 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:04.073+0000 7fb36753c640 1 --2- 172.21.15.142:0/2304498460 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb3600c81e0 0x7fb36014b050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:04.074 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:04.073+0000 7fb36753c640 1 --2- 172.21.15.142:0/2304498460 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb3600c6590 0x7fb36014ab10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:04.074 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:04.073+0000 7fb36753c640 1 --2- 172.21.15.142:0/2304498460 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb36006c0f0 0x7fb3601ed860 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:04.074 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:04.073+0000 7fb36753c640 1 -- 172.21.15.142:0/2304498460 >> 172.21.15.142:0/2304498460 conn(0x7fb3600ab770 msgr2=0x7fb360154b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:43:04.074 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:04.073+0000 7fb36753c640 1 -- 172.21.15.142:0/2304498460 shutdown_connections 2023-12-12T09:43:04.074 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:04.073+0000 7fb36753c640 1 -- 172.21.15.142:0/2304498460 wait complete. 2023-12-12T09:43:04.090 DEBUG:teuthology.orchestra.run.smithi142:> sudo ceph --cluster ceph osd new 512bc8ac-72c2-40d4-b3d2-d867a92c5213 2 2023-12-12T09:43:04.095 INFO:tasks.ceph.mgr.x.smithi142.stderr:2023-12-12T09:43:04.095+0000 7f2df1446040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-12-12T09:43:04.166 INFO:tasks.ceph.mgr.y.smithi073.stderr:2023-12-12T09:43:04.166+0000 7fc1a5452040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-12-12T09:43:04.179 INFO:tasks.ceph.mgr.x.smithi142.stderr:2023-12-12T09:43:04.179+0000 7f2df1446040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-12-12T09:43:04.234 INFO:tasks.ceph.mgr.x.smithi142.stderr:2023-12-12T09:43:04.234+0000 7f2df1446040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-12-12T09:43:04.245 INFO:tasks.ceph.mgr.y.smithi073.stderr:2023-12-12T09:43:04.245+0000 7fc1a5452040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-12-12T09:43:04.292 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:04.287+0000 7f765e8ff640 1 Processor -- start 2023-12-12T09:43:04.293 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:04.287+0000 7f765e8ff640 1 -- start start 2023-12-12T09:43:04.293 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:04.289+0000 7f765e8ff640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f76580c40e0 0x7f76580c44c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:04.293 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:04.289+0000 7f765e8ff640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f76580c5ae0 0x7f7658154e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:04.293 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:04.289+0000 7f765e8ff640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f76581579b0 0x7f7658157e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:04.293 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:04.289+0000 7f765e8ff640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76580c2be0 con 0x7f76581579b0 2023-12-12T09:43:04.293 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:04.289+0000 7f765e8ff640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76580c2750 con 0x7f76580c40e0 2023-12-12T09:43:04.293 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:04.289+0000 7f765e8ff640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7658155350 con 0x7f76580c5ae0 2023-12-12T09:43:04.293 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:04.289+0000 7f765d8fd640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f76580c40e0 0x7f76580c44c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:04.293 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:04.289+0000 7f765d0fc640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f76580c5ae0 0x7f7658154e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:04.294 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:04.289+0000 7f765d8fd640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f76580c40e0 0x7f76580c44c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:34286/0 (socket says 172.21.15.142:34286) 2023-12-12T09:43:04.294 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:04.289+0000 7f765d8fd640 1 -- 172.21.15.142:0/1173281307 learned_addr learned my addr 172.21.15.142:0/1173281307 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-12-12T09:43:04.294 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:04.289+0000 7f765e0fe640 1 --2- 172.21.15.142:0/1173281307 >> v2:172.21.15.73:3300/0 conn(0x7f76581579b0 0x7f7658157e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:04.294 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:04.290+0000 7f765d0fc640 1 -- 172.21.15.142:0/1173281307 >> v2:172.21.15.142:3300/0 conn(0x7f76580c40e0 msgr2=0x7f76580c44c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:43:04.294 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:04.290+0000 7f765d0fc640 1 --2- 172.21.15.142:0/1173281307 >> v2:172.21.15.142:3300/0 conn(0x7f76580c40e0 0x7f76580c44c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:04.294 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:04.290+0000 7f765d0fc640 1 -- 172.21.15.142:0/1173281307 >> v2:172.21.15.73:3300/0 conn(0x7f76581579b0 msgr2=0x7f7658157e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:43:04.294 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:04.290+0000 7f765d0fc640 1 --2- 172.21.15.142:0/1173281307 >> v2:172.21.15.73:3300/0 conn(0x7f76581579b0 0x7f7658157e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:04.322 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:04.290+0000 7f765d0fc640 1 -- 172.21.15.142:0/1173281307 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76580a7430 con 0x7f76580c5ae0 2023-12-12T09:43:04.322 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:04.290+0000 7f765d8fd640 1 --2- 172.21.15.142:0/1173281307 >> v2:172.21.15.142:3300/0 conn(0x7f76580c40e0 0x7f76580c44c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-12T09:43:04.322 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:04.291+0000 7f765d0fc640 1 --2- 172.21.15.142:0/1173281307 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f76580c5ae0 0x7f7658154e10 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f76580c8a30 tx=0x7f764802b710 comp rx=0 tx=0).ready entity=mon.2 client_cookie=245534af9a97b1cc server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:43:04.322 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:04.291+0000 7f765c8fb640 1 -- 172.21.15.142:0/1173281307 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7648030710 con 0x7f76580c5ae0 2023-12-12T09:43:04.323 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:04.291+0000 7f765c8fb640 1 -- 172.21.15.142:0/1173281307 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f764802e050 con 0x7f76580c5ae0 2023-12-12T09:43:04.323 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:04.291+0000 7f765c8fb640 1 -- 172.21.15.142:0/1173281307 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7648030a90 con 0x7f76580c5ae0 2023-12-12T09:43:04.323 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:04.292+0000 7f765e8ff640 1 -- 172.21.15.142:0/1173281307 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f76580c5ae0 msgr2=0x7f7658154e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:04.323 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:04.292+0000 7f765e8ff640 1 --2- 172.21.15.142:0/1173281307 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f76580c5ae0 0x7f7658154e10 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f76580c8a30 tx=0x7f764802b710 comp rx=0 tx=0).stop 2023-12-12T09:43:04.323 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:04.292+0000 7f765e8ff640 1 -- 172.21.15.142:0/1173281307 shutdown_connections 2023-12-12T09:43:04.323 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:04.292+0000 7f765e8ff640 1 --2- 172.21.15.142:0/1173281307 >> v2:172.21.15.73:3300/0 conn(0x7f76581579b0 0x7f7658157e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:04.323 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:04.292+0000 7f765e8ff640 1 --2- 172.21.15.142:0/1173281307 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f76580c5ae0 0x7f7658154e10 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:04.323 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:04.292+0000 7f765e8ff640 1 --2- 172.21.15.142:0/1173281307 >> v2:172.21.15.142:3300/0 conn(0x7f76580c40e0 0x7f76580c44c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:04.323 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:04.292+0000 7f765e8ff640 1 -- 172.21.15.142:0/1173281307 >> 172.21.15.142:0/1173281307 conn(0x7f76580a96f0 msgr2=0x7f76580a9ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:43:04.323 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:04.292+0000 7f765e8ff640 1 -- 172.21.15.142:0/1173281307 shutdown_connections 2023-12-12T09:43:04.323 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:04.292+0000 7f765e8ff640 1 -- 172.21.15.142:0/1173281307 wait complete. 2023-12-12T09:43:04.324 INFO:tasks.ceph.mgr.y.smithi073.stderr:2023-12-12T09:43:04.298+0000 7fc1a5452040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-12-12T09:43:04.327 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:04.294+0000 7f765e8ff640 1 Processor -- start 2023-12-12T09:43:04.327 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:04.294+0000 7f765e8ff640 1 -- start start 2023-12-12T09:43:04.327 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:04.295+0000 7f765e8ff640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f76580c40e0 0x7f76581494a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:04.327 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:04.295+0000 7f765e8ff640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f76580c5ae0 0x7f76580a8770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:04.327 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:04.295+0000 7f765e8ff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f76581579b0 0x7f7658149c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:04.327 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:04.295+0000 7f765e8ff640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76580aad30 con 0x7f76581579b0 2023-12-12T09:43:04.328 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:04.295+0000 7f765e8ff640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76581e9f10 con 0x7f76580c5ae0 2023-12-12T09:43:04.328 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:04.295+0000 7f765e8ff640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7658156fb0 con 0x7f76580c40e0 2023-12-12T09:43:04.328 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:04.295+0000 7f765d8fd640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f76580c40e0 0x7f76581494a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:04.328 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:04.295+0000 7f765d0fc640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f76580c5ae0 0x7f76580a8770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:04.328 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:04.295+0000 7f765d0fc640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f76580c5ae0 0x7f76580a8770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:34292/0 (socket says 172.21.15.142:34292) 2023-12-12T09:43:04.328 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:04.295+0000 7f765d0fc640 1 -- 172.21.15.142:0/3376262480 learned_addr learned my addr 172.21.15.142:0/3376262480 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-12-12T09:43:04.328 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:04.295+0000 7f765e0fe640 1 --2- 172.21.15.142:0/3376262480 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f76581579b0 0x7f7658149c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:04.328 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:04.295+0000 7f765d0fc640 1 -- 172.21.15.142:0/3376262480 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f76580c40e0 msgr2=0x7f76581494a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:04.329 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:04.295+0000 7f765d0fc640 1 --2- 172.21.15.142:0/3376262480 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f76580c40e0 0x7f76581494a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:04.329 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:04.295+0000 7f765d0fc640 1 -- 172.21.15.142:0/3376262480 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f76581579b0 msgr2=0x7f7658149c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:04.329 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:04.295+0000 7f765d0fc640 1 --2- 172.21.15.142:0/3376262480 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f76581579b0 0x7f7658149c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:04.329 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:04.295+0000 7f765d0fc640 1 -- 172.21.15.142:0/3376262480 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76540094d0 con 0x7f76580c5ae0 2023-12-12T09:43:04.329 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:04.295+0000 7f765e0fe640 1 --2- 172.21.15.142:0/3376262480 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f76581579b0 0x7f7658149c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:43:04.329 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:04.296+0000 7f765d0fc640 1 --2- 172.21.15.142:0/3376262480 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f76580c5ae0 0x7f76580a8770 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f7648000c00 tx=0x7f76480046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:43:04.329 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:04.296+0000 7f764e7fc640 1 -- 172.21.15.142:0/3376262480 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f764803b810 con 0x7f76580c5ae0 2023-12-12T09:43:04.329 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:04.296+0000 7f764e7fc640 1 -- 172.21.15.142:0/3376262480 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f764803b990 con 0x7f76580c5ae0 2023-12-12T09:43:04.329 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:04.296+0000 7f765e8ff640 1 -- 172.21.15.142:0/3376262480 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7648009400 con 0x7f76580c5ae0 2023-12-12T09:43:04.329 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:04.296+0000 7f764e7fc640 1 -- 172.21.15.142:0/3376262480 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f764803bd40 con 0x7f76580c5ae0 2023-12-12T09:43:04.329 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:04.296+0000 7f765e8ff640 1 -- 172.21.15.142:0/3376262480 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76581499e0 con 0x7f76580c5ae0 2023-12-12T09:43:04.329 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:04.296+0000 7f764e7fc640 1 -- 172.21.15.142:0/3376262480 <== mon.1 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f7648039040 con 0x7f76580c5ae0 2023-12-12T09:43:04.329 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:04.297+0000 7f764e7fc640 1 -- 172.21.15.142:0/3376262480 <== mon.1 v2:172.21.15.142:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 955+0+0 (secure 0 0 0) 0x7f7648046b70 con 0x7f76580c5ae0 2023-12-12T09:43:04.330 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:04.297+0000 7f765e8ff640 1 -- 172.21.15.142:0/3376262480 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7658067b10 con 0x7f76580c5ae0 2023-12-12T09:43:04.330 INFO:tasks.ceph.mgr.x.smithi142.stderr:2023-12-12T09:43:04.297+0000 7f2df1446040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-12-12T09:43:04.330 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:04.300+0000 7f764e7fc640 1 -- 172.21.15.142:0/3376262480 <== mon.1 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7f764804b060 con 0x7f76580c5ae0 2023-12-12T09:43:04.356 INFO:tasks.ceph.mgr.x.smithi142.stderr:2023-12-12T09:43:04.355+0000 7f2df1446040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-12-12T09:43:04.359 INFO:tasks.ceph.mgr.y.smithi073.stderr:2023-12-12T09:43:04.358+0000 7fc1a5452040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-12-12T09:43:04.380 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:04.380+0000 7f765e8ff640 1 -- 172.21.15.142:0/3376262480 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd new", "uuid": "512bc8ac-72c2-40d4-b3d2-d867a92c5213", "id": 2} v 0) v1 -- 0x7f765814e640 con 0x7f76580c5ae0 2023-12-12T09:43:04.388 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:04.388+0000 7f764e7fc640 1 -- 172.21.15.142:0/3376262480 <== mon.1 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "512bc8ac-72c2-40d4-b3d2-d867a92c5213", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7f7648041070 con 0x7f76580c5ae0 2023-12-12T09:43:04.388 INFO:teuthology.orchestra.run.smithi142.stdout:2 2023-12-12T09:43:04.390 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:04.389+0000 7f765e8ff640 1 -- 172.21.15.142:0/3376262480 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f76580c5ae0 msgr2=0x7f76580a8770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:04.390 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:04.389+0000 7f765e8ff640 1 --2- 172.21.15.142:0/3376262480 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f76580c5ae0 0x7f76580a8770 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f7648000c00 tx=0x7f76480046c0 comp rx=0 tx=0).stop 2023-12-12T09:43:04.390 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:04.389+0000 7f765e8ff640 1 -- 172.21.15.142:0/3376262480 shutdown_connections 2023-12-12T09:43:04.390 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:04.389+0000 7f765e8ff640 1 --2- 172.21.15.142:0/3376262480 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f76581579b0 0x7f7658149c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:04.390 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:04.389+0000 7f765e8ff640 1 --2- 172.21.15.142:0/3376262480 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f76580c5ae0 0x7f76580a8770 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:04.390 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:04.389+0000 7f765e8ff640 1 --2- 172.21.15.142:0/3376262480 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f76580c40e0 0x7f76581494a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:04.390 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:04.389+0000 7f765e8ff640 1 -- 172.21.15.142:0/3376262480 >> 172.21.15.142:0/3376262480 conn(0x7f76580a96f0 msgr2=0x7f765806f970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:43:04.390 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:04.389+0000 7f765e8ff640 1 -- 172.21.15.142:0/3376262480 shutdown_connections 2023-12-12T09:43:04.390 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:04.389+0000 7f765e8ff640 1 -- 172.21.15.142:0/3376262480 wait complete. 2023-12-12T09:43:04.406 DEBUG:teuthology.orchestra.run.smithi142:> sudo ceph --cluster ceph osd new 3d1a91e0-42bf-437a-8eae-8d357c8f63a1 3 2023-12-12T09:43:04.415 INFO:tasks.ceph.mgr.y.smithi073.stderr:2023-12-12T09:43:04.414+0000 7fc1a5452040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-12-12T09:43:04.592 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:04.591+0000 7f7d01dbc640 1 Processor -- start 2023-12-12T09:43:04.592 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:04.591+0000 7f7d01dbc640 1 -- start start 2023-12-12T09:43:04.594 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:04.593+0000 7f7d01dbc640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f7cfc0c6590 0x7f7cfc0c6970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:04.594 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:04.593+0000 7f7d01dbc640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f7cfc0c81e0 0x7f7cfc06c0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:04.594 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:04.593+0000 7f7d01dbc640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7cfc06c630 con 0x7f7cfc154b40 2023-12-12T09:43:04.594 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:04.593+0000 7f7d01dbc640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7cfc154430 con 0x7f7cfc0c81e0 2023-12-12T09:43:04.594 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:04.593+0000 7f7d01dbc640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7cfc0c4540 con 0x7f7cfc0c6590 2023-12-12T09:43:04.594 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:04.593+0000 7f7d00dba640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f7cfc0c6590 0x7f7cfc0c6970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:04.594 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:04.593+0000 7f7d015bb640 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f7cfc154b40 0x7f7cfc1579c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:53902/0 (socket says 172.21.15.142:53902) 2023-12-12T09:43:04.594 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:04.593+0000 7f7d015bb640 1 -- 172.21.15.142:0/112824075 learned_addr learned my addr 172.21.15.142:0/112824075 (peer_addr_for_me v1:172.21.15.142:0/0) 2023-12-12T09:43:04.594 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:04.593+0000 7f7d00dba640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f7cfc0c6590 0x7f7cfc0c6970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:34294/0 (socket says 172.21.15.142:34294) 2023-12-12T09:43:04.594 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:04.594+0000 7f7cfbfff640 1 --2- 172.21.15.142:0/112824075 >> v2:172.21.15.73:3300/0 conn(0x7f7cfc0c81e0 0x7f7cfc06c0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:04.595 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:04.594+0000 7f7d00dba640 1 -- 172.21.15.142:0/112824075 >> v2:172.21.15.73:3300/0 conn(0x7f7cfc0c81e0 msgr2=0x7f7cfc06c0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:43:04.596 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:04.594+0000 7f7d00dba640 1 --2- 172.21.15.142:0/112824075 >> v2:172.21.15.73:3300/0 conn(0x7f7cfc0c81e0 0x7f7cfc06c0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:04.596 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:04.594+0000 7f7d00dba640 1 -- 172.21.15.142:0/112824075 >> v1:172.21.15.142:6789/0 conn(0x7f7cfc154b40 legacy=0x7f7cfc1579c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:04.596 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:04.594+0000 7f7d00dba640 1 -- 172.21.15.142:0/112824075 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7cfc0c5030 con 0x7f7cfc0c6590 2023-12-12T09:43:04.596 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:04.594+0000 7f7cfb7fe640 1 -- 172.21.15.142:0/112824075 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 98082073 0 0) 0x7f7cf4001490 con 0x7f7cfc154b40 2023-12-12T09:43:04.596 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:04.595+0000 7f7d00dba640 1 --2- 172.21.15.142:0/112824075 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7cfc0c6590 0x7f7cfc0c6970 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f7cfc08b0e0 tx=0x7f7cf002b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d2b966bbc92d4efc server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:43:04.596 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:04.595+0000 7f7cfb7fe640 1 -- 172.21.15.142:0/112824075 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cf0031830 con 0x7f7cfc0c6590 2023-12-12T09:43:04.596 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:04.595+0000 7f7cfb7fe640 1 -- 172.21.15.142:0/112824075 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7cf0031990 con 0x7f7cfc0c6590 2023-12-12T09:43:04.596 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:04.595+0000 7f7cfb7fe640 1 -- 172.21.15.142:0/112824075 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cf0031d20 con 0x7f7cfc0c6590 2023-12-12T09:43:04.597 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:04.596+0000 7f7d01dbc640 1 -- 172.21.15.142:0/112824075 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7cfc0c6590 msgr2=0x7f7cfc0c6970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:04.597 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:04.596+0000 7f7d01dbc640 1 --2- 172.21.15.142:0/112824075 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7cfc0c6590 0x7f7cfc0c6970 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f7cfc08b0e0 tx=0x7f7cf002b8d0 comp rx=0 tx=0).stop 2023-12-12T09:43:04.597 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:04.596+0000 7f7d01dbc640 1 -- 172.21.15.142:0/112824075 shutdown_connections 2023-12-12T09:43:04.597 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:04.596+0000 7f7d01dbc640 1 --2- 172.21.15.142:0/112824075 >> v2:172.21.15.73:3300/0 conn(0x7f7cfc0c81e0 0x7f7cfc06c0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:04.597 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:04.596+0000 7f7d01dbc640 1 --2- 172.21.15.142:0/112824075 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7cfc0c6590 0x7f7cfc0c6970 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:04.597 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:04.596+0000 7f7d01dbc640 1 -- 172.21.15.142:0/112824075 >> 172.21.15.142:0/112824075 conn(0x7f7cfc0ab770 msgr2=0x7f7cfc0abb80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:43:04.597 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:04.596+0000 7f7d01dbc640 1 -- 172.21.15.142:0/112824075 shutdown_connections 2023-12-12T09:43:04.597 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:04.596+0000 7f7d01dbc640 1 -- 172.21.15.142:0/112824075 wait complete. 2023-12-12T09:43:04.598 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:04.598+0000 7f7d01dbc640 1 Processor -- start 2023-12-12T09:43:04.598 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:04.598+0000 7f7d01dbc640 1 -- start start 2023-12-12T09:43:04.599 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:04.599+0000 7f7d01dbc640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7cfc0c6590 0x7f7cfc1ed190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:04.599 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:04.599+0000 7f7d01dbc640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7cfc0c81e0 0x7f7cfc1ed6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:04.599 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:04.599+0000 7f7d01dbc640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7cfc154b40 0x7f7cfc0c3070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:04.599 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:04.599+0000 7f7d01dbc640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cfc148d30 con 0x7f7cfc0c6590 2023-12-12T09:43:04.600 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:04.599+0000 7f7d01dbc640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cfc1eb920 con 0x7f7cfc0c81e0 2023-12-12T09:43:04.600 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:04.599+0000 7f7d01dbc640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7cfc1eaff0 con 0x7f7cfc154b40 2023-12-12T09:43:04.601 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:04.599+0000 7f7cfbfff640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7cfc0c81e0 0x7f7cfc1ed6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:04.601 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:04.599+0000 7f7d015bb640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7cfc154b40 0x7f7cfc0c3070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:04.601 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:04.599+0000 7f7cfbfff640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7cfc0c81e0 0x7f7cfc1ed6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:34296/0 (socket says 172.21.15.142:34296) 2023-12-12T09:43:04.601 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:04.599+0000 7f7cfbfff640 1 -- 172.21.15.142:0/2116728198 learned_addr learned my addr 172.21.15.142:0/2116728198 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-12-12T09:43:04.601 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:04.599+0000 7f7d00dba640 1 --2- 172.21.15.142:0/2116728198 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7cfc0c6590 0x7f7cfc1ed190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:04.601 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:04.600+0000 7f7d015bb640 1 -- 172.21.15.142:0/2116728198 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7cfc0c81e0 msgr2=0x7f7cfc1ed6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:04.601 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:04.600+0000 7f7d015bb640 1 --2- 172.21.15.142:0/2116728198 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7cfc0c81e0 0x7f7cfc1ed6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:04.601 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:04.600+0000 7f7d015bb640 1 -- 172.21.15.142:0/2116728198 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7cfc0c6590 msgr2=0x7f7cfc1ed190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:04.602 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:04.600+0000 7f7d015bb640 1 --2- 172.21.15.142:0/2116728198 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7cfc0c6590 0x7f7cfc1ed190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:04.602 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:04.600+0000 7f7d015bb640 1 -- 172.21.15.142:0/2116728198 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7cf0009400 con 0x7f7cfc154b40 2023-12-12T09:43:04.602 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:04.600+0000 7f7d015bb640 1 --2- 172.21.15.142:0/2116728198 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7cfc154b40 0x7f7cfc0c3070 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f7cf400c710 tx=0x7f7cf400cbd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:43:04.602 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:04.600+0000 7f7cf97fa640 1 -- 172.21.15.142:0/2116728198 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cf400ce20 con 0x7f7cfc154b40 2023-12-12T09:43:04.602 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:04.600+0000 7f7cf97fa640 1 -- 172.21.15.142:0/2116728198 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7cf400a640 con 0x7f7cfc154b40 2023-12-12T09:43:04.602 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:04.600+0000 7f7d01dbc640 1 -- 172.21.15.142:0/2116728198 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7cfc1eb2d0 con 0x7f7cfc154b40 2023-12-12T09:43:04.602 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:04.600+0000 7f7cf97fa640 1 -- 172.21.15.142:0/2116728198 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cf400a9f0 con 0x7f7cfc154b40 2023-12-12T09:43:04.602 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:04.601+0000 7f7d01dbc640 1 -- 172.21.15.142:0/2116728198 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7cfc0afa50 con 0x7f7cfc154b40 2023-12-12T09:43:04.602 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:04.601+0000 7f7cf97fa640 1 -- 172.21.15.142:0/2116728198 <== mon.2 v2:172.21.15.142:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f7cf40070d0 con 0x7f7cfc154b40 2023-12-12T09:43:04.602 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:04.601+0000 7f7cf97fa640 1 -- 172.21.15.142:0/2116728198 <== mon.2 v2:172.21.15.142:3301/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1070+0+0 (secure 0 0 0) 0x7f7cf4007810 con 0x7f7cfc154b40 2023-12-12T09:43:04.602 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:04.602+0000 7f7d01dbc640 1 -- 172.21.15.142:0/2116728198 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7cfc067400 con 0x7f7cfc154b40 2023-12-12T09:43:04.604 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:04.604+0000 7f7cf97fa640 1 -- 172.21.15.142:0/2116728198 <== mon.2 v2:172.21.15.142:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7f7cf4018070 con 0x7f7cfc154b40 2023-12-12T09:43:04.683 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:04.683+0000 7f7d01dbc640 1 -- 172.21.15.142:0/2116728198 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_command({"prefix": "osd new", "uuid": "3d1a91e0-42bf-437a-8eae-8d357c8f63a1", "id": 3} v 0) v1 -- 0x7f7cfc1eba60 con 0x7f7cfc154b40 2023-12-12T09:43:04.690 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:04.690+0000 7f7cf97fa640 1 -- 172.21.15.142:0/2116728198 <== mon.2 v2:172.21.15.142:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "3d1a91e0-42bf-437a-8eae-8d357c8f63a1", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7f7cfc06c630 con 0x7f7cfc154b40 2023-12-12T09:43:04.690 INFO:teuthology.orchestra.run.smithi142.stdout:3 2023-12-12T09:43:04.692 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:04.691+0000 7f7d01dbc640 1 -- 172.21.15.142:0/2116728198 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7cfc154b40 msgr2=0x7f7cfc0c3070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:04.692 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:04.691+0000 7f7d01dbc640 1 --2- 172.21.15.142:0/2116728198 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7cfc154b40 0x7f7cfc0c3070 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f7cf400c710 tx=0x7f7cf400cbd0 comp rx=0 tx=0).stop 2023-12-12T09:43:04.692 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:04.691+0000 7f7d01dbc640 1 -- 172.21.15.142:0/2116728198 shutdown_connections 2023-12-12T09:43:04.692 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:04.691+0000 7f7d01dbc640 1 --2- 172.21.15.142:0/2116728198 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7cfc154b40 0x7f7cfc0c3070 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:04.692 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:04.691+0000 7f7d01dbc640 1 --2- 172.21.15.142:0/2116728198 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7cfc0c81e0 0x7f7cfc1ed6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:04.692 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:04.691+0000 7f7d01dbc640 1 --2- 172.21.15.142:0/2116728198 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7cfc0c6590 0x7f7cfc1ed190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:04.692 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:04.691+0000 7f7d01dbc640 1 -- 172.21.15.142:0/2116728198 >> 172.21.15.142:0/2116728198 conn(0x7f7cfc0ab770 msgr2=0x7f7cfc0c8630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:43:04.692 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:04.691+0000 7f7d01dbc640 1 -- 172.21.15.142:0/2116728198 shutdown_connections 2023-12-12T09:43:04.692 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:04.692+0000 7f7d01dbc640 1 -- 172.21.15.142:0/2116728198 wait complete. 2023-12-12T09:43:04.709 DEBUG:teuthology.orchestra.run.smithi142:> sudo ceph --cluster ceph osd new 4b302fff-834c-4069-ac19-00e46f6c87b0 4 2023-12-12T09:43:04.833 INFO:tasks.ceph.mgr.x.smithi142.stderr:2023-12-12T09:43:04.833+0000 7f2df1446040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-12-12T09:43:04.865 INFO:tasks.ceph.mgr.y.smithi073.stderr:2023-12-12T09:43:04.864+0000 7fc1a5452040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-12-12T09:43:04.898 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:04.898+0000 7fd56a3e5640 1 Processor -- start 2023-12-12T09:43:04.898 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:04.898+0000 7fd56a3e5640 1 -- start start 2023-12-12T09:43:04.899 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:04.899+0000 7fd56a3e5640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd5640c67c0 0x7fd5640c7ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:04.899 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:04.899+0000 7fd56a3e5640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fd5641550a0 0x7fd56415efa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:04.900 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:04.899+0000 7fd56a3e5640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd56406c890 con 0x7fd5640c6ba0 2023-12-12T09:43:04.900 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:04.899+0000 7fd56a3e5640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5640c7000 con 0x7fd5641550a0 2023-12-12T09:43:04.900 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:04.899+0000 7fd56a3e5640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5640c4af0 con 0x7fd5640c67c0 2023-12-12T09:43:04.900 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:04.899+0000 7fd563fff640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd5640c67c0 0x7fd5640c7ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:04.900 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:04.899+0000 7fd5637fe640 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7fd5640c6ba0 0x7fd56406c180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:53906/0 (socket says 172.21.15.142:53906) 2023-12-12T09:43:04.900 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:04.899+0000 7fd5637fe640 1 -- 172.21.15.142:0/314337674 learned_addr learned my addr 172.21.15.142:0/314337674 (peer_addr_for_me v1:172.21.15.142:0/0) 2023-12-12T09:43:04.901 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:04.900+0000 7fd568982640 1 --2- 172.21.15.142:0/314337674 >> v2:172.21.15.73:3300/0 conn(0x7fd5641550a0 0x7fd56415efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:04.901 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:04.900+0000 7fd562ffd640 1 -- 172.21.15.142:0/314337674 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1684263643 0 0) 0x7fd56406c890 con 0x7fd5640c6ba0 2023-12-12T09:43:04.901 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:04.900+0000 7fd562ffd640 1 -- 172.21.15.142:0/314337674 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd54c003520 con 0x7fd5640c6ba0 2023-12-12T09:43:04.901 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:04.900+0000 7fd563fff640 1 -- 172.21.15.142:0/314337674 >> v2:172.21.15.73:3300/0 conn(0x7fd5641550a0 msgr2=0x7fd56415efa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:43:04.901 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:04.900+0000 7fd563fff640 1 --2- 172.21.15.142:0/314337674 >> v2:172.21.15.73:3300/0 conn(0x7fd5641550a0 0x7fd56415efa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:04.901 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:04.900+0000 7fd563fff640 1 -- 172.21.15.142:0/314337674 >> v1:172.21.15.142:6789/0 conn(0x7fd5640c6ba0 legacy=0x7fd56406c180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:04.901 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:04.900+0000 7fd563fff640 1 -- 172.21.15.142:0/314337674 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5640c4dd0 con 0x7fd5640c67c0 2023-12-12T09:43:04.902 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:04.901+0000 7fd563fff640 1 --2- 172.21.15.142:0/314337674 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd5640c67c0 0x7fd5640c7ed0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fd5540097a0 tx=0x7fd55402b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3dd019f9db7332f8 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:43:04.902 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:04.901+0000 7fd562ffd640 1 -- 172.21.15.142:0/314337674 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd554031830 con 0x7fd5640c67c0 2023-12-12T09:43:04.902 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:04.901+0000 7fd562ffd640 1 -- 172.21.15.142:0/314337674 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd554031990 con 0x7fd5640c67c0 2023-12-12T09:43:04.905 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:04.901+0000 7fd562ffd640 1 -- 172.21.15.142:0/314337674 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd554031d20 con 0x7fd5640c67c0 2023-12-12T09:43:04.905 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:04.902+0000 7fd56a3e5640 1 -- 172.21.15.142:0/314337674 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd5640c67c0 msgr2=0x7fd5640c7ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:04.905 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:04.902+0000 7fd56a3e5640 1 --2- 172.21.15.142:0/314337674 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd5640c67c0 0x7fd5640c7ed0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fd5540097a0 tx=0x7fd55402b8d0 comp rx=0 tx=0).stop 2023-12-12T09:43:04.905 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:04.902+0000 7fd56a3e5640 1 -- 172.21.15.142:0/314337674 shutdown_connections 2023-12-12T09:43:04.905 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:04.902+0000 7fd56a3e5640 1 --2- 172.21.15.142:0/314337674 >> v2:172.21.15.73:3300/0 conn(0x7fd5641550a0 0x7fd56415efa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:04.905 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:04.902+0000 7fd56a3e5640 1 --2- 172.21.15.142:0/314337674 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd5640c67c0 0x7fd5640c7ed0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:04.905 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:04.902+0000 7fd56a3e5640 1 -- 172.21.15.142:0/314337674 >> 172.21.15.142:0/314337674 conn(0x7fd5640abb20 msgr2=0x7fd5640abf30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:43:04.905 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:04.902+0000 7fd56a3e5640 1 -- 172.21.15.142:0/314337674 shutdown_connections 2023-12-12T09:43:04.905 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:04.902+0000 7fd56a3e5640 1 -- 172.21.15.142:0/314337674 wait complete. 2023-12-12T09:43:04.907 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:04.904+0000 7fd56a3e5640 1 Processor -- start 2023-12-12T09:43:04.908 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:04.904+0000 7fd56a3e5640 1 -- start start 2023-12-12T09:43:04.908 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:04.904+0000 7fd56a3e5640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd5640c67c0 0x7fd564157b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:04.908 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:04.904+0000 7fd56a3e5640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd5640c6ba0 0x7fd5640bfeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:04.908 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:04.904+0000 7fd56a3e5640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd5641550a0 0x7fd5640c03f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:04.908 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:04.904+0000 7fd56a3e5640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5640beef0 con 0x7fd5641550a0 2023-12-12T09:43:04.908 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:04.905+0000 7fd56a3e5640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5640bfa20 con 0x7fd5640c6ba0 2023-12-12T09:43:04.908 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:04.905+0000 7fd56a3e5640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5640c2250 con 0x7fd5640c67c0 2023-12-12T09:43:04.908 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:04.905+0000 7fd563fff640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd5640c67c0 0x7fd564157b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:04.908 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:04.905+0000 7fd5637fe640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd5640c6ba0 0x7fd5640bfeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:04.908 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:04.905+0000 7fd563fff640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd5640c67c0 0x7fd564157b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.142:39164/0 (socket says 172.21.15.142:39164) 2023-12-12T09:43:04.908 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:04.905+0000 7fd563fff640 1 -- 172.21.15.142:0/3474495689 learned_addr learned my addr 172.21.15.142:0/3474495689 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-12-12T09:43:04.908 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:04.905+0000 7fd568982640 1 --2- 172.21.15.142:0/3474495689 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd5641550a0 0x7fd5640c03f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:04.908 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:04.905+0000 7fd5637fe640 1 -- 172.21.15.142:0/3474495689 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd5640c67c0 msgr2=0x7fd564157b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:04.908 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:04.905+0000 7fd5637fe640 1 --2- 172.21.15.142:0/3474495689 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd5640c67c0 0x7fd564157b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:04.909 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:04.905+0000 7fd5637fe640 1 -- 172.21.15.142:0/3474495689 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd5641550a0 msgr2=0x7fd5640c03f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:04.909 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:04.905+0000 7fd5637fe640 1 --2- 172.21.15.142:0/3474495689 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd5641550a0 0x7fd5640c03f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:04.909 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:04.905+0000 7fd5637fe640 1 -- 172.21.15.142:0/3474495689 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd554009400 con 0x7fd5640c6ba0 2023-12-12T09:43:04.909 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:04.905+0000 7fd563fff640 1 --2- 172.21.15.142:0/3474495689 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd5640c67c0 0x7fd564157b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-12T09:43:04.909 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:04.905+0000 7fd5637fe640 1 --2- 172.21.15.142:0/3474495689 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd5640c6ba0 0x7fd5640bfeb0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fd55800c490 tx=0x7fd55800c950 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:43:04.909 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:04.906+0000 7fd560ff9640 1 -- 172.21.15.142:0/3474495689 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd558005ce0 con 0x7fd5640c6ba0 2023-12-12T09:43:04.909 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:04.906+0000 7fd560ff9640 1 -- 172.21.15.142:0/3474495689 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd558005e40 con 0x7fd5640c6ba0 2023-12-12T09:43:04.909 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:04.906+0000 7fd56a3e5640 1 -- 172.21.15.142:0/3474495689 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5640c24c0 con 0x7fd5640c6ba0 2023-12-12T09:43:04.909 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:04.906+0000 7fd560ff9640 1 -- 172.21.15.142:0/3474495689 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd558007270 con 0x7fd5640c6ba0 2023-12-12T09:43:04.909 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:04.906+0000 7fd56a3e5640 1 -- 172.21.15.142:0/3474495689 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd564158070 con 0x7fd5640c6ba0 2023-12-12T09:43:04.909 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:04.906+0000 7fd560ff9640 1 -- 172.21.15.142:0/3474495689 <== mon.1 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fd55801c440 con 0x7fd5640c6ba0 2023-12-12T09:43:04.909 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:04.906+0000 7fd560ff9640 1 -- 172.21.15.142:0/3474495689 <== mon.1 v2:172.21.15.142:3300/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1185+0+0 (secure 0 0 0) 0x7fd55801cc00 con 0x7fd5640c6ba0 2023-12-12T09:43:04.909 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:04.907+0000 7fd56a3e5640 1 -- 172.21.15.142:0/3474495689 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd564073af0 con 0x7fd5640c6ba0 2023-12-12T09:43:04.912 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:04.912+0000 7fd560ff9640 1 -- 172.21.15.142:0/3474495689 <== mon.1 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7fd558021060 con 0x7fd5640c6ba0 2023-12-12T09:43:04.989 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:04.989+0000 7fd56a3e5640 1 -- 172.21.15.142:0/3474495689 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd new", "uuid": "4b302fff-834c-4069-ac19-00e46f6c87b0", "id": 4} v 0) v1 -- 0x7fd564067580 con 0x7fd5640c6ba0 2023-12-12T09:43:04.997 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:04.996+0000 7fd560ff9640 1 -- 172.21.15.142:0/3474495689 <== mon.1 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "4b302fff-834c-4069-ac19-00e46f6c87b0", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7fd558017070 con 0x7fd5640c6ba0 2023-12-12T09:43:04.997 INFO:teuthology.orchestra.run.smithi142.stdout:4 2023-12-12T09:43:04.998 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:04.998+0000 7fd56a3e5640 1 -- 172.21.15.142:0/3474495689 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd5640c6ba0 msgr2=0x7fd5640bfeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:04.998 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:04.998+0000 7fd56a3e5640 1 --2- 172.21.15.142:0/3474495689 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd5640c6ba0 0x7fd5640bfeb0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fd55800c490 tx=0x7fd55800c950 comp rx=0 tx=0).stop 2023-12-12T09:43:04.998 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:04.998+0000 7fd56a3e5640 1 -- 172.21.15.142:0/3474495689 shutdown_connections 2023-12-12T09:43:04.999 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:04.998+0000 7fd56a3e5640 1 --2- 172.21.15.142:0/3474495689 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd5641550a0 0x7fd5640c03f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:04.999 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:04.998+0000 7fd56a3e5640 1 --2- 172.21.15.142:0/3474495689 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd5640c6ba0 0x7fd5640bfeb0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:04.999 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:04.998+0000 7fd56a3e5640 1 --2- 172.21.15.142:0/3474495689 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd5640c67c0 0x7fd564157b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:04.999 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:04.998+0000 7fd56a3e5640 1 -- 172.21.15.142:0/3474495689 >> 172.21.15.142:0/3474495689 conn(0x7fd5640abb20 msgr2=0x7fd5640abf00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:43:04.999 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:04.998+0000 7fd56a3e5640 1 -- 172.21.15.142:0/3474495689 shutdown_connections 2023-12-12T09:43:04.999 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:04.998+0000 7fd56a3e5640 1 -- 172.21.15.142:0/3474495689 wait complete. 2023-12-12T09:43:05.004 INFO:tasks.ceph.mgr.x.smithi142.stderr:2023-12-12T09:43:05.004+0000 7f2df1446040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-12-12T09:43:05.015 DEBUG:teuthology.orchestra.run.smithi142:> sudo ceph --cluster ceph osd new d7cdace2-67d0-45cc-95f2-515cf6ef1b82 5 2023-12-12T09:43:05.026 INFO:tasks.ceph.mgr.y.smithi073.stderr:2023-12-12T09:43:05.025+0000 7fc1a5452040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-12-12T09:43:05.142 INFO:tasks.ceph.mgr.x.smithi142.stderr:2023-12-12T09:43:05.141+0000 7f2df1446040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-12-12T09:43:05.167 INFO:tasks.ceph.mgr.y.smithi073.stderr:2023-12-12T09:43:05.166+0000 7fc1a5452040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-12-12T09:43:05.197 INFO:tasks.ceph.mgr.x.smithi142.stderr:2023-12-12T09:43:05.197+0000 7f2df1446040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-12-12T09:43:05.207 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:05.207+0000 7f352b59e640 1 Processor -- start 2023-12-12T09:43:05.208 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:05.207+0000 7f352b59e640 1 -- start start 2023-12-12T09:43:05.209 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:05.208+0000 7f352b59e640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f352c06a750 0x7f352c157980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:05.209 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:05.208+0000 7f352b59e640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f352c151be0 0x7f352c15ed10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:05.209 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:05.208+0000 7f352b59e640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f352c0c6730 con 0x7f352c1550a0 2023-12-12T09:43:05.209 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:05.208+0000 7f352b59e640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f352c0a6500 con 0x7f352c151be0 2023-12-12T09:43:05.209 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:05.208+0000 7f352b59e640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f352c1543d0 con 0x7f352c06a750 2023-12-12T09:43:05.209 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:05.208+0000 7f352a59c640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f352c06a750 0x7f352c157980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:05.210 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:05.209+0000 7f3523fff640 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f352c1550a0 0x7f352c1514d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:53914/0 (socket says 172.21.15.142:53914) 2023-12-12T09:43:05.210 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:05.209+0000 7f3523fff640 1 -- 172.21.15.142:0/3209962596 learned_addr learned my addr 172.21.15.142:0/3209962596 (peer_addr_for_me v1:172.21.15.142:0/0) 2023-12-12T09:43:05.210 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:05.209+0000 7f352a59c640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f352c06a750 0x7f352c157980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:34324/0 (socket says 172.21.15.142:34324) 2023-12-12T09:43:05.210 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:05.209+0000 7f352ad9d640 1 --2- 172.21.15.142:0/3209962596 >> v2:172.21.15.73:3300/0 conn(0x7f352c151be0 0x7f352c15ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:05.210 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:05.209+0000 7f352a59c640 1 -- 172.21.15.142:0/3209962596 >> v2:172.21.15.73:3300/0 conn(0x7f352c151be0 msgr2=0x7f352c15ed10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:43:05.210 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:05.209+0000 7f352a59c640 1 --2- 172.21.15.142:0/3209962596 >> v2:172.21.15.73:3300/0 conn(0x7f352c151be0 0x7f352c15ed10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:05.210 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:05.209+0000 7f352a59c640 1 -- 172.21.15.142:0/3209962596 >> v1:172.21.15.142:6789/0 conn(0x7f352c1550a0 legacy=0x7f352c1514d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:05.210 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:05.209+0000 7f352a59c640 1 -- 172.21.15.142:0/3209962596 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f352c0a6220 con 0x7f352c06a750 2023-12-12T09:43:05.211 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:05.210+0000 7f352a59c640 1 --2- 172.21.15.142:0/3209962596 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f352c06a750 0x7f352c157980 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f352c0c3390 tx=0x7f351c02b840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=31fb78eca192b06e server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:43:05.211 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:05.210+0000 7f3529d9b640 1 -- 172.21.15.142:0/3209962596 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f351c02e070 con 0x7f352c06a750 2023-12-12T09:43:05.211 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:05.211+0000 7f3529d9b640 1 -- 172.21.15.142:0/3209962596 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f351c0315a0 con 0x7f352c06a750 2023-12-12T09:43:05.211 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:05.211+0000 7f3529d9b640 1 -- 172.21.15.142:0/3209962596 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f351c031930 con 0x7f352c06a750 2023-12-12T09:43:05.212 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:05.211+0000 7f352b59e640 1 -- 172.21.15.142:0/3209962596 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f352c06a750 msgr2=0x7f352c157980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:05.212 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:05.211+0000 7f352b59e640 1 --2- 172.21.15.142:0/3209962596 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f352c06a750 0x7f352c157980 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f352c0c3390 tx=0x7f351c02b840 comp rx=0 tx=0).stop 2023-12-12T09:43:05.212 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:05.211+0000 7f352b59e640 1 -- 172.21.15.142:0/3209962596 shutdown_connections 2023-12-12T09:43:05.212 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:05.211+0000 7f352b59e640 1 --2- 172.21.15.142:0/3209962596 >> v2:172.21.15.73:3300/0 conn(0x7f352c151be0 0x7f352c15ed10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:05.212 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:05.211+0000 7f352b59e640 1 --2- 172.21.15.142:0/3209962596 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f352c06a750 0x7f352c157980 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:05.212 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:05.211+0000 7f352b59e640 1 -- 172.21.15.142:0/3209962596 >> 172.21.15.142:0/3209962596 conn(0x7f352c06b5f0 msgr2=0x7f352c06ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:43:05.212 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:05.211+0000 7f352b59e640 1 -- 172.21.15.142:0/3209962596 shutdown_connections 2023-12-12T09:43:05.212 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:05.211+0000 7f352b59e640 1 -- 172.21.15.142:0/3209962596 wait complete. 2023-12-12T09:43:05.213 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:05.213+0000 7f352b59e640 1 Processor -- start 2023-12-12T09:43:05.213 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:05.213+0000 7f352b59e640 1 -- start start 2023-12-12T09:43:05.216 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:05.214+0000 7f352b59e640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f352c06a750 0x7f352c06de60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:05.216 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:05.214+0000 7f352b59e640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f352c151be0 0x7f352c071ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:05.216 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:05.214+0000 7f352b59e640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f352c1550a0 0x7f352c152240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:05.216 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:05.214+0000 7f352b59e640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f352c153b80 con 0x7f352c1550a0 2023-12-12T09:43:05.216 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:05.214+0000 7f352b59e640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f352c1ea450 con 0x7f352c151be0 2023-12-12T09:43:05.216 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:05.214+0000 7f352b59e640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f352c153530 con 0x7f352c06a750 2023-12-12T09:43:05.216 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:05.214+0000 7f3523fff640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f352c151be0 0x7f352c071ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:05.216 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:05.214+0000 7f352a59c640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f352c06a750 0x7f352c06de60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:05.216 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:05.214+0000 7f3523fff640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f352c151be0 0x7f352c071ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:34340/0 (socket says 172.21.15.142:34340) 2023-12-12T09:43:05.216 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:05.214+0000 7f3523fff640 1 -- 172.21.15.142:0/2733589344 learned_addr learned my addr 172.21.15.142:0/2733589344 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-12-12T09:43:05.216 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:05.215+0000 7f352ad9d640 1 --2- 172.21.15.142:0/2733589344 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f352c1550a0 0x7f352c152240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:05.216 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:05.215+0000 7f3523fff640 1 -- 172.21.15.142:0/2733589344 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f352c06a750 msgr2=0x7f352c06de60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:05.217 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:05.215+0000 7f3523fff640 1 --2- 172.21.15.142:0/2733589344 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f352c06a750 0x7f352c06de60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:05.217 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:05.215+0000 7f3523fff640 1 -- 172.21.15.142:0/2733589344 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f352c1550a0 msgr2=0x7f352c152240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:05.217 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:05.215+0000 7f3523fff640 1 --2- 172.21.15.142:0/2733589344 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f352c1550a0 0x7f352c152240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:05.217 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:05.215+0000 7f3523fff640 1 -- 172.21.15.142:0/2733589344 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f351c009400 con 0x7f352c151be0 2023-12-12T09:43:05.217 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:05.215+0000 7f3523fff640 1 --2- 172.21.15.142:0/2733589344 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f352c151be0 0x7f352c071ef0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f351400c3c0 tx=0x7f351400c880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:43:05.217 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:05.215+0000 7f3522ffd640 1 -- 172.21.15.142:0/2733589344 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3514005ce0 con 0x7f352c151be0 2023-12-12T09:43:05.217 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:05.215+0000 7f3522ffd640 1 -- 172.21.15.142:0/2733589344 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3514005e40 con 0x7f352c151be0 2023-12-12T09:43:05.217 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:05.215+0000 7f3522ffd640 1 -- 172.21.15.142:0/2733589344 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35140072d0 con 0x7f352c151be0 2023-12-12T09:43:05.217 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:05.215+0000 7f352b59e640 1 -- 172.21.15.142:0/2733589344 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f352c153810 con 0x7f352c151be0 2023-12-12T09:43:05.217 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:05.216+0000 7f352b59e640 1 -- 172.21.15.142:0/2733589344 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f352c154010 con 0x7f352c151be0 2023-12-12T09:43:05.217 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:05.216+0000 7f3522ffd640 1 -- 172.21.15.142:0/2733589344 <== mon.1 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f351401c440 con 0x7f352c151be0 2023-12-12T09:43:05.218 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:05.216+0000 7f3522ffd640 1 -- 172.21.15.142:0/2733589344 <== mon.1 v2:172.21.15.142:3300/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1300+0+0 (secure 0 0 0) 0x7f351401cc70 con 0x7f352c151be0 2023-12-12T09:43:05.218 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:05.217+0000 7f352b59e640 1 -- 172.21.15.142:0/2733589344 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f352c1539a0 con 0x7f352c151be0 2023-12-12T09:43:05.220 INFO:tasks.ceph.mgr.y.smithi073.stderr:2023-12-12T09:43:05.220+0000 7fc1a5452040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-12-12T09:43:05.221 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:05.221+0000 7f3522ffd640 1 -- 172.21.15.142:0/2733589344 <== mon.1 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7f3514017070 con 0x7f352c151be0 2023-12-12T09:43:05.313 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:05.312+0000 7f352b59e640 1 -- 172.21.15.142:0/2733589344 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd new", "uuid": "d7cdace2-67d0-45cc-95f2-515cf6ef1b82", "id": 5} v 0) v1 -- 0x7f352c153cf0 con 0x7f352c151be0 2023-12-12T09:43:05.320 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:05.319+0000 7f3522ffd640 1 -- 172.21.15.142:0/2733589344 <== mon.1 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "d7cdace2-67d0-45cc-95f2-515cf6ef1b82", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7f351401c7c0 con 0x7f352c151be0 2023-12-12T09:43:05.320 INFO:teuthology.orchestra.run.smithi142.stdout:5 2023-12-12T09:43:05.321 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:05.321+0000 7f352b59e640 1 -- 172.21.15.142:0/2733589344 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f352c151be0 msgr2=0x7f352c071ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:05.322 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:05.321+0000 7f352b59e640 1 --2- 172.21.15.142:0/2733589344 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f352c151be0 0x7f352c071ef0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f351400c3c0 tx=0x7f351400c880 comp rx=0 tx=0).stop 2023-12-12T09:43:05.322 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:05.321+0000 7f352b59e640 1 -- 172.21.15.142:0/2733589344 shutdown_connections 2023-12-12T09:43:05.322 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:05.321+0000 7f352b59e640 1 --2- 172.21.15.142:0/2733589344 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f352c1550a0 0x7f352c152240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:05.322 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:05.321+0000 7f352b59e640 1 --2- 172.21.15.142:0/2733589344 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f352c151be0 0x7f352c071ef0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:05.322 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:05.321+0000 7f352b59e640 1 --2- 172.21.15.142:0/2733589344 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f352c06a750 0x7f352c06de60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:05.322 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:05.321+0000 7f352b59e640 1 -- 172.21.15.142:0/2733589344 >> 172.21.15.142:0/2733589344 conn(0x7f352c06b5f0 msgr2=0x7f352c149ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:43:05.322 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:05.321+0000 7f352b59e640 1 -- 172.21.15.142:0/2733589344 shutdown_connections 2023-12-12T09:43:05.322 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:05.321+0000 7f352b59e640 1 -- 172.21.15.142:0/2733589344 wait complete. 2023-12-12T09:43:05.331 INFO:tasks.ceph.mgr.y.smithi073.stderr:2023-12-12T09:43:05.331+0000 7fc1a5452040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-12-12T09:43:05.334 INFO:tasks.ceph.mgr.x.smithi142.stderr:2023-12-12T09:43:05.333+0000 7f2df1446040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-12-12T09:43:05.336 DEBUG:teuthology.orchestra.run.smithi142:> sudo ceph --cluster ceph osd new 649ce78a-5626-445c-aedc-a651ed05a6f6 6 2023-12-12T09:43:05.442 INFO:tasks.ceph.mgr.y.smithi073.stderr:2023-12-12T09:43:05.441+0000 7fc1a5452040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-12-12T09:43:05.454 INFO:tasks.ceph.mgr.x.smithi142.stderr:2023-12-12T09:43:05.453+0000 7f2df1446040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-12-12T09:43:05.534 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:05.533+0000 7fc86759e640 1 Processor -- start 2023-12-12T09:43:05.534 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:05.534+0000 7fc86759e640 1 -- start start 2023-12-12T09:43:05.535 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:05.535+0000 7fc86759e640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fc86806c430 0x7fc8680ca0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:05.536 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:05.535+0000 7fc86759e640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc868157ac0 con 0x7fc868151c00 2023-12-12T09:43:05.536 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:05.535+0000 7fc86759e640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc868157da0 con 0x7fc8680ca600 2023-12-12T09:43:05.536 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:05.535+0000 7fc86759e640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8680c5490 con 0x7fc86806c430 2023-12-12T09:43:05.536 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:05.535+0000 7fc85ffff640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fc86806c430 0x7fc8680ca0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:05.536 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:05.535+0000 7fc866d9d640 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7fc8680ca600 0x7fc8681544a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:53926/0 (socket says 172.21.15.142:53926) 2023-12-12T09:43:05.536 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:05.535+0000 7fc866d9d640 1 -- 172.21.15.142:0/1921861328 learned_addr learned my addr 172.21.15.142:0/1921861328 (peer_addr_for_me v1:172.21.15.142:0/0) 2023-12-12T09:43:05.536 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:05.536+0000 7fc865d9b640 1 -- 172.21.15.142:0/1921861328 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2641151510 0 0) 0x7fc868157da0 con 0x7fc8680ca600 2023-12-12T09:43:05.536 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:05.536+0000 7fc85ffff640 1 -- 172.21.15.142:0/1921861328 >> v1:172.21.15.142:6789/0 conn(0x7fc8680ca600 legacy=0x7fc8681544a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:05.536 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:05.536+0000 7fc85ffff640 1 -- 172.21.15.142:0/1921861328 >> v1:172.21.15.73:6789/0 conn(0x7fc868151c00 legacy=0x7fc8680c7d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:05.537 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:05.536+0000 7fc85ffff640 1 -- 172.21.15.142:0/1921861328 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc868158080 con 0x7fc86806c430 2023-12-12T09:43:05.537 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:05.537+0000 7fc85ffff640 1 --2- 172.21.15.142:0/1921861328 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc86806c430 0x7fc8680ca0c0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fc850009790 tx=0x7fc85002b840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c3968ae5929aeff4 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:43:05.537 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:05.537+0000 7fc865d9b640 1 -- 172.21.15.142:0/1921861328 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc85002e070 con 0x7fc86806c430 2023-12-12T09:43:05.537 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:05.537+0000 7fc865d9b640 1 -- 172.21.15.142:0/1921861328 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8500315a0 con 0x7fc86806c430 2023-12-12T09:43:05.538 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:05.537+0000 7fc865d9b640 1 -- 172.21.15.142:0/1921861328 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc850031930 con 0x7fc86806c430 2023-12-12T09:43:05.538 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:05.538+0000 7fc86759e640 1 -- 172.21.15.142:0/1921861328 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc86806c430 msgr2=0x7fc8680ca0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:05.538 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:05.538+0000 7fc86759e640 1 --2- 172.21.15.142:0/1921861328 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc86806c430 0x7fc8680ca0c0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fc850009790 tx=0x7fc85002b840 comp rx=0 tx=0).stop 2023-12-12T09:43:05.538 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:05.538+0000 7fc86759e640 1 -- 172.21.15.142:0/1921861328 shutdown_connections 2023-12-12T09:43:05.539 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:05.538+0000 7fc86759e640 1 --2- 172.21.15.142:0/1921861328 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc86806c430 0x7fc8680ca0c0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:05.539 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:05.538+0000 7fc86759e640 1 -- 172.21.15.142:0/1921861328 >> 172.21.15.142:0/1921861328 conn(0x7fc868072030 msgr2=0x7fc868072440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:43:05.539 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:05.538+0000 7fc86759e640 1 -- 172.21.15.142:0/1921861328 shutdown_connections 2023-12-12T09:43:05.539 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:05.538+0000 7fc86759e640 1 -- 172.21.15.142:0/1921861328 wait complete. 2023-12-12T09:43:05.540 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:05.540+0000 7fc86759e640 1 Processor -- start 2023-12-12T09:43:05.540 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:05.540+0000 7fc86759e640 1 -- start start 2023-12-12T09:43:05.543 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:05.541+0000 7fc86759e640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc86806c430 0x7fc86814b120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:05.543 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:05.541+0000 7fc86759e640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc8680ca600 0x7fc8681ed620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:05.543 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:05.541+0000 7fc86759e640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc868151c00 0x7fc8680c16e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:05.543 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:05.541+0000 7fc86759e640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc868158740 con 0x7fc868151c00 2023-12-12T09:43:05.543 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:05.541+0000 7fc86759e640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8680c85c0 con 0x7fc86806c430 2023-12-12T09:43:05.544 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:05.541+0000 7fc86759e640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8680c3150 con 0x7fc8680ca600 2023-12-12T09:43:05.544 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:05.541+0000 7fc85ffff640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc8680ca600 0x7fc8681ed620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:05.544 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:05.541+0000 7fc86659c640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc86806c430 0x7fc86814b120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:05.544 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:05.541+0000 7fc85ffff640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc8680ca600 0x7fc8681ed620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.142:39192/0 (socket says 172.21.15.142:39192) 2023-12-12T09:43:05.544 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:05.541+0000 7fc85ffff640 1 -- 172.21.15.142:0/3057979138 learned_addr learned my addr 172.21.15.142:0/3057979138 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-12-12T09:43:05.544 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:05.541+0000 7fc866d9d640 1 --2- 172.21.15.142:0/3057979138 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc868151c00 0x7fc8680c16e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:05.544 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:05.541+0000 7fc85ffff640 1 -- 172.21.15.142:0/3057979138 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc86806c430 msgr2=0x7fc86814b120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:05.544 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:05.541+0000 7fc85ffff640 1 --2- 172.21.15.142:0/3057979138 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc86806c430 0x7fc86814b120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:05.544 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:05.541+0000 7fc85ffff640 1 -- 172.21.15.142:0/3057979138 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc868151c00 msgr2=0x7fc8680c16e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:05.544 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:05.541+0000 7fc85ffff640 1 --2- 172.21.15.142:0/3057979138 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc868151c00 0x7fc8680c16e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:05.544 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:05.541+0000 7fc85ffff640 1 -- 172.21.15.142:0/3057979138 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8500093a0 con 0x7fc8680ca600 2023-12-12T09:43:05.544 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:05.541+0000 7fc86659c640 1 --2- 172.21.15.142:0/3057979138 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc86806c430 0x7fc86814b120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-12T09:43:05.544 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:05.542+0000 7fc85ffff640 1 --2- 172.21.15.142:0/3057979138 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc8680ca600 0x7fc8681ed620 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fc85002be50 tx=0x7fc8500046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:43:05.544 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:05.542+0000 7fc85effd640 1 -- 172.21.15.142:0/3057979138 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc850032980 con 0x7fc8680ca600 2023-12-12T09:43:05.545 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:05.542+0000 7fc85effd640 1 -- 172.21.15.142:0/3057979138 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc850032ae0 con 0x7fc8680ca600 2023-12-12T09:43:05.545 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:05.542+0000 7fc85effd640 1 -- 172.21.15.142:0/3057979138 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc850032e90 con 0x7fc8680ca600 2023-12-12T09:43:05.545 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:05.542+0000 7fc86759e640 1 -- 172.21.15.142:0/3057979138 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8680c25f0 con 0x7fc8680ca600 2023-12-12T09:43:05.545 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:05.542+0000 7fc86759e640 1 -- 172.21.15.142:0/3057979138 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc86814ab80 con 0x7fc8680ca600 2023-12-12T09:43:05.545 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:05.542+0000 7fc85effd640 1 -- 172.21.15.142:0/3057979138 <== mon.2 v2:172.21.15.142:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fc850005c90 con 0x7fc8680ca600 2023-12-12T09:43:05.545 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:05.542+0000 7fc85effd640 1 -- 172.21.15.142:0/3057979138 <== mon.2 v2:172.21.15.142:3301/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1415+0+0 (secure 0 0 0) 0x7fc85003b3f0 con 0x7fc8680ca600 2023-12-12T09:43:05.545 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:05.543+0000 7fc86759e640 1 -- 172.21.15.142:0/3057979138 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc868067b10 con 0x7fc8680ca600 2023-12-12T09:43:05.546 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:05.546+0000 7fc85effd640 1 -- 172.21.15.142:0/3057979138 <== mon.2 v2:172.21.15.142:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7fc850063ce0 con 0x7fc8680ca600 2023-12-12T09:43:05.604 INFO:tasks.ceph.mgr.y.smithi073.stderr:2023-12-12T09:43:05.603+0000 7fc1a5452040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-12-12T09:43:05.624 INFO:tasks.ceph.mgr.x.smithi142.stderr:2023-12-12T09:43:05.623+0000 7f2df1446040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-12-12T09:43:05.624 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:05.624+0000 7fc86759e640 1 -- 172.21.15.142:0/3057979138 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_command({"prefix": "osd new", "uuid": "649ce78a-5626-445c-aedc-a651ed05a6f6", "id": 6} v 0) v1 -- 0x7fc8680c7b00 con 0x7fc8680ca600 2023-12-12T09:43:05.632 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:05.632+0000 7fc85effd640 1 -- 172.21.15.142:0/3057979138 <== mon.2 v2:172.21.15.142:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "649ce78a-5626-445c-aedc-a651ed05a6f6", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7fc850052070 con 0x7fc8680ca600 2023-12-12T09:43:05.632 INFO:teuthology.orchestra.run.smithi142.stdout:6 2023-12-12T09:43:05.634 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:05.633+0000 7fc86759e640 1 -- 172.21.15.142:0/3057979138 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc8680ca600 msgr2=0x7fc8681ed620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:05.634 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:05.633+0000 7fc86759e640 1 --2- 172.21.15.142:0/3057979138 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc8680ca600 0x7fc8681ed620 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fc85002be50 tx=0x7fc8500046c0 comp rx=0 tx=0).stop 2023-12-12T09:43:05.634 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:05.633+0000 7fc86759e640 1 -- 172.21.15.142:0/3057979138 shutdown_connections 2023-12-12T09:43:05.634 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:05.633+0000 7fc86759e640 1 --2- 172.21.15.142:0/3057979138 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc868151c00 0x7fc8680c16e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:05.634 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:05.633+0000 7fc86759e640 1 --2- 172.21.15.142:0/3057979138 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc8680ca600 0x7fc8681ed620 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:05.634 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:05.633+0000 7fc86759e640 1 --2- 172.21.15.142:0/3057979138 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc86806c430 0x7fc86814b120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:05.634 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:05.633+0000 7fc86759e640 1 -- 172.21.15.142:0/3057979138 >> 172.21.15.142:0/3057979138 conn(0x7fc868072030 msgr2=0x7fc8680c7d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:43:05.634 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:05.634+0000 7fc86759e640 1 -- 172.21.15.142:0/3057979138 shutdown_connections 2023-12-12T09:43:05.634 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:05.634+0000 7fc86759e640 1 -- 172.21.15.142:0/3057979138 wait complete. 2023-12-12T09:43:05.651 DEBUG:teuthology.orchestra.run.smithi142:> sudo ceph --cluster ceph osd new af15ae3b-c1d0-4acf-92db-8a1805494d13 7 2023-12-12T09:43:05.654 INFO:tasks.ceph.mgr.y.smithi073.stderr:2023-12-12T09:43:05.654+0000 7fc1a5452040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-12-12T09:43:05.678 INFO:tasks.ceph.mgr.x.smithi142.stderr:2023-12-12T09:43:05.677+0000 7f2df1446040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-12-12T09:43:05.811 INFO:tasks.ceph.mgr.y.smithi073.stderr:2023-12-12T09:43:05.810+0000 7fc1a5452040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-12-12T09:43:05.833 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:05.832+0000 7f121f397640 1 Processor -- start 2023-12-12T09:43:05.833 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:05.833+0000 7f121f397640 1 -- start start 2023-12-12T09:43:05.835 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:05.834+0000 7f121f397640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1218151cc0 0x7f121806e780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:05.835 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:05.834+0000 7f121f397640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f1218072960 0x7f1218157b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:05.835 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:05.834+0000 7f121f397640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f121806e2f0 con 0x7f12180c3bc0 2023-12-12T09:43:05.835 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:05.834+0000 7f121f397640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12181520a0 con 0x7f1218072960 2023-12-12T09:43:05.835 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:05.834+0000 7f121f397640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12180c1070 con 0x7f1218151cc0 2023-12-12T09:43:05.835 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:05.834+0000 7f121d133640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1218151cc0 0x7f121806e780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:05.835 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:05.834+0000 7f121d133640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1218151cc0 0x7f121806e780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.142:39202/0 (socket says 172.21.15.142:39202) 2023-12-12T09:43:05.835 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:05.834+0000 7f121d133640 1 -- 172.21.15.142:0/131645657 learned_addr learned my addr 172.21.15.142:0/131645657 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-12-12T09:43:05.836 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:05.835+0000 7f121c932640 1 --2- 172.21.15.142:0/131645657 >> v2:172.21.15.73:3300/0 conn(0x7f1218072960 0x7f1218157b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:05.836 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:05.835+0000 7f121d133640 1 -- 172.21.15.142:0/131645657 >> v2:172.21.15.73:3300/0 conn(0x7f1218072960 msgr2=0x7f1218157b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:43:05.836 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:05.835+0000 7f121d133640 1 --2- 172.21.15.142:0/131645657 >> v2:172.21.15.73:3300/0 conn(0x7f1218072960 0x7f1218157b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:05.836 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:05.835+0000 7f121d133640 1 -- 172.21.15.142:0/131645657 >> v1:172.21.15.73:6789/0 conn(0x7f12180c3bc0 legacy=0x7f121806a4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:43:05.836 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:05.835+0000 7f121d133640 1 -- 172.21.15.142:0/131645657 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12180c0ab0 con 0x7f1218151cc0 2023-12-12T09:43:05.836 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:05.836+0000 7f121d133640 1 --2- 172.21.15.142:0/131645657 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1218151cc0 0x7f121806e780 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f1214009870 tx=0x7f121402b7e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9a512a5d2426815d server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:43:05.837 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:05.836+0000 7f120ffff640 1 -- 172.21.15.142:0/131645657 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1214031740 con 0x7f1218151cc0 2023-12-12T09:43:05.837 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:05.836+0000 7f120ffff640 1 -- 172.21.15.142:0/131645657 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12140318a0 con 0x7f1218151cc0 2023-12-12T09:43:05.837 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:05.836+0000 7f120ffff640 1 -- 172.21.15.142:0/131645657 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1214031c30 con 0x7f1218151cc0 2023-12-12T09:43:05.838 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:05.837+0000 7f121f397640 1 -- 172.21.15.142:0/131645657 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1218151cc0 msgr2=0x7f121806e780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:05.838 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:05.837+0000 7f121f397640 1 --2- 172.21.15.142:0/131645657 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1218151cc0 0x7f121806e780 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f1214009870 tx=0x7f121402b7e0 comp rx=0 tx=0).stop 2023-12-12T09:43:05.838 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:05.837+0000 7f121f397640 1 -- 172.21.15.142:0/131645657 shutdown_connections 2023-12-12T09:43:05.838 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:05.837+0000 7f121f397640 1 --2- 172.21.15.142:0/131645657 >> v2:172.21.15.73:3300/0 conn(0x7f1218072960 0x7f1218157b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:05.838 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:05.837+0000 7f121f397640 1 --2- 172.21.15.142:0/131645657 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1218151cc0 0x7f121806e780 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:05.838 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:05.837+0000 7f121f397640 1 -- 172.21.15.142:0/131645657 >> 172.21.15.142:0/131645657 conn(0x7f121806d590 msgr2=0x7f121806b5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:43:05.838 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:05.837+0000 7f121f397640 1 -- 172.21.15.142:0/131645657 shutdown_connections 2023-12-12T09:43:05.838 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:05.837+0000 7f121f397640 1 -- 172.21.15.142:0/131645657 wait complete. 2023-12-12T09:43:05.839 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:05.839+0000 7f121f397640 1 Processor -- start 2023-12-12T09:43:05.839 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:05.839+0000 7f121f397640 1 -- start start 2023-12-12T09:43:05.842 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:05.840+0000 7f121f397640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1218072960 0x7f12180c5000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:05.843 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:05.840+0000 7f121f397640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f12180c3bc0 0x7f1218147ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:05.843 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:05.840+0000 7f121f397640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1218151cc0 0x7f12180c5890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:05.843 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:05.840+0000 7f121f397640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12181eef10 con 0x7f1218072960 2023-12-12T09:43:05.843 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:05.840+0000 7f121f397640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12181ef1f0 con 0x7f1218151cc0 2023-12-12T09:43:05.843 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:05.840+0000 7f121f397640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f121814aac0 con 0x7f12180c3bc0 2023-12-12T09:43:05.843 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:05.840+0000 7f121c932640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f12180c3bc0 0x7f1218147ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:05.843 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:05.840+0000 7f121c932640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f12180c3bc0 0x7f1218147ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.142:39206/0 (socket says 172.21.15.142:39206) 2023-12-12T09:43:05.843 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:05.840+0000 7f121c932640 1 -- 172.21.15.142:0/3257751196 learned_addr learned my addr 172.21.15.142:0/3257751196 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-12-12T09:43:05.843 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:05.840+0000 7f121d934640 1 --2- 172.21.15.142:0/3257751196 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1218151cc0 0x7f12180c5890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:05.843 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:05.840+0000 7f121d133640 1 --2- 172.21.15.142:0/3257751196 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1218072960 0x7f12180c5000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:05.843 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:05.840+0000 7f121c932640 1 -- 172.21.15.142:0/3257751196 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1218151cc0 msgr2=0x7f12180c5890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:05.843 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:05.840+0000 7f121c932640 1 --2- 172.21.15.142:0/3257751196 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1218151cc0 0x7f12180c5890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:05.844 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:05.840+0000 7f121c932640 1 -- 172.21.15.142:0/3257751196 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1218072960 msgr2=0x7f12180c5000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:05.844 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:05.840+0000 7f121c932640 1 --2- 172.21.15.142:0/3257751196 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1218072960 0x7f12180c5000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:05.844 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:05.840+0000 7f121c932640 1 -- 172.21.15.142:0/3257751196 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12140094d0 con 0x7f12180c3bc0 2023-12-12T09:43:05.844 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:05.841+0000 7f121c932640 1 --2- 172.21.15.142:0/3257751196 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f12180c3bc0 0x7f1218147ad0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f120800d5f0 tx=0x7f120800dab0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:43:05.844 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:05.841+0000 7f120dffb640 1 -- 172.21.15.142:0/3257751196 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12080125f0 con 0x7f12180c3bc0 2023-12-12T09:43:05.844 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:05.841+0000 7f120dffb640 1 -- 172.21.15.142:0/3257751196 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1208012750 con 0x7f12180c3bc0 2023-12-12T09:43:05.844 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:05.841+0000 7f120dffb640 1 -- 172.21.15.142:0/3257751196 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1208012b00 con 0x7f12180c3bc0 2023-12-12T09:43:05.844 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:05.841+0000 7f121f397640 1 -- 172.21.15.142:0/3257751196 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12180ab8f0 con 0x7f12180c3bc0 2023-12-12T09:43:05.844 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:05.841+0000 7f121f397640 1 -- 172.21.15.142:0/3257751196 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1218148010 con 0x7f12180c3bc0 2023-12-12T09:43:05.844 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:05.841+0000 7f120dffb640 1 -- 172.21.15.142:0/3257751196 <== mon.2 v2:172.21.15.142:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f120801e460 con 0x7f12180c3bc0 2023-12-12T09:43:05.844 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:05.842+0000 7f120dffb640 1 -- 172.21.15.142:0/3257751196 <== mon.2 v2:172.21.15.142:3301/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1530+0+0 (secure 0 0 0) 0x7f1208014b30 con 0x7f12180c3bc0 2023-12-12T09:43:05.844 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:05.842+0000 7f121f397640 1 -- 172.21.15.142:0/3257751196 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f121814ac80 con 0x7f12180c3bc0 2023-12-12T09:43:05.845 INFO:tasks.ceph.mgr.x.smithi142.stderr:2023-12-12T09:43:05.842+0000 7f2df1446040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-12-12T09:43:05.845 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:05.845+0000 7f120dffb640 1 -- 172.21.15.142:0/3257751196 <== mon.2 v2:172.21.15.142:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7f1208014d80 con 0x7f12180c3bc0 2023-12-12T09:43:05.923 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:05.923+0000 7f121f397640 1 -- 172.21.15.142:0/3257751196 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_command({"prefix": "osd new", "uuid": "af15ae3b-c1d0-4acf-92db-8a1805494d13", "id": 7} v 0) v1 -- 0x7f1218071520 con 0x7f12180c3bc0 2023-12-12T09:43:05.930 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:05.930+0000 7f120dffb640 1 -- 172.21.15.142:0/3257751196 <== mon.2 v2:172.21.15.142:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "af15ae3b-c1d0-4acf-92db-8a1805494d13", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7f12080144d0 con 0x7f12180c3bc0 2023-12-12T09:43:05.931 INFO:teuthology.orchestra.run.smithi142.stdout:7 2023-12-12T09:43:05.932 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:05.931+0000 7f121f397640 1 -- 172.21.15.142:0/3257751196 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f12180c3bc0 msgr2=0x7f1218147ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:05.932 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:05.931+0000 7f121f397640 1 --2- 172.21.15.142:0/3257751196 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f12180c3bc0 0x7f1218147ad0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f120800d5f0 tx=0x7f120800dab0 comp rx=0 tx=0).stop 2023-12-12T09:43:05.932 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:05.931+0000 7f121f397640 1 -- 172.21.15.142:0/3257751196 shutdown_connections 2023-12-12T09:43:05.932 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:05.931+0000 7f121f397640 1 --2- 172.21.15.142:0/3257751196 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1218151cc0 0x7f12180c5890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:05.932 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:05.931+0000 7f121f397640 1 --2- 172.21.15.142:0/3257751196 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f12180c3bc0 0x7f1218147ad0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:05.932 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:05.931+0000 7f121f397640 1 --2- 172.21.15.142:0/3257751196 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1218072960 0x7f12180c5000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:05.933 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:05.931+0000 7f121f397640 1 -- 172.21.15.142:0/3257751196 >> 172.21.15.142:0/3257751196 conn(0x7f121806d590 msgr2=0x7f1218150780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:43:05.933 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:05.932+0000 7f121f397640 1 -- 172.21.15.142:0/3257751196 shutdown_connections 2023-12-12T09:43:05.933 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-12T09:43:05.932+0000 7f121f397640 1 -- 172.21.15.142:0/3257751196 wait complete. 2023-12-12T09:43:05.949 INFO:tasks.ceph.osd.0:Restarting daemon 2023-12-12T09:43:05.949 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2023-12-12T09:43:05.958 INFO:tasks.ceph.osd.0:Started 2023-12-12T09:43:05.958 INFO:tasks.ceph.osd.1:Restarting daemon 2023-12-12T09:43:05.958 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2023-12-12T09:43:05.966 INFO:tasks.ceph.osd.1:Started 2023-12-12T09:43:05.967 INFO:tasks.ceph.osd.2:Restarting daemon 2023-12-12T09:43:05.967 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2023-12-12T09:43:05.973 INFO:tasks.ceph.osd.2:Started 2023-12-12T09:43:05.973 INFO:tasks.ceph.osd.3:Restarting daemon 2023-12-12T09:43:05.974 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2023-12-12T09:43:05.978 INFO:tasks.ceph.osd.3:Started 2023-12-12T09:43:05.978 INFO:tasks.ceph.osd.4:Restarting daemon 2023-12-12T09:43:05.978 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2023-12-12T09:43:05.998 INFO:tasks.ceph.osd.4:Started 2023-12-12T09:43:05.998 INFO:tasks.ceph.osd.5:Restarting daemon 2023-12-12T09:43:05.998 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2023-12-12T09:43:06.006 INFO:tasks.ceph.osd.5:Started 2023-12-12T09:43:06.006 INFO:tasks.ceph.osd.6:Restarting daemon 2023-12-12T09:43:06.006 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2023-12-12T09:43:06.011 INFO:tasks.ceph.osd.6:Started 2023-12-12T09:43:06.012 INFO:tasks.ceph.osd.7:Restarting daemon 2023-12-12T09:43:06.012 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2023-12-12T09:43:06.017 INFO:tasks.ceph.osd.7:Started 2023-12-12T09:43:06.017 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-12T09:43:06.236 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:06.235+0000 7fcfbd1ce640 1 Processor -- start 2023-12-12T09:43:06.236 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:06.235+0000 7fcfbd1ce640 1 -- start start 2023-12-12T09:43:06.237 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:06.236+0000 7fcfbd1ce640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fcfb80c9900 0x7fcfb80c86d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:06.237 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:06.236+0000 7fcfbd1ce640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcfb80c4ce0 con 0x7fcfb8157b30 2023-12-12T09:43:06.237 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:06.236+0000 7fcfbd1ce640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcfb8151fc0 con 0x7fcfb8151be0 2023-12-12T09:43:06.237 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:06.236+0000 7fcfbd1ce640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcfb80c6190 con 0x7fcfb80c9900 2023-12-12T09:43:06.238 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:06.236+0000 7fcfb659c640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fcfb80c9900 0x7fcfb80c86d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:06.238 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:06.236+0000 7fcfb759e640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7fcfb8157b30 0x7fcfb8157f40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:42208/0 (socket says 172.21.15.73:42208) 2023-12-12T09:43:06.238 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:06.236+0000 7fcfb759e640 1 -- 172.21.15.73:0/2130547152 learned_addr learned my addr 172.21.15.73:0/2130547152 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-12T09:43:06.238 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:06.237+0000 7fcfb659c640 1 -- 172.21.15.73:0/2130547152 >> v1:172.21.15.142:6789/0 conn(0x7fcfb8151be0 legacy=0x7fcfb80bf160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:06.238 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:06.237+0000 7fcfb659c640 1 -- 172.21.15.73:0/2130547152 >> v1:172.21.15.73:6789/0 conn(0x7fcfb8157b30 legacy=0x7fcfb8157f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:06.239 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:06.237+0000 7fcfb659c640 1 -- 172.21.15.73:0/2130547152 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfb80c6470 con 0x7fcfb80c9900 2023-12-12T09:43:06.239 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:06.238+0000 7fcfb659c640 1 --2- 172.21.15.73:0/2130547152 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcfb80c9900 0x7fcfb80c86d0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fcfac0097a0 tx=0x7fcfac02b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=671428531c77d2f8 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:43:06.240 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:06.238+0000 7fcfb5d9b640 1 -- 172.21.15.73:0/2130547152 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfac02e070 con 0x7fcfb80c9900 2023-12-12T09:43:06.240 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:06.238+0000 7fcfb5d9b640 1 -- 172.21.15.73:0/2130547152 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfac0315a0 con 0x7fcfb80c9900 2023-12-12T09:43:06.240 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:06.238+0000 7fcfb5d9b640 1 -- 172.21.15.73:0/2130547152 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfac031930 con 0x7fcfb80c9900 2023-12-12T09:43:06.240 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:06.239+0000 7fcfbd1ce640 1 -- 172.21.15.73:0/2130547152 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcfb80c9900 msgr2=0x7fcfb80c86d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:06.240 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:06.239+0000 7fcfbd1ce640 1 --2- 172.21.15.73:0/2130547152 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcfb80c9900 0x7fcfb80c86d0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fcfac0097a0 tx=0x7fcfac02b840 comp rx=0 tx=0).stop 2023-12-12T09:43:06.240 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:06.239+0000 7fcfbd1ce640 1 -- 172.21.15.73:0/2130547152 shutdown_connections 2023-12-12T09:43:06.240 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:06.239+0000 7fcfbd1ce640 1 --2- 172.21.15.73:0/2130547152 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcfb80c9900 0x7fcfb80c86d0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:06.240 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:06.239+0000 7fcfbd1ce640 1 -- 172.21.15.73:0/2130547152 >> 172.21.15.73:0/2130547152 conn(0x7fcfb80c9dc0 msgr2=0x7fcfb80ca1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:43:06.240 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:06.239+0000 7fcfbd1ce640 1 -- 172.21.15.73:0/2130547152 shutdown_connections 2023-12-12T09:43:06.241 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:06.239+0000 7fcfbd1ce640 1 -- 172.21.15.73:0/2130547152 wait complete. 2023-12-12T09:43:06.241 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:06.240+0000 7fcfbd1ce640 1 Processor -- start 2023-12-12T09:43:06.241 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:06.241+0000 7fcfbd1ce640 1 -- start start 2023-12-12T09:43:06.244 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:06.241+0000 7fcfbd1ce640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcfb80c9900 0x7fcfb80aaaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:06.244 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:06.241+0000 7fcfbd1ce640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcfb8151be0 0x7fcfb81ed120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:06.244 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:06.241+0000 7fcfbd1ce640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcfb8157b30 0x7fcfb81ed660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:06.244 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:06.241+0000 7fcfbd1ce640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfb80ab830 con 0x7fcfb8157b30 2023-12-12T09:43:06.244 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:06.241+0000 7fcfbd1ce640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfb81edba0 con 0x7fcfb8151be0 2023-12-12T09:43:06.244 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:06.241+0000 7fcfbd1ce640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcfb8155180 con 0x7fcfb80c9900 2023-12-12T09:43:06.244 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:06.242+0000 7fcfb759e640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcfb8157b30 0x7fcfb81ed660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:06.244 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:06.242+0000 7fcfb6d9d640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcfb80c9900 0x7fcfb80aaaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:06.244 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:06.242+0000 7fcfb659c640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcfb8151be0 0x7fcfb81ed120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:06.244 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:06.242+0000 7fcfb6d9d640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcfb80c9900 0x7fcfb80aaaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.73:46280/0 (socket says 172.21.15.73:46280) 2023-12-12T09:43:06.245 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:06.242+0000 7fcfb6d9d640 1 -- 172.21.15.73:0/764281756 learned_addr learned my addr 172.21.15.73:0/764281756 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:43:06.245 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:06.242+0000 7fcfb759e640 1 --2- 172.21.15.73:0/764281756 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcfb8157b30 0x7fcfb81ed660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:45296/0 (socket says 172.21.15.73:45296) 2023-12-12T09:43:06.245 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:06.242+0000 7fcfb759e640 1 -- 172.21.15.73:0/764281756 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcfb80c9900 msgr2=0x7fcfb80aaaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:06.245 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:06.242+0000 7fcfb759e640 1 --2- 172.21.15.73:0/764281756 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcfb80c9900 0x7fcfb80aaaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:06.245 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:06.242+0000 7fcfb759e640 1 -- 172.21.15.73:0/764281756 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcfb8151be0 msgr2=0x7fcfb81ed120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:06.245 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:06.242+0000 7fcfb759e640 1 --2- 172.21.15.73:0/764281756 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcfb8151be0 0x7fcfb81ed120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:06.245 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:06.242+0000 7fcfb759e640 1 -- 172.21.15.73:0/764281756 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfac009400 con 0x7fcfb8157b30 2023-12-12T09:43:06.245 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:06.242+0000 7fcfb759e640 1 --2- 172.21.15.73:0/764281756 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcfb8157b30 0x7fcfb81ed660 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fcfb000caa0 tx=0x7fcfb000cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:43:06.245 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:06.243+0000 7fcf9f7fe640 1 -- 172.21.15.73:0/764281756 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfb000ab40 con 0x7fcfb8157b30 2023-12-12T09:43:06.245 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:06.243+0000 7fcf9f7fe640 1 -- 172.21.15.73:0/764281756 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfb000aca0 con 0x7fcfb8157b30 2023-12-12T09:43:06.245 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:06.243+0000 7fcf9f7fe640 1 -- 172.21.15.73:0/764281756 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfb0012600 con 0x7fcfb8157b30 2023-12-12T09:43:06.245 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:06.243+0000 7fcfbd1ce640 1 -- 172.21.15.73:0/764281756 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcfb81539c0 con 0x7fcfb8157b30 2023-12-12T09:43:06.245 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:06.243+0000 7fcfbd1ce640 1 -- 172.21.15.73:0/764281756 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcfb8153f80 con 0x7fcfb8157b30 2023-12-12T09:43:06.245 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:06.243+0000 7fcf9f7fe640 1 -- 172.21.15.73:0/764281756 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fcfb0012a60 con 0x7fcfb8157b30 2023-12-12T09:43:06.246 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:06.243+0000 7fcf9f7fe640 1 -- 172.21.15.73:0/764281756 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7fcfb0012d10 con 0x7fcfb8157b30 2023-12-12T09:43:06.246 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:06.244+0000 7fcfbd1ce640 1 -- 172.21.15.73:0/764281756 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcfb8067580 con 0x7fcfb8157b30 2023-12-12T09:43:06.247 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:06.247+0000 7fcf9f7fe640 1 -- 172.21.15.73:0/764281756 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7fcfb0021060 con 0x7fcfb8157b30 2023-12-12T09:43:06.311 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:06.310+0000 7fcfbd1ce640 1 -- 172.21.15.73:0/764281756 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcfb80c4740 con 0x7fcfb8157b30 2023-12-12T09:43:06.312 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:06.312+0000 7fcf9f7fe640 1 -- 172.21.15.73:0/764281756 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7fcfb0017070 con 0x7fcfb8157b30 2023-12-12T09:43:06.313 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-12T09:43:06.313 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":10,"fsid":"ba240992-02b8-4c7e-92f2-27eb29ac433b","created":"2023-12-12T09:43:02.454719+0000","modified":"2023-12-12T09:43:05.925348+0000","last_up_change":"0.000000","last_in_change":"2023-12-12T09:43:05.925348+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"dd9074be-dbe2-4c34-9896-a4223d8d3940","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"c4a05052-96d4-4758-a4e1-1a37f1e07fed","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"512bc8ac-72c2-40d4-b3d2-d867a92c5213","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"3d1a91e0-42bf-437a-8eae-8d357c8f63a1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"4b302fff-834c-4069-ac19-00e46f6c87b0","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"d7cdace2-67d0-45cc-95f2-515cf6ef1b82","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"649ce78a-5626-445c-aedc-a651ed05a6f6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"af15ae3b-c1d0-4acf-92db-8a1805494d13","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-12T09:43:06.314 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:06.313+0000 7fcfbd1ce640 1 -- 172.21.15.73:0/764281756 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcfb8157b30 msgr2=0x7fcfb81ed660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:06.314 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:06.313+0000 7fcfbd1ce640 1 --2- 172.21.15.73:0/764281756 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcfb8157b30 0x7fcfb81ed660 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fcfb000caa0 tx=0x7fcfb000cf60 comp rx=0 tx=0).stop 2023-12-12T09:43:06.314 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:06.313+0000 7fcfbd1ce640 1 -- 172.21.15.73:0/764281756 shutdown_connections 2023-12-12T09:43:06.314 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:06.313+0000 7fcfbd1ce640 1 --2- 172.21.15.73:0/764281756 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcfb8157b30 0x7fcfb81ed660 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:06.314 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:06.313+0000 7fcfbd1ce640 1 --2- 172.21.15.73:0/764281756 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcfb8151be0 0x7fcfb81ed120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:06.315 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:06.313+0000 7fcfbd1ce640 1 --2- 172.21.15.73:0/764281756 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcfb80c9900 0x7fcfb80aaaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:06.315 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:06.313+0000 7fcfbd1ce640 1 -- 172.21.15.73:0/764281756 >> 172.21.15.73:0/764281756 conn(0x7fcfb80c9dc0 msgr2=0x7fcfb8150ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:43:06.315 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:06.313+0000 7fcfbd1ce640 1 -- 172.21.15.73:0/764281756 shutdown_connections 2023-12-12T09:43:06.315 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:06.313+0000 7fcfbd1ce640 1 -- 172.21.15.73:0/764281756 wait complete. 2023-12-12T09:43:06.331 INFO:tasks.ceph.ceph_manager.ceph:[] 2023-12-12T09:43:06.331 INFO:tasks.ceph:Waiting for OSDs to come up 2023-12-12T09:43:06.672 INFO:tasks.ceph.osd.0.smithi073.stderr:2023-12-12T09:43:06.671+0000 7f51fe610500 -1 Falling back to public interface 2023-12-12T09:43:06.693 INFO:tasks.ceph.osd.3.smithi073.stderr:2023-12-12T09:43:06.692+0000 7f2d1d017500 -1 Falling back to public interface 2023-12-12T09:43:06.700 INFO:tasks.ceph.osd.4.smithi142.stderr:2023-12-12T09:43:06.700+0000 7f5ddd69c500 -1 Falling back to public interface 2023-12-12T09:43:06.701 INFO:tasks.ceph.osd.6.smithi142.stderr:2023-12-12T09:43:06.700+0000 7fe583825500 -1 Falling back to public interface 2023-12-12T09:43:06.703 INFO:tasks.ceph.osd.2.smithi073.stderr:2023-12-12T09:43:06.702+0000 7f3cb3174500 -1 Falling back to public interface 2023-12-12T09:43:06.709 INFO:tasks.ceph.osd.1.smithi073.stderr:2023-12-12T09:43:06.708+0000 7f0d872c2500 -1 Falling back to public interface 2023-12-12T09:43:06.734 INFO:tasks.ceph.osd.5.smithi142.stderr:2023-12-12T09:43:06.734+0000 7fe65120c500 -1 Falling back to public interface 2023-12-12T09:43:06.735 INFO:tasks.ceph.osd.7.smithi142.stderr:2023-12-12T09:43:06.734+0000 7f714ba0d500 -1 Falling back to public interface 2023-12-12T09:43:06.735 INFO:tasks.ceph.osd.5.smithi142.stderr:2023-12-12T09:43:06.735+0000 7fe6501b3640 -1 PosixStack listen unable to listen on v2:0.0.0.0:6816/0: (98) Address already in use 2023-12-12T09:43:06.931 INFO:tasks.ceph.mgr.y.smithi073.stderr:2023-12-12T09:43:06.930+0000 7fc1a5452040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-12-12T09:43:06.992 INFO:tasks.ceph.mgr.x.smithi142.stderr:2023-12-12T09:43:06.991+0000 7f2df1446040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-12-12T09:43:07.136 DEBUG:teuthology.orchestra.run.smithi073:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-12-12T09:43:07.242 INFO:tasks.ceph.mgr.y.smithi073.stderr:2023-12-12T09:43:07.241+0000 7fc1a5452040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-12-12T09:43:07.301 INFO:teuthology.misc.health.smithi073.stderr:2023-12-12T09:43:07.300+0000 7f7099790640 1 Processor -- start 2023-12-12T09:43:07.301 INFO:teuthology.misc.health.smithi073.stderr:2023-12-12T09:43:07.300+0000 7f7099790640 1 -- start start 2023-12-12T09:43:07.303 INFO:teuthology.misc.health.smithi073.stderr:2023-12-12T09:43:07.301+0000 7f7099790640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f70940c4a10 0x7f7094151620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:07.303 INFO:teuthology.misc.health.smithi073.stderr:2023-12-12T09:43:07.301+0000 7f7099790640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f70940c7cc0 0x7f7094154c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:07.303 INFO:teuthology.misc.health.smithi073.stderr:2023-12-12T09:43:07.301+0000 7f7099790640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7094158940 con 0x7f70940bd470 2023-12-12T09:43:07.303 INFO:teuthology.misc.health.smithi073.stderr:2023-12-12T09:43:07.301+0000 7f7099790640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70940ca890 con 0x7f70940c4a10 2023-12-12T09:43:07.303 INFO:teuthology.misc.health.smithi073.stderr:2023-12-12T09:43:07.301+0000 7f7099790640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70941583e0 con 0x7f70940c7cc0 2023-12-12T09:43:07.303 INFO:teuthology.misc.health.smithi073.stderr:2023-12-12T09:43:07.301+0000 7f7092ffd640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f70940c4a10 0x7f7094151620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:07.303 INFO:teuthology.misc.health.smithi073.stderr:2023-12-12T09:43:07.301+0000 7f7092ffd640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f70940c4a10 0x7f7094151620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:45302/0 (socket says 172.21.15.73:45302) 2023-12-12T09:43:07.303 INFO:teuthology.misc.health.smithi073.stderr:2023-12-12T09:43:07.301+0000 7f7092ffd640 1 -- 172.21.15.73:0/2507621617 learned_addr learned my addr 172.21.15.73:0/2507621617 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:43:07.303 INFO:teuthology.misc.health.smithi073.stderr:2023-12-12T09:43:07.301+0000 7f70927fc640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f70940bd470 0x7f7094154560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:42220/0 (socket says 172.21.15.73:42220) 2023-12-12T09:43:07.303 INFO:teuthology.misc.health.smithi073.stderr:2023-12-12T09:43:07.301+0000 7f70937fe640 1 --2- 172.21.15.73:0/2507621617 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f70940c7cc0 0x7f7094154c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:07.303 INFO:teuthology.misc.health.smithi073.stderr:2023-12-12T09:43:07.302+0000 7f7092ffd640 1 -- 172.21.15.73:0/2507621617 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f70940c7cc0 msgr2=0x7f7094154c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:43:07.303 INFO:teuthology.misc.health.smithi073.stderr:2023-12-12T09:43:07.302+0000 7f7092ffd640 1 --2- 172.21.15.73:0/2507621617 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f70940c7cc0 0x7f7094154c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:07.303 INFO:teuthology.misc.health.smithi073.stderr:2023-12-12T09:43:07.302+0000 7f7092ffd640 1 -- 172.21.15.73:0/2507621617 >> v1:172.21.15.73:6789/0 conn(0x7f70940bd470 legacy=0x7f7094154560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:07.304 INFO:teuthology.misc.health.smithi073.stderr:2023-12-12T09:43:07.302+0000 7f7092ffd640 1 -- 172.21.15.73:0/2507621617 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f709406cc60 con 0x7f70940c4a10 2023-12-12T09:43:07.304 INFO:teuthology.misc.health.smithi073.stderr:2023-12-12T09:43:07.302+0000 7f7091ffb640 1 -- 172.21.15.73:0/2507621617 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3345730211 0 0) 0x7f7094158940 con 0x7f70940bd470 2023-12-12T09:43:07.305 INFO:teuthology.misc.health.smithi073.stderr:2023-12-12T09:43:07.303+0000 7f7092ffd640 1 --2- 172.21.15.73:0/2507621617 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f70940c4a10 0x7f7094151620 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f7084009870 tx=0x7f708402b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53312c6cb5f3fa71 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:43:07.305 INFO:teuthology.misc.health.smithi073.stderr:2023-12-12T09:43:07.303+0000 7f7091ffb640 1 -- 172.21.15.73:0/2507621617 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70840317c0 con 0x7f70940c4a10 2023-12-12T09:43:07.305 INFO:teuthology.misc.health.smithi073.stderr:2023-12-12T09:43:07.303+0000 7f7091ffb640 1 -- 172.21.15.73:0/2507621617 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7084031920 con 0x7f70940c4a10 2023-12-12T09:43:07.305 INFO:teuthology.misc.health.smithi073.stderr:2023-12-12T09:43:07.303+0000 7f7091ffb640 1 -- 172.21.15.73:0/2507621617 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7084031cb0 con 0x7f70940c4a10 2023-12-12T09:43:07.305 INFO:teuthology.misc.health.smithi073.stderr:2023-12-12T09:43:07.303+0000 7f7099790640 1 -- 172.21.15.73:0/2507621617 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f70940c4a10 msgr2=0x7f7094151620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:07.305 INFO:teuthology.misc.health.smithi073.stderr:2023-12-12T09:43:07.303+0000 7f7099790640 1 --2- 172.21.15.73:0/2507621617 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f70940c4a10 0x7f7094151620 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f7084009870 tx=0x7f708402b860 comp rx=0 tx=0).stop 2023-12-12T09:43:07.305 INFO:teuthology.misc.health.smithi073.stderr:2023-12-12T09:43:07.304+0000 7f7099790640 1 -- 172.21.15.73:0/2507621617 shutdown_connections 2023-12-12T09:43:07.305 INFO:teuthology.misc.health.smithi073.stderr:2023-12-12T09:43:07.304+0000 7f7099790640 1 --2- 172.21.15.73:0/2507621617 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f70940c7cc0 0x7f7094154c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:07.305 INFO:teuthology.misc.health.smithi073.stderr:2023-12-12T09:43:07.304+0000 7f7099790640 1 --2- 172.21.15.73:0/2507621617 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f70940c4a10 0x7f7094151620 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:07.305 INFO:teuthology.misc.health.smithi073.stderr:2023-12-12T09:43:07.304+0000 7f7099790640 1 -- 172.21.15.73:0/2507621617 >> 172.21.15.73:0/2507621617 conn(0x7f7094071e10 msgr2=0x7f7094072220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:43:07.305 INFO:teuthology.misc.health.smithi073.stderr:2023-12-12T09:43:07.304+0000 7f7099790640 1 -- 172.21.15.73:0/2507621617 shutdown_connections 2023-12-12T09:43:07.306 INFO:teuthology.misc.health.smithi073.stderr:2023-12-12T09:43:07.304+0000 7f7099790640 1 -- 172.21.15.73:0/2507621617 wait complete. 2023-12-12T09:43:07.306 INFO:tasks.ceph.mgr.y.smithi073.stderr:2023-12-12T09:43:07.305+0000 7fc1a5452040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-12-12T09:43:07.306 INFO:teuthology.misc.health.smithi073.stderr:2023-12-12T09:43:07.305+0000 7f7099790640 1 Processor -- start 2023-12-12T09:43:07.306 INFO:teuthology.misc.health.smithi073.stderr:2023-12-12T09:43:07.305+0000 7f7099790640 1 -- start start 2023-12-12T09:43:07.308 INFO:teuthology.misc.health.smithi073.stderr:2023-12-12T09:43:07.306+0000 7f7099790640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f70940bd470 0x7f7094148670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:07.309 INFO:teuthology.misc.health.smithi073.stderr:2023-12-12T09:43:07.306+0000 7f7099790640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f70940c4a10 0x7f709414d790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:07.309 INFO:teuthology.misc.health.smithi073.stderr:2023-12-12T09:43:07.306+0000 7f7099790640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f70940c7cc0 0x7f70941ea1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:07.309 INFO:teuthology.misc.health.smithi073.stderr:2023-12-12T09:43:07.306+0000 7f7099790640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7094157650 con 0x7f70940c4a10 2023-12-12T09:43:07.309 INFO:teuthology.misc.health.smithi073.stderr:2023-12-12T09:43:07.306+0000 7f7099790640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70941e9cd0 con 0x7f70940bd470 2023-12-12T09:43:07.309 INFO:teuthology.misc.health.smithi073.stderr:2023-12-12T09:43:07.306+0000 7f7099790640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7094156180 con 0x7f70940c7cc0 2023-12-12T09:43:07.309 INFO:teuthology.misc.health.smithi073.stderr:2023-12-12T09:43:07.306+0000 7f70927fc640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f70940c4a10 0x7f709414d790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:07.309 INFO:teuthology.misc.health.smithi073.stderr:2023-12-12T09:43:07.307+0000 7f70927fc640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f70940c4a10 0x7f709414d790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:45304/0 (socket says 172.21.15.73:45304) 2023-12-12T09:43:07.309 INFO:teuthology.misc.health.smithi073.stderr:2023-12-12T09:43:07.307+0000 7f70927fc640 1 -- 172.21.15.73:0/2792720865 learned_addr learned my addr 172.21.15.73:0/2792720865 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:43:07.309 INFO:teuthology.misc.health.smithi073.stderr:2023-12-12T09:43:07.307+0000 7f7092ffd640 1 --2- 172.21.15.73:0/2792720865 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f70940bd470 0x7f7094148670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:07.309 INFO:teuthology.misc.health.smithi073.stderr:2023-12-12T09:43:07.307+0000 7f70937fe640 1 --2- 172.21.15.73:0/2792720865 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f70940c7cc0 0x7f70941ea1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:07.309 INFO:teuthology.misc.health.smithi073.stderr:2023-12-12T09:43:07.307+0000 7f70927fc640 1 -- 172.21.15.73:0/2792720865 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f70940c7cc0 msgr2=0x7f70941ea1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:07.309 INFO:teuthology.misc.health.smithi073.stderr:2023-12-12T09:43:07.307+0000 7f70927fc640 1 --2- 172.21.15.73:0/2792720865 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f70940c7cc0 0x7f70941ea1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:07.309 INFO:teuthology.misc.health.smithi073.stderr:2023-12-12T09:43:07.307+0000 7f70927fc640 1 -- 172.21.15.73:0/2792720865 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f70940bd470 msgr2=0x7f7094148670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:07.309 INFO:teuthology.misc.health.smithi073.stderr:2023-12-12T09:43:07.307+0000 7f70927fc640 1 --2- 172.21.15.73:0/2792720865 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f70940bd470 0x7f7094148670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:07.310 INFO:teuthology.misc.health.smithi073.stderr:2023-12-12T09:43:07.307+0000 7f70927fc640 1 -- 172.21.15.73:0/2792720865 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70840094d0 con 0x7f70940c4a10 2023-12-12T09:43:07.310 INFO:teuthology.misc.health.smithi073.stderr:2023-12-12T09:43:07.307+0000 7f7092ffd640 1 --2- 172.21.15.73:0/2792720865 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f70940bd470 0x7f7094148670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-12T09:43:07.310 INFO:teuthology.misc.health.smithi073.stderr:2023-12-12T09:43:07.307+0000 7f70927fc640 1 --2- 172.21.15.73:0/2792720865 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f70940c4a10 0x7f709414d790 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f708800c430 tx=0x7f708800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:43:07.310 INFO:teuthology.misc.health.smithi073.stderr:2023-12-12T09:43:07.307+0000 7f707b7fe640 1 -- 172.21.15.73:0/2792720865 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70880074e0 con 0x7f70940c4a10 2023-12-12T09:43:07.310 INFO:teuthology.misc.health.smithi073.stderr:2023-12-12T09:43:07.307+0000 7f707b7fe640 1 -- 172.21.15.73:0/2792720865 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7088007660 con 0x7f70940c4a10 2023-12-12T09:43:07.310 INFO:teuthology.misc.health.smithi073.stderr:2023-12-12T09:43:07.307+0000 7f707b7fe640 1 -- 172.21.15.73:0/2792720865 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7088004a20 con 0x7f70940c4a10 2023-12-12T09:43:07.310 INFO:teuthology.misc.health.smithi073.stderr:2023-12-12T09:43:07.307+0000 7f7099790640 1 -- 172.21.15.73:0/2792720865 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7094156460 con 0x7f70940c4a10 2023-12-12T09:43:07.310 INFO:teuthology.misc.health.smithi073.stderr:2023-12-12T09:43:07.308+0000 7f7099790640 1 -- 172.21.15.73:0/2792720865 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7094156740 con 0x7f70940c4a10 2023-12-12T09:43:07.310 INFO:teuthology.misc.health.smithi073.stderr:2023-12-12T09:43:07.308+0000 7f707b7fe640 1 -- 172.21.15.73:0/2792720865 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f70880133c0 con 0x7f70940c4a10 2023-12-12T09:43:07.310 INFO:teuthology.misc.health.smithi073.stderr:2023-12-12T09:43:07.308+0000 7f707b7fe640 1 -- 172.21.15.73:0/2792720865 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7f7088013da0 con 0x7f70940c4a10 2023-12-12T09:43:07.311 INFO:teuthology.misc.health.smithi073.stderr:2023-12-12T09:43:07.309+0000 7f7099790640 1 -- 172.21.15.73:0/2792720865 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f70941e9e90 con 0x7f70940c4a10 2023-12-12T09:43:07.314 INFO:teuthology.misc.health.smithi073.stderr:2023-12-12T09:43:07.313+0000 7f707b7fe640 1 -- 172.21.15.73:0/2792720865 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7f7088013780 con 0x7f70940c4a10 2023-12-12T09:43:07.320 INFO:tasks.ceph.mgr.x.smithi142.stderr:2023-12-12T09:43:07.320+0000 7f2df1446040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-12-12T09:43:07.381 INFO:teuthology.misc.health.smithi073.stderr:2023-12-12T09:43:07.380+0000 7f7099790640 1 -- 172.21.15.73:0/2792720865 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f70940c8150 con 0x7f70940c4a10 2023-12-12T09:43:07.381 INFO:teuthology.misc.health.smithi073.stderr:2023-12-12T09:43:07.381+0000 7f707b7fe640 1 -- 172.21.15.73:0/2792720865 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7f7088013920 con 0x7f70940c4a10 2023-12-12T09:43:07.382 INFO:teuthology.misc.health.smithi073.stdout: 2023-12-12T09:43:07.382 INFO:teuthology.misc.health.smithi073.stdout:{"epoch":10,"fsid":"ba240992-02b8-4c7e-92f2-27eb29ac433b","created":"2023-12-12T09:43:02.454719+0000","modified":"2023-12-12T09:43:05.925348+0000","last_up_change":"0.000000","last_in_change":"2023-12-12T09:43:05.925348+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"dd9074be-dbe2-4c34-9896-a4223d8d3940","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"c4a05052-96d4-4758-a4e1-1a37f1e07fed","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"512bc8ac-72c2-40d4-b3d2-d867a92c5213","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"3d1a91e0-42bf-437a-8eae-8d357c8f63a1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"4b302fff-834c-4069-ac19-00e46f6c87b0","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"d7cdace2-67d0-45cc-95f2-515cf6ef1b82","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"649ce78a-5626-445c-aedc-a651ed05a6f6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"af15ae3b-c1d0-4acf-92db-8a1805494d13","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-12T09:43:07.383 INFO:teuthology.misc.health.smithi073.stderr:2023-12-12T09:43:07.382+0000 7f7099790640 1 -- 172.21.15.73:0/2792720865 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f70940c4a10 msgr2=0x7f709414d790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:07.383 INFO:teuthology.misc.health.smithi073.stderr:2023-12-12T09:43:07.382+0000 7f7099790640 1 --2- 172.21.15.73:0/2792720865 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f70940c4a10 0x7f709414d790 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f708800c430 tx=0x7f708800c8f0 comp rx=0 tx=0).stop 2023-12-12T09:43:07.383 INFO:teuthology.misc.health.smithi073.stderr:2023-12-12T09:43:07.382+0000 7f7099790640 1 -- 172.21.15.73:0/2792720865 shutdown_connections 2023-12-12T09:43:07.383 INFO:teuthology.misc.health.smithi073.stderr:2023-12-12T09:43:07.382+0000 7f7099790640 1 --2- 172.21.15.73:0/2792720865 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f70940c7cc0 0x7f70941ea1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:07.383 INFO:teuthology.misc.health.smithi073.stderr:2023-12-12T09:43:07.382+0000 7f7099790640 1 --2- 172.21.15.73:0/2792720865 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f70940c4a10 0x7f709414d790 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:07.383 INFO:teuthology.misc.health.smithi073.stderr:2023-12-12T09:43:07.382+0000 7f7099790640 1 --2- 172.21.15.73:0/2792720865 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f70940bd470 0x7f7094148670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:07.383 INFO:teuthology.misc.health.smithi073.stderr:2023-12-12T09:43:07.382+0000 7f7099790640 1 -- 172.21.15.73:0/2792720865 >> 172.21.15.73:0/2792720865 conn(0x7f7094071e10 msgr2=0x7f70940c6df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:43:07.384 INFO:teuthology.misc.health.smithi073.stderr:2023-12-12T09:43:07.382+0000 7f7099790640 1 -- 172.21.15.73:0/2792720865 shutdown_connections 2023-12-12T09:43:07.384 INFO:teuthology.misc.health.smithi073.stderr:2023-12-12T09:43:07.382+0000 7f7099790640 1 -- 172.21.15.73:0/2792720865 wait complete. 2023-12-12T09:43:07.384 INFO:tasks.ceph.mgr.x.smithi142.stderr:2023-12-12T09:43:07.384+0000 7f2df1446040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-12-12T09:43:07.395 DEBUG:teuthology.misc:0 of 8 OSDs are up 2023-12-12T09:43:07.426 INFO:tasks.ceph.mgr.y.smithi073.stderr:2023-12-12T09:43:07.425+0000 7fc1a5452040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-12-12T09:43:07.509 INFO:tasks.ceph.mgr.x.smithi142.stderr:2023-12-12T09:43:07.509+0000 7f2df1446040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-12-12T09:43:08.462 INFO:tasks.ceph.mgr.y.smithi073.stderr:2023-12-12T09:43:08.461+0000 7fc146842640 -1 mgr.server handle_report got status from non-daemon mon.b 2023-12-12T09:43:08.462 INFO:tasks.ceph.mgr.y.smithi073.stderr:2023-12-12T09:43:08.462+0000 7fc146842640 -1 mgr.server handle_report got status from non-daemon mon.c 2023-12-12T09:43:09.516 INFO:tasks.ceph.osd.3.smithi073.stderr:2023-12-12T09:43:09.515+0000 7f2d1d017500 -1 osd.3 0 log_to_monitors true 2023-12-12T09:43:09.723 INFO:tasks.ceph.osd.4.smithi142.stderr:2023-12-12T09:43:09.723+0000 7f5ddd69c500 -1 osd.4 0 log_to_monitors true 2023-12-12T09:43:10.080 INFO:tasks.ceph.osd.7.smithi142.stderr:2023-12-12T09:43:10.080+0000 7f714ba0d500 -1 osd.7 0 log_to_monitors true 2023-12-12T09:43:10.201 INFO:tasks.ceph.osd.0.smithi073.stderr:2023-12-12T09:43:10.200+0000 7f51fe610500 -1 osd.0 0 log_to_monitors true 2023-12-12T09:43:10.256 INFO:tasks.ceph.osd.6.smithi142.stderr:2023-12-12T09:43:10.256+0000 7fe583825500 -1 osd.6 0 log_to_monitors true 2023-12-12T09:43:10.261 INFO:tasks.ceph.osd.2.smithi073.stderr:2023-12-12T09:43:10.261+0000 7f3cb3174500 -1 osd.2 0 log_to_monitors true 2023-12-12T09:43:10.287 INFO:tasks.ceph.osd.5.smithi142.stderr:2023-12-12T09:43:10.287+0000 7fe65120c500 -1 osd.5 0 log_to_monitors true 2023-12-12T09:43:10.297 INFO:tasks.ceph.osd.1.smithi073.stderr:2023-12-12T09:43:10.296+0000 7f0d872c2500 -1 osd.1 0 log_to_monitors true 2023-12-12T09:43:12.898 INFO:tasks.ceph.osd.2.smithi073.stderr:2023-12-12T09:43:12.897+0000 7f3caf102640 -1 osd.2 0 waiting for initial osdmap 2023-12-12T09:43:12.909 INFO:tasks.ceph.osd.2.smithi073.stderr:2023-12-12T09:43:12.908+0000 7f3ca6f29640 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-12T09:43:12.917 INFO:tasks.ceph.osd.1.smithi073.stderr:2023-12-12T09:43:12.917+0000 7f0d83250640 -1 osd.1 0 waiting for initial osdmap 2023-12-12T09:43:12.919 INFO:tasks.ceph.osd.0.smithi073.stderr:2023-12-12T09:43:12.919+0000 7f51fa8a3640 -1 osd.0 0 waiting for initial osdmap 2023-12-12T09:43:12.924 INFO:tasks.ceph.osd.1.smithi073.stderr:2023-12-12T09:43:12.923+0000 7f0d7b077640 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-12T09:43:12.931 INFO:tasks.ceph.osd.7.smithi142.stderr:2023-12-12T09:43:12.929+0000 7f714746d640 -1 osd.7 0 waiting for initial osdmap 2023-12-12T09:43:12.938 INFO:tasks.ceph.osd.0.smithi073.stderr:2023-12-12T09:43:12.938+0000 7f51f1eb6640 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-12T09:43:12.942 INFO:tasks.ceph.osd.7.smithi142.stderr:2023-12-12T09:43:12.940+0000 7f713f294640 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-12T09:43:12.966 INFO:tasks.ceph.osd.5.smithi142.stderr:2023-12-12T09:43:12.965+0000 7fe64d19a640 -1 osd.5 0 waiting for initial osdmap 2023-12-12T09:43:12.976 INFO:tasks.ceph.osd.5.smithi142.stderr:2023-12-12T09:43:12.974+0000 7fe644fc1640 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-12T09:43:12.988 INFO:tasks.ceph.osd.3.smithi073.stderr:2023-12-12T09:43:12.988+0000 7f2d191f9640 -1 osd.3 0 waiting for initial osdmap 2023-12-12T09:43:12.995 INFO:tasks.ceph.osd.3.smithi073.stderr:2023-12-12T09:43:12.994+0000 7f2d1080c640 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-12T09:43:13.030 INFO:tasks.ceph.osd.6.smithi142.stderr:2023-12-12T09:43:13.028+0000 7fe57f213640 -1 osd.6 0 waiting for initial osdmap 2023-12-12T09:43:13.030 INFO:tasks.ceph.osd.4.smithi142.stderr:2023-12-12T09:43:13.029+0000 7f5dd9e3e640 -1 osd.4 0 waiting for initial osdmap 2023-12-12T09:43:13.034 INFO:tasks.ceph.osd.4.smithi142.stderr:2023-12-12T09:43:13.033+0000 7f5dd1451640 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-12T09:43:13.046 INFO:tasks.ceph.osd.6.smithi142.stderr:2023-12-12T09:43:13.045+0000 7fe57703a640 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-12T09:43:14.200 DEBUG:teuthology.orchestra.run.smithi073:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-12-12T09:43:14.376 INFO:teuthology.misc.health.smithi073.stderr:2023-12-12T09:43:14.375+0000 7fcb9bb53640 1 Processor -- start 2023-12-12T09:43:14.376 INFO:teuthology.misc.health.smithi073.stderr:2023-12-12T09:43:14.375+0000 7fcb9bb53640 1 -- start start 2023-12-12T09:43:14.377 INFO:teuthology.misc.health.smithi073.stderr:2023-12-12T09:43:14.376+0000 7fcb9bb53640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcb940c1f30 0x7fcb94156000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:14.377 INFO:teuthology.misc.health.smithi073.stderr:2023-12-12T09:43:14.376+0000 7fcb9bb53640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb940c13c0 con 0x7fcb940c1850 2023-12-12T09:43:14.377 INFO:teuthology.misc.health.smithi073.stderr:2023-12-12T09:43:14.376+0000 7fcb9bb53640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb9406c680 con 0x7fcb9414fbd0 2023-12-12T09:43:14.377 INFO:teuthology.misc.health.smithi073.stderr:2023-12-12T09:43:14.376+0000 7fcb9bb53640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb940c1120 con 0x7fcb940c1f30 2023-12-12T09:43:14.380 INFO:teuthology.misc.health.smithi073.stderr:2023-12-12T09:43:14.377+0000 7fcb990ee640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7fcb940c1850 0x7fcb941558f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:33360/0 (socket says 172.21.15.73:33360) 2023-12-12T09:43:14.380 INFO:teuthology.misc.health.smithi073.stderr:2023-12-12T09:43:14.377+0000 7fcb990ee640 1 -- 172.21.15.73:0/2096006233 learned_addr learned my addr 172.21.15.73:0/2096006233 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-12T09:43:14.380 INFO:teuthology.misc.health.smithi073.stderr:2023-12-12T09:43:14.377+0000 7fcb9a0f0640 1 --2- 172.21.15.73:0/2096006233 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcb940c1f30 0x7fcb94156000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:14.380 INFO:teuthology.misc.health.smithi073.stderr:2023-12-12T09:43:14.377+0000 7fcb988ed640 1 -- 172.21.15.73:0/2096006233 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3807563893 0 0) 0x7fcb940c13c0 con 0x7fcb940c1850 2023-12-12T09:43:14.380 INFO:teuthology.misc.health.smithi073.stderr:2023-12-12T09:43:14.377+0000 7fcb988ed640 1 -- 172.21.15.73:0/2096006233 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcb80003520 con 0x7fcb940c1850 2023-12-12T09:43:14.380 INFO:teuthology.misc.health.smithi073.stderr:2023-12-12T09:43:14.378+0000 7fcb988ed640 1 -- 172.21.15.73:0/2096006233 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2753226918 0 0) 0x7fcb9406c680 con 0x7fcb9414fbd0 2023-12-12T09:43:14.380 INFO:teuthology.misc.health.smithi073.stderr:2023-12-12T09:43:14.378+0000 7fcb988ed640 1 -- 172.21.15.73:0/2096006233 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcb940c13c0 con 0x7fcb9414fbd0 2023-12-12T09:43:14.380 INFO:teuthology.misc.health.smithi073.stderr:2023-12-12T09:43:14.378+0000 7fcb988ed640 1 -- 172.21.15.73:0/2096006233 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3523406916 0 0) 0x7fcb80003520 con 0x7fcb940c1850 2023-12-12T09:43:14.380 INFO:teuthology.misc.health.smithi073.stderr:2023-12-12T09:43:14.378+0000 7fcb988ed640 1 -- 172.21.15.73:0/2096006233 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcb940c1f30 msgr2=0x7fcb94156000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:43:14.380 INFO:teuthology.misc.health.smithi073.stderr:2023-12-12T09:43:14.378+0000 7fcb988ed640 1 --2- 172.21.15.73:0/2096006233 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcb940c1f30 0x7fcb94156000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:14.380 INFO:teuthology.misc.health.smithi073.stderr:2023-12-12T09:43:14.378+0000 7fcb988ed640 1 -- 172.21.15.73:0/2096006233 >> v1:172.21.15.142:6789/0 conn(0x7fcb9414fbd0 legacy=0x7fcb940c39c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:14.380 INFO:teuthology.misc.health.smithi073.stderr:2023-12-12T09:43:14.378+0000 7fcb988ed640 1 -- 172.21.15.73:0/2096006233 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb9406ceb0 con 0x7fcb940c1850 2023-12-12T09:43:14.381 INFO:teuthology.misc.health.smithi073.stderr:2023-12-12T09:43:14.378+0000 7fcb988ed640 1 -- 172.21.15.73:0/2096006233 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3186547832 0 0) 0x7fcb84001670 con 0x7fcb940c1850 2023-12-12T09:43:14.381 INFO:teuthology.misc.health.smithi073.stderr:2023-12-12T09:43:14.378+0000 7fcb988ed640 1 -- 172.21.15.73:0/2096006233 >> v1:172.21.15.73:6789/0 conn(0x7fcb940c1850 legacy=0x7fcb941558f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:14.381 INFO:teuthology.misc.health.smithi073.stderr:2023-12-12T09:43:14.378+0000 7fcb988ed640 1 --2- 172.21.15.73:0/2096006233 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcb80003b30 0x7fcb80003f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:14.381 INFO:teuthology.misc.health.smithi073.stderr:2023-12-12T09:43:14.378+0000 7fcb988ed640 1 --2- 172.21.15.73:0/2096006233 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcb940c1f30 0x7fcb800047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:14.381 INFO:teuthology.misc.health.smithi073.stderr:2023-12-12T09:43:14.378+0000 7fcb988ed640 1 --2- 172.21.15.73:0/2096006233 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcb80004d00 0x7fcb80005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:14.381 INFO:teuthology.misc.health.smithi073.stderr:2023-12-12T09:43:14.378+0000 7fcb988ed640 1 -- 172.21.15.73:0/2096006233 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb940c1120 con 0x7fcb80004d00 2023-12-12T09:43:14.381 INFO:teuthology.misc.health.smithi073.stderr:2023-12-12T09:43:14.378+0000 7fcb988ed640 1 -- 172.21.15.73:0/2096006233 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb8000ba60 con 0x7fcb80003b30 2023-12-12T09:43:14.381 INFO:teuthology.misc.health.smithi073.stderr:2023-12-12T09:43:14.378+0000 7fcb988ed640 1 -- 172.21.15.73:0/2096006233 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb8000bc20 con 0x7fcb940c1f30 2023-12-12T09:43:14.381 INFO:teuthology.misc.health.smithi073.stderr:2023-12-12T09:43:14.378+0000 7fcb9a0f0640 1 --2- 172.21.15.73:0/2096006233 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcb80004d00 0x7fcb80005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:14.381 INFO:teuthology.misc.health.smithi073.stderr:2023-12-12T09:43:14.378+0000 7fcb990ee640 1 --2- 172.21.15.73:0/2096006233 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcb940c1f30 0x7fcb800047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:14.381 INFO:teuthology.misc.health.smithi073.stderr:2023-12-12T09:43:14.378+0000 7fcb998ef640 1 --2- 172.21.15.73:0/2096006233 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcb80003b30 0x7fcb80003f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:14.381 INFO:teuthology.misc.health.smithi073.stderr:2023-12-12T09:43:14.379+0000 7fcb9a0f0640 1 -- 172.21.15.73:0/2096006233 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcb940c1f30 msgr2=0x7fcb800047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:43:14.381 INFO:teuthology.misc.health.smithi073.stderr:2023-12-12T09:43:14.379+0000 7fcb9a0f0640 1 --2- 172.21.15.73:0/2096006233 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcb940c1f30 0x7fcb800047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:14.381 INFO:teuthology.misc.health.smithi073.stderr:2023-12-12T09:43:14.379+0000 7fcb9a0f0640 1 -- 172.21.15.73:0/2096006233 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcb80003b30 msgr2=0x7fcb80003f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:43:14.381 INFO:teuthology.misc.health.smithi073.stderr:2023-12-12T09:43:14.379+0000 7fcb9a0f0640 1 --2- 172.21.15.73:0/2096006233 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcb80003b30 0x7fcb80003f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:14.382 INFO:teuthology.misc.health.smithi073.stderr:2023-12-12T09:43:14.379+0000 7fcb9a0f0640 1 -- 172.21.15.73:0/2096006233 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb80003520 con 0x7fcb80004d00 2023-12-12T09:43:14.383 INFO:teuthology.misc.health.smithi073.stderr:2023-12-12T09:43:14.380+0000 7fcb9a0f0640 1 --2- 172.21.15.73:0/2096006233 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcb80004d00 0x7fcb80005180 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fcb8c009fc0 tx=0x7fcb800057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58b21fd849ca5fa9 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:43:14.383 INFO:teuthology.misc.health.smithi073.stderr:2023-12-12T09:43:14.380+0000 7fcb988ed640 1 -- 172.21.15.73:0/2096006233 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb8c02cc20 con 0x7fcb80004d00 2023-12-12T09:43:14.383 INFO:teuthology.misc.health.smithi073.stderr:2023-12-12T09:43:14.380+0000 7fcb988ed640 1 -- 172.21.15.73:0/2096006233 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb8c00f040 con 0x7fcb80004d00 2023-12-12T09:43:14.383 INFO:teuthology.misc.health.smithi073.stderr:2023-12-12T09:43:14.380+0000 7fcb988ed640 1 -- 172.21.15.73:0/2096006233 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb8c034440 con 0x7fcb80004d00 2023-12-12T09:43:14.383 INFO:teuthology.misc.health.smithi073.stderr:2023-12-12T09:43:14.381+0000 7fcb9bb53640 1 -- 172.21.15.73:0/2096006233 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcb80004d00 msgr2=0x7fcb80005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:14.384 INFO:teuthology.misc.health.smithi073.stderr:2023-12-12T09:43:14.381+0000 7fcb9bb53640 1 --2- 172.21.15.73:0/2096006233 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcb80004d00 0x7fcb80005180 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fcb8c009fc0 tx=0x7fcb800057f0 comp rx=0 tx=0).stop 2023-12-12T09:43:14.384 INFO:teuthology.misc.health.smithi073.stderr:2023-12-12T09:43:14.381+0000 7fcb9a0f0640 1 -- 172.21.15.73:0/2096006233 reap_dead start 2023-12-12T09:43:14.384 INFO:teuthology.misc.health.smithi073.stderr:2023-12-12T09:43:14.381+0000 7fcb9bb53640 1 -- 172.21.15.73:0/2096006233 shutdown_connections 2023-12-12T09:43:14.384 INFO:teuthology.misc.health.smithi073.stderr:2023-12-12T09:43:14.381+0000 7fcb9bb53640 1 -- 172.21.15.73:0/2096006233 >> 172.21.15.73:0/2096006233 conn(0x7fcb940a7ea0 msgr2=0x7fcb940c25c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:43:14.384 INFO:teuthology.misc.health.smithi073.stderr:2023-12-12T09:43:14.381+0000 7fcb9bb53640 1 -- 172.21.15.73:0/2096006233 shutdown_connections 2023-12-12T09:43:14.384 INFO:teuthology.misc.health.smithi073.stderr:2023-12-12T09:43:14.381+0000 7fcb9bb53640 1 -- 172.21.15.73:0/2096006233 wait complete. 2023-12-12T09:43:14.387 INFO:teuthology.misc.health.smithi073.stderr:2023-12-12T09:43:14.383+0000 7fcb9bb53640 1 Processor -- start 2023-12-12T09:43:14.387 INFO:teuthology.misc.health.smithi073.stderr:2023-12-12T09:43:14.383+0000 7fcb9bb53640 1 -- start start 2023-12-12T09:43:14.387 INFO:teuthology.misc.health.smithi073.stderr:2023-12-12T09:43:14.384+0000 7fcb9bb53640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcb80004d00 0x7fcb940bc450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:14.387 INFO:teuthology.misc.health.smithi073.stderr:2023-12-12T09:43:14.384+0000 7fcb9bb53640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcb94147370 0x7fcb941451b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:14.387 INFO:teuthology.misc.health.smithi073.stderr:2023-12-12T09:43:14.384+0000 7fcb9bb53640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcb941e94b0 0x7fcb940717b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:14.387 INFO:teuthology.misc.health.smithi073.stderr:2023-12-12T09:43:14.384+0000 7fcb9bb53640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb94070650 con 0x7fcb94147370 2023-12-12T09:43:14.387 INFO:teuthology.misc.health.smithi073.stderr:2023-12-12T09:43:14.384+0000 7fcb9bb53640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb941e9020 con 0x7fcb941e94b0 2023-12-12T09:43:14.387 INFO:teuthology.misc.health.smithi073.stderr:2023-12-12T09:43:14.384+0000 7fcb9bb53640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb94070240 con 0x7fcb80004d00 2023-12-12T09:43:14.387 INFO:teuthology.misc.health.smithi073.stderr:2023-12-12T09:43:14.384+0000 7fcb990ee640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcb94147370 0x7fcb941451b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:14.387 INFO:teuthology.misc.health.smithi073.stderr:2023-12-12T09:43:14.384+0000 7fcb990ee640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcb94147370 0x7fcb941451b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:39900/0 (socket says 172.21.15.73:39900) 2023-12-12T09:43:14.388 INFO:teuthology.misc.health.smithi073.stderr:2023-12-12T09:43:14.384+0000 7fcb990ee640 1 -- 172.21.15.73:0/1497020179 learned_addr learned my addr 172.21.15.73:0/1497020179 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:43:14.388 INFO:teuthology.misc.health.smithi073.stderr:2023-12-12T09:43:14.384+0000 7fcb990ee640 1 -- 172.21.15.73:0/1497020179 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcb80004d00 msgr2=0x7fcb940bc450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:14.388 INFO:teuthology.misc.health.smithi073.stderr:2023-12-12T09:43:14.384+0000 7fcb998ef640 1 --2- 172.21.15.73:0/1497020179 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcb80004d00 0x7fcb940bc450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:14.388 INFO:teuthology.misc.health.smithi073.stderr:2023-12-12T09:43:14.384+0000 7fcb990ee640 1 --2- 172.21.15.73:0/1497020179 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcb80004d00 0x7fcb940bc450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:14.388 INFO:teuthology.misc.health.smithi073.stderr:2023-12-12T09:43:14.384+0000 7fcb990ee640 1 -- 172.21.15.73:0/1497020179 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcb941e94b0 msgr2=0x7fcb940717b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:14.388 INFO:teuthology.misc.health.smithi073.stderr:2023-12-12T09:43:14.384+0000 7fcb990ee640 1 --2- 172.21.15.73:0/1497020179 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcb941e94b0 0x7fcb940717b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:14.388 INFO:teuthology.misc.health.smithi073.stderr:2023-12-12T09:43:14.384+0000 7fcb990ee640 1 -- 172.21.15.73:0/1497020179 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb9406fc80 con 0x7fcb94147370 2023-12-12T09:43:14.388 INFO:teuthology.misc.health.smithi073.stderr:2023-12-12T09:43:14.385+0000 7fcb990ee640 1 --2- 172.21.15.73:0/1497020179 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcb94147370 0x7fcb941451b0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fcb84001050 tx=0x7fcb8400ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:43:14.388 INFO:teuthology.misc.health.smithi073.stderr:2023-12-12T09:43:14.385+0000 7fcb8a7fc640 1 -- 172.21.15.73:0/1497020179 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb8400eed0 con 0x7fcb94147370 2023-12-12T09:43:14.388 INFO:teuthology.misc.health.smithi073.stderr:2023-12-12T09:43:14.385+0000 7fcb8a7fc640 1 -- 172.21.15.73:0/1497020179 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb8400c7f0 con 0x7fcb94147370 2023-12-12T09:43:14.388 INFO:teuthology.misc.health.smithi073.stderr:2023-12-12T09:43:14.385+0000 7fcb9bb53640 1 -- 172.21.15.73:0/1497020179 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb9406ff60 con 0x7fcb94147370 2023-12-12T09:43:14.388 INFO:teuthology.misc.health.smithi073.stderr:2023-12-12T09:43:14.385+0000 7fcb8a7fc640 1 -- 172.21.15.73:0/1497020179 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb8400cba0 con 0x7fcb94147370 2023-12-12T09:43:14.388 INFO:teuthology.misc.health.smithi073.stderr:2023-12-12T09:43:14.385+0000 7fcb9bb53640 1 -- 172.21.15.73:0/1497020179 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb941456f0 con 0x7fcb94147370 2023-12-12T09:43:14.388 INFO:teuthology.misc.health.smithi073.stderr:2023-12-12T09:43:14.386+0000 7fcb9bb53640 1 -- 172.21.15.73:0/1497020179 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb941e8b10 con 0x7fcb94147370 2023-12-12T09:43:14.389 INFO:teuthology.misc.health.smithi073.stderr:2023-12-12T09:43:14.387+0000 7fcb8a7fc640 1 -- 172.21.15.73:0/1497020179 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 4) v1 ==== 89175+0+0 (secure 0 0 0) 0x7fcb8400cd00 con 0x7fcb94147370 2023-12-12T09:43:14.389 INFO:teuthology.misc.health.smithi073.stderr:2023-12-12T09:43:14.388+0000 7fcb8a7fc640 1 --2- 172.21.15.73:0/1497020179 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fcb7806ade0 0x7fcb7806d2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:14.389 INFO:teuthology.misc.health.smithi073.stderr:2023-12-12T09:43:14.388+0000 7fcb8a7fc640 1 -- 172.21.15.73:0/1497020179 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(13..13 src has 1..13) v4 ==== 4471+0+0 (secure 0 0 0) 0x7fcb84088cd0 con 0x7fcb94147370 2023-12-12T09:43:14.389 INFO:teuthology.misc.health.smithi073.stderr:2023-12-12T09:43:14.388+0000 7fcb998ef640 1 --2- 172.21.15.73:0/1497020179 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fcb7806ade0 0x7fcb7806d2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:14.390 INFO:teuthology.misc.health.smithi073.stderr:2023-12-12T09:43:14.389+0000 7fcb998ef640 1 --2- 172.21.15.73:0/1497020179 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fcb7806ade0 0x7fcb7806d2a0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fcb90007fd0 tx=0x7fcb90009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:43:14.394 INFO:teuthology.misc.health.smithi073.stderr:2023-12-12T09:43:14.393+0000 7fcb8a7fc640 1 -- 172.21.15.73:0/1497020179 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fcb941e8b10 con 0x7fcb94147370 2023-12-12T09:43:14.582 INFO:teuthology.misc.health.smithi073.stderr:2023-12-12T09:43:14.581+0000 7fcb9bb53640 1 -- 172.21.15.73:0/1497020179 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcb941e8b10 con 0x7fcb94147370 2023-12-12T09:43:14.584 INFO:teuthology.misc.health.smithi073.stderr:2023-12-12T09:43:14.583+0000 7fcb8a7fc640 1 -- 172.21.15.73:0/1497020179 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v13) v1 ==== 74+0+10920 (secure 0 0 0) 0x7fcb941e8b10 con 0x7fcb94147370 2023-12-12T09:43:14.584 INFO:teuthology.misc.health.smithi073.stdout: 2023-12-12T09:43:14.584 INFO:teuthology.misc.health.smithi073.stdout:{"epoch":13,"fsid":"ba240992-02b8-4c7e-92f2-27eb29ac433b","created":"2023-12-12T09:43:02.454719+0000","modified":"2023-12-12T09:43:13.913440+0000","last_up_change":"2023-12-12T09:43:13.913440+0000","last_in_change":"2023-12-12T09:43:05.925348+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"dd9074be-dbe2-4c34-9896-a4223d8d3940","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":4047810203},{"type":"v1","addr":"172.21.15.73:6801","nonce":4047810203}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":4047810203},{"type":"v1","addr":"172.21.15.73:6803","nonce":4047810203}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":4047810203},{"type":"v1","addr":"172.21.15.73:6807","nonce":4047810203}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":4047810203},{"type":"v1","addr":"172.21.15.73:6805","nonce":4047810203}]},"public_addr":"172.21.15.73:6801/4047810203","cluster_addr":"172.21.15.73:6803/4047810203","heartbeat_back_addr":"172.21.15.73:6807/4047810203","heartbeat_front_addr":"172.21.15.73:6805/4047810203","state":["exists","up"]},{"osd":1,"uuid":"c4a05052-96d4-4758-a4e1-1a37f1e07fed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":1356058331},{"type":"v1","addr":"172.21.15.73:6824","nonce":1356058331}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":1356058331},{"type":"v1","addr":"172.21.15.73:6827","nonce":1356058331}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":1356058331},{"type":"v1","addr":"172.21.15.73:6831","nonce":1356058331}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":1356058331},{"type":"v1","addr":"172.21.15.73:6829","nonce":1356058331}]},"public_addr":"172.21.15.73:6824/1356058331","cluster_addr":"172.21.15.73:6827/1356058331","heartbeat_back_addr":"172.21.15.73:6831/1356058331","heartbeat_front_addr":"172.21.15.73:6829/1356058331","state":["exists","up"]},{"osd":2,"uuid":"512bc8ac-72c2-40d4-b3d2-d867a92c5213","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":1228903316},{"type":"v1","addr":"172.21.15.73:6817","nonce":1228903316}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":1228903316},{"type":"v1","addr":"172.21.15.73:6819","nonce":1228903316}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6823","nonce":1228903316},{"type":"v1","addr":"172.21.15.73:6825","nonce":1228903316}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":1228903316},{"type":"v1","addr":"172.21.15.73:6821","nonce":1228903316}]},"public_addr":"172.21.15.73:6817/1228903316","cluster_addr":"172.21.15.73:6819/1228903316","heartbeat_back_addr":"172.21.15.73:6825/1228903316","heartbeat_front_addr":"172.21.15.73:6821/1228903316","state":["exists","up"]},{"osd":3,"uuid":"3d1a91e0-42bf-437a-8eae-8d357c8f63a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":1293329670},{"type":"v1","addr":"172.21.15.73:6809","nonce":1293329670}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6810","nonce":1293329670},{"type":"v1","addr":"172.21.15.73:6811","nonce":1293329670}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":1293329670},{"type":"v1","addr":"172.21.15.73:6815","nonce":1293329670}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":1293329670},{"type":"v1","addr":"172.21.15.73:6813","nonce":1293329670}]},"public_addr":"172.21.15.73:6809/1293329670","cluster_addr":"172.21.15.73:6811/1293329670","heartbeat_back_addr":"172.21.15.73:6815/1293329670","heartbeat_front_addr":"172.21.15.73:6813/1293329670","state":["exists","up"]},{"osd":4,"uuid":"4b302fff-834c-4069-ac19-00e46f6c87b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":3727975702},{"type":"v1","addr":"172.21.15.142:6801","nonce":3727975702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":3727975702},{"type":"v1","addr":"172.21.15.142:6803","nonce":3727975702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6809","nonce":3727975702},{"type":"v1","addr":"172.21.15.142:6811","nonce":3727975702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6805","nonce":3727975702},{"type":"v1","addr":"172.21.15.142:6807","nonce":3727975702}]},"public_addr":"172.21.15.142:6801/3727975702","cluster_addr":"172.21.15.142:6803/3727975702","heartbeat_back_addr":"172.21.15.142:6811/3727975702","heartbeat_front_addr":"172.21.15.142:6807/3727975702","state":["exists","up"]},{"osd":5,"uuid":"d7cdace2-67d0-45cc-95f2-515cf6ef1b82","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6817","nonce":2353193632},{"type":"v1","addr":"172.21.15.142:6819","nonce":2353193632}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6821","nonce":2353193632},{"type":"v1","addr":"172.21.15.142:6823","nonce":2353193632}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6829","nonce":2353193632},{"type":"v1","addr":"172.21.15.142:6831","nonce":2353193632}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6825","nonce":2353193632},{"type":"v1","addr":"172.21.15.142:6827","nonce":2353193632}]},"public_addr":"172.21.15.142:6819/2353193632","cluster_addr":"172.21.15.142:6823/2353193632","heartbeat_back_addr":"172.21.15.142:6831/2353193632","heartbeat_front_addr":"172.21.15.142:6827/2353193632","state":["exists","up"]},{"osd":6,"uuid":"649ce78a-5626-445c-aedc-a651ed05a6f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":2006111986},{"type":"v1","addr":"172.21.15.142:6806","nonce":2006111986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":2006111986},{"type":"v1","addr":"172.21.15.142:6810","nonce":2006111986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":2006111986},{"type":"v1","addr":"172.21.15.142:6815","nonce":2006111986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":2006111986},{"type":"v1","addr":"172.21.15.142:6813","nonce":2006111986}]},"public_addr":"172.21.15.142:6806/2006111986","cluster_addr":"172.21.15.142:6810/2006111986","heartbeat_back_addr":"172.21.15.142:6815/2006111986","heartbeat_front_addr":"172.21.15.142:6813/2006111986","state":["exists","up"]},{"osd":7,"uuid":"af15ae3b-c1d0-4acf-92db-8a1805494d13","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":2573794341},{"type":"v1","addr":"172.21.15.142:6818","nonce":2573794341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":2573794341},{"type":"v1","addr":"172.21.15.142:6822","nonce":2573794341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":2573794341},{"type":"v1","addr":"172.21.15.142:6830","nonce":2573794341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":2573794341},{"type":"v1","addr":"172.21.15.142:6826","nonce":2573794341}]},"public_addr":"172.21.15.142:6818/2573794341","cluster_addr":"172.21.15.142:6822/2573794341","heartbeat_back_addr":"172.21.15.142:6830/2573794341","heartbeat_front_addr":"172.21.15.142:6826/2573794341","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-12T09:43:14.586 INFO:teuthology.misc.health.smithi073.stderr:2023-12-12T09:43:14.585+0000 7fcb9bb53640 1 -- 172.21.15.73:0/1497020179 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fcb7806ade0 msgr2=0x7fcb7806d2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:14.586 INFO:teuthology.misc.health.smithi073.stderr:2023-12-12T09:43:14.585+0000 7fcb9bb53640 1 --2- 172.21.15.73:0/1497020179 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fcb7806ade0 0x7fcb7806d2a0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fcb90007fd0 tx=0x7fcb90009040 comp rx=0 tx=0).stop 2023-12-12T09:43:14.586 INFO:teuthology.misc.health.smithi073.stderr:2023-12-12T09:43:14.585+0000 7fcb9bb53640 1 -- 172.21.15.73:0/1497020179 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcb94147370 msgr2=0x7fcb941451b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:14.586 INFO:teuthology.misc.health.smithi073.stderr:2023-12-12T09:43:14.585+0000 7fcb9bb53640 1 --2- 172.21.15.73:0/1497020179 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcb94147370 0x7fcb941451b0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fcb84001050 tx=0x7fcb8400ec80 comp rx=0 tx=0).stop 2023-12-12T09:43:14.587 INFO:teuthology.misc.health.smithi073.stderr:2023-12-12T09:43:14.585+0000 7fcb9bb53640 1 -- 172.21.15.73:0/1497020179 shutdown_connections 2023-12-12T09:43:14.587 INFO:teuthology.misc.health.smithi073.stderr:2023-12-12T09:43:14.585+0000 7fcb9bb53640 1 --2- 172.21.15.73:0/1497020179 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fcb7806ade0 0x7fcb7806d2a0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:14.587 INFO:teuthology.misc.health.smithi073.stderr:2023-12-12T09:43:14.585+0000 7fcb9bb53640 1 --2- 172.21.15.73:0/1497020179 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcb941e94b0 0x7fcb940717b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:14.587 INFO:teuthology.misc.health.smithi073.stderr:2023-12-12T09:43:14.585+0000 7fcb9bb53640 1 --2- 172.21.15.73:0/1497020179 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcb94147370 0x7fcb941451b0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:14.587 INFO:teuthology.misc.health.smithi073.stderr:2023-12-12T09:43:14.585+0000 7fcb9bb53640 1 --2- 172.21.15.73:0/1497020179 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcb80004d00 0x7fcb940bc450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:14.587 INFO:teuthology.misc.health.smithi073.stderr:2023-12-12T09:43:14.585+0000 7fcb9bb53640 1 -- 172.21.15.73:0/1497020179 >> 172.21.15.73:0/1497020179 conn(0x7fcb940a7ea0 msgr2=0x7fcb940c2550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:43:14.587 INFO:teuthology.misc.health.smithi073.stderr:2023-12-12T09:43:14.585+0000 7fcb9bb53640 1 -- 172.21.15.73:0/1497020179 shutdown_connections 2023-12-12T09:43:14.587 INFO:teuthology.misc.health.smithi073.stderr:2023-12-12T09:43:14.585+0000 7fcb9bb53640 1 -- 172.21.15.73:0/1497020179 wait complete. 2023-12-12T09:43:14.601 DEBUG:teuthology.misc:8 of 8 OSDs are up 2023-12-12T09:43:14.601 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2023-12-12T09:43:14.601 INFO:tasks.ceph.mds.a:Restarting daemon 2023-12-12T09:43:14.601 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-12-12T09:43:14.609 INFO:tasks.ceph.mds.a:Started 2023-12-12T09:43:14.609 INFO:tasks.ceph.mds.c:Restarting daemon 2023-12-12T09:43:14.610 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-12-12T09:43:14.620 INFO:tasks.ceph.mds.c:Started 2023-12-12T09:43:14.620 INFO:tasks.ceph.mds.b:Restarting daemon 2023-12-12T09:43:14.620 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-12-12T09:43:14.629 INFO:tasks.ceph.mds.b:Started 2023-12-12T09:43:14.630 INFO:tasks.ceph.mds.d:Restarting daemon 2023-12-12T09:43:14.630 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-12-12T09:43:14.639 INFO:tasks.ceph.mds.d:Started 2023-12-12T09:43:14.639 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2023-12-12T09:43:14.639 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-12T09:43:14.767 INFO:tasks.ceph.mds.a.smithi073.stdout:starting mds.a at 2023-12-12T09:43:14.774 INFO:tasks.ceph.mds.c.smithi073.stdout:starting mds.c at 2023-12-12T09:43:14.800 INFO:tasks.ceph.mds.d.smithi142.stdout:starting mds.d at 2023-12-12T09:43:14.800 INFO:tasks.ceph.mds.b.smithi142.stdout:starting mds.b at 2023-12-12T09:43:14.830 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:14.830+0000 7fd5db2e0640 1 Processor -- start 2023-12-12T09:43:14.831 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:14.830+0000 7fd5db2e0640 1 -- start start 2023-12-12T09:43:14.832 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:14.831+0000 7fd5db2e0640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd5d40c5070 0x7fd5d40c40c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:14.832 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:14.831+0000 7fd5db2e0640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5d4152610 con 0x7fd5d414fa40 2023-12-12T09:43:14.832 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:14.831+0000 7fd5db2e0640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5d41528f0 con 0x7fd5d406db70 2023-12-12T09:43:14.832 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:14.831+0000 7fd5db2e0640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5d4152bd0 con 0x7fd5d40c5070 2023-12-12T09:43:14.832 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:14.831+0000 7fd5d907c640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7fd5d414fa40 0x7fd5d406a4e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:33388/0 (socket says 172.21.15.73:33388) 2023-12-12T09:43:14.832 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:14.831+0000 7fd5d907c640 1 -- 172.21.15.73:0/3398114567 learned_addr learned my addr 172.21.15.73:0/3398114567 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-12T09:43:14.832 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:14.831+0000 7fd5d987d640 1 --2- 172.21.15.73:0/3398114567 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd5d40c5070 0x7fd5d40c40c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:14.833 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:14.831+0000 7fd5cbfff640 1 -- 172.21.15.73:0/3398114567 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 895061575 0 0) 0x7fd5d4152610 con 0x7fd5d414fa40 2023-12-12T09:43:14.833 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:14.831+0000 7fd5cbfff640 1 -- 172.21.15.73:0/3398114567 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd5c0003520 con 0x7fd5d414fa40 2023-12-12T09:43:14.833 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:14.832+0000 7fd5cbfff640 1 -- 172.21.15.73:0/3398114567 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 840472782 0 0) 0x7fd5d41528f0 con 0x7fd5d406db70 2023-12-12T09:43:14.833 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:14.832+0000 7fd5cbfff640 1 -- 172.21.15.73:0/3398114567 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd5d4152610 con 0x7fd5d406db70 2023-12-12T09:43:14.833 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:14.832+0000 7fd5d987d640 1 -- 172.21.15.73:0/3398114567 >> v1:172.21.15.142:6789/0 conn(0x7fd5d406db70 legacy=0x7fd5d40c39b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:14.833 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:14.832+0000 7fd5d987d640 1 -- 172.21.15.73:0/3398114567 >> v1:172.21.15.73:6789/0 conn(0x7fd5d414fa40 legacy=0x7fd5d406a4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:14.833 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:14.832+0000 7fd5d987d640 1 -- 172.21.15.73:0/3398114567 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5d4152eb0 con 0x7fd5d40c5070 2023-12-12T09:43:14.835 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:14.833+0000 7fd5d987d640 1 --2- 172.21.15.73:0/3398114567 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd5d40c5070 0x7fd5d40c40c0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fd5cc009dc0 tx=0x7fd5cc02bf20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=32bde3065610aaba server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:43:14.835 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:14.833+0000 7fd5cbfff640 1 -- 172.21.15.73:0/3398114567 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5cc02ccd0 con 0x7fd5d40c5070 2023-12-12T09:43:14.835 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:14.833+0000 7fd5cbfff640 1 -- 172.21.15.73:0/3398114567 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5cc02ce30 con 0x7fd5d40c5070 2023-12-12T09:43:14.835 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:14.833+0000 7fd5cbfff640 1 -- 172.21.15.73:0/3398114567 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5cc034660 con 0x7fd5d40c5070 2023-12-12T09:43:14.835 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:14.833+0000 7fd5db2e0640 1 -- 172.21.15.73:0/3398114567 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd5d40c5070 msgr2=0x7fd5d40c40c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:14.835 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:14.833+0000 7fd5db2e0640 1 --2- 172.21.15.73:0/3398114567 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd5d40c5070 0x7fd5d40c40c0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fd5cc009dc0 tx=0x7fd5cc02bf20 comp rx=0 tx=0).stop 2023-12-12T09:43:14.835 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:14.834+0000 7fd5db2e0640 1 -- 172.21.15.73:0/3398114567 shutdown_connections 2023-12-12T09:43:14.835 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:14.834+0000 7fd5db2e0640 1 --2- 172.21.15.73:0/3398114567 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd5d40c5070 0x7fd5d40c40c0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:14.835 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:14.834+0000 7fd5db2e0640 1 -- 172.21.15.73:0/3398114567 >> 172.21.15.73:0/3398114567 conn(0x7fd5d40a8130 msgr2=0x7fd5d40c24b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:43:14.835 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:14.834+0000 7fd5db2e0640 1 -- 172.21.15.73:0/3398114567 shutdown_connections 2023-12-12T09:43:14.835 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:14.834+0000 7fd5db2e0640 1 -- 172.21.15.73:0/3398114567 wait complete. 2023-12-12T09:43:14.836 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:14.835+0000 7fd5db2e0640 1 Processor -- start 2023-12-12T09:43:14.836 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:14.836+0000 7fd5db2e0640 1 -- start start 2023-12-12T09:43:14.838 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:14.836+0000 7fd5db2e0640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd5d406db70 0x7fd5d41ed1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:14.838 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:14.836+0000 7fd5db2e0640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd5d40c5070 0x7fd5d4070760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:14.838 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:14.836+0000 7fd5db2e0640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd5d414fa40 0x7fd5d4070ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:14.838 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:14.837+0000 7fd5db2e0640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5d41502e0 con 0x7fd5d406db70 2023-12-12T09:43:14.838 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:14.837+0000 7fd5db2e0640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5d4071a20 con 0x7fd5d414fa40 2023-12-12T09:43:14.838 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:14.837+0000 7fd5db2e0640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5d4154440 con 0x7fd5d40c5070 2023-12-12T09:43:14.839 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:14.837+0000 7fd5d907c640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd5d406db70 0x7fd5d41ed1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:14.839 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:14.837+0000 7fd5d907c640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd5d406db70 0x7fd5d41ed1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:39918/0 (socket says 172.21.15.73:39918) 2023-12-12T09:43:14.839 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:14.837+0000 7fd5d907c640 1 -- 172.21.15.73:0/1974806618 learned_addr learned my addr 172.21.15.73:0/1974806618 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:43:14.839 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:14.837+0000 7fd5d887b640 1 --2- 172.21.15.73:0/1974806618 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd5d40c5070 0x7fd5d4070760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:14.839 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:14.837+0000 7fd5d987d640 1 --2- 172.21.15.73:0/1974806618 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd5d414fa40 0x7fd5d4070ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:14.839 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:14.837+0000 7fd5d907c640 1 -- 172.21.15.73:0/1974806618 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd5d40c5070 msgr2=0x7fd5d4070760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:14.839 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:14.837+0000 7fd5d907c640 1 --2- 172.21.15.73:0/1974806618 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd5d40c5070 0x7fd5d4070760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:14.839 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:14.837+0000 7fd5d907c640 1 -- 172.21.15.73:0/1974806618 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd5d414fa40 msgr2=0x7fd5d4070ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:14.839 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:14.837+0000 7fd5d907c640 1 --2- 172.21.15.73:0/1974806618 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd5d414fa40 0x7fd5d4070ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:14.839 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:14.837+0000 7fd5d907c640 1 -- 172.21.15.73:0/1974806618 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5cc009a70 con 0x7fd5d406db70 2023-12-12T09:43:14.839 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:14.838+0000 7fd5d907c640 1 --2- 172.21.15.73:0/1974806618 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd5d406db70 0x7fd5d41ed1d0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fd5d000c500 tx=0x7fd5d000c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:43:14.840 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:14.838+0000 7fd5c9ffb640 1 -- 172.21.15.73:0/1974806618 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5d0005ce0 con 0x7fd5d406db70 2023-12-12T09:43:14.840 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:14.838+0000 7fd5c9ffb640 1 -- 172.21.15.73:0/1974806618 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5d0005e40 con 0x7fd5d406db70 2023-12-12T09:43:14.840 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:14.838+0000 7fd5c9ffb640 1 -- 172.21.15.73:0/1974806618 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5d00072f0 con 0x7fd5d406db70 2023-12-12T09:43:14.840 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:14.838+0000 7fd5db2e0640 1 -- 172.21.15.73:0/1974806618 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5d40716f0 con 0x7fd5d406db70 2023-12-12T09:43:14.840 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:14.838+0000 7fd5db2e0640 1 -- 172.21.15.73:0/1974806618 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5d41eddf0 con 0x7fd5d406db70 2023-12-12T09:43:14.840 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:14.839+0000 7fd5db2e0640 1 -- 172.21.15.73:0/1974806618 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd5d4067580 con 0x7fd5d406db70 2023-12-12T09:43:14.841 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:14.840+0000 7fd5c9ffb640 1 -- 172.21.15.73:0/1974806618 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 4) v1 ==== 89175+0+0 (secure 0 0 0) 0x7fd5d0007450 con 0x7fd5d406db70 2023-12-12T09:43:14.842 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:14.841+0000 7fd5c9ffb640 1 --2- 172.21.15.73:0/1974806618 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fd5b806ade0 0x7fd5b806d2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:14.842 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:14.842+0000 7fd5c9ffb640 1 -- 172.21.15.73:0/1974806618 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(13..13 src has 1..13) v4 ==== 4471+0+0 (secure 0 0 0) 0x7fd5d0088510 con 0x7fd5d406db70 2023-12-12T09:43:14.843 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:14.842+0000 7fd5d887b640 1 --2- 172.21.15.73:0/1974806618 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fd5b806ade0 0x7fd5b806d2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:14.843 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:14.842+0000 7fd5d887b640 1 --2- 172.21.15.73:0/1974806618 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fd5b806ade0 0x7fd5b806d2a0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fd5d40c45d0 tx=0x7fd5c4009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:43:14.847 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:14.846+0000 7fd5c9ffb640 1 -- 172.21.15.73:0/1974806618 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fd5d0053d70 con 0x7fd5d406db70 2023-12-12T09:43:15.044 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:15.043+0000 7fd5db2e0640 1 -- 172.21.15.73:0/1974806618 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd5d414f700 con 0x7fd5d406db70 2023-12-12T09:43:15.046 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:15.045+0000 7fd5c9ffb640 1 -- 172.21.15.73:0/1974806618 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v14) v1 ==== 74+0+11104 (secure 0 0 0) 0x7fd5d0057390 con 0x7fd5d406db70 2023-12-12T09:43:15.046 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-12T09:43:15.046 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":14,"fsid":"ba240992-02b8-4c7e-92f2-27eb29ac433b","created":"2023-12-12T09:43:02.454719+0000","modified":"2023-12-12T09:43:14.917599+0000","last_up_change":"2023-12-12T09:43:13.913440+0000","last_in_change":"2023-12-12T09:43:05.925348+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"dd9074be-dbe2-4c34-9896-a4223d8d3940","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":4047810203},{"type":"v1","addr":"172.21.15.73:6801","nonce":4047810203}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":4047810203},{"type":"v1","addr":"172.21.15.73:6803","nonce":4047810203}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":4047810203},{"type":"v1","addr":"172.21.15.73:6807","nonce":4047810203}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":4047810203},{"type":"v1","addr":"172.21.15.73:6805","nonce":4047810203}]},"public_addr":"172.21.15.73:6801/4047810203","cluster_addr":"172.21.15.73:6803/4047810203","heartbeat_back_addr":"172.21.15.73:6807/4047810203","heartbeat_front_addr":"172.21.15.73:6805/4047810203","state":["exists","up"]},{"osd":1,"uuid":"c4a05052-96d4-4758-a4e1-1a37f1e07fed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":1356058331},{"type":"v1","addr":"172.21.15.73:6824","nonce":1356058331}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":1356058331},{"type":"v1","addr":"172.21.15.73:6827","nonce":1356058331}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":1356058331},{"type":"v1","addr":"172.21.15.73:6831","nonce":1356058331}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":1356058331},{"type":"v1","addr":"172.21.15.73:6829","nonce":1356058331}]},"public_addr":"172.21.15.73:6824/1356058331","cluster_addr":"172.21.15.73:6827/1356058331","heartbeat_back_addr":"172.21.15.73:6831/1356058331","heartbeat_front_addr":"172.21.15.73:6829/1356058331","state":["exists","up"]},{"osd":2,"uuid":"512bc8ac-72c2-40d4-b3d2-d867a92c5213","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":1228903316},{"type":"v1","addr":"172.21.15.73:6817","nonce":1228903316}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":1228903316},{"type":"v1","addr":"172.21.15.73:6819","nonce":1228903316}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6823","nonce":1228903316},{"type":"v1","addr":"172.21.15.73:6825","nonce":1228903316}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":1228903316},{"type":"v1","addr":"172.21.15.73:6821","nonce":1228903316}]},"public_addr":"172.21.15.73:6817/1228903316","cluster_addr":"172.21.15.73:6819/1228903316","heartbeat_back_addr":"172.21.15.73:6825/1228903316","heartbeat_front_addr":"172.21.15.73:6821/1228903316","state":["exists","up"]},{"osd":3,"uuid":"3d1a91e0-42bf-437a-8eae-8d357c8f63a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":1293329670},{"type":"v1","addr":"172.21.15.73:6809","nonce":1293329670}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6810","nonce":1293329670},{"type":"v1","addr":"172.21.15.73:6811","nonce":1293329670}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":1293329670},{"type":"v1","addr":"172.21.15.73:6815","nonce":1293329670}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":1293329670},{"type":"v1","addr":"172.21.15.73:6813","nonce":1293329670}]},"public_addr":"172.21.15.73:6809/1293329670","cluster_addr":"172.21.15.73:6811/1293329670","heartbeat_back_addr":"172.21.15.73:6815/1293329670","heartbeat_front_addr":"172.21.15.73:6813/1293329670","state":["exists","up"]},{"osd":4,"uuid":"4b302fff-834c-4069-ac19-00e46f6c87b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":3727975702},{"type":"v1","addr":"172.21.15.142:6801","nonce":3727975702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":3727975702},{"type":"v1","addr":"172.21.15.142:6803","nonce":3727975702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6809","nonce":3727975702},{"type":"v1","addr":"172.21.15.142:6811","nonce":3727975702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6805","nonce":3727975702},{"type":"v1","addr":"172.21.15.142:6807","nonce":3727975702}]},"public_addr":"172.21.15.142:6801/3727975702","cluster_addr":"172.21.15.142:6803/3727975702","heartbeat_back_addr":"172.21.15.142:6811/3727975702","heartbeat_front_addr":"172.21.15.142:6807/3727975702","state":["exists","up"]},{"osd":5,"uuid":"d7cdace2-67d0-45cc-95f2-515cf6ef1b82","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6817","nonce":2353193632},{"type":"v1","addr":"172.21.15.142:6819","nonce":2353193632}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6821","nonce":2353193632},{"type":"v1","addr":"172.21.15.142:6823","nonce":2353193632}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6829","nonce":2353193632},{"type":"v1","addr":"172.21.15.142:6831","nonce":2353193632}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6825","nonce":2353193632},{"type":"v1","addr":"172.21.15.142:6827","nonce":2353193632}]},"public_addr":"172.21.15.142:6819/2353193632","cluster_addr":"172.21.15.142:6823/2353193632","heartbeat_back_addr":"172.21.15.142:6831/2353193632","heartbeat_front_addr":"172.21.15.142:6827/2353193632","state":["exists","up"]},{"osd":6,"uuid":"649ce78a-5626-445c-aedc-a651ed05a6f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":2006111986},{"type":"v1","addr":"172.21.15.142:6806","nonce":2006111986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":2006111986},{"type":"v1","addr":"172.21.15.142:6810","nonce":2006111986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":2006111986},{"type":"v1","addr":"172.21.15.142:6815","nonce":2006111986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":2006111986},{"type":"v1","addr":"172.21.15.142:6813","nonce":2006111986}]},"public_addr":"172.21.15.142:6806/2006111986","cluster_addr":"172.21.15.142:6810/2006111986","heartbeat_back_addr":"172.21.15.142:6815/2006111986","heartbeat_front_addr":"172.21.15.142:6813/2006111986","state":["exists","up"]},{"osd":7,"uuid":"af15ae3b-c1d0-4acf-92db-8a1805494d13","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":2573794341},{"type":"v1","addr":"172.21.15.142:6818","nonce":2573794341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":2573794341},{"type":"v1","addr":"172.21.15.142:6822","nonce":2573794341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":2573794341},{"type":"v1","addr":"172.21.15.142:6830","nonce":2573794341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":2573794341},{"type":"v1","addr":"172.21.15.142:6826","nonce":2573794341}]},"public_addr":"172.21.15.142:6818/2573794341","cluster_addr":"172.21.15.142:6822/2573794341","heartbeat_back_addr":"172.21.15.142:6830/2573794341","heartbeat_front_addr":"172.21.15.142:6826/2573794341","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.185824+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.262103+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.225556+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:10.523459+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:10.706035+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.257339+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.301776+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.051960+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-12T09:43:15.051 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:15.048+0000 7fd5db2e0640 1 -- 172.21.15.73:0/1974806618 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fd5b806ade0 msgr2=0x7fd5b806d2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:15.051 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:15.048+0000 7fd5db2e0640 1 --2- 172.21.15.73:0/1974806618 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fd5b806ade0 0x7fd5b806d2a0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fd5d40c45d0 tx=0x7fd5c4009040 comp rx=0 tx=0).stop 2023-12-12T09:43:15.051 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:15.048+0000 7fd5db2e0640 1 -- 172.21.15.73:0/1974806618 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd5d406db70 msgr2=0x7fd5d41ed1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:15.051 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:15.048+0000 7fd5db2e0640 1 --2- 172.21.15.73:0/1974806618 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd5d406db70 0x7fd5d41ed1d0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fd5d000c500 tx=0x7fd5d000c9c0 comp rx=0 tx=0).stop 2023-12-12T09:43:15.051 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:15.048+0000 7fd5db2e0640 1 -- 172.21.15.73:0/1974806618 shutdown_connections 2023-12-12T09:43:15.051 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:15.048+0000 7fd5db2e0640 1 --2- 172.21.15.73:0/1974806618 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fd5b806ade0 0x7fd5b806d2a0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:15.051 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:15.048+0000 7fd5db2e0640 1 --2- 172.21.15.73:0/1974806618 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd5d414fa40 0x7fd5d4070ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:15.051 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:15.048+0000 7fd5db2e0640 1 --2- 172.21.15.73:0/1974806618 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd5d40c5070 0x7fd5d4070760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:15.051 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:15.048+0000 7fd5db2e0640 1 --2- 172.21.15.73:0/1974806618 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd5d406db70 0x7fd5d41ed1d0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:15.051 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:15.048+0000 7fd5db2e0640 1 -- 172.21.15.73:0/1974806618 >> 172.21.15.73:0/1974806618 conn(0x7fd5d40a8130 msgr2=0x7fd5d40c63b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:43:15.051 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:15.048+0000 7fd5db2e0640 1 -- 172.21.15.73:0/1974806618 shutdown_connections 2023-12-12T09:43:15.051 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:15.048+0000 7fd5db2e0640 1 -- 172.21.15.73:0/1974806618 wait complete. 2023-12-12T09:43:15.066 INFO:tasks.cephfs.filesystem.ceph_manager:[] 2023-12-12T09:43:15.066 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-12T09:43:15.264 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:15.262+0000 7fd3df285640 1 Processor -- start 2023-12-12T09:43:15.264 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:15.263+0000 7fd3df285640 1 -- start start 2023-12-12T09:43:15.266 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:15.264+0000 7fd3df285640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fd3d814fbb0 0x7fd3d80c09e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:15.266 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:15.264+0000 7fd3df285640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd3d80c0f20 0x7fd3d80aae00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:15.266 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:15.264+0000 7fd3df285640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fd3d80a9470 0x7fd3d80ab340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:15.266 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:15.264+0000 7fd3df285640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3d80aa000 con 0x7fd3d80a9470 2023-12-12T09:43:15.266 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:15.264+0000 7fd3df285640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3d80c1d40 con 0x7fd3d814fbb0 2023-12-12T09:43:15.266 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:15.264+0000 7fd3df285640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3d8153300 con 0x7fd3d80c0f20 2023-12-12T09:43:15.266 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:15.264+0000 7fd3dea84640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fd3d80a9470 0x7fd3d80ab340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:15.266 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:15.265+0000 7fd3dea84640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fd3d80a9470 0x7fd3d80ab340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:39934/0 (socket says 172.21.15.73:39934) 2023-12-12T09:43:15.266 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:15.265+0000 7fd3dea84640 1 -- 172.21.15.73:0/1720135153 learned_addr learned my addr 172.21.15.73:0/1720135153 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:43:15.266 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:15.265+0000 7fd3de283640 1 --2- 172.21.15.73:0/1720135153 >> v2:172.21.15.142:3300/0 conn(0x7fd3d814fbb0 0x7fd3d80c09e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:15.267 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:15.265+0000 7fd3dda82640 1 --2- 172.21.15.73:0/1720135153 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd3d80c0f20 0x7fd3d80aae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:15.267 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:15.265+0000 7fd3dea84640 1 -- 172.21.15.73:0/1720135153 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd3d80c0f20 msgr2=0x7fd3d80aae00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:43:15.267 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:15.265+0000 7fd3dea84640 1 --2- 172.21.15.73:0/1720135153 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd3d80c0f20 0x7fd3d80aae00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:15.267 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:15.265+0000 7fd3dea84640 1 -- 172.21.15.73:0/1720135153 >> v2:172.21.15.142:3300/0 conn(0x7fd3d814fbb0 msgr2=0x7fd3d80c09e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:43:15.267 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:15.265+0000 7fd3dea84640 1 --2- 172.21.15.73:0/1720135153 >> v2:172.21.15.142:3300/0 conn(0x7fd3d814fbb0 0x7fd3d80c09e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:15.267 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:15.265+0000 7fd3dea84640 1 -- 172.21.15.73:0/1720135153 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3d80c2160 con 0x7fd3d80a9470 2023-12-12T09:43:15.268 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:15.266+0000 7fd3dea84640 1 --2- 172.21.15.73:0/1720135153 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd3d80a9470 0x7fd3d80ab340 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fd3d80a9330 tx=0x7fd3d002b870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9bfe214e22beb63 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:43:15.268 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:15.266+0000 7fd3dd281640 1 -- 172.21.15.73:0/1720135153 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3d00317d0 con 0x7fd3d80a9470 2023-12-12T09:43:15.268 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:15.266+0000 7fd3dd281640 1 -- 172.21.15.73:0/1720135153 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3d0031930 con 0x7fd3d80a9470 2023-12-12T09:43:15.268 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:15.266+0000 7fd3dd281640 1 -- 172.21.15.73:0/1720135153 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3d0031cc0 con 0x7fd3d80a9470 2023-12-12T09:43:15.268 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:15.267+0000 7fd3df285640 1 -- 172.21.15.73:0/1720135153 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd3d80a9470 msgr2=0x7fd3d80ab340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:15.268 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:15.267+0000 7fd3df285640 1 --2- 172.21.15.73:0/1720135153 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd3d80a9470 0x7fd3d80ab340 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fd3d80a9330 tx=0x7fd3d002b870 comp rx=0 tx=0).stop 2023-12-12T09:43:15.269 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:15.267+0000 7fd3df285640 1 -- 172.21.15.73:0/1720135153 shutdown_connections 2023-12-12T09:43:15.269 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:15.267+0000 7fd3df285640 1 --2- 172.21.15.73:0/1720135153 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd3d80a9470 0x7fd3d80ab340 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:15.269 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:15.267+0000 7fd3df285640 1 --2- 172.21.15.73:0/1720135153 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd3d80c0f20 0x7fd3d80aae00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:15.269 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:15.267+0000 7fd3df285640 1 --2- 172.21.15.73:0/1720135153 >> v2:172.21.15.142:3300/0 conn(0x7fd3d814fbb0 0x7fd3d80c09e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:15.269 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:15.267+0000 7fd3df285640 1 -- 172.21.15.73:0/1720135153 >> 172.21.15.73:0/1720135153 conn(0x7fd3d80c23b0 msgr2=0x7fd3d80c2790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:43:15.269 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:15.267+0000 7fd3df285640 1 -- 172.21.15.73:0/1720135153 shutdown_connections 2023-12-12T09:43:15.269 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:15.267+0000 7fd3df285640 1 -- 172.21.15.73:0/1720135153 wait complete. 2023-12-12T09:43:15.270 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:15.269+0000 7fd3df285640 1 Processor -- start 2023-12-12T09:43:15.270 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:15.269+0000 7fd3df285640 1 -- start start 2023-12-12T09:43:15.271 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:15.270+0000 7fd3df285640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd3d80a9470 0x7fd3d80712d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:15.271 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:15.270+0000 7fd3df285640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd3d80c0f20 0x7fd3d8153730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:15.272 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:15.270+0000 7fd3df285640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd3d814fbb0 0x7fd3d8071f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:15.272 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:15.270+0000 7fd3df285640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3d80a6750 con 0x7fd3d80c0f20 2023-12-12T09:43:15.272 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:15.270+0000 7fd3df285640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3d80a6a30 con 0x7fd3d80a9470 2023-12-12T09:43:15.272 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:15.270+0000 7fd3df285640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3d80a6d10 con 0x7fd3d814fbb0 2023-12-12T09:43:15.272 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:15.270+0000 7fd3dda82640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd3d80c0f20 0x7fd3d8153730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:15.272 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:15.270+0000 7fd3dda82640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd3d80c0f20 0x7fd3d8153730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:39950/0 (socket says 172.21.15.73:39950) 2023-12-12T09:43:15.272 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:15.270+0000 7fd3dda82640 1 -- 172.21.15.73:0/2030477050 learned_addr learned my addr 172.21.15.73:0/2030477050 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:43:15.272 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:15.271+0000 7fd3de283640 1 --2- 172.21.15.73:0/2030477050 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd3d80a9470 0x7fd3d80712d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:15.272 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:15.271+0000 7fd3dea84640 1 --2- 172.21.15.73:0/2030477050 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd3d814fbb0 0x7fd3d8071f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:15.272 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:15.271+0000 7fd3dda82640 1 -- 172.21.15.73:0/2030477050 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd3d814fbb0 msgr2=0x7fd3d8071f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:15.272 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:15.271+0000 7fd3dda82640 1 --2- 172.21.15.73:0/2030477050 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd3d814fbb0 0x7fd3d8071f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:15.272 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:15.271+0000 7fd3dda82640 1 -- 172.21.15.73:0/2030477050 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd3d80a9470 msgr2=0x7fd3d80712d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:15.272 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:15.271+0000 7fd3dda82640 1 --2- 172.21.15.73:0/2030477050 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd3d80a9470 0x7fd3d80712d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:15.273 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:15.271+0000 7fd3dda82640 1 -- 172.21.15.73:0/2030477050 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3d00094d0 con 0x7fd3d80c0f20 2023-12-12T09:43:15.273 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:15.271+0000 7fd3dda82640 1 --2- 172.21.15.73:0/2030477050 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd3d80c0f20 0x7fd3d8153730 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fd3c400d7d0 tx=0x7fd3c400dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:43:15.273 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:15.271+0000 7fd3d6ffd640 1 -- 172.21.15.73:0/2030477050 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3c40096a0 con 0x7fd3d80c0f20 2023-12-12T09:43:15.273 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:15.271+0000 7fd3d6ffd640 1 -- 172.21.15.73:0/2030477050 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3c4009800 con 0x7fd3d80c0f20 2023-12-12T09:43:15.274 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:15.271+0000 7fd3d6ffd640 1 -- 172.21.15.73:0/2030477050 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3c4009b90 con 0x7fd3d80c0f20 2023-12-12T09:43:15.274 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:15.271+0000 7fd3df285640 1 -- 172.21.15.73:0/2030477050 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3d80a6ff0 con 0x7fd3d80c0f20 2023-12-12T09:43:15.274 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:15.272+0000 7fd3df285640 1 -- 172.21.15.73:0/2030477050 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3d8153c70 con 0x7fd3d80c0f20 2023-12-12T09:43:15.274 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:15.273+0000 7fd3df285640 1 -- 172.21.15.73:0/2030477050 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3d80a6890 con 0x7fd3d80c0f20 2023-12-12T09:43:15.274 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:15.273+0000 7fd3d6ffd640 1 -- 172.21.15.73:0/2030477050 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 4) v1 ==== 89175+0+0 (secure 0 0 0) 0x7fd3c4009cf0 con 0x7fd3d80c0f20 2023-12-12T09:43:15.275 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:15.274+0000 7fd3d6ffd640 1 --2- 172.21.15.73:0/2030477050 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fd3bc06adb0 0x7fd3bc06d270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:15.275 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:15.274+0000 7fd3d6ffd640 1 -- 172.21.15.73:0/2030477050 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 4471+0+0 (secure 0 0 0) 0x7fd3c4089520 con 0x7fd3d80c0f20 2023-12-12T09:43:15.275 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:15.275+0000 7fd3de283640 1 --2- 172.21.15.73:0/2030477050 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fd3bc06adb0 0x7fd3bc06d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:15.276 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:15.275+0000 7fd3de283640 1 --2- 172.21.15.73:0/2030477050 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fd3bc06adb0 0x7fd3bc06d270 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fd3d80bfbe0 tx=0x7fd3cc0039b0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:43:15.280 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:15.279+0000 7fd3d6ffd640 1 -- 172.21.15.73:0/2030477050 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fd3d80a6890 con 0x7fd3d80c0f20 2023-12-12T09:43:15.511 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:15.510+0000 7fd3df285640 1 -- 172.21.15.73:0/2030477050 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd3d80a6890 con 0x7fd3d80c0f20 2023-12-12T09:43:15.525 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:15.524+0000 7fd3d6ffd640 1 -- 172.21.15.73:0/2030477050 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) v1 ==== 93+0+1324 (secure 0 0 0) 0x7fd3d80a6890 con 0x7fd3d80c0f20 2023-12-12T09:43:15.526 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-12T09:43:15.526 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4257,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6835/1079394562","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":1079394562},{"type":"v1","addr":"172.21.15.73:6835","nonce":1079394562}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[]} 2023-12-12T09:43:15.526 INFO:teuthology.orchestra.run.smithi073.stderr:dumped fsmap epoch 2 2023-12-12T09:43:15.528 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:15.527+0000 7fd3df285640 1 -- 172.21.15.73:0/2030477050 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fd3bc06adb0 msgr2=0x7fd3bc06d270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:15.528 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:15.527+0000 7fd3df285640 1 --2- 172.21.15.73:0/2030477050 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fd3bc06adb0 0x7fd3bc06d270 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fd3d80bfbe0 tx=0x7fd3cc0039b0 comp rx=0 tx=0).stop 2023-12-12T09:43:15.528 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:15.527+0000 7fd3df285640 1 -- 172.21.15.73:0/2030477050 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd3d80c0f20 msgr2=0x7fd3d8153730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:15.528 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:15.527+0000 7fd3df285640 1 --2- 172.21.15.73:0/2030477050 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd3d80c0f20 0x7fd3d8153730 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fd3c400d7d0 tx=0x7fd3c400dc90 comp rx=0 tx=0).stop 2023-12-12T09:43:15.528 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:15.527+0000 7fd3df285640 1 -- 172.21.15.73:0/2030477050 shutdown_connections 2023-12-12T09:43:15.528 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:15.527+0000 7fd3df285640 1 --2- 172.21.15.73:0/2030477050 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fd3bc06adb0 0x7fd3bc06d270 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:15.528 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:15.527+0000 7fd3df285640 1 --2- 172.21.15.73:0/2030477050 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd3d814fbb0 0x7fd3d8071f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:15.528 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:15.527+0000 7fd3df285640 1 --2- 172.21.15.73:0/2030477050 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd3d80c0f20 0x7fd3d8153730 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:15.528 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:15.527+0000 7fd3df285640 1 --2- 172.21.15.73:0/2030477050 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd3d80a9470 0x7fd3d80712d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:15.528 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:15.527+0000 7fd3df285640 1 -- 172.21.15.73:0/2030477050 >> 172.21.15.73:0/2030477050 conn(0x7fd3d80c23b0 msgr2=0x7fd3d80c2790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:43:15.529 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:15.527+0000 7fd3df285640 1 -- 172.21.15.73:0/2030477050 shutdown_connections 2023-12-12T09:43:15.529 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:15.527+0000 7fd3df285640 1 -- 172.21.15.73:0/2030477050 wait complete. 2023-12-12T09:43:17.546 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-12T09:43:17.735 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:17.734+0000 7efcbb1e9640 1 Processor -- start 2023-12-12T09:43:17.735 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:17.734+0000 7efcbb1e9640 1 -- start start 2023-12-12T09:43:17.737 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:17.735+0000 7efcbb1e9640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7efcb414e700 0x7efcb4151cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:17.737 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:17.735+0000 7efcbb1e9640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7efcb40c37b0 0x7efcb40c02b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:17.737 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:17.736+0000 7efcbb1e9640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efcb41521f0 con 0x7efcb40ab4a0 2023-12-12T09:43:17.737 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:17.736+0000 7efcbb1e9640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efcb40ab2d0 con 0x7efcb40c37b0 2023-12-12T09:43:17.737 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:17.736+0000 7efcbb1e9640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efcb406bb10 con 0x7efcb414e700 2023-12-12T09:43:17.737 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:17.736+0000 7efcb99e6640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7efcb40c37b0 0x7efcb40c02b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:17.738 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:17.736+0000 7efcb99e6640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7efcb40c37b0 0x7efcb40c02b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:39988/0 (socket says 172.21.15.73:39988) 2023-12-12T09:43:17.738 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:17.736+0000 7efcb99e6640 1 -- 172.21.15.73:0/273636545 learned_addr learned my addr 172.21.15.73:0/273636545 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:43:17.738 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:17.736+0000 7efcba1e7640 1 --2- 172.21.15.73:0/273636545 >> v2:172.21.15.142:3300/0 conn(0x7efcb414e700 0x7efcb4151cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:17.738 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:17.736+0000 7efcb99e6640 1 -- 172.21.15.73:0/273636545 >> v2:172.21.15.142:3300/0 conn(0x7efcb414e700 msgr2=0x7efcb4151cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:43:17.738 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:17.736+0000 7efcb99e6640 1 --2- 172.21.15.73:0/273636545 >> v2:172.21.15.142:3300/0 conn(0x7efcb414e700 0x7efcb4151cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:17.738 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:17.736+0000 7efcb99e6640 1 -- 172.21.15.73:0/273636545 >> v1:172.21.15.142:6789/0 conn(0x7efcb40ab4a0 legacy=0x7efcb40a9df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:43:17.738 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:17.736+0000 7efcb99e6640 1 -- 172.21.15.73:0/273636545 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcb40c07f0 con 0x7efcb40c37b0 2023-12-12T09:43:17.738 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:17.736+0000 7efcba1e7640 1 --2- 172.21.15.73:0/273636545 >> v2:172.21.15.142:3300/0 conn(0x7efcb414e700 0x7efcb4151cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:43:17.738 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:17.738+0000 7efcb99e6640 1 --2- 172.21.15.73:0/273636545 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efcb40c37b0 0x7efcb40c02b0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7efca4009870 tx=0x7efca402b7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=beaa40003bfb5e0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:43:17.739 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:17.738+0000 7efcb91e5640 1 -- 172.21.15.73:0/273636545 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efca4031750 con 0x7efcb40c37b0 2023-12-12T09:43:17.739 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:17.738+0000 7efcb91e5640 1 -- 172.21.15.73:0/273636545 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efca40318b0 con 0x7efcb40c37b0 2023-12-12T09:43:17.739 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:17.738+0000 7efcb91e5640 1 -- 172.21.15.73:0/273636545 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efca4031c40 con 0x7efcb40c37b0 2023-12-12T09:43:17.740 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:17.739+0000 7efcbb1e9640 1 -- 172.21.15.73:0/273636545 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efcb40c37b0 msgr2=0x7efcb40c02b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:17.740 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:17.739+0000 7efcbb1e9640 1 --2- 172.21.15.73:0/273636545 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efcb40c37b0 0x7efcb40c02b0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7efca4009870 tx=0x7efca402b7f0 comp rx=0 tx=0).stop 2023-12-12T09:43:17.740 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:17.739+0000 7efcbb1e9640 1 -- 172.21.15.73:0/273636545 shutdown_connections 2023-12-12T09:43:17.740 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:17.739+0000 7efcbb1e9640 1 --2- 172.21.15.73:0/273636545 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efcb40c37b0 0x7efcb40c02b0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:17.740 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:17.739+0000 7efcbb1e9640 1 --2- 172.21.15.73:0/273636545 >> v2:172.21.15.142:3300/0 conn(0x7efcb414e700 0x7efcb4151cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:17.740 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:17.739+0000 7efcbb1e9640 1 -- 172.21.15.73:0/273636545 >> 172.21.15.73:0/273636545 conn(0x7efcb40c23b0 msgr2=0x7efcb40c2790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:43:17.740 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:17.739+0000 7efcbb1e9640 1 -- 172.21.15.73:0/273636545 shutdown_connections 2023-12-12T09:43:17.740 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:17.739+0000 7efcbb1e9640 1 -- 172.21.15.73:0/273636545 wait complete. 2023-12-12T09:43:17.741 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:17.741+0000 7efcbb1e9640 1 Processor -- start 2023-12-12T09:43:17.741 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:17.741+0000 7efcbb1e9640 1 -- start start 2023-12-12T09:43:17.743 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:17.742+0000 7efcbb1e9640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efcb40ab4a0 0x7efcb414b260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:17.743 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:17.742+0000 7efcbb1e9640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efcb40c37b0 0x7efcb40a6dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:17.744 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:17.742+0000 7efcbb1e9640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efcb414e700 0x7efcb41debc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:17.744 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:17.742+0000 7efcbb1e9640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcb40bb150 con 0x7efcb414e700 2023-12-12T09:43:17.744 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:17.742+0000 7efcbb1e9640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcb40ba8d0 con 0x7efcb40c37b0 2023-12-12T09:43:17.744 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:17.742+0000 7efcbb1e9640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efcb41ed3a0 con 0x7efcb40ab4a0 2023-12-12T09:43:17.744 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:17.742+0000 7efcba9e8640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efcb414e700 0x7efcb41debc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:17.744 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:17.742+0000 7efcba9e8640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efcb414e700 0x7efcb41debc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:40000/0 (socket says 172.21.15.73:40000) 2023-12-12T09:43:17.745 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:17.742+0000 7efcba9e8640 1 -- 172.21.15.73:0/2561964078 learned_addr learned my addr 172.21.15.73:0/2561964078 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:43:17.745 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:17.742+0000 7efcba1e7640 1 --2- 172.21.15.73:0/2561964078 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efcb40ab4a0 0x7efcb414b260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:17.745 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:17.742+0000 7efcb99e6640 1 --2- 172.21.15.73:0/2561964078 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efcb40c37b0 0x7efcb40a6dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:17.745 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:17.742+0000 7efcba9e8640 1 -- 172.21.15.73:0/2561964078 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efcb40ab4a0 msgr2=0x7efcb414b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:17.746 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:17.742+0000 7efcba9e8640 1 --2- 172.21.15.73:0/2561964078 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efcb40ab4a0 0x7efcb414b260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:17.746 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:17.742+0000 7efcba9e8640 1 -- 172.21.15.73:0/2561964078 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efcb40c37b0 msgr2=0x7efcb40a6dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:17.746 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:17.742+0000 7efcba9e8640 1 --2- 172.21.15.73:0/2561964078 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efcb40c37b0 0x7efcb40a6dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:17.746 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:17.742+0000 7efcba9e8640 1 -- 172.21.15.73:0/2561964078 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efca40094d0 con 0x7efcb414e700 2023-12-12T09:43:17.746 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:17.742+0000 7efcb99e6640 1 --2- 172.21.15.73:0/2561964078 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efcb40c37b0 0x7efcb40a6dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:43:17.746 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:17.742+0000 7efcba1e7640 1 --2- 172.21.15.73:0/2561964078 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efcb40ab4a0 0x7efcb414b260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:43:17.746 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:17.743+0000 7efcba9e8640 1 --2- 172.21.15.73:0/2561964078 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efcb414e700 0x7efcb41debc0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7efcac00b9c0 tx=0x7efcac00be80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:43:17.747 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:17.743+0000 7efcaaffd640 1 -- 172.21.15.73:0/2561964078 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcac00cb40 con 0x7efcb414e700 2023-12-12T09:43:17.747 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:17.743+0000 7efcaaffd640 1 -- 172.21.15.73:0/2561964078 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efcac00cca0 con 0x7efcb414e700 2023-12-12T09:43:17.747 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:17.743+0000 7efcaaffd640 1 -- 172.21.15.73:0/2561964078 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcac014680 con 0x7efcb414e700 2023-12-12T09:43:17.747 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:17.743+0000 7efcbb1e9640 1 -- 172.21.15.73:0/2561964078 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efcb41edc40 con 0x7efcb414e700 2023-12-12T09:43:17.747 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:17.743+0000 7efcbb1e9640 1 -- 172.21.15.73:0/2561964078 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efcb41ed5f0 con 0x7efcb414e700 2023-12-12T09:43:17.748 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:17.744+0000 7efcbb1e9640 1 -- 172.21.15.73:0/2561964078 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efcb41eddd0 con 0x7efcb414e700 2023-12-12T09:43:17.748 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:17.745+0000 7efcaaffd640 1 -- 172.21.15.73:0/2561964078 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 4) v1 ==== 89175+0+0 (secure 0 0 0) 0x7efcac01d3b0 con 0x7efcb414e700 2023-12-12T09:43:17.748 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:17.746+0000 7efcaaffd640 1 --2- 172.21.15.73:0/2561964078 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7efc9806adb0 0x7efc9806d270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:17.748 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:17.746+0000 7efcaaffd640 1 -- 172.21.15.73:0/2561964078 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7efcac089100 con 0x7efcb414e700 2023-12-12T09:43:17.748 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:17.746+0000 7efcba1e7640 1 --2- 172.21.15.73:0/2561964078 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7efc9806adb0 0x7efc9806d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:17.748 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:17.747+0000 7efcba1e7640 1 --2- 172.21.15.73:0/2561964078 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7efc9806adb0 0x7efc9806d270 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7efcb0006fd0 tx=0x7efcb0008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:43:17.756 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:17.756+0000 7efcaaffd640 1 -- 172.21.15.73:0/2561964078 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7efcac054670 con 0x7efcb414e700 2023-12-12T09:43:17.998 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:17.997+0000 7efcbb1e9640 1 -- 172.21.15.73:0/2561964078 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7efcb4067400 con 0x7efcb414e700 2023-12-12T09:43:17.999 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:17.998+0000 7efcaaffd640 1 -- 172.21.15.73:0/2561964078 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+3700 (secure 0 0 0) 0x7efcac057c90 con 0x7efcb414e700 2023-12-12T09:43:17.999 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-12T09:43:17.999 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4257,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6835/1079394562","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":1079394562},{"type":"v1","addr":"172.21.15.73:6835","nonce":1079394562}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4258,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6835/3726638062","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6833","nonce":3726638062},{"type":"v1","addr":"172.21.15.142:6835","nonce":3726638062}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4260,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6837/2513898821","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6836","nonce":2513898821},{"type":"v1","addr":"172.21.15.73:6837","nonce":2513898821}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4269,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6834/1773392257","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6832","nonce":1773392257},{"type":"v1","addr":"172.21.15.142:6834","nonce":1773392257}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[]} 2023-12-12T09:43:17.999 INFO:teuthology.orchestra.run.smithi073.stderr:dumped fsmap epoch 3 2023-12-12T09:43:18.002 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:18.000+0000 7efcbb1e9640 1 -- 172.21.15.73:0/2561964078 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7efc9806adb0 msgr2=0x7efc9806d270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:18.002 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:18.000+0000 7efcbb1e9640 1 --2- 172.21.15.73:0/2561964078 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7efc9806adb0 0x7efc9806d270 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7efcb0006fd0 tx=0x7efcb0008040 comp rx=0 tx=0).stop 2023-12-12T09:43:18.002 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:18.000+0000 7efcbb1e9640 1 -- 172.21.15.73:0/2561964078 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efcb414e700 msgr2=0x7efcb41debc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:18.002 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:18.000+0000 7efcbb1e9640 1 --2- 172.21.15.73:0/2561964078 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efcb414e700 0x7efcb41debc0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7efcac00b9c0 tx=0x7efcac00be80 comp rx=0 tx=0).stop 2023-12-12T09:43:18.002 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:18.001+0000 7efcbb1e9640 1 -- 172.21.15.73:0/2561964078 shutdown_connections 2023-12-12T09:43:18.003 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:18.001+0000 7efcbb1e9640 1 --2- 172.21.15.73:0/2561964078 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7efc9806adb0 0x7efc9806d270 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:18.005 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:18.001+0000 7efcbb1e9640 1 --2- 172.21.15.73:0/2561964078 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efcb414e700 0x7efcb41debc0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:18.005 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:18.001+0000 7efcbb1e9640 1 --2- 172.21.15.73:0/2561964078 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efcb40c37b0 0x7efcb40a6dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:18.005 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:18.001+0000 7efcbb1e9640 1 --2- 172.21.15.73:0/2561964078 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efcb40ab4a0 0x7efcb414b260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:18.005 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:18.001+0000 7efcbb1e9640 1 -- 172.21.15.73:0/2561964078 >> 172.21.15.73:0/2561964078 conn(0x7efcb40c23b0 msgr2=0x7efcb40c4040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:43:18.006 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:18.001+0000 7efcbb1e9640 1 -- 172.21.15.73:0/2561964078 shutdown_connections 2023-12-12T09:43:18.006 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:18.001+0000 7efcbb1e9640 1 -- 172.21.15.73:0/2561964078 wait complete. 2023-12-12T09:43:18.019 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-12T09:43:18.050 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T09:43:18.069 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T09:43:18.207 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:18.206+0000 7fb188589640 1 Processor -- start 2023-12-12T09:43:18.207 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:18.206+0000 7fb188589640 1 -- start start 2023-12-12T09:43:18.208 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:18.207+0000 7fb188589640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fb1800c6200 0x7fb18006ab50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:18.208 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:18.207+0000 7fb188589640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1800c49c0 con 0x7fb18006b090 2023-12-12T09:43:18.208 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:18.207+0000 7fb188589640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1800c5d70 con 0x7fb180151e40 2023-12-12T09:43:18.209 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:18.207+0000 7fb188589640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb18006bad0 con 0x7fb1800c6200 2023-12-12T09:43:18.209 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:18.207+0000 7fb185b24640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fb1800c6200 0x7fb18006ab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:18.209 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:18.207+0000 7fb185b24640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fb1800c6200 0x7fb18006ab50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:40014/0 (socket says 172.21.15.73:40014) 2023-12-12T09:43:18.209 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:18.207+0000 7fb185b24640 1 -- 172.21.15.73:0/1419202836 learned_addr learned my addr 172.21.15.73:0/1419202836 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:43:18.209 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:18.207+0000 7fb186b26640 1 --1- 172.21.15.73:0/1419202836 >> v1:172.21.15.73:6789/0 conn(0x7fb18006b090 0x7fb18015ef80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:33404/0 (socket says 172.21.15.73:33404) 2023-12-12T09:43:18.209 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:18.208+0000 7fb185b24640 1 -- 172.21.15.73:0/1419202836 >> v1:172.21.15.142:6789/0 conn(0x7fb180151e40 legacy=0x7fb1800c7cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:43:18.209 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:18.208+0000 7fb185323640 1 -- 172.21.15.73:0/1419202836 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3697509435 0 0) 0x7fb1800c49c0 con 0x7fb18006b090 2023-12-12T09:43:18.210 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:18.208+0000 7fb185b24640 1 -- 172.21.15.73:0/1419202836 >> v1:172.21.15.73:6789/0 conn(0x7fb18006b090 legacy=0x7fb18015ef80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:18.210 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:18.208+0000 7fb185b24640 1 -- 172.21.15.73:0/1419202836 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb180154640 con 0x7fb1800c6200 2023-12-12T09:43:18.210 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:18.209+0000 7fb185b24640 1 --2- 172.21.15.73:0/1419202836 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb1800c6200 0x7fb18006ab50 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fb170009870 tx=0x7fb17002ba30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27c1aa3b981853c7 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:43:18.210 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:18.209+0000 7fb185323640 1 -- 172.21.15.73:0/1419202836 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb17002f850 con 0x7fb1800c6200 2023-12-12T09:43:18.210 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:18.209+0000 7fb185323640 1 -- 172.21.15.73:0/1419202836 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb17002f9b0 con 0x7fb1800c6200 2023-12-12T09:43:18.210 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:18.209+0000 7fb185323640 1 -- 172.21.15.73:0/1419202836 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb17002fd40 con 0x7fb1800c6200 2023-12-12T09:43:18.211 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:18.210+0000 7fb188589640 1 -- 172.21.15.73:0/1419202836 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb1800c6200 msgr2=0x7fb18006ab50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:18.212 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:18.210+0000 7fb188589640 1 --2- 172.21.15.73:0/1419202836 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb1800c6200 0x7fb18006ab50 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fb170009870 tx=0x7fb17002ba30 comp rx=0 tx=0).stop 2023-12-12T09:43:18.212 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:18.210+0000 7fb188589640 1 -- 172.21.15.73:0/1419202836 shutdown_connections 2023-12-12T09:43:18.212 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:18.210+0000 7fb188589640 1 --2- 172.21.15.73:0/1419202836 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb1800c6200 0x7fb18006ab50 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:18.212 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:18.210+0000 7fb188589640 1 -- 172.21.15.73:0/1419202836 >> 172.21.15.73:0/1419202836 conn(0x7fb1800ab8a0 msgr2=0x7fb1800abcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:43:18.212 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:18.210+0000 7fb188589640 1 -- 172.21.15.73:0/1419202836 shutdown_connections 2023-12-12T09:43:18.212 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:18.210+0000 7fb188589640 1 -- 172.21.15.73:0/1419202836 wait complete. 2023-12-12T09:43:18.212 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:18.212+0000 7fb188589640 1 Processor -- start 2023-12-12T09:43:18.212 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:18.212+0000 7fb188589640 1 -- start start 2023-12-12T09:43:18.215 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:18.213+0000 7fb188589640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb18006b090 0x7fb180146e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:18.215 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:18.213+0000 7fb188589640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb1800c6200 0x7fb180156ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:18.215 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:18.213+0000 7fb188589640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb180151e40 0x7fb180156650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:18.215 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:18.213+0000 7fb188589640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1800ad000 con 0x7fb180151e40 2023-12-12T09:43:18.215 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:18.213+0000 7fb188589640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1800ae220 con 0x7fb18006b090 2023-12-12T09:43:18.215 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:18.213+0000 7fb188589640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1800ac9d0 con 0x7fb1800c6200 2023-12-12T09:43:18.215 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:18.213+0000 7fb186b26640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb180151e40 0x7fb180156650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:18.215 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:18.213+0000 7fb186b26640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb180151e40 0x7fb180156650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:40022/0 (socket says 172.21.15.73:40022) 2023-12-12T09:43:18.215 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:18.213+0000 7fb186b26640 1 -- 172.21.15.73:0/3435612373 learned_addr learned my addr 172.21.15.73:0/3435612373 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:43:18.216 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:18.213+0000 7fb186325640 1 --2- 172.21.15.73:0/3435612373 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb18006b090 0x7fb180146e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:18.216 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:18.213+0000 7fb186b26640 1 -- 172.21.15.73:0/3435612373 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb1800c6200 msgr2=0x7fb180156ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:18.216 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:18.213+0000 7fb186b26640 1 --2- 172.21.15.73:0/3435612373 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb1800c6200 0x7fb180156ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:18.216 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:18.214+0000 7fb186b26640 1 -- 172.21.15.73:0/3435612373 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb18006b090 msgr2=0x7fb180146e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:18.216 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:18.214+0000 7fb186b26640 1 --2- 172.21.15.73:0/3435612373 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb18006b090 0x7fb180146e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:18.216 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:18.214+0000 7fb186b26640 1 -- 172.21.15.73:0/3435612373 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1700094d0 con 0x7fb180151e40 2023-12-12T09:43:18.216 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:18.214+0000 7fb186325640 1 --2- 172.21.15.73:0/3435612373 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb18006b090 0x7fb180146e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:43:18.216 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:18.214+0000 7fb186b26640 1 --2- 172.21.15.73:0/3435612373 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb180151e40 0x7fb180156650 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fb17800c7e0 tx=0x7fb17800cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:43:18.216 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:18.214+0000 7fb176ffd640 1 -- 172.21.15.73:0/3435612373 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb17800a640 con 0x7fb180151e40 2023-12-12T09:43:18.216 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:18.214+0000 7fb176ffd640 1 -- 172.21.15.73:0/3435612373 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb17800a7c0 con 0x7fb180151e40 2023-12-12T09:43:18.216 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:18.214+0000 7fb176ffd640 1 -- 172.21.15.73:0/3435612373 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb17800ab70 con 0x7fb180151e40 2023-12-12T09:43:18.216 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:18.214+0000 7fb188589640 1 -- 172.21.15.73:0/3435612373 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1800af1a0 con 0x7fb180151e40 2023-12-12T09:43:18.216 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:18.214+0000 7fb188589640 1 -- 172.21.15.73:0/3435612373 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1800acc20 con 0x7fb180151e40 2023-12-12T09:43:18.217 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:18.216+0000 7fb188589640 1 -- 172.21.15.73:0/3435612373 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb180157590 con 0x7fb180151e40 2023-12-12T09:43:18.217 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:18.216+0000 7fb176ffd640 1 -- 172.21.15.73:0/3435612373 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 4) v1 ==== 89175+0+0 (secure 0 0 0) 0x7fb17800acd0 con 0x7fb180151e40 2023-12-12T09:43:18.218 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:18.217+0000 7fb176ffd640 1 --2- 172.21.15.73:0/3435612373 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fb16406adb0 0x7fb16406d270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:18.218 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:18.217+0000 7fb176ffd640 1 -- 172.21.15.73:0/3435612373 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fb1780887e0 con 0x7fb180151e40 2023-12-12T09:43:18.218 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:18.218+0000 7fb186325640 1 --2- 172.21.15.73:0/3435612373 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fb16406adb0 0x7fb16406d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:18.219 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:18.218+0000 7fb186325640 1 --2- 172.21.15.73:0/3435612373 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fb16406adb0 0x7fb16406d270 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fb1801545e0 tx=0x7fb17c009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:43:18.223 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:18.223+0000 7fb176ffd640 1 -- 172.21.15.73:0/3435612373 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fb178053cb0 con 0x7fb180151e40 2023-12-12T09:43:18.417 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:18.416+0000 7fb188589640 1 -- 172.21.15.73:0/3435612373 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb180067580 con 0x7fb180151e40 2023-12-12T09:43:18.418 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:18.417+0000 7fb176ffd640 1 -- 172.21.15.73:0/3435612373 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) v1 ==== 74+0+12862 (secure 0 0 0) 0x7fb178018070 con 0x7fb180151e40 2023-12-12T09:43:18.418 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-12T09:43:18.419 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":17,"fsid":"ba240992-02b8-4c7e-92f2-27eb29ac433b","created":"2023-12-12T09:43:02.454719+0000","modified":"2023-12-12T09:43:17.960710+0000","last_up_change":"2023-12-12T09:43:13.913440+0000","last_in_change":"2023-12-12T09:43:05.925348+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-12T09:43:15.525508+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"dd9074be-dbe2-4c34-9896-a4223d8d3940","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":4047810203},{"type":"v1","addr":"172.21.15.73:6801","nonce":4047810203}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":4047810203},{"type":"v1","addr":"172.21.15.73:6803","nonce":4047810203}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":4047810203},{"type":"v1","addr":"172.21.15.73:6807","nonce":4047810203}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":4047810203},{"type":"v1","addr":"172.21.15.73:6805","nonce":4047810203}]},"public_addr":"172.21.15.73:6801/4047810203","cluster_addr":"172.21.15.73:6803/4047810203","heartbeat_back_addr":"172.21.15.73:6807/4047810203","heartbeat_front_addr":"172.21.15.73:6805/4047810203","state":["exists","up"]},{"osd":1,"uuid":"c4a05052-96d4-4758-a4e1-1a37f1e07fed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":1356058331},{"type":"v1","addr":"172.21.15.73:6824","nonce":1356058331}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":1356058331},{"type":"v1","addr":"172.21.15.73:6827","nonce":1356058331}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":1356058331},{"type":"v1","addr":"172.21.15.73:6831","nonce":1356058331}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":1356058331},{"type":"v1","addr":"172.21.15.73:6829","nonce":1356058331}]},"public_addr":"172.21.15.73:6824/1356058331","cluster_addr":"172.21.15.73:6827/1356058331","heartbeat_back_addr":"172.21.15.73:6831/1356058331","heartbeat_front_addr":"172.21.15.73:6829/1356058331","state":["exists","up"]},{"osd":2,"uuid":"512bc8ac-72c2-40d4-b3d2-d867a92c5213","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":1228903316},{"type":"v1","addr":"172.21.15.73:6817","nonce":1228903316}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":1228903316},{"type":"v1","addr":"172.21.15.73:6819","nonce":1228903316}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6823","nonce":1228903316},{"type":"v1","addr":"172.21.15.73:6825","nonce":1228903316}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":1228903316},{"type":"v1","addr":"172.21.15.73:6821","nonce":1228903316}]},"public_addr":"172.21.15.73:6817/1228903316","cluster_addr":"172.21.15.73:6819/1228903316","heartbeat_back_addr":"172.21.15.73:6825/1228903316","heartbeat_front_addr":"172.21.15.73:6821/1228903316","state":["exists","up"]},{"osd":3,"uuid":"3d1a91e0-42bf-437a-8eae-8d357c8f63a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":1293329670},{"type":"v1","addr":"172.21.15.73:6809","nonce":1293329670}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6810","nonce":1293329670},{"type":"v1","addr":"172.21.15.73:6811","nonce":1293329670}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":1293329670},{"type":"v1","addr":"172.21.15.73:6815","nonce":1293329670}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":1293329670},{"type":"v1","addr":"172.21.15.73:6813","nonce":1293329670}]},"public_addr":"172.21.15.73:6809/1293329670","cluster_addr":"172.21.15.73:6811/1293329670","heartbeat_back_addr":"172.21.15.73:6815/1293329670","heartbeat_front_addr":"172.21.15.73:6813/1293329670","state":["exists","up"]},{"osd":4,"uuid":"4b302fff-834c-4069-ac19-00e46f6c87b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":3727975702},{"type":"v1","addr":"172.21.15.142:6801","nonce":3727975702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":3727975702},{"type":"v1","addr":"172.21.15.142:6803","nonce":3727975702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6809","nonce":3727975702},{"type":"v1","addr":"172.21.15.142:6811","nonce":3727975702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6805","nonce":3727975702},{"type":"v1","addr":"172.21.15.142:6807","nonce":3727975702}]},"public_addr":"172.21.15.142:6801/3727975702","cluster_addr":"172.21.15.142:6803/3727975702","heartbeat_back_addr":"172.21.15.142:6811/3727975702","heartbeat_front_addr":"172.21.15.142:6807/3727975702","state":["exists","up"]},{"osd":5,"uuid":"d7cdace2-67d0-45cc-95f2-515cf6ef1b82","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6817","nonce":2353193632},{"type":"v1","addr":"172.21.15.142:6819","nonce":2353193632}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6821","nonce":2353193632},{"type":"v1","addr":"172.21.15.142:6823","nonce":2353193632}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6829","nonce":2353193632},{"type":"v1","addr":"172.21.15.142:6831","nonce":2353193632}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6825","nonce":2353193632},{"type":"v1","addr":"172.21.15.142:6827","nonce":2353193632}]},"public_addr":"172.21.15.142:6819/2353193632","cluster_addr":"172.21.15.142:6823/2353193632","heartbeat_back_addr":"172.21.15.142:6831/2353193632","heartbeat_front_addr":"172.21.15.142:6827/2353193632","state":["exists","up"]},{"osd":6,"uuid":"649ce78a-5626-445c-aedc-a651ed05a6f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":2006111986},{"type":"v1","addr":"172.21.15.142:6806","nonce":2006111986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":2006111986},{"type":"v1","addr":"172.21.15.142:6810","nonce":2006111986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":2006111986},{"type":"v1","addr":"172.21.15.142:6815","nonce":2006111986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":2006111986},{"type":"v1","addr":"172.21.15.142:6813","nonce":2006111986}]},"public_addr":"172.21.15.142:6806/2006111986","cluster_addr":"172.21.15.142:6810/2006111986","heartbeat_back_addr":"172.21.15.142:6815/2006111986","heartbeat_front_addr":"172.21.15.142:6813/2006111986","state":["exists","up"]},{"osd":7,"uuid":"af15ae3b-c1d0-4acf-92db-8a1805494d13","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":2573794341},{"type":"v1","addr":"172.21.15.142:6818","nonce":2573794341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":2573794341},{"type":"v1","addr":"172.21.15.142:6822","nonce":2573794341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":2573794341},{"type":"v1","addr":"172.21.15.142:6830","nonce":2573794341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":2573794341},{"type":"v1","addr":"172.21.15.142:6826","nonce":2573794341}]},"public_addr":"172.21.15.142:6818/2573794341","cluster_addr":"172.21.15.142:6822/2573794341","heartbeat_back_addr":"172.21.15.142:6830/2573794341","heartbeat_front_addr":"172.21.15.142:6826/2573794341","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.185824+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.262103+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.225556+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:10.523459+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:10.706035+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.257339+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.301776+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.051960+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-12T09:43:18.421 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:18.420+0000 7fb188589640 1 -- 172.21.15.73:0/3435612373 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fb16406adb0 msgr2=0x7fb16406d270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:18.421 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:18.420+0000 7fb188589640 1 --2- 172.21.15.73:0/3435612373 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fb16406adb0 0x7fb16406d270 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fb1801545e0 tx=0x7fb17c009040 comp rx=0 tx=0).stop 2023-12-12T09:43:18.421 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:18.420+0000 7fb188589640 1 -- 172.21.15.73:0/3435612373 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb180151e40 msgr2=0x7fb180156650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:18.421 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:18.420+0000 7fb188589640 1 --2- 172.21.15.73:0/3435612373 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb180151e40 0x7fb180156650 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fb17800c7e0 tx=0x7fb17800cca0 comp rx=0 tx=0).stop 2023-12-12T09:43:18.422 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:18.420+0000 7fb188589640 1 -- 172.21.15.73:0/3435612373 shutdown_connections 2023-12-12T09:43:18.422 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:18.420+0000 7fb188589640 1 --2- 172.21.15.73:0/3435612373 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fb16406adb0 0x7fb16406d270 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:18.422 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:18.420+0000 7fb188589640 1 --2- 172.21.15.73:0/3435612373 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb180151e40 0x7fb180156650 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:18.422 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:18.420+0000 7fb188589640 1 --2- 172.21.15.73:0/3435612373 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb1800c6200 0x7fb180156ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:18.422 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:18.420+0000 7fb188589640 1 --2- 172.21.15.73:0/3435612373 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb18006b090 0x7fb180146e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:18.422 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:18.420+0000 7fb188589640 1 -- 172.21.15.73:0/3435612373 >> 172.21.15.73:0/3435612373 conn(0x7fb1800ab8a0 msgr2=0x7fb18014aad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:43:18.422 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:18.420+0000 7fb188589640 1 -- 172.21.15.73:0/3435612373 shutdown_connections 2023-12-12T09:43:18.422 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:18.420+0000 7fb188589640 1 -- 172.21.15.73:0/3435612373 wait complete. 2023-12-12T09:43:18.438 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-12T09:43:15.525508+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-12T09:43:18.438 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-12T09:43:18.678 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:18.677+0000 7f711b1be640 1 Processor -- start 2023-12-12T09:43:18.679 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:18.678+0000 7f711b1be640 1 -- start start 2023-12-12T09:43:18.680 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:18.679+0000 7f711b1be640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f711406d350 0x7f711406dc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:18.680 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:18.679+0000 7f711b1be640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71140c16c0 con 0x7f711414f8c0 2023-12-12T09:43:18.680 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:18.679+0000 7f711b1be640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71140c19a0 con 0x7f7114152500 2023-12-12T09:43:18.680 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:18.679+0000 7f711b1be640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71140c1090 con 0x7f711406d350 2023-12-12T09:43:18.680 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:18.679+0000 7f7118f5a640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f711414f8c0 0x7f7114071e60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:33412/0 (socket says 172.21.15.73:33412) 2023-12-12T09:43:18.680 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:18.679+0000 7f7118f5a640 1 -- 172.21.15.73:0/3923619666 learned_addr learned my addr 172.21.15.73:0/3923619666 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-12T09:43:18.682 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:18.679+0000 7f7113fff640 1 --2- 172.21.15.73:0/3923619666 >> v2:172.21.15.142:3300/0 conn(0x7f711406d350 0x7f711406dc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:18.682 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:18.679+0000 7f71137fe640 1 -- 172.21.15.73:0/3923619666 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4005029948 0 0) 0x7f71140c16c0 con 0x7f711414f8c0 2023-12-12T09:43:18.682 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:18.679+0000 7f71137fe640 1 -- 172.21.15.73:0/3923619666 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7104003520 con 0x7f711414f8c0 2023-12-12T09:43:18.682 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:18.680+0000 7f71137fe640 1 -- 172.21.15.73:0/3923619666 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2750026071 0 0) 0x7f7104003520 con 0x7f711414f8c0 2023-12-12T09:43:18.682 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:18.680+0000 7f71137fe640 1 -- 172.21.15.73:0/3923619666 >> v2:172.21.15.142:3300/0 conn(0x7f711406d350 msgr2=0x7f711406dc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:43:18.682 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:18.680+0000 7f71137fe640 1 --2- 172.21.15.73:0/3923619666 >> v2:172.21.15.142:3300/0 conn(0x7f711406d350 0x7f711406dc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:18.682 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:18.680+0000 7f71137fe640 1 -- 172.21.15.73:0/3923619666 >> v1:172.21.15.142:6789/0 conn(0x7f7114152500 legacy=0x7f7114152990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:18.682 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:18.680+0000 7f71137fe640 1 -- 172.21.15.73:0/3923619666 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71140c1c80 con 0x7f711414f8c0 2023-12-12T09:43:18.682 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:18.680+0000 7f71137fe640 1 -- 172.21.15.73:0/3923619666 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3186547832 0 0) 0x7f7108001670 con 0x7f711414f8c0 2023-12-12T09:43:18.682 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:18.680+0000 7f71137fe640 1 -- 172.21.15.73:0/3923619666 >> v1:172.21.15.73:6789/0 conn(0x7f711414f8c0 legacy=0x7f7114071e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:18.682 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:18.680+0000 7f71137fe640 1 --2- 172.21.15.73:0/3923619666 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7104003970 0x7f7104003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:18.683 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:18.680+0000 7f71137fe640 1 --2- 172.21.15.73:0/3923619666 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f71040047c0 0x7f7104004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:18.683 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:18.680+0000 7f71137fe640 1 --2- 172.21.15.73:0/3923619666 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7104005180 0x7f710400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:18.683 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:18.680+0000 7f71137fe640 1 -- 172.21.15.73:0/3923619666 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f710400bff0 con 0x7f71040047c0 2023-12-12T09:43:18.683 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:18.680+0000 7f71137fe640 1 -- 172.21.15.73:0/3923619666 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f710400c160 con 0x7f7104005180 2023-12-12T09:43:18.683 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:18.680+0000 7f71137fe640 1 -- 172.21.15.73:0/3923619666 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f710400c320 con 0x7f7104003970 2023-12-12T09:43:18.683 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:18.680+0000 7f7113fff640 1 --2- 172.21.15.73:0/3923619666 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f71040047c0 0x7f7104004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:18.683 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:18.680+0000 7f7118f5a640 1 --2- 172.21.15.73:0/3923619666 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7104003970 0x7f7104003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:18.683 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:18.681+0000 7f711975b640 1 --2- 172.21.15.73:0/3923619666 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7104005180 0x7f710400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:18.683 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:18.681+0000 7f7113fff640 1 -- 172.21.15.73:0/3923619666 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7104003970 msgr2=0x7f7104003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:43:18.683 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:18.681+0000 7f7113fff640 1 --2- 172.21.15.73:0/3923619666 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7104003970 0x7f7104003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:18.683 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:18.681+0000 7f7113fff640 1 -- 172.21.15.73:0/3923619666 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7104005180 msgr2=0x7f710400b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:43:18.683 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:18.681+0000 7f7113fff640 1 --2- 172.21.15.73:0/3923619666 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7104005180 0x7f710400b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:18.683 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:18.681+0000 7f7113fff640 1 -- 172.21.15.73:0/3923619666 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7104003520 con 0x7f71040047c0 2023-12-12T09:43:18.683 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:18.681+0000 7f711975b640 1 -- 172.21.15.73:0/3923619666 reap_dead start 2023-12-12T09:43:18.685 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:18.682+0000 7f7113fff640 1 --2- 172.21.15.73:0/3923619666 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f71040047c0 0x7f7104004c40 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f7100009ac0 tx=0x7f71040057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f29a99bb3d87b3 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:43:18.685 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:18.682+0000 7f71137fe640 1 -- 172.21.15.73:0/3923619666 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f710002c6b0 con 0x7f71040047c0 2023-12-12T09:43:18.685 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:18.682+0000 7f71137fe640 1 -- 172.21.15.73:0/3923619666 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f710002c810 con 0x7f71040047c0 2023-12-12T09:43:18.685 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:18.682+0000 7f71137fe640 1 -- 172.21.15.73:0/3923619666 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f710002cba0 con 0x7f71040047c0 2023-12-12T09:43:18.685 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:18.683+0000 7f711b1be640 1 -- 172.21.15.73:0/3923619666 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f71040047c0 msgr2=0x7f7104004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:18.685 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:18.683+0000 7f711b1be640 1 --2- 172.21.15.73:0/3923619666 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f71040047c0 0x7f7104004c40 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f7100009ac0 tx=0x7f71040057f0 comp rx=0 tx=0).stop 2023-12-12T09:43:18.685 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:18.683+0000 7f711b1be640 1 -- 172.21.15.73:0/3923619666 shutdown_connections 2023-12-12T09:43:18.685 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:18.683+0000 7f711b1be640 1 --2- 172.21.15.73:0/3923619666 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f71040047c0 0x7f7104004c40 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:18.685 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:18.683+0000 7f711b1be640 1 -- 172.21.15.73:0/3923619666 >> 172.21.15.73:0/3923619666 conn(0x7f711406a4e0 msgr2=0x7f711406a8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:43:18.685 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:18.683+0000 7f711b1be640 1 -- 172.21.15.73:0/3923619666 shutdown_connections 2023-12-12T09:43:18.685 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:18.683+0000 7f711b1be640 1 -- 172.21.15.73:0/3923619666 wait complete. 2023-12-12T09:43:18.686 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:18.685+0000 7f711b1be640 1 Processor -- start 2023-12-12T09:43:18.686 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:18.685+0000 7f711b1be640 1 -- start start 2023-12-12T09:43:18.687 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:18.686+0000 7f711b1be640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f71040047c0 0x7f7114070660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:18.688 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:18.686+0000 7f711b1be640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7114071050 0x7f71140bed50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:18.688 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:18.686+0000 7f711b1be640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f71140bf290 0x7f7114142730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:18.688 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:18.686+0000 7f711b1be640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7114149c10 con 0x7f7114071050 2023-12-12T09:43:18.688 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:18.686+0000 7f711b1be640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f711414c6a0 con 0x7f71140bf290 2023-12-12T09:43:18.688 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:18.686+0000 7f711b1be640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71140715c0 con 0x7f71040047c0 2023-12-12T09:43:18.688 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:18.686+0000 7f7113fff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7114071050 0x7f71140bed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:18.688 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:18.686+0000 7f7113fff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7114071050 0x7f71140bed50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:40036/0 (socket says 172.21.15.73:40036) 2023-12-12T09:43:18.688 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:18.686+0000 7f7113fff640 1 -- 172.21.15.73:0/3932976269 learned_addr learned my addr 172.21.15.73:0/3932976269 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:43:18.688 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:18.687+0000 7f7118f5a640 1 --2- 172.21.15.73:0/3932976269 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f71040047c0 0x7f7114070660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:18.688 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:18.687+0000 7f711975b640 1 --2- 172.21.15.73:0/3932976269 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f71140bf290 0x7f7114142730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:18.688 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:18.687+0000 7f7113fff640 1 -- 172.21.15.73:0/3932976269 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f71040047c0 msgr2=0x7f7114070660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:18.688 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:18.687+0000 7f7113fff640 1 --2- 172.21.15.73:0/3932976269 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f71040047c0 0x7f7114070660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:18.688 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:18.687+0000 7f7113fff640 1 -- 172.21.15.73:0/3932976269 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f71140bf290 msgr2=0x7f7114142730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:18.688 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:18.687+0000 7f7113fff640 1 --2- 172.21.15.73:0/3932976269 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f71140bf290 0x7f7114142730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:18.689 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:18.687+0000 7f7113fff640 1 -- 172.21.15.73:0/3932976269 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f711414af30 con 0x7f7114071050 2023-12-12T09:43:18.689 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:18.687+0000 7f7113fff640 1 --2- 172.21.15.73:0/3932976269 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7114071050 0x7f71140bed50 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f710002c250 tx=0x7f7100004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:43:18.689 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:18.687+0000 7f71117fa640 1 -- 172.21.15.73:0/3932976269 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7100003810 con 0x7f7114071050 2023-12-12T09:43:18.690 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:18.687+0000 7f71117fa640 1 -- 172.21.15.73:0/3932976269 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7100003970 con 0x7f7114071050 2023-12-12T09:43:18.690 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:18.687+0000 7f711b1be640 1 -- 172.21.15.73:0/3932976269 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f711414b210 con 0x7f7114071050 2023-12-12T09:43:18.690 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:18.687+0000 7f71117fa640 1 -- 172.21.15.73:0/3932976269 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7100003d00 con 0x7f7114071050 2023-12-12T09:43:18.690 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:18.688+0000 7f711b1be640 1 -- 172.21.15.73:0/3932976269 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7114070ba0 con 0x7f7114071050 2023-12-12T09:43:18.690 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:18.689+0000 7f711b1be640 1 -- 172.21.15.73:0/3932976269 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f711414ad70 con 0x7f7114071050 2023-12-12T09:43:18.690 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:18.689+0000 7f71117fa640 1 -- 172.21.15.73:0/3932976269 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 4) v1 ==== 89175+0+0 (secure 0 0 0) 0x7f7100047450 con 0x7f7114071050 2023-12-12T09:43:18.691 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:18.691+0000 7f71117fa640 1 --2- 172.21.15.73:0/3932976269 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f70f806adb0 0x7f70f806d270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:18.692 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:18.691+0000 7f71117fa640 1 -- 172.21.15.73:0/3932976269 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f71000ab4e0 con 0x7f7114071050 2023-12-12T09:43:18.692 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:18.691+0000 7f7118f5a640 1 --2- 172.21.15.73:0/3932976269 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f70f806adb0 0x7f70f806d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:18.692 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:18.692+0000 7f7118f5a640 1 --2- 172.21.15.73:0/3932976269 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f70f806adb0 0x7f70f806d270 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f7108001c90 tx=0x7f7108009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:43:18.696 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:18.695+0000 7f71117fa640 1 -- 172.21.15.73:0/3932976269 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f7100076b80 con 0x7f7114071050 2023-12-12T09:43:18.885 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:18.884+0000 7f711b1be640 1 -- 172.21.15.73:0/3932976269 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f7114067070 con 0x7f7114071050 2023-12-12T09:43:18.886 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:18.885+0000 7f71117fa640 1 -- 172.21.15.73:0/3932976269 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v17) v1 ==== 93+0+10 (secure 0 0 0) 0x7f7100003e60 con 0x7f7114071050 2023-12-12T09:43:18.886 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 1 2023-12-12T09:43:18.890 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:18.888+0000 7f711b1be640 1 -- 172.21.15.73:0/3932976269 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f70f806adb0 msgr2=0x7f70f806d270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:18.890 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:18.888+0000 7f711b1be640 1 --2- 172.21.15.73:0/3932976269 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f70f806adb0 0x7f70f806d270 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f7108001c90 tx=0x7f7108009040 comp rx=0 tx=0).stop 2023-12-12T09:43:18.890 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:18.888+0000 7f711b1be640 1 -- 172.21.15.73:0/3932976269 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7114071050 msgr2=0x7f71140bed50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:18.890 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:18.888+0000 7f711b1be640 1 --2- 172.21.15.73:0/3932976269 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7114071050 0x7f71140bed50 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f710002c250 tx=0x7f7100004730 comp rx=0 tx=0).stop 2023-12-12T09:43:18.890 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:18.889+0000 7f711b1be640 1 -- 172.21.15.73:0/3932976269 shutdown_connections 2023-12-12T09:43:18.890 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:18.889+0000 7f711b1be640 1 --2- 172.21.15.73:0/3932976269 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f70f806adb0 0x7f70f806d270 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:18.890 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:18.889+0000 7f711b1be640 1 --2- 172.21.15.73:0/3932976269 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f71140bf290 0x7f7114142730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:18.890 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:18.889+0000 7f711b1be640 1 --2- 172.21.15.73:0/3932976269 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7114071050 0x7f71140bed50 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:18.891 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:18.889+0000 7f711b1be640 1 --2- 172.21.15.73:0/3932976269 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f71040047c0 0x7f7114070660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:18.891 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:18.889+0000 7f711b1be640 1 -- 172.21.15.73:0/3932976269 >> 172.21.15.73:0/3932976269 conn(0x7f711406a4e0 msgr2=0x7f711406aa00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:43:18.891 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:18.889+0000 7f711b1be640 1 -- 172.21.15.73:0/3932976269 shutdown_connections 2023-12-12T09:43:18.891 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:18.889+0000 7f711b1be640 1 -- 172.21.15.73:0/3932976269 wait complete. 2023-12-12T09:43:18.912 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-12-12T09:43:19.122 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:19.121+0000 7feb1878a640 1 Processor -- start 2023-12-12T09:43:19.122 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:19.121+0000 7feb1878a640 1 -- start start 2023-12-12T09:43:19.123 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:19.122+0000 7feb1878a640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7feb1014fa40 0x7feb1006a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:19.123 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:19.122+0000 7feb1878a640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7feb1006db70 0x7feb100c39b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:19.123 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:19.122+0000 7feb1878a640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb10152610 con 0x7feb100c5070 2023-12-12T09:43:19.123 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:19.122+0000 7feb1878a640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb101528f0 con 0x7feb1006db70 2023-12-12T09:43:19.123 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:19.122+0000 7feb1878a640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb10152bd0 con 0x7feb1014fa40 2023-12-12T09:43:19.124 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:19.123+0000 7feb16526640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7feb1014fa40 0x7feb1006a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:19.124 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:19.123+0000 7feb16526640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7feb1014fa40 0x7feb1006a4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.73:43762/0 (socket says 172.21.15.73:43762) 2023-12-12T09:43:19.124 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:19.123+0000 7feb16526640 1 -- 172.21.15.73:0/1629255663 learned_addr learned my addr 172.21.15.73:0/1629255663 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:43:19.125 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:19.123+0000 7feb15d25640 1 --2- 172.21.15.73:0/1629255663 >> v2:172.21.15.142:3300/0 conn(0x7feb1006db70 0x7feb100c39b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:19.125 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:19.123+0000 7feb16526640 1 -- 172.21.15.73:0/1629255663 >> v2:172.21.15.142:3300/0 conn(0x7feb1006db70 msgr2=0x7feb100c39b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:43:19.125 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:19.123+0000 7feb16526640 1 --2- 172.21.15.73:0/1629255663 >> v2:172.21.15.142:3300/0 conn(0x7feb1006db70 0x7feb100c39b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:19.125 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:19.123+0000 7feb16526640 1 -- 172.21.15.73:0/1629255663 >> v1:172.21.15.142:6789/0 conn(0x7feb100c5070 legacy=0x7feb100c3ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:19.125 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:19.123+0000 7feb16526640 1 -- 172.21.15.73:0/1629255663 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb10152eb0 con 0x7feb1014fa40 2023-12-12T09:43:19.125 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:19.125+0000 7feb16526640 1 --2- 172.21.15.73:0/1629255663 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7feb1014fa40 0x7feb1006a4e0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7feb0c009870 tx=0x7feb0c02b980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9864a33e0ca251c8 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:43:19.126 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:19.125+0000 7feb15524640 1 -- 172.21.15.73:0/1629255663 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb0c030840 con 0x7feb1014fa40 2023-12-12T09:43:19.126 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:19.125+0000 7feb15524640 1 -- 172.21.15.73:0/1629255663 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb0c0309a0 con 0x7feb1014fa40 2023-12-12T09:43:19.126 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:19.125+0000 7feb15524640 1 -- 172.21.15.73:0/1629255663 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb0c030d30 con 0x7feb1014fa40 2023-12-12T09:43:19.127 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:19.126+0000 7feb1878a640 1 -- 172.21.15.73:0/1629255663 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7feb1014fa40 msgr2=0x7feb1006a4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:19.127 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:19.126+0000 7feb1878a640 1 --2- 172.21.15.73:0/1629255663 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7feb1014fa40 0x7feb1006a4e0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7feb0c009870 tx=0x7feb0c02b980 comp rx=0 tx=0).stop 2023-12-12T09:43:19.127 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:19.126+0000 7feb1878a640 1 -- 172.21.15.73:0/1629255663 shutdown_connections 2023-12-12T09:43:19.127 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:19.126+0000 7feb1878a640 1 --2- 172.21.15.73:0/1629255663 >> v2:172.21.15.142:3300/0 conn(0x7feb1006db70 0x7feb100c39b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:19.127 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:19.126+0000 7feb1878a640 1 --2- 172.21.15.73:0/1629255663 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7feb1014fa40 0x7feb1006a4e0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:19.127 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:19.126+0000 7feb1878a640 1 -- 172.21.15.73:0/1629255663 >> 172.21.15.73:0/1629255663 conn(0x7feb100a8130 msgr2=0x7feb100c24b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:43:19.127 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:19.126+0000 7feb1878a640 1 -- 172.21.15.73:0/1629255663 shutdown_connections 2023-12-12T09:43:19.127 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:19.126+0000 7feb1878a640 1 -- 172.21.15.73:0/1629255663 wait complete. 2023-12-12T09:43:19.128 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:19.128+0000 7feb1878a640 1 Processor -- start 2023-12-12T09:43:19.129 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:19.128+0000 7feb1878a640 1 -- start start 2023-12-12T09:43:19.130 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:19.129+0000 7feb1878a640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7feb1006db70 0x7feb100bc540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:19.130 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:19.129+0000 7feb1878a640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7feb100c5070 0x7feb101eb920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:19.130 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:19.129+0000 7feb1878a640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7feb1014fa40 0x7feb100a6b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:19.130 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:19.129+0000 7feb1878a640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb101e7e70 con 0x7feb1014fa40 2023-12-12T09:43:19.130 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:19.129+0000 7feb1878a640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb100bbbf0 con 0x7feb100c5070 2023-12-12T09:43:19.130 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:19.129+0000 7feb1878a640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb101ebe60 con 0x7feb1006db70 2023-12-12T09:43:19.130 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:19.129+0000 7feb16d27640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7feb1014fa40 0x7feb100a6b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:19.130 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:19.129+0000 7feb16d27640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7feb1014fa40 0x7feb100a6b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:41086/0 (socket says 172.21.15.73:41086) 2023-12-12T09:43:19.131 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:19.129+0000 7feb16d27640 1 -- 172.21.15.73:0/1911175023 learned_addr learned my addr 172.21.15.73:0/1911175023 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:43:19.131 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:19.129+0000 7feb16526640 1 --2- 172.21.15.73:0/1911175023 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7feb1006db70 0x7feb100bc540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:19.131 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:19.129+0000 7feb15d25640 1 --2- 172.21.15.73:0/1911175023 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7feb100c5070 0x7feb101eb920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:19.132 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:19.130+0000 7feb16d27640 1 -- 172.21.15.73:0/1911175023 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7feb1006db70 msgr2=0x7feb100bc540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:19.132 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:19.130+0000 7feb16d27640 1 --2- 172.21.15.73:0/1911175023 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7feb1006db70 0x7feb100bc540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:19.132 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:19.130+0000 7feb16d27640 1 -- 172.21.15.73:0/1911175023 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7feb100c5070 msgr2=0x7feb101eb920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:19.132 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:19.130+0000 7feb16d27640 1 --2- 172.21.15.73:0/1911175023 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7feb100c5070 0x7feb101eb920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:19.132 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:19.130+0000 7feb16d27640 1 -- 172.21.15.73:0/1911175023 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb0c0094d0 con 0x7feb1014fa40 2023-12-12T09:43:19.132 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:19.130+0000 7feb16d27640 1 --2- 172.21.15.73:0/1911175023 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7feb1014fa40 0x7feb100a6b40 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7feb0800c7d0 tx=0x7feb0800cc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:43:19.132 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:19.130+0000 7feb06ffd640 1 -- 172.21.15.73:0/1911175023 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb08003b70 con 0x7feb1014fa40 2023-12-12T09:43:19.132 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:19.130+0000 7feb06ffd640 1 -- 172.21.15.73:0/1911175023 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb08003cf0 con 0x7feb1014fa40 2023-12-12T09:43:19.132 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:19.130+0000 7feb06ffd640 1 -- 172.21.15.73:0/1911175023 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb0800aa90 con 0x7feb1014fa40 2023-12-12T09:43:19.132 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:19.130+0000 7feb1878a640 1 -- 172.21.15.73:0/1911175023 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb100bb630 con 0x7feb1014fa40 2023-12-12T09:43:19.132 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:19.130+0000 7feb1878a640 1 -- 172.21.15.73:0/1911175023 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb101e7b00 con 0x7feb1014fa40 2023-12-12T09:43:19.133 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:19.131+0000 7feb1878a640 1 -- 172.21.15.73:0/1911175023 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb101e8020 con 0x7feb1014fa40 2023-12-12T09:43:19.133 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:19.132+0000 7feb06ffd640 1 -- 172.21.15.73:0/1911175023 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 4) v1 ==== 89175+0+0 (secure 0 0 0) 0x7feb0800abf0 con 0x7feb1014fa40 2023-12-12T09:43:19.134 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:19.134+0000 7feb06ffd640 1 --2- 172.21.15.73:0/1911175023 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7feaf406adb0 0x7feaf406d270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:19.134 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:19.134+0000 7feb06ffd640 1 -- 172.21.15.73:0/1911175023 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7feb08088fe0 con 0x7feb1014fa40 2023-12-12T09:43:19.135 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:19.134+0000 7feb16526640 1 --2- 172.21.15.73:0/1911175023 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7feaf406adb0 0x7feaf406d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:19.135 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:19.135+0000 7feb16526640 1 --2- 172.21.15.73:0/1911175023 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7feaf406adb0 0x7feaf406d270 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7feb0c036000 tx=0x7feb0c008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:43:19.139 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:19.138+0000 7feb06ffd640 1 -- 172.21.15.73:0/1911175023 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7feb101e8020 con 0x7feb1014fa40 2023-12-12T09:43:19.331 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:19.330+0000 7feb1878a640 1 -- 172.21.15.73:0/1911175023 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7feb101e8020 con 0x7feb1014fa40 2023-12-12T09:43:19.331 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:19.330+0000 7feb06ffd640 1 -- 172.21.15.73:0/1911175023 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v17) v1 ==== 84+0+65 (secure 0 0 0) 0x7feb101e8020 con 0x7feb1014fa40 2023-12-12T09:43:19.331 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-12T09:43:19.332 INFO:teuthology.orchestra.run.smithi073.stdout:[ 2023-12-12T09:43:19.332 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-12-12T09:43:19.332 INFO:teuthology.orchestra.run.smithi073.stdout: "poolnum": 1, 2023-12-12T09:43:19.332 INFO:teuthology.orchestra.run.smithi073.stdout: "poolname": ".mgr" 2023-12-12T09:43:19.332 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-12-12T09:43:19.332 INFO:teuthology.orchestra.run.smithi073.stdout:] 2023-12-12T09:43:19.334 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:19.333+0000 7feb1878a640 1 -- 172.21.15.73:0/1911175023 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7feaf406adb0 msgr2=0x7feaf406d270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:19.334 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:19.333+0000 7feb1878a640 1 --2- 172.21.15.73:0/1911175023 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7feaf406adb0 0x7feaf406d270 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7feb0c036000 tx=0x7feb0c008030 comp rx=0 tx=0).stop 2023-12-12T09:43:19.335 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:19.333+0000 7feb1878a640 1 -- 172.21.15.73:0/1911175023 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7feb1014fa40 msgr2=0x7feb100a6b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:19.335 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:19.333+0000 7feb1878a640 1 --2- 172.21.15.73:0/1911175023 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7feb1014fa40 0x7feb100a6b40 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7feb0800c7d0 tx=0x7feb0800cc90 comp rx=0 tx=0).stop 2023-12-12T09:43:19.335 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:19.333+0000 7feb1878a640 1 -- 172.21.15.73:0/1911175023 shutdown_connections 2023-12-12T09:43:19.335 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:19.333+0000 7feb1878a640 1 --2- 172.21.15.73:0/1911175023 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7feaf406adb0 0x7feaf406d270 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:19.335 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:19.333+0000 7feb1878a640 1 --2- 172.21.15.73:0/1911175023 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7feb1014fa40 0x7feb100a6b40 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:19.335 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:19.333+0000 7feb1878a640 1 --2- 172.21.15.73:0/1911175023 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7feb100c5070 0x7feb101eb920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:19.335 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:19.333+0000 7feb1878a640 1 --2- 172.21.15.73:0/1911175023 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7feb1006db70 0x7feb100bc540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:19.335 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:19.333+0000 7feb1878a640 1 -- 172.21.15.73:0/1911175023 >> 172.21.15.73:0/1911175023 conn(0x7feb100a8130 msgr2=0x7feb100c18a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:43:19.335 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:19.333+0000 7feb1878a640 1 -- 172.21.15.73:0/1911175023 shutdown_connections 2023-12-12T09:43:19.335 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:19.333+0000 7feb1878a640 1 -- 172.21.15.73:0/1911175023 wait complete. 2023-12-12T09:43:19.352 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-12-12T09:43:19.352 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-12-12T09:43:19.575 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:19.573+0000 7f6c9ea1e640 1 Processor -- start 2023-12-12T09:43:19.575 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:19.574+0000 7f6c9ea1e640 1 -- start start 2023-12-12T09:43:19.577 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:19.575+0000 7f6c9ea1e640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f6c980c4d50 0x7f6c98157c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:19.577 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:19.575+0000 7f6c9ea1e640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6c980c2320 0x7f6c980c27b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:19.577 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:19.575+0000 7f6c9ea1e640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c981557b0 con 0x7f6c981553d0 2023-12-12T09:43:19.577 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:19.575+0000 7f6c9ea1e640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c98158b30 con 0x7f6c980c4d50 2023-12-12T09:43:19.577 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:19.575+0000 7f6c9ea1e640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c980c60d0 con 0x7f6c980c2320 2023-12-12T09:43:19.578 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:19.575+0000 7f6c97fff640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f6c981553d0 0x7f6c9806a4e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:37250/0 (socket says 172.21.15.73:37250) 2023-12-12T09:43:19.578 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:19.575+0000 7f6c97fff640 1 -- 172.21.15.73:0/1409305049 learned_addr learned my addr 172.21.15.73:0/1409305049 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-12T09:43:19.578 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:19.576+0000 7f6c9cfbb640 1 --2- 172.21.15.73:0/1409305049 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6c980c2320 0x7f6c980c27b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:19.578 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:19.576+0000 7f6c977fe640 1 --2- 172.21.15.73:0/1409305049 >> v2:172.21.15.73:3300/0 conn(0x7f6c980c4d50 0x7f6c98157c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:19.578 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:19.576+0000 7f6c96ffd640 1 -- 172.21.15.73:0/1409305049 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 838800615 0 0) 0x7f6c981557b0 con 0x7f6c981553d0 2023-12-12T09:43:19.578 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:19.576+0000 7f6c96ffd640 1 -- 172.21.15.73:0/1409305049 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6c84003520 con 0x7f6c981553d0 2023-12-12T09:43:19.578 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:19.576+0000 7f6c9cfbb640 1 -- 172.21.15.73:0/1409305049 >> v2:172.21.15.73:3300/0 conn(0x7f6c980c4d50 msgr2=0x7f6c98157c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:43:19.578 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:19.576+0000 7f6c9cfbb640 1 --2- 172.21.15.73:0/1409305049 >> v2:172.21.15.73:3300/0 conn(0x7f6c980c4d50 0x7f6c98157c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:19.578 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:19.576+0000 7f6c9cfbb640 1 -- 172.21.15.73:0/1409305049 >> v1:172.21.15.73:6789/0 conn(0x7f6c981553d0 legacy=0x7f6c9806a4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:19.578 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:19.576+0000 7f6c9cfbb640 1 -- 172.21.15.73:0/1409305049 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c980c1e90 con 0x7f6c980c2320 2023-12-12T09:43:19.579 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:19.577+0000 7f6c9cfbb640 1 --2- 172.21.15.73:0/1409305049 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6c980c2320 0x7f6c980c27b0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f6c900097a0 tx=0x7f6c9002b8b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cb6c077f151388dc server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:43:19.579 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:19.578+0000 7f6c96ffd640 1 -- 172.21.15.73:0/1409305049 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c9002d040 con 0x7f6c980c2320 2023-12-12T09:43:19.580 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:19.578+0000 7f6c96ffd640 1 -- 172.21.15.73:0/1409305049 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c90031810 con 0x7f6c980c2320 2023-12-12T09:43:19.580 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:19.578+0000 7f6c96ffd640 1 -- 172.21.15.73:0/1409305049 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c90031ba0 con 0x7f6c980c2320 2023-12-12T09:43:19.580 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:19.578+0000 7f6c9ea1e640 1 -- 172.21.15.73:0/1409305049 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6c980c2320 msgr2=0x7f6c980c27b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:19.580 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:19.578+0000 7f6c9ea1e640 1 --2- 172.21.15.73:0/1409305049 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6c980c2320 0x7f6c980c27b0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f6c900097a0 tx=0x7f6c9002b8b0 comp rx=0 tx=0).stop 2023-12-12T09:43:19.580 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:19.578+0000 7f6c9ea1e640 1 -- 172.21.15.73:0/1409305049 shutdown_connections 2023-12-12T09:43:19.580 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:19.578+0000 7f6c9ea1e640 1 --2- 172.21.15.73:0/1409305049 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6c980c2320 0x7f6c980c27b0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:19.580 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:19.578+0000 7f6c9ea1e640 1 --2- 172.21.15.73:0/1409305049 >> v2:172.21.15.73:3300/0 conn(0x7f6c980c4d50 0x7f6c98157c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:19.580 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:19.578+0000 7f6c9ea1e640 1 -- 172.21.15.73:0/1409305049 >> 172.21.15.73:0/1409305049 conn(0x7f6c980c6ab0 msgr2=0x7f6c980c6e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:43:19.580 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:19.578+0000 7f6c9ea1e640 1 -- 172.21.15.73:0/1409305049 shutdown_connections 2023-12-12T09:43:19.580 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:19.578+0000 7f6c9ea1e640 1 -- 172.21.15.73:0/1409305049 wait complete. 2023-12-12T09:43:19.581 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:19.580+0000 7f6c9ea1e640 1 Processor -- start 2023-12-12T09:43:19.581 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:19.580+0000 7f6c9ea1e640 1 -- start start 2023-12-12T09:43:19.583 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:19.581+0000 7f6c9ea1e640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6c980c2320 0x7f6c980999d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:19.583 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:19.581+0000 7f6c9ea1e640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6c980c4d50 0x7f6c98156c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:19.583 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:19.581+0000 7f6c9ea1e640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6c981553d0 0x7f6c98150dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:19.583 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:19.581+0000 7f6c9ea1e640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c980ab7e0 con 0x7f6c980c2320 2023-12-12T09:43:19.583 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:19.581+0000 7f6c9ea1e640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c980aa480 con 0x7f6c981553d0 2023-12-12T09:43:19.584 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:19.581+0000 7f6c9ea1e640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c980aa760 con 0x7f6c980c4d50 2023-12-12T09:43:19.584 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:19.581+0000 7f6c97fff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6c980c2320 0x7f6c980999d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:19.584 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:19.581+0000 7f6c97fff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6c980c2320 0x7f6c980999d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:41118/0 (socket says 172.21.15.73:41118) 2023-12-12T09:43:19.584 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:19.581+0000 7f6c97fff640 1 -- 172.21.15.73:0/2789751775 learned_addr learned my addr 172.21.15.73:0/2789751775 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:43:19.584 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:19.582+0000 7f6c9cfbb640 1 --2- 172.21.15.73:0/2789751775 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6c981553d0 0x7f6c98150dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:19.584 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:19.582+0000 7f6c977fe640 1 --2- 172.21.15.73:0/2789751775 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6c980c4d50 0x7f6c98156c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:19.584 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:19.582+0000 7f6c97fff640 1 -- 172.21.15.73:0/2789751775 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6c980c4d50 msgr2=0x7f6c98156c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:19.584 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:19.582+0000 7f6c97fff640 1 --2- 172.21.15.73:0/2789751775 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6c980c4d50 0x7f6c98156c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:19.584 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:19.582+0000 7f6c97fff640 1 -- 172.21.15.73:0/2789751775 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6c981553d0 msgr2=0x7f6c98150dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:19.584 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:19.582+0000 7f6c97fff640 1 --2- 172.21.15.73:0/2789751775 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6c981553d0 0x7f6c98150dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:19.584 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:19.582+0000 7f6c97fff640 1 -- 172.21.15.73:0/2789751775 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c90009400 con 0x7f6c980c2320 2023-12-12T09:43:19.584 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:19.582+0000 7f6c97fff640 1 --2- 172.21.15.73:0/2789751775 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6c980c2320 0x7f6c980999d0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f6c8000c390 tx=0x7f6c8000c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:43:19.584 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:19.582+0000 7f6c94ff9640 1 -- 172.21.15.73:0/2789751775 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c80005ce0 con 0x7f6c980c2320 2023-12-12T09:43:19.584 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:19.582+0000 7f6c94ff9640 1 -- 172.21.15.73:0/2789751775 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c80005e40 con 0x7f6c980c2320 2023-12-12T09:43:19.584 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:19.582+0000 7f6c94ff9640 1 -- 172.21.15.73:0/2789751775 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c800072f0 con 0x7f6c980c2320 2023-12-12T09:43:19.585 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:19.582+0000 7f6c9ea1e640 1 -- 172.21.15.73:0/2789751775 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c980aaa40 con 0x7f6c980c2320 2023-12-12T09:43:19.585 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:19.582+0000 7f6c9ea1e640 1 -- 172.21.15.73:0/2789751775 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c9809a0d0 con 0x7f6c980c2320 2023-12-12T09:43:19.585 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:19.583+0000 7f6c9ea1e640 1 -- 172.21.15.73:0/2789751775 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c98072a90 con 0x7f6c980c2320 2023-12-12T09:43:19.585 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:19.584+0000 7f6c94ff9640 1 -- 172.21.15.73:0/2789751775 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 4) v1 ==== 89175+0+0 (secure 0 0 0) 0x7f6c80007450 con 0x7f6c980c2320 2023-12-12T09:43:19.586 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:19.585+0000 7f6c94ff9640 1 --2- 172.21.15.73:0/2789751775 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f6c7806adb0 0x7f6c7806d270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:19.586 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:19.585+0000 7f6c94ff9640 1 -- 172.21.15.73:0/2789751775 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f6c800887e0 con 0x7f6c980c2320 2023-12-12T09:43:19.586 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:19.586+0000 7f6c977fe640 1 --2- 172.21.15.73:0/2789751775 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f6c7806adb0 0x7f6c7806d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:19.587 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:19.586+0000 7f6c977fe640 1 --2- 172.21.15.73:0/2789751775 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f6c7806adb0 0x7f6c7806d270 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f6c980722d0 tx=0x7f6c8800b040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:43:19.590 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:19.590+0000 7f6c94ff9640 1 -- 172.21.15.73:0/2789751775 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f6c80053cb0 con 0x7f6c980c2320 2023-12-12T09:43:19.778 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:19.777+0000 7f6c9ea1e640 1 -- 172.21.15.73:0/2789751775 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f6c980aac30 con 0x7f6c980c2320 2023-12-12T09:43:20.240 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:20.238+0000 7f6c94ff9640 1 -- 172.21.15.73:0/2789751775 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v18) v1 ==== 138+0+0 (secure 0 0 0) 0x7f6c80017020 con 0x7f6c980c2320 2023-12-12T09:43:20.240 INFO:teuthology.orchestra.run.smithi073.stderr:pool 'cephfs_metadata' created 2023-12-12T09:43:20.243 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:20.242+0000 7f6c9ea1e640 1 -- 172.21.15.73:0/2789751775 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f6c7806adb0 msgr2=0x7f6c7806d270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:20.243 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:20.242+0000 7f6c9ea1e640 1 --2- 172.21.15.73:0/2789751775 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f6c7806adb0 0x7f6c7806d270 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f6c980722d0 tx=0x7f6c8800b040 comp rx=0 tx=0).stop 2023-12-12T09:43:20.243 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:20.242+0000 7f6c9ea1e640 1 -- 172.21.15.73:0/2789751775 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6c980c2320 msgr2=0x7f6c980999d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:20.243 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:20.242+0000 7f6c9ea1e640 1 --2- 172.21.15.73:0/2789751775 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6c980c2320 0x7f6c980999d0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f6c8000c390 tx=0x7f6c8000c850 comp rx=0 tx=0).stop 2023-12-12T09:43:20.243 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:20.242+0000 7f6c9ea1e640 1 -- 172.21.15.73:0/2789751775 shutdown_connections 2023-12-12T09:43:20.243 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:20.242+0000 7f6c9ea1e640 1 --2- 172.21.15.73:0/2789751775 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f6c7806adb0 0x7f6c7806d270 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:20.244 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:20.242+0000 7f6c9ea1e640 1 --2- 172.21.15.73:0/2789751775 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6c981553d0 0x7f6c98150dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:20.244 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:20.242+0000 7f6c9ea1e640 1 --2- 172.21.15.73:0/2789751775 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6c980c4d50 0x7f6c98156c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:20.244 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:20.242+0000 7f6c9ea1e640 1 --2- 172.21.15.73:0/2789751775 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6c980c2320 0x7f6c980999d0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:20.244 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:20.242+0000 7f6c9ea1e640 1 -- 172.21.15.73:0/2789751775 >> 172.21.15.73:0/2789751775 conn(0x7f6c980c6ab0 msgr2=0x7f6c9806a4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:43:20.244 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:20.242+0000 7f6c9ea1e640 1 -- 172.21.15.73:0/2789751775 shutdown_connections 2023-12-12T09:43:20.244 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:20.242+0000 7f6c9ea1e640 1 -- 172.21.15.73:0/2789751775 wait complete. 2023-12-12T09:43:20.271 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-12-12T09:43:20.469 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:20.467+0000 7f637df01640 1 Processor -- start 2023-12-12T09:43:20.469 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:20.468+0000 7f637df01640 1 -- start start 2023-12-12T09:43:20.470 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:20.469+0000 7f637df01640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f637814f8c0 0x7f637806dc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:20.470 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:20.469+0000 7f637df01640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6378152500 0x7f6378152990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:20.470 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:20.469+0000 7f637df01640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63780c16c0 con 0x7f637806d350 2023-12-12T09:43:20.470 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:20.469+0000 7f637df01640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63780c1090 con 0x7f637814f8c0 2023-12-12T09:43:20.470 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:20.469+0000 7f637df01640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63780c14b0 con 0x7f6378152500 2023-12-12T09:43:20.471 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:20.470+0000 7f63777fe640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f637814f8c0 0x7f637806dc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:20.471 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:20.470+0000 7f6376ffd640 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f637806d350 0x7f6378071e60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.73:47232/0 (socket says 172.21.15.73:47232) 2023-12-12T09:43:20.472 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:20.470+0000 7f6376ffd640 1 -- 172.21.15.73:0/655203591 learned_addr learned my addr 172.21.15.73:0/655203591 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-12T09:43:20.472 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:20.470+0000 7f6377fff640 1 --2- 172.21.15.73:0/655203591 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6378152500 0x7f6378152990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:20.472 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:20.470+0000 7f63767fc640 1 -- 172.21.15.73:0/655203591 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3248477079 0 0) 0x7f63780c16c0 con 0x7f637806d350 2023-12-12T09:43:20.472 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:20.470+0000 7f63767fc640 1 -- 172.21.15.73:0/655203591 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6364003520 con 0x7f637806d350 2023-12-12T09:43:20.472 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:20.470+0000 7f63777fe640 1 -- 172.21.15.73:0/655203591 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6378152500 msgr2=0x7f6378152990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:43:20.472 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:20.470+0000 7f63777fe640 1 --2- 172.21.15.73:0/655203591 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6378152500 0x7f6378152990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:20.472 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:20.470+0000 7f63777fe640 1 -- 172.21.15.73:0/655203591 >> v1:172.21.15.142:6789/0 conn(0x7f637806d350 legacy=0x7f6378071e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:20.472 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:20.470+0000 7f63777fe640 1 -- 172.21.15.73:0/655203591 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63780c19a0 con 0x7f637814f8c0 2023-12-12T09:43:20.472 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:20.472+0000 7f63777fe640 1 --2- 172.21.15.73:0/655203591 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f637814f8c0 0x7f637806dc40 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f63680097a0 tx=0x7f636802b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=80b6678c8bb923af server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:43:20.474 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:20.472+0000 7f63767fc640 1 -- 172.21.15.73:0/655203591 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6368031830 con 0x7f637814f8c0 2023-12-12T09:43:20.474 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:20.472+0000 7f63767fc640 1 -- 172.21.15.73:0/655203591 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6368031990 con 0x7f637814f8c0 2023-12-12T09:43:20.474 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:20.472+0000 7f63767fc640 1 -- 172.21.15.73:0/655203591 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6368031d20 con 0x7f637814f8c0 2023-12-12T09:43:20.474 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:20.473+0000 7f637df01640 1 -- 172.21.15.73:0/655203591 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f637814f8c0 msgr2=0x7f637806dc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:20.474 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:20.473+0000 7f637df01640 1 --2- 172.21.15.73:0/655203591 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f637814f8c0 0x7f637806dc40 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f63680097a0 tx=0x7f636802b8d0 comp rx=0 tx=0).stop 2023-12-12T09:43:20.475 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:20.473+0000 7f637df01640 1 -- 172.21.15.73:0/655203591 shutdown_connections 2023-12-12T09:43:20.475 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:20.473+0000 7f637df01640 1 --2- 172.21.15.73:0/655203591 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6378152500 0x7f6378152990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:20.475 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:20.473+0000 7f637df01640 1 --2- 172.21.15.73:0/655203591 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f637814f8c0 0x7f637806dc40 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:20.475 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:20.473+0000 7f637df01640 1 -- 172.21.15.73:0/655203591 >> 172.21.15.73:0/655203591 conn(0x7f637806a4e0 msgr2=0x7f637806a8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:43:20.475 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:20.473+0000 7f637df01640 1 -- 172.21.15.73:0/655203591 shutdown_connections 2023-12-12T09:43:20.475 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:20.473+0000 7f637df01640 1 -- 172.21.15.73:0/655203591 wait complete. 2023-12-12T09:43:20.476 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:20.475+0000 7f637df01640 1 Processor -- start 2023-12-12T09:43:20.476 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:20.475+0000 7f637df01640 1 -- start start 2023-12-12T09:43:20.478 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:20.476+0000 7f637df01640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f637806d350 0x7f63780aaf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:20.478 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:20.476+0000 7f637df01640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f637814f8c0 0x7f63781eb510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:20.478 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:20.476+0000 7f637df01640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6378152500 0x7f63781eba50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:20.478 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:20.476+0000 7f637df01640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63780a8ac0 con 0x7f637806d350 2023-12-12T09:43:20.478 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:20.476+0000 7f637df01640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6378153ea0 con 0x7f6378152500 2023-12-12T09:43:20.478 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:20.476+0000 7f637df01640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63781538e0 con 0x7f637814f8c0 2023-12-12T09:43:20.478 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:20.477+0000 7f63777fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f637806d350 0x7f63780aaf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:20.478 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:20.477+0000 7f63777fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f637806d350 0x7f63780aaf80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:41122/0 (socket says 172.21.15.73:41122) 2023-12-12T09:43:20.478 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:20.477+0000 7f63777fe640 1 -- 172.21.15.73:0/2170036478 learned_addr learned my addr 172.21.15.73:0/2170036478 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:43:20.478 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:20.477+0000 7f6376ffd640 1 --2- 172.21.15.73:0/2170036478 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f637814f8c0 0x7f63781eb510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:20.479 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:20.477+0000 7f6377fff640 1 --2- 172.21.15.73:0/2170036478 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6378152500 0x7f63781eba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:20.480 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:20.477+0000 7f63777fe640 1 -- 172.21.15.73:0/2170036478 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f637814f8c0 msgr2=0x7f63781eb510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:20.480 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:20.477+0000 7f63777fe640 1 --2- 172.21.15.73:0/2170036478 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f637814f8c0 0x7f63781eb510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:20.480 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:20.477+0000 7f63777fe640 1 -- 172.21.15.73:0/2170036478 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6378152500 msgr2=0x7f63781eba50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:20.480 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:20.477+0000 7f63777fe640 1 --2- 172.21.15.73:0/2170036478 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6378152500 0x7f63781eba50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:20.480 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:20.477+0000 7f63777fe640 1 -- 172.21.15.73:0/2170036478 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6368009400 con 0x7f637806d350 2023-12-12T09:43:20.480 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:20.477+0000 7f6377fff640 1 --2- 172.21.15.73:0/2170036478 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6378152500 0x7f63781eba50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-12T09:43:20.480 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:20.478+0000 7f63777fe640 1 --2- 172.21.15.73:0/2170036478 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f637806d350 0x7f63780aaf80 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f6368034040 tx=0x7f63680046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:43:20.481 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:20.478+0000 7f636ffff640 1 -- 172.21.15.73:0/2170036478 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f636803a8f0 con 0x7f637806d350 2023-12-12T09:43:20.481 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:20.478+0000 7f636ffff640 1 -- 172.21.15.73:0/2170036478 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f636803aa70 con 0x7f637806d350 2023-12-12T09:43:20.481 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:20.478+0000 7f637df01640 1 -- 172.21.15.73:0/2170036478 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6378153bc0 con 0x7f637806d350 2023-12-12T09:43:20.481 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:20.478+0000 7f636ffff640 1 -- 172.21.15.73:0/2170036478 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f636803ae20 con 0x7f637806d350 2023-12-12T09:43:20.481 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:20.478+0000 7f637df01640 1 -- 172.21.15.73:0/2170036478 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63780aaa60 con 0x7f637806d350 2023-12-12T09:43:20.481 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:20.479+0000 7f637df01640 1 -- 172.21.15.73:0/2170036478 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6378067070 con 0x7f637806d350 2023-12-12T09:43:20.481 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:20.480+0000 7f636ffff640 1 -- 172.21.15.73:0/2170036478 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f636804d440 con 0x7f637806d350 2023-12-12T09:43:20.482 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:20.481+0000 7f636ffff640 1 --2- 172.21.15.73:0/2170036478 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f635806ae40 0x7f635806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:20.482 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:20.481+0000 7f636ffff640 1 -- 172.21.15.73:0/2170036478 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5227+0+0 (secure 0 0 0) 0x7f63680ab490 con 0x7f637806d350 2023-12-12T09:43:20.483 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:20.482+0000 7f6376ffd640 1 --2- 172.21.15.73:0/2170036478 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f635806ae40 0x7f635806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:20.483 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:20.482+0000 7f6376ffd640 1 --2- 172.21.15.73:0/2170036478 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f635806ae40 0x7f635806d300 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f63781567f0 tx=0x7f6360007d30 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:43:20.487 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:20.487+0000 7f636ffff640 1 -- 172.21.15.73:0/2170036478 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f6368076710 con 0x7f637806d350 2023-12-12T09:43:20.682 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:20.681+0000 7f637df01640 1 -- 172.21.15.73:0/2170036478 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f6378067580 con 0x7f637806d350 2023-12-12T09:43:21.257 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:21.256+0000 7f636ffff640 1 -- 172.21.15.73:0/2170036478 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v19) v1 ==== 170+0+0 (secure 0 0 0) 0x7f6368079d30 con 0x7f637806d350 2023-12-12T09:43:21.257 INFO:teuthology.orchestra.run.smithi073.stderr:pool 'cephfs_data' created 2023-12-12T09:43:21.261 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:21.260+0000 7f637df01640 1 -- 172.21.15.73:0/2170036478 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f635806ae40 msgr2=0x7f635806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:21.261 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:21.260+0000 7f637df01640 1 --2- 172.21.15.73:0/2170036478 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f635806ae40 0x7f635806d300 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f63781567f0 tx=0x7f6360007d30 comp rx=0 tx=0).stop 2023-12-12T09:43:21.261 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:21.260+0000 7f637df01640 1 -- 172.21.15.73:0/2170036478 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f637806d350 msgr2=0x7f63780aaf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:21.261 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:21.260+0000 7f637df01640 1 --2- 172.21.15.73:0/2170036478 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f637806d350 0x7f63780aaf80 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f6368034040 tx=0x7f63680046c0 comp rx=0 tx=0).stop 2023-12-12T09:43:21.261 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:21.260+0000 7f637df01640 1 -- 172.21.15.73:0/2170036478 shutdown_connections 2023-12-12T09:43:21.261 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:21.260+0000 7f637df01640 1 --2- 172.21.15.73:0/2170036478 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f635806ae40 0x7f635806d300 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:21.261 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:21.260+0000 7f637df01640 1 --2- 172.21.15.73:0/2170036478 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6378152500 0x7f63781eba50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:21.261 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:21.260+0000 7f637df01640 1 --2- 172.21.15.73:0/2170036478 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f637814f8c0 0x7f63781eb510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:21.261 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:21.260+0000 7f637df01640 1 --2- 172.21.15.73:0/2170036478 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f637806d350 0x7f63780aaf80 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:21.262 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:21.260+0000 7f637df01640 1 -- 172.21.15.73:0/2170036478 >> 172.21.15.73:0/2170036478 conn(0x7f637806a4e0 msgr2=0x7f6378152970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:43:21.262 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:21.260+0000 7f637df01640 1 -- 172.21.15.73:0/2170036478 shutdown_connections 2023-12-12T09:43:21.262 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:21.260+0000 7f637df01640 1 -- 172.21.15.73:0/2170036478 wait complete. 2023-12-12T09:43:21.290 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-12-12T09:43:21.479 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:21.478+0000 7f42eb59e640 1 Processor -- start 2023-12-12T09:43:21.479 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:21.478+0000 7f42eb59e640 1 -- start start 2023-12-12T09:43:21.480 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:21.479+0000 7f42eb59e640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f42ec14c190 0x7f42ec0c0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:21.480 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:21.479+0000 7f42eb59e640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f42ec0a4d00 0x7f42ec1555c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:21.480 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:21.479+0000 7f42eb59e640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42ec155b00 con 0x7f42ec1529a0 2023-12-12T09:43:21.480 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:21.479+0000 7f42eb59e640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42ec0c1890 con 0x7f42ec14c190 2023-12-12T09:43:21.481 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:21.479+0000 7f42eb59e640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42ec151fd0 con 0x7f42ec0a4d00 2023-12-12T09:43:21.481 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:21.480+0000 7f42ead9d640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f42ec1529a0 0x7f42ec0a8880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:37264/0 (socket says 172.21.15.73:37264) 2023-12-12T09:43:21.481 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:21.480+0000 7f42ead9d640 1 -- 172.21.15.73:0/4178690084 learned_addr learned my addr 172.21.15.73:0/4178690084 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-12T09:43:21.483 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:21.480+0000 7f42e3fff640 1 --2- 172.21.15.73:0/4178690084 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f42ec0a4d00 0x7f42ec1555c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:21.483 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:21.480+0000 7f42ea59c640 1 --2- 172.21.15.73:0/4178690084 >> v2:172.21.15.142:3300/0 conn(0x7f42ec14c190 0x7f42ec0c0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:21.483 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:21.480+0000 7f42e9d9b640 1 -- 172.21.15.73:0/4178690084 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2770202791 0 0) 0x7f42ec155b00 con 0x7f42ec1529a0 2023-12-12T09:43:21.483 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:21.480+0000 7f42e9d9b640 1 -- 172.21.15.73:0/4178690084 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f42d8003520 con 0x7f42ec1529a0 2023-12-12T09:43:21.483 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:21.480+0000 7f42e9d9b640 1 -- 172.21.15.73:0/4178690084 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3790247799 0 0) 0x7f42d8003520 con 0x7f42ec1529a0 2023-12-12T09:43:21.483 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:21.480+0000 7f42e9d9b640 1 -- 172.21.15.73:0/4178690084 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f42ec0a4d00 msgr2=0x7f42ec1555c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:43:21.483 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:21.480+0000 7f42e9d9b640 1 --2- 172.21.15.73:0/4178690084 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f42ec0a4d00 0x7f42ec1555c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:21.483 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:21.480+0000 7f42e9d9b640 1 -- 172.21.15.73:0/4178690084 >> v2:172.21.15.142:3300/0 conn(0x7f42ec14c190 msgr2=0x7f42ec0c0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:43:21.483 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:21.480+0000 7f42e9d9b640 1 --2- 172.21.15.73:0/4178690084 >> v2:172.21.15.142:3300/0 conn(0x7f42ec14c190 0x7f42ec0c0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:21.483 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:21.480+0000 7f42e9d9b640 1 -- 172.21.15.73:0/4178690084 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42ec1521e0 con 0x7f42ec1529a0 2023-12-12T09:43:21.483 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:21.480+0000 7f42e9d9b640 1 -- 172.21.15.73:0/4178690084 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3186547832 0 0) 0x7f42e40019f0 con 0x7f42ec1529a0 2023-12-12T09:43:21.483 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:21.481+0000 7f42e9d9b640 1 -- 172.21.15.73:0/4178690084 >> v1:172.21.15.73:6789/0 conn(0x7f42ec1529a0 legacy=0x7f42ec0a8880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:21.483 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:21.481+0000 7f42e9d9b640 1 --2- 172.21.15.73:0/4178690084 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f42ec0a4d00 0x7f42d8003970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:21.484 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:21.481+0000 7f42e9d9b640 1 --2- 172.21.15.73:0/4178690084 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f42d8003ef0 0x7f42d80047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:21.484 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:21.481+0000 7f42e9d9b640 1 --2- 172.21.15.73:0/4178690084 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f42d8004d00 0x7f42d8005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:21.484 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:21.481+0000 7f42e9d9b640 1 -- 172.21.15.73:0/4178690084 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42ec0c1890 con 0x7f42d8004d00 2023-12-12T09:43:21.484 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:21.481+0000 7f42e9d9b640 1 -- 172.21.15.73:0/4178690084 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42ec151fd0 con 0x7f42d8003ef0 2023-12-12T09:43:21.484 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:21.481+0000 7f42e9d9b640 1 -- 172.21.15.73:0/4178690084 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42d800b9d0 con 0x7f42ec0a4d00 2023-12-12T09:43:21.484 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:21.481+0000 7f42ead9d640 1 --2- 172.21.15.73:0/4178690084 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f42d8004d00 0x7f42d8005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:21.484 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:21.481+0000 7f42ea59c640 1 --2- 172.21.15.73:0/4178690084 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f42ec0a4d00 0x7f42d8003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:21.484 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:21.481+0000 7f42ead9d640 1 -- 172.21.15.73:0/4178690084 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f42ec0a4d00 msgr2=0x7f42d8003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:43:21.484 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:21.481+0000 7f42e3fff640 1 --2- 172.21.15.73:0/4178690084 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f42d8003ef0 0x7f42d80047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:21.484 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:21.481+0000 7f42ead9d640 1 --2- 172.21.15.73:0/4178690084 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f42ec0a4d00 0x7f42d8003970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:21.484 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:21.481+0000 7f42ead9d640 1 -- 172.21.15.73:0/4178690084 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f42d8003ef0 msgr2=0x7f42d80047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:43:21.484 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:21.481+0000 7f42ead9d640 1 --2- 172.21.15.73:0/4178690084 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f42d8003ef0 0x7f42d80047c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:21.484 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:21.481+0000 7f42ead9d640 1 -- 172.21.15.73:0/4178690084 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42d8003520 con 0x7f42d8004d00 2023-12-12T09:43:21.488 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:21.482+0000 7f42ead9d640 1 --2- 172.21.15.73:0/4178690084 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f42d8004d00 0x7f42d8005180 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f42e400a890 tx=0x7f42d80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46f3668d8fd75cc7 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:43:21.488 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:21.483+0000 7f42e9d9b640 1 -- 172.21.15.73:0/4178690084 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42e4034630 con 0x7f42d8004d00 2023-12-12T09:43:21.488 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:21.483+0000 7f42e9d9b640 1 -- 172.21.15.73:0/4178690084 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42e402f070 con 0x7f42d8004d00 2023-12-12T09:43:21.488 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:21.483+0000 7f42e9d9b640 1 -- 172.21.15.73:0/4178690084 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42e4034a30 con 0x7f42d8004d00 2023-12-12T09:43:21.488 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:21.483+0000 7f42eb59e640 1 -- 172.21.15.73:0/4178690084 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f42d8004d00 msgr2=0x7f42d8005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:21.488 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:21.483+0000 7f42eb59e640 1 --2- 172.21.15.73:0/4178690084 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f42d8004d00 0x7f42d8005180 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f42e400a890 tx=0x7f42d80057f0 comp rx=0 tx=0).stop 2023-12-12T09:43:21.488 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:21.483+0000 7f42ead9d640 1 -- 172.21.15.73:0/4178690084 reap_dead start 2023-12-12T09:43:21.488 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:21.483+0000 7f42eb59e640 1 -- 172.21.15.73:0/4178690084 shutdown_connections 2023-12-12T09:43:21.488 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:21.483+0000 7f42eb59e640 1 -- 172.21.15.73:0/4178690084 >> 172.21.15.73:0/4178690084 conn(0x7f42ec06a4e0 msgr2=0x7f42ec06a8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:43:21.488 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:21.483+0000 7f42eb59e640 1 -- 172.21.15.73:0/4178690084 shutdown_connections 2023-12-12T09:43:21.488 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:21.483+0000 7f42eb59e640 1 -- 172.21.15.73:0/4178690084 wait complete. 2023-12-12T09:43:21.488 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:21.485+0000 7f42eb59e640 1 Processor -- start 2023-12-12T09:43:21.489 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:21.485+0000 7f42eb59e640 1 -- start start 2023-12-12T09:43:21.489 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:21.486+0000 7f42eb59e640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f42d8004d00 0x7f42ec145ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:21.489 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:21.486+0000 7f42eb59e640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f42ec0a70e0 0x7f42ec0a53f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:21.489 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:21.486+0000 7f42eb59e640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f42ec1e83b0 0x7f42ec0a5930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:21.489 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:21.486+0000 7f42eb59e640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42ec1e76c0 con 0x7f42ec1e83b0 2023-12-12T09:43:21.489 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:21.486+0000 7f42eb59e640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42ec156350 con 0x7f42ec0a70e0 2023-12-12T09:43:21.489 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:21.486+0000 7f42eb59e640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42ec155e20 con 0x7f42d8004d00 2023-12-12T09:43:21.489 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:21.486+0000 7f42ead9d640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f42ec1e83b0 0x7f42ec0a5930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:21.489 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:21.486+0000 7f42ead9d640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f42ec1e83b0 0x7f42ec0a5930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:41134/0 (socket says 172.21.15.73:41134) 2023-12-12T09:43:21.489 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:21.486+0000 7f42ead9d640 1 -- 172.21.15.73:0/2114784361 learned_addr learned my addr 172.21.15.73:0/2114784361 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:43:21.489 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:21.487+0000 7f42e3fff640 1 --2- 172.21.15.73:0/2114784361 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f42ec0a70e0 0x7f42ec0a53f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:21.489 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:21.487+0000 7f42ea59c640 1 --2- 172.21.15.73:0/2114784361 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f42d8004d00 0x7f42ec145ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:21.489 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:21.487+0000 7f42ead9d640 1 -- 172.21.15.73:0/2114784361 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f42d8004d00 msgr2=0x7f42ec145ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:21.489 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:21.487+0000 7f42ead9d640 1 --2- 172.21.15.73:0/2114784361 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f42d8004d00 0x7f42ec145ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:21.490 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:21.487+0000 7f42ead9d640 1 -- 172.21.15.73:0/2114784361 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f42ec0a70e0 msgr2=0x7f42ec0a53f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:21.490 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:21.487+0000 7f42ead9d640 1 --2- 172.21.15.73:0/2114784361 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f42ec0a70e0 0x7f42ec0a53f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:21.490 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:21.487+0000 7f42ead9d640 1 -- 172.21.15.73:0/2114784361 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42ec156070 con 0x7f42ec1e83b0 2023-12-12T09:43:21.490 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:21.487+0000 7f42ead9d640 1 --2- 172.21.15.73:0/2114784361 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f42ec1e83b0 0x7f42ec0a5930 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f42e400a890 tx=0x7f42e4001d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:43:21.491 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:21.487+0000 7f42e2ffd640 1 -- 172.21.15.73:0/2114784361 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42e4001fd0 con 0x7f42ec1e83b0 2023-12-12T09:43:21.491 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:21.487+0000 7f42e2ffd640 1 -- 172.21.15.73:0/2114784361 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42e4034640 con 0x7f42ec1e83b0 2023-12-12T09:43:21.491 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:21.487+0000 7f42e2ffd640 1 -- 172.21.15.73:0/2114784361 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42e40349b0 con 0x7f42ec1e83b0 2023-12-12T09:43:21.491 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:21.487+0000 7f42eb59e640 1 -- 172.21.15.73:0/2114784361 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42ec1e78d0 con 0x7f42ec1e83b0 2023-12-12T09:43:21.491 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:21.488+0000 7f42eb59e640 1 -- 172.21.15.73:0/2114784361 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42ec1e7e90 con 0x7f42ec1e83b0 2023-12-12T09:43:21.491 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:21.489+0000 7f42eb59e640 1 -- 172.21.15.73:0/2114784361 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f42ec1e8080 con 0x7f42ec1e83b0 2023-12-12T09:43:21.491 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:21.490+0000 7f42e2ffd640 1 -- 172.21.15.73:0/2114784361 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f42e4031030 con 0x7f42ec1e83b0 2023-12-12T09:43:21.492 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:21.491+0000 7f42e2ffd640 1 --2- 172.21.15.73:0/2114784361 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f42cc06ae40 0x7f42cc06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:21.492 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:21.491+0000 7f42e2ffd640 1 -- 172.21.15.73:0/2114784361 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5609+0+0 (secure 0 0 0) 0x7f42e40ab680 con 0x7f42ec1e83b0 2023-12-12T09:43:21.492 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:21.491+0000 7f42ea59c640 1 --2- 172.21.15.73:0/2114784361 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f42cc06ae40 0x7f42cc06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:21.492 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:21.492+0000 7f42ea59c640 1 --2- 172.21.15.73:0/2114784361 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f42cc06ae40 0x7f42cc06d300 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f42dc009a90 tx=0x7f42dc008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:43:21.497 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:21.496+0000 7f42e2ffd640 1 -- 172.21.15.73:0/2114784361 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f42e4076820 con 0x7f42ec1e83b0 2023-12-12T09:43:21.719 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:21.718+0000 7f42eb59e640 1 -- 172.21.15.73:0/2114784361 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f42ec1e8080 con 0x7f42ec1e83b0 2023-12-12T09:43:22.262 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:22.261+0000 7f42e2ffd640 1 -- 172.21.15.73:0/2114784361 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) v1 ==== 172+0+0 (secure 0 0 0) 0x7f42e4079e40 con 0x7f42ec1e83b0 2023-12-12T09:43:22.263 INFO:teuthology.orchestra.run.smithi073.stderr:new fs with metadata pool 2 and data pool 3 2023-12-12T09:43:22.266 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:22.265+0000 7f42eb59e640 1 -- 172.21.15.73:0/2114784361 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f42cc06ae40 msgr2=0x7f42cc06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:22.266 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:22.265+0000 7f42eb59e640 1 --2- 172.21.15.73:0/2114784361 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f42cc06ae40 0x7f42cc06d300 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f42dc009a90 tx=0x7f42dc008040 comp rx=0 tx=0).stop 2023-12-12T09:43:22.267 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:22.265+0000 7f42eb59e640 1 -- 172.21.15.73:0/2114784361 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f42ec1e83b0 msgr2=0x7f42ec0a5930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:22.267 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:22.265+0000 7f42eb59e640 1 --2- 172.21.15.73:0/2114784361 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f42ec1e83b0 0x7f42ec0a5930 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f42e400a890 tx=0x7f42e4001d80 comp rx=0 tx=0).stop 2023-12-12T09:43:22.267 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:22.265+0000 7f42eb59e640 1 -- 172.21.15.73:0/2114784361 shutdown_connections 2023-12-12T09:43:22.267 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:22.265+0000 7f42eb59e640 1 --2- 172.21.15.73:0/2114784361 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f42cc06ae40 0x7f42cc06d300 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:22.267 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:22.265+0000 7f42eb59e640 1 --2- 172.21.15.73:0/2114784361 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f42ec1e83b0 0x7f42ec0a5930 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:22.267 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:22.265+0000 7f42eb59e640 1 --2- 172.21.15.73:0/2114784361 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f42ec0a70e0 0x7f42ec0a53f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:22.267 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:22.265+0000 7f42eb59e640 1 --2- 172.21.15.73:0/2114784361 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f42d8004d00 0x7f42ec145ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:22.267 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:22.265+0000 7f42eb59e640 1 -- 172.21.15.73:0/2114784361 >> 172.21.15.73:0/2114784361 conn(0x7f42ec06a4e0 msgr2=0x7f42ec150810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:43:22.267 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:22.265+0000 7f42eb59e640 1 -- 172.21.15.73:0/2114784361 shutdown_connections 2023-12-12T09:43:22.267 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:22.265+0000 7f42eb59e640 1 -- 172.21.15.73:0/2114784361 wait complete. 2023-12-12T09:43:22.291 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-12T09:43:22.468 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:22.467+0000 7f559f30c640 1 Processor -- start 2023-12-12T09:43:22.468 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:22.467+0000 7f559f30c640 1 -- start start 2023-12-12T09:43:22.469 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:22.468+0000 7f559f30c640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f55980ab510 0x7f559815dc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:22.469 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:22.468+0000 7f559f30c640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5598153300 con 0x7f559814fbb0 2023-12-12T09:43:22.469 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:22.468+0000 7f559f30c640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55980c2160 con 0x7f55980a9470 2023-12-12T09:43:22.469 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:22.468+0000 7f559f30c640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55980aa000 con 0x7f55980ab510 2023-12-12T09:43:22.469 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:22.468+0000 7f559e30a640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f559814fbb0 0x7f55980c09e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:37276/0 (socket says 172.21.15.73:37276) 2023-12-12T09:43:22.470 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:22.468+0000 7f559e30a640 1 -- 172.21.15.73:0/1379317981 learned_addr learned my addr 172.21.15.73:0/1379317981 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-12T09:43:22.472 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:22.469+0000 7f559d308640 1 -- 172.21.15.73:0/1379317981 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1694261079 0 0) 0x7f5598153300 con 0x7f559814fbb0 2023-12-12T09:43:22.472 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:22.469+0000 7f559d308640 1 -- 172.21.15.73:0/1379317981 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5584003520 con 0x7f559814fbb0 2023-12-12T09:43:22.472 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:22.469+0000 7f559eb0b640 1 --2- 172.21.15.73:0/1379317981 >> v2:172.21.15.142:3300/0 conn(0x7f55980ab510 0x7f559815dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:22.472 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:22.469+0000 7f559d308640 1 -- 172.21.15.73:0/1379317981 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 556851315 0 0) 0x7f5584003520 con 0x7f559814fbb0 2023-12-12T09:43:22.472 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:22.469+0000 7f559d308640 1 -- 172.21.15.73:0/1379317981 >> v2:172.21.15.142:3300/0 conn(0x7f55980ab510 msgr2=0x7f559815dc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:43:22.472 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:22.469+0000 7f559d308640 1 --2- 172.21.15.73:0/1379317981 >> v2:172.21.15.142:3300/0 conn(0x7f55980ab510 0x7f559815dc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:22.472 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:22.469+0000 7f559d308640 1 -- 172.21.15.73:0/1379317981 >> v1:172.21.15.142:6789/0 conn(0x7f55980a9470 legacy=0x7f55980aae00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:43:22.472 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:22.469+0000 7f559d308640 1 -- 172.21.15.73:0/1379317981 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5598153020 con 0x7f559814fbb0 2023-12-12T09:43:22.472 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:22.469+0000 7f559d308640 1 -- 172.21.15.73:0/1379317981 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3186547832 0 0) 0x7f5594001670 con 0x7f559814fbb0 2023-12-12T09:43:22.473 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:22.469+0000 7f559d308640 1 -- 172.21.15.73:0/1379317981 >> v1:172.21.15.73:6789/0 conn(0x7f559814fbb0 legacy=0x7f55980c09e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:22.473 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:22.469+0000 7f559d308640 1 --2- 172.21.15.73:0/1379317981 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5584003970 0x7f5584003d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:22.473 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:22.469+0000 7f559d308640 1 --2- 172.21.15.73:0/1379317981 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f55840047c0 0x7f5584004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:22.473 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:22.469+0000 7f559d308640 1 --2- 172.21.15.73:0/1379317981 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f55840052a0 0x7f558400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:22.473 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:22.469+0000 7f559d308640 1 -- 172.21.15.73:0/1379317981 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55980aa000 con 0x7f55840052a0 2023-12-12T09:43:22.473 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:22.469+0000 7f559d308640 1 -- 172.21.15.73:0/1379317981 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f558400c150 con 0x7f55840047c0 2023-12-12T09:43:22.473 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:22.469+0000 7f559d308640 1 -- 172.21.15.73:0/1379317981 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f558400c310 con 0x7f5584003970 2023-12-12T09:43:22.473 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:22.469+0000 7f559eb0b640 1 --2- 172.21.15.73:0/1379317981 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f55840052a0 0x7f558400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:22.473 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:22.470+0000 7f559e30a640 1 --2- 172.21.15.73:0/1379317981 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5584003970 0x7f5584003d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:22.473 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:22.470+0000 7f559db09640 1 --2- 172.21.15.73:0/1379317981 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f55840047c0 0x7f5584004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:22.473 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:22.470+0000 7f559eb0b640 1 -- 172.21.15.73:0/1379317981 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5584003970 msgr2=0x7f5584003d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:43:22.473 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:22.470+0000 7f559eb0b640 1 --2- 172.21.15.73:0/1379317981 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5584003970 0x7f5584003d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:22.473 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:22.470+0000 7f559eb0b640 1 -- 172.21.15.73:0/1379317981 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f55840047c0 msgr2=0x7f5584004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:43:22.473 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:22.470+0000 7f559eb0b640 1 --2- 172.21.15.73:0/1379317981 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f55840047c0 0x7f5584004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:22.474 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:22.470+0000 7f559eb0b640 1 -- 172.21.15.73:0/1379317981 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5584003520 con 0x7f55840052a0 2023-12-12T09:43:22.474 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:22.470+0000 7f559db09640 1 --2- 172.21.15.73:0/1379317981 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f55840047c0 0x7f5584004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:43:22.474 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:22.471+0000 7f559eb0b640 1 -- 172.21.15.73:0/1379317981 reap_dead start 2023-12-12T09:43:22.474 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:22.471+0000 7f559eb0b640 1 --2- 172.21.15.73:0/1379317981 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f55840052a0 0x7f558400b980 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f5590007330 tx=0x7f55840057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d686002e94d7457a server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:43:22.474 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:22.471+0000 7f559d308640 1 -- 172.21.15.73:0/1379317981 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f559002ccd0 con 0x7f55840052a0 2023-12-12T09:43:22.474 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:22.471+0000 7f559d308640 1 -- 172.21.15.73:0/1379317981 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f559002ce30 con 0x7f55840052a0 2023-12-12T09:43:22.474 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:22.471+0000 7f559d308640 1 -- 172.21.15.73:0/1379317981 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5590003bd0 con 0x7f55840052a0 2023-12-12T09:43:22.476 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:22.472+0000 7f559f30c640 1 -- 172.21.15.73:0/1379317981 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f55840052a0 msgr2=0x7f558400b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:22.476 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:22.472+0000 7f559f30c640 1 --2- 172.21.15.73:0/1379317981 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f55840052a0 0x7f558400b980 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f5590007330 tx=0x7f55840057f0 comp rx=0 tx=0).stop 2023-12-12T09:43:22.476 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:22.472+0000 7f559f30c640 1 -- 172.21.15.73:0/1379317981 shutdown_connections 2023-12-12T09:43:22.476 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:22.472+0000 7f559f30c640 1 --2- 172.21.15.73:0/1379317981 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f55840052a0 0x7f558400b980 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:22.476 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:22.472+0000 7f559f30c640 1 -- 172.21.15.73:0/1379317981 >> 172.21.15.73:0/1379317981 conn(0x7f55980c23b0 msgr2=0x7f55980c2790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:43:22.476 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:22.472+0000 7f559f30c640 1 -- 172.21.15.73:0/1379317981 shutdown_connections 2023-12-12T09:43:22.476 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:22.472+0000 7f559f30c640 1 -- 172.21.15.73:0/1379317981 wait complete. 2023-12-12T09:43:22.477 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:22.473+0000 7f559f30c640 1 Processor -- start 2023-12-12T09:43:22.477 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:22.473+0000 7f559f30c640 1 -- start start 2023-12-12T09:43:22.477 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:22.474+0000 7f559f30c640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f55840052a0 0x7f55980700d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:22.477 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:22.474+0000 7f559f30c640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f55980a4e20 0x7f5598154970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:22.477 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:22.474+0000 7f559f30c640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5598154eb0 0x7f559814cef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:22.477 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:22.474+0000 7f559f30c640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55980c1d40 con 0x7f55980a4e20 2023-12-12T09:43:22.477 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:22.474+0000 7f559f30c640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55980727b0 con 0x7f55840052a0 2023-12-12T09:43:22.477 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:22.474+0000 7f559f30c640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55981544e0 con 0x7f5598154eb0 2023-12-12T09:43:22.477 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:22.475+0000 7f559db09640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f55980a4e20 0x7f5598154970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:22.477 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:22.475+0000 7f559db09640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f55980a4e20 0x7f5598154970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:41150/0 (socket says 172.21.15.73:41150) 2023-12-12T09:43:22.477 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:22.475+0000 7f559db09640 1 -- 172.21.15.73:0/3847344939 learned_addr learned my addr 172.21.15.73:0/3847344939 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:43:22.477 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:22.475+0000 7f559eb0b640 1 --2- 172.21.15.73:0/3847344939 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5598154eb0 0x7f559814cef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:22.477 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:22.475+0000 7f559e30a640 1 --2- 172.21.15.73:0/3847344939 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f55840052a0 0x7f55980700d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:22.477 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:22.475+0000 7f559db09640 1 -- 172.21.15.73:0/3847344939 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5598154eb0 msgr2=0x7f559814cef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:22.477 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:22.475+0000 7f559db09640 1 --2- 172.21.15.73:0/3847344939 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5598154eb0 0x7f559814cef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:22.478 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:22.475+0000 7f559db09640 1 -- 172.21.15.73:0/3847344939 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f55840052a0 msgr2=0x7f55980700d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:22.478 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:22.475+0000 7f559db09640 1 --2- 172.21.15.73:0/3847344939 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f55840052a0 0x7f55980700d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:22.478 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:22.475+0000 7f559db09640 1 -- 172.21.15.73:0/3847344939 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5598155f60 con 0x7f55980a4e20 2023-12-12T09:43:22.478 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:22.475+0000 7f559db09640 1 --2- 172.21.15.73:0/3847344939 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f55980a4e20 0x7f5598154970 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f558800d5a0 tx=0x7f558800da60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:43:22.479 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:22.476+0000 7f558effd640 1 -- 172.21.15.73:0/3847344939 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5588016070 con 0x7f55980a4e20 2023-12-12T09:43:22.479 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:22.476+0000 7f558effd640 1 -- 172.21.15.73:0/3847344939 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5588005280 con 0x7f55980a4e20 2023-12-12T09:43:22.479 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:22.476+0000 7f558effd640 1 -- 172.21.15.73:0/3847344939 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5588007020 con 0x7f55980a4e20 2023-12-12T09:43:22.479 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:22.476+0000 7f559f30c640 1 -- 172.21.15.73:0/3847344939 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5598156240 con 0x7f55980a4e20 2023-12-12T09:43:22.479 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:22.476+0000 7f559f30c640 1 -- 172.21.15.73:0/3847344939 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5598155a90 con 0x7f55980a4e20 2023-12-12T09:43:22.479 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:22.477+0000 7f559f30c640 1 -- 172.21.15.73:0/3847344939 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f55980c55c0 con 0x7f55980a4e20 2023-12-12T09:43:22.479 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:22.478+0000 7f558effd640 1 -- 172.21.15.73:0/3847344939 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f5588007180 con 0x7f55980a4e20 2023-12-12T09:43:22.479 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:22.479+0000 7f558effd640 1 --2- 172.21.15.73:0/3847344939 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f557c06ae70 0x7f557c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:22.480 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:22.479+0000 7f558effd640 1 -- 172.21.15.73:0/3847344939 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5588088cd0 con 0x7f55980a4e20 2023-12-12T09:43:22.480 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:22.479+0000 7f559e30a640 1 --2- 172.21.15.73:0/3847344939 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f557c06ae70 0x7f557c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:22.480 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:22.480+0000 7f559e30a640 1 --2- 172.21.15.73:0/3847344939 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f557c06ae70 0x7f557c06d330 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f55940017a0 tx=0x7f5594009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:43:22.484 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:22.483+0000 7f558effd640 1 -- 172.21.15.73:0/3847344939 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f5588053e10 con 0x7f55980a4e20 2023-12-12T09:43:22.673 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:22.672+0000 7f559f30c640 1 -- 172.21.15.73:0/3847344939 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5598152cb0 con 0x7f55980a4e20 2023-12-12T09:43:22.676 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:22.675+0000 7f558effd640 1 -- 172.21.15.73:0/3847344939 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16530 (secure 0 0 0) 0x7f5598152cb0 con 0x7f55980a4e20 2023-12-12T09:43:22.677 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-12T09:43:22.677 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":20,"fsid":"ba240992-02b8-4c7e-92f2-27eb29ac433b","created":"2023-12-12T09:43:02.454719+0000","modified":"2023-12-12T09:43:21.720354+0000","last_up_change":"2023-12-12T09:43:13.913440+0000","last_in_change":"2023-12-12T09:43:05.925348+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-12T09:43:15.525508+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-12T09:43:20.004546+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-12T09:43:20.736500+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"dd9074be-dbe2-4c34-9896-a4223d8d3940","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":4047810203},{"type":"v1","addr":"172.21.15.73:6801","nonce":4047810203}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":4047810203},{"type":"v1","addr":"172.21.15.73:6803","nonce":4047810203}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":4047810203},{"type":"v1","addr":"172.21.15.73:6807","nonce":4047810203}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":4047810203},{"type":"v1","addr":"172.21.15.73:6805","nonce":4047810203}]},"public_addr":"172.21.15.73:6801/4047810203","cluster_addr":"172.21.15.73:6803/4047810203","heartbeat_back_addr":"172.21.15.73:6807/4047810203","heartbeat_front_addr":"172.21.15.73:6805/4047810203","state":["exists","up"]},{"osd":1,"uuid":"c4a05052-96d4-4758-a4e1-1a37f1e07fed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":1356058331},{"type":"v1","addr":"172.21.15.73:6824","nonce":1356058331}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":1356058331},{"type":"v1","addr":"172.21.15.73:6827","nonce":1356058331}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":1356058331},{"type":"v1","addr":"172.21.15.73:6831","nonce":1356058331}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":1356058331},{"type":"v1","addr":"172.21.15.73:6829","nonce":1356058331}]},"public_addr":"172.21.15.73:6824/1356058331","cluster_addr":"172.21.15.73:6827/1356058331","heartbeat_back_addr":"172.21.15.73:6831/1356058331","heartbeat_front_addr":"172.21.15.73:6829/1356058331","state":["exists","up"]},{"osd":2,"uuid":"512bc8ac-72c2-40d4-b3d2-d867a92c5213","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":1228903316},{"type":"v1","addr":"172.21.15.73:6817","nonce":1228903316}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":1228903316},{"type":"v1","addr":"172.21.15.73:6819","nonce":1228903316}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6823","nonce":1228903316},{"type":"v1","addr":"172.21.15.73:6825","nonce":1228903316}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":1228903316},{"type":"v1","addr":"172.21.15.73:6821","nonce":1228903316}]},"public_addr":"172.21.15.73:6817/1228903316","cluster_addr":"172.21.15.73:6819/1228903316","heartbeat_back_addr":"172.21.15.73:6825/1228903316","heartbeat_front_addr":"172.21.15.73:6821/1228903316","state":["exists","up"]},{"osd":3,"uuid":"3d1a91e0-42bf-437a-8eae-8d357c8f63a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":1293329670},{"type":"v1","addr":"172.21.15.73:6809","nonce":1293329670}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6810","nonce":1293329670},{"type":"v1","addr":"172.21.15.73:6811","nonce":1293329670}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":1293329670},{"type":"v1","addr":"172.21.15.73:6815","nonce":1293329670}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":1293329670},{"type":"v1","addr":"172.21.15.73:6813","nonce":1293329670}]},"public_addr":"172.21.15.73:6809/1293329670","cluster_addr":"172.21.15.73:6811/1293329670","heartbeat_back_addr":"172.21.15.73:6815/1293329670","heartbeat_front_addr":"172.21.15.73:6813/1293329670","state":["exists","up"]},{"osd":4,"uuid":"4b302fff-834c-4069-ac19-00e46f6c87b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":3727975702},{"type":"v1","addr":"172.21.15.142:6801","nonce":3727975702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":3727975702},{"type":"v1","addr":"172.21.15.142:6803","nonce":3727975702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6809","nonce":3727975702},{"type":"v1","addr":"172.21.15.142:6811","nonce":3727975702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6805","nonce":3727975702},{"type":"v1","addr":"172.21.15.142:6807","nonce":3727975702}]},"public_addr":"172.21.15.142:6801/3727975702","cluster_addr":"172.21.15.142:6803/3727975702","heartbeat_back_addr":"172.21.15.142:6811/3727975702","heartbeat_front_addr":"172.21.15.142:6807/3727975702","state":["exists","up"]},{"osd":5,"uuid":"d7cdace2-67d0-45cc-95f2-515cf6ef1b82","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6817","nonce":2353193632},{"type":"v1","addr":"172.21.15.142:6819","nonce":2353193632}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6821","nonce":2353193632},{"type":"v1","addr":"172.21.15.142:6823","nonce":2353193632}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6829","nonce":2353193632},{"type":"v1","addr":"172.21.15.142:6831","nonce":2353193632}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6825","nonce":2353193632},{"type":"v1","addr":"172.21.15.142:6827","nonce":2353193632}]},"public_addr":"172.21.15.142:6819/2353193632","cluster_addr":"172.21.15.142:6823/2353193632","heartbeat_back_addr":"172.21.15.142:6831/2353193632","heartbeat_front_addr":"172.21.15.142:6827/2353193632","state":["exists","up"]},{"osd":6,"uuid":"649ce78a-5626-445c-aedc-a651ed05a6f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":2006111986},{"type":"v1","addr":"172.21.15.142:6806","nonce":2006111986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":2006111986},{"type":"v1","addr":"172.21.15.142:6810","nonce":2006111986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":2006111986},{"type":"v1","addr":"172.21.15.142:6815","nonce":2006111986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":2006111986},{"type":"v1","addr":"172.21.15.142:6813","nonce":2006111986}]},"public_addr":"172.21.15.142:6806/2006111986","cluster_addr":"172.21.15.142:6810/2006111986","heartbeat_back_addr":"172.21.15.142:6815/2006111986","heartbeat_front_addr":"172.21.15.142:6813/2006111986","state":["exists","up"]},{"osd":7,"uuid":"af15ae3b-c1d0-4acf-92db-8a1805494d13","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":2573794341},{"type":"v1","addr":"172.21.15.142:6818","nonce":2573794341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":2573794341},{"type":"v1","addr":"172.21.15.142:6822","nonce":2573794341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":2573794341},{"type":"v1","addr":"172.21.15.142:6830","nonce":2573794341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":2573794341},{"type":"v1","addr":"172.21.15.142:6826","nonce":2573794341}]},"public_addr":"172.21.15.142:6818/2573794341","cluster_addr":"172.21.15.142:6822/2573794341","heartbeat_back_addr":"172.21.15.142:6830/2573794341","heartbeat_front_addr":"172.21.15.142:6826/2573794341","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.185824+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.262103+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.225556+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:10.523459+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:10.706035+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.257339+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.301776+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.051960+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-12T09:43:22.679 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:22.678+0000 7f559f30c640 1 -- 172.21.15.73:0/3847344939 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f557c06ae70 msgr2=0x7f557c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:22.679 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:22.678+0000 7f559f30c640 1 --2- 172.21.15.73:0/3847344939 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f557c06ae70 0x7f557c06d330 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f55940017a0 tx=0x7f5594009040 comp rx=0 tx=0).stop 2023-12-12T09:43:22.679 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:22.678+0000 7f559f30c640 1 -- 172.21.15.73:0/3847344939 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f55980a4e20 msgr2=0x7f5598154970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:22.679 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:22.678+0000 7f559f30c640 1 --2- 172.21.15.73:0/3847344939 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f55980a4e20 0x7f5598154970 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f558800d5a0 tx=0x7f558800da60 comp rx=0 tx=0).stop 2023-12-12T09:43:22.679 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:22.678+0000 7f559f30c640 1 -- 172.21.15.73:0/3847344939 shutdown_connections 2023-12-12T09:43:22.680 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:22.678+0000 7f559f30c640 1 --2- 172.21.15.73:0/3847344939 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f557c06ae70 0x7f557c06d330 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:22.680 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:22.678+0000 7f559f30c640 1 --2- 172.21.15.73:0/3847344939 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5598154eb0 0x7f559814cef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:22.680 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:22.678+0000 7f559f30c640 1 --2- 172.21.15.73:0/3847344939 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f55980a4e20 0x7f5598154970 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:22.680 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:22.678+0000 7f559f30c640 1 --2- 172.21.15.73:0/3847344939 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f55840052a0 0x7f55980700d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:22.680 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:22.678+0000 7f559f30c640 1 -- 172.21.15.73:0/3847344939 >> 172.21.15.73:0/3847344939 conn(0x7f55980c23b0 msgr2=0x7f55981512d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:43:22.680 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:22.678+0000 7f559f30c640 1 -- 172.21.15.73:0/3847344939 shutdown_connections 2023-12-12T09:43:22.680 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:22.678+0000 7f559f30c640 1 -- 172.21.15.73:0/3847344939 wait complete. 2023-12-12T09:43:22.697 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-12T09:43:22.907 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:22.906+0000 7f2cb6b47640 1 Processor -- start 2023-12-12T09:43:22.907 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:22.906+0000 7f2cb6b47640 1 -- start start 2023-12-12T09:43:22.909 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:22.907+0000 7f2cb6b47640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f2cb014fbb0 0x7f2cb00c09e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:22.909 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:22.907+0000 7f2cb6b47640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f2cb00a9470 0x7f2cb00ab510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:22.909 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:22.907+0000 7f2cb6b47640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2cb0153300 con 0x7f2cb00c0f20 2023-12-12T09:43:22.909 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:22.907+0000 7f2cb6b47640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2cb00aa000 con 0x7f2cb00a9470 2023-12-12T09:43:22.909 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:22.907+0000 7f2cb6b47640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2cb00c1d40 con 0x7f2cb014fbb0 2023-12-12T09:43:22.909 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:22.908+0000 7f2cb6346640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f2cb00a9470 0x7f2cb00ab510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:22.909 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:22.908+0000 7f2cb6346640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f2cb00a9470 0x7f2cb00ab510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:41164/0 (socket says 172.21.15.73:41164) 2023-12-12T09:43:22.909 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:22.908+0000 7f2cb6346640 1 -- 172.21.15.73:0/3969046032 learned_addr learned my addr 172.21.15.73:0/3969046032 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:43:22.909 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:22.908+0000 7f2cb5b45640 1 --2- 172.21.15.73:0/3969046032 >> v2:172.21.15.142:3300/0 conn(0x7f2cb014fbb0 0x7f2cb00c09e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:22.909 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:22.908+0000 7f2cb6346640 1 -- 172.21.15.73:0/3969046032 >> v2:172.21.15.142:3300/0 conn(0x7f2cb014fbb0 msgr2=0x7f2cb00c09e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:43:22.910 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:22.908+0000 7f2cb6346640 1 --2- 172.21.15.73:0/3969046032 >> v2:172.21.15.142:3300/0 conn(0x7f2cb014fbb0 0x7f2cb00c09e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:22.910 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:22.908+0000 7f2cb6346640 1 -- 172.21.15.73:0/3969046032 >> v1:172.21.15.73:6789/0 conn(0x7f2cb00c0f20 legacy=0x7f2cb00aae00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:22.910 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:22.908+0000 7f2cb6346640 1 -- 172.21.15.73:0/3969046032 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cb00c2160 con 0x7f2cb00a9470 2023-12-12T09:43:22.910 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:22.909+0000 7f2cb6346640 1 --2- 172.21.15.73:0/3969046032 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2cb00a9470 0x7f2cb00ab510 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f2cb00a9330 tx=0x7f2ca802bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4862ef718d562e2 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:43:22.910 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:22.909+0000 7f2cb4b43640 1 -- 172.21.15.73:0/3969046032 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ca802ca80 con 0x7f2cb00a9470 2023-12-12T09:43:22.910 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:22.909+0000 7f2cb4b43640 1 -- 172.21.15.73:0/3969046032 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ca802cbe0 con 0x7f2cb00a9470 2023-12-12T09:43:22.911 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:22.909+0000 7f2cb4b43640 1 -- 172.21.15.73:0/3969046032 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ca80343f0 con 0x7f2cb00a9470 2023-12-12T09:43:22.911 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:22.910+0000 7f2cb6b47640 1 -- 172.21.15.73:0/3969046032 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2cb00a9470 msgr2=0x7f2cb00ab510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:22.911 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:22.910+0000 7f2cb6b47640 1 --2- 172.21.15.73:0/3969046032 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2cb00a9470 0x7f2cb00ab510 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f2cb00a9330 tx=0x7f2ca802bee0 comp rx=0 tx=0).stop 2023-12-12T09:43:22.911 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:22.910+0000 7f2cb6b47640 1 -- 172.21.15.73:0/3969046032 shutdown_connections 2023-12-12T09:43:22.912 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:22.910+0000 7f2cb6b47640 1 --2- 172.21.15.73:0/3969046032 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2cb00a9470 0x7f2cb00ab510 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:22.912 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:22.910+0000 7f2cb6b47640 1 --2- 172.21.15.73:0/3969046032 >> v2:172.21.15.142:3300/0 conn(0x7f2cb014fbb0 0x7f2cb00c09e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:22.912 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:22.910+0000 7f2cb6b47640 1 -- 172.21.15.73:0/3969046032 >> 172.21.15.73:0/3969046032 conn(0x7f2cb00c23b0 msgr2=0x7f2cb00c2790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:43:22.912 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:22.910+0000 7f2cb6b47640 1 -- 172.21.15.73:0/3969046032 shutdown_connections 2023-12-12T09:43:22.912 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:22.910+0000 7f2cb6b47640 1 -- 172.21.15.73:0/3969046032 wait complete. 2023-12-12T09:43:22.913 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:22.912+0000 7f2cb6b47640 1 Processor -- start 2023-12-12T09:43:22.913 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:22.912+0000 7f2cb6b47640 1 -- start start 2023-12-12T09:43:22.914 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:22.913+0000 7f2cb6b47640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2cb00a9470 0x7f2cb00c4720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:22.914 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:22.913+0000 7f2cb6b47640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2cb00c0f20 0x7f2cb014c070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:22.914 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:22.913+0000 7f2cb6b47640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2cb014fbb0 0x7f2cb014c5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:22.914 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:22.913+0000 7f2cb6b47640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cb01dcf40 con 0x7f2cb014fbb0 2023-12-12T09:43:22.914 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:22.913+0000 7f2cb6b47640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cb01eafc0 con 0x7f2cb00a9470 2023-12-12T09:43:22.914 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:22.913+0000 7f2cb6b47640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2cb01eb2a0 con 0x7f2cb00c0f20 2023-12-12T09:43:22.914 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:22.913+0000 7f2cb6346640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2cb014fbb0 0x7f2cb014c5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:22.914 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:22.913+0000 7f2cb6346640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2cb014fbb0 0x7f2cb014c5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:41174/0 (socket says 172.21.15.73:41174) 2023-12-12T09:43:22.914 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:22.913+0000 7f2cb6346640 1 -- 172.21.15.73:0/1560346603 learned_addr learned my addr 172.21.15.73:0/1560346603 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:43:22.919 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:22.913+0000 7f2cb6346640 1 -- 172.21.15.73:0/1560346603 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2cb00c0f20 msgr2=0x7f2cb014c070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:22.919 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:22.913+0000 7f2cb6346640 1 --2- 172.21.15.73:0/1560346603 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2cb00c0f20 0x7f2cb014c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:22.919 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:22.913+0000 7f2cb6346640 1 -- 172.21.15.73:0/1560346603 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2cb00a9470 msgr2=0x7f2cb00c4720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:22.919 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:22.913+0000 7f2cb6346640 1 --2- 172.21.15.73:0/1560346603 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2cb00a9470 0x7f2cb00c4720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:22.919 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:22.913+0000 7f2cb6346640 1 -- 172.21.15.73:0/1560346603 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ca8009b30 con 0x7f2cb014fbb0 2023-12-12T09:43:22.919 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:22.914+0000 7f2cb6346640 1 --2- 172.21.15.73:0/1560346603 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2cb014fbb0 0x7f2cb014c5b0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f2ca8009e50 tx=0x7f2ca8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:43:22.920 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:22.914+0000 7f2ca27fc640 1 -- 172.21.15.73:0/1560346603 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ca8009510 con 0x7f2cb014fbb0 2023-12-12T09:43:22.920 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:22.914+0000 7f2ca27fc640 1 -- 172.21.15.73:0/1560346603 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ca803e450 con 0x7f2cb014fbb0 2023-12-12T09:43:22.920 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:22.914+0000 7f2ca27fc640 1 -- 172.21.15.73:0/1560346603 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ca803e800 con 0x7f2cb014fbb0 2023-12-12T09:43:22.920 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:22.914+0000 7f2cb6b47640 1 -- 172.21.15.73:0/1560346603 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2cb01eb580 con 0x7f2cb014fbb0 2023-12-12T09:43:22.920 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:22.914+0000 7f2cb6b47640 1 -- 172.21.15.73:0/1560346603 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2cb01ebb40 con 0x7f2cb014fbb0 2023-12-12T09:43:22.920 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:22.915+0000 7f2cb6b47640 1 -- 172.21.15.73:0/1560346603 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2cb0067400 con 0x7f2cb014fbb0 2023-12-12T09:43:22.920 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:22.916+0000 7f2ca27fc640 1 -- 172.21.15.73:0/1560346603 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f2ca802cd50 con 0x7f2cb014fbb0 2023-12-12T09:43:22.920 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:22.917+0000 7f2ca27fc640 1 --2- 172.21.15.73:0/1560346603 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f2c9406ae40 0x7f2c9406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:22.920 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:22.917+0000 7f2ca27fc640 1 -- 172.21.15.73:0/1560346603 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2ca80ac1a0 con 0x7f2cb014fbb0 2023-12-12T09:43:22.920 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:22.917+0000 7f2cb5b45640 1 --2- 172.21.15.73:0/1560346603 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f2c9406ae40 0x7f2c9406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:22.920 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:22.918+0000 7f2cb5b45640 1 --2- 172.21.15.73:0/1560346603 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f2c9406ae40 0x7f2c9406d300 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f2cac006fd0 tx=0x7f2cac008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:43:22.922 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:22.922+0000 7f2ca27fc640 1 -- 172.21.15.73:0/1560346603 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f2ca8077360 con 0x7f2cb014fbb0 2023-12-12T09:43:23.115 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:23.114+0000 7f2cb6b47640 1 -- 172.21.15.73:0/1560346603 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2cb00c04b0 con 0x7f2cb014fbb0 2023-12-12T09:43:23.116 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:23.116+0000 7f2ca27fc640 1 -- 172.21.15.73:0/1560346603 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16530 (secure 0 0 0) 0x7f2ca807a980 con 0x7f2cb014fbb0 2023-12-12T09:43:23.117 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-12T09:43:23.117 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":20,"fsid":"ba240992-02b8-4c7e-92f2-27eb29ac433b","created":"2023-12-12T09:43:02.454719+0000","modified":"2023-12-12T09:43:21.720354+0000","last_up_change":"2023-12-12T09:43:13.913440+0000","last_in_change":"2023-12-12T09:43:05.925348+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-12T09:43:15.525508+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-12T09:43:20.004546+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-12T09:43:20.736500+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"dd9074be-dbe2-4c34-9896-a4223d8d3940","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":4047810203},{"type":"v1","addr":"172.21.15.73:6801","nonce":4047810203}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":4047810203},{"type":"v1","addr":"172.21.15.73:6803","nonce":4047810203}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":4047810203},{"type":"v1","addr":"172.21.15.73:6807","nonce":4047810203}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":4047810203},{"type":"v1","addr":"172.21.15.73:6805","nonce":4047810203}]},"public_addr":"172.21.15.73:6801/4047810203","cluster_addr":"172.21.15.73:6803/4047810203","heartbeat_back_addr":"172.21.15.73:6807/4047810203","heartbeat_front_addr":"172.21.15.73:6805/4047810203","state":["exists","up"]},{"osd":1,"uuid":"c4a05052-96d4-4758-a4e1-1a37f1e07fed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":1356058331},{"type":"v1","addr":"172.21.15.73:6824","nonce":1356058331}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":1356058331},{"type":"v1","addr":"172.21.15.73:6827","nonce":1356058331}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":1356058331},{"type":"v1","addr":"172.21.15.73:6831","nonce":1356058331}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":1356058331},{"type":"v1","addr":"172.21.15.73:6829","nonce":1356058331}]},"public_addr":"172.21.15.73:6824/1356058331","cluster_addr":"172.21.15.73:6827/1356058331","heartbeat_back_addr":"172.21.15.73:6831/1356058331","heartbeat_front_addr":"172.21.15.73:6829/1356058331","state":["exists","up"]},{"osd":2,"uuid":"512bc8ac-72c2-40d4-b3d2-d867a92c5213","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":1228903316},{"type":"v1","addr":"172.21.15.73:6817","nonce":1228903316}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":1228903316},{"type":"v1","addr":"172.21.15.73:6819","nonce":1228903316}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6823","nonce":1228903316},{"type":"v1","addr":"172.21.15.73:6825","nonce":1228903316}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":1228903316},{"type":"v1","addr":"172.21.15.73:6821","nonce":1228903316}]},"public_addr":"172.21.15.73:6817/1228903316","cluster_addr":"172.21.15.73:6819/1228903316","heartbeat_back_addr":"172.21.15.73:6825/1228903316","heartbeat_front_addr":"172.21.15.73:6821/1228903316","state":["exists","up"]},{"osd":3,"uuid":"3d1a91e0-42bf-437a-8eae-8d357c8f63a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":1293329670},{"type":"v1","addr":"172.21.15.73:6809","nonce":1293329670}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6810","nonce":1293329670},{"type":"v1","addr":"172.21.15.73:6811","nonce":1293329670}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":1293329670},{"type":"v1","addr":"172.21.15.73:6815","nonce":1293329670}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":1293329670},{"type":"v1","addr":"172.21.15.73:6813","nonce":1293329670}]},"public_addr":"172.21.15.73:6809/1293329670","cluster_addr":"172.21.15.73:6811/1293329670","heartbeat_back_addr":"172.21.15.73:6815/1293329670","heartbeat_front_addr":"172.21.15.73:6813/1293329670","state":["exists","up"]},{"osd":4,"uuid":"4b302fff-834c-4069-ac19-00e46f6c87b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":3727975702},{"type":"v1","addr":"172.21.15.142:6801","nonce":3727975702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":3727975702},{"type":"v1","addr":"172.21.15.142:6803","nonce":3727975702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6809","nonce":3727975702},{"type":"v1","addr":"172.21.15.142:6811","nonce":3727975702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6805","nonce":3727975702},{"type":"v1","addr":"172.21.15.142:6807","nonce":3727975702}]},"public_addr":"172.21.15.142:6801/3727975702","cluster_addr":"172.21.15.142:6803/3727975702","heartbeat_back_addr":"172.21.15.142:6811/3727975702","heartbeat_front_addr":"172.21.15.142:6807/3727975702","state":["exists","up"]},{"osd":5,"uuid":"d7cdace2-67d0-45cc-95f2-515cf6ef1b82","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6817","nonce":2353193632},{"type":"v1","addr":"172.21.15.142:6819","nonce":2353193632}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6821","nonce":2353193632},{"type":"v1","addr":"172.21.15.142:6823","nonce":2353193632}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6829","nonce":2353193632},{"type":"v1","addr":"172.21.15.142:6831","nonce":2353193632}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6825","nonce":2353193632},{"type":"v1","addr":"172.21.15.142:6827","nonce":2353193632}]},"public_addr":"172.21.15.142:6819/2353193632","cluster_addr":"172.21.15.142:6823/2353193632","heartbeat_back_addr":"172.21.15.142:6831/2353193632","heartbeat_front_addr":"172.21.15.142:6827/2353193632","state":["exists","up"]},{"osd":6,"uuid":"649ce78a-5626-445c-aedc-a651ed05a6f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":2006111986},{"type":"v1","addr":"172.21.15.142:6806","nonce":2006111986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":2006111986},{"type":"v1","addr":"172.21.15.142:6810","nonce":2006111986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":2006111986},{"type":"v1","addr":"172.21.15.142:6815","nonce":2006111986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":2006111986},{"type":"v1","addr":"172.21.15.142:6813","nonce":2006111986}]},"public_addr":"172.21.15.142:6806/2006111986","cluster_addr":"172.21.15.142:6810/2006111986","heartbeat_back_addr":"172.21.15.142:6815/2006111986","heartbeat_front_addr":"172.21.15.142:6813/2006111986","state":["exists","up"]},{"osd":7,"uuid":"af15ae3b-c1d0-4acf-92db-8a1805494d13","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":2573794341},{"type":"v1","addr":"172.21.15.142:6818","nonce":2573794341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":2573794341},{"type":"v1","addr":"172.21.15.142:6822","nonce":2573794341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":2573794341},{"type":"v1","addr":"172.21.15.142:6830","nonce":2573794341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":2573794341},{"type":"v1","addr":"172.21.15.142:6826","nonce":2573794341}]},"public_addr":"172.21.15.142:6818/2573794341","cluster_addr":"172.21.15.142:6822/2573794341","heartbeat_back_addr":"172.21.15.142:6830/2573794341","heartbeat_front_addr":"172.21.15.142:6826/2573794341","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.185824+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.262103+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.225556+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:10.523459+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:10.706035+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.257339+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.301776+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.051960+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-12T09:43:23.119 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:23.118+0000 7f2cb6b47640 1 -- 172.21.15.73:0/1560346603 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f2c9406ae40 msgr2=0x7f2c9406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:23.120 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:23.118+0000 7f2cb6b47640 1 --2- 172.21.15.73:0/1560346603 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f2c9406ae40 0x7f2c9406d300 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f2cac006fd0 tx=0x7f2cac008040 comp rx=0 tx=0).stop 2023-12-12T09:43:23.120 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:23.118+0000 7f2cb6b47640 1 -- 172.21.15.73:0/1560346603 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2cb014fbb0 msgr2=0x7f2cb014c5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:23.120 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:23.118+0000 7f2cb6b47640 1 --2- 172.21.15.73:0/1560346603 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2cb014fbb0 0x7f2cb014c5b0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f2ca8009e50 tx=0x7f2ca8004a40 comp rx=0 tx=0).stop 2023-12-12T09:43:23.120 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:23.118+0000 7f2cb6b47640 1 -- 172.21.15.73:0/1560346603 shutdown_connections 2023-12-12T09:43:23.120 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:23.118+0000 7f2cb6b47640 1 --2- 172.21.15.73:0/1560346603 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f2c9406ae40 0x7f2c9406d300 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:23.120 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:23.118+0000 7f2cb6b47640 1 --2- 172.21.15.73:0/1560346603 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2cb014fbb0 0x7f2cb014c5b0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:23.120 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:23.118+0000 7f2cb6b47640 1 --2- 172.21.15.73:0/1560346603 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2cb00c0f20 0x7f2cb014c070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:23.120 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:23.118+0000 7f2cb6b47640 1 --2- 172.21.15.73:0/1560346603 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2cb00a9470 0x7f2cb00c4720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:23.120 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:23.118+0000 7f2cb6b47640 1 -- 172.21.15.73:0/1560346603 >> 172.21.15.73:0/1560346603 conn(0x7f2cb00c23b0 msgr2=0x7f2cb00c2790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:43:23.120 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:23.119+0000 7f2cb6b47640 1 -- 172.21.15.73:0/1560346603 shutdown_connections 2023-12-12T09:43:23.120 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:23.119+0000 7f2cb6b47640 1 -- 172.21.15.73:0/1560346603 wait complete. 2023-12-12T09:43:23.137 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-12-12T09:43:23.354 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:23.353+0000 7fb759cd7640 1 Processor -- start 2023-12-12T09:43:23.354 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:23.353+0000 7fb759cd7640 1 -- start start 2023-12-12T09:43:23.355 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:23.354+0000 7fb759cd7640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb7540c45b0 0x7fb7540c4a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:23.355 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:23.354+0000 7fb759cd7640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fb75406b590 0x7fb75406ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:23.355 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:23.354+0000 7fb759cd7640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb754157a70 con 0x7fb754151ac0 2023-12-12T09:43:23.356 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:23.354+0000 7fb759cd7640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7540c71e0 con 0x7fb75406b590 2023-12-12T09:43:23.356 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:23.354+0000 7fb759cd7640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7541586f0 con 0x7fb7540c45b0 2023-12-12T09:43:23.356 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:23.355+0000 7fb753fff640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb7540c45b0 0x7fb7540c4a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:23.356 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:23.355+0000 7fb758cd5640 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7fb754151ac0 0x7fb7540c7b30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.73:47264/0 (socket says 172.21.15.73:47264) 2023-12-12T09:43:23.356 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:23.355+0000 7fb758cd5640 1 -- 172.21.15.73:0/3852924170 learned_addr learned my addr 172.21.15.73:0/3852924170 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-12T09:43:23.356 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:23.355+0000 7fb7594d6640 1 --2- 172.21.15.73:0/3852924170 >> v2:172.21.15.142:3300/0 conn(0x7fb75406b590 0x7fb75406ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:23.357 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:23.356+0000 7fb7537fe640 1 -- 172.21.15.73:0/3852924170 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1740924397 0 0) 0x7fb754157a70 con 0x7fb754151ac0 2023-12-12T09:43:23.357 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:23.356+0000 7fb7537fe640 1 -- 172.21.15.73:0/3852924170 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb740003520 con 0x7fb754151ac0 2023-12-12T09:43:23.357 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:23.356+0000 7fb753fff640 1 -- 172.21.15.73:0/3852924170 >> v2:172.21.15.142:3300/0 conn(0x7fb75406b590 msgr2=0x7fb75406ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:43:23.357 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:23.356+0000 7fb753fff640 1 --2- 172.21.15.73:0/3852924170 >> v2:172.21.15.142:3300/0 conn(0x7fb75406b590 0x7fb75406ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:23.357 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:23.356+0000 7fb753fff640 1 -- 172.21.15.73:0/3852924170 >> v1:172.21.15.142:6789/0 conn(0x7fb754151ac0 legacy=0x7fb7540c7b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:23.357 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:23.356+0000 7fb753fff640 1 -- 172.21.15.73:0/3852924170 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb754157d50 con 0x7fb7540c45b0 2023-12-12T09:43:23.358 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:23.357+0000 7fb753fff640 1 --2- 172.21.15.73:0/3852924170 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb7540c45b0 0x7fb7540c4a10 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fb7440097a0 tx=0x7fb74402b7a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e1027a4e4f50fd7c server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:43:23.358 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:23.358+0000 7fb7537fe640 1 -- 172.21.15.73:0/3852924170 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb74402f050 con 0x7fb7540c45b0 2023-12-12T09:43:23.358 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:23.358+0000 7fb7537fe640 1 -- 172.21.15.73:0/3852924170 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb744031700 con 0x7fb7540c45b0 2023-12-12T09:43:23.359 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:23.358+0000 7fb7537fe640 1 -- 172.21.15.73:0/3852924170 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb744031a90 con 0x7fb7540c45b0 2023-12-12T09:43:23.359 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:23.358+0000 7fb759cd7640 1 -- 172.21.15.73:0/3852924170 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb7540c45b0 msgr2=0x7fb7540c4a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:23.359 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:23.358+0000 7fb759cd7640 1 --2- 172.21.15.73:0/3852924170 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb7540c45b0 0x7fb7540c4a10 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fb7440097a0 tx=0x7fb74402b7a0 comp rx=0 tx=0).stop 2023-12-12T09:43:23.359 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:23.358+0000 7fb759cd7640 1 -- 172.21.15.73:0/3852924170 shutdown_connections 2023-12-12T09:43:23.360 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:23.358+0000 7fb759cd7640 1 --2- 172.21.15.73:0/3852924170 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb7540c45b0 0x7fb7540c4a10 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:23.360 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:23.358+0000 7fb759cd7640 1 --2- 172.21.15.73:0/3852924170 >> v2:172.21.15.142:3300/0 conn(0x7fb75406b590 0x7fb75406ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:23.360 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:23.358+0000 7fb759cd7640 1 -- 172.21.15.73:0/3852924170 >> 172.21.15.73:0/3852924170 conn(0x7fb7540ab7e0 msgr2=0x7fb7540abbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:43:23.360 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:23.358+0000 7fb759cd7640 1 -- 172.21.15.73:0/3852924170 shutdown_connections 2023-12-12T09:43:23.360 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:23.358+0000 7fb759cd7640 1 -- 172.21.15.73:0/3852924170 wait complete. 2023-12-12T09:43:23.361 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:23.360+0000 7fb759cd7640 1 Processor -- start 2023-12-12T09:43:23.361 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:23.360+0000 7fb759cd7640 1 -- start start 2023-12-12T09:43:23.363 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:23.361+0000 7fb759cd7640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb75406b590 0x7fb754146bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:23.363 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:23.361+0000 7fb759cd7640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb7540c45b0 0x7fb754147130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:23.363 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:23.361+0000 7fb759cd7640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb754151ac0 0x7fb754155f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:23.364 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:23.361+0000 7fb759cd7640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb754155ad0 con 0x7fb7540c45b0 2023-12-12T09:43:23.364 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:23.361+0000 7fb759cd7640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7540ca790 con 0x7fb754151ac0 2023-12-12T09:43:23.364 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:23.361+0000 7fb759cd7640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7540c9ef0 con 0x7fb75406b590 2023-12-12T09:43:23.364 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:23.361+0000 7fb753fff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb7540c45b0 0x7fb754147130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:23.364 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:23.361+0000 7fb753fff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb7540c45b0 0x7fb754147130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:41180/0 (socket says 172.21.15.73:41180) 2023-12-12T09:43:23.364 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:23.361+0000 7fb753fff640 1 -- 172.21.15.73:0/1238332965 learned_addr learned my addr 172.21.15.73:0/1238332965 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:43:23.364 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:23.362+0000 7fb7594d6640 1 --2- 172.21.15.73:0/1238332965 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb754151ac0 0x7fb754155f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:23.364 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:23.362+0000 7fb758cd5640 1 --2- 172.21.15.73:0/1238332965 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb75406b590 0x7fb754146bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:23.364 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:23.362+0000 7fb753fff640 1 -- 172.21.15.73:0/1238332965 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb75406b590 msgr2=0x7fb754146bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:23.364 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:23.362+0000 7fb753fff640 1 --2- 172.21.15.73:0/1238332965 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb75406b590 0x7fb754146bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:23.364 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:23.362+0000 7fb753fff640 1 -- 172.21.15.73:0/1238332965 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb754151ac0 msgr2=0x7fb754155f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:23.364 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:23.362+0000 7fb753fff640 1 --2- 172.21.15.73:0/1238332965 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb754151ac0 0x7fb754155f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:23.364 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:23.362+0000 7fb753fff640 1 -- 172.21.15.73:0/1238332965 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb744009400 con 0x7fb7540c45b0 2023-12-12T09:43:23.364 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:23.362+0000 7fb758cd5640 1 --2- 172.21.15.73:0/1238332965 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb75406b590 0x7fb754146bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:43:23.365 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:23.362+0000 7fb7594d6640 1 --2- 172.21.15.73:0/1238332965 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb754151ac0 0x7fb754155f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:43:23.365 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:23.362+0000 7fb753fff640 1 --2- 172.21.15.73:0/1238332965 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb7540c45b0 0x7fb754147130 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fb744036040 tx=0x7fb7440046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:43:23.365 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:23.362+0000 7fb7517fa640 1 -- 172.21.15.73:0/1238332965 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb744031500 con 0x7fb7540c45b0 2023-12-12T09:43:23.365 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:23.362+0000 7fb7517fa640 1 -- 172.21.15.73:0/1238332965 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7440339b0 con 0x7fb7540c45b0 2023-12-12T09:43:23.365 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:23.362+0000 7fb759cd7640 1 -- 172.21.15.73:0/1238332965 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7540ca1d0 con 0x7fb7540c45b0 2023-12-12T09:43:23.365 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:23.362+0000 7fb7517fa640 1 -- 172.21.15.73:0/1238332965 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb744033d60 con 0x7fb7540c45b0 2023-12-12T09:43:23.365 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:23.363+0000 7fb759cd7640 1 -- 172.21.15.73:0/1238332965 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb754147670 con 0x7fb7540c45b0 2023-12-12T09:43:23.365 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:23.364+0000 7fb759cd7640 1 -- 172.21.15.73:0/1238332965 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb7540c5810 con 0x7fb7540c45b0 2023-12-12T09:43:23.365 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:23.364+0000 7fb7517fa640 1 -- 172.21.15.73:0/1238332965 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fb74403a040 con 0x7fb7540c45b0 2023-12-12T09:43:23.366 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:23.365+0000 7fb7517fa640 1 --2- 172.21.15.73:0/1238332965 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fb73406ae40 0x7fb73406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:23.366 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:23.365+0000 7fb7517fa640 1 -- 172.21.15.73:0/1238332965 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb7440aa950 con 0x7fb7540c45b0 2023-12-12T09:43:23.366 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:23.366+0000 7fb758cd5640 1 --2- 172.21.15.73:0/1238332965 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fb73406ae40 0x7fb73406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:23.367 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:23.366+0000 7fb758cd5640 1 --2- 172.21.15.73:0/1238332965 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fb73406ae40 0x7fb73406d300 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fb73c0011e0 tx=0x7fb73c009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:43:23.371 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:23.370+0000 7fb7517fa640 1 -- 172.21.15.73:0/1238332965 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fb7440758d0 con 0x7fb7540c45b0 2023-12-12T09:43:23.605 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:23.604+0000 7fb759cd7640 1 -- 172.21.15.73:0/1238332965 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fb754067400 con 0x7fb7540c45b0 2023-12-12T09:43:24.305 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:24.304+0000 7fb7517fa640 1 -- 172.21.15.73:0/1238332965 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v7) v1 ==== 118+0+0 (secure 0 0 0) 0x7fb744043070 con 0x7fb7540c45b0 2023-12-12T09:43:24.310 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:24.308+0000 7fb759cd7640 1 -- 172.21.15.73:0/1238332965 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fb73406ae40 msgr2=0x7fb73406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:24.310 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:24.308+0000 7fb759cd7640 1 --2- 172.21.15.73:0/1238332965 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fb73406ae40 0x7fb73406d300 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fb73c0011e0 tx=0x7fb73c009040 comp rx=0 tx=0).stop 2023-12-12T09:43:24.310 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:24.308+0000 7fb759cd7640 1 -- 172.21.15.73:0/1238332965 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb7540c45b0 msgr2=0x7fb754147130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:24.310 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:24.308+0000 7fb759cd7640 1 --2- 172.21.15.73:0/1238332965 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb7540c45b0 0x7fb754147130 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fb744036040 tx=0x7fb7440046c0 comp rx=0 tx=0).stop 2023-12-12T09:43:24.310 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:24.309+0000 7fb759cd7640 1 -- 172.21.15.73:0/1238332965 shutdown_connections 2023-12-12T09:43:24.310 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:24.309+0000 7fb759cd7640 1 --2- 172.21.15.73:0/1238332965 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fb73406ae40 0x7fb73406d300 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:24.310 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:24.309+0000 7fb759cd7640 1 --2- 172.21.15.73:0/1238332965 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb754151ac0 0x7fb754155f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:24.310 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:24.309+0000 7fb759cd7640 1 --2- 172.21.15.73:0/1238332965 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb7540c45b0 0x7fb754147130 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:24.310 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:24.309+0000 7fb759cd7640 1 --2- 172.21.15.73:0/1238332965 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb75406b590 0x7fb754146bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:24.310 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:24.309+0000 7fb759cd7640 1 -- 172.21.15.73:0/1238332965 >> 172.21.15.73:0/1238332965 conn(0x7fb7540ab7e0 msgr2=0x7fb75406ba10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:43:24.310 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:24.309+0000 7fb759cd7640 1 -- 172.21.15.73:0/1238332965 shutdown_connections 2023-12-12T09:43:24.310 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:24.309+0000 7fb759cd7640 1 -- 172.21.15.73:0/1238332965 wait complete. 2023-12-12T09:43:24.333 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-12-12T09:43:24.334 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-12-12T09:43:24.556 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:24.555+0000 7f9f3ed4c640 1 Processor -- start 2023-12-12T09:43:24.556 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:24.555+0000 7f9f3ed4c640 1 -- start start 2023-12-12T09:43:24.558 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:24.557+0000 7f9f3ed4c640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f9f380c67c0 0x7f9f380c7ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:24.558 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:24.557+0000 7f9f3ed4c640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f380c7030 con 0x7f9f380c6ba0 2023-12-12T09:43:24.558 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:24.557+0000 7f9f3ed4c640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f3806c890 con 0x7f9f381550a0 2023-12-12T09:43:24.558 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:24.557+0000 7f9f3ed4c640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f380c4af0 con 0x7f9f380c67c0 2023-12-12T09:43:24.558 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:24.558+0000 7f9f3cae8640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f9f380c67c0 0x7f9f380c7ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:24.558 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:24.558+0000 7f9f3cae8640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f9f380c67c0 0x7f9f380c7ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.73:49696/0 (socket says 172.21.15.73:49696) 2023-12-12T09:43:24.559 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:24.558+0000 7f9f3cae8640 1 -- 172.21.15.73:0/2534337787 learned_addr learned my addr 172.21.15.73:0/2534337787 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:43:24.559 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:24.558+0000 7f9f2f7fe640 1 -- 172.21.15.73:0/2534337787 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3560362033 0 0) 0x7f9f28001040 con 0x7f9f380c6ba0 2023-12-12T09:43:24.559 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:24.558+0000 7f9f3cae8640 1 -- 172.21.15.73:0/2534337787 >> v1:172.21.15.142:6789/0 conn(0x7f9f381550a0 legacy=0x7f9f3815efa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:24.559 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:24.558+0000 7f9f3cae8640 1 -- 172.21.15.73:0/2534337787 >> v1:172.21.15.73:6789/0 conn(0x7f9f380c6ba0 legacy=0x7f9f3806c180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:24.559 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:24.558+0000 7f9f3cae8640 1 -- 172.21.15.73:0/2534337787 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f380c4dd0 con 0x7f9f380c67c0 2023-12-12T09:43:24.561 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:24.560+0000 7f9f3cae8640 1 --2- 172.21.15.73:0/2534337787 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9f380c67c0 0x7f9f380c7ed0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f9f34009e50 tx=0x7f9f3402c010 comp rx=0 tx=0).ready entity=mon.1 client_cookie=43ff8f82ee508f91 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:43:24.561 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:24.560+0000 7f9f2f7fe640 1 -- 172.21.15.73:0/2534337787 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f3402cbb0 con 0x7f9f380c67c0 2023-12-12T09:43:24.561 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:24.561+0000 7f9f2f7fe640 1 -- 172.21.15.73:0/2534337787 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f3402cd10 con 0x7f9f380c67c0 2023-12-12T09:43:24.562 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:24.561+0000 7f9f2f7fe640 1 -- 172.21.15.73:0/2534337787 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f34034610 con 0x7f9f380c67c0 2023-12-12T09:43:24.568 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:24.561+0000 7f9f3ed4c640 1 -- 172.21.15.73:0/2534337787 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9f380c67c0 msgr2=0x7f9f380c7ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:24.568 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:24.561+0000 7f9f3ed4c640 1 --2- 172.21.15.73:0/2534337787 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9f380c67c0 0x7f9f380c7ed0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f9f34009e50 tx=0x7f9f3402c010 comp rx=0 tx=0).stop 2023-12-12T09:43:24.568 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:24.561+0000 7f9f3ed4c640 1 -- 172.21.15.73:0/2534337787 shutdown_connections 2023-12-12T09:43:24.568 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:24.561+0000 7f9f3ed4c640 1 --2- 172.21.15.73:0/2534337787 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9f380c67c0 0x7f9f380c7ed0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:24.568 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:24.561+0000 7f9f3ed4c640 1 -- 172.21.15.73:0/2534337787 >> 172.21.15.73:0/2534337787 conn(0x7f9f380abb20 msgr2=0x7f9f380abf30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:43:24.568 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:24.561+0000 7f9f3ed4c640 1 -- 172.21.15.73:0/2534337787 shutdown_connections 2023-12-12T09:43:24.568 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:24.561+0000 7f9f3ed4c640 1 -- 172.21.15.73:0/2534337787 wait complete. 2023-12-12T09:43:24.568 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:24.563+0000 7f9f3ed4c640 1 Processor -- start 2023-12-12T09:43:24.568 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:24.563+0000 7f9f3ed4c640 1 -- start start 2023-12-12T09:43:24.568 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:24.564+0000 7f9f3ed4c640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9f380c67c0 0x7f9f381565a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:24.568 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:24.564+0000 7f9f3ed4c640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9f380c6ba0 0x7f9f38156ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:24.568 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:24.564+0000 7f9f3ed4c640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9f381550a0 0x7f9f38158090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:24.569 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:24.564+0000 7f9f3ed4c640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f381ea600 con 0x7f9f380c67c0 2023-12-12T09:43:24.569 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:24.564+0000 7f9f3ed4c640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f380bd550 con 0x7f9f380c6ba0 2023-12-12T09:43:24.569 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:24.564+0000 7f9f3ed4c640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f38153830 con 0x7f9f381550a0 2023-12-12T09:43:24.569 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:24.564+0000 7f9f3cae8640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9f380c67c0 0x7f9f381565a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:24.569 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:24.564+0000 7f9f3cae8640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9f380c67c0 0x7f9f381565a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:41196/0 (socket says 172.21.15.73:41196) 2023-12-12T09:43:24.569 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:24.564+0000 7f9f3cae8640 1 -- 172.21.15.73:0/1783198548 learned_addr learned my addr 172.21.15.73:0/1783198548 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:43:24.569 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:24.565+0000 7f9f2ffff640 1 --2- 172.21.15.73:0/1783198548 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9f380c6ba0 0x7f9f38156ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:24.569 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:24.565+0000 7f9f3cae8640 1 -- 172.21.15.73:0/1783198548 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9f381550a0 msgr2=0x7f9f38158090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:24.569 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:24.565+0000 7f9f3d2e9640 1 --2- 172.21.15.73:0/1783198548 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9f381550a0 0x7f9f38158090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:24.569 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:24.565+0000 7f9f3cae8640 1 --2- 172.21.15.73:0/1783198548 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9f381550a0 0x7f9f38158090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:24.569 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:24.565+0000 7f9f3cae8640 1 -- 172.21.15.73:0/1783198548 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9f380c6ba0 msgr2=0x7f9f38156ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:24.569 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:24.565+0000 7f9f3cae8640 1 --2- 172.21.15.73:0/1783198548 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9f380c6ba0 0x7f9f38156ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:24.569 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:24.565+0000 7f9f3cae8640 1 -- 172.21.15.73:0/1783198548 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f34009b30 con 0x7f9f380c67c0 2023-12-12T09:43:24.569 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:24.565+0000 7f9f2ffff640 1 --2- 172.21.15.73:0/1783198548 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9f380c6ba0 0x7f9f38156ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:43:24.570 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:24.565+0000 7f9f3d2e9640 1 --2- 172.21.15.73:0/1783198548 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9f381550a0 0x7f9f38158090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:43:24.570 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:24.565+0000 7f9f3cae8640 1 --2- 172.21.15.73:0/1783198548 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9f380c67c0 0x7f9f381565a0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f9f34009e50 tx=0x7f9f34004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:43:24.570 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:24.566+0000 7f9f2d7fa640 1 -- 172.21.15.73:0/1783198548 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f3403e450 con 0x7f9f380c67c0 2023-12-12T09:43:24.570 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:24.566+0000 7f9f2d7fa640 1 -- 172.21.15.73:0/1783198548 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f3403e5d0 con 0x7f9f380c67c0 2023-12-12T09:43:24.570 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:24.566+0000 7f9f3ed4c640 1 -- 172.21.15.73:0/1783198548 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f38155d50 con 0x7f9f380c67c0 2023-12-12T09:43:24.570 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:24.566+0000 7f9f2d7fa640 1 -- 172.21.15.73:0/1783198548 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f3403e780 con 0x7f9f380c67c0 2023-12-12T09:43:24.570 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:24.566+0000 7f9f3ed4c640 1 -- 172.21.15.73:0/1783198548 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f38153dd0 con 0x7f9f380c67c0 2023-12-12T09:43:24.570 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:24.567+0000 7f9f3ed4c640 1 -- 172.21.15.73:0/1783198548 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f38067580 con 0x7f9f380c67c0 2023-12-12T09:43:24.571 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:24.568+0000 7f9f2d7fa640 1 -- 172.21.15.73:0/1783198548 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f9f3403e8e0 con 0x7f9f380c67c0 2023-12-12T09:43:24.571 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:24.569+0000 7f9f2d7fa640 1 --2- 172.21.15.73:0/1783198548 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f9f2406ae70 0x7f9f2406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:24.571 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:24.569+0000 7f9f2d7fa640 1 -- 172.21.15.73:0/1783198548 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9f340ac0c0 con 0x7f9f380c67c0 2023-12-12T09:43:24.571 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:24.569+0000 7f9f2ffff640 1 --2- 172.21.15.73:0/1783198548 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f9f2406ae70 0x7f9f2406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:24.571 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:24.570+0000 7f9f2ffff640 1 --2- 172.21.15.73:0/1783198548 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f9f2406ae70 0x7f9f2406d330 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f9f28007fd0 tx=0x7f9f28009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:43:24.574 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:24.573+0000 7f9f2d7fa640 1 -- 172.21.15.73:0/1783198548 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f9f34077170 con 0x7f9f380c67c0 2023-12-12T09:43:24.801 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:24.799+0000 7f9f3ed4c640 1 -- 172.21.15.73:0/1783198548 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f9f3806d140 con 0x7f9f380c67c0 2023-12-12T09:43:25.308 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:25.307+0000 7f9f2d7fa640 1 -- 172.21.15.73:0/1783198548 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v8) v1 ==== 122+0+0 (secure 0 0 0) 0x7f9f34033e80 con 0x7f9f380c67c0 2023-12-12T09:43:25.312 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:25.311+0000 7f9f3ed4c640 1 -- 172.21.15.73:0/1783198548 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f9f2406ae70 msgr2=0x7f9f2406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:25.312 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:25.311+0000 7f9f3ed4c640 1 --2- 172.21.15.73:0/1783198548 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f9f2406ae70 0x7f9f2406d330 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f9f28007fd0 tx=0x7f9f28009040 comp rx=0 tx=0).stop 2023-12-12T09:43:25.312 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:25.311+0000 7f9f3ed4c640 1 -- 172.21.15.73:0/1783198548 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9f380c67c0 msgr2=0x7f9f381565a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:25.312 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:25.311+0000 7f9f3ed4c640 1 --2- 172.21.15.73:0/1783198548 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9f380c67c0 0x7f9f381565a0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f9f34009e50 tx=0x7f9f34004a40 comp rx=0 tx=0).stop 2023-12-12T09:43:25.312 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:25.311+0000 7f9f3ed4c640 1 -- 172.21.15.73:0/1783198548 shutdown_connections 2023-12-12T09:43:25.312 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:25.311+0000 7f9f3ed4c640 1 --2- 172.21.15.73:0/1783198548 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f9f2406ae70 0x7f9f2406d330 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:25.312 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:25.311+0000 7f9f3ed4c640 1 --2- 172.21.15.73:0/1783198548 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9f381550a0 0x7f9f38158090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:25.312 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:25.311+0000 7f9f3ed4c640 1 --2- 172.21.15.73:0/1783198548 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9f380c6ba0 0x7f9f38156ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:25.313 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:25.311+0000 7f9f3ed4c640 1 --2- 172.21.15.73:0/1783198548 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9f380c67c0 0x7f9f381565a0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:25.313 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:25.311+0000 7f9f3ed4c640 1 -- 172.21.15.73:0/1783198548 >> 172.21.15.73:0/1783198548 conn(0x7f9f380abb20 msgr2=0x7f9f38146ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:43:25.313 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:25.311+0000 7f9f3ed4c640 1 -- 172.21.15.73:0/1783198548 shutdown_connections 2023-12-12T09:43:25.313 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:25.311+0000 7f9f3ed4c640 1 -- 172.21.15.73:0/1783198548 wait complete. 2023-12-12T09:43:25.333 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-12-12T09:43:25.334 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-12T09:43:25.536 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:25.535+0000 7faeae41e640 1 Processor -- start 2023-12-12T09:43:25.537 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:25.535+0000 7faeae41e640 1 -- start start 2023-12-12T09:43:25.540 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:25.537+0000 7faeae41e640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7faea81552e0 0x7faea80c49c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:25.540 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:25.537+0000 7faeae41e640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7faea806bf20 0x7faea80a9760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:25.540 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:25.537+0000 7faeae41e640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faea80c0b50 con 0x7faea80a50f0 2023-12-12T09:43:25.540 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:25.537+0000 7faeae41e640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faea80c04d0 con 0x7faea81552e0 2023-12-12T09:43:25.540 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:25.537+0000 7faeae41e640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faea806c880 con 0x7faea806bf20 2023-12-12T09:43:25.540 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:25.537+0000 7fae9ffff640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7faea80a50f0 0x7faea80a9050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:37298/0 (socket says 172.21.15.73:37298) 2023-12-12T09:43:25.540 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:25.537+0000 7fae9ffff640 1 -- 172.21.15.73:0/1175817869 learned_addr learned my addr 172.21.15.73:0/1175817869 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-12T09:43:25.540 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:25.537+0000 7faea77fe640 1 -- 172.21.15.73:0/1175817869 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3205756699 0 0) 0x7faea80c0b50 con 0x7faea80a50f0 2023-12-12T09:43:25.540 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:25.537+0000 7faeac9bb640 1 --2- 172.21.15.73:0/1175817869 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7faea806bf20 0x7faea80a9760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:25.540 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:25.537+0000 7faea77fe640 1 -- 172.21.15.73:0/1175817869 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fae94003520 con 0x7faea80a50f0 2023-12-12T09:43:25.541 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:25.537+0000 7faea7fff640 1 --2- 172.21.15.73:0/1175817869 >> v2:172.21.15.142:3300/0 conn(0x7faea81552e0 0x7faea80c49c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:25.541 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:25.538+0000 7faea77fe640 1 -- 172.21.15.73:0/1175817869 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2682584135 0 0) 0x7fae94003520 con 0x7faea80a50f0 2023-12-12T09:43:25.541 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:25.538+0000 7faea77fe640 1 -- 172.21.15.73:0/1175817869 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7faea806bf20 msgr2=0x7faea80a9760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:43:25.541 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:25.538+0000 7faea77fe640 1 --2- 172.21.15.73:0/1175817869 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7faea806bf20 0x7faea80a9760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:25.541 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:25.538+0000 7faea77fe640 1 -- 172.21.15.73:0/1175817869 >> v2:172.21.15.142:3300/0 conn(0x7faea81552e0 msgr2=0x7faea80c49c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:43:25.541 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:25.538+0000 7faea77fe640 1 --2- 172.21.15.73:0/1175817869 >> v2:172.21.15.142:3300/0 conn(0x7faea81552e0 0x7faea80c49c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:25.541 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:25.538+0000 7faea77fe640 1 -- 172.21.15.73:0/1175817869 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faea806cb60 con 0x7faea80a50f0 2023-12-12T09:43:25.541 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:25.538+0000 7faea77fe640 1 -- 172.21.15.73:0/1175817869 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3186547832 0 0) 0x7fae90001670 con 0x7faea80a50f0 2023-12-12T09:43:25.541 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:25.538+0000 7faea77fe640 1 -- 172.21.15.73:0/1175817869 >> v1:172.21.15.73:6789/0 conn(0x7faea80a50f0 legacy=0x7faea80a9050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:25.541 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:25.538+0000 7faea77fe640 1 --2- 172.21.15.73:0/1175817869 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7faea806bf20 0x7fae94003970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:25.541 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:25.538+0000 7faea77fe640 1 --2- 172.21.15.73:0/1175817869 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fae94003fa0 0x7fae940047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:25.541 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:25.538+0000 7faea77fe640 1 --2- 172.21.15.73:0/1175817869 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fae94004d00 0x7fae94005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:25.541 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:25.538+0000 7faea77fe640 1 -- 172.21.15.73:0/1175817869 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faea80c04d0 con 0x7fae94004d00 2023-12-12T09:43:25.541 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:25.538+0000 7faea77fe640 1 -- 172.21.15.73:0/1175817869 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faea806c880 con 0x7fae94003fa0 2023-12-12T09:43:25.542 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:25.538+0000 7faea77fe640 1 -- 172.21.15.73:0/1175817869 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae9400bb40 con 0x7faea806bf20 2023-12-12T09:43:25.542 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:25.538+0000 7faea7fff640 1 --2- 172.21.15.73:0/1175817869 >> v2:172.21.15.142:3300/0 conn(0x7faea81552e0 0x7faea80c49c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-12T09:43:25.542 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:25.538+0000 7faeac9bb640 1 --2- 172.21.15.73:0/1175817869 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fae94004d00 0x7fae94005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:25.542 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:25.539+0000 7fae9ffff640 1 --2- 172.21.15.73:0/1175817869 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fae94003fa0 0x7fae940047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:25.542 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:25.539+0000 7faeac9bb640 1 -- 172.21.15.73:0/1175817869 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7faea806bf20 msgr2=0x7fae94003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:43:25.542 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:25.539+0000 7faeac9bb640 1 --2- 172.21.15.73:0/1175817869 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7faea806bf20 0x7fae94003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:25.542 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:25.539+0000 7faeac9bb640 1 -- 172.21.15.73:0/1175817869 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fae94003fa0 msgr2=0x7fae940047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:43:25.542 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:25.539+0000 7faeac9bb640 1 --2- 172.21.15.73:0/1175817869 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fae94003fa0 0x7fae940047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:25.542 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:25.539+0000 7faeac9bb640 1 -- 172.21.15.73:0/1175817869 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae94003520 con 0x7fae94004d00 2023-12-12T09:43:25.542 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:25.539+0000 7fae9ffff640 1 --2- 172.21.15.73:0/1175817869 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fae94003fa0 0x7fae940047c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:43:25.543 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:25.540+0000 7faeac9bb640 1 --2- 172.21.15.73:0/1175817869 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fae94004d00 0x7fae94005180 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7faea000ba30 tx=0x7fae940057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73e01e6d2e5c519c server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:43:25.543 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:25.540+0000 7faea77fe640 1 -- 172.21.15.73:0/1175817869 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faea0032680 con 0x7fae94004d00 2023-12-12T09:43:25.544 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:25.540+0000 7faea77fe640 1 -- 172.21.15.73:0/1175817869 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faea00327e0 con 0x7fae94004d00 2023-12-12T09:43:25.544 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:25.540+0000 7faea77fe640 1 -- 172.21.15.73:0/1175817869 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faea0032b70 con 0x7fae94004d00 2023-12-12T09:43:25.544 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:25.540+0000 7faeae41e640 1 -- 172.21.15.73:0/1175817869 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fae94004d00 msgr2=0x7fae94005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:25.544 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:25.540+0000 7faeae41e640 1 --2- 172.21.15.73:0/1175817869 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fae94004d00 0x7fae94005180 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7faea000ba30 tx=0x7fae940057f0 comp rx=0 tx=0).stop 2023-12-12T09:43:25.544 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:25.540+0000 7faeac9bb640 1 -- 172.21.15.73:0/1175817869 reap_dead start 2023-12-12T09:43:25.544 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:25.541+0000 7faeae41e640 1 -- 172.21.15.73:0/1175817869 shutdown_connections 2023-12-12T09:43:25.544 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:25.541+0000 7faeae41e640 1 -- 172.21.15.73:0/1175817869 >> 172.21.15.73:0/1175817869 conn(0x7faea80a8130 msgr2=0x7faea80c24b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:43:25.544 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:25.541+0000 7faeae41e640 1 -- 172.21.15.73:0/1175817869 shutdown_connections 2023-12-12T09:43:25.544 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:25.541+0000 7faeae41e640 1 -- 172.21.15.73:0/1175817869 wait complete. 2023-12-12T09:43:25.544 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:25.542+0000 7faeae41e640 1 Processor -- start 2023-12-12T09:43:25.544 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:25.542+0000 7faeae41e640 1 -- start start 2023-12-12T09:43:25.546 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:25.543+0000 7faeae41e640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fae94004d00 0x7faea81541a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:25.546 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:25.543+0000 7faeae41e640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7faea80bf050 0x7faea81ed3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:25.546 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:25.543+0000 7faeae41e640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7faea81ed900 0x7faea8145bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:25.546 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:25.543+0000 7faeae41e640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faea81532a0 con 0x7faea80bf050 2023-12-12T09:43:25.546 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:25.543+0000 7faeae41e640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faea8153ab0 con 0x7fae94004d00 2023-12-12T09:43:25.546 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:25.543+0000 7faeae41e640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faea80bf860 con 0x7faea81ed900 2023-12-12T09:43:25.546 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:25.544+0000 7fae9ffff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7faea80bf050 0x7faea81ed3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:25.546 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:25.544+0000 7fae9ffff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7faea80bf050 0x7faea81ed3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:41224/0 (socket says 172.21.15.73:41224) 2023-12-12T09:43:25.546 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:25.544+0000 7fae9ffff640 1 -- 172.21.15.73:0/461258967 learned_addr learned my addr 172.21.15.73:0/461258967 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:43:25.546 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:25.544+0000 7fae9ffff640 1 -- 172.21.15.73:0/461258967 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7faea81ed900 msgr2=0x7faea8145bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:25.546 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:25.544+0000 7fae9ffff640 1 --2- 172.21.15.73:0/461258967 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7faea81ed900 0x7faea8145bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:25.547 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:25.544+0000 7fae9ffff640 1 -- 172.21.15.73:0/461258967 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fae94004d00 msgr2=0x7faea81541a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:25.547 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:25.544+0000 7fae9ffff640 1 --2- 172.21.15.73:0/461258967 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fae94004d00 0x7faea81541a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:25.547 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:25.544+0000 7fae9ffff640 1 -- 172.21.15.73:0/461258967 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faea81edd80 con 0x7faea80bf050 2023-12-12T09:43:25.547 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:25.544+0000 7fae9ffff640 1 --2- 172.21.15.73:0/461258967 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7faea80bf050 0x7faea81ed3c0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fae9000d8e0 tx=0x7fae9000dda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:43:25.547 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:25.544+0000 7faea57fa640 1 -- 172.21.15.73:0/461258967 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae900075a0 con 0x7faea80bf050 2023-12-12T09:43:25.547 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:25.545+0000 7faea57fa640 1 -- 172.21.15.73:0/461258967 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae900047e0 con 0x7faea80bf050 2023-12-12T09:43:25.547 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:25.545+0000 7faeae41e640 1 -- 172.21.15.73:0/461258967 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faea81534f0 con 0x7faea80bf050 2023-12-12T09:43:25.547 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:25.545+0000 7faea57fa640 1 -- 172.21.15.73:0/461258967 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae90004b50 con 0x7faea80bf050 2023-12-12T09:43:25.547 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:25.545+0000 7faeae41e640 1 -- 172.21.15.73:0/461258967 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faea806fdf0 con 0x7faea80bf050 2023-12-12T09:43:25.548 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:25.546+0000 7faeae41e640 1 -- 172.21.15.73:0/461258967 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faea806ffb0 con 0x7faea80bf050 2023-12-12T09:43:25.548 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:25.547+0000 7faea57fa640 1 -- 172.21.15.73:0/461258967 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fae90004cb0 con 0x7faea80bf050 2023-12-12T09:43:25.548 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:25.548+0000 7faea57fa640 1 --2- 172.21.15.73:0/461258967 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fae8806ae40 0x7fae8806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:25.548 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:25.548+0000 7faea57fa640 1 -- 172.21.15.73:0/461258967 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fae90089330 con 0x7faea80bf050 2023-12-12T09:43:25.549 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:25.548+0000 7faea7fff640 1 --2- 172.21.15.73:0/461258967 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fae8806ae40 0x7fae8806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:25.549 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:25.548+0000 7faea7fff640 1 --2- 172.21.15.73:0/461258967 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fae8806ae40 0x7fae8806d300 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fae98009fa0 tx=0x7fae980099e0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:43:25.553 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:25.552+0000 7faea57fa640 1 -- 172.21.15.73:0/461258967 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fae90054480 con 0x7faea80bf050 2023-12-12T09:43:25.782 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:25.780+0000 7faeae41e640 1 -- 172.21.15.73:0/461258967 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7faea8067580 con 0x7faea80bf050 2023-12-12T09:43:25.783 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:25.782+0000 7faea57fa640 1 -- 172.21.15.73:0/461258967 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4913 (secure 0 0 0) 0x7fae90057aa0 con 0x7faea80bf050 2023-12-12T09:43:25.783 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-12T09:43:25.783 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4257,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6835/1079394562","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":1079394562},{"type":"v1","addr":"172.21.15.73:6835","nonce":1079394562}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4258,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6835/3726638062","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6833","nonce":3726638062},{"type":"v1","addr":"172.21.15.142:6835","nonce":3726638062}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4260,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6837/2513898821","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6836","nonce":2513898821},{"type":"v1","addr":"172.21.15.73:6837","nonce":2513898821}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-12T09:43:21.720752+0000","modified":"2023-12-12T09:43:24.801495+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4269},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4269":{"gid":4269,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.142:6834/1773392257","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6832","nonce":1773392257},{"type":"v1","addr":"172.21.15.142:6834","nonce":1773392257}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-12-12T09:43:25.783 INFO:teuthology.orchestra.run.smithi073.stderr:dumped fsmap epoch 8 2023-12-12T09:43:25.785 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:25.784+0000 7faeae41e640 1 -- 172.21.15.73:0/461258967 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fae8806ae40 msgr2=0x7fae8806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:25.786 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:25.784+0000 7faeae41e640 1 --2- 172.21.15.73:0/461258967 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fae8806ae40 0x7fae8806d300 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fae98009fa0 tx=0x7fae980099e0 comp rx=0 tx=0).stop 2023-12-12T09:43:25.786 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:25.784+0000 7faeae41e640 1 -- 172.21.15.73:0/461258967 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7faea80bf050 msgr2=0x7faea81ed3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:25.786 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:25.784+0000 7faeae41e640 1 --2- 172.21.15.73:0/461258967 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7faea80bf050 0x7faea81ed3c0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fae9000d8e0 tx=0x7fae9000dda0 comp rx=0 tx=0).stop 2023-12-12T09:43:25.786 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:25.785+0000 7faeae41e640 1 -- 172.21.15.73:0/461258967 shutdown_connections 2023-12-12T09:43:25.786 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:25.785+0000 7faeae41e640 1 --2- 172.21.15.73:0/461258967 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fae8806ae40 0x7fae8806d300 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:25.786 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:25.785+0000 7faeae41e640 1 --2- 172.21.15.73:0/461258967 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7faea81ed900 0x7faea8145bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:25.786 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:25.785+0000 7faeae41e640 1 --2- 172.21.15.73:0/461258967 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7faea80bf050 0x7faea81ed3c0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:25.786 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:25.785+0000 7faeae41e640 1 --2- 172.21.15.73:0/461258967 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fae94004d00 0x7faea81541a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:25.786 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:25.785+0000 7faeae41e640 1 -- 172.21.15.73:0/461258967 >> 172.21.15.73:0/461258967 conn(0x7faea80a8130 msgr2=0x7faea81504b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:43:25.786 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:25.785+0000 7faeae41e640 1 -- 172.21.15.73:0/461258967 shutdown_connections 2023-12-12T09:43:25.786 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:25.785+0000 7faeae41e640 1 -- 172.21.15.73:0/461258967 wait complete. 2023-12-12T09:43:25.797 INFO:tasks.ceph.mds.d.smithi142.stderr:2023-12-12T09:43:25.796+0000 7fc3396ea640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-12-12T09:43:25.804 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-12T09:43:26.014 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:26.013+0000 7fe4d9209640 1 Processor -- start 2023-12-12T09:43:26.015 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:26.014+0000 7fe4d9209640 1 -- start start 2023-12-12T09:43:26.016 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:26.015+0000 7fe4d9209640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe4d4151e40 0x7fe4d40c6200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:26.016 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:26.015+0000 7fe4d9209640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fe4d40c7cb0 0x7fe4d406ab50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:26.016 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:26.015+0000 7fe4d9209640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4d40c49c0 con 0x7fe4d40c80f0 2023-12-12T09:43:26.016 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:26.015+0000 7fe4d9209640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4d406bad0 con 0x7fe4d40c7cb0 2023-12-12T09:43:26.016 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:26.015+0000 7fe4d9209640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4d40c5d70 con 0x7fe4d4151e40 2023-12-12T09:43:26.016 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:26.015+0000 7fe4cbfff640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fe4d40c7cb0 0x7fe4d406ab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:26.016 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:26.015+0000 7fe4cbfff640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fe4d40c7cb0 0x7fe4d406ab50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:41240/0 (socket says 172.21.15.73:41240) 2023-12-12T09:43:26.017 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:26.015+0000 7fe4cbfff640 1 -- 172.21.15.73:0/3376348881 learned_addr learned my addr 172.21.15.73:0/3376348881 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:43:26.017 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:26.015+0000 7fe4d359e640 1 --1- 172.21.15.73:0/3376348881 >> v1:172.21.15.73:6789/0 conn(0x7fe4d40c80f0 0x7fe4d406b090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:37310/0 (socket says 172.21.15.73:37310) 2023-12-12T09:43:26.017 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:26.016+0000 7fe4d2d9d640 1 --2- 172.21.15.73:0/3376348881 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe4d4151e40 0x7fe4d40c6200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:26.017 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:26.016+0000 7fe4cbfff640 1 -- 172.21.15.73:0/3376348881 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe4d4151e40 msgr2=0x7fe4d40c6200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:43:26.017 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:26.016+0000 7fe4cbfff640 1 --2- 172.21.15.73:0/3376348881 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe4d4151e40 0x7fe4d40c6200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:26.017 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:26.016+0000 7fe4cbfff640 1 -- 172.21.15.73:0/3376348881 >> v1:172.21.15.73:6789/0 conn(0x7fe4d40c80f0 legacy=0x7fe4d406b090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:26.018 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:26.016+0000 7fe4cbfff640 1 -- 172.21.15.73:0/3376348881 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4d4154640 con 0x7fe4d40c7cb0 2023-12-12T09:43:26.018 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:26.016+0000 7fe4d259c640 1 -- 172.21.15.73:0/3376348881 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 420508234 0 0) 0x7fe4d40c49c0 con 0x7fe4d40c80f0 2023-12-12T09:43:26.019 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:26.017+0000 7fe4cbfff640 1 --2- 172.21.15.73:0/3376348881 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe4d40c7cb0 0x7fe4d406ab50 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fe4bc009870 tx=0x7fe4bc02b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60bc50ffd3e3d3d3 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:43:26.019 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:26.017+0000 7fe4d259c640 1 -- 172.21.15.73:0/3376348881 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4bc030840 con 0x7fe4d40c7cb0 2023-12-12T09:43:26.019 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:26.017+0000 7fe4d259c640 1 -- 172.21.15.73:0/3376348881 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4bc0309a0 con 0x7fe4d40c7cb0 2023-12-12T09:43:26.019 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:26.017+0000 7fe4d259c640 1 -- 172.21.15.73:0/3376348881 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4bc030d30 con 0x7fe4d40c7cb0 2023-12-12T09:43:26.019 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:26.018+0000 7fe4d9209640 1 -- 172.21.15.73:0/3376348881 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe4d40c7cb0 msgr2=0x7fe4d406ab50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:26.019 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:26.018+0000 7fe4d9209640 1 --2- 172.21.15.73:0/3376348881 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe4d40c7cb0 0x7fe4d406ab50 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fe4bc009870 tx=0x7fe4bc02b980 comp rx=0 tx=0).stop 2023-12-12T09:43:26.019 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:26.018+0000 7fe4d9209640 1 -- 172.21.15.73:0/3376348881 shutdown_connections 2023-12-12T09:43:26.019 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:26.018+0000 7fe4d9209640 1 --2- 172.21.15.73:0/3376348881 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe4d40c7cb0 0x7fe4d406ab50 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:26.019 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:26.018+0000 7fe4d9209640 1 --2- 172.21.15.73:0/3376348881 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe4d4151e40 0x7fe4d40c6200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:26.019 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:26.018+0000 7fe4d9209640 1 -- 172.21.15.73:0/3376348881 >> 172.21.15.73:0/3376348881 conn(0x7fe4d40ab8a0 msgr2=0x7fe4d40abcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:43:26.019 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:26.018+0000 7fe4d9209640 1 -- 172.21.15.73:0/3376348881 shutdown_connections 2023-12-12T09:43:26.019 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:26.018+0000 7fe4d9209640 1 -- 172.21.15.73:0/3376348881 wait complete. 2023-12-12T09:43:26.020 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:26.020+0000 7fe4d9209640 1 Processor -- start 2023-12-12T09:43:26.020 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:26.020+0000 7fe4d9209640 1 -- start start 2023-12-12T09:43:26.022 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:26.021+0000 7fe4d9209640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe4d40c7cb0 0x7fe4d4150880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:26.022 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:26.021+0000 7fe4d9209640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe4d40c80f0 0x7fe4d4146f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:26.023 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:26.021+0000 7fe4d9209640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe4d4151e40 0x7fe4d4147460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:26.023 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:26.021+0000 7fe4d9209640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4d414dd50 con 0x7fe4d40c80f0 2023-12-12T09:43:26.023 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:26.021+0000 7fe4d9209640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4d414d1c0 con 0x7fe4d40c7cb0 2023-12-12T09:43:26.023 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:26.021+0000 7fe4d9209640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4d414f1e0 con 0x7fe4d4151e40 2023-12-12T09:43:26.023 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:26.021+0000 7fe4cbfff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe4d40c80f0 0x7fe4d4146f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:26.023 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:26.021+0000 7fe4cbfff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe4d40c80f0 0x7fe4d4146f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:41252/0 (socket says 172.21.15.73:41252) 2023-12-12T09:43:26.023 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:26.021+0000 7fe4cbfff640 1 -- 172.21.15.73:0/3312206860 learned_addr learned my addr 172.21.15.73:0/3312206860 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:43:26.023 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:26.021+0000 7fe4d359e640 1 --2- 172.21.15.73:0/3312206860 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe4d4151e40 0x7fe4d4147460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:26.023 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:26.021+0000 7fe4d2d9d640 1 --2- 172.21.15.73:0/3312206860 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe4d40c7cb0 0x7fe4d4150880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:26.023 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:26.021+0000 7fe4cbfff640 1 -- 172.21.15.73:0/3312206860 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe4d4151e40 msgr2=0x7fe4d4147460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:26.023 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:26.021+0000 7fe4cbfff640 1 --2- 172.21.15.73:0/3312206860 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe4d4151e40 0x7fe4d4147460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:26.023 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:26.021+0000 7fe4cbfff640 1 -- 172.21.15.73:0/3312206860 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe4d40c7cb0 msgr2=0x7fe4d4150880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:26.023 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:26.021+0000 7fe4cbfff640 1 --2- 172.21.15.73:0/3312206860 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe4d40c7cb0 0x7fe4d4150880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:26.024 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:26.021+0000 7fe4cbfff640 1 -- 172.21.15.73:0/3312206860 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4bc0094d0 con 0x7fe4d40c80f0 2023-12-12T09:43:26.024 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:26.022+0000 7fe4cbfff640 1 --2- 172.21.15.73:0/3312206860 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe4d40c80f0 0x7fe4d4146f20 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fe4bc02b9c0 tx=0x7fe4bc004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:43:26.024 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:26.022+0000 7fe4cb7fe640 1 -- 172.21.15.73:0/3312206860 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4bc039c90 con 0x7fe4d40c80f0 2023-12-12T09:43:26.024 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:26.022+0000 7fe4cb7fe640 1 -- 172.21.15.73:0/3312206860 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4bc039df0 con 0x7fe4d40c80f0 2023-12-12T09:43:26.024 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:26.022+0000 7fe4d9209640 1 -- 172.21.15.73:0/3312206860 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4d40c3610 con 0x7fe4d40c80f0 2023-12-12T09:43:26.025 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:26.022+0000 7fe4cb7fe640 1 -- 172.21.15.73:0/3312206860 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4bc0446c0 con 0x7fe4d40c80f0 2023-12-12T09:43:26.025 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:26.022+0000 7fe4d9209640 1 -- 172.21.15.73:0/3312206860 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4d414cee0 con 0x7fe4d40c80f0 2023-12-12T09:43:26.025 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:26.023+0000 7fe4d9209640 1 -- 172.21.15.73:0/3312206860 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe4d4067580 con 0x7fe4d40c80f0 2023-12-12T09:43:26.025 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:26.024+0000 7fe4cb7fe640 1 -- 172.21.15.73:0/3312206860 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fe4bc04d3b0 con 0x7fe4d40c80f0 2023-12-12T09:43:26.026 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:26.026+0000 7fe4cb7fe640 1 --2- 172.21.15.73:0/3312206860 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fe4b406ae40 0x7fe4b406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:26.027 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:26.026+0000 7fe4cb7fe640 1 -- 172.21.15.73:0/3312206860 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe4bc03e070 con 0x7fe4d40c80f0 2023-12-12T09:43:26.027 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:26.026+0000 7fe4d2d9d640 1 --2- 172.21.15.73:0/3312206860 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fe4b406ae40 0x7fe4b406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:26.027 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:26.026+0000 7fe4d2d9d640 1 --2- 172.21.15.73:0/3312206860 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fe4b406ae40 0x7fe4b406d300 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fe4c4006fd0 tx=0x7fe4c4008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:43:26.031 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:26.030+0000 7fe4cb7fe640 1 -- 172.21.15.73:0/3312206860 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fe4bc077170 con 0x7fe4d40c80f0 2023-12-12T09:43:26.221 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:26.220+0000 7fe4d9209640 1 -- 172.21.15.73:0/3312206860 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe4d40c6200 con 0x7fe4d40c80f0 2023-12-12T09:43:26.223 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:26.222+0000 7fe4cb7fe640 1 -- 172.21.15.73:0/3312206860 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16517 (secure 0 0 0) 0x7fe4bc07a790 con 0x7fe4d40c80f0 2023-12-12T09:43:26.224 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-12T09:43:26.224 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":21,"fsid":"ba240992-02b8-4c7e-92f2-27eb29ac433b","created":"2023-12-12T09:43:02.454719+0000","modified":"2023-12-12T09:43:23.219345+0000","last_up_change":"2023-12-12T09:43:13.913440+0000","last_in_change":"2023-12-12T09:43:05.925348+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-12T09:43:15.525508+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-12T09:43:20.004546+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-12T09:43:20.736500+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"dd9074be-dbe2-4c34-9896-a4223d8d3940","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":4047810203},{"type":"v1","addr":"172.21.15.73:6801","nonce":4047810203}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":4047810203},{"type":"v1","addr":"172.21.15.73:6803","nonce":4047810203}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":4047810203},{"type":"v1","addr":"172.21.15.73:6807","nonce":4047810203}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":4047810203},{"type":"v1","addr":"172.21.15.73:6805","nonce":4047810203}]},"public_addr":"172.21.15.73:6801/4047810203","cluster_addr":"172.21.15.73:6803/4047810203","heartbeat_back_addr":"172.21.15.73:6807/4047810203","heartbeat_front_addr":"172.21.15.73:6805/4047810203","state":["exists","up"]},{"osd":1,"uuid":"c4a05052-96d4-4758-a4e1-1a37f1e07fed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":1356058331},{"type":"v1","addr":"172.21.15.73:6824","nonce":1356058331}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":1356058331},{"type":"v1","addr":"172.21.15.73:6827","nonce":1356058331}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":1356058331},{"type":"v1","addr":"172.21.15.73:6831","nonce":1356058331}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":1356058331},{"type":"v1","addr":"172.21.15.73:6829","nonce":1356058331}]},"public_addr":"172.21.15.73:6824/1356058331","cluster_addr":"172.21.15.73:6827/1356058331","heartbeat_back_addr":"172.21.15.73:6831/1356058331","heartbeat_front_addr":"172.21.15.73:6829/1356058331","state":["exists","up"]},{"osd":2,"uuid":"512bc8ac-72c2-40d4-b3d2-d867a92c5213","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":1228903316},{"type":"v1","addr":"172.21.15.73:6817","nonce":1228903316}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":1228903316},{"type":"v1","addr":"172.21.15.73:6819","nonce":1228903316}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6823","nonce":1228903316},{"type":"v1","addr":"172.21.15.73:6825","nonce":1228903316}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":1228903316},{"type":"v1","addr":"172.21.15.73:6821","nonce":1228903316}]},"public_addr":"172.21.15.73:6817/1228903316","cluster_addr":"172.21.15.73:6819/1228903316","heartbeat_back_addr":"172.21.15.73:6825/1228903316","heartbeat_front_addr":"172.21.15.73:6821/1228903316","state":["exists","up"]},{"osd":3,"uuid":"3d1a91e0-42bf-437a-8eae-8d357c8f63a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":1293329670},{"type":"v1","addr":"172.21.15.73:6809","nonce":1293329670}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6810","nonce":1293329670},{"type":"v1","addr":"172.21.15.73:6811","nonce":1293329670}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":1293329670},{"type":"v1","addr":"172.21.15.73:6815","nonce":1293329670}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":1293329670},{"type":"v1","addr":"172.21.15.73:6813","nonce":1293329670}]},"public_addr":"172.21.15.73:6809/1293329670","cluster_addr":"172.21.15.73:6811/1293329670","heartbeat_back_addr":"172.21.15.73:6815/1293329670","heartbeat_front_addr":"172.21.15.73:6813/1293329670","state":["exists","up"]},{"osd":4,"uuid":"4b302fff-834c-4069-ac19-00e46f6c87b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":3727975702},{"type":"v1","addr":"172.21.15.142:6801","nonce":3727975702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":3727975702},{"type":"v1","addr":"172.21.15.142:6803","nonce":3727975702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6809","nonce":3727975702},{"type":"v1","addr":"172.21.15.142:6811","nonce":3727975702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6805","nonce":3727975702},{"type":"v1","addr":"172.21.15.142:6807","nonce":3727975702}]},"public_addr":"172.21.15.142:6801/3727975702","cluster_addr":"172.21.15.142:6803/3727975702","heartbeat_back_addr":"172.21.15.142:6811/3727975702","heartbeat_front_addr":"172.21.15.142:6807/3727975702","state":["exists","up"]},{"osd":5,"uuid":"d7cdace2-67d0-45cc-95f2-515cf6ef1b82","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6817","nonce":2353193632},{"type":"v1","addr":"172.21.15.142:6819","nonce":2353193632}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6821","nonce":2353193632},{"type":"v1","addr":"172.21.15.142:6823","nonce":2353193632}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6829","nonce":2353193632},{"type":"v1","addr":"172.21.15.142:6831","nonce":2353193632}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6825","nonce":2353193632},{"type":"v1","addr":"172.21.15.142:6827","nonce":2353193632}]},"public_addr":"172.21.15.142:6819/2353193632","cluster_addr":"172.21.15.142:6823/2353193632","heartbeat_back_addr":"172.21.15.142:6831/2353193632","heartbeat_front_addr":"172.21.15.142:6827/2353193632","state":["exists","up"]},{"osd":6,"uuid":"649ce78a-5626-445c-aedc-a651ed05a6f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":2006111986},{"type":"v1","addr":"172.21.15.142:6806","nonce":2006111986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":2006111986},{"type":"v1","addr":"172.21.15.142:6810","nonce":2006111986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":2006111986},{"type":"v1","addr":"172.21.15.142:6815","nonce":2006111986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":2006111986},{"type":"v1","addr":"172.21.15.142:6813","nonce":2006111986}]},"public_addr":"172.21.15.142:6806/2006111986","cluster_addr":"172.21.15.142:6810/2006111986","heartbeat_back_addr":"172.21.15.142:6815/2006111986","heartbeat_front_addr":"172.21.15.142:6813/2006111986","state":["exists","up"]},{"osd":7,"uuid":"af15ae3b-c1d0-4acf-92db-8a1805494d13","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":2573794341},{"type":"v1","addr":"172.21.15.142:6818","nonce":2573794341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":2573794341},{"type":"v1","addr":"172.21.15.142:6822","nonce":2573794341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":2573794341},{"type":"v1","addr":"172.21.15.142:6830","nonce":2573794341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":2573794341},{"type":"v1","addr":"172.21.15.142:6826","nonce":2573794341}]},"public_addr":"172.21.15.142:6818/2573794341","cluster_addr":"172.21.15.142:6822/2573794341","heartbeat_back_addr":"172.21.15.142:6830/2573794341","heartbeat_front_addr":"172.21.15.142:6826/2573794341","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.185824+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.262103+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.225556+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:10.523459+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:10.706035+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.257339+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.301776+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.051960+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-12T09:43:26.226 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:26.225+0000 7fe4d9209640 1 -- 172.21.15.73:0/3312206860 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fe4b406ae40 msgr2=0x7fe4b406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:26.226 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:26.225+0000 7fe4d9209640 1 --2- 172.21.15.73:0/3312206860 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fe4b406ae40 0x7fe4b406d300 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fe4c4006fd0 tx=0x7fe4c4008040 comp rx=0 tx=0).stop 2023-12-12T09:43:26.227 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:26.225+0000 7fe4d9209640 1 -- 172.21.15.73:0/3312206860 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe4d40c80f0 msgr2=0x7fe4d4146f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:26.227 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:26.225+0000 7fe4d9209640 1 --2- 172.21.15.73:0/3312206860 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe4d40c80f0 0x7fe4d4146f20 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fe4bc02b9c0 tx=0x7fe4bc004730 comp rx=0 tx=0).stop 2023-12-12T09:43:26.227 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:26.225+0000 7fe4d9209640 1 -- 172.21.15.73:0/3312206860 shutdown_connections 2023-12-12T09:43:26.227 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:26.225+0000 7fe4d9209640 1 --2- 172.21.15.73:0/3312206860 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fe4b406ae40 0x7fe4b406d300 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:26.227 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:26.225+0000 7fe4d9209640 1 --2- 172.21.15.73:0/3312206860 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe4d4151e40 0x7fe4d4147460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:26.227 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:26.225+0000 7fe4d9209640 1 --2- 172.21.15.73:0/3312206860 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe4d40c80f0 0x7fe4d4146f20 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:26.227 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:26.225+0000 7fe4d9209640 1 --2- 172.21.15.73:0/3312206860 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe4d40c7cb0 0x7fe4d4150880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:26.227 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:26.225+0000 7fe4d9209640 1 -- 172.21.15.73:0/3312206860 >> 172.21.15.73:0/3312206860 conn(0x7fe4d40ab8a0 msgr2=0x7fe4d40a9810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:43:26.227 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:26.225+0000 7fe4d9209640 1 -- 172.21.15.73:0/3312206860 shutdown_connections 2023-12-12T09:43:26.227 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:26.225+0000 7fe4d9209640 1 -- 172.21.15.73:0/3312206860 wait complete. 2023-12-12T09:43:26.246 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-12-12T09:43:26.246 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-12T09:43:26.455 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:26.454+0000 7f2211a07640 1 Processor -- start 2023-12-12T09:43:26.455 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:26.454+0000 7f2211a07640 1 -- start start 2023-12-12T09:43:26.457 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:26.456+0000 7f2211a07640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f220c06db70 0x7f220c0c39b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:26.457 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:26.456+0000 7f2211a07640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f220c0c5070 0x7f220c0c3ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:26.457 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:26.456+0000 7f2211a07640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f220c152610 con 0x7f220c14fa40 2023-12-12T09:43:26.457 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:26.456+0000 7f2211a07640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f220c1528f0 con 0x7f220c0c5070 2023-12-12T09:43:26.457 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:26.456+0000 7f2211a07640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f220c152bd0 con 0x7f220c06db70 2023-12-12T09:43:26.457 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:26.456+0000 7f220b7fe640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f220c0c5070 0x7f220c0c3ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:26.457 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:26.456+0000 7f220b7fe640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f220c0c5070 0x7f220c0c3ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:41264/0 (socket says 172.21.15.73:41264) 2023-12-12T09:43:26.457 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:26.456+0000 7f220b7fe640 1 -- 172.21.15.73:0/3033202008 learned_addr learned my addr 172.21.15.73:0/3033202008 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:43:26.458 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:26.456+0000 7f22027fc640 1 --2- 172.21.15.73:0/3033202008 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f220c06db70 0x7f220c0c39b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:26.458 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:26.457+0000 7f220b7fe640 1 -- 172.21.15.73:0/3033202008 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f220c06db70 msgr2=0x7f220c0c39b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:43:26.458 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:26.457+0000 7f220b7fe640 1 --2- 172.21.15.73:0/3033202008 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f220c06db70 0x7f220c0c39b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:26.458 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:26.457+0000 7f220b7fe640 1 -- 172.21.15.73:0/3033202008 >> v1:172.21.15.142:6789/0 conn(0x7f220c14fa40 legacy=0x7f220c06a4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:43:26.458 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:26.457+0000 7f220b7fe640 1 -- 172.21.15.73:0/3033202008 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f220c152eb0 con 0x7f220c0c5070 2023-12-12T09:43:26.459 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:26.458+0000 7f220b7fe640 1 --2- 172.21.15.73:0/3033202008 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f220c0c5070 0x7f220c0c3ef0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f2204009870 tx=0x7f220402b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dde9a710b60b7208 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:43:26.459 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:26.458+0000 7f220a7fc640 1 -- 172.21.15.73:0/3033202008 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2204031640 con 0x7f220c0c5070 2023-12-12T09:43:26.459 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:26.458+0000 7f220a7fc640 1 -- 172.21.15.73:0/3033202008 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22040317a0 con 0x7f220c0c5070 2023-12-12T09:43:26.460 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:26.458+0000 7f220a7fc640 1 -- 172.21.15.73:0/3033202008 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2204031b30 con 0x7f220c0c5070 2023-12-12T09:43:26.460 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:26.459+0000 7f2211a07640 1 -- 172.21.15.73:0/3033202008 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f220c0c5070 msgr2=0x7f220c0c3ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:26.460 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:26.459+0000 7f2211a07640 1 --2- 172.21.15.73:0/3033202008 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f220c0c5070 0x7f220c0c3ef0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f2204009870 tx=0x7f220402b8f0 comp rx=0 tx=0).stop 2023-12-12T09:43:26.461 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:26.459+0000 7f2211a07640 1 -- 172.21.15.73:0/3033202008 shutdown_connections 2023-12-12T09:43:26.461 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:26.459+0000 7f2211a07640 1 --2- 172.21.15.73:0/3033202008 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f220c0c5070 0x7f220c0c3ef0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:26.461 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:26.459+0000 7f2211a07640 1 --2- 172.21.15.73:0/3033202008 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f220c06db70 0x7f220c0c39b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:26.461 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:26.459+0000 7f2211a07640 1 -- 172.21.15.73:0/3033202008 >> 172.21.15.73:0/3033202008 conn(0x7f220c0a8130 msgr2=0x7f220c0c24b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:43:26.461 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:26.459+0000 7f2211a07640 1 -- 172.21.15.73:0/3033202008 shutdown_connections 2023-12-12T09:43:26.461 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:26.459+0000 7f2211a07640 1 -- 172.21.15.73:0/3033202008 wait complete. 2023-12-12T09:43:26.462 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:26.461+0000 7f2211a07640 1 Processor -- start 2023-12-12T09:43:26.462 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:26.461+0000 7f2211a07640 1 -- start start 2023-12-12T09:43:26.464 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:26.462+0000 7f2211a07640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f220c06db70 0x7f220c1d8920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:26.464 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:26.462+0000 7f2211a07640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f220c0c5070 0x7f220c1e0ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:26.464 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:26.462+0000 7f2211a07640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f220c14fa40 0x7f220c150c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:26.464 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:26.462+0000 7f2211a07640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f220c150840 con 0x7f220c0c5070 2023-12-12T09:43:26.464 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:26.462+0000 7f2211a07640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f220c1db430 con 0x7f220c06db70 2023-12-12T09:43:26.465 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:26.462+0000 7f2211a07640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f220c1517f0 con 0x7f220c14fa40 2023-12-12T09:43:26.465 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:26.462+0000 7f22027fc640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f220c0c5070 0x7f220c1e0ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:26.465 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:26.462+0000 7f22027fc640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f220c0c5070 0x7f220c1e0ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:41274/0 (socket says 172.21.15.73:41274) 2023-12-12T09:43:26.465 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:26.462+0000 7f22027fc640 1 -- 172.21.15.73:0/2155708136 learned_addr learned my addr 172.21.15.73:0/2155708136 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:43:26.465 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:26.463+0000 7f220b7fe640 1 --2- 172.21.15.73:0/2155708136 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f220c14fa40 0x7f220c150c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:26.465 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:26.463+0000 7f220affd640 1 --2- 172.21.15.73:0/2155708136 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f220c06db70 0x7f220c1d8920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:26.465 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:26.463+0000 7f22027fc640 1 -- 172.21.15.73:0/2155708136 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f220c14fa40 msgr2=0x7f220c150c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:26.465 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:26.463+0000 7f22027fc640 1 --2- 172.21.15.73:0/2155708136 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f220c14fa40 0x7f220c150c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:26.465 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:26.463+0000 7f22027fc640 1 -- 172.21.15.73:0/2155708136 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f220c06db70 msgr2=0x7f220c1d8920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:26.465 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:26.463+0000 7f22027fc640 1 --2- 172.21.15.73:0/2155708136 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f220c06db70 0x7f220c1d8920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:26.465 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:26.463+0000 7f22027fc640 1 -- 172.21.15.73:0/2155708136 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22040094d0 con 0x7f220c0c5070 2023-12-12T09:43:26.465 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:26.463+0000 7f220affd640 1 --2- 172.21.15.73:0/2155708136 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f220c06db70 0x7f220c1d8920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:43:26.465 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:26.463+0000 7f22027fc640 1 --2- 172.21.15.73:0/2155708136 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f220c0c5070 0x7f220c1e0ec0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f21f400d5d0 tx=0x7f21f400da90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:43:26.465 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:26.463+0000 7f2208ff9640 1 -- 172.21.15.73:0/2155708136 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21f4004240 con 0x7f220c0c5070 2023-12-12T09:43:26.466 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:26.463+0000 7f2208ff9640 1 -- 172.21.15.73:0/2155708136 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21f40043a0 con 0x7f220c0c5070 2023-12-12T09:43:26.466 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:26.463+0000 7f2208ff9640 1 -- 172.21.15.73:0/2155708136 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21f4003830 con 0x7f220c0c5070 2023-12-12T09:43:26.466 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:26.463+0000 7f2211a07640 1 -- 172.21.15.73:0/2155708136 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f220c151ad0 con 0x7f220c0c5070 2023-12-12T09:43:26.466 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:26.463+0000 7f2211a07640 1 -- 172.21.15.73:0/2155708136 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f220c1e1400 con 0x7f220c0c5070 2023-12-12T09:43:26.466 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:26.464+0000 7f2211a07640 1 -- 172.21.15.73:0/2155708136 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f220c067580 con 0x7f220c0c5070 2023-12-12T09:43:26.466 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:26.465+0000 7f2208ff9640 1 -- 172.21.15.73:0/2155708136 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f21f4003990 con 0x7f220c0c5070 2023-12-12T09:43:26.467 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:26.466+0000 7f2208ff9640 1 --2- 172.21.15.73:0/2155708136 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f21ec06ae40 0x7f21ec06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:26.467 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:26.466+0000 7f2208ff9640 1 -- 172.21.15.73:0/2155708136 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f21f40898f0 con 0x7f220c0c5070 2023-12-12T09:43:26.467 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:26.467+0000 7f220affd640 1 --2- 172.21.15.73:0/2155708136 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f21ec06ae40 0x7f21ec06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:26.468 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:26.467+0000 7f220affd640 1 --2- 172.21.15.73:0/2155708136 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f21ec06ae40 0x7f21ec06d300 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f21fc004520 tx=0x7f21fc009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:43:26.471 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:26.471+0000 7f2208ff9640 1 -- 172.21.15.73:0/2155708136 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f21f4054900 con 0x7f220c0c5070 2023-12-12T09:43:26.661 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:26.660+0000 7f2211a07640 1 -- 172.21.15.73:0/2155708136 --> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f220c0c31a0 con 0x7f21ec06ae40 2023-12-12T09:43:26.679 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:26.679+0000 7f2208ff9640 1 -- 172.21.15.73:0/2155708136 <== mgr.4110 v2:172.21.15.73:6832/779985841 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264556 (secure 0 0 0) 0x7f21fc00d8d0 con 0x7f21ec06ae40 2023-12-12T09:43:26.685 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-12T09:43:26.687 INFO:teuthology.orchestra.run.smithi073.stderr:dumped all 2023-12-12T09:43:26.689 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:26.683+0000 7f2211a07640 1 -- 172.21.15.73:0/2155708136 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f21ec06ae40 msgr2=0x7f21ec06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:26.689 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:26.683+0000 7f2211a07640 1 --2- 172.21.15.73:0/2155708136 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f21ec06ae40 0x7f21ec06d300 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f21fc004520 tx=0x7f21fc009040 comp rx=0 tx=0).stop 2023-12-12T09:43:26.689 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:26.683+0000 7f2211a07640 1 -- 172.21.15.73:0/2155708136 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f220c0c5070 msgr2=0x7f220c1e0ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:26.690 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:26.683+0000 7f2211a07640 1 --2- 172.21.15.73:0/2155708136 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f220c0c5070 0x7f220c1e0ec0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f21f400d5d0 tx=0x7f21f400da90 comp rx=0 tx=0).stop 2023-12-12T09:43:26.690 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:26.684+0000 7f2211a07640 1 -- 172.21.15.73:0/2155708136 shutdown_connections 2023-12-12T09:43:26.690 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:26.684+0000 7f2211a07640 1 --2- 172.21.15.73:0/2155708136 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f21ec06ae40 0x7f21ec06d300 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:26.690 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:26.684+0000 7f2211a07640 1 --2- 172.21.15.73:0/2155708136 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f220c14fa40 0x7f220c150c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:26.690 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:26.684+0000 7f2211a07640 1 --2- 172.21.15.73:0/2155708136 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f220c0c5070 0x7f220c1e0ec0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:26.690 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:26.684+0000 7f2211a07640 1 --2- 172.21.15.73:0/2155708136 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f220c06db70 0x7f220c1d8920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:26.690 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:26.684+0000 7f2211a07640 1 -- 172.21.15.73:0/2155708136 >> 172.21.15.73:0/2155708136 conn(0x7f220c0a8130 msgr2=0x7f220c0c1cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:43:26.690 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:26.684+0000 7f2211a07640 1 -- 172.21.15.73:0/2155708136 shutdown_connections 2023-12-12T09:43:26.690 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:26.684+0000 7f2211a07640 1 -- 172.21.15.73:0/2155708136 wait complete. 2023-12-12T09:43:26.704 INFO:teuthology.orchestra.run.smithi073.stdout:{"pg_ready":true,"pg_map":{"version":20,"stamp":"2023-12-12T09:43:25.456166+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":143,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218100,"kb_used_data":1876,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754756620,"statfs":{"total":773094113280,"available":772870778880,"internally_reserved":0,"allocated":1921024,"data_stored":1783904,"data_compressed":64844,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":31,"apply_latency_ms":31,"commit_latency_ns":31000000,"apply_latency_ns":31000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":10,"num_read_kb":9,"num_write":58,"num_write_kb":276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.975410"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-12-12T09:43:23.513587+0000","last_change":"2023-12-12T09:43:22.259173+0000","last_active":"2023-12-12T09:43:23.513587+0000","last_peered":"2023-12-12T09:43:23.513587+0000","last_clean":"2023-12-12T09:43:23.513587+0000","last_became_active":"2023-12-12T09:43:22.257823+0000","last_became_peered":"2023-12-12T09:43:22.257823+0000","last_unstale":"2023-12-12T09:43:23.513587+0000","last_undegraded":"2023-12-12T09:43:23.513587+0000","last_fullsized":"2023-12-12T09:43:23.513587+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_clean_scrub_stamp":"2023-12-12T09:43:21.241417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T11:44:44.846070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-12-12T09:43:23.228756+0000","last_change":"2023-12-12T09:43:22.246332+0000","last_active":"2023-12-12T09:43:23.228756+0000","last_peered":"2023-12-12T09:43:23.228756+0000","last_clean":"2023-12-12T09:43:23.228756+0000","last_became_active":"2023-12-12T09:43:22.245968+0000","last_became_peered":"2023-12-12T09:43:22.245968+0000","last_unstale":"2023-12-12T09:43:23.228756+0000","last_undegraded":"2023-12-12T09:43:23.228756+0000","last_fullsized":"2023-12-12T09:43:23.228756+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_clean_scrub_stamp":"2023-12-12T09:43:21.241417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T13:28:21.176910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-12-12T09:43:23.512350+0000","last_change":"2023-12-12T09:43:22.256406+0000","last_active":"2023-12-12T09:43:23.512350+0000","last_peered":"2023-12-12T09:43:23.512350+0000","last_clean":"2023-12-12T09:43:23.512350+0000","last_became_active":"2023-12-12T09:43:22.256051+0000","last_became_peered":"2023-12-12T09:43:22.256051+0000","last_unstale":"2023-12-12T09:43:23.512350+0000","last_undegraded":"2023-12-12T09:43:23.512350+0000","last_fullsized":"2023-12-12T09:43:23.512350+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_clean_scrub_stamp":"2023-12-12T09:43:21.241417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T11:56:43.095343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-12-12T09:43:23.232452+0000","last_change":"2023-12-12T09:43:22.270381+0000","last_active":"2023-12-12T09:43:23.232452+0000","last_peered":"2023-12-12T09:43:23.232452+0000","last_clean":"2023-12-12T09:43:23.232452+0000","last_became_active":"2023-12-12T09:43:22.270156+0000","last_became_peered":"2023-12-12T09:43:22.270156+0000","last_unstale":"2023-12-12T09:43:23.232452+0000","last_undegraded":"2023-12-12T09:43:23.232452+0000","last_fullsized":"2023-12-12T09:43:23.232452+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_clean_scrub_stamp":"2023-12-12T09:43:21.241417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T12:09:32.290407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-12-12T09:43:23.512600+0000","last_change":"2023-12-12T09:43:22.256406+0000","last_active":"2023-12-12T09:43:23.512600+0000","last_peered":"2023-12-12T09:43:23.512600+0000","last_clean":"2023-12-12T09:43:23.512600+0000","last_became_active":"2023-12-12T09:43:22.256089+0000","last_became_peered":"2023-12-12T09:43:22.256089+0000","last_unstale":"2023-12-12T09:43:23.512600+0000","last_undegraded":"2023-12-12T09:43:23.512600+0000","last_fullsized":"2023-12-12T09:43:23.512600+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_clean_scrub_stamp":"2023-12-12T09:43:21.241417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T12:08:27.288104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-12-12T09:43:23.231961+0000","last_change":"2023-12-12T09:43:22.262100+0000","last_active":"2023-12-12T09:43:23.231961+0000","last_peered":"2023-12-12T09:43:23.231961+0000","last_clean":"2023-12-12T09:43:23.231961+0000","last_became_active":"2023-12-12T09:43:22.250378+0000","last_became_peered":"2023-12-12T09:43:22.250378+0000","last_unstale":"2023-12-12T09:43:23.231961+0000","last_undegraded":"2023-12-12T09:43:23.231961+0000","last_fullsized":"2023-12-12T09:43:23.231961+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_clean_scrub_stamp":"2023-12-12T09:43:21.241417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T13:28:21.176910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-12-12T09:43:23.511903+0000","last_change":"2023-12-12T09:43:22.257819+0000","last_active":"2023-12-12T09:43:23.511903+0000","last_peered":"2023-12-12T09:43:23.511903+0000","last_clean":"2023-12-12T09:43:23.511903+0000","last_became_active":"2023-12-12T09:43:22.257516+0000","last_became_peered":"2023-12-12T09:43:22.257516+0000","last_unstale":"2023-12-12T09:43:23.511903+0000","last_undegraded":"2023-12-12T09:43:23.511903+0000","last_fullsized":"2023-12-12T09:43:23.511903+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_clean_scrub_stamp":"2023-12-12T09:43:21.241417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T13:22:21.650455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-12-12T09:43:23.511693+0000","last_change":"2023-12-12T09:43:22.250148+0000","last_active":"2023-12-12T09:43:23.511693+0000","last_peered":"2023-12-12T09:43:23.511693+0000","last_clean":"2023-12-12T09:43:23.511693+0000","last_became_active":"2023-12-12T09:43:22.249829+0000","last_became_peered":"2023-12-12T09:43:22.249829+0000","last_unstale":"2023-12-12T09:43:23.511693+0000","last_undegraded":"2023-12-12T09:43:23.511693+0000","last_fullsized":"2023-12-12T09:43:23.511693+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_clean_scrub_stamp":"2023-12-12T09:43:21.241417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T10:01:50.869497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-12-12T09:43:23.513773+0000","last_change":"2023-12-12T09:43:22.283672+0000","last_active":"2023-12-12T09:43:23.513773+0000","last_peered":"2023-12-12T09:43:23.513773+0000","last_clean":"2023-12-12T09:43:23.513773+0000","last_became_active":"2023-12-12T09:43:22.283234+0000","last_became_peered":"2023-12-12T09:43:22.283234+0000","last_unstale":"2023-12-12T09:43:23.513773+0000","last_undegraded":"2023-12-12T09:43:23.513773+0000","last_fullsized":"2023-12-12T09:43:23.513773+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_clean_scrub_stamp":"2023-12-12T09:43:21.241417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T20:45:26.767222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-12-12T09:43:23.235723+0000","last_change":"2023-12-12T09:43:22.271352+0000","last_active":"2023-12-12T09:43:23.235723+0000","last_peered":"2023-12-12T09:43:23.235723+0000","last_clean":"2023-12-12T09:43:23.235723+0000","last_became_active":"2023-12-12T09:43:22.271056+0000","last_became_peered":"2023-12-12T09:43:22.271056+0000","last_unstale":"2023-12-12T09:43:23.235723+0000","last_undegraded":"2023-12-12T09:43:23.235723+0000","last_fullsized":"2023-12-12T09:43:23.235723+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_clean_scrub_stamp":"2023-12-12T09:43:21.241417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T13:28:21.176910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-12-12T09:43:23.235191+0000","last_change":"2023-12-12T09:43:22.271790+0000","last_active":"2023-12-12T09:43:23.235191+0000","last_peered":"2023-12-12T09:43:23.235191+0000","last_clean":"2023-12-12T09:43:23.235191+0000","last_became_active":"2023-12-12T09:43:22.271591+0000","last_became_peered":"2023-12-12T09:43:22.271591+0000","last_unstale":"2023-12-12T09:43:23.235191+0000","last_undegraded":"2023-12-12T09:43:23.235191+0000","last_fullsized":"2023-12-12T09:43:23.235191+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_clean_scrub_stamp":"2023-12-12T09:43:21.241417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T17:19:30.590382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-12-12T09:43:23.511156+0000","last_change":"2023-12-12T09:43:22.260477+0000","last_active":"2023-12-12T09:43:23.511156+0000","last_peered":"2023-12-12T09:43:23.511156+0000","last_clean":"2023-12-12T09:43:23.511156+0000","last_became_active":"2023-12-12T09:43:22.258474+0000","last_became_peered":"2023-12-12T09:43:22.258474+0000","last_unstale":"2023-12-12T09:43:23.511156+0000","last_undegraded":"2023-12-12T09:43:23.511156+0000","last_fullsized":"2023-12-12T09:43:23.511156+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_clean_scrub_stamp":"2023-12-12T09:43:21.241417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T17:30:21.214675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-12-12T09:43:23.513789+0000","last_change":"2023-12-12T09:43:22.256210+0000","last_active":"2023-12-12T09:43:23.513789+0000","last_peered":"2023-12-12T09:43:23.513789+0000","last_clean":"2023-12-12T09:43:23.513789+0000","last_became_active":"2023-12-12T09:43:22.255873+0000","last_became_peered":"2023-12-12T09:43:22.255873+0000","last_unstale":"2023-12-12T09:43:23.513789+0000","last_undegraded":"2023-12-12T09:43:23.513789+0000","last_fullsized":"2023-12-12T09:43:23.513789+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_clean_scrub_stamp":"2023-12-12T09:43:21.241417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T12:09:32.290407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-12-12T09:43:23.509500+0000","last_change":"2023-12-12T09:43:22.261015+0000","last_active":"2023-12-12T09:43:23.509500+0000","last_peered":"2023-12-12T09:43:23.509500+0000","last_clean":"2023-12-12T09:43:23.509500+0000","last_became_active":"2023-12-12T09:43:22.260799+0000","last_became_peered":"2023-12-12T09:43:22.260799+0000","last_unstale":"2023-12-12T09:43:23.509500+0000","last_undegraded":"2023-12-12T09:43:23.509500+0000","last_fullsized":"2023-12-12T09:43:23.509500+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_clean_scrub_stamp":"2023-12-12T09:43:21.241417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T17:13:30.502374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-12-12T09:43:23.228621+0000","last_change":"2023-12-12T09:43:22.251732+0000","last_active":"2023-12-12T09:43:23.228621+0000","last_peered":"2023-12-12T09:43:23.228621+0000","last_clean":"2023-12-12T09:43:23.228621+0000","last_became_active":"2023-12-12T09:43:22.251022+0000","last_became_peered":"2023-12-12T09:43:22.251022+0000","last_unstale":"2023-12-12T09:43:23.228621+0000","last_undegraded":"2023-12-12T09:43:23.228621+0000","last_fullsized":"2023-12-12T09:43:23.228621+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_clean_scrub_stamp":"2023-12-12T09:43:21.241417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T11:56:43.095343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-12-12T09:43:23.231963+0000","last_change":"2023-12-12T09:43:22.249945+0000","last_active":"2023-12-12T09:43:23.231963+0000","last_peered":"2023-12-12T09:43:23.231963+0000","last_clean":"2023-12-12T09:43:23.231963+0000","last_became_active":"2023-12-12T09:43:22.248947+0000","last_became_peered":"2023-12-12T09:43:22.248947+0000","last_unstale":"2023-12-12T09:43:23.231963+0000","last_undegraded":"2023-12-12T09:43:23.231963+0000","last_fullsized":"2023-12-12T09:43:23.231963+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_clean_scrub_stamp":"2023-12-12T09:43:21.241417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T10:52:36.164447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-12-12T09:43:23.234030+0000","last_change":"2023-12-12T09:43:22.269637+0000","last_active":"2023-12-12T09:43:23.234030+0000","last_peered":"2023-12-12T09:43:23.234030+0000","last_clean":"2023-12-12T09:43:23.234030+0000","last_became_active":"2023-12-12T09:43:22.269332+0000","last_became_peered":"2023-12-12T09:43:22.269332+0000","last_unstale":"2023-12-12T09:43:23.234030+0000","last_undegraded":"2023-12-12T09:43:23.234030+0000","last_fullsized":"2023-12-12T09:43:23.234030+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_clean_scrub_stamp":"2023-12-12T09:43:21.241417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T16:30:08.113732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-12-12T09:43:23.514190+0000","last_change":"2023-12-12T09:43:22.253973+0000","last_active":"2023-12-12T09:43:23.514190+0000","last_peered":"2023-12-12T09:43:23.514190+0000","last_clean":"2023-12-12T09:43:23.514190+0000","last_became_active":"2023-12-12T09:43:22.253518+0000","last_became_peered":"2023-12-12T09:43:22.253518+0000","last_unstale":"2023-12-12T09:43:23.514190+0000","last_undegraded":"2023-12-12T09:43:23.514190+0000","last_fullsized":"2023-12-12T09:43:23.514190+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_clean_scrub_stamp":"2023-12-12T09:43:21.241417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T11:40:42.785424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-12-12T09:43:23.512776+0000","last_change":"2023-12-12T09:43:22.260001+0000","last_active":"2023-12-12T09:43:23.512776+0000","last_peered":"2023-12-12T09:43:23.512776+0000","last_clean":"2023-12-12T09:43:23.512776+0000","last_became_active":"2023-12-12T09:43:22.259694+0000","last_became_peered":"2023-12-12T09:43:22.259694+0000","last_unstale":"2023-12-12T09:43:23.512776+0000","last_undegraded":"2023-12-12T09:43:23.512776+0000","last_fullsized":"2023-12-12T09:43:23.512776+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_clean_scrub_stamp":"2023-12-12T09:43:21.241417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T13:12:59.364006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-12-12T09:43:23.235234+0000","last_change":"2023-12-12T09:43:22.261171+0000","last_active":"2023-12-12T09:43:23.235234+0000","last_peered":"2023-12-12T09:43:23.235234+0000","last_clean":"2023-12-12T09:43:23.235234+0000","last_became_active":"2023-12-12T09:43:22.257505+0000","last_became_peered":"2023-12-12T09:43:22.257505+0000","last_unstale":"2023-12-12T09:43:23.235234+0000","last_undegraded":"2023-12-12T09:43:23.235234+0000","last_fullsized":"2023-12-12T09:43:23.235234+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_clean_scrub_stamp":"2023-12-12T09:43:21.241417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T11:56:43.095343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-12-12T09:43:23.510222+0000","last_change":"2023-12-12T09:43:22.249523+0000","last_active":"2023-12-12T09:43:23.510222+0000","last_peered":"2023-12-12T09:43:23.510222+0000","last_clean":"2023-12-12T09:43:23.510222+0000","last_became_active":"2023-12-12T09:43:22.249225+0000","last_became_peered":"2023-12-12T09:43:22.249225+0000","last_unstale":"2023-12-12T09:43:23.510222+0000","last_undegraded":"2023-12-12T09:43:23.510222+0000","last_fullsized":"2023-12-12T09:43:23.510222+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_clean_scrub_stamp":"2023-12-12T09:43:21.241417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T20:17:31.359873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-12-12T09:43:23.232234+0000","last_change":"2023-12-12T09:43:22.262015+0000","last_active":"2023-12-12T09:43:23.232234+0000","last_peered":"2023-12-12T09:43:23.232234+0000","last_clean":"2023-12-12T09:43:23.232234+0000","last_became_active":"2023-12-12T09:43:22.249119+0000","last_became_peered":"2023-12-12T09:43:22.249119+0000","last_unstale":"2023-12-12T09:43:23.232234+0000","last_undegraded":"2023-12-12T09:43:23.232234+0000","last_fullsized":"2023-12-12T09:43:23.232234+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_clean_scrub_stamp":"2023-12-12T09:43:21.241417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T19:41:10.137746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-12-12T09:43:23.511791+0000","last_change":"2023-12-12T09:43:22.262018+0000","last_active":"2023-12-12T09:43:23.511791+0000","last_peered":"2023-12-12T09:43:23.511791+0000","last_clean":"2023-12-12T09:43:23.511791+0000","last_became_active":"2023-12-12T09:43:22.261664+0000","last_became_peered":"2023-12-12T09:43:22.261664+0000","last_unstale":"2023-12-12T09:43:23.511791+0000","last_undegraded":"2023-12-12T09:43:23.511791+0000","last_fullsized":"2023-12-12T09:43:23.511791+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_clean_scrub_stamp":"2023-12-12T09:43:21.241417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T17:19:30.590382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-12-12T09:43:23.232314+0000","last_change":"2023-12-12T09:43:22.262378+0000","last_active":"2023-12-12T09:43:23.232314+0000","last_peered":"2023-12-12T09:43:23.232314+0000","last_clean":"2023-12-12T09:43:23.232314+0000","last_became_active":"2023-12-12T09:43:22.257809+0000","last_became_peered":"2023-12-12T09:43:22.257809+0000","last_unstale":"2023-12-12T09:43:23.232314+0000","last_undegraded":"2023-12-12T09:43:23.232314+0000","last_fullsized":"2023-12-12T09:43:23.232314+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_clean_scrub_stamp":"2023-12-12T09:43:21.241417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T13:17:19.564666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-12-12T09:43:23.512246+0000","last_change":"2023-12-12T09:43:22.255723+0000","last_active":"2023-12-12T09:43:23.512246+0000","last_peered":"2023-12-12T09:43:23.512246+0000","last_clean":"2023-12-12T09:43:23.512246+0000","last_became_active":"2023-12-12T09:43:22.255373+0000","last_became_peered":"2023-12-12T09:43:22.255373+0000","last_unstale":"2023-12-12T09:43:23.512246+0000","last_undegraded":"2023-12-12T09:43:23.512246+0000","last_fullsized":"2023-12-12T09:43:23.512246+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_clean_scrub_stamp":"2023-12-12T09:43:21.241417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T10:52:36.164447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-12-12T09:43:23.235623+0000","last_change":"2023-12-12T09:43:22.257161+0000","last_active":"2023-12-12T09:43:23.235623+0000","last_peered":"2023-12-12T09:43:23.235623+0000","last_clean":"2023-12-12T09:43:23.235623+0000","last_became_active":"2023-12-12T09:43:22.256836+0000","last_became_peered":"2023-12-12T09:43:22.256836+0000","last_unstale":"2023-12-12T09:43:23.235623+0000","last_undegraded":"2023-12-12T09:43:23.235623+0000","last_fullsized":"2023-12-12T09:43:23.235623+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_clean_scrub_stamp":"2023-12-12T09:43:21.241417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T10:52:36.164447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-12-12T09:43:23.228750+0000","last_change":"2023-12-12T09:43:22.248044+0000","last_active":"2023-12-12T09:43:23.228750+0000","last_peered":"2023-12-12T09:43:23.228750+0000","last_clean":"2023-12-12T09:43:23.228750+0000","last_became_active":"2023-12-12T09:43:22.247775+0000","last_became_peered":"2023-12-12T09:43:22.247775+0000","last_unstale":"2023-12-12T09:43:23.228750+0000","last_undegraded":"2023-12-12T09:43:23.228750+0000","last_fullsized":"2023-12-12T09:43:23.228750+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_clean_scrub_stamp":"2023-12-12T09:43:21.241417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T10:52:36.164447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-12-12T09:43:23.512629+0000","last_change":"2023-12-12T09:43:22.254318+0000","last_active":"2023-12-12T09:43:23.512629+0000","last_peered":"2023-12-12T09:43:23.512629+0000","last_clean":"2023-12-12T09:43:23.512629+0000","last_became_active":"2023-12-12T09:43:22.253983+0000","last_became_peered":"2023-12-12T09:43:22.253983+0000","last_unstale":"2023-12-12T09:43:23.512629+0000","last_undegraded":"2023-12-12T09:43:23.512629+0000","last_fullsized":"2023-12-12T09:43:23.512629+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_clean_scrub_stamp":"2023-12-12T09:43:21.241417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T13:17:19.564666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-12-12T09:43:23.510548+0000","last_change":"2023-12-12T09:43:22.259144+0000","last_active":"2023-12-12T09:43:23.510548+0000","last_peered":"2023-12-12T09:43:23.510548+0000","last_clean":"2023-12-12T09:43:23.510548+0000","last_became_active":"2023-12-12T09:43:22.258791+0000","last_became_peered":"2023-12-12T09:43:22.258791+0000","last_unstale":"2023-12-12T09:43:23.510548+0000","last_undegraded":"2023-12-12T09:43:23.510548+0000","last_fullsized":"2023-12-12T09:43:23.510548+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_clean_scrub_stamp":"2023-12-12T09:43:21.241417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T10:01:50.869497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-12-12T09:43:23.232428+0000","last_change":"2023-12-12T09:43:22.262253+0000","last_active":"2023-12-12T09:43:23.232428+0000","last_peered":"2023-12-12T09:43:23.232428+0000","last_clean":"2023-12-12T09:43:23.232428+0000","last_became_active":"2023-12-12T09:43:22.250870+0000","last_became_peered":"2023-12-12T09:43:22.250870+0000","last_unstale":"2023-12-12T09:43:23.232428+0000","last_undegraded":"2023-12-12T09:43:23.232428+0000","last_fullsized":"2023-12-12T09:43:23.232428+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_clean_scrub_stamp":"2023-12-12T09:43:21.241417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T13:22:21.650455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-12-12T09:43:23.510589+0000","last_change":"2023-12-12T09:43:22.247885+0000","last_active":"2023-12-12T09:43:23.510589+0000","last_peered":"2023-12-12T09:43:23.510589+0000","last_clean":"2023-12-12T09:43:23.510589+0000","last_became_active":"2023-12-12T09:43:22.245305+0000","last_became_peered":"2023-12-12T09:43:22.245305+0000","last_unstale":"2023-12-12T09:43:23.510589+0000","last_undegraded":"2023-12-12T09:43:23.510589+0000","last_fullsized":"2023-12-12T09:43:23.510589+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_clean_scrub_stamp":"2023-12-12T09:43:21.241417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T17:30:21.214675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-12-12T09:43:23.234759+0000","last_change":"2023-12-12T09:43:22.262475+0000","last_active":"2023-12-12T09:43:23.234759+0000","last_peered":"2023-12-12T09:43:23.234759+0000","last_clean":"2023-12-12T09:43:23.234759+0000","last_became_active":"2023-12-12T09:43:22.260635+0000","last_became_peered":"2023-12-12T09:43:22.260635+0000","last_unstale":"2023-12-12T09:43:23.234759+0000","last_undegraded":"2023-12-12T09:43:23.234759+0000","last_fullsized":"2023-12-12T09:43:23.234759+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_clean_scrub_stamp":"2023-12-12T09:43:21.241417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T10:01:50.869497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-12-12T09:43:23.510507+0000","last_change":"2023-12-12T09:43:22.253497+0000","last_active":"2023-12-12T09:43:23.510507+0000","last_peered":"2023-12-12T09:43:23.510507+0000","last_clean":"2023-12-12T09:43:23.510507+0000","last_became_active":"2023-12-12T09:43:22.253062+0000","last_became_peered":"2023-12-12T09:43:22.253062+0000","last_unstale":"2023-12-12T09:43:23.510507+0000","last_undegraded":"2023-12-12T09:43:23.510507+0000","last_fullsized":"2023-12-12T09:43:23.510507+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_clean_scrub_stamp":"2023-12-12T09:43:21.241417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T11:24:12.081000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-12-12T09:43:23.514357+0000","last_change":"2023-12-12T09:43:21.297984+0000","last_active":"2023-12-12T09:43:23.514357+0000","last_peered":"2023-12-12T09:43:23.514357+0000","last_clean":"2023-12-12T09:43:23.514357+0000","last_became_active":"2023-12-12T09:43:21.297753+0000","last_became_peered":"2023-12-12T09:43:21.297753+0000","last_unstale":"2023-12-12T09:43:23.514357+0000","last_undegraded":"2023-12-12T09:43:23.514357+0000","last_fullsized":"2023-12-12T09:43:23.514357+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:43:20.054829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:43:20.054829+0000","last_clean_scrub_stamp":"2023-12-12T09:43:20.054829+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T14:02:28.705261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-12-12T09:43:23.510862+0000","last_change":"2023-12-12T09:43:22.257540+0000","last_active":"2023-12-12T09:43:23.510862+0000","last_peered":"2023-12-12T09:43:23.510862+0000","last_clean":"2023-12-12T09:43:23.510862+0000","last_became_active":"2023-12-12T09:43:22.257172+0000","last_became_peered":"2023-12-12T09:43:22.257172+0000","last_unstale":"2023-12-12T09:43:23.510862+0000","last_undegraded":"2023-12-12T09:43:23.510862+0000","last_fullsized":"2023-12-12T09:43:23.510862+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_clean_scrub_stamp":"2023-12-12T09:43:21.241417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T17:19:30.590382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-12-12T09:43:23.235423+0000","last_change":"2023-12-12T09:43:21.301627+0000","last_active":"2023-12-12T09:43:23.235423+0000","last_peered":"2023-12-12T09:43:23.235423+0000","last_clean":"2023-12-12T09:43:23.235423+0000","last_became_active":"2023-12-12T09:43:21.296928+0000","last_became_peered":"2023-12-12T09:43:21.296928+0000","last_unstale":"2023-12-12T09:43:23.235423+0000","last_undegraded":"2023-12-12T09:43:23.235423+0000","last_fullsized":"2023-12-12T09:43:23.235423+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:43:20.054829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:43:20.054829+0000","last_clean_scrub_stamp":"2023-12-12T09:43:20.054829+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T17:13:29.315785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-12-12T09:43:23.511662+0000","last_change":"2023-12-12T09:43:21.292918+0000","last_active":"2023-12-12T09:43:23.511662+0000","last_peered":"2023-12-12T09:43:23.511662+0000","last_clean":"2023-12-12T09:43:23.511662+0000","last_became_active":"2023-12-12T09:43:21.292599+0000","last_became_peered":"2023-12-12T09:43:21.292599+0000","last_unstale":"2023-12-12T09:43:23.511662+0000","last_undegraded":"2023-12-12T09:43:23.511662+0000","last_fullsized":"2023-12-12T09:43:23.511662+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:43:20.054829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:43:20.054829+0000","last_clean_scrub_stamp":"2023-12-12T09:43:20.054829+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T17:13:29.315785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-12-12T09:43:23.512032+0000","last_change":"2023-12-12T09:43:22.250889+0000","last_active":"2023-12-12T09:43:23.512032+0000","last_peered":"2023-12-12T09:43:23.512032+0000","last_clean":"2023-12-12T09:43:23.512032+0000","last_became_active":"2023-12-12T09:43:22.249404+0000","last_became_peered":"2023-12-12T09:43:22.249404+0000","last_unstale":"2023-12-12T09:43:23.512032+0000","last_undegraded":"2023-12-12T09:43:23.512032+0000","last_fullsized":"2023-12-12T09:43:23.512032+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_clean_scrub_stamp":"2023-12-12T09:43:21.241417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T11:56:43.095343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-12-12T09:43:23.232554+0000","last_change":"2023-12-12T09:43:21.283438+0000","last_active":"2023-12-12T09:43:23.232554+0000","last_peered":"2023-12-12T09:43:23.232554+0000","last_clean":"2023-12-12T09:43:23.232554+0000","last_became_active":"2023-12-12T09:43:21.283168+0000","last_became_peered":"2023-12-12T09:43:21.283168+0000","last_unstale":"2023-12-12T09:43:23.232554+0000","last_undegraded":"2023-12-12T09:43:23.232554+0000","last_fullsized":"2023-12-12T09:43:23.232554+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:43:20.054829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:43:20.054829+0000","last_clean_scrub_stamp":"2023-12-12T09:43:20.054829+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T19:29:29.412626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-12-12T09:43:23.228419+0000","last_change":"2023-12-12T09:43:22.246835+0000","last_active":"2023-12-12T09:43:23.228419+0000","last_peered":"2023-12-12T09:43:23.228419+0000","last_clean":"2023-12-12T09:43:23.228419+0000","last_became_active":"2023-12-12T09:43:22.246425+0000","last_became_peered":"2023-12-12T09:43:22.246425+0000","last_unstale":"2023-12-12T09:43:23.228419+0000","last_undegraded":"2023-12-12T09:43:23.228419+0000","last_fullsized":"2023-12-12T09:43:23.228419+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_clean_scrub_stamp":"2023-12-12T09:43:21.241417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T10:01:50.869497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-12-12T09:43:23.235408+0000","last_change":"2023-12-12T09:43:21.296908+0000","last_active":"2023-12-12T09:43:23.235408+0000","last_peered":"2023-12-12T09:43:23.235408+0000","last_clean":"2023-12-12T09:43:23.235408+0000","last_became_active":"2023-12-12T09:43:21.296613+0000","last_became_peered":"2023-12-12T09:43:21.296613+0000","last_unstale":"2023-12-12T09:43:23.235408+0000","last_undegraded":"2023-12-12T09:43:23.235408+0000","last_fullsized":"2023-12-12T09:43:23.235408+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:43:20.054829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:43:20.054829+0000","last_clean_scrub_stamp":"2023-12-12T09:43:20.054829+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T17:12:57.858301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-12-12T09:43:23.233425+0000","last_change":"2023-12-12T09:43:22.257034+0000","last_active":"2023-12-12T09:43:23.233425+0000","last_peered":"2023-12-12T09:43:23.233425+0000","last_clean":"2023-12-12T09:43:23.233425+0000","last_became_active":"2023-12-12T09:43:22.250340+0000","last_became_peered":"2023-12-12T09:43:22.250340+0000","last_unstale":"2023-12-12T09:43:23.233425+0000","last_undegraded":"2023-12-12T09:43:23.233425+0000","last_fullsized":"2023-12-12T09:43:23.233425+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_clean_scrub_stamp":"2023-12-12T09:43:21.241417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T11:37:48.456174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-12-12T09:43:23.233396+0000","last_change":"2023-12-12T09:43:21.303926+0000","last_active":"2023-12-12T09:43:23.233396+0000","last_peered":"2023-12-12T09:43:23.233396+0000","last_clean":"2023-12-12T09:43:23.233396+0000","last_became_active":"2023-12-12T09:43:21.303631+0000","last_became_peered":"2023-12-12T09:43:21.303631+0000","last_unstale":"2023-12-12T09:43:23.233396+0000","last_undegraded":"2023-12-12T09:43:23.233396+0000","last_fullsized":"2023-12-12T09:43:23.233396+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:43:20.054829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:43:20.054829+0000","last_clean_scrub_stamp":"2023-12-12T09:43:20.054829+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T10:01:49.682908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-12-12T09:43:23.513875+0000","last_change":"2023-12-12T09:43:22.252730+0000","last_active":"2023-12-12T09:43:23.513875+0000","last_peered":"2023-12-12T09:43:23.513875+0000","last_clean":"2023-12-12T09:43:23.513875+0000","last_became_active":"2023-12-12T09:43:22.252440+0000","last_became_peered":"2023-12-12T09:43:22.252440+0000","last_unstale":"2023-12-12T09:43:23.513875+0000","last_undegraded":"2023-12-12T09:43:23.513875+0000","last_fullsized":"2023-12-12T09:43:23.513875+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_clean_scrub_stamp":"2023-12-12T09:43:21.241417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T13:28:21.176910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-12-12T09:43:23.228903+0000","last_change":"2023-12-12T09:43:21.288877+0000","last_active":"2023-12-12T09:43:23.228903+0000","last_peered":"2023-12-12T09:43:23.228903+0000","last_clean":"2023-12-12T09:43:23.228903+0000","last_became_active":"2023-12-12T09:43:21.288552+0000","last_became_peered":"2023-12-12T09:43:21.288552+0000","last_unstale":"2023-12-12T09:43:23.228903+0000","last_undegraded":"2023-12-12T09:43:23.228903+0000","last_fullsized":"2023-12-12T09:43:23.228903+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:43:20.054829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:43:20.054829+0000","last_clean_scrub_stamp":"2023-12-12T09:43:20.054829+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T20:32:59.313749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-12-12T09:43:23.511204+0000","last_change":"2023-12-12T09:43:22.261371+0000","last_active":"2023-12-12T09:43:23.511204+0000","last_peered":"2023-12-12T09:43:23.511204+0000","last_clean":"2023-12-12T09:43:23.511204+0000","last_became_active":"2023-12-12T09:43:22.255661+0000","last_became_peered":"2023-12-12T09:43:22.255661+0000","last_unstale":"2023-12-12T09:43:23.511204+0000","last_undegraded":"2023-12-12T09:43:23.511204+0000","last_fullsized":"2023-12-12T09:43:23.511204+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_clean_scrub_stamp":"2023-12-12T09:43:21.241417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T11:40:42.785424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"20'6","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-12-12T09:43:23.235332+0000","last_change":"2023-12-12T09:43:21.302252+0000","last_active":"2023-12-12T09:43:23.235332+0000","last_peered":"2023-12-12T09:43:23.235332+0000","last_clean":"2023-12-12T09:43:23.235332+0000","last_became_active":"2023-12-12T09:43:21.301960+0000","last_became_peered":"2023-12-12T09:43:21.301960+0000","last_unstale":"2023-12-12T09:43:23.235332+0000","last_undegraded":"2023-12-12T09:43:23.235332+0000","last_fullsized":"2023-12-12T09:43:23.235332+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:43:20.054829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:43:20.054829+0000","last_clean_scrub_stamp":"2023-12-12T09:43:20.054829+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T21:27:10.922205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-12-12T09:43:23.512344+0000","last_change":"2023-12-12T09:43:22.264539+0000","last_active":"2023-12-12T09:43:23.512344+0000","last_peered":"2023-12-12T09:43:23.512344+0000","last_clean":"2023-12-12T09:43:23.512344+0000","last_became_active":"2023-12-12T09:43:22.264263+0000","last_became_peered":"2023-12-12T09:43:22.264263+0000","last_unstale":"2023-12-12T09:43:23.512344+0000","last_undegraded":"2023-12-12T09:43:23.512344+0000","last_fullsized":"2023-12-12T09:43:23.512344+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_clean_scrub_stamp":"2023-12-12T09:43:21.241417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T11:24:46.660535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-12-12T09:43:23.511008+0000","last_change":"2023-12-12T09:43:21.291014+0000","last_active":"2023-12-12T09:43:23.511008+0000","last_peered":"2023-12-12T09:43:23.511008+0000","last_clean":"2023-12-12T09:43:23.511008+0000","last_became_active":"2023-12-12T09:43:21.286948+0000","last_became_peered":"2023-12-12T09:43:21.286948+0000","last_unstale":"2023-12-12T09:43:23.511008+0000","last_undegraded":"2023-12-12T09:43:23.511008+0000","last_fullsized":"2023-12-12T09:43:23.511008+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:43:20.054829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:43:20.054829+0000","last_clean_scrub_stamp":"2023-12-12T09:43:20.054829+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T18:28:40.746959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-12-12T09:43:23.509853+0000","last_change":"2023-12-12T09:43:22.249360+0000","last_active":"2023-12-12T09:43:23.509853+0000","last_peered":"2023-12-12T09:43:23.509853+0000","last_clean":"2023-12-12T09:43:23.509853+0000","last_became_active":"2023-12-12T09:43:22.248965+0000","last_became_peered":"2023-12-12T09:43:22.248965+0000","last_unstale":"2023-12-12T09:43:23.509853+0000","last_undegraded":"2023-12-12T09:43:23.509853+0000","last_fullsized":"2023-12-12T09:43:23.509853+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_clean_scrub_stamp":"2023-12-12T09:43:21.241417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T14:02:29.891850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-12-12T09:43:23.232545+0000","last_change":"2023-12-12T09:43:21.291279+0000","last_active":"2023-12-12T09:43:23.232545+0000","last_peered":"2023-12-12T09:43:23.232545+0000","last_clean":"2023-12-12T09:43:23.232545+0000","last_became_active":"2023-12-12T09:43:21.290993+0000","last_became_peered":"2023-12-12T09:43:21.290993+0000","last_unstale":"2023-12-12T09:43:23.232545+0000","last_undegraded":"2023-12-12T09:43:23.232545+0000","last_fullsized":"2023-12-12T09:43:23.232545+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:43:20.054829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:43:20.054829+0000","last_clean_scrub_stamp":"2023-12-12T09:43:20.054829+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T21:27:10.922205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-12-12T09:43:23.512810+0000","last_change":"2023-12-12T09:43:22.264893+0000","last_active":"2023-12-12T09:43:23.512810+0000","last_peered":"2023-12-12T09:43:23.512810+0000","last_clean":"2023-12-12T09:43:23.512810+0000","last_became_active":"2023-12-12T09:43:22.262599+0000","last_became_peered":"2023-12-12T09:43:22.262599+0000","last_unstale":"2023-12-12T09:43:23.512810+0000","last_undegraded":"2023-12-12T09:43:23.512810+0000","last_fullsized":"2023-12-12T09:43:23.512810+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_clean_scrub_stamp":"2023-12-12T09:43:21.241417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T11:37:48.456174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-12-12T09:43:23.234782+0000","last_change":"2023-12-12T09:43:21.298187+0000","last_active":"2023-12-12T09:43:23.234782+0000","last_peered":"2023-12-12T09:43:23.234782+0000","last_clean":"2023-12-12T09:43:23.234782+0000","last_became_active":"2023-12-12T09:43:21.297563+0000","last_became_peered":"2023-12-12T09:43:21.297563+0000","last_unstale":"2023-12-12T09:43:23.234782+0000","last_undegraded":"2023-12-12T09:43:23.234782+0000","last_fullsized":"2023-12-12T09:43:23.234782+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:43:20.054829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:43:20.054829+0000","last_clean_scrub_stamp":"2023-12-12T09:43:20.054829+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T18:28:40.746959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-12-12T09:43:23.234722+0000","last_change":"2023-12-12T09:43:22.265004+0000","last_active":"2023-12-12T09:43:23.234722+0000","last_peered":"2023-12-12T09:43:23.234722+0000","last_clean":"2023-12-12T09:43:23.234722+0000","last_became_active":"2023-12-12T09:43:22.264691+0000","last_became_peered":"2023-12-12T09:43:22.264691+0000","last_unstale":"2023-12-12T09:43:23.234722+0000","last_undegraded":"2023-12-12T09:43:23.234722+0000","last_fullsized":"2023-12-12T09:43:23.234722+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_clean_scrub_stamp":"2023-12-12T09:43:21.241417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T20:17:31.359873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-12-12T09:43:23.510566+0000","last_change":"2023-12-12T09:43:21.284943+0000","last_active":"2023-12-12T09:43:23.510566+0000","last_peered":"2023-12-12T09:43:23.510566+0000","last_clean":"2023-12-12T09:43:23.510566+0000","last_became_active":"2023-12-12T09:43:21.284647+0000","last_became_peered":"2023-12-12T09:43:21.284647+0000","last_unstale":"2023-12-12T09:43:23.510566+0000","last_undegraded":"2023-12-12T09:43:23.510566+0000","last_fullsized":"2023-12-12T09:43:23.510566+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:43:20.054829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:43:20.054829+0000","last_clean_scrub_stamp":"2023-12-12T09:43:20.054829+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T11:24:10.894411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-12-12T09:43:23.511910+0000","last_change":"2023-12-12T09:43:22.265457+0000","last_active":"2023-12-12T09:43:23.511910+0000","last_peered":"2023-12-12T09:43:23.511910+0000","last_clean":"2023-12-12T09:43:23.511910+0000","last_became_active":"2023-12-12T09:43:22.263712+0000","last_became_peered":"2023-12-12T09:43:22.263712+0000","last_unstale":"2023-12-12T09:43:23.511910+0000","last_undegraded":"2023-12-12T09:43:23.511910+0000","last_fullsized":"2023-12-12T09:43:23.511910+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_clean_scrub_stamp":"2023-12-12T09:43:21.241417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T12:09:32.290407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-12-12T09:43:23.511049+0000","last_change":"2023-12-12T09:43:21.295422+0000","last_active":"2023-12-12T09:43:23.511049+0000","last_peered":"2023-12-12T09:43:23.511049+0000","last_clean":"2023-12-12T09:43:23.511049+0000","last_became_active":"2023-12-12T09:43:21.295045+0000","last_became_peered":"2023-12-12T09:43:21.295045+0000","last_unstale":"2023-12-12T09:43:23.511049+0000","last_undegraded":"2023-12-12T09:43:23.511049+0000","last_fullsized":"2023-12-12T09:43:23.511049+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:43:20.054829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:43:20.054829+0000","last_clean_scrub_stamp":"2023-12-12T09:43:20.054829+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T17:12:57.858301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-12-12T09:43:23.513178+0000","last_change":"2023-12-12T09:43:22.261274+0000","last_active":"2023-12-12T09:43:23.513178+0000","last_peered":"2023-12-12T09:43:23.513178+0000","last_clean":"2023-12-12T09:43:23.513178+0000","last_became_active":"2023-12-12T09:43:22.260940+0000","last_became_peered":"2023-12-12T09:43:22.260940+0000","last_unstale":"2023-12-12T09:43:23.513178+0000","last_undegraded":"2023-12-12T09:43:23.513178+0000","last_fullsized":"2023-12-12T09:43:23.513178+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_clean_scrub_stamp":"2023-12-12T09:43:21.241417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T16:30:08.113732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-12-12T09:43:23.514412+0000","last_change":"2023-12-12T09:43:21.292425+0000","last_active":"2023-12-12T09:43:23.514412+0000","last_peered":"2023-12-12T09:43:23.514412+0000","last_clean":"2023-12-12T09:43:23.514412+0000","last_became_active":"2023-12-12T09:43:21.290884+0000","last_became_peered":"2023-12-12T09:43:21.290884+0000","last_unstale":"2023-12-12T09:43:23.514412+0000","last_undegraded":"2023-12-12T09:43:23.514412+0000","last_fullsized":"2023-12-12T09:43:23.514412+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:43:20.054829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:43:20.054829+0000","last_clean_scrub_stamp":"2023-12-12T09:43:20.054829+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T10:41:13.505292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-12-12T09:43:23.513933+0000","last_change":"2023-12-12T09:43:22.261726+0000","last_active":"2023-12-12T09:43:23.513933+0000","last_peered":"2023-12-12T09:43:23.513933+0000","last_clean":"2023-12-12T09:43:23.513933+0000","last_became_active":"2023-12-12T09:43:22.261503+0000","last_became_peered":"2023-12-12T09:43:22.261503+0000","last_unstale":"2023-12-12T09:43:23.513933+0000","last_undegraded":"2023-12-12T09:43:23.513933+0000","last_fullsized":"2023-12-12T09:43:23.513933+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_clean_scrub_stamp":"2023-12-12T09:43:21.241417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T11:47:46.279003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-12-12T09:43:23.228883+0000","last_change":"2023-12-12T09:43:21.288749+0000","last_active":"2023-12-12T09:43:23.228883+0000","last_peered":"2023-12-12T09:43:23.228883+0000","last_clean":"2023-12-12T09:43:23.228883+0000","last_became_active":"2023-12-12T09:43:21.288489+0000","last_became_peered":"2023-12-12T09:43:21.288489+0000","last_unstale":"2023-12-12T09:43:23.228883+0000","last_undegraded":"2023-12-12T09:43:23.228883+0000","last_fullsized":"2023-12-12T09:43:23.228883+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:43:20.054829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:43:20.054829+0000","last_clean_scrub_stamp":"2023-12-12T09:43:20.054829+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T20:17:30.173285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-12-12T09:43:23.233067+0000","last_change":"2023-12-12T09:43:22.270243+0000","last_active":"2023-12-12T09:43:23.233067+0000","last_peered":"2023-12-12T09:43:23.233067+0000","last_clean":"2023-12-12T09:43:23.233067+0000","last_became_active":"2023-12-12T09:43:22.269976+0000","last_became_peered":"2023-12-12T09:43:22.269976+0000","last_unstale":"2023-12-12T09:43:23.233067+0000","last_undegraded":"2023-12-12T09:43:23.233067+0000","last_fullsized":"2023-12-12T09:43:23.233067+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_clean_scrub_stamp":"2023-12-12T09:43:21.241417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T12:08:27.288104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-12-12T09:43:23.511644+0000","last_change":"2023-12-12T09:43:21.286223+0000","last_active":"2023-12-12T09:43:23.511644+0000","last_peered":"2023-12-12T09:43:23.511644+0000","last_clean":"2023-12-12T09:43:23.511644+0000","last_became_active":"2023-12-12T09:43:21.285919+0000","last_became_peered":"2023-12-12T09:43:21.285919+0000","last_unstale":"2023-12-12T09:43:23.511644+0000","last_undegraded":"2023-12-12T09:43:23.511644+0000","last_fullsized":"2023-12-12T09:43:23.511644+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:43:20.054829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:43:20.054829+0000","last_clean_scrub_stamp":"2023-12-12T09:43:20.054829+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T20:43:17.341558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-12-12T09:43:23.512543+0000","last_change":"2023-12-12T09:43:22.279936+0000","last_active":"2023-12-12T09:43:23.512543+0000","last_peered":"2023-12-12T09:43:23.512543+0000","last_clean":"2023-12-12T09:43:23.512543+0000","last_became_active":"2023-12-12T09:43:22.276294+0000","last_became_peered":"2023-12-12T09:43:22.276294+0000","last_unstale":"2023-12-12T09:43:23.512543+0000","last_undegraded":"2023-12-12T09:43:23.512543+0000","last_fullsized":"2023-12-12T09:43:23.512543+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_clean_scrub_stamp":"2023-12-12T09:43:21.241417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T20:26:35.861125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":165,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-12T09:43:22.246331+0000","last_change":"2023-12-12T09:43:17.203315+0000","last_active":"2023-12-12T09:43:22.246331+0000","last_peered":"2023-12-12T09:43:22.246331+0000","last_clean":"2023-12-12T09:43:22.246331+0000","last_became_active":"2023-12-12T09:43:17.200779+0000","last_became_peered":"2023-12-12T09:43:17.200779+0000","last_unstale":"2023-12-12T09:43:22.246331+0000","last_undegraded":"2023-12-12T09:43:22.246331+0000","last_fullsized":"2023-12-12T09:43:22.246331+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:43:15.931922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:43:15.931922+0000","last_clean_scrub_stamp":"2023-12-12T09:43:15.931922+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T21:42:10.929640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-12-12T09:43:23.231837+0000","last_change":"2023-12-12T09:43:21.286777+0000","last_active":"2023-12-12T09:43:23.231837+0000","last_peered":"2023-12-12T09:43:23.231837+0000","last_clean":"2023-12-12T09:43:23.231837+0000","last_became_active":"2023-12-12T09:43:21.285422+0000","last_became_peered":"2023-12-12T09:43:21.285422+0000","last_unstale":"2023-12-12T09:43:23.231837+0000","last_undegraded":"2023-12-12T09:43:23.231837+0000","last_fullsized":"2023-12-12T09:43:23.231837+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:43:20.054829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:43:20.054829+0000","last_clean_scrub_stamp":"2023-12-12T09:43:20.054829+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T17:30:20.028086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-12-12T09:43:23.511894+0000","last_change":"2023-12-12T09:43:22.272912+0000","last_active":"2023-12-12T09:43:23.511894+0000","last_peered":"2023-12-12T09:43:23.511894+0000","last_clean":"2023-12-12T09:43:23.511894+0000","last_became_active":"2023-12-12T09:43:22.272617+0000","last_became_peered":"2023-12-12T09:43:22.272617+0000","last_unstale":"2023-12-12T09:43:23.511894+0000","last_undegraded":"2023-12-12T09:43:23.511894+0000","last_fullsized":"2023-12-12T09:43:23.511894+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_clean_scrub_stamp":"2023-12-12T09:43:21.241417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T19:29:30.599215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-12-12T09:43:23.511681+0000","last_change":"2023-12-12T09:43:21.300937+0000","last_active":"2023-12-12T09:43:23.511681+0000","last_peered":"2023-12-12T09:43:23.511681+0000","last_clean":"2023-12-12T09:43:23.511681+0000","last_became_active":"2023-12-12T09:43:21.300601+0000","last_became_peered":"2023-12-12T09:43:21.300601+0000","last_unstale":"2023-12-12T09:43:23.511681+0000","last_undegraded":"2023-12-12T09:43:23.511681+0000","last_fullsized":"2023-12-12T09:43:23.511681+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:43:20.054829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:43:20.054829+0000","last_clean_scrub_stamp":"2023-12-12T09:43:20.054829+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T21:27:10.922205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-12-12T09:43:23.509615+0000","last_change":"2023-12-12T09:43:22.252774+0000","last_active":"2023-12-12T09:43:23.509615+0000","last_peered":"2023-12-12T09:43:23.509615+0000","last_clean":"2023-12-12T09:43:23.509615+0000","last_became_active":"2023-12-12T09:43:22.252296+0000","last_became_peered":"2023-12-12T09:43:22.252296+0000","last_unstale":"2023-12-12T09:43:23.509615+0000","last_undegraded":"2023-12-12T09:43:23.509615+0000","last_fullsized":"2023-12-12T09:43:23.509615+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_clean_scrub_stamp":"2023-12-12T09:43:21.241417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T20:33:00.500338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-12-12T09:43:23.510762+0000","last_change":"2023-12-12T09:43:21.291232+0000","last_active":"2023-12-12T09:43:23.510762+0000","last_peered":"2023-12-12T09:43:23.510762+0000","last_clean":"2023-12-12T09:43:23.510762+0000","last_became_active":"2023-12-12T09:43:21.290905+0000","last_became_peered":"2023-12-12T09:43:21.290905+0000","last_unstale":"2023-12-12T09:43:23.510762+0000","last_undegraded":"2023-12-12T09:43:23.510762+0000","last_fullsized":"2023-12-12T09:43:23.510762+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:43:20.054829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:43:20.054829+0000","last_clean_scrub_stamp":"2023-12-12T09:43:20.054829+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T17:12:57.858301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-12-12T09:43:23.228577+0000","last_change":"2023-12-12T09:43:22.247541+0000","last_active":"2023-12-12T09:43:23.228577+0000","last_peered":"2023-12-12T09:43:23.228577+0000","last_clean":"2023-12-12T09:43:23.228577+0000","last_became_active":"2023-12-12T09:43:22.247160+0000","last_became_peered":"2023-12-12T09:43:22.247160+0000","last_unstale":"2023-12-12T09:43:23.228577+0000","last_undegraded":"2023-12-12T09:43:23.228577+0000","last_fullsized":"2023-12-12T09:43:23.228577+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_clean_scrub_stamp":"2023-12-12T09:43:21.241417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T19:29:30.599215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-12-12T09:43:23.232670+0000","last_change":"2023-12-12T09:43:21.292842+0000","last_active":"2023-12-12T09:43:23.232670+0000","last_peered":"2023-12-12T09:43:23.232670+0000","last_clean":"2023-12-12T09:43:23.232670+0000","last_became_active":"2023-12-12T09:43:21.292525+0000","last_became_peered":"2023-12-12T09:43:21.292525+0000","last_unstale":"2023-12-12T09:43:23.232670+0000","last_undegraded":"2023-12-12T09:43:23.232670+0000","last_fullsized":"2023-12-12T09:43:23.232670+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:43:20.054829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:43:20.054829+0000","last_clean_scrub_stamp":"2023-12-12T09:43:20.054829+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T18:28:40.746959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-12-12T09:43:23.511003+0000","last_change":"2023-12-12T09:43:22.255350+0000","last_active":"2023-12-12T09:43:23.511003+0000","last_peered":"2023-12-12T09:43:23.511003+0000","last_clean":"2023-12-12T09:43:23.511003+0000","last_became_active":"2023-12-12T09:43:22.253699+0000","last_became_peered":"2023-12-12T09:43:22.253699+0000","last_unstale":"2023-12-12T09:43:23.511003+0000","last_undegraded":"2023-12-12T09:43:23.511003+0000","last_fullsized":"2023-12-12T09:43:23.511003+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_clean_scrub_stamp":"2023-12-12T09:43:21.241417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T10:41:14.691881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-12-12T09:43:23.228484+0000","last_change":"2023-12-12T09:43:21.275987+0000","last_active":"2023-12-12T09:43:23.228484+0000","last_peered":"2023-12-12T09:43:23.228484+0000","last_clean":"2023-12-12T09:43:23.228484+0000","last_became_active":"2023-12-12T09:43:21.274563+0000","last_became_peered":"2023-12-12T09:43:21.274563+0000","last_unstale":"2023-12-12T09:43:23.228484+0000","last_undegraded":"2023-12-12T09:43:23.228484+0000","last_fullsized":"2023-12-12T09:43:23.228484+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:43:20.054829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:43:20.054829+0000","last_clean_scrub_stamp":"2023-12-12T09:43:20.054829+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T21:27:10.922205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-12-12T09:43:23.233263+0000","last_change":"2023-12-12T09:43:22.270432+0000","last_active":"2023-12-12T09:43:23.233263+0000","last_peered":"2023-12-12T09:43:23.233263+0000","last_clean":"2023-12-12T09:43:23.233263+0000","last_became_active":"2023-12-12T09:43:22.265195+0000","last_became_peered":"2023-12-12T09:43:22.265195+0000","last_unstale":"2023-12-12T09:43:23.233263+0000","last_undegraded":"2023-12-12T09:43:23.233263+0000","last_fullsized":"2023-12-12T09:43:23.233263+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_clean_scrub_stamp":"2023-12-12T09:43:21.241417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T13:12:59.364006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-12-12T09:43:23.512702+0000","last_change":"2023-12-12T09:43:21.305016+0000","last_active":"2023-12-12T09:43:23.512702+0000","last_peered":"2023-12-12T09:43:23.512702+0000","last_clean":"2023-12-12T09:43:23.512702+0000","last_became_active":"2023-12-12T09:43:21.302634+0000","last_became_peered":"2023-12-12T09:43:21.302634+0000","last_unstale":"2023-12-12T09:43:23.512702+0000","last_undegraded":"2023-12-12T09:43:23.512702+0000","last_fullsized":"2023-12-12T09:43:23.512702+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:43:20.054829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:43:20.054829+0000","last_clean_scrub_stamp":"2023-12-12T09:43:20.054829+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T19:41:08.951158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-12-12T09:43:23.228598+0000","last_change":"2023-12-12T09:43:22.249130+0000","last_active":"2023-12-12T09:43:23.228598+0000","last_peered":"2023-12-12T09:43:23.228598+0000","last_clean":"2023-12-12T09:43:23.228598+0000","last_became_active":"2023-12-12T09:43:22.248797+0000","last_became_peered":"2023-12-12T09:43:22.248797+0000","last_unstale":"2023-12-12T09:43:23.228598+0000","last_undegraded":"2023-12-12T09:43:23.228598+0000","last_fullsized":"2023-12-12T09:43:23.228598+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_clean_scrub_stamp":"2023-12-12T09:43:21.241417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T17:19:30.590382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-12-12T09:43:23.228746+0000","last_change":"2023-12-12T09:43:21.299170+0000","last_active":"2023-12-12T09:43:23.228746+0000","last_peered":"2023-12-12T09:43:23.228746+0000","last_clean":"2023-12-12T09:43:23.228746+0000","last_became_active":"2023-12-12T09:43:21.298879+0000","last_became_peered":"2023-12-12T09:43:21.298879+0000","last_unstale":"2023-12-12T09:43:23.228746+0000","last_undegraded":"2023-12-12T09:43:23.228746+0000","last_fullsized":"2023-12-12T09:43:23.228746+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:43:20.054829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:43:20.054829+0000","last_clean_scrub_stamp":"2023-12-12T09:43:20.054829+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T14:02:28.705261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-12-12T09:43:23.512630+0000","last_change":"2023-12-12T09:43:22.261674+0000","last_active":"2023-12-12T09:43:23.512630+0000","last_peered":"2023-12-12T09:43:23.512630+0000","last_clean":"2023-12-12T09:43:23.512630+0000","last_became_active":"2023-12-12T09:43:22.261405+0000","last_became_peered":"2023-12-12T09:43:22.261405+0000","last_unstale":"2023-12-12T09:43:23.512630+0000","last_undegraded":"2023-12-12T09:43:23.512630+0000","last_fullsized":"2023-12-12T09:43:23.512630+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_clean_scrub_stamp":"2023-12-12T09:43:21.241417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T19:41:10.137746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-12-12T09:43:23.235503+0000","last_change":"2023-12-12T09:43:21.304624+0000","last_active":"2023-12-12T09:43:23.235503+0000","last_peered":"2023-12-12T09:43:23.235503+0000","last_clean":"2023-12-12T09:43:23.235503+0000","last_became_active":"2023-12-12T09:43:21.304305+0000","last_became_peered":"2023-12-12T09:43:21.304305+0000","last_unstale":"2023-12-12T09:43:23.235503+0000","last_undegraded":"2023-12-12T09:43:23.235503+0000","last_fullsized":"2023-12-12T09:43:23.235503+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:43:20.054829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:43:20.054829+0000","last_clean_scrub_stamp":"2023-12-12T09:43:20.054829+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T11:24:10.894411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-12-12T09:43:23.512203+0000","last_change":"2023-12-12T09:43:22.260743+0000","last_active":"2023-12-12T09:43:23.512203+0000","last_peered":"2023-12-12T09:43:23.512203+0000","last_clean":"2023-12-12T09:43:23.512203+0000","last_became_active":"2023-12-12T09:43:22.260367+0000","last_became_peered":"2023-12-12T09:43:22.260367+0000","last_unstale":"2023-12-12T09:43:23.512203+0000","last_undegraded":"2023-12-12T09:43:23.512203+0000","last_fullsized":"2023-12-12T09:43:23.512203+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_clean_scrub_stamp":"2023-12-12T09:43:21.241417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T19:29:30.599215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-12-12T09:43:23.511691+0000","last_change":"2023-12-12T09:43:21.301133+0000","last_active":"2023-12-12T09:43:23.511691+0000","last_peered":"2023-12-12T09:43:23.511691+0000","last_clean":"2023-12-12T09:43:23.511691+0000","last_became_active":"2023-12-12T09:43:21.300231+0000","last_became_peered":"2023-12-12T09:43:21.300231+0000","last_unstale":"2023-12-12T09:43:23.511691+0000","last_undegraded":"2023-12-12T09:43:23.511691+0000","last_fullsized":"2023-12-12T09:43:23.511691+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:43:20.054829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:43:20.054829+0000","last_clean_scrub_stamp":"2023-12-12T09:43:20.054829+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T10:41:13.505292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-12-12T09:43:23.510712+0000","last_change":"2023-12-12T09:43:22.260117+0000","last_active":"2023-12-12T09:43:23.510712+0000","last_peered":"2023-12-12T09:43:23.510712+0000","last_clean":"2023-12-12T09:43:23.510712+0000","last_became_active":"2023-12-12T09:43:22.255443+0000","last_became_peered":"2023-12-12T09:43:22.255443+0000","last_unstale":"2023-12-12T09:43:23.510712+0000","last_undegraded":"2023-12-12T09:43:23.510712+0000","last_fullsized":"2023-12-12T09:43:23.510712+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_clean_scrub_stamp":"2023-12-12T09:43:21.241417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T20:43:18.528147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-12-12T09:43:23.228536+0000","last_change":"2023-12-12T09:43:21.281650+0000","last_active":"2023-12-12T09:43:23.228536+0000","last_peered":"2023-12-12T09:43:23.228536+0000","last_clean":"2023-12-12T09:43:23.228536+0000","last_became_active":"2023-12-12T09:43:21.281353+0000","last_became_peered":"2023-12-12T09:43:21.281353+0000","last_unstale":"2023-12-12T09:43:23.228536+0000","last_undegraded":"2023-12-12T09:43:23.228536+0000","last_fullsized":"2023-12-12T09:43:23.228536+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:43:20.054829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:43:20.054829+0000","last_clean_scrub_stamp":"2023-12-12T09:43:20.054829+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T10:41:13.505292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-12-12T09:43:23.512382+0000","last_change":"2023-12-12T09:43:22.255511+0000","last_active":"2023-12-12T09:43:23.512382+0000","last_peered":"2023-12-12T09:43:23.512382+0000","last_clean":"2023-12-12T09:43:23.512382+0000","last_became_active":"2023-12-12T09:43:22.255187+0000","last_became_peered":"2023-12-12T09:43:22.255187+0000","last_unstale":"2023-12-12T09:43:23.512382+0000","last_undegraded":"2023-12-12T09:43:23.512382+0000","last_fullsized":"2023-12-12T09:43:23.512382+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_clean_scrub_stamp":"2023-12-12T09:43:21.241417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T13:28:21.176910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-12-12T09:43:23.228903+0000","last_change":"2023-12-12T09:43:21.291624+0000","last_active":"2023-12-12T09:43:23.228903+0000","last_peered":"2023-12-12T09:43:23.228903+0000","last_clean":"2023-12-12T09:43:23.228903+0000","last_became_active":"2023-12-12T09:43:21.291410+0000","last_became_peered":"2023-12-12T09:43:21.291410+0000","last_unstale":"2023-12-12T09:43:23.228903+0000","last_undegraded":"2023-12-12T09:43:23.228903+0000","last_fullsized":"2023-12-12T09:43:23.228903+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:43:20.054829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:43:20.054829+0000","last_clean_scrub_stamp":"2023-12-12T09:43:20.054829+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T20:43:17.341558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-12-12T09:43:23.514113+0000","last_change":"2023-12-12T09:43:22.250477+0000","last_active":"2023-12-12T09:43:23.514113+0000","last_peered":"2023-12-12T09:43:23.514113+0000","last_clean":"2023-12-12T09:43:23.514113+0000","last_became_active":"2023-12-12T09:43:22.250114+0000","last_became_peered":"2023-12-12T09:43:22.250114+0000","last_unstale":"2023-12-12T09:43:23.514113+0000","last_undegraded":"2023-12-12T09:43:23.514113+0000","last_fullsized":"2023-12-12T09:43:23.514113+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_clean_scrub_stamp":"2023-12-12T09:43:21.241417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T11:24:46.660535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-12-12T09:43:23.512859+0000","last_change":"2023-12-12T09:43:21.300810+0000","last_active":"2023-12-12T09:43:23.512859+0000","last_peered":"2023-12-12T09:43:23.512859+0000","last_clean":"2023-12-12T09:43:23.512859+0000","last_became_active":"2023-12-12T09:43:21.300476+0000","last_became_peered":"2023-12-12T09:43:21.300476+0000","last_unstale":"2023-12-12T09:43:23.512859+0000","last_undegraded":"2023-12-12T09:43:23.512859+0000","last_fullsized":"2023-12-12T09:43:23.512859+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:43:20.054829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:43:20.054829+0000","last_clean_scrub_stamp":"2023-12-12T09:43:20.054829+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T20:32:59.313749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-12-12T09:43:23.235201+0000","last_change":"2023-12-12T09:43:22.254797+0000","last_active":"2023-12-12T09:43:23.235201+0000","last_peered":"2023-12-12T09:43:23.235201+0000","last_clean":"2023-12-12T09:43:23.235201+0000","last_became_active":"2023-12-12T09:43:22.254482+0000","last_became_peered":"2023-12-12T09:43:22.254482+0000","last_unstale":"2023-12-12T09:43:23.235201+0000","last_undegraded":"2023-12-12T09:43:23.235201+0000","last_fullsized":"2023-12-12T09:43:23.235201+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_clean_scrub_stamp":"2023-12-12T09:43:21.241417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T19:29:30.599215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-12-12T09:43:23.232655+0000","last_change":"2023-12-12T09:43:22.256918+0000","last_active":"2023-12-12T09:43:23.232655+0000","last_peered":"2023-12-12T09:43:23.232655+0000","last_clean":"2023-12-12T09:43:23.232655+0000","last_became_active":"2023-12-12T09:43:22.256575+0000","last_became_peered":"2023-12-12T09:43:22.256575+0000","last_unstale":"2023-12-12T09:43:23.232655+0000","last_undegraded":"2023-12-12T09:43:23.232655+0000","last_fullsized":"2023-12-12T09:43:23.232655+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_clean_scrub_stamp":"2023-12-12T09:43:21.241417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T11:24:46.660535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-12-12T09:43:23.512318+0000","last_change":"2023-12-12T09:43:21.300710+0000","last_active":"2023-12-12T09:43:23.512318+0000","last_peered":"2023-12-12T09:43:23.512318+0000","last_clean":"2023-12-12T09:43:23.512318+0000","last_became_active":"2023-12-12T09:43:21.300311+0000","last_became_peered":"2023-12-12T09:43:21.300311+0000","last_unstale":"2023-12-12T09:43:23.512318+0000","last_undegraded":"2023-12-12T09:43:23.512318+0000","last_fullsized":"2023-12-12T09:43:23.512318+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:43:20.054829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:43:20.054829+0000","last_clean_scrub_stamp":"2023-12-12T09:43:20.054829+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T14:02:28.705261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-12-12T09:43:23.232804+0000","last_change":"2023-12-12T09:43:22.257472+0000","last_active":"2023-12-12T09:43:23.232804+0000","last_peered":"2023-12-12T09:43:23.232804+0000","last_clean":"2023-12-12T09:43:23.232804+0000","last_became_active":"2023-12-12T09:43:22.250225+0000","last_became_peered":"2023-12-12T09:43:22.250225+0000","last_unstale":"2023-12-12T09:43:23.232804+0000","last_undegraded":"2023-12-12T09:43:23.232804+0000","last_fullsized":"2023-12-12T09:43:23.232804+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_clean_scrub_stamp":"2023-12-12T09:43:21.241417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T20:26:35.861125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-12-12T09:43:23.512528+0000","last_change":"2023-12-12T09:43:21.306307+0000","last_active":"2023-12-12T09:43:23.512528+0000","last_peered":"2023-12-12T09:43:23.512528+0000","last_clean":"2023-12-12T09:43:23.512528+0000","last_became_active":"2023-12-12T09:43:21.305903+0000","last_became_peered":"2023-12-12T09:43:21.305903+0000","last_unstale":"2023-12-12T09:43:23.512528+0000","last_undegraded":"2023-12-12T09:43:23.512528+0000","last_fullsized":"2023-12-12T09:43:23.512528+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:43:20.054829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:43:20.054829+0000","last_clean_scrub_stamp":"2023-12-12T09:43:20.054829+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T11:56:41.908755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-12-12T09:43:23.513534+0000","last_change":"2023-12-12T09:43:22.274288+0000","last_active":"2023-12-12T09:43:23.513534+0000","last_peered":"2023-12-12T09:43:23.513534+0000","last_clean":"2023-12-12T09:43:23.513534+0000","last_became_active":"2023-12-12T09:43:22.273968+0000","last_became_peered":"2023-12-12T09:43:22.273968+0000","last_unstale":"2023-12-12T09:43:23.513534+0000","last_undegraded":"2023-12-12T09:43:23.513534+0000","last_fullsized":"2023-12-12T09:43:23.513534+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_clean_scrub_stamp":"2023-12-12T09:43:21.241417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T10:52:36.164447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-12-12T09:43:23.513171+0000","last_change":"2023-12-12T09:43:21.295200+0000","last_active":"2023-12-12T09:43:23.513171+0000","last_peered":"2023-12-12T09:43:23.513171+0000","last_clean":"2023-12-12T09:43:23.513171+0000","last_became_active":"2023-12-12T09:43:21.294908+0000","last_became_peered":"2023-12-12T09:43:21.294908+0000","last_unstale":"2023-12-12T09:43:23.513171+0000","last_undegraded":"2023-12-12T09:43:23.513171+0000","last_fullsized":"2023-12-12T09:43:23.513171+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:43:20.054829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:43:20.054829+0000","last_clean_scrub_stamp":"2023-12-12T09:43:20.054829+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T20:32:59.313749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-12-12T09:43:23.512766+0000","last_change":"2023-12-12T09:43:22.256556+0000","last_active":"2023-12-12T09:43:23.512766+0000","last_peered":"2023-12-12T09:43:23.512766+0000","last_clean":"2023-12-12T09:43:23.512766+0000","last_became_active":"2023-12-12T09:43:22.256166+0000","last_became_peered":"2023-12-12T09:43:22.256166+0000","last_unstale":"2023-12-12T09:43:23.512766+0000","last_undegraded":"2023-12-12T09:43:23.512766+0000","last_fullsized":"2023-12-12T09:43:23.512766+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_clean_scrub_stamp":"2023-12-12T09:43:21.241417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T13:22:21.650455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"20'4","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-12-12T09:43:23.514113+0000","last_change":"2023-12-12T09:43:21.296519+0000","last_active":"2023-12-12T09:43:23.514113+0000","last_peered":"2023-12-12T09:43:23.514113+0000","last_clean":"2023-12-12T09:43:23.514113+0000","last_became_active":"2023-12-12T09:43:21.296221+0000","last_became_peered":"2023-12-12T09:43:21.296221+0000","last_unstale":"2023-12-12T09:43:23.514113+0000","last_undegraded":"2023-12-12T09:43:23.514113+0000","last_fullsized":"2023-12-12T09:43:23.514113+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:43:20.054829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:43:20.054829+0000","last_clean_scrub_stamp":"2023-12-12T09:43:20.054829+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T21:27:10.922205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":64844,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574853,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27320,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344520,"statfs":{"total":96636764160,"available":96608788480,"internally_reserved":0,"allocated":286720,"data_stored":666531,"data_compressed":32422,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76500000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.359}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6419999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0469999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.617}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.218}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4630000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574851,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":229376,"data_stored":77193,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68999999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72599999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93700000000000006}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.077}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0449999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.236}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2569999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574851,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":221184,"data_stored":75671,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92400000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.355}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1830000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4390000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.619}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.655}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.756}]}]},{"osd":4,"up_from":13,"seq":55834574853,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":229376,"data_stored":75707,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95999999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0820000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3460000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.468}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.9039999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.246}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.726}]}]},{"osd":3,"up_from":13,"seq":55834574851,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":229376,"data_stored":77193,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88600000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0029999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1100000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.21}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.444}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.8620000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5369999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574851,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":204800,"data_stored":69281,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.458}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.593}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.8879999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.5760000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.3109999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.214}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.3370000000000002}]}]},{"osd":1,"up_from":13,"seq":55834574851,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":225280,"data_stored":75741,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.099}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85499999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6890000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7230000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.9870000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.2170000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.9009999999999998}]}]},{"osd":0,"up_from":13,"seq":55834574853,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27328,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344512,"statfs":{"total":96636764160,"available":96608780288,"internally_reserved":0,"allocated":294912,"data_stored":666587,"data_compressed":32422,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0680000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2529999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93700000000000006}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.337}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1699999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.8720000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.613}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32422,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32422,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-12T09:43:26.709 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-12T09:43:26.961 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:26.960+0000 7f70709b5640 1 Processor -- start 2023-12-12T09:43:26.961 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:26.960+0000 7f70709b5640 1 -- start start 2023-12-12T09:43:26.962 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:26.961+0000 7f70709b5640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f706c14fbb0 0x7f706c0c09e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:26.962 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:26.961+0000 7f70709b5640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f706c153300 con 0x7f706c0a9470 2023-12-12T09:43:26.962 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:26.961+0000 7f70709b5640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f706c0c2160 con 0x7f706c0c0f20 2023-12-12T09:43:26.962 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:26.961+0000 7f70709b5640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f706c0aa000 con 0x7f706c14fbb0 2023-12-12T09:43:26.964 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:26.962+0000 7f706b59e640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f706c0a9470 0x7f706c0ab510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:37326/0 (socket says 172.21.15.73:37326) 2023-12-12T09:43:26.964 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:26.962+0000 7f706b59e640 1 -- 172.21.15.73:0/1869405227 learned_addr learned my addr 172.21.15.73:0/1869405227 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-12T09:43:26.964 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:26.962+0000 7f706ad9d640 1 --2- 172.21.15.73:0/1869405227 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f706c14fbb0 0x7f706c0c09e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:26.965 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:26.962+0000 7f706a59c640 1 -- 172.21.15.73:0/1869405227 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 108130604 0 0) 0x7f706c153300 con 0x7f706c0a9470 2023-12-12T09:43:26.965 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:26.962+0000 7f706a59c640 1 -- 172.21.15.73:0/1869405227 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7058003520 con 0x7f706c0a9470 2023-12-12T09:43:26.965 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:26.962+0000 7f706a59c640 1 -- 172.21.15.73:0/1869405227 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 565590937 0 0) 0x7f7058003520 con 0x7f706c0a9470 2023-12-12T09:43:26.965 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:26.963+0000 7f706a59c640 1 -- 172.21.15.73:0/1869405227 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f706c14fbb0 msgr2=0x7f706c0c09e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:43:26.965 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:26.963+0000 7f706a59c640 1 --2- 172.21.15.73:0/1869405227 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f706c14fbb0 0x7f706c0c09e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:26.965 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:26.963+0000 7f706a59c640 1 -- 172.21.15.73:0/1869405227 >> v1:172.21.15.142:6789/0 conn(0x7f706c0c0f20 legacy=0x7f706c0aae00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:26.965 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:26.963+0000 7f706a59c640 1 -- 172.21.15.73:0/1869405227 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f706c153020 con 0x7f706c0a9470 2023-12-12T09:43:26.965 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:26.963+0000 7f706a59c640 1 -- 172.21.15.73:0/1869405227 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3186547832 0 0) 0x7f70640019f0 con 0x7f706c0a9470 2023-12-12T09:43:26.965 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:26.963+0000 7f706a59c640 1 -- 172.21.15.73:0/1869405227 >> v1:172.21.15.73:6789/0 conn(0x7f706c0a9470 legacy=0x7f706c0ab510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:26.965 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:26.963+0000 7f706a59c640 1 --2- 172.21.15.73:0/1869405227 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f70580039a0 0x7f7058003d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:26.965 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:26.963+0000 7f706a59c640 1 --2- 172.21.15.73:0/1869405227 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f70580047c0 0x7f7058004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:26.965 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:26.963+0000 7f706a59c640 1 --2- 172.21.15.73:0/1869405227 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f706c14fbb0 0x7f7058005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:26.966 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:26.963+0000 7f706a59c640 1 -- 172.21.15.73:0/1869405227 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f706c0aa000 con 0x7f70580039a0 2023-12-12T09:43:26.966 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:26.963+0000 7f706a59c640 1 -- 172.21.15.73:0/1869405227 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f705800ba80 con 0x7f70580047c0 2023-12-12T09:43:26.966 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:26.963+0000 7f706a59c640 1 -- 172.21.15.73:0/1869405227 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f705800bc40 con 0x7f706c14fbb0 2023-12-12T09:43:26.966 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:26.963+0000 7f706ad9d640 1 --2- 172.21.15.73:0/1869405227 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f70580039a0 0x7f7058003d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:26.966 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:26.963+0000 7f706b59e640 1 --2- 172.21.15.73:0/1869405227 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f706c14fbb0 0x7f7058005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:26.966 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:26.963+0000 7f7063fff640 1 --2- 172.21.15.73:0/1869405227 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f70580047c0 0x7f7058004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:26.966 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:26.963+0000 7f706ad9d640 1 -- 172.21.15.73:0/1869405227 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f706c14fbb0 msgr2=0x7f7058005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:43:26.966 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:26.963+0000 7f706ad9d640 1 --2- 172.21.15.73:0/1869405227 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f706c14fbb0 0x7f7058005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:26.966 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:26.964+0000 7f706ad9d640 1 -- 172.21.15.73:0/1869405227 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f70580047c0 msgr2=0x7f7058004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:43:26.966 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:26.964+0000 7f706ad9d640 1 --2- 172.21.15.73:0/1869405227 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f70580047c0 0x7f7058004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:26.966 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:26.964+0000 7f706ad9d640 1 -- 172.21.15.73:0/1869405227 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7058003520 con 0x7f70580039a0 2023-12-12T09:43:26.966 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:26.964+0000 7f7063fff640 1 --2- 172.21.15.73:0/1869405227 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f70580047c0 0x7f7058004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:43:26.966 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:26.964+0000 7f706b59e640 1 --2- 172.21.15.73:0/1869405227 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f706c14fbb0 0x7f7058005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:43:26.968 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:26.965+0000 7f706ad9d640 1 --2- 172.21.15.73:0/1869405227 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f70580039a0 0x7f7058003d80 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f705c009ac0 tx=0x7f70580057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd5d9168be77e4d9 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:43:26.968 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:26.965+0000 7f706a59c640 1 -- 172.21.15.73:0/1869405227 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f705c02c6b0 con 0x7f70580039a0 2023-12-12T09:43:26.968 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:26.965+0000 7f706a59c640 1 -- 172.21.15.73:0/1869405227 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f705c02c810 con 0x7f70580039a0 2023-12-12T09:43:26.968 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:26.965+0000 7f706a59c640 1 -- 172.21.15.73:0/1869405227 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f705c02cba0 con 0x7f70580039a0 2023-12-12T09:43:26.968 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:26.965+0000 7f70709b5640 1 -- 172.21.15.73:0/1869405227 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f70580039a0 msgr2=0x7f7058003d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:26.968 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:26.965+0000 7f70709b5640 1 --2- 172.21.15.73:0/1869405227 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f70580039a0 0x7f7058003d80 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f705c009ac0 tx=0x7f70580057f0 comp rx=0 tx=0).stop 2023-12-12T09:43:26.968 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:26.966+0000 7f706b59e640 1 -- 172.21.15.73:0/1869405227 reap_dead start 2023-12-12T09:43:26.968 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:26.966+0000 7f70709b5640 1 -- 172.21.15.73:0/1869405227 shutdown_connections 2023-12-12T09:43:26.968 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:26.966+0000 7f70709b5640 1 -- 172.21.15.73:0/1869405227 >> 172.21.15.73:0/1869405227 conn(0x7f706c0c23b0 msgr2=0x7f706c0c2790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:43:26.968 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:26.966+0000 7f70709b5640 1 -- 172.21.15.73:0/1869405227 shutdown_connections 2023-12-12T09:43:26.968 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:26.966+0000 7f70709b5640 1 -- 172.21.15.73:0/1869405227 wait complete. 2023-12-12T09:43:26.969 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:26.967+0000 7f70709b5640 1 Processor -- start 2023-12-12T09:43:26.970 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:26.968+0000 7f70709b5640 1 -- start start 2023-12-12T09:43:26.970 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:26.968+0000 7f70709b5640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f70580039a0 0x7f706c1e9810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:26.970 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:26.968+0000 7f70709b5640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f706c153670 0x7f706c1e6f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:26.970 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:26.968+0000 7f70709b5640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f706c1ed4f0 0x7f706c071c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:26.970 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:26.968+0000 7f70709b5640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f706c0c1d40 con 0x7f706c1ed4f0 2023-12-12T09:43:26.970 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:26.968+0000 7f70709b5640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f706c06d6a0 con 0x7f706c153670 2023-12-12T09:43:26.970 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:26.968+0000 7f70709b5640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f706c154d60 con 0x7f70580039a0 2023-12-12T09:43:26.970 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:26.969+0000 7f706b59e640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f706c1ed4f0 0x7f706c071c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:26.971 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:26.969+0000 7f706b59e640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f706c1ed4f0 0x7f706c071c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:41292/0 (socket says 172.21.15.73:41292) 2023-12-12T09:43:26.971 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:26.969+0000 7f706b59e640 1 -- 172.21.15.73:0/2897392636 learned_addr learned my addr 172.21.15.73:0/2897392636 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:43:26.972 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:26.969+0000 7f706ad9d640 1 --2- 172.21.15.73:0/2897392636 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f70580039a0 0x7f706c1e9810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:26.972 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:26.969+0000 7f7063fff640 1 --2- 172.21.15.73:0/2897392636 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f706c153670 0x7f706c1e6f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:26.972 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:26.969+0000 7f706b59e640 1 -- 172.21.15.73:0/2897392636 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f70580039a0 msgr2=0x7f706c1e9810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:26.972 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:26.969+0000 7f706b59e640 1 --2- 172.21.15.73:0/2897392636 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f70580039a0 0x7f706c1e9810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:26.972 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:26.969+0000 7f706b59e640 1 -- 172.21.15.73:0/2897392636 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f706c153670 msgr2=0x7f706c1e6f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:26.972 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:26.969+0000 7f706b59e640 1 --2- 172.21.15.73:0/2897392636 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f706c153670 0x7f706c1e6f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:26.972 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:26.969+0000 7f706b59e640 1 -- 172.21.15.73:0/2897392636 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f706c1ecd80 con 0x7f706c1ed4f0 2023-12-12T09:43:26.973 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:26.969+0000 7f706b59e640 1 --2- 172.21.15.73:0/2897392636 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f706c1ed4f0 0x7f706c071c30 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f7064002230 tx=0x7f706400df70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:43:26.973 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:26.970+0000 7f70637fe640 1 -- 172.21.15.73:0/2897392636 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f706400b7d0 con 0x7f706c1ed4f0 2023-12-12T09:43:26.973 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:26.970+0000 7f70637fe640 1 -- 172.21.15.73:0/2897392636 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f706400b930 con 0x7f706c1ed4f0 2023-12-12T09:43:26.973 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:26.970+0000 7f70709b5640 1 -- 172.21.15.73:0/2897392636 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f706c1ed060 con 0x7f706c1ed4f0 2023-12-12T09:43:26.973 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:26.970+0000 7f70637fe640 1 -- 172.21.15.73:0/2897392636 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f706400bce0 con 0x7f706c1ed4f0 2023-12-12T09:43:26.973 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:26.970+0000 7f70709b5640 1 -- 172.21.15.73:0/2897392636 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f706c154190 con 0x7f706c1ed4f0 2023-12-12T09:43:26.973 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:26.971+0000 7f70709b5640 1 -- 172.21.15.73:0/2897392636 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f706c1ed1f0 con 0x7f706c1ed4f0 2023-12-12T09:43:26.973 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:26.972+0000 7f70637fe640 1 -- 172.21.15.73:0/2897392636 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f7064007110 con 0x7f706c1ed4f0 2023-12-12T09:43:26.974 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:26.973+0000 7f70637fe640 1 --2- 172.21.15.73:0/2897392636 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f704c06ae40 0x7f704c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:26.975 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:26.974+0000 7f70637fe640 1 -- 172.21.15.73:0/2897392636 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7064089810 con 0x7f706c1ed4f0 2023-12-12T09:43:26.975 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:26.974+0000 7f706ad9d640 1 --2- 172.21.15.73:0/2897392636 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f704c06ae40 0x7f704c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:26.975 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:26.974+0000 7f706ad9d640 1 --2- 172.21.15.73:0/2897392636 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f704c06ae40 0x7f704c06d300 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f705c036000 tx=0x7f705c030000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:43:26.979 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:26.978+0000 7f70637fe640 1 -- 172.21.15.73:0/2897392636 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f70640548b0 con 0x7f706c1ed4f0 2023-12-12T09:43:27.164 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:27.163+0000 7f70709b5640 1 -- 172.21.15.73:0/2897392636 --> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f706c0c5610 con 0x7f704c06ae40 2023-12-12T09:43:27.176 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:27.175+0000 7f70637fe640 1 -- 172.21.15.73:0/2897392636 <== mgr.4110 v2:172.21.15.73:6832/779985841 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264556 (secure 0 0 0) 0x7f705c004040 con 0x7f704c06ae40 2023-12-12T09:43:27.179 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-12T09:43:27.181 INFO:teuthology.orchestra.run.smithi073.stderr:dumped all 2023-12-12T09:43:27.184 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:27.180+0000 7f70709b5640 1 -- 172.21.15.73:0/2897392636 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f704c06ae40 msgr2=0x7f704c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:27.184 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:27.180+0000 7f70709b5640 1 --2- 172.21.15.73:0/2897392636 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f704c06ae40 0x7f704c06d300 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f705c036000 tx=0x7f705c030000 comp rx=0 tx=0).stop 2023-12-12T09:43:27.184 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:27.180+0000 7f70709b5640 1 -- 172.21.15.73:0/2897392636 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f706c1ed4f0 msgr2=0x7f706c071c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:27.184 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:27.180+0000 7f70709b5640 1 --2- 172.21.15.73:0/2897392636 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f706c1ed4f0 0x7f706c071c30 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f7064002230 tx=0x7f706400df70 comp rx=0 tx=0).stop 2023-12-12T09:43:27.185 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:27.180+0000 7f70709b5640 1 -- 172.21.15.73:0/2897392636 shutdown_connections 2023-12-12T09:43:27.185 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:27.180+0000 7f70709b5640 1 --2- 172.21.15.73:0/2897392636 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f704c06ae40 0x7f704c06d300 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:27.185 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:27.180+0000 7f70709b5640 1 --2- 172.21.15.73:0/2897392636 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f706c1ed4f0 0x7f706c071c30 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:27.185 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:27.180+0000 7f70709b5640 1 --2- 172.21.15.73:0/2897392636 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f706c153670 0x7f706c1e6f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:27.185 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:27.180+0000 7f70709b5640 1 --2- 172.21.15.73:0/2897392636 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f70580039a0 0x7f706c1e9810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:27.185 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:27.180+0000 7f70709b5640 1 -- 172.21.15.73:0/2897392636 >> 172.21.15.73:0/2897392636 conn(0x7f706c0c23b0 msgr2=0x7f706c150e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:43:27.185 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:27.180+0000 7f70709b5640 1 -- 172.21.15.73:0/2897392636 shutdown_connections 2023-12-12T09:43:27.185 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:27.180+0000 7f70709b5640 1 -- 172.21.15.73:0/2897392636 wait complete. 2023-12-12T09:43:27.198 INFO:teuthology.orchestra.run.smithi073.stdout:{"pg_ready":true,"pg_map":{"version":20,"stamp":"2023-12-12T09:43:25.456166+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":143,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218100,"kb_used_data":1876,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754756620,"statfs":{"total":773094113280,"available":772870778880,"internally_reserved":0,"allocated":1921024,"data_stored":1783904,"data_compressed":64844,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":31,"apply_latency_ms":31,"commit_latency_ns":31000000,"apply_latency_ns":31000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":10,"num_read_kb":9,"num_write":58,"num_write_kb":276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.975410"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-12-12T09:43:23.513587+0000","last_change":"2023-12-12T09:43:22.259173+0000","last_active":"2023-12-12T09:43:23.513587+0000","last_peered":"2023-12-12T09:43:23.513587+0000","last_clean":"2023-12-12T09:43:23.513587+0000","last_became_active":"2023-12-12T09:43:22.257823+0000","last_became_peered":"2023-12-12T09:43:22.257823+0000","last_unstale":"2023-12-12T09:43:23.513587+0000","last_undegraded":"2023-12-12T09:43:23.513587+0000","last_fullsized":"2023-12-12T09:43:23.513587+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_clean_scrub_stamp":"2023-12-12T09:43:21.241417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T11:44:44.846070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-12-12T09:43:23.228756+0000","last_change":"2023-12-12T09:43:22.246332+0000","last_active":"2023-12-12T09:43:23.228756+0000","last_peered":"2023-12-12T09:43:23.228756+0000","last_clean":"2023-12-12T09:43:23.228756+0000","last_became_active":"2023-12-12T09:43:22.245968+0000","last_became_peered":"2023-12-12T09:43:22.245968+0000","last_unstale":"2023-12-12T09:43:23.228756+0000","last_undegraded":"2023-12-12T09:43:23.228756+0000","last_fullsized":"2023-12-12T09:43:23.228756+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_clean_scrub_stamp":"2023-12-12T09:43:21.241417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T13:28:21.176910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-12-12T09:43:23.512350+0000","last_change":"2023-12-12T09:43:22.256406+0000","last_active":"2023-12-12T09:43:23.512350+0000","last_peered":"2023-12-12T09:43:23.512350+0000","last_clean":"2023-12-12T09:43:23.512350+0000","last_became_active":"2023-12-12T09:43:22.256051+0000","last_became_peered":"2023-12-12T09:43:22.256051+0000","last_unstale":"2023-12-12T09:43:23.512350+0000","last_undegraded":"2023-12-12T09:43:23.512350+0000","last_fullsized":"2023-12-12T09:43:23.512350+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_clean_scrub_stamp":"2023-12-12T09:43:21.241417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T11:56:43.095343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-12-12T09:43:23.232452+0000","last_change":"2023-12-12T09:43:22.270381+0000","last_active":"2023-12-12T09:43:23.232452+0000","last_peered":"2023-12-12T09:43:23.232452+0000","last_clean":"2023-12-12T09:43:23.232452+0000","last_became_active":"2023-12-12T09:43:22.270156+0000","last_became_peered":"2023-12-12T09:43:22.270156+0000","last_unstale":"2023-12-12T09:43:23.232452+0000","last_undegraded":"2023-12-12T09:43:23.232452+0000","last_fullsized":"2023-12-12T09:43:23.232452+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_clean_scrub_stamp":"2023-12-12T09:43:21.241417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T12:09:32.290407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-12-12T09:43:23.512600+0000","last_change":"2023-12-12T09:43:22.256406+0000","last_active":"2023-12-12T09:43:23.512600+0000","last_peered":"2023-12-12T09:43:23.512600+0000","last_clean":"2023-12-12T09:43:23.512600+0000","last_became_active":"2023-12-12T09:43:22.256089+0000","last_became_peered":"2023-12-12T09:43:22.256089+0000","last_unstale":"2023-12-12T09:43:23.512600+0000","last_undegraded":"2023-12-12T09:43:23.512600+0000","last_fullsized":"2023-12-12T09:43:23.512600+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_clean_scrub_stamp":"2023-12-12T09:43:21.241417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T12:08:27.288104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-12-12T09:43:23.231961+0000","last_change":"2023-12-12T09:43:22.262100+0000","last_active":"2023-12-12T09:43:23.231961+0000","last_peered":"2023-12-12T09:43:23.231961+0000","last_clean":"2023-12-12T09:43:23.231961+0000","last_became_active":"2023-12-12T09:43:22.250378+0000","last_became_peered":"2023-12-12T09:43:22.250378+0000","last_unstale":"2023-12-12T09:43:23.231961+0000","last_undegraded":"2023-12-12T09:43:23.231961+0000","last_fullsized":"2023-12-12T09:43:23.231961+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_clean_scrub_stamp":"2023-12-12T09:43:21.241417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T13:28:21.176910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-12-12T09:43:23.511903+0000","last_change":"2023-12-12T09:43:22.257819+0000","last_active":"2023-12-12T09:43:23.511903+0000","last_peered":"2023-12-12T09:43:23.511903+0000","last_clean":"2023-12-12T09:43:23.511903+0000","last_became_active":"2023-12-12T09:43:22.257516+0000","last_became_peered":"2023-12-12T09:43:22.257516+0000","last_unstale":"2023-12-12T09:43:23.511903+0000","last_undegraded":"2023-12-12T09:43:23.511903+0000","last_fullsized":"2023-12-12T09:43:23.511903+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_clean_scrub_stamp":"2023-12-12T09:43:21.241417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T13:22:21.650455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-12-12T09:43:23.511693+0000","last_change":"2023-12-12T09:43:22.250148+0000","last_active":"2023-12-12T09:43:23.511693+0000","last_peered":"2023-12-12T09:43:23.511693+0000","last_clean":"2023-12-12T09:43:23.511693+0000","last_became_active":"2023-12-12T09:43:22.249829+0000","last_became_peered":"2023-12-12T09:43:22.249829+0000","last_unstale":"2023-12-12T09:43:23.511693+0000","last_undegraded":"2023-12-12T09:43:23.511693+0000","last_fullsized":"2023-12-12T09:43:23.511693+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_clean_scrub_stamp":"2023-12-12T09:43:21.241417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T10:01:50.869497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-12-12T09:43:23.513773+0000","last_change":"2023-12-12T09:43:22.283672+0000","last_active":"2023-12-12T09:43:23.513773+0000","last_peered":"2023-12-12T09:43:23.513773+0000","last_clean":"2023-12-12T09:43:23.513773+0000","last_became_active":"2023-12-12T09:43:22.283234+0000","last_became_peered":"2023-12-12T09:43:22.283234+0000","last_unstale":"2023-12-12T09:43:23.513773+0000","last_undegraded":"2023-12-12T09:43:23.513773+0000","last_fullsized":"2023-12-12T09:43:23.513773+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_clean_scrub_stamp":"2023-12-12T09:43:21.241417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T20:45:26.767222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-12-12T09:43:23.235723+0000","last_change":"2023-12-12T09:43:22.271352+0000","last_active":"2023-12-12T09:43:23.235723+0000","last_peered":"2023-12-12T09:43:23.235723+0000","last_clean":"2023-12-12T09:43:23.235723+0000","last_became_active":"2023-12-12T09:43:22.271056+0000","last_became_peered":"2023-12-12T09:43:22.271056+0000","last_unstale":"2023-12-12T09:43:23.235723+0000","last_undegraded":"2023-12-12T09:43:23.235723+0000","last_fullsized":"2023-12-12T09:43:23.235723+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_clean_scrub_stamp":"2023-12-12T09:43:21.241417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T13:28:21.176910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-12-12T09:43:23.235191+0000","last_change":"2023-12-12T09:43:22.271790+0000","last_active":"2023-12-12T09:43:23.235191+0000","last_peered":"2023-12-12T09:43:23.235191+0000","last_clean":"2023-12-12T09:43:23.235191+0000","last_became_active":"2023-12-12T09:43:22.271591+0000","last_became_peered":"2023-12-12T09:43:22.271591+0000","last_unstale":"2023-12-12T09:43:23.235191+0000","last_undegraded":"2023-12-12T09:43:23.235191+0000","last_fullsized":"2023-12-12T09:43:23.235191+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_clean_scrub_stamp":"2023-12-12T09:43:21.241417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T17:19:30.590382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-12-12T09:43:23.511156+0000","last_change":"2023-12-12T09:43:22.260477+0000","last_active":"2023-12-12T09:43:23.511156+0000","last_peered":"2023-12-12T09:43:23.511156+0000","last_clean":"2023-12-12T09:43:23.511156+0000","last_became_active":"2023-12-12T09:43:22.258474+0000","last_became_peered":"2023-12-12T09:43:22.258474+0000","last_unstale":"2023-12-12T09:43:23.511156+0000","last_undegraded":"2023-12-12T09:43:23.511156+0000","last_fullsized":"2023-12-12T09:43:23.511156+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_clean_scrub_stamp":"2023-12-12T09:43:21.241417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T17:30:21.214675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-12-12T09:43:23.513789+0000","last_change":"2023-12-12T09:43:22.256210+0000","last_active":"2023-12-12T09:43:23.513789+0000","last_peered":"2023-12-12T09:43:23.513789+0000","last_clean":"2023-12-12T09:43:23.513789+0000","last_became_active":"2023-12-12T09:43:22.255873+0000","last_became_peered":"2023-12-12T09:43:22.255873+0000","last_unstale":"2023-12-12T09:43:23.513789+0000","last_undegraded":"2023-12-12T09:43:23.513789+0000","last_fullsized":"2023-12-12T09:43:23.513789+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_clean_scrub_stamp":"2023-12-12T09:43:21.241417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T12:09:32.290407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-12-12T09:43:23.509500+0000","last_change":"2023-12-12T09:43:22.261015+0000","last_active":"2023-12-12T09:43:23.509500+0000","last_peered":"2023-12-12T09:43:23.509500+0000","last_clean":"2023-12-12T09:43:23.509500+0000","last_became_active":"2023-12-12T09:43:22.260799+0000","last_became_peered":"2023-12-12T09:43:22.260799+0000","last_unstale":"2023-12-12T09:43:23.509500+0000","last_undegraded":"2023-12-12T09:43:23.509500+0000","last_fullsized":"2023-12-12T09:43:23.509500+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_clean_scrub_stamp":"2023-12-12T09:43:21.241417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T17:13:30.502374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-12-12T09:43:23.228621+0000","last_change":"2023-12-12T09:43:22.251732+0000","last_active":"2023-12-12T09:43:23.228621+0000","last_peered":"2023-12-12T09:43:23.228621+0000","last_clean":"2023-12-12T09:43:23.228621+0000","last_became_active":"2023-12-12T09:43:22.251022+0000","last_became_peered":"2023-12-12T09:43:22.251022+0000","last_unstale":"2023-12-12T09:43:23.228621+0000","last_undegraded":"2023-12-12T09:43:23.228621+0000","last_fullsized":"2023-12-12T09:43:23.228621+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_clean_scrub_stamp":"2023-12-12T09:43:21.241417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T11:56:43.095343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-12-12T09:43:23.231963+0000","last_change":"2023-12-12T09:43:22.249945+0000","last_active":"2023-12-12T09:43:23.231963+0000","last_peered":"2023-12-12T09:43:23.231963+0000","last_clean":"2023-12-12T09:43:23.231963+0000","last_became_active":"2023-12-12T09:43:22.248947+0000","last_became_peered":"2023-12-12T09:43:22.248947+0000","last_unstale":"2023-12-12T09:43:23.231963+0000","last_undegraded":"2023-12-12T09:43:23.231963+0000","last_fullsized":"2023-12-12T09:43:23.231963+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_clean_scrub_stamp":"2023-12-12T09:43:21.241417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T10:52:36.164447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-12-12T09:43:23.234030+0000","last_change":"2023-12-12T09:43:22.269637+0000","last_active":"2023-12-12T09:43:23.234030+0000","last_peered":"2023-12-12T09:43:23.234030+0000","last_clean":"2023-12-12T09:43:23.234030+0000","last_became_active":"2023-12-12T09:43:22.269332+0000","last_became_peered":"2023-12-12T09:43:22.269332+0000","last_unstale":"2023-12-12T09:43:23.234030+0000","last_undegraded":"2023-12-12T09:43:23.234030+0000","last_fullsized":"2023-12-12T09:43:23.234030+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_clean_scrub_stamp":"2023-12-12T09:43:21.241417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T16:30:08.113732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-12-12T09:43:23.514190+0000","last_change":"2023-12-12T09:43:22.253973+0000","last_active":"2023-12-12T09:43:23.514190+0000","last_peered":"2023-12-12T09:43:23.514190+0000","last_clean":"2023-12-12T09:43:23.514190+0000","last_became_active":"2023-12-12T09:43:22.253518+0000","last_became_peered":"2023-12-12T09:43:22.253518+0000","last_unstale":"2023-12-12T09:43:23.514190+0000","last_undegraded":"2023-12-12T09:43:23.514190+0000","last_fullsized":"2023-12-12T09:43:23.514190+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_clean_scrub_stamp":"2023-12-12T09:43:21.241417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T11:40:42.785424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-12-12T09:43:23.512776+0000","last_change":"2023-12-12T09:43:22.260001+0000","last_active":"2023-12-12T09:43:23.512776+0000","last_peered":"2023-12-12T09:43:23.512776+0000","last_clean":"2023-12-12T09:43:23.512776+0000","last_became_active":"2023-12-12T09:43:22.259694+0000","last_became_peered":"2023-12-12T09:43:22.259694+0000","last_unstale":"2023-12-12T09:43:23.512776+0000","last_undegraded":"2023-12-12T09:43:23.512776+0000","last_fullsized":"2023-12-12T09:43:23.512776+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_clean_scrub_stamp":"2023-12-12T09:43:21.241417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T13:12:59.364006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-12-12T09:43:23.235234+0000","last_change":"2023-12-12T09:43:22.261171+0000","last_active":"2023-12-12T09:43:23.235234+0000","last_peered":"2023-12-12T09:43:23.235234+0000","last_clean":"2023-12-12T09:43:23.235234+0000","last_became_active":"2023-12-12T09:43:22.257505+0000","last_became_peered":"2023-12-12T09:43:22.257505+0000","last_unstale":"2023-12-12T09:43:23.235234+0000","last_undegraded":"2023-12-12T09:43:23.235234+0000","last_fullsized":"2023-12-12T09:43:23.235234+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_clean_scrub_stamp":"2023-12-12T09:43:21.241417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T11:56:43.095343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-12-12T09:43:23.510222+0000","last_change":"2023-12-12T09:43:22.249523+0000","last_active":"2023-12-12T09:43:23.510222+0000","last_peered":"2023-12-12T09:43:23.510222+0000","last_clean":"2023-12-12T09:43:23.510222+0000","last_became_active":"2023-12-12T09:43:22.249225+0000","last_became_peered":"2023-12-12T09:43:22.249225+0000","last_unstale":"2023-12-12T09:43:23.510222+0000","last_undegraded":"2023-12-12T09:43:23.510222+0000","last_fullsized":"2023-12-12T09:43:23.510222+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_clean_scrub_stamp":"2023-12-12T09:43:21.241417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T20:17:31.359873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-12-12T09:43:23.232234+0000","last_change":"2023-12-12T09:43:22.262015+0000","last_active":"2023-12-12T09:43:23.232234+0000","last_peered":"2023-12-12T09:43:23.232234+0000","last_clean":"2023-12-12T09:43:23.232234+0000","last_became_active":"2023-12-12T09:43:22.249119+0000","last_became_peered":"2023-12-12T09:43:22.249119+0000","last_unstale":"2023-12-12T09:43:23.232234+0000","last_undegraded":"2023-12-12T09:43:23.232234+0000","last_fullsized":"2023-12-12T09:43:23.232234+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_clean_scrub_stamp":"2023-12-12T09:43:21.241417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T19:41:10.137746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-12-12T09:43:23.511791+0000","last_change":"2023-12-12T09:43:22.262018+0000","last_active":"2023-12-12T09:43:23.511791+0000","last_peered":"2023-12-12T09:43:23.511791+0000","last_clean":"2023-12-12T09:43:23.511791+0000","last_became_active":"2023-12-12T09:43:22.261664+0000","last_became_peered":"2023-12-12T09:43:22.261664+0000","last_unstale":"2023-12-12T09:43:23.511791+0000","last_undegraded":"2023-12-12T09:43:23.511791+0000","last_fullsized":"2023-12-12T09:43:23.511791+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_clean_scrub_stamp":"2023-12-12T09:43:21.241417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T17:19:30.590382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-12-12T09:43:23.232314+0000","last_change":"2023-12-12T09:43:22.262378+0000","last_active":"2023-12-12T09:43:23.232314+0000","last_peered":"2023-12-12T09:43:23.232314+0000","last_clean":"2023-12-12T09:43:23.232314+0000","last_became_active":"2023-12-12T09:43:22.257809+0000","last_became_peered":"2023-12-12T09:43:22.257809+0000","last_unstale":"2023-12-12T09:43:23.232314+0000","last_undegraded":"2023-12-12T09:43:23.232314+0000","last_fullsized":"2023-12-12T09:43:23.232314+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_clean_scrub_stamp":"2023-12-12T09:43:21.241417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T13:17:19.564666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-12-12T09:43:23.512246+0000","last_change":"2023-12-12T09:43:22.255723+0000","last_active":"2023-12-12T09:43:23.512246+0000","last_peered":"2023-12-12T09:43:23.512246+0000","last_clean":"2023-12-12T09:43:23.512246+0000","last_became_active":"2023-12-12T09:43:22.255373+0000","last_became_peered":"2023-12-12T09:43:22.255373+0000","last_unstale":"2023-12-12T09:43:23.512246+0000","last_undegraded":"2023-12-12T09:43:23.512246+0000","last_fullsized":"2023-12-12T09:43:23.512246+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_clean_scrub_stamp":"2023-12-12T09:43:21.241417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T10:52:36.164447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-12-12T09:43:23.235623+0000","last_change":"2023-12-12T09:43:22.257161+0000","last_active":"2023-12-12T09:43:23.235623+0000","last_peered":"2023-12-12T09:43:23.235623+0000","last_clean":"2023-12-12T09:43:23.235623+0000","last_became_active":"2023-12-12T09:43:22.256836+0000","last_became_peered":"2023-12-12T09:43:22.256836+0000","last_unstale":"2023-12-12T09:43:23.235623+0000","last_undegraded":"2023-12-12T09:43:23.235623+0000","last_fullsized":"2023-12-12T09:43:23.235623+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_clean_scrub_stamp":"2023-12-12T09:43:21.241417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T10:52:36.164447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-12-12T09:43:23.228750+0000","last_change":"2023-12-12T09:43:22.248044+0000","last_active":"2023-12-12T09:43:23.228750+0000","last_peered":"2023-12-12T09:43:23.228750+0000","last_clean":"2023-12-12T09:43:23.228750+0000","last_became_active":"2023-12-12T09:43:22.247775+0000","last_became_peered":"2023-12-12T09:43:22.247775+0000","last_unstale":"2023-12-12T09:43:23.228750+0000","last_undegraded":"2023-12-12T09:43:23.228750+0000","last_fullsized":"2023-12-12T09:43:23.228750+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_clean_scrub_stamp":"2023-12-12T09:43:21.241417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T10:52:36.164447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-12-12T09:43:23.512629+0000","last_change":"2023-12-12T09:43:22.254318+0000","last_active":"2023-12-12T09:43:23.512629+0000","last_peered":"2023-12-12T09:43:23.512629+0000","last_clean":"2023-12-12T09:43:23.512629+0000","last_became_active":"2023-12-12T09:43:22.253983+0000","last_became_peered":"2023-12-12T09:43:22.253983+0000","last_unstale":"2023-12-12T09:43:23.512629+0000","last_undegraded":"2023-12-12T09:43:23.512629+0000","last_fullsized":"2023-12-12T09:43:23.512629+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_clean_scrub_stamp":"2023-12-12T09:43:21.241417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T13:17:19.564666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-12-12T09:43:23.510548+0000","last_change":"2023-12-12T09:43:22.259144+0000","last_active":"2023-12-12T09:43:23.510548+0000","last_peered":"2023-12-12T09:43:23.510548+0000","last_clean":"2023-12-12T09:43:23.510548+0000","last_became_active":"2023-12-12T09:43:22.258791+0000","last_became_peered":"2023-12-12T09:43:22.258791+0000","last_unstale":"2023-12-12T09:43:23.510548+0000","last_undegraded":"2023-12-12T09:43:23.510548+0000","last_fullsized":"2023-12-12T09:43:23.510548+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_clean_scrub_stamp":"2023-12-12T09:43:21.241417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T10:01:50.869497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-12-12T09:43:23.232428+0000","last_change":"2023-12-12T09:43:22.262253+0000","last_active":"2023-12-12T09:43:23.232428+0000","last_peered":"2023-12-12T09:43:23.232428+0000","last_clean":"2023-12-12T09:43:23.232428+0000","last_became_active":"2023-12-12T09:43:22.250870+0000","last_became_peered":"2023-12-12T09:43:22.250870+0000","last_unstale":"2023-12-12T09:43:23.232428+0000","last_undegraded":"2023-12-12T09:43:23.232428+0000","last_fullsized":"2023-12-12T09:43:23.232428+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_clean_scrub_stamp":"2023-12-12T09:43:21.241417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T13:22:21.650455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-12-12T09:43:23.510589+0000","last_change":"2023-12-12T09:43:22.247885+0000","last_active":"2023-12-12T09:43:23.510589+0000","last_peered":"2023-12-12T09:43:23.510589+0000","last_clean":"2023-12-12T09:43:23.510589+0000","last_became_active":"2023-12-12T09:43:22.245305+0000","last_became_peered":"2023-12-12T09:43:22.245305+0000","last_unstale":"2023-12-12T09:43:23.510589+0000","last_undegraded":"2023-12-12T09:43:23.510589+0000","last_fullsized":"2023-12-12T09:43:23.510589+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_clean_scrub_stamp":"2023-12-12T09:43:21.241417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T17:30:21.214675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-12-12T09:43:23.234759+0000","last_change":"2023-12-12T09:43:22.262475+0000","last_active":"2023-12-12T09:43:23.234759+0000","last_peered":"2023-12-12T09:43:23.234759+0000","last_clean":"2023-12-12T09:43:23.234759+0000","last_became_active":"2023-12-12T09:43:22.260635+0000","last_became_peered":"2023-12-12T09:43:22.260635+0000","last_unstale":"2023-12-12T09:43:23.234759+0000","last_undegraded":"2023-12-12T09:43:23.234759+0000","last_fullsized":"2023-12-12T09:43:23.234759+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_clean_scrub_stamp":"2023-12-12T09:43:21.241417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T10:01:50.869497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-12-12T09:43:23.510507+0000","last_change":"2023-12-12T09:43:22.253497+0000","last_active":"2023-12-12T09:43:23.510507+0000","last_peered":"2023-12-12T09:43:23.510507+0000","last_clean":"2023-12-12T09:43:23.510507+0000","last_became_active":"2023-12-12T09:43:22.253062+0000","last_became_peered":"2023-12-12T09:43:22.253062+0000","last_unstale":"2023-12-12T09:43:23.510507+0000","last_undegraded":"2023-12-12T09:43:23.510507+0000","last_fullsized":"2023-12-12T09:43:23.510507+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_clean_scrub_stamp":"2023-12-12T09:43:21.241417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T11:24:12.081000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-12-12T09:43:23.514357+0000","last_change":"2023-12-12T09:43:21.297984+0000","last_active":"2023-12-12T09:43:23.514357+0000","last_peered":"2023-12-12T09:43:23.514357+0000","last_clean":"2023-12-12T09:43:23.514357+0000","last_became_active":"2023-12-12T09:43:21.297753+0000","last_became_peered":"2023-12-12T09:43:21.297753+0000","last_unstale":"2023-12-12T09:43:23.514357+0000","last_undegraded":"2023-12-12T09:43:23.514357+0000","last_fullsized":"2023-12-12T09:43:23.514357+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:43:20.054829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:43:20.054829+0000","last_clean_scrub_stamp":"2023-12-12T09:43:20.054829+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T14:02:28.705261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-12-12T09:43:23.510862+0000","last_change":"2023-12-12T09:43:22.257540+0000","last_active":"2023-12-12T09:43:23.510862+0000","last_peered":"2023-12-12T09:43:23.510862+0000","last_clean":"2023-12-12T09:43:23.510862+0000","last_became_active":"2023-12-12T09:43:22.257172+0000","last_became_peered":"2023-12-12T09:43:22.257172+0000","last_unstale":"2023-12-12T09:43:23.510862+0000","last_undegraded":"2023-12-12T09:43:23.510862+0000","last_fullsized":"2023-12-12T09:43:23.510862+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_clean_scrub_stamp":"2023-12-12T09:43:21.241417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T17:19:30.590382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-12-12T09:43:23.235423+0000","last_change":"2023-12-12T09:43:21.301627+0000","last_active":"2023-12-12T09:43:23.235423+0000","last_peered":"2023-12-12T09:43:23.235423+0000","last_clean":"2023-12-12T09:43:23.235423+0000","last_became_active":"2023-12-12T09:43:21.296928+0000","last_became_peered":"2023-12-12T09:43:21.296928+0000","last_unstale":"2023-12-12T09:43:23.235423+0000","last_undegraded":"2023-12-12T09:43:23.235423+0000","last_fullsized":"2023-12-12T09:43:23.235423+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:43:20.054829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:43:20.054829+0000","last_clean_scrub_stamp":"2023-12-12T09:43:20.054829+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T17:13:29.315785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-12-12T09:43:23.511662+0000","last_change":"2023-12-12T09:43:21.292918+0000","last_active":"2023-12-12T09:43:23.511662+0000","last_peered":"2023-12-12T09:43:23.511662+0000","last_clean":"2023-12-12T09:43:23.511662+0000","last_became_active":"2023-12-12T09:43:21.292599+0000","last_became_peered":"2023-12-12T09:43:21.292599+0000","last_unstale":"2023-12-12T09:43:23.511662+0000","last_undegraded":"2023-12-12T09:43:23.511662+0000","last_fullsized":"2023-12-12T09:43:23.511662+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:43:20.054829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:43:20.054829+0000","last_clean_scrub_stamp":"2023-12-12T09:43:20.054829+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T17:13:29.315785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-12-12T09:43:23.512032+0000","last_change":"2023-12-12T09:43:22.250889+0000","last_active":"2023-12-12T09:43:23.512032+0000","last_peered":"2023-12-12T09:43:23.512032+0000","last_clean":"2023-12-12T09:43:23.512032+0000","last_became_active":"2023-12-12T09:43:22.249404+0000","last_became_peered":"2023-12-12T09:43:22.249404+0000","last_unstale":"2023-12-12T09:43:23.512032+0000","last_undegraded":"2023-12-12T09:43:23.512032+0000","last_fullsized":"2023-12-12T09:43:23.512032+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_clean_scrub_stamp":"2023-12-12T09:43:21.241417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T11:56:43.095343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-12-12T09:43:23.232554+0000","last_change":"2023-12-12T09:43:21.283438+0000","last_active":"2023-12-12T09:43:23.232554+0000","last_peered":"2023-12-12T09:43:23.232554+0000","last_clean":"2023-12-12T09:43:23.232554+0000","last_became_active":"2023-12-12T09:43:21.283168+0000","last_became_peered":"2023-12-12T09:43:21.283168+0000","last_unstale":"2023-12-12T09:43:23.232554+0000","last_undegraded":"2023-12-12T09:43:23.232554+0000","last_fullsized":"2023-12-12T09:43:23.232554+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:43:20.054829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:43:20.054829+0000","last_clean_scrub_stamp":"2023-12-12T09:43:20.054829+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T19:29:29.412626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-12-12T09:43:23.228419+0000","last_change":"2023-12-12T09:43:22.246835+0000","last_active":"2023-12-12T09:43:23.228419+0000","last_peered":"2023-12-12T09:43:23.228419+0000","last_clean":"2023-12-12T09:43:23.228419+0000","last_became_active":"2023-12-12T09:43:22.246425+0000","last_became_peered":"2023-12-12T09:43:22.246425+0000","last_unstale":"2023-12-12T09:43:23.228419+0000","last_undegraded":"2023-12-12T09:43:23.228419+0000","last_fullsized":"2023-12-12T09:43:23.228419+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_clean_scrub_stamp":"2023-12-12T09:43:21.241417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T10:01:50.869497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-12-12T09:43:23.235408+0000","last_change":"2023-12-12T09:43:21.296908+0000","last_active":"2023-12-12T09:43:23.235408+0000","last_peered":"2023-12-12T09:43:23.235408+0000","last_clean":"2023-12-12T09:43:23.235408+0000","last_became_active":"2023-12-12T09:43:21.296613+0000","last_became_peered":"2023-12-12T09:43:21.296613+0000","last_unstale":"2023-12-12T09:43:23.235408+0000","last_undegraded":"2023-12-12T09:43:23.235408+0000","last_fullsized":"2023-12-12T09:43:23.235408+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:43:20.054829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:43:20.054829+0000","last_clean_scrub_stamp":"2023-12-12T09:43:20.054829+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T17:12:57.858301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-12-12T09:43:23.233425+0000","last_change":"2023-12-12T09:43:22.257034+0000","last_active":"2023-12-12T09:43:23.233425+0000","last_peered":"2023-12-12T09:43:23.233425+0000","last_clean":"2023-12-12T09:43:23.233425+0000","last_became_active":"2023-12-12T09:43:22.250340+0000","last_became_peered":"2023-12-12T09:43:22.250340+0000","last_unstale":"2023-12-12T09:43:23.233425+0000","last_undegraded":"2023-12-12T09:43:23.233425+0000","last_fullsized":"2023-12-12T09:43:23.233425+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_clean_scrub_stamp":"2023-12-12T09:43:21.241417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T11:37:48.456174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-12-12T09:43:23.233396+0000","last_change":"2023-12-12T09:43:21.303926+0000","last_active":"2023-12-12T09:43:23.233396+0000","last_peered":"2023-12-12T09:43:23.233396+0000","last_clean":"2023-12-12T09:43:23.233396+0000","last_became_active":"2023-12-12T09:43:21.303631+0000","last_became_peered":"2023-12-12T09:43:21.303631+0000","last_unstale":"2023-12-12T09:43:23.233396+0000","last_undegraded":"2023-12-12T09:43:23.233396+0000","last_fullsized":"2023-12-12T09:43:23.233396+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:43:20.054829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:43:20.054829+0000","last_clean_scrub_stamp":"2023-12-12T09:43:20.054829+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T10:01:49.682908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-12-12T09:43:23.513875+0000","last_change":"2023-12-12T09:43:22.252730+0000","last_active":"2023-12-12T09:43:23.513875+0000","last_peered":"2023-12-12T09:43:23.513875+0000","last_clean":"2023-12-12T09:43:23.513875+0000","last_became_active":"2023-12-12T09:43:22.252440+0000","last_became_peered":"2023-12-12T09:43:22.252440+0000","last_unstale":"2023-12-12T09:43:23.513875+0000","last_undegraded":"2023-12-12T09:43:23.513875+0000","last_fullsized":"2023-12-12T09:43:23.513875+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_clean_scrub_stamp":"2023-12-12T09:43:21.241417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T13:28:21.176910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-12-12T09:43:23.228903+0000","last_change":"2023-12-12T09:43:21.288877+0000","last_active":"2023-12-12T09:43:23.228903+0000","last_peered":"2023-12-12T09:43:23.228903+0000","last_clean":"2023-12-12T09:43:23.228903+0000","last_became_active":"2023-12-12T09:43:21.288552+0000","last_became_peered":"2023-12-12T09:43:21.288552+0000","last_unstale":"2023-12-12T09:43:23.228903+0000","last_undegraded":"2023-12-12T09:43:23.228903+0000","last_fullsized":"2023-12-12T09:43:23.228903+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:43:20.054829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:43:20.054829+0000","last_clean_scrub_stamp":"2023-12-12T09:43:20.054829+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T20:32:59.313749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-12-12T09:43:23.511204+0000","last_change":"2023-12-12T09:43:22.261371+0000","last_active":"2023-12-12T09:43:23.511204+0000","last_peered":"2023-12-12T09:43:23.511204+0000","last_clean":"2023-12-12T09:43:23.511204+0000","last_became_active":"2023-12-12T09:43:22.255661+0000","last_became_peered":"2023-12-12T09:43:22.255661+0000","last_unstale":"2023-12-12T09:43:23.511204+0000","last_undegraded":"2023-12-12T09:43:23.511204+0000","last_fullsized":"2023-12-12T09:43:23.511204+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_clean_scrub_stamp":"2023-12-12T09:43:21.241417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T11:40:42.785424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"20'6","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-12-12T09:43:23.235332+0000","last_change":"2023-12-12T09:43:21.302252+0000","last_active":"2023-12-12T09:43:23.235332+0000","last_peered":"2023-12-12T09:43:23.235332+0000","last_clean":"2023-12-12T09:43:23.235332+0000","last_became_active":"2023-12-12T09:43:21.301960+0000","last_became_peered":"2023-12-12T09:43:21.301960+0000","last_unstale":"2023-12-12T09:43:23.235332+0000","last_undegraded":"2023-12-12T09:43:23.235332+0000","last_fullsized":"2023-12-12T09:43:23.235332+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:43:20.054829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:43:20.054829+0000","last_clean_scrub_stamp":"2023-12-12T09:43:20.054829+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T21:27:10.922205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-12-12T09:43:23.512344+0000","last_change":"2023-12-12T09:43:22.264539+0000","last_active":"2023-12-12T09:43:23.512344+0000","last_peered":"2023-12-12T09:43:23.512344+0000","last_clean":"2023-12-12T09:43:23.512344+0000","last_became_active":"2023-12-12T09:43:22.264263+0000","last_became_peered":"2023-12-12T09:43:22.264263+0000","last_unstale":"2023-12-12T09:43:23.512344+0000","last_undegraded":"2023-12-12T09:43:23.512344+0000","last_fullsized":"2023-12-12T09:43:23.512344+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_clean_scrub_stamp":"2023-12-12T09:43:21.241417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T11:24:46.660535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-12-12T09:43:23.511008+0000","last_change":"2023-12-12T09:43:21.291014+0000","last_active":"2023-12-12T09:43:23.511008+0000","last_peered":"2023-12-12T09:43:23.511008+0000","last_clean":"2023-12-12T09:43:23.511008+0000","last_became_active":"2023-12-12T09:43:21.286948+0000","last_became_peered":"2023-12-12T09:43:21.286948+0000","last_unstale":"2023-12-12T09:43:23.511008+0000","last_undegraded":"2023-12-12T09:43:23.511008+0000","last_fullsized":"2023-12-12T09:43:23.511008+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:43:20.054829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:43:20.054829+0000","last_clean_scrub_stamp":"2023-12-12T09:43:20.054829+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T18:28:40.746959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-12-12T09:43:23.509853+0000","last_change":"2023-12-12T09:43:22.249360+0000","last_active":"2023-12-12T09:43:23.509853+0000","last_peered":"2023-12-12T09:43:23.509853+0000","last_clean":"2023-12-12T09:43:23.509853+0000","last_became_active":"2023-12-12T09:43:22.248965+0000","last_became_peered":"2023-12-12T09:43:22.248965+0000","last_unstale":"2023-12-12T09:43:23.509853+0000","last_undegraded":"2023-12-12T09:43:23.509853+0000","last_fullsized":"2023-12-12T09:43:23.509853+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_clean_scrub_stamp":"2023-12-12T09:43:21.241417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T14:02:29.891850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-12-12T09:43:23.232545+0000","last_change":"2023-12-12T09:43:21.291279+0000","last_active":"2023-12-12T09:43:23.232545+0000","last_peered":"2023-12-12T09:43:23.232545+0000","last_clean":"2023-12-12T09:43:23.232545+0000","last_became_active":"2023-12-12T09:43:21.290993+0000","last_became_peered":"2023-12-12T09:43:21.290993+0000","last_unstale":"2023-12-12T09:43:23.232545+0000","last_undegraded":"2023-12-12T09:43:23.232545+0000","last_fullsized":"2023-12-12T09:43:23.232545+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:43:20.054829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:43:20.054829+0000","last_clean_scrub_stamp":"2023-12-12T09:43:20.054829+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T21:27:10.922205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-12-12T09:43:23.512810+0000","last_change":"2023-12-12T09:43:22.264893+0000","last_active":"2023-12-12T09:43:23.512810+0000","last_peered":"2023-12-12T09:43:23.512810+0000","last_clean":"2023-12-12T09:43:23.512810+0000","last_became_active":"2023-12-12T09:43:22.262599+0000","last_became_peered":"2023-12-12T09:43:22.262599+0000","last_unstale":"2023-12-12T09:43:23.512810+0000","last_undegraded":"2023-12-12T09:43:23.512810+0000","last_fullsized":"2023-12-12T09:43:23.512810+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_clean_scrub_stamp":"2023-12-12T09:43:21.241417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T11:37:48.456174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-12-12T09:43:23.234782+0000","last_change":"2023-12-12T09:43:21.298187+0000","last_active":"2023-12-12T09:43:23.234782+0000","last_peered":"2023-12-12T09:43:23.234782+0000","last_clean":"2023-12-12T09:43:23.234782+0000","last_became_active":"2023-12-12T09:43:21.297563+0000","last_became_peered":"2023-12-12T09:43:21.297563+0000","last_unstale":"2023-12-12T09:43:23.234782+0000","last_undegraded":"2023-12-12T09:43:23.234782+0000","last_fullsized":"2023-12-12T09:43:23.234782+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:43:20.054829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:43:20.054829+0000","last_clean_scrub_stamp":"2023-12-12T09:43:20.054829+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T18:28:40.746959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-12-12T09:43:23.234722+0000","last_change":"2023-12-12T09:43:22.265004+0000","last_active":"2023-12-12T09:43:23.234722+0000","last_peered":"2023-12-12T09:43:23.234722+0000","last_clean":"2023-12-12T09:43:23.234722+0000","last_became_active":"2023-12-12T09:43:22.264691+0000","last_became_peered":"2023-12-12T09:43:22.264691+0000","last_unstale":"2023-12-12T09:43:23.234722+0000","last_undegraded":"2023-12-12T09:43:23.234722+0000","last_fullsized":"2023-12-12T09:43:23.234722+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_clean_scrub_stamp":"2023-12-12T09:43:21.241417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T20:17:31.359873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-12-12T09:43:23.510566+0000","last_change":"2023-12-12T09:43:21.284943+0000","last_active":"2023-12-12T09:43:23.510566+0000","last_peered":"2023-12-12T09:43:23.510566+0000","last_clean":"2023-12-12T09:43:23.510566+0000","last_became_active":"2023-12-12T09:43:21.284647+0000","last_became_peered":"2023-12-12T09:43:21.284647+0000","last_unstale":"2023-12-12T09:43:23.510566+0000","last_undegraded":"2023-12-12T09:43:23.510566+0000","last_fullsized":"2023-12-12T09:43:23.510566+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:43:20.054829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:43:20.054829+0000","last_clean_scrub_stamp":"2023-12-12T09:43:20.054829+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T11:24:10.894411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-12-12T09:43:23.511910+0000","last_change":"2023-12-12T09:43:22.265457+0000","last_active":"2023-12-12T09:43:23.511910+0000","last_peered":"2023-12-12T09:43:23.511910+0000","last_clean":"2023-12-12T09:43:23.511910+0000","last_became_active":"2023-12-12T09:43:22.263712+0000","last_became_peered":"2023-12-12T09:43:22.263712+0000","last_unstale":"2023-12-12T09:43:23.511910+0000","last_undegraded":"2023-12-12T09:43:23.511910+0000","last_fullsized":"2023-12-12T09:43:23.511910+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_clean_scrub_stamp":"2023-12-12T09:43:21.241417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T12:09:32.290407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-12-12T09:43:23.511049+0000","last_change":"2023-12-12T09:43:21.295422+0000","last_active":"2023-12-12T09:43:23.511049+0000","last_peered":"2023-12-12T09:43:23.511049+0000","last_clean":"2023-12-12T09:43:23.511049+0000","last_became_active":"2023-12-12T09:43:21.295045+0000","last_became_peered":"2023-12-12T09:43:21.295045+0000","last_unstale":"2023-12-12T09:43:23.511049+0000","last_undegraded":"2023-12-12T09:43:23.511049+0000","last_fullsized":"2023-12-12T09:43:23.511049+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:43:20.054829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:43:20.054829+0000","last_clean_scrub_stamp":"2023-12-12T09:43:20.054829+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T17:12:57.858301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-12-12T09:43:23.513178+0000","last_change":"2023-12-12T09:43:22.261274+0000","last_active":"2023-12-12T09:43:23.513178+0000","last_peered":"2023-12-12T09:43:23.513178+0000","last_clean":"2023-12-12T09:43:23.513178+0000","last_became_active":"2023-12-12T09:43:22.260940+0000","last_became_peered":"2023-12-12T09:43:22.260940+0000","last_unstale":"2023-12-12T09:43:23.513178+0000","last_undegraded":"2023-12-12T09:43:23.513178+0000","last_fullsized":"2023-12-12T09:43:23.513178+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_clean_scrub_stamp":"2023-12-12T09:43:21.241417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T16:30:08.113732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-12-12T09:43:23.514412+0000","last_change":"2023-12-12T09:43:21.292425+0000","last_active":"2023-12-12T09:43:23.514412+0000","last_peered":"2023-12-12T09:43:23.514412+0000","last_clean":"2023-12-12T09:43:23.514412+0000","last_became_active":"2023-12-12T09:43:21.290884+0000","last_became_peered":"2023-12-12T09:43:21.290884+0000","last_unstale":"2023-12-12T09:43:23.514412+0000","last_undegraded":"2023-12-12T09:43:23.514412+0000","last_fullsized":"2023-12-12T09:43:23.514412+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:43:20.054829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:43:20.054829+0000","last_clean_scrub_stamp":"2023-12-12T09:43:20.054829+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T10:41:13.505292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-12-12T09:43:23.513933+0000","last_change":"2023-12-12T09:43:22.261726+0000","last_active":"2023-12-12T09:43:23.513933+0000","last_peered":"2023-12-12T09:43:23.513933+0000","last_clean":"2023-12-12T09:43:23.513933+0000","last_became_active":"2023-12-12T09:43:22.261503+0000","last_became_peered":"2023-12-12T09:43:22.261503+0000","last_unstale":"2023-12-12T09:43:23.513933+0000","last_undegraded":"2023-12-12T09:43:23.513933+0000","last_fullsized":"2023-12-12T09:43:23.513933+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_clean_scrub_stamp":"2023-12-12T09:43:21.241417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T11:47:46.279003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-12-12T09:43:23.228883+0000","last_change":"2023-12-12T09:43:21.288749+0000","last_active":"2023-12-12T09:43:23.228883+0000","last_peered":"2023-12-12T09:43:23.228883+0000","last_clean":"2023-12-12T09:43:23.228883+0000","last_became_active":"2023-12-12T09:43:21.288489+0000","last_became_peered":"2023-12-12T09:43:21.288489+0000","last_unstale":"2023-12-12T09:43:23.228883+0000","last_undegraded":"2023-12-12T09:43:23.228883+0000","last_fullsized":"2023-12-12T09:43:23.228883+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:43:20.054829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:43:20.054829+0000","last_clean_scrub_stamp":"2023-12-12T09:43:20.054829+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T20:17:30.173285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-12-12T09:43:23.233067+0000","last_change":"2023-12-12T09:43:22.270243+0000","last_active":"2023-12-12T09:43:23.233067+0000","last_peered":"2023-12-12T09:43:23.233067+0000","last_clean":"2023-12-12T09:43:23.233067+0000","last_became_active":"2023-12-12T09:43:22.269976+0000","last_became_peered":"2023-12-12T09:43:22.269976+0000","last_unstale":"2023-12-12T09:43:23.233067+0000","last_undegraded":"2023-12-12T09:43:23.233067+0000","last_fullsized":"2023-12-12T09:43:23.233067+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_clean_scrub_stamp":"2023-12-12T09:43:21.241417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T12:08:27.288104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-12-12T09:43:23.511644+0000","last_change":"2023-12-12T09:43:21.286223+0000","last_active":"2023-12-12T09:43:23.511644+0000","last_peered":"2023-12-12T09:43:23.511644+0000","last_clean":"2023-12-12T09:43:23.511644+0000","last_became_active":"2023-12-12T09:43:21.285919+0000","last_became_peered":"2023-12-12T09:43:21.285919+0000","last_unstale":"2023-12-12T09:43:23.511644+0000","last_undegraded":"2023-12-12T09:43:23.511644+0000","last_fullsized":"2023-12-12T09:43:23.511644+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:43:20.054829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:43:20.054829+0000","last_clean_scrub_stamp":"2023-12-12T09:43:20.054829+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T20:43:17.341558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-12-12T09:43:23.512543+0000","last_change":"2023-12-12T09:43:22.279936+0000","last_active":"2023-12-12T09:43:23.512543+0000","last_peered":"2023-12-12T09:43:23.512543+0000","last_clean":"2023-12-12T09:43:23.512543+0000","last_became_active":"2023-12-12T09:43:22.276294+0000","last_became_peered":"2023-12-12T09:43:22.276294+0000","last_unstale":"2023-12-12T09:43:23.512543+0000","last_undegraded":"2023-12-12T09:43:23.512543+0000","last_fullsized":"2023-12-12T09:43:23.512543+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_clean_scrub_stamp":"2023-12-12T09:43:21.241417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T20:26:35.861125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":165,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-12T09:43:22.246331+0000","last_change":"2023-12-12T09:43:17.203315+0000","last_active":"2023-12-12T09:43:22.246331+0000","last_peered":"2023-12-12T09:43:22.246331+0000","last_clean":"2023-12-12T09:43:22.246331+0000","last_became_active":"2023-12-12T09:43:17.200779+0000","last_became_peered":"2023-12-12T09:43:17.200779+0000","last_unstale":"2023-12-12T09:43:22.246331+0000","last_undegraded":"2023-12-12T09:43:22.246331+0000","last_fullsized":"2023-12-12T09:43:22.246331+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:43:15.931922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:43:15.931922+0000","last_clean_scrub_stamp":"2023-12-12T09:43:15.931922+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T21:42:10.929640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-12-12T09:43:23.231837+0000","last_change":"2023-12-12T09:43:21.286777+0000","last_active":"2023-12-12T09:43:23.231837+0000","last_peered":"2023-12-12T09:43:23.231837+0000","last_clean":"2023-12-12T09:43:23.231837+0000","last_became_active":"2023-12-12T09:43:21.285422+0000","last_became_peered":"2023-12-12T09:43:21.285422+0000","last_unstale":"2023-12-12T09:43:23.231837+0000","last_undegraded":"2023-12-12T09:43:23.231837+0000","last_fullsized":"2023-12-12T09:43:23.231837+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:43:20.054829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:43:20.054829+0000","last_clean_scrub_stamp":"2023-12-12T09:43:20.054829+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T17:30:20.028086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-12-12T09:43:23.511894+0000","last_change":"2023-12-12T09:43:22.272912+0000","last_active":"2023-12-12T09:43:23.511894+0000","last_peered":"2023-12-12T09:43:23.511894+0000","last_clean":"2023-12-12T09:43:23.511894+0000","last_became_active":"2023-12-12T09:43:22.272617+0000","last_became_peered":"2023-12-12T09:43:22.272617+0000","last_unstale":"2023-12-12T09:43:23.511894+0000","last_undegraded":"2023-12-12T09:43:23.511894+0000","last_fullsized":"2023-12-12T09:43:23.511894+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_clean_scrub_stamp":"2023-12-12T09:43:21.241417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T19:29:30.599215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-12-12T09:43:23.511681+0000","last_change":"2023-12-12T09:43:21.300937+0000","last_active":"2023-12-12T09:43:23.511681+0000","last_peered":"2023-12-12T09:43:23.511681+0000","last_clean":"2023-12-12T09:43:23.511681+0000","last_became_active":"2023-12-12T09:43:21.300601+0000","last_became_peered":"2023-12-12T09:43:21.300601+0000","last_unstale":"2023-12-12T09:43:23.511681+0000","last_undegraded":"2023-12-12T09:43:23.511681+0000","last_fullsized":"2023-12-12T09:43:23.511681+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:43:20.054829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:43:20.054829+0000","last_clean_scrub_stamp":"2023-12-12T09:43:20.054829+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T21:27:10.922205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-12-12T09:43:23.509615+0000","last_change":"2023-12-12T09:43:22.252774+0000","last_active":"2023-12-12T09:43:23.509615+0000","last_peered":"2023-12-12T09:43:23.509615+0000","last_clean":"2023-12-12T09:43:23.509615+0000","last_became_active":"2023-12-12T09:43:22.252296+0000","last_became_peered":"2023-12-12T09:43:22.252296+0000","last_unstale":"2023-12-12T09:43:23.509615+0000","last_undegraded":"2023-12-12T09:43:23.509615+0000","last_fullsized":"2023-12-12T09:43:23.509615+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_clean_scrub_stamp":"2023-12-12T09:43:21.241417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T20:33:00.500338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-12-12T09:43:23.510762+0000","last_change":"2023-12-12T09:43:21.291232+0000","last_active":"2023-12-12T09:43:23.510762+0000","last_peered":"2023-12-12T09:43:23.510762+0000","last_clean":"2023-12-12T09:43:23.510762+0000","last_became_active":"2023-12-12T09:43:21.290905+0000","last_became_peered":"2023-12-12T09:43:21.290905+0000","last_unstale":"2023-12-12T09:43:23.510762+0000","last_undegraded":"2023-12-12T09:43:23.510762+0000","last_fullsized":"2023-12-12T09:43:23.510762+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:43:20.054829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:43:20.054829+0000","last_clean_scrub_stamp":"2023-12-12T09:43:20.054829+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T17:12:57.858301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-12-12T09:43:23.228577+0000","last_change":"2023-12-12T09:43:22.247541+0000","last_active":"2023-12-12T09:43:23.228577+0000","last_peered":"2023-12-12T09:43:23.228577+0000","last_clean":"2023-12-12T09:43:23.228577+0000","last_became_active":"2023-12-12T09:43:22.247160+0000","last_became_peered":"2023-12-12T09:43:22.247160+0000","last_unstale":"2023-12-12T09:43:23.228577+0000","last_undegraded":"2023-12-12T09:43:23.228577+0000","last_fullsized":"2023-12-12T09:43:23.228577+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_clean_scrub_stamp":"2023-12-12T09:43:21.241417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T19:29:30.599215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-12-12T09:43:23.232670+0000","last_change":"2023-12-12T09:43:21.292842+0000","last_active":"2023-12-12T09:43:23.232670+0000","last_peered":"2023-12-12T09:43:23.232670+0000","last_clean":"2023-12-12T09:43:23.232670+0000","last_became_active":"2023-12-12T09:43:21.292525+0000","last_became_peered":"2023-12-12T09:43:21.292525+0000","last_unstale":"2023-12-12T09:43:23.232670+0000","last_undegraded":"2023-12-12T09:43:23.232670+0000","last_fullsized":"2023-12-12T09:43:23.232670+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:43:20.054829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:43:20.054829+0000","last_clean_scrub_stamp":"2023-12-12T09:43:20.054829+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T18:28:40.746959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-12-12T09:43:23.511003+0000","last_change":"2023-12-12T09:43:22.255350+0000","last_active":"2023-12-12T09:43:23.511003+0000","last_peered":"2023-12-12T09:43:23.511003+0000","last_clean":"2023-12-12T09:43:23.511003+0000","last_became_active":"2023-12-12T09:43:22.253699+0000","last_became_peered":"2023-12-12T09:43:22.253699+0000","last_unstale":"2023-12-12T09:43:23.511003+0000","last_undegraded":"2023-12-12T09:43:23.511003+0000","last_fullsized":"2023-12-12T09:43:23.511003+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_clean_scrub_stamp":"2023-12-12T09:43:21.241417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T10:41:14.691881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-12-12T09:43:23.228484+0000","last_change":"2023-12-12T09:43:21.275987+0000","last_active":"2023-12-12T09:43:23.228484+0000","last_peered":"2023-12-12T09:43:23.228484+0000","last_clean":"2023-12-12T09:43:23.228484+0000","last_became_active":"2023-12-12T09:43:21.274563+0000","last_became_peered":"2023-12-12T09:43:21.274563+0000","last_unstale":"2023-12-12T09:43:23.228484+0000","last_undegraded":"2023-12-12T09:43:23.228484+0000","last_fullsized":"2023-12-12T09:43:23.228484+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:43:20.054829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:43:20.054829+0000","last_clean_scrub_stamp":"2023-12-12T09:43:20.054829+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T21:27:10.922205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-12-12T09:43:23.233263+0000","last_change":"2023-12-12T09:43:22.270432+0000","last_active":"2023-12-12T09:43:23.233263+0000","last_peered":"2023-12-12T09:43:23.233263+0000","last_clean":"2023-12-12T09:43:23.233263+0000","last_became_active":"2023-12-12T09:43:22.265195+0000","last_became_peered":"2023-12-12T09:43:22.265195+0000","last_unstale":"2023-12-12T09:43:23.233263+0000","last_undegraded":"2023-12-12T09:43:23.233263+0000","last_fullsized":"2023-12-12T09:43:23.233263+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_clean_scrub_stamp":"2023-12-12T09:43:21.241417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T13:12:59.364006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-12-12T09:43:23.512702+0000","last_change":"2023-12-12T09:43:21.305016+0000","last_active":"2023-12-12T09:43:23.512702+0000","last_peered":"2023-12-12T09:43:23.512702+0000","last_clean":"2023-12-12T09:43:23.512702+0000","last_became_active":"2023-12-12T09:43:21.302634+0000","last_became_peered":"2023-12-12T09:43:21.302634+0000","last_unstale":"2023-12-12T09:43:23.512702+0000","last_undegraded":"2023-12-12T09:43:23.512702+0000","last_fullsized":"2023-12-12T09:43:23.512702+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:43:20.054829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:43:20.054829+0000","last_clean_scrub_stamp":"2023-12-12T09:43:20.054829+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T19:41:08.951158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-12-12T09:43:23.228598+0000","last_change":"2023-12-12T09:43:22.249130+0000","last_active":"2023-12-12T09:43:23.228598+0000","last_peered":"2023-12-12T09:43:23.228598+0000","last_clean":"2023-12-12T09:43:23.228598+0000","last_became_active":"2023-12-12T09:43:22.248797+0000","last_became_peered":"2023-12-12T09:43:22.248797+0000","last_unstale":"2023-12-12T09:43:23.228598+0000","last_undegraded":"2023-12-12T09:43:23.228598+0000","last_fullsized":"2023-12-12T09:43:23.228598+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_clean_scrub_stamp":"2023-12-12T09:43:21.241417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T17:19:30.590382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-12-12T09:43:23.228746+0000","last_change":"2023-12-12T09:43:21.299170+0000","last_active":"2023-12-12T09:43:23.228746+0000","last_peered":"2023-12-12T09:43:23.228746+0000","last_clean":"2023-12-12T09:43:23.228746+0000","last_became_active":"2023-12-12T09:43:21.298879+0000","last_became_peered":"2023-12-12T09:43:21.298879+0000","last_unstale":"2023-12-12T09:43:23.228746+0000","last_undegraded":"2023-12-12T09:43:23.228746+0000","last_fullsized":"2023-12-12T09:43:23.228746+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:43:20.054829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:43:20.054829+0000","last_clean_scrub_stamp":"2023-12-12T09:43:20.054829+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T14:02:28.705261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-12-12T09:43:23.512630+0000","last_change":"2023-12-12T09:43:22.261674+0000","last_active":"2023-12-12T09:43:23.512630+0000","last_peered":"2023-12-12T09:43:23.512630+0000","last_clean":"2023-12-12T09:43:23.512630+0000","last_became_active":"2023-12-12T09:43:22.261405+0000","last_became_peered":"2023-12-12T09:43:22.261405+0000","last_unstale":"2023-12-12T09:43:23.512630+0000","last_undegraded":"2023-12-12T09:43:23.512630+0000","last_fullsized":"2023-12-12T09:43:23.512630+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_clean_scrub_stamp":"2023-12-12T09:43:21.241417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T19:41:10.137746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-12-12T09:43:23.235503+0000","last_change":"2023-12-12T09:43:21.304624+0000","last_active":"2023-12-12T09:43:23.235503+0000","last_peered":"2023-12-12T09:43:23.235503+0000","last_clean":"2023-12-12T09:43:23.235503+0000","last_became_active":"2023-12-12T09:43:21.304305+0000","last_became_peered":"2023-12-12T09:43:21.304305+0000","last_unstale":"2023-12-12T09:43:23.235503+0000","last_undegraded":"2023-12-12T09:43:23.235503+0000","last_fullsized":"2023-12-12T09:43:23.235503+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:43:20.054829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:43:20.054829+0000","last_clean_scrub_stamp":"2023-12-12T09:43:20.054829+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T11:24:10.894411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-12-12T09:43:23.512203+0000","last_change":"2023-12-12T09:43:22.260743+0000","last_active":"2023-12-12T09:43:23.512203+0000","last_peered":"2023-12-12T09:43:23.512203+0000","last_clean":"2023-12-12T09:43:23.512203+0000","last_became_active":"2023-12-12T09:43:22.260367+0000","last_became_peered":"2023-12-12T09:43:22.260367+0000","last_unstale":"2023-12-12T09:43:23.512203+0000","last_undegraded":"2023-12-12T09:43:23.512203+0000","last_fullsized":"2023-12-12T09:43:23.512203+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_clean_scrub_stamp":"2023-12-12T09:43:21.241417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T19:29:30.599215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-12-12T09:43:23.511691+0000","last_change":"2023-12-12T09:43:21.301133+0000","last_active":"2023-12-12T09:43:23.511691+0000","last_peered":"2023-12-12T09:43:23.511691+0000","last_clean":"2023-12-12T09:43:23.511691+0000","last_became_active":"2023-12-12T09:43:21.300231+0000","last_became_peered":"2023-12-12T09:43:21.300231+0000","last_unstale":"2023-12-12T09:43:23.511691+0000","last_undegraded":"2023-12-12T09:43:23.511691+0000","last_fullsized":"2023-12-12T09:43:23.511691+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:43:20.054829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:43:20.054829+0000","last_clean_scrub_stamp":"2023-12-12T09:43:20.054829+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T10:41:13.505292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-12-12T09:43:23.510712+0000","last_change":"2023-12-12T09:43:22.260117+0000","last_active":"2023-12-12T09:43:23.510712+0000","last_peered":"2023-12-12T09:43:23.510712+0000","last_clean":"2023-12-12T09:43:23.510712+0000","last_became_active":"2023-12-12T09:43:22.255443+0000","last_became_peered":"2023-12-12T09:43:22.255443+0000","last_unstale":"2023-12-12T09:43:23.510712+0000","last_undegraded":"2023-12-12T09:43:23.510712+0000","last_fullsized":"2023-12-12T09:43:23.510712+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_clean_scrub_stamp":"2023-12-12T09:43:21.241417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T20:43:18.528147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-12-12T09:43:23.228536+0000","last_change":"2023-12-12T09:43:21.281650+0000","last_active":"2023-12-12T09:43:23.228536+0000","last_peered":"2023-12-12T09:43:23.228536+0000","last_clean":"2023-12-12T09:43:23.228536+0000","last_became_active":"2023-12-12T09:43:21.281353+0000","last_became_peered":"2023-12-12T09:43:21.281353+0000","last_unstale":"2023-12-12T09:43:23.228536+0000","last_undegraded":"2023-12-12T09:43:23.228536+0000","last_fullsized":"2023-12-12T09:43:23.228536+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:43:20.054829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:43:20.054829+0000","last_clean_scrub_stamp":"2023-12-12T09:43:20.054829+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T10:41:13.505292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-12-12T09:43:23.512382+0000","last_change":"2023-12-12T09:43:22.255511+0000","last_active":"2023-12-12T09:43:23.512382+0000","last_peered":"2023-12-12T09:43:23.512382+0000","last_clean":"2023-12-12T09:43:23.512382+0000","last_became_active":"2023-12-12T09:43:22.255187+0000","last_became_peered":"2023-12-12T09:43:22.255187+0000","last_unstale":"2023-12-12T09:43:23.512382+0000","last_undegraded":"2023-12-12T09:43:23.512382+0000","last_fullsized":"2023-12-12T09:43:23.512382+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_clean_scrub_stamp":"2023-12-12T09:43:21.241417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T13:28:21.176910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-12-12T09:43:23.228903+0000","last_change":"2023-12-12T09:43:21.291624+0000","last_active":"2023-12-12T09:43:23.228903+0000","last_peered":"2023-12-12T09:43:23.228903+0000","last_clean":"2023-12-12T09:43:23.228903+0000","last_became_active":"2023-12-12T09:43:21.291410+0000","last_became_peered":"2023-12-12T09:43:21.291410+0000","last_unstale":"2023-12-12T09:43:23.228903+0000","last_undegraded":"2023-12-12T09:43:23.228903+0000","last_fullsized":"2023-12-12T09:43:23.228903+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:43:20.054829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:43:20.054829+0000","last_clean_scrub_stamp":"2023-12-12T09:43:20.054829+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T20:43:17.341558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-12-12T09:43:23.514113+0000","last_change":"2023-12-12T09:43:22.250477+0000","last_active":"2023-12-12T09:43:23.514113+0000","last_peered":"2023-12-12T09:43:23.514113+0000","last_clean":"2023-12-12T09:43:23.514113+0000","last_became_active":"2023-12-12T09:43:22.250114+0000","last_became_peered":"2023-12-12T09:43:22.250114+0000","last_unstale":"2023-12-12T09:43:23.514113+0000","last_undegraded":"2023-12-12T09:43:23.514113+0000","last_fullsized":"2023-12-12T09:43:23.514113+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_clean_scrub_stamp":"2023-12-12T09:43:21.241417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T11:24:46.660535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-12-12T09:43:23.512859+0000","last_change":"2023-12-12T09:43:21.300810+0000","last_active":"2023-12-12T09:43:23.512859+0000","last_peered":"2023-12-12T09:43:23.512859+0000","last_clean":"2023-12-12T09:43:23.512859+0000","last_became_active":"2023-12-12T09:43:21.300476+0000","last_became_peered":"2023-12-12T09:43:21.300476+0000","last_unstale":"2023-12-12T09:43:23.512859+0000","last_undegraded":"2023-12-12T09:43:23.512859+0000","last_fullsized":"2023-12-12T09:43:23.512859+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:43:20.054829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:43:20.054829+0000","last_clean_scrub_stamp":"2023-12-12T09:43:20.054829+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T20:32:59.313749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-12-12T09:43:23.235201+0000","last_change":"2023-12-12T09:43:22.254797+0000","last_active":"2023-12-12T09:43:23.235201+0000","last_peered":"2023-12-12T09:43:23.235201+0000","last_clean":"2023-12-12T09:43:23.235201+0000","last_became_active":"2023-12-12T09:43:22.254482+0000","last_became_peered":"2023-12-12T09:43:22.254482+0000","last_unstale":"2023-12-12T09:43:23.235201+0000","last_undegraded":"2023-12-12T09:43:23.235201+0000","last_fullsized":"2023-12-12T09:43:23.235201+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_clean_scrub_stamp":"2023-12-12T09:43:21.241417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T19:29:30.599215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-12-12T09:43:23.232655+0000","last_change":"2023-12-12T09:43:22.256918+0000","last_active":"2023-12-12T09:43:23.232655+0000","last_peered":"2023-12-12T09:43:23.232655+0000","last_clean":"2023-12-12T09:43:23.232655+0000","last_became_active":"2023-12-12T09:43:22.256575+0000","last_became_peered":"2023-12-12T09:43:22.256575+0000","last_unstale":"2023-12-12T09:43:23.232655+0000","last_undegraded":"2023-12-12T09:43:23.232655+0000","last_fullsized":"2023-12-12T09:43:23.232655+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_clean_scrub_stamp":"2023-12-12T09:43:21.241417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T11:24:46.660535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-12-12T09:43:23.512318+0000","last_change":"2023-12-12T09:43:21.300710+0000","last_active":"2023-12-12T09:43:23.512318+0000","last_peered":"2023-12-12T09:43:23.512318+0000","last_clean":"2023-12-12T09:43:23.512318+0000","last_became_active":"2023-12-12T09:43:21.300311+0000","last_became_peered":"2023-12-12T09:43:21.300311+0000","last_unstale":"2023-12-12T09:43:23.512318+0000","last_undegraded":"2023-12-12T09:43:23.512318+0000","last_fullsized":"2023-12-12T09:43:23.512318+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:43:20.054829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:43:20.054829+0000","last_clean_scrub_stamp":"2023-12-12T09:43:20.054829+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T14:02:28.705261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-12-12T09:43:23.232804+0000","last_change":"2023-12-12T09:43:22.257472+0000","last_active":"2023-12-12T09:43:23.232804+0000","last_peered":"2023-12-12T09:43:23.232804+0000","last_clean":"2023-12-12T09:43:23.232804+0000","last_became_active":"2023-12-12T09:43:22.250225+0000","last_became_peered":"2023-12-12T09:43:22.250225+0000","last_unstale":"2023-12-12T09:43:23.232804+0000","last_undegraded":"2023-12-12T09:43:23.232804+0000","last_fullsized":"2023-12-12T09:43:23.232804+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_clean_scrub_stamp":"2023-12-12T09:43:21.241417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T20:26:35.861125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-12-12T09:43:23.512528+0000","last_change":"2023-12-12T09:43:21.306307+0000","last_active":"2023-12-12T09:43:23.512528+0000","last_peered":"2023-12-12T09:43:23.512528+0000","last_clean":"2023-12-12T09:43:23.512528+0000","last_became_active":"2023-12-12T09:43:21.305903+0000","last_became_peered":"2023-12-12T09:43:21.305903+0000","last_unstale":"2023-12-12T09:43:23.512528+0000","last_undegraded":"2023-12-12T09:43:23.512528+0000","last_fullsized":"2023-12-12T09:43:23.512528+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:43:20.054829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:43:20.054829+0000","last_clean_scrub_stamp":"2023-12-12T09:43:20.054829+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T11:56:41.908755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-12-12T09:43:23.513534+0000","last_change":"2023-12-12T09:43:22.274288+0000","last_active":"2023-12-12T09:43:23.513534+0000","last_peered":"2023-12-12T09:43:23.513534+0000","last_clean":"2023-12-12T09:43:23.513534+0000","last_became_active":"2023-12-12T09:43:22.273968+0000","last_became_peered":"2023-12-12T09:43:22.273968+0000","last_unstale":"2023-12-12T09:43:23.513534+0000","last_undegraded":"2023-12-12T09:43:23.513534+0000","last_fullsized":"2023-12-12T09:43:23.513534+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_clean_scrub_stamp":"2023-12-12T09:43:21.241417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T10:52:36.164447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-12-12T09:43:23.513171+0000","last_change":"2023-12-12T09:43:21.295200+0000","last_active":"2023-12-12T09:43:23.513171+0000","last_peered":"2023-12-12T09:43:23.513171+0000","last_clean":"2023-12-12T09:43:23.513171+0000","last_became_active":"2023-12-12T09:43:21.294908+0000","last_became_peered":"2023-12-12T09:43:21.294908+0000","last_unstale":"2023-12-12T09:43:23.513171+0000","last_undegraded":"2023-12-12T09:43:23.513171+0000","last_fullsized":"2023-12-12T09:43:23.513171+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:43:20.054829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:43:20.054829+0000","last_clean_scrub_stamp":"2023-12-12T09:43:20.054829+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T20:32:59.313749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-12-12T09:43:23.512766+0000","last_change":"2023-12-12T09:43:22.256556+0000","last_active":"2023-12-12T09:43:23.512766+0000","last_peered":"2023-12-12T09:43:23.512766+0000","last_clean":"2023-12-12T09:43:23.512766+0000","last_became_active":"2023-12-12T09:43:22.256166+0000","last_became_peered":"2023-12-12T09:43:22.256166+0000","last_unstale":"2023-12-12T09:43:23.512766+0000","last_undegraded":"2023-12-12T09:43:23.512766+0000","last_fullsized":"2023-12-12T09:43:23.512766+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_clean_scrub_stamp":"2023-12-12T09:43:21.241417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T13:22:21.650455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"20'4","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-12-12T09:43:23.514113+0000","last_change":"2023-12-12T09:43:21.296519+0000","last_active":"2023-12-12T09:43:23.514113+0000","last_peered":"2023-12-12T09:43:23.514113+0000","last_clean":"2023-12-12T09:43:23.514113+0000","last_became_active":"2023-12-12T09:43:21.296221+0000","last_became_peered":"2023-12-12T09:43:21.296221+0000","last_unstale":"2023-12-12T09:43:23.514113+0000","last_undegraded":"2023-12-12T09:43:23.514113+0000","last_fullsized":"2023-12-12T09:43:23.514113+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:43:20.054829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:43:20.054829+0000","last_clean_scrub_stamp":"2023-12-12T09:43:20.054829+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T21:27:10.922205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":64844,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574853,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27320,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344520,"statfs":{"total":96636764160,"available":96608788480,"internally_reserved":0,"allocated":286720,"data_stored":666531,"data_compressed":32422,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76500000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.359}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6419999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0469999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.617}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.218}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4630000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574851,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":229376,"data_stored":77193,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68999999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72599999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93700000000000006}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.077}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0449999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.236}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2569999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574851,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":221184,"data_stored":75671,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92400000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.355}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1830000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4390000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.619}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.655}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.756}]}]},{"osd":4,"up_from":13,"seq":55834574853,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":229376,"data_stored":75707,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95999999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0820000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3460000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.468}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.9039999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.246}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.726}]}]},{"osd":3,"up_from":13,"seq":55834574851,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":229376,"data_stored":77193,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88600000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0029999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1100000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.21}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.444}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.8620000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5369999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574851,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":204800,"data_stored":69281,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.458}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.593}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.8879999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.5760000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.3109999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.214}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.3370000000000002}]}]},{"osd":1,"up_from":13,"seq":55834574851,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":225280,"data_stored":75741,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.099}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85499999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6890000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7230000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.9870000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.2170000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.9009999999999998}]}]},{"osd":0,"up_from":13,"seq":55834574853,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27328,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344512,"statfs":{"total":96636764160,"available":96608780288,"internally_reserved":0,"allocated":294912,"data_stored":666587,"data_compressed":32422,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0680000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2529999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93700000000000006}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.337}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1699999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.8720000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.613}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32422,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32422,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-12T09:43:27.203 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-12-12T09:43:27.203 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2023-12-12T09:43:27.203 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2023-12-12T09:43:27.203 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2023-12-12T09:43:27.204 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2023-12-12T09:43:27.447 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:27.446+0000 7f0fc4a0f640 1 Processor -- start 2023-12-12T09:43:27.447 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:27.446+0000 7f0fc4a0f640 1 -- start start 2023-12-12T09:43:27.448 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:27.447+0000 7f0fc4a0f640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f0fc00aa500 0x7f0fc0151cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:27.448 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:27.447+0000 7f0fc4a0f640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0fc01521f0 con 0x7f0fc00c37b0 2023-12-12T09:43:27.448 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:27.447+0000 7f0fc4a0f640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0fc00ab2d0 con 0x7f0fc014e700 2023-12-12T09:43:27.448 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:27.447+0000 7f0fc4a0f640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0fc006bb10 con 0x7f0fc00aa500 2023-12-12T09:43:27.448 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:27.447+0000 7f0fbe59c640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f0fc00c37b0 0x7f0fc00a9df0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:37338/0 (socket says 172.21.15.73:37338) 2023-12-12T09:43:27.448 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:27.447+0000 7f0fbe59c640 1 -- 172.21.15.73:0/3455481863 learned_addr learned my addr 172.21.15.73:0/3455481863 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-12T09:43:27.450 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:27.448+0000 7f0fbf59e640 1 --2- 172.21.15.73:0/3455481863 >> v2:172.21.15.142:3300/0 conn(0x7f0fc00aa500 0x7f0fc0151cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:27.450 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:27.448+0000 7f0fbdd9b640 1 -- 172.21.15.73:0/3455481863 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1968650220 0 0) 0x7f0fb4001110 con 0x7f0fc00c37b0 2023-12-12T09:43:27.450 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:27.448+0000 7f0fbdd9b640 1 -- 172.21.15.73:0/3455481863 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0fa8003520 con 0x7f0fc00c37b0 2023-12-12T09:43:27.450 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:27.448+0000 7f0fbdd9b640 1 -- 172.21.15.73:0/3455481863 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 356496751 0 0) 0x7f0fa8003520 con 0x7f0fc00c37b0 2023-12-12T09:43:27.451 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:27.448+0000 7f0fbdd9b640 1 -- 172.21.15.73:0/3455481863 >> v2:172.21.15.142:3300/0 conn(0x7f0fc00aa500 msgr2=0x7f0fc0151cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:43:27.451 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:27.448+0000 7f0fbdd9b640 1 --2- 172.21.15.73:0/3455481863 >> v2:172.21.15.142:3300/0 conn(0x7f0fc00aa500 0x7f0fc0151cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:27.451 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:27.448+0000 7f0fbdd9b640 1 -- 172.21.15.73:0/3455481863 >> v1:172.21.15.142:6789/0 conn(0x7f0fc014e700 legacy=0x7f0fc00c02b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:27.451 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:27.448+0000 7f0fbdd9b640 1 -- 172.21.15.73:0/3455481863 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fc00aaff0 con 0x7f0fc00c37b0 2023-12-12T09:43:27.451 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:27.448+0000 7f0fbdd9b640 1 -- 172.21.15.73:0/3455481863 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3186547832 0 0) 0x7f0fb4001800 con 0x7f0fc00c37b0 2023-12-12T09:43:27.451 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:27.448+0000 7f0fbdd9b640 1 -- 172.21.15.73:0/3455481863 >> v1:172.21.15.73:6789/0 conn(0x7f0fc00c37b0 legacy=0x7f0fc00a9df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:27.451 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:27.448+0000 7f0fbdd9b640 1 --2- 172.21.15.73:0/3455481863 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0fa80039c0 0x7f0fa8003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:27.451 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:27.448+0000 7f0fbdd9b640 1 --2- 172.21.15.73:0/3455481863 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0fa80047c0 0x7f0fa8004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:27.451 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:27.448+0000 7f0fbdd9b640 1 --2- 172.21.15.73:0/3455481863 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0fa80052a0 0x7f0fa800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:27.451 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:27.448+0000 7f0fbdd9b640 1 -- 172.21.15.73:0/3455481863 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fc006bb10 con 0x7f0fa80039c0 2023-12-12T09:43:27.451 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:27.448+0000 7f0fbdd9b640 1 -- 172.21.15.73:0/3455481863 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fa800c1a0 con 0x7f0fa80052a0 2023-12-12T09:43:27.451 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:27.448+0000 7f0fbdd9b640 1 -- 172.21.15.73:0/3455481863 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0fa800c360 con 0x7f0fa80047c0 2023-12-12T09:43:27.451 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:27.449+0000 7f0fbed9d640 1 --2- 172.21.15.73:0/3455481863 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0fa80039c0 0x7f0fa8003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:27.451 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:27.449+0000 7f0fbe59c640 1 --2- 172.21.15.73:0/3455481863 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0fa80047c0 0x7f0fa8004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:27.451 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:27.449+0000 7f0fbf59e640 1 --2- 172.21.15.73:0/3455481863 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0fa80052a0 0x7f0fa800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:27.452 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:27.449+0000 7f0fbed9d640 1 -- 172.21.15.73:0/3455481863 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0fa80047c0 msgr2=0x7f0fa8004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:43:27.452 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:27.449+0000 7f0fbed9d640 1 --2- 172.21.15.73:0/3455481863 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0fa80047c0 0x7f0fa8004c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:27.452 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:27.449+0000 7f0fbed9d640 1 -- 172.21.15.73:0/3455481863 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0fa80052a0 msgr2=0x7f0fa800b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:43:27.452 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:27.449+0000 7f0fbed9d640 1 --2- 172.21.15.73:0/3455481863 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0fa80052a0 0x7f0fa800b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:27.452 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:27.449+0000 7f0fbed9d640 1 -- 172.21.15.73:0/3455481863 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fa8003520 con 0x7f0fa80039c0 2023-12-12T09:43:27.452 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:27.449+0000 7f0fbf59e640 1 --2- 172.21.15.73:0/3455481863 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0fa80052a0 0x7f0fa800b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:43:27.452 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:27.449+0000 7f0fbf59e640 1 -- 172.21.15.73:0/3455481863 reap_dead start 2023-12-12T09:43:27.453 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:27.450+0000 7f0fbed9d640 1 --2- 172.21.15.73:0/3455481863 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0fa80039c0 0x7f0fa8003de0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f0fb0001750 tx=0x7f0fa80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5fadff4731eec9e9 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:43:27.453 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:27.450+0000 7f0fbdd9b640 1 -- 172.21.15.73:0/3455481863 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fb00052d0 con 0x7f0fa80039c0 2023-12-12T09:43:27.453 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:27.450+0000 7f0fbdd9b640 1 -- 172.21.15.73:0/3455481863 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fb002e050 con 0x7f0fa80039c0 2023-12-12T09:43:27.453 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:27.450+0000 7f0fbdd9b640 1 -- 172.21.15.73:0/3455481863 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fb0003830 con 0x7f0fa80039c0 2023-12-12T09:43:27.454 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:27.451+0000 7f0fc4a0f640 1 -- 172.21.15.73:0/3455481863 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0fa80039c0 msgr2=0x7f0fa8003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:27.454 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:27.451+0000 7f0fc4a0f640 1 --2- 172.21.15.73:0/3455481863 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0fa80039c0 0x7f0fa8003de0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f0fb0001750 tx=0x7f0fa80057f0 comp rx=0 tx=0).stop 2023-12-12T09:43:27.454 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:27.451+0000 7f0fc4a0f640 1 -- 172.21.15.73:0/3455481863 shutdown_connections 2023-12-12T09:43:27.454 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:27.451+0000 7f0fc4a0f640 1 --2- 172.21.15.73:0/3455481863 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0fa80039c0 0x7f0fa8003de0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:27.454 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:27.451+0000 7f0fc4a0f640 1 -- 172.21.15.73:0/3455481863 >> 172.21.15.73:0/3455481863 conn(0x7f0fc00c23b0 msgr2=0x7f0fc00c2790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:43:27.454 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:27.451+0000 7f0fc4a0f640 1 -- 172.21.15.73:0/3455481863 shutdown_connections 2023-12-12T09:43:27.454 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:27.451+0000 7f0fc4a0f640 1 -- 172.21.15.73:0/3455481863 wait complete. 2023-12-12T09:43:27.454 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:27.453+0000 7f0fc4a0f640 1 Processor -- start 2023-12-12T09:43:27.454 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:27.453+0000 7f0fc4a0f640 1 -- start start 2023-12-12T09:43:27.456 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:27.453+0000 7f0fc4a0f640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0fa80039c0 0x7f0fc01e90b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:27.456 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:27.453+0000 7f0fc4a0f640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0fc0071b80 0x7f0fc014a280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:27.456 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:27.454+0000 7f0fc4a0f640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0fc0072000 0x7f0fc014a7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:27.456 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:27.454+0000 7f0fc4a0f640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fc01e9bd0 con 0x7f0fc0072000 2023-12-12T09:43:27.457 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:27.454+0000 7f0fc4a0f640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fc014ad00 con 0x7f0fc0071b80 2023-12-12T09:43:27.457 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:27.454+0000 7f0fc4a0f640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0fc0155270 con 0x7f0fa80039c0 2023-12-12T09:43:27.457 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:27.454+0000 7f0fbf59e640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0fc0072000 0x7f0fc014a7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:27.457 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:27.454+0000 7f0fbf59e640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0fc0072000 0x7f0fc014a7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:41310/0 (socket says 172.21.15.73:41310) 2023-12-12T09:43:27.457 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:27.454+0000 7f0fbf59e640 1 -- 172.21.15.73:0/1879382010 learned_addr learned my addr 172.21.15.73:0/1879382010 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:43:27.457 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:27.454+0000 7f0fbed9d640 1 --2- 172.21.15.73:0/1879382010 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0fa80039c0 0x7f0fc01e90b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:27.457 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:27.454+0000 7f0fbe59c640 1 --2- 172.21.15.73:0/1879382010 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0fc0071b80 0x7f0fc014a280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:27.457 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:27.454+0000 7f0fbf59e640 1 -- 172.21.15.73:0/1879382010 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0fa80039c0 msgr2=0x7f0fc01e90b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:27.457 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:27.454+0000 7f0fbf59e640 1 --2- 172.21.15.73:0/1879382010 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0fa80039c0 0x7f0fc01e90b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:27.457 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:27.454+0000 7f0fbf59e640 1 -- 172.21.15.73:0/1879382010 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0fc0071b80 msgr2=0x7f0fc014a280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:27.457 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:27.454+0000 7f0fbf59e640 1 --2- 172.21.15.73:0/1879382010 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0fc0071b80 0x7f0fc014a280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:27.457 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:27.454+0000 7f0fbf59e640 1 -- 172.21.15.73:0/1879382010 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fc0072930 con 0x7f0fc0072000 2023-12-12T09:43:27.457 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:27.454+0000 7f0fbe59c640 1 --2- 172.21.15.73:0/1879382010 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0fc0071b80 0x7f0fc014a280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:43:27.457 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:27.455+0000 7f0fbf59e640 1 --2- 172.21.15.73:0/1879382010 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0fc0072000 0x7f0fc014a7c0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f0fc00c68c0 tx=0x7f0fb800f520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:43:27.458 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:27.455+0000 7f0fa77fe640 1 -- 172.21.15.73:0/1879382010 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fb8016620 con 0x7f0fc0072000 2023-12-12T09:43:27.458 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:27.455+0000 7f0fa77fe640 1 -- 172.21.15.73:0/1879382010 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fb8016780 con 0x7f0fc0072000 2023-12-12T09:43:27.458 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:27.455+0000 7f0fa77fe640 1 -- 172.21.15.73:0/1879382010 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fb8016af0 con 0x7f0fc0072000 2023-12-12T09:43:27.458 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:27.455+0000 7f0fc4a0f640 1 -- 172.21.15.73:0/1879382010 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0fc00a6770 con 0x7f0fc0072000 2023-12-12T09:43:27.458 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:27.455+0000 7f0fc4a0f640 1 -- 172.21.15.73:0/1879382010 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0fc0154f00 con 0x7f0fc0072000 2023-12-12T09:43:27.459 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:27.456+0000 7f0fc4a0f640 1 -- 172.21.15.73:0/1879382010 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0fc0154d60 con 0x7f0fc0072000 2023-12-12T09:43:27.459 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:27.457+0000 7f0fa77fe640 1 -- 172.21.15.73:0/1879382010 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f0fb8016c50 con 0x7f0fc0072000 2023-12-12T09:43:27.459 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:27.458+0000 7f0fa77fe640 1 --2- 172.21.15.73:0/1879382010 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f0fac06ae30 0x7f0fac06d2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:27.459 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:27.458+0000 7f0fa77fe640 1 -- 172.21.15.73:0/1879382010 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0fb808a430 con 0x7f0fc0072000 2023-12-12T09:43:27.459 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:27.458+0000 7f0fbed9d640 1 --2- 172.21.15.73:0/1879382010 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f0fac06ae30 0x7f0fac06d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:27.460 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:27.459+0000 7f0fbed9d640 1 --2- 172.21.15.73:0/1879382010 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f0fac06ae30 0x7f0fac06d2f0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f0fb0033000 tx=0x7f0fb0009030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:43:27.463 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:27.463+0000 7f0fa77fe640 1 -- 172.21.15.73:0/1879382010 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f0fc0154d60 con 0x7f0fc0072000 2023-12-12T09:43:27.697 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:27.695+0000 7f0fc4a0f640 1 -- 172.21.15.73:0/1879382010 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f0fc0154d60 con 0x7f0fc0072000 2023-12-12T09:43:27.705 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:27.704+0000 7f0fa77fe640 1 -- 172.21.15.73:0/1879382010 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) v1 ==== 74+0+171027 (secure 0 0 0) 0x7f0fc0154d60 con 0x7f0fc0072000 2023-12-12T09:43:27.708 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-12T09:43:27.709 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:27.708+0000 7f0fc4a0f640 1 -- 172.21.15.73:0/1879382010 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f0fac06ae30 msgr2=0x7f0fac06d2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:27.709 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:27.708+0000 7f0fc4a0f640 1 --2- 172.21.15.73:0/1879382010 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f0fac06ae30 0x7f0fac06d2f0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f0fb0033000 tx=0x7f0fb0009030 comp rx=0 tx=0).stop 2023-12-12T09:43:27.709 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:27.708+0000 7f0fc4a0f640 1 -- 172.21.15.73:0/1879382010 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0fc0072000 msgr2=0x7f0fc014a7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:27.709 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:27.708+0000 7f0fc4a0f640 1 --2- 172.21.15.73:0/1879382010 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0fc0072000 0x7f0fc014a7c0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f0fc00c68c0 tx=0x7f0fb800f520 comp rx=0 tx=0).stop 2023-12-12T09:43:27.709 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:27.708+0000 7f0fc4a0f640 1 -- 172.21.15.73:0/1879382010 shutdown_connections 2023-12-12T09:43:27.710 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:27.708+0000 7f0fc4a0f640 1 --2- 172.21.15.73:0/1879382010 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f0fac06ae30 0x7f0fac06d2f0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:27.710 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:27.708+0000 7f0fc4a0f640 1 --2- 172.21.15.73:0/1879382010 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0fc0072000 0x7f0fc014a7c0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:27.710 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:27.708+0000 7f0fc4a0f640 1 --2- 172.21.15.73:0/1879382010 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0fc0071b80 0x7f0fc014a280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:27.710 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:27.708+0000 7f0fc4a0f640 1 --2- 172.21.15.73:0/1879382010 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0fa80039c0 0x7f0fc01e90b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:27.710 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:27.708+0000 7f0fc4a0f640 1 -- 172.21.15.73:0/1879382010 >> 172.21.15.73:0/1879382010 conn(0x7f0fc00c23b0 msgr2=0x7f0fc00c1560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:43:27.710 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:27.708+0000 7f0fc4a0f640 1 -- 172.21.15.73:0/1879382010 shutdown_connections 2023-12-12T09:43:27.710 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:27.708+0000 7f0fc4a0f640 1 -- 172.21.15.73:0/1879382010 wait complete. 2023-12-12T09:43:27.726 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":5,"active_gid":4110,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6832","nonce":779985841},{"type":"v1","addr":"172.21.15.73:6833","nonce":779985841}]},"active_addr":"172.21.15.73:6833/779985841","active_change":"2023-12-12T09:43:07.430175+0000","active_mgr_features":4540138322906710015,"available":true,"standbys":[{"gid":4103,"name":"x","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:latest","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:latest","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.73:0","nonce":2862953518}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.73:0","nonce":3883516864}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.73:0","nonce":11482316}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.73:0","nonce":1779660553}]}]} 2023-12-12T09:43:27.730 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2023-12-12T09:43:27.730 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2023-12-12T09:43:27.730 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-12T09:43:27.934 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:27.934+0000 7f02945ea640 1 Processor -- start 2023-12-12T09:43:27.934 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:27.934+0000 7f02945ea640 1 -- start start 2023-12-12T09:43:27.936 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:27.934+0000 7f02945ea640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f028c0a5040 0x7f028c06bf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:27.936 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:27.934+0000 7f02945ea640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f028c158c00 con 0x7f028c0c3ad0 2023-12-12T09:43:27.936 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:27.934+0000 7f02945ea640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f028c0c4d00 con 0x7f028c06a4e0 2023-12-12T09:43:27.936 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:27.934+0000 7f02945ea640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f028c06c4d0 con 0x7f028c0a5040 2023-12-12T09:43:27.936 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:27.934+0000 7f0292386640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f028c0a5040 0x7f028c06bf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:27.936 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:27.935+0000 7f0292386640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f028c0a5040 0x7f028c06bf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:41314/0 (socket says 172.21.15.73:41314) 2023-12-12T09:43:27.936 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:27.935+0000 7f0292386640 1 -- 172.21.15.73:0/4202555128 learned_addr learned my addr 172.21.15.73:0/4202555128 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:43:27.936 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:27.935+0000 7f0291b85640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f028c0c3ad0 0x7f028c1584f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:37342/0 (socket says 172.21.15.73:37342) 2023-12-12T09:43:27.936 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:27.935+0000 7f0292386640 1 -- 172.21.15.73:0/4202555128 >> v1:172.21.15.142:6789/0 conn(0x7f028c06a4e0 legacy=0x7f028c15f020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:43:27.936 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:27.935+0000 7f0292386640 1 -- 172.21.15.73:0/4202555128 >> v1:172.21.15.73:6789/0 conn(0x7f028c0c3ad0 legacy=0x7f028c1584f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:27.936 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:27.935+0000 7f0292386640 1 -- 172.21.15.73:0/4202555128 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f028c0c5100 con 0x7f028c0a5040 2023-12-12T09:43:27.937 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:27.935+0000 7f0291384640 1 -- 172.21.15.73:0/4202555128 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1522758160 0 0) 0x7f028c158c00 con 0x7f028c0c3ad0 2023-12-12T09:43:27.938 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:27.936+0000 7f0292386640 1 --2- 172.21.15.73:0/4202555128 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f028c0a5040 0x7f028c06bf90 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f027c009870 tx=0x7f027c02ba20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8142d727116d7668 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:43:27.938 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:27.936+0000 7f0291384640 1 -- 172.21.15.73:0/4202555128 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f027c02f840 con 0x7f028c0a5040 2023-12-12T09:43:27.938 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:27.936+0000 7f0291384640 1 -- 172.21.15.73:0/4202555128 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f027c02f9a0 con 0x7f028c0a5040 2023-12-12T09:43:27.938 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:27.936+0000 7f0291384640 1 -- 172.21.15.73:0/4202555128 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f027c02fd30 con 0x7f028c0a5040 2023-12-12T09:43:27.938 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:27.937+0000 7f02945ea640 1 -- 172.21.15.73:0/4202555128 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f028c0a5040 msgr2=0x7f028c06bf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:27.938 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:27.937+0000 7f02945ea640 1 --2- 172.21.15.73:0/4202555128 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f028c0a5040 0x7f028c06bf90 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f027c009870 tx=0x7f027c02ba20 comp rx=0 tx=0).stop 2023-12-12T09:43:27.938 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:27.937+0000 7f02945ea640 1 -- 172.21.15.73:0/4202555128 shutdown_connections 2023-12-12T09:43:27.938 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:27.937+0000 7f02945ea640 1 --2- 172.21.15.73:0/4202555128 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f028c0a5040 0x7f028c06bf90 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:27.938 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:27.937+0000 7f02945ea640 1 -- 172.21.15.73:0/4202555128 >> 172.21.15.73:0/4202555128 conn(0x7f028c0a8130 msgr2=0x7f028c0c24b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:43:27.938 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:27.937+0000 7f02945ea640 1 -- 172.21.15.73:0/4202555128 shutdown_connections 2023-12-12T09:43:27.938 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:27.937+0000 7f02945ea640 1 -- 172.21.15.73:0/4202555128 wait complete. 2023-12-12T09:43:27.939 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:27.938+0000 7f02945ea640 1 Processor -- start 2023-12-12T09:43:27.939 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:27.939+0000 7f02945ea640 1 -- start start 2023-12-12T09:43:27.941 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:27.939+0000 7f02945ea640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f028c06a4e0 0x7f028c0a9bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:27.942 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:27.939+0000 7f02945ea640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f028c0a5040 0x7f028c1de280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:27.942 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:27.939+0000 7f02945ea640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f028c0c3ad0 0x7f028c1de7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:27.942 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:27.939+0000 7f02945ea640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f028c1ded00 con 0x7f028c06a4e0 2023-12-12T09:43:27.942 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:27.939+0000 7f02945ea640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f028c1e05c0 con 0x7f028c0c3ad0 2023-12-12T09:43:27.942 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:27.939+0000 7f02945ea640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f028c1ddda0 con 0x7f028c0a5040 2023-12-12T09:43:27.942 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:27.940+0000 7f0292386640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f028c06a4e0 0x7f028c0a9bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:27.942 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:27.940+0000 7f0292386640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f028c06a4e0 0x7f028c0a9bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:41322/0 (socket says 172.21.15.73:41322) 2023-12-12T09:43:27.942 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:27.940+0000 7f0292386640 1 -- 172.21.15.73:0/2578589433 learned_addr learned my addr 172.21.15.73:0/2578589433 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:43:27.942 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:27.940+0000 7f0292386640 1 -- 172.21.15.73:0/2578589433 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f028c0a5040 msgr2=0x7f028c1de280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:27.942 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:27.940+0000 7f0292386640 1 --2- 172.21.15.73:0/2578589433 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f028c0a5040 0x7f028c1de280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:27.942 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:27.940+0000 7f0292386640 1 -- 172.21.15.73:0/2578589433 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f028c0c3ad0 msgr2=0x7f028c1de7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:27.943 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:27.940+0000 7f0292386640 1 --2- 172.21.15.73:0/2578589433 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f028c0c3ad0 0x7f028c1de7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:27.943 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:27.940+0000 7f0292386640 1 -- 172.21.15.73:0/2578589433 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f027c0094d0 con 0x7f028c06a4e0 2023-12-12T09:43:27.943 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:27.940+0000 7f0292386640 1 --2- 172.21.15.73:0/2578589433 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f028c06a4e0 0x7f028c0a9bb0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f027c009870 tx=0x7f027c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:43:27.943 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:27.940+0000 7f028affd640 1 -- 172.21.15.73:0/2578589433 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f027c037d10 con 0x7f028c06a4e0 2023-12-12T09:43:27.943 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:27.940+0000 7f028affd640 1 -- 172.21.15.73:0/2578589433 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f027c037e70 con 0x7f028c06a4e0 2023-12-12T09:43:27.943 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:27.940+0000 7f028affd640 1 -- 172.21.15.73:0/2578589433 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f027c041620 con 0x7f028c06a4e0 2023-12-12T09:43:27.943 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:27.941+0000 7f02945ea640 1 -- 172.21.15.73:0/2578589433 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f028c1eb760 con 0x7f028c06a4e0 2023-12-12T09:43:27.943 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:27.941+0000 7f02945ea640 1 -- 172.21.15.73:0/2578589433 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f028c0aa0f0 con 0x7f028c06a4e0 2023-12-12T09:43:27.943 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:27.942+0000 7f02945ea640 1 -- 172.21.15.73:0/2578589433 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f028c0a5770 con 0x7f028c06a4e0 2023-12-12T09:43:27.944 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:27.942+0000 7f028affd640 1 -- 172.21.15.73:0/2578589433 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f027c041780 con 0x7f028c06a4e0 2023-12-12T09:43:27.944 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:27.943+0000 7f028affd640 1 --2- 172.21.15.73:0/2578589433 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f027806ae70 0x7f027806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:27.944 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:27.943+0000 7f028affd640 1 -- 172.21.15.73:0/2578589433 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f027c03c070 con 0x7f028c06a4e0 2023-12-12T09:43:27.944 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:27.943+0000 7f0291b85640 1 --2- 172.21.15.73:0/2578589433 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f027806ae70 0x7f027806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:27.945 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:27.944+0000 7f0291b85640 1 --2- 172.21.15.73:0/2578589433 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f027806ae70 0x7f027806d330 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f0280007fd0 tx=0x7f0280007ce0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:43:27.949 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:27.948+0000 7f028affd640 1 -- 172.21.15.73:0/2578589433 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f027c0775a0 con 0x7f028c06a4e0 2023-12-12T09:43:28.128 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.126+0000 7f02945ea640 1 -- 172.21.15.73:0/2578589433 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f028c067580 con 0x7f028c06a4e0 2023-12-12T09:43:28.129 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.128+0000 7f028affd640 1 -- 172.21.15.73:0/2578589433 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16517 (secure 0 0 0) 0x7f027c07abc0 con 0x7f028c06a4e0 2023-12-12T09:43:28.130 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-12T09:43:28.130 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":21,"fsid":"ba240992-02b8-4c7e-92f2-27eb29ac433b","created":"2023-12-12T09:43:02.454719+0000","modified":"2023-12-12T09:43:23.219345+0000","last_up_change":"2023-12-12T09:43:13.913440+0000","last_in_change":"2023-12-12T09:43:05.925348+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-12T09:43:15.525508+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-12T09:43:20.004546+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-12T09:43:20.736500+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"dd9074be-dbe2-4c34-9896-a4223d8d3940","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":4047810203},{"type":"v1","addr":"172.21.15.73:6801","nonce":4047810203}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":4047810203},{"type":"v1","addr":"172.21.15.73:6803","nonce":4047810203}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":4047810203},{"type":"v1","addr":"172.21.15.73:6807","nonce":4047810203}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":4047810203},{"type":"v1","addr":"172.21.15.73:6805","nonce":4047810203}]},"public_addr":"172.21.15.73:6801/4047810203","cluster_addr":"172.21.15.73:6803/4047810203","heartbeat_back_addr":"172.21.15.73:6807/4047810203","heartbeat_front_addr":"172.21.15.73:6805/4047810203","state":["exists","up"]},{"osd":1,"uuid":"c4a05052-96d4-4758-a4e1-1a37f1e07fed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":1356058331},{"type":"v1","addr":"172.21.15.73:6824","nonce":1356058331}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":1356058331},{"type":"v1","addr":"172.21.15.73:6827","nonce":1356058331}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":1356058331},{"type":"v1","addr":"172.21.15.73:6831","nonce":1356058331}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":1356058331},{"type":"v1","addr":"172.21.15.73:6829","nonce":1356058331}]},"public_addr":"172.21.15.73:6824/1356058331","cluster_addr":"172.21.15.73:6827/1356058331","heartbeat_back_addr":"172.21.15.73:6831/1356058331","heartbeat_front_addr":"172.21.15.73:6829/1356058331","state":["exists","up"]},{"osd":2,"uuid":"512bc8ac-72c2-40d4-b3d2-d867a92c5213","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":1228903316},{"type":"v1","addr":"172.21.15.73:6817","nonce":1228903316}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":1228903316},{"type":"v1","addr":"172.21.15.73:6819","nonce":1228903316}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6823","nonce":1228903316},{"type":"v1","addr":"172.21.15.73:6825","nonce":1228903316}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":1228903316},{"type":"v1","addr":"172.21.15.73:6821","nonce":1228903316}]},"public_addr":"172.21.15.73:6817/1228903316","cluster_addr":"172.21.15.73:6819/1228903316","heartbeat_back_addr":"172.21.15.73:6825/1228903316","heartbeat_front_addr":"172.21.15.73:6821/1228903316","state":["exists","up"]},{"osd":3,"uuid":"3d1a91e0-42bf-437a-8eae-8d357c8f63a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":1293329670},{"type":"v1","addr":"172.21.15.73:6809","nonce":1293329670}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6810","nonce":1293329670},{"type":"v1","addr":"172.21.15.73:6811","nonce":1293329670}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":1293329670},{"type":"v1","addr":"172.21.15.73:6815","nonce":1293329670}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":1293329670},{"type":"v1","addr":"172.21.15.73:6813","nonce":1293329670}]},"public_addr":"172.21.15.73:6809/1293329670","cluster_addr":"172.21.15.73:6811/1293329670","heartbeat_back_addr":"172.21.15.73:6815/1293329670","heartbeat_front_addr":"172.21.15.73:6813/1293329670","state":["exists","up"]},{"osd":4,"uuid":"4b302fff-834c-4069-ac19-00e46f6c87b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":3727975702},{"type":"v1","addr":"172.21.15.142:6801","nonce":3727975702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":3727975702},{"type":"v1","addr":"172.21.15.142:6803","nonce":3727975702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6809","nonce":3727975702},{"type":"v1","addr":"172.21.15.142:6811","nonce":3727975702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6805","nonce":3727975702},{"type":"v1","addr":"172.21.15.142:6807","nonce":3727975702}]},"public_addr":"172.21.15.142:6801/3727975702","cluster_addr":"172.21.15.142:6803/3727975702","heartbeat_back_addr":"172.21.15.142:6811/3727975702","heartbeat_front_addr":"172.21.15.142:6807/3727975702","state":["exists","up"]},{"osd":5,"uuid":"d7cdace2-67d0-45cc-95f2-515cf6ef1b82","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6817","nonce":2353193632},{"type":"v1","addr":"172.21.15.142:6819","nonce":2353193632}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6821","nonce":2353193632},{"type":"v1","addr":"172.21.15.142:6823","nonce":2353193632}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6829","nonce":2353193632},{"type":"v1","addr":"172.21.15.142:6831","nonce":2353193632}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6825","nonce":2353193632},{"type":"v1","addr":"172.21.15.142:6827","nonce":2353193632}]},"public_addr":"172.21.15.142:6819/2353193632","cluster_addr":"172.21.15.142:6823/2353193632","heartbeat_back_addr":"172.21.15.142:6831/2353193632","heartbeat_front_addr":"172.21.15.142:6827/2353193632","state":["exists","up"]},{"osd":6,"uuid":"649ce78a-5626-445c-aedc-a651ed05a6f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":2006111986},{"type":"v1","addr":"172.21.15.142:6806","nonce":2006111986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":2006111986},{"type":"v1","addr":"172.21.15.142:6810","nonce":2006111986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":2006111986},{"type":"v1","addr":"172.21.15.142:6815","nonce":2006111986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":2006111986},{"type":"v1","addr":"172.21.15.142:6813","nonce":2006111986}]},"public_addr":"172.21.15.142:6806/2006111986","cluster_addr":"172.21.15.142:6810/2006111986","heartbeat_back_addr":"172.21.15.142:6815/2006111986","heartbeat_front_addr":"172.21.15.142:6813/2006111986","state":["exists","up"]},{"osd":7,"uuid":"af15ae3b-c1d0-4acf-92db-8a1805494d13","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":2573794341},{"type":"v1","addr":"172.21.15.142:6818","nonce":2573794341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":2573794341},{"type":"v1","addr":"172.21.15.142:6822","nonce":2573794341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":2573794341},{"type":"v1","addr":"172.21.15.142:6830","nonce":2573794341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":2573794341},{"type":"v1","addr":"172.21.15.142:6826","nonce":2573794341}]},"public_addr":"172.21.15.142:6818/2573794341","cluster_addr":"172.21.15.142:6822/2573794341","heartbeat_back_addr":"172.21.15.142:6830/2573794341","heartbeat_front_addr":"172.21.15.142:6826/2573794341","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.185824+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.262103+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.225556+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:10.523459+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:10.706035+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.257339+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.301776+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.051960+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-12T09:43:28.132 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.131+0000 7f02945ea640 1 -- 172.21.15.73:0/2578589433 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f027806ae70 msgr2=0x7f027806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:28.132 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.131+0000 7f02945ea640 1 --2- 172.21.15.73:0/2578589433 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f027806ae70 0x7f027806d330 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f0280007fd0 tx=0x7f0280007ce0 comp rx=0 tx=0).stop 2023-12-12T09:43:28.132 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.131+0000 7f02945ea640 1 -- 172.21.15.73:0/2578589433 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f028c06a4e0 msgr2=0x7f028c0a9bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:28.132 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.131+0000 7f02945ea640 1 --2- 172.21.15.73:0/2578589433 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f028c06a4e0 0x7f028c0a9bb0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f027c009870 tx=0x7f027c004730 comp rx=0 tx=0).stop 2023-12-12T09:43:28.133 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.131+0000 7f02945ea640 1 -- 172.21.15.73:0/2578589433 shutdown_connections 2023-12-12T09:43:28.133 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.131+0000 7f02945ea640 1 --2- 172.21.15.73:0/2578589433 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f027806ae70 0x7f027806d330 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:28.133 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.131+0000 7f02945ea640 1 --2- 172.21.15.73:0/2578589433 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f028c0c3ad0 0x7f028c1de7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:28.133 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.131+0000 7f02945ea640 1 --2- 172.21.15.73:0/2578589433 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f028c0a5040 0x7f028c1de280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:28.133 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.131+0000 7f02945ea640 1 --2- 172.21.15.73:0/2578589433 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f028c06a4e0 0x7f028c0a9bb0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:28.133 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.131+0000 7f02945ea640 1 -- 172.21.15.73:0/2578589433 >> 172.21.15.73:0/2578589433 conn(0x7f028c0a8130 msgr2=0x7f028c073310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:43:28.133 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.131+0000 7f02945ea640 1 -- 172.21.15.73:0/2578589433 shutdown_connections 2023-12-12T09:43:28.133 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.131+0000 7f02945ea640 1 -- 172.21.15.73:0/2578589433 wait complete. 2023-12-12T09:43:28.150 INFO:tasks.ceph.ceph_manager.ceph:all up! 2023-12-12T09:43:28.150 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-12T09:43:28.359 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.358+0000 7f2c4010f640 1 Processor -- start 2023-12-12T09:43:28.360 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.359+0000 7f2c4010f640 1 -- start start 2023-12-12T09:43:28.361 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.360+0000 7f2c4010f640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f2c38151e40 0x7f2c380c6200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:28.361 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.360+0000 7f2c4010f640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c380c49c0 con 0x7f2c380c7cb0 2023-12-12T09:43:28.361 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.360+0000 7f2c4010f640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c380c5d70 con 0x7f2c380c80f0 2023-12-12T09:43:28.361 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.360+0000 7f2c4010f640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c3806bad0 con 0x7f2c38151e40 2023-12-12T09:43:28.361 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.360+0000 7f2c3d6aa640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f2c380c7cb0 0x7f2c3806ab50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:37354/0 (socket says 172.21.15.73:37354) 2023-12-12T09:43:28.361 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.360+0000 7f2c3d6aa640 1 -- 172.21.15.73:0/3038179501 learned_addr learned my addr 172.21.15.73:0/3038179501 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-12T09:43:28.363 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.360+0000 7f2c3deab640 1 --2- 172.21.15.73:0/3038179501 >> v2:172.21.15.142:3300/0 conn(0x7f2c38151e40 0x7f2c380c6200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:28.363 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.361+0000 7f2c3cea9640 1 -- 172.21.15.73:0/3038179501 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1913982627 0 0) 0x7f2c380c49c0 con 0x7f2c380c7cb0 2023-12-12T09:43:28.363 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.361+0000 7f2c3cea9640 1 -- 172.21.15.73:0/3038179501 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2c20003520 con 0x7f2c380c7cb0 2023-12-12T09:43:28.364 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.361+0000 7f2c3cea9640 1 -- 172.21.15.73:0/3038179501 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1558265668 0 0) 0x7f2c20003520 con 0x7f2c380c7cb0 2023-12-12T09:43:28.364 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.361+0000 7f2c3cea9640 1 -- 172.21.15.73:0/3038179501 >> v2:172.21.15.142:3300/0 conn(0x7f2c38151e40 msgr2=0x7f2c380c6200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:43:28.364 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.361+0000 7f2c3cea9640 1 --2- 172.21.15.73:0/3038179501 >> v2:172.21.15.142:3300/0 conn(0x7f2c38151e40 0x7f2c380c6200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:28.364 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.361+0000 7f2c3cea9640 1 -- 172.21.15.73:0/3038179501 >> v1:172.21.15.142:6789/0 conn(0x7f2c380c80f0 legacy=0x7f2c3815ef80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:28.364 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.361+0000 7f2c3cea9640 1 -- 172.21.15.73:0/3038179501 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c38154640 con 0x7f2c380c7cb0 2023-12-12T09:43:28.364 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.361+0000 7f2c3cea9640 1 -- 172.21.15.73:0/3038179501 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3186547832 0 0) 0x7f2c2c001670 con 0x7f2c380c7cb0 2023-12-12T09:43:28.364 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.361+0000 7f2c3cea9640 1 -- 172.21.15.73:0/3038179501 >> v1:172.21.15.73:6789/0 conn(0x7f2c380c7cb0 legacy=0x7f2c3806ab50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:28.364 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.361+0000 7f2c3cea9640 1 --2- 172.21.15.73:0/3038179501 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2c200039c0 0x7f2c20003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:28.364 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.361+0000 7f2c3cea9640 1 --2- 172.21.15.73:0/3038179501 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2c200047c0 0x7f2c20004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:28.364 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.361+0000 7f2c3cea9640 1 --2- 172.21.15.73:0/3038179501 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2c20005180 0x7f2c2000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:28.364 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.361+0000 7f2c3cea9640 1 -- 172.21.15.73:0/3038179501 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c3806bad0 con 0x7f2c20005180 2023-12-12T09:43:28.364 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.361+0000 7f2c3cea9640 1 -- 172.21.15.73:0/3038179501 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c2000c080 con 0x7f2c200039c0 2023-12-12T09:43:28.364 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.361+0000 7f2c3cea9640 1 -- 172.21.15.73:0/3038179501 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c2000c240 con 0x7f2c200047c0 2023-12-12T09:43:28.364 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.361+0000 7f2c3e6ac640 1 --2- 172.21.15.73:0/3038179501 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2c20005180 0x7f2c2000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:28.365 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.362+0000 7f2c3d6aa640 1 --2- 172.21.15.73:0/3038179501 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2c200047c0 0x7f2c20004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:28.365 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.362+0000 7f2c3deab640 1 --2- 172.21.15.73:0/3038179501 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2c200039c0 0x7f2c20003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:28.365 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.362+0000 7f2c3e6ac640 1 -- 172.21.15.73:0/3038179501 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2c200047c0 msgr2=0x7f2c20004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:43:28.365 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.362+0000 7f2c3e6ac640 1 --2- 172.21.15.73:0/3038179501 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2c200047c0 0x7f2c20004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:28.365 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.362+0000 7f2c3e6ac640 1 -- 172.21.15.73:0/3038179501 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2c200039c0 msgr2=0x7f2c20003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:43:28.365 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.362+0000 7f2c3e6ac640 1 --2- 172.21.15.73:0/3038179501 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2c200039c0 0x7f2c20003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:28.365 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.362+0000 7f2c3e6ac640 1 -- 172.21.15.73:0/3038179501 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c20003520 con 0x7f2c20005180 2023-12-12T09:43:28.365 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.362+0000 7f2c3deab640 1 --2- 172.21.15.73:0/3038179501 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2c200039c0 0x7f2c20003de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:43:28.365 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.363+0000 7f2c3e6ac640 1 -- 172.21.15.73:0/3038179501 reap_dead start 2023-12-12T09:43:28.366 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.363+0000 7f2c3e6ac640 1 --2- 172.21.15.73:0/3038179501 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2c20005180 0x7f2c2000b980 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f2c30001720 tx=0x7f2c200057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c5a94adac457a0a server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:43:28.366 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.363+0000 7f2c3cea9640 1 -- 172.21.15.73:0/3038179501 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c300052d0 con 0x7f2c20005180 2023-12-12T09:43:28.367 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.363+0000 7f2c3cea9640 1 -- 172.21.15.73:0/3038179501 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c3002e050 con 0x7f2c20005180 2023-12-12T09:43:28.367 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.363+0000 7f2c3cea9640 1 -- 172.21.15.73:0/3038179501 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c300035f0 con 0x7f2c20005180 2023-12-12T09:43:28.367 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.364+0000 7f2c4010f640 1 -- 172.21.15.73:0/3038179501 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2c20005180 msgr2=0x7f2c2000b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:28.367 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.364+0000 7f2c4010f640 1 --2- 172.21.15.73:0/3038179501 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2c20005180 0x7f2c2000b980 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f2c30001720 tx=0x7f2c200057f0 comp rx=0 tx=0).stop 2023-12-12T09:43:28.367 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.364+0000 7f2c4010f640 1 -- 172.21.15.73:0/3038179501 shutdown_connections 2023-12-12T09:43:28.367 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.364+0000 7f2c4010f640 1 --2- 172.21.15.73:0/3038179501 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2c20005180 0x7f2c2000b980 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:28.367 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.364+0000 7f2c4010f640 1 -- 172.21.15.73:0/3038179501 >> 172.21.15.73:0/3038179501 conn(0x7f2c380ab8a0 msgr2=0x7f2c380abcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:43:28.367 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.364+0000 7f2c4010f640 1 -- 172.21.15.73:0/3038179501 shutdown_connections 2023-12-12T09:43:28.367 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.364+0000 7f2c4010f640 1 -- 172.21.15.73:0/3038179501 wait complete. 2023-12-12T09:43:28.367 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.366+0000 7f2c4010f640 1 Processor -- start 2023-12-12T09:43:28.367 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.366+0000 7f2c4010f640 1 -- start start 2023-12-12T09:43:28.369 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.367+0000 7f2c4010f640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2c20005180 0x7f2c38158260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:28.369 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.367+0000 7f2c4010f640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2c3814f3d0 0x7f2c3814d0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:28.369 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.367+0000 7f2c4010f640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2c380c3c70 0x7f2c3814d620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:28.369 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.367+0000 7f2c4010f640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c381567a0 con 0x7f2c380c3c70 2023-12-12T09:43:28.369 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.367+0000 7f2c4010f640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c3814c270 con 0x7f2c3814f3d0 2023-12-12T09:43:28.369 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.367+0000 7f2c4010f640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c3814e170 con 0x7f2c20005180 2023-12-12T09:43:28.369 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.367+0000 7f2c3e6ac640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2c380c3c70 0x7f2c3814d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:28.370 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.367+0000 7f2c3e6ac640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2c380c3c70 0x7f2c3814d620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:41340/0 (socket says 172.21.15.73:41340) 2023-12-12T09:43:28.370 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.367+0000 7f2c3e6ac640 1 -- 172.21.15.73:0/345692826 learned_addr learned my addr 172.21.15.73:0/345692826 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:43:28.370 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.367+0000 7f2c3e6ac640 1 -- 172.21.15.73:0/345692826 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2c20005180 msgr2=0x7f2c38158260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:28.370 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.367+0000 7f2c3deab640 1 --2- 172.21.15.73:0/345692826 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2c20005180 0x7f2c38158260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:28.370 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.367+0000 7f2c3e6ac640 1 --2- 172.21.15.73:0/345692826 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2c20005180 0x7f2c38158260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:28.370 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.367+0000 7f2c3d6aa640 1 --2- 172.21.15.73:0/345692826 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2c3814f3d0 0x7f2c3814d0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:28.370 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.367+0000 7f2c3e6ac640 1 -- 172.21.15.73:0/345692826 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2c3814f3d0 msgr2=0x7f2c3814d0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:28.370 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.367+0000 7f2c3e6ac640 1 --2- 172.21.15.73:0/345692826 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2c3814f3d0 0x7f2c3814d0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:28.370 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.367+0000 7f2c3e6ac640 1 -- 172.21.15.73:0/345692826 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c3814e450 con 0x7f2c380c3c70 2023-12-12T09:43:28.370 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.368+0000 7f2c3e6ac640 1 --2- 172.21.15.73:0/345692826 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2c380c3c70 0x7f2c3814d620 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f2c3002bcb0 tx=0x7f2c30001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:43:28.370 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.368+0000 7f2c367fc640 1 -- 172.21.15.73:0/345692826 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c30007a30 con 0x7f2c380c3c70 2023-12-12T09:43:28.370 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.368+0000 7f2c367fc640 1 -- 172.21.15.73:0/345692826 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c30038040 con 0x7f2c380c3c70 2023-12-12T09:43:28.370 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.368+0000 7f2c367fc640 1 -- 172.21.15.73:0/345692826 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c30007250 con 0x7f2c380c3c70 2023-12-12T09:43:28.370 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.368+0000 7f2c4010f640 1 -- 172.21.15.73:0/345692826 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c38155a90 con 0x7f2c380c3c70 2023-12-12T09:43:28.371 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.368+0000 7f2c4010f640 1 -- 172.21.15.73:0/345692826 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c38156430 con 0x7f2c380c3c70 2023-12-12T09:43:28.371 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.369+0000 7f2c4010f640 1 -- 172.21.15.73:0/345692826 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c381565f0 con 0x7f2c380c3c70 2023-12-12T09:43:28.371 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.370+0000 7f2c367fc640 1 -- 172.21.15.73:0/345692826 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f2c300073b0 con 0x7f2c380c3c70 2023-12-12T09:43:28.372 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.371+0000 7f2c367fc640 1 --2- 172.21.15.73:0/345692826 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f2c2406ae70 0x7f2c2406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:28.372 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.371+0000 7f2c367fc640 1 -- 172.21.15.73:0/345692826 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2c300aa2f0 con 0x7f2c380c3c70 2023-12-12T09:43:28.372 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.371+0000 7f2c3deab640 1 --2- 172.21.15.73:0/345692826 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f2c2406ae70 0x7f2c2406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:28.372 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.372+0000 7f2c3deab640 1 --2- 172.21.15.73:0/345692826 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f2c2406ae70 0x7f2c2406d330 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f2c28007440 tx=0x7f2c2800d040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:43:28.376 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.376+0000 7f2c367fc640 1 -- 172.21.15.73:0/345692826 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f2c30075270 con 0x7f2c380c3c70 2023-12-12T09:43:28.568 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.567+0000 7f2c4010f640 1 -- 172.21.15.73:0/345692826 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2c38156950 con 0x7f2c380c3c70 2023-12-12T09:43:28.570 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.570+0000 7f2c367fc640 1 -- 172.21.15.73:0/345692826 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16517 (secure 0 0 0) 0x7f2c38156950 con 0x7f2c380c3c70 2023-12-12T09:43:28.571 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-12T09:43:28.571 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":21,"fsid":"ba240992-02b8-4c7e-92f2-27eb29ac433b","created":"2023-12-12T09:43:02.454719+0000","modified":"2023-12-12T09:43:23.219345+0000","last_up_change":"2023-12-12T09:43:13.913440+0000","last_in_change":"2023-12-12T09:43:05.925348+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-12T09:43:15.525508+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-12T09:43:20.004546+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-12T09:43:20.736500+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"dd9074be-dbe2-4c34-9896-a4223d8d3940","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":4047810203},{"type":"v1","addr":"172.21.15.73:6801","nonce":4047810203}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":4047810203},{"type":"v1","addr":"172.21.15.73:6803","nonce":4047810203}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":4047810203},{"type":"v1","addr":"172.21.15.73:6807","nonce":4047810203}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":4047810203},{"type":"v1","addr":"172.21.15.73:6805","nonce":4047810203}]},"public_addr":"172.21.15.73:6801/4047810203","cluster_addr":"172.21.15.73:6803/4047810203","heartbeat_back_addr":"172.21.15.73:6807/4047810203","heartbeat_front_addr":"172.21.15.73:6805/4047810203","state":["exists","up"]},{"osd":1,"uuid":"c4a05052-96d4-4758-a4e1-1a37f1e07fed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":1356058331},{"type":"v1","addr":"172.21.15.73:6824","nonce":1356058331}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":1356058331},{"type":"v1","addr":"172.21.15.73:6827","nonce":1356058331}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":1356058331},{"type":"v1","addr":"172.21.15.73:6831","nonce":1356058331}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":1356058331},{"type":"v1","addr":"172.21.15.73:6829","nonce":1356058331}]},"public_addr":"172.21.15.73:6824/1356058331","cluster_addr":"172.21.15.73:6827/1356058331","heartbeat_back_addr":"172.21.15.73:6831/1356058331","heartbeat_front_addr":"172.21.15.73:6829/1356058331","state":["exists","up"]},{"osd":2,"uuid":"512bc8ac-72c2-40d4-b3d2-d867a92c5213","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":1228903316},{"type":"v1","addr":"172.21.15.73:6817","nonce":1228903316}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":1228903316},{"type":"v1","addr":"172.21.15.73:6819","nonce":1228903316}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6823","nonce":1228903316},{"type":"v1","addr":"172.21.15.73:6825","nonce":1228903316}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":1228903316},{"type":"v1","addr":"172.21.15.73:6821","nonce":1228903316}]},"public_addr":"172.21.15.73:6817/1228903316","cluster_addr":"172.21.15.73:6819/1228903316","heartbeat_back_addr":"172.21.15.73:6825/1228903316","heartbeat_front_addr":"172.21.15.73:6821/1228903316","state":["exists","up"]},{"osd":3,"uuid":"3d1a91e0-42bf-437a-8eae-8d357c8f63a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":1293329670},{"type":"v1","addr":"172.21.15.73:6809","nonce":1293329670}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6810","nonce":1293329670},{"type":"v1","addr":"172.21.15.73:6811","nonce":1293329670}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":1293329670},{"type":"v1","addr":"172.21.15.73:6815","nonce":1293329670}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":1293329670},{"type":"v1","addr":"172.21.15.73:6813","nonce":1293329670}]},"public_addr":"172.21.15.73:6809/1293329670","cluster_addr":"172.21.15.73:6811/1293329670","heartbeat_back_addr":"172.21.15.73:6815/1293329670","heartbeat_front_addr":"172.21.15.73:6813/1293329670","state":["exists","up"]},{"osd":4,"uuid":"4b302fff-834c-4069-ac19-00e46f6c87b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":3727975702},{"type":"v1","addr":"172.21.15.142:6801","nonce":3727975702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":3727975702},{"type":"v1","addr":"172.21.15.142:6803","nonce":3727975702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6809","nonce":3727975702},{"type":"v1","addr":"172.21.15.142:6811","nonce":3727975702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6805","nonce":3727975702},{"type":"v1","addr":"172.21.15.142:6807","nonce":3727975702}]},"public_addr":"172.21.15.142:6801/3727975702","cluster_addr":"172.21.15.142:6803/3727975702","heartbeat_back_addr":"172.21.15.142:6811/3727975702","heartbeat_front_addr":"172.21.15.142:6807/3727975702","state":["exists","up"]},{"osd":5,"uuid":"d7cdace2-67d0-45cc-95f2-515cf6ef1b82","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6817","nonce":2353193632},{"type":"v1","addr":"172.21.15.142:6819","nonce":2353193632}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6821","nonce":2353193632},{"type":"v1","addr":"172.21.15.142:6823","nonce":2353193632}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6829","nonce":2353193632},{"type":"v1","addr":"172.21.15.142:6831","nonce":2353193632}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6825","nonce":2353193632},{"type":"v1","addr":"172.21.15.142:6827","nonce":2353193632}]},"public_addr":"172.21.15.142:6819/2353193632","cluster_addr":"172.21.15.142:6823/2353193632","heartbeat_back_addr":"172.21.15.142:6831/2353193632","heartbeat_front_addr":"172.21.15.142:6827/2353193632","state":["exists","up"]},{"osd":6,"uuid":"649ce78a-5626-445c-aedc-a651ed05a6f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":2006111986},{"type":"v1","addr":"172.21.15.142:6806","nonce":2006111986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":2006111986},{"type":"v1","addr":"172.21.15.142:6810","nonce":2006111986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":2006111986},{"type":"v1","addr":"172.21.15.142:6815","nonce":2006111986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":2006111986},{"type":"v1","addr":"172.21.15.142:6813","nonce":2006111986}]},"public_addr":"172.21.15.142:6806/2006111986","cluster_addr":"172.21.15.142:6810/2006111986","heartbeat_back_addr":"172.21.15.142:6815/2006111986","heartbeat_front_addr":"172.21.15.142:6813/2006111986","state":["exists","up"]},{"osd":7,"uuid":"af15ae3b-c1d0-4acf-92db-8a1805494d13","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":2573794341},{"type":"v1","addr":"172.21.15.142:6818","nonce":2573794341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":2573794341},{"type":"v1","addr":"172.21.15.142:6822","nonce":2573794341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":2573794341},{"type":"v1","addr":"172.21.15.142:6830","nonce":2573794341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":2573794341},{"type":"v1","addr":"172.21.15.142:6826","nonce":2573794341}]},"public_addr":"172.21.15.142:6818/2573794341","cluster_addr":"172.21.15.142:6822/2573794341","heartbeat_back_addr":"172.21.15.142:6830/2573794341","heartbeat_front_addr":"172.21.15.142:6826/2573794341","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.185824+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.262103+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.225556+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:10.523459+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:10.706035+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.257339+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.301776+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.051960+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-12T09:43:28.574 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.572+0000 7f2c4010f640 1 -- 172.21.15.73:0/345692826 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f2c2406ae70 msgr2=0x7f2c2406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:28.574 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.572+0000 7f2c4010f640 1 --2- 172.21.15.73:0/345692826 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f2c2406ae70 0x7f2c2406d330 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f2c28007440 tx=0x7f2c2800d040 comp rx=0 tx=0).stop 2023-12-12T09:43:28.574 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.572+0000 7f2c4010f640 1 -- 172.21.15.73:0/345692826 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2c380c3c70 msgr2=0x7f2c3814d620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:28.574 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.572+0000 7f2c4010f640 1 --2- 172.21.15.73:0/345692826 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2c380c3c70 0x7f2c3814d620 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f2c3002bcb0 tx=0x7f2c30001120 comp rx=0 tx=0).stop 2023-12-12T09:43:28.575 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.573+0000 7f2c4010f640 1 -- 172.21.15.73:0/345692826 shutdown_connections 2023-12-12T09:43:28.575 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.573+0000 7f2c4010f640 1 --2- 172.21.15.73:0/345692826 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f2c2406ae70 0x7f2c2406d330 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:28.575 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.573+0000 7f2c4010f640 1 --2- 172.21.15.73:0/345692826 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2c380c3c70 0x7f2c3814d620 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:28.575 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.573+0000 7f2c4010f640 1 --2- 172.21.15.73:0/345692826 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2c3814f3d0 0x7f2c3814d0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:28.575 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.573+0000 7f2c4010f640 1 --2- 172.21.15.73:0/345692826 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2c20005180 0x7f2c38158260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:28.575 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.573+0000 7f2c4010f640 1 -- 172.21.15.73:0/345692826 >> 172.21.15.73:0/345692826 conn(0x7f2c380ab8a0 msgr2=0x7f2c380a9b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:43:28.575 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.573+0000 7f2c4010f640 1 -- 172.21.15.73:0/345692826 shutdown_connections 2023-12-12T09:43:28.575 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.573+0000 7f2c4010f640 1 -- 172.21.15.73:0/345692826 wait complete. 2023-12-12T09:43:28.594 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2023-12-12T09:43:28.594 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2023-12-12T09:43:28.594 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2023-12-12T09:43:28.595 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2023-12-12T09:43:28.595 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2023-12-12T09:43:28.596 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2023-12-12T09:43:28.596 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2023-12-12T09:43:28.596 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2023-12-12T09:43:28.899 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.898+0000 7feac74c3640 1 Processor -- start 2023-12-12T09:43:28.901 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.898+0000 7feac74c3640 1 -- start start 2023-12-12T09:43:28.901 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.900+0000 7feac74c3640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7feac0151960 0x7feac00c4590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:28.901 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.900+0000 7feac74c3640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7feac0154b80 0x7feac00ca430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:28.901 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.900+0000 7feac74c3640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feac006c930 con 0x7feac00c9fa0 2023-12-12T09:43:28.901 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.900+0000 7feac74c3640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feac00c4e90 con 0x7feac0154b80 2023-12-12T09:43:28.901 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.900+0000 7feac74c3640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feac00c8870 con 0x7feac0151960 2023-12-12T09:43:28.901 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.901+0000 7feac64c1640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7feac0151960 0x7feac00c4590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:28.901 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.901+0000 7feac64c1640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7feac0151960 0x7feac00c4590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.73:43148/0 (socket says 172.21.15.73:43148) 2023-12-12T09:43:28.902 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.901+0000 7feac64c1640 1 -- 172.21.15.73:0/3241765424 learned_addr learned my addr 172.21.15.73:0/3241765424 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:43:28.902 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.901+0000 7feac6cc2640 1 --2- 172.21.15.73:0/3241765424 >> v2:172.21.15.73:3300/0 conn(0x7feac0154b80 0x7feac00ca430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:28.902 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.901+0000 7fc203a7c640 1 Processor -- start 2023-12-12T09:43:28.903 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.902+0000 7feac64c1640 1 -- 172.21.15.73:0/3241765424 >> v2:172.21.15.73:3300/0 conn(0x7feac0154b80 msgr2=0x7feac00ca430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:43:28.903 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.902+0000 7feac64c1640 1 --2- 172.21.15.73:0/3241765424 >> v2:172.21.15.73:3300/0 conn(0x7feac0154b80 0x7feac00ca430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:28.903 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.902+0000 7feac64c1640 1 -- 172.21.15.73:0/3241765424 >> v1:172.21.15.73:6789/0 conn(0x7feac00c9fa0 legacy=0x7feac0154470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:28.905 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.903+0000 7feac64c1640 1 -- 172.21.15.73:0/3241765424 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feac00c8b50 con 0x7feac0151960 2023-12-12T09:43:28.905 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.903+0000 7f907b6bb640 1 Processor -- start 2023-12-12T09:43:28.905 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.904+0000 7f907b6bb640 1 -- start start 2023-12-12T09:43:28.906 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.902+0000 7fc203a7c640 1 -- start start 2023-12-12T09:43:28.906 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.904+0000 7fc203a7c640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fc1fc0c4a40 0x7fc1fc15bf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:28.906 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.904+0000 7fc203a7c640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1fc0c3ea0 con 0x7fc1fc1513f0 2023-12-12T09:43:28.906 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.904+0000 7fc203a7c640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1fc0c1bb0 con 0x7fc1fc0c0af0 2023-12-12T09:43:28.906 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.904+0000 7fc203a7c640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1fc0c3920 con 0x7fc1fc0c4a40 2023-12-12T09:43:28.906 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.904+0000 7feac6cc2640 1 --2- 172.21.15.73:0/3241765424 >> v2:172.21.15.73:3300/0 conn(0x7feac0154b80 0x7feac00ca430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-12T09:43:28.907 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.905+0000 7fc202019640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fc1fc0c4a40 0x7fc1fc15bf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:28.907 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.905+0000 7feac64c1640 1 --2- 172.21.15.73:0/3241765424 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7feac0151960 0x7feac00c4590 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7feac00ac830 tx=0x7feab002bd50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=88a913db060b2607 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:43:28.907 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.905+0000 7fc202019640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fc1fc0c4a40 0x7fc1fc15bf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:56518/0 (socket says 172.21.15.73:56518) 2023-12-12T09:43:28.907 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.905+0000 7fc202019640 1 -- 172.21.15.73:0/2394476801 learned_addr learned my addr 172.21.15.73:0/2394476801 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:43:28.908 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.906+0000 7feac54bf640 1 -- 172.21.15.73:0/3241765424 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feab002c870 con 0x7feac0151960 2023-12-12T09:43:28.908 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.905+0000 7f978a490640 1 Processor -- start 2023-12-12T09:43:28.908 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.906+0000 7f978a490640 1 -- start start 2023-12-12T09:43:28.908 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.906+0000 7f907b6bb640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f907406ddd0 0x7f907406ca10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:28.909 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.906+0000 7feac54bf640 1 -- 172.21.15.73:0/3241765424 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feab002c9d0 con 0x7feac0151960 2023-12-12T09:43:28.909 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.906+0000 7feac54bf640 1 -- 172.21.15.73:0/3241765424 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feab002cda0 con 0x7feac0151960 2023-12-12T09:43:28.909 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.906+0000 7f907b6bb640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f90740a5160 0x7f90740c42c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:28.909 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.906+0000 7f907b6bb640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90740c1e40 con 0x7f90740c0da0 2023-12-12T09:43:28.909 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.906+0000 7f907b6bb640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90740c2370 con 0x7f90740a5160 2023-12-12T09:43:28.910 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.906+0000 7f907b6bb640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f907406cf50 con 0x7f907406ddd0 2023-12-12T09:43:28.910 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.907+0000 7f978a490640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f9784155ef0 0x7f978406bee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:28.910 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.907+0000 7feac74c3640 1 -- 172.21.15.73:0/3241765424 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7feac0151960 msgr2=0x7feac00c4590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:28.910 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.907+0000 7feac74c3640 1 --2- 172.21.15.73:0/3241765424 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7feac0151960 0x7feac00c4590 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7feac00ac830 tx=0x7feab002bd50 comp rx=0 tx=0).stop 2023-12-12T09:43:28.911 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.907+0000 7f978a490640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97840c11a0 con 0x7f97840c3bc0 2023-12-12T09:43:28.911 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.908+0000 7f978a490640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97841562d0 con 0x7f97840c1390 2023-12-12T09:43:28.911 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.906+0000 7fc202019640 1 -- 172.21.15.73:0/2394476801 >> v1:172.21.15.142:6789/0 conn(0x7fc1fc0c0af0 legacy=0x7fc1fc0c4330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:28.912 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.906+0000 7fc202019640 1 -- 172.21.15.73:0/2394476801 >> v1:172.21.15.73:6789/0 conn(0x7fc1fc1513f0 legacy=0x7fc1fc0a4c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:28.912 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.906+0000 7fc202019640 1 -- 172.21.15.73:0/2394476801 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1fc0c1e90 con 0x7fc1fc0c4a40 2023-12-12T09:43:28.912 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.908+0000 7f9079457640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f907406ddd0 0x7f907406ca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:28.912 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.908+0000 7feac74c3640 1 -- 172.21.15.73:0/3241765424 shutdown_connections 2023-12-12T09:43:28.913 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.908+0000 7feac74c3640 1 --2- 172.21.15.73:0/3241765424 >> v2:172.21.15.73:3300/0 conn(0x7feac0154b80 0x7feac00ca430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:28.913 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.908+0000 7feac74c3640 1 --2- 172.21.15.73:0/3241765424 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7feac0151960 0x7feac00c4590 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:28.913 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.908+0000 7feac74c3640 1 -- 172.21.15.73:0/3241765424 >> 172.21.15.73:0/3241765424 conn(0x7feac0071df0 msgr2=0x7feac0072200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:43:28.913 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.908+0000 7f977b7fe640 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f97840c1390 0x7f978406c6e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.73:56836/0 (socket says 172.21.15.73:56836) 2023-12-12T09:43:28.913 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.908+0000 7f977b7fe640 1 -- 172.21.15.73:0/494312992 learned_addr learned my addr 172.21.15.73:0/494312992 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-12T09:43:28.913 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.908+0000 7f9783fff640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f9784155ef0 0x7f978406bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:28.913 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.908+0000 7f978a490640 1 -- 172.21.15.73:0/494312992 --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9784159450 con 0x7f9784155ef0 2023-12-12T09:43:28.914 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.909+0000 7feac74c3640 1 -- 172.21.15.73:0/3241765424 shutdown_connections 2023-12-12T09:43:28.914 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.909+0000 7feac74c3640 1 -- 172.21.15.73:0/3241765424 wait complete. 2023-12-12T09:43:28.914 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.908+0000 7f9079457640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f907406ddd0 0x7f907406ca10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.73:43158/0 (socket says 172.21.15.73:43158) 2023-12-12T09:43:28.914 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.908+0000 7f9079457640 1 -- 172.21.15.73:0/3194485980 learned_addr learned my addr 172.21.15.73:0/3194485980 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:43:28.915 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.909+0000 7fc202019640 1 --2- 172.21.15.73:0/2394476801 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc1fc0c4a40 0x7fc1fc15bf40 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fc1f800b1e0 tx=0x7fc1f802c1d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18faba0585aaf15d server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:43:28.915 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.909+0000 7f9079457640 1 -- 172.21.15.73:0/3194485980 >> v2:172.21.15.73:3300/0 conn(0x7f90740a5160 msgr2=0x7f90740c42c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:43:28.915 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.910+0000 7fc200816640 1 -- 172.21.15.73:0/2394476801 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1f80078d0 con 0x7fc1fc0c4a40 2023-12-12T09:43:28.916 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.910+0000 7f97837fe640 1 -- 172.21.15.73:0/494312992 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1492019845 0 0) 0x7f97841562d0 con 0x7f97840c1390 2023-12-12T09:43:28.916 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.910+0000 7f97837fe640 1 -- 172.21.15.73:0/494312992 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9770003520 con 0x7f97840c1390 2023-12-12T09:43:28.916 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.910+0000 7f9078c56640 1 --2- 172.21.15.73:0/3194485980 >> v2:172.21.15.73:3300/0 conn(0x7f90740a5160 0x7f90740c42c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:28.916 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.910+0000 7fc61a2bb640 1 Processor -- start 2023-12-12T09:43:28.917 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.910+0000 7f9079457640 1 --2- 172.21.15.73:0/3194485980 >> v2:172.21.15.73:3300/0 conn(0x7f90740a5160 0x7f90740c42c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:28.917 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.910+0000 7f9079457640 1 -- 172.21.15.73:0/3194485980 >> v1:172.21.15.73:6789/0 conn(0x7f90740c0da0 legacy=0x7f90740aa6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:28.917 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.910+0000 7fc61a2bb640 1 -- start start 2023-12-12T09:43:28.918 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.910+0000 7f9079457640 1 -- 172.21.15.73:0/3194485980 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f907406c060 con 0x7f907406ddd0 2023-12-12T09:43:28.918 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.911+0000 7fc200816640 1 -- 172.21.15.73:0/2394476801 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1f8007a30 con 0x7fc1fc0c4a40 2023-12-12T09:43:28.918 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.911+0000 7fc200816640 1 -- 172.21.15.73:0/2394476801 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1f8007e20 con 0x7fc1fc0c4a40 2023-12-12T09:43:28.918 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.911+0000 7ff2332ad640 1 Processor -- start 2023-12-12T09:43:28.919 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.912+0000 7fc61a2bb640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fc60c02bff0 0x7fc60c00b220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:28.919 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.912+0000 7fc61a2bb640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc60c04aec0 con 0x7fc60c0d71c0 2023-12-12T09:43:28.919 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.912+0000 7fc61a2bb640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc60c04ba40 con 0x7fc60c0d46a0 2023-12-12T09:43:28.919 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.912+0000 7fc61a2bb640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc60c040270 con 0x7fc60c02bff0 2023-12-12T09:43:28.920 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.910+0000 7f97837fe640 1 -- 172.21.15.73:0/494312992 <== mon.1 v1:172.21.15.142:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 964839906 0 0) 0x7f9770003520 con 0x7f97840c1390 2023-12-12T09:43:28.920 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.910+0000 7f97837fe640 1 -- 172.21.15.73:0/494312992 >> v2:172.21.15.73:3300/0 conn(0x7f9784155ef0 msgr2=0x7f978406bee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:43:28.920 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.910+0000 7f97837fe640 1 --2- 172.21.15.73:0/494312992 >> v2:172.21.15.73:3300/0 conn(0x7f9784155ef0 0x7f978406bee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:28.920 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.910+0000 7f97837fe640 1 -- 172.21.15.73:0/494312992 >> v1:172.21.15.73:6789/0 conn(0x7f97840c3bc0 legacy=0x7f97840c4030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:43:28.920 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.911+0000 7f97837fe640 1 -- 172.21.15.73:0/494312992 --> v1:172.21.15.142:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9784159730 con 0x7f97840c1390 2023-12-12T09:43:28.920 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.911+0000 7f97837fe640 1 -- 172.21.15.73:0/494312992 <== mon.1 v1:172.21.15.142:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3186547832 0 0) 0x7f9774001670 con 0x7f97840c1390 2023-12-12T09:43:28.920 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.911+0000 7f97837fe640 1 -- 172.21.15.73:0/494312992 >> v1:172.21.15.142:6789/0 conn(0x7f97840c1390 legacy=0x7f978406c6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:28.920 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.911+0000 7f97837fe640 1 --2- 172.21.15.73:0/494312992 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9770003970 0x7f9770003db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:28.920 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.911+0000 7f97837fe640 1 --2- 172.21.15.73:0/494312992 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f97700047c0 0x7f9770004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:28.921 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.911+0000 7f97837fe640 1 --2- 172.21.15.73:0/494312992 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f97700052a0 0x7f977000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:28.921 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.911+0000 7f97837fe640 1 -- 172.21.15.73:0/494312992 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9784159450 con 0x7f97700047c0 2023-12-12T09:43:28.921 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.911+0000 7f97837fe640 1 -- 172.21.15.73:0/494312992 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f977000c170 con 0x7f9770003970 2023-12-12T09:43:28.921 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.911+0000 7f97837fe640 1 -- 172.21.15.73:0/494312992 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f977000c330 con 0x7f97700052a0 2023-12-12T09:43:28.921 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.912+0000 7f9078c56640 1 --2- 172.21.15.73:0/3194485980 >> v2:172.21.15.73:3300/0 conn(0x7f90740a5160 0x7f90740c42c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:43:28.921 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.912+0000 7ff2332ad640 1 -- start start 2023-12-12T09:43:28.922 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.912+0000 7feac74c3640 1 Processor -- start 2023-12-12T09:43:28.922 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.912+0000 7fc618858640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7fc60c0d71c0 0x7fc60c0472b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:34294/0 (socket says 172.21.15.73:34294) 2023-12-12T09:43:28.922 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.912+0000 7fc618858640 1 -- 172.21.15.73:0/720337399 learned_addr learned my addr 172.21.15.73:0/720337399 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-12T09:43:28.922 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.912+0000 7feac74c3640 1 -- start start 2023-12-12T09:43:28.923 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.912+0000 7fc6137fe640 1 --2- 172.21.15.73:0/720337399 >> v2:172.21.15.142:3300/0 conn(0x7fc60c02bff0 0x7fc60c00b220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:28.923 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.913+0000 7f9783fff640 1 --2- 172.21.15.73:0/494312992 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9770003970 0x7f9770003db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:28.923 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.913+0000 7f9079457640 1 --2- 172.21.15.73:0/3194485980 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f907406ddd0 0x7f907406ca10 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f90740c58f0 tx=0x7f906c02bfb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=aef4adb4c7a095f9 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:43:28.924 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.913+0000 7f9788a2d640 1 --2- 172.21.15.73:0/494312992 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f97700052a0 0x7f977000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:28.924 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.913+0000 7f906bfff640 1 -- 172.21.15.73:0/3194485980 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f906c02cb50 con 0x7f907406ddd0 2023-12-12T09:43:28.924 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.913+0000 7f906bfff640 1 -- 172.21.15.73:0/3194485980 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f906c02ccb0 con 0x7f907406ddd0 2023-12-12T09:43:28.925 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.913+0000 7fc6137fe640 1 -- 172.21.15.73:0/720337399 >> v1:172.21.15.142:6789/0 conn(0x7fc60c0d46a0 legacy=0x7fc60c04bed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:43:28.925 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.913+0000 7fc6137fe640 1 -- 172.21.15.73:0/720337399 >> v1:172.21.15.73:6789/0 conn(0x7fc60c0d71c0 legacy=0x7fc60c0472b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:43:28.925 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.914+0000 7ff2332ad640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff224049fa0 0x7ff2240df150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:28.925 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.914+0000 7ff2332ad640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7ff2240064a0 0x7ff224006910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:28.925 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.914+0000 7ff2332ad640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff22404c4a0 con 0x7ff2240d8790 2023-12-12T09:43:28.926 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.914+0000 7ff2332ad640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff22404b8d0 con 0x7ff2240064a0 2023-12-12T09:43:28.926 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.914+0000 7ff2332ad640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2240d8b70 con 0x7ff224049fa0 2023-12-12T09:43:28.926 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.914+0000 7fc6137fe640 1 -- 172.21.15.73:0/720337399 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc60c04c5e0 con 0x7fc60c02bff0 2023-12-12T09:43:28.926 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.914+0000 7f9783fff640 1 -- 172.21.15.73:0/494312992 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f97700052a0 msgr2=0x7f977000b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:43:28.927 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.914+0000 7f9783fff640 1 --2- 172.21.15.73:0/494312992 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f97700052a0 0x7f977000b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:28.927 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.914+0000 7f9783fff640 1 -- 172.21.15.73:0/494312992 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f97700047c0 msgr2=0x7f9770004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:43:28.927 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.914+0000 7f9783fff640 1 --2- 172.21.15.73:0/494312992 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f97700047c0 0x7f9770004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:28.927 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.914+0000 7f9783fff640 1 -- 172.21.15.73:0/494312992 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97840c11a0 con 0x7f9770003970 2023-12-12T09:43:28.927 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.914+0000 7f907b6bb640 1 -- 172.21.15.73:0/3194485980 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f907406ddd0 msgr2=0x7f907406ca10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:28.927 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.914+0000 7f907b6bb640 1 --2- 172.21.15.73:0/3194485980 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f907406ddd0 0x7f907406ca10 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f90740c58f0 tx=0x7f906c02bfb0 comp rx=0 tx=0).stop 2023-12-12T09:43:28.927 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.914+0000 7f907b6bb640 1 -- 172.21.15.73:0/3194485980 shutdown_connections 2023-12-12T09:43:28.927 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.914+0000 7f907b6bb640 1 --2- 172.21.15.73:0/3194485980 >> v2:172.21.15.73:3300/0 conn(0x7f90740a5160 0x7f90740c42c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:28.927 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.914+0000 7f907b6bb640 1 --2- 172.21.15.73:0/3194485980 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f907406ddd0 0x7f907406ca10 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:28.928 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.914+0000 7f907b6bb640 1 -- 172.21.15.73:0/3194485980 >> 172.21.15.73:0/3194485980 conn(0x7f90740a7760 msgr2=0x7f90740a7b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:43:28.928 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.914+0000 7feac74c3640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7feac00c9fa0 0x7feac00c0ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:28.928 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.914+0000 7f9788a2d640 1 -- 172.21.15.73:0/494312992 reap_dead start 2023-12-12T09:43:28.929 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.915+0000 7ff23184a640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7ff2240064a0 0x7ff224006910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:28.929 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.915+0000 7ff23184a640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7ff2240064a0 0x7ff224006910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.73:43176/0 (socket says 172.21.15.73:43176) 2023-12-12T09:43:28.929 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.915+0000 7ff23184a640 1 -- 172.21.15.73:0/622623881 learned_addr learned my addr 172.21.15.73:0/622623881 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:43:28.929 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.915+0000 7ff231049640 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7ff2240d8790 0x7ff22400edb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.73:56854/0 (socket says 172.21.15.73:56854) 2023-12-12T09:43:28.929 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.915+0000 7feac74c3640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7feac0151960 0x7feac0148220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:28.930 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.915+0000 7feac74c3640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7feac0154b80 0x7feac00c2af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:28.930 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.915+0000 7fc203a7c640 1 -- 172.21.15.73:0/2394476801 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc1fc0c4a40 msgr2=0x7fc1fc15bf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:28.930 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.915+0000 7fc203a7c640 1 --2- 172.21.15.73:0/2394476801 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc1fc0c4a40 0x7fc1fc15bf40 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fc1f800b1e0 tx=0x7fc1f802c1d0 comp rx=0 tx=0).stop 2023-12-12T09:43:28.930 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.915+0000 7feac74c3640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feac00c3900 con 0x7feac00c9fa0 2023-12-12T09:43:28.931 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.915+0000 7ff223fff640 1 -- 172.21.15.73:0/622623881 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1215302776 0 0) 0x7ff22404c4a0 con 0x7ff2240d8790 2023-12-12T09:43:28.931 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.916+0000 7feac74c3640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feac0148070 con 0x7feac0151960 2023-12-12T09:43:28.931 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.916+0000 7feac64c1640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7feac00c9fa0 0x7feac00c0ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:28.931 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.916+0000 7feac5cc0640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7feac0151960 0x7feac0148220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:28.931 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.916+0000 7feac6cc2640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7feac0154b80 0x7feac00c2af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:28.932 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.916+0000 7feac64c1640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7feac00c9fa0 0x7feac00c0ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:56558/0 (socket says 172.21.15.73:56558) 2023-12-12T09:43:28.932 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.916+0000 7feac6cc2640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7feac0154b80 0x7feac00c2af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.73:33510/0 (socket says 172.21.15.73:33510) 2023-12-12T09:43:28.932 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.916+0000 7fc203a7c640 1 -- 172.21.15.73:0/2394476801 shutdown_connections 2023-12-12T09:43:28.932 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.916+0000 7fc203a7c640 1 --2- 172.21.15.73:0/2394476801 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc1fc0c4a40 0x7fc1fc15bf40 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:28.932 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.916+0000 7fc203a7c640 1 -- 172.21.15.73:0/2394476801 >> 172.21.15.73:0/2394476801 conn(0x7fc1fc0a77d0 msgr2=0x7fc1fc0a7be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:43:28.933 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.916+0000 7feac64c1640 1 -- 172.21.15.73:0/843963753 learned_addr learned my addr 172.21.15.73:0/843963753 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:43:28.933 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.915+0000 7f9783fff640 1 --2- 172.21.15.73:0/494312992 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9770003970 0x7f9770003db0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f976c009ac0 tx=0x7f97700057f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f40a750364ea69f9 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:43:28.933 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.915+0000 7f907b6bb640 1 -- 172.21.15.73:0/3194485980 shutdown_connections 2023-12-12T09:43:28.934 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.915+0000 7f907b6bb640 1 -- 172.21.15.73:0/3194485980 wait complete. 2023-12-12T09:43:28.934 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.916+0000 7feac74c3640 1 -- 172.21.15.73:0/843963753 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feac0157fa0 con 0x7feac0154b80 2023-12-12T09:43:28.934 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.916+0000 7ff223fff640 1 -- 172.21.15.73:0/622623881 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff218003520 con 0x7ff2240d8790 2023-12-12T09:43:28.934 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.916+0000 7ff230848640 1 --2- 172.21.15.73:0/622623881 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff224049fa0 0x7ff2240df150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:28.935 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.916+0000 7ff23184a640 1 -- 172.21.15.73:0/622623881 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff224049fa0 msgr2=0x7ff2240df150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:43:28.935 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.916+0000 7ff23184a640 1 --2- 172.21.15.73:0/622623881 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff224049fa0 0x7ff2240df150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:28.935 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.916+0000 7ff23184a640 1 -- 172.21.15.73:0/622623881 >> v1:172.21.15.142:6789/0 conn(0x7ff2240d8790 legacy=0x7ff22400edb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:28.935 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.916+0000 7ff23184a640 1 -- 172.21.15.73:0/622623881 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff22404bb70 con 0x7ff2240064a0 2023-12-12T09:43:28.935 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.916+0000 7ff230848640 1 --2- 172.21.15.73:0/622623881 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff224049fa0 0x7ff2240df150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:43:28.935 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.916+0000 7fc203a7c640 1 -- 172.21.15.73:0/2394476801 shutdown_connections 2023-12-12T09:43:28.936 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.916+0000 7f97837fe640 1 -- 172.21.15.73:0/494312992 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f976c02c6b0 con 0x7f9770003970 2023-12-12T09:43:28.936 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.916+0000 7f97837fe640 1 -- 172.21.15.73:0/494312992 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f976c02c810 con 0x7f9770003970 2023-12-12T09:43:28.936 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.916+0000 7f97837fe640 1 -- 172.21.15.73:0/494312992 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f976c02cba0 con 0x7f9770003970 2023-12-12T09:43:28.936 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.917+0000 7f907b6bb640 1 Processor -- start 2023-12-12T09:43:28.936 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.917+0000 7fc6137fe640 1 --2- 172.21.15.73:0/720337399 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc60c02bff0 0x7fc60c00b220 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fc6000097a0 tx=0x7fc60002b840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=decbe10e3b1ceeb7 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:43:28.937 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.917+0000 7f907b6bb640 1 -- start start 2023-12-12T09:43:28.937 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.916+0000 7fc203a7c640 1 -- 172.21.15.73:0/2394476801 wait complete. 2023-12-12T09:43:28.937 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.918+0000 7f978a490640 1 -- 172.21.15.73:0/494312992 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9770003970 msgr2=0x7f9770003db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:28.937 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.918+0000 7f978a490640 1 --2- 172.21.15.73:0/494312992 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9770003970 0x7f9770003db0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f976c009ac0 tx=0x7f97700057f0 comp rx=0 tx=0).stop 2023-12-12T09:43:28.938 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.917+0000 7fc612ffd640 1 -- 172.21.15.73:0/720337399 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc60002e070 con 0x7fc60c02bff0 2023-12-12T09:43:28.938 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.918+0000 7fc612ffd640 1 -- 172.21.15.73:0/720337399 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6000315a0 con 0x7fc60c02bff0 2023-12-12T09:43:28.938 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.918+0000 7feac5cc0640 1 -- 172.21.15.73:0/843963753 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7feac0154b80 msgr2=0x7feac00c2af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:28.938 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.918+0000 7feac5cc0640 1 --2- 172.21.15.73:0/843963753 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7feac0154b80 0x7feac00c2af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:28.939 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.918+0000 7feac5cc0640 1 -- 172.21.15.73:0/843963753 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7feac00c9fa0 msgr2=0x7feac00c0ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:28.939 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.918+0000 7feac5cc0640 1 --2- 172.21.15.73:0/843963753 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7feac00c9fa0 0x7feac00c0ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:28.939 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.918+0000 7feac5cc0640 1 -- 172.21.15.73:0/843963753 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feab0009b30 con 0x7feac0151960 2023-12-12T09:43:28.939 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.918+0000 7ff23184a640 1 --2- 172.21.15.73:0/622623881 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff2240064a0 0x7ff224006910 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7ff22c0686f0 tx=0x7ff22c0a5d60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=934644eb07968f8a server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:43:28.939 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.918+0000 7fc612ffd640 1 -- 172.21.15.73:0/720337399 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc600031930 con 0x7fc60c02bff0 2023-12-12T09:43:28.940 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.918+0000 7fc61a2bb640 1 -- 172.21.15.73:0/720337399 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc60c02bff0 msgr2=0x7fc60c00b220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:28.940 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.918+0000 7fc61a2bb640 1 --2- 172.21.15.73:0/720337399 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc60c02bff0 0x7fc60c00b220 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fc6000097a0 tx=0x7fc60002b840 comp rx=0 tx=0).stop 2023-12-12T09:43:28.940 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.918+0000 7f978a490640 1 -- 172.21.15.73:0/494312992 shutdown_connections 2023-12-12T09:43:28.940 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.918+0000 7f978a490640 1 --2- 172.21.15.73:0/494312992 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9770003970 0x7f9770003db0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:28.940 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.918+0000 7f978a490640 1 -- 172.21.15.73:0/494312992 >> 172.21.15.73:0/494312992 conn(0x7f97840a77d0 msgr2=0x7f97840a7be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:43:28.941 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.919+0000 7feac5cc0640 1 --2- 172.21.15.73:0/843963753 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7feac0151960 0x7feac0148220 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7feab400c780 tx=0x7feab400cc40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:43:28.941 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.919+0000 7f978a490640 1 -- 172.21.15.73:0/494312992 shutdown_connections 2023-12-12T09:43:28.941 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.919+0000 7fc61a2bb640 1 -- 172.21.15.73:0/720337399 shutdown_connections 2023-12-12T09:43:28.941 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.919+0000 7fc61a2bb640 1 --2- 172.21.15.73:0/720337399 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc60c02bff0 0x7fc60c00b220 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:28.941 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.919+0000 7fc61a2bb640 1 -- 172.21.15.73:0/720337399 >> 172.21.15.73:0/720337399 conn(0x7fc60c007b10 msgr2=0x7fc60c007f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:43:28.942 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.919+0000 7feabeffd640 1 -- 172.21.15.73:0/843963753 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feab4005270 con 0x7feac0151960 2023-12-12T09:43:28.942 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.919+0000 7feabeffd640 1 -- 172.21.15.73:0/843963753 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feab40053d0 con 0x7feac0151960 2023-12-12T09:43:28.942 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.919+0000 7ff223fff640 1 -- 172.21.15.73:0/622623881 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff22c0a6bd0 con 0x7ff2240064a0 2023-12-12T09:43:28.942 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.919+0000 7ff223fff640 1 -- 172.21.15.73:0/622623881 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff22c0a6d50 con 0x7ff2240064a0 2023-12-12T09:43:28.943 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.919+0000 7ff223fff640 1 -- 172.21.15.73:0/622623881 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff22c0ae680 con 0x7ff2240064a0 2023-12-12T09:43:28.943 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.919+0000 7fc203a7c640 1 Processor -- start 2023-12-12T09:43:28.943 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.919+0000 7feabeffd640 1 -- 172.21.15.73:0/843963753 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feab400a880 con 0x7feac0151960 2023-12-12T09:43:28.944 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.919+0000 7feac74c3640 1 -- 172.21.15.73:0/843963753 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feac01eaad0 con 0x7feac0151960 2023-12-12T09:43:28.944 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.920+0000 7f978a490640 1 -- 172.21.15.73:0/494312992 wait complete. 2023-12-12T09:43:28.944 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.920+0000 7feac74c3640 1 -- 172.21.15.73:0/843963753 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feac01581f0 con 0x7feac0151960 2023-12-12T09:43:28.944 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.920+0000 7f907b6bb640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f907406ddd0 0x7f90741471f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:28.945 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.920+0000 7f907b6bb640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f90740a5160 0x7f9074148b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:28.945 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.920+0000 7f907b6bb640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f90740c0da0 0x7f9074149070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:28.945 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.920+0000 7feac74c3640 1 -- 172.21.15.73:0/843963753 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7feac00c8520 con 0x7feac0151960 2023-12-12T09:43:28.945 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.921+0000 7f9079457640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f907406ddd0 0x7f90741471f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:28.945 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.921+0000 7f9079457640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f907406ddd0 0x7f90741471f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.73:33518/0 (socket says 172.21.15.73:33518) 2023-12-12T09:43:28.946 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.921+0000 7f9079457640 1 -- 172.21.15.73:0/258930463 learned_addr learned my addr 172.21.15.73:0/258930463 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:43:28.946 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.921+0000 7f907b6bb640 1 -- 172.21.15.73:0/258930463 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90740bfa90 con 0x7f90740a5160 2023-12-12T09:43:28.946 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.921+0000 7f907b6bb640 1 -- 172.21.15.73:0/258930463 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90740bb5f0 con 0x7f90740c0da0 2023-12-12T09:43:28.946 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.921+0000 7f907b6bb640 1 -- 172.21.15.73:0/258930463 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90740718b0 con 0x7f907406ddd0 2023-12-12T09:43:28.946 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.921+0000 7f9078c56640 1 --2- 172.21.15.73:0/258930463 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f90740a5160 0x7f9074148b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:28.946 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.921+0000 7f9079c58640 1 --2- 172.21.15.73:0/258930463 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f90740c0da0 0x7f9074149070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:28.946 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.922+0000 7f9079457640 1 -- 172.21.15.73:0/258930463 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f90740c0da0 msgr2=0x7f9074149070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:28.946 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.921+0000 7ff2332ad640 1 -- 172.21.15.73:0/622623881 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff2240064a0 msgr2=0x7ff224006910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:28.947 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.921+0000 7ff2332ad640 1 --2- 172.21.15.73:0/622623881 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff2240064a0 0x7ff224006910 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7ff22c0686f0 tx=0x7ff22c0a5d60 comp rx=0 tx=0).stop 2023-12-12T09:43:28.947 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.921+0000 7ff2332ad640 1 -- 172.21.15.73:0/622623881 shutdown_connections 2023-12-12T09:43:28.947 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.921+0000 7ff2332ad640 1 --2- 172.21.15.73:0/622623881 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff224049fa0 0x7ff2240df150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:28.947 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.921+0000 7ff2332ad640 1 --2- 172.21.15.73:0/622623881 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff2240064a0 0x7ff224006910 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:28.947 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.921+0000 7ff2332ad640 1 -- 172.21.15.73:0/622623881 >> 172.21.15.73:0/622623881 conn(0x7ff22404fc00 msgr2=0x7ff224050010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:43:28.947 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.921+0000 7fc61a2bb640 1 -- 172.21.15.73:0/720337399 shutdown_connections 2023-12-12T09:43:28.948 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.921+0000 7f8b1cb33640 1 Processor -- start 2023-12-12T09:43:28.948 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.922+0000 7f9079457640 1 --2- 172.21.15.73:0/258930463 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f90740c0da0 0x7f9074149070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:28.948 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.922+0000 7f9079457640 1 -- 172.21.15.73:0/258930463 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f90740a5160 msgr2=0x7f9074148b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:28.948 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.922+0000 7f9079457640 1 --2- 172.21.15.73:0/258930463 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f90740a5160 0x7f9074148b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:28.948 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.922+0000 7f9079457640 1 -- 172.21.15.73:0/258930463 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f906c009b30 con 0x7f907406ddd0 2023-12-12T09:43:28.949 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.922+0000 7fc203a7c640 1 -- start start 2023-12-12T09:43:28.949 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.921+0000 7f8b1cb33640 1 -- start start 2023-12-12T09:43:28.949 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.922+0000 7f9078c56640 1 --2- 172.21.15.73:0/258930463 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f90740a5160 0x7f9074148b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-12T09:43:28.950 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.922+0000 7f8b1cb33640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8b18151a70 0x7f8b18154f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:28.950 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.922+0000 7f8b1cb33640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f8b180acdd0 0x7f8b180ad230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:28.950 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.922+0000 7f8b1cb33640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b180c7cc0 con 0x7f8b180c8150 2023-12-12T09:43:28.950 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.922+0000 7f8b1cb33640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b180c9c00 con 0x7f8b180acdd0 2023-12-12T09:43:28.950 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.922+0000 7f8b1cb33640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b18155450 con 0x7f8b18151a70 2023-12-12T09:43:28.950 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.922+0000 7ff2332ad640 1 -- 172.21.15.73:0/622623881 shutdown_connections 2023-12-12T09:43:28.951 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.923+0000 7f8b15d9b640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f8b180acdd0 0x7f8b180ad230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:28.951 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.923+0000 7f8b1659c640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8b18151a70 0x7f8b18154f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:28.951 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.923+0000 7ff2332ad640 1 -- 172.21.15.73:0/622623881 wait complete. 2023-12-12T09:43:28.951 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.923+0000 7f8b15d9b640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f8b180acdd0 0x7f8b180ad230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.73:43208/0 (socket says 172.21.15.73:43208) 2023-12-12T09:43:28.952 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.923+0000 7f8b15d9b640 1 -- 172.21.15.73:0/2329595532 learned_addr learned my addr 172.21.15.73:0/2329595532 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:43:28.952 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.923+0000 7f9079457640 1 --2- 172.21.15.73:0/258930463 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f907406ddd0 0x7f90741471f0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f906c02c5c0 tx=0x7f906c004a70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:43:28.952 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.923+0000 7f8b15d9b640 1 -- 172.21.15.73:0/2329595532 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8b18151a70 msgr2=0x7f8b18154f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:43:28.952 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.923+0000 7fc203a7c640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc1fc0c0af0 0x7fc1fc14df10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:28.952 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.923+0000 7fc203a7c640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc1fc0c4a40 0x7fc1fc0a5280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:28.953 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.923+0000 7fc203a7c640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc1fc1513f0 0x7fc1fc0a57c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:28.953 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.922+0000 7fc61a2bb640 1 -- 172.21.15.73:0/720337399 wait complete. 2023-12-12T09:43:28.953 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.923+0000 7f8b15d9b640 1 --2- 172.21.15.73:0/2329595532 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8b18151a70 0x7f8b18154f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:28.953 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.923+0000 7f8b15d9b640 1 -- 172.21.15.73:0/2329595532 >> v1:172.21.15.73:6789/0 conn(0x7f8b180c8150 legacy=0x7f8b180c8590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:28.953 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.923+0000 7f8b15d9b640 1 -- 172.21.15.73:0/2329595532 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b180c9920 con 0x7f8b180acdd0 2023-12-12T09:43:28.954 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.923+0000 7fc203a7c640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1fc0a8f80 con 0x7fc1fc0c4a40 2023-12-12T09:43:28.954 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.923+0000 7fc203a7c640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1fc1f26d0 con 0x7fc1fc0c0af0 2023-12-12T09:43:28.954 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.923+0000 7fc203a7c640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1fc1f29b0 con 0x7fc1fc1513f0 2023-12-12T09:43:28.954 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.924+0000 7feabeffd640 1 -- 172.21.15.73:0/843963753 <== mon.1 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7feab400a9e0 con 0x7feac0151960 2023-12-12T09:43:28.954 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.924+0000 7f9069ffb640 1 -- 172.21.15.73:0/258930463 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f906c0099b0 con 0x7f907406ddd0 2023-12-12T09:43:28.955 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.924+0000 7fc202019640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc1fc1513f0 0x7fc1fc0a57c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:28.955 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.924+0000 7f907b6bb640 1 -- 172.21.15.73:0/258930463 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90741495b0 con 0x7f907406ddd0 2023-12-12T09:43:28.955 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.924+0000 7f9069ffb640 1 -- 172.21.15.73:0/258930463 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f906c004680 con 0x7f907406ddd0 2023-12-12T09:43:28.955 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.924+0000 7f907b6bb640 1 -- 172.21.15.73:0/258930463 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90740bf7b0 con 0x7f907406ddd0 2023-12-12T09:43:28.955 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.924+0000 7f9069ffb640 1 -- 172.21.15.73:0/258930463 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f906c03e450 con 0x7f907406ddd0 2023-12-12T09:43:28.956 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.924+0000 7fc202019640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc1fc1513f0 0x7fc1fc0a57c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.73:33536/0 (socket says 172.21.15.73:33536) 2023-12-12T09:43:28.956 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.924+0000 7fc202019640 1 -- 172.21.15.73:0/422897117 learned_addr learned my addr 172.21.15.73:0/422897117 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:43:28.956 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.925+0000 7f8b1659c640 1 --2- 172.21.15.73:0/2329595532 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8b18151a70 0x7f8b18154f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-12T09:43:28.957 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.924+0000 7fc201017640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc1fc0c4a40 0x7fc1fc0a5280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:28.957 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.924+0000 7fc201818640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc1fc0c0af0 0x7fc1fc14df10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:28.957 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.925+0000 7f9eaf2cf640 1 Processor -- start 2023-12-12T09:43:28.957 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.925+0000 7f9eaf2cf640 1 -- start start 2023-12-12T09:43:28.958 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.925+0000 7feabeffd640 1 --2- 172.21.15.73:0/843963753 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7feaac06ae90 0x7feaac06d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:28.958 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.925+0000 7f8b15d9b640 1 --2- 172.21.15.73:0/2329595532 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8b180acdd0 0x7f8b180ad230 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f8b0c009870 tx=0x7f8b0c02b880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3fdcf8e2893cdf6d server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:43:28.958 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.926+0000 7f907b6bb640 1 -- 172.21.15.73:0/258930463 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f90740c0870 con 0x7f907406ddd0 2023-12-12T09:43:28.959 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.926+0000 7fc202019640 1 -- 172.21.15.73:0/422897117 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc1fc0c0af0 msgr2=0x7fc1fc14df10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:28.959 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.926+0000 7f978a490640 1 Processor -- start 2023-12-12T09:43:28.959 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.925+0000 7ff2332ad640 1 Processor -- start 2023-12-12T09:43:28.959 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.926+0000 7feabeffd640 1 -- 172.21.15.73:0/843963753 <== mon.1 v2:172.21.15.142:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7feab4089220 con 0x7feac0151960 2023-12-12T09:43:28.960 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.926+0000 7fc202019640 1 --2- 172.21.15.73:0/422897117 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc1fc0c0af0 0x7fc1fc14df10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:28.960 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.926+0000 7fc202019640 1 -- 172.21.15.73:0/422897117 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc1fc0c4a40 msgr2=0x7fc1fc0a5280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:28.960 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.926+0000 7fc202019640 1 --2- 172.21.15.73:0/422897117 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc1fc0c4a40 0x7fc1fc0a5280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:28.960 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.926+0000 7feabeffd640 1 --2- 172.21.15.73:0/843963753 >> [v2:172.21.15.73:6800/4047810203,v1:172.21.15.73:6801/4047810203] conn(0x7feaac0730b0 0x7feaac0754d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:28.960 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.926+0000 7fc202019640 1 -- 172.21.15.73:0/422897117 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1f8009df0 con 0x7fc1fc1513f0 2023-12-12T09:43:28.961 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.926+0000 7f8b1559a640 1 -- 172.21.15.73:0/2329595532 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b0c0317e0 con 0x7f8b180acdd0 2023-12-12T09:43:28.961 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.926+0000 7feabeffd640 1 -- 172.21.15.73:0/843963753 --> [v2:172.21.15.73:6800/4047810203,v1:172.21.15.73:6801/4047810203] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7feaac075b80 con 0x7feaac0730b0 2023-12-12T09:43:28.961 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.926+0000 7f8b1559a640 1 -- 172.21.15.73:0/2329595532 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b0c031940 con 0x7f8b180acdd0 2023-12-12T09:43:28.962 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.926+0000 7feabeffd640 1 -- 172.21.15.73:0/843963753 <== mon.1 v2:172.21.15.142:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7feab40896c0 con 0x7feac0151960 2023-12-12T09:43:28.962 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.927+0000 7f8b1559a640 1 -- 172.21.15.73:0/2329595532 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b0c031d10 con 0x7f8b180acdd0 2023-12-12T09:43:28.963 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.926+0000 7feac6cc2640 1 --2- 172.21.15.73:0/843963753 >> [v2:172.21.15.73:6800/4047810203,v1:172.21.15.73:6801/4047810203] conn(0x7feaac0730b0 0x7feaac0754d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:28.963 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.927+0000 7feac64c1640 1 --2- 172.21.15.73:0/843963753 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7feaac06ae90 0x7feaac06d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:28.963 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.927+0000 7fc202019640 1 --2- 172.21.15.73:0/422897117 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc1fc1513f0 0x7fc1fc0a57c0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fc1f800b300 tx=0x7fc1f80046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:43:28.963 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.927+0000 7f8b1cb33640 1 -- 172.21.15.73:0/2329595532 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8b180acdd0 msgr2=0x7f8b180ad230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:28.963 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.927+0000 7f8b1cb33640 1 --2- 172.21.15.73:0/2329595532 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8b180acdd0 0x7f8b180ad230 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f8b0c009870 tx=0x7f8b0c02b880 comp rx=0 tx=0).stop 2023-12-12T09:43:28.964 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.927+0000 7fc61a2bb640 1 Processor -- start 2023-12-12T09:43:28.964 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.926+0000 7f978a490640 1 -- start start 2023-12-12T09:43:28.964 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.928+0000 7f8b1cb33640 1 -- 172.21.15.73:0/2329595532 shutdown_connections 2023-12-12T09:43:28.964 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.928+0000 7f8b1cb33640 1 --2- 172.21.15.73:0/2329595532 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8b180acdd0 0x7f8b180ad230 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:28.964 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.928+0000 7f8b1cb33640 1 --2- 172.21.15.73:0/2329595532 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8b18151a70 0x7f8b18154f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:28.964 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.928+0000 7f8b1cb33640 1 -- 172.21.15.73:0/2329595532 >> 172.21.15.73:0/2329595532 conn(0x7f8b180abcb0 msgr2=0x7f8b180ac0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:43:28.965 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.928+0000 7fc1f27fc640 1 -- 172.21.15.73:0/422897117 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1f8007210 con 0x7fc1fc1513f0 2023-12-12T09:43:28.965 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.928+0000 7fc1f27fc640 1 -- 172.21.15.73:0/422897117 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1f8007390 con 0x7fc1fc1513f0 2023-12-12T09:43:28.965 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.928+0000 7fc1f27fc640 1 -- 172.21.15.73:0/422897117 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1f8007740 con 0x7fc1fc1513f0 2023-12-12T09:43:28.965 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.928+0000 7f9eaf2cf640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f9ea80ad230 0x7f9ea80c8860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:28.965 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.928+0000 7f9eaf2cf640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ea80c7cc0 con 0x7f9ea80acdd0 2023-12-12T09:43:28.965 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.928+0000 7f9eaf2cf640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ea80c9c00 con 0x7f9ea8151a70 2023-12-12T09:43:28.965 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.928+0000 7f9eaf2cf640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ea80ad6a0 con 0x7f9ea80ad230 2023-12-12T09:43:28.966 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.928+0000 7feac6cc2640 1 --2- 172.21.15.73:0/843963753 >> [v2:172.21.15.73:6800/4047810203,v1:172.21.15.73:6801/4047810203] conn(0x7feaac0730b0 0x7feaac0754d0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:43:28.966 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.928+0000 7feac64c1640 1 --2- 172.21.15.73:0/843963753 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7feaac06ae90 0x7feaac06d350 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7feab002bd90 tx=0x7feab0030000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:43:28.967 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.928+0000 7fc203a7c640 1 -- 172.21.15.73:0/422897117 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1fc0a88c0 con 0x7fc1fc1513f0 2023-12-12T09:43:28.967 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.928+0000 7fc203a7c640 1 -- 172.21.15.73:0/422897117 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1fc14e450 con 0x7fc1fc1513f0 2023-12-12T09:43:28.967 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.928+0000 7ff2332ad640 1 -- start start 2023-12-12T09:43:28.967 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.929+0000 7f9eac86a640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f9ea80acdd0 0x7f9ea80c8150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:34314/0 (socket says 172.21.15.73:34314) 2023-12-12T09:43:28.967 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.929+0000 7f9eac86a640 1 -- 172.21.15.73:0/607053246 learned_addr learned my addr 172.21.15.73:0/607053246 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-12T09:43:28.967 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.929+0000 7f8b1cb33640 1 -- 172.21.15.73:0/2329595532 shutdown_connections 2023-12-12T09:43:28.968 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.928+0000 7fc61a2bb640 1 -- start start 2023-12-12T09:43:28.968 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.927+0000 7f978a490640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9770003970 0x7f97840ab590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:28.968 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.927+0000 7f978a490640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9784159c20 0x7f9784070d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:28.968 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.927+0000 7f978a490640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f978414b3c0 0x7f978414b870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:28.968 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.927+0000 7f978a490640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f978414af30 con 0x7f9784159c20 2023-12-12T09:43:28.968 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.927+0000 7f978a490640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9784150720 con 0x7f978414b3c0 2023-12-12T09:43:28.968 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.927+0000 7f978a490640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f978414ac30 con 0x7f9770003970 2023-12-12T09:43:28.968 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.928+0000 7f9783fff640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9770003970 0x7f97840ab590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:28.969 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.928+0000 7f9783fff640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9770003970 0x7f97840ab590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.73:33538/0 (socket says 172.21.15.73:33538) 2023-12-12T09:43:28.969 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.928+0000 7f9783fff640 1 -- 172.21.15.73:0/3784900625 learned_addr learned my addr 172.21.15.73:0/3784900625 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:43:28.969 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.929+0000 7f9783fff640 1 -- 172.21.15.73:0/3784900625 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f978414b3c0 msgr2=0x7f978414b870 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-12T09:43:28.969 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.929+0000 7f9783fff640 1 --2- 172.21.15.73:0/3784900625 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f978414b3c0 0x7f978414b870 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:28.969 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.929+0000 7f9783fff640 1 -- 172.21.15.73:0/3784900625 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9784159c20 msgr2=0x7f9784070d90 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-12T09:43:28.969 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.929+0000 7f9e9ffff640 1 -- 172.21.15.73:0/607053246 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3381718784 0 0) 0x7f9ea80c7cc0 con 0x7f9ea80acdd0 2023-12-12T09:43:28.969 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.929+0000 7f9e9ffff640 1 -- 172.21.15.73:0/607053246 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9e94003520 con 0x7f9ea80acdd0 2023-12-12T09:43:28.969 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.929+0000 7f9ead86c640 1 --2- 172.21.15.73:0/607053246 >> v2:172.21.15.142:3300/0 conn(0x7f9ea80ad230 0x7f9ea80c8860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:28.970 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.930+0000 7fc203a7c640 1 -- 172.21.15.73:0/422897117 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fc1fc0c3b30 con 0x7fc1fc1513f0 2023-12-12T09:43:28.970 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.930+0000 7f9069ffb640 1 -- 172.21.15.73:0/258930463 <== mon.2 v2:172.21.15.142:3301/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f906c03e5b0 con 0x7f907406ddd0 2023-12-12T09:43:28.970 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.930+0000 7f977b7fe640 1 --2- 172.21.15.73:0/3784900625 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9784159c20 0x7f9784070d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:28.971 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.930+0000 7f9783fff640 1 --2- 172.21.15.73:0/3784900625 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9784159c20 0x7f9784070d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:28.971 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.930+0000 7f9e9ffff640 1 -- 172.21.15.73:0/607053246 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3364088556 0 0) 0x7f9ea80c9c00 con 0x7f9ea8151a70 2023-12-12T09:43:28.971 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.930+0000 7f9e9ffff640 1 -- 172.21.15.73:0/607053246 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9ea80c7cc0 con 0x7f9ea8151a70 2023-12-12T09:43:28.971 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.930+0000 7f9e9ffff640 1 -- 172.21.15.73:0/607053246 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2686014370 0 0) 0x7f9e94003520 con 0x7f9ea80acdd0 2023-12-12T09:43:28.971 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.930+0000 7f9e9ffff640 1 -- 172.21.15.73:0/607053246 >> v2:172.21.15.142:3300/0 conn(0x7f9ea80ad230 msgr2=0x7f9ea80c8860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:43:28.972 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.930+0000 7f9e9ffff640 1 --2- 172.21.15.73:0/607053246 >> v2:172.21.15.142:3300/0 conn(0x7f9ea80ad230 0x7f9ea80c8860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:28.972 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.930+0000 7f9e9ffff640 1 -- 172.21.15.73:0/607053246 >> v1:172.21.15.142:6789/0 conn(0x7f9ea8151a70 legacy=0x7f9ea8154f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:28.972 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.930+0000 7f9e9ffff640 1 -- 172.21.15.73:0/607053246 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ea80c9920 con 0x7f9ea80acdd0 2023-12-12T09:43:28.972 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.930+0000 7f9e9ffff640 1 -- 172.21.15.73:0/607053246 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3186547832 0 0) 0x7f9e98001670 con 0x7f9ea80acdd0 2023-12-12T09:43:28.972 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.930+0000 7fc61a2bb640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc60c02bff0 0x7fc60c046480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:28.972 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.930+0000 7f9783fff640 1 -- 172.21.15.73:0/3784900625 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97840aa3c0 con 0x7f9770003970 2023-12-12T09:43:28.973 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.930+0000 7f977b7fe640 1 --2- 172.21.15.73:0/3784900625 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9784159c20 0x7f9784070d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:43:28.973 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.930+0000 7ff2332ad640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff2240064a0 0x7ff2240e01a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:28.973 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.930+0000 7ff2332ad640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff224049fa0 0x7ff2240cc7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:28.973 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.930+0000 7fc61a2bb640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc60c0d46a0 0x7fc60c0ce810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:28.974 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.930+0000 7fc61a2bb640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc60c0d71c0 0x7fc60c0da9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:28.974 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.930+0000 7fc61a2bb640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc60c045600 con 0x7fc60c0d71c0 2023-12-12T09:43:28.974 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.930+0000 7fc61a2bb640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc60c0444b0 con 0x7fc60c0d46a0 2023-12-12T09:43:28.974 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.930+0000 7fc61a2bb640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc60c177db0 con 0x7fc60c02bff0 2023-12-12T09:43:28.974 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.930+0000 7f9e9ffff640 1 -- 172.21.15.73:0/607053246 >> v1:172.21.15.73:6789/0 conn(0x7f9ea80acdd0 legacy=0x7f9ea80c8150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:28.974 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.930+0000 7f9e9ffff640 1 --2- 172.21.15.73:0/607053246 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9e94003b30 0x7f9e94003f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:28.974 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.930+0000 7f9e9ffff640 1 --2- 172.21.15.73:0/607053246 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9e940047c0 0x7f9e94004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:28.974 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.930+0000 7f9e9ffff640 1 --2- 172.21.15.73:0/607053246 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9e940051d0 0x7f9e9400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:28.974 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.930+0000 7f9e9ffff640 1 -- 172.21.15.73:0/607053246 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ea80ad6a0 con 0x7f9e940051d0 2023-12-12T09:43:28.975 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.930+0000 7f9e9ffff640 1 -- 172.21.15.73:0/607053246 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e9400c100 con 0x7f9e94003b30 2023-12-12T09:43:28.975 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.930+0000 7f9e9ffff640 1 -- 172.21.15.73:0/607053246 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e9400c2c0 con 0x7f9e940047c0 2023-12-12T09:43:28.975 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.930+0000 7f9783fff640 1 --2- 172.21.15.73:0/3784900625 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9770003970 0x7f97840ab590 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f976c000c00 tx=0x7f976c004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:43:28.975 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.929+0000 7f8b1cb33640 1 -- 172.21.15.73:0/2329595532 wait complete. 2023-12-12T09:43:28.976 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.931+0000 7ff2332ad640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff2240d8790 0x7ff224177e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:28.976 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.931+0000 7feabeffd640 1 -- 172.21.15.73:0/843963753 <== osd.0 v2:172.21.15.73:6800/4047810203 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7feaac075b80 con 0x7feaac0730b0 2023-12-12T09:43:28.976 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.931+0000 7fc6137fe640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc60c0d46a0 0x7fc60c0ce810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:28.977 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.931+0000 7f9ead06b640 1 --2- 172.21.15.73:0/607053246 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9e94003b30 0x7f9e94003f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:28.977 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.931+0000 7ff2332ad640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2240de490 con 0x7ff224049fa0 2023-12-12T09:43:28.977 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.931+0000 7fc6137fe640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc60c0d46a0 0x7fc60c0ce810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.73:43244/0 (socket says 172.21.15.73:43244) 2023-12-12T09:43:28.977 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.931+0000 7fc6137fe640 1 -- 172.21.15.73:0/4186125441 learned_addr learned my addr 172.21.15.73:0/4186125441 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:43:28.977 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.931+0000 7fc618858640 1 --2- 172.21.15.73:0/4186125441 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc60c0d71c0 0x7fc60c0da9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:28.978 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.931+0000 7ff2332ad640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff224034030 con 0x7ff2240064a0 2023-12-12T09:43:28.978 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.931+0000 7ff2332ad640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2240ccce0 con 0x7ff2240d8790 2023-12-12T09:43:28.978 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.931+0000 7ff231049640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff2240064a0 0x7ff2240e01a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:28.978 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.931+0000 7ff231049640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff2240064a0 0x7ff2240e01a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.73:43260/0 (socket says 172.21.15.73:43260) 2023-12-12T09:43:28.979 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.931+0000 7f97817fa640 1 -- 172.21.15.73:0/3784900625 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f976c003810 con 0x7f9770003970 2023-12-12T09:43:28.979 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.931+0000 7ff231049640 1 -- 172.21.15.73:0/926210600 learned_addr learned my addr 172.21.15.73:0/926210600 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:43:28.979 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.932+0000 7ff230848640 1 --2- 172.21.15.73:0/926210600 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff224049fa0 0x7ff2240cc7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:28.980 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.932+0000 7f978a490640 1 -- 172.21.15.73:0/3784900625 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97840aa6a0 con 0x7f9770003970 2023-12-12T09:43:28.980 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.932+0000 7fc613fff640 1 --2- 172.21.15.73:0/4186125441 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc60c02bff0 0x7fc60c046480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:28.980 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.932+0000 7f97817fa640 1 -- 172.21.15.73:0/3784900625 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f976c003970 con 0x7f9770003970 2023-12-12T09:43:28.981 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.932+0000 7fc6137fe640 1 -- 172.21.15.73:0/4186125441 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc60c02bff0 msgr2=0x7fc60c046480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:28.981 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.932+0000 7ff23184a640 1 --2- 172.21.15.73:0/926210600 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff2240d8790 0x7ff224177e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:28.981 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.932+0000 7f97817fa640 1 -- 172.21.15.73:0/3784900625 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f976c003d20 con 0x7f9770003970 2023-12-12T09:43:28.981 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.932+0000 7fc6137fe640 1 --2- 172.21.15.73:0/4186125441 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc60c02bff0 0x7fc60c046480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:28.982 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.932+0000 7fc6137fe640 1 -- 172.21.15.73:0/4186125441 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc60c0d71c0 msgr2=0x7fc60c0da9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:28.982 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.932+0000 7f9ead86c640 1 --2- 172.21.15.73:0/607053246 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9e940051d0 0x7f9e9400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:28.982 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.932+0000 7f8b1cb33640 1 Processor -- start 2023-12-12T09:43:28.982 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.932+0000 7f978a490640 1 -- 172.21.15.73:0/3784900625 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97840aa980 con 0x7f9770003970 2023-12-12T09:43:28.983 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.932+0000 7f9ead06b640 1 -- 172.21.15.73:0/607053246 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9e940047c0 msgr2=0x7f9e94004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:43:28.983 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.932+0000 7f9ead06b640 1 --2- 172.21.15.73:0/607053246 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9e940047c0 0x7f9e94004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:28.983 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.932+0000 7f9ead06b640 1 -- 172.21.15.73:0/607053246 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9e940051d0 msgr2=0x7f9e9400b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:43:28.983 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.932+0000 7f9ead06b640 1 --2- 172.21.15.73:0/607053246 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9e940051d0 0x7f9e9400b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:28.983 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.932+0000 7f9ead06b640 1 -- 172.21.15.73:0/607053246 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ea80c9920 con 0x7f9e94003b30 2023-12-12T09:43:28.984 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.931+0000 7f9069ffb640 1 --2- 172.21.15.73:0/258930463 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f905806ae40 0x7f905806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:28.984 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.931+0000 7f9069ffb640 1 -- 172.21.15.73:0/258930463 <== mon.2 v2:172.21.15.142:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f906c0ac5b0 con 0x7f907406ddd0 2023-12-12T09:43:28.984 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.931+0000 7f9069ffb640 1 --2- 172.21.15.73:0/258930463 >> [v2:172.21.15.73:6816/1228903316,v1:172.21.15.73:6817/1228903316] conn(0x7f9058073060 0x7f9058075480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:28.984 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.931+0000 7f9069ffb640 1 -- 172.21.15.73:0/258930463 --> [v2:172.21.15.73:6816/1228903316,v1:172.21.15.73:6817/1228903316] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f9058075b30 con 0x7f9058073060 2023-12-12T09:43:28.984 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.931+0000 7f9069ffb640 1 -- 172.21.15.73:0/258930463 <== mon.2 v2:172.21.15.142:3301/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7f906c0ac960 con 0x7f907406ddd0 2023-12-12T09:43:28.984 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.933+0000 7ff230848640 1 -- 172.21.15.73:0/926210600 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff2240d8790 msgr2=0x7ff224177e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:28.984 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.933+0000 7ff230848640 1 --2- 172.21.15.73:0/926210600 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff2240d8790 0x7ff224177e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:28.985 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.933+0000 7ff230848640 1 -- 172.21.15.73:0/926210600 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff2240064a0 msgr2=0x7ff2240e01a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:28.985 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.933+0000 7f9ead86c640 1 -- 172.21.15.73:0/607053246 reap_dead start 2023-12-12T09:43:28.985 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.932+0000 7fc6137fe640 1 --2- 172.21.15.73:0/4186125441 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc60c0d71c0 0x7fc60c0da9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:28.985 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.932+0000 7fc6137fe640 1 -- 172.21.15.73:0/4186125441 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc600009400 con 0x7fc60c0d46a0 2023-12-12T09:43:28.985 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.933+0000 7fc618858640 1 --2- 172.21.15.73:0/4186125441 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc60c0d71c0 0x7fc60c0da9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-12T09:43:28.986 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.933+0000 7ff230848640 1 --2- 172.21.15.73:0/926210600 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff2240064a0 0x7ff2240e01a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:28.986 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.933+0000 7f9078c56640 1 --2- 172.21.15.73:0/258930463 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f905806ae40 0x7f905806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:28.986 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.933+0000 7ff230848640 1 -- 172.21.15.73:0/926210600 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff22c04f730 con 0x7ff224049fa0 2023-12-12T09:43:28.987 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.933+0000 7f978a490640 1 -- 172.21.15.73:0/3784900625 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f97840c0e30 con 0x7f9770003970 2023-12-12T09:43:28.987 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.933+0000 7ff231049640 1 --2- 172.21.15.73:0/926210600 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff2240064a0 0x7ff2240e01a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-12T09:43:28.987 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.933+0000 7f8b1cb33640 1 -- start start 2023-12-12T09:43:28.988 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.934+0000 7ff230848640 1 --2- 172.21.15.73:0/926210600 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff224049fa0 0x7ff2240cc7a0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7ff21c00c5e0 tx=0x7ff21c00caa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:43:28.988 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.934+0000 7fc6137fe640 1 --2- 172.21.15.73:0/4186125441 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc60c0d46a0 0x7fc60c0ce810 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fc600034040 tx=0x7fc6000046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:43:28.988 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.934+0000 7fc610ff9640 1 -- 172.21.15.73:0/4186125441 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc600032980 con 0x7fc60c0d46a0 2023-12-12T09:43:28.988 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.934+0000 7fc61a2bb640 1 -- 172.21.15.73:0/4186125441 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc60c0ced50 con 0x7fc60c0d46a0 2023-12-12T09:43:28.988 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.934+0000 7f9078c56640 1 --2- 172.21.15.73:0/258930463 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f905806ae40 0x7f905806d300 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f907406da80 tx=0x7f9064008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:43:28.989 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.934+0000 7fc1f27fc640 1 -- 172.21.15.73:0/422897117 <== mon.2 v2:172.21.15.142:3301/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fc1f803e450 con 0x7fc1fc1513f0 2023-12-12T09:43:28.989 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.934+0000 7fc61a2bb640 1 -- 172.21.15.73:0/4186125441 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc60c0441d0 con 0x7fc60c0d46a0 2023-12-12T09:43:28.989 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.935+0000 7ff221ffb640 1 -- 172.21.15.73:0/926210600 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff21c011800 con 0x7ff224049fa0 2023-12-12T09:43:28.989 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.935+0000 7ff221ffb640 1 -- 172.21.15.73:0/926210600 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff21c011960 con 0x7ff224049fa0 2023-12-12T09:43:28.990 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.935+0000 7ff221ffb640 1 -- 172.21.15.73:0/926210600 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff21c011d30 con 0x7ff224049fa0 2023-12-12T09:43:28.990 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.935+0000 7f9ead06b640 1 --2- 172.21.15.73:0/607053246 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9e94003b30 0x7f9e94003f10 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f9ea40018e0 tx=0x7f9e940057f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f096308766432696 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:43:28.990 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.935+0000 7f9079c58640 1 --2- 172.21.15.73:0/258930463 >> [v2:172.21.15.73:6816/1228903316,v1:172.21.15.73:6817/1228903316] conn(0x7f9058073060 0x7f9058075480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:28.991 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.935+0000 7ff2332ad640 1 -- 172.21.15.73:0/926210600 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff224034820 con 0x7ff224049fa0 2023-12-12T09:43:28.991 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.935+0000 7f9079c58640 1 --2- 172.21.15.73:0/258930463 >> [v2:172.21.15.73:6816/1228903316,v1:172.21.15.73:6817/1228903316] conn(0x7f9058073060 0x7f9058075480 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:43:28.991 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.935+0000 7fc1f27fc640 1 --2- 172.21.15.73:0/422897117 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fc1e006af10 0x7fc1e006d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:28.991 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.936+0000 7fc1f27fc640 1 -- 172.21.15.73:0/422897117 <== mon.2 v2:172.21.15.142:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc1f80ac380 con 0x7fc1fc1513f0 2023-12-12T09:43:28.991 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.936+0000 7fc1f27fc640 1 --2- 172.21.15.73:0/422897117 >> [v2:172.21.15.73:6808/1293329670,v1:172.21.15.73:6809/1293329670] conn(0x7fc1e0073130 0x7fc1e0075550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:28.992 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.936+0000 7fc1f27fc640 1 -- 172.21.15.73:0/422897117 --> [v2:172.21.15.73:6808/1293329670,v1:172.21.15.73:6809/1293329670] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fc1e0075c00 con 0x7fc1e0073130 2023-12-12T09:43:28.992 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.936+0000 7fc1f27fc640 1 -- 172.21.15.73:0/422897117 <== mon.2 v2:172.21.15.142:3301/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc1f80ac730 con 0x7fc1fc1513f0 2023-12-12T09:43:28.992 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.935+0000 7ff2332ad640 1 -- 172.21.15.73:0/926210600 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff224034540 con 0x7ff224049fa0 2023-12-12T09:43:28.992 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.935+0000 7fc610ff9640 1 -- 172.21.15.73:0/4186125441 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc600032ae0 con 0x7fc60c0d46a0 2023-12-12T09:43:28.992 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.935+0000 7fc610ff9640 1 -- 172.21.15.73:0/4186125441 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc600032e90 con 0x7fc60c0d46a0 2023-12-12T09:43:28.993 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.936+0000 7fc61a2bb640 1 -- 172.21.15.73:0/4186125441 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fc5f4000fc0 con 0x7fc60c0d46a0 2023-12-12T09:43:28.993 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.935+0000 7f8b1cb33640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8b180acdd0 0x7f8b181edd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:28.993 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.935+0000 7f8b1cb33640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8b180c8150 0x7f8b18150050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:28.993 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.935+0000 7f8b1cb33640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8b18151a70 0x7f8b181471e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:28.993 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.935+0000 7f8b1cb33640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b181ee2f0 con 0x7f8b180acdd0 2023-12-12T09:43:28.993 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.935+0000 7f8b1cb33640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b18155880 con 0x7f8b18151a70 2023-12-12T09:43:28.993 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.935+0000 7f8b1cb33640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b180c3a70 con 0x7f8b180c8150 2023-12-12T09:43:28.994 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.935+0000 7f9e9ffff640 1 -- 172.21.15.73:0/607053246 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ea4032610 con 0x7f9e94003b30 2023-12-12T09:43:28.994 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.935+0000 7f9e9ffff640 1 -- 172.21.15.73:0/607053246 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ea4032770 con 0x7f9e94003b30 2023-12-12T09:43:28.994 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.936+0000 7f9e9ffff640 1 -- 172.21.15.73:0/607053246 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ea4032b40 con 0x7f9e94003b30 2023-12-12T09:43:28.994 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.936+0000 7fc201818640 1 --2- 172.21.15.73:0/422897117 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fc1e006af10 0x7fc1e006d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:28.994 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.937+0000 7f97817fa640 1 -- 172.21.15.73:0/3784900625 <== mon.2 v2:172.21.15.142:3301/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f976c03b070 con 0x7f9770003970 2023-12-12T09:43:28.995 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.937+0000 7f8b15d9b640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8b180c8150 0x7f8b18150050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:28.995 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.937+0000 7f8b1659c640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8b180acdd0 0x7f8b181edd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:28.995 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.937+0000 7f8b1659c640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8b180acdd0 0x7f8b181edd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:56618/0 (socket says 172.21.15.73:56618) 2023-12-12T09:43:28.995 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.937+0000 7f8b1659c640 1 -- 172.21.15.73:0/1113574542 learned_addr learned my addr 172.21.15.73:0/1113574542 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:43:28.995 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.937+0000 7f9eaf2cf640 1 -- 172.21.15.73:0/607053246 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9e94003b30 msgr2=0x7f9e94003f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:28.995 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.937+0000 7f9eaf2cf640 1 --2- 172.21.15.73:0/607053246 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9e94003b30 0x7f9e94003f10 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f9ea40018e0 tx=0x7f9e940057f0 comp rx=0 tx=0).stop 2023-12-12T09:43:28.996 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.937+0000 7fc201017640 1 --2- 172.21.15.73:0/422897117 >> [v2:172.21.15.73:6808/1293329670,v1:172.21.15.73:6809/1293329670] conn(0x7fc1e0073130 0x7fc1e0075550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:28.996 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.937+0000 7f8b1659c640 1 -- 172.21.15.73:0/1113574542 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8b180c8150 msgr2=0x7f8b18150050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:28.996 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.937+0000 7f8b1659c640 1 --2- 172.21.15.73:0/1113574542 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8b180c8150 0x7f8b18150050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:28.996 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.937+0000 7f8b16d9d640 1 --2- 172.21.15.73:0/1113574542 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8b18151a70 0x7f8b181471e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:28.996 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.937+0000 7f8b1659c640 1 -- 172.21.15.73:0/1113574542 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8b18151a70 msgr2=0x7f8b181471e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:28.996 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.937+0000 7f8b1659c640 1 --2- 172.21.15.73:0/1113574542 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8b18151a70 0x7f8b181471e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:28.996 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.937+0000 7f8b1659c640 1 -- 172.21.15.73:0/1113574542 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b08009400 con 0x7f8b180acdd0 2023-12-12T09:43:28.996 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.938+0000 7f8b16d9d640 1 --2- 172.21.15.73:0/1113574542 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8b18151a70 0x7f8b181471e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:43:28.997 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.938+0000 7ff2332ad640 1 -- 172.21.15.73:0/926210600 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7ff20c000fc0 con 0x7ff224049fa0 2023-12-12T09:43:28.997 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.938+0000 7f9069ffb640 1 -- 172.21.15.73:0/258930463 <== osd.2 v2:172.21.15.73:6816/1228903316 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f9058075b30 con 0x7f9058073060 2023-12-12T09:43:28.997 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.938+0000 7fc201818640 1 --2- 172.21.15.73:0/422897117 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fc1e006af10 0x7fc1e006d3d0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fc1f4001d40 tx=0x7fc1f4009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:43:28.998 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.938+0000 7f8b15d9b640 1 --2- 172.21.15.73:0/1113574542 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8b180c8150 0x7f8b18150050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-12T09:43:28.998 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.938+0000 7f8b1659c640 1 --2- 172.21.15.73:0/1113574542 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8b180acdd0 0x7f8b181edd10 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f8b0800e960 tx=0x7f8b0800ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:43:28.998 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.939+0000 7f97817fa640 1 --2- 172.21.15.73:0/3784900625 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f976406ae40 0x7f976406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:28.999 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.938+0000 7f9eaf2cf640 1 -- 172.21.15.73:0/607053246 shutdown_connections 2023-12-12T09:43:28.999 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.938+0000 7f9eaf2cf640 1 --2- 172.21.15.73:0/607053246 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9e94003b30 0x7f9e94003f10 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:28.999 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.938+0000 7f9eaf2cf640 1 -- 172.21.15.73:0/607053246 >> 172.21.15.73:0/607053246 conn(0x7f9ea80abcb0 msgr2=0x7f9ea80ac0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:43:28.999 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.939+0000 7f97817fa640 1 -- 172.21.15.73:0/3784900625 <== mon.2 v2:172.21.15.142:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f976c0ab780 con 0x7f9770003970 2023-12-12T09:43:28.999 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.939+0000 7f97817fa640 1 --2- 172.21.15.73:0/3784900625 >> [v2:172.21.15.73:6822/1356058331,v1:172.21.15.73:6824/1356058331] conn(0x7f9764073060 0x7f9764075480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:28.999 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.939+0000 7f97817fa640 1 -- 172.21.15.73:0/3784900625 --> [v2:172.21.15.73:6822/1356058331,v1:172.21.15.73:6824/1356058331] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f9764075b30 con 0x7f9764073060 2023-12-12T09:43:28.999 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.939+0000 7f97817fa640 1 -- 172.21.15.73:0/3784900625 <== mon.2 v2:172.21.15.142:3301/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7f976c0abb30 con 0x7f9770003970 2023-12-12T09:43:29.000 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.939+0000 7fc610ff9640 1 -- 172.21.15.73:0/4186125441 <== mon.1 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fc60003b3f0 con 0x7fc60c0d46a0 2023-12-12T09:43:29.000 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.939+0000 7f9eaf2cf640 1 -- 172.21.15.73:0/607053246 shutdown_connections 2023-12-12T09:43:29.000 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.939+0000 7fc201017640 1 --2- 172.21.15.73:0/422897117 >> [v2:172.21.15.73:6808/1293329670,v1:172.21.15.73:6809/1293329670] conn(0x7fc1e0073130 0x7fc1e0075550 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:43:29.001 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.939+0000 7f8b06ffd640 1 -- 172.21.15.73:0/1113574542 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b0800ca00 con 0x7f8b180acdd0 2023-12-12T09:43:29.001 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.939+0000 7f8b06ffd640 1 -- 172.21.15.73:0/1113574542 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b0800cb60 con 0x7f8b180acdd0 2023-12-12T09:43:29.001 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.939+0000 7f8b06ffd640 1 -- 172.21.15.73:0/1113574542 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b0800ced0 con 0x7f8b180acdd0 2023-12-12T09:43:29.001 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.939+0000 7f8b1cb33640 1 -- 172.21.15.73:0/1113574542 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b0c0094d0 con 0x7f8b180acdd0 2023-12-12T09:43:29.001 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.940+0000 7f977b7fe640 1 --2- 172.21.15.73:0/3784900625 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f976406ae40 0x7f976406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:29.001 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.939+0000 7f9eaf2cf640 1 -- 172.21.15.73:0/607053246 wait complete. 2023-12-12T09:43:29.002 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.941+0000 7f8b1cb33640 1 -- 172.21.15.73:0/1113574542 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b18157610 con 0x7f8b180acdd0 2023-12-12T09:43:29.002 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.941+0000 7fc610ff9640 1 --2- 172.21.15.73:0/4186125441 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fc5f806ae40 0x7fc5f806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:29.002 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.941+0000 7f977b7fe640 1 --2- 172.21.15.73:0/3784900625 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f976406ae40 0x7f976406d300 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f9774001120 tx=0x7f9774009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:43:29.003 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.941+0000 7fc610ff9640 1 -- 172.21.15.73:0/4186125441 <== mon.1 v2:172.21.15.142:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc6000ab850 con 0x7fc60c0d46a0 2023-12-12T09:43:29.003 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.942+0000 7f9788a2d640 1 --2- 172.21.15.73:0/3784900625 >> [v2:172.21.15.73:6822/1356058331,v1:172.21.15.73:6824/1356058331] conn(0x7f9764073060 0x7f9764075480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:29.003 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.942+0000 7fc610ff9640 1 --2- 172.21.15.73:0/4186125441 >> [v2:172.21.15.142:6817/2353193632,v1:172.21.15.142:6819/2353193632] conn(0x7fc5f8072ef0 0x7fc5f8075310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:29.003 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.942+0000 7fc613fff640 1 --2- 172.21.15.73:0/4186125441 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fc5f806ae40 0x7fc5f806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:29.003 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.942+0000 7fc610ff9640 1 -- 172.21.15.73:0/4186125441 --> [v2:172.21.15.142:6817/2353193632,v1:172.21.15.142:6819/2353193632] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fc5f80759c0 con 0x7fc5f8072ef0 2023-12-12T09:43:29.004 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.942+0000 7f8b1cb33640 1 -- 172.21.15.73:0/1113574542 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f8b18067800 con 0x7f8b180acdd0 2023-12-12T09:43:29.004 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.942+0000 7fc610ff9640 1 -- 172.21.15.73:0/4186125441 <== mon.1 v2:172.21.15.142:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc6000abc00 con 0x7fc60c0d46a0 2023-12-12T09:43:29.004 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.942+0000 7f9eaf2cf640 1 Processor -- start 2023-12-12T09:43:29.005 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.942+0000 7ff221ffb640 1 -- 172.21.15.73:0/926210600 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7ff21c01a450 con 0x7ff224049fa0 2023-12-12T09:43:29.005 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.942+0000 7f9eaf2cf640 1 -- start start 2023-12-12T09:43:29.005 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.942+0000 7fc1f27fc640 1 -- 172.21.15.73:0/422897117 <== osd.3 v2:172.21.15.73:6808/1293329670 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7fc1e0075c00 con 0x7fc1e0073130 2023-12-12T09:43:29.006 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.943+0000 7fc618858640 1 --2- 172.21.15.73:0/4186125441 >> [v2:172.21.15.142:6817/2353193632,v1:172.21.15.142:6819/2353193632] conn(0x7fc5f8072ef0 0x7fc5f8075310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:29.006 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.943+0000 7f9788a2d640 1 --2- 172.21.15.73:0/3784900625 >> [v2:172.21.15.73:6822/1356058331,v1:172.21.15.73:6824/1356058331] conn(0x7f9764073060 0x7f9764075480 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:43:29.006 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.943+0000 7fc613fff640 1 --2- 172.21.15.73:0/4186125441 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fc5f806ae40 0x7fc5f806d300 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fc608004ea0 tx=0x7fc608009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:43:29.006 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.944+0000 7ff221ffb640 1 --2- 172.21.15.73:0/926210600 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7ff21006af10 0x7ff21006d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:29.007 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.944+0000 7f9eaf2cf640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9e94003b30 0x7f9ea8157bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:29.007 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.944+0000 7f9eaf2cf640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9ea81587a0 0x7f9ea81ef5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:29.007 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.944+0000 7f9eaf2cf640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9ea81efb20 0x7f9ea81f1370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:29.007 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.944+0000 7f9eaf2cf640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ea80c8da0 con 0x7f9ea81efb20 2023-12-12T09:43:29.007 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.944+0000 7f9eaf2cf640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ea806e1f0 con 0x7f9e94003b30 2023-12-12T09:43:29.007 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.944+0000 7f9eaf2cf640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ea81506b0 con 0x7f9ea81587a0 2023-12-12T09:43:29.008 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.944+0000 7ff221ffb640 1 -- 172.21.15.73:0/926210600 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff21c0898b0 con 0x7ff224049fa0 2023-12-12T09:43:29.008 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.945+0000 7ff221ffb640 1 --2- 172.21.15.73:0/926210600 >> [v2:172.21.15.142:6800/3727975702,v1:172.21.15.142:6801/3727975702] conn(0x7ff210073130 0x7ff210075550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:29.008 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.945+0000 7ff221ffb640 1 -- 172.21.15.73:0/926210600 --> [v2:172.21.15.142:6800/3727975702,v1:172.21.15.142:6801/3727975702] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7ff210075c00 con 0x7ff210073130 2023-12-12T09:43:29.008 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.945+0000 7ff221ffb640 1 -- 172.21.15.73:0/926210600 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff21c08e2a0 con 0x7ff224049fa0 2023-12-12T09:43:29.008 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.944+0000 7fc618858640 1 --2- 172.21.15.73:0/4186125441 >> [v2:172.21.15.142:6817/2353193632,v1:172.21.15.142:6819/2353193632] conn(0x7fc5f8072ef0 0x7fc5f8075310 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:43:29.008 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.945+0000 7f9ead06b640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9e94003b30 0x7f9ea8157bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:29.009 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.945+0000 7f9ead86c640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9ea81efb20 0x7f9ea81f1370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:29.009 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.945+0000 7f8b06ffd640 1 -- 172.21.15.73:0/1113574542 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f8b08013470 con 0x7f8b180acdd0 2023-12-12T09:43:29.009 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.945+0000 7f97817fa640 1 -- 172.21.15.73:0/3784900625 <== osd.1 v2:172.21.15.73:6822/1356058331 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f9764075b30 con 0x7f9764073060 2023-12-12T09:43:29.010 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.945+0000 7f9eac86a640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9ea81587a0 0x7f9ea81ef5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:29.010 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.945+0000 7f9eac86a640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9ea81587a0 0x7f9ea81ef5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.73:33608/0 (socket says 172.21.15.73:33608) 2023-12-12T09:43:29.010 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.945+0000 7f9eac86a640 1 -- 172.21.15.73:0/2230386892 learned_addr learned my addr 172.21.15.73:0/2230386892 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:43:29.010 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.945+0000 7ff231049640 1 --2- 172.21.15.73:0/926210600 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7ff21006af10 0x7ff21006d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:29.010 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.946+0000 7ff23184a640 1 --2- 172.21.15.73:0/926210600 >> [v2:172.21.15.142:6800/3727975702,v1:172.21.15.142:6801/3727975702] conn(0x7ff210073130 0x7ff210075550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:29.010 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.946+0000 7f9ead86c640 1 -- 172.21.15.73:0/2230386892 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9ea81587a0 msgr2=0x7f9ea81ef5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:29.011 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.946+0000 7ff231049640 1 --2- 172.21.15.73:0/926210600 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7ff21006af10 0x7ff21006d3d0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7ff228007fd0 tx=0x7ff228007d80 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:43:29.011 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.947+0000 7f8b06ffd640 1 --2- 172.21.15.73:0/1113574542 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f8af806ae90 0x7f8af806d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:29.012 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.947+0000 7f9ead86c640 1 --2- 172.21.15.73:0/2230386892 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9ea81587a0 0x7f9ea81ef5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:29.012 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.947+0000 7f9ead86c640 1 -- 172.21.15.73:0/2230386892 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9e94003b30 msgr2=0x7f9ea8157bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:29.012 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.947+0000 7f9ead86c640 1 --2- 172.21.15.73:0/2230386892 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9e94003b30 0x7f9ea8157bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:29.012 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.947+0000 7f9ead86c640 1 -- 172.21.15.73:0/2230386892 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ea806ec70 con 0x7f9ea81efb20 2023-12-12T09:43:29.012 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.947+0000 7f9eac86a640 1 --2- 172.21.15.73:0/2230386892 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9ea81587a0 0x7f9ea81ef5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-12T09:43:29.012 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.947+0000 7ff23184a640 1 --2- 172.21.15.73:0/926210600 >> [v2:172.21.15.142:6800/3727975702,v1:172.21.15.142:6801/3727975702] conn(0x7ff210073130 0x7ff210075550 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:43:29.013 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.947+0000 7fc610ff9640 1 -- 172.21.15.73:0/4186125441 <== osd.5 v2:172.21.15.142:6817/2353193632 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7fc5f80759c0 con 0x7fc5f8072ef0 2023-12-12T09:43:29.013 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.947+0000 7f8b06ffd640 1 -- 172.21.15.73:0/1113574542 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8b08089a50 con 0x7f8b180acdd0 2023-12-12T09:43:29.013 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.947+0000 7f8b15d9b640 1 --2- 172.21.15.73:0/1113574542 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f8af806ae90 0x7f8af806d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:29.013 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.947+0000 7f9ead86c640 1 --2- 172.21.15.73:0/2230386892 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9ea81efb20 0x7f9ea81f1370 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f9ea80c7390 tx=0x7f9ea00115a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:43:29.014 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.948+0000 7f8b06ffd640 1 --2- 172.21.15.73:0/1113574542 >> [v2:172.21.15.142:6804/2006111986,v1:172.21.15.142:6806/2006111986] conn(0x7f8af8072f40 0x7f8af8075360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:29.014 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.948+0000 7f8b06ffd640 1 -- 172.21.15.73:0/1113574542 --> [v2:172.21.15.142:6804/2006111986,v1:172.21.15.142:6806/2006111986] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f8af8075a10 con 0x7f8af8072f40 2023-12-12T09:43:29.014 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.948+0000 7f8b06ffd640 1 -- 172.21.15.73:0/1113574542 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8b08089ef0 con 0x7f8b180acdd0 2023-12-12T09:43:29.014 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.948+0000 7f9e9dffb640 1 -- 172.21.15.73:0/2230386892 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ea000e070 con 0x7f9ea81efb20 2023-12-12T09:43:29.015 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.948+0000 7f8b15d9b640 1 --2- 172.21.15.73:0/1113574542 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f8af806ae90 0x7f8af806d350 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f8b0c036000 tx=0x7f8b0c03d040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:43:29.015 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.948+0000 7f9e9dffb640 1 -- 172.21.15.73:0/2230386892 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ea0011e10 con 0x7f9ea81efb20 2023-12-12T09:43:29.015 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.948+0000 7f9e9dffb640 1 -- 172.21.15.73:0/2230386892 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ea0003990 con 0x7f9ea81efb20 2023-12-12T09:43:29.015 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.950+0000 7ff221ffb640 1 -- 172.21.15.73:0/926210600 <== osd.4 v2:172.21.15.142:6800/3727975702 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7ff210075c00 con 0x7ff210073130 2023-12-12T09:43:29.016 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.950+0000 7f8b16d9d640 1 --2- 172.21.15.73:0/1113574542 >> [v2:172.21.15.142:6804/2006111986,v1:172.21.15.142:6806/2006111986] conn(0x7f8af8072f40 0x7f8af8075360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:29.016 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.949+0000 7f9eaf2cf640 1 -- 172.21.15.73:0/2230386892 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ea80aa3e0 con 0x7f9ea81efb20 2023-12-12T09:43:29.016 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.949+0000 7f9eaf2cf640 1 -- 172.21.15.73:0/2230386892 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ea806e6b0 con 0x7f9ea81efb20 2023-12-12T09:43:29.016 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.951+0000 7f8b16d9d640 1 --2- 172.21.15.73:0/1113574542 >> [v2:172.21.15.142:6804/2006111986,v1:172.21.15.142:6806/2006111986] conn(0x7f8af8072f40 0x7f8af8075360 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:43:29.017 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.951+0000 7f9eaf2cf640 1 -- 172.21.15.73:0/2230386892 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f9e88000fc0 con 0x7f9ea81efb20 2023-12-12T09:43:29.017 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.954+0000 7f9e9dffb640 1 -- 172.21.15.73:0/2230386892 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f9ea0003af0 con 0x7f9ea81efb20 2023-12-12T09:43:29.017 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.954+0000 7f8b06ffd640 1 -- 172.21.15.73:0/1113574542 <== osd.6 v2:172.21.15.142:6804/2006111986 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f8af8075a10 con 0x7f8af8072f40 2023-12-12T09:43:29.018 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.955+0000 7f9e9dffb640 1 --2- 172.21.15.73:0/2230386892 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f9e8c06ae90 0x7f9e8c06d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:29.018 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.956+0000 7f9e9dffb640 1 -- 172.21.15.73:0/2230386892 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9ea0059760 con 0x7f9ea81efb20 2023-12-12T09:43:29.018 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.956+0000 7f9ead06b640 1 --2- 172.21.15.73:0/2230386892 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f9e8c06ae90 0x7f9e8c06d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:29.018 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.956+0000 7f9e9dffb640 1 --2- 172.21.15.73:0/2230386892 >> [v2:172.21.15.142:6816/2573794341,v1:172.21.15.142:6818/2573794341] conn(0x7f9e8c073d90 0x7f9e8c076230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:29.018 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.956+0000 7f9e9dffb640 1 -- 172.21.15.73:0/2230386892 --> [v2:172.21.15.142:6816/2573794341,v1:172.21.15.142:6818/2573794341] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f9e8c076900 con 0x7f9e8c073d90 2023-12-12T09:43:29.018 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.956+0000 7f9e9dffb640 1 -- 172.21.15.73:0/2230386892 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9ea0059530 con 0x7f9ea81efb20 2023-12-12T09:43:29.018 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.957+0000 7f9eac86a640 1 --2- 172.21.15.73:0/2230386892 >> [v2:172.21.15.142:6816/2573794341,v1:172.21.15.142:6818/2573794341] conn(0x7f9e8c073d90 0x7f9e8c076230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:29.018 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.958+0000 7f9ead06b640 1 --2- 172.21.15.73:0/2230386892 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f9e8c06ae90 0x7f9e8c06d350 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f9ea4036000 tx=0x7f9ea4009030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:43:29.018 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.958+0000 7f9eac86a640 1 --2- 172.21.15.73:0/2230386892 >> [v2:172.21.15.142:6816/2573794341,v1:172.21.15.142:6818/2573794341] conn(0x7f9e8c073d90 0x7f9e8c076230 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:43:29.019 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.960+0000 7feac74c3640 1 -- 172.21.15.73:0/843963753 --> [v2:172.21.15.73:6800/4047810203,v1:172.21.15.73:6801/4047810203] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7feac00c9110 con 0x7feaac0730b0 2023-12-12T09:43:29.019 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.961+0000 7f9e9dffb640 1 -- 172.21.15.73:0/2230386892 <== osd.7 v2:172.21.15.142:6816/2573794341 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f9e8c076900 con 0x7f9e8c073d90 2023-12-12T09:43:29.019 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.961+0000 7feabeffd640 1 -- 172.21.15.73:0/843963753 <== osd.0 v2:172.21.15.73:6800/4047810203 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7feab800bac0 con 0x7feaac0730b0 2023-12-12T09:43:29.020 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.962+0000 7feac74c3640 1 -- 172.21.15.73:0/843963753 >> [v2:172.21.15.73:6800/4047810203,v1:172.21.15.73:6801/4047810203] conn(0x7feaac0730b0 msgr2=0x7feaac0754d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:29.021 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.962+0000 7feac74c3640 1 --2- 172.21.15.73:0/843963753 >> [v2:172.21.15.73:6800/4047810203,v1:172.21.15.73:6801/4047810203] conn(0x7feaac0730b0 0x7feaac0754d0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:29.021 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.966+0000 7feac74c3640 1 -- 172.21.15.73:0/843963753 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7feaac06ae90 msgr2=0x7feaac06d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:29.021 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.966+0000 7feac74c3640 1 --2- 172.21.15.73:0/843963753 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7feaac06ae90 0x7feaac06d350 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7feab002bd90 tx=0x7feab0030000 comp rx=0 tx=0).stop 2023-12-12T09:43:29.021 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.966+0000 7feac74c3640 1 -- 172.21.15.73:0/843963753 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7feac0151960 msgr2=0x7feac0148220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:29.021 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.966+0000 7feac74c3640 1 --2- 172.21.15.73:0/843963753 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7feac0151960 0x7feac0148220 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7feab400c780 tx=0x7feab400cc40 comp rx=0 tx=0).stop 2023-12-12T09:43:29.021 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.966+0000 7feac6cc2640 1 -- 172.21.15.73:0/843963753 reap_dead start 2023-12-12T09:43:29.021 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.966+0000 7feac74c3640 1 -- 172.21.15.73:0/843963753 shutdown_connections 2023-12-12T09:43:29.021 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.966+0000 7feac74c3640 1 -- 172.21.15.73:0/843963753 >> 172.21.15.73:0/843963753 conn(0x7feac0071df0 msgr2=0x7feac00721d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:43:29.021 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.966+0000 7feac74c3640 1 -- 172.21.15.73:0/843963753 shutdown_connections 2023-12-12T09:43:29.021 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.966+0000 7feac74c3640 1 -- 172.21.15.73:0/843963753 wait complete. 2023-12-12T09:43:29.022 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.968+0000 7f907b6bb640 1 -- 172.21.15.73:0/258930463 --> [v2:172.21.15.73:6816/1228903316,v1:172.21.15.73:6817/1228903316] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f90740c0b50 con 0x7f9058073060 2023-12-12T09:43:29.022 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.969+0000 7f9069ffb640 1 -- 172.21.15.73:0/258930463 <== osd.2 v2:172.21.15.73:6816/1228903316 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f90700012c0 con 0x7f9058073060 2023-12-12T09:43:29.022 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.973+0000 7f907b6bb640 1 -- 172.21.15.73:0/258930463 >> [v2:172.21.15.73:6816/1228903316,v1:172.21.15.73:6817/1228903316] conn(0x7f9058073060 msgr2=0x7f9058075480 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:29.022 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.973+0000 7f907b6bb640 1 --2- 172.21.15.73:0/258930463 >> [v2:172.21.15.73:6816/1228903316,v1:172.21.15.73:6817/1228903316] conn(0x7f9058073060 0x7f9058075480 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:29.022 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.973+0000 7fc203a7c640 1 -- 172.21.15.73:0/422897117 --> [v2:172.21.15.73:6808/1293329670,v1:172.21.15.73:6809/1293329670] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fc1fc06bcd0 con 0x7fc1e0073130 2023-12-12T09:43:29.023 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.973+0000 7f907b6bb640 1 -- 172.21.15.73:0/258930463 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f905806ae40 msgr2=0x7f905806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:29.023 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.973+0000 7f907b6bb640 1 --2- 172.21.15.73:0/258930463 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f905806ae40 0x7f905806d300 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f907406da80 tx=0x7f9064008040 comp rx=0 tx=0).stop 2023-12-12T09:43:29.023 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.973+0000 7f907b6bb640 1 -- 172.21.15.73:0/258930463 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f907406ddd0 msgr2=0x7f90741471f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:29.023 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.973+0000 7f907b6bb640 1 --2- 172.21.15.73:0/258930463 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f907406ddd0 0x7f90741471f0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f906c02c5c0 tx=0x7f906c004a70 comp rx=0 tx=0).stop 2023-12-12T09:43:29.023 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.973+0000 7f9079c58640 1 -- 172.21.15.73:0/258930463 reap_dead start 2023-12-12T09:43:29.023 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.974+0000 7f978a490640 1 -- 172.21.15.73:0/3784900625 --> [v2:172.21.15.73:6822/1356058331,v1:172.21.15.73:6824/1356058331] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f9784067580 con 0x7f9764073060 2023-12-12T09:43:29.024 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.974+0000 7f907b6bb640 1 -- 172.21.15.73:0/258930463 shutdown_connections 2023-12-12T09:43:29.024 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.974+0000 7f907b6bb640 1 -- 172.21.15.73:0/258930463 >> 172.21.15.73:0/258930463 conn(0x7f90740a7760 msgr2=0x7f9074073310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:43:29.024 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.974+0000 7f907b6bb640 1 -- 172.21.15.73:0/258930463 shutdown_connections 2023-12-12T09:43:29.024 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.974+0000 7f907b6bb640 1 -- 172.21.15.73:0/258930463 wait complete. 2023-12-12T09:43:29.024 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.974+0000 7fc1f27fc640 1 -- 172.21.15.73:0/422897117 <== osd.3 v2:172.21.15.73:6808/1293329670 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fc1ec001400 con 0x7fc1e0073130 2023-12-12T09:43:29.024 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.975+0000 7f97817fa640 1 -- 172.21.15.73:0/3784900625 <== osd.1 v2:172.21.15.73:6822/1356058331 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f9784067580 con 0x7f9764073060 2023-12-12T09:43:29.025 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.975+0000 7fc203a7c640 1 -- 172.21.15.73:0/422897117 >> [v2:172.21.15.73:6808/1293329670,v1:172.21.15.73:6809/1293329670] conn(0x7fc1e0073130 msgr2=0x7fc1e0075550 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:29.025 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.975+0000 7fc203a7c640 1 --2- 172.21.15.73:0/422897117 >> [v2:172.21.15.73:6808/1293329670,v1:172.21.15.73:6809/1293329670] conn(0x7fc1e0073130 0x7fc1e0075550 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:29.025 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.975+0000 7f978a490640 1 -- 172.21.15.73:0/3784900625 >> [v2:172.21.15.73:6822/1356058331,v1:172.21.15.73:6824/1356058331] conn(0x7f9764073060 msgr2=0x7f9764075480 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:29.026 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.975+0000 7f978a490640 1 --2- 172.21.15.73:0/3784900625 >> [v2:172.21.15.73:6822/1356058331,v1:172.21.15.73:6824/1356058331] conn(0x7f9764073060 0x7f9764075480 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:29.026 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.976+0000 7f978a490640 1 -- 172.21.15.73:0/3784900625 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f976406ae40 msgr2=0x7f976406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:29.026 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.976+0000 7f978a490640 1 --2- 172.21.15.73:0/3784900625 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f976406ae40 0x7f976406d300 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f9774001120 tx=0x7f9774009040 comp rx=0 tx=0).stop 2023-12-12T09:43:29.026 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.975+0000 7fc203a7c640 1 -- 172.21.15.73:0/422897117 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fc1e006af10 msgr2=0x7fc1e006d3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:29.026 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.975+0000 7fc203a7c640 1 --2- 172.21.15.73:0/422897117 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fc1e006af10 0x7fc1e006d3d0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fc1f4001d40 tx=0x7fc1f4009040 comp rx=0 tx=0).stop 2023-12-12T09:43:29.026 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.975+0000 7fc203a7c640 1 -- 172.21.15.73:0/422897117 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc1fc1513f0 msgr2=0x7fc1fc0a57c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:29.026 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.975+0000 7fc203a7c640 1 --2- 172.21.15.73:0/422897117 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc1fc1513f0 0x7fc1fc0a57c0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fc1f800b300 tx=0x7fc1f80046c0 comp rx=0 tx=0).stop 2023-12-12T09:43:29.026 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.975+0000 7fc202019640 1 -- 172.21.15.73:0/422897117 reap_dead start 2023-12-12T09:43:29.026 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.976+0000 7fc203a7c640 1 -- 172.21.15.73:0/422897117 shutdown_connections 2023-12-12T09:43:29.027 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.976+0000 7fc203a7c640 1 -- 172.21.15.73:0/422897117 >> 172.21.15.73:0/422897117 conn(0x7fc1fc0a77d0 msgr2=0x7fc1fc0a7bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:43:29.027 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.976+0000 7fc203a7c640 1 -- 172.21.15.73:0/422897117 shutdown_connections 2023-12-12T09:43:29.027 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.976+0000 7fc203a7c640 1 -- 172.21.15.73:0/422897117 wait complete. 2023-12-12T09:43:29.027 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.976+0000 7f978a490640 1 -- 172.21.15.73:0/3784900625 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9770003970 msgr2=0x7f97840ab590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:29.027 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.976+0000 7f978a490640 1 --2- 172.21.15.73:0/3784900625 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9770003970 0x7f97840ab590 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f976c000c00 tx=0x7f976c004730 comp rx=0 tx=0).stop 2023-12-12T09:43:29.027 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.976+0000 7f9788a2d640 1 -- 172.21.15.73:0/3784900625 reap_dead start 2023-12-12T09:43:29.027 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.976+0000 7f978a490640 1 -- 172.21.15.73:0/3784900625 shutdown_connections 2023-12-12T09:43:29.027 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.976+0000 7f978a490640 1 -- 172.21.15.73:0/3784900625 >> 172.21.15.73:0/3784900625 conn(0x7f97840a77d0 msgr2=0x7f9784155490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:43:29.027 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.976+0000 7f978a490640 1 -- 172.21.15.73:0/3784900625 shutdown_connections 2023-12-12T09:43:29.027 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.976+0000 7f978a490640 1 -- 172.21.15.73:0/3784900625 wait complete. 2023-12-12T09:43:29.028 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.982+0000 7ff2332ad640 1 -- 172.21.15.73:0/926210600 --> [v2:172.21.15.142:6800/3727975702,v1:172.21.15.142:6801/3727975702] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7ff20c002cb0 con 0x7ff210073130 2023-12-12T09:43:29.028 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.986+0000 7fc61a2bb640 1 -- 172.21.15.73:0/4186125441 --> [v2:172.21.15.142:6817/2353193632,v1:172.21.15.142:6819/2353193632] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fc5f4002cb0 con 0x7fc5f8072ef0 2023-12-12T09:43:29.028 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.987+0000 7ff221ffb640 1 -- 172.21.15.73:0/926210600 <== osd.4 v2:172.21.15.142:6800/3727975702 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7ff20c002cb0 con 0x7ff210073130 2023-12-12T09:43:29.028 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.987+0000 7f8b1cb33640 1 -- 172.21.15.73:0/1113574542 --> [v2:172.21.15.142:6804/2006111986,v1:172.21.15.142:6806/2006111986] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f8b18067b10 con 0x7f8af8072f40 2023-12-12T09:43:29.029 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.988+0000 7ff2177fe640 1 -- 172.21.15.73:0/926210600 >> [v2:172.21.15.142:6800/3727975702,v1:172.21.15.142:6801/3727975702] conn(0x7ff210073130 msgr2=0x7ff210075550 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:29.029 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.988+0000 7ff2177fe640 1 --2- 172.21.15.73:0/926210600 >> [v2:172.21.15.142:6800/3727975702,v1:172.21.15.142:6801/3727975702] conn(0x7ff210073130 0x7ff210075550 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:29.029 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.988+0000 7fc610ff9640 1 -- 172.21.15.73:0/4186125441 <== osd.5 v2:172.21.15.142:6817/2353193632 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fc5f4002cb0 con 0x7fc5f8072ef0 2023-12-12T09:43:29.030 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.989+0000 7fc61a2bb640 1 -- 172.21.15.73:0/4186125441 >> [v2:172.21.15.142:6817/2353193632,v1:172.21.15.142:6819/2353193632] conn(0x7fc5f8072ef0 msgr2=0x7fc5f8075310 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:29.030 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.989+0000 7fc61a2bb640 1 --2- 172.21.15.73:0/4186125441 >> [v2:172.21.15.142:6817/2353193632,v1:172.21.15.142:6819/2353193632] conn(0x7fc5f8072ef0 0x7fc5f8075310 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:29.030 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.989+0000 7fc61a2bb640 1 -- 172.21.15.73:0/4186125441 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fc5f806ae40 msgr2=0x7fc5f806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:29.030 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.989+0000 7fc61a2bb640 1 --2- 172.21.15.73:0/4186125441 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fc5f806ae40 0x7fc5f806d300 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fc608004ea0 tx=0x7fc608009040 comp rx=0 tx=0).stop 2023-12-12T09:43:29.031 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.989+0000 7fc61a2bb640 1 -- 172.21.15.73:0/4186125441 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc60c0d46a0 msgr2=0x7fc60c0ce810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:29.031 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.989+0000 7fc61a2bb640 1 --2- 172.21.15.73:0/4186125441 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc60c0d46a0 0x7fc60c0ce810 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fc600034040 tx=0x7fc6000046c0 comp rx=0 tx=0).stop 2023-12-12T09:43:29.031 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.989+0000 7fc618858640 1 -- 172.21.15.73:0/4186125441 reap_dead start 2023-12-12T09:43:29.031 INFO:teuthology.orchestra.run.smithi073.stdout:55834574854 2023-12-12T09:43:29.032 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-12-12T09:43:29.032 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.990+0000 7ff2177fe640 1 -- 172.21.15.73:0/926210600 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7ff21006af10 msgr2=0x7ff21006d3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:29.032 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.990+0000 7ff2177fe640 1 --2- 172.21.15.73:0/926210600 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7ff21006af10 0x7ff21006d3d0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7ff228007fd0 tx=0x7ff228007d80 comp rx=0 tx=0).stop 2023-12-12T09:43:29.033 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.990+0000 7f8b06ffd640 1 -- 172.21.15.73:0/1113574542 <== osd.6 v2:172.21.15.142:6804/2006111986 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f8b18067b10 con 0x7f8af8072f40 2023-12-12T09:43:29.033 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.990+0000 7ff2177fe640 1 -- 172.21.15.73:0/926210600 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff224049fa0 msgr2=0x7ff2240cc7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:29.033 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.990+0000 7ff2177fe640 1 --2- 172.21.15.73:0/926210600 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff224049fa0 0x7ff2240cc7a0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7ff21c00c5e0 tx=0x7ff21c00caa0 comp rx=0 tx=0).stop 2023-12-12T09:43:29.033 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.990+0000 7ff23184a640 1 -- 172.21.15.73:0/926210600 reap_dead start 2023-12-12T09:43:29.033 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.991+0000 7ff2177fe640 1 -- 172.21.15.73:0/926210600 shutdown_connections 2023-12-12T09:43:29.034 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.991+0000 7ff2177fe640 1 -- 172.21.15.73:0/926210600 >> 172.21.15.73:0/926210600 conn(0x7ff22404fc00 msgr2=0x7ff2240d6fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:43:29.034 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.991+0000 7f8b1cb33640 1 -- 172.21.15.73:0/1113574542 >> [v2:172.21.15.142:6804/2006111986,v1:172.21.15.142:6806/2006111986] conn(0x7f8af8072f40 msgr2=0x7f8af8075360 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:29.034 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.991+0000 7f8b1cb33640 1 --2- 172.21.15.73:0/1113574542 >> [v2:172.21.15.142:6804/2006111986,v1:172.21.15.142:6806/2006111986] conn(0x7f8af8072f40 0x7f8af8075360 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:29.034 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.991+0000 7fc61a2bb640 1 -- 172.21.15.73:0/4186125441 shutdown_connections 2023-12-12T09:43:29.034 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.991+0000 7fc61a2bb640 1 -- 172.21.15.73:0/4186125441 >> 172.21.15.73:0/4186125441 conn(0x7fc60c007b10 msgr2=0x7fc60c04bed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:43:29.035 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.991+0000 7f8b1cb33640 1 -- 172.21.15.73:0/1113574542 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f8af806ae90 msgr2=0x7f8af806d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:29.035 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.991+0000 7f8b1cb33640 1 --2- 172.21.15.73:0/1113574542 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f8af806ae90 0x7f8af806d350 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f8b0c036000 tx=0x7f8b0c03d040 comp rx=0 tx=0).stop 2023-12-12T09:43:29.035 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.991+0000 7f8b1cb33640 1 -- 172.21.15.73:0/1113574542 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8b180acdd0 msgr2=0x7f8b181edd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:29.035 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.991+0000 7f8b1cb33640 1 --2- 172.21.15.73:0/1113574542 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8b180acdd0 0x7f8b181edd10 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f8b0800e960 tx=0x7f8b0800ee20 comp rx=0 tx=0).stop 2023-12-12T09:43:29.035 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.991+0000 7f8b16d9d640 1 -- 172.21.15.73:0/1113574542 reap_dead start 2023-12-12T09:43:29.036 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.991+0000 7fc61a2bb640 1 -- 172.21.15.73:0/4186125441 shutdown_connections 2023-12-12T09:43:29.036 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.991+0000 7ff2177fe640 1 -- 172.21.15.73:0/926210600 shutdown_connections 2023-12-12T09:43:29.036 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.991+0000 7fc61a2bb640 1 -- 172.21.15.73:0/4186125441 wait complete. 2023-12-12T09:43:29.036 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.991+0000 7ff2177fe640 1 -- 172.21.15.73:0/926210600 wait complete. 2023-12-12T09:43:29.037 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.992+0000 7f8b1cb33640 1 -- 172.21.15.73:0/1113574542 shutdown_connections 2023-12-12T09:43:29.037 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.992+0000 7f8b1cb33640 1 -- 172.21.15.73:0/1113574542 >> 172.21.15.73:0/1113574542 conn(0x7f8b180abcb0 msgr2=0x7f8b180ac090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:43:29.037 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.992+0000 7f8b1cb33640 1 -- 172.21.15.73:0/1113574542 shutdown_connections 2023-12-12T09:43:29.037 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.992+0000 7f8b1cb33640 1 -- 172.21.15.73:0/1113574542 wait complete. 2023-12-12T09:43:29.037 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.992+0000 7f9eaf2cf640 1 -- 172.21.15.73:0/2230386892 --> [v2:172.21.15.142:6816/2573794341,v1:172.21.15.142:6818/2573794341] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f9e88002cb0 con 0x7f9e8c073d90 2023-12-12T09:43:29.037 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.995+0000 7f9e9dffb640 1 -- 172.21.15.73:0/2230386892 <== osd.7 v2:172.21.15.142:6816/2573794341 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f9e88002cb0 con 0x7f9e8c073d90 2023-12-12T09:43:29.038 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.995+0000 7f9eaf2cf640 1 -- 172.21.15.73:0/2230386892 >> [v2:172.21.15.142:6816/2573794341,v1:172.21.15.142:6818/2573794341] conn(0x7f9e8c073d90 msgr2=0x7f9e8c076230 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:29.039 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.995+0000 7f9eaf2cf640 1 --2- 172.21.15.73:0/2230386892 >> [v2:172.21.15.142:6816/2573794341,v1:172.21.15.142:6818/2573794341] conn(0x7f9e8c073d90 0x7f9e8c076230 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:29.039 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.996+0000 7f9eaf2cf640 1 -- 172.21.15.73:0/2230386892 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f9e8c06ae90 msgr2=0x7f9e8c06d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:29.039 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.996+0000 7f9eaf2cf640 1 --2- 172.21.15.73:0/2230386892 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f9e8c06ae90 0x7f9e8c06d350 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f9ea4036000 tx=0x7f9ea4009030 comp rx=0 tx=0).stop 2023-12-12T09:43:29.039 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.996+0000 7f9eaf2cf640 1 -- 172.21.15.73:0/2230386892 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9ea81efb20 msgr2=0x7f9ea81f1370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:29.039 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.996+0000 7f9eaf2cf640 1 --2- 172.21.15.73:0/2230386892 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9ea81efb20 0x7f9ea81f1370 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f9ea80c7390 tx=0x7f9ea00115a0 comp rx=0 tx=0).stop 2023-12-12T09:43:29.039 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.996+0000 7f9ead86c640 1 -- 172.21.15.73:0/2230386892 reap_dead start 2023-12-12T09:43:29.039 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.996+0000 7f9eaf2cf640 1 -- 172.21.15.73:0/2230386892 shutdown_connections 2023-12-12T09:43:29.039 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.996+0000 7f9eaf2cf640 1 -- 172.21.15.73:0/2230386892 >> 172.21.15.73:0/2230386892 conn(0x7f9ea80abcb0 msgr2=0x7f9ea8152300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:43:29.040 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.996+0000 7f9eaf2cf640 1 -- 172.21.15.73:0/2230386892 shutdown_connections 2023-12-12T09:43:29.040 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:28.996+0000 7f9eaf2cf640 1 -- 172.21.15.73:0/2230386892 wait complete. 2023-12-12T09:43:29.040 INFO:teuthology.orchestra.run.smithi073.stdout:55834574852 2023-12-12T09:43:29.041 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-12-12T09:43:29.043 INFO:teuthology.orchestra.run.smithi073.stdout:55834574852 2023-12-12T09:43:29.043 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-12-12T09:43:29.044 INFO:teuthology.orchestra.run.smithi073.stdout:55834574852 2023-12-12T09:43:29.045 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-12-12T09:43:29.045 INFO:teuthology.orchestra.run.smithi073.stdout:55834574852 2023-12-12T09:43:29.046 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-12-12T09:43:29.046 INFO:teuthology.orchestra.run.smithi073.stdout:55834574854 2023-12-12T09:43:29.047 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-12-12T09:43:29.047 INFO:teuthology.orchestra.run.smithi073.stdout:55834574852 2023-12-12T09:43:29.048 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-12-12T09:43:29.048 INFO:teuthology.orchestra.run.smithi073.stdout:55834574854 2023-12-12T09:43:29.049 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-12-12T09:43:29.370 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.370+0000 7fa9d9ae0640 1 Processor -- start 2023-12-12T09:43:29.372 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.370+0000 7fa9d9ae0640 1 -- start start 2023-12-12T09:43:29.372 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.372+0000 7fa9d9ae0640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fa9d40c4540 0x7fa9d406cbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:29.372 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.372+0000 7fa9d9ae0640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fa9d40c08d0 0x7fa9d414d740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:29.372 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.372+0000 7fa9d9ae0640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9d40c5250 con 0x7fa9d40c04f0 2023-12-12T09:43:29.372 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.372+0000 7fa9d9ae0640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9d40c1d10 con 0x7fa9d40c08d0 2023-12-12T09:43:29.373 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.372+0000 7fa9d9ae0640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9d4154440 con 0x7fa9d40c4540 2023-12-12T09:43:29.373 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.373+0000 7fa9d3fff640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fa9d40c08d0 0x7fa9d414d740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:29.373 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.373+0000 7fa9d3fff640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fa9d40c08d0 0x7fa9d414d740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:56640/0 (socket says 172.21.15.73:56640) 2023-12-12T09:43:29.373 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.374+0000 7fa9d3fff640 1 -- 172.21.15.73:0/250647521 learned_addr learned my addr 172.21.15.73:0/250647521 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:43:29.374 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.374+0000 7fa9d2ffd640 1 --2- 172.21.15.73:0/250647521 >> v2:172.21.15.142:3300/0 conn(0x7fa9d40c4540 0x7fa9d406cbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:29.375 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.375+0000 7fa9d27fc640 1 -- 172.21.15.73:0/250647521 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 655743533 0 0) 0x7fa9d40c5250 con 0x7fa9d40c04f0 2023-12-12T09:43:29.377 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.375+0000 7fa9d3fff640 1 -- 172.21.15.73:0/250647521 >> v2:172.21.15.142:3300/0 conn(0x7fa9d40c4540 msgr2=0x7fa9d406cbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:43:29.377 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.375+0000 7fa9d3fff640 1 --2- 172.21.15.73:0/250647521 >> v2:172.21.15.142:3300/0 conn(0x7fa9d40c4540 0x7fa9d406cbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:29.377 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.375+0000 7fa9d3fff640 1 -- 172.21.15.73:0/250647521 >> v1:172.21.15.142:6789/0 conn(0x7fa9d40c04f0 legacy=0x7fa9d40c3c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:29.377 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.375+0000 7fa9d3fff640 1 -- 172.21.15.73:0/250647521 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9d40c4a40 con 0x7fa9d40c08d0 2023-12-12T09:43:29.377 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.377+0000 7fa9d3fff640 1 --2- 172.21.15.73:0/250647521 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa9d40c08d0 0x7fa9d414d740 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fa9d4151620 tx=0x7fa9cc02b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5bcca86043537228 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:43:29.378 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.378+0000 7fa9d27fc640 1 -- 172.21.15.73:0/250647521 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9cc02d040 con 0x7fa9d40c08d0 2023-12-12T09:43:29.378 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.378+0000 7fa9d27fc640 1 -- 172.21.15.73:0/250647521 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9cc031810 con 0x7fa9d40c08d0 2023-12-12T09:43:29.378 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.378+0000 7fa9d27fc640 1 -- 172.21.15.73:0/250647521 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9cc02d040 con 0x7fa9d40c08d0 2023-12-12T09:43:29.379 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.380+0000 7fa9d9ae0640 1 -- 172.21.15.73:0/250647521 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa9d40c08d0 msgr2=0x7fa9d414d740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:29.380 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.380+0000 7fa9d9ae0640 1 --2- 172.21.15.73:0/250647521 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa9d40c08d0 0x7fa9d414d740 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fa9d4151620 tx=0x7fa9cc02b8b0 comp rx=0 tx=0).stop 2023-12-12T09:43:29.380 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.380+0000 7fa9d9ae0640 1 -- 172.21.15.73:0/250647521 shutdown_connections 2023-12-12T09:43:29.380 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.380+0000 7fa9d9ae0640 1 --2- 172.21.15.73:0/250647521 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa9d40c08d0 0x7fa9d414d740 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:29.380 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.380+0000 7fa9d9ae0640 1 --2- 172.21.15.73:0/250647521 >> v2:172.21.15.142:3300/0 conn(0x7fa9d40c4540 0x7fa9d406cbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:29.380 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.380+0000 7fa9d9ae0640 1 -- 172.21.15.73:0/250647521 >> 172.21.15.73:0/250647521 conn(0x7fa9d40c5900 msgr2=0x7fa9d40c5d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:43:29.381 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.381+0000 7fa9d9ae0640 1 -- 172.21.15.73:0/250647521 shutdown_connections 2023-12-12T09:43:29.381 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.381+0000 7fa9d9ae0640 1 -- 172.21.15.73:0/250647521 wait complete. 2023-12-12T09:43:29.383 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.383+0000 7fa9d9ae0640 1 Processor -- start 2023-12-12T09:43:29.384 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.384+0000 7fa9d9ae0640 1 -- start start 2023-12-12T09:43:29.386 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.386+0000 7fa9d9ae0640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa9d40c04f0 0x7fa9d41dbcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:29.386 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.386+0000 7fa9d9ae0640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa9d40c08d0 0x7fa9d40aa310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:29.386 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.387+0000 7fa9d9ae0640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa9d40c4540 0x7fa9d40aa850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:29.387 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.387+0000 7fa9d3fff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa9d40c4540 0x7fa9d40aa850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:29.387 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.387+0000 7fa9d3fff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa9d40c4540 0x7fa9d40aa850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:56642/0 (socket says 172.21.15.73:56642) 2023-12-12T09:43:29.387 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.387+0000 7fa9d2ffd640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa9d40c08d0 0x7fa9d40aa310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:29.387 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.387+0000 7fa9d2ffd640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa9d40c08d0 0x7fa9d40aa310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.73:33610/0 (socket says 172.21.15.73:33610) 2023-12-12T09:43:29.388 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.388+0000 7fa9d3fff640 1 -- 172.21.15.73:0/229750765 learned_addr learned my addr 172.21.15.73:0/229750765 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:43:29.388 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.388+0000 7fa9d37fe640 1 --2- 172.21.15.73:0/229750765 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa9d40c04f0 0x7fa9d41dbcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:29.388 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.388+0000 7fa9d9ae0640 1 -- 172.21.15.73:0/229750765 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9d41ecb80 con 0x7fa9d40c4540 2023-12-12T09:43:29.388 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.388+0000 7fa9d9ae0640 1 -- 172.21.15.73:0/229750765 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9d41ece60 con 0x7fa9d40c04f0 2023-12-12T09:43:29.388 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.388+0000 7fa9d9ae0640 1 -- 172.21.15.73:0/229750765 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9d41ed140 con 0x7fa9d40c08d0 2023-12-12T09:43:29.389 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.389+0000 7fa9d3fff640 1 -- 172.21.15.73:0/229750765 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa9d40c08d0 msgr2=0x7fa9d40aa310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:29.389 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.389+0000 7fa9d3fff640 1 --2- 172.21.15.73:0/229750765 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa9d40c08d0 0x7fa9d40aa310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:29.389 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.389+0000 7fa9d3fff640 1 -- 172.21.15.73:0/229750765 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa9d40c04f0 msgr2=0x7fa9d41dbcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:29.389 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.389+0000 7fa9d3fff640 1 --2- 172.21.15.73:0/229750765 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa9d40c04f0 0x7fa9d41dbcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:29.389 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.389+0000 7fa9d3fff640 1 -- 172.21.15.73:0/229750765 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9cc0094d0 con 0x7fa9d40c4540 2023-12-12T09:43:29.390 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.391+0000 7fa9d3fff640 1 --2- 172.21.15.73:0/229750765 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa9d40c4540 0x7fa9d40aa850 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fa9cc0090b0 tx=0x7fa9cc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:43:29.391 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.391+0000 7fa3f0dc9640 1 Processor -- start 2023-12-12T09:43:29.391 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.391+0000 7fa3f0dc9640 1 -- start start 2023-12-12T09:43:29.391 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.391+0000 7fa9cbfff640 1 -- 172.21.15.73:0/229750765 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9cc003820 con 0x7fa9d40c4540 2023-12-12T09:43:29.391 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.391+0000 7fa9cbfff640 1 -- 172.21.15.73:0/229750765 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9cc03e070 con 0x7fa9d40c4540 2023-12-12T09:43:29.392 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.391+0000 7fa9cbfff640 1 -- 172.21.15.73:0/229750765 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9cc003be0 con 0x7fa9d40c4540 2023-12-12T09:43:29.393 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.391+0000 7fa9d9ae0640 1 -- 172.21.15.73:0/229750765 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9d41ed420 con 0x7fa9d40c4540 2023-12-12T09:43:29.393 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.392+0000 7fa9d9ae0640 1 -- 172.21.15.73:0/229750765 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9d41dc810 con 0x7fa9d40c4540 2023-12-12T09:43:29.394 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.393+0000 7fa3f0dc9640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fa3ec0c0e70 0x7fa3ec0c5f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:29.394 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.393+0000 7fa3f0dc9640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa3ec0c1250 0x7fa3ec0c16e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:29.394 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.393+0000 7fa3f0dc9640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3ec0c6cc0 con 0x7fa3ec0c6830 2023-12-12T09:43:29.394 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.393+0000 7fa3f0dc9640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3ec0c1c20 con 0x7fa3ec0c0e70 2023-12-12T09:43:29.394 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.393+0000 7fa3f0dc9640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3ec0c3e20 con 0x7fa3ec0c1250 2023-12-12T09:43:29.394 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.394+0000 7fa3eaffd640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7fa3ec0c6830 0x7fa3ec06cf70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:34322/0 (socket says 172.21.15.73:34322) 2023-12-12T09:43:29.394 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.394+0000 7fa3eaffd640 1 -- 172.21.15.73:0/4006183616 learned_addr learned my addr 172.21.15.73:0/4006183616 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-12T09:43:29.394 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.394+0000 7fa3eb7fe640 1 --2- 172.21.15.73:0/4006183616 >> v2:172.21.15.73:3300/0 conn(0x7fa3ec0c0e70 0x7fa3ec0c5f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:29.394 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.394+0000 7fa3ebfff640 1 --2- 172.21.15.73:0/4006183616 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa3ec0c1250 0x7fa3ec0c16e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:29.395 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.394+0000 7f98644e0640 1 Processor -- start 2023-12-12T09:43:29.395 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.395+0000 7f98644e0640 1 -- start start 2023-12-12T09:43:29.395 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.395+0000 7fa9d9ae0640 1 -- 172.21.15.73:0/229750765 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa9d41ed940 con 0x7fa9d40c4540 2023-12-12T09:43:29.396 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.395+0000 7fa3ea7fc640 1 -- 172.21.15.73:0/4006183616 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2421503423 0 0) 0x7fa3ec0c6cc0 con 0x7fa3ec0c6830 2023-12-12T09:43:29.396 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.395+0000 7fa3ea7fc640 1 -- 172.21.15.73:0/4006183616 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa3d4003520 con 0x7fa3ec0c6830 2023-12-12T09:43:29.396 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.395+0000 7fa3eb7fe640 1 -- 172.21.15.73:0/4006183616 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa3ec0c1250 msgr2=0x7fa3ec0c16e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:43:29.396 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.395+0000 7fa3eb7fe640 1 --2- 172.21.15.73:0/4006183616 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa3ec0c1250 0x7fa3ec0c16e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:29.396 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.395+0000 7fa3eb7fe640 1 -- 172.21.15.73:0/4006183616 >> v1:172.21.15.73:6789/0 conn(0x7fa3ec0c6830 legacy=0x7fa3ec06cf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:29.396 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.395+0000 7fa3eb7fe640 1 -- 172.21.15.73:0/4006183616 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3ec06c800 con 0x7fa3ec0c0e70 2023-12-12T09:43:29.398 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.395+0000 7fa9cbfff640 1 -- 172.21.15.73:0/229750765 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fa9cc003d40 con 0x7fa9d40c4540 2023-12-12T09:43:29.398 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.397+0000 7fa9cbfff640 1 --2- 172.21.15.73:0/229750765 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fa9b406aec0 0x7fa9b406d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:29.398 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.397+0000 7fa9cbfff640 1 -- 172.21.15.73:0/229750765 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa9cc0ab240 con 0x7fa9d40c4540 2023-12-12T09:43:29.398 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.397+0000 7fa9d37fe640 1 --2- 172.21.15.73:0/229750765 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fa9b406aec0 0x7fa9b406d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:29.398 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.396+0000 7f98644e0640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f985c0c5090 0x7f985c151860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:29.398 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.397+0000 7f98644e0640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f985c0c0490 0x7f985c154d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:29.398 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.397+0000 7f98644e0640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f985c06d820 con 0x7f985c0c3920 2023-12-12T09:43:29.399 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.397+0000 7f98644e0640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f985c154610 con 0x7f985c0c5090 2023-12-12T09:43:29.399 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.397+0000 7f98644e0640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f985c1548b0 con 0x7f985c0c0490 2023-12-12T09:43:29.399 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.397+0000 7f9862a7d640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f985c0c3920 0x7f985c071cc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:34334/0 (socket says 172.21.15.73:34334) 2023-12-12T09:43:29.399 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.397+0000 7f9862a7d640 1 -- 172.21.15.73:0/3167760143 learned_addr learned my addr 172.21.15.73:0/3167760143 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-12T09:43:29.399 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.397+0000 7f9861a7b640 1 --2- 172.21.15.73:0/3167760143 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f985c0c0490 0x7f985c154d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:29.399 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.397+0000 7f986227c640 1 --2- 172.21.15.73:0/3167760143 >> v2:172.21.15.142:3300/0 conn(0x7f985c0c5090 0x7f985c151860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:29.399 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.398+0000 7fa9d37fe640 1 --2- 172.21.15.73:0/229750765 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fa9b406aec0 0x7fa9b406d380 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fa9bc000f60 tx=0x7fa9bc009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:43:29.399 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.398+0000 7f986227c640 1 -- 172.21.15.73:0/3167760143 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f985c0c0490 msgr2=0x7f985c154d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:43:29.400 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.398+0000 7f986227c640 1 --2- 172.21.15.73:0/3167760143 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f985c0c0490 0x7f985c154d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:29.400 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.398+0000 7f986227c640 1 -- 172.21.15.73:0/3167760143 >> v1:172.21.15.73:6789/0 conn(0x7f985c0c3920 legacy=0x7f985c071cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:29.400 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.398+0000 7f986227c640 1 -- 172.21.15.73:0/3167760143 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f985c06db00 con 0x7f985c0c5090 2023-12-12T09:43:29.400 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.399+0000 7fa3eb7fe640 1 --2- 172.21.15.73:0/4006183616 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa3ec0c0e70 0x7fa3ec0c5f90 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fa3dc0097a0 tx=0x7fa3dc02b710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf57801815da620b server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:43:29.400 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.399+0000 7f458cf3c640 1 Processor -- start 2023-12-12T09:43:29.401 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.400+0000 7f458cf3c640 1 -- start start 2023-12-12T09:43:29.401 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.400+0000 7f986227c640 1 --2- 172.21.15.73:0/3167760143 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f985c0c5090 0x7f985c151860 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f98580097a0 tx=0x7f985802b8b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=56168515e89e1943 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:43:29.401 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.400+0000 7fcd1a07c640 1 Processor -- start 2023-12-12T09:43:29.402 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.401+0000 7f986127a640 1 -- 172.21.15.73:0/3167760143 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f985802d040 con 0x7f985c0c5090 2023-12-12T09:43:29.402 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.401+0000 7f986127a640 1 -- 172.21.15.73:0/3167760143 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9858031810 con 0x7f985c0c5090 2023-12-12T09:43:29.402 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.401+0000 7f986127a640 1 -- 172.21.15.73:0/3167760143 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9858031ba0 con 0x7f985c0c5090 2023-12-12T09:43:29.402 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.401+0000 7fcd1a07c640 1 -- start start 2023-12-12T09:43:29.402 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.401+0000 7f98644e0640 1 -- 172.21.15.73:0/3167760143 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f985c0c5090 msgr2=0x7f985c151860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:29.402 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.401+0000 7f98644e0640 1 --2- 172.21.15.73:0/3167760143 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f985c0c5090 0x7f985c151860 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f98580097a0 tx=0x7f985802b8b0 comp rx=0 tx=0).stop 2023-12-12T09:43:29.403 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.401+0000 7f458cf3c640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4588155480 0x7f458806ee40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:29.403 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.401+0000 7f458cf3c640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f45881587a0 0x7f458806a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:29.403 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.401+0000 7f458cf3c640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45880c1e90 con 0x7f458806aa20 2023-12-12T09:43:29.403 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.402+0000 7f458cf3c640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4588071180 con 0x7f45881587a0 2023-12-12T09:43:29.403 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.402+0000 7f458cf3c640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45880c2430 con 0x7f4588155480 2023-12-12T09:43:29.404 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.402+0000 7f98644e0640 1 -- 172.21.15.73:0/3167760143 shutdown_connections 2023-12-12T09:43:29.404 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.402+0000 7f98644e0640 1 --2- 172.21.15.73:0/3167760143 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f985c0c0490 0x7f985c154d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:29.404 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.402+0000 7f98644e0640 1 --2- 172.21.15.73:0/3167760143 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f985c0c5090 0x7f985c151860 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:29.404 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.402+0000 7f98644e0640 1 -- 172.21.15.73:0/3167760143 >> 172.21.15.73:0/3167760143 conn(0x7f985c0a77d0 msgr2=0x7f985c0a7be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:43:29.404 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.402+0000 7f98644e0640 1 -- 172.21.15.73:0/3167760143 shutdown_connections 2023-12-12T09:43:29.404 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.402+0000 7f98644e0640 1 -- 172.21.15.73:0/3167760143 wait complete. 2023-12-12T09:43:29.404 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.402+0000 7f4585d9b640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f45881587a0 0x7f458806a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:29.404 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.402+0000 7f4585d9b640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f45881587a0 0x7f458806a4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.73:43320/0 (socket says 172.21.15.73:43320) 2023-12-12T09:43:29.405 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.403+0000 7f4585d9b640 1 -- 172.21.15.73:0/3343567176 learned_addr learned my addr 172.21.15.73:0/3343567176 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:43:29.405 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.402+0000 7fcd1a07c640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcd140c47a0 0x7fcd140c4b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:29.405 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.403+0000 7fcd1a07c640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fcd140bd4b0 0x7fcd1406b320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:29.405 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.403+0000 7fcd1a07c640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd141545f0 con 0x7fcd140c7d20 2023-12-12T09:43:29.405 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.403+0000 7fcd1a07c640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd14155270 con 0x7fcd140bd4b0 2023-12-12T09:43:29.405 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.403+0000 7fcd1a07c640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd141548d0 con 0x7fcd140c47a0 2023-12-12T09:43:29.405 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.403+0000 7fcd137fe640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcd140c47a0 0x7fcd140c4b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:29.406 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.403+0000 7fcd0affd640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fcd140bd4b0 0x7fcd1406b320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:29.406 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.403+0000 7fcd0affd640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fcd140bd4b0 0x7fcd1406b320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.73:43334/0 (socket says 172.21.15.73:43334) 2023-12-12T09:43:29.406 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.403+0000 7fcd0affd640 1 -- 172.21.15.73:0/4060683452 learned_addr learned my addr 172.21.15.73:0/4060683452 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:43:29.406 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.403+0000 7f458659c640 1 --2- 172.21.15.73:0/3343567176 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4588155480 0x7f458806ee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:29.406 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.404+0000 7f98644e0640 1 Processor -- start 2023-12-12T09:43:29.407 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.404+0000 7fb51b690640 1 Processor -- start 2023-12-12T09:43:29.407 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.404+0000 7fb51b690640 1 -- start start 2023-12-12T09:43:29.407 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.404+0000 7f98644e0640 1 -- start start 2023-12-12T09:43:29.407 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.404+0000 7fa3ea7fc640 1 -- 172.21.15.73:0/4006183616 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3dc030710 con 0x7fa3ec0c0e70 2023-12-12T09:43:29.408 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.404+0000 7fa3ea7fc640 1 -- 172.21.15.73:0/4006183616 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3dc02e050 con 0x7fa3ec0c0e70 2023-12-12T09:43:29.408 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.404+0000 7fa3ea7fc640 1 -- 172.21.15.73:0/4006183616 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3dc030a90 con 0x7fa3ec0c0e70 2023-12-12T09:43:29.408 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.404+0000 7f458659c640 1 -- 172.21.15.73:0/3343567176 >> v2:172.21.15.142:3300/0 conn(0x7f45881587a0 msgr2=0x7f458806a4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:43:29.408 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.404+0000 7f458659c640 1 --2- 172.21.15.73:0/3343567176 >> v2:172.21.15.142:3300/0 conn(0x7f45881587a0 0x7f458806a4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:29.408 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.404+0000 7fcd137fe640 1 -- 172.21.15.73:0/4060683452 >> v2:172.21.15.142:3300/0 conn(0x7fcd140bd4b0 msgr2=0x7fcd1406b320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:43:29.409 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.404+0000 7fcd137fe640 1 --2- 172.21.15.73:0/4060683452 >> v2:172.21.15.142:3300/0 conn(0x7fcd140bd4b0 0x7fcd1406b320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:29.409 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.404+0000 7fcd137fe640 1 -- 172.21.15.73:0/4060683452 >> v1:172.21.15.73:6789/0 conn(0x7fcd140c7d20 legacy=0x7fcd1406b860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:29.409 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.404+0000 7fcd137fe640 1 -- 172.21.15.73:0/4060683452 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd14154bb0 con 0x7fcd140c47a0 2023-12-12T09:43:29.409 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.405+0000 7fa9cbfff640 1 -- 172.21.15.73:0/229750765 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fa9d41ed940 con 0x7fa9d40c4540 2023-12-12T09:43:29.410 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.405+0000 7f98644e0640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f985c0c3920 0x7f985c0a9b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:29.410 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.406+0000 7f98644e0640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f985c0c5090 0x7f985c143b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:29.410 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.406+0000 7f98644e0640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f985c158660 0x7f985c144080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:29.410 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.406+0000 7f98644e0640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f985c157b30 con 0x7f985c158660 2023-12-12T09:43:29.410 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.406+0000 7f98644e0640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f985c157f50 con 0x7f985c0c5090 2023-12-12T09:43:29.410 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.406+0000 7f98644e0640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f985c0ab700 con 0x7f985c0c3920 2023-12-12T09:43:29.410 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.406+0000 7f9862a7d640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f985c158660 0x7f985c144080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:29.411 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.406+0000 7f9862a7d640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f985c158660 0x7f985c144080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:56662/0 (socket says 172.21.15.73:56662) 2023-12-12T09:43:29.411 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.406+0000 7f9862a7d640 1 -- 172.21.15.73:0/1000036414 learned_addr learned my addr 172.21.15.73:0/1000036414 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:43:29.411 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.406+0000 7f9861a7b640 1 --2- 172.21.15.73:0/1000036414 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f985c0c5090 0x7f985c143b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:29.411 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.404+0000 7f458659c640 1 -- 172.21.15.73:0/3343567176 >> v1:172.21.15.142:6789/0 conn(0x7f458806aa20 legacy=0x7f45880c28c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:43:29.411 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.404+0000 7f458659c640 1 -- 172.21.15.73:0/3343567176 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45880725f0 con 0x7f4588155480 2023-12-12T09:43:29.411 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.406+0000 7f458659c640 1 --2- 172.21.15.73:0/3343567176 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4588155480 0x7f458806ee40 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f4580009d90 tx=0x7f458002be20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2ce51e7238cfd44d server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:43:29.412 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.407+0000 7fb51b690640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fb5140acdd0 0x7fb5140ad230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:29.412 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.407+0000 7fb51b690640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb5140c8150 0x7fb5140c85c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:29.412 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.407+0000 7f9861a7b640 1 -- 172.21.15.73:0/1000036414 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f985c0c3920 msgr2=0x7f985c0a9b70 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-12-12T09:43:29.412 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.407+0000 7f458559a640 1 -- 172.21.15.73:0/3343567176 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f458002cbd0 con 0x7f4588155480 2023-12-12T09:43:29.413 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.407+0000 7fa3f0dc9640 1 -- 172.21.15.73:0/4006183616 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa3ec0c0e70 msgr2=0x7fa3ec0c5f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:29.413 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.407+0000 7fa3f0dc9640 1 --2- 172.21.15.73:0/4006183616 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa3ec0c0e70 0x7fa3ec0c5f90 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fa3dc0097a0 tx=0x7fa3dc02b710 comp rx=0 tx=0).stop 2023-12-12T09:43:29.413 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.407+0000 7f458559a640 1 -- 172.21.15.73:0/3343567176 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f458002cd30 con 0x7f4588155480 2023-12-12T09:43:29.413 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.407+0000 7f458559a640 1 -- 172.21.15.73:0/3343567176 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f458002cea0 con 0x7f4588155480 2023-12-12T09:43:29.414 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.407+0000 7fb51b690640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5140c7cc0 con 0x7fb514151a70 2023-12-12T09:43:29.414 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.407+0000 7fb51b690640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5140c9c00 con 0x7fb5140acdd0 2023-12-12T09:43:29.414 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.407+0000 7fb51b690640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5140c9920 con 0x7fb5140c8150 2023-12-12T09:43:29.414 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.407+0000 7fb51942c640 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7fb514151a70 0x7fb514154f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.73:56892/0 (socket says 172.21.15.73:56892) 2023-12-12T09:43:29.414 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.408+0000 7fb518c2b640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fb5140acdd0 0x7fb5140ad230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:29.415 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.407+0000 7f9861a7b640 1 --2- 172.21.15.73:0/1000036414 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f985c0c3920 0x7f985c0a9b70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:29.415 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.407+0000 7f9861a7b640 1 -- 172.21.15.73:0/1000036414 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f985c158660 msgr2=0x7f985c144080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:29.415 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.407+0000 7f9861a7b640 1 --2- 172.21.15.73:0/1000036414 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f985c158660 0x7f985c144080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:29.415 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.407+0000 7f9861a7b640 1 -- 172.21.15.73:0/1000036414 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9858009400 con 0x7f985c0c5090 2023-12-12T09:43:29.415 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.407+0000 7f9862a7d640 1 --2- 172.21.15.73:0/1000036414 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f985c158660 0x7f985c144080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-12T09:43:29.415 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.408+0000 7fa3f0dc9640 1 -- 172.21.15.73:0/4006183616 shutdown_connections 2023-12-12T09:43:29.416 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.408+0000 7fa3f0dc9640 1 --2- 172.21.15.73:0/4006183616 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa3ec0c1250 0x7fa3ec0c16e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:29.416 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.408+0000 7fa3f0dc9640 1 --2- 172.21.15.73:0/4006183616 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa3ec0c0e70 0x7fa3ec0c5f90 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:29.416 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.408+0000 7fa3f0dc9640 1 -- 172.21.15.73:0/4006183616 >> 172.21.15.73:0/4006183616 conn(0x7fa3ec0a97f0 msgr2=0x7fa3ec0a9c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:43:29.416 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.408+0000 7fb518c2b640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fb5140acdd0 0x7fb5140ad230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:56676/0 (socket says 172.21.15.73:56676) 2023-12-12T09:43:29.416 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.408+0000 7fb519c2d640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb5140c8150 0x7fb5140c85c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:29.416 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.408+0000 7fb51942c640 1 -- 172.21.15.73:0/2109459382 learned_addr learned my addr 172.21.15.73:0/2109459382 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-12T09:43:29.417 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.408+0000 7fa3f0dc9640 1 -- 172.21.15.73:0/4006183616 shutdown_connections 2023-12-12T09:43:29.417 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.408+0000 7fa3f0dc9640 1 -- 172.21.15.73:0/4006183616 wait complete. 2023-12-12T09:43:29.417 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.408+0000 7f9861a7b640 1 --2- 172.21.15.73:0/1000036414 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f985c0c5090 0x7f985c143b40 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f984c00e820 tx=0x7f984c00ece0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:43:29.418 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.408+0000 7f458cf3c640 1 -- 172.21.15.73:0/3343567176 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4588155480 msgr2=0x7f458806ee40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:29.418 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.408+0000 7f458cf3c640 1 --2- 172.21.15.73:0/3343567176 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4588155480 0x7f458806ee40 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f4580009d90 tx=0x7f458002be20 comp rx=0 tx=0).stop 2023-12-12T09:43:29.418 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.409+0000 7fb50bfff640 1 -- 172.21.15.73:0/2109459382 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3148868719 0 0) 0x7fb5140c7cc0 con 0x7fb514151a70 2023-12-12T09:43:29.419 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.409+0000 7f9852ffd640 1 -- 172.21.15.73:0/1000036414 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f984c00c940 con 0x7f985c0c5090 2023-12-12T09:43:29.419 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.409+0000 7f9852ffd640 1 -- 172.21.15.73:0/1000036414 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f984c00caa0 con 0x7f985c0c5090 2023-12-12T09:43:29.419 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.409+0000 7f9852ffd640 1 -- 172.21.15.73:0/1000036414 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f984c00ce30 con 0x7f985c0c5090 2023-12-12T09:43:29.420 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.408+0000 7fcd137fe640 1 --2- 172.21.15.73:0/4060683452 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcd140c47a0 0x7fcd140c4b80 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fcd040097a0 tx=0x7fcd0402b7a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a60aab8774dea32d server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:43:29.421 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.409+0000 7fcd12ffd640 1 -- 172.21.15.73:0/4060683452 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd0402f050 con 0x7fcd140c47a0 2023-12-12T09:43:29.421 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.409+0000 7fcd12ffd640 1 -- 172.21.15.73:0/4060683452 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd04031700 con 0x7fcd140c47a0 2023-12-12T09:43:29.421 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.409+0000 7fcd12ffd640 1 -- 172.21.15.73:0/4060683452 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd04031a90 con 0x7fcd140c47a0 2023-12-12T09:43:29.421 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.410+0000 7fcd1a07c640 1 -- 172.21.15.73:0/4060683452 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcd140c47a0 msgr2=0x7fcd140c4b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:29.421 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.410+0000 7fcd1a07c640 1 --2- 172.21.15.73:0/4060683452 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcd140c47a0 0x7fcd140c4b80 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fcd040097a0 tx=0x7fcd0402b7a0 comp rx=0 tx=0).stop 2023-12-12T09:43:29.421 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.410+0000 7fcd1a07c640 1 -- 172.21.15.73:0/4060683452 shutdown_connections 2023-12-12T09:43:29.421 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.410+0000 7fcd1a07c640 1 --2- 172.21.15.73:0/4060683452 >> v2:172.21.15.142:3300/0 conn(0x7fcd140bd4b0 0x7fcd1406b320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:29.421 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.410+0000 7fcd1a07c640 1 --2- 172.21.15.73:0/4060683452 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcd140c47a0 0x7fcd140c4b80 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:29.421 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.410+0000 7fcd1a07c640 1 -- 172.21.15.73:0/4060683452 >> 172.21.15.73:0/4060683452 conn(0x7fcd140ab9d0 msgr2=0x7fcd140abde0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:43:29.421 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.410+0000 7f458cf3c640 1 -- 172.21.15.73:0/3343567176 shutdown_connections 2023-12-12T09:43:29.422 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.409+0000 7fb518c2b640 1 -- 172.21.15.73:0/2109459382 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb5140c8150 msgr2=0x7fb5140c85c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:43:29.422 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.409+0000 7fb518c2b640 1 --2- 172.21.15.73:0/2109459382 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb5140c8150 0x7fb5140c85c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:29.422 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.409+0000 7fb518c2b640 1 -- 172.21.15.73:0/2109459382 >> v1:172.21.15.142:6789/0 conn(0x7fb514151a70 legacy=0x7fb514154f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:29.422 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.409+0000 7fb518c2b640 1 -- 172.21.15.73:0/2109459382 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5140c4a90 con 0x7fb5140acdd0 2023-12-12T09:43:29.423 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.410+0000 7fcd1a07c640 1 -- 172.21.15.73:0/4060683452 shutdown_connections 2023-12-12T09:43:29.423 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.410+0000 7fcd1a07c640 1 -- 172.21.15.73:0/4060683452 wait complete. 2023-12-12T09:43:29.423 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.410+0000 7f458cf3c640 1 --2- 172.21.15.73:0/3343567176 >> v2:172.21.15.142:3300/0 conn(0x7f45881587a0 0x7f458806a4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:29.423 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.410+0000 7f458cf3c640 1 --2- 172.21.15.73:0/3343567176 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4588155480 0x7f458806ee40 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:29.423 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.410+0000 7f458cf3c640 1 -- 172.21.15.73:0/3343567176 >> 172.21.15.73:0/3343567176 conn(0x7f45880c35d0 msgr2=0x7f45880c39b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:43:29.423 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.411+0000 7f458cf3c640 1 -- 172.21.15.73:0/3343567176 shutdown_connections 2023-12-12T09:43:29.424 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.411+0000 7fb518c2b640 1 --2- 172.21.15.73:0/2109459382 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb5140acdd0 0x7fb5140ad230 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fb5100097a0 tx=0x7fb51002b7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca21733e8ba7ab64 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:43:29.424 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.411+0000 7f458cf3c640 1 -- 172.21.15.73:0/3343567176 wait complete. 2023-12-12T09:43:29.424 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.411+0000 7fa3f0dc9640 1 Processor -- start 2023-12-12T09:43:29.425 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.411+0000 7fd686a00640 1 Processor -- start 2023-12-12T09:43:29.425 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.411+0000 7f98644e0640 1 -- 172.21.15.73:0/1000036414 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f985c157500 con 0x7f985c0c5090 2023-12-12T09:43:29.425 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.411+0000 7f98644e0640 1 -- 172.21.15.73:0/1000036414 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f985c0abbd0 con 0x7f985c0c5090 2023-12-12T09:43:29.425 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.411+0000 7fd686a00640 1 -- start start 2023-12-12T09:43:29.426 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.413+0000 7f98644e0640 1 -- 172.21.15.73:0/1000036414 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f985c157da0 con 0x7f985c0c5090 2023-12-12T09:43:29.426 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.413+0000 7fa3f0dc9640 1 -- start start 2023-12-12T09:43:29.426 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.413+0000 7f458cf3c640 1 Processor -- start 2023-12-12T09:43:29.426 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.413+0000 7f458cf3c640 1 -- start start 2023-12-12T09:43:29.427 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.413+0000 7fd686a00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd6800c0710 0x7fd680159440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:29.427 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.413+0000 7fd686a00640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fd680071cc0 0x7fd680072130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:29.427 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.413+0000 7fd686a00640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd68006c9d0 con 0x7fd680155dd0 2023-12-12T09:43:29.427 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.413+0000 7fd686a00640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6800c1b80 con 0x7fd680071cc0 2023-12-12T09:43:29.427 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.413+0000 7fd686a00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6800c1e60 con 0x7fd6800c0710 2023-12-12T09:43:29.427 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.413+0000 7fcd1a07c640 1 Processor -- start 2023-12-12T09:43:29.428 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.414+0000 7fb50bfff640 1 -- 172.21.15.73:0/2109459382 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb510031710 con 0x7fb5140acdd0 2023-12-12T09:43:29.428 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.414+0000 7fb50bfff640 1 -- 172.21.15.73:0/2109459382 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb51002f050 con 0x7fb5140acdd0 2023-12-12T09:43:29.428 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.414+0000 7fb50bfff640 1 -- 172.21.15.73:0/2109459382 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb510031ad0 con 0x7fb5140acdd0 2023-12-12T09:43:29.429 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.414+0000 7fd67f7fe640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd6800c0710 0x7fd680159440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:29.429 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.414+0000 7fd684f9d640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fd680071cc0 0x7fd680072130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:29.429 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.414+0000 7fd684f9d640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fd680071cc0 0x7fd680072130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.73:43360/0 (socket says 172.21.15.73:43360) 2023-12-12T09:43:29.429 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.414+0000 7fd684f9d640 1 -- 172.21.15.73:0/2967780124 learned_addr learned my addr 172.21.15.73:0/2967780124 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:43:29.429 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.415+0000 7fb51b690640 1 -- 172.21.15.73:0/2109459382 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb5140acdd0 msgr2=0x7fb5140ad230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:29.429 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.415+0000 7fb51b690640 1 --2- 172.21.15.73:0/2109459382 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb5140acdd0 0x7fb5140ad230 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fb5100097a0 tx=0x7fb51002b7b0 comp rx=0 tx=0).stop 2023-12-12T09:43:29.430 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.415+0000 7f458cf3c640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f458806aa20 0x7f45881f27e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:29.430 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.415+0000 7f458cf3c640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4588155480 0x7f45880a7980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:29.430 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.415+0000 7fb51b690640 1 -- 172.21.15.73:0/2109459382 shutdown_connections 2023-12-12T09:43:29.430 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.415+0000 7fb51b690640 1 --2- 172.21.15.73:0/2109459382 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb5140c8150 0x7fb5140c85c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:29.430 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.415+0000 7fb51b690640 1 --2- 172.21.15.73:0/2109459382 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb5140acdd0 0x7fb5140ad230 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:29.430 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.415+0000 7fb51b690640 1 -- 172.21.15.73:0/2109459382 >> 172.21.15.73:0/2109459382 conn(0x7fb5140abcb0 msgr2=0x7fb5140ac0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:43:29.431 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.415+0000 7fd684f9d640 1 -- 172.21.15.73:0/2967780124 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd6800c0710 msgr2=0x7fd680159440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:43:29.431 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.415+0000 7fd684f9d640 1 --2- 172.21.15.73:0/2967780124 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd6800c0710 0x7fd680159440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:29.431 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.415+0000 7fa3f0dc9640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa3ec0c1250 0x7fa3ec14f150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:29.431 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.416+0000 7f458cf3c640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f45881587a0 0x7f45881ee840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:29.432 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.415+0000 7fa3f0dc9640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa3ec0c6830 0x7fa3ec1ee600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:29.432 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.415+0000 7fa3f0dc9640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa3ec06fa20 0x7fa3ec153ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:29.432 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.415+0000 7fa3f0dc9640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3ec151a40 con 0x7fa3ec0c6830 2023-12-12T09:43:29.432 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.415+0000 7fa3f0dc9640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3ec1eeec0 con 0x7fa3ec06fa20 2023-12-12T09:43:29.432 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.415+0000 7fa3f0dc9640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3ec1ef1a0 con 0x7fa3ec0c1250 2023-12-12T09:43:29.433 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.414+0000 7fcd1a07c640 1 -- start start 2023-12-12T09:43:29.433 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.416+0000 7f9852ffd640 1 -- 172.21.15.73:0/1000036414 <== mon.1 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f984c013470 con 0x7f985c0c5090 2023-12-12T09:43:29.433 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.416+0000 7fcd1a07c640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcd140bd4b0 0x7fcd140ad8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:29.434 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.416+0000 7fcd1a07c640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcd140c47a0 0x7fcd141f17a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:29.434 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.416+0000 7fcd1a07c640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcd140c7d20 0x7fcd141f1ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:29.434 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.416+0000 7fcd1a07c640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd140be330 con 0x7fcd140bd4b0 2023-12-12T09:43:29.434 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.416+0000 7fcd1a07c640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd14158930 con 0x7fcd140c47a0 2023-12-12T09:43:29.434 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.416+0000 7fcd1a07c640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd14151450 con 0x7fcd140c7d20 2023-12-12T09:43:29.434 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.416+0000 7fa3eaffd640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa3ec0c6830 0x7fa3ec1ee600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:29.435 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.416+0000 7fcd137fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcd140bd4b0 0x7fcd140ad8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:29.435 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.416+0000 7fcd137fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcd140bd4b0 0x7fcd140ad8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:56694/0 (socket says 172.21.15.73:56694) 2023-12-12T09:43:29.435 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.416+0000 7fcd137fe640 1 -- 172.21.15.73:0/1222539035 learned_addr learned my addr 172.21.15.73:0/1222539035 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:43:29.435 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.416+0000 7fa3eaffd640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa3ec0c6830 0x7fa3ec1ee600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:56700/0 (socket says 172.21.15.73:56700) 2023-12-12T09:43:29.435 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.416+0000 7fcd0affd640 1 --2- 172.21.15.73:0/1222539035 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcd140c47a0 0x7fcd141f17a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:29.436 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.416+0000 7fcd13fff640 1 --2- 172.21.15.73:0/1222539035 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcd140c7d20 0x7fcd141f1ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:29.436 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.416+0000 7fa3eaffd640 1 -- 172.21.15.73:0/1922643610 learned_addr learned my addr 172.21.15.73:0/1922643610 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:43:29.436 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.416+0000 7fa3ebfff640 1 --2- 172.21.15.73:0/1922643610 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa3ec06fa20 0x7fa3ec153ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:29.436 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.417+0000 7fcd137fe640 1 -- 172.21.15.73:0/1222539035 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcd140c7d20 msgr2=0x7fcd141f1ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:29.437 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.417+0000 7fcd137fe640 1 --2- 172.21.15.73:0/1222539035 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcd140c7d20 0x7fcd141f1ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:29.437 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.417+0000 7fcd137fe640 1 -- 172.21.15.73:0/1222539035 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcd140c47a0 msgr2=0x7fcd141f17a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:29.437 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.417+0000 7fcd137fe640 1 --2- 172.21.15.73:0/1222539035 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcd140c47a0 0x7fcd141f17a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:29.437 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.417+0000 7fcd137fe640 1 -- 172.21.15.73:0/1222539035 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd04009400 con 0x7fcd140bd4b0 2023-12-12T09:43:29.437 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.417+0000 7fa3eaffd640 1 -- 172.21.15.73:0/1922643610 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa3ec0c1250 msgr2=0x7fa3ec14f150 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-12-12T09:43:29.437 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.417+0000 7fa3eaffd640 1 --2- 172.21.15.73:0/1922643610 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa3ec0c1250 0x7fa3ec14f150 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:29.437 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.417+0000 7fa3eaffd640 1 -- 172.21.15.73:0/1922643610 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa3ec06fa20 msgr2=0x7fa3ec153ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:29.437 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.417+0000 7fa3eaffd640 1 --2- 172.21.15.73:0/1922643610 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa3ec06fa20 0x7fa3ec153ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:29.438 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.415+0000 7fd684f9d640 1 -- 172.21.15.73:0/2967780124 >> v1:172.21.15.142:6789/0 conn(0x7fd680155dd0 legacy=0x7fd6800c0c60 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-12-12T09:43:29.438 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.415+0000 7fd684f9d640 1 -- 172.21.15.73:0/2967780124 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd68006c660 con 0x7fd680071cc0 2023-12-12T09:43:29.438 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.417+0000 7fa3eaffd640 1 -- 172.21.15.73:0/1922643610 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3dc009400 con 0x7fa3ec0c6830 2023-12-12T09:43:29.438 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.417+0000 7f458cf3c640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45881f23c0 con 0x7f4588155480 2023-12-12T09:43:29.439 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.417+0000 7f9852ffd640 1 --2- 172.21.15.73:0/1000036414 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f984006ae70 0x7f984006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:29.439 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.417+0000 7fcd137fe640 1 --2- 172.21.15.73:0/1222539035 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcd140bd4b0 0x7fcd140ad8b0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fcd040096f0 tx=0x7fcd040046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:43:29.439 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.417+0000 7fa3eaffd640 1 --2- 172.21.15.73:0/1922643610 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa3ec0c6830 0x7fa3ec1ee600 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fa3e000c460 tx=0x7fa3e000c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:43:29.439 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.417+0000 7f9852ffd640 1 -- 172.21.15.73:0/1000036414 <== mon.1 v2:172.21.15.142:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f984c089e30 con 0x7f985c0c5090 2023-12-12T09:43:29.440 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.418+0000 7fb51b690640 1 -- 172.21.15.73:0/2109459382 shutdown_connections 2023-12-12T09:43:29.440 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.417+0000 7f458659c640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f458806aa20 0x7f45881f27e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:29.440 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.418+0000 7f4586d9d640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f45881587a0 0x7f45881ee840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:29.440 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.418+0000 7f4586d9d640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f45881587a0 0x7f45881ee840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.73:33726/0 (socket says 172.21.15.73:33726) 2023-12-12T09:43:29.441 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.418+0000 7f4586d9d640 1 -- 172.21.15.73:0/552708165 learned_addr learned my addr 172.21.15.73:0/552708165 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:43:29.441 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.417+0000 7fd684f9d640 1 --2- 172.21.15.73:0/2967780124 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd680071cc0 0x7fd680072130 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fd670009e50 tx=0x7fd67002bed0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3552e8b4d70c9d51 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:43:29.441 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.418+0000 7fa3ebfff640 1 --2- 172.21.15.73:0/1922643610 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa3ec06fa20 0x7fa3ec153ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:43:29.441 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.418+0000 7f458cf3c640 1 -- 172.21.15.73:0/552708165 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45880a3500 con 0x7f458806aa20 2023-12-12T09:43:29.442 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.418+0000 7f458cf3c640 1 -- 172.21.15.73:0/552708165 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45881f2d20 con 0x7f45881587a0 2023-12-12T09:43:29.442 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.418+0000 7fb51b690640 1 -- 172.21.15.73:0/2109459382 wait complete. 2023-12-12T09:43:29.442 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.418+0000 7f986227c640 1 --2- 172.21.15.73:0/1000036414 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f984006ae70 0x7f984006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:29.443 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.418+0000 7f4585d9b640 1 --2- 172.21.15.73:0/552708165 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4588155480 0x7f45880a7980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:29.443 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.418+0000 7f4586d9d640 1 -- 172.21.15.73:0/552708165 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f458806aa20 msgr2=0x7f45881f27e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:29.443 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.418+0000 7f4586d9d640 1 --2- 172.21.15.73:0/552708165 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f458806aa20 0x7f45881f27e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:29.443 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.419+0000 7f4586d9d640 1 -- 172.21.15.73:0/552708165 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4588155480 msgr2=0x7f45880a7980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:29.443 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.419+0000 7fa3d3fff640 1 -- 172.21.15.73:0/1922643610 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3e00074e0 con 0x7fa3ec0c6830 2023-12-12T09:43:29.443 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.419+0000 7fa3d3fff640 1 -- 172.21.15.73:0/1922643610 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3e0007640 con 0x7fa3ec0c6830 2023-12-12T09:43:29.443 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.419+0000 7fa3d3fff640 1 -- 172.21.15.73:0/1922643610 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3e00049e0 con 0x7fa3ec0c6830 2023-12-12T09:43:29.444 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.419+0000 7f4586d9d640 1 --2- 172.21.15.73:0/552708165 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4588155480 0x7f45880a7980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:29.444 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.419+0000 7f4586d9d640 1 -- 172.21.15.73:0/552708165 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4580009a70 con 0x7f45881587a0 2023-12-12T09:43:29.444 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.419+0000 7fa3f0dc9640 1 -- 172.21.15.73:0/1922643610 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3ec1ef480 con 0x7fa3ec0c6830 2023-12-12T09:43:29.444 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.419+0000 7fa3f0dc9640 1 -- 172.21.15.73:0/1922643610 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3ec06e080 con 0x7fa3ec0c6830 2023-12-12T09:43:29.444 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.419+0000 7f4585d9b640 1 --2- 172.21.15.73:0/552708165 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4588155480 0x7f45880a7980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-12T09:43:29.445 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.420+0000 7f986227c640 1 --2- 172.21.15.73:0/1000036414 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f984006ae70 0x7f984006d330 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f9858036000 tx=0x7f9858008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:43:29.445 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.419+0000 7f4586d9d640 1 --2- 172.21.15.73:0/552708165 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f45881587a0 0x7f45881ee840 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f457c00b490 tx=0x7f457c00b950 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:43:29.445 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.420+0000 7f4576ffd640 1 -- 172.21.15.73:0/552708165 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f457c011830 con 0x7f45881587a0 2023-12-12T09:43:29.445 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.420+0000 7fcd10ff9640 1 -- 172.21.15.73:0/1222539035 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd040339b0 con 0x7fcd140bd4b0 2023-12-12T09:43:29.446 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.420+0000 7f4576ffd640 1 -- 172.21.15.73:0/552708165 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f457c0119b0 con 0x7f45881587a0 2023-12-12T09:43:29.446 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.420+0000 7fcd10ff9640 1 -- 172.21.15.73:0/1222539035 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd04033b10 con 0x7fcd140bd4b0 2023-12-12T09:43:29.446 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.420+0000 7fcd10ff9640 1 -- 172.21.15.73:0/1222539035 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd04033ea0 con 0x7fcd140bd4b0 2023-12-12T09:43:29.446 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.420+0000 7efcfeddc640 1 Processor -- start 2023-12-12T09:43:29.447 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.420+0000 7f4576ffd640 1 -- 172.21.15.73:0/552708165 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f457c011d60 con 0x7f45881587a0 2023-12-12T09:43:29.447 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.420+0000 7fcd1a07c640 1 -- 172.21.15.73:0/1222539035 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd140be580 con 0x7fcd140bd4b0 2023-12-12T09:43:29.447 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.420+0000 7fcd1a07c640 1 -- 172.21.15.73:0/1222539035 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd140bd920 con 0x7fcd140bd4b0 2023-12-12T09:43:29.448 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.420+0000 7fb51b690640 1 Processor -- start 2023-12-12T09:43:29.448 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.421+0000 7fb51b690640 1 -- start start 2023-12-12T09:43:29.448 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.421+0000 7f458cf3c640 1 -- 172.21.15.73:0/552708165 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45881f1db0 con 0x7f45881587a0 2023-12-12T09:43:29.448 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.421+0000 7f458cf3c640 1 -- 172.21.15.73:0/552708165 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45880a3220 con 0x7f45881587a0 2023-12-12T09:43:29.449 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.422+0000 7fb51b690640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb5140acdd0 0x7fb5140aac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:29.449 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.422+0000 7fb51b690640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb5140c8150 0x7fb514149d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:29.449 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.422+0000 7fb51b690640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb514151a70 0x7fb51414a290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:29.449 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.422+0000 7fb51b690640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb51406fea0 con 0x7fb5140acdd0 2023-12-12T09:43:29.449 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.422+0000 7fb51b690640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb51406b360 con 0x7fb5140c8150 2023-12-12T09:43:29.449 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.422+0000 7fb51b690640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb51406b890 con 0x7fb514151a70 2023-12-12T09:43:29.449 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.421+0000 7efcfeddc640 1 -- start start 2023-12-12T09:43:29.450 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.422+0000 7efcfeddc640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7efcf80bd470 0x7efcf806ba90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:29.450 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.422+0000 7efcfeddc640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efcf80c7cc0 0x7efcf806bfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:29.450 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.422+0000 7efcfeddc640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efcf8154650 con 0x7efcf8151ce0 2023-12-12T09:43:29.450 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.422+0000 7efcfeddc640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efcf80c57b0 con 0x7efcf80bd470 2023-12-12T09:43:29.450 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.422+0000 7efcfeddc640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efcf8154930 con 0x7efcf80c7cc0 2023-12-12T09:43:29.450 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.422+0000 7fcd1a07c640 1 -- 172.21.15.73:0/1222539035 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd140beaa0 con 0x7fcd140bd4b0 2023-12-12T09:43:29.450 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.423+0000 7fb51942c640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb5140acdd0 0x7fb5140aac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:29.451 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.423+0000 7fa3f0dc9640 1 -- 172.21.15.73:0/1922643610 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3ec06e2a0 con 0x7fa3ec0c6830 2023-12-12T09:43:29.451 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.423+0000 7fb51942c640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb5140acdd0 0x7fb5140aac00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:56706/0 (socket says 172.21.15.73:56706) 2023-12-12T09:43:29.451 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.423+0000 7fb51942c640 1 -- 172.21.15.73:0/1415977378 learned_addr learned my addr 172.21.15.73:0/1415977378 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:43:29.452 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.423+0000 7efcfcb78640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7efcf8151ce0 0x7efcf80c67d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:34352/0 (socket says 172.21.15.73:34352) 2023-12-12T09:43:29.452 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.423+0000 7efcfcb78640 1 -- 172.21.15.73:0/1080473252 learned_addr learned my addr 172.21.15.73:0/1080473252 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-12T09:43:29.452 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.423+0000 7efceffff640 1 --2- 172.21.15.73:0/1080473252 >> v2:172.21.15.142:3300/0 conn(0x7efcf80bd470 0x7efcf806ba90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:29.452 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.423+0000 7efcfd379640 1 --2- 172.21.15.73:0/1080473252 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efcf80c7cc0 0x7efcf806bfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:29.452 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.424+0000 7efceffff640 1 -- 172.21.15.73:0/1080473252 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efcf80c7cc0 msgr2=0x7efcf806bfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:43:29.452 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.424+0000 7efceffff640 1 --2- 172.21.15.73:0/1080473252 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efcf80c7cc0 0x7efcf806bfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:29.452 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.424+0000 7efceffff640 1 -- 172.21.15.73:0/1080473252 >> v1:172.21.15.73:6789/0 conn(0x7efcf8151ce0 legacy=0x7efcf80c67d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:43:29.452 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.424+0000 7efceffff640 1 -- 172.21.15.73:0/1080473252 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcf8154c10 con 0x7efcf80bd470 2023-12-12T09:43:29.453 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.423+0000 7fb519c2d640 1 --2- 172.21.15.73:0/1415977378 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb514151a70 0x7fb51414a290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:29.453 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.424+0000 7fb51942c640 1 -- 172.21.15.73:0/1415977378 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb514151a70 msgr2=0x7fb51414a290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:29.453 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.424+0000 7fb51942c640 1 --2- 172.21.15.73:0/1415977378 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb514151a70 0x7fb51414a290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:29.453 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.424+0000 7fb51942c640 1 -- 172.21.15.73:0/1415977378 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb5140c8150 msgr2=0x7fb514149d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:29.453 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.424+0000 7fb51942c640 1 --2- 172.21.15.73:0/1415977378 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb5140c8150 0x7fb514149d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:29.453 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.424+0000 7fb51942c640 1 -- 172.21.15.73:0/1415977378 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb510009400 con 0x7fb5140acdd0 2023-12-12T09:43:29.453 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.424+0000 7fb51942c640 1 --2- 172.21.15.73:0/1415977378 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb5140acdd0 0x7fb5140aac00 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fb50c00c780 tx=0x7fb50c00cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:43:29.454 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.424+0000 7fa3d3fff640 1 -- 172.21.15.73:0/1922643610 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fa3e001c3b0 con 0x7fa3ec0c6830 2023-12-12T09:43:29.454 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.425+0000 7fa3d3fff640 1 --2- 172.21.15.73:0/1922643610 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fa3d806af10 0x7fa3d806d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:29.454 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.426+0000 7fa3d3fff640 1 -- 172.21.15.73:0/1922643610 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa3e0088b10 con 0x7fa3ec0c6830 2023-12-12T09:43:29.454 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.426+0000 7efceffff640 1 --2- 172.21.15.73:0/1080473252 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efcf80bd470 0x7efcf806ba90 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7efce00097a0 tx=0x7efce002b790 comp rx=0 tx=0).ready entity=mon.1 client_cookie=256996ba58a76970 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:43:29.455 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.426+0000 7fcd10ff9640 1 -- 172.21.15.73:0/1222539035 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fcd0403a040 con 0x7fcd140bd4b0 2023-12-12T09:43:29.455 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.425+0000 7f4576ffd640 1 -- 172.21.15.73:0/552708165 <== mon.2 v2:172.21.15.142:3301/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f457c01a410 con 0x7f45881587a0 2023-12-12T09:43:29.455 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.425+0000 7f458cf3c640 1 -- 172.21.15.73:0/552708165 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45881f2500 con 0x7f45881587a0 2023-12-12T09:43:29.455 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.426+0000 7f4576ffd640 1 --2- 172.21.15.73:0/552708165 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f456806ae70 0x7f456806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:29.455 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.426+0000 7f4576ffd640 1 -- 172.21.15.73:0/552708165 <== mon.2 v2:172.21.15.142:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f457c089070 con 0x7f45881587a0 2023-12-12T09:43:29.456 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.427+0000 7fa3eb7fe640 1 --2- 172.21.15.73:0/1922643610 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fa3d806af10 0x7fa3d806d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:29.456 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.427+0000 7f458659c640 1 --2- 172.21.15.73:0/552708165 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f456806ae70 0x7f456806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:29.457 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.427+0000 7fcd10ff9640 1 --2- 172.21.15.73:0/1222539035 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fccf406ae90 0x7fccf406d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:29.457 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.427+0000 7fcd10ff9640 1 -- 172.21.15.73:0/1222539035 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fcd040ab3e0 con 0x7fcd140bd4b0 2023-12-12T09:43:29.457 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.428+0000 7fcd0affd640 1 --2- 172.21.15.73:0/1222539035 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fccf406ae90 0x7fccf406d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:29.457 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.428+0000 7f458659c640 1 --2- 172.21.15.73:0/552708165 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f456806ae70 0x7f456806d330 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f4580036000 tx=0x7f4580030000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:43:29.457 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.428+0000 7fa3eb7fe640 1 --2- 172.21.15.73:0/1922643610 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fa3d806af10 0x7fa3d806d3d0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fa3dc034000 tx=0x7fa3dc02f000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:43:29.458 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.428+0000 7fcd0affd640 1 --2- 172.21.15.73:0/1222539035 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fccf406ae90 0x7fccf406d350 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fcd14151260 tx=0x7fccfc008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:43:29.458 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.430+0000 7fb509ffb640 1 -- 172.21.15.73:0/1415977378 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb50c00ce90 con 0x7fb5140acdd0 2023-12-12T09:43:29.458 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.430+0000 7fb51b690640 1 -- 172.21.15.73:0/1415977378 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb51406b5b0 con 0x7fb5140acdd0 2023-12-12T09:43:29.458 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.430+0000 7fb51b690640 1 -- 172.21.15.73:0/1415977378 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5140716a0 con 0x7fb5140acdd0 2023-12-12T09:43:29.459 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.430+0000 7fa3d3fff640 1 -- 172.21.15.73:0/1922643610 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fa3e0053ce0 con 0x7fa3ec0c6830 2023-12-12T09:43:29.459 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.431+0000 7fb51b690640 1 -- 172.21.15.73:0/1415977378 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb514067580 con 0x7fb5140acdd0 2023-12-12T09:43:29.459 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.433+0000 7fd67effd640 1 -- 172.21.15.73:0/2967780124 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd67002ca70 con 0x7fd680071cc0 2023-12-12T09:43:29.460 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.433+0000 7efcf7fff640 1 -- 172.21.15.73:0/1080473252 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efce00316f0 con 0x7efcf80bd470 2023-12-12T09:43:29.460 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.433+0000 7efcf7fff640 1 -- 172.21.15.73:0/1080473252 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efce0031850 con 0x7efcf80bd470 2023-12-12T09:43:29.460 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.433+0000 7f9852ffd640 1 -- 172.21.15.73:0/1000036414 <== mon.1 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f984c054f70 con 0x7f985c0c5090 2023-12-12T09:43:29.460 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.433+0000 7fd67effd640 1 -- 172.21.15.73:0/2967780124 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd67002cbd0 con 0x7fd680071cc0 2023-12-12T09:43:29.460 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.433+0000 7fd67effd640 1 -- 172.21.15.73:0/2967780124 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd67002ca70 con 0x7fd680071cc0 2023-12-12T09:43:29.461 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.434+0000 7efcf7fff640 1 -- 172.21.15.73:0/1080473252 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efce0031be0 con 0x7efcf80bd470 2023-12-12T09:43:29.461 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.434+0000 7fd686a00640 1 -- 172.21.15.73:0/2967780124 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd680071cc0 msgr2=0x7fd680072130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:29.461 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.434+0000 7fd686a00640 1 --2- 172.21.15.73:0/2967780124 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd680071cc0 0x7fd680072130 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fd670009e50 tx=0x7fd67002bed0 comp rx=0 tx=0).stop 2023-12-12T09:43:29.462 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.434+0000 7efcfeddc640 1 -- 172.21.15.73:0/1080473252 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efcf80bd470 msgr2=0x7efcf806ba90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:29.462 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.434+0000 7efcfeddc640 1 --2- 172.21.15.73:0/1080473252 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efcf80bd470 0x7efcf806ba90 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7efce00097a0 tx=0x7efce002b790 comp rx=0 tx=0).stop 2023-12-12T09:43:29.462 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.434+0000 7efcfeddc640 1 -- 172.21.15.73:0/1080473252 shutdown_connections 2023-12-12T09:43:29.462 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.434+0000 7efcfeddc640 1 --2- 172.21.15.73:0/1080473252 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efcf80c7cc0 0x7efcf806bfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:29.462 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.434+0000 7efcfeddc640 1 --2- 172.21.15.73:0/1080473252 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efcf80bd470 0x7efcf806ba90 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:29.462 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.434+0000 7efcfeddc640 1 -- 172.21.15.73:0/1080473252 >> 172.21.15.73:0/1080473252 conn(0x7efcf80ab950 msgr2=0x7efcf80abd30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:43:29.463 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.434+0000 7fd686a00640 1 -- 172.21.15.73:0/2967780124 shutdown_connections 2023-12-12T09:43:29.463 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.434+0000 7fd686a00640 1 --2- 172.21.15.73:0/2967780124 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd6800c0710 0x7fd680159440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:29.463 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.434+0000 7fd686a00640 1 --2- 172.21.15.73:0/2967780124 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd680071cc0 0x7fd680072130 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:29.463 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.434+0000 7fd686a00640 1 -- 172.21.15.73:0/2967780124 >> 172.21.15.73:0/2967780124 conn(0x7fd6800a77d0 msgr2=0x7fd6800a7bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:43:29.463 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.435+0000 7efcfeddc640 1 -- 172.21.15.73:0/1080473252 shutdown_connections 2023-12-12T09:43:29.463 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.435+0000 7fd686a00640 1 -- 172.21.15.73:0/2967780124 shutdown_connections 2023-12-12T09:43:29.464 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.435+0000 7efcfeddc640 1 -- 172.21.15.73:0/1080473252 wait complete. 2023-12-12T09:43:29.464 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.435+0000 7fd686a00640 1 -- 172.21.15.73:0/2967780124 wait complete. 2023-12-12T09:43:29.464 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.437+0000 7fd686a00640 1 Processor -- start 2023-12-12T09:43:29.464 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.438+0000 7fd686a00640 1 -- start start 2023-12-12T09:43:29.465 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.438+0000 7efcfeddc640 1 Processor -- start 2023-12-12T09:43:29.465 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.438+0000 7efcfeddc640 1 -- start start 2023-12-12T09:43:29.465 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.439+0000 7fd686a00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd680071cc0 0x7fd680152580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:29.466 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.439+0000 7efcfeddc640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efcf80bd470 0x7efcf80c96f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:29.466 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.439+0000 7efcfeddc640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efcf80c7cc0 0x7efcf814aec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:29.466 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.439+0000 7efcfeddc640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efcf8155e40 0x7efcf814b400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:29.466 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.439+0000 7efcfeddc640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcf81588c0 con 0x7efcf80bd470 2023-12-12T09:43:29.466 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.439+0000 7efcfeddc640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcf8157360 con 0x7efcf8155e40 2023-12-12T09:43:29.466 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.439+0000 7efcfeddc640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efcf8155910 con 0x7efcf80c7cc0 2023-12-12T09:43:29.466 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.440+0000 7fd686a00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd6800c0710 0x7fd680158470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:29.466 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.440+0000 7fd686a00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd680155dd0 0x7fd6801f1af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:29.467 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.440+0000 7fcd10ff9640 1 -- 172.21.15.73:0/1222539035 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fcd04076600 con 0x7fcd140bd4b0 2023-12-12T09:43:29.467 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.440+0000 7fd686a00640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6801f1610 con 0x7fd680155dd0 2023-12-12T09:43:29.467 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.440+0000 7fd686a00640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd680152ac0 con 0x7fd680071cc0 2023-12-12T09:43:29.467 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.440+0000 7fd686a00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd68014ea80 con 0x7fd6800c0710 2023-12-12T09:43:29.468 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.440+0000 7efcfd379640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efcf8155e40 0x7efcf814b400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:29.468 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.440+0000 7efcfd379640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efcf8155e40 0x7efcf814b400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.73:43404/0 (socket says 172.21.15.73:43404) 2023-12-12T09:43:29.468 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.441+0000 7efcfd379640 1 -- 172.21.15.73:0/511337706 learned_addr learned my addr 172.21.15.73:0/511337706 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:43:29.468 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.441+0000 7efcfcb78640 1 --2- 172.21.15.73:0/511337706 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efcf80bd470 0x7efcf80c96f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:29.468 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.440+0000 7fb509ffb640 1 -- 172.21.15.73:0/1415977378 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb50c00a640 con 0x7fb5140acdd0 2023-12-12T09:43:29.468 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.440+0000 7fb509ffb640 1 -- 172.21.15.73:0/1415977378 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb50c00aa30 con 0x7fb5140acdd0 2023-12-12T09:43:29.469 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.441+0000 7efceffff640 1 --2- 172.21.15.73:0/511337706 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efcf80c7cc0 0x7efcf814aec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:29.469 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.442+0000 7efcfcb78640 1 -- 172.21.15.73:0/511337706 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efcf80c7cc0 msgr2=0x7efcf814aec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:29.469 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.442+0000 7efcfcb78640 1 --2- 172.21.15.73:0/511337706 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efcf80c7cc0 0x7efcf814aec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:29.469 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.442+0000 7efcfcb78640 1 -- 172.21.15.73:0/511337706 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efcf8155e40 msgr2=0x7efcf814b400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:29.469 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.442+0000 7efcfcb78640 1 --2- 172.21.15.73:0/511337706 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efcf8155e40 0x7efcf814b400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:29.469 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.442+0000 7efcfcb78640 1 -- 172.21.15.73:0/511337706 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efce0009400 con 0x7efcf80bd470 2023-12-12T09:43:29.469 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.442+0000 7fb509ffb640 1 -- 172.21.15.73:0/1415977378 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fb50c00ac50 con 0x7fb5140acdd0 2023-12-12T09:43:29.470 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.440+0000 7fd67ffff640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd680071cc0 0x7fd680152580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:29.470 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.440+0000 7fd67f7fe640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd6800c0710 0x7fd680158470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:29.470 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.440+0000 7fd67ffff640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd680071cc0 0x7fd680152580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.73:43418/0 (socket says 172.21.15.73:43418) 2023-12-12T09:43:29.470 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.440+0000 7fd67ffff640 1 -- 172.21.15.73:0/2621135118 learned_addr learned my addr 172.21.15.73:0/2621135118 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:43:29.470 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.441+0000 7fd684f9d640 1 --2- 172.21.15.73:0/2621135118 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd680155dd0 0x7fd6801f1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:29.470 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.441+0000 7fd67f7fe640 1 -- 172.21.15.73:0/2621135118 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd680071cc0 msgr2=0x7fd680152580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:29.470 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.441+0000 7fd67f7fe640 1 --2- 172.21.15.73:0/2621135118 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd680071cc0 0x7fd680152580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:29.470 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.441+0000 7fd67f7fe640 1 -- 172.21.15.73:0/2621135118 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd680155dd0 msgr2=0x7fd6801f1af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:29.470 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.441+0000 7fd67f7fe640 1 --2- 172.21.15.73:0/2621135118 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd680155dd0 0x7fd6801f1af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:29.470 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.441+0000 7fd67f7fe640 1 -- 172.21.15.73:0/2621135118 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd670009b30 con 0x7fd6800c0710 2023-12-12T09:43:29.471 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.442+0000 7fd67f7fe640 1 --2- 172.21.15.73:0/2621135118 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd6800c0710 0x7fd680158470 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fd67800e840 tx=0x7fd67800ed00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:43:29.471 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.443+0000 7efcfcb78640 1 --2- 172.21.15.73:0/511337706 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efcf80bd470 0x7efcf80c96f0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7efce800bd30 tx=0x7efce800be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:43:29.471 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.444+0000 7fb509ffb640 1 --2- 172.21.15.73:0/1415977378 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fb4f806ae40 0x7fb4f806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:29.471 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.444+0000 7fb509ffb640 1 -- 172.21.15.73:0/1415977378 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb50c089420 con 0x7fb5140acdd0 2023-12-12T09:43:29.472 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.445+0000 7fd67cff9640 1 -- 172.21.15.73:0/2621135118 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd678009590 con 0x7fd6800c0710 2023-12-12T09:43:29.472 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.445+0000 7fd686a00640 1 -- 172.21.15.73:0/2621135118 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd68014e7a0 con 0x7fd6800c0710 2023-12-12T09:43:29.472 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.445+0000 7fd686a00640 1 -- 172.21.15.73:0/2621135118 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd68015cc50 con 0x7fd6800c0710 2023-12-12T09:43:29.472 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.445+0000 7fd67cff9640 1 -- 172.21.15.73:0/2621135118 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd67800c940 con 0x7fd6800c0710 2023-12-12T09:43:29.472 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.445+0000 7fd67cff9640 1 -- 172.21.15.73:0/2621135118 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd678009590 con 0x7fd6800c0710 2023-12-12T09:43:29.472 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.445+0000 7fb518c2b640 1 --2- 172.21.15.73:0/1415977378 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fb4f806ae40 0x7fb4f806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:29.472 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.445+0000 7f4576ffd640 1 -- 172.21.15.73:0/552708165 <== mon.2 v2:172.21.15.142:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f45881f2500 con 0x7f45881587a0 2023-12-12T09:43:29.473 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.447+0000 7fb518c2b640 1 --2- 172.21.15.73:0/1415977378 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fb4f806ae40 0x7fb4f806d300 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fb510035000 tx=0x7fb510030000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:43:29.473 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.447+0000 7fd686a00640 1 -- 172.21.15.73:0/2621135118 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd664005250 con 0x7fd6800c0710 2023-12-12T09:43:29.473 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.448+0000 7efcf5ffb640 1 -- 172.21.15.73:0/511337706 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efce8011710 con 0x7efcf80bd470 2023-12-12T09:43:29.474 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.448+0000 7fb509ffb640 1 -- 172.21.15.73:0/1415977378 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fb50c0544e0 con 0x7fb5140acdd0 2023-12-12T09:43:29.474 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.448+0000 7efcf5ffb640 1 -- 172.21.15.73:0/511337706 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efce800f050 con 0x7efcf80bd470 2023-12-12T09:43:29.474 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.448+0000 7efcf5ffb640 1 -- 172.21.15.73:0/511337706 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efce8011ad0 con 0x7efcf80bd470 2023-12-12T09:43:29.474 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.449+0000 7efcfeddc640 1 -- 172.21.15.73:0/511337706 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efcf81df240 con 0x7efcf80bd470 2023-12-12T09:43:29.474 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.449+0000 7fd67cff9640 1 -- 172.21.15.73:0/2621135118 <== mon.2 v2:172.21.15.142:3301/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fd67800cab0 con 0x7fd6800c0710 2023-12-12T09:43:29.475 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.450+0000 7efcfeddc640 1 -- 172.21.15.73:0/511337706 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efcf81df500 con 0x7efcf80bd470 2023-12-12T09:43:29.475 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.452+0000 7efcfeddc640 1 -- 172.21.15.73:0/511337706 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efcf80c41c0 con 0x7efcf80bd470 2023-12-12T09:43:29.475 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.452+0000 7fd67cff9640 1 --2- 172.21.15.73:0/2621135118 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fd66006aea0 0x7fd66006d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:29.475 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.452+0000 7fd67cff9640 1 -- 172.21.15.73:0/2621135118 <== mon.2 v2:172.21.15.142:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd678089340 con 0x7fd6800c0710 2023-12-12T09:43:29.475 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.453+0000 7fd67ffff640 1 --2- 172.21.15.73:0/2621135118 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fd66006aea0 0x7fd66006d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:29.476 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.453+0000 7efcf5ffb640 1 -- 172.21.15.73:0/511337706 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7efce8011c30 con 0x7efcf80bd470 2023-12-12T09:43:29.476 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.454+0000 7fd67ffff640 1 --2- 172.21.15.73:0/2621135118 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fd66006aea0 0x7fd66006d360 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fd6680099a0 tx=0x7fd6680090e0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:43:29.476 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.455+0000 7efcf5ffb640 1 --2- 172.21.15.73:0/511337706 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7efcd806af40 0x7efcd806d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:29.477 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.455+0000 7efcf5ffb640 1 -- 172.21.15.73:0/511337706 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7efce8089da0 con 0x7efcf80bd470 2023-12-12T09:43:29.477 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.455+0000 7efceffff640 1 --2- 172.21.15.73:0/511337706 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7efcd806af40 0x7efcd806d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:29.477 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.457+0000 7efceffff640 1 --2- 172.21.15.73:0/511337706 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7efcd806af40 0x7efcd806d400 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7efce0036000 tx=0x7efce0008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:43:29.477 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.462+0000 7fd67cff9640 1 -- 172.21.15.73:0/2621135118 <== mon.2 v2:172.21.15.142:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fd678054510 con 0x7fd6800c0710 2023-12-12T09:43:29.477 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.464+0000 7efcf5ffb640 1 -- 172.21.15.73:0/511337706 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7efce8054ec0 con 0x7efcf80bd470 2023-12-12T09:43:29.812 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.812+0000 7fa9d9ae0640 1 -- 172.21.15.73:0/229750765 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fa9d41ed940 con 0x7fa9d40c4540 2023-12-12T09:43:29.813 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.813+0000 7fa9cbfff640 1 -- 172.21.15.73:0/229750765 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fa9d41ed940 con 0x7fa9d40c4540 2023-12-12T09:43:29.813 INFO:teuthology.orchestra.run.smithi073.stdout:55834574853 2023-12-12T09:43:29.817 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.817+0000 7fa9d9ae0640 1 -- 172.21.15.73:0/229750765 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fa9b406aec0 msgr2=0x7fa9b406d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:29.817 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.817+0000 7fa9d9ae0640 1 --2- 172.21.15.73:0/229750765 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fa9b406aec0 0x7fa9b406d380 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fa9bc000f60 tx=0x7fa9bc009040 comp rx=0 tx=0).stop 2023-12-12T09:43:29.817 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.817+0000 7fa9d9ae0640 1 -- 172.21.15.73:0/229750765 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa9d40c4540 msgr2=0x7fa9d40aa850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:29.817 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.817+0000 7fa9d9ae0640 1 --2- 172.21.15.73:0/229750765 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa9d40c4540 0x7fa9d40aa850 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fa9cc0090b0 tx=0x7fa9cc0046c0 comp rx=0 tx=0).stop 2023-12-12T09:43:29.818 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.818+0000 7fa9d9ae0640 1 -- 172.21.15.73:0/229750765 shutdown_connections 2023-12-12T09:43:29.818 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.818+0000 7fa9d9ae0640 1 --2- 172.21.15.73:0/229750765 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fa9b406aec0 0x7fa9b406d380 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:29.818 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.818+0000 7fa9d9ae0640 1 --2- 172.21.15.73:0/229750765 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa9d40c4540 0x7fa9d40aa850 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:29.818 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.818+0000 7fa9d9ae0640 1 --2- 172.21.15.73:0/229750765 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa9d40c08d0 0x7fa9d40aa310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:29.818 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.818+0000 7fa9d9ae0640 1 --2- 172.21.15.73:0/229750765 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa9d40c04f0 0x7fa9d41dbcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:29.818 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.818+0000 7fa9d9ae0640 1 -- 172.21.15.73:0/229750765 >> 172.21.15.73:0/229750765 conn(0x7fa9d40c5900 msgr2=0x7fa9d4149f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:43:29.819 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.819+0000 7fa9d9ae0640 1 -- 172.21.15.73:0/229750765 shutdown_connections 2023-12-12T09:43:29.819 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.819+0000 7fa9d9ae0640 1 -- 172.21.15.73:0/229750765 wait complete. 2023-12-12T09:43:29.838 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.838+0000 7f98644e0640 1 -- 172.21.15.73:0/1000036414 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f985c067580 con 0x7f985c0c5090 2023-12-12T09:43:29.842 INFO:teuthology.orchestra.run.smithi073.stdout:55834574851 2023-12-12T09:43:29.842 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.839+0000 7f9852ffd640 1 -- 172.21.15.73:0/1000036414 <== mon.1 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f984c021020 con 0x7f985c0c5090 2023-12-12T09:43:29.844 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.843+0000 7f98644e0640 1 -- 172.21.15.73:0/1000036414 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f984006ae70 msgr2=0x7f984006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:29.845 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.843+0000 7f98644e0640 1 --2- 172.21.15.73:0/1000036414 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f984006ae70 0x7f984006d330 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f9858036000 tx=0x7f9858008030 comp rx=0 tx=0).stop 2023-12-12T09:43:29.845 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.843+0000 7f98644e0640 1 -- 172.21.15.73:0/1000036414 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f985c0c5090 msgr2=0x7f985c143b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:29.845 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.843+0000 7f98644e0640 1 --2- 172.21.15.73:0/1000036414 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f985c0c5090 0x7f985c143b40 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f984c00e820 tx=0x7f984c00ece0 comp rx=0 tx=0).stop 2023-12-12T09:43:29.845 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.844+0000 7f98644e0640 1 -- 172.21.15.73:0/1000036414 shutdown_connections 2023-12-12T09:43:29.845 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.844+0000 7f98644e0640 1 --2- 172.21.15.73:0/1000036414 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f984006ae70 0x7f984006d330 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:29.845 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.844+0000 7f98644e0640 1 --2- 172.21.15.73:0/1000036414 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f985c158660 0x7f985c144080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:29.845 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.844+0000 7f98644e0640 1 --2- 172.21.15.73:0/1000036414 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f985c0c5090 0x7f985c143b40 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:29.846 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.844+0000 7f98644e0640 1 --2- 172.21.15.73:0/1000036414 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f985c0c3920 0x7f985c0a9b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:29.846 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.844+0000 7f98644e0640 1 -- 172.21.15.73:0/1000036414 >> 172.21.15.73:0/1000036414 conn(0x7f985c0a77d0 msgr2=0x7f985c154d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:43:29.846 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.844+0000 7f98644e0640 1 -- 172.21.15.73:0/1000036414 shutdown_connections 2023-12-12T09:43:29.846 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.845+0000 7f98644e0640 1 -- 172.21.15.73:0/1000036414 wait complete. 2023-12-12T09:43:29.847 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.0 2023-12-12T09:43:29.852 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.852+0000 7fa3f0dc9640 1 -- 172.21.15.73:0/1922643610 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fa3ec0c74e0 con 0x7fa3ec0c6830 2023-12-12T09:43:29.852 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.852+0000 7fcd1a07c640 1 -- 172.21.15.73:0/1222539035 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fcd140beaa0 con 0x7fcd140bd4b0 2023-12-12T09:43:29.852 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.853+0000 7fcd10ff9640 1 -- 172.21.15.73:0/1222539035 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fcd140beaa0 con 0x7fcd140bd4b0 2023-12-12T09:43:29.853 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.853+0000 7fa3d3fff640 1 -- 172.21.15.73:0/1922643610 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fa3e0018020 con 0x7fa3ec0c6830 2023-12-12T09:43:29.853 INFO:teuthology.orchestra.run.smithi073.stdout:55834574851 2023-12-12T09:43:29.853 INFO:teuthology.orchestra.run.smithi073.stdout:55834574851 2023-12-12T09:43:29.857 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.856+0000 7fa3f0dc9640 1 -- 172.21.15.73:0/1922643610 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fa3d806af10 msgr2=0x7fa3d806d3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:29.857 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.856+0000 7fa3f0dc9640 1 --2- 172.21.15.73:0/1922643610 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fa3d806af10 0x7fa3d806d3d0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fa3dc034000 tx=0x7fa3dc02f000 comp rx=0 tx=0).stop 2023-12-12T09:43:29.858 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.856+0000 7fcd1a07c640 1 -- 172.21.15.73:0/1222539035 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fccf406ae90 msgr2=0x7fccf406d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:29.858 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.856+0000 7fcd1a07c640 1 --2- 172.21.15.73:0/1222539035 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fccf406ae90 0x7fccf406d350 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fcd14151260 tx=0x7fccfc008040 comp rx=0 tx=0).stop 2023-12-12T09:43:29.858 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.856+0000 7fcd1a07c640 1 -- 172.21.15.73:0/1222539035 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcd140bd4b0 msgr2=0x7fcd140ad8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:29.858 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.856+0000 7fcd1a07c640 1 --2- 172.21.15.73:0/1222539035 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcd140bd4b0 0x7fcd140ad8b0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fcd040096f0 tx=0x7fcd040046c0 comp rx=0 tx=0).stop 2023-12-12T09:43:29.858 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.856+0000 7fa3f0dc9640 1 -- 172.21.15.73:0/1922643610 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa3ec0c6830 msgr2=0x7fa3ec1ee600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:29.859 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.856+0000 7fa3f0dc9640 1 --2- 172.21.15.73:0/1922643610 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa3ec0c6830 0x7fa3ec1ee600 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fa3e000c460 tx=0x7fa3e000c920 comp rx=0 tx=0).stop 2023-12-12T09:43:29.859 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.857+0000 7fa3f0dc9640 1 -- 172.21.15.73:0/1922643610 shutdown_connections 2023-12-12T09:43:29.859 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.857+0000 7fa3f0dc9640 1 --2- 172.21.15.73:0/1922643610 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fa3d806af10 0x7fa3d806d3d0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:29.859 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.857+0000 7fa3f0dc9640 1 --2- 172.21.15.73:0/1922643610 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa3ec06fa20 0x7fa3ec153ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:29.859 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.857+0000 7fa3f0dc9640 1 --2- 172.21.15.73:0/1922643610 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa3ec0c6830 0x7fa3ec1ee600 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:29.859 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.857+0000 7fa3f0dc9640 1 --2- 172.21.15.73:0/1922643610 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa3ec0c1250 0x7fa3ec14f150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:29.859 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.857+0000 7fa3f0dc9640 1 -- 172.21.15.73:0/1922643610 >> 172.21.15.73:0/1922643610 conn(0x7fa3ec0a97f0 msgr2=0x7fa3ec06bdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:43:29.859 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.857+0000 7fcd1a07c640 1 -- 172.21.15.73:0/1222539035 shutdown_connections 2023-12-12T09:43:29.859 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.857+0000 7fcd1a07c640 1 --2- 172.21.15.73:0/1222539035 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fccf406ae90 0x7fccf406d350 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:29.860 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.857+0000 7fcd1a07c640 1 --2- 172.21.15.73:0/1222539035 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcd140c7d20 0x7fcd141f1ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:29.860 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.857+0000 7fcd1a07c640 1 --2- 172.21.15.73:0/1222539035 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcd140c47a0 0x7fcd141f17a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:29.860 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.857+0000 7fcd1a07c640 1 --2- 172.21.15.73:0/1222539035 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcd140bd4b0 0x7fcd140ad8b0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:29.860 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.857+0000 7fcd1a07c640 1 -- 172.21.15.73:0/1222539035 >> 172.21.15.73:0/1222539035 conn(0x7fcd140ab9d0 msgr2=0x7fcd140ca6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:43:29.860 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.857+0000 7fa3f0dc9640 1 -- 172.21.15.73:0/1922643610 shutdown_connections 2023-12-12T09:43:29.860 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.858+0000 7fa3f0dc9640 1 -- 172.21.15.73:0/1922643610 wait complete. 2023-12-12T09:43:29.860 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.857+0000 7fcd1a07c640 1 -- 172.21.15.73:0/1222539035 shutdown_connections 2023-12-12T09:43:29.861 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.858+0000 7fcd1a07c640 1 -- 172.21.15.73:0/1222539035 wait complete. 2023-12-12T09:43:29.861 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.858+0000 7f458cf3c640 1 -- 172.21.15.73:0/552708165 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f45881f2500 con 0x7f45881587a0 2023-12-12T09:43:29.861 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.859+0000 7f4576ffd640 1 -- 172.21.15.73:0/552708165 <== mon.2 v2:172.21.15.142:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f45881f2500 con 0x7f45881587a0 2023-12-12T09:43:29.861 INFO:teuthology.orchestra.run.smithi073.stdout:55834574851 2023-12-12T09:43:29.863 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.864+0000 7f458cf3c640 1 -- 172.21.15.73:0/552708165 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f456806ae70 msgr2=0x7f456806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:29.864 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.864+0000 7f458cf3c640 1 --2- 172.21.15.73:0/552708165 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f456806ae70 0x7f456806d330 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f4580036000 tx=0x7f4580030000 comp rx=0 tx=0).stop 2023-12-12T09:43:29.864 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.864+0000 7fd686a00640 1 -- 172.21.15.73:0/2621135118 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7fd6640057d0 con 0x7fd6800c0710 2023-12-12T09:43:29.865 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.864+0000 7f458cf3c640 1 -- 172.21.15.73:0/552708165 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f45881587a0 msgr2=0x7f45881ee840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:29.865 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.864+0000 7f458cf3c640 1 --2- 172.21.15.73:0/552708165 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f45881587a0 0x7f45881ee840 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f457c00b490 tx=0x7f457c00b950 comp rx=0 tx=0).stop 2023-12-12T09:43:29.865 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.864+0000 7f458cf3c640 1 -- 172.21.15.73:0/552708165 shutdown_connections 2023-12-12T09:43:29.865 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.864+0000 7f458cf3c640 1 --2- 172.21.15.73:0/552708165 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f456806ae70 0x7f456806d330 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:29.865 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.864+0000 7f458cf3c640 1 --2- 172.21.15.73:0/552708165 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f45881587a0 0x7f45881ee840 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:29.865 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.864+0000 7f458cf3c640 1 --2- 172.21.15.73:0/552708165 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4588155480 0x7f45880a7980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:29.865 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.864+0000 7f458cf3c640 1 --2- 172.21.15.73:0/552708165 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f458806aa20 0x7f45881f27e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:29.865 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.864+0000 7f458cf3c640 1 -- 172.21.15.73:0/552708165 >> 172.21.15.73:0/552708165 conn(0x7f45880c35d0 msgr2=0x7f4588153620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:43:29.865 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.864+0000 7f458cf3c640 1 -- 172.21.15.73:0/552708165 shutdown_connections 2023-12-12T09:43:29.865 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.864+0000 7f458cf3c640 1 -- 172.21.15.73:0/552708165 wait complete. 2023-12-12T09:43:29.866 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.865+0000 7fd67cff9640 1 -- 172.21.15.73:0/2621135118 <== mon.2 v2:172.21.15.142:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fd678057b30 con 0x7fd6800c0710 2023-12-12T09:43:29.866 INFO:teuthology.orchestra.run.smithi073.stdout:55834574851 2023-12-12T09:43:29.867 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.867+0000 7fb51b690640 1 -- 172.21.15.73:0/1415977378 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7fb51406dff0 con 0x7fb5140acdd0 2023-12-12T09:43:29.867 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.868+0000 7fb509ffb640 1 -- 172.21.15.73:0/1415977378 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fb50c022020 con 0x7fb5140acdd0 2023-12-12T09:43:29.868 INFO:teuthology.orchestra.run.smithi073.stdout:55834574853 2023-12-12T09:43:29.869 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.869+0000 7fd686a00640 1 -- 172.21.15.73:0/2621135118 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fd66006aea0 msgr2=0x7fd66006d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:29.869 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.869+0000 7fd686a00640 1 --2- 172.21.15.73:0/2621135118 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fd66006aea0 0x7fd66006d360 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fd6680099a0 tx=0x7fd6680090e0 comp rx=0 tx=0).stop 2023-12-12T09:43:29.869 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.869+0000 7fd686a00640 1 -- 172.21.15.73:0/2621135118 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd6800c0710 msgr2=0x7fd680158470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:29.869 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.869+0000 7fd686a00640 1 --2- 172.21.15.73:0/2621135118 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd6800c0710 0x7fd680158470 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fd67800e840 tx=0x7fd67800ed00 comp rx=0 tx=0).stop 2023-12-12T09:43:29.869 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.870+0000 7fd686a00640 1 -- 172.21.15.73:0/2621135118 shutdown_connections 2023-12-12T09:43:29.870 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.870+0000 7fd686a00640 1 --2- 172.21.15.73:0/2621135118 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fd66006aea0 0x7fd66006d360 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:29.870 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.870+0000 7fd686a00640 1 --2- 172.21.15.73:0/2621135118 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd680155dd0 0x7fd6801f1af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:29.870 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.870+0000 7fd686a00640 1 --2- 172.21.15.73:0/2621135118 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd6800c0710 0x7fd680158470 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:29.870 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.870+0000 7fd686a00640 1 --2- 172.21.15.73:0/2621135118 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd680071cc0 0x7fd680152580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:29.870 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.870+0000 7fd686a00640 1 -- 172.21.15.73:0/2621135118 >> 172.21.15.73:0/2621135118 conn(0x7fd6800a77d0 msgr2=0x7fd680071540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:43:29.871 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.871+0000 7fd686a00640 1 -- 172.21.15.73:0/2621135118 shutdown_connections 2023-12-12T09:43:29.871 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.871+0000 7fd686a00640 1 -- 172.21.15.73:0/2621135118 wait complete. 2023-12-12T09:43:29.871 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.871+0000 7fb51b690640 1 -- 172.21.15.73:0/1415977378 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fb4f806ae40 msgr2=0x7fb4f806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:29.872 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.871+0000 7fb51b690640 1 --2- 172.21.15.73:0/1415977378 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fb4f806ae40 0x7fb4f806d300 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fb510035000 tx=0x7fb510030000 comp rx=0 tx=0).stop 2023-12-12T09:43:29.872 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.871+0000 7fb51b690640 1 -- 172.21.15.73:0/1415977378 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb5140acdd0 msgr2=0x7fb5140aac00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:29.872 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.871+0000 7fb51b690640 1 --2- 172.21.15.73:0/1415977378 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb5140acdd0 0x7fb5140aac00 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fb50c00c780 tx=0x7fb50c00cc40 comp rx=0 tx=0).stop 2023-12-12T09:43:29.872 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.872+0000 7fb51b690640 1 -- 172.21.15.73:0/1415977378 shutdown_connections 2023-12-12T09:43:29.872 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.872+0000 7fb51b690640 1 --2- 172.21.15.73:0/1415977378 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fb4f806ae40 0x7fb4f806d300 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:29.872 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.872+0000 7fb51b690640 1 --2- 172.21.15.73:0/1415977378 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb514151a70 0x7fb51414a290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:29.872 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.872+0000 7fb51b690640 1 --2- 172.21.15.73:0/1415977378 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb5140c8150 0x7fb514149d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:29.873 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.872+0000 7fb51b690640 1 --2- 172.21.15.73:0/1415977378 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb5140acdd0 0x7fb5140aac00 secure :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fb50c00c780 tx=0x7fb50c00cc40 comp rx=0 tx=0).stop 2023-12-12T09:43:29.873 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.872+0000 7fb51b690640 1 -- 172.21.15.73:0/1415977378 >> 172.21.15.73:0/1415977378 conn(0x7fb5140abcb0 msgr2=0x7fb514153290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:43:29.873 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.872+0000 7fb51b690640 1 -- 172.21.15.73:0/1415977378 shutdown_connections 2023-12-12T09:43:29.873 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.872+0000 7fb51b690640 1 -- 172.21.15.73:0/1415977378 wait complete. 2023-12-12T09:43:29.874 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574852 got 55834574851 for osd.1 2023-12-12T09:43:29.874 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.874+0000 7efcfeddc640 1 -- 172.21.15.73:0/511337706 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7efcf8067580 con 0x7efcf80bd470 2023-12-12T09:43:29.875 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.875+0000 7efcf5ffb640 1 -- 172.21.15.73:0/511337706 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7efce8054ec0 con 0x7efcf80bd470 2023-12-12T09:43:29.875 INFO:teuthology.orchestra.run.smithi073.stdout:55834574853 2023-12-12T09:43:29.878 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.878+0000 7efcfeddc640 1 -- 172.21.15.73:0/511337706 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7efcd806af40 msgr2=0x7efcd806d400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:29.878 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.878+0000 7efcfeddc640 1 --2- 172.21.15.73:0/511337706 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7efcd806af40 0x7efcd806d400 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7efce0036000 tx=0x7efce0008030 comp rx=0 tx=0).stop 2023-12-12T09:43:29.879 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.878+0000 7efcfeddc640 1 -- 172.21.15.73:0/511337706 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efcf80bd470 msgr2=0x7efcf80c96f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:29.879 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.878+0000 7efcfeddc640 1 --2- 172.21.15.73:0/511337706 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efcf80bd470 0x7efcf80c96f0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7efce800bd30 tx=0x7efce800be20 comp rx=0 tx=0).stop 2023-12-12T09:43:29.880 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.878+0000 7efcfeddc640 1 -- 172.21.15.73:0/511337706 shutdown_connections 2023-12-12T09:43:29.880 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.878+0000 7efcfeddc640 1 --2- 172.21.15.73:0/511337706 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7efcd806af40 0x7efcd806d400 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:29.880 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.878+0000 7efcfeddc640 1 --2- 172.21.15.73:0/511337706 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efcf8155e40 0x7efcf814b400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:29.880 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.878+0000 7efcfeddc640 1 --2- 172.21.15.73:0/511337706 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efcf80c7cc0 0x7efcf814aec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:29.880 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.878+0000 7efcfeddc640 1 --2- 172.21.15.73:0/511337706 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efcf80bd470 0x7efcf80c96f0 secure :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7efce800bd30 tx=0x7efce800be20 comp rx=0 tx=0).stop 2023-12-12T09:43:29.880 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.878+0000 7efcfeddc640 1 -- 172.21.15.73:0/511337706 >> 172.21.15.73:0/511337706 conn(0x7efcf80ab950 msgr2=0x7efcf8151000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:43:29.880 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.879+0000 7efcfeddc640 1 -- 172.21.15.73:0/511337706 shutdown_connections 2023-12-12T09:43:29.880 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:29.880+0000 7efcfeddc640 1 -- 172.21.15.73:0/511337706 wait complete. 2023-12-12T09:43:29.881 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574852 got 55834574851 for osd.2 2023-12-12T09:43:29.883 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574852 got 55834574851 for osd.3 2023-12-12T09:43:29.893 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574852 got 55834574851 for osd.6 2023-12-12T09:43:29.896 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574852 got 55834574851 for osd.5 2023-12-12T09:43:29.900 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.4 2023-12-12T09:43:29.902 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.7 2023-12-12T09:43:30.849 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-12-12T09:43:30.875 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-12-12T09:43:30.881 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-12-12T09:43:30.884 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-12-12T09:43:30.894 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-12-12T09:43:30.897 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-12-12T09:43:30.900 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-12-12T09:43:30.903 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-12-12T09:43:31.146 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.144+0000 7fc008ba7640 1 Processor -- start 2023-12-12T09:43:31.146 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.145+0000 7fc008ba7640 1 -- start start 2023-12-12T09:43:31.149 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.147+0000 7fc008ba7640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fbffc0d78f0 0x7fbffc00ed80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:31.149 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.147+0000 7fc008ba7640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbffc00fcc0 0x7fbffc0069a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:31.150 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.148+0000 7fc008ba7640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbffc0d7cd0 con 0x7fbffc0506f0 2023-12-12T09:43:31.150 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.148+0000 7fc008ba7640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbffc0db220 con 0x7fbffc0d78f0 2023-12-12T09:43:31.150 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.148+0000 7fc008ba7640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbffc04b9d0 con 0x7fbffc00fcc0 2023-12-12T09:43:31.150 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.148+0000 7fc003fff640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbffc00fcc0 0x7fbffc0069a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:31.150 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.148+0000 7fc003fff640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbffc00fcc0 0x7fbffc0069a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.73:33788/0 (socket says 172.21.15.73:33788) 2023-12-12T09:43:31.150 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.148+0000 7fc003fff640 1 -- 172.21.15.73:0/3253640286 learned_addr learned my addr 172.21.15.73:0/3253640286 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:43:31.151 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.150+0000 7fc0037fe640 1 --2- 172.21.15.73:0/3253640286 >> v2:172.21.15.73:3300/0 conn(0x7fbffc0d78f0 0x7fbffc00ed80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:31.151 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.150+0000 7fc003fff640 1 -- 172.21.15.73:0/3253640286 >> v2:172.21.15.73:3300/0 conn(0x7fbffc0d78f0 msgr2=0x7fbffc00ed80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:43:31.151 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.150+0000 7fc003fff640 1 --2- 172.21.15.73:0/3253640286 >> v2:172.21.15.73:3300/0 conn(0x7fbffc0d78f0 0x7fbffc00ed80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:31.151 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.150+0000 7fc003fff640 1 -- 172.21.15.73:0/3253640286 >> v1:172.21.15.142:6789/0 conn(0x7fbffc0506f0 legacy=0x7fbffc006290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:31.151 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.151+0000 7fc003fff640 1 -- 172.21.15.73:0/3253640286 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbffc04bcb0 con 0x7fbffc00fcc0 2023-12-12T09:43:31.151 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.151+0000 7fc0037fe640 1 --2- 172.21.15.73:0/3253640286 >> v2:172.21.15.73:3300/0 conn(0x7fbffc0d78f0 0x7fbffc00ed80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-12T09:43:31.152 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.153+0000 7fc003fff640 1 --2- 172.21.15.73:0/3253640286 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbffc00fcc0 0x7fbffc0069a0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fbff0009870 tx=0x7fbff002b710 comp rx=0 tx=0).ready entity=mon.2 client_cookie=134031d1ea0d321a server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:43:31.153 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.153+0000 7fc0027fc640 1 -- 172.21.15.73:0/3253640286 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbff0030710 con 0x7fbffc00fcc0 2023-12-12T09:43:31.154 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.153+0000 7fc0027fc640 1 -- 172.21.15.73:0/3253640286 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbff002e050 con 0x7fbffc00fcc0 2023-12-12T09:43:31.154 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.153+0000 7fc0027fc640 1 -- 172.21.15.73:0/3253640286 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbff0030a90 con 0x7fbffc00fcc0 2023-12-12T09:43:31.154 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.154+0000 7fc008ba7640 1 -- 172.21.15.73:0/3253640286 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbffc00fcc0 msgr2=0x7fbffc0069a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:31.155 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.154+0000 7fc008ba7640 1 --2- 172.21.15.73:0/3253640286 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbffc00fcc0 0x7fbffc0069a0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fbff0009870 tx=0x7fbff002b710 comp rx=0 tx=0).stop 2023-12-12T09:43:31.155 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.155+0000 7fc008ba7640 1 -- 172.21.15.73:0/3253640286 shutdown_connections 2023-12-12T09:43:31.155 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.155+0000 7fc008ba7640 1 --2- 172.21.15.73:0/3253640286 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbffc00fcc0 0x7fbffc0069a0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:31.155 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.155+0000 7fc008ba7640 1 --2- 172.21.15.73:0/3253640286 >> v2:172.21.15.73:3300/0 conn(0x7fbffc0d78f0 0x7fbffc00ed80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:31.155 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.155+0000 7fc008ba7640 1 -- 172.21.15.73:0/3253640286 >> 172.21.15.73:0/3253640286 conn(0x7fbffc04fbd0 msgr2=0x7fbffc04ffe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:43:31.158 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.157+0000 7fc008ba7640 1 -- 172.21.15.73:0/3253640286 shutdown_connections 2023-12-12T09:43:31.158 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.157+0000 7fc008ba7640 1 -- 172.21.15.73:0/3253640286 wait complete. 2023-12-12T09:43:31.159 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.159+0000 7fc008ba7640 1 Processor -- start 2023-12-12T09:43:31.160 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.159+0000 7fc008ba7640 1 -- start start 2023-12-12T09:43:31.161 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.161+0000 7fc008ba7640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbffc00fcc0 0x7fbffc033110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:31.161 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.161+0000 7fc008ba7640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbffc0506f0 0x7fbffc033d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:31.161 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.161+0000 7fc008ba7640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbffc0d78f0 0x7fbffc0d2350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:31.161 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.161+0000 7fc008ba7640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbffc0c5eb0 con 0x7fbffc0d78f0 2023-12-12T09:43:31.161 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.161+0000 7fc008ba7640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbffc0d2010 con 0x7fbffc0506f0 2023-12-12T09:43:31.161 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.161+0000 7fc008ba7640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbffc0d4630 con 0x7fbffc00fcc0 2023-12-12T09:43:31.162 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.162+0000 7fc003fff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbffc0d78f0 0x7fbffc0d2350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:31.162 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.162+0000 7fc0037fe640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbffc00fcc0 0x7fbffc033110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:31.162 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.162+0000 7fc0037fe640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbffc00fcc0 0x7fbffc033110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.73:33790/0 (socket says 172.21.15.73:33790) 2023-12-12T09:43:31.162 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.162+0000 7fc0037fe640 1 -- 172.21.15.73:0/1165023180 learned_addr learned my addr 172.21.15.73:0/1165023180 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:43:31.163 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.163+0000 7fc002ffd640 1 --2- 172.21.15.73:0/1165023180 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbffc0506f0 0x7fbffc033d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:31.163 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.163+0000 7fc003fff640 1 -- 172.21.15.73:0/1165023180 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbffc00fcc0 msgr2=0x7fbffc033110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:31.163 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.163+0000 7fc003fff640 1 --2- 172.21.15.73:0/1165023180 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbffc00fcc0 0x7fbffc033110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:31.163 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.163+0000 7fc003fff640 1 -- 172.21.15.73:0/1165023180 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbffc0506f0 msgr2=0x7fbffc033d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:31.163 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.163+0000 7fc003fff640 1 --2- 172.21.15.73:0/1165023180 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbffc0506f0 0x7fbffc033d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:31.164 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.163+0000 7fc003fff640 1 -- 172.21.15.73:0/1165023180 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbff00094d0 con 0x7fbffc0d78f0 2023-12-12T09:43:31.164 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.164+0000 7fc003fff640 1 --2- 172.21.15.73:0/1165023180 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbffc0d78f0 0x7fbffc0d2350 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fbff0032000 tx=0x7fbff00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:43:31.165 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.165+0000 7fbfeffff640 1 -- 172.21.15.73:0/1165023180 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbff003b8d0 con 0x7fbffc0d78f0 2023-12-12T09:43:31.165 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.165+0000 7fbfeffff640 1 -- 172.21.15.73:0/1165023180 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbff003ba30 con 0x7fbffc0d78f0 2023-12-12T09:43:31.166 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.165+0000 7fbfeffff640 1 -- 172.21.15.73:0/1165023180 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbff003b8d0 con 0x7fbffc0d78f0 2023-12-12T09:43:31.166 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.167+0000 7fc008ba7640 1 -- 172.21.15.73:0/1165023180 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbffc0d4860 con 0x7fbffc0d78f0 2023-12-12T09:43:31.167 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.167+0000 7fc008ba7640 1 -- 172.21.15.73:0/1165023180 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbffc0d1c30 con 0x7fbffc0d78f0 2023-12-12T09:43:31.169 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.168+0000 7fc008ba7640 1 -- 172.21.15.73:0/1165023180 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbffc0d2150 con 0x7fbffc0d78f0 2023-12-12T09:43:31.175 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.172+0000 7fbfeffff640 1 -- 172.21.15.73:0/1165023180 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fbff0039040 con 0x7fbffc0d78f0 2023-12-12T09:43:31.175 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.173+0000 7fbfeffff640 1 --2- 172.21.15.73:0/1165023180 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fbfe806aed0 0x7fbfe806d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:31.175 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.174+0000 7fbfeffff640 1 -- 172.21.15.73:0/1165023180 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fbff00aad20 con 0x7fbffc0d78f0 2023-12-12T09:43:31.176 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.174+0000 7fc0037fe640 1 --2- 172.21.15.73:0/1165023180 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fbfe806aed0 0x7fbfe806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:31.176 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.176+0000 7fc0037fe640 1 --2- 172.21.15.73:0/1165023180 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fbfe806aed0 0x7fbfe806d390 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fbff8006d40 tx=0x7fbff8008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:43:31.182 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.182+0000 7fbfeffff640 1 -- 172.21.15.73:0/1165023180 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fbffc0d2150 con 0x7fbffc0d78f0 2023-12-12T09:43:31.182 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.183+0000 7fc1721dc640 1 Processor -- start 2023-12-12T09:43:31.183 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.183+0000 7fc1721dc640 1 -- start start 2023-12-12T09:43:31.186 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.185+0000 7fc1721dc640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fc16c151a70 0x7fc16c154f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:31.186 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.185+0000 7fc1721dc640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fc16c0ad230 0x7fc16c0c8860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:31.186 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.185+0000 7fc1721dc640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc16c0c7cc0 con 0x7fc16c0acdd0 2023-12-12T09:43:31.186 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.185+0000 7fc1721dc640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc16c0ad6a0 con 0x7fc16c151a70 2023-12-12T09:43:31.186 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.185+0000 7fc1721dc640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc16c0c8da0 con 0x7fc16c0ad230 2023-12-12T09:43:31.187 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.187+0000 7fc16bfff640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fc16c0ad230 0x7fc16c0c8860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:31.187 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.187+0000 7fc16affd640 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7fc16c0acdd0 0x7fc16c0c8150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.73:56916/0 (socket says 172.21.15.73:56916) 2023-12-12T09:43:31.188 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.185+0000 7fa54ae02640 1 Processor -- start 2023-12-12T09:43:31.188 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.186+0000 7fa54ae02640 1 -- start start 2023-12-12T09:43:31.188 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.187+0000 7fa54ae02640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fa544155ef0 0x7fa5440aee50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:31.188 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.188+0000 7fa54ae02640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fa5440c49d0 0x7fa5440acdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:31.188 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.188+0000 7fa54ae02640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5440c7cc0 con 0x7fa5440ad310 2023-12-12T09:43:31.188 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.188+0000 7fa54ae02640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5441598c0 con 0x7fa544155ef0 2023-12-12T09:43:31.188 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.188+0000 7fa54ae02640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5441562d0 con 0x7fa5440c49d0 2023-12-12T09:43:31.188 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.188+0000 7fc16affd640 1 -- 172.21.15.73:0/591574177 learned_addr learned my addr 172.21.15.73:0/591574177 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-12T09:43:31.189 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.188+0000 7fa548b9e640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fa544155ef0 0x7fa5440aee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:31.189 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.188+0000 7fa548b9e640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fa544155ef0 0x7fa5440aee50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:56744/0 (socket says 172.21.15.73:56744) 2023-12-12T09:43:31.189 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.188+0000 7fa548b9e640 1 -- 172.21.15.73:0/96968448 learned_addr learned my addr 172.21.15.73:0/96968448 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:43:31.189 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.189+0000 7fc16a7fc640 1 -- 172.21.15.73:0/591574177 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1261138553 0 0) 0x7fc16c0c7cc0 con 0x7fc16c0acdd0 2023-12-12T09:43:31.190 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.189+0000 7fa548b9e640 1 -- 172.21.15.73:0/96968448 >> v2:172.21.15.142:3300/0 conn(0x7fa5440c49d0 msgr2=0x7fa5440acdd0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-12-12T09:43:31.190 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.189+0000 7fa548b9e640 1 --2- 172.21.15.73:0/96968448 >> v2:172.21.15.142:3300/0 conn(0x7fa5440c49d0 0x7fa5440acdd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:31.190 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.189+0000 7fa548b9e640 1 -- 172.21.15.73:0/96968448 >> v1:172.21.15.142:6789/0 conn(0x7fa5440ad310 legacy=0x7fa5440c8150 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-12-12T09:43:31.190 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.189+0000 7fa548b9e640 1 -- 172.21.15.73:0/96968448 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5440c97b0 con 0x7fa544155ef0 2023-12-12T09:43:31.190 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.189+0000 7fc16a7fc640 1 -- 172.21.15.73:0/591574177 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc154003520 con 0x7fc16c0acdd0 2023-12-12T09:43:31.190 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.191+0000 7fa548b9e640 1 --2- 172.21.15.73:0/96968448 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa544155ef0 0x7fa5440aee50 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fa5440c7920 tx=0x7fa53c02b810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4c34eb431e291 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:43:31.191 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.189+0000 7fc16bfff640 1 -- 172.21.15.73:0/591574177 >> v2:172.21.15.73:3300/0 conn(0x7fc16c151a70 msgr2=0x7fc16c154f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:43:31.191 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.189+0000 7fc16bfff640 1 --2- 172.21.15.73:0/591574177 >> v2:172.21.15.73:3300/0 conn(0x7fc16c151a70 0x7fc16c154f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:31.191 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.190+0000 7fc16bfff640 1 -- 172.21.15.73:0/591574177 >> v1:172.21.15.142:6789/0 conn(0x7fc16c0acdd0 legacy=0x7fc16c0c8150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:31.191 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.190+0000 7fc16bfff640 1 -- 172.21.15.73:0/591574177 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc16c0c9c00 con 0x7fc16c0ad230 2023-12-12T09:43:31.191 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.191+0000 7fa5437fe640 1 -- 172.21.15.73:0/96968448 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa53c031770 con 0x7fa544155ef0 2023-12-12T09:43:31.192 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.192+0000 7fc16bfff640 1 --2- 172.21.15.73:0/591574177 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc16c0ad230 0x7fc16c0c8860 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fc15c0097a0 tx=0x7fc15c02b7f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=574fc5608f10cf8d server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:43:31.192 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.191+0000 7fa5437fe640 1 -- 172.21.15.73:0/96968448 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa53c0318d0 con 0x7fa544155ef0 2023-12-12T09:43:31.192 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.191+0000 7fa5437fe640 1 -- 172.21.15.73:0/96968448 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa53c031c60 con 0x7fa544155ef0 2023-12-12T09:43:31.192 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.192+0000 7fc16a7fc640 1 -- 172.21.15.73:0/591574177 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc15c031750 con 0x7fc16c0ad230 2023-12-12T09:43:31.192 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.192+0000 7fc16a7fc640 1 -- 172.21.15.73:0/591574177 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc15c0318b0 con 0x7fc16c0ad230 2023-12-12T09:43:31.193 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.192+0000 7fc16a7fc640 1 -- 172.21.15.73:0/591574177 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc15c031c60 con 0x7fc16c0ad230 2023-12-12T09:43:31.193 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.193+0000 7fc1721dc640 1 -- 172.21.15.73:0/591574177 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc16c0ad230 msgr2=0x7fc16c0c8860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:31.193 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.193+0000 7fc1721dc640 1 --2- 172.21.15.73:0/591574177 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc16c0ad230 0x7fc16c0c8860 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fc15c0097a0 tx=0x7fc15c02b7f0 comp rx=0 tx=0).stop 2023-12-12T09:43:31.194 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.193+0000 7fa54ae02640 1 -- 172.21.15.73:0/96968448 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa544155ef0 msgr2=0x7fa5440aee50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:31.194 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.193+0000 7fa54ae02640 1 --2- 172.21.15.73:0/96968448 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa544155ef0 0x7fa5440aee50 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fa5440c7920 tx=0x7fa53c02b810 comp rx=0 tx=0).stop 2023-12-12T09:43:31.194 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.194+0000 7fc1721dc640 1 -- 172.21.15.73:0/591574177 shutdown_connections 2023-12-12T09:43:31.194 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.194+0000 7fc1721dc640 1 --2- 172.21.15.73:0/591574177 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc16c0ad230 0x7fc16c0c8860 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:31.194 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.194+0000 7fc1721dc640 1 --2- 172.21.15.73:0/591574177 >> v2:172.21.15.73:3300/0 conn(0x7fc16c151a70 0x7fc16c154f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:31.194 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.194+0000 7fc1721dc640 1 -- 172.21.15.73:0/591574177 >> 172.21.15.73:0/591574177 conn(0x7fc16c0abcb0 msgr2=0x7fc16c0ac0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:43:31.195 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.195+0000 7fa54ae02640 1 -- 172.21.15.73:0/96968448 shutdown_connections 2023-12-12T09:43:31.195 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.195+0000 7fa54ae02640 1 --2- 172.21.15.73:0/96968448 >> v2:172.21.15.142:3300/0 conn(0x7fa5440c49d0 0x7fa5440acdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:31.195 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.195+0000 7fa54ae02640 1 --2- 172.21.15.73:0/96968448 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa544155ef0 0x7fa5440aee50 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:31.195 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.195+0000 7fa54ae02640 1 -- 172.21.15.73:0/96968448 >> 172.21.15.73:0/96968448 conn(0x7fa5440abcb0 msgr2=0x7fa5440ac0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:43:31.195 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.195+0000 7fc1721dc640 1 -- 172.21.15.73:0/591574177 shutdown_connections 2023-12-12T09:43:31.195 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.195+0000 7fc1721dc640 1 -- 172.21.15.73:0/591574177 wait complete. 2023-12-12T09:43:31.196 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.197+0000 7fa54ae02640 1 -- 172.21.15.73:0/96968448 shutdown_connections 2023-12-12T09:43:31.196 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.197+0000 7fa54ae02640 1 -- 172.21.15.73:0/96968448 wait complete. 2023-12-12T09:43:31.198 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.198+0000 7fc1721dc640 1 Processor -- start 2023-12-12T09:43:31.198 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.198+0000 7fc1721dc640 1 -- start start 2023-12-12T09:43:31.200 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.200+0000 7fc1721dc640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc16c0acdd0 0x7fc16c1563c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:31.200 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.200+0000 7fc1721dc640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc16c0ad230 0x7fc16c157ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:31.200 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.200+0000 7fc1721dc640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc16c151a70 0x7fc16c158400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:31.201 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.201+0000 7fc16affd640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc16c0ad230 0x7fc16c157ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:31.201 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.201+0000 7fc16b7fe640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc16c0acdd0 0x7fc16c1563c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:31.201 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.201+0000 7fc16b7fe640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc16c0acdd0 0x7fc16c1563c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.73:33792/0 (socket says 172.21.15.73:33792) 2023-12-12T09:43:31.201 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.201+0000 7fc16affd640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc16c0ad230 0x7fc16c157ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:56754/0 (socket says 172.21.15.73:56754) 2023-12-12T09:43:31.201 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.201+0000 7fc16bfff640 1 --2- 172.21.15.73:0/221482824 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc16c151a70 0x7fc16c158400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:31.201 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.201+0000 7fc16b7fe640 1 -- 172.21.15.73:0/221482824 learned_addr learned my addr 172.21.15.73:0/221482824 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:43:31.202 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.201+0000 7fc1721dc640 1 -- 172.21.15.73:0/221482824 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc16c144720 con 0x7fc16c0ad230 2023-12-12T09:43:31.202 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.201+0000 7fc1721dc640 1 -- 172.21.15.73:0/221482824 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc16c158940 con 0x7fc16c151a70 2023-12-12T09:43:31.202 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.201+0000 7fc1721dc640 1 -- 172.21.15.73:0/221482824 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc16c06ae80 con 0x7fc16c0acdd0 2023-12-12T09:43:31.202 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.199+0000 7fa54ae02640 1 Processor -- start 2023-12-12T09:43:31.203 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.202+0000 7fc16affd640 1 -- 172.21.15.73:0/221482824 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc16c0acdd0 msgr2=0x7fc16c1563c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:31.203 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.202+0000 7fc16affd640 1 --2- 172.21.15.73:0/221482824 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc16c0acdd0 0x7fc16c1563c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:31.203 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.202+0000 7fc16affd640 1 -- 172.21.15.73:0/221482824 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc16c151a70 msgr2=0x7fc16c158400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:31.203 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.203+0000 7fa54ae02640 1 -- start start 2023-12-12T09:43:31.204 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.202+0000 7fc16affd640 1 --2- 172.21.15.73:0/221482824 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc16c151a70 0x7fc16c158400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:31.204 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.202+0000 7fc16affd640 1 -- 172.21.15.73:0/221482824 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc15c009400 con 0x7fc16c0ad230 2023-12-12T09:43:31.204 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.204+0000 7fc16affd640 1 --2- 172.21.15.73:0/221482824 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc16c0ad230 0x7fc16c157ec0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fc16000c430 tx=0x7fc16000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:43:31.204 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.204+0000 7fa54ae02640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa5440ad310 0x7fa544159c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:31.205 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.204+0000 7fa54ae02640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa5440c49d0 0x7fa5441e5420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:31.205 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.204+0000 7fa54ae02640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa544155ef0 0x7fa5441e5960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:31.205 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.204+0000 7fa54ae02640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5441e3d30 con 0x7fa5440c49d0 2023-12-12T09:43:31.205 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.204+0000 7fa54ae02640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa54415b980 con 0x7fa5440ad310 2023-12-12T09:43:31.205 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.204+0000 7fa54ae02640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5441522e0 con 0x7fa544155ef0 2023-12-12T09:43:31.205 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.204+0000 7fc16b7fe640 1 --2- 172.21.15.73:0/221482824 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc16c0acdd0 0x7fc16c1563c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:43:31.205 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.204+0000 7fc153fff640 1 -- 172.21.15.73:0/221482824 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc160005ce0 con 0x7fc16c0ad230 2023-12-12T09:43:31.206 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.205+0000 7fc153fff640 1 -- 172.21.15.73:0/221482824 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc160005e40 con 0x7fc16c0ad230 2023-12-12T09:43:31.206 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.205+0000 7fc153fff640 1 -- 172.21.15.73:0/221482824 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1600072d0 con 0x7fc16c0ad230 2023-12-12T09:43:31.206 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.205+0000 7fa543fff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa5440c49d0 0x7fa5441e5420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:31.206 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.205+0000 7fa543fff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa5440c49d0 0x7fa5441e5420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:56756/0 (socket says 172.21.15.73:56756) 2023-12-12T09:43:31.206 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.205+0000 7fa543fff640 1 -- 172.21.15.73:0/3421681105 learned_addr learned my addr 172.21.15.73:0/3421681105 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:43:31.207 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.205+0000 7fa548b9e640 1 --2- 172.21.15.73:0/3421681105 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa5440ad310 0x7fa544159c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:31.207 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.205+0000 7fa54939f640 1 --2- 172.21.15.73:0/3421681105 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa544155ef0 0x7fa5441e5960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:31.207 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.205+0000 7fc1721dc640 1 -- 172.21.15.73:0/221482824 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc16c06ca50 con 0x7fc16c0ad230 2023-12-12T09:43:31.207 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.206+0000 7fa543fff640 1 -- 172.21.15.73:0/3421681105 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa544155ef0 msgr2=0x7fa5441e5960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:31.208 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.206+0000 7fa543fff640 1 --2- 172.21.15.73:0/3421681105 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa544155ef0 0x7fa5441e5960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:31.208 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.206+0000 7fa543fff640 1 -- 172.21.15.73:0/3421681105 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa5440ad310 msgr2=0x7fa544159c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:31.208 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.206+0000 7fa543fff640 1 --2- 172.21.15.73:0/3421681105 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa5440ad310 0x7fa544159c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:31.208 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.206+0000 7fa543fff640 1 -- 172.21.15.73:0/3421681105 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa53c0094d0 con 0x7fa5440c49d0 2023-12-12T09:43:31.208 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.206+0000 7fa54939f640 1 --2- 172.21.15.73:0/3421681105 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa544155ef0 0x7fa5441e5960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-12T09:43:31.208 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.207+0000 7fa543fff640 1 --2- 172.21.15.73:0/3421681105 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa5440c49d0 0x7fa5441e5420 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fa53400ba50 tx=0x7fa53400bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:43:31.208 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.207+0000 7f7957675640 1 Processor -- start 2023-12-12T09:43:31.208 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.205+0000 7fc1721dc640 1 -- 172.21.15.73:0/221482824 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc16c144f80 con 0x7fc16c0ad230 2023-12-12T09:43:31.209 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.207+0000 7f7957675640 1 -- start start 2023-12-12T09:43:31.209 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.208+0000 7fe1d3fff640 1 Processor -- start 2023-12-12T09:43:31.209 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.209+0000 7fa5417fa640 1 -- 172.21.15.73:0/3421681105 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa53400cc10 con 0x7fa5440c49d0 2023-12-12T09:43:31.210 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.208+0000 7fc1721dc640 1 -- 172.21.15.73:0/221482824 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc14c005250 con 0x7fc16c0ad230 2023-12-12T09:43:31.210 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.209+0000 7fa5417fa640 1 -- 172.21.15.73:0/3421681105 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa53400cd70 con 0x7fa5440c49d0 2023-12-12T09:43:31.210 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.209+0000 7fa5417fa640 1 -- 172.21.15.73:0/3421681105 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa534014680 con 0x7fa5440c49d0 2023-12-12T09:43:31.210 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.209+0000 7fe1d3fff640 1 -- start start 2023-12-12T09:43:31.211 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.209+0000 7f7957675640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f7950155dd0 0x7f7950159440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:31.211 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.209+0000 7f7957675640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f795006c9d0 con 0x7f79500c0710 2023-12-12T09:43:31.211 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.209+0000 7f7957675640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79500c1b80 con 0x7f7950071cc0 2023-12-12T09:43:31.211 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.209+0000 7f7957675640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79500c1e60 con 0x7f7950155dd0 2023-12-12T09:43:31.211 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.210+0000 7f7954c10640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f79500c0710 0x7f79500c0c60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:34354/0 (socket says 172.21.15.73:34354) 2023-12-12T09:43:31.211 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.210+0000 7f7954c10640 1 -- 172.21.15.73:0/2448659533 learned_addr learned my addr 172.21.15.73:0/2448659533 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-12T09:43:31.211 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.210+0000 7fa54ae02640 1 -- 172.21.15.73:0/3421681105 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa544152000 con 0x7fa5440c49d0 2023-12-12T09:43:31.211 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.210+0000 7fa54ae02640 1 -- 172.21.15.73:0/3421681105 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5441eefb0 con 0x7fa5440c49d0 2023-12-12T09:43:31.212 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.210+0000 7f7955411640 1 --2- 172.21.15.73:0/2448659533 >> v2:172.21.15.142:3300/0 conn(0x7f7950155dd0 0x7f7950159440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:31.212 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.211+0000 7fc153fff640 1 -- 172.21.15.73:0/221482824 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fc160007430 con 0x7fc16c0ad230 2023-12-12T09:43:31.212 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.211+0000 7fe1d3fff640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe1cc0d88e0 0x7fe1cc040980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:31.212 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.211+0000 7fafd14bb640 1 Processor -- start 2023-12-12T09:43:31.213 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.212+0000 7fafd14bb640 1 -- start start 2023-12-12T09:43:31.213 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.211+0000 7f7955411640 1 -- 172.21.15.73:0/2448659533 >> v1:172.21.15.142:6789/0 conn(0x7f7950071cc0 legacy=0x7f79500720f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:31.213 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.211+0000 7f7955411640 1 -- 172.21.15.73:0/2448659533 >> v1:172.21.15.73:6789/0 conn(0x7f79500c0710 legacy=0x7f79500c0c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:31.213 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.211+0000 7f7955411640 1 -- 172.21.15.73:0/2448659533 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f795006c660 con 0x7f7950155dd0 2023-12-12T09:43:31.214 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.213+0000 7fc153fff640 1 --2- 172.21.15.73:0/221482824 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fc15806af40 0x7fc15806d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:31.214 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.213+0000 7f7955411640 1 --2- 172.21.15.73:0/2448659533 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7950155dd0 0x7f7950159440 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f79400097a0 tx=0x7f794002b980 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fe4fe85266ff3658 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:43:31.214 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.214+0000 7fc153fff640 1 -- 172.21.15.73:0/221482824 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc160088ac0 con 0x7fc16c0ad230 2023-12-12T09:43:31.214 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.214+0000 7fc16b7fe640 1 --2- 172.21.15.73:0/221482824 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fc15806af40 0x7fc15806d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:31.215 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.211+0000 7fe1d3fff640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fe1cc04e660 0x7fe1cc00c3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:31.215 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.211+0000 7fe1d3fff640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1cc0de800 con 0x7fe1cc040ec0 2023-12-12T09:43:31.215 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.211+0000 7fe1d3fff640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1cc0deae0 con 0x7fe1cc04e660 2023-12-12T09:43:31.215 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.211+0000 7fe1d3fff640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1cc0dedc0 con 0x7fe1cc0d88e0 2023-12-12T09:43:31.215 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.212+0000 7fe1d2ffd640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe1cc0d88e0 0x7fe1cc040980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:31.215 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.212+0000 7fe1d2ffd640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe1cc0d88e0 0x7fe1cc040980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.73:33812/0 (socket says 172.21.15.73:33812) 2023-12-12T09:43:31.215 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.212+0000 7fe1d2ffd640 1 -- 172.21.15.73:0/3082407540 learned_addr learned my addr 172.21.15.73:0/3082407540 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:43:31.216 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.212+0000 7fe1d27fc640 1 --2- 172.21.15.73:0/3082407540 >> v2:172.21.15.142:3300/0 conn(0x7fe1cc04e660 0x7fe1cc00c3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:31.216 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.213+0000 7fe1d2ffd640 1 -- 172.21.15.73:0/3082407540 >> v2:172.21.15.142:3300/0 conn(0x7fe1cc04e660 msgr2=0x7fe1cc00c3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:43:31.218 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.213+0000 7fe1d2ffd640 1 --2- 172.21.15.73:0/3082407540 >> v2:172.21.15.142:3300/0 conn(0x7fe1cc04e660 0x7fe1cc00c3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:31.218 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.213+0000 7fe1d2ffd640 1 -- 172.21.15.73:0/3082407540 >> v1:172.21.15.73:6789/0 conn(0x7fe1cc040ec0 legacy=0x7fe1cc00c8e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-12-12T09:43:31.218 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.213+0000 7fe1d2ffd640 1 -- 172.21.15.73:0/3082407540 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1cc0df0a0 con 0x7fe1cc0d88e0 2023-12-12T09:43:31.219 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.214+0000 7fafd14bb640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fafc40d8760 0x7fafc40df120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:31.219 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.214+0000 7fafd14bb640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fafc4006470 0x7fafc40068e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:31.219 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.214+0000 7fafd14bb640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fafc404c470 con 0x7fafc4049f70 2023-12-12T09:43:31.219 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.214+0000 7fafd14bb640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fafc404b8a0 con 0x7fafc4006470 2023-12-12T09:43:31.219 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.214+0000 7fafd14bb640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fafc40d8b40 con 0x7fafc40d8760 2023-12-12T09:43:31.219 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.215+0000 7f7947fff640 1 -- 172.21.15.73:0/2448659533 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7940030840 con 0x7f7950155dd0 2023-12-12T09:43:31.219 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.215+0000 7f7947fff640 1 -- 172.21.15.73:0/2448659533 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79400309a0 con 0x7f7950155dd0 2023-12-12T09:43:31.220 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.215+0000 7fa54ae02640 1 -- 172.21.15.73:0/3421681105 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa54415bb10 con 0x7fa5440c49d0 2023-12-12T09:43:31.220 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.215+0000 7f7947fff640 1 -- 172.21.15.73:0/2448659533 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7940030d70 con 0x7f7950155dd0 2023-12-12T09:43:31.220 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.215+0000 7fafcbfff640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fafc40d8760 0x7fafc40df120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:31.220 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.215+0000 7fafd0cba640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fafc4006470 0x7fafc40068e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:31.220 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.215+0000 7fafcb7fe640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7fafc4049f70 0x7fafc400ed80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:34364/0 (socket says 172.21.15.73:34364) 2023-12-12T09:43:31.220 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.215+0000 7fafcb7fe640 1 -- 172.21.15.73:0/3861189085 learned_addr learned my addr 172.21.15.73:0/3861189085 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-12T09:43:31.221 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.216+0000 7fe1d2ffd640 1 --2- 172.21.15.73:0/3082407540 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe1cc0d88e0 0x7fe1cc040980 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fe1bc009870 tx=0x7fe1bc02b880 comp rx=0 tx=0).ready entity=mon.2 client_cookie=aeab3bee1d2cdd27 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:43:31.221 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.216+0000 7fafd0cba640 1 -- 172.21.15.73:0/3861189085 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fafc40d8760 msgr2=0x7fafc40df120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:43:31.221 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.216+0000 7fafd0cba640 1 --2- 172.21.15.73:0/3861189085 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fafc40d8760 0x7fafc40df120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:31.221 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.217+0000 7f7957675640 1 -- 172.21.15.73:0/2448659533 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7950155dd0 msgr2=0x7f7950159440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:31.221 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.217+0000 7f7957675640 1 --2- 172.21.15.73:0/2448659533 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7950155dd0 0x7f7950159440 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f79400097a0 tx=0x7f794002b980 comp rx=0 tx=0).stop 2023-12-12T09:43:31.222 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.217+0000 7fa5417fa640 1 -- 172.21.15.73:0/3421681105 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fa53401d3b0 con 0x7fa5440c49d0 2023-12-12T09:43:31.222 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.217+0000 7f7957675640 1 -- 172.21.15.73:0/2448659533 shutdown_connections 2023-12-12T09:43:31.222 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.217+0000 7f7957675640 1 --2- 172.21.15.73:0/2448659533 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7950155dd0 0x7f7950159440 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:31.222 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.218+0000 7f7957675640 1 -- 172.21.15.73:0/2448659533 >> 172.21.15.73:0/2448659533 conn(0x7f79500a77d0 msgr2=0x7f79500a7bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:43:31.222 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.218+0000 7f7957675640 1 -- 172.21.15.73:0/2448659533 shutdown_connections 2023-12-12T09:43:31.222 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.218+0000 7f7957675640 1 -- 172.21.15.73:0/2448659533 wait complete. 2023-12-12T09:43:31.223 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.216+0000 7fafd0cba640 1 -- 172.21.15.73:0/3861189085 >> v1:172.21.15.73:6789/0 conn(0x7fafc4049f70 legacy=0x7fafc400ed80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:31.223 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.216+0000 7fafd0cba640 1 -- 172.21.15.73:0/3861189085 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafc404bb40 con 0x7fafc4006470 2023-12-12T09:43:31.223 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.218+0000 7fafd0cba640 1 --2- 172.21.15.73:0/3861189085 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fafc4006470 0x7fafc40068e0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fafcc0696d0 tx=0x7fafcc0a5d30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=da691263e6cbed6e server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:43:31.223 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.217+0000 7fe1d1ffb640 1 -- 172.21.15.73:0/3082407540 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1bc0317e0 con 0x7fe1cc0d88e0 2023-12-12T09:43:31.223 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.217+0000 7fe1d1ffb640 1 -- 172.21.15.73:0/3082407540 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1bc031940 con 0x7fe1cc0d88e0 2023-12-12T09:43:31.223 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.217+0000 7fe1d1ffb640 1 -- 172.21.15.73:0/3082407540 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1bc031d10 con 0x7fe1cc0d88e0 2023-12-12T09:43:31.223 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.218+0000 7fe1d3fff640 1 -- 172.21.15.73:0/3082407540 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe1cc0d88e0 msgr2=0x7fe1cc040980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:31.224 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.219+0000 7fe1d3fff640 1 --2- 172.21.15.73:0/3082407540 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe1cc0d88e0 0x7fe1cc040980 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fe1bc009870 tx=0x7fe1bc02b880 comp rx=0 tx=0).stop 2023-12-12T09:43:31.224 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.218+0000 7fafcaffd640 1 -- 172.21.15.73:0/3861189085 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafcc0a6be0 con 0x7fafc4006470 2023-12-12T09:43:31.224 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.218+0000 7fafcaffd640 1 -- 172.21.15.73:0/3861189085 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafcc0a6d40 con 0x7fafc4006470 2023-12-12T09:43:31.224 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.218+0000 7fafcaffd640 1 -- 172.21.15.73:0/3861189085 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafcc0ae640 con 0x7fafc4006470 2023-12-12T09:43:31.225 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.218+0000 7fc16b7fe640 1 --2- 172.21.15.73:0/221482824 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fc15806af40 0x7fc15806d400 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fc16400a450 tx=0x7fc164007560 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:43:31.225 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.219+0000 7fe1d3fff640 1 -- 172.21.15.73:0/3082407540 shutdown_connections 2023-12-12T09:43:31.225 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.219+0000 7fe1d3fff640 1 --2- 172.21.15.73:0/3082407540 >> v2:172.21.15.142:3300/0 conn(0x7fe1cc04e660 0x7fe1cc00c3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:31.225 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.219+0000 7fe1d3fff640 1 --2- 172.21.15.73:0/3082407540 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe1cc0d88e0 0x7fe1cc040980 secure :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fe1bc009870 tx=0x7fe1bc02b880 comp rx=0 tx=0).stop 2023-12-12T09:43:31.225 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.219+0000 7fe1d3fff640 1 -- 172.21.15.73:0/3082407540 >> 172.21.15.73:0/3082407540 conn(0x7fe1cc04d9b0 msgr2=0x7fe1cc04ddc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:43:31.226 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.219+0000 7fafd14bb640 1 -- 172.21.15.73:0/3861189085 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fafc4006470 msgr2=0x7fafc40068e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:31.226 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.219+0000 7fe1d3fff640 1 -- 172.21.15.73:0/3082407540 shutdown_connections 2023-12-12T09:43:31.226 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.219+0000 7fa5417fa640 1 --2- 172.21.15.73:0/3421681105 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fa52406ae90 0x7fa52406d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:31.226 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.219+0000 7fe1d3fff640 1 -- 172.21.15.73:0/3082407540 wait complete. 2023-12-12T09:43:31.227 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.219+0000 7fafd14bb640 1 --2- 172.21.15.73:0/3861189085 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fafc4006470 0x7fafc40068e0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fafcc0696d0 tx=0x7fafcc0a5d30 comp rx=0 tx=0).stop 2023-12-12T09:43:31.227 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.220+0000 7fa548b9e640 1 --2- 172.21.15.73:0/3421681105 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fa52406ae90 0x7fa52406d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:31.227 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.220+0000 7fafd14bb640 1 -- 172.21.15.73:0/3861189085 shutdown_connections 2023-12-12T09:43:31.228 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.220+0000 7fafd14bb640 1 --2- 172.21.15.73:0/3861189085 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fafc4006470 0x7fafc40068e0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:31.228 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.220+0000 7fafd14bb640 1 --2- 172.21.15.73:0/3861189085 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fafc40d8760 0x7fafc40df120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:31.228 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.220+0000 7fafd14bb640 1 -- 172.21.15.73:0/3861189085 >> 172.21.15.73:0/3861189085 conn(0x7fafc404fbd0 msgr2=0x7fafc404ffe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:43:31.228 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.220+0000 7fafd14bb640 1 -- 172.21.15.73:0/3861189085 shutdown_connections 2023-12-12T09:43:31.228 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.221+0000 7fa548b9e640 1 --2- 172.21.15.73:0/3421681105 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fa52406ae90 0x7fa52406d350 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fa53c036000 tx=0x7fa53c03d040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:43:31.228 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.222+0000 7f7957675640 1 Processor -- start 2023-12-12T09:43:31.229 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.220+0000 7fafd14bb640 1 -- 172.21.15.73:0/3861189085 wait complete. 2023-12-12T09:43:31.229 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.222+0000 7f7957675640 1 -- start start 2023-12-12T09:43:31.229 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.222+0000 7fe1d3fff640 1 Processor -- start 2023-12-12T09:43:31.229 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.222+0000 7fe1d3fff640 1 -- start start 2023-12-12T09:43:31.229 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.223+0000 7fafd14bb640 1 Processor -- start 2023-12-12T09:43:31.230 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.224+0000 7fe1d3fff640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe1cc040ec0 0x7fe1cc0305d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:31.230 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.224+0000 7f7957675640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7950071cc0 0x7f79500a49b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:31.230 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.223+0000 7fafd14bb640 1 -- start start 2023-12-12T09:43:31.231 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.224+0000 7fe1d3fff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe1cc04e660 0x7fe1cc008c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:31.231 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.224+0000 7f7957675640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f79500c0710 0x7f79500a21e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:31.231 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.224+0000 7fe1d3fff640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe1cc0d8d20 0x7fe1cc0ddc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:31.231 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.224+0000 7fe1d3fff640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1cc0334a0 con 0x7fe1cc04e660 2023-12-12T09:43:31.231 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.224+0000 7fe1d3fff640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1cc0324f0 con 0x7fe1cc040ec0 2023-12-12T09:43:31.231 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.224+0000 7fe1d3fff640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1cc0dd500 con 0x7fe1cc0d8d20 2023-12-12T09:43:31.232 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.224+0000 7fc153fff640 1 -- 172.21.15.73:0/221482824 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fc16008ae60 con 0x7fc16c0ad230 2023-12-12T09:43:31.232 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.224+0000 7f7957675640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7950155dd0 0x7f79501f1680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:31.232 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.225+0000 7fe1d2ffd640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe1cc040ec0 0x7fe1cc0305d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:31.233 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.225+0000 7f7957675640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f795015b6f0 con 0x7f7950071cc0 2023-12-12T09:43:31.233 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.225+0000 7f7957675640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7950152a80 con 0x7f79500c0710 2023-12-12T09:43:31.233 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.225+0000 7f7957675640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f795015b0a0 con 0x7f7950155dd0 2023-12-12T09:43:31.233 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.225+0000 7f7955411640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7950071cc0 0x7f79500a49b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:31.233 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.225+0000 7f7954c10640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f79500c0710 0x7f79500a21e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:31.233 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.225+0000 7fe1d2ffd640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe1cc040ec0 0x7fe1cc0305d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.73:43508/0 (socket says 172.21.15.73:43508) 2023-12-12T09:43:31.233 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.225+0000 7fe1d2ffd640 1 -- 172.21.15.73:0/185631133 learned_addr learned my addr 172.21.15.73:0/185631133 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:43:31.233 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.225+0000 7fe1d37fe640 1 --2- 172.21.15.73:0/185631133 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe1cc0d8d20 0x7fe1cc0ddc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:31.234 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.225+0000 7f7954c10640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f79500c0710 0x7f79500a21e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.73:43524/0 (socket says 172.21.15.73:43524) 2023-12-12T09:43:31.234 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.225+0000 7fafd14bb640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fafc4006470 0x7fafc40de3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:31.234 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.225+0000 7fafd14bb640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fafc4049f70 0x7fafc40340d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:31.234 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.225+0000 7fafd14bb640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fafc40d8760 0x7fafc40d19f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:31.234 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.225+0000 7fafd14bb640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafc40db2f0 con 0x7fafc4049f70 2023-12-12T09:43:31.234 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.225+0000 7fafd14bb640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafc40de900 con 0x7fafc40d8760 2023-12-12T09:43:31.235 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.225+0000 7fafd14bb640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fafc4177a10 con 0x7fafc4006470 2023-12-12T09:43:31.235 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.225+0000 7f7954c10640 1 -- 172.21.15.73:0/239634761 learned_addr learned my addr 172.21.15.73:0/239634761 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:43:31.235 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.225+0000 7f7955c12640 1 --2- 172.21.15.73:0/239634761 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7950155dd0 0x7f79501f1680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:31.235 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.225+0000 7fe1d27fc640 1 --2- 172.21.15.73:0/185631133 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe1cc04e660 0x7fe1cc008c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:31.235 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.226+0000 7f7954c10640 1 -- 172.21.15.73:0/239634761 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7950155dd0 msgr2=0x7f79501f1680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:31.236 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.226+0000 7f7954c10640 1 --2- 172.21.15.73:0/239634761 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7950155dd0 0x7f79501f1680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:31.236 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.226+0000 7f7954c10640 1 -- 172.21.15.73:0/239634761 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7950071cc0 msgr2=0x7f79500a49b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:31.236 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.226+0000 7f7954c10640 1 --2- 172.21.15.73:0/239634761 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7950071cc0 0x7f79500a49b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:31.236 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.226+0000 7f7954c10640 1 -- 172.21.15.73:0/239634761 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7940009400 con 0x7f79500c0710 2023-12-12T09:43:31.236 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.226+0000 7fe1d37fe640 1 -- 172.21.15.73:0/185631133 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe1cc040ec0 msgr2=0x7fe1cc0305d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:31.236 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.226+0000 7fe1d37fe640 1 --2- 172.21.15.73:0/185631133 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe1cc040ec0 0x7fe1cc0305d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:31.236 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.226+0000 7fe1d37fe640 1 -- 172.21.15.73:0/185631133 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe1cc04e660 msgr2=0x7fe1cc008c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:31.237 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.226+0000 7fe1d37fe640 1 --2- 172.21.15.73:0/185631133 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe1cc04e660 0x7fe1cc008c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:31.237 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.226+0000 7fe1d37fe640 1 -- 172.21.15.73:0/185631133 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1bc0094d0 con 0x7fe1cc0d8d20 2023-12-12T09:43:31.237 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.226+0000 7fe1d27fc640 1 --2- 172.21.15.73:0/185631133 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe1cc04e660 0x7fe1cc008c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-12T09:43:31.237 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.226+0000 7fafcbfff640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fafc4006470 0x7fafc40de3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:31.237 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.226+0000 7fafcbfff640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fafc4006470 0x7fafc40de3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.73:33852/0 (socket says 172.21.15.73:33852) 2023-12-12T09:43:31.237 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.226+0000 7fafcbfff640 1 -- 172.21.15.73:0/2921768696 learned_addr learned my addr 172.21.15.73:0/2921768696 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:43:31.237 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.226+0000 7f7955411640 1 --2- 172.21.15.73:0/239634761 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7950071cc0 0x7f79500a49b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-12T09:43:31.237 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.227+0000 7f7954c10640 1 --2- 172.21.15.73:0/239634761 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f79500c0710 0x7f79500a21e0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f794c00c400 tx=0x7f794c00c8c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:43:31.238 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.226+0000 7fafd0cba640 1 --2- 172.21.15.73:0/2921768696 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fafc40d8760 0x7fafc40d19f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:31.238 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.227+0000 7fe1d37fe640 1 --2- 172.21.15.73:0/185631133 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe1cc0d8d20 0x7fe1cc0ddc00 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fe1d4069160 tx=0x7fe1d4074790 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:43:31.238 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.227+0000 7f7945ffb640 1 -- 172.21.15.73:0/239634761 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f794c005ce0 con 0x7f79500c0710 2023-12-12T09:43:31.238 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.227+0000 7f7957675640 1 -- 172.21.15.73:0/239634761 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f795015b380 con 0x7f79500c0710 2023-12-12T09:43:31.238 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.227+0000 7f7957675640 1 -- 172.21.15.73:0/239634761 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79500abbf0 con 0x7f79500c0710 2023-12-12T09:43:31.239 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.227+0000 7fe1cb7fe640 1 -- 172.21.15.73:0/185631133 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1d406bc50 con 0x7fe1cc0d8d20 2023-12-12T09:43:31.239 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.227+0000 7fe1cb7fe640 1 -- 172.21.15.73:0/185631133 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1d406be10 con 0x7fe1cc0d8d20 2023-12-12T09:43:31.239 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.227+0000 7fe1cb7fe640 1 -- 172.21.15.73:0/185631133 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1d4072400 con 0x7fe1cc0d8d20 2023-12-12T09:43:31.239 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.227+0000 7f7945ffb640 1 -- 172.21.15.73:0/239634761 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f794c005e40 con 0x7f79500c0710 2023-12-12T09:43:31.239 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.227+0000 7f7945ffb640 1 -- 172.21.15.73:0/239634761 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f794c0072d0 con 0x7f79500c0710 2023-12-12T09:43:31.240 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.228+0000 7fe1d3fff640 1 -- 172.21.15.73:0/185631133 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1cc0dcf80 con 0x7fe1cc0d8d20 2023-12-12T09:43:31.240 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.228+0000 7fe1d3fff640 1 -- 172.21.15.73:0/185631133 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1cc0dd220 con 0x7fe1cc0d8d20 2023-12-12T09:43:31.240 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.227+0000 7fafcbfff640 1 -- 172.21.15.73:0/2921768696 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fafc40d8760 msgr2=0x7fafc40d19f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:31.240 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.227+0000 7fafcbfff640 1 --2- 172.21.15.73:0/2921768696 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fafc40d8760 0x7fafc40d19f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:31.240 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.227+0000 7fafcbfff640 1 -- 172.21.15.73:0/2921768696 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fafc4049f70 msgr2=0x7fafc40340d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:31.240 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.227+0000 7fafcbfff640 1 --2- 172.21.15.73:0/2921768696 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fafc4049f70 0x7fafc40340d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:31.240 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.227+0000 7fafcbfff640 1 -- 172.21.15.73:0/2921768696 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafcc04f730 con 0x7fafc4006470 2023-12-12T09:43:31.241 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.228+0000 7fa5417fa640 1 -- 172.21.15.73:0/3421681105 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa534058400 con 0x7fa5440c49d0 2023-12-12T09:43:31.241 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.229+0000 7fafcbfff640 1 --2- 172.21.15.73:0/2921768696 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fafc4006470 0x7fafc40de3c0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fafc000e9b0 tx=0x7fafc000ee70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:43:31.241 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.229+0000 7fafc8ff9640 1 -- 172.21.15.73:0/2921768696 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafc0009670 con 0x7fafc4006470 2023-12-12T09:43:31.241 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.229+0000 7fafc8ff9640 1 -- 172.21.15.73:0/2921768696 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafc000c9a0 con 0x7fafc4006470 2023-12-12T09:43:31.241 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.229+0000 7fafc8ff9640 1 -- 172.21.15.73:0/2921768696 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafc000cd50 con 0x7fafc4006470 2023-12-12T09:43:31.241 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.230+0000 7fafd14bb640 1 -- 172.21.15.73:0/2921768696 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fafc4177c60 con 0x7fafc4006470 2023-12-12T09:43:31.242 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.230+0000 7fafd14bb640 1 -- 172.21.15.73:0/2921768696 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fafc4178220 con 0x7fafc4006470 2023-12-12T09:43:31.242 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.229+0000 7fe1d3fff640 1 -- 172.21.15.73:0/185631133 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1cc0057b0 con 0x7fe1cc0d8d20 2023-12-12T09:43:31.242 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.231+0000 7fe1cb7fe640 1 -- 172.21.15.73:0/185631133 <== mon.2 v2:172.21.15.142:3301/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fe1d4072560 con 0x7fe1cc0d8d20 2023-12-12T09:43:31.242 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.233+0000 7fe1cb7fe640 1 --2- 172.21.15.73:0/185631133 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fe1b406ae40 0x7fe1b406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:31.242 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.233+0000 7fe1cb7fe640 1 -- 172.21.15.73:0/185631133 <== mon.2 v2:172.21.15.142:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe1d4103570 con 0x7fe1cc0d8d20 2023-12-12T09:43:31.242 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.234+0000 7fe1d2ffd640 1 --2- 172.21.15.73:0/185631133 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fe1b406ae40 0x7fe1b406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:31.242 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.235+0000 7fe1d2ffd640 1 --2- 172.21.15.73:0/185631133 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fe1b406ae40 0x7fe1b406d300 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fe1bc02b8c0 tx=0x7fe1bc03d040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:43:31.243 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.235+0000 7fafd14bb640 1 -- 172.21.15.73:0/2921768696 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fafc400f410 con 0x7fafc4006470 2023-12-12T09:43:31.243 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.232+0000 7f7957675640 1 -- 172.21.15.73:0/239634761 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7930005250 con 0x7f79500c0710 2023-12-12T09:43:31.243 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.233+0000 7f7945ffb640 1 -- 172.21.15.73:0/239634761 <== mon.1 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f794c0074f0 con 0x7f79500c0710 2023-12-12T09:43:31.243 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.234+0000 7f7945ffb640 1 --2- 172.21.15.73:0/239634761 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f793406ae40 0x7f793406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:31.243 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.235+0000 7f7945ffb640 1 -- 172.21.15.73:0/239634761 <== mon.1 v2:172.21.15.142:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f794c088b00 con 0x7f79500c0710 2023-12-12T09:43:31.243 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.236+0000 7f7955411640 1 --2- 172.21.15.73:0/239634761 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f793406ae40 0x7f793406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:31.244 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.236+0000 7fa5417fa640 1 -- 172.21.15.73:0/3421681105 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fa534054740 con 0x7fa5440c49d0 2023-12-12T09:43:31.244 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.237+0000 7f7955411640 1 --2- 172.21.15.73:0/239634761 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f793406ae40 0x7f793406d300 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f7940036000 tx=0x7f794003b040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:43:31.244 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.244+0000 7fe1cb7fe640 1 -- 172.21.15.73:0/185631133 <== mon.2 v2:172.21.15.142:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fe1d40ce690 con 0x7fe1cc0d8d20 2023-12-12T09:43:31.248 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.248+0000 7f7945ffb640 1 -- 172.21.15.73:0/239634761 <== mon.1 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f794c053c50 con 0x7f79500c0710 2023-12-12T09:43:31.248 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.248+0000 7fafc8ff9640 1 -- 172.21.15.73:0/2921768696 <== mon.2 v2:172.21.15.142:3301/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fafc0013470 con 0x7fafc4006470 2023-12-12T09:43:31.249 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.250+0000 7fafc8ff9640 1 --2- 172.21.15.73:0/2921768696 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fafb006af40 0x7fafb006d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:31.250 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.250+0000 7fafc8ff9640 1 -- 172.21.15.73:0/2921768696 <== mon.2 v2:172.21.15.142:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fafc0089eb0 con 0x7fafc4006470 2023-12-12T09:43:31.252 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.252+0000 7fafcb7fe640 1 --2- 172.21.15.73:0/2921768696 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fafb006af40 0x7fafb006d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:31.256 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.257+0000 7fafcb7fe640 1 --2- 172.21.15.73:0/2921768696 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fafb006af40 0x7fafb006d400 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fafc40d2930 tx=0x7fafb8007a30 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:43:31.264 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.261+0000 7fafc8ff9640 1 -- 172.21.15.73:0/2921768696 <== mon.2 v2:172.21.15.142:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fafc0055080 con 0x7fafc4006470 2023-12-12T09:43:31.267 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.260+0000 7fd35486a640 1 Processor -- start 2023-12-12T09:43:31.267 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.260+0000 7fd35486a640 1 -- start start 2023-12-12T09:43:31.267 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.262+0000 7fd35486a640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fd3500c4fa0 0x7fd350156190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:31.267 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.262+0000 7fd35486a640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3500c10f0 con 0x7fd3500c2520 2023-12-12T09:43:31.267 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.262+0000 7fd35486a640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3500c39e0 con 0x7fd3500c47e0 2023-12-12T09:43:31.267 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.262+0000 7fd35486a640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3500c3cc0 con 0x7fd3500c4fa0 2023-12-12T09:43:31.267 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.265+0000 7fd34f59e640 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7fd3500c47e0 0x7fd35015c0e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.73:56944/0 (socket says 172.21.15.73:56944) 2023-12-12T09:43:31.267 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.265+0000 7fd34f59e640 1 -- 172.21.15.73:0/4199052849 learned_addr learned my addr 172.21.15.73:0/4199052849 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-12T09:43:31.268 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.266+0000 7fd34e59c640 1 --2- 172.21.15.73:0/4199052849 >> v2:172.21.15.142:3300/0 conn(0x7fd3500c4fa0 0x7fd350156190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:31.268 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.267+0000 7f1717de5640 1 Processor -- start 2023-12-12T09:43:31.268 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.267+0000 7f1717de5640 1 -- start start 2023-12-12T09:43:31.271 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.268+0000 7fd34e59c640 1 -- 172.21.15.73:0/4199052849 >> v1:172.21.15.142:6789/0 conn(0x7fd3500c47e0 legacy=0x7fd35015c0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:31.271 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.268+0000 7fd34e59c640 1 -- 172.21.15.73:0/4199052849 >> v1:172.21.15.73:6789/0 conn(0x7fd3500c2520 legacy=0x7fd350155a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:43:31.271 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.268+0000 7fd34e59c640 1 -- 172.21.15.73:0/4199052849 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3500c3fa0 con 0x7fd3500c4fa0 2023-12-12T09:43:31.271 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.269+0000 7fd34e59c640 1 --2- 172.21.15.73:0/4199052849 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd3500c4fa0 0x7fd350156190 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fd3400097a0 tx=0x7fd34002b860 comp rx=0 tx=0).ready entity=mon.1 client_cookie=acfebfd15dce65b3 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:43:31.271 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.270+0000 7fd34dd9b640 1 -- 172.21.15.73:0/4199052849 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3400317c0 con 0x7fd3500c4fa0 2023-12-12T09:43:31.271 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.270+0000 7fd34dd9b640 1 -- 172.21.15.73:0/4199052849 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd340031920 con 0x7fd3500c4fa0 2023-12-12T09:43:31.271 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.270+0000 7fd34dd9b640 1 -- 172.21.15.73:0/4199052849 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd340031cb0 con 0x7fd3500c4fa0 2023-12-12T09:43:31.272 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.271+0000 7f1717de5640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1710151a70 0x7f1710154f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:31.272 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.271+0000 7f1717de5640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f17100acdd0 0x7f17100ad230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:31.272 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.271+0000 7f1717de5640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17100c7cc0 con 0x7f17100c8150 2023-12-12T09:43:31.272 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.271+0000 7f1717de5640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17100c9c00 con 0x7f17100acdd0 2023-12-12T09:43:31.272 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.271+0000 7f1717de5640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1710155450 con 0x7f1710151a70 2023-12-12T09:43:31.272 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.271+0000 7fd35486a640 1 -- 172.21.15.73:0/4199052849 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd3500c4fa0 msgr2=0x7fd350156190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:31.273 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.271+0000 7fd35486a640 1 --2- 172.21.15.73:0/4199052849 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd3500c4fa0 0x7fd350156190 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fd3400097a0 tx=0x7fd34002b860 comp rx=0 tx=0).stop 2023-12-12T09:43:31.273 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.272+0000 7fd35486a640 1 -- 172.21.15.73:0/4199052849 shutdown_connections 2023-12-12T09:43:31.273 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.272+0000 7fd35486a640 1 --2- 172.21.15.73:0/4199052849 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd3500c4fa0 0x7fd350156190 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:31.273 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.272+0000 7fd35486a640 1 -- 172.21.15.73:0/4199052849 >> 172.21.15.73:0/4199052849 conn(0x7fd3500c5940 msgr2=0x7fd3500c5d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:43:31.273 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.272+0000 7fd35486a640 1 -- 172.21.15.73:0/4199052849 shutdown_connections 2023-12-12T09:43:31.273 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.272+0000 7fd35486a640 1 -- 172.21.15.73:0/4199052849 wait complete. 2023-12-12T09:43:31.273 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.272+0000 7f1716382640 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f17100c8150 0x7f17100c8590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.73:56952/0 (socket says 172.21.15.73:56952) 2023-12-12T09:43:31.274 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.272+0000 7f1716382640 1 -- 172.21.15.73:0/3422360118 learned_addr learned my addr 172.21.15.73:0/3422360118 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-12T09:43:31.274 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.272+0000 7f1715380640 1 --2- 172.21.15.73:0/3422360118 >> v2:172.21.15.142:3300/0 conn(0x7f17100acdd0 0x7f17100ad230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:31.274 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.272+0000 7f1715b81640 1 --2- 172.21.15.73:0/3422360118 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1710151a70 0x7f1710154f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:31.274 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.273+0000 7f1714b7f640 1 -- 172.21.15.73:0/3422360118 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 233505201 0 0) 0x7f17100c7cc0 con 0x7f17100c8150 2023-12-12T09:43:31.274 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.273+0000 7f1714b7f640 1 -- 172.21.15.73:0/3422360118 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f16fc003520 con 0x7f17100c8150 2023-12-12T09:43:31.275 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.275+0000 7fd35486a640 1 Processor -- start 2023-12-12T09:43:31.275 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.275+0000 7fd35486a640 1 -- start start 2023-12-12T09:43:31.275 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.274+0000 7f1715b81640 1 -- 172.21.15.73:0/3422360118 >> v2:172.21.15.142:3300/0 conn(0x7f17100acdd0 msgr2=0x7f17100ad230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:43:31.276 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.277+0000 7fd35486a640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd3500c2520 0x7fd3501578c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:31.277 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.277+0000 7fd35486a640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd3500c47e0 0x7fd3500a8f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:31.277 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.277+0000 7fd35486a640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd3500c4fa0 0x7fd3500a9480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:31.277 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.277+0000 7fd34ed9d640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd3500c2520 0x7fd3501578c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:31.277 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.278+0000 7fd34ed9d640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd3500c2520 0x7fd3501578c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.73:43568/0 (socket says 172.21.15.73:43568) 2023-12-12T09:43:31.278 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.278+0000 7fd34e59c640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd3500c47e0 0x7fd3500a8f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:31.278 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.278+0000 7fd34e59c640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd3500c47e0 0x7fd3500a8f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.73:33868/0 (socket says 172.21.15.73:33868) 2023-12-12T09:43:31.278 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.278+0000 7fd35486a640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd35015bd00 con 0x7fd3500c4fa0 2023-12-12T09:43:31.278 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.278+0000 7fd35486a640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3500aabd0 con 0x7fd3500c2520 2023-12-12T09:43:31.279 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.274+0000 7f1715b81640 1 --2- 172.21.15.73:0/3422360118 >> v2:172.21.15.142:3300/0 conn(0x7f17100acdd0 0x7f17100ad230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:31.279 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.274+0000 7f1715b81640 1 -- 172.21.15.73:0/3422360118 >> v1:172.21.15.142:6789/0 conn(0x7f17100c8150 legacy=0x7f17100c8590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:31.279 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.274+0000 7f1715b81640 1 -- 172.21.15.73:0/3422360118 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17100c9920 con 0x7f1710151a70 2023-12-12T09:43:31.279 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.279+0000 7fd34ed9d640 1 -- 172.21.15.73:0/1819542830 learned_addr learned my addr 172.21.15.73:0/1819542830 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:43:31.279 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.279+0000 7fd35486a640 1 -- 172.21.15.73:0/1819542830 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd350158620 con 0x7fd3500c47e0 2023-12-12T09:43:31.280 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.279+0000 7f1715b81640 1 --2- 172.21.15.73:0/3422360118 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1710151a70 0x7f1710154f10 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f170c0097a0 tx=0x7f170c02b730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8628e4263493ba24 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:43:31.280 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.279+0000 7fd34f59e640 1 --2- 172.21.15.73:0/1819542830 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd3500c4fa0 0x7fd3500a9480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:31.280 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.280+0000 7f1714b7f640 1 -- 172.21.15.73:0/3422360118 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f170c030710 con 0x7f1710151a70 2023-12-12T09:43:31.281 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.280+0000 7f1714b7f640 1 -- 172.21.15.73:0/3422360118 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f170c02e050 con 0x7f1710151a70 2023-12-12T09:43:31.281 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.280+0000 7f1714b7f640 1 -- 172.21.15.73:0/3422360118 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f170c030ab0 con 0x7f1710151a70 2023-12-12T09:43:31.281 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.281+0000 7f1717de5640 1 -- 172.21.15.73:0/3422360118 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1710151a70 msgr2=0x7f1710154f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:31.281 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.281+0000 7f1717de5640 1 --2- 172.21.15.73:0/3422360118 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1710151a70 0x7f1710154f10 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f170c0097a0 tx=0x7f170c02b730 comp rx=0 tx=0).stop 2023-12-12T09:43:31.282 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.281+0000 7f1717de5640 1 -- 172.21.15.73:0/3422360118 shutdown_connections 2023-12-12T09:43:31.282 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.281+0000 7f1717de5640 1 --2- 172.21.15.73:0/3422360118 >> v2:172.21.15.142:3300/0 conn(0x7f17100acdd0 0x7f17100ad230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:31.282 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.281+0000 7f1717de5640 1 --2- 172.21.15.73:0/3422360118 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1710151a70 0x7f1710154f10 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:31.282 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.282+0000 7f1717de5640 1 -- 172.21.15.73:0/3422360118 >> 172.21.15.73:0/3422360118 conn(0x7f17100abcb0 msgr2=0x7f17100ac0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:43:31.282 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.282+0000 7f1717de5640 1 -- 172.21.15.73:0/3422360118 shutdown_connections 2023-12-12T09:43:31.282 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.282+0000 7f1717de5640 1 -- 172.21.15.73:0/3422360118 wait complete. 2023-12-12T09:43:31.285 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.286+0000 7f1717de5640 1 Processor -- start 2023-12-12T09:43:31.286 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.286+0000 7f1717de5640 1 -- start start 2023-12-12T09:43:31.288 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.288+0000 7fd34e59c640 1 -- 172.21.15.73:0/1819542830 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd3500c2520 msgr2=0x7fd3501578c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:31.288 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.288+0000 7fd34e59c640 1 --2- 172.21.15.73:0/1819542830 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd3500c2520 0x7fd3501578c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:31.288 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.288+0000 7fd34e59c640 1 -- 172.21.15.73:0/1819542830 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd3500c4fa0 msgr2=0x7fd3500a9480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:31.288 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.288+0000 7fd34e59c640 1 --2- 172.21.15.73:0/1819542830 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd3500c4fa0 0x7fd3500a9480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:31.288 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.288+0000 7fd34e59c640 1 -- 172.21.15.73:0/1819542830 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd340009400 con 0x7fd3500c47e0 2023-12-12T09:43:31.288 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.288+0000 7fd34ed9d640 1 --2- 172.21.15.73:0/1819542830 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd3500c2520 0x7fd3501578c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-12T09:43:31.289 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.288+0000 7f1717de5640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f17100acdd0 0x7f17101edad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:31.289 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.288+0000 7f1717de5640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f17100c8150 0x7f171006bc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:31.289 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.288+0000 7f1717de5640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1710071820 0x7f1710155ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:31.289 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.288+0000 7f1717de5640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1710157990 con 0x7f17100acdd0 2023-12-12T09:43:31.289 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.288+0000 7f1717de5640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17100c1020 con 0x7f17100c8150 2023-12-12T09:43:31.289 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.288+0000 7f1717de5640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1710157160 con 0x7f1710071820 2023-12-12T09:43:31.290 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.290+0000 7f1715b81640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f17100acdd0 0x7f17101edad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:31.290 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.291+0000 7fd34e59c640 1 --2- 172.21.15.73:0/1819542830 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd3500c47e0 0x7fd3500a8f40 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fd340033000 tx=0x7fd3400046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:43:31.291 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.291+0000 7f1716382640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1710071820 0x7f1710155ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:31.291 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.291+0000 7f1716382640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1710071820 0x7f1710155ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.73:33874/0 (socket says 172.21.15.73:33874) 2023-12-12T09:43:31.291 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.291+0000 7f1716382640 1 -- 172.21.15.73:0/440200263 learned_addr learned my addr 172.21.15.73:0/440200263 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:43:31.291 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.291+0000 7fd3477fe640 1 -- 172.21.15.73:0/1819542830 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd340032a20 con 0x7fd3500c47e0 2023-12-12T09:43:31.292 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.291+0000 7fd35486a640 1 -- 172.21.15.73:0/1819542830 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3500aa810 con 0x7fd3500c47e0 2023-12-12T09:43:31.292 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.291+0000 7fd3477fe640 1 -- 172.21.15.73:0/1819542830 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd340032b80 con 0x7fd3500c47e0 2023-12-12T09:43:31.292 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.291+0000 7fd3477fe640 1 -- 172.21.15.73:0/1819542830 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3400453f0 con 0x7fd3500c47e0 2023-12-12T09:43:31.292 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.291+0000 7f1715380640 1 --2- 172.21.15.73:0/440200263 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f17100c8150 0x7f171006bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:31.292 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.292+0000 7fd35486a640 1 -- 172.21.15.73:0/1819542830 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3500bff40 con 0x7fd3500c47e0 2023-12-12T09:43:31.293 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.292+0000 7f1716382640 1 -- 172.21.15.73:0/440200263 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f17100c8150 msgr2=0x7f171006bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:31.293 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.293+0000 7f1716382640 1 --2- 172.21.15.73:0/440200263 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f17100c8150 0x7f171006bc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:31.293 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.293+0000 7f1716382640 1 -- 172.21.15.73:0/440200263 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f17100acdd0 msgr2=0x7f17101edad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:31.293 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.293+0000 7f1716382640 1 --2- 172.21.15.73:0/440200263 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f17100acdd0 0x7f17101edad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:31.293 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.293+0000 7f1716382640 1 -- 172.21.15.73:0/440200263 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f170c009400 con 0x7f1710071820 2023-12-12T09:43:31.293 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.293+0000 7f1715b81640 1 --2- 172.21.15.73:0/440200263 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f17100acdd0 0x7f17101edad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:43:31.295 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.293+0000 7fd3457fa640 1 -- 172.21.15.73:0/1819542830 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd328005250 con 0x7fd3500c47e0 2023-12-12T09:43:31.296 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.295+0000 7fd3477fe640 1 -- 172.21.15.73:0/1819542830 <== mon.2 v2:172.21.15.142:3301/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fd34004e450 con 0x7fd3500c47e0 2023-12-12T09:43:31.296 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.296+0000 7f1716382640 1 --2- 172.21.15.73:0/440200263 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1710071820 0x7f1710155ec0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f170800c700 tx=0x7f170800cbc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:43:31.297 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.297+0000 7fd3477fe640 1 --2- 172.21.15.73:0/1819542830 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fd33006ae70 0x7fd33006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:31.297 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.297+0000 7fd3477fe640 1 -- 172.21.15.73:0/1819542830 <== mon.2 v2:172.21.15.142:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd3400ab8e0 con 0x7fd3500c47e0 2023-12-12T09:43:31.298 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.298+0000 7fd34ed9d640 1 --2- 172.21.15.73:0/1819542830 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fd33006ae70 0x7fd33006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:31.299 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.299+0000 7fd34ed9d640 1 --2- 172.21.15.73:0/1819542830 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fd33006ae70 0x7fd33006d330 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fd338009d70 tx=0x7fd3380090e0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:43:31.309 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.309+0000 7f17067fc640 1 -- 172.21.15.73:0/440200263 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f170800ce10 con 0x7f1710071820 2023-12-12T09:43:31.309 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.309+0000 7f17067fc640 1 -- 172.21.15.73:0/440200263 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f170800a640 con 0x7f1710071820 2023-12-12T09:43:31.309 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.309+0000 7f17067fc640 1 -- 172.21.15.73:0/440200263 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f170800a9f0 con 0x7f1710071820 2023-12-12T09:43:31.309 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.309+0000 7f1717de5640 1 -- 172.21.15.73:0/440200263 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17101ee010 con 0x7f1710071820 2023-12-12T09:43:31.309 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.309+0000 7f1717de5640 1 -- 172.21.15.73:0/440200263 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17101576b0 con 0x7f1710071820 2023-12-12T09:43:31.309 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.309+0000 7fd3477fe640 1 -- 172.21.15.73:0/1819542830 <== mon.2 v2:172.21.15.142:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fd340076ae0 con 0x7fd3500c47e0 2023-12-12T09:43:31.311 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.311+0000 7f1717de5640 1 -- 172.21.15.73:0/440200263 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1710067580 con 0x7f1710071820 2023-12-12T09:43:31.315 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.313+0000 7f17067fc640 1 -- 172.21.15.73:0/440200263 <== mon.2 v2:172.21.15.142:3301/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f170800ab50 con 0x7f1710071820 2023-12-12T09:43:31.315 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.315+0000 7f17067fc640 1 --2- 172.21.15.73:0/440200263 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f16f406ae90 0x7f16f406d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:31.315 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.315+0000 7f1715b81640 1 --2- 172.21.15.73:0/440200263 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f16f406ae90 0x7f16f406d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:31.317 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.317+0000 7f1715b81640 1 --2- 172.21.15.73:0/440200263 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f16f406ae90 0x7f16f406d350 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f170c034000 tx=0x7f170c008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:43:31.317 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.317+0000 7f17067fc640 1 -- 172.21.15.73:0/440200263 <== mon.2 v2:172.21.15.142:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1708057c60 con 0x7f1710071820 2023-12-12T09:43:31.329 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.329+0000 7f17067fc640 1 -- 172.21.15.73:0/440200263 <== mon.2 v2:172.21.15.142:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f1708054730 con 0x7f1710071820 2023-12-12T09:43:31.569 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.569+0000 7fc008ba7640 1 -- 172.21.15.73:0/1165023180 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fbffc0d2150 con 0x7fbffc0d78f0 2023-12-12T09:43:31.571 INFO:teuthology.orchestra.run.smithi073.stdout:55834574855 2023-12-12T09:43:31.572 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.570+0000 7fbfeffff640 1 -- 172.21.15.73:0/1165023180 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fbffc0d2150 con 0x7fbffc0d78f0 2023-12-12T09:43:31.577 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.577+0000 7fbfedffb640 1 -- 172.21.15.73:0/1165023180 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fbfe806aed0 msgr2=0x7fbfe806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:31.577 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.577+0000 7fbfedffb640 1 --2- 172.21.15.73:0/1165023180 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fbfe806aed0 0x7fbfe806d390 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fbff8006d40 tx=0x7fbff8008040 comp rx=0 tx=0).stop 2023-12-12T09:43:31.577 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.577+0000 7fbfedffb640 1 -- 172.21.15.73:0/1165023180 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbffc0d78f0 msgr2=0x7fbffc0d2350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:31.577 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.577+0000 7fbfedffb640 1 --2- 172.21.15.73:0/1165023180 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbffc0d78f0 0x7fbffc0d2350 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fbff0032000 tx=0x7fbff00046c0 comp rx=0 tx=0).stop 2023-12-12T09:43:31.580 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.580+0000 7fbfedffb640 1 -- 172.21.15.73:0/1165023180 shutdown_connections 2023-12-12T09:43:31.580 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.580+0000 7fbfedffb640 1 --2- 172.21.15.73:0/1165023180 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fbfe806aed0 0x7fbfe806d390 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:31.580 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.580+0000 7fbfedffb640 1 --2- 172.21.15.73:0/1165023180 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbffc0d78f0 0x7fbffc0d2350 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:31.580 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.580+0000 7fbfedffb640 1 --2- 172.21.15.73:0/1165023180 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbffc0506f0 0x7fbffc033d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:31.580 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.580+0000 7fbfedffb640 1 --2- 172.21.15.73:0/1165023180 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbffc00fcc0 0x7fbffc033110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:31.580 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.580+0000 7fbfedffb640 1 -- 172.21.15.73:0/1165023180 >> 172.21.15.73:0/1165023180 conn(0x7fbffc04fbd0 msgr2=0x7fbffc006290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:43:31.581 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.581+0000 7fbfedffb640 1 -- 172.21.15.73:0/1165023180 shutdown_connections 2023-12-12T09:43:31.581 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.581+0000 7fbfedffb640 1 -- 172.21.15.73:0/1165023180 wait complete. 2023-12-12T09:43:31.608 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574855 for osd.0 2023-12-12T09:43:31.608 DEBUG:teuthology.parallel:result is None 2023-12-12T09:43:31.634 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.634+0000 7fc1721dc640 1 -- 172.21.15.73:0/221482824 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fc14c005500 con 0x7fc16c0ad230 2023-12-12T09:43:31.636 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.636+0000 7fc153fff640 1 -- 172.21.15.73:0/221482824 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fc160017020 con 0x7fc16c0ad230 2023-12-12T09:43:31.636 INFO:teuthology.orchestra.run.smithi073.stdout:55834574853 2023-12-12T09:43:31.639 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.639+0000 7fc1721dc640 1 -- 172.21.15.73:0/221482824 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fc15806af40 msgr2=0x7fc15806d400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:31.639 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.639+0000 7fc1721dc640 1 --2- 172.21.15.73:0/221482824 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fc15806af40 0x7fc15806d400 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fc16400a450 tx=0x7fc164007560 comp rx=0 tx=0).stop 2023-12-12T09:43:31.640 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.640+0000 7fc1721dc640 1 -- 172.21.15.73:0/221482824 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc16c0ad230 msgr2=0x7fc16c157ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:31.640 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.640+0000 7fc1721dc640 1 --2- 172.21.15.73:0/221482824 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc16c0ad230 0x7fc16c157ec0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fc16000c430 tx=0x7fc16000c8f0 comp rx=0 tx=0).stop 2023-12-12T09:43:31.640 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.640+0000 7fc1721dc640 1 -- 172.21.15.73:0/221482824 shutdown_connections 2023-12-12T09:43:31.640 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.640+0000 7fc1721dc640 1 --2- 172.21.15.73:0/221482824 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fc15806af40 0x7fc15806d400 secure :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fc16400a450 tx=0x7fc164007560 comp rx=0 tx=0).stop 2023-12-12T09:43:31.640 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.640+0000 7fc1721dc640 1 --2- 172.21.15.73:0/221482824 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc16c151a70 0x7fc16c158400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:31.640 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.640+0000 7fc1721dc640 1 --2- 172.21.15.73:0/221482824 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc16c0ad230 0x7fc16c157ec0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:31.640 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.640+0000 7fc1721dc640 1 --2- 172.21.15.73:0/221482824 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc16c0acdd0 0x7fc16c1563c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:31.640 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.640+0000 7fc1721dc640 1 -- 172.21.15.73:0/221482824 >> 172.21.15.73:0/221482824 conn(0x7fc16c0abcb0 msgr2=0x7fc16c15f5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:43:31.641 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.641+0000 7fc1721dc640 1 -- 172.21.15.73:0/221482824 shutdown_connections 2023-12-12T09:43:31.641 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.641+0000 7fc1721dc640 1 -- 172.21.15.73:0/221482824 wait complete. 2023-12-12T09:43:31.656 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.656+0000 7fa54ae02640 1 -- 172.21.15.73:0/3421681105 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fa544067580 con 0x7fa5440c49d0 2023-12-12T09:43:31.657 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.657+0000 7fa5417fa640 1 -- 172.21.15.73:0/3421681105 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fa534019020 con 0x7fa5440c49d0 2023-12-12T09:43:31.657 INFO:teuthology.orchestra.run.smithi073.stdout:55834574853 2023-12-12T09:43:31.660 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.660+0000 7fa54ae02640 1 -- 172.21.15.73:0/3421681105 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fa52406ae90 msgr2=0x7fa52406d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:31.660 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.660+0000 7fa54ae02640 1 --2- 172.21.15.73:0/3421681105 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fa52406ae90 0x7fa52406d350 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fa53c036000 tx=0x7fa53c03d040 comp rx=0 tx=0).stop 2023-12-12T09:43:31.660 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.660+0000 7fa54ae02640 1 -- 172.21.15.73:0/3421681105 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa5440c49d0 msgr2=0x7fa5441e5420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:31.660 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.660+0000 7fa54ae02640 1 --2- 172.21.15.73:0/3421681105 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa5440c49d0 0x7fa5441e5420 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fa53400ba50 tx=0x7fa53400bf10 comp rx=0 tx=0).stop 2023-12-12T09:43:31.661 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.661+0000 7fa54ae02640 1 -- 172.21.15.73:0/3421681105 shutdown_connections 2023-12-12T09:43:31.661 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.661+0000 7fa54ae02640 1 --2- 172.21.15.73:0/3421681105 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fa52406ae90 0x7fa52406d350 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:31.661 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.661+0000 7fa54ae02640 1 --2- 172.21.15.73:0/3421681105 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa544155ef0 0x7fa5441e5960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:31.661 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.661+0000 7fa54ae02640 1 --2- 172.21.15.73:0/3421681105 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa5440c49d0 0x7fa5441e5420 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:31.661 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.661+0000 7fa54ae02640 1 --2- 172.21.15.73:0/3421681105 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa5440ad310 0x7fa544159c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:31.661 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.661+0000 7fa54ae02640 1 -- 172.21.15.73:0/3421681105 >> 172.21.15.73:0/3421681105 conn(0x7fa5440abcb0 msgr2=0x7fa544157cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:43:31.661 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.661+0000 7fa54ae02640 1 -- 172.21.15.73:0/3421681105 shutdown_connections 2023-12-12T09:43:31.662 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.661+0000 7fa54ae02640 1 -- 172.21.15.73:0/3421681105 wait complete. 2023-12-12T09:43:31.668 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574852 got 55834574853 for osd.1 2023-12-12T09:43:31.668 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.668+0000 7fe1d3fff640 1 -- 172.21.15.73:0/185631133 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7fe1cc033930 con 0x7fe1cc0d8d20 2023-12-12T09:43:31.668 DEBUG:teuthology.parallel:result is None 2023-12-12T09:43:31.669 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.669+0000 7fe1cb7fe640 1 -- 172.21.15.73:0/185631133 <== mon.2 v2:172.21.15.142:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fe1d40d1cb0 con 0x7fe1cc0d8d20 2023-12-12T09:43:31.670 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.670+0000 7f7957675640 1 -- 172.21.15.73:0/239634761 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f7930005500 con 0x7f79500c0710 2023-12-12T09:43:31.670 INFO:teuthology.orchestra.run.smithi073.stdout:55834574853 2023-12-12T09:43:31.670 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.671+0000 7f7945ffb640 1 -- 172.21.15.73:0/239634761 <== mon.1 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f794c017020 con 0x7f79500c0710 2023-12-12T09:43:31.671 INFO:teuthology.orchestra.run.smithi073.stdout:55834574853 2023-12-12T09:43:31.672 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.672+0000 7fe1d3fff640 1 -- 172.21.15.73:0/185631133 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fe1b406ae40 msgr2=0x7fe1b406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:31.672 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.672+0000 7fe1d3fff640 1 --2- 172.21.15.73:0/185631133 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fe1b406ae40 0x7fe1b406d300 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fe1bc02b8c0 tx=0x7fe1bc03d040 comp rx=0 tx=0).stop 2023-12-12T09:43:31.673 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.673+0000 7fe1d3fff640 1 -- 172.21.15.73:0/185631133 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe1cc0d8d20 msgr2=0x7fe1cc0ddc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:31.673 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.673+0000 7fe1d3fff640 1 --2- 172.21.15.73:0/185631133 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe1cc0d8d20 0x7fe1cc0ddc00 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fe1d4069160 tx=0x7fe1d4074790 comp rx=0 tx=0).stop 2023-12-12T09:43:31.673 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.673+0000 7fe1d3fff640 1 -- 172.21.15.73:0/185631133 shutdown_connections 2023-12-12T09:43:31.674 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.673+0000 7fe1d3fff640 1 --2- 172.21.15.73:0/185631133 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fe1b406ae40 0x7fe1b406d300 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:31.674 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.673+0000 7fe1d3fff640 1 --2- 172.21.15.73:0/185631133 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe1cc0d8d20 0x7fe1cc0ddc00 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:31.674 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.673+0000 7fe1d3fff640 1 --2- 172.21.15.73:0/185631133 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe1cc04e660 0x7fe1cc008c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:31.674 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.673+0000 7fe1d3fff640 1 --2- 172.21.15.73:0/185631133 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe1cc040ec0 0x7fe1cc0305d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:31.674 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.673+0000 7fe1d3fff640 1 -- 172.21.15.73:0/185631133 >> 172.21.15.73:0/185631133 conn(0x7fe1cc04d9b0 msgr2=0x7fe1cc0d33d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:43:31.674 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.674+0000 7fe1d3fff640 1 -- 172.21.15.73:0/185631133 shutdown_connections 2023-12-12T09:43:31.674 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.674+0000 7fe1d3fff640 1 -- 172.21.15.73:0/185631133 wait complete. 2023-12-12T09:43:31.675 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.674+0000 7f7957675640 1 -- 172.21.15.73:0/239634761 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f793406ae40 msgr2=0x7f793406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:31.675 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.674+0000 7f7957675640 1 --2- 172.21.15.73:0/239634761 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f793406ae40 0x7f793406d300 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f7940036000 tx=0x7f794003b040 comp rx=0 tx=0).stop 2023-12-12T09:43:31.675 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.674+0000 7f7957675640 1 -- 172.21.15.73:0/239634761 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f79500c0710 msgr2=0x7f79500a21e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:31.675 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.674+0000 7f7957675640 1 --2- 172.21.15.73:0/239634761 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f79500c0710 0x7f79500a21e0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f794c00c400 tx=0x7f794c00c8c0 comp rx=0 tx=0).stop 2023-12-12T09:43:31.675 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.674+0000 7f7957675640 1 -- 172.21.15.73:0/239634761 shutdown_connections 2023-12-12T09:43:31.675 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.674+0000 7f7957675640 1 --2- 172.21.15.73:0/239634761 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f793406ae40 0x7f793406d300 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:31.675 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.674+0000 7f7957675640 1 --2- 172.21.15.73:0/239634761 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7950155dd0 0x7f79501f1680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:31.675 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.674+0000 7f7957675640 1 --2- 172.21.15.73:0/239634761 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f79500c0710 0x7f79500a21e0 secure :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f794c00c400 tx=0x7f794c00c8c0 comp rx=0 tx=0).stop 2023-12-12T09:43:31.675 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.674+0000 7f7957675640 1 --2- 172.21.15.73:0/239634761 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7950071cc0 0x7f79500a49b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:31.675 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.675+0000 7f7957675640 1 -- 172.21.15.73:0/239634761 >> 172.21.15.73:0/239634761 conn(0x7f79500a77d0 msgr2=0x7f79500c3e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:43:31.676 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.674+0000 7fafd14bb640 1 -- 172.21.15.73:0/2921768696 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7fafc4005360 con 0x7fafc4006470 2023-12-12T09:43:31.676 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.675+0000 7f7957675640 1 -- 172.21.15.73:0/239634761 shutdown_connections 2023-12-12T09:43:31.676 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.675+0000 7f7957675640 1 -- 172.21.15.73:0/239634761 wait complete. 2023-12-12T09:43:31.676 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.675+0000 7fafc8ff9640 1 -- 172.21.15.73:0/2921768696 <== mon.2 v2:172.21.15.142:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fafc0017020 con 0x7fafc4006470 2023-12-12T09:43:31.677 INFO:teuthology.orchestra.run.smithi073.stdout:55834574853 2023-12-12T09:43:31.677 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.678+0000 7fafd14bb640 1 -- 172.21.15.73:0/2921768696 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fafb006af40 msgr2=0x7fafb006d400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:31.677 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.678+0000 7fafd14bb640 1 --2- 172.21.15.73:0/2921768696 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fafb006af40 0x7fafb006d400 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fafc40d2930 tx=0x7fafb8007a30 comp rx=0 tx=0).stop 2023-12-12T09:43:31.678 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.678+0000 7fafd14bb640 1 -- 172.21.15.73:0/2921768696 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fafc4006470 msgr2=0x7fafc40de3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:31.678 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.678+0000 7fafd14bb640 1 --2- 172.21.15.73:0/2921768696 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fafc4006470 0x7fafc40de3c0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fafc000e9b0 tx=0x7fafc000ee70 comp rx=0 tx=0).stop 2023-12-12T09:43:31.678 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.678+0000 7fafd14bb640 1 -- 172.21.15.73:0/2921768696 shutdown_connections 2023-12-12T09:43:31.678 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.678+0000 7fafd14bb640 1 --2- 172.21.15.73:0/2921768696 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fafb006af40 0x7fafb006d400 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:31.678 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.678+0000 7fafd14bb640 1 --2- 172.21.15.73:0/2921768696 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fafc40d8760 0x7fafc40d19f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:31.679 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.678+0000 7fafd14bb640 1 --2- 172.21.15.73:0/2921768696 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fafc4049f70 0x7fafc40340d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:31.679 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.678+0000 7fafd14bb640 1 --2- 172.21.15.73:0/2921768696 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fafc4006470 0x7fafc40de3c0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:31.679 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.678+0000 7fafd14bb640 1 -- 172.21.15.73:0/2921768696 >> 172.21.15.73:0/2921768696 conn(0x7fafc404fbd0 msgr2=0x7fafc4006850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:43:31.679 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.678+0000 7fafd14bb640 1 -- 172.21.15.73:0/2921768696 shutdown_connections 2023-12-12T09:43:31.679 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.678+0000 7fafd14bb640 1 -- 172.21.15.73:0/2921768696 wait complete. 2023-12-12T09:43:31.688 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574852 got 55834574853 for osd.2 2023-12-12T09:43:31.688 DEBUG:teuthology.parallel:result is None 2023-12-12T09:43:31.701 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574852 got 55834574853 for osd.3 2023-12-12T09:43:31.701 DEBUG:teuthology.parallel:result is None 2023-12-12T09:43:31.701 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574852 got 55834574853 for osd.5 2023-12-12T09:43:31.702 DEBUG:teuthology.parallel:result is None 2023-12-12T09:43:31.703 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574852 got 55834574853 for osd.6 2023-12-12T09:43:31.703 DEBUG:teuthology.parallel:result is None 2023-12-12T09:43:31.704 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.704+0000 7fd3457fa640 1 -- 172.21.15.73:0/1819542830 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7fd3280057d0 con 0x7fd3500c47e0 2023-12-12T09:43:31.705 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.705+0000 7fd3477fe640 1 -- 172.21.15.73:0/1819542830 <== mon.2 v2:172.21.15.142:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fd34007a100 con 0x7fd3500c47e0 2023-12-12T09:43:31.705 INFO:teuthology.orchestra.run.smithi073.stdout:55834574855 2023-12-12T09:43:31.707 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.707+0000 7fd3457fa640 1 -- 172.21.15.73:0/1819542830 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fd33006ae70 msgr2=0x7fd33006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:31.707 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.707+0000 7fd3457fa640 1 --2- 172.21.15.73:0/1819542830 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fd33006ae70 0x7fd33006d330 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fd338009d70 tx=0x7fd3380090e0 comp rx=0 tx=0).stop 2023-12-12T09:43:31.707 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.707+0000 7fd3457fa640 1 -- 172.21.15.73:0/1819542830 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd3500c47e0 msgr2=0x7fd3500a8f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:31.707 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.707+0000 7fd3457fa640 1 --2- 172.21.15.73:0/1819542830 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd3500c47e0 0x7fd3500a8f40 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fd340033000 tx=0x7fd3400046c0 comp rx=0 tx=0).stop 2023-12-12T09:43:31.707 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.707+0000 7f1717de5640 1 -- 172.21.15.73:0/440200263 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f17100c4740 con 0x7f1710071820 2023-12-12T09:43:31.708 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.707+0000 7fd3457fa640 1 -- 172.21.15.73:0/1819542830 shutdown_connections 2023-12-12T09:43:31.708 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.707+0000 7fd3457fa640 1 --2- 172.21.15.73:0/1819542830 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fd33006ae70 0x7fd33006d330 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:31.708 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.707+0000 7fd3457fa640 1 --2- 172.21.15.73:0/1819542830 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd3500c4fa0 0x7fd3500a9480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:31.708 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.707+0000 7fd3457fa640 1 --2- 172.21.15.73:0/1819542830 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd3500c47e0 0x7fd3500a8f40 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:31.708 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.707+0000 7fd3457fa640 1 --2- 172.21.15.73:0/1819542830 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd3500c2520 0x7fd3501578c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:31.708 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.707+0000 7fd3457fa640 1 -- 172.21.15.73:0/1819542830 >> 172.21.15.73:0/1819542830 conn(0x7fd3500c5940 msgr2=0x7fd350073310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:43:31.708 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.707+0000 7fd3457fa640 1 -- 172.21.15.73:0/1819542830 shutdown_connections 2023-12-12T09:43:31.708 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.707+0000 7fd3457fa640 1 -- 172.21.15.73:0/1819542830 wait complete. 2023-12-12T09:43:31.709 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.708+0000 7f17067fc640 1 -- 172.21.15.73:0/440200263 <== mon.2 v2:172.21.15.142:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f1708018030 con 0x7f1710071820 2023-12-12T09:43:31.709 INFO:teuthology.orchestra.run.smithi073.stdout:55834574855 2023-12-12T09:43:31.710 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.710+0000 7f1717de5640 1 -- 172.21.15.73:0/440200263 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f16f406ae90 msgr2=0x7f16f406d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:31.710 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.710+0000 7f1717de5640 1 --2- 172.21.15.73:0/440200263 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f16f406ae90 0x7f16f406d350 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f170c034000 tx=0x7f170c008030 comp rx=0 tx=0).stop 2023-12-12T09:43:31.710 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.710+0000 7f1717de5640 1 -- 172.21.15.73:0/440200263 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1710071820 msgr2=0x7f1710155ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:31.710 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.710+0000 7f1717de5640 1 --2- 172.21.15.73:0/440200263 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1710071820 0x7f1710155ec0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f170800c700 tx=0x7f170800cbc0 comp rx=0 tx=0).stop 2023-12-12T09:43:31.710 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.710+0000 7f1717de5640 1 -- 172.21.15.73:0/440200263 shutdown_connections 2023-12-12T09:43:31.711 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.710+0000 7f1717de5640 1 --2- 172.21.15.73:0/440200263 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f16f406ae90 0x7f16f406d350 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:31.711 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.710+0000 7f1717de5640 1 --2- 172.21.15.73:0/440200263 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1710071820 0x7f1710155ec0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:31.711 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.710+0000 7f1717de5640 1 --2- 172.21.15.73:0/440200263 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f17100c8150 0x7f171006bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:31.711 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.710+0000 7f1717de5640 1 --2- 172.21.15.73:0/440200263 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f17100acdd0 0x7f17101edad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:31.711 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.710+0000 7f1717de5640 1 -- 172.21.15.73:0/440200263 >> 172.21.15.73:0/440200263 conn(0x7f17100abcb0 msgr2=0x7f17100aa670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:43:31.711 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.710+0000 7f1717de5640 1 -- 172.21.15.73:0/440200263 shutdown_connections 2023-12-12T09:43:31.711 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.710+0000 7f1717de5640 1 -- 172.21.15.73:0/440200263 wait complete. 2023-12-12T09:43:31.724 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574855 for osd.4 2023-12-12T09:43:31.724 DEBUG:teuthology.parallel:result is None 2023-12-12T09:43:31.726 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574855 for osd.7 2023-12-12T09:43:31.726 DEBUG:teuthology.parallel:result is None 2023-12-12T09:43:31.726 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-12-12T09:43:31.726 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-12T09:43:31.967 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.967+0000 7f8b1f1bb640 1 Processor -- start 2023-12-12T09:43:31.967 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.967+0000 7f8b1f1bb640 1 -- start start 2023-12-12T09:43:31.969 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.968+0000 7f8b1f1bb640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f8b1806d160 0x7f8b180c62a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:31.970 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.969+0000 7f8b1f1bb640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f8b180c5bc0 0x7f8b180c1180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:31.970 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.969+0000 7f8b1f1bb640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b180c6050 con 0x7f8b180c67e0 2023-12-12T09:43:31.970 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.969+0000 7f8b1f1bb640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b180c7180 con 0x7f8b1806d160 2023-12-12T09:43:31.970 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.969+0000 7f8b1f1bb640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b180c3030 con 0x7f8b180c5bc0 2023-12-12T09:43:31.970 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.969+0000 7f8b1cf57640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f8b1806d160 0x7f8b180c62a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:31.970 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.969+0000 7f8b1cf57640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f8b1806d160 0x7f8b180c62a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:56806/0 (socket says 172.21.15.73:56806) 2023-12-12T09:43:31.970 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.969+0000 7f8b1cf57640 1 -- 172.21.15.73:0/1315984026 learned_addr learned my addr 172.21.15.73:0/1315984026 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:43:31.970 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.969+0000 7f8b17fff640 1 --2- 172.21.15.73:0/1315984026 >> v2:172.21.15.142:3300/0 conn(0x7f8b180c5bc0 0x7f8b180c1180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:31.970 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.969+0000 7f8b1cf57640 1 -- 172.21.15.73:0/1315984026 >> v2:172.21.15.142:3300/0 conn(0x7f8b180c5bc0 msgr2=0x7f8b180c1180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:43:31.970 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.969+0000 7f8b1cf57640 1 --2- 172.21.15.73:0/1315984026 >> v2:172.21.15.142:3300/0 conn(0x7f8b180c5bc0 0x7f8b180c1180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:31.971 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.969+0000 7f8b1cf57640 1 -- 172.21.15.73:0/1315984026 >> v1:172.21.15.73:6789/0 conn(0x7f8b180c67e0 legacy=0x7f8b180c16c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:31.971 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.969+0000 7f8b1cf57640 1 -- 172.21.15.73:0/1315984026 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b180c3310 con 0x7f8b1806d160 2023-12-12T09:43:31.971 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.970+0000 7f8b17fff640 1 --2- 172.21.15.73:0/1315984026 >> v2:172.21.15.142:3300/0 conn(0x7f8b180c5bc0 0x7f8b180c1180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:43:31.972 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.970+0000 7f8b1cf57640 1 --2- 172.21.15.73:0/1315984026 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8b1806d160 0x7f8b180c62a0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f8b1806b2f0 tx=0x7f8b0c02b890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d121cd2d3fc6fea9 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:43:31.972 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.971+0000 7f8b177fe640 1 -- 172.21.15.73:0/1315984026 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b0c0317f0 con 0x7f8b1806d160 2023-12-12T09:43:31.972 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.971+0000 7f8b177fe640 1 -- 172.21.15.73:0/1315984026 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b0c031950 con 0x7f8b1806d160 2023-12-12T09:43:31.972 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.971+0000 7f8b177fe640 1 -- 172.21.15.73:0/1315984026 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b0c031ce0 con 0x7f8b1806d160 2023-12-12T09:43:31.972 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.971+0000 7f8b1f1bb640 1 -- 172.21.15.73:0/1315984026 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8b1806d160 msgr2=0x7f8b180c62a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:31.972 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.971+0000 7f8b1f1bb640 1 --2- 172.21.15.73:0/1315984026 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8b1806d160 0x7f8b180c62a0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f8b1806b2f0 tx=0x7f8b0c02b890 comp rx=0 tx=0).stop 2023-12-12T09:43:31.972 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.971+0000 7f8b1f1bb640 1 -- 172.21.15.73:0/1315984026 shutdown_connections 2023-12-12T09:43:31.972 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.971+0000 7f8b1f1bb640 1 --2- 172.21.15.73:0/1315984026 >> v2:172.21.15.142:3300/0 conn(0x7f8b180c5bc0 0x7f8b180c1180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:31.973 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.971+0000 7f8b1f1bb640 1 --2- 172.21.15.73:0/1315984026 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8b1806d160 0x7f8b180c62a0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:31.973 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.971+0000 7f8b1f1bb640 1 -- 172.21.15.73:0/1315984026 >> 172.21.15.73:0/1315984026 conn(0x7f8b180c7cc0 msgr2=0x7f8b180c80a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:43:31.973 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.972+0000 7f8b1f1bb640 1 -- 172.21.15.73:0/1315984026 shutdown_connections 2023-12-12T09:43:31.973 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.972+0000 7f8b1f1bb640 1 -- 172.21.15.73:0/1315984026 wait complete. 2023-12-12T09:43:31.973 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.973+0000 7f8b1f1bb640 1 Processor -- start 2023-12-12T09:43:31.973 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.973+0000 7f8b1f1bb640 1 -- start start 2023-12-12T09:43:31.975 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.974+0000 7f8b1f1bb640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8b1806d160 0x7f8b180999d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:31.975 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.974+0000 7f8b1f1bb640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8b180c67e0 0x7f8b1814dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:31.975 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.974+0000 7f8b1f1bb640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8b181ed380 0x7f8b181ed830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:31.975 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.974+0000 7f8b1f1bb640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b1814f320 con 0x7f8b180c67e0 2023-12-12T09:43:31.975 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.974+0000 7f8b1f1bb640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b181e7850 con 0x7f8b1806d160 2023-12-12T09:43:31.975 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.974+0000 7f8b1f1bb640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b1809aec0 con 0x7f8b181ed380 2023-12-12T09:43:31.975 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.974+0000 7f8b17fff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8b180c67e0 0x7f8b1814dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:31.975 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.975+0000 7f8b17fff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8b180c67e0 0x7f8b1814dcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:56808/0 (socket says 172.21.15.73:56808) 2023-12-12T09:43:31.975 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.975+0000 7f8b17fff640 1 -- 172.21.15.73:0/1508459127 learned_addr learned my addr 172.21.15.73:0/1508459127 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:43:31.975 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.975+0000 7f8b1cf57640 1 --2- 172.21.15.73:0/1508459127 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8b1806d160 0x7f8b180999d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:31.975 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.975+0000 7f8b1d758640 1 --2- 172.21.15.73:0/1508459127 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8b181ed380 0x7f8b181ed830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:31.976 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.975+0000 7f8b17fff640 1 -- 172.21.15.73:0/1508459127 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8b181ed380 msgr2=0x7f8b181ed830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:31.976 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.975+0000 7f8b17fff640 1 --2- 172.21.15.73:0/1508459127 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8b181ed380 0x7f8b181ed830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:31.976 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.975+0000 7f8b17fff640 1 -- 172.21.15.73:0/1508459127 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8b1806d160 msgr2=0x7f8b180999d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:31.976 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.975+0000 7f8b17fff640 1 --2- 172.21.15.73:0/1508459127 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8b1806d160 0x7f8b180999d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:31.976 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.975+0000 7f8b17fff640 1 -- 172.21.15.73:0/1508459127 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b0c0094d0 con 0x7f8b180c67e0 2023-12-12T09:43:31.977 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.975+0000 7f8b17fff640 1 --2- 172.21.15.73:0/1508459127 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8b180c67e0 0x7f8b1814dcf0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f8b0400c820 tx=0x7f8b0400cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:43:31.977 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.975+0000 7f8b157fa640 1 -- 172.21.15.73:0/1508459127 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b04007a30 con 0x7f8b180c67e0 2023-12-12T09:43:31.978 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.975+0000 7f8b157fa640 1 -- 172.21.15.73:0/1508459127 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b04007b90 con 0x7f8b180c67e0 2023-12-12T09:43:31.978 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.975+0000 7f8b1f1bb640 1 -- 172.21.15.73:0/1508459127 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b1814ecf0 con 0x7f8b180c67e0 2023-12-12T09:43:31.978 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.976+0000 7f8b157fa640 1 -- 172.21.15.73:0/1508459127 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b0400ce10 con 0x7f8b180c67e0 2023-12-12T09:43:31.978 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.976+0000 7f8b1f1bb640 1 -- 172.21.15.73:0/1508459127 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b1814e230 con 0x7f8b180c67e0 2023-12-12T09:43:31.978 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.977+0000 7f8b1f1bb640 1 -- 172.21.15.73:0/1508459127 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b18067580 con 0x7f8b180c67e0 2023-12-12T09:43:31.979 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.978+0000 7f8b157fa640 1 -- 172.21.15.73:0/1508459127 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f8b040113f0 con 0x7f8b180c67e0 2023-12-12T09:43:31.979 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.978+0000 7f8b157fa640 1 --2- 172.21.15.73:0/1508459127 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f8afc06ae40 0x7f8afc06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:31.979 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.978+0000 7f8b157fa640 1 -- 172.21.15.73:0/1508459127 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8b04089650 con 0x7f8b180c67e0 2023-12-12T09:43:31.979 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.979+0000 7f8b1cf57640 1 --2- 172.21.15.73:0/1508459127 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f8afc06ae40 0x7f8afc06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:31.979 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.979+0000 7f8b1cf57640 1 --2- 172.21.15.73:0/1508459127 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f8afc06ae40 0x7f8afc06d300 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f8b0c036000 tx=0x7f8b0c03d040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:43:31.983 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:31.983+0000 7f8b157fa640 1 -- 172.21.15.73:0/1508459127 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f8b04054790 con 0x7f8b180c67e0 2023-12-12T09:43:32.158 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:32.155+0000 7f8b1f1bb640 1 -- 172.21.15.73:0/1508459127 --> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f8b180c1dd0 con 0x7f8afc06ae40 2023-12-12T09:43:32.175 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:32.175+0000 7f8b157fa640 1 -- 172.21.15.73:0/1508459127 <== mgr.4110 v2:172.21.15.73:6832/779985841 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264382 (secure 0 0 0) 0x7f8b0c031c40 con 0x7f8afc06ae40 2023-12-12T09:43:32.179 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-12T09:43:32.180 INFO:teuthology.orchestra.run.smithi073.stderr:dumped all 2023-12-12T09:43:32.182 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:32.180+0000 7f8b1f1bb640 1 -- 172.21.15.73:0/1508459127 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f8afc06ae40 msgr2=0x7f8afc06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:32.183 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:32.180+0000 7f8b1f1bb640 1 --2- 172.21.15.73:0/1508459127 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f8afc06ae40 0x7f8afc06d300 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f8b0c036000 tx=0x7f8b0c03d040 comp rx=0 tx=0).stop 2023-12-12T09:43:32.183 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:32.180+0000 7f8b1f1bb640 1 -- 172.21.15.73:0/1508459127 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8b180c67e0 msgr2=0x7f8b1814dcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:32.183 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:32.180+0000 7f8b1f1bb640 1 --2- 172.21.15.73:0/1508459127 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8b180c67e0 0x7f8b1814dcf0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f8b0400c820 tx=0x7f8b0400cce0 comp rx=0 tx=0).stop 2023-12-12T09:43:32.183 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:32.181+0000 7f8b1f1bb640 1 -- 172.21.15.73:0/1508459127 shutdown_connections 2023-12-12T09:43:32.183 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:32.181+0000 7f8b1f1bb640 1 --2- 172.21.15.73:0/1508459127 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f8afc06ae40 0x7f8afc06d300 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:32.183 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:32.181+0000 7f8b1f1bb640 1 --2- 172.21.15.73:0/1508459127 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8b181ed380 0x7f8b181ed830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:32.183 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:32.181+0000 7f8b1f1bb640 1 --2- 172.21.15.73:0/1508459127 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8b180c67e0 0x7f8b1814dcf0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:32.183 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:32.181+0000 7f8b1f1bb640 1 --2- 172.21.15.73:0/1508459127 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8b1806d160 0x7f8b180999d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:32.183 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:32.181+0000 7f8b1f1bb640 1 -- 172.21.15.73:0/1508459127 >> 172.21.15.73:0/1508459127 conn(0x7f8b180c7cc0 msgr2=0x7f8b1806e6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:43:32.183 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:32.181+0000 7f8b1f1bb640 1 -- 172.21.15.73:0/1508459127 shutdown_connections 2023-12-12T09:43:32.184 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:32.181+0000 7f8b1f1bb640 1 -- 172.21.15.73:0/1508459127 wait complete. 2023-12-12T09:43:32.199 INFO:teuthology.orchestra.run.smithi073.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2023-12-12T09:43:31.458326+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218116,"kb_used_data":1888,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754756604,"statfs":{"total":773094113280,"available":772870762496,"internally_reserved":0,"allocated":1933312,"data_stored":1790204,"data_compressed":64844,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":10,"num_read_kb":9,"num_write":59,"num_write_kb":276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.236115"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-12-12T09:43:23.513587+0000","last_change":"2023-12-12T09:43:22.259173+0000","last_active":"2023-12-12T09:43:23.513587+0000","last_peered":"2023-12-12T09:43:23.513587+0000","last_clean":"2023-12-12T09:43:23.513587+0000","last_became_active":"2023-12-12T09:43:22.257823+0000","last_became_peered":"2023-12-12T09:43:22.257823+0000","last_unstale":"2023-12-12T09:43:23.513587+0000","last_undegraded":"2023-12-12T09:43:23.513587+0000","last_fullsized":"2023-12-12T09:43:23.513587+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_clean_scrub_stamp":"2023-12-12T09:43:21.241417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T11:44:44.846070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-12-12T09:43:23.228756+0000","last_change":"2023-12-12T09:43:22.246332+0000","last_active":"2023-12-12T09:43:23.228756+0000","last_peered":"2023-12-12T09:43:23.228756+0000","last_clean":"2023-12-12T09:43:23.228756+0000","last_became_active":"2023-12-12T09:43:22.245968+0000","last_became_peered":"2023-12-12T09:43:22.245968+0000","last_unstale":"2023-12-12T09:43:23.228756+0000","last_undegraded":"2023-12-12T09:43:23.228756+0000","last_fullsized":"2023-12-12T09:43:23.228756+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_clean_scrub_stamp":"2023-12-12T09:43:21.241417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T13:28:21.176910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-12-12T09:43:23.512350+0000","last_change":"2023-12-12T09:43:22.256406+0000","last_active":"2023-12-12T09:43:23.512350+0000","last_peered":"2023-12-12T09:43:23.512350+0000","last_clean":"2023-12-12T09:43:23.512350+0000","last_became_active":"2023-12-12T09:43:22.256051+0000","last_became_peered":"2023-12-12T09:43:22.256051+0000","last_unstale":"2023-12-12T09:43:23.512350+0000","last_undegraded":"2023-12-12T09:43:23.512350+0000","last_fullsized":"2023-12-12T09:43:23.512350+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_clean_scrub_stamp":"2023-12-12T09:43:21.241417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T11:56:43.095343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-12-12T09:43:23.232452+0000","last_change":"2023-12-12T09:43:22.270381+0000","last_active":"2023-12-12T09:43:23.232452+0000","last_peered":"2023-12-12T09:43:23.232452+0000","last_clean":"2023-12-12T09:43:23.232452+0000","last_became_active":"2023-12-12T09:43:22.270156+0000","last_became_peered":"2023-12-12T09:43:22.270156+0000","last_unstale":"2023-12-12T09:43:23.232452+0000","last_undegraded":"2023-12-12T09:43:23.232452+0000","last_fullsized":"2023-12-12T09:43:23.232452+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_clean_scrub_stamp":"2023-12-12T09:43:21.241417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T12:09:32.290407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-12-12T09:43:23.512600+0000","last_change":"2023-12-12T09:43:22.256406+0000","last_active":"2023-12-12T09:43:23.512600+0000","last_peered":"2023-12-12T09:43:23.512600+0000","last_clean":"2023-12-12T09:43:23.512600+0000","last_became_active":"2023-12-12T09:43:22.256089+0000","last_became_peered":"2023-12-12T09:43:22.256089+0000","last_unstale":"2023-12-12T09:43:23.512600+0000","last_undegraded":"2023-12-12T09:43:23.512600+0000","last_fullsized":"2023-12-12T09:43:23.512600+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_clean_scrub_stamp":"2023-12-12T09:43:21.241417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T12:08:27.288104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-12-12T09:43:23.231961+0000","last_change":"2023-12-12T09:43:22.262100+0000","last_active":"2023-12-12T09:43:23.231961+0000","last_peered":"2023-12-12T09:43:23.231961+0000","last_clean":"2023-12-12T09:43:23.231961+0000","last_became_active":"2023-12-12T09:43:22.250378+0000","last_became_peered":"2023-12-12T09:43:22.250378+0000","last_unstale":"2023-12-12T09:43:23.231961+0000","last_undegraded":"2023-12-12T09:43:23.231961+0000","last_fullsized":"2023-12-12T09:43:23.231961+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_clean_scrub_stamp":"2023-12-12T09:43:21.241417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T13:28:21.176910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-12-12T09:43:23.511903+0000","last_change":"2023-12-12T09:43:22.257819+0000","last_active":"2023-12-12T09:43:23.511903+0000","last_peered":"2023-12-12T09:43:23.511903+0000","last_clean":"2023-12-12T09:43:23.511903+0000","last_became_active":"2023-12-12T09:43:22.257516+0000","last_became_peered":"2023-12-12T09:43:22.257516+0000","last_unstale":"2023-12-12T09:43:23.511903+0000","last_undegraded":"2023-12-12T09:43:23.511903+0000","last_fullsized":"2023-12-12T09:43:23.511903+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_clean_scrub_stamp":"2023-12-12T09:43:21.241417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T13:22:21.650455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-12-12T09:43:23.511693+0000","last_change":"2023-12-12T09:43:22.250148+0000","last_active":"2023-12-12T09:43:23.511693+0000","last_peered":"2023-12-12T09:43:23.511693+0000","last_clean":"2023-12-12T09:43:23.511693+0000","last_became_active":"2023-12-12T09:43:22.249829+0000","last_became_peered":"2023-12-12T09:43:22.249829+0000","last_unstale":"2023-12-12T09:43:23.511693+0000","last_undegraded":"2023-12-12T09:43:23.511693+0000","last_fullsized":"2023-12-12T09:43:23.511693+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_clean_scrub_stamp":"2023-12-12T09:43:21.241417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T10:01:50.869497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-12-12T09:43:23.513773+0000","last_change":"2023-12-12T09:43:22.283672+0000","last_active":"2023-12-12T09:43:23.513773+0000","last_peered":"2023-12-12T09:43:23.513773+0000","last_clean":"2023-12-12T09:43:23.513773+0000","last_became_active":"2023-12-12T09:43:22.283234+0000","last_became_peered":"2023-12-12T09:43:22.283234+0000","last_unstale":"2023-12-12T09:43:23.513773+0000","last_undegraded":"2023-12-12T09:43:23.513773+0000","last_fullsized":"2023-12-12T09:43:23.513773+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_clean_scrub_stamp":"2023-12-12T09:43:21.241417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T20:45:26.767222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-12-12T09:43:23.235723+0000","last_change":"2023-12-12T09:43:22.271352+0000","last_active":"2023-12-12T09:43:23.235723+0000","last_peered":"2023-12-12T09:43:23.235723+0000","last_clean":"2023-12-12T09:43:23.235723+0000","last_became_active":"2023-12-12T09:43:22.271056+0000","last_became_peered":"2023-12-12T09:43:22.271056+0000","last_unstale":"2023-12-12T09:43:23.235723+0000","last_undegraded":"2023-12-12T09:43:23.235723+0000","last_fullsized":"2023-12-12T09:43:23.235723+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_clean_scrub_stamp":"2023-12-12T09:43:21.241417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T13:28:21.176910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-12-12T09:43:23.235191+0000","last_change":"2023-12-12T09:43:22.271790+0000","last_active":"2023-12-12T09:43:23.235191+0000","last_peered":"2023-12-12T09:43:23.235191+0000","last_clean":"2023-12-12T09:43:23.235191+0000","last_became_active":"2023-12-12T09:43:22.271591+0000","last_became_peered":"2023-12-12T09:43:22.271591+0000","last_unstale":"2023-12-12T09:43:23.235191+0000","last_undegraded":"2023-12-12T09:43:23.235191+0000","last_fullsized":"2023-12-12T09:43:23.235191+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_clean_scrub_stamp":"2023-12-12T09:43:21.241417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T17:19:30.590382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-12-12T09:43:23.511156+0000","last_change":"2023-12-12T09:43:22.260477+0000","last_active":"2023-12-12T09:43:23.511156+0000","last_peered":"2023-12-12T09:43:23.511156+0000","last_clean":"2023-12-12T09:43:23.511156+0000","last_became_active":"2023-12-12T09:43:22.258474+0000","last_became_peered":"2023-12-12T09:43:22.258474+0000","last_unstale":"2023-12-12T09:43:23.511156+0000","last_undegraded":"2023-12-12T09:43:23.511156+0000","last_fullsized":"2023-12-12T09:43:23.511156+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_clean_scrub_stamp":"2023-12-12T09:43:21.241417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T17:30:21.214675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-12-12T09:43:23.513789+0000","last_change":"2023-12-12T09:43:22.256210+0000","last_active":"2023-12-12T09:43:23.513789+0000","last_peered":"2023-12-12T09:43:23.513789+0000","last_clean":"2023-12-12T09:43:23.513789+0000","last_became_active":"2023-12-12T09:43:22.255873+0000","last_became_peered":"2023-12-12T09:43:22.255873+0000","last_unstale":"2023-12-12T09:43:23.513789+0000","last_undegraded":"2023-12-12T09:43:23.513789+0000","last_fullsized":"2023-12-12T09:43:23.513789+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_clean_scrub_stamp":"2023-12-12T09:43:21.241417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T12:09:32.290407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-12-12T09:43:23.509500+0000","last_change":"2023-12-12T09:43:22.261015+0000","last_active":"2023-12-12T09:43:23.509500+0000","last_peered":"2023-12-12T09:43:23.509500+0000","last_clean":"2023-12-12T09:43:23.509500+0000","last_became_active":"2023-12-12T09:43:22.260799+0000","last_became_peered":"2023-12-12T09:43:22.260799+0000","last_unstale":"2023-12-12T09:43:23.509500+0000","last_undegraded":"2023-12-12T09:43:23.509500+0000","last_fullsized":"2023-12-12T09:43:23.509500+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_clean_scrub_stamp":"2023-12-12T09:43:21.241417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T17:13:30.502374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-12-12T09:43:23.228621+0000","last_change":"2023-12-12T09:43:22.251732+0000","last_active":"2023-12-12T09:43:23.228621+0000","last_peered":"2023-12-12T09:43:23.228621+0000","last_clean":"2023-12-12T09:43:23.228621+0000","last_became_active":"2023-12-12T09:43:22.251022+0000","last_became_peered":"2023-12-12T09:43:22.251022+0000","last_unstale":"2023-12-12T09:43:23.228621+0000","last_undegraded":"2023-12-12T09:43:23.228621+0000","last_fullsized":"2023-12-12T09:43:23.228621+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_clean_scrub_stamp":"2023-12-12T09:43:21.241417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T11:56:43.095343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-12-12T09:43:23.231963+0000","last_change":"2023-12-12T09:43:22.249945+0000","last_active":"2023-12-12T09:43:23.231963+0000","last_peered":"2023-12-12T09:43:23.231963+0000","last_clean":"2023-12-12T09:43:23.231963+0000","last_became_active":"2023-12-12T09:43:22.248947+0000","last_became_peered":"2023-12-12T09:43:22.248947+0000","last_unstale":"2023-12-12T09:43:23.231963+0000","last_undegraded":"2023-12-12T09:43:23.231963+0000","last_fullsized":"2023-12-12T09:43:23.231963+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_clean_scrub_stamp":"2023-12-12T09:43:21.241417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T10:52:36.164447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-12-12T09:43:23.234030+0000","last_change":"2023-12-12T09:43:22.269637+0000","last_active":"2023-12-12T09:43:23.234030+0000","last_peered":"2023-12-12T09:43:23.234030+0000","last_clean":"2023-12-12T09:43:23.234030+0000","last_became_active":"2023-12-12T09:43:22.269332+0000","last_became_peered":"2023-12-12T09:43:22.269332+0000","last_unstale":"2023-12-12T09:43:23.234030+0000","last_undegraded":"2023-12-12T09:43:23.234030+0000","last_fullsized":"2023-12-12T09:43:23.234030+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_clean_scrub_stamp":"2023-12-12T09:43:21.241417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T16:30:08.113732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-12-12T09:43:23.514190+0000","last_change":"2023-12-12T09:43:22.253973+0000","last_active":"2023-12-12T09:43:23.514190+0000","last_peered":"2023-12-12T09:43:23.514190+0000","last_clean":"2023-12-12T09:43:23.514190+0000","last_became_active":"2023-12-12T09:43:22.253518+0000","last_became_peered":"2023-12-12T09:43:22.253518+0000","last_unstale":"2023-12-12T09:43:23.514190+0000","last_undegraded":"2023-12-12T09:43:23.514190+0000","last_fullsized":"2023-12-12T09:43:23.514190+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_clean_scrub_stamp":"2023-12-12T09:43:21.241417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T11:40:42.785424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-12-12T09:43:23.512776+0000","last_change":"2023-12-12T09:43:22.260001+0000","last_active":"2023-12-12T09:43:23.512776+0000","last_peered":"2023-12-12T09:43:23.512776+0000","last_clean":"2023-12-12T09:43:23.512776+0000","last_became_active":"2023-12-12T09:43:22.259694+0000","last_became_peered":"2023-12-12T09:43:22.259694+0000","last_unstale":"2023-12-12T09:43:23.512776+0000","last_undegraded":"2023-12-12T09:43:23.512776+0000","last_fullsized":"2023-12-12T09:43:23.512776+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_clean_scrub_stamp":"2023-12-12T09:43:21.241417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T13:12:59.364006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-12-12T09:43:23.235234+0000","last_change":"2023-12-12T09:43:22.261171+0000","last_active":"2023-12-12T09:43:23.235234+0000","last_peered":"2023-12-12T09:43:23.235234+0000","last_clean":"2023-12-12T09:43:23.235234+0000","last_became_active":"2023-12-12T09:43:22.257505+0000","last_became_peered":"2023-12-12T09:43:22.257505+0000","last_unstale":"2023-12-12T09:43:23.235234+0000","last_undegraded":"2023-12-12T09:43:23.235234+0000","last_fullsized":"2023-12-12T09:43:23.235234+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_clean_scrub_stamp":"2023-12-12T09:43:21.241417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T11:56:43.095343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-12-12T09:43:23.510222+0000","last_change":"2023-12-12T09:43:22.249523+0000","last_active":"2023-12-12T09:43:23.510222+0000","last_peered":"2023-12-12T09:43:23.510222+0000","last_clean":"2023-12-12T09:43:23.510222+0000","last_became_active":"2023-12-12T09:43:22.249225+0000","last_became_peered":"2023-12-12T09:43:22.249225+0000","last_unstale":"2023-12-12T09:43:23.510222+0000","last_undegraded":"2023-12-12T09:43:23.510222+0000","last_fullsized":"2023-12-12T09:43:23.510222+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_clean_scrub_stamp":"2023-12-12T09:43:21.241417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T20:17:31.359873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-12-12T09:43:23.232234+0000","last_change":"2023-12-12T09:43:22.262015+0000","last_active":"2023-12-12T09:43:23.232234+0000","last_peered":"2023-12-12T09:43:23.232234+0000","last_clean":"2023-12-12T09:43:23.232234+0000","last_became_active":"2023-12-12T09:43:22.249119+0000","last_became_peered":"2023-12-12T09:43:22.249119+0000","last_unstale":"2023-12-12T09:43:23.232234+0000","last_undegraded":"2023-12-12T09:43:23.232234+0000","last_fullsized":"2023-12-12T09:43:23.232234+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_clean_scrub_stamp":"2023-12-12T09:43:21.241417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T19:41:10.137746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-12-12T09:43:23.511791+0000","last_change":"2023-12-12T09:43:22.262018+0000","last_active":"2023-12-12T09:43:23.511791+0000","last_peered":"2023-12-12T09:43:23.511791+0000","last_clean":"2023-12-12T09:43:23.511791+0000","last_became_active":"2023-12-12T09:43:22.261664+0000","last_became_peered":"2023-12-12T09:43:22.261664+0000","last_unstale":"2023-12-12T09:43:23.511791+0000","last_undegraded":"2023-12-12T09:43:23.511791+0000","last_fullsized":"2023-12-12T09:43:23.511791+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_clean_scrub_stamp":"2023-12-12T09:43:21.241417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T17:19:30.590382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-12-12T09:43:23.232314+0000","last_change":"2023-12-12T09:43:22.262378+0000","last_active":"2023-12-12T09:43:23.232314+0000","last_peered":"2023-12-12T09:43:23.232314+0000","last_clean":"2023-12-12T09:43:23.232314+0000","last_became_active":"2023-12-12T09:43:22.257809+0000","last_became_peered":"2023-12-12T09:43:22.257809+0000","last_unstale":"2023-12-12T09:43:23.232314+0000","last_undegraded":"2023-12-12T09:43:23.232314+0000","last_fullsized":"2023-12-12T09:43:23.232314+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_clean_scrub_stamp":"2023-12-12T09:43:21.241417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T13:17:19.564666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-12-12T09:43:23.512246+0000","last_change":"2023-12-12T09:43:22.255723+0000","last_active":"2023-12-12T09:43:23.512246+0000","last_peered":"2023-12-12T09:43:23.512246+0000","last_clean":"2023-12-12T09:43:23.512246+0000","last_became_active":"2023-12-12T09:43:22.255373+0000","last_became_peered":"2023-12-12T09:43:22.255373+0000","last_unstale":"2023-12-12T09:43:23.512246+0000","last_undegraded":"2023-12-12T09:43:23.512246+0000","last_fullsized":"2023-12-12T09:43:23.512246+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_clean_scrub_stamp":"2023-12-12T09:43:21.241417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T10:52:36.164447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-12-12T09:43:23.235623+0000","last_change":"2023-12-12T09:43:22.257161+0000","last_active":"2023-12-12T09:43:23.235623+0000","last_peered":"2023-12-12T09:43:23.235623+0000","last_clean":"2023-12-12T09:43:23.235623+0000","last_became_active":"2023-12-12T09:43:22.256836+0000","last_became_peered":"2023-12-12T09:43:22.256836+0000","last_unstale":"2023-12-12T09:43:23.235623+0000","last_undegraded":"2023-12-12T09:43:23.235623+0000","last_fullsized":"2023-12-12T09:43:23.235623+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_clean_scrub_stamp":"2023-12-12T09:43:21.241417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T10:52:36.164447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-12-12T09:43:23.228750+0000","last_change":"2023-12-12T09:43:22.248044+0000","last_active":"2023-12-12T09:43:23.228750+0000","last_peered":"2023-12-12T09:43:23.228750+0000","last_clean":"2023-12-12T09:43:23.228750+0000","last_became_active":"2023-12-12T09:43:22.247775+0000","last_became_peered":"2023-12-12T09:43:22.247775+0000","last_unstale":"2023-12-12T09:43:23.228750+0000","last_undegraded":"2023-12-12T09:43:23.228750+0000","last_fullsized":"2023-12-12T09:43:23.228750+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_clean_scrub_stamp":"2023-12-12T09:43:21.241417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T10:52:36.164447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-12-12T09:43:23.512629+0000","last_change":"2023-12-12T09:43:22.254318+0000","last_active":"2023-12-12T09:43:23.512629+0000","last_peered":"2023-12-12T09:43:23.512629+0000","last_clean":"2023-12-12T09:43:23.512629+0000","last_became_active":"2023-12-12T09:43:22.253983+0000","last_became_peered":"2023-12-12T09:43:22.253983+0000","last_unstale":"2023-12-12T09:43:23.512629+0000","last_undegraded":"2023-12-12T09:43:23.512629+0000","last_fullsized":"2023-12-12T09:43:23.512629+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_clean_scrub_stamp":"2023-12-12T09:43:21.241417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T13:17:19.564666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-12-12T09:43:23.510548+0000","last_change":"2023-12-12T09:43:22.259144+0000","last_active":"2023-12-12T09:43:23.510548+0000","last_peered":"2023-12-12T09:43:23.510548+0000","last_clean":"2023-12-12T09:43:23.510548+0000","last_became_active":"2023-12-12T09:43:22.258791+0000","last_became_peered":"2023-12-12T09:43:22.258791+0000","last_unstale":"2023-12-12T09:43:23.510548+0000","last_undegraded":"2023-12-12T09:43:23.510548+0000","last_fullsized":"2023-12-12T09:43:23.510548+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_clean_scrub_stamp":"2023-12-12T09:43:21.241417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T10:01:50.869497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-12-12T09:43:23.232428+0000","last_change":"2023-12-12T09:43:22.262253+0000","last_active":"2023-12-12T09:43:23.232428+0000","last_peered":"2023-12-12T09:43:23.232428+0000","last_clean":"2023-12-12T09:43:23.232428+0000","last_became_active":"2023-12-12T09:43:22.250870+0000","last_became_peered":"2023-12-12T09:43:22.250870+0000","last_unstale":"2023-12-12T09:43:23.232428+0000","last_undegraded":"2023-12-12T09:43:23.232428+0000","last_fullsized":"2023-12-12T09:43:23.232428+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_clean_scrub_stamp":"2023-12-12T09:43:21.241417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T13:22:21.650455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-12-12T09:43:23.510589+0000","last_change":"2023-12-12T09:43:22.247885+0000","last_active":"2023-12-12T09:43:23.510589+0000","last_peered":"2023-12-12T09:43:23.510589+0000","last_clean":"2023-12-12T09:43:23.510589+0000","last_became_active":"2023-12-12T09:43:22.245305+0000","last_became_peered":"2023-12-12T09:43:22.245305+0000","last_unstale":"2023-12-12T09:43:23.510589+0000","last_undegraded":"2023-12-12T09:43:23.510589+0000","last_fullsized":"2023-12-12T09:43:23.510589+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_clean_scrub_stamp":"2023-12-12T09:43:21.241417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T17:30:21.214675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-12-12T09:43:23.234759+0000","last_change":"2023-12-12T09:43:22.262475+0000","last_active":"2023-12-12T09:43:23.234759+0000","last_peered":"2023-12-12T09:43:23.234759+0000","last_clean":"2023-12-12T09:43:23.234759+0000","last_became_active":"2023-12-12T09:43:22.260635+0000","last_became_peered":"2023-12-12T09:43:22.260635+0000","last_unstale":"2023-12-12T09:43:23.234759+0000","last_undegraded":"2023-12-12T09:43:23.234759+0000","last_fullsized":"2023-12-12T09:43:23.234759+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_clean_scrub_stamp":"2023-12-12T09:43:21.241417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T10:01:50.869497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-12-12T09:43:23.510507+0000","last_change":"2023-12-12T09:43:22.253497+0000","last_active":"2023-12-12T09:43:23.510507+0000","last_peered":"2023-12-12T09:43:23.510507+0000","last_clean":"2023-12-12T09:43:23.510507+0000","last_became_active":"2023-12-12T09:43:22.253062+0000","last_became_peered":"2023-12-12T09:43:22.253062+0000","last_unstale":"2023-12-12T09:43:23.510507+0000","last_undegraded":"2023-12-12T09:43:23.510507+0000","last_fullsized":"2023-12-12T09:43:23.510507+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_clean_scrub_stamp":"2023-12-12T09:43:21.241417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T11:24:12.081000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-12-12T09:43:23.514357+0000","last_change":"2023-12-12T09:43:21.297984+0000","last_active":"2023-12-12T09:43:23.514357+0000","last_peered":"2023-12-12T09:43:23.514357+0000","last_clean":"2023-12-12T09:43:23.514357+0000","last_became_active":"2023-12-12T09:43:21.297753+0000","last_became_peered":"2023-12-12T09:43:21.297753+0000","last_unstale":"2023-12-12T09:43:23.514357+0000","last_undegraded":"2023-12-12T09:43:23.514357+0000","last_fullsized":"2023-12-12T09:43:23.514357+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:43:20.054829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:43:20.054829+0000","last_clean_scrub_stamp":"2023-12-12T09:43:20.054829+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T14:02:28.705261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-12-12T09:43:23.510862+0000","last_change":"2023-12-12T09:43:22.257540+0000","last_active":"2023-12-12T09:43:23.510862+0000","last_peered":"2023-12-12T09:43:23.510862+0000","last_clean":"2023-12-12T09:43:23.510862+0000","last_became_active":"2023-12-12T09:43:22.257172+0000","last_became_peered":"2023-12-12T09:43:22.257172+0000","last_unstale":"2023-12-12T09:43:23.510862+0000","last_undegraded":"2023-12-12T09:43:23.510862+0000","last_fullsized":"2023-12-12T09:43:23.510862+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_clean_scrub_stamp":"2023-12-12T09:43:21.241417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T17:19:30.590382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-12-12T09:43:23.235423+0000","last_change":"2023-12-12T09:43:21.301627+0000","last_active":"2023-12-12T09:43:23.235423+0000","last_peered":"2023-12-12T09:43:23.235423+0000","last_clean":"2023-12-12T09:43:23.235423+0000","last_became_active":"2023-12-12T09:43:21.296928+0000","last_became_peered":"2023-12-12T09:43:21.296928+0000","last_unstale":"2023-12-12T09:43:23.235423+0000","last_undegraded":"2023-12-12T09:43:23.235423+0000","last_fullsized":"2023-12-12T09:43:23.235423+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:43:20.054829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:43:20.054829+0000","last_clean_scrub_stamp":"2023-12-12T09:43:20.054829+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T17:13:29.315785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-12-12T09:43:23.511662+0000","last_change":"2023-12-12T09:43:21.292918+0000","last_active":"2023-12-12T09:43:23.511662+0000","last_peered":"2023-12-12T09:43:23.511662+0000","last_clean":"2023-12-12T09:43:23.511662+0000","last_became_active":"2023-12-12T09:43:21.292599+0000","last_became_peered":"2023-12-12T09:43:21.292599+0000","last_unstale":"2023-12-12T09:43:23.511662+0000","last_undegraded":"2023-12-12T09:43:23.511662+0000","last_fullsized":"2023-12-12T09:43:23.511662+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:43:20.054829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:43:20.054829+0000","last_clean_scrub_stamp":"2023-12-12T09:43:20.054829+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T17:13:29.315785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-12-12T09:43:23.512032+0000","last_change":"2023-12-12T09:43:22.250889+0000","last_active":"2023-12-12T09:43:23.512032+0000","last_peered":"2023-12-12T09:43:23.512032+0000","last_clean":"2023-12-12T09:43:23.512032+0000","last_became_active":"2023-12-12T09:43:22.249404+0000","last_became_peered":"2023-12-12T09:43:22.249404+0000","last_unstale":"2023-12-12T09:43:23.512032+0000","last_undegraded":"2023-12-12T09:43:23.512032+0000","last_fullsized":"2023-12-12T09:43:23.512032+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_clean_scrub_stamp":"2023-12-12T09:43:21.241417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T11:56:43.095343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-12-12T09:43:23.232554+0000","last_change":"2023-12-12T09:43:21.283438+0000","last_active":"2023-12-12T09:43:23.232554+0000","last_peered":"2023-12-12T09:43:23.232554+0000","last_clean":"2023-12-12T09:43:23.232554+0000","last_became_active":"2023-12-12T09:43:21.283168+0000","last_became_peered":"2023-12-12T09:43:21.283168+0000","last_unstale":"2023-12-12T09:43:23.232554+0000","last_undegraded":"2023-12-12T09:43:23.232554+0000","last_fullsized":"2023-12-12T09:43:23.232554+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:43:20.054829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:43:20.054829+0000","last_clean_scrub_stamp":"2023-12-12T09:43:20.054829+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T19:29:29.412626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-12-12T09:43:23.228419+0000","last_change":"2023-12-12T09:43:22.246835+0000","last_active":"2023-12-12T09:43:23.228419+0000","last_peered":"2023-12-12T09:43:23.228419+0000","last_clean":"2023-12-12T09:43:23.228419+0000","last_became_active":"2023-12-12T09:43:22.246425+0000","last_became_peered":"2023-12-12T09:43:22.246425+0000","last_unstale":"2023-12-12T09:43:23.228419+0000","last_undegraded":"2023-12-12T09:43:23.228419+0000","last_fullsized":"2023-12-12T09:43:23.228419+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_clean_scrub_stamp":"2023-12-12T09:43:21.241417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T10:01:50.869497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-12-12T09:43:23.235408+0000","last_change":"2023-12-12T09:43:21.296908+0000","last_active":"2023-12-12T09:43:23.235408+0000","last_peered":"2023-12-12T09:43:23.235408+0000","last_clean":"2023-12-12T09:43:23.235408+0000","last_became_active":"2023-12-12T09:43:21.296613+0000","last_became_peered":"2023-12-12T09:43:21.296613+0000","last_unstale":"2023-12-12T09:43:23.235408+0000","last_undegraded":"2023-12-12T09:43:23.235408+0000","last_fullsized":"2023-12-12T09:43:23.235408+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:43:20.054829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:43:20.054829+0000","last_clean_scrub_stamp":"2023-12-12T09:43:20.054829+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T17:12:57.858301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-12-12T09:43:23.233425+0000","last_change":"2023-12-12T09:43:22.257034+0000","last_active":"2023-12-12T09:43:23.233425+0000","last_peered":"2023-12-12T09:43:23.233425+0000","last_clean":"2023-12-12T09:43:23.233425+0000","last_became_active":"2023-12-12T09:43:22.250340+0000","last_became_peered":"2023-12-12T09:43:22.250340+0000","last_unstale":"2023-12-12T09:43:23.233425+0000","last_undegraded":"2023-12-12T09:43:23.233425+0000","last_fullsized":"2023-12-12T09:43:23.233425+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_clean_scrub_stamp":"2023-12-12T09:43:21.241417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T11:37:48.456174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-12-12T09:43:23.233396+0000","last_change":"2023-12-12T09:43:21.303926+0000","last_active":"2023-12-12T09:43:23.233396+0000","last_peered":"2023-12-12T09:43:23.233396+0000","last_clean":"2023-12-12T09:43:23.233396+0000","last_became_active":"2023-12-12T09:43:21.303631+0000","last_became_peered":"2023-12-12T09:43:21.303631+0000","last_unstale":"2023-12-12T09:43:23.233396+0000","last_undegraded":"2023-12-12T09:43:23.233396+0000","last_fullsized":"2023-12-12T09:43:23.233396+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:43:20.054829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:43:20.054829+0000","last_clean_scrub_stamp":"2023-12-12T09:43:20.054829+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T10:01:49.682908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-12-12T09:43:23.513875+0000","last_change":"2023-12-12T09:43:22.252730+0000","last_active":"2023-12-12T09:43:23.513875+0000","last_peered":"2023-12-12T09:43:23.513875+0000","last_clean":"2023-12-12T09:43:23.513875+0000","last_became_active":"2023-12-12T09:43:22.252440+0000","last_became_peered":"2023-12-12T09:43:22.252440+0000","last_unstale":"2023-12-12T09:43:23.513875+0000","last_undegraded":"2023-12-12T09:43:23.513875+0000","last_fullsized":"2023-12-12T09:43:23.513875+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_clean_scrub_stamp":"2023-12-12T09:43:21.241417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T13:28:21.176910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-12-12T09:43:23.228903+0000","last_change":"2023-12-12T09:43:21.288877+0000","last_active":"2023-12-12T09:43:23.228903+0000","last_peered":"2023-12-12T09:43:23.228903+0000","last_clean":"2023-12-12T09:43:23.228903+0000","last_became_active":"2023-12-12T09:43:21.288552+0000","last_became_peered":"2023-12-12T09:43:21.288552+0000","last_unstale":"2023-12-12T09:43:23.228903+0000","last_undegraded":"2023-12-12T09:43:23.228903+0000","last_fullsized":"2023-12-12T09:43:23.228903+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:43:20.054829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:43:20.054829+0000","last_clean_scrub_stamp":"2023-12-12T09:43:20.054829+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T20:32:59.313749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-12-12T09:43:23.511204+0000","last_change":"2023-12-12T09:43:22.261371+0000","last_active":"2023-12-12T09:43:23.511204+0000","last_peered":"2023-12-12T09:43:23.511204+0000","last_clean":"2023-12-12T09:43:23.511204+0000","last_became_active":"2023-12-12T09:43:22.255661+0000","last_became_peered":"2023-12-12T09:43:22.255661+0000","last_unstale":"2023-12-12T09:43:23.511204+0000","last_undegraded":"2023-12-12T09:43:23.511204+0000","last_fullsized":"2023-12-12T09:43:23.511204+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_clean_scrub_stamp":"2023-12-12T09:43:21.241417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T11:40:42.785424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"20'6","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-12-12T09:43:23.235332+0000","last_change":"2023-12-12T09:43:21.302252+0000","last_active":"2023-12-12T09:43:23.235332+0000","last_peered":"2023-12-12T09:43:23.235332+0000","last_clean":"2023-12-12T09:43:23.235332+0000","last_became_active":"2023-12-12T09:43:21.301960+0000","last_became_peered":"2023-12-12T09:43:21.301960+0000","last_unstale":"2023-12-12T09:43:23.235332+0000","last_undegraded":"2023-12-12T09:43:23.235332+0000","last_fullsized":"2023-12-12T09:43:23.235332+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:43:20.054829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:43:20.054829+0000","last_clean_scrub_stamp":"2023-12-12T09:43:20.054829+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T21:27:10.922205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-12-12T09:43:23.512344+0000","last_change":"2023-12-12T09:43:22.264539+0000","last_active":"2023-12-12T09:43:23.512344+0000","last_peered":"2023-12-12T09:43:23.512344+0000","last_clean":"2023-12-12T09:43:23.512344+0000","last_became_active":"2023-12-12T09:43:22.264263+0000","last_became_peered":"2023-12-12T09:43:22.264263+0000","last_unstale":"2023-12-12T09:43:23.512344+0000","last_undegraded":"2023-12-12T09:43:23.512344+0000","last_fullsized":"2023-12-12T09:43:23.512344+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_clean_scrub_stamp":"2023-12-12T09:43:21.241417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T11:24:46.660535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-12-12T09:43:23.511008+0000","last_change":"2023-12-12T09:43:21.291014+0000","last_active":"2023-12-12T09:43:23.511008+0000","last_peered":"2023-12-12T09:43:23.511008+0000","last_clean":"2023-12-12T09:43:23.511008+0000","last_became_active":"2023-12-12T09:43:21.286948+0000","last_became_peered":"2023-12-12T09:43:21.286948+0000","last_unstale":"2023-12-12T09:43:23.511008+0000","last_undegraded":"2023-12-12T09:43:23.511008+0000","last_fullsized":"2023-12-12T09:43:23.511008+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:43:20.054829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:43:20.054829+0000","last_clean_scrub_stamp":"2023-12-12T09:43:20.054829+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T18:28:40.746959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-12-12T09:43:23.509853+0000","last_change":"2023-12-12T09:43:22.249360+0000","last_active":"2023-12-12T09:43:23.509853+0000","last_peered":"2023-12-12T09:43:23.509853+0000","last_clean":"2023-12-12T09:43:23.509853+0000","last_became_active":"2023-12-12T09:43:22.248965+0000","last_became_peered":"2023-12-12T09:43:22.248965+0000","last_unstale":"2023-12-12T09:43:23.509853+0000","last_undegraded":"2023-12-12T09:43:23.509853+0000","last_fullsized":"2023-12-12T09:43:23.509853+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_clean_scrub_stamp":"2023-12-12T09:43:21.241417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T14:02:29.891850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-12-12T09:43:23.232545+0000","last_change":"2023-12-12T09:43:21.291279+0000","last_active":"2023-12-12T09:43:23.232545+0000","last_peered":"2023-12-12T09:43:23.232545+0000","last_clean":"2023-12-12T09:43:23.232545+0000","last_became_active":"2023-12-12T09:43:21.290993+0000","last_became_peered":"2023-12-12T09:43:21.290993+0000","last_unstale":"2023-12-12T09:43:23.232545+0000","last_undegraded":"2023-12-12T09:43:23.232545+0000","last_fullsized":"2023-12-12T09:43:23.232545+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:43:20.054829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:43:20.054829+0000","last_clean_scrub_stamp":"2023-12-12T09:43:20.054829+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T21:27:10.922205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-12-12T09:43:23.512810+0000","last_change":"2023-12-12T09:43:22.264893+0000","last_active":"2023-12-12T09:43:23.512810+0000","last_peered":"2023-12-12T09:43:23.512810+0000","last_clean":"2023-12-12T09:43:23.512810+0000","last_became_active":"2023-12-12T09:43:22.262599+0000","last_became_peered":"2023-12-12T09:43:22.262599+0000","last_unstale":"2023-12-12T09:43:23.512810+0000","last_undegraded":"2023-12-12T09:43:23.512810+0000","last_fullsized":"2023-12-12T09:43:23.512810+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_clean_scrub_stamp":"2023-12-12T09:43:21.241417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T11:37:48.456174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-12-12T09:43:23.234782+0000","last_change":"2023-12-12T09:43:21.298187+0000","last_active":"2023-12-12T09:43:23.234782+0000","last_peered":"2023-12-12T09:43:23.234782+0000","last_clean":"2023-12-12T09:43:23.234782+0000","last_became_active":"2023-12-12T09:43:21.297563+0000","last_became_peered":"2023-12-12T09:43:21.297563+0000","last_unstale":"2023-12-12T09:43:23.234782+0000","last_undegraded":"2023-12-12T09:43:23.234782+0000","last_fullsized":"2023-12-12T09:43:23.234782+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:43:20.054829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:43:20.054829+0000","last_clean_scrub_stamp":"2023-12-12T09:43:20.054829+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T18:28:40.746959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-12-12T09:43:23.234722+0000","last_change":"2023-12-12T09:43:22.265004+0000","last_active":"2023-12-12T09:43:23.234722+0000","last_peered":"2023-12-12T09:43:23.234722+0000","last_clean":"2023-12-12T09:43:23.234722+0000","last_became_active":"2023-12-12T09:43:22.264691+0000","last_became_peered":"2023-12-12T09:43:22.264691+0000","last_unstale":"2023-12-12T09:43:23.234722+0000","last_undegraded":"2023-12-12T09:43:23.234722+0000","last_fullsized":"2023-12-12T09:43:23.234722+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_clean_scrub_stamp":"2023-12-12T09:43:21.241417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T20:17:31.359873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-12-12T09:43:23.510566+0000","last_change":"2023-12-12T09:43:21.284943+0000","last_active":"2023-12-12T09:43:23.510566+0000","last_peered":"2023-12-12T09:43:23.510566+0000","last_clean":"2023-12-12T09:43:23.510566+0000","last_became_active":"2023-12-12T09:43:21.284647+0000","last_became_peered":"2023-12-12T09:43:21.284647+0000","last_unstale":"2023-12-12T09:43:23.510566+0000","last_undegraded":"2023-12-12T09:43:23.510566+0000","last_fullsized":"2023-12-12T09:43:23.510566+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:43:20.054829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:43:20.054829+0000","last_clean_scrub_stamp":"2023-12-12T09:43:20.054829+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T11:24:10.894411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-12-12T09:43:23.511910+0000","last_change":"2023-12-12T09:43:22.265457+0000","last_active":"2023-12-12T09:43:23.511910+0000","last_peered":"2023-12-12T09:43:23.511910+0000","last_clean":"2023-12-12T09:43:23.511910+0000","last_became_active":"2023-12-12T09:43:22.263712+0000","last_became_peered":"2023-12-12T09:43:22.263712+0000","last_unstale":"2023-12-12T09:43:23.511910+0000","last_undegraded":"2023-12-12T09:43:23.511910+0000","last_fullsized":"2023-12-12T09:43:23.511910+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_clean_scrub_stamp":"2023-12-12T09:43:21.241417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T12:09:32.290407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-12-12T09:43:23.511049+0000","last_change":"2023-12-12T09:43:21.295422+0000","last_active":"2023-12-12T09:43:23.511049+0000","last_peered":"2023-12-12T09:43:23.511049+0000","last_clean":"2023-12-12T09:43:23.511049+0000","last_became_active":"2023-12-12T09:43:21.295045+0000","last_became_peered":"2023-12-12T09:43:21.295045+0000","last_unstale":"2023-12-12T09:43:23.511049+0000","last_undegraded":"2023-12-12T09:43:23.511049+0000","last_fullsized":"2023-12-12T09:43:23.511049+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:43:20.054829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:43:20.054829+0000","last_clean_scrub_stamp":"2023-12-12T09:43:20.054829+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T17:12:57.858301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-12-12T09:43:23.513178+0000","last_change":"2023-12-12T09:43:22.261274+0000","last_active":"2023-12-12T09:43:23.513178+0000","last_peered":"2023-12-12T09:43:23.513178+0000","last_clean":"2023-12-12T09:43:23.513178+0000","last_became_active":"2023-12-12T09:43:22.260940+0000","last_became_peered":"2023-12-12T09:43:22.260940+0000","last_unstale":"2023-12-12T09:43:23.513178+0000","last_undegraded":"2023-12-12T09:43:23.513178+0000","last_fullsized":"2023-12-12T09:43:23.513178+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_clean_scrub_stamp":"2023-12-12T09:43:21.241417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T16:30:08.113732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-12-12T09:43:23.514412+0000","last_change":"2023-12-12T09:43:21.292425+0000","last_active":"2023-12-12T09:43:23.514412+0000","last_peered":"2023-12-12T09:43:23.514412+0000","last_clean":"2023-12-12T09:43:23.514412+0000","last_became_active":"2023-12-12T09:43:21.290884+0000","last_became_peered":"2023-12-12T09:43:21.290884+0000","last_unstale":"2023-12-12T09:43:23.514412+0000","last_undegraded":"2023-12-12T09:43:23.514412+0000","last_fullsized":"2023-12-12T09:43:23.514412+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:43:20.054829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:43:20.054829+0000","last_clean_scrub_stamp":"2023-12-12T09:43:20.054829+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T10:41:13.505292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-12-12T09:43:23.513933+0000","last_change":"2023-12-12T09:43:22.261726+0000","last_active":"2023-12-12T09:43:23.513933+0000","last_peered":"2023-12-12T09:43:23.513933+0000","last_clean":"2023-12-12T09:43:23.513933+0000","last_became_active":"2023-12-12T09:43:22.261503+0000","last_became_peered":"2023-12-12T09:43:22.261503+0000","last_unstale":"2023-12-12T09:43:23.513933+0000","last_undegraded":"2023-12-12T09:43:23.513933+0000","last_fullsized":"2023-12-12T09:43:23.513933+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_clean_scrub_stamp":"2023-12-12T09:43:21.241417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T11:47:46.279003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-12-12T09:43:23.228883+0000","last_change":"2023-12-12T09:43:21.288749+0000","last_active":"2023-12-12T09:43:23.228883+0000","last_peered":"2023-12-12T09:43:23.228883+0000","last_clean":"2023-12-12T09:43:23.228883+0000","last_became_active":"2023-12-12T09:43:21.288489+0000","last_became_peered":"2023-12-12T09:43:21.288489+0000","last_unstale":"2023-12-12T09:43:23.228883+0000","last_undegraded":"2023-12-12T09:43:23.228883+0000","last_fullsized":"2023-12-12T09:43:23.228883+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:43:20.054829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:43:20.054829+0000","last_clean_scrub_stamp":"2023-12-12T09:43:20.054829+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T20:17:30.173285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-12-12T09:43:23.233067+0000","last_change":"2023-12-12T09:43:22.270243+0000","last_active":"2023-12-12T09:43:23.233067+0000","last_peered":"2023-12-12T09:43:23.233067+0000","last_clean":"2023-12-12T09:43:23.233067+0000","last_became_active":"2023-12-12T09:43:22.269976+0000","last_became_peered":"2023-12-12T09:43:22.269976+0000","last_unstale":"2023-12-12T09:43:23.233067+0000","last_undegraded":"2023-12-12T09:43:23.233067+0000","last_fullsized":"2023-12-12T09:43:23.233067+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_clean_scrub_stamp":"2023-12-12T09:43:21.241417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T12:08:27.288104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-12-12T09:43:23.511644+0000","last_change":"2023-12-12T09:43:21.286223+0000","last_active":"2023-12-12T09:43:23.511644+0000","last_peered":"2023-12-12T09:43:23.511644+0000","last_clean":"2023-12-12T09:43:23.511644+0000","last_became_active":"2023-12-12T09:43:21.285919+0000","last_became_peered":"2023-12-12T09:43:21.285919+0000","last_unstale":"2023-12-12T09:43:23.511644+0000","last_undegraded":"2023-12-12T09:43:23.511644+0000","last_fullsized":"2023-12-12T09:43:23.511644+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:43:20.054829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:43:20.054829+0000","last_clean_scrub_stamp":"2023-12-12T09:43:20.054829+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T20:43:17.341558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-12-12T09:43:23.512543+0000","last_change":"2023-12-12T09:43:22.279936+0000","last_active":"2023-12-12T09:43:23.512543+0000","last_peered":"2023-12-12T09:43:23.512543+0000","last_clean":"2023-12-12T09:43:23.512543+0000","last_became_active":"2023-12-12T09:43:22.276294+0000","last_became_peered":"2023-12-12T09:43:22.276294+0000","last_unstale":"2023-12-12T09:43:23.512543+0000","last_undegraded":"2023-12-12T09:43:23.512543+0000","last_fullsized":"2023-12-12T09:43:23.512543+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_clean_scrub_stamp":"2023-12-12T09:43:21.241417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T20:26:35.861125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":165,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-12T09:43:22.246331+0000","last_change":"2023-12-12T09:43:17.203315+0000","last_active":"2023-12-12T09:43:22.246331+0000","last_peered":"2023-12-12T09:43:22.246331+0000","last_clean":"2023-12-12T09:43:22.246331+0000","last_became_active":"2023-12-12T09:43:17.200779+0000","last_became_peered":"2023-12-12T09:43:17.200779+0000","last_unstale":"2023-12-12T09:43:22.246331+0000","last_undegraded":"2023-12-12T09:43:22.246331+0000","last_fullsized":"2023-12-12T09:43:22.246331+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:43:15.931922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:43:15.931922+0000","last_clean_scrub_stamp":"2023-12-12T09:43:15.931922+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T21:42:10.929640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-12-12T09:43:23.231837+0000","last_change":"2023-12-12T09:43:21.286777+0000","last_active":"2023-12-12T09:43:23.231837+0000","last_peered":"2023-12-12T09:43:23.231837+0000","last_clean":"2023-12-12T09:43:23.231837+0000","last_became_active":"2023-12-12T09:43:21.285422+0000","last_became_peered":"2023-12-12T09:43:21.285422+0000","last_unstale":"2023-12-12T09:43:23.231837+0000","last_undegraded":"2023-12-12T09:43:23.231837+0000","last_fullsized":"2023-12-12T09:43:23.231837+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:43:20.054829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:43:20.054829+0000","last_clean_scrub_stamp":"2023-12-12T09:43:20.054829+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T17:30:20.028086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-12-12T09:43:23.511894+0000","last_change":"2023-12-12T09:43:22.272912+0000","last_active":"2023-12-12T09:43:23.511894+0000","last_peered":"2023-12-12T09:43:23.511894+0000","last_clean":"2023-12-12T09:43:23.511894+0000","last_became_active":"2023-12-12T09:43:22.272617+0000","last_became_peered":"2023-12-12T09:43:22.272617+0000","last_unstale":"2023-12-12T09:43:23.511894+0000","last_undegraded":"2023-12-12T09:43:23.511894+0000","last_fullsized":"2023-12-12T09:43:23.511894+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_clean_scrub_stamp":"2023-12-12T09:43:21.241417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T19:29:30.599215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-12-12T09:43:23.511681+0000","last_change":"2023-12-12T09:43:21.300937+0000","last_active":"2023-12-12T09:43:23.511681+0000","last_peered":"2023-12-12T09:43:23.511681+0000","last_clean":"2023-12-12T09:43:23.511681+0000","last_became_active":"2023-12-12T09:43:21.300601+0000","last_became_peered":"2023-12-12T09:43:21.300601+0000","last_unstale":"2023-12-12T09:43:23.511681+0000","last_undegraded":"2023-12-12T09:43:23.511681+0000","last_fullsized":"2023-12-12T09:43:23.511681+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:43:20.054829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:43:20.054829+0000","last_clean_scrub_stamp":"2023-12-12T09:43:20.054829+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T21:27:10.922205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-12-12T09:43:23.509615+0000","last_change":"2023-12-12T09:43:22.252774+0000","last_active":"2023-12-12T09:43:23.509615+0000","last_peered":"2023-12-12T09:43:23.509615+0000","last_clean":"2023-12-12T09:43:23.509615+0000","last_became_active":"2023-12-12T09:43:22.252296+0000","last_became_peered":"2023-12-12T09:43:22.252296+0000","last_unstale":"2023-12-12T09:43:23.509615+0000","last_undegraded":"2023-12-12T09:43:23.509615+0000","last_fullsized":"2023-12-12T09:43:23.509615+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_clean_scrub_stamp":"2023-12-12T09:43:21.241417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T20:33:00.500338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-12-12T09:43:23.510762+0000","last_change":"2023-12-12T09:43:21.291232+0000","last_active":"2023-12-12T09:43:23.510762+0000","last_peered":"2023-12-12T09:43:23.510762+0000","last_clean":"2023-12-12T09:43:23.510762+0000","last_became_active":"2023-12-12T09:43:21.290905+0000","last_became_peered":"2023-12-12T09:43:21.290905+0000","last_unstale":"2023-12-12T09:43:23.510762+0000","last_undegraded":"2023-12-12T09:43:23.510762+0000","last_fullsized":"2023-12-12T09:43:23.510762+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:43:20.054829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:43:20.054829+0000","last_clean_scrub_stamp":"2023-12-12T09:43:20.054829+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T17:12:57.858301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-12-12T09:43:23.228577+0000","last_change":"2023-12-12T09:43:22.247541+0000","last_active":"2023-12-12T09:43:23.228577+0000","last_peered":"2023-12-12T09:43:23.228577+0000","last_clean":"2023-12-12T09:43:23.228577+0000","last_became_active":"2023-12-12T09:43:22.247160+0000","last_became_peered":"2023-12-12T09:43:22.247160+0000","last_unstale":"2023-12-12T09:43:23.228577+0000","last_undegraded":"2023-12-12T09:43:23.228577+0000","last_fullsized":"2023-12-12T09:43:23.228577+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_clean_scrub_stamp":"2023-12-12T09:43:21.241417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T19:29:30.599215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-12-12T09:43:23.232670+0000","last_change":"2023-12-12T09:43:21.292842+0000","last_active":"2023-12-12T09:43:23.232670+0000","last_peered":"2023-12-12T09:43:23.232670+0000","last_clean":"2023-12-12T09:43:23.232670+0000","last_became_active":"2023-12-12T09:43:21.292525+0000","last_became_peered":"2023-12-12T09:43:21.292525+0000","last_unstale":"2023-12-12T09:43:23.232670+0000","last_undegraded":"2023-12-12T09:43:23.232670+0000","last_fullsized":"2023-12-12T09:43:23.232670+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:43:20.054829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:43:20.054829+0000","last_clean_scrub_stamp":"2023-12-12T09:43:20.054829+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T18:28:40.746959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-12-12T09:43:23.511003+0000","last_change":"2023-12-12T09:43:22.255350+0000","last_active":"2023-12-12T09:43:23.511003+0000","last_peered":"2023-12-12T09:43:23.511003+0000","last_clean":"2023-12-12T09:43:23.511003+0000","last_became_active":"2023-12-12T09:43:22.253699+0000","last_became_peered":"2023-12-12T09:43:22.253699+0000","last_unstale":"2023-12-12T09:43:23.511003+0000","last_undegraded":"2023-12-12T09:43:23.511003+0000","last_fullsized":"2023-12-12T09:43:23.511003+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_clean_scrub_stamp":"2023-12-12T09:43:21.241417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T10:41:14.691881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-12-12T09:43:23.228484+0000","last_change":"2023-12-12T09:43:21.275987+0000","last_active":"2023-12-12T09:43:23.228484+0000","last_peered":"2023-12-12T09:43:23.228484+0000","last_clean":"2023-12-12T09:43:23.228484+0000","last_became_active":"2023-12-12T09:43:21.274563+0000","last_became_peered":"2023-12-12T09:43:21.274563+0000","last_unstale":"2023-12-12T09:43:23.228484+0000","last_undegraded":"2023-12-12T09:43:23.228484+0000","last_fullsized":"2023-12-12T09:43:23.228484+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:43:20.054829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:43:20.054829+0000","last_clean_scrub_stamp":"2023-12-12T09:43:20.054829+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T21:27:10.922205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-12-12T09:43:23.233263+0000","last_change":"2023-12-12T09:43:22.270432+0000","last_active":"2023-12-12T09:43:23.233263+0000","last_peered":"2023-12-12T09:43:23.233263+0000","last_clean":"2023-12-12T09:43:23.233263+0000","last_became_active":"2023-12-12T09:43:22.265195+0000","last_became_peered":"2023-12-12T09:43:22.265195+0000","last_unstale":"2023-12-12T09:43:23.233263+0000","last_undegraded":"2023-12-12T09:43:23.233263+0000","last_fullsized":"2023-12-12T09:43:23.233263+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_clean_scrub_stamp":"2023-12-12T09:43:21.241417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T13:12:59.364006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-12-12T09:43:23.512702+0000","last_change":"2023-12-12T09:43:21.305016+0000","last_active":"2023-12-12T09:43:23.512702+0000","last_peered":"2023-12-12T09:43:23.512702+0000","last_clean":"2023-12-12T09:43:23.512702+0000","last_became_active":"2023-12-12T09:43:21.302634+0000","last_became_peered":"2023-12-12T09:43:21.302634+0000","last_unstale":"2023-12-12T09:43:23.512702+0000","last_undegraded":"2023-12-12T09:43:23.512702+0000","last_fullsized":"2023-12-12T09:43:23.512702+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:43:20.054829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:43:20.054829+0000","last_clean_scrub_stamp":"2023-12-12T09:43:20.054829+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T19:41:08.951158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-12-12T09:43:23.228598+0000","last_change":"2023-12-12T09:43:22.249130+0000","last_active":"2023-12-12T09:43:23.228598+0000","last_peered":"2023-12-12T09:43:23.228598+0000","last_clean":"2023-12-12T09:43:23.228598+0000","last_became_active":"2023-12-12T09:43:22.248797+0000","last_became_peered":"2023-12-12T09:43:22.248797+0000","last_unstale":"2023-12-12T09:43:23.228598+0000","last_undegraded":"2023-12-12T09:43:23.228598+0000","last_fullsized":"2023-12-12T09:43:23.228598+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_clean_scrub_stamp":"2023-12-12T09:43:21.241417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T17:19:30.590382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"21'1","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-12-12T09:43:24.494095+0000","last_change":"2023-12-12T09:43:21.299170+0000","last_active":"2023-12-12T09:43:24.494095+0000","last_peered":"2023-12-12T09:43:24.494095+0000","last_clean":"2023-12-12T09:43:24.494095+0000","last_became_active":"2023-12-12T09:43:21.298879+0000","last_became_peered":"2023-12-12T09:43:21.298879+0000","last_unstale":"2023-12-12T09:43:24.494095+0000","last_undegraded":"2023-12-12T09:43:24.494095+0000","last_fullsized":"2023-12-12T09:43:24.494095+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:43:20.054829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:43:20.054829+0000","last_clean_scrub_stamp":"2023-12-12T09:43:20.054829+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T14:02:28.705261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-12-12T09:43:23.512630+0000","last_change":"2023-12-12T09:43:22.261674+0000","last_active":"2023-12-12T09:43:23.512630+0000","last_peered":"2023-12-12T09:43:23.512630+0000","last_clean":"2023-12-12T09:43:23.512630+0000","last_became_active":"2023-12-12T09:43:22.261405+0000","last_became_peered":"2023-12-12T09:43:22.261405+0000","last_unstale":"2023-12-12T09:43:23.512630+0000","last_undegraded":"2023-12-12T09:43:23.512630+0000","last_fullsized":"2023-12-12T09:43:23.512630+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_clean_scrub_stamp":"2023-12-12T09:43:21.241417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T19:41:10.137746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-12-12T09:43:23.235503+0000","last_change":"2023-12-12T09:43:21.304624+0000","last_active":"2023-12-12T09:43:23.235503+0000","last_peered":"2023-12-12T09:43:23.235503+0000","last_clean":"2023-12-12T09:43:23.235503+0000","last_became_active":"2023-12-12T09:43:21.304305+0000","last_became_peered":"2023-12-12T09:43:21.304305+0000","last_unstale":"2023-12-12T09:43:23.235503+0000","last_undegraded":"2023-12-12T09:43:23.235503+0000","last_fullsized":"2023-12-12T09:43:23.235503+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:43:20.054829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:43:20.054829+0000","last_clean_scrub_stamp":"2023-12-12T09:43:20.054829+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T11:24:10.894411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-12-12T09:43:23.512203+0000","last_change":"2023-12-12T09:43:22.260743+0000","last_active":"2023-12-12T09:43:23.512203+0000","last_peered":"2023-12-12T09:43:23.512203+0000","last_clean":"2023-12-12T09:43:23.512203+0000","last_became_active":"2023-12-12T09:43:22.260367+0000","last_became_peered":"2023-12-12T09:43:22.260367+0000","last_unstale":"2023-12-12T09:43:23.512203+0000","last_undegraded":"2023-12-12T09:43:23.512203+0000","last_fullsized":"2023-12-12T09:43:23.512203+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_clean_scrub_stamp":"2023-12-12T09:43:21.241417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T19:29:30.599215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-12-12T09:43:23.511691+0000","last_change":"2023-12-12T09:43:21.301133+0000","last_active":"2023-12-12T09:43:23.511691+0000","last_peered":"2023-12-12T09:43:23.511691+0000","last_clean":"2023-12-12T09:43:23.511691+0000","last_became_active":"2023-12-12T09:43:21.300231+0000","last_became_peered":"2023-12-12T09:43:21.300231+0000","last_unstale":"2023-12-12T09:43:23.511691+0000","last_undegraded":"2023-12-12T09:43:23.511691+0000","last_fullsized":"2023-12-12T09:43:23.511691+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:43:20.054829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:43:20.054829+0000","last_clean_scrub_stamp":"2023-12-12T09:43:20.054829+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T10:41:13.505292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-12-12T09:43:23.510712+0000","last_change":"2023-12-12T09:43:22.260117+0000","last_active":"2023-12-12T09:43:23.510712+0000","last_peered":"2023-12-12T09:43:23.510712+0000","last_clean":"2023-12-12T09:43:23.510712+0000","last_became_active":"2023-12-12T09:43:22.255443+0000","last_became_peered":"2023-12-12T09:43:22.255443+0000","last_unstale":"2023-12-12T09:43:23.510712+0000","last_undegraded":"2023-12-12T09:43:23.510712+0000","last_fullsized":"2023-12-12T09:43:23.510712+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_clean_scrub_stamp":"2023-12-12T09:43:21.241417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T20:43:18.528147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-12-12T09:43:23.228536+0000","last_change":"2023-12-12T09:43:21.281650+0000","last_active":"2023-12-12T09:43:23.228536+0000","last_peered":"2023-12-12T09:43:23.228536+0000","last_clean":"2023-12-12T09:43:23.228536+0000","last_became_active":"2023-12-12T09:43:21.281353+0000","last_became_peered":"2023-12-12T09:43:21.281353+0000","last_unstale":"2023-12-12T09:43:23.228536+0000","last_undegraded":"2023-12-12T09:43:23.228536+0000","last_fullsized":"2023-12-12T09:43:23.228536+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:43:20.054829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:43:20.054829+0000","last_clean_scrub_stamp":"2023-12-12T09:43:20.054829+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T10:41:13.505292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-12-12T09:43:23.512382+0000","last_change":"2023-12-12T09:43:22.255511+0000","last_active":"2023-12-12T09:43:23.512382+0000","last_peered":"2023-12-12T09:43:23.512382+0000","last_clean":"2023-12-12T09:43:23.512382+0000","last_became_active":"2023-12-12T09:43:22.255187+0000","last_became_peered":"2023-12-12T09:43:22.255187+0000","last_unstale":"2023-12-12T09:43:23.512382+0000","last_undegraded":"2023-12-12T09:43:23.512382+0000","last_fullsized":"2023-12-12T09:43:23.512382+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_clean_scrub_stamp":"2023-12-12T09:43:21.241417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T13:28:21.176910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-12-12T09:43:23.228903+0000","last_change":"2023-12-12T09:43:21.291624+0000","last_active":"2023-12-12T09:43:23.228903+0000","last_peered":"2023-12-12T09:43:23.228903+0000","last_clean":"2023-12-12T09:43:23.228903+0000","last_became_active":"2023-12-12T09:43:21.291410+0000","last_became_peered":"2023-12-12T09:43:21.291410+0000","last_unstale":"2023-12-12T09:43:23.228903+0000","last_undegraded":"2023-12-12T09:43:23.228903+0000","last_fullsized":"2023-12-12T09:43:23.228903+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:43:20.054829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:43:20.054829+0000","last_clean_scrub_stamp":"2023-12-12T09:43:20.054829+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T20:43:17.341558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-12-12T09:43:23.514113+0000","last_change":"2023-12-12T09:43:22.250477+0000","last_active":"2023-12-12T09:43:23.514113+0000","last_peered":"2023-12-12T09:43:23.514113+0000","last_clean":"2023-12-12T09:43:23.514113+0000","last_became_active":"2023-12-12T09:43:22.250114+0000","last_became_peered":"2023-12-12T09:43:22.250114+0000","last_unstale":"2023-12-12T09:43:23.514113+0000","last_undegraded":"2023-12-12T09:43:23.514113+0000","last_fullsized":"2023-12-12T09:43:23.514113+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_clean_scrub_stamp":"2023-12-12T09:43:21.241417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T11:24:46.660535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-12-12T09:43:23.512859+0000","last_change":"2023-12-12T09:43:21.300810+0000","last_active":"2023-12-12T09:43:23.512859+0000","last_peered":"2023-12-12T09:43:23.512859+0000","last_clean":"2023-12-12T09:43:23.512859+0000","last_became_active":"2023-12-12T09:43:21.300476+0000","last_became_peered":"2023-12-12T09:43:21.300476+0000","last_unstale":"2023-12-12T09:43:23.512859+0000","last_undegraded":"2023-12-12T09:43:23.512859+0000","last_fullsized":"2023-12-12T09:43:23.512859+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:43:20.054829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:43:20.054829+0000","last_clean_scrub_stamp":"2023-12-12T09:43:20.054829+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T20:32:59.313749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-12-12T09:43:23.235201+0000","last_change":"2023-12-12T09:43:22.254797+0000","last_active":"2023-12-12T09:43:23.235201+0000","last_peered":"2023-12-12T09:43:23.235201+0000","last_clean":"2023-12-12T09:43:23.235201+0000","last_became_active":"2023-12-12T09:43:22.254482+0000","last_became_peered":"2023-12-12T09:43:22.254482+0000","last_unstale":"2023-12-12T09:43:23.235201+0000","last_undegraded":"2023-12-12T09:43:23.235201+0000","last_fullsized":"2023-12-12T09:43:23.235201+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_clean_scrub_stamp":"2023-12-12T09:43:21.241417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T19:29:30.599215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-12-12T09:43:23.232655+0000","last_change":"2023-12-12T09:43:22.256918+0000","last_active":"2023-12-12T09:43:23.232655+0000","last_peered":"2023-12-12T09:43:23.232655+0000","last_clean":"2023-12-12T09:43:23.232655+0000","last_became_active":"2023-12-12T09:43:22.256575+0000","last_became_peered":"2023-12-12T09:43:22.256575+0000","last_unstale":"2023-12-12T09:43:23.232655+0000","last_undegraded":"2023-12-12T09:43:23.232655+0000","last_fullsized":"2023-12-12T09:43:23.232655+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_clean_scrub_stamp":"2023-12-12T09:43:21.241417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T11:24:46.660535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-12-12T09:43:23.512318+0000","last_change":"2023-12-12T09:43:21.300710+0000","last_active":"2023-12-12T09:43:23.512318+0000","last_peered":"2023-12-12T09:43:23.512318+0000","last_clean":"2023-12-12T09:43:23.512318+0000","last_became_active":"2023-12-12T09:43:21.300311+0000","last_became_peered":"2023-12-12T09:43:21.300311+0000","last_unstale":"2023-12-12T09:43:23.512318+0000","last_undegraded":"2023-12-12T09:43:23.512318+0000","last_fullsized":"2023-12-12T09:43:23.512318+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:43:20.054829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:43:20.054829+0000","last_clean_scrub_stamp":"2023-12-12T09:43:20.054829+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T14:02:28.705261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-12-12T09:43:23.232804+0000","last_change":"2023-12-12T09:43:22.257472+0000","last_active":"2023-12-12T09:43:23.232804+0000","last_peered":"2023-12-12T09:43:23.232804+0000","last_clean":"2023-12-12T09:43:23.232804+0000","last_became_active":"2023-12-12T09:43:22.250225+0000","last_became_peered":"2023-12-12T09:43:22.250225+0000","last_unstale":"2023-12-12T09:43:23.232804+0000","last_undegraded":"2023-12-12T09:43:23.232804+0000","last_fullsized":"2023-12-12T09:43:23.232804+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_clean_scrub_stamp":"2023-12-12T09:43:21.241417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T20:26:35.861125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-12-12T09:43:23.512528+0000","last_change":"2023-12-12T09:43:21.306307+0000","last_active":"2023-12-12T09:43:23.512528+0000","last_peered":"2023-12-12T09:43:23.512528+0000","last_clean":"2023-12-12T09:43:23.512528+0000","last_became_active":"2023-12-12T09:43:21.305903+0000","last_became_peered":"2023-12-12T09:43:21.305903+0000","last_unstale":"2023-12-12T09:43:23.512528+0000","last_undegraded":"2023-12-12T09:43:23.512528+0000","last_fullsized":"2023-12-12T09:43:23.512528+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:43:20.054829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:43:20.054829+0000","last_clean_scrub_stamp":"2023-12-12T09:43:20.054829+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T11:56:41.908755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-12-12T09:43:23.513534+0000","last_change":"2023-12-12T09:43:22.274288+0000","last_active":"2023-12-12T09:43:23.513534+0000","last_peered":"2023-12-12T09:43:23.513534+0000","last_clean":"2023-12-12T09:43:23.513534+0000","last_became_active":"2023-12-12T09:43:22.273968+0000","last_became_peered":"2023-12-12T09:43:22.273968+0000","last_unstale":"2023-12-12T09:43:23.513534+0000","last_undegraded":"2023-12-12T09:43:23.513534+0000","last_fullsized":"2023-12-12T09:43:23.513534+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_clean_scrub_stamp":"2023-12-12T09:43:21.241417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T10:52:36.164447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-12-12T09:43:23.513171+0000","last_change":"2023-12-12T09:43:21.295200+0000","last_active":"2023-12-12T09:43:23.513171+0000","last_peered":"2023-12-12T09:43:23.513171+0000","last_clean":"2023-12-12T09:43:23.513171+0000","last_became_active":"2023-12-12T09:43:21.294908+0000","last_became_peered":"2023-12-12T09:43:21.294908+0000","last_unstale":"2023-12-12T09:43:23.513171+0000","last_undegraded":"2023-12-12T09:43:23.513171+0000","last_fullsized":"2023-12-12T09:43:23.513171+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:43:20.054829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:43:20.054829+0000","last_clean_scrub_stamp":"2023-12-12T09:43:20.054829+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T20:32:59.313749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-12-12T09:43:23.512766+0000","last_change":"2023-12-12T09:43:22.256556+0000","last_active":"2023-12-12T09:43:23.512766+0000","last_peered":"2023-12-12T09:43:23.512766+0000","last_clean":"2023-12-12T09:43:23.512766+0000","last_became_active":"2023-12-12T09:43:22.256166+0000","last_became_peered":"2023-12-12T09:43:22.256166+0000","last_unstale":"2023-12-12T09:43:23.512766+0000","last_undegraded":"2023-12-12T09:43:23.512766+0000","last_fullsized":"2023-12-12T09:43:23.512766+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_clean_scrub_stamp":"2023-12-12T09:43:21.241417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T13:22:21.650455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"20'4","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-12-12T09:43:23.514113+0000","last_change":"2023-12-12T09:43:21.296519+0000","last_active":"2023-12-12T09:43:23.514113+0000","last_peered":"2023-12-12T09:43:23.514113+0000","last_clean":"2023-12-12T09:43:23.514113+0000","last_became_active":"2023-12-12T09:43:21.296221+0000","last_became_peered":"2023-12-12T09:43:21.296221+0000","last_unstale":"2023-12-12T09:43:23.514113+0000","last_undegraded":"2023-12-12T09:43:23.514113+0000","last_fullsized":"2023-12-12T09:43:23.514113+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:43:20.054829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:43:20.054829+0000","last_clean_scrub_stamp":"2023-12-12T09:43:20.054829+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T21:27:10.922205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":64844,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574855,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27320,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344520,"statfs":{"total":96636764160,"available":96608788480,"internally_reserved":0,"allocated":286720,"data_stored":666531,"data_compressed":32422,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80000000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.429}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1859999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.242}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3720000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6659999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.742}]}]},{"osd":6,"up_from":13,"seq":55834574853,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":229376,"data_stored":77193,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79800000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0169999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.222}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.268}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.587}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3180000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.552}]}]},{"osd":5,"up_from":13,"seq":55834574853,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":221184,"data_stored":75671,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96799999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2609999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.579}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.625}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6830000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.296}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.746}]}]},{"osd":4,"up_from":13,"seq":55834574855,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":229376,"data_stored":75707,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.754}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81200000000000006}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2090000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0649999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.268}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.397}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.444}]}]},{"osd":3,"up_from":13,"seq":55834574853,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":229376,"data_stored":77193,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0129999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4610000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.0899999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.3130000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0940000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.0219999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.5299999999999998}]}]},{"osd":2,"up_from":13,"seq":55834574853,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":75581,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.226}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92600000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2030000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.129}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.266}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.306}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3500000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574853,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":225280,"data_stored":75741,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.794}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":6.3390000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.7519999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":6.423}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":6.2830000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":6.468}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.177}]}]},{"osd":0,"up_from":13,"seq":55834574855,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27328,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344512,"statfs":{"total":96636764160,"available":96608780288,"internally_reserved":0,"allocated":294912,"data_stored":666587,"data_compressed":32422,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97599999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55800000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.179}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91300000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3740000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2430000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32422,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32422,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-12T09:43:32.203 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-12T09:43:32.448 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:32.448+0000 7fcb3bd90640 1 Processor -- start 2023-12-12T09:43:32.449 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:32.448+0000 7fcb3bd90640 1 -- start start 2023-12-12T09:43:32.450 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:32.450+0000 7fcb3bd90640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fcb341552e0 0x7fcb340c49c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:32.450 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:32.450+0000 7fcb3bd90640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb340c0b50 con 0x7fcb340a50f0 2023-12-12T09:43:32.450 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:32.450+0000 7fcb3bd90640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb3406c880 con 0x7fcb3406bf20 2023-12-12T09:43:32.450 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:32.450+0000 7fcb3bd90640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb340c04d0 con 0x7fcb341552e0 2023-12-12T09:43:32.450 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:32.450+0000 7fcb3932b640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7fcb340a50f0 0x7fcb340a9050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:34402/0 (socket says 172.21.15.73:34402) 2023-12-12T09:43:32.450 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:32.450+0000 7fcb3932b640 1 -- 172.21.15.73:0/3709777134 learned_addr learned my addr 172.21.15.73:0/3709777134 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-12T09:43:32.450 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:32.450+0000 7fcb39b2c640 1 --2- 172.21.15.73:0/3709777134 >> v2:172.21.15.73:3300/0 conn(0x7fcb341552e0 0x7fcb340c49c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:32.451 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:32.451+0000 7fcb38b2a640 1 -- 172.21.15.73:0/3709777134 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 283263953 0 0) 0x7fcb340c0b50 con 0x7fcb340a50f0 2023-12-12T09:43:32.451 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:32.451+0000 7fcb38b2a640 1 -- 172.21.15.73:0/3709777134 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcb24003520 con 0x7fcb340a50f0 2023-12-12T09:43:32.451 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:32.451+0000 7fcb39b2c640 1 -- 172.21.15.73:0/3709777134 >> v1:172.21.15.142:6789/0 conn(0x7fcb3406bf20 legacy=0x7fcb3415bb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:43:32.451 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:32.451+0000 7fcb39b2c640 1 -- 172.21.15.73:0/3709777134 >> v1:172.21.15.73:6789/0 conn(0x7fcb340a50f0 legacy=0x7fcb340a9050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:32.452 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:32.451+0000 7fcb39b2c640 1 -- 172.21.15.73:0/3709777134 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb3406cb60 con 0x7fcb341552e0 2023-12-12T09:43:32.453 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:32.452+0000 7fcb39b2c640 1 --2- 172.21.15.73:0/3709777134 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcb341552e0 0x7fcb340c49c0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fcb28009d90 tx=0x7fcb2802beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5d6b497ae7d67c6 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:43:32.453 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:32.452+0000 7fcb38b2a640 1 -- 172.21.15.73:0/3709777134 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb2802cc60 con 0x7fcb341552e0 2023-12-12T09:43:32.453 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:32.452+0000 7fcb38b2a640 1 -- 172.21.15.73:0/3709777134 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb2802cdc0 con 0x7fcb341552e0 2023-12-12T09:43:32.453 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:32.452+0000 7fcb38b2a640 1 -- 172.21.15.73:0/3709777134 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb28034660 con 0x7fcb341552e0 2023-12-12T09:43:32.453 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:32.453+0000 7fcb3bd90640 1 -- 172.21.15.73:0/3709777134 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcb341552e0 msgr2=0x7fcb340c49c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:32.453 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:32.453+0000 7fcb3bd90640 1 --2- 172.21.15.73:0/3709777134 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcb341552e0 0x7fcb340c49c0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fcb28009d90 tx=0x7fcb2802beb0 comp rx=0 tx=0).stop 2023-12-12T09:43:32.453 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:32.453+0000 7fcb3bd90640 1 -- 172.21.15.73:0/3709777134 shutdown_connections 2023-12-12T09:43:32.453 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:32.453+0000 7fcb3bd90640 1 --2- 172.21.15.73:0/3709777134 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcb341552e0 0x7fcb340c49c0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:32.453 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:32.453+0000 7fcb3bd90640 1 -- 172.21.15.73:0/3709777134 >> 172.21.15.73:0/3709777134 conn(0x7fcb340a8130 msgr2=0x7fcb340c24b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:43:32.453 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:32.453+0000 7fcb3bd90640 1 -- 172.21.15.73:0/3709777134 shutdown_connections 2023-12-12T09:43:32.454 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:32.453+0000 7fcb3bd90640 1 -- 172.21.15.73:0/3709777134 wait complete. 2023-12-12T09:43:32.454 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:32.455+0000 7fcb3bd90640 1 Processor -- start 2023-12-12T09:43:32.454 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:32.455+0000 7fcb3bd90640 1 -- start start 2023-12-12T09:43:32.456 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:32.456+0000 7fcb3bd90640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcb3406bf20 0x7fcb340bede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:32.457 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:32.456+0000 7fcb3bd90640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcb340a50f0 0x7fcb341ed9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:32.457 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:32.456+0000 7fcb3bd90640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcb341552e0 0x7fcb341edf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:32.457 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:32.456+0000 7fcb3bd90640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb3406fe70 con 0x7fcb3406bf20 2023-12-12T09:43:32.457 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:32.456+0000 7fcb3bd90640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb341eae50 con 0x7fcb340a50f0 2023-12-12T09:43:32.457 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:32.456+0000 7fcb3bd90640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb341dbbf0 con 0x7fcb341552e0 2023-12-12T09:43:32.457 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:32.456+0000 7fcb39b2c640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcb3406bf20 0x7fcb340bede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:32.457 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:32.456+0000 7fcb39b2c640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcb3406bf20 0x7fcb340bede0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:56822/0 (socket says 172.21.15.73:56822) 2023-12-12T09:43:32.457 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:32.456+0000 7fcb39b2c640 1 -- 172.21.15.73:0/2735372592 learned_addr learned my addr 172.21.15.73:0/2735372592 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:43:32.457 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:32.456+0000 7fcb39b2c640 1 -- 172.21.15.73:0/2735372592 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcb341552e0 msgr2=0x7fcb341edf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:32.457 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:32.456+0000 7fcb39b2c640 1 --2- 172.21.15.73:0/2735372592 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcb341552e0 0x7fcb341edf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:32.457 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:32.456+0000 7fcb39b2c640 1 -- 172.21.15.73:0/2735372592 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcb340a50f0 msgr2=0x7fcb341ed9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:32.457 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:32.456+0000 7fcb39b2c640 1 --2- 172.21.15.73:0/2735372592 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcb340a50f0 0x7fcb341ed9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:32.457 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:32.456+0000 7fcb39b2c640 1 -- 172.21.15.73:0/2735372592 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb28009a70 con 0x7fcb3406bf20 2023-12-12T09:43:32.458 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:32.456+0000 7fcb39b2c640 1 --2- 172.21.15.73:0/2735372592 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcb3406bf20 0x7fcb340bede0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fcb28037040 tx=0x7fcb28004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:43:32.458 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:32.457+0000 7fcb327fc640 1 -- 172.21.15.73:0/2735372592 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb28040650 con 0x7fcb3406bf20 2023-12-12T09:43:32.458 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:32.457+0000 7fcb327fc640 1 -- 172.21.15.73:0/2735372592 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb280407b0 con 0x7fcb3406bf20 2023-12-12T09:43:32.458 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:32.457+0000 7fcb3bd90640 1 -- 172.21.15.73:0/2735372592 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb341dbed0 con 0x7fcb3406bf20 2023-12-12T09:43:32.458 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:32.457+0000 7fcb327fc640 1 -- 172.21.15.73:0/2735372592 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb28040b60 con 0x7fcb3406bf20 2023-12-12T09:43:32.458 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:32.457+0000 7fcb3bd90640 1 -- 172.21.15.73:0/2735372592 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb341dc490 con 0x7fcb3406bf20 2023-12-12T09:43:32.458 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:32.458+0000 7fcb3bd90640 1 -- 172.21.15.73:0/2735372592 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb34067580 con 0x7fcb3406bf20 2023-12-12T09:43:32.459 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:32.459+0000 7fcb327fc640 1 -- 172.21.15.73:0/2735372592 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fcb28040cc0 con 0x7fcb3406bf20 2023-12-12T09:43:32.459 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:32.459+0000 7fcb327fc640 1 --2- 172.21.15.73:0/2735372592 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fcb1806ae40 0x7fcb1806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:32.459 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:32.460+0000 7fcb327fc640 1 -- 172.21.15.73:0/2735372592 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fcb280ac410 con 0x7fcb3406bf20 2023-12-12T09:43:32.460 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:32.460+0000 7fcb3932b640 1 --2- 172.21.15.73:0/2735372592 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fcb1806ae40 0x7fcb1806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:32.460 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:32.460+0000 7fcb3932b640 1 --2- 172.21.15.73:0/2735372592 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fcb1806ae40 0x7fcb1806d300 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fcb340c01e0 tx=0x7fcb20007930 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:43:32.464 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:32.464+0000 7fcb327fc640 1 -- 172.21.15.73:0/2735372592 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fcb280774b0 con 0x7fcb3406bf20 2023-12-12T09:43:32.638 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:32.637+0000 7fcb3bd90640 1 -- 172.21.15.73:0/2735372592 --> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fcb340c1ff0 con 0x7fcb1806ae40 2023-12-12T09:43:32.649 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:32.649+0000 7fcb327fc640 1 -- 172.21.15.73:0/2735372592 <== mgr.4110 v2:172.21.15.73:6832/779985841 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264382 (secure 0 0 0) 0x7fcb200058b0 con 0x7fcb1806ae40 2023-12-12T09:43:32.652 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-12T09:43:32.654 INFO:teuthology.orchestra.run.smithi073.stderr:dumped all 2023-12-12T09:43:32.655 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:32.654+0000 7fcb3bd90640 1 -- 172.21.15.73:0/2735372592 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fcb1806ae40 msgr2=0x7fcb1806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:32.655 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:32.654+0000 7fcb3bd90640 1 --2- 172.21.15.73:0/2735372592 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fcb1806ae40 0x7fcb1806d300 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fcb340c01e0 tx=0x7fcb20007930 comp rx=0 tx=0).stop 2023-12-12T09:43:32.656 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:32.654+0000 7fcb3bd90640 1 -- 172.21.15.73:0/2735372592 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcb3406bf20 msgr2=0x7fcb340bede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:32.656 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:32.654+0000 7fcb3bd90640 1 --2- 172.21.15.73:0/2735372592 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcb3406bf20 0x7fcb340bede0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fcb28037040 tx=0x7fcb28004a40 comp rx=0 tx=0).stop 2023-12-12T09:43:32.657 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:32.654+0000 7fcb3bd90640 1 -- 172.21.15.73:0/2735372592 shutdown_connections 2023-12-12T09:43:32.657 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:32.654+0000 7fcb3bd90640 1 --2- 172.21.15.73:0/2735372592 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fcb1806ae40 0x7fcb1806d300 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:32.657 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:32.654+0000 7fcb3bd90640 1 --2- 172.21.15.73:0/2735372592 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcb341552e0 0x7fcb341edf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:32.657 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:32.654+0000 7fcb3bd90640 1 --2- 172.21.15.73:0/2735372592 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcb340a50f0 0x7fcb341ed9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:32.657 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:32.654+0000 7fcb3bd90640 1 --2- 172.21.15.73:0/2735372592 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcb3406bf20 0x7fcb340bede0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:32.657 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:32.654+0000 7fcb3bd90640 1 -- 172.21.15.73:0/2735372592 >> 172.21.15.73:0/2735372592 conn(0x7fcb340a8130 msgr2=0x7fcb34151330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:43:32.657 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:32.654+0000 7fcb3bd90640 1 -- 172.21.15.73:0/2735372592 shutdown_connections 2023-12-12T09:43:32.657 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:32.654+0000 7fcb3bd90640 1 -- 172.21.15.73:0/2735372592 wait complete. 2023-12-12T09:43:32.670 INFO:teuthology.orchestra.run.smithi073.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2023-12-12T09:43:31.458326+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218116,"kb_used_data":1888,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754756604,"statfs":{"total":773094113280,"available":772870762496,"internally_reserved":0,"allocated":1933312,"data_stored":1790204,"data_compressed":64844,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":10,"num_read_kb":9,"num_write":59,"num_write_kb":276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.236115"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-12-12T09:43:23.513587+0000","last_change":"2023-12-12T09:43:22.259173+0000","last_active":"2023-12-12T09:43:23.513587+0000","last_peered":"2023-12-12T09:43:23.513587+0000","last_clean":"2023-12-12T09:43:23.513587+0000","last_became_active":"2023-12-12T09:43:22.257823+0000","last_became_peered":"2023-12-12T09:43:22.257823+0000","last_unstale":"2023-12-12T09:43:23.513587+0000","last_undegraded":"2023-12-12T09:43:23.513587+0000","last_fullsized":"2023-12-12T09:43:23.513587+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_clean_scrub_stamp":"2023-12-12T09:43:21.241417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T11:44:44.846070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-12-12T09:43:23.228756+0000","last_change":"2023-12-12T09:43:22.246332+0000","last_active":"2023-12-12T09:43:23.228756+0000","last_peered":"2023-12-12T09:43:23.228756+0000","last_clean":"2023-12-12T09:43:23.228756+0000","last_became_active":"2023-12-12T09:43:22.245968+0000","last_became_peered":"2023-12-12T09:43:22.245968+0000","last_unstale":"2023-12-12T09:43:23.228756+0000","last_undegraded":"2023-12-12T09:43:23.228756+0000","last_fullsized":"2023-12-12T09:43:23.228756+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_clean_scrub_stamp":"2023-12-12T09:43:21.241417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T13:28:21.176910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-12-12T09:43:23.512350+0000","last_change":"2023-12-12T09:43:22.256406+0000","last_active":"2023-12-12T09:43:23.512350+0000","last_peered":"2023-12-12T09:43:23.512350+0000","last_clean":"2023-12-12T09:43:23.512350+0000","last_became_active":"2023-12-12T09:43:22.256051+0000","last_became_peered":"2023-12-12T09:43:22.256051+0000","last_unstale":"2023-12-12T09:43:23.512350+0000","last_undegraded":"2023-12-12T09:43:23.512350+0000","last_fullsized":"2023-12-12T09:43:23.512350+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_clean_scrub_stamp":"2023-12-12T09:43:21.241417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T11:56:43.095343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-12-12T09:43:23.232452+0000","last_change":"2023-12-12T09:43:22.270381+0000","last_active":"2023-12-12T09:43:23.232452+0000","last_peered":"2023-12-12T09:43:23.232452+0000","last_clean":"2023-12-12T09:43:23.232452+0000","last_became_active":"2023-12-12T09:43:22.270156+0000","last_became_peered":"2023-12-12T09:43:22.270156+0000","last_unstale":"2023-12-12T09:43:23.232452+0000","last_undegraded":"2023-12-12T09:43:23.232452+0000","last_fullsized":"2023-12-12T09:43:23.232452+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_clean_scrub_stamp":"2023-12-12T09:43:21.241417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T12:09:32.290407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-12-12T09:43:23.512600+0000","last_change":"2023-12-12T09:43:22.256406+0000","last_active":"2023-12-12T09:43:23.512600+0000","last_peered":"2023-12-12T09:43:23.512600+0000","last_clean":"2023-12-12T09:43:23.512600+0000","last_became_active":"2023-12-12T09:43:22.256089+0000","last_became_peered":"2023-12-12T09:43:22.256089+0000","last_unstale":"2023-12-12T09:43:23.512600+0000","last_undegraded":"2023-12-12T09:43:23.512600+0000","last_fullsized":"2023-12-12T09:43:23.512600+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_clean_scrub_stamp":"2023-12-12T09:43:21.241417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T12:08:27.288104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-12-12T09:43:23.231961+0000","last_change":"2023-12-12T09:43:22.262100+0000","last_active":"2023-12-12T09:43:23.231961+0000","last_peered":"2023-12-12T09:43:23.231961+0000","last_clean":"2023-12-12T09:43:23.231961+0000","last_became_active":"2023-12-12T09:43:22.250378+0000","last_became_peered":"2023-12-12T09:43:22.250378+0000","last_unstale":"2023-12-12T09:43:23.231961+0000","last_undegraded":"2023-12-12T09:43:23.231961+0000","last_fullsized":"2023-12-12T09:43:23.231961+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_clean_scrub_stamp":"2023-12-12T09:43:21.241417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T13:28:21.176910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-12-12T09:43:23.511903+0000","last_change":"2023-12-12T09:43:22.257819+0000","last_active":"2023-12-12T09:43:23.511903+0000","last_peered":"2023-12-12T09:43:23.511903+0000","last_clean":"2023-12-12T09:43:23.511903+0000","last_became_active":"2023-12-12T09:43:22.257516+0000","last_became_peered":"2023-12-12T09:43:22.257516+0000","last_unstale":"2023-12-12T09:43:23.511903+0000","last_undegraded":"2023-12-12T09:43:23.511903+0000","last_fullsized":"2023-12-12T09:43:23.511903+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_clean_scrub_stamp":"2023-12-12T09:43:21.241417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T13:22:21.650455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-12-12T09:43:23.511693+0000","last_change":"2023-12-12T09:43:22.250148+0000","last_active":"2023-12-12T09:43:23.511693+0000","last_peered":"2023-12-12T09:43:23.511693+0000","last_clean":"2023-12-12T09:43:23.511693+0000","last_became_active":"2023-12-12T09:43:22.249829+0000","last_became_peered":"2023-12-12T09:43:22.249829+0000","last_unstale":"2023-12-12T09:43:23.511693+0000","last_undegraded":"2023-12-12T09:43:23.511693+0000","last_fullsized":"2023-12-12T09:43:23.511693+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_clean_scrub_stamp":"2023-12-12T09:43:21.241417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T10:01:50.869497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-12-12T09:43:23.513773+0000","last_change":"2023-12-12T09:43:22.283672+0000","last_active":"2023-12-12T09:43:23.513773+0000","last_peered":"2023-12-12T09:43:23.513773+0000","last_clean":"2023-12-12T09:43:23.513773+0000","last_became_active":"2023-12-12T09:43:22.283234+0000","last_became_peered":"2023-12-12T09:43:22.283234+0000","last_unstale":"2023-12-12T09:43:23.513773+0000","last_undegraded":"2023-12-12T09:43:23.513773+0000","last_fullsized":"2023-12-12T09:43:23.513773+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_clean_scrub_stamp":"2023-12-12T09:43:21.241417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T20:45:26.767222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-12-12T09:43:23.235723+0000","last_change":"2023-12-12T09:43:22.271352+0000","last_active":"2023-12-12T09:43:23.235723+0000","last_peered":"2023-12-12T09:43:23.235723+0000","last_clean":"2023-12-12T09:43:23.235723+0000","last_became_active":"2023-12-12T09:43:22.271056+0000","last_became_peered":"2023-12-12T09:43:22.271056+0000","last_unstale":"2023-12-12T09:43:23.235723+0000","last_undegraded":"2023-12-12T09:43:23.235723+0000","last_fullsized":"2023-12-12T09:43:23.235723+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_clean_scrub_stamp":"2023-12-12T09:43:21.241417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T13:28:21.176910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-12-12T09:43:23.235191+0000","last_change":"2023-12-12T09:43:22.271790+0000","last_active":"2023-12-12T09:43:23.235191+0000","last_peered":"2023-12-12T09:43:23.235191+0000","last_clean":"2023-12-12T09:43:23.235191+0000","last_became_active":"2023-12-12T09:43:22.271591+0000","last_became_peered":"2023-12-12T09:43:22.271591+0000","last_unstale":"2023-12-12T09:43:23.235191+0000","last_undegraded":"2023-12-12T09:43:23.235191+0000","last_fullsized":"2023-12-12T09:43:23.235191+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_clean_scrub_stamp":"2023-12-12T09:43:21.241417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T17:19:30.590382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-12-12T09:43:23.511156+0000","last_change":"2023-12-12T09:43:22.260477+0000","last_active":"2023-12-12T09:43:23.511156+0000","last_peered":"2023-12-12T09:43:23.511156+0000","last_clean":"2023-12-12T09:43:23.511156+0000","last_became_active":"2023-12-12T09:43:22.258474+0000","last_became_peered":"2023-12-12T09:43:22.258474+0000","last_unstale":"2023-12-12T09:43:23.511156+0000","last_undegraded":"2023-12-12T09:43:23.511156+0000","last_fullsized":"2023-12-12T09:43:23.511156+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_clean_scrub_stamp":"2023-12-12T09:43:21.241417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T17:30:21.214675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-12-12T09:43:23.513789+0000","last_change":"2023-12-12T09:43:22.256210+0000","last_active":"2023-12-12T09:43:23.513789+0000","last_peered":"2023-12-12T09:43:23.513789+0000","last_clean":"2023-12-12T09:43:23.513789+0000","last_became_active":"2023-12-12T09:43:22.255873+0000","last_became_peered":"2023-12-12T09:43:22.255873+0000","last_unstale":"2023-12-12T09:43:23.513789+0000","last_undegraded":"2023-12-12T09:43:23.513789+0000","last_fullsized":"2023-12-12T09:43:23.513789+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_clean_scrub_stamp":"2023-12-12T09:43:21.241417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T12:09:32.290407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-12-12T09:43:23.509500+0000","last_change":"2023-12-12T09:43:22.261015+0000","last_active":"2023-12-12T09:43:23.509500+0000","last_peered":"2023-12-12T09:43:23.509500+0000","last_clean":"2023-12-12T09:43:23.509500+0000","last_became_active":"2023-12-12T09:43:22.260799+0000","last_became_peered":"2023-12-12T09:43:22.260799+0000","last_unstale":"2023-12-12T09:43:23.509500+0000","last_undegraded":"2023-12-12T09:43:23.509500+0000","last_fullsized":"2023-12-12T09:43:23.509500+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_clean_scrub_stamp":"2023-12-12T09:43:21.241417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T17:13:30.502374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-12-12T09:43:23.228621+0000","last_change":"2023-12-12T09:43:22.251732+0000","last_active":"2023-12-12T09:43:23.228621+0000","last_peered":"2023-12-12T09:43:23.228621+0000","last_clean":"2023-12-12T09:43:23.228621+0000","last_became_active":"2023-12-12T09:43:22.251022+0000","last_became_peered":"2023-12-12T09:43:22.251022+0000","last_unstale":"2023-12-12T09:43:23.228621+0000","last_undegraded":"2023-12-12T09:43:23.228621+0000","last_fullsized":"2023-12-12T09:43:23.228621+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_clean_scrub_stamp":"2023-12-12T09:43:21.241417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T11:56:43.095343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-12-12T09:43:23.231963+0000","last_change":"2023-12-12T09:43:22.249945+0000","last_active":"2023-12-12T09:43:23.231963+0000","last_peered":"2023-12-12T09:43:23.231963+0000","last_clean":"2023-12-12T09:43:23.231963+0000","last_became_active":"2023-12-12T09:43:22.248947+0000","last_became_peered":"2023-12-12T09:43:22.248947+0000","last_unstale":"2023-12-12T09:43:23.231963+0000","last_undegraded":"2023-12-12T09:43:23.231963+0000","last_fullsized":"2023-12-12T09:43:23.231963+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_clean_scrub_stamp":"2023-12-12T09:43:21.241417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T10:52:36.164447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-12-12T09:43:23.234030+0000","last_change":"2023-12-12T09:43:22.269637+0000","last_active":"2023-12-12T09:43:23.234030+0000","last_peered":"2023-12-12T09:43:23.234030+0000","last_clean":"2023-12-12T09:43:23.234030+0000","last_became_active":"2023-12-12T09:43:22.269332+0000","last_became_peered":"2023-12-12T09:43:22.269332+0000","last_unstale":"2023-12-12T09:43:23.234030+0000","last_undegraded":"2023-12-12T09:43:23.234030+0000","last_fullsized":"2023-12-12T09:43:23.234030+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_clean_scrub_stamp":"2023-12-12T09:43:21.241417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T16:30:08.113732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-12-12T09:43:23.514190+0000","last_change":"2023-12-12T09:43:22.253973+0000","last_active":"2023-12-12T09:43:23.514190+0000","last_peered":"2023-12-12T09:43:23.514190+0000","last_clean":"2023-12-12T09:43:23.514190+0000","last_became_active":"2023-12-12T09:43:22.253518+0000","last_became_peered":"2023-12-12T09:43:22.253518+0000","last_unstale":"2023-12-12T09:43:23.514190+0000","last_undegraded":"2023-12-12T09:43:23.514190+0000","last_fullsized":"2023-12-12T09:43:23.514190+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_clean_scrub_stamp":"2023-12-12T09:43:21.241417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T11:40:42.785424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-12-12T09:43:23.512776+0000","last_change":"2023-12-12T09:43:22.260001+0000","last_active":"2023-12-12T09:43:23.512776+0000","last_peered":"2023-12-12T09:43:23.512776+0000","last_clean":"2023-12-12T09:43:23.512776+0000","last_became_active":"2023-12-12T09:43:22.259694+0000","last_became_peered":"2023-12-12T09:43:22.259694+0000","last_unstale":"2023-12-12T09:43:23.512776+0000","last_undegraded":"2023-12-12T09:43:23.512776+0000","last_fullsized":"2023-12-12T09:43:23.512776+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_clean_scrub_stamp":"2023-12-12T09:43:21.241417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T13:12:59.364006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-12-12T09:43:23.235234+0000","last_change":"2023-12-12T09:43:22.261171+0000","last_active":"2023-12-12T09:43:23.235234+0000","last_peered":"2023-12-12T09:43:23.235234+0000","last_clean":"2023-12-12T09:43:23.235234+0000","last_became_active":"2023-12-12T09:43:22.257505+0000","last_became_peered":"2023-12-12T09:43:22.257505+0000","last_unstale":"2023-12-12T09:43:23.235234+0000","last_undegraded":"2023-12-12T09:43:23.235234+0000","last_fullsized":"2023-12-12T09:43:23.235234+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_clean_scrub_stamp":"2023-12-12T09:43:21.241417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T11:56:43.095343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-12-12T09:43:23.510222+0000","last_change":"2023-12-12T09:43:22.249523+0000","last_active":"2023-12-12T09:43:23.510222+0000","last_peered":"2023-12-12T09:43:23.510222+0000","last_clean":"2023-12-12T09:43:23.510222+0000","last_became_active":"2023-12-12T09:43:22.249225+0000","last_became_peered":"2023-12-12T09:43:22.249225+0000","last_unstale":"2023-12-12T09:43:23.510222+0000","last_undegraded":"2023-12-12T09:43:23.510222+0000","last_fullsized":"2023-12-12T09:43:23.510222+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_clean_scrub_stamp":"2023-12-12T09:43:21.241417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T20:17:31.359873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-12-12T09:43:23.232234+0000","last_change":"2023-12-12T09:43:22.262015+0000","last_active":"2023-12-12T09:43:23.232234+0000","last_peered":"2023-12-12T09:43:23.232234+0000","last_clean":"2023-12-12T09:43:23.232234+0000","last_became_active":"2023-12-12T09:43:22.249119+0000","last_became_peered":"2023-12-12T09:43:22.249119+0000","last_unstale":"2023-12-12T09:43:23.232234+0000","last_undegraded":"2023-12-12T09:43:23.232234+0000","last_fullsized":"2023-12-12T09:43:23.232234+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_clean_scrub_stamp":"2023-12-12T09:43:21.241417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T19:41:10.137746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-12-12T09:43:23.511791+0000","last_change":"2023-12-12T09:43:22.262018+0000","last_active":"2023-12-12T09:43:23.511791+0000","last_peered":"2023-12-12T09:43:23.511791+0000","last_clean":"2023-12-12T09:43:23.511791+0000","last_became_active":"2023-12-12T09:43:22.261664+0000","last_became_peered":"2023-12-12T09:43:22.261664+0000","last_unstale":"2023-12-12T09:43:23.511791+0000","last_undegraded":"2023-12-12T09:43:23.511791+0000","last_fullsized":"2023-12-12T09:43:23.511791+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_clean_scrub_stamp":"2023-12-12T09:43:21.241417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T17:19:30.590382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-12-12T09:43:23.232314+0000","last_change":"2023-12-12T09:43:22.262378+0000","last_active":"2023-12-12T09:43:23.232314+0000","last_peered":"2023-12-12T09:43:23.232314+0000","last_clean":"2023-12-12T09:43:23.232314+0000","last_became_active":"2023-12-12T09:43:22.257809+0000","last_became_peered":"2023-12-12T09:43:22.257809+0000","last_unstale":"2023-12-12T09:43:23.232314+0000","last_undegraded":"2023-12-12T09:43:23.232314+0000","last_fullsized":"2023-12-12T09:43:23.232314+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_clean_scrub_stamp":"2023-12-12T09:43:21.241417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T13:17:19.564666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-12-12T09:43:23.512246+0000","last_change":"2023-12-12T09:43:22.255723+0000","last_active":"2023-12-12T09:43:23.512246+0000","last_peered":"2023-12-12T09:43:23.512246+0000","last_clean":"2023-12-12T09:43:23.512246+0000","last_became_active":"2023-12-12T09:43:22.255373+0000","last_became_peered":"2023-12-12T09:43:22.255373+0000","last_unstale":"2023-12-12T09:43:23.512246+0000","last_undegraded":"2023-12-12T09:43:23.512246+0000","last_fullsized":"2023-12-12T09:43:23.512246+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_clean_scrub_stamp":"2023-12-12T09:43:21.241417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T10:52:36.164447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-12-12T09:43:23.235623+0000","last_change":"2023-12-12T09:43:22.257161+0000","last_active":"2023-12-12T09:43:23.235623+0000","last_peered":"2023-12-12T09:43:23.235623+0000","last_clean":"2023-12-12T09:43:23.235623+0000","last_became_active":"2023-12-12T09:43:22.256836+0000","last_became_peered":"2023-12-12T09:43:22.256836+0000","last_unstale":"2023-12-12T09:43:23.235623+0000","last_undegraded":"2023-12-12T09:43:23.235623+0000","last_fullsized":"2023-12-12T09:43:23.235623+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_clean_scrub_stamp":"2023-12-12T09:43:21.241417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T10:52:36.164447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-12-12T09:43:23.228750+0000","last_change":"2023-12-12T09:43:22.248044+0000","last_active":"2023-12-12T09:43:23.228750+0000","last_peered":"2023-12-12T09:43:23.228750+0000","last_clean":"2023-12-12T09:43:23.228750+0000","last_became_active":"2023-12-12T09:43:22.247775+0000","last_became_peered":"2023-12-12T09:43:22.247775+0000","last_unstale":"2023-12-12T09:43:23.228750+0000","last_undegraded":"2023-12-12T09:43:23.228750+0000","last_fullsized":"2023-12-12T09:43:23.228750+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_clean_scrub_stamp":"2023-12-12T09:43:21.241417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T10:52:36.164447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-12-12T09:43:23.512629+0000","last_change":"2023-12-12T09:43:22.254318+0000","last_active":"2023-12-12T09:43:23.512629+0000","last_peered":"2023-12-12T09:43:23.512629+0000","last_clean":"2023-12-12T09:43:23.512629+0000","last_became_active":"2023-12-12T09:43:22.253983+0000","last_became_peered":"2023-12-12T09:43:22.253983+0000","last_unstale":"2023-12-12T09:43:23.512629+0000","last_undegraded":"2023-12-12T09:43:23.512629+0000","last_fullsized":"2023-12-12T09:43:23.512629+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_clean_scrub_stamp":"2023-12-12T09:43:21.241417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T13:17:19.564666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-12-12T09:43:23.510548+0000","last_change":"2023-12-12T09:43:22.259144+0000","last_active":"2023-12-12T09:43:23.510548+0000","last_peered":"2023-12-12T09:43:23.510548+0000","last_clean":"2023-12-12T09:43:23.510548+0000","last_became_active":"2023-12-12T09:43:22.258791+0000","last_became_peered":"2023-12-12T09:43:22.258791+0000","last_unstale":"2023-12-12T09:43:23.510548+0000","last_undegraded":"2023-12-12T09:43:23.510548+0000","last_fullsized":"2023-12-12T09:43:23.510548+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_clean_scrub_stamp":"2023-12-12T09:43:21.241417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T10:01:50.869497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-12-12T09:43:23.232428+0000","last_change":"2023-12-12T09:43:22.262253+0000","last_active":"2023-12-12T09:43:23.232428+0000","last_peered":"2023-12-12T09:43:23.232428+0000","last_clean":"2023-12-12T09:43:23.232428+0000","last_became_active":"2023-12-12T09:43:22.250870+0000","last_became_peered":"2023-12-12T09:43:22.250870+0000","last_unstale":"2023-12-12T09:43:23.232428+0000","last_undegraded":"2023-12-12T09:43:23.232428+0000","last_fullsized":"2023-12-12T09:43:23.232428+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_clean_scrub_stamp":"2023-12-12T09:43:21.241417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T13:22:21.650455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-12-12T09:43:23.510589+0000","last_change":"2023-12-12T09:43:22.247885+0000","last_active":"2023-12-12T09:43:23.510589+0000","last_peered":"2023-12-12T09:43:23.510589+0000","last_clean":"2023-12-12T09:43:23.510589+0000","last_became_active":"2023-12-12T09:43:22.245305+0000","last_became_peered":"2023-12-12T09:43:22.245305+0000","last_unstale":"2023-12-12T09:43:23.510589+0000","last_undegraded":"2023-12-12T09:43:23.510589+0000","last_fullsized":"2023-12-12T09:43:23.510589+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_clean_scrub_stamp":"2023-12-12T09:43:21.241417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T17:30:21.214675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-12-12T09:43:23.234759+0000","last_change":"2023-12-12T09:43:22.262475+0000","last_active":"2023-12-12T09:43:23.234759+0000","last_peered":"2023-12-12T09:43:23.234759+0000","last_clean":"2023-12-12T09:43:23.234759+0000","last_became_active":"2023-12-12T09:43:22.260635+0000","last_became_peered":"2023-12-12T09:43:22.260635+0000","last_unstale":"2023-12-12T09:43:23.234759+0000","last_undegraded":"2023-12-12T09:43:23.234759+0000","last_fullsized":"2023-12-12T09:43:23.234759+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_clean_scrub_stamp":"2023-12-12T09:43:21.241417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T10:01:50.869497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-12-12T09:43:23.510507+0000","last_change":"2023-12-12T09:43:22.253497+0000","last_active":"2023-12-12T09:43:23.510507+0000","last_peered":"2023-12-12T09:43:23.510507+0000","last_clean":"2023-12-12T09:43:23.510507+0000","last_became_active":"2023-12-12T09:43:22.253062+0000","last_became_peered":"2023-12-12T09:43:22.253062+0000","last_unstale":"2023-12-12T09:43:23.510507+0000","last_undegraded":"2023-12-12T09:43:23.510507+0000","last_fullsized":"2023-12-12T09:43:23.510507+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_clean_scrub_stamp":"2023-12-12T09:43:21.241417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T11:24:12.081000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-12-12T09:43:23.514357+0000","last_change":"2023-12-12T09:43:21.297984+0000","last_active":"2023-12-12T09:43:23.514357+0000","last_peered":"2023-12-12T09:43:23.514357+0000","last_clean":"2023-12-12T09:43:23.514357+0000","last_became_active":"2023-12-12T09:43:21.297753+0000","last_became_peered":"2023-12-12T09:43:21.297753+0000","last_unstale":"2023-12-12T09:43:23.514357+0000","last_undegraded":"2023-12-12T09:43:23.514357+0000","last_fullsized":"2023-12-12T09:43:23.514357+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:43:20.054829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:43:20.054829+0000","last_clean_scrub_stamp":"2023-12-12T09:43:20.054829+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T14:02:28.705261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-12-12T09:43:23.510862+0000","last_change":"2023-12-12T09:43:22.257540+0000","last_active":"2023-12-12T09:43:23.510862+0000","last_peered":"2023-12-12T09:43:23.510862+0000","last_clean":"2023-12-12T09:43:23.510862+0000","last_became_active":"2023-12-12T09:43:22.257172+0000","last_became_peered":"2023-12-12T09:43:22.257172+0000","last_unstale":"2023-12-12T09:43:23.510862+0000","last_undegraded":"2023-12-12T09:43:23.510862+0000","last_fullsized":"2023-12-12T09:43:23.510862+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_clean_scrub_stamp":"2023-12-12T09:43:21.241417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T17:19:30.590382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-12-12T09:43:23.235423+0000","last_change":"2023-12-12T09:43:21.301627+0000","last_active":"2023-12-12T09:43:23.235423+0000","last_peered":"2023-12-12T09:43:23.235423+0000","last_clean":"2023-12-12T09:43:23.235423+0000","last_became_active":"2023-12-12T09:43:21.296928+0000","last_became_peered":"2023-12-12T09:43:21.296928+0000","last_unstale":"2023-12-12T09:43:23.235423+0000","last_undegraded":"2023-12-12T09:43:23.235423+0000","last_fullsized":"2023-12-12T09:43:23.235423+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:43:20.054829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:43:20.054829+0000","last_clean_scrub_stamp":"2023-12-12T09:43:20.054829+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T17:13:29.315785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-12-12T09:43:23.511662+0000","last_change":"2023-12-12T09:43:21.292918+0000","last_active":"2023-12-12T09:43:23.511662+0000","last_peered":"2023-12-12T09:43:23.511662+0000","last_clean":"2023-12-12T09:43:23.511662+0000","last_became_active":"2023-12-12T09:43:21.292599+0000","last_became_peered":"2023-12-12T09:43:21.292599+0000","last_unstale":"2023-12-12T09:43:23.511662+0000","last_undegraded":"2023-12-12T09:43:23.511662+0000","last_fullsized":"2023-12-12T09:43:23.511662+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:43:20.054829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:43:20.054829+0000","last_clean_scrub_stamp":"2023-12-12T09:43:20.054829+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T17:13:29.315785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-12-12T09:43:23.512032+0000","last_change":"2023-12-12T09:43:22.250889+0000","last_active":"2023-12-12T09:43:23.512032+0000","last_peered":"2023-12-12T09:43:23.512032+0000","last_clean":"2023-12-12T09:43:23.512032+0000","last_became_active":"2023-12-12T09:43:22.249404+0000","last_became_peered":"2023-12-12T09:43:22.249404+0000","last_unstale":"2023-12-12T09:43:23.512032+0000","last_undegraded":"2023-12-12T09:43:23.512032+0000","last_fullsized":"2023-12-12T09:43:23.512032+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_clean_scrub_stamp":"2023-12-12T09:43:21.241417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T11:56:43.095343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-12-12T09:43:23.232554+0000","last_change":"2023-12-12T09:43:21.283438+0000","last_active":"2023-12-12T09:43:23.232554+0000","last_peered":"2023-12-12T09:43:23.232554+0000","last_clean":"2023-12-12T09:43:23.232554+0000","last_became_active":"2023-12-12T09:43:21.283168+0000","last_became_peered":"2023-12-12T09:43:21.283168+0000","last_unstale":"2023-12-12T09:43:23.232554+0000","last_undegraded":"2023-12-12T09:43:23.232554+0000","last_fullsized":"2023-12-12T09:43:23.232554+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:43:20.054829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:43:20.054829+0000","last_clean_scrub_stamp":"2023-12-12T09:43:20.054829+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T19:29:29.412626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-12-12T09:43:23.228419+0000","last_change":"2023-12-12T09:43:22.246835+0000","last_active":"2023-12-12T09:43:23.228419+0000","last_peered":"2023-12-12T09:43:23.228419+0000","last_clean":"2023-12-12T09:43:23.228419+0000","last_became_active":"2023-12-12T09:43:22.246425+0000","last_became_peered":"2023-12-12T09:43:22.246425+0000","last_unstale":"2023-12-12T09:43:23.228419+0000","last_undegraded":"2023-12-12T09:43:23.228419+0000","last_fullsized":"2023-12-12T09:43:23.228419+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_clean_scrub_stamp":"2023-12-12T09:43:21.241417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T10:01:50.869497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-12-12T09:43:23.235408+0000","last_change":"2023-12-12T09:43:21.296908+0000","last_active":"2023-12-12T09:43:23.235408+0000","last_peered":"2023-12-12T09:43:23.235408+0000","last_clean":"2023-12-12T09:43:23.235408+0000","last_became_active":"2023-12-12T09:43:21.296613+0000","last_became_peered":"2023-12-12T09:43:21.296613+0000","last_unstale":"2023-12-12T09:43:23.235408+0000","last_undegraded":"2023-12-12T09:43:23.235408+0000","last_fullsized":"2023-12-12T09:43:23.235408+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:43:20.054829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:43:20.054829+0000","last_clean_scrub_stamp":"2023-12-12T09:43:20.054829+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T17:12:57.858301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-12-12T09:43:23.233425+0000","last_change":"2023-12-12T09:43:22.257034+0000","last_active":"2023-12-12T09:43:23.233425+0000","last_peered":"2023-12-12T09:43:23.233425+0000","last_clean":"2023-12-12T09:43:23.233425+0000","last_became_active":"2023-12-12T09:43:22.250340+0000","last_became_peered":"2023-12-12T09:43:22.250340+0000","last_unstale":"2023-12-12T09:43:23.233425+0000","last_undegraded":"2023-12-12T09:43:23.233425+0000","last_fullsized":"2023-12-12T09:43:23.233425+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_clean_scrub_stamp":"2023-12-12T09:43:21.241417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T11:37:48.456174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-12-12T09:43:23.233396+0000","last_change":"2023-12-12T09:43:21.303926+0000","last_active":"2023-12-12T09:43:23.233396+0000","last_peered":"2023-12-12T09:43:23.233396+0000","last_clean":"2023-12-12T09:43:23.233396+0000","last_became_active":"2023-12-12T09:43:21.303631+0000","last_became_peered":"2023-12-12T09:43:21.303631+0000","last_unstale":"2023-12-12T09:43:23.233396+0000","last_undegraded":"2023-12-12T09:43:23.233396+0000","last_fullsized":"2023-12-12T09:43:23.233396+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:43:20.054829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:43:20.054829+0000","last_clean_scrub_stamp":"2023-12-12T09:43:20.054829+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T10:01:49.682908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-12-12T09:43:23.513875+0000","last_change":"2023-12-12T09:43:22.252730+0000","last_active":"2023-12-12T09:43:23.513875+0000","last_peered":"2023-12-12T09:43:23.513875+0000","last_clean":"2023-12-12T09:43:23.513875+0000","last_became_active":"2023-12-12T09:43:22.252440+0000","last_became_peered":"2023-12-12T09:43:22.252440+0000","last_unstale":"2023-12-12T09:43:23.513875+0000","last_undegraded":"2023-12-12T09:43:23.513875+0000","last_fullsized":"2023-12-12T09:43:23.513875+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_clean_scrub_stamp":"2023-12-12T09:43:21.241417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T13:28:21.176910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-12-12T09:43:23.228903+0000","last_change":"2023-12-12T09:43:21.288877+0000","last_active":"2023-12-12T09:43:23.228903+0000","last_peered":"2023-12-12T09:43:23.228903+0000","last_clean":"2023-12-12T09:43:23.228903+0000","last_became_active":"2023-12-12T09:43:21.288552+0000","last_became_peered":"2023-12-12T09:43:21.288552+0000","last_unstale":"2023-12-12T09:43:23.228903+0000","last_undegraded":"2023-12-12T09:43:23.228903+0000","last_fullsized":"2023-12-12T09:43:23.228903+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:43:20.054829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:43:20.054829+0000","last_clean_scrub_stamp":"2023-12-12T09:43:20.054829+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T20:32:59.313749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-12-12T09:43:23.511204+0000","last_change":"2023-12-12T09:43:22.261371+0000","last_active":"2023-12-12T09:43:23.511204+0000","last_peered":"2023-12-12T09:43:23.511204+0000","last_clean":"2023-12-12T09:43:23.511204+0000","last_became_active":"2023-12-12T09:43:22.255661+0000","last_became_peered":"2023-12-12T09:43:22.255661+0000","last_unstale":"2023-12-12T09:43:23.511204+0000","last_undegraded":"2023-12-12T09:43:23.511204+0000","last_fullsized":"2023-12-12T09:43:23.511204+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_clean_scrub_stamp":"2023-12-12T09:43:21.241417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T11:40:42.785424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"20'6","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-12-12T09:43:23.235332+0000","last_change":"2023-12-12T09:43:21.302252+0000","last_active":"2023-12-12T09:43:23.235332+0000","last_peered":"2023-12-12T09:43:23.235332+0000","last_clean":"2023-12-12T09:43:23.235332+0000","last_became_active":"2023-12-12T09:43:21.301960+0000","last_became_peered":"2023-12-12T09:43:21.301960+0000","last_unstale":"2023-12-12T09:43:23.235332+0000","last_undegraded":"2023-12-12T09:43:23.235332+0000","last_fullsized":"2023-12-12T09:43:23.235332+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:43:20.054829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:43:20.054829+0000","last_clean_scrub_stamp":"2023-12-12T09:43:20.054829+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T21:27:10.922205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-12-12T09:43:23.512344+0000","last_change":"2023-12-12T09:43:22.264539+0000","last_active":"2023-12-12T09:43:23.512344+0000","last_peered":"2023-12-12T09:43:23.512344+0000","last_clean":"2023-12-12T09:43:23.512344+0000","last_became_active":"2023-12-12T09:43:22.264263+0000","last_became_peered":"2023-12-12T09:43:22.264263+0000","last_unstale":"2023-12-12T09:43:23.512344+0000","last_undegraded":"2023-12-12T09:43:23.512344+0000","last_fullsized":"2023-12-12T09:43:23.512344+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_clean_scrub_stamp":"2023-12-12T09:43:21.241417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T11:24:46.660535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-12-12T09:43:23.511008+0000","last_change":"2023-12-12T09:43:21.291014+0000","last_active":"2023-12-12T09:43:23.511008+0000","last_peered":"2023-12-12T09:43:23.511008+0000","last_clean":"2023-12-12T09:43:23.511008+0000","last_became_active":"2023-12-12T09:43:21.286948+0000","last_became_peered":"2023-12-12T09:43:21.286948+0000","last_unstale":"2023-12-12T09:43:23.511008+0000","last_undegraded":"2023-12-12T09:43:23.511008+0000","last_fullsized":"2023-12-12T09:43:23.511008+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:43:20.054829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:43:20.054829+0000","last_clean_scrub_stamp":"2023-12-12T09:43:20.054829+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T18:28:40.746959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-12-12T09:43:23.509853+0000","last_change":"2023-12-12T09:43:22.249360+0000","last_active":"2023-12-12T09:43:23.509853+0000","last_peered":"2023-12-12T09:43:23.509853+0000","last_clean":"2023-12-12T09:43:23.509853+0000","last_became_active":"2023-12-12T09:43:22.248965+0000","last_became_peered":"2023-12-12T09:43:22.248965+0000","last_unstale":"2023-12-12T09:43:23.509853+0000","last_undegraded":"2023-12-12T09:43:23.509853+0000","last_fullsized":"2023-12-12T09:43:23.509853+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_clean_scrub_stamp":"2023-12-12T09:43:21.241417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T14:02:29.891850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-12-12T09:43:23.232545+0000","last_change":"2023-12-12T09:43:21.291279+0000","last_active":"2023-12-12T09:43:23.232545+0000","last_peered":"2023-12-12T09:43:23.232545+0000","last_clean":"2023-12-12T09:43:23.232545+0000","last_became_active":"2023-12-12T09:43:21.290993+0000","last_became_peered":"2023-12-12T09:43:21.290993+0000","last_unstale":"2023-12-12T09:43:23.232545+0000","last_undegraded":"2023-12-12T09:43:23.232545+0000","last_fullsized":"2023-12-12T09:43:23.232545+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:43:20.054829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:43:20.054829+0000","last_clean_scrub_stamp":"2023-12-12T09:43:20.054829+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T21:27:10.922205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-12-12T09:43:23.512810+0000","last_change":"2023-12-12T09:43:22.264893+0000","last_active":"2023-12-12T09:43:23.512810+0000","last_peered":"2023-12-12T09:43:23.512810+0000","last_clean":"2023-12-12T09:43:23.512810+0000","last_became_active":"2023-12-12T09:43:22.262599+0000","last_became_peered":"2023-12-12T09:43:22.262599+0000","last_unstale":"2023-12-12T09:43:23.512810+0000","last_undegraded":"2023-12-12T09:43:23.512810+0000","last_fullsized":"2023-12-12T09:43:23.512810+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_clean_scrub_stamp":"2023-12-12T09:43:21.241417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T11:37:48.456174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-12-12T09:43:23.234782+0000","last_change":"2023-12-12T09:43:21.298187+0000","last_active":"2023-12-12T09:43:23.234782+0000","last_peered":"2023-12-12T09:43:23.234782+0000","last_clean":"2023-12-12T09:43:23.234782+0000","last_became_active":"2023-12-12T09:43:21.297563+0000","last_became_peered":"2023-12-12T09:43:21.297563+0000","last_unstale":"2023-12-12T09:43:23.234782+0000","last_undegraded":"2023-12-12T09:43:23.234782+0000","last_fullsized":"2023-12-12T09:43:23.234782+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:43:20.054829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:43:20.054829+0000","last_clean_scrub_stamp":"2023-12-12T09:43:20.054829+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T18:28:40.746959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-12-12T09:43:23.234722+0000","last_change":"2023-12-12T09:43:22.265004+0000","last_active":"2023-12-12T09:43:23.234722+0000","last_peered":"2023-12-12T09:43:23.234722+0000","last_clean":"2023-12-12T09:43:23.234722+0000","last_became_active":"2023-12-12T09:43:22.264691+0000","last_became_peered":"2023-12-12T09:43:22.264691+0000","last_unstale":"2023-12-12T09:43:23.234722+0000","last_undegraded":"2023-12-12T09:43:23.234722+0000","last_fullsized":"2023-12-12T09:43:23.234722+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_clean_scrub_stamp":"2023-12-12T09:43:21.241417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T20:17:31.359873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-12-12T09:43:23.510566+0000","last_change":"2023-12-12T09:43:21.284943+0000","last_active":"2023-12-12T09:43:23.510566+0000","last_peered":"2023-12-12T09:43:23.510566+0000","last_clean":"2023-12-12T09:43:23.510566+0000","last_became_active":"2023-12-12T09:43:21.284647+0000","last_became_peered":"2023-12-12T09:43:21.284647+0000","last_unstale":"2023-12-12T09:43:23.510566+0000","last_undegraded":"2023-12-12T09:43:23.510566+0000","last_fullsized":"2023-12-12T09:43:23.510566+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:43:20.054829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:43:20.054829+0000","last_clean_scrub_stamp":"2023-12-12T09:43:20.054829+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T11:24:10.894411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-12-12T09:43:23.511910+0000","last_change":"2023-12-12T09:43:22.265457+0000","last_active":"2023-12-12T09:43:23.511910+0000","last_peered":"2023-12-12T09:43:23.511910+0000","last_clean":"2023-12-12T09:43:23.511910+0000","last_became_active":"2023-12-12T09:43:22.263712+0000","last_became_peered":"2023-12-12T09:43:22.263712+0000","last_unstale":"2023-12-12T09:43:23.511910+0000","last_undegraded":"2023-12-12T09:43:23.511910+0000","last_fullsized":"2023-12-12T09:43:23.511910+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_clean_scrub_stamp":"2023-12-12T09:43:21.241417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T12:09:32.290407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-12-12T09:43:23.511049+0000","last_change":"2023-12-12T09:43:21.295422+0000","last_active":"2023-12-12T09:43:23.511049+0000","last_peered":"2023-12-12T09:43:23.511049+0000","last_clean":"2023-12-12T09:43:23.511049+0000","last_became_active":"2023-12-12T09:43:21.295045+0000","last_became_peered":"2023-12-12T09:43:21.295045+0000","last_unstale":"2023-12-12T09:43:23.511049+0000","last_undegraded":"2023-12-12T09:43:23.511049+0000","last_fullsized":"2023-12-12T09:43:23.511049+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:43:20.054829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:43:20.054829+0000","last_clean_scrub_stamp":"2023-12-12T09:43:20.054829+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T17:12:57.858301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-12-12T09:43:23.513178+0000","last_change":"2023-12-12T09:43:22.261274+0000","last_active":"2023-12-12T09:43:23.513178+0000","last_peered":"2023-12-12T09:43:23.513178+0000","last_clean":"2023-12-12T09:43:23.513178+0000","last_became_active":"2023-12-12T09:43:22.260940+0000","last_became_peered":"2023-12-12T09:43:22.260940+0000","last_unstale":"2023-12-12T09:43:23.513178+0000","last_undegraded":"2023-12-12T09:43:23.513178+0000","last_fullsized":"2023-12-12T09:43:23.513178+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_clean_scrub_stamp":"2023-12-12T09:43:21.241417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T16:30:08.113732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-12-12T09:43:23.514412+0000","last_change":"2023-12-12T09:43:21.292425+0000","last_active":"2023-12-12T09:43:23.514412+0000","last_peered":"2023-12-12T09:43:23.514412+0000","last_clean":"2023-12-12T09:43:23.514412+0000","last_became_active":"2023-12-12T09:43:21.290884+0000","last_became_peered":"2023-12-12T09:43:21.290884+0000","last_unstale":"2023-12-12T09:43:23.514412+0000","last_undegraded":"2023-12-12T09:43:23.514412+0000","last_fullsized":"2023-12-12T09:43:23.514412+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:43:20.054829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:43:20.054829+0000","last_clean_scrub_stamp":"2023-12-12T09:43:20.054829+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T10:41:13.505292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-12-12T09:43:23.513933+0000","last_change":"2023-12-12T09:43:22.261726+0000","last_active":"2023-12-12T09:43:23.513933+0000","last_peered":"2023-12-12T09:43:23.513933+0000","last_clean":"2023-12-12T09:43:23.513933+0000","last_became_active":"2023-12-12T09:43:22.261503+0000","last_became_peered":"2023-12-12T09:43:22.261503+0000","last_unstale":"2023-12-12T09:43:23.513933+0000","last_undegraded":"2023-12-12T09:43:23.513933+0000","last_fullsized":"2023-12-12T09:43:23.513933+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_clean_scrub_stamp":"2023-12-12T09:43:21.241417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T11:47:46.279003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-12-12T09:43:23.228883+0000","last_change":"2023-12-12T09:43:21.288749+0000","last_active":"2023-12-12T09:43:23.228883+0000","last_peered":"2023-12-12T09:43:23.228883+0000","last_clean":"2023-12-12T09:43:23.228883+0000","last_became_active":"2023-12-12T09:43:21.288489+0000","last_became_peered":"2023-12-12T09:43:21.288489+0000","last_unstale":"2023-12-12T09:43:23.228883+0000","last_undegraded":"2023-12-12T09:43:23.228883+0000","last_fullsized":"2023-12-12T09:43:23.228883+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:43:20.054829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:43:20.054829+0000","last_clean_scrub_stamp":"2023-12-12T09:43:20.054829+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T20:17:30.173285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-12-12T09:43:23.233067+0000","last_change":"2023-12-12T09:43:22.270243+0000","last_active":"2023-12-12T09:43:23.233067+0000","last_peered":"2023-12-12T09:43:23.233067+0000","last_clean":"2023-12-12T09:43:23.233067+0000","last_became_active":"2023-12-12T09:43:22.269976+0000","last_became_peered":"2023-12-12T09:43:22.269976+0000","last_unstale":"2023-12-12T09:43:23.233067+0000","last_undegraded":"2023-12-12T09:43:23.233067+0000","last_fullsized":"2023-12-12T09:43:23.233067+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_clean_scrub_stamp":"2023-12-12T09:43:21.241417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T12:08:27.288104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-12-12T09:43:23.511644+0000","last_change":"2023-12-12T09:43:21.286223+0000","last_active":"2023-12-12T09:43:23.511644+0000","last_peered":"2023-12-12T09:43:23.511644+0000","last_clean":"2023-12-12T09:43:23.511644+0000","last_became_active":"2023-12-12T09:43:21.285919+0000","last_became_peered":"2023-12-12T09:43:21.285919+0000","last_unstale":"2023-12-12T09:43:23.511644+0000","last_undegraded":"2023-12-12T09:43:23.511644+0000","last_fullsized":"2023-12-12T09:43:23.511644+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:43:20.054829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:43:20.054829+0000","last_clean_scrub_stamp":"2023-12-12T09:43:20.054829+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T20:43:17.341558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-12-12T09:43:23.512543+0000","last_change":"2023-12-12T09:43:22.279936+0000","last_active":"2023-12-12T09:43:23.512543+0000","last_peered":"2023-12-12T09:43:23.512543+0000","last_clean":"2023-12-12T09:43:23.512543+0000","last_became_active":"2023-12-12T09:43:22.276294+0000","last_became_peered":"2023-12-12T09:43:22.276294+0000","last_unstale":"2023-12-12T09:43:23.512543+0000","last_undegraded":"2023-12-12T09:43:23.512543+0000","last_fullsized":"2023-12-12T09:43:23.512543+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_clean_scrub_stamp":"2023-12-12T09:43:21.241417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T20:26:35.861125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":165,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-12T09:43:22.246331+0000","last_change":"2023-12-12T09:43:17.203315+0000","last_active":"2023-12-12T09:43:22.246331+0000","last_peered":"2023-12-12T09:43:22.246331+0000","last_clean":"2023-12-12T09:43:22.246331+0000","last_became_active":"2023-12-12T09:43:17.200779+0000","last_became_peered":"2023-12-12T09:43:17.200779+0000","last_unstale":"2023-12-12T09:43:22.246331+0000","last_undegraded":"2023-12-12T09:43:22.246331+0000","last_fullsized":"2023-12-12T09:43:22.246331+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:43:15.931922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:43:15.931922+0000","last_clean_scrub_stamp":"2023-12-12T09:43:15.931922+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T21:42:10.929640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-12-12T09:43:23.231837+0000","last_change":"2023-12-12T09:43:21.286777+0000","last_active":"2023-12-12T09:43:23.231837+0000","last_peered":"2023-12-12T09:43:23.231837+0000","last_clean":"2023-12-12T09:43:23.231837+0000","last_became_active":"2023-12-12T09:43:21.285422+0000","last_became_peered":"2023-12-12T09:43:21.285422+0000","last_unstale":"2023-12-12T09:43:23.231837+0000","last_undegraded":"2023-12-12T09:43:23.231837+0000","last_fullsized":"2023-12-12T09:43:23.231837+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:43:20.054829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:43:20.054829+0000","last_clean_scrub_stamp":"2023-12-12T09:43:20.054829+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T17:30:20.028086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-12-12T09:43:23.511894+0000","last_change":"2023-12-12T09:43:22.272912+0000","last_active":"2023-12-12T09:43:23.511894+0000","last_peered":"2023-12-12T09:43:23.511894+0000","last_clean":"2023-12-12T09:43:23.511894+0000","last_became_active":"2023-12-12T09:43:22.272617+0000","last_became_peered":"2023-12-12T09:43:22.272617+0000","last_unstale":"2023-12-12T09:43:23.511894+0000","last_undegraded":"2023-12-12T09:43:23.511894+0000","last_fullsized":"2023-12-12T09:43:23.511894+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_clean_scrub_stamp":"2023-12-12T09:43:21.241417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T19:29:30.599215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-12-12T09:43:23.511681+0000","last_change":"2023-12-12T09:43:21.300937+0000","last_active":"2023-12-12T09:43:23.511681+0000","last_peered":"2023-12-12T09:43:23.511681+0000","last_clean":"2023-12-12T09:43:23.511681+0000","last_became_active":"2023-12-12T09:43:21.300601+0000","last_became_peered":"2023-12-12T09:43:21.300601+0000","last_unstale":"2023-12-12T09:43:23.511681+0000","last_undegraded":"2023-12-12T09:43:23.511681+0000","last_fullsized":"2023-12-12T09:43:23.511681+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:43:20.054829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:43:20.054829+0000","last_clean_scrub_stamp":"2023-12-12T09:43:20.054829+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T21:27:10.922205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-12-12T09:43:23.509615+0000","last_change":"2023-12-12T09:43:22.252774+0000","last_active":"2023-12-12T09:43:23.509615+0000","last_peered":"2023-12-12T09:43:23.509615+0000","last_clean":"2023-12-12T09:43:23.509615+0000","last_became_active":"2023-12-12T09:43:22.252296+0000","last_became_peered":"2023-12-12T09:43:22.252296+0000","last_unstale":"2023-12-12T09:43:23.509615+0000","last_undegraded":"2023-12-12T09:43:23.509615+0000","last_fullsized":"2023-12-12T09:43:23.509615+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_clean_scrub_stamp":"2023-12-12T09:43:21.241417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T20:33:00.500338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-12-12T09:43:23.510762+0000","last_change":"2023-12-12T09:43:21.291232+0000","last_active":"2023-12-12T09:43:23.510762+0000","last_peered":"2023-12-12T09:43:23.510762+0000","last_clean":"2023-12-12T09:43:23.510762+0000","last_became_active":"2023-12-12T09:43:21.290905+0000","last_became_peered":"2023-12-12T09:43:21.290905+0000","last_unstale":"2023-12-12T09:43:23.510762+0000","last_undegraded":"2023-12-12T09:43:23.510762+0000","last_fullsized":"2023-12-12T09:43:23.510762+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:43:20.054829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:43:20.054829+0000","last_clean_scrub_stamp":"2023-12-12T09:43:20.054829+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T17:12:57.858301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-12-12T09:43:23.228577+0000","last_change":"2023-12-12T09:43:22.247541+0000","last_active":"2023-12-12T09:43:23.228577+0000","last_peered":"2023-12-12T09:43:23.228577+0000","last_clean":"2023-12-12T09:43:23.228577+0000","last_became_active":"2023-12-12T09:43:22.247160+0000","last_became_peered":"2023-12-12T09:43:22.247160+0000","last_unstale":"2023-12-12T09:43:23.228577+0000","last_undegraded":"2023-12-12T09:43:23.228577+0000","last_fullsized":"2023-12-12T09:43:23.228577+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_clean_scrub_stamp":"2023-12-12T09:43:21.241417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T19:29:30.599215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-12-12T09:43:23.232670+0000","last_change":"2023-12-12T09:43:21.292842+0000","last_active":"2023-12-12T09:43:23.232670+0000","last_peered":"2023-12-12T09:43:23.232670+0000","last_clean":"2023-12-12T09:43:23.232670+0000","last_became_active":"2023-12-12T09:43:21.292525+0000","last_became_peered":"2023-12-12T09:43:21.292525+0000","last_unstale":"2023-12-12T09:43:23.232670+0000","last_undegraded":"2023-12-12T09:43:23.232670+0000","last_fullsized":"2023-12-12T09:43:23.232670+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:43:20.054829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:43:20.054829+0000","last_clean_scrub_stamp":"2023-12-12T09:43:20.054829+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T18:28:40.746959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-12-12T09:43:23.511003+0000","last_change":"2023-12-12T09:43:22.255350+0000","last_active":"2023-12-12T09:43:23.511003+0000","last_peered":"2023-12-12T09:43:23.511003+0000","last_clean":"2023-12-12T09:43:23.511003+0000","last_became_active":"2023-12-12T09:43:22.253699+0000","last_became_peered":"2023-12-12T09:43:22.253699+0000","last_unstale":"2023-12-12T09:43:23.511003+0000","last_undegraded":"2023-12-12T09:43:23.511003+0000","last_fullsized":"2023-12-12T09:43:23.511003+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_clean_scrub_stamp":"2023-12-12T09:43:21.241417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T10:41:14.691881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-12-12T09:43:23.228484+0000","last_change":"2023-12-12T09:43:21.275987+0000","last_active":"2023-12-12T09:43:23.228484+0000","last_peered":"2023-12-12T09:43:23.228484+0000","last_clean":"2023-12-12T09:43:23.228484+0000","last_became_active":"2023-12-12T09:43:21.274563+0000","last_became_peered":"2023-12-12T09:43:21.274563+0000","last_unstale":"2023-12-12T09:43:23.228484+0000","last_undegraded":"2023-12-12T09:43:23.228484+0000","last_fullsized":"2023-12-12T09:43:23.228484+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:43:20.054829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:43:20.054829+0000","last_clean_scrub_stamp":"2023-12-12T09:43:20.054829+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T21:27:10.922205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-12-12T09:43:23.233263+0000","last_change":"2023-12-12T09:43:22.270432+0000","last_active":"2023-12-12T09:43:23.233263+0000","last_peered":"2023-12-12T09:43:23.233263+0000","last_clean":"2023-12-12T09:43:23.233263+0000","last_became_active":"2023-12-12T09:43:22.265195+0000","last_became_peered":"2023-12-12T09:43:22.265195+0000","last_unstale":"2023-12-12T09:43:23.233263+0000","last_undegraded":"2023-12-12T09:43:23.233263+0000","last_fullsized":"2023-12-12T09:43:23.233263+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_clean_scrub_stamp":"2023-12-12T09:43:21.241417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T13:12:59.364006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-12-12T09:43:23.512702+0000","last_change":"2023-12-12T09:43:21.305016+0000","last_active":"2023-12-12T09:43:23.512702+0000","last_peered":"2023-12-12T09:43:23.512702+0000","last_clean":"2023-12-12T09:43:23.512702+0000","last_became_active":"2023-12-12T09:43:21.302634+0000","last_became_peered":"2023-12-12T09:43:21.302634+0000","last_unstale":"2023-12-12T09:43:23.512702+0000","last_undegraded":"2023-12-12T09:43:23.512702+0000","last_fullsized":"2023-12-12T09:43:23.512702+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:43:20.054829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:43:20.054829+0000","last_clean_scrub_stamp":"2023-12-12T09:43:20.054829+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T19:41:08.951158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-12-12T09:43:23.228598+0000","last_change":"2023-12-12T09:43:22.249130+0000","last_active":"2023-12-12T09:43:23.228598+0000","last_peered":"2023-12-12T09:43:23.228598+0000","last_clean":"2023-12-12T09:43:23.228598+0000","last_became_active":"2023-12-12T09:43:22.248797+0000","last_became_peered":"2023-12-12T09:43:22.248797+0000","last_unstale":"2023-12-12T09:43:23.228598+0000","last_undegraded":"2023-12-12T09:43:23.228598+0000","last_fullsized":"2023-12-12T09:43:23.228598+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_clean_scrub_stamp":"2023-12-12T09:43:21.241417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T17:19:30.590382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"21'1","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-12-12T09:43:24.494095+0000","last_change":"2023-12-12T09:43:21.299170+0000","last_active":"2023-12-12T09:43:24.494095+0000","last_peered":"2023-12-12T09:43:24.494095+0000","last_clean":"2023-12-12T09:43:24.494095+0000","last_became_active":"2023-12-12T09:43:21.298879+0000","last_became_peered":"2023-12-12T09:43:21.298879+0000","last_unstale":"2023-12-12T09:43:24.494095+0000","last_undegraded":"2023-12-12T09:43:24.494095+0000","last_fullsized":"2023-12-12T09:43:24.494095+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:43:20.054829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:43:20.054829+0000","last_clean_scrub_stamp":"2023-12-12T09:43:20.054829+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T14:02:28.705261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-12-12T09:43:23.512630+0000","last_change":"2023-12-12T09:43:22.261674+0000","last_active":"2023-12-12T09:43:23.512630+0000","last_peered":"2023-12-12T09:43:23.512630+0000","last_clean":"2023-12-12T09:43:23.512630+0000","last_became_active":"2023-12-12T09:43:22.261405+0000","last_became_peered":"2023-12-12T09:43:22.261405+0000","last_unstale":"2023-12-12T09:43:23.512630+0000","last_undegraded":"2023-12-12T09:43:23.512630+0000","last_fullsized":"2023-12-12T09:43:23.512630+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_clean_scrub_stamp":"2023-12-12T09:43:21.241417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T19:41:10.137746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-12-12T09:43:23.235503+0000","last_change":"2023-12-12T09:43:21.304624+0000","last_active":"2023-12-12T09:43:23.235503+0000","last_peered":"2023-12-12T09:43:23.235503+0000","last_clean":"2023-12-12T09:43:23.235503+0000","last_became_active":"2023-12-12T09:43:21.304305+0000","last_became_peered":"2023-12-12T09:43:21.304305+0000","last_unstale":"2023-12-12T09:43:23.235503+0000","last_undegraded":"2023-12-12T09:43:23.235503+0000","last_fullsized":"2023-12-12T09:43:23.235503+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:43:20.054829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:43:20.054829+0000","last_clean_scrub_stamp":"2023-12-12T09:43:20.054829+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T11:24:10.894411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-12-12T09:43:23.512203+0000","last_change":"2023-12-12T09:43:22.260743+0000","last_active":"2023-12-12T09:43:23.512203+0000","last_peered":"2023-12-12T09:43:23.512203+0000","last_clean":"2023-12-12T09:43:23.512203+0000","last_became_active":"2023-12-12T09:43:22.260367+0000","last_became_peered":"2023-12-12T09:43:22.260367+0000","last_unstale":"2023-12-12T09:43:23.512203+0000","last_undegraded":"2023-12-12T09:43:23.512203+0000","last_fullsized":"2023-12-12T09:43:23.512203+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_clean_scrub_stamp":"2023-12-12T09:43:21.241417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T19:29:30.599215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-12-12T09:43:23.511691+0000","last_change":"2023-12-12T09:43:21.301133+0000","last_active":"2023-12-12T09:43:23.511691+0000","last_peered":"2023-12-12T09:43:23.511691+0000","last_clean":"2023-12-12T09:43:23.511691+0000","last_became_active":"2023-12-12T09:43:21.300231+0000","last_became_peered":"2023-12-12T09:43:21.300231+0000","last_unstale":"2023-12-12T09:43:23.511691+0000","last_undegraded":"2023-12-12T09:43:23.511691+0000","last_fullsized":"2023-12-12T09:43:23.511691+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:43:20.054829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:43:20.054829+0000","last_clean_scrub_stamp":"2023-12-12T09:43:20.054829+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T10:41:13.505292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-12-12T09:43:23.510712+0000","last_change":"2023-12-12T09:43:22.260117+0000","last_active":"2023-12-12T09:43:23.510712+0000","last_peered":"2023-12-12T09:43:23.510712+0000","last_clean":"2023-12-12T09:43:23.510712+0000","last_became_active":"2023-12-12T09:43:22.255443+0000","last_became_peered":"2023-12-12T09:43:22.255443+0000","last_unstale":"2023-12-12T09:43:23.510712+0000","last_undegraded":"2023-12-12T09:43:23.510712+0000","last_fullsized":"2023-12-12T09:43:23.510712+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_clean_scrub_stamp":"2023-12-12T09:43:21.241417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T20:43:18.528147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-12-12T09:43:23.228536+0000","last_change":"2023-12-12T09:43:21.281650+0000","last_active":"2023-12-12T09:43:23.228536+0000","last_peered":"2023-12-12T09:43:23.228536+0000","last_clean":"2023-12-12T09:43:23.228536+0000","last_became_active":"2023-12-12T09:43:21.281353+0000","last_became_peered":"2023-12-12T09:43:21.281353+0000","last_unstale":"2023-12-12T09:43:23.228536+0000","last_undegraded":"2023-12-12T09:43:23.228536+0000","last_fullsized":"2023-12-12T09:43:23.228536+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:43:20.054829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:43:20.054829+0000","last_clean_scrub_stamp":"2023-12-12T09:43:20.054829+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T10:41:13.505292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-12-12T09:43:23.512382+0000","last_change":"2023-12-12T09:43:22.255511+0000","last_active":"2023-12-12T09:43:23.512382+0000","last_peered":"2023-12-12T09:43:23.512382+0000","last_clean":"2023-12-12T09:43:23.512382+0000","last_became_active":"2023-12-12T09:43:22.255187+0000","last_became_peered":"2023-12-12T09:43:22.255187+0000","last_unstale":"2023-12-12T09:43:23.512382+0000","last_undegraded":"2023-12-12T09:43:23.512382+0000","last_fullsized":"2023-12-12T09:43:23.512382+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_clean_scrub_stamp":"2023-12-12T09:43:21.241417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T13:28:21.176910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-12-12T09:43:23.228903+0000","last_change":"2023-12-12T09:43:21.291624+0000","last_active":"2023-12-12T09:43:23.228903+0000","last_peered":"2023-12-12T09:43:23.228903+0000","last_clean":"2023-12-12T09:43:23.228903+0000","last_became_active":"2023-12-12T09:43:21.291410+0000","last_became_peered":"2023-12-12T09:43:21.291410+0000","last_unstale":"2023-12-12T09:43:23.228903+0000","last_undegraded":"2023-12-12T09:43:23.228903+0000","last_fullsized":"2023-12-12T09:43:23.228903+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:43:20.054829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:43:20.054829+0000","last_clean_scrub_stamp":"2023-12-12T09:43:20.054829+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T20:43:17.341558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-12-12T09:43:23.514113+0000","last_change":"2023-12-12T09:43:22.250477+0000","last_active":"2023-12-12T09:43:23.514113+0000","last_peered":"2023-12-12T09:43:23.514113+0000","last_clean":"2023-12-12T09:43:23.514113+0000","last_became_active":"2023-12-12T09:43:22.250114+0000","last_became_peered":"2023-12-12T09:43:22.250114+0000","last_unstale":"2023-12-12T09:43:23.514113+0000","last_undegraded":"2023-12-12T09:43:23.514113+0000","last_fullsized":"2023-12-12T09:43:23.514113+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_clean_scrub_stamp":"2023-12-12T09:43:21.241417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T11:24:46.660535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-12-12T09:43:23.512859+0000","last_change":"2023-12-12T09:43:21.300810+0000","last_active":"2023-12-12T09:43:23.512859+0000","last_peered":"2023-12-12T09:43:23.512859+0000","last_clean":"2023-12-12T09:43:23.512859+0000","last_became_active":"2023-12-12T09:43:21.300476+0000","last_became_peered":"2023-12-12T09:43:21.300476+0000","last_unstale":"2023-12-12T09:43:23.512859+0000","last_undegraded":"2023-12-12T09:43:23.512859+0000","last_fullsized":"2023-12-12T09:43:23.512859+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:43:20.054829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:43:20.054829+0000","last_clean_scrub_stamp":"2023-12-12T09:43:20.054829+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T20:32:59.313749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-12-12T09:43:23.235201+0000","last_change":"2023-12-12T09:43:22.254797+0000","last_active":"2023-12-12T09:43:23.235201+0000","last_peered":"2023-12-12T09:43:23.235201+0000","last_clean":"2023-12-12T09:43:23.235201+0000","last_became_active":"2023-12-12T09:43:22.254482+0000","last_became_peered":"2023-12-12T09:43:22.254482+0000","last_unstale":"2023-12-12T09:43:23.235201+0000","last_undegraded":"2023-12-12T09:43:23.235201+0000","last_fullsized":"2023-12-12T09:43:23.235201+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_clean_scrub_stamp":"2023-12-12T09:43:21.241417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T19:29:30.599215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-12-12T09:43:23.232655+0000","last_change":"2023-12-12T09:43:22.256918+0000","last_active":"2023-12-12T09:43:23.232655+0000","last_peered":"2023-12-12T09:43:23.232655+0000","last_clean":"2023-12-12T09:43:23.232655+0000","last_became_active":"2023-12-12T09:43:22.256575+0000","last_became_peered":"2023-12-12T09:43:22.256575+0000","last_unstale":"2023-12-12T09:43:23.232655+0000","last_undegraded":"2023-12-12T09:43:23.232655+0000","last_fullsized":"2023-12-12T09:43:23.232655+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_clean_scrub_stamp":"2023-12-12T09:43:21.241417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T11:24:46.660535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-12-12T09:43:23.512318+0000","last_change":"2023-12-12T09:43:21.300710+0000","last_active":"2023-12-12T09:43:23.512318+0000","last_peered":"2023-12-12T09:43:23.512318+0000","last_clean":"2023-12-12T09:43:23.512318+0000","last_became_active":"2023-12-12T09:43:21.300311+0000","last_became_peered":"2023-12-12T09:43:21.300311+0000","last_unstale":"2023-12-12T09:43:23.512318+0000","last_undegraded":"2023-12-12T09:43:23.512318+0000","last_fullsized":"2023-12-12T09:43:23.512318+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:43:20.054829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:43:20.054829+0000","last_clean_scrub_stamp":"2023-12-12T09:43:20.054829+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T14:02:28.705261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-12-12T09:43:23.232804+0000","last_change":"2023-12-12T09:43:22.257472+0000","last_active":"2023-12-12T09:43:23.232804+0000","last_peered":"2023-12-12T09:43:23.232804+0000","last_clean":"2023-12-12T09:43:23.232804+0000","last_became_active":"2023-12-12T09:43:22.250225+0000","last_became_peered":"2023-12-12T09:43:22.250225+0000","last_unstale":"2023-12-12T09:43:23.232804+0000","last_undegraded":"2023-12-12T09:43:23.232804+0000","last_fullsized":"2023-12-12T09:43:23.232804+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_clean_scrub_stamp":"2023-12-12T09:43:21.241417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T20:26:35.861125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-12-12T09:43:23.512528+0000","last_change":"2023-12-12T09:43:21.306307+0000","last_active":"2023-12-12T09:43:23.512528+0000","last_peered":"2023-12-12T09:43:23.512528+0000","last_clean":"2023-12-12T09:43:23.512528+0000","last_became_active":"2023-12-12T09:43:21.305903+0000","last_became_peered":"2023-12-12T09:43:21.305903+0000","last_unstale":"2023-12-12T09:43:23.512528+0000","last_undegraded":"2023-12-12T09:43:23.512528+0000","last_fullsized":"2023-12-12T09:43:23.512528+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:43:20.054829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:43:20.054829+0000","last_clean_scrub_stamp":"2023-12-12T09:43:20.054829+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T11:56:41.908755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-12-12T09:43:23.513534+0000","last_change":"2023-12-12T09:43:22.274288+0000","last_active":"2023-12-12T09:43:23.513534+0000","last_peered":"2023-12-12T09:43:23.513534+0000","last_clean":"2023-12-12T09:43:23.513534+0000","last_became_active":"2023-12-12T09:43:22.273968+0000","last_became_peered":"2023-12-12T09:43:22.273968+0000","last_unstale":"2023-12-12T09:43:23.513534+0000","last_undegraded":"2023-12-12T09:43:23.513534+0000","last_fullsized":"2023-12-12T09:43:23.513534+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_clean_scrub_stamp":"2023-12-12T09:43:21.241417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T10:52:36.164447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-12-12T09:43:23.513171+0000","last_change":"2023-12-12T09:43:21.295200+0000","last_active":"2023-12-12T09:43:23.513171+0000","last_peered":"2023-12-12T09:43:23.513171+0000","last_clean":"2023-12-12T09:43:23.513171+0000","last_became_active":"2023-12-12T09:43:21.294908+0000","last_became_peered":"2023-12-12T09:43:21.294908+0000","last_unstale":"2023-12-12T09:43:23.513171+0000","last_undegraded":"2023-12-12T09:43:23.513171+0000","last_fullsized":"2023-12-12T09:43:23.513171+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:43:20.054829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:43:20.054829+0000","last_clean_scrub_stamp":"2023-12-12T09:43:20.054829+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T20:32:59.313749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-12-12T09:43:23.512766+0000","last_change":"2023-12-12T09:43:22.256556+0000","last_active":"2023-12-12T09:43:23.512766+0000","last_peered":"2023-12-12T09:43:23.512766+0000","last_clean":"2023-12-12T09:43:23.512766+0000","last_became_active":"2023-12-12T09:43:22.256166+0000","last_became_peered":"2023-12-12T09:43:22.256166+0000","last_unstale":"2023-12-12T09:43:23.512766+0000","last_undegraded":"2023-12-12T09:43:23.512766+0000","last_fullsized":"2023-12-12T09:43:23.512766+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:43:21.241417+0000","last_clean_scrub_stamp":"2023-12-12T09:43:21.241417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T13:22:21.650455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"20'4","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-12-12T09:43:23.514113+0000","last_change":"2023-12-12T09:43:21.296519+0000","last_active":"2023-12-12T09:43:23.514113+0000","last_peered":"2023-12-12T09:43:23.514113+0000","last_clean":"2023-12-12T09:43:23.514113+0000","last_became_active":"2023-12-12T09:43:21.296221+0000","last_became_peered":"2023-12-12T09:43:21.296221+0000","last_unstale":"2023-12-12T09:43:23.514113+0000","last_undegraded":"2023-12-12T09:43:23.514113+0000","last_fullsized":"2023-12-12T09:43:23.514113+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:43:20.054829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:43:20.054829+0000","last_clean_scrub_stamp":"2023-12-12T09:43:20.054829+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T21:27:10.922205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":64844,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574855,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27320,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344520,"statfs":{"total":96636764160,"available":96608788480,"internally_reserved":0,"allocated":286720,"data_stored":666531,"data_compressed":32422,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80000000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.429}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1859999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.242}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3720000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6659999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.742}]}]},{"osd":6,"up_from":13,"seq":55834574853,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":229376,"data_stored":77193,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79800000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0169999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.222}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.268}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.587}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3180000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.552}]}]},{"osd":5,"up_from":13,"seq":55834574853,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":221184,"data_stored":75671,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96799999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2609999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.579}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.625}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6830000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.296}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.746}]}]},{"osd":4,"up_from":13,"seq":55834574855,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":229376,"data_stored":75707,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.754}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81200000000000006}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2090000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0649999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.268}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.397}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.444}]}]},{"osd":3,"up_from":13,"seq":55834574853,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":229376,"data_stored":77193,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0129999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4610000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.0899999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.3130000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0940000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.0219999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.5299999999999998}]}]},{"osd":2,"up_from":13,"seq":55834574853,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":75581,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.226}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92600000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2030000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.129}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.266}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.306}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3500000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574853,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":225280,"data_stored":75741,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.794}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":6.3390000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.7519999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":6.423}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":6.2830000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":6.468}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.177}]}]},{"osd":0,"up_from":13,"seq":55834574855,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27328,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344512,"statfs":{"total":96636764160,"available":96608780288,"internally_reserved":0,"allocated":294912,"data_stored":666587,"data_compressed":32422,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97599999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55800000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.179}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91300000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3740000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2430000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32422,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32422,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-12T09:43:32.675 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-12-12T09:43:32.675 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2023-12-12T09:43:32.675 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2023-12-12T09:43:32.675 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-12-12T09:43:32.921 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:32.921+0000 7fe9b7abb640 1 Processor -- start 2023-12-12T09:43:32.921 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:32.921+0000 7fe9b7abb640 1 -- start start 2023-12-12T09:43:32.922 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:32.922+0000 7fe9b7abb640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe9b01552e0 0x7fe9b00c49c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:32.923 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:32.923+0000 7fe9b7abb640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fe9b006bf20 0x7fe9b00a9760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:32.923 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:32.923+0000 7fe9b7abb640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9b00c0b50 con 0x7fe9b00a50f0 2023-12-12T09:43:32.923 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:32.923+0000 7fe9b7abb640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9b00c04d0 con 0x7fe9b006bf20 2023-12-12T09:43:32.923 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:32.923+0000 7fe9b7abb640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9b006c880 con 0x7fe9b01552e0 2023-12-12T09:43:32.924 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:32.923+0000 7fe9b6058640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fe9b006bf20 0x7fe9b00a9760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:32.924 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:32.923+0000 7fe9b5857640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe9b01552e0 0x7fe9b00c49c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:32.924 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:32.923+0000 7fe9b6058640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fe9b006bf20 0x7fe9b00a9760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.73:43624/0 (socket says 172.21.15.73:43624) 2023-12-12T09:43:32.924 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:32.923+0000 7fe9b6058640 1 -- 172.21.15.73:0/1519983353 learned_addr learned my addr 172.21.15.73:0/1519983353 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:43:32.924 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:32.924+0000 7fe9b6058640 1 -- 172.21.15.73:0/1519983353 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe9b01552e0 msgr2=0x7fe9b00c49c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:43:32.924 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:32.924+0000 7fe9b6058640 1 --2- 172.21.15.73:0/1519983353 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe9b01552e0 0x7fe9b00c49c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:32.924 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:32.924+0000 7fe9b6058640 1 -- 172.21.15.73:0/1519983353 >> v1:172.21.15.142:6789/0 conn(0x7fe9b00a50f0 legacy=0x7fe9b00a9050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:32.924 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:32.924+0000 7fe9b6058640 1 -- 172.21.15.73:0/1519983353 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9b006cb60 con 0x7fe9b006bf20 2023-12-12T09:43:32.925 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:32.925+0000 7fe9b6058640 1 --2- 172.21.15.73:0/1519983353 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe9b006bf20 0x7fe9b00a9760 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fe9a8009e50 tx=0x7fe9a802bed0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=96de533ce0deacee server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:43:32.925 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:32.926+0000 7fe9b4855640 1 -- 172.21.15.73:0/1519983353 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9a802ca70 con 0x7fe9b006bf20 2023-12-12T09:43:32.925 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:32.926+0000 7fe9b4855640 1 -- 172.21.15.73:0/1519983353 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9a802cbd0 con 0x7fe9b006bf20 2023-12-12T09:43:32.925 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:32.926+0000 7fe9b4855640 1 -- 172.21.15.73:0/1519983353 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9a80343f0 con 0x7fe9b006bf20 2023-12-12T09:43:32.926 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:32.926+0000 7fe9b7abb640 1 -- 172.21.15.73:0/1519983353 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe9b006bf20 msgr2=0x7fe9b00a9760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:32.926 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:32.926+0000 7fe9b7abb640 1 --2- 172.21.15.73:0/1519983353 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe9b006bf20 0x7fe9b00a9760 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fe9a8009e50 tx=0x7fe9a802bed0 comp rx=0 tx=0).stop 2023-12-12T09:43:32.926 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:32.926+0000 7fe9b7abb640 1 -- 172.21.15.73:0/1519983353 shutdown_connections 2023-12-12T09:43:32.926 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:32.926+0000 7fe9b7abb640 1 --2- 172.21.15.73:0/1519983353 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe9b006bf20 0x7fe9b00a9760 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:32.927 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:32.926+0000 7fe9b7abb640 1 --2- 172.21.15.73:0/1519983353 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe9b01552e0 0x7fe9b00c49c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:32.927 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:32.926+0000 7fe9b7abb640 1 -- 172.21.15.73:0/1519983353 >> 172.21.15.73:0/1519983353 conn(0x7fe9b00a8130 msgr2=0x7fe9b00c24b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:43:32.927 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:32.926+0000 7fe9b7abb640 1 -- 172.21.15.73:0/1519983353 shutdown_connections 2023-12-12T09:43:32.927 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:32.926+0000 7fe9b7abb640 1 -- 172.21.15.73:0/1519983353 wait complete. 2023-12-12T09:43:32.928 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:32.928+0000 7fe9b7abb640 1 Processor -- start 2023-12-12T09:43:32.929 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:32.929+0000 7fe9b7abb640 1 -- start start 2023-12-12T09:43:32.931 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:32.930+0000 7fe9b7abb640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe9b006bf20 0x7fe9b014cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:32.931 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:32.930+0000 7fe9b7abb640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe9b00a50f0 0x7fe9b01deef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:32.931 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:32.930+0000 7fe9b7abb640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe9b01552e0 0x7fe9b00a9840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:32.931 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:32.930+0000 7fe9b7abb640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9b014d050 con 0x7fe9b006bf20 2023-12-12T09:43:32.931 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:32.930+0000 7fe9b7abb640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9b01ea470 con 0x7fe9b00a50f0 2023-12-12T09:43:32.931 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:32.930+0000 7fe9b7abb640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9b014b4b0 con 0x7fe9b01552e0 2023-12-12T09:43:32.931 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:32.930+0000 7fe9b5857640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe9b006bf20 0x7fe9b014cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:32.932 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:32.930+0000 7fe9b5857640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe9b006bf20 0x7fe9b014cb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:56836/0 (socket says 172.21.15.73:56836) 2023-12-12T09:43:32.932 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:32.930+0000 7fe9b5857640 1 -- 172.21.15.73:0/64116147 learned_addr learned my addr 172.21.15.73:0/64116147 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:43:32.932 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:32.930+0000 7fe9b5056640 1 --2- 172.21.15.73:0/64116147 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe9b00a50f0 0x7fe9b01deef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:32.932 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:32.930+0000 7fe9b5857640 1 -- 172.21.15.73:0/64116147 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe9b01552e0 msgr2=0x7fe9b00a9840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:32.932 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:32.930+0000 7fe9b5857640 1 --2- 172.21.15.73:0/64116147 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe9b01552e0 0x7fe9b00a9840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:32.932 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:32.930+0000 7fe9b5857640 1 -- 172.21.15.73:0/64116147 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe9b00a50f0 msgr2=0x7fe9b01deef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:32.932 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:32.931+0000 7fe9b5857640 1 --2- 172.21.15.73:0/64116147 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe9b00a50f0 0x7fe9b01deef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:32.932 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:32.931+0000 7fe9b5857640 1 -- 172.21.15.73:0/64116147 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9a8009b30 con 0x7fe9b006bf20 2023-12-12T09:43:32.932 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:32.931+0000 7fe9b5857640 1 --2- 172.21.15.73:0/64116147 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe9b006bf20 0x7fe9b014cb10 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fe9ac00e870 tx=0x7fe9ac00ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:43:32.932 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:32.931+0000 7fe9a67fc640 1 -- 172.21.15.73:0/64116147 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9ac0094f0 con 0x7fe9b006bf20 2023-12-12T09:43:32.932 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:32.931+0000 7fe9a67fc640 1 -- 172.21.15.73:0/64116147 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9ac00c8e0 con 0x7fe9b006bf20 2023-12-12T09:43:32.932 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:32.931+0000 7fe9b7abb640 1 -- 172.21.15.73:0/64116147 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9b00a93b0 con 0x7fe9b006bf20 2023-12-12T09:43:32.932 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:32.931+0000 7fe9a67fc640 1 -- 172.21.15.73:0/64116147 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9ac00cc90 con 0x7fe9b006bf20 2023-12-12T09:43:32.932 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:32.931+0000 7fe9b7abb640 1 -- 172.21.15.73:0/64116147 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9b01ea940 con 0x7fe9b006bf20 2023-12-12T09:43:32.933 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:32.932+0000 7fe9b7abb640 1 -- 172.21.15.73:0/64116147 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe9b0067580 con 0x7fe9b006bf20 2023-12-12T09:43:32.933 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:32.933+0000 7fe9a67fc640 1 -- 172.21.15.73:0/64116147 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fe9ac013470 con 0x7fe9b006bf20 2023-12-12T09:43:32.933 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:32.934+0000 7fe9a67fc640 1 --2- 172.21.15.73:0/64116147 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fe99406ae70 0x7fe99406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:32.934 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:32.934+0000 7fe9a67fc640 1 -- 172.21.15.73:0/64116147 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe9ac089590 con 0x7fe9b006bf20 2023-12-12T09:43:32.934 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:32.934+0000 7fe9b5056640 1 --2- 172.21.15.73:0/64116147 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fe99406ae70 0x7fe99406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:32.934 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:32.935+0000 7fe9b5056640 1 --2- 172.21.15.73:0/64116147 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fe99406ae70 0x7fe99406d330 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fe9b00a4c30 tx=0x7fe9a0009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:43:32.938 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:32.938+0000 7fe9a67fc640 1 -- 172.21.15.73:0/64116147 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fe9ac0546d0 con 0x7fe9b006bf20 2023-12-12T09:43:33.148 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:33.148+0000 7fe9b7abb640 1 -- 172.21.15.73:0/64116147 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fe9b006ddd0 con 0x7fe9b006bf20 2023-12-12T09:43:33.149 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:33.149+0000 7fe9a67fc640 1 -- 172.21.15.73:0/64116147 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7fe9ac057cf0 con 0x7fe9b006bf20 2023-12-12T09:43:33.149 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-12T09:43:33.149 INFO:teuthology.orchestra.run.smithi073.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2023-12-12T09:43:33.151 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:33.151+0000 7fe9b7abb640 1 -- 172.21.15.73:0/64116147 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fe99406ae70 msgr2=0x7fe99406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:33.151 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:33.151+0000 7fe9b7abb640 1 --2- 172.21.15.73:0/64116147 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fe99406ae70 0x7fe99406d330 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fe9b00a4c30 tx=0x7fe9a0009040 comp rx=0 tx=0).stop 2023-12-12T09:43:33.152 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:33.151+0000 7fe9b7abb640 1 -- 172.21.15.73:0/64116147 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe9b006bf20 msgr2=0x7fe9b014cb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:33.152 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:33.151+0000 7fe9b7abb640 1 --2- 172.21.15.73:0/64116147 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe9b006bf20 0x7fe9b014cb10 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fe9ac00e870 tx=0x7fe9ac00ed30 comp rx=0 tx=0).stop 2023-12-12T09:43:33.152 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:33.151+0000 7fe9b7abb640 1 -- 172.21.15.73:0/64116147 shutdown_connections 2023-12-12T09:43:33.152 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:33.151+0000 7fe9b7abb640 1 --2- 172.21.15.73:0/64116147 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fe99406ae70 0x7fe99406d330 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:33.152 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:33.151+0000 7fe9b7abb640 1 --2- 172.21.15.73:0/64116147 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe9b01552e0 0x7fe9b00a9840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:33.152 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:33.151+0000 7fe9b7abb640 1 --2- 172.21.15.73:0/64116147 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe9b00a50f0 0x7fe9b01deef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:33.152 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:33.151+0000 7fe9b7abb640 1 --2- 172.21.15.73:0/64116147 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe9b006bf20 0x7fe9b014cb10 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:33.152 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:33.151+0000 7fe9b7abb640 1 -- 172.21.15.73:0/64116147 >> 172.21.15.73:0/64116147 conn(0x7fe9b00a8130 msgr2=0x7fe9b00c0d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:43:33.152 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:33.152+0000 7fe9b7abb640 1 -- 172.21.15.73:0/64116147 shutdown_connections 2023-12-12T09:43:33.152 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:33.152+0000 7fe9b7abb640 1 -- 172.21.15.73:0/64116147 wait complete. 2023-12-12T09:43:33.170 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2023-12-12T09:43:33.170 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-12T09:43:33.373 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:33.373+0000 7f101487c640 1 Processor -- start 2023-12-12T09:43:33.374 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:33.373+0000 7f101487c640 1 -- start start 2023-12-12T09:43:33.375 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:33.375+0000 7f101487c640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f101006bf20 0x7f10100a9760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:33.375 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:33.375+0000 7f101487c640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10100c0b50 con 0x7f10100a50f0 2023-12-12T09:43:33.375 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:33.375+0000 7f101487c640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f101006c880 con 0x7f10101552e0 2023-12-12T09:43:33.375 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:33.375+0000 7f101487c640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10100c04d0 con 0x7f101006bf20 2023-12-12T09:43:33.375 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:33.375+0000 7f1007fff640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f10100a50f0 0x7f10100a9050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:34416/0 (socket says 172.21.15.73:34416) 2023-12-12T09:43:33.376 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:33.375+0000 7f1007fff640 1 -- 172.21.15.73:0/497262175 learned_addr learned my addr 172.21.15.73:0/497262175 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-12T09:43:33.377 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:33.376+0000 7f100ed9d640 1 --2- 172.21.15.73:0/497262175 >> v2:172.21.15.142:3300/0 conn(0x7f101006bf20 0x7f10100a9760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:33.378 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:33.376+0000 7f100dd9b640 1 -- 172.21.15.73:0/497262175 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 200742314 0 0) 0x7f10100c0b50 con 0x7f10100a50f0 2023-12-12T09:43:33.378 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:33.376+0000 7f100dd9b640 1 -- 172.21.15.73:0/497262175 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0ffc003520 con 0x7f10100a50f0 2023-12-12T09:43:33.378 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:33.376+0000 7f100dd9b640 1 -- 172.21.15.73:0/497262175 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 90540689 0 0) 0x7f0ffc003520 con 0x7f10100a50f0 2023-12-12T09:43:33.378 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:33.376+0000 7f100dd9b640 1 -- 172.21.15.73:0/497262175 >> v2:172.21.15.142:3300/0 conn(0x7f101006bf20 msgr2=0x7f10100a9760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:43:33.378 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:33.376+0000 7f100dd9b640 1 --2- 172.21.15.73:0/497262175 >> v2:172.21.15.142:3300/0 conn(0x7f101006bf20 0x7f10100a9760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:33.378 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:33.376+0000 7f100dd9b640 1 -- 172.21.15.73:0/497262175 >> v1:172.21.15.142:6789/0 conn(0x7f10101552e0 legacy=0x7f10100c49c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:33.378 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:33.376+0000 7f100dd9b640 1 -- 172.21.15.73:0/497262175 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f101006cb60 con 0x7f10100a50f0 2023-12-12T09:43:33.378 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:33.376+0000 7f100dd9b640 1 -- 172.21.15.73:0/497262175 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3186547832 0 0) 0x7f0ff8001670 con 0x7f10100a50f0 2023-12-12T09:43:33.378 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:33.376+0000 7f100dd9b640 1 -- 172.21.15.73:0/497262175 >> v1:172.21.15.73:6789/0 conn(0x7f10100a50f0 legacy=0x7f10100a9050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:33.378 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:33.377+0000 7f100dd9b640 1 --2- 172.21.15.73:0/497262175 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0ffc003970 0x7f0ffc003d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:33.378 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:33.377+0000 7f100dd9b640 1 --2- 172.21.15.73:0/497262175 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0ffc004320 0x7f0ffc0047e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:33.378 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:33.377+0000 7f100dd9b640 1 --2- 172.21.15.73:0/497262175 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0ffc005080 0x7f0ffc00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:33.379 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:33.377+0000 7f100dd9b640 1 -- 172.21.15.73:0/497262175 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10100c04d0 con 0x7f0ffc003970 2023-12-12T09:43:33.379 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:33.377+0000 7f100dd9b640 1 -- 172.21.15.73:0/497262175 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ffc00bfd0 con 0x7f0ffc005080 2023-12-12T09:43:33.379 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:33.377+0000 7f100dd9b640 1 -- 172.21.15.73:0/497262175 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ffc00c190 con 0x7f0ffc004320 2023-12-12T09:43:33.379 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:33.377+0000 7f100e59c640 1 --2- 172.21.15.73:0/497262175 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0ffc003970 0x7f0ffc003d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:33.379 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:33.377+0000 7f1007fff640 1 --2- 172.21.15.73:0/497262175 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0ffc004320 0x7f0ffc0047e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:33.379 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:33.377+0000 7f100ed9d640 1 --2- 172.21.15.73:0/497262175 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0ffc005080 0x7f0ffc00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:33.379 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:33.377+0000 7f100e59c640 1 -- 172.21.15.73:0/497262175 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0ffc004320 msgr2=0x7f0ffc0047e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:43:33.379 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:33.377+0000 7f100e59c640 1 --2- 172.21.15.73:0/497262175 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0ffc004320 0x7f0ffc0047e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:33.379 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:33.377+0000 7f100e59c640 1 -- 172.21.15.73:0/497262175 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0ffc005080 msgr2=0x7f0ffc00b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:43:33.379 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:33.377+0000 7f100e59c640 1 --2- 172.21.15.73:0/497262175 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0ffc005080 0x7f0ffc00b980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:33.379 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:33.377+0000 7f100e59c640 1 -- 172.21.15.73:0/497262175 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ffc003520 con 0x7f0ffc003970 2023-12-12T09:43:33.380 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:33.377+0000 7f100ed9d640 1 -- 172.21.15.73:0/497262175 reap_dead start 2023-12-12T09:43:33.381 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:33.378+0000 7f100e59c640 1 --2- 172.21.15.73:0/497262175 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0ffc003970 0x7f0ffc003d50 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f1000001830 tx=0x7f0ffc0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22b9a61689a82cec server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:43:33.381 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:33.378+0000 7f100dd9b640 1 -- 172.21.15.73:0/497262175 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f100002f050 con 0x7f0ffc003970 2023-12-12T09:43:33.381 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:33.379+0000 7f100dd9b640 1 -- 172.21.15.73:0/497262175 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1000033610 con 0x7f0ffc003970 2023-12-12T09:43:33.381 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:33.379+0000 7f100dd9b640 1 -- 172.21.15.73:0/497262175 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10000339c0 con 0x7f0ffc003970 2023-12-12T09:43:33.381 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:33.379+0000 7f101487c640 1 -- 172.21.15.73:0/497262175 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0ffc003970 msgr2=0x7f0ffc003d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:33.381 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:33.379+0000 7f101487c640 1 --2- 172.21.15.73:0/497262175 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0ffc003970 0x7f0ffc003d50 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f1000001830 tx=0x7f0ffc0057f0 comp rx=0 tx=0).stop 2023-12-12T09:43:33.381 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:33.379+0000 7f101487c640 1 -- 172.21.15.73:0/497262175 shutdown_connections 2023-12-12T09:43:33.381 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:33.379+0000 7f101487c640 1 --2- 172.21.15.73:0/497262175 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0ffc003970 0x7f0ffc003d50 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:33.381 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:33.379+0000 7f101487c640 1 -- 172.21.15.73:0/497262175 >> 172.21.15.73:0/497262175 conn(0x7f10100a8130 msgr2=0x7f10100c24b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:43:33.381 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:33.379+0000 7f101487c640 1 -- 172.21.15.73:0/497262175 shutdown_connections 2023-12-12T09:43:33.381 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:33.379+0000 7f101487c640 1 -- 172.21.15.73:0/497262175 wait complete. 2023-12-12T09:43:33.381 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:33.381+0000 7f101487c640 1 Processor -- start 2023-12-12T09:43:33.382 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:33.381+0000 7f101487c640 1 -- start start 2023-12-12T09:43:33.383 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:33.382+0000 7f101487c640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0ffc003970 0x7f10100bede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:33.384 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:33.382+0000 7f101487c640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f10101e9f60 0x7f10101edb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:33.384 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:33.382+0000 7f101487c640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f10100bf320 0x7f1010145770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:33.384 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:33.382+0000 7f101487c640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10101ed750 con 0x7f10101e9f60 2023-12-12T09:43:33.384 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:33.382+0000 7f101487c640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10100a5e60 con 0x7f0ffc003970 2023-12-12T09:43:33.384 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:33.382+0000 7f101487c640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10100a60b0 con 0x7f10100bf320 2023-12-12T09:43:33.384 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:33.382+0000 7f1007fff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f10101e9f60 0x7f10101edb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:33.384 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:33.382+0000 7f1007fff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f10101e9f60 0x7f10101edb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:56846/0 (socket says 172.21.15.73:56846) 2023-12-12T09:43:33.384 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:33.382+0000 7f1007fff640 1 -- 172.21.15.73:0/859476164 learned_addr learned my addr 172.21.15.73:0/859476164 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:43:33.384 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:33.383+0000 7f100e59c640 1 --2- 172.21.15.73:0/859476164 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0ffc003970 0x7f10100bede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:33.384 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:33.383+0000 7f100ed9d640 1 --2- 172.21.15.73:0/859476164 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f10100bf320 0x7f1010145770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:33.384 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:33.383+0000 7f1007fff640 1 -- 172.21.15.73:0/859476164 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f10100bf320 msgr2=0x7f1010145770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:33.385 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:33.383+0000 7f1007fff640 1 --2- 172.21.15.73:0/859476164 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f10100bf320 0x7f1010145770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:33.385 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:33.383+0000 7f1007fff640 1 -- 172.21.15.73:0/859476164 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0ffc003970 msgr2=0x7f10100bede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:33.385 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:33.383+0000 7f1007fff640 1 --2- 172.21.15.73:0/859476164 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0ffc003970 0x7f10100bede0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:33.385 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:33.383+0000 7f1007fff640 1 -- 172.21.15.73:0/859476164 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10100a6390 con 0x7f10101e9f60 2023-12-12T09:43:33.385 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:33.383+0000 7f100e59c640 1 --2- 172.21.15.73:0/859476164 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0ffc003970 0x7f10100bede0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-12T09:43:33.385 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:33.383+0000 7f1007fff640 1 --2- 172.21.15.73:0/859476164 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f10101e9f60 0x7f10101edb70 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f0ff8000ff0 tx=0x7f0ff800dbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:43:33.385 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:33.383+0000 7f1006ffd640 1 -- 172.21.15.73:0/859476164 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ff8004c00 con 0x7f10101e9f60 2023-12-12T09:43:33.385 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:33.383+0000 7f1006ffd640 1 -- 172.21.15.73:0/859476164 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ff8004d60 con 0x7f10101e9f60 2023-12-12T09:43:33.385 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:33.383+0000 7f101487c640 1 -- 172.21.15.73:0/859476164 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10100a6670 con 0x7f10101e9f60 2023-12-12T09:43:33.385 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:33.383+0000 7f1006ffd640 1 -- 172.21.15.73:0/859476164 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ff8007310 con 0x7f10101e9f60 2023-12-12T09:43:33.385 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:33.384+0000 7f101487c640 1 -- 172.21.15.73:0/859476164 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f101014b410 con 0x7f10101e9f60 2023-12-12T09:43:33.386 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:33.385+0000 7f101487c640 1 -- 172.21.15.73:0/859476164 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10101ed890 con 0x7f10101e9f60 2023-12-12T09:43:33.386 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:33.385+0000 7f1006ffd640 1 -- 172.21.15.73:0/859476164 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f0ff8007470 con 0x7f10101e9f60 2023-12-12T09:43:33.386 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:33.386+0000 7f1006ffd640 1 --2- 172.21.15.73:0/859476164 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f0ff006ae70 0x7f0ff006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:33.386 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:33.386+0000 7f1006ffd640 1 -- 172.21.15.73:0/859476164 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0ff8088c00 con 0x7f10101e9f60 2023-12-12T09:43:33.386 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:33.387+0000 7f100e59c640 1 --2- 172.21.15.73:0/859476164 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f0ff006ae70 0x7f0ff006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:33.389 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:33.387+0000 7f100e59c640 1 --2- 172.21.15.73:0/859476164 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f0ff006ae70 0x7f0ff006d330 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f1000036000 tx=0x7f1000031000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:43:33.390 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:33.390+0000 7f1006ffd640 1 -- 172.21.15.73:0/859476164 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f10101ed890 con 0x7f10101e9f60 2023-12-12T09:43:33.582 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:33.582+0000 7f101487c640 1 -- 172.21.15.73:0/859476164 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f10101ed890 con 0x7f10101e9f60 2023-12-12T09:43:33.583 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:33.583+0000 7f1006ffd640 1 -- 172.21.15.73:0/859476164 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16517 (secure 0 0 0) 0x7f10101ed890 con 0x7f10101e9f60 2023-12-12T09:43:33.584 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-12T09:43:33.584 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":21,"fsid":"ba240992-02b8-4c7e-92f2-27eb29ac433b","created":"2023-12-12T09:43:02.454719+0000","modified":"2023-12-12T09:43:23.219345+0000","last_up_change":"2023-12-12T09:43:13.913440+0000","last_in_change":"2023-12-12T09:43:05.925348+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-12T09:43:15.525508+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-12T09:43:20.004546+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-12T09:43:20.736500+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"dd9074be-dbe2-4c34-9896-a4223d8d3940","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":4047810203},{"type":"v1","addr":"172.21.15.73:6801","nonce":4047810203}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":4047810203},{"type":"v1","addr":"172.21.15.73:6803","nonce":4047810203}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":4047810203},{"type":"v1","addr":"172.21.15.73:6807","nonce":4047810203}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":4047810203},{"type":"v1","addr":"172.21.15.73:6805","nonce":4047810203}]},"public_addr":"172.21.15.73:6801/4047810203","cluster_addr":"172.21.15.73:6803/4047810203","heartbeat_back_addr":"172.21.15.73:6807/4047810203","heartbeat_front_addr":"172.21.15.73:6805/4047810203","state":["exists","up"]},{"osd":1,"uuid":"c4a05052-96d4-4758-a4e1-1a37f1e07fed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":1356058331},{"type":"v1","addr":"172.21.15.73:6824","nonce":1356058331}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":1356058331},{"type":"v1","addr":"172.21.15.73:6827","nonce":1356058331}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":1356058331},{"type":"v1","addr":"172.21.15.73:6831","nonce":1356058331}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":1356058331},{"type":"v1","addr":"172.21.15.73:6829","nonce":1356058331}]},"public_addr":"172.21.15.73:6824/1356058331","cluster_addr":"172.21.15.73:6827/1356058331","heartbeat_back_addr":"172.21.15.73:6831/1356058331","heartbeat_front_addr":"172.21.15.73:6829/1356058331","state":["exists","up"]},{"osd":2,"uuid":"512bc8ac-72c2-40d4-b3d2-d867a92c5213","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":1228903316},{"type":"v1","addr":"172.21.15.73:6817","nonce":1228903316}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":1228903316},{"type":"v1","addr":"172.21.15.73:6819","nonce":1228903316}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6823","nonce":1228903316},{"type":"v1","addr":"172.21.15.73:6825","nonce":1228903316}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":1228903316},{"type":"v1","addr":"172.21.15.73:6821","nonce":1228903316}]},"public_addr":"172.21.15.73:6817/1228903316","cluster_addr":"172.21.15.73:6819/1228903316","heartbeat_back_addr":"172.21.15.73:6825/1228903316","heartbeat_front_addr":"172.21.15.73:6821/1228903316","state":["exists","up"]},{"osd":3,"uuid":"3d1a91e0-42bf-437a-8eae-8d357c8f63a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":1293329670},{"type":"v1","addr":"172.21.15.73:6809","nonce":1293329670}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6810","nonce":1293329670},{"type":"v1","addr":"172.21.15.73:6811","nonce":1293329670}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":1293329670},{"type":"v1","addr":"172.21.15.73:6815","nonce":1293329670}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":1293329670},{"type":"v1","addr":"172.21.15.73:6813","nonce":1293329670}]},"public_addr":"172.21.15.73:6809/1293329670","cluster_addr":"172.21.15.73:6811/1293329670","heartbeat_back_addr":"172.21.15.73:6815/1293329670","heartbeat_front_addr":"172.21.15.73:6813/1293329670","state":["exists","up"]},{"osd":4,"uuid":"4b302fff-834c-4069-ac19-00e46f6c87b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":3727975702},{"type":"v1","addr":"172.21.15.142:6801","nonce":3727975702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":3727975702},{"type":"v1","addr":"172.21.15.142:6803","nonce":3727975702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6809","nonce":3727975702},{"type":"v1","addr":"172.21.15.142:6811","nonce":3727975702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6805","nonce":3727975702},{"type":"v1","addr":"172.21.15.142:6807","nonce":3727975702}]},"public_addr":"172.21.15.142:6801/3727975702","cluster_addr":"172.21.15.142:6803/3727975702","heartbeat_back_addr":"172.21.15.142:6811/3727975702","heartbeat_front_addr":"172.21.15.142:6807/3727975702","state":["exists","up"]},{"osd":5,"uuid":"d7cdace2-67d0-45cc-95f2-515cf6ef1b82","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6817","nonce":2353193632},{"type":"v1","addr":"172.21.15.142:6819","nonce":2353193632}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6821","nonce":2353193632},{"type":"v1","addr":"172.21.15.142:6823","nonce":2353193632}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6829","nonce":2353193632},{"type":"v1","addr":"172.21.15.142:6831","nonce":2353193632}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6825","nonce":2353193632},{"type":"v1","addr":"172.21.15.142:6827","nonce":2353193632}]},"public_addr":"172.21.15.142:6819/2353193632","cluster_addr":"172.21.15.142:6823/2353193632","heartbeat_back_addr":"172.21.15.142:6831/2353193632","heartbeat_front_addr":"172.21.15.142:6827/2353193632","state":["exists","up"]},{"osd":6,"uuid":"649ce78a-5626-445c-aedc-a651ed05a6f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":2006111986},{"type":"v1","addr":"172.21.15.142:6806","nonce":2006111986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":2006111986},{"type":"v1","addr":"172.21.15.142:6810","nonce":2006111986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":2006111986},{"type":"v1","addr":"172.21.15.142:6815","nonce":2006111986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":2006111986},{"type":"v1","addr":"172.21.15.142:6813","nonce":2006111986}]},"public_addr":"172.21.15.142:6806/2006111986","cluster_addr":"172.21.15.142:6810/2006111986","heartbeat_back_addr":"172.21.15.142:6815/2006111986","heartbeat_front_addr":"172.21.15.142:6813/2006111986","state":["exists","up"]},{"osd":7,"uuid":"af15ae3b-c1d0-4acf-92db-8a1805494d13","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":2573794341},{"type":"v1","addr":"172.21.15.142:6818","nonce":2573794341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":2573794341},{"type":"v1","addr":"172.21.15.142:6822","nonce":2573794341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":2573794341},{"type":"v1","addr":"172.21.15.142:6830","nonce":2573794341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":2573794341},{"type":"v1","addr":"172.21.15.142:6826","nonce":2573794341}]},"public_addr":"172.21.15.142:6818/2573794341","cluster_addr":"172.21.15.142:6822/2573794341","heartbeat_back_addr":"172.21.15.142:6830/2573794341","heartbeat_front_addr":"172.21.15.142:6826/2573794341","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.185824+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.262103+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.225556+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:10.523459+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:10.706035+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.257339+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.301776+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.051960+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-12T09:43:33.587 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:33.586+0000 7f101487c640 1 -- 172.21.15.73:0/859476164 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f0ff006ae70 msgr2=0x7f0ff006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:33.587 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:33.586+0000 7f101487c640 1 --2- 172.21.15.73:0/859476164 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f0ff006ae70 0x7f0ff006d330 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f1000036000 tx=0x7f1000031000 comp rx=0 tx=0).stop 2023-12-12T09:43:33.587 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:33.586+0000 7f101487c640 1 -- 172.21.15.73:0/859476164 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f10101e9f60 msgr2=0x7f10101edb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:33.587 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:33.586+0000 7f101487c640 1 --2- 172.21.15.73:0/859476164 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f10101e9f60 0x7f10101edb70 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f0ff8000ff0 tx=0x7f0ff800dbe0 comp rx=0 tx=0).stop 2023-12-12T09:43:33.587 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:33.586+0000 7f101487c640 1 -- 172.21.15.73:0/859476164 shutdown_connections 2023-12-12T09:43:33.587 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:33.586+0000 7f101487c640 1 --2- 172.21.15.73:0/859476164 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f0ff006ae70 0x7f0ff006d330 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:33.587 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:33.586+0000 7f101487c640 1 --2- 172.21.15.73:0/859476164 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f10100bf320 0x7f1010145770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:33.587 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:33.586+0000 7f101487c640 1 --2- 172.21.15.73:0/859476164 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f10101e9f60 0x7f10101edb70 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:33.587 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:33.586+0000 7f101487c640 1 --2- 172.21.15.73:0/859476164 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0ffc003970 0x7f10100bede0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:33.588 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:33.586+0000 7f101487c640 1 -- 172.21.15.73:0/859476164 >> 172.21.15.73:0/859476164 conn(0x7f10100a8130 msgr2=0x7f10100c0f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:43:33.588 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:33.586+0000 7f101487c640 1 -- 172.21.15.73:0/859476164 shutdown_connections 2023-12-12T09:43:33.588 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:33.586+0000 7f101487c640 1 -- 172.21.15.73:0/859476164 wait complete. 2023-12-12T09:43:33.603 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-12T09:43:15.525508+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-12T09:43:20.004546+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-12T09:43:20.736500+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-12T09:43:33.604 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-12T09:43:33.807 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:33.807+0000 7fdb5ac52640 1 Processor -- start 2023-12-12T09:43:33.807 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:33.807+0000 7fdb5ac52640 1 -- start start 2023-12-12T09:43:33.808 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:33.808+0000 7fdb5ac52640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fdb540c3930 0x7fdb5406d440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:33.809 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:33.808+0000 7fdb5ac52640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb541582e0 con 0x7fdb54151c30 2023-12-12T09:43:33.809 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:33.808+0000 7fdb5ac52640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb540a4f50 con 0x7fdb540bed50 2023-12-12T09:43:33.809 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:33.808+0000 7fdb5ac52640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb540a54d0 con 0x7fdb540c3930 2023-12-12T09:43:33.809 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:33.809+0000 7fdb589ee640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7fdb54151c30 0x7fdb54157bd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:34422/0 (socket says 172.21.15.73:34422) 2023-12-12T09:43:33.809 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:33.809+0000 7fdb589ee640 1 -- 172.21.15.73:0/2766700154 learned_addr learned my addr 172.21.15.73:0/2766700154 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-12T09:43:33.809 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:33.809+0000 7fdb53fff640 1 --2- 172.21.15.73:0/2766700154 >> v2:172.21.15.73:3300/0 conn(0x7fdb540c3930 0x7fdb5406d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:33.810 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:33.809+0000 7fdb537fe640 1 -- 172.21.15.73:0/2766700154 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3873374189 0 0) 0x7fdb541582e0 con 0x7fdb54151c30 2023-12-12T09:43:33.810 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:33.809+0000 7fdb537fe640 1 -- 172.21.15.73:0/2766700154 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdb44003520 con 0x7fdb54151c30 2023-12-12T09:43:33.810 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:33.809+0000 7fdb53fff640 1 -- 172.21.15.73:0/2766700154 >> v1:172.21.15.142:6789/0 conn(0x7fdb540bed50 legacy=0x7fdb540bf160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:43:33.810 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:33.809+0000 7fdb53fff640 1 -- 172.21.15.73:0/2766700154 >> v1:172.21.15.73:6789/0 conn(0x7fdb54151c30 legacy=0x7fdb54157bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:33.810 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:33.809+0000 7fdb53fff640 1 -- 172.21.15.73:0/2766700154 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb54155260 con 0x7fdb540c3930 2023-12-12T09:43:33.811 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:33.811+0000 7fdb53fff640 1 --2- 172.21.15.73:0/2766700154 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdb540c3930 0x7fdb5406d440 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fdb400097a0 tx=0x7fdb4002b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4b0ad9f83ed84ba server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:43:33.811 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:33.811+0000 7fdb537fe640 1 -- 172.21.15.73:0/2766700154 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb4002e070 con 0x7fdb540c3930 2023-12-12T09:43:33.811 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:33.811+0000 7fdb537fe640 1 -- 172.21.15.73:0/2766700154 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb400315a0 con 0x7fdb540c3930 2023-12-12T09:43:33.811 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:33.811+0000 7fdb537fe640 1 -- 172.21.15.73:0/2766700154 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb40031930 con 0x7fdb540c3930 2023-12-12T09:43:33.812 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:33.812+0000 7fdb5ac52640 1 -- 172.21.15.73:0/2766700154 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdb540c3930 msgr2=0x7fdb5406d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:33.812 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:33.812+0000 7fdb5ac52640 1 --2- 172.21.15.73:0/2766700154 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdb540c3930 0x7fdb5406d440 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fdb400097a0 tx=0x7fdb4002b840 comp rx=0 tx=0).stop 2023-12-12T09:43:33.812 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:33.812+0000 7fdb5ac52640 1 -- 172.21.15.73:0/2766700154 shutdown_connections 2023-12-12T09:43:33.812 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:33.812+0000 7fdb5ac52640 1 --2- 172.21.15.73:0/2766700154 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdb540c3930 0x7fdb5406d440 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:33.812 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:33.812+0000 7fdb5ac52640 1 -- 172.21.15.73:0/2766700154 >> 172.21.15.73:0/2766700154 conn(0x7fdb5406a4e0 msgr2=0x7fdb5406a8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:43:33.812 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:33.812+0000 7fdb5ac52640 1 -- 172.21.15.73:0/2766700154 shutdown_connections 2023-12-12T09:43:33.812 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:33.812+0000 7fdb5ac52640 1 -- 172.21.15.73:0/2766700154 wait complete. 2023-12-12T09:43:33.813 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:33.813+0000 7fdb5ac52640 1 Processor -- start 2023-12-12T09:43:33.813 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:33.814+0000 7fdb5ac52640 1 -- start start 2023-12-12T09:43:33.816 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:33.814+0000 7fdb5ac52640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdb540bed50 0x7fdb5414df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:33.816 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:33.815+0000 7fdb5ac52640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdb540c3930 0x7fdb541ed2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:33.816 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:33.815+0000 7fdb5ac52640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdb54151c30 0x7fdb541ed800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:33.816 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:33.815+0000 7fdb5ac52640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb5406ff00 con 0x7fdb540c3930 2023-12-12T09:43:33.816 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:33.815+0000 7fdb5ac52640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb54152930 con 0x7fdb54151c30 2023-12-12T09:43:33.816 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:33.815+0000 7fdb5ac52640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb540726d0 con 0x7fdb540bed50 2023-12-12T09:43:33.816 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:33.815+0000 7fdb53fff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdb540c3930 0x7fdb541ed2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:33.816 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:33.815+0000 7fdb53fff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdb540c3930 0x7fdb541ed2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:56866/0 (socket says 172.21.15.73:56866) 2023-12-12T09:43:33.816 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:33.815+0000 7fdb53fff640 1 -- 172.21.15.73:0/2556649929 learned_addr learned my addr 172.21.15.73:0/2556649929 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:43:33.817 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:33.815+0000 7fdb53fff640 1 -- 172.21.15.73:0/2556649929 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdb540bed50 msgr2=0x7fdb5414df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:33.817 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:33.815+0000 7fdb53fff640 1 --2- 172.21.15.73:0/2556649929 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdb540bed50 0x7fdb5414df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:33.817 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:33.815+0000 7fdb591ef640 1 --2- 172.21.15.73:0/2556649929 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdb54151c30 0x7fdb541ed800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:33.817 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:33.815+0000 7fdb53fff640 1 -- 172.21.15.73:0/2556649929 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdb54151c30 msgr2=0x7fdb541ed800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:33.817 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:33.815+0000 7fdb53fff640 1 --2- 172.21.15.73:0/2556649929 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdb54151c30 0x7fdb541ed800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:33.817 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:33.815+0000 7fdb53fff640 1 -- 172.21.15.73:0/2556649929 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb40009400 con 0x7fdb540c3930 2023-12-12T09:43:33.817 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:33.816+0000 7fdb53fff640 1 --2- 172.21.15.73:0/2556649929 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdb540c3930 0x7fdb541ed2c0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fdb40034040 tx=0x7fdb400046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:43:33.817 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:33.816+0000 7fdb517fa640 1 -- 172.21.15.73:0/2556649929 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb40032840 con 0x7fdb540c3930 2023-12-12T09:43:33.817 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:33.816+0000 7fdb517fa640 1 -- 172.21.15.73:0/2556649929 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb400329c0 con 0x7fdb540c3930 2023-12-12T09:43:33.817 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:33.816+0000 7fdb517fa640 1 -- 172.21.15.73:0/2556649929 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb40032d70 con 0x7fdb540c3930 2023-12-12T09:43:33.817 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:33.816+0000 7fdb5ac52640 1 -- 172.21.15.73:0/2556649929 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb54152650 con 0x7fdb540c3930 2023-12-12T09:43:33.817 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:33.816+0000 7fdb5ac52640 1 -- 172.21.15.73:0/2556649929 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb5414e4c0 con 0x7fdb540c3930 2023-12-12T09:43:33.818 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:33.817+0000 7fdb5ac52640 1 -- 172.21.15.73:0/2556649929 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb54072530 con 0x7fdb540c3930 2023-12-12T09:43:33.818 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:33.818+0000 7fdb517fa640 1 -- 172.21.15.73:0/2556649929 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fdb4003b3f0 con 0x7fdb540c3930 2023-12-12T09:43:33.818 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:33.819+0000 7fdb517fa640 1 --2- 172.21.15.73:0/2556649929 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fdb3806ae70 0x7fdb3806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:33.819 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:33.819+0000 7fdb517fa640 1 -- 172.21.15.73:0/2556649929 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fdb400ab540 con 0x7fdb540c3930 2023-12-12T09:43:33.819 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:33.819+0000 7fdb589ee640 1 --2- 172.21.15.73:0/2556649929 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fdb3806ae70 0x7fdb3806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:33.819 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:33.819+0000 7fdb589ee640 1 --2- 172.21.15.73:0/2556649929 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fdb3806ae70 0x7fdb3806d330 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fdb540ab9c0 tx=0x7fdb48007930 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:43:33.823 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:33.823+0000 7fdb517fa640 1 -- 172.21.15.73:0/2556649929 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fdb54072530 con 0x7fdb540c3930 2023-12-12T09:43:34.011 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:34.011+0000 7fdb5ac52640 1 -- 172.21.15.73:0/2556649929 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fdb54072530 con 0x7fdb540c3930 2023-12-12T09:43:34.011 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:34.012+0000 7fdb517fa640 1 -- 172.21.15.73:0/2556649929 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7fdb54072530 con 0x7fdb540c3930 2023-12-12T09:43:34.012 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 1 2023-12-12T09:43:34.015 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:34.014+0000 7fdb5ac52640 1 -- 172.21.15.73:0/2556649929 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fdb3806ae70 msgr2=0x7fdb3806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:34.015 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:34.014+0000 7fdb5ac52640 1 --2- 172.21.15.73:0/2556649929 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fdb3806ae70 0x7fdb3806d330 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fdb540ab9c0 tx=0x7fdb48007930 comp rx=0 tx=0).stop 2023-12-12T09:43:34.015 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:34.014+0000 7fdb5ac52640 1 -- 172.21.15.73:0/2556649929 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdb540c3930 msgr2=0x7fdb541ed2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:34.015 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:34.014+0000 7fdb5ac52640 1 --2- 172.21.15.73:0/2556649929 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdb540c3930 0x7fdb541ed2c0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fdb40034040 tx=0x7fdb400046c0 comp rx=0 tx=0).stop 2023-12-12T09:43:34.015 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:34.014+0000 7fdb5ac52640 1 -- 172.21.15.73:0/2556649929 shutdown_connections 2023-12-12T09:43:34.015 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:34.014+0000 7fdb5ac52640 1 --2- 172.21.15.73:0/2556649929 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fdb3806ae70 0x7fdb3806d330 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:34.015 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:34.014+0000 7fdb5ac52640 1 --2- 172.21.15.73:0/2556649929 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdb54151c30 0x7fdb541ed800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:34.015 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:34.014+0000 7fdb5ac52640 1 --2- 172.21.15.73:0/2556649929 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdb540c3930 0x7fdb541ed2c0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:34.015 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:34.014+0000 7fdb5ac52640 1 --2- 172.21.15.73:0/2556649929 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdb540bed50 0x7fdb5414df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:34.016 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:34.015+0000 7fdb5ac52640 1 -- 172.21.15.73:0/2556649929 >> 172.21.15.73:0/2556649929 conn(0x7fdb5406a4e0 msgr2=0x7fdb540c4c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:43:34.016 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:34.015+0000 7fdb5ac52640 1 -- 172.21.15.73:0/2556649929 shutdown_connections 2023-12-12T09:43:34.016 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:34.015+0000 7fdb5ac52640 1 -- 172.21.15.73:0/2556649929 wait complete. 2023-12-12T09:43:34.033 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-12T09:43:34.234 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:34.234+0000 7fd3f1c02640 1 Processor -- start 2023-12-12T09:43:34.234 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:34.234+0000 7fd3f1c02640 1 -- start start 2023-12-12T09:43:34.236 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:34.235+0000 7fd3f1c02640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd3ec14f8c0 0x7fd3ec06dc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:34.236 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:34.235+0000 7fd3f1c02640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fd3ec152500 0x7fd3ec152990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:34.236 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:34.235+0000 7fd3f1c02640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3ec0c16c0 con 0x7fd3ec06d350 2023-12-12T09:43:34.236 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:34.235+0000 7fd3f1c02640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3ec0c1090 con 0x7fd3ec152500 2023-12-12T09:43:34.236 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:34.235+0000 7fd3f1c02640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3ec0c14b0 con 0x7fd3ec14f8c0 2023-12-12T09:43:34.236 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:34.235+0000 7fd3ebfff640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fd3ec152500 0x7fd3ec152990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:34.236 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:34.235+0000 7fd3ebfff640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fd3ec152500 0x7fd3ec152990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:56876/0 (socket says 172.21.15.73:56876) 2023-12-12T09:43:34.236 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:34.235+0000 7fd3ebfff640 1 -- 172.21.15.73:0/1810144362 learned_addr learned my addr 172.21.15.73:0/1810144362 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:43:34.236 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:34.236+0000 7fd3eb7fe640 1 --2- 172.21.15.73:0/1810144362 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd3ec14f8c0 0x7fd3ec06dc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:34.237 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:34.236+0000 7fd3ebfff640 1 -- 172.21.15.73:0/1810144362 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd3ec14f8c0 msgr2=0x7fd3ec06dc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:43:34.237 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:34.236+0000 7fd3ebfff640 1 --2- 172.21.15.73:0/1810144362 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd3ec14f8c0 0x7fd3ec06dc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:34.237 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:34.236+0000 7fd3ebfff640 1 -- 172.21.15.73:0/1810144362 >> v1:172.21.15.142:6789/0 conn(0x7fd3ec06d350 legacy=0x7fd3ec071e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:34.237 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:34.236+0000 7fd3ebfff640 1 -- 172.21.15.73:0/1810144362 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3ec0c19a0 con 0x7fd3ec152500 2023-12-12T09:43:34.238 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:34.237+0000 7fd3ebfff640 1 --2- 172.21.15.73:0/1810144362 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd3ec152500 0x7fd3ec152990 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fd3e4009e50 tx=0x7fd3e402bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1be931a46608d35 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:43:34.238 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:34.237+0000 7fd3eaffd640 1 -- 172.21.15.73:0/1810144362 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3e402cb00 con 0x7fd3ec152500 2023-12-12T09:43:34.239 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:34.237+0000 7fd3eaffd640 1 -- 172.21.15.73:0/1810144362 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3e402cc60 con 0x7fd3ec152500 2023-12-12T09:43:34.239 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:34.237+0000 7fd3eaffd640 1 -- 172.21.15.73:0/1810144362 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3e40343f0 con 0x7fd3ec152500 2023-12-12T09:43:34.239 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:34.238+0000 7fd3f1c02640 1 -- 172.21.15.73:0/1810144362 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd3ec152500 msgr2=0x7fd3ec152990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:34.239 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:34.238+0000 7fd3f1c02640 1 --2- 172.21.15.73:0/1810144362 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd3ec152500 0x7fd3ec152990 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fd3e4009e50 tx=0x7fd3e402bf60 comp rx=0 tx=0).stop 2023-12-12T09:43:34.239 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:34.238+0000 7fd3f1c02640 1 -- 172.21.15.73:0/1810144362 shutdown_connections 2023-12-12T09:43:34.239 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:34.238+0000 7fd3f1c02640 1 --2- 172.21.15.73:0/1810144362 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd3ec152500 0x7fd3ec152990 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:34.239 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:34.238+0000 7fd3f1c02640 1 --2- 172.21.15.73:0/1810144362 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd3ec14f8c0 0x7fd3ec06dc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:34.239 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:34.238+0000 7fd3f1c02640 1 -- 172.21.15.73:0/1810144362 >> 172.21.15.73:0/1810144362 conn(0x7fd3ec06a4e0 msgr2=0x7fd3ec06a8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:43:34.239 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:34.238+0000 7fd3f1c02640 1 -- 172.21.15.73:0/1810144362 shutdown_connections 2023-12-12T09:43:34.239 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:34.238+0000 7fd3f1c02640 1 -- 172.21.15.73:0/1810144362 wait complete. 2023-12-12T09:43:34.240 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:34.240+0000 7fd3f1c02640 1 Processor -- start 2023-12-12T09:43:34.240 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:34.240+0000 7fd3f1c02640 1 -- start start 2023-12-12T09:43:34.242 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:34.241+0000 7fd3f1c02640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd3ec06d350 0x7fd3ec1ee5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:34.242 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:34.241+0000 7fd3f1c02640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd3ec14f8c0 0x7fd3ec1edcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:34.242 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:34.241+0000 7fd3f1c02640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd3ec152500 0x7fd3ec14b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:34.242 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:34.241+0000 7fd3f1c02640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3ec0abbd0 con 0x7fd3ec152500 2023-12-12T09:43:34.243 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:34.241+0000 7fd3f1c02640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3ec14a180 con 0x7fd3ec14f8c0 2023-12-12T09:43:34.243 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:34.241+0000 7fd3f1c02640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3ec0ab8a0 con 0x7fd3ec06d350 2023-12-12T09:43:34.243 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:34.241+0000 7fd3ebfff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd3ec152500 0x7fd3ec14b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:34.243 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:34.241+0000 7fd3ebfff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd3ec152500 0x7fd3ec14b2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:56890/0 (socket says 172.21.15.73:56890) 2023-12-12T09:43:34.243 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:34.241+0000 7fd3ebfff640 1 -- 172.21.15.73:0/719194267 learned_addr learned my addr 172.21.15.73:0/719194267 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:43:34.243 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:34.241+0000 7fd3eb7fe640 1 --2- 172.21.15.73:0/719194267 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd3ec06d350 0x7fd3ec1ee5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:34.243 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:34.241+0000 7fd3e2ffd640 1 --2- 172.21.15.73:0/719194267 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd3ec14f8c0 0x7fd3ec1edcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:34.243 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:34.241+0000 7fd3ebfff640 1 -- 172.21.15.73:0/719194267 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd3ec06d350 msgr2=0x7fd3ec1ee5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:34.243 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:34.241+0000 7fd3ebfff640 1 --2- 172.21.15.73:0/719194267 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd3ec06d350 0x7fd3ec1ee5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:34.243 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:34.241+0000 7fd3ebfff640 1 -- 172.21.15.73:0/719194267 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd3ec14f8c0 msgr2=0x7fd3ec1edcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:34.243 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:34.241+0000 7fd3ebfff640 1 --2- 172.21.15.73:0/719194267 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd3ec14f8c0 0x7fd3ec1edcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:34.244 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:34.241+0000 7fd3ebfff640 1 -- 172.21.15.73:0/719194267 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3e4009b30 con 0x7fd3ec152500 2023-12-12T09:43:34.244 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:34.241+0000 7fd3e2ffd640 1 --2- 172.21.15.73:0/719194267 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd3ec14f8c0 0x7fd3ec1edcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:43:34.244 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:34.242+0000 7fd3ebfff640 1 --2- 172.21.15.73:0/719194267 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd3ec152500 0x7fd3ec14b2f0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fd3e4009e50 tx=0x7fd3e4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:43:34.244 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:34.242+0000 7fd3e8ff9640 1 -- 172.21.15.73:0/719194267 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3e4040670 con 0x7fd3ec152500 2023-12-12T09:43:34.244 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:34.242+0000 7fd3e8ff9640 1 -- 172.21.15.73:0/719194267 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3e40407d0 con 0x7fd3ec152500 2023-12-12T09:43:34.244 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:34.242+0000 7fd3f1c02640 1 -- 172.21.15.73:0/719194267 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3ec156350 con 0x7fd3ec152500 2023-12-12T09:43:34.244 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:34.242+0000 7fd3e8ff9640 1 -- 172.21.15.73:0/719194267 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3e4040b80 con 0x7fd3ec152500 2023-12-12T09:43:34.244 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:34.242+0000 7fd3f1c02640 1 -- 172.21.15.73:0/719194267 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3ec1ee200 con 0x7fd3ec152500 2023-12-12T09:43:34.245 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:34.243+0000 7fd3f1c02640 1 -- 172.21.15.73:0/719194267 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3ec067070 con 0x7fd3ec152500 2023-12-12T09:43:34.245 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:34.244+0000 7fd3e8ff9640 1 -- 172.21.15.73:0/719194267 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fd3e4040ce0 con 0x7fd3ec152500 2023-12-12T09:43:34.245 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:34.245+0000 7fd3e8ff9640 1 --2- 172.21.15.73:0/719194267 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fd3cc06ae40 0x7fd3cc06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:34.245 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:34.245+0000 7fd3e8ff9640 1 -- 172.21.15.73:0/719194267 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd3e40ac5d0 con 0x7fd3ec152500 2023-12-12T09:43:34.245 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:34.245+0000 7fd3eb7fe640 1 --2- 172.21.15.73:0/719194267 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fd3cc06ae40 0x7fd3cc06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:34.246 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:34.246+0000 7fd3eb7fe640 1 --2- 172.21.15.73:0/719194267 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fd3cc06ae40 0x7fd3cc06d300 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fd3dc006fd0 tx=0x7fd3dc008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:43:34.249 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:34.249+0000 7fd3e8ff9640 1 -- 172.21.15.73:0/719194267 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fd3e4077830 con 0x7fd3ec152500 2023-12-12T09:43:34.423 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:34.423+0000 7fd3f1c02640 1 -- 172.21.15.73:0/719194267 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fd3ec067580 con 0x7fd3ec152500 2023-12-12T09:43:34.424 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:34.424+0000 7fd3e8ff9640 1 -- 172.21.15.73:0/719194267 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7fd3e4009510 con 0x7fd3ec152500 2023-12-12T09:43:34.424 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 32 2023-12-12T09:43:34.427 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:34.427+0000 7fd3f1c02640 1 -- 172.21.15.73:0/719194267 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fd3cc06ae40 msgr2=0x7fd3cc06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:34.427 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:34.427+0000 7fd3f1c02640 1 --2- 172.21.15.73:0/719194267 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fd3cc06ae40 0x7fd3cc06d300 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fd3dc006fd0 tx=0x7fd3dc008040 comp rx=0 tx=0).stop 2023-12-12T09:43:34.427 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:34.427+0000 7fd3f1c02640 1 -- 172.21.15.73:0/719194267 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd3ec152500 msgr2=0x7fd3ec14b2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:34.427 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:34.427+0000 7fd3f1c02640 1 --2- 172.21.15.73:0/719194267 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd3ec152500 0x7fd3ec14b2f0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fd3e4009e50 tx=0x7fd3e4004a40 comp rx=0 tx=0).stop 2023-12-12T09:43:34.427 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:34.427+0000 7fd3f1c02640 1 -- 172.21.15.73:0/719194267 shutdown_connections 2023-12-12T09:43:34.427 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:34.427+0000 7fd3f1c02640 1 --2- 172.21.15.73:0/719194267 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fd3cc06ae40 0x7fd3cc06d300 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:34.428 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:34.427+0000 7fd3f1c02640 1 --2- 172.21.15.73:0/719194267 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd3ec152500 0x7fd3ec14b2f0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:34.428 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:34.427+0000 7fd3f1c02640 1 --2- 172.21.15.73:0/719194267 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd3ec14f8c0 0x7fd3ec1edcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:34.428 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:34.427+0000 7fd3f1c02640 1 --2- 172.21.15.73:0/719194267 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd3ec06d350 0x7fd3ec1ee5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:34.428 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:34.427+0000 7fd3f1c02640 1 -- 172.21.15.73:0/719194267 >> 172.21.15.73:0/719194267 conn(0x7fd3ec06a4e0 msgr2=0x7fd3ec0c5980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:43:34.428 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:34.427+0000 7fd3f1c02640 1 -- 172.21.15.73:0/719194267 shutdown_connections 2023-12-12T09:43:34.428 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:34.427+0000 7fd3f1c02640 1 -- 172.21.15.73:0/719194267 wait complete. 2023-12-12T09:43:34.446 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-12T09:43:34.658 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:34.658+0000 7ff68ea3d640 1 Processor -- start 2023-12-12T09:43:34.658 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:34.658+0000 7ff68ea3d640 1 -- start start 2023-12-12T09:43:34.660 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:34.659+0000 7ff68ea3d640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7ff6880a4c90 0x7ff6880c5420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:34.660 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:34.660+0000 7ff68ea3d640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6880c3390 con 0x7ff6880c0320 2023-12-12T09:43:34.660 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:34.660+0000 7ff68ea3d640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6880c4b30 con 0x7ff68814ea60 2023-12-12T09:43:34.660 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:34.660+0000 7ff68ea3d640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6880c0750 con 0x7ff6880a4c90 2023-12-12T09:43:34.660 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:34.660+0000 7ff67ffff640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7ff6880a4c90 0x7ff6880c5420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:34.660 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:34.660+0000 7ff67ffff640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7ff6880a4c90 0x7ff6880c5420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:56894/0 (socket says 172.21.15.73:56894) 2023-12-12T09:43:34.660 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:34.660+0000 7ff67ffff640 1 -- 172.21.15.73:0/1192436919 learned_addr learned my addr 172.21.15.73:0/1192436919 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:43:34.660 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:34.660+0000 7ff68cfda640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7ff6880c0320 0x7ff6880c20b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:34436/0 (socket says 172.21.15.73:34436) 2023-12-12T09:43:34.661 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:34.660+0000 7ff67ffff640 1 -- 172.21.15.73:0/1192436919 >> v1:172.21.15.142:6789/0 conn(0x7ff68814ea60 legacy=0x7ff6880c4420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:43:34.661 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:34.660+0000 7ff67ffff640 1 -- 172.21.15.73:0/1192436919 >> v1:172.21.15.73:6789/0 conn(0x7ff6880c0320 legacy=0x7ff6880c20b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:34.661 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:34.660+0000 7ff67ffff640 1 -- 172.21.15.73:0/1192436919 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff688151e60 con 0x7ff6880a4c90 2023-12-12T09:43:34.662 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:34.661+0000 7ff67ffff640 1 --2- 172.21.15.73:0/1192436919 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff6880a4c90 0x7ff6880c5420 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7ff670009870 tx=0x7ff67002b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38eae5e4a78b60e1 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:43:34.662 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:34.662+0000 7ff6877fe640 1 -- 172.21.15.73:0/1192436919 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff670031860 con 0x7ff6880a4c90 2023-12-12T09:43:34.662 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:34.662+0000 7ff6877fe640 1 -- 172.21.15.73:0/1192436919 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6700319c0 con 0x7ff6880a4c90 2023-12-12T09:43:34.662 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:34.662+0000 7ff6877fe640 1 -- 172.21.15.73:0/1192436919 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff670031d50 con 0x7ff6880a4c90 2023-12-12T09:43:34.663 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:34.662+0000 7ff68ea3d640 1 -- 172.21.15.73:0/1192436919 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff6880a4c90 msgr2=0x7ff6880c5420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:34.663 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:34.662+0000 7ff68ea3d640 1 --2- 172.21.15.73:0/1192436919 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff6880a4c90 0x7ff6880c5420 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7ff670009870 tx=0x7ff67002b900 comp rx=0 tx=0).stop 2023-12-12T09:43:34.663 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:34.662+0000 7ff68ea3d640 1 -- 172.21.15.73:0/1192436919 shutdown_connections 2023-12-12T09:43:34.663 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:34.662+0000 7ff68ea3d640 1 --2- 172.21.15.73:0/1192436919 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff6880a4c90 0x7ff6880c5420 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:34.663 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:34.662+0000 7ff68ea3d640 1 -- 172.21.15.73:0/1192436919 >> 172.21.15.73:0/1192436919 conn(0x7ff68806a4e0 msgr2=0x7ff68806a8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:43:34.663 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:34.663+0000 7ff68ea3d640 1 -- 172.21.15.73:0/1192436919 shutdown_connections 2023-12-12T09:43:34.663 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:34.663+0000 7ff68ea3d640 1 -- 172.21.15.73:0/1192436919 wait complete. 2023-12-12T09:43:34.664 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:34.664+0000 7ff68ea3d640 1 Processor -- start 2023-12-12T09:43:34.664 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:34.664+0000 7ff68ea3d640 1 -- start start 2023-12-12T09:43:34.665 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:34.665+0000 7ff68ea3d640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff6880a4c90 0x7ff6880aa890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:34.665 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:34.665+0000 7ff68ea3d640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff6880c0320 0x7ff68806cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:34.665 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:34.665+0000 7ff68ea3d640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff68814ea60 0x7ff688147d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:34.666 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:34.665+0000 7ff68ea3d640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6881478e0 con 0x7ff68814ea60 2023-12-12T09:43:34.666 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:34.665+0000 7ff68ea3d640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6880aadd0 con 0x7ff6880a4c90 2023-12-12T09:43:34.666 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:34.665+0000 7ff68ea3d640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6880a8c80 con 0x7ff6880c0320 2023-12-12T09:43:34.666 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:34.666+0000 7ff68cfda640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff68814ea60 0x7ff688147d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:34.666 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:34.666+0000 7ff68cfda640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff68814ea60 0x7ff688147d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:56896/0 (socket says 172.21.15.73:56896) 2023-12-12T09:43:34.666 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:34.666+0000 7ff68cfda640 1 -- 172.21.15.73:0/3864983590 learned_addr learned my addr 172.21.15.73:0/3864983590 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:43:34.667 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:34.666+0000 7ff68cfda640 1 -- 172.21.15.73:0/3864983590 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff6880c0320 msgr2=0x7ff68806cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:34.667 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:34.666+0000 7ff68cfda640 1 --2- 172.21.15.73:0/3864983590 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff6880c0320 0x7ff68806cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:34.668 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:34.666+0000 7ff687fff640 1 --2- 172.21.15.73:0/3864983590 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff6880a4c90 0x7ff6880aa890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:34.668 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:34.666+0000 7ff68cfda640 1 -- 172.21.15.73:0/3864983590 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff6880a4c90 msgr2=0x7ff6880aa890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:34.668 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:34.666+0000 7ff68cfda640 1 --2- 172.21.15.73:0/3864983590 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff6880a4c90 0x7ff6880aa890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:34.668 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:34.666+0000 7ff68cfda640 1 -- 172.21.15.73:0/3864983590 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6700094d0 con 0x7ff68814ea60 2023-12-12T09:43:34.668 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:34.666+0000 7ff68cfda640 1 --2- 172.21.15.73:0/3864983590 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff68814ea60 0x7ff688147d70 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7ff68000c780 tx=0x7ff68000cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:43:34.668 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:34.666+0000 7ff6857fa640 1 -- 172.21.15.73:0/3864983590 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff68000ce90 con 0x7ff68814ea60 2023-12-12T09:43:34.668 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:34.666+0000 7ff6857fa640 1 -- 172.21.15.73:0/3864983590 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff68000a640 con 0x7ff68814ea60 2023-12-12T09:43:34.668 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:34.666+0000 7ff6857fa640 1 -- 172.21.15.73:0/3864983590 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff68000a9f0 con 0x7ff68814ea60 2023-12-12T09:43:34.668 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:34.666+0000 7ff68ea3d640 1 -- 172.21.15.73:0/3864983590 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6880a8f60 con 0x7ff68814ea60 2023-12-12T09:43:34.668 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:34.667+0000 7ff68ea3d640 1 -- 172.21.15.73:0/3864983590 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff68806d440 con 0x7ff68814ea60 2023-12-12T09:43:34.668 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:34.668+0000 7ff68ea3d640 1 -- 172.21.15.73:0/3864983590 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff688067070 con 0x7ff68814ea60 2023-12-12T09:43:34.669 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:34.668+0000 7ff6857fa640 1 -- 172.21.15.73:0/3864983590 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7ff68000ab50 con 0x7ff68814ea60 2023-12-12T09:43:34.669 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:34.669+0000 7ff6857fa640 1 --2- 172.21.15.73:0/3864983590 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7ff66806ae70 0x7ff66806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:34.669 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:34.669+0000 7ff6857fa640 1 -- 172.21.15.73:0/3864983590 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff680088cd0 con 0x7ff68814ea60 2023-12-12T09:43:34.669 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:34.670+0000 7ff687fff640 1 --2- 172.21.15.73:0/3864983590 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7ff66806ae70 0x7ff66806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:34.670 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:34.670+0000 7ff687fff640 1 --2- 172.21.15.73:0/3864983590 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7ff66806ae70 0x7ff66806d330 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7ff67800a730 tx=0x7ff678008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:43:34.674 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:34.674+0000 7ff6857fa640 1 -- 172.21.15.73:0/3864983590 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7ff680053ec0 con 0x7ff68814ea60 2023-12-12T09:43:34.865 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:34.865+0000 7ff68ea3d640 1 -- 172.21.15.73:0/3864983590 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7ff688067580 con 0x7ff68814ea60 2023-12-12T09:43:34.866 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:34.866+0000 7ff6857fa640 1 -- 172.21.15.73:0/3864983590 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7ff680017020 con 0x7ff68814ea60 2023-12-12T09:43:34.866 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 64 2023-12-12T09:43:34.869 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:34.868+0000 7ff68ea3d640 1 -- 172.21.15.73:0/3864983590 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7ff66806ae70 msgr2=0x7ff66806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:34.869 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:34.868+0000 7ff68ea3d640 1 --2- 172.21.15.73:0/3864983590 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7ff66806ae70 0x7ff66806d330 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7ff67800a730 tx=0x7ff678008040 comp rx=0 tx=0).stop 2023-12-12T09:43:34.869 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:34.868+0000 7ff68ea3d640 1 -- 172.21.15.73:0/3864983590 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff68814ea60 msgr2=0x7ff688147d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:34.869 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:34.868+0000 7ff68ea3d640 1 --2- 172.21.15.73:0/3864983590 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff68814ea60 0x7ff688147d70 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7ff68000c780 tx=0x7ff68000cc40 comp rx=0 tx=0).stop 2023-12-12T09:43:34.869 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:34.869+0000 7ff68ea3d640 1 -- 172.21.15.73:0/3864983590 shutdown_connections 2023-12-12T09:43:34.869 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:34.869+0000 7ff68ea3d640 1 --2- 172.21.15.73:0/3864983590 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7ff66806ae70 0x7ff66806d330 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:34.869 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:34.869+0000 7ff68ea3d640 1 --2- 172.21.15.73:0/3864983590 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff68814ea60 0x7ff688147d70 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:34.869 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:34.869+0000 7ff68ea3d640 1 --2- 172.21.15.73:0/3864983590 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff6880c0320 0x7ff68806cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:34.869 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:34.869+0000 7ff68ea3d640 1 --2- 172.21.15.73:0/3864983590 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff6880a4c90 0x7ff6880aa890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:34.869 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:34.869+0000 7ff68ea3d640 1 -- 172.21.15.73:0/3864983590 >> 172.21.15.73:0/3864983590 conn(0x7ff68806a4e0 msgr2=0x7ff6880c4420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:43:34.869 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:34.869+0000 7ff68ea3d640 1 -- 172.21.15.73:0/3864983590 shutdown_connections 2023-12-12T09:43:34.870 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:34.869+0000 7ff68ea3d640 1 -- 172.21.15.73:0/3864983590 wait complete. 2023-12-12T09:43:34.886 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-12T09:43:35.084 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:35.084+0000 7f2695347640 1 Processor -- start 2023-12-12T09:43:35.114 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:35.084+0000 7f2695347640 1 -- start start 2023-12-12T09:43:35.119 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:35.085+0000 7f2695347640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f269014e700 0x7f2690151cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:35.119 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:35.085+0000 7f2695347640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f26900ab4a0 0x7f26900a9df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:35.119 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:35.085+0000 7f2695347640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26901521f0 con 0x7f26900c37b0 2023-12-12T09:43:35.119 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:35.085+0000 7f2695347640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26900ab2d0 con 0x7f26900ab4a0 2023-12-12T09:43:35.119 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:35.085+0000 7f2695347640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f269006bb10 con 0x7f269014e700 2023-12-12T09:43:35.119 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:35.085+0000 7f2694b46640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f26900ab4a0 0x7f26900a9df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:35.119 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:35.085+0000 7f2694b46640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f26900ab4a0 0x7f26900a9df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:56908/0 (socket says 172.21.15.73:56908) 2023-12-12T09:43:35.119 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:35.085+0000 7f2694b46640 1 -- 172.21.15.73:0/1445080301 learned_addr learned my addr 172.21.15.73:0/1445080301 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:43:35.119 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:35.086+0000 7f268ffff640 1 --2- 172.21.15.73:0/1445080301 >> v2:172.21.15.142:3300/0 conn(0x7f269014e700 0x7f2690151cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:35.119 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:35.086+0000 7f2694b46640 1 -- 172.21.15.73:0/1445080301 >> v2:172.21.15.142:3300/0 conn(0x7f269014e700 msgr2=0x7f2690151cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:43:35.120 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:35.086+0000 7f2694b46640 1 --2- 172.21.15.73:0/1445080301 >> v2:172.21.15.142:3300/0 conn(0x7f269014e700 0x7f2690151cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:35.120 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:35.086+0000 7f2694b46640 1 -- 172.21.15.73:0/1445080301 >> v1:172.21.15.142:6789/0 conn(0x7f26900c37b0 legacy=0x7f26900c02b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:43:35.120 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:35.086+0000 7f2694b46640 1 -- 172.21.15.73:0/1445080301 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26900aaff0 con 0x7f26900ab4a0 2023-12-12T09:43:35.120 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:35.086+0000 7f268ffff640 1 --2- 172.21.15.73:0/1445080301 >> v2:172.21.15.142:3300/0 conn(0x7f269014e700 0x7f2690151cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:43:35.120 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:35.087+0000 7f2694b46640 1 --2- 172.21.15.73:0/1445080301 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f26900ab4a0 0x7f26900a9df0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f26900a8630 tx=0x7f268802b7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=112849cd13698f82 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:43:35.120 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:35.087+0000 7f268effd640 1 -- 172.21.15.73:0/1445080301 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2688031750 con 0x7f26900ab4a0 2023-12-12T09:43:35.120 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:35.087+0000 7f268effd640 1 -- 172.21.15.73:0/1445080301 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26880318b0 con 0x7f26900ab4a0 2023-12-12T09:43:35.120 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:35.087+0000 7f268effd640 1 -- 172.21.15.73:0/1445080301 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2688031c40 con 0x7f26900ab4a0 2023-12-12T09:43:35.120 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:35.088+0000 7f2695347640 1 -- 172.21.15.73:0/1445080301 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f26900ab4a0 msgr2=0x7f26900a9df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:35.120 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:35.088+0000 7f2695347640 1 --2- 172.21.15.73:0/1445080301 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f26900ab4a0 0x7f26900a9df0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f26900a8630 tx=0x7f268802b7f0 comp rx=0 tx=0).stop 2023-12-12T09:43:35.120 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:35.088+0000 7f2695347640 1 -- 172.21.15.73:0/1445080301 shutdown_connections 2023-12-12T09:43:35.120 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:35.088+0000 7f2695347640 1 --2- 172.21.15.73:0/1445080301 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f26900ab4a0 0x7f26900a9df0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:35.120 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:35.088+0000 7f2695347640 1 --2- 172.21.15.73:0/1445080301 >> v2:172.21.15.142:3300/0 conn(0x7f269014e700 0x7f2690151cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:35.121 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:35.088+0000 7f2695347640 1 -- 172.21.15.73:0/1445080301 >> 172.21.15.73:0/1445080301 conn(0x7f26900c23b0 msgr2=0x7f26900c2790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:43:35.121 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:35.088+0000 7f2695347640 1 -- 172.21.15.73:0/1445080301 shutdown_connections 2023-12-12T09:43:35.121 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:35.088+0000 7f2695347640 1 -- 172.21.15.73:0/1445080301 wait complete. 2023-12-12T09:43:35.121 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:35.089+0000 7f2695347640 1 Processor -- start 2023-12-12T09:43:35.121 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:35.090+0000 7f2695347640 1 -- start start 2023-12-12T09:43:35.121 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:35.090+0000 7f2695347640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f26900ab4a0 0x7f269014f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:35.121 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:35.090+0000 7f2695347640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f26900c37b0 0x7f2690142870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:35.121 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:35.090+0000 7f2695347640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f269014e700 0x7f2690142db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:35.121 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:35.090+0000 7f2695347640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26900beb60 con 0x7f269014e700 2023-12-12T09:43:35.121 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:35.090+0000 7f2695347640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26901e5510 con 0x7f26900ab4a0 2023-12-12T09:43:35.121 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:35.090+0000 7f2695347640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26900bcb30 con 0x7f26900c37b0 2023-12-12T09:43:35.121 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:35.091+0000 7f2694b46640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f269014e700 0x7f2690142db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:35.121 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:35.091+0000 7f2694b46640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f269014e700 0x7f2690142db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:56922/0 (socket says 172.21.15.73:56922) 2023-12-12T09:43:35.122 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:35.091+0000 7f2694b46640 1 -- 172.21.15.73:0/4034579279 learned_addr learned my addr 172.21.15.73:0/4034579279 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:43:35.122 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:35.091+0000 7f268ffff640 1 --2- 172.21.15.73:0/4034579279 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f26900ab4a0 0x7f269014f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:35.122 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:35.091+0000 7f2694b46640 1 -- 172.21.15.73:0/4034579279 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f26900c37b0 msgr2=0x7f2690142870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:35.122 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:35.091+0000 7f268f7fe640 1 --2- 172.21.15.73:0/4034579279 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f26900c37b0 0x7f2690142870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:35.122 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:35.091+0000 7f2694b46640 1 --2- 172.21.15.73:0/4034579279 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f26900c37b0 0x7f2690142870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:35.122 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:35.091+0000 7f2694b46640 1 -- 172.21.15.73:0/4034579279 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f26900ab4a0 msgr2=0x7f269014f310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:35.122 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:35.091+0000 7f2694b46640 1 --2- 172.21.15.73:0/4034579279 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f26900ab4a0 0x7f269014f310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:35.122 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:35.091+0000 7f2694b46640 1 -- 172.21.15.73:0/4034579279 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26880094d0 con 0x7f269014e700 2023-12-12T09:43:35.122 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:35.091+0000 7f268ffff640 1 --2- 172.21.15.73:0/4034579279 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f26900ab4a0 0x7f269014f310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:43:35.122 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:35.091+0000 7f2694b46640 1 --2- 172.21.15.73:0/4034579279 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f269014e700 0x7f2690142db0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f2688009960 tx=0x7f26880046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:43:35.122 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:35.092+0000 7f268cff9640 1 -- 172.21.15.73:0/4034579279 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2688033c80 con 0x7f269014e700 2023-12-12T09:43:35.122 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:35.092+0000 7f268cff9640 1 -- 172.21.15.73:0/4034579279 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2688033de0 con 0x7f269014e700 2023-12-12T09:43:35.122 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:35.092+0000 7f2695347640 1 -- 172.21.15.73:0/4034579279 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26900bb7f0 con 0x7f269014e700 2023-12-12T09:43:35.122 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:35.092+0000 7f268cff9640 1 -- 172.21.15.73:0/4034579279 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f268803c640 con 0x7f269014e700 2023-12-12T09:43:35.123 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:35.092+0000 7f2695347640 1 -- 172.21.15.73:0/4034579279 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26900bbdb0 con 0x7f269014e700 2023-12-12T09:43:35.123 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:35.093+0000 7f2695347640 1 -- 172.21.15.73:0/4034579279 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2690067400 con 0x7f269014e700 2023-12-12T09:43:35.123 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:35.094+0000 7f268cff9640 1 -- 172.21.15.73:0/4034579279 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f268803a040 con 0x7f269014e700 2023-12-12T09:43:35.123 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:35.095+0000 7f268cff9640 1 --2- 172.21.15.73:0/4034579279 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f267006ae40 0x7f267006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:35.123 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:35.095+0000 7f268cff9640 1 -- 172.21.15.73:0/4034579279 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f26880ab230 con 0x7f269014e700 2023-12-12T09:43:35.123 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:35.095+0000 7f268ffff640 1 --2- 172.21.15.73:0/4034579279 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f267006ae40 0x7f267006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:35.123 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:35.096+0000 7f268ffff640 1 --2- 172.21.15.73:0/4034579279 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f267006ae40 0x7f267006d300 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f2678006fd0 tx=0x7f2678008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:43:35.123 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:35.099+0000 7f268cff9640 1 -- 172.21.15.73:0/4034579279 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f2688076240 con 0x7f269014e700 2023-12-12T09:43:35.325 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:35.325+0000 7f2695347640 1 -- 172.21.15.73:0/4034579279 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f26901521f0 con 0x7f269014e700 2023-12-12T09:43:35.326 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:35.326+0000 7f268cff9640 1 -- 172.21.15.73:0/4034579279 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4913 (secure 0 0 0) 0x7f26901521f0 con 0x7f269014e700 2023-12-12T09:43:35.326 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-12T09:43:35.327 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4257,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6835/1079394562","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":1079394562},{"type":"v1","addr":"172.21.15.73:6835","nonce":1079394562}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4258,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6835/3726638062","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6833","nonce":3726638062},{"type":"v1","addr":"172.21.15.142:6835","nonce":3726638062}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4260,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6837/2513898821","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6836","nonce":2513898821},{"type":"v1","addr":"172.21.15.73:6837","nonce":2513898821}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-12T09:43:21.720752+0000","modified":"2023-12-12T09:43:24.801495+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4269},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4269":{"gid":4269,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.142:6834/1773392257","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6832","nonce":1773392257},{"type":"v1","addr":"172.21.15.142:6834","nonce":1773392257}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-12-12T09:43:35.327 INFO:teuthology.orchestra.run.smithi073.stderr:dumped fsmap epoch 8 2023-12-12T09:43:35.329 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:35.329+0000 7f2695347640 1 -- 172.21.15.73:0/4034579279 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f267006ae40 msgr2=0x7f267006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:35.329 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:35.329+0000 7f2695347640 1 --2- 172.21.15.73:0/4034579279 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f267006ae40 0x7f267006d300 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f2678006fd0 tx=0x7f2678008040 comp rx=0 tx=0).stop 2023-12-12T09:43:35.329 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:35.329+0000 7f2695347640 1 -- 172.21.15.73:0/4034579279 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f269014e700 msgr2=0x7f2690142db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:35.329 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:35.329+0000 7f2695347640 1 --2- 172.21.15.73:0/4034579279 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f269014e700 0x7f2690142db0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f2688009960 tx=0x7f26880046c0 comp rx=0 tx=0).stop 2023-12-12T09:43:35.329 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:35.329+0000 7f2695347640 1 -- 172.21.15.73:0/4034579279 shutdown_connections 2023-12-12T09:43:35.329 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:35.329+0000 7f2695347640 1 --2- 172.21.15.73:0/4034579279 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f267006ae40 0x7f267006d300 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:35.329 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:35.329+0000 7f2695347640 1 --2- 172.21.15.73:0/4034579279 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f269014e700 0x7f2690142db0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:35.329 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:35.329+0000 7f2695347640 1 --2- 172.21.15.73:0/4034579279 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f26900c37b0 0x7f2690142870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:35.329 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:35.329+0000 7f2695347640 1 --2- 172.21.15.73:0/4034579279 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f26900ab4a0 0x7f269014f310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:35.329 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:35.329+0000 7f2695347640 1 -- 172.21.15.73:0/4034579279 >> 172.21.15.73:0/4034579279 conn(0x7f26900c23b0 msgr2=0x7f26900c2790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:43:35.330 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:35.329+0000 7f2695347640 1 -- 172.21.15.73:0/4034579279 shutdown_connections 2023-12-12T09:43:35.330 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:35.329+0000 7f2695347640 1 -- 172.21.15.73:0/4034579279 wait complete. 2023-12-12T09:43:35.347 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-12T09:43:35.555 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:35.555+0000 7f61e3fff640 1 Processor -- start 2023-12-12T09:43:35.555 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:35.555+0000 7f61e3fff640 1 -- start start 2023-12-12T09:43:35.557 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:35.556+0000 7f61e3fff640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f61e40c37b0 0x7f61e4151cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:35.557 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:35.556+0000 7f61e3fff640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f61e40ab4a0 0x7f61e40a9df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:35.557 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:35.556+0000 7f61e3fff640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61e41521f0 con 0x7f61e414e700 2023-12-12T09:43:35.558 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:35.556+0000 7f61e3fff640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61e40ab2d0 con 0x7f61e40ab4a0 2023-12-12T09:43:35.558 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:35.556+0000 7f61e3fff640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61e406bb10 con 0x7f61e40c37b0 2023-12-12T09:43:35.558 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:35.557+0000 7f61e37fe640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f61e40ab4a0 0x7f61e40a9df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:35.558 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:35.557+0000 7f61e37fe640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f61e40ab4a0 0x7f61e40a9df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:56938/0 (socket says 172.21.15.73:56938) 2023-12-12T09:43:35.558 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:35.557+0000 7f61e37fe640 1 -- 172.21.15.73:0/584502191 learned_addr learned my addr 172.21.15.73:0/584502191 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:43:35.558 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:35.557+0000 7f61e27fc640 1 --2- 172.21.15.73:0/584502191 >> v2:172.21.15.142:3300/0 conn(0x7f61e40c37b0 0x7f61e4151cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:35.558 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:35.557+0000 7f61e37fe640 1 -- 172.21.15.73:0/584502191 >> v2:172.21.15.142:3300/0 conn(0x7f61e40c37b0 msgr2=0x7f61e4151cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:43:35.558 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:35.557+0000 7f61e37fe640 1 --2- 172.21.15.73:0/584502191 >> v2:172.21.15.142:3300/0 conn(0x7f61e40c37b0 0x7f61e4151cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:35.558 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:35.557+0000 7f61e37fe640 1 -- 172.21.15.73:0/584502191 >> v1:172.21.15.142:6789/0 conn(0x7f61e414e700 legacy=0x7f61e40c02b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:43:35.558 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:35.557+0000 7f61e37fe640 1 -- 172.21.15.73:0/584502191 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61e40aaff0 con 0x7f61e40ab4a0 2023-12-12T09:43:35.558 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:35.557+0000 7f61e27fc640 1 --2- 172.21.15.73:0/584502191 >> v2:172.21.15.142:3300/0 conn(0x7f61e40c37b0 0x7f61e4151cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:43:35.560 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:35.558+0000 7f61e37fe640 1 --2- 172.21.15.73:0/584502191 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f61e40ab4a0 0x7f61e40a9df0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f61e406fa50 tx=0x7f61dc02b7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6f09536dde8bdae server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:43:35.560 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:35.559+0000 7f61e1ffb640 1 -- 172.21.15.73:0/584502191 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61dc031750 con 0x7f61e40ab4a0 2023-12-12T09:43:35.560 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:35.559+0000 7f61e1ffb640 1 -- 172.21.15.73:0/584502191 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61dc0318b0 con 0x7f61e40ab4a0 2023-12-12T09:43:35.560 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:35.559+0000 7f61e1ffb640 1 -- 172.21.15.73:0/584502191 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61dc031c40 con 0x7f61e40ab4a0 2023-12-12T09:43:35.560 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:35.559+0000 7f61e3fff640 1 -- 172.21.15.73:0/584502191 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f61e40ab4a0 msgr2=0x7f61e40a9df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:35.560 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:35.559+0000 7f61e3fff640 1 --2- 172.21.15.73:0/584502191 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f61e40ab4a0 0x7f61e40a9df0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f61e406fa50 tx=0x7f61dc02b7f0 comp rx=0 tx=0).stop 2023-12-12T09:43:35.560 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:35.559+0000 7f61e3fff640 1 -- 172.21.15.73:0/584502191 shutdown_connections 2023-12-12T09:43:35.560 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:35.559+0000 7f61e3fff640 1 --2- 172.21.15.73:0/584502191 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f61e40ab4a0 0x7f61e40a9df0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:35.560 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:35.559+0000 7f61e3fff640 1 --2- 172.21.15.73:0/584502191 >> v2:172.21.15.142:3300/0 conn(0x7f61e40c37b0 0x7f61e4151cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:35.560 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:35.559+0000 7f61e3fff640 1 -- 172.21.15.73:0/584502191 >> 172.21.15.73:0/584502191 conn(0x7f61e40c23b0 msgr2=0x7f61e40c2790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:43:35.560 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:35.560+0000 7f61e3fff640 1 -- 172.21.15.73:0/584502191 shutdown_connections 2023-12-12T09:43:35.561 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:35.560+0000 7f61e3fff640 1 -- 172.21.15.73:0/584502191 wait complete. 2023-12-12T09:43:35.561 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:35.561+0000 7f61e3fff640 1 Processor -- start 2023-12-12T09:43:35.561 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:35.561+0000 7f61e3fff640 1 -- start start 2023-12-12T09:43:35.564 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:35.562+0000 7f61e3fff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f61e40ab4a0 0x7f61e4072260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:35.564 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:35.562+0000 7f61e3fff640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f61e40c37b0 0x7f61e4070cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:35.564 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:35.562+0000 7f61e3fff640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f61e414e700 0x7f61e4071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:35.564 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:35.562+0000 7f61e3fff640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61e41eab10 con 0x7f61e40ab4a0 2023-12-12T09:43:35.564 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:35.562+0000 7f61e3fff640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61e41e9f00 con 0x7f61e40c37b0 2023-12-12T09:43:35.564 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:35.562+0000 7f61e3fff640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61e41ea1e0 con 0x7f61e414e700 2023-12-12T09:43:35.564 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:35.563+0000 7f61e2ffd640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f61e40ab4a0 0x7f61e4072260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:35.564 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:35.563+0000 7f61e2ffd640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f61e40ab4a0 0x7f61e4072260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:56954/0 (socket says 172.21.15.73:56954) 2023-12-12T09:43:35.564 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:35.563+0000 7f61e2ffd640 1 -- 172.21.15.73:0/3861615037 learned_addr learned my addr 172.21.15.73:0/3861615037 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:43:35.564 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:35.563+0000 7f61e27fc640 1 --2- 172.21.15.73:0/3861615037 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f61e40c37b0 0x7f61e4070cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:35.564 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:35.563+0000 7f61e37fe640 1 --2- 172.21.15.73:0/3861615037 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f61e414e700 0x7f61e4071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:35.565 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:35.563+0000 7f61e2ffd640 1 -- 172.21.15.73:0/3861615037 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f61e414e700 msgr2=0x7f61e4071210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:35.565 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:35.563+0000 7f61e2ffd640 1 --2- 172.21.15.73:0/3861615037 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f61e414e700 0x7f61e4071210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:35.565 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:35.563+0000 7f61e2ffd640 1 -- 172.21.15.73:0/3861615037 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f61e40c37b0 msgr2=0x7f61e4070cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:35.565 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:35.563+0000 7f61e2ffd640 1 --2- 172.21.15.73:0/3861615037 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f61e40c37b0 0x7f61e4070cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:35.565 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:35.563+0000 7f61e2ffd640 1 -- 172.21.15.73:0/3861615037 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61dc0094d0 con 0x7f61e40ab4a0 2023-12-12T09:43:35.565 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:35.563+0000 7f61e2ffd640 1 --2- 172.21.15.73:0/3861615037 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f61e40ab4a0 0x7f61e4072260 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f61d400b3f0 tx=0x7f61d400b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:43:35.565 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:35.564+0000 7f61db7fe640 1 -- 172.21.15.73:0/3861615037 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61d4011830 con 0x7f61e40ab4a0 2023-12-12T09:43:35.565 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:35.564+0000 7f61db7fe640 1 -- 172.21.15.73:0/3861615037 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61d4011990 con 0x7f61e40ab4a0 2023-12-12T09:43:35.565 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:35.564+0000 7f61e3fff640 1 -- 172.21.15.73:0/3861615037 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61e41ea4c0 con 0x7f61e40ab4a0 2023-12-12T09:43:35.565 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:35.564+0000 7f61db7fe640 1 -- 172.21.15.73:0/3861615037 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61d4011d40 con 0x7f61e40ab4a0 2023-12-12T09:43:35.565 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:35.564+0000 7f61e3fff640 1 -- 172.21.15.73:0/3861615037 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61e40727a0 con 0x7f61e40ab4a0 2023-12-12T09:43:35.566 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:35.565+0000 7f61e3fff640 1 -- 172.21.15.73:0/3861615037 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61e4067400 con 0x7f61e40ab4a0 2023-12-12T09:43:35.566 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:35.566+0000 7f61db7fe640 1 -- 172.21.15.73:0/3861615037 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f61d401a400 con 0x7f61e40ab4a0 2023-12-12T09:43:35.567 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:35.567+0000 7f61db7fe640 1 --2- 172.21.15.73:0/3861615037 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f61c406ae40 0x7f61c406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:35.567 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:35.567+0000 7f61db7fe640 1 -- 172.21.15.73:0/3861615037 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f61d40894d0 con 0x7f61e40ab4a0 2023-12-12T09:43:35.567 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:35.567+0000 7f61e27fc640 1 --2- 172.21.15.73:0/3861615037 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f61c406ae40 0x7f61c406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:35.567 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:35.568+0000 7f61e27fc640 1 --2- 172.21.15.73:0/3861615037 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f61c406ae40 0x7f61c406d300 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f61cc0075b0 tx=0x7f61cc007540 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:43:35.571 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:35.571+0000 7f61db7fe640 1 -- 172.21.15.73:0/3861615037 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f61d4054570 con 0x7f61e40ab4a0 2023-12-12T09:43:35.760 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:35.760+0000 7f61e3fff640 1 -- 172.21.15.73:0/3861615037 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f61e40c54d0 con 0x7f61e40ab4a0 2023-12-12T09:43:35.762 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:35.763+0000 7f61db7fe640 1 -- 172.21.15.73:0/3861615037 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16517 (secure 0 0 0) 0x7f61d4057b90 con 0x7f61e40ab4a0 2023-12-12T09:43:35.763 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-12T09:43:35.763 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":21,"fsid":"ba240992-02b8-4c7e-92f2-27eb29ac433b","created":"2023-12-12T09:43:02.454719+0000","modified":"2023-12-12T09:43:23.219345+0000","last_up_change":"2023-12-12T09:43:13.913440+0000","last_in_change":"2023-12-12T09:43:05.925348+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-12T09:43:15.525508+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-12T09:43:20.004546+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-12T09:43:20.736500+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"dd9074be-dbe2-4c34-9896-a4223d8d3940","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":4047810203},{"type":"v1","addr":"172.21.15.73:6801","nonce":4047810203}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":4047810203},{"type":"v1","addr":"172.21.15.73:6803","nonce":4047810203}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":4047810203},{"type":"v1","addr":"172.21.15.73:6807","nonce":4047810203}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":4047810203},{"type":"v1","addr":"172.21.15.73:6805","nonce":4047810203}]},"public_addr":"172.21.15.73:6801/4047810203","cluster_addr":"172.21.15.73:6803/4047810203","heartbeat_back_addr":"172.21.15.73:6807/4047810203","heartbeat_front_addr":"172.21.15.73:6805/4047810203","state":["exists","up"]},{"osd":1,"uuid":"c4a05052-96d4-4758-a4e1-1a37f1e07fed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":1356058331},{"type":"v1","addr":"172.21.15.73:6824","nonce":1356058331}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":1356058331},{"type":"v1","addr":"172.21.15.73:6827","nonce":1356058331}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":1356058331},{"type":"v1","addr":"172.21.15.73:6831","nonce":1356058331}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":1356058331},{"type":"v1","addr":"172.21.15.73:6829","nonce":1356058331}]},"public_addr":"172.21.15.73:6824/1356058331","cluster_addr":"172.21.15.73:6827/1356058331","heartbeat_back_addr":"172.21.15.73:6831/1356058331","heartbeat_front_addr":"172.21.15.73:6829/1356058331","state":["exists","up"]},{"osd":2,"uuid":"512bc8ac-72c2-40d4-b3d2-d867a92c5213","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":1228903316},{"type":"v1","addr":"172.21.15.73:6817","nonce":1228903316}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":1228903316},{"type":"v1","addr":"172.21.15.73:6819","nonce":1228903316}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6823","nonce":1228903316},{"type":"v1","addr":"172.21.15.73:6825","nonce":1228903316}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":1228903316},{"type":"v1","addr":"172.21.15.73:6821","nonce":1228903316}]},"public_addr":"172.21.15.73:6817/1228903316","cluster_addr":"172.21.15.73:6819/1228903316","heartbeat_back_addr":"172.21.15.73:6825/1228903316","heartbeat_front_addr":"172.21.15.73:6821/1228903316","state":["exists","up"]},{"osd":3,"uuid":"3d1a91e0-42bf-437a-8eae-8d357c8f63a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":1293329670},{"type":"v1","addr":"172.21.15.73:6809","nonce":1293329670}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6810","nonce":1293329670},{"type":"v1","addr":"172.21.15.73:6811","nonce":1293329670}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":1293329670},{"type":"v1","addr":"172.21.15.73:6815","nonce":1293329670}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":1293329670},{"type":"v1","addr":"172.21.15.73:6813","nonce":1293329670}]},"public_addr":"172.21.15.73:6809/1293329670","cluster_addr":"172.21.15.73:6811/1293329670","heartbeat_back_addr":"172.21.15.73:6815/1293329670","heartbeat_front_addr":"172.21.15.73:6813/1293329670","state":["exists","up"]},{"osd":4,"uuid":"4b302fff-834c-4069-ac19-00e46f6c87b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":3727975702},{"type":"v1","addr":"172.21.15.142:6801","nonce":3727975702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":3727975702},{"type":"v1","addr":"172.21.15.142:6803","nonce":3727975702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6809","nonce":3727975702},{"type":"v1","addr":"172.21.15.142:6811","nonce":3727975702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6805","nonce":3727975702},{"type":"v1","addr":"172.21.15.142:6807","nonce":3727975702}]},"public_addr":"172.21.15.142:6801/3727975702","cluster_addr":"172.21.15.142:6803/3727975702","heartbeat_back_addr":"172.21.15.142:6811/3727975702","heartbeat_front_addr":"172.21.15.142:6807/3727975702","state":["exists","up"]},{"osd":5,"uuid":"d7cdace2-67d0-45cc-95f2-515cf6ef1b82","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6817","nonce":2353193632},{"type":"v1","addr":"172.21.15.142:6819","nonce":2353193632}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6821","nonce":2353193632},{"type":"v1","addr":"172.21.15.142:6823","nonce":2353193632}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6829","nonce":2353193632},{"type":"v1","addr":"172.21.15.142:6831","nonce":2353193632}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6825","nonce":2353193632},{"type":"v1","addr":"172.21.15.142:6827","nonce":2353193632}]},"public_addr":"172.21.15.142:6819/2353193632","cluster_addr":"172.21.15.142:6823/2353193632","heartbeat_back_addr":"172.21.15.142:6831/2353193632","heartbeat_front_addr":"172.21.15.142:6827/2353193632","state":["exists","up"]},{"osd":6,"uuid":"649ce78a-5626-445c-aedc-a651ed05a6f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":2006111986},{"type":"v1","addr":"172.21.15.142:6806","nonce":2006111986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":2006111986},{"type":"v1","addr":"172.21.15.142:6810","nonce":2006111986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":2006111986},{"type":"v1","addr":"172.21.15.142:6815","nonce":2006111986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":2006111986},{"type":"v1","addr":"172.21.15.142:6813","nonce":2006111986}]},"public_addr":"172.21.15.142:6806/2006111986","cluster_addr":"172.21.15.142:6810/2006111986","heartbeat_back_addr":"172.21.15.142:6815/2006111986","heartbeat_front_addr":"172.21.15.142:6813/2006111986","state":["exists","up"]},{"osd":7,"uuid":"af15ae3b-c1d0-4acf-92db-8a1805494d13","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":2573794341},{"type":"v1","addr":"172.21.15.142:6818","nonce":2573794341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":2573794341},{"type":"v1","addr":"172.21.15.142:6822","nonce":2573794341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":2573794341},{"type":"v1","addr":"172.21.15.142:6830","nonce":2573794341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":2573794341},{"type":"v1","addr":"172.21.15.142:6826","nonce":2573794341}]},"public_addr":"172.21.15.142:6818/2573794341","cluster_addr":"172.21.15.142:6822/2573794341","heartbeat_back_addr":"172.21.15.142:6830/2573794341","heartbeat_front_addr":"172.21.15.142:6826/2573794341","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.185824+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.262103+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.225556+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:10.523459+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:10.706035+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.257339+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.301776+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.051960+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-12T09:43:35.765 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:35.765+0000 7f61e3fff640 1 -- 172.21.15.73:0/3861615037 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f61c406ae40 msgr2=0x7f61c406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:35.766 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:35.765+0000 7f61e3fff640 1 --2- 172.21.15.73:0/3861615037 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f61c406ae40 0x7f61c406d300 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f61cc0075b0 tx=0x7f61cc007540 comp rx=0 tx=0).stop 2023-12-12T09:43:35.766 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:35.765+0000 7f61e3fff640 1 -- 172.21.15.73:0/3861615037 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f61e40ab4a0 msgr2=0x7f61e4072260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:35.766 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:35.765+0000 7f61e3fff640 1 --2- 172.21.15.73:0/3861615037 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f61e40ab4a0 0x7f61e4072260 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f61d400b3f0 tx=0x7f61d400b8b0 comp rx=0 tx=0).stop 2023-12-12T09:43:35.766 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:35.765+0000 7f61e3fff640 1 -- 172.21.15.73:0/3861615037 shutdown_connections 2023-12-12T09:43:35.766 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:35.765+0000 7f61e3fff640 1 --2- 172.21.15.73:0/3861615037 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f61c406ae40 0x7f61c406d300 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:35.766 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:35.765+0000 7f61e3fff640 1 --2- 172.21.15.73:0/3861615037 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f61e414e700 0x7f61e4071210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:35.766 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:35.765+0000 7f61e3fff640 1 --2- 172.21.15.73:0/3861615037 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f61e40c37b0 0x7f61e4070cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:35.766 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:35.765+0000 7f61e3fff640 1 --2- 172.21.15.73:0/3861615037 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f61e40ab4a0 0x7f61e4072260 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:35.766 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:35.765+0000 7f61e3fff640 1 -- 172.21.15.73:0/3861615037 >> 172.21.15.73:0/3861615037 conn(0x7f61e40c23b0 msgr2=0x7f61e40c0fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:43:35.766 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:35.765+0000 7f61e3fff640 1 -- 172.21.15.73:0/3861615037 shutdown_connections 2023-12-12T09:43:35.766 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:35.765+0000 7f61e3fff640 1 -- 172.21.15.73:0/3861615037 wait complete. 2023-12-12T09:43:35.783 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-12T09:43:15.525508+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-12T09:43:20.004546+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-12T09:43:20.736500+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-12T09:43:35.784 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-12T09:43:35.996 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:35.995+0000 7f7e3fb90640 1 Processor -- start 2023-12-12T09:43:35.996 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:35.996+0000 7f7e3fb90640 1 -- start start 2023-12-12T09:43:35.997 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:35.997+0000 7f7e3fb90640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f7e3806dc40 0x7f7e38152c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:35.997 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:35.997+0000 7f7e3fb90640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e380c16c0 con 0x7f7e3806d350 2023-12-12T09:43:35.997 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:35.997+0000 7f7e3fb90640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e380c19a0 con 0x7f7e3814f8c0 2023-12-12T09:43:35.998 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:35.997+0000 7f7e3fb90640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e380c1090 con 0x7f7e3806dc40 2023-12-12T09:43:35.998 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:35.997+0000 7f7e3e12d640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f7e3806dc40 0x7f7e38152c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:35.998 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:35.998+0000 7f7e3e12d640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f7e3806dc40 0x7f7e38152c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:56964/0 (socket says 172.21.15.73:56964) 2023-12-12T09:43:35.998 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:35.997+0000 7f7e3d12b640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f7e3806d350 0x7f7e38152500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:34442/0 (socket says 172.21.15.73:34442) 2023-12-12T09:43:35.998 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:35.998+0000 7f7e3e12d640 1 -- 172.21.15.73:0/3951046374 learned_addr learned my addr 172.21.15.73:0/3951046374 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:43:35.998 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:35.998+0000 7f7e3e12d640 1 -- 172.21.15.73:0/3951046374 >> v1:172.21.15.142:6789/0 conn(0x7f7e3814f8c0 legacy=0x7f7e38071e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:43:35.999 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:35.998+0000 7f7e3e12d640 1 -- 172.21.15.73:0/3951046374 >> v1:172.21.15.73:6789/0 conn(0x7f7e3806d350 legacy=0x7f7e38152500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:35.999 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:35.998+0000 7f7e3c92a640 1 -- 172.21.15.73:0/3951046374 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2228547338 0 0) 0x7f7e380c16c0 con 0x7f7e3806d350 2023-12-12T09:43:35.999 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:35.998+0000 7f7e3e12d640 1 -- 172.21.15.73:0/3951046374 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e380c1c80 con 0x7f7e3806dc40 2023-12-12T09:43:36.001 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:35.999+0000 7f7e3e12d640 1 --2- 172.21.15.73:0/3951046374 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7e3806dc40 0x7f7e38152c10 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f7e30009e50 tx=0x7f7e3002c010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ac8a1dd08d39011 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:43:36.001 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:35.999+0000 7f7e3c92a640 1 -- 172.21.15.73:0/3951046374 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e3002cbb0 con 0x7f7e3806dc40 2023-12-12T09:43:36.001 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:35.999+0000 7f7e3c92a640 1 -- 172.21.15.73:0/3951046374 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e3002cd10 con 0x7f7e3806dc40 2023-12-12T09:43:36.002 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:35.999+0000 7f7e3c92a640 1 -- 172.21.15.73:0/3951046374 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e30034610 con 0x7f7e3806dc40 2023-12-12T09:43:36.002 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:36.000+0000 7f7e3fb90640 1 -- 172.21.15.73:0/3951046374 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7e3806dc40 msgr2=0x7f7e38152c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:36.002 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:36.000+0000 7f7e3fb90640 1 --2- 172.21.15.73:0/3951046374 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7e3806dc40 0x7f7e38152c10 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f7e30009e50 tx=0x7f7e3002c010 comp rx=0 tx=0).stop 2023-12-12T09:43:36.003 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:36.000+0000 7f7e3fb90640 1 -- 172.21.15.73:0/3951046374 shutdown_connections 2023-12-12T09:43:36.003 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:36.000+0000 7f7e3fb90640 1 --2- 172.21.15.73:0/3951046374 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7e3806dc40 0x7f7e38152c10 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:36.003 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:36.000+0000 7f7e3fb90640 1 -- 172.21.15.73:0/3951046374 >> 172.21.15.73:0/3951046374 conn(0x7f7e3806a4e0 msgr2=0x7f7e3806a8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:43:36.003 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:36.000+0000 7f7e3fb90640 1 -- 172.21.15.73:0/3951046374 shutdown_connections 2023-12-12T09:43:36.003 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:36.000+0000 7f7e3fb90640 1 -- 172.21.15.73:0/3951046374 wait complete. 2023-12-12T09:43:36.007 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:36.002+0000 7f7e3fb90640 1 Processor -- start 2023-12-12T09:43:36.007 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:36.002+0000 7f7e3fb90640 1 -- start start 2023-12-12T09:43:36.007 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:36.003+0000 7f7e3fb90640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7e3806d350 0x7f7e380ab520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:36.007 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:36.003+0000 7f7e3fb90640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7e3806dc40 0x7f7e3814c0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:36.007 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:36.003+0000 7f7e3fb90640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7e3814f8c0 0x7f7e381469a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:36.007 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:36.003+0000 7f7e3fb90640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e381e7f80 con 0x7f7e3806dc40 2023-12-12T09:43:36.007 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:36.003+0000 7f7e3fb90640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e380abb00 con 0x7f7e3806d350 2023-12-12T09:43:36.007 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:36.003+0000 7f7e3fb90640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e380a9a20 con 0x7f7e3814f8c0 2023-12-12T09:43:36.008 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:36.003+0000 7f7e3d12b640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7e3806dc40 0x7f7e3814c0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:36.008 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:36.003+0000 7f7e3d12b640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7e3806dc40 0x7f7e3814c0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:56978/0 (socket says 172.21.15.73:56978) 2023-12-12T09:43:36.008 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:36.003+0000 7f7e3d12b640 1 -- 172.21.15.73:0/646844512 learned_addr learned my addr 172.21.15.73:0/646844512 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:43:36.008 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:36.003+0000 7f7e3d92c640 1 --2- 172.21.15.73:0/646844512 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7e3806d350 0x7f7e380ab520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:36.008 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:36.004+0000 7f7e3e12d640 1 --2- 172.21.15.73:0/646844512 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7e3814f8c0 0x7f7e381469a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:36.008 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:36.004+0000 7f7e3d12b640 1 -- 172.21.15.73:0/646844512 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7e3814f8c0 msgr2=0x7f7e381469a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:36.008 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:36.004+0000 7f7e3d12b640 1 --2- 172.21.15.73:0/646844512 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7e3814f8c0 0x7f7e381469a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:36.008 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:36.004+0000 7f7e3d12b640 1 -- 172.21.15.73:0/646844512 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7e3806d350 msgr2=0x7f7e380ab520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:36.008 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:36.004+0000 7f7e3d12b640 1 --2- 172.21.15.73:0/646844512 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7e3806d350 0x7f7e380ab520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:36.008 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:36.004+0000 7f7e3d12b640 1 -- 172.21.15.73:0/646844512 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e30009b30 con 0x7f7e3806dc40 2023-12-12T09:43:36.008 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:36.004+0000 7f7e3d12b640 1 --2- 172.21.15.73:0/646844512 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7e3806dc40 0x7f7e3814c0a0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f7e2c00c3f0 tx=0x7f7e2c00c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:43:36.008 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:36.004+0000 7f7e2a7fc640 1 -- 172.21.15.73:0/646844512 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e2c0074e0 con 0x7f7e3806dc40 2023-12-12T09:43:36.008 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:36.004+0000 7f7e2a7fc640 1 -- 172.21.15.73:0/646844512 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e2c007640 con 0x7f7e3806dc40 2023-12-12T09:43:36.008 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:36.004+0000 7f7e3fb90640 1 -- 172.21.15.73:0/646844512 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e380a9d00 con 0x7f7e3806dc40 2023-12-12T09:43:36.008 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:36.004+0000 7f7e2a7fc640 1 -- 172.21.15.73:0/646844512 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e2c004a00 con 0x7f7e3806dc40 2023-12-12T09:43:36.009 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:36.004+0000 7f7e3fb90640 1 -- 172.21.15.73:0/646844512 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e3814c5e0 con 0x7f7e3806dc40 2023-12-12T09:43:36.009 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:36.005+0000 7f7e3fb90640 1 -- 172.21.15.73:0/646844512 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e381eb580 con 0x7f7e3806dc40 2023-12-12T09:43:36.009 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:36.006+0000 7f7e2a7fc640 1 -- 172.21.15.73:0/646844512 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f7e2c004b60 con 0x7f7e3806dc40 2023-12-12T09:43:36.010 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:36.007+0000 7f7e2a7fc640 1 --2- 172.21.15.73:0/646844512 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f7e1c06ae40 0x7f7e1c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:36.010 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:36.008+0000 7f7e2a7fc640 1 -- 172.21.15.73:0/646844512 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7e2c089420 con 0x7f7e3806dc40 2023-12-12T09:43:36.010 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:36.008+0000 7f7e3d92c640 1 --2- 172.21.15.73:0/646844512 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f7e1c06ae40 0x7f7e1c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:36.010 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:36.009+0000 7f7e3d92c640 1 --2- 172.21.15.73:0/646844512 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f7e1c06ae40 0x7f7e1c06d300 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f7e34000f60 tx=0x7f7e34009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:43:36.011 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:36.012+0000 7f7e2a7fc640 1 -- 172.21.15.73:0/646844512 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f7e381eb580 con 0x7f7e3806dc40 2023-12-12T09:43:36.200 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:36.200+0000 7f7e3fb90640 1 -- 172.21.15.73:0/646844512 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f7e381eb580 con 0x7f7e3806dc40 2023-12-12T09:43:36.201 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:36.201+0000 7f7e2a7fc640 1 -- 172.21.15.73:0/646844512 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7f7e381eb580 con 0x7f7e3806dc40 2023-12-12T09:43:36.201 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 1 2023-12-12T09:43:36.204 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:36.204+0000 7f7e3fb90640 1 -- 172.21.15.73:0/646844512 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f7e1c06ae40 msgr2=0x7f7e1c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:36.204 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:36.204+0000 7f7e3fb90640 1 --2- 172.21.15.73:0/646844512 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f7e1c06ae40 0x7f7e1c06d300 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f7e34000f60 tx=0x7f7e34009040 comp rx=0 tx=0).stop 2023-12-12T09:43:36.204 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:36.204+0000 7f7e3fb90640 1 -- 172.21.15.73:0/646844512 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7e3806dc40 msgr2=0x7f7e3814c0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:36.205 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:36.204+0000 7f7e3fb90640 1 --2- 172.21.15.73:0/646844512 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7e3806dc40 0x7f7e3814c0a0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f7e2c00c3f0 tx=0x7f7e2c00c8b0 comp rx=0 tx=0).stop 2023-12-12T09:43:36.205 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:36.204+0000 7f7e3fb90640 1 -- 172.21.15.73:0/646844512 shutdown_connections 2023-12-12T09:43:36.205 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:36.204+0000 7f7e3fb90640 1 --2- 172.21.15.73:0/646844512 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f7e1c06ae40 0x7f7e1c06d300 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:36.205 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:36.204+0000 7f7e3fb90640 1 --2- 172.21.15.73:0/646844512 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7e3814f8c0 0x7f7e381469a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:36.205 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:36.204+0000 7f7e3fb90640 1 --2- 172.21.15.73:0/646844512 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7e3806dc40 0x7f7e3814c0a0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:36.205 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:36.204+0000 7f7e3fb90640 1 --2- 172.21.15.73:0/646844512 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7e3806d350 0x7f7e380ab520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:36.205 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:36.204+0000 7f7e3fb90640 1 -- 172.21.15.73:0/646844512 >> 172.21.15.73:0/646844512 conn(0x7f7e3806a4e0 msgr2=0x7f7e381482b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:43:36.205 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:36.204+0000 7f7e3fb90640 1 -- 172.21.15.73:0/646844512 shutdown_connections 2023-12-12T09:43:36.205 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:36.204+0000 7f7e3fb90640 1 -- 172.21.15.73:0/646844512 wait complete. 2023-12-12T09:43:36.224 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-12T09:43:36.434 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:36.434+0000 7f8c1172c640 1 Processor -- start 2023-12-12T09:43:36.434 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:36.434+0000 7f8c1172c640 1 -- start start 2023-12-12T09:43:36.436 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:36.435+0000 7f8c1172c640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8c0c0a5d30 0x7f8c0c155850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:36.436 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:36.435+0000 7f8c1172c640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c0c0c6e20 con 0x7f8c0c155d90 2023-12-12T09:43:36.436 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:36.436+0000 7f8c1172c640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c0c0a9520 con 0x7f8c0c14f7c0 2023-12-12T09:43:36.436 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:36.436+0000 7f8c1172c640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c0c0a63c0 con 0x7f8c0c0a5d30 2023-12-12T09:43:36.436 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:36.436+0000 7f8c10f2b640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f8c0c155d90 0x7f8c0c15cbe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:34450/0 (socket says 172.21.15.73:34450) 2023-12-12T09:43:36.436 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:36.436+0000 7f8c10f2b640 1 -- 172.21.15.73:0/1854150623 learned_addr learned my addr 172.21.15.73:0/1854150623 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-12T09:43:36.436 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:36.436+0000 7f8c0b7fe640 1 --2- 172.21.15.73:0/1854150623 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8c0c0a5d30 0x7f8c0c155850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:36.436 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:36.436+0000 7f8c0affd640 1 -- 172.21.15.73:0/1854150623 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2803341490 0 0) 0x7f8c0c0c6e20 con 0x7f8c0c155d90 2023-12-12T09:43:36.436 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:36.436+0000 7f8c0affd640 1 -- 172.21.15.73:0/1854150623 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8bf8003520 con 0x7f8c0c155d90 2023-12-12T09:43:36.438 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:36.436+0000 7f8c0affd640 1 -- 172.21.15.73:0/1854150623 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 397613839 0 0) 0x7f8bf8003520 con 0x7f8c0c155d90 2023-12-12T09:43:36.438 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:36.436+0000 7f8c0affd640 1 -- 172.21.15.73:0/1854150623 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8c0c0a5d30 msgr2=0x7f8c0c155850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:43:36.438 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:36.436+0000 7f8c0affd640 1 --2- 172.21.15.73:0/1854150623 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8c0c0a5d30 0x7f8c0c155850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:36.438 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:36.436+0000 7f8c0affd640 1 -- 172.21.15.73:0/1854150623 >> v1:172.21.15.142:6789/0 conn(0x7f8c0c14f7c0 legacy=0x7f8c0c06a4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:36.439 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:36.436+0000 7f8c0affd640 1 -- 172.21.15.73:0/1854150623 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c0c152470 con 0x7f8c0c155d90 2023-12-12T09:43:36.439 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:36.437+0000 7f8c0affd640 1 -- 172.21.15.73:0/1854150623 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3186547832 0 0) 0x7f8c04001670 con 0x7f8c0c155d90 2023-12-12T09:43:36.439 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:36.437+0000 7f8c0affd640 1 -- 172.21.15.73:0/1854150623 >> v1:172.21.15.73:6789/0 conn(0x7f8c0c155d90 legacy=0x7f8c0c15cbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:36.439 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:36.437+0000 7f8c0affd640 1 --2- 172.21.15.73:0/1854150623 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8bf80039a0 0x7f8bf8003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:36.439 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:36.437+0000 7f8c0affd640 1 --2- 172.21.15.73:0/1854150623 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8c0c0a5d30 0x7f8bf80047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:36.439 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:36.437+0000 7f8c0affd640 1 --2- 172.21.15.73:0/1854150623 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8bf8004d00 0x7f8bf8005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:36.439 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:36.437+0000 7f8c0affd640 1 -- 172.21.15.73:0/1854150623 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c0c0a63c0 con 0x7f8bf80039a0 2023-12-12T09:43:36.439 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:36.437+0000 7f8c0affd640 1 -- 172.21.15.73:0/1854150623 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bf800bb40 con 0x7f8bf8004d00 2023-12-12T09:43:36.439 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:36.437+0000 7f8c0affd640 1 -- 172.21.15.73:0/1854150623 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8bf800bd00 con 0x7f8c0c0a5d30 2023-12-12T09:43:36.439 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:36.437+0000 7f8c0bfff640 1 --2- 172.21.15.73:0/1854150623 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8bf80039a0 0x7f8bf8003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:36.439 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:36.437+0000 7f8c0bfff640 1 -- 172.21.15.73:0/1854150623 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8c0c0a5d30 msgr2=0x7f8bf80047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:43:36.439 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:36.437+0000 7f8c0bfff640 1 --2- 172.21.15.73:0/1854150623 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8c0c0a5d30 0x7f8bf80047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:36.439 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:36.437+0000 7f8c0bfff640 1 -- 172.21.15.73:0/1854150623 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8bf8004d00 msgr2=0x7f8bf8005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:43:36.439 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:36.437+0000 7f8c0bfff640 1 --2- 172.21.15.73:0/1854150623 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8bf8004d00 0x7f8bf8005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:36.440 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:36.437+0000 7f8c0bfff640 1 -- 172.21.15.73:0/1854150623 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bf8003520 con 0x7f8bf80039a0 2023-12-12T09:43:36.440 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:36.438+0000 7f8c0bfff640 1 --2- 172.21.15.73:0/1854150623 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8bf80039a0 0x7f8bf8003dc0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f8bfc001e50 tx=0x7f8bf80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51669e2f8a9d6253 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:43:36.440 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:36.438+0000 7f8c0affd640 1 -- 172.21.15.73:0/1854150623 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bfc003b70 con 0x7f8bf80039a0 2023-12-12T09:43:36.440 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:36.438+0000 7f8c0affd640 1 -- 172.21.15.73:0/1854150623 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8bfc003cd0 con 0x7f8bf80039a0 2023-12-12T09:43:36.440 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:36.438+0000 7f8c0affd640 1 -- 172.21.15.73:0/1854150623 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bfc005310 con 0x7f8bf80039a0 2023-12-12T09:43:36.441 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:36.439+0000 7f8c1172c640 1 -- 172.21.15.73:0/1854150623 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8bf80039a0 msgr2=0x7f8bf8003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:36.441 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:36.439+0000 7f8c1172c640 1 --2- 172.21.15.73:0/1854150623 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8bf80039a0 0x7f8bf8003dc0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f8bfc001e50 tx=0x7f8bf80057f0 comp rx=0 tx=0).stop 2023-12-12T09:43:36.441 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:36.439+0000 7f8c10f2b640 1 -- 172.21.15.73:0/1854150623 reap_dead start 2023-12-12T09:43:36.441 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:36.439+0000 7f8c1172c640 1 -- 172.21.15.73:0/1854150623 shutdown_connections 2023-12-12T09:43:36.441 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:36.439+0000 7f8c1172c640 1 -- 172.21.15.73:0/1854150623 >> 172.21.15.73:0/1854150623 conn(0x7f8c0c06d260 msgr2=0x7f8c0c0a86e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:43:36.441 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:36.439+0000 7f8c1172c640 1 -- 172.21.15.73:0/1854150623 shutdown_connections 2023-12-12T09:43:36.441 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:36.439+0000 7f8c1172c640 1 -- 172.21.15.73:0/1854150623 wait complete. 2023-12-12T09:43:36.441 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:36.441+0000 7f8c1172c640 1 Processor -- start 2023-12-12T09:43:36.442 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:36.441+0000 7f8c1172c640 1 -- start start 2023-12-12T09:43:36.444 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:36.442+0000 7f8c1172c640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8bf80039a0 0x7f8c0c071fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:36.444 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:36.442+0000 7f8c1172c640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8c0c14ebc0 0x7f8c0c0a9bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:36.444 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:36.442+0000 7f8c1172c640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8c0c148ca0 0x7f8c0c0aa100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:36.444 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:36.442+0000 7f8c1172c640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c0c14cee0 con 0x7f8c0c148ca0 2023-12-12T09:43:36.444 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:36.442+0000 7f8c1172c640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c0c14db30 con 0x7f8c0c14ebc0 2023-12-12T09:43:36.444 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:36.442+0000 7f8c1172c640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c0c14e0c0 con 0x7f8bf80039a0 2023-12-12T09:43:36.445 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:36.442+0000 7f8c10f2b640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8c0c148ca0 0x7f8c0c0aa100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:36.445 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:36.442+0000 7f8c10f2b640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8c0c148ca0 0x7f8c0c0aa100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:56994/0 (socket says 172.21.15.73:56994) 2023-12-12T09:43:36.445 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:36.442+0000 7f8c10f2b640 1 -- 172.21.15.73:0/647085918 learned_addr learned my addr 172.21.15.73:0/647085918 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:43:36.445 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:36.442+0000 7f8c0b7fe640 1 --2- 172.21.15.73:0/647085918 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8c0c14ebc0 0x7f8c0c0a9bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:36.445 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:36.442+0000 7f8c0bfff640 1 --2- 172.21.15.73:0/647085918 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8bf80039a0 0x7f8c0c071fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:36.445 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:36.442+0000 7f8c10f2b640 1 -- 172.21.15.73:0/647085918 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8bf80039a0 msgr2=0x7f8c0c071fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:36.445 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:36.442+0000 7f8c10f2b640 1 --2- 172.21.15.73:0/647085918 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8bf80039a0 0x7f8c0c071fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:36.445 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:36.442+0000 7f8c10f2b640 1 -- 172.21.15.73:0/647085918 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8c0c14ebc0 msgr2=0x7f8c0c0a9bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:36.446 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:36.442+0000 7f8c10f2b640 1 --2- 172.21.15.73:0/647085918 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8c0c14ebc0 0x7f8c0c0a9bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:36.446 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:36.442+0000 7f8c10f2b640 1 -- 172.21.15.73:0/647085918 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c0c14e3a0 con 0x7f8c0c148ca0 2023-12-12T09:43:36.446 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:36.442+0000 7f8c0b7fe640 1 --2- 172.21.15.73:0/647085918 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8c0c14ebc0 0x7f8c0c0a9bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:43:36.446 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:36.443+0000 7f8c10f2b640 1 --2- 172.21.15.73:0/647085918 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8c0c148ca0 0x7f8c0c0aa100 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f8c0c156170 tx=0x7f8c0400c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:43:36.446 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:36.443+0000 7f8c08ff9640 1 -- 172.21.15.73:0/647085918 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c040074e0 con 0x7f8c0c148ca0 2023-12-12T09:43:36.446 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:36.443+0000 7f8c08ff9640 1 -- 172.21.15.73:0/647085918 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c04007660 con 0x7f8c0c148ca0 2023-12-12T09:43:36.446 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:36.443+0000 7f8c1172c640 1 -- 172.21.15.73:0/647085918 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c0c14e680 con 0x7f8c0c148ca0 2023-12-12T09:43:36.446 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:36.443+0000 7f8c08ff9640 1 -- 172.21.15.73:0/647085918 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c04004a20 con 0x7f8c0c148ca0 2023-12-12T09:43:36.446 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:36.443+0000 7f8c1172c640 1 -- 172.21.15.73:0/647085918 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c0c14d7c0 con 0x7f8c0c148ca0 2023-12-12T09:43:36.446 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:36.444+0000 7f8c1172c640 1 -- 172.21.15.73:0/647085918 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c0c14dcc0 con 0x7f8c0c148ca0 2023-12-12T09:43:36.447 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:36.445+0000 7f8c08ff9640 1 -- 172.21.15.73:0/647085918 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f8c04004b80 con 0x7f8c0c148ca0 2023-12-12T09:43:36.447 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:36.446+0000 7f8c08ff9640 1 --2- 172.21.15.73:0/647085918 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f8bec06add0 0x7f8bec06d290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:36.447 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:36.446+0000 7f8c08ff9640 1 -- 172.21.15.73:0/647085918 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8c040890c0 con 0x7f8c0c148ca0 2023-12-12T09:43:36.447 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:36.446+0000 7f8c0bfff640 1 --2- 172.21.15.73:0/647085918 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f8bec06add0 0x7f8bec06d290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:36.447 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:36.447+0000 7f8c0bfff640 1 --2- 172.21.15.73:0/647085918 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f8bec06add0 0x7f8bec06d290 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f8bfc034000 tx=0x7f8bfc009030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:43:36.450 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:36.450+0000 7f8c08ff9640 1 -- 172.21.15.73:0/647085918 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f8c04054160 con 0x7f8c0c148ca0 2023-12-12T09:43:36.639 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:36.639+0000 7f8c1172c640 1 -- 172.21.15.73:0/647085918 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f8c0c067b10 con 0x7f8c0c148ca0 2023-12-12T09:43:36.640 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:36.640+0000 7f8c08ff9640 1 -- 172.21.15.73:0/647085918 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7f8c04057780 con 0x7f8c0c148ca0 2023-12-12T09:43:36.640 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 32 2023-12-12T09:43:36.643 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:36.643+0000 7f8c1172c640 1 -- 172.21.15.73:0/647085918 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f8bec06add0 msgr2=0x7f8bec06d290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:36.643 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:36.643+0000 7f8c1172c640 1 --2- 172.21.15.73:0/647085918 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f8bec06add0 0x7f8bec06d290 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f8bfc034000 tx=0x7f8bfc009030 comp rx=0 tx=0).stop 2023-12-12T09:43:36.643 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:36.643+0000 7f8c1172c640 1 -- 172.21.15.73:0/647085918 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8c0c148ca0 msgr2=0x7f8c0c0aa100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:36.643 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:36.643+0000 7f8c1172c640 1 --2- 172.21.15.73:0/647085918 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8c0c148ca0 0x7f8c0c0aa100 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f8c0c156170 tx=0x7f8c0400c960 comp rx=0 tx=0).stop 2023-12-12T09:43:36.643 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:36.643+0000 7f8c1172c640 1 -- 172.21.15.73:0/647085918 shutdown_connections 2023-12-12T09:43:36.643 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:36.643+0000 7f8c1172c640 1 --2- 172.21.15.73:0/647085918 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f8bec06add0 0x7f8bec06d290 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:36.644 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:36.643+0000 7f8c1172c640 1 --2- 172.21.15.73:0/647085918 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8c0c148ca0 0x7f8c0c0aa100 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:36.644 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:36.643+0000 7f8c1172c640 1 --2- 172.21.15.73:0/647085918 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8c0c14ebc0 0x7f8c0c0a9bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:36.644 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:36.643+0000 7f8c1172c640 1 --2- 172.21.15.73:0/647085918 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8bf80039a0 0x7f8c0c071fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:36.644 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:36.643+0000 7f8c1172c640 1 -- 172.21.15.73:0/647085918 >> 172.21.15.73:0/647085918 conn(0x7f8c0c06d260 msgr2=0x7f8c0c0c13c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:43:36.644 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:36.643+0000 7f8c1172c640 1 -- 172.21.15.73:0/647085918 shutdown_connections 2023-12-12T09:43:36.644 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:36.643+0000 7f8c1172c640 1 -- 172.21.15.73:0/647085918 wait complete. 2023-12-12T09:43:36.662 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-12T09:43:36.874 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:36.874+0000 7ff219e10640 1 Processor -- start 2023-12-12T09:43:36.874 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:36.874+0000 7ff219e10640 1 -- start start 2023-12-12T09:43:36.876 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:36.876+0000 7ff219e10640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7ff2140c5420 0x7ff2140c0320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:36.876 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:36.876+0000 7ff219e10640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2140c3390 con 0x7ff21414ea60 2023-12-12T09:43:36.876 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:36.876+0000 7ff219e10640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2140c4b30 con 0x7ff2140a4c90 2023-12-12T09:43:36.876 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:36.876+0000 7ff219e10640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2140c5820 con 0x7ff2140c5420 2023-12-12T09:43:36.876 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:36.876+0000 7ff2137fe640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7ff21414ea60 0x7ff2140c4420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:34462/0 (socket says 172.21.15.73:34462) 2023-12-12T09:43:36.876 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:36.876+0000 7ff2137fe640 1 -- 172.21.15.73:0/944129355 learned_addr learned my addr 172.21.15.73:0/944129355 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-12T09:43:36.879 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:36.876+0000 7ff213fff640 1 --2- 172.21.15.73:0/944129355 >> v2:172.21.15.142:3300/0 conn(0x7ff2140c5420 0x7ff2140c0320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:36.879 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:36.876+0000 7ff212ffd640 1 -- 172.21.15.73:0/944129355 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2711439687 0 0) 0x7ff2140c3390 con 0x7ff21414ea60 2023-12-12T09:43:36.879 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:36.877+0000 7ff212ffd640 1 -- 172.21.15.73:0/944129355 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff200003520 con 0x7ff21414ea60 2023-12-12T09:43:36.879 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:36.877+0000 7ff212ffd640 1 -- 172.21.15.73:0/944129355 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2428491567 0 0) 0x7ff200003520 con 0x7ff21414ea60 2023-12-12T09:43:36.879 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:36.877+0000 7ff212ffd640 1 -- 172.21.15.73:0/944129355 >> v2:172.21.15.142:3300/0 conn(0x7ff2140c5420 msgr2=0x7ff2140c0320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:43:36.880 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:36.877+0000 7ff212ffd640 1 --2- 172.21.15.73:0/944129355 >> v2:172.21.15.142:3300/0 conn(0x7ff2140c5420 0x7ff2140c0320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:36.880 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:36.877+0000 7ff212ffd640 1 -- 172.21.15.73:0/944129355 >> v1:172.21.15.142:6789/0 conn(0x7ff2140a4c90 legacy=0x7ff2140c20b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:36.880 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:36.877+0000 7ff212ffd640 1 -- 172.21.15.73:0/944129355 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff214151e60 con 0x7ff21414ea60 2023-12-12T09:43:36.880 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:36.877+0000 7ff212ffd640 1 -- 172.21.15.73:0/944129355 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3186547832 0 0) 0x7ff204001670 con 0x7ff21414ea60 2023-12-12T09:43:36.880 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:36.877+0000 7ff212ffd640 1 -- 172.21.15.73:0/944129355 >> v1:172.21.15.73:6789/0 conn(0x7ff21414ea60 legacy=0x7ff2140c4420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:36.880 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:36.877+0000 7ff212ffd640 1 --2- 172.21.15.73:0/944129355 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff2000039c0 0x7ff200003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:36.880 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:36.877+0000 7ff212ffd640 1 --2- 172.21.15.73:0/944129355 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff2000047c0 0x7ff200004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:36.881 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:36.877+0000 7ff212ffd640 1 --2- 172.21.15.73:0/944129355 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff2000051d0 0x7ff20000db90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:36.881 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:36.877+0000 7ff212ffd640 1 -- 172.21.15.73:0/944129355 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2140c5820 con 0x7ff2000051d0 2023-12-12T09:43:36.881 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:36.877+0000 7ff212ffd640 1 -- 172.21.15.73:0/944129355 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff20000e330 con 0x7ff2000039c0 2023-12-12T09:43:36.881 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:36.877+0000 7ff212ffd640 1 -- 172.21.15.73:0/944129355 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff20000e4f0 con 0x7ff2000047c0 2023-12-12T09:43:36.881 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:36.877+0000 7ff213fff640 1 --2- 172.21.15.73:0/944129355 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff2000051d0 0x7ff20000db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:36.881 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:36.878+0000 7ff2137fe640 1 --2- 172.21.15.73:0/944129355 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff2000039c0 0x7ff200003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:36.881 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:36.878+0000 7ff20bfff640 1 --2- 172.21.15.73:0/944129355 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff2000047c0 0x7ff200004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:36.881 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:36.878+0000 7ff213fff640 1 -- 172.21.15.73:0/944129355 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff2000047c0 msgr2=0x7ff200004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:43:36.881 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:36.878+0000 7ff213fff640 1 --2- 172.21.15.73:0/944129355 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff2000047c0 0x7ff200004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:36.881 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:36.878+0000 7ff213fff640 1 -- 172.21.15.73:0/944129355 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff2000039c0 msgr2=0x7ff200003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:43:36.881 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:36.878+0000 7ff213fff640 1 --2- 172.21.15.73:0/944129355 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff2000039c0 0x7ff200003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:36.881 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:36.878+0000 7ff213fff640 1 -- 172.21.15.73:0/944129355 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff200003520 con 0x7ff2000051d0 2023-12-12T09:43:36.882 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:36.879+0000 7ff213fff640 1 -- 172.21.15.73:0/944129355 reap_dead start 2023-12-12T09:43:36.882 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:36.879+0000 7ff213fff640 1 --2- 172.21.15.73:0/944129355 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff2000051d0 0x7ff20000db90 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7ff20c009f90 tx=0x7ff2000057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e703ac7fa89f1f server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:43:36.882 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:36.879+0000 7ff212ffd640 1 -- 172.21.15.73:0/944129355 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff20c02cbf0 con 0x7ff2000051d0 2023-12-12T09:43:36.882 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:36.879+0000 7ff212ffd640 1 -- 172.21.15.73:0/944129355 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff20c00f040 con 0x7ff2000051d0 2023-12-12T09:43:36.882 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:36.879+0000 7ff212ffd640 1 -- 172.21.15.73:0/944129355 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff20c003990 con 0x7ff2000051d0 2023-12-12T09:43:36.885 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:36.879+0000 7ff219e10640 1 -- 172.21.15.73:0/944129355 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff2000051d0 msgr2=0x7ff20000db90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:36.885 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:36.879+0000 7ff219e10640 1 --2- 172.21.15.73:0/944129355 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff2000051d0 0x7ff20000db90 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7ff20c009f90 tx=0x7ff2000057f0 comp rx=0 tx=0).stop 2023-12-12T09:43:36.885 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:36.880+0000 7ff219e10640 1 -- 172.21.15.73:0/944129355 shutdown_connections 2023-12-12T09:43:36.885 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:36.880+0000 7ff219e10640 1 --2- 172.21.15.73:0/944129355 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff2000051d0 0x7ff20000db90 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:36.886 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:36.880+0000 7ff219e10640 1 -- 172.21.15.73:0/944129355 >> 172.21.15.73:0/944129355 conn(0x7ff21406a4e0 msgr2=0x7ff21406a8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:43:36.886 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:36.880+0000 7ff219e10640 1 -- 172.21.15.73:0/944129355 shutdown_connections 2023-12-12T09:43:36.886 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:36.880+0000 7ff219e10640 1 -- 172.21.15.73:0/944129355 wait complete. 2023-12-12T09:43:36.886 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:36.881+0000 7ff219e10640 1 Processor -- start 2023-12-12T09:43:36.886 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:36.881+0000 7ff219e10640 1 -- start start 2023-12-12T09:43:36.886 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:36.882+0000 7ff219e10640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff2000051d0 0x7ff2141ea150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:36.886 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:36.882+0000 7ff219e10640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff21414fa70 0x7ff2141edea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:36.886 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:36.882+0000 7ff219e10640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff214151260 0x7ff2141dc950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:36.886 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:36.882+0000 7ff219e10640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2140a6ea0 con 0x7ff2000051d0 2023-12-12T09:43:36.886 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:36.882+0000 7ff219e10640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2140a5390 con 0x7ff214151260 2023-12-12T09:43:36.886 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:36.882+0000 7ff219e10640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2141ed6c0 con 0x7ff21414fa70 2023-12-12T09:43:36.886 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:36.882+0000 7ff2137fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff2000051d0 0x7ff2141ea150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:36.887 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:36.883+0000 7ff2137fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff2000051d0 0x7ff2141ea150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:57010/0 (socket says 172.21.15.73:57010) 2023-12-12T09:43:36.887 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:36.883+0000 7ff2137fe640 1 -- 172.21.15.73:0/2644786402 learned_addr learned my addr 172.21.15.73:0/2644786402 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:43:36.887 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:36.883+0000 7ff2137fe640 1 -- 172.21.15.73:0/2644786402 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff21414fa70 msgr2=0x7ff2141edea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:36.887 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:36.883+0000 7ff2137fe640 1 --2- 172.21.15.73:0/2644786402 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff21414fa70 0x7ff2141edea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:36.887 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:36.883+0000 7ff2137fe640 1 -- 172.21.15.73:0/2644786402 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff214151260 msgr2=0x7ff2141dc950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:36.887 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:36.883+0000 7ff2137fe640 1 --2- 172.21.15.73:0/2644786402 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff214151260 0x7ff2141dc950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:36.887 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:36.883+0000 7ff2137fe640 1 -- 172.21.15.73:0/2644786402 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2140a70f0 con 0x7ff2000051d0 2023-12-12T09:43:36.887 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:36.883+0000 7ff2137fe640 1 --2- 172.21.15.73:0/2644786402 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff2000051d0 0x7ff2141ea150 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7ff20400e700 tx=0x7ff20400eb00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:43:36.887 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:36.883+0000 7ff210ff9640 1 -- 172.21.15.73:0/2644786402 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff20400c620 con 0x7ff2000051d0 2023-12-12T09:43:36.887 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:36.883+0000 7ff210ff9640 1 -- 172.21.15.73:0/2644786402 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff20400c7a0 con 0x7ff2000051d0 2023-12-12T09:43:36.887 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:36.883+0000 7ff219e10640 1 -- 172.21.15.73:0/2644786402 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2140a73d0 con 0x7ff2000051d0 2023-12-12T09:43:36.887 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:36.883+0000 7ff210ff9640 1 -- 172.21.15.73:0/2644786402 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff20400cb50 con 0x7ff2000051d0 2023-12-12T09:43:36.887 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:36.884+0000 7ff219e10640 1 -- 172.21.15.73:0/2644786402 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff214147360 con 0x7ff2000051d0 2023-12-12T09:43:36.887 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:36.884+0000 7ff219e10640 1 -- 172.21.15.73:0/2644786402 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff214067920 con 0x7ff2000051d0 2023-12-12T09:43:36.888 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:36.885+0000 7ff210ff9640 1 -- 172.21.15.73:0/2644786402 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7ff20400ccb0 con 0x7ff2000051d0 2023-12-12T09:43:36.888 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:36.886+0000 7ff210ff9640 1 --2- 172.21.15.73:0/2644786402 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7ff1f406ae40 0x7ff1f406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:36.888 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:36.886+0000 7ff210ff9640 1 -- 172.21.15.73:0/2644786402 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff204089650 con 0x7ff2000051d0 2023-12-12T09:43:36.888 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:36.886+0000 7ff20bfff640 1 --2- 172.21.15.73:0/2644786402 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7ff1f406ae40 0x7ff1f406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:36.888 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:36.887+0000 7ff20bfff640 1 --2- 172.21.15.73:0/2644786402 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7ff1f406ae40 0x7ff1f406d300 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7ff2140a4ba0 tx=0x7ff1fc009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:43:36.890 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:36.891+0000 7ff210ff9640 1 -- 172.21.15.73:0/2644786402 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7ff204054660 con 0x7ff2000051d0 2023-12-12T09:43:37.068 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:37.068+0000 7ff219e10640 1 -- 172.21.15.73:0/2644786402 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7ff214074890 con 0x7ff2000051d0 2023-12-12T09:43:37.069 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:37.069+0000 7ff210ff9640 1 -- 172.21.15.73:0/2644786402 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7ff204057c80 con 0x7ff2000051d0 2023-12-12T09:43:37.069 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 64 2023-12-12T09:43:37.075 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:37.071+0000 7ff219e10640 1 -- 172.21.15.73:0/2644786402 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7ff1f406ae40 msgr2=0x7ff1f406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:37.075 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:37.071+0000 7ff219e10640 1 --2- 172.21.15.73:0/2644786402 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7ff1f406ae40 0x7ff1f406d300 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7ff2140a4ba0 tx=0x7ff1fc009040 comp rx=0 tx=0).stop 2023-12-12T09:43:37.075 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:37.071+0000 7ff219e10640 1 -- 172.21.15.73:0/2644786402 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff2000051d0 msgr2=0x7ff2141ea150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:37.075 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:37.071+0000 7ff219e10640 1 --2- 172.21.15.73:0/2644786402 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff2000051d0 0x7ff2141ea150 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7ff20400e700 tx=0x7ff20400eb00 comp rx=0 tx=0).stop 2023-12-12T09:43:37.075 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:37.072+0000 7ff219e10640 1 -- 172.21.15.73:0/2644786402 shutdown_connections 2023-12-12T09:43:37.075 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:37.072+0000 7ff219e10640 1 --2- 172.21.15.73:0/2644786402 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7ff1f406ae40 0x7ff1f406d300 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:37.076 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:37.072+0000 7ff219e10640 1 --2- 172.21.15.73:0/2644786402 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff214151260 0x7ff2141dc950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:37.076 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:37.072+0000 7ff219e10640 1 --2- 172.21.15.73:0/2644786402 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff21414fa70 0x7ff2141edea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:37.076 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:37.072+0000 7ff219e10640 1 --2- 172.21.15.73:0/2644786402 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff2000051d0 0x7ff2141ea150 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:37.076 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:37.072+0000 7ff219e10640 1 -- 172.21.15.73:0/2644786402 >> 172.21.15.73:0/2644786402 conn(0x7ff21406a4e0 msgr2=0x7ff21406a8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:43:37.076 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:37.072+0000 7ff219e10640 1 -- 172.21.15.73:0/2644786402 shutdown_connections 2023-12-12T09:43:37.076 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:37.072+0000 7ff219e10640 1 -- 172.21.15.73:0/2644786402 wait complete. 2023-12-12T09:43:37.090 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-12T09:43:37.299 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:37.299+0000 7f2c65cb4640 1 Processor -- start 2023-12-12T09:43:37.299 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:37.299+0000 7f2c65cb4640 1 -- start start 2023-12-12T09:43:37.302 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:37.300+0000 7f2c65cb4640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f2c600af3d0 0x7f2c600c4760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:37.302 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:37.300+0000 7f2c65cb4640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2c60157ab0 0x7f2c60157f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:37.302 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:37.300+0000 7f2c65cb4640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c600c62e0 con 0x7f2c6006d300 2023-12-12T09:43:37.302 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:37.301+0000 7f2c65cb4640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c600c7e50 con 0x7f2c600af3d0 2023-12-12T09:43:37.302 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:37.301+0000 7f2c65cb4640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c601545d0 con 0x7f2c60157ab0 2023-12-12T09:43:37.302 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:37.301+0000 7f2c5f7fe640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f2c600af3d0 0x7f2c600c4760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:37.302 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:37.301+0000 7f2c5f7fe640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f2c600af3d0 0x7f2c600c4760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:57016/0 (socket says 172.21.15.73:57016) 2023-12-12T09:43:37.302 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:37.301+0000 7f2c5f7fe640 1 -- 172.21.15.73:0/3955515220 learned_addr learned my addr 172.21.15.73:0/3955515220 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:43:37.302 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:37.301+0000 7f2c5ffff640 1 --2- 172.21.15.73:0/3955515220 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2c60157ab0 0x7f2c60157f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:37.302 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:37.301+0000 7f2c5f7fe640 1 -- 172.21.15.73:0/3955515220 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2c60157ab0 msgr2=0x7f2c60157f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:43:37.303 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:37.301+0000 7f2c5f7fe640 1 --2- 172.21.15.73:0/3955515220 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2c60157ab0 0x7f2c60157f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:37.303 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:37.301+0000 7f2c5f7fe640 1 -- 172.21.15.73:0/3955515220 >> v1:172.21.15.142:6789/0 conn(0x7f2c6006d300 legacy=0x7f2c600c6d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:43:37.303 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:37.301+0000 7f2c5f7fe640 1 -- 172.21.15.73:0/3955515220 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c601548b0 con 0x7f2c600af3d0 2023-12-12T09:43:37.304 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:37.303+0000 7f2c5f7fe640 1 --2- 172.21.15.73:0/3955515220 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2c600af3d0 0x7f2c600c4760 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f2c50009870 tx=0x7f2c5002b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2056a069ad20ff77 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:43:37.305 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:37.303+0000 7f2c5effd640 1 -- 172.21.15.73:0/3955515220 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c500317c0 con 0x7f2c600af3d0 2023-12-12T09:43:37.305 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:37.303+0000 7f2c5effd640 1 -- 172.21.15.73:0/3955515220 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c50031920 con 0x7f2c600af3d0 2023-12-12T09:43:37.305 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:37.303+0000 7f2c5effd640 1 -- 172.21.15.73:0/3955515220 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c50031cb0 con 0x7f2c600af3d0 2023-12-12T09:43:37.305 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:37.304+0000 7f2c65cb4640 1 -- 172.21.15.73:0/3955515220 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2c600af3d0 msgr2=0x7f2c600c4760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:37.305 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:37.304+0000 7f2c65cb4640 1 --2- 172.21.15.73:0/3955515220 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2c600af3d0 0x7f2c600c4760 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f2c50009870 tx=0x7f2c5002b860 comp rx=0 tx=0).stop 2023-12-12T09:43:37.306 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:37.304+0000 7f2c65cb4640 1 -- 172.21.15.73:0/3955515220 shutdown_connections 2023-12-12T09:43:37.306 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:37.304+0000 7f2c65cb4640 1 --2- 172.21.15.73:0/3955515220 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2c60157ab0 0x7f2c60157f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:37.306 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:37.304+0000 7f2c65cb4640 1 --2- 172.21.15.73:0/3955515220 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2c600af3d0 0x7f2c600c4760 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:37.306 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:37.304+0000 7f2c65cb4640 1 -- 172.21.15.73:0/3955515220 >> 172.21.15.73:0/3955515220 conn(0x7f2c60072030 msgr2=0x7f2c60072440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:43:37.306 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:37.304+0000 7f2c65cb4640 1 -- 172.21.15.73:0/3955515220 shutdown_connections 2023-12-12T09:43:37.306 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:37.304+0000 7f2c65cb4640 1 -- 172.21.15.73:0/3955515220 wait complete. 2023-12-12T09:43:37.310 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:37.306+0000 7f2c65cb4640 1 Processor -- start 2023-12-12T09:43:37.310 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:37.306+0000 7f2c65cb4640 1 -- start start 2023-12-12T09:43:37.310 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:37.306+0000 7f2c65cb4640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2c6006d300 0x7f2c601e6f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:37.310 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:37.306+0000 7f2c65cb4640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2c600af3d0 0x7f2c601ed2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:37.310 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:37.306+0000 7f2c65cb4640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2c60157ab0 0x7f2c601ed810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:37.311 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:37.307+0000 7f2c65cb4640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c601ebca0 con 0x7f2c60157ab0 2023-12-12T09:43:37.311 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:37.307+0000 7f2c65cb4640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c60151660 con 0x7f2c6006d300 2023-12-12T09:43:37.311 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:37.307+0000 7f2c65cb4640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c601eb090 con 0x7f2c600af3d0 2023-12-12T09:43:37.311 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:37.307+0000 7f2c5ffff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2c60157ab0 0x7f2c601ed810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:37.311 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:37.307+0000 7f2c5ffff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2c60157ab0 0x7f2c601ed810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:57032/0 (socket says 172.21.15.73:57032) 2023-12-12T09:43:37.311 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:37.307+0000 7f2c5ffff640 1 -- 172.21.15.73:0/675007397 learned_addr learned my addr 172.21.15.73:0/675007397 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:43:37.311 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:37.307+0000 7f2c56ffd640 1 --2- 172.21.15.73:0/675007397 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2c600af3d0 0x7f2c601ed2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:37.311 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:37.307+0000 7f2c5f7fe640 1 --2- 172.21.15.73:0/675007397 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2c6006d300 0x7f2c601e6f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:37.312 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:37.307+0000 7f2c5ffff640 1 -- 172.21.15.73:0/675007397 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2c600af3d0 msgr2=0x7f2c601ed2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:37.312 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:37.307+0000 7f2c5ffff640 1 --2- 172.21.15.73:0/675007397 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2c600af3d0 0x7f2c601ed2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:37.312 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:37.307+0000 7f2c5ffff640 1 -- 172.21.15.73:0/675007397 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2c6006d300 msgr2=0x7f2c601e6f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:37.312 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:37.307+0000 7f2c5ffff640 1 --2- 172.21.15.73:0/675007397 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2c6006d300 0x7f2c601e6f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:37.312 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:37.307+0000 7f2c5ffff640 1 -- 172.21.15.73:0/675007397 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c500094d0 con 0x7f2c60157ab0 2023-12-12T09:43:37.312 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:37.307+0000 7f2c5f7fe640 1 --2- 172.21.15.73:0/675007397 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2c6006d300 0x7f2c601e6f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:43:37.312 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:37.307+0000 7f2c56ffd640 1 --2- 172.21.15.73:0/675007397 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2c600af3d0 0x7f2c601ed2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:43:37.312 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:37.308+0000 7f2c5ffff640 1 --2- 172.21.15.73:0/675007397 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2c60157ab0 0x7f2c601ed810 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f2c58007e60 tx=0x7f2c5800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:43:37.312 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:37.308+0000 7f2c5cff9640 1 -- 172.21.15.73:0/675007397 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c58014420 con 0x7f2c60157ab0 2023-12-12T09:43:37.313 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:37.308+0000 7f2c5cff9640 1 -- 172.21.15.73:0/675007397 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c580145a0 con 0x7f2c60157ab0 2023-12-12T09:43:37.313 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:37.308+0000 7f2c5cff9640 1 -- 172.21.15.73:0/675007397 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c58014950 con 0x7f2c60157ab0 2023-12-12T09:43:37.313 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:37.308+0000 7f2c65cb4640 1 -- 172.21.15.73:0/675007397 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c601eb370 con 0x7f2c60157ab0 2023-12-12T09:43:37.313 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:37.308+0000 7f2c65cb4640 1 -- 172.21.15.73:0/675007397 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c601eb930 con 0x7f2c60157ab0 2023-12-12T09:43:37.313 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:37.309+0000 7f2c65cb4640 1 -- 172.21.15.73:0/675007397 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c601ebaf0 con 0x7f2c60157ab0 2023-12-12T09:43:37.313 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:37.310+0000 7f2c5cff9640 1 -- 172.21.15.73:0/675007397 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f2c58014ab0 con 0x7f2c60157ab0 2023-12-12T09:43:37.314 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:37.311+0000 7f2c5cff9640 1 --2- 172.21.15.73:0/675007397 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f2c4006ae40 0x7f2c4006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:37.314 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:37.311+0000 7f2c5cff9640 1 -- 172.21.15.73:0/675007397 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2c58089fe0 con 0x7f2c60157ab0 2023-12-12T09:43:37.314 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:37.311+0000 7f2c5f7fe640 1 --2- 172.21.15.73:0/675007397 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f2c4006ae40 0x7f2c4006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:37.314 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:37.312+0000 7f2c5f7fe640 1 --2- 172.21.15.73:0/675007397 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f2c4006ae40 0x7f2c4006d300 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f2c50036000 tx=0x7f2c5003d040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:43:37.316 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:37.316+0000 7f2c5cff9640 1 -- 172.21.15.73:0/675007397 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f2c58055010 con 0x7f2c60157ab0 2023-12-12T09:43:37.546 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:37.546+0000 7f2c65cb4640 1 -- 172.21.15.73:0/675007397 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2c60067580 con 0x7f2c60157ab0 2023-12-12T09:43:37.547 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:37.547+0000 7f2c5cff9640 1 -- 172.21.15.73:0/675007397 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4913 (secure 0 0 0) 0x7f2c58058630 con 0x7f2c60157ab0 2023-12-12T09:43:37.547 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-12T09:43:37.547 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4257,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6835/1079394562","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":1079394562},{"type":"v1","addr":"172.21.15.73:6835","nonce":1079394562}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4258,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6835/3726638062","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6833","nonce":3726638062},{"type":"v1","addr":"172.21.15.142:6835","nonce":3726638062}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4260,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6837/2513898821","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6836","nonce":2513898821},{"type":"v1","addr":"172.21.15.73:6837","nonce":2513898821}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-12T09:43:21.720752+0000","modified":"2023-12-12T09:43:24.801495+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4269},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4269":{"gid":4269,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.142:6834/1773392257","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6832","nonce":1773392257},{"type":"v1","addr":"172.21.15.142:6834","nonce":1773392257}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-12-12T09:43:37.547 INFO:teuthology.orchestra.run.smithi073.stderr:dumped fsmap epoch 8 2023-12-12T09:43:37.550 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:37.550+0000 7f2c65cb4640 1 -- 172.21.15.73:0/675007397 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f2c4006ae40 msgr2=0x7f2c4006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:37.550 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:37.550+0000 7f2c65cb4640 1 --2- 172.21.15.73:0/675007397 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f2c4006ae40 0x7f2c4006d300 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f2c50036000 tx=0x7f2c5003d040 comp rx=0 tx=0).stop 2023-12-12T09:43:37.551 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:37.550+0000 7f2c65cb4640 1 -- 172.21.15.73:0/675007397 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2c60157ab0 msgr2=0x7f2c601ed810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:37.551 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:37.550+0000 7f2c65cb4640 1 --2- 172.21.15.73:0/675007397 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2c60157ab0 0x7f2c601ed810 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f2c58007e60 tx=0x7f2c5800e4b0 comp rx=0 tx=0).stop 2023-12-12T09:43:37.551 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:37.550+0000 7f2c65cb4640 1 -- 172.21.15.73:0/675007397 shutdown_connections 2023-12-12T09:43:37.551 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:37.550+0000 7f2c65cb4640 1 --2- 172.21.15.73:0/675007397 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f2c4006ae40 0x7f2c4006d300 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:37.551 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:37.550+0000 7f2c65cb4640 1 --2- 172.21.15.73:0/675007397 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2c60157ab0 0x7f2c601ed810 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:37.551 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:37.550+0000 7f2c65cb4640 1 --2- 172.21.15.73:0/675007397 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2c600af3d0 0x7f2c601ed2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:37.551 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:37.550+0000 7f2c65cb4640 1 --2- 172.21.15.73:0/675007397 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2c6006d300 0x7f2c601e6f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:37.551 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:37.550+0000 7f2c65cb4640 1 -- 172.21.15.73:0/675007397 >> 172.21.15.73:0/675007397 conn(0x7f2c60072030 msgr2=0x7f2c60152330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:43:37.551 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:37.550+0000 7f2c65cb4640 1 -- 172.21.15.73:0/675007397 shutdown_connections 2023-12-12T09:43:37.551 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:37.551+0000 7f2c65cb4640 1 -- 172.21.15.73:0/675007397 wait complete. 2023-12-12T09:43:37.571 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-12T09:43:37.774 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:37.774+0000 7f2ab0e2b640 1 Processor -- start 2023-12-12T09:43:37.774 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:37.774+0000 7f2ab0e2b640 1 -- start start 2023-12-12T09:43:37.775 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:37.775+0000 7f2ab0e2b640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f2aac0c5070 0x7f2aac0c40c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:37.776 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:37.775+0000 7f2ab0e2b640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2aac152610 con 0x7f2aac06db70 2023-12-12T09:43:37.776 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:37.775+0000 7f2ab0e2b640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2aac1528f0 con 0x7f2aac14fa40 2023-12-12T09:43:37.776 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:37.775+0000 7f2ab0e2b640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2aac152bd0 con 0x7f2aac0c5070 2023-12-12T09:43:37.776 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:37.776+0000 7f2aa3fff640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f2aac06db70 0x7f2aac0c39b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:34476/0 (socket says 172.21.15.73:34476) 2023-12-12T09:43:37.776 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:37.776+0000 7f2aa3fff640 1 -- 172.21.15.73:0/3439627301 learned_addr learned my addr 172.21.15.73:0/3439627301 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-12T09:43:37.776 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:37.776+0000 7f2aaad9d640 1 --2- 172.21.15.73:0/3439627301 >> v2:172.21.15.73:3300/0 conn(0x7f2aac0c5070 0x7f2aac0c40c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:37.777 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:37.776+0000 7f2aa9d9b640 1 -- 172.21.15.73:0/3439627301 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1960179663 0 0) 0x7f2aac152610 con 0x7f2aac06db70 2023-12-12T09:43:37.777 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:37.776+0000 7f2aa9d9b640 1 -- 172.21.15.73:0/3439627301 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2a98003520 con 0x7f2aac06db70 2023-12-12T09:43:37.777 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:37.776+0000 7f2aaad9d640 1 -- 172.21.15.73:0/3439627301 >> v1:172.21.15.142:6789/0 conn(0x7f2aac14fa40 legacy=0x7f2aac06a4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:37.777 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:37.776+0000 7f2aaad9d640 1 -- 172.21.15.73:0/3439627301 >> v1:172.21.15.73:6789/0 conn(0x7f2aac06db70 legacy=0x7f2aac0c39b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:37.777 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:37.776+0000 7f2aaad9d640 1 -- 172.21.15.73:0/3439627301 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2aac152eb0 con 0x7f2aac0c5070 2023-12-12T09:43:37.777 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:37.777+0000 7f2aaad9d640 1 --2- 172.21.15.73:0/3439627301 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2aac0c5070 0x7f2aac0c40c0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f2aa4009d90 tx=0x7f2aa402beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3429d04479e2a67 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:43:37.778 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:37.778+0000 7f2aa9d9b640 1 -- 172.21.15.73:0/3439627301 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2aa402cc60 con 0x7f2aac0c5070 2023-12-12T09:43:37.778 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:37.778+0000 7f2aa9d9b640 1 -- 172.21.15.73:0/3439627301 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2aa402cdc0 con 0x7f2aac0c5070 2023-12-12T09:43:37.778 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:37.778+0000 7f2aa9d9b640 1 -- 172.21.15.73:0/3439627301 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2aa4034660 con 0x7f2aac0c5070 2023-12-12T09:43:37.779 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:37.778+0000 7f2ab0e2b640 1 -- 172.21.15.73:0/3439627301 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2aac0c5070 msgr2=0x7f2aac0c40c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:37.779 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:37.778+0000 7f2ab0e2b640 1 --2- 172.21.15.73:0/3439627301 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2aac0c5070 0x7f2aac0c40c0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f2aa4009d90 tx=0x7f2aa402beb0 comp rx=0 tx=0).stop 2023-12-12T09:43:37.779 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:37.778+0000 7f2ab0e2b640 1 -- 172.21.15.73:0/3439627301 shutdown_connections 2023-12-12T09:43:37.779 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:37.778+0000 7f2ab0e2b640 1 --2- 172.21.15.73:0/3439627301 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2aac0c5070 0x7f2aac0c40c0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:37.779 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:37.778+0000 7f2ab0e2b640 1 -- 172.21.15.73:0/3439627301 >> 172.21.15.73:0/3439627301 conn(0x7f2aac0a8130 msgr2=0x7f2aac0c24b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:43:37.779 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:37.778+0000 7f2ab0e2b640 1 -- 172.21.15.73:0/3439627301 shutdown_connections 2023-12-12T09:43:37.779 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:37.778+0000 7f2ab0e2b640 1 -- 172.21.15.73:0/3439627301 wait complete. 2023-12-12T09:43:37.780 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:37.780+0000 7f2ab0e2b640 1 Processor -- start 2023-12-12T09:43:37.780 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:37.780+0000 7f2ab0e2b640 1 -- start start 2023-12-12T09:43:37.782 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:37.781+0000 7f2ab0e2b640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2aac06db70 0x7f2aac151080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:37.783 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:37.781+0000 7f2ab0e2b640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2aac0c5070 0x7f2aac070bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:37.783 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:37.781+0000 7f2ab0e2b640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2aac14fa40 0x7f2aac071130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:37.783 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:37.781+0000 7f2ab0e2b640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2aac14b990 con 0x7f2aac0c5070 2023-12-12T09:43:37.783 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:37.781+0000 7f2ab0e2b640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2aac070710 con 0x7f2aac06db70 2023-12-12T09:43:37.783 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:37.781+0000 7f2ab0e2b640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2aac151a70 con 0x7f2aac14fa40 2023-12-12T09:43:37.783 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:37.781+0000 7f2aa3fff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2aac0c5070 0x7f2aac070bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:37.783 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:37.781+0000 7f2aa3fff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2aac0c5070 0x7f2aac070bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:57050/0 (socket says 172.21.15.73:57050) 2023-12-12T09:43:37.783 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:37.781+0000 7f2aa3fff640 1 -- 172.21.15.73:0/3728292681 learned_addr learned my addr 172.21.15.73:0/3728292681 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:43:37.783 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:37.782+0000 7f2aaa59c640 1 --2- 172.21.15.73:0/3728292681 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2aac06db70 0x7f2aac151080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:37.783 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:37.782+0000 7f2aaad9d640 1 --2- 172.21.15.73:0/3728292681 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2aac14fa40 0x7f2aac071130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:37.783 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:37.782+0000 7f2aa3fff640 1 -- 172.21.15.73:0/3728292681 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2aac14fa40 msgr2=0x7f2aac071130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:37.783 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:37.782+0000 7f2aa3fff640 1 --2- 172.21.15.73:0/3728292681 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2aac14fa40 0x7f2aac071130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:37.783 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:37.782+0000 7f2aa3fff640 1 -- 172.21.15.73:0/3728292681 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2aac06db70 msgr2=0x7f2aac151080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:37.784 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:37.782+0000 7f2aa3fff640 1 --2- 172.21.15.73:0/3728292681 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2aac06db70 0x7f2aac151080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:37.784 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:37.782+0000 7f2aa3fff640 1 -- 172.21.15.73:0/3728292681 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2aa4009a70 con 0x7f2aac0c5070 2023-12-12T09:43:37.784 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:37.782+0000 7f2aa3fff640 1 --2- 172.21.15.73:0/3728292681 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2aac0c5070 0x7f2aac070bf0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f2a9400c410 tx=0x7f2a9400c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:43:37.784 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:37.782+0000 7f2aa2ffd640 1 -- 172.21.15.73:0/3728292681 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a94005ce0 con 0x7f2aac0c5070 2023-12-12T09:43:37.784 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:37.782+0000 7f2aa2ffd640 1 -- 172.21.15.73:0/3728292681 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a94005e40 con 0x7f2aac0c5070 2023-12-12T09:43:37.784 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:37.782+0000 7f2aa2ffd640 1 -- 172.21.15.73:0/3728292681 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a940072f0 con 0x7f2aac0c5070 2023-12-12T09:43:37.784 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:37.782+0000 7f2ab0e2b640 1 -- 172.21.15.73:0/3728292681 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2aac1ea680 con 0x7f2aac0c5070 2023-12-12T09:43:37.784 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:37.783+0000 7f2ab0e2b640 1 -- 172.21.15.73:0/3728292681 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2aac1515c0 con 0x7f2aac0c5070 2023-12-12T09:43:37.784 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:37.784+0000 7f2ab0e2b640 1 -- 172.21.15.73:0/3728292681 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2aac1ea4d0 con 0x7f2aac0c5070 2023-12-12T09:43:37.785 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:37.785+0000 7f2aa2ffd640 1 -- 172.21.15.73:0/3728292681 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f2a94007450 con 0x7f2aac0c5070 2023-12-12T09:43:37.785 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:37.785+0000 7f2aa2ffd640 1 --2- 172.21.15.73:0/3728292681 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f2a8c06ae70 0x7f2a8c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:37.785 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:37.786+0000 7f2aa2ffd640 1 -- 172.21.15.73:0/3728292681 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2a94088ca0 con 0x7f2aac0c5070 2023-12-12T09:43:37.785 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:37.786+0000 7f2aaa59c640 1 --2- 172.21.15.73:0/3728292681 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f2a8c06ae70 0x7f2a8c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:37.786 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:37.786+0000 7f2aaa59c640 1 --2- 172.21.15.73:0/3728292681 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f2a8c06ae70 0x7f2a8c06d330 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f2aac0c4df0 tx=0x7f2a9c009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:43:37.789 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:37.790+0000 7f2aa2ffd640 1 -- 172.21.15.73:0/3728292681 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f2a94057890 con 0x7f2aac0c5070 2023-12-12T09:43:37.981 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:37.981+0000 7f2ab0e2b640 1 -- 172.21.15.73:0/3728292681 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2aac067580 con 0x7f2aac0c5070 2023-12-12T09:43:37.983 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:37.984+0000 7f2aa2ffd640 1 -- 172.21.15.73:0/3728292681 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16517 (secure 0 0 0) 0x7f2a94017090 con 0x7f2aac0c5070 2023-12-12T09:43:37.984 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-12T09:43:37.984 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":21,"fsid":"ba240992-02b8-4c7e-92f2-27eb29ac433b","created":"2023-12-12T09:43:02.454719+0000","modified":"2023-12-12T09:43:23.219345+0000","last_up_change":"2023-12-12T09:43:13.913440+0000","last_in_change":"2023-12-12T09:43:05.925348+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-12T09:43:15.525508+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-12T09:43:20.004546+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-12T09:43:20.736500+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"dd9074be-dbe2-4c34-9896-a4223d8d3940","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":4047810203},{"type":"v1","addr":"172.21.15.73:6801","nonce":4047810203}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":4047810203},{"type":"v1","addr":"172.21.15.73:6803","nonce":4047810203}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":4047810203},{"type":"v1","addr":"172.21.15.73:6807","nonce":4047810203}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":4047810203},{"type":"v1","addr":"172.21.15.73:6805","nonce":4047810203}]},"public_addr":"172.21.15.73:6801/4047810203","cluster_addr":"172.21.15.73:6803/4047810203","heartbeat_back_addr":"172.21.15.73:6807/4047810203","heartbeat_front_addr":"172.21.15.73:6805/4047810203","state":["exists","up"]},{"osd":1,"uuid":"c4a05052-96d4-4758-a4e1-1a37f1e07fed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":1356058331},{"type":"v1","addr":"172.21.15.73:6824","nonce":1356058331}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":1356058331},{"type":"v1","addr":"172.21.15.73:6827","nonce":1356058331}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":1356058331},{"type":"v1","addr":"172.21.15.73:6831","nonce":1356058331}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":1356058331},{"type":"v1","addr":"172.21.15.73:6829","nonce":1356058331}]},"public_addr":"172.21.15.73:6824/1356058331","cluster_addr":"172.21.15.73:6827/1356058331","heartbeat_back_addr":"172.21.15.73:6831/1356058331","heartbeat_front_addr":"172.21.15.73:6829/1356058331","state":["exists","up"]},{"osd":2,"uuid":"512bc8ac-72c2-40d4-b3d2-d867a92c5213","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":1228903316},{"type":"v1","addr":"172.21.15.73:6817","nonce":1228903316}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":1228903316},{"type":"v1","addr":"172.21.15.73:6819","nonce":1228903316}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6823","nonce":1228903316},{"type":"v1","addr":"172.21.15.73:6825","nonce":1228903316}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":1228903316},{"type":"v1","addr":"172.21.15.73:6821","nonce":1228903316}]},"public_addr":"172.21.15.73:6817/1228903316","cluster_addr":"172.21.15.73:6819/1228903316","heartbeat_back_addr":"172.21.15.73:6825/1228903316","heartbeat_front_addr":"172.21.15.73:6821/1228903316","state":["exists","up"]},{"osd":3,"uuid":"3d1a91e0-42bf-437a-8eae-8d357c8f63a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":1293329670},{"type":"v1","addr":"172.21.15.73:6809","nonce":1293329670}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6810","nonce":1293329670},{"type":"v1","addr":"172.21.15.73:6811","nonce":1293329670}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":1293329670},{"type":"v1","addr":"172.21.15.73:6815","nonce":1293329670}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":1293329670},{"type":"v1","addr":"172.21.15.73:6813","nonce":1293329670}]},"public_addr":"172.21.15.73:6809/1293329670","cluster_addr":"172.21.15.73:6811/1293329670","heartbeat_back_addr":"172.21.15.73:6815/1293329670","heartbeat_front_addr":"172.21.15.73:6813/1293329670","state":["exists","up"]},{"osd":4,"uuid":"4b302fff-834c-4069-ac19-00e46f6c87b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":3727975702},{"type":"v1","addr":"172.21.15.142:6801","nonce":3727975702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":3727975702},{"type":"v1","addr":"172.21.15.142:6803","nonce":3727975702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6809","nonce":3727975702},{"type":"v1","addr":"172.21.15.142:6811","nonce":3727975702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6805","nonce":3727975702},{"type":"v1","addr":"172.21.15.142:6807","nonce":3727975702}]},"public_addr":"172.21.15.142:6801/3727975702","cluster_addr":"172.21.15.142:6803/3727975702","heartbeat_back_addr":"172.21.15.142:6811/3727975702","heartbeat_front_addr":"172.21.15.142:6807/3727975702","state":["exists","up"]},{"osd":5,"uuid":"d7cdace2-67d0-45cc-95f2-515cf6ef1b82","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6817","nonce":2353193632},{"type":"v1","addr":"172.21.15.142:6819","nonce":2353193632}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6821","nonce":2353193632},{"type":"v1","addr":"172.21.15.142:6823","nonce":2353193632}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6829","nonce":2353193632},{"type":"v1","addr":"172.21.15.142:6831","nonce":2353193632}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6825","nonce":2353193632},{"type":"v1","addr":"172.21.15.142:6827","nonce":2353193632}]},"public_addr":"172.21.15.142:6819/2353193632","cluster_addr":"172.21.15.142:6823/2353193632","heartbeat_back_addr":"172.21.15.142:6831/2353193632","heartbeat_front_addr":"172.21.15.142:6827/2353193632","state":["exists","up"]},{"osd":6,"uuid":"649ce78a-5626-445c-aedc-a651ed05a6f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":2006111986},{"type":"v1","addr":"172.21.15.142:6806","nonce":2006111986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":2006111986},{"type":"v1","addr":"172.21.15.142:6810","nonce":2006111986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":2006111986},{"type":"v1","addr":"172.21.15.142:6815","nonce":2006111986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":2006111986},{"type":"v1","addr":"172.21.15.142:6813","nonce":2006111986}]},"public_addr":"172.21.15.142:6806/2006111986","cluster_addr":"172.21.15.142:6810/2006111986","heartbeat_back_addr":"172.21.15.142:6815/2006111986","heartbeat_front_addr":"172.21.15.142:6813/2006111986","state":["exists","up"]},{"osd":7,"uuid":"af15ae3b-c1d0-4acf-92db-8a1805494d13","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":2573794341},{"type":"v1","addr":"172.21.15.142:6818","nonce":2573794341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":2573794341},{"type":"v1","addr":"172.21.15.142:6822","nonce":2573794341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":2573794341},{"type":"v1","addr":"172.21.15.142:6830","nonce":2573794341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":2573794341},{"type":"v1","addr":"172.21.15.142:6826","nonce":2573794341}]},"public_addr":"172.21.15.142:6818/2573794341","cluster_addr":"172.21.15.142:6822/2573794341","heartbeat_back_addr":"172.21.15.142:6830/2573794341","heartbeat_front_addr":"172.21.15.142:6826/2573794341","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.185824+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.262103+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.225556+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:10.523459+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:10.706035+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.257339+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.301776+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.051960+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-12T09:43:37.986 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:37.986+0000 7f2ab0e2b640 1 -- 172.21.15.73:0/3728292681 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f2a8c06ae70 msgr2=0x7f2a8c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:37.986 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:37.986+0000 7f2ab0e2b640 1 --2- 172.21.15.73:0/3728292681 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f2a8c06ae70 0x7f2a8c06d330 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f2aac0c4df0 tx=0x7f2a9c009040 comp rx=0 tx=0).stop 2023-12-12T09:43:37.986 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:37.986+0000 7f2ab0e2b640 1 -- 172.21.15.73:0/3728292681 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2aac0c5070 msgr2=0x7f2aac070bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:37.986 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:37.986+0000 7f2ab0e2b640 1 --2- 172.21.15.73:0/3728292681 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2aac0c5070 0x7f2aac070bf0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f2a9400c410 tx=0x7f2a9400c8d0 comp rx=0 tx=0).stop 2023-12-12T09:43:37.987 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:37.987+0000 7f2ab0e2b640 1 -- 172.21.15.73:0/3728292681 shutdown_connections 2023-12-12T09:43:37.987 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:37.987+0000 7f2ab0e2b640 1 --2- 172.21.15.73:0/3728292681 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f2a8c06ae70 0x7f2a8c06d330 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:37.987 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:37.987+0000 7f2ab0e2b640 1 --2- 172.21.15.73:0/3728292681 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2aac14fa40 0x7f2aac071130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:37.987 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:37.987+0000 7f2ab0e2b640 1 --2- 172.21.15.73:0/3728292681 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2aac0c5070 0x7f2aac070bf0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:37.987 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:37.987+0000 7f2ab0e2b640 1 --2- 172.21.15.73:0/3728292681 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2aac06db70 0x7f2aac151080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:37.988 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:37.987+0000 7f2ab0e2b640 1 -- 172.21.15.73:0/3728292681 >> 172.21.15.73:0/3728292681 conn(0x7f2aac0a8130 msgr2=0x7f2aac0c2440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:43:37.988 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:37.987+0000 7f2ab0e2b640 1 -- 172.21.15.73:0/3728292681 shutdown_connections 2023-12-12T09:43:37.988 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:37.987+0000 7f2ab0e2b640 1 -- 172.21.15.73:0/3728292681 wait complete. 2023-12-12T09:43:38.007 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-12T09:43:38.219 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:38.218+0000 7f780ff33640 1 Processor -- start 2023-12-12T09:43:38.219 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:38.219+0000 7f780ff33640 1 -- start start 2023-12-12T09:43:38.220 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:38.220+0000 7f780ff33640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f780806a750 0x7f7808159020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:38.220 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:38.220+0000 7f780ff33640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f7808071f00 0x7f7808155aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:38.220 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:38.220+0000 7f780ff33640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7808158b90 con 0x7f78080bfdc0 2023-12-12T09:43:38.220 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:38.220+0000 7f780ff33640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78080727c0 con 0x7f7808071f00 2023-12-12T09:43:38.220 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:38.220+0000 7f780ff33640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78081588f0 con 0x7f780806a750 2023-12-12T09:43:38.223 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:38.220+0000 7f780e4d0640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f78080bfdc0 0x7f780815bec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:34486/0 (socket says 172.21.15.73:34486) 2023-12-12T09:43:38.223 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:38.221+0000 7f780e4d0640 1 -- 172.21.15.73:0/2519605683 learned_addr learned my addr 172.21.15.73:0/2519605683 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-12T09:43:38.223 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:38.221+0000 7f780dccf640 1 --2- 172.21.15.73:0/2519605683 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f780806a750 0x7f7808159020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:38.223 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:38.221+0000 7f780d4ce640 1 --2- 172.21.15.73:0/2519605683 >> v2:172.21.15.142:3300/0 conn(0x7f7808071f00 0x7f7808155aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:38.223 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:38.221+0000 7f780cccd640 1 -- 172.21.15.73:0/2519605683 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2157379564 0 0) 0x7f7808158b90 con 0x7f78080bfdc0 2023-12-12T09:43:38.223 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:38.221+0000 7f780cccd640 1 -- 172.21.15.73:0/2519605683 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f77f4003520 con 0x7f78080bfdc0 2023-12-12T09:43:38.223 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:38.221+0000 7f780cccd640 1 -- 172.21.15.73:0/2519605683 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 775481962 0 0) 0x7f77f4003520 con 0x7f78080bfdc0 2023-12-12T09:43:38.223 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:38.221+0000 7f780cccd640 1 -- 172.21.15.73:0/2519605683 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f780806a750 msgr2=0x7f7808159020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:43:38.223 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:38.221+0000 7f780cccd640 1 --2- 172.21.15.73:0/2519605683 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f780806a750 0x7f7808159020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:38.223 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:38.221+0000 7f780cccd640 1 -- 172.21.15.73:0/2519605683 >> v2:172.21.15.142:3300/0 conn(0x7f7808071f00 msgr2=0x7f7808155aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:43:38.224 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:38.221+0000 7f780cccd640 1 --2- 172.21.15.73:0/2519605683 >> v2:172.21.15.142:3300/0 conn(0x7f7808071f00 0x7f7808155aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:38.224 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:38.221+0000 7f780cccd640 1 -- 172.21.15.73:0/2519605683 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78080c48c0 con 0x7f78080bfdc0 2023-12-12T09:43:38.224 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:38.221+0000 7f780cccd640 1 -- 172.21.15.73:0/2519605683 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3186547832 0 0) 0x7f78000019f0 con 0x7f78080bfdc0 2023-12-12T09:43:38.224 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:38.221+0000 7f780cccd640 1 -- 172.21.15.73:0/2519605683 >> v1:172.21.15.73:6789/0 conn(0x7f78080bfdc0 legacy=0x7f780815bec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:38.224 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:38.221+0000 7f780cccd640 1 --2- 172.21.15.73:0/2519605683 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f77f4003970 0x7f77f4003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:38.224 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:38.221+0000 7f780cccd640 1 --2- 172.21.15.73:0/2519605683 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f77f40047c0 0x7f77f4004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:38.224 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:38.221+0000 7f780cccd640 1 --2- 172.21.15.73:0/2519605683 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f780806a750 0x7f77f4005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:38.224 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:38.221+0000 7f780cccd640 1 -- 172.21.15.73:0/2519605683 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78080727c0 con 0x7f77f4003970 2023-12-12T09:43:38.224 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:38.221+0000 7f780cccd640 1 -- 172.21.15.73:0/2519605683 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78081588f0 con 0x7f77f40047c0 2023-12-12T09:43:38.224 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:38.221+0000 7f780cccd640 1 -- 172.21.15.73:0/2519605683 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77f400ba00 con 0x7f780806a750 2023-12-12T09:43:38.224 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:38.222+0000 7f780dccf640 1 --2- 172.21.15.73:0/2519605683 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f77f4003970 0x7f77f4003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:38.224 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:38.222+0000 7f780d4ce640 1 --2- 172.21.15.73:0/2519605683 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f77f40047c0 0x7f77f4004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:38.224 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:38.222+0000 7f780e4d0640 1 --2- 172.21.15.73:0/2519605683 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f780806a750 0x7f77f4005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:38.225 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:38.222+0000 7f780dccf640 1 -- 172.21.15.73:0/2519605683 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f780806a750 msgr2=0x7f77f4005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:43:38.225 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:38.222+0000 7f780dccf640 1 --2- 172.21.15.73:0/2519605683 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f780806a750 0x7f77f4005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:38.225 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:38.222+0000 7f780dccf640 1 -- 172.21.15.73:0/2519605683 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f77f40047c0 msgr2=0x7f77f4004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:43:38.225 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:38.222+0000 7f780dccf640 1 --2- 172.21.15.73:0/2519605683 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f77f40047c0 0x7f77f4004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:38.225 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:38.222+0000 7f780dccf640 1 -- 172.21.15.73:0/2519605683 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77f4003520 con 0x7f77f4003970 2023-12-12T09:43:38.225 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:38.222+0000 7f780e4d0640 1 --2- 172.21.15.73:0/2519605683 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f780806a750 0x7f77f4005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:43:38.225 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:38.222+0000 7f780d4ce640 1 --2- 172.21.15.73:0/2519605683 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f77f40047c0 0x7f77f4004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-12T09:43:38.226 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:38.224+0000 7f780dccf640 1 --2- 172.21.15.73:0/2519605683 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f77f4003970 0x7f77f4003d90 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f7804009ac0 tx=0x7f77f40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=127d6ad905ee4258 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:43:38.226 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:38.224+0000 7f780cccd640 1 -- 172.21.15.73:0/2519605683 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f780402c6b0 con 0x7f77f4003970 2023-12-12T09:43:38.226 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:38.224+0000 7f780cccd640 1 -- 172.21.15.73:0/2519605683 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f780402c810 con 0x7f77f4003970 2023-12-12T09:43:38.226 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:38.224+0000 7f780cccd640 1 -- 172.21.15.73:0/2519605683 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f780402cba0 con 0x7f77f4003970 2023-12-12T09:43:38.226 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:38.225+0000 7f780ff33640 1 -- 172.21.15.73:0/2519605683 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f77f4003970 msgr2=0x7f77f4003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:38.226 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:38.225+0000 7f780ff33640 1 --2- 172.21.15.73:0/2519605683 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f77f4003970 0x7f77f4003d90 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f7804009ac0 tx=0x7f77f40057f0 comp rx=0 tx=0).stop 2023-12-12T09:43:38.227 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:38.225+0000 7f780e4d0640 1 -- 172.21.15.73:0/2519605683 reap_dead start 2023-12-12T09:43:38.227 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:38.225+0000 7f780ff33640 1 -- 172.21.15.73:0/2519605683 shutdown_connections 2023-12-12T09:43:38.227 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:38.225+0000 7f780ff33640 1 -- 172.21.15.73:0/2519605683 >> 172.21.15.73:0/2519605683 conn(0x7f78080a8130 msgr2=0x7f78080c24b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:43:38.227 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:38.225+0000 7f780ff33640 1 -- 172.21.15.73:0/2519605683 shutdown_connections 2023-12-12T09:43:38.227 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:38.225+0000 7f780ff33640 1 -- 172.21.15.73:0/2519605683 wait complete. 2023-12-12T09:43:38.227 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:38.227+0000 7f780ff33640 1 Processor -- start 2023-12-12T09:43:38.227 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:38.227+0000 7f780ff33640 1 -- start start 2023-12-12T09:43:38.229 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:38.228+0000 7f780ff33640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f77f4003970 0x7f78081e41d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:38.230 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:38.228+0000 7f780ff33640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f78081e1f30 0x7f78081459a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:38.230 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:38.228+0000 7f780ff33640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7808153f20 0x7f7808145ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:38.230 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:38.228+0000 7f780ff33640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f780815ac40 con 0x7f78081e1f30 2023-12-12T09:43:38.230 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:38.228+0000 7f780ff33640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78081ef680 con 0x7f77f4003970 2023-12-12T09:43:38.230 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:38.228+0000 7f780ff33640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78081ef120 con 0x7f7808153f20 2023-12-12T09:43:38.230 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:38.228+0000 7f780d4ce640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f78081e1f30 0x7f78081459a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:38.230 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:38.228+0000 7f780d4ce640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f78081e1f30 0x7f78081459a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:57054/0 (socket says 172.21.15.73:57054) 2023-12-12T09:43:38.230 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:38.228+0000 7f780d4ce640 1 -- 172.21.15.73:0/851350813 learned_addr learned my addr 172.21.15.73:0/851350813 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:43:38.230 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:38.228+0000 7f780e4d0640 1 --2- 172.21.15.73:0/851350813 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7808153f20 0x7f7808145ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:38.230 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:38.228+0000 7f780dccf640 1 --2- 172.21.15.73:0/851350813 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f77f4003970 0x7f78081e41d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:38.230 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:38.229+0000 7f780d4ce640 1 -- 172.21.15.73:0/851350813 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7808153f20 msgr2=0x7f7808145ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:38.231 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:38.229+0000 7f780d4ce640 1 --2- 172.21.15.73:0/851350813 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7808153f20 0x7f7808145ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:38.231 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:38.229+0000 7f780d4ce640 1 -- 172.21.15.73:0/851350813 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f77f4003970 msgr2=0x7f78081e41d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:38.231 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:38.229+0000 7f780d4ce640 1 --2- 172.21.15.73:0/851350813 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f77f4003970 0x7f78081e41d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:38.231 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:38.229+0000 7f780d4ce640 1 -- 172.21.15.73:0/851350813 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78081ef3a0 con 0x7f78081e1f30 2023-12-12T09:43:38.231 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:38.229+0000 7f780d4ce640 1 --2- 172.21.15.73:0/851350813 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f78081e1f30 0x7f78081459a0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f77f80116d0 tx=0x7f77f8011b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:43:38.231 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:38.229+0000 7f77fe7fc640 1 -- 172.21.15.73:0/851350813 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77f800f960 con 0x7f78081e1f30 2023-12-12T09:43:38.231 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:38.229+0000 7f77fe7fc640 1 -- 172.21.15.73:0/851350813 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77f800fac0 con 0x7f78081e1f30 2023-12-12T09:43:38.231 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:38.229+0000 7f77fe7fc640 1 -- 172.21.15.73:0/851350813 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77f800fe50 con 0x7f78081e1f30 2023-12-12T09:43:38.231 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:38.229+0000 7f780ff33640 1 -- 172.21.15.73:0/851350813 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f780815bfd0 con 0x7f78081e1f30 2023-12-12T09:43:38.231 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:38.229+0000 7f780ff33640 1 -- 172.21.15.73:0/851350813 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7808146420 con 0x7f78081e1f30 2023-12-12T09:43:38.232 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:38.231+0000 7f780ff33640 1 -- 172.21.15.73:0/851350813 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f780806cac0 con 0x7f78081e1f30 2023-12-12T09:43:38.232 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:38.231+0000 7f77fe7fc640 1 -- 172.21.15.73:0/851350813 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f77f8015460 con 0x7f78081e1f30 2023-12-12T09:43:38.232 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:38.232+0000 7f77fe7fc640 1 --2- 172.21.15.73:0/851350813 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f77ec06ae70 0x7f77ec06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:38.232 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:38.232+0000 7f77fe7fc640 1 -- 172.21.15.73:0/851350813 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f77f8089e20 con 0x7f78081e1f30 2023-12-12T09:43:38.232 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:38.232+0000 7f780dccf640 1 --2- 172.21.15.73:0/851350813 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f77ec06ae70 0x7f77ec06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:38.233 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:38.233+0000 7f780dccf640 1 --2- 172.21.15.73:0/851350813 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f77ec06ae70 0x7f77ec06d330 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f7804036000 tx=0x7f7804030000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:43:38.236 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:38.236+0000 7f77fe7fc640 1 -- 172.21.15.73:0/851350813 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f77f8054ec0 con 0x7f78081e1f30 2023-12-12T09:43:38.467 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:38.467+0000 7f780ff33640 1 -- 172.21.15.73:0/851350813 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7808067920 con 0x7f78081e1f30 2023-12-12T09:43:38.468 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:38.468+0000 7f77fe7fc640 1 -- 172.21.15.73:0/851350813 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4913 (secure 0 0 0) 0x7f77f8022090 con 0x7f78081e1f30 2023-12-12T09:43:38.468 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-12T09:43:38.468 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4257,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6835/1079394562","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":1079394562},{"type":"v1","addr":"172.21.15.73:6835","nonce":1079394562}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4258,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6835/3726638062","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6833","nonce":3726638062},{"type":"v1","addr":"172.21.15.142:6835","nonce":3726638062}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4260,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6837/2513898821","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6836","nonce":2513898821},{"type":"v1","addr":"172.21.15.73:6837","nonce":2513898821}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-12T09:43:21.720752+0000","modified":"2023-12-12T09:43:24.801495+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4269},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4269":{"gid":4269,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.142:6834/1773392257","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6832","nonce":1773392257},{"type":"v1","addr":"172.21.15.142:6834","nonce":1773392257}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-12-12T09:43:38.468 INFO:teuthology.orchestra.run.smithi073.stderr:dumped fsmap epoch 8 2023-12-12T09:43:38.470 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:38.470+0000 7f780ff33640 1 -- 172.21.15.73:0/851350813 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f77ec06ae70 msgr2=0x7f77ec06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:38.471 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:38.470+0000 7f780ff33640 1 --2- 172.21.15.73:0/851350813 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f77ec06ae70 0x7f77ec06d330 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f7804036000 tx=0x7f7804030000 comp rx=0 tx=0).stop 2023-12-12T09:43:38.471 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:38.470+0000 7f780ff33640 1 -- 172.21.15.73:0/851350813 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f78081e1f30 msgr2=0x7f78081459a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:38.471 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:38.470+0000 7f780ff33640 1 --2- 172.21.15.73:0/851350813 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f78081e1f30 0x7f78081459a0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f77f80116d0 tx=0x7f77f8011b90 comp rx=0 tx=0).stop 2023-12-12T09:43:38.471 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:38.470+0000 7f780ff33640 1 -- 172.21.15.73:0/851350813 shutdown_connections 2023-12-12T09:43:38.471 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:38.470+0000 7f780ff33640 1 --2- 172.21.15.73:0/851350813 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f77ec06ae70 0x7f77ec06d330 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:38.471 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:38.470+0000 7f780ff33640 1 --2- 172.21.15.73:0/851350813 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7808153f20 0x7f7808145ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:38.471 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:38.470+0000 7f780ff33640 1 --2- 172.21.15.73:0/851350813 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f78081e1f30 0x7f78081459a0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:38.471 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:38.470+0000 7f780ff33640 1 --2- 172.21.15.73:0/851350813 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f77f4003970 0x7f78081e41d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:38.471 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:38.470+0000 7f780ff33640 1 -- 172.21.15.73:0/851350813 >> 172.21.15.73:0/851350813 conn(0x7f78080a8130 msgr2=0x7f78080c1280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:43:38.471 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:38.471+0000 7f780ff33640 1 -- 172.21.15.73:0/851350813 shutdown_connections 2023-12-12T09:43:38.471 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:38.471+0000 7f780ff33640 1 -- 172.21.15.73:0/851350813 wait complete. 2023-12-12T09:43:38.893 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 8, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-12-12T09:43:21.720752+0000', 'modified': '2023-12-12T09:43:24.801495+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4269}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4269': {'gid': 4269, 'name': 'd', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.142:6834/1773392257', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.142:6832', 'nonce': 1773392257}, {'type': 'v1', 'addr': '172.21.15.142:6834', 'nonce': 1773392257}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-12-12T09:43:38.893 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-12-12T09:43:38.893 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2023-12-12T09:43:39.115 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:39.115+0000 7f0efef2c640 1 Processor -- start 2023-12-12T09:43:39.115 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:39.115+0000 7f0efef2c640 1 -- start start 2023-12-12T09:43:39.117 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:39.116+0000 7f0efef2c640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0ef80a4f00 0x7f0ef8151ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:39.117 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:39.116+0000 7f0efef2c640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f0ef80c14f0 0x7f0ef80c1960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:39.117 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:39.117+0000 7f0efef2c640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ef80c04c0 con 0x7f0ef80c3920 2023-12-12T09:43:39.117 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:39.117+0000 7f0efef2c640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ef80c58c0 con 0x7f0ef80c14f0 2023-12-12T09:43:39.117 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:39.117+0000 7f0efef2c640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ef8152220 con 0x7f0ef80a4f00 2023-12-12T09:43:39.117 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:39.117+0000 7f0efd4c9640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f0ef80c14f0 0x7f0ef80c1960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:39.117 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:39.117+0000 7f0efd4c9640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f0ef80c14f0 0x7f0ef80c1960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:41218/0 (socket says 172.21.15.73:41218) 2023-12-12T09:43:39.117 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:39.117+0000 7f0efd4c9640 1 -- 172.21.15.73:0/674747860 learned_addr learned my addr 172.21.15.73:0/674747860 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:43:39.117 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:39.117+0000 7f0ef7fff640 1 --1- 172.21.15.73:0/674747860 >> v1:172.21.15.73:6789/0 conn(0x7f0ef80c3920 0x7f0ef814e480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:36676/0 (socket says 172.21.15.73:36676) 2023-12-12T09:43:39.118 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:39.117+0000 7f0efccc8640 1 --2- 172.21.15.73:0/674747860 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0ef80a4f00 0x7f0ef8151ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:39.118 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:39.117+0000 7f0efd4c9640 1 -- 172.21.15.73:0/674747860 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0ef80a4f00 msgr2=0x7f0ef8151ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:43:39.118 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:39.117+0000 7f0efd4c9640 1 --2- 172.21.15.73:0/674747860 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0ef80a4f00 0x7f0ef8151ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:39.118 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:39.117+0000 7f0efd4c9640 1 -- 172.21.15.73:0/674747860 >> v1:172.21.15.73:6789/0 conn(0x7f0ef80c3920 legacy=0x7f0ef814e480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:39.118 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:39.117+0000 7f0ef77fe640 1 -- 172.21.15.73:0/674747860 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3143716522 0 0) 0x7f0ef80c04c0 con 0x7f0ef80c3920 2023-12-12T09:43:39.118 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:39.117+0000 7f0efd4c9640 1 -- 172.21.15.73:0/674747860 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ef80c0730 con 0x7f0ef80c14f0 2023-12-12T09:43:39.119 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:39.118+0000 7f0efd4c9640 1 --2- 172.21.15.73:0/674747860 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0ef80c14f0 0x7f0ef80c1960 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f0ef000d150 tx=0x7f0ef002e0e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25a51d685fc761f9 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:43:39.119 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:39.119+0000 7f0ef77fe640 1 -- 172.21.15.73:0/674747860 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ef002ea80 con 0x7f0ef80c14f0 2023-12-12T09:43:39.120 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:39.119+0000 7f0ef77fe640 1 -- 172.21.15.73:0/674747860 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ef002ebe0 con 0x7f0ef80c14f0 2023-12-12T09:43:39.120 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:39.119+0000 7f0ef77fe640 1 -- 172.21.15.73:0/674747860 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ef0009600 con 0x7f0ef80c14f0 2023-12-12T09:43:39.120 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:39.119+0000 7f0efef2c640 1 -- 172.21.15.73:0/674747860 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0ef80c14f0 msgr2=0x7f0ef80c1960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:39.120 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:39.119+0000 7f0efef2c640 1 --2- 172.21.15.73:0/674747860 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0ef80c14f0 0x7f0ef80c1960 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f0ef000d150 tx=0x7f0ef002e0e0 comp rx=0 tx=0).stop 2023-12-12T09:43:39.120 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:39.119+0000 7f0efef2c640 1 -- 172.21.15.73:0/674747860 shutdown_connections 2023-12-12T09:43:39.120 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:39.119+0000 7f0efef2c640 1 --2- 172.21.15.73:0/674747860 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0ef80c14f0 0x7f0ef80c1960 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:39.120 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:39.119+0000 7f0efef2c640 1 --2- 172.21.15.73:0/674747860 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0ef80a4f00 0x7f0ef8151ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:39.120 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:39.119+0000 7f0efef2c640 1 -- 172.21.15.73:0/674747860 >> 172.21.15.73:0/674747860 conn(0x7f0ef80a77d0 msgr2=0x7f0ef80a7bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:43:39.120 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:39.120+0000 7f0efef2c640 1 -- 172.21.15.73:0/674747860 shutdown_connections 2023-12-12T09:43:39.120 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:39.120+0000 7f0efef2c640 1 -- 172.21.15.73:0/674747860 wait complete. 2023-12-12T09:43:39.121 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:39.121+0000 7f0efef2c640 1 Processor -- start 2023-12-12T09:43:39.121 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:39.121+0000 7f0efef2c640 1 -- start start 2023-12-12T09:43:39.123 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:39.122+0000 7f0efef2c640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0ef80a4f00 0x7f0ef80a5cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:39.123 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:39.122+0000 7f0efef2c640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0ef80c14f0 0x7f0ef814d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:39.123 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:39.122+0000 7f0efef2c640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0ef80c3920 0x7f0ef8153590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:39.123 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:39.122+0000 7f0efef2c640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ef80a6df0 con 0x7f0ef80c3920 2023-12-12T09:43:39.123 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:39.122+0000 7f0efef2c640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ef80a6fd0 con 0x7f0ef80a4f00 2023-12-12T09:43:39.123 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:39.122+0000 7f0efef2c640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ef80a72b0 con 0x7f0ef80c14f0 2023-12-12T09:43:39.123 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:39.123+0000 7f0efd4c9640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0ef80c3920 0x7f0ef8153590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:39.123 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:39.123+0000 7f0efd4c9640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0ef80c3920 0x7f0ef8153590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:41220/0 (socket says 172.21.15.73:41220) 2023-12-12T09:43:39.124 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:39.123+0000 7f0efd4c9640 1 -- 172.21.15.73:0/3834015869 learned_addr learned my addr 172.21.15.73:0/3834015869 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:43:39.124 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:39.123+0000 7f0ef7fff640 1 --2- 172.21.15.73:0/3834015869 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0ef80c14f0 0x7f0ef814d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:39.124 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:39.123+0000 7f0efd4c9640 1 -- 172.21.15.73:0/3834015869 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0ef80c14f0 msgr2=0x7f0ef814d1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:39.124 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:39.123+0000 7f0efd4c9640 1 --2- 172.21.15.73:0/3834015869 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0ef80c14f0 0x7f0ef814d1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:39.124 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:39.123+0000 7f0efd4c9640 1 -- 172.21.15.73:0/3834015869 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0ef80a4f00 msgr2=0x7f0ef80a5cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:39.124 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:39.123+0000 7f0efd4c9640 1 --2- 172.21.15.73:0/3834015869 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0ef80a4f00 0x7f0ef80a5cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:39.124 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:39.123+0000 7f0efd4c9640 1 -- 172.21.15.73:0/3834015869 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ef000bd40 con 0x7f0ef80c3920 2023-12-12T09:43:39.124 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:39.123+0000 7f0ef7fff640 1 --2- 172.21.15.73:0/3834015869 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0ef80c14f0 0x7f0ef814d1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:43:39.124 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:39.123+0000 7f0efd4c9640 1 --2- 172.21.15.73:0/3834015869 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0ef80c3920 0x7f0ef8153590 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f0ef0038040 tx=0x7f0ef0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:43:39.125 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:39.124+0000 7f0ef57fa640 1 -- 172.21.15.73:0/3834015869 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ef002ea80 con 0x7f0ef80c3920 2023-12-12T09:43:39.125 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:39.124+0000 7f0ef57fa640 1 -- 172.21.15.73:0/3834015869 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ef0036820 con 0x7f0ef80c3920 2023-12-12T09:43:39.125 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:39.124+0000 7f0ef57fa640 1 -- 172.21.15.73:0/3834015869 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ef0036bd0 con 0x7f0ef80c3920 2023-12-12T09:43:39.125 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:39.124+0000 7f0efef2c640 1 -- 172.21.15.73:0/3834015869 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ef8152d90 con 0x7f0ef80c3920 2023-12-12T09:43:39.125 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:39.124+0000 7f0efef2c640 1 -- 172.21.15.73:0/3834015869 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ef814d710 con 0x7f0ef80c3920 2023-12-12T09:43:39.125 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:39.126+0000 7f0ef57fa640 1 -- 172.21.15.73:0/3834015869 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f0ef002ed50 con 0x7f0ef80c3920 2023-12-12T09:43:39.127 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:39.127+0000 7f0ef57fa640 1 --2- 172.21.15.73:0/3834015869 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f0edc06ae40 0x7f0edc06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:39.127 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:39.127+0000 7f0ef57fa640 1 -- 172.21.15.73:0/3834015869 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0ef00ac9a0 con 0x7f0ef80c3920 2023-12-12T09:43:39.127 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:39.127+0000 7f0efccc8640 1 --2- 172.21.15.73:0/3834015869 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f0edc06ae40 0x7f0edc06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:39.127 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:39.128+0000 7f0f01b98740 1 Processor -- start 2023-12-12T09:43:39.128 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:39.128+0000 7f0efccc8640 1 --2- 172.21.15.73:0/3834015869 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f0edc06ae40 0x7f0edc06d300 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f0eec00a810 tx=0x7f0eec008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:43:39.128 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:39.128+0000 7f0f01b98740 1 -- start start 2023-12-12T09:43:39.130 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:39.129+0000 7f0f01b98740 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55eac64bbab0 0x55eac64f63a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:39.130 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:39.129+0000 7f0f01b98740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55eac64bbe90 0x55eac64f68e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:39.130 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:39.129+0000 7f0f01b98740 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55eac64bcb40 0x55eac64f7910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:39.130 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:39.129+0000 7f0f01b98740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eac6428f40 con 0x55eac64bbe90 2023-12-12T09:43:39.130 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:39.129+0000 7f0f01b98740 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eac6426630 con 0x55eac64bbab0 2023-12-12T09:43:39.130 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:39.129+0000 7f0f01b98740 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x55eac6421f20 con 0x55eac64bcb40 2023-12-12T09:43:39.130 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:39.129+0000 7f0ef7fff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55eac64bbe90 0x55eac64f68e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:39.130 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:39.129+0000 7f0ef7fff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55eac64bbe90 0x55eac64f68e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:41234/0 (socket says 172.21.15.73:41234) 2023-12-12T09:43:39.130 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:39.129+0000 7f0ef7fff640 1 -- 172.21.15.73:0/444203113 learned_addr learned my addr 172.21.15.73:0/444203113 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:43:39.130 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:39.129+0000 7f0efccc8640 1 --2- 172.21.15.73:0/444203113 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55eac64bbab0 0x55eac64f63a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:39.131 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:39.129+0000 7f0efd4c9640 1 --2- 172.21.15.73:0/444203113 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55eac64bcb40 0x55eac64f7910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:39.131 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:39.129+0000 7f0ef7fff640 1 -- 172.21.15.73:0/444203113 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55eac64bcb40 msgr2=0x55eac64f7910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:43:39.131 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:39.129+0000 7f0ef7fff640 1 --2- 172.21.15.73:0/444203113 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55eac64bcb40 0x55eac64f7910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:39.131 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:39.129+0000 7f0ef7fff640 1 -- 172.21.15.73:0/444203113 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55eac64bbab0 msgr2=0x55eac64f63a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:43:39.131 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:39.129+0000 7f0ef7fff640 1 --2- 172.21.15.73:0/444203113 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55eac64bbab0 0x55eac64f63a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:39.131 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:39.129+0000 7f0ef7fff640 1 -- 172.21.15.73:0/444203113 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55eac63e4910 con 0x55eac64bbe90 2023-12-12T09:43:39.131 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:39.129+0000 7f0efccc8640 1 --2- 172.21.15.73:0/444203113 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55eac64bbab0 0x55eac64f63a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:43:39.131 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:39.130+0000 7f0ef7fff640 1 --2- 172.21.15.73:0/444203113 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55eac64bbe90 0x55eac64f68e0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f0ee4001830 tx=0x7f0ee4001cf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66e9aacad1f2afd7 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:43:39.131 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:39.130+0000 7f0ee27fc640 1 -- 172.21.15.73:0/444203113 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ee40074e0 con 0x55eac64bbe90 2023-12-12T09:43:39.131 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:39.130+0000 7f0ee27fc640 1 -- 172.21.15.73:0/444203113 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ee4007640 con 0x55eac64bbe90 2023-12-12T09:43:39.131 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:39.130+0000 7f0ee27fc640 1 -- 172.21.15.73:0/444203113 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ee40049e0 con 0x55eac64bbe90 2023-12-12T09:43:39.135 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:39.130+0000 7f0f01b98740 1 -- 172.21.15.73:0/444203113 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55eac64bbe90 msgr2=0x55eac64f68e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:39.135 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:39.130+0000 7f0f01b98740 1 --2- 172.21.15.73:0/444203113 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55eac64bbe90 0x55eac64f68e0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f0ee4001830 tx=0x7f0ee4001cf0 comp rx=0 tx=0).stop 2023-12-12T09:43:39.135 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:39.131+0000 7f0f01b98740 1 -- 172.21.15.73:0/444203113 shutdown_connections 2023-12-12T09:43:39.135 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:39.131+0000 7f0f01b98740 1 --2- 172.21.15.73:0/444203113 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55eac64bcb40 0x55eac64f7910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:39.135 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:39.131+0000 7f0f01b98740 1 --2- 172.21.15.73:0/444203113 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55eac64bbe90 0x55eac64f68e0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:39.135 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:39.131+0000 7f0f01b98740 1 --2- 172.21.15.73:0/444203113 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55eac64bbab0 0x55eac64f63a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:39.135 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:39.131+0000 7f0f01b98740 1 -- 172.21.15.73:0/444203113 >> 172.21.15.73:0/444203113 conn(0x55eac64b8410 msgr2=0x55eac64dcb90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:43:39.136 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:39.131+0000 7f0f01b98740 1 -- 172.21.15.73:0/444203113 shutdown_connections 2023-12-12T09:43:39.136 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:39.131+0000 7f0f01b98740 1 -- 172.21.15.73:0/444203113 wait complete. 2023-12-12T09:43:39.136 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:39.131+0000 7f0f01b98740 1 -- start start 2023-12-12T09:43:39.136 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:39.132+0000 7f0f01b98740 1 Processor -- start 2023-12-12T09:43:39.136 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:39.133+0000 7f0f01b98740 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55eac64bbe90 0x55eac64fdbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:39.136 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:39.133+0000 7f0f01b98740 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55eac64bcb40 0x55eac64de960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:39.136 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:39.133+0000 7f0f01b98740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55eac64dfc60 0x55eac650bc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:39.136 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:39.133+0000 7f0f01b98740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eac63be2f0 con 0x55eac64dfc60 2023-12-12T09:43:39.136 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:39.133+0000 7f0f01b98740 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eac63dbc70 con 0x55eac64bbe90 2023-12-12T09:43:39.136 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:39.133+0000 7f0f01b98740 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x55eac6184f20 con 0x55eac64bcb40 2023-12-12T09:43:39.136 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:39.133+0000 7f0f01b98740 10 client.0 _ll_register_callbacks cb 0x55eac63e03b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-12T09:43:39.136 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:39.133+0000 7f0efd4c9640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55eac64dfc60 0x55eac650bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:39.136 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:39.133+0000 7f0efd4c9640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55eac64dfc60 0x55eac650bc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:41242/0 (socket says 172.21.15.73:41242) 2023-12-12T09:43:39.136 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:39.133+0000 7f0efd4c9640 1 -- 172.21.15.73:0/774779902 learned_addr learned my addr 172.21.15.73:0/774779902 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:43:39.137 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:39.133+0000 7f0efd4c9640 1 -- 172.21.15.73:0/774779902 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55eac64bcb40 msgr2=0x55eac64de960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:43:39.137 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:39.133+0000 7f0ef7fff640 1 --2- 172.21.15.73:0/774779902 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55eac64bcb40 0x55eac64de960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:39.137 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:39.133+0000 7f0efd4c9640 1 --2- 172.21.15.73:0/774779902 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55eac64bcb40 0x55eac64de960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:39.137 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:39.133+0000 7f0efd4c9640 1 -- 172.21.15.73:0/774779902 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55eac64bbe90 msgr2=0x55eac64fdbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:43:39.137 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:39.133+0000 7f0efccc8640 1 --2- 172.21.15.73:0/774779902 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55eac64bbe90 0x55eac64fdbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:39.137 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:39.133+0000 7f0efd4c9640 1 --2- 172.21.15.73:0/774779902 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55eac64bbe90 0x55eac64fdbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:39.137 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:39.133+0000 7f0efd4c9640 1 -- 172.21.15.73:0/774779902 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ee4001430 con 0x55eac64dfc60 2023-12-12T09:43:39.137 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:39.134+0000 7f0efd4c9640 1 --2- 172.21.15.73:0/774779902 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55eac64dfc60 0x55eac650bc20 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f0ef0077ca0 tx=0x7f0ef0035f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1f5a8d5666b7612 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:43:39.137 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:39.134+0000 7f0ed77fe640 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2023-12-12T09:43:39.137 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:39.134+0000 7f0ed77fe640 1 -- 172.21.15.73:0/774779902 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ef0083aa0 con 0x55eac64dfc60 2023-12-12T09:43:39.138 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:39.134+0000 7f0ed77fe640 1 -- 172.21.15.73:0/774779902 <== mon.0 v2:172.21.15.73:3300/0 2 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0ef0036d30 con 0x55eac64dfc60 2023-12-12T09:43:39.138 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:39.134+0000 7f0f01b98740 1 -- 172.21.15.73:0/774779902 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55eac641adb0 con 0x55eac64dfc60 2023-12-12T09:43:39.138 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:39.134+0000 7f0ed77fe640 1 -- 172.21.15.73:0/774779902 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0ef0077eb0 con 0x55eac64dfc60 2023-12-12T09:43:39.138 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:39.134+0000 7f0f01b98740 10 client.4635 fetch_fsmap learned FSMap version 8 2023-12-12T09:43:39.138 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:39.134+0000 7f0f01b98740 1 -- 172.21.15.73:0/774779902 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) v3 -- 0x55eac64205a0 con 0x55eac64dfc60 2023-12-12T09:43:39.138 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:39.134+0000 7f0ed77fe640 1 -- 172.21.15.73:0/774779902 <== mon.0 v2:172.21.15.73:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55eac641adb0 con 0x55eac64dfc60 2023-12-12T09:43:39.138 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:39.134+0000 7f0ed77fe640 1 -- 172.21.15.73:0/774779902 <== mon.0 v2:172.21.15.73:3300/0 5 ==== fsmap(e 8) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f0ef007ac90 con 0x55eac64dfc60 2023-12-12T09:43:39.138 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:39.134+0000 7f0f01b98740 10 client.4635 fetch_fsmap finished waiting for FSMap version 8 2023-12-12T09:43:39.138 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:39.134+0000 7f0f01b98740 10 client.4635 resolve_mds: resolved name 'd' to daemon mds.d 2023-12-12T09:43:39.138 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:39.134+0000 7f0f01b98740 20 client.4635 populate_metadata read hostname 'smithi073' 2023-12-12T09:43:39.138 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:39.134+0000 7f0f01b98740 1 --2- 172.21.15.73:0/774779902 >> [v2:172.21.15.142:6832/1773392257,v1:172.21.15.142:6834/1773392257] conn(0x55eac64f4fb0 0x55eac64ba2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:39.138 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:39.134+0000 7f0f01b98740 4 client.4635 mds_command: new command op to 4269 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-12-12T09:43:39.139 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:39.134+0000 7f0f01b98740 1 -- 172.21.15.73:0/774779902 --> [v2:172.21.15.142:6832/1773392257,v1:172.21.15.142:6834/1773392257] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55eac641aad0 con 0x55eac64f4fb0 2023-12-12T09:43:39.139 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:39.135+0000 7f0efccc8640 1 --2- 172.21.15.73:0/774779902 >> [v2:172.21.15.142:6832/1773392257,v1:172.21.15.142:6834/1773392257] conn(0x55eac64f4fb0 0x55eac64ba2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:39.140 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:39.136+0000 7f0efccc8640 1 --2- 172.21.15.73:0/774779902 >> [v2:172.21.15.142:6832/1773392257,v1:172.21.15.142:6834/1773392257] conn(0x55eac64f4fb0 0x55eac64ba2f0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6211095d10b8f8b8 server_cookie=8d97446655bc95e9 in_seq=0 out_seq=0 2023-12-12T09:43:39.140 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:39.136+0000 7f0ed77fe640 10 client.4635 ms_handle_connect on v2:172.21.15.142:6832/1773392257 2023-12-12T09:43:39.140 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:39.138+0000 7f0ed77fe640 1 -- 172.21.15.73:0/774779902 <== mds.0 v2:172.21.15.142:6832/1773392257 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55eac641aad0 con 0x55eac64f4fb0 2023-12-12T09:43:39.140 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:39.138+0000 7f0ed77fe640 10 client.4635 handle_command_reply: tid=0 2023-12-12T09:43:39.140 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:39.138+0000 7f0f01b98740 1 client.4635 shutdown 2023-12-12T09:43:39.141 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:39.138+0000 7f0f01b98740 1 -- 172.21.15.73:0/774779902 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55eac64dfc60 msgr2=0x55eac650bc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:39.141 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:39.138+0000 7f0f01b98740 1 --2- 172.21.15.73:0/774779902 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55eac64dfc60 0x55eac650bc20 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f0ef0077ca0 tx=0x7f0ef0035f40 comp rx=0 tx=0).stop 2023-12-12T09:43:39.141 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:39.138+0000 7f0f01b98740 1 -- 172.21.15.73:0/774779902 shutdown_connections 2023-12-12T09:43:39.141 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:39.138+0000 7f0f01b98740 1 --2- 172.21.15.73:0/774779902 >> [v2:172.21.15.142:6832/1773392257,v1:172.21.15.142:6834/1773392257] conn(0x55eac64f4fb0 0x55eac64ba2f0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:39.141 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:39.138+0000 7f0f01b98740 1 --2- 172.21.15.73:0/774779902 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55eac64dfc60 0x55eac650bc20 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:39.141 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:39.138+0000 7f0f01b98740 1 --2- 172.21.15.73:0/774779902 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55eac64bcb40 0x55eac64de960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:39.141 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:39.138+0000 7f0f01b98740 1 --2- 172.21.15.73:0/774779902 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55eac64bbe90 0x55eac64fdbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:39.141 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:39.138+0000 7f0ed77fe640 0 client.4635 ms_handle_reset on v2:172.21.15.142:6832/1773392257 2023-12-12T09:43:39.141 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:39.138+0000 7f0f01b98740 1 -- 172.21.15.73:0/774779902 >> 172.21.15.73:0/774779902 conn(0x55eac64bbab0 msgr2=0x55eac64f63a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:43:39.141 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:39.138+0000 7f0f01b98740 1 -- 172.21.15.73:0/774779902 shutdown_connections 2023-12-12T09:43:39.141 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:39.138+0000 7f0f01b98740 1 -- 172.21.15.73:0/774779902 wait complete. 2023-12-12T09:43:39.141 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:39.138+0000 7f0f01b98740 20 client.4635 trim_cache size 0 max 16384 2023-12-12T09:43:39.155 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:39.155+0000 7f0f01b98740 1 Processor -- start 2023-12-12T09:43:39.155 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:39.155+0000 7f0f01b98740 1 -- start start 2023-12-12T09:43:39.156 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:39.156+0000 7f0f01b98740 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55eac64bbe90 0x55eac651ad40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:39.156 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:39.156+0000 7f0f01b98740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55eac64bcb40 0x55eac64dc070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:39.156 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:39.156+0000 7f0f01b98740 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55eac64dfc60 0x55eac64dc5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:39.156 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:39.156+0000 7f0f01b98740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eac64fae30 con 0x55eac64bcb40 2023-12-12T09:43:39.156 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:39.156+0000 7f0f01b98740 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eac64e0630 con 0x55eac64bbe90 2023-12-12T09:43:39.156 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:39.156+0000 7f0f01b98740 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x55eac64df9f0 con 0x55eac64dfc60 2023-12-12T09:43:39.157 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:39.156+0000 7f0ef7fff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55eac64bcb40 0x55eac64dc070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:39.157 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:39.156+0000 7f0ef7fff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55eac64bcb40 0x55eac64dc070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:41244/0 (socket says 172.21.15.73:41244) 2023-12-12T09:43:39.157 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:39.156+0000 7f0ef7fff640 1 -- 172.21.15.73:0/4133676343 learned_addr learned my addr 172.21.15.73:0/4133676343 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:43:39.158 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:39.156+0000 7f0efccc8640 1 --2- 172.21.15.73:0/4133676343 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55eac64bbe90 0x55eac651ad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:39.158 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:39.157+0000 7f0efd4c9640 1 --2- 172.21.15.73:0/4133676343 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55eac64dfc60 0x55eac64dc5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:39.158 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:39.157+0000 7f0ef7fff640 1 -- 172.21.15.73:0/4133676343 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55eac64dfc60 msgr2=0x55eac64dc5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:43:39.158 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:39.157+0000 7f0ef7fff640 1 --2- 172.21.15.73:0/4133676343 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55eac64dfc60 0x55eac64dc5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:39.158 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:39.157+0000 7f0ef7fff640 1 -- 172.21.15.73:0/4133676343 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55eac64bbe90 msgr2=0x55eac651ad40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:43:39.158 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:39.157+0000 7f0ef7fff640 1 --2- 172.21.15.73:0/4133676343 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55eac64bbe90 0x55eac651ad40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:39.158 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:39.157+0000 7f0ef7fff640 1 -- 172.21.15.73:0/4133676343 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55eac63bdb80 con 0x55eac64bcb40 2023-12-12T09:43:39.158 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:39.157+0000 7f0efccc8640 1 --2- 172.21.15.73:0/4133676343 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55eac64bbe90 0x55eac651ad40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-12T09:43:39.158 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:39.157+0000 7f0ef7fff640 1 --2- 172.21.15.73:0/4133676343 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55eac64bcb40 0x55eac64dc070 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f0ee4016040 tx=0x7f0ee4006000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b178af470e96c2c1 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:43:39.158 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:39.157+0000 7f0ee2ffd640 1 -- 172.21.15.73:0/4133676343 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ee40074e0 con 0x55eac64bcb40 2023-12-12T09:43:39.158 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:39.157+0000 7f0ee2ffd640 1 -- 172.21.15.73:0/4133676343 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ee40012b0 con 0x55eac64bcb40 2023-12-12T09:43:39.158 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:39.157+0000 7f0ee2ffd640 1 -- 172.21.15.73:0/4133676343 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ee4004a00 con 0x55eac64bcb40 2023-12-12T09:43:39.162 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:39.158+0000 7f0f01b98740 1 -- 172.21.15.73:0/4133676343 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55eac64bcb40 msgr2=0x55eac64dc070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:39.162 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:39.158+0000 7f0f01b98740 1 --2- 172.21.15.73:0/4133676343 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55eac64bcb40 0x55eac64dc070 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f0ee4016040 tx=0x7f0ee4006000 comp rx=0 tx=0).stop 2023-12-12T09:43:39.162 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:39.158+0000 7f0f01b98740 1 -- 172.21.15.73:0/4133676343 shutdown_connections 2023-12-12T09:43:39.162 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:39.158+0000 7f0f01b98740 1 --2- 172.21.15.73:0/4133676343 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55eac64dfc60 0x55eac64dc5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:39.162 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:39.158+0000 7f0f01b98740 1 --2- 172.21.15.73:0/4133676343 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55eac64bcb40 0x55eac64dc070 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:39.162 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:39.158+0000 7f0f01b98740 1 --2- 172.21.15.73:0/4133676343 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55eac64bbe90 0x55eac651ad40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:39.162 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:39.158+0000 7f0f01b98740 1 -- 172.21.15.73:0/4133676343 >> 172.21.15.73:0/4133676343 conn(0x55eac64bbab0 msgr2=0x55eac64fd9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:43:39.162 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:39.158+0000 7f0f01b98740 1 -- 172.21.15.73:0/4133676343 shutdown_connections 2023-12-12T09:43:39.162 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:39.158+0000 7f0f01b98740 1 -- 172.21.15.73:0/4133676343 wait complete. 2023-12-12T09:43:39.162 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:39.159+0000 7f0f01b98740 1 -- start start 2023-12-12T09:43:39.162 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:39.159+0000 7f0f01b98740 1 Processor -- start 2023-12-12T09:43:39.163 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:39.160+0000 7f0f01b98740 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55eac64bbe90 0x55eac64b52e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:39.163 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:39.160+0000 7f0f01b98740 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55eac64bcb40 0x55eac6504960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:39.163 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:39.160+0000 7f0f01b98740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55eac64dfc60 0x55eac655f3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:39.163 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:39.160+0000 7f0f01b98740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eac651b0e0 con 0x55eac64dfc60 2023-12-12T09:43:39.163 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:39.160+0000 7f0f01b98740 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eac6505620 con 0x55eac64bcb40 2023-12-12T09:43:39.163 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:39.160+0000 7f0f01b98740 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x55eac64b5cf0 con 0x55eac64bbe90 2023-12-12T09:43:39.163 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:39.160+0000 7f0f01b98740 10 client.0 _ll_register_callbacks cb 0x7f0ef0077ae0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-12T09:43:39.163 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:39.160+0000 7f0efd4c9640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55eac64dfc60 0x55eac655f3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:39.163 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:39.160+0000 7f0efd4c9640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55eac64dfc60 0x55eac655f3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:41260/0 (socket says 172.21.15.73:41260) 2023-12-12T09:43:39.163 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:39.160+0000 7f0efd4c9640 1 -- 172.21.15.73:0/3727356704 learned_addr learned my addr 172.21.15.73:0/3727356704 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:43:39.163 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:39.160+0000 7f0efccc8640 1 --2- 172.21.15.73:0/3727356704 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55eac64bbe90 0x55eac64b52e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:39.163 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:39.160+0000 7f0ef7fff640 1 --2- 172.21.15.73:0/3727356704 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55eac64bcb40 0x55eac6504960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:39.163 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:39.160+0000 7f0efd4c9640 1 -- 172.21.15.73:0/3727356704 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55eac64bbe90 msgr2=0x55eac64b52e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:43:39.164 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:39.160+0000 7f0efd4c9640 1 --2- 172.21.15.73:0/3727356704 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55eac64bbe90 0x55eac64b52e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:39.164 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:39.160+0000 7f0efd4c9640 1 -- 172.21.15.73:0/3727356704 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55eac64bcb40 msgr2=0x55eac6504960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:43:39.164 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:39.160+0000 7f0efd4c9640 1 --2- 172.21.15.73:0/3727356704 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55eac64bcb40 0x55eac6504960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:39.164 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:39.160+0000 7f0efd4c9640 1 -- 172.21.15.73:0/3727356704 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55eac63e4910 con 0x55eac64dfc60 2023-12-12T09:43:39.164 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:39.161+0000 7f0efccc8640 1 --2- 172.21.15.73:0/3727356704 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55eac64bbe90 0x55eac64b52e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:43:39.164 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:39.161+0000 7f0efd4c9640 1 --2- 172.21.15.73:0/3727356704 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55eac64dfc60 0x55eac655f3d0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f0ef007b730 tx=0x7f0ef00aad90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f40a081dad1afc2 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:43:39.164 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:39.161+0000 7f0ed77fe640 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2023-12-12T09:43:39.164 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:39.161+0000 7f0ed77fe640 1 -- 172.21.15.73:0/3727356704 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ef007b100 con 0x55eac64dfc60 2023-12-12T09:43:39.164 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:39.161+0000 7f0ed77fe640 1 -- 172.21.15.73:0/3727356704 <== mon.0 v2:172.21.15.73:3300/0 2 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0ef0083aa0 con 0x55eac64dfc60 2023-12-12T09:43:39.164 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:39.161+0000 7f0f01b98740 1 -- 172.21.15.73:0/3727356704 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55eac61226c0 con 0x55eac64dfc60 2023-12-12T09:43:39.164 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:39.161+0000 7f0ed77fe640 1 -- 172.21.15.73:0/3727356704 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0ef007ac90 con 0x55eac64dfc60 2023-12-12T09:43:39.165 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:39.161+0000 7f0f01b98740 10 client.4641 fetch_fsmap learned FSMap version 8 2023-12-12T09:43:39.165 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:39.161+0000 7f0f01b98740 1 -- 172.21.15.73:0/3727356704 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) v3 -- 0x55eac63e3170 con 0x55eac64dfc60 2023-12-12T09:43:39.165 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:39.161+0000 7f0ed77fe640 1 -- 172.21.15.73:0/3727356704 <== mon.0 v2:172.21.15.73:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55eac61226c0 con 0x55eac64dfc60 2023-12-12T09:43:39.165 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:39.161+0000 7f0ed77fe640 1 -- 172.21.15.73:0/3727356704 <== mon.0 v2:172.21.15.73:3300/0 5 ==== fsmap(e 8) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f0ef008f120 con 0x55eac64dfc60 2023-12-12T09:43:39.165 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:39.161+0000 7f0f01b98740 10 client.4641 fetch_fsmap finished waiting for FSMap version 8 2023-12-12T09:43:39.165 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:39.161+0000 7f0f01b98740 10 client.4641 resolve_mds: resolved name 'd' to daemon mds.d 2023-12-12T09:43:39.165 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:39.161+0000 7f0f01b98740 20 client.4641 populate_metadata read hostname 'smithi073' 2023-12-12T09:43:39.165 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:39.161+0000 7f0f01b98740 1 --2- 172.21.15.73:0/3727356704 >> [v2:172.21.15.142:6832/1773392257,v1:172.21.15.142:6834/1773392257] conn(0x55eac655f910 0x55eac65657a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:39.165 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:39.161+0000 7f0f01b98740 4 client.4641 mds_command: new command op to 4269 tid=0 multi_id=0 [{"prefix": "status"}] 2023-12-12T09:43:39.165 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:39.161+0000 7f0f01b98740 1 -- 172.21.15.73:0/3727356704 --> [v2:172.21.15.142:6832/1773392257,v1:172.21.15.142:6834/1773392257] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55eac6175d10 con 0x55eac655f910 2023-12-12T09:43:39.165 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:39.162+0000 7f0efccc8640 1 --2- 172.21.15.73:0/3727356704 >> [v2:172.21.15.142:6832/1773392257,v1:172.21.15.142:6834/1773392257] conn(0x55eac655f910 0x55eac65657a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:39.167 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:39.163+0000 7f0efccc8640 1 --2- 172.21.15.73:0/3727356704 >> [v2:172.21.15.142:6832/1773392257,v1:172.21.15.142:6834/1773392257] conn(0x55eac655f910 0x55eac65657a0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=201b1bc3270b7399 server_cookie=43d875ea60ea1fd4 in_seq=0 out_seq=0 2023-12-12T09:43:39.167 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:39.163+0000 7f0ed77fe640 10 client.4641 ms_handle_connect on v2:172.21.15.142:6832/1773392257 2023-12-12T09:43:39.167 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:39.163+0000 7f0ed77fe640 1 -- 172.21.15.73:0/3727356704 <== mds.0 v2:172.21.15.142:6832/1773392257 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+324 (crc 0 0 0) 0x55eac6175d10 con 0x55eac655f910 2023-12-12T09:43:39.167 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:39.163+0000 7f0ed77fe640 10 client.4641 handle_command_reply: tid=0 2023-12-12T09:43:39.167 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:39.163+0000 7f0f01b98740 1 client.4641 shutdown 2023-12-12T09:43:39.167 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:39.164+0000 7f0f01b98740 1 -- 172.21.15.73:0/3727356704 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55eac64dfc60 msgr2=0x55eac655f3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:39.167 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:39.164+0000 7f0f01b98740 1 --2- 172.21.15.73:0/3727356704 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55eac64dfc60 0x55eac655f3d0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f0ef007b730 tx=0x7f0ef00aad90 comp rx=0 tx=0).stop 2023-12-12T09:43:39.167 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:39.164+0000 7f0f01b98740 1 -- 172.21.15.73:0/3727356704 shutdown_connections 2023-12-12T09:43:39.168 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:39.164+0000 7f0f01b98740 1 --2- 172.21.15.73:0/3727356704 >> [v2:172.21.15.142:6832/1773392257,v1:172.21.15.142:6834/1773392257] conn(0x55eac655f910 0x55eac65657a0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:39.168 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:39.164+0000 7f0f01b98740 1 --2- 172.21.15.73:0/3727356704 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55eac64dfc60 0x55eac655f3d0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:39.168 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:39.164+0000 7f0f01b98740 1 --2- 172.21.15.73:0/3727356704 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55eac64bcb40 0x55eac6504960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:39.168 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:39.164+0000 7f0f01b98740 1 --2- 172.21.15.73:0/3727356704 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55eac64bbe90 0x55eac64b52e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:39.168 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:39.164+0000 7f0f01b98740 1 -- 172.21.15.73:0/3727356704 >> 172.21.15.73:0/3727356704 conn(0x55eac64bbab0 msgr2=0x55eac64f9720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:43:39.168 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:39.164+0000 7f0ed77fe640 0 client.4641 ms_handle_reset on v2:172.21.15.142:6832/1773392257 2023-12-12T09:43:39.168 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:39.164+0000 7f0f01b98740 1 -- 172.21.15.73:0/3727356704 shutdown_connections 2023-12-12T09:43:39.168 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:39.164+0000 7f0f01b98740 1 -- 172.21.15.73:0/3727356704 wait complete. 2023-12-12T09:43:39.168 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:39.164+0000 7f0f01b98740 20 client.4641 trim_cache size 0 max 16384 2023-12-12T09:43:39.168 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2023-12-12T09:43:39.169 INFO:teuthology.orchestra.run.smithi073.stdout: "cluster_fsid": "ba240992-02b8-4c7e-92f2-27eb29ac433b", 2023-12-12T09:43:39.169 INFO:teuthology.orchestra.run.smithi073.stdout: "whoami": 0, 2023-12-12T09:43:39.169 INFO:teuthology.orchestra.run.smithi073.stdout: "id": 4269, 2023-12-12T09:43:39.169 INFO:teuthology.orchestra.run.smithi073.stdout: "want_state": "up:active", 2023-12-12T09:43:39.169 INFO:teuthology.orchestra.run.smithi073.stdout: "state": "up:active", 2023-12-12T09:43:39.169 INFO:teuthology.orchestra.run.smithi073.stdout: "fs_name": "cephfs", 2023-12-12T09:43:39.169 INFO:teuthology.orchestra.run.smithi073.stdout: "rank_uptime": 16.899917405, 2023-12-12T09:43:39.169 INFO:teuthology.orchestra.run.smithi073.stdout: "mdsmap_epoch": 8, 2023-12-12T09:43:39.169 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap_epoch": 21, 2023-12-12T09:43:39.169 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap_epoch_barrier": 21, 2023-12-12T09:43:39.169 INFO:teuthology.orchestra.run.smithi073.stdout: "uptime": 24.358665740999999 2023-12-12T09:43:39.169 INFO:teuthology.orchestra.run.smithi073.stdout:} 2023-12-12T09:43:39.170 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:39.164+0000 7f0efef2c640 1 -- 172.21.15.73:0/3834015869 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f0edc06ae40 msgr2=0x7f0edc06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:39.170 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:39.164+0000 7f0efef2c640 1 --2- 172.21.15.73:0/3834015869 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f0edc06ae40 0x7f0edc06d300 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f0eec00a810 tx=0x7f0eec008040 comp rx=0 tx=0).stop 2023-12-12T09:43:39.170 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:39.164+0000 7f0efef2c640 1 -- 172.21.15.73:0/3834015869 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0ef80c3920 msgr2=0x7f0ef8153590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:39.171 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:39.164+0000 7f0efef2c640 1 --2- 172.21.15.73:0/3834015869 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0ef80c3920 0x7f0ef8153590 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f0ef0038040 tx=0x7f0ef0004a40 comp rx=0 tx=0).stop 2023-12-12T09:43:39.171 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:39.165+0000 7f0efef2c640 1 -- 172.21.15.73:0/3834015869 shutdown_connections 2023-12-12T09:43:39.171 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:39.165+0000 7f0efef2c640 1 --2- 172.21.15.73:0/3834015869 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f0edc06ae40 0x7f0edc06d300 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:39.171 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:39.165+0000 7f0efef2c640 1 --2- 172.21.15.73:0/3834015869 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0ef80c3920 0x7f0ef8153590 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:39.171 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:39.165+0000 7f0efef2c640 1 --2- 172.21.15.73:0/3834015869 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0ef80c14f0 0x7f0ef814d1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:39.171 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:39.165+0000 7f0efef2c640 1 --2- 172.21.15.73:0/3834015869 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0ef80a4f00 0x7f0ef80a5cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:39.171 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:39.165+0000 7f0efef2c640 1 -- 172.21.15.73:0/3834015869 >> 172.21.15.73:0/3834015869 conn(0x7f0ef80a77d0 msgr2=0x7f0ef814e250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:43:39.171 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:39.165+0000 7f0efef2c640 1 -- 172.21.15.73:0/3834015869 shutdown_connections 2023-12-12T09:43:39.171 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:39.165+0000 7f0efef2c640 1 -- 172.21.15.73:0/3834015869 wait complete. 2023-12-12T09:43:39.181 INFO:teuthology.run_tasks:Running task kclient... 2023-12-12T09:43:39.205 INFO:tasks.kclient:Mounting kernel clients... 2023-12-12T09:43:39.205 INFO:tasks.kclient:config is {'client.0': {}, 'client.1': {}} 2023-12-12T09:43:39.205 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T09:43:39.205 DEBUG:teuthology.orchestra.run.smithi073:> ip netns list 2023-12-12T09:43:39.259 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T09:43:39.260 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip link delete ceph-brx 2023-12-12T09:43:39.359 INFO:teuthology.orchestra.run.smithi073.stderr:Cannot find device "ceph-brx" 2023-12-12T09:43:39.362 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-12T09:43:39.363 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T09:43:39.363 DEBUG:teuthology.orchestra.run.smithi142:> ip netns list 2023-12-12T09:43:39.424 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T09:43:39.424 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip link delete ceph-brx 2023-12-12T09:43:39.525 INFO:teuthology.orchestra.run.smithi142.stderr:Cannot find device "ceph-brx" 2023-12-12T09:43:39.529 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-12T09:43:39.529 INFO:tasks.kclient:client.0 config is {'syntax': 'v2'} 2023-12-12T09:43:39.529 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-12-12T09:43:39.530 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-12-12T09:43:39.530 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-12-12T09:43:39.742 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:39.741+0000 7f1b12e4f640 1 Processor -- start 2023-12-12T09:43:39.743 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:39.742+0000 7f1b12e4f640 1 -- start start 2023-12-12T09:43:39.746 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:39.743+0000 7f1b12e4f640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1b0c0a50f0 0x7f1b0c0a9050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:39.746 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:39.743+0000 7f1b12e4f640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b0c0c0b50 con 0x7f1b0c1552e0 2023-12-12T09:43:39.747 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:39.743+0000 7f1b12e4f640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b0c06c880 con 0x7f1b0c06bf20 2023-12-12T09:43:39.747 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:39.743+0000 7f1b12e4f640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b0c0c04d0 con 0x7f1b0c0a50f0 2023-12-12T09:43:39.747 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:39.743+0000 7f1b10beb640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f1b0c1552e0 0x7f1b0c0c49c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:36680/0 (socket says 172.21.15.73:36680) 2023-12-12T09:43:39.747 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:39.743+0000 7f1b10beb640 1 -- 172.21.15.73:0/1440707377 learned_addr learned my addr 172.21.15.73:0/1440707377 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-12T09:43:39.747 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:39.744+0000 7f1b0b7fe640 1 -- 172.21.15.73:0/1440707377 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2783274086 0 0) 0x7f1b0c0c0b50 con 0x7f1b0c1552e0 2023-12-12T09:43:39.747 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:39.744+0000 7f1b0b7fe640 1 -- 172.21.15.73:0/1440707377 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1afc003520 con 0x7f1b0c1552e0 2023-12-12T09:43:39.747 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:39.744+0000 7f1b0bfff640 1 --2- 172.21.15.73:0/1440707377 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1b0c0a50f0 0x7f1b0c0a9050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:39.747 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:39.744+0000 7f1b0b7fe640 1 -- 172.21.15.73:0/1440707377 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3263581116 0 0) 0x7f1afc003520 con 0x7f1b0c1552e0 2023-12-12T09:43:39.747 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:39.744+0000 7f1b0b7fe640 1 -- 172.21.15.73:0/1440707377 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1b0c0a50f0 msgr2=0x7f1b0c0a9050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:43:39.747 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:39.744+0000 7f1b0b7fe640 1 --2- 172.21.15.73:0/1440707377 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1b0c0a50f0 0x7f1b0c0a9050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:39.748 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:39.744+0000 7f1b0b7fe640 1 -- 172.21.15.73:0/1440707377 >> v1:172.21.15.142:6789/0 conn(0x7f1b0c06bf20 legacy=0x7f1b0c0a9590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:39.748 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:39.744+0000 7f1b0b7fe640 1 -- 172.21.15.73:0/1440707377 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b0c06cb60 con 0x7f1b0c1552e0 2023-12-12T09:43:39.748 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:39.744+0000 7f1b0b7fe640 1 -- 172.21.15.73:0/1440707377 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3186547832 0 0) 0x7f1b00001670 con 0x7f1b0c1552e0 2023-12-12T09:43:39.748 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:39.744+0000 7f1b0b7fe640 1 -- 172.21.15.73:0/1440707377 >> v1:172.21.15.73:6789/0 conn(0x7f1b0c1552e0 legacy=0x7f1b0c0c49c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:39.748 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:39.744+0000 7f1b0b7fe640 1 --2- 172.21.15.73:0/1440707377 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1b0c0a50f0 0x7f1afc0039a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:39.748 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:39.744+0000 7f1b0b7fe640 1 --2- 172.21.15.73:0/1440707377 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1afc004020 0x7f1afc0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:39.748 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:39.744+0000 7f1b0b7fe640 1 --2- 172.21.15.73:0/1440707377 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1afc004d00 0x7f1afc005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:39.748 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:39.744+0000 7f1b0b7fe640 1 -- 172.21.15.73:0/1440707377 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b0c0c04d0 con 0x7f1afc004d00 2023-12-12T09:43:39.748 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:39.744+0000 7f1b0b7fe640 1 -- 172.21.15.73:0/1440707377 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1afc00bc60 con 0x7f1afc004020 2023-12-12T09:43:39.748 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:39.744+0000 7f1b0b7fe640 1 -- 172.21.15.73:0/1440707377 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1afc00e030 con 0x7f1b0c0a50f0 2023-12-12T09:43:39.748 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:39.744+0000 7f1b113ec640 1 --2- 172.21.15.73:0/1440707377 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1afc004d00 0x7f1afc005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:39.748 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:39.745+0000 7f1b0bfff640 1 --2- 172.21.15.73:0/1440707377 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1afc004020 0x7f1afc0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:39.748 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:39.745+0000 7f1b10beb640 1 --2- 172.21.15.73:0/1440707377 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1b0c0a50f0 0x7f1afc0039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:39.749 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:39.745+0000 7f1b113ec640 1 -- 172.21.15.73:0/1440707377 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1b0c0a50f0 msgr2=0x7f1afc0039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:43:39.749 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:39.745+0000 7f1b113ec640 1 --2- 172.21.15.73:0/1440707377 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1b0c0a50f0 0x7f1afc0039a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:39.749 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:39.745+0000 7f1b113ec640 1 -- 172.21.15.73:0/1440707377 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1afc004020 msgr2=0x7f1afc0047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:43:39.749 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:39.745+0000 7f1b113ec640 1 --2- 172.21.15.73:0/1440707377 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1afc004020 0x7f1afc0047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:39.749 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:39.745+0000 7f1b113ec640 1 -- 172.21.15.73:0/1440707377 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1afc003520 con 0x7f1afc004d00 2023-12-12T09:43:39.749 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:39.746+0000 7f1b113ec640 1 --2- 172.21.15.73:0/1440707377 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1afc004d00 0x7f1afc005180 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f1b04001e50 tx=0x7f1afc0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=197ce72dc867b918 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:43:39.749 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:39.746+0000 7f1b0b7fe640 1 -- 172.21.15.73:0/1440707377 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b04003b70 con 0x7f1afc004d00 2023-12-12T09:43:39.749 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:39.746+0000 7f1b0b7fe640 1 -- 172.21.15.73:0/1440707377 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b04003cd0 con 0x7f1afc004d00 2023-12-12T09:43:39.749 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:39.746+0000 7f1b0b7fe640 1 -- 172.21.15.73:0/1440707377 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b04005310 con 0x7f1afc004d00 2023-12-12T09:43:39.751 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:39.747+0000 7f1b12e4f640 1 -- 172.21.15.73:0/1440707377 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1afc004d00 msgr2=0x7f1afc005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:39.751 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:39.747+0000 7f1b12e4f640 1 --2- 172.21.15.73:0/1440707377 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1afc004d00 0x7f1afc005180 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f1b04001e50 tx=0x7f1afc0057f0 comp rx=0 tx=0).stop 2023-12-12T09:43:39.752 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:39.747+0000 7f1b113ec640 1 -- 172.21.15.73:0/1440707377 reap_dead start 2023-12-12T09:43:39.752 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:39.747+0000 7f1b12e4f640 1 -- 172.21.15.73:0/1440707377 shutdown_connections 2023-12-12T09:43:39.752 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:39.747+0000 7f1b12e4f640 1 -- 172.21.15.73:0/1440707377 >> 172.21.15.73:0/1440707377 conn(0x7f1b0c0a8130 msgr2=0x7f1b0c0c24b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:43:39.752 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:39.747+0000 7f1b12e4f640 1 -- 172.21.15.73:0/1440707377 shutdown_connections 2023-12-12T09:43:39.752 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:39.747+0000 7f1b12e4f640 1 -- 172.21.15.73:0/1440707377 wait complete. 2023-12-12T09:43:39.752 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:39.749+0000 7f1b12e4f640 1 Processor -- start 2023-12-12T09:43:39.752 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:39.749+0000 7f1b12e4f640 1 -- start start 2023-12-12T09:43:39.752 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:39.750+0000 7f1b12e4f640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1afc004d00 0x7f1b0c0aa3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:39.752 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:39.750+0000 7f1b12e4f640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1b0c1e5c90 0x7f1b0c1e6110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:39.752 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:39.750+0000 7f1b12e4f640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1b0c1e6650 0x7f1b0c151030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:39.752 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:39.750+0000 7f1b12e4f640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b0c0bf960 con 0x7f1b0c1e5c90 2023-12-12T09:43:39.752 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:39.750+0000 7f1b12e4f640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b0c1e8f90 con 0x7f1b0c1e6650 2023-12-12T09:43:39.752 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:39.750+0000 7f1b12e4f640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b0c1e91e0 con 0x7f1afc004d00 2023-12-12T09:43:39.753 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:39.750+0000 7f1b0bfff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1b0c1e5c90 0x7f1b0c1e6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:39.753 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:39.750+0000 7f1b0bfff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1b0c1e5c90 0x7f1b0c1e6110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:41268/0 (socket says 172.21.15.73:41268) 2023-12-12T09:43:39.753 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:39.750+0000 7f1b0bfff640 1 -- 172.21.15.73:0/2739406517 learned_addr learned my addr 172.21.15.73:0/2739406517 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:43:39.753 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:39.750+0000 7f1b0bfff640 1 -- 172.21.15.73:0/2739406517 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1afc004d00 msgr2=0x7f1b0c0aa3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:39.753 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:39.750+0000 7f1b0bfff640 1 --2- 172.21.15.73:0/2739406517 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1afc004d00 0x7f1b0c0aa3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:39.753 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:39.750+0000 7f1b0bfff640 1 -- 172.21.15.73:0/2739406517 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1b0c1e6650 msgr2=0x7f1b0c151030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:39.753 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:39.750+0000 7f1b0bfff640 1 --2- 172.21.15.73:0/2739406517 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1b0c1e6650 0x7f1b0c151030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:39.753 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:39.750+0000 7f1b0bfff640 1 -- 172.21.15.73:0/2739406517 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b0c1e94c0 con 0x7f1b0c1e5c90 2023-12-12T09:43:39.753 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:39.751+0000 7f1b0bfff640 1 --2- 172.21.15.73:0/2739406517 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1b0c1e5c90 0x7f1b0c1e6110 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f1af800f550 tx=0x7f1af800fa10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:43:39.753 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:39.751+0000 7f1b097fa640 1 -- 172.21.15.73:0/2739406517 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1af8014870 con 0x7f1b0c1e5c90 2023-12-12T09:43:39.753 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:39.751+0000 7f1b097fa640 1 -- 172.21.15.73:0/2739406517 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1af80149d0 con 0x7f1b0c1e5c90 2023-12-12T09:43:39.753 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:39.751+0000 7f1b12e4f640 1 -- 172.21.15.73:0/2739406517 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b0c1e97a0 con 0x7f1b0c1e5c90 2023-12-12T09:43:39.753 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:39.751+0000 7f1b097fa640 1 -- 172.21.15.73:0/2739406517 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1af8014d80 con 0x7f1b0c1e5c90 2023-12-12T09:43:39.753 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:39.751+0000 7f1b12e4f640 1 -- 172.21.15.73:0/2739406517 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b0c1e9d60 con 0x7f1b0c1e5c90 2023-12-12T09:43:39.754 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:39.752+0000 7f1b12e4f640 1 -- 172.21.15.73:0/2739406517 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b0c067580 con 0x7f1b0c1e5c90 2023-12-12T09:43:39.754 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:39.753+0000 7f1b097fa640 1 -- 172.21.15.73:0/2739406517 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f1af8015410 con 0x7f1b0c1e5c90 2023-12-12T09:43:39.754 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:39.754+0000 7f1b097fa640 1 --2- 172.21.15.73:0/2739406517 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f1af006ae70 0x7f1af006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:39.754 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:39.754+0000 7f1b097fa640 1 -- 172.21.15.73:0/2739406517 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1af8089e70 con 0x7f1b0c1e5c90 2023-12-12T09:43:39.755 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:39.754+0000 7f1b10beb640 1 --2- 172.21.15.73:0/2739406517 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f1af006ae70 0x7f1af006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:39.755 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:39.755+0000 7f1b10beb640 1 --2- 172.21.15.73:0/2739406517 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f1af006ae70 0x7f1af006d330 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f1b0c0a4c90 tx=0x7f1b00000f90 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:43:39.758 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:39.758+0000 7f1b097fa640 1 -- 172.21.15.73:0/2739406517 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f1af8054fb0 con 0x7f1b0c1e5c90 2023-12-12T09:43:39.987 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:39.987+0000 7f1b12e4f640 1 -- 172.21.15.73:0/2739406517 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f1b0c1526b0 con 0x7f1b0c1e5c90 2023-12-12T09:43:39.988 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:39.988+0000 7f1b097fa640 1 -- 172.21.15.73:0/2739406517 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7f1af80585d0 con 0x7f1b0c1e5c90 2023-12-12T09:43:39.989 INFO:teuthology.orchestra.run.smithi073.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-12-12T09:43:39.991 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:39.990+0000 7f1b12e4f640 1 -- 172.21.15.73:0/2739406517 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f1af006ae70 msgr2=0x7f1af006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:39.991 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:39.990+0000 7f1b12e4f640 1 --2- 172.21.15.73:0/2739406517 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f1af006ae70 0x7f1af006d330 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f1b0c0a4c90 tx=0x7f1b00000f90 comp rx=0 tx=0).stop 2023-12-12T09:43:39.991 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:39.990+0000 7f1b12e4f640 1 -- 172.21.15.73:0/2739406517 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1b0c1e5c90 msgr2=0x7f1b0c1e6110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:39.991 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:39.990+0000 7f1b12e4f640 1 --2- 172.21.15.73:0/2739406517 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1b0c1e5c90 0x7f1b0c1e6110 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f1af800f550 tx=0x7f1af800fa10 comp rx=0 tx=0).stop 2023-12-12T09:43:39.991 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:39.991+0000 7f1b12e4f640 1 -- 172.21.15.73:0/2739406517 shutdown_connections 2023-12-12T09:43:39.991 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:39.991+0000 7f1b12e4f640 1 --2- 172.21.15.73:0/2739406517 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f1af006ae70 0x7f1af006d330 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:39.991 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:39.991+0000 7f1b12e4f640 1 --2- 172.21.15.73:0/2739406517 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1b0c1e6650 0x7f1b0c151030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:39.992 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:39.991+0000 7f1b12e4f640 1 --2- 172.21.15.73:0/2739406517 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1b0c1e5c90 0x7f1b0c1e6110 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:39.992 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:39.991+0000 7f1b12e4f640 1 --2- 172.21.15.73:0/2739406517 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1afc004d00 0x7f1b0c0aa3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:39.992 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:39.991+0000 7f1b12e4f640 1 -- 172.21.15.73:0/2739406517 >> 172.21.15.73:0/2739406517 conn(0x7f1b0c0a8130 msgr2=0x7f1b0c0c0d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:43:39.992 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:39.991+0000 7f1b12e4f640 1 -- 172.21.15.73:0/2739406517 shutdown_connections 2023-12-12T09:43:39.992 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:39.991+0000 7f1b12e4f640 1 -- 172.21.15.73:0/2739406517 wait complete. 2023-12-12T09:43:40.010 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-12-12T09:43:40.010 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-12T09:43:40.011 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi073.front.sepia.ceph.com 2023-12-12T09:43:40.011 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-12-12T09:43:40.011 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-12-12T09:43:40.011 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-12-12T09:43:40.011 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-12-12T09:43:40.011 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-12-12T09:43:40.011 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2023-12-12T09:43:40.012 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T09:43:40.012 DEBUG:teuthology.orchestra.run.smithi073:> ip addr 2023-12-12T09:43:40.066 INFO:teuthology.orchestra.run.smithi073.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-12T09:43:40.066 INFO:teuthology.orchestra.run.smithi073.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-12T09:43:40.067 INFO:teuthology.orchestra.run.smithi073.stdout: inet 127.0.0.1/8 scope host lo 2023-12-12T09:43:40.067 INFO:teuthology.orchestra.run.smithi073.stdout: valid_lft forever preferred_lft forever 2023-12-12T09:43:40.067 INFO:teuthology.orchestra.run.smithi073.stdout: inet6 ::1/128 scope host 2023-12-12T09:43:40.067 INFO:teuthology.orchestra.run.smithi073.stdout: valid_lft forever preferred_lft forever 2023-12-12T09:43:40.067 INFO:teuthology.orchestra.run.smithi073.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-12T09:43:40.067 INFO:teuthology.orchestra.run.smithi073.stdout: link/ether 0c:c4:7a:d8:d9:ea brd ff:ff:ff:ff:ff:ff 2023-12-12T09:43:40.067 INFO:teuthology.orchestra.run.smithi073.stdout: altname enp7s0f0 2023-12-12T09:43:40.067 INFO:teuthology.orchestra.run.smithi073.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-12T09:43:40.067 INFO:teuthology.orchestra.run.smithi073.stdout: link/ether 0c:c4:7a:d8:d9:eb brd ff:ff:ff:ff:ff:ff 2023-12-12T09:43:40.067 INFO:teuthology.orchestra.run.smithi073.stdout: altname enp7s0f1 2023-12-12T09:43:40.067 INFO:teuthology.orchestra.run.smithi073.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-12T09:43:40.067 INFO:teuthology.orchestra.run.smithi073.stdout: link/ether 0c:c4:7a:8f:ce:7c brd ff:ff:ff:ff:ff:ff 2023-12-12T09:43:40.067 INFO:teuthology.orchestra.run.smithi073.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-12T09:43:40.068 INFO:teuthology.orchestra.run.smithi073.stdout: link/ether 0c:c4:7a:8f:ce:7d brd ff:ff:ff:ff:ff:ff 2023-12-12T09:43:40.068 INFO:teuthology.orchestra.run.smithi073.stdout: inet 172.21.15.73/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-12-12T09:43:40.068 INFO:teuthology.orchestra.run.smithi073.stdout: valid_lft 42379sec preferred_lft 42379sec 2023-12-12T09:43:40.068 INFO:teuthology.orchestra.run.smithi073.stdout: inet6 fe80::ec4:7aff:fe8f:ce7d/64 scope link 2023-12-12T09:43:40.068 INFO:teuthology.orchestra.run.smithi073.stdout: valid_lft forever preferred_lft forever 2023-12-12T09:43:40.068 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-12-12T09:43:40.069 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T09:43:40.069 DEBUG:teuthology.orchestra.run.smithi073:> (cd / && exec bash -c ' 2023-12-12T09:43:40.069 DEBUG:teuthology.orchestra.run.smithi073:> set -e 2023-12-12T09:43:40.069 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip link add name ceph-brx type bridge 2023-12-12T09:43:40.069 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip addr flush dev ceph-brx 2023-12-12T09:43:40.069 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip link set ceph-brx up 2023-12-12T09:43:40.069 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-12-12T09:43:40.069 DEBUG:teuthology.orchestra.run.smithi073:> ') 2023-12-12T09:43:40.526 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T09:43:40.527 DEBUG:teuthology.orchestra.run.smithi073:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-12T09:43:40.611 INFO:teuthology.orchestra.run.smithi073.stdout:1 2023-12-12T09:43:40.615 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T09:43:40.615 DEBUG:teuthology.orchestra.run.smithi073:> route 2023-12-12T09:43:40.666 INFO:teuthology.orchestra.run.smithi073.stdout:Kernel IP routing table 2023-12-12T09:43:40.667 INFO:teuthology.orchestra.run.smithi073.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-12T09:43:40.667 INFO:teuthology.orchestra.run.smithi073.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-12-12T09:43:40.667 INFO:teuthology.orchestra.run.smithi073.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-12-12T09:43:40.667 INFO:teuthology.orchestra.run.smithi073.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-12T09:43:40.667 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T09:43:40.667 DEBUG:teuthology.orchestra.run.smithi073:> (cd / && exec bash -c ' 2023-12-12T09:43:40.667 DEBUG:teuthology.orchestra.run.smithi073:> set -e 2023-12-12T09:43:40.668 DEBUG:teuthology.orchestra.run.smithi073:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-12-12T09:43:40.668 DEBUG:teuthology.orchestra.run.smithi073:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-12-12T09:43:40.668 DEBUG:teuthology.orchestra.run.smithi073:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-12-12T09:43:40.668 DEBUG:teuthology.orchestra.run.smithi073:> ') 2023-12-12T09:43:41.469 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T09:43:41.469 DEBUG:teuthology.orchestra.run.smithi073:> ip netns list 2023-12-12T09:43:41.528 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T09:43:41.528 DEBUG:teuthology.orchestra.run.smithi073:> ip netns list-id 2023-12-12T09:43:41.583 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T09:43:41.583 DEBUG:teuthology.orchestra.run.smithi073:> (cd / && exec bash -c ' 2023-12-12T09:43:41.583 DEBUG:teuthology.orchestra.run.smithi073:> set -e 2023-12-12T09:43:41.583 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-12T09:43:41.583 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2023-12-12T09:43:41.583 DEBUG:teuthology.orchestra.run.smithi073:> ') 2023-12-12T09:43:41.714 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2023-12-12T09:43:41.714 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T09:43:41.714 DEBUG:teuthology.orchestra.run.smithi073:> (cd / && exec bash -c ' 2023-12-12T09:43:41.715 DEBUG:teuthology.orchestra.run.smithi073:> set -e 2023-12-12T09:43:41.715 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2023-12-12T09:43:41.715 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-12-12T09:43:41.715 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2023-12-12T09:43:41.715 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2023-12-12T09:43:41.715 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2023-12-12T09:43:41.715 DEBUG:teuthology.orchestra.run.smithi073:> ') 2023-12-12T09:43:41.995 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T09:43:41.995 DEBUG:teuthology.orchestra.run.smithi073:> (cd / && exec bash -c ' 2023-12-12T09:43:41.995 DEBUG:teuthology.orchestra.run.smithi073:> set -e 2023-12-12T09:43:41.995 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip link set brx.0 up 2023-12-12T09:43:41.995 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip link set dev brx.0 master ceph-brx 2023-12-12T09:43:41.995 DEBUG:teuthology.orchestra.run.smithi073:> ') 2023-12-12T09:43:42.158 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-12T09:43:42.159 DEBUG:teuthology.orchestra.run.smithi073:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-12-12T09:43:42.207 INFO:teuthology.orchestra.run.smithi073.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-12-12T09:43:42.207 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-12T09:43:42.207 DEBUG:teuthology.orchestra.run.smithi073:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-12-12T09:43:42.305 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2023-12-12T09:43:42.305 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T09:43:42.306 DEBUG:teuthology.orchestra.run.smithi073:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-12T09:43:42.474 INFO:teuthology.orchestra.run.smithi073.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-12T09:43:42.475 INFO:teuthology.orchestra.run.smithi073.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-12T09:43:42.976 INFO:teuthology.orchestra.run.smithi073.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-12T09:43:42.976 INFO:teuthology.orchestra.run.smithi073.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-12T09:43:42.976 INFO:teuthology.orchestra.run.smithi073.stdout:mount.ceph: resolved to: "172.21.15.73:3300,172.21.15.142:3300,172.21.15.142:3301" 2023-12-12T09:43:42.976 INFO:teuthology.orchestra.run.smithi073.stdout:mount.ceph: trying mount with new device syntax: 0@ba240992-02b8-4c7e-92f2-27eb29ac433b.cephfs=/ 2023-12-12T09:43:42.976 INFO:teuthology.orchestra.run.smithi073.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.73:3300/172.21.15.142:3300/172.21.15.142:3301" will pass to kernel 2023-12-12T09:43:42.978 INFO:teuthology.orchestra.run.smithi073.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2023-12-12T09:43:42.978 INFO:teuthology.orchestra.run.smithi073.stdout: You just mounted a file system that supports labels which does not 2023-12-12T09:43:42.978 INFO:teuthology.orchestra.run.smithi073.stdout: contain labels, onto an SELinux box. It is likely that confined 2023-12-12T09:43:42.978 INFO:teuthology.orchestra.run.smithi073.stdout: applications will generate AVC messages and not be allowed access to 2023-12-12T09:43:42.978 INFO:teuthology.orchestra.run.smithi073.stdout: this file system. For more details see restorecon(8) and mount(8). 2023-12-12T09:43:42.983 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-12-12T09:43:42.983 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T09:43:42.983 DEBUG:teuthology.orchestra.run.smithi073:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-12-12T09:43:43.077 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T09:43:43.078 DEBUG:teuthology.orchestra.run.smithi073:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-12T09:43:43.161 INFO:teuthology.orchestra.run.smithi073.stdout:client4546 2023-12-12T09:43:43.162 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2023-12-12T09:43:43.162 DEBUG:teuthology.orchestra.run.smithi073:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-12T09:43:43.224 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T09:43:43.224 DEBUG:teuthology.orchestra.run.smithi073:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-12T09:43:43.307 INFO:teuthology.orchestra.run.smithi073.stdout:client4546 2023-12-12T09:43:43.308 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T09:43:43.308 DEBUG:teuthology.orchestra.run.smithi073:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-12T09:43:43.390 INFO:teuthology.orchestra.run.smithi073.stdout:client4546 2023-12-12T09:43:43.391 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T09:43:43.391 DEBUG:teuthology.orchestra.run.smithi073:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/ba240992-02b8-4c7e-92f2-27eb29ac433b.client4546/status') 2023-12-12T09:43:43.502 INFO:teuthology.orchestra.run.smithi073.stdout:instance: client.4546 (3)172.21.15.73:0/232085453 2023-12-12T09:43:43.502 INFO:teuthology.orchestra.run.smithi073.stdout:blocklisted: false 2023-12-12T09:43:43.502 INFO:teuthology.orchestra.run.smithi073.stderr:0+1 records in 2023-12-12T09:43:43.503 INFO:teuthology.orchestra.run.smithi073.stderr:0+1 records out 2023-12-12T09:43:43.503 INFO:teuthology.orchestra.run.smithi073.stderr:69 bytes copied, 7.6237e-05 s, 905 kB/s 2023-12-12T09:43:43.506 INFO:tasks.kclient:client.1 config is {'syntax': 'v2'} 2023-12-12T09:43:43.507 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-12-12T09:43:43.507 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-12-12T09:43:43.507 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-12-12T09:43:43.717 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:43.716+0000 7fbfcc656640 1 Processor -- start 2023-12-12T09:43:43.717 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:43.716+0000 7fbfcc656640 1 -- start start 2023-12-12T09:43:43.719 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:43.717+0000 7fbfcc656640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbfc40c5070 0x7fbfc40c40c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:43.719 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:43.718+0000 7fbfcc656640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbfc4152610 con 0x7fbfc414fa40 2023-12-12T09:43:43.719 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:43.718+0000 7fbfcc656640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbfc41528f0 con 0x7fbfc406db70 2023-12-12T09:43:43.719 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:43.718+0000 7fbfcc656640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbfc4152bd0 con 0x7fbfc40c5070 2023-12-12T09:43:43.719 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:43.718+0000 7fbfca3f2640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7fbfc414fa40 0x7fbfc406a4e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:36686/0 (socket says 172.21.15.73:36686) 2023-12-12T09:43:43.719 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:43.718+0000 7fbfca3f2640 1 -- 172.21.15.73:0/4145289908 learned_addr learned my addr 172.21.15.73:0/4145289908 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-12T09:43:43.721 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:43.718+0000 7fbfcabf3640 1 --2- 172.21.15.73:0/4145289908 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbfc40c5070 0x7fbfc40c40c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:43.721 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:43.718+0000 7fbfc93f0640 1 -- 172.21.15.73:0/4145289908 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 350244771 0 0) 0x7fbfc4152610 con 0x7fbfc414fa40 2023-12-12T09:43:43.721 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:43.718+0000 7fbfc93f0640 1 -- 172.21.15.73:0/4145289908 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbfb0003520 con 0x7fbfc414fa40 2023-12-12T09:43:43.721 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:43.719+0000 7fbfc93f0640 1 -- 172.21.15.73:0/4145289908 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1389679845 0 0) 0x7fbfb0003520 con 0x7fbfc414fa40 2023-12-12T09:43:43.721 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:43.719+0000 7fbfc93f0640 1 -- 172.21.15.73:0/4145289908 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbfc40c5070 msgr2=0x7fbfc40c40c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:43:43.721 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:43.719+0000 7fbfc93f0640 1 --2- 172.21.15.73:0/4145289908 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbfc40c5070 0x7fbfc40c40c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:43.721 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:43.719+0000 7fbfc93f0640 1 -- 172.21.15.73:0/4145289908 >> v1:172.21.15.142:6789/0 conn(0x7fbfc406db70 legacy=0x7fbfc40c39b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:43.721 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:43.719+0000 7fbfc93f0640 1 -- 172.21.15.73:0/4145289908 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfc4152eb0 con 0x7fbfc414fa40 2023-12-12T09:43:43.721 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:43.719+0000 7fbfc93f0640 1 -- 172.21.15.73:0/4145289908 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3186547832 0 0) 0x7fbfc0001670 con 0x7fbfc414fa40 2023-12-12T09:43:43.722 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:43.719+0000 7fbfc93f0640 1 -- 172.21.15.73:0/4145289908 >> v1:172.21.15.73:6789/0 conn(0x7fbfc414fa40 legacy=0x7fbfc406a4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:43.722 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:43.719+0000 7fbfc93f0640 1 --2- 172.21.15.73:0/4145289908 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbfb00039a0 0x7fbfb0003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:43.722 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:43.719+0000 7fbfc93f0640 1 --2- 172.21.15.73:0/4145289908 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbfc40c5070 0x7fbfb00047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:43.722 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:43.719+0000 7fbfc93f0640 1 --2- 172.21.15.73:0/4145289908 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbfb0004d00 0x7fbfb0005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:43.722 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:43.719+0000 7fbfc93f0640 1 -- 172.21.15.73:0/4145289908 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfc4152bd0 con 0x7fbfb0004d00 2023-12-12T09:43:43.722 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:43.719+0000 7fbfc93f0640 1 -- 172.21.15.73:0/4145289908 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfb000ba30 con 0x7fbfb00039a0 2023-12-12T09:43:43.722 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:43.719+0000 7fbfc93f0640 1 -- 172.21.15.73:0/4145289908 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbfb000bbf0 con 0x7fbfc40c5070 2023-12-12T09:43:43.722 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:43.719+0000 7fbfcabf3640 1 --2- 172.21.15.73:0/4145289908 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbfb0004d00 0x7fbfb0005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:43.722 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:43.719+0000 7fbfca3f2640 1 --2- 172.21.15.73:0/4145289908 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbfb00039a0 0x7fbfb0003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:43.722 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:43.720+0000 7fbfc9bf1640 1 --2- 172.21.15.73:0/4145289908 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbfc40c5070 0x7fbfb00047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:43.722 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:43.720+0000 7fbfcabf3640 1 -- 172.21.15.73:0/4145289908 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbfc40c5070 msgr2=0x7fbfb00047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:43:43.722 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:43.720+0000 7fbfcabf3640 1 --2- 172.21.15.73:0/4145289908 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbfc40c5070 0x7fbfb00047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:43.722 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:43.720+0000 7fbfcabf3640 1 -- 172.21.15.73:0/4145289908 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbfb00039a0 msgr2=0x7fbfb0003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:43:43.723 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:43.720+0000 7fbfcabf3640 1 --2- 172.21.15.73:0/4145289908 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbfb00039a0 0x7fbfb0003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:43.723 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:43.720+0000 7fbfcabf3640 1 -- 172.21.15.73:0/4145289908 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfb0003520 con 0x7fbfb0004d00 2023-12-12T09:43:43.724 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:43.721+0000 7fbfcabf3640 1 --2- 172.21.15.73:0/4145289908 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbfb0004d00 0x7fbfb0005180 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fbfbc009f90 tx=0x7fbfb00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fec83b219c27554f server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:43:43.724 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:43.721+0000 7fbfc93f0640 1 -- 172.21.15.73:0/4145289908 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfbc02cbd0 con 0x7fbfb0004d00 2023-12-12T09:43:43.724 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:43.721+0000 7fbfc93f0640 1 -- 172.21.15.73:0/4145289908 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfbc00f040 con 0x7fbfb0004d00 2023-12-12T09:43:43.724 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:43.721+0000 7fbfc93f0640 1 -- 172.21.15.73:0/4145289908 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfbc034440 con 0x7fbfb0004d00 2023-12-12T09:43:43.724 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:43.722+0000 7fbfcc656640 1 -- 172.21.15.73:0/4145289908 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbfb0004d00 msgr2=0x7fbfb0005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:43.724 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:43.722+0000 7fbfcc656640 1 --2- 172.21.15.73:0/4145289908 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbfb0004d00 0x7fbfb0005180 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fbfbc009f90 tx=0x7fbfb00057f0 comp rx=0 tx=0).stop 2023-12-12T09:43:43.724 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:43.722+0000 7fbfcabf3640 1 -- 172.21.15.73:0/4145289908 reap_dead start 2023-12-12T09:43:43.724 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:43.722+0000 7fbfcc656640 1 -- 172.21.15.73:0/4145289908 shutdown_connections 2023-12-12T09:43:43.724 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:43.722+0000 7fbfcc656640 1 -- 172.21.15.73:0/4145289908 >> 172.21.15.73:0/4145289908 conn(0x7fbfc40a8130 msgr2=0x7fbfc40c24b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:43:43.724 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:43.722+0000 7fbfcc656640 1 -- 172.21.15.73:0/4145289908 shutdown_connections 2023-12-12T09:43:43.724 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:43.722+0000 7fbfcc656640 1 -- 172.21.15.73:0/4145289908 wait complete. 2023-12-12T09:43:43.725 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:43.724+0000 7fbfcc656640 1 Processor -- start 2023-12-12T09:43:43.725 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:43.724+0000 7fbfcc656640 1 -- start start 2023-12-12T09:43:43.727 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:43.725+0000 7fbfcc656640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbfb0004d00 0x7fbfc41ea760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:43.728 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:43.725+0000 7fbfcc656640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbfc414b8d0 0x7fbfc4150ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:43.728 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:43.725+0000 7fbfcc656640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbfc4070890 0x7fbfc4070d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:43.728 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:43.725+0000 7fbfcc656640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfc4070400 con 0x7fbfc414b8d0 2023-12-12T09:43:43.728 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:43.725+0000 7fbfcc656640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfc41eaca0 con 0x7fbfc4070890 2023-12-12T09:43:43.728 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:43.725+0000 7fbfcc656640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbfc4152090 con 0x7fbfb0004d00 2023-12-12T09:43:43.728 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:43.725+0000 7fbfc9bf1640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbfc414b8d0 0x7fbfc4150ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:43.728 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:43.725+0000 7fbfc9bf1640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbfc414b8d0 0x7fbfc4150ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:41276/0 (socket says 172.21.15.73:41276) 2023-12-12T09:43:43.728 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:43.725+0000 7fbfc9bf1640 1 -- 172.21.15.73:0/2704419969 learned_addr learned my addr 172.21.15.73:0/2704419969 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:43:43.728 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:43.725+0000 7fbfca3f2640 1 --2- 172.21.15.73:0/2704419969 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbfb0004d00 0x7fbfc41ea760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:43.728 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:43.725+0000 7fbfc9bf1640 1 -- 172.21.15.73:0/2704419969 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbfb0004d00 msgr2=0x7fbfc41ea760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:43.728 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:43.725+0000 7fbfc9bf1640 1 --2- 172.21.15.73:0/2704419969 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbfb0004d00 0x7fbfc41ea760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:43.729 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:43.725+0000 7fbfc9bf1640 1 -- 172.21.15.73:0/2704419969 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbfc4070890 msgr2=0x7fbfc4070d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:43.729 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:43.725+0000 7fbfc9bf1640 1 --2- 172.21.15.73:0/2704419969 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbfc4070890 0x7fbfc4070d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:43.729 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:43.725+0000 7fbfc9bf1640 1 -- 172.21.15.73:0/2704419969 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfc406fdf0 con 0x7fbfc414b8d0 2023-12-12T09:43:43.729 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:43.725+0000 7fbfca3f2640 1 --2- 172.21.15.73:0/2704419969 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbfb0004d00 0x7fbfc41ea760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:43:43.729 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:43.726+0000 7fbfc9bf1640 1 --2- 172.21.15.73:0/2704419969 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbfc414b8d0 0x7fbfc4150ad0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fbfb400e550 tx=0x7fbfb400ea10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:43:43.729 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:43.726+0000 7fbfbaffd640 1 -- 172.21.15.73:0/2704419969 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfb40052e0 con 0x7fbfc414b8d0 2023-12-12T09:43:43.729 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:43.726+0000 7fbfbaffd640 1 -- 172.21.15.73:0/2704419969 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfb4005440 con 0x7fbfc414b8d0 2023-12-12T09:43:43.729 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:43.726+0000 7fbfbaffd640 1 -- 172.21.15.73:0/2704419969 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfb4003810 con 0x7fbfc414b8d0 2023-12-12T09:43:43.729 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:43.726+0000 7fbfcc656640 1 -- 172.21.15.73:0/2704419969 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbfc4151db0 con 0x7fbfc414b8d0 2023-12-12T09:43:43.729 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:43.726+0000 7fbfcc656640 1 -- 172.21.15.73:0/2704419969 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbfc4151010 con 0x7fbfc414b8d0 2023-12-12T09:43:43.732 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:43.727+0000 7fbfcc656640 1 -- 172.21.15.73:0/2704419969 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbfc40705b0 con 0x7fbfc414b8d0 2023-12-12T09:43:43.732 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:43.728+0000 7fbfbaffd640 1 -- 172.21.15.73:0/2704419969 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fbfb4003970 con 0x7fbfc414b8d0 2023-12-12T09:43:43.732 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:43.729+0000 7fbfbaffd640 1 --2- 172.21.15.73:0/2704419969 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fbfa806ae40 0x7fbfa806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:43.732 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:43.729+0000 7fbfbaffd640 1 -- 172.21.15.73:0/2704419969 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fbfb4089240 con 0x7fbfc414b8d0 2023-12-12T09:43:43.732 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:43.729+0000 7fbfca3f2640 1 --2- 172.21.15.73:0/2704419969 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fbfa806ae40 0x7fbfa806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:43.732 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:43.730+0000 7fbfca3f2640 1 --2- 172.21.15.73:0/2704419969 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fbfa806ae40 0x7fbfa806d300 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fbfc00017a0 tx=0x7fbfc0001150 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:43:43.735 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:43.734+0000 7fbfbaffd640 1 -- 172.21.15.73:0/2704419969 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fbfc40705b0 con 0x7fbfc414b8d0 2023-12-12T09:43:43.963 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:43.962+0000 7fbfcc656640 1 -- 172.21.15.73:0/2704419969 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fbfc40705b0 con 0x7fbfc414b8d0 2023-12-12T09:43:43.964 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:43.963+0000 7fbfbaffd640 1 -- 172.21.15.73:0/2704419969 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7fbfc40705b0 con 0x7fbfc414b8d0 2023-12-12T09:43:43.964 INFO:teuthology.orchestra.run.smithi073.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-12-12T09:43:43.967 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:43.965+0000 7fbfcc656640 1 -- 172.21.15.73:0/2704419969 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fbfa806ae40 msgr2=0x7fbfa806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:43.967 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:43.965+0000 7fbfcc656640 1 --2- 172.21.15.73:0/2704419969 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fbfa806ae40 0x7fbfa806d300 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fbfc00017a0 tx=0x7fbfc0001150 comp rx=0 tx=0).stop 2023-12-12T09:43:43.967 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:43.965+0000 7fbfcc656640 1 -- 172.21.15.73:0/2704419969 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbfc414b8d0 msgr2=0x7fbfc4150ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:43.967 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:43.965+0000 7fbfcc656640 1 --2- 172.21.15.73:0/2704419969 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbfc414b8d0 0x7fbfc4150ad0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fbfb400e550 tx=0x7fbfb400ea10 comp rx=0 tx=0).stop 2023-12-12T09:43:43.967 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:43.965+0000 7fbfcc656640 1 -- 172.21.15.73:0/2704419969 shutdown_connections 2023-12-12T09:43:43.967 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:43.966+0000 7fbfcc656640 1 --2- 172.21.15.73:0/2704419969 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fbfa806ae40 0x7fbfa806d300 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:43.967 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:43.966+0000 7fbfcc656640 1 --2- 172.21.15.73:0/2704419969 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbfc4070890 0x7fbfc4070d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:43.967 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:43.966+0000 7fbfcc656640 1 --2- 172.21.15.73:0/2704419969 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbfc414b8d0 0x7fbfc4150ad0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:43.967 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:43.966+0000 7fbfcc656640 1 --2- 172.21.15.73:0/2704419969 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbfb0004d00 0x7fbfc41ea760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:43.968 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:43.966+0000 7fbfcc656640 1 -- 172.21.15.73:0/2704419969 >> 172.21.15.73:0/2704419969 conn(0x7fbfc40a8130 msgr2=0x7fbfc414f280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:43:43.968 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:43.966+0000 7fbfcc656640 1 -- 172.21.15.73:0/2704419969 shutdown_connections 2023-12-12T09:43:43.968 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:43.966+0000 7fbfcc656640 1 -- 172.21.15.73:0/2704419969 wait complete. 2023-12-12T09:43:43.985 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-12-12T09:43:43.986 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-12T09:43:43.986 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi142.front.sepia.ceph.com 2023-12-12T09:43:43.986 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-12-12T09:43:43.986 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-12-12T09:43:43.986 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-12-12T09:43:43.986 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-12-12T09:43:43.986 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-12-12T09:43:43.986 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2023-12-12T09:43:43.986 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T09:43:43.986 DEBUG:teuthology.orchestra.run.smithi142:> ip addr 2023-12-12T09:43:44.045 INFO:teuthology.orchestra.run.smithi142.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-12T09:43:44.046 INFO:teuthology.orchestra.run.smithi142.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-12T09:43:44.046 INFO:teuthology.orchestra.run.smithi142.stdout: inet 127.0.0.1/8 scope host lo 2023-12-12T09:43:44.046 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2023-12-12T09:43:44.046 INFO:teuthology.orchestra.run.smithi142.stdout: inet6 ::1/128 scope host 2023-12-12T09:43:44.046 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2023-12-12T09:43:44.046 INFO:teuthology.orchestra.run.smithi142.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-12T09:43:44.046 INFO:teuthology.orchestra.run.smithi142.stdout: link/ether 0c:c4:7a:d9:36:3c brd ff:ff:ff:ff:ff:ff 2023-12-12T09:43:44.046 INFO:teuthology.orchestra.run.smithi142.stdout: altname enp7s0f0 2023-12-12T09:43:44.046 INFO:teuthology.orchestra.run.smithi142.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-12T09:43:44.046 INFO:teuthology.orchestra.run.smithi142.stdout: link/ether 0c:c4:7a:d9:36:3d brd ff:ff:ff:ff:ff:ff 2023-12-12T09:43:44.046 INFO:teuthology.orchestra.run.smithi142.stdout: altname enp7s0f1 2023-12-12T09:43:44.046 INFO:teuthology.orchestra.run.smithi142.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-12T09:43:44.046 INFO:teuthology.orchestra.run.smithi142.stdout: link/ether 0c:c4:7a:88:6e:0c brd ff:ff:ff:ff:ff:ff 2023-12-12T09:43:44.047 INFO:teuthology.orchestra.run.smithi142.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-12T09:43:44.047 INFO:teuthology.orchestra.run.smithi142.stdout: link/ether 0c:c4:7a:88:6e:0d brd ff:ff:ff:ff:ff:ff 2023-12-12T09:43:44.047 INFO:teuthology.orchestra.run.smithi142.stdout: inet 172.21.15.142/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-12-12T09:43:44.047 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft 42378sec preferred_lft 42378sec 2023-12-12T09:43:44.047 INFO:teuthology.orchestra.run.smithi142.stdout: inet6 fe80::ec4:7aff:fe88:6e0d/64 scope link 2023-12-12T09:43:44.047 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2023-12-12T09:43:44.050 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-12-12T09:43:44.051 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T09:43:44.051 DEBUG:teuthology.orchestra.run.smithi142:> (cd / && exec bash -c ' 2023-12-12T09:43:44.051 DEBUG:teuthology.orchestra.run.smithi142:> set -e 2023-12-12T09:43:44.051 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip link add name ceph-brx type bridge 2023-12-12T09:43:44.051 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip addr flush dev ceph-brx 2023-12-12T09:43:44.051 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip link set ceph-brx up 2023-12-12T09:43:44.051 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-12-12T09:43:44.051 DEBUG:teuthology.orchestra.run.smithi142:> ') 2023-12-12T09:43:44.527 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T09:43:44.527 DEBUG:teuthology.orchestra.run.smithi142:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-12T09:43:44.602 INFO:teuthology.orchestra.run.smithi142.stdout:1 2023-12-12T09:43:44.605 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T09:43:44.605 DEBUG:teuthology.orchestra.run.smithi142:> route 2023-12-12T09:43:44.661 INFO:teuthology.orchestra.run.smithi142.stdout:Kernel IP routing table 2023-12-12T09:43:44.661 INFO:teuthology.orchestra.run.smithi142.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-12T09:43:44.661 INFO:teuthology.orchestra.run.smithi142.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-12-12T09:43:44.662 INFO:teuthology.orchestra.run.smithi142.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-12-12T09:43:44.662 INFO:teuthology.orchestra.run.smithi142.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-12T09:43:44.662 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T09:43:44.663 DEBUG:teuthology.orchestra.run.smithi142:> (cd / && exec bash -c ' 2023-12-12T09:43:44.663 DEBUG:teuthology.orchestra.run.smithi142:> set -e 2023-12-12T09:43:44.663 DEBUG:teuthology.orchestra.run.smithi142:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-12-12T09:43:44.663 DEBUG:teuthology.orchestra.run.smithi142:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-12-12T09:43:44.663 DEBUG:teuthology.orchestra.run.smithi142:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-12-12T09:43:44.663 DEBUG:teuthology.orchestra.run.smithi142:> ') 2023-12-12T09:43:45.417 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T09:43:45.418 DEBUG:teuthology.orchestra.run.smithi142:> ip netns list 2023-12-12T09:43:45.475 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T09:43:45.475 DEBUG:teuthology.orchestra.run.smithi142:> ip netns list-id 2023-12-12T09:43:45.530 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T09:43:45.530 DEBUG:teuthology.orchestra.run.smithi142:> (cd / && exec bash -c ' 2023-12-12T09:43:45.530 DEBUG:teuthology.orchestra.run.smithi142:> set -e 2023-12-12T09:43:45.530 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2023-12-12T09:43:45.530 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2023-12-12T09:43:45.530 DEBUG:teuthology.orchestra.run.smithi142:> ') 2023-12-12T09:43:45.675 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2023-12-12T09:43:45.675 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T09:43:45.675 DEBUG:teuthology.orchestra.run.smithi142:> (cd / && exec bash -c ' 2023-12-12T09:43:45.675 DEBUG:teuthology.orchestra.run.smithi142:> set -e 2023-12-12T09:43:45.675 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2023-12-12T09:43:45.676 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-12-12T09:43:45.676 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2023-12-12T09:43:45.676 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2023-12-12T09:43:45.676 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2023-12-12T09:43:45.676 DEBUG:teuthology.orchestra.run.smithi142:> ') 2023-12-12T09:43:45.960 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T09:43:45.960 DEBUG:teuthology.orchestra.run.smithi142:> (cd / && exec bash -c ' 2023-12-12T09:43:45.961 DEBUG:teuthology.orchestra.run.smithi142:> set -e 2023-12-12T09:43:45.961 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip link set brx.0 up 2023-12-12T09:43:45.961 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip link set dev brx.0 master ceph-brx 2023-12-12T09:43:45.961 DEBUG:teuthology.orchestra.run.smithi142:> ') 2023-12-12T09:43:46.127 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-12T09:43:46.128 DEBUG:teuthology.orchestra.run.smithi142:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-12-12T09:43:46.175 INFO:teuthology.orchestra.run.smithi142.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-12-12T09:43:46.176 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-12T09:43:46.176 DEBUG:teuthology.orchestra.run.smithi142:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-12-12T09:43:46.222 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2023-12-12T09:43:46.222 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T09:43:46.222 DEBUG:teuthology.orchestra.run.smithi142:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-12T09:43:46.463 INFO:teuthology.orchestra.run.smithi142.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-12T09:43:46.463 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-12T09:43:46.893 INFO:teuthology.orchestra.run.smithi142.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-12T09:43:46.893 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-12T09:43:46.893 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: resolved to: "172.21.15.73:3300,172.21.15.142:3300,172.21.15.142:3301" 2023-12-12T09:43:46.894 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: trying mount with new device syntax: 1@ba240992-02b8-4c7e-92f2-27eb29ac433b.cephfs=/ 2023-12-12T09:43:46.894 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.73:3300/172.21.15.142:3300/172.21.15.142:3301" will pass to kernel 2023-12-12T09:43:46.898 INFO:teuthology.orchestra.run.smithi142.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2023-12-12T09:43:46.898 INFO:teuthology.orchestra.run.smithi142.stdout: You just mounted a file system that supports labels which does not 2023-12-12T09:43:46.898 INFO:teuthology.orchestra.run.smithi142.stdout: contain labels, onto an SELinux box. It is likely that confined 2023-12-12T09:43:46.898 INFO:teuthology.orchestra.run.smithi142.stdout: applications will generate AVC messages and not be allowed access to 2023-12-12T09:43:46.898 INFO:teuthology.orchestra.run.smithi142.stdout: this file system. For more details see restorecon(8) and mount(8). 2023-12-12T09:43:46.901 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-12-12T09:43:46.902 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T09:43:46.902 DEBUG:teuthology.orchestra.run.smithi142:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-12-12T09:43:46.990 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T09:43:46.990 DEBUG:teuthology.orchestra.run.smithi142:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-12T09:43:47.043 INFO:teuthology.orchestra.run.smithi142.stdout:client4656 2023-12-12T09:43:47.044 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2023-12-12T09:43:47.044 DEBUG:teuthology.orchestra.run.smithi142:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-12T09:43:47.094 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T09:43:47.095 DEBUG:teuthology.orchestra.run.smithi142:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-12T09:43:47.196 INFO:teuthology.orchestra.run.smithi142.stdout:client4656 2023-12-12T09:43:47.196 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T09:43:47.196 DEBUG:teuthology.orchestra.run.smithi142:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-12T09:43:47.247 INFO:teuthology.orchestra.run.smithi142.stdout:client4656 2023-12-12T09:43:47.248 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T09:43:47.248 DEBUG:teuthology.orchestra.run.smithi142:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/ba240992-02b8-4c7e-92f2-27eb29ac433b.client4656/status') 2023-12-12T09:43:47.330 INFO:teuthology.orchestra.run.smithi142.stdout:instance: client.4656 (3)172.21.15.142:0/2699845866 2023-12-12T09:43:47.331 INFO:teuthology.orchestra.run.smithi142.stdout:blocklisted: false 2023-12-12T09:43:47.331 INFO:teuthology.orchestra.run.smithi142.stderr:0+1 records in 2023-12-12T09:43:47.331 INFO:teuthology.orchestra.run.smithi142.stderr:0+1 records out 2023-12-12T09:43:47.331 INFO:teuthology.orchestra.run.smithi142.stderr:71 bytes copied, 7.9458e-05 s, 894 kB/s 2023-12-12T09:43:47.339 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2023-12-12T09:43:47.364 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-12T09:43:47.587 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:47.586+0000 7fe39e090640 1 Processor -- start 2023-12-12T09:43:47.587 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:47.586+0000 7fe39e090640 1 -- start start 2023-12-12T09:43:47.588 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:47.587+0000 7fe39e090640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe3980a5040 0x7fe39806bf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:47.588 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:47.587+0000 7fe39e090640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fe39806a4e0 0x7fe39806a950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:47.588 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:47.587+0000 7fe39e090640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe398158c00 con 0x7fe3980c3ad0 2023-12-12T09:43:47.589 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:47.587+0000 7fe39e090640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe39806c4d0 con 0x7fe39806a4e0 2023-12-12T09:43:47.589 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:47.587+0000 7fe39e090640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3980c4d00 con 0x7fe3980a5040 2023-12-12T09:43:47.589 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:47.588+0000 7fe3977fe640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe3980a5040 0x7fe39806bf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:47.589 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:47.588+0000 7fe38ffff640 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7fe3980c3ad0 0x7fe3981584f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.73:51492/0 (socket says 172.21.15.73:51492) 2023-12-12T09:43:47.589 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:47.588+0000 7fe38ffff640 1 -- 172.21.15.73:0/2665711338 learned_addr learned my addr 172.21.15.73:0/2665711338 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-12T09:43:47.589 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:47.588+0000 7fe397fff640 1 --2- 172.21.15.73:0/2665711338 >> v2:172.21.15.142:3300/0 conn(0x7fe39806a4e0 0x7fe39806a950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:47.590 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:47.589+0000 7fe3977fe640 1 -- 172.21.15.73:0/2665711338 >> v2:172.21.15.142:3300/0 conn(0x7fe39806a4e0 msgr2=0x7fe39806a950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:43:47.590 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:47.589+0000 7fe3977fe640 1 --2- 172.21.15.73:0/2665711338 >> v2:172.21.15.142:3300/0 conn(0x7fe39806a4e0 0x7fe39806a950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:47.590 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:47.589+0000 7fe3977fe640 1 -- 172.21.15.73:0/2665711338 >> v1:172.21.15.142:6789/0 conn(0x7fe3980c3ad0 legacy=0x7fe3981584f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:47.590 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:47.589+0000 7fe3977fe640 1 -- 172.21.15.73:0/2665711338 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3980c5100 con 0x7fe3980a5040 2023-12-12T09:43:47.590 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:47.589+0000 7fe396ffd640 1 -- 172.21.15.73:0/2665711338 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 762952922 0 0) 0x7fe398158c00 con 0x7fe3980c3ad0 2023-12-12T09:43:47.592 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:47.590+0000 7fe3977fe640 1 --2- 172.21.15.73:0/2665711338 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe3980a5040 0x7fe39806bf90 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fe3880097a0 tx=0x7fe38802b960 comp rx=0 tx=0).ready entity=mon.2 client_cookie=20537d141124083d server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:43:47.592 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:47.591+0000 7fe396ffd640 1 -- 172.21.15.73:0/2665711338 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe388030610 con 0x7fe3980a5040 2023-12-12T09:43:47.592 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:47.591+0000 7fe396ffd640 1 -- 172.21.15.73:0/2665711338 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe388030770 con 0x7fe3980a5040 2023-12-12T09:43:47.592 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:47.591+0000 7fe396ffd640 1 -- 172.21.15.73:0/2665711338 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe388030b00 con 0x7fe3980a5040 2023-12-12T09:43:47.593 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:47.591+0000 7fe39e090640 1 -- 172.21.15.73:0/2665711338 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe3980a5040 msgr2=0x7fe39806bf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:47.593 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:47.591+0000 7fe39e090640 1 --2- 172.21.15.73:0/2665711338 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe3980a5040 0x7fe39806bf90 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fe3880097a0 tx=0x7fe38802b960 comp rx=0 tx=0).stop 2023-12-12T09:43:47.593 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:47.592+0000 7fe39e090640 1 -- 172.21.15.73:0/2665711338 shutdown_connections 2023-12-12T09:43:47.593 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:47.592+0000 7fe39e090640 1 --2- 172.21.15.73:0/2665711338 >> v2:172.21.15.142:3300/0 conn(0x7fe39806a4e0 0x7fe39806a950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:47.593 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:47.592+0000 7fe39e090640 1 --2- 172.21.15.73:0/2665711338 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe3980a5040 0x7fe39806bf90 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:47.593 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:47.592+0000 7fe39e090640 1 -- 172.21.15.73:0/2665711338 >> 172.21.15.73:0/2665711338 conn(0x7fe3980a8130 msgr2=0x7fe3980c24b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:43:47.593 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:47.592+0000 7fe39e090640 1 -- 172.21.15.73:0/2665711338 shutdown_connections 2023-12-12T09:43:47.593 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:47.592+0000 7fe39e090640 1 -- 172.21.15.73:0/2665711338 wait complete. 2023-12-12T09:43:47.594 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:47.593+0000 7fe39e090640 1 Processor -- start 2023-12-12T09:43:47.594 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:47.593+0000 7fe39e090640 1 -- start start 2023-12-12T09:43:47.597 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:47.594+0000 7fe39e090640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe39806a4e0 0x7fe3981eac30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:47.598 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:47.594+0000 7fe39e090640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe3980a5040 0x7fe39814e800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:47.598 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:47.594+0000 7fe39e090640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe3980c3ad0 0x7fe3981542a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:47.598 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:47.594+0000 7fe39e090640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3981e1920 con 0x7fe3980c3ad0 2023-12-12T09:43:47.598 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:47.594+0000 7fe39e090640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe39814f710 con 0x7fe3980a5040 2023-12-12T09:43:47.598 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:47.594+0000 7fe39e090640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe39814f150 con 0x7fe39806a4e0 2023-12-12T09:43:47.598 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:47.595+0000 7fe397fff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe3980c3ad0 0x7fe3981542a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:47.599 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:47.595+0000 7fe397fff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe3980c3ad0 0x7fe3981542a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:41286/0 (socket says 172.21.15.73:41286) 2023-12-12T09:43:47.599 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:47.595+0000 7fe397fff640 1 -- 172.21.15.73:0/910785750 learned_addr learned my addr 172.21.15.73:0/910785750 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:43:47.599 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:47.595+0000 7fe38ffff640 1 --2- 172.21.15.73:0/910785750 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe3980a5040 0x7fe39814e800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:47.599 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:47.595+0000 7fe3977fe640 1 --2- 172.21.15.73:0/910785750 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe39806a4e0 0x7fe3981eac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:47.599 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:47.595+0000 7fe397fff640 1 -- 172.21.15.73:0/910785750 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe39806a4e0 msgr2=0x7fe3981eac30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:47.599 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:47.595+0000 7fe397fff640 1 --2- 172.21.15.73:0/910785750 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe39806a4e0 0x7fe3981eac30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:47.600 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:47.595+0000 7fe397fff640 1 -- 172.21.15.73:0/910785750 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe3980a5040 msgr2=0x7fe39814e800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:47.600 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:47.595+0000 7fe397fff640 1 --2- 172.21.15.73:0/910785750 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe3980a5040 0x7fe39814e800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:47.600 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:47.595+0000 7fe397fff640 1 -- 172.21.15.73:0/910785750 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe388009400 con 0x7fe3980c3ad0 2023-12-12T09:43:47.600 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:47.595+0000 7fe3977fe640 1 --2- 172.21.15.73:0/910785750 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe39806a4e0 0x7fe3981eac30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:43:47.600 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:47.595+0000 7fe397fff640 1 --2- 172.21.15.73:0/910785750 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe3980c3ad0 0x7fe3981542a0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fe39000efc0 tx=0x7fe39000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:43:47.600 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:47.596+0000 7fe394ff9640 1 -- 172.21.15.73:0/910785750 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe390014480 con 0x7fe3980c3ad0 2023-12-12T09:43:47.601 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:47.596+0000 7fe394ff9640 1 -- 172.21.15.73:0/910785750 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe39000f040 con 0x7fe3980c3ad0 2023-12-12T09:43:47.601 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:47.596+0000 7fe39e090640 1 -- 172.21.15.73:0/910785750 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe39814f430 con 0x7fe3980c3ad0 2023-12-12T09:43:47.601 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:47.596+0000 7fe394ff9640 1 -- 172.21.15.73:0/910785750 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe390014820 con 0x7fe3980c3ad0 2023-12-12T09:43:47.601 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:47.596+0000 7fe39e090640 1 -- 172.21.15.73:0/910785750 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3980aa150 con 0x7fe3980c3ad0 2023-12-12T09:43:47.603 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:47.597+0000 7fe39e090640 1 -- 172.21.15.73:0/910785750 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe3980aa340 con 0x7fe3980c3ad0 2023-12-12T09:43:47.603 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:47.598+0000 7fe394ff9640 1 -- 172.21.15.73:0/910785750 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fe390014980 con 0x7fe3980c3ad0 2023-12-12T09:43:47.603 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:47.599+0000 7fe394ff9640 1 --2- 172.21.15.73:0/910785750 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fe37c06ae40 0x7fe37c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:47.603 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:47.599+0000 7fe394ff9640 1 -- 172.21.15.73:0/910785750 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe39008a1f0 con 0x7fe3980c3ad0 2023-12-12T09:43:47.603 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:47.599+0000 7fe3977fe640 1 --2- 172.21.15.73:0/910785750 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fe37c06ae40 0x7fe37c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:47.603 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:47.600+0000 7fe3977fe640 1 --2- 172.21.15.73:0/910785750 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fe37c06ae40 0x7fe37c06d300 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fe388036000 tx=0x7fe38803b040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:43:47.604 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:47.604+0000 7fe394ff9640 1 -- 172.21.15.73:0/910785750 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fe390055290 con 0x7fe3980c3ad0 2023-12-12T09:43:47.794 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:47.793+0000 7fe39e090640 1 -- 172.21.15.73:0/910785750 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe398067580 con 0x7fe3980c3ad0 2023-12-12T09:43:47.796 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:47.796+0000 7fe394ff9640 1 -- 172.21.15.73:0/910785750 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16517 (secure 0 0 0) 0x7fe3900588b0 con 0x7fe3980c3ad0 2023-12-12T09:43:47.797 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-12T09:43:47.797 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":21,"fsid":"ba240992-02b8-4c7e-92f2-27eb29ac433b","created":"2023-12-12T09:43:02.454719+0000","modified":"2023-12-12T09:43:23.219345+0000","last_up_change":"2023-12-12T09:43:13.913440+0000","last_in_change":"2023-12-12T09:43:05.925348+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-12T09:43:15.525508+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-12T09:43:20.004546+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-12T09:43:20.736500+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"dd9074be-dbe2-4c34-9896-a4223d8d3940","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":4047810203},{"type":"v1","addr":"172.21.15.73:6801","nonce":4047810203}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":4047810203},{"type":"v1","addr":"172.21.15.73:6803","nonce":4047810203}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":4047810203},{"type":"v1","addr":"172.21.15.73:6807","nonce":4047810203}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":4047810203},{"type":"v1","addr":"172.21.15.73:6805","nonce":4047810203}]},"public_addr":"172.21.15.73:6801/4047810203","cluster_addr":"172.21.15.73:6803/4047810203","heartbeat_back_addr":"172.21.15.73:6807/4047810203","heartbeat_front_addr":"172.21.15.73:6805/4047810203","state":["exists","up"]},{"osd":1,"uuid":"c4a05052-96d4-4758-a4e1-1a37f1e07fed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":1356058331},{"type":"v1","addr":"172.21.15.73:6824","nonce":1356058331}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":1356058331},{"type":"v1","addr":"172.21.15.73:6827","nonce":1356058331}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":1356058331},{"type":"v1","addr":"172.21.15.73:6831","nonce":1356058331}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":1356058331},{"type":"v1","addr":"172.21.15.73:6829","nonce":1356058331}]},"public_addr":"172.21.15.73:6824/1356058331","cluster_addr":"172.21.15.73:6827/1356058331","heartbeat_back_addr":"172.21.15.73:6831/1356058331","heartbeat_front_addr":"172.21.15.73:6829/1356058331","state":["exists","up"]},{"osd":2,"uuid":"512bc8ac-72c2-40d4-b3d2-d867a92c5213","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":1228903316},{"type":"v1","addr":"172.21.15.73:6817","nonce":1228903316}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":1228903316},{"type":"v1","addr":"172.21.15.73:6819","nonce":1228903316}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6823","nonce":1228903316},{"type":"v1","addr":"172.21.15.73:6825","nonce":1228903316}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":1228903316},{"type":"v1","addr":"172.21.15.73:6821","nonce":1228903316}]},"public_addr":"172.21.15.73:6817/1228903316","cluster_addr":"172.21.15.73:6819/1228903316","heartbeat_back_addr":"172.21.15.73:6825/1228903316","heartbeat_front_addr":"172.21.15.73:6821/1228903316","state":["exists","up"]},{"osd":3,"uuid":"3d1a91e0-42bf-437a-8eae-8d357c8f63a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":1293329670},{"type":"v1","addr":"172.21.15.73:6809","nonce":1293329670}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6810","nonce":1293329670},{"type":"v1","addr":"172.21.15.73:6811","nonce":1293329670}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":1293329670},{"type":"v1","addr":"172.21.15.73:6815","nonce":1293329670}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":1293329670},{"type":"v1","addr":"172.21.15.73:6813","nonce":1293329670}]},"public_addr":"172.21.15.73:6809/1293329670","cluster_addr":"172.21.15.73:6811/1293329670","heartbeat_back_addr":"172.21.15.73:6815/1293329670","heartbeat_front_addr":"172.21.15.73:6813/1293329670","state":["exists","up"]},{"osd":4,"uuid":"4b302fff-834c-4069-ac19-00e46f6c87b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":3727975702},{"type":"v1","addr":"172.21.15.142:6801","nonce":3727975702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":3727975702},{"type":"v1","addr":"172.21.15.142:6803","nonce":3727975702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6809","nonce":3727975702},{"type":"v1","addr":"172.21.15.142:6811","nonce":3727975702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6805","nonce":3727975702},{"type":"v1","addr":"172.21.15.142:6807","nonce":3727975702}]},"public_addr":"172.21.15.142:6801/3727975702","cluster_addr":"172.21.15.142:6803/3727975702","heartbeat_back_addr":"172.21.15.142:6811/3727975702","heartbeat_front_addr":"172.21.15.142:6807/3727975702","state":["exists","up"]},{"osd":5,"uuid":"d7cdace2-67d0-45cc-95f2-515cf6ef1b82","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6817","nonce":2353193632},{"type":"v1","addr":"172.21.15.142:6819","nonce":2353193632}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6821","nonce":2353193632},{"type":"v1","addr":"172.21.15.142:6823","nonce":2353193632}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6829","nonce":2353193632},{"type":"v1","addr":"172.21.15.142:6831","nonce":2353193632}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6825","nonce":2353193632},{"type":"v1","addr":"172.21.15.142:6827","nonce":2353193632}]},"public_addr":"172.21.15.142:6819/2353193632","cluster_addr":"172.21.15.142:6823/2353193632","heartbeat_back_addr":"172.21.15.142:6831/2353193632","heartbeat_front_addr":"172.21.15.142:6827/2353193632","state":["exists","up"]},{"osd":6,"uuid":"649ce78a-5626-445c-aedc-a651ed05a6f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":2006111986},{"type":"v1","addr":"172.21.15.142:6806","nonce":2006111986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":2006111986},{"type":"v1","addr":"172.21.15.142:6810","nonce":2006111986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":2006111986},{"type":"v1","addr":"172.21.15.142:6815","nonce":2006111986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":2006111986},{"type":"v1","addr":"172.21.15.142:6813","nonce":2006111986}]},"public_addr":"172.21.15.142:6806/2006111986","cluster_addr":"172.21.15.142:6810/2006111986","heartbeat_back_addr":"172.21.15.142:6815/2006111986","heartbeat_front_addr":"172.21.15.142:6813/2006111986","state":["exists","up"]},{"osd":7,"uuid":"af15ae3b-c1d0-4acf-92db-8a1805494d13","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":2573794341},{"type":"v1","addr":"172.21.15.142:6818","nonce":2573794341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":2573794341},{"type":"v1","addr":"172.21.15.142:6822","nonce":2573794341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":2573794341},{"type":"v1","addr":"172.21.15.142:6830","nonce":2573794341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":2573794341},{"type":"v1","addr":"172.21.15.142:6826","nonce":2573794341}]},"public_addr":"172.21.15.142:6818/2573794341","cluster_addr":"172.21.15.142:6822/2573794341","heartbeat_back_addr":"172.21.15.142:6830/2573794341","heartbeat_front_addr":"172.21.15.142:6826/2573794341","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.185824+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.262103+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.225556+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:10.523459+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:10.706035+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.257339+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.301776+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.051960+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-12T09:43:47.800 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:47.798+0000 7fe39e090640 1 -- 172.21.15.73:0/910785750 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fe37c06ae40 msgr2=0x7fe37c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:47.800 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:47.798+0000 7fe39e090640 1 --2- 172.21.15.73:0/910785750 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fe37c06ae40 0x7fe37c06d300 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fe388036000 tx=0x7fe38803b040 comp rx=0 tx=0).stop 2023-12-12T09:43:47.800 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:47.798+0000 7fe39e090640 1 -- 172.21.15.73:0/910785750 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe3980c3ad0 msgr2=0x7fe3981542a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:47.800 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:47.798+0000 7fe39e090640 1 --2- 172.21.15.73:0/910785750 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe3980c3ad0 0x7fe3981542a0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fe39000efc0 tx=0x7fe39000c490 comp rx=0 tx=0).stop 2023-12-12T09:43:47.800 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:47.799+0000 7fe39e090640 1 -- 172.21.15.73:0/910785750 shutdown_connections 2023-12-12T09:43:47.800 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:47.799+0000 7fe39e090640 1 --2- 172.21.15.73:0/910785750 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fe37c06ae40 0x7fe37c06d300 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:47.800 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:47.799+0000 7fe39e090640 1 --2- 172.21.15.73:0/910785750 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe3980c3ad0 0x7fe3981542a0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:47.800 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:47.799+0000 7fe39e090640 1 --2- 172.21.15.73:0/910785750 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe3980a5040 0x7fe39814e800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:47.800 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:47.799+0000 7fe39e090640 1 --2- 172.21.15.73:0/910785750 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe39806a4e0 0x7fe3981eac30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:47.800 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:47.799+0000 7fe39e090640 1 -- 172.21.15.73:0/910785750 >> 172.21.15.73:0/910785750 conn(0x7fe3980a8130 msgr2=0x7fe3980c22b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:43:47.800 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:47.799+0000 7fe39e090640 1 -- 172.21.15.73:0/910785750 shutdown_connections 2023-12-12T09:43:47.800 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:47.799+0000 7fe39e090640 1 -- 172.21.15.73:0/910785750 wait complete. 2023-12-12T09:43:47.820 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-12T09:43:15.525508+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-12T09:43:20.004546+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-12T09:43:20.736500+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-12T09:43:47.820 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-12T09:43:48.035 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:48.033+0000 7f0da8248640 1 Processor -- start 2023-12-12T09:43:48.035 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:48.034+0000 7f0da8248640 1 -- start start 2023-12-12T09:43:48.036 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:48.035+0000 7f0da8248640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f0da0152000 0x7f0da01551e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:48.036 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:48.035+0000 7f0da8248640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0da00c84d0 0x7f0da006c340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:48.036 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:48.035+0000 7f0da8248640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f0da006c880 0x7f0da00c68c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:48.036 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:48.035+0000 7f0da8248640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0da0155720 con 0x7f0da0152000 2023-12-12T09:43:48.036 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:48.035+0000 7f0da8248640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0da006bb80 con 0x7f0da006c880 2023-12-12T09:43:48.036 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:48.035+0000 7f0da8248640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0da00c4830 con 0x7f0da00c84d0 2023-12-12T09:43:48.037 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:48.036+0000 7f0da5fe4640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f0da0152000 0x7f0da01551e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:48.037 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:48.036+0000 7f0da5fe4640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f0da0152000 0x7f0da01551e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:41296/0 (socket says 172.21.15.73:41296) 2023-12-12T09:43:48.037 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:48.036+0000 7f0da5fe4640 1 -- 172.21.15.73:0/3351722526 learned_addr learned my addr 172.21.15.73:0/3351722526 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:43:48.037 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:48.036+0000 7f0da67e5640 1 --2- 172.21.15.73:0/3351722526 >> v2:172.21.15.142:3300/0 conn(0x7f0da006c880 0x7f0da00c68c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:48.038 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:48.036+0000 7f0da57e3640 1 --2- 172.21.15.73:0/3351722526 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0da00c84d0 0x7f0da006c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:48.038 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:48.036+0000 7f0da5fe4640 1 -- 172.21.15.73:0/3351722526 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0da00c84d0 msgr2=0x7f0da006c340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:43:48.038 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:48.036+0000 7f0da5fe4640 1 --2- 172.21.15.73:0/3351722526 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0da00c84d0 0x7f0da006c340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:48.038 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:48.036+0000 7f0da5fe4640 1 -- 172.21.15.73:0/3351722526 >> v2:172.21.15.142:3300/0 conn(0x7f0da006c880 msgr2=0x7f0da00c68c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:43:48.038 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:48.036+0000 7f0da5fe4640 1 --2- 172.21.15.73:0/3351722526 >> v2:172.21.15.142:3300/0 conn(0x7f0da006c880 0x7f0da00c68c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:48.038 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:48.036+0000 7f0da5fe4640 1 -- 172.21.15.73:0/3351722526 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0da00c4b10 con 0x7f0da0152000 2023-12-12T09:43:48.038 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:48.036+0000 7f0da57e3640 1 --2- 172.21.15.73:0/3351722526 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0da00c84d0 0x7f0da006c340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-12T09:43:48.039 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:48.037+0000 7f0da5fe4640 1 --2- 172.21.15.73:0/3351722526 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0da0152000 0x7f0da01551e0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f0da00aca00 tx=0x7f0d9002be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16a0452e0dbae228 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:43:48.039 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:48.038+0000 7f0da4fe2640 1 -- 172.21.15.73:0/3351722526 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d9002c9e0 con 0x7f0da0152000 2023-12-12T09:43:48.039 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:48.038+0000 7f0da4fe2640 1 -- 172.21.15.73:0/3351722526 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d9002cb40 con 0x7f0da0152000 2023-12-12T09:43:48.039 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:48.038+0000 7f0da4fe2640 1 -- 172.21.15.73:0/3351722526 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d900343f0 con 0x7f0da0152000 2023-12-12T09:43:48.039 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:48.038+0000 7f0da8248640 1 -- 172.21.15.73:0/3351722526 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0da0152000 msgr2=0x7f0da01551e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:48.039 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:48.038+0000 7f0da8248640 1 --2- 172.21.15.73:0/3351722526 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0da0152000 0x7f0da01551e0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f0da00aca00 tx=0x7f0d9002be40 comp rx=0 tx=0).stop 2023-12-12T09:43:48.041 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:48.038+0000 7f0da8248640 1 -- 172.21.15.73:0/3351722526 shutdown_connections 2023-12-12T09:43:48.042 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:48.038+0000 7f0da8248640 1 --2- 172.21.15.73:0/3351722526 >> v2:172.21.15.142:3300/0 conn(0x7f0da006c880 0x7f0da00c68c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:48.042 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:48.038+0000 7f0da8248640 1 --2- 172.21.15.73:0/3351722526 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0da00c84d0 0x7f0da006c340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:48.042 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:48.038+0000 7f0da8248640 1 --2- 172.21.15.73:0/3351722526 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0da0152000 0x7f0da01551e0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:48.042 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:48.038+0000 7f0da8248640 1 -- 172.21.15.73:0/3351722526 >> 172.21.15.73:0/3351722526 conn(0x7f0da00ab9e0 msgr2=0x7f0da00abdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:43:48.042 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:48.038+0000 7f0da8248640 1 -- 172.21.15.73:0/3351722526 shutdown_connections 2023-12-12T09:43:48.042 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:48.038+0000 7f0da8248640 1 -- 172.21.15.73:0/3351722526 wait complete. 2023-12-12T09:43:48.042 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:48.040+0000 7f0da8248640 1 Processor -- start 2023-12-12T09:43:48.042 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:48.040+0000 7f0da8248640 1 -- start start 2023-12-12T09:43:48.044 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:48.041+0000 7f0da8248640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0da006c880 0x7f0da0148660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:48.044 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:48.041+0000 7f0da8248640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0da00c84d0 0x7f0da01566d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:48.044 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:48.041+0000 7f0da8248640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0da0155b00 0x7f0da01ea810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:48.044 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:48.041+0000 7f0da8248640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0da01ead50 con 0x7f0da006c880 2023-12-12T09:43:48.044 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:48.041+0000 7f0da8248640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0da00ab680 con 0x7f0da0155b00 2023-12-12T09:43:48.044 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:48.041+0000 7f0da8248640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0da01ed850 con 0x7f0da00c84d0 2023-12-12T09:43:48.044 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:48.041+0000 7f0da5fe4640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0da006c880 0x7f0da0148660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:48.044 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:48.041+0000 7f0da5fe4640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0da006c880 0x7f0da0148660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:41302/0 (socket says 172.21.15.73:41302) 2023-12-12T09:43:48.045 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:48.041+0000 7f0da5fe4640 1 -- 172.21.15.73:0/2457063488 learned_addr learned my addr 172.21.15.73:0/2457063488 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:43:48.045 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:48.042+0000 7f0da67e5640 1 --2- 172.21.15.73:0/2457063488 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0da0155b00 0x7f0da01ea810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:48.045 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:48.042+0000 7f0da5fe4640 1 -- 172.21.15.73:0/2457063488 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0da00c84d0 msgr2=0x7f0da01566d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:48.045 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:48.042+0000 7f0da57e3640 1 --2- 172.21.15.73:0/2457063488 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0da00c84d0 0x7f0da01566d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:48.045 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:48.042+0000 7f0da5fe4640 1 --2- 172.21.15.73:0/2457063488 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0da00c84d0 0x7f0da01566d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:48.045 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:48.042+0000 7f0da5fe4640 1 -- 172.21.15.73:0/2457063488 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0da0155b00 msgr2=0x7f0da01ea810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:48.045 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:48.042+0000 7f0da5fe4640 1 --2- 172.21.15.73:0/2457063488 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0da0155b00 0x7f0da01ea810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:48.045 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:48.042+0000 7f0da5fe4640 1 -- 172.21.15.73:0/2457063488 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d90009b30 con 0x7f0da006c880 2023-12-12T09:43:48.045 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:48.042+0000 7f0da67e5640 1 --2- 172.21.15.73:0/2457063488 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0da0155b00 0x7f0da01ea810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:43:48.046 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:48.042+0000 7f0da5fe4640 1 --2- 172.21.15.73:0/2457063488 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0da006c880 0x7f0da0148660 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f0d90000f80 tx=0x7f0d90004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:43:48.046 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:48.042+0000 7f0d9e7fc640 1 -- 172.21.15.73:0/2457063488 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d90009510 con 0x7f0da006c880 2023-12-12T09:43:48.046 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:48.042+0000 7f0d9e7fc640 1 -- 172.21.15.73:0/2457063488 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d9003e450 con 0x7f0da006c880 2023-12-12T09:43:48.046 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:48.042+0000 7f0d9e7fc640 1 -- 172.21.15.73:0/2457063488 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d9003e7e0 con 0x7f0da006c880 2023-12-12T09:43:48.046 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:48.042+0000 7f0da8248640 1 -- 172.21.15.73:0/2457063488 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0da00ab0e0 con 0x7f0da006c880 2023-12-12T09:43:48.046 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:48.043+0000 7f0da8248640 1 -- 172.21.15.73:0/2457063488 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0da01ed4e0 con 0x7f0da006c880 2023-12-12T09:43:48.047 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:48.044+0000 7f0da8248640 1 -- 172.21.15.73:0/2457063488 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0da01ed670 con 0x7f0da006c880 2023-12-12T09:43:48.047 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:48.045+0000 7f0d9e7fc640 1 -- 172.21.15.73:0/2457063488 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f0d9003e940 con 0x7f0da006c880 2023-12-12T09:43:48.047 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:48.045+0000 7f0d9e7fc640 1 --2- 172.21.15.73:0/2457063488 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f0d8c06ae70 0x7f0d8c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:48.047 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:48.046+0000 7f0d9e7fc640 1 -- 172.21.15.73:0/2457063488 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0d900ac2d0 con 0x7f0da006c880 2023-12-12T09:43:48.047 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:48.046+0000 7f0da57e3640 1 --2- 172.21.15.73:0/2457063488 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f0d8c06ae70 0x7f0d8c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:48.047 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:48.046+0000 7f0da57e3640 1 --2- 172.21.15.73:0/2457063488 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f0d8c06ae70 0x7f0d8c06d330 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f0da0067ed0 tx=0x7f0d94008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:43:48.051 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:48.050+0000 7f0d9e7fc640 1 -- 172.21.15.73:0/2457063488 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f0d900772f0 con 0x7f0da006c880 2023-12-12T09:43:48.192 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T09:43:48.202 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T09:43:48.248 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:48.246+0000 7f0da8248640 1 -- 172.21.15.73:0/2457063488 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f0da0067580 con 0x7f0da006c880 2023-12-12T09:43:48.249 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:48.247+0000 7f0d9e7fc640 1 -- 172.21.15.73:0/2457063488 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7f0d9007a910 con 0x7f0da006c880 2023-12-12T09:43:48.249 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 1 2023-12-12T09:43:48.251 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:48.250+0000 7f0da8248640 1 -- 172.21.15.73:0/2457063488 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f0d8c06ae70 msgr2=0x7f0d8c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:48.252 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:48.250+0000 7f0da8248640 1 --2- 172.21.15.73:0/2457063488 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f0d8c06ae70 0x7f0d8c06d330 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f0da0067ed0 tx=0x7f0d94008040 comp rx=0 tx=0).stop 2023-12-12T09:43:48.252 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:48.250+0000 7f0da8248640 1 -- 172.21.15.73:0/2457063488 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0da006c880 msgr2=0x7f0da0148660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:48.252 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:48.250+0000 7f0da8248640 1 --2- 172.21.15.73:0/2457063488 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0da006c880 0x7f0da0148660 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f0d90000f80 tx=0x7f0d90004a40 comp rx=0 tx=0).stop 2023-12-12T09:43:48.252 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:48.250+0000 7f0da8248640 1 -- 172.21.15.73:0/2457063488 shutdown_connections 2023-12-12T09:43:48.252 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:48.250+0000 7f0da8248640 1 --2- 172.21.15.73:0/2457063488 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f0d8c06ae70 0x7f0d8c06d330 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:48.252 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:48.250+0000 7f0da8248640 1 --2- 172.21.15.73:0/2457063488 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0da0155b00 0x7f0da01ea810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:48.252 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:48.250+0000 7f0da8248640 1 --2- 172.21.15.73:0/2457063488 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0da00c84d0 0x7f0da01566d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:48.252 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:48.250+0000 7f0da8248640 1 --2- 172.21.15.73:0/2457063488 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0da006c880 0x7f0da0148660 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:48.252 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:48.250+0000 7f0da8248640 1 -- 172.21.15.73:0/2457063488 >> 172.21.15.73:0/2457063488 conn(0x7f0da00ab9e0 msgr2=0x7f0da00abdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:43:48.252 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:48.251+0000 7f0da8248640 1 -- 172.21.15.73:0/2457063488 shutdown_connections 2023-12-12T09:43:48.252 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:48.251+0000 7f0da8248640 1 -- 172.21.15.73:0/2457063488 wait complete. 2023-12-12T09:43:48.270 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-12T09:43:48.469 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:48.468+0000 7fdd676cf640 1 Processor -- start 2023-12-12T09:43:48.470 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:48.469+0000 7fdd676cf640 1 -- start start 2023-12-12T09:43:48.472 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:48.470+0000 7fdd676cf640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdd600c2790 0x7fdd601550c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:48.472 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:48.470+0000 7fdd676cf640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fdd600c5aa0 0x7fdd60151a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:48.472 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:48.470+0000 7fdd676cf640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fdd60151f40 0x7fdd600c4640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:48.472 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:48.470+0000 7fdd676cf640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd60158960 con 0x7fdd600c5aa0 2023-12-12T09:43:48.472 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:48.470+0000 7fdd676cf640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd60152370 con 0x7fdd60151f40 2023-12-12T09:43:48.472 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:48.470+0000 7fdd676cf640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd60155600 con 0x7fdd600c2790 2023-12-12T09:43:48.472 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:48.470+0000 7fdd64c6a640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fdd600c5aa0 0x7fdd60151a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:48.472 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:48.470+0000 7fdd64c6a640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fdd600c5aa0 0x7fdd60151a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:41316/0 (socket says 172.21.15.73:41316) 2023-12-12T09:43:48.472 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:48.470+0000 7fdd64c6a640 1 -- 172.21.15.73:0/2749643683 learned_addr learned my addr 172.21.15.73:0/2749643683 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:43:48.472 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:48.471+0000 7fdd6546b640 1 --2- 172.21.15.73:0/2749643683 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdd600c2790 0x7fdd601550c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:48.473 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:48.471+0000 7fdd65c6c640 1 --2- 172.21.15.73:0/2749643683 >> v2:172.21.15.142:3300/0 conn(0x7fdd60151f40 0x7fdd600c4640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:48.473 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:48.471+0000 7fdd64c6a640 1 -- 172.21.15.73:0/2749643683 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdd600c2790 msgr2=0x7fdd601550c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:43:48.473 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:48.471+0000 7fdd64c6a640 1 --2- 172.21.15.73:0/2749643683 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdd600c2790 0x7fdd601550c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:48.473 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:48.471+0000 7fdd64c6a640 1 -- 172.21.15.73:0/2749643683 >> v2:172.21.15.142:3300/0 conn(0x7fdd60151f40 msgr2=0x7fdd600c4640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:43:48.473 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:48.471+0000 7fdd64c6a640 1 --2- 172.21.15.73:0/2749643683 >> v2:172.21.15.142:3300/0 conn(0x7fdd60151f40 0x7fdd600c4640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:48.473 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:48.471+0000 7fdd64c6a640 1 -- 172.21.15.73:0/2749643683 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd60157ce0 con 0x7fdd600c5aa0 2023-12-12T09:43:48.473 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:48.472+0000 7fdd64c6a640 1 --2- 172.21.15.73:0/2749643683 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdd600c5aa0 0x7fdd60151a00 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fdd600aa740 tx=0x7fdd5002b7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88e6c261282e2b02 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:43:48.474 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:48.472+0000 7fdd57fff640 1 -- 172.21.15.73:0/2749643683 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd50031740 con 0x7fdd600c5aa0 2023-12-12T09:43:48.474 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:48.472+0000 7fdd57fff640 1 -- 172.21.15.73:0/2749643683 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd500318a0 con 0x7fdd600c5aa0 2023-12-12T09:43:48.474 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:48.472+0000 7fdd57fff640 1 -- 172.21.15.73:0/2749643683 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd50031c30 con 0x7fdd600c5aa0 2023-12-12T09:43:48.474 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:48.473+0000 7fdd676cf640 1 -- 172.21.15.73:0/2749643683 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdd600c5aa0 msgr2=0x7fdd60151a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:48.475 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:48.473+0000 7fdd676cf640 1 --2- 172.21.15.73:0/2749643683 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdd600c5aa0 0x7fdd60151a00 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fdd600aa740 tx=0x7fdd5002b7e0 comp rx=0 tx=0).stop 2023-12-12T09:43:48.475 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:48.473+0000 7fdd676cf640 1 -- 172.21.15.73:0/2749643683 shutdown_connections 2023-12-12T09:43:48.475 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:48.473+0000 7fdd676cf640 1 --2- 172.21.15.73:0/2749643683 >> v2:172.21.15.142:3300/0 conn(0x7fdd60151f40 0x7fdd600c4640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:48.475 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:48.473+0000 7fdd676cf640 1 --2- 172.21.15.73:0/2749643683 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdd600c5aa0 0x7fdd60151a00 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:48.475 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:48.473+0000 7fdd676cf640 1 --2- 172.21.15.73:0/2749643683 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdd600c2790 0x7fdd601550c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:48.475 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:48.473+0000 7fdd676cf640 1 -- 172.21.15.73:0/2749643683 >> 172.21.15.73:0/2749643683 conn(0x7fdd600a9890 msgr2=0x7fdd600a9ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:43:48.475 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:48.473+0000 7fdd676cf640 1 -- 172.21.15.73:0/2749643683 shutdown_connections 2023-12-12T09:43:48.475 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:48.473+0000 7fdd676cf640 1 -- 172.21.15.73:0/2749643683 wait complete. 2023-12-12T09:43:48.476 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:48.475+0000 7fdd676cf640 1 Processor -- start 2023-12-12T09:43:48.476 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:48.476+0000 7fdd676cf640 1 -- start start 2023-12-12T09:43:48.478 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:48.477+0000 7fdd676cf640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdd600c2790 0x7fdd601ecc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:48.479 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:48.477+0000 7fdd676cf640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdd600c5aa0 0x7fdd6006f3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:48.479 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:48.477+0000 7fdd676cf640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdd60151f40 0x7fdd6006e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:48.479 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:48.477+0000 7fdd676cf640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd60154610 con 0x7fdd60151f40 2023-12-12T09:43:48.479 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:48.477+0000 7fdd676cf640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd6006fed0 con 0x7fdd600c5aa0 2023-12-12T09:43:48.479 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:48.477+0000 7fdd676cf640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd601edba0 con 0x7fdd600c2790 2023-12-12T09:43:48.479 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:48.477+0000 7fdd65c6c640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdd60151f40 0x7fdd6006e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:48.479 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:48.477+0000 7fdd65c6c640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdd60151f40 0x7fdd6006e3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:41326/0 (socket says 172.21.15.73:41326) 2023-12-12T09:43:48.479 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:48.477+0000 7fdd65c6c640 1 -- 172.21.15.73:0/1509883443 learned_addr learned my addr 172.21.15.73:0/1509883443 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:43:48.479 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:48.477+0000 7fdd6546b640 1 --2- 172.21.15.73:0/1509883443 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdd600c2790 0x7fdd601ecc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:48.480 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:48.477+0000 7fdd64c6a640 1 --2- 172.21.15.73:0/1509883443 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdd600c5aa0 0x7fdd6006f3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:48.480 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:48.477+0000 7fdd65c6c640 1 -- 172.21.15.73:0/1509883443 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdd600c2790 msgr2=0x7fdd601ecc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:48.480 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:48.477+0000 7fdd65c6c640 1 --2- 172.21.15.73:0/1509883443 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdd600c2790 0x7fdd601ecc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:48.480 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:48.477+0000 7fdd65c6c640 1 -- 172.21.15.73:0/1509883443 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdd600c5aa0 msgr2=0x7fdd6006f3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:48.480 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:48.477+0000 7fdd65c6c640 1 --2- 172.21.15.73:0/1509883443 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdd600c5aa0 0x7fdd6006f3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:48.480 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:48.477+0000 7fdd65c6c640 1 -- 172.21.15.73:0/1509883443 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd500094d0 con 0x7fdd60151f40 2023-12-12T09:43:48.480 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:48.478+0000 7fdd64c6a640 1 --2- 172.21.15.73:0/1509883443 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdd600c5aa0 0x7fdd6006f3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:43:48.480 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:48.478+0000 7fdd6546b640 1 --2- 172.21.15.73:0/1509883443 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdd600c2790 0x7fdd601ecc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:43:48.480 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:48.478+0000 7fdd65c6c640 1 --2- 172.21.15.73:0/1509883443 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdd60151f40 0x7fdd6006e3f0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fdd58007e60 tx=0x7fdd5800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:43:48.481 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:48.478+0000 7fdd55ffb640 1 -- 172.21.15.73:0/1509883443 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd58014420 con 0x7fdd60151f40 2023-12-12T09:43:48.481 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:48.478+0000 7fdd55ffb640 1 -- 172.21.15.73:0/1509883443 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd580145a0 con 0x7fdd60151f40 2023-12-12T09:43:48.481 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:48.478+0000 7fdd55ffb640 1 -- 172.21.15.73:0/1509883443 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd58014950 con 0x7fdd60151f40 2023-12-12T09:43:48.481 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:48.478+0000 7fdd676cf640 1 -- 172.21.15.73:0/1509883443 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd601ed300 con 0x7fdd60151f40 2023-12-12T09:43:48.481 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:48.478+0000 7fdd676cf640 1 -- 172.21.15.73:0/1509883443 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd601ed8c0 con 0x7fdd60151f40 2023-12-12T09:43:48.481 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:48.479+0000 7fdd676cf640 1 -- 172.21.15.73:0/1509883443 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd60067580 con 0x7fdd60151f40 2023-12-12T09:43:48.481 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:48.480+0000 7fdd55ffb640 1 -- 172.21.15.73:0/1509883443 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fdd58014ab0 con 0x7fdd60151f40 2023-12-12T09:43:48.485 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:48.481+0000 7fdd55ffb640 1 --2- 172.21.15.73:0/1509883443 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fdd4406ae70 0x7fdd4406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:48.486 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:48.481+0000 7fdd55ffb640 1 -- 172.21.15.73:0/1509883443 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fdd58089e80 con 0x7fdd60151f40 2023-12-12T09:43:48.486 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:48.482+0000 7fdd6546b640 1 --2- 172.21.15.73:0/1509883443 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fdd4406ae70 0x7fdd4406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:48.486 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:48.482+0000 7fdd6546b640 1 --2- 172.21.15.73:0/1509883443 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fdd4406ae70 0x7fdd4406d330 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fdd5c006fd0 tx=0x7fdd5c008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:43:48.486 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:48.486+0000 7fdd55ffb640 1 -- 172.21.15.73:0/1509883443 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fdd58054fc0 con 0x7fdd60151f40 2023-12-12T09:43:48.679 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:48.678+0000 7fdd676cf640 1 -- 172.21.15.73:0/1509883443 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fdd600c3990 con 0x7fdd60151f40 2023-12-12T09:43:48.679 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:48.678+0000 7fdd55ffb640 1 -- 172.21.15.73:0/1509883443 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7fdd580585e0 con 0x7fdd60151f40 2023-12-12T09:43:48.679 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 32 2023-12-12T09:43:48.683 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:48.681+0000 7fdd676cf640 1 -- 172.21.15.73:0/1509883443 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fdd4406ae70 msgr2=0x7fdd4406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:48.683 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:48.681+0000 7fdd676cf640 1 --2- 172.21.15.73:0/1509883443 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fdd4406ae70 0x7fdd4406d330 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fdd5c006fd0 tx=0x7fdd5c008040 comp rx=0 tx=0).stop 2023-12-12T09:43:48.683 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:48.681+0000 7fdd676cf640 1 -- 172.21.15.73:0/1509883443 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdd60151f40 msgr2=0x7fdd6006e3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:48.683 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:48.681+0000 7fdd676cf640 1 --2- 172.21.15.73:0/1509883443 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdd60151f40 0x7fdd6006e3f0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fdd58007e60 tx=0x7fdd5800e4b0 comp rx=0 tx=0).stop 2023-12-12T09:43:48.683 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:48.681+0000 7fdd676cf640 1 -- 172.21.15.73:0/1509883443 shutdown_connections 2023-12-12T09:43:48.684 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:48.681+0000 7fdd676cf640 1 --2- 172.21.15.73:0/1509883443 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fdd4406ae70 0x7fdd4406d330 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:48.684 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:48.681+0000 7fdd676cf640 1 --2- 172.21.15.73:0/1509883443 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdd60151f40 0x7fdd6006e3f0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:48.684 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:48.681+0000 7fdd676cf640 1 --2- 172.21.15.73:0/1509883443 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdd600c5aa0 0x7fdd6006f3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:48.684 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:48.681+0000 7fdd676cf640 1 --2- 172.21.15.73:0/1509883443 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdd600c2790 0x7fdd601ecc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:48.684 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:48.681+0000 7fdd676cf640 1 -- 172.21.15.73:0/1509883443 >> 172.21.15.73:0/1509883443 conn(0x7fdd600a9890 msgr2=0x7fdd600a9c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:43:48.684 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:48.681+0000 7fdd676cf640 1 -- 172.21.15.73:0/1509883443 shutdown_connections 2023-12-12T09:43:48.684 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:48.682+0000 7fdd676cf640 1 -- 172.21.15.73:0/1509883443 wait complete. 2023-12-12T09:43:48.700 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-12T09:43:48.887 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:48.886+0000 7f3953fff640 1 Processor -- start 2023-12-12T09:43:48.887 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:48.886+0000 7f3953fff640 1 -- start start 2023-12-12T09:43:48.888 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:48.887+0000 7f3953fff640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f39540c6590 0x7f39540c6970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:48.889 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:48.887+0000 7f3953fff640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f39540c81e0 0x7f395406c0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:48.889 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:48.887+0000 7f3953fff640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f395406c630 con 0x7f3954154b40 2023-12-12T09:43:48.889 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:48.887+0000 7f3953fff640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3954154430 con 0x7f39540c81e0 2023-12-12T09:43:48.889 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:48.887+0000 7f3953fff640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39540c4540 con 0x7f39540c6590 2023-12-12T09:43:48.890 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:48.888+0000 7f394bfff640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f39540c81e0 0x7f395406c0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:48.890 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:48.888+0000 7f3952ffd640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f39540c6590 0x7f39540c6970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:48.890 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:48.888+0000 7f394bfff640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f39540c81e0 0x7f395406c0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.73:49910/0 (socket says 172.21.15.73:49910) 2023-12-12T09:43:48.890 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:48.888+0000 7f394bfff640 1 -- 172.21.15.73:0/1406982455 learned_addr learned my addr 172.21.15.73:0/1406982455 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:43:48.891 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:48.889+0000 7f3952ffd640 1 -- 172.21.15.73:0/1406982455 >> v2:172.21.15.142:3300/0 conn(0x7f39540c81e0 msgr2=0x7f395406c0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:43:48.891 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:48.889+0000 7f3952ffd640 1 --2- 172.21.15.73:0/1406982455 >> v2:172.21.15.142:3300/0 conn(0x7f39540c81e0 0x7f395406c0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:48.891 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:48.889+0000 7f3952ffd640 1 -- 172.21.15.73:0/1406982455 >> v1:172.21.15.142:6789/0 conn(0x7f3954154b40 legacy=0x7f39541579c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:48.891 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:48.889+0000 7f3952ffd640 1 -- 172.21.15.73:0/1406982455 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39540c5030 con 0x7f39540c6590 2023-12-12T09:43:48.893 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:48.890+0000 7f3952ffd640 1 --2- 172.21.15.73:0/1406982455 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f39540c6590 0x7f39540c6970 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f39440097a0 tx=0x7f394402b8b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6c0519f955c5e5ab server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:43:48.893 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:48.890+0000 7f39527fc640 1 -- 172.21.15.73:0/1406982455 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f394402d040 con 0x7f39540c6590 2023-12-12T09:43:48.893 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:48.891+0000 7f39527fc640 1 -- 172.21.15.73:0/1406982455 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3944031810 con 0x7f39540c6590 2023-12-12T09:43:48.893 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:48.891+0000 7f39527fc640 1 -- 172.21.15.73:0/1406982455 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3944031ba0 con 0x7f39540c6590 2023-12-12T09:43:48.893 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:48.891+0000 7f3953fff640 1 -- 172.21.15.73:0/1406982455 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f39540c6590 msgr2=0x7f39540c6970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:48.893 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:48.891+0000 7f3953fff640 1 --2- 172.21.15.73:0/1406982455 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f39540c6590 0x7f39540c6970 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f39440097a0 tx=0x7f394402b8b0 comp rx=0 tx=0).stop 2023-12-12T09:43:48.893 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:48.891+0000 7f3953fff640 1 -- 172.21.15.73:0/1406982455 shutdown_connections 2023-12-12T09:43:48.894 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:48.891+0000 7f3953fff640 1 --2- 172.21.15.73:0/1406982455 >> v2:172.21.15.142:3300/0 conn(0x7f39540c81e0 0x7f395406c0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:48.894 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:48.891+0000 7f3953fff640 1 --2- 172.21.15.73:0/1406982455 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f39540c6590 0x7f39540c6970 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:48.894 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:48.891+0000 7f3953fff640 1 -- 172.21.15.73:0/1406982455 >> 172.21.15.73:0/1406982455 conn(0x7f39540ab770 msgr2=0x7f39540abb80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:43:48.894 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:48.891+0000 7f3953fff640 1 -- 172.21.15.73:0/1406982455 shutdown_connections 2023-12-12T09:43:48.894 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:48.891+0000 7f3953fff640 1 -- 172.21.15.73:0/1406982455 wait complete. 2023-12-12T09:43:48.895 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:48.893+0000 7f3953fff640 1 Processor -- start 2023-12-12T09:43:48.895 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:48.893+0000 7f3953fff640 1 -- start start 2023-12-12T09:43:48.895 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:48.894+0000 7f3953fff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f39540c6590 0x7f39540aef70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:48.896 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:48.894+0000 7f3953fff640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f39540c81e0 0x7f39541575a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:48.896 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:48.894+0000 7f3953fff640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3954154b40 0x7f39540ad0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:48.896 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:48.894+0000 7f3953fff640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39541eb330 con 0x7f39540c6590 2023-12-12T09:43:48.896 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:48.894+0000 7f3953fff640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39541eae00 con 0x7f3954154b40 2023-12-12T09:43:48.896 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:48.894+0000 7f3953fff640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39541e8010 con 0x7f39540c81e0 2023-12-12T09:43:48.898 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:48.895+0000 7f3952ffd640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f39540c6590 0x7f39540aef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:48.898 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:48.895+0000 7f394bfff640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f39540c81e0 0x7f39541575a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:48.898 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:48.895+0000 7f39537fe640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3954154b40 0x7f39540ad0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:48.898 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:48.895+0000 7f3952ffd640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f39540c6590 0x7f39540aef70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:45284/0 (socket says 172.21.15.73:45284) 2023-12-12T09:43:48.899 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:48.895+0000 7f3952ffd640 1 -- 172.21.15.73:0/1405655460 learned_addr learned my addr 172.21.15.73:0/1405655460 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:43:48.899 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:48.895+0000 7f3952ffd640 1 -- 172.21.15.73:0/1405655460 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f39540c81e0 msgr2=0x7f39541575a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:48.899 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:48.895+0000 7f3952ffd640 1 --2- 172.21.15.73:0/1405655460 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f39540c81e0 0x7f39541575a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:48.899 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:48.895+0000 7f3952ffd640 1 -- 172.21.15.73:0/1405655460 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3954154b40 msgr2=0x7f39540ad0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:48.899 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:48.895+0000 7f3952ffd640 1 --2- 172.21.15.73:0/1405655460 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3954154b40 0x7f39540ad0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:48.899 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:48.895+0000 7f3952ffd640 1 -- 172.21.15.73:0/1405655460 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3944009400 con 0x7f39540c6590 2023-12-12T09:43:48.899 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:48.896+0000 7f3952ffd640 1 --2- 172.21.15.73:0/1405655460 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f39540c6590 0x7f39540aef70 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f39440098c0 tx=0x7f39440046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:43:48.900 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:48.896+0000 7f394b7fe640 1 -- 172.21.15.73:0/1405655460 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3944006e10 con 0x7f39540c6590 2023-12-12T09:43:48.900 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:48.896+0000 7f394b7fe640 1 -- 172.21.15.73:0/1405655460 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f394403ad60 con 0x7f39540c6590 2023-12-12T09:43:48.900 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:48.896+0000 7f394b7fe640 1 -- 172.21.15.73:0/1405655460 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3944044610 con 0x7f39540c6590 2023-12-12T09:43:48.900 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:48.896+0000 7f3953fff640 1 -- 172.21.15.73:0/1405655460 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39541eb050 con 0x7f39540c6590 2023-12-12T09:43:48.900 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:48.896+0000 7f3953fff640 1 -- 172.21.15.73:0/1405655460 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39540acbb0 con 0x7f39540c6590 2023-12-12T09:43:48.900 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:48.897+0000 7f3953fff640 1 -- 172.21.15.73:0/1405655460 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f39540c5760 con 0x7f39540c6590 2023-12-12T09:43:48.902 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:48.898+0000 7f394b7fe640 1 -- 172.21.15.73:0/1405655460 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f3944044770 con 0x7f39540c6590 2023-12-12T09:43:48.902 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:48.899+0000 7f394b7fe640 1 --2- 172.21.15.73:0/1405655460 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f393406ae70 0x7f393406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:48.902 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:48.899+0000 7f394b7fe640 1 -- 172.21.15.73:0/1405655460 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f39440ab8e0 con 0x7f39540c6590 2023-12-12T09:43:48.902 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:48.899+0000 7f394bfff640 1 --2- 172.21.15.73:0/1405655460 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f393406ae70 0x7f393406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:48.902 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:48.900+0000 7f394bfff640 1 --2- 172.21.15.73:0/1405655460 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f393406ae70 0x7f393406d330 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f39540c11e0 tx=0x7f393c009210 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:43:48.904 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:48.903+0000 7f394b7fe640 1 -- 172.21.15.73:0/1405655460 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f3944076b50 con 0x7f39540c6590 2023-12-12T09:43:49.091 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:49.090+0000 7f3953fff640 1 -- 172.21.15.73:0/1405655460 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f3954153870 con 0x7f39540c6590 2023-12-12T09:43:49.092 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:49.091+0000 7f394b7fe640 1 -- 172.21.15.73:0/1405655460 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7f394407a170 con 0x7f39540c6590 2023-12-12T09:43:49.092 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 64 2023-12-12T09:43:49.094 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:49.093+0000 7f3953fff640 1 -- 172.21.15.73:0/1405655460 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f393406ae70 msgr2=0x7f393406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:49.094 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:49.093+0000 7f3953fff640 1 --2- 172.21.15.73:0/1405655460 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f393406ae70 0x7f393406d330 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f39540c11e0 tx=0x7f393c009210 comp rx=0 tx=0).stop 2023-12-12T09:43:49.094 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:49.093+0000 7f3953fff640 1 -- 172.21.15.73:0/1405655460 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f39540c6590 msgr2=0x7f39540aef70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:49.095 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:49.093+0000 7f3953fff640 1 --2- 172.21.15.73:0/1405655460 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f39540c6590 0x7f39540aef70 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f39440098c0 tx=0x7f39440046c0 comp rx=0 tx=0).stop 2023-12-12T09:43:49.095 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:49.093+0000 7f3953fff640 1 -- 172.21.15.73:0/1405655460 shutdown_connections 2023-12-12T09:43:49.095 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:49.093+0000 7f3953fff640 1 --2- 172.21.15.73:0/1405655460 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f393406ae70 0x7f393406d330 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:49.095 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:49.093+0000 7f3953fff640 1 --2- 172.21.15.73:0/1405655460 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3954154b40 0x7f39540ad0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:49.095 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:49.093+0000 7f3953fff640 1 --2- 172.21.15.73:0/1405655460 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f39540c81e0 0x7f39541575a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:49.095 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:49.093+0000 7f3953fff640 1 --2- 172.21.15.73:0/1405655460 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f39540c6590 0x7f39540aef70 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:49.095 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:49.093+0000 7f3953fff640 1 -- 172.21.15.73:0/1405655460 >> 172.21.15.73:0/1405655460 conn(0x7f39540ab770 msgr2=0x7f39540aad60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:43:49.095 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:49.093+0000 7f3953fff640 1 -- 172.21.15.73:0/1405655460 shutdown_connections 2023-12-12T09:43:49.095 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:49.093+0000 7f3953fff640 1 -- 172.21.15.73:0/1405655460 wait complete. 2023-12-12T09:43:49.112 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-12T09:43:49.296 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:49.295+0000 7f72feddc640 1 Processor -- start 2023-12-12T09:43:49.296 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:49.295+0000 7f72feddc640 1 -- start start 2023-12-12T09:43:49.298 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:49.296+0000 7f72feddc640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f72f8151b90 0x7f72f80c7c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:49.298 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:49.296+0000 7f72feddc640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f72f806b580 0x7f72f8158390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:49.298 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:49.296+0000 7f72feddc640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72f8157f00 con 0x7f72f81588d0 2023-12-12T09:43:49.298 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:49.296+0000 7f72feddc640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72f80c61f0 con 0x7f72f806b580 2023-12-12T09:43:49.298 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:49.296+0000 7f72feddc640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72f80c64d0 con 0x7f72f8151b90 2023-12-12T09:43:49.298 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:49.297+0000 7f72f7fff640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f72f806b580 0x7f72f8158390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:49.298 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:49.297+0000 7f72fd379640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f72f81588d0 0x7f72f80c4710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:50046/0 (socket says 172.21.15.73:50046) 2023-12-12T09:43:49.298 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:49.297+0000 7f72fd379640 1 -- 172.21.15.73:0/2020039301 learned_addr learned my addr 172.21.15.73:0/2020039301 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-12T09:43:49.298 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:49.297+0000 7f72fcb78640 1 --2- 172.21.15.73:0/2020039301 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f72f8151b90 0x7f72f80c7c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:49.299 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:49.297+0000 7f72f7fff640 1 -- 172.21.15.73:0/2020039301 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f72f8151b90 msgr2=0x7f72f80c7c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:43:49.299 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:49.297+0000 7f72f7fff640 1 --2- 172.21.15.73:0/2020039301 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f72f8151b90 0x7f72f80c7c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:49.299 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:49.297+0000 7f72f7fff640 1 -- 172.21.15.73:0/2020039301 >> v1:172.21.15.73:6789/0 conn(0x7f72f81588d0 legacy=0x7f72f80c4710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:49.299 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:49.297+0000 7f72f7fff640 1 -- 172.21.15.73:0/2020039301 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72f8157b90 con 0x7f72f806b580 2023-12-12T09:43:49.299 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:49.297+0000 7f72f77fe640 1 -- 172.21.15.73:0/2020039301 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 604592631 0 0) 0x7f72f8157f00 con 0x7f72f81588d0 2023-12-12T09:43:49.300 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:49.298+0000 7f72f7fff640 1 --2- 172.21.15.73:0/2020039301 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f72f806b580 0x7f72f8158390 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f72e40097a0 tx=0x7f72e402b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69d11ef5194c069b server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:43:49.300 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:49.299+0000 7f72f77fe640 1 -- 172.21.15.73:0/2020039301 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72e402e070 con 0x7f72f806b580 2023-12-12T09:43:49.300 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:49.299+0000 7f72f77fe640 1 -- 172.21.15.73:0/2020039301 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72e40315a0 con 0x7f72f806b580 2023-12-12T09:43:49.300 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:49.299+0000 7f72f77fe640 1 -- 172.21.15.73:0/2020039301 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72e4031930 con 0x7f72f806b580 2023-12-12T09:43:49.301 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:49.299+0000 7f72feddc640 1 -- 172.21.15.73:0/2020039301 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f72f806b580 msgr2=0x7f72f8158390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:49.301 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:49.299+0000 7f72feddc640 1 --2- 172.21.15.73:0/2020039301 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f72f806b580 0x7f72f8158390 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f72e40097a0 tx=0x7f72e402b840 comp rx=0 tx=0).stop 2023-12-12T09:43:49.301 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:49.300+0000 7f72feddc640 1 -- 172.21.15.73:0/2020039301 shutdown_connections 2023-12-12T09:43:49.301 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:49.300+0000 7f72feddc640 1 --2- 172.21.15.73:0/2020039301 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f72f806b580 0x7f72f8158390 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:49.301 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:49.300+0000 7f72feddc640 1 --2- 172.21.15.73:0/2020039301 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f72f8151b90 0x7f72f80c7c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:49.301 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:49.300+0000 7f72feddc640 1 -- 172.21.15.73:0/2020039301 >> 172.21.15.73:0/2020039301 conn(0x7f72f80ab880 msgr2=0x7f72f80abc90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:43:49.301 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:49.300+0000 7f72feddc640 1 -- 172.21.15.73:0/2020039301 shutdown_connections 2023-12-12T09:43:49.301 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:49.300+0000 7f72feddc640 1 -- 172.21.15.73:0/2020039301 wait complete. 2023-12-12T09:43:49.303 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:49.302+0000 7f72feddc640 1 Processor -- start 2023-12-12T09:43:49.303 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:49.302+0000 7f72feddc640 1 -- start start 2023-12-12T09:43:49.305 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:49.304+0000 7f72feddc640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f72f806b580 0x7f72f814e430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:49.305 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:49.304+0000 7f72feddc640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f72f8151b90 0x7f72f8153170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:49.305 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:49.304+0000 7f72feddc640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f72f81588d0 0x7f72f81536b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:49.305 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:49.304+0000 7f72feddc640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72f8152ce0 con 0x7f72f81588d0 2023-12-12T09:43:49.305 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:49.304+0000 7f72feddc640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72f8155040 con 0x7f72f806b580 2023-12-12T09:43:49.305 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:49.304+0000 7f72feddc640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72f8155320 con 0x7f72f8151b90 2023-12-12T09:43:49.305 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:49.304+0000 7f72fd379640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f72f81588d0 0x7f72f81536b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:49.305 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:49.304+0000 7f72fd379640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f72f81588d0 0x7f72f81536b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:45298/0 (socket says 172.21.15.73:45298) 2023-12-12T09:43:49.305 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:49.304+0000 7f72fd379640 1 -- 172.21.15.73:0/644803864 learned_addr learned my addr 172.21.15.73:0/644803864 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:43:49.306 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:49.304+0000 7f72fd379640 1 -- 172.21.15.73:0/644803864 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f72f8151b90 msgr2=0x7f72f8153170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:49.306 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:49.304+0000 7f72fd379640 1 --2- 172.21.15.73:0/644803864 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f72f8151b90 0x7f72f8153170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:49.307 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:49.304+0000 7f72fd379640 1 -- 172.21.15.73:0/644803864 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f72f806b580 msgr2=0x7f72f814e430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:49.307 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:49.304+0000 7f72fd379640 1 --2- 172.21.15.73:0/644803864 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f72f806b580 0x7f72f814e430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:49.307 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:49.304+0000 7f72fd379640 1 -- 172.21.15.73:0/644803864 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72e4009400 con 0x7f72f81588d0 2023-12-12T09:43:49.307 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:49.305+0000 7f72fd379640 1 --2- 172.21.15.73:0/644803864 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f72f81588d0 0x7f72f81536b0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f72f000c780 tx=0x7f72f000cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:43:49.307 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:49.305+0000 7f72f57fa640 1 -- 172.21.15.73:0/644803864 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72f000ce90 con 0x7f72f81588d0 2023-12-12T09:43:49.307 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:49.305+0000 7f72f57fa640 1 -- 172.21.15.73:0/644803864 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72f000a640 con 0x7f72f81588d0 2023-12-12T09:43:49.307 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:49.305+0000 7f72f57fa640 1 -- 172.21.15.73:0/644803864 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72f000a9d0 con 0x7f72f81588d0 2023-12-12T09:43:49.307 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:49.305+0000 7f72feddc640 1 -- 172.21.15.73:0/644803864 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72f814d610 con 0x7f72f81588d0 2023-12-12T09:43:49.307 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:49.305+0000 7f72feddc640 1 -- 172.21.15.73:0/644803864 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72f814dbd0 con 0x7f72f81588d0 2023-12-12T09:43:49.307 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:49.306+0000 7f72feddc640 1 -- 172.21.15.73:0/644803864 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f72f8066f50 con 0x7f72f81588d0 2023-12-12T09:43:49.308 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:49.307+0000 7f72f57fa640 1 -- 172.21.15.73:0/644803864 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f72f000ab30 con 0x7f72f81588d0 2023-12-12T09:43:49.310 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:49.309+0000 7f72f57fa640 1 --2- 172.21.15.73:0/644803864 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f72dc06ae40 0x7f72dc06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:49.310 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:49.309+0000 7f72f57fa640 1 -- 172.21.15.73:0/644803864 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f72f0088b80 con 0x7f72f81588d0 2023-12-12T09:43:49.310 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:49.309+0000 7f72fcb78640 1 --2- 172.21.15.73:0/644803864 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f72dc06ae40 0x7f72dc06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:49.310 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:49.309+0000 7f72fcb78640 1 --2- 172.21.15.73:0/644803864 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f72dc06ae40 0x7f72dc06d300 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f72ec0098f0 tx=0x7f72ec008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:43:49.314 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:49.313+0000 7f72f57fa640 1 -- 172.21.15.73:0/644803864 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f72f0053c20 con 0x7f72f81588d0 2023-12-12T09:43:49.503 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:49.502+0000 7f72feddc640 1 -- 172.21.15.73:0/644803864 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f72f8067580 con 0x7f72f81588d0 2023-12-12T09:43:49.504 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:49.504+0000 7f72f57fa640 1 -- 172.21.15.73:0/644803864 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16517 (secure 0 0 0) 0x7f72f0018070 con 0x7f72f81588d0 2023-12-12T09:43:49.505 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-12T09:43:49.505 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":21,"fsid":"ba240992-02b8-4c7e-92f2-27eb29ac433b","created":"2023-12-12T09:43:02.454719+0000","modified":"2023-12-12T09:43:23.219345+0000","last_up_change":"2023-12-12T09:43:13.913440+0000","last_in_change":"2023-12-12T09:43:05.925348+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-12T09:43:15.525508+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-12T09:43:20.004546+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-12T09:43:20.736500+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"dd9074be-dbe2-4c34-9896-a4223d8d3940","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":4047810203},{"type":"v1","addr":"172.21.15.73:6801","nonce":4047810203}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":4047810203},{"type":"v1","addr":"172.21.15.73:6803","nonce":4047810203}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":4047810203},{"type":"v1","addr":"172.21.15.73:6807","nonce":4047810203}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":4047810203},{"type":"v1","addr":"172.21.15.73:6805","nonce":4047810203}]},"public_addr":"172.21.15.73:6801/4047810203","cluster_addr":"172.21.15.73:6803/4047810203","heartbeat_back_addr":"172.21.15.73:6807/4047810203","heartbeat_front_addr":"172.21.15.73:6805/4047810203","state":["exists","up"]},{"osd":1,"uuid":"c4a05052-96d4-4758-a4e1-1a37f1e07fed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":1356058331},{"type":"v1","addr":"172.21.15.73:6824","nonce":1356058331}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":1356058331},{"type":"v1","addr":"172.21.15.73:6827","nonce":1356058331}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":1356058331},{"type":"v1","addr":"172.21.15.73:6831","nonce":1356058331}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":1356058331},{"type":"v1","addr":"172.21.15.73:6829","nonce":1356058331}]},"public_addr":"172.21.15.73:6824/1356058331","cluster_addr":"172.21.15.73:6827/1356058331","heartbeat_back_addr":"172.21.15.73:6831/1356058331","heartbeat_front_addr":"172.21.15.73:6829/1356058331","state":["exists","up"]},{"osd":2,"uuid":"512bc8ac-72c2-40d4-b3d2-d867a92c5213","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":1228903316},{"type":"v1","addr":"172.21.15.73:6817","nonce":1228903316}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":1228903316},{"type":"v1","addr":"172.21.15.73:6819","nonce":1228903316}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6823","nonce":1228903316},{"type":"v1","addr":"172.21.15.73:6825","nonce":1228903316}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":1228903316},{"type":"v1","addr":"172.21.15.73:6821","nonce":1228903316}]},"public_addr":"172.21.15.73:6817/1228903316","cluster_addr":"172.21.15.73:6819/1228903316","heartbeat_back_addr":"172.21.15.73:6825/1228903316","heartbeat_front_addr":"172.21.15.73:6821/1228903316","state":["exists","up"]},{"osd":3,"uuid":"3d1a91e0-42bf-437a-8eae-8d357c8f63a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":1293329670},{"type":"v1","addr":"172.21.15.73:6809","nonce":1293329670}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6810","nonce":1293329670},{"type":"v1","addr":"172.21.15.73:6811","nonce":1293329670}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":1293329670},{"type":"v1","addr":"172.21.15.73:6815","nonce":1293329670}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":1293329670},{"type":"v1","addr":"172.21.15.73:6813","nonce":1293329670}]},"public_addr":"172.21.15.73:6809/1293329670","cluster_addr":"172.21.15.73:6811/1293329670","heartbeat_back_addr":"172.21.15.73:6815/1293329670","heartbeat_front_addr":"172.21.15.73:6813/1293329670","state":["exists","up"]},{"osd":4,"uuid":"4b302fff-834c-4069-ac19-00e46f6c87b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":3727975702},{"type":"v1","addr":"172.21.15.142:6801","nonce":3727975702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":3727975702},{"type":"v1","addr":"172.21.15.142:6803","nonce":3727975702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6809","nonce":3727975702},{"type":"v1","addr":"172.21.15.142:6811","nonce":3727975702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6805","nonce":3727975702},{"type":"v1","addr":"172.21.15.142:6807","nonce":3727975702}]},"public_addr":"172.21.15.142:6801/3727975702","cluster_addr":"172.21.15.142:6803/3727975702","heartbeat_back_addr":"172.21.15.142:6811/3727975702","heartbeat_front_addr":"172.21.15.142:6807/3727975702","state":["exists","up"]},{"osd":5,"uuid":"d7cdace2-67d0-45cc-95f2-515cf6ef1b82","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6817","nonce":2353193632},{"type":"v1","addr":"172.21.15.142:6819","nonce":2353193632}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6821","nonce":2353193632},{"type":"v1","addr":"172.21.15.142:6823","nonce":2353193632}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6829","nonce":2353193632},{"type":"v1","addr":"172.21.15.142:6831","nonce":2353193632}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6825","nonce":2353193632},{"type":"v1","addr":"172.21.15.142:6827","nonce":2353193632}]},"public_addr":"172.21.15.142:6819/2353193632","cluster_addr":"172.21.15.142:6823/2353193632","heartbeat_back_addr":"172.21.15.142:6831/2353193632","heartbeat_front_addr":"172.21.15.142:6827/2353193632","state":["exists","up"]},{"osd":6,"uuid":"649ce78a-5626-445c-aedc-a651ed05a6f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":2006111986},{"type":"v1","addr":"172.21.15.142:6806","nonce":2006111986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":2006111986},{"type":"v1","addr":"172.21.15.142:6810","nonce":2006111986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":2006111986},{"type":"v1","addr":"172.21.15.142:6815","nonce":2006111986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":2006111986},{"type":"v1","addr":"172.21.15.142:6813","nonce":2006111986}]},"public_addr":"172.21.15.142:6806/2006111986","cluster_addr":"172.21.15.142:6810/2006111986","heartbeat_back_addr":"172.21.15.142:6815/2006111986","heartbeat_front_addr":"172.21.15.142:6813/2006111986","state":["exists","up"]},{"osd":7,"uuid":"af15ae3b-c1d0-4acf-92db-8a1805494d13","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":2573794341},{"type":"v1","addr":"172.21.15.142:6818","nonce":2573794341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":2573794341},{"type":"v1","addr":"172.21.15.142:6822","nonce":2573794341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":2573794341},{"type":"v1","addr":"172.21.15.142:6830","nonce":2573794341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":2573794341},{"type":"v1","addr":"172.21.15.142:6826","nonce":2573794341}]},"public_addr":"172.21.15.142:6818/2573794341","cluster_addr":"172.21.15.142:6822/2573794341","heartbeat_back_addr":"172.21.15.142:6830/2573794341","heartbeat_front_addr":"172.21.15.142:6826/2573794341","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.185824+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.262103+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.225556+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:10.523459+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:10.706035+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.257339+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.301776+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.051960+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-12T09:43:49.507 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:49.506+0000 7f72feddc640 1 -- 172.21.15.73:0/644803864 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f72dc06ae40 msgr2=0x7f72dc06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:49.507 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:49.506+0000 7f72feddc640 1 --2- 172.21.15.73:0/644803864 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f72dc06ae40 0x7f72dc06d300 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f72ec0098f0 tx=0x7f72ec008040 comp rx=0 tx=0).stop 2023-12-12T09:43:49.507 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:49.506+0000 7f72feddc640 1 -- 172.21.15.73:0/644803864 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f72f81588d0 msgr2=0x7f72f81536b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:49.508 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:49.506+0000 7f72feddc640 1 --2- 172.21.15.73:0/644803864 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f72f81588d0 0x7f72f81536b0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f72f000c780 tx=0x7f72f000cc40 comp rx=0 tx=0).stop 2023-12-12T09:43:49.508 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:49.506+0000 7f72feddc640 1 -- 172.21.15.73:0/644803864 shutdown_connections 2023-12-12T09:43:49.508 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:49.506+0000 7f72feddc640 1 --2- 172.21.15.73:0/644803864 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f72dc06ae40 0x7f72dc06d300 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:49.508 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:49.506+0000 7f72feddc640 1 --2- 172.21.15.73:0/644803864 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f72f81588d0 0x7f72f81536b0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:49.508 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:49.506+0000 7f72feddc640 1 --2- 172.21.15.73:0/644803864 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f72f8151b90 0x7f72f8153170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:49.508 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:49.506+0000 7f72feddc640 1 --2- 172.21.15.73:0/644803864 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f72f806b580 0x7f72f814e430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:49.508 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:49.506+0000 7f72feddc640 1 -- 172.21.15.73:0/644803864 >> 172.21.15.73:0/644803864 conn(0x7f72f80ab880 msgr2=0x7f72f80a97f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:43:49.508 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:49.507+0000 7f72feddc640 1 -- 172.21.15.73:0/644803864 shutdown_connections 2023-12-12T09:43:49.508 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:49.507+0000 7f72feddc640 1 -- 172.21.15.73:0/644803864 wait complete. 2023-12-12T09:43:49.524 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-12T09:43:15.525508+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-12T09:43:20.004546+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-12T09:43:20.736500+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-12T09:43:49.525 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-12T09:43:49.725 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:49.724+0000 7f1630461640 1 Processor -- start 2023-12-12T09:43:49.726 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:49.725+0000 7f1630461640 1 -- start start 2023-12-12T09:43:49.728 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:49.726+0000 7f1630461640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f16280c7ed0 0x7f16280c6ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:49.728 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:49.726+0000 7f1630461640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f16281550a0 0x7f162815efa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:49.728 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:49.726+0000 7f1630461640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f162806c890 con 0x7f16280c67c0 2023-12-12T09:43:49.728 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:49.726+0000 7f1630461640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16280c8360 con 0x7f16280c7ed0 2023-12-12T09:43:49.728 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:49.726+0000 7f1630461640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16280c4af0 con 0x7f16281550a0 2023-12-12T09:43:49.728 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:49.726+0000 7f162d9fc640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f16280c7ed0 0x7f16280c6ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:49.728 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:49.726+0000 7f162d9fc640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f16280c7ed0 0x7f16280c6ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:45312/0 (socket says 172.21.15.73:45312) 2023-12-12T09:43:49.728 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:49.726+0000 7f162d9fc640 1 -- 172.21.15.73:0/3880487817 learned_addr learned my addr 172.21.15.73:0/3880487817 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:43:49.728 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:49.727+0000 7f162e9fe640 1 --2- 172.21.15.73:0/3880487817 >> v2:172.21.15.142:3300/0 conn(0x7f16281550a0 0x7f162815efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:49.728 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:49.727+0000 7f162d9fc640 1 -- 172.21.15.73:0/3880487817 >> v2:172.21.15.142:3300/0 conn(0x7f16281550a0 msgr2=0x7f162815efa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:43:49.728 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:49.727+0000 7f162d9fc640 1 --2- 172.21.15.73:0/3880487817 >> v2:172.21.15.142:3300/0 conn(0x7f16281550a0 0x7f162815efa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:49.728 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:49.727+0000 7f162d9fc640 1 -- 172.21.15.73:0/3880487817 >> v1:172.21.15.142:6789/0 conn(0x7f16280c67c0 legacy=0x7f162806c180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:43:49.729 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:49.727+0000 7f162d9fc640 1 -- 172.21.15.73:0/3880487817 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16280c4dd0 con 0x7f16280c7ed0 2023-12-12T09:43:49.729 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:49.727+0000 7f162e9fe640 1 --2- 172.21.15.73:0/3880487817 >> v2:172.21.15.142:3300/0 conn(0x7f16281550a0 0x7f162815efa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:43:49.730 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:49.728+0000 7f162d9fc640 1 --2- 172.21.15.73:0/3880487817 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f16280c7ed0 0x7f16280c6ba0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f16280bd450 tx=0x7f161802b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93f933ff4ba729af server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:43:49.730 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:49.728+0000 7f162d1fb640 1 -- 172.21.15.73:0/3880487817 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1618031870 con 0x7f16280c7ed0 2023-12-12T09:43:49.730 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:49.728+0000 7f162d1fb640 1 -- 172.21.15.73:0/3880487817 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16180319d0 con 0x7f16280c7ed0 2023-12-12T09:43:49.730 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:49.728+0000 7f162d1fb640 1 -- 172.21.15.73:0/3880487817 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1618031d60 con 0x7f16280c7ed0 2023-12-12T09:43:49.730 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:49.729+0000 7f1630461640 1 -- 172.21.15.73:0/3880487817 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f16280c7ed0 msgr2=0x7f16280c6ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:49.730 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:49.729+0000 7f1630461640 1 --2- 172.21.15.73:0/3880487817 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f16280c7ed0 0x7f16280c6ba0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f16280bd450 tx=0x7f161802b910 comp rx=0 tx=0).stop 2023-12-12T09:43:49.730 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:49.729+0000 7f1630461640 1 -- 172.21.15.73:0/3880487817 shutdown_connections 2023-12-12T09:43:49.730 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:49.729+0000 7f1630461640 1 --2- 172.21.15.73:0/3880487817 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f16280c7ed0 0x7f16280c6ba0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:49.730 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:49.729+0000 7f1630461640 1 --2- 172.21.15.73:0/3880487817 >> v2:172.21.15.142:3300/0 conn(0x7f16281550a0 0x7f162815efa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:49.730 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:49.729+0000 7f1630461640 1 -- 172.21.15.73:0/3880487817 >> 172.21.15.73:0/3880487817 conn(0x7f16280abb20 msgr2=0x7f16280abf30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:43:49.730 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:49.729+0000 7f1630461640 1 -- 172.21.15.73:0/3880487817 shutdown_connections 2023-12-12T09:43:49.730 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:49.729+0000 7f1630461640 1 -- 172.21.15.73:0/3880487817 wait complete. 2023-12-12T09:43:49.731 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:49.730+0000 7f1630461640 1 Processor -- start 2023-12-12T09:43:49.732 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:49.731+0000 7f1630461640 1 -- start start 2023-12-12T09:43:49.734 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:49.731+0000 7f1630461640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f16280c67c0 0x7f16281eab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:49.734 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:49.731+0000 7f1630461640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f16280c7ed0 0x7f16280c10f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:49.735 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:49.731+0000 7f1630461640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f16281550a0 0x7f16280adf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:49.735 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:49.731+0000 7f1630461640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16281eb080 con 0x7f16280c7ed0 2023-12-12T09:43:49.735 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:49.731+0000 7f1630461640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16280ada80 con 0x7f16280c67c0 2023-12-12T09:43:49.735 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:49.731+0000 7f1630461640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16280c2c80 con 0x7f16281550a0 2023-12-12T09:43:49.735 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:49.732+0000 7f162d9fc640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f16280c7ed0 0x7f16280c10f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:49.735 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:49.732+0000 7f162d9fc640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f16280c7ed0 0x7f16280c10f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:45318/0 (socket says 172.21.15.73:45318) 2023-12-12T09:43:49.735 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:49.732+0000 7f162d9fc640 1 -- 172.21.15.73:0/4185335866 learned_addr learned my addr 172.21.15.73:0/4185335866 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:43:49.735 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:49.732+0000 7f162d9fc640 1 -- 172.21.15.73:0/4185335866 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f16281550a0 msgr2=0x7f16280adf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:49.735 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:49.732+0000 7f162d9fc640 1 --2- 172.21.15.73:0/4185335866 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f16281550a0 0x7f16280adf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:49.735 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:49.732+0000 7f162d9fc640 1 -- 172.21.15.73:0/4185335866 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f16280c67c0 msgr2=0x7f16281eab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:49.735 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:49.732+0000 7f162d9fc640 1 --2- 172.21.15.73:0/4185335866 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f16280c67c0 0x7f16281eab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:49.735 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:49.732+0000 7f162d9fc640 1 -- 172.21.15.73:0/4185335866 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16180094d0 con 0x7f16280c7ed0 2023-12-12T09:43:49.735 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:49.732+0000 7f162d9fc640 1 --2- 172.21.15.73:0/4185335866 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f16280c7ed0 0x7f16280c10f0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f1618000c00 tx=0x7f16180046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:43:49.736 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:49.733+0000 7f161effd640 1 -- 172.21.15.73:0/4185335866 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1618031840 con 0x7f16280c7ed0 2023-12-12T09:43:49.736 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:49.733+0000 7f161effd640 1 -- 172.21.15.73:0/4185335866 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16180443f0 con 0x7f16280c7ed0 2023-12-12T09:43:49.736 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:49.733+0000 7f1630461640 1 -- 172.21.15.73:0/4185335866 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16280c2f60 con 0x7f16280c7ed0 2023-12-12T09:43:49.736 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:49.733+0000 7f161effd640 1 -- 172.21.15.73:0/4185335866 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16180447a0 con 0x7f16280c7ed0 2023-12-12T09:43:49.736 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:49.733+0000 7f1630461640 1 -- 172.21.15.73:0/4185335866 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16280c3520 con 0x7f16280c7ed0 2023-12-12T09:43:49.736 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:49.734+0000 7f1630461640 1 -- 172.21.15.73:0/4185335866 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1628067580 con 0x7f16280c7ed0 2023-12-12T09:43:49.736 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:49.735+0000 7f161effd640 1 -- 172.21.15.73:0/4185335866 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f161804d450 con 0x7f16280c7ed0 2023-12-12T09:43:49.738 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:49.736+0000 7f161effd640 1 --2- 172.21.15.73:0/4185335866 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f160c06ae40 0x7f160c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:49.738 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:49.736+0000 7f161effd640 1 -- 172.21.15.73:0/4185335866 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f161802d040 con 0x7f16280c7ed0 2023-12-12T09:43:49.738 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:49.736+0000 7f162e1fd640 1 --2- 172.21.15.73:0/4185335866 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f160c06ae40 0x7f160c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:49.738 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:49.737+0000 7f162e1fd640 1 --2- 172.21.15.73:0/4185335866 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f160c06ae40 0x7f160c06d300 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f1624001560 tx=0x7f1624007990 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:43:49.741 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:49.740+0000 7f161effd640 1 -- 172.21.15.73:0/4185335866 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f1618076e80 con 0x7f16280c7ed0 2023-12-12T09:43:49.934 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:49.933+0000 7f1630461640 1 -- 172.21.15.73:0/4185335866 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f16280c6190 con 0x7f16280c7ed0 2023-12-12T09:43:49.934 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:49.934+0000 7f161effd640 1 -- 172.21.15.73:0/4185335866 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7f1618035070 con 0x7f16280c7ed0 2023-12-12T09:43:49.935 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 1 2023-12-12T09:43:49.937 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:49.936+0000 7f1630461640 1 -- 172.21.15.73:0/4185335866 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f160c06ae40 msgr2=0x7f160c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:49.937 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:49.936+0000 7f1630461640 1 --2- 172.21.15.73:0/4185335866 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f160c06ae40 0x7f160c06d300 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f1624001560 tx=0x7f1624007990 comp rx=0 tx=0).stop 2023-12-12T09:43:49.937 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:49.936+0000 7f1630461640 1 -- 172.21.15.73:0/4185335866 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f16280c7ed0 msgr2=0x7f16280c10f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:49.937 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:49.936+0000 7f1630461640 1 --2- 172.21.15.73:0/4185335866 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f16280c7ed0 0x7f16280c10f0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f1618000c00 tx=0x7f16180046c0 comp rx=0 tx=0).stop 2023-12-12T09:43:49.937 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:49.936+0000 7f1630461640 1 -- 172.21.15.73:0/4185335866 shutdown_connections 2023-12-12T09:43:49.938 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:49.936+0000 7f1630461640 1 --2- 172.21.15.73:0/4185335866 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f160c06ae40 0x7f160c06d300 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:49.938 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:49.936+0000 7f1630461640 1 --2- 172.21.15.73:0/4185335866 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f16281550a0 0x7f16280adf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:49.938 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:49.936+0000 7f1630461640 1 --2- 172.21.15.73:0/4185335866 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f16280c7ed0 0x7f16280c10f0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:49.938 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:49.936+0000 7f1630461640 1 --2- 172.21.15.73:0/4185335866 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f16280c67c0 0x7f16281eab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:49.938 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:49.936+0000 7f1630461640 1 -- 172.21.15.73:0/4185335866 >> 172.21.15.73:0/4185335866 conn(0x7f16280abb20 msgr2=0x7f16280abf00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:43:49.938 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:49.936+0000 7f1630461640 1 -- 172.21.15.73:0/4185335866 shutdown_connections 2023-12-12T09:43:49.938 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:49.936+0000 7f1630461640 1 -- 172.21.15.73:0/4185335866 wait complete. 2023-12-12T09:43:49.955 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-12T09:43:50.156 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:50.155+0000 7fc5e8741640 1 Processor -- start 2023-12-12T09:43:50.156 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:50.155+0000 7fc5e8741640 1 -- start start 2023-12-12T09:43:50.158 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:50.156+0000 7fc5e8741640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fc5e014ea60 0x7fc5e00c5420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:50.158 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:50.157+0000 7fc5e8741640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc5e00c0320 0x7fc5e00c20b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:50.158 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:50.157+0000 7fc5e8741640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5e00c3390 con 0x7fc5e00a4c90 2023-12-12T09:43:50.158 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:50.157+0000 7fc5e8741640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5e00c4b30 con 0x7fc5e014ea60 2023-12-12T09:43:50.159 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:50.157+0000 7fc5e8741640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5e0151e60 con 0x7fc5e00c0320 2023-12-12T09:43:50.159 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:50.157+0000 7fc5e64dd640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fc5e014ea60 0x7fc5e00c5420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:50.159 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:50.157+0000 7fc5e64dd640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fc5e014ea60 0x7fc5e00c5420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:45322/0 (socket says 172.21.15.73:45322) 2023-12-12T09:43:50.159 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:50.157+0000 7fc5e64dd640 1 -- 172.21.15.73:0/3906496050 learned_addr learned my addr 172.21.15.73:0/3906496050 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:43:50.159 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:50.157+0000 7fc5e64dd640 1 -- 172.21.15.73:0/3906496050 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc5e00c0320 msgr2=0x7fc5e00c20b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:43:50.159 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:50.157+0000 7fc5e64dd640 1 --2- 172.21.15.73:0/3906496050 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc5e00c0320 0x7fc5e00c20b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:50.159 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:50.157+0000 7fc5e64dd640 1 -- 172.21.15.73:0/3906496050 >> v1:172.21.15.142:6789/0 conn(0x7fc5e00a4c90 legacy=0x7fc5e00c4420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:43:50.159 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:50.157+0000 7fc5e64dd640 1 -- 172.21.15.73:0/3906496050 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5e0152140 con 0x7fc5e014ea60 2023-12-12T09:43:50.160 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:50.158+0000 7fc5e64dd640 1 --2- 172.21.15.73:0/3906496050 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc5e014ea60 0x7fc5e00c5420 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fc5dc009870 tx=0x7fc5dc02da70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dccb6ecdec84e484 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:43:50.160 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:50.159+0000 7fc5e54db640 1 -- 172.21.15.73:0/3906496050 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5dc02f830 con 0x7fc5e014ea60 2023-12-12T09:43:50.160 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:50.159+0000 7fc5e54db640 1 -- 172.21.15.73:0/3906496050 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5dc02f990 con 0x7fc5e014ea60 2023-12-12T09:43:50.160 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:50.159+0000 7fc5e54db640 1 -- 172.21.15.73:0/3906496050 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5dc02fd20 con 0x7fc5e014ea60 2023-12-12T09:43:50.161 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:50.159+0000 7fc5e8741640 1 -- 172.21.15.73:0/3906496050 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc5e014ea60 msgr2=0x7fc5e00c5420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:50.161 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:50.159+0000 7fc5e8741640 1 --2- 172.21.15.73:0/3906496050 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc5e014ea60 0x7fc5e00c5420 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fc5dc009870 tx=0x7fc5dc02da70 comp rx=0 tx=0).stop 2023-12-12T09:43:50.161 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:50.159+0000 7fc5e8741640 1 -- 172.21.15.73:0/3906496050 shutdown_connections 2023-12-12T09:43:50.161 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:50.159+0000 7fc5e8741640 1 --2- 172.21.15.73:0/3906496050 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc5e00c0320 0x7fc5e00c20b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:50.161 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:50.159+0000 7fc5e8741640 1 --2- 172.21.15.73:0/3906496050 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc5e014ea60 0x7fc5e00c5420 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:50.161 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:50.159+0000 7fc5e8741640 1 -- 172.21.15.73:0/3906496050 >> 172.21.15.73:0/3906496050 conn(0x7fc5e006a4e0 msgr2=0x7fc5e006a8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:43:50.161 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:50.159+0000 7fc5e8741640 1 -- 172.21.15.73:0/3906496050 shutdown_connections 2023-12-12T09:43:50.161 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:50.159+0000 7fc5e8741640 1 -- 172.21.15.73:0/3906496050 wait complete. 2023-12-12T09:43:50.162 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:50.161+0000 7fc5e8741640 1 Processor -- start 2023-12-12T09:43:50.162 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:50.161+0000 7fc5e8741640 1 -- start start 2023-12-12T09:43:50.163 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:50.162+0000 7fc5e8741640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc5e00a4c90 0x7fc5e00befc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:50.163 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:50.162+0000 7fc5e8741640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc5e00c0320 0x7fc5e0149fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:50.163 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:50.162+0000 7fc5e8741640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc5e014ea60 0x7fc5e014a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:50.164 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:50.162+0000 7fc5e8741640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5e00a9ca0 con 0x7fc5e014ea60 2023-12-12T09:43:50.164 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:50.162+0000 7fc5e8741640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5e00bfa50 con 0x7fc5e00c0320 2023-12-12T09:43:50.164 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:50.162+0000 7fc5e8741640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5e00aaaa0 con 0x7fc5e00a4c90 2023-12-12T09:43:50.164 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:50.163+0000 7fc5e6cde640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc5e014ea60 0x7fc5e014a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:50.164 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:50.163+0000 7fc5e6cde640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc5e014ea60 0x7fc5e014a4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:45330/0 (socket says 172.21.15.73:45330) 2023-12-12T09:43:50.164 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:50.163+0000 7fc5e6cde640 1 -- 172.21.15.73:0/3106572973 learned_addr learned my addr 172.21.15.73:0/3106572973 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:43:50.165 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:50.163+0000 7fc5e64dd640 1 --2- 172.21.15.73:0/3106572973 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc5e00a4c90 0x7fc5e00befc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:50.165 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:50.163+0000 7fc5e6cde640 1 -- 172.21.15.73:0/3106572973 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc5e00a4c90 msgr2=0x7fc5e00befc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:50.165 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:50.163+0000 7fc5e6cde640 1 --2- 172.21.15.73:0/3106572973 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc5e00a4c90 0x7fc5e00befc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:50.165 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:50.163+0000 7fc5e6cde640 1 -- 172.21.15.73:0/3106572973 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc5e00c0320 msgr2=0x7fc5e0149fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:50.165 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:50.163+0000 7fc5e5cdc640 1 --2- 172.21.15.73:0/3106572973 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc5e00c0320 0x7fc5e0149fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:50.166 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:50.163+0000 7fc5e6cde640 1 --2- 172.21.15.73:0/3106572973 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc5e00c0320 0x7fc5e0149fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:50.166 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:50.163+0000 7fc5e6cde640 1 -- 172.21.15.73:0/3106572973 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5dc0094d0 con 0x7fc5e014ea60 2023-12-12T09:43:50.166 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:50.163+0000 7fc5e6cde640 1 --2- 172.21.15.73:0/3106572973 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc5e014ea60 0x7fc5e014a4f0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fc5d800b970 tx=0x7fc5d800be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:43:50.166 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:50.163+0000 7fc5d6ffd640 1 -- 172.21.15.73:0/3106572973 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5d800cb40 con 0x7fc5e014ea60 2023-12-12T09:43:50.166 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:50.164+0000 7fc5d6ffd640 1 -- 172.21.15.73:0/3106572973 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5d800ccc0 con 0x7fc5e014ea60 2023-12-12T09:43:50.166 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:50.164+0000 7fc5d6ffd640 1 -- 172.21.15.73:0/3106572973 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5d8014680 con 0x7fc5e014ea60 2023-12-12T09:43:50.166 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:50.164+0000 7fc5e8741640 1 -- 172.21.15.73:0/3106572973 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5e00aacd0 con 0x7fc5e014ea60 2023-12-12T09:43:50.166 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:50.164+0000 7fc5e8741640 1 -- 172.21.15.73:0/3106572973 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5e00ab290 con 0x7fc5e014ea60 2023-12-12T09:43:50.167 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:50.165+0000 7fc5e8741640 1 -- 172.21.15.73:0/3106572973 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc5e01ed620 con 0x7fc5e014ea60 2023-12-12T09:43:50.167 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:50.166+0000 7fc5d6ffd640 1 -- 172.21.15.73:0/3106572973 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fc5d801d3b0 con 0x7fc5e014ea60 2023-12-12T09:43:50.167 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:50.166+0000 7fc5d6ffd640 1 --2- 172.21.15.73:0/3106572973 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fc5c406ae40 0x7fc5c406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:50.167 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:50.167+0000 7fc5d6ffd640 1 -- 172.21.15.73:0/3106572973 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc5d80895c0 con 0x7fc5e014ea60 2023-12-12T09:43:50.168 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:50.167+0000 7fc5e64dd640 1 --2- 172.21.15.73:0/3106572973 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fc5c406ae40 0x7fc5c406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:50.168 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:50.167+0000 7fc5e64dd640 1 --2- 172.21.15.73:0/3106572973 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fc5c406ae40 0x7fc5c406d300 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fc5dc038000 tx=0x7fc5dc008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:43:50.171 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:50.171+0000 7fc5d6ffd640 1 -- 172.21.15.73:0/3106572973 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fc5e01ed620 con 0x7fc5e014ea60 2023-12-12T09:43:50.349 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:50.348+0000 7fc5e8741640 1 -- 172.21.15.73:0/3106572973 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fc5e01ed620 con 0x7fc5e014ea60 2023-12-12T09:43:50.349 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:50.348+0000 7fc5d6ffd640 1 -- 172.21.15.73:0/3106572973 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7fc5e01ed620 con 0x7fc5e014ea60 2023-12-12T09:43:50.349 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 32 2023-12-12T09:43:50.352 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:50.351+0000 7fc5e8741640 1 -- 172.21.15.73:0/3106572973 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fc5c406ae40 msgr2=0x7fc5c406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:50.352 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:50.351+0000 7fc5e8741640 1 --2- 172.21.15.73:0/3106572973 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fc5c406ae40 0x7fc5c406d300 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fc5dc038000 tx=0x7fc5dc008030 comp rx=0 tx=0).stop 2023-12-12T09:43:50.352 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:50.351+0000 7fc5e8741640 1 -- 172.21.15.73:0/3106572973 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc5e014ea60 msgr2=0x7fc5e014a4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:50.352 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:50.351+0000 7fc5e8741640 1 --2- 172.21.15.73:0/3106572973 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc5e014ea60 0x7fc5e014a4f0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fc5d800b970 tx=0x7fc5d800be30 comp rx=0 tx=0).stop 2023-12-12T09:43:50.353 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:50.351+0000 7fc5e8741640 1 -- 172.21.15.73:0/3106572973 shutdown_connections 2023-12-12T09:43:50.353 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:50.351+0000 7fc5e8741640 1 --2- 172.21.15.73:0/3106572973 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fc5c406ae40 0x7fc5c406d300 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:50.353 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:50.351+0000 7fc5e8741640 1 --2- 172.21.15.73:0/3106572973 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc5e014ea60 0x7fc5e014a4f0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:50.353 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:50.351+0000 7fc5e8741640 1 --2- 172.21.15.73:0/3106572973 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc5e00c0320 0x7fc5e0149fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:50.353 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:50.351+0000 7fc5e8741640 1 --2- 172.21.15.73:0/3106572973 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc5e00a4c90 0x7fc5e00befc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:50.353 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:50.351+0000 7fc5e8741640 1 -- 172.21.15.73:0/3106572973 >> 172.21.15.73:0/3106572973 conn(0x7fc5e006a4e0 msgr2=0x7fc5e00c0790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:43:50.353 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:50.351+0000 7fc5e8741640 1 -- 172.21.15.73:0/3106572973 shutdown_connections 2023-12-12T09:43:50.353 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:50.351+0000 7fc5e8741640 1 -- 172.21.15.73:0/3106572973 wait complete. 2023-12-12T09:43:50.369 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-12T09:43:50.582 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:50.580+0000 7f2a1be4f640 1 Processor -- start 2023-12-12T09:43:50.582 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:50.581+0000 7f2a1be4f640 1 -- start start 2023-12-12T09:43:50.589 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:50.582+0000 7f2a1be4f640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2a140a4b10 0x7f2a140a5040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:50.589 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:50.582+0000 7f2a1be4f640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a140c2b00 con 0x7f2a1414e160 2023-12-12T09:43:50.589 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:50.582+0000 7f2a1be4f640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a140c57e0 con 0x7f2a1406cc90 2023-12-12T09:43:50.589 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:50.582+0000 7f2a1be4f640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a140c1e10 con 0x7f2a140a4b10 2023-12-12T09:43:50.589 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:50.583+0000 7f2a193ea640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f2a1414e160 0x7f2a140c23f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:50060/0 (socket says 172.21.15.73:50060) 2023-12-12T09:43:50.590 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:50.583+0000 7f2a193ea640 1 -- 172.21.15.73:0/1653784025 learned_addr learned my addr 172.21.15.73:0/1653784025 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-12T09:43:50.590 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:50.583+0000 7f2a19beb640 1 --2- 172.21.15.73:0/1653784025 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2a140a4b10 0x7f2a140a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:50.590 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:50.583+0000 7f2a18be9640 1 -- 172.21.15.73:0/1653784025 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3153888425 0 0) 0x7f2a140c2b00 con 0x7f2a1414e160 2023-12-12T09:43:50.590 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:50.583+0000 7f2a18be9640 1 -- 172.21.15.73:0/1653784025 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2a00005730 con 0x7f2a1414e160 2023-12-12T09:43:50.590 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:50.584+0000 7f2a18be9640 1 -- 172.21.15.73:0/1653784025 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2385232719 0 0) 0x7f2a00005730 con 0x7f2a1414e160 2023-12-12T09:43:50.591 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:50.584+0000 7f2a18be9640 1 -- 172.21.15.73:0/1653784025 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2a140a4b10 msgr2=0x7f2a140a5040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:43:50.591 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:50.584+0000 7f2a18be9640 1 --2- 172.21.15.73:0/1653784025 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2a140a4b10 0x7f2a140a5040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:50.591 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:50.584+0000 7f2a18be9640 1 -- 172.21.15.73:0/1653784025 >> v1:172.21.15.142:6789/0 conn(0x7f2a1406cc90 legacy=0x7f2a140c3c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:50.591 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:50.584+0000 7f2a18be9640 1 -- 172.21.15.73:0/1653784025 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a141517b0 con 0x7f2a1414e160 2023-12-12T09:43:50.591 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:50.584+0000 7f2a18be9640 1 -- 172.21.15.73:0/1653784025 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3186547832 0 0) 0x7f2a04001670 con 0x7f2a1414e160 2023-12-12T09:43:50.592 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:50.584+0000 7f2a18be9640 1 -- 172.21.15.73:0/1653784025 >> v1:172.21.15.73:6789/0 conn(0x7f2a1414e160 legacy=0x7f2a140c23f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:50.592 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:50.584+0000 7f2a18be9640 1 --2- 172.21.15.73:0/1653784025 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2a140a4b10 0x7f2a00005bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:50.592 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:50.584+0000 7f2a18be9640 1 --2- 172.21.15.73:0/1653784025 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2a00006180 0x7f2a000069d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:50.592 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:50.584+0000 7f2a18be9640 1 --2- 172.21.15.73:0/1653784025 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2a00006f10 0x7f2a00007370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:50.592 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:50.584+0000 7f2a18be9640 1 -- 172.21.15.73:0/1653784025 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a140c1e10 con 0x7f2a00006180 2023-12-12T09:43:50.592 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:50.584+0000 7f2a18be9640 1 -- 172.21.15.73:0/1653784025 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a0000de20 con 0x7f2a00006f10 2023-12-12T09:43:50.592 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:50.584+0000 7f2a18be9640 1 -- 172.21.15.73:0/1653784025 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a0000dfe0 con 0x7f2a140a4b10 2023-12-12T09:43:50.592 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:50.584+0000 7f2a193ea640 1 --2- 172.21.15.73:0/1653784025 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2a00006180 0x7f2a000069d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:50.593 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:50.584+0000 7f2a19beb640 1 --2- 172.21.15.73:0/1653784025 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2a140a4b10 0x7f2a00005bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:50.593 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:50.585+0000 7f2a193ea640 1 -- 172.21.15.73:0/1653784025 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2a140a4b10 msgr2=0x7f2a00005bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:43:50.593 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:50.585+0000 7f2a193ea640 1 --2- 172.21.15.73:0/1653784025 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2a140a4b10 0x7f2a00005bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:50.593 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:50.585+0000 7f2a193ea640 1 -- 172.21.15.73:0/1653784025 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2a00006f10 msgr2=0x7f2a00007370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:43:50.593 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:50.585+0000 7f2a193ea640 1 --2- 172.21.15.73:0/1653784025 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2a00006f10 0x7f2a00007370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:50.593 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:50.585+0000 7f2a193ea640 1 -- 172.21.15.73:0/1653784025 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a00005730 con 0x7f2a00006180 2023-12-12T09:43:50.593 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:50.586+0000 7f2a193ea640 1 --2- 172.21.15.73:0/1653784025 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2a00006180 0x7f2a000069d0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f2a0400c0e0 tx=0x7f2a00007a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d0986dd44c5ba8f server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:43:50.593 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:50.586+0000 7f2a18be9640 1 -- 172.21.15.73:0/1653784025 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a04005ad0 con 0x7f2a00006180 2023-12-12T09:43:50.593 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:50.586+0000 7f2a18be9640 1 -- 172.21.15.73:0/1653784025 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a04005c50 con 0x7f2a00006180 2023-12-12T09:43:50.594 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:50.586+0000 7f2a18be9640 1 -- 172.21.15.73:0/1653784025 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a0402c810 con 0x7f2a00006180 2023-12-12T09:43:50.594 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:50.586+0000 7f2a1be4f640 1 -- 172.21.15.73:0/1653784025 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2a00006180 msgr2=0x7f2a000069d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:50.594 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:50.586+0000 7f2a1be4f640 1 --2- 172.21.15.73:0/1653784025 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2a00006180 0x7f2a000069d0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f2a0400c0e0 tx=0x7f2a00007a00 comp rx=0 tx=0).stop 2023-12-12T09:43:50.594 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:50.586+0000 7f2a1a3ec640 1 -- 172.21.15.73:0/1653784025 reap_dead start 2023-12-12T09:43:50.594 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:50.586+0000 7f2a1be4f640 1 -- 172.21.15.73:0/1653784025 shutdown_connections 2023-12-12T09:43:50.594 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:50.586+0000 7f2a1be4f640 1 -- 172.21.15.73:0/1653784025 >> 172.21.15.73:0/1653784025 conn(0x7f2a1406a4e0 msgr2=0x7f2a1406a8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:43:50.594 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:50.586+0000 7f2a1be4f640 1 -- 172.21.15.73:0/1653784025 shutdown_connections 2023-12-12T09:43:50.594 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:50.586+0000 7f2a1be4f640 1 -- 172.21.15.73:0/1653784025 wait complete. 2023-12-12T09:43:50.597 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:50.588+0000 7f2a1be4f640 1 Processor -- start 2023-12-12T09:43:50.597 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:50.588+0000 7f2a1be4f640 1 -- start start 2023-12-12T09:43:50.597 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:50.589+0000 7f2a1be4f640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2a00006180 0x7f2a141e9eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:50.597 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:50.589+0000 7f2a1be4f640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2a141523c0 0x7f2a141499b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:50.597 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:50.589+0000 7f2a1be4f640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2a14149ef0 0x7f2a14148790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:50.597 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:50.589+0000 7f2a1be4f640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a14154aa0 con 0x7f2a00006180 2023-12-12T09:43:50.597 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:50.589+0000 7f2a1be4f640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a14070770 con 0x7f2a141523c0 2023-12-12T09:43:50.597 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:50.589+0000 7f2a1be4f640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a141ea3f0 con 0x7f2a14149ef0 2023-12-12T09:43:50.597 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:50.589+0000 7f2a19beb640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2a00006180 0x7f2a141e9eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:50.598 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:50.590+0000 7f2a19beb640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2a00006180 0x7f2a141e9eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:45338/0 (socket says 172.21.15.73:45338) 2023-12-12T09:43:50.598 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:50.590+0000 7f2a19beb640 1 -- 172.21.15.73:0/1111305516 learned_addr learned my addr 172.21.15.73:0/1111305516 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:43:50.598 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:50.590+0000 7f2a193ea640 1 --2- 172.21.15.73:0/1111305516 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2a141523c0 0x7f2a141499b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:50.598 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:50.590+0000 7f2a1a3ec640 1 --2- 172.21.15.73:0/1111305516 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2a14149ef0 0x7f2a14148790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:50.598 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:50.590+0000 7f2a19beb640 1 -- 172.21.15.73:0/1111305516 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2a14149ef0 msgr2=0x7f2a14148790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:50.598 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:50.590+0000 7f2a19beb640 1 --2- 172.21.15.73:0/1111305516 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2a14149ef0 0x7f2a14148790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:50.598 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:50.590+0000 7f2a19beb640 1 -- 172.21.15.73:0/1111305516 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2a141523c0 msgr2=0x7f2a141499b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:50.598 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:50.590+0000 7f2a19beb640 1 --2- 172.21.15.73:0/1111305516 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2a141523c0 0x7f2a141499b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:50.598 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:50.590+0000 7f2a19beb640 1 -- 172.21.15.73:0/1111305516 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a141ea670 con 0x7f2a00006180 2023-12-12T09:43:50.598 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:50.590+0000 7f2a1a3ec640 1 --2- 172.21.15.73:0/1111305516 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2a14149ef0 0x7f2a14148790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:43:50.599 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:50.590+0000 7f2a19beb640 1 --2- 172.21.15.73:0/1111305516 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2a00006180 0x7f2a141e9eb0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f2a10010890 tx=0x7f2a10010d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:43:50.599 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:50.591+0000 7f2a0a7fc640 1 -- 172.21.15.73:0/1111305516 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a10009610 con 0x7f2a00006180 2023-12-12T09:43:50.599 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:50.591+0000 7f2a0a7fc640 1 -- 172.21.15.73:0/1111305516 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a1000eb60 con 0x7f2a00006180 2023-12-12T09:43:50.599 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:50.591+0000 7f2a0a7fc640 1 -- 172.21.15.73:0/1111305516 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a1001c400 con 0x7f2a00006180 2023-12-12T09:43:50.599 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:50.591+0000 7f2a1be4f640 1 -- 172.21.15.73:0/1111305516 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a141ea950 con 0x7f2a00006180 2023-12-12T09:43:50.599 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:50.591+0000 7f2a1be4f640 1 -- 172.21.15.73:0/1111305516 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a14148cd0 con 0x7f2a00006180 2023-12-12T09:43:50.599 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:50.592+0000 7f2a1be4f640 1 -- 172.21.15.73:0/1111305516 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a141eae70 con 0x7f2a00006180 2023-12-12T09:43:50.599 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:50.593+0000 7f2a0a7fc640 1 -- 172.21.15.73:0/1111305516 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f2a1001c560 con 0x7f2a00006180 2023-12-12T09:43:50.599 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:50.593+0000 7f2a0a7fc640 1 --2- 172.21.15.73:0/1111305516 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f29f806ae70 0x7f29f806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:50.599 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:50.594+0000 7f2a0a7fc640 1 -- 172.21.15.73:0/1111305516 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2a10089b50 con 0x7f2a00006180 2023-12-12T09:43:50.599 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:50.594+0000 7f2a193ea640 1 --2- 172.21.15.73:0/1111305516 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f29f806ae70 0x7f29f806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:50.599 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:50.594+0000 7f2a193ea640 1 --2- 172.21.15.73:0/1111305516 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f29f806ae70 0x7f29f806d330 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f2a04034000 tx=0x7f2a04009030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:43:50.600 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:50.598+0000 7f2a0a7fc640 1 -- 172.21.15.73:0/1111305516 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f2a141eae70 con 0x7f2a00006180 2023-12-12T09:43:50.793 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:50.792+0000 7f2a1be4f640 1 -- 172.21.15.73:0/1111305516 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f2a141eae70 con 0x7f2a00006180 2023-12-12T09:43:50.794 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:50.793+0000 7f2a0a7fc640 1 -- 172.21.15.73:0/1111305516 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7f2a141eae70 con 0x7f2a00006180 2023-12-12T09:43:50.795 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 64 2023-12-12T09:43:50.798 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:50.796+0000 7f2a1be4f640 1 -- 172.21.15.73:0/1111305516 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f29f806ae70 msgr2=0x7f29f806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:50.798 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:50.796+0000 7f2a1be4f640 1 --2- 172.21.15.73:0/1111305516 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f29f806ae70 0x7f29f806d330 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f2a04034000 tx=0x7f2a04009030 comp rx=0 tx=0).stop 2023-12-12T09:43:50.798 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:50.796+0000 7f2a1be4f640 1 -- 172.21.15.73:0/1111305516 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2a00006180 msgr2=0x7f2a141e9eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:50.798 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:50.796+0000 7f2a1be4f640 1 --2- 172.21.15.73:0/1111305516 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2a00006180 0x7f2a141e9eb0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f2a10010890 tx=0x7f2a10010d50 comp rx=0 tx=0).stop 2023-12-12T09:43:50.798 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:50.796+0000 7f2a1be4f640 1 -- 172.21.15.73:0/1111305516 shutdown_connections 2023-12-12T09:43:50.799 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:50.796+0000 7f2a1be4f640 1 --2- 172.21.15.73:0/1111305516 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f29f806ae70 0x7f29f806d330 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:50.799 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:50.796+0000 7f2a1be4f640 1 --2- 172.21.15.73:0/1111305516 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2a14149ef0 0x7f2a14148790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:50.799 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:50.796+0000 7f2a1be4f640 1 --2- 172.21.15.73:0/1111305516 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2a141523c0 0x7f2a141499b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:50.799 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:50.796+0000 7f2a1be4f640 1 --2- 172.21.15.73:0/1111305516 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2a00006180 0x7f2a141e9eb0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:50.799 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:50.796+0000 7f2a1be4f640 1 -- 172.21.15.73:0/1111305516 >> 172.21.15.73:0/1111305516 conn(0x7f2a1406a4e0 msgr2=0x7f2a1414b9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:43:50.800 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:50.796+0000 7f2a1be4f640 1 -- 172.21.15.73:0/1111305516 shutdown_connections 2023-12-12T09:43:50.800 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:50.796+0000 7f2a1be4f640 1 -- 172.21.15.73:0/1111305516 wait complete. 2023-12-12T09:43:50.816 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-12T09:43:51.033 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:51.025+0000 7f0dcfce7640 1 Processor -- start 2023-12-12T09:43:51.033 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:51.026+0000 7f0dcfce7640 1 -- start start 2023-12-12T09:43:51.033 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:51.027+0000 7f0dcfce7640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f0dc8151e40 0x7f0dc80c6200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:51.033 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:51.027+0000 7f0dcfce7640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f0dc80c80f0 0x7f0dc806b260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:51.033 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:51.027+0000 7f0dcfce7640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0dc80c49c0 con 0x7f0dc80c7cb0 2023-12-12T09:43:51.033 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:51.027+0000 7f0dcfce7640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0dc806bad0 con 0x7f0dc80c80f0 2023-12-12T09:43:51.034 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:51.027+0000 7f0dcfce7640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0dc80c5d70 con 0x7f0dc8151e40 2023-12-12T09:43:51.034 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:51.027+0000 7f0dce284640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f0dc80c80f0 0x7f0dc806b260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:51.034 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:51.028+0000 7f0dce284640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f0dc80c80f0 0x7f0dc806b260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:45346/0 (socket says 172.21.15.73:45346) 2023-12-12T09:43:51.034 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:51.028+0000 7f0dce284640 1 -- 172.21.15.73:0/4102235025 learned_addr learned my addr 172.21.15.73:0/4102235025 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:43:51.034 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:51.028+0000 7f0dcda83640 1 --2- 172.21.15.73:0/4102235025 >> v2:172.21.15.142:3300/0 conn(0x7f0dc8151e40 0x7f0dc80c6200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:51.034 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:51.028+0000 7f0dce284640 1 -- 172.21.15.73:0/4102235025 >> v2:172.21.15.142:3300/0 conn(0x7f0dc8151e40 msgr2=0x7f0dc80c6200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:43:51.034 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:51.028+0000 7f0dce284640 1 --2- 172.21.15.73:0/4102235025 >> v2:172.21.15.142:3300/0 conn(0x7f0dc8151e40 0x7f0dc80c6200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:51.034 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:51.028+0000 7f0dce284640 1 -- 172.21.15.73:0/4102235025 >> v1:172.21.15.142:6789/0 conn(0x7f0dc80c7cb0 legacy=0x7f0dc806ab50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:43:51.034 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:51.028+0000 7f0dce284640 1 -- 172.21.15.73:0/4102235025 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0dc8154640 con 0x7f0dc80c80f0 2023-12-12T09:43:51.034 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:51.028+0000 7f0dcda83640 1 --2- 172.21.15.73:0/4102235025 >> v2:172.21.15.142:3300/0 conn(0x7f0dc8151e40 0x7f0dc80c6200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:43:51.034 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:51.029+0000 7f0dce284640 1 --2- 172.21.15.73:0/4102235025 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0dc80c80f0 0x7f0dc806b260 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f0dc80ac7c0 tx=0x7f0dc002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8495d2337de170ee server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:43:51.034 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:51.029+0000 7f0dcca81640 1 -- 172.21.15.73:0/4102235025 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dc0031870 con 0x7f0dc80c80f0 2023-12-12T09:43:51.034 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:51.029+0000 7f0dcca81640 1 -- 172.21.15.73:0/4102235025 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0dc00319d0 con 0x7f0dc80c80f0 2023-12-12T09:43:51.034 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:51.029+0000 7f0dcca81640 1 -- 172.21.15.73:0/4102235025 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dc0031d60 con 0x7f0dc80c80f0 2023-12-12T09:43:51.035 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:51.030+0000 7f0dcfce7640 1 -- 172.21.15.73:0/4102235025 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0dc80c80f0 msgr2=0x7f0dc806b260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:51.035 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:51.030+0000 7f0dcfce7640 1 --2- 172.21.15.73:0/4102235025 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0dc80c80f0 0x7f0dc806b260 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f0dc80ac7c0 tx=0x7f0dc002b910 comp rx=0 tx=0).stop 2023-12-12T09:43:51.035 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:51.030+0000 7f0dcfce7640 1 -- 172.21.15.73:0/4102235025 shutdown_connections 2023-12-12T09:43:51.035 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:51.030+0000 7f0dcfce7640 1 --2- 172.21.15.73:0/4102235025 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0dc80c80f0 0x7f0dc806b260 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:51.035 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:51.030+0000 7f0dcfce7640 1 --2- 172.21.15.73:0/4102235025 >> v2:172.21.15.142:3300/0 conn(0x7f0dc8151e40 0x7f0dc80c6200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:51.035 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:51.030+0000 7f0dcfce7640 1 -- 172.21.15.73:0/4102235025 >> 172.21.15.73:0/4102235025 conn(0x7f0dc80ab8a0 msgr2=0x7f0dc80abcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:43:51.035 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:51.030+0000 7f0dcfce7640 1 -- 172.21.15.73:0/4102235025 shutdown_connections 2023-12-12T09:43:51.035 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:51.030+0000 7f0dcfce7640 1 -- 172.21.15.73:0/4102235025 wait complete. 2023-12-12T09:43:51.035 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:51.032+0000 7f0dcfce7640 1 Processor -- start 2023-12-12T09:43:51.035 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:51.032+0000 7f0dcfce7640 1 -- start start 2023-12-12T09:43:51.039 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:51.033+0000 7f0dcfce7640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0dc80c7cb0 0x7f0dc81582d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:51.039 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:51.033+0000 7f0dcfce7640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0dc80c80f0 0x7f0dc8153e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:51.039 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:51.033+0000 7f0dcfce7640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0dc8151e40 0x7f0dc81469b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:51.039 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:51.033+0000 7f0dcfce7640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0dc80c1e40 con 0x7f0dc80c7cb0 2023-12-12T09:43:51.039 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:51.033+0000 7f0dcfce7640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0dc8158810 con 0x7f0dc8151e40 2023-12-12T09:43:51.039 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:51.033+0000 7f0dcfce7640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0dc8158a40 con 0x7f0dc80c80f0 2023-12-12T09:43:51.039 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:51.033+0000 7f0dcda83640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0dc80c7cb0 0x7f0dc81582d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:51.039 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:51.033+0000 7f0dcda83640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0dc80c7cb0 0x7f0dc81582d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:45366/0 (socket says 172.21.15.73:45366) 2023-12-12T09:43:51.039 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:51.033+0000 7f0dcda83640 1 -- 172.21.15.73:0/3688542227 learned_addr learned my addr 172.21.15.73:0/3688542227 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:43:51.039 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:51.033+0000 7f0dce284640 1 --2- 172.21.15.73:0/3688542227 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0dc8151e40 0x7f0dc81469b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:51.039 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:51.033+0000 7f0dcd282640 1 --2- 172.21.15.73:0/3688542227 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0dc80c80f0 0x7f0dc8153e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:51.040 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:51.034+0000 7f0dcda83640 1 -- 172.21.15.73:0/3688542227 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0dc80c80f0 msgr2=0x7f0dc8153e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:51.040 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:51.034+0000 7f0dcda83640 1 --2- 172.21.15.73:0/3688542227 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0dc80c80f0 0x7f0dc8153e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:51.040 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:51.034+0000 7f0dcda83640 1 -- 172.21.15.73:0/3688542227 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0dc8151e40 msgr2=0x7f0dc81469b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:51.040 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:51.034+0000 7f0dcda83640 1 --2- 172.21.15.73:0/3688542227 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0dc8151e40 0x7f0dc81469b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:51.040 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:51.034+0000 7f0dcda83640 1 -- 172.21.15.73:0/3688542227 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0dc00094d0 con 0x7f0dc80c7cb0 2023-12-12T09:43:51.040 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:51.034+0000 7f0dce284640 1 --2- 172.21.15.73:0/3688542227 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0dc8151e40 0x7f0dc81469b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:43:51.040 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:51.034+0000 7f0dcda83640 1 --2- 172.21.15.73:0/3688542227 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0dc80c7cb0 0x7f0dc81582d0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f0dbc00ce00 tx=0x7f0dbc00a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:43:51.040 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:51.034+0000 7f0dc67fc640 1 -- 172.21.15.73:0/3688542227 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dbc00f890 con 0x7f0dc80c7cb0 2023-12-12T09:43:51.040 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:51.034+0000 7f0dc67fc640 1 -- 172.21.15.73:0/3688542227 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0dbc00f9f0 con 0x7f0dc80c7cb0 2023-12-12T09:43:51.040 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:51.034+0000 7f0dc67fc640 1 -- 172.21.15.73:0/3688542227 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dbc00fdc0 con 0x7f0dc80c7cb0 2023-12-12T09:43:51.040 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:51.034+0000 7f0dcfce7640 1 -- 172.21.15.73:0/3688542227 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0dc80c30f0 con 0x7f0dc80c7cb0 2023-12-12T09:43:51.040 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:51.034+0000 7f0dcfce7640 1 -- 172.21.15.73:0/3688542227 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0dc80c3670 con 0x7f0dc80c7cb0 2023-12-12T09:43:51.040 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:51.035+0000 7f0dcfce7640 1 -- 172.21.15.73:0/3688542227 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0dc8067580 con 0x7f0dc80c7cb0 2023-12-12T09:43:51.040 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:51.036+0000 7f0dc67fc640 1 -- 172.21.15.73:0/3688542227 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f0dbc00b040 con 0x7f0dc80c7cb0 2023-12-12T09:43:51.040 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:51.037+0000 7f0dc67fc640 1 --2- 172.21.15.73:0/3688542227 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f0dac06ae70 0x7f0dac06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:51.041 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:51.037+0000 7f0dc67fc640 1 -- 172.21.15.73:0/3688542227 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0dbc089ff0 con 0x7f0dc80c7cb0 2023-12-12T09:43:51.041 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:51.037+0000 7f0dcd282640 1 --2- 172.21.15.73:0/3688542227 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f0dac06ae70 0x7f0dac06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:51.041 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:51.038+0000 7f0dcd282640 1 --2- 172.21.15.73:0/3688542227 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f0dac06ae70 0x7f0dac06d330 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f0dc80afbe0 tx=0x7f0db4009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:43:51.043 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:51.042+0000 7f0dc67fc640 1 -- 172.21.15.73:0/3688542227 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f0dbc0bce90 con 0x7f0dc80c7cb0 2023-12-12T09:43:51.236 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:51.235+0000 7f0dcfce7640 1 -- 172.21.15.73:0/3688542227 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0dc80c9910 con 0x7f0dc80c7cb0 2023-12-12T09:43:51.239 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:51.238+0000 7f0dc67fc640 1 -- 172.21.15.73:0/3688542227 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16517 (secure 0 0 0) 0x7f0dbc01d020 con 0x7f0dc80c7cb0 2023-12-12T09:43:51.239 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-12T09:43:51.239 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":21,"fsid":"ba240992-02b8-4c7e-92f2-27eb29ac433b","created":"2023-12-12T09:43:02.454719+0000","modified":"2023-12-12T09:43:23.219345+0000","last_up_change":"2023-12-12T09:43:13.913440+0000","last_in_change":"2023-12-12T09:43:05.925348+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-12T09:43:15.525508+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-12T09:43:20.004546+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-12T09:43:20.736500+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"dd9074be-dbe2-4c34-9896-a4223d8d3940","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":4047810203},{"type":"v1","addr":"172.21.15.73:6801","nonce":4047810203}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":4047810203},{"type":"v1","addr":"172.21.15.73:6803","nonce":4047810203}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":4047810203},{"type":"v1","addr":"172.21.15.73:6807","nonce":4047810203}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":4047810203},{"type":"v1","addr":"172.21.15.73:6805","nonce":4047810203}]},"public_addr":"172.21.15.73:6801/4047810203","cluster_addr":"172.21.15.73:6803/4047810203","heartbeat_back_addr":"172.21.15.73:6807/4047810203","heartbeat_front_addr":"172.21.15.73:6805/4047810203","state":["exists","up"]},{"osd":1,"uuid":"c4a05052-96d4-4758-a4e1-1a37f1e07fed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":1356058331},{"type":"v1","addr":"172.21.15.73:6824","nonce":1356058331}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":1356058331},{"type":"v1","addr":"172.21.15.73:6827","nonce":1356058331}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":1356058331},{"type":"v1","addr":"172.21.15.73:6831","nonce":1356058331}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":1356058331},{"type":"v1","addr":"172.21.15.73:6829","nonce":1356058331}]},"public_addr":"172.21.15.73:6824/1356058331","cluster_addr":"172.21.15.73:6827/1356058331","heartbeat_back_addr":"172.21.15.73:6831/1356058331","heartbeat_front_addr":"172.21.15.73:6829/1356058331","state":["exists","up"]},{"osd":2,"uuid":"512bc8ac-72c2-40d4-b3d2-d867a92c5213","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":1228903316},{"type":"v1","addr":"172.21.15.73:6817","nonce":1228903316}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":1228903316},{"type":"v1","addr":"172.21.15.73:6819","nonce":1228903316}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6823","nonce":1228903316},{"type":"v1","addr":"172.21.15.73:6825","nonce":1228903316}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":1228903316},{"type":"v1","addr":"172.21.15.73:6821","nonce":1228903316}]},"public_addr":"172.21.15.73:6817/1228903316","cluster_addr":"172.21.15.73:6819/1228903316","heartbeat_back_addr":"172.21.15.73:6825/1228903316","heartbeat_front_addr":"172.21.15.73:6821/1228903316","state":["exists","up"]},{"osd":3,"uuid":"3d1a91e0-42bf-437a-8eae-8d357c8f63a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":1293329670},{"type":"v1","addr":"172.21.15.73:6809","nonce":1293329670}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6810","nonce":1293329670},{"type":"v1","addr":"172.21.15.73:6811","nonce":1293329670}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":1293329670},{"type":"v1","addr":"172.21.15.73:6815","nonce":1293329670}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":1293329670},{"type":"v1","addr":"172.21.15.73:6813","nonce":1293329670}]},"public_addr":"172.21.15.73:6809/1293329670","cluster_addr":"172.21.15.73:6811/1293329670","heartbeat_back_addr":"172.21.15.73:6815/1293329670","heartbeat_front_addr":"172.21.15.73:6813/1293329670","state":["exists","up"]},{"osd":4,"uuid":"4b302fff-834c-4069-ac19-00e46f6c87b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":3727975702},{"type":"v1","addr":"172.21.15.142:6801","nonce":3727975702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":3727975702},{"type":"v1","addr":"172.21.15.142:6803","nonce":3727975702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6809","nonce":3727975702},{"type":"v1","addr":"172.21.15.142:6811","nonce":3727975702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6805","nonce":3727975702},{"type":"v1","addr":"172.21.15.142:6807","nonce":3727975702}]},"public_addr":"172.21.15.142:6801/3727975702","cluster_addr":"172.21.15.142:6803/3727975702","heartbeat_back_addr":"172.21.15.142:6811/3727975702","heartbeat_front_addr":"172.21.15.142:6807/3727975702","state":["exists","up"]},{"osd":5,"uuid":"d7cdace2-67d0-45cc-95f2-515cf6ef1b82","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6817","nonce":2353193632},{"type":"v1","addr":"172.21.15.142:6819","nonce":2353193632}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6821","nonce":2353193632},{"type":"v1","addr":"172.21.15.142:6823","nonce":2353193632}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6829","nonce":2353193632},{"type":"v1","addr":"172.21.15.142:6831","nonce":2353193632}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6825","nonce":2353193632},{"type":"v1","addr":"172.21.15.142:6827","nonce":2353193632}]},"public_addr":"172.21.15.142:6819/2353193632","cluster_addr":"172.21.15.142:6823/2353193632","heartbeat_back_addr":"172.21.15.142:6831/2353193632","heartbeat_front_addr":"172.21.15.142:6827/2353193632","state":["exists","up"]},{"osd":6,"uuid":"649ce78a-5626-445c-aedc-a651ed05a6f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":2006111986},{"type":"v1","addr":"172.21.15.142:6806","nonce":2006111986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":2006111986},{"type":"v1","addr":"172.21.15.142:6810","nonce":2006111986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":2006111986},{"type":"v1","addr":"172.21.15.142:6815","nonce":2006111986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":2006111986},{"type":"v1","addr":"172.21.15.142:6813","nonce":2006111986}]},"public_addr":"172.21.15.142:6806/2006111986","cluster_addr":"172.21.15.142:6810/2006111986","heartbeat_back_addr":"172.21.15.142:6815/2006111986","heartbeat_front_addr":"172.21.15.142:6813/2006111986","state":["exists","up"]},{"osd":7,"uuid":"af15ae3b-c1d0-4acf-92db-8a1805494d13","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":2573794341},{"type":"v1","addr":"172.21.15.142:6818","nonce":2573794341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":2573794341},{"type":"v1","addr":"172.21.15.142:6822","nonce":2573794341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":2573794341},{"type":"v1","addr":"172.21.15.142:6830","nonce":2573794341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":2573794341},{"type":"v1","addr":"172.21.15.142:6826","nonce":2573794341}]},"public_addr":"172.21.15.142:6818/2573794341","cluster_addr":"172.21.15.142:6822/2573794341","heartbeat_back_addr":"172.21.15.142:6830/2573794341","heartbeat_front_addr":"172.21.15.142:6826/2573794341","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.185824+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.262103+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.225556+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:10.523459+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:10.706035+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.257339+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.301776+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.051960+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-12T09:43:51.241 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:51.241+0000 7f0dcfce7640 1 -- 172.21.15.73:0/3688542227 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f0dac06ae70 msgr2=0x7f0dac06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:51.241 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:51.241+0000 7f0dcfce7640 1 --2- 172.21.15.73:0/3688542227 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f0dac06ae70 0x7f0dac06d330 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f0dc80afbe0 tx=0x7f0db4009040 comp rx=0 tx=0).stop 2023-12-12T09:43:51.241 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:51.241+0000 7f0dcfce7640 1 -- 172.21.15.73:0/3688542227 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0dc80c7cb0 msgr2=0x7f0dc81582d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:51.242 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:51.241+0000 7f0dcfce7640 1 --2- 172.21.15.73:0/3688542227 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0dc80c7cb0 0x7f0dc81582d0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f0dbc00ce00 tx=0x7f0dbc00a650 comp rx=0 tx=0).stop 2023-12-12T09:43:51.242 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:51.241+0000 7f0dcfce7640 1 -- 172.21.15.73:0/3688542227 shutdown_connections 2023-12-12T09:43:51.242 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:51.241+0000 7f0dcfce7640 1 --2- 172.21.15.73:0/3688542227 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f0dac06ae70 0x7f0dac06d330 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:51.242 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:51.241+0000 7f0dcfce7640 1 --2- 172.21.15.73:0/3688542227 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0dc8151e40 0x7f0dc81469b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:51.243 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:51.241+0000 7f0dcfce7640 1 --2- 172.21.15.73:0/3688542227 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0dc80c80f0 0x7f0dc8153e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:51.243 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:51.241+0000 7f0dcfce7640 1 --2- 172.21.15.73:0/3688542227 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0dc80c7cb0 0x7f0dc81582d0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:51.243 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:51.241+0000 7f0dcfce7640 1 -- 172.21.15.73:0/3688542227 >> 172.21.15.73:0/3688542227 conn(0x7f0dc80ab8a0 msgr2=0x7f0dc80c6830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:43:51.243 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:51.241+0000 7f0dcfce7640 1 -- 172.21.15.73:0/3688542227 shutdown_connections 2023-12-12T09:43:51.243 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:51.241+0000 7f0dcfce7640 1 -- 172.21.15.73:0/3688542227 wait complete. 2023-12-12T09:43:51.261 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-12T09:43:15.525508+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-12T09:43:20.004546+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-12T09:43:20.736500+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-12T09:43:51.262 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-12T09:43:51.478 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:51.477+0000 7fda4f002640 1 Processor -- start 2023-12-12T09:43:51.478 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:51.477+0000 7fda4f002640 1 -- start start 2023-12-12T09:43:51.479 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:51.478+0000 7fda4f002640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fda480c67c0 0x7fda480c7ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:51.479 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:51.478+0000 7fda4f002640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fda480c6ba0 0x7fda481550a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:51.479 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:51.478+0000 7fda4f002640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda480c7030 con 0x7fda4806c180 2023-12-12T09:43:51.480 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:51.478+0000 7fda4f002640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda481555e0 con 0x7fda480c67c0 2023-12-12T09:43:51.480 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:51.478+0000 7fda4f002640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda480c4af0 con 0x7fda480c6ba0 2023-12-12T09:43:51.480 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:51.478+0000 7fda4cd9e640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fda480c67c0 0x7fda480c7ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:51.480 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:51.479+0000 7fda4cd9e640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fda480c67c0 0x7fda480c7ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:45368/0 (socket says 172.21.15.73:45368) 2023-12-12T09:43:51.480 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:51.479+0000 7fda4cd9e640 1 -- 172.21.15.73:0/998533252 learned_addr learned my addr 172.21.15.73:0/998533252 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:43:51.480 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:51.479+0000 7fda4cd9e640 1 -- 172.21.15.73:0/998533252 >> v2:172.21.15.142:3300/0 conn(0x7fda480c6ba0 msgr2=0x7fda481550a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:43:51.481 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:51.479+0000 7fda47fff640 1 --2- 172.21.15.73:0/998533252 >> v2:172.21.15.142:3300/0 conn(0x7fda480c6ba0 0x7fda481550a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:51.481 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:51.479+0000 7fda4cd9e640 1 --2- 172.21.15.73:0/998533252 >> v2:172.21.15.142:3300/0 conn(0x7fda480c6ba0 0x7fda481550a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:51.481 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:51.479+0000 7fda4cd9e640 1 -- 172.21.15.73:0/998533252 >> v1:172.21.15.142:6789/0 conn(0x7fda4806c180 legacy=0x7fda48157c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:43:51.481 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:51.479+0000 7fda4cd9e640 1 -- 172.21.15.73:0/998533252 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda480c4dd0 con 0x7fda480c67c0 2023-12-12T09:43:51.481 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:51.480+0000 7fda4cd9e640 1 --2- 172.21.15.73:0/998533252 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fda480c67c0 0x7fda480c7ed0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fda4806d070 tx=0x7fda3802bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be581ea61d2db24 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:43:51.481 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:51.480+0000 7fda477fe640 1 -- 172.21.15.73:0/998533252 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda3802ca80 con 0x7fda480c67c0 2023-12-12T09:43:51.482 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:51.480+0000 7fda477fe640 1 -- 172.21.15.73:0/998533252 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda3802cbe0 con 0x7fda480c67c0 2023-12-12T09:43:51.482 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:51.480+0000 7fda477fe640 1 -- 172.21.15.73:0/998533252 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda380343f0 con 0x7fda480c67c0 2023-12-12T09:43:51.482 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:51.481+0000 7fda4f002640 1 -- 172.21.15.73:0/998533252 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fda480c67c0 msgr2=0x7fda480c7ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:51.482 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:51.481+0000 7fda4f002640 1 --2- 172.21.15.73:0/998533252 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fda480c67c0 0x7fda480c7ed0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fda4806d070 tx=0x7fda3802bee0 comp rx=0 tx=0).stop 2023-12-12T09:43:51.483 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:51.481+0000 7fda4f002640 1 -- 172.21.15.73:0/998533252 shutdown_connections 2023-12-12T09:43:51.483 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:51.481+0000 7fda4f002640 1 --2- 172.21.15.73:0/998533252 >> v2:172.21.15.142:3300/0 conn(0x7fda480c6ba0 0x7fda481550a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:51.483 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:51.481+0000 7fda4f002640 1 --2- 172.21.15.73:0/998533252 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fda480c67c0 0x7fda480c7ed0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:51.483 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:51.481+0000 7fda4f002640 1 -- 172.21.15.73:0/998533252 >> 172.21.15.73:0/998533252 conn(0x7fda480abb20 msgr2=0x7fda480abf30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:43:51.483 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:51.481+0000 7fda4f002640 1 -- 172.21.15.73:0/998533252 shutdown_connections 2023-12-12T09:43:51.483 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:51.481+0000 7fda4f002640 1 -- 172.21.15.73:0/998533252 wait complete. 2023-12-12T09:43:51.484 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:51.483+0000 7fda4f002640 1 Processor -- start 2023-12-12T09:43:51.484 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:51.483+0000 7fda4f002640 1 -- start start 2023-12-12T09:43:51.486 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:51.484+0000 7fda4f002640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fda4806c180 0x7fda480c0e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:51.486 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:51.484+0000 7fda4f002640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fda480c67c0 0x7fda481ea830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:51.487 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:51.484+0000 7fda4f002640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fda480c6ba0 0x7fda48157de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:51.487 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:51.484+0000 7fda4f002640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda481ead70 con 0x7fda480c6ba0 2023-12-12T09:43:51.487 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:51.484+0000 7fda4f002640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda480bf7c0 con 0x7fda4806c180 2023-12-12T09:43:51.487 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:51.484+0000 7fda4f002640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda480bfaa0 con 0x7fda480c67c0 2023-12-12T09:43:51.487 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:51.484+0000 7fda4d59f640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fda480c6ba0 0x7fda48157de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:51.487 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:51.484+0000 7fda4d59f640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fda480c6ba0 0x7fda48157de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:45382/0 (socket says 172.21.15.73:45382) 2023-12-12T09:43:51.487 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:51.484+0000 7fda4d59f640 1 -- 172.21.15.73:0/94190968 learned_addr learned my addr 172.21.15.73:0/94190968 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:43:51.487 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:51.485+0000 7fda4cd9e640 1 --2- 172.21.15.73:0/94190968 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fda4806c180 0x7fda480c0e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:51.487 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:51.485+0000 7fda47fff640 1 --2- 172.21.15.73:0/94190968 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fda480c67c0 0x7fda481ea830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:51.487 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:51.485+0000 7fda4d59f640 1 -- 172.21.15.73:0/94190968 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fda480c67c0 msgr2=0x7fda481ea830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:51.487 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:51.485+0000 7fda4d59f640 1 --2- 172.21.15.73:0/94190968 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fda480c67c0 0x7fda481ea830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:51.487 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:51.485+0000 7fda4d59f640 1 -- 172.21.15.73:0/94190968 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fda4806c180 msgr2=0x7fda480c0e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:51.487 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:51.485+0000 7fda4d59f640 1 --2- 172.21.15.73:0/94190968 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fda4806c180 0x7fda480c0e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:51.487 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:51.485+0000 7fda4d59f640 1 -- 172.21.15.73:0/94190968 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda38009b30 con 0x7fda480c6ba0 2023-12-12T09:43:51.488 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:51.485+0000 7fda4d59f640 1 --2- 172.21.15.73:0/94190968 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fda480c6ba0 0x7fda48157de0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fda4000c390 tx=0x7fda4000c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:43:51.488 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:51.485+0000 7fda457fa640 1 -- 172.21.15.73:0/94190968 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda400035f0 con 0x7fda480c6ba0 2023-12-12T09:43:51.488 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:51.485+0000 7fda457fa640 1 -- 172.21.15.73:0/94190968 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda40003750 con 0x7fda480c6ba0 2023-12-12T09:43:51.488 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:51.485+0000 7fda457fa640 1 -- 172.21.15.73:0/94190968 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda40003b00 con 0x7fda480c6ba0 2023-12-12T09:43:51.488 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:51.485+0000 7fda4f002640 1 -- 172.21.15.73:0/94190968 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda480bfd80 con 0x7fda480c6ba0 2023-12-12T09:43:51.488 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:51.486+0000 7fda4f002640 1 -- 172.21.15.73:0/94190968 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda481ed640 con 0x7fda480c6ba0 2023-12-12T09:43:51.488 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:51.487+0000 7fda4f002640 1 -- 172.21.15.73:0/94190968 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda48067580 con 0x7fda480c6ba0 2023-12-12T09:43:51.488 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:51.488+0000 7fda457fa640 1 -- 172.21.15.73:0/94190968 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fda40003c60 con 0x7fda480c6ba0 2023-12-12T09:43:51.490 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:51.489+0000 7fda457fa640 1 --2- 172.21.15.73:0/94190968 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fda2806ae40 0x7fda2806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:51.490 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:51.489+0000 7fda457fa640 1 -- 172.21.15.73:0/94190968 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fda400887f0 con 0x7fda480c6ba0 2023-12-12T09:43:51.490 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:51.489+0000 7fda4cd9e640 1 --2- 172.21.15.73:0/94190968 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fda2806ae40 0x7fda2806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:51.491 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:51.490+0000 7fda4cd9e640 1 --2- 172.21.15.73:0/94190968 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fda2806ae40 0x7fda2806d300 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fda38035000 tx=0x7fda38030000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:43:51.494 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:51.494+0000 7fda457fa640 1 -- 172.21.15.73:0/94190968 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fda40053930 con 0x7fda480c6ba0 2023-12-12T09:43:51.683 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:51.682+0000 7fda4f002640 1 -- 172.21.15.73:0/94190968 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fda480c7cb0 con 0x7fda480c6ba0 2023-12-12T09:43:51.684 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:51.683+0000 7fda457fa640 1 -- 172.21.15.73:0/94190968 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7fda400170a0 con 0x7fda480c6ba0 2023-12-12T09:43:51.684 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 1 2023-12-12T09:43:51.687 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:51.685+0000 7fda4f002640 1 -- 172.21.15.73:0/94190968 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fda2806ae40 msgr2=0x7fda2806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:51.687 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:51.685+0000 7fda4f002640 1 --2- 172.21.15.73:0/94190968 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fda2806ae40 0x7fda2806d300 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fda38035000 tx=0x7fda38030000 comp rx=0 tx=0).stop 2023-12-12T09:43:51.687 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:51.685+0000 7fda4f002640 1 -- 172.21.15.73:0/94190968 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fda480c6ba0 msgr2=0x7fda48157de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:51.687 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:51.685+0000 7fda4f002640 1 --2- 172.21.15.73:0/94190968 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fda480c6ba0 0x7fda48157de0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fda4000c390 tx=0x7fda4000c850 comp rx=0 tx=0).stop 2023-12-12T09:43:51.687 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:51.685+0000 7fda4f002640 1 -- 172.21.15.73:0/94190968 shutdown_connections 2023-12-12T09:43:51.687 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:51.685+0000 7fda4f002640 1 --2- 172.21.15.73:0/94190968 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fda2806ae40 0x7fda2806d300 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:51.687 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:51.685+0000 7fda4f002640 1 --2- 172.21.15.73:0/94190968 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fda480c6ba0 0x7fda48157de0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:51.687 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:51.685+0000 7fda4f002640 1 --2- 172.21.15.73:0/94190968 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fda480c67c0 0x7fda481ea830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:51.687 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:51.685+0000 7fda4f002640 1 --2- 172.21.15.73:0/94190968 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fda4806c180 0x7fda480c0e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:51.687 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:51.685+0000 7fda4f002640 1 -- 172.21.15.73:0/94190968 >> 172.21.15.73:0/94190968 conn(0x7fda480abb20 msgr2=0x7fda480abf00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:43:51.688 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:51.686+0000 7fda4f002640 1 -- 172.21.15.73:0/94190968 shutdown_connections 2023-12-12T09:43:51.688 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:51.686+0000 7fda4f002640 1 -- 172.21.15.73:0/94190968 wait complete. 2023-12-12T09:43:51.704 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-12T09:43:51.918 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:51.917+0000 7f700ddd7640 1 Processor -- start 2023-12-12T09:43:51.918 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:51.917+0000 7f700ddd7640 1 -- start start 2023-12-12T09:43:51.920 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:51.918+0000 7f700ddd7640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f700814f8c0 0x7f700806dc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:51.920 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:51.918+0000 7f700ddd7640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7008152500 0x7f7008152990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:51.920 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:51.918+0000 7f700ddd7640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70080c16c0 con 0x7f700806d350 2023-12-12T09:43:51.920 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:51.918+0000 7f700ddd7640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70080c1090 con 0x7f700814f8c0 2023-12-12T09:43:51.920 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:51.918+0000 7f700ddd7640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70080c14b0 con 0x7f7008152500 2023-12-12T09:43:51.920 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:51.919+0000 7f70077fe640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f700814f8c0 0x7f700806dc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:51.920 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:51.919+0000 7f70077fe640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f700814f8c0 0x7f700806dc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:45398/0 (socket says 172.21.15.73:45398) 2023-12-12T09:43:51.920 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:51.919+0000 7f70077fe640 1 -- 172.21.15.73:0/979358346 learned_addr learned my addr 172.21.15.73:0/979358346 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:43:51.921 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:51.919+0000 7f7007fff640 1 --2- 172.21.15.73:0/979358346 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7008152500 0x7f7008152990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:51.921 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:51.919+0000 7f70077fe640 1 -- 172.21.15.73:0/979358346 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7008152500 msgr2=0x7f7008152990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:43:51.921 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:51.919+0000 7f70077fe640 1 --2- 172.21.15.73:0/979358346 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7008152500 0x7f7008152990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:51.921 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:51.919+0000 7f70077fe640 1 -- 172.21.15.73:0/979358346 >> v1:172.21.15.142:6789/0 conn(0x7f700806d350 legacy=0x7f7008071e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:43:51.921 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:51.919+0000 7f70077fe640 1 -- 172.21.15.73:0/979358346 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70080c19a0 con 0x7f700814f8c0 2023-12-12T09:43:51.922 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:51.920+0000 7f70077fe640 1 --2- 172.21.15.73:0/979358346 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f700814f8c0 0x7f700806dc40 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f6ff8009e50 tx=0x7f6ff802bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e7c03af45c0dde server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:43:51.922 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:51.921+0000 7f7006ffd640 1 -- 172.21.15.73:0/979358346 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ff802ca70 con 0x7f700814f8c0 2023-12-12T09:43:51.922 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:51.921+0000 7f7006ffd640 1 -- 172.21.15.73:0/979358346 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ff802cbd0 con 0x7f700814f8c0 2023-12-12T09:43:51.922 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:51.921+0000 7f7006ffd640 1 -- 172.21.15.73:0/979358346 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ff80343f0 con 0x7f700814f8c0 2023-12-12T09:43:51.923 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:51.921+0000 7f700ddd7640 1 -- 172.21.15.73:0/979358346 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f700814f8c0 msgr2=0x7f700806dc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:51.923 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:51.921+0000 7f700ddd7640 1 --2- 172.21.15.73:0/979358346 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f700814f8c0 0x7f700806dc40 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f6ff8009e50 tx=0x7f6ff802bed0 comp rx=0 tx=0).stop 2023-12-12T09:43:51.923 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:51.921+0000 7f700ddd7640 1 -- 172.21.15.73:0/979358346 shutdown_connections 2023-12-12T09:43:51.923 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:51.921+0000 7f700ddd7640 1 --2- 172.21.15.73:0/979358346 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7008152500 0x7f7008152990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:51.923 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:51.921+0000 7f700ddd7640 1 --2- 172.21.15.73:0/979358346 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f700814f8c0 0x7f700806dc40 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:51.923 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:51.921+0000 7f700ddd7640 1 -- 172.21.15.73:0/979358346 >> 172.21.15.73:0/979358346 conn(0x7f700806a4e0 msgr2=0x7f700806a8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:43:51.924 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:51.921+0000 7f700ddd7640 1 -- 172.21.15.73:0/979358346 shutdown_connections 2023-12-12T09:43:51.924 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:51.921+0000 7f700ddd7640 1 -- 172.21.15.73:0/979358346 wait complete. 2023-12-12T09:43:51.924 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:51.923+0000 7f700ddd7640 1 Processor -- start 2023-12-12T09:43:51.924 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:51.923+0000 7f700ddd7640 1 -- start start 2023-12-12T09:43:51.927 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:51.924+0000 7f700ddd7640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f700806d350 0x7f70080a8790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:51.927 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:51.924+0000 7f700ddd7640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f700814f8c0 0x7f7008147780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:51.927 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:51.924+0000 7f700ddd7640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7008152500 0x7f70081ed3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:51.927 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:51.924+0000 7f700ddd7640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7008153800 con 0x7f700814f8c0 2023-12-12T09:43:51.927 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:51.924+0000 7f700ddd7640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70081ee260 con 0x7f700806d350 2023-12-12T09:43:51.927 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:51.924+0000 7f700ddd7640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7008148c90 con 0x7f7008152500 2023-12-12T09:43:51.927 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:51.924+0000 7f6ffeffd640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f700814f8c0 0x7f7008147780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:51.927 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:51.924+0000 7f6ffeffd640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f700814f8c0 0x7f7008147780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:45410/0 (socket says 172.21.15.73:45410) 2023-12-12T09:43:51.927 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:51.924+0000 7f6ffeffd640 1 -- 172.21.15.73:0/562783071 learned_addr learned my addr 172.21.15.73:0/562783071 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:43:51.927 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:51.925+0000 7f7007fff640 1 --2- 172.21.15.73:0/562783071 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7008152500 0x7f70081ed3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:51.928 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:51.925+0000 7f70077fe640 1 --2- 172.21.15.73:0/562783071 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f700806d350 0x7f70080a8790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:51.928 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:51.925+0000 7f6ffeffd640 1 -- 172.21.15.73:0/562783071 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7008152500 msgr2=0x7f70081ed3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:51.928 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:51.925+0000 7f6ffeffd640 1 --2- 172.21.15.73:0/562783071 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7008152500 0x7f70081ed3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:51.928 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:51.925+0000 7f6ffeffd640 1 -- 172.21.15.73:0/562783071 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f700806d350 msgr2=0x7f70080a8790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:51.928 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:51.925+0000 7f6ffeffd640 1 --2- 172.21.15.73:0/562783071 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f700806d350 0x7f70080a8790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:51.928 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:51.925+0000 7f6ffeffd640 1 -- 172.21.15.73:0/562783071 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ff8009b30 con 0x7f700814f8c0 2023-12-12T09:43:51.928 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:51.925+0000 7f6ffeffd640 1 --2- 172.21.15.73:0/562783071 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f700814f8c0 0x7f7008147780 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f6ff000b3f0 tx=0x7f6ff000b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:43:51.928 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:51.925+0000 7f7004ff9640 1 -- 172.21.15.73:0/562783071 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ff0011830 con 0x7f700814f8c0 2023-12-12T09:43:51.928 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:51.925+0000 7f7004ff9640 1 -- 172.21.15.73:0/562783071 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ff0011990 con 0x7f700814f8c0 2023-12-12T09:43:51.928 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:51.925+0000 7f700ddd7640 1 -- 172.21.15.73:0/562783071 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7008148f70 con 0x7f700814f8c0 2023-12-12T09:43:51.928 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:51.926+0000 7f7004ff9640 1 -- 172.21.15.73:0/562783071 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ff0011d40 con 0x7f700814f8c0 2023-12-12T09:43:51.928 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:51.926+0000 7f700ddd7640 1 -- 172.21.15.73:0/562783071 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7008149530 con 0x7f700814f8c0 2023-12-12T09:43:51.929 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:51.927+0000 7f700ddd7640 1 -- 172.21.15.73:0/562783071 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7008067070 con 0x7f700814f8c0 2023-12-12T09:43:51.929 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:51.928+0000 7f7004ff9640 1 -- 172.21.15.73:0/562783071 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f6ff001a400 con 0x7f700814f8c0 2023-12-12T09:43:51.929 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:51.929+0000 7f7004ff9640 1 --2- 172.21.15.73:0/562783071 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f6fe806ae40 0x7f6fe806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:51.929 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:51.929+0000 7f7004ff9640 1 -- 172.21.15.73:0/562783071 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6ff0089420 con 0x7f700814f8c0 2023-12-12T09:43:51.930 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:51.929+0000 7f70077fe640 1 --2- 172.21.15.73:0/562783071 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f6fe806ae40 0x7f6fe806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:51.930 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:51.930+0000 7f70077fe640 1 --2- 172.21.15.73:0/562783071 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f6fe806ae40 0x7f6fe806d300 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f6ff8035000 tx=0x7f6ff8030000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:43:51.934 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:51.933+0000 7f7004ff9640 1 -- 172.21.15.73:0/562783071 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f6ff00544c0 con 0x7f700814f8c0 2023-12-12T09:43:52.129 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:52.128+0000 7f700ddd7640 1 -- 172.21.15.73:0/562783071 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f700806d130 con 0x7f700814f8c0 2023-12-12T09:43:52.130 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:52.129+0000 7f7004ff9640 1 -- 172.21.15.73:0/562783071 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7f6ff0057ae0 con 0x7f700814f8c0 2023-12-12T09:43:52.130 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 32 2023-12-12T09:43:52.133 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:52.132+0000 7f700ddd7640 1 -- 172.21.15.73:0/562783071 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f6fe806ae40 msgr2=0x7f6fe806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:52.133 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:52.132+0000 7f700ddd7640 1 --2- 172.21.15.73:0/562783071 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f6fe806ae40 0x7f6fe806d300 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f6ff8035000 tx=0x7f6ff8030000 comp rx=0 tx=0).stop 2023-12-12T09:43:52.133 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:52.132+0000 7f700ddd7640 1 -- 172.21.15.73:0/562783071 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f700814f8c0 msgr2=0x7f7008147780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:52.133 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:52.132+0000 7f700ddd7640 1 --2- 172.21.15.73:0/562783071 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f700814f8c0 0x7f7008147780 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f6ff000b3f0 tx=0x7f6ff000b8b0 comp rx=0 tx=0).stop 2023-12-12T09:43:52.134 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:52.132+0000 7f700ddd7640 1 -- 172.21.15.73:0/562783071 shutdown_connections 2023-12-12T09:43:52.134 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:52.132+0000 7f700ddd7640 1 --2- 172.21.15.73:0/562783071 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f6fe806ae40 0x7f6fe806d300 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:52.134 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:52.132+0000 7f700ddd7640 1 --2- 172.21.15.73:0/562783071 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7008152500 0x7f70081ed3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:52.134 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:52.132+0000 7f700ddd7640 1 --2- 172.21.15.73:0/562783071 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f700814f8c0 0x7f7008147780 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:52.134 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:52.132+0000 7f700ddd7640 1 --2- 172.21.15.73:0/562783071 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f700806d350 0x7f70080a8790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:52.134 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:52.132+0000 7f700ddd7640 1 -- 172.21.15.73:0/562783071 >> 172.21.15.73:0/562783071 conn(0x7f700806a4e0 msgr2=0x7f700806a8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:43:52.134 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:52.132+0000 7f700ddd7640 1 -- 172.21.15.73:0/562783071 shutdown_connections 2023-12-12T09:43:52.134 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:52.132+0000 7f700ddd7640 1 -- 172.21.15.73:0/562783071 wait complete. 2023-12-12T09:43:52.152 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-12T09:43:52.360 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:52.359+0000 7fd37167c640 1 Processor -- start 2023-12-12T09:43:52.360 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:52.359+0000 7fd37167c640 1 -- start start 2023-12-12T09:43:52.363 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:52.361+0000 7fd37167c640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fd36c14f8c0 0x7fd36c06dc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:52.363 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:52.361+0000 7fd37167c640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fd36c152500 0x7fd36c152990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:52.363 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:52.361+0000 7fd37167c640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd36c0c16c0 con 0x7fd36c06d350 2023-12-12T09:43:52.363 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:52.361+0000 7fd37167c640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd36c0c1090 con 0x7fd36c152500 2023-12-12T09:43:52.363 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:52.361+0000 7fd37167c640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd36c0c14b0 con 0x7fd36c14f8c0 2023-12-12T09:43:52.363 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:52.361+0000 7fd36b7fe640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fd36c152500 0x7fd36c152990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:52.363 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:52.361+0000 7fd36b7fe640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fd36c152500 0x7fd36c152990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:45420/0 (socket says 172.21.15.73:45420) 2023-12-12T09:43:52.363 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:52.361+0000 7fd36b7fe640 1 -- 172.21.15.73:0/4283537172 learned_addr learned my addr 172.21.15.73:0/4283537172 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:43:52.363 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:52.361+0000 7fd36affd640 1 --2- 172.21.15.73:0/4283537172 >> v2:172.21.15.142:3300/0 conn(0x7fd36c14f8c0 0x7fd36c06dc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:52.363 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:52.362+0000 7fd36b7fe640 1 -- 172.21.15.73:0/4283537172 >> v2:172.21.15.142:3300/0 conn(0x7fd36c14f8c0 msgr2=0x7fd36c06dc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:43:52.364 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:52.362+0000 7fd36b7fe640 1 --2- 172.21.15.73:0/4283537172 >> v2:172.21.15.142:3300/0 conn(0x7fd36c14f8c0 0x7fd36c06dc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:52.364 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:52.362+0000 7fd36b7fe640 1 -- 172.21.15.73:0/4283537172 >> v1:172.21.15.142:6789/0 conn(0x7fd36c06d350 legacy=0x7fd36c071e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:43:52.364 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:52.362+0000 7fd36b7fe640 1 -- 172.21.15.73:0/4283537172 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd36c0c19a0 con 0x7fd36c152500 2023-12-12T09:43:52.364 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:52.362+0000 7fd36affd640 1 --2- 172.21.15.73:0/4283537172 >> v2:172.21.15.142:3300/0 conn(0x7fd36c14f8c0 0x7fd36c06dc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:43:52.366 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:52.363+0000 7fd36b7fe640 1 --2- 172.21.15.73:0/4283537172 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd36c152500 0x7fd36c152990 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fd36c0c34b0 tx=0x7fd36402bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8500c28855c62748 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:43:52.366 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:52.363+0000 7fd36a7fc640 1 -- 172.21.15.73:0/4283537172 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd36402ca80 con 0x7fd36c152500 2023-12-12T09:43:52.366 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:52.363+0000 7fd36a7fc640 1 -- 172.21.15.73:0/4283537172 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd36402cbe0 con 0x7fd36c152500 2023-12-12T09:43:52.366 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:52.363+0000 7fd36a7fc640 1 -- 172.21.15.73:0/4283537172 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3640343f0 con 0x7fd36c152500 2023-12-12T09:43:52.366 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:52.364+0000 7fd37167c640 1 -- 172.21.15.73:0/4283537172 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd36c152500 msgr2=0x7fd36c152990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:52.366 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:52.364+0000 7fd37167c640 1 --2- 172.21.15.73:0/4283537172 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd36c152500 0x7fd36c152990 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fd36c0c34b0 tx=0x7fd36402bee0 comp rx=0 tx=0).stop 2023-12-12T09:43:52.366 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:52.364+0000 7fd37167c640 1 -- 172.21.15.73:0/4283537172 shutdown_connections 2023-12-12T09:43:52.366 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:52.364+0000 7fd37167c640 1 --2- 172.21.15.73:0/4283537172 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd36c152500 0x7fd36c152990 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:52.366 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:52.364+0000 7fd37167c640 1 --2- 172.21.15.73:0/4283537172 >> v2:172.21.15.142:3300/0 conn(0x7fd36c14f8c0 0x7fd36c06dc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:52.367 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:52.364+0000 7fd37167c640 1 -- 172.21.15.73:0/4283537172 >> 172.21.15.73:0/4283537172 conn(0x7fd36c06a4e0 msgr2=0x7fd36c06a8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:43:52.367 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:52.364+0000 7fd37167c640 1 -- 172.21.15.73:0/4283537172 shutdown_connections 2023-12-12T09:43:52.367 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:52.364+0000 7fd37167c640 1 -- 172.21.15.73:0/4283537172 wait complete. 2023-12-12T09:43:52.367 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:52.366+0000 7fd37167c640 1 Processor -- start 2023-12-12T09:43:52.367 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:52.366+0000 7fd37167c640 1 -- start start 2023-12-12T09:43:52.369 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:52.367+0000 7fd37167c640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd36c06d350 0x7fd36c151a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:52.369 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:52.367+0000 7fd37167c640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd36c14f8c0 0x7fd36c154090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:52.369 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:52.367+0000 7fd37167c640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd36c152500 0x7fd36c1481b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:52.369 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:52.367+0000 7fd37167c640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd36c1e8320 con 0x7fd36c152500 2023-12-12T09:43:52.369 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:52.367+0000 7fd37167c640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd36c1e8880 con 0x7fd36c06d350 2023-12-12T09:43:52.369 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:52.367+0000 7fd37167c640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd36c150fa0 con 0x7fd36c14f8c0 2023-12-12T09:43:52.369 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:52.367+0000 7fd36b7fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd36c152500 0x7fd36c1481b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:52.370 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:52.367+0000 7fd36b7fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd36c152500 0x7fd36c1481b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:45424/0 (socket says 172.21.15.73:45424) 2023-12-12T09:43:52.370 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:52.367+0000 7fd36b7fe640 1 -- 172.21.15.73:0/2063818071 learned_addr learned my addr 172.21.15.73:0/2063818071 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:43:52.370 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:52.367+0000 7fd36b7fe640 1 -- 172.21.15.73:0/2063818071 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd36c14f8c0 msgr2=0x7fd36c154090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:52.370 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:52.367+0000 7fd36b7fe640 1 --2- 172.21.15.73:0/2063818071 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd36c14f8c0 0x7fd36c154090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:52.370 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:52.367+0000 7fd36b7fe640 1 -- 172.21.15.73:0/2063818071 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd36c06d350 msgr2=0x7fd36c151a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:52.370 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:52.367+0000 7fd36b7fe640 1 --2- 172.21.15.73:0/2063818071 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd36c06d350 0x7fd36c151a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:52.370 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:52.367+0000 7fd36b7fe640 1 -- 172.21.15.73:0/2063818071 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd364009b30 con 0x7fd36c152500 2023-12-12T09:43:52.370 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:52.368+0000 7fd36b7fe640 1 --2- 172.21.15.73:0/2063818071 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd36c152500 0x7fd36c1481b0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fd364036040 tx=0x7fd364004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:43:52.370 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:52.368+0000 7fd3637fe640 1 -- 172.21.15.73:0/2063818071 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd36403e450 con 0x7fd36c152500 2023-12-12T09:43:52.370 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:52.368+0000 7fd3637fe640 1 -- 172.21.15.73:0/2063818071 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd36403e5d0 con 0x7fd36c152500 2023-12-12T09:43:52.370 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:52.368+0000 7fd3637fe640 1 -- 172.21.15.73:0/2063818071 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd36403e980 con 0x7fd36c152500 2023-12-12T09:43:52.370 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:52.368+0000 7fd37167c640 1 -- 172.21.15.73:0/2063818071 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd36c151f80 con 0x7fd36c152500 2023-12-12T09:43:52.370 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:52.368+0000 7fd37167c640 1 -- 172.21.15.73:0/2063818071 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd36c151240 con 0x7fd36c152500 2023-12-12T09:43:52.371 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:52.369+0000 7fd37167c640 1 -- 172.21.15.73:0/2063818071 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd36c067070 con 0x7fd36c152500 2023-12-12T09:43:52.371 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:52.370+0000 7fd3637fe640 1 -- 172.21.15.73:0/2063818071 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fd36402cd50 con 0x7fd36c152500 2023-12-12T09:43:52.372 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:52.371+0000 7fd3637fe640 1 --2- 172.21.15.73:0/2063818071 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fd34c06ae40 0x7fd34c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:52.372 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:52.371+0000 7fd3637fe640 1 -- 172.21.15.73:0/2063818071 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd3640ac250 con 0x7fd36c152500 2023-12-12T09:43:52.372 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:52.371+0000 7fd36affd640 1 --2- 172.21.15.73:0/2063818071 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fd34c06ae40 0x7fd34c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:52.373 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:52.372+0000 7fd36affd640 1 --2- 172.21.15.73:0/2063818071 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fd34c06ae40 0x7fd34c06d300 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fd35c006fd0 tx=0x7fd35c008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:43:52.377 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:52.376+0000 7fd3637fe640 1 -- 172.21.15.73:0/2063818071 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fd3640772f0 con 0x7fd36c152500 2023-12-12T09:43:52.566 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:52.565+0000 7fd37167c640 1 -- 172.21.15.73:0/2063818071 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fd36c067b10 con 0x7fd36c152500 2023-12-12T09:43:52.567 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:52.566+0000 7fd3637fe640 1 -- 172.21.15.73:0/2063818071 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7fd36407a910 con 0x7fd36c152500 2023-12-12T09:43:52.567 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 64 2023-12-12T09:43:52.570 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:52.568+0000 7fd37167c640 1 -- 172.21.15.73:0/2063818071 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fd34c06ae40 msgr2=0x7fd34c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:52.570 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:52.568+0000 7fd37167c640 1 --2- 172.21.15.73:0/2063818071 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fd34c06ae40 0x7fd34c06d300 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fd35c006fd0 tx=0x7fd35c008040 comp rx=0 tx=0).stop 2023-12-12T09:43:52.570 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:52.568+0000 7fd37167c640 1 -- 172.21.15.73:0/2063818071 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd36c152500 msgr2=0x7fd36c1481b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:52.570 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:52.568+0000 7fd37167c640 1 --2- 172.21.15.73:0/2063818071 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd36c152500 0x7fd36c1481b0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fd364036040 tx=0x7fd364004a40 comp rx=0 tx=0).stop 2023-12-12T09:43:52.570 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:52.568+0000 7fd37167c640 1 -- 172.21.15.73:0/2063818071 shutdown_connections 2023-12-12T09:43:52.570 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:52.568+0000 7fd37167c640 1 --2- 172.21.15.73:0/2063818071 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fd34c06ae40 0x7fd34c06d300 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:52.570 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:52.568+0000 7fd37167c640 1 --2- 172.21.15.73:0/2063818071 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd36c152500 0x7fd36c1481b0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:52.570 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:52.568+0000 7fd37167c640 1 --2- 172.21.15.73:0/2063818071 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd36c14f8c0 0x7fd36c154090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:52.570 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:52.568+0000 7fd37167c640 1 --2- 172.21.15.73:0/2063818071 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd36c06d350 0x7fd36c151a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:52.570 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:52.568+0000 7fd37167c640 1 -- 172.21.15.73:0/2063818071 >> 172.21.15.73:0/2063818071 conn(0x7fd36c06a4e0 msgr2=0x7fd36c14d0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:43:52.571 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:52.569+0000 7fd37167c640 1 -- 172.21.15.73:0/2063818071 shutdown_connections 2023-12-12T09:43:52.571 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:52.569+0000 7fd37167c640 1 -- 172.21.15.73:0/2063818071 wait complete. 2023-12-12T09:43:52.589 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-12T09:43:52.800 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:52.799+0000 7f50927be640 1 Processor -- start 2023-12-12T09:43:52.800 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:52.799+0000 7f50927be640 1 -- start start 2023-12-12T09:43:52.802 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:52.801+0000 7f50927be640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f508c06a4e0 0x7f508c06a8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:52.802 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:52.801+0000 7f50927be640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f508c158c00 con 0x7f508c0a5040 2023-12-12T09:43:52.802 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:52.801+0000 7f50927be640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f508c0c4d00 con 0x7f508c06bf90 2023-12-12T09:43:52.802 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:52.801+0000 7f50927be640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f508c06c400 con 0x7f508c06a4e0 2023-12-12T09:43:52.802 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:52.801+0000 7f508bfff640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f508c0a5040 0x7f508c0c3ad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:50076/0 (socket says 172.21.15.73:50076) 2023-12-12T09:43:52.802 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:52.801+0000 7f508bfff640 1 -- 172.21.15.73:0/1703817953 learned_addr learned my addr 172.21.15.73:0/1703817953 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-12T09:43:52.804 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:52.801+0000 7f508b7fe640 1 -- 172.21.15.73:0/1703817953 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 976155728 0 0) 0x7f508c158c00 con 0x7f508c0a5040 2023-12-12T09:43:52.804 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:52.801+0000 7f5090d5b640 1 --2- 172.21.15.73:0/1703817953 >> v2:172.21.15.142:3300/0 conn(0x7f508c06a4e0 0x7f508c06a8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:52.804 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:52.802+0000 7f508b7fe640 1 -- 172.21.15.73:0/1703817953 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5078003520 con 0x7f508c0a5040 2023-12-12T09:43:52.804 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:52.802+0000 7f508b7fe640 1 -- 172.21.15.73:0/1703817953 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1104902746 0 0) 0x7f5078003520 con 0x7f508c0a5040 2023-12-12T09:43:52.804 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:52.802+0000 7f508b7fe640 1 -- 172.21.15.73:0/1703817953 >> v2:172.21.15.142:3300/0 conn(0x7f508c06a4e0 msgr2=0x7f508c06a8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:43:52.805 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:52.802+0000 7f508b7fe640 1 --2- 172.21.15.73:0/1703817953 >> v2:172.21.15.142:3300/0 conn(0x7f508c06a4e0 0x7f508c06a8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:52.805 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:52.802+0000 7f508b7fe640 1 -- 172.21.15.73:0/1703817953 >> v1:172.21.15.142:6789/0 conn(0x7f508c06bf90 legacy=0x7f508c1584f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:52.805 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:52.802+0000 7f508b7fe640 1 -- 172.21.15.73:0/1703817953 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f508c0c5100 con 0x7f508c0a5040 2023-12-12T09:43:52.805 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:52.802+0000 7f508b7fe640 1 -- 172.21.15.73:0/1703817953 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3186547832 0 0) 0x7f507c001670 con 0x7f508c0a5040 2023-12-12T09:43:52.805 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:52.802+0000 7f508b7fe640 1 -- 172.21.15.73:0/1703817953 >> v1:172.21.15.73:6789/0 conn(0x7f508c0a5040 legacy=0x7f508c0c3ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:52.805 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:52.802+0000 7f508b7fe640 1 --2- 172.21.15.73:0/1703817953 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5078003970 0x7f5078003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:52.805 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:52.802+0000 7f508b7fe640 1 --2- 172.21.15.73:0/1703817953 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f50780047c0 0x7f5078004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:52.805 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:52.802+0000 7f508b7fe640 1 --2- 172.21.15.73:0/1703817953 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5078005180 0x7f507800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:52.805 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:52.802+0000 7f508b7fe640 1 -- 172.21.15.73:0/1703817953 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f508c06c400 con 0x7f5078005180 2023-12-12T09:43:52.805 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:52.802+0000 7f508b7fe640 1 -- 172.21.15.73:0/1703817953 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f507800c0b0 con 0x7f5078003970 2023-12-12T09:43:52.805 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:52.802+0000 7f508b7fe640 1 -- 172.21.15.73:0/1703817953 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f507800c270 con 0x7f50780047c0 2023-12-12T09:43:52.805 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:52.802+0000 7f5090d5b640 1 --2- 172.21.15.73:0/1703817953 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5078005180 0x7f507800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:52.805 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:52.803+0000 7f508bfff640 1 --2- 172.21.15.73:0/1703817953 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5078003970 0x7f5078003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:52.806 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:52.803+0000 7f50837fe640 1 --2- 172.21.15.73:0/1703817953 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f50780047c0 0x7f5078004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:52.806 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:52.803+0000 7f5090d5b640 1 -- 172.21.15.73:0/1703817953 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f50780047c0 msgr2=0x7f5078004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:43:52.806 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:52.803+0000 7f5090d5b640 1 --2- 172.21.15.73:0/1703817953 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f50780047c0 0x7f5078004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:52.806 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:52.803+0000 7f5090d5b640 1 -- 172.21.15.73:0/1703817953 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5078003970 msgr2=0x7f5078003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:43:52.806 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:52.803+0000 7f5090d5b640 1 --2- 172.21.15.73:0/1703817953 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5078003970 0x7f5078003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:52.806 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:52.803+0000 7f5090d5b640 1 -- 172.21.15.73:0/1703817953 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5078003520 con 0x7f5078005180 2023-12-12T09:43:52.806 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:52.803+0000 7f508bfff640 1 --2- 172.21.15.73:0/1703817953 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5078003970 0x7f5078003d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-12T09:43:52.807 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:52.804+0000 7f5090d5b640 1 -- 172.21.15.73:0/1703817953 reap_dead start 2023-12-12T09:43:52.807 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:52.804+0000 7f5090d5b640 1 --2- 172.21.15.73:0/1703817953 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5078005180 0x7f507800b980 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f5084007360 tx=0x7f50780057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9bdf0f14b3348680 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:43:52.807 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:52.805+0000 7f508b7fe640 1 -- 172.21.15.73:0/1703817953 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f508402ccf0 con 0x7f5078005180 2023-12-12T09:43:52.807 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:52.805+0000 7f508b7fe640 1 -- 172.21.15.73:0/1703817953 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f508402ce90 con 0x7f5078005180 2023-12-12T09:43:52.807 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:52.805+0000 7f508b7fe640 1 -- 172.21.15.73:0/1703817953 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5084003bd0 con 0x7f5078005180 2023-12-12T09:43:52.807 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:52.805+0000 7f50927be640 1 -- 172.21.15.73:0/1703817953 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5078005180 msgr2=0x7f507800b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:52.808 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:52.805+0000 7f50927be640 1 --2- 172.21.15.73:0/1703817953 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5078005180 0x7f507800b980 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f5084007360 tx=0x7f50780057f0 comp rx=0 tx=0).stop 2023-12-12T09:43:52.808 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:52.805+0000 7f50927be640 1 -- 172.21.15.73:0/1703817953 shutdown_connections 2023-12-12T09:43:52.808 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:52.806+0000 7f50927be640 1 --2- 172.21.15.73:0/1703817953 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5078005180 0x7f507800b980 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:52.808 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:52.806+0000 7f50927be640 1 -- 172.21.15.73:0/1703817953 >> 172.21.15.73:0/1703817953 conn(0x7f508c0a8130 msgr2=0x7f508c0c24b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:43:52.808 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:52.806+0000 7f50927be640 1 -- 172.21.15.73:0/1703817953 shutdown_connections 2023-12-12T09:43:52.808 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:52.806+0000 7f50927be640 1 -- 172.21.15.73:0/1703817953 wait complete. 2023-12-12T09:43:52.808 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:52.808+0000 7f50927be640 1 Processor -- start 2023-12-12T09:43:52.809 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:52.808+0000 7f50927be640 1 -- start start 2023-12-12T09:43:52.811 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:52.809+0000 7f50927be640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5078005180 0x7f508c153d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:52.811 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:52.809+0000 7f50927be640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f508c071b10 0x7f508c141a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:52.812 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:52.809+0000 7f50927be640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f508c0714c0 0x7f508c141fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:52.812 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:52.809+0000 7f50927be640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f508c1ee120 con 0x7f508c071b10 2023-12-12T09:43:52.812 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:52.809+0000 7f50927be640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f508c1edba0 con 0x7f508c0714c0 2023-12-12T09:43:52.812 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:52.809+0000 7f50927be640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f508c1ede40 con 0x7f5078005180 2023-12-12T09:43:52.812 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:52.809+0000 7f50837fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f508c071b10 0x7f508c141a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:52.812 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:52.809+0000 7f50837fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f508c071b10 0x7f508c141a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:45430/0 (socket says 172.21.15.73:45430) 2023-12-12T09:43:52.812 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:52.809+0000 7f50837fe640 1 -- 172.21.15.73:0/57098238 learned_addr learned my addr 172.21.15.73:0/57098238 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:43:52.812 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:52.810+0000 7f508bfff640 1 --2- 172.21.15.73:0/57098238 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5078005180 0x7f508c153d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:52.812 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:52.810+0000 7f50837fe640 1 -- 172.21.15.73:0/57098238 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5078005180 msgr2=0x7f508c153d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:52.812 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:52.810+0000 7f50837fe640 1 --2- 172.21.15.73:0/57098238 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5078005180 0x7f508c153d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:52.812 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:52.810+0000 7f50837fe640 1 -- 172.21.15.73:0/57098238 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f508c0714c0 msgr2=0x7f508c141fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:52.813 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:52.810+0000 7f50837fe640 1 --2- 172.21.15.73:0/57098238 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f508c0714c0 0x7f508c141fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:52.813 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:52.810+0000 7f50837fe640 1 -- 172.21.15.73:0/57098238 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f508c0a8e40 con 0x7f508c071b10 2023-12-12T09:43:52.813 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:52.810+0000 7f50837fe640 1 --2- 172.21.15.73:0/57098238 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f508c071b10 0x7f508c141a60 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f507400e480 tx=0x7f507400e940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:43:52.813 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:52.810+0000 7f50897fa640 1 -- 172.21.15.73:0/57098238 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50740052e0 con 0x7f508c071b10 2023-12-12T09:43:52.813 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:52.810+0000 7f50897fa640 1 -- 172.21.15.73:0/57098238 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5074005440 con 0x7f508c071b10 2023-12-12T09:43:52.813 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:52.810+0000 7f50927be640 1 -- 172.21.15.73:0/57098238 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f508c0a9120 con 0x7f508c071b10 2023-12-12T09:43:52.813 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:52.810+0000 7f50897fa640 1 -- 172.21.15.73:0/57098238 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5074003830 con 0x7f508c071b10 2023-12-12T09:43:52.813 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:52.811+0000 7f50927be640 1 -- 172.21.15.73:0/57098238 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f508c1424e0 con 0x7f508c071b10 2023-12-12T09:43:52.814 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:52.812+0000 7f50927be640 1 -- 172.21.15.73:0/57098238 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f508c0a8ca0 con 0x7f508c071b10 2023-12-12T09:43:52.814 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:52.812+0000 7f50897fa640 1 -- 172.21.15.73:0/57098238 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f5074003990 con 0x7f508c071b10 2023-12-12T09:43:52.815 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:52.813+0000 7f50897fa640 1 --2- 172.21.15.73:0/57098238 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f506c06ae70 0x7f506c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:52.815 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:52.813+0000 7f50897fa640 1 -- 172.21.15.73:0/57098238 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5074089310 con 0x7f508c071b10 2023-12-12T09:43:52.815 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:52.814+0000 7f508bfff640 1 --2- 172.21.15.73:0/57098238 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f506c06ae70 0x7f506c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:52.815 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:52.814+0000 7f508bfff640 1 --2- 172.21.15.73:0/57098238 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f506c06ae70 0x7f506c06d330 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f507c000f60 tx=0x7f507c001150 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:43:52.818 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:52.818+0000 7f50897fa640 1 -- 172.21.15.73:0/57098238 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f508c0a8ca0 con 0x7f508c071b10 2023-12-12T09:43:53.010 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:53.009+0000 7f50927be640 1 -- 172.21.15.73:0/57098238 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f508c0a8ca0 con 0x7f508c071b10 2023-12-12T09:43:53.012 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:53.011+0000 7f50897fa640 1 -- 172.21.15.73:0/57098238 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16517 (secure 0 0 0) 0x7f508c0a8ca0 con 0x7f508c071b10 2023-12-12T09:43:53.012 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-12T09:43:53.012 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":21,"fsid":"ba240992-02b8-4c7e-92f2-27eb29ac433b","created":"2023-12-12T09:43:02.454719+0000","modified":"2023-12-12T09:43:23.219345+0000","last_up_change":"2023-12-12T09:43:13.913440+0000","last_in_change":"2023-12-12T09:43:05.925348+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-12T09:43:15.525508+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-12T09:43:20.004546+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-12T09:43:20.736500+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"dd9074be-dbe2-4c34-9896-a4223d8d3940","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":4047810203},{"type":"v1","addr":"172.21.15.73:6801","nonce":4047810203}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":4047810203},{"type":"v1","addr":"172.21.15.73:6803","nonce":4047810203}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":4047810203},{"type":"v1","addr":"172.21.15.73:6807","nonce":4047810203}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":4047810203},{"type":"v1","addr":"172.21.15.73:6805","nonce":4047810203}]},"public_addr":"172.21.15.73:6801/4047810203","cluster_addr":"172.21.15.73:6803/4047810203","heartbeat_back_addr":"172.21.15.73:6807/4047810203","heartbeat_front_addr":"172.21.15.73:6805/4047810203","state":["exists","up"]},{"osd":1,"uuid":"c4a05052-96d4-4758-a4e1-1a37f1e07fed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":1356058331},{"type":"v1","addr":"172.21.15.73:6824","nonce":1356058331}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":1356058331},{"type":"v1","addr":"172.21.15.73:6827","nonce":1356058331}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":1356058331},{"type":"v1","addr":"172.21.15.73:6831","nonce":1356058331}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":1356058331},{"type":"v1","addr":"172.21.15.73:6829","nonce":1356058331}]},"public_addr":"172.21.15.73:6824/1356058331","cluster_addr":"172.21.15.73:6827/1356058331","heartbeat_back_addr":"172.21.15.73:6831/1356058331","heartbeat_front_addr":"172.21.15.73:6829/1356058331","state":["exists","up"]},{"osd":2,"uuid":"512bc8ac-72c2-40d4-b3d2-d867a92c5213","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":1228903316},{"type":"v1","addr":"172.21.15.73:6817","nonce":1228903316}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":1228903316},{"type":"v1","addr":"172.21.15.73:6819","nonce":1228903316}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6823","nonce":1228903316},{"type":"v1","addr":"172.21.15.73:6825","nonce":1228903316}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":1228903316},{"type":"v1","addr":"172.21.15.73:6821","nonce":1228903316}]},"public_addr":"172.21.15.73:6817/1228903316","cluster_addr":"172.21.15.73:6819/1228903316","heartbeat_back_addr":"172.21.15.73:6825/1228903316","heartbeat_front_addr":"172.21.15.73:6821/1228903316","state":["exists","up"]},{"osd":3,"uuid":"3d1a91e0-42bf-437a-8eae-8d357c8f63a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":1293329670},{"type":"v1","addr":"172.21.15.73:6809","nonce":1293329670}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6810","nonce":1293329670},{"type":"v1","addr":"172.21.15.73:6811","nonce":1293329670}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":1293329670},{"type":"v1","addr":"172.21.15.73:6815","nonce":1293329670}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":1293329670},{"type":"v1","addr":"172.21.15.73:6813","nonce":1293329670}]},"public_addr":"172.21.15.73:6809/1293329670","cluster_addr":"172.21.15.73:6811/1293329670","heartbeat_back_addr":"172.21.15.73:6815/1293329670","heartbeat_front_addr":"172.21.15.73:6813/1293329670","state":["exists","up"]},{"osd":4,"uuid":"4b302fff-834c-4069-ac19-00e46f6c87b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":3727975702},{"type":"v1","addr":"172.21.15.142:6801","nonce":3727975702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":3727975702},{"type":"v1","addr":"172.21.15.142:6803","nonce":3727975702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6809","nonce":3727975702},{"type":"v1","addr":"172.21.15.142:6811","nonce":3727975702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6805","nonce":3727975702},{"type":"v1","addr":"172.21.15.142:6807","nonce":3727975702}]},"public_addr":"172.21.15.142:6801/3727975702","cluster_addr":"172.21.15.142:6803/3727975702","heartbeat_back_addr":"172.21.15.142:6811/3727975702","heartbeat_front_addr":"172.21.15.142:6807/3727975702","state":["exists","up"]},{"osd":5,"uuid":"d7cdace2-67d0-45cc-95f2-515cf6ef1b82","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6817","nonce":2353193632},{"type":"v1","addr":"172.21.15.142:6819","nonce":2353193632}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6821","nonce":2353193632},{"type":"v1","addr":"172.21.15.142:6823","nonce":2353193632}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6829","nonce":2353193632},{"type":"v1","addr":"172.21.15.142:6831","nonce":2353193632}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6825","nonce":2353193632},{"type":"v1","addr":"172.21.15.142:6827","nonce":2353193632}]},"public_addr":"172.21.15.142:6819/2353193632","cluster_addr":"172.21.15.142:6823/2353193632","heartbeat_back_addr":"172.21.15.142:6831/2353193632","heartbeat_front_addr":"172.21.15.142:6827/2353193632","state":["exists","up"]},{"osd":6,"uuid":"649ce78a-5626-445c-aedc-a651ed05a6f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":2006111986},{"type":"v1","addr":"172.21.15.142:6806","nonce":2006111986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":2006111986},{"type":"v1","addr":"172.21.15.142:6810","nonce":2006111986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":2006111986},{"type":"v1","addr":"172.21.15.142:6815","nonce":2006111986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":2006111986},{"type":"v1","addr":"172.21.15.142:6813","nonce":2006111986}]},"public_addr":"172.21.15.142:6806/2006111986","cluster_addr":"172.21.15.142:6810/2006111986","heartbeat_back_addr":"172.21.15.142:6815/2006111986","heartbeat_front_addr":"172.21.15.142:6813/2006111986","state":["exists","up"]},{"osd":7,"uuid":"af15ae3b-c1d0-4acf-92db-8a1805494d13","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":2573794341},{"type":"v1","addr":"172.21.15.142:6818","nonce":2573794341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":2573794341},{"type":"v1","addr":"172.21.15.142:6822","nonce":2573794341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":2573794341},{"type":"v1","addr":"172.21.15.142:6830","nonce":2573794341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":2573794341},{"type":"v1","addr":"172.21.15.142:6826","nonce":2573794341}]},"public_addr":"172.21.15.142:6818/2573794341","cluster_addr":"172.21.15.142:6822/2573794341","heartbeat_back_addr":"172.21.15.142:6830/2573794341","heartbeat_front_addr":"172.21.15.142:6826/2573794341","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.185824+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.262103+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.225556+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:10.523459+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:10.706035+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.257339+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.301776+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.051960+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-12T09:43:53.015 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:53.014+0000 7f50927be640 1 -- 172.21.15.73:0/57098238 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f506c06ae70 msgr2=0x7f506c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:53.015 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:53.014+0000 7f50927be640 1 --2- 172.21.15.73:0/57098238 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f506c06ae70 0x7f506c06d330 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f507c000f60 tx=0x7f507c001150 comp rx=0 tx=0).stop 2023-12-12T09:43:53.015 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:53.014+0000 7f50927be640 1 -- 172.21.15.73:0/57098238 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f508c071b10 msgr2=0x7f508c141a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:53.015 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:53.014+0000 7f50927be640 1 --2- 172.21.15.73:0/57098238 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f508c071b10 0x7f508c141a60 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f507400e480 tx=0x7f507400e940 comp rx=0 tx=0).stop 2023-12-12T09:43:53.015 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:53.014+0000 7f50927be640 1 -- 172.21.15.73:0/57098238 shutdown_connections 2023-12-12T09:43:53.015 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:53.014+0000 7f50927be640 1 --2- 172.21.15.73:0/57098238 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f506c06ae70 0x7f506c06d330 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:53.016 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:53.014+0000 7f50927be640 1 --2- 172.21.15.73:0/57098238 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f508c0714c0 0x7f508c141fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:53.016 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:53.014+0000 7f50927be640 1 --2- 172.21.15.73:0/57098238 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f508c071b10 0x7f508c141a60 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:53.016 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:53.014+0000 7f50927be640 1 --2- 172.21.15.73:0/57098238 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5078005180 0x7f508c153d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:53.016 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:53.014+0000 7f50927be640 1 -- 172.21.15.73:0/57098238 >> 172.21.15.73:0/57098238 conn(0x7f508c0a8130 msgr2=0x7f508c073310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:43:53.016 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:53.014+0000 7f50927be640 1 -- 172.21.15.73:0/57098238 shutdown_connections 2023-12-12T09:43:53.016 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:53.014+0000 7f50927be640 1 -- 172.21.15.73:0/57098238 wait complete. 2023-12-12T09:43:53.034 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-12T09:43:15.525508+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-12T09:43:20.004546+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-12T09:43:20.736500+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-12T09:43:53.035 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-12T09:43:53.256 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:53.254+0000 7f6a9b400640 1 Processor -- start 2023-12-12T09:43:53.256 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:53.255+0000 7f6a9b400640 1 -- start start 2023-12-12T09:43:53.257 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:53.256+0000 7f6a9b400640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f6a9414ea60 0x7f6a940c5420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:53.257 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:53.256+0000 7f6a9b400640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6a940a4c90 0x7f6a940c0320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:53.257 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:53.256+0000 7f6a9b400640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f6a940c4420 0x7f6a940c20b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:53.257 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:53.256+0000 7f6a9b400640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a940c3390 con 0x7f6a9414ea60 2023-12-12T09:43:53.258 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:53.256+0000 7f6a9b400640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a94151e60 con 0x7f6a940c4420 2023-12-12T09:43:53.258 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:53.256+0000 7f6a9b400640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a94152140 con 0x7f6a940a4c90 2023-12-12T09:43:53.258 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:53.256+0000 7f6a9919c640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f6a9414ea60 0x7f6a940c5420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:53.258 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:53.256+0000 7f6a9919c640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f6a9414ea60 0x7f6a940c5420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:45440/0 (socket says 172.21.15.73:45440) 2023-12-12T09:43:53.258 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:53.256+0000 7f6a9919c640 1 -- 172.21.15.73:0/72616294 learned_addr learned my addr 172.21.15.73:0/72616294 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:43:53.258 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:53.256+0000 7f6a9919c640 1 -- 172.21.15.73:0/72616294 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6a940a4c90 msgr2=0x7f6a940c0320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:43:53.258 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:53.256+0000 7f6a9919c640 1 --2- 172.21.15.73:0/72616294 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6a940a4c90 0x7f6a940c0320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:53.258 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:53.256+0000 7f6a9919c640 1 -- 172.21.15.73:0/72616294 >> v2:172.21.15.142:3300/0 conn(0x7f6a940c4420 msgr2=0x7f6a940c20b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:43:53.258 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:53.256+0000 7f6a9919c640 1 --2- 172.21.15.73:0/72616294 >> v2:172.21.15.142:3300/0 conn(0x7f6a940c4420 0x7f6a940c20b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:53.258 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:53.256+0000 7f6a9919c640 1 -- 172.21.15.73:0/72616294 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a940c3940 con 0x7f6a9414ea60 2023-12-12T09:43:53.260 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:53.257+0000 7f6a9919c640 1 --2- 172.21.15.73:0/72616294 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6a9414ea60 0x7f6a940c5420 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f6a9406b5a0 tx=0x7f6a8402be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63f3dffdb01f268c server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:43:53.260 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:53.258+0000 7f6a93fff640 1 -- 172.21.15.73:0/72616294 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a8402c9e0 con 0x7f6a9414ea60 2023-12-12T09:43:53.260 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:53.258+0000 7f6a93fff640 1 -- 172.21.15.73:0/72616294 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a8402cb40 con 0x7f6a9414ea60 2023-12-12T09:43:53.260 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:53.258+0000 7f6a93fff640 1 -- 172.21.15.73:0/72616294 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a840343f0 con 0x7f6a9414ea60 2023-12-12T09:43:53.260 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:53.258+0000 7f6a9b400640 1 -- 172.21.15.73:0/72616294 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6a9414ea60 msgr2=0x7f6a940c5420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:53.260 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:53.258+0000 7f6a9b400640 1 --2- 172.21.15.73:0/72616294 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6a9414ea60 0x7f6a940c5420 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f6a9406b5a0 tx=0x7f6a8402be40 comp rx=0 tx=0).stop 2023-12-12T09:43:53.260 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:53.258+0000 7f6a9b400640 1 -- 172.21.15.73:0/72616294 shutdown_connections 2023-12-12T09:43:53.260 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:53.258+0000 7f6a9b400640 1 --2- 172.21.15.73:0/72616294 >> v2:172.21.15.142:3300/0 conn(0x7f6a940c4420 0x7f6a940c20b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:53.260 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:53.258+0000 7f6a9b400640 1 --2- 172.21.15.73:0/72616294 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6a940a4c90 0x7f6a940c0320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:53.260 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:53.258+0000 7f6a9b400640 1 --2- 172.21.15.73:0/72616294 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6a9414ea60 0x7f6a940c5420 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:53.260 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:53.259+0000 7f6a9b400640 1 -- 172.21.15.73:0/72616294 >> 172.21.15.73:0/72616294 conn(0x7f6a9406a4e0 msgr2=0x7f6a9406a8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:43:53.260 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:53.259+0000 7f6a9b400640 1 -- 172.21.15.73:0/72616294 shutdown_connections 2023-12-12T09:43:53.261 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:53.259+0000 7f6a9b400640 1 -- 172.21.15.73:0/72616294 wait complete. 2023-12-12T09:43:53.261 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:53.260+0000 7f6a9b400640 1 Processor -- start 2023-12-12T09:43:53.261 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:53.260+0000 7f6a9b400640 1 -- start start 2023-12-12T09:43:53.264 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:53.261+0000 7f6a9b400640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6a940a4c90 0x7f6a9414a900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:53.264 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:53.261+0000 7f6a9b400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6a940c4420 0x7f6a941ea240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:53.264 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:53.261+0000 7f6a9b400640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6a9414ea60 0x7f6a941ea780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:53.264 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:53.261+0000 7f6a9b400640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a9414b270 con 0x7f6a940c4420 2023-12-12T09:43:53.264 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:53.261+0000 7f6a9b400640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a940a9550 con 0x7f6a940a4c90 2023-12-12T09:43:53.264 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:53.261+0000 7f6a9b400640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a941eacc0 con 0x7f6a9414ea60 2023-12-12T09:43:53.264 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:53.262+0000 7f6a9899b640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6a940c4420 0x7f6a941ea240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:53.264 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:53.262+0000 7f6a9899b640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6a940c4420 0x7f6a941ea240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:45444/0 (socket says 172.21.15.73:45444) 2023-12-12T09:43:53.264 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:53.262+0000 7f6a9899b640 1 -- 172.21.15.73:0/3534768292 learned_addr learned my addr 172.21.15.73:0/3534768292 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:43:53.264 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:53.262+0000 7f6a9899b640 1 -- 172.21.15.73:0/3534768292 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6a9414ea60 msgr2=0x7f6a941ea780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:53.264 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:53.262+0000 7f6a9899b640 1 --2- 172.21.15.73:0/3534768292 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6a9414ea60 0x7f6a941ea780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:53.264 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:53.262+0000 7f6a9899b640 1 -- 172.21.15.73:0/3534768292 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6a940a4c90 msgr2=0x7f6a9414a900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:53.264 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:53.262+0000 7f6a9899b640 1 --2- 172.21.15.73:0/3534768292 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6a940a4c90 0x7f6a9414a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:53.265 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:53.262+0000 7f6a9899b640 1 -- 172.21.15.73:0/3534768292 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a84009b30 con 0x7f6a940c4420 2023-12-12T09:43:53.265 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:53.262+0000 7f6a9899b640 1 --2- 172.21.15.73:0/3534768292 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6a940c4420 0x7f6a941ea240 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f6a8800b4a0 tx=0x7f6a8800b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:43:53.265 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:53.263+0000 7f6a91ffb640 1 -- 172.21.15.73:0/3534768292 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a88010610 con 0x7f6a940c4420 2023-12-12T09:43:53.265 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:53.263+0000 7f6a91ffb640 1 -- 172.21.15.73:0/3534768292 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a88010770 con 0x7f6a940c4420 2023-12-12T09:43:53.265 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:53.263+0000 7f6a91ffb640 1 -- 172.21.15.73:0/3534768292 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a88010b20 con 0x7f6a940c4420 2023-12-12T09:43:53.265 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:53.263+0000 7f6a9b400640 1 -- 172.21.15.73:0/3534768292 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a940a8a30 con 0x7f6a940c4420 2023-12-12T09:43:53.265 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:53.263+0000 7f6a9b400640 1 -- 172.21.15.73:0/3534768292 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a940a8f70 con 0x7f6a940c4420 2023-12-12T09:43:53.265 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:53.264+0000 7f6a9b400640 1 -- 172.21.15.73:0/3534768292 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a94067070 con 0x7f6a940c4420 2023-12-12T09:43:53.266 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:53.265+0000 7f6a91ffb640 1 -- 172.21.15.73:0/3534768292 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f6a88010c80 con 0x7f6a940c4420 2023-12-12T09:43:53.266 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:53.266+0000 7f6a91ffb640 1 --2- 172.21.15.73:0/3534768292 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f6a8006ae70 0x7f6a8006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:53.267 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:53.266+0000 7f6a9919c640 1 --2- 172.21.15.73:0/3534768292 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f6a8006ae70 0x7f6a8006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:53.267 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:53.267+0000 7f6a9919c640 1 --2- 172.21.15.73:0/3534768292 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f6a8006ae70 0x7f6a8006d330 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f6a84035000 tx=0x7f6a8402e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:43:53.268 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:53.267+0000 7f6a91ffb640 1 -- 172.21.15.73:0/3534768292 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6a880586a0 con 0x7f6a940c4420 2023-12-12T09:43:53.273 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:53.272+0000 7f6a91ffb640 1 -- 172.21.15.73:0/3534768292 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f6a880542e0 con 0x7f6a940c4420 2023-12-12T09:43:53.465 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:53.464+0000 7f6a9b400640 1 -- 172.21.15.73:0/3534768292 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f6a94067580 con 0x7f6a940c4420 2023-12-12T09:43:53.466 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:53.465+0000 7f6a91ffb640 1 -- 172.21.15.73:0/3534768292 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7f6a8801e0a0 con 0x7f6a940c4420 2023-12-12T09:43:53.467 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 1 2023-12-12T09:43:53.470 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:53.468+0000 7f6a9b400640 1 -- 172.21.15.73:0/3534768292 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f6a8006ae70 msgr2=0x7f6a8006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:53.470 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:53.468+0000 7f6a9b400640 1 --2- 172.21.15.73:0/3534768292 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f6a8006ae70 0x7f6a8006d330 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f6a84035000 tx=0x7f6a8402e000 comp rx=0 tx=0).stop 2023-12-12T09:43:53.470 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:53.468+0000 7f6a9b400640 1 -- 172.21.15.73:0/3534768292 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6a940c4420 msgr2=0x7f6a941ea240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:53.470 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:53.468+0000 7f6a9b400640 1 --2- 172.21.15.73:0/3534768292 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6a940c4420 0x7f6a941ea240 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f6a8800b4a0 tx=0x7f6a8800b960 comp rx=0 tx=0).stop 2023-12-12T09:43:53.470 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:53.468+0000 7f6a9b400640 1 -- 172.21.15.73:0/3534768292 shutdown_connections 2023-12-12T09:43:53.470 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:53.468+0000 7f6a9b400640 1 --2- 172.21.15.73:0/3534768292 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f6a8006ae70 0x7f6a8006d330 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:53.470 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:53.468+0000 7f6a9b400640 1 --2- 172.21.15.73:0/3534768292 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6a9414ea60 0x7f6a941ea780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:53.470 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:53.468+0000 7f6a9b400640 1 --2- 172.21.15.73:0/3534768292 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6a940c4420 0x7f6a941ea240 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:53.470 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:53.468+0000 7f6a9b400640 1 --2- 172.21.15.73:0/3534768292 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6a940a4c90 0x7f6a9414a900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:53.470 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:53.468+0000 7f6a9b400640 1 -- 172.21.15.73:0/3534768292 >> 172.21.15.73:0/3534768292 conn(0x7f6a9406a4e0 msgr2=0x7f6a9414cfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:43:53.470 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:53.468+0000 7f6a9b400640 1 -- 172.21.15.73:0/3534768292 shutdown_connections 2023-12-12T09:43:53.470 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:53.468+0000 7f6a9b400640 1 -- 172.21.15.73:0/3534768292 wait complete. 2023-12-12T09:43:53.486 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-12T09:43:53.697 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:53.696+0000 7f515ed41640 1 Processor -- start 2023-12-12T09:43:53.698 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:53.696+0000 7f515ed41640 1 -- start start 2023-12-12T09:43:53.699 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:53.698+0000 7f515ed41640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f51580c4750 0x7f515815ff30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:53.699 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:53.698+0000 7f515ed41640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51580c4e20 con 0x7f5158151dd0 2023-12-12T09:43:53.699 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:53.698+0000 7f515ed41640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51580c59a0 con 0x7f51581545a0 2023-12-12T09:43:53.699 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:53.698+0000 7f515ed41640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51580c5070 con 0x7f51580c4750 2023-12-12T09:43:53.699 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:53.698+0000 7f515cadd640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f5158151dd0 0x7f515806ab70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:50086/0 (socket says 172.21.15.73:50086) 2023-12-12T09:43:53.699 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:53.698+0000 7f515cadd640 1 -- 172.21.15.73:0/612003028 learned_addr learned my addr 172.21.15.73:0/612003028 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-12T09:43:53.700 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:53.698+0000 7f515d2de640 1 --2- 172.21.15.73:0/612003028 >> v2:172.21.15.73:3300/0 conn(0x7f51580c4750 0x7f515815ff30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:53.700 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:53.699+0000 7f51577fe640 1 -- 172.21.15.73:0/612003028 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3568285851 0 0) 0x7f51580c4e20 con 0x7f5158151dd0 2023-12-12T09:43:53.700 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:53.699+0000 7f51577fe640 1 -- 172.21.15.73:0/612003028 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5144003520 con 0x7f5158151dd0 2023-12-12T09:43:53.700 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:53.699+0000 7f515d2de640 1 -- 172.21.15.73:0/612003028 >> v1:172.21.15.142:6789/0 conn(0x7f51581545a0 legacy=0x7f51580c5e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:43:53.700 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:53.699+0000 7f515d2de640 1 -- 172.21.15.73:0/612003028 >> v1:172.21.15.73:6789/0 conn(0x7f5158151dd0 legacy=0x7f515806ab70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:53.700 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:53.699+0000 7f515d2de640 1 -- 172.21.15.73:0/612003028 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51580c5350 con 0x7f51580c4750 2023-12-12T09:43:53.701 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:53.700+0000 7f515d2de640 1 --2- 172.21.15.73:0/612003028 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f51580c4750 0x7f515815ff30 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f51500097a0 tx=0x7f515002b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eafd70e99e0de32c server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:43:53.701 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:53.700+0000 7f51577fe640 1 -- 172.21.15.73:0/612003028 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f515002e070 con 0x7f51580c4750 2023-12-12T09:43:53.701 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:53.700+0000 7f51577fe640 1 -- 172.21.15.73:0/612003028 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51500315a0 con 0x7f51580c4750 2023-12-12T09:43:53.701 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:53.700+0000 7f51577fe640 1 -- 172.21.15.73:0/612003028 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5150031930 con 0x7f51580c4750 2023-12-12T09:43:53.702 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:53.701+0000 7f515ed41640 1 -- 172.21.15.73:0/612003028 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f51580c4750 msgr2=0x7f515815ff30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:53.702 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:53.701+0000 7f515ed41640 1 --2- 172.21.15.73:0/612003028 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f51580c4750 0x7f515815ff30 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f51500097a0 tx=0x7f515002b840 comp rx=0 tx=0).stop 2023-12-12T09:43:53.702 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:53.701+0000 7f515ed41640 1 -- 172.21.15.73:0/612003028 shutdown_connections 2023-12-12T09:43:53.702 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:53.701+0000 7f515ed41640 1 --2- 172.21.15.73:0/612003028 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f51580c4750 0x7f515815ff30 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:53.702 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:53.701+0000 7f515ed41640 1 -- 172.21.15.73:0/612003028 >> 172.21.15.73:0/612003028 conn(0x7f51580ab8c0 msgr2=0x7f51580abcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:43:53.703 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:53.701+0000 7f515ed41640 1 -- 172.21.15.73:0/612003028 shutdown_connections 2023-12-12T09:43:53.703 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:53.701+0000 7f515ed41640 1 -- 172.21.15.73:0/612003028 wait complete. 2023-12-12T09:43:53.703 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:53.703+0000 7f515ed41640 1 Processor -- start 2023-12-12T09:43:53.703 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:53.703+0000 7f515ed41640 1 -- start start 2023-12-12T09:43:53.705 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:53.704+0000 7f515ed41640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f51580c4750 0x7f51580c0ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:53.705 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:53.704+0000 7f515ed41640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5158151dd0 0x7f51581ea9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:53.705 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:53.704+0000 7f515ed41640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f51581545a0 0x7f51580c1b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:53.705 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:53.704+0000 7f515ed41640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5158151090 con 0x7f5158151dd0 2023-12-12T09:43:53.705 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:53.704+0000 7f515ed41640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51580c1500 con 0x7f51581545a0 2023-12-12T09:43:53.705 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:53.704+0000 7f515ed41640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51580c38b0 con 0x7f51580c4750 2023-12-12T09:43:53.705 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:53.704+0000 7f5157fff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5158151dd0 0x7f51581ea9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:53.705 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:53.704+0000 7f5157fff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5158151dd0 0x7f51581ea9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:45462/0 (socket says 172.21.15.73:45462) 2023-12-12T09:43:53.705 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:53.704+0000 7f5157fff640 1 -- 172.21.15.73:0/2959767909 learned_addr learned my addr 172.21.15.73:0/2959767909 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:43:53.706 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:53.704+0000 7f515cadd640 1 --2- 172.21.15.73:0/2959767909 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f51580c4750 0x7f51580c0ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:53.707 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:53.704+0000 7f5157fff640 1 -- 172.21.15.73:0/2959767909 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f51580c4750 msgr2=0x7f51580c0ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:53.707 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:53.704+0000 7f515d2de640 1 --2- 172.21.15.73:0/2959767909 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f51581545a0 0x7f51580c1b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:53.707 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:53.704+0000 7f5157fff640 1 --2- 172.21.15.73:0/2959767909 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f51580c4750 0x7f51580c0ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:53.707 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:53.704+0000 7f5157fff640 1 -- 172.21.15.73:0/2959767909 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f51581545a0 msgr2=0x7f51580c1b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:53.707 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:53.704+0000 7f5157fff640 1 --2- 172.21.15.73:0/2959767909 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f51581545a0 0x7f51580c1b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:53.707 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:53.704+0000 7f5157fff640 1 -- 172.21.15.73:0/2959767909 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5150009400 con 0x7f5158151dd0 2023-12-12T09:43:53.707 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:53.704+0000 7f515d2de640 1 --2- 172.21.15.73:0/2959767909 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f51581545a0 0x7f51580c1b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:43:53.707 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:53.705+0000 7f5157fff640 1 --2- 172.21.15.73:0/2959767909 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5158151dd0 0x7f51581ea9b0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f514800ba50 tx=0x7f514800bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:43:53.707 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:53.705+0000 7f51557fa640 1 -- 172.21.15.73:0/2959767909 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f514800cbe0 con 0x7f5158151dd0 2023-12-12T09:43:53.707 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:53.705+0000 7f51557fa640 1 -- 172.21.15.73:0/2959767909 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f514800cd80 con 0x7f5158151dd0 2023-12-12T09:43:53.707 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:53.705+0000 7f51557fa640 1 -- 172.21.15.73:0/2959767909 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5148014680 con 0x7f5158151dd0 2023-12-12T09:43:53.707 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:53.705+0000 7f515ed41640 1 -- 172.21.15.73:0/2959767909 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51580c3b90 con 0x7f5158151dd0 2023-12-12T09:43:53.707 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:53.705+0000 7f515ed41640 1 -- 172.21.15.73:0/2959767909 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51580c2060 con 0x7f5158151dd0 2023-12-12T09:43:53.708 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:53.706+0000 7f515ed41640 1 -- 172.21.15.73:0/2959767909 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5158067580 con 0x7f5158151dd0 2023-12-12T09:43:53.708 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:53.707+0000 7f51557fa640 1 -- 172.21.15.73:0/2959767909 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f51480147e0 con 0x7f5158151dd0 2023-12-12T09:43:53.709 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:53.708+0000 7f51557fa640 1 --2- 172.21.15.73:0/2959767909 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f513806ae40 0x7f513806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:53.709 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:53.708+0000 7f51557fa640 1 -- 172.21.15.73:0/2959767909 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5148089490 con 0x7f5158151dd0 2023-12-12T09:43:53.709 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:53.708+0000 7f515cadd640 1 --2- 172.21.15.73:0/2959767909 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f513806ae40 0x7f513806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:53.710 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:53.709+0000 7f515cadd640 1 --2- 172.21.15.73:0/2959767909 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f513806ae40 0x7f513806d300 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f51580c0e50 tx=0x7f5140009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:43:53.714 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:53.713+0000 7f51557fa640 1 -- 172.21.15.73:0/2959767909 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f51480545e0 con 0x7f5158151dd0 2023-12-12T09:43:53.897 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:53.896+0000 7f515ed41640 1 -- 172.21.15.73:0/2959767909 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f51580bd360 con 0x7f5158151dd0 2023-12-12T09:43:53.898 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:53.897+0000 7f51557fa640 1 -- 172.21.15.73:0/2959767909 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7f5148057c00 con 0x7f5158151dd0 2023-12-12T09:43:53.898 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 32 2023-12-12T09:43:53.900 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:53.899+0000 7f515ed41640 1 -- 172.21.15.73:0/2959767909 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f513806ae40 msgr2=0x7f513806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:53.900 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:53.899+0000 7f515ed41640 1 --2- 172.21.15.73:0/2959767909 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f513806ae40 0x7f513806d300 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f51580c0e50 tx=0x7f5140009040 comp rx=0 tx=0).stop 2023-12-12T09:43:53.900 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:53.899+0000 7f515ed41640 1 -- 172.21.15.73:0/2959767909 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5158151dd0 msgr2=0x7f51581ea9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:53.900 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:53.899+0000 7f515ed41640 1 --2- 172.21.15.73:0/2959767909 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5158151dd0 0x7f51581ea9b0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f514800ba50 tx=0x7f514800bf10 comp rx=0 tx=0).stop 2023-12-12T09:43:53.901 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:53.899+0000 7f515ed41640 1 -- 172.21.15.73:0/2959767909 shutdown_connections 2023-12-12T09:43:53.901 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:53.899+0000 7f515ed41640 1 --2- 172.21.15.73:0/2959767909 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f513806ae40 0x7f513806d300 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:53.901 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:53.899+0000 7f515ed41640 1 --2- 172.21.15.73:0/2959767909 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f51581545a0 0x7f51580c1b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:53.901 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:53.899+0000 7f515ed41640 1 --2- 172.21.15.73:0/2959767909 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5158151dd0 0x7f51581ea9b0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:53.901 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:53.899+0000 7f515ed41640 1 --2- 172.21.15.73:0/2959767909 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f51580c4750 0x7f51580c0ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:53.901 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:53.899+0000 7f515ed41640 1 -- 172.21.15.73:0/2959767909 >> 172.21.15.73:0/2959767909 conn(0x7f51580ab8c0 msgr2=0x7f51580abca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:43:53.901 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:53.899+0000 7f515ed41640 1 -- 172.21.15.73:0/2959767909 shutdown_connections 2023-12-12T09:43:53.901 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:53.899+0000 7f515ed41640 1 -- 172.21.15.73:0/2959767909 wait complete. 2023-12-12T09:43:53.916 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-12T09:43:54.122 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:54.121+0000 7f377d490640 1 Processor -- start 2023-12-12T09:43:54.122 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:54.121+0000 7f377d490640 1 -- start start 2023-12-12T09:43:54.123 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:54.122+0000 7f377d490640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f377806d350 0x7f377806dc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:54.124 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:54.122+0000 7f377d490640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37780c16c0 con 0x7f377814f8c0 2023-12-12T09:43:54.124 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:54.123+0000 7f377d490640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37780c19a0 con 0x7f3778152500 2023-12-12T09:43:54.124 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:54.123+0000 7f377d490640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37780c1090 con 0x7f377806d350 2023-12-12T09:43:54.124 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:54.123+0000 7f3776ffd640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f377814f8c0 0x7f3778071e60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:50096/0 (socket says 172.21.15.73:50096) 2023-12-12T09:43:54.124 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:54.123+0000 7f3776ffd640 1 -- 172.21.15.73:0/3380688849 learned_addr learned my addr 172.21.15.73:0/3380688849 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-12T09:43:54.125 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:54.123+0000 7f37767fc640 1 --2- 172.21.15.73:0/3380688849 >> v2:172.21.15.142:3300/0 conn(0x7f377806d350 0x7f377806dc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:54.126 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:54.123+0000 7f3775ffb640 1 -- 172.21.15.73:0/3380688849 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2803976240 0 0) 0x7f37780c16c0 con 0x7f377814f8c0 2023-12-12T09:43:54.126 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:54.123+0000 7f3775ffb640 1 -- 172.21.15.73:0/3380688849 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3760003520 con 0x7f377814f8c0 2023-12-12T09:43:54.126 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:54.123+0000 7f3775ffb640 1 -- 172.21.15.73:0/3380688849 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2592168303 0 0) 0x7f3760003520 con 0x7f377814f8c0 2023-12-12T09:43:54.126 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:54.124+0000 7f3775ffb640 1 -- 172.21.15.73:0/3380688849 >> v2:172.21.15.142:3300/0 conn(0x7f377806d350 msgr2=0x7f377806dc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:43:54.126 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:54.124+0000 7f3775ffb640 1 --2- 172.21.15.73:0/3380688849 >> v2:172.21.15.142:3300/0 conn(0x7f377806d350 0x7f377806dc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:54.126 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:54.124+0000 7f3775ffb640 1 -- 172.21.15.73:0/3380688849 >> v1:172.21.15.142:6789/0 conn(0x7f3778152500 legacy=0x7f3778152990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:43:54.126 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:54.124+0000 7f3775ffb640 1 -- 172.21.15.73:0/3380688849 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37780c1c80 con 0x7f377814f8c0 2023-12-12T09:43:54.126 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:54.124+0000 7f3775ffb640 1 -- 172.21.15.73:0/3380688849 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3186547832 0 0) 0x7f3768001670 con 0x7f377814f8c0 2023-12-12T09:43:54.126 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:54.124+0000 7f3775ffb640 1 -- 172.21.15.73:0/3380688849 >> v1:172.21.15.73:6789/0 conn(0x7f377814f8c0 legacy=0x7f3778071e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:54.126 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:54.124+0000 7f3775ffb640 1 --2- 172.21.15.73:0/3380688849 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3760003970 0x7f3760003d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:54.126 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:54.124+0000 7f3775ffb640 1 --2- 172.21.15.73:0/3380688849 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f37600047c0 0x7f3760004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:54.126 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:54.124+0000 7f3775ffb640 1 --2- 172.21.15.73:0/3380688849 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3760005180 0x7f376000fd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:54.126 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:54.124+0000 7f3775ffb640 1 -- 172.21.15.73:0/3380688849 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3760010490 con 0x7f3760003970 2023-12-12T09:43:54.127 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:54.124+0000 7f3775ffb640 1 -- 172.21.15.73:0/3380688849 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3760010600 con 0x7f3760005180 2023-12-12T09:43:54.127 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:54.124+0000 7f3775ffb640 1 -- 172.21.15.73:0/3380688849 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37600107c0 con 0x7f37600047c0 2023-12-12T09:43:54.127 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:54.124+0000 7f3776ffd640 1 --2- 172.21.15.73:0/3380688849 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3760003970 0x7f3760003d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:54.127 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:54.124+0000 7f3776ffd640 1 -- 172.21.15.73:0/3380688849 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f37600047c0 msgr2=0x7f3760004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:43:54.127 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:54.124+0000 7f3776ffd640 1 --2- 172.21.15.73:0/3380688849 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f37600047c0 0x7f3760004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:54.127 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:54.124+0000 7f3776ffd640 1 -- 172.21.15.73:0/3380688849 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3760005180 msgr2=0x7f376000fd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:43:54.127 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:54.124+0000 7f3776ffd640 1 --2- 172.21.15.73:0/3380688849 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3760005180 0x7f376000fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:54.127 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:54.124+0000 7f3776ffd640 1 -- 172.21.15.73:0/3380688849 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3760003520 con 0x7f3760003970 2023-12-12T09:43:54.127 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:54.124+0000 7f37777fe640 1 -- 172.21.15.73:0/3380688849 reap_dead start 2023-12-12T09:43:54.128 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:54.125+0000 7f3776ffd640 1 --2- 172.21.15.73:0/3380688849 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3760003970 0x7f3760003d70 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f3768001eb0 tx=0x7f37600057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c202310d33bf2c40 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:43:54.128 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:54.126+0000 7f3775ffb640 1 -- 172.21.15.73:0/3380688849 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3768005ad0 con 0x7f3760003970 2023-12-12T09:43:54.128 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:54.126+0000 7f3775ffb640 1 -- 172.21.15.73:0/3380688849 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3768005c50 con 0x7f3760003970 2023-12-12T09:43:54.128 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:54.126+0000 7f3775ffb640 1 -- 172.21.15.73:0/3380688849 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f376802c8b0 con 0x7f3760003970 2023-12-12T09:43:54.128 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:54.126+0000 7f377d490640 1 -- 172.21.15.73:0/3380688849 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3760003970 msgr2=0x7f3760003d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:54.128 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:54.126+0000 7f377d490640 1 --2- 172.21.15.73:0/3380688849 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3760003970 0x7f3760003d70 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f3768001eb0 tx=0x7f37600057f0 comp rx=0 tx=0).stop 2023-12-12T09:43:54.129 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:54.126+0000 7f377d490640 1 -- 172.21.15.73:0/3380688849 shutdown_connections 2023-12-12T09:43:54.129 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:54.126+0000 7f377d490640 1 --2- 172.21.15.73:0/3380688849 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3760003970 0x7f3760003d70 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:54.129 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:54.126+0000 7f377d490640 1 -- 172.21.15.73:0/3380688849 >> 172.21.15.73:0/3380688849 conn(0x7f377806a4e0 msgr2=0x7f377806a8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:43:54.129 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:54.126+0000 7f377d490640 1 -- 172.21.15.73:0/3380688849 shutdown_connections 2023-12-12T09:43:54.129 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:54.126+0000 7f377d490640 1 -- 172.21.15.73:0/3380688849 wait complete. 2023-12-12T09:43:54.129 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:54.128+0000 7f377d490640 1 Processor -- start 2023-12-12T09:43:54.129 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:54.128+0000 7f377d490640 1 -- start start 2023-12-12T09:43:54.131 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:54.129+0000 7f377d490640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3760003970 0x7f37780a6a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:54.131 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:54.129+0000 7f377d490640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f37781e99c0 0x7f3778151770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:54.131 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:54.129+0000 7f377d490640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3778146120 0x7f37780a5820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:54.131 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:54.129+0000 7f377d490640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f377814b470 con 0x7f3778146120 2023-12-12T09:43:54.131 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:54.129+0000 7f377d490640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37781520e0 con 0x7f37781e99c0 2023-12-12T09:43:54.131 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:54.129+0000 7f377d490640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3778151e00 con 0x7f3760003970 2023-12-12T09:43:54.131 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:54.129+0000 7f37777fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3778146120 0x7f37780a5820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:54.131 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:54.129+0000 7f37777fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3778146120 0x7f37780a5820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:45482/0 (socket says 172.21.15.73:45482) 2023-12-12T09:43:54.131 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:54.129+0000 7f37777fe640 1 -- 172.21.15.73:0/4176766492 learned_addr learned my addr 172.21.15.73:0/4176766492 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:43:54.131 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:54.130+0000 7f3776ffd640 1 --2- 172.21.15.73:0/4176766492 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3760003970 0x7f37780a6a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:54.131 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:54.130+0000 7f37767fc640 1 --2- 172.21.15.73:0/4176766492 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f37781e99c0 0x7f3778151770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:54.131 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:54.130+0000 7f37777fe640 1 -- 172.21.15.73:0/4176766492 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3760003970 msgr2=0x7f37780a6a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:54.131 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:54.130+0000 7f37777fe640 1 --2- 172.21.15.73:0/4176766492 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3760003970 0x7f37780a6a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:54.131 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:54.130+0000 7f37777fe640 1 -- 172.21.15.73:0/4176766492 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f37781e99c0 msgr2=0x7f3778151770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:54.132 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:54.130+0000 7f37777fe640 1 --2- 172.21.15.73:0/4176766492 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f37781e99c0 0x7f3778151770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:54.132 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:54.130+0000 7f37777fe640 1 -- 172.21.15.73:0/4176766492 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37781e8ee0 con 0x7f3778146120 2023-12-12T09:43:54.134 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:54.130+0000 7f37777fe640 1 --2- 172.21.15.73:0/4176766492 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3778146120 0x7f37780a5820 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f37781528e0 tx=0x7f377000c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:43:54.134 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:54.130+0000 7f375f7fe640 1 -- 172.21.15.73:0/4176766492 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37700070d0 con 0x7f3778146120 2023-12-12T09:43:54.135 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:54.130+0000 7f375f7fe640 1 -- 172.21.15.73:0/4176766492 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3770007230 con 0x7f3778146120 2023-12-12T09:43:54.135 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:54.130+0000 7f375f7fe640 1 -- 172.21.15.73:0/4176766492 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37700075e0 con 0x7f3778146120 2023-12-12T09:43:54.135 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:54.130+0000 7f377d490640 1 -- 172.21.15.73:0/4176766492 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37781e91c0 con 0x7f3778146120 2023-12-12T09:43:54.135 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:54.131+0000 7f377d490640 1 -- 172.21.15.73:0/4176766492 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37781465b0 con 0x7f3778146120 2023-12-12T09:43:54.135 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:54.132+0000 7f377d490640 1 -- 172.21.15.73:0/4176766492 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f37781e8d40 con 0x7f3778146120 2023-12-12T09:43:54.135 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:54.132+0000 7f375f7fe640 1 -- 172.21.15.73:0/4176766492 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f3770007740 con 0x7f3778146120 2023-12-12T09:43:54.135 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:54.133+0000 7f375f7fe640 1 --2- 172.21.15.73:0/4176766492 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f376406ae40 0x7f376406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:54.135 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:54.133+0000 7f375f7fe640 1 -- 172.21.15.73:0/4176766492 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3770088b90 con 0x7f3778146120 2023-12-12T09:43:54.135 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:54.134+0000 7f3776ffd640 1 --2- 172.21.15.73:0/4176766492 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f376406ae40 0x7f376406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:54.135 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:54.134+0000 7f3776ffd640 1 --2- 172.21.15.73:0/4176766492 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f376406ae40 0x7f376406d300 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f3768034000 tx=0x7f3768009030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:43:54.139 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:54.138+0000 7f375f7fe640 1 -- 172.21.15.73:0/4176766492 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f37781e8d40 con 0x7f3778146120 2023-12-12T09:43:54.333 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:54.332+0000 7f377d490640 1 -- 172.21.15.73:0/4176766492 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f37781e96e0 con 0x7f3778146120 2023-12-12T09:43:54.334 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:54.333+0000 7f375f7fe640 1 -- 172.21.15.73:0/4176766492 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7f37781e96e0 con 0x7f3778146120 2023-12-12T09:43:54.334 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 64 2023-12-12T09:43:54.337 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:54.335+0000 7f377d490640 1 -- 172.21.15.73:0/4176766492 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f376406ae40 msgr2=0x7f376406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:54.337 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:54.335+0000 7f377d490640 1 --2- 172.21.15.73:0/4176766492 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f376406ae40 0x7f376406d300 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f3768034000 tx=0x7f3768009030 comp rx=0 tx=0).stop 2023-12-12T09:43:54.337 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:54.335+0000 7f377d490640 1 -- 172.21.15.73:0/4176766492 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3778146120 msgr2=0x7f37780a5820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:54.337 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:54.335+0000 7f377d490640 1 --2- 172.21.15.73:0/4176766492 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3778146120 0x7f37780a5820 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f37781528e0 tx=0x7f377000c960 comp rx=0 tx=0).stop 2023-12-12T09:43:54.337 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:54.335+0000 7f377d490640 1 -- 172.21.15.73:0/4176766492 shutdown_connections 2023-12-12T09:43:54.337 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:54.335+0000 7f377d490640 1 --2- 172.21.15.73:0/4176766492 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f376406ae40 0x7f376406d300 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:54.337 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:54.335+0000 7f377d490640 1 --2- 172.21.15.73:0/4176766492 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3778146120 0x7f37780a5820 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:54.337 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:54.335+0000 7f377d490640 1 --2- 172.21.15.73:0/4176766492 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f37781e99c0 0x7f3778151770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:54.337 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:54.335+0000 7f377d490640 1 --2- 172.21.15.73:0/4176766492 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3760003970 0x7f37780a6a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:54.337 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:54.335+0000 7f377d490640 1 -- 172.21.15.73:0/4176766492 >> 172.21.15.73:0/4176766492 conn(0x7f377806a4e0 msgr2=0x7f37780bfc30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:43:54.337 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:54.336+0000 7f377d490640 1 -- 172.21.15.73:0/4176766492 shutdown_connections 2023-12-12T09:43:54.337 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:54.336+0000 7f377d490640 1 -- 172.21.15.73:0/4176766492 wait complete. 2023-12-12T09:43:54.403 INFO:tasks.cephfs_test_runner:Starting test: test_mount_all_caps_absent (tasks.cephfs.test_multifs_auth.TestClientsWithoutAuth) 2023-12-12T09:43:54.403 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-12T09:43:54.622 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:54.621+0000 7fb6d1da9640 1 Processor -- start 2023-12-12T09:43:54.622 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:54.621+0000 7fb6d1da9640 1 -- start start 2023-12-12T09:43:54.624 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:54.622+0000 7fb6d1da9640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fb6cc14fa40 0x7fb6cc06a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:54.624 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:54.623+0000 7fb6d1da9640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fb6cc0c5070 0x7fb6cc0c40c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:54.624 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:54.623+0000 7fb6d1da9640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6cc152610 con 0x7fb6cc06db70 2023-12-12T09:43:54.624 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:54.623+0000 7fb6d1da9640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6cc1528f0 con 0x7fb6cc0c5070 2023-12-12T09:43:54.624 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:54.623+0000 7fb6d1da9640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6cc152bd0 con 0x7fb6cc14fa40 2023-12-12T09:43:54.624 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:54.623+0000 7fb6c3fff640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7fb6cc06db70 0x7fb6cc0c39b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:50110/0 (socket says 172.21.15.73:50110) 2023-12-12T09:43:54.624 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:54.623+0000 7fb6c3fff640 1 -- 172.21.15.73:0/839482638 learned_addr learned my addr 172.21.15.73:0/839482638 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-12T09:43:54.624 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:54.623+0000 7fb6cbfff640 1 --2- 172.21.15.73:0/839482638 >> v2:172.21.15.73:3300/0 conn(0x7fb6cc0c5070 0x7fb6cc0c40c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:54.625 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:54.623+0000 7fb6cb7fe640 1 --2- 172.21.15.73:0/839482638 >> v2:172.21.15.142:3300/0 conn(0x7fb6cc14fa40 0x7fb6cc06a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:54.625 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:54.624+0000 7fb6caffd640 1 -- 172.21.15.73:0/839482638 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2894093971 0 0) 0x7fb6cc152610 con 0x7fb6cc06db70 2023-12-12T09:43:54.625 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:54.624+0000 7fb6caffd640 1 -- 172.21.15.73:0/839482638 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb6b8003520 con 0x7fb6cc06db70 2023-12-12T09:43:54.625 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:54.624+0000 7fb6cbfff640 1 -- 172.21.15.73:0/839482638 >> v2:172.21.15.142:3300/0 conn(0x7fb6cc14fa40 msgr2=0x7fb6cc06a4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:43:54.626 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:54.624+0000 7fb6cbfff640 1 --2- 172.21.15.73:0/839482638 >> v2:172.21.15.142:3300/0 conn(0x7fb6cc14fa40 0x7fb6cc06a4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:54.626 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:54.624+0000 7fb6cbfff640 1 -- 172.21.15.73:0/839482638 >> v1:172.21.15.73:6789/0 conn(0x7fb6cc06db70 legacy=0x7fb6cc0c39b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:54.626 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:54.624+0000 7fb6cbfff640 1 -- 172.21.15.73:0/839482638 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6cc152eb0 con 0x7fb6cc0c5070 2023-12-12T09:43:54.627 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:54.625+0000 7fb6cbfff640 1 --2- 172.21.15.73:0/839482638 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb6cc0c5070 0x7fb6cc0c40c0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fb6cc06e480 tx=0x7fb6c402bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a8e0059573a4343 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:43:54.627 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:54.625+0000 7fb6caffd640 1 -- 172.21.15.73:0/839482638 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6c402cc80 con 0x7fb6cc0c5070 2023-12-12T09:43:54.627 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:54.625+0000 7fb6caffd640 1 -- 172.21.15.73:0/839482638 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6c402cde0 con 0x7fb6cc0c5070 2023-12-12T09:43:54.627 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:54.625+0000 7fb6caffd640 1 -- 172.21.15.73:0/839482638 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6c4034660 con 0x7fb6cc0c5070 2023-12-12T09:43:54.627 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:54.626+0000 7fb6d1da9640 1 -- 172.21.15.73:0/839482638 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb6cc0c5070 msgr2=0x7fb6cc0c40c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:54.627 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:54.626+0000 7fb6d1da9640 1 --2- 172.21.15.73:0/839482638 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb6cc0c5070 0x7fb6cc0c40c0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fb6cc06e480 tx=0x7fb6c402bed0 comp rx=0 tx=0).stop 2023-12-12T09:43:54.627 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:54.626+0000 7fb6d1da9640 1 -- 172.21.15.73:0/839482638 shutdown_connections 2023-12-12T09:43:54.627 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:54.626+0000 7fb6d1da9640 1 --2- 172.21.15.73:0/839482638 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb6cc0c5070 0x7fb6cc0c40c0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:54.627 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:54.626+0000 7fb6d1da9640 1 --2- 172.21.15.73:0/839482638 >> v2:172.21.15.142:3300/0 conn(0x7fb6cc14fa40 0x7fb6cc06a4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:54.627 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:54.626+0000 7fb6d1da9640 1 -- 172.21.15.73:0/839482638 >> 172.21.15.73:0/839482638 conn(0x7fb6cc0a8130 msgr2=0x7fb6cc0c24b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:43:54.627 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:54.626+0000 7fb6d1da9640 1 -- 172.21.15.73:0/839482638 shutdown_connections 2023-12-12T09:43:54.628 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:54.626+0000 7fb6d1da9640 1 -- 172.21.15.73:0/839482638 wait complete. 2023-12-12T09:43:54.628 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:54.627+0000 7fb6d1da9640 1 Processor -- start 2023-12-12T09:43:54.629 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:54.628+0000 7fb6d1da9640 1 -- start start 2023-12-12T09:43:54.630 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:54.629+0000 7fb6d1da9640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb6cc06db70 0x7fb6cc0a8ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:54.630 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:54.629+0000 7fb6d1da9640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb6cc0c5070 0x7fb6cc0a90e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:54.630 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:54.629+0000 7fb6d1da9640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb6cc14fa40 0x7fb6cc1e0bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:54.630 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:54.629+0000 7fb6d1da9640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6cc155810 con 0x7fb6cc0c5070 2023-12-12T09:43:54.630 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:54.629+0000 7fb6d1da9640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6cc1ea660 con 0x7fb6cc14fa40 2023-12-12T09:43:54.630 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:54.629+0000 7fb6d1da9640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6cc154170 con 0x7fb6cc06db70 2023-12-12T09:43:54.632 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:54.629+0000 7fb6c3fff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb6cc0c5070 0x7fb6cc0a90e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:54.632 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:54.629+0000 7fb6c3fff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb6cc0c5070 0x7fb6cc0a90e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:45500/0 (socket says 172.21.15.73:45500) 2023-12-12T09:43:54.632 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:54.629+0000 7fb6c3fff640 1 -- 172.21.15.73:0/4072295748 learned_addr learned my addr 172.21.15.73:0/4072295748 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:43:54.632 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:54.629+0000 7fb6cbfff640 1 --2- 172.21.15.73:0/4072295748 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb6cc14fa40 0x7fb6cc1e0bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:54.632 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:54.629+0000 7fb6cb7fe640 1 --2- 172.21.15.73:0/4072295748 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb6cc06db70 0x7fb6cc0a8ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:54.632 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:54.629+0000 7fb6c3fff640 1 -- 172.21.15.73:0/4072295748 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb6cc06db70 msgr2=0x7fb6cc0a8ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:54.632 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:54.630+0000 7fb6c3fff640 1 --2- 172.21.15.73:0/4072295748 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb6cc06db70 0x7fb6cc0a8ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:54.632 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:54.630+0000 7fb6c3fff640 1 -- 172.21.15.73:0/4072295748 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb6cc14fa40 msgr2=0x7fb6cc1e0bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:54.632 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:54.630+0000 7fb6c3fff640 1 --2- 172.21.15.73:0/4072295748 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb6cc14fa40 0x7fb6cc1e0bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:54.632 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:54.630+0000 7fb6c3fff640 1 -- 172.21.15.73:0/4072295748 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6c4009a70 con 0x7fb6cc0c5070 2023-12-12T09:43:54.633 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:54.630+0000 7fb6c3fff640 1 --2- 172.21.15.73:0/4072295748 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb6cc0c5070 0x7fb6cc0a90e0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fb6b400c410 tx=0x7fb6b400c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:43:54.633 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:54.630+0000 7fb6c8ff9640 1 -- 172.21.15.73:0/4072295748 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6b4005ce0 con 0x7fb6cc0c5070 2023-12-12T09:43:54.633 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:54.630+0000 7fb6c8ff9640 1 -- 172.21.15.73:0/4072295748 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6b4005e40 con 0x7fb6cc0c5070 2023-12-12T09:43:54.633 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:54.630+0000 7fb6d1da9640 1 -- 172.21.15.73:0/4072295748 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6cc154450 con 0x7fb6cc0c5070 2023-12-12T09:43:54.633 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:54.630+0000 7fb6c8ff9640 1 -- 172.21.15.73:0/4072295748 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6b40072f0 con 0x7fb6cc0c5070 2023-12-12T09:43:54.633 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:54.630+0000 7fb6d1da9640 1 -- 172.21.15.73:0/4072295748 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6cc1ea940 con 0x7fb6cc0c5070 2023-12-12T09:43:54.633 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:54.632+0000 7fb6d1da9640 1 -- 172.21.15.73:0/4072295748 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb6cc067580 con 0x7fb6cc0c5070 2023-12-12T09:43:54.633 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:54.632+0000 7fb6c8ff9640 1 -- 172.21.15.73:0/4072295748 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fb6b4007450 con 0x7fb6cc0c5070 2023-12-12T09:43:54.634 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:54.633+0000 7fb6c8ff9640 1 --2- 172.21.15.73:0/4072295748 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fb6ac06ae40 0x7fb6ac06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:54.634 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:54.633+0000 7fb6c8ff9640 1 -- 172.21.15.73:0/4072295748 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb6b4088be0 con 0x7fb6cc0c5070 2023-12-12T09:43:54.634 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:54.633+0000 7fb6cb7fe640 1 --2- 172.21.15.73:0/4072295748 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fb6ac06ae40 0x7fb6ac06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:54.635 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:54.634+0000 7fb6cb7fe640 1 --2- 172.21.15.73:0/4072295748 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fb6ac06ae40 0x7fb6ac06d300 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fb6bc006fd0 tx=0x7fb6bc008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:43:54.639 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:54.638+0000 7fb6c8ff9640 1 -- 172.21.15.73:0/4072295748 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fb6b4057850 con 0x7fb6cc0c5070 2023-12-12T09:43:54.830 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:54.829+0000 7fb6d1da9640 1 -- 172.21.15.73:0/4072295748 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb6cc1537e0 con 0x7fb6cc0c5070 2023-12-12T09:43:54.833 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:54.832+0000 7fb6c8ff9640 1 -- 172.21.15.73:0/4072295748 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16517 (secure 0 0 0) 0x7fb6b4017090 con 0x7fb6cc0c5070 2023-12-12T09:43:54.834 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-12T09:43:54.834 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":21,"fsid":"ba240992-02b8-4c7e-92f2-27eb29ac433b","created":"2023-12-12T09:43:02.454719+0000","modified":"2023-12-12T09:43:23.219345+0000","last_up_change":"2023-12-12T09:43:13.913440+0000","last_in_change":"2023-12-12T09:43:05.925348+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-12T09:43:15.525508+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-12T09:43:20.004546+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-12T09:43:20.736500+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"dd9074be-dbe2-4c34-9896-a4223d8d3940","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":4047810203},{"type":"v1","addr":"172.21.15.73:6801","nonce":4047810203}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":4047810203},{"type":"v1","addr":"172.21.15.73:6803","nonce":4047810203}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":4047810203},{"type":"v1","addr":"172.21.15.73:6807","nonce":4047810203}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":4047810203},{"type":"v1","addr":"172.21.15.73:6805","nonce":4047810203}]},"public_addr":"172.21.15.73:6801/4047810203","cluster_addr":"172.21.15.73:6803/4047810203","heartbeat_back_addr":"172.21.15.73:6807/4047810203","heartbeat_front_addr":"172.21.15.73:6805/4047810203","state":["exists","up"]},{"osd":1,"uuid":"c4a05052-96d4-4758-a4e1-1a37f1e07fed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":1356058331},{"type":"v1","addr":"172.21.15.73:6824","nonce":1356058331}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":1356058331},{"type":"v1","addr":"172.21.15.73:6827","nonce":1356058331}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":1356058331},{"type":"v1","addr":"172.21.15.73:6831","nonce":1356058331}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":1356058331},{"type":"v1","addr":"172.21.15.73:6829","nonce":1356058331}]},"public_addr":"172.21.15.73:6824/1356058331","cluster_addr":"172.21.15.73:6827/1356058331","heartbeat_back_addr":"172.21.15.73:6831/1356058331","heartbeat_front_addr":"172.21.15.73:6829/1356058331","state":["exists","up"]},{"osd":2,"uuid":"512bc8ac-72c2-40d4-b3d2-d867a92c5213","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":1228903316},{"type":"v1","addr":"172.21.15.73:6817","nonce":1228903316}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":1228903316},{"type":"v1","addr":"172.21.15.73:6819","nonce":1228903316}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6823","nonce":1228903316},{"type":"v1","addr":"172.21.15.73:6825","nonce":1228903316}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":1228903316},{"type":"v1","addr":"172.21.15.73:6821","nonce":1228903316}]},"public_addr":"172.21.15.73:6817/1228903316","cluster_addr":"172.21.15.73:6819/1228903316","heartbeat_back_addr":"172.21.15.73:6825/1228903316","heartbeat_front_addr":"172.21.15.73:6821/1228903316","state":["exists","up"]},{"osd":3,"uuid":"3d1a91e0-42bf-437a-8eae-8d357c8f63a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":1293329670},{"type":"v1","addr":"172.21.15.73:6809","nonce":1293329670}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6810","nonce":1293329670},{"type":"v1","addr":"172.21.15.73:6811","nonce":1293329670}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":1293329670},{"type":"v1","addr":"172.21.15.73:6815","nonce":1293329670}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":1293329670},{"type":"v1","addr":"172.21.15.73:6813","nonce":1293329670}]},"public_addr":"172.21.15.73:6809/1293329670","cluster_addr":"172.21.15.73:6811/1293329670","heartbeat_back_addr":"172.21.15.73:6815/1293329670","heartbeat_front_addr":"172.21.15.73:6813/1293329670","state":["exists","up"]},{"osd":4,"uuid":"4b302fff-834c-4069-ac19-00e46f6c87b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":3727975702},{"type":"v1","addr":"172.21.15.142:6801","nonce":3727975702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":3727975702},{"type":"v1","addr":"172.21.15.142:6803","nonce":3727975702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6809","nonce":3727975702},{"type":"v1","addr":"172.21.15.142:6811","nonce":3727975702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6805","nonce":3727975702},{"type":"v1","addr":"172.21.15.142:6807","nonce":3727975702}]},"public_addr":"172.21.15.142:6801/3727975702","cluster_addr":"172.21.15.142:6803/3727975702","heartbeat_back_addr":"172.21.15.142:6811/3727975702","heartbeat_front_addr":"172.21.15.142:6807/3727975702","state":["exists","up"]},{"osd":5,"uuid":"d7cdace2-67d0-45cc-95f2-515cf6ef1b82","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6817","nonce":2353193632},{"type":"v1","addr":"172.21.15.142:6819","nonce":2353193632}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6821","nonce":2353193632},{"type":"v1","addr":"172.21.15.142:6823","nonce":2353193632}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6829","nonce":2353193632},{"type":"v1","addr":"172.21.15.142:6831","nonce":2353193632}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6825","nonce":2353193632},{"type":"v1","addr":"172.21.15.142:6827","nonce":2353193632}]},"public_addr":"172.21.15.142:6819/2353193632","cluster_addr":"172.21.15.142:6823/2353193632","heartbeat_back_addr":"172.21.15.142:6831/2353193632","heartbeat_front_addr":"172.21.15.142:6827/2353193632","state":["exists","up"]},{"osd":6,"uuid":"649ce78a-5626-445c-aedc-a651ed05a6f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":2006111986},{"type":"v1","addr":"172.21.15.142:6806","nonce":2006111986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":2006111986},{"type":"v1","addr":"172.21.15.142:6810","nonce":2006111986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":2006111986},{"type":"v1","addr":"172.21.15.142:6815","nonce":2006111986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":2006111986},{"type":"v1","addr":"172.21.15.142:6813","nonce":2006111986}]},"public_addr":"172.21.15.142:6806/2006111986","cluster_addr":"172.21.15.142:6810/2006111986","heartbeat_back_addr":"172.21.15.142:6815/2006111986","heartbeat_front_addr":"172.21.15.142:6813/2006111986","state":["exists","up"]},{"osd":7,"uuid":"af15ae3b-c1d0-4acf-92db-8a1805494d13","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":2573794341},{"type":"v1","addr":"172.21.15.142:6818","nonce":2573794341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":2573794341},{"type":"v1","addr":"172.21.15.142:6822","nonce":2573794341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":2573794341},{"type":"v1","addr":"172.21.15.142:6830","nonce":2573794341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":2573794341},{"type":"v1","addr":"172.21.15.142:6826","nonce":2573794341}]},"public_addr":"172.21.15.142:6818/2573794341","cluster_addr":"172.21.15.142:6822/2573794341","heartbeat_back_addr":"172.21.15.142:6830/2573794341","heartbeat_front_addr":"172.21.15.142:6826/2573794341","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.185824+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.262103+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.225556+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:10.523459+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:10.706035+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.257339+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.301776+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.051960+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-12T09:43:54.835 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:54.835+0000 7fb6d1da9640 1 -- 172.21.15.73:0/4072295748 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fb6ac06ae40 msgr2=0x7fb6ac06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:54.836 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:54.835+0000 7fb6d1da9640 1 --2- 172.21.15.73:0/4072295748 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fb6ac06ae40 0x7fb6ac06d300 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fb6bc006fd0 tx=0x7fb6bc008040 comp rx=0 tx=0).stop 2023-12-12T09:43:54.836 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:54.835+0000 7fb6d1da9640 1 -- 172.21.15.73:0/4072295748 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb6cc0c5070 msgr2=0x7fb6cc0a90e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:54.836 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:54.835+0000 7fb6d1da9640 1 --2- 172.21.15.73:0/4072295748 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb6cc0c5070 0x7fb6cc0a90e0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fb6b400c410 tx=0x7fb6b400c8d0 comp rx=0 tx=0).stop 2023-12-12T09:43:54.836 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:54.835+0000 7fb6d1da9640 1 -- 172.21.15.73:0/4072295748 shutdown_connections 2023-12-12T09:43:54.836 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:54.835+0000 7fb6d1da9640 1 --2- 172.21.15.73:0/4072295748 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fb6ac06ae40 0x7fb6ac06d300 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:54.837 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:54.835+0000 7fb6d1da9640 1 --2- 172.21.15.73:0/4072295748 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb6cc14fa40 0x7fb6cc1e0bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:54.837 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:54.835+0000 7fb6d1da9640 1 --2- 172.21.15.73:0/4072295748 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb6cc0c5070 0x7fb6cc0a90e0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:54.837 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:54.835+0000 7fb6d1da9640 1 --2- 172.21.15.73:0/4072295748 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb6cc06db70 0x7fb6cc0a8ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:54.837 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:54.835+0000 7fb6d1da9640 1 -- 172.21.15.73:0/4072295748 >> 172.21.15.73:0/4072295748 conn(0x7fb6cc0a8130 msgr2=0x7fb6cc0c63b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:43:54.837 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:54.835+0000 7fb6d1da9640 1 -- 172.21.15.73:0/4072295748 shutdown_connections 2023-12-12T09:43:54.837 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:54.835+0000 7fb6d1da9640 1 -- 172.21.15.73:0/4072295748 wait complete. 2023-12-12T09:43:54.855 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-12T09:43:15.525508+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-12T09:43:20.004546+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-12T09:43:20.736500+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-12T09:43:54.855 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-12T09:43:55.072 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:55.071+0000 7f7048ebb640 1 Processor -- start 2023-12-12T09:43:55.072 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:55.071+0000 7f7048ebb640 1 -- start start 2023-12-12T09:43:55.073 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:55.072+0000 7f7048ebb640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f704414e770 0x7f70440c5070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:55.073 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:55.072+0000 7f7048ebb640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f70440a4f30 0x7f70440c1510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:55.073 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:55.072+0000 7f7048ebb640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70440c1080 con 0x7f70440a9a30 2023-12-12T09:43:55.073 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:55.072+0000 7f7048ebb640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7044155470 con 0x7f70440a4f30 2023-12-12T09:43:55.074 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:55.072+0000 7f7048ebb640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7044155190 con 0x7f704414e770 2023-12-12T09:43:55.074 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:55.073+0000 7f7042ffd640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f70440a4f30 0x7f70440c1510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:55.075 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:55.073+0000 7f7042ffd640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f70440a4f30 0x7f70440c1510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:45510/0 (socket says 172.21.15.73:45510) 2023-12-12T09:43:55.075 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:55.073+0000 7f7042ffd640 1 -- 172.21.15.73:0/2262237766 learned_addr learned my addr 172.21.15.73:0/2262237766 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:43:55.075 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:55.073+0000 7f7043fff640 1 --1- 172.21.15.73:0/2262237766 >> v1:172.21.15.73:6789/0 conn(0x7f70440a9a30 0x7f7044154530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:50120/0 (socket says 172.21.15.73:50120) 2023-12-12T09:43:55.075 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:55.073+0000 7f70437fe640 1 --2- 172.21.15.73:0/2262237766 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f704414e770 0x7f70440c5070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:55.075 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:55.073+0000 7f7042ffd640 1 -- 172.21.15.73:0/2262237766 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f704414e770 msgr2=0x7f70440c5070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:43:55.075 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:55.073+0000 7f7042ffd640 1 --2- 172.21.15.73:0/2262237766 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f704414e770 0x7f70440c5070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:55.075 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:55.073+0000 7f7042ffd640 1 -- 172.21.15.73:0/2262237766 >> v1:172.21.15.73:6789/0 conn(0x7f70440a9a30 legacy=0x7f7044154530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:55.075 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:55.073+0000 7f7042ffd640 1 -- 172.21.15.73:0/2262237766 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70440c0d10 con 0x7f70440a4f30 2023-12-12T09:43:55.076 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:55.074+0000 7f7042ffd640 1 --2- 172.21.15.73:0/2262237766 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f70440a4f30 0x7f70440c1510 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f7038009870 tx=0x7f703802b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba5480509a1956bc server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:43:55.076 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:55.075+0000 7f70427fc640 1 -- 172.21.15.73:0/2262237766 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70380317c0 con 0x7f70440a4f30 2023-12-12T09:43:55.076 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:55.075+0000 7f70427fc640 1 -- 172.21.15.73:0/2262237766 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7038031920 con 0x7f70440a4f30 2023-12-12T09:43:55.076 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:55.075+0000 7f70427fc640 1 -- 172.21.15.73:0/2262237766 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7038031cb0 con 0x7f70440a4f30 2023-12-12T09:43:55.077 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:55.075+0000 7f7048ebb640 1 -- 172.21.15.73:0/2262237766 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f70440a4f30 msgr2=0x7f70440c1510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:55.077 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:55.075+0000 7f7048ebb640 1 --2- 172.21.15.73:0/2262237766 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f70440a4f30 0x7f70440c1510 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f7038009870 tx=0x7f703802b860 comp rx=0 tx=0).stop 2023-12-12T09:43:55.077 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:55.076+0000 7f7048ebb640 1 -- 172.21.15.73:0/2262237766 shutdown_connections 2023-12-12T09:43:55.077 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:55.076+0000 7f7048ebb640 1 --2- 172.21.15.73:0/2262237766 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f70440a4f30 0x7f70440c1510 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:55.077 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:55.076+0000 7f7048ebb640 1 --2- 172.21.15.73:0/2262237766 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f704414e770 0x7f70440c5070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:55.077 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:55.076+0000 7f7048ebb640 1 -- 172.21.15.73:0/2262237766 >> 172.21.15.73:0/2262237766 conn(0x7f704406a4e0 msgr2=0x7f704406a8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:43:55.077 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:55.076+0000 7f7048ebb640 1 -- 172.21.15.73:0/2262237766 shutdown_connections 2023-12-12T09:43:55.077 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:55.076+0000 7f7048ebb640 1 -- 172.21.15.73:0/2262237766 wait complete. 2023-12-12T09:43:55.079 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:55.078+0000 7f7048ebb640 1 Processor -- start 2023-12-12T09:43:55.079 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:55.078+0000 7f7048ebb640 1 -- start start 2023-12-12T09:43:55.081 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:55.079+0000 7f7048ebb640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f70440a4f30 0x7f70441454c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:55.081 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:55.079+0000 7f7048ebb640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f70440a9a30 0x7f704406ce00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:55.081 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:55.079+0000 7f7048ebb640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f704414e770 0x7f70440a5a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:55.081 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:55.079+0000 7f7048ebb640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f704414c9a0 con 0x7f70440a9a30 2023-12-12T09:43:55.081 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:55.079+0000 7f7048ebb640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f704414d200 con 0x7f704414e770 2023-12-12T09:43:55.082 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:55.079+0000 7f7048ebb640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7044145aa0 con 0x7f70440a4f30 2023-12-12T09:43:55.082 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:55.079+0000 7f7042ffd640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f70440a9a30 0x7f704406ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:55.082 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:55.079+0000 7f7042ffd640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f70440a9a30 0x7f704406ce00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:45512/0 (socket says 172.21.15.73:45512) 2023-12-12T09:43:55.082 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:55.079+0000 7f7042ffd640 1 -- 172.21.15.73:0/3803118236 learned_addr learned my addr 172.21.15.73:0/3803118236 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:43:55.082 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:55.080+0000 7f70437fe640 1 --2- 172.21.15.73:0/3803118236 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f70440a4f30 0x7f70441454c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:55.082 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:55.080+0000 7f7043fff640 1 --2- 172.21.15.73:0/3803118236 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f704414e770 0x7f70440a5a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:55.082 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:55.080+0000 7f7042ffd640 1 -- 172.21.15.73:0/3803118236 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f70440a4f30 msgr2=0x7f70441454c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:55.082 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:55.080+0000 7f7042ffd640 1 --2- 172.21.15.73:0/3803118236 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f70440a4f30 0x7f70441454c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:55.082 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:55.080+0000 7f7042ffd640 1 -- 172.21.15.73:0/3803118236 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f704414e770 msgr2=0x7f70440a5a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:55.082 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:55.080+0000 7f7042ffd640 1 --2- 172.21.15.73:0/3803118236 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f704414e770 0x7f70440a5a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:55.082 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:55.080+0000 7f7042ffd640 1 -- 172.21.15.73:0/3803118236 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70380094d0 con 0x7f70440a9a30 2023-12-12T09:43:55.082 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:55.080+0000 7f7042ffd640 1 --2- 172.21.15.73:0/3803118236 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f70440a9a30 0x7f704406ce00 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f7038000c00 tx=0x7f70380046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:43:55.083 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:55.080+0000 7f702bfff640 1 -- 172.21.15.73:0/3803118236 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7038032860 con 0x7f70440a9a30 2023-12-12T09:43:55.083 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:55.080+0000 7f702bfff640 1 -- 172.21.15.73:0/3803118236 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70380329e0 con 0x7f70440a9a30 2023-12-12T09:43:55.083 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:55.081+0000 7f702bfff640 1 -- 172.21.15.73:0/3803118236 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7038032d90 con 0x7f70440a9a30 2023-12-12T09:43:55.083 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:55.081+0000 7f7048ebb640 1 -- 172.21.15.73:0/3803118236 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f704414cbb0 con 0x7f70440a9a30 2023-12-12T09:43:55.083 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:55.081+0000 7f7048ebb640 1 -- 172.21.15.73:0/3803118236 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f704406d340 con 0x7f70440a9a30 2023-12-12T09:43:55.083 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:55.082+0000 7f7048ebb640 1 -- 172.21.15.73:0/3803118236 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7044072b60 con 0x7f70440a9a30 2023-12-12T09:43:55.084 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:55.083+0000 7f702bfff640 1 -- 172.21.15.73:0/3803118236 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f703804e450 con 0x7f70440a9a30 2023-12-12T09:43:55.085 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:55.084+0000 7f702bfff640 1 --2- 172.21.15.73:0/3803118236 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f703006ae40 0x7f703006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:55.085 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:55.084+0000 7f702bfff640 1 -- 172.21.15.73:0/3803118236 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f70380ab7a0 con 0x7f70440a9a30 2023-12-12T09:43:55.085 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:55.084+0000 7f70437fe640 1 --2- 172.21.15.73:0/3803118236 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f703006ae40 0x7f703006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:55.086 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:55.085+0000 7f70437fe640 1 --2- 172.21.15.73:0/3803118236 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f703006ae40 0x7f703006d300 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f7034006fd0 tx=0x7f7034008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:43:55.089 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:55.088+0000 7f702bfff640 1 -- 172.21.15.73:0/3803118236 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f70380768e0 con 0x7f70440a9a30 2023-12-12T09:43:55.278 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:55.277+0000 7f7048ebb640 1 -- 172.21.15.73:0/3803118236 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f7044067400 con 0x7f70440a9a30 2023-12-12T09:43:55.279 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:55.278+0000 7f702bfff640 1 -- 172.21.15.73:0/3803118236 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7f7038079f00 con 0x7f70440a9a30 2023-12-12T09:43:55.279 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 1 2023-12-12T09:43:55.282 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:55.281+0000 7f7048ebb640 1 -- 172.21.15.73:0/3803118236 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f703006ae40 msgr2=0x7f703006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:55.282 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:55.281+0000 7f7048ebb640 1 --2- 172.21.15.73:0/3803118236 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f703006ae40 0x7f703006d300 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f7034006fd0 tx=0x7f7034008040 comp rx=0 tx=0).stop 2023-12-12T09:43:55.282 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:55.281+0000 7f7048ebb640 1 -- 172.21.15.73:0/3803118236 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f70440a9a30 msgr2=0x7f704406ce00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:55.283 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:55.281+0000 7f7048ebb640 1 --2- 172.21.15.73:0/3803118236 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f70440a9a30 0x7f704406ce00 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f7038000c00 tx=0x7f70380046c0 comp rx=0 tx=0).stop 2023-12-12T09:43:55.283 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:55.281+0000 7f7048ebb640 1 -- 172.21.15.73:0/3803118236 shutdown_connections 2023-12-12T09:43:55.283 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:55.281+0000 7f7048ebb640 1 --2- 172.21.15.73:0/3803118236 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f703006ae40 0x7f703006d300 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:55.283 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:55.281+0000 7f7048ebb640 1 --2- 172.21.15.73:0/3803118236 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f704414e770 0x7f70440a5a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:55.283 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:55.281+0000 7f7048ebb640 1 --2- 172.21.15.73:0/3803118236 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f70440a9a30 0x7f704406ce00 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:55.283 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:55.281+0000 7f7048ebb640 1 --2- 172.21.15.73:0/3803118236 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f70440a4f30 0x7f70441454c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:55.283 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:55.281+0000 7f7048ebb640 1 -- 172.21.15.73:0/3803118236 >> 172.21.15.73:0/3803118236 conn(0x7f704406a4e0 msgr2=0x7f704414ae70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:43:55.283 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:55.281+0000 7f7048ebb640 1 -- 172.21.15.73:0/3803118236 shutdown_connections 2023-12-12T09:43:55.283 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:55.281+0000 7f7048ebb640 1 -- 172.21.15.73:0/3803118236 wait complete. 2023-12-12T09:43:55.301 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-12T09:43:55.516 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:55.515+0000 7faaab5d7640 1 Processor -- start 2023-12-12T09:43:55.517 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:55.515+0000 7faaab5d7640 1 -- start start 2023-12-12T09:43:55.518 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:55.516+0000 7faaab5d7640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7faaa414ea60 0x7faaa40c5420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:55.518 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:55.516+0000 7faaab5d7640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7faaa40a4c90 0x7faaa40c0320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:55.518 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:55.517+0000 7faaab5d7640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faaa40c3390 con 0x7faaa40c4420 2023-12-12T09:43:55.518 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:55.517+0000 7faaab5d7640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faaa4151e60 con 0x7faaa40a4c90 2023-12-12T09:43:55.518 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:55.517+0000 7faaab5d7640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faaa4152140 con 0x7faaa414ea60 2023-12-12T09:43:55.518 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:55.517+0000 7faaa8b72640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7faaa40a4c90 0x7faaa40c0320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:55.518 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:55.517+0000 7faaa8b72640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7faaa40a4c90 0x7faaa40c0320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:45528/0 (socket says 172.21.15.73:45528) 2023-12-12T09:43:55.518 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:55.517+0000 7faaa8b72640 1 -- 172.21.15.73:0/3297765610 learned_addr learned my addr 172.21.15.73:0/3297765610 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:43:55.519 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:55.517+0000 7faaa9373640 1 --2- 172.21.15.73:0/3297765610 >> v2:172.21.15.142:3300/0 conn(0x7faaa414ea60 0x7faaa40c5420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:55.519 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:55.517+0000 7faaa8b72640 1 -- 172.21.15.73:0/3297765610 >> v2:172.21.15.142:3300/0 conn(0x7faaa414ea60 msgr2=0x7faaa40c5420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:43:55.519 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:55.517+0000 7faaa8b72640 1 --2- 172.21.15.73:0/3297765610 >> v2:172.21.15.142:3300/0 conn(0x7faaa414ea60 0x7faaa40c5420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:55.519 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:55.517+0000 7faaa8b72640 1 -- 172.21.15.73:0/3297765610 >> v1:172.21.15.142:6789/0 conn(0x7faaa40c4420 legacy=0x7faaa40c20b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:43:55.519 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:55.517+0000 7faaa8b72640 1 -- 172.21.15.73:0/3297765610 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faaa40c3940 con 0x7faaa40a4c90 2023-12-12T09:43:55.520 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:55.519+0000 7faaa8b72640 1 --2- 172.21.15.73:0/3297765610 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7faaa40a4c90 0x7faaa40c0320 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7faaa406b490 tx=0x7faa9402b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45b0b0a60f795011 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:43:55.520 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:55.519+0000 7faa9bfff640 1 -- 172.21.15.73:0/3297765610 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa940317e0 con 0x7faaa40a4c90 2023-12-12T09:43:55.520 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:55.519+0000 7faa9bfff640 1 -- 172.21.15.73:0/3297765610 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa94031940 con 0x7faaa40a4c90 2023-12-12T09:43:55.520 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:55.519+0000 7faa9bfff640 1 -- 172.21.15.73:0/3297765610 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa94031cd0 con 0x7faaa40a4c90 2023-12-12T09:43:55.521 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:55.520+0000 7faaab5d7640 1 -- 172.21.15.73:0/3297765610 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7faaa40a4c90 msgr2=0x7faaa40c0320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:55.521 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:55.520+0000 7faaab5d7640 1 --2- 172.21.15.73:0/3297765610 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7faaa40a4c90 0x7faaa40c0320 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7faaa406b490 tx=0x7faa9402b880 comp rx=0 tx=0).stop 2023-12-12T09:43:55.521 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:55.520+0000 7faaab5d7640 1 -- 172.21.15.73:0/3297765610 shutdown_connections 2023-12-12T09:43:55.521 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:55.520+0000 7faaab5d7640 1 --2- 172.21.15.73:0/3297765610 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7faaa40a4c90 0x7faaa40c0320 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:55.521 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:55.520+0000 7faaab5d7640 1 --2- 172.21.15.73:0/3297765610 >> v2:172.21.15.142:3300/0 conn(0x7faaa414ea60 0x7faaa40c5420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:55.521 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:55.520+0000 7faaab5d7640 1 -- 172.21.15.73:0/3297765610 >> 172.21.15.73:0/3297765610 conn(0x7faaa406a4e0 msgr2=0x7faaa406a8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:43:55.521 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:55.520+0000 7faaab5d7640 1 -- 172.21.15.73:0/3297765610 shutdown_connections 2023-12-12T09:43:55.521 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:55.520+0000 7faaab5d7640 1 -- 172.21.15.73:0/3297765610 wait complete. 2023-12-12T09:43:55.522 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:55.521+0000 7faaab5d7640 1 Processor -- start 2023-12-12T09:43:55.522 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:55.522+0000 7faaab5d7640 1 -- start start 2023-12-12T09:43:55.524 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:55.523+0000 7faaab5d7640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7faaa40a4c90 0x7faaa41ebb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:55.524 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:55.523+0000 7faaab5d7640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7faaa40c4420 0x7faaa4150370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:55.524 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:55.523+0000 7faaab5d7640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7faaa414ea60 0x7faaa41e7b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:55.524 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:55.523+0000 7faaab5d7640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faaa4149c90 con 0x7faaa40c4420 2023-12-12T09:43:55.524 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:55.523+0000 7faaab5d7640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faaa41ec070 con 0x7faaa40a4c90 2023-12-12T09:43:55.524 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:55.523+0000 7faaab5d7640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faaa4149410 con 0x7faaa414ea60 2023-12-12T09:43:55.524 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:55.523+0000 7faaa8b72640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7faaa40c4420 0x7faaa4150370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:55.525 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:55.523+0000 7faaa8b72640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7faaa40c4420 0x7faaa4150370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:45530/0 (socket says 172.21.15.73:45530) 2023-12-12T09:43:55.525 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:55.523+0000 7faaa8b72640 1 -- 172.21.15.73:0/382391973 learned_addr learned my addr 172.21.15.73:0/382391973 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:43:55.525 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:55.523+0000 7faaa8b72640 1 -- 172.21.15.73:0/382391973 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7faaa414ea60 msgr2=0x7faaa41e7b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:55.525 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:55.523+0000 7faaa8b72640 1 --2- 172.21.15.73:0/382391973 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7faaa414ea60 0x7faaa41e7b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:55.525 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:55.523+0000 7faaa8b72640 1 -- 172.21.15.73:0/382391973 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7faaa40a4c90 msgr2=0x7faaa41ebb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:55.525 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:55.523+0000 7faaa8b72640 1 --2- 172.21.15.73:0/382391973 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7faaa40a4c90 0x7faaa41ebb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:55.525 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:55.523+0000 7faaa8b72640 1 -- 172.21.15.73:0/382391973 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa940094d0 con 0x7faaa40c4420 2023-12-12T09:43:55.526 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:55.524+0000 7faaa8b72640 1 --2- 172.21.15.73:0/382391973 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7faaa40c4420 0x7faaa4150370 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7faa9402b8c0 tx=0x7faa940046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:43:55.526 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:55.524+0000 7faa99ffb640 1 -- 172.21.15.73:0/382391973 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa940329c0 con 0x7faaa40c4420 2023-12-12T09:43:55.526 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:55.524+0000 7faa99ffb640 1 -- 172.21.15.73:0/382391973 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa94032b40 con 0x7faaa40c4420 2023-12-12T09:43:55.526 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:55.524+0000 7faaab5d7640 1 -- 172.21.15.73:0/382391973 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faaa4148040 con 0x7faaa40c4420 2023-12-12T09:43:55.526 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:55.524+0000 7faa99ffb640 1 -- 172.21.15.73:0/382391973 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa940453f0 con 0x7faaa40c4420 2023-12-12T09:43:55.526 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:55.524+0000 7faaab5d7640 1 -- 172.21.15.73:0/382391973 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faaa40ab220 con 0x7faaa40c4420 2023-12-12T09:43:55.527 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:55.525+0000 7faaab5d7640 1 -- 172.21.15.73:0/382391973 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faaa4067070 con 0x7faaa40c4420 2023-12-12T09:43:55.527 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:55.526+0000 7faa99ffb640 1 -- 172.21.15.73:0/382391973 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7faa9404d3f0 con 0x7faaa40c4420 2023-12-12T09:43:55.528 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:55.527+0000 7faa99ffb640 1 --2- 172.21.15.73:0/382391973 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7faa8806ae40 0x7faa8806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:55.528 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:55.527+0000 7faa99ffb640 1 -- 172.21.15.73:0/382391973 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7faa940ab5d0 con 0x7faaa40c4420 2023-12-12T09:43:55.528 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:55.527+0000 7faaa9373640 1 --2- 172.21.15.73:0/382391973 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7faa8806ae40 0x7faa8806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:55.528 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:55.528+0000 7faaa9373640 1 --2- 172.21.15.73:0/382391973 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7faa8806ae40 0x7faa8806d300 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7faaa000a7f0 tx=0x7faaa0008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:43:55.532 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:55.531+0000 7faa99ffb640 1 -- 172.21.15.73:0/382391973 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7faa94076690 con 0x7faaa40c4420 2023-12-12T09:43:55.726 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:55.724+0000 7faaab5d7640 1 -- 172.21.15.73:0/382391973 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7faaa40c2770 con 0x7faaa40c4420 2023-12-12T09:43:55.727 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:55.726+0000 7faa99ffb640 1 -- 172.21.15.73:0/382391973 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7faa94079cb0 con 0x7faaa40c4420 2023-12-12T09:43:55.727 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 32 2023-12-12T09:43:55.729 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:55.728+0000 7faaab5d7640 1 -- 172.21.15.73:0/382391973 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7faa8806ae40 msgr2=0x7faa8806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:55.729 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:55.728+0000 7faaab5d7640 1 --2- 172.21.15.73:0/382391973 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7faa8806ae40 0x7faa8806d300 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7faaa000a7f0 tx=0x7faaa0008040 comp rx=0 tx=0).stop 2023-12-12T09:43:55.730 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:55.728+0000 7faaab5d7640 1 -- 172.21.15.73:0/382391973 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7faaa40c4420 msgr2=0x7faaa4150370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:55.730 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:55.728+0000 7faaab5d7640 1 --2- 172.21.15.73:0/382391973 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7faaa40c4420 0x7faaa4150370 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7faa9402b8c0 tx=0x7faa940046c0 comp rx=0 tx=0).stop 2023-12-12T09:43:55.730 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:55.728+0000 7faaab5d7640 1 -- 172.21.15.73:0/382391973 shutdown_connections 2023-12-12T09:43:55.730 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:55.728+0000 7faaab5d7640 1 --2- 172.21.15.73:0/382391973 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7faa8806ae40 0x7faa8806d300 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:55.730 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:55.728+0000 7faaab5d7640 1 --2- 172.21.15.73:0/382391973 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7faaa414ea60 0x7faaa41e7b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:55.730 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:55.728+0000 7faaab5d7640 1 --2- 172.21.15.73:0/382391973 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7faaa40c4420 0x7faaa4150370 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:55.730 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:55.728+0000 7faaab5d7640 1 --2- 172.21.15.73:0/382391973 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7faaa40a4c90 0x7faaa41ebb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:55.730 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:55.728+0000 7faaab5d7640 1 -- 172.21.15.73:0/382391973 >> 172.21.15.73:0/382391973 conn(0x7faaa406a4e0 msgr2=0x7faaa406d520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:43:55.730 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:55.728+0000 7faaab5d7640 1 -- 172.21.15.73:0/382391973 shutdown_connections 2023-12-12T09:43:55.730 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:55.728+0000 7faaab5d7640 1 -- 172.21.15.73:0/382391973 wait complete. 2023-12-12T09:43:55.747 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-12T09:43:55.962 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:55.961+0000 7f1f6230c640 1 Processor -- start 2023-12-12T09:43:55.962 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:55.961+0000 7f1f6230c640 1 -- start start 2023-12-12T09:43:55.964 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:55.962+0000 7f1f6230c640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1f5c14f8c0 0x7f1f5c06dc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:55.964 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:55.962+0000 7f1f6230c640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f1f5c06d350 0x7f1f5c071e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:55.964 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:55.962+0000 7f1f6230c640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f1f5c0723a0 0x7f1f5c152500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:55.964 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:55.962+0000 7f1f6230c640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f5c0c1090 con 0x7f1f5c0723a0 2023-12-12T09:43:55.964 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:55.962+0000 7f1f6230c640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f5c0c14b0 con 0x7f1f5c06d350 2023-12-12T09:43:55.964 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:55.962+0000 7f1f6230c640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f5c0c16c0 con 0x7f1f5c14f8c0 2023-12-12T09:43:55.964 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:55.963+0000 7f1f608a9640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f1f5c0723a0 0x7f1f5c152500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:55.964 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:55.963+0000 7f1f608a9640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f1f5c0723a0 0x7f1f5c152500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:45544/0 (socket says 172.21.15.73:45544) 2023-12-12T09:43:55.964 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:55.963+0000 7f1f608a9640 1 -- 172.21.15.73:0/4157926444 learned_addr learned my addr 172.21.15.73:0/4157926444 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:43:55.965 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:55.963+0000 7f1f608a9640 1 -- 172.21.15.73:0/4157926444 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1f5c14f8c0 msgr2=0x7f1f5c06dc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:43:55.965 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:55.963+0000 7f1f608a9640 1 --2- 172.21.15.73:0/4157926444 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1f5c14f8c0 0x7f1f5c06dc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:55.965 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:55.963+0000 7f1f608a9640 1 -- 172.21.15.73:0/4157926444 >> v2:172.21.15.142:3300/0 conn(0x7f1f5c06d350 msgr2=0x7f1f5c071e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:43:55.965 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:55.963+0000 7f1f608a9640 1 --2- 172.21.15.73:0/4157926444 >> v2:172.21.15.142:3300/0 conn(0x7f1f5c06d350 0x7f1f5c071e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:55.965 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:55.963+0000 7f1f608a9640 1 -- 172.21.15.73:0/4157926444 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f5c0c19a0 con 0x7f1f5c0723a0 2023-12-12T09:43:55.966 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:55.964+0000 7f1f608a9640 1 --2- 172.21.15.73:0/4157926444 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1f5c0723a0 0x7f1f5c152500 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f1f54009e50 tx=0x7f1f5402bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1b2663987e4b2c4 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:43:55.966 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:55.964+0000 7f1f5affd640 1 -- 172.21.15.73:0/4157926444 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f5402ca80 con 0x7f1f5c0723a0 2023-12-12T09:43:55.966 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:55.965+0000 7f1f5affd640 1 -- 172.21.15.73:0/4157926444 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f5402cbe0 con 0x7f1f5c0723a0 2023-12-12T09:43:55.966 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:55.965+0000 7f1f5affd640 1 -- 172.21.15.73:0/4157926444 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f540343f0 con 0x7f1f5c0723a0 2023-12-12T09:43:55.966 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:55.965+0000 7f1f6230c640 1 -- 172.21.15.73:0/4157926444 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1f5c0723a0 msgr2=0x7f1f5c152500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:55.967 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:55.965+0000 7f1f6230c640 1 --2- 172.21.15.73:0/4157926444 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1f5c0723a0 0x7f1f5c152500 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f1f54009e50 tx=0x7f1f5402bee0 comp rx=0 tx=0).stop 2023-12-12T09:43:55.967 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:55.965+0000 7f1f6230c640 1 -- 172.21.15.73:0/4157926444 shutdown_connections 2023-12-12T09:43:55.967 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:55.965+0000 7f1f6230c640 1 --2- 172.21.15.73:0/4157926444 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1f5c0723a0 0x7f1f5c152500 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:55.967 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:55.965+0000 7f1f6230c640 1 --2- 172.21.15.73:0/4157926444 >> v2:172.21.15.142:3300/0 conn(0x7f1f5c06d350 0x7f1f5c071e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:55.967 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:55.965+0000 7f1f6230c640 1 --2- 172.21.15.73:0/4157926444 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1f5c14f8c0 0x7f1f5c06dc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:55.967 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:55.965+0000 7f1f6230c640 1 -- 172.21.15.73:0/4157926444 >> 172.21.15.73:0/4157926444 conn(0x7f1f5c06a4e0 msgr2=0x7f1f5c06a8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:43:55.967 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:55.965+0000 7f1f6230c640 1 -- 172.21.15.73:0/4157926444 shutdown_connections 2023-12-12T09:43:55.967 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:55.965+0000 7f1f6230c640 1 -- 172.21.15.73:0/4157926444 wait complete. 2023-12-12T09:43:55.972 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:55.967+0000 7f1f6230c640 1 Processor -- start 2023-12-12T09:43:55.972 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:55.967+0000 7f1f6230c640 1 -- start start 2023-12-12T09:43:55.972 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:55.968+0000 7f1f6230c640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1f5c06d350 0x7f1f5c144bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:55.972 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:55.968+0000 7f1f6230c640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1f5c0723a0 0x7f1f5c1eb3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:55.972 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:55.968+0000 7f1f6230c640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1f5c14f8c0 0x7f1f5c1eb910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:55.972 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:55.968+0000 7f1f6230c640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f5c1ebe50 con 0x7f1f5c0723a0 2023-12-12T09:43:55.972 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:55.968+0000 7f1f6230c640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f5c14cc10 con 0x7f1f5c06d350 2023-12-12T09:43:55.972 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:55.968+0000 7f1f6230c640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f5c145130 con 0x7f1f5c14f8c0 2023-12-12T09:43:55.972 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:55.968+0000 7f1f5b7fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1f5c0723a0 0x7f1f5c1eb3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:55.972 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:55.968+0000 7f1f5b7fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1f5c0723a0 0x7f1f5c1eb3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:45560/0 (socket says 172.21.15.73:45560) 2023-12-12T09:43:55.973 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:55.968+0000 7f1f5b7fe640 1 -- 172.21.15.73:0/2919391268 learned_addr learned my addr 172.21.15.73:0/2919391268 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:43:55.973 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:55.969+0000 7f1f608a9640 1 --2- 172.21.15.73:0/2919391268 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1f5c14f8c0 0x7f1f5c1eb910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:55.973 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:55.969+0000 7f1f5bfff640 1 --2- 172.21.15.73:0/2919391268 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1f5c06d350 0x7f1f5c144bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:55.973 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:55.969+0000 7f1f5b7fe640 1 -- 172.21.15.73:0/2919391268 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1f5c14f8c0 msgr2=0x7f1f5c1eb910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:55.973 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:55.969+0000 7f1f5b7fe640 1 --2- 172.21.15.73:0/2919391268 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1f5c14f8c0 0x7f1f5c1eb910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:55.973 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:55.969+0000 7f1f5b7fe640 1 -- 172.21.15.73:0/2919391268 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1f5c06d350 msgr2=0x7f1f5c144bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:55.973 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:55.969+0000 7f1f5b7fe640 1 --2- 172.21.15.73:0/2919391268 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1f5c06d350 0x7f1f5c144bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:55.973 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:55.969+0000 7f1f5b7fe640 1 -- 172.21.15.73:0/2919391268 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f54009b30 con 0x7f1f5c0723a0 2023-12-12T09:43:55.973 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:55.969+0000 7f1f5b7fe640 1 --2- 172.21.15.73:0/2919391268 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1f5c0723a0 0x7f1f5c1eb3d0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f1f5000b500 tx=0x7f1f5000b9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:43:55.973 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:55.969+0000 7f1f58ff9640 1 -- 172.21.15.73:0/2919391268 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f50010870 con 0x7f1f5c0723a0 2023-12-12T09:43:55.973 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:55.969+0000 7f1f58ff9640 1 -- 172.21.15.73:0/2919391268 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f500109d0 con 0x7f1f5c0723a0 2023-12-12T09:43:55.973 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:55.969+0000 7f1f6230c640 1 -- 172.21.15.73:0/2919391268 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f5c14a910 con 0x7f1f5c0723a0 2023-12-12T09:43:55.973 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:55.969+0000 7f1f58ff9640 1 -- 172.21.15.73:0/2919391268 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f50010d80 con 0x7f1f5c0723a0 2023-12-12T09:43:55.973 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:55.969+0000 7f1f6230c640 1 -- 172.21.15.73:0/2919391268 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f5c14a2c0 con 0x7f1f5c0723a0 2023-12-12T09:43:55.974 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:55.970+0000 7f1f6230c640 1 -- 172.21.15.73:0/2919391268 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f5c067070 con 0x7f1f5c0723a0 2023-12-12T09:43:55.974 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:55.971+0000 7f1f58ff9640 1 -- 172.21.15.73:0/2919391268 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f1f5000f3c0 con 0x7f1f5c0723a0 2023-12-12T09:43:55.974 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:55.973+0000 7f1f58ff9640 1 --2- 172.21.15.73:0/2919391268 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f1f4806ae70 0x7f1f4806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:55.974 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:55.973+0000 7f1f58ff9640 1 -- 172.21.15.73:0/2919391268 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1f500895b0 con 0x7f1f5c0723a0 2023-12-12T09:43:55.974 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:55.973+0000 7f1f5bfff640 1 --2- 172.21.15.73:0/2919391268 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f1f4806ae70 0x7f1f4806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:55.975 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:55.974+0000 7f1f5bfff640 1 --2- 172.21.15.73:0/2919391268 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f1f4806ae70 0x7f1f4806d330 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f1f4c00a770 tx=0x7f1f4c008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:43:55.978 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:55.977+0000 7f1f58ff9640 1 -- 172.21.15.73:0/2919391268 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f1f500545d0 con 0x7f1f5c0723a0 2023-12-12T09:43:56.169 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:56.168+0000 7f1f6230c640 1 -- 172.21.15.73:0/2919391268 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f1f5c067580 con 0x7f1f5c0723a0 2023-12-12T09:43:56.170 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:56.169+0000 7f1f58ff9640 1 -- 172.21.15.73:0/2919391268 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7f1f50057bf0 con 0x7f1f5c0723a0 2023-12-12T09:43:56.170 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 64 2023-12-12T09:43:56.172 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:56.171+0000 7f1f6230c640 1 -- 172.21.15.73:0/2919391268 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f1f4806ae70 msgr2=0x7f1f4806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:56.172 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:56.171+0000 7f1f6230c640 1 --2- 172.21.15.73:0/2919391268 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f1f4806ae70 0x7f1f4806d330 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f1f4c00a770 tx=0x7f1f4c008040 comp rx=0 tx=0).stop 2023-12-12T09:43:56.172 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:56.171+0000 7f1f6230c640 1 -- 172.21.15.73:0/2919391268 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1f5c0723a0 msgr2=0x7f1f5c1eb3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:56.172 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:56.171+0000 7f1f6230c640 1 --2- 172.21.15.73:0/2919391268 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1f5c0723a0 0x7f1f5c1eb3d0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f1f5000b500 tx=0x7f1f5000b9c0 comp rx=0 tx=0).stop 2023-12-12T09:43:56.173 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:56.171+0000 7f1f6230c640 1 -- 172.21.15.73:0/2919391268 shutdown_connections 2023-12-12T09:43:56.173 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:56.171+0000 7f1f6230c640 1 --2- 172.21.15.73:0/2919391268 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f1f4806ae70 0x7f1f4806d330 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:56.173 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:56.171+0000 7f1f6230c640 1 --2- 172.21.15.73:0/2919391268 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1f5c14f8c0 0x7f1f5c1eb910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:56.173 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:56.171+0000 7f1f6230c640 1 --2- 172.21.15.73:0/2919391268 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1f5c0723a0 0x7f1f5c1eb3d0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:56.173 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:56.171+0000 7f1f6230c640 1 --2- 172.21.15.73:0/2919391268 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1f5c06d350 0x7f1f5c144bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:56.173 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:56.171+0000 7f1f6230c640 1 -- 172.21.15.73:0/2919391268 >> 172.21.15.73:0/2919391268 conn(0x7f1f5c06a4e0 msgr2=0x7f1f5c0c6250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:43:56.173 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:56.172+0000 7f1f6230c640 1 -- 172.21.15.73:0/2919391268 shutdown_connections 2023-12-12T09:43:56.173 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:56.172+0000 7f1f6230c640 1 -- 172.21.15.73:0/2919391268 wait complete. 2023-12-12T09:43:56.191 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_multifs_auth.TestClientsWithoutAuth.test_mount_all_caps_absent' 2023-12-12T09:43:56.403 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:56.402+0000 7f917a2d0640 1 Processor -- start 2023-12-12T09:43:56.403 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:56.402+0000 7f917a2d0640 1 -- start start 2023-12-12T09:43:56.405 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:56.404+0000 7f917a2d0640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f9174151a40 0x7f91740acbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:56.405 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:56.404+0000 7f917a2d0640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f91740c1120 0x7f917406a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:56.405 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:56.404+0000 7f917a2d0640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91740c2f60 con 0x7f917406aa20 2023-12-12T09:43:56.405 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:56.404+0000 7f917a2d0640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f917406e790 con 0x7f91740c1120 2023-12-12T09:43:56.405 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:56.404+0000 7f917a2d0640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9174155090 con 0x7f9174151a40 2023-12-12T09:43:56.405 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:56.404+0000 7f916bfff640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f91740c1120 0x7f917406a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:56.405 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:56.404+0000 7f916bfff640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f91740c1120 0x7f917406a4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:45568/0 (socket says 172.21.15.73:45568) 2023-12-12T09:43:56.405 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:56.404+0000 7f916bfff640 1 -- 172.21.15.73:0/2372581364 learned_addr learned my addr 172.21.15.73:0/2372581364 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:43:56.406 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:56.404+0000 7f9173fff640 1 --2- 172.21.15.73:0/2372581364 >> v2:172.21.15.142:3300/0 conn(0x7f9174151a40 0x7f91740acbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:56.406 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:56.405+0000 7f916bfff640 1 -- 172.21.15.73:0/2372581364 >> v2:172.21.15.142:3300/0 conn(0x7f9174151a40 msgr2=0x7f91740acbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:43:56.406 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:56.405+0000 7f916bfff640 1 --2- 172.21.15.73:0/2372581364 >> v2:172.21.15.142:3300/0 conn(0x7f9174151a40 0x7f91740acbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:56.406 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:56.405+0000 7f916bfff640 1 -- 172.21.15.73:0/2372581364 >> v1:172.21.15.142:6789/0 conn(0x7f917406aa20 legacy=0x7f91740c1900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:43:56.406 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:56.405+0000 7f916bfff640 1 -- 172.21.15.73:0/2372581364 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9174155370 con 0x7f91740c1120 2023-12-12T09:43:56.407 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:56.406+0000 7f916bfff640 1 --2- 172.21.15.73:0/2372581364 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f91740c1120 0x7f917406a4e0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f91740721f0 tx=0x7f915c02b7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fad070d1a9ffe61d server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:43:56.407 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:56.406+0000 7f91737fe640 1 -- 172.21.15.73:0/2372581364 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f915c031750 con 0x7f91740c1120 2023-12-12T09:43:56.407 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:56.406+0000 7f91737fe640 1 -- 172.21.15.73:0/2372581364 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f915c0318b0 con 0x7f91740c1120 2023-12-12T09:43:56.407 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:56.406+0000 7f91737fe640 1 -- 172.21.15.73:0/2372581364 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f915c031c40 con 0x7f91740c1120 2023-12-12T09:43:56.408 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:56.407+0000 7f917a2d0640 1 -- 172.21.15.73:0/2372581364 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f91740c1120 msgr2=0x7f917406a4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:56.408 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:56.407+0000 7f917a2d0640 1 --2- 172.21.15.73:0/2372581364 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f91740c1120 0x7f917406a4e0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f91740721f0 tx=0x7f915c02b7f0 comp rx=0 tx=0).stop 2023-12-12T09:43:56.408 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:56.407+0000 7f917a2d0640 1 -- 172.21.15.73:0/2372581364 shutdown_connections 2023-12-12T09:43:56.408 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:56.407+0000 7f917a2d0640 1 --2- 172.21.15.73:0/2372581364 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f91740c1120 0x7f917406a4e0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:56.408 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:56.407+0000 7f917a2d0640 1 --2- 172.21.15.73:0/2372581364 >> v2:172.21.15.142:3300/0 conn(0x7f9174151a40 0x7f91740acbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:56.408 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:56.407+0000 7f917a2d0640 1 -- 172.21.15.73:0/2372581364 >> 172.21.15.73:0/2372581364 conn(0x7f91740c3850 msgr2=0x7f91740c3c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:43:56.409 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:56.407+0000 7f917a2d0640 1 -- 172.21.15.73:0/2372581364 shutdown_connections 2023-12-12T09:43:56.409 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:56.407+0000 7f917a2d0640 1 -- 172.21.15.73:0/2372581364 wait complete. 2023-12-12T09:43:56.409 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:56.409+0000 7f917a2d0640 1 Processor -- start 2023-12-12T09:43:56.410 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:56.409+0000 7f917a2d0640 1 -- start start 2023-12-12T09:43:56.411 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:56.410+0000 7f917a2d0640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f917406aa20 0x7f917414c190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:56.411 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:56.410+0000 7f917a2d0640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f91740c1120 0x7f917406cd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:56.411 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:56.410+0000 7f917a2d0640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9174151a40 0x7f91740bca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:56.411 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:56.410+0000 7f917a2d0640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9174158aa0 con 0x7f9174151a40 2023-12-12T09:43:56.411 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:56.410+0000 7f917a2d0640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91741577a0 con 0x7f917406aa20 2023-12-12T09:43:56.411 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:56.410+0000 7f917a2d0640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9174158200 con 0x7f91740c1120 2023-12-12T09:43:56.411 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:56.410+0000 7f917886d640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9174151a40 0x7f91740bca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:56.411 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:56.410+0000 7f917886d640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9174151a40 0x7f91740bca40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:45580/0 (socket says 172.21.15.73:45580) 2023-12-12T09:43:56.411 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:56.410+0000 7f917886d640 1 -- 172.21.15.73:0/505892540 learned_addr learned my addr 172.21.15.73:0/505892540 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:43:56.413 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:56.410+0000 7f916bfff640 1 --2- 172.21.15.73:0/505892540 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f91740c1120 0x7f917406cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:56.413 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:56.410+0000 7f9173fff640 1 --2- 172.21.15.73:0/505892540 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f917406aa20 0x7f917414c190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:56.413 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:56.410+0000 7f917886d640 1 -- 172.21.15.73:0/505892540 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f91740c1120 msgr2=0x7f917406cd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:56.413 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:56.410+0000 7f917886d640 1 --2- 172.21.15.73:0/505892540 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f91740c1120 0x7f917406cd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:56.413 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:56.410+0000 7f917886d640 1 -- 172.21.15.73:0/505892540 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f917406aa20 msgr2=0x7f917414c190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:56.413 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:56.410+0000 7f917886d640 1 --2- 172.21.15.73:0/505892540 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f917406aa20 0x7f917414c190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:56.413 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:56.410+0000 7f917886d640 1 -- 172.21.15.73:0/505892540 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f915c0094d0 con 0x7f9174151a40 2023-12-12T09:43:56.413 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:56.410+0000 7f916bfff640 1 --2- 172.21.15.73:0/505892540 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f91740c1120 0x7f917406cd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:43:56.413 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:56.411+0000 7f917886d640 1 --2- 172.21.15.73:0/505892540 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9174151a40 0x7f91740bca40 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f916c00b990 tx=0x7f916c00be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:43:56.413 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:56.411+0000 7f91717fa640 1 -- 172.21.15.73:0/505892540 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f916c00cba0 con 0x7f9174151a40 2023-12-12T09:43:56.413 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:56.411+0000 7f91717fa640 1 -- 172.21.15.73:0/505892540 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f916c00cd00 con 0x7f9174151a40 2023-12-12T09:43:56.413 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:56.411+0000 7f917a2d0640 1 -- 172.21.15.73:0/505892540 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91741584e0 con 0x7f9174151a40 2023-12-12T09:43:56.413 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:56.411+0000 7f91717fa640 1 -- 172.21.15.73:0/505892540 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f916c014680 con 0x7f9174151a40 2023-12-12T09:43:56.414 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:56.411+0000 7f917a2d0640 1 -- 172.21.15.73:0/505892540 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91741573c0 con 0x7f9174151a40 2023-12-12T09:43:56.414 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:56.412+0000 7f917a2d0640 1 -- 172.21.15.73:0/505892540 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9174067580 con 0x7f9174151a40 2023-12-12T09:43:56.414 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:56.413+0000 7f91717fa640 1 -- 172.21.15.73:0/505892540 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f916c01d3b0 con 0x7f9174151a40 2023-12-12T09:43:56.415 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:56.414+0000 7f91717fa640 1 --2- 172.21.15.73:0/505892540 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f915406ae40 0x7f915406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:56.415 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:56.414+0000 7f91717fa640 1 -- 172.21.15.73:0/505892540 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f916c089610 con 0x7f9174151a40 2023-12-12T09:43:56.418 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:56.414+0000 7f9173fff640 1 --2- 172.21.15.73:0/505892540 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f915406ae40 0x7f915406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:56.418 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:56.415+0000 7f9173fff640 1 --2- 172.21.15.73:0/505892540 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f915406ae40 0x7f915406d300 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f9164006fd0 tx=0x7f9164008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:43:56.419 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:56.419+0000 7f91717fa640 1 -- 172.21.15.73:0/505892540 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f916c054620 con 0x7f9174151a40 2023-12-12T09:43:56.680 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:56.679+0000 7f917a2d0640 1 -- 172.21.15.73:0/505892540 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_multifs_auth.TestClientsWithoutAuth.test_mount_all_caps_absent"]} v 0) v1 -- 0x7f91741543c0 con 0x7f9174151a40 2023-12-12T09:43:57.291 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:57.290+0000 7f91717fa640 1 -- 172.21.15.73:0/505892540 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_multifs_auth.TestClientsWithoutAuth.test_mount_all_caps_absent"]}]=0 v49) v1 ==== 162+0+0 (secure 0 0 0) 0x7f916c05e070 con 0x7f9174151a40 2023-12-12T09:43:57.295 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:57.294+0000 7f917a2d0640 1 -- 172.21.15.73:0/505892540 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f915406ae40 msgr2=0x7f915406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:57.296 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:57.294+0000 7f917a2d0640 1 --2- 172.21.15.73:0/505892540 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f915406ae40 0x7f915406d300 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f9164006fd0 tx=0x7f9164008040 comp rx=0 tx=0).stop 2023-12-12T09:43:57.296 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:57.294+0000 7f917a2d0640 1 -- 172.21.15.73:0/505892540 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9174151a40 msgr2=0x7f91740bca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:57.296 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:57.294+0000 7f917a2d0640 1 --2- 172.21.15.73:0/505892540 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9174151a40 0x7f91740bca40 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f916c00b990 tx=0x7f916c00be50 comp rx=0 tx=0).stop 2023-12-12T09:43:57.296 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:57.294+0000 7f917a2d0640 1 -- 172.21.15.73:0/505892540 shutdown_connections 2023-12-12T09:43:57.296 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:57.294+0000 7f917a2d0640 1 --2- 172.21.15.73:0/505892540 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f915406ae40 0x7f915406d300 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:57.296 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:57.294+0000 7f917a2d0640 1 --2- 172.21.15.73:0/505892540 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9174151a40 0x7f91740bca40 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:57.296 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:57.294+0000 7f917a2d0640 1 --2- 172.21.15.73:0/505892540 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f91740c1120 0x7f917406cd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:57.296 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:57.294+0000 7f917a2d0640 1 --2- 172.21.15.73:0/505892540 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f917406aa20 0x7f917414c190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:57.296 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:57.294+0000 7f917a2d0640 1 -- 172.21.15.73:0/505892540 >> 172.21.15.73:0/505892540 conn(0x7f91740c3850 msgr2=0x7f9174153ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:43:57.296 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:57.295+0000 7f917a2d0640 1 -- 172.21.15.73:0/505892540 shutdown_connections 2023-12-12T09:43:57.296 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:57.295+0000 7f917a2d0640 1 -- 172.21.15.73:0/505892540 wait complete. 2023-12-12T09:43:57.314 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-12-12T09:43:57.524 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:57.523+0000 7f3c63815640 1 Processor -- start 2023-12-12T09:43:57.525 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:57.524+0000 7f3c63815640 1 -- start start 2023-12-12T09:43:57.526 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:57.525+0000 7f3c63815640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f3c5c0c4d50 0x7f3c5c157c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:57.526 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:57.525+0000 7f3c63815640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c5c1557b0 con 0x7f3c5c0c2320 2023-12-12T09:43:57.526 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:57.525+0000 7f3c63815640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c5c0c1e90 con 0x7f3c5c1553d0 2023-12-12T09:43:57.526 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:57.525+0000 7f3c63815640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c5c158b30 con 0x7f3c5c0c4d50 2023-12-12T09:43:57.527 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:57.525+0000 7f3c61db2640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f3c5c0c2320 0x7f3c5c15ef30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:50126/0 (socket says 172.21.15.73:50126) 2023-12-12T09:43:57.527 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:57.525+0000 7f3c61db2640 1 -- 172.21.15.73:0/2241889961 learned_addr learned my addr 172.21.15.73:0/2241889961 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-12T09:43:57.529 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:57.526+0000 7f3c60db0640 1 --2- 172.21.15.73:0/2241889961 >> v2:172.21.15.142:3300/0 conn(0x7f3c5c0c4d50 0x7f3c5c157c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:57.529 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:57.526+0000 7f3c53fff640 1 -- 172.21.15.73:0/2241889961 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3980547948 0 0) 0x7f3c5c1557b0 con 0x7f3c5c0c2320 2023-12-12T09:43:57.529 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:57.526+0000 7f3c53fff640 1 -- 172.21.15.73:0/2241889961 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3c48003520 con 0x7f3c5c0c2320 2023-12-12T09:43:57.529 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:57.526+0000 7f3c53fff640 1 -- 172.21.15.73:0/2241889961 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2689100386 0 0) 0x7f3c48003520 con 0x7f3c5c0c2320 2023-12-12T09:43:57.529 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:57.526+0000 7f3c53fff640 1 -- 172.21.15.73:0/2241889961 >> v2:172.21.15.142:3300/0 conn(0x7f3c5c0c4d50 msgr2=0x7f3c5c157c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:43:57.529 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:57.526+0000 7f3c53fff640 1 --2- 172.21.15.73:0/2241889961 >> v2:172.21.15.142:3300/0 conn(0x7f3c5c0c4d50 0x7f3c5c157c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:57.529 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:57.526+0000 7f3c53fff640 1 -- 172.21.15.73:0/2241889961 >> v1:172.21.15.142:6789/0 conn(0x7f3c5c1553d0 legacy=0x7f3c5c06a4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:57.529 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:57.526+0000 7f3c53fff640 1 -- 172.21.15.73:0/2241889961 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c5c158290 con 0x7f3c5c0c2320 2023-12-12T09:43:57.529 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:57.526+0000 7f3c53fff640 1 -- 172.21.15.73:0/2241889961 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3186547832 0 0) 0x7f3c540019f0 con 0x7f3c5c0c2320 2023-12-12T09:43:57.529 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:57.526+0000 7f3c53fff640 1 -- 172.21.15.73:0/2241889961 >> v1:172.21.15.73:6789/0 conn(0x7f3c5c0c2320 legacy=0x7f3c5c15ef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:57.529 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:57.526+0000 7f3c53fff640 1 --2- 172.21.15.73:0/2241889961 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3c48003970 0x7f3c48003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:57.529 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:57.526+0000 7f3c53fff640 1 --2- 172.21.15.73:0/2241889961 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3c480047c0 0x7f3c48004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:57.529 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:57.526+0000 7f3c53fff640 1 --2- 172.21.15.73:0/2241889961 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3c48005180 0x7f3c4800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:57.530 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:57.526+0000 7f3c53fff640 1 -- 172.21.15.73:0/2241889961 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c5c158b30 con 0x7f3c48005180 2023-12-12T09:43:57.530 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:57.526+0000 7f3c53fff640 1 -- 172.21.15.73:0/2241889961 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c4800c020 con 0x7f3c480047c0 2023-12-12T09:43:57.530 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:57.526+0000 7f3c53fff640 1 -- 172.21.15.73:0/2241889961 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c4800c1e0 con 0x7f3c48003970 2023-12-12T09:43:57.530 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:57.527+0000 7f3c61db2640 1 --2- 172.21.15.73:0/2241889961 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3c48005180 0x7f3c4800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:57.530 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:57.527+0000 7f3c60db0640 1 --2- 172.21.15.73:0/2241889961 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3c480047c0 0x7f3c48004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:57.530 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:57.527+0000 7f3c61db2640 1 -- 172.21.15.73:0/2241889961 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3c48003970 msgr2=0x7f3c48003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:43:57.530 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:57.527+0000 7f3c61db2640 1 --2- 172.21.15.73:0/2241889961 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3c48003970 0x7f3c48003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:57.530 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:57.527+0000 7f3c61db2640 1 -- 172.21.15.73:0/2241889961 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3c480047c0 msgr2=0x7f3c48004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:43:57.530 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:57.527+0000 7f3c61db2640 1 --2- 172.21.15.73:0/2241889961 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3c480047c0 0x7f3c48004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:57.530 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:57.527+0000 7f3c61db2640 1 -- 172.21.15.73:0/2241889961 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c48003520 con 0x7f3c48005180 2023-12-12T09:43:57.530 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:57.527+0000 7f3c60db0640 1 --2- 172.21.15.73:0/2241889961 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3c480047c0 0x7f3c48004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:43:57.531 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:57.528+0000 7f3c61db2640 1 -- 172.21.15.73:0/2241889961 reap_dead start 2023-12-12T09:43:57.531 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:57.528+0000 7f3c61db2640 1 --2- 172.21.15.73:0/2241889961 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3c48005180 0x7f3c4800b980 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f3c5400a830 tx=0x7f3c480057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=561edf26b11ed536 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:43:57.531 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:57.529+0000 7f3c53fff640 1 -- 172.21.15.73:0/2241889961 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c540072d0 con 0x7f3c48005180 2023-12-12T09:43:57.532 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:57.529+0000 7f3c53fff640 1 -- 172.21.15.73:0/2241889961 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c5402f070 con 0x7f3c48005180 2023-12-12T09:43:57.532 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:57.529+0000 7f3c53fff640 1 -- 172.21.15.73:0/2241889961 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c540076b0 con 0x7f3c48005180 2023-12-12T09:43:57.532 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:57.529+0000 7f3c63815640 1 -- 172.21.15.73:0/2241889961 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3c48005180 msgr2=0x7f3c4800b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:57.532 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:57.529+0000 7f3c63815640 1 --2- 172.21.15.73:0/2241889961 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3c48005180 0x7f3c4800b980 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f3c5400a830 tx=0x7f3c480057f0 comp rx=0 tx=0).stop 2023-12-12T09:43:57.532 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:57.529+0000 7f3c63815640 1 -- 172.21.15.73:0/2241889961 shutdown_connections 2023-12-12T09:43:57.532 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:57.529+0000 7f3c63815640 1 --2- 172.21.15.73:0/2241889961 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3c48005180 0x7f3c4800b980 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:57.532 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:57.529+0000 7f3c63815640 1 -- 172.21.15.73:0/2241889961 >> 172.21.15.73:0/2241889961 conn(0x7f3c5c0c6ab0 msgr2=0x7f3c5c0c6e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:43:57.532 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:57.529+0000 7f3c63815640 1 -- 172.21.15.73:0/2241889961 shutdown_connections 2023-12-12T09:43:57.532 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:57.529+0000 7f3c63815640 1 -- 172.21.15.73:0/2241889961 wait complete. 2023-12-12T09:43:57.533 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:57.531+0000 7f3c63815640 1 Processor -- start 2023-12-12T09:43:57.533 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:57.531+0000 7f3c63815640 1 -- start start 2023-12-12T09:43:57.533 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:57.532+0000 7f3c63815640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3c48005180 0x7f3c5c1e7140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:57.533 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:57.532+0000 7f3c63815640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3c5c06d9c0 0x7f3c5c1e99e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:57.533 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:57.532+0000 7f3c63815640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3c5c14e360 0x7f3c5c0a99d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:57.533 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:57.532+0000 7f3c63815640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c5c0aa3f0 con 0x7f3c48005180 2023-12-12T09:43:57.534 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:57.532+0000 7f3c63815640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c5c14ac90 con 0x7f3c5c14e360 2023-12-12T09:43:57.534 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:57.532+0000 7f3c63815640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c5c1ed9e0 con 0x7f3c5c06d9c0 2023-12-12T09:43:57.534 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:57.532+0000 7f3c615b1640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3c48005180 0x7f3c5c1e7140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:57.534 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:57.532+0000 7f3c615b1640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3c48005180 0x7f3c5c1e7140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:45606/0 (socket says 172.21.15.73:45606) 2023-12-12T09:43:57.534 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:57.532+0000 7f3c615b1640 1 -- 172.21.15.73:0/2952092375 learned_addr learned my addr 172.21.15.73:0/2952092375 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:43:57.535 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:57.533+0000 7f3c61db2640 1 --2- 172.21.15.73:0/2952092375 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3c5c14e360 0x7f3c5c0a99d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:57.536 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:57.533+0000 7f3c60db0640 1 --2- 172.21.15.73:0/2952092375 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3c5c06d9c0 0x7f3c5c1e99e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:57.536 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:57.533+0000 7f3c615b1640 1 -- 172.21.15.73:0/2952092375 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3c5c06d9c0 msgr2=0x7f3c5c1e99e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:57.536 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:57.533+0000 7f3c615b1640 1 --2- 172.21.15.73:0/2952092375 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3c5c06d9c0 0x7f3c5c1e99e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:57.536 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:57.533+0000 7f3c615b1640 1 -- 172.21.15.73:0/2952092375 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3c5c14e360 msgr2=0x7f3c5c0a99d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:57.536 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:57.533+0000 7f3c615b1640 1 --2- 172.21.15.73:0/2952092375 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3c5c14e360 0x7f3c5c0a99d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:57.536 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:57.533+0000 7f3c615b1640 1 -- 172.21.15.73:0/2952092375 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c5c1eded0 con 0x7f3c48005180 2023-12-12T09:43:57.536 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:57.533+0000 7f3c615b1640 1 --2- 172.21.15.73:0/2952092375 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3c48005180 0x7f3c5c1e7140 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f3c5800c480 tx=0x7f3c5800c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:43:57.536 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:57.533+0000 7f3c51ffb640 1 -- 172.21.15.73:0/2952092375 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c580052d0 con 0x7f3c48005180 2023-12-12T09:43:57.536 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:57.534+0000 7f3c51ffb640 1 -- 172.21.15.73:0/2952092375 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c58005470 con 0x7f3c48005180 2023-12-12T09:43:57.536 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:57.534+0000 7f3c51ffb640 1 -- 172.21.15.73:0/2952092375 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c58007260 con 0x7f3c48005180 2023-12-12T09:43:57.536 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:57.534+0000 7f3c63815640 1 -- 172.21.15.73:0/2952092375 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c5c1e7680 con 0x7f3c48005180 2023-12-12T09:43:57.536 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:57.534+0000 7f3c63815640 1 -- 172.21.15.73:0/2952092375 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c5c06ce80 con 0x7f3c48005180 2023-12-12T09:43:57.536 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:57.535+0000 7f3c63815640 1 -- 172.21.15.73:0/2952092375 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c5c072a90 con 0x7f3c48005180 2023-12-12T09:43:57.537 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:57.536+0000 7f3c51ffb640 1 -- 172.21.15.73:0/2952092375 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f3c580073c0 con 0x7f3c48005180 2023-12-12T09:43:57.537 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:57.536+0000 7f3c51ffb640 1 --2- 172.21.15.73:0/2952092375 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f3c4006ae40 0x7f3c4006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:57.537 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:57.537+0000 7f3c51ffb640 1 -- 172.21.15.73:0/2952092375 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3c58088aa0 con 0x7f3c48005180 2023-12-12T09:43:57.538 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:57.537+0000 7f3c60db0640 1 --2- 172.21.15.73:0/2952092375 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f3c4006ae40 0x7f3c4006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:57.538 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:57.537+0000 7f3c60db0640 1 --2- 172.21.15.73:0/2952092375 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f3c4006ae40 0x7f3c4006d300 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f3c5c0ac990 tx=0x7f3c4c008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:43:57.542 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:57.541+0000 7f3c51ffb640 1 -- 172.21.15.73:0/2952092375 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f3c580575d0 con 0x7f3c48005180 2023-12-12T09:43:57.734 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:57.733+0000 7f3c63815640 1 -- 172.21.15.73:0/2952092375 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f3c5c067580 con 0x7f3c48005180 2023-12-12T09:43:57.739 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:57.738+0000 7f3c51ffb640 1 -- 172.21.15.73:0/2952092375 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) v1 ==== 122+0+0 (secure 0 0 0) 0x7f3c580160c0 con 0x7f3c48005180 2023-12-12T09:43:57.742 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:57.740+0000 7f3c63815640 1 -- 172.21.15.73:0/2952092375 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f3c4006ae40 msgr2=0x7f3c4006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:57.742 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:57.740+0000 7f3c63815640 1 --2- 172.21.15.73:0/2952092375 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f3c4006ae40 0x7f3c4006d300 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f3c5c0ac990 tx=0x7f3c4c008040 comp rx=0 tx=0).stop 2023-12-12T09:43:57.742 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:57.740+0000 7f3c63815640 1 -- 172.21.15.73:0/2952092375 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3c48005180 msgr2=0x7f3c5c1e7140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:57.742 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:57.740+0000 7f3c63815640 1 --2- 172.21.15.73:0/2952092375 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3c48005180 0x7f3c5c1e7140 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f3c5800c480 tx=0x7f3c5800c940 comp rx=0 tx=0).stop 2023-12-12T09:43:57.742 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:57.740+0000 7f3c63815640 1 -- 172.21.15.73:0/2952092375 shutdown_connections 2023-12-12T09:43:57.742 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:57.740+0000 7f3c63815640 1 --2- 172.21.15.73:0/2952092375 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f3c4006ae40 0x7f3c4006d300 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:57.742 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:57.740+0000 7f3c63815640 1 --2- 172.21.15.73:0/2952092375 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3c5c14e360 0x7f3c5c0a99d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:57.742 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:57.741+0000 7f3c63815640 1 --2- 172.21.15.73:0/2952092375 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3c5c06d9c0 0x7f3c5c1e99e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:57.742 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:57.741+0000 7f3c63815640 1 --2- 172.21.15.73:0/2952092375 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3c48005180 0x7f3c5c1e7140 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:57.742 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:57.741+0000 7f3c63815640 1 -- 172.21.15.73:0/2952092375 >> 172.21.15.73:0/2952092375 conn(0x7f3c5c0c6ab0 msgr2=0x7f3c5c06a4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:43:57.743 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:57.741+0000 7f3c63815640 1 -- 172.21.15.73:0/2952092375 shutdown_connections 2023-12-12T09:43:57.743 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:57.741+0000 7f3c63815640 1 -- 172.21.15.73:0/2952092375 wait complete. 2023-12-12T09:43:57.760 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-12-12T09:43:57.761 DEBUG:teuthology.orchestra.run.smithi073:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-12T09:43:57.881 DEBUG:teuthology.orchestra.run.smithi142:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-12T09:43:58.027 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-12-12T09:43:58.027 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2023-12-12T09:43:58.027 DEBUG:teuthology.orchestra.run.smithi073:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-12T09:43:58.084 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2023-12-12T09:43:58.085 DEBUG:teuthology.orchestra.run.smithi073:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-12T09:43:58.135 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2023-12-12T09:43:58.135 DEBUG:teuthology.orchestra.run.smithi073:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-12T09:43:58.187 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-12T09:43:58.402 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:58.401+0000 7f6a4bee7640 1 Processor -- start 2023-12-12T09:43:58.402 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:58.401+0000 7f6a4bee7640 1 -- start start 2023-12-12T09:43:58.404 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:58.402+0000 7f6a4bee7640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f6a4406db70 0x7f6a440c39b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:58.404 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:58.402+0000 7f6a4bee7640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f6a440c5070 0x7f6a440c3ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:58.404 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:58.402+0000 7f6a4bee7640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a44152610 con 0x7f6a4414fa40 2023-12-12T09:43:58.404 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:58.402+0000 7f6a4bee7640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a441528f0 con 0x7f6a4406db70 2023-12-12T09:43:58.404 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:58.402+0000 7f6a4bee7640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a44152bd0 con 0x7f6a440c5070 2023-12-12T09:43:58.405 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:58.403+0000 7f6a49482640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f6a4406db70 0x7f6a440c39b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:58.405 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:58.403+0000 7f6a49482640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f6a4406db70 0x7f6a440c39b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:45622/0 (socket says 172.21.15.73:45622) 2023-12-12T09:43:58.405 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:58.403+0000 7f6a49482640 1 -- 172.21.15.73:0/66133118 learned_addr learned my addr 172.21.15.73:0/66133118 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:43:58.405 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:58.403+0000 7f6a4a484640 1 --2- 172.21.15.73:0/66133118 >> v2:172.21.15.142:3300/0 conn(0x7f6a440c5070 0x7f6a440c3ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:58.405 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:58.403+0000 7f6a49482640 1 -- 172.21.15.73:0/66133118 >> v2:172.21.15.142:3300/0 conn(0x7f6a440c5070 msgr2=0x7f6a440c3ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:43:58.405 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:58.403+0000 7f6a49482640 1 --2- 172.21.15.73:0/66133118 >> v2:172.21.15.142:3300/0 conn(0x7f6a440c5070 0x7f6a440c3ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:58.405 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:58.403+0000 7f6a49482640 1 -- 172.21.15.73:0/66133118 >> v1:172.21.15.142:6789/0 conn(0x7f6a4414fa40 legacy=0x7f6a4406a4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:43:58.405 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:58.403+0000 7f6a49482640 1 -- 172.21.15.73:0/66133118 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a44152eb0 con 0x7f6a4406db70 2023-12-12T09:43:58.405 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:58.403+0000 7f6a4a484640 1 --2- 172.21.15.73:0/66133118 >> v2:172.21.15.142:3300/0 conn(0x7f6a440c5070 0x7f6a440c3ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:43:58.406 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:58.404+0000 7f6a49482640 1 --2- 172.21.15.73:0/66133118 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6a4406db70 0x7f6a440c39b0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f6a4406fc50 tx=0x7f6a3402b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95960fbe87716d8c server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:43:58.406 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:58.405+0000 7f6a48c81640 1 -- 172.21.15.73:0/66133118 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a34031870 con 0x7f6a4406db70 2023-12-12T09:43:58.407 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:58.405+0000 7f6a48c81640 1 -- 172.21.15.73:0/66133118 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a340319d0 con 0x7f6a4406db70 2023-12-12T09:43:58.407 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:58.405+0000 7f6a48c81640 1 -- 172.21.15.73:0/66133118 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a34031d60 con 0x7f6a4406db70 2023-12-12T09:43:58.407 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:58.405+0000 7f6a4bee7640 1 -- 172.21.15.73:0/66133118 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6a4406db70 msgr2=0x7f6a440c39b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:58.407 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:58.405+0000 7f6a4bee7640 1 --2- 172.21.15.73:0/66133118 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6a4406db70 0x7f6a440c39b0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f6a4406fc50 tx=0x7f6a3402b910 comp rx=0 tx=0).stop 2023-12-12T09:43:58.407 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:58.405+0000 7f6a4bee7640 1 -- 172.21.15.73:0/66133118 shutdown_connections 2023-12-12T09:43:58.407 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:58.405+0000 7f6a4bee7640 1 --2- 172.21.15.73:0/66133118 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6a4406db70 0x7f6a440c39b0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:58.407 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:58.405+0000 7f6a4bee7640 1 --2- 172.21.15.73:0/66133118 >> v2:172.21.15.142:3300/0 conn(0x7f6a440c5070 0x7f6a440c3ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:58.407 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:58.405+0000 7f6a4bee7640 1 -- 172.21.15.73:0/66133118 >> 172.21.15.73:0/66133118 conn(0x7f6a440a8130 msgr2=0x7f6a440c24b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:43:58.407 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:58.406+0000 7f6a4bee7640 1 -- 172.21.15.73:0/66133118 shutdown_connections 2023-12-12T09:43:58.407 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:58.406+0000 7f6a4bee7640 1 -- 172.21.15.73:0/66133118 wait complete. 2023-12-12T09:43:58.408 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:58.407+0000 7f6a4bee7640 1 Processor -- start 2023-12-12T09:43:58.408 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:58.408+0000 7f6a4bee7640 1 -- start start 2023-12-12T09:43:58.411 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:58.409+0000 7f6a4bee7640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6a4406db70 0x7f6a44071170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:58.411 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:58.409+0000 7f6a4bee7640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6a440c5070 0x7f6a44149770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:58.411 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:58.409+0000 7f6a4bee7640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6a4414fa40 0x7f6a441ed390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:58.411 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:58.409+0000 7f6a4bee7640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a44070ce0 con 0x7f6a4414fa40 2023-12-12T09:43:58.411 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:58.409+0000 7f6a4bee7640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a4414a4f0 con 0x7f6a4406db70 2023-12-12T09:43:58.411 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:58.409+0000 7f6a4bee7640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a4414a7d0 con 0x7f6a440c5070 2023-12-12T09:43:58.411 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:58.409+0000 7f6a4a484640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6a4414fa40 0x7f6a441ed390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:58.411 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:58.409+0000 7f6a4a484640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6a4414fa40 0x7f6a441ed390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:45632/0 (socket says 172.21.15.73:45632) 2023-12-12T09:43:58.411 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:58.409+0000 7f6a4a484640 1 -- 172.21.15.73:0/238978357 learned_addr learned my addr 172.21.15.73:0/238978357 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:43:58.412 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:58.409+0000 7f6a49c83640 1 --2- 172.21.15.73:0/238978357 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6a4406db70 0x7f6a44071170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:58.412 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:58.409+0000 7f6a49482640 1 --2- 172.21.15.73:0/238978357 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6a440c5070 0x7f6a44149770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:58.412 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:58.410+0000 7f6a4a484640 1 -- 172.21.15.73:0/238978357 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6a440c5070 msgr2=0x7f6a44149770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:58.412 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:58.410+0000 7f6a4a484640 1 --2- 172.21.15.73:0/238978357 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6a440c5070 0x7f6a44149770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:58.412 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:58.410+0000 7f6a4a484640 1 -- 172.21.15.73:0/238978357 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6a4406db70 msgr2=0x7f6a44071170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:58.412 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:58.410+0000 7f6a4a484640 1 --2- 172.21.15.73:0/238978357 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6a4406db70 0x7f6a44071170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:58.412 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:58.410+0000 7f6a4a484640 1 -- 172.21.15.73:0/238978357 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a340094d0 con 0x7f6a4414fa40 2023-12-12T09:43:58.412 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:58.410+0000 7f6a4a484640 1 --2- 172.21.15.73:0/238978357 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6a4414fa40 0x7f6a441ed390 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f6a3c00cef0 tx=0x7f6a3c00a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:43:58.413 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:58.410+0000 7f6a3a7fc640 1 -- 172.21.15.73:0/238978357 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a3c00d840 con 0x7f6a4414fa40 2023-12-12T09:43:58.413 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:58.410+0000 7f6a3a7fc640 1 -- 172.21.15.73:0/238978357 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a3c00d9c0 con 0x7f6a4414fa40 2023-12-12T09:43:58.413 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:58.410+0000 7f6a4bee7640 1 -- 172.21.15.73:0/238978357 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a4414aab0 con 0x7f6a4414fa40 2023-12-12T09:43:58.413 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:58.410+0000 7f6a3a7fc640 1 -- 172.21.15.73:0/238978357 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a3c00dd70 con 0x7f6a4414fa40 2023-12-12T09:43:58.413 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:58.410+0000 7f6a4bee7640 1 -- 172.21.15.73:0/238978357 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a44149cb0 con 0x7f6a4414fa40 2023-12-12T09:43:58.413 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:58.412+0000 7f6a4bee7640 1 -- 172.21.15.73:0/238978357 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a44070e50 con 0x7f6a4414fa40 2023-12-12T09:43:58.414 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:58.412+0000 7f6a3a7fc640 1 -- 172.21.15.73:0/238978357 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f6a3c01e3b0 con 0x7f6a4414fa40 2023-12-12T09:43:58.414 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:58.413+0000 7f6a3a7fc640 1 --2- 172.21.15.73:0/238978357 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f6a2806ae40 0x7f6a2806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:58.414 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:58.413+0000 7f6a3a7fc640 1 -- 172.21.15.73:0/238978357 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6a3c08a100 con 0x7f6a4414fa40 2023-12-12T09:43:58.414 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:58.414+0000 7f6a49c83640 1 --2- 172.21.15.73:0/238978357 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f6a2806ae40 0x7f6a2806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:58.415 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:58.414+0000 7f6a49c83640 1 --2- 172.21.15.73:0/238978357 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f6a2806ae40 0x7f6a2806d300 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f6a40007fd0 tx=0x7f6a40009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:43:58.419 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:58.418+0000 7f6a3a7fc640 1 -- 172.21.15.73:0/238978357 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f6a3c055260 con 0x7f6a4414fa40 2023-12-12T09:43:58.609 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:58.608+0000 7f6a4bee7640 1 -- 172.21.15.73:0/238978357 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6a44067580 con 0x7f6a4414fa40 2023-12-12T09:43:58.612 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:58.611+0000 7f6a3a7fc640 1 -- 172.21.15.73:0/238978357 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16517 (secure 0 0 0) 0x7f6a3c058880 con 0x7f6a4414fa40 2023-12-12T09:43:58.612 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-12T09:43:58.612 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":21,"fsid":"ba240992-02b8-4c7e-92f2-27eb29ac433b","created":"2023-12-12T09:43:02.454719+0000","modified":"2023-12-12T09:43:23.219345+0000","last_up_change":"2023-12-12T09:43:13.913440+0000","last_in_change":"2023-12-12T09:43:05.925348+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-12T09:43:15.525508+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-12T09:43:20.004546+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-12T09:43:20.736500+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"dd9074be-dbe2-4c34-9896-a4223d8d3940","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":4047810203},{"type":"v1","addr":"172.21.15.73:6801","nonce":4047810203}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":4047810203},{"type":"v1","addr":"172.21.15.73:6803","nonce":4047810203}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":4047810203},{"type":"v1","addr":"172.21.15.73:6807","nonce":4047810203}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":4047810203},{"type":"v1","addr":"172.21.15.73:6805","nonce":4047810203}]},"public_addr":"172.21.15.73:6801/4047810203","cluster_addr":"172.21.15.73:6803/4047810203","heartbeat_back_addr":"172.21.15.73:6807/4047810203","heartbeat_front_addr":"172.21.15.73:6805/4047810203","state":["exists","up"]},{"osd":1,"uuid":"c4a05052-96d4-4758-a4e1-1a37f1e07fed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":1356058331},{"type":"v1","addr":"172.21.15.73:6824","nonce":1356058331}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":1356058331},{"type":"v1","addr":"172.21.15.73:6827","nonce":1356058331}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":1356058331},{"type":"v1","addr":"172.21.15.73:6831","nonce":1356058331}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":1356058331},{"type":"v1","addr":"172.21.15.73:6829","nonce":1356058331}]},"public_addr":"172.21.15.73:6824/1356058331","cluster_addr":"172.21.15.73:6827/1356058331","heartbeat_back_addr":"172.21.15.73:6831/1356058331","heartbeat_front_addr":"172.21.15.73:6829/1356058331","state":["exists","up"]},{"osd":2,"uuid":"512bc8ac-72c2-40d4-b3d2-d867a92c5213","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":1228903316},{"type":"v1","addr":"172.21.15.73:6817","nonce":1228903316}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":1228903316},{"type":"v1","addr":"172.21.15.73:6819","nonce":1228903316}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6823","nonce":1228903316},{"type":"v1","addr":"172.21.15.73:6825","nonce":1228903316}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":1228903316},{"type":"v1","addr":"172.21.15.73:6821","nonce":1228903316}]},"public_addr":"172.21.15.73:6817/1228903316","cluster_addr":"172.21.15.73:6819/1228903316","heartbeat_back_addr":"172.21.15.73:6825/1228903316","heartbeat_front_addr":"172.21.15.73:6821/1228903316","state":["exists","up"]},{"osd":3,"uuid":"3d1a91e0-42bf-437a-8eae-8d357c8f63a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":1293329670},{"type":"v1","addr":"172.21.15.73:6809","nonce":1293329670}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6810","nonce":1293329670},{"type":"v1","addr":"172.21.15.73:6811","nonce":1293329670}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":1293329670},{"type":"v1","addr":"172.21.15.73:6815","nonce":1293329670}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":1293329670},{"type":"v1","addr":"172.21.15.73:6813","nonce":1293329670}]},"public_addr":"172.21.15.73:6809/1293329670","cluster_addr":"172.21.15.73:6811/1293329670","heartbeat_back_addr":"172.21.15.73:6815/1293329670","heartbeat_front_addr":"172.21.15.73:6813/1293329670","state":["exists","up"]},{"osd":4,"uuid":"4b302fff-834c-4069-ac19-00e46f6c87b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":3727975702},{"type":"v1","addr":"172.21.15.142:6801","nonce":3727975702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":3727975702},{"type":"v1","addr":"172.21.15.142:6803","nonce":3727975702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6809","nonce":3727975702},{"type":"v1","addr":"172.21.15.142:6811","nonce":3727975702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6805","nonce":3727975702},{"type":"v1","addr":"172.21.15.142:6807","nonce":3727975702}]},"public_addr":"172.21.15.142:6801/3727975702","cluster_addr":"172.21.15.142:6803/3727975702","heartbeat_back_addr":"172.21.15.142:6811/3727975702","heartbeat_front_addr":"172.21.15.142:6807/3727975702","state":["exists","up"]},{"osd":5,"uuid":"d7cdace2-67d0-45cc-95f2-515cf6ef1b82","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6817","nonce":2353193632},{"type":"v1","addr":"172.21.15.142:6819","nonce":2353193632}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6821","nonce":2353193632},{"type":"v1","addr":"172.21.15.142:6823","nonce":2353193632}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6829","nonce":2353193632},{"type":"v1","addr":"172.21.15.142:6831","nonce":2353193632}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6825","nonce":2353193632},{"type":"v1","addr":"172.21.15.142:6827","nonce":2353193632}]},"public_addr":"172.21.15.142:6819/2353193632","cluster_addr":"172.21.15.142:6823/2353193632","heartbeat_back_addr":"172.21.15.142:6831/2353193632","heartbeat_front_addr":"172.21.15.142:6827/2353193632","state":["exists","up"]},{"osd":6,"uuid":"649ce78a-5626-445c-aedc-a651ed05a6f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":2006111986},{"type":"v1","addr":"172.21.15.142:6806","nonce":2006111986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":2006111986},{"type":"v1","addr":"172.21.15.142:6810","nonce":2006111986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":2006111986},{"type":"v1","addr":"172.21.15.142:6815","nonce":2006111986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":2006111986},{"type":"v1","addr":"172.21.15.142:6813","nonce":2006111986}]},"public_addr":"172.21.15.142:6806/2006111986","cluster_addr":"172.21.15.142:6810/2006111986","heartbeat_back_addr":"172.21.15.142:6815/2006111986","heartbeat_front_addr":"172.21.15.142:6813/2006111986","state":["exists","up"]},{"osd":7,"uuid":"af15ae3b-c1d0-4acf-92db-8a1805494d13","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":2573794341},{"type":"v1","addr":"172.21.15.142:6818","nonce":2573794341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":2573794341},{"type":"v1","addr":"172.21.15.142:6822","nonce":2573794341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":2573794341},{"type":"v1","addr":"172.21.15.142:6830","nonce":2573794341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":2573794341},{"type":"v1","addr":"172.21.15.142:6826","nonce":2573794341}]},"public_addr":"172.21.15.142:6818/2573794341","cluster_addr":"172.21.15.142:6822/2573794341","heartbeat_back_addr":"172.21.15.142:6830/2573794341","heartbeat_front_addr":"172.21.15.142:6826/2573794341","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.185824+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.262103+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.225556+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:10.523459+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:10.706035+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.257339+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.301776+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.051960+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-12T09:43:58.615 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:58.613+0000 7f6a4bee7640 1 -- 172.21.15.73:0/238978357 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f6a2806ae40 msgr2=0x7f6a2806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:58.615 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:58.613+0000 7f6a4bee7640 1 --2- 172.21.15.73:0/238978357 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f6a2806ae40 0x7f6a2806d300 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f6a40007fd0 tx=0x7f6a40009040 comp rx=0 tx=0).stop 2023-12-12T09:43:58.615 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:58.613+0000 7f6a4bee7640 1 -- 172.21.15.73:0/238978357 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6a4414fa40 msgr2=0x7f6a441ed390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:58.615 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:58.613+0000 7f6a4bee7640 1 --2- 172.21.15.73:0/238978357 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6a4414fa40 0x7f6a441ed390 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f6a3c00cef0 tx=0x7f6a3c00a710 comp rx=0 tx=0).stop 2023-12-12T09:43:58.615 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:58.614+0000 7f6a4bee7640 1 -- 172.21.15.73:0/238978357 shutdown_connections 2023-12-12T09:43:58.615 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:58.614+0000 7f6a4bee7640 1 --2- 172.21.15.73:0/238978357 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f6a2806ae40 0x7f6a2806d300 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:58.615 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:58.614+0000 7f6a4bee7640 1 --2- 172.21.15.73:0/238978357 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6a4414fa40 0x7f6a441ed390 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:58.615 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:58.614+0000 7f6a4bee7640 1 --2- 172.21.15.73:0/238978357 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6a440c5070 0x7f6a44149770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:58.615 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:58.614+0000 7f6a4bee7640 1 --2- 172.21.15.73:0/238978357 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6a4406db70 0x7f6a44071170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:58.616 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:58.614+0000 7f6a4bee7640 1 -- 172.21.15.73:0/238978357 >> 172.21.15.73:0/238978357 conn(0x7f6a440a8130 msgr2=0x7f6a440c2440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:43:58.616 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:58.614+0000 7f6a4bee7640 1 -- 172.21.15.73:0/238978357 shutdown_connections 2023-12-12T09:43:58.616 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:58.614+0000 7f6a4bee7640 1 -- 172.21.15.73:0/238978357 wait complete. 2023-12-12T09:43:58.633 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-12T09:43:15.525508+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-12T09:43:20.004546+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-12T09:43:20.736500+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-12T09:43:58.634 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-12T09:43:58.846 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:58.845+0000 7f7f414df640 1 Processor -- start 2023-12-12T09:43:58.846 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:58.845+0000 7f7f414df640 1 -- start start 2023-12-12T09:43:58.848 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:58.847+0000 7f7f414df640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f7f3c14e770 0x7f7f3c0c5070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:58.849 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:58.847+0000 7f7f414df640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f7f3c0a4f30 0x7f7f3c0c1510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:58.849 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:58.847+0000 7f7f414df640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7f3c0a9a30 0x7f7f3c154530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:58.849 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:58.847+0000 7f7f414df640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f3c0c1080 con 0x7f7f3c0a4f30 2023-12-12T09:43:58.849 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:58.847+0000 7f7f414df640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f3c155470 con 0x7f7f3c14e770 2023-12-12T09:43:58.849 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:58.847+0000 7f7f414df640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f3c155190 con 0x7f7f3c0a9a30 2023-12-12T09:43:58.849 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:58.847+0000 7f7f33fff640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f7f3c0a4f30 0x7f7f3c0c1510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:58.849 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:58.847+0000 7f7f33fff640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f7f3c0a4f30 0x7f7f3c0c1510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:45638/0 (socket says 172.21.15.73:45638) 2023-12-12T09:43:58.849 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:58.847+0000 7f7f33fff640 1 -- 172.21.15.73:0/255642177 learned_addr learned my addr 172.21.15.73:0/255642177 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:43:58.849 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:58.847+0000 7f7f3bfff640 1 --2- 172.21.15.73:0/255642177 >> v2:172.21.15.142:3300/0 conn(0x7f7f3c14e770 0x7f7f3c0c5070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:58.849 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:58.847+0000 7f7f40cde640 1 --2- 172.21.15.73:0/255642177 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7f3c0a9a30 0x7f7f3c154530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:58.849 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:58.848+0000 7f7f33fff640 1 -- 172.21.15.73:0/255642177 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7f3c0a9a30 msgr2=0x7f7f3c154530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:43:58.849 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:58.848+0000 7f7f33fff640 1 --2- 172.21.15.73:0/255642177 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7f3c0a9a30 0x7f7f3c154530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:58.849 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:58.848+0000 7f7f33fff640 1 -- 172.21.15.73:0/255642177 >> v2:172.21.15.142:3300/0 conn(0x7f7f3c14e770 msgr2=0x7f7f3c0c5070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:43:58.850 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:58.848+0000 7f7f33fff640 1 --2- 172.21.15.73:0/255642177 >> v2:172.21.15.142:3300/0 conn(0x7f7f3c14e770 0x7f7f3c0c5070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:58.850 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:58.848+0000 7f7f33fff640 1 -- 172.21.15.73:0/255642177 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f3c0c0d10 con 0x7f7f3c0a4f30 2023-12-12T09:43:58.850 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:58.849+0000 7f7f33fff640 1 --2- 172.21.15.73:0/255642177 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7f3c0a4f30 0x7f7f3c0c1510 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f7f3c0749a0 tx=0x7f7f2402da00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d18b1af2c1038aac server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:43:58.850 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:58.849+0000 7f7f3b7fe640 1 -- 172.21.15.73:0/255642177 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f24031820 con 0x7f7f3c0a4f30 2023-12-12T09:43:58.850 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:58.849+0000 7f7f3b7fe640 1 -- 172.21.15.73:0/255642177 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f24031980 con 0x7f7f3c0a4f30 2023-12-12T09:43:58.850 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:58.849+0000 7f7f3b7fe640 1 -- 172.21.15.73:0/255642177 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f24031d10 con 0x7f7f3c0a4f30 2023-12-12T09:43:58.851 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:58.850+0000 7f7f414df640 1 -- 172.21.15.73:0/255642177 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7f3c0a4f30 msgr2=0x7f7f3c0c1510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:58.851 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:58.850+0000 7f7f414df640 1 --2- 172.21.15.73:0/255642177 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7f3c0a4f30 0x7f7f3c0c1510 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f7f3c0749a0 tx=0x7f7f2402da00 comp rx=0 tx=0).stop 2023-12-12T09:43:58.851 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:58.850+0000 7f7f414df640 1 -- 172.21.15.73:0/255642177 shutdown_connections 2023-12-12T09:43:58.851 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:58.850+0000 7f7f414df640 1 --2- 172.21.15.73:0/255642177 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7f3c0a9a30 0x7f7f3c154530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:58.851 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:58.850+0000 7f7f414df640 1 --2- 172.21.15.73:0/255642177 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7f3c0a4f30 0x7f7f3c0c1510 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:58.851 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:58.850+0000 7f7f414df640 1 --2- 172.21.15.73:0/255642177 >> v2:172.21.15.142:3300/0 conn(0x7f7f3c14e770 0x7f7f3c0c5070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:58.852 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:58.850+0000 7f7f414df640 1 -- 172.21.15.73:0/255642177 >> 172.21.15.73:0/255642177 conn(0x7f7f3c06a4e0 msgr2=0x7f7f3c06a8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:43:58.852 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:58.850+0000 7f7f414df640 1 -- 172.21.15.73:0/255642177 shutdown_connections 2023-12-12T09:43:58.852 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:58.850+0000 7f7f414df640 1 -- 172.21.15.73:0/255642177 wait complete. 2023-12-12T09:43:58.853 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:58.852+0000 7f7f414df640 1 Processor -- start 2023-12-12T09:43:58.853 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:58.852+0000 7f7f414df640 1 -- start start 2023-12-12T09:43:58.854 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:58.853+0000 7f7f414df640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7f3c0a4f30 0x7f7f3c148f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:58.854 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:58.853+0000 7f7f414df640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7f3c0a9a30 0x7f7f3c153050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:58.854 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:58.853+0000 7f7f414df640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7f3c14e770 0x7f7f3c153590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:58.854 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:58.853+0000 7f7f414df640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f3c149ae0 con 0x7f7f3c0a9a30 2023-12-12T09:43:58.854 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:58.853+0000 7f7f414df640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f3c14a7c0 con 0x7f7f3c0a4f30 2023-12-12T09:43:58.854 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:58.853+0000 7f7f414df640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f3c154d10 con 0x7f7f3c14e770 2023-12-12T09:43:58.854 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:58.853+0000 7f7f33fff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7f3c0a9a30 0x7f7f3c153050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:58.854 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:58.853+0000 7f7f33fff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7f3c0a9a30 0x7f7f3c153050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:45640/0 (socket says 172.21.15.73:45640) 2023-12-12T09:43:58.854 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:58.853+0000 7f7f33fff640 1 -- 172.21.15.73:0/2879320982 learned_addr learned my addr 172.21.15.73:0/2879320982 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:43:58.855 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:58.853+0000 7f7f33fff640 1 -- 172.21.15.73:0/2879320982 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7f3c14e770 msgr2=0x7f7f3c153590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:58.855 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:58.853+0000 7f7f33fff640 1 --2- 172.21.15.73:0/2879320982 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7f3c14e770 0x7f7f3c153590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:58.856 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:58.853+0000 7f7f33fff640 1 -- 172.21.15.73:0/2879320982 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7f3c0a4f30 msgr2=0x7f7f3c148f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:58.856 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:58.853+0000 7f7f33fff640 1 --2- 172.21.15.73:0/2879320982 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7f3c0a4f30 0x7f7f3c148f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:58.856 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:58.853+0000 7f7f33fff640 1 -- 172.21.15.73:0/2879320982 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f240094d0 con 0x7f7f3c0a9a30 2023-12-12T09:43:58.856 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:58.854+0000 7f7f33fff640 1 --2- 172.21.15.73:0/2879320982 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7f3c0a9a30 0x7f7f3c153050 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f7f2402da40 tx=0x7f7f240046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:43:58.856 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:58.854+0000 7f7f397fa640 1 -- 172.21.15.73:0/2879320982 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f24039c40 con 0x7f7f3c0a9a30 2023-12-12T09:43:58.856 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:58.854+0000 7f7f397fa640 1 -- 172.21.15.73:0/2879320982 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f24039dc0 con 0x7f7f3c0a9a30 2023-12-12T09:43:58.856 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:58.854+0000 7f7f397fa640 1 -- 172.21.15.73:0/2879320982 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f24043630 con 0x7f7f3c0a9a30 2023-12-12T09:43:58.856 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:58.854+0000 7f7f414df640 1 -- 172.21.15.73:0/2879320982 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f3c153ad0 con 0x7f7f3c0a9a30 2023-12-12T09:43:58.856 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:58.854+0000 7f7f414df640 1 -- 172.21.15.73:0/2879320982 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f3c152970 con 0x7f7f3c0a9a30 2023-12-12T09:43:58.856 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:58.855+0000 7f7f414df640 1 -- 172.21.15.73:0/2879320982 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f3c0aa170 con 0x7f7f3c0a9a30 2023-12-12T09:43:58.857 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:58.856+0000 7f7f397fa640 1 -- 172.21.15.73:0/2879320982 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f7f2402f040 con 0x7f7f3c0a9a30 2023-12-12T09:43:58.858 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:58.857+0000 7f7f397fa640 1 --2- 172.21.15.73:0/2879320982 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f7f1c06ae40 0x7f7f1c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:58.858 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:58.857+0000 7f7f397fa640 1 -- 172.21.15.73:0/2879320982 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7f240ab6a0 con 0x7f7f3c0a9a30 2023-12-12T09:43:58.858 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:58.857+0000 7f7f3bfff640 1 --2- 172.21.15.73:0/2879320982 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f7f1c06ae40 0x7f7f1c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:58.859 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:58.858+0000 7f7f3bfff640 1 --2- 172.21.15.73:0/2879320982 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f7f1c06ae40 0x7f7f1c06d300 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f7f2c006fd0 tx=0x7f7f2c008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:43:58.865 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:58.864+0000 7f7f397fa640 1 -- 172.21.15.73:0/2879320982 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f7f24076740 con 0x7f7f3c0a9a30 2023-12-12T09:43:59.053 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:59.052+0000 7f7f414df640 1 -- 172.21.15.73:0/2879320982 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f7f3c067400 con 0x7f7f3c0a9a30 2023-12-12T09:43:59.054 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:59.053+0000 7f7f397fa640 1 -- 172.21.15.73:0/2879320982 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7f7f24079d60 con 0x7f7f3c0a9a30 2023-12-12T09:43:59.054 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 1 2023-12-12T09:43:59.057 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:59.055+0000 7f7f414df640 1 -- 172.21.15.73:0/2879320982 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f7f1c06ae40 msgr2=0x7f7f1c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:59.057 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:59.055+0000 7f7f414df640 1 --2- 172.21.15.73:0/2879320982 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f7f1c06ae40 0x7f7f1c06d300 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f7f2c006fd0 tx=0x7f7f2c008040 comp rx=0 tx=0).stop 2023-12-12T09:43:59.057 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:59.055+0000 7f7f414df640 1 -- 172.21.15.73:0/2879320982 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7f3c0a9a30 msgr2=0x7f7f3c153050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:59.057 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:59.055+0000 7f7f414df640 1 --2- 172.21.15.73:0/2879320982 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7f3c0a9a30 0x7f7f3c153050 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f7f2402da40 tx=0x7f7f240046c0 comp rx=0 tx=0).stop 2023-12-12T09:43:59.057 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:59.056+0000 7f7f414df640 1 -- 172.21.15.73:0/2879320982 shutdown_connections 2023-12-12T09:43:59.057 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:59.056+0000 7f7f414df640 1 --2- 172.21.15.73:0/2879320982 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f7f1c06ae40 0x7f7f1c06d300 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:59.057 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:59.056+0000 7f7f414df640 1 --2- 172.21.15.73:0/2879320982 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7f3c14e770 0x7f7f3c153590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:59.057 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:59.056+0000 7f7f414df640 1 --2- 172.21.15.73:0/2879320982 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7f3c0a9a30 0x7f7f3c153050 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:59.057 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:59.056+0000 7f7f414df640 1 --2- 172.21.15.73:0/2879320982 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7f3c0a4f30 0x7f7f3c148f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:59.057 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:59.056+0000 7f7f414df640 1 -- 172.21.15.73:0/2879320982 >> 172.21.15.73:0/2879320982 conn(0x7f7f3c06a4e0 msgr2=0x7f7f3c0bec00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:43:59.058 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:59.056+0000 7f7f414df640 1 -- 172.21.15.73:0/2879320982 shutdown_connections 2023-12-12T09:43:59.058 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:59.056+0000 7f7f414df640 1 -- 172.21.15.73:0/2879320982 wait complete. 2023-12-12T09:43:59.075 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-12T09:43:59.288 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:59.287+0000 7f6d85289640 1 Processor -- start 2023-12-12T09:43:59.289 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:59.287+0000 7f6d85289640 1 -- start start 2023-12-12T09:43:59.291 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:59.289+0000 7f6d85289640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6d8014ea60 0x7f6d800c5420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:59.291 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:59.289+0000 7f6d85289640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f6d800c0320 0x7f6d800c20b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:59.291 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:59.289+0000 7f6d85289640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d800c3390 con 0x7f6d800a4c90 2023-12-12T09:43:59.291 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:59.289+0000 7f6d85289640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d800c4b30 con 0x7f6d800c0320 2023-12-12T09:43:59.291 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:59.289+0000 7f6d85289640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d80151e60 con 0x7f6d8014ea60 2023-12-12T09:43:59.291 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:59.290+0000 7f6d7f7fe640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f6d800c0320 0x7f6d800c20b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:59.291 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:59.290+0000 7f6d7effd640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6d8014ea60 0x7f6d800c5420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:59.292 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:59.290+0000 7f6d7f7fe640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f6d800c0320 0x7f6d800c20b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.73:52440/0 (socket says 172.21.15.73:52440) 2023-12-12T09:43:59.292 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:59.290+0000 7f6d7f7fe640 1 -- 172.21.15.73:0/1758362030 learned_addr learned my addr 172.21.15.73:0/1758362030 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:43:59.292 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:59.291+0000 7f6d7f7fe640 1 -- 172.21.15.73:0/1758362030 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6d8014ea60 msgr2=0x7f6d800c5420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:43:59.292 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:59.291+0000 7f6d7f7fe640 1 --2- 172.21.15.73:0/1758362030 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6d8014ea60 0x7f6d800c5420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:59.292 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:59.291+0000 7f6d7f7fe640 1 -- 172.21.15.73:0/1758362030 >> v1:172.21.15.142:6789/0 conn(0x7f6d800a4c90 legacy=0x7f6d800c4420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:59.292 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:59.291+0000 7f6d7f7fe640 1 -- 172.21.15.73:0/1758362030 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d80152140 con 0x7f6d800c0320 2023-12-12T09:43:59.293 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:59.292+0000 7f6d7f7fe640 1 --2- 172.21.15.73:0/1758362030 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6d800c0320 0x7f6d800c20b0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f6d78009e50 tx=0x7f6d7802bee0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1a8c77e60df5b75e server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:43:59.294 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:59.293+0000 7f6d7e7fc640 1 -- 172.21.15.73:0/1758362030 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d7802ca80 con 0x7f6d800c0320 2023-12-12T09:43:59.294 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:59.293+0000 7f6d7e7fc640 1 -- 172.21.15.73:0/1758362030 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d7802cbe0 con 0x7f6d800c0320 2023-12-12T09:43:59.294 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:59.293+0000 7f6d7e7fc640 1 -- 172.21.15.73:0/1758362030 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d780343f0 con 0x7f6d800c0320 2023-12-12T09:43:59.295 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:59.294+0000 7f6d85289640 1 -- 172.21.15.73:0/1758362030 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6d800c0320 msgr2=0x7f6d800c20b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:59.295 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:59.294+0000 7f6d85289640 1 --2- 172.21.15.73:0/1758362030 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6d800c0320 0x7f6d800c20b0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f6d78009e50 tx=0x7f6d7802bee0 comp rx=0 tx=0).stop 2023-12-12T09:43:59.295 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:59.294+0000 7f6d85289640 1 -- 172.21.15.73:0/1758362030 shutdown_connections 2023-12-12T09:43:59.295 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:59.294+0000 7f6d85289640 1 --2- 172.21.15.73:0/1758362030 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6d800c0320 0x7f6d800c20b0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:59.296 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:59.294+0000 7f6d85289640 1 --2- 172.21.15.73:0/1758362030 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6d8014ea60 0x7f6d800c5420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:59.296 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:59.294+0000 7f6d85289640 1 -- 172.21.15.73:0/1758362030 >> 172.21.15.73:0/1758362030 conn(0x7f6d8006a4e0 msgr2=0x7f6d8006a8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:43:59.296 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:59.294+0000 7f6d85289640 1 -- 172.21.15.73:0/1758362030 shutdown_connections 2023-12-12T09:43:59.296 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:59.294+0000 7f6d85289640 1 -- 172.21.15.73:0/1758362030 wait complete. 2023-12-12T09:43:59.297 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:59.296+0000 7f6d85289640 1 Processor -- start 2023-12-12T09:43:59.297 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:59.297+0000 7f6d85289640 1 -- start start 2023-12-12T09:43:59.299 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:59.298+0000 7f6d85289640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6d800a4c90 0x7f6d800aae10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:59.299 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:59.298+0000 7f6d85289640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6d800c0320 0x7f6d801ea0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:59.299 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:59.298+0000 7f6d85289640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6d8014ea60 0x7f6d801ea5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:59.299 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:59.298+0000 7f6d85289640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d80153960 con 0x7f6d8014ea60 2023-12-12T09:43:59.299 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:59.298+0000 7f6d85289640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d80152d20 con 0x7f6d800c0320 2023-12-12T09:43:59.299 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:59.298+0000 7f6d85289640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d801529f0 con 0x7f6d800a4c90 2023-12-12T09:43:59.300 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:59.298+0000 7f6d7f7fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6d8014ea60 0x7f6d801ea5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:59.300 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:59.298+0000 7f6d7f7fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6d8014ea60 0x7f6d801ea5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:36096/0 (socket says 172.21.15.73:36096) 2023-12-12T09:43:59.300 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:59.298+0000 7f6d7f7fe640 1 -- 172.21.15.73:0/1460354921 learned_addr learned my addr 172.21.15.73:0/1460354921 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:43:59.301 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:59.299+0000 7f6d7effd640 1 --2- 172.21.15.73:0/1460354921 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6d800a4c90 0x7f6d800aae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:59.301 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:59.299+0000 7f6d767fc640 1 --2- 172.21.15.73:0/1460354921 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6d800c0320 0x7f6d801ea0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:59.301 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:59.299+0000 7f6d7f7fe640 1 -- 172.21.15.73:0/1460354921 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6d800a4c90 msgr2=0x7f6d800aae10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:59.301 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:59.299+0000 7f6d7f7fe640 1 --2- 172.21.15.73:0/1460354921 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6d800a4c90 0x7f6d800aae10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:59.301 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:59.299+0000 7f6d7f7fe640 1 -- 172.21.15.73:0/1460354921 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6d800c0320 msgr2=0x7f6d801ea0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:59.301 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:59.299+0000 7f6d7f7fe640 1 --2- 172.21.15.73:0/1460354921 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6d800c0320 0x7f6d801ea0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:59.301 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:59.299+0000 7f6d7f7fe640 1 -- 172.21.15.73:0/1460354921 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d78009b30 con 0x7f6d8014ea60 2023-12-12T09:43:59.301 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:59.299+0000 7f6d767fc640 1 --2- 172.21.15.73:0/1460354921 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6d800c0320 0x7f6d801ea0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:43:59.302 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:59.299+0000 7f6d7effd640 1 --2- 172.21.15.73:0/1460354921 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6d800a4c90 0x7f6d800aae10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:43:59.302 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:59.299+0000 7f6d7f7fe640 1 --2- 172.21.15.73:0/1460354921 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6d8014ea60 0x7f6d801ea5f0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f6d78009e50 tx=0x7f6d78004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:43:59.302 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:59.299+0000 7f6d77fff640 1 -- 172.21.15.73:0/1460354921 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d7803e450 con 0x7f6d8014ea60 2023-12-12T09:43:59.302 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:59.299+0000 7f6d77fff640 1 -- 172.21.15.73:0/1460354921 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d7803e5b0 con 0x7f6d8014ea60 2023-12-12T09:43:59.302 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:59.299+0000 7f6d77fff640 1 -- 172.21.15.73:0/1460354921 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d7803e960 con 0x7f6d8014ea60 2023-12-12T09:43:59.302 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:59.299+0000 7f6d85289640 1 -- 172.21.15.73:0/1460354921 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d801496b0 con 0x7f6d8014ea60 2023-12-12T09:43:59.302 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:59.300+0000 7f6d85289640 1 -- 172.21.15.73:0/1460354921 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d800ab350 con 0x7f6d8014ea60 2023-12-12T09:43:59.302 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:59.301+0000 7f6d85289640 1 -- 172.21.15.73:0/1460354921 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d80067070 con 0x7f6d8014ea60 2023-12-12T09:43:59.303 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:59.302+0000 7f6d77fff640 1 -- 172.21.15.73:0/1460354921 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f6d7802cd50 con 0x7f6d8014ea60 2023-12-12T09:43:59.304 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:59.303+0000 7f6d77fff640 1 --2- 172.21.15.73:0/1460354921 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f6d6006ae70 0x7f6d6006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:59.304 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:59.303+0000 7f6d77fff640 1 -- 172.21.15.73:0/1460354921 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6d780ac080 con 0x7f6d8014ea60 2023-12-12T09:43:59.304 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:59.303+0000 7f6d7effd640 1 --2- 172.21.15.73:0/1460354921 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f6d6006ae70 0x7f6d6006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:59.304 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:59.304+0000 7f6d7effd640 1 --2- 172.21.15.73:0/1460354921 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f6d6006ae70 0x7f6d6006d330 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f6d80151bc0 tx=0x7f6d70008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:43:59.310 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:59.309+0000 7f6d77fff640 1 -- 172.21.15.73:0/1460354921 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f6d780772e0 con 0x7f6d8014ea60 2023-12-12T09:43:59.502 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:59.501+0000 7f6d85289640 1 -- 172.21.15.73:0/1460354921 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f6d80067580 con 0x7f6d8014ea60 2023-12-12T09:43:59.503 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:59.502+0000 7f6d77fff640 1 -- 172.21.15.73:0/1460354921 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7f6d7807a900 con 0x7f6d8014ea60 2023-12-12T09:43:59.503 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 32 2023-12-12T09:43:59.506 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:59.504+0000 7f6d85289640 1 -- 172.21.15.73:0/1460354921 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f6d6006ae70 msgr2=0x7f6d6006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:59.506 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:59.504+0000 7f6d85289640 1 --2- 172.21.15.73:0/1460354921 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f6d6006ae70 0x7f6d6006d330 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f6d80151bc0 tx=0x7f6d70008040 comp rx=0 tx=0).stop 2023-12-12T09:43:59.506 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:59.504+0000 7f6d85289640 1 -- 172.21.15.73:0/1460354921 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6d8014ea60 msgr2=0x7f6d801ea5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:59.506 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:59.504+0000 7f6d85289640 1 --2- 172.21.15.73:0/1460354921 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6d8014ea60 0x7f6d801ea5f0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f6d78009e50 tx=0x7f6d78004a40 comp rx=0 tx=0).stop 2023-12-12T09:43:59.506 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:59.504+0000 7f6d85289640 1 -- 172.21.15.73:0/1460354921 shutdown_connections 2023-12-12T09:43:59.506 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:59.504+0000 7f6d85289640 1 --2- 172.21.15.73:0/1460354921 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f6d6006ae70 0x7f6d6006d330 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:59.506 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:59.505+0000 7f6d85289640 1 --2- 172.21.15.73:0/1460354921 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6d8014ea60 0x7f6d801ea5f0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:59.506 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:59.505+0000 7f6d85289640 1 --2- 172.21.15.73:0/1460354921 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6d800c0320 0x7f6d801ea0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:59.506 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:59.505+0000 7f6d85289640 1 --2- 172.21.15.73:0/1460354921 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6d800a4c90 0x7f6d800aae10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:59.506 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:59.505+0000 7f6d85289640 1 -- 172.21.15.73:0/1460354921 >> 172.21.15.73:0/1460354921 conn(0x7f6d8006a4e0 msgr2=0x7f6d800c1840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:43:59.507 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:59.505+0000 7f6d85289640 1 -- 172.21.15.73:0/1460354921 shutdown_connections 2023-12-12T09:43:59.507 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:59.505+0000 7f6d85289640 1 -- 172.21.15.73:0/1460354921 wait complete. 2023-12-12T09:43:59.525 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-12T09:43:59.739 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:59.738+0000 7f2816fa0640 1 Processor -- start 2023-12-12T09:43:59.739 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:59.738+0000 7f2816fa0640 1 -- start start 2023-12-12T09:43:59.743 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:59.739+0000 7f2816fa0640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f281014e770 0x7f28100c5070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:59.743 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:59.739+0000 7f2816fa0640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28100c1080 con 0x7f28100a9a30 2023-12-12T09:43:59.744 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:59.739+0000 7f2816fa0640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2810155470 con 0x7f28100a4f30 2023-12-12T09:43:59.744 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:59.739+0000 7f2816fa0640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2810155190 con 0x7f281014e770 2023-12-12T09:43:59.744 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:59.740+0000 7f281679f640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f28100a9a30 0x7f2810154530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:54510/0 (socket says 172.21.15.73:54510) 2023-12-12T09:43:59.744 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:59.740+0000 7f281679f640 1 -- 172.21.15.73:0/95160453 learned_addr learned my addr 172.21.15.73:0/95160453 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-12T09:43:59.744 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:59.740+0000 7f2815f9e640 1 --2- 172.21.15.73:0/95160453 >> v2:172.21.15.142:3300/0 conn(0x7f281014e770 0x7f28100c5070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:59.744 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:59.740+0000 7f2814f9c640 1 -- 172.21.15.73:0/95160453 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3551278083 0 0) 0x7f28100c1080 con 0x7f28100a9a30 2023-12-12T09:43:59.744 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:59.740+0000 7f2814f9c640 1 -- 172.21.15.73:0/95160453 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f27fc003520 con 0x7f28100a9a30 2023-12-12T09:43:59.744 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:59.740+0000 7f2814f9c640 1 -- 172.21.15.73:0/95160453 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3757660072 0 0) 0x7f27fc003520 con 0x7f28100a9a30 2023-12-12T09:43:59.745 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:59.740+0000 7f2814f9c640 1 -- 172.21.15.73:0/95160453 >> v2:172.21.15.142:3300/0 conn(0x7f281014e770 msgr2=0x7f28100c5070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:43:59.745 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:59.740+0000 7f2814f9c640 1 --2- 172.21.15.73:0/95160453 >> v2:172.21.15.142:3300/0 conn(0x7f281014e770 0x7f28100c5070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:59.745 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:59.741+0000 7f2814f9c640 1 -- 172.21.15.73:0/95160453 >> v1:172.21.15.142:6789/0 conn(0x7f28100a4f30 legacy=0x7f28100c1510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:59.745 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:59.741+0000 7f2814f9c640 1 -- 172.21.15.73:0/95160453 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28100c0d10 con 0x7f28100a9a30 2023-12-12T09:43:59.745 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:59.741+0000 7f2814f9c640 1 -- 172.21.15.73:0/95160453 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3186547832 0 0) 0x7f28080019f0 con 0x7f28100a9a30 2023-12-12T09:43:59.745 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:59.741+0000 7f2814f9c640 1 -- 172.21.15.73:0/95160453 >> v1:172.21.15.73:6789/0 conn(0x7f28100a9a30 legacy=0x7f2810154530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:59.746 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:59.741+0000 7f2814f9c640 1 --2- 172.21.15.73:0/95160453 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f27fc003970 0x7f27fc003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:59.746 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:59.741+0000 7f2814f9c640 1 --2- 172.21.15.73:0/95160453 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f27fc0047c0 0x7f27fc004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:59.746 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:59.741+0000 7f2814f9c640 1 --2- 172.21.15.73:0/95160453 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f27fc0052a0 0x7f27fc00db90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:59.746 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:59.741+0000 7f2814f9c640 1 -- 172.21.15.73:0/95160453 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2810155190 con 0x7f27fc0047c0 2023-12-12T09:43:59.746 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:59.741+0000 7f2814f9c640 1 -- 172.21.15.73:0/95160453 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27fc00e380 con 0x7f27fc003970 2023-12-12T09:43:59.746 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:59.741+0000 7f2814f9c640 1 -- 172.21.15.73:0/95160453 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27fc00e540 con 0x7f27fc0052a0 2023-12-12T09:43:59.746 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:59.741+0000 7f281579d640 1 --2- 172.21.15.73:0/95160453 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f27fc0047c0 0x7f27fc004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:59.746 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:59.741+0000 7f2815f9e640 1 --2- 172.21.15.73:0/95160453 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f27fc003970 0x7f27fc003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:59.747 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:59.741+0000 7f281679f640 1 --2- 172.21.15.73:0/95160453 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f27fc0052a0 0x7f27fc00db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:59.747 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:59.741+0000 7f281579d640 1 -- 172.21.15.73:0/95160453 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f27fc0052a0 msgr2=0x7f27fc00db90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:43:59.747 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:59.742+0000 7f281579d640 1 --2- 172.21.15.73:0/95160453 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f27fc0052a0 0x7f27fc00db90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:59.747 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:59.742+0000 7f281579d640 1 -- 172.21.15.73:0/95160453 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f27fc003970 msgr2=0x7f27fc003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:43:59.747 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:59.742+0000 7f281579d640 1 --2- 172.21.15.73:0/95160453 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f27fc003970 0x7f27fc003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:59.747 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:59.742+0000 7f281579d640 1 -- 172.21.15.73:0/95160453 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27fc003520 con 0x7f27fc0047c0 2023-12-12T09:43:59.747 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:59.742+0000 7f281679f640 1 -- 172.21.15.73:0/95160453 reap_dead start 2023-12-12T09:43:59.748 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:59.742+0000 7f2815f9e640 1 --2- 172.21.15.73:0/95160453 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f27fc003970 0x7f27fc003d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:43:59.754 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:59.743+0000 7f281579d640 1 --2- 172.21.15.73:0/95160453 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f27fc0047c0 0x7f27fc004c40 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f2800001720 tx=0x7f27fc0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a477627e21eba850 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:43:59.754 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:59.743+0000 7f2814f9c640 1 -- 172.21.15.73:0/95160453 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28000052d0 con 0x7f27fc0047c0 2023-12-12T09:43:59.755 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:59.743+0000 7f2814f9c640 1 -- 172.21.15.73:0/95160453 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f280002e050 con 0x7f27fc0047c0 2023-12-12T09:43:59.755 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:59.743+0000 7f2814f9c640 1 -- 172.21.15.73:0/95160453 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2800003830 con 0x7f27fc0047c0 2023-12-12T09:43:59.755 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:59.744+0000 7f2816fa0640 1 -- 172.21.15.73:0/95160453 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f27fc0047c0 msgr2=0x7f27fc004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:59.755 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:59.744+0000 7f2816fa0640 1 --2- 172.21.15.73:0/95160453 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f27fc0047c0 0x7f27fc004c40 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f2800001720 tx=0x7f27fc0057f0 comp rx=0 tx=0).stop 2023-12-12T09:43:59.755 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:59.744+0000 7f2816fa0640 1 -- 172.21.15.73:0/95160453 shutdown_connections 2023-12-12T09:43:59.756 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:59.744+0000 7f2816fa0640 1 --2- 172.21.15.73:0/95160453 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f27fc0047c0 0x7f27fc004c40 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:59.756 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:59.744+0000 7f2816fa0640 1 -- 172.21.15.73:0/95160453 >> 172.21.15.73:0/95160453 conn(0x7f281006a4e0 msgr2=0x7f281006a8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:43:59.756 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:59.744+0000 7f2816fa0640 1 -- 172.21.15.73:0/95160453 shutdown_connections 2023-12-12T09:43:59.756 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:59.744+0000 7f2816fa0640 1 -- 172.21.15.73:0/95160453 wait complete. 2023-12-12T09:43:59.756 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:59.746+0000 7f2816fa0640 1 Processor -- start 2023-12-12T09:43:59.756 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:59.746+0000 7f2816fa0640 1 -- start start 2023-12-12T09:43:59.757 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:59.747+0000 7f2816fa0640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f27fc0047c0 0x7f28101515b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:59.757 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:59.747+0000 7f2816fa0640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2810152200 0x7f2810152bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:59.757 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:59.747+0000 7f2816fa0640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2810154410 0x7f2810153130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:59.757 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:59.747+0000 7f2816fa0640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f281014f810 con 0x7f27fc0047c0 2023-12-12T09:43:59.757 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:59.747+0000 7f2816fa0640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2810153670 con 0x7f2810154410 2023-12-12T09:43:59.757 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:59.747+0000 7f2816fa0640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f281014eee0 con 0x7f2810152200 2023-12-12T09:43:59.757 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:59.747+0000 7f2815f9e640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f27fc0047c0 0x7f28101515b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:59.757 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:59.747+0000 7f2815f9e640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f27fc0047c0 0x7f28101515b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:36104/0 (socket says 172.21.15.73:36104) 2023-12-12T09:43:59.757 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:59.747+0000 7f2815f9e640 1 -- 172.21.15.73:0/463122857 learned_addr learned my addr 172.21.15.73:0/463122857 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:43:59.758 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:59.747+0000 7f2815f9e640 1 -- 172.21.15.73:0/463122857 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2810152200 msgr2=0x7f2810152bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:59.758 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:59.747+0000 7f2815f9e640 1 --2- 172.21.15.73:0/463122857 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2810152200 0x7f2810152bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:59.758 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:59.747+0000 7f2815f9e640 1 -- 172.21.15.73:0/463122857 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2810154410 msgr2=0x7f2810153130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:59.758 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:59.747+0000 7f2815f9e640 1 --2- 172.21.15.73:0/463122857 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2810154410 0x7f2810153130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:59.758 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:59.747+0000 7f2815f9e640 1 -- 172.21.15.73:0/463122857 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28101ea970 con 0x7f27fc0047c0 2023-12-12T09:43:59.758 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:59.748+0000 7f2815f9e640 1 --2- 172.21.15.73:0/463122857 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f27fc0047c0 0x7f28101515b0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f280c0107c0 tx=0x7f280c010c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:43:59.758 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:59.748+0000 7f28067fc640 1 -- 172.21.15.73:0/463122857 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f280c00eb60 con 0x7f27fc0047c0 2023-12-12T09:43:59.758 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:59.748+0000 7f28067fc640 1 -- 172.21.15.73:0/463122857 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f280c010ed0 con 0x7f27fc0047c0 2023-12-12T09:43:59.758 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:59.748+0000 7f28067fc640 1 -- 172.21.15.73:0/463122857 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f280c00eee0 con 0x7f27fc0047c0 2023-12-12T09:43:59.758 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:59.748+0000 7f2816fa0640 1 -- 172.21.15.73:0/463122857 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28101eac50 con 0x7f27fc0047c0 2023-12-12T09:43:59.759 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:59.748+0000 7f2816fa0640 1 -- 172.21.15.73:0/463122857 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f281014fc60 con 0x7f27fc0047c0 2023-12-12T09:43:59.759 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:59.749+0000 7f2816fa0640 1 -- 172.21.15.73:0/463122857 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2810067400 con 0x7f27fc0047c0 2023-12-12T09:43:59.759 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:59.750+0000 7f28067fc640 1 -- 172.21.15.73:0/463122857 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f280c01c400 con 0x7f27fc0047c0 2023-12-12T09:43:59.759 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:59.751+0000 7f28067fc640 1 --2- 172.21.15.73:0/463122857 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f27f406ae70 0x7f27f406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:43:59.759 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:59.751+0000 7f28067fc640 1 -- 172.21.15.73:0/463122857 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f280c089a90 con 0x7f27fc0047c0 2023-12-12T09:43:59.759 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:59.751+0000 7f281579d640 1 --2- 172.21.15.73:0/463122857 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f27f406ae70 0x7f27f406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:43:59.759 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:59.752+0000 7f281579d640 1 --2- 172.21.15.73:0/463122857 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f27f406ae70 0x7f27f406d330 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f2800033000 tx=0x7f280002f000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:43:59.759 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:59.756+0000 7f28067fc640 1 -- 172.21.15.73:0/463122857 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f280c054c80 con 0x7f27fc0047c0 2023-12-12T09:43:59.951 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:59.949+0000 7f2816fa0640 1 -- 172.21.15.73:0/463122857 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f28101ea760 con 0x7f27fc0047c0 2023-12-12T09:43:59.951 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:59.950+0000 7f28067fc640 1 -- 172.21.15.73:0/463122857 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7f280c0582a0 con 0x7f27fc0047c0 2023-12-12T09:43:59.951 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 64 2023-12-12T09:43:59.953 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:59.952+0000 7f2816fa0640 1 -- 172.21.15.73:0/463122857 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f27f406ae70 msgr2=0x7f27f406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:59.953 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:59.952+0000 7f2816fa0640 1 --2- 172.21.15.73:0/463122857 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f27f406ae70 0x7f27f406d330 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f2800033000 tx=0x7f280002f000 comp rx=0 tx=0).stop 2023-12-12T09:43:59.953 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:59.952+0000 7f2816fa0640 1 -- 172.21.15.73:0/463122857 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f27fc0047c0 msgr2=0x7f28101515b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:43:59.954 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:59.952+0000 7f2816fa0640 1 --2- 172.21.15.73:0/463122857 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f27fc0047c0 0x7f28101515b0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f280c0107c0 tx=0x7f280c010c80 comp rx=0 tx=0).stop 2023-12-12T09:43:59.954 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:59.952+0000 7f2816fa0640 1 -- 172.21.15.73:0/463122857 shutdown_connections 2023-12-12T09:43:59.954 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:59.952+0000 7f2816fa0640 1 --2- 172.21.15.73:0/463122857 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f27f406ae70 0x7f27f406d330 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:59.954 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:59.952+0000 7f2816fa0640 1 --2- 172.21.15.73:0/463122857 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2810154410 0x7f2810153130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:59.954 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:59.952+0000 7f2816fa0640 1 --2- 172.21.15.73:0/463122857 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2810152200 0x7f2810152bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:59.954 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:59.952+0000 7f2816fa0640 1 --2- 172.21.15.73:0/463122857 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f27fc0047c0 0x7f28101515b0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:43:59.954 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:59.952+0000 7f2816fa0640 1 -- 172.21.15.73:0/463122857 >> 172.21.15.73:0/463122857 conn(0x7f281006a4e0 msgr2=0x7f28100aa1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:43:59.954 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:59.952+0000 7f2816fa0640 1 -- 172.21.15.73:0/463122857 shutdown_connections 2023-12-12T09:43:59.954 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:43:59.952+0000 7f2816fa0640 1 -- 172.21.15.73:0/463122857 wait complete. 2023-12-12T09:43:59.973 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-12T09:44:00.184 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:00.183+0000 7fab066d4640 1 Processor -- start 2023-12-12T09:44:00.185 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:00.184+0000 7fab066d4640 1 -- start start 2023-12-12T09:44:00.186 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:00.185+0000 7fab066d4640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fab000bd470 0x7fab0006ba90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:00.186 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:00.185+0000 7fab066d4640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fab000c7cc0 0x7fab0006bfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:00.186 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:00.185+0000 7fab066d4640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab00154650 con 0x7fab00151ce0 2023-12-12T09:44:00.186 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:00.185+0000 7fab066d4640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab000c57b0 con 0x7fab000c7cc0 2023-12-12T09:44:00.186 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:00.185+0000 7fab066d4640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab00154930 con 0x7fab000bd470 2023-12-12T09:44:00.187 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:00.185+0000 7faafffff640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7fab00151ce0 0x7fab000c67d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:54522/0 (socket says 172.21.15.73:54522) 2023-12-12T09:44:00.187 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:00.185+0000 7faafffff640 1 -- 172.21.15.73:0/111365992 learned_addr learned my addr 172.21.15.73:0/111365992 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-12T09:44:00.189 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:00.186+0000 7fab04c71640 1 --2- 172.21.15.73:0/111365992 >> v2:172.21.15.142:3300/0 conn(0x7fab000c7cc0 0x7fab0006bfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:00.189 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:00.186+0000 7faaf77fe640 1 --2- 172.21.15.73:0/111365992 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fab000bd470 0x7fab0006ba90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:00.189 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:00.186+0000 7faaff7fe640 1 -- 172.21.15.73:0/111365992 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 994787511 0 0) 0x7fab00154650 con 0x7fab00151ce0 2023-12-12T09:44:00.189 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:00.186+0000 7faaff7fe640 1 -- 172.21.15.73:0/111365992 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faaec003520 con 0x7fab00151ce0 2023-12-12T09:44:00.189 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:00.186+0000 7faaff7fe640 1 -- 172.21.15.73:0/111365992 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1728380703 0 0) 0x7faaec003520 con 0x7fab00151ce0 2023-12-12T09:44:00.189 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:00.186+0000 7faaff7fe640 1 -- 172.21.15.73:0/111365992 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fab000bd470 msgr2=0x7fab0006ba90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:44:00.189 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:00.186+0000 7faaff7fe640 1 --2- 172.21.15.73:0/111365992 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fab000bd470 0x7fab0006ba90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:00.189 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:00.186+0000 7faaff7fe640 1 -- 172.21.15.73:0/111365992 >> v2:172.21.15.142:3300/0 conn(0x7fab000c7cc0 msgr2=0x7fab0006bfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:44:00.189 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:00.186+0000 7faaff7fe640 1 --2- 172.21.15.73:0/111365992 >> v2:172.21.15.142:3300/0 conn(0x7fab000c7cc0 0x7fab0006bfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:00.189 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:00.186+0000 7faaff7fe640 1 -- 172.21.15.73:0/111365992 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab00154c10 con 0x7fab00151ce0 2023-12-12T09:44:00.189 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:00.186+0000 7faaff7fe640 1 -- 172.21.15.73:0/111365992 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3186547832 0 0) 0x7faaf0001670 con 0x7fab00151ce0 2023-12-12T09:44:00.190 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:00.186+0000 7faaff7fe640 1 -- 172.21.15.73:0/111365992 >> v1:172.21.15.73:6789/0 conn(0x7fab00151ce0 legacy=0x7fab000c67d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:00.190 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:00.186+0000 7faaff7fe640 1 --2- 172.21.15.73:0/111365992 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fab000bd470 0x7faaec003970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:00.190 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:00.186+0000 7faaff7fe640 1 --2- 172.21.15.73:0/111365992 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7faaec003ff0 0x7faaec0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:00.190 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:00.186+0000 7faaff7fe640 1 --2- 172.21.15.73:0/111365992 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7faaec004d00 0x7faaec005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:00.190 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:00.186+0000 7faaff7fe640 1 -- 172.21.15.73:0/111365992 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab000c57b0 con 0x7faaec003ff0 2023-12-12T09:44:00.190 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:00.186+0000 7faaff7fe640 1 -- 172.21.15.73:0/111365992 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab00154930 con 0x7faaec004d00 2023-12-12T09:44:00.190 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:00.186+0000 7faaff7fe640 1 -- 172.21.15.73:0/111365992 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faaec00bb90 con 0x7fab000bd470 2023-12-12T09:44:00.190 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:00.187+0000 7faaf77fe640 1 --2- 172.21.15.73:0/111365992 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7faaec003ff0 0x7faaec0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:00.190 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:00.187+0000 7fab04c71640 1 --2- 172.21.15.73:0/111365992 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7faaec004d00 0x7faaec005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:00.190 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:00.187+0000 7faafffff640 1 --2- 172.21.15.73:0/111365992 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fab000bd470 0x7faaec003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:00.190 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:00.187+0000 7faaf77fe640 1 -- 172.21.15.73:0/111365992 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fab000bd470 msgr2=0x7faaec003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:44:00.190 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:00.187+0000 7faaf77fe640 1 --2- 172.21.15.73:0/111365992 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fab000bd470 0x7faaec003970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:00.190 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:00.187+0000 7faaf77fe640 1 -- 172.21.15.73:0/111365992 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7faaec004d00 msgr2=0x7faaec005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:44:00.191 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:00.187+0000 7faaf77fe640 1 --2- 172.21.15.73:0/111365992 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7faaec004d00 0x7faaec005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:00.191 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:00.187+0000 7faaf77fe640 1 -- 172.21.15.73:0/111365992 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faaec003520 con 0x7faaec003ff0 2023-12-12T09:44:00.191 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:00.187+0000 7fab04c71640 1 --2- 172.21.15.73:0/111365992 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7faaec004d00 0x7faaec005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:44:00.191 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:00.188+0000 7faaf77fe640 1 --2- 172.21.15.73:0/111365992 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7faaec003ff0 0x7faaec0047c0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fab000c0bd0 tx=0x7faaec0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b33d48c82c005ba server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:44:00.192 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:00.188+0000 7faaff7fe640 1 -- 172.21.15.73:0/111365992 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faae80325f0 con 0x7faaec003ff0 2023-12-12T09:44:00.192 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:00.188+0000 7faaff7fe640 1 -- 172.21.15.73:0/111365992 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faae8032750 con 0x7faaec003ff0 2023-12-12T09:44:00.192 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:00.188+0000 7faaff7fe640 1 -- 172.21.15.73:0/111365992 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faae8032ae0 con 0x7faaec003ff0 2023-12-12T09:44:00.192 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:00.189+0000 7fab066d4640 1 -- 172.21.15.73:0/111365992 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7faaec003ff0 msgr2=0x7faaec0047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:00.192 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:00.189+0000 7fab066d4640 1 --2- 172.21.15.73:0/111365992 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7faaec003ff0 0x7faaec0047c0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fab000c0bd0 tx=0x7faaec0057f0 comp rx=0 tx=0).stop 2023-12-12T09:44:00.192 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:00.189+0000 7fab04c71640 1 -- 172.21.15.73:0/111365992 reap_dead start 2023-12-12T09:44:00.192 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:00.189+0000 7fab066d4640 1 -- 172.21.15.73:0/111365992 shutdown_connections 2023-12-12T09:44:00.192 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:00.189+0000 7fab066d4640 1 -- 172.21.15.73:0/111365992 >> 172.21.15.73:0/111365992 conn(0x7fab000ab950 msgr2=0x7fab000abd30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:44:00.193 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:00.189+0000 7fab066d4640 1 -- 172.21.15.73:0/111365992 shutdown_connections 2023-12-12T09:44:00.193 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:00.189+0000 7fab066d4640 1 -- 172.21.15.73:0/111365992 wait complete. 2023-12-12T09:44:00.193 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:00.191+0000 7fab066d4640 1 Processor -- start 2023-12-12T09:44:00.193 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:00.191+0000 7fab066d4640 1 -- start start 2023-12-12T09:44:00.195 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:00.192+0000 7fab066d4640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7faaec003ff0 0x7fab000c2dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:00.195 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:00.192+0000 7fab066d4640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fab001ede10 0x7fab000bd8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:00.195 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:00.192+0000 7fab066d4640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fab0014b030 0x7fab000bde30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:00.195 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:00.192+0000 7fab066d4640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab000c3dc0 con 0x7faaec003ff0 2023-12-12T09:44:00.195 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:00.192+0000 7fab066d4640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab000c3ae0 con 0x7fab0014b030 2023-12-12T09:44:00.195 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:00.192+0000 7fab066d4640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab001ed330 con 0x7fab001ede10 2023-12-12T09:44:00.195 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:00.192+0000 7faafffff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7faaec003ff0 0x7fab000c2dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:00.195 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:00.192+0000 7faafffff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7faaec003ff0 0x7fab000c2dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:36134/0 (socket says 172.21.15.73:36134) 2023-12-12T09:44:00.195 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:00.192+0000 7faafffff640 1 -- 172.21.15.73:0/1001332102 learned_addr learned my addr 172.21.15.73:0/1001332102 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:44:00.195 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:00.193+0000 7faaf77fe640 1 --2- 172.21.15.73:0/1001332102 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fab001ede10 0x7fab000bd8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:00.195 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:00.193+0000 7faafffff640 1 -- 172.21.15.73:0/1001332102 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fab001ede10 msgr2=0x7fab000bd8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:00.195 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:00.193+0000 7faafffff640 1 --2- 172.21.15.73:0/1001332102 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fab001ede10 0x7fab000bd8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:00.195 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:00.193+0000 7faafffff640 1 -- 172.21.15.73:0/1001332102 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fab0014b030 msgr2=0x7fab000bde30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:00.196 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:00.193+0000 7fab04c71640 1 --2- 172.21.15.73:0/1001332102 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fab0014b030 0x7fab000bde30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:00.196 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:00.193+0000 7faafffff640 1 --2- 172.21.15.73:0/1001332102 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fab0014b030 0x7fab000bde30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:00.196 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:00.193+0000 7faafffff640 1 -- 172.21.15.73:0/1001332102 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab001ed610 con 0x7faaec003ff0 2023-12-12T09:44:00.196 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:00.193+0000 7faafffff640 1 --2- 172.21.15.73:0/1001332102 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7faaec003ff0 0x7fab000c2dc0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7faaf0000c00 tx=0x7faaf000dc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:44:00.196 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:00.193+0000 7faafd7fa640 1 -- 172.21.15.73:0/1001332102 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faaf000dea0 con 0x7faaec003ff0 2023-12-12T09:44:00.196 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:00.193+0000 7faafd7fa640 1 -- 172.21.15.73:0/1001332102 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faaf00074e0 con 0x7faaec003ff0 2023-12-12T09:44:00.196 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:00.193+0000 7faafd7fa640 1 -- 172.21.15.73:0/1001332102 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faaf0004a00 con 0x7faaec003ff0 2023-12-12T09:44:00.196 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:00.193+0000 7fab066d4640 1 -- 172.21.15.73:0/1001332102 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab001ed8f0 con 0x7faaec003ff0 2023-12-12T09:44:00.196 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:00.193+0000 7fab066d4640 1 -- 172.21.15.73:0/1001332102 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab000c1f30 con 0x7faaec003ff0 2023-12-12T09:44:00.197 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:00.195+0000 7fab066d4640 1 -- 172.21.15.73:0/1001332102 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab001ed190 con 0x7faaec003ff0 2023-12-12T09:44:00.197 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:00.196+0000 7faafd7fa640 1 -- 172.21.15.73:0/1001332102 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7faaf0004b60 con 0x7faaec003ff0 2023-12-12T09:44:00.197 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:00.196+0000 7faafd7fa640 1 --2- 172.21.15.73:0/1001332102 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7faae006ae40 0x7faae006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:00.198 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:00.197+0000 7faafd7fa640 1 -- 172.21.15.73:0/1001332102 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7faaf0088f30 con 0x7faaec003ff0 2023-12-12T09:44:00.198 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:00.197+0000 7faaf77fe640 1 --2- 172.21.15.73:0/1001332102 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7faae006ae40 0x7faae006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:00.198 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:00.198+0000 7faaf77fe640 1 --2- 172.21.15.73:0/1001332102 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7faae006ae40 0x7faae006d300 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fab00158b60 tx=0x7faae8030000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:44:00.202 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:00.201+0000 7faafd7fa640 1 -- 172.21.15.73:0/1001332102 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fab001ed190 con 0x7faaec003ff0 2023-12-12T09:44:00.407 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:00.406+0000 7fab066d4640 1 -- 172.21.15.73:0/1001332102 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fab001ed190 con 0x7faaec003ff0 2023-12-12T09:44:00.407 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:00.406+0000 7faafd7fa640 1 -- 172.21.15.73:0/1001332102 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v21) v1 ==== 80+0+0 (secure 0 0 0) 0x7fab001ed190 con 0x7faaec003ff0 2023-12-12T09:44:00.408 INFO:teuthology.orchestra.run.smithi073.stderr:listed 0 entries 2023-12-12T09:44:00.411 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:00.409+0000 7fab066d4640 1 -- 172.21.15.73:0/1001332102 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7faae006ae40 msgr2=0x7faae006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:00.411 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:00.409+0000 7fab066d4640 1 --2- 172.21.15.73:0/1001332102 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7faae006ae40 0x7faae006d300 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fab00158b60 tx=0x7faae8030000 comp rx=0 tx=0).stop 2023-12-12T09:44:00.411 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:00.409+0000 7fab066d4640 1 -- 172.21.15.73:0/1001332102 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7faaec003ff0 msgr2=0x7fab000c2dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:00.411 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:00.409+0000 7fab066d4640 1 --2- 172.21.15.73:0/1001332102 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7faaec003ff0 0x7fab000c2dc0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7faaf0000c00 tx=0x7faaf000dc50 comp rx=0 tx=0).stop 2023-12-12T09:44:00.411 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:00.409+0000 7fab066d4640 1 -- 172.21.15.73:0/1001332102 shutdown_connections 2023-12-12T09:44:00.411 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:00.409+0000 7fab066d4640 1 --2- 172.21.15.73:0/1001332102 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7faae006ae40 0x7faae006d300 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:00.411 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:00.409+0000 7fab066d4640 1 --2- 172.21.15.73:0/1001332102 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fab0014b030 0x7fab000bde30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:00.411 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:00.409+0000 7fab066d4640 1 --2- 172.21.15.73:0/1001332102 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fab001ede10 0x7fab000bd8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:00.411 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:00.409+0000 7fab066d4640 1 --2- 172.21.15.73:0/1001332102 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7faaec003ff0 0x7fab000c2dc0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:00.411 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:00.409+0000 7fab066d4640 1 -- 172.21.15.73:0/1001332102 >> 172.21.15.73:0/1001332102 conn(0x7fab000ab950 msgr2=0x7fab0014c510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:44:00.411 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:00.410+0000 7fab066d4640 1 -- 172.21.15.73:0/1001332102 shutdown_connections 2023-12-12T09:44:00.411 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:00.410+0000 7fab066d4640 1 -- 172.21.15.73:0/1001332102 wait complete. 2023-12-12T09:44:00.429 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-12-12T09:44:00.430 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T09:44:00.430 DEBUG:teuthology.orchestra.run.smithi073:> sudo umount /home/ubuntu/cephtest/mnt.0 -f 2023-12-12T09:44:00.522 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi073.front.sepia.ceph.com 2023-12-12T09:44:00.522 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T09:44:00.522 DEBUG:teuthology.orchestra.run.smithi073:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-12-12T09:44:00.582 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2023-12-12T09:44:00.582 DEBUG:teuthology.orchestra.run.smithi142:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-12T09:44:00.642 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2023-12-12T09:44:00.642 DEBUG:teuthology.orchestra.run.smithi142:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-12T09:44:00.694 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2023-12-12T09:44:00.694 DEBUG:teuthology.orchestra.run.smithi142:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-12T09:44:00.748 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-12T09:44:00.971 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:00.970+0000 7f55a65c9640 1 Processor -- start 2023-12-12T09:44:00.972 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:00.970+0000 7f55a65c9640 1 -- start start 2023-12-12T09:44:00.973 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:00.972+0000 7f55a65c9640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f55a006db70 0x7f55a00c39b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:00.973 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:00.972+0000 7f55a65c9640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55a0152610 con 0x7f55a014fa40 2023-12-12T09:44:00.973 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:00.972+0000 7f55a65c9640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55a01528f0 con 0x7f55a00c5070 2023-12-12T09:44:00.973 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:00.972+0000 7f55a65c9640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55a0152bd0 con 0x7f55a006db70 2023-12-12T09:44:00.973 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:00.972+0000 7f559ffff640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f55a014fa40 0x7f55a006a4e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:54538/0 (socket says 172.21.15.73:54538) 2023-12-12T09:44:00.973 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:00.972+0000 7f559ffff640 1 -- 172.21.15.73:0/1939590488 learned_addr learned my addr 172.21.15.73:0/1939590488 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-12T09:44:00.975 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:00.972+0000 7f559f7fe640 1 --2- 172.21.15.73:0/1939590488 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f55a006db70 0x7f55a00c39b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:00.975 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:00.972+0000 7f559effd640 1 -- 172.21.15.73:0/1939590488 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3698791719 0 0) 0x7f55a0152610 con 0x7f55a014fa40 2023-12-12T09:44:00.975 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:00.973+0000 7f559effd640 1 -- 172.21.15.73:0/1939590488 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5588003520 con 0x7f55a014fa40 2023-12-12T09:44:00.975 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:00.973+0000 7f559effd640 1 -- 172.21.15.73:0/1939590488 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 882519122 0 0) 0x7f5588003520 con 0x7f55a014fa40 2023-12-12T09:44:00.975 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:00.973+0000 7f559effd640 1 -- 172.21.15.73:0/1939590488 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f55a006db70 msgr2=0x7f55a00c39b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:44:00.975 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:00.973+0000 7f559effd640 1 --2- 172.21.15.73:0/1939590488 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f55a006db70 0x7f55a00c39b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:00.976 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:00.973+0000 7f559effd640 1 -- 172.21.15.73:0/1939590488 >> v1:172.21.15.142:6789/0 conn(0x7f55a00c5070 legacy=0x7f55a00c3ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:00.976 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:00.973+0000 7f559effd640 1 -- 172.21.15.73:0/1939590488 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55a0152eb0 con 0x7f55a014fa40 2023-12-12T09:44:00.976 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:00.973+0000 7f559effd640 1 -- 172.21.15.73:0/1939590488 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3186547832 0 0) 0x7f5590001670 con 0x7f55a014fa40 2023-12-12T09:44:00.976 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:00.973+0000 7f559effd640 1 -- 172.21.15.73:0/1939590488 >> v1:172.21.15.73:6789/0 conn(0x7f55a014fa40 legacy=0x7f55a006a4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:00.976 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:00.973+0000 7f559effd640 1 --2- 172.21.15.73:0/1939590488 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f55880039a0 0x7f5588003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:00.976 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:00.973+0000 7f559effd640 1 --2- 172.21.15.73:0/1939590488 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f55880047c0 0x7f5588004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:00.976 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:00.973+0000 7f559effd640 1 --2- 172.21.15.73:0/1939590488 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5588005180 0x7f558800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:00.976 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:00.973+0000 7f559effd640 1 -- 172.21.15.73:0/1939590488 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55a0152bd0 con 0x7f55880039a0 2023-12-12T09:44:00.976 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:00.973+0000 7f559effd640 1 -- 172.21.15.73:0/1939590488 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f558800c050 con 0x7f5588005180 2023-12-12T09:44:00.976 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:00.973+0000 7f559effd640 1 -- 172.21.15.73:0/1939590488 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f558800c210 con 0x7f55880047c0 2023-12-12T09:44:00.976 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:00.973+0000 7f559f7fe640 1 --2- 172.21.15.73:0/1939590488 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f55a006db70 0x7f55a00c39b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-12T09:44:00.976 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:00.973+0000 7f559ffff640 1 --2- 172.21.15.73:0/1939590488 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f55880039a0 0x7f5588003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:00.976 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:00.974+0000 7f55a4b66640 1 --2- 172.21.15.73:0/1939590488 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5588005180 0x7f558800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:00.976 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:00.974+0000 7f559f7fe640 1 --2- 172.21.15.73:0/1939590488 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f55880047c0 0x7f5588004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:00.976 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:00.974+0000 7f559ffff640 1 -- 172.21.15.73:0/1939590488 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f55880047c0 msgr2=0x7f5588004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:44:00.977 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:00.974+0000 7f559ffff640 1 --2- 172.21.15.73:0/1939590488 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f55880047c0 0x7f5588004c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:00.977 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:00.974+0000 7f559ffff640 1 -- 172.21.15.73:0/1939590488 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5588005180 msgr2=0x7f558800b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:44:00.977 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:00.974+0000 7f559ffff640 1 --2- 172.21.15.73:0/1939590488 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5588005180 0x7f558800b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:00.977 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:00.974+0000 7f559ffff640 1 -- 172.21.15.73:0/1939590488 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5588003520 con 0x7f55880039a0 2023-12-12T09:44:00.978 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:00.975+0000 7f559ffff640 1 --2- 172.21.15.73:0/1939590488 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f55880039a0 0x7f5588003dc0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f559000c240 tx=0x7f55880057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78df46463182281c server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:44:00.978 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:00.975+0000 7f559effd640 1 -- 172.21.15.73:0/1939590488 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5590005ad0 con 0x7f55880039a0 2023-12-12T09:44:00.978 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:00.975+0000 7f559effd640 1 -- 172.21.15.73:0/1939590488 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5590005c30 con 0x7f55880039a0 2023-12-12T09:44:00.978 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:00.975+0000 7f559effd640 1 -- 172.21.15.73:0/1939590488 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f559002c8b0 con 0x7f55880039a0 2023-12-12T09:44:00.978 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:00.976+0000 7f55a65c9640 1 -- 172.21.15.73:0/1939590488 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f55880039a0 msgr2=0x7f5588003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:00.978 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:00.976+0000 7f55a65c9640 1 --2- 172.21.15.73:0/1939590488 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f55880039a0 0x7f5588003dc0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f559000c240 tx=0x7f55880057f0 comp rx=0 tx=0).stop 2023-12-12T09:44:00.978 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:00.976+0000 7f55a4b66640 1 -- 172.21.15.73:0/1939590488 reap_dead start 2023-12-12T09:44:00.978 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:00.976+0000 7f55a65c9640 1 -- 172.21.15.73:0/1939590488 shutdown_connections 2023-12-12T09:44:00.978 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:00.976+0000 7f55a65c9640 1 -- 172.21.15.73:0/1939590488 >> 172.21.15.73:0/1939590488 conn(0x7f55a00a8130 msgr2=0x7f55a00c24b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:44:00.979 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:00.976+0000 7f55a65c9640 1 -- 172.21.15.73:0/1939590488 shutdown_connections 2023-12-12T09:44:00.979 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:00.976+0000 7f55a65c9640 1 -- 172.21.15.73:0/1939590488 wait complete. 2023-12-12T09:44:00.979 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:00.978+0000 7f55a65c9640 1 Processor -- start 2023-12-12T09:44:00.979 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:00.978+0000 7f55a65c9640 1 -- start start 2023-12-12T09:44:00.981 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:00.979+0000 7f55a65c9640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f55880039a0 0x7f55a01511e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:00.981 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:00.979+0000 7f55a65c9640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f55a00bf5f0 0x7f55a006fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:00.981 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:00.979+0000 7f55a65c9640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f55a00a9bb0 0x7f55a00aa060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:00.981 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:00.979+0000 7f55a65c9640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55a00c1b70 con 0x7f55880039a0 2023-12-12T09:44:00.981 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:00.979+0000 7f55a65c9640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55a0151c00 con 0x7f55a00bf5f0 2023-12-12T09:44:00.981 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:00.979+0000 7f55a65c9640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55a01edd00 con 0x7f55a00a9bb0 2023-12-12T09:44:00.981 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:00.979+0000 7f559ffff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f55880039a0 0x7f55a01511e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:00.981 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:00.979+0000 7f559ffff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f55880039a0 0x7f55a01511e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:36154/0 (socket says 172.21.15.73:36154) 2023-12-12T09:44:00.981 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:00.979+0000 7f559ffff640 1 -- 172.21.15.73:0/23992969 learned_addr learned my addr 172.21.15.73:0/23992969 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:44:00.981 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:00.980+0000 7f55a4b66640 1 --2- 172.21.15.73:0/23992969 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f55a00a9bb0 0x7f55a00aa060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:00.982 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:00.980+0000 7f559f7fe640 1 --2- 172.21.15.73:0/23992969 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f55a00bf5f0 0x7f55a006fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:00.982 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:00.980+0000 7f559ffff640 1 -- 172.21.15.73:0/23992969 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f55a00a9bb0 msgr2=0x7f55a00aa060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:00.982 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:00.980+0000 7f559ffff640 1 --2- 172.21.15.73:0/23992969 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f55a00a9bb0 0x7f55a00aa060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:00.982 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:00.980+0000 7f559ffff640 1 -- 172.21.15.73:0/23992969 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f55a00bf5f0 msgr2=0x7f55a006fcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:00.982 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:00.980+0000 7f559ffff640 1 --2- 172.21.15.73:0/23992969 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f55a00bf5f0 0x7f55a006fcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:00.982 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:00.980+0000 7f559ffff640 1 -- 172.21.15.73:0/23992969 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55a0151e50 con 0x7f55880039a0 2023-12-12T09:44:00.982 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:00.980+0000 7f559ffff640 1 --2- 172.21.15.73:0/23992969 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f55880039a0 0x7f55a01511e0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f5590001930 tx=0x7f5590001a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:44:00.983 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:00.980+0000 7f559cff9640 1 -- 172.21.15.73:0/23992969 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f559003c040 con 0x7f55880039a0 2023-12-12T09:44:00.983 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:00.980+0000 7f559cff9640 1 -- 172.21.15.73:0/23992969 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f559002ddd0 con 0x7f55880039a0 2023-12-12T09:44:00.983 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:00.980+0000 7f559cff9640 1 -- 172.21.15.73:0/23992969 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55900072b0 con 0x7f55880039a0 2023-12-12T09:44:00.983 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:00.980+0000 7f55a65c9640 1 -- 172.21.15.73:0/23992969 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55a0152130 con 0x7f55880039a0 2023-12-12T09:44:00.983 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:00.981+0000 7f55a65c9640 1 -- 172.21.15.73:0/23992969 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55a00bfa70 con 0x7f55880039a0 2023-12-12T09:44:00.983 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:00.982+0000 7f55a65c9640 1 -- 172.21.15.73:0/23992969 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f55a01522c0 con 0x7f55880039a0 2023-12-12T09:44:00.983 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:00.983+0000 7f559cff9640 1 -- 172.21.15.73:0/23992969 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f5590032070 con 0x7f55880039a0 2023-12-12T09:44:00.984 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:00.983+0000 7f559cff9640 1 --2- 172.21.15.73:0/23992969 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f558c06ae70 0x7f558c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:00.985 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:00.984+0000 7f559cff9640 1 -- 172.21.15.73:0/23992969 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f55900ab120 con 0x7f55880039a0 2023-12-12T09:44:00.985 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:00.984+0000 7f559f7fe640 1 --2- 172.21.15.73:0/23992969 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f558c06ae70 0x7f558c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:00.986 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:00.984+0000 7f559f7fe640 1 --2- 172.21.15.73:0/23992969 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f558c06ae70 0x7f558c06d330 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f55a00a4df0 tx=0x7f5594008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:44:00.989 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:00.988+0000 7f559cff9640 1 -- 172.21.15.73:0/23992969 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f5590076260 con 0x7f55880039a0 2023-12-12T09:44:01.179 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:01.177+0000 7f55a65c9640 1 -- 172.21.15.73:0/23992969 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f55a0067580 con 0x7f55880039a0 2023-12-12T09:44:01.182 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:01.181+0000 7f559cff9640 1 -- 172.21.15.73:0/23992969 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16517 (secure 0 0 0) 0x7f5590079880 con 0x7f55880039a0 2023-12-12T09:44:01.182 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-12T09:44:01.182 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":21,"fsid":"ba240992-02b8-4c7e-92f2-27eb29ac433b","created":"2023-12-12T09:43:02.454719+0000","modified":"2023-12-12T09:43:23.219345+0000","last_up_change":"2023-12-12T09:43:13.913440+0000","last_in_change":"2023-12-12T09:43:05.925348+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-12T09:43:15.525508+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-12T09:43:20.004546+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-12T09:43:20.736500+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"dd9074be-dbe2-4c34-9896-a4223d8d3940","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":4047810203},{"type":"v1","addr":"172.21.15.73:6801","nonce":4047810203}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":4047810203},{"type":"v1","addr":"172.21.15.73:6803","nonce":4047810203}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":4047810203},{"type":"v1","addr":"172.21.15.73:6807","nonce":4047810203}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":4047810203},{"type":"v1","addr":"172.21.15.73:6805","nonce":4047810203}]},"public_addr":"172.21.15.73:6801/4047810203","cluster_addr":"172.21.15.73:6803/4047810203","heartbeat_back_addr":"172.21.15.73:6807/4047810203","heartbeat_front_addr":"172.21.15.73:6805/4047810203","state":["exists","up"]},{"osd":1,"uuid":"c4a05052-96d4-4758-a4e1-1a37f1e07fed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":1356058331},{"type":"v1","addr":"172.21.15.73:6824","nonce":1356058331}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":1356058331},{"type":"v1","addr":"172.21.15.73:6827","nonce":1356058331}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":1356058331},{"type":"v1","addr":"172.21.15.73:6831","nonce":1356058331}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":1356058331},{"type":"v1","addr":"172.21.15.73:6829","nonce":1356058331}]},"public_addr":"172.21.15.73:6824/1356058331","cluster_addr":"172.21.15.73:6827/1356058331","heartbeat_back_addr":"172.21.15.73:6831/1356058331","heartbeat_front_addr":"172.21.15.73:6829/1356058331","state":["exists","up"]},{"osd":2,"uuid":"512bc8ac-72c2-40d4-b3d2-d867a92c5213","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":1228903316},{"type":"v1","addr":"172.21.15.73:6817","nonce":1228903316}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":1228903316},{"type":"v1","addr":"172.21.15.73:6819","nonce":1228903316}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6823","nonce":1228903316},{"type":"v1","addr":"172.21.15.73:6825","nonce":1228903316}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":1228903316},{"type":"v1","addr":"172.21.15.73:6821","nonce":1228903316}]},"public_addr":"172.21.15.73:6817/1228903316","cluster_addr":"172.21.15.73:6819/1228903316","heartbeat_back_addr":"172.21.15.73:6825/1228903316","heartbeat_front_addr":"172.21.15.73:6821/1228903316","state":["exists","up"]},{"osd":3,"uuid":"3d1a91e0-42bf-437a-8eae-8d357c8f63a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":1293329670},{"type":"v1","addr":"172.21.15.73:6809","nonce":1293329670}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6810","nonce":1293329670},{"type":"v1","addr":"172.21.15.73:6811","nonce":1293329670}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":1293329670},{"type":"v1","addr":"172.21.15.73:6815","nonce":1293329670}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":1293329670},{"type":"v1","addr":"172.21.15.73:6813","nonce":1293329670}]},"public_addr":"172.21.15.73:6809/1293329670","cluster_addr":"172.21.15.73:6811/1293329670","heartbeat_back_addr":"172.21.15.73:6815/1293329670","heartbeat_front_addr":"172.21.15.73:6813/1293329670","state":["exists","up"]},{"osd":4,"uuid":"4b302fff-834c-4069-ac19-00e46f6c87b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":3727975702},{"type":"v1","addr":"172.21.15.142:6801","nonce":3727975702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":3727975702},{"type":"v1","addr":"172.21.15.142:6803","nonce":3727975702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6809","nonce":3727975702},{"type":"v1","addr":"172.21.15.142:6811","nonce":3727975702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6805","nonce":3727975702},{"type":"v1","addr":"172.21.15.142:6807","nonce":3727975702}]},"public_addr":"172.21.15.142:6801/3727975702","cluster_addr":"172.21.15.142:6803/3727975702","heartbeat_back_addr":"172.21.15.142:6811/3727975702","heartbeat_front_addr":"172.21.15.142:6807/3727975702","state":["exists","up"]},{"osd":5,"uuid":"d7cdace2-67d0-45cc-95f2-515cf6ef1b82","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6817","nonce":2353193632},{"type":"v1","addr":"172.21.15.142:6819","nonce":2353193632}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6821","nonce":2353193632},{"type":"v1","addr":"172.21.15.142:6823","nonce":2353193632}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6829","nonce":2353193632},{"type":"v1","addr":"172.21.15.142:6831","nonce":2353193632}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6825","nonce":2353193632},{"type":"v1","addr":"172.21.15.142:6827","nonce":2353193632}]},"public_addr":"172.21.15.142:6819/2353193632","cluster_addr":"172.21.15.142:6823/2353193632","heartbeat_back_addr":"172.21.15.142:6831/2353193632","heartbeat_front_addr":"172.21.15.142:6827/2353193632","state":["exists","up"]},{"osd":6,"uuid":"649ce78a-5626-445c-aedc-a651ed05a6f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":2006111986},{"type":"v1","addr":"172.21.15.142:6806","nonce":2006111986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":2006111986},{"type":"v1","addr":"172.21.15.142:6810","nonce":2006111986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":2006111986},{"type":"v1","addr":"172.21.15.142:6815","nonce":2006111986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":2006111986},{"type":"v1","addr":"172.21.15.142:6813","nonce":2006111986}]},"public_addr":"172.21.15.142:6806/2006111986","cluster_addr":"172.21.15.142:6810/2006111986","heartbeat_back_addr":"172.21.15.142:6815/2006111986","heartbeat_front_addr":"172.21.15.142:6813/2006111986","state":["exists","up"]},{"osd":7,"uuid":"af15ae3b-c1d0-4acf-92db-8a1805494d13","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":2573794341},{"type":"v1","addr":"172.21.15.142:6818","nonce":2573794341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":2573794341},{"type":"v1","addr":"172.21.15.142:6822","nonce":2573794341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":2573794341},{"type":"v1","addr":"172.21.15.142:6830","nonce":2573794341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":2573794341},{"type":"v1","addr":"172.21.15.142:6826","nonce":2573794341}]},"public_addr":"172.21.15.142:6818/2573794341","cluster_addr":"172.21.15.142:6822/2573794341","heartbeat_back_addr":"172.21.15.142:6830/2573794341","heartbeat_front_addr":"172.21.15.142:6826/2573794341","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.185824+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.262103+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.225556+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:10.523459+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:10.706035+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.257339+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.301776+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.051960+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-12T09:44:01.185 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:01.183+0000 7f55a65c9640 1 -- 172.21.15.73:0/23992969 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f558c06ae70 msgr2=0x7f558c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:01.185 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:01.183+0000 7f55a65c9640 1 --2- 172.21.15.73:0/23992969 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f558c06ae70 0x7f558c06d330 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f55a00a4df0 tx=0x7f5594008040 comp rx=0 tx=0).stop 2023-12-12T09:44:01.185 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:01.183+0000 7f55a65c9640 1 -- 172.21.15.73:0/23992969 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f55880039a0 msgr2=0x7f55a01511e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:01.185 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:01.183+0000 7f55a65c9640 1 --2- 172.21.15.73:0/23992969 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f55880039a0 0x7f55a01511e0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f5590001930 tx=0x7f5590001a00 comp rx=0 tx=0).stop 2023-12-12T09:44:01.185 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:01.183+0000 7f55a65c9640 1 -- 172.21.15.73:0/23992969 shutdown_connections 2023-12-12T09:44:01.185 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:01.183+0000 7f55a65c9640 1 --2- 172.21.15.73:0/23992969 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f558c06ae70 0x7f558c06d330 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:01.185 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:01.183+0000 7f55a65c9640 1 --2- 172.21.15.73:0/23992969 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f55a00a9bb0 0x7f55a00aa060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:01.185 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:01.183+0000 7f55a65c9640 1 --2- 172.21.15.73:0/23992969 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f55a00bf5f0 0x7f55a006fcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:01.185 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:01.183+0000 7f55a65c9640 1 --2- 172.21.15.73:0/23992969 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f55880039a0 0x7f55a01511e0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:01.185 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:01.184+0000 7f55a65c9640 1 -- 172.21.15.73:0/23992969 >> 172.21.15.73:0/23992969 conn(0x7f55a00a8130 msgr2=0x7f55a00c2440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:44:01.185 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:01.184+0000 7f55a65c9640 1 -- 172.21.15.73:0/23992969 shutdown_connections 2023-12-12T09:44:01.186 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:01.184+0000 7f55a65c9640 1 -- 172.21.15.73:0/23992969 wait complete. 2023-12-12T09:44:01.202 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-12T09:43:15.525508+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-12T09:43:20.004546+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-12T09:43:20.736500+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-12T09:44:01.203 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-12T09:44:01.419 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:01.417+0000 7fb992236640 1 Processor -- start 2023-12-12T09:44:01.419 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:01.418+0000 7fb992236640 1 -- start start 2023-12-12T09:44:01.420 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:01.419+0000 7fb992236640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fb98c151dd0 0x7fb98c06ab70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:01.420 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:01.419+0000 7fb992236640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb98c0c4750 0x7fb98c15ef20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:01.420 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:01.419+0000 7fb992236640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb98c0c4e20 con 0x7fb98c1545a0 2023-12-12T09:44:01.421 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:01.419+0000 7fb992236640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb98c0c59a0 con 0x7fb98c151dd0 2023-12-12T09:44:01.421 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:01.419+0000 7fb992236640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb98c0c5070 con 0x7fb98c0c4750 2023-12-12T09:44:01.422 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:01.420+0000 7fb98b7fe640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fb98c151dd0 0x7fb98c06ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:01.422 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:01.420+0000 7fb98bfff640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb98c0c4750 0x7fb98c15ef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:01.422 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:01.420+0000 7fb98b7fe640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fb98c151dd0 0x7fb98c06ab70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.73:52516/0 (socket says 172.21.15.73:52516) 2023-12-12T09:44:01.422 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:01.420+0000 7fb98bfff640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb98c0c4750 0x7fb98c15ef20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.73:42618/0 (socket says 172.21.15.73:42618) 2023-12-12T09:44:01.422 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:01.420+0000 7fb98b7fe640 1 -- 172.21.15.73:0/1703591820 learned_addr learned my addr 172.21.15.73:0/1703591820 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:44:01.422 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:01.421+0000 7fb98bfff640 1 -- 172.21.15.73:0/1703591820 >> v2:172.21.15.142:3300/0 conn(0x7fb98c151dd0 msgr2=0x7fb98c06ab70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:44:01.422 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:01.421+0000 7fb98bfff640 1 --2- 172.21.15.73:0/1703591820 >> v2:172.21.15.142:3300/0 conn(0x7fb98c151dd0 0x7fb98c06ab70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:01.422 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:01.421+0000 7fb98bfff640 1 -- 172.21.15.73:0/1703591820 >> v1:172.21.15.142:6789/0 conn(0x7fb98c1545a0 legacy=0x7fb98c0c5e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:01.422 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:01.421+0000 7fb98bfff640 1 -- 172.21.15.73:0/1703591820 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb98c0c5350 con 0x7fb98c0c4750 2023-12-12T09:44:01.423 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:01.421+0000 7fb98b7fe640 1 --2- 172.21.15.73:0/1703591820 >> v2:172.21.15.142:3300/0 conn(0x7fb98c151dd0 0x7fb98c06ab70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-12T09:44:01.423 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:01.421+0000 7fb98affd640 1 -- 172.21.15.73:0/1703591820 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2580128085 0 0) 0x7fb98c0c4e20 con 0x7fb98c1545a0 2023-12-12T09:44:01.423 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:01.422+0000 7fb98bfff640 1 --2- 172.21.15.73:0/1703591820 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb98c0c4750 0x7fb98c15ef20 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fb984009d90 tx=0x7fb98402be20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=40de1380642d6c22 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:44:01.423 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:01.423+0000 7fb98affd640 1 -- 172.21.15.73:0/1703591820 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb98402cbd0 con 0x7fb98c0c4750 2023-12-12T09:44:01.424 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:01.423+0000 7fb98affd640 1 -- 172.21.15.73:0/1703591820 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb98402cd30 con 0x7fb98c0c4750 2023-12-12T09:44:01.424 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:01.423+0000 7fb98affd640 1 -- 172.21.15.73:0/1703591820 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb98402cea0 con 0x7fb98c0c4750 2023-12-12T09:44:01.425 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:01.423+0000 7fb992236640 1 -- 172.21.15.73:0/1703591820 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb98c0c4750 msgr2=0x7fb98c15ef20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:01.425 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:01.423+0000 7fb992236640 1 --2- 172.21.15.73:0/1703591820 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb98c0c4750 0x7fb98c15ef20 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fb984009d90 tx=0x7fb98402be20 comp rx=0 tx=0).stop 2023-12-12T09:44:01.425 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:01.423+0000 7fb992236640 1 -- 172.21.15.73:0/1703591820 shutdown_connections 2023-12-12T09:44:01.425 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:01.423+0000 7fb992236640 1 --2- 172.21.15.73:0/1703591820 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb98c0c4750 0x7fb98c15ef20 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:01.425 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:01.423+0000 7fb992236640 1 --2- 172.21.15.73:0/1703591820 >> v2:172.21.15.142:3300/0 conn(0x7fb98c151dd0 0x7fb98c06ab70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:01.425 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:01.423+0000 7fb992236640 1 -- 172.21.15.73:0/1703591820 >> 172.21.15.73:0/1703591820 conn(0x7fb98c0ab8c0 msgr2=0x7fb98c0abcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:44:01.425 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:01.423+0000 7fb992236640 1 -- 172.21.15.73:0/1703591820 shutdown_connections 2023-12-12T09:44:01.425 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:01.423+0000 7fb992236640 1 -- 172.21.15.73:0/1703591820 wait complete. 2023-12-12T09:44:01.426 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:01.425+0000 7fb992236640 1 Processor -- start 2023-12-12T09:44:01.426 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:01.425+0000 7fb992236640 1 -- start start 2023-12-12T09:44:01.429 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:01.426+0000 7fb992236640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb98c0c4750 0x7fb98c14ec30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:01.429 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:01.426+0000 7fb992236640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb98c151dd0 0x7fb98c14d0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:01.429 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:01.426+0000 7fb992236640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb98c1545a0 0x7fb98c149f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:01.430 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:01.426+0000 7fb992236640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb98c14e460 con 0x7fb98c1545a0 2023-12-12T09:44:01.430 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:01.426+0000 7fb992236640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb98c148da0 con 0x7fb98c151dd0 2023-12-12T09:44:01.430 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:01.426+0000 7fb992236640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb98c148290 con 0x7fb98c0c4750 2023-12-12T09:44:01.430 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:01.426+0000 7fb98bfff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb98c1545a0 0x7fb98c149f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:01.430 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:01.426+0000 7fb98bfff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb98c1545a0 0x7fb98c149f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:36162/0 (socket says 172.21.15.73:36162) 2023-12-12T09:44:01.430 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:01.426+0000 7fb98bfff640 1 -- 172.21.15.73:0/1135401259 learned_addr learned my addr 172.21.15.73:0/1135401259 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:44:01.430 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:01.427+0000 7fb98b7fe640 1 --2- 172.21.15.73:0/1135401259 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb98c0c4750 0x7fb98c14ec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:01.430 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:01.427+0000 7fb983fff640 1 --2- 172.21.15.73:0/1135401259 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb98c151dd0 0x7fb98c14d0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:01.430 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:01.427+0000 7fb98bfff640 1 -- 172.21.15.73:0/1135401259 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb98c0c4750 msgr2=0x7fb98c14ec30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:01.430 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:01.427+0000 7fb98bfff640 1 --2- 172.21.15.73:0/1135401259 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb98c0c4750 0x7fb98c14ec30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:01.430 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:01.427+0000 7fb98bfff640 1 -- 172.21.15.73:0/1135401259 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb98c151dd0 msgr2=0x7fb98c14d0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:01.430 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:01.427+0000 7fb98bfff640 1 --2- 172.21.15.73:0/1135401259 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb98c151dd0 0x7fb98c14d0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:01.430 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:01.427+0000 7fb98bfff640 1 -- 172.21.15.73:0/1135401259 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb97c0094d0 con 0x7fb98c1545a0 2023-12-12T09:44:01.430 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:01.427+0000 7fb98b7fe640 1 --2- 172.21.15.73:0/1135401259 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb98c0c4750 0x7fb98c14ec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:44:01.431 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:01.427+0000 7fb98bfff640 1 --2- 172.21.15.73:0/1135401259 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb98c1545a0 0x7fb98c149f50 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fb984009d90 tx=0x7fb984004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:44:01.431 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:01.427+0000 7fb988ff9640 1 -- 172.21.15.73:0/1135401259 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb98402cea0 con 0x7fb98c1545a0 2023-12-12T09:44:01.431 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:01.428+0000 7fb988ff9640 1 -- 172.21.15.73:0/1135401259 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb984040650 con 0x7fb98c1545a0 2023-12-12T09:44:01.431 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:01.428+0000 7fb988ff9640 1 -- 172.21.15.73:0/1135401259 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb984040a00 con 0x7fb98c1545a0 2023-12-12T09:44:01.431 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:01.428+0000 7fb992236640 1 -- 172.21.15.73:0/1135401259 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb984009a70 con 0x7fb98c1545a0 2023-12-12T09:44:01.431 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:01.428+0000 7fb992236640 1 -- 172.21.15.73:0/1135401259 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb98c0c66c0 con 0x7fb98c1545a0 2023-12-12T09:44:01.432 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:01.429+0000 7fb992236640 1 -- 172.21.15.73:0/1135401259 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb98c067580 con 0x7fb98c1545a0 2023-12-12T09:44:01.432 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:01.430+0000 7fb988ff9640 1 -- 172.21.15.73:0/1135401259 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fb984040b60 con 0x7fb98c1545a0 2023-12-12T09:44:01.432 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:01.431+0000 7fb988ff9640 1 --2- 172.21.15.73:0/1135401259 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fb96c06ae40 0x7fb96c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:01.432 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:01.431+0000 7fb988ff9640 1 -- 172.21.15.73:0/1135401259 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb9840ac280 con 0x7fb98c1545a0 2023-12-12T09:44:01.432 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:01.431+0000 7fb98b7fe640 1 --2- 172.21.15.73:0/1135401259 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fb96c06ae40 0x7fb96c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:01.433 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:01.432+0000 7fb98b7fe640 1 --2- 172.21.15.73:0/1135401259 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fb96c06ae40 0x7fb96c06d300 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fb98c0c46c0 tx=0x7fb97c008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:44:01.436 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:01.435+0000 7fb988ff9640 1 -- 172.21.15.73:0/1135401259 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fb984077320 con 0x7fb98c1545a0 2023-12-12T09:44:01.627 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:01.625+0000 7fb992236640 1 -- 172.21.15.73:0/1135401259 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fb98c0aa840 con 0x7fb98c1545a0 2023-12-12T09:44:01.627 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:01.626+0000 7fb988ff9640 1 -- 172.21.15.73:0/1135401259 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7fb984009450 con 0x7fb98c1545a0 2023-12-12T09:44:01.627 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 1 2023-12-12T09:44:01.630 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:01.629+0000 7fb992236640 1 -- 172.21.15.73:0/1135401259 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fb96c06ae40 msgr2=0x7fb96c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:01.630 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:01.629+0000 7fb992236640 1 --2- 172.21.15.73:0/1135401259 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fb96c06ae40 0x7fb96c06d300 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fb98c0c46c0 tx=0x7fb97c008040 comp rx=0 tx=0).stop 2023-12-12T09:44:01.631 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:01.629+0000 7fb992236640 1 -- 172.21.15.73:0/1135401259 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb98c1545a0 msgr2=0x7fb98c149f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:01.631 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:01.629+0000 7fb992236640 1 --2- 172.21.15.73:0/1135401259 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb98c1545a0 0x7fb98c149f50 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fb984009d90 tx=0x7fb984004a40 comp rx=0 tx=0).stop 2023-12-12T09:44:01.631 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:01.629+0000 7fb992236640 1 -- 172.21.15.73:0/1135401259 shutdown_connections 2023-12-12T09:44:01.631 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:01.629+0000 7fb992236640 1 --2- 172.21.15.73:0/1135401259 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fb96c06ae40 0x7fb96c06d300 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:01.631 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:01.629+0000 7fb992236640 1 --2- 172.21.15.73:0/1135401259 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb98c1545a0 0x7fb98c149f50 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:01.631 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:01.629+0000 7fb992236640 1 --2- 172.21.15.73:0/1135401259 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb98c151dd0 0x7fb98c14d0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:01.631 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:01.629+0000 7fb992236640 1 --2- 172.21.15.73:0/1135401259 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb98c0c4750 0x7fb98c14ec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:01.631 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:01.629+0000 7fb992236640 1 -- 172.21.15.73:0/1135401259 >> 172.21.15.73:0/1135401259 conn(0x7fb98c0ab8c0 msgr2=0x7fb98c14b830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:44:01.631 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:01.629+0000 7fb992236640 1 -- 172.21.15.73:0/1135401259 shutdown_connections 2023-12-12T09:44:01.631 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:01.630+0000 7fb992236640 1 -- 172.21.15.73:0/1135401259 wait complete. 2023-12-12T09:44:01.648 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-12T09:44:01.856 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:01.855+0000 7efeb6807640 1 Processor -- start 2023-12-12T09:44:01.856 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:01.855+0000 7efeb6807640 1 -- start start 2023-12-12T09:44:01.857 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:01.856+0000 7efeb6807640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7efeb006d350 0x7efeb006dc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:01.857 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:01.856+0000 7efeb6807640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efeb00c16c0 con 0x7efeb014f8c0 2023-12-12T09:44:01.857 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:01.856+0000 7efeb6807640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efeb00c19a0 con 0x7efeb0152500 2023-12-12T09:44:01.858 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:01.856+0000 7efeb6807640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efeb00c1090 con 0x7efeb006d350 2023-12-12T09:44:01.858 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:01.857+0000 7efeaffff640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7efeb014f8c0 0x7efeb0071e60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:54542/0 (socket says 172.21.15.73:54542) 2023-12-12T09:44:01.858 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:01.857+0000 7efeaffff640 1 -- 172.21.15.73:0/3167500858 learned_addr learned my addr 172.21.15.73:0/3167500858 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-12T09:44:01.860 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:01.857+0000 7efeaf7fe640 1 --2- 172.21.15.73:0/3167500858 >> v2:172.21.15.142:3300/0 conn(0x7efeb006d350 0x7efeb006dc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:01.860 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:01.857+0000 7efeaeffd640 1 -- 172.21.15.73:0/3167500858 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3836469500 0 0) 0x7efeb00c16c0 con 0x7efeb014f8c0 2023-12-12T09:44:01.860 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:01.857+0000 7efeaeffd640 1 -- 172.21.15.73:0/3167500858 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efe98003520 con 0x7efeb014f8c0 2023-12-12T09:44:01.860 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:01.857+0000 7efeaeffd640 1 -- 172.21.15.73:0/3167500858 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2495331212 0 0) 0x7efe98003520 con 0x7efeb014f8c0 2023-12-12T09:44:01.860 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:01.857+0000 7efeaeffd640 1 -- 172.21.15.73:0/3167500858 >> v2:172.21.15.142:3300/0 conn(0x7efeb006d350 msgr2=0x7efeb006dc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:44:01.860 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:01.857+0000 7efeaeffd640 1 --2- 172.21.15.73:0/3167500858 >> v2:172.21.15.142:3300/0 conn(0x7efeb006d350 0x7efeb006dc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:01.860 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:01.857+0000 7efeaeffd640 1 -- 172.21.15.73:0/3167500858 >> v1:172.21.15.142:6789/0 conn(0x7efeb0152500 legacy=0x7efeb0152990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:01.860 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:01.857+0000 7efeaeffd640 1 -- 172.21.15.73:0/3167500858 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efeb00c1c80 con 0x7efeb014f8c0 2023-12-12T09:44:01.860 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:01.857+0000 7efeaeffd640 1 -- 172.21.15.73:0/3167500858 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3186547832 0 0) 0x7efea0001670 con 0x7efeb014f8c0 2023-12-12T09:44:01.860 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:01.858+0000 7efeaeffd640 1 -- 172.21.15.73:0/3167500858 >> v1:172.21.15.73:6789/0 conn(0x7efeb014f8c0 legacy=0x7efeb0071e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:01.860 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:01.858+0000 7efeaeffd640 1 --2- 172.21.15.73:0/3167500858 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efe980039c0 0x7efe98003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:01.860 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:01.858+0000 7efeaeffd640 1 --2- 172.21.15.73:0/3167500858 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efe980047c0 0x7efe98004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:01.860 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:01.858+0000 7efeaeffd640 1 --2- 172.21.15.73:0/3167500858 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efe98005180 0x7efe9800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:01.861 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:01.858+0000 7efeaeffd640 1 -- 172.21.15.73:0/3167500858 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe9800c050 con 0x7efe98005180 2023-12-12T09:44:01.861 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:01.858+0000 7efeaeffd640 1 -- 172.21.15.73:0/3167500858 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe9800c1c0 con 0x7efe980047c0 2023-12-12T09:44:01.861 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:01.858+0000 7efeaeffd640 1 -- 172.21.15.73:0/3167500858 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe9800c380 con 0x7efe980039c0 2023-12-12T09:44:01.861 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:01.858+0000 7efeb4da4640 1 --2- 172.21.15.73:0/3167500858 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efe98005180 0x7efe9800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:01.861 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:01.858+0000 7efeaf7fe640 1 --2- 172.21.15.73:0/3167500858 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efe980047c0 0x7efe98004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:01.861 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:01.858+0000 7efeaffff640 1 --2- 172.21.15.73:0/3167500858 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efe980039c0 0x7efe98003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:01.861 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:01.858+0000 7efeb4da4640 1 -- 172.21.15.73:0/3167500858 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efe980039c0 msgr2=0x7efe98003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:44:01.861 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:01.858+0000 7efeb4da4640 1 --2- 172.21.15.73:0/3167500858 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efe980039c0 0x7efe98003de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:01.861 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:01.858+0000 7efeb4da4640 1 -- 172.21.15.73:0/3167500858 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efe980047c0 msgr2=0x7efe98004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:44:01.861 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:01.858+0000 7efeb4da4640 1 --2- 172.21.15.73:0/3167500858 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efe980047c0 0x7efe98004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:01.861 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:01.858+0000 7efeb4da4640 1 -- 172.21.15.73:0/3167500858 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe98003520 con 0x7efe98005180 2023-12-12T09:44:01.861 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:01.858+0000 7efeaf7fe640 1 --2- 172.21.15.73:0/3167500858 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efe980047c0 0x7efe98004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:44:01.863 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:01.859+0000 7efeb4da4640 1 -- 172.21.15.73:0/3167500858 reap_dead start 2023-12-12T09:44:01.863 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:01.860+0000 7efeb4da4640 1 --2- 172.21.15.73:0/3167500858 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efe98005180 0x7efe9800b980 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7efea8001e50 tx=0x7efe980057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95d1b4791dfa7b32 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:44:01.863 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:01.860+0000 7efeaeffd640 1 -- 172.21.15.73:0/3167500858 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efea8003b70 con 0x7efe98005180 2023-12-12T09:44:01.863 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:01.860+0000 7efeaeffd640 1 -- 172.21.15.73:0/3167500858 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efea8003cf0 con 0x7efe98005180 2023-12-12T09:44:01.863 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:01.860+0000 7efeaeffd640 1 -- 172.21.15.73:0/3167500858 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efea8005310 con 0x7efe98005180 2023-12-12T09:44:01.863 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:01.860+0000 7efeb6807640 1 -- 172.21.15.73:0/3167500858 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efe98005180 msgr2=0x7efe9800b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:01.863 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:01.860+0000 7efeb6807640 1 --2- 172.21.15.73:0/3167500858 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efe98005180 0x7efe9800b980 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7efea8001e50 tx=0x7efe980057f0 comp rx=0 tx=0).stop 2023-12-12T09:44:01.863 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:01.860+0000 7efeb6807640 1 -- 172.21.15.73:0/3167500858 shutdown_connections 2023-12-12T09:44:01.863 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:01.860+0000 7efeb6807640 1 --2- 172.21.15.73:0/3167500858 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efe98005180 0x7efe9800b980 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:01.863 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:01.860+0000 7efeb6807640 1 -- 172.21.15.73:0/3167500858 >> 172.21.15.73:0/3167500858 conn(0x7efeb006a4e0 msgr2=0x7efeb006a8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:44:01.863 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:01.861+0000 7efeb6807640 1 -- 172.21.15.73:0/3167500858 shutdown_connections 2023-12-12T09:44:01.863 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:01.861+0000 7efeb6807640 1 -- 172.21.15.73:0/3167500858 wait complete. 2023-12-12T09:44:01.864 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:01.862+0000 7efeb6807640 1 Processor -- start 2023-12-12T09:44:01.864 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:01.862+0000 7efeb6807640 1 -- start start 2023-12-12T09:44:01.865 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:01.863+0000 7efeb6807640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efe98005180 0x7efeb01ea230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:01.865 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:01.863+0000 7efeb6807640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efeb0149b60 0x7efeb014b240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:01.865 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:01.863+0000 7efeb6807640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efeb00befc0 0x7efeb01ed730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:01.865 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:01.863+0000 7efeb6807640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efeb0071cd0 con 0x7efe98005180 2023-12-12T09:44:01.865 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:01.863+0000 7efeb6807640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efeb014a430 con 0x7efeb00befc0 2023-12-12T09:44:01.865 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:01.863+0000 7efeb6807640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efeb01ea770 con 0x7efeb0149b60 2023-12-12T09:44:01.865 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:01.864+0000 7efeaffff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efe98005180 0x7efeb01ea230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:01.865 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:01.864+0000 7efeaffff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efe98005180 0x7efeb01ea230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:36184/0 (socket says 172.21.15.73:36184) 2023-12-12T09:44:01.865 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:01.864+0000 7efeaffff640 1 -- 172.21.15.73:0/2304028634 learned_addr learned my addr 172.21.15.73:0/2304028634 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:44:01.867 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:01.864+0000 7efeb4da4640 1 --2- 172.21.15.73:0/2304028634 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efeb00befc0 0x7efeb01ed730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:01.867 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:01.864+0000 7efeaf7fe640 1 --2- 172.21.15.73:0/2304028634 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efeb0149b60 0x7efeb014b240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:01.867 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:01.864+0000 7efeaffff640 1 -- 172.21.15.73:0/2304028634 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efeb0149b60 msgr2=0x7efeb014b240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:01.867 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:01.864+0000 7efeaffff640 1 --2- 172.21.15.73:0/2304028634 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efeb0149b60 0x7efeb014b240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:01.867 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:01.864+0000 7efeaffff640 1 -- 172.21.15.73:0/2304028634 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efeb00befc0 msgr2=0x7efeb01ed730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:01.867 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:01.864+0000 7efeaffff640 1 --2- 172.21.15.73:0/2304028634 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efeb00befc0 0x7efeb01ed730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:01.867 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:01.864+0000 7efeaffff640 1 -- 172.21.15.73:0/2304028634 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efeb0071430 con 0x7efe98005180 2023-12-12T09:44:01.867 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:01.864+0000 7efeb4da4640 1 --2- 172.21.15.73:0/2304028634 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efeb00befc0 0x7efeb01ed730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:44:01.867 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:01.864+0000 7efeaffff640 1 --2- 172.21.15.73:0/2304028634 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efe98005180 0x7efeb01ea230 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7efea000d7a0 tx=0x7efea000dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:44:01.867 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:01.865+0000 7efeacff9640 1 -- 172.21.15.73:0/2304028634 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efea00074e0 con 0x7efe98005180 2023-12-12T09:44:01.868 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:01.865+0000 7efeacff9640 1 -- 172.21.15.73:0/2304028634 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efea0007640 con 0x7efe98005180 2023-12-12T09:44:01.868 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:01.865+0000 7efeacff9640 1 -- 172.21.15.73:0/2304028634 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efea0004a00 con 0x7efe98005180 2023-12-12T09:44:01.868 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:01.865+0000 7efeb6807640 1 -- 172.21.15.73:0/2304028634 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efeb0071710 con 0x7efe98005180 2023-12-12T09:44:01.868 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:01.865+0000 7efeb6807640 1 -- 172.21.15.73:0/2304028634 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efeb01ecf30 con 0x7efe98005180 2023-12-12T09:44:01.868 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:01.866+0000 7efeb6807640 1 -- 172.21.15.73:0/2304028634 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efeb01ecd90 con 0x7efe98005180 2023-12-12T09:44:01.868 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:01.867+0000 7efeacff9640 1 -- 172.21.15.73:0/2304028634 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7efea0004b60 con 0x7efe98005180 2023-12-12T09:44:01.869 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:01.868+0000 7efeacff9640 1 --2- 172.21.15.73:0/2304028634 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7efe9c06ae40 0x7efe9c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:01.869 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:01.868+0000 7efeacff9640 1 -- 172.21.15.73:0/2304028634 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7efea0088f10 con 0x7efe98005180 2023-12-12T09:44:01.869 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:01.868+0000 7efeaf7fe640 1 --2- 172.21.15.73:0/2304028634 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7efe9c06ae40 0x7efe9c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:01.869 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:01.869+0000 7efeaf7fe640 1 --2- 172.21.15.73:0/2304028634 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7efe9c06ae40 0x7efe9c06d300 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7efeb0152100 tx=0x7efea4008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:44:01.873 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:01.872+0000 7efeacff9640 1 -- 172.21.15.73:0/2304028634 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7efeb01ecd90 con 0x7efe98005180 2023-12-12T09:44:02.062 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:02.061+0000 7efeb6807640 1 -- 172.21.15.73:0/2304028634 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7efeb01ecd90 con 0x7efe98005180 2023-12-12T09:44:02.062 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:02.062+0000 7efeacff9640 1 -- 172.21.15.73:0/2304028634 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7efea0019020 con 0x7efe98005180 2023-12-12T09:44:02.063 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 32 2023-12-12T09:44:02.066 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:02.064+0000 7efeb6807640 1 -- 172.21.15.73:0/2304028634 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7efe9c06ae40 msgr2=0x7efe9c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:02.066 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:02.064+0000 7efeb6807640 1 --2- 172.21.15.73:0/2304028634 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7efe9c06ae40 0x7efe9c06d300 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7efeb0152100 tx=0x7efea4008040 comp rx=0 tx=0).stop 2023-12-12T09:44:02.066 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:02.064+0000 7efeb6807640 1 -- 172.21.15.73:0/2304028634 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efe98005180 msgr2=0x7efeb01ea230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:02.066 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:02.064+0000 7efeb6807640 1 --2- 172.21.15.73:0/2304028634 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efe98005180 0x7efeb01ea230 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7efea000d7a0 tx=0x7efea000dc60 comp rx=0 tx=0).stop 2023-12-12T09:44:02.066 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:02.065+0000 7efeb6807640 1 -- 172.21.15.73:0/2304028634 shutdown_connections 2023-12-12T09:44:02.066 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:02.065+0000 7efeb6807640 1 --2- 172.21.15.73:0/2304028634 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7efe9c06ae40 0x7efe9c06d300 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:02.066 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:02.065+0000 7efeb6807640 1 --2- 172.21.15.73:0/2304028634 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efeb00befc0 0x7efeb01ed730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:02.066 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:02.065+0000 7efeb6807640 1 --2- 172.21.15.73:0/2304028634 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efeb0149b60 0x7efeb014b240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:02.066 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:02.065+0000 7efeb6807640 1 --2- 172.21.15.73:0/2304028634 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efe98005180 0x7efeb01ea230 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:02.067 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:02.065+0000 7efeb6807640 1 -- 172.21.15.73:0/2304028634 >> 172.21.15.73:0/2304028634 conn(0x7efeb006a4e0 msgr2=0x7efeb0149440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:44:02.067 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:02.065+0000 7efeb6807640 1 -- 172.21.15.73:0/2304028634 shutdown_connections 2023-12-12T09:44:02.067 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:02.065+0000 7efeb6807640 1 -- 172.21.15.73:0/2304028634 wait complete. 2023-12-12T09:44:02.085 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-12T09:44:02.307 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:02.306+0000 7f2241c9b640 1 Processor -- start 2023-12-12T09:44:02.307 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:02.306+0000 7f2241c9b640 1 -- start start 2023-12-12T09:44:02.309 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:02.307+0000 7f2241c9b640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f223c14ea60 0x7f223c0c5420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:02.309 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:02.307+0000 7f2241c9b640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f223c0a4c90 0x7f223c0c0320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:02.309 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:02.307+0000 7f2241c9b640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f223c0c3390 con 0x7f223c0c4420 2023-12-12T09:44:02.309 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:02.307+0000 7f2241c9b640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f223c151e60 con 0x7f223c0a4c90 2023-12-12T09:44:02.309 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:02.307+0000 7f2241c9b640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f223c152140 con 0x7f223c14ea60 2023-12-12T09:44:02.309 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:02.308+0000 7f223bfff640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f223c0c4420 0x7f223c0c20b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:54556/0 (socket says 172.21.15.73:54556) 2023-12-12T09:44:02.310 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:02.308+0000 7f223bfff640 1 -- 172.21.15.73:0/3448912967 learned_addr learned my addr 172.21.15.73:0/3448912967 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-12T09:44:02.310 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:02.308+0000 7f223affd640 1 --2- 172.21.15.73:0/3448912967 >> v2:172.21.15.73:3300/0 conn(0x7f223c0a4c90 0x7f223c0c0320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:02.310 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:02.308+0000 7f223b7fe640 1 --2- 172.21.15.73:0/3448912967 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f223c14ea60 0x7f223c0c5420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:02.310 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:02.308+0000 7f223a7fc640 1 -- 172.21.15.73:0/3448912967 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 341977269 0 0) 0x7f223c0c3390 con 0x7f223c0c4420 2023-12-12T09:44:02.310 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:02.308+0000 7f223a7fc640 1 -- 172.21.15.73:0/3448912967 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2224003520 con 0x7f223c0c4420 2023-12-12T09:44:02.310 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:02.308+0000 7f223affd640 1 -- 172.21.15.73:0/3448912967 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f223c14ea60 msgr2=0x7f223c0c5420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:44:02.310 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:02.308+0000 7f223affd640 1 --2- 172.21.15.73:0/3448912967 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f223c14ea60 0x7f223c0c5420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:02.310 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:02.308+0000 7f223affd640 1 -- 172.21.15.73:0/3448912967 >> v1:172.21.15.73:6789/0 conn(0x7f223c0c4420 legacy=0x7f223c0c20b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:02.310 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:02.308+0000 7f223affd640 1 -- 172.21.15.73:0/3448912967 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f223c0c3940 con 0x7f223c0a4c90 2023-12-12T09:44:02.311 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:02.309+0000 7f223affd640 1 --2- 172.21.15.73:0/3448912967 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f223c0a4c90 0x7f223c0c0320 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f22300097a0 tx=0x7f223002b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a26b35f3cfac91e server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:44:02.311 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:02.310+0000 7f223a7fc640 1 -- 172.21.15.73:0/3448912967 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f223002e070 con 0x7f223c0a4c90 2023-12-12T09:44:02.311 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:02.310+0000 7f223a7fc640 1 -- 172.21.15.73:0/3448912967 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22300315a0 con 0x7f223c0a4c90 2023-12-12T09:44:02.311 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:02.310+0000 7f223a7fc640 1 -- 172.21.15.73:0/3448912967 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2230031930 con 0x7f223c0a4c90 2023-12-12T09:44:02.312 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:02.310+0000 7f2241c9b640 1 -- 172.21.15.73:0/3448912967 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f223c0a4c90 msgr2=0x7f223c0c0320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:02.312 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:02.310+0000 7f2241c9b640 1 --2- 172.21.15.73:0/3448912967 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f223c0a4c90 0x7f223c0c0320 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f22300097a0 tx=0x7f223002b840 comp rx=0 tx=0).stop 2023-12-12T09:44:02.312 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:02.310+0000 7f2241c9b640 1 -- 172.21.15.73:0/3448912967 shutdown_connections 2023-12-12T09:44:02.312 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:02.310+0000 7f2241c9b640 1 --2- 172.21.15.73:0/3448912967 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f223c0a4c90 0x7f223c0c0320 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:02.312 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:02.310+0000 7f2241c9b640 1 --2- 172.21.15.73:0/3448912967 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f223c14ea60 0x7f223c0c5420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:02.312 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:02.310+0000 7f2241c9b640 1 -- 172.21.15.73:0/3448912967 >> 172.21.15.73:0/3448912967 conn(0x7f223c06a4e0 msgr2=0x7f223c06a8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:44:02.312 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:02.310+0000 7f2241c9b640 1 -- 172.21.15.73:0/3448912967 shutdown_connections 2023-12-12T09:44:02.312 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:02.310+0000 7f2241c9b640 1 -- 172.21.15.73:0/3448912967 wait complete. 2023-12-12T09:44:02.313 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:02.312+0000 7f2241c9b640 1 Processor -- start 2023-12-12T09:44:02.313 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:02.312+0000 7f2241c9b640 1 -- start start 2023-12-12T09:44:02.316 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:02.313+0000 7f2241c9b640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f223c0a4c90 0x7f223c1526c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:02.316 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:02.313+0000 7f2241c9b640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f223c0c4420 0x7f223c147020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:02.316 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:02.313+0000 7f2241c9b640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f223c14ea60 0x7f223c147b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:02.316 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:02.313+0000 7f2241c9b640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f223c0aaac0 con 0x7f223c0c4420 2023-12-12T09:44:02.316 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:02.313+0000 7f2241c9b640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f223c155200 con 0x7f223c14ea60 2023-12-12T09:44:02.316 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:02.313+0000 7f2241c9b640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f223c1554e0 con 0x7f223c0a4c90 2023-12-12T09:44:02.316 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:02.313+0000 7f223affd640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f223c0c4420 0x7f223c147020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:02.316 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:02.313+0000 7f223affd640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f223c0c4420 0x7f223c147020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:36206/0 (socket says 172.21.15.73:36206) 2023-12-12T09:44:02.316 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:02.314+0000 7f223affd640 1 -- 172.21.15.73:0/2384546731 learned_addr learned my addr 172.21.15.73:0/2384546731 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:44:02.316 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:02.314+0000 7f223affd640 1 -- 172.21.15.73:0/2384546731 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f223c0a4c90 msgr2=0x7f223c1526c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:02.317 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:02.314+0000 7f223b7fe640 1 --2- 172.21.15.73:0/2384546731 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f223c0a4c90 0x7f223c1526c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:02.317 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:02.314+0000 7f223bfff640 1 --2- 172.21.15.73:0/2384546731 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f223c14ea60 0x7f223c147b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:02.317 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:02.314+0000 7f223affd640 1 --2- 172.21.15.73:0/2384546731 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f223c0a4c90 0x7f223c1526c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:02.317 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:02.314+0000 7f223affd640 1 -- 172.21.15.73:0/2384546731 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f223c14ea60 msgr2=0x7f223c147b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:02.317 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:02.314+0000 7f223affd640 1 --2- 172.21.15.73:0/2384546731 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f223c14ea60 0x7f223c147b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:02.317 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:02.314+0000 7f223affd640 1 -- 172.21.15.73:0/2384546731 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2230009400 con 0x7f223c0c4420 2023-12-12T09:44:02.317 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:02.314+0000 7f223affd640 1 --2- 172.21.15.73:0/2384546731 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f223c0c4420 0x7f223c147020 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f2230034040 tx=0x7f22300046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:44:02.317 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:02.314+0000 7f2223fff640 1 -- 172.21.15.73:0/2384546731 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2230032840 con 0x7f223c0c4420 2023-12-12T09:44:02.317 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:02.315+0000 7f2223fff640 1 -- 172.21.15.73:0/2384546731 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2230031f00 con 0x7f223c0c4420 2023-12-12T09:44:02.317 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:02.315+0000 7f2241c9b640 1 -- 172.21.15.73:0/2384546731 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f223c0aa6e0 con 0x7f223c0c4420 2023-12-12T09:44:02.317 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:02.315+0000 7f2223fff640 1 -- 172.21.15.73:0/2384546731 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2230032be0 con 0x7f223c0c4420 2023-12-12T09:44:02.317 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:02.315+0000 7f2241c9b640 1 -- 172.21.15.73:0/2384546731 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f223c152c00 con 0x7f223c0c4420 2023-12-12T09:44:02.318 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:02.316+0000 7f2241c9b640 1 -- 172.21.15.73:0/2384546731 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f223c067070 con 0x7f223c0c4420 2023-12-12T09:44:02.318 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:02.317+0000 7f2223fff640 1 -- 172.21.15.73:0/2384546731 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f2230032d40 con 0x7f223c0c4420 2023-12-12T09:44:02.319 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:02.318+0000 7f2223fff640 1 --2- 172.21.15.73:0/2384546731 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f222806ae70 0x7f222806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:02.319 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:02.318+0000 7f2223fff640 1 -- 172.21.15.73:0/2384546731 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f22300ab610 con 0x7f223c0c4420 2023-12-12T09:44:02.319 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:02.318+0000 7f223b7fe640 1 --2- 172.21.15.73:0/2384546731 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f222806ae70 0x7f222806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:02.321 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:02.319+0000 7f223b7fe640 1 --2- 172.21.15.73:0/2384546731 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f222806ae70 0x7f222806d330 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f222c006fd0 tx=0x7f222c008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:44:02.324 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:02.323+0000 7f2223fff640 1 -- 172.21.15.73:0/2384546731 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f2230076620 con 0x7f223c0c4420 2023-12-12T09:44:02.516 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:02.515+0000 7f2241c9b640 1 -- 172.21.15.73:0/2384546731 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f223c067580 con 0x7f223c0c4420 2023-12-12T09:44:02.517 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:02.516+0000 7f2223fff640 1 -- 172.21.15.73:0/2384546731 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7f2230080070 con 0x7f223c0c4420 2023-12-12T09:44:02.517 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 64 2023-12-12T09:44:02.520 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:02.518+0000 7f2241c9b640 1 -- 172.21.15.73:0/2384546731 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f222806ae70 msgr2=0x7f222806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:02.520 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:02.518+0000 7f2241c9b640 1 --2- 172.21.15.73:0/2384546731 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f222806ae70 0x7f222806d330 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f222c006fd0 tx=0x7f222c008040 comp rx=0 tx=0).stop 2023-12-12T09:44:02.520 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:02.518+0000 7f2241c9b640 1 -- 172.21.15.73:0/2384546731 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f223c0c4420 msgr2=0x7f223c147020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:02.520 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:02.518+0000 7f2241c9b640 1 --2- 172.21.15.73:0/2384546731 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f223c0c4420 0x7f223c147020 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f2230034040 tx=0x7f22300046c0 comp rx=0 tx=0).stop 2023-12-12T09:44:02.520 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:02.519+0000 7f2241c9b640 1 -- 172.21.15.73:0/2384546731 shutdown_connections 2023-12-12T09:44:02.520 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:02.519+0000 7f2241c9b640 1 --2- 172.21.15.73:0/2384546731 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f222806ae70 0x7f222806d330 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:02.520 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:02.519+0000 7f2241c9b640 1 --2- 172.21.15.73:0/2384546731 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f223c14ea60 0x7f223c147b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:02.520 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:02.519+0000 7f2241c9b640 1 --2- 172.21.15.73:0/2384546731 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f223c0c4420 0x7f223c147020 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:02.520 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:02.519+0000 7f2241c9b640 1 --2- 172.21.15.73:0/2384546731 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f223c0a4c90 0x7f223c1526c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:02.521 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:02.519+0000 7f2241c9b640 1 -- 172.21.15.73:0/2384546731 >> 172.21.15.73:0/2384546731 conn(0x7f223c06a4e0 msgr2=0x7f223c06d5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:44:02.521 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:02.519+0000 7f2241c9b640 1 -- 172.21.15.73:0/2384546731 shutdown_connections 2023-12-12T09:44:02.521 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:02.519+0000 7f2241c9b640 1 -- 172.21.15.73:0/2384546731 wait complete. 2023-12-12T09:44:02.541 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-12T09:44:02.756 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:02.755+0000 7fb47146b640 1 Processor -- start 2023-12-12T09:44:02.757 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:02.756+0000 7fb47146b640 1 -- start start 2023-12-12T09:44:02.758 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:02.757+0000 7fb47146b640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb46c0c0420 0x7fb46c0c17e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:02.758 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:02.757+0000 7fb47146b640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb46c152560 con 0x7fb46c06fca0 2023-12-12T09:44:02.758 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:02.757+0000 7fb47146b640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb46c1532e0 con 0x7fb46c072700 2023-12-12T09:44:02.758 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:02.757+0000 7fb47146b640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb46c152ec0 con 0x7fb46c0c0420 2023-12-12T09:44:02.760 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:02.757+0000 7fb46affd640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7fb46c06fca0 0x7fb46c0c10d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:54568/0 (socket says 172.21.15.73:54568) 2023-12-12T09:44:02.760 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:02.757+0000 7fb46affd640 1 -- 172.21.15.73:0/745217095 learned_addr learned my addr 172.21.15.73:0/745217095 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-12T09:44:02.760 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:02.758+0000 7fb46a7fc640 1 --2- 172.21.15.73:0/745217095 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb46c0c0420 0x7fb46c0c17e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:02.760 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:02.758+0000 7fb469ffb640 1 -- 172.21.15.73:0/745217095 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4014574233 0 0) 0x7fb46c152560 con 0x7fb46c06fca0 2023-12-12T09:44:02.761 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:02.758+0000 7fb469ffb640 1 -- 172.21.15.73:0/745217095 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb458003520 con 0x7fb46c06fca0 2023-12-12T09:44:02.761 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:02.758+0000 7fb469ffb640 1 -- 172.21.15.73:0/745217095 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3321168199 0 0) 0x7fb458003520 con 0x7fb46c06fca0 2023-12-12T09:44:02.761 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:02.758+0000 7fb469ffb640 1 -- 172.21.15.73:0/745217095 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb46c0c0420 msgr2=0x7fb46c0c17e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:44:02.761 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:02.758+0000 7fb469ffb640 1 --2- 172.21.15.73:0/745217095 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb46c0c0420 0x7fb46c0c17e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:02.761 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:02.758+0000 7fb469ffb640 1 -- 172.21.15.73:0/745217095 >> v1:172.21.15.142:6789/0 conn(0x7fb46c072700 legacy=0x7fb46c15ccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:02.761 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:02.758+0000 7fb469ffb640 1 -- 172.21.15.73:0/745217095 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb46c152800 con 0x7fb46c06fca0 2023-12-12T09:44:02.761 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:02.758+0000 7fb469ffb640 1 -- 172.21.15.73:0/745217095 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3186547832 0 0) 0x7fb45c0019f0 con 0x7fb46c06fca0 2023-12-12T09:44:02.761 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:02.758+0000 7fb469ffb640 1 -- 172.21.15.73:0/745217095 >> v1:172.21.15.73:6789/0 conn(0x7fb46c06fca0 legacy=0x7fb46c0c10d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:02.761 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:02.758+0000 7fb469ffb640 1 --2- 172.21.15.73:0/745217095 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb4580039a0 0x7fb458003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:02.761 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:02.758+0000 7fb469ffb640 1 --2- 172.21.15.73:0/745217095 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb46c0c0420 0x7fb4580047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:02.761 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:02.758+0000 7fb469ffb640 1 --2- 172.21.15.73:0/745217095 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb458004d00 0x7fb458005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:02.761 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:02.758+0000 7fb469ffb640 1 -- 172.21.15.73:0/745217095 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb46c152ec0 con 0x7fb458004d00 2023-12-12T09:44:02.761 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:02.758+0000 7fb469ffb640 1 -- 172.21.15.73:0/745217095 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb45800bab0 con 0x7fb4580039a0 2023-12-12T09:44:02.761 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:02.758+0000 7fb469ffb640 1 -- 172.21.15.73:0/745217095 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb45800bc70 con 0x7fb46c0c0420 2023-12-12T09:44:02.762 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:02.759+0000 7fb46b7fe640 1 --2- 172.21.15.73:0/745217095 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb458004d00 0x7fb458005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:02.762 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:02.759+0000 7fb46affd640 1 --2- 172.21.15.73:0/745217095 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb4580039a0 0x7fb458003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:02.762 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:02.759+0000 7fb46a7fc640 1 --2- 172.21.15.73:0/745217095 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb46c0c0420 0x7fb4580047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:02.762 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:02.759+0000 7fb46b7fe640 1 -- 172.21.15.73:0/745217095 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb46c0c0420 msgr2=0x7fb4580047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:44:02.762 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:02.759+0000 7fb46b7fe640 1 --2- 172.21.15.73:0/745217095 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb46c0c0420 0x7fb4580047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:02.762 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:02.759+0000 7fb46b7fe640 1 -- 172.21.15.73:0/745217095 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb4580039a0 msgr2=0x7fb458003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:44:02.762 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:02.759+0000 7fb46b7fe640 1 --2- 172.21.15.73:0/745217095 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb4580039a0 0x7fb458003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:02.762 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:02.759+0000 7fb46b7fe640 1 -- 172.21.15.73:0/745217095 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb458003520 con 0x7fb458004d00 2023-12-12T09:44:02.762 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:02.759+0000 7fb46a7fc640 1 --2- 172.21.15.73:0/745217095 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb46c0c0420 0x7fb4580047c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:44:02.763 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:02.760+0000 7fb46b7fe640 1 --2- 172.21.15.73:0/745217095 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb458004d00 0x7fb458005180 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fb464001750 tx=0x7fb4580057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21595791dba36a10 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:44:02.763 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:02.760+0000 7fb469ffb640 1 -- 172.21.15.73:0/745217095 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4640052d0 con 0x7fb458004d00 2023-12-12T09:44:02.763 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:02.760+0000 7fb469ffb640 1 -- 172.21.15.73:0/745217095 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb46402e050 con 0x7fb458004d00 2023-12-12T09:44:02.763 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:02.760+0000 7fb469ffb640 1 -- 172.21.15.73:0/745217095 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4640035f0 con 0x7fb458004d00 2023-12-12T09:44:02.763 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:02.761+0000 7fb47146b640 1 -- 172.21.15.73:0/745217095 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb458004d00 msgr2=0x7fb458005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:02.764 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:02.761+0000 7fb47146b640 1 --2- 172.21.15.73:0/745217095 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb458004d00 0x7fb458005180 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fb464001750 tx=0x7fb4580057f0 comp rx=0 tx=0).stop 2023-12-12T09:44:02.764 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:02.761+0000 7fb46b7fe640 1 -- 172.21.15.73:0/745217095 reap_dead start 2023-12-12T09:44:02.764 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:02.761+0000 7fb47146b640 1 -- 172.21.15.73:0/745217095 shutdown_connections 2023-12-12T09:44:02.764 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:02.761+0000 7fb47146b640 1 -- 172.21.15.73:0/745217095 >> 172.21.15.73:0/745217095 conn(0x7fb46c0a77d0 msgr2=0x7fb46c0a7bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:44:02.764 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:02.761+0000 7fb47146b640 1 -- 172.21.15.73:0/745217095 shutdown_connections 2023-12-12T09:44:02.764 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:02.761+0000 7fb47146b640 1 -- 172.21.15.73:0/745217095 wait complete. 2023-12-12T09:44:02.764 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:02.763+0000 7fb47146b640 1 Processor -- start 2023-12-12T09:44:02.764 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:02.763+0000 7fb47146b640 1 -- start start 2023-12-12T09:44:02.765 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:02.764+0000 7fb47146b640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb46c155ab0 0x7fb46c06cdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:02.765 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:02.764+0000 7fb47146b640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb46c14c910 0x7fb46c155e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:02.765 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:02.764+0000 7fb47146b640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb46c0ab890 0x7fb46c1ed910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:02.765 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:02.764+0000 7fb47146b640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb46c06c990 con 0x7fb46c14c910 2023-12-12T09:44:02.765 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:02.764+0000 7fb47146b640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb46c06d8a0 con 0x7fb46c0ab890 2023-12-12T09:44:02.766 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:02.764+0000 7fb47146b640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb46c06be60 con 0x7fb46c155ab0 2023-12-12T09:44:02.766 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:02.764+0000 7fb46a7fc640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb46c14c910 0x7fb46c155e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:02.766 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:02.764+0000 7fb46a7fc640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb46c14c910 0x7fb46c155e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:36222/0 (socket says 172.21.15.73:36222) 2023-12-12T09:44:02.766 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:02.764+0000 7fb46a7fc640 1 -- 172.21.15.73:0/4092901378 learned_addr learned my addr 172.21.15.73:0/4092901378 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:44:02.767 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:02.765+0000 7fb46affd640 1 --2- 172.21.15.73:0/4092901378 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb46c155ab0 0x7fb46c06cdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:02.767 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:02.765+0000 7fb46a7fc640 1 -- 172.21.15.73:0/4092901378 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb46c155ab0 msgr2=0x7fb46c06cdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:02.767 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:02.765+0000 7fb46a7fc640 1 --2- 172.21.15.73:0/4092901378 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb46c155ab0 0x7fb46c06cdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:02.767 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:02.765+0000 7fb46a7fc640 1 -- 172.21.15.73:0/4092901378 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb46c0ab890 msgr2=0x7fb46c1ed910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:02.767 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:02.765+0000 7fb46a7fc640 1 --2- 172.21.15.73:0/4092901378 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb46c0ab890 0x7fb46c1ed910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:02.767 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:02.765+0000 7fb46a7fc640 1 -- 172.21.15.73:0/4092901378 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb46c1eafa0 con 0x7fb46c14c910 2023-12-12T09:44:02.767 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:02.765+0000 7fb46a7fc640 1 --2- 172.21.15.73:0/4092901378 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb46c14c910 0x7fb46c155e90 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fb454010880 tx=0x7fb454010d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:44:02.767 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:02.765+0000 7fb4637fe640 1 -- 172.21.15.73:0/4092901378 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb45400eae0 con 0x7fb46c14c910 2023-12-12T09:44:02.768 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:02.765+0000 7fb4637fe640 1 -- 172.21.15.73:0/4092901378 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb45400ec40 con 0x7fb46c14c910 2023-12-12T09:44:02.768 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:02.765+0000 7fb4637fe640 1 -- 172.21.15.73:0/4092901378 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb45401c400 con 0x7fb46c14c910 2023-12-12T09:44:02.768 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:02.765+0000 7fb47146b640 1 -- 172.21.15.73:0/4092901378 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb46c06db40 con 0x7fb46c14c910 2023-12-12T09:44:02.768 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:02.766+0000 7fb47146b640 1 -- 172.21.15.73:0/4092901378 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb46c1ede50 con 0x7fb46c14c910 2023-12-12T09:44:02.768 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:02.767+0000 7fb47146b640 1 -- 172.21.15.73:0/4092901378 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb46c1ee0a0 con 0x7fb46c14c910 2023-12-12T09:44:02.768 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:02.768+0000 7fb4637fe640 1 -- 172.21.15.73:0/4092901378 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fb45401c560 con 0x7fb46c14c910 2023-12-12T09:44:02.770 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:02.769+0000 7fb4637fe640 1 --2- 172.21.15.73:0/4092901378 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fb44c06ae40 0x7fb44c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:02.770 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:02.769+0000 7fb4637fe640 1 -- 172.21.15.73:0/4092901378 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb454089bc0 con 0x7fb46c14c910 2023-12-12T09:44:02.770 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:02.769+0000 7fb46affd640 1 --2- 172.21.15.73:0/4092901378 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fb44c06ae40 0x7fb44c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:02.770 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:02.769+0000 7fb46affd640 1 --2- 172.21.15.73:0/4092901378 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fb44c06ae40 0x7fb44c06d300 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fb45c007250 tx=0x7fb45c009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:44:02.774 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:02.773+0000 7fb4637fe640 1 -- 172.21.15.73:0/4092901378 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fb454054d50 con 0x7fb46c14c910 2023-12-12T09:44:02.967 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:02.966+0000 7fb47146b640 1 -- 172.21.15.73:0/4092901378 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fb46c0a6fa0 con 0x7fb46c14c910 2023-12-12T09:44:02.968 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:02.967+0000 7fb4637fe640 1 -- 172.21.15.73:0/4092901378 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v21) v1 ==== 80+0+0 (secure 0 0 0) 0x7fb454058370 con 0x7fb46c14c910 2023-12-12T09:44:02.968 INFO:teuthology.orchestra.run.smithi073.stderr:listed 0 entries 2023-12-12T09:44:02.971 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:02.969+0000 7fb47146b640 1 -- 172.21.15.73:0/4092901378 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fb44c06ae40 msgr2=0x7fb44c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:02.971 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:02.969+0000 7fb47146b640 1 --2- 172.21.15.73:0/4092901378 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fb44c06ae40 0x7fb44c06d300 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fb45c007250 tx=0x7fb45c009040 comp rx=0 tx=0).stop 2023-12-12T09:44:02.971 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:02.969+0000 7fb47146b640 1 -- 172.21.15.73:0/4092901378 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb46c14c910 msgr2=0x7fb46c155e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:02.971 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:02.969+0000 7fb47146b640 1 --2- 172.21.15.73:0/4092901378 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb46c14c910 0x7fb46c155e90 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fb454010880 tx=0x7fb454010d40 comp rx=0 tx=0).stop 2023-12-12T09:44:02.971 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:02.969+0000 7fb47146b640 1 -- 172.21.15.73:0/4092901378 shutdown_connections 2023-12-12T09:44:02.971 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:02.969+0000 7fb47146b640 1 --2- 172.21.15.73:0/4092901378 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fb44c06ae40 0x7fb44c06d300 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:02.971 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:02.969+0000 7fb47146b640 1 --2- 172.21.15.73:0/4092901378 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb46c0ab890 0x7fb46c1ed910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:02.971 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:02.969+0000 7fb47146b640 1 --2- 172.21.15.73:0/4092901378 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb46c14c910 0x7fb46c155e90 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:02.971 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:02.969+0000 7fb47146b640 1 --2- 172.21.15.73:0/4092901378 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb46c155ab0 0x7fb46c06cdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:02.971 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:02.969+0000 7fb47146b640 1 -- 172.21.15.73:0/4092901378 >> 172.21.15.73:0/4092901378 conn(0x7fb46c0a77d0 msgr2=0x7fb46c150a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:44:02.971 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:02.970+0000 7fb47146b640 1 -- 172.21.15.73:0/4092901378 shutdown_connections 2023-12-12T09:44:02.971 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:02.970+0000 7fb47146b640 1 -- 172.21.15.73:0/4092901378 wait complete. 2023-12-12T09:44:02.988 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-12-12T09:44:02.988 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T09:44:02.988 DEBUG:teuthology.orchestra.run.smithi142:> sudo umount /home/ubuntu/cephtest/mnt.1 -f 2023-12-12T09:44:03.096 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi142.front.sepia.ceph.com 2023-12-12T09:44:03.096 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T09:44:03.096 DEBUG:teuthology.orchestra.run.smithi142:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-12-12T09:44:03.154 INFO:tasks.cephfs.cephfs_test_case:[, ] 2023-12-12T09:44:03.155 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-12T09:44:03.366 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:03.365+0000 7f50299b6640 1 Processor -- start 2023-12-12T09:44:03.366 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:03.365+0000 7f50299b6640 1 -- start start 2023-12-12T09:44:03.367 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:03.366+0000 7f50299b6640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f502406db70 0x7f50240c39b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:03.367 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:03.366+0000 7f50299b6640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f50240c5070 0x7f50240c3ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:03.367 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:03.366+0000 7f50299b6640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5024152610 con 0x7f502414fa40 2023-12-12T09:44:03.367 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:03.366+0000 7f50299b6640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50241528f0 con 0x7f502406db70 2023-12-12T09:44:03.368 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:03.366+0000 7f50299b6640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5024152bd0 con 0x7f50240c5070 2023-12-12T09:44:03.368 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:03.366+0000 7f5022ffd640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f502414fa40 0x7f502406a4e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:54574/0 (socket says 172.21.15.73:54574) 2023-12-12T09:44:03.368 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:03.367+0000 7f5022ffd640 1 -- 172.21.15.73:0/1540078151 learned_addr learned my addr 172.21.15.73:0/1540078151 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-12T09:44:03.369 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:03.367+0000 7f50227fc640 1 --2- 172.21.15.73:0/1540078151 >> v2:172.21.15.142:3300/0 conn(0x7f502406db70 0x7f50240c39b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:03.369 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:03.367+0000 7f50237fe640 1 --2- 172.21.15.73:0/1540078151 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f50240c5070 0x7f50240c3ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:03.370 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:03.367+0000 7f5021ffb640 1 -- 172.21.15.73:0/1540078151 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4204002916 0 0) 0x7f5024152610 con 0x7f502414fa40 2023-12-12T09:44:03.370 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:03.367+0000 7f5021ffb640 1 -- 172.21.15.73:0/1540078151 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f500c003520 con 0x7f502414fa40 2023-12-12T09:44:03.370 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:03.367+0000 7f5021ffb640 1 -- 172.21.15.73:0/1540078151 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2152368625 0 0) 0x7f500c003520 con 0x7f502414fa40 2023-12-12T09:44:03.370 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:03.367+0000 7f5021ffb640 1 -- 172.21.15.73:0/1540078151 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f50240c5070 msgr2=0x7f50240c3ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:44:03.370 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:03.367+0000 7f5021ffb640 1 --2- 172.21.15.73:0/1540078151 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f50240c5070 0x7f50240c3ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:03.370 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:03.367+0000 7f5021ffb640 1 -- 172.21.15.73:0/1540078151 >> v2:172.21.15.142:3300/0 conn(0x7f502406db70 msgr2=0x7f50240c39b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:44:03.370 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:03.367+0000 7f5021ffb640 1 --2- 172.21.15.73:0/1540078151 >> v2:172.21.15.142:3300/0 conn(0x7f502406db70 0x7f50240c39b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:03.370 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:03.367+0000 7f5021ffb640 1 -- 172.21.15.73:0/1540078151 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5024152eb0 con 0x7f502414fa40 2023-12-12T09:44:03.370 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:03.367+0000 7f5021ffb640 1 -- 172.21.15.73:0/1540078151 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3186547832 0 0) 0x7f5014001670 con 0x7f502414fa40 2023-12-12T09:44:03.370 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:03.367+0000 7f50227fc640 1 --2- 172.21.15.73:0/1540078151 >> v2:172.21.15.142:3300/0 conn(0x7f502406db70 0x7f50240c39b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-12T09:44:03.370 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:03.367+0000 7f5021ffb640 1 -- 172.21.15.73:0/1540078151 >> v1:172.21.15.73:6789/0 conn(0x7f502414fa40 legacy=0x7f502406a4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:03.370 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:03.367+0000 7f5021ffb640 1 --2- 172.21.15.73:0/1540078151 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f50240c5070 0x7f500c003970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:03.370 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:03.368+0000 7f5021ffb640 1 --2- 172.21.15.73:0/1540078151 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f500c003f40 0x7f500c0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:03.371 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:03.368+0000 7f5021ffb640 1 --2- 172.21.15.73:0/1540078151 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f500c004d00 0x7f500c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:03.371 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:03.368+0000 7f5021ffb640 1 -- 172.21.15.73:0/1540078151 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50241528f0 con 0x7f500c004d00 2023-12-12T09:44:03.371 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:03.368+0000 7f5021ffb640 1 -- 172.21.15.73:0/1540078151 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5024152bd0 con 0x7f500c003f40 2023-12-12T09:44:03.371 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:03.368+0000 7f5021ffb640 1 -- 172.21.15.73:0/1540078151 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f500c00ba30 con 0x7f50240c5070 2023-12-12T09:44:03.371 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:03.368+0000 7f50237fe640 1 --2- 172.21.15.73:0/1540078151 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f500c004d00 0x7f500c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:03.371 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:03.368+0000 7f5022ffd640 1 --2- 172.21.15.73:0/1540078151 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f50240c5070 0x7f500c003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:03.371 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:03.368+0000 7f50227fc640 1 --2- 172.21.15.73:0/1540078151 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f500c003f40 0x7f500c0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:03.371 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:03.368+0000 7f50237fe640 1 -- 172.21.15.73:0/1540078151 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f50240c5070 msgr2=0x7f500c003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:44:03.371 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:03.368+0000 7f50237fe640 1 --2- 172.21.15.73:0/1540078151 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f50240c5070 0x7f500c003970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:03.372 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:03.368+0000 7f50237fe640 1 -- 172.21.15.73:0/1540078151 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f500c003f40 msgr2=0x7f500c0047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:44:03.372 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:03.368+0000 7f50237fe640 1 --2- 172.21.15.73:0/1540078151 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f500c003f40 0x7f500c0047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:03.372 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:03.368+0000 7f50237fe640 1 -- 172.21.15.73:0/1540078151 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f500c003520 con 0x7f500c004d00 2023-12-12T09:44:03.372 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:03.368+0000 7f5022ffd640 1 --2- 172.21.15.73:0/1540078151 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f50240c5070 0x7f500c003970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:44:03.372 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:03.368+0000 7f50227fc640 1 --2- 172.21.15.73:0/1540078151 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f500c003f40 0x7f500c0047c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:44:03.373 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:03.369+0000 7f50237fe640 1 --2- 172.21.15.73:0/1540078151 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f500c004d00 0x7f500c005180 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f501c009fc0 tx=0x7f500c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=908d5d599fa42830 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:44:03.373 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:03.370+0000 7f5021ffb640 1 -- 172.21.15.73:0/1540078151 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f501c02cc20 con 0x7f500c004d00 2023-12-12T09:44:03.373 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:03.370+0000 7f5021ffb640 1 -- 172.21.15.73:0/1540078151 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f501c00f040 con 0x7f500c004d00 2023-12-12T09:44:03.373 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:03.370+0000 7f5021ffb640 1 -- 172.21.15.73:0/1540078151 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f501c034440 con 0x7f500c004d00 2023-12-12T09:44:03.373 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:03.370+0000 7f50299b6640 1 -- 172.21.15.73:0/1540078151 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f500c004d00 msgr2=0x7f500c005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:03.373 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:03.370+0000 7f50299b6640 1 --2- 172.21.15.73:0/1540078151 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f500c004d00 0x7f500c005180 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f501c009fc0 tx=0x7f500c0057f0 comp rx=0 tx=0).stop 2023-12-12T09:44:03.373 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:03.370+0000 7f50237fe640 1 -- 172.21.15.73:0/1540078151 reap_dead start 2023-12-12T09:44:03.374 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:03.370+0000 7f50299b6640 1 -- 172.21.15.73:0/1540078151 shutdown_connections 2023-12-12T09:44:03.374 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:03.370+0000 7f50299b6640 1 -- 172.21.15.73:0/1540078151 >> 172.21.15.73:0/1540078151 conn(0x7f50240a8130 msgr2=0x7f50240c24b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:44:03.374 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:03.370+0000 7f50299b6640 1 -- 172.21.15.73:0/1540078151 shutdown_connections 2023-12-12T09:44:03.374 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:03.371+0000 7f50299b6640 1 -- 172.21.15.73:0/1540078151 wait complete. 2023-12-12T09:44:03.374 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:03.372+0000 7f50299b6640 1 Processor -- start 2023-12-12T09:44:03.374 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:03.372+0000 7f50299b6640 1 -- start start 2023-12-12T09:44:03.375 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:03.373+0000 7f50299b6640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f500c004d00 0x7f5024150cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:03.376 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:03.373+0000 7f50299b6640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f50240a6da0 0x7f5024155ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:03.376 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:03.373+0000 7f50299b6640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f50241561e0 0x7f50241ed3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:03.376 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:03.373+0000 7f50299b6640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50241ecf40 con 0x7f50240a6da0 2023-12-12T09:44:03.376 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:03.373+0000 7f50299b6640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5024156640 con 0x7f50241561e0 2023-12-12T09:44:03.376 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:03.373+0000 7f50299b6640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50240aa7c0 con 0x7f500c004d00 2023-12-12T09:44:03.376 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:03.373+0000 7f50227fc640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f50240a6da0 0x7f5024155ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:03.376 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:03.374+0000 7f50227fc640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f50240a6da0 0x7f5024155ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:36242/0 (socket says 172.21.15.73:36242) 2023-12-12T09:44:03.376 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:03.374+0000 7f50227fc640 1 -- 172.21.15.73:0/1484852101 learned_addr learned my addr 172.21.15.73:0/1484852101 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:44:03.376 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:03.374+0000 7f50237fe640 1 --2- 172.21.15.73:0/1484852101 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f50241561e0 0x7f50241ed3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:03.376 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:03.374+0000 7f5022ffd640 1 --2- 172.21.15.73:0/1484852101 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f500c004d00 0x7f5024150cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:03.376 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:03.374+0000 7f50227fc640 1 -- 172.21.15.73:0/1484852101 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f500c004d00 msgr2=0x7f5024150cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:03.376 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:03.374+0000 7f50227fc640 1 --2- 172.21.15.73:0/1484852101 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f500c004d00 0x7f5024150cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:03.376 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:03.374+0000 7f50227fc640 1 -- 172.21.15.73:0/1484852101 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f50241561e0 msgr2=0x7f50241ed3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:03.376 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:03.374+0000 7f50227fc640 1 --2- 172.21.15.73:0/1484852101 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f50241561e0 0x7f50241ed3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:03.376 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:03.374+0000 7f50227fc640 1 -- 172.21.15.73:0/1484852101 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50240aaaa0 con 0x7f50240a6da0 2023-12-12T09:44:03.377 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:03.374+0000 7f50227fc640 1 --2- 172.21.15.73:0/1484852101 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f50240a6da0 0x7f5024155ca0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f501800f650 tx=0x7f501800fb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:44:03.377 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:03.374+0000 7f500bfff640 1 -- 172.21.15.73:0/1484852101 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50180098e0 con 0x7f50240a6da0 2023-12-12T09:44:03.377 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:03.374+0000 7f500bfff640 1 -- 172.21.15.73:0/1484852101 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f501800c030 con 0x7f50240a6da0 2023-12-12T09:44:03.377 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:03.374+0000 7f500bfff640 1 -- 172.21.15.73:0/1484852101 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5018009c40 con 0x7f50240a6da0 2023-12-12T09:44:03.377 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:03.374+0000 7f50299b6640 1 -- 172.21.15.73:0/1484852101 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50241ea470 con 0x7f50240a6da0 2023-12-12T09:44:03.377 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:03.375+0000 7f50299b6640 1 -- 172.21.15.73:0/1484852101 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50241e7570 con 0x7f50240a6da0 2023-12-12T09:44:03.377 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:03.376+0000 7f50299b6640 1 -- 172.21.15.73:0/1484852101 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50240c3120 con 0x7f50240a6da0 2023-12-12T09:44:03.377 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:03.377+0000 7f500bfff640 1 -- 172.21.15.73:0/1484852101 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f5018014480 con 0x7f50240a6da0 2023-12-12T09:44:03.378 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:03.378+0000 7f500bfff640 1 --2- 172.21.15.73:0/1484852101 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f501006ae70 0x7f501006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:03.379 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:03.378+0000 7f500bfff640 1 -- 172.21.15.73:0/1484852101 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f50180898e0 con 0x7f50240a6da0 2023-12-12T09:44:03.379 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:03.378+0000 7f5022ffd640 1 --2- 172.21.15.73:0/1484852101 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f501006ae70 0x7f501006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:03.379 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:03.378+0000 7f5022ffd640 1 --2- 172.21.15.73:0/1484852101 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f501006ae70 0x7f501006d330 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f5014007950 tx=0x7f5014009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:44:03.383 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:03.382+0000 7f500bfff640 1 -- 172.21.15.73:0/1484852101 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f5018054a20 con 0x7f50240a6da0 2023-12-12T09:44:03.614 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:03.613+0000 7f50299b6640 1 -- 172.21.15.73:0/1484852101 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5024067580 con 0x7f50240a6da0 2023-12-12T09:44:03.615 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:03.614+0000 7f500bfff640 1 -- 172.21.15.73:0/1484852101 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4913 (secure 0 0 0) 0x7f5018021090 con 0x7f50240a6da0 2023-12-12T09:44:03.615 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-12T09:44:03.615 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4257,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6835/1079394562","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":1079394562},{"type":"v1","addr":"172.21.15.73:6835","nonce":1079394562}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4258,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6835/3726638062","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6833","nonce":3726638062},{"type":"v1","addr":"172.21.15.142:6835","nonce":3726638062}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4260,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6837/2513898821","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6836","nonce":2513898821},{"type":"v1","addr":"172.21.15.73:6837","nonce":2513898821}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-12T09:43:21.720752+0000","modified":"2023-12-12T09:43:24.801495+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4269},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4269":{"gid":4269,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.142:6834/1773392257","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6832","nonce":1773392257},{"type":"v1","addr":"172.21.15.142:6834","nonce":1773392257}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-12-12T09:44:03.616 INFO:teuthology.orchestra.run.smithi073.stderr:dumped fsmap epoch 8 2023-12-12T09:44:03.619 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:03.617+0000 7f50299b6640 1 -- 172.21.15.73:0/1484852101 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f501006ae70 msgr2=0x7f501006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:03.619 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:03.617+0000 7f50299b6640 1 --2- 172.21.15.73:0/1484852101 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f501006ae70 0x7f501006d330 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f5014007950 tx=0x7f5014009040 comp rx=0 tx=0).stop 2023-12-12T09:44:03.619 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:03.617+0000 7f50299b6640 1 -- 172.21.15.73:0/1484852101 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f50240a6da0 msgr2=0x7f5024155ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:03.619 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:03.617+0000 7f50299b6640 1 --2- 172.21.15.73:0/1484852101 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f50240a6da0 0x7f5024155ca0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f501800f650 tx=0x7f501800fb10 comp rx=0 tx=0).stop 2023-12-12T09:44:03.619 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:03.617+0000 7f50299b6640 1 -- 172.21.15.73:0/1484852101 shutdown_connections 2023-12-12T09:44:03.619 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:03.617+0000 7f50299b6640 1 --2- 172.21.15.73:0/1484852101 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f501006ae70 0x7f501006d330 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:03.619 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:03.617+0000 7f50299b6640 1 --2- 172.21.15.73:0/1484852101 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f50241561e0 0x7f50241ed3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:03.619 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:03.617+0000 7f50299b6640 1 --2- 172.21.15.73:0/1484852101 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f50240a6da0 0x7f5024155ca0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:03.620 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:03.617+0000 7f50299b6640 1 --2- 172.21.15.73:0/1484852101 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f500c004d00 0x7f5024150cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:03.620 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:03.617+0000 7f50299b6640 1 -- 172.21.15.73:0/1484852101 >> 172.21.15.73:0/1484852101 conn(0x7f50240a8130 msgr2=0x7f502414f210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:44:03.620 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:03.617+0000 7f50299b6640 1 -- 172.21.15.73:0/1484852101 shutdown_connections 2023-12-12T09:44:03.620 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:03.617+0000 7f50299b6640 1 -- 172.21.15.73:0/1484852101 wait complete. 2023-12-12T09:44:03.636 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-12T09:44:03.845 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:03.844+0000 7f52cc389640 1 Processor -- start 2023-12-12T09:44:03.845 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:03.844+0000 7f52cc389640 1 -- start start 2023-12-12T09:44:03.847 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:03.845+0000 7f52cc389640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f52c406a750 0x7f52c4159020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:03.847 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:03.846+0000 7f52cc389640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f52c40bfdc0 0x7f52c40c38b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:03.847 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:03.846+0000 7f52cc389640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52c4158b90 con 0x7f52c4071f00 2023-12-12T09:44:03.847 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:03.846+0000 7f52cc389640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52c40727c0 con 0x7f52c40bfdc0 2023-12-12T09:44:03.847 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:03.846+0000 7f52cc389640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52c41588f0 con 0x7f52c406a750 2023-12-12T09:44:03.847 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:03.846+0000 7f52ca926640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f52c40bfdc0 0x7f52c40c38b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:03.847 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:03.846+0000 7f52ca926640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f52c40bfdc0 0x7f52c40c38b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:36244/0 (socket says 172.21.15.73:36244) 2023-12-12T09:44:03.847 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:03.846+0000 7f52ca926640 1 -- 172.21.15.73:0/1936127856 learned_addr learned my addr 172.21.15.73:0/1936127856 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:44:03.848 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:03.846+0000 7f52ca926640 1 -- 172.21.15.73:0/1936127856 >> v2:172.21.15.142:3300/0 conn(0x7f52c406a750 msgr2=0x7f52c4159020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:44:03.848 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:03.846+0000 7f52ca926640 1 --2- 172.21.15.73:0/1936127856 >> v2:172.21.15.142:3300/0 conn(0x7f52c406a750 0x7f52c4159020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:03.848 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:03.846+0000 7f52ca926640 1 -- 172.21.15.73:0/1936127856 >> v1:172.21.15.142:6789/0 conn(0x7f52c4071f00 legacy=0x7f52c4155aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:44:03.848 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:03.846+0000 7f52ca926640 1 -- 172.21.15.73:0/1936127856 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52c40c4e30 con 0x7f52c40bfdc0 2023-12-12T09:44:03.848 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:03.847+0000 7f52ca926640 1 --2- 172.21.15.73:0/1936127856 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f52c40bfdc0 0x7f52c40c38b0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f52c406e3c0 tx=0x7f52bc02bdc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f6109fdba2b45db server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:44:03.849 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:03.848+0000 7f52c9123640 1 -- 172.21.15.73:0/1936127856 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52bc02c960 con 0x7f52c40bfdc0 2023-12-12T09:44:03.849 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:03.848+0000 7f52c9123640 1 -- 172.21.15.73:0/1936127856 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52bc02cac0 con 0x7f52c40bfdc0 2023-12-12T09:44:03.849 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:03.848+0000 7f52c9123640 1 -- 172.21.15.73:0/1936127856 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52bc02ce50 con 0x7f52c40bfdc0 2023-12-12T09:44:03.850 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:03.848+0000 7f52cc389640 1 -- 172.21.15.73:0/1936127856 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f52c40bfdc0 msgr2=0x7f52c40c38b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:03.850 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:03.848+0000 7f52cc389640 1 --2- 172.21.15.73:0/1936127856 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f52c40bfdc0 0x7f52c40c38b0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f52c406e3c0 tx=0x7f52bc02bdc0 comp rx=0 tx=0).stop 2023-12-12T09:44:03.850 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:03.849+0000 7f52cc389640 1 -- 172.21.15.73:0/1936127856 shutdown_connections 2023-12-12T09:44:03.850 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:03.849+0000 7f52cc389640 1 --2- 172.21.15.73:0/1936127856 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f52c40bfdc0 0x7f52c40c38b0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:03.850 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:03.849+0000 7f52cc389640 1 --2- 172.21.15.73:0/1936127856 >> v2:172.21.15.142:3300/0 conn(0x7f52c406a750 0x7f52c4159020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:03.850 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:03.849+0000 7f52cc389640 1 -- 172.21.15.73:0/1936127856 >> 172.21.15.73:0/1936127856 conn(0x7f52c40a8130 msgr2=0x7f52c40c24b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:44:03.850 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:03.849+0000 7f52cc389640 1 -- 172.21.15.73:0/1936127856 shutdown_connections 2023-12-12T09:44:03.850 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:03.849+0000 7f52cc389640 1 -- 172.21.15.73:0/1936127856 wait complete. 2023-12-12T09:44:03.851 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:03.850+0000 7f52cc389640 1 Processor -- start 2023-12-12T09:44:03.851 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:03.850+0000 7f52cc389640 1 -- start start 2023-12-12T09:44:03.852 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:03.851+0000 7f52cc389640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f52c406a750 0x7f52c41efbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:03.852 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:03.851+0000 7f52cc389640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f52c4071f00 0x7f52c40a9a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:03.852 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:03.851+0000 7f52cc389640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f52c40bfdc0 0x7f52c40baeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:03.853 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:03.851+0000 7f52cc389640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52c40bb860 con 0x7f52c4071f00 2023-12-12T09:44:03.853 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:03.851+0000 7f52cc389640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52c41ef360 con 0x7f52c40bfdc0 2023-12-12T09:44:03.853 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:03.851+0000 7f52cc389640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52c415bc00 con 0x7f52c406a750 2023-12-12T09:44:03.853 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:03.851+0000 7f52c9924640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f52c4071f00 0x7f52c40a9a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:03.853 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:03.852+0000 7f52c9924640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f52c4071f00 0x7f52c40a9a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:36258/0 (socket says 172.21.15.73:36258) 2023-12-12T09:44:03.853 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:03.852+0000 7f52c9924640 1 -- 172.21.15.73:0/4005452978 learned_addr learned my addr 172.21.15.73:0/4005452978 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:44:03.854 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:03.852+0000 7f52c9924640 1 -- 172.21.15.73:0/4005452978 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f52c406a750 msgr2=0x7f52c41efbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:03.854 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:03.852+0000 7f52c9924640 1 --2- 172.21.15.73:0/4005452978 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f52c406a750 0x7f52c41efbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:03.854 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:03.852+0000 7f52c9924640 1 -- 172.21.15.73:0/4005452978 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f52c40bfdc0 msgr2=0x7f52c40baeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:03.854 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:03.852+0000 7f52c9924640 1 --2- 172.21.15.73:0/4005452978 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f52c40bfdc0 0x7f52c40baeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:03.854 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:03.852+0000 7f52c9924640 1 -- 172.21.15.73:0/4005452978 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52bc009b30 con 0x7f52c4071f00 2023-12-12T09:44:03.854 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:03.852+0000 7f52c9924640 1 --2- 172.21.15.73:0/4005452978 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f52c4071f00 0x7f52c40a9a80 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f52b400b3e0 tx=0x7f52b400b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:44:03.854 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:03.852+0000 7f52baffd640 1 -- 172.21.15.73:0/4005452978 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52b4011830 con 0x7f52c4071f00 2023-12-12T09:44:03.854 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:03.852+0000 7f52baffd640 1 -- 172.21.15.73:0/4005452978 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52b40119b0 con 0x7f52c4071f00 2023-12-12T09:44:03.854 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:03.852+0000 7f52baffd640 1 -- 172.21.15.73:0/4005452978 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52b4011d60 con 0x7f52c4071f00 2023-12-12T09:44:03.854 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:03.852+0000 7f52cc389640 1 -- 172.21.15.73:0/4005452978 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52c415bee0 con 0x7f52c4071f00 2023-12-12T09:44:03.855 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:03.853+0000 7f52cc389640 1 -- 172.21.15.73:0/4005452978 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52c41f00f0 con 0x7f52c4071f00 2023-12-12T09:44:03.855 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:03.854+0000 7f52cc389640 1 -- 172.21.15.73:0/4005452978 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52c406cac0 con 0x7f52c4071f00 2023-12-12T09:44:03.855 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:03.855+0000 7f52baffd640 1 -- 172.21.15.73:0/4005452978 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f52b401a400 con 0x7f52c4071f00 2023-12-12T09:44:03.856 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:03.856+0000 7f52baffd640 1 --2- 172.21.15.73:0/4005452978 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f52a806ae70 0x7f52a806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:03.856 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:03.856+0000 7f52baffd640 1 -- 172.21.15.73:0/4005452978 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f52b4089750 con 0x7f52c4071f00 2023-12-12T09:44:03.857 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:03.856+0000 7f52ca125640 1 --2- 172.21.15.73:0/4005452978 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f52a806ae70 0x7f52a806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:03.858 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:03.857+0000 7f52ca125640 1 --2- 172.21.15.73:0/4005452978 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f52a806ae70 0x7f52a806d330 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f52c0009670 tx=0x7f52c0006bf0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:44:03.861 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:03.860+0000 7f52baffd640 1 -- 172.21.15.73:0/4005452978 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f52b40547f0 con 0x7f52c4071f00 2023-12-12T09:44:04.051 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:04.050+0000 7f52cc389640 1 -- 172.21.15.73:0/4005452978 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f52c406ab30 con 0x7f52c4071f00 2023-12-12T09:44:04.054 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:04.053+0000 7f52baffd640 1 -- 172.21.15.73:0/4005452978 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16517 (secure 0 0 0) 0x7f52b4057e10 con 0x7f52c4071f00 2023-12-12T09:44:04.055 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-12T09:44:04.055 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":21,"fsid":"ba240992-02b8-4c7e-92f2-27eb29ac433b","created":"2023-12-12T09:43:02.454719+0000","modified":"2023-12-12T09:43:23.219345+0000","last_up_change":"2023-12-12T09:43:13.913440+0000","last_in_change":"2023-12-12T09:43:05.925348+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-12T09:43:15.525508+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-12T09:43:20.004546+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-12T09:43:20.736500+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"dd9074be-dbe2-4c34-9896-a4223d8d3940","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":4047810203},{"type":"v1","addr":"172.21.15.73:6801","nonce":4047810203}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":4047810203},{"type":"v1","addr":"172.21.15.73:6803","nonce":4047810203}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":4047810203},{"type":"v1","addr":"172.21.15.73:6807","nonce":4047810203}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":4047810203},{"type":"v1","addr":"172.21.15.73:6805","nonce":4047810203}]},"public_addr":"172.21.15.73:6801/4047810203","cluster_addr":"172.21.15.73:6803/4047810203","heartbeat_back_addr":"172.21.15.73:6807/4047810203","heartbeat_front_addr":"172.21.15.73:6805/4047810203","state":["exists","up"]},{"osd":1,"uuid":"c4a05052-96d4-4758-a4e1-1a37f1e07fed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":1356058331},{"type":"v1","addr":"172.21.15.73:6824","nonce":1356058331}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":1356058331},{"type":"v1","addr":"172.21.15.73:6827","nonce":1356058331}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":1356058331},{"type":"v1","addr":"172.21.15.73:6831","nonce":1356058331}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":1356058331},{"type":"v1","addr":"172.21.15.73:6829","nonce":1356058331}]},"public_addr":"172.21.15.73:6824/1356058331","cluster_addr":"172.21.15.73:6827/1356058331","heartbeat_back_addr":"172.21.15.73:6831/1356058331","heartbeat_front_addr":"172.21.15.73:6829/1356058331","state":["exists","up"]},{"osd":2,"uuid":"512bc8ac-72c2-40d4-b3d2-d867a92c5213","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":1228903316},{"type":"v1","addr":"172.21.15.73:6817","nonce":1228903316}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":1228903316},{"type":"v1","addr":"172.21.15.73:6819","nonce":1228903316}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6823","nonce":1228903316},{"type":"v1","addr":"172.21.15.73:6825","nonce":1228903316}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":1228903316},{"type":"v1","addr":"172.21.15.73:6821","nonce":1228903316}]},"public_addr":"172.21.15.73:6817/1228903316","cluster_addr":"172.21.15.73:6819/1228903316","heartbeat_back_addr":"172.21.15.73:6825/1228903316","heartbeat_front_addr":"172.21.15.73:6821/1228903316","state":["exists","up"]},{"osd":3,"uuid":"3d1a91e0-42bf-437a-8eae-8d357c8f63a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":1293329670},{"type":"v1","addr":"172.21.15.73:6809","nonce":1293329670}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6810","nonce":1293329670},{"type":"v1","addr":"172.21.15.73:6811","nonce":1293329670}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":1293329670},{"type":"v1","addr":"172.21.15.73:6815","nonce":1293329670}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":1293329670},{"type":"v1","addr":"172.21.15.73:6813","nonce":1293329670}]},"public_addr":"172.21.15.73:6809/1293329670","cluster_addr":"172.21.15.73:6811/1293329670","heartbeat_back_addr":"172.21.15.73:6815/1293329670","heartbeat_front_addr":"172.21.15.73:6813/1293329670","state":["exists","up"]},{"osd":4,"uuid":"4b302fff-834c-4069-ac19-00e46f6c87b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":3727975702},{"type":"v1","addr":"172.21.15.142:6801","nonce":3727975702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":3727975702},{"type":"v1","addr":"172.21.15.142:6803","nonce":3727975702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6809","nonce":3727975702},{"type":"v1","addr":"172.21.15.142:6811","nonce":3727975702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6805","nonce":3727975702},{"type":"v1","addr":"172.21.15.142:6807","nonce":3727975702}]},"public_addr":"172.21.15.142:6801/3727975702","cluster_addr":"172.21.15.142:6803/3727975702","heartbeat_back_addr":"172.21.15.142:6811/3727975702","heartbeat_front_addr":"172.21.15.142:6807/3727975702","state":["exists","up"]},{"osd":5,"uuid":"d7cdace2-67d0-45cc-95f2-515cf6ef1b82","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6817","nonce":2353193632},{"type":"v1","addr":"172.21.15.142:6819","nonce":2353193632}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6821","nonce":2353193632},{"type":"v1","addr":"172.21.15.142:6823","nonce":2353193632}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6829","nonce":2353193632},{"type":"v1","addr":"172.21.15.142:6831","nonce":2353193632}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6825","nonce":2353193632},{"type":"v1","addr":"172.21.15.142:6827","nonce":2353193632}]},"public_addr":"172.21.15.142:6819/2353193632","cluster_addr":"172.21.15.142:6823/2353193632","heartbeat_back_addr":"172.21.15.142:6831/2353193632","heartbeat_front_addr":"172.21.15.142:6827/2353193632","state":["exists","up"]},{"osd":6,"uuid":"649ce78a-5626-445c-aedc-a651ed05a6f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":2006111986},{"type":"v1","addr":"172.21.15.142:6806","nonce":2006111986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":2006111986},{"type":"v1","addr":"172.21.15.142:6810","nonce":2006111986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":2006111986},{"type":"v1","addr":"172.21.15.142:6815","nonce":2006111986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":2006111986},{"type":"v1","addr":"172.21.15.142:6813","nonce":2006111986}]},"public_addr":"172.21.15.142:6806/2006111986","cluster_addr":"172.21.15.142:6810/2006111986","heartbeat_back_addr":"172.21.15.142:6815/2006111986","heartbeat_front_addr":"172.21.15.142:6813/2006111986","state":["exists","up"]},{"osd":7,"uuid":"af15ae3b-c1d0-4acf-92db-8a1805494d13","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":2573794341},{"type":"v1","addr":"172.21.15.142:6818","nonce":2573794341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":2573794341},{"type":"v1","addr":"172.21.15.142:6822","nonce":2573794341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":2573794341},{"type":"v1","addr":"172.21.15.142:6830","nonce":2573794341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":2573794341},{"type":"v1","addr":"172.21.15.142:6826","nonce":2573794341}]},"public_addr":"172.21.15.142:6818/2573794341","cluster_addr":"172.21.15.142:6822/2573794341","heartbeat_back_addr":"172.21.15.142:6830/2573794341","heartbeat_front_addr":"172.21.15.142:6826/2573794341","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.185824+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.262103+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.225556+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:10.523459+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:10.706035+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.257339+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.301776+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.051960+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-12T09:44:04.058 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:04.056+0000 7f52cc389640 1 -- 172.21.15.73:0/4005452978 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f52a806ae70 msgr2=0x7f52a806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:04.058 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:04.056+0000 7f52cc389640 1 --2- 172.21.15.73:0/4005452978 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f52a806ae70 0x7f52a806d330 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f52c0009670 tx=0x7f52c0006bf0 comp rx=0 tx=0).stop 2023-12-12T09:44:04.058 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:04.056+0000 7f52cc389640 1 -- 172.21.15.73:0/4005452978 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f52c4071f00 msgr2=0x7f52c40a9a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:04.058 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:04.056+0000 7f52cc389640 1 --2- 172.21.15.73:0/4005452978 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f52c4071f00 0x7f52c40a9a80 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f52b400b3e0 tx=0x7f52b400b8a0 comp rx=0 tx=0).stop 2023-12-12T09:44:04.058 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:04.056+0000 7f52cc389640 1 -- 172.21.15.73:0/4005452978 shutdown_connections 2023-12-12T09:44:04.058 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:04.056+0000 7f52cc389640 1 --2- 172.21.15.73:0/4005452978 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f52a806ae70 0x7f52a806d330 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:04.058 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:04.056+0000 7f52cc389640 1 --2- 172.21.15.73:0/4005452978 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f52c40bfdc0 0x7f52c40baeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:04.058 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:04.056+0000 7f52cc389640 1 --2- 172.21.15.73:0/4005452978 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f52c4071f00 0x7f52c40a9a80 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:04.058 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:04.056+0000 7f52cc389640 1 --2- 172.21.15.73:0/4005452978 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f52c406a750 0x7f52c41efbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:04.058 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:04.056+0000 7f52cc389640 1 -- 172.21.15.73:0/4005452978 >> 172.21.15.73:0/4005452978 conn(0x7f52c40a8130 msgr2=0x7f52c40c5e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:44:04.058 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:04.056+0000 7f52cc389640 1 -- 172.21.15.73:0/4005452978 shutdown_connections 2023-12-12T09:44:04.059 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:04.056+0000 7f52cc389640 1 -- 172.21.15.73:0/4005452978 wait complete. 2023-12-12T09:44:04.076 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-12T09:43:15.525508+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-12T09:43:20.004546+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-12T09:43:20.736500+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-12T09:44:04.077 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-12T09:44:04.285 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:04.284+0000 7fc7aeeb4640 1 Processor -- start 2023-12-12T09:44:04.286 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:04.284+0000 7fc7aeeb4640 1 -- start start 2023-12-12T09:44:04.287 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:04.286+0000 7fc7aeeb4640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc7a8151c30 0x7fc7a806d440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:04.287 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:04.286+0000 7fc7aeeb4640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fc7a80bed50 0x7fc7a80bf1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:04.287 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:04.286+0000 7fc7aeeb4640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7a81582e0 con 0x7fc7a80c3930 2023-12-12T09:44:04.287 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:04.286+0000 7fc7aeeb4640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7a80a54d0 con 0x7fc7a80bed50 2023-12-12T09:44:04.287 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:04.286+0000 7fc7aeeb4640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7a80a4f50 con 0x7fc7a8151c30 2023-12-12T09:44:04.288 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:04.287+0000 7fc7ad451640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fc7a80bed50 0x7fc7a80bf1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:04.288 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:04.287+0000 7fc7acc50640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc7a8151c30 0x7fc7a806d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:04.288 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:04.287+0000 7fc7ad451640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fc7a80bed50 0x7fc7a80bf1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.73:52580/0 (socket says 172.21.15.73:52580) 2023-12-12T09:44:04.288 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:04.287+0000 7fc7ad451640 1 -- 172.21.15.73:0/1678437247 learned_addr learned my addr 172.21.15.73:0/1678437247 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:44:04.289 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:04.288+0000 7fc7ad451640 1 -- 172.21.15.73:0/1678437247 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc7a8151c30 msgr2=0x7fc7a806d440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:44:04.289 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:04.288+0000 7fc7ad451640 1 --2- 172.21.15.73:0/1678437247 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc7a8151c30 0x7fc7a806d440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:04.289 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:04.288+0000 7fc7ad451640 1 -- 172.21.15.73:0/1678437247 >> v1:172.21.15.142:6789/0 conn(0x7fc7a80c3930 legacy=0x7fc7a8157bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:04.289 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:04.288+0000 7fc7ad451640 1 -- 172.21.15.73:0/1678437247 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7a8155260 con 0x7fc7a80bed50 2023-12-12T09:44:04.290 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:04.289+0000 7fc7ad451640 1 --2- 172.21.15.73:0/1678437247 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc7a80bed50 0x7fc7a80bf1c0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fc7a0009e50 tx=0x7fc7a002bee0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=695d63663edda1ce server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:44:04.291 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:04.290+0000 7fc7a77fe640 1 -- 172.21.15.73:0/1678437247 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7a002ca80 con 0x7fc7a80bed50 2023-12-12T09:44:04.291 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:04.290+0000 7fc7a77fe640 1 -- 172.21.15.73:0/1678437247 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7a002cbe0 con 0x7fc7a80bed50 2023-12-12T09:44:04.291 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:04.290+0000 7fc7a77fe640 1 -- 172.21.15.73:0/1678437247 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7a00343f0 con 0x7fc7a80bed50 2023-12-12T09:44:04.291 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:04.290+0000 7fc7aeeb4640 1 -- 172.21.15.73:0/1678437247 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc7a80bed50 msgr2=0x7fc7a80bf1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:04.291 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:04.290+0000 7fc7aeeb4640 1 --2- 172.21.15.73:0/1678437247 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc7a80bed50 0x7fc7a80bf1c0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fc7a0009e50 tx=0x7fc7a002bee0 comp rx=0 tx=0).stop 2023-12-12T09:44:04.292 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:04.291+0000 7fc7aeeb4640 1 -- 172.21.15.73:0/1678437247 shutdown_connections 2023-12-12T09:44:04.292 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:04.291+0000 7fc7aeeb4640 1 --2- 172.21.15.73:0/1678437247 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc7a80bed50 0x7fc7a80bf1c0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:04.292 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:04.291+0000 7fc7aeeb4640 1 --2- 172.21.15.73:0/1678437247 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc7a8151c30 0x7fc7a806d440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:04.292 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:04.291+0000 7fc7aeeb4640 1 -- 172.21.15.73:0/1678437247 >> 172.21.15.73:0/1678437247 conn(0x7fc7a806a4e0 msgr2=0x7fc7a806a8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:44:04.292 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:04.291+0000 7fc7aeeb4640 1 -- 172.21.15.73:0/1678437247 shutdown_connections 2023-12-12T09:44:04.292 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:04.291+0000 7fc7aeeb4640 1 -- 172.21.15.73:0/1678437247 wait complete. 2023-12-12T09:44:04.293 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:04.293+0000 7fc7aeeb4640 1 Processor -- start 2023-12-12T09:44:04.294 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:04.293+0000 7fc7aeeb4640 1 -- start start 2023-12-12T09:44:04.296 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:04.294+0000 7fc7aeeb4640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc7a80bed50 0x7fc7a80725f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:04.296 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:04.294+0000 7fc7aeeb4640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc7a80c3930 0x7fc7a8155ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:04.296 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:04.294+0000 7fc7aeeb4640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc7a8151c30 0x7fc7a81e9f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:04.296 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:04.294+0000 7fc7aeeb4640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7a80c3370 con 0x7fc7a8151c30 2023-12-12T09:44:04.296 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:04.294+0000 7fc7aeeb4640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7a8072160 con 0x7fc7a80bed50 2023-12-12T09:44:04.296 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:04.294+0000 7fc7aeeb4640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7a8072b30 con 0x7fc7a80c3930 2023-12-12T09:44:04.296 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:04.294+0000 7fc7ad451640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc7a8151c30 0x7fc7a81e9f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:04.297 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:04.294+0000 7fc7ad451640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc7a8151c30 0x7fc7a81e9f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:36270/0 (socket says 172.21.15.73:36270) 2023-12-12T09:44:04.297 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:04.294+0000 7fc7ad451640 1 -- 172.21.15.73:0/1104541709 learned_addr learned my addr 172.21.15.73:0/1104541709 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:44:04.297 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:04.294+0000 7fc7acc50640 1 --2- 172.21.15.73:0/1104541709 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc7a80bed50 0x7fc7a80725f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:04.297 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:04.294+0000 7fc7a7fff640 1 --2- 172.21.15.73:0/1104541709 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc7a80c3930 0x7fc7a8155ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:04.297 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:04.294+0000 7fc7ad451640 1 -- 172.21.15.73:0/1104541709 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc7a80c3930 msgr2=0x7fc7a8155ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:04.297 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:04.294+0000 7fc7ad451640 1 --2- 172.21.15.73:0/1104541709 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc7a80c3930 0x7fc7a8155ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:04.297 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:04.294+0000 7fc7ad451640 1 -- 172.21.15.73:0/1104541709 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc7a80bed50 msgr2=0x7fc7a80725f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:04.297 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:04.294+0000 7fc7ad451640 1 --2- 172.21.15.73:0/1104541709 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc7a80bed50 0x7fc7a80725f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:04.297 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:04.294+0000 7fc7ad451640 1 -- 172.21.15.73:0/1104541709 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7a0009b30 con 0x7fc7a8151c30 2023-12-12T09:44:04.297 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:04.294+0000 7fc7a7fff640 1 --2- 172.21.15.73:0/1104541709 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc7a80c3930 0x7fc7a8155ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:44:04.297 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:04.294+0000 7fc7acc50640 1 --2- 172.21.15.73:0/1104541709 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc7a80bed50 0x7fc7a80725f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:44:04.297 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:04.295+0000 7fc7ad451640 1 --2- 172.21.15.73:0/1104541709 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc7a8151c30 0x7fc7a81e9f20 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fc7a0009e50 tx=0x7fc7a0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:44:04.297 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:04.295+0000 7fc7a57fa640 1 -- 172.21.15.73:0/1104541709 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7a003e450 con 0x7fc7a8151c30 2023-12-12T09:44:04.297 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:04.295+0000 7fc7a57fa640 1 -- 172.21.15.73:0/1104541709 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7a003e5b0 con 0x7fc7a8151c30 2023-12-12T09:44:04.298 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:04.295+0000 7fc7a57fa640 1 -- 172.21.15.73:0/1104541709 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7a003e960 con 0x7fc7a8151c30 2023-12-12T09:44:04.298 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:04.295+0000 7fc7aeeb4640 1 -- 172.21.15.73:0/1104541709 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7a8156a70 con 0x7fc7a8151c30 2023-12-12T09:44:04.298 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:04.295+0000 7fc7aeeb4640 1 -- 172.21.15.73:0/1104541709 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7a8157030 con 0x7fc7a8151c30 2023-12-12T09:44:04.298 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:04.296+0000 7fc7aeeb4640 1 -- 172.21.15.73:0/1104541709 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc7a8074890 con 0x7fc7a8151c30 2023-12-12T09:44:04.299 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:04.297+0000 7fc7a57fa640 1 -- 172.21.15.73:0/1104541709 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fc7a002cd50 con 0x7fc7a8151c30 2023-12-12T09:44:04.299 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:04.298+0000 7fc7a57fa640 1 --2- 172.21.15.73:0/1104541709 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fc78c06ae40 0x7fc78c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:04.299 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:04.298+0000 7fc7a57fa640 1 -- 172.21.15.73:0/1104541709 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc7a00abf20 con 0x7fc7a8151c30 2023-12-12T09:44:04.299 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:04.298+0000 7fc7acc50640 1 --2- 172.21.15.73:0/1104541709 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fc78c06ae40 0x7fc78c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:04.300 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:04.299+0000 7fc7acc50640 1 --2- 172.21.15.73:0/1104541709 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fc78c06ae40 0x7fc78c06d300 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fc7a8154fe0 tx=0x7fc79c008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:44:04.303 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:04.302+0000 7fc7a57fa640 1 -- 172.21.15.73:0/1104541709 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fc7a0077060 con 0x7fc7a8151c30 2023-12-12T09:44:04.496 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:04.495+0000 7fc7aeeb4640 1 -- 172.21.15.73:0/1104541709 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fc7a8067070 con 0x7fc7a8151c30 2023-12-12T09:44:04.497 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:04.496+0000 7fc7a57fa640 1 -- 172.21.15.73:0/1104541709 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7fc7a007a680 con 0x7fc7a8151c30 2023-12-12T09:44:04.497 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 1 2023-12-12T09:44:04.501 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:04.499+0000 7fc7aeeb4640 1 -- 172.21.15.73:0/1104541709 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fc78c06ae40 msgr2=0x7fc78c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:04.501 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:04.499+0000 7fc7aeeb4640 1 --2- 172.21.15.73:0/1104541709 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fc78c06ae40 0x7fc78c06d300 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fc7a8154fe0 tx=0x7fc79c008040 comp rx=0 tx=0).stop 2023-12-12T09:44:04.501 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:04.499+0000 7fc7aeeb4640 1 -- 172.21.15.73:0/1104541709 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc7a8151c30 msgr2=0x7fc7a81e9f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:04.501 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:04.499+0000 7fc7aeeb4640 1 --2- 172.21.15.73:0/1104541709 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc7a8151c30 0x7fc7a81e9f20 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fc7a0009e50 tx=0x7fc7a0004a40 comp rx=0 tx=0).stop 2023-12-12T09:44:04.501 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:04.500+0000 7fc7aeeb4640 1 -- 172.21.15.73:0/1104541709 shutdown_connections 2023-12-12T09:44:04.501 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:04.500+0000 7fc7aeeb4640 1 --2- 172.21.15.73:0/1104541709 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fc78c06ae40 0x7fc78c06d300 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:04.501 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:04.500+0000 7fc7aeeb4640 1 --2- 172.21.15.73:0/1104541709 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc7a8151c30 0x7fc7a81e9f20 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:04.502 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:04.500+0000 7fc7aeeb4640 1 --2- 172.21.15.73:0/1104541709 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc7a80c3930 0x7fc7a8155ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:04.502 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:04.500+0000 7fc7aeeb4640 1 --2- 172.21.15.73:0/1104541709 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc7a80bed50 0x7fc7a80725f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:04.502 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:04.500+0000 7fc7aeeb4640 1 -- 172.21.15.73:0/1104541709 >> 172.21.15.73:0/1104541709 conn(0x7fc7a806a4e0 msgr2=0x7fc7a806a8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:44:04.502 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:04.500+0000 7fc7aeeb4640 1 -- 172.21.15.73:0/1104541709 shutdown_connections 2023-12-12T09:44:04.502 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:04.500+0000 7fc7aeeb4640 1 -- 172.21.15.73:0/1104541709 wait complete. 2023-12-12T09:44:04.519 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-12T09:44:04.735 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:04.734+0000 7f946ffff640 1 Processor -- start 2023-12-12T09:44:04.735 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:04.734+0000 7f946ffff640 1 -- start start 2023-12-12T09:44:04.737 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:04.736+0000 7f946ffff640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f9470151a30 0x7f947006a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:04.737 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:04.736+0000 7f946ffff640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94701579f0 con 0x7f94700c70c0 2023-12-12T09:44:04.737 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:04.736+0000 7f946ffff640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9470158570 con 0x7f94700a5f50 2023-12-12T09:44:04.737 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:04.736+0000 7f946ffff640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94700c0e10 con 0x7f9470151a30 2023-12-12T09:44:04.737 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:04.736+0000 7f946f7fe640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f94700c70c0 0x7f947015ed80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:54588/0 (socket says 172.21.15.73:54588) 2023-12-12T09:44:04.737 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:04.736+0000 7f946f7fe640 1 -- 172.21.15.73:0/1318930059 learned_addr learned my addr 172.21.15.73:0/1318930059 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-12T09:44:04.739 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:04.737+0000 7f946effd640 1 --2- 172.21.15.73:0/1318930059 >> v2:172.21.15.142:3300/0 conn(0x7f9470151a30 0x7f947006a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:04.740 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:04.737+0000 7f946e7fc640 1 -- 172.21.15.73:0/1318930059 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1822869292 0 0) 0x7f94701579f0 con 0x7f94700c70c0 2023-12-12T09:44:04.740 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:04.737+0000 7f946e7fc640 1 -- 172.21.15.73:0/1318930059 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f945c003520 con 0x7f94700c70c0 2023-12-12T09:44:04.740 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:04.737+0000 7f946e7fc640 1 -- 172.21.15.73:0/1318930059 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 406783484 0 0) 0x7f945c003520 con 0x7f94700c70c0 2023-12-12T09:44:04.740 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:04.737+0000 7f946e7fc640 1 -- 172.21.15.73:0/1318930059 >> v2:172.21.15.142:3300/0 conn(0x7f9470151a30 msgr2=0x7f947006a4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:44:04.740 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:04.737+0000 7f946e7fc640 1 --2- 172.21.15.73:0/1318930059 >> v2:172.21.15.142:3300/0 conn(0x7f9470151a30 0x7f947006a4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:04.740 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:04.737+0000 7f946e7fc640 1 -- 172.21.15.73:0/1318930059 >> v1:172.21.15.142:6789/0 conn(0x7f94700a5f50 legacy=0x7f947006dc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:04.740 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:04.737+0000 7f946e7fc640 1 -- 172.21.15.73:0/1318930059 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9470157c40 con 0x7f94700c70c0 2023-12-12T09:44:04.740 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:04.737+0000 7f946e7fc640 1 -- 172.21.15.73:0/1318930059 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3186547832 0 0) 0x7f94680019f0 con 0x7f94700c70c0 2023-12-12T09:44:04.740 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:04.737+0000 7f946e7fc640 1 -- 172.21.15.73:0/1318930059 >> v1:172.21.15.73:6789/0 conn(0x7f94700c70c0 legacy=0x7f947015ed80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:04.740 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:04.737+0000 7f946e7fc640 1 --2- 172.21.15.73:0/1318930059 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f945c003970 0x7f945c003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:04.740 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:04.737+0000 7f946e7fc640 1 --2- 172.21.15.73:0/1318930059 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f945c0047c0 0x7f945c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:04.740 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:04.737+0000 7f946e7fc640 1 --2- 172.21.15.73:0/1318930059 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f945c0052a0 0x7f945c00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:04.740 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:04.737+0000 7f946e7fc640 1 -- 172.21.15.73:0/1318930059 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94700c0e10 con 0x7f945c003970 2023-12-12T09:44:04.741 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:04.737+0000 7f946e7fc640 1 -- 172.21.15.73:0/1318930059 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f945c00c170 con 0x7f945c0052a0 2023-12-12T09:44:04.741 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:04.737+0000 7f946e7fc640 1 -- 172.21.15.73:0/1318930059 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f945c00c330 con 0x7f945c0047c0 2023-12-12T09:44:04.741 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:04.738+0000 7f946effd640 1 --2- 172.21.15.73:0/1318930059 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f945c003970 0x7f945c003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:04.741 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:04.738+0000 7f946effd640 1 -- 172.21.15.73:0/1318930059 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f945c0047c0 msgr2=0x7f945c004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:44:04.741 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:04.738+0000 7f9467fff640 1 --2- 172.21.15.73:0/1318930059 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f945c0047c0 0x7f945c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:04.741 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:04.738+0000 7f946f7fe640 1 --2- 172.21.15.73:0/1318930059 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f945c0052a0 0x7f945c00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:04.741 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:04.738+0000 7f946effd640 1 --2- 172.21.15.73:0/1318930059 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f945c0047c0 0x7f945c004c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:04.741 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:04.738+0000 7f946effd640 1 -- 172.21.15.73:0/1318930059 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f945c0052a0 msgr2=0x7f945c00b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:44:04.741 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:04.738+0000 7f946effd640 1 --2- 172.21.15.73:0/1318930059 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f945c0052a0 0x7f945c00b980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:04.741 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:04.738+0000 7f946effd640 1 -- 172.21.15.73:0/1318930059 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f945c003520 con 0x7f945c003970 2023-12-12T09:44:04.741 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:04.738+0000 7f946f7fe640 1 -- 172.21.15.73:0/1318930059 reap_dead start 2023-12-12T09:44:04.742 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:04.739+0000 7f946effd640 1 --2- 172.21.15.73:0/1318930059 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f945c003970 0x7f945c003d90 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f9460009a90 tx=0x7f945c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ad84deb726665c3 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:44:04.742 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:04.739+0000 7f946e7fc640 1 -- 172.21.15.73:0/1318930059 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f946002c680 con 0x7f945c003970 2023-12-12T09:44:04.742 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:04.739+0000 7f946e7fc640 1 -- 172.21.15.73:0/1318930059 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f946002c7e0 con 0x7f945c003970 2023-12-12T09:44:04.742 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:04.739+0000 7f946e7fc640 1 -- 172.21.15.73:0/1318930059 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f946002cb70 con 0x7f945c003970 2023-12-12T09:44:04.743 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:04.740+0000 7f946ffff640 1 -- 172.21.15.73:0/1318930059 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f945c003970 msgr2=0x7f945c003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:04.743 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:04.740+0000 7f946ffff640 1 --2- 172.21.15.73:0/1318930059 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f945c003970 0x7f945c003d90 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f9460009a90 tx=0x7f945c0057f0 comp rx=0 tx=0).stop 2023-12-12T09:44:04.743 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:04.740+0000 7f946ffff640 1 -- 172.21.15.73:0/1318930059 shutdown_connections 2023-12-12T09:44:04.743 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:04.740+0000 7f946ffff640 1 --2- 172.21.15.73:0/1318930059 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f945c003970 0x7f945c003d90 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:04.743 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:04.740+0000 7f946ffff640 1 -- 172.21.15.73:0/1318930059 >> 172.21.15.73:0/1318930059 conn(0x7f947006d260 msgr2=0x7f94700a86e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:44:04.743 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:04.740+0000 7f946ffff640 1 -- 172.21.15.73:0/1318930059 shutdown_connections 2023-12-12T09:44:04.743 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:04.740+0000 7f946ffff640 1 -- 172.21.15.73:0/1318930059 wait complete. 2023-12-12T09:44:04.744 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:04.742+0000 7f946ffff640 1 Processor -- start 2023-12-12T09:44:04.744 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:04.742+0000 7f946ffff640 1 -- start start 2023-12-12T09:44:04.744 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:04.743+0000 7f946ffff640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f945c003970 0x7f94701ed150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:04.744 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:04.743+0000 7f946ffff640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9470157070 0x7f9470072020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:04.744 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:04.743+0000 7f946ffff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f947014d050 0x7f9470146d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:04.744 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:04.743+0000 7f946ffff640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f947014c870 con 0x7f947014d050 2023-12-12T09:44:04.744 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:04.743+0000 7f946ffff640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94701ed690 con 0x7f9470157070 2023-12-12T09:44:04.745 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:04.743+0000 7f946ffff640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94701562c0 con 0x7f945c003970 2023-12-12T09:44:04.745 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:04.743+0000 7f946f7fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f947014d050 0x7f9470146d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:04.745 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:04.743+0000 7f946f7fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f947014d050 0x7f9470146d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:36290/0 (socket says 172.21.15.73:36290) 2023-12-12T09:44:04.745 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:04.743+0000 7f946f7fe640 1 -- 172.21.15.73:0/1872070246 learned_addr learned my addr 172.21.15.73:0/1872070246 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:44:04.746 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:04.744+0000 7f946effd640 1 --2- 172.21.15.73:0/1872070246 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f945c003970 0x7f94701ed150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:04.746 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:04.744+0000 7f9467fff640 1 --2- 172.21.15.73:0/1872070246 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9470157070 0x7f9470072020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:04.746 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:04.744+0000 7f946f7fe640 1 -- 172.21.15.73:0/1872070246 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f945c003970 msgr2=0x7f94701ed150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:04.746 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:04.744+0000 7f946f7fe640 1 --2- 172.21.15.73:0/1872070246 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f945c003970 0x7f94701ed150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:04.746 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:04.744+0000 7f946f7fe640 1 -- 172.21.15.73:0/1872070246 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9470157070 msgr2=0x7f9470072020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:04.746 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:04.744+0000 7f946f7fe640 1 --2- 172.21.15.73:0/1872070246 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9470157070 0x7f9470072020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:04.747 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:04.744+0000 7f946f7fe640 1 -- 172.21.15.73:0/1872070246 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94701565a0 con 0x7f947014d050 2023-12-12T09:44:04.747 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:04.744+0000 7f946f7fe640 1 --2- 172.21.15.73:0/1872070246 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f947014d050 0x7f9470146d20 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f94700abfb0 tx=0x7f946800b4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:44:04.747 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:04.744+0000 7f946cff9640 1 -- 172.21.15.73:0/1872070246 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9468004d60 con 0x7f947014d050 2023-12-12T09:44:04.747 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:04.744+0000 7f946cff9640 1 -- 172.21.15.73:0/1872070246 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f946800bb80 con 0x7f947014d050 2023-12-12T09:44:04.747 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:04.744+0000 7f946cff9640 1 -- 172.21.15.73:0/1872070246 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9468007110 con 0x7f947014d050 2023-12-12T09:44:04.747 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:04.744+0000 7f946ffff640 1 -- 172.21.15.73:0/1872070246 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9470156880 con 0x7f947014d050 2023-12-12T09:44:04.747 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:04.744+0000 7f946ffff640 1 -- 172.21.15.73:0/1872070246 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f947014cb30 con 0x7f947014d050 2023-12-12T09:44:04.747 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:04.746+0000 7f946ffff640 1 -- 172.21.15.73:0/1872070246 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9470067b10 con 0x7f947014d050 2023-12-12T09:44:04.748 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:04.747+0000 7f946cff9640 1 -- 172.21.15.73:0/1872070246 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f9468007480 con 0x7f947014d050 2023-12-12T09:44:04.748 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:04.747+0000 7f946cff9640 1 --2- 172.21.15.73:0/1872070246 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f945006ae40 0x7f945006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:04.748 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:04.748+0000 7f946cff9640 1 -- 172.21.15.73:0/1872070246 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9468089a60 con 0x7f947014d050 2023-12-12T09:44:04.749 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:04.748+0000 7f946effd640 1 --2- 172.21.15.73:0/1872070246 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f945006ae40 0x7f945006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:04.749 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:04.748+0000 7f946effd640 1 --2- 172.21.15.73:0/1872070246 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f945006ae40 0x7f945006d300 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f9460036000 tx=0x7f9460030000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:44:04.753 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:04.752+0000 7f946cff9640 1 -- 172.21.15.73:0/1872070246 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f9468054ba0 con 0x7f947014d050 2023-12-12T09:44:04.942 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:04.941+0000 7f946ffff640 1 -- 172.21.15.73:0/1872070246 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f9470072560 con 0x7f947014d050 2023-12-12T09:44:04.943 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:04.942+0000 7f946cff9640 1 -- 172.21.15.73:0/1872070246 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7f94680581c0 con 0x7f947014d050 2023-12-12T09:44:04.943 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 32 2023-12-12T09:44:04.946 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:04.944+0000 7f946ffff640 1 -- 172.21.15.73:0/1872070246 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f945006ae40 msgr2=0x7f945006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:04.946 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:04.944+0000 7f946ffff640 1 --2- 172.21.15.73:0/1872070246 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f945006ae40 0x7f945006d300 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f9460036000 tx=0x7f9460030000 comp rx=0 tx=0).stop 2023-12-12T09:44:04.946 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:04.944+0000 7f946ffff640 1 -- 172.21.15.73:0/1872070246 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f947014d050 msgr2=0x7f9470146d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:04.946 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:04.944+0000 7f946ffff640 1 --2- 172.21.15.73:0/1872070246 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f947014d050 0x7f9470146d20 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f94700abfb0 tx=0x7f946800b4a0 comp rx=0 tx=0).stop 2023-12-12T09:44:04.946 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:04.945+0000 7f946ffff640 1 -- 172.21.15.73:0/1872070246 shutdown_connections 2023-12-12T09:44:04.946 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:04.945+0000 7f946ffff640 1 --2- 172.21.15.73:0/1872070246 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f945006ae40 0x7f945006d300 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:04.946 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:04.945+0000 7f946ffff640 1 --2- 172.21.15.73:0/1872070246 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f947014d050 0x7f9470146d20 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:04.947 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:04.945+0000 7f946ffff640 1 --2- 172.21.15.73:0/1872070246 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9470157070 0x7f9470072020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:04.947 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:04.945+0000 7f946ffff640 1 --2- 172.21.15.73:0/1872070246 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f945c003970 0x7f94701ed150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:04.947 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:04.945+0000 7f946ffff640 1 -- 172.21.15.73:0/1872070246 >> 172.21.15.73:0/1872070246 conn(0x7f947006d260 msgr2=0x7f9470150c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:44:04.947 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:04.945+0000 7f946ffff640 1 -- 172.21.15.73:0/1872070246 shutdown_connections 2023-12-12T09:44:04.947 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:04.945+0000 7f946ffff640 1 -- 172.21.15.73:0/1872070246 wait complete. 2023-12-12T09:44:04.964 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-12T09:44:05.172 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:05.171+0000 7f6cf58ec640 1 Processor -- start 2023-12-12T09:44:05.172 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:05.171+0000 7f6cf58ec640 1 -- start start 2023-12-12T09:44:05.174 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:05.172+0000 7f6cf58ec640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f6cf00c67c0 0x7f6cf00c7ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:05.174 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:05.172+0000 7f6cf58ec640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f6cf00c6ba0 0x7f6cf01550a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:05.174 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:05.172+0000 7f6cf58ec640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6cf006c180 0x7f6cf0157c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:05.174 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:05.172+0000 7f6cf58ec640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6cf01555e0 con 0x7f6cf00c6ba0 2023-12-12T09:44:05.174 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:05.172+0000 7f6cf58ec640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6cf00c7030 con 0x7f6cf00c67c0 2023-12-12T09:44:05.174 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:05.172+0000 7f6cf58ec640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6cf00c4af0 con 0x7f6cf006c180 2023-12-12T09:44:05.174 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:05.172+0000 7f6ce7fff640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f6cf00c6ba0 0x7f6cf01550a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:05.174 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:05.173+0000 7f6ce7fff640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f6cf00c6ba0 0x7f6cf01550a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:36296/0 (socket says 172.21.15.73:36296) 2023-12-12T09:44:05.175 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:05.173+0000 7f6ce7fff640 1 -- 172.21.15.73:0/2929845454 learned_addr learned my addr 172.21.15.73:0/2929845454 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:44:05.175 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:05.173+0000 7f6cef7fe640 1 --2- 172.21.15.73:0/2929845454 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6cf006c180 0x7f6cf0157c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:05.175 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:05.173+0000 7f6ceeffd640 1 --2- 172.21.15.73:0/2929845454 >> v2:172.21.15.142:3300/0 conn(0x7f6cf00c67c0 0x7f6cf00c7ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:05.175 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:05.173+0000 7f6ce7fff640 1 -- 172.21.15.73:0/2929845454 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6cf006c180 msgr2=0x7f6cf0157c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:44:05.175 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:05.173+0000 7f6ce7fff640 1 --2- 172.21.15.73:0/2929845454 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6cf006c180 0x7f6cf0157c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:05.175 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:05.173+0000 7f6ce7fff640 1 -- 172.21.15.73:0/2929845454 >> v2:172.21.15.142:3300/0 conn(0x7f6cf00c67c0 msgr2=0x7f6cf00c7ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:44:05.175 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:05.173+0000 7f6ce7fff640 1 --2- 172.21.15.73:0/2929845454 >> v2:172.21.15.142:3300/0 conn(0x7f6cf00c67c0 0x7f6cf00c7ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:05.175 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:05.173+0000 7f6ce7fff640 1 -- 172.21.15.73:0/2929845454 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6cf00c4dd0 con 0x7f6cf00c6ba0 2023-12-12T09:44:05.175 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:05.173+0000 7f6ceeffd640 1 --2- 172.21.15.73:0/2929845454 >> v2:172.21.15.142:3300/0 conn(0x7f6cf00c67c0 0x7f6cf00c7ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:44:05.176 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:05.174+0000 7f6ce7fff640 1 --2- 172.21.15.73:0/2929845454 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6cf00c6ba0 0x7f6cf01550a0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f6cf00c0e30 tx=0x7f6cd802b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97e48152d63d4257 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:44:05.176 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:05.174+0000 7f6cee7fc640 1 -- 172.21.15.73:0/2929845454 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cd8031870 con 0x7f6cf00c6ba0 2023-12-12T09:44:05.176 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:05.174+0000 7f6cee7fc640 1 -- 172.21.15.73:0/2929845454 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6cd80319d0 con 0x7f6cf00c6ba0 2023-12-12T09:44:05.176 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:05.174+0000 7f6cee7fc640 1 -- 172.21.15.73:0/2929845454 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cd8031d60 con 0x7f6cf00c6ba0 2023-12-12T09:44:05.176 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:05.175+0000 7f6cf58ec640 1 -- 172.21.15.73:0/2929845454 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6cf00c6ba0 msgr2=0x7f6cf01550a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:05.176 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:05.175+0000 7f6cf58ec640 1 --2- 172.21.15.73:0/2929845454 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6cf00c6ba0 0x7f6cf01550a0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f6cf00c0e30 tx=0x7f6cd802b910 comp rx=0 tx=0).stop 2023-12-12T09:44:05.176 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:05.175+0000 7f6cf58ec640 1 -- 172.21.15.73:0/2929845454 shutdown_connections 2023-12-12T09:44:05.177 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:05.175+0000 7f6cf58ec640 1 --2- 172.21.15.73:0/2929845454 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6cf006c180 0x7f6cf0157c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:05.177 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:05.175+0000 7f6cf58ec640 1 --2- 172.21.15.73:0/2929845454 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6cf00c6ba0 0x7f6cf01550a0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:05.177 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:05.175+0000 7f6cf58ec640 1 --2- 172.21.15.73:0/2929845454 >> v2:172.21.15.142:3300/0 conn(0x7f6cf00c67c0 0x7f6cf00c7ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:05.177 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:05.175+0000 7f6cf58ec640 1 -- 172.21.15.73:0/2929845454 >> 172.21.15.73:0/2929845454 conn(0x7f6cf00abb20 msgr2=0x7f6cf00abf30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:44:05.177 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:05.175+0000 7f6cf58ec640 1 -- 172.21.15.73:0/2929845454 shutdown_connections 2023-12-12T09:44:05.177 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:05.175+0000 7f6cf58ec640 1 -- 172.21.15.73:0/2929845454 wait complete. 2023-12-12T09:44:05.178 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:05.177+0000 7f6cf58ec640 1 Processor -- start 2023-12-12T09:44:05.178 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:05.177+0000 7f6cf58ec640 1 -- start start 2023-12-12T09:44:05.179 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:05.178+0000 7f6cf58ec640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6cf006c180 0x7f6cf01ed2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:05.179 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:05.178+0000 7f6cf58ec640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6cf00c67c0 0x7f6cf00c32c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:05.180 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:05.178+0000 7f6cf58ec640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6cf00c6ba0 0x7f6cf00af390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:05.180 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:05.178+0000 7f6cf58ec640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cf00ae580 con 0x7f6cf006c180 2023-12-12T09:44:05.180 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:05.178+0000 7f6cf58ec640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cf00bdce0 con 0x7f6cf00c67c0 2023-12-12T09:44:05.180 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:05.178+0000 7f6cf58ec640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6cf00bda00 con 0x7f6cf00c6ba0 2023-12-12T09:44:05.180 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:05.178+0000 7f6ceeffd640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6cf006c180 0x7f6cf01ed2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:05.180 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:05.178+0000 7f6ceeffd640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6cf006c180 0x7f6cf01ed2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:36298/0 (socket says 172.21.15.73:36298) 2023-12-12T09:44:05.180 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:05.178+0000 7f6ceeffd640 1 -- 172.21.15.73:0/1493081352 learned_addr learned my addr 172.21.15.73:0/1493081352 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:44:05.180 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:05.178+0000 7f6ceeffd640 1 -- 172.21.15.73:0/1493081352 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6cf00c6ba0 msgr2=0x7f6cf00af390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:05.180 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:05.178+0000 7f6ceeffd640 1 --2- 172.21.15.73:0/1493081352 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6cf00c6ba0 0x7f6cf00af390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:05.180 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:05.178+0000 7f6ceeffd640 1 -- 172.21.15.73:0/1493081352 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6cf00c67c0 msgr2=0x7f6cf00c32c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:05.181 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:05.178+0000 7f6ceeffd640 1 --2- 172.21.15.73:0/1493081352 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6cf00c67c0 0x7f6cf00c32c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:05.181 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:05.178+0000 7f6ceeffd640 1 -- 172.21.15.73:0/1493081352 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6cd80094d0 con 0x7f6cf006c180 2023-12-12T09:44:05.181 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:05.179+0000 7f6ceeffd640 1 --2- 172.21.15.73:0/1493081352 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6cf006c180 0x7f6cf01ed2b0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f6ce000c7f0 tx=0x7f6ce000cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:44:05.181 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:05.179+0000 7f6cecff9640 1 -- 172.21.15.73:0/1493081352 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ce0007a30 con 0x7f6cf006c180 2023-12-12T09:44:05.182 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:05.179+0000 7f6cecff9640 1 -- 172.21.15.73:0/1493081352 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ce0007b90 con 0x7f6cf006c180 2023-12-12T09:44:05.182 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:05.179+0000 7f6cf58ec640 1 -- 172.21.15.73:0/1493081352 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6cf00c0730 con 0x7f6cf006c180 2023-12-12T09:44:05.182 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:05.179+0000 7f6cecff9640 1 -- 172.21.15.73:0/1493081352 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ce000ce40 con 0x7f6cf006c180 2023-12-12T09:44:05.182 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:05.179+0000 7f6cf58ec640 1 -- 172.21.15.73:0/1493081352 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6cf00ae7d0 con 0x7f6cf006c180 2023-12-12T09:44:05.182 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:05.180+0000 7f6cf58ec640 1 -- 172.21.15.73:0/1493081352 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6cf00c5f80 con 0x7f6cf006c180 2023-12-12T09:44:05.182 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:05.181+0000 7f6cecff9640 1 -- 172.21.15.73:0/1493081352 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f6ce00113f0 con 0x7f6cf006c180 2023-12-12T09:44:05.183 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:05.182+0000 7f6cecff9640 1 --2- 172.21.15.73:0/1493081352 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f6cd006ae40 0x7f6cd006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:05.183 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:05.182+0000 7f6cecff9640 1 -- 172.21.15.73:0/1493081352 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6ce0089730 con 0x7f6cf006c180 2023-12-12T09:44:05.183 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:05.182+0000 7f6ce7fff640 1 --2- 172.21.15.73:0/1493081352 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f6cd006ae40 0x7f6cd006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:05.183 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:05.183+0000 7f6ce7fff640 1 --2- 172.21.15.73:0/1493081352 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f6cd006ae40 0x7f6cd006d300 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f6cd8036000 tx=0x7f6cd8030000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:44:05.187 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:05.186+0000 7f6cecff9640 1 -- 172.21.15.73:0/1493081352 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f6ce0054870 con 0x7f6cf006c180 2023-12-12T09:44:05.364 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:05.363+0000 7f6cf58ec640 1 -- 172.21.15.73:0/1493081352 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f6cf00ae9c0 con 0x7f6cf006c180 2023-12-12T09:44:05.365 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:05.364+0000 7f6cecff9640 1 -- 172.21.15.73:0/1493081352 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7f6ce001f020 con 0x7f6cf006c180 2023-12-12T09:44:05.365 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 64 2023-12-12T09:44:05.368 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:05.367+0000 7f6cf58ec640 1 -- 172.21.15.73:0/1493081352 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f6cd006ae40 msgr2=0x7f6cd006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:05.368 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:05.367+0000 7f6cf58ec640 1 --2- 172.21.15.73:0/1493081352 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f6cd006ae40 0x7f6cd006d300 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f6cd8036000 tx=0x7f6cd8030000 comp rx=0 tx=0).stop 2023-12-12T09:44:05.368 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:05.367+0000 7f6cf58ec640 1 -- 172.21.15.73:0/1493081352 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6cf006c180 msgr2=0x7f6cf01ed2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:05.369 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:05.367+0000 7f6cf58ec640 1 --2- 172.21.15.73:0/1493081352 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6cf006c180 0x7f6cf01ed2b0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f6ce000c7f0 tx=0x7f6ce000cbf0 comp rx=0 tx=0).stop 2023-12-12T09:44:05.369 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:05.367+0000 7f6cf58ec640 1 -- 172.21.15.73:0/1493081352 shutdown_connections 2023-12-12T09:44:05.369 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:05.367+0000 7f6cf58ec640 1 --2- 172.21.15.73:0/1493081352 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f6cd006ae40 0x7f6cd006d300 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:05.369 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:05.367+0000 7f6cf58ec640 1 --2- 172.21.15.73:0/1493081352 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6cf00c6ba0 0x7f6cf00af390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:05.369 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:05.367+0000 7f6cf58ec640 1 --2- 172.21.15.73:0/1493081352 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6cf00c67c0 0x7f6cf00c32c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:05.369 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:05.367+0000 7f6cf58ec640 1 --2- 172.21.15.73:0/1493081352 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6cf006c180 0x7f6cf01ed2b0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:05.369 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:05.367+0000 7f6cf58ec640 1 -- 172.21.15.73:0/1493081352 >> 172.21.15.73:0/1493081352 conn(0x7f6cf00abb20 msgr2=0x7f6cf014a610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:44:05.369 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:05.367+0000 7f6cf58ec640 1 -- 172.21.15.73:0/1493081352 shutdown_connections 2023-12-12T09:44:05.369 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:05.367+0000 7f6cf58ec640 1 -- 172.21.15.73:0/1493081352 wait complete. 2023-12-12T09:44:05.386 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-12T09:44:05.584 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:05.583+0000 7f0847189640 1 Processor -- start 2023-12-12T09:44:05.584 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:05.583+0000 7f0847189640 1 -- start start 2023-12-12T09:44:05.586 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:05.584+0000 7f0847189640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f084014fa40 0x7f084006a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:05.586 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:05.585+0000 7f0847189640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f08400c5070 0x7f08400c40c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:05.586 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:05.585+0000 7f0847189640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0840152610 con 0x7f084006db70 2023-12-12T09:44:05.586 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:05.585+0000 7f0847189640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08401528f0 con 0x7f08400c5070 2023-12-12T09:44:05.586 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:05.585+0000 7f0847189640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0840152bd0 con 0x7f084014fa40 2023-12-12T09:44:05.587 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:05.585+0000 7f0845726640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f08400c5070 0x7f08400c40c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:05.587 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:05.585+0000 7f0844f25640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f084014fa40 0x7f084006a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:05.587 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:05.585+0000 7f0845726640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f08400c5070 0x7f08400c40c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.73:52624/0 (socket says 172.21.15.73:52624) 2023-12-12T09:44:05.587 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:05.585+0000 7f0845726640 1 -- 172.21.15.73:0/2689683471 learned_addr learned my addr 172.21.15.73:0/2689683471 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:44:05.587 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:05.586+0000 7f0845726640 1 -- 172.21.15.73:0/2689683471 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f084014fa40 msgr2=0x7f084006a4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:44:05.587 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:05.586+0000 7f0845726640 1 --2- 172.21.15.73:0/2689683471 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f084014fa40 0x7f084006a4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:05.587 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:05.586+0000 7f0845726640 1 -- 172.21.15.73:0/2689683471 >> v1:172.21.15.142:6789/0 conn(0x7f084006db70 legacy=0x7f08400c39b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:05.588 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:05.586+0000 7f0845726640 1 -- 172.21.15.73:0/2689683471 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0840152eb0 con 0x7f08400c5070 2023-12-12T09:44:05.589 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:05.588+0000 7f0845726640 1 --2- 172.21.15.73:0/2689683471 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f08400c5070 0x7f08400c40c0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f0838009e50 tx=0x7f083802bf60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=56cd74ebba39efdb server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:44:05.590 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:05.588+0000 7f083f7fe640 1 -- 172.21.15.73:0/2689683471 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f083802cb00 con 0x7f08400c5070 2023-12-12T09:44:05.590 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:05.589+0000 7f083f7fe640 1 -- 172.21.15.73:0/2689683471 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f083802cc60 con 0x7f08400c5070 2023-12-12T09:44:05.590 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:05.589+0000 7f083f7fe640 1 -- 172.21.15.73:0/2689683471 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08380343f0 con 0x7f08400c5070 2023-12-12T09:44:05.590 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:05.589+0000 7f0847189640 1 -- 172.21.15.73:0/2689683471 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f08400c5070 msgr2=0x7f08400c40c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:05.591 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:05.589+0000 7f0847189640 1 --2- 172.21.15.73:0/2689683471 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f08400c5070 0x7f08400c40c0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f0838009e50 tx=0x7f083802bf60 comp rx=0 tx=0).stop 2023-12-12T09:44:05.591 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:05.589+0000 7f0847189640 1 -- 172.21.15.73:0/2689683471 shutdown_connections 2023-12-12T09:44:05.591 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:05.589+0000 7f0847189640 1 --2- 172.21.15.73:0/2689683471 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f08400c5070 0x7f08400c40c0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:05.591 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:05.589+0000 7f0847189640 1 --2- 172.21.15.73:0/2689683471 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f084014fa40 0x7f084006a4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:05.591 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:05.589+0000 7f0847189640 1 -- 172.21.15.73:0/2689683471 >> 172.21.15.73:0/2689683471 conn(0x7f08400a8130 msgr2=0x7f08400c24b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:44:05.591 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:05.589+0000 7f0847189640 1 -- 172.21.15.73:0/2689683471 shutdown_connections 2023-12-12T09:44:05.591 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:05.589+0000 7f0847189640 1 -- 172.21.15.73:0/2689683471 wait complete. 2023-12-12T09:44:05.592 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:05.591+0000 7f0847189640 1 Processor -- start 2023-12-12T09:44:05.592 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:05.591+0000 7f0847189640 1 -- start start 2023-12-12T09:44:05.594 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:05.592+0000 7f0847189640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f084006db70 0x7f08400bf050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:05.594 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:05.592+0000 7f0847189640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f08400c5070 0x7f08401de7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:05.594 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:05.592+0000 7f0847189640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f084014fa40 0x7f08401dece0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:05.594 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:05.592+0000 7f0847189640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08401e9870 con 0x7f084014fa40 2023-12-12T09:44:05.594 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:05.592+0000 7f0847189640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08400a8b60 con 0x7f084006db70 2023-12-12T09:44:05.594 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:05.592+0000 7f0847189640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08401e9a80 con 0x7f08400c5070 2023-12-12T09:44:05.595 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:05.592+0000 7f0845726640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f084014fa40 0x7f08401dece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:05.595 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:05.592+0000 7f0845726640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f084014fa40 0x7f08401dece0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:36302/0 (socket says 172.21.15.73:36302) 2023-12-12T09:44:05.595 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:05.592+0000 7f0845726640 1 -- 172.21.15.73:0/3497120663 learned_addr learned my addr 172.21.15.73:0/3497120663 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:44:05.595 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:05.593+0000 7f083ffff640 1 --2- 172.21.15.73:0/3497120663 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f08400c5070 0x7f08401de7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:05.595 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:05.593+0000 7f0844f25640 1 --2- 172.21.15.73:0/3497120663 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f084006db70 0x7f08400bf050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:05.595 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:05.593+0000 7f0845726640 1 -- 172.21.15.73:0/3497120663 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f08400c5070 msgr2=0x7f08401de7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:05.595 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:05.593+0000 7f0845726640 1 --2- 172.21.15.73:0/3497120663 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f08400c5070 0x7f08401de7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:05.595 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:05.593+0000 7f0845726640 1 -- 172.21.15.73:0/3497120663 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f084006db70 msgr2=0x7f08400bf050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:05.595 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:05.593+0000 7f0845726640 1 --2- 172.21.15.73:0/3497120663 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f084006db70 0x7f08400bf050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:05.595 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:05.593+0000 7f0845726640 1 -- 172.21.15.73:0/3497120663 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0838009b30 con 0x7f084014fa40 2023-12-12T09:44:05.595 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:05.593+0000 7f0845726640 1 --2- 172.21.15.73:0/3497120663 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f084014fa40 0x7f08401dece0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f0838009e50 tx=0x7f0838004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:44:05.596 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:05.594+0000 7f083d7fa640 1 -- 172.21.15.73:0/3497120663 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0838009510 con 0x7f084014fa40 2023-12-12T09:44:05.596 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:05.594+0000 7f083d7fa640 1 -- 172.21.15.73:0/3497120663 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f083803e450 con 0x7f084014fa40 2023-12-12T09:44:05.596 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:05.594+0000 7f083d7fa640 1 -- 172.21.15.73:0/3497120663 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f083803e800 con 0x7f084014fa40 2023-12-12T09:44:05.596 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:05.594+0000 7f0847189640 1 -- 172.21.15.73:0/3497120663 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08400a8d70 con 0x7f084014fa40 2023-12-12T09:44:05.596 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:05.594+0000 7f0847189640 1 -- 172.21.15.73:0/3497120663 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08400a9330 con 0x7f084014fa40 2023-12-12T09:44:05.596 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:05.595+0000 7f0847189640 1 -- 172.21.15.73:0/3497120663 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f08400a9520 con 0x7f084014fa40 2023-12-12T09:44:05.597 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:05.596+0000 7f083d7fa640 1 -- 172.21.15.73:0/3497120663 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f083803e960 con 0x7f084014fa40 2023-12-12T09:44:05.598 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:05.597+0000 7f083d7fa640 1 --2- 172.21.15.73:0/3497120663 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f082406ae70 0x7f082406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:05.598 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:05.597+0000 7f083d7fa640 1 -- 172.21.15.73:0/3497120663 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f08380ac3b0 con 0x7f084014fa40 2023-12-12T09:44:05.598 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:05.597+0000 7f0844f25640 1 --2- 172.21.15.73:0/3497120663 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f082406ae70 0x7f082406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:05.598 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:05.598+0000 7f0844f25640 1 --2- 172.21.15.73:0/3497120663 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f082406ae70 0x7f082406d330 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f08401df3d0 tx=0x7f0834008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:44:05.602 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:05.601+0000 7f083d7fa640 1 -- 172.21.15.73:0/3497120663 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f08380773c0 con 0x7f084014fa40 2023-12-12T09:44:05.828 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:05.827+0000 7f0847189640 1 -- 172.21.15.73:0/3497120663 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0840067580 con 0x7f084014fa40 2023-12-12T09:44:05.829 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:05.828+0000 7f083d7fa640 1 -- 172.21.15.73:0/3497120663 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4913 (secure 0 0 0) 0x7f083807a9e0 con 0x7f084014fa40 2023-12-12T09:44:05.829 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-12T09:44:05.830 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4257,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6835/1079394562","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":1079394562},{"type":"v1","addr":"172.21.15.73:6835","nonce":1079394562}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4258,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6835/3726638062","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6833","nonce":3726638062},{"type":"v1","addr":"172.21.15.142:6835","nonce":3726638062}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4260,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6837/2513898821","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6836","nonce":2513898821},{"type":"v1","addr":"172.21.15.73:6837","nonce":2513898821}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-12T09:43:21.720752+0000","modified":"2023-12-12T09:43:24.801495+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4269},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4269":{"gid":4269,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.142:6834/1773392257","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6832","nonce":1773392257},{"type":"v1","addr":"172.21.15.142:6834","nonce":1773392257}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-12-12T09:44:05.830 INFO:teuthology.orchestra.run.smithi073.stderr:dumped fsmap epoch 8 2023-12-12T09:44:05.832 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:05.831+0000 7f0847189640 1 -- 172.21.15.73:0/3497120663 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f082406ae70 msgr2=0x7f082406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:05.832 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:05.831+0000 7f0847189640 1 --2- 172.21.15.73:0/3497120663 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f082406ae70 0x7f082406d330 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f08401df3d0 tx=0x7f0834008040 comp rx=0 tx=0).stop 2023-12-12T09:44:05.832 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:05.831+0000 7f0847189640 1 -- 172.21.15.73:0/3497120663 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f084014fa40 msgr2=0x7f08401dece0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:05.832 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:05.831+0000 7f0847189640 1 --2- 172.21.15.73:0/3497120663 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f084014fa40 0x7f08401dece0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f0838009e50 tx=0x7f0838004a40 comp rx=0 tx=0).stop 2023-12-12T09:44:05.832 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:05.831+0000 7f0847189640 1 -- 172.21.15.73:0/3497120663 shutdown_connections 2023-12-12T09:44:05.833 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:05.831+0000 7f0847189640 1 --2- 172.21.15.73:0/3497120663 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f082406ae70 0x7f082406d330 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:05.833 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:05.831+0000 7f0847189640 1 --2- 172.21.15.73:0/3497120663 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f084014fa40 0x7f08401dece0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:05.833 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:05.831+0000 7f0847189640 1 --2- 172.21.15.73:0/3497120663 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f08400c5070 0x7f08401de7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:05.833 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:05.831+0000 7f0847189640 1 --2- 172.21.15.73:0/3497120663 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f084006db70 0x7f08400bf050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:05.833 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:05.831+0000 7f0847189640 1 -- 172.21.15.73:0/3497120663 >> 172.21.15.73:0/3497120663 conn(0x7f08400a8130 msgr2=0x7f08400c0890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:44:05.833 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:05.831+0000 7f0847189640 1 -- 172.21.15.73:0/3497120663 shutdown_connections 2023-12-12T09:44:05.833 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:05.831+0000 7f0847189640 1 -- 172.21.15.73:0/3497120663 wait complete. 2023-12-12T09:44:05.852 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-12T09:44:06.067 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:06.066+0000 7f866c41e640 1 Processor -- start 2023-12-12T09:44:06.068 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:06.067+0000 7f866c41e640 1 -- start start 2023-12-12T09:44:06.069 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:06.068+0000 7f866c41e640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f86640a50f0 0x7f86640a9050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:06.069 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:06.068+0000 7f866c41e640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f866406bf20 0x7f86640a9590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:06.069 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:06.068+0000 7f866c41e640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86640c0b50 con 0x7f86641552e0 2023-12-12T09:44:06.070 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:06.068+0000 7f866c41e640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86640c04d0 con 0x7f866406bf20 2023-12-12T09:44:06.070 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:06.068+0000 7f866c41e640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f866406c880 con 0x7f86640a50f0 2023-12-12T09:44:06.070 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:06.068+0000 7f866a1ba640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f86641552e0 0x7f86640c49c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:54598/0 (socket says 172.21.15.73:54598) 2023-12-12T09:44:06.070 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:06.068+0000 7f866a1ba640 1 -- 172.21.15.73:0/4252259027 learned_addr learned my addr 172.21.15.73:0/4252259027 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-12T09:44:06.070 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:06.068+0000 7f866a9bb640 1 --2- 172.21.15.73:0/4252259027 >> v2:172.21.15.73:3300/0 conn(0x7f866406bf20 0x7f86640a9590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:06.070 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:06.069+0000 7f86699b9640 1 --2- 172.21.15.73:0/4252259027 >> v2:172.21.15.142:3300/0 conn(0x7f86640a50f0 0x7f86640a9050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:06.070 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:06.069+0000 7f866a9bb640 1 -- 172.21.15.73:0/4252259027 >> v2:172.21.15.142:3300/0 conn(0x7f86640a50f0 msgr2=0x7f86640a9050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:44:06.070 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:06.069+0000 7f866a9bb640 1 --2- 172.21.15.73:0/4252259027 >> v2:172.21.15.142:3300/0 conn(0x7f86640a50f0 0x7f86640a9050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:06.071 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:06.069+0000 7f866a9bb640 1 -- 172.21.15.73:0/4252259027 >> v1:172.21.15.73:6789/0 conn(0x7f86641552e0 legacy=0x7f86640c49c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:06.071 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:06.069+0000 7f866a9bb640 1 -- 172.21.15.73:0/4252259027 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f866406cb60 con 0x7f866406bf20 2023-12-12T09:44:06.071 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:06.070+0000 7f866a9bb640 1 --2- 172.21.15.73:0/4252259027 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f866406bf20 0x7f86640a9590 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f8664072230 tx=0x7f865c02e040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d22e22c2dd233d73 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:44:06.071 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:06.070+0000 7f86691b8640 1 -- 172.21.15.73:0/4252259027 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f865c02edf0 con 0x7f866406bf20 2023-12-12T09:44:06.071 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:06.070+0000 7f86691b8640 1 -- 172.21.15.73:0/4252259027 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f865c036440 con 0x7f866406bf20 2023-12-12T09:44:06.071 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:06.070+0000 7f86691b8640 1 -- 172.21.15.73:0/4252259027 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f865c0367d0 con 0x7f866406bf20 2023-12-12T09:44:06.072 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:06.071+0000 7f866c41e640 1 -- 172.21.15.73:0/4252259027 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f866406bf20 msgr2=0x7f86640a9590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:06.072 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:06.071+0000 7f866c41e640 1 --2- 172.21.15.73:0/4252259027 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f866406bf20 0x7f86640a9590 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f8664072230 tx=0x7f865c02e040 comp rx=0 tx=0).stop 2023-12-12T09:44:06.072 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:06.071+0000 7f866c41e640 1 -- 172.21.15.73:0/4252259027 shutdown_connections 2023-12-12T09:44:06.072 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:06.071+0000 7f866c41e640 1 --2- 172.21.15.73:0/4252259027 >> v2:172.21.15.142:3300/0 conn(0x7f86640a50f0 0x7f86640a9050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:06.073 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:06.071+0000 7f866c41e640 1 --2- 172.21.15.73:0/4252259027 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f866406bf20 0x7f86640a9590 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:06.073 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:06.071+0000 7f866c41e640 1 -- 172.21.15.73:0/4252259027 >> 172.21.15.73:0/4252259027 conn(0x7f86640a8130 msgr2=0x7f86640c24b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:44:06.073 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:06.071+0000 7f866c41e640 1 -- 172.21.15.73:0/4252259027 shutdown_connections 2023-12-12T09:44:06.073 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:06.071+0000 7f866c41e640 1 -- 172.21.15.73:0/4252259027 wait complete. 2023-12-12T09:44:06.074 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:06.073+0000 7f866c41e640 1 Processor -- start 2023-12-12T09:44:06.074 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:06.073+0000 7f866c41e640 1 -- start start 2023-12-12T09:44:06.076 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:06.074+0000 7f866c41e640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f866406bf20 0x7f86640be630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:06.076 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:06.074+0000 7f866c41e640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f86640a50f0 0x7f86640a97b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:06.076 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:06.074+0000 7f866c41e640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f86641552e0 0x7f86641e5ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:06.077 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:06.074+0000 7f866c41e640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86641dd7a0 con 0x7f86640a50f0 2023-12-12T09:44:06.077 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:06.074+0000 7f866c41e640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86640bf490 con 0x7f866406bf20 2023-12-12T09:44:06.077 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:06.074+0000 7f866c41e640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8664071450 con 0x7f86641552e0 2023-12-12T09:44:06.077 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:06.074+0000 7f86699b9640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f86640a50f0 0x7f86640a97b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:06.077 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:06.074+0000 7f86699b9640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f86640a50f0 0x7f86640a97b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:36328/0 (socket says 172.21.15.73:36328) 2023-12-12T09:44:06.077 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:06.074+0000 7f86699b9640 1 -- 172.21.15.73:0/3906259146 learned_addr learned my addr 172.21.15.73:0/3906259146 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:44:06.077 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:06.075+0000 7f866a1ba640 1 --2- 172.21.15.73:0/3906259146 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f866406bf20 0x7f86640be630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:06.077 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:06.075+0000 7f866a9bb640 1 --2- 172.21.15.73:0/3906259146 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f86641552e0 0x7f86641e5ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:06.077 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:06.075+0000 7f86699b9640 1 -- 172.21.15.73:0/3906259146 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f86641552e0 msgr2=0x7f86641e5ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:06.077 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:06.075+0000 7f86699b9640 1 --2- 172.21.15.73:0/3906259146 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f86641552e0 0x7f86641e5ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:06.077 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:06.075+0000 7f86699b9640 1 -- 172.21.15.73:0/3906259146 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f866406bf20 msgr2=0x7f86640be630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:06.077 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:06.075+0000 7f86699b9640 1 --2- 172.21.15.73:0/3906259146 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f866406bf20 0x7f86640be630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:06.077 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:06.075+0000 7f86699b9640 1 -- 172.21.15.73:0/3906259146 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f865c009a70 con 0x7f86640a50f0 2023-12-12T09:44:06.077 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:06.075+0000 7f866a1ba640 1 --2- 172.21.15.73:0/3906259146 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f866406bf20 0x7f86640be630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:44:06.078 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:06.075+0000 7f86699b9640 1 --2- 172.21.15.73:0/3906259146 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f86640a50f0 0x7f86640a97b0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f865400d7d0 tx=0x7f865400dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:44:06.078 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:06.075+0000 7f865affd640 1 -- 172.21.15.73:0/3906259146 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f865400b6c0 con 0x7f86640a50f0 2023-12-12T09:44:06.078 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:06.075+0000 7f865affd640 1 -- 172.21.15.73:0/3906259146 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f865400b820 con 0x7f86640a50f0 2023-12-12T09:44:06.078 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:06.075+0000 7f865affd640 1 -- 172.21.15.73:0/3906259146 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f865400bbb0 con 0x7f86640a50f0 2023-12-12T09:44:06.078 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:06.075+0000 7f866c41e640 1 -- 172.21.15.73:0/3906259146 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8664071190 con 0x7f86640a50f0 2023-12-12T09:44:06.078 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:06.075+0000 7f866c41e640 1 -- 172.21.15.73:0/3906259146 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86640bf120 con 0x7f86640a50f0 2023-12-12T09:44:06.078 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:06.076+0000 7f866c41e640 1 -- 172.21.15.73:0/3906259146 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8664067580 con 0x7f86640a50f0 2023-12-12T09:44:06.078 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:06.077+0000 7f865affd640 1 -- 172.21.15.73:0/3906259146 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f865400bd10 con 0x7f86640a50f0 2023-12-12T09:44:06.079 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:06.078+0000 7f865affd640 1 --2- 172.21.15.73:0/3906259146 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f864806ae40 0x7f864806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:06.079 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:06.078+0000 7f865affd640 1 -- 172.21.15.73:0/3906259146 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8654089bc0 con 0x7f86640a50f0 2023-12-12T09:44:06.079 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:06.079+0000 7f866a1ba640 1 --2- 172.21.15.73:0/3906259146 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f864806ae40 0x7f864806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:06.080 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:06.079+0000 7f866a1ba640 1 --2- 172.21.15.73:0/3906259146 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f864806ae40 0x7f864806d300 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f8660005880 tx=0x7f8660009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:44:06.084 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:06.083+0000 7f865affd640 1 -- 172.21.15.73:0/3906259146 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f8654054c60 con 0x7f86640a50f0 2023-12-12T09:44:06.275 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:06.274+0000 7f866c41e640 1 -- 172.21.15.73:0/3906259146 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f86640c68e0 con 0x7f86640a50f0 2023-12-12T09:44:06.278 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:06.276+0000 7f865affd640 1 -- 172.21.15.73:0/3906259146 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16517 (secure 0 0 0) 0x7f8654058280 con 0x7f86640a50f0 2023-12-12T09:44:06.278 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-12T09:44:06.278 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":21,"fsid":"ba240992-02b8-4c7e-92f2-27eb29ac433b","created":"2023-12-12T09:43:02.454719+0000","modified":"2023-12-12T09:43:23.219345+0000","last_up_change":"2023-12-12T09:43:13.913440+0000","last_in_change":"2023-12-12T09:43:05.925348+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-12T09:43:15.525508+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-12T09:43:20.004546+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-12T09:43:20.736500+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"dd9074be-dbe2-4c34-9896-a4223d8d3940","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":4047810203},{"type":"v1","addr":"172.21.15.73:6801","nonce":4047810203}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":4047810203},{"type":"v1","addr":"172.21.15.73:6803","nonce":4047810203}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":4047810203},{"type":"v1","addr":"172.21.15.73:6807","nonce":4047810203}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":4047810203},{"type":"v1","addr":"172.21.15.73:6805","nonce":4047810203}]},"public_addr":"172.21.15.73:6801/4047810203","cluster_addr":"172.21.15.73:6803/4047810203","heartbeat_back_addr":"172.21.15.73:6807/4047810203","heartbeat_front_addr":"172.21.15.73:6805/4047810203","state":["exists","up"]},{"osd":1,"uuid":"c4a05052-96d4-4758-a4e1-1a37f1e07fed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":1356058331},{"type":"v1","addr":"172.21.15.73:6824","nonce":1356058331}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":1356058331},{"type":"v1","addr":"172.21.15.73:6827","nonce":1356058331}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":1356058331},{"type":"v1","addr":"172.21.15.73:6831","nonce":1356058331}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":1356058331},{"type":"v1","addr":"172.21.15.73:6829","nonce":1356058331}]},"public_addr":"172.21.15.73:6824/1356058331","cluster_addr":"172.21.15.73:6827/1356058331","heartbeat_back_addr":"172.21.15.73:6831/1356058331","heartbeat_front_addr":"172.21.15.73:6829/1356058331","state":["exists","up"]},{"osd":2,"uuid":"512bc8ac-72c2-40d4-b3d2-d867a92c5213","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":1228903316},{"type":"v1","addr":"172.21.15.73:6817","nonce":1228903316}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":1228903316},{"type":"v1","addr":"172.21.15.73:6819","nonce":1228903316}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6823","nonce":1228903316},{"type":"v1","addr":"172.21.15.73:6825","nonce":1228903316}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":1228903316},{"type":"v1","addr":"172.21.15.73:6821","nonce":1228903316}]},"public_addr":"172.21.15.73:6817/1228903316","cluster_addr":"172.21.15.73:6819/1228903316","heartbeat_back_addr":"172.21.15.73:6825/1228903316","heartbeat_front_addr":"172.21.15.73:6821/1228903316","state":["exists","up"]},{"osd":3,"uuid":"3d1a91e0-42bf-437a-8eae-8d357c8f63a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":1293329670},{"type":"v1","addr":"172.21.15.73:6809","nonce":1293329670}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6810","nonce":1293329670},{"type":"v1","addr":"172.21.15.73:6811","nonce":1293329670}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":1293329670},{"type":"v1","addr":"172.21.15.73:6815","nonce":1293329670}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":1293329670},{"type":"v1","addr":"172.21.15.73:6813","nonce":1293329670}]},"public_addr":"172.21.15.73:6809/1293329670","cluster_addr":"172.21.15.73:6811/1293329670","heartbeat_back_addr":"172.21.15.73:6815/1293329670","heartbeat_front_addr":"172.21.15.73:6813/1293329670","state":["exists","up"]},{"osd":4,"uuid":"4b302fff-834c-4069-ac19-00e46f6c87b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":3727975702},{"type":"v1","addr":"172.21.15.142:6801","nonce":3727975702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":3727975702},{"type":"v1","addr":"172.21.15.142:6803","nonce":3727975702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6809","nonce":3727975702},{"type":"v1","addr":"172.21.15.142:6811","nonce":3727975702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6805","nonce":3727975702},{"type":"v1","addr":"172.21.15.142:6807","nonce":3727975702}]},"public_addr":"172.21.15.142:6801/3727975702","cluster_addr":"172.21.15.142:6803/3727975702","heartbeat_back_addr":"172.21.15.142:6811/3727975702","heartbeat_front_addr":"172.21.15.142:6807/3727975702","state":["exists","up"]},{"osd":5,"uuid":"d7cdace2-67d0-45cc-95f2-515cf6ef1b82","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6817","nonce":2353193632},{"type":"v1","addr":"172.21.15.142:6819","nonce":2353193632}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6821","nonce":2353193632},{"type":"v1","addr":"172.21.15.142:6823","nonce":2353193632}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6829","nonce":2353193632},{"type":"v1","addr":"172.21.15.142:6831","nonce":2353193632}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6825","nonce":2353193632},{"type":"v1","addr":"172.21.15.142:6827","nonce":2353193632}]},"public_addr":"172.21.15.142:6819/2353193632","cluster_addr":"172.21.15.142:6823/2353193632","heartbeat_back_addr":"172.21.15.142:6831/2353193632","heartbeat_front_addr":"172.21.15.142:6827/2353193632","state":["exists","up"]},{"osd":6,"uuid":"649ce78a-5626-445c-aedc-a651ed05a6f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":2006111986},{"type":"v1","addr":"172.21.15.142:6806","nonce":2006111986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":2006111986},{"type":"v1","addr":"172.21.15.142:6810","nonce":2006111986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":2006111986},{"type":"v1","addr":"172.21.15.142:6815","nonce":2006111986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":2006111986},{"type":"v1","addr":"172.21.15.142:6813","nonce":2006111986}]},"public_addr":"172.21.15.142:6806/2006111986","cluster_addr":"172.21.15.142:6810/2006111986","heartbeat_back_addr":"172.21.15.142:6815/2006111986","heartbeat_front_addr":"172.21.15.142:6813/2006111986","state":["exists","up"]},{"osd":7,"uuid":"af15ae3b-c1d0-4acf-92db-8a1805494d13","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":2573794341},{"type":"v1","addr":"172.21.15.142:6818","nonce":2573794341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":2573794341},{"type":"v1","addr":"172.21.15.142:6822","nonce":2573794341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":2573794341},{"type":"v1","addr":"172.21.15.142:6830","nonce":2573794341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":2573794341},{"type":"v1","addr":"172.21.15.142:6826","nonce":2573794341}]},"public_addr":"172.21.15.142:6818/2573794341","cluster_addr":"172.21.15.142:6822/2573794341","heartbeat_back_addr":"172.21.15.142:6830/2573794341","heartbeat_front_addr":"172.21.15.142:6826/2573794341","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.185824+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.262103+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.225556+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:10.523459+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:10.706035+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.257339+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.301776+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.051960+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-12T09:44:06.280 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:06.279+0000 7f866c41e640 1 -- 172.21.15.73:0/3906259146 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f864806ae40 msgr2=0x7f864806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:06.281 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:06.279+0000 7f866c41e640 1 --2- 172.21.15.73:0/3906259146 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f864806ae40 0x7f864806d300 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f8660005880 tx=0x7f8660009040 comp rx=0 tx=0).stop 2023-12-12T09:44:06.281 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:06.279+0000 7f866c41e640 1 -- 172.21.15.73:0/3906259146 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f86640a50f0 msgr2=0x7f86640a97b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:06.281 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:06.279+0000 7f866c41e640 1 --2- 172.21.15.73:0/3906259146 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f86640a50f0 0x7f86640a97b0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f865400d7d0 tx=0x7f865400dc90 comp rx=0 tx=0).stop 2023-12-12T09:44:06.281 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:06.279+0000 7f866c41e640 1 -- 172.21.15.73:0/3906259146 shutdown_connections 2023-12-12T09:44:06.281 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:06.279+0000 7f866c41e640 1 --2- 172.21.15.73:0/3906259146 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f864806ae40 0x7f864806d300 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:06.281 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:06.279+0000 7f866c41e640 1 --2- 172.21.15.73:0/3906259146 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f86641552e0 0x7f86641e5ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:06.281 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:06.279+0000 7f866c41e640 1 --2- 172.21.15.73:0/3906259146 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f86640a50f0 0x7f86640a97b0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:06.281 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:06.279+0000 7f866c41e640 1 --2- 172.21.15.73:0/3906259146 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f866406bf20 0x7f86640be630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:06.281 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:06.279+0000 7f866c41e640 1 -- 172.21.15.73:0/3906259146 >> 172.21.15.73:0/3906259146 conn(0x7f86640a8130 msgr2=0x7f8664152fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:44:06.281 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:06.280+0000 7f866c41e640 1 -- 172.21.15.73:0/3906259146 shutdown_connections 2023-12-12T09:44:06.281 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:06.280+0000 7f866c41e640 1 -- 172.21.15.73:0/3906259146 wait complete. 2023-12-12T09:44:06.300 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-12-12T09:44:06.300 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-12T09:44:06.514 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:06.513+0000 7f2205d89640 1 Processor -- start 2023-12-12T09:44:06.515 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:06.513+0000 7f2205d89640 1 -- start start 2023-12-12T09:44:06.516 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:06.515+0000 7f2205d89640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f220014a820 0x7f22000c3300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:06.516 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:06.515+0000 7f2205d89640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f22000aa520 0x7f2200154b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:06.516 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:06.515+0000 7f2205d89640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22001546a0 con 0x7f220014ac00 2023-12-12T09:44:06.516 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:06.515+0000 7f2205d89640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22000aadf0 con 0x7f220014a820 2023-12-12T09:44:06.516 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:06.515+0000 7f2205d89640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22000c38e0 con 0x7f22000aa520 2023-12-12T09:44:06.517 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:06.516+0000 7f21feffd640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f22000aa520 0x7f2200154b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:06.517 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:06.516+0000 7f21ff7fe640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f220014a820 0x7f22000c3300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:06.517 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:06.516+0000 7f21feffd640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f22000aa520 0x7f2200154b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.73:42854/0 (socket says 172.21.15.73:42854) 2023-12-12T09:44:06.517 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:06.516+0000 7f21feffd640 1 -- 172.21.15.73:0/3752856161 learned_addr learned my addr 172.21.15.73:0/3752856161 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:44:06.518 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:06.516+0000 7f21feffd640 1 -- 172.21.15.73:0/3752856161 >> v2:172.21.15.142:3300/0 conn(0x7f220014a820 msgr2=0x7f22000c3300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:44:06.518 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:06.516+0000 7f21feffd640 1 --2- 172.21.15.73:0/3752856161 >> v2:172.21.15.142:3300/0 conn(0x7f220014a820 0x7f22000c3300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:06.518 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:06.516+0000 7f21feffd640 1 -- 172.21.15.73:0/3752856161 >> v1:172.21.15.142:6789/0 conn(0x7f220014ac00 legacy=0x7f22001509c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:06.518 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:06.516+0000 7f21feffd640 1 -- 172.21.15.73:0/3752856161 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22000c3bc0 con 0x7f22000aa520 2023-12-12T09:44:06.519 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:06.518+0000 7f21feffd640 1 --2- 172.21.15.73:0/3752856161 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f22000aa520 0x7f2200154b30 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f21e8009870 tx=0x7f21e802b8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=17602f517a04bbb0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:44:06.519 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:06.518+0000 7f21fe7fc640 1 -- 172.21.15.73:0/3752856161 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21e8031640 con 0x7f22000aa520 2023-12-12T09:44:06.519 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:06.519+0000 7f21fe7fc640 1 -- 172.21.15.73:0/3752856161 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21e80317a0 con 0x7f22000aa520 2023-12-12T09:44:06.520 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:06.519+0000 7f21fe7fc640 1 -- 172.21.15.73:0/3752856161 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21e8031b30 con 0x7f22000aa520 2023-12-12T09:44:06.521 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:06.519+0000 7f2205d89640 1 -- 172.21.15.73:0/3752856161 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f22000aa520 msgr2=0x7f2200154b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:06.521 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:06.519+0000 7f2205d89640 1 --2- 172.21.15.73:0/3752856161 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f22000aa520 0x7f2200154b30 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f21e8009870 tx=0x7f21e802b8f0 comp rx=0 tx=0).stop 2023-12-12T09:44:06.521 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:06.519+0000 7f2205d89640 1 -- 172.21.15.73:0/3752856161 shutdown_connections 2023-12-12T09:44:06.521 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:06.519+0000 7f2205d89640 1 --2- 172.21.15.73:0/3752856161 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f22000aa520 0x7f2200154b30 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:06.521 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:06.519+0000 7f2205d89640 1 --2- 172.21.15.73:0/3752856161 >> v2:172.21.15.142:3300/0 conn(0x7f220014a820 0x7f22000c3300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:06.521 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:06.519+0000 7f2205d89640 1 -- 172.21.15.73:0/3752856161 >> 172.21.15.73:0/3752856161 conn(0x7f22000a9710 msgr2=0x7f22000a9af0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:44:06.521 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:06.519+0000 7f2205d89640 1 -- 172.21.15.73:0/3752856161 shutdown_connections 2023-12-12T09:44:06.521 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:06.519+0000 7f2205d89640 1 -- 172.21.15.73:0/3752856161 wait complete. 2023-12-12T09:44:06.522 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:06.521+0000 7f2205d89640 1 Processor -- start 2023-12-12T09:44:06.523 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:06.521+0000 7f2205d89640 1 -- start start 2023-12-12T09:44:06.524 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:06.522+0000 7f2205d89640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f220014a820 0x7f2200145b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:06.524 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:06.522+0000 7f2205d89640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f220014ac00 0x7f2200146b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:06.524 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:06.522+0000 7f2205d89640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2200142960 0x7f2200141a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:06.524 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:06.522+0000 7f2205d89640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2200153a60 con 0x7f220014a820 2023-12-12T09:44:06.524 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:06.522+0000 7f2205d89640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2200143210 con 0x7f220014ac00 2023-12-12T09:44:06.524 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:06.522+0000 7f2205d89640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22001434f0 con 0x7f2200142960 2023-12-12T09:44:06.524 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:06.522+0000 7f21ff7fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f220014a820 0x7f2200145b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:06.524 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:06.522+0000 7f21ff7fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f220014a820 0x7f2200145b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:36340/0 (socket says 172.21.15.73:36340) 2023-12-12T09:44:06.524 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:06.522+0000 7f21ff7fe640 1 -- 172.21.15.73:0/2512856538 learned_addr learned my addr 172.21.15.73:0/2512856538 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:44:06.525 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:06.523+0000 7f21feffd640 1 --2- 172.21.15.73:0/2512856538 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f220014ac00 0x7f2200146b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:06.525 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:06.523+0000 7f21ff7fe640 1 -- 172.21.15.73:0/2512856538 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2200142960 msgr2=0x7f2200141a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:06.525 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:06.523+0000 7f21fffff640 1 --2- 172.21.15.73:0/2512856538 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2200142960 0x7f2200141a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:06.525 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:06.523+0000 7f21ff7fe640 1 --2- 172.21.15.73:0/2512856538 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2200142960 0x7f2200141a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:06.525 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:06.523+0000 7f21ff7fe640 1 -- 172.21.15.73:0/2512856538 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f220014ac00 msgr2=0x7f2200146b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:06.525 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:06.523+0000 7f21ff7fe640 1 --2- 172.21.15.73:0/2512856538 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f220014ac00 0x7f2200146b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:06.525 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:06.523+0000 7f21ff7fe640 1 -- 172.21.15.73:0/2512856538 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21e80094d0 con 0x7f220014a820 2023-12-12T09:44:06.525 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:06.523+0000 7f21ff7fe640 1 --2- 172.21.15.73:0/2512856538 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f220014a820 0x7f2200145b70 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f21f000efc0 tx=0x7f21f000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:44:06.526 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:06.523+0000 7f21f7fff640 1 -- 172.21.15.73:0/2512856538 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21f0014480 con 0x7f220014a820 2023-12-12T09:44:06.526 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:06.524+0000 7f21f7fff640 1 -- 172.21.15.73:0/2512856538 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21f000f040 con 0x7f220014a820 2023-12-12T09:44:06.526 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:06.524+0000 7f21f7fff640 1 -- 172.21.15.73:0/2512856538 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21f0014800 con 0x7f220014a820 2023-12-12T09:44:06.526 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:06.524+0000 7f2205d89640 1 -- 172.21.15.73:0/2512856538 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22001437d0 con 0x7f220014a820 2023-12-12T09:44:06.526 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:06.524+0000 7f2205d89640 1 -- 172.21.15.73:0/2512856538 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2200142e10 con 0x7f220014a820 2023-12-12T09:44:06.526 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:06.525+0000 7f2205d89640 1 -- 172.21.15.73:0/2512856538 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2200067580 con 0x7f220014a820 2023-12-12T09:44:06.527 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:06.526+0000 7f21f7fff640 1 -- 172.21.15.73:0/2512856538 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f21f0014960 con 0x7f220014a820 2023-12-12T09:44:06.528 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:06.527+0000 7f21f7fff640 1 --2- 172.21.15.73:0/2512856538 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f21e006ae40 0x7f21e006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:06.528 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:06.527+0000 7f21f7fff640 1 -- 172.21.15.73:0/2512856538 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f21f008a250 con 0x7f220014a820 2023-12-12T09:44:06.528 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:06.527+0000 7f21feffd640 1 --2- 172.21.15.73:0/2512856538 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f21e006ae40 0x7f21e006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:06.528 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:06.528+0000 7f21feffd640 1 --2- 172.21.15.73:0/2512856538 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f21e006ae40 0x7f21e006d300 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f21e8036000 tx=0x7f21e803c040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:44:06.532 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:06.531+0000 7f21f7fff640 1 -- 172.21.15.73:0/2512856538 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f21f00552f0 con 0x7f220014a820 2023-12-12T09:44:06.760 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:06.759+0000 7f2205d89640 1 -- 172.21.15.73:0/2512856538 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f22000c46d0 con 0x7f220014a820 2023-12-12T09:44:06.761 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:06.760+0000 7f21f7fff640 1 -- 172.21.15.73:0/2512856538 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4913 (secure 0 0 0) 0x7f21f0058910 con 0x7f220014a820 2023-12-12T09:44:06.761 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-12T09:44:06.761 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4257,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6835/1079394562","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":1079394562},{"type":"v1","addr":"172.21.15.73:6835","nonce":1079394562}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4258,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6835/3726638062","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6833","nonce":3726638062},{"type":"v1","addr":"172.21.15.142:6835","nonce":3726638062}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4260,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6837/2513898821","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6836","nonce":2513898821},{"type":"v1","addr":"172.21.15.73:6837","nonce":2513898821}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-12T09:43:21.720752+0000","modified":"2023-12-12T09:43:24.801495+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4269},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4269":{"gid":4269,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.142:6834/1773392257","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6832","nonce":1773392257},{"type":"v1","addr":"172.21.15.142:6834","nonce":1773392257}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-12-12T09:44:06.761 INFO:teuthology.orchestra.run.smithi073.stderr:dumped fsmap epoch 8 2023-12-12T09:44:06.764 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:06.762+0000 7f2205d89640 1 -- 172.21.15.73:0/2512856538 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f21e006ae40 msgr2=0x7f21e006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:06.764 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:06.762+0000 7f2205d89640 1 --2- 172.21.15.73:0/2512856538 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f21e006ae40 0x7f21e006d300 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f21e8036000 tx=0x7f21e803c040 comp rx=0 tx=0).stop 2023-12-12T09:44:06.764 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:06.762+0000 7f2205d89640 1 -- 172.21.15.73:0/2512856538 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f220014a820 msgr2=0x7f2200145b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:06.764 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:06.762+0000 7f2205d89640 1 --2- 172.21.15.73:0/2512856538 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f220014a820 0x7f2200145b70 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f21f000efc0 tx=0x7f21f000c490 comp rx=0 tx=0).stop 2023-12-12T09:44:06.764 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:06.762+0000 7f2205d89640 1 -- 172.21.15.73:0/2512856538 shutdown_connections 2023-12-12T09:44:06.764 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:06.762+0000 7f2205d89640 1 --2- 172.21.15.73:0/2512856538 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f21e006ae40 0x7f21e006d300 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:06.764 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:06.762+0000 7f2205d89640 1 --2- 172.21.15.73:0/2512856538 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2200142960 0x7f2200141a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:06.764 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:06.762+0000 7f2205d89640 1 --2- 172.21.15.73:0/2512856538 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f220014ac00 0x7f2200146b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:06.764 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:06.762+0000 7f2205d89640 1 --2- 172.21.15.73:0/2512856538 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f220014a820 0x7f2200145b70 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:06.764 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:06.762+0000 7f2205d89640 1 -- 172.21.15.73:0/2512856538 >> 172.21.15.73:0/2512856538 conn(0x7f22000a9710 msgr2=0x7f2200151250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:44:06.765 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:06.763+0000 7f2205d89640 1 -- 172.21.15.73:0/2512856538 shutdown_connections 2023-12-12T09:44:06.765 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:06.763+0000 7f2205d89640 1 -- 172.21.15.73:0/2512856538 wait complete. 2023-12-12T09:44:06.783 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-12T09:44:06.994 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:06.993+0000 7f031b831640 1 Processor -- start 2023-12-12T09:44:06.994 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:06.993+0000 7f031b831640 1 -- start start 2023-12-12T09:44:06.995 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:06.994+0000 7f031b831640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f03141552e0 0x7f03140c49c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:06.995 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:06.994+0000 7f031b831640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f03140a50f0 0x7f03140a9050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:06.995 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:06.994+0000 7f031b831640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03140c0b50 con 0x7f031406bf20 2023-12-12T09:44:06.995 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:06.994+0000 7f031b831640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03140c04d0 con 0x7f03141552e0 2023-12-12T09:44:06.995 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:06.994+0000 7f031b831640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f031406c880 con 0x7f03140a50f0 2023-12-12T09:44:06.997 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:06.994+0000 7f0319dce640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f031406bf20 0x7f03140a9590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:54604/0 (socket says 172.21.15.73:54604) 2023-12-12T09:44:06.997 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:06.994+0000 7f0319dce640 1 -- 172.21.15.73:0/782917422 learned_addr learned my addr 172.21.15.73:0/782917422 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-12T09:44:06.997 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:06.995+0000 7f03195cd640 1 --2- 172.21.15.73:0/782917422 >> v2:172.21.15.142:3300/0 conn(0x7f03141552e0 0x7f03140c49c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:06.997 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:06.995+0000 7f0318dcc640 1 --2- 172.21.15.73:0/782917422 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f03140a50f0 0x7f03140a9050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:06.997 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:06.995+0000 7f030bfff640 1 -- 172.21.15.73:0/782917422 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 441981217 0 0) 0x7f03140c0b50 con 0x7f031406bf20 2023-12-12T09:44:06.998 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:06.995+0000 7f030bfff640 1 -- 172.21.15.73:0/782917422 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0300003520 con 0x7f031406bf20 2023-12-12T09:44:06.998 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:06.995+0000 7f030bfff640 1 -- 172.21.15.73:0/782917422 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3285548006 0 0) 0x7f0300003520 con 0x7f031406bf20 2023-12-12T09:44:06.998 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:06.995+0000 7f030bfff640 1 -- 172.21.15.73:0/782917422 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f03140a50f0 msgr2=0x7f03140a9050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:44:06.998 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:06.995+0000 7f030bfff640 1 --2- 172.21.15.73:0/782917422 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f03140a50f0 0x7f03140a9050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:06.998 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:06.995+0000 7f030bfff640 1 -- 172.21.15.73:0/782917422 >> v2:172.21.15.142:3300/0 conn(0x7f03141552e0 msgr2=0x7f03140c49c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:44:06.998 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:06.995+0000 7f030bfff640 1 --2- 172.21.15.73:0/782917422 >> v2:172.21.15.142:3300/0 conn(0x7f03141552e0 0x7f03140c49c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:06.998 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:06.995+0000 7f030bfff640 1 -- 172.21.15.73:0/782917422 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f031406cb60 con 0x7f031406bf20 2023-12-12T09:44:06.998 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:06.995+0000 7f030bfff640 1 -- 172.21.15.73:0/782917422 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3186547832 0 0) 0x7f030c0019f0 con 0x7f031406bf20 2023-12-12T09:44:06.998 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:06.995+0000 7f030bfff640 1 -- 172.21.15.73:0/782917422 >> v1:172.21.15.73:6789/0 conn(0x7f031406bf20 legacy=0x7f03140a9590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:06.998 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:06.995+0000 7f030bfff640 1 --2- 172.21.15.73:0/782917422 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f03140a50f0 0x7f0300003970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:06.999 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:06.995+0000 7f030bfff640 1 --2- 172.21.15.73:0/782917422 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0300003f40 0x7f03000047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:06.999 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:06.995+0000 7f030bfff640 1 --2- 172.21.15.73:0/782917422 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0300004d00 0x7f0300005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:06.999 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:06.995+0000 7f030bfff640 1 -- 172.21.15.73:0/782917422 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03140c04d0 con 0x7f0300003f40 2023-12-12T09:44:06.999 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:06.995+0000 7f030bfff640 1 -- 172.21.15.73:0/782917422 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f031406c880 con 0x7f0300004d00 2023-12-12T09:44:06.999 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:06.995+0000 7f030bfff640 1 -- 172.21.15.73:0/782917422 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f030000ba30 con 0x7f03140a50f0 2023-12-12T09:44:06.999 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:06.996+0000 7f0318dcc640 1 --2- 172.21.15.73:0/782917422 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0300003f40 0x7f03000047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:06.999 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:06.996+0000 7f0318dcc640 1 -- 172.21.15.73:0/782917422 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f03140a50f0 msgr2=0x7f0300003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:44:06.999 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:06.996+0000 7f0318dcc640 1 --2- 172.21.15.73:0/782917422 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f03140a50f0 0x7f0300003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:06.999 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:06.996+0000 7f0318dcc640 1 -- 172.21.15.73:0/782917422 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0300004d00 msgr2=0x7f0300005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:44:06.999 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:06.996+0000 7f0318dcc640 1 --2- 172.21.15.73:0/782917422 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0300004d00 0x7f0300005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:06.999 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:06.996+0000 7f0318dcc640 1 -- 172.21.15.73:0/782917422 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0300003520 con 0x7f0300003f40 2023-12-12T09:44:07.001 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:06.997+0000 7f0318dcc640 1 --2- 172.21.15.73:0/782917422 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0300003f40 0x7f03000047c0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f030400bd30 tx=0x7f03000057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d447b96c10bc763 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:44:07.001 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:06.997+0000 7f030bfff640 1 -- 172.21.15.73:0/782917422 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03040306e0 con 0x7f0300003f40 2023-12-12T09:44:07.001 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:06.997+0000 7f030bfff640 1 -- 172.21.15.73:0/782917422 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0304030840 con 0x7f0300003f40 2023-12-12T09:44:07.001 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:06.997+0000 7f030bfff640 1 -- 172.21.15.73:0/782917422 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0304030bd0 con 0x7f0300003f40 2023-12-12T09:44:07.001 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:06.998+0000 7f031b831640 1 -- 172.21.15.73:0/782917422 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0300003f40 msgr2=0x7f03000047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:07.001 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:06.998+0000 7f031b831640 1 --2- 172.21.15.73:0/782917422 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0300003f40 0x7f03000047c0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f030400bd30 tx=0x7f03000057f0 comp rx=0 tx=0).stop 2023-12-12T09:44:07.001 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:06.998+0000 7f0319dce640 1 -- 172.21.15.73:0/782917422 reap_dead start 2023-12-12T09:44:07.001 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:06.998+0000 7f031b831640 1 -- 172.21.15.73:0/782917422 shutdown_connections 2023-12-12T09:44:07.001 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:06.998+0000 7f031b831640 1 -- 172.21.15.73:0/782917422 >> 172.21.15.73:0/782917422 conn(0x7f03140a8130 msgr2=0x7f03140c24b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:44:07.001 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:06.998+0000 7f031b831640 1 -- 172.21.15.73:0/782917422 shutdown_connections 2023-12-12T09:44:07.001 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:06.998+0000 7f031b831640 1 -- 172.21.15.73:0/782917422 wait complete. 2023-12-12T09:44:07.001 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:07.000+0000 7f031b831640 1 Processor -- start 2023-12-12T09:44:07.002 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:07.000+0000 7f031b831640 1 -- start start 2023-12-12T09:44:07.004 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:07.001+0000 7f031b831640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0300003f40 0x7f03140702b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:07.004 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:07.001+0000 7f031b831640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f03141e03a0 0x7f031414f660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:07.004 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:07.001+0000 7f031b831640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f03141513d0 0x7f0314151850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:07.004 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:07.001+0000 7f031b831640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0314151d90 con 0x7f03141513d0 2023-12-12T09:44:07.004 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:07.001+0000 7f031b831640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f031414f1b0 con 0x7f03141e03a0 2023-12-12T09:44:07.004 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:07.001+0000 7f031b831640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03140707f0 con 0x7f0300003f40 2023-12-12T09:44:07.004 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:07.001+0000 7f0319dce640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f03141513d0 0x7f0314151850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:07.004 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:07.001+0000 7f0319dce640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f03141513d0 0x7f0314151850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:36358/0 (socket says 172.21.15.73:36358) 2023-12-12T09:44:07.004 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:07.001+0000 7f0319dce640 1 -- 172.21.15.73:0/791955180 learned_addr learned my addr 172.21.15.73:0/791955180 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:44:07.004 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:07.001+0000 7f03195cd640 1 --2- 172.21.15.73:0/791955180 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0300003f40 0x7f03140702b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:07.004 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:07.001+0000 7f0318dcc640 1 --2- 172.21.15.73:0/791955180 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f03141e03a0 0x7f031414f660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:07.005 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:07.002+0000 7f0319dce640 1 -- 172.21.15.73:0/791955180 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0300003f40 msgr2=0x7f03140702b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:07.005 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:07.002+0000 7f0319dce640 1 --2- 172.21.15.73:0/791955180 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0300003f40 0x7f03140702b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:07.005 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:07.002+0000 7f0319dce640 1 -- 172.21.15.73:0/791955180 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f03141e03a0 msgr2=0x7f031414f660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:07.005 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:07.002+0000 7f0319dce640 1 --2- 172.21.15.73:0/791955180 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f03141e03a0 0x7f031414f660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:07.005 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:07.002+0000 7f0319dce640 1 -- 172.21.15.73:0/791955180 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f031414eed0 con 0x7f03141513d0 2023-12-12T09:44:07.005 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:07.002+0000 7f0319dce640 1 --2- 172.21.15.73:0/791955180 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f03141513d0 0x7f0314151850 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f030c000f80 tx=0x7f030c00ccd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:44:07.005 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:07.002+0000 7f0309ffb640 1 -- 172.21.15.73:0/791955180 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f030c00a610 con 0x7f03141513d0 2023-12-12T09:44:07.005 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:07.002+0000 7f0309ffb640 1 -- 172.21.15.73:0/791955180 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f030c00a7b0 con 0x7f03141513d0 2023-12-12T09:44:07.005 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:07.002+0000 7f031b831640 1 -- 172.21.15.73:0/791955180 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03141eaee0 con 0x7f03141513d0 2023-12-12T09:44:07.005 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:07.002+0000 7f0309ffb640 1 -- 172.21.15.73:0/791955180 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f030c00ab60 con 0x7f03141513d0 2023-12-12T09:44:07.005 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:07.002+0000 7f031b831640 1 -- 172.21.15.73:0/791955180 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03140aab00 con 0x7f03141513d0 2023-12-12T09:44:07.006 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:07.003+0000 7f031b831640 1 -- 172.21.15.73:0/791955180 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f031414f380 con 0x7f03141513d0 2023-12-12T09:44:07.006 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:07.004+0000 7f0309ffb640 1 -- 172.21.15.73:0/791955180 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f030c00acc0 con 0x7f03141513d0 2023-12-12T09:44:07.007 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:07.006+0000 7f0309ffb640 1 --2- 172.21.15.73:0/791955180 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f02f806ae70 0x7f02f806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:07.007 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:07.006+0000 7f0309ffb640 1 -- 172.21.15.73:0/791955180 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f030c089330 con 0x7f03141513d0 2023-12-12T09:44:07.007 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:07.006+0000 7f03195cd640 1 --2- 172.21.15.73:0/791955180 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f02f806ae70 0x7f02f806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:07.007 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:07.007+0000 7f03195cd640 1 --2- 172.21.15.73:0/791955180 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f02f806ae70 0x7f02f806d330 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f03100047b0 tx=0x7f0310008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:44:07.011 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:07.010+0000 7f0309ffb640 1 -- 172.21.15.73:0/791955180 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f031414f380 con 0x7f03141513d0 2023-12-12T09:44:07.224 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:07.222+0000 7f031b831640 1 -- 172.21.15.73:0/791955180 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f031414f380 con 0x7f03141513d0 2023-12-12T09:44:07.224 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:07.223+0000 7f0309ffb640 1 -- 172.21.15.73:0/791955180 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4913 (secure 0 0 0) 0x7f031414f380 con 0x7f03141513d0 2023-12-12T09:44:07.225 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-12T09:44:07.225 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4257,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6835/1079394562","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":1079394562},{"type":"v1","addr":"172.21.15.73:6835","nonce":1079394562}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4258,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6835/3726638062","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6833","nonce":3726638062},{"type":"v1","addr":"172.21.15.142:6835","nonce":3726638062}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4260,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6837/2513898821","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6836","nonce":2513898821},{"type":"v1","addr":"172.21.15.73:6837","nonce":2513898821}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-12T09:43:21.720752+0000","modified":"2023-12-12T09:43:24.801495+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4269},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4269":{"gid":4269,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.142:6834/1773392257","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6832","nonce":1773392257},{"type":"v1","addr":"172.21.15.142:6834","nonce":1773392257}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-12-12T09:44:07.225 INFO:teuthology.orchestra.run.smithi073.stderr:dumped fsmap epoch 8 2023-12-12T09:44:07.227 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:07.226+0000 7f031b831640 1 -- 172.21.15.73:0/791955180 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f02f806ae70 msgr2=0x7f02f806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:07.228 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:07.226+0000 7f031b831640 1 --2- 172.21.15.73:0/791955180 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f02f806ae70 0x7f02f806d330 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f03100047b0 tx=0x7f0310008040 comp rx=0 tx=0).stop 2023-12-12T09:44:07.228 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:07.226+0000 7f031b831640 1 -- 172.21.15.73:0/791955180 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f03141513d0 msgr2=0x7f0314151850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:07.228 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:07.226+0000 7f031b831640 1 --2- 172.21.15.73:0/791955180 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f03141513d0 0x7f0314151850 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f030c000f80 tx=0x7f030c00ccd0 comp rx=0 tx=0).stop 2023-12-12T09:44:07.228 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:07.226+0000 7f031b831640 1 -- 172.21.15.73:0/791955180 shutdown_connections 2023-12-12T09:44:07.228 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:07.226+0000 7f031b831640 1 --2- 172.21.15.73:0/791955180 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f02f806ae70 0x7f02f806d330 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:07.228 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:07.226+0000 7f031b831640 1 --2- 172.21.15.73:0/791955180 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f03141513d0 0x7f0314151850 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:07.228 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:07.226+0000 7f031b831640 1 --2- 172.21.15.73:0/791955180 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f03141e03a0 0x7f031414f660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:07.228 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:07.226+0000 7f031b831640 1 --2- 172.21.15.73:0/791955180 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0300003f40 0x7f03140702b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:07.228 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:07.226+0000 7f031b831640 1 -- 172.21.15.73:0/791955180 >> 172.21.15.73:0/791955180 conn(0x7f03140a8130 msgr2=0x7f03140c0d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:44:07.228 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:07.226+0000 7f031b831640 1 -- 172.21.15.73:0/791955180 shutdown_connections 2023-12-12T09:44:07.228 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:07.226+0000 7f031b831640 1 -- 172.21.15.73:0/791955180 wait complete. 2023-12-12T09:44:07.246 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-12T09:44:07.446 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:07.445+0000 7ff381548640 1 Processor -- start 2023-12-12T09:44:07.447 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:07.445+0000 7ff381548640 1 -- start start 2023-12-12T09:44:07.448 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:07.446+0000 7ff381548640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7ff37c14fa40 0x7ff37c06a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:07.448 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:07.447+0000 7ff381548640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff37c06db70 0x7ff37c0c39b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:07.448 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:07.447+0000 7ff381548640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff37c152610 con 0x7ff37c0c5070 2023-12-12T09:44:07.448 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:07.447+0000 7ff381548640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff37c1528f0 con 0x7ff37c14fa40 2023-12-12T09:44:07.448 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:07.447+0000 7ff381548640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff37c152bd0 con 0x7ff37c06db70 2023-12-12T09:44:07.448 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:07.447+0000 7ff37affd640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7ff37c14fa40 0x7ff37c06a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:07.448 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:07.447+0000 7ff37b7fe640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7ff37c0c5070 0x7ff37c0c3ef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:54620/0 (socket says 172.21.15.73:54620) 2023-12-12T09:44:07.449 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:07.447+0000 7ff37b7fe640 1 -- 172.21.15.73:0/3019653998 learned_addr learned my addr 172.21.15.73:0/3019653998 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-12T09:44:07.450 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:07.447+0000 7ff373fff640 1 --2- 172.21.15.73:0/3019653998 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff37c06db70 0x7ff37c0c39b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:07.450 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:07.447+0000 7ff37a7fc640 1 -- 172.21.15.73:0/3019653998 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1885181081 0 0) 0x7ff37c152610 con 0x7ff37c0c5070 2023-12-12T09:44:07.450 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:07.447+0000 7ff37a7fc640 1 -- 172.21.15.73:0/3019653998 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff368003520 con 0x7ff37c0c5070 2023-12-12T09:44:07.450 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:07.447+0000 7ff37affd640 1 -- 172.21.15.73:0/3019653998 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff37c06db70 msgr2=0x7ff37c0c39b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:44:07.450 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:07.447+0000 7ff37affd640 1 --2- 172.21.15.73:0/3019653998 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff37c06db70 0x7ff37c0c39b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:07.450 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:07.447+0000 7ff37affd640 1 -- 172.21.15.73:0/3019653998 >> v1:172.21.15.73:6789/0 conn(0x7ff37c0c5070 legacy=0x7ff37c0c3ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:07.450 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:07.447+0000 7ff37affd640 1 -- 172.21.15.73:0/3019653998 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff37c152eb0 con 0x7ff37c14fa40 2023-12-12T09:44:07.450 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:07.448+0000 7ff37affd640 1 --2- 172.21.15.73:0/3019653998 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff37c14fa40 0x7ff37c06a4e0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7ff36c0097a0 tx=0x7ff36c02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c02077cea6b4a2c1 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:44:07.450 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:07.449+0000 7ff37a7fc640 1 -- 172.21.15.73:0/3019653998 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff36c031830 con 0x7ff37c14fa40 2023-12-12T09:44:07.450 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:07.449+0000 7ff37a7fc640 1 -- 172.21.15.73:0/3019653998 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff36c031990 con 0x7ff37c14fa40 2023-12-12T09:44:07.450 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:07.449+0000 7ff37a7fc640 1 -- 172.21.15.73:0/3019653998 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff36c031d20 con 0x7ff37c14fa40 2023-12-12T09:44:07.456 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:07.449+0000 7ff381548640 1 -- 172.21.15.73:0/3019653998 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff37c14fa40 msgr2=0x7ff37c06a4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:07.456 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:07.449+0000 7ff381548640 1 --2- 172.21.15.73:0/3019653998 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff37c14fa40 0x7ff37c06a4e0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7ff36c0097a0 tx=0x7ff36c02b8d0 comp rx=0 tx=0).stop 2023-12-12T09:44:07.456 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:07.449+0000 7ff381548640 1 -- 172.21.15.73:0/3019653998 shutdown_connections 2023-12-12T09:44:07.456 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:07.449+0000 7ff381548640 1 --2- 172.21.15.73:0/3019653998 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff37c06db70 0x7ff37c0c39b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:07.456 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:07.449+0000 7ff381548640 1 --2- 172.21.15.73:0/3019653998 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff37c14fa40 0x7ff37c06a4e0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:07.456 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:07.449+0000 7ff381548640 1 -- 172.21.15.73:0/3019653998 >> 172.21.15.73:0/3019653998 conn(0x7ff37c0a8130 msgr2=0x7ff37c0c24b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:44:07.456 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:07.449+0000 7ff381548640 1 -- 172.21.15.73:0/3019653998 shutdown_connections 2023-12-12T09:44:07.456 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:07.450+0000 7ff381548640 1 -- 172.21.15.73:0/3019653998 wait complete. 2023-12-12T09:44:07.456 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:07.451+0000 7ff381548640 1 Processor -- start 2023-12-12T09:44:07.456 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:07.451+0000 7ff381548640 1 -- start start 2023-12-12T09:44:07.456 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:07.452+0000 7ff381548640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff37c06db70 0x7ff37c1ebac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:07.456 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:07.452+0000 7ff381548640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff37c0c5070 0x7ff37c071870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:07.457 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:07.452+0000 7ff381548640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff37c14fa40 0x7ff37c1dec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:07.457 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:07.452+0000 7ff381548640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff37c0bd780 con 0x7ff37c0c5070 2023-12-12T09:44:07.457 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:07.452+0000 7ff381548640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff37c1e7e10 con 0x7ff37c06db70 2023-12-12T09:44:07.457 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:07.452+0000 7ff381548640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff37c1e7b10 con 0x7ff37c14fa40 2023-12-12T09:44:07.457 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:07.452+0000 7ff373fff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff37c0c5070 0x7ff37c071870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:07.457 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:07.453+0000 7ff373fff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff37c0c5070 0x7ff37c071870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:36372/0 (socket says 172.21.15.73:36372) 2023-12-12T09:44:07.457 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:07.453+0000 7ff373fff640 1 -- 172.21.15.73:0/3741411270 learned_addr learned my addr 172.21.15.73:0/3741411270 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:44:07.457 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:07.453+0000 7ff37affd640 1 --2- 172.21.15.73:0/3741411270 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff37c06db70 0x7ff37c1ebac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:07.457 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:07.453+0000 7ff37b7fe640 1 --2- 172.21.15.73:0/3741411270 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff37c14fa40 0x7ff37c1dec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:07.457 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:07.453+0000 7ff373fff640 1 -- 172.21.15.73:0/3741411270 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff37c14fa40 msgr2=0x7ff37c1dec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:07.457 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:07.453+0000 7ff373fff640 1 --2- 172.21.15.73:0/3741411270 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff37c14fa40 0x7ff37c1dec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:07.457 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:07.453+0000 7ff373fff640 1 -- 172.21.15.73:0/3741411270 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff37c06db70 msgr2=0x7ff37c1ebac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:07.457 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:07.453+0000 7ff373fff640 1 --2- 172.21.15.73:0/3741411270 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff37c06db70 0x7ff37c1ebac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:07.457 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:07.453+0000 7ff373fff640 1 -- 172.21.15.73:0/3741411270 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff36c009400 con 0x7ff37c0c5070 2023-12-12T09:44:07.457 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:07.453+0000 7ff37b7fe640 1 --2- 172.21.15.73:0/3741411270 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff37c14fa40 0x7ff37c1dec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:44:07.458 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:07.453+0000 7ff373fff640 1 --2- 172.21.15.73:0/3741411270 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff37c0c5070 0x7ff37c071870 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7ff36400d600 tx=0x7ff36400dac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:44:07.458 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:07.454+0000 7ff3737fe640 1 -- 172.21.15.73:0/3741411270 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff364004240 con 0x7ff37c0c5070 2023-12-12T09:44:07.458 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:07.454+0000 7ff3737fe640 1 -- 172.21.15.73:0/3741411270 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3640043a0 con 0x7ff37c0c5070 2023-12-12T09:44:07.458 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:07.454+0000 7ff381548640 1 -- 172.21.15.73:0/3741411270 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff37c1ec000 con 0x7ff37c0c5070 2023-12-12T09:44:07.458 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:07.454+0000 7ff3737fe640 1 -- 172.21.15.73:0/3741411270 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff364003830 con 0x7ff37c0c5070 2023-12-12T09:44:07.458 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:07.454+0000 7ff381548640 1 -- 172.21.15.73:0/3741411270 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff37c0bcee0 con 0x7ff37c0c5070 2023-12-12T09:44:07.459 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:07.455+0000 7ff381548640 1 -- 172.21.15.73:0/3741411270 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff37c0c0120 con 0x7ff37c0c5070 2023-12-12T09:44:07.459 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:07.456+0000 7ff3737fe640 1 -- 172.21.15.73:0/3741411270 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7ff364003990 con 0x7ff37c0c5070 2023-12-12T09:44:07.459 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:07.457+0000 7ff3737fe640 1 --2- 172.21.15.73:0/3741411270 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7ff35c06ae40 0x7ff35c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:07.459 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:07.457+0000 7ff3737fe640 1 -- 172.21.15.73:0/3741411270 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff364089780 con 0x7ff37c0c5070 2023-12-12T09:44:07.459 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:07.457+0000 7ff37affd640 1 --2- 172.21.15.73:0/3741411270 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7ff35c06ae40 0x7ff35c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:07.459 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:07.458+0000 7ff37affd640 1 --2- 172.21.15.73:0/3741411270 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7ff35c06ae40 0x7ff35c06d300 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7ff36c036000 tx=0x7ff36c03c040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:44:07.462 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:07.462+0000 7ff3737fe640 1 -- 172.21.15.73:0/3741411270 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7ff364054820 con 0x7ff37c0c5070 2023-12-12T09:44:07.661 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:07.660+0000 7ff381548640 1 -- 172.21.15.73:0/3741411270 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff37c1e7fc0 con 0x7ff37c0c5070 2023-12-12T09:44:07.664 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:07.663+0000 7ff3737fe640 1 -- 172.21.15.73:0/3741411270 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16517 (secure 0 0 0) 0x7ff37c1e7fc0 con 0x7ff37c0c5070 2023-12-12T09:44:07.664 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-12T09:44:07.665 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":21,"fsid":"ba240992-02b8-4c7e-92f2-27eb29ac433b","created":"2023-12-12T09:43:02.454719+0000","modified":"2023-12-12T09:43:23.219345+0000","last_up_change":"2023-12-12T09:43:13.913440+0000","last_in_change":"2023-12-12T09:43:05.925348+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-12T09:43:15.525508+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-12T09:43:20.004546+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-12T09:43:20.736500+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"dd9074be-dbe2-4c34-9896-a4223d8d3940","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":4047810203},{"type":"v1","addr":"172.21.15.73:6801","nonce":4047810203}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":4047810203},{"type":"v1","addr":"172.21.15.73:6803","nonce":4047810203}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":4047810203},{"type":"v1","addr":"172.21.15.73:6807","nonce":4047810203}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":4047810203},{"type":"v1","addr":"172.21.15.73:6805","nonce":4047810203}]},"public_addr":"172.21.15.73:6801/4047810203","cluster_addr":"172.21.15.73:6803/4047810203","heartbeat_back_addr":"172.21.15.73:6807/4047810203","heartbeat_front_addr":"172.21.15.73:6805/4047810203","state":["exists","up"]},{"osd":1,"uuid":"c4a05052-96d4-4758-a4e1-1a37f1e07fed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":1356058331},{"type":"v1","addr":"172.21.15.73:6824","nonce":1356058331}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":1356058331},{"type":"v1","addr":"172.21.15.73:6827","nonce":1356058331}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":1356058331},{"type":"v1","addr":"172.21.15.73:6831","nonce":1356058331}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":1356058331},{"type":"v1","addr":"172.21.15.73:6829","nonce":1356058331}]},"public_addr":"172.21.15.73:6824/1356058331","cluster_addr":"172.21.15.73:6827/1356058331","heartbeat_back_addr":"172.21.15.73:6831/1356058331","heartbeat_front_addr":"172.21.15.73:6829/1356058331","state":["exists","up"]},{"osd":2,"uuid":"512bc8ac-72c2-40d4-b3d2-d867a92c5213","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":1228903316},{"type":"v1","addr":"172.21.15.73:6817","nonce":1228903316}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":1228903316},{"type":"v1","addr":"172.21.15.73:6819","nonce":1228903316}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6823","nonce":1228903316},{"type":"v1","addr":"172.21.15.73:6825","nonce":1228903316}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":1228903316},{"type":"v1","addr":"172.21.15.73:6821","nonce":1228903316}]},"public_addr":"172.21.15.73:6817/1228903316","cluster_addr":"172.21.15.73:6819/1228903316","heartbeat_back_addr":"172.21.15.73:6825/1228903316","heartbeat_front_addr":"172.21.15.73:6821/1228903316","state":["exists","up"]},{"osd":3,"uuid":"3d1a91e0-42bf-437a-8eae-8d357c8f63a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":1293329670},{"type":"v1","addr":"172.21.15.73:6809","nonce":1293329670}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6810","nonce":1293329670},{"type":"v1","addr":"172.21.15.73:6811","nonce":1293329670}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":1293329670},{"type":"v1","addr":"172.21.15.73:6815","nonce":1293329670}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":1293329670},{"type":"v1","addr":"172.21.15.73:6813","nonce":1293329670}]},"public_addr":"172.21.15.73:6809/1293329670","cluster_addr":"172.21.15.73:6811/1293329670","heartbeat_back_addr":"172.21.15.73:6815/1293329670","heartbeat_front_addr":"172.21.15.73:6813/1293329670","state":["exists","up"]},{"osd":4,"uuid":"4b302fff-834c-4069-ac19-00e46f6c87b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":3727975702},{"type":"v1","addr":"172.21.15.142:6801","nonce":3727975702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":3727975702},{"type":"v1","addr":"172.21.15.142:6803","nonce":3727975702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6809","nonce":3727975702},{"type":"v1","addr":"172.21.15.142:6811","nonce":3727975702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6805","nonce":3727975702},{"type":"v1","addr":"172.21.15.142:6807","nonce":3727975702}]},"public_addr":"172.21.15.142:6801/3727975702","cluster_addr":"172.21.15.142:6803/3727975702","heartbeat_back_addr":"172.21.15.142:6811/3727975702","heartbeat_front_addr":"172.21.15.142:6807/3727975702","state":["exists","up"]},{"osd":5,"uuid":"d7cdace2-67d0-45cc-95f2-515cf6ef1b82","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6817","nonce":2353193632},{"type":"v1","addr":"172.21.15.142:6819","nonce":2353193632}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6821","nonce":2353193632},{"type":"v1","addr":"172.21.15.142:6823","nonce":2353193632}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6829","nonce":2353193632},{"type":"v1","addr":"172.21.15.142:6831","nonce":2353193632}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6825","nonce":2353193632},{"type":"v1","addr":"172.21.15.142:6827","nonce":2353193632}]},"public_addr":"172.21.15.142:6819/2353193632","cluster_addr":"172.21.15.142:6823/2353193632","heartbeat_back_addr":"172.21.15.142:6831/2353193632","heartbeat_front_addr":"172.21.15.142:6827/2353193632","state":["exists","up"]},{"osd":6,"uuid":"649ce78a-5626-445c-aedc-a651ed05a6f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":2006111986},{"type":"v1","addr":"172.21.15.142:6806","nonce":2006111986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":2006111986},{"type":"v1","addr":"172.21.15.142:6810","nonce":2006111986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":2006111986},{"type":"v1","addr":"172.21.15.142:6815","nonce":2006111986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":2006111986},{"type":"v1","addr":"172.21.15.142:6813","nonce":2006111986}]},"public_addr":"172.21.15.142:6806/2006111986","cluster_addr":"172.21.15.142:6810/2006111986","heartbeat_back_addr":"172.21.15.142:6815/2006111986","heartbeat_front_addr":"172.21.15.142:6813/2006111986","state":["exists","up"]},{"osd":7,"uuid":"af15ae3b-c1d0-4acf-92db-8a1805494d13","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":2573794341},{"type":"v1","addr":"172.21.15.142:6818","nonce":2573794341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":2573794341},{"type":"v1","addr":"172.21.15.142:6822","nonce":2573794341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":2573794341},{"type":"v1","addr":"172.21.15.142:6830","nonce":2573794341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":2573794341},{"type":"v1","addr":"172.21.15.142:6826","nonce":2573794341}]},"public_addr":"172.21.15.142:6818/2573794341","cluster_addr":"172.21.15.142:6822/2573794341","heartbeat_back_addr":"172.21.15.142:6830/2573794341","heartbeat_front_addr":"172.21.15.142:6826/2573794341","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.185824+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.262103+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.225556+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:10.523459+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:10.706035+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.257339+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.301776+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.051960+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-12T09:44:07.666 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:07.665+0000 7ff381548640 1 -- 172.21.15.73:0/3741411270 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7ff35c06ae40 msgr2=0x7ff35c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:07.667 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:07.665+0000 7ff381548640 1 --2- 172.21.15.73:0/3741411270 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7ff35c06ae40 0x7ff35c06d300 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7ff36c036000 tx=0x7ff36c03c040 comp rx=0 tx=0).stop 2023-12-12T09:44:07.667 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:07.665+0000 7ff381548640 1 -- 172.21.15.73:0/3741411270 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff37c0c5070 msgr2=0x7ff37c071870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:07.667 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:07.665+0000 7ff381548640 1 --2- 172.21.15.73:0/3741411270 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff37c0c5070 0x7ff37c071870 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7ff36400d600 tx=0x7ff36400dac0 comp rx=0 tx=0).stop 2023-12-12T09:44:07.667 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:07.665+0000 7ff381548640 1 -- 172.21.15.73:0/3741411270 shutdown_connections 2023-12-12T09:44:07.667 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:07.665+0000 7ff381548640 1 --2- 172.21.15.73:0/3741411270 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7ff35c06ae40 0x7ff35c06d300 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:07.667 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:07.665+0000 7ff381548640 1 --2- 172.21.15.73:0/3741411270 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff37c14fa40 0x7ff37c1dec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:07.667 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:07.665+0000 7ff381548640 1 --2- 172.21.15.73:0/3741411270 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff37c0c5070 0x7ff37c071870 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:07.667 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:07.665+0000 7ff381548640 1 --2- 172.21.15.73:0/3741411270 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff37c06db70 0x7ff37c1ebac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:07.667 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:07.666+0000 7ff381548640 1 -- 172.21.15.73:0/3741411270 >> 172.21.15.73:0/3741411270 conn(0x7ff37c0a8130 msgr2=0x7ff37c0c1d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:44:07.667 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:07.666+0000 7ff381548640 1 -- 172.21.15.73:0/3741411270 shutdown_connections 2023-12-12T09:44:07.667 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:07.666+0000 7ff381548640 1 -- 172.21.15.73:0/3741411270 wait complete. 2023-12-12T09:44:07.686 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-12-12T09:44:07.896 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:07.895+0000 7f7eed378640 1 Processor -- start 2023-12-12T09:44:07.896 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:07.895+0000 7f7eed378640 1 -- start start 2023-12-12T09:44:07.898 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:07.897+0000 7f7eed378640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f7ee806fca0 0x7f7ee8072700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:07.898 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:07.897+0000 7f7eed378640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ee8152560 con 0x7f7ee80c17e0 2023-12-12T09:44:07.898 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:07.897+0000 7f7eed378640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ee81532e0 con 0x7f7ee80c0420 2023-12-12T09:44:07.898 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:07.897+0000 7f7eed378640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ee8152ec0 con 0x7f7ee806fca0 2023-12-12T09:44:07.898 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:07.897+0000 7f7ee77fe640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f7ee80c17e0 0x7f7ee815ccd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:54628/0 (socket says 172.21.15.73:54628) 2023-12-12T09:44:07.898 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:07.897+0000 7f7ee77fe640 1 -- 172.21.15.73:0/1461065312 learned_addr learned my addr 172.21.15.73:0/1461065312 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-12T09:44:07.901 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:07.897+0000 7f7ee6ffd640 1 --2- 172.21.15.73:0/1461065312 >> v2:172.21.15.142:3300/0 conn(0x7f7ee806fca0 0x7f7ee8072700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:07.901 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:07.898+0000 7f7ee5ffb640 1 -- 172.21.15.73:0/1461065312 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 695099000 0 0) 0x7f7ee8152560 con 0x7f7ee80c17e0 2023-12-12T09:44:07.901 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:07.898+0000 7f7ee5ffb640 1 -- 172.21.15.73:0/1461065312 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7ed4003520 con 0x7f7ee80c17e0 2023-12-12T09:44:07.902 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:07.898+0000 7f7ee5ffb640 1 -- 172.21.15.73:0/1461065312 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1709392209 0 0) 0x7f7ed4003520 con 0x7f7ee80c17e0 2023-12-12T09:44:07.902 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:07.898+0000 7f7ee5ffb640 1 -- 172.21.15.73:0/1461065312 >> v2:172.21.15.142:3300/0 conn(0x7f7ee806fca0 msgr2=0x7f7ee8072700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:44:07.902 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:07.898+0000 7f7ee5ffb640 1 --2- 172.21.15.73:0/1461065312 >> v2:172.21.15.142:3300/0 conn(0x7f7ee806fca0 0x7f7ee8072700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:07.902 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:07.898+0000 7f7ee5ffb640 1 -- 172.21.15.73:0/1461065312 >> v1:172.21.15.142:6789/0 conn(0x7f7ee80c0420 legacy=0x7f7ee80c10d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:07.902 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:07.898+0000 7f7ee5ffb640 1 -- 172.21.15.73:0/1461065312 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ee8152800 con 0x7f7ee80c17e0 2023-12-12T09:44:07.902 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:07.898+0000 7f7ee5ffb640 1 -- 172.21.15.73:0/1461065312 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3186547832 0 0) 0x7f7ee00019f0 con 0x7f7ee80c17e0 2023-12-12T09:44:07.902 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:07.898+0000 7f7ee5ffb640 1 -- 172.21.15.73:0/1461065312 >> v1:172.21.15.73:6789/0 conn(0x7f7ee80c17e0 legacy=0x7f7ee815ccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:07.902 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:07.898+0000 7f7ee5ffb640 1 --2- 172.21.15.73:0/1461065312 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7ed40039c0 0x7f7ed4003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:07.902 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:07.898+0000 7f7ee5ffb640 1 --2- 172.21.15.73:0/1461065312 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7ed40047c0 0x7f7ed4004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:07.902 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:07.898+0000 7f7ee5ffb640 1 --2- 172.21.15.73:0/1461065312 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7ed40051d0 0x7f7ed400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:07.903 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:07.898+0000 7f7ee5ffb640 1 -- 172.21.15.73:0/1461065312 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ee8152ec0 con 0x7f7ed40039c0 2023-12-12T09:44:07.903 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:07.898+0000 7f7ee5ffb640 1 -- 172.21.15.73:0/1461065312 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ed400c120 con 0x7f7ed40051d0 2023-12-12T09:44:07.903 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:07.898+0000 7f7ee5ffb640 1 -- 172.21.15.73:0/1461065312 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ed400c2e0 con 0x7f7ed40047c0 2023-12-12T09:44:07.903 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:07.898+0000 7f7ee6ffd640 1 --2- 172.21.15.73:0/1461065312 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7ed40039c0 0x7f7ed4003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:07.903 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:07.899+0000 7f7ee67fc640 1 --2- 172.21.15.73:0/1461065312 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7ed40047c0 0x7f7ed4004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:07.903 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:07.899+0000 7f7ee77fe640 1 --2- 172.21.15.73:0/1461065312 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7ed40051d0 0x7f7ed400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:07.903 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:07.899+0000 7f7ee6ffd640 1 -- 172.21.15.73:0/1461065312 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7ed40047c0 msgr2=0x7f7ed4004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:44:07.903 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:07.899+0000 7f7ee6ffd640 1 --2- 172.21.15.73:0/1461065312 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7ed40047c0 0x7f7ed4004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:07.903 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:07.899+0000 7f7ee6ffd640 1 -- 172.21.15.73:0/1461065312 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7ed40051d0 msgr2=0x7f7ed400b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:44:07.903 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:07.899+0000 7f7ee6ffd640 1 --2- 172.21.15.73:0/1461065312 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7ed40051d0 0x7f7ed400b980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:07.903 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:07.899+0000 7f7ee6ffd640 1 -- 172.21.15.73:0/1461065312 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ed4003520 con 0x7f7ed40039c0 2023-12-12T09:44:07.903 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:07.899+0000 7f7ee77fe640 1 -- 172.21.15.73:0/1461065312 reap_dead start 2023-12-12T09:44:07.904 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:07.900+0000 7f7ee6ffd640 1 --2- 172.21.15.73:0/1461065312 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7ed40039c0 0x7f7ed4003de0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f7ed8009a90 tx=0x7f7ed40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1962974cc9ec7ef3 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:44:07.904 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:07.900+0000 7f7ee5ffb640 1 -- 172.21.15.73:0/1461065312 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ed802c680 con 0x7f7ed40039c0 2023-12-12T09:44:07.904 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:07.900+0000 7f7ee5ffb640 1 -- 172.21.15.73:0/1461065312 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ed802c7e0 con 0x7f7ed40039c0 2023-12-12T09:44:07.904 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:07.900+0000 7f7ee5ffb640 1 -- 172.21.15.73:0/1461065312 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ed802cb70 con 0x7f7ed40039c0 2023-12-12T09:44:07.907 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:07.901+0000 7f7eed378640 1 -- 172.21.15.73:0/1461065312 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7ed40039c0 msgr2=0x7f7ed4003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:07.907 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:07.901+0000 7f7eed378640 1 --2- 172.21.15.73:0/1461065312 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7ed40039c0 0x7f7ed4003de0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f7ed8009a90 tx=0x7f7ed40057f0 comp rx=0 tx=0).stop 2023-12-12T09:44:07.907 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:07.901+0000 7f7eed378640 1 -- 172.21.15.73:0/1461065312 shutdown_connections 2023-12-12T09:44:07.907 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:07.901+0000 7f7eed378640 1 --2- 172.21.15.73:0/1461065312 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7ed40039c0 0x7f7ed4003de0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:07.907 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:07.901+0000 7f7eed378640 1 -- 172.21.15.73:0/1461065312 >> 172.21.15.73:0/1461065312 conn(0x7f7ee80a77d0 msgr2=0x7f7ee80a7bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:44:07.907 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:07.901+0000 7f7eed378640 1 -- 172.21.15.73:0/1461065312 shutdown_connections 2023-12-12T09:44:07.907 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:07.901+0000 7f7eed378640 1 -- 172.21.15.73:0/1461065312 wait complete. 2023-12-12T09:44:07.907 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:07.903+0000 7f7eed378640 1 Processor -- start 2023-12-12T09:44:07.908 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:07.903+0000 7f7eed378640 1 -- start start 2023-12-12T09:44:07.908 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:07.904+0000 7f7eed378640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7ed40039c0 0x7f7ee8155ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:07.908 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:07.904+0000 7f7eed378640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7ee80a92d0 0x7f7ee81eb440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:07.908 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:07.904+0000 7f7eed378640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7ee8156410 0x7f7ee81eb980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:07.908 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:07.904+0000 7f7eed378640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ee80aa530 con 0x7f7ed40039c0 2023-12-12T09:44:07.908 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:07.904+0000 7f7eed378640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ee80aaa80 con 0x7f7ee80a92d0 2023-12-12T09:44:07.908 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:07.904+0000 7f7eed378640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ee80aad60 con 0x7f7ee8156410 2023-12-12T09:44:07.908 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:07.904+0000 7f7ee6ffd640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7ed40039c0 0x7f7ee8155ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:07.908 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:07.904+0000 7f7ee6ffd640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7ed40039c0 0x7f7ee8155ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:36390/0 (socket says 172.21.15.73:36390) 2023-12-12T09:44:07.908 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:07.904+0000 7f7ee6ffd640 1 -- 172.21.15.73:0/570572509 learned_addr learned my addr 172.21.15.73:0/570572509 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:44:07.908 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:07.905+0000 7f7ee77fe640 1 --2- 172.21.15.73:0/570572509 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7ee8156410 0x7f7ee81eb980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:07.908 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:07.905+0000 7f7ee67fc640 1 --2- 172.21.15.73:0/570572509 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7ee80a92d0 0x7f7ee81eb440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:07.908 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:07.905+0000 7f7ee6ffd640 1 -- 172.21.15.73:0/570572509 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7ee8156410 msgr2=0x7f7ee81eb980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:07.909 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:07.905+0000 7f7ee6ffd640 1 --2- 172.21.15.73:0/570572509 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7ee8156410 0x7f7ee81eb980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:07.909 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:07.905+0000 7f7ee6ffd640 1 -- 172.21.15.73:0/570572509 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7ee80a92d0 msgr2=0x7f7ee81eb440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:07.909 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:07.905+0000 7f7ee6ffd640 1 --2- 172.21.15.73:0/570572509 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7ee80a92d0 0x7f7ee81eb440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:07.909 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:07.905+0000 7f7ee6ffd640 1 -- 172.21.15.73:0/570572509 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ee80ab040 con 0x7f7ed40039c0 2023-12-12T09:44:07.909 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:07.905+0000 7f7ee6ffd640 1 --2- 172.21.15.73:0/570572509 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7ed40039c0 0x7f7ee8155ed0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f7ed8009a90 tx=0x7f7ed8004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:44:07.909 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:07.905+0000 7f7edf7fe640 1 -- 172.21.15.73:0/570572509 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ed8003810 con 0x7f7ed40039c0 2023-12-12T09:44:07.909 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:07.905+0000 7f7edf7fe640 1 -- 172.21.15.73:0/570572509 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ed8003970 con 0x7f7ed40039c0 2023-12-12T09:44:07.909 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:07.905+0000 7f7eed378640 1 -- 172.21.15.73:0/570572509 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ee80ab560 con 0x7f7ed40039c0 2023-12-12T09:44:07.909 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:07.905+0000 7f7edf7fe640 1 -- 172.21.15.73:0/570572509 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ed8003d00 con 0x7f7ed40039c0 2023-12-12T09:44:07.909 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:07.905+0000 7f7eed378640 1 -- 172.21.15.73:0/570572509 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ee814cbf0 con 0x7f7ed40039c0 2023-12-12T09:44:07.910 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:07.907+0000 7f7eed378640 1 -- 172.21.15.73:0/570572509 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ee80ab1d0 con 0x7f7ed40039c0 2023-12-12T09:44:07.910 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:07.908+0000 7f7edf7fe640 1 -- 172.21.15.73:0/570572509 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f7ed8040450 con 0x7f7ed40039c0 2023-12-12T09:44:07.910 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:07.908+0000 7f7edf7fe640 1 --2- 172.21.15.73:0/570572509 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f7ec806ae70 0x7f7ec806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:07.910 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:07.909+0000 7f7edf7fe640 1 -- 172.21.15.73:0/570572509 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7ed80ab440 con 0x7f7ed40039c0 2023-12-12T09:44:07.911 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:07.909+0000 7f7ee67fc640 1 --2- 172.21.15.73:0/570572509 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f7ec806ae70 0x7f7ec806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:07.911 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:07.909+0000 7f7ee67fc640 1 --2- 172.21.15.73:0/570572509 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f7ec806ae70 0x7f7ec806d330 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f7ee81ec500 tx=0x7f7ed0009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:44:07.914 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:07.913+0000 7f7edf7fe640 1 -- 172.21.15.73:0/570572509 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f7ed8076580 con 0x7f7ed40039c0 2023-12-12T09:44:08.143 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:08.142+0000 7f7eed378640 1 -- 172.21.15.73:0/570572509 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f7ee8067580 con 0x7f7ed40039c0 2023-12-12T09:44:08.144 INFO:tasks.ceph.mon.a.smithi073.stderr:2023-12-12T09:44:08.143+0000 7f81027f3640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-12-12T09:44:08.148 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:08.147+0000 7f7edf7fe640 1 -- 172.21.15.73:0/570572509 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v9) v1 ==== 161+0+0 (secure 0 0 0) 0x7f7ed8003e60 con 0x7f7ed40039c0 2023-12-12T09:44:08.148 INFO:teuthology.orchestra.run.smithi073.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-12-12T09:44:08.152 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:08.150+0000 7f7eed378640 1 -- 172.21.15.73:0/570572509 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f7ec806ae70 msgr2=0x7f7ec806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:08.152 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:08.150+0000 7f7eed378640 1 --2- 172.21.15.73:0/570572509 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f7ec806ae70 0x7f7ec806d330 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f7ee81ec500 tx=0x7f7ed0009040 comp rx=0 tx=0).stop 2023-12-12T09:44:08.152 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:08.150+0000 7f7eed378640 1 -- 172.21.15.73:0/570572509 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7ed40039c0 msgr2=0x7f7ee8155ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:08.152 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:08.150+0000 7f7eed378640 1 --2- 172.21.15.73:0/570572509 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7ed40039c0 0x7f7ee8155ed0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f7ed8009a90 tx=0x7f7ed8004730 comp rx=0 tx=0).stop 2023-12-12T09:44:08.152 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:08.151+0000 7f7eed378640 1 -- 172.21.15.73:0/570572509 shutdown_connections 2023-12-12T09:44:08.152 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:08.151+0000 7f7eed378640 1 --2- 172.21.15.73:0/570572509 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f7ec806ae70 0x7f7ec806d330 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:08.152 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:08.151+0000 7f7eed378640 1 --2- 172.21.15.73:0/570572509 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7ee8156410 0x7f7ee81eb980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:08.152 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:08.151+0000 7f7eed378640 1 --2- 172.21.15.73:0/570572509 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7ee80a92d0 0x7f7ee81eb440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:08.152 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:08.151+0000 7f7eed378640 1 --2- 172.21.15.73:0/570572509 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7ed40039c0 0x7f7ee8155ed0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:08.152 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:08.151+0000 7f7eed378640 1 -- 172.21.15.73:0/570572509 >> 172.21.15.73:0/570572509 conn(0x7f7ee80a77d0 msgr2=0x7f7ee8150aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:44:08.153 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:08.151+0000 7f7eed378640 1 -- 172.21.15.73:0/570572509 shutdown_connections 2023-12-12T09:44:08.153 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:08.152+0000 7f7eed378640 1 -- 172.21.15.73:0/570572509 wait complete. 2023-12-12T09:44:08.179 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-12-12T09:44:08.187 INFO:tasks.ceph.mds.d.smithi142.stderr: -5819> 2023-12-12T09:43:25.796+0000 7fc3396ea640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-12-12T09:44:08.270 INFO:tasks.ceph.mds.d.smithi142.stdout:starting mds.d at 2023-12-12T09:44:08.378 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:08.377+0000 7f0579a61640 1 Processor -- start 2023-12-12T09:44:08.378 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:08.377+0000 7f0579a61640 1 -- start start 2023-12-12T09:44:08.385 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:08.378+0000 7f0579a61640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f057406d350 0x7f057406dc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:08.385 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:08.378+0000 7f0579a61640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05740c16c0 con 0x7f057414f8c0 2023-12-12T09:44:08.385 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:08.378+0000 7f0579a61640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05740c19a0 con 0x7f0574152500 2023-12-12T09:44:08.385 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:08.378+0000 7f0579a61640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05740c1090 con 0x7f057406d350 2023-12-12T09:44:08.385 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:08.379+0000 7f0572ffd640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f057414f8c0 0x7f0574071e60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:54638/0 (socket says 172.21.15.73:54638) 2023-12-12T09:44:08.385 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:08.379+0000 7f0572ffd640 1 -- 172.21.15.73:0/2221232943 learned_addr learned my addr 172.21.15.73:0/2221232943 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-12T09:44:08.386 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:08.379+0000 7f0571ffb640 1 -- 172.21.15.73:0/2221232943 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2628627105 0 0) 0x7f05740c16c0 con 0x7f057414f8c0 2023-12-12T09:44:08.386 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:08.379+0000 7f0571ffb640 1 -- 172.21.15.73:0/2221232943 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f055c003520 con 0x7f057414f8c0 2023-12-12T09:44:08.386 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:08.379+0000 7f05727fc640 1 --2- 172.21.15.73:0/2221232943 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f057406d350 0x7f057406dc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:08.386 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:08.379+0000 7f0571ffb640 1 -- 172.21.15.73:0/2221232943 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 948856333 0 0) 0x7f055c003520 con 0x7f057414f8c0 2023-12-12T09:44:08.386 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:08.379+0000 7f0571ffb640 1 -- 172.21.15.73:0/2221232943 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f057406d350 msgr2=0x7f057406dc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:44:08.386 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:08.379+0000 7f0571ffb640 1 --2- 172.21.15.73:0/2221232943 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f057406d350 0x7f057406dc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:08.387 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:08.379+0000 7f0571ffb640 1 -- 172.21.15.73:0/2221232943 >> v1:172.21.15.142:6789/0 conn(0x7f0574152500 legacy=0x7f0574152990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:08.387 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:08.379+0000 7f0571ffb640 1 -- 172.21.15.73:0/2221232943 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05740c1c80 con 0x7f057414f8c0 2023-12-12T09:44:08.387 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:08.379+0000 7f0571ffb640 1 -- 172.21.15.73:0/2221232943 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3186547832 0 0) 0x7f0568001670 con 0x7f057414f8c0 2023-12-12T09:44:08.387 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:08.379+0000 7f0571ffb640 1 -- 172.21.15.73:0/2221232943 >> v1:172.21.15.73:6789/0 conn(0x7f057414f8c0 legacy=0x7f0574071e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:08.387 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:08.380+0000 7f0571ffb640 1 --2- 172.21.15.73:0/2221232943 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f055c0039a0 0x7f055c003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:08.388 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:08.380+0000 7f0571ffb640 1 --2- 172.21.15.73:0/2221232943 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f057406d350 0x7f055c0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:08.388 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:08.380+0000 7f0571ffb640 1 --2- 172.21.15.73:0/2221232943 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f055c004dd0 0x7f055c005250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:08.388 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:08.380+0000 7f0571ffb640 1 -- 172.21.15.73:0/2221232943 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f055c00bbb0 con 0x7f055c004dd0 2023-12-12T09:44:08.388 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:08.380+0000 7f0571ffb640 1 -- 172.21.15.73:0/2221232943 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f055c00bd20 con 0x7f055c0039a0 2023-12-12T09:44:08.388 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:08.380+0000 7f0571ffb640 1 -- 172.21.15.73:0/2221232943 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f055c00bee0 con 0x7f057406d350 2023-12-12T09:44:08.388 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:08.380+0000 7f05737fe640 1 --2- 172.21.15.73:0/2221232943 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f055c004dd0 0x7f055c005250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:08.389 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:08.380+0000 7f0572ffd640 1 --2- 172.21.15.73:0/2221232943 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f055c0039a0 0x7f055c003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:08.389 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:08.380+0000 7f05737fe640 1 -- 172.21.15.73:0/2221232943 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f057406d350 msgr2=0x7f055c0047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:44:08.389 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:08.380+0000 7f05737fe640 1 --2- 172.21.15.73:0/2221232943 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f057406d350 0x7f055c0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:08.389 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:08.380+0000 7f05737fe640 1 -- 172.21.15.73:0/2221232943 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f055c0039a0 msgr2=0x7f055c003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:44:08.389 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:08.380+0000 7f05737fe640 1 --2- 172.21.15.73:0/2221232943 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f055c0039a0 0x7f055c003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:08.389 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:08.380+0000 7f05737fe640 1 -- 172.21.15.73:0/2221232943 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f055c003520 con 0x7f055c004dd0 2023-12-12T09:44:08.390 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:08.381+0000 7f05737fe640 1 --2- 172.21.15.73:0/2221232943 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f055c004dd0 0x7f055c005250 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f056c001e50 tx=0x7f055c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d14904ef5ca562e5 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:44:08.390 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:08.382+0000 7f0571ffb640 1 -- 172.21.15.73:0/2221232943 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f056c003b70 con 0x7f055c004dd0 2023-12-12T09:44:08.390 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:08.382+0000 7f0571ffb640 1 -- 172.21.15.73:0/2221232943 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f056c003cd0 con 0x7f055c004dd0 2023-12-12T09:44:08.390 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:08.382+0000 7f0571ffb640 1 -- 172.21.15.73:0/2221232943 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f056c005310 con 0x7f055c004dd0 2023-12-12T09:44:08.390 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:08.382+0000 7f0579a61640 1 -- 172.21.15.73:0/2221232943 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f055c004dd0 msgr2=0x7f055c005250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:08.390 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:08.382+0000 7f0579a61640 1 --2- 172.21.15.73:0/2221232943 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f055c004dd0 0x7f055c005250 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f056c001e50 tx=0x7f055c0057f0 comp rx=0 tx=0).stop 2023-12-12T09:44:08.391 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:08.382+0000 7f05737fe640 1 -- 172.21.15.73:0/2221232943 reap_dead start 2023-12-12T09:44:08.391 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:08.382+0000 7f0579a61640 1 -- 172.21.15.73:0/2221232943 shutdown_connections 2023-12-12T09:44:08.391 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:08.382+0000 7f0579a61640 1 -- 172.21.15.73:0/2221232943 >> 172.21.15.73:0/2221232943 conn(0x7f057406a4e0 msgr2=0x7f057406a8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:44:08.391 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:08.382+0000 7f0579a61640 1 -- 172.21.15.73:0/2221232943 shutdown_connections 2023-12-12T09:44:08.391 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:08.382+0000 7f0579a61640 1 -- 172.21.15.73:0/2221232943 wait complete. 2023-12-12T09:44:08.397 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:08.384+0000 7f0579a61640 1 Processor -- start 2023-12-12T09:44:08.397 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:08.384+0000 7f0579a61640 1 -- start start 2023-12-12T09:44:08.397 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:08.385+0000 7f0579a61640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f055c004dd0 0x7f05741449c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:08.397 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:08.385+0000 7f0579a61640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0574153780 0x7f05741ed6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:08.397 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:08.385+0000 7f0579a61640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0574148540 0x7f05741edbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:08.397 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:08.385+0000 7f0579a61640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05740ab300 con 0x7f0574148540 2023-12-12T09:44:08.397 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:08.385+0000 7f0579a61640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0574148db0 con 0x7f055c004dd0 2023-12-12T09:44:08.397 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:08.385+0000 7f0579a61640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05740723e0 con 0x7f0574153780 2023-12-12T09:44:08.397 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:08.386+0000 7f05737fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0574148540 0x7f05741edbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:08.397 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:08.386+0000 7f05737fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0574148540 0x7f05741edbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:36414/0 (socket says 172.21.15.73:36414) 2023-12-12T09:44:08.397 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:08.386+0000 7f05737fe640 1 -- 172.21.15.73:0/2646281862 learned_addr learned my addr 172.21.15.73:0/2646281862 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:44:08.398 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:08.386+0000 7f0572ffd640 1 --2- 172.21.15.73:0/2646281862 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f055c004dd0 0x7f05741449c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:08.398 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:08.386+0000 7f05727fc640 1 --2- 172.21.15.73:0/2646281862 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0574153780 0x7f05741ed6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:08.398 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:08.386+0000 7f05737fe640 1 -- 172.21.15.73:0/2646281862 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0574153780 msgr2=0x7f05741ed6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:08.398 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:08.386+0000 7f05737fe640 1 --2- 172.21.15.73:0/2646281862 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0574153780 0x7f05741ed6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:08.398 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:08.386+0000 7f05737fe640 1 -- 172.21.15.73:0/2646281862 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f055c004dd0 msgr2=0x7f05741449c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:08.398 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:08.386+0000 7f05737fe640 1 --2- 172.21.15.73:0/2646281862 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f055c004dd0 0x7f05741449c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:08.398 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:08.386+0000 7f05737fe640 1 -- 172.21.15.73:0/2646281862 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05740ab660 con 0x7f0574148540 2023-12-12T09:44:08.398 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:08.386+0000 7f0572ffd640 1 --2- 172.21.15.73:0/2646281862 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f055c004dd0 0x7f05741449c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:44:08.398 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:08.386+0000 7f05727fc640 1 --2- 172.21.15.73:0/2646281862 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0574153780 0x7f05741ed6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:44:08.398 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:08.386+0000 7f05737fe640 1 --2- 172.21.15.73:0/2646281862 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0574148540 0x7f05741edbf0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f056c001f70 tx=0x7f056c0014a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:44:08.398 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:08.387+0000 7f055bfff640 1 -- 172.21.15.73:0/2646281862 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f056c03e070 con 0x7f0574148540 2023-12-12T09:44:08.398 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:08.387+0000 7f055bfff640 1 -- 172.21.15.73:0/2646281862 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f056c003e40 con 0x7f0574148540 2023-12-12T09:44:08.398 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:08.387+0000 7f055bfff640 1 -- 172.21.15.73:0/2646281862 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f056c006d50 con 0x7f0574148540 2023-12-12T09:44:08.398 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:08.387+0000 7f0579a61640 1 -- 172.21.15.73:0/2646281862 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0574071f50 con 0x7f0574148540 2023-12-12T09:44:08.399 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:08.387+0000 7f0579a61640 1 -- 172.21.15.73:0/2646281862 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05740ab8b0 con 0x7f0574148540 2023-12-12T09:44:08.399 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:08.388+0000 7f0579a61640 1 -- 172.21.15.73:0/2646281862 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05740720e0 con 0x7f0574148540 2023-12-12T09:44:08.399 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:08.389+0000 7f055bfff640 1 -- 172.21.15.73:0/2646281862 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f056c007030 con 0x7f0574148540 2023-12-12T09:44:08.399 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:08.390+0000 7f055bfff640 1 --2- 172.21.15.73:0/2646281862 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f056006ae40 0x7f056006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:08.399 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:08.390+0000 7f055bfff640 1 -- 172.21.15.73:0/2646281862 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5940+0+0 (secure 0 0 0) 0x7f056c0aa9c0 con 0x7f0574148540 2023-12-12T09:44:08.399 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:08.390+0000 7f0572ffd640 1 --2- 172.21.15.73:0/2646281862 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f056006ae40 0x7f056006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:08.399 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:08.391+0000 7f0572ffd640 1 --2- 172.21.15.73:0/2646281862 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f056006ae40 0x7f056006d300 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f0568001eb0 tx=0x7f0568000f90 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:44:08.399 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:08.394+0000 7f055bfff640 1 -- 172.21.15.73:0/2646281862 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f056c075970 con 0x7f0574148540 2023-12-12T09:44:08.629 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:08.628+0000 7f0579a61640 1 -- 172.21.15.73:0/2646281862 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f0574067070 con 0x7f0574148540 2023-12-12T09:44:09.168 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:09.166+0000 7f055bfff640 1 -- 172.21.15.73:0/2646281862 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v10) v1 ==== 104+0+0 (secure 0 0 0) 0x7f056c0480a0 con 0x7f0574148540 2023-12-12T09:44:09.172 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:09.171+0000 7f0579a61640 1 -- 172.21.15.73:0/2646281862 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f056006ae40 msgr2=0x7f056006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:09.172 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:09.171+0000 7f0579a61640 1 --2- 172.21.15.73:0/2646281862 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f056006ae40 0x7f056006d300 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f0568001eb0 tx=0x7f0568000f90 comp rx=0 tx=0).stop 2023-12-12T09:44:09.172 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:09.171+0000 7f0579a61640 1 -- 172.21.15.73:0/2646281862 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0574148540 msgr2=0x7f05741edbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:09.172 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:09.171+0000 7f0579a61640 1 --2- 172.21.15.73:0/2646281862 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0574148540 0x7f05741edbf0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f056c001f70 tx=0x7f056c0014a0 comp rx=0 tx=0).stop 2023-12-12T09:44:09.173 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:09.172+0000 7f0579a61640 1 -- 172.21.15.73:0/2646281862 shutdown_connections 2023-12-12T09:44:09.173 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:09.172+0000 7f0579a61640 1 --2- 172.21.15.73:0/2646281862 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f056006ae40 0x7f056006d300 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:09.173 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:09.172+0000 7f0579a61640 1 --2- 172.21.15.73:0/2646281862 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0574148540 0x7f05741edbf0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:09.173 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:09.172+0000 7f0579a61640 1 --2- 172.21.15.73:0/2646281862 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0574153780 0x7f05741ed6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:09.173 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:09.172+0000 7f0579a61640 1 --2- 172.21.15.73:0/2646281862 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f055c004dd0 0x7f05741449c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:09.173 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:09.172+0000 7f0579a61640 1 -- 172.21.15.73:0/2646281862 >> 172.21.15.73:0/2646281862 conn(0x7f057406a4e0 msgr2=0x7f057406a8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:44:09.173 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:09.172+0000 7f0579a61640 1 -- 172.21.15.73:0/2646281862 shutdown_connections 2023-12-12T09:44:09.173 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:09.172+0000 7f0579a61640 1 -- 172.21.15.73:0/2646281862 wait complete. 2023-12-12T09:44:09.195 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-12-12T09:44:09.387 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:09.386+0000 7fab5d410640 1 Processor -- start 2023-12-12T09:44:09.388 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:09.386+0000 7fab5d410640 1 -- start start 2023-12-12T09:44:09.389 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:09.388+0000 7fab5d410640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fab580c53e0 0x7fab580c7d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:09.389 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:09.388+0000 7fab5d410640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab5806a6b0 con 0x7fab580c5ba0 2023-12-12T09:44:09.389 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:09.388+0000 7fab5d410640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab5806a990 con 0x7fab580c4a20 2023-12-12T09:44:09.389 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:09.388+0000 7fab5d410640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab580c6580 con 0x7fab580c53e0 2023-12-12T09:44:09.389 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:09.388+0000 7fab577fe640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7fab580c5ba0 0x7fab58151930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:33210/0 (socket says 172.21.15.73:33210) 2023-12-12T09:44:09.389 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:09.388+0000 7fab577fe640 1 -- 172.21.15.73:0/1214017875 learned_addr learned my addr 172.21.15.73:0/1214017875 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-12T09:44:09.391 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:09.389+0000 7fab567fc640 1 --2- 172.21.15.73:0/1214017875 >> v2:172.21.15.142:3300/0 conn(0x7fab580c53e0 0x7fab580c7d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:09.391 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:09.389+0000 7fab55ffb640 1 -- 172.21.15.73:0/1214017875 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1171179542 0 0) 0x7fab5806a6b0 con 0x7fab580c5ba0 2023-12-12T09:44:09.391 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:09.389+0000 7fab55ffb640 1 -- 172.21.15.73:0/1214017875 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fab44003520 con 0x7fab580c5ba0 2023-12-12T09:44:09.391 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:09.389+0000 7fab55ffb640 1 -- 172.21.15.73:0/1214017875 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 106432920 0 0) 0x7fab44003520 con 0x7fab580c5ba0 2023-12-12T09:44:09.391 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:09.389+0000 7fab55ffb640 1 -- 172.21.15.73:0/1214017875 >> v2:172.21.15.142:3300/0 conn(0x7fab580c53e0 msgr2=0x7fab580c7d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:44:09.392 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:09.389+0000 7fab55ffb640 1 --2- 172.21.15.73:0/1214017875 >> v2:172.21.15.142:3300/0 conn(0x7fab580c53e0 0x7fab580c7d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:09.392 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:09.389+0000 7fab55ffb640 1 -- 172.21.15.73:0/1214017875 >> v1:172.21.15.142:6789/0 conn(0x7fab580c4a20 legacy=0x7fab5806ae20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:09.392 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:09.389+0000 7fab55ffb640 1 -- 172.21.15.73:0/1214017875 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab581584c0 con 0x7fab580c5ba0 2023-12-12T09:44:09.392 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:09.389+0000 7fab55ffb640 1 -- 172.21.15.73:0/1214017875 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3186547832 0 0) 0x7fab50001670 con 0x7fab580c5ba0 2023-12-12T09:44:09.392 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:09.389+0000 7fab55ffb640 1 -- 172.21.15.73:0/1214017875 >> v1:172.21.15.73:6789/0 conn(0x7fab580c5ba0 legacy=0x7fab58151930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:09.392 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:09.389+0000 7fab55ffb640 1 --2- 172.21.15.73:0/1214017875 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fab440039c0 0x7fab44003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:09.392 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:09.389+0000 7fab55ffb640 1 --2- 172.21.15.73:0/1214017875 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fab440047c0 0x7fab44004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:09.392 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:09.389+0000 7fab55ffb640 1 --2- 172.21.15.73:0/1214017875 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fab440051d0 0x7fab4400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:09.392 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:09.389+0000 7fab55ffb640 1 -- 172.21.15.73:0/1214017875 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab580c6580 con 0x7fab440051d0 2023-12-12T09:44:09.392 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:09.389+0000 7fab55ffb640 1 -- 172.21.15.73:0/1214017875 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab4400c120 con 0x7fab440047c0 2023-12-12T09:44:09.392 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:09.389+0000 7fab55ffb640 1 -- 172.21.15.73:0/1214017875 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab4400c2e0 con 0x7fab440039c0 2023-12-12T09:44:09.392 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:09.389+0000 7fab577fe640 1 --2- 172.21.15.73:0/1214017875 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fab440051d0 0x7fab4400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:09.392 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:09.390+0000 7fab567fc640 1 --2- 172.21.15.73:0/1214017875 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fab440047c0 0x7fab44004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:09.392 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:09.390+0000 7fab56ffd640 1 --2- 172.21.15.73:0/1214017875 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fab440039c0 0x7fab44003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:09.392 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:09.390+0000 7fab577fe640 1 -- 172.21.15.73:0/1214017875 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fab440039c0 msgr2=0x7fab44003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:44:09.393 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:09.390+0000 7fab577fe640 1 --2- 172.21.15.73:0/1214017875 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fab440039c0 0x7fab44003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:09.393 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:09.390+0000 7fab577fe640 1 -- 172.21.15.73:0/1214017875 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fab440047c0 msgr2=0x7fab44004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:44:09.393 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:09.390+0000 7fab577fe640 1 --2- 172.21.15.73:0/1214017875 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fab440047c0 0x7fab44004c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:09.393 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:09.390+0000 7fab577fe640 1 -- 172.21.15.73:0/1214017875 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab44003520 con 0x7fab440051d0 2023-12-12T09:44:09.393 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:09.390+0000 7fab56ffd640 1 --2- 172.21.15.73:0/1214017875 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fab440039c0 0x7fab44003de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:44:09.394 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:09.391+0000 7fab577fe640 1 -- 172.21.15.73:0/1214017875 reap_dead start 2023-12-12T09:44:09.394 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:09.391+0000 7fab577fe640 1 --2- 172.21.15.73:0/1214017875 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fab440051d0 0x7fab4400b980 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fab5000c0e0 tx=0x7fab440057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0f06dd32db57aad server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:44:09.394 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:09.391+0000 7fab55ffb640 1 -- 172.21.15.73:0/1214017875 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab50005ad0 con 0x7fab440051d0 2023-12-12T09:44:09.394 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:09.391+0000 7fab55ffb640 1 -- 172.21.15.73:0/1214017875 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab50005c50 con 0x7fab440051d0 2023-12-12T09:44:09.395 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:09.391+0000 7fab55ffb640 1 -- 172.21.15.73:0/1214017875 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab5002c7e0 con 0x7fab440051d0 2023-12-12T09:44:09.395 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:09.392+0000 7fab5d410640 1 -- 172.21.15.73:0/1214017875 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fab440051d0 msgr2=0x7fab4400b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:09.395 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:09.392+0000 7fab5d410640 1 --2- 172.21.15.73:0/1214017875 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fab440051d0 0x7fab4400b980 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fab5000c0e0 tx=0x7fab440057f0 comp rx=0 tx=0).stop 2023-12-12T09:44:09.395 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:09.392+0000 7fab5d410640 1 -- 172.21.15.73:0/1214017875 shutdown_connections 2023-12-12T09:44:09.395 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:09.392+0000 7fab5d410640 1 --2- 172.21.15.73:0/1214017875 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fab440051d0 0x7fab4400b980 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:09.395 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:09.392+0000 7fab5d410640 1 -- 172.21.15.73:0/1214017875 >> 172.21.15.73:0/1214017875 conn(0x7fab580c9e30 msgr2=0x7fab580ca240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:44:09.395 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:09.392+0000 7fab5d410640 1 -- 172.21.15.73:0/1214017875 shutdown_connections 2023-12-12T09:44:09.395 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:09.392+0000 7fab5d410640 1 -- 172.21.15.73:0/1214017875 wait complete. 2023-12-12T09:44:09.395 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:09.393+0000 7fab5d410640 1 Processor -- start 2023-12-12T09:44:09.395 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:09.393+0000 7fab5d410640 1 -- start start 2023-12-12T09:44:09.397 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:09.394+0000 7fab5d410640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fab440051d0 0x7fab58156ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:09.397 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:09.394+0000 7fab5d410640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fab580c0f00 0x7fab580c28f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:09.397 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:09.394+0000 7fab5d410640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fab580c2e30 0x7fab581ecdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:09.397 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:09.394+0000 7fab5d410640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab581e9630 con 0x7fab580c2e30 2023-12-12T09:44:09.397 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:09.394+0000 7fab5d410640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab580c32b0 con 0x7fab580c0f00 2023-12-12T09:44:09.397 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:09.394+0000 7fab5d410640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab581e98f0 con 0x7fab440051d0 2023-12-12T09:44:09.397 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:09.395+0000 7fab577fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fab580c2e30 0x7fab581ecdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:09.397 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:09.395+0000 7fab577fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fab580c2e30 0x7fab581ecdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:49246/0 (socket says 172.21.15.73:49246) 2023-12-12T09:44:09.397 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:09.395+0000 7fab577fe640 1 -- 172.21.15.73:0/168993928 learned_addr learned my addr 172.21.15.73:0/168993928 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:44:09.397 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:09.395+0000 7fab577fe640 1 -- 172.21.15.73:0/168993928 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fab440051d0 msgr2=0x7fab58156ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:09.397 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:09.395+0000 7fab577fe640 1 --2- 172.21.15.73:0/168993928 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fab440051d0 0x7fab58156ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:09.398 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:09.395+0000 7fab577fe640 1 -- 172.21.15.73:0/168993928 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fab580c0f00 msgr2=0x7fab580c28f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:09.398 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:09.395+0000 7fab567fc640 1 --2- 172.21.15.73:0/168993928 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fab580c0f00 0x7fab580c28f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:09.398 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:09.395+0000 7fab577fe640 1 --2- 172.21.15.73:0/168993928 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fab580c0f00 0x7fab580c28f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:09.398 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:09.395+0000 7fab577fe640 1 -- 172.21.15.73:0/168993928 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab581e9bd0 con 0x7fab580c2e30 2023-12-12T09:44:09.398 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:09.395+0000 7fab577fe640 1 --2- 172.21.15.73:0/168993928 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fab580c2e30 0x7fab581ecdc0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fab5000c0e0 tx=0x7fab581554f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:44:09.398 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:09.395+0000 7fab4f7fe640 1 -- 172.21.15.73:0/168993928 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab50000ed0 con 0x7fab580c2e30 2023-12-12T09:44:09.398 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:09.395+0000 7fab4f7fe640 1 -- 172.21.15.73:0/168993928 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab500047e0 con 0x7fab580c2e30 2023-12-12T09:44:09.398 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:09.395+0000 7fab4f7fe640 1 -- 172.21.15.73:0/168993928 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab50004b70 con 0x7fab580c2e30 2023-12-12T09:44:09.398 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:09.396+0000 7fab5d410640 1 -- 172.21.15.73:0/168993928 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab581e9eb0 con 0x7fab580c2e30 2023-12-12T09:44:09.398 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:09.396+0000 7fab5d410640 1 -- 172.21.15.73:0/168993928 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab581ea470 con 0x7fab580c2e30 2023-12-12T09:44:09.399 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:09.397+0000 7fab5d410640 1 -- 172.21.15.73:0/168993928 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab581ea600 con 0x7fab580c2e30 2023-12-12T09:44:09.399 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:09.398+0000 7fab4f7fe640 1 -- 172.21.15.73:0/168993928 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fab50032070 con 0x7fab580c2e30 2023-12-12T09:44:09.399 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:09.399+0000 7fab4f7fe640 1 --2- 172.21.15.73:0/168993928 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fab3806ae40 0x7fab3806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:09.400 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:09.399+0000 7fab4f7fe640 1 -- 172.21.15.73:0/168993928 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5940+0+0 (secure 0 0 0) 0x7fab5003c070 con 0x7fab580c2e30 2023-12-12T09:44:09.400 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:09.399+0000 7fab56ffd640 1 --2- 172.21.15.73:0/168993928 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fab3806ae40 0x7fab3806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:09.400 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:09.400+0000 7fab56ffd640 1 --2- 172.21.15.73:0/168993928 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fab3806ae40 0x7fab3806d300 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fab580c0cb0 tx=0x7fab48009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:44:09.404 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:09.403+0000 7fab4f7fe640 1 -- 172.21.15.73:0/168993928 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fab500750e0 con 0x7fab580c2e30 2023-12-12T09:44:09.599 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:09.598+0000 7fab5d410640 1 -- 172.21.15.73:0/168993928 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fab58067580 con 0x7fab580c2e30 2023-12-12T09:44:10.377 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:10.375+0000 7fab4f7fe640 1 -- 172.21.15.73:0/168993928 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v24) v1 ==== 181+0+0 (secure 0 0 0) 0x7fab50078700 con 0x7fab580c2e30 2023-12-12T09:44:10.377 INFO:teuthology.orchestra.run.smithi073.stderr:pool 'cephfs_metadata' removed 2023-12-12T09:44:10.381 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:10.380+0000 7fab5d410640 1 -- 172.21.15.73:0/168993928 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fab3806ae40 msgr2=0x7fab3806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:10.381 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:10.380+0000 7fab5d410640 1 --2- 172.21.15.73:0/168993928 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fab3806ae40 0x7fab3806d300 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fab580c0cb0 tx=0x7fab48009040 comp rx=0 tx=0).stop 2023-12-12T09:44:10.381 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:10.380+0000 7fab5d410640 1 -- 172.21.15.73:0/168993928 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fab580c2e30 msgr2=0x7fab581ecdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:10.381 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:10.380+0000 7fab5d410640 1 --2- 172.21.15.73:0/168993928 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fab580c2e30 0x7fab581ecdc0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fab5000c0e0 tx=0x7fab581554f0 comp rx=0 tx=0).stop 2023-12-12T09:44:10.382 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:10.381+0000 7fab5d410640 1 -- 172.21.15.73:0/168993928 shutdown_connections 2023-12-12T09:44:10.382 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:10.381+0000 7fab5d410640 1 --2- 172.21.15.73:0/168993928 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fab3806ae40 0x7fab3806d300 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:10.382 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:10.381+0000 7fab5d410640 1 --2- 172.21.15.73:0/168993928 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fab580c2e30 0x7fab581ecdc0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:10.382 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:10.381+0000 7fab5d410640 1 --2- 172.21.15.73:0/168993928 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fab580c0f00 0x7fab580c28f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:10.382 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:10.381+0000 7fab5d410640 1 --2- 172.21.15.73:0/168993928 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fab440051d0 0x7fab58156ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:10.382 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:10.381+0000 7fab5d410640 1 -- 172.21.15.73:0/168993928 >> 172.21.15.73:0/168993928 conn(0x7fab580c9e30 msgr2=0x7fab580ca210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:44:10.383 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:10.381+0000 7fab5d410640 1 -- 172.21.15.73:0/168993928 shutdown_connections 2023-12-12T09:44:10.383 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:10.381+0000 7fab5d410640 1 -- 172.21.15.73:0/168993928 wait complete. 2023-12-12T09:44:10.405 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-12-12T09:44:10.620 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:10.619+0000 7ff9d0943640 1 Processor -- start 2023-12-12T09:44:10.620 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:10.619+0000 7ff9d0943640 1 -- start start 2023-12-12T09:44:10.621 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:10.621+0000 7ff9d0943640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7ff9cc06d350 0x7ff9cc06dc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:10.622 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:10.621+0000 7ff9d0943640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9cc0c16c0 con 0x7ff9cc152500 2023-12-12T09:44:10.622 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:10.621+0000 7ff9d0943640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9cc0c19a0 con 0x7ff9cc14f8c0 2023-12-12T09:44:10.622 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:10.621+0000 7ff9d0943640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9cc0c1090 con 0x7ff9cc06d350 2023-12-12T09:44:10.623 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:10.621+0000 7ff9c1d9b640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7ff9cc06d350 0x7ff9cc06dc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:10.623 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:10.621+0000 7ff9c1d9b640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7ff9cc06d350 0x7ff9cc06dc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:49258/0 (socket says 172.21.15.73:49258) 2023-12-12T09:44:10.623 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:10.621+0000 7ff9c1d9b640 1 -- 172.21.15.73:0/2813519415 learned_addr learned my addr 172.21.15.73:0/2813519415 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:44:10.623 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:10.621+0000 7ff9c1d9b640 1 -- 172.21.15.73:0/2813519415 >> v1:172.21.15.142:6789/0 conn(0x7ff9cc14f8c0 legacy=0x7ff9cc071e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:44:10.623 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:10.621+0000 7ff9c1d9b640 1 -- 172.21.15.73:0/2813519415 >> v1:172.21.15.73:6789/0 conn(0x7ff9cc152500 legacy=0x7ff9cc152990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:10.623 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:10.622+0000 7ff9c9d9b640 1 -- 172.21.15.73:0/2813519415 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 616358835 0 0) 0x7ff9cc0c16c0 con 0x7ff9cc152500 2023-12-12T09:44:10.623 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:10.622+0000 7ff9c1d9b640 1 -- 172.21.15.73:0/2813519415 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9cc0c1c80 con 0x7ff9cc06d350 2023-12-12T09:44:10.624 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:10.623+0000 7ff9c1d9b640 1 --2- 172.21.15.73:0/2813519415 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff9cc06d350 0x7ff9cc06dc40 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7ff9b4009870 tx=0x7ff9b402b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce2c8ce8e4ff5a53 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:44:10.624 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:10.623+0000 7ff9c9d9b640 1 -- 172.21.15.73:0/2813519415 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9b4030860 con 0x7ff9cc06d350 2023-12-12T09:44:10.624 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:10.623+0000 7ff9c9d9b640 1 -- 172.21.15.73:0/2813519415 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9b40309c0 con 0x7ff9cc06d350 2023-12-12T09:44:10.624 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:10.623+0000 7ff9c9d9b640 1 -- 172.21.15.73:0/2813519415 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9b4030d50 con 0x7ff9cc06d350 2023-12-12T09:44:10.625 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:10.624+0000 7ff9d0943640 1 -- 172.21.15.73:0/2813519415 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff9cc06d350 msgr2=0x7ff9cc06dc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:10.625 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:10.624+0000 7ff9d0943640 1 --2- 172.21.15.73:0/2813519415 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff9cc06d350 0x7ff9cc06dc40 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7ff9b4009870 tx=0x7ff9b402b9a0 comp rx=0 tx=0).stop 2023-12-12T09:44:10.625 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:10.624+0000 7ff9d0943640 1 -- 172.21.15.73:0/2813519415 shutdown_connections 2023-12-12T09:44:10.625 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:10.624+0000 7ff9d0943640 1 --2- 172.21.15.73:0/2813519415 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff9cc06d350 0x7ff9cc06dc40 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:10.625 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:10.624+0000 7ff9d0943640 1 -- 172.21.15.73:0/2813519415 >> 172.21.15.73:0/2813519415 conn(0x7ff9cc06a4e0 msgr2=0x7ff9cc06a8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:44:10.625 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:10.624+0000 7ff9d0943640 1 -- 172.21.15.73:0/2813519415 shutdown_connections 2023-12-12T09:44:10.625 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:10.624+0000 7ff9d0943640 1 -- 172.21.15.73:0/2813519415 wait complete. 2023-12-12T09:44:10.627 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:10.626+0000 7ff9d0943640 1 Processor -- start 2023-12-12T09:44:10.628 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:10.626+0000 7ff9d0943640 1 -- start start 2023-12-12T09:44:10.628 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:10.627+0000 7ff9d0943640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff9cc06d350 0x7ff9cc156310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:10.629 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:10.627+0000 7ff9d0943640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff9cc14f8c0 0x7ff9cc071800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:10.629 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:10.627+0000 7ff9d0943640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff9cc152500 0x7ff9cc147e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:10.629 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:10.627+0000 7ff9d0943640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9cc0a8cd0 con 0x7ff9cc06d350 2023-12-12T09:44:10.629 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:10.627+0000 7ff9d0943640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9cc1eaa40 con 0x7ff9cc14f8c0 2023-12-12T09:44:10.629 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:10.627+0000 7ff9d0943640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9cc149ce0 con 0x7ff9cc152500 2023-12-12T09:44:10.629 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:10.628+0000 7ff9ca59c640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff9cc06d350 0x7ff9cc156310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:10.629 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:10.628+0000 7ff9ca59c640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff9cc06d350 0x7ff9cc156310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:49262/0 (socket says 172.21.15.73:49262) 2023-12-12T09:44:10.629 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:10.628+0000 7ff9ca59c640 1 -- 172.21.15.73:0/1683238811 learned_addr learned my addr 172.21.15.73:0/1683238811 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:44:10.630 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:10.628+0000 7ff9cad9d640 1 --2- 172.21.15.73:0/1683238811 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff9cc152500 0x7ff9cc147e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:10.630 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:10.628+0000 7ff9c1d9b640 1 --2- 172.21.15.73:0/1683238811 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff9cc14f8c0 0x7ff9cc071800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:10.631 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:10.628+0000 7ff9ca59c640 1 -- 172.21.15.73:0/1683238811 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff9cc152500 msgr2=0x7ff9cc147e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:10.631 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:10.628+0000 7ff9ca59c640 1 --2- 172.21.15.73:0/1683238811 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff9cc152500 0x7ff9cc147e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:10.631 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:10.628+0000 7ff9ca59c640 1 -- 172.21.15.73:0/1683238811 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff9cc14f8c0 msgr2=0x7ff9cc071800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:10.631 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:10.628+0000 7ff9ca59c640 1 --2- 172.21.15.73:0/1683238811 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff9cc14f8c0 0x7ff9cc071800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:10.631 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:10.628+0000 7ff9ca59c640 1 -- 172.21.15.73:0/1683238811 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9b40094d0 con 0x7ff9cc06d350 2023-12-12T09:44:10.631 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:10.628+0000 7ff9ca59c640 1 --2- 172.21.15.73:0/1683238811 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff9cc06d350 0x7ff9cc156310 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7ff9bc00c430 tx=0x7ff9bc00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:44:10.631 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:10.629+0000 7ff9c37fe640 1 -- 172.21.15.73:0/1683238811 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9bc011790 con 0x7ff9cc06d350 2023-12-12T09:44:10.631 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:10.629+0000 7ff9c37fe640 1 -- 172.21.15.73:0/1683238811 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9bc0118f0 con 0x7ff9cc06d350 2023-12-12T09:44:10.631 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:10.629+0000 7ff9d0943640 1 -- 172.21.15.73:0/1683238811 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9cc149fc0 con 0x7ff9cc06d350 2023-12-12T09:44:10.631 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:10.629+0000 7ff9c37fe640 1 -- 172.21.15.73:0/1683238811 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9bc011ce0 con 0x7ff9cc06d350 2023-12-12T09:44:10.631 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:10.629+0000 7ff9d0943640 1 -- 172.21.15.73:0/1683238811 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9cc071d40 con 0x7ff9cc06d350 2023-12-12T09:44:10.632 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:10.630+0000 7ff9d0943640 1 -- 172.21.15.73:0/1683238811 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9cc154930 con 0x7ff9cc06d350 2023-12-12T09:44:10.632 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:10.631+0000 7ff9c37fe640 1 -- 172.21.15.73:0/1683238811 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7ff9bc01c460 con 0x7ff9cc06d350 2023-12-12T09:44:10.633 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:10.632+0000 7ff9c37fe640 1 --2- 172.21.15.73:0/1683238811 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7ff9ac06ae40 0x7ff9ac06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:10.633 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:10.632+0000 7ff9c37fe640 1 -- 172.21.15.73:0/1683238811 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5502+0+0 (secure 0 0 0) 0x7ff9bc089450 con 0x7ff9cc06d350 2023-12-12T09:44:10.633 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:10.632+0000 7ff9c1d9b640 1 --2- 172.21.15.73:0/1683238811 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7ff9ac06ae40 0x7ff9ac06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:10.634 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:10.633+0000 7ff9c1d9b640 1 --2- 172.21.15.73:0/1683238811 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7ff9ac06ae40 0x7ff9ac06d300 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7ff9b4036000 tx=0x7ff9b403b040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:44:10.637 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:10.637+0000 7ff9c37fe640 1 -- 172.21.15.73:0/1683238811 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7ff9cc154930 con 0x7ff9cc06d350 2023-12-12T09:44:10.837 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:10.836+0000 7ff9d0943640 1 -- 172.21.15.73:0/1683238811 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7ff9cc154930 con 0x7ff9cc06d350 2023-12-12T09:44:11.401 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:11.401+0000 7ff9c37fe640 1 -- 172.21.15.73:0/1683238811 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v25) v1 ==== 169+0+0 (secure 0 0 0) 0x7ff9cc154930 con 0x7ff9cc06d350 2023-12-12T09:44:11.401 INFO:teuthology.orchestra.run.smithi073.stderr:pool 'cephfs_data' removed 2023-12-12T09:44:11.405 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:11.405+0000 7ff9d0943640 1 -- 172.21.15.73:0/1683238811 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7ff9ac06ae40 msgr2=0x7ff9ac06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:11.405 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:11.405+0000 7ff9d0943640 1 --2- 172.21.15.73:0/1683238811 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7ff9ac06ae40 0x7ff9ac06d300 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7ff9b4036000 tx=0x7ff9b403b040 comp rx=0 tx=0).stop 2023-12-12T09:44:11.405 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:11.405+0000 7ff9d0943640 1 -- 172.21.15.73:0/1683238811 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff9cc06d350 msgr2=0x7ff9cc156310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:11.405 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:11.405+0000 7ff9d0943640 1 --2- 172.21.15.73:0/1683238811 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff9cc06d350 0x7ff9cc156310 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7ff9bc00c430 tx=0x7ff9bc00c8f0 comp rx=0 tx=0).stop 2023-12-12T09:44:11.406 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:11.405+0000 7ff9d0943640 1 -- 172.21.15.73:0/1683238811 shutdown_connections 2023-12-12T09:44:11.406 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:11.405+0000 7ff9d0943640 1 --2- 172.21.15.73:0/1683238811 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7ff9ac06ae40 0x7ff9ac06d300 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:11.406 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:11.405+0000 7ff9d0943640 1 --2- 172.21.15.73:0/1683238811 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff9cc152500 0x7ff9cc147e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:11.406 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:11.405+0000 7ff9d0943640 1 --2- 172.21.15.73:0/1683238811 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff9cc14f8c0 0x7ff9cc071800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:11.406 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:11.405+0000 7ff9d0943640 1 --2- 172.21.15.73:0/1683238811 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff9cc06d350 0x7ff9cc156310 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:11.406 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:11.405+0000 7ff9d0943640 1 -- 172.21.15.73:0/1683238811 >> 172.21.15.73:0/1683238811 conn(0x7ff9cc06a4e0 msgr2=0x7ff9cc152990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:44:11.406 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:11.406+0000 7ff9d0943640 1 -- 172.21.15.73:0/1683238811 shutdown_connections 2023-12-12T09:44:11.406 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:11.406+0000 7ff9d0943640 1 -- 172.21.15.73:0/1683238811 wait complete. 2023-12-12T09:44:11.432 INFO:tasks.ceph.mds.a:Restarting daemon 2023-12-12T09:44:11.432 INFO:tasks.ceph.mds.a:Stopping old one... 2023-12-12T09:44:11.432 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-12-12T09:44:11.433 INFO:teuthology.orchestra.run:waiting for 300 2023-12-12T09:44:11.433 INFO:tasks.ceph.mds.c:Restarting daemon 2023-12-12T09:44:11.433 INFO:tasks.ceph.mds.c:Stopping old one... 2023-12-12T09:44:11.433 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-12-12T09:44:11.433 INFO:teuthology.orchestra.run:waiting for 300 2023-12-12T09:44:11.433 INFO:tasks.ceph.mds.b:Restarting daemon 2023-12-12T09:44:11.433 INFO:tasks.ceph.mds.b:Stopping old one... 2023-12-12T09:44:11.434 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-12-12T09:44:11.434 INFO:teuthology.orchestra.run:waiting for 300 2023-12-12T09:44:11.434 INFO:tasks.ceph.mds.d:Restarting daemon 2023-12-12T09:44:11.434 INFO:tasks.ceph.mds.d:Stopping old one... 2023-12-12T09:44:11.434 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-12-12T09:44:11.434 INFO:teuthology.orchestra.run:waiting for 300 2023-12-12T09:44:11.455 INFO:tasks.ceph.mds.d:Stopped 2023-12-12T09:44:11.455 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-12-12T09:44:11.456 INFO:tasks.ceph.mds.b:Stopped 2023-12-12T09:44:11.456 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-12-12T09:44:11.457 INFO:tasks.ceph.mds.a:Stopped 2023-12-12T09:44:11.458 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-12-12T09:44:11.459 INFO:tasks.ceph.mds.c:Stopped 2023-12-12T09:44:11.460 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-12-12T09:44:11.501 INFO:tasks.ceph.mds.d:Started 2023-12-12T09:44:11.501 DEBUG:teuthology.parallel:result is None 2023-12-12T09:44:11.507 INFO:tasks.ceph.mds.a:Started 2023-12-12T09:44:11.507 DEBUG:teuthology.parallel:result is None 2023-12-12T09:44:11.507 INFO:tasks.ceph.mds.b:Started 2023-12-12T09:44:11.508 DEBUG:teuthology.parallel:result is None 2023-12-12T09:44:11.514 INFO:tasks.ceph.mds.c:Started 2023-12-12T09:44:11.514 DEBUG:teuthology.parallel:result is None 2023-12-12T09:44:11.514 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-12-12T09:44:11.656 INFO:tasks.ceph.mds.d.smithi142.stdout:starting mds.d at 2023-12-12T09:44:11.656 INFO:tasks.ceph.mds.b.smithi142.stdout:starting mds.b at 2023-12-12T09:44:11.668 INFO:tasks.ceph.mds.c.smithi073.stdout:starting mds.c at 2023-12-12T09:44:11.669 INFO:tasks.ceph.mds.a.smithi073.stdout:starting mds.a at 2023-12-12T09:44:11.706 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:11.706+0000 7f81dd9a5640 1 Processor -- start 2023-12-12T09:44:11.706 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:11.706+0000 7f81dd9a5640 1 -- start start 2023-12-12T09:44:11.707 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:11.707+0000 7f81dd9a5640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f81d80bd2e0 0x7f81d806b900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:11.707 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:11.707+0000 7f81dd9a5640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f81d80c7b50 0x7f81d806be40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:11.707 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:11.707+0000 7f81dd9a5640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81d806d360 con 0x7f81d8151a50 2023-12-12T09:44:11.707 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:11.707+0000 7f81dd9a5640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81d8155080 con 0x7f81d80c7b50 2023-12-12T09:44:11.707 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:11.707+0000 7f81dd9a5640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81d8154400 con 0x7f81d80bd2e0 2023-12-12T09:44:11.708 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:11.707+0000 7f81dd1a4640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f81d80c7b50 0x7f81d806be40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:11.708 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:11.707+0000 7f81dd1a4640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f81d80c7b50 0x7f81d806be40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:49286/0 (socket says 172.21.15.73:49286) 2023-12-12T09:44:11.708 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:11.707+0000 7f81dd1a4640 1 -- 172.21.15.73:0/1180554316 learned_addr learned my addr 172.21.15.73:0/1180554316 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:44:11.708 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:11.707+0000 7f81d7fff640 1 --2- 172.21.15.73:0/1180554316 >> v2:172.21.15.142:3300/0 conn(0x7f81d80bd2e0 0x7f81d806b900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:11.708 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:11.708+0000 7f81dd1a4640 1 -- 172.21.15.73:0/1180554316 >> v2:172.21.15.142:3300/0 conn(0x7f81d80bd2e0 msgr2=0x7f81d806b900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:44:11.708 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:11.708+0000 7f81dd1a4640 1 --2- 172.21.15.73:0/1180554316 >> v2:172.21.15.142:3300/0 conn(0x7f81d80bd2e0 0x7f81d806b900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:11.708 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:11.708+0000 7f81dd1a4640 1 -- 172.21.15.73:0/1180554316 >> v1:172.21.15.142:6789/0 conn(0x7f81d8151a50 legacy=0x7f81d80ca360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:11.709 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:11.708+0000 7f81dd1a4640 1 -- 172.21.15.73:0/1180554316 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81d81546e0 con 0x7f81d80c7b50 2023-12-12T09:44:11.709 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:11.708+0000 7f81d7fff640 1 --2- 172.21.15.73:0/1180554316 >> v2:172.21.15.142:3300/0 conn(0x7f81d80bd2e0 0x7f81d806b900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-12T09:44:11.709 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:11.709+0000 7f81dd1a4640 1 --2- 172.21.15.73:0/1180554316 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f81d80c7b50 0x7f81d806be40 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f81d808b730 tx=0x7f81d002be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad43ad8937600384 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:44:11.709 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:11.709+0000 7f81d77fe640 1 -- 172.21.15.73:0/1180554316 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81d002c9f0 con 0x7f81d80c7b50 2023-12-12T09:44:11.709 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:11.709+0000 7f81d77fe640 1 -- 172.21.15.73:0/1180554316 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81d002cb50 con 0x7f81d80c7b50 2023-12-12T09:44:11.709 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:11.709+0000 7f81d77fe640 1 -- 172.21.15.73:0/1180554316 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81d00343f0 con 0x7f81d80c7b50 2023-12-12T09:44:11.710 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:11.710+0000 7f81dd9a5640 1 -- 172.21.15.73:0/1180554316 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f81d80c7b50 msgr2=0x7f81d806be40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:11.710 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:11.710+0000 7f81dd9a5640 1 --2- 172.21.15.73:0/1180554316 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f81d80c7b50 0x7f81d806be40 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f81d808b730 tx=0x7f81d002be50 comp rx=0 tx=0).stop 2023-12-12T09:44:11.710 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:11.710+0000 7f81dd9a5640 1 -- 172.21.15.73:0/1180554316 shutdown_connections 2023-12-12T09:44:11.710 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:11.710+0000 7f81dd9a5640 1 --2- 172.21.15.73:0/1180554316 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f81d80c7b50 0x7f81d806be40 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:11.711 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:11.710+0000 7f81dd9a5640 1 --2- 172.21.15.73:0/1180554316 >> v2:172.21.15.142:3300/0 conn(0x7f81d80bd2e0 0x7f81d806b900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:11.711 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:11.710+0000 7f81dd9a5640 1 -- 172.21.15.73:0/1180554316 >> 172.21.15.73:0/1180554316 conn(0x7f81d80abe10 msgr2=0x7f81d80c9c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:44:11.711 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:11.710+0000 7f81dd9a5640 1 -- 172.21.15.73:0/1180554316 shutdown_connections 2023-12-12T09:44:11.711 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:11.710+0000 7f81dd9a5640 1 -- 172.21.15.73:0/1180554316 wait complete. 2023-12-12T09:44:11.711 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:11.712+0000 7f81dd9a5640 1 Processor -- start 2023-12-12T09:44:11.712 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:11.712+0000 7f81dd9a5640 1 -- start start 2023-12-12T09:44:11.714 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:11.713+0000 7f81dd9a5640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f81d80bd2e0 0x7f81d8157dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:11.714 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:11.713+0000 7f81dd9a5640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f81d80c7b50 0x7f81d81564f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:11.714 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:11.713+0000 7f81dd9a5640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f81d8151a50 0x7f81d814ad70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:11.714 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:11.713+0000 7f81dd9a5640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81d8157050 con 0x7f81d80bd2e0 2023-12-12T09:44:11.714 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:11.713+0000 7f81dd9a5640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81d80be470 con 0x7f81d8151a50 2023-12-12T09:44:11.714 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:11.713+0000 7f81dd9a5640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81d8156d70 con 0x7f81d80c7b50 2023-12-12T09:44:11.715 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:11.713+0000 7f81dc9a3640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f81d80bd2e0 0x7f81d8157dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:11.715 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:11.713+0000 7f81dc9a3640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f81d80bd2e0 0x7f81d8157dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:49294/0 (socket says 172.21.15.73:49294) 2023-12-12T09:44:11.715 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:11.713+0000 7f81dc9a3640 1 -- 172.21.15.73:0/44409574 learned_addr learned my addr 172.21.15.73:0/44409574 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:44:11.715 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:11.713+0000 7f81d7fff640 1 --2- 172.21.15.73:0/44409574 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f81d80c7b50 0x7f81d81564f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:11.715 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:11.713+0000 7f81dd1a4640 1 --2- 172.21.15.73:0/44409574 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f81d8151a50 0x7f81d814ad70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:11.715 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:11.713+0000 7f81dc9a3640 1 -- 172.21.15.73:0/44409574 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f81d80c7b50 msgr2=0x7f81d81564f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:11.715 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:11.713+0000 7f81dc9a3640 1 --2- 172.21.15.73:0/44409574 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f81d80c7b50 0x7f81d81564f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:11.715 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:11.713+0000 7f81dc9a3640 1 -- 172.21.15.73:0/44409574 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f81d8151a50 msgr2=0x7f81d814ad70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:11.715 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:11.713+0000 7f81dc9a3640 1 --2- 172.21.15.73:0/44409574 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f81d8151a50 0x7f81d814ad70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:11.715 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:11.713+0000 7f81dc9a3640 1 -- 172.21.15.73:0/44409574 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81c4009400 con 0x7f81d80bd2e0 2023-12-12T09:44:11.715 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:11.713+0000 7f81dd1a4640 1 --2- 172.21.15.73:0/44409574 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f81d8151a50 0x7f81d814ad70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-12T09:44:11.715 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:11.713+0000 7f81d7fff640 1 --2- 172.21.15.73:0/44409574 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f81d80c7b50 0x7f81d81564f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-12T09:44:11.715 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:11.714+0000 7f81dc9a3640 1 --2- 172.21.15.73:0/44409574 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f81d80bd2e0 0x7f81d8157dd0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f81cc00c400 tx=0x7f81cc00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:44:11.715 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:11.714+0000 7f81d57fa640 1 -- 172.21.15.73:0/44409574 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81cc0052d0 con 0x7f81d80bd2e0 2023-12-12T09:44:11.716 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:11.714+0000 7f81d57fa640 1 -- 172.21.15.73:0/44409574 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81cc005430 con 0x7f81d80bd2e0 2023-12-12T09:44:11.716 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:11.714+0000 7f81dd9a5640 1 -- 172.21.15.73:0/44409574 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81d0009b30 con 0x7f81d80bd2e0 2023-12-12T09:44:11.716 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:11.714+0000 7f81d57fa640 1 -- 172.21.15.73:0/44409574 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81cc003830 con 0x7f81d80bd2e0 2023-12-12T09:44:11.716 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:11.714+0000 7f81dd9a5640 1 -- 172.21.15.73:0/44409574 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81d80cabf0 con 0x7f81d80bd2e0 2023-12-12T09:44:11.717 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:11.715+0000 7f81dd9a5640 1 -- 172.21.15.73:0/44409574 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81d80bdc80 con 0x7f81d80bd2e0 2023-12-12T09:44:11.717 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:11.716+0000 7f81d57fa640 1 -- 172.21.15.73:0/44409574 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f81cc003990 con 0x7f81d80bd2e0 2023-12-12T09:44:11.717 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:11.717+0000 7f81d57fa640 1 --2- 172.21.15.73:0/44409574 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f81bc06ae40 0x7f81bc06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:11.717 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:11.717+0000 7f81d57fa640 1 -- 172.21.15.73:0/44409574 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f81cc088930 con 0x7f81d80bd2e0 2023-12-12T09:44:11.717 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:11.717+0000 7f81d7fff640 1 --2- 172.21.15.73:0/44409574 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f81bc06ae40 0x7f81bc06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:11.718 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:11.718+0000 7f81d7fff640 1 --2- 172.21.15.73:0/44409574 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f81bc06ae40 0x7f81bc06d300 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f81d80c4680 tx=0x7f81c4008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:44:11.721 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:11.721+0000 7f81d57fa640 1 -- 172.21.15.73:0/44409574 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f81d80bdc80 con 0x7f81d80bd2e0 2023-12-12T09:44:11.923 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:11.923+0000 7f81dd9a5640 1 -- 172.21.15.73:0/44409574 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f81d80bdc80 con 0x7f81d80bd2e0 2023-12-12T09:44:13.275 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:13.275+0000 7f81d57fa640 1 -- 172.21.15.73:0/44409574 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v30) v1 ==== 97+0+0 (secure 0 0 0) 0x7f81d80bdc80 con 0x7f81d80bd2e0 2023-12-12T09:44:13.275 INFO:teuthology.orchestra.run.smithi073.stderr: removed all blocklist entries 2023-12-12T09:44:13.279 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:13.279+0000 7f81dd9a5640 1 -- 172.21.15.73:0/44409574 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f81bc06ae40 msgr2=0x7f81bc06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:13.279 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:13.279+0000 7f81dd9a5640 1 --2- 172.21.15.73:0/44409574 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f81bc06ae40 0x7f81bc06d300 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f81d80c4680 tx=0x7f81c4008040 comp rx=0 tx=0).stop 2023-12-12T09:44:13.279 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:13.279+0000 7f81dd9a5640 1 -- 172.21.15.73:0/44409574 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f81d80bd2e0 msgr2=0x7f81d8157dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:13.279 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:13.279+0000 7f81dd9a5640 1 --2- 172.21.15.73:0/44409574 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f81d80bd2e0 0x7f81d8157dd0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f81cc00c400 tx=0x7f81cc00c8c0 comp rx=0 tx=0).stop 2023-12-12T09:44:13.279 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:13.279+0000 7f81dd9a5640 1 -- 172.21.15.73:0/44409574 shutdown_connections 2023-12-12T09:44:13.280 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:13.279+0000 7f81dd9a5640 1 --2- 172.21.15.73:0/44409574 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f81bc06ae40 0x7f81bc06d300 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:13.280 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:13.279+0000 7f81dd9a5640 1 --2- 172.21.15.73:0/44409574 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f81d8151a50 0x7f81d814ad70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:13.280 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:13.279+0000 7f81dd9a5640 1 --2- 172.21.15.73:0/44409574 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f81d80c7b50 0x7f81d81564f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:13.280 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:13.279+0000 7f81dd9a5640 1 --2- 172.21.15.73:0/44409574 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f81d80bd2e0 0x7f81d8157dd0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:13.280 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:13.279+0000 7f81dd9a5640 1 -- 172.21.15.73:0/44409574 >> 172.21.15.73:0/44409574 conn(0x7f81d80abe10 msgr2=0x7f81d80a9c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:44:13.280 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:13.279+0000 7f81dd9a5640 1 -- 172.21.15.73:0/44409574 shutdown_connections 2023-12-12T09:44:13.280 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:13.279+0000 7f81dd9a5640 1 -- 172.21.15.73:0/44409574 wait complete. 2023-12-12T09:44:13.298 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-12-12T09:44:13.512 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:13.511+0000 7f7b9e5ea640 1 Processor -- start 2023-12-12T09:44:13.512 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:13.512+0000 7f7b9e5ea640 1 -- start start 2023-12-12T09:44:13.514 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:13.513+0000 7f7b9e5ea640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f7b9814fa40 0x7f7b9806a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:13.514 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:13.513+0000 7f7b9e5ea640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b98152610 con 0x7f7b9806db70 2023-12-12T09:44:13.514 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:13.513+0000 7f7b9e5ea640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b981528f0 con 0x7f7b980c5070 2023-12-12T09:44:13.514 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:13.513+0000 7f7b9e5ea640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b98152bd0 con 0x7f7b9814fa40 2023-12-12T09:44:13.514 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:13.513+0000 7f7b97fff640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f7b9814fa40 0x7f7b9806a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:13.514 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:13.513+0000 7f7b8ffff640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f7b9806db70 0x7f7b980c39b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:33226/0 (socket says 172.21.15.73:33226) 2023-12-12T09:44:13.514 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:13.513+0000 7f7b8ffff640 1 -- 172.21.15.73:0/3061692684 learned_addr learned my addr 172.21.15.73:0/3061692684 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-12T09:44:13.514 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:13.514+0000 7f7b97fff640 1 -- 172.21.15.73:0/3061692684 >> v1:172.21.15.142:6789/0 conn(0x7f7b980c5070 legacy=0x7f7b980c40c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:44:13.514 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:13.514+0000 7f7b97fff640 1 -- 172.21.15.73:0/3061692684 >> v1:172.21.15.73:6789/0 conn(0x7f7b9806db70 legacy=0x7f7b980c39b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:13.514 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:13.514+0000 7f7b977fe640 1 -- 172.21.15.73:0/3061692684 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 276407987 0 0) 0x7f7b98152610 con 0x7f7b9806db70 2023-12-12T09:44:13.515 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:13.514+0000 7f7b97fff640 1 -- 172.21.15.73:0/3061692684 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b98152eb0 con 0x7f7b9814fa40 2023-12-12T09:44:13.515 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:13.515+0000 7f7b97fff640 1 --2- 172.21.15.73:0/3061692684 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7b9814fa40 0x7f7b9806a4e0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f7b880097a0 tx=0x7f7b8802b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa83a38646beeb7b server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:44:13.515 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:13.516+0000 7f7b977fe640 1 -- 172.21.15.73:0/3061692684 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b8802e070 con 0x7f7b9814fa40 2023-12-12T09:44:13.516 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:13.516+0000 7f7b977fe640 1 -- 172.21.15.73:0/3061692684 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b880315a0 con 0x7f7b9814fa40 2023-12-12T09:44:13.516 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:13.516+0000 7f7b977fe640 1 -- 172.21.15.73:0/3061692684 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b88031930 con 0x7f7b9814fa40 2023-12-12T09:44:13.516 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:13.516+0000 7f7b9e5ea640 1 -- 172.21.15.73:0/3061692684 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7b9814fa40 msgr2=0x7f7b9806a4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:13.516 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:13.516+0000 7f7b9e5ea640 1 --2- 172.21.15.73:0/3061692684 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7b9814fa40 0x7f7b9806a4e0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f7b880097a0 tx=0x7f7b8802b840 comp rx=0 tx=0).stop 2023-12-12T09:44:13.516 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:13.516+0000 7f7b9e5ea640 1 -- 172.21.15.73:0/3061692684 shutdown_connections 2023-12-12T09:44:13.516 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:13.516+0000 7f7b9e5ea640 1 --2- 172.21.15.73:0/3061692684 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7b9814fa40 0x7f7b9806a4e0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:13.517 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:13.516+0000 7f7b9e5ea640 1 -- 172.21.15.73:0/3061692684 >> 172.21.15.73:0/3061692684 conn(0x7f7b980a8130 msgr2=0x7f7b980c24b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:44:13.517 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:13.516+0000 7f7b9e5ea640 1 -- 172.21.15.73:0/3061692684 shutdown_connections 2023-12-12T09:44:13.517 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:13.516+0000 7f7b9e5ea640 1 -- 172.21.15.73:0/3061692684 wait complete. 2023-12-12T09:44:13.518 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:13.518+0000 7f7b9e5ea640 1 Processor -- start 2023-12-12T09:44:13.518 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:13.518+0000 7f7b9e5ea640 1 -- start start 2023-12-12T09:44:13.520 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:13.519+0000 7f7b9e5ea640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7b9806db70 0x7f7b98071a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:13.521 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:13.519+0000 7f7b9e5ea640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7b980c5070 0x7f7b9806feb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:13.521 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:13.519+0000 7f7b9e5ea640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7b9814fa40 0x7f7b98148820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:13.521 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:13.519+0000 7f7b9e5ea640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b981eabe0 con 0x7f7b980c5070 2023-12-12T09:44:13.521 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:13.519+0000 7f7b9e5ea640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b98149720 con 0x7f7b9814fa40 2023-12-12T09:44:13.521 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:13.519+0000 7f7b9e5ea640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b981545e0 con 0x7f7b9806db70 2023-12-12T09:44:13.521 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:13.519+0000 7f7b8ffff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7b980c5070 0x7f7b9806feb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:13.521 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:13.520+0000 7f7b8ffff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7b980c5070 0x7f7b9806feb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:49306/0 (socket says 172.21.15.73:49306) 2023-12-12T09:44:13.521 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:13.520+0000 7f7b8ffff640 1 -- 172.21.15.73:0/2135017778 learned_addr learned my addr 172.21.15.73:0/2135017778 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:44:13.521 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:13.520+0000 7f7b97fff640 1 --2- 172.21.15.73:0/2135017778 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7b9806db70 0x7f7b98071a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:13.521 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:13.520+0000 7f7b9cb87640 1 --2- 172.21.15.73:0/2135017778 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7b9814fa40 0x7f7b98148820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:13.521 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:13.520+0000 7f7b8ffff640 1 -- 172.21.15.73:0/2135017778 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7b9806db70 msgr2=0x7f7b98071a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:13.521 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:13.520+0000 7f7b8ffff640 1 --2- 172.21.15.73:0/2135017778 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7b9806db70 0x7f7b98071a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:13.521 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:13.520+0000 7f7b8ffff640 1 -- 172.21.15.73:0/2135017778 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7b9814fa40 msgr2=0x7f7b98148820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:13.521 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:13.520+0000 7f7b8ffff640 1 --2- 172.21.15.73:0/2135017778 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7b9814fa40 0x7f7b98148820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:13.522 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:13.520+0000 7f7b8ffff640 1 -- 172.21.15.73:0/2135017778 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b88009400 con 0x7f7b980c5070 2023-12-12T09:44:13.522 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:13.520+0000 7f7b8ffff640 1 --2- 172.21.15.73:0/2135017778 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7b980c5070 0x7f7b9806feb0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f7b8000c430 tx=0x7f7b8000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:44:13.522 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:13.520+0000 7f7b957fa640 1 -- 172.21.15.73:0/2135017778 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b800074e0 con 0x7f7b980c5070 2023-12-12T09:44:13.522 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:13.521+0000 7f7b957fa640 1 -- 172.21.15.73:0/2135017778 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b80007660 con 0x7f7b980c5070 2023-12-12T09:44:13.522 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:13.521+0000 7f7b9e5ea640 1 -- 172.21.15.73:0/2135017778 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b98154300 con 0x7f7b980c5070 2023-12-12T09:44:13.522 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:13.521+0000 7f7b957fa640 1 -- 172.21.15.73:0/2135017778 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b80004a20 con 0x7f7b980c5070 2023-12-12T09:44:13.522 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:13.521+0000 7f7b9e5ea640 1 -- 172.21.15.73:0/2135017778 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b98149360 con 0x7f7b980c5070 2023-12-12T09:44:13.522 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:13.522+0000 7f7b9e5ea640 1 -- 172.21.15.73:0/2135017778 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b980718b0 con 0x7f7b980c5070 2023-12-12T09:44:13.523 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:13.523+0000 7f7b957fa640 1 -- 172.21.15.73:0/2135017778 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f7b80004b80 con 0x7f7b980c5070 2023-12-12T09:44:13.523 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:13.523+0000 7f7b957fa640 1 --2- 172.21.15.73:0/2135017778 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f7b7806ae40 0x7f7b7806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:13.523 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:13.524+0000 7f7b957fa640 1 -- 172.21.15.73:0/2135017778 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f7b80089140 con 0x7f7b980c5070 2023-12-12T09:44:13.524 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:13.524+0000 7f7b97fff640 1 --2- 172.21.15.73:0/2135017778 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f7b7806ae40 0x7f7b7806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:13.524 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:13.525+0000 7f7b97fff640 1 --2- 172.21.15.73:0/2135017778 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f7b7806ae40 0x7f7b7806d300 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f7b88036000 tx=0x7f7b88008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:44:13.528 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:13.528+0000 7f7b957fa640 1 -- 172.21.15.73:0/2135017778 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f7b80054530 con 0x7f7b980c5070 2023-12-12T09:44:13.786 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:13.786+0000 7f7b9e5ea640 1 -- 172.21.15.73:0/2135017778 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f7b98067580 con 0x7f7b980c5070 2023-12-12T09:44:13.787 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:13.787+0000 7f7b957fa640 1 -- 172.21.15.73:0/2135017778 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v4) v1 ==== 80+0+6065 (secure 0 0 0) 0x7f7b80057b50 con 0x7f7b980c5070 2023-12-12T09:44:13.787 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-12T09:44:13.787 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2023-12-12T09:44:13.788 INFO:teuthology.orchestra.run.smithi073.stdout: "auth_dump": [ 2023-12-12T09:44:13.788 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-12-12T09:44:13.788 INFO:teuthology.orchestra.run.smithi073.stdout: "entity": "mds.a", 2023-12-12T09:44:13.788 INFO:teuthology.orchestra.run.smithi073.stdout: "key": "AQD+KnhltpiJCBAAkARF8P9XMNmVBOclyUE0FQ==", 2023-12-12T09:44:13.788 INFO:teuthology.orchestra.run.smithi073.stdout: "caps": { 2023-12-12T09:44:13.788 INFO:teuthology.orchestra.run.smithi073.stdout: "mds": "allow", 2023-12-12T09:44:13.788 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr": "allow *", 2023-12-12T09:44:13.788 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": "allow *", 2023-12-12T09:44:13.788 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": "allow *" 2023-12-12T09:44:13.788 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-12-12T09:44:13.788 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-12-12T09:44:13.788 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-12-12T09:44:13.788 INFO:teuthology.orchestra.run.smithi073.stdout: "entity": "mds.b", 2023-12-12T09:44:13.788 INFO:teuthology.orchestra.run.smithi073.stdout: "key": "AQD+KnhlmYRlKBAAVfJyNKwqFR1brRr+uFNhPA==", 2023-12-12T09:44:13.789 INFO:teuthology.orchestra.run.smithi073.stdout: "caps": { 2023-12-12T09:44:13.789 INFO:teuthology.orchestra.run.smithi073.stdout: "mds": "allow", 2023-12-12T09:44:13.789 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr": "allow *", 2023-12-12T09:44:13.789 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": "allow *", 2023-12-12T09:44:13.789 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": "allow *" 2023-12-12T09:44:13.789 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-12-12T09:44:13.789 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-12-12T09:44:13.789 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-12-12T09:44:13.789 INFO:teuthology.orchestra.run.smithi073.stdout: "entity": "mds.c", 2023-12-12T09:44:13.789 INFO:teuthology.orchestra.run.smithi073.stdout: "key": "AQD+KnhlmFweGRAAOp4JMzmBBBakD0PZJ+h3kA==", 2023-12-12T09:44:13.789 INFO:teuthology.orchestra.run.smithi073.stdout: "caps": { 2023-12-12T09:44:13.789 INFO:teuthology.orchestra.run.smithi073.stdout: "mds": "allow", 2023-12-12T09:44:13.789 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr": "allow *", 2023-12-12T09:44:13.789 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": "allow *", 2023-12-12T09:44:13.789 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": "allow *" 2023-12-12T09:44:13.790 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-12-12T09:44:13.790 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-12-12T09:44:13.790 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-12-12T09:44:13.790 INFO:teuthology.orchestra.run.smithi073.stdout: "entity": "mds.d", 2023-12-12T09:44:13.790 INFO:teuthology.orchestra.run.smithi073.stdout: "key": "AQD+Knhl2IWUNhAA0/c8VA4L8iJXGUmjQ0Y6Tw==", 2023-12-12T09:44:13.790 INFO:teuthology.orchestra.run.smithi073.stdout: "caps": { 2023-12-12T09:44:13.790 INFO:teuthology.orchestra.run.smithi073.stdout: "mds": "allow", 2023-12-12T09:44:13.790 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr": "allow *", 2023-12-12T09:44:13.790 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": "allow *", 2023-12-12T09:44:13.790 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": "allow *" 2023-12-12T09:44:13.790 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-12-12T09:44:13.790 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-12-12T09:44:13.790 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-12-12T09:44:13.790 INFO:teuthology.orchestra.run.smithi073.stdout: "entity": "osd.0", 2023-12-12T09:44:13.791 INFO:teuthology.orchestra.run.smithi073.stdout: "key": "AQADK3hlOX7MFBAAOOzt4ZXOGwlGwyySWJgz4Q==", 2023-12-12T09:44:13.791 INFO:teuthology.orchestra.run.smithi073.stdout: "caps": { 2023-12-12T09:44:13.791 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr": "allow profile osd", 2023-12-12T09:44:13.791 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": "allow profile osd", 2023-12-12T09:44:13.791 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": "allow *" 2023-12-12T09:44:13.791 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-12-12T09:44:13.791 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-12-12T09:44:13.791 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-12-12T09:44:13.791 INFO:teuthology.orchestra.run.smithi073.stdout: "entity": "osd.1", 2023-12-12T09:44:13.791 INFO:teuthology.orchestra.run.smithi073.stdout: "key": "AQAGK3hl+zgiLhAAO2mzDGz2F88weMdDaHYN9w==", 2023-12-12T09:44:13.791 INFO:teuthology.orchestra.run.smithi073.stdout: "caps": { 2023-12-12T09:44:13.791 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr": "allow profile osd", 2023-12-12T09:44:13.791 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": "allow profile osd", 2023-12-12T09:44:13.791 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": "allow *" 2023-12-12T09:44:13.791 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-12-12T09:44:13.791 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-12-12T09:44:13.792 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-12-12T09:44:13.792 INFO:teuthology.orchestra.run.smithi073.stdout: "entity": "osd.2", 2023-12-12T09:44:13.792 INFO:teuthology.orchestra.run.smithi073.stdout: "key": "AQAJK3hlRjtuOBAAmRB8r8bmB4W8yfGT+XaT8A==", 2023-12-12T09:44:13.792 INFO:teuthology.orchestra.run.smithi073.stdout: "caps": { 2023-12-12T09:44:13.792 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr": "allow profile osd", 2023-12-12T09:44:13.792 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": "allow profile osd", 2023-12-12T09:44:13.792 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": "allow *" 2023-12-12T09:44:13.792 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-12-12T09:44:13.792 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-12-12T09:44:13.792 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-12-12T09:44:13.792 INFO:teuthology.orchestra.run.smithi073.stdout: "entity": "osd.3", 2023-12-12T09:44:13.792 INFO:teuthology.orchestra.run.smithi073.stdout: "key": "AQANK3hlmDDlBhAAGk3Yf40DqtpTTcDlbCsnCg==", 2023-12-12T09:44:13.792 INFO:teuthology.orchestra.run.smithi073.stdout: "caps": { 2023-12-12T09:44:13.792 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr": "allow profile osd", 2023-12-12T09:44:13.793 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": "allow profile osd", 2023-12-12T09:44:13.793 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": "allow *" 2023-12-12T09:44:13.793 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-12-12T09:44:13.793 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-12-12T09:44:13.793 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-12-12T09:44:13.793 INFO:teuthology.orchestra.run.smithi073.stdout: "entity": "osd.4", 2023-12-12T09:44:13.793 INFO:teuthology.orchestra.run.smithi073.stdout: "key": "AQAUK3hlQqQlBBAALgzKsaHojYauYpl7vx86uQ==", 2023-12-12T09:44:13.793 INFO:teuthology.orchestra.run.smithi073.stdout: "caps": { 2023-12-12T09:44:13.793 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr": "allow profile osd", 2023-12-12T09:44:13.793 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": "allow profile osd", 2023-12-12T09:44:13.793 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": "allow *" 2023-12-12T09:44:13.793 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-12-12T09:44:13.793 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-12-12T09:44:13.793 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-12-12T09:44:13.793 INFO:teuthology.orchestra.run.smithi073.stdout: "entity": "osd.5", 2023-12-12T09:44:13.794 INFO:teuthology.orchestra.run.smithi073.stdout: "key": "AQAXK3hl2/oEHRAAQKg28eQUCVyqKo7+mE1mpA==", 2023-12-12T09:44:13.794 INFO:teuthology.orchestra.run.smithi073.stdout: "caps": { 2023-12-12T09:44:13.794 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr": "allow profile osd", 2023-12-12T09:44:13.794 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": "allow profile osd", 2023-12-12T09:44:13.794 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": "allow *" 2023-12-12T09:44:13.794 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-12-12T09:44:13.794 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-12-12T09:44:13.794 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-12-12T09:44:13.794 INFO:teuthology.orchestra.run.smithi073.stdout: "entity": "osd.6", 2023-12-12T09:44:13.794 INFO:teuthology.orchestra.run.smithi073.stdout: "key": "AQAaK3hleownKBAADG0Bq08cGxCwBfMPkR30pg==", 2023-12-12T09:44:13.794 INFO:teuthology.orchestra.run.smithi073.stdout: "caps": { 2023-12-12T09:44:13.794 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr": "allow profile osd", 2023-12-12T09:44:13.794 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": "allow profile osd", 2023-12-12T09:44:13.794 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": "allow *" 2023-12-12T09:44:13.794 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-12-12T09:44:13.795 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-12-12T09:44:13.795 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-12-12T09:44:13.795 INFO:teuthology.orchestra.run.smithi073.stdout: "entity": "osd.7", 2023-12-12T09:44:13.795 INFO:teuthology.orchestra.run.smithi073.stdout: "key": "AQAdK3hlqOPJMhAAF/cz3Xce+skpwDFCsb+8BQ==", 2023-12-12T09:44:13.795 INFO:teuthology.orchestra.run.smithi073.stdout: "caps": { 2023-12-12T09:44:13.795 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr": "allow profile osd", 2023-12-12T09:44:13.795 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": "allow profile osd", 2023-12-12T09:44:13.795 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": "allow *" 2023-12-12T09:44:13.795 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-12-12T09:44:13.795 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-12-12T09:44:13.795 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-12-12T09:44:13.795 INFO:teuthology.orchestra.run.smithi073.stdout: "entity": "client.0", 2023-12-12T09:44:13.795 INFO:teuthology.orchestra.run.smithi073.stdout: "key": "AQD/Knhl/4KuBxAAdAlGb7dYkXXlgPJp0Qcecg==", 2023-12-12T09:44:13.795 INFO:teuthology.orchestra.run.smithi073.stdout: "caps": { 2023-12-12T09:44:13.795 INFO:teuthology.orchestra.run.smithi073.stdout: "mds": "allow", 2023-12-12T09:44:13.796 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr": "allow r", 2023-12-12T09:44:13.796 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": "allow rw", 2023-12-12T09:44:13.796 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": "allow rwx" 2023-12-12T09:44:13.796 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-12-12T09:44:13.796 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-12-12T09:44:13.796 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-12-12T09:44:13.796 INFO:teuthology.orchestra.run.smithi073.stdout: "entity": "client.1", 2023-12-12T09:44:13.796 INFO:teuthology.orchestra.run.smithi073.stdout: "key": "AQD/KnhlLq6aERAAgTQwqvltAggkGpb77Zngsg==", 2023-12-12T09:44:13.796 INFO:teuthology.orchestra.run.smithi073.stdout: "caps": { 2023-12-12T09:44:13.796 INFO:teuthology.orchestra.run.smithi073.stdout: "mds": "allow", 2023-12-12T09:44:13.796 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr": "allow r", 2023-12-12T09:44:13.796 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": "allow rw", 2023-12-12T09:44:13.796 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": "allow rwx" 2023-12-12T09:44:13.796 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-12-12T09:44:13.796 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-12-12T09:44:13.797 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-12-12T09:44:13.797 INFO:teuthology.orchestra.run.smithi073.stdout: "entity": "client.admin", 2023-12-12T09:44:13.797 INFO:teuthology.orchestra.run.smithi073.stdout: "key": "AQD8KnhlpfsBOBAAE2SZE5bav1875HDrdGXBDQ==", 2023-12-12T09:44:13.797 INFO:teuthology.orchestra.run.smithi073.stdout: "caps": { 2023-12-12T09:44:13.797 INFO:teuthology.orchestra.run.smithi073.stdout: "mds": "allow *", 2023-12-12T09:44:13.797 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr": "allow *", 2023-12-12T09:44:13.797 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": "allow *", 2023-12-12T09:44:13.797 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": "allow *" 2023-12-12T09:44:13.797 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-12-12T09:44:13.797 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-12-12T09:44:13.797 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-12-12T09:44:13.797 INFO:teuthology.orchestra.run.smithi073.stdout: "entity": "client.bootstrap-mds", 2023-12-12T09:44:13.797 INFO:teuthology.orchestra.run.smithi073.stdout: "key": "AQAmK3hlNUYvGxAAQ/J+f1M1xyilmyEo7IV8Ew==", 2023-12-12T09:44:13.797 INFO:teuthology.orchestra.run.smithi073.stdout: "caps": { 2023-12-12T09:44:13.797 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": "allow profile bootstrap-mds" 2023-12-12T09:44:13.797 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-12-12T09:44:13.798 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-12-12T09:44:13.798 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-12-12T09:44:13.798 INFO:teuthology.orchestra.run.smithi073.stdout: "entity": "client.bootstrap-mgr", 2023-12-12T09:44:13.798 INFO:teuthology.orchestra.run.smithi073.stdout: "key": "AQAmK3hl12MvGxAAeJq+y7rF9l9KDZqjde9ZUQ==", 2023-12-12T09:44:13.798 INFO:teuthology.orchestra.run.smithi073.stdout: "caps": { 2023-12-12T09:44:13.798 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": "allow profile bootstrap-mgr" 2023-12-12T09:44:13.798 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-12-12T09:44:13.798 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-12-12T09:44:13.798 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-12-12T09:44:13.798 INFO:teuthology.orchestra.run.smithi073.stdout: "entity": "client.bootstrap-osd", 2023-12-12T09:44:13.798 INFO:teuthology.orchestra.run.smithi073.stdout: "key": "AQAmK3hlXHwvGxAAALqN4SSamDIonq1rbSdUXA==", 2023-12-12T09:44:13.798 INFO:teuthology.orchestra.run.smithi073.stdout: "caps": { 2023-12-12T09:44:13.798 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": "allow profile bootstrap-osd" 2023-12-12T09:44:13.798 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-12-12T09:44:13.798 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-12-12T09:44:13.799 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-12-12T09:44:13.799 INFO:teuthology.orchestra.run.smithi073.stdout: "entity": "client.bootstrap-rbd", 2023-12-12T09:44:13.799 INFO:teuthology.orchestra.run.smithi073.stdout: "key": "AQAmK3hllZsvGxAAgAU1iOjrJSwyxLB0YTYfcg==", 2023-12-12T09:44:13.799 INFO:teuthology.orchestra.run.smithi073.stdout: "caps": { 2023-12-12T09:44:13.799 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": "allow profile bootstrap-rbd" 2023-12-12T09:44:13.799 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-12-12T09:44:13.799 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-12-12T09:44:13.799 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-12-12T09:44:13.799 INFO:teuthology.orchestra.run.smithi073.stdout: "entity": "client.bootstrap-rbd-mirror", 2023-12-12T09:44:13.799 INFO:teuthology.orchestra.run.smithi073.stdout: "key": "AQAmK3hl9rQvGxAAZ1sTt6kPW/LKqpCdbFppng==", 2023-12-12T09:44:13.799 INFO:teuthology.orchestra.run.smithi073.stdout: "caps": { 2023-12-12T09:44:13.799 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2023-12-12T09:44:13.799 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-12-12T09:44:13.799 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-12-12T09:44:13.799 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-12-12T09:44:13.800 INFO:teuthology.orchestra.run.smithi073.stdout: "entity": "client.bootstrap-rgw", 2023-12-12T09:44:13.800 INFO:teuthology.orchestra.run.smithi073.stdout: "key": "AQAmK3hljM4vGxAAhfr4wJfteDXadnt5Ll0nGQ==", 2023-12-12T09:44:13.800 INFO:teuthology.orchestra.run.smithi073.stdout: "caps": { 2023-12-12T09:44:13.800 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": "allow profile bootstrap-rgw" 2023-12-12T09:44:13.800 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-12-12T09:44:13.801 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-12-12T09:44:13.802 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-12-12T09:44:13.802 INFO:teuthology.orchestra.run.smithi073.stdout: "entity": "mgr.x", 2023-12-12T09:44:13.802 INFO:teuthology.orchestra.run.smithi073.stdout: "key": "AQD9Knhls5L9NxAAQ8z4BOLLDQvKzZhSGc7oCg==", 2023-12-12T09:44:13.802 INFO:teuthology.orchestra.run.smithi073.stdout: "caps": { 2023-12-12T09:44:13.802 INFO:teuthology.orchestra.run.smithi073.stdout: "mds": "allow *", 2023-12-12T09:44:13.802 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": "allow profile mgr", 2023-12-12T09:44:13.802 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": "allow *" 2023-12-12T09:44:13.802 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-12-12T09:44:13.802 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-12-12T09:44:13.803 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-12-12T09:44:13.803 INFO:teuthology.orchestra.run.smithi073.stdout: "entity": "mgr.y", 2023-12-12T09:44:13.804 INFO:teuthology.orchestra.run.smithi073.stdout: "key": "AQD9KnhlWTNgKxAAmpMhLYOvVwJkRPAEtHSQAg==", 2023-12-12T09:44:13.804 INFO:teuthology.orchestra.run.smithi073.stdout: "caps": { 2023-12-12T09:44:13.804 INFO:teuthology.orchestra.run.smithi073.stdout: "mds": "allow *", 2023-12-12T09:44:13.804 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": "allow profile mgr", 2023-12-12T09:44:13.804 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": "allow *" 2023-12-12T09:44:13.804 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-12-12T09:44:13.804 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-12-12T09:44:13.804 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-12-12T09:44:13.804 INFO:teuthology.orchestra.run.smithi073.stdout:} 2023-12-12T09:44:13.805 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:13.790+0000 7f7b9e5ea640 1 -- 172.21.15.73:0/2135017778 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f7b7806ae40 msgr2=0x7f7b7806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:13.805 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:13.790+0000 7f7b9e5ea640 1 --2- 172.21.15.73:0/2135017778 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f7b7806ae40 0x7f7b7806d300 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f7b88036000 tx=0x7f7b88008030 comp rx=0 tx=0).stop 2023-12-12T09:44:13.805 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:13.790+0000 7f7b9e5ea640 1 -- 172.21.15.73:0/2135017778 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7b980c5070 msgr2=0x7f7b9806feb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:13.805 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:13.790+0000 7f7b9e5ea640 1 --2- 172.21.15.73:0/2135017778 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7b980c5070 0x7f7b9806feb0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f7b8000c430 tx=0x7f7b8000c8f0 comp rx=0 tx=0).stop 2023-12-12T09:44:13.806 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:13.790+0000 7f7b9e5ea640 1 -- 172.21.15.73:0/2135017778 shutdown_connections 2023-12-12T09:44:13.806 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:13.790+0000 7f7b9e5ea640 1 --2- 172.21.15.73:0/2135017778 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f7b7806ae40 0x7f7b7806d300 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:13.806 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:13.790+0000 7f7b9e5ea640 1 --2- 172.21.15.73:0/2135017778 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7b9814fa40 0x7f7b98148820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:13.806 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:13.790+0000 7f7b9e5ea640 1 --2- 172.21.15.73:0/2135017778 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7b980c5070 0x7f7b9806feb0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:13.806 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:13.790+0000 7f7b9e5ea640 1 --2- 172.21.15.73:0/2135017778 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7b9806db70 0x7f7b98071a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:13.806 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:13.790+0000 7f7b9e5ea640 1 -- 172.21.15.73:0/2135017778 >> 172.21.15.73:0/2135017778 conn(0x7f7b980a8130 msgr2=0x7f7b980bf4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:44:13.806 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:13.790+0000 7f7b9e5ea640 1 -- 172.21.15.73:0/2135017778 shutdown_connections 2023-12-12T09:44:13.806 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:13.790+0000 7f7b9e5ea640 1 -- 172.21.15.73:0/2135017778 wait complete. 2023-12-12T09:44:13.809 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2023-12-12T09:44:14.024 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:14.023+0000 7fe9ae773640 1 Processor -- start 2023-12-12T09:44:14.024 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:14.024+0000 7fe9ae773640 1 -- start start 2023-12-12T09:44:14.025 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:14.025+0000 7fe9ae773640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe9a80a4f40 0x7fe9a8154860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:14.025 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:14.025+0000 7fe9ae773640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fe9a80c4c10 0x7fe9a8154da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:14.026 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:14.025+0000 7fe9ae773640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9a81589a0 con 0x7fe9a80c1a60 2023-12-12T09:44:14.026 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:14.025+0000 7fe9ae773640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9a806c120 con 0x7fe9a80c4c10 2023-12-12T09:44:14.026 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:14.025+0000 7fe9ae773640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9a8157d90 con 0x7fe9a80a4f40 2023-12-12T09:44:14.026 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:14.025+0000 7fe9a7fff640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7fe9a80c1a60 0x7fe9a8151b20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:33238/0 (socket says 172.21.15.73:33238) 2023-12-12T09:44:14.026 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:14.025+0000 7fe9a7fff640 1 -- 172.21.15.73:0/3278329090 learned_addr learned my addr 172.21.15.73:0/3278329090 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-12T09:44:14.026 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:14.026+0000 7fe9acd10640 1 --2- 172.21.15.73:0/3278329090 >> v2:172.21.15.73:3300/0 conn(0x7fe9a80c4c10 0x7fe9a8154da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:14.027 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:14.026+0000 7fe9a6ffd640 1 -- 172.21.15.73:0/3278329090 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2545224472 0 0) 0x7fe9a81589a0 con 0x7fe9a80c1a60 2023-12-12T09:44:14.027 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:14.026+0000 7fe9a6ffd640 1 -- 172.21.15.73:0/3278329090 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe994003520 con 0x7fe9a80c1a60 2023-12-12T09:44:14.027 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:14.026+0000 7fe9a77fe640 1 --2- 172.21.15.73:0/3278329090 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe9a80a4f40 0x7fe9a8154860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:14.027 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:14.026+0000 7fe9acd10640 1 -- 172.21.15.73:0/3278329090 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe9a80a4f40 msgr2=0x7fe9a8154860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:44:14.027 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:14.026+0000 7fe9acd10640 1 --2- 172.21.15.73:0/3278329090 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe9a80a4f40 0x7fe9a8154860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:14.027 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:14.026+0000 7fe9a6ffd640 1 -- 172.21.15.73:0/3278329090 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4236291763 0 0) 0x7fe994003520 con 0x7fe9a80c1a60 2023-12-12T09:44:14.027 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:14.026+0000 7fe9acd10640 1 -- 172.21.15.73:0/3278329090 >> v1:172.21.15.73:6789/0 conn(0x7fe9a80c1a60 legacy=0x7fe9a8151b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:14.027 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:14.026+0000 7fe9acd10640 1 -- 172.21.15.73:0/3278329090 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9a8158070 con 0x7fe9a80c4c10 2023-12-12T09:44:14.028 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:14.027+0000 7fe9acd10640 1 --2- 172.21.15.73:0/3278329090 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe9a80c4c10 0x7fe9a8154da0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fe9a00097a0 tx=0x7fe9a002b660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b73223e31cde51b8 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:44:14.028 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:14.028+0000 7fe9a6ffd640 1 -- 172.21.15.73:0/3278329090 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9980019f0 con 0x7fe9a80c4c10 2023-12-12T09:44:14.029 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:14.028+0000 7fe9a6ffd640 1 -- 172.21.15.73:0/3278329090 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9a002e050 con 0x7fe9a80c4c10 2023-12-12T09:44:14.029 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:14.028+0000 7fe9a6ffd640 1 -- 172.21.15.73:0/3278329090 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9a0030730 con 0x7fe9a80c4c10 2023-12-12T09:44:14.029 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:14.028+0000 7fe9ae773640 1 -- 172.21.15.73:0/3278329090 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe9a80c4c10 msgr2=0x7fe9a8154da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:14.029 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:14.028+0000 7fe9ae773640 1 --2- 172.21.15.73:0/3278329090 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe9a80c4c10 0x7fe9a8154da0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fe9a00097a0 tx=0x7fe9a002b660 comp rx=0 tx=0).stop 2023-12-12T09:44:14.029 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:14.028+0000 7fe9ae773640 1 -- 172.21.15.73:0/3278329090 shutdown_connections 2023-12-12T09:44:14.029 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:14.028+0000 7fe9ae773640 1 --2- 172.21.15.73:0/3278329090 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe9a80a4f40 0x7fe9a8154860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:14.029 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:14.028+0000 7fe9ae773640 1 --2- 172.21.15.73:0/3278329090 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe9a80c4c10 0x7fe9a8154da0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:14.029 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:14.028+0000 7fe9ae773640 1 -- 172.21.15.73:0/3278329090 >> 172.21.15.73:0/3278329090 conn(0x7fe9a80a77d0 msgr2=0x7fe9a80a7bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:44:14.029 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:14.028+0000 7fe9ae773640 1 -- 172.21.15.73:0/3278329090 shutdown_connections 2023-12-12T09:44:14.030 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:14.028+0000 7fe9ae773640 1 -- 172.21.15.73:0/3278329090 wait complete. 2023-12-12T09:44:14.030 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:14.030+0000 7fe9ae773640 1 Processor -- start 2023-12-12T09:44:14.030 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:14.030+0000 7fe9ae773640 1 -- start start 2023-12-12T09:44:14.031 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:14.031+0000 7fe9ae773640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe9a80a4f40 0x7fe9a81536a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:14.031 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:14.031+0000 7fe9ae773640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe9a80c1a60 0x7fe9a80718f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:14.031 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:14.031+0000 7fe9ae773640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe9a80c4c10 0x7fe9a8142aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:14.031 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:14.031+0000 7fe9ae773640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9a81eac40 con 0x7fe9a80a4f40 2023-12-12T09:44:14.031 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:14.031+0000 7fe9ae773640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9a81ea0c0 con 0x7fe9a80c1a60 2023-12-12T09:44:14.031 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:14.031+0000 7fe9ae773640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9a81ea3a0 con 0x7fe9a80c4c10 2023-12-12T09:44:14.031 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:14.031+0000 7fe9a7fff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe9a80a4f40 0x7fe9a81536a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:14.031 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:14.031+0000 7fe9a7fff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe9a80a4f40 0x7fe9a81536a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:49334/0 (socket says 172.21.15.73:49334) 2023-12-12T09:44:14.031 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:14.031+0000 7fe9a7fff640 1 -- 172.21.15.73:0/2622324347 learned_addr learned my addr 172.21.15.73:0/2622324347 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:44:14.032 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:14.032+0000 7fe9a7fff640 1 -- 172.21.15.73:0/2622324347 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe9a80c4c10 msgr2=0x7fe9a8142aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:14.033 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:14.032+0000 7fe9a7fff640 1 --2- 172.21.15.73:0/2622324347 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe9a80c4c10 0x7fe9a8142aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:14.033 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:14.032+0000 7fe9a7fff640 1 -- 172.21.15.73:0/2622324347 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe9a80c1a60 msgr2=0x7fe9a80718f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:14.033 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:14.032+0000 7fe9a7fff640 1 --2- 172.21.15.73:0/2622324347 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe9a80c1a60 0x7fe9a80718f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:14.033 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:14.032+0000 7fe9a7fff640 1 -- 172.21.15.73:0/2622324347 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9a0009400 con 0x7fe9a80a4f40 2023-12-12T09:44:14.033 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:14.032+0000 7fe9a7fff640 1 --2- 172.21.15.73:0/2622324347 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe9a80a4f40 0x7fe9a81536a0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fe998001ff0 tx=0x7fe99800a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:44:14.033 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:14.032+0000 7fe9a4ff9640 1 -- 172.21.15.73:0/2622324347 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe998012400 con 0x7fe9a80a4f40 2023-12-12T09:44:14.033 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:14.032+0000 7fe9a4ff9640 1 -- 172.21.15.73:0/2622324347 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe998012560 con 0x7fe9a80a4f40 2023-12-12T09:44:14.033 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:14.032+0000 7fe9ae773640 1 -- 172.21.15.73:0/2622324347 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9a81ea680 con 0x7fe9a80a4f40 2023-12-12T09:44:14.033 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:14.032+0000 7fe9a4ff9640 1 -- 172.21.15.73:0/2622324347 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe998012930 con 0x7fe9a80a4f40 2023-12-12T09:44:14.033 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:14.032+0000 7fe9ae773640 1 -- 172.21.15.73:0/2622324347 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9a8071e30 con 0x7fe9a80a4f40 2023-12-12T09:44:14.034 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:14.033+0000 7fe9ae773640 1 -- 172.21.15.73:0/2622324347 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe9a8067580 con 0x7fe9a80a4f40 2023-12-12T09:44:14.034 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:14.034+0000 7fe9a4ff9640 1 -- 172.21.15.73:0/2622324347 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fe998012a90 con 0x7fe9a80a4f40 2023-12-12T09:44:14.035 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:14.035+0000 7fe9a4ff9640 1 --2- 172.21.15.73:0/2622324347 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fe98806ae40 0x7fe98806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:14.035 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:14.035+0000 7fe9a4ff9640 1 -- 172.21.15.73:0/2622324347 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fe998089ae0 con 0x7fe9a80a4f40 2023-12-12T09:44:14.035 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:14.035+0000 7fe9a77fe640 1 --2- 172.21.15.73:0/2622324347 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fe98806ae40 0x7fe98806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:14.036 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:14.036+0000 7fe9a77fe640 1 --2- 172.21.15.73:0/2622324347 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fe98806ae40 0x7fe98806d300 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fe990006fd0 tx=0x7fe990008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:44:14.040 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:14.040+0000 7fe9a4ff9640 1 -- 172.21.15.73:0/2622324347 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fe998054ed0 con 0x7fe9a80a4f40 2023-12-12T09:44:14.297 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:14.297+0000 7fe9ae773640 1 -- 172.21.15.73:0/2622324347 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) v1 -- 0x7fe9a8154d80 con 0x7fe9a80a4f40 2023-12-12T09:44:14.301 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:14.301+0000 7fe9a4ff9640 1 -- 172.21.15.73:0/2622324347 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v5) v1 ==== 90+0+0 (secure 0 0 0) 0x7fe9980584f0 con 0x7fe9a80a4f40 2023-12-12T09:44:14.304 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:14.304+0000 7fe9ae773640 1 -- 172.21.15.73:0/2622324347 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fe98806ae40 msgr2=0x7fe98806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:14.304 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:14.304+0000 7fe9ae773640 1 --2- 172.21.15.73:0/2622324347 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fe98806ae40 0x7fe98806d300 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fe990006fd0 tx=0x7fe990008040 comp rx=0 tx=0).stop 2023-12-12T09:44:14.304 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:14.304+0000 7fe9ae773640 1 -- 172.21.15.73:0/2622324347 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe9a80a4f40 msgr2=0x7fe9a81536a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:14.305 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:14.304+0000 7fe9ae773640 1 --2- 172.21.15.73:0/2622324347 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe9a80a4f40 0x7fe9a81536a0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fe998001ff0 tx=0x7fe99800a430 comp rx=0 tx=0).stop 2023-12-12T09:44:14.305 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:14.304+0000 7fe9ae773640 1 -- 172.21.15.73:0/2622324347 shutdown_connections 2023-12-12T09:44:14.305 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:14.304+0000 7fe9ae773640 1 --2- 172.21.15.73:0/2622324347 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fe98806ae40 0x7fe98806d300 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:14.305 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:14.304+0000 7fe9ae773640 1 --2- 172.21.15.73:0/2622324347 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe9a80c4c10 0x7fe9a8142aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:14.305 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:14.304+0000 7fe9ae773640 1 --2- 172.21.15.73:0/2622324347 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe9a80c1a60 0x7fe9a80718f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:14.305 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:14.304+0000 7fe9ae773640 1 --2- 172.21.15.73:0/2622324347 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe9a80a4f40 0x7fe9a81536a0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:14.305 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:14.304+0000 7fe9ae773640 1 -- 172.21.15.73:0/2622324347 >> 172.21.15.73:0/2622324347 conn(0x7fe9a80a77d0 msgr2=0x7fe9a80c0e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:44:14.305 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:14.304+0000 7fe9ae773640 1 -- 172.21.15.73:0/2622324347 shutdown_connections 2023-12-12T09:44:14.305 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:14.304+0000 7fe9ae773640 1 -- 172.21.15.73:0/2622324347 wait complete. 2023-12-12T09:44:14.323 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2023-12-12T09:44:14.528 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:14.527+0000 7f5f9b000640 1 Processor -- start 2023-12-12T09:44:14.528 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:14.527+0000 7f5f9b000640 1 -- start start 2023-12-12T09:44:14.529 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:14.529+0000 7f5f9b000640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f5f940bd470 0x7f5f9406ba90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:14.529 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:14.529+0000 7f5f9b000640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f94154650 con 0x7f5f94151ce0 2023-12-12T09:44:14.529 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:14.529+0000 7f5f9b000640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f94154930 con 0x7f5f940c7cc0 2023-12-12T09:44:14.529 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:14.529+0000 7f5f9b000640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f940c57b0 con 0x7f5f940bd470 2023-12-12T09:44:14.529 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:14.529+0000 7f5f98d9c640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f5f94151ce0 0x7f5f940c67d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:33244/0 (socket says 172.21.15.73:33244) 2023-12-12T09:44:14.529 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:14.529+0000 7f5f98d9c640 1 -- 172.21.15.73:0/3546033952 learned_addr learned my addr 172.21.15.73:0/3546033952 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-12T09:44:14.531 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:14.530+0000 7f5f937fe640 1 -- 172.21.15.73:0/3546033952 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3241066635 0 0) 0x7f5f94154650 con 0x7f5f94151ce0 2023-12-12T09:44:14.532 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:14.530+0000 7f5f937fe640 1 -- 172.21.15.73:0/3546033952 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5f80003520 con 0x7f5f94151ce0 2023-12-12T09:44:14.532 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:14.530+0000 7f5f93fff640 1 --2- 172.21.15.73:0/3546033952 >> v2:172.21.15.142:3300/0 conn(0x7f5f940bd470 0x7f5f9406ba90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:14.532 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:14.530+0000 7f5f937fe640 1 -- 172.21.15.73:0/3546033952 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3755877249 0 0) 0x7f5f80003520 con 0x7f5f94151ce0 2023-12-12T09:44:14.532 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:14.530+0000 7f5f937fe640 1 -- 172.21.15.73:0/3546033952 >> v2:172.21.15.142:3300/0 conn(0x7f5f940bd470 msgr2=0x7f5f9406ba90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:44:14.532 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:14.530+0000 7f5f937fe640 1 --2- 172.21.15.73:0/3546033952 >> v2:172.21.15.142:3300/0 conn(0x7f5f940bd470 0x7f5f9406ba90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:14.532 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:14.530+0000 7f5f937fe640 1 -- 172.21.15.73:0/3546033952 >> v1:172.21.15.142:6789/0 conn(0x7f5f940c7cc0 legacy=0x7f5f9406bfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:44:14.532 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:14.530+0000 7f5f937fe640 1 -- 172.21.15.73:0/3546033952 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f94154c10 con 0x7f5f94151ce0 2023-12-12T09:44:14.532 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:14.530+0000 7f5f937fe640 1 -- 172.21.15.73:0/3546033952 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3186547832 0 0) 0x7f5f840019f0 con 0x7f5f94151ce0 2023-12-12T09:44:14.532 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:14.530+0000 7f5f937fe640 1 -- 172.21.15.73:0/3546033952 >> v1:172.21.15.73:6789/0 conn(0x7f5f94151ce0 legacy=0x7f5f940c67d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:14.532 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:14.530+0000 7f5f937fe640 1 --2- 172.21.15.73:0/3546033952 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5f80003970 0x7f5f80003d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:14.532 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:14.530+0000 7f5f937fe640 1 --2- 172.21.15.73:0/3546033952 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5f800047c0 0x7f5f80004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:14.532 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:14.530+0000 7f5f937fe640 1 --2- 172.21.15.73:0/3546033952 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5f800052a0 0x7f5f8000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:14.533 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:14.530+0000 7f5f937fe640 1 -- 172.21.15.73:0/3546033952 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f940c57b0 con 0x7f5f800052a0 2023-12-12T09:44:14.533 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:14.530+0000 7f5f937fe640 1 -- 172.21.15.73:0/3546033952 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f8000c150 con 0x7f5f800047c0 2023-12-12T09:44:14.533 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:14.530+0000 7f5f937fe640 1 -- 172.21.15.73:0/3546033952 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f8000c310 con 0x7f5f80003970 2023-12-12T09:44:14.533 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:14.530+0000 7f5f9959d640 1 --2- 172.21.15.73:0/3546033952 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5f800052a0 0x7f5f8000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:14.533 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:14.531+0000 7f5f9959d640 1 -- 172.21.15.73:0/3546033952 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5f80003970 msgr2=0x7f5f80003d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:44:14.533 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:14.531+0000 7f5f9959d640 1 --2- 172.21.15.73:0/3546033952 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5f80003970 0x7f5f80003d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:14.533 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:14.531+0000 7f5f9959d640 1 -- 172.21.15.73:0/3546033952 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5f800047c0 msgr2=0x7f5f80004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:44:14.533 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:14.531+0000 7f5f9959d640 1 --2- 172.21.15.73:0/3546033952 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5f800047c0 0x7f5f80004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:14.533 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:14.531+0000 7f5f9959d640 1 -- 172.21.15.73:0/3546033952 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f80003520 con 0x7f5f800052a0 2023-12-12T09:44:14.533 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:14.532+0000 7f5f9959d640 1 -- 172.21.15.73:0/3546033952 reap_dead start 2023-12-12T09:44:14.533 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:14.532+0000 7f5f9959d640 1 --2- 172.21.15.73:0/3546033952 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5f800052a0 0x7f5f8000b980 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f5f940c8140 tx=0x7f5f800057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53d1fc7d2ee84fb5 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:44:14.534 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:14.532+0000 7f5f937fe640 1 -- 172.21.15.73:0/3546033952 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f8c007220 con 0x7f5f800052a0 2023-12-12T09:44:14.535 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:14.532+0000 7f5f937fe640 1 -- 172.21.15.73:0/3546033952 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f8c02e050 con 0x7f5f800052a0 2023-12-12T09:44:14.535 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:14.532+0000 7f5f937fe640 1 -- 172.21.15.73:0/3546033952 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f8c0075e0 con 0x7f5f800052a0 2023-12-12T09:44:14.535 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:14.532+0000 7f5f9b000640 1 -- 172.21.15.73:0/3546033952 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5f800052a0 msgr2=0x7f5f8000b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:14.535 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:14.532+0000 7f5f9b000640 1 --2- 172.21.15.73:0/3546033952 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5f800052a0 0x7f5f8000b980 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f5f940c8140 tx=0x7f5f800057f0 comp rx=0 tx=0).stop 2023-12-12T09:44:14.535 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:14.533+0000 7f5f9b000640 1 -- 172.21.15.73:0/3546033952 shutdown_connections 2023-12-12T09:44:14.535 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:14.533+0000 7f5f9b000640 1 --2- 172.21.15.73:0/3546033952 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5f800052a0 0x7f5f8000b980 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:14.535 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:14.533+0000 7f5f9b000640 1 -- 172.21.15.73:0/3546033952 >> 172.21.15.73:0/3546033952 conn(0x7f5f940ab950 msgr2=0x7f5f940abd30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:44:14.535 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:14.533+0000 7f5f9b000640 1 -- 172.21.15.73:0/3546033952 shutdown_connections 2023-12-12T09:44:14.535 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:14.533+0000 7f5f9b000640 1 -- 172.21.15.73:0/3546033952 wait complete. 2023-12-12T09:44:14.535 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:14.534+0000 7f5f9b000640 1 Processor -- start 2023-12-12T09:44:14.535 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:14.535+0000 7f5f9b000640 1 -- start start 2023-12-12T09:44:14.537 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:14.535+0000 7f5f9b000640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5f800052a0 0x7f5f941e9ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:14.537 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:14.535+0000 7f5f9b000640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5f940beba0 0x7f5f940c1660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:14.537 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:14.535+0000 7f5f9b000640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5f940c02e0 0x7f5f94157e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:14.538 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:14.535+0000 7f5f9b000640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f940c35e0 con 0x7f5f940c02e0 2023-12-12T09:44:14.538 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:14.535+0000 7f5f9b000640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f940bd8b0 con 0x7f5f800052a0 2023-12-12T09:44:14.538 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:14.535+0000 7f5f9b000640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f940be710 con 0x7f5f940beba0 2023-12-12T09:44:14.538 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:14.536+0000 7f5f9959d640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5f940c02e0 0x7f5f94157e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:14.538 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:14.536+0000 7f5f9959d640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5f940c02e0 0x7f5f94157e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:49354/0 (socket says 172.21.15.73:49354) 2023-12-12T09:44:14.538 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:14.536+0000 7f5f9959d640 1 -- 172.21.15.73:0/3754280578 learned_addr learned my addr 172.21.15.73:0/3754280578 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:44:14.538 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:14.536+0000 7f5f98d9c640 1 --2- 172.21.15.73:0/3754280578 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5f800052a0 0x7f5f941e9ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:14.538 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:14.536+0000 7f5f9959d640 1 -- 172.21.15.73:0/3754280578 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5f940beba0 msgr2=0x7f5f940c1660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:14.538 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:14.536+0000 7f5f9959d640 1 --2- 172.21.15.73:0/3754280578 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5f940beba0 0x7f5f940c1660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:14.538 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:14.536+0000 7f5f9959d640 1 -- 172.21.15.73:0/3754280578 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5f800052a0 msgr2=0x7f5f941e9ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:14.538 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:14.536+0000 7f5f9959d640 1 --2- 172.21.15.73:0/3754280578 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5f800052a0 0x7f5f941e9ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:14.538 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:14.536+0000 7f5f9959d640 1 -- 172.21.15.73:0/3754280578 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f940bdb00 con 0x7f5f940c02e0 2023-12-12T09:44:14.539 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:14.537+0000 7f5f9959d640 1 --2- 172.21.15.73:0/3754280578 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5f940c02e0 0x7f5f94157e30 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f5f8c003e40 tx=0x7f5f8c0036f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:44:14.539 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:14.537+0000 7f5f917fa640 1 -- 172.21.15.73:0/3754280578 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f8c006ea0 con 0x7f5f940c02e0 2023-12-12T09:44:14.539 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:14.537+0000 7f5f917fa640 1 -- 172.21.15.73:0/3754280578 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f8c03c460 con 0x7f5f940c02e0 2023-12-12T09:44:14.539 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:14.537+0000 7f5f917fa640 1 -- 172.21.15.73:0/3754280578 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f8c03c7f0 con 0x7f5f940c02e0 2023-12-12T09:44:14.539 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:14.537+0000 7f5f9b000640 1 -- 172.21.15.73:0/3754280578 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f940bdde0 con 0x7f5f940c02e0 2023-12-12T09:44:14.539 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:14.537+0000 7f5f9b000640 1 -- 172.21.15.73:0/3754280578 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f940be3a0 con 0x7f5f940c02e0 2023-12-12T09:44:14.540 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:14.538+0000 7f5f9b000640 1 -- 172.21.15.73:0/3754280578 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f940be8a0 con 0x7f5f940c02e0 2023-12-12T09:44:14.540 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:14.539+0000 7f5f917fa640 1 -- 172.21.15.73:0/3754280578 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f5f8c03c950 con 0x7f5f940c02e0 2023-12-12T09:44:14.540 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:14.540+0000 7f5f917fa640 1 --2- 172.21.15.73:0/3754280578 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f5f7406ae40 0x7f5f7406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:14.540 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:14.540+0000 7f5f917fa640 1 -- 172.21.15.73:0/3754280578 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f5f8c0aac10 con 0x7f5f940c02e0 2023-12-12T09:44:14.540 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:14.540+0000 7f5f98d9c640 1 --2- 172.21.15.73:0/3754280578 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f5f7406ae40 0x7f5f7406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:14.541 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:14.541+0000 7f5f98d9c640 1 --2- 172.21.15.73:0/3754280578 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f5f7406ae40 0x7f5f7406d300 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f5f84001330 tx=0x7f5f84009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:44:14.544 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:14.544+0000 7f5f917fa640 1 -- 172.21.15.73:0/3754280578 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f5f8c075f70 con 0x7f5f940c02e0 2023-12-12T09:44:14.803 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:14.803+0000 7f5f9b000640 1 -- 172.21.15.73:0/3754280578 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) v1 -- 0x7f5f940c6750 con 0x7f5f940c02e0 2023-12-12T09:44:14.807 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:14.807+0000 7f5f917fa640 1 -- 172.21.15.73:0/3754280578 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v6) v1 ==== 90+0+0 (secure 0 0 0) 0x7f5f8c079590 con 0x7f5f940c02e0 2023-12-12T09:44:14.810 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:14.810+0000 7f5f9b000640 1 -- 172.21.15.73:0/3754280578 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f5f7406ae40 msgr2=0x7f5f7406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:14.810 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:14.810+0000 7f5f9b000640 1 --2- 172.21.15.73:0/3754280578 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f5f7406ae40 0x7f5f7406d300 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f5f84001330 tx=0x7f5f84009040 comp rx=0 tx=0).stop 2023-12-12T09:44:14.810 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:14.810+0000 7f5f9b000640 1 -- 172.21.15.73:0/3754280578 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5f940c02e0 msgr2=0x7f5f94157e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:14.810 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:14.810+0000 7f5f9b000640 1 --2- 172.21.15.73:0/3754280578 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5f940c02e0 0x7f5f94157e30 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f5f8c003e40 tx=0x7f5f8c0036f0 comp rx=0 tx=0).stop 2023-12-12T09:44:14.811 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:14.810+0000 7f5f9b000640 1 -- 172.21.15.73:0/3754280578 shutdown_connections 2023-12-12T09:44:14.811 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:14.810+0000 7f5f9b000640 1 --2- 172.21.15.73:0/3754280578 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f5f7406ae40 0x7f5f7406d300 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:14.811 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:14.811+0000 7f5f9b000640 1 --2- 172.21.15.73:0/3754280578 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5f940c02e0 0x7f5f94157e30 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:14.812 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:14.811+0000 7f5f9b000640 1 --2- 172.21.15.73:0/3754280578 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5f940beba0 0x7f5f940c1660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:14.812 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:14.811+0000 7f5f9b000640 1 --2- 172.21.15.73:0/3754280578 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5f800052a0 0x7f5f941e9ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:14.812 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:14.811+0000 7f5f9b000640 1 -- 172.21.15.73:0/3754280578 >> 172.21.15.73:0/3754280578 conn(0x7f5f940ab950 msgr2=0x7f5f9414fe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:44:14.812 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:14.811+0000 7f5f9b000640 1 -- 172.21.15.73:0/3754280578 shutdown_connections 2023-12-12T09:44:14.812 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:14.811+0000 7f5f9b000640 1 -- 172.21.15.73:0/3754280578 wait complete. 2023-12-12T09:44:14.828 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2023-12-12T09:44:15.039 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:15.036+0000 7f2ccefc9640 1 Processor -- start 2023-12-12T09:44:15.039 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:15.036+0000 7f2ccefc9640 1 -- start start 2023-12-12T09:44:15.039 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:15.037+0000 7f2ccefc9640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f2cc80bd4b0 0x7f2cc80c4b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:15.039 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:15.037+0000 7f2ccefc9640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2cc81545f0 con 0x7f2cc80c7d20 2023-12-12T09:44:15.040 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:15.037+0000 7f2ccefc9640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2cc81548d0 con 0x7f2cc80c47a0 2023-12-12T09:44:15.040 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:15.037+0000 7f2ccefc9640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2cc8155270 con 0x7f2cc80bd4b0 2023-12-12T09:44:15.040 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:15.037+0000 7f2ccd566640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f2cc80c7d20 0x7f2cc806ba30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:33250/0 (socket says 172.21.15.73:33250) 2023-12-12T09:44:15.040 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:15.037+0000 7f2ccd566640 1 -- 172.21.15.73:0/3468419995 learned_addr learned my addr 172.21.15.73:0/3468419995 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-12T09:44:15.040 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:15.038+0000 7f2cc7fff640 1 --2- 172.21.15.73:0/3468419995 >> v2:172.21.15.142:3300/0 conn(0x7f2cc80bd4b0 0x7f2cc80c4b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:15.040 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:15.038+0000 7f2cc77fe640 1 -- 172.21.15.73:0/3468419995 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 628996844 0 0) 0x7f2cc81545f0 con 0x7f2cc80c7d20 2023-12-12T09:44:15.040 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:15.038+0000 7f2cc77fe640 1 -- 172.21.15.73:0/3468419995 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2cb4003520 con 0x7f2cc80c7d20 2023-12-12T09:44:15.040 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:15.038+0000 7f2cc77fe640 1 -- 172.21.15.73:0/3468419995 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4238602261 0 0) 0x7f2cb4003520 con 0x7f2cc80c7d20 2023-12-12T09:44:15.040 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:15.038+0000 7f2cc77fe640 1 -- 172.21.15.73:0/3468419995 >> v2:172.21.15.142:3300/0 conn(0x7f2cc80bd4b0 msgr2=0x7f2cc80c4b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:44:15.040 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:15.038+0000 7f2cc77fe640 1 --2- 172.21.15.73:0/3468419995 >> v2:172.21.15.142:3300/0 conn(0x7f2cc80bd4b0 0x7f2cc80c4b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:15.040 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:15.038+0000 7f2cc77fe640 1 -- 172.21.15.73:0/3468419995 >> v1:172.21.15.142:6789/0 conn(0x7f2cc80c47a0 legacy=0x7f2cc806b320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:44:15.040 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:15.038+0000 7f2cc77fe640 1 -- 172.21.15.73:0/3468419995 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cc8154bb0 con 0x7f2cc80c7d20 2023-12-12T09:44:15.041 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:15.038+0000 7f2cc77fe640 1 -- 172.21.15.73:0/3468419995 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3186547832 0 0) 0x7f2cc0001670 con 0x7f2cc80c7d20 2023-12-12T09:44:15.041 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:15.038+0000 7f2cc77fe640 1 -- 172.21.15.73:0/3468419995 >> v1:172.21.15.73:6789/0 conn(0x7f2cc80c7d20 legacy=0x7f2cc806ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:15.041 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:15.038+0000 7f2cc77fe640 1 --2- 172.21.15.73:0/3468419995 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2cb4003970 0x7f2cb4003d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:15.041 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:15.038+0000 7f2cc77fe640 1 --2- 172.21.15.73:0/3468419995 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2cb40047c0 0x7f2cb4004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:15.041 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:15.038+0000 7f2cc77fe640 1 --2- 172.21.15.73:0/3468419995 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2cb40052a0 0x7f2cb400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:15.041 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:15.038+0000 7f2cc77fe640 1 -- 172.21.15.73:0/3468419995 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cc8155270 con 0x7f2cb40047c0 2023-12-12T09:44:15.041 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:15.038+0000 7f2cc77fe640 1 -- 172.21.15.73:0/3468419995 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cb400c1f0 con 0x7f2cb40052a0 2023-12-12T09:44:15.041 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:15.038+0000 7f2cc77fe640 1 -- 172.21.15.73:0/3468419995 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2cb400c3b0 con 0x7f2cb4003970 2023-12-12T09:44:15.041 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:15.038+0000 7f2cc7fff640 1 --2- 172.21.15.73:0/3468419995 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2cb40047c0 0x7f2cb4004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:15.041 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:15.039+0000 7f2cccd65640 1 --2- 172.21.15.73:0/3468419995 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2cb4003970 0x7f2cb4003d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:15.041 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:15.039+0000 7f2ccd566640 1 --2- 172.21.15.73:0/3468419995 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2cb40052a0 0x7f2cb400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:15.041 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:15.039+0000 7f2cc7fff640 1 -- 172.21.15.73:0/3468419995 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2cb4003970 msgr2=0x7f2cb4003d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:44:15.041 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:15.039+0000 7f2cc7fff640 1 --2- 172.21.15.73:0/3468419995 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2cb4003970 0x7f2cb4003d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:15.042 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:15.039+0000 7f2cc7fff640 1 -- 172.21.15.73:0/3468419995 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2cb40052a0 msgr2=0x7f2cb400b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:44:15.042 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:15.039+0000 7f2cc7fff640 1 --2- 172.21.15.73:0/3468419995 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2cb40052a0 0x7f2cb400b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:15.042 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:15.039+0000 7f2cc7fff640 1 -- 172.21.15.73:0/3468419995 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cb4003520 con 0x7f2cb40047c0 2023-12-12T09:44:15.042 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:15.039+0000 7f2ccd566640 1 --2- 172.21.15.73:0/3468419995 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2cb40052a0 0x7f2cb400b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:44:15.042 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:15.039+0000 7f2ccd566640 1 -- 172.21.15.73:0/3468419995 reap_dead start 2023-12-12T09:44:15.043 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:15.041+0000 7f2cc7fff640 1 --2- 172.21.15.73:0/3468419995 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2cb40047c0 0x7f2cb4004c40 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f2cc80bd8f0 tx=0x7f2cb40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5809b8ae6c51cd4 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:44:15.043 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:15.041+0000 7f2cc77fe640 1 -- 172.21.15.73:0/3468419995 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cb802cc70 con 0x7f2cb40047c0 2023-12-12T09:44:15.043 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:15.041+0000 7f2cc77fe640 1 -- 172.21.15.73:0/3468419995 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2cb802cdd0 con 0x7f2cb40047c0 2023-12-12T09:44:15.043 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:15.041+0000 7f2cc77fe640 1 -- 172.21.15.73:0/3468419995 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cb8034660 con 0x7f2cb40047c0 2023-12-12T09:44:15.043 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:15.041+0000 7f2ccefc9640 1 -- 172.21.15.73:0/3468419995 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2cb40047c0 msgr2=0x7f2cb4004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:15.043 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:15.041+0000 7f2ccefc9640 1 --2- 172.21.15.73:0/3468419995 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2cb40047c0 0x7f2cb4004c40 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f2cc80bd8f0 tx=0x7f2cb40057f0 comp rx=0 tx=0).stop 2023-12-12T09:44:15.043 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:15.042+0000 7f2ccefc9640 1 -- 172.21.15.73:0/3468419995 shutdown_connections 2023-12-12T09:44:15.043 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:15.042+0000 7f2ccefc9640 1 --2- 172.21.15.73:0/3468419995 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2cb40047c0 0x7f2cb4004c40 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:15.044 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:15.042+0000 7f2ccefc9640 1 -- 172.21.15.73:0/3468419995 >> 172.21.15.73:0/3468419995 conn(0x7f2cc80ab9d0 msgr2=0x7f2cc80abde0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:44:15.044 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:15.042+0000 7f2ccefc9640 1 -- 172.21.15.73:0/3468419995 shutdown_connections 2023-12-12T09:44:15.044 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:15.042+0000 7f2ccefc9640 1 -- 172.21.15.73:0/3468419995 wait complete. 2023-12-12T09:44:15.045 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:15.043+0000 7f2ccefc9640 1 Processor -- start 2023-12-12T09:44:15.045 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:15.044+0000 7f2ccefc9640 1 -- start start 2023-12-12T09:44:15.046 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:15.044+0000 7f2ccefc9640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2cb40047c0 0x7f2cc81e6b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:15.046 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:15.045+0000 7f2ccefc9640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2cc81e7080 0x7f2cc81573c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:15.046 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:15.045+0000 7f2ccefc9640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2cc8157900 0x7f2cc80c1210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:15.046 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:15.045+0000 7f2ccefc9640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cc8158690 con 0x7f2cc8157900 2023-12-12T09:44:15.046 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:15.045+0000 7f2ccefc9640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cc814ce40 con 0x7f2cc81e7080 2023-12-12T09:44:15.046 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:15.045+0000 7f2ccefc9640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2cc80c0cd0 con 0x7f2cb40047c0 2023-12-12T09:44:15.046 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:15.045+0000 7f2ccd566640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2cc8157900 0x7f2cc80c1210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:15.046 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:15.045+0000 7f2ccd566640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2cc8157900 0x7f2cc80c1210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:49362/0 (socket says 172.21.15.73:49362) 2023-12-12T09:44:15.046 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:15.045+0000 7f2ccd566640 1 -- 172.21.15.73:0/1589106509 learned_addr learned my addr 172.21.15.73:0/1589106509 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:44:15.046 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:15.045+0000 7f2cc7fff640 1 --2- 172.21.15.73:0/1589106509 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2cc81e7080 0x7f2cc81573c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:15.046 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:15.045+0000 7f2cccd65640 1 --2- 172.21.15.73:0/1589106509 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2cb40047c0 0x7f2cc81e6b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:15.046 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:15.045+0000 7f2ccd566640 1 -- 172.21.15.73:0/1589106509 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2cb40047c0 msgr2=0x7f2cc81e6b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:15.047 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:15.045+0000 7f2ccd566640 1 --2- 172.21.15.73:0/1589106509 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2cb40047c0 0x7f2cc81e6b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:15.047 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:15.045+0000 7f2ccd566640 1 -- 172.21.15.73:0/1589106509 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2cc81e7080 msgr2=0x7f2cc81573c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:15.047 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:15.045+0000 7f2ccd566640 1 --2- 172.21.15.73:0/1589106509 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2cc81e7080 0x7f2cc81573c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:15.047 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:15.045+0000 7f2ccd566640 1 -- 172.21.15.73:0/1589106509 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cc8155950 con 0x7f2cc8157900 2023-12-12T09:44:15.047 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:15.046+0000 7f2ccd566640 1 --2- 172.21.15.73:0/1589106509 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2cc8157900 0x7f2cc80c1210 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f2cc806c550 tx=0x7f2cc000d950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:44:15.048 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:15.046+0000 7f2cc57fa640 1 -- 172.21.15.73:0/1589106509 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cc0007440 con 0x7f2cc8157900 2023-12-12T09:44:15.048 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:15.046+0000 7f2cc57fa640 1 -- 172.21.15.73:0/1589106509 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2cc00075a0 con 0x7f2cc8157900 2023-12-12T09:44:15.048 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:15.046+0000 7f2ccefc9640 1 -- 172.21.15.73:0/1589106509 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2cc81583b0 con 0x7f2cc8157900 2023-12-12T09:44:15.048 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:15.046+0000 7f2cc57fa640 1 -- 172.21.15.73:0/1589106509 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cc0004a20 con 0x7f2cc8157900 2023-12-12T09:44:15.048 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:15.046+0000 7f2ccefc9640 1 -- 172.21.15.73:0/1589106509 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2cc80c0ef0 con 0x7f2cc8157900 2023-12-12T09:44:15.048 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:15.047+0000 7f2ccefc9640 1 -- 172.21.15.73:0/1589106509 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2cc81ea8e0 con 0x7f2cc8157900 2023-12-12T09:44:15.048 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:15.048+0000 7f2cc57fa640 1 -- 172.21.15.73:0/1589106509 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f2cc0004b80 con 0x7f2cc8157900 2023-12-12T09:44:15.049 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:15.049+0000 7f2cc57fa640 1 --2- 172.21.15.73:0/1589106509 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f2ca806ae70 0x7f2ca806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:15.049 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:15.049+0000 7f2cc57fa640 1 -- 172.21.15.73:0/1589106509 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f2cc0088ba0 con 0x7f2cc8157900 2023-12-12T09:44:15.049 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:15.049+0000 7f2cccd65640 1 --2- 172.21.15.73:0/1589106509 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f2ca806ae70 0x7f2ca806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:15.050 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:15.050+0000 7f2cccd65640 1 --2- 172.21.15.73:0/1589106509 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f2ca806ae70 0x7f2ca806d330 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f2cb0007fd0 tx=0x7f2cb0009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:44:15.053 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:15.053+0000 7f2cc57fa640 1 -- 172.21.15.73:0/1589106509 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f2cc81ea8e0 con 0x7f2cc8157900 2023-12-12T09:44:15.312 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:15.312+0000 7f2ccefc9640 1 -- 172.21.15.73:0/1589106509 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) v1 -- 0x7f2cc81ea8e0 con 0x7f2cc8157900 2023-12-12T09:44:15.316 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:15.316+0000 7f2cc57fa640 1 -- 172.21.15.73:0/1589106509 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v7) v1 ==== 90+0+0 (secure 0 0 0) 0x7f2cc81ea8e0 con 0x7f2cc8157900 2023-12-12T09:44:15.319 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:15.319+0000 7f2ccefc9640 1 -- 172.21.15.73:0/1589106509 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f2ca806ae70 msgr2=0x7f2ca806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:15.320 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:15.319+0000 7f2ccefc9640 1 --2- 172.21.15.73:0/1589106509 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f2ca806ae70 0x7f2ca806d330 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f2cb0007fd0 tx=0x7f2cb0009040 comp rx=0 tx=0).stop 2023-12-12T09:44:15.320 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:15.319+0000 7f2ccefc9640 1 -- 172.21.15.73:0/1589106509 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2cc8157900 msgr2=0x7f2cc80c1210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:15.320 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:15.319+0000 7f2ccefc9640 1 --2- 172.21.15.73:0/1589106509 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2cc8157900 0x7f2cc80c1210 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f2cc806c550 tx=0x7f2cc000d950 comp rx=0 tx=0).stop 2023-12-12T09:44:15.320 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:15.319+0000 7f2ccefc9640 1 -- 172.21.15.73:0/1589106509 shutdown_connections 2023-12-12T09:44:15.320 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:15.319+0000 7f2ccefc9640 1 --2- 172.21.15.73:0/1589106509 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f2ca806ae70 0x7f2ca806d330 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:15.320 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:15.319+0000 7f2ccefc9640 1 --2- 172.21.15.73:0/1589106509 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2cc8157900 0x7f2cc80c1210 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:15.320 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:15.319+0000 7f2ccefc9640 1 --2- 172.21.15.73:0/1589106509 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2cc81e7080 0x7f2cc81573c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:15.320 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:15.319+0000 7f2ccefc9640 1 --2- 172.21.15.73:0/1589106509 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2cb40047c0 0x7f2cc81e6b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:15.320 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:15.319+0000 7f2ccefc9640 1 -- 172.21.15.73:0/1589106509 >> 172.21.15.73:0/1589106509 conn(0x7f2cc80ab9d0 msgr2=0x7f2cc80abdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:44:15.320 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:15.319+0000 7f2ccefc9640 1 -- 172.21.15.73:0/1589106509 shutdown_connections 2023-12-12T09:44:15.320 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:15.319+0000 7f2ccefc9640 1 -- 172.21.15.73:0/1589106509 wait complete. 2023-12-12T09:44:15.337 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2023-12-12T09:44:15.547 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:15.546+0000 7fa2a59c5640 1 Processor -- start 2023-12-12T09:44:15.547 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:15.547+0000 7fa2a59c5640 1 -- start start 2023-12-12T09:44:15.548 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:15.548+0000 7fa2a59c5640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa2a0152f30 0x7fa2a00a6cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:15.549 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:15.548+0000 7fa2a59c5640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fa2a0156500 0x7fa2a015cbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:15.549 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:15.548+0000 7fa2a59c5640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2a0155960 con 0x7fa2a0152240 2023-12-12T09:44:15.549 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:15.548+0000 7fa2a59c5640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2a00c2f20 con 0x7fa2a0156500 2023-12-12T09:44:15.549 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:15.548+0000 7fa2a59c5640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2a00aa690 con 0x7fa2a0152f30 2023-12-12T09:44:15.549 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:15.548+0000 7fa29f7fe640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fa2a0156500 0x7fa2a015cbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:15.549 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:15.548+0000 7fa29e7fc640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7fa2a0152240 0x7fa2a0155df0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:33264/0 (socket says 172.21.15.73:33264) 2023-12-12T09:44:15.549 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:15.548+0000 7fa29e7fc640 1 -- 172.21.15.73:0/3607789003 learned_addr learned my addr 172.21.15.73:0/3607789003 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-12T09:44:15.549 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:15.549+0000 7fa29effd640 1 --2- 172.21.15.73:0/3607789003 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa2a0152f30 0x7fa2a00a6cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:15.549 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:15.549+0000 7fa29f7fe640 1 -- 172.21.15.73:0/3607789003 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa2a0152f30 msgr2=0x7fa2a00a6cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:44:15.549 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:15.549+0000 7fa29f7fe640 1 --2- 172.21.15.73:0/3607789003 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa2a0152f30 0x7fa2a00a6cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:15.549 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:15.549+0000 7fa29f7fe640 1 -- 172.21.15.73:0/3607789003 >> v1:172.21.15.73:6789/0 conn(0x7fa2a0152240 legacy=0x7fa2a0155df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:15.550 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:15.549+0000 7fa29f7fe640 1 -- 172.21.15.73:0/3607789003 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2a00c3b10 con 0x7fa2a0156500 2023-12-12T09:44:15.551 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:15.550+0000 7fa29f7fe640 1 --2- 172.21.15.73:0/3607789003 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa2a0156500 0x7fa2a015cbc0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fa2980097a0 tx=0x7fa29802b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=284b69563cb4217d server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:44:15.551 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:15.550+0000 7fa29dffb640 1 -- 172.21.15.73:0/3607789003 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa29802d040 con 0x7fa2a0156500 2023-12-12T09:44:15.551 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:15.550+0000 7fa29dffb640 1 -- 172.21.15.73:0/3607789003 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa298031810 con 0x7fa2a0156500 2023-12-12T09:44:15.551 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:15.550+0000 7fa29dffb640 1 -- 172.21.15.73:0/3607789003 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa298031ba0 con 0x7fa2a0156500 2023-12-12T09:44:15.551 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:15.551+0000 7fa2a59c5640 1 -- 172.21.15.73:0/3607789003 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa2a0156500 msgr2=0x7fa2a015cbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:15.551 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:15.551+0000 7fa2a59c5640 1 --2- 172.21.15.73:0/3607789003 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa2a0156500 0x7fa2a015cbc0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fa2980097a0 tx=0x7fa29802b8b0 comp rx=0 tx=0).stop 2023-12-12T09:44:15.551 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:15.551+0000 7fa2a59c5640 1 -- 172.21.15.73:0/3607789003 shutdown_connections 2023-12-12T09:44:15.551 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:15.551+0000 7fa2a59c5640 1 --2- 172.21.15.73:0/3607789003 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa2a0156500 0x7fa2a015cbc0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:15.552 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:15.551+0000 7fa2a59c5640 1 --2- 172.21.15.73:0/3607789003 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa2a0152f30 0x7fa2a00a6cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:15.552 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:15.551+0000 7fa2a59c5640 1 -- 172.21.15.73:0/3607789003 >> 172.21.15.73:0/3607789003 conn(0x7fa2a00a99e0 msgr2=0x7fa2a00a9df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:44:15.552 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:15.551+0000 7fa2a59c5640 1 -- 172.21.15.73:0/3607789003 shutdown_connections 2023-12-12T09:44:15.552 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:15.551+0000 7fa2a59c5640 1 -- 172.21.15.73:0/3607789003 wait complete. 2023-12-12T09:44:15.552 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:15.552+0000 7fa2a59c5640 1 Processor -- start 2023-12-12T09:44:15.553 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:15.553+0000 7fa2a59c5640 1 -- start start 2023-12-12T09:44:15.554 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:15.553+0000 7fa2a59c5640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa2a0152240 0x7fa2a014ea60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:15.554 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:15.553+0000 7fa2a59c5640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa2a0152f30 0x7fa2a01e10f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:15.554 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:15.554+0000 7fa2a59c5640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa2a0156500 0x7fa2a00aa8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:15.554 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:15.554+0000 7fa2a59c5640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2a01ead20 con 0x7fa2a0152240 2023-12-12T09:44:15.554 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:15.554+0000 7fa2a59c5640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2a01508c0 con 0x7fa2a0152f30 2023-12-12T09:44:15.554 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:15.554+0000 7fa2a59c5640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2a014ff90 con 0x7fa2a0156500 2023-12-12T09:44:15.554 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:15.554+0000 7fa29effd640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa2a0152240 0x7fa2a014ea60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:15.554 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:15.554+0000 7fa29effd640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa2a0152240 0x7fa2a014ea60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:49386/0 (socket says 172.21.15.73:49386) 2023-12-12T09:44:15.554 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:15.554+0000 7fa29effd640 1 -- 172.21.15.73:0/3103195891 learned_addr learned my addr 172.21.15.73:0/3103195891 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:44:15.556 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:15.554+0000 7fa29effd640 1 -- 172.21.15.73:0/3103195891 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa2a0156500 msgr2=0x7fa2a00aa8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:15.556 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:15.554+0000 7fa29effd640 1 --2- 172.21.15.73:0/3103195891 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa2a0156500 0x7fa2a00aa8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:15.556 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:15.554+0000 7fa29effd640 1 -- 172.21.15.73:0/3103195891 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa2a0152f30 msgr2=0x7fa2a01e10f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:15.556 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:15.554+0000 7fa29effd640 1 --2- 172.21.15.73:0/3103195891 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa2a0152f30 0x7fa2a01e10f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:15.556 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:15.554+0000 7fa29effd640 1 -- 172.21.15.73:0/3103195891 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa298009400 con 0x7fa2a0152240 2023-12-12T09:44:15.556 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:15.555+0000 7fa29effd640 1 --2- 172.21.15.73:0/3103195891 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa2a0152240 0x7fa2a014ea60 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fa290007ef0 tx=0x7fa29000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:44:15.556 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:15.555+0000 7fa297fff640 1 -- 172.21.15.73:0/3103195891 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa290014620 con 0x7fa2a0152240 2023-12-12T09:44:15.556 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:15.555+0000 7fa297fff640 1 -- 172.21.15.73:0/3103195891 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa290014780 con 0x7fa2a0152240 2023-12-12T09:44:15.556 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:15.555+0000 7fa2a59c5640 1 -- 172.21.15.73:0/3103195891 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2a0150270 con 0x7fa2a0152240 2023-12-12T09:44:15.556 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:15.555+0000 7fa297fff640 1 -- 172.21.15.73:0/3103195891 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa290014b30 con 0x7fa2a0152240 2023-12-12T09:44:15.556 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:15.555+0000 7fa2a59c5640 1 -- 172.21.15.73:0/3103195891 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2a00abd60 con 0x7fa2a0152240 2023-12-12T09:44:15.557 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:15.556+0000 7fa2a59c5640 1 -- 172.21.15.73:0/3103195891 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2a0067580 con 0x7fa2a0152240 2023-12-12T09:44:15.557 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:15.557+0000 7fa297fff640 1 -- 172.21.15.73:0/3103195891 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fa290014c90 con 0x7fa2a0152240 2023-12-12T09:44:15.558 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:15.558+0000 7fa297fff640 1 --2- 172.21.15.73:0/3103195891 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fa28006ae40 0x7fa28006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:15.558 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:15.558+0000 7fa297fff640 1 -- 172.21.15.73:0/3103195891 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fa290089cd0 con 0x7fa2a0152240 2023-12-12T09:44:15.558 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:15.558+0000 7fa29e7fc640 1 --2- 172.21.15.73:0/3103195891 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fa28006ae40 0x7fa28006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:15.558 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:15.559+0000 7fa29e7fc640 1 --2- 172.21.15.73:0/3103195891 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fa28006ae40 0x7fa28006d300 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fa2a0151e50 tx=0x7fa288007a40 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:44:15.562 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:15.562+0000 7fa297fff640 1 -- 172.21.15.73:0/3103195891 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fa2900550c0 con 0x7fa2a0152240 2023-12-12T09:44:15.822 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:15.822+0000 7fa2a59c5640 1 -- 172.21.15.73:0/3103195891 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) v1 -- 0x7fa2a00c88a0 con 0x7fa2a0152240 2023-12-12T09:44:15.827 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:15.826+0000 7fa297fff640 1 -- 172.21.15.73:0/3103195891 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v8) v1 ==== 90+0+0 (secure 0 0 0) 0x7fa2900586e0 con 0x7fa2a0152240 2023-12-12T09:44:15.829 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:15.829+0000 7fa2a59c5640 1 -- 172.21.15.73:0/3103195891 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fa28006ae40 msgr2=0x7fa28006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:15.830 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:15.829+0000 7fa2a59c5640 1 --2- 172.21.15.73:0/3103195891 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fa28006ae40 0x7fa28006d300 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fa2a0151e50 tx=0x7fa288007a40 comp rx=0 tx=0).stop 2023-12-12T09:44:15.830 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:15.829+0000 7fa2a59c5640 1 -- 172.21.15.73:0/3103195891 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa2a0152240 msgr2=0x7fa2a014ea60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:15.830 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:15.829+0000 7fa2a59c5640 1 --2- 172.21.15.73:0/3103195891 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa2a0152240 0x7fa2a014ea60 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fa290007ef0 tx=0x7fa29000e4b0 comp rx=0 tx=0).stop 2023-12-12T09:44:15.830 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:15.829+0000 7fa2a59c5640 1 -- 172.21.15.73:0/3103195891 shutdown_connections 2023-12-12T09:44:15.830 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:15.829+0000 7fa2a59c5640 1 --2- 172.21.15.73:0/3103195891 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fa28006ae40 0x7fa28006d300 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:15.830 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:15.829+0000 7fa2a59c5640 1 --2- 172.21.15.73:0/3103195891 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa2a0156500 0x7fa2a00aa8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:15.830 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:15.829+0000 7fa2a59c5640 1 --2- 172.21.15.73:0/3103195891 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa2a0152f30 0x7fa2a01e10f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:15.830 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:15.829+0000 7fa2a59c5640 1 --2- 172.21.15.73:0/3103195891 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa2a0152240 0x7fa2a014ea60 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:15.830 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:15.829+0000 7fa2a59c5640 1 -- 172.21.15.73:0/3103195891 >> 172.21.15.73:0/3103195891 conn(0x7fa2a00a99e0 msgr2=0x7fa2a006f3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:44:15.830 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:15.830+0000 7fa2a59c5640 1 -- 172.21.15.73:0/3103195891 shutdown_connections 2023-12-12T09:44:15.831 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:15.830+0000 7fa2a59c5640 1 -- 172.21.15.73:0/3103195891 wait complete. 2023-12-12T09:44:15.848 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2023-12-12T09:44:16.051 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:16.051+0000 7f41f8bc9640 1 Processor -- start 2023-12-12T09:44:16.051 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:16.051+0000 7f41f8bc9640 1 -- start start 2023-12-12T09:44:16.053 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:16.053+0000 7f41f8bc9640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f41f40ca000 0x7f41f40ca3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:16.053 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:16.053+0000 7f41f8bc9640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f41f40c81e0 0x7f41f4154530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:16.053 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:16.053+0000 7f41f8bc9640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41f40c7240 con 0x7f41f4154a70 2023-12-12T09:44:16.053 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:16.053+0000 7f41f8bc9640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41f40c5170 con 0x7f41f40c81e0 2023-12-12T09:44:16.053 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:16.053+0000 7f41f8bc9640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41f406c480 con 0x7f41f40ca000 2023-12-12T09:44:16.054 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:16.053+0000 7f41f37fe640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f41f40ca000 0x7f41f40ca3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:16.054 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:16.053+0000 7f41f2ffd640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f41f40c81e0 0x7f41f4154530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:16.054 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:16.053+0000 7f41f2ffd640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f41f40c81e0 0x7f41f4154530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.73:59052/0 (socket says 172.21.15.73:59052) 2023-12-12T09:44:16.054 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:16.054+0000 7f41f2ffd640 1 -- 172.21.15.73:0/1418447233 learned_addr learned my addr 172.21.15.73:0/1418447233 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:44:16.054 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:16.054+0000 7f41f2ffd640 1 -- 172.21.15.73:0/1418447233 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f41f40ca000 msgr2=0x7f41f40ca3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:44:16.055 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:16.054+0000 7f41f2ffd640 1 --2- 172.21.15.73:0/1418447233 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f41f40ca000 0x7f41f40ca3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:16.055 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:16.054+0000 7f41f2ffd640 1 -- 172.21.15.73:0/1418447233 >> v1:172.21.15.142:6789/0 conn(0x7f41f4154a70 legacy=0x7f41f4157aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:16.055 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:16.054+0000 7f41f2ffd640 1 -- 172.21.15.73:0/1418447233 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41f40c6910 con 0x7f41f40c81e0 2023-12-12T09:44:16.055 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:16.054+0000 7f41f37fe640 1 --2- 172.21.15.73:0/1418447233 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f41f40ca000 0x7f41f40ca3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-12T09:44:16.055 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:16.056+0000 7f41f2ffd640 1 --2- 172.21.15.73:0/1418447233 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f41f40c81e0 0x7f41f4154530 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f41e8009870 tx=0x7f41e802b980 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ff0d93daac99a610 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:44:16.056 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:16.056+0000 7f41f27fc640 1 -- 172.21.15.73:0/1418447233 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41e8030840 con 0x7f41f40c81e0 2023-12-12T09:44:16.056 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:16.056+0000 7f41f27fc640 1 -- 172.21.15.73:0/1418447233 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41e80309a0 con 0x7f41f40c81e0 2023-12-12T09:44:16.056 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:16.056+0000 7f41f27fc640 1 -- 172.21.15.73:0/1418447233 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41e8030d30 con 0x7f41f40c81e0 2023-12-12T09:44:16.057 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:16.057+0000 7f41f8bc9640 1 -- 172.21.15.73:0/1418447233 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f41f40c81e0 msgr2=0x7f41f4154530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:16.057 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:16.057+0000 7f41f8bc9640 1 --2- 172.21.15.73:0/1418447233 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f41f40c81e0 0x7f41f4154530 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f41e8009870 tx=0x7f41e802b980 comp rx=0 tx=0).stop 2023-12-12T09:44:16.057 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:16.057+0000 7f41f8bc9640 1 -- 172.21.15.73:0/1418447233 shutdown_connections 2023-12-12T09:44:16.057 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:16.057+0000 7f41f8bc9640 1 --2- 172.21.15.73:0/1418447233 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f41f40c81e0 0x7f41f4154530 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:16.057 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:16.057+0000 7f41f8bc9640 1 --2- 172.21.15.73:0/1418447233 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f41f40ca000 0x7f41f40ca3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:16.057 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:16.057+0000 7f41f8bc9640 1 -- 172.21.15.73:0/1418447233 >> 172.21.15.73:0/1418447233 conn(0x7f41f4071df0 msgr2=0x7f41f4072200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:44:16.057 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:16.057+0000 7f41f8bc9640 1 -- 172.21.15.73:0/1418447233 shutdown_connections 2023-12-12T09:44:16.057 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:16.057+0000 7f41f8bc9640 1 -- 172.21.15.73:0/1418447233 wait complete. 2023-12-12T09:44:16.058 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:16.059+0000 7f41f8bc9640 1 Processor -- start 2023-12-12T09:44:16.059 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:16.059+0000 7f41f8bc9640 1 -- start start 2023-12-12T09:44:16.060 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:16.060+0000 7f41f8bc9640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f41f40c81e0 0x7f41f40c3a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:16.060 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:16.060+0000 7f41f8bc9640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f41f40ca000 0x7f41f4155800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:16.060 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:16.060+0000 7f41f8bc9640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f41f4154a70 0x7f41f414edd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:16.060 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:16.060+0000 7f41f8bc9640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41f40c3590 con 0x7f41f40c81e0 2023-12-12T09:44:16.060 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:16.060+0000 7f41f8bc9640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41f4158690 con 0x7f41f40ca000 2023-12-12T09:44:16.060 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:16.060+0000 7f41f8bc9640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41f40c3f60 con 0x7f41f4154a70 2023-12-12T09:44:16.060 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:16.060+0000 7f41f37fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f41f40c81e0 0x7f41f40c3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:16.060 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:16.060+0000 7f41f37fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f41f40c81e0 0x7f41f40c3a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:49400/0 (socket says 172.21.15.73:49400) 2023-12-12T09:44:16.060 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:16.060+0000 7f41f37fe640 1 -- 172.21.15.73:0/2568304178 learned_addr learned my addr 172.21.15.73:0/2568304178 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:44:16.061 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:16.060+0000 7f41f37fe640 1 -- 172.21.15.73:0/2568304178 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f41f4154a70 msgr2=0x7f41f414edd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:16.062 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:16.060+0000 7f41f37fe640 1 --2- 172.21.15.73:0/2568304178 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f41f4154a70 0x7f41f414edd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:16.062 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:16.060+0000 7f41f37fe640 1 -- 172.21.15.73:0/2568304178 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f41f40ca000 msgr2=0x7f41f4155800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:16.062 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:16.060+0000 7f41f37fe640 1 --2- 172.21.15.73:0/2568304178 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f41f40ca000 0x7f41f4155800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:16.062 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:16.060+0000 7f41f37fe640 1 -- 172.21.15.73:0/2568304178 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41e4009400 con 0x7f41f40c81e0 2023-12-12T09:44:16.062 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:16.061+0000 7f41f37fe640 1 --2- 172.21.15.73:0/2568304178 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f41f40c81e0 0x7f41f40c3a20 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f41e400ec10 tx=0x7f41e400c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:44:16.062 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:16.061+0000 7f41dbfff640 1 -- 172.21.15.73:0/2568304178 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41e4009760 con 0x7f41f40c81e0 2023-12-12T09:44:16.062 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:16.061+0000 7f41dbfff640 1 -- 172.21.15.73:0/2568304178 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41e400cc30 con 0x7f41f40c81e0 2023-12-12T09:44:16.062 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:16.061+0000 7f41dbfff640 1 -- 172.21.15.73:0/2568304178 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41e4013470 con 0x7f41f40c81e0 2023-12-12T09:44:16.062 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:16.061+0000 7f41f8bc9640 1 -- 172.21.15.73:0/2568304178 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41e80094d0 con 0x7f41f40c81e0 2023-12-12T09:44:16.062 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:16.061+0000 7f41f8bc9640 1 -- 172.21.15.73:0/2568304178 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41f4155d40 con 0x7f41f40c81e0 2023-12-12T09:44:16.063 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:16.062+0000 7f41f8bc9640 1 -- 172.21.15.73:0/2568304178 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f41f4067400 con 0x7f41f40c81e0 2023-12-12T09:44:16.063 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:16.063+0000 7f41dbfff640 1 -- 172.21.15.73:0/2568304178 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f41e40135d0 con 0x7f41f40c81e0 2023-12-12T09:44:16.066 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:16.064+0000 7f41dbfff640 1 --2- 172.21.15.73:0/2568304178 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f41e006ae70 0x7f41e006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:16.066 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:16.064+0000 7f41dbfff640 1 -- 172.21.15.73:0/2568304178 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f41e4089530 con 0x7f41f40c81e0 2023-12-12T09:44:16.067 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:16.064+0000 7f41f2ffd640 1 --2- 172.21.15.73:0/2568304178 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f41e006ae70 0x7f41e006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:16.067 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:16.065+0000 7f41f2ffd640 1 --2- 172.21.15.73:0/2568304178 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f41e006ae70 0x7f41e006d330 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f41e8036000 tx=0x7f41e803b040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:44:16.068 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:16.068+0000 7f41dbfff640 1 -- 172.21.15.73:0/2568304178 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f41e4054920 con 0x7f41f40c81e0 2023-12-12T09:44:16.312 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:16.312+0000 7f41f8bc9640 1 -- 172.21.15.73:0/2568304178 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) v1 -- 0x7f41f4154850 con 0x7f41f40c81e0 2023-12-12T09:44:16.317 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:16.317+0000 7f41dbfff640 1 -- 172.21.15.73:0/2568304178 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v9) v1 ==== 97+0+0 (secure 0 0 0) 0x7f41e4057f40 con 0x7f41f40c81e0 2023-12-12T09:44:16.320 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:16.319+0000 7f41f8bc9640 1 -- 172.21.15.73:0/2568304178 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f41e006ae70 msgr2=0x7f41e006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:16.320 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:16.319+0000 7f41f8bc9640 1 --2- 172.21.15.73:0/2568304178 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f41e006ae70 0x7f41e006d330 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f41e8036000 tx=0x7f41e803b040 comp rx=0 tx=0).stop 2023-12-12T09:44:16.321 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:16.319+0000 7f41f8bc9640 1 -- 172.21.15.73:0/2568304178 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f41f40c81e0 msgr2=0x7f41f40c3a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:16.321 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:16.319+0000 7f41f8bc9640 1 --2- 172.21.15.73:0/2568304178 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f41f40c81e0 0x7f41f40c3a20 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f41e400ec10 tx=0x7f41e400c520 comp rx=0 tx=0).stop 2023-12-12T09:44:16.321 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:16.320+0000 7f41f8bc9640 1 -- 172.21.15.73:0/2568304178 shutdown_connections 2023-12-12T09:44:16.321 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:16.320+0000 7f41f8bc9640 1 --2- 172.21.15.73:0/2568304178 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f41e006ae70 0x7f41e006d330 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:16.321 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:16.320+0000 7f41f8bc9640 1 --2- 172.21.15.73:0/2568304178 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f41f4154a70 0x7f41f414edd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:16.321 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:16.320+0000 7f41f8bc9640 1 --2- 172.21.15.73:0/2568304178 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f41f40ca000 0x7f41f4155800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:16.321 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:16.320+0000 7f41f8bc9640 1 --2- 172.21.15.73:0/2568304178 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f41f40c81e0 0x7f41f40c3a20 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:16.321 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:16.320+0000 7f41f8bc9640 1 -- 172.21.15.73:0/2568304178 >> 172.21.15.73:0/2568304178 conn(0x7f41f4071df0 msgr2=0x7f41f4150940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:44:16.321 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:16.320+0000 7f41f8bc9640 1 -- 172.21.15.73:0/2568304178 shutdown_connections 2023-12-12T09:44:16.322 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:16.320+0000 7f41f8bc9640 1 -- 172.21.15.73:0/2568304178 wait complete. 2023-12-12T09:44:16.338 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2023-12-12T09:44:16.551 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:16.551+0000 7f72c67e3640 1 Processor -- start 2023-12-12T09:44:16.552 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:16.551+0000 7f72c67e3640 1 -- start start 2023-12-12T09:44:16.554 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:16.553+0000 7f72c67e3640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f72c006fca0 0x7f72c0072700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:16.554 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:16.553+0000 7f72c67e3640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f72c00c0420 0x7f72c0070080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:16.554 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:16.553+0000 7f72c67e3640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72c0152560 con 0x7f72c00c10d0 2023-12-12T09:44:16.554 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:16.553+0000 7f72c67e3640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72c0152ec0 con 0x7f72c00c0420 2023-12-12T09:44:16.554 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:16.553+0000 7f72c67e3640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72c00c53d0 con 0x7f72c006fca0 2023-12-12T09:44:16.554 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:16.553+0000 7f72b7fff640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f72c00c0420 0x7f72c0070080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:16.554 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:16.553+0000 7f72b7fff640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f72c00c0420 0x7f72c0070080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:49414/0 (socket says 172.21.15.73:49414) 2023-12-12T09:44:16.554 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:16.553+0000 7f72b7fff640 1 -- 172.21.15.73:0/3019602672 learned_addr learned my addr 172.21.15.73:0/3019602672 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:44:16.555 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:16.554+0000 7f72bffff640 1 --2- 172.21.15.73:0/3019602672 >> v2:172.21.15.142:3300/0 conn(0x7f72c006fca0 0x7f72c0072700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:16.555 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:16.554+0000 7f72b7fff640 1 -- 172.21.15.73:0/3019602672 >> v2:172.21.15.142:3300/0 conn(0x7f72c006fca0 msgr2=0x7f72c0072700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:44:16.555 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:16.554+0000 7f72b7fff640 1 --2- 172.21.15.73:0/3019602672 >> v2:172.21.15.142:3300/0 conn(0x7f72c006fca0 0x7f72c0072700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:16.555 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:16.554+0000 7f72b7fff640 1 -- 172.21.15.73:0/3019602672 >> v1:172.21.15.142:6789/0 conn(0x7f72c00c10d0 legacy=0x7f72c00c1560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:44:16.555 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:16.554+0000 7f72b7fff640 1 -- 172.21.15.73:0/3019602672 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72c01532e0 con 0x7f72c00c0420 2023-12-12T09:44:16.555 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:16.554+0000 7f72bffff640 1 --2- 172.21.15.73:0/3019602672 >> v2:172.21.15.142:3300/0 conn(0x7f72c006fca0 0x7f72c0072700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:44:16.556 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:16.555+0000 7f72b7fff640 1 --2- 172.21.15.73:0/3019602672 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f72c00c0420 0x7f72c0070080 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f72c0073cc0 tx=0x7f72a802b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60c6642ffe9f3163 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:44:16.556 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:16.555+0000 7f72bf7fe640 1 -- 172.21.15.73:0/3019602672 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72a80317e0 con 0x7f72c00c0420 2023-12-12T09:44:16.556 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:16.555+0000 7f72bf7fe640 1 -- 172.21.15.73:0/3019602672 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72a8031940 con 0x7f72c00c0420 2023-12-12T09:44:16.557 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:16.555+0000 7f72bf7fe640 1 -- 172.21.15.73:0/3019602672 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72a8031cd0 con 0x7f72c00c0420 2023-12-12T09:44:16.557 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:16.556+0000 7f72c67e3640 1 -- 172.21.15.73:0/3019602672 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f72c00c0420 msgr2=0x7f72c0070080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:16.557 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:16.556+0000 7f72c67e3640 1 --2- 172.21.15.73:0/3019602672 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f72c00c0420 0x7f72c0070080 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f72c0073cc0 tx=0x7f72a802b880 comp rx=0 tx=0).stop 2023-12-12T09:44:16.557 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:16.556+0000 7f72c67e3640 1 -- 172.21.15.73:0/3019602672 shutdown_connections 2023-12-12T09:44:16.557 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:16.556+0000 7f72c67e3640 1 --2- 172.21.15.73:0/3019602672 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f72c00c0420 0x7f72c0070080 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:16.557 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:16.556+0000 7f72c67e3640 1 --2- 172.21.15.73:0/3019602672 >> v2:172.21.15.142:3300/0 conn(0x7f72c006fca0 0x7f72c0072700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:16.557 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:16.556+0000 7f72c67e3640 1 -- 172.21.15.73:0/3019602672 >> 172.21.15.73:0/3019602672 conn(0x7f72c00a77d0 msgr2=0x7f72c00a7bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:44:16.557 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:16.556+0000 7f72c67e3640 1 -- 172.21.15.73:0/3019602672 shutdown_connections 2023-12-12T09:44:16.557 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:16.556+0000 7f72c67e3640 1 -- 172.21.15.73:0/3019602672 wait complete. 2023-12-12T09:44:16.558 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:16.558+0000 7f72c67e3640 1 Processor -- start 2023-12-12T09:44:16.558 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:16.558+0000 7f72c67e3640 1 -- start start 2023-12-12T09:44:16.560 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:16.560+0000 7f72c67e3640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f72c006fca0 0x7f72c00a9a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:16.560 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:16.560+0000 7f72c67e3640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f72c00c0420 0x7f72c01dcf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:16.561 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:16.560+0000 7f72c67e3640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f72c00c10d0 0x7f72c01dbc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:16.561 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:16.560+0000 7f72c67e3640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72c01dd450 con 0x7f72c00c0420 2023-12-12T09:44:16.561 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:16.560+0000 7f72c67e3640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72c00a89f0 con 0x7f72c006fca0 2023-12-12T09:44:16.561 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:16.560+0000 7f72c67e3640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72c00a8cd0 con 0x7f72c00c10d0 2023-12-12T09:44:16.561 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:16.560+0000 7f72b7fff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f72c00c0420 0x7f72c01dcf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:16.561 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:16.560+0000 7f72b7fff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f72c00c0420 0x7f72c01dcf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:49422/0 (socket says 172.21.15.73:49422) 2023-12-12T09:44:16.561 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:16.560+0000 7f72b7fff640 1 -- 172.21.15.73:0/690394566 learned_addr learned my addr 172.21.15.73:0/690394566 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:44:16.561 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:16.560+0000 7f72b7fff640 1 -- 172.21.15.73:0/690394566 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f72c00c10d0 msgr2=0x7f72c01dbc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:16.561 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:16.560+0000 7f72b7fff640 1 --2- 172.21.15.73:0/690394566 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f72c00c10d0 0x7f72c01dbc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:16.561 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:16.560+0000 7f72bffff640 1 --2- 172.21.15.73:0/690394566 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f72c006fca0 0x7f72c00a9a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:16.561 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:16.560+0000 7f72b7fff640 1 -- 172.21.15.73:0/690394566 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f72c006fca0 msgr2=0x7f72c00a9a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:16.561 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:16.560+0000 7f72b7fff640 1 --2- 172.21.15.73:0/690394566 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f72c006fca0 0x7f72c00a9a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:16.561 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:16.560+0000 7f72b7fff640 1 -- 172.21.15.73:0/690394566 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72a80094d0 con 0x7f72c00c0420 2023-12-12T09:44:16.561 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:16.561+0000 7f72b7fff640 1 --2- 172.21.15.73:0/690394566 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f72c00c0420 0x7f72c01dcf10 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f72a802b8c0 tx=0x7f72a80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:44:16.562 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:16.561+0000 7f72bd7fa640 1 -- 172.21.15.73:0/690394566 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72a80329c0 con 0x7f72c00c0420 2023-12-12T09:44:16.562 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:16.561+0000 7f72bd7fa640 1 -- 172.21.15.73:0/690394566 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72a8032b40 con 0x7f72c00c0420 2023-12-12T09:44:16.562 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:16.561+0000 7f72c67e3640 1 -- 172.21.15.73:0/690394566 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72c00a8fb0 con 0x7f72c00c0420 2023-12-12T09:44:16.563 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:16.561+0000 7f72bd7fa640 1 -- 172.21.15.73:0/690394566 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72a80453f0 con 0x7f72c00c0420 2023-12-12T09:44:16.563 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:16.561+0000 7f72c67e3640 1 -- 172.21.15.73:0/690394566 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72c00a9570 con 0x7f72c00c0420 2023-12-12T09:44:16.563 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:16.562+0000 7f72c67e3640 1 -- 172.21.15.73:0/690394566 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f72c00a9760 con 0x7f72c00c0420 2023-12-12T09:44:16.563 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:16.563+0000 7f72bd7fa640 1 -- 172.21.15.73:0/690394566 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f72a8045550 con 0x7f72c00c0420 2023-12-12T09:44:16.564 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:16.564+0000 7f72bd7fa640 1 --2- 172.21.15.73:0/690394566 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f72a006ae70 0x7f72a006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:16.564 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:16.565+0000 7f72bd7fa640 1 -- 172.21.15.73:0/690394566 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f72a80ab730 con 0x7f72c00c0420 2023-12-12T09:44:16.565 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:16.565+0000 7f72bffff640 1 --2- 172.21.15.73:0/690394566 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f72a006ae70 0x7f72a006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:16.565 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:16.565+0000 7f72bffff640 1 --2- 172.21.15.73:0/690394566 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f72a006ae70 0x7f72a006d330 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f72b0006fd0 tx=0x7f72b0008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:44:16.569 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:16.569+0000 7f72bd7fa640 1 -- 172.21.15.73:0/690394566 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f72a8076c40 con 0x7f72c00c0420 2023-12-12T09:44:16.830 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:16.829+0000 7f72c67e3640 1 -- 172.21.15.73:0/690394566 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) v1 -- 0x7f72c0067580 con 0x7f72c00c0420 2023-12-12T09:44:16.834 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:16.834+0000 7f72bd7fa640 1 -- 172.21.15.73:0/690394566 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v10) v1 ==== 90+0+0 (secure 0 0 0) 0x7f72a807a260 con 0x7f72c00c0420 2023-12-12T09:44:16.837 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:16.837+0000 7f72c67e3640 1 -- 172.21.15.73:0/690394566 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f72a006ae70 msgr2=0x7f72a006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:16.837 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:16.837+0000 7f72c67e3640 1 --2- 172.21.15.73:0/690394566 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f72a006ae70 0x7f72a006d330 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f72b0006fd0 tx=0x7f72b0008040 comp rx=0 tx=0).stop 2023-12-12T09:44:16.837 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:16.837+0000 7f72c67e3640 1 -- 172.21.15.73:0/690394566 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f72c00c0420 msgr2=0x7f72c01dcf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:16.837 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:16.837+0000 7f72c67e3640 1 --2- 172.21.15.73:0/690394566 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f72c00c0420 0x7f72c01dcf10 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f72a802b8c0 tx=0x7f72a80046c0 comp rx=0 tx=0).stop 2023-12-12T09:44:16.837 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:16.837+0000 7f72c67e3640 1 -- 172.21.15.73:0/690394566 shutdown_connections 2023-12-12T09:44:16.837 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:16.837+0000 7f72c67e3640 1 --2- 172.21.15.73:0/690394566 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f72a006ae70 0x7f72a006d330 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:16.838 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:16.837+0000 7f72c67e3640 1 --2- 172.21.15.73:0/690394566 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f72c00c10d0 0x7f72c01dbc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:16.838 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:16.837+0000 7f72c67e3640 1 --2- 172.21.15.73:0/690394566 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f72c00c0420 0x7f72c01dcf10 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:16.838 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:16.837+0000 7f72c67e3640 1 --2- 172.21.15.73:0/690394566 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f72c006fca0 0x7f72c00a9a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:16.838 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:16.837+0000 7f72c67e3640 1 -- 172.21.15.73:0/690394566 >> 172.21.15.73:0/690394566 conn(0x7f72c00a77d0 msgr2=0x7f72c00a5740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:44:16.838 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:16.837+0000 7f72c67e3640 1 -- 172.21.15.73:0/690394566 shutdown_connections 2023-12-12T09:44:16.838 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:16.837+0000 7f72c67e3640 1 -- 172.21.15.73:0/690394566 wait complete. 2023-12-12T09:44:16.855 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-12T09:44:17.062 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:17.062+0000 7faa611c9640 1 Processor -- start 2023-12-12T09:44:17.062 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:17.062+0000 7faa611c9640 1 -- start start 2023-12-12T09:44:17.063 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:17.063+0000 7faa611c9640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7faa5c1552e0 0x7faa5c0c49c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:17.064 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:17.063+0000 7faa611c9640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7faa5c06bf20 0x7faa5c0a9760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:17.064 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:17.063+0000 7faa611c9640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa5c0c0b50 con 0x7faa5c0a50f0 2023-12-12T09:44:17.064 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:17.063+0000 7faa611c9640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa5c0c04d0 con 0x7faa5c1552e0 2023-12-12T09:44:17.064 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:17.064+0000 7faa611c9640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa5c06c880 con 0x7faa5c06bf20 2023-12-12T09:44:17.064 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:17.064+0000 7faa5b59e640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7faa5c06bf20 0x7faa5c0a9760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:17.064 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:17.064+0000 7faa5ad9d640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7faa5c1552e0 0x7faa5c0c49c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:17.065 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:17.064+0000 7faa5b59e640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7faa5c06bf20 0x7faa5c0a9760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.73:38496/0 (socket says 172.21.15.73:38496) 2023-12-12T09:44:17.065 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:17.064+0000 7faa5b59e640 1 -- 172.21.15.73:0/2622893692 learned_addr learned my addr 172.21.15.73:0/2622893692 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:44:17.065 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:17.065+0000 7faa5ad9d640 1 -- 172.21.15.73:0/2622893692 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7faa5c06bf20 msgr2=0x7faa5c0a9760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:44:17.065 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:17.065+0000 7faa5ad9d640 1 --2- 172.21.15.73:0/2622893692 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7faa5c06bf20 0x7faa5c0a9760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:17.065 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:17.065+0000 7faa5ad9d640 1 -- 172.21.15.73:0/2622893692 >> v1:172.21.15.142:6789/0 conn(0x7faa5c0a50f0 legacy=0x7faa5c0a9050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:44:17.065 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:17.065+0000 7faa5ad9d640 1 -- 172.21.15.73:0/2622893692 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa5c06cb60 con 0x7faa5c1552e0 2023-12-12T09:44:17.066 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:17.066+0000 7faa5ad9d640 1 --2- 172.21.15.73:0/2622893692 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7faa5c1552e0 0x7faa5c0c49c0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7faa440097a0 tx=0x7faa4402b7a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f9f15c92c227ce02 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:44:17.067 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:17.067+0000 7faa59d9b640 1 -- 172.21.15.73:0/2622893692 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa4402f050 con 0x7faa5c1552e0 2023-12-12T09:44:17.067 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:17.067+0000 7faa59d9b640 1 -- 172.21.15.73:0/2622893692 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa44031700 con 0x7faa5c1552e0 2023-12-12T09:44:17.067 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:17.067+0000 7faa59d9b640 1 -- 172.21.15.73:0/2622893692 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa44031a90 con 0x7faa5c1552e0 2023-12-12T09:44:17.068 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:17.067+0000 7faa611c9640 1 -- 172.21.15.73:0/2622893692 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7faa5c1552e0 msgr2=0x7faa5c0c49c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:17.068 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:17.067+0000 7faa611c9640 1 --2- 172.21.15.73:0/2622893692 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7faa5c1552e0 0x7faa5c0c49c0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7faa440097a0 tx=0x7faa4402b7a0 comp rx=0 tx=0).stop 2023-12-12T09:44:17.068 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:17.067+0000 7faa611c9640 1 -- 172.21.15.73:0/2622893692 shutdown_connections 2023-12-12T09:44:17.068 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:17.067+0000 7faa611c9640 1 --2- 172.21.15.73:0/2622893692 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7faa5c06bf20 0x7faa5c0a9760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:17.068 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:17.067+0000 7faa611c9640 1 --2- 172.21.15.73:0/2622893692 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7faa5c1552e0 0x7faa5c0c49c0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:17.068 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:17.067+0000 7faa611c9640 1 -- 172.21.15.73:0/2622893692 >> 172.21.15.73:0/2622893692 conn(0x7faa5c0a8130 msgr2=0x7faa5c0c24b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:44:17.068 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:17.067+0000 7faa611c9640 1 -- 172.21.15.73:0/2622893692 shutdown_connections 2023-12-12T09:44:17.068 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:17.068+0000 7faa611c9640 1 -- 172.21.15.73:0/2622893692 wait complete. 2023-12-12T09:44:17.069 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:17.069+0000 7faa611c9640 1 Processor -- start 2023-12-12T09:44:17.069 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:17.069+0000 7faa611c9640 1 -- start start 2023-12-12T09:44:17.072 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:17.070+0000 7faa611c9640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7faa5c06bf20 0x7faa5c071980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:17.072 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:17.070+0000 7faa611c9640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7faa5c0a50f0 0x7faa5c14bc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:17.072 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:17.070+0000 7faa611c9640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7faa5c1552e0 0x7faa5c1ed830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:17.072 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:17.070+0000 7faa611c9640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa5c071560 con 0x7faa5c0a50f0 2023-12-12T09:44:17.072 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:17.070+0000 7faa611c9640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa5c0705e0 con 0x7faa5c1552e0 2023-12-12T09:44:17.072 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:17.070+0000 7faa611c9640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa5c14c1b0 con 0x7faa5c06bf20 2023-12-12T09:44:17.072 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:17.070+0000 7faa5a59c640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7faa5c0a50f0 0x7faa5c14bc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:17.072 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:17.071+0000 7faa5a59c640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7faa5c0a50f0 0x7faa5c14bc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:49426/0 (socket says 172.21.15.73:49426) 2023-12-12T09:44:17.073 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:17.071+0000 7faa5a59c640 1 -- 172.21.15.73:0/1440804821 learned_addr learned my addr 172.21.15.73:0/1440804821 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:44:17.073 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:17.071+0000 7faa5b59e640 1 --2- 172.21.15.73:0/1440804821 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7faa5c1552e0 0x7faa5c1ed830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:17.073 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:17.071+0000 7faa5ad9d640 1 --2- 172.21.15.73:0/1440804821 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7faa5c06bf20 0x7faa5c071980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:17.073 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:17.071+0000 7faa5a59c640 1 -- 172.21.15.73:0/1440804821 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7faa5c06bf20 msgr2=0x7faa5c071980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:17.073 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:17.071+0000 7faa5a59c640 1 --2- 172.21.15.73:0/1440804821 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7faa5c06bf20 0x7faa5c071980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:17.073 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:17.071+0000 7faa5a59c640 1 -- 172.21.15.73:0/1440804821 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7faa5c1552e0 msgr2=0x7faa5c1ed830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:17.074 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:17.071+0000 7faa5a59c640 1 --2- 172.21.15.73:0/1440804821 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7faa5c1552e0 0x7faa5c1ed830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:17.074 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:17.071+0000 7faa5a59c640 1 -- 172.21.15.73:0/1440804821 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa44009400 con 0x7faa5c0a50f0 2023-12-12T09:44:17.074 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:17.071+0000 7faa5b59e640 1 --2- 172.21.15.73:0/1440804821 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7faa5c1552e0 0x7faa5c1ed830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:44:17.074 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:17.071+0000 7faa5a59c640 1 --2- 172.21.15.73:0/1440804821 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7faa5c0a50f0 0x7faa5c14bc70 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7faa4c00c780 tx=0x7faa4c00cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:44:17.074 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:17.071+0000 7faa537fe640 1 -- 172.21.15.73:0/1440804821 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa4c00aa50 con 0x7faa5c0a50f0 2023-12-12T09:44:17.074 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:17.072+0000 7faa537fe640 1 -- 172.21.15.73:0/1440804821 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa4c00ce90 con 0x7faa5c0a50f0 2023-12-12T09:44:17.074 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:17.072+0000 7faa611c9640 1 -- 172.21.15.73:0/1440804821 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa5c14e420 con 0x7faa5c0a50f0 2023-12-12T09:44:17.074 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:17.072+0000 7faa537fe640 1 -- 172.21.15.73:0/1440804821 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa4c00ae30 con 0x7faa5c0a50f0 2023-12-12T09:44:17.074 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:17.072+0000 7faa611c9640 1 -- 172.21.15.73:0/1440804821 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa5c14e9e0 con 0x7faa5c0a50f0 2023-12-12T09:44:17.075 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:17.073+0000 7faa611c9640 1 -- 172.21.15.73:0/1440804821 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa5c06cfd0 con 0x7faa5c0a50f0 2023-12-12T09:44:17.075 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:17.074+0000 7faa537fe640 1 -- 172.21.15.73:0/1440804821 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7faa4c012420 con 0x7faa5c0a50f0 2023-12-12T09:44:17.075 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:17.075+0000 7faa537fe640 1 --2- 172.21.15.73:0/1440804821 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7faa3c06ae40 0x7faa3c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:17.075 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:17.075+0000 7faa537fe640 1 -- 172.21.15.73:0/1440804821 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 4857+0+0 (secure 0 0 0) 0x7faa4c089490 con 0x7faa5c0a50f0 2023-12-12T09:44:17.075 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:17.075+0000 7faa5ad9d640 1 --2- 172.21.15.73:0/1440804821 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7faa3c06ae40 0x7faa3c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:17.080 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:17.076+0000 7faa5ad9d640 1 --2- 172.21.15.73:0/1440804821 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7faa3c06ae40 0x7faa3c06d300 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7faa44035000 tx=0x7faa44008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:44:17.080 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:17.081+0000 7faa537fe640 1 -- 172.21.15.73:0/1440804821 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7faa5c06cfd0 con 0x7faa5c0a50f0 2023-12-12T09:44:17.273 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:17.273+0000 7faa611c9640 1 -- 172.21.15.73:0/1440804821 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7faa5c0716a0 con 0x7faa5c0a50f0 2023-12-12T09:44:17.275 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:17.275+0000 7faa537fe640 1 -- 172.21.15.73:0/1440804821 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v30) v1 ==== 74+0+12869 (secure 0 0 0) 0x7faa5c0716a0 con 0x7faa5c0a50f0 2023-12-12T09:44:17.275 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-12T09:44:17.275 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":30,"fsid":"ba240992-02b8-4c7e-92f2-27eb29ac433b","created":"2023-12-12T09:43:02.454719+0000","modified":"2023-12-12T09:44:13.271565+0000","last_up_change":"2023-12-12T09:43:13.913440+0000","last_in_change":"2023-12-12T09:43:05.925348+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-12T09:43:15.525508+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"dd9074be-dbe2-4c34-9896-a4223d8d3940","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":4047810203},{"type":"v1","addr":"172.21.15.73:6801","nonce":4047810203}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":4047810203},{"type":"v1","addr":"172.21.15.73:6803","nonce":4047810203}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":4047810203},{"type":"v1","addr":"172.21.15.73:6807","nonce":4047810203}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":4047810203},{"type":"v1","addr":"172.21.15.73:6805","nonce":4047810203}]},"public_addr":"172.21.15.73:6801/4047810203","cluster_addr":"172.21.15.73:6803/4047810203","heartbeat_back_addr":"172.21.15.73:6807/4047810203","heartbeat_front_addr":"172.21.15.73:6805/4047810203","state":["exists","up"]},{"osd":1,"uuid":"c4a05052-96d4-4758-a4e1-1a37f1e07fed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":1356058331},{"type":"v1","addr":"172.21.15.73:6824","nonce":1356058331}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":1356058331},{"type":"v1","addr":"172.21.15.73:6827","nonce":1356058331}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":1356058331},{"type":"v1","addr":"172.21.15.73:6831","nonce":1356058331}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":1356058331},{"type":"v1","addr":"172.21.15.73:6829","nonce":1356058331}]},"public_addr":"172.21.15.73:6824/1356058331","cluster_addr":"172.21.15.73:6827/1356058331","heartbeat_back_addr":"172.21.15.73:6831/1356058331","heartbeat_front_addr":"172.21.15.73:6829/1356058331","state":["exists","up"]},{"osd":2,"uuid":"512bc8ac-72c2-40d4-b3d2-d867a92c5213","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":1228903316},{"type":"v1","addr":"172.21.15.73:6817","nonce":1228903316}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":1228903316},{"type":"v1","addr":"172.21.15.73:6819","nonce":1228903316}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6823","nonce":1228903316},{"type":"v1","addr":"172.21.15.73:6825","nonce":1228903316}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":1228903316},{"type":"v1","addr":"172.21.15.73:6821","nonce":1228903316}]},"public_addr":"172.21.15.73:6817/1228903316","cluster_addr":"172.21.15.73:6819/1228903316","heartbeat_back_addr":"172.21.15.73:6825/1228903316","heartbeat_front_addr":"172.21.15.73:6821/1228903316","state":["exists","up"]},{"osd":3,"uuid":"3d1a91e0-42bf-437a-8eae-8d357c8f63a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":1293329670},{"type":"v1","addr":"172.21.15.73:6809","nonce":1293329670}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6810","nonce":1293329670},{"type":"v1","addr":"172.21.15.73:6811","nonce":1293329670}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":1293329670},{"type":"v1","addr":"172.21.15.73:6815","nonce":1293329670}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":1293329670},{"type":"v1","addr":"172.21.15.73:6813","nonce":1293329670}]},"public_addr":"172.21.15.73:6809/1293329670","cluster_addr":"172.21.15.73:6811/1293329670","heartbeat_back_addr":"172.21.15.73:6815/1293329670","heartbeat_front_addr":"172.21.15.73:6813/1293329670","state":["exists","up"]},{"osd":4,"uuid":"4b302fff-834c-4069-ac19-00e46f6c87b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":3727975702},{"type":"v1","addr":"172.21.15.142:6801","nonce":3727975702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":3727975702},{"type":"v1","addr":"172.21.15.142:6803","nonce":3727975702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6809","nonce":3727975702},{"type":"v1","addr":"172.21.15.142:6811","nonce":3727975702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6805","nonce":3727975702},{"type":"v1","addr":"172.21.15.142:6807","nonce":3727975702}]},"public_addr":"172.21.15.142:6801/3727975702","cluster_addr":"172.21.15.142:6803/3727975702","heartbeat_back_addr":"172.21.15.142:6811/3727975702","heartbeat_front_addr":"172.21.15.142:6807/3727975702","state":["exists","up"]},{"osd":5,"uuid":"d7cdace2-67d0-45cc-95f2-515cf6ef1b82","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6817","nonce":2353193632},{"type":"v1","addr":"172.21.15.142:6819","nonce":2353193632}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6821","nonce":2353193632},{"type":"v1","addr":"172.21.15.142:6823","nonce":2353193632}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6829","nonce":2353193632},{"type":"v1","addr":"172.21.15.142:6831","nonce":2353193632}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6825","nonce":2353193632},{"type":"v1","addr":"172.21.15.142:6827","nonce":2353193632}]},"public_addr":"172.21.15.142:6819/2353193632","cluster_addr":"172.21.15.142:6823/2353193632","heartbeat_back_addr":"172.21.15.142:6831/2353193632","heartbeat_front_addr":"172.21.15.142:6827/2353193632","state":["exists","up"]},{"osd":6,"uuid":"649ce78a-5626-445c-aedc-a651ed05a6f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":2006111986},{"type":"v1","addr":"172.21.15.142:6806","nonce":2006111986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":2006111986},{"type":"v1","addr":"172.21.15.142:6810","nonce":2006111986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":2006111986},{"type":"v1","addr":"172.21.15.142:6815","nonce":2006111986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":2006111986},{"type":"v1","addr":"172.21.15.142:6813","nonce":2006111986}]},"public_addr":"172.21.15.142:6806/2006111986","cluster_addr":"172.21.15.142:6810/2006111986","heartbeat_back_addr":"172.21.15.142:6815/2006111986","heartbeat_front_addr":"172.21.15.142:6813/2006111986","state":["exists","up"]},{"osd":7,"uuid":"af15ae3b-c1d0-4acf-92db-8a1805494d13","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":2573794341},{"type":"v1","addr":"172.21.15.142:6818","nonce":2573794341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":2573794341},{"type":"v1","addr":"172.21.15.142:6822","nonce":2573794341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":2573794341},{"type":"v1","addr":"172.21.15.142:6830","nonce":2573794341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":2573794341},{"type":"v1","addr":"172.21.15.142:6826","nonce":2573794341}]},"public_addr":"172.21.15.142:6818/2573794341","cluster_addr":"172.21.15.142:6822/2573794341","heartbeat_back_addr":"172.21.15.142:6830/2573794341","heartbeat_front_addr":"172.21.15.142:6826/2573794341","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.185824+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.262103+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.225556+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:10.523459+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:10.706035+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.257339+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.301776+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.051960+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-12T09:44:17.278 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:17.277+0000 7faa611c9640 1 -- 172.21.15.73:0/1440804821 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7faa3c06ae40 msgr2=0x7faa3c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:17.278 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:17.277+0000 7faa611c9640 1 --2- 172.21.15.73:0/1440804821 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7faa3c06ae40 0x7faa3c06d300 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7faa44035000 tx=0x7faa44008030 comp rx=0 tx=0).stop 2023-12-12T09:44:17.278 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:17.277+0000 7faa611c9640 1 -- 172.21.15.73:0/1440804821 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7faa5c0a50f0 msgr2=0x7faa5c14bc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:17.278 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:17.277+0000 7faa611c9640 1 --2- 172.21.15.73:0/1440804821 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7faa5c0a50f0 0x7faa5c14bc70 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7faa4c00c780 tx=0x7faa4c00cc40 comp rx=0 tx=0).stop 2023-12-12T09:44:17.278 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:17.278+0000 7faa611c9640 1 -- 172.21.15.73:0/1440804821 shutdown_connections 2023-12-12T09:44:17.278 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:17.278+0000 7faa611c9640 1 --2- 172.21.15.73:0/1440804821 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7faa3c06ae40 0x7faa3c06d300 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:17.278 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:17.278+0000 7faa611c9640 1 --2- 172.21.15.73:0/1440804821 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7faa5c1552e0 0x7faa5c1ed830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:17.278 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:17.278+0000 7faa611c9640 1 --2- 172.21.15.73:0/1440804821 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7faa5c0a50f0 0x7faa5c14bc70 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:17.278 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:17.278+0000 7faa611c9640 1 --2- 172.21.15.73:0/1440804821 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7faa5c06bf20 0x7faa5c071980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:17.278 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:17.278+0000 7faa611c9640 1 -- 172.21.15.73:0/1440804821 >> 172.21.15.73:0/1440804821 conn(0x7faa5c0a8130 msgr2=0x7faa5c1531c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:44:17.278 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:17.278+0000 7faa611c9640 1 -- 172.21.15.73:0/1440804821 shutdown_connections 2023-12-12T09:44:17.279 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:17.278+0000 7faa611c9640 1 -- 172.21.15.73:0/1440804821 wait complete. 2023-12-12T09:44:17.297 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-12T09:43:15.525508+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-12T09:44:17.297 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-12T09:44:17.503 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:17.503+0000 7f2c29de3640 1 Processor -- start 2023-12-12T09:44:17.503 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:17.503+0000 7f2c29de3640 1 -- start start 2023-12-12T09:44:17.506 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:17.504+0000 7f2c29de3640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f2c2414f8c0 0x7f2c2406dc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:17.506 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:17.504+0000 7f2c29de3640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c240c16c0 con 0x7f2c24152500 2023-12-12T09:44:17.506 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:17.504+0000 7f2c29de3640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c240c19a0 con 0x7f2c2406d350 2023-12-12T09:44:17.507 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:17.504+0000 7f2c29de3640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c240c1090 con 0x7f2c2414f8c0 2023-12-12T09:44:17.507 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:17.504+0000 7f2c23fff640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f2c24152500 0x7f2c24152990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:33268/0 (socket says 172.21.15.73:33268) 2023-12-12T09:44:17.507 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:17.504+0000 7f2c23fff640 1 -- 172.21.15.73:0/661451917 learned_addr learned my addr 172.21.15.73:0/661451917 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-12T09:44:17.507 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:17.505+0000 7f2c237fe640 1 --2- 172.21.15.73:0/661451917 >> v2:172.21.15.142:3300/0 conn(0x7f2c2414f8c0 0x7f2c2406dc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:17.507 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:17.505+0000 7f2c22ffd640 1 -- 172.21.15.73:0/661451917 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 612627364 0 0) 0x7f2c240c16c0 con 0x7f2c24152500 2023-12-12T09:44:17.507 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:17.505+0000 7f2c22ffd640 1 -- 172.21.15.73:0/661451917 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2c10003520 con 0x7f2c24152500 2023-12-12T09:44:17.507 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:17.505+0000 7f2c22ffd640 1 -- 172.21.15.73:0/661451917 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2458942821 0 0) 0x7f2c10003520 con 0x7f2c24152500 2023-12-12T09:44:17.507 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:17.505+0000 7f2c22ffd640 1 -- 172.21.15.73:0/661451917 >> v2:172.21.15.142:3300/0 conn(0x7f2c2414f8c0 msgr2=0x7f2c2406dc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:44:17.507 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:17.505+0000 7f2c22ffd640 1 --2- 172.21.15.73:0/661451917 >> v2:172.21.15.142:3300/0 conn(0x7f2c2414f8c0 0x7f2c2406dc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:17.507 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:17.505+0000 7f2c22ffd640 1 -- 172.21.15.73:0/661451917 >> v1:172.21.15.142:6789/0 conn(0x7f2c2406d350 legacy=0x7f2c24071e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:44:17.507 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:17.505+0000 7f2c22ffd640 1 -- 172.21.15.73:0/661451917 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c240c1c80 con 0x7f2c24152500 2023-12-12T09:44:17.507 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:17.505+0000 7f2c22ffd640 1 -- 172.21.15.73:0/661451917 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3186547832 0 0) 0x7f2c1c0019f0 con 0x7f2c24152500 2023-12-12T09:44:17.508 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:17.505+0000 7f2c22ffd640 1 -- 172.21.15.73:0/661451917 >> v1:172.21.15.73:6789/0 conn(0x7f2c24152500 legacy=0x7f2c24152990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:17.508 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:17.505+0000 7f2c22ffd640 1 --2- 172.21.15.73:0/661451917 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2c10003970 0x7f2c10003d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:17.508 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:17.505+0000 7f2c22ffd640 1 --2- 172.21.15.73:0/661451917 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2c100047c0 0x7f2c10004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:17.508 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:17.505+0000 7f2c22ffd640 1 --2- 172.21.15.73:0/661451917 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2c10005180 0x7f2c1000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:17.508 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:17.505+0000 7f2c22ffd640 1 -- 172.21.15.73:0/661451917 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c1000c080 con 0x7f2c10003970 2023-12-12T09:44:17.508 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:17.505+0000 7f2c22ffd640 1 -- 172.21.15.73:0/661451917 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c1000c1f0 con 0x7f2c100047c0 2023-12-12T09:44:17.508 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:17.505+0000 7f2c22ffd640 1 -- 172.21.15.73:0/661451917 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c1000c3b0 con 0x7f2c10005180 2023-12-12T09:44:17.508 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:17.506+0000 7f2c237fe640 1 --2- 172.21.15.73:0/661451917 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2c10003970 0x7f2c10003d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:17.508 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:17.506+0000 7f2c237fe640 1 -- 172.21.15.73:0/661451917 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2c10005180 msgr2=0x7f2c1000b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:44:17.508 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:17.506+0000 7f2c237fe640 1 --2- 172.21.15.73:0/661451917 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2c10005180 0x7f2c1000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:17.508 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:17.506+0000 7f2c237fe640 1 -- 172.21.15.73:0/661451917 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2c100047c0 msgr2=0x7f2c10004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:44:17.508 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:17.506+0000 7f2c1bfff640 1 --2- 172.21.15.73:0/661451917 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2c100047c0 0x7f2c10004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:17.508 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:17.506+0000 7f2c237fe640 1 --2- 172.21.15.73:0/661451917 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2c100047c0 0x7f2c10004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:17.508 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:17.506+0000 7f2c23fff640 1 -- 172.21.15.73:0/661451917 reap_dead start 2023-12-12T09:44:17.508 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:17.506+0000 7f2c237fe640 1 -- 172.21.15.73:0/661451917 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c10003520 con 0x7f2c10003970 2023-12-12T09:44:17.509 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:17.506+0000 7f2c1bfff640 1 --2- 172.21.15.73:0/661451917 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2c100047c0 0x7f2c10004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:44:17.510 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:17.507+0000 7f2c237fe640 1 --2- 172.21.15.73:0/661451917 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2c10003970 0x7f2c10003d70 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f2c1400ba00 tx=0x7f2c100057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4896d9cf2d1133e4 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:44:17.510 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:17.508+0000 7f2c22ffd640 1 -- 172.21.15.73:0/661451917 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c140325f0 con 0x7f2c10003970 2023-12-12T09:44:17.510 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:17.508+0000 7f2c22ffd640 1 -- 172.21.15.73:0/661451917 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c14032750 con 0x7f2c10003970 2023-12-12T09:44:17.510 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:17.508+0000 7f2c22ffd640 1 -- 172.21.15.73:0/661451917 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c14032ae0 con 0x7f2c10003970 2023-12-12T09:44:17.510 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:17.508+0000 7f2c29de3640 1 -- 172.21.15.73:0/661451917 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2c10003970 msgr2=0x7f2c10003d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:17.510 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:17.508+0000 7f2c29de3640 1 --2- 172.21.15.73:0/661451917 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2c10003970 0x7f2c10003d70 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f2c1400ba00 tx=0x7f2c100057f0 comp rx=0 tx=0).stop 2023-12-12T09:44:17.511 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:17.508+0000 7f2c29de3640 1 -- 172.21.15.73:0/661451917 shutdown_connections 2023-12-12T09:44:17.511 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:17.508+0000 7f2c29de3640 1 --2- 172.21.15.73:0/661451917 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2c10003970 0x7f2c10003d70 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:17.511 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:17.508+0000 7f2c29de3640 1 -- 172.21.15.73:0/661451917 >> 172.21.15.73:0/661451917 conn(0x7f2c2406a4e0 msgr2=0x7f2c2406a8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:44:17.511 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:17.508+0000 7f2c29de3640 1 -- 172.21.15.73:0/661451917 shutdown_connections 2023-12-12T09:44:17.511 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:17.508+0000 7f2c29de3640 1 -- 172.21.15.73:0/661451917 wait complete. 2023-12-12T09:44:17.511 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:17.510+0000 7f2c29de3640 1 Processor -- start 2023-12-12T09:44:17.511 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:17.510+0000 7f2c29de3640 1 -- start start 2023-12-12T09:44:17.513 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:17.511+0000 7f2c29de3640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2c10003970 0x7f2c241555b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:17.513 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:17.511+0000 7f2c29de3640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2c24149690 0x7f2c2413cab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:17.513 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:17.511+0000 7f2c29de3640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2c240a71f0 0x7f2c2413cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:17.513 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:17.511+0000 7f2c29de3640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c240a5600 con 0x7f2c24149690 2023-12-12T09:44:17.513 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:17.511+0000 7f2c29de3640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c2413d530 con 0x7f2c240a71f0 2023-12-12T09:44:17.513 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:17.511+0000 7f2c29de3640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c24153d60 con 0x7f2c10003970 2023-12-12T09:44:17.513 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:17.511+0000 7f2c1bfff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2c24149690 0x7f2c2413cab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:17.513 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:17.511+0000 7f2c1bfff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2c24149690 0x7f2c2413cab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:49450/0 (socket says 172.21.15.73:49450) 2023-12-12T09:44:17.513 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:17.511+0000 7f2c1bfff640 1 -- 172.21.15.73:0/2230029041 learned_addr learned my addr 172.21.15.73:0/2230029041 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:44:17.513 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:17.512+0000 7f2c237fe640 1 --2- 172.21.15.73:0/2230029041 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2c10003970 0x7f2c241555b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:17.513 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:17.512+0000 7f2c23fff640 1 --2- 172.21.15.73:0/2230029041 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2c240a71f0 0x7f2c2413cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:17.513 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:17.512+0000 7f2c1bfff640 1 -- 172.21.15.73:0/2230029041 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2c10003970 msgr2=0x7f2c241555b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:17.513 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:17.512+0000 7f2c1bfff640 1 --2- 172.21.15.73:0/2230029041 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2c10003970 0x7f2c241555b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:17.514 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:17.512+0000 7f2c1bfff640 1 -- 172.21.15.73:0/2230029041 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2c240a71f0 msgr2=0x7f2c2413cff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:17.514 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:17.512+0000 7f2c1bfff640 1 --2- 172.21.15.73:0/2230029041 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2c240a71f0 0x7f2c2413cff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:17.514 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:17.512+0000 7f2c1bfff640 1 -- 172.21.15.73:0/2230029041 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c24154cf0 con 0x7f2c24149690 2023-12-12T09:44:17.514 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:17.512+0000 7f2c1bfff640 1 --2- 172.21.15.73:0/2230029041 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2c24149690 0x7f2c2413cab0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f2c0c00d430 tx=0x7f2c0c00d8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:44:17.514 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:17.512+0000 7f2c20ff9640 1 -- 172.21.15.73:0/2230029041 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c0c007020 con 0x7f2c24149690 2023-12-12T09:44:17.514 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:17.512+0000 7f2c20ff9640 1 -- 172.21.15.73:0/2230029041 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c0c007180 con 0x7f2c24149690 2023-12-12T09:44:17.514 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:17.512+0000 7f2c29de3640 1 -- 172.21.15.73:0/2230029041 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c24153fe0 con 0x7f2c24149690 2023-12-12T09:44:17.514 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:17.512+0000 7f2c20ff9640 1 -- 172.21.15.73:0/2230029041 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c0c007530 con 0x7f2c24149690 2023-12-12T09:44:17.514 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:17.513+0000 7f2c29de3640 1 -- 172.21.15.73:0/2230029041 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c240a5220 con 0x7f2c24149690 2023-12-12T09:44:17.515 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:17.514+0000 7f2c29de3640 1 -- 172.21.15.73:0/2230029041 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c240a53e0 con 0x7f2c24149690 2023-12-12T09:44:17.515 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:17.515+0000 7f2c20ff9640 1 -- 172.21.15.73:0/2230029041 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f2c0c0067d0 con 0x7f2c24149690 2023-12-12T09:44:17.516 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:17.516+0000 7f2c20ff9640 1 --2- 172.21.15.73:0/2230029041 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f2c0406ae70 0x7f2c0406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:17.516 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:17.516+0000 7f2c20ff9640 1 -- 172.21.15.73:0/2230029041 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f2c0c088c40 con 0x7f2c24149690 2023-12-12T09:44:17.516 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:17.516+0000 7f2c237fe640 1 --2- 172.21.15.73:0/2230029041 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f2c0406ae70 0x7f2c0406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:17.517 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:17.517+0000 7f2c237fe640 1 --2- 172.21.15.73:0/2230029041 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f2c0406ae70 0x7f2c0406d330 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f2c100057a0 tx=0x7f2c1403d040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:44:17.521 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:17.521+0000 7f2c20ff9640 1 -- 172.21.15.73:0/2230029041 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f2c0c054040 con 0x7f2c24149690 2023-12-12T09:44:17.712 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:17.711+0000 7f2c29de3640 1 -- 172.21.15.73:0/2230029041 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f2c240a5740 con 0x7f2c24149690 2023-12-12T09:44:17.712 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:17.712+0000 7f2c20ff9640 1 -- 172.21.15.73:0/2230029041 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v30) v1 ==== 93+0+10 (secure 0 0 0) 0x7f2c240a5740 con 0x7f2c24149690 2023-12-12T09:44:17.713 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 1 2023-12-12T09:44:17.716 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:17.715+0000 7f2c29de3640 1 -- 172.21.15.73:0/2230029041 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f2c0406ae70 msgr2=0x7f2c0406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:17.716 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:17.715+0000 7f2c29de3640 1 --2- 172.21.15.73:0/2230029041 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f2c0406ae70 0x7f2c0406d330 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f2c100057a0 tx=0x7f2c1403d040 comp rx=0 tx=0).stop 2023-12-12T09:44:17.716 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:17.715+0000 7f2c29de3640 1 -- 172.21.15.73:0/2230029041 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2c24149690 msgr2=0x7f2c2413cab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:17.716 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:17.715+0000 7f2c29de3640 1 --2- 172.21.15.73:0/2230029041 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2c24149690 0x7f2c2413cab0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f2c0c00d430 tx=0x7f2c0c00d8f0 comp rx=0 tx=0).stop 2023-12-12T09:44:17.716 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:17.715+0000 7f2c29de3640 1 -- 172.21.15.73:0/2230029041 shutdown_connections 2023-12-12T09:44:17.716 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:17.715+0000 7f2c29de3640 1 --2- 172.21.15.73:0/2230029041 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f2c0406ae70 0x7f2c0406d330 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:17.716 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:17.715+0000 7f2c29de3640 1 --2- 172.21.15.73:0/2230029041 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2c240a71f0 0x7f2c2413cff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:17.717 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:17.716+0000 7f2c29de3640 1 --2- 172.21.15.73:0/2230029041 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2c24149690 0x7f2c2413cab0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:17.717 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:17.716+0000 7f2c29de3640 1 --2- 172.21.15.73:0/2230029041 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2c10003970 0x7f2c241555b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:17.717 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:17.716+0000 7f2c29de3640 1 -- 172.21.15.73:0/2230029041 >> 172.21.15.73:0/2230029041 conn(0x7f2c2406a4e0 msgr2=0x7f2c2414bed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:44:17.717 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:17.716+0000 7f2c29de3640 1 -- 172.21.15.73:0/2230029041 shutdown_connections 2023-12-12T09:44:17.717 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:17.716+0000 7f2c29de3640 1 -- 172.21.15.73:0/2230029041 wait complete. 2023-12-12T09:44:17.735 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-12-12T09:44:17.945 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:17.945+0000 7ff13e8cf640 1 Processor -- start 2023-12-12T09:44:17.946 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:17.946+0000 7ff13e8cf640 1 -- start start 2023-12-12T09:44:17.947 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:17.947+0000 7ff13e8cf640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff13814fa40 0x7ff13806a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:17.947 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:17.947+0000 7ff13e8cf640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff138152610 con 0x7ff1380c5070 2023-12-12T09:44:17.947 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:17.947+0000 7ff13e8cf640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1381528f0 con 0x7ff13806db70 2023-12-12T09:44:17.947 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:17.947+0000 7ff13e8cf640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff138152bd0 con 0x7ff13814fa40 2023-12-12T09:44:17.949 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:17.947+0000 7ff13ce6c640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7ff1380c5070 0x7ff1380c40c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:33272/0 (socket says 172.21.15.73:33272) 2023-12-12T09:44:17.949 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:17.947+0000 7ff13ce6c640 1 -- 172.21.15.73:0/1746279144 learned_addr learned my addr 172.21.15.73:0/1746279144 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-12T09:44:17.949 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:17.947+0000 7ff137fff640 1 --2- 172.21.15.73:0/1746279144 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff13814fa40 0x7ff13806a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:17.949 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:17.947+0000 7ff1377fe640 1 -- 172.21.15.73:0/1746279144 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4213199175 0 0) 0x7ff138152610 con 0x7ff1380c5070 2023-12-12T09:44:17.949 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:17.948+0000 7ff1377fe640 1 -- 172.21.15.73:0/1746279144 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff124003520 con 0x7ff1380c5070 2023-12-12T09:44:17.949 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:17.948+0000 7ff1377fe640 1 -- 172.21.15.73:0/1746279144 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3147835811 0 0) 0x7ff124003520 con 0x7ff1380c5070 2023-12-12T09:44:17.949 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:17.948+0000 7ff1377fe640 1 -- 172.21.15.73:0/1746279144 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff13814fa40 msgr2=0x7ff13806a4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:44:17.949 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:17.948+0000 7ff1377fe640 1 --2- 172.21.15.73:0/1746279144 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff13814fa40 0x7ff13806a4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:17.950 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:17.948+0000 7ff1377fe640 1 -- 172.21.15.73:0/1746279144 >> v1:172.21.15.142:6789/0 conn(0x7ff13806db70 legacy=0x7ff1380c39b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:17.950 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:17.948+0000 7ff1377fe640 1 -- 172.21.15.73:0/1746279144 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff138152eb0 con 0x7ff1380c5070 2023-12-12T09:44:17.950 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:17.948+0000 7ff1377fe640 1 -- 172.21.15.73:0/1746279144 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3186547832 0 0) 0x7ff1300019f0 con 0x7ff1380c5070 2023-12-12T09:44:17.950 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:17.948+0000 7ff1377fe640 1 -- 172.21.15.73:0/1746279144 >> v1:172.21.15.73:6789/0 conn(0x7ff1380c5070 legacy=0x7ff1380c40c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:17.950 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:17.948+0000 7ff1377fe640 1 --2- 172.21.15.73:0/1746279144 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff1240039a0 0x7ff124003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:17.950 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:17.948+0000 7ff1377fe640 1 --2- 172.21.15.73:0/1746279144 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff1240047c0 0x7ff124004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:17.950 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:17.948+0000 7ff1377fe640 1 --2- 172.21.15.73:0/1746279144 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff13814fa40 0x7ff12400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:17.950 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:17.948+0000 7ff1377fe640 1 -- 172.21.15.73:0/1746279144 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff138152bd0 con 0x7ff1240047c0 2023-12-12T09:44:17.950 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:17.948+0000 7ff1377fe640 1 -- 172.21.15.73:0/1746279144 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1240054e0 con 0x7ff1240039a0 2023-12-12T09:44:17.950 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:17.948+0000 7ff1377fe640 1 -- 172.21.15.73:0/1746279144 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff12400bec0 con 0x7ff13814fa40 2023-12-12T09:44:17.950 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:17.948+0000 7ff12ffff640 1 --2- 172.21.15.73:0/1746279144 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff1240047c0 0x7ff124004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:17.950 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:17.949+0000 7ff137fff640 1 --2- 172.21.15.73:0/1746279144 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff1240039a0 0x7ff124003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:17.950 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:17.949+0000 7ff13ce6c640 1 --2- 172.21.15.73:0/1746279144 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff13814fa40 0x7ff12400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:17.951 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:17.949+0000 7ff12ffff640 1 -- 172.21.15.73:0/1746279144 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff13814fa40 msgr2=0x7ff12400b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:44:17.951 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:17.949+0000 7ff12ffff640 1 --2- 172.21.15.73:0/1746279144 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff13814fa40 0x7ff12400b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:17.951 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:17.949+0000 7ff12ffff640 1 -- 172.21.15.73:0/1746279144 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff1240039a0 msgr2=0x7ff124003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:44:17.951 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:17.949+0000 7ff12ffff640 1 --2- 172.21.15.73:0/1746279144 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff1240039a0 0x7ff124003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:17.951 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:17.949+0000 7ff12ffff640 1 -- 172.21.15.73:0/1746279144 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff124003520 con 0x7ff1240047c0 2023-12-12T09:44:17.951 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:17.949+0000 7ff13ce6c640 1 --2- 172.21.15.73:0/1746279144 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff13814fa40 0x7ff12400b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:44:17.952 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:17.950+0000 7ff12ffff640 1 --2- 172.21.15.73:0/1746279144 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff1240047c0 0x7ff124004c40 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7ff120001720 tx=0x7ff1240057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3dea3528beeb2f8 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:44:17.952 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:17.950+0000 7ff1377fe640 1 -- 172.21.15.73:0/1746279144 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1200052d0 con 0x7ff1240047c0 2023-12-12T09:44:17.952 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:17.950+0000 7ff1377fe640 1 -- 172.21.15.73:0/1746279144 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff12002e050 con 0x7ff1240047c0 2023-12-12T09:44:17.952 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:17.950+0000 7ff1377fe640 1 -- 172.21.15.73:0/1746279144 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1200035f0 con 0x7ff1240047c0 2023-12-12T09:44:17.952 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:17.951+0000 7ff13e8cf640 1 -- 172.21.15.73:0/1746279144 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff1240047c0 msgr2=0x7ff124004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:17.952 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:17.951+0000 7ff13e8cf640 1 --2- 172.21.15.73:0/1746279144 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff1240047c0 0x7ff124004c40 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7ff120001720 tx=0x7ff1240057f0 comp rx=0 tx=0).stop 2023-12-12T09:44:17.952 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:17.951+0000 7ff13ce6c640 1 -- 172.21.15.73:0/1746279144 reap_dead start 2023-12-12T09:44:17.952 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:17.951+0000 7ff13e8cf640 1 -- 172.21.15.73:0/1746279144 shutdown_connections 2023-12-12T09:44:17.952 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:17.951+0000 7ff13e8cf640 1 -- 172.21.15.73:0/1746279144 >> 172.21.15.73:0/1746279144 conn(0x7ff1380a8130 msgr2=0x7ff1380c24b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:44:17.952 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:17.951+0000 7ff13e8cf640 1 -- 172.21.15.73:0/1746279144 shutdown_connections 2023-12-12T09:44:17.953 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:17.951+0000 7ff13e8cf640 1 -- 172.21.15.73:0/1746279144 wait complete. 2023-12-12T09:44:17.953 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:17.953+0000 7ff13e8cf640 1 Processor -- start 2023-12-12T09:44:17.953 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:17.953+0000 7ff13e8cf640 1 -- start start 2023-12-12T09:44:17.955 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:17.954+0000 7ff13e8cf640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff1240047c0 0x7ff1380715f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:17.955 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:17.954+0000 7ff13e8cf640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff138151340 0x7ff13806ffa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:17.955 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:17.954+0000 7ff13e8cf640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff1380704e0 0x7ff13814a100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:17.955 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:17.954+0000 7ff13e8cf640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff138151a70 con 0x7ff1240047c0 2023-12-12T09:44:17.955 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:17.954+0000 7ff13e8cf640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1381eb090 con 0x7ff1380704e0 2023-12-12T09:44:17.955 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:17.954+0000 7ff13e8cf640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1381eb370 con 0x7ff138151340 2023-12-12T09:44:17.955 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:17.954+0000 7ff137fff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff1240047c0 0x7ff1380715f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:17.955 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:17.954+0000 7ff137fff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff1240047c0 0x7ff1380715f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:49458/0 (socket says 172.21.15.73:49458) 2023-12-12T09:44:17.955 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:17.954+0000 7ff137fff640 1 -- 172.21.15.73:0/2099746940 learned_addr learned my addr 172.21.15.73:0/2099746940 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:44:17.955 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:17.955+0000 7ff12ffff640 1 --2- 172.21.15.73:0/2099746940 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff138151340 0x7ff13806ffa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:17.956 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:17.955+0000 7ff13ce6c640 1 --2- 172.21.15.73:0/2099746940 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff1380704e0 0x7ff13814a100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:17.956 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:17.955+0000 7ff137fff640 1 -- 172.21.15.73:0/2099746940 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff138151340 msgr2=0x7ff13806ffa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:17.956 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:17.955+0000 7ff137fff640 1 --2- 172.21.15.73:0/2099746940 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff138151340 0x7ff13806ffa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:17.956 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:17.955+0000 7ff137fff640 1 -- 172.21.15.73:0/2099746940 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff1380704e0 msgr2=0x7ff13814a100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:17.956 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:17.955+0000 7ff137fff640 1 --2- 172.21.15.73:0/2099746940 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff1380704e0 0x7ff13814a100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:17.956 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:17.955+0000 7ff137fff640 1 -- 172.21.15.73:0/2099746940 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1381eb650 con 0x7ff1240047c0 2023-12-12T09:44:17.956 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:17.955+0000 7ff12ffff640 1 --2- 172.21.15.73:0/2099746940 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff138151340 0x7ff13806ffa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:44:17.956 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:17.955+0000 7ff137fff640 1 --2- 172.21.15.73:0/2099746940 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff1240047c0 0x7ff1380715f0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7ff12800f580 tx=0x7ff12800fa40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:44:17.957 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:17.955+0000 7ff1357fa640 1 -- 172.21.15.73:0/2099746940 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff128014870 con 0x7ff1240047c0 2023-12-12T09:44:17.957 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:17.955+0000 7ff1357fa640 1 -- 172.21.15.73:0/2099746940 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1280149d0 con 0x7ff1240047c0 2023-12-12T09:44:17.957 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:17.955+0000 7ff1357fa640 1 -- 172.21.15.73:0/2099746940 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff128014d80 con 0x7ff1240047c0 2023-12-12T09:44:17.957 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:17.955+0000 7ff13e8cf640 1 -- 172.21.15.73:0/2099746940 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1381eb930 con 0x7ff1240047c0 2023-12-12T09:44:17.957 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:17.955+0000 7ff13e8cf640 1 -- 172.21.15.73:0/2099746940 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1381ead40 con 0x7ff1240047c0 2023-12-12T09:44:17.957 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:17.957+0000 7ff13e8cf640 1 -- 172.21.15.73:0/2099746940 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff1380008d0 con 0x7ff1240047c0 2023-12-12T09:44:17.957 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:17.957+0000 7ff1357fa640 1 -- 172.21.15.73:0/2099746940 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7ff128015410 con 0x7ff1240047c0 2023-12-12T09:44:17.958 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:17.958+0000 7ff1357fa640 1 --2- 172.21.15.73:0/2099746940 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7ff11806ae40 0x7ff11806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:17.958 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:17.958+0000 7ff1357fa640 1 -- 172.21.15.73:0/2099746940 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 4857+0+0 (secure 0 0 0) 0x7ff128089cc0 con 0x7ff1240047c0 2023-12-12T09:44:17.958 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:17.959+0000 7ff12ffff640 1 --2- 172.21.15.73:0/2099746940 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7ff11806ae40 0x7ff11806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:17.959 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:17.959+0000 7ff12ffff640 1 --2- 172.21.15.73:0/2099746940 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7ff11806ae40 0x7ff11806d300 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7ff120033000 tx=0x7ff120009030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:44:17.962 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:17.963+0000 7ff1357fa640 1 -- 172.21.15.73:0/2099746940 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7ff1280550d0 con 0x7ff1240047c0 2023-12-12T09:44:18.154 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:18.154+0000 7ff13e8cf640 1 -- 172.21.15.73:0/2099746940 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7ff1381506b0 con 0x7ff1240047c0 2023-12-12T09:44:18.154 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:18.154+0000 7ff1357fa640 1 -- 172.21.15.73:0/2099746940 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v30) v1 ==== 84+0+65 (secure 0 0 0) 0x7ff1280586f0 con 0x7ff1240047c0 2023-12-12T09:44:18.154 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-12T09:44:18.155 INFO:teuthology.orchestra.run.smithi073.stdout:[ 2023-12-12T09:44:18.155 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-12-12T09:44:18.155 INFO:teuthology.orchestra.run.smithi073.stdout: "poolnum": 1, 2023-12-12T09:44:18.155 INFO:teuthology.orchestra.run.smithi073.stdout: "poolname": ".mgr" 2023-12-12T09:44:18.155 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-12-12T09:44:18.155 INFO:teuthology.orchestra.run.smithi073.stdout:] 2023-12-12T09:44:18.157 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:18.157+0000 7ff13e8cf640 1 -- 172.21.15.73:0/2099746940 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7ff11806ae40 msgr2=0x7ff11806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:18.157 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:18.157+0000 7ff13e8cf640 1 --2- 172.21.15.73:0/2099746940 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7ff11806ae40 0x7ff11806d300 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7ff120033000 tx=0x7ff120009030 comp rx=0 tx=0).stop 2023-12-12T09:44:18.157 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:18.157+0000 7ff13e8cf640 1 -- 172.21.15.73:0/2099746940 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff1240047c0 msgr2=0x7ff1380715f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:18.157 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:18.157+0000 7ff13e8cf640 1 --2- 172.21.15.73:0/2099746940 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff1240047c0 0x7ff1380715f0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7ff12800f580 tx=0x7ff12800fa40 comp rx=0 tx=0).stop 2023-12-12T09:44:18.157 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:18.157+0000 7ff13e8cf640 1 -- 172.21.15.73:0/2099746940 shutdown_connections 2023-12-12T09:44:18.157 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:18.157+0000 7ff13e8cf640 1 --2- 172.21.15.73:0/2099746940 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7ff11806ae40 0x7ff11806d300 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:18.158 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:18.157+0000 7ff13e8cf640 1 --2- 172.21.15.73:0/2099746940 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff1380704e0 0x7ff13814a100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:18.158 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:18.157+0000 7ff13e8cf640 1 --2- 172.21.15.73:0/2099746940 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff138151340 0x7ff13806ffa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:18.158 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:18.157+0000 7ff13e8cf640 1 --2- 172.21.15.73:0/2099746940 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff1240047c0 0x7ff1380715f0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:18.158 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:18.157+0000 7ff13e8cf640 1 -- 172.21.15.73:0/2099746940 >> 172.21.15.73:0/2099746940 conn(0x7ff1380a8130 msgr2=0x7ff1380a5990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:44:18.158 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:18.157+0000 7ff13e8cf640 1 -- 172.21.15.73:0/2099746940 shutdown_connections 2023-12-12T09:44:18.158 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:18.157+0000 7ff13e8cf640 1 -- 172.21.15.73:0/2099746940 wait complete. 2023-12-12T09:44:18.175 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-12-12T09:44:18.176 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-12-12T09:44:18.334 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T09:44:18.343 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T09:44:18.381 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:18.381+0000 7fea26abb640 1 Processor -- start 2023-12-12T09:44:18.381 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:18.381+0000 7fea26abb640 1 -- start start 2023-12-12T09:44:18.382 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:18.382+0000 7fea26abb640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fea200c67c0 0x7fea200c7ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:18.382 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:18.382+0000 7fea26abb640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea200c7030 con 0x7fea200c6ba0 2023-12-12T09:44:18.382 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:18.382+0000 7fea26abb640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea2006c890 con 0x7fea201550a0 2023-12-12T09:44:18.382 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:18.382+0000 7fea26abb640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea200c4af0 con 0x7fea200c67c0 2023-12-12T09:44:18.382 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:18.382+0000 7fea1ffff640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7fea200c6ba0 0x7fea2006c180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:33278/0 (socket says 172.21.15.73:33278) 2023-12-12T09:44:18.382 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:18.382+0000 7fea1ffff640 1 -- 172.21.15.73:0/820569407 learned_addr learned my addr 172.21.15.73:0/820569407 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-12T09:44:18.383 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:18.382+0000 7fea24857640 1 --2- 172.21.15.73:0/820569407 >> v2:172.21.15.142:3300/0 conn(0x7fea200c67c0 0x7fea200c7ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:18.384 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:18.383+0000 7fea1f7fe640 1 -- 172.21.15.73:0/820569407 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 791917233 0 0) 0x7fea0c001110 con 0x7fea200c6ba0 2023-12-12T09:44:18.384 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:18.383+0000 7fea1f7fe640 1 -- 172.21.15.73:0/820569407 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fea10003520 con 0x7fea200c6ba0 2023-12-12T09:44:18.385 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:18.383+0000 7fea1f7fe640 1 -- 172.21.15.73:0/820569407 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 897849800 0 0) 0x7fea10003520 con 0x7fea200c6ba0 2023-12-12T09:44:18.385 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:18.383+0000 7fea1f7fe640 1 -- 172.21.15.73:0/820569407 >> v2:172.21.15.142:3300/0 conn(0x7fea200c67c0 msgr2=0x7fea200c7ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:44:18.385 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:18.383+0000 7fea1f7fe640 1 --2- 172.21.15.73:0/820569407 >> v2:172.21.15.142:3300/0 conn(0x7fea200c67c0 0x7fea200c7ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:18.385 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:18.383+0000 7fea1f7fe640 1 -- 172.21.15.73:0/820569407 >> v1:172.21.15.142:6789/0 conn(0x7fea201550a0 legacy=0x7fea2015efa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:18.385 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:18.383+0000 7fea1f7fe640 1 -- 172.21.15.73:0/820569407 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea200c4dd0 con 0x7fea200c6ba0 2023-12-12T09:44:18.385 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:18.383+0000 7fea1f7fe640 1 -- 172.21.15.73:0/820569407 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3186547832 0 0) 0x7fea0c001800 con 0x7fea200c6ba0 2023-12-12T09:44:18.385 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:18.383+0000 7fea24857640 1 --2- 172.21.15.73:0/820569407 >> v2:172.21.15.142:3300/0 conn(0x7fea200c67c0 0x7fea200c7ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-12T09:44:18.385 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:18.383+0000 7fea1f7fe640 1 -- 172.21.15.73:0/820569407 >> v1:172.21.15.73:6789/0 conn(0x7fea200c6ba0 legacy=0x7fea2006c180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:18.385 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:18.383+0000 7fea1f7fe640 1 --2- 172.21.15.73:0/820569407 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fea100039c0 0x7fea10003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:18.385 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:18.383+0000 7fea1f7fe640 1 --2- 172.21.15.73:0/820569407 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fea100047c0 0x7fea10004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:18.385 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:18.383+0000 7fea1f7fe640 1 --2- 172.21.15.73:0/820569407 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fea10005180 0x7fea1000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:18.385 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:18.383+0000 7fea1f7fe640 1 -- 172.21.15.73:0/820569407 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea200c4af0 con 0x7fea10005180 2023-12-12T09:44:18.385 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:18.383+0000 7fea1f7fe640 1 -- 172.21.15.73:0/820569407 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea1000c080 con 0x7fea100039c0 2023-12-12T09:44:18.385 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:18.383+0000 7fea1f7fe640 1 -- 172.21.15.73:0/820569407 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea1000c240 con 0x7fea100047c0 2023-12-12T09:44:18.386 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:18.384+0000 7fea25058640 1 --2- 172.21.15.73:0/820569407 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fea10005180 0x7fea1000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:18.386 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:18.384+0000 7fea24857640 1 --2- 172.21.15.73:0/820569407 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fea100039c0 0x7fea10003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:18.386 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:18.384+0000 7fea1ffff640 1 --2- 172.21.15.73:0/820569407 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fea100047c0 0x7fea10004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:18.386 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:18.384+0000 7fea25058640 1 -- 172.21.15.73:0/820569407 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fea100047c0 msgr2=0x7fea10004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:44:18.386 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:18.384+0000 7fea25058640 1 --2- 172.21.15.73:0/820569407 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fea100047c0 0x7fea10004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:18.386 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:18.384+0000 7fea25058640 1 -- 172.21.15.73:0/820569407 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fea100039c0 msgr2=0x7fea10003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:44:18.386 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:18.384+0000 7fea25058640 1 --2- 172.21.15.73:0/820569407 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fea100039c0 0x7fea10003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:18.386 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:18.384+0000 7fea25058640 1 -- 172.21.15.73:0/820569407 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea10003520 con 0x7fea10005180 2023-12-12T09:44:18.387 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:18.385+0000 7fea25058640 1 -- 172.21.15.73:0/820569407 reap_dead start 2023-12-12T09:44:18.387 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:18.385+0000 7fea25058640 1 --2- 172.21.15.73:0/820569407 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fea10005180 0x7fea1000b980 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fea18001e50 tx=0x7fea100057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c590793209ec4ff server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:44:18.387 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:18.385+0000 7fea1f7fe640 1 -- 172.21.15.73:0/820569407 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea18003b70 con 0x7fea10005180 2023-12-12T09:44:18.387 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:18.385+0000 7fea1f7fe640 1 -- 172.21.15.73:0/820569407 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea18003cf0 con 0x7fea10005180 2023-12-12T09:44:18.387 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:18.385+0000 7fea1f7fe640 1 -- 172.21.15.73:0/820569407 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea18005310 con 0x7fea10005180 2023-12-12T09:44:18.388 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:18.386+0000 7fea26abb640 1 -- 172.21.15.73:0/820569407 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fea10005180 msgr2=0x7fea1000b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:18.388 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:18.386+0000 7fea26abb640 1 --2- 172.21.15.73:0/820569407 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fea10005180 0x7fea1000b980 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fea18001e50 tx=0x7fea100057f0 comp rx=0 tx=0).stop 2023-12-12T09:44:18.388 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:18.386+0000 7fea26abb640 1 -- 172.21.15.73:0/820569407 shutdown_connections 2023-12-12T09:44:18.388 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:18.386+0000 7fea26abb640 1 --2- 172.21.15.73:0/820569407 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fea10005180 0x7fea1000b980 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:18.388 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:18.386+0000 7fea26abb640 1 -- 172.21.15.73:0/820569407 >> 172.21.15.73:0/820569407 conn(0x7fea200abb20 msgr2=0x7fea200abf30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:44:18.388 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:18.386+0000 7fea26abb640 1 -- 172.21.15.73:0/820569407 shutdown_connections 2023-12-12T09:44:18.388 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:18.386+0000 7fea26abb640 1 -- 172.21.15.73:0/820569407 wait complete. 2023-12-12T09:44:18.392 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:18.388+0000 7fea26abb640 1 Processor -- start 2023-12-12T09:44:18.392 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:18.388+0000 7fea26abb640 1 -- start start 2023-12-12T09:44:18.392 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:18.389+0000 7fea26abb640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fea10005180 0x7fea200adf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:18.392 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:18.389+0000 7fea26abb640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fea200c08c0 0x7fea200c0000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:18.392 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:18.389+0000 7fea26abb640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fea20158800 0x7fea200bf140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:18.392 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:18.389+0000 7fea26abb640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea20156f60 con 0x7fea200c08c0 2023-12-12T09:44:18.392 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:18.389+0000 7fea26abb640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea200becb0 con 0x7fea10005180 2023-12-12T09:44:18.392 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:18.389+0000 7fea26abb640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea200be980 con 0x7fea20158800 2023-12-12T09:44:18.392 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:18.389+0000 7fea1ffff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fea200c08c0 0x7fea200c0000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:18.393 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:18.389+0000 7fea1ffff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fea200c08c0 0x7fea200c0000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:49482/0 (socket says 172.21.15.73:49482) 2023-12-12T09:44:18.393 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:18.389+0000 7fea1ffff640 1 -- 172.21.15.73:0/1344304205 learned_addr learned my addr 172.21.15.73:0/1344304205 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:44:18.393 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:18.389+0000 7fea24857640 1 --2- 172.21.15.73:0/1344304205 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fea10005180 0x7fea200adf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:18.393 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:18.389+0000 7fea25058640 1 --2- 172.21.15.73:0/1344304205 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fea20158800 0x7fea200bf140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:18.393 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:18.390+0000 7fea1ffff640 1 -- 172.21.15.73:0/1344304205 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fea20158800 msgr2=0x7fea200bf140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:18.393 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:18.390+0000 7fea1ffff640 1 --2- 172.21.15.73:0/1344304205 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fea20158800 0x7fea200bf140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:18.393 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:18.390+0000 7fea1ffff640 1 -- 172.21.15.73:0/1344304205 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fea10005180 msgr2=0x7fea200adf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:18.393 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:18.390+0000 7fea1ffff640 1 --2- 172.21.15.73:0/1344304205 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fea10005180 0x7fea200adf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:18.393 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:18.390+0000 7fea1ffff640 1 -- 172.21.15.73:0/1344304205 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea20156190 con 0x7fea200c08c0 2023-12-12T09:44:18.393 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:18.390+0000 7fea1ffff640 1 --2- 172.21.15.73:0/1344304205 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fea200c08c0 0x7fea200c0000 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fea0c007290 tx=0x7fea0c007750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:44:18.393 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:18.390+0000 7fea1d7fa640 1 -- 172.21.15.73:0/1344304205 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea0c007e10 con 0x7fea200c08c0 2023-12-12T09:44:18.393 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:18.390+0000 7fea1d7fa640 1 -- 172.21.15.73:0/1344304205 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea0c00f9c0 con 0x7fea200c08c0 2023-12-12T09:44:18.393 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:18.390+0000 7fea1d7fa640 1 -- 172.21.15.73:0/1344304205 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea0c00fd70 con 0x7fea200c08c0 2023-12-12T09:44:18.393 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:18.390+0000 7fea26abb640 1 -- 172.21.15.73:0/1344304205 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea20156470 con 0x7fea200c08c0 2023-12-12T09:44:18.393 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:18.390+0000 7fea26abb640 1 -- 172.21.15.73:0/1344304205 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea20155e20 con 0x7fea200c08c0 2023-12-12T09:44:18.394 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:18.391+0000 7fea26abb640 1 -- 172.21.15.73:0/1344304205 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea200bedf0 con 0x7fea200c08c0 2023-12-12T09:44:18.394 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:18.392+0000 7fea1d7fa640 1 -- 172.21.15.73:0/1344304205 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fea0c01d360 con 0x7fea200c08c0 2023-12-12T09:44:18.394 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:18.393+0000 7fea1d7fa640 1 --2- 172.21.15.73:0/1344304205 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fea0406ae40 0x7fea0406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:18.395 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:18.393+0000 7fea1d7fa640 1 -- 172.21.15.73:0/1344304205 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fea0c0889f0 con 0x7fea200c08c0 2023-12-12T09:44:18.395 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:18.394+0000 7fea24857640 1 --2- 172.21.15.73:0/1344304205 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fea0406ae40 0x7fea0406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:18.395 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:18.394+0000 7fea24857640 1 --2- 172.21.15.73:0/1344304205 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fea0406ae40 0x7fea0406d300 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fea140093d0 tx=0x7fea14009190 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:44:18.397 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:18.398+0000 7fea1d7fa640 1 -- 172.21.15.73:0/1344304205 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fea0c053e00 con 0x7fea200c08c0 2023-12-12T09:44:18.591 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:18.591+0000 7fea26abb640 1 -- 172.21.15.73:0/1344304205 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fea200c7030 con 0x7fea200c08c0 2023-12-12T09:44:19.465 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:19.464+0000 7fea1d7fa640 1 -- 172.21.15.73:0/1344304205 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v31) v1 ==== 138+0+0 (secure 0 0 0) 0x7fea200c7030 con 0x7fea200c08c0 2023-12-12T09:44:19.465 INFO:teuthology.orchestra.run.smithi073.stderr:pool 'cephfs_metadata' created 2023-12-12T09:44:19.468 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:19.468+0000 7fea26abb640 1 -- 172.21.15.73:0/1344304205 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fea0406ae40 msgr2=0x7fea0406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:19.468 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:19.468+0000 7fea26abb640 1 --2- 172.21.15.73:0/1344304205 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fea0406ae40 0x7fea0406d300 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fea140093d0 tx=0x7fea14009190 comp rx=0 tx=0).stop 2023-12-12T09:44:19.468 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:19.468+0000 7fea26abb640 1 -- 172.21.15.73:0/1344304205 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fea200c08c0 msgr2=0x7fea200c0000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:19.468 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:19.468+0000 7fea26abb640 1 --2- 172.21.15.73:0/1344304205 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fea200c08c0 0x7fea200c0000 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fea0c007290 tx=0x7fea0c007750 comp rx=0 tx=0).stop 2023-12-12T09:44:19.468 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:19.468+0000 7fea26abb640 1 -- 172.21.15.73:0/1344304205 shutdown_connections 2023-12-12T09:44:19.469 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:19.468+0000 7fea26abb640 1 --2- 172.21.15.73:0/1344304205 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fea0406ae40 0x7fea0406d300 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:19.469 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:19.468+0000 7fea26abb640 1 --2- 172.21.15.73:0/1344304205 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fea20158800 0x7fea200bf140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:19.469 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:19.468+0000 7fea26abb640 1 --2- 172.21.15.73:0/1344304205 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fea200c08c0 0x7fea200c0000 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:19.469 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:19.468+0000 7fea26abb640 1 --2- 172.21.15.73:0/1344304205 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fea10005180 0x7fea200adf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:19.469 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:19.468+0000 7fea26abb640 1 -- 172.21.15.73:0/1344304205 >> 172.21.15.73:0/1344304205 conn(0x7fea200abb20 msgr2=0x7fea200a9750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:44:19.469 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:19.468+0000 7fea26abb640 1 -- 172.21.15.73:0/1344304205 shutdown_connections 2023-12-12T09:44:19.469 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:19.468+0000 7fea26abb640 1 -- 172.21.15.73:0/1344304205 wait complete. 2023-12-12T09:44:19.494 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-12-12T09:44:19.692 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:19.692+0000 7f4c25e1c640 1 Processor -- start 2023-12-12T09:44:19.692 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:19.692+0000 7f4c25e1c640 1 -- start start 2023-12-12T09:44:19.694 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:19.693+0000 7f4c25e1c640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f4c2006d350 0x7f4c2006dc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:19.694 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:19.694+0000 7f4c25e1c640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c200c16c0 con 0x7f4c2014f8c0 2023-12-12T09:44:19.694 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:19.694+0000 7f4c25e1c640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c200c19a0 con 0x7f4c20152500 2023-12-12T09:44:19.694 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:19.694+0000 7f4c25e1c640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c200c1090 con 0x7f4c2006d350 2023-12-12T09:44:19.694 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:19.694+0000 7f4c1f7fe640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f4c2014f8c0 0x7f4c20071e60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:49020/0 (socket says 172.21.15.73:49020) 2023-12-12T09:44:19.694 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:19.694+0000 7f4c1f7fe640 1 -- 172.21.15.73:0/4072246372 learned_addr learned my addr 172.21.15.73:0/4072246372 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-12T09:44:19.696 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:19.694+0000 7f4c1effd640 1 -- 172.21.15.73:0/4072246372 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 968743559 0 0) 0x7f4c200c16c0 con 0x7f4c2014f8c0 2023-12-12T09:44:19.696 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:19.694+0000 7f4c1effd640 1 -- 172.21.15.73:0/4072246372 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4c0c003520 con 0x7f4c2014f8c0 2023-12-12T09:44:19.696 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:19.694+0000 7f4c17fff640 1 --2- 172.21.15.73:0/4072246372 >> v2:172.21.15.142:3300/0 conn(0x7f4c2006d350 0x7f4c2006dc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:19.696 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:19.695+0000 7f4c1effd640 1 -- 172.21.15.73:0/4072246372 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 828059947 0 0) 0x7f4c0c003520 con 0x7f4c2014f8c0 2023-12-12T09:44:19.696 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:19.695+0000 7f4c1effd640 1 -- 172.21.15.73:0/4072246372 >> v2:172.21.15.142:3300/0 conn(0x7f4c2006d350 msgr2=0x7f4c2006dc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:44:19.697 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:19.695+0000 7f4c1effd640 1 --2- 172.21.15.73:0/4072246372 >> v2:172.21.15.142:3300/0 conn(0x7f4c2006d350 0x7f4c2006dc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:19.697 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:19.695+0000 7f4c1effd640 1 -- 172.21.15.73:0/4072246372 >> v1:172.21.15.142:6789/0 conn(0x7f4c20152500 legacy=0x7f4c20152990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:44:19.697 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:19.695+0000 7f4c1effd640 1 -- 172.21.15.73:0/4072246372 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c200c1c80 con 0x7f4c2014f8c0 2023-12-12T09:44:19.697 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:19.695+0000 7f4c1effd640 1 -- 172.21.15.73:0/4072246372 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3186547832 0 0) 0x7f4c10001670 con 0x7f4c2014f8c0 2023-12-12T09:44:19.697 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:19.695+0000 7f4c1effd640 1 -- 172.21.15.73:0/4072246372 >> v1:172.21.15.73:6789/0 conn(0x7f4c2014f8c0 legacy=0x7f4c20071e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:19.697 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:19.695+0000 7f4c1effd640 1 --2- 172.21.15.73:0/4072246372 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4c0c003970 0x7f4c0c003d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:19.697 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:19.695+0000 7f4c1effd640 1 --2- 172.21.15.73:0/4072246372 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4c0c0047c0 0x7f4c0c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:19.697 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:19.695+0000 7f4c1effd640 1 --2- 172.21.15.73:0/4072246372 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4c0c005180 0x7f4c0c00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:19.697 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:19.695+0000 7f4c1effd640 1 -- 172.21.15.73:0/4072246372 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c0c00bfd0 con 0x7f4c0c0047c0 2023-12-12T09:44:19.697 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:19.695+0000 7f4c1effd640 1 -- 172.21.15.73:0/4072246372 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c0c00c140 con 0x7f4c0c003970 2023-12-12T09:44:19.697 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:19.695+0000 7f4c1effd640 1 -- 172.21.15.73:0/4072246372 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c0c00c300 con 0x7f4c0c005180 2023-12-12T09:44:19.697 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:19.695+0000 7f4c17fff640 1 --2- 172.21.15.73:0/4072246372 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4c0c0047c0 0x7f4c0c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:19.697 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:19.695+0000 7f4c1f7fe640 1 --2- 172.21.15.73:0/4072246372 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4c0c003970 0x7f4c0c003d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:19.697 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:19.696+0000 7f4c1ffff640 1 --2- 172.21.15.73:0/4072246372 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4c0c005180 0x7f4c0c00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:19.698 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:19.696+0000 7f4c17fff640 1 -- 172.21.15.73:0/4072246372 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4c0c005180 msgr2=0x7f4c0c00b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:44:19.698 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:19.696+0000 7f4c17fff640 1 --2- 172.21.15.73:0/4072246372 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4c0c005180 0x7f4c0c00b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:19.698 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:19.696+0000 7f4c17fff640 1 -- 172.21.15.73:0/4072246372 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4c0c003970 msgr2=0x7f4c0c003d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:44:19.698 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:19.696+0000 7f4c17fff640 1 --2- 172.21.15.73:0/4072246372 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4c0c003970 0x7f4c0c003d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:19.698 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:19.696+0000 7f4c1ffff640 1 -- 172.21.15.73:0/4072246372 reap_dead start 2023-12-12T09:44:19.698 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:19.696+0000 7f4c17fff640 1 -- 172.21.15.73:0/4072246372 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c0c003520 con 0x7f4c0c0047c0 2023-12-12T09:44:19.698 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:19.696+0000 7f4c1f7fe640 1 --2- 172.21.15.73:0/4072246372 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4c0c003970 0x7f4c0c003d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-12T09:44:19.699 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:19.697+0000 7f4c17fff640 1 --2- 172.21.15.73:0/4072246372 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4c0c0047c0 0x7f4c0c004c40 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f4c08009ac0 tx=0x7f4c0c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2135a8640eae7e45 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:44:19.699 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:19.697+0000 7f4c1effd640 1 -- 172.21.15.73:0/4072246372 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c0802c6b0 con 0x7f4c0c0047c0 2023-12-12T09:44:19.699 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:19.697+0000 7f4c1effd640 1 -- 172.21.15.73:0/4072246372 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c0802c810 con 0x7f4c0c0047c0 2023-12-12T09:44:19.699 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:19.697+0000 7f4c1effd640 1 -- 172.21.15.73:0/4072246372 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c0802cba0 con 0x7f4c0c0047c0 2023-12-12T09:44:19.699 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:19.698+0000 7f4c25e1c640 1 -- 172.21.15.73:0/4072246372 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4c0c0047c0 msgr2=0x7f4c0c004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:19.700 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:19.698+0000 7f4c25e1c640 1 --2- 172.21.15.73:0/4072246372 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4c0c0047c0 0x7f4c0c004c40 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f4c08009ac0 tx=0x7f4c0c0057f0 comp rx=0 tx=0).stop 2023-12-12T09:44:19.700 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:19.698+0000 7f4c25e1c640 1 -- 172.21.15.73:0/4072246372 shutdown_connections 2023-12-12T09:44:19.700 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:19.698+0000 7f4c25e1c640 1 --2- 172.21.15.73:0/4072246372 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4c0c0047c0 0x7f4c0c004c40 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:19.700 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:19.698+0000 7f4c25e1c640 1 -- 172.21.15.73:0/4072246372 >> 172.21.15.73:0/4072246372 conn(0x7f4c2006a4e0 msgr2=0x7f4c2006a8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:44:19.700 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:19.698+0000 7f4c25e1c640 1 -- 172.21.15.73:0/4072246372 shutdown_connections 2023-12-12T09:44:19.700 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:19.698+0000 7f4c25e1c640 1 -- 172.21.15.73:0/4072246372 wait complete. 2023-12-12T09:44:19.700 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:19.700+0000 7f4c25e1c640 1 Processor -- start 2023-12-12T09:44:19.700 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:19.700+0000 7f4c25e1c640 1 -- start start 2023-12-12T09:44:19.701 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:19.701+0000 7f4c25e1c640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4c0c0047c0 0x7f4c20071650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:19.702 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:19.701+0000 7f4c25e1c640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4c20149b60 0x7f4c200a6410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:19.702 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:19.701+0000 7f4c25e1c640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4c201508e0 0x7f4c200a6950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:19.702 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:19.701+0000 7f4c25e1c640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c200a6e90 con 0x7f4c20149b60 2023-12-12T09:44:19.702 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:19.701+0000 7f4c25e1c640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c201eaad0 con 0x7f4c201508e0 2023-12-12T09:44:19.702 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:19.701+0000 7f4c25e1c640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c20070e50 con 0x7f4c0c0047c0 2023-12-12T09:44:19.702 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:19.701+0000 7f4c17fff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4c20149b60 0x7f4c200a6410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:19.702 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:19.701+0000 7f4c17fff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4c20149b60 0x7f4c200a6410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:42326/0 (socket says 172.21.15.73:42326) 2023-12-12T09:44:19.702 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:19.701+0000 7f4c17fff640 1 -- 172.21.15.73:0/4188009410 learned_addr learned my addr 172.21.15.73:0/4188009410 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:44:19.702 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:19.702+0000 7f4c1f7fe640 1 --2- 172.21.15.73:0/4188009410 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4c0c0047c0 0x7f4c20071650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:19.702 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:19.702+0000 7f4c1ffff640 1 --2- 172.21.15.73:0/4188009410 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4c201508e0 0x7f4c200a6950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:19.703 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:19.702+0000 7f4c17fff640 1 -- 172.21.15.73:0/4188009410 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4c0c0047c0 msgr2=0x7f4c20071650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:19.703 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:19.702+0000 7f4c17fff640 1 --2- 172.21.15.73:0/4188009410 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4c0c0047c0 0x7f4c20071650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:19.703 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:19.702+0000 7f4c17fff640 1 -- 172.21.15.73:0/4188009410 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4c201508e0 msgr2=0x7f4c200a6950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:19.704 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:19.702+0000 7f4c17fff640 1 --2- 172.21.15.73:0/4188009410 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4c201508e0 0x7f4c200a6950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:19.704 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:19.702+0000 7f4c17fff640 1 -- 172.21.15.73:0/4188009410 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c20071130 con 0x7f4c20149b60 2023-12-12T09:44:19.704 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:19.702+0000 7f4c17fff640 1 --2- 172.21.15.73:0/4188009410 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4c20149b60 0x7f4c200a6410 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f4c0802c250 tx=0x7f4c08004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:44:19.704 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:19.703+0000 7f4c1cff9640 1 -- 172.21.15.73:0/4188009410 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c08003810 con 0x7f4c20149b60 2023-12-12T09:44:19.704 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:19.703+0000 7f4c1cff9640 1 -- 172.21.15.73:0/4188009410 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c08003970 con 0x7f4c20149b60 2023-12-12T09:44:19.704 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:19.703+0000 7f4c25e1c640 1 -- 172.21.15.73:0/4188009410 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c20070010 con 0x7f4c20149b60 2023-12-12T09:44:19.704 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:19.703+0000 7f4c1cff9640 1 -- 172.21.15.73:0/4188009410 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c08003d00 con 0x7f4c20149b60 2023-12-12T09:44:19.704 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:19.703+0000 7f4c25e1c640 1 -- 172.21.15.73:0/4188009410 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c2014bae0 con 0x7f4c20149b60 2023-12-12T09:44:19.705 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:19.704+0000 7f4c25e1c640 1 -- 172.21.15.73:0/4188009410 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c200712c0 con 0x7f4c20149b60 2023-12-12T09:44:19.705 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:19.705+0000 7f4c1cff9640 1 -- 172.21.15.73:0/4188009410 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f4c08034440 con 0x7f4c20149b60 2023-12-12T09:44:19.706 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:19.706+0000 7f4c1cff9640 1 --2- 172.21.15.73:0/4188009410 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f4c0006ae40 0x7f4c0006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:19.706 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:19.706+0000 7f4c1cff9640 1 -- 172.21.15.73:0/4188009410 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5227+0+0 (secure 0 0 0) 0x7f4c080ab750 con 0x7f4c20149b60 2023-12-12T09:44:19.706 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:19.706+0000 7f4c1f7fe640 1 --2- 172.21.15.73:0/4188009410 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f4c0006ae40 0x7f4c0006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:19.707 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:19.707+0000 7f4c1f7fe640 1 --2- 172.21.15.73:0/4188009410 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f4c0006ae40 0x7f4c0006d300 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f4c200a7550 tx=0x7f4c10009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:44:19.711 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:19.711+0000 7f4c1cff9640 1 -- 172.21.15.73:0/4188009410 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f4c08076a80 con 0x7f4c20149b60 2023-12-12T09:44:19.900 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:19.899+0000 7f4c25e1c640 1 -- 172.21.15.73:0/4188009410 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f4c20067070 con 0x7f4c20149b60 2023-12-12T09:44:20.480 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:20.479+0000 7f4c1cff9640 1 -- 172.21.15.73:0/4188009410 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v32) v1 ==== 170+0+0 (secure 0 0 0) 0x7f4c08003e60 con 0x7f4c20149b60 2023-12-12T09:44:20.480 INFO:teuthology.orchestra.run.smithi073.stderr:pool 'cephfs_data' created 2023-12-12T09:44:20.485 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:20.484+0000 7f4c25e1c640 1 -- 172.21.15.73:0/4188009410 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f4c0006ae40 msgr2=0x7f4c0006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:20.485 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:20.484+0000 7f4c25e1c640 1 --2- 172.21.15.73:0/4188009410 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f4c0006ae40 0x7f4c0006d300 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f4c200a7550 tx=0x7f4c10009040 comp rx=0 tx=0).stop 2023-12-12T09:44:20.485 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:20.484+0000 7f4c25e1c640 1 -- 172.21.15.73:0/4188009410 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4c20149b60 msgr2=0x7f4c200a6410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:20.485 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:20.484+0000 7f4c25e1c640 1 --2- 172.21.15.73:0/4188009410 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4c20149b60 0x7f4c200a6410 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f4c0802c250 tx=0x7f4c08004730 comp rx=0 tx=0).stop 2023-12-12T09:44:20.485 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:20.484+0000 7f4c25e1c640 1 -- 172.21.15.73:0/4188009410 shutdown_connections 2023-12-12T09:44:20.485 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:20.484+0000 7f4c25e1c640 1 --2- 172.21.15.73:0/4188009410 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f4c0006ae40 0x7f4c0006d300 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:20.485 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:20.484+0000 7f4c25e1c640 1 --2- 172.21.15.73:0/4188009410 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4c201508e0 0x7f4c200a6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:20.485 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:20.484+0000 7f4c25e1c640 1 --2- 172.21.15.73:0/4188009410 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4c20149b60 0x7f4c200a6410 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:20.486 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:20.484+0000 7f4c25e1c640 1 --2- 172.21.15.73:0/4188009410 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4c0c0047c0 0x7f4c20071650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:20.486 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:20.484+0000 7f4c25e1c640 1 -- 172.21.15.73:0/4188009410 >> 172.21.15.73:0/4188009410 conn(0x7f4c2006a4e0 msgr2=0x7f4c2006a8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:44:20.486 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:20.484+0000 7f4c25e1c640 1 -- 172.21.15.73:0/4188009410 shutdown_connections 2023-12-12T09:44:20.486 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:20.484+0000 7f4c25e1c640 1 -- 172.21.15.73:0/4188009410 wait complete. 2023-12-12T09:44:20.521 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-12-12T09:44:20.697 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:20.697+0000 7f2da5809640 1 Processor -- start 2023-12-12T09:44:20.697 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:20.697+0000 7f2da5809640 1 -- start start 2023-12-12T09:44:20.698 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:20.698+0000 7f2da5809640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f2da014ea60 0x7f2da00c5420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:20.698 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:20.698+0000 7f2da5809640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f2da00c0320 0x7f2da00c20b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:20.698 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:20.698+0000 7f2da5809640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2da00c3390 con 0x7f2da00a4c90 2023-12-12T09:44:20.698 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:20.698+0000 7f2da5809640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2da00c0750 con 0x7f2da00c0320 2023-12-12T09:44:20.698 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:20.698+0000 7f2da5809640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2da00c4b30 con 0x7f2da014ea60 2023-12-12T09:44:20.699 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:20.699+0000 7f2d9f7fe640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f2da00c0320 0x7f2da00c20b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:20.699 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:20.699+0000 7f2d967fc640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f2da00a4c90 0x7f2da00c4420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:49024/0 (socket says 172.21.15.73:49024) 2023-12-12T09:44:20.699 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:20.699+0000 7f2d967fc640 1 -- 172.21.15.73:0/206836889 learned_addr learned my addr 172.21.15.73:0/206836889 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-12T09:44:20.700 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:20.699+0000 7f2d9effd640 1 --2- 172.21.15.73:0/206836889 >> v2:172.21.15.142:3300/0 conn(0x7f2da014ea60 0x7f2da00c5420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:20.700 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:20.699+0000 7f2d9e7fc640 1 -- 172.21.15.73:0/206836889 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2441336670 0 0) 0x7f2da00c3390 con 0x7f2da00a4c90 2023-12-12T09:44:20.700 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:20.699+0000 7f2d9f7fe640 1 -- 172.21.15.73:0/206836889 >> v2:172.21.15.142:3300/0 conn(0x7f2da014ea60 msgr2=0x7f2da00c5420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:44:20.700 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:20.699+0000 7f2d9f7fe640 1 --2- 172.21.15.73:0/206836889 >> v2:172.21.15.142:3300/0 conn(0x7f2da014ea60 0x7f2da00c5420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:20.700 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:20.699+0000 7f2d9f7fe640 1 -- 172.21.15.73:0/206836889 >> v1:172.21.15.73:6789/0 conn(0x7f2da00a4c90 legacy=0x7f2da00c4420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:20.700 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:20.699+0000 7f2d9f7fe640 1 -- 172.21.15.73:0/206836889 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2da0151e60 con 0x7f2da00c0320 2023-12-12T09:44:20.701 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:20.700+0000 7f2d9f7fe640 1 --2- 172.21.15.73:0/206836889 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2da00c0320 0x7f2da00c20b0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f2da006b490 tx=0x7f2d9802b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95965f0db01e0908 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:44:20.701 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:20.700+0000 7f2d9e7fc640 1 -- 172.21.15.73:0/206836889 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d9802e070 con 0x7f2da00c0320 2023-12-12T09:44:20.701 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:20.700+0000 7f2d9e7fc640 1 -- 172.21.15.73:0/206836889 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d980315a0 con 0x7f2da00c0320 2023-12-12T09:44:20.701 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:20.700+0000 7f2d9e7fc640 1 -- 172.21.15.73:0/206836889 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d98031930 con 0x7f2da00c0320 2023-12-12T09:44:20.701 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:20.701+0000 7f2da5809640 1 -- 172.21.15.73:0/206836889 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2da00c0320 msgr2=0x7f2da00c20b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:20.701 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:20.701+0000 7f2da5809640 1 --2- 172.21.15.73:0/206836889 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2da00c0320 0x7f2da00c20b0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f2da006b490 tx=0x7f2d9802b840 comp rx=0 tx=0).stop 2023-12-12T09:44:20.701 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:20.701+0000 7f2da5809640 1 -- 172.21.15.73:0/206836889 shutdown_connections 2023-12-12T09:44:20.701 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:20.701+0000 7f2da5809640 1 --2- 172.21.15.73:0/206836889 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2da00c0320 0x7f2da00c20b0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:20.702 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:20.701+0000 7f2da5809640 1 --2- 172.21.15.73:0/206836889 >> v2:172.21.15.142:3300/0 conn(0x7f2da014ea60 0x7f2da00c5420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:20.702 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:20.701+0000 7f2da5809640 1 -- 172.21.15.73:0/206836889 >> 172.21.15.73:0/206836889 conn(0x7f2da006a4e0 msgr2=0x7f2da006a8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:44:20.702 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:20.701+0000 7f2da5809640 1 -- 172.21.15.73:0/206836889 shutdown_connections 2023-12-12T09:44:20.702 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:20.701+0000 7f2da5809640 1 -- 172.21.15.73:0/206836889 wait complete. 2023-12-12T09:44:20.702 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:20.703+0000 7f2da5809640 1 Processor -- start 2023-12-12T09:44:20.703 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:20.703+0000 7f2da5809640 1 -- start start 2023-12-12T09:44:20.704 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:20.704+0000 7f2da5809640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2da00a4c90 0x7f2da01dd710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:20.704 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:20.704+0000 7f2da5809640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2da00c0320 0x7f2da014bd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:20.704 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:20.704+0000 7f2da5809640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2da014ea60 0x7f2da014f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:20.704 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:20.704+0000 7f2da5809640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2da00a97b0 con 0x7f2da00c0320 2023-12-12T09:44:20.704 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:20.704+0000 7f2da5809640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2da00a9b00 con 0x7f2da014ea60 2023-12-12T09:44:20.705 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:20.704+0000 7f2da5809640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2da00aa7d0 con 0x7f2da00a4c90 2023-12-12T09:44:20.705 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:20.704+0000 7f2d967fc640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2da00c0320 0x7f2da014bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:20.705 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:20.704+0000 7f2d967fc640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2da00c0320 0x7f2da014bd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:42336/0 (socket says 172.21.15.73:42336) 2023-12-12T09:44:20.705 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:20.704+0000 7f2d967fc640 1 -- 172.21.15.73:0/1049509989 learned_addr learned my addr 172.21.15.73:0/1049509989 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:44:20.705 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:20.704+0000 7f2d967fc640 1 -- 172.21.15.73:0/1049509989 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2da00a4c90 msgr2=0x7f2da01dd710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:20.705 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:20.704+0000 7f2d967fc640 1 --2- 172.21.15.73:0/1049509989 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2da00a4c90 0x7f2da01dd710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:20.705 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:20.704+0000 7f2d967fc640 1 -- 172.21.15.73:0/1049509989 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2da014ea60 msgr2=0x7f2da014f0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:20.705 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:20.704+0000 7f2d967fc640 1 --2- 172.21.15.73:0/1049509989 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2da014ea60 0x7f2da014f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:20.705 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:20.704+0000 7f2d967fc640 1 -- 172.21.15.73:0/1049509989 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d98009400 con 0x7f2da00c0320 2023-12-12T09:44:20.705 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:20.704+0000 7f2d967fc640 1 --2- 172.21.15.73:0/1049509989 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2da00c0320 0x7f2da014bd30 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f2d8800c8c0 tx=0x7f2d8800cd80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:44:20.706 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:20.705+0000 7f2d9cff9640 1 -- 172.21.15.73:0/1049509989 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d8800a640 con 0x7f2da00c0320 2023-12-12T09:44:20.706 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:20.705+0000 7f2d9cff9640 1 -- 172.21.15.73:0/1049509989 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d8800a7c0 con 0x7f2da00c0320 2023-12-12T09:44:20.706 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:20.705+0000 7f2d9cff9640 1 -- 172.21.15.73:0/1049509989 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d8800ab70 con 0x7f2da00c0320 2023-12-12T09:44:20.706 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:20.705+0000 7f2da5809640 1 -- 172.21.15.73:0/1049509989 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2da00ab800 con 0x7f2da00c0320 2023-12-12T09:44:20.706 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:20.705+0000 7f2da5809640 1 -- 172.21.15.73:0/1049509989 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2da00aad20 con 0x7f2da00c0320 2023-12-12T09:44:20.706 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:20.706+0000 7f2da5809640 1 -- 172.21.15.73:0/1049509989 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2da0067070 con 0x7f2da00c0320 2023-12-12T09:44:20.707 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:20.707+0000 7f2d9cff9640 1 -- 172.21.15.73:0/1049509989 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f2d8800acd0 con 0x7f2da00c0320 2023-12-12T09:44:20.708 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:20.708+0000 7f2d9cff9640 1 --2- 172.21.15.73:0/1049509989 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f2d8006ae40 0x7f2d8006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:20.708 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:20.708+0000 7f2d9cff9640 1 -- 172.21.15.73:0/1049509989 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5609+0+0 (secure 0 0 0) 0x7f2d88088bd0 con 0x7f2da00c0320 2023-12-12T09:44:20.708 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:20.708+0000 7f2d9effd640 1 --2- 172.21.15.73:0/1049509989 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f2d8006ae40 0x7f2d8006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:20.709 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:20.709+0000 7f2d9effd640 1 --2- 172.21.15.73:0/1049509989 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f2d8006ae40 0x7f2d8006d300 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f2d90006fd0 tx=0x7f2d90008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:44:20.713 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:20.713+0000 7f2d9cff9640 1 -- 172.21.15.73:0/1049509989 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f2d88053cd0 con 0x7f2da00c0320 2023-12-12T09:44:20.924 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:20.923+0000 7f2da5809640 1 -- 172.21.15.73:0/1049509989 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f2da0067580 con 0x7f2da00c0320 2023-12-12T09:44:21.484 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:21.484+0000 7f2d9cff9640 1 -- 172.21.15.73:0/1049509989 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 4 and data pool 5 v12) v1 ==== 172+0+0 (secure 0 0 0) 0x7f2d88018070 con 0x7f2da00c0320 2023-12-12T09:44:21.484 INFO:teuthology.orchestra.run.smithi073.stderr:new fs with metadata pool 4 and data pool 5 2023-12-12T09:44:21.489 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:21.489+0000 7f2da5809640 1 -- 172.21.15.73:0/1049509989 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f2d8006ae40 msgr2=0x7f2d8006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:21.490 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:21.489+0000 7f2da5809640 1 --2- 172.21.15.73:0/1049509989 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f2d8006ae40 0x7f2d8006d300 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f2d90006fd0 tx=0x7f2d90008040 comp rx=0 tx=0).stop 2023-12-12T09:44:21.490 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:21.489+0000 7f2da5809640 1 -- 172.21.15.73:0/1049509989 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2da00c0320 msgr2=0x7f2da014bd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:21.490 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:21.489+0000 7f2da5809640 1 --2- 172.21.15.73:0/1049509989 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2da00c0320 0x7f2da014bd30 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f2d8800c8c0 tx=0x7f2d8800cd80 comp rx=0 tx=0).stop 2023-12-12T09:44:21.490 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:21.490+0000 7f2da5809640 1 -- 172.21.15.73:0/1049509989 shutdown_connections 2023-12-12T09:44:21.490 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:21.490+0000 7f2da5809640 1 --2- 172.21.15.73:0/1049509989 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f2d8006ae40 0x7f2d8006d300 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:21.491 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:21.490+0000 7f2da5809640 1 --2- 172.21.15.73:0/1049509989 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2da014ea60 0x7f2da014f0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:21.491 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:21.490+0000 7f2da5809640 1 --2- 172.21.15.73:0/1049509989 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2da00c0320 0x7f2da014bd30 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:21.491 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:21.490+0000 7f2da5809640 1 --2- 172.21.15.73:0/1049509989 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2da00a4c90 0x7f2da01dd710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:21.491 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:21.490+0000 7f2da5809640 1 -- 172.21.15.73:0/1049509989 >> 172.21.15.73:0/1049509989 conn(0x7f2da006a4e0 msgr2=0x7f2da00c63e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:44:21.491 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:21.491+0000 7f2da5809640 1 -- 172.21.15.73:0/1049509989 shutdown_connections 2023-12-12T09:44:21.491 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:21.492+0000 7f2da5809640 1 -- 172.21.15.73:0/1049509989 wait complete. 2023-12-12T09:44:21.535 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-12T09:44:21.709 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:21.709+0000 7f39911c5640 1 Processor -- start 2023-12-12T09:44:21.709 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:21.709+0000 7f39911c5640 1 -- start start 2023-12-12T09:44:21.710 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:21.710+0000 7f39911c5640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f398c0c5070 0x7f398c0c40c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:21.710 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:21.710+0000 7f39911c5640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f398c152610 con 0x7f398c06db70 2023-12-12T09:44:21.710 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:21.710+0000 7f39911c5640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f398c1528f0 con 0x7f398c14fa40 2023-12-12T09:44:21.710 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:21.710+0000 7f39911c5640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f398c152bd0 con 0x7f398c0c5070 2023-12-12T09:44:21.710 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:21.710+0000 7f3983fff640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f398c06db70 0x7f398c0c39b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:49026/0 (socket says 172.21.15.73:49026) 2023-12-12T09:44:21.711 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:21.710+0000 7f3983fff640 1 -- 172.21.15.73:0/2236803831 learned_addr learned my addr 172.21.15.73:0/2236803831 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-12T09:44:21.712 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:21.711+0000 7f398b59e640 1 --2- 172.21.15.73:0/2236803831 >> v2:172.21.15.142:3300/0 conn(0x7f398c0c5070 0x7f398c0c40c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:21.712 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:21.711+0000 7f398a59c640 1 -- 172.21.15.73:0/2236803831 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2413679533 0 0) 0x7f398c152610 con 0x7f398c06db70 2023-12-12T09:44:21.712 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:21.711+0000 7f398a59c640 1 -- 172.21.15.73:0/2236803831 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3978003520 con 0x7f398c06db70 2023-12-12T09:44:21.713 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:21.711+0000 7f398a59c640 1 -- 172.21.15.73:0/2236803831 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2814760464 0 0) 0x7f3978003520 con 0x7f398c06db70 2023-12-12T09:44:21.713 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:21.711+0000 7f398a59c640 1 -- 172.21.15.73:0/2236803831 >> v2:172.21.15.142:3300/0 conn(0x7f398c0c5070 msgr2=0x7f398c0c40c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:44:21.713 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:21.711+0000 7f398a59c640 1 --2- 172.21.15.73:0/2236803831 >> v2:172.21.15.142:3300/0 conn(0x7f398c0c5070 0x7f398c0c40c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:21.713 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:21.711+0000 7f398a59c640 1 -- 172.21.15.73:0/2236803831 >> v1:172.21.15.142:6789/0 conn(0x7f398c14fa40 legacy=0x7f398c06a4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:21.713 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:21.711+0000 7f398a59c640 1 -- 172.21.15.73:0/2236803831 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f398c152eb0 con 0x7f398c06db70 2023-12-12T09:44:21.713 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:21.711+0000 7f398a59c640 1 -- 172.21.15.73:0/2236803831 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3186547832 0 0) 0x7f3974001670 con 0x7f398c06db70 2023-12-12T09:44:21.713 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:21.711+0000 7f398a59c640 1 -- 172.21.15.73:0/2236803831 >> v1:172.21.15.73:6789/0 conn(0x7f398c06db70 legacy=0x7f398c0c39b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:21.713 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:21.711+0000 7f398a59c640 1 --2- 172.21.15.73:0/2236803831 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3978003970 0x7f3978003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:21.713 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:21.711+0000 7f398a59c640 1 --2- 172.21.15.73:0/2236803831 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f39780047c0 0x7f3978004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:21.713 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:21.711+0000 7f398a59c640 1 --2- 172.21.15.73:0/2236803831 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3978005180 0x7f397800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:21.713 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:21.711+0000 7f398a59c640 1 -- 172.21.15.73:0/2236803831 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f398c152bd0 con 0x7f3978005180 2023-12-12T09:44:21.713 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:21.712+0000 7f398a59c640 1 -- 172.21.15.73:0/2236803831 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f397800c020 con 0x7f3978003970 2023-12-12T09:44:21.713 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:21.712+0000 7f398a59c640 1 -- 172.21.15.73:0/2236803831 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f397800c1e0 con 0x7f39780047c0 2023-12-12T09:44:21.713 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:21.712+0000 7f398b59e640 1 --2- 172.21.15.73:0/2236803831 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3978005180 0x7f397800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:21.713 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:21.712+0000 7f398ad9d640 1 --2- 172.21.15.73:0/2236803831 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3978003970 0x7f3978003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:21.714 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:21.712+0000 7f398b59e640 1 -- 172.21.15.73:0/2236803831 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f39780047c0 msgr2=0x7f3978004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:44:21.714 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:21.712+0000 7f398b59e640 1 --2- 172.21.15.73:0/2236803831 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f39780047c0 0x7f3978004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:21.714 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:21.712+0000 7f398b59e640 1 -- 172.21.15.73:0/2236803831 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3978003970 msgr2=0x7f3978003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:44:21.714 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:21.712+0000 7f398b59e640 1 --2- 172.21.15.73:0/2236803831 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3978003970 0x7f3978003d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:21.714 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:21.712+0000 7f398b59e640 1 -- 172.21.15.73:0/2236803831 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3978003520 con 0x7f3978005180 2023-12-12T09:44:21.715 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:21.713+0000 7f398b59e640 1 -- 172.21.15.73:0/2236803831 reap_dead start 2023-12-12T09:44:21.715 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:21.713+0000 7f398b59e640 1 --2- 172.21.15.73:0/2236803831 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3978005180 0x7f397800b980 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f3984009fc0 tx=0x7f39780057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2419fc15bbb9a98 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:44:21.715 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:21.713+0000 7f398a59c640 1 -- 172.21.15.73:0/2236803831 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f398402cc60 con 0x7f3978005180 2023-12-12T09:44:21.715 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:21.713+0000 7f398a59c640 1 -- 172.21.15.73:0/2236803831 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f398400f040 con 0x7f3978005180 2023-12-12T09:44:21.715 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:21.713+0000 7f398a59c640 1 -- 172.21.15.73:0/2236803831 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3984003990 con 0x7f3978005180 2023-12-12T09:44:21.715 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:21.714+0000 7f39911c5640 1 -- 172.21.15.73:0/2236803831 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3978005180 msgr2=0x7f397800b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:21.715 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:21.714+0000 7f39911c5640 1 --2- 172.21.15.73:0/2236803831 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3978005180 0x7f397800b980 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f3984009fc0 tx=0x7f39780057f0 comp rx=0 tx=0).stop 2023-12-12T09:44:21.715 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:21.714+0000 7f39911c5640 1 -- 172.21.15.73:0/2236803831 shutdown_connections 2023-12-12T09:44:21.715 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:21.714+0000 7f39911c5640 1 --2- 172.21.15.73:0/2236803831 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3978005180 0x7f397800b980 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:21.715 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:21.714+0000 7f39911c5640 1 -- 172.21.15.73:0/2236803831 >> 172.21.15.73:0/2236803831 conn(0x7f398c0a8130 msgr2=0x7f398c0c24b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:44:21.716 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:21.714+0000 7f39911c5640 1 -- 172.21.15.73:0/2236803831 shutdown_connections 2023-12-12T09:44:21.716 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:21.714+0000 7f39911c5640 1 -- 172.21.15.73:0/2236803831 wait complete. 2023-12-12T09:44:21.716 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:21.716+0000 7f39911c5640 1 Processor -- start 2023-12-12T09:44:21.716 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:21.716+0000 7f39911c5640 1 -- start start 2023-12-12T09:44:21.717 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:21.717+0000 7f39911c5640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3978005180 0x7f398c149f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:21.717 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:21.717+0000 7f39911c5640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f398c06fcc0 0x7f398c1518e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:21.717 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:21.717+0000 7f39911c5640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f398c151e20 0x7f398c1ecdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:21.717 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:21.717+0000 7f39911c5640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f398c071300 con 0x7f398c06fcc0 2023-12-12T09:44:21.717 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:21.717+0000 7f39911c5640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f398c1ea1a0 con 0x7f3978005180 2023-12-12T09:44:21.717 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:21.717+0000 7f39911c5640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f398c0aa970 con 0x7f398c151e20 2023-12-12T09:44:21.717 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:21.717+0000 7f3983fff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f398c06fcc0 0x7f398c1518e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:21.718 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:21.717+0000 7f3983fff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f398c06fcc0 0x7f398c1518e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:42346/0 (socket says 172.21.15.73:42346) 2023-12-12T09:44:21.718 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:21.717+0000 7f3983fff640 1 -- 172.21.15.73:0/2454624687 learned_addr learned my addr 172.21.15.73:0/2454624687 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:44:21.718 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:21.717+0000 7f3983fff640 1 -- 172.21.15.73:0/2454624687 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f398c151e20 msgr2=0x7f398c1ecdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:21.718 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:21.717+0000 7f3983fff640 1 --2- 172.21.15.73:0/2454624687 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f398c151e20 0x7f398c1ecdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:21.718 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:21.717+0000 7f3983fff640 1 -- 172.21.15.73:0/2454624687 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3978005180 msgr2=0x7f398c149f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:21.718 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:21.717+0000 7f3983fff640 1 --2- 172.21.15.73:0/2454624687 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3978005180 0x7f398c149f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:21.718 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:21.717+0000 7f3983fff640 1 -- 172.21.15.73:0/2454624687 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f398c1ea670 con 0x7f398c06fcc0 2023-12-12T09:44:21.719 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:21.717+0000 7f3983fff640 1 --2- 172.21.15.73:0/2454624687 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f398c06fcc0 0x7f398c1518e0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f397400c730 tx=0x7f397400cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:44:21.719 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:21.718+0000 7f39837fe640 1 -- 172.21.15.73:0/2454624687 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39740072d0 con 0x7f398c06fcc0 2023-12-12T09:44:21.719 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:21.718+0000 7f39837fe640 1 -- 172.21.15.73:0/2454624687 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3974007430 con 0x7f398c06fcc0 2023-12-12T09:44:21.719 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:21.718+0000 7f39837fe640 1 -- 172.21.15.73:0/2454624687 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39740047e0 con 0x7f398c06fcc0 2023-12-12T09:44:21.719 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:21.718+0000 7f39911c5640 1 -- 172.21.15.73:0/2454624687 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f398c1ea390 con 0x7f398c06fcc0 2023-12-12T09:44:21.719 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:21.718+0000 7f39911c5640 1 -- 172.21.15.73:0/2454624687 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f398c14a480 con 0x7f398c06fcc0 2023-12-12T09:44:21.719 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:21.719+0000 7f39911c5640 1 -- 172.21.15.73:0/2454624687 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f398c067920 con 0x7f398c06fcc0 2023-12-12T09:44:21.720 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:21.720+0000 7f39837fe640 1 -- 172.21.15.73:0/2454624687 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f3974004940 con 0x7f398c06fcc0 2023-12-12T09:44:21.721 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:21.721+0000 7f39837fe640 1 --2- 172.21.15.73:0/2454624687 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f396c06ae40 0x7f396c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:21.721 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:21.721+0000 7f39837fe640 1 -- 172.21.15.73:0/2454624687 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3974088b30 con 0x7f398c06fcc0 2023-12-12T09:44:21.721 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:21.721+0000 7f398ad9d640 1 --2- 172.21.15.73:0/2454624687 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f396c06ae40 0x7f396c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:21.721 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:21.721+0000 7f398ad9d640 1 --2- 172.21.15.73:0/2454624687 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f396c06ae40 0x7f396c06d300 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f397c0015d0 tx=0x7f397c009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:44:21.725 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:21.725+0000 7f39837fe640 1 -- 172.21.15.73:0/2454624687 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f3974053bd0 con 0x7f398c06fcc0 2023-12-12T09:44:21.911 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:21.911+0000 7f39911c5640 1 -- 172.21.15.73:0/2454624687 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f398c0aaae0 con 0x7f398c06fcc0 2023-12-12T09:44:21.914 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:21.914+0000 7f39837fe640 1 -- 172.21.15.73:0/2454624687 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v33) v1 ==== 74+0+16594 (secure 0 0 0) 0x7f3974018070 con 0x7f398c06fcc0 2023-12-12T09:44:21.915 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-12T09:44:21.915 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":33,"fsid":"ba240992-02b8-4c7e-92f2-27eb29ac433b","created":"2023-12-12T09:43:02.454719+0000","modified":"2023-12-12T09:44:20.924805+0000","last_up_change":"2023-12-12T09:43:13.913440+0000","last_in_change":"2023-12-12T09:43:05.925348+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-12T09:43:15.525508+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-12-12T09:44:18.641446+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-12-12T09:44:19.952405+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"dd9074be-dbe2-4c34-9896-a4223d8d3940","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":4047810203},{"type":"v1","addr":"172.21.15.73:6801","nonce":4047810203}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":4047810203},{"type":"v1","addr":"172.21.15.73:6803","nonce":4047810203}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":4047810203},{"type":"v1","addr":"172.21.15.73:6807","nonce":4047810203}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":4047810203},{"type":"v1","addr":"172.21.15.73:6805","nonce":4047810203}]},"public_addr":"172.21.15.73:6801/4047810203","cluster_addr":"172.21.15.73:6803/4047810203","heartbeat_back_addr":"172.21.15.73:6807/4047810203","heartbeat_front_addr":"172.21.15.73:6805/4047810203","state":["exists","up"]},{"osd":1,"uuid":"c4a05052-96d4-4758-a4e1-1a37f1e07fed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":1356058331},{"type":"v1","addr":"172.21.15.73:6824","nonce":1356058331}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":1356058331},{"type":"v1","addr":"172.21.15.73:6827","nonce":1356058331}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":1356058331},{"type":"v1","addr":"172.21.15.73:6831","nonce":1356058331}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":1356058331},{"type":"v1","addr":"172.21.15.73:6829","nonce":1356058331}]},"public_addr":"172.21.15.73:6824/1356058331","cluster_addr":"172.21.15.73:6827/1356058331","heartbeat_back_addr":"172.21.15.73:6831/1356058331","heartbeat_front_addr":"172.21.15.73:6829/1356058331","state":["exists","up"]},{"osd":2,"uuid":"512bc8ac-72c2-40d4-b3d2-d867a92c5213","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":1228903316},{"type":"v1","addr":"172.21.15.73:6817","nonce":1228903316}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":1228903316},{"type":"v1","addr":"172.21.15.73:6819","nonce":1228903316}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6823","nonce":1228903316},{"type":"v1","addr":"172.21.15.73:6825","nonce":1228903316}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":1228903316},{"type":"v1","addr":"172.21.15.73:6821","nonce":1228903316}]},"public_addr":"172.21.15.73:6817/1228903316","cluster_addr":"172.21.15.73:6819/1228903316","heartbeat_back_addr":"172.21.15.73:6825/1228903316","heartbeat_front_addr":"172.21.15.73:6821/1228903316","state":["exists","up"]},{"osd":3,"uuid":"3d1a91e0-42bf-437a-8eae-8d357c8f63a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":1293329670},{"type":"v1","addr":"172.21.15.73:6809","nonce":1293329670}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6810","nonce":1293329670},{"type":"v1","addr":"172.21.15.73:6811","nonce":1293329670}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":1293329670},{"type":"v1","addr":"172.21.15.73:6815","nonce":1293329670}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":1293329670},{"type":"v1","addr":"172.21.15.73:6813","nonce":1293329670}]},"public_addr":"172.21.15.73:6809/1293329670","cluster_addr":"172.21.15.73:6811/1293329670","heartbeat_back_addr":"172.21.15.73:6815/1293329670","heartbeat_front_addr":"172.21.15.73:6813/1293329670","state":["exists","up"]},{"osd":4,"uuid":"4b302fff-834c-4069-ac19-00e46f6c87b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":3727975702},{"type":"v1","addr":"172.21.15.142:6801","nonce":3727975702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":3727975702},{"type":"v1","addr":"172.21.15.142:6803","nonce":3727975702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6809","nonce":3727975702},{"type":"v1","addr":"172.21.15.142:6811","nonce":3727975702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6805","nonce":3727975702},{"type":"v1","addr":"172.21.15.142:6807","nonce":3727975702}]},"public_addr":"172.21.15.142:6801/3727975702","cluster_addr":"172.21.15.142:6803/3727975702","heartbeat_back_addr":"172.21.15.142:6811/3727975702","heartbeat_front_addr":"172.21.15.142:6807/3727975702","state":["exists","up"]},{"osd":5,"uuid":"d7cdace2-67d0-45cc-95f2-515cf6ef1b82","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6817","nonce":2353193632},{"type":"v1","addr":"172.21.15.142:6819","nonce":2353193632}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6821","nonce":2353193632},{"type":"v1","addr":"172.21.15.142:6823","nonce":2353193632}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6829","nonce":2353193632},{"type":"v1","addr":"172.21.15.142:6831","nonce":2353193632}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6825","nonce":2353193632},{"type":"v1","addr":"172.21.15.142:6827","nonce":2353193632}]},"public_addr":"172.21.15.142:6819/2353193632","cluster_addr":"172.21.15.142:6823/2353193632","heartbeat_back_addr":"172.21.15.142:6831/2353193632","heartbeat_front_addr":"172.21.15.142:6827/2353193632","state":["exists","up"]},{"osd":6,"uuid":"649ce78a-5626-445c-aedc-a651ed05a6f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":2006111986},{"type":"v1","addr":"172.21.15.142:6806","nonce":2006111986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":2006111986},{"type":"v1","addr":"172.21.15.142:6810","nonce":2006111986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":2006111986},{"type":"v1","addr":"172.21.15.142:6815","nonce":2006111986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":2006111986},{"type":"v1","addr":"172.21.15.142:6813","nonce":2006111986}]},"public_addr":"172.21.15.142:6806/2006111986","cluster_addr":"172.21.15.142:6810/2006111986","heartbeat_back_addr":"172.21.15.142:6815/2006111986","heartbeat_front_addr":"172.21.15.142:6813/2006111986","state":["exists","up"]},{"osd":7,"uuid":"af15ae3b-c1d0-4acf-92db-8a1805494d13","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":2573794341},{"type":"v1","addr":"172.21.15.142:6818","nonce":2573794341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":2573794341},{"type":"v1","addr":"172.21.15.142:6822","nonce":2573794341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":2573794341},{"type":"v1","addr":"172.21.15.142:6830","nonce":2573794341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":2573794341},{"type":"v1","addr":"172.21.15.142:6826","nonce":2573794341}]},"public_addr":"172.21.15.142:6818/2573794341","cluster_addr":"172.21.15.142:6822/2573794341","heartbeat_back_addr":"172.21.15.142:6830/2573794341","heartbeat_front_addr":"172.21.15.142:6826/2573794341","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.185824+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.262103+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.225556+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:10.523459+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:10.706035+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.257339+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.301776+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.051960+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-12T09:44:21.917 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:21.917+0000 7f39911c5640 1 -- 172.21.15.73:0/2454624687 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f396c06ae40 msgr2=0x7f396c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:21.918 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:21.917+0000 7f39911c5640 1 --2- 172.21.15.73:0/2454624687 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f396c06ae40 0x7f396c06d300 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f397c0015d0 tx=0x7f397c009040 comp rx=0 tx=0).stop 2023-12-12T09:44:21.918 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:21.917+0000 7f39911c5640 1 -- 172.21.15.73:0/2454624687 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f398c06fcc0 msgr2=0x7f398c1518e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:21.918 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:21.917+0000 7f39911c5640 1 --2- 172.21.15.73:0/2454624687 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f398c06fcc0 0x7f398c1518e0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f397400c730 tx=0x7f397400cbf0 comp rx=0 tx=0).stop 2023-12-12T09:44:21.918 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:21.917+0000 7f39911c5640 1 -- 172.21.15.73:0/2454624687 shutdown_connections 2023-12-12T09:44:21.918 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:21.917+0000 7f39911c5640 1 --2- 172.21.15.73:0/2454624687 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f396c06ae40 0x7f396c06d300 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:21.918 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:21.917+0000 7f39911c5640 1 --2- 172.21.15.73:0/2454624687 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f398c151e20 0x7f398c1ecdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:21.918 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:21.917+0000 7f39911c5640 1 --2- 172.21.15.73:0/2454624687 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f398c06fcc0 0x7f398c1518e0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:21.918 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:21.917+0000 7f39911c5640 1 --2- 172.21.15.73:0/2454624687 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3978005180 0x7f398c149f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:21.918 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:21.917+0000 7f39911c5640 1 -- 172.21.15.73:0/2454624687 >> 172.21.15.73:0/2454624687 conn(0x7f398c0a8130 msgr2=0x7f398c0c2440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:44:21.918 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:21.917+0000 7f39911c5640 1 -- 172.21.15.73:0/2454624687 shutdown_connections 2023-12-12T09:44:21.918 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:21.917+0000 7f39911c5640 1 -- 172.21.15.73:0/2454624687 wait complete. 2023-12-12T09:44:21.934 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-12T09:44:22.138 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:22.137+0000 7fb206487640 1 Processor -- start 2023-12-12T09:44:22.138 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:22.138+0000 7fb206487640 1 -- start start 2023-12-12T09:44:22.140 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:22.139+0000 7fb206487640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fb2001553b0 0x7fb20006d040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:22.140 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:22.139+0000 7fb206487640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fb2000c6610 0x7fb2000c2520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:22.140 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:22.139+0000 7fb206487640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb200158600 0x7fb2000c43c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:22.140 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:22.139+0000 7fb206487640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb20006cbb0 con 0x7fb2000c6610 2023-12-12T09:44:22.140 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:22.139+0000 7fb206487640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb200158ae0 con 0x7fb2001553b0 2023-12-12T09:44:22.140 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:22.139+0000 7fb206487640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb20006c280 con 0x7fb200158600 2023-12-12T09:44:22.140 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:22.139+0000 7fb1f7fff640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fb2000c6610 0x7fb2000c2520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:22.140 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:22.139+0000 7fb1f7fff640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fb2000c6610 0x7fb2000c2520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:42356/0 (socket says 172.21.15.73:42356) 2023-12-12T09:44:22.140 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:22.139+0000 7fb1f7fff640 1 -- 172.21.15.73:0/2230141062 learned_addr learned my addr 172.21.15.73:0/2230141062 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:44:22.140 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:22.140+0000 7fb1fffff640 1 --2- 172.21.15.73:0/2230141062 >> v2:172.21.15.142:3300/0 conn(0x7fb2001553b0 0x7fb20006d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:22.140 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:22.140+0000 7fb204a24640 1 --2- 172.21.15.73:0/2230141062 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb200158600 0x7fb2000c43c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:22.141 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:22.140+0000 7fb1f7fff640 1 -- 172.21.15.73:0/2230141062 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb200158600 msgr2=0x7fb2000c43c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:44:22.141 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:22.140+0000 7fb1f7fff640 1 --2- 172.21.15.73:0/2230141062 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb200158600 0x7fb2000c43c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:22.141 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:22.140+0000 7fb1f7fff640 1 -- 172.21.15.73:0/2230141062 >> v2:172.21.15.142:3300/0 conn(0x7fb2001553b0 msgr2=0x7fb20006d040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:44:22.141 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:22.140+0000 7fb1f7fff640 1 --2- 172.21.15.73:0/2230141062 >> v2:172.21.15.142:3300/0 conn(0x7fb2001553b0 0x7fb20006d040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:22.141 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:22.140+0000 7fb1f7fff640 1 -- 172.21.15.73:0/2230141062 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb20006c560 con 0x7fb2000c6610 2023-12-12T09:44:22.141 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:22.140+0000 7fb204a24640 1 --2- 172.21.15.73:0/2230141062 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb200158600 0x7fb2000c43c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:44:22.143 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:22.141+0000 7fb1f7fff640 1 --2- 172.21.15.73:0/2230141062 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb2000c6610 0x7fb2000c2520 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fb2000c8be0 tx=0x7fb1e802b890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29efed2965b778d0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:44:22.143 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:22.141+0000 7fb1ff7fe640 1 -- 172.21.15.73:0/2230141062 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1e80317f0 con 0x7fb2000c6610 2023-12-12T09:44:22.143 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:22.141+0000 7fb1ff7fe640 1 -- 172.21.15.73:0/2230141062 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1e8031950 con 0x7fb2000c6610 2023-12-12T09:44:22.143 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:22.141+0000 7fb1ff7fe640 1 -- 172.21.15.73:0/2230141062 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1e8031ce0 con 0x7fb2000c6610 2023-12-12T09:44:22.143 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:22.142+0000 7fb206487640 1 -- 172.21.15.73:0/2230141062 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb2000c6610 msgr2=0x7fb2000c2520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:22.143 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:22.142+0000 7fb206487640 1 --2- 172.21.15.73:0/2230141062 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb2000c6610 0x7fb2000c2520 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fb2000c8be0 tx=0x7fb1e802b890 comp rx=0 tx=0).stop 2023-12-12T09:44:22.144 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:22.142+0000 7fb206487640 1 -- 172.21.15.73:0/2230141062 shutdown_connections 2023-12-12T09:44:22.144 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:22.142+0000 7fb206487640 1 --2- 172.21.15.73:0/2230141062 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb200158600 0x7fb2000c43c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:22.144 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:22.142+0000 7fb206487640 1 --2- 172.21.15.73:0/2230141062 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb2000c6610 0x7fb2000c2520 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:22.144 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:22.142+0000 7fb206487640 1 --2- 172.21.15.73:0/2230141062 >> v2:172.21.15.142:3300/0 conn(0x7fb2001553b0 0x7fb20006d040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:22.144 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:22.142+0000 7fb206487640 1 -- 172.21.15.73:0/2230141062 >> 172.21.15.73:0/2230141062 conn(0x7fb2000a9890 msgr2=0x7fb2000a9c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:44:22.144 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:22.142+0000 7fb206487640 1 -- 172.21.15.73:0/2230141062 shutdown_connections 2023-12-12T09:44:22.144 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:22.142+0000 7fb206487640 1 -- 172.21.15.73:0/2230141062 wait complete. 2023-12-12T09:44:22.146 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:22.143+0000 7fb206487640 1 Processor -- start 2023-12-12T09:44:22.146 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:22.144+0000 7fb206487640 1 -- start start 2023-12-12T09:44:22.146 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:22.144+0000 7fb206487640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb2000c6610 0x7fb20009bb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:22.146 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:22.144+0000 7fb206487640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb2001553b0 0x7fb2000ac710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:22.146 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:22.144+0000 7fb206487640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb200158600 0x7fb20009a570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:22.146 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:22.144+0000 7fb206487640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2000ad220 con 0x7fb2001553b0 2023-12-12T09:44:22.146 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:22.144+0000 7fb206487640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2000ad4c0 con 0x7fb2000c6610 2023-12-12T09:44:22.146 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:22.144+0000 7fb206487640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2000ad7a0 con 0x7fb200158600 2023-12-12T09:44:22.146 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:22.145+0000 7fb1f7fff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb2001553b0 0x7fb2000ac710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:22.146 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:22.145+0000 7fb1f7fff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb2001553b0 0x7fb2000ac710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:42360/0 (socket says 172.21.15.73:42360) 2023-12-12T09:44:22.147 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:22.145+0000 7fb1f7fff640 1 -- 172.21.15.73:0/818674523 learned_addr learned my addr 172.21.15.73:0/818674523 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:44:22.147 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:22.145+0000 7fb1fffff640 1 --2- 172.21.15.73:0/818674523 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb2000c6610 0x7fb20009bb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:22.147 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:22.145+0000 7fb1f7fff640 1 -- 172.21.15.73:0/818674523 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb200158600 msgr2=0x7fb20009a570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:22.147 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:22.145+0000 7fb1f7fff640 1 --2- 172.21.15.73:0/818674523 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb200158600 0x7fb20009a570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:22.147 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:22.145+0000 7fb1f7fff640 1 -- 172.21.15.73:0/818674523 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb2000c6610 msgr2=0x7fb20009bb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:22.147 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:22.145+0000 7fb1f7fff640 1 --2- 172.21.15.73:0/818674523 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb2000c6610 0x7fb20009bb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:22.147 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:22.145+0000 7fb1f7fff640 1 -- 172.21.15.73:0/818674523 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1e80094d0 con 0x7fb2001553b0 2023-12-12T09:44:22.147 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:22.145+0000 7fb1f7fff640 1 --2- 172.21.15.73:0/818674523 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb2001553b0 0x7fb2000ac710 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fb1e8000c00 tx=0x7fb1e80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:44:22.147 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:22.146+0000 7fb1fd7fa640 1 -- 172.21.15.73:0/818674523 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1e8032890 con 0x7fb2001553b0 2023-12-12T09:44:22.147 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:22.146+0000 7fb1fd7fa640 1 -- 172.21.15.73:0/818674523 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1e8032a30 con 0x7fb2001553b0 2023-12-12T09:44:22.147 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:22.146+0000 7fb206487640 1 -- 172.21.15.73:0/818674523 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2000ada80 con 0x7fb2001553b0 2023-12-12T09:44:22.147 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:22.146+0000 7fb1fd7fa640 1 -- 172.21.15.73:0/818674523 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1e8032de0 con 0x7fb2001553b0 2023-12-12T09:44:22.147 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:22.146+0000 7fb206487640 1 -- 172.21.15.73:0/818674523 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb20009adf0 con 0x7fb2001553b0 2023-12-12T09:44:22.149 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:22.147+0000 7fb206487640 1 -- 172.21.15.73:0/818674523 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2000adcc0 con 0x7fb2001553b0 2023-12-12T09:44:22.149 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:22.148+0000 7fb1fd7fa640 1 -- 172.21.15.73:0/818674523 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fb1e804e450 con 0x7fb2001553b0 2023-12-12T09:44:22.149 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:22.149+0000 7fb1fd7fa640 1 --2- 172.21.15.73:0/818674523 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fb1e006ae40 0x7fb1e006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:22.149 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:22.149+0000 7fb1fd7fa640 1 -- 172.21.15.73:0/818674523 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb1e80ab990 con 0x7fb2001553b0 2023-12-12T09:44:22.149 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:22.149+0000 7fb1fffff640 1 --2- 172.21.15.73:0/818674523 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fb1e006ae40 0x7fb1e006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:22.149 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:22.149+0000 7fb1fffff640 1 --2- 172.21.15.73:0/818674523 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fb1e006ae40 0x7fb1e006d300 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fb1f0006fd0 tx=0x7fb1f0008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:44:22.153 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:22.153+0000 7fb1fd7fa640 1 -- 172.21.15.73:0/818674523 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fb2000adcc0 con 0x7fb2001553b0 2023-12-12T09:44:22.347 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:22.347+0000 7fb206487640 1 -- 172.21.15.73:0/818674523 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb2000adcc0 con 0x7fb2001553b0 2023-12-12T09:44:22.349 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:22.349+0000 7fb1fd7fa640 1 -- 172.21.15.73:0/818674523 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v33) v1 ==== 74+0+16594 (secure 0 0 0) 0x7fb2000adcc0 con 0x7fb2001553b0 2023-12-12T09:44:22.350 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-12T09:44:22.350 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":33,"fsid":"ba240992-02b8-4c7e-92f2-27eb29ac433b","created":"2023-12-12T09:43:02.454719+0000","modified":"2023-12-12T09:44:20.924805+0000","last_up_change":"2023-12-12T09:43:13.913440+0000","last_in_change":"2023-12-12T09:43:05.925348+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-12T09:43:15.525508+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-12-12T09:44:18.641446+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-12-12T09:44:19.952405+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"dd9074be-dbe2-4c34-9896-a4223d8d3940","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":4047810203},{"type":"v1","addr":"172.21.15.73:6801","nonce":4047810203}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":4047810203},{"type":"v1","addr":"172.21.15.73:6803","nonce":4047810203}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":4047810203},{"type":"v1","addr":"172.21.15.73:6807","nonce":4047810203}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":4047810203},{"type":"v1","addr":"172.21.15.73:6805","nonce":4047810203}]},"public_addr":"172.21.15.73:6801/4047810203","cluster_addr":"172.21.15.73:6803/4047810203","heartbeat_back_addr":"172.21.15.73:6807/4047810203","heartbeat_front_addr":"172.21.15.73:6805/4047810203","state":["exists","up"]},{"osd":1,"uuid":"c4a05052-96d4-4758-a4e1-1a37f1e07fed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":1356058331},{"type":"v1","addr":"172.21.15.73:6824","nonce":1356058331}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":1356058331},{"type":"v1","addr":"172.21.15.73:6827","nonce":1356058331}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":1356058331},{"type":"v1","addr":"172.21.15.73:6831","nonce":1356058331}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":1356058331},{"type":"v1","addr":"172.21.15.73:6829","nonce":1356058331}]},"public_addr":"172.21.15.73:6824/1356058331","cluster_addr":"172.21.15.73:6827/1356058331","heartbeat_back_addr":"172.21.15.73:6831/1356058331","heartbeat_front_addr":"172.21.15.73:6829/1356058331","state":["exists","up"]},{"osd":2,"uuid":"512bc8ac-72c2-40d4-b3d2-d867a92c5213","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":1228903316},{"type":"v1","addr":"172.21.15.73:6817","nonce":1228903316}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":1228903316},{"type":"v1","addr":"172.21.15.73:6819","nonce":1228903316}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6823","nonce":1228903316},{"type":"v1","addr":"172.21.15.73:6825","nonce":1228903316}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":1228903316},{"type":"v1","addr":"172.21.15.73:6821","nonce":1228903316}]},"public_addr":"172.21.15.73:6817/1228903316","cluster_addr":"172.21.15.73:6819/1228903316","heartbeat_back_addr":"172.21.15.73:6825/1228903316","heartbeat_front_addr":"172.21.15.73:6821/1228903316","state":["exists","up"]},{"osd":3,"uuid":"3d1a91e0-42bf-437a-8eae-8d357c8f63a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":1293329670},{"type":"v1","addr":"172.21.15.73:6809","nonce":1293329670}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6810","nonce":1293329670},{"type":"v1","addr":"172.21.15.73:6811","nonce":1293329670}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":1293329670},{"type":"v1","addr":"172.21.15.73:6815","nonce":1293329670}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":1293329670},{"type":"v1","addr":"172.21.15.73:6813","nonce":1293329670}]},"public_addr":"172.21.15.73:6809/1293329670","cluster_addr":"172.21.15.73:6811/1293329670","heartbeat_back_addr":"172.21.15.73:6815/1293329670","heartbeat_front_addr":"172.21.15.73:6813/1293329670","state":["exists","up"]},{"osd":4,"uuid":"4b302fff-834c-4069-ac19-00e46f6c87b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":3727975702},{"type":"v1","addr":"172.21.15.142:6801","nonce":3727975702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":3727975702},{"type":"v1","addr":"172.21.15.142:6803","nonce":3727975702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6809","nonce":3727975702},{"type":"v1","addr":"172.21.15.142:6811","nonce":3727975702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6805","nonce":3727975702},{"type":"v1","addr":"172.21.15.142:6807","nonce":3727975702}]},"public_addr":"172.21.15.142:6801/3727975702","cluster_addr":"172.21.15.142:6803/3727975702","heartbeat_back_addr":"172.21.15.142:6811/3727975702","heartbeat_front_addr":"172.21.15.142:6807/3727975702","state":["exists","up"]},{"osd":5,"uuid":"d7cdace2-67d0-45cc-95f2-515cf6ef1b82","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6817","nonce":2353193632},{"type":"v1","addr":"172.21.15.142:6819","nonce":2353193632}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6821","nonce":2353193632},{"type":"v1","addr":"172.21.15.142:6823","nonce":2353193632}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6829","nonce":2353193632},{"type":"v1","addr":"172.21.15.142:6831","nonce":2353193632}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6825","nonce":2353193632},{"type":"v1","addr":"172.21.15.142:6827","nonce":2353193632}]},"public_addr":"172.21.15.142:6819/2353193632","cluster_addr":"172.21.15.142:6823/2353193632","heartbeat_back_addr":"172.21.15.142:6831/2353193632","heartbeat_front_addr":"172.21.15.142:6827/2353193632","state":["exists","up"]},{"osd":6,"uuid":"649ce78a-5626-445c-aedc-a651ed05a6f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":2006111986},{"type":"v1","addr":"172.21.15.142:6806","nonce":2006111986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":2006111986},{"type":"v1","addr":"172.21.15.142:6810","nonce":2006111986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":2006111986},{"type":"v1","addr":"172.21.15.142:6815","nonce":2006111986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":2006111986},{"type":"v1","addr":"172.21.15.142:6813","nonce":2006111986}]},"public_addr":"172.21.15.142:6806/2006111986","cluster_addr":"172.21.15.142:6810/2006111986","heartbeat_back_addr":"172.21.15.142:6815/2006111986","heartbeat_front_addr":"172.21.15.142:6813/2006111986","state":["exists","up"]},{"osd":7,"uuid":"af15ae3b-c1d0-4acf-92db-8a1805494d13","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":2573794341},{"type":"v1","addr":"172.21.15.142:6818","nonce":2573794341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":2573794341},{"type":"v1","addr":"172.21.15.142:6822","nonce":2573794341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":2573794341},{"type":"v1","addr":"172.21.15.142:6830","nonce":2573794341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":2573794341},{"type":"v1","addr":"172.21.15.142:6826","nonce":2573794341}]},"public_addr":"172.21.15.142:6818/2573794341","cluster_addr":"172.21.15.142:6822/2573794341","heartbeat_back_addr":"172.21.15.142:6830/2573794341","heartbeat_front_addr":"172.21.15.142:6826/2573794341","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.185824+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.262103+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.225556+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:10.523459+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:10.706035+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.257339+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.301776+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.051960+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-12T09:44:22.352 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:22.352+0000 7fb206487640 1 -- 172.21.15.73:0/818674523 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fb1e006ae40 msgr2=0x7fb1e006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:22.352 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:22.352+0000 7fb206487640 1 --2- 172.21.15.73:0/818674523 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fb1e006ae40 0x7fb1e006d300 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fb1f0006fd0 tx=0x7fb1f0008040 comp rx=0 tx=0).stop 2023-12-12T09:44:22.352 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:22.352+0000 7fb206487640 1 -- 172.21.15.73:0/818674523 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb2001553b0 msgr2=0x7fb2000ac710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:22.352 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:22.352+0000 7fb206487640 1 --2- 172.21.15.73:0/818674523 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb2001553b0 0x7fb2000ac710 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fb1e8000c00 tx=0x7fb1e80046c0 comp rx=0 tx=0).stop 2023-12-12T09:44:22.352 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:22.352+0000 7fb206487640 1 -- 172.21.15.73:0/818674523 shutdown_connections 2023-12-12T09:44:22.352 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:22.352+0000 7fb206487640 1 --2- 172.21.15.73:0/818674523 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fb1e006ae40 0x7fb1e006d300 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:22.353 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:22.352+0000 7fb206487640 1 --2- 172.21.15.73:0/818674523 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb200158600 0x7fb20009a570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:22.353 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:22.352+0000 7fb206487640 1 --2- 172.21.15.73:0/818674523 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb2001553b0 0x7fb2000ac710 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:22.353 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:22.352+0000 7fb206487640 1 --2- 172.21.15.73:0/818674523 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb2000c6610 0x7fb20009bb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:22.353 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:22.352+0000 7fb206487640 1 -- 172.21.15.73:0/818674523 >> 172.21.15.73:0/818674523 conn(0x7fb2000a9890 msgr2=0x7fb200153d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:44:22.353 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:22.352+0000 7fb206487640 1 -- 172.21.15.73:0/818674523 shutdown_connections 2023-12-12T09:44:22.353 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:22.352+0000 7fb206487640 1 -- 172.21.15.73:0/818674523 wait complete. 2023-12-12T09:44:22.370 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-12-12T09:44:22.419 INFO:tasks.ceph.mds.c.smithi073.stderr:2023-12-12T09:44:22.418+0000 7fd3b2a6e640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-12-12T09:44:22.581 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:22.580+0000 7fbfb203d640 1 Processor -- start 2023-12-12T09:44:22.581 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:22.580+0000 7fbfb203d640 1 -- start start 2023-12-12T09:44:22.582 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:22.581+0000 7fbfb203d640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbfac14ea60 0x7fbfac0c5420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:22.582 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:22.581+0000 7fbfb203d640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fbfac0c0320 0x7fbfac0c20b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:22.582 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:22.581+0000 7fbfb203d640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbfac0c3390 con 0x7fbfac0a4c90 2023-12-12T09:44:22.583 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:22.581+0000 7fbfb203d640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbfac0c4b30 con 0x7fbfac0c0320 2023-12-12T09:44:22.583 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:22.581+0000 7fbfb203d640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbfac151e60 con 0x7fbfac14ea60 2023-12-12T09:44:22.583 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:22.581+0000 7fbfaaffd640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7fbfac0a4c90 0x7fbfac0c4420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:49040/0 (socket says 172.21.15.73:49040) 2023-12-12T09:44:22.583 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:22.581+0000 7fbfaaffd640 1 -- 172.21.15.73:0/3121272772 learned_addr learned my addr 172.21.15.73:0/3121272772 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-12T09:44:22.583 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:22.582+0000 7fbfabfff640 1 --2- 172.21.15.73:0/3121272772 >> v2:172.21.15.73:3300/0 conn(0x7fbfac0c0320 0x7fbfac0c20b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:22.584 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:22.582+0000 7fbfab7fe640 1 --2- 172.21.15.73:0/3121272772 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbfac14ea60 0x7fbfac0c5420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:22.584 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:22.582+0000 7fbfaa7fc640 1 -- 172.21.15.73:0/3121272772 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2443696027 0 0) 0x7fbfac0c3390 con 0x7fbfac0a4c90 2023-12-12T09:44:22.584 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:22.582+0000 7fbfaa7fc640 1 -- 172.21.15.73:0/3121272772 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbf94003520 con 0x7fbfac0a4c90 2023-12-12T09:44:22.584 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:22.582+0000 7fbfabfff640 1 -- 172.21.15.73:0/3121272772 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbfac14ea60 msgr2=0x7fbfac0c5420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:44:22.584 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:22.582+0000 7fbfabfff640 1 --2- 172.21.15.73:0/3121272772 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbfac14ea60 0x7fbfac0c5420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:22.584 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:22.582+0000 7fbfabfff640 1 -- 172.21.15.73:0/3121272772 >> v1:172.21.15.73:6789/0 conn(0x7fbfac0a4c90 legacy=0x7fbfac0c4420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:22.584 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:22.582+0000 7fbfabfff640 1 -- 172.21.15.73:0/3121272772 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfac152140 con 0x7fbfac0c0320 2023-12-12T09:44:22.585 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:22.583+0000 7fbfabfff640 1 --2- 172.21.15.73:0/3121272772 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbfac0c0320 0x7fbfac0c20b0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fbfa4009d90 tx=0x7fbfa402be10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b70b7c1949d5b4d2 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:44:22.585 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:22.583+0000 7fbfaa7fc640 1 -- 172.21.15.73:0/3121272772 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfa402cbc0 con 0x7fbfac0c0320 2023-12-12T09:44:22.586 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:22.583+0000 7fbfaa7fc640 1 -- 172.21.15.73:0/3121272772 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfa402cd20 con 0x7fbfac0c0320 2023-12-12T09:44:22.586 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:22.584+0000 7fbfaa7fc640 1 -- 172.21.15.73:0/3121272772 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfa4034660 con 0x7fbfac0c0320 2023-12-12T09:44:22.586 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:22.584+0000 7fbfb203d640 1 -- 172.21.15.73:0/3121272772 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbfac0c0320 msgr2=0x7fbfac0c20b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:22.586 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:22.584+0000 7fbfb203d640 1 --2- 172.21.15.73:0/3121272772 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbfac0c0320 0x7fbfac0c20b0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fbfa4009d90 tx=0x7fbfa402be10 comp rx=0 tx=0).stop 2023-12-12T09:44:22.586 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:22.584+0000 7fbfb203d640 1 -- 172.21.15.73:0/3121272772 shutdown_connections 2023-12-12T09:44:22.586 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:22.584+0000 7fbfb203d640 1 --2- 172.21.15.73:0/3121272772 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbfac0c0320 0x7fbfac0c20b0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:22.586 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:22.584+0000 7fbfb203d640 1 --2- 172.21.15.73:0/3121272772 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbfac14ea60 0x7fbfac0c5420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:22.586 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:22.584+0000 7fbfb203d640 1 -- 172.21.15.73:0/3121272772 >> 172.21.15.73:0/3121272772 conn(0x7fbfac06a4e0 msgr2=0x7fbfac06a8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:44:22.586 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:22.584+0000 7fbfb203d640 1 -- 172.21.15.73:0/3121272772 shutdown_connections 2023-12-12T09:44:22.586 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:22.584+0000 7fbfb203d640 1 -- 172.21.15.73:0/3121272772 wait complete. 2023-12-12T09:44:22.587 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:22.586+0000 7fbfb203d640 1 Processor -- start 2023-12-12T09:44:22.587 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:22.586+0000 7fbfb203d640 1 -- start start 2023-12-12T09:44:22.588 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:22.587+0000 7fbfb203d640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbfac0a4c90 0x7fbfac1504a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:22.588 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:22.587+0000 7fbfb203d640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbfac0c0320 0x7fbfac152400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:22.588 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:22.587+0000 7fbfb203d640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbfac14ea60 0x7fbfac152940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:22.588 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:22.587+0000 7fbfb203d640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfac14a3e0 con 0x7fbfac0a4c90 2023-12-12T09:44:22.588 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:22.587+0000 7fbfb203d640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfac153d00 con 0x7fbfac14ea60 2023-12-12T09:44:22.589 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:22.587+0000 7fbfb203d640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbfac1e8530 con 0x7fbfac0c0320 2023-12-12T09:44:22.589 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:22.587+0000 7fbfab7fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbfac0a4c90 0x7fbfac1504a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:22.589 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:22.587+0000 7fbfab7fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbfac0a4c90 0x7fbfac1504a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:42370/0 (socket says 172.21.15.73:42370) 2023-12-12T09:44:22.589 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:22.587+0000 7fbfab7fe640 1 -- 172.21.15.73:0/1027314568 learned_addr learned my addr 172.21.15.73:0/1027314568 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:44:22.590 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:22.588+0000 7fbfaaffd640 1 --2- 172.21.15.73:0/1027314568 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbfac0c0320 0x7fbfac152400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:22.590 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:22.588+0000 7fbfab7fe640 1 -- 172.21.15.73:0/1027314568 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbfac0c0320 msgr2=0x7fbfac152400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:22.590 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:22.588+0000 7fbfab7fe640 1 --2- 172.21.15.73:0/1027314568 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbfac0c0320 0x7fbfac152400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:22.590 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:22.588+0000 7fbfab7fe640 1 -- 172.21.15.73:0/1027314568 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbfac14ea60 msgr2=0x7fbfac152940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:22.590 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:22.588+0000 7fbfab7fe640 1 --2- 172.21.15.73:0/1027314568 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbfac14ea60 0x7fbfac152940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:22.590 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:22.588+0000 7fbfab7fe640 1 -- 172.21.15.73:0/1027314568 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfa4009a70 con 0x7fbfac0a4c90 2023-12-12T09:44:22.590 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:22.588+0000 7fbfaaffd640 1 --2- 172.21.15.73:0/1027314568 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbfac0c0320 0x7fbfac152400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:44:22.591 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:22.588+0000 7fbfab7fe640 1 --2- 172.21.15.73:0/1027314568 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbfac0a4c90 0x7fbfac1504a0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fbf9c00d620 tx=0x7fbf9c00dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:44:22.591 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:22.588+0000 7fbf93fff640 1 -- 172.21.15.73:0/1027314568 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf9c00b620 con 0x7fbfac0a4c90 2023-12-12T09:44:22.591 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:22.588+0000 7fbf93fff640 1 -- 172.21.15.73:0/1027314568 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf9c00b780 con 0x7fbfac0a4c90 2023-12-12T09:44:22.591 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:22.588+0000 7fbf93fff640 1 -- 172.21.15.73:0/1027314568 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf9c00bb30 con 0x7fbfac0a4c90 2023-12-12T09:44:22.591 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:22.588+0000 7fbfb203d640 1 -- 172.21.15.73:0/1027314568 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbfac1e7c20 con 0x7fbfac0a4c90 2023-12-12T09:44:22.591 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:22.589+0000 7fbfb203d640 1 -- 172.21.15.73:0/1027314568 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbfac1e7ee0 con 0x7fbfac0a4c90 2023-12-12T09:44:22.591 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:22.590+0000 7fbfb203d640 1 -- 172.21.15.73:0/1027314568 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbfac067070 con 0x7fbfac0a4c90 2023-12-12T09:44:22.592 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:22.591+0000 7fbf93fff640 1 -- 172.21.15.73:0/1027314568 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fbf9c00bc90 con 0x7fbfac0a4c90 2023-12-12T09:44:22.593 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:22.592+0000 7fbf93fff640 1 --2- 172.21.15.73:0/1027314568 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fbf9806ae40 0x7fbf9806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:22.593 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:22.592+0000 7fbf93fff640 1 -- 172.21.15.73:0/1027314568 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fbf9c089a50 con 0x7fbfac0a4c90 2023-12-12T09:44:22.593 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:22.592+0000 7fbfaaffd640 1 --2- 172.21.15.73:0/1027314568 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fbf9806ae40 0x7fbf9806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:22.594 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:22.593+0000 7fbfaaffd640 1 --2- 172.21.15.73:0/1027314568 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fbf9806ae40 0x7fbf9806d300 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fbfac1ec250 tx=0x7fbfa0009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:44:22.598 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:22.597+0000 7fbf93fff640 1 -- 172.21.15.73:0/1027314568 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fbf9c054b90 con 0x7fbfac0a4c90 2023-12-12T09:44:22.820 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:22.819+0000 7fbfb203d640 1 -- 172.21.15.73:0/1027314568 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fbfac067580 con 0x7fbfac0a4c90 2023-12-12T09:44:23.519 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:23.518+0000 7fbf93fff640 1 -- 172.21.15.73:0/1027314568 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v14) v1 ==== 118+0+0 (secure 0 0 0) 0x7fbf9c0581b0 con 0x7fbfac0a4c90 2023-12-12T09:44:23.523 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:23.521+0000 7fbfb203d640 1 -- 172.21.15.73:0/1027314568 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fbf9806ae40 msgr2=0x7fbf9806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:23.523 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:23.521+0000 7fbfb203d640 1 --2- 172.21.15.73:0/1027314568 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fbf9806ae40 0x7fbf9806d300 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fbfac1ec250 tx=0x7fbfa0009040 comp rx=0 tx=0).stop 2023-12-12T09:44:23.523 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:23.521+0000 7fbfb203d640 1 -- 172.21.15.73:0/1027314568 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbfac0a4c90 msgr2=0x7fbfac1504a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:23.523 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:23.521+0000 7fbfb203d640 1 --2- 172.21.15.73:0/1027314568 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbfac0a4c90 0x7fbfac1504a0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fbf9c00d620 tx=0x7fbf9c00dae0 comp rx=0 tx=0).stop 2023-12-12T09:44:23.523 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:23.521+0000 7fbfb203d640 1 -- 172.21.15.73:0/1027314568 shutdown_connections 2023-12-12T09:44:23.523 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:23.521+0000 7fbfb203d640 1 --2- 172.21.15.73:0/1027314568 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fbf9806ae40 0x7fbf9806d300 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:23.523 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:23.521+0000 7fbfb203d640 1 --2- 172.21.15.73:0/1027314568 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbfac14ea60 0x7fbfac152940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:23.523 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:23.521+0000 7fbfb203d640 1 --2- 172.21.15.73:0/1027314568 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbfac0c0320 0x7fbfac152400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:23.523 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:23.521+0000 7fbfb203d640 1 --2- 172.21.15.73:0/1027314568 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbfac0a4c90 0x7fbfac1504a0 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:23.523 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:23.521+0000 7fbfb203d640 1 -- 172.21.15.73:0/1027314568 >> 172.21.15.73:0/1027314568 conn(0x7fbfac06a4e0 msgr2=0x7fbfac0c07e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:44:23.523 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:23.521+0000 7fbfb203d640 1 -- 172.21.15.73:0/1027314568 shutdown_connections 2023-12-12T09:44:23.524 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:23.522+0000 7fbfb203d640 1 -- 172.21.15.73:0/1027314568 wait complete. 2023-12-12T09:44:23.543 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-12-12T09:44:23.543 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-12-12T09:44:23.802 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:23.800+0000 7f6b1017c640 1 Processor -- start 2023-12-12T09:44:23.802 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:23.801+0000 7f6b1017c640 1 -- start start 2023-12-12T09:44:23.803 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:23.802+0000 7f6b1017c640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f6b08152000 0x7f6b081551e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:23.803 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:23.802+0000 7f6b1017c640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6b080c84d0 0x7f6b0806c340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:23.803 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:23.802+0000 7f6b1017c640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f6b0806c880 0x7f6b080c68c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:23.803 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:23.802+0000 7f6b1017c640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b08155720 con 0x7f6b08152000 2023-12-12T09:44:23.804 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:23.802+0000 7f6b1017c640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b0806bb80 con 0x7f6b0806c880 2023-12-12T09:44:23.804 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:23.802+0000 7f6b1017c640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b080c4830 con 0x7f6b080c84d0 2023-12-12T09:44:23.804 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:23.802+0000 7f6b0df18640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f6b08152000 0x7f6b081551e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:23.804 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:23.802+0000 7f6b0df18640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f6b08152000 0x7f6b081551e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:42386/0 (socket says 172.21.15.73:42386) 2023-12-12T09:44:23.804 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:23.802+0000 7f6b0df18640 1 -- 172.21.15.73:0/3773156406 learned_addr learned my addr 172.21.15.73:0/3773156406 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:44:23.805 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:23.803+0000 7f6b0df18640 1 -- 172.21.15.73:0/3773156406 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6b080c84d0 msgr2=0x7f6b0806c340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:44:23.805 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:23.803+0000 7f6b0df18640 1 --2- 172.21.15.73:0/3773156406 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6b080c84d0 0x7f6b0806c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:23.805 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:23.803+0000 7f6b0df18640 1 -- 172.21.15.73:0/3773156406 >> v2:172.21.15.142:3300/0 conn(0x7f6b0806c880 msgr2=0x7f6b080c68c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:44:23.805 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:23.803+0000 7f6b0e719640 1 --2- 172.21.15.73:0/3773156406 >> v2:172.21.15.142:3300/0 conn(0x7f6b0806c880 0x7f6b080c68c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:23.805 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:23.803+0000 7f6b0df18640 1 --2- 172.21.15.73:0/3773156406 >> v2:172.21.15.142:3300/0 conn(0x7f6b0806c880 0x7f6b080c68c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:23.805 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:23.803+0000 7f6b0df18640 1 -- 172.21.15.73:0/3773156406 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b080c4b10 con 0x7f6b08152000 2023-12-12T09:44:23.806 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:23.803+0000 7f6b0e719640 1 --2- 172.21.15.73:0/3773156406 >> v2:172.21.15.142:3300/0 conn(0x7f6b0806c880 0x7f6b080c68c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:44:23.806 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:23.804+0000 7f6b0df18640 1 --2- 172.21.15.73:0/3773156406 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6b08152000 0x7f6b081551e0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f6b080aca00 tx=0x7f6afc02be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d5f0538bd241dab server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:44:23.806 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:23.804+0000 7f6b0cf16640 1 -- 172.21.15.73:0/3773156406 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6afc02c9e0 con 0x7f6b08152000 2023-12-12T09:44:23.806 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:23.804+0000 7f6b0cf16640 1 -- 172.21.15.73:0/3773156406 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6afc02cb40 con 0x7f6b08152000 2023-12-12T09:44:23.806 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:23.804+0000 7f6b0cf16640 1 -- 172.21.15.73:0/3773156406 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6afc0343f0 con 0x7f6b08152000 2023-12-12T09:44:23.807 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:23.805+0000 7f6b1017c640 1 -- 172.21.15.73:0/3773156406 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6b08152000 msgr2=0x7f6b081551e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:23.807 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:23.805+0000 7f6b1017c640 1 --2- 172.21.15.73:0/3773156406 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6b08152000 0x7f6b081551e0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f6b080aca00 tx=0x7f6afc02be40 comp rx=0 tx=0).stop 2023-12-12T09:44:23.807 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:23.805+0000 7f6b1017c640 1 -- 172.21.15.73:0/3773156406 shutdown_connections 2023-12-12T09:44:23.807 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:23.805+0000 7f6b1017c640 1 --2- 172.21.15.73:0/3773156406 >> v2:172.21.15.142:3300/0 conn(0x7f6b0806c880 0x7f6b080c68c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:23.807 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:23.805+0000 7f6b1017c640 1 --2- 172.21.15.73:0/3773156406 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6b080c84d0 0x7f6b0806c340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:23.807 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:23.805+0000 7f6b1017c640 1 --2- 172.21.15.73:0/3773156406 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6b08152000 0x7f6b081551e0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:23.807 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:23.805+0000 7f6b1017c640 1 -- 172.21.15.73:0/3773156406 >> 172.21.15.73:0/3773156406 conn(0x7f6b080ab9e0 msgr2=0x7f6b080abdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:44:23.807 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:23.805+0000 7f6b1017c640 1 -- 172.21.15.73:0/3773156406 shutdown_connections 2023-12-12T09:44:23.808 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:23.805+0000 7f6b1017c640 1 -- 172.21.15.73:0/3773156406 wait complete. 2023-12-12T09:44:23.808 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:23.807+0000 7f6b1017c640 1 Processor -- start 2023-12-12T09:44:23.808 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:23.807+0000 7f6b1017c640 1 -- start start 2023-12-12T09:44:23.811 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:23.808+0000 7f6b1017c640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6b0806c880 0x7f6b08153c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:23.811 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:23.808+0000 7f6b1017c640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6b080c84d0 0x7f6b080c2f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:23.811 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:23.809+0000 7f6b1017c640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6b08148b10 0x7f6b080c1f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:23.811 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:23.809+0000 7f6b1017c640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b0814f210 con 0x7f6b08148b10 2023-12-12T09:44:23.811 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:23.809+0000 7f6b1017c640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b081541a0 con 0x7f6b0806c880 2023-12-12T09:44:23.811 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:23.809+0000 7f6b1017c640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b08154810 con 0x7f6b080c84d0 2023-12-12T09:44:23.812 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:23.809+0000 7f6b0e719640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6b08148b10 0x7f6b080c1f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:23.812 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:23.809+0000 7f6b0e719640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6b08148b10 0x7f6b080c1f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:42396/0 (socket says 172.21.15.73:42396) 2023-12-12T09:44:23.812 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:23.809+0000 7f6b0e719640 1 -- 172.21.15.73:0/3823851773 learned_addr learned my addr 172.21.15.73:0/3823851773 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:44:23.812 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:23.809+0000 7f6b0df18640 1 --2- 172.21.15.73:0/3823851773 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6b0806c880 0x7f6b08153c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:23.812 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:23.809+0000 7f6b0d717640 1 --2- 172.21.15.73:0/3823851773 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6b080c84d0 0x7f6b080c2f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:23.812 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:23.809+0000 7f6b0e719640 1 -- 172.21.15.73:0/3823851773 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6b080c84d0 msgr2=0x7f6b080c2f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:23.812 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:23.809+0000 7f6b0e719640 1 --2- 172.21.15.73:0/3823851773 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6b080c84d0 0x7f6b080c2f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:23.812 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:23.809+0000 7f6b0e719640 1 -- 172.21.15.73:0/3823851773 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6b0806c880 msgr2=0x7f6b08153c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:23.812 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:23.809+0000 7f6b0e719640 1 --2- 172.21.15.73:0/3823851773 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6b0806c880 0x7f6b08153c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:23.812 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:23.809+0000 7f6b0e719640 1 -- 172.21.15.73:0/3823851773 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6afc009b30 con 0x7f6b08148b10 2023-12-12T09:44:23.812 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:23.810+0000 7f6b0e719640 1 --2- 172.21.15.73:0/3823851773 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6b08148b10 0x7f6b080c1f30 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f6b0000c7f0 tx=0x7f6b0000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:44:23.812 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:23.810+0000 7f6b067fc640 1 -- 172.21.15.73:0/3823851773 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b00007820 con 0x7f6b08148b10 2023-12-12T09:44:23.813 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:23.810+0000 7f6b067fc640 1 -- 172.21.15.73:0/3823851773 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b00007980 con 0x7f6b08148b10 2023-12-12T09:44:23.813 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:23.810+0000 7f6b067fc640 1 -- 172.21.15.73:0/3823851773 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b00007d70 con 0x7f6b08148b10 2023-12-12T09:44:23.813 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:23.810+0000 7f6b1017c640 1 -- 172.21.15.73:0/3823851773 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b081eaa40 con 0x7f6b08148b10 2023-12-12T09:44:23.813 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:23.810+0000 7f6b1017c640 1 -- 172.21.15.73:0/3823851773 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b080c1a10 con 0x7f6b08148b10 2023-12-12T09:44:23.813 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:23.811+0000 7f6b1017c640 1 -- 172.21.15.73:0/3823851773 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b081509e0 con 0x7f6b08148b10 2023-12-12T09:44:23.813 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:23.812+0000 7f6b067fc640 1 -- 172.21.15.73:0/3823851773 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f6b000113f0 con 0x7f6b08148b10 2023-12-12T09:44:23.814 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:23.813+0000 7f6b067fc640 1 --2- 172.21.15.73:0/3823851773 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f6aec06ae40 0x7f6aec06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:23.814 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:23.813+0000 7f6b067fc640 1 -- 172.21.15.73:0/3823851773 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6b000898b0 con 0x7f6b08148b10 2023-12-12T09:44:23.814 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:23.813+0000 7f6b0df18640 1 --2- 172.21.15.73:0/3823851773 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f6aec06ae40 0x7f6aec06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:23.815 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:23.814+0000 7f6b0df18640 1 --2- 172.21.15.73:0/3823851773 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f6aec06ae40 0x7f6aec06d300 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f6afc035000 tx=0x7f6afc030000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:44:23.820 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:23.819+0000 7f6b067fc640 1 -- 172.21.15.73:0/3823851773 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f6b000549f0 con 0x7f6b08148b10 2023-12-12T09:44:24.049 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:24.047+0000 7f6b1017c640 1 -- 172.21.15.73:0/3823851773 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f6b080c75c0 con 0x7f6b08148b10 2023-12-12T09:44:24.541 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:24.540+0000 7f6b067fc640 1 -- 172.21.15.73:0/3823851773 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v15) v1 ==== 122+0+0 (secure 0 0 0) 0x7f6b0001f0c0 con 0x7f6b08148b10 2023-12-12T09:44:24.545 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:24.543+0000 7f6b1017c640 1 -- 172.21.15.73:0/3823851773 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f6aec06ae40 msgr2=0x7f6aec06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:24.545 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:24.543+0000 7f6b1017c640 1 --2- 172.21.15.73:0/3823851773 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f6aec06ae40 0x7f6aec06d300 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f6afc035000 tx=0x7f6afc030000 comp rx=0 tx=0).stop 2023-12-12T09:44:24.545 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:24.543+0000 7f6b1017c640 1 -- 172.21.15.73:0/3823851773 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6b08148b10 msgr2=0x7f6b080c1f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:24.545 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:24.543+0000 7f6b1017c640 1 --2- 172.21.15.73:0/3823851773 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6b08148b10 0x7f6b080c1f30 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f6b0000c7f0 tx=0x7f6b0000ccb0 comp rx=0 tx=0).stop 2023-12-12T09:44:24.545 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:24.544+0000 7f6b1017c640 1 -- 172.21.15.73:0/3823851773 shutdown_connections 2023-12-12T09:44:24.545 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:24.544+0000 7f6b1017c640 1 --2- 172.21.15.73:0/3823851773 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f6aec06ae40 0x7f6aec06d300 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:24.545 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:24.544+0000 7f6b1017c640 1 --2- 172.21.15.73:0/3823851773 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6b08148b10 0x7f6b080c1f30 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:24.546 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:24.544+0000 7f6b1017c640 1 --2- 172.21.15.73:0/3823851773 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6b080c84d0 0x7f6b080c2f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:24.546 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:24.544+0000 7f6b1017c640 1 --2- 172.21.15.73:0/3823851773 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6b0806c880 0x7f6b08153c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:24.546 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:24.544+0000 7f6b1017c640 1 -- 172.21.15.73:0/3823851773 >> 172.21.15.73:0/3823851773 conn(0x7f6b080ab9e0 msgr2=0x7f6b080c8930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:44:24.546 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:24.544+0000 7f6b1017c640 1 -- 172.21.15.73:0/3823851773 shutdown_connections 2023-12-12T09:44:24.546 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:24.544+0000 7f6b1017c640 1 -- 172.21.15.73:0/3823851773 wait complete. 2023-12-12T09:44:24.564 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-12-12T09:44:24.564 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-12T09:44:24.773 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:24.772+0000 7f933e268640 1 Processor -- start 2023-12-12T09:44:24.773 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:24.772+0000 7f933e268640 1 -- start start 2023-12-12T09:44:24.774 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:24.773+0000 7f933e268640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f933806db70 0x7f93380c39b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:24.774 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:24.773+0000 7f933e268640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f93380c5070 0x7f93380c3ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:24.774 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:24.773+0000 7f933e268640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9338152610 con 0x7f933814fa40 2023-12-12T09:44:24.775 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:24.773+0000 7f933e268640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93381528f0 con 0x7f933806db70 2023-12-12T09:44:24.775 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:24.773+0000 7f933e268640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9338152bd0 con 0x7f93380c5070 2023-12-12T09:44:24.775 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:24.774+0000 7f932ffff640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f933806db70 0x7f93380c39b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:24.775 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:24.774+0000 7f932ffff640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f933806db70 0x7f93380c39b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:42410/0 (socket says 172.21.15.73:42410) 2023-12-12T09:44:24.776 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:24.774+0000 7f932ffff640 1 -- 172.21.15.73:0/1203003738 learned_addr learned my addr 172.21.15.73:0/1203003738 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:44:24.776 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:24.774+0000 7f932ffff640 1 -- 172.21.15.73:0/1203003738 >> v2:172.21.15.142:3300/0 conn(0x7f93380c5070 msgr2=0x7f93380c3ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:44:24.776 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:24.774+0000 7f932ffff640 1 --2- 172.21.15.73:0/1203003738 >> v2:172.21.15.142:3300/0 conn(0x7f93380c5070 0x7f93380c3ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:24.776 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:24.774+0000 7f932ffff640 1 -- 172.21.15.73:0/1203003738 >> v1:172.21.15.142:6789/0 conn(0x7f933814fa40 legacy=0x7f933806a4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:44:24.776 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:24.774+0000 7f932ffff640 1 -- 172.21.15.73:0/1203003738 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9338152eb0 con 0x7f933806db70 2023-12-12T09:44:24.776 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:24.776+0000 7f932ffff640 1 --2- 172.21.15.73:0/1203003738 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f933806db70 0x7f93380c39b0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f933806fc50 tx=0x7f932002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2f78aac67872021 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:44:24.777 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:24.776+0000 7f93377fe640 1 -- 172.21.15.73:0/1203003738 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9320031870 con 0x7f933806db70 2023-12-12T09:44:24.777 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:24.776+0000 7f93377fe640 1 -- 172.21.15.73:0/1203003738 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93200319d0 con 0x7f933806db70 2023-12-12T09:44:24.777 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:24.776+0000 7f93377fe640 1 -- 172.21.15.73:0/1203003738 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9320031d60 con 0x7f933806db70 2023-12-12T09:44:24.778 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:24.777+0000 7f933e268640 1 -- 172.21.15.73:0/1203003738 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f933806db70 msgr2=0x7f93380c39b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:24.778 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:24.777+0000 7f933e268640 1 --2- 172.21.15.73:0/1203003738 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f933806db70 0x7f93380c39b0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f933806fc50 tx=0x7f932002b910 comp rx=0 tx=0).stop 2023-12-12T09:44:24.778 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:24.777+0000 7f933e268640 1 -- 172.21.15.73:0/1203003738 shutdown_connections 2023-12-12T09:44:24.778 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:24.777+0000 7f933e268640 1 --2- 172.21.15.73:0/1203003738 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f933806db70 0x7f93380c39b0 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:24.778 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:24.777+0000 7f933e268640 1 --2- 172.21.15.73:0/1203003738 >> v2:172.21.15.142:3300/0 conn(0x7f93380c5070 0x7f93380c3ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:24.778 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:24.777+0000 7f933e268640 1 -- 172.21.15.73:0/1203003738 >> 172.21.15.73:0/1203003738 conn(0x7f93380a8130 msgr2=0x7f93380c24b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:44:24.779 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:24.777+0000 7f933e268640 1 -- 172.21.15.73:0/1203003738 shutdown_connections 2023-12-12T09:44:24.779 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:24.777+0000 7f933e268640 1 -- 172.21.15.73:0/1203003738 wait complete. 2023-12-12T09:44:24.780 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:24.779+0000 7f933e268640 1 Processor -- start 2023-12-12T09:44:24.780 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:24.779+0000 7f933e268640 1 -- start start 2023-12-12T09:44:24.782 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:24.780+0000 7f933e268640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f933806db70 0x7f93381502e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:24.782 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:24.780+0000 7f933e268640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f93380c5070 0x7f9338070f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:24.782 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:24.780+0000 7f933e268640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f933814fa40 0x7f9338151c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:24.783 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:24.780+0000 7f933e268640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9338149480 con 0x7f933806db70 2023-12-12T09:44:24.783 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:24.780+0000 7f933e268640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9338147a40 con 0x7f933814fa40 2023-12-12T09:44:24.783 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:24.780+0000 7f933e268640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9338147c90 con 0x7f93380c5070 2023-12-12T09:44:24.783 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:24.780+0000 7f9337fff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f933806db70 0x7f93381502e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:24.783 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:24.780+0000 7f9337fff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f933806db70 0x7f93381502e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:42426/0 (socket says 172.21.15.73:42426) 2023-12-12T09:44:24.783 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:24.780+0000 7f9337fff640 1 -- 172.21.15.73:0/1689003133 learned_addr learned my addr 172.21.15.73:0/1689003133 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:44:24.783 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:24.781+0000 7f933c805640 1 --2- 172.21.15.73:0/1689003133 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f933814fa40 0x7f9338151c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:24.783 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:24.781+0000 7f932ffff640 1 --2- 172.21.15.73:0/1689003133 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f93380c5070 0x7f9338070f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:24.783 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:24.781+0000 7f9337fff640 1 -- 172.21.15.73:0/1689003133 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f93380c5070 msgr2=0x7f9338070f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:24.783 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:24.781+0000 7f9337fff640 1 --2- 172.21.15.73:0/1689003133 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f93380c5070 0x7f9338070f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:24.783 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:24.781+0000 7f9337fff640 1 -- 172.21.15.73:0/1689003133 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f933814fa40 msgr2=0x7f9338151c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:24.783 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:24.781+0000 7f9337fff640 1 --2- 172.21.15.73:0/1689003133 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f933814fa40 0x7f9338151c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:24.783 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:24.781+0000 7f9337fff640 1 -- 172.21.15.73:0/1689003133 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93200094d0 con 0x7f933806db70 2023-12-12T09:44:24.783 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:24.781+0000 7f933c805640 1 --2- 172.21.15.73:0/1689003133 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f933814fa40 0x7f9338151c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:44:24.784 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:24.781+0000 7f9337fff640 1 --2- 172.21.15.73:0/1689003133 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f933806db70 0x7f93381502e0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f932800c410 tx=0x7f932800c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:44:24.784 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:24.781+0000 7f93357fa640 1 -- 172.21.15.73:0/1689003133 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93280035f0 con 0x7f933806db70 2023-12-12T09:44:24.784 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:24.781+0000 7f93357fa640 1 -- 172.21.15.73:0/1689003133 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9328003750 con 0x7f933806db70 2023-12-12T09:44:24.784 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:24.781+0000 7f93357fa640 1 -- 172.21.15.73:0/1689003133 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9328003b00 con 0x7f933806db70 2023-12-12T09:44:24.784 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:24.781+0000 7f933e268640 1 -- 172.21.15.73:0/1689003133 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93380bfcc0 con 0x7f933806db70 2023-12-12T09:44:24.784 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:24.781+0000 7f933e268640 1 -- 172.21.15.73:0/1689003133 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93380714c0 con 0x7f933806db70 2023-12-12T09:44:24.784 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:24.783+0000 7f933e268640 1 -- 172.21.15.73:0/1689003133 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9338067580 con 0x7f933806db70 2023-12-12T09:44:24.784 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:24.783+0000 7f93357fa640 1 -- 172.21.15.73:0/1689003133 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f9328003c60 con 0x7f933806db70 2023-12-12T09:44:24.785 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:24.784+0000 7f93357fa640 1 --2- 172.21.15.73:0/1689003133 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f931806ae40 0x7f931806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:24.785 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:24.784+0000 7f93357fa640 1 -- 172.21.15.73:0/1689003133 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9328088860 con 0x7f933806db70 2023-12-12T09:44:24.786 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:24.785+0000 7f932ffff640 1 --2- 172.21.15.73:0/1689003133 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f931806ae40 0x7f931806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:24.786 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:24.785+0000 7f932ffff640 1 --2- 172.21.15.73:0/1689003133 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f931806ae40 0x7f931806d300 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f9320036000 tx=0x7f932003c040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:44:24.790 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:24.789+0000 7f93357fa640 1 -- 172.21.15.73:0/1689003133 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f9328053900 con 0x7f933806db70 2023-12-12T09:44:25.023 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:25.022+0000 7f933e268640 1 -- 172.21.15.73:0/1689003133 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f93380724d0 con 0x7f933806db70 2023-12-12T09:44:25.024 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:25.023+0000 7f93357fa640 1 -- 172.21.15.73:0/1689003133 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) v1 ==== 94+0+4916 (secure 0 0 0) 0x7f9328056f20 con 0x7f933806db70 2023-12-12T09:44:25.024 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-12T09:44:25.025 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":15,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4517,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6835/2407815368","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6833","nonce":2407815368},{"type":"v1","addr":"172.21.15.142:6835","nonce":2407815368}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":4720,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6834/153753304","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6832","nonce":153753304},{"type":"v1","addr":"172.21.15.142:6834","nonce":153753304}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":4962,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6836/2500303907","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":2500303907},{"type":"v1","addr":"172.21.15.73:6836","nonce":2500303907}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-12T09:44:20.925302+0000","modified":"2023-12-12T09:44:24.049947+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4965},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4965":{"gid":4965,"name":"c","rank":0,"incarnation":12,"state":"up:active","state_seq":4,"addr":"172.21.15.73:6837/1534083424","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6835","nonce":1534083424},{"type":"v1","addr":"172.21.15.73:6837","nonce":1534083424}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-12-12T09:44:25.025 INFO:teuthology.orchestra.run.smithi073.stderr:dumped fsmap epoch 15 2023-12-12T09:44:25.027 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:25.026+0000 7f933e268640 1 -- 172.21.15.73:0/1689003133 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f931806ae40 msgr2=0x7f931806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:25.027 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:25.026+0000 7f933e268640 1 --2- 172.21.15.73:0/1689003133 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f931806ae40 0x7f931806d300 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f9320036000 tx=0x7f932003c040 comp rx=0 tx=0).stop 2023-12-12T09:44:25.027 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:25.026+0000 7f933e268640 1 -- 172.21.15.73:0/1689003133 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f933806db70 msgr2=0x7f93381502e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:25.027 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:25.026+0000 7f933e268640 1 --2- 172.21.15.73:0/1689003133 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f933806db70 0x7f93381502e0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f932800c410 tx=0x7f932800c8d0 comp rx=0 tx=0).stop 2023-12-12T09:44:25.027 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:25.026+0000 7f933e268640 1 -- 172.21.15.73:0/1689003133 shutdown_connections 2023-12-12T09:44:25.028 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:25.026+0000 7f933e268640 1 --2- 172.21.15.73:0/1689003133 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f931806ae40 0x7f931806d300 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:25.028 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:25.026+0000 7f933e268640 1 --2- 172.21.15.73:0/1689003133 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f933814fa40 0x7f9338151c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:25.028 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:25.026+0000 7f933e268640 1 --2- 172.21.15.73:0/1689003133 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f93380c5070 0x7f9338070f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:25.028 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:25.026+0000 7f933e268640 1 --2- 172.21.15.73:0/1689003133 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f933806db70 0x7f93381502e0 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:25.028 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:25.026+0000 7f933e268640 1 -- 172.21.15.73:0/1689003133 >> 172.21.15.73:0/1689003133 conn(0x7f93380a8130 msgr2=0x7f933806a4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:44:25.028 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:25.026+0000 7f933e268640 1 -- 172.21.15.73:0/1689003133 shutdown_connections 2023-12-12T09:44:25.028 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:25.026+0000 7f933e268640 1 -- 172.21.15.73:0/1689003133 wait complete. 2023-12-12T09:44:25.046 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-12T09:44:25.261 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:25.260+0000 7f61e0431640 1 Processor -- start 2023-12-12T09:44:25.261 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:25.260+0000 7f61e0431640 1 -- start start 2023-12-12T09:44:25.262 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:25.261+0000 7f61e0431640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f61d814fa40 0x7f61d806a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:25.262 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:25.261+0000 7f61e0431640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61d8152610 con 0x7f61d806db70 2023-12-12T09:44:25.263 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:25.261+0000 7f61e0431640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61d81528f0 con 0x7f61d80c5070 2023-12-12T09:44:25.263 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:25.261+0000 7f61e0431640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61d8152bd0 con 0x7f61d814fa40 2023-12-12T09:44:25.263 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:25.262+0000 7f61de1cd640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f61d814fa40 0x7f61d806a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:25.263 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:25.262+0000 7f61dd9cc640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f61d806db70 0x7f61d80c39b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:49044/0 (socket says 172.21.15.73:49044) 2023-12-12T09:44:25.263 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:25.262+0000 7f61dd9cc640 1 -- 172.21.15.73:0/2229241984 learned_addr learned my addr 172.21.15.73:0/2229241984 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-12T09:44:25.263 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:25.262+0000 7f61de1cd640 1 -- 172.21.15.73:0/2229241984 >> v1:172.21.15.142:6789/0 conn(0x7f61d80c5070 legacy=0x7f61d80c40c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:44:25.264 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:25.262+0000 7f61de1cd640 1 -- 172.21.15.73:0/2229241984 >> v1:172.21.15.73:6789/0 conn(0x7f61d806db70 legacy=0x7f61d80c39b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:25.264 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:25.262+0000 7f61de1cd640 1 -- 172.21.15.73:0/2229241984 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61d8152eb0 con 0x7f61d814fa40 2023-12-12T09:44:25.264 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:25.262+0000 7f61dd1cb640 1 -- 172.21.15.73:0/2229241984 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1032044856 0 0) 0x7f61d8152610 con 0x7f61d806db70 2023-12-12T09:44:25.264 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:25.263+0000 7f61de1cd640 1 --2- 172.21.15.73:0/2229241984 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f61d814fa40 0x7f61d806a4e0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f61cc009d90 tx=0x7f61cc02be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83b3358ac67025 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:44:25.264 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:25.263+0000 7f61dd1cb640 1 -- 172.21.15.73:0/2229241984 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61cc02cbd0 con 0x7f61d814fa40 2023-12-12T09:44:25.265 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:25.263+0000 7f61dd1cb640 1 -- 172.21.15.73:0/2229241984 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61cc02cd30 con 0x7f61d814fa40 2023-12-12T09:44:25.265 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:25.263+0000 7f61dd1cb640 1 -- 172.21.15.73:0/2229241984 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61cc02cea0 con 0x7f61d814fa40 2023-12-12T09:44:25.265 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:25.264+0000 7f61e0431640 1 -- 172.21.15.73:0/2229241984 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f61d814fa40 msgr2=0x7f61d806a4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:25.266 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:25.264+0000 7f61e0431640 1 --2- 172.21.15.73:0/2229241984 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f61d814fa40 0x7f61d806a4e0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f61cc009d90 tx=0x7f61cc02be20 comp rx=0 tx=0).stop 2023-12-12T09:44:25.266 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:25.264+0000 7f61e0431640 1 -- 172.21.15.73:0/2229241984 shutdown_connections 2023-12-12T09:44:25.266 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:25.264+0000 7f61e0431640 1 --2- 172.21.15.73:0/2229241984 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f61d814fa40 0x7f61d806a4e0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:25.266 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:25.264+0000 7f61e0431640 1 -- 172.21.15.73:0/2229241984 >> 172.21.15.73:0/2229241984 conn(0x7f61d80a8130 msgr2=0x7f61d80c24b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:44:25.266 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:25.264+0000 7f61e0431640 1 -- 172.21.15.73:0/2229241984 shutdown_connections 2023-12-12T09:44:25.266 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:25.264+0000 7f61e0431640 1 -- 172.21.15.73:0/2229241984 wait complete. 2023-12-12T09:44:25.267 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:25.266+0000 7f61e0431640 1 Processor -- start 2023-12-12T09:44:25.267 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:25.266+0000 7f61e0431640 1 -- start start 2023-12-12T09:44:25.270 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:25.267+0000 7f61e0431640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f61d806db70 0x7f61d814a1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:25.270 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:25.267+0000 7f61e0431640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f61d80c5070 0x7f61d81ea780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:25.270 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:25.267+0000 7f61e0431640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f61d814fa40 0x7f61d81eacc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:25.270 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:25.267+0000 7f61e0431640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61d81519a0 con 0x7f61d814fa40 2023-12-12T09:44:25.270 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:25.267+0000 7f61e0431640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61d814ac40 con 0x7f61d80c5070 2023-12-12T09:44:25.270 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:25.267+0000 7f61e0431640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61d8150bf0 con 0x7f61d806db70 2023-12-12T09:44:25.270 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:25.267+0000 7f61de9ce640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f61d814fa40 0x7f61d81eacc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:25.270 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:25.267+0000 7f61de9ce640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f61d814fa40 0x7f61d81eacc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:42438/0 (socket says 172.21.15.73:42438) 2023-12-12T09:44:25.271 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:25.268+0000 7f61de9ce640 1 -- 172.21.15.73:0/1308961038 learned_addr learned my addr 172.21.15.73:0/1308961038 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:44:25.271 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:25.268+0000 7f61de1cd640 1 --2- 172.21.15.73:0/1308961038 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f61d806db70 0x7f61d814a1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:25.271 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:25.268+0000 7f61dd9cc640 1 --2- 172.21.15.73:0/1308961038 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f61d80c5070 0x7f61d81ea780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:25.271 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:25.268+0000 7f61de9ce640 1 -- 172.21.15.73:0/1308961038 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f61d806db70 msgr2=0x7f61d814a1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:25.271 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:25.268+0000 7f61de9ce640 1 --2- 172.21.15.73:0/1308961038 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f61d806db70 0x7f61d814a1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:25.271 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:25.268+0000 7f61de9ce640 1 -- 172.21.15.73:0/1308961038 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f61d80c5070 msgr2=0x7f61d81ea780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:25.271 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:25.268+0000 7f61de9ce640 1 --2- 172.21.15.73:0/1308961038 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f61d80c5070 0x7f61d81ea780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:25.271 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:25.268+0000 7f61de9ce640 1 -- 172.21.15.73:0/1308961038 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61cc009a70 con 0x7f61d814fa40 2023-12-12T09:44:25.271 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:25.268+0000 7f61de9ce640 1 --2- 172.21.15.73:0/1308961038 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f61d814fa40 0x7f61d81eacc0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f61d000c440 tx=0x7f61d000c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:44:25.271 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:25.268+0000 7f61d6ffd640 1 -- 172.21.15.73:0/1308961038 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61d0011790 con 0x7f61d814fa40 2023-12-12T09:44:25.271 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:25.269+0000 7f61d6ffd640 1 -- 172.21.15.73:0/1308961038 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61d00118f0 con 0x7f61d814fa40 2023-12-12T09:44:25.271 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:25.269+0000 7f61e0431640 1 -- 172.21.15.73:0/1308961038 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61d81ea0a0 con 0x7f61d814fa40 2023-12-12T09:44:25.271 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:25.269+0000 7f61d6ffd640 1 -- 172.21.15.73:0/1308961038 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61d0011ca0 con 0x7f61d814fa40 2023-12-12T09:44:25.271 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:25.269+0000 7f61e0431640 1 -- 172.21.15.73:0/1308961038 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61d8151100 con 0x7f61d814fa40 2023-12-12T09:44:25.272 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:25.270+0000 7f61e0431640 1 -- 172.21.15.73:0/1308961038 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61d80a5200 con 0x7f61d814fa40 2023-12-12T09:44:25.272 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:25.271+0000 7f61d6ffd640 1 -- 172.21.15.73:0/1308961038 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f61d001c460 con 0x7f61d814fa40 2023-12-12T09:44:25.273 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:25.272+0000 7f61d6ffd640 1 --2- 172.21.15.73:0/1308961038 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f61bc06ae40 0x7f61bc06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:25.273 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:25.272+0000 7f61d6ffd640 1 -- 172.21.15.73:0/1308961038 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f61d00895c0 con 0x7f61d814fa40 2023-12-12T09:44:25.273 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:25.272+0000 7f61de1cd640 1 --2- 172.21.15.73:0/1308961038 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f61bc06ae40 0x7f61bc06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:25.273 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:25.273+0000 7f61de1cd640 1 --2- 172.21.15.73:0/1308961038 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f61bc06ae40 0x7f61bc06d300 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f61cc036000 tx=0x7f61cc030000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:44:25.277 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:25.276+0000 7f61d6ffd640 1 -- 172.21.15.73:0/1308961038 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f61d00545d0 con 0x7f61d814fa40 2023-12-12T09:44:25.473 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:25.472+0000 7f61e0431640 1 -- 172.21.15.73:0/1308961038 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f61d8067580 con 0x7f61d814fa40 2023-12-12T09:44:25.476 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:25.475+0000 7f61d6ffd640 1 -- 172.21.15.73:0/1308961038 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v34) v1 ==== 74+0+16581 (secure 0 0 0) 0x7f61d0057bf0 con 0x7f61d814fa40 2023-12-12T09:44:25.476 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-12T09:44:25.476 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":34,"fsid":"ba240992-02b8-4c7e-92f2-27eb29ac433b","created":"2023-12-12T09:43:02.454719+0000","modified":"2023-12-12T09:44:22.500256+0000","last_up_change":"2023-12-12T09:43:13.913440+0000","last_in_change":"2023-12-12T09:43:05.925348+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-12T09:43:15.525508+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-12-12T09:44:18.641446+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-12-12T09:44:19.952405+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"dd9074be-dbe2-4c34-9896-a4223d8d3940","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":4047810203},{"type":"v1","addr":"172.21.15.73:6801","nonce":4047810203}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":4047810203},{"type":"v1","addr":"172.21.15.73:6803","nonce":4047810203}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":4047810203},{"type":"v1","addr":"172.21.15.73:6807","nonce":4047810203}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":4047810203},{"type":"v1","addr":"172.21.15.73:6805","nonce":4047810203}]},"public_addr":"172.21.15.73:6801/4047810203","cluster_addr":"172.21.15.73:6803/4047810203","heartbeat_back_addr":"172.21.15.73:6807/4047810203","heartbeat_front_addr":"172.21.15.73:6805/4047810203","state":["exists","up"]},{"osd":1,"uuid":"c4a05052-96d4-4758-a4e1-1a37f1e07fed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":1356058331},{"type":"v1","addr":"172.21.15.73:6824","nonce":1356058331}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":1356058331},{"type":"v1","addr":"172.21.15.73:6827","nonce":1356058331}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":1356058331},{"type":"v1","addr":"172.21.15.73:6831","nonce":1356058331}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":1356058331},{"type":"v1","addr":"172.21.15.73:6829","nonce":1356058331}]},"public_addr":"172.21.15.73:6824/1356058331","cluster_addr":"172.21.15.73:6827/1356058331","heartbeat_back_addr":"172.21.15.73:6831/1356058331","heartbeat_front_addr":"172.21.15.73:6829/1356058331","state":["exists","up"]},{"osd":2,"uuid":"512bc8ac-72c2-40d4-b3d2-d867a92c5213","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":1228903316},{"type":"v1","addr":"172.21.15.73:6817","nonce":1228903316}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":1228903316},{"type":"v1","addr":"172.21.15.73:6819","nonce":1228903316}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6823","nonce":1228903316},{"type":"v1","addr":"172.21.15.73:6825","nonce":1228903316}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":1228903316},{"type":"v1","addr":"172.21.15.73:6821","nonce":1228903316}]},"public_addr":"172.21.15.73:6817/1228903316","cluster_addr":"172.21.15.73:6819/1228903316","heartbeat_back_addr":"172.21.15.73:6825/1228903316","heartbeat_front_addr":"172.21.15.73:6821/1228903316","state":["exists","up"]},{"osd":3,"uuid":"3d1a91e0-42bf-437a-8eae-8d357c8f63a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":1293329670},{"type":"v1","addr":"172.21.15.73:6809","nonce":1293329670}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6810","nonce":1293329670},{"type":"v1","addr":"172.21.15.73:6811","nonce":1293329670}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":1293329670},{"type":"v1","addr":"172.21.15.73:6815","nonce":1293329670}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":1293329670},{"type":"v1","addr":"172.21.15.73:6813","nonce":1293329670}]},"public_addr":"172.21.15.73:6809/1293329670","cluster_addr":"172.21.15.73:6811/1293329670","heartbeat_back_addr":"172.21.15.73:6815/1293329670","heartbeat_front_addr":"172.21.15.73:6813/1293329670","state":["exists","up"]},{"osd":4,"uuid":"4b302fff-834c-4069-ac19-00e46f6c87b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":3727975702},{"type":"v1","addr":"172.21.15.142:6801","nonce":3727975702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":3727975702},{"type":"v1","addr":"172.21.15.142:6803","nonce":3727975702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6809","nonce":3727975702},{"type":"v1","addr":"172.21.15.142:6811","nonce":3727975702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6805","nonce":3727975702},{"type":"v1","addr":"172.21.15.142:6807","nonce":3727975702}]},"public_addr":"172.21.15.142:6801/3727975702","cluster_addr":"172.21.15.142:6803/3727975702","heartbeat_back_addr":"172.21.15.142:6811/3727975702","heartbeat_front_addr":"172.21.15.142:6807/3727975702","state":["exists","up"]},{"osd":5,"uuid":"d7cdace2-67d0-45cc-95f2-515cf6ef1b82","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6817","nonce":2353193632},{"type":"v1","addr":"172.21.15.142:6819","nonce":2353193632}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6821","nonce":2353193632},{"type":"v1","addr":"172.21.15.142:6823","nonce":2353193632}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6829","nonce":2353193632},{"type":"v1","addr":"172.21.15.142:6831","nonce":2353193632}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6825","nonce":2353193632},{"type":"v1","addr":"172.21.15.142:6827","nonce":2353193632}]},"public_addr":"172.21.15.142:6819/2353193632","cluster_addr":"172.21.15.142:6823/2353193632","heartbeat_back_addr":"172.21.15.142:6831/2353193632","heartbeat_front_addr":"172.21.15.142:6827/2353193632","state":["exists","up"]},{"osd":6,"uuid":"649ce78a-5626-445c-aedc-a651ed05a6f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":2006111986},{"type":"v1","addr":"172.21.15.142:6806","nonce":2006111986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":2006111986},{"type":"v1","addr":"172.21.15.142:6810","nonce":2006111986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":2006111986},{"type":"v1","addr":"172.21.15.142:6815","nonce":2006111986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":2006111986},{"type":"v1","addr":"172.21.15.142:6813","nonce":2006111986}]},"public_addr":"172.21.15.142:6806/2006111986","cluster_addr":"172.21.15.142:6810/2006111986","heartbeat_back_addr":"172.21.15.142:6815/2006111986","heartbeat_front_addr":"172.21.15.142:6813/2006111986","state":["exists","up"]},{"osd":7,"uuid":"af15ae3b-c1d0-4acf-92db-8a1805494d13","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":2573794341},{"type":"v1","addr":"172.21.15.142:6818","nonce":2573794341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":2573794341},{"type":"v1","addr":"172.21.15.142:6822","nonce":2573794341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":2573794341},{"type":"v1","addr":"172.21.15.142:6830","nonce":2573794341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":2573794341},{"type":"v1","addr":"172.21.15.142:6826","nonce":2573794341}]},"public_addr":"172.21.15.142:6818/2573794341","cluster_addr":"172.21.15.142:6822/2573794341","heartbeat_back_addr":"172.21.15.142:6830/2573794341","heartbeat_front_addr":"172.21.15.142:6826/2573794341","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.185824+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.262103+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.225556+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:10.523459+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:10.706035+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.257339+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.301776+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.051960+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-12T09:44:25.479 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:25.477+0000 7f61e0431640 1 -- 172.21.15.73:0/1308961038 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f61bc06ae40 msgr2=0x7f61bc06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:25.479 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:25.477+0000 7f61e0431640 1 --2- 172.21.15.73:0/1308961038 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f61bc06ae40 0x7f61bc06d300 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f61cc036000 tx=0x7f61cc030000 comp rx=0 tx=0).stop 2023-12-12T09:44:25.479 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:25.477+0000 7f61e0431640 1 -- 172.21.15.73:0/1308961038 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f61d814fa40 msgr2=0x7f61d81eacc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:25.479 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:25.477+0000 7f61e0431640 1 --2- 172.21.15.73:0/1308961038 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f61d814fa40 0x7f61d81eacc0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f61d000c440 tx=0x7f61d000c900 comp rx=0 tx=0).stop 2023-12-12T09:44:25.480 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:25.478+0000 7f61e0431640 1 -- 172.21.15.73:0/1308961038 shutdown_connections 2023-12-12T09:44:25.480 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:25.478+0000 7f61e0431640 1 --2- 172.21.15.73:0/1308961038 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f61bc06ae40 0x7f61bc06d300 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:25.480 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:25.478+0000 7f61e0431640 1 --2- 172.21.15.73:0/1308961038 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f61d814fa40 0x7f61d81eacc0 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:25.480 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:25.478+0000 7f61e0431640 1 --2- 172.21.15.73:0/1308961038 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f61d80c5070 0x7f61d81ea780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:25.480 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:25.478+0000 7f61e0431640 1 --2- 172.21.15.73:0/1308961038 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f61d806db70 0x7f61d814a1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:25.480 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:25.478+0000 7f61e0431640 1 -- 172.21.15.73:0/1308961038 >> 172.21.15.73:0/1308961038 conn(0x7f61d80a8130 msgr2=0x7f61d80c2440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:44:25.480 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:25.478+0000 7f61e0431640 1 -- 172.21.15.73:0/1308961038 shutdown_connections 2023-12-12T09:44:25.480 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:25.478+0000 7f61e0431640 1 -- 172.21.15.73:0/1308961038 wait complete. 2023-12-12T09:44:25.499 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-12-12T09:44:25.499 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-12T09:44:25.711 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:25.710+0000 7efc2046b640 1 Processor -- start 2023-12-12T09:44:25.711 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:25.710+0000 7efc2046b640 1 -- start start 2023-12-12T09:44:25.713 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:25.711+0000 7efc2046b640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efc1814fa40 0x7efc1806a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:25.713 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:25.711+0000 7efc2046b640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc18152610 con 0x7efc180c5070 2023-12-12T09:44:25.713 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:25.711+0000 7efc2046b640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc181528f0 con 0x7efc1806db70 2023-12-12T09:44:25.713 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:25.711+0000 7efc2046b640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc18152bd0 con 0x7efc1814fa40 2023-12-12T09:44:25.713 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:25.712+0000 7efc1ea08640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7efc180c5070 0x7efc180c40c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:49050/0 (socket says 172.21.15.73:49050) 2023-12-12T09:44:25.713 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:25.712+0000 7efc1ea08640 1 -- 172.21.15.73:0/444690669 learned_addr learned my addr 172.21.15.73:0/444690669 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-12T09:44:25.715 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:25.712+0000 7efc1d205640 1 -- 172.21.15.73:0/444690669 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4229416587 0 0) 0x7efc18152610 con 0x7efc180c5070 2023-12-12T09:44:25.715 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:25.712+0000 7efc1d205640 1 -- 172.21.15.73:0/444690669 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efc04003520 con 0x7efc180c5070 2023-12-12T09:44:25.715 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:25.712+0000 7efc1e207640 1 --2- 172.21.15.73:0/444690669 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efc1814fa40 0x7efc1806a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:25.715 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:25.713+0000 7efc1d205640 1 -- 172.21.15.73:0/444690669 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 889289329 0 0) 0x7efc04003520 con 0x7efc180c5070 2023-12-12T09:44:25.715 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:25.713+0000 7efc1d205640 1 -- 172.21.15.73:0/444690669 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efc1814fa40 msgr2=0x7efc1806a4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:44:25.715 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:25.713+0000 7efc1d205640 1 --2- 172.21.15.73:0/444690669 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efc1814fa40 0x7efc1806a4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:25.716 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:25.713+0000 7efc1d205640 1 -- 172.21.15.73:0/444690669 >> v1:172.21.15.142:6789/0 conn(0x7efc1806db70 legacy=0x7efc180c39b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:25.716 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:25.713+0000 7efc1d205640 1 -- 172.21.15.73:0/444690669 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc18152eb0 con 0x7efc180c5070 2023-12-12T09:44:25.716 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:25.713+0000 7efc1d205640 1 -- 172.21.15.73:0/444690669 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3186547832 0 0) 0x7efc100019f0 con 0x7efc180c5070 2023-12-12T09:44:25.716 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:25.713+0000 7efc1d205640 1 -- 172.21.15.73:0/444690669 >> v1:172.21.15.73:6789/0 conn(0x7efc180c5070 legacy=0x7efc180c40c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:25.716 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:25.713+0000 7efc1d205640 1 --2- 172.21.15.73:0/444690669 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efc040039a0 0x7efc04003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:25.716 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:25.713+0000 7efc1d205640 1 --2- 172.21.15.73:0/444690669 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efc040047c0 0x7efc04004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:25.716 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:25.713+0000 7efc1d205640 1 --2- 172.21.15.73:0/444690669 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efc1814fa40 0x7efc040051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:25.716 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:25.713+0000 7efc1d205640 1 -- 172.21.15.73:0/444690669 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc18152bd0 con 0x7efc040047c0 2023-12-12T09:44:25.716 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:25.713+0000 7efc1d205640 1 -- 172.21.15.73:0/444690669 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc0400bab0 con 0x7efc040039a0 2023-12-12T09:44:25.716 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:25.713+0000 7efc1d205640 1 -- 172.21.15.73:0/444690669 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc0400bc70 con 0x7efc1814fa40 2023-12-12T09:44:25.716 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:25.713+0000 7efc1da06640 1 --2- 172.21.15.73:0/444690669 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efc040047c0 0x7efc04004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:25.716 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:25.714+0000 7efc1e207640 1 --2- 172.21.15.73:0/444690669 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efc040039a0 0x7efc04003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:25.716 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:25.714+0000 7efc1ea08640 1 --2- 172.21.15.73:0/444690669 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efc1814fa40 0x7efc040051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:25.717 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:25.714+0000 7efc1da06640 1 -- 172.21.15.73:0/444690669 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efc1814fa40 msgr2=0x7efc040051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:44:25.717 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:25.714+0000 7efc1da06640 1 --2- 172.21.15.73:0/444690669 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efc1814fa40 0x7efc040051c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:25.717 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:25.714+0000 7efc1da06640 1 -- 172.21.15.73:0/444690669 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efc040039a0 msgr2=0x7efc04003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:44:25.717 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:25.714+0000 7efc1da06640 1 --2- 172.21.15.73:0/444690669 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efc040039a0 0x7efc04003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:25.717 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:25.714+0000 7efc1da06640 1 -- 172.21.15.73:0/444690669 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc04003520 con 0x7efc040047c0 2023-12-12T09:44:25.717 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:25.714+0000 7efc1e207640 1 --2- 172.21.15.73:0/444690669 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efc040039a0 0x7efc04003dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:44:25.718 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:25.715+0000 7efc1da06640 1 --2- 172.21.15.73:0/444690669 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efc040047c0 0x7efc04004c40 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7efc08001720 tx=0x7efc040057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7556cabad4d60ba9 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:44:25.718 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:25.715+0000 7efc1d205640 1 -- 172.21.15.73:0/444690669 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc080052d0 con 0x7efc040047c0 2023-12-12T09:44:25.718 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:25.715+0000 7efc1d205640 1 -- 172.21.15.73:0/444690669 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc0802e050 con 0x7efc040047c0 2023-12-12T09:44:25.718 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:25.715+0000 7efc1d205640 1 -- 172.21.15.73:0/444690669 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc080035f0 con 0x7efc040047c0 2023-12-12T09:44:25.718 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:25.716+0000 7efc2046b640 1 -- 172.21.15.73:0/444690669 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efc040047c0 msgr2=0x7efc04004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:25.719 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:25.716+0000 7efc2046b640 1 --2- 172.21.15.73:0/444690669 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efc040047c0 0x7efc04004c40 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7efc08001720 tx=0x7efc040057f0 comp rx=0 tx=0).stop 2023-12-12T09:44:25.719 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:25.716+0000 7efc1ea08640 1 -- 172.21.15.73:0/444690669 reap_dead start 2023-12-12T09:44:25.719 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:25.716+0000 7efc2046b640 1 -- 172.21.15.73:0/444690669 shutdown_connections 2023-12-12T09:44:25.719 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:25.716+0000 7efc2046b640 1 -- 172.21.15.73:0/444690669 >> 172.21.15.73:0/444690669 conn(0x7efc180a8130 msgr2=0x7efc180c24b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:44:25.719 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:25.716+0000 7efc2046b640 1 -- 172.21.15.73:0/444690669 shutdown_connections 2023-12-12T09:44:25.719 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:25.716+0000 7efc2046b640 1 -- 172.21.15.73:0/444690669 wait complete. 2023-12-12T09:44:25.721 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:25.718+0000 7efc2046b640 1 Processor -- start 2023-12-12T09:44:25.721 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:25.718+0000 7efc2046b640 1 -- start start 2023-12-12T09:44:25.721 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:25.719+0000 7efc2046b640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efc040047c0 0x7efc180715c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:25.721 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:25.719+0000 7efc2046b640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efc1814ad40 0x7efc180bede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:25.721 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:25.719+0000 7efc2046b640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efc1814a780 0x7efc180bf320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:25.721 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:25.719+0000 7efc2046b640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc180a9710 con 0x7efc1814ad40 2023-12-12T09:44:25.721 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:25.719+0000 7efc2046b640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc180a93c0 con 0x7efc040047c0 2023-12-12T09:44:25.721 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:25.719+0000 7efc2046b640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc181ea530 con 0x7efc1814a780 2023-12-12T09:44:25.721 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:25.719+0000 7efc1da06640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efc1814ad40 0x7efc180bede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:25.721 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:25.719+0000 7efc1da06640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efc1814ad40 0x7efc180bede0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:42460/0 (socket says 172.21.15.73:42460) 2023-12-12T09:44:25.721 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:25.719+0000 7efc1da06640 1 -- 172.21.15.73:0/1638914112 learned_addr learned my addr 172.21.15.73:0/1638914112 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:44:25.721 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:25.719+0000 7efc1ea08640 1 --2- 172.21.15.73:0/1638914112 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efc1814a780 0x7efc180bf320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:25.721 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:25.719+0000 7efc1e207640 1 --2- 172.21.15.73:0/1638914112 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efc040047c0 0x7efc180715c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:25.722 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:25.720+0000 7efc1da06640 1 -- 172.21.15.73:0/1638914112 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efc1814a780 msgr2=0x7efc180bf320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:25.722 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:25.720+0000 7efc1da06640 1 --2- 172.21.15.73:0/1638914112 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efc1814a780 0x7efc180bf320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:25.722 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:25.720+0000 7efc1da06640 1 -- 172.21.15.73:0/1638914112 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efc040047c0 msgr2=0x7efc180715c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:25.722 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:25.720+0000 7efc1da06640 1 --2- 172.21.15.73:0/1638914112 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efc040047c0 0x7efc180715c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:25.722 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:25.720+0000 7efc1da06640 1 -- 172.21.15.73:0/1638914112 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc180bf860 con 0x7efc1814ad40 2023-12-12T09:44:25.722 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:25.720+0000 7efc1e207640 1 --2- 172.21.15.73:0/1638914112 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efc040047c0 0x7efc180715c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:44:25.722 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:25.720+0000 7efc1da06640 1 --2- 172.21.15.73:0/1638914112 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efc1814ad40 0x7efc180bede0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7efc08005040 tx=0x7efc08001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:44:25.723 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:25.720+0000 7efc0effd640 1 -- 172.21.15.73:0/1638914112 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc080076c0 con 0x7efc1814ad40 2023-12-12T09:44:25.723 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:25.720+0000 7efc0effd640 1 -- 172.21.15.73:0/1638914112 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc08007a30 con 0x7efc1814ad40 2023-12-12T09:44:25.723 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:25.720+0000 7efc2046b640 1 -- 172.21.15.73:0/1638914112 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc180a9b30 con 0x7efc1814ad40 2023-12-12T09:44:25.723 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:25.720+0000 7efc0effd640 1 -- 172.21.15.73:0/1638914112 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc08006be0 con 0x7efc1814ad40 2023-12-12T09:44:25.723 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:25.720+0000 7efc2046b640 1 -- 172.21.15.73:0/1638914112 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc18071b00 con 0x7efc1814ad40 2023-12-12T09:44:25.723 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:25.721+0000 7efc2046b640 1 -- 172.21.15.73:0/1638914112 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc18067580 con 0x7efc1814ad40 2023-12-12T09:44:25.724 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:25.723+0000 7efc0effd640 1 -- 172.21.15.73:0/1638914112 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7efc08006d40 con 0x7efc1814ad40 2023-12-12T09:44:25.725 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:25.724+0000 7efc0effd640 1 --2- 172.21.15.73:0/1638914112 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7efbfc06ae70 0x7efbfc06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:25.725 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:25.724+0000 7efc0effd640 1 -- 172.21.15.73:0/1638914112 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7efc080ab740 con 0x7efc1814ad40 2023-12-12T09:44:25.725 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:25.724+0000 7efc1e207640 1 --2- 172.21.15.73:0/1638914112 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7efbfc06ae70 0x7efbfc06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:25.726 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:25.725+0000 7efc1e207640 1 --2- 172.21.15.73:0/1638914112 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7efbfc06ae70 0x7efbfc06d330 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7efc14009aa0 tx=0x7efc14008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:44:25.729 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:25.728+0000 7efc0effd640 1 -- 172.21.15.73:0/1638914112 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7efc080767e0 con 0x7efc1814ad40 2023-12-12T09:44:25.914 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:25.913+0000 7efc2046b640 1 -- 172.21.15.73:0/1638914112 --> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7efc1814fe20 con 0x7efbfc06ae70 2023-12-12T09:44:25.927 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:25.926+0000 7efc0effd640 1 -- 172.21.15.73:0/1638914112 <== mgr.4110 v2:172.21.15.73:6832/779985841 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+287138 (secure 0 0 0) 0x7efc140119a0 con 0x7efbfc06ae70 2023-12-12T09:44:25.931 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-12T09:44:25.933 INFO:teuthology.orchestra.run.smithi073.stderr:dumped all 2023-12-12T09:44:25.935 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:25.931+0000 7efc2046b640 1 -- 172.21.15.73:0/1638914112 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7efbfc06ae70 msgr2=0x7efbfc06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:25.935 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:25.931+0000 7efc2046b640 1 --2- 172.21.15.73:0/1638914112 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7efbfc06ae70 0x7efbfc06d330 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7efc14009aa0 tx=0x7efc14008040 comp rx=0 tx=0).stop 2023-12-12T09:44:25.935 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:25.931+0000 7efc2046b640 1 -- 172.21.15.73:0/1638914112 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efc1814ad40 msgr2=0x7efc180bede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:25.935 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:25.931+0000 7efc2046b640 1 --2- 172.21.15.73:0/1638914112 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efc1814ad40 0x7efc180bede0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7efc08005040 tx=0x7efc08001120 comp rx=0 tx=0).stop 2023-12-12T09:44:25.935 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:25.931+0000 7efc2046b640 1 -- 172.21.15.73:0/1638914112 shutdown_connections 2023-12-12T09:44:25.935 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:25.931+0000 7efc2046b640 1 --2- 172.21.15.73:0/1638914112 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7efbfc06ae70 0x7efbfc06d330 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:25.935 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:25.931+0000 7efc2046b640 1 --2- 172.21.15.73:0/1638914112 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efc1814a780 0x7efc180bf320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:25.935 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:25.931+0000 7efc2046b640 1 --2- 172.21.15.73:0/1638914112 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efc1814ad40 0x7efc180bede0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:25.935 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:25.931+0000 7efc2046b640 1 --2- 172.21.15.73:0/1638914112 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efc040047c0 0x7efc180715c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:25.935 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:25.931+0000 7efc2046b640 1 -- 172.21.15.73:0/1638914112 >> 172.21.15.73:0/1638914112 conn(0x7efc180a8130 msgr2=0x7efc1806a4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:44:25.935 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:25.931+0000 7efc2046b640 1 -- 172.21.15.73:0/1638914112 shutdown_connections 2023-12-12T09:44:25.936 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:25.931+0000 7efc2046b640 1 -- 172.21.15.73:0/1638914112 wait complete. 2023-12-12T09:44:25.952 INFO:teuthology.orchestra.run.smithi073.stdout:{"pg_ready":true,"pg_map":{"version":63,"stamp":"2023-12-12T09:44:25.475156+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":120,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219364,"kb_used_data":3188,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755356,"statfs":{"total":773094113280,"available":772869484544,"internally_reserved":0,"allocated":3264512,"data_stored":2385432,"data_compressed":64844,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":40,"apply_latency_ms":40,"commit_latency_ns":40000000,"apply_latency_ns":40000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001808"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-12T09:44:22.686611+0000","last_change":"2023-12-12T09:44:21.521409+0000","last_active":"2023-12-12T09:44:22.686611+0000","last_peered":"2023-12-12T09:44:22.686611+0000","last_clean":"2023-12-12T09:44:22.686611+0000","last_became_active":"2023-12-12T09:44:21.520807+0000","last_became_peered":"2023-12-12T09:44:21.520807+0000","last_unstale":"2023-12-12T09:44:22.686611+0000","last_undegraded":"2023-12-12T09:44:22.686611+0000","last_fullsized":"2023-12-12T09:44:22.686611+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_clean_scrub_stamp":"2023-12-12T09:44:20.465592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T10:43:48.035299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-12T09:44:22.509764+0000","last_change":"2023-12-12T09:44:21.513912+0000","last_active":"2023-12-12T09:44:22.509764+0000","last_peered":"2023-12-12T09:44:22.509764+0000","last_clean":"2023-12-12T09:44:22.509764+0000","last_became_active":"2023-12-12T09:44:21.513624+0000","last_became_peered":"2023-12-12T09:44:21.513624+0000","last_unstale":"2023-12-12T09:44:22.509764+0000","last_undegraded":"2023-12-12T09:44:22.509764+0000","last_fullsized":"2023-12-12T09:44:22.509764+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_clean_scrub_stamp":"2023-12-12T09:44:20.465592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T14:08:30.510607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-12T09:44:22.516115+0000","last_change":"2023-12-12T09:44:21.516991+0000","last_active":"2023-12-12T09:44:22.516115+0000","last_peered":"2023-12-12T09:44:22.516115+0000","last_clean":"2023-12-12T09:44:22.516115+0000","last_became_active":"2023-12-12T09:44:21.516690+0000","last_became_peered":"2023-12-12T09:44:21.516690+0000","last_unstale":"2023-12-12T09:44:22.516115+0000","last_undegraded":"2023-12-12T09:44:22.516115+0000","last_fullsized":"2023-12-12T09:44:22.516115+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_clean_scrub_stamp":"2023-12-12T09:44:20.465592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T20:53:13.479872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-12T09:44:24.021218+0000","last_change":"2023-12-12T09:44:21.536425+0000","last_active":"2023-12-12T09:44:24.021218+0000","last_peered":"2023-12-12T09:44:24.021218+0000","last_clean":"2023-12-12T09:44:24.021218+0000","last_became_active":"2023-12-12T09:44:21.534962+0000","last_became_peered":"2023-12-12T09:44:21.534962+0000","last_unstale":"2023-12-12T09:44:24.021218+0000","last_undegraded":"2023-12-12T09:44:24.021218+0000","last_fullsized":"2023-12-12T09:44:24.021218+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_clean_scrub_stamp":"2023-12-12T09:44:20.465592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T11:40:20.775860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-12T09:44:24.021568+0000","last_change":"2023-12-12T09:44:21.517132+0000","last_active":"2023-12-12T09:44:24.021568+0000","last_peered":"2023-12-12T09:44:24.021568+0000","last_clean":"2023-12-12T09:44:24.021568+0000","last_became_active":"2023-12-12T09:44:21.516794+0000","last_became_peered":"2023-12-12T09:44:21.516794+0000","last_unstale":"2023-12-12T09:44:24.021568+0000","last_undegraded":"2023-12-12T09:44:24.021568+0000","last_fullsized":"2023-12-12T09:44:24.021568+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_clean_scrub_stamp":"2023-12-12T09:44:20.465592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T14:59:37.496347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-12T09:44:22.510245+0000","last_change":"2023-12-12T09:44:21.520418+0000","last_active":"2023-12-12T09:44:22.510245+0000","last_peered":"2023-12-12T09:44:22.510245+0000","last_clean":"2023-12-12T09:44:22.510245+0000","last_became_active":"2023-12-12T09:44:21.520070+0000","last_became_peered":"2023-12-12T09:44:21.520070+0000","last_unstale":"2023-12-12T09:44:22.510245+0000","last_undegraded":"2023-12-12T09:44:22.510245+0000","last_fullsized":"2023-12-12T09:44:22.510245+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_clean_scrub_stamp":"2023-12-12T09:44:20.465592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T20:42:57.403954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-12T09:44:22.513863+0000","last_change":"2023-12-12T09:44:21.526135+0000","last_active":"2023-12-12T09:44:22.513863+0000","last_peered":"2023-12-12T09:44:22.513863+0000","last_clean":"2023-12-12T09:44:22.513863+0000","last_became_active":"2023-12-12T09:44:21.525852+0000","last_became_peered":"2023-12-12T09:44:21.525852+0000","last_unstale":"2023-12-12T09:44:22.513863+0000","last_undegraded":"2023-12-12T09:44:22.513863+0000","last_fullsized":"2023-12-12T09:44:22.513863+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_clean_scrub_stamp":"2023-12-12T09:44:20.465592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T21:03:17.881060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-12T09:44:22.513007+0000","last_change":"2023-12-12T09:44:21.526128+0000","last_active":"2023-12-12T09:44:22.513007+0000","last_peered":"2023-12-12T09:44:22.513007+0000","last_clean":"2023-12-12T09:44:22.513007+0000","last_became_active":"2023-12-12T09:44:21.521368+0000","last_became_peered":"2023-12-12T09:44:21.521368+0000","last_unstale":"2023-12-12T09:44:22.513007+0000","last_undegraded":"2023-12-12T09:44:22.513007+0000","last_fullsized":"2023-12-12T09:44:22.513007+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_clean_scrub_stamp":"2023-12-12T09:44:20.465592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T20:58:54.834367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-12T09:44:24.020933+0000","last_change":"2023-12-12T09:44:21.531885+0000","last_active":"2023-12-12T09:44:24.020933+0000","last_peered":"2023-12-12T09:44:24.020933+0000","last_clean":"2023-12-12T09:44:24.020933+0000","last_became_active":"2023-12-12T09:44:21.531436+0000","last_became_peered":"2023-12-12T09:44:21.531436+0000","last_unstale":"2023-12-12T09:44:24.020933+0000","last_undegraded":"2023-12-12T09:44:24.020933+0000","last_fullsized":"2023-12-12T09:44:24.020933+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_clean_scrub_stamp":"2023-12-12T09:44:20.465592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T18:54:29.796762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-12T09:44:24.020933+0000","last_change":"2023-12-12T09:44:21.515196+0000","last_active":"2023-12-12T09:44:24.020933+0000","last_peered":"2023-12-12T09:44:24.020933+0000","last_clean":"2023-12-12T09:44:24.020933+0000","last_became_active":"2023-12-12T09:44:21.514944+0000","last_became_peered":"2023-12-12T09:44:21.514944+0000","last_unstale":"2023-12-12T09:44:24.020933+0000","last_undegraded":"2023-12-12T09:44:24.020933+0000","last_fullsized":"2023-12-12T09:44:24.020933+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_clean_scrub_stamp":"2023-12-12T09:44:20.465592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T14:50:35.888381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-12T09:44:22.514214+0000","last_change":"2023-12-12T09:44:21.536596+0000","last_active":"2023-12-12T09:44:22.514214+0000","last_peered":"2023-12-12T09:44:22.514214+0000","last_clean":"2023-12-12T09:44:22.514214+0000","last_became_active":"2023-12-12T09:44:21.536304+0000","last_became_peered":"2023-12-12T09:44:21.536304+0000","last_unstale":"2023-12-12T09:44:22.514214+0000","last_undegraded":"2023-12-12T09:44:22.514214+0000","last_fullsized":"2023-12-12T09:44:22.514214+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_clean_scrub_stamp":"2023-12-12T09:44:20.465592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T11:36:54.156220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-12T09:44:22.515933+0000","last_change":"2023-12-12T09:44:21.517566+0000","last_active":"2023-12-12T09:44:22.515933+0000","last_peered":"2023-12-12T09:44:22.515933+0000","last_clean":"2023-12-12T09:44:22.515933+0000","last_became_active":"2023-12-12T09:44:21.517004+0000","last_became_peered":"2023-12-12T09:44:21.517004+0000","last_unstale":"2023-12-12T09:44:22.515933+0000","last_undegraded":"2023-12-12T09:44:22.515933+0000","last_fullsized":"2023-12-12T09:44:22.515933+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_clean_scrub_stamp":"2023-12-12T09:44:20.465592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T10:50:32.155095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-12T09:44:24.021696+0000","last_change":"2023-12-12T09:44:21.510175+0000","last_active":"2023-12-12T09:44:24.021696+0000","last_peered":"2023-12-12T09:44:24.021696+0000","last_clean":"2023-12-12T09:44:24.021696+0000","last_became_active":"2023-12-12T09:44:21.509923+0000","last_became_peered":"2023-12-12T09:44:21.509923+0000","last_unstale":"2023-12-12T09:44:24.021696+0000","last_undegraded":"2023-12-12T09:44:24.021696+0000","last_fullsized":"2023-12-12T09:44:24.021696+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_clean_scrub_stamp":"2023-12-12T09:44:20.465592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T18:46:45.450477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-12T09:44:22.510035+0000","last_change":"2023-12-12T09:44:21.515103+0000","last_active":"2023-12-12T09:44:22.510035+0000","last_peered":"2023-12-12T09:44:22.510035+0000","last_clean":"2023-12-12T09:44:22.510035+0000","last_became_active":"2023-12-12T09:44:21.514438+0000","last_became_peered":"2023-12-12T09:44:21.514438+0000","last_unstale":"2023-12-12T09:44:22.510035+0000","last_undegraded":"2023-12-12T09:44:22.510035+0000","last_fullsized":"2023-12-12T09:44:22.510035+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_clean_scrub_stamp":"2023-12-12T09:44:20.465592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T18:05:42.865925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-12T09:44:22.515117+0000","last_change":"2023-12-12T09:44:21.517469+0000","last_active":"2023-12-12T09:44:22.515117+0000","last_peered":"2023-12-12T09:44:22.515117+0000","last_clean":"2023-12-12T09:44:22.515117+0000","last_became_active":"2023-12-12T09:44:21.517156+0000","last_became_peered":"2023-12-12T09:44:21.517156+0000","last_unstale":"2023-12-12T09:44:22.515117+0000","last_undegraded":"2023-12-12T09:44:22.515117+0000","last_fullsized":"2023-12-12T09:44:22.515117+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_clean_scrub_stamp":"2023-12-12T09:44:20.465592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T20:58:54.834367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-12T09:44:22.513635+0000","last_change":"2023-12-12T09:44:21.526715+0000","last_active":"2023-12-12T09:44:22.513635+0000","last_peered":"2023-12-12T09:44:22.513635+0000","last_clean":"2023-12-12T09:44:22.513635+0000","last_became_active":"2023-12-12T09:44:21.526475+0000","last_became_peered":"2023-12-12T09:44:21.526475+0000","last_unstale":"2023-12-12T09:44:22.513635+0000","last_undegraded":"2023-12-12T09:44:22.513635+0000","last_fullsized":"2023-12-12T09:44:22.513635+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_clean_scrub_stamp":"2023-12-12T09:44:20.465592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T20:53:13.479872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-12T09:44:22.514859+0000","last_change":"2023-12-12T09:44:21.524561+0000","last_active":"2023-12-12T09:44:22.514859+0000","last_peered":"2023-12-12T09:44:22.514859+0000","last_clean":"2023-12-12T09:44:22.514859+0000","last_became_active":"2023-12-12T09:44:21.524316+0000","last_became_peered":"2023-12-12T09:44:21.524316+0000","last_unstale":"2023-12-12T09:44:22.514859+0000","last_undegraded":"2023-12-12T09:44:22.514859+0000","last_fullsized":"2023-12-12T09:44:22.514859+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_clean_scrub_stamp":"2023-12-12T09:44:20.465592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T18:05:42.865925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-12T09:44:22.509834+0000","last_change":"2023-12-12T09:44:21.510970+0000","last_active":"2023-12-12T09:44:22.509834+0000","last_peered":"2023-12-12T09:44:22.509834+0000","last_clean":"2023-12-12T09:44:22.509834+0000","last_became_active":"2023-12-12T09:44:21.508875+0000","last_became_peered":"2023-12-12T09:44:21.508875+0000","last_unstale":"2023-12-12T09:44:22.509834+0000","last_undegraded":"2023-12-12T09:44:22.509834+0000","last_fullsized":"2023-12-12T09:44:22.509834+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_clean_scrub_stamp":"2023-12-12T09:44:20.465592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T11:36:54.156220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-12T09:44:22.509308+0000","last_change":"2023-12-12T09:44:21.515576+0000","last_active":"2023-12-12T09:44:22.509308+0000","last_peered":"2023-12-12T09:44:22.509308+0000","last_clean":"2023-12-12T09:44:22.509308+0000","last_became_active":"2023-12-12T09:44:21.515246+0000","last_became_peered":"2023-12-12T09:44:21.515246+0000","last_unstale":"2023-12-12T09:44:22.509308+0000","last_undegraded":"2023-12-12T09:44:22.509308+0000","last_fullsized":"2023-12-12T09:44:22.509308+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_clean_scrub_stamp":"2023-12-12T09:44:20.465592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T13:05:01.026963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-12T09:44:24.022105+0000","last_change":"2023-12-12T09:44:21.521072+0000","last_active":"2023-12-12T09:44:24.022105+0000","last_peered":"2023-12-12T09:44:24.022105+0000","last_clean":"2023-12-12T09:44:24.022105+0000","last_became_active":"2023-12-12T09:44:21.520779+0000","last_became_peered":"2023-12-12T09:44:21.520779+0000","last_unstale":"2023-12-12T09:44:24.022105+0000","last_undegraded":"2023-12-12T09:44:24.022105+0000","last_fullsized":"2023-12-12T09:44:24.022105+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_clean_scrub_stamp":"2023-12-12T09:44:20.465592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T18:50:23.713305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-12T09:44:24.020043+0000","last_change":"2023-12-12T09:44:21.524113+0000","last_active":"2023-12-12T09:44:24.020043+0000","last_peered":"2023-12-12T09:44:24.020043+0000","last_clean":"2023-12-12T09:44:24.020043+0000","last_became_active":"2023-12-12T09:44:21.523749+0000","last_became_peered":"2023-12-12T09:44:21.523749+0000","last_unstale":"2023-12-12T09:44:24.020043+0000","last_undegraded":"2023-12-12T09:44:24.020043+0000","last_fullsized":"2023-12-12T09:44:24.020043+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_clean_scrub_stamp":"2023-12-12T09:44:20.465592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T21:19:34.161140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-12T09:44:24.020967+0000","last_change":"2023-12-12T09:44:21.507419+0000","last_active":"2023-12-12T09:44:24.020967+0000","last_peered":"2023-12-12T09:44:24.020967+0000","last_clean":"2023-12-12T09:44:24.020967+0000","last_became_active":"2023-12-12T09:44:21.507005+0000","last_became_peered":"2023-12-12T09:44:21.507005+0000","last_unstale":"2023-12-12T09:44:24.020967+0000","last_undegraded":"2023-12-12T09:44:24.020967+0000","last_fullsized":"2023-12-12T09:44:24.020967+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_clean_scrub_stamp":"2023-12-12T09:44:20.465592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T14:50:35.888381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-12T09:44:24.019206+0000","last_change":"2023-12-12T09:44:21.522714+0000","last_active":"2023-12-12T09:44:24.019206+0000","last_peered":"2023-12-12T09:44:24.019206+0000","last_clean":"2023-12-12T09:44:24.019206+0000","last_became_active":"2023-12-12T09:44:21.519272+0000","last_became_peered":"2023-12-12T09:44:21.519272+0000","last_unstale":"2023-12-12T09:44:24.019206+0000","last_undegraded":"2023-12-12T09:44:24.019206+0000","last_fullsized":"2023-12-12T09:44:24.019206+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_clean_scrub_stamp":"2023-12-12T09:44:20.465592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T21:42:36.877781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-12T09:44:22.515006+0000","last_change":"2023-12-12T09:44:21.519677+0000","last_active":"2023-12-12T09:44:22.515006+0000","last_peered":"2023-12-12T09:44:22.515006+0000","last_clean":"2023-12-12T09:44:22.515006+0000","last_became_active":"2023-12-12T09:44:21.519364+0000","last_became_peered":"2023-12-12T09:44:21.519364+0000","last_unstale":"2023-12-12T09:44:22.515006+0000","last_undegraded":"2023-12-12T09:44:22.515006+0000","last_fullsized":"2023-12-12T09:44:22.515006+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_clean_scrub_stamp":"2023-12-12T09:44:20.465592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T11:40:20.775860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-12T09:44:24.022778+0000","last_change":"2023-12-12T09:44:21.526204+0000","last_active":"2023-12-12T09:44:24.022778+0000","last_peered":"2023-12-12T09:44:24.022778+0000","last_clean":"2023-12-12T09:44:24.022778+0000","last_became_active":"2023-12-12T09:44:21.525855+0000","last_became_peered":"2023-12-12T09:44:21.525855+0000","last_unstale":"2023-12-12T09:44:24.022778+0000","last_undegraded":"2023-12-12T09:44:24.022778+0000","last_fullsized":"2023-12-12T09:44:24.022778+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_clean_scrub_stamp":"2023-12-12T09:44:20.465592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T10:03:17.158642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-12T09:44:22.510146+0000","last_change":"2023-12-12T09:44:21.522457+0000","last_active":"2023-12-12T09:44:22.510146+0000","last_peered":"2023-12-12T09:44:22.510146+0000","last_clean":"2023-12-12T09:44:22.510146+0000","last_became_active":"2023-12-12T09:44:21.522168+0000","last_became_peered":"2023-12-12T09:44:21.522168+0000","last_unstale":"2023-12-12T09:44:22.510146+0000","last_undegraded":"2023-12-12T09:44:22.510146+0000","last_fullsized":"2023-12-12T09:44:22.510146+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_clean_scrub_stamp":"2023-12-12T09:44:20.465592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T11:42:56.191775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-12T09:44:24.021839+0000","last_change":"2023-12-12T09:44:21.532041+0000","last_active":"2023-12-12T09:44:24.021839+0000","last_peered":"2023-12-12T09:44:24.021839+0000","last_clean":"2023-12-12T09:44:24.021839+0000","last_became_active":"2023-12-12T09:44:21.531731+0000","last_became_peered":"2023-12-12T09:44:21.531731+0000","last_unstale":"2023-12-12T09:44:24.021839+0000","last_undegraded":"2023-12-12T09:44:24.021839+0000","last_fullsized":"2023-12-12T09:44:24.021839+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_clean_scrub_stamp":"2023-12-12T09:44:20.465592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T12:21:37.296506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-12T09:44:22.516135+0000","last_change":"2023-12-12T09:44:21.517720+0000","last_active":"2023-12-12T09:44:22.516135+0000","last_peered":"2023-12-12T09:44:22.516135+0000","last_clean":"2023-12-12T09:44:22.516135+0000","last_became_active":"2023-12-12T09:44:21.517332+0000","last_became_peered":"2023-12-12T09:44:21.517332+0000","last_unstale":"2023-12-12T09:44:22.516135+0000","last_undegraded":"2023-12-12T09:44:22.516135+0000","last_fullsized":"2023-12-12T09:44:22.516135+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_clean_scrub_stamp":"2023-12-12T09:44:20.465592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T13:05:01.026963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-12T09:44:24.020721+0000","last_change":"2023-12-12T09:44:21.529115+0000","last_active":"2023-12-12T09:44:24.020721+0000","last_peered":"2023-12-12T09:44:24.020721+0000","last_clean":"2023-12-12T09:44:24.020721+0000","last_became_active":"2023-12-12T09:44:21.528843+0000","last_became_peered":"2023-12-12T09:44:21.528843+0000","last_unstale":"2023-12-12T09:44:24.020721+0000","last_undegraded":"2023-12-12T09:44:24.020721+0000","last_fullsized":"2023-12-12T09:44:24.020721+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_clean_scrub_stamp":"2023-12-12T09:44:20.465592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T12:38:15.250056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-12T09:44:22.513416+0000","last_change":"2023-12-12T09:44:21.525189+0000","last_active":"2023-12-12T09:44:22.513416+0000","last_peered":"2023-12-12T09:44:22.513416+0000","last_clean":"2023-12-12T09:44:22.513416+0000","last_became_active":"2023-12-12T09:44:21.524872+0000","last_became_peered":"2023-12-12T09:44:21.524872+0000","last_unstale":"2023-12-12T09:44:22.513416+0000","last_undegraded":"2023-12-12T09:44:22.513416+0000","last_fullsized":"2023-12-12T09:44:22.513416+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_clean_scrub_stamp":"2023-12-12T09:44:20.465592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T10:03:17.158642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-12T09:44:22.686183+0000","last_change":"2023-12-12T09:44:21.511525+0000","last_active":"2023-12-12T09:44:22.686183+0000","last_peered":"2023-12-12T09:44:22.686183+0000","last_clean":"2023-12-12T09:44:22.686183+0000","last_became_active":"2023-12-12T09:44:21.511270+0000","last_became_peered":"2023-12-12T09:44:21.511270+0000","last_unstale":"2023-12-12T09:44:22.686183+0000","last_undegraded":"2023-12-12T09:44:22.686183+0000","last_fullsized":"2023-12-12T09:44:22.686183+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_clean_scrub_stamp":"2023-12-12T09:44:20.465592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T12:00:33.415612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-12T09:44:22.513103+0000","last_change":"2023-12-12T09:44:21.533072+0000","last_active":"2023-12-12T09:44:22.513103+0000","last_peered":"2023-12-12T09:44:22.513103+0000","last_clean":"2023-12-12T09:44:22.513103+0000","last_became_active":"2023-12-12T09:44:21.532524+0000","last_became_peered":"2023-12-12T09:44:21.532524+0000","last_unstale":"2023-12-12T09:44:22.513103+0000","last_undegraded":"2023-12-12T09:44:22.513103+0000","last_fullsized":"2023-12-12T09:44:22.513103+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_clean_scrub_stamp":"2023-12-12T09:44:20.465592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T12:21:37.296506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-12T09:44:24.020168+0000","last_change":"2023-12-12T09:44:21.520102+0000","last_active":"2023-12-12T09:44:24.020168+0000","last_peered":"2023-12-12T09:44:24.020168+0000","last_clean":"2023-12-12T09:44:24.020168+0000","last_became_active":"2023-12-12T09:44:21.517595+0000","last_became_peered":"2023-12-12T09:44:21.517595+0000","last_unstale":"2023-12-12T09:44:24.020168+0000","last_undegraded":"2023-12-12T09:44:24.020168+0000","last_fullsized":"2023-12-12T09:44:24.020168+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_clean_scrub_stamp":"2023-12-12T09:44:20.465592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T12:07:42.924447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"33'4","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-12T09:44:21.521245+0000","last_change":"2023-12-12T09:44:20.514272+0000","last_active":"2023-12-12T09:44:21.521245+0000","last_peered":"2023-12-12T09:44:21.521245+0000","last_clean":"2023-12-12T09:44:21.521245+0000","last_became_active":"2023-12-12T09:44:20.513997+0000","last_became_peered":"2023-12-12T09:44:20.513997+0000","last_unstale":"2023-12-12T09:44:21.521245+0000","last_undegraded":"2023-12-12T09:44:21.521245+0000","last_fullsized":"2023-12-12T09:44:21.521245+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:19.449520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:19.449520+0000","last_clean_scrub_stamp":"2023-12-12T09:44:19.449520+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T16:36:32.055010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-12T09:44:22.686533+0000","last_change":"2023-12-12T09:44:21.535215+0000","last_active":"2023-12-12T09:44:22.686533+0000","last_peered":"2023-12-12T09:44:22.686533+0000","last_clean":"2023-12-12T09:44:22.686533+0000","last_became_active":"2023-12-12T09:44:21.534935+0000","last_became_peered":"2023-12-12T09:44:21.534935+0000","last_unstale":"2023-12-12T09:44:22.686533+0000","last_undegraded":"2023-12-12T09:44:22.686533+0000","last_fullsized":"2023-12-12T09:44:22.686533+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_clean_scrub_stamp":"2023-12-12T09:44:20.465592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T21:19:34.161140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"33'1","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-12T09:44:21.517240+0000","last_change":"2023-12-12T09:44:20.512943+0000","last_active":"2023-12-12T09:44:21.517240+0000","last_peered":"2023-12-12T09:44:21.517240+0000","last_clean":"2023-12-12T09:44:21.517240+0000","last_became_active":"2023-12-12T09:44:20.512655+0000","last_became_peered":"2023-12-12T09:44:20.512655+0000","last_unstale":"2023-12-12T09:44:21.517240+0000","last_undegraded":"2023-12-12T09:44:21.517240+0000","last_fullsized":"2023-12-12T09:44:21.517240+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:19.449520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:19.449520+0000","last_clean_scrub_stamp":"2023-12-12T09:44:19.449520+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T20:21:31.990503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-12T09:44:24.020668+0000","last_change":"2023-12-12T09:44:21.531214+0000","last_active":"2023-12-12T09:44:24.020668+0000","last_peered":"2023-12-12T09:44:24.020668+0000","last_clean":"2023-12-12T09:44:24.020668+0000","last_became_active":"2023-12-12T09:44:21.530559+0000","last_became_peered":"2023-12-12T09:44:21.530559+0000","last_unstale":"2023-12-12T09:44:24.020668+0000","last_undegraded":"2023-12-12T09:44:24.020668+0000","last_fullsized":"2023-12-12T09:44:24.020668+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_clean_scrub_stamp":"2023-12-12T09:44:20.465592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T12:07:42.924447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"33'2","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-12T09:44:21.532618+0000","last_change":"2023-12-12T09:44:20.505973+0000","last_active":"2023-12-12T09:44:21.532618+0000","last_peered":"2023-12-12T09:44:21.532618+0000","last_clean":"2023-12-12T09:44:21.532618+0000","last_became_active":"2023-12-12T09:44:20.505716+0000","last_became_peered":"2023-12-12T09:44:20.505716+0000","last_unstale":"2023-12-12T09:44:21.532618+0000","last_undegraded":"2023-12-12T09:44:21.532618+0000","last_fullsized":"2023-12-12T09:44:21.532618+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:19.449520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:19.449520+0000","last_clean_scrub_stamp":"2023-12-12T09:44:19.449520+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T14:50:34.872309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-12T09:44:24.022148+0000","last_change":"2023-12-12T09:44:21.531916+0000","last_active":"2023-12-12T09:44:24.022148+0000","last_peered":"2023-12-12T09:44:24.022148+0000","last_clean":"2023-12-12T09:44:24.022148+0000","last_became_active":"2023-12-12T09:44:21.531595+0000","last_became_peered":"2023-12-12T09:44:21.531595+0000","last_unstale":"2023-12-12T09:44:24.022148+0000","last_undegraded":"2023-12-12T09:44:24.022148+0000","last_fullsized":"2023-12-12T09:44:24.022148+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_clean_scrub_stamp":"2023-12-12T09:44:20.465592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T12:23:17.141227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"33'2","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-12T09:44:21.532628+0000","last_change":"2023-12-12T09:44:20.509167+0000","last_active":"2023-12-12T09:44:21.532628+0000","last_peered":"2023-12-12T09:44:21.532628+0000","last_clean":"2023-12-12T09:44:21.532628+0000","last_became_active":"2023-12-12T09:44:20.508808+0000","last_became_peered":"2023-12-12T09:44:20.508808+0000","last_unstale":"2023-12-12T09:44:21.532628+0000","last_undegraded":"2023-12-12T09:44:21.532628+0000","last_fullsized":"2023-12-12T09:44:21.532628+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:19.449520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:19.449520+0000","last_clean_scrub_stamp":"2023-12-12T09:44:19.449520+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T18:14:15.788144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-12T09:44:22.514010+0000","last_change":"2023-12-12T09:44:21.532639+0000","last_active":"2023-12-12T09:44:22.514010+0000","last_peered":"2023-12-12T09:44:22.514010+0000","last_clean":"2023-12-12T09:44:22.514010+0000","last_became_active":"2023-12-12T09:44:21.532369+0000","last_became_peered":"2023-12-12T09:44:21.532369+0000","last_unstale":"2023-12-12T09:44:22.514010+0000","last_undegraded":"2023-12-12T09:44:22.514010+0000","last_fullsized":"2023-12-12T09:44:22.514010+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_clean_scrub_stamp":"2023-12-12T09:44:20.465592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T14:08:30.510607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"33'1","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-12T09:44:21.535515+0000","last_change":"2023-12-12T09:44:20.506547+0000","last_active":"2023-12-12T09:44:21.535515+0000","last_peered":"2023-12-12T09:44:21.535515+0000","last_clean":"2023-12-12T09:44:21.535515+0000","last_became_active":"2023-12-12T09:44:20.506207+0000","last_became_peered":"2023-12-12T09:44:20.506207+0000","last_unstale":"2023-12-12T09:44:21.535515+0000","last_undegraded":"2023-12-12T09:44:21.535515+0000","last_fullsized":"2023-12-12T09:44:21.535515+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:19.449520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:19.449520+0000","last_clean_scrub_stamp":"2023-12-12T09:44:19.449520+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T21:18:35.916411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-12T09:44:22.515617+0000","last_change":"2023-12-12T09:44:21.510952+0000","last_active":"2023-12-12T09:44:22.515617+0000","last_peered":"2023-12-12T09:44:22.515617+0000","last_clean":"2023-12-12T09:44:22.515617+0000","last_became_active":"2023-12-12T09:44:21.510672+0000","last_became_peered":"2023-12-12T09:44:21.510672+0000","last_unstale":"2023-12-12T09:44:22.515617+0000","last_undegraded":"2023-12-12T09:44:22.515617+0000","last_fullsized":"2023-12-12T09:44:22.515617+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_clean_scrub_stamp":"2023-12-12T09:44:20.465592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T12:21:37.296506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"33'1","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-12T09:44:21.529396+0000","last_change":"2023-12-12T09:44:20.507138+0000","last_active":"2023-12-12T09:44:21.529396+0000","last_peered":"2023-12-12T09:44:21.529396+0000","last_clean":"2023-12-12T09:44:21.529396+0000","last_became_active":"2023-12-12T09:44:20.506706+0000","last_became_peered":"2023-12-12T09:44:20.506706+0000","last_unstale":"2023-12-12T09:44:21.529396+0000","last_undegraded":"2023-12-12T09:44:21.529396+0000","last_fullsized":"2023-12-12T09:44:21.529396+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:19.449520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:19.449520+0000","last_clean_scrub_stamp":"2023-12-12T09:44:19.449520+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T14:59:36.480275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-12T09:44:24.020131+0000","last_change":"2023-12-12T09:44:21.528208+0000","last_active":"2023-12-12T09:44:24.020131+0000","last_peered":"2023-12-12T09:44:24.020131+0000","last_clean":"2023-12-12T09:44:24.020131+0000","last_became_active":"2023-12-12T09:44:21.524386+0000","last_became_peered":"2023-12-12T09:44:21.524386+0000","last_unstale":"2023-12-12T09:44:24.020131+0000","last_undegraded":"2023-12-12T09:44:24.020131+0000","last_fullsized":"2023-12-12T09:44:24.020131+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_clean_scrub_stamp":"2023-12-12T09:44:20.465592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T10:43:48.035299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-12T09:44:21.495485+0000","last_change":"2023-12-12T09:44:20.510572+0000","last_active":"2023-12-12T09:44:21.495485+0000","last_peered":"2023-12-12T09:44:21.495485+0000","last_clean":"2023-12-12T09:44:21.495485+0000","last_became_active":"2023-12-12T09:44:20.510324+0000","last_became_peered":"2023-12-12T09:44:20.510324+0000","last_unstale":"2023-12-12T09:44:21.495485+0000","last_undegraded":"2023-12-12T09:44:21.495485+0000","last_fullsized":"2023-12-12T09:44:21.495485+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:19.449520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:19.449520+0000","last_clean_scrub_stamp":"2023-12-12T09:44:19.449520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T12:38:14.233984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-12T09:44:24.020767+0000","last_change":"2023-12-12T09:44:21.520960+0000","last_active":"2023-12-12T09:44:24.020767+0000","last_peered":"2023-12-12T09:44:24.020767+0000","last_clean":"2023-12-12T09:44:24.020767+0000","last_became_active":"2023-12-12T09:44:21.520630+0000","last_became_peered":"2023-12-12T09:44:21.520630+0000","last_unstale":"2023-12-12T09:44:24.020767+0000","last_undegraded":"2023-12-12T09:44:24.020767+0000","last_fullsized":"2023-12-12T09:44:24.020767+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_clean_scrub_stamp":"2023-12-12T09:44:20.465592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T18:54:29.796762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-12T09:44:21.494190+0000","last_change":"2023-12-12T09:44:20.516411+0000","last_active":"2023-12-12T09:44:21.494190+0000","last_peered":"2023-12-12T09:44:21.494190+0000","last_clean":"2023-12-12T09:44:21.494190+0000","last_became_active":"2023-12-12T09:44:20.516143+0000","last_became_peered":"2023-12-12T09:44:20.516143+0000","last_unstale":"2023-12-12T09:44:21.494190+0000","last_undegraded":"2023-12-12T09:44:21.494190+0000","last_fullsized":"2023-12-12T09:44:21.494190+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:19.449520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:19.449520+0000","last_clean_scrub_stamp":"2023-12-12T09:44:19.449520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T20:16:12.578797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-12T09:44:22.516476+0000","last_change":"2023-12-12T09:44:21.516583+0000","last_active":"2023-12-12T09:44:22.516476+0000","last_peered":"2023-12-12T09:44:22.516476+0000","last_clean":"2023-12-12T09:44:22.516476+0000","last_became_active":"2023-12-12T09:44:21.515986+0000","last_became_peered":"2023-12-12T09:44:21.515986+0000","last_unstale":"2023-12-12T09:44:22.516476+0000","last_undegraded":"2023-12-12T09:44:22.516476+0000","last_fullsized":"2023-12-12T09:44:22.516476+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_clean_scrub_stamp":"2023-12-12T09:44:20.465592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T14:08:30.510607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-12T09:44:21.496356+0000","last_change":"2023-12-12T09:44:20.515405+0000","last_active":"2023-12-12T09:44:21.496356+0000","last_peered":"2023-12-12T09:44:21.496356+0000","last_clean":"2023-12-12T09:44:21.496356+0000","last_became_active":"2023-12-12T09:44:20.515184+0000","last_became_peered":"2023-12-12T09:44:20.515184+0000","last_unstale":"2023-12-12T09:44:21.496356+0000","last_undegraded":"2023-12-12T09:44:21.496356+0000","last_fullsized":"2023-12-12T09:44:21.496356+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:19.449520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:19.449520+0000","last_clean_scrub_stamp":"2023-12-12T09:44:19.449520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T11:40:19.759789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-12T09:44:22.509556+0000","last_change":"2023-12-12T09:44:21.528120+0000","last_active":"2023-12-12T09:44:22.509556+0000","last_peered":"2023-12-12T09:44:22.509556+0000","last_clean":"2023-12-12T09:44:22.509556+0000","last_became_active":"2023-12-12T09:44:21.527860+0000","last_became_peered":"2023-12-12T09:44:21.527860+0000","last_unstale":"2023-12-12T09:44:22.509556+0000","last_undegraded":"2023-12-12T09:44:22.509556+0000","last_fullsized":"2023-12-12T09:44:22.509556+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_clean_scrub_stamp":"2023-12-12T09:44:20.465592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T21:03:17.881060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-12T09:44:21.488771+0000","last_change":"2023-12-12T09:44:20.505493+0000","last_active":"2023-12-12T09:44:21.488771+0000","last_peered":"2023-12-12T09:44:21.488771+0000","last_clean":"2023-12-12T09:44:21.488771+0000","last_became_active":"2023-12-12T09:44:20.503452+0000","last_became_peered":"2023-12-12T09:44:20.503452+0000","last_unstale":"2023-12-12T09:44:21.488771+0000","last_undegraded":"2023-12-12T09:44:21.488771+0000","last_fullsized":"2023-12-12T09:44:21.488771+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:19.449520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:19.449520+0000","last_clean_scrub_stamp":"2023-12-12T09:44:19.449520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T19:38:07.725951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-12T09:44:22.509198+0000","last_change":"2023-12-12T09:44:21.515459+0000","last_active":"2023-12-12T09:44:22.509198+0000","last_peered":"2023-12-12T09:44:22.509198+0000","last_clean":"2023-12-12T09:44:22.509198+0000","last_became_active":"2023-12-12T09:44:21.515182+0000","last_became_peered":"2023-12-12T09:44:21.515182+0000","last_unstale":"2023-12-12T09:44:22.509198+0000","last_undegraded":"2023-12-12T09:44:22.509198+0000","last_fullsized":"2023-12-12T09:44:22.509198+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_clean_scrub_stamp":"2023-12-12T09:44:20.465592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T20:53:13.479872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"33'3","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-12T09:44:21.524147+0000","last_change":"2023-12-12T09:44:20.516043+0000","last_active":"2023-12-12T09:44:21.524147+0000","last_peered":"2023-12-12T09:44:21.524147+0000","last_clean":"2023-12-12T09:44:21.524147+0000","last_became_active":"2023-12-12T09:44:20.515717+0000","last_became_peered":"2023-12-12T09:44:20.515717+0000","last_unstale":"2023-12-12T09:44:21.524147+0000","last_undegraded":"2023-12-12T09:44:21.524147+0000","last_fullsized":"2023-12-12T09:44:21.524147+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:19.449520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:19.449520+0000","last_clean_scrub_stamp":"2023-12-12T09:44:19.449520+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T12:38:14.233984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-12T09:44:22.515625+0000","last_change":"2023-12-12T09:44:21.514238+0000","last_active":"2023-12-12T09:44:22.515625+0000","last_peered":"2023-12-12T09:44:22.515625+0000","last_clean":"2023-12-12T09:44:22.515625+0000","last_became_active":"2023-12-12T09:44:21.513900+0000","last_became_peered":"2023-12-12T09:44:21.513900+0000","last_unstale":"2023-12-12T09:44:22.515625+0000","last_undegraded":"2023-12-12T09:44:22.515625+0000","last_fullsized":"2023-12-12T09:44:22.515625+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_clean_scrub_stamp":"2023-12-12T09:44:20.465592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T12:23:17.141227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"33'6","reported_seq":18,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-12T09:44:21.541926+0000","last_change":"2023-12-12T09:44:20.509723+0000","last_active":"2023-12-12T09:44:21.541926+0000","last_peered":"2023-12-12T09:44:21.541926+0000","last_clean":"2023-12-12T09:44:21.541926+0000","last_became_active":"2023-12-12T09:44:20.509311+0000","last_became_peered":"2023-12-12T09:44:20.509311+0000","last_unstale":"2023-12-12T09:44:21.541926+0000","last_undegraded":"2023-12-12T09:44:21.541926+0000","last_fullsized":"2023-12-12T09:44:21.541926+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:19.449520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:19.449520+0000","last_clean_scrub_stamp":"2023-12-12T09:44:19.449520+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T20:58:53.818296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-12T09:44:24.020444+0000","last_change":"2023-12-12T09:44:21.522639+0000","last_active":"2023-12-12T09:44:24.020444+0000","last_peered":"2023-12-12T09:44:24.020444+0000","last_clean":"2023-12-12T09:44:24.020444+0000","last_became_active":"2023-12-12T09:44:21.522313+0000","last_became_peered":"2023-12-12T09:44:21.522313+0000","last_unstale":"2023-12-12T09:44:24.020444+0000","last_undegraded":"2023-12-12T09:44:24.020444+0000","last_fullsized":"2023-12-12T09:44:24.020444+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_clean_scrub_stamp":"2023-12-12T09:44:20.465592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T12:38:15.250056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"33'2","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-12T09:44:21.534665+0000","last_change":"2023-12-12T09:44:20.516223+0000","last_active":"2023-12-12T09:44:21.534665+0000","last_peered":"2023-12-12T09:44:21.534665+0000","last_clean":"2023-12-12T09:44:21.534665+0000","last_became_active":"2023-12-12T09:44:20.515976+0000","last_became_peered":"2023-12-12T09:44:20.515976+0000","last_unstale":"2023-12-12T09:44:21.534665+0000","last_undegraded":"2023-12-12T09:44:21.534665+0000","last_fullsized":"2023-12-12T09:44:21.534665+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:19.449520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:19.449520+0000","last_clean_scrub_stamp":"2023-12-12T09:44:19.449520+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T16:04:09.402682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-12T09:44:22.510253+0000","last_change":"2023-12-12T09:44:21.498629+0000","last_active":"2023-12-12T09:44:22.510253+0000","last_peered":"2023-12-12T09:44:22.510253+0000","last_clean":"2023-12-12T09:44:22.510253+0000","last_became_active":"2023-12-12T09:44:21.498281+0000","last_became_peered":"2023-12-12T09:44:21.498281+0000","last_unstale":"2023-12-12T09:44:22.510253+0000","last_undegraded":"2023-12-12T09:44:22.510253+0000","last_fullsized":"2023-12-12T09:44:22.510253+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_clean_scrub_stamp":"2023-12-12T09:44:20.465592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T15:26:37.478870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-12T09:44:21.498015+0000","last_change":"2023-12-12T09:44:20.513932+0000","last_active":"2023-12-12T09:44:21.498015+0000","last_peered":"2023-12-12T09:44:21.498015+0000","last_clean":"2023-12-12T09:44:21.498015+0000","last_became_active":"2023-12-12T09:44:20.513676+0000","last_became_peered":"2023-12-12T09:44:20.513676+0000","last_unstale":"2023-12-12T09:44:21.498015+0000","last_undegraded":"2023-12-12T09:44:21.498015+0000","last_fullsized":"2023-12-12T09:44:21.498015+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:19.449520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:19.449520+0000","last_clean_scrub_stamp":"2023-12-12T09:44:19.449520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T19:16:24.812720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-12T09:44:22.513406+0000","last_change":"2023-12-12T09:44:21.532046+0000","last_active":"2023-12-12T09:44:22.513406+0000","last_peered":"2023-12-12T09:44:22.513406+0000","last_clean":"2023-12-12T09:44:22.513406+0000","last_became_active":"2023-12-12T09:44:21.531801+0000","last_became_peered":"2023-12-12T09:44:21.531801+0000","last_unstale":"2023-12-12T09:44:22.513406+0000","last_undegraded":"2023-12-12T09:44:22.513406+0000","last_fullsized":"2023-12-12T09:44:22.513406+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_clean_scrub_stamp":"2023-12-12T09:44:20.465592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T12:23:17.141227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-12T09:44:21.495413+0000","last_change":"2023-12-12T09:44:20.514956+0000","last_active":"2023-12-12T09:44:21.495413+0000","last_peered":"2023-12-12T09:44:21.495413+0000","last_clean":"2023-12-12T09:44:21.495413+0000","last_became_active":"2023-12-12T09:44:20.513186+0000","last_became_peered":"2023-12-12T09:44:20.513186+0000","last_unstale":"2023-12-12T09:44:21.495413+0000","last_undegraded":"2023-12-12T09:44:21.495413+0000","last_fullsized":"2023-12-12T09:44:21.495413+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:19.449520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:19.449520+0000","last_clean_scrub_stamp":"2023-12-12T09:44:19.449520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T12:49:11.267636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-12T09:44:22.686230+0000","last_change":"2023-12-12T09:44:21.531855+0000","last_active":"2023-12-12T09:44:22.686230+0000","last_peered":"2023-12-12T09:44:22.686230+0000","last_clean":"2023-12-12T09:44:22.686230+0000","last_became_active":"2023-12-12T09:44:21.531294+0000","last_became_peered":"2023-12-12T09:44:21.531294+0000","last_unstale":"2023-12-12T09:44:22.686230+0000","last_undegraded":"2023-12-12T09:44:22.686230+0000","last_fullsized":"2023-12-12T09:44:22.686230+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_clean_scrub_stamp":"2023-12-12T09:44:20.465592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T21:42:36.877781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"33'8","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-12T09:44:21.529853+0000","last_change":"2023-12-12T09:44:20.505770+0000","last_active":"2023-12-12T09:44:21.529853+0000","last_peered":"2023-12-12T09:44:21.529853+0000","last_clean":"2023-12-12T09:44:21.529853+0000","last_became_active":"2023-12-12T09:44:20.505511+0000","last_became_peered":"2023-12-12T09:44:20.505511+0000","last_unstale":"2023-12-12T09:44:21.529853+0000","last_undegraded":"2023-12-12T09:44:21.529853+0000","last_fullsized":"2023-12-12T09:44:21.529853+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:19.449520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:19.449520+0000","last_clean_scrub_stamp":"2023-12-12T09:44:19.449520+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T12:23:16.125156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-12T09:44:24.020681+0000","last_change":"2023-12-12T09:44:21.530767+0000","last_active":"2023-12-12T09:44:24.020681+0000","last_peered":"2023-12-12T09:44:24.020681+0000","last_clean":"2023-12-12T09:44:24.020681+0000","last_became_active":"2023-12-12T09:44:21.530072+0000","last_became_peered":"2023-12-12T09:44:21.530072+0000","last_unstale":"2023-12-12T09:44:24.020681+0000","last_undegraded":"2023-12-12T09:44:24.020681+0000","last_fullsized":"2023-12-12T09:44:24.020681+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_clean_scrub_stamp":"2023-12-12T09:44:20.465592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T12:49:12.283708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"33'1","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-12T09:44:21.535871+0000","last_change":"2023-12-12T09:44:20.505080+0000","last_active":"2023-12-12T09:44:21.535871+0000","last_peered":"2023-12-12T09:44:21.535871+0000","last_clean":"2023-12-12T09:44:21.535871+0000","last_became_active":"2023-12-12T09:44:20.504727+0000","last_became_peered":"2023-12-12T09:44:20.504727+0000","last_unstale":"2023-12-12T09:44:21.535871+0000","last_undegraded":"2023-12-12T09:44:21.535871+0000","last_fullsized":"2023-12-12T09:44:21.535871+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:19.449520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:19.449520+0000","last_clean_scrub_stamp":"2023-12-12T09:44:19.449520+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T12:07:41.908376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-12T09:44:22.515709+0000","last_change":"2023-12-12T09:44:21.528910+0000","last_active":"2023-12-12T09:44:22.515709+0000","last_peered":"2023-12-12T09:44:22.515709+0000","last_clean":"2023-12-12T09:44:22.515709+0000","last_became_active":"2023-12-12T09:44:21.528597+0000","last_became_peered":"2023-12-12T09:44:21.528597+0000","last_unstale":"2023-12-12T09:44:22.515709+0000","last_undegraded":"2023-12-12T09:44:22.515709+0000","last_fullsized":"2023-12-12T09:44:22.515709+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_clean_scrub_stamp":"2023-12-12T09:44:20.465592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T10:03:17.158642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"33'2","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-12T09:44:21.531013+0000","last_change":"2023-12-12T09:44:20.516846+0000","last_active":"2023-12-12T09:44:21.531013+0000","last_peered":"2023-12-12T09:44:21.531013+0000","last_clean":"2023-12-12T09:44:21.531013+0000","last_became_active":"2023-12-12T09:44:20.514593+0000","last_became_peered":"2023-12-12T09:44:20.514593+0000","last_unstale":"2023-12-12T09:44:21.531013+0000","last_undegraded":"2023-12-12T09:44:21.531013+0000","last_fullsized":"2023-12-12T09:44:21.531013+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:19.449520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:19.449520+0000","last_clean_scrub_stamp":"2023-12-12T09:44:19.449520+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T16:36:32.055010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-12T09:44:24.021580+0000","last_change":"2023-12-12T09:44:21.536677+0000","last_active":"2023-12-12T09:44:24.021580+0000","last_peered":"2023-12-12T09:44:24.021580+0000","last_clean":"2023-12-12T09:44:24.021580+0000","last_became_active":"2023-12-12T09:44:21.535741+0000","last_became_peered":"2023-12-12T09:44:21.535741+0000","last_unstale":"2023-12-12T09:44:24.021580+0000","last_undegraded":"2023-12-12T09:44:24.021580+0000","last_fullsized":"2023-12-12T09:44:24.021580+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_clean_scrub_stamp":"2023-12-12T09:44:20.465592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T20:58:54.834367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"33'1","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-12T09:44:21.535209+0000","last_change":"2023-12-12T09:44:20.511043+0000","last_active":"2023-12-12T09:44:21.535209+0000","last_peered":"2023-12-12T09:44:21.535209+0000","last_clean":"2023-12-12T09:44:21.535209+0000","last_became_active":"2023-12-12T09:44:20.510215+0000","last_became_peered":"2023-12-12T09:44:20.510215+0000","last_unstale":"2023-12-12T09:44:21.535209+0000","last_undegraded":"2023-12-12T09:44:21.535209+0000","last_fullsized":"2023-12-12T09:44:21.535209+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:19.449520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:19.449520+0000","last_clean_scrub_stamp":"2023-12-12T09:44:19.449520+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T19:16:24.812720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-12T09:44:24.021650+0000","last_change":"2023-12-12T09:44:21.508894+0000","last_active":"2023-12-12T09:44:24.021650+0000","last_peered":"2023-12-12T09:44:24.021650+0000","last_clean":"2023-12-12T09:44:24.021650+0000","last_became_active":"2023-12-12T09:44:21.508640+0000","last_became_peered":"2023-12-12T09:44:21.508640+0000","last_unstale":"2023-12-12T09:44:24.021650+0000","last_undegraded":"2023-12-12T09:44:24.021650+0000","last_fullsized":"2023-12-12T09:44:24.021650+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_clean_scrub_stamp":"2023-12-12T09:44:20.465592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T20:16:13.594869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-12T09:44:21.499026+0000","last_change":"2023-12-12T09:44:20.507016+0000","last_active":"2023-12-12T09:44:21.499026+0000","last_peered":"2023-12-12T09:44:21.499026+0000","last_clean":"2023-12-12T09:44:21.499026+0000","last_became_active":"2023-12-12T09:44:20.506728+0000","last_became_peered":"2023-12-12T09:44:20.506728+0000","last_unstale":"2023-12-12T09:44:21.499026+0000","last_undegraded":"2023-12-12T09:44:21.499026+0000","last_fullsized":"2023-12-12T09:44:21.499026+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:19.449520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:19.449520+0000","last_clean_scrub_stamp":"2023-12-12T09:44:19.449520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T20:21:31.990503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-12T09:44:24.021425+0000","last_change":"2023-12-12T09:44:21.529516+0000","last_active":"2023-12-12T09:44:24.021425+0000","last_peered":"2023-12-12T09:44:24.021425+0000","last_clean":"2023-12-12T09:44:24.021425+0000","last_became_active":"2023-12-12T09:44:21.528160+0000","last_became_peered":"2023-12-12T09:44:21.528160+0000","last_unstale":"2023-12-12T09:44:24.021425+0000","last_undegraded":"2023-12-12T09:44:24.021425+0000","last_fullsized":"2023-12-12T09:44:24.021425+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_clean_scrub_stamp":"2023-12-12T09:44:20.465592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T19:57:06.191557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"33'2","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-12T09:44:21.515512+0000","last_change":"2023-12-12T09:44:20.506834+0000","last_active":"2023-12-12T09:44:21.515512+0000","last_peered":"2023-12-12T09:44:21.515512+0000","last_clean":"2023-12-12T09:44:21.515512+0000","last_became_active":"2023-12-12T09:44:20.506432+0000","last_became_peered":"2023-12-12T09:44:20.506432+0000","last_unstale":"2023-12-12T09:44:21.515512+0000","last_undegraded":"2023-12-12T09:44:21.515512+0000","last_fullsized":"2023-12-12T09:44:21.515512+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:19.449520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:19.449520+0000","last_clean_scrub_stamp":"2023-12-12T09:44:19.449520+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T21:18:35.916411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-12T09:44:24.021829+0000","last_change":"2023-12-12T09:44:21.511615+0000","last_active":"2023-12-12T09:44:24.021829+0000","last_peered":"2023-12-12T09:44:24.021829+0000","last_clean":"2023-12-12T09:44:24.021829+0000","last_became_active":"2023-12-12T09:44:21.509251+0000","last_became_peered":"2023-12-12T09:44:21.509251+0000","last_unstale":"2023-12-12T09:44:24.021829+0000","last_undegraded":"2023-12-12T09:44:24.021829+0000","last_fullsized":"2023-12-12T09:44:24.021829+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_clean_scrub_stamp":"2023-12-12T09:44:20.465592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T19:18:46.146779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-12T09:44:21.507039+0000","last_change":"2023-12-12T09:44:20.515913+0000","last_active":"2023-12-12T09:44:21.507039+0000","last_peered":"2023-12-12T09:44:21.507039+0000","last_clean":"2023-12-12T09:44:21.507039+0000","last_became_active":"2023-12-12T09:44:20.515642+0000","last_became_peered":"2023-12-12T09:44:20.515642+0000","last_unstale":"2023-12-12T09:44:21.507039+0000","last_undegraded":"2023-12-12T09:44:21.507039+0000","last_fullsized":"2023-12-12T09:44:21.507039+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:19.449520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:19.449520+0000","last_clean_scrub_stamp":"2023-12-12T09:44:19.449520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T21:18:35.916411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-12T09:44:24.023156+0000","last_change":"2023-12-12T09:44:21.508562+0000","last_active":"2023-12-12T09:44:24.023156+0000","last_peered":"2023-12-12T09:44:24.023156+0000","last_clean":"2023-12-12T09:44:24.023156+0000","last_became_active":"2023-12-12T09:44:21.508207+0000","last_became_peered":"2023-12-12T09:44:21.508207+0000","last_unstale":"2023-12-12T09:44:24.023156+0000","last_undegraded":"2023-12-12T09:44:24.023156+0000","last_fullsized":"2023-12-12T09:44:24.023156+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_clean_scrub_stamp":"2023-12-12T09:44:20.465592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T14:54:55.495724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-12T09:44:21.500123+0000","last_change":"2023-12-12T09:44:20.509876+0000","last_active":"2023-12-12T09:44:21.500123+0000","last_peered":"2023-12-12T09:44:21.500123+0000","last_clean":"2023-12-12T09:44:21.500123+0000","last_became_active":"2023-12-12T09:44:20.509580+0000","last_became_peered":"2023-12-12T09:44:20.509580+0000","last_unstale":"2023-12-12T09:44:21.500123+0000","last_undegraded":"2023-12-12T09:44:21.500123+0000","last_fullsized":"2023-12-12T09:44:21.500123+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:19.449520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:19.449520+0000","last_clean_scrub_stamp":"2023-12-12T09:44:19.449520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T12:00:32.399540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-12T09:44:22.513495+0000","last_change":"2023-12-12T09:44:21.527012+0000","last_active":"2023-12-12T09:44:22.513495+0000","last_peered":"2023-12-12T09:44:22.513495+0000","last_clean":"2023-12-12T09:44:22.513495+0000","last_became_active":"2023-12-12T09:44:21.525770+0000","last_became_peered":"2023-12-12T09:44:21.525770+0000","last_unstale":"2023-12-12T09:44:22.513495+0000","last_undegraded":"2023-12-12T09:44:22.513495+0000","last_fullsized":"2023-12-12T09:44:22.513495+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_clean_scrub_stamp":"2023-12-12T09:44:20.465592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T10:50:32.155095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-12T09:44:21.503960+0000","last_change":"2023-12-12T09:44:20.519234+0000","last_active":"2023-12-12T09:44:21.503960+0000","last_peered":"2023-12-12T09:44:21.503960+0000","last_clean":"2023-12-12T09:44:21.503960+0000","last_became_active":"2023-12-12T09:44:20.518728+0000","last_became_peered":"2023-12-12T09:44:20.518728+0000","last_unstale":"2023-12-12T09:44:21.503960+0000","last_undegraded":"2023-12-12T09:44:21.503960+0000","last_fullsized":"2023-12-12T09:44:21.503960+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:19.449520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:19.449520+0000","last_clean_scrub_stamp":"2023-12-12T09:44:19.449520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T14:50:34.872309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-12T09:44:24.022357+0000","last_change":"2023-12-12T09:44:21.521774+0000","last_active":"2023-12-12T09:44:24.022357+0000","last_peered":"2023-12-12T09:44:24.022357+0000","last_clean":"2023-12-12T09:44:24.022357+0000","last_became_active":"2023-12-12T09:44:21.521431+0000","last_became_peered":"2023-12-12T09:44:21.521431+0000","last_unstale":"2023-12-12T09:44:24.022357+0000","last_undegraded":"2023-12-12T09:44:24.022357+0000","last_fullsized":"2023-12-12T09:44:24.022357+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_clean_scrub_stamp":"2023-12-12T09:44:20.465592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T19:05:15.078557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"33'2","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-12T09:44:21.535958+0000","last_change":"2023-12-12T09:44:20.511011+0000","last_active":"2023-12-12T09:44:21.535958+0000","last_peered":"2023-12-12T09:44:21.535958+0000","last_clean":"2023-12-12T09:44:21.535958+0000","last_became_active":"2023-12-12T09:44:20.510709+0000","last_became_peered":"2023-12-12T09:44:20.510709+0000","last_unstale":"2023-12-12T09:44:21.535958+0000","last_undegraded":"2023-12-12T09:44:21.535958+0000","last_fullsized":"2023-12-12T09:44:21.535958+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:19.449520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:19.449520+0000","last_clean_scrub_stamp":"2023-12-12T09:44:19.449520+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T12:49:11.267636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-12T09:44:22.516242+0000","last_change":"2023-12-12T09:44:21.521339+0000","last_active":"2023-12-12T09:44:22.516242+0000","last_peered":"2023-12-12T09:44:22.516242+0000","last_clean":"2023-12-12T09:44:22.516242+0000","last_became_active":"2023-12-12T09:44:21.521079+0000","last_became_peered":"2023-12-12T09:44:21.521079+0000","last_unstale":"2023-12-12T09:44:22.516242+0000","last_undegraded":"2023-12-12T09:44:22.516242+0000","last_fullsized":"2023-12-12T09:44:22.516242+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_clean_scrub_stamp":"2023-12-12T09:44:20.465592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T21:03:17.881060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-12T09:44:21.488848+0000","last_change":"2023-12-12T09:44:20.505916+0000","last_active":"2023-12-12T09:44:21.488848+0000","last_peered":"2023-12-12T09:44:21.488848+0000","last_clean":"2023-12-12T09:44:21.488848+0000","last_became_active":"2023-12-12T09:44:20.505632+0000","last_became_peered":"2023-12-12T09:44:20.505632+0000","last_unstale":"2023-12-12T09:44:21.488848+0000","last_undegraded":"2023-12-12T09:44:21.488848+0000","last_fullsized":"2023-12-12T09:44:21.488848+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:19.449520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:19.449520+0000","last_clean_scrub_stamp":"2023-12-12T09:44:19.449520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T12:00:32.399540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-12T09:44:24.019990+0000","last_change":"2023-12-12T09:44:21.515107+0000","last_active":"2023-12-12T09:44:24.019990+0000","last_peered":"2023-12-12T09:44:24.019990+0000","last_clean":"2023-12-12T09:44:24.019990+0000","last_became_active":"2023-12-12T09:44:21.514827+0000","last_became_peered":"2023-12-12T09:44:21.514827+0000","last_unstale":"2023-12-12T09:44:24.019990+0000","last_undegraded":"2023-12-12T09:44:24.019990+0000","last_fullsized":"2023-12-12T09:44:24.019990+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_clean_scrub_stamp":"2023-12-12T09:44:20.465592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T10:43:48.035299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-12T09:44:21.503969+0000","last_change":"2023-12-12T09:44:20.511329+0000","last_active":"2023-12-12T09:44:21.503969+0000","last_peered":"2023-12-12T09:44:21.503969+0000","last_clean":"2023-12-12T09:44:21.503969+0000","last_became_active":"2023-12-12T09:44:20.510982+0000","last_became_peered":"2023-12-12T09:44:20.510982+0000","last_unstale":"2023-12-12T09:44:21.503969+0000","last_undegraded":"2023-12-12T09:44:21.503969+0000","last_fullsized":"2023-12-12T09:44:21.503969+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:19.449520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:19.449520+0000","last_clean_scrub_stamp":"2023-12-12T09:44:19.449520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T10:43:47.019227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-12T09:44:22.686138+0000","last_change":"2023-12-12T09:44:21.518935+0000","last_active":"2023-12-12T09:44:22.686138+0000","last_peered":"2023-12-12T09:44:22.686138+0000","last_clean":"2023-12-12T09:44:22.686138+0000","last_became_active":"2023-12-12T09:44:21.518647+0000","last_became_peered":"2023-12-12T09:44:21.518647+0000","last_unstale":"2023-12-12T09:44:22.686138+0000","last_undegraded":"2023-12-12T09:44:22.686138+0000","last_fullsized":"2023-12-12T09:44:22.686138+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_clean_scrub_stamp":"2023-12-12T09:44:20.465592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T19:38:08.742023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-12T09:44:21.488692+0000","last_change":"2023-12-12T09:44:20.506663+0000","last_active":"2023-12-12T09:44:21.488692+0000","last_peered":"2023-12-12T09:44:21.488692+0000","last_clean":"2023-12-12T09:44:21.488692+0000","last_became_active":"2023-12-12T09:44:20.506077+0000","last_became_peered":"2023-12-12T09:44:20.506077+0000","last_unstale":"2023-12-12T09:44:21.488692+0000","last_undegraded":"2023-12-12T09:44:21.488692+0000","last_fullsized":"2023-12-12T09:44:21.488692+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:19.449520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:19.449520+0000","last_clean_scrub_stamp":"2023-12-12T09:44:19.449520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T19:16:24.812720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-12T09:44:24.019623+0000","last_change":"2023-12-12T09:44:21.513642+0000","last_active":"2023-12-12T09:44:24.019623+0000","last_peered":"2023-12-12T09:44:24.019623+0000","last_clean":"2023-12-12T09:44:24.019623+0000","last_became_active":"2023-12-12T09:44:21.513346+0000","last_became_peered":"2023-12-12T09:44:21.513346+0000","last_unstale":"2023-12-12T09:44:24.019623+0000","last_undegraded":"2023-12-12T09:44:24.019623+0000","last_fullsized":"2023-12-12T09:44:24.019623+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_clean_scrub_stamp":"2023-12-12T09:44:20.465592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T21:19:34.161140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-12T09:44:21.498144+0000","last_change":"2023-12-12T09:44:20.512148+0000","last_active":"2023-12-12T09:44:21.498144+0000","last_peered":"2023-12-12T09:44:21.498144+0000","last_clean":"2023-12-12T09:44:21.498144+0000","last_became_active":"2023-12-12T09:44:20.510963+0000","last_became_peered":"2023-12-12T09:44:20.510963+0000","last_unstale":"2023-12-12T09:44:21.498144+0000","last_undegraded":"2023-12-12T09:44:21.498144+0000","last_fullsized":"2023-12-12T09:44:21.498144+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:19.449520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:19.449520+0000","last_clean_scrub_stamp":"2023-12-12T09:44:19.449520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T19:38:07.725951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-12T09:44:22.508601+0000","last_change":"2023-12-12T09:44:21.529727+0000","last_active":"2023-12-12T09:44:22.508601+0000","last_peered":"2023-12-12T09:44:22.508601+0000","last_clean":"2023-12-12T09:44:22.508601+0000","last_became_active":"2023-12-12T09:44:21.528750+0000","last_became_peered":"2023-12-12T09:44:21.528750+0000","last_unstale":"2023-12-12T09:44:22.508601+0000","last_undegraded":"2023-12-12T09:44:22.508601+0000","last_fullsized":"2023-12-12T09:44:22.508601+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_clean_scrub_stamp":"2023-12-12T09:44:20.465592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T10:50:32.155095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-12T09:44:21.499858+0000","last_change":"2023-12-12T09:44:20.508411+0000","last_active":"2023-12-12T09:44:21.499858+0000","last_peered":"2023-12-12T09:44:21.499858+0000","last_clean":"2023-12-12T09:44:21.499858+0000","last_became_active":"2023-12-12T09:44:20.508071+0000","last_became_peered":"2023-12-12T09:44:20.508071+0000","last_unstale":"2023-12-12T09:44:21.499858+0000","last_undegraded":"2023-12-12T09:44:21.499858+0000","last_fullsized":"2023-12-12T09:44:21.499858+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:19.449520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:19.449520+0000","last_clean_scrub_stamp":"2023-12-12T09:44:19.449520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T19:38:07.725951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-12T09:44:24.019975+0000","last_change":"2023-12-12T09:44:21.530146+0000","last_active":"2023-12-12T09:44:24.019975+0000","last_peered":"2023-12-12T09:44:24.019975+0000","last_clean":"2023-12-12T09:44:24.019975+0000","last_became_active":"2023-12-12T09:44:21.526991+0000","last_became_peered":"2023-12-12T09:44:21.526991+0000","last_unstale":"2023-12-12T09:44:24.019975+0000","last_undegraded":"2023-12-12T09:44:24.019975+0000","last_fullsized":"2023-12-12T09:44:24.019975+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_clean_scrub_stamp":"2023-12-12T09:44:20.465592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T21:42:36.877781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-12T09:44:21.496636+0000","last_change":"2023-12-12T09:44:20.514669+0000","last_active":"2023-12-12T09:44:21.496636+0000","last_peered":"2023-12-12T09:44:21.496636+0000","last_clean":"2023-12-12T09:44:21.496636+0000","last_became_active":"2023-12-12T09:44:20.514346+0000","last_became_peered":"2023-12-12T09:44:20.514346+0000","last_unstale":"2023-12-12T09:44:21.496636+0000","last_undegraded":"2023-12-12T09:44:21.496636+0000","last_fullsized":"2023-12-12T09:44:21.496636+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:19.449520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:19.449520+0000","last_clean_scrub_stamp":"2023-12-12T09:44:19.449520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T12:21:36.280435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-12T09:44:22.513812+0000","last_change":"2023-12-12T09:44:21.525532+0000","last_active":"2023-12-12T09:44:22.513812+0000","last_peered":"2023-12-12T09:44:22.513812+0000","last_clean":"2023-12-12T09:44:22.513812+0000","last_became_active":"2023-12-12T09:44:21.521828+0000","last_became_peered":"2023-12-12T09:44:21.521828+0000","last_unstale":"2023-12-12T09:44:22.513812+0000","last_undegraded":"2023-12-12T09:44:22.513812+0000","last_fullsized":"2023-12-12T09:44:22.513812+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_clean_scrub_stamp":"2023-12-12T09:44:20.465592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T13:05:01.026963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-12T09:44:21.507274+0000","last_change":"2023-12-12T09:44:20.519204+0000","last_active":"2023-12-12T09:44:21.507274+0000","last_peered":"2023-12-12T09:44:21.507274+0000","last_clean":"2023-12-12T09:44:21.507274+0000","last_became_active":"2023-12-12T09:44:20.518590+0000","last_became_peered":"2023-12-12T09:44:20.518590+0000","last_unstale":"2023-12-12T09:44:21.507274+0000","last_undegraded":"2023-12-12T09:44:21.507274+0000","last_fullsized":"2023-12-12T09:44:21.507274+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:19.449520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:19.449520+0000","last_clean_scrub_stamp":"2023-12-12T09:44:19.449520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T16:04:09.402682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":176,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-12T09:44:21.512754+0000","last_change":"2023-12-12T09:43:17.203315+0000","last_active":"2023-12-12T09:44:21.512754+0000","last_peered":"2023-12-12T09:44:21.512754+0000","last_clean":"2023-12-12T09:44:21.512754+0000","last_became_active":"2023-12-12T09:43:17.200779+0000","last_became_peered":"2023-12-12T09:43:17.200779+0000","last_unstale":"2023-12-12T09:44:21.512754+0000","last_undegraded":"2023-12-12T09:44:21.512754+0000","last_fullsized":"2023-12-12T09:44:21.512754+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:43:15.931922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:43:15.931922+0000","last_clean_scrub_stamp":"2023-12-12T09:43:15.931922+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T21:42:10.929640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":64844,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574866,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27468,"kb_used_data":444,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344372,"statfs":{"total":96636764160,"available":96608636928,"internally_reserved":0,"allocated":454656,"data_stored":741230,"data_compressed":32422,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 12 09:44:15 2023","interfaces":[{"interface":"back","average":{"1min":0.999,"5min":0.999,"15min":0.999},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.8089999999999999,"5min":1.8089999999999999,"15min":1.8089999999999999},"last":1.476},{"interface":"front","average":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"min":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"max":{"1min":1.4279999999999999,"5min":1.4279999999999999,"15min":1.4279999999999999},"last":1.4359999999999999}]},{"osd":1,"last update":"Tue Dec 12 09:44:15 2023","interfaces":[{"interface":"back","average":{"1min":1.198,"5min":1.198,"15min":1.198},"min":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"max":{"1min":1.7729999999999999,"5min":1.7729999999999999,"15min":1.7729999999999999},"last":1.51},{"interface":"front","average":{"1min":1.216,"5min":1.216,"15min":1.216},"min":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"max":{"1min":3.1150000000000002,"5min":3.1150000000000002,"15min":3.1150000000000002},"last":1.542}]},{"osd":2,"last update":"Tue Dec 12 09:44:15 2023","interfaces":[{"interface":"back","average":{"1min":1.262,"5min":1.262,"15min":1.262},"min":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"max":{"1min":2.2050000000000001,"5min":2.2050000000000001,"15min":2.2050000000000001},"last":0.98599999999999999},{"interface":"front","average":{"1min":1.2450000000000001,"5min":1.2450000000000001,"15min":1.2450000000000001},"min":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":3.2759999999999998,"5min":3.2759999999999998,"15min":3.2759999999999998},"last":1.1679999999999999}]},{"osd":3,"last update":"Tue Dec 12 09:44:15 2023","interfaces":[{"interface":"back","average":{"1min":1.3169999999999999,"5min":1.3169999999999999,"15min":1.3169999999999999},"min":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"max":{"1min":3.1819999999999999,"5min":3.1819999999999999,"15min":3.1819999999999999},"last":1.345},{"interface":"front","average":{"1min":1.2949999999999999,"5min":1.2949999999999999,"15min":1.2949999999999999},"min":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"max":{"1min":1.8740000000000001,"5min":1.8740000000000001,"15min":1.8740000000000001},"last":1.587}]},{"osd":4,"last update":"Tue Dec 12 09:44:15 2023","interfaces":[{"interface":"back","average":{"1min":1.3520000000000001,"5min":1.3520000000000001,"15min":1.3520000000000001},"min":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"max":{"1min":2.5529999999999999,"5min":2.5529999999999999,"15min":2.5529999999999999},"last":1.282},{"interface":"front","average":{"1min":1.4550000000000001,"5min":1.4550000000000001,"15min":1.4550000000000001},"min":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"max":{"1min":2.351,"5min":2.351,"15min":2.351},"last":1.3799999999999999}]},{"osd":5,"last update":"Tue Dec 12 09:44:15 2023","interfaces":[{"interface":"back","average":{"1min":1.335,"5min":1.335,"15min":1.335},"min":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"max":{"1min":1.9610000000000001,"5min":1.9610000000000001,"15min":1.9610000000000001},"last":1.121},{"interface":"front","average":{"1min":1.5369999999999999,"5min":1.5369999999999999,"15min":1.5369999999999999},"min":{"1min":1.2050000000000001,"5min":1.2050000000000001,"15min":1.2050000000000001},"max":{"1min":2.4159999999999999,"5min":2.4159999999999999,"15min":2.4159999999999999},"last":1.204}]},{"osd":6,"last update":"Tue Dec 12 09:44:15 2023","interfaces":[{"interface":"back","average":{"1min":1.417,"5min":1.417,"15min":1.417},"min":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"max":{"1min":2.0510000000000002,"5min":2.0510000000000002,"15min":2.0510000000000002},"last":1.3169999999999999},{"interface":"front","average":{"1min":1.635,"5min":1.635,"15min":1.635},"min":{"1min":1.256,"5min":1.256,"15min":1.256},"max":{"1min":2.5800000000000001,"5min":2.5800000000000001,"15min":2.5800000000000001},"last":1.643}]}]},{"osd":6,"up_from":13,"seq":55834574864,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27408,"kb_used_data":384,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344432,"statfs":{"total":96636764160,"available":96608698368,"internally_reserved":0,"allocated":393216,"data_stored":151388,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 12 09:44:14 2023","interfaces":[{"interface":"back","average":{"1min":1.1930000000000001,"5min":1.1930000000000001,"15min":1.1930000000000001},"min":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":3.6429999999999998,"5min":3.6429999999999998,"15min":3.6429999999999998},"last":0.66100000000000003},{"interface":"front","average":{"1min":1.0700000000000001,"5min":1.0700000000000001,"15min":1.0700000000000001},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":2.6059999999999999,"5min":2.6059999999999999,"15min":2.6059999999999999},"last":1.0740000000000001}]},{"osd":1,"last update":"Tue Dec 12 09:44:14 2023","interfaces":[{"interface":"back","average":{"1min":1.0620000000000001,"5min":1.0620000000000001,"15min":1.0620000000000001},"min":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"max":{"1min":2.0169999999999999,"5min":2.0169999999999999,"15min":2.0169999999999999},"last":1.2889999999999999},{"interface":"front","average":{"1min":1.2010000000000001,"5min":1.2010000000000001,"15min":1.2010000000000001},"min":{"1min":0.747,"5min":0.747,"15min":0.747},"max":{"1min":1.7,"5min":1.7,"15min":1.7},"last":1.0009999999999999}]},{"osd":2,"last update":"Tue Dec 12 09:44:14 2023","interfaces":[{"interface":"back","average":{"1min":1.236,"5min":1.236,"15min":1.236},"min":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"max":{"1min":1.804,"5min":1.804,"15min":1.804},"last":1.359},{"interface":"front","average":{"1min":1.3129999999999999,"5min":1.3129999999999999,"15min":1.3129999999999999},"min":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"max":{"1min":2.2160000000000002,"5min":2.2160000000000002,"15min":2.2160000000000002},"last":1.23}]},{"osd":3,"last update":"Tue Dec 12 09:44:14 2023","interfaces":[{"interface":"back","average":{"1min":1.218,"5min":1.218,"15min":1.218},"min":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"max":{"1min":2.665,"5min":2.665,"15min":2.665},"last":1.661},{"interface":"front","average":{"1min":1.2310000000000001,"5min":1.2310000000000001,"15min":1.2310000000000001},"min":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"max":{"1min":1.8620000000000001,"5min":1.8620000000000001,"15min":1.8620000000000001},"last":1.4399999999999999}]},{"osd":4,"last update":"Tue Dec 12 09:44:14 2023","interfaces":[{"interface":"back","average":{"1min":1.2749999999999999,"5min":1.2749999999999999,"15min":1.2749999999999999},"min":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":2.0310000000000001,"5min":2.0310000000000001,"15min":2.0310000000000001},"last":1.163},{"interface":"front","average":{"1min":1.407,"5min":1.407,"15min":1.407},"min":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"max":{"1min":2.2799999999999998,"5min":2.2799999999999998,"15min":2.2799999999999998},"last":0.93899999999999995}]},{"osd":5,"last update":"Tue Dec 12 09:44:14 2023","interfaces":[{"interface":"back","average":{"1min":1.4410000000000001,"5min":1.4410000000000001,"15min":1.4410000000000001},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":2.1739999999999999,"5min":2.1739999999999999,"15min":2.1739999999999999},"last":1.597},{"interface":"front","average":{"1min":1.4770000000000001,"5min":1.4770000000000001,"15min":1.4770000000000001},"min":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"max":{"1min":1.929,"5min":1.929,"15min":1.929},"last":1.538}]},{"osd":7,"last update":"Tue Dec 12 09:44:14 2023","interfaces":[{"interface":"back","average":{"1min":1.5089999999999999,"5min":1.5089999999999999,"15min":1.5089999999999999},"min":{"1min":0.754,"5min":0.754,"15min":0.754},"max":{"1min":1.994,"5min":1.994,"15min":1.994},"last":1.4910000000000001},{"interface":"front","average":{"1min":1.5389999999999999,"5min":1.5389999999999999,"15min":1.5389999999999999},"min":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"max":{"1min":2.0800000000000001,"5min":2.0800000000000001,"15min":2.0800000000000001},"last":1.71}]}]},{"osd":5,"up_from":13,"seq":55834574864,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27404,"kb_used_data":384,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344436,"statfs":{"total":96636764160,"available":96608702464,"internally_reserved":0,"allocated":393216,"data_stored":151444,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 12 09:44:14 2023","interfaces":[{"interface":"back","average":{"1min":1.02,"5min":1.02,"15min":1.02},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.5209999999999999,"5min":1.5209999999999999,"15min":1.5209999999999999},"last":0.92000000000000004},{"interface":"front","average":{"1min":1.1299999999999999,"5min":1.1299999999999999,"15min":1.1299999999999999},"min":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"max":{"1min":1.508,"5min":1.508,"15min":1.508},"last":1.595}]},{"osd":1,"last update":"Tue Dec 12 09:44:14 2023","interfaces":[{"interface":"back","average":{"1min":1.226,"5min":1.226,"15min":1.226},"min":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"max":{"1min":1.5940000000000001,"5min":1.5940000000000001,"15min":1.5940000000000001},"last":1.756},{"interface":"front","average":{"1min":1.0920000000000001,"5min":1.0920000000000001,"15min":1.0920000000000001},"min":{"1min":0.753,"5min":0.753,"15min":0.753},"max":{"1min":1.5840000000000001,"5min":1.5840000000000001,"15min":1.5840000000000001},"last":1.022}]},{"osd":2,"last update":"Tue Dec 12 09:44:14 2023","interfaces":[{"interface":"back","average":{"1min":1.3169999999999999,"5min":1.3169999999999999,"15min":1.3169999999999999},"min":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"max":{"1min":1.7889999999999999,"5min":1.7889999999999999,"15min":1.7889999999999999},"last":1.3029999999999999},{"interface":"front","average":{"1min":1.421,"5min":1.421,"15min":1.421},"min":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"max":{"1min":2.1600000000000001,"5min":2.1600000000000001,"15min":2.1600000000000001},"last":1.1619999999999999}]},{"osd":3,"last update":"Tue Dec 12 09:44:14 2023","interfaces":[{"interface":"back","average":{"1min":1.371,"5min":1.371,"15min":1.371},"min":{"1min":1.002,"5min":1.002,"15min":1.002},"max":{"1min":2.1499999999999999,"5min":2.1499999999999999,"15min":2.1499999999999999},"last":1.367},{"interface":"front","average":{"1min":1.492,"5min":1.492,"15min":1.492},"min":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"max":{"1min":1.8939999999999999,"5min":1.8939999999999999,"15min":1.8939999999999999},"last":1.4179999999999999}]},{"osd":4,"last update":"Tue Dec 12 09:44:14 2023","interfaces":[{"interface":"back","average":{"1min":1.4910000000000001,"5min":1.4910000000000001,"15min":1.4910000000000001},"min":{"1min":0.995,"5min":0.995,"15min":0.995},"max":{"1min":2.391,"5min":2.391,"15min":2.391},"last":1.5089999999999999},{"interface":"front","average":{"1min":1.5880000000000001,"5min":1.5880000000000001,"15min":1.5880000000000001},"min":{"1min":1.0940000000000001,"5min":1.0940000000000001,"15min":1.0940000000000001},"max":{"1min":2.5430000000000001,"5min":2.5430000000000001,"15min":2.5430000000000001},"last":1.665}]},{"osd":6,"last update":"Tue Dec 12 09:44:14 2023","interfaces":[{"interface":"back","average":{"1min":1.5960000000000001,"5min":1.5960000000000001,"15min":1.5960000000000001},"min":{"1min":1.034,"5min":1.034,"15min":1.034},"max":{"1min":2.0840000000000001,"5min":2.0840000000000001,"15min":2.0840000000000001},"last":1.696},{"interface":"front","average":{"1min":1.631,"5min":1.631,"15min":1.631},"min":{"1min":1.155,"5min":1.155,"15min":1.155},"max":{"1min":2.306,"5min":2.306,"15min":2.306},"last":1.9970000000000001}]},{"osd":7,"last update":"Tue Dec 12 09:44:14 2023","interfaces":[{"interface":"back","average":{"1min":1.7849999999999999,"5min":1.7849999999999999,"15min":1.7849999999999999},"min":{"1min":1.2090000000000001,"5min":1.2090000000000001,"15min":1.2090000000000001},"max":{"1min":2.6880000000000002,"5min":2.6880000000000002,"15min":2.6880000000000002},"last":1.889},{"interface":"front","average":{"1min":1.748,"5min":1.748,"15min":1.748},"min":{"1min":1.1220000000000001,"5min":1.1220000000000001,"15min":1.1220000000000001},"max":{"1min":2.3410000000000002,"5min":2.3410000000000002,"15min":2.3410000000000002},"last":1.8260000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574866,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27392,"kb_used_data":372,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344448,"statfs":{"total":96636764160,"available":96608714752,"internally_reserved":0,"allocated":380928,"data_stored":144576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 12 09:44:14 2023","interfaces":[{"interface":"back","average":{"1min":1.0549999999999999,"5min":1.0549999999999999,"15min":1.0549999999999999},"min":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":1.5820000000000001,"5min":1.5820000000000001,"15min":1.5820000000000001},"last":1.0840000000000001},{"interface":"front","average":{"1min":1.0549999999999999,"5min":1.0549999999999999,"15min":1.0549999999999999},"min":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"max":{"1min":1.492,"5min":1.492,"15min":1.492},"last":1.151}]},{"osd":1,"last update":"Tue Dec 12 09:44:14 2023","interfaces":[{"interface":"back","average":{"1min":1.044,"5min":1.044,"15min":1.044},"min":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"max":{"1min":1.3360000000000001,"5min":1.3360000000000001,"15min":1.3360000000000001},"last":0.79600000000000004},{"interface":"front","average":{"1min":1.181,"5min":1.181,"15min":1.181},"min":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"max":{"1min":1.8720000000000001,"5min":1.8720000000000001,"15min":1.8720000000000001},"last":1.1890000000000001}]},{"osd":2,"last update":"Tue Dec 12 09:44:14 2023","interfaces":[{"interface":"back","average":{"1min":1.119,"5min":1.119,"15min":1.119},"min":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"max":{"1min":1.429,"5min":1.429,"15min":1.429},"last":1.3740000000000001},{"interface":"front","average":{"1min":1.294,"5min":1.294,"15min":1.294},"min":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"max":{"1min":2.1640000000000001,"5min":2.1640000000000001,"15min":2.1640000000000001},"last":1.335}]},{"osd":3,"last update":"Tue Dec 12 09:44:14 2023","interfaces":[{"interface":"back","average":{"1min":1.2030000000000001,"5min":1.2030000000000001,"15min":1.2030000000000001},"min":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"max":{"1min":1.635,"5min":1.635,"15min":1.635},"last":1.2949999999999999},{"interface":"front","average":{"1min":1.238,"5min":1.238,"15min":1.238},"min":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"max":{"1min":2.0499999999999998,"5min":2.0499999999999998,"15min":2.0499999999999998},"last":1.0049999999999999}]},{"osd":5,"last update":"Tue Dec 12 09:44:14 2023","interfaces":[{"interface":"back","average":{"1min":1.468,"5min":1.468,"15min":1.468},"min":{"1min":1,"5min":1,"15min":1},"max":{"1min":2.3159999999999998,"5min":2.3159999999999998,"15min":2.3159999999999998},"last":0.53200000000000003},{"interface":"front","average":{"1min":1.3500000000000001,"5min":1.3500000000000001,"15min":1.3500000000000001},"min":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"max":{"1min":2.117,"5min":2.117,"15min":2.117},"last":1.038}]},{"osd":6,"last update":"Tue Dec 12 09:44:14 2023","interfaces":[{"interface":"back","average":{"1min":1.403,"5min":1.403,"15min":1.403},"min":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"max":{"1min":2.246,"5min":2.246,"15min":2.246},"last":0.91100000000000003},{"interface":"front","average":{"1min":1.5489999999999999,"5min":1.5489999999999999,"15min":1.5489999999999999},"min":{"1min":1.2430000000000001,"5min":1.2430000000000001,"15min":1.2430000000000001},"max":{"1min":2.5099999999999998,"5min":2.5099999999999998,"15min":2.5099999999999998},"last":1.391}]},{"osd":7,"last update":"Tue Dec 12 09:44:14 2023","interfaces":[{"interface":"back","average":{"1min":1.5049999999999999,"5min":1.5049999999999999,"15min":1.5049999999999999},"min":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"max":{"1min":2.5710000000000002,"5min":2.5710000000000002,"15min":2.5710000000000002},"last":0.96099999999999997},{"interface":"front","average":{"1min":1.5129999999999999,"5min":1.5129999999999999,"15min":1.5129999999999999},"min":{"1min":1.0600000000000001,"5min":1.0600000000000001,"15min":1.0600000000000001},"max":{"1min":2.3919999999999999,"5min":2.3919999999999999,"15min":2.3919999999999999},"last":1.2290000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574864,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27412,"kb_used_data":392,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344428,"statfs":{"total":96636764160,"available":96608694272,"internally_reserved":0,"allocated":401408,"data_stored":152406,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 12 09:44:16 2023","interfaces":[{"interface":"back","average":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":1.4830000000000001,"5min":1.4830000000000001,"15min":1.4830000000000001},"last":0.67200000000000004},{"interface":"front","average":{"1min":1.137,"5min":1.137,"15min":1.137},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":3.3370000000000002,"5min":3.3370000000000002,"15min":3.3370000000000002},"last":0.41299999999999998}]},{"osd":1,"last update":"Tue Dec 12 09:44:16 2023","interfaces":[{"interface":"back","average":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":1.4610000000000001,"5min":1.4610000000000001,"15min":1.4610000000000001},"last":0.69999999999999996},{"interface":"front","average":{"1min":1.069,"5min":1.069,"15min":1.069},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":2.9409999999999998,"5min":2.9409999999999998,"15min":2.9409999999999998},"last":0.78300000000000003}]},{"osd":2,"last update":"Tue Dec 12 09:44:16 2023","interfaces":[{"interface":"back","average":{"1min":1.1870000000000001,"5min":1.1870000000000001,"15min":1.1870000000000001},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":2.613,"5min":2.613,"15min":2.613},"last":0.64100000000000001},{"interface":"front","average":{"1min":1.1850000000000001,"5min":1.1850000000000001,"15min":1.1850000000000001},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":3.0430000000000001,"5min":3.0430000000000001,"15min":3.0430000000000001},"last":0.52700000000000002}]},{"osd":4,"last update":"Tue Dec 12 09:44:16 2023","interfaces":[{"interface":"back","average":{"1min":1.383,"5min":1.383,"15min":1.383},"min":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":3.5019999999999998,"5min":3.5019999999999998,"15min":3.5019999999999998},"last":1.218},{"interface":"front","average":{"1min":1.4830000000000001,"5min":1.4830000000000001,"15min":1.4830000000000001},"min":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"max":{"1min":2.9889999999999999,"5min":2.9889999999999999,"15min":2.9889999999999999},"last":0.79800000000000004}]},{"osd":5,"last update":"Tue Dec 12 09:44:16 2023","interfaces":[{"interface":"back","average":{"1min":1.5,"5min":1.5,"15min":1.5},"min":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"max":{"1min":4.2480000000000002,"5min":4.2480000000000002,"15min":4.2480000000000002},"last":0.73599999999999999},{"interface":"front","average":{"1min":1.5920000000000001,"5min":1.5920000000000001,"15min":1.5920000000000001},"min":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"max":{"1min":5.5060000000000002,"5min":5.5060000000000002,"15min":5.5060000000000002},"last":1.1279999999999999}]},{"osd":6,"last update":"Tue Dec 12 09:44:16 2023","interfaces":[{"interface":"back","average":{"1min":1.458,"5min":1.458,"15min":1.458},"min":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"max":{"1min":3.1400000000000001,"5min":3.1400000000000001,"15min":3.1400000000000001},"last":0.83199999999999996},{"interface":"front","average":{"1min":1.5469999999999999,"5min":1.5469999999999999,"15min":1.5469999999999999},"min":{"1min":0.627,"5min":0.627,"15min":0.627},"max":{"1min":4.3179999999999996,"5min":4.3179999999999996,"15min":4.3179999999999996},"last":1.288}]},{"osd":7,"last update":"Tue Dec 12 09:44:16 2023","interfaces":[{"interface":"back","average":{"1min":1.5920000000000001,"5min":1.5920000000000001,"15min":1.5920000000000001},"min":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"max":{"1min":5.3979999999999997,"5min":5.3979999999999997,"15min":5.3979999999999997},"last":1.054},{"interface":"front","average":{"1min":1.554,"5min":1.554,"15min":1.554},"min":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"max":{"1min":3.4129999999999998,"5min":3.4129999999999998,"15min":3.4129999999999998},"last":0.75800000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574864,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27404,"kb_used_data":380,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344436,"statfs":{"total":96636764160,"available":96608702464,"internally_reserved":0,"allocated":389120,"data_stored":150842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 12 09:44:15 2023","interfaces":[{"interface":"back","average":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":1.458,"5min":1.458,"15min":1.458},"last":0.98799999999999999},{"interface":"front","average":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":1.4370000000000001,"5min":1.4370000000000001,"15min":1.4370000000000001},"last":1.343}]},{"osd":1,"last update":"Tue Dec 12 09:44:15 2023","interfaces":[{"interface":"back","average":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.593,"5min":1.593,"15min":1.593},"last":0.83399999999999996},{"interface":"front","average":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":1.758,"5min":1.758,"15min":1.758},"last":0.92500000000000004}]},{"osd":3,"last update":"Tue Dec 12 09:44:15 2023","interfaces":[{"interface":"back","average":{"1min":1.0569999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.8879999999999999,"5min":1.8879999999999999,"15min":1.8879999999999999},"last":1.0780000000000001},{"interface":"front","average":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":1.8120000000000001,"5min":1.8120000000000001,"15min":1.8120000000000001},"last":1.131}]},{"osd":4,"last update":"Tue Dec 12 09:44:15 2023","interfaces":[{"interface":"back","average":{"1min":1.2270000000000001,"5min":1.2270000000000001,"15min":1.2270000000000001},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":2.5760000000000001,"5min":2.5760000000000001,"15min":2.5760000000000001},"last":1.2070000000000001},{"interface":"front","average":{"1min":1.3939999999999999,"5min":1.3939999999999999,"15min":1.3939999999999999},"min":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":2.8069999999999999,"5min":2.8069999999999999,"15min":2.8069999999999999},"last":1.522}]},{"osd":5,"last update":"Tue Dec 12 09:44:15 2023","interfaces":[{"interface":"back","average":{"1min":1.379,"5min":1.379,"15min":1.379},"min":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"max":{"1min":2.3109999999999999,"5min":2.3109999999999999,"15min":2.3109999999999999},"last":1.2929999999999999},{"interface":"front","average":{"1min":1.351,"5min":1.351,"15min":1.351},"min":{"1min":0.627,"5min":0.627,"15min":0.627},"max":{"1min":2.5110000000000001,"5min":2.5110000000000001,"15min":2.5110000000000001},"last":1.3979999999999999}]},{"osd":6,"last update":"Tue Dec 12 09:44:15 2023","interfaces":[{"interface":"back","average":{"1min":1.4370000000000001,"5min":1.4370000000000001,"15min":1.4370000000000001},"min":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"max":{"1min":2.907,"5min":2.907,"15min":2.907},"last":1.6479999999999999},{"interface":"front","average":{"1min":1.429,"5min":1.429,"15min":1.429},"min":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"max":{"1min":2.375,"5min":2.375,"15min":2.375},"last":1.4730000000000001}]},{"osd":7,"last update":"Tue Dec 12 09:44:15 2023","interfaces":[{"interface":"back","average":{"1min":1.4570000000000001,"5min":1.4570000000000001,"15min":1.4570000000000001},"min":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"max":{"1min":2.3370000000000002,"5min":2.3370000000000002,"15min":2.3370000000000002},"last":1.706},{"interface":"front","average":{"1min":1.5129999999999999,"5min":1.5129999999999999,"15min":1.5129999999999999},"min":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"max":{"1min":2.488,"5min":2.488,"15min":2.488},"last":1.5649999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574864,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27412,"kb_used_data":392,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344428,"statfs":{"total":96636764160,"available":96608694272,"internally_reserved":0,"allocated":401408,"data_stored":152406,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 12 09:44:15 2023","interfaces":[{"interface":"back","average":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":2.794,"5min":2.794,"15min":2.794},"last":0.82499999999999996},{"interface":"front","average":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":2.1379999999999999,"5min":2.1379999999999999,"15min":2.1379999999999999},"last":0.83599999999999997}]},{"osd":2,"last update":"Tue Dec 12 09:44:15 2023","interfaces":[{"interface":"back","average":{"1min":0.98599999999999999,"5min":0.98599999999999999,"15min":0.98599999999999999},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":6.3390000000000004,"5min":6.3390000000000004,"15min":6.3390000000000004},"last":0.752},{"interface":"front","average":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":2.823,"5min":2.823,"15min":2.823},"last":0.78100000000000003}]},{"osd":3,"last update":"Tue Dec 12 09:44:15 2023","interfaces":[{"interface":"back","average":{"1min":1.0509999999999999,"5min":1.0509999999999999,"15min":1.0509999999999999},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":2.7519999999999998,"5min":2.7519999999999998,"15min":2.7519999999999998},"last":0.88200000000000001},{"interface":"front","average":{"1min":1.008,"5min":1.008,"15min":1.008},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":2.2559999999999998,"5min":2.2559999999999998,"15min":2.2559999999999998},"last":0.90900000000000003}]},{"osd":4,"last update":"Tue Dec 12 09:44:15 2023","interfaces":[{"interface":"back","average":{"1min":1.399,"5min":1.399,"15min":1.399},"min":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"max":{"1min":6.423,"5min":6.423,"15min":6.423},"last":1.1299999999999999},{"interface":"front","average":{"1min":1.194,"5min":1.194,"15min":1.194},"min":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"max":{"1min":2.2309999999999999,"5min":2.2309999999999999,"15min":2.2309999999999999},"last":1.157}]},{"osd":5,"last update":"Tue Dec 12 09:44:15 2023","interfaces":[{"interface":"back","average":{"1min":1.4670000000000001,"5min":1.4670000000000001,"15min":1.4670000000000001},"min":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"max":{"1min":6.2830000000000004,"5min":6.2830000000000004,"15min":6.2830000000000004},"last":1.351},{"interface":"front","average":{"1min":1.375,"5min":1.375,"15min":1.375},"min":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"max":{"1min":2.73,"5min":2.73,"15min":2.73},"last":1.4339999999999999}]},{"osd":6,"last update":"Tue Dec 12 09:44:15 2023","interfaces":[{"interface":"back","average":{"1min":1.5600000000000001,"5min":1.5600000000000001,"15min":1.5600000000000001},"min":{"1min":0.875,"5min":0.875,"15min":0.875},"max":{"1min":6.468,"5min":6.468,"15min":6.468},"last":1.4099999999999999},{"interface":"front","average":{"1min":1.5800000000000001,"5min":1.5800000000000001,"15min":1.5800000000000001},"min":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"max":{"1min":6.3129999999999997,"5min":6.3129999999999997,"15min":6.3129999999999997},"last":1.484}]},{"osd":7,"last update":"Tue Dec 12 09:44:15 2023","interfaces":[{"interface":"back","average":{"1min":1.407,"5min":1.407,"15min":1.407},"min":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"max":{"1min":2.9009999999999998,"5min":2.9009999999999998,"15min":2.9009999999999998},"last":1.111},{"interface":"front","average":{"1min":1.556,"5min":1.556,"15min":1.556},"min":{"1min":0.752,"5min":0.752,"15min":0.752},"max":{"1min":6.242,"5min":6.242,"15min":6.242},"last":1.3140000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574866,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27464,"kb_used_data":440,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344376,"statfs":{"total":96636764160,"available":96608641024,"internally_reserved":0,"allocated":450560,"data_stored":741140,"data_compressed":32422,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Dec 12 09:44:16 2023","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":1.3600000000000001,"5min":1.3600000000000001,"15min":1.3600000000000001},"last":0.82299999999999995},{"interface":"front","average":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":1.282,"5min":1.282,"15min":1.282},"last":1.3460000000000001}]},{"osd":2,"last update":"Tue Dec 12 09:44:16 2023","interfaces":[{"interface":"back","average":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":1.2529999999999999,"5min":1.2529999999999999,"15min":1.2529999999999999},"last":0.91900000000000004},{"interface":"front","average":{"1min":0.995,"5min":0.995,"15min":0.995},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":1.649,"5min":1.649,"15min":1.649},"last":1.1619999999999999}]},{"osd":3,"last update":"Tue Dec 12 09:44:16 2023","interfaces":[{"interface":"back","average":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.4990000000000001,"5min":1.4990000000000001,"15min":1.4990000000000001},"last":1.2529999999999999},{"interface":"front","average":{"1min":1.004,"5min":1.004,"15min":1.004},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.7689999999999999,"5min":1.7689999999999999,"15min":1.7689999999999999},"last":1.4790000000000001}]},{"osd":4,"last update":"Tue Dec 12 09:44:16 2023","interfaces":[{"interface":"back","average":{"1min":1.2869999999999999,"5min":1.2869999999999999,"15min":1.2869999999999999},"min":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"max":{"1min":2.073,"5min":2.073,"15min":2.073},"last":1.29},{"interface":"front","average":{"1min":1.2929999999999999,"5min":1.2929999999999999,"15min":1.2929999999999999},"min":{"1min":0.877,"5min":0.877,"15min":0.877},"max":{"1min":3.0699999999999998,"5min":3.0699999999999998,"15min":3.0699999999999998},"last":1.4259999999999999}]},{"osd":5,"last update":"Tue Dec 12 09:44:16 2023","interfaces":[{"interface":"back","average":{"1min":1.2330000000000001,"5min":1.2330000000000001,"15min":1.2330000000000001},"min":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":3.1909999999999998,"5min":3.1909999999999998,"15min":3.1909999999999998},"last":1.0089999999999999},{"interface":"front","average":{"1min":1.3069999999999999,"5min":1.3069999999999999,"15min":1.3069999999999999},"min":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"max":{"1min":1.9750000000000001,"5min":1.9750000000000001,"15min":1.9750000000000001},"last":1.0740000000000001}]},{"osd":6,"last update":"Tue Dec 12 09:44:16 2023","interfaces":[{"interface":"back","average":{"1min":1.3380000000000001,"5min":1.3380000000000001,"15min":1.3380000000000001},"min":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"max":{"1min":1.9630000000000001,"5min":1.9630000000000001,"15min":1.9630000000000001},"last":1.3080000000000001},{"interface":"front","average":{"1min":1.3919999999999999,"5min":1.3919999999999999,"15min":1.3919999999999999},"min":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"max":{"1min":2.9100000000000001,"5min":2.9100000000000001,"15min":2.9100000000000001},"last":1.391}]},{"osd":7,"last update":"Tue Dec 12 09:44:16 2023","interfaces":[{"interface":"back","average":{"1min":1.4450000000000001,"5min":1.4450000000000001,"15min":1.4450000000000001},"min":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"max":{"1min":2.992,"5min":2.992,"15min":2.992},"last":1.45},{"interface":"front","average":{"1min":1.3300000000000001,"5min":1.3300000000000001,"15min":1.3300000000000001},"min":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"max":{"1min":2.7690000000000001,"5min":2.7690000000000001,"15min":2.7690000000000001},"last":1.522}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32422,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32422,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-12T09:44:25.958 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-12T09:44:26.217 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:26.216+0000 7fb1d0bce640 1 Processor -- start 2023-12-12T09:44:26.217 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:26.216+0000 7fb1d0bce640 1 -- start start 2023-12-12T09:44:26.219 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:26.217+0000 7fb1d0bce640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb1cc14fa40 0x7fb1cc06a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:26.219 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:26.217+0000 7fb1d0bce640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fb1cc0c5070 0x7fb1cc0c40c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:26.219 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:26.217+0000 7fb1d0bce640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1cc152610 con 0x7fb1cc06db70 2023-12-12T09:44:26.219 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:26.217+0000 7fb1d0bce640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1cc1528f0 con 0x7fb1cc0c5070 2023-12-12T09:44:26.219 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:26.218+0000 7fb1d0bce640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1cc152bd0 con 0x7fb1cc14fa40 2023-12-12T09:44:26.219 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:26.218+0000 7fb1c3fff640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7fb1cc06db70 0x7fb1cc0c39b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:49056/0 (socket says 172.21.15.73:49056) 2023-12-12T09:44:26.219 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:26.218+0000 7fb1c3fff640 1 -- 172.21.15.73:0/1847785284 learned_addr learned my addr 172.21.15.73:0/1847785284 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-12T09:44:26.221 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:26.218+0000 7fb1cad9d640 1 --2- 172.21.15.73:0/1847785284 >> v2:172.21.15.142:3300/0 conn(0x7fb1cc0c5070 0x7fb1cc0c40c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:26.221 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:26.218+0000 7fb1ca59c640 1 --2- 172.21.15.73:0/1847785284 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb1cc14fa40 0x7fb1cc06a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:26.221 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:26.218+0000 7fb1c9d9b640 1 -- 172.21.15.73:0/1847785284 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 989309537 0 0) 0x7fb1cc152610 con 0x7fb1cc06db70 2023-12-12T09:44:26.221 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:26.218+0000 7fb1c9d9b640 1 -- 172.21.15.73:0/1847785284 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb1b8003520 con 0x7fb1cc06db70 2023-12-12T09:44:26.221 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:26.219+0000 7fb1c9d9b640 1 -- 172.21.15.73:0/1847785284 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1728516345 0 0) 0x7fb1b8003520 con 0x7fb1cc06db70 2023-12-12T09:44:26.221 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:26.219+0000 7fb1c9d9b640 1 -- 172.21.15.73:0/1847785284 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb1cc14fa40 msgr2=0x7fb1cc06a4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:44:26.222 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:26.219+0000 7fb1c9d9b640 1 --2- 172.21.15.73:0/1847785284 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb1cc14fa40 0x7fb1cc06a4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:26.222 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:26.219+0000 7fb1c9d9b640 1 -- 172.21.15.73:0/1847785284 >> v2:172.21.15.142:3300/0 conn(0x7fb1cc0c5070 msgr2=0x7fb1cc0c40c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:44:26.222 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:26.219+0000 7fb1c9d9b640 1 --2- 172.21.15.73:0/1847785284 >> v2:172.21.15.142:3300/0 conn(0x7fb1cc0c5070 0x7fb1cc0c40c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:26.222 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:26.219+0000 7fb1c9d9b640 1 -- 172.21.15.73:0/1847785284 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1cc152eb0 con 0x7fb1cc06db70 2023-12-12T09:44:26.222 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:26.219+0000 7fb1c9d9b640 1 -- 172.21.15.73:0/1847785284 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3186547832 0 0) 0x7fb1b4001670 con 0x7fb1cc06db70 2023-12-12T09:44:26.222 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:26.219+0000 7fb1c9d9b640 1 -- 172.21.15.73:0/1847785284 >> v1:172.21.15.73:6789/0 conn(0x7fb1cc06db70 legacy=0x7fb1cc0c39b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:26.222 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:26.219+0000 7fb1c9d9b640 1 --2- 172.21.15.73:0/1847785284 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb1b8003970 0x7fb1b8003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:26.222 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:26.219+0000 7fb1c9d9b640 1 --2- 172.21.15.73:0/1847785284 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb1cc14fa40 0x7fb1b80047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:26.222 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:26.219+0000 7fb1c9d9b640 1 --2- 172.21.15.73:0/1847785284 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb1b8004d00 0x7fb1b8005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:26.222 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:26.219+0000 7fb1c9d9b640 1 -- 172.21.15.73:0/1847785284 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1cc1528f0 con 0x7fb1b8004d00 2023-12-12T09:44:26.223 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:26.219+0000 7fb1c9d9b640 1 -- 172.21.15.73:0/1847785284 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1cc152bd0 con 0x7fb1b8003970 2023-12-12T09:44:26.223 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:26.219+0000 7fb1c9d9b640 1 -- 172.21.15.73:0/1847785284 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1b800b980 con 0x7fb1cc14fa40 2023-12-12T09:44:26.223 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:26.219+0000 7fb1cad9d640 1 --2- 172.21.15.73:0/1847785284 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb1b8004d00 0x7fb1b8005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:26.223 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:26.219+0000 7fb1c3fff640 1 --2- 172.21.15.73:0/1847785284 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb1cc14fa40 0x7fb1b80047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:26.223 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:26.219+0000 7fb1ca59c640 1 --2- 172.21.15.73:0/1847785284 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb1b8003970 0x7fb1b8003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:26.223 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:26.220+0000 7fb1cad9d640 1 -- 172.21.15.73:0/1847785284 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb1cc14fa40 msgr2=0x7fb1b80047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:44:26.223 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:26.220+0000 7fb1cad9d640 1 --2- 172.21.15.73:0/1847785284 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb1cc14fa40 0x7fb1b80047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:26.223 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:26.220+0000 7fb1cad9d640 1 -- 172.21.15.73:0/1847785284 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb1b8003970 msgr2=0x7fb1b8003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:44:26.223 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:26.220+0000 7fb1cad9d640 1 --2- 172.21.15.73:0/1847785284 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb1b8003970 0x7fb1b8003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:26.224 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:26.220+0000 7fb1cad9d640 1 -- 172.21.15.73:0/1847785284 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1b8003520 con 0x7fb1b8004d00 2023-12-12T09:44:26.225 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:26.221+0000 7fb1cad9d640 1 --2- 172.21.15.73:0/1847785284 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb1b8004d00 0x7fb1b8005180 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fb1c4009fc0 tx=0x7fb1b80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=707cea8c70236dbe server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:44:26.225 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:26.221+0000 7fb1c9d9b640 1 -- 172.21.15.73:0/1847785284 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1c402cc60 con 0x7fb1b8004d00 2023-12-12T09:44:26.225 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:26.221+0000 7fb1c9d9b640 1 -- 172.21.15.73:0/1847785284 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1c400f040 con 0x7fb1b8004d00 2023-12-12T09:44:26.225 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:26.221+0000 7fb1c9d9b640 1 -- 172.21.15.73:0/1847785284 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1c4034440 con 0x7fb1b8004d00 2023-12-12T09:44:26.225 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:26.222+0000 7fb1d0bce640 1 -- 172.21.15.73:0/1847785284 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb1b8004d00 msgr2=0x7fb1b8005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:26.225 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:26.222+0000 7fb1d0bce640 1 --2- 172.21.15.73:0/1847785284 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb1b8004d00 0x7fb1b8005180 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fb1c4009fc0 tx=0x7fb1b80057f0 comp rx=0 tx=0).stop 2023-12-12T09:44:26.225 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:26.222+0000 7fb1cad9d640 1 -- 172.21.15.73:0/1847785284 reap_dead start 2023-12-12T09:44:26.225 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:26.222+0000 7fb1d0bce640 1 -- 172.21.15.73:0/1847785284 shutdown_connections 2023-12-12T09:44:26.226 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:26.222+0000 7fb1d0bce640 1 -- 172.21.15.73:0/1847785284 >> 172.21.15.73:0/1847785284 conn(0x7fb1cc0a8130 msgr2=0x7fb1cc0c24b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:44:26.226 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:26.222+0000 7fb1d0bce640 1 -- 172.21.15.73:0/1847785284 shutdown_connections 2023-12-12T09:44:26.226 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:26.222+0000 7fb1d0bce640 1 -- 172.21.15.73:0/1847785284 wait complete. 2023-12-12T09:44:26.226 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:26.224+0000 7fb1d0bce640 1 Processor -- start 2023-12-12T09:44:26.226 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:26.224+0000 7fb1d0bce640 1 -- start start 2023-12-12T09:44:26.230 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:26.225+0000 7fb1d0bce640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb1cc151030 0x7fb1cc150350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:26.230 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:26.225+0000 7fb1d0bce640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb1cc151410 0x7fb1cc14bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:26.230 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:26.225+0000 7fb1d0bce640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb1cc0a56d0 0x7fb1cc1f17f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:26.231 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:26.225+0000 7fb1d0bce640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1cc1523f0 con 0x7fb1cc0a56d0 2023-12-12T09:44:26.231 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:26.225+0000 7fb1d0bce640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1cc14b920 con 0x7fb1cc151030 2023-12-12T09:44:26.231 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:26.225+0000 7fb1d0bce640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1cc0a7510 con 0x7fb1cc151410 2023-12-12T09:44:26.231 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:26.225+0000 7fb1cad9d640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb1cc0a56d0 0x7fb1cc1f17f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:26.231 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:26.226+0000 7fb1cad9d640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb1cc0a56d0 0x7fb1cc1f17f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:42486/0 (socket says 172.21.15.73:42486) 2023-12-12T09:44:26.231 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:26.226+0000 7fb1cad9d640 1 -- 172.21.15.73:0/709590966 learned_addr learned my addr 172.21.15.73:0/709590966 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:44:26.231 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:26.226+0000 7fb1ca59c640 1 --2- 172.21.15.73:0/709590966 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb1cc151030 0x7fb1cc150350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:26.232 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:26.226+0000 7fb1c3fff640 1 --2- 172.21.15.73:0/709590966 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb1cc151410 0x7fb1cc14bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:26.232 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:26.226+0000 7fb1cad9d640 1 -- 172.21.15.73:0/709590966 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb1cc151410 msgr2=0x7fb1cc14bdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:26.232 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:26.226+0000 7fb1cad9d640 1 --2- 172.21.15.73:0/709590966 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb1cc151410 0x7fb1cc14bdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:26.232 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:26.226+0000 7fb1cad9d640 1 -- 172.21.15.73:0/709590966 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb1cc151030 msgr2=0x7fb1cc150350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:26.232 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:26.226+0000 7fb1cad9d640 1 --2- 172.21.15.73:0/709590966 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb1cc151030 0x7fb1cc150350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:26.232 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:26.226+0000 7fb1cad9d640 1 -- 172.21.15.73:0/709590966 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1cc151970 con 0x7fb1cc0a56d0 2023-12-12T09:44:26.232 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:26.226+0000 7fb1c3fff640 1 --2- 172.21.15.73:0/709590966 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb1cc151410 0x7fb1cc14bdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:44:26.232 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:26.226+0000 7fb1cad9d640 1 --2- 172.21.15.73:0/709590966 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb1cc0a56d0 0x7fb1cc1f17f0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fb1c4037040 tx=0x7fb1c4009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:44:26.233 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:26.227+0000 7fb1c2ffd640 1 -- 172.21.15.73:0/709590966 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1c4034d50 con 0x7fb1cc0a56d0 2023-12-12T09:44:26.233 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:26.227+0000 7fb1c2ffd640 1 -- 172.21.15.73:0/709590966 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1c4003990 con 0x7fb1cc0a56d0 2023-12-12T09:44:26.233 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:26.227+0000 7fb1d0bce640 1 -- 172.21.15.73:0/709590966 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1cc14c2f0 con 0x7fb1cc0a56d0 2023-12-12T09:44:26.233 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:26.227+0000 7fb1c2ffd640 1 -- 172.21.15.73:0/709590966 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1c4003d40 con 0x7fb1cc0a56d0 2023-12-12T09:44:26.233 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:26.227+0000 7fb1d0bce640 1 -- 172.21.15.73:0/709590966 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1cc0a5b50 con 0x7fb1cc0a56d0 2023-12-12T09:44:26.233 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:26.228+0000 7fb1d0bce640 1 -- 172.21.15.73:0/709590966 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1cc067920 con 0x7fb1cc0a56d0 2023-12-12T09:44:26.233 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:26.229+0000 7fb1c2ffd640 1 -- 172.21.15.73:0/709590966 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fb1c4004030 con 0x7fb1cc0a56d0 2023-12-12T09:44:26.235 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:26.230+0000 7fb1c2ffd640 1 --2- 172.21.15.73:0/709590966 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fb1ac06ae70 0x7fb1ac06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:26.235 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:26.230+0000 7fb1c2ffd640 1 -- 172.21.15.73:0/709590966 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb1c40aafa0 con 0x7fb1cc0a56d0 2023-12-12T09:44:26.235 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:26.230+0000 7fb1ca59c640 1 --2- 172.21.15.73:0/709590966 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fb1ac06ae70 0x7fb1ac06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:26.235 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:26.231+0000 7fb1ca59c640 1 --2- 172.21.15.73:0/709590966 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fb1ac06ae70 0x7fb1ac06d330 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fb1bc0098d0 tx=0x7fb1bc008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:44:26.235 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:26.234+0000 7fb1c2ffd640 1 -- 172.21.15.73:0/709590966 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fb1c4076190 con 0x7fb1cc0a56d0 2023-12-12T09:44:26.420 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:26.419+0000 7fb1d0bce640 1 -- 172.21.15.73:0/709590966 --> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fb1cc0c45d0 con 0x7fb1ac06ae70 2023-12-12T09:44:26.442 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:26.441+0000 7fb1c2ffd640 1 -- 172.21.15.73:0/709590966 <== mgr.4110 v2:172.21.15.73:6832/779985841 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+287138 (secure 0 0 0) 0x7fb1cc0c45d0 con 0x7fb1ac06ae70 2023-12-12T09:44:26.445 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-12T09:44:26.448 INFO:teuthology.orchestra.run.smithi073.stderr:dumped all 2023-12-12T09:44:26.450 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:26.448+0000 7fb1d0bce640 1 -- 172.21.15.73:0/709590966 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fb1ac06ae70 msgr2=0x7fb1ac06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:26.450 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:26.448+0000 7fb1d0bce640 1 --2- 172.21.15.73:0/709590966 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fb1ac06ae70 0x7fb1ac06d330 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fb1bc0098d0 tx=0x7fb1bc008040 comp rx=0 tx=0).stop 2023-12-12T09:44:26.450 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:26.448+0000 7fb1d0bce640 1 -- 172.21.15.73:0/709590966 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb1cc0a56d0 msgr2=0x7fb1cc1f17f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:26.450 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:26.448+0000 7fb1d0bce640 1 --2- 172.21.15.73:0/709590966 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb1cc0a56d0 0x7fb1cc1f17f0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fb1c4037040 tx=0x7fb1c4009750 comp rx=0 tx=0).stop 2023-12-12T09:44:26.450 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:26.448+0000 7fb1d0bce640 1 -- 172.21.15.73:0/709590966 shutdown_connections 2023-12-12T09:44:26.450 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:26.448+0000 7fb1d0bce640 1 --2- 172.21.15.73:0/709590966 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fb1ac06ae70 0x7fb1ac06d330 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:26.450 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:26.448+0000 7fb1d0bce640 1 --2- 172.21.15.73:0/709590966 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb1cc0a56d0 0x7fb1cc1f17f0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:26.450 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:26.448+0000 7fb1d0bce640 1 --2- 172.21.15.73:0/709590966 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb1cc151410 0x7fb1cc14bdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:26.451 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:26.448+0000 7fb1d0bce640 1 --2- 172.21.15.73:0/709590966 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb1cc151030 0x7fb1cc150350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:26.451 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:26.448+0000 7fb1d0bce640 1 -- 172.21.15.73:0/709590966 >> 172.21.15.73:0/709590966 conn(0x7fb1cc0a8130 msgr2=0x7fb1cc0c0500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:44:26.451 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:26.448+0000 7fb1d0bce640 1 -- 172.21.15.73:0/709590966 shutdown_connections 2023-12-12T09:44:26.451 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:26.448+0000 7fb1d0bce640 1 -- 172.21.15.73:0/709590966 wait complete. 2023-12-12T09:44:26.469 INFO:teuthology.orchestra.run.smithi073.stdout:{"pg_ready":true,"pg_map":{"version":63,"stamp":"2023-12-12T09:44:25.475156+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":120,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219364,"kb_used_data":3188,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755356,"statfs":{"total":773094113280,"available":772869484544,"internally_reserved":0,"allocated":3264512,"data_stored":2385432,"data_compressed":64844,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":40,"apply_latency_ms":40,"commit_latency_ns":40000000,"apply_latency_ns":40000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001808"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-12T09:44:22.686611+0000","last_change":"2023-12-12T09:44:21.521409+0000","last_active":"2023-12-12T09:44:22.686611+0000","last_peered":"2023-12-12T09:44:22.686611+0000","last_clean":"2023-12-12T09:44:22.686611+0000","last_became_active":"2023-12-12T09:44:21.520807+0000","last_became_peered":"2023-12-12T09:44:21.520807+0000","last_unstale":"2023-12-12T09:44:22.686611+0000","last_undegraded":"2023-12-12T09:44:22.686611+0000","last_fullsized":"2023-12-12T09:44:22.686611+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_clean_scrub_stamp":"2023-12-12T09:44:20.465592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T10:43:48.035299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-12T09:44:22.509764+0000","last_change":"2023-12-12T09:44:21.513912+0000","last_active":"2023-12-12T09:44:22.509764+0000","last_peered":"2023-12-12T09:44:22.509764+0000","last_clean":"2023-12-12T09:44:22.509764+0000","last_became_active":"2023-12-12T09:44:21.513624+0000","last_became_peered":"2023-12-12T09:44:21.513624+0000","last_unstale":"2023-12-12T09:44:22.509764+0000","last_undegraded":"2023-12-12T09:44:22.509764+0000","last_fullsized":"2023-12-12T09:44:22.509764+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_clean_scrub_stamp":"2023-12-12T09:44:20.465592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T14:08:30.510607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-12T09:44:22.516115+0000","last_change":"2023-12-12T09:44:21.516991+0000","last_active":"2023-12-12T09:44:22.516115+0000","last_peered":"2023-12-12T09:44:22.516115+0000","last_clean":"2023-12-12T09:44:22.516115+0000","last_became_active":"2023-12-12T09:44:21.516690+0000","last_became_peered":"2023-12-12T09:44:21.516690+0000","last_unstale":"2023-12-12T09:44:22.516115+0000","last_undegraded":"2023-12-12T09:44:22.516115+0000","last_fullsized":"2023-12-12T09:44:22.516115+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_clean_scrub_stamp":"2023-12-12T09:44:20.465592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T20:53:13.479872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-12T09:44:24.021218+0000","last_change":"2023-12-12T09:44:21.536425+0000","last_active":"2023-12-12T09:44:24.021218+0000","last_peered":"2023-12-12T09:44:24.021218+0000","last_clean":"2023-12-12T09:44:24.021218+0000","last_became_active":"2023-12-12T09:44:21.534962+0000","last_became_peered":"2023-12-12T09:44:21.534962+0000","last_unstale":"2023-12-12T09:44:24.021218+0000","last_undegraded":"2023-12-12T09:44:24.021218+0000","last_fullsized":"2023-12-12T09:44:24.021218+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_clean_scrub_stamp":"2023-12-12T09:44:20.465592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T11:40:20.775860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-12T09:44:24.021568+0000","last_change":"2023-12-12T09:44:21.517132+0000","last_active":"2023-12-12T09:44:24.021568+0000","last_peered":"2023-12-12T09:44:24.021568+0000","last_clean":"2023-12-12T09:44:24.021568+0000","last_became_active":"2023-12-12T09:44:21.516794+0000","last_became_peered":"2023-12-12T09:44:21.516794+0000","last_unstale":"2023-12-12T09:44:24.021568+0000","last_undegraded":"2023-12-12T09:44:24.021568+0000","last_fullsized":"2023-12-12T09:44:24.021568+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_clean_scrub_stamp":"2023-12-12T09:44:20.465592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T14:59:37.496347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-12T09:44:22.510245+0000","last_change":"2023-12-12T09:44:21.520418+0000","last_active":"2023-12-12T09:44:22.510245+0000","last_peered":"2023-12-12T09:44:22.510245+0000","last_clean":"2023-12-12T09:44:22.510245+0000","last_became_active":"2023-12-12T09:44:21.520070+0000","last_became_peered":"2023-12-12T09:44:21.520070+0000","last_unstale":"2023-12-12T09:44:22.510245+0000","last_undegraded":"2023-12-12T09:44:22.510245+0000","last_fullsized":"2023-12-12T09:44:22.510245+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_clean_scrub_stamp":"2023-12-12T09:44:20.465592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T20:42:57.403954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-12T09:44:22.513863+0000","last_change":"2023-12-12T09:44:21.526135+0000","last_active":"2023-12-12T09:44:22.513863+0000","last_peered":"2023-12-12T09:44:22.513863+0000","last_clean":"2023-12-12T09:44:22.513863+0000","last_became_active":"2023-12-12T09:44:21.525852+0000","last_became_peered":"2023-12-12T09:44:21.525852+0000","last_unstale":"2023-12-12T09:44:22.513863+0000","last_undegraded":"2023-12-12T09:44:22.513863+0000","last_fullsized":"2023-12-12T09:44:22.513863+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_clean_scrub_stamp":"2023-12-12T09:44:20.465592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T21:03:17.881060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-12T09:44:22.513007+0000","last_change":"2023-12-12T09:44:21.526128+0000","last_active":"2023-12-12T09:44:22.513007+0000","last_peered":"2023-12-12T09:44:22.513007+0000","last_clean":"2023-12-12T09:44:22.513007+0000","last_became_active":"2023-12-12T09:44:21.521368+0000","last_became_peered":"2023-12-12T09:44:21.521368+0000","last_unstale":"2023-12-12T09:44:22.513007+0000","last_undegraded":"2023-12-12T09:44:22.513007+0000","last_fullsized":"2023-12-12T09:44:22.513007+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_clean_scrub_stamp":"2023-12-12T09:44:20.465592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T20:58:54.834367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-12T09:44:24.020933+0000","last_change":"2023-12-12T09:44:21.531885+0000","last_active":"2023-12-12T09:44:24.020933+0000","last_peered":"2023-12-12T09:44:24.020933+0000","last_clean":"2023-12-12T09:44:24.020933+0000","last_became_active":"2023-12-12T09:44:21.531436+0000","last_became_peered":"2023-12-12T09:44:21.531436+0000","last_unstale":"2023-12-12T09:44:24.020933+0000","last_undegraded":"2023-12-12T09:44:24.020933+0000","last_fullsized":"2023-12-12T09:44:24.020933+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_clean_scrub_stamp":"2023-12-12T09:44:20.465592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T18:54:29.796762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-12T09:44:24.020933+0000","last_change":"2023-12-12T09:44:21.515196+0000","last_active":"2023-12-12T09:44:24.020933+0000","last_peered":"2023-12-12T09:44:24.020933+0000","last_clean":"2023-12-12T09:44:24.020933+0000","last_became_active":"2023-12-12T09:44:21.514944+0000","last_became_peered":"2023-12-12T09:44:21.514944+0000","last_unstale":"2023-12-12T09:44:24.020933+0000","last_undegraded":"2023-12-12T09:44:24.020933+0000","last_fullsized":"2023-12-12T09:44:24.020933+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_clean_scrub_stamp":"2023-12-12T09:44:20.465592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T14:50:35.888381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-12T09:44:22.514214+0000","last_change":"2023-12-12T09:44:21.536596+0000","last_active":"2023-12-12T09:44:22.514214+0000","last_peered":"2023-12-12T09:44:22.514214+0000","last_clean":"2023-12-12T09:44:22.514214+0000","last_became_active":"2023-12-12T09:44:21.536304+0000","last_became_peered":"2023-12-12T09:44:21.536304+0000","last_unstale":"2023-12-12T09:44:22.514214+0000","last_undegraded":"2023-12-12T09:44:22.514214+0000","last_fullsized":"2023-12-12T09:44:22.514214+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_clean_scrub_stamp":"2023-12-12T09:44:20.465592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T11:36:54.156220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-12T09:44:22.515933+0000","last_change":"2023-12-12T09:44:21.517566+0000","last_active":"2023-12-12T09:44:22.515933+0000","last_peered":"2023-12-12T09:44:22.515933+0000","last_clean":"2023-12-12T09:44:22.515933+0000","last_became_active":"2023-12-12T09:44:21.517004+0000","last_became_peered":"2023-12-12T09:44:21.517004+0000","last_unstale":"2023-12-12T09:44:22.515933+0000","last_undegraded":"2023-12-12T09:44:22.515933+0000","last_fullsized":"2023-12-12T09:44:22.515933+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_clean_scrub_stamp":"2023-12-12T09:44:20.465592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T10:50:32.155095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-12T09:44:24.021696+0000","last_change":"2023-12-12T09:44:21.510175+0000","last_active":"2023-12-12T09:44:24.021696+0000","last_peered":"2023-12-12T09:44:24.021696+0000","last_clean":"2023-12-12T09:44:24.021696+0000","last_became_active":"2023-12-12T09:44:21.509923+0000","last_became_peered":"2023-12-12T09:44:21.509923+0000","last_unstale":"2023-12-12T09:44:24.021696+0000","last_undegraded":"2023-12-12T09:44:24.021696+0000","last_fullsized":"2023-12-12T09:44:24.021696+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_clean_scrub_stamp":"2023-12-12T09:44:20.465592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T18:46:45.450477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-12T09:44:22.510035+0000","last_change":"2023-12-12T09:44:21.515103+0000","last_active":"2023-12-12T09:44:22.510035+0000","last_peered":"2023-12-12T09:44:22.510035+0000","last_clean":"2023-12-12T09:44:22.510035+0000","last_became_active":"2023-12-12T09:44:21.514438+0000","last_became_peered":"2023-12-12T09:44:21.514438+0000","last_unstale":"2023-12-12T09:44:22.510035+0000","last_undegraded":"2023-12-12T09:44:22.510035+0000","last_fullsized":"2023-12-12T09:44:22.510035+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_clean_scrub_stamp":"2023-12-12T09:44:20.465592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T18:05:42.865925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-12T09:44:22.515117+0000","last_change":"2023-12-12T09:44:21.517469+0000","last_active":"2023-12-12T09:44:22.515117+0000","last_peered":"2023-12-12T09:44:22.515117+0000","last_clean":"2023-12-12T09:44:22.515117+0000","last_became_active":"2023-12-12T09:44:21.517156+0000","last_became_peered":"2023-12-12T09:44:21.517156+0000","last_unstale":"2023-12-12T09:44:22.515117+0000","last_undegraded":"2023-12-12T09:44:22.515117+0000","last_fullsized":"2023-12-12T09:44:22.515117+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_clean_scrub_stamp":"2023-12-12T09:44:20.465592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T20:58:54.834367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-12T09:44:22.513635+0000","last_change":"2023-12-12T09:44:21.526715+0000","last_active":"2023-12-12T09:44:22.513635+0000","last_peered":"2023-12-12T09:44:22.513635+0000","last_clean":"2023-12-12T09:44:22.513635+0000","last_became_active":"2023-12-12T09:44:21.526475+0000","last_became_peered":"2023-12-12T09:44:21.526475+0000","last_unstale":"2023-12-12T09:44:22.513635+0000","last_undegraded":"2023-12-12T09:44:22.513635+0000","last_fullsized":"2023-12-12T09:44:22.513635+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_clean_scrub_stamp":"2023-12-12T09:44:20.465592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T20:53:13.479872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-12T09:44:22.514859+0000","last_change":"2023-12-12T09:44:21.524561+0000","last_active":"2023-12-12T09:44:22.514859+0000","last_peered":"2023-12-12T09:44:22.514859+0000","last_clean":"2023-12-12T09:44:22.514859+0000","last_became_active":"2023-12-12T09:44:21.524316+0000","last_became_peered":"2023-12-12T09:44:21.524316+0000","last_unstale":"2023-12-12T09:44:22.514859+0000","last_undegraded":"2023-12-12T09:44:22.514859+0000","last_fullsized":"2023-12-12T09:44:22.514859+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_clean_scrub_stamp":"2023-12-12T09:44:20.465592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T18:05:42.865925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-12T09:44:22.509834+0000","last_change":"2023-12-12T09:44:21.510970+0000","last_active":"2023-12-12T09:44:22.509834+0000","last_peered":"2023-12-12T09:44:22.509834+0000","last_clean":"2023-12-12T09:44:22.509834+0000","last_became_active":"2023-12-12T09:44:21.508875+0000","last_became_peered":"2023-12-12T09:44:21.508875+0000","last_unstale":"2023-12-12T09:44:22.509834+0000","last_undegraded":"2023-12-12T09:44:22.509834+0000","last_fullsized":"2023-12-12T09:44:22.509834+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_clean_scrub_stamp":"2023-12-12T09:44:20.465592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T11:36:54.156220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-12T09:44:22.509308+0000","last_change":"2023-12-12T09:44:21.515576+0000","last_active":"2023-12-12T09:44:22.509308+0000","last_peered":"2023-12-12T09:44:22.509308+0000","last_clean":"2023-12-12T09:44:22.509308+0000","last_became_active":"2023-12-12T09:44:21.515246+0000","last_became_peered":"2023-12-12T09:44:21.515246+0000","last_unstale":"2023-12-12T09:44:22.509308+0000","last_undegraded":"2023-12-12T09:44:22.509308+0000","last_fullsized":"2023-12-12T09:44:22.509308+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_clean_scrub_stamp":"2023-12-12T09:44:20.465592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T13:05:01.026963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-12T09:44:24.022105+0000","last_change":"2023-12-12T09:44:21.521072+0000","last_active":"2023-12-12T09:44:24.022105+0000","last_peered":"2023-12-12T09:44:24.022105+0000","last_clean":"2023-12-12T09:44:24.022105+0000","last_became_active":"2023-12-12T09:44:21.520779+0000","last_became_peered":"2023-12-12T09:44:21.520779+0000","last_unstale":"2023-12-12T09:44:24.022105+0000","last_undegraded":"2023-12-12T09:44:24.022105+0000","last_fullsized":"2023-12-12T09:44:24.022105+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_clean_scrub_stamp":"2023-12-12T09:44:20.465592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T18:50:23.713305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-12T09:44:24.020043+0000","last_change":"2023-12-12T09:44:21.524113+0000","last_active":"2023-12-12T09:44:24.020043+0000","last_peered":"2023-12-12T09:44:24.020043+0000","last_clean":"2023-12-12T09:44:24.020043+0000","last_became_active":"2023-12-12T09:44:21.523749+0000","last_became_peered":"2023-12-12T09:44:21.523749+0000","last_unstale":"2023-12-12T09:44:24.020043+0000","last_undegraded":"2023-12-12T09:44:24.020043+0000","last_fullsized":"2023-12-12T09:44:24.020043+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_clean_scrub_stamp":"2023-12-12T09:44:20.465592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T21:19:34.161140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-12T09:44:24.020967+0000","last_change":"2023-12-12T09:44:21.507419+0000","last_active":"2023-12-12T09:44:24.020967+0000","last_peered":"2023-12-12T09:44:24.020967+0000","last_clean":"2023-12-12T09:44:24.020967+0000","last_became_active":"2023-12-12T09:44:21.507005+0000","last_became_peered":"2023-12-12T09:44:21.507005+0000","last_unstale":"2023-12-12T09:44:24.020967+0000","last_undegraded":"2023-12-12T09:44:24.020967+0000","last_fullsized":"2023-12-12T09:44:24.020967+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_clean_scrub_stamp":"2023-12-12T09:44:20.465592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T14:50:35.888381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-12T09:44:24.019206+0000","last_change":"2023-12-12T09:44:21.522714+0000","last_active":"2023-12-12T09:44:24.019206+0000","last_peered":"2023-12-12T09:44:24.019206+0000","last_clean":"2023-12-12T09:44:24.019206+0000","last_became_active":"2023-12-12T09:44:21.519272+0000","last_became_peered":"2023-12-12T09:44:21.519272+0000","last_unstale":"2023-12-12T09:44:24.019206+0000","last_undegraded":"2023-12-12T09:44:24.019206+0000","last_fullsized":"2023-12-12T09:44:24.019206+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_clean_scrub_stamp":"2023-12-12T09:44:20.465592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T21:42:36.877781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-12T09:44:22.515006+0000","last_change":"2023-12-12T09:44:21.519677+0000","last_active":"2023-12-12T09:44:22.515006+0000","last_peered":"2023-12-12T09:44:22.515006+0000","last_clean":"2023-12-12T09:44:22.515006+0000","last_became_active":"2023-12-12T09:44:21.519364+0000","last_became_peered":"2023-12-12T09:44:21.519364+0000","last_unstale":"2023-12-12T09:44:22.515006+0000","last_undegraded":"2023-12-12T09:44:22.515006+0000","last_fullsized":"2023-12-12T09:44:22.515006+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_clean_scrub_stamp":"2023-12-12T09:44:20.465592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T11:40:20.775860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-12T09:44:24.022778+0000","last_change":"2023-12-12T09:44:21.526204+0000","last_active":"2023-12-12T09:44:24.022778+0000","last_peered":"2023-12-12T09:44:24.022778+0000","last_clean":"2023-12-12T09:44:24.022778+0000","last_became_active":"2023-12-12T09:44:21.525855+0000","last_became_peered":"2023-12-12T09:44:21.525855+0000","last_unstale":"2023-12-12T09:44:24.022778+0000","last_undegraded":"2023-12-12T09:44:24.022778+0000","last_fullsized":"2023-12-12T09:44:24.022778+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_clean_scrub_stamp":"2023-12-12T09:44:20.465592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T10:03:17.158642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-12T09:44:22.510146+0000","last_change":"2023-12-12T09:44:21.522457+0000","last_active":"2023-12-12T09:44:22.510146+0000","last_peered":"2023-12-12T09:44:22.510146+0000","last_clean":"2023-12-12T09:44:22.510146+0000","last_became_active":"2023-12-12T09:44:21.522168+0000","last_became_peered":"2023-12-12T09:44:21.522168+0000","last_unstale":"2023-12-12T09:44:22.510146+0000","last_undegraded":"2023-12-12T09:44:22.510146+0000","last_fullsized":"2023-12-12T09:44:22.510146+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_clean_scrub_stamp":"2023-12-12T09:44:20.465592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T11:42:56.191775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-12T09:44:24.021839+0000","last_change":"2023-12-12T09:44:21.532041+0000","last_active":"2023-12-12T09:44:24.021839+0000","last_peered":"2023-12-12T09:44:24.021839+0000","last_clean":"2023-12-12T09:44:24.021839+0000","last_became_active":"2023-12-12T09:44:21.531731+0000","last_became_peered":"2023-12-12T09:44:21.531731+0000","last_unstale":"2023-12-12T09:44:24.021839+0000","last_undegraded":"2023-12-12T09:44:24.021839+0000","last_fullsized":"2023-12-12T09:44:24.021839+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_clean_scrub_stamp":"2023-12-12T09:44:20.465592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T12:21:37.296506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-12T09:44:22.516135+0000","last_change":"2023-12-12T09:44:21.517720+0000","last_active":"2023-12-12T09:44:22.516135+0000","last_peered":"2023-12-12T09:44:22.516135+0000","last_clean":"2023-12-12T09:44:22.516135+0000","last_became_active":"2023-12-12T09:44:21.517332+0000","last_became_peered":"2023-12-12T09:44:21.517332+0000","last_unstale":"2023-12-12T09:44:22.516135+0000","last_undegraded":"2023-12-12T09:44:22.516135+0000","last_fullsized":"2023-12-12T09:44:22.516135+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_clean_scrub_stamp":"2023-12-12T09:44:20.465592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T13:05:01.026963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-12T09:44:24.020721+0000","last_change":"2023-12-12T09:44:21.529115+0000","last_active":"2023-12-12T09:44:24.020721+0000","last_peered":"2023-12-12T09:44:24.020721+0000","last_clean":"2023-12-12T09:44:24.020721+0000","last_became_active":"2023-12-12T09:44:21.528843+0000","last_became_peered":"2023-12-12T09:44:21.528843+0000","last_unstale":"2023-12-12T09:44:24.020721+0000","last_undegraded":"2023-12-12T09:44:24.020721+0000","last_fullsized":"2023-12-12T09:44:24.020721+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_clean_scrub_stamp":"2023-12-12T09:44:20.465592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T12:38:15.250056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-12T09:44:22.513416+0000","last_change":"2023-12-12T09:44:21.525189+0000","last_active":"2023-12-12T09:44:22.513416+0000","last_peered":"2023-12-12T09:44:22.513416+0000","last_clean":"2023-12-12T09:44:22.513416+0000","last_became_active":"2023-12-12T09:44:21.524872+0000","last_became_peered":"2023-12-12T09:44:21.524872+0000","last_unstale":"2023-12-12T09:44:22.513416+0000","last_undegraded":"2023-12-12T09:44:22.513416+0000","last_fullsized":"2023-12-12T09:44:22.513416+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_clean_scrub_stamp":"2023-12-12T09:44:20.465592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T10:03:17.158642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-12T09:44:22.686183+0000","last_change":"2023-12-12T09:44:21.511525+0000","last_active":"2023-12-12T09:44:22.686183+0000","last_peered":"2023-12-12T09:44:22.686183+0000","last_clean":"2023-12-12T09:44:22.686183+0000","last_became_active":"2023-12-12T09:44:21.511270+0000","last_became_peered":"2023-12-12T09:44:21.511270+0000","last_unstale":"2023-12-12T09:44:22.686183+0000","last_undegraded":"2023-12-12T09:44:22.686183+0000","last_fullsized":"2023-12-12T09:44:22.686183+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_clean_scrub_stamp":"2023-12-12T09:44:20.465592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T12:00:33.415612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-12T09:44:22.513103+0000","last_change":"2023-12-12T09:44:21.533072+0000","last_active":"2023-12-12T09:44:22.513103+0000","last_peered":"2023-12-12T09:44:22.513103+0000","last_clean":"2023-12-12T09:44:22.513103+0000","last_became_active":"2023-12-12T09:44:21.532524+0000","last_became_peered":"2023-12-12T09:44:21.532524+0000","last_unstale":"2023-12-12T09:44:22.513103+0000","last_undegraded":"2023-12-12T09:44:22.513103+0000","last_fullsized":"2023-12-12T09:44:22.513103+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_clean_scrub_stamp":"2023-12-12T09:44:20.465592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T12:21:37.296506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-12T09:44:24.020168+0000","last_change":"2023-12-12T09:44:21.520102+0000","last_active":"2023-12-12T09:44:24.020168+0000","last_peered":"2023-12-12T09:44:24.020168+0000","last_clean":"2023-12-12T09:44:24.020168+0000","last_became_active":"2023-12-12T09:44:21.517595+0000","last_became_peered":"2023-12-12T09:44:21.517595+0000","last_unstale":"2023-12-12T09:44:24.020168+0000","last_undegraded":"2023-12-12T09:44:24.020168+0000","last_fullsized":"2023-12-12T09:44:24.020168+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_clean_scrub_stamp":"2023-12-12T09:44:20.465592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T12:07:42.924447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"33'4","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-12T09:44:21.521245+0000","last_change":"2023-12-12T09:44:20.514272+0000","last_active":"2023-12-12T09:44:21.521245+0000","last_peered":"2023-12-12T09:44:21.521245+0000","last_clean":"2023-12-12T09:44:21.521245+0000","last_became_active":"2023-12-12T09:44:20.513997+0000","last_became_peered":"2023-12-12T09:44:20.513997+0000","last_unstale":"2023-12-12T09:44:21.521245+0000","last_undegraded":"2023-12-12T09:44:21.521245+0000","last_fullsized":"2023-12-12T09:44:21.521245+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:19.449520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:19.449520+0000","last_clean_scrub_stamp":"2023-12-12T09:44:19.449520+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T16:36:32.055010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-12T09:44:22.686533+0000","last_change":"2023-12-12T09:44:21.535215+0000","last_active":"2023-12-12T09:44:22.686533+0000","last_peered":"2023-12-12T09:44:22.686533+0000","last_clean":"2023-12-12T09:44:22.686533+0000","last_became_active":"2023-12-12T09:44:21.534935+0000","last_became_peered":"2023-12-12T09:44:21.534935+0000","last_unstale":"2023-12-12T09:44:22.686533+0000","last_undegraded":"2023-12-12T09:44:22.686533+0000","last_fullsized":"2023-12-12T09:44:22.686533+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_clean_scrub_stamp":"2023-12-12T09:44:20.465592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T21:19:34.161140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"33'1","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-12T09:44:21.517240+0000","last_change":"2023-12-12T09:44:20.512943+0000","last_active":"2023-12-12T09:44:21.517240+0000","last_peered":"2023-12-12T09:44:21.517240+0000","last_clean":"2023-12-12T09:44:21.517240+0000","last_became_active":"2023-12-12T09:44:20.512655+0000","last_became_peered":"2023-12-12T09:44:20.512655+0000","last_unstale":"2023-12-12T09:44:21.517240+0000","last_undegraded":"2023-12-12T09:44:21.517240+0000","last_fullsized":"2023-12-12T09:44:21.517240+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:19.449520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:19.449520+0000","last_clean_scrub_stamp":"2023-12-12T09:44:19.449520+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T20:21:31.990503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-12T09:44:24.020668+0000","last_change":"2023-12-12T09:44:21.531214+0000","last_active":"2023-12-12T09:44:24.020668+0000","last_peered":"2023-12-12T09:44:24.020668+0000","last_clean":"2023-12-12T09:44:24.020668+0000","last_became_active":"2023-12-12T09:44:21.530559+0000","last_became_peered":"2023-12-12T09:44:21.530559+0000","last_unstale":"2023-12-12T09:44:24.020668+0000","last_undegraded":"2023-12-12T09:44:24.020668+0000","last_fullsized":"2023-12-12T09:44:24.020668+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_clean_scrub_stamp":"2023-12-12T09:44:20.465592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T12:07:42.924447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"33'2","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-12T09:44:21.532618+0000","last_change":"2023-12-12T09:44:20.505973+0000","last_active":"2023-12-12T09:44:21.532618+0000","last_peered":"2023-12-12T09:44:21.532618+0000","last_clean":"2023-12-12T09:44:21.532618+0000","last_became_active":"2023-12-12T09:44:20.505716+0000","last_became_peered":"2023-12-12T09:44:20.505716+0000","last_unstale":"2023-12-12T09:44:21.532618+0000","last_undegraded":"2023-12-12T09:44:21.532618+0000","last_fullsized":"2023-12-12T09:44:21.532618+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:19.449520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:19.449520+0000","last_clean_scrub_stamp":"2023-12-12T09:44:19.449520+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T14:50:34.872309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-12T09:44:24.022148+0000","last_change":"2023-12-12T09:44:21.531916+0000","last_active":"2023-12-12T09:44:24.022148+0000","last_peered":"2023-12-12T09:44:24.022148+0000","last_clean":"2023-12-12T09:44:24.022148+0000","last_became_active":"2023-12-12T09:44:21.531595+0000","last_became_peered":"2023-12-12T09:44:21.531595+0000","last_unstale":"2023-12-12T09:44:24.022148+0000","last_undegraded":"2023-12-12T09:44:24.022148+0000","last_fullsized":"2023-12-12T09:44:24.022148+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_clean_scrub_stamp":"2023-12-12T09:44:20.465592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T12:23:17.141227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"33'2","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-12T09:44:21.532628+0000","last_change":"2023-12-12T09:44:20.509167+0000","last_active":"2023-12-12T09:44:21.532628+0000","last_peered":"2023-12-12T09:44:21.532628+0000","last_clean":"2023-12-12T09:44:21.532628+0000","last_became_active":"2023-12-12T09:44:20.508808+0000","last_became_peered":"2023-12-12T09:44:20.508808+0000","last_unstale":"2023-12-12T09:44:21.532628+0000","last_undegraded":"2023-12-12T09:44:21.532628+0000","last_fullsized":"2023-12-12T09:44:21.532628+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:19.449520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:19.449520+0000","last_clean_scrub_stamp":"2023-12-12T09:44:19.449520+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T18:14:15.788144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-12T09:44:22.514010+0000","last_change":"2023-12-12T09:44:21.532639+0000","last_active":"2023-12-12T09:44:22.514010+0000","last_peered":"2023-12-12T09:44:22.514010+0000","last_clean":"2023-12-12T09:44:22.514010+0000","last_became_active":"2023-12-12T09:44:21.532369+0000","last_became_peered":"2023-12-12T09:44:21.532369+0000","last_unstale":"2023-12-12T09:44:22.514010+0000","last_undegraded":"2023-12-12T09:44:22.514010+0000","last_fullsized":"2023-12-12T09:44:22.514010+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_clean_scrub_stamp":"2023-12-12T09:44:20.465592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T14:08:30.510607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"33'1","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-12T09:44:21.535515+0000","last_change":"2023-12-12T09:44:20.506547+0000","last_active":"2023-12-12T09:44:21.535515+0000","last_peered":"2023-12-12T09:44:21.535515+0000","last_clean":"2023-12-12T09:44:21.535515+0000","last_became_active":"2023-12-12T09:44:20.506207+0000","last_became_peered":"2023-12-12T09:44:20.506207+0000","last_unstale":"2023-12-12T09:44:21.535515+0000","last_undegraded":"2023-12-12T09:44:21.535515+0000","last_fullsized":"2023-12-12T09:44:21.535515+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:19.449520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:19.449520+0000","last_clean_scrub_stamp":"2023-12-12T09:44:19.449520+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T21:18:35.916411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-12T09:44:22.515617+0000","last_change":"2023-12-12T09:44:21.510952+0000","last_active":"2023-12-12T09:44:22.515617+0000","last_peered":"2023-12-12T09:44:22.515617+0000","last_clean":"2023-12-12T09:44:22.515617+0000","last_became_active":"2023-12-12T09:44:21.510672+0000","last_became_peered":"2023-12-12T09:44:21.510672+0000","last_unstale":"2023-12-12T09:44:22.515617+0000","last_undegraded":"2023-12-12T09:44:22.515617+0000","last_fullsized":"2023-12-12T09:44:22.515617+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_clean_scrub_stamp":"2023-12-12T09:44:20.465592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T12:21:37.296506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"33'1","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-12T09:44:21.529396+0000","last_change":"2023-12-12T09:44:20.507138+0000","last_active":"2023-12-12T09:44:21.529396+0000","last_peered":"2023-12-12T09:44:21.529396+0000","last_clean":"2023-12-12T09:44:21.529396+0000","last_became_active":"2023-12-12T09:44:20.506706+0000","last_became_peered":"2023-12-12T09:44:20.506706+0000","last_unstale":"2023-12-12T09:44:21.529396+0000","last_undegraded":"2023-12-12T09:44:21.529396+0000","last_fullsized":"2023-12-12T09:44:21.529396+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:19.449520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:19.449520+0000","last_clean_scrub_stamp":"2023-12-12T09:44:19.449520+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T14:59:36.480275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-12T09:44:24.020131+0000","last_change":"2023-12-12T09:44:21.528208+0000","last_active":"2023-12-12T09:44:24.020131+0000","last_peered":"2023-12-12T09:44:24.020131+0000","last_clean":"2023-12-12T09:44:24.020131+0000","last_became_active":"2023-12-12T09:44:21.524386+0000","last_became_peered":"2023-12-12T09:44:21.524386+0000","last_unstale":"2023-12-12T09:44:24.020131+0000","last_undegraded":"2023-12-12T09:44:24.020131+0000","last_fullsized":"2023-12-12T09:44:24.020131+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_clean_scrub_stamp":"2023-12-12T09:44:20.465592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T10:43:48.035299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-12T09:44:21.495485+0000","last_change":"2023-12-12T09:44:20.510572+0000","last_active":"2023-12-12T09:44:21.495485+0000","last_peered":"2023-12-12T09:44:21.495485+0000","last_clean":"2023-12-12T09:44:21.495485+0000","last_became_active":"2023-12-12T09:44:20.510324+0000","last_became_peered":"2023-12-12T09:44:20.510324+0000","last_unstale":"2023-12-12T09:44:21.495485+0000","last_undegraded":"2023-12-12T09:44:21.495485+0000","last_fullsized":"2023-12-12T09:44:21.495485+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:19.449520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:19.449520+0000","last_clean_scrub_stamp":"2023-12-12T09:44:19.449520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T12:38:14.233984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-12T09:44:24.020767+0000","last_change":"2023-12-12T09:44:21.520960+0000","last_active":"2023-12-12T09:44:24.020767+0000","last_peered":"2023-12-12T09:44:24.020767+0000","last_clean":"2023-12-12T09:44:24.020767+0000","last_became_active":"2023-12-12T09:44:21.520630+0000","last_became_peered":"2023-12-12T09:44:21.520630+0000","last_unstale":"2023-12-12T09:44:24.020767+0000","last_undegraded":"2023-12-12T09:44:24.020767+0000","last_fullsized":"2023-12-12T09:44:24.020767+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_clean_scrub_stamp":"2023-12-12T09:44:20.465592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T18:54:29.796762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-12T09:44:21.494190+0000","last_change":"2023-12-12T09:44:20.516411+0000","last_active":"2023-12-12T09:44:21.494190+0000","last_peered":"2023-12-12T09:44:21.494190+0000","last_clean":"2023-12-12T09:44:21.494190+0000","last_became_active":"2023-12-12T09:44:20.516143+0000","last_became_peered":"2023-12-12T09:44:20.516143+0000","last_unstale":"2023-12-12T09:44:21.494190+0000","last_undegraded":"2023-12-12T09:44:21.494190+0000","last_fullsized":"2023-12-12T09:44:21.494190+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:19.449520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:19.449520+0000","last_clean_scrub_stamp":"2023-12-12T09:44:19.449520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T20:16:12.578797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-12T09:44:22.516476+0000","last_change":"2023-12-12T09:44:21.516583+0000","last_active":"2023-12-12T09:44:22.516476+0000","last_peered":"2023-12-12T09:44:22.516476+0000","last_clean":"2023-12-12T09:44:22.516476+0000","last_became_active":"2023-12-12T09:44:21.515986+0000","last_became_peered":"2023-12-12T09:44:21.515986+0000","last_unstale":"2023-12-12T09:44:22.516476+0000","last_undegraded":"2023-12-12T09:44:22.516476+0000","last_fullsized":"2023-12-12T09:44:22.516476+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_clean_scrub_stamp":"2023-12-12T09:44:20.465592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T14:08:30.510607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-12T09:44:21.496356+0000","last_change":"2023-12-12T09:44:20.515405+0000","last_active":"2023-12-12T09:44:21.496356+0000","last_peered":"2023-12-12T09:44:21.496356+0000","last_clean":"2023-12-12T09:44:21.496356+0000","last_became_active":"2023-12-12T09:44:20.515184+0000","last_became_peered":"2023-12-12T09:44:20.515184+0000","last_unstale":"2023-12-12T09:44:21.496356+0000","last_undegraded":"2023-12-12T09:44:21.496356+0000","last_fullsized":"2023-12-12T09:44:21.496356+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:19.449520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:19.449520+0000","last_clean_scrub_stamp":"2023-12-12T09:44:19.449520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T11:40:19.759789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-12T09:44:22.509556+0000","last_change":"2023-12-12T09:44:21.528120+0000","last_active":"2023-12-12T09:44:22.509556+0000","last_peered":"2023-12-12T09:44:22.509556+0000","last_clean":"2023-12-12T09:44:22.509556+0000","last_became_active":"2023-12-12T09:44:21.527860+0000","last_became_peered":"2023-12-12T09:44:21.527860+0000","last_unstale":"2023-12-12T09:44:22.509556+0000","last_undegraded":"2023-12-12T09:44:22.509556+0000","last_fullsized":"2023-12-12T09:44:22.509556+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_clean_scrub_stamp":"2023-12-12T09:44:20.465592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T21:03:17.881060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-12T09:44:21.488771+0000","last_change":"2023-12-12T09:44:20.505493+0000","last_active":"2023-12-12T09:44:21.488771+0000","last_peered":"2023-12-12T09:44:21.488771+0000","last_clean":"2023-12-12T09:44:21.488771+0000","last_became_active":"2023-12-12T09:44:20.503452+0000","last_became_peered":"2023-12-12T09:44:20.503452+0000","last_unstale":"2023-12-12T09:44:21.488771+0000","last_undegraded":"2023-12-12T09:44:21.488771+0000","last_fullsized":"2023-12-12T09:44:21.488771+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:19.449520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:19.449520+0000","last_clean_scrub_stamp":"2023-12-12T09:44:19.449520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T19:38:07.725951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-12T09:44:22.509198+0000","last_change":"2023-12-12T09:44:21.515459+0000","last_active":"2023-12-12T09:44:22.509198+0000","last_peered":"2023-12-12T09:44:22.509198+0000","last_clean":"2023-12-12T09:44:22.509198+0000","last_became_active":"2023-12-12T09:44:21.515182+0000","last_became_peered":"2023-12-12T09:44:21.515182+0000","last_unstale":"2023-12-12T09:44:22.509198+0000","last_undegraded":"2023-12-12T09:44:22.509198+0000","last_fullsized":"2023-12-12T09:44:22.509198+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_clean_scrub_stamp":"2023-12-12T09:44:20.465592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T20:53:13.479872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"33'3","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-12T09:44:21.524147+0000","last_change":"2023-12-12T09:44:20.516043+0000","last_active":"2023-12-12T09:44:21.524147+0000","last_peered":"2023-12-12T09:44:21.524147+0000","last_clean":"2023-12-12T09:44:21.524147+0000","last_became_active":"2023-12-12T09:44:20.515717+0000","last_became_peered":"2023-12-12T09:44:20.515717+0000","last_unstale":"2023-12-12T09:44:21.524147+0000","last_undegraded":"2023-12-12T09:44:21.524147+0000","last_fullsized":"2023-12-12T09:44:21.524147+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:19.449520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:19.449520+0000","last_clean_scrub_stamp":"2023-12-12T09:44:19.449520+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T12:38:14.233984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-12T09:44:22.515625+0000","last_change":"2023-12-12T09:44:21.514238+0000","last_active":"2023-12-12T09:44:22.515625+0000","last_peered":"2023-12-12T09:44:22.515625+0000","last_clean":"2023-12-12T09:44:22.515625+0000","last_became_active":"2023-12-12T09:44:21.513900+0000","last_became_peered":"2023-12-12T09:44:21.513900+0000","last_unstale":"2023-12-12T09:44:22.515625+0000","last_undegraded":"2023-12-12T09:44:22.515625+0000","last_fullsized":"2023-12-12T09:44:22.515625+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_clean_scrub_stamp":"2023-12-12T09:44:20.465592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T12:23:17.141227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"33'6","reported_seq":18,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-12T09:44:21.541926+0000","last_change":"2023-12-12T09:44:20.509723+0000","last_active":"2023-12-12T09:44:21.541926+0000","last_peered":"2023-12-12T09:44:21.541926+0000","last_clean":"2023-12-12T09:44:21.541926+0000","last_became_active":"2023-12-12T09:44:20.509311+0000","last_became_peered":"2023-12-12T09:44:20.509311+0000","last_unstale":"2023-12-12T09:44:21.541926+0000","last_undegraded":"2023-12-12T09:44:21.541926+0000","last_fullsized":"2023-12-12T09:44:21.541926+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:19.449520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:19.449520+0000","last_clean_scrub_stamp":"2023-12-12T09:44:19.449520+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T20:58:53.818296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-12T09:44:24.020444+0000","last_change":"2023-12-12T09:44:21.522639+0000","last_active":"2023-12-12T09:44:24.020444+0000","last_peered":"2023-12-12T09:44:24.020444+0000","last_clean":"2023-12-12T09:44:24.020444+0000","last_became_active":"2023-12-12T09:44:21.522313+0000","last_became_peered":"2023-12-12T09:44:21.522313+0000","last_unstale":"2023-12-12T09:44:24.020444+0000","last_undegraded":"2023-12-12T09:44:24.020444+0000","last_fullsized":"2023-12-12T09:44:24.020444+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_clean_scrub_stamp":"2023-12-12T09:44:20.465592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T12:38:15.250056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"33'2","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-12T09:44:21.534665+0000","last_change":"2023-12-12T09:44:20.516223+0000","last_active":"2023-12-12T09:44:21.534665+0000","last_peered":"2023-12-12T09:44:21.534665+0000","last_clean":"2023-12-12T09:44:21.534665+0000","last_became_active":"2023-12-12T09:44:20.515976+0000","last_became_peered":"2023-12-12T09:44:20.515976+0000","last_unstale":"2023-12-12T09:44:21.534665+0000","last_undegraded":"2023-12-12T09:44:21.534665+0000","last_fullsized":"2023-12-12T09:44:21.534665+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:19.449520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:19.449520+0000","last_clean_scrub_stamp":"2023-12-12T09:44:19.449520+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T16:04:09.402682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-12T09:44:22.510253+0000","last_change":"2023-12-12T09:44:21.498629+0000","last_active":"2023-12-12T09:44:22.510253+0000","last_peered":"2023-12-12T09:44:22.510253+0000","last_clean":"2023-12-12T09:44:22.510253+0000","last_became_active":"2023-12-12T09:44:21.498281+0000","last_became_peered":"2023-12-12T09:44:21.498281+0000","last_unstale":"2023-12-12T09:44:22.510253+0000","last_undegraded":"2023-12-12T09:44:22.510253+0000","last_fullsized":"2023-12-12T09:44:22.510253+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_clean_scrub_stamp":"2023-12-12T09:44:20.465592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T15:26:37.478870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-12T09:44:21.498015+0000","last_change":"2023-12-12T09:44:20.513932+0000","last_active":"2023-12-12T09:44:21.498015+0000","last_peered":"2023-12-12T09:44:21.498015+0000","last_clean":"2023-12-12T09:44:21.498015+0000","last_became_active":"2023-12-12T09:44:20.513676+0000","last_became_peered":"2023-12-12T09:44:20.513676+0000","last_unstale":"2023-12-12T09:44:21.498015+0000","last_undegraded":"2023-12-12T09:44:21.498015+0000","last_fullsized":"2023-12-12T09:44:21.498015+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:19.449520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:19.449520+0000","last_clean_scrub_stamp":"2023-12-12T09:44:19.449520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T19:16:24.812720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-12T09:44:22.513406+0000","last_change":"2023-12-12T09:44:21.532046+0000","last_active":"2023-12-12T09:44:22.513406+0000","last_peered":"2023-12-12T09:44:22.513406+0000","last_clean":"2023-12-12T09:44:22.513406+0000","last_became_active":"2023-12-12T09:44:21.531801+0000","last_became_peered":"2023-12-12T09:44:21.531801+0000","last_unstale":"2023-12-12T09:44:22.513406+0000","last_undegraded":"2023-12-12T09:44:22.513406+0000","last_fullsized":"2023-12-12T09:44:22.513406+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_clean_scrub_stamp":"2023-12-12T09:44:20.465592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T12:23:17.141227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-12T09:44:21.495413+0000","last_change":"2023-12-12T09:44:20.514956+0000","last_active":"2023-12-12T09:44:21.495413+0000","last_peered":"2023-12-12T09:44:21.495413+0000","last_clean":"2023-12-12T09:44:21.495413+0000","last_became_active":"2023-12-12T09:44:20.513186+0000","last_became_peered":"2023-12-12T09:44:20.513186+0000","last_unstale":"2023-12-12T09:44:21.495413+0000","last_undegraded":"2023-12-12T09:44:21.495413+0000","last_fullsized":"2023-12-12T09:44:21.495413+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:19.449520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:19.449520+0000","last_clean_scrub_stamp":"2023-12-12T09:44:19.449520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T12:49:11.267636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-12T09:44:22.686230+0000","last_change":"2023-12-12T09:44:21.531855+0000","last_active":"2023-12-12T09:44:22.686230+0000","last_peered":"2023-12-12T09:44:22.686230+0000","last_clean":"2023-12-12T09:44:22.686230+0000","last_became_active":"2023-12-12T09:44:21.531294+0000","last_became_peered":"2023-12-12T09:44:21.531294+0000","last_unstale":"2023-12-12T09:44:22.686230+0000","last_undegraded":"2023-12-12T09:44:22.686230+0000","last_fullsized":"2023-12-12T09:44:22.686230+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_clean_scrub_stamp":"2023-12-12T09:44:20.465592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T21:42:36.877781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"33'8","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-12T09:44:21.529853+0000","last_change":"2023-12-12T09:44:20.505770+0000","last_active":"2023-12-12T09:44:21.529853+0000","last_peered":"2023-12-12T09:44:21.529853+0000","last_clean":"2023-12-12T09:44:21.529853+0000","last_became_active":"2023-12-12T09:44:20.505511+0000","last_became_peered":"2023-12-12T09:44:20.505511+0000","last_unstale":"2023-12-12T09:44:21.529853+0000","last_undegraded":"2023-12-12T09:44:21.529853+0000","last_fullsized":"2023-12-12T09:44:21.529853+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:19.449520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:19.449520+0000","last_clean_scrub_stamp":"2023-12-12T09:44:19.449520+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T12:23:16.125156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-12T09:44:24.020681+0000","last_change":"2023-12-12T09:44:21.530767+0000","last_active":"2023-12-12T09:44:24.020681+0000","last_peered":"2023-12-12T09:44:24.020681+0000","last_clean":"2023-12-12T09:44:24.020681+0000","last_became_active":"2023-12-12T09:44:21.530072+0000","last_became_peered":"2023-12-12T09:44:21.530072+0000","last_unstale":"2023-12-12T09:44:24.020681+0000","last_undegraded":"2023-12-12T09:44:24.020681+0000","last_fullsized":"2023-12-12T09:44:24.020681+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_clean_scrub_stamp":"2023-12-12T09:44:20.465592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T12:49:12.283708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"33'1","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-12T09:44:21.535871+0000","last_change":"2023-12-12T09:44:20.505080+0000","last_active":"2023-12-12T09:44:21.535871+0000","last_peered":"2023-12-12T09:44:21.535871+0000","last_clean":"2023-12-12T09:44:21.535871+0000","last_became_active":"2023-12-12T09:44:20.504727+0000","last_became_peered":"2023-12-12T09:44:20.504727+0000","last_unstale":"2023-12-12T09:44:21.535871+0000","last_undegraded":"2023-12-12T09:44:21.535871+0000","last_fullsized":"2023-12-12T09:44:21.535871+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:19.449520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:19.449520+0000","last_clean_scrub_stamp":"2023-12-12T09:44:19.449520+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T12:07:41.908376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-12T09:44:22.515709+0000","last_change":"2023-12-12T09:44:21.528910+0000","last_active":"2023-12-12T09:44:22.515709+0000","last_peered":"2023-12-12T09:44:22.515709+0000","last_clean":"2023-12-12T09:44:22.515709+0000","last_became_active":"2023-12-12T09:44:21.528597+0000","last_became_peered":"2023-12-12T09:44:21.528597+0000","last_unstale":"2023-12-12T09:44:22.515709+0000","last_undegraded":"2023-12-12T09:44:22.515709+0000","last_fullsized":"2023-12-12T09:44:22.515709+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_clean_scrub_stamp":"2023-12-12T09:44:20.465592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T10:03:17.158642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"33'2","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-12T09:44:21.531013+0000","last_change":"2023-12-12T09:44:20.516846+0000","last_active":"2023-12-12T09:44:21.531013+0000","last_peered":"2023-12-12T09:44:21.531013+0000","last_clean":"2023-12-12T09:44:21.531013+0000","last_became_active":"2023-12-12T09:44:20.514593+0000","last_became_peered":"2023-12-12T09:44:20.514593+0000","last_unstale":"2023-12-12T09:44:21.531013+0000","last_undegraded":"2023-12-12T09:44:21.531013+0000","last_fullsized":"2023-12-12T09:44:21.531013+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:19.449520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:19.449520+0000","last_clean_scrub_stamp":"2023-12-12T09:44:19.449520+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T16:36:32.055010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-12T09:44:24.021580+0000","last_change":"2023-12-12T09:44:21.536677+0000","last_active":"2023-12-12T09:44:24.021580+0000","last_peered":"2023-12-12T09:44:24.021580+0000","last_clean":"2023-12-12T09:44:24.021580+0000","last_became_active":"2023-12-12T09:44:21.535741+0000","last_became_peered":"2023-12-12T09:44:21.535741+0000","last_unstale":"2023-12-12T09:44:24.021580+0000","last_undegraded":"2023-12-12T09:44:24.021580+0000","last_fullsized":"2023-12-12T09:44:24.021580+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_clean_scrub_stamp":"2023-12-12T09:44:20.465592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T20:58:54.834367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"33'1","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-12T09:44:21.535209+0000","last_change":"2023-12-12T09:44:20.511043+0000","last_active":"2023-12-12T09:44:21.535209+0000","last_peered":"2023-12-12T09:44:21.535209+0000","last_clean":"2023-12-12T09:44:21.535209+0000","last_became_active":"2023-12-12T09:44:20.510215+0000","last_became_peered":"2023-12-12T09:44:20.510215+0000","last_unstale":"2023-12-12T09:44:21.535209+0000","last_undegraded":"2023-12-12T09:44:21.535209+0000","last_fullsized":"2023-12-12T09:44:21.535209+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:19.449520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:19.449520+0000","last_clean_scrub_stamp":"2023-12-12T09:44:19.449520+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T19:16:24.812720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-12T09:44:24.021650+0000","last_change":"2023-12-12T09:44:21.508894+0000","last_active":"2023-12-12T09:44:24.021650+0000","last_peered":"2023-12-12T09:44:24.021650+0000","last_clean":"2023-12-12T09:44:24.021650+0000","last_became_active":"2023-12-12T09:44:21.508640+0000","last_became_peered":"2023-12-12T09:44:21.508640+0000","last_unstale":"2023-12-12T09:44:24.021650+0000","last_undegraded":"2023-12-12T09:44:24.021650+0000","last_fullsized":"2023-12-12T09:44:24.021650+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_clean_scrub_stamp":"2023-12-12T09:44:20.465592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T20:16:13.594869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-12T09:44:21.499026+0000","last_change":"2023-12-12T09:44:20.507016+0000","last_active":"2023-12-12T09:44:21.499026+0000","last_peered":"2023-12-12T09:44:21.499026+0000","last_clean":"2023-12-12T09:44:21.499026+0000","last_became_active":"2023-12-12T09:44:20.506728+0000","last_became_peered":"2023-12-12T09:44:20.506728+0000","last_unstale":"2023-12-12T09:44:21.499026+0000","last_undegraded":"2023-12-12T09:44:21.499026+0000","last_fullsized":"2023-12-12T09:44:21.499026+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:19.449520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:19.449520+0000","last_clean_scrub_stamp":"2023-12-12T09:44:19.449520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T20:21:31.990503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-12T09:44:24.021425+0000","last_change":"2023-12-12T09:44:21.529516+0000","last_active":"2023-12-12T09:44:24.021425+0000","last_peered":"2023-12-12T09:44:24.021425+0000","last_clean":"2023-12-12T09:44:24.021425+0000","last_became_active":"2023-12-12T09:44:21.528160+0000","last_became_peered":"2023-12-12T09:44:21.528160+0000","last_unstale":"2023-12-12T09:44:24.021425+0000","last_undegraded":"2023-12-12T09:44:24.021425+0000","last_fullsized":"2023-12-12T09:44:24.021425+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_clean_scrub_stamp":"2023-12-12T09:44:20.465592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T19:57:06.191557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"33'2","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-12T09:44:21.515512+0000","last_change":"2023-12-12T09:44:20.506834+0000","last_active":"2023-12-12T09:44:21.515512+0000","last_peered":"2023-12-12T09:44:21.515512+0000","last_clean":"2023-12-12T09:44:21.515512+0000","last_became_active":"2023-12-12T09:44:20.506432+0000","last_became_peered":"2023-12-12T09:44:20.506432+0000","last_unstale":"2023-12-12T09:44:21.515512+0000","last_undegraded":"2023-12-12T09:44:21.515512+0000","last_fullsized":"2023-12-12T09:44:21.515512+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:19.449520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:19.449520+0000","last_clean_scrub_stamp":"2023-12-12T09:44:19.449520+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T21:18:35.916411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-12T09:44:24.021829+0000","last_change":"2023-12-12T09:44:21.511615+0000","last_active":"2023-12-12T09:44:24.021829+0000","last_peered":"2023-12-12T09:44:24.021829+0000","last_clean":"2023-12-12T09:44:24.021829+0000","last_became_active":"2023-12-12T09:44:21.509251+0000","last_became_peered":"2023-12-12T09:44:21.509251+0000","last_unstale":"2023-12-12T09:44:24.021829+0000","last_undegraded":"2023-12-12T09:44:24.021829+0000","last_fullsized":"2023-12-12T09:44:24.021829+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_clean_scrub_stamp":"2023-12-12T09:44:20.465592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T19:18:46.146779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-12T09:44:21.507039+0000","last_change":"2023-12-12T09:44:20.515913+0000","last_active":"2023-12-12T09:44:21.507039+0000","last_peered":"2023-12-12T09:44:21.507039+0000","last_clean":"2023-12-12T09:44:21.507039+0000","last_became_active":"2023-12-12T09:44:20.515642+0000","last_became_peered":"2023-12-12T09:44:20.515642+0000","last_unstale":"2023-12-12T09:44:21.507039+0000","last_undegraded":"2023-12-12T09:44:21.507039+0000","last_fullsized":"2023-12-12T09:44:21.507039+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:19.449520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:19.449520+0000","last_clean_scrub_stamp":"2023-12-12T09:44:19.449520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T21:18:35.916411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-12T09:44:24.023156+0000","last_change":"2023-12-12T09:44:21.508562+0000","last_active":"2023-12-12T09:44:24.023156+0000","last_peered":"2023-12-12T09:44:24.023156+0000","last_clean":"2023-12-12T09:44:24.023156+0000","last_became_active":"2023-12-12T09:44:21.508207+0000","last_became_peered":"2023-12-12T09:44:21.508207+0000","last_unstale":"2023-12-12T09:44:24.023156+0000","last_undegraded":"2023-12-12T09:44:24.023156+0000","last_fullsized":"2023-12-12T09:44:24.023156+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_clean_scrub_stamp":"2023-12-12T09:44:20.465592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T14:54:55.495724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-12T09:44:21.500123+0000","last_change":"2023-12-12T09:44:20.509876+0000","last_active":"2023-12-12T09:44:21.500123+0000","last_peered":"2023-12-12T09:44:21.500123+0000","last_clean":"2023-12-12T09:44:21.500123+0000","last_became_active":"2023-12-12T09:44:20.509580+0000","last_became_peered":"2023-12-12T09:44:20.509580+0000","last_unstale":"2023-12-12T09:44:21.500123+0000","last_undegraded":"2023-12-12T09:44:21.500123+0000","last_fullsized":"2023-12-12T09:44:21.500123+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:19.449520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:19.449520+0000","last_clean_scrub_stamp":"2023-12-12T09:44:19.449520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T12:00:32.399540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-12T09:44:22.513495+0000","last_change":"2023-12-12T09:44:21.527012+0000","last_active":"2023-12-12T09:44:22.513495+0000","last_peered":"2023-12-12T09:44:22.513495+0000","last_clean":"2023-12-12T09:44:22.513495+0000","last_became_active":"2023-12-12T09:44:21.525770+0000","last_became_peered":"2023-12-12T09:44:21.525770+0000","last_unstale":"2023-12-12T09:44:22.513495+0000","last_undegraded":"2023-12-12T09:44:22.513495+0000","last_fullsized":"2023-12-12T09:44:22.513495+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_clean_scrub_stamp":"2023-12-12T09:44:20.465592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T10:50:32.155095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-12T09:44:21.503960+0000","last_change":"2023-12-12T09:44:20.519234+0000","last_active":"2023-12-12T09:44:21.503960+0000","last_peered":"2023-12-12T09:44:21.503960+0000","last_clean":"2023-12-12T09:44:21.503960+0000","last_became_active":"2023-12-12T09:44:20.518728+0000","last_became_peered":"2023-12-12T09:44:20.518728+0000","last_unstale":"2023-12-12T09:44:21.503960+0000","last_undegraded":"2023-12-12T09:44:21.503960+0000","last_fullsized":"2023-12-12T09:44:21.503960+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:19.449520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:19.449520+0000","last_clean_scrub_stamp":"2023-12-12T09:44:19.449520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T14:50:34.872309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-12T09:44:24.022357+0000","last_change":"2023-12-12T09:44:21.521774+0000","last_active":"2023-12-12T09:44:24.022357+0000","last_peered":"2023-12-12T09:44:24.022357+0000","last_clean":"2023-12-12T09:44:24.022357+0000","last_became_active":"2023-12-12T09:44:21.521431+0000","last_became_peered":"2023-12-12T09:44:21.521431+0000","last_unstale":"2023-12-12T09:44:24.022357+0000","last_undegraded":"2023-12-12T09:44:24.022357+0000","last_fullsized":"2023-12-12T09:44:24.022357+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_clean_scrub_stamp":"2023-12-12T09:44:20.465592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T19:05:15.078557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"33'2","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-12T09:44:21.535958+0000","last_change":"2023-12-12T09:44:20.511011+0000","last_active":"2023-12-12T09:44:21.535958+0000","last_peered":"2023-12-12T09:44:21.535958+0000","last_clean":"2023-12-12T09:44:21.535958+0000","last_became_active":"2023-12-12T09:44:20.510709+0000","last_became_peered":"2023-12-12T09:44:20.510709+0000","last_unstale":"2023-12-12T09:44:21.535958+0000","last_undegraded":"2023-12-12T09:44:21.535958+0000","last_fullsized":"2023-12-12T09:44:21.535958+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:19.449520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:19.449520+0000","last_clean_scrub_stamp":"2023-12-12T09:44:19.449520+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T12:49:11.267636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-12T09:44:22.516242+0000","last_change":"2023-12-12T09:44:21.521339+0000","last_active":"2023-12-12T09:44:22.516242+0000","last_peered":"2023-12-12T09:44:22.516242+0000","last_clean":"2023-12-12T09:44:22.516242+0000","last_became_active":"2023-12-12T09:44:21.521079+0000","last_became_peered":"2023-12-12T09:44:21.521079+0000","last_unstale":"2023-12-12T09:44:22.516242+0000","last_undegraded":"2023-12-12T09:44:22.516242+0000","last_fullsized":"2023-12-12T09:44:22.516242+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_clean_scrub_stamp":"2023-12-12T09:44:20.465592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T21:03:17.881060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-12T09:44:21.488848+0000","last_change":"2023-12-12T09:44:20.505916+0000","last_active":"2023-12-12T09:44:21.488848+0000","last_peered":"2023-12-12T09:44:21.488848+0000","last_clean":"2023-12-12T09:44:21.488848+0000","last_became_active":"2023-12-12T09:44:20.505632+0000","last_became_peered":"2023-12-12T09:44:20.505632+0000","last_unstale":"2023-12-12T09:44:21.488848+0000","last_undegraded":"2023-12-12T09:44:21.488848+0000","last_fullsized":"2023-12-12T09:44:21.488848+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:19.449520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:19.449520+0000","last_clean_scrub_stamp":"2023-12-12T09:44:19.449520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T12:00:32.399540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-12T09:44:24.019990+0000","last_change":"2023-12-12T09:44:21.515107+0000","last_active":"2023-12-12T09:44:24.019990+0000","last_peered":"2023-12-12T09:44:24.019990+0000","last_clean":"2023-12-12T09:44:24.019990+0000","last_became_active":"2023-12-12T09:44:21.514827+0000","last_became_peered":"2023-12-12T09:44:21.514827+0000","last_unstale":"2023-12-12T09:44:24.019990+0000","last_undegraded":"2023-12-12T09:44:24.019990+0000","last_fullsized":"2023-12-12T09:44:24.019990+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_clean_scrub_stamp":"2023-12-12T09:44:20.465592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T10:43:48.035299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-12T09:44:21.503969+0000","last_change":"2023-12-12T09:44:20.511329+0000","last_active":"2023-12-12T09:44:21.503969+0000","last_peered":"2023-12-12T09:44:21.503969+0000","last_clean":"2023-12-12T09:44:21.503969+0000","last_became_active":"2023-12-12T09:44:20.510982+0000","last_became_peered":"2023-12-12T09:44:20.510982+0000","last_unstale":"2023-12-12T09:44:21.503969+0000","last_undegraded":"2023-12-12T09:44:21.503969+0000","last_fullsized":"2023-12-12T09:44:21.503969+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:19.449520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:19.449520+0000","last_clean_scrub_stamp":"2023-12-12T09:44:19.449520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T10:43:47.019227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-12T09:44:22.686138+0000","last_change":"2023-12-12T09:44:21.518935+0000","last_active":"2023-12-12T09:44:22.686138+0000","last_peered":"2023-12-12T09:44:22.686138+0000","last_clean":"2023-12-12T09:44:22.686138+0000","last_became_active":"2023-12-12T09:44:21.518647+0000","last_became_peered":"2023-12-12T09:44:21.518647+0000","last_unstale":"2023-12-12T09:44:22.686138+0000","last_undegraded":"2023-12-12T09:44:22.686138+0000","last_fullsized":"2023-12-12T09:44:22.686138+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_clean_scrub_stamp":"2023-12-12T09:44:20.465592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T19:38:08.742023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-12T09:44:21.488692+0000","last_change":"2023-12-12T09:44:20.506663+0000","last_active":"2023-12-12T09:44:21.488692+0000","last_peered":"2023-12-12T09:44:21.488692+0000","last_clean":"2023-12-12T09:44:21.488692+0000","last_became_active":"2023-12-12T09:44:20.506077+0000","last_became_peered":"2023-12-12T09:44:20.506077+0000","last_unstale":"2023-12-12T09:44:21.488692+0000","last_undegraded":"2023-12-12T09:44:21.488692+0000","last_fullsized":"2023-12-12T09:44:21.488692+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:19.449520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:19.449520+0000","last_clean_scrub_stamp":"2023-12-12T09:44:19.449520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T19:16:24.812720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-12T09:44:24.019623+0000","last_change":"2023-12-12T09:44:21.513642+0000","last_active":"2023-12-12T09:44:24.019623+0000","last_peered":"2023-12-12T09:44:24.019623+0000","last_clean":"2023-12-12T09:44:24.019623+0000","last_became_active":"2023-12-12T09:44:21.513346+0000","last_became_peered":"2023-12-12T09:44:21.513346+0000","last_unstale":"2023-12-12T09:44:24.019623+0000","last_undegraded":"2023-12-12T09:44:24.019623+0000","last_fullsized":"2023-12-12T09:44:24.019623+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_clean_scrub_stamp":"2023-12-12T09:44:20.465592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T21:19:34.161140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-12T09:44:21.498144+0000","last_change":"2023-12-12T09:44:20.512148+0000","last_active":"2023-12-12T09:44:21.498144+0000","last_peered":"2023-12-12T09:44:21.498144+0000","last_clean":"2023-12-12T09:44:21.498144+0000","last_became_active":"2023-12-12T09:44:20.510963+0000","last_became_peered":"2023-12-12T09:44:20.510963+0000","last_unstale":"2023-12-12T09:44:21.498144+0000","last_undegraded":"2023-12-12T09:44:21.498144+0000","last_fullsized":"2023-12-12T09:44:21.498144+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:19.449520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:19.449520+0000","last_clean_scrub_stamp":"2023-12-12T09:44:19.449520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T19:38:07.725951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-12T09:44:22.508601+0000","last_change":"2023-12-12T09:44:21.529727+0000","last_active":"2023-12-12T09:44:22.508601+0000","last_peered":"2023-12-12T09:44:22.508601+0000","last_clean":"2023-12-12T09:44:22.508601+0000","last_became_active":"2023-12-12T09:44:21.528750+0000","last_became_peered":"2023-12-12T09:44:21.528750+0000","last_unstale":"2023-12-12T09:44:22.508601+0000","last_undegraded":"2023-12-12T09:44:22.508601+0000","last_fullsized":"2023-12-12T09:44:22.508601+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_clean_scrub_stamp":"2023-12-12T09:44:20.465592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T10:50:32.155095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-12T09:44:21.499858+0000","last_change":"2023-12-12T09:44:20.508411+0000","last_active":"2023-12-12T09:44:21.499858+0000","last_peered":"2023-12-12T09:44:21.499858+0000","last_clean":"2023-12-12T09:44:21.499858+0000","last_became_active":"2023-12-12T09:44:20.508071+0000","last_became_peered":"2023-12-12T09:44:20.508071+0000","last_unstale":"2023-12-12T09:44:21.499858+0000","last_undegraded":"2023-12-12T09:44:21.499858+0000","last_fullsized":"2023-12-12T09:44:21.499858+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:19.449520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:19.449520+0000","last_clean_scrub_stamp":"2023-12-12T09:44:19.449520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T19:38:07.725951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-12T09:44:24.019975+0000","last_change":"2023-12-12T09:44:21.530146+0000","last_active":"2023-12-12T09:44:24.019975+0000","last_peered":"2023-12-12T09:44:24.019975+0000","last_clean":"2023-12-12T09:44:24.019975+0000","last_became_active":"2023-12-12T09:44:21.526991+0000","last_became_peered":"2023-12-12T09:44:21.526991+0000","last_unstale":"2023-12-12T09:44:24.019975+0000","last_undegraded":"2023-12-12T09:44:24.019975+0000","last_fullsized":"2023-12-12T09:44:24.019975+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_clean_scrub_stamp":"2023-12-12T09:44:20.465592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T21:42:36.877781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-12T09:44:21.496636+0000","last_change":"2023-12-12T09:44:20.514669+0000","last_active":"2023-12-12T09:44:21.496636+0000","last_peered":"2023-12-12T09:44:21.496636+0000","last_clean":"2023-12-12T09:44:21.496636+0000","last_became_active":"2023-12-12T09:44:20.514346+0000","last_became_peered":"2023-12-12T09:44:20.514346+0000","last_unstale":"2023-12-12T09:44:21.496636+0000","last_undegraded":"2023-12-12T09:44:21.496636+0000","last_fullsized":"2023-12-12T09:44:21.496636+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:19.449520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:19.449520+0000","last_clean_scrub_stamp":"2023-12-12T09:44:19.449520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T12:21:36.280435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-12T09:44:22.513812+0000","last_change":"2023-12-12T09:44:21.525532+0000","last_active":"2023-12-12T09:44:22.513812+0000","last_peered":"2023-12-12T09:44:22.513812+0000","last_clean":"2023-12-12T09:44:22.513812+0000","last_became_active":"2023-12-12T09:44:21.521828+0000","last_became_peered":"2023-12-12T09:44:21.521828+0000","last_unstale":"2023-12-12T09:44:22.513812+0000","last_undegraded":"2023-12-12T09:44:22.513812+0000","last_fullsized":"2023-12-12T09:44:22.513812+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_clean_scrub_stamp":"2023-12-12T09:44:20.465592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T13:05:01.026963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-12T09:44:21.507274+0000","last_change":"2023-12-12T09:44:20.519204+0000","last_active":"2023-12-12T09:44:21.507274+0000","last_peered":"2023-12-12T09:44:21.507274+0000","last_clean":"2023-12-12T09:44:21.507274+0000","last_became_active":"2023-12-12T09:44:20.518590+0000","last_became_peered":"2023-12-12T09:44:20.518590+0000","last_unstale":"2023-12-12T09:44:21.507274+0000","last_undegraded":"2023-12-12T09:44:21.507274+0000","last_fullsized":"2023-12-12T09:44:21.507274+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:19.449520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:19.449520+0000","last_clean_scrub_stamp":"2023-12-12T09:44:19.449520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T16:04:09.402682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":176,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-12T09:44:21.512754+0000","last_change":"2023-12-12T09:43:17.203315+0000","last_active":"2023-12-12T09:44:21.512754+0000","last_peered":"2023-12-12T09:44:21.512754+0000","last_clean":"2023-12-12T09:44:21.512754+0000","last_became_active":"2023-12-12T09:43:17.200779+0000","last_became_peered":"2023-12-12T09:43:17.200779+0000","last_unstale":"2023-12-12T09:44:21.512754+0000","last_undegraded":"2023-12-12T09:44:21.512754+0000","last_fullsized":"2023-12-12T09:44:21.512754+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:43:15.931922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:43:15.931922+0000","last_clean_scrub_stamp":"2023-12-12T09:43:15.931922+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T21:42:10.929640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":64844,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574866,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27468,"kb_used_data":444,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344372,"statfs":{"total":96636764160,"available":96608636928,"internally_reserved":0,"allocated":454656,"data_stored":741230,"data_compressed":32422,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 12 09:44:15 2023","interfaces":[{"interface":"back","average":{"1min":0.999,"5min":0.999,"15min":0.999},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.8089999999999999,"5min":1.8089999999999999,"15min":1.8089999999999999},"last":1.476},{"interface":"front","average":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"min":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"max":{"1min":1.4279999999999999,"5min":1.4279999999999999,"15min":1.4279999999999999},"last":1.4359999999999999}]},{"osd":1,"last update":"Tue Dec 12 09:44:15 2023","interfaces":[{"interface":"back","average":{"1min":1.198,"5min":1.198,"15min":1.198},"min":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"max":{"1min":1.7729999999999999,"5min":1.7729999999999999,"15min":1.7729999999999999},"last":1.51},{"interface":"front","average":{"1min":1.216,"5min":1.216,"15min":1.216},"min":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"max":{"1min":3.1150000000000002,"5min":3.1150000000000002,"15min":3.1150000000000002},"last":1.542}]},{"osd":2,"last update":"Tue Dec 12 09:44:15 2023","interfaces":[{"interface":"back","average":{"1min":1.262,"5min":1.262,"15min":1.262},"min":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"max":{"1min":2.2050000000000001,"5min":2.2050000000000001,"15min":2.2050000000000001},"last":0.98599999999999999},{"interface":"front","average":{"1min":1.2450000000000001,"5min":1.2450000000000001,"15min":1.2450000000000001},"min":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":3.2759999999999998,"5min":3.2759999999999998,"15min":3.2759999999999998},"last":1.1679999999999999}]},{"osd":3,"last update":"Tue Dec 12 09:44:15 2023","interfaces":[{"interface":"back","average":{"1min":1.3169999999999999,"5min":1.3169999999999999,"15min":1.3169999999999999},"min":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"max":{"1min":3.1819999999999999,"5min":3.1819999999999999,"15min":3.1819999999999999},"last":1.345},{"interface":"front","average":{"1min":1.2949999999999999,"5min":1.2949999999999999,"15min":1.2949999999999999},"min":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"max":{"1min":1.8740000000000001,"5min":1.8740000000000001,"15min":1.8740000000000001},"last":1.587}]},{"osd":4,"last update":"Tue Dec 12 09:44:15 2023","interfaces":[{"interface":"back","average":{"1min":1.3520000000000001,"5min":1.3520000000000001,"15min":1.3520000000000001},"min":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"max":{"1min":2.5529999999999999,"5min":2.5529999999999999,"15min":2.5529999999999999},"last":1.282},{"interface":"front","average":{"1min":1.4550000000000001,"5min":1.4550000000000001,"15min":1.4550000000000001},"min":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"max":{"1min":2.351,"5min":2.351,"15min":2.351},"last":1.3799999999999999}]},{"osd":5,"last update":"Tue Dec 12 09:44:15 2023","interfaces":[{"interface":"back","average":{"1min":1.335,"5min":1.335,"15min":1.335},"min":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"max":{"1min":1.9610000000000001,"5min":1.9610000000000001,"15min":1.9610000000000001},"last":1.121},{"interface":"front","average":{"1min":1.5369999999999999,"5min":1.5369999999999999,"15min":1.5369999999999999},"min":{"1min":1.2050000000000001,"5min":1.2050000000000001,"15min":1.2050000000000001},"max":{"1min":2.4159999999999999,"5min":2.4159999999999999,"15min":2.4159999999999999},"last":1.204}]},{"osd":6,"last update":"Tue Dec 12 09:44:15 2023","interfaces":[{"interface":"back","average":{"1min":1.417,"5min":1.417,"15min":1.417},"min":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"max":{"1min":2.0510000000000002,"5min":2.0510000000000002,"15min":2.0510000000000002},"last":1.3169999999999999},{"interface":"front","average":{"1min":1.635,"5min":1.635,"15min":1.635},"min":{"1min":1.256,"5min":1.256,"15min":1.256},"max":{"1min":2.5800000000000001,"5min":2.5800000000000001,"15min":2.5800000000000001},"last":1.643}]}]},{"osd":6,"up_from":13,"seq":55834574864,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27408,"kb_used_data":384,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344432,"statfs":{"total":96636764160,"available":96608698368,"internally_reserved":0,"allocated":393216,"data_stored":151388,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 12 09:44:14 2023","interfaces":[{"interface":"back","average":{"1min":1.1930000000000001,"5min":1.1930000000000001,"15min":1.1930000000000001},"min":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":3.6429999999999998,"5min":3.6429999999999998,"15min":3.6429999999999998},"last":0.66100000000000003},{"interface":"front","average":{"1min":1.0700000000000001,"5min":1.0700000000000001,"15min":1.0700000000000001},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":2.6059999999999999,"5min":2.6059999999999999,"15min":2.6059999999999999},"last":1.0740000000000001}]},{"osd":1,"last update":"Tue Dec 12 09:44:14 2023","interfaces":[{"interface":"back","average":{"1min":1.0620000000000001,"5min":1.0620000000000001,"15min":1.0620000000000001},"min":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"max":{"1min":2.0169999999999999,"5min":2.0169999999999999,"15min":2.0169999999999999},"last":1.2889999999999999},{"interface":"front","average":{"1min":1.2010000000000001,"5min":1.2010000000000001,"15min":1.2010000000000001},"min":{"1min":0.747,"5min":0.747,"15min":0.747},"max":{"1min":1.7,"5min":1.7,"15min":1.7},"last":1.0009999999999999}]},{"osd":2,"last update":"Tue Dec 12 09:44:14 2023","interfaces":[{"interface":"back","average":{"1min":1.236,"5min":1.236,"15min":1.236},"min":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"max":{"1min":1.804,"5min":1.804,"15min":1.804},"last":1.359},{"interface":"front","average":{"1min":1.3129999999999999,"5min":1.3129999999999999,"15min":1.3129999999999999},"min":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"max":{"1min":2.2160000000000002,"5min":2.2160000000000002,"15min":2.2160000000000002},"last":1.23}]},{"osd":3,"last update":"Tue Dec 12 09:44:14 2023","interfaces":[{"interface":"back","average":{"1min":1.218,"5min":1.218,"15min":1.218},"min":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"max":{"1min":2.665,"5min":2.665,"15min":2.665},"last":1.661},{"interface":"front","average":{"1min":1.2310000000000001,"5min":1.2310000000000001,"15min":1.2310000000000001},"min":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"max":{"1min":1.8620000000000001,"5min":1.8620000000000001,"15min":1.8620000000000001},"last":1.4399999999999999}]},{"osd":4,"last update":"Tue Dec 12 09:44:14 2023","interfaces":[{"interface":"back","average":{"1min":1.2749999999999999,"5min":1.2749999999999999,"15min":1.2749999999999999},"min":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":2.0310000000000001,"5min":2.0310000000000001,"15min":2.0310000000000001},"last":1.163},{"interface":"front","average":{"1min":1.407,"5min":1.407,"15min":1.407},"min":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"max":{"1min":2.2799999999999998,"5min":2.2799999999999998,"15min":2.2799999999999998},"last":0.93899999999999995}]},{"osd":5,"last update":"Tue Dec 12 09:44:14 2023","interfaces":[{"interface":"back","average":{"1min":1.4410000000000001,"5min":1.4410000000000001,"15min":1.4410000000000001},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":2.1739999999999999,"5min":2.1739999999999999,"15min":2.1739999999999999},"last":1.597},{"interface":"front","average":{"1min":1.4770000000000001,"5min":1.4770000000000001,"15min":1.4770000000000001},"min":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"max":{"1min":1.929,"5min":1.929,"15min":1.929},"last":1.538}]},{"osd":7,"last update":"Tue Dec 12 09:44:14 2023","interfaces":[{"interface":"back","average":{"1min":1.5089999999999999,"5min":1.5089999999999999,"15min":1.5089999999999999},"min":{"1min":0.754,"5min":0.754,"15min":0.754},"max":{"1min":1.994,"5min":1.994,"15min":1.994},"last":1.4910000000000001},{"interface":"front","average":{"1min":1.5389999999999999,"5min":1.5389999999999999,"15min":1.5389999999999999},"min":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"max":{"1min":2.0800000000000001,"5min":2.0800000000000001,"15min":2.0800000000000001},"last":1.71}]}]},{"osd":5,"up_from":13,"seq":55834574864,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27404,"kb_used_data":384,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344436,"statfs":{"total":96636764160,"available":96608702464,"internally_reserved":0,"allocated":393216,"data_stored":151444,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 12 09:44:14 2023","interfaces":[{"interface":"back","average":{"1min":1.02,"5min":1.02,"15min":1.02},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.5209999999999999,"5min":1.5209999999999999,"15min":1.5209999999999999},"last":0.92000000000000004},{"interface":"front","average":{"1min":1.1299999999999999,"5min":1.1299999999999999,"15min":1.1299999999999999},"min":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"max":{"1min":1.508,"5min":1.508,"15min":1.508},"last":1.595}]},{"osd":1,"last update":"Tue Dec 12 09:44:14 2023","interfaces":[{"interface":"back","average":{"1min":1.226,"5min":1.226,"15min":1.226},"min":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"max":{"1min":1.5940000000000001,"5min":1.5940000000000001,"15min":1.5940000000000001},"last":1.756},{"interface":"front","average":{"1min":1.0920000000000001,"5min":1.0920000000000001,"15min":1.0920000000000001},"min":{"1min":0.753,"5min":0.753,"15min":0.753},"max":{"1min":1.5840000000000001,"5min":1.5840000000000001,"15min":1.5840000000000001},"last":1.022}]},{"osd":2,"last update":"Tue Dec 12 09:44:14 2023","interfaces":[{"interface":"back","average":{"1min":1.3169999999999999,"5min":1.3169999999999999,"15min":1.3169999999999999},"min":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"max":{"1min":1.7889999999999999,"5min":1.7889999999999999,"15min":1.7889999999999999},"last":1.3029999999999999},{"interface":"front","average":{"1min":1.421,"5min":1.421,"15min":1.421},"min":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"max":{"1min":2.1600000000000001,"5min":2.1600000000000001,"15min":2.1600000000000001},"last":1.1619999999999999}]},{"osd":3,"last update":"Tue Dec 12 09:44:14 2023","interfaces":[{"interface":"back","average":{"1min":1.371,"5min":1.371,"15min":1.371},"min":{"1min":1.002,"5min":1.002,"15min":1.002},"max":{"1min":2.1499999999999999,"5min":2.1499999999999999,"15min":2.1499999999999999},"last":1.367},{"interface":"front","average":{"1min":1.492,"5min":1.492,"15min":1.492},"min":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"max":{"1min":1.8939999999999999,"5min":1.8939999999999999,"15min":1.8939999999999999},"last":1.4179999999999999}]},{"osd":4,"last update":"Tue Dec 12 09:44:14 2023","interfaces":[{"interface":"back","average":{"1min":1.4910000000000001,"5min":1.4910000000000001,"15min":1.4910000000000001},"min":{"1min":0.995,"5min":0.995,"15min":0.995},"max":{"1min":2.391,"5min":2.391,"15min":2.391},"last":1.5089999999999999},{"interface":"front","average":{"1min":1.5880000000000001,"5min":1.5880000000000001,"15min":1.5880000000000001},"min":{"1min":1.0940000000000001,"5min":1.0940000000000001,"15min":1.0940000000000001},"max":{"1min":2.5430000000000001,"5min":2.5430000000000001,"15min":2.5430000000000001},"last":1.665}]},{"osd":6,"last update":"Tue Dec 12 09:44:14 2023","interfaces":[{"interface":"back","average":{"1min":1.5960000000000001,"5min":1.5960000000000001,"15min":1.5960000000000001},"min":{"1min":1.034,"5min":1.034,"15min":1.034},"max":{"1min":2.0840000000000001,"5min":2.0840000000000001,"15min":2.0840000000000001},"last":1.696},{"interface":"front","average":{"1min":1.631,"5min":1.631,"15min":1.631},"min":{"1min":1.155,"5min":1.155,"15min":1.155},"max":{"1min":2.306,"5min":2.306,"15min":2.306},"last":1.9970000000000001}]},{"osd":7,"last update":"Tue Dec 12 09:44:14 2023","interfaces":[{"interface":"back","average":{"1min":1.7849999999999999,"5min":1.7849999999999999,"15min":1.7849999999999999},"min":{"1min":1.2090000000000001,"5min":1.2090000000000001,"15min":1.2090000000000001},"max":{"1min":2.6880000000000002,"5min":2.6880000000000002,"15min":2.6880000000000002},"last":1.889},{"interface":"front","average":{"1min":1.748,"5min":1.748,"15min":1.748},"min":{"1min":1.1220000000000001,"5min":1.1220000000000001,"15min":1.1220000000000001},"max":{"1min":2.3410000000000002,"5min":2.3410000000000002,"15min":2.3410000000000002},"last":1.8260000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574866,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27392,"kb_used_data":372,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344448,"statfs":{"total":96636764160,"available":96608714752,"internally_reserved":0,"allocated":380928,"data_stored":144576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 12 09:44:14 2023","interfaces":[{"interface":"back","average":{"1min":1.0549999999999999,"5min":1.0549999999999999,"15min":1.0549999999999999},"min":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":1.5820000000000001,"5min":1.5820000000000001,"15min":1.5820000000000001},"last":1.0840000000000001},{"interface":"front","average":{"1min":1.0549999999999999,"5min":1.0549999999999999,"15min":1.0549999999999999},"min":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"max":{"1min":1.492,"5min":1.492,"15min":1.492},"last":1.151}]},{"osd":1,"last update":"Tue Dec 12 09:44:14 2023","interfaces":[{"interface":"back","average":{"1min":1.044,"5min":1.044,"15min":1.044},"min":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"max":{"1min":1.3360000000000001,"5min":1.3360000000000001,"15min":1.3360000000000001},"last":0.79600000000000004},{"interface":"front","average":{"1min":1.181,"5min":1.181,"15min":1.181},"min":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"max":{"1min":1.8720000000000001,"5min":1.8720000000000001,"15min":1.8720000000000001},"last":1.1890000000000001}]},{"osd":2,"last update":"Tue Dec 12 09:44:14 2023","interfaces":[{"interface":"back","average":{"1min":1.119,"5min":1.119,"15min":1.119},"min":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"max":{"1min":1.429,"5min":1.429,"15min":1.429},"last":1.3740000000000001},{"interface":"front","average":{"1min":1.294,"5min":1.294,"15min":1.294},"min":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"max":{"1min":2.1640000000000001,"5min":2.1640000000000001,"15min":2.1640000000000001},"last":1.335}]},{"osd":3,"last update":"Tue Dec 12 09:44:14 2023","interfaces":[{"interface":"back","average":{"1min":1.2030000000000001,"5min":1.2030000000000001,"15min":1.2030000000000001},"min":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"max":{"1min":1.635,"5min":1.635,"15min":1.635},"last":1.2949999999999999},{"interface":"front","average":{"1min":1.238,"5min":1.238,"15min":1.238},"min":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"max":{"1min":2.0499999999999998,"5min":2.0499999999999998,"15min":2.0499999999999998},"last":1.0049999999999999}]},{"osd":5,"last update":"Tue Dec 12 09:44:14 2023","interfaces":[{"interface":"back","average":{"1min":1.468,"5min":1.468,"15min":1.468},"min":{"1min":1,"5min":1,"15min":1},"max":{"1min":2.3159999999999998,"5min":2.3159999999999998,"15min":2.3159999999999998},"last":0.53200000000000003},{"interface":"front","average":{"1min":1.3500000000000001,"5min":1.3500000000000001,"15min":1.3500000000000001},"min":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"max":{"1min":2.117,"5min":2.117,"15min":2.117},"last":1.038}]},{"osd":6,"last update":"Tue Dec 12 09:44:14 2023","interfaces":[{"interface":"back","average":{"1min":1.403,"5min":1.403,"15min":1.403},"min":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"max":{"1min":2.246,"5min":2.246,"15min":2.246},"last":0.91100000000000003},{"interface":"front","average":{"1min":1.5489999999999999,"5min":1.5489999999999999,"15min":1.5489999999999999},"min":{"1min":1.2430000000000001,"5min":1.2430000000000001,"15min":1.2430000000000001},"max":{"1min":2.5099999999999998,"5min":2.5099999999999998,"15min":2.5099999999999998},"last":1.391}]},{"osd":7,"last update":"Tue Dec 12 09:44:14 2023","interfaces":[{"interface":"back","average":{"1min":1.5049999999999999,"5min":1.5049999999999999,"15min":1.5049999999999999},"min":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"max":{"1min":2.5710000000000002,"5min":2.5710000000000002,"15min":2.5710000000000002},"last":0.96099999999999997},{"interface":"front","average":{"1min":1.5129999999999999,"5min":1.5129999999999999,"15min":1.5129999999999999},"min":{"1min":1.0600000000000001,"5min":1.0600000000000001,"15min":1.0600000000000001},"max":{"1min":2.3919999999999999,"5min":2.3919999999999999,"15min":2.3919999999999999},"last":1.2290000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574864,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27412,"kb_used_data":392,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344428,"statfs":{"total":96636764160,"available":96608694272,"internally_reserved":0,"allocated":401408,"data_stored":152406,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 12 09:44:16 2023","interfaces":[{"interface":"back","average":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":1.4830000000000001,"5min":1.4830000000000001,"15min":1.4830000000000001},"last":0.67200000000000004},{"interface":"front","average":{"1min":1.137,"5min":1.137,"15min":1.137},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":3.3370000000000002,"5min":3.3370000000000002,"15min":3.3370000000000002},"last":0.41299999999999998}]},{"osd":1,"last update":"Tue Dec 12 09:44:16 2023","interfaces":[{"interface":"back","average":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":1.4610000000000001,"5min":1.4610000000000001,"15min":1.4610000000000001},"last":0.69999999999999996},{"interface":"front","average":{"1min":1.069,"5min":1.069,"15min":1.069},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":2.9409999999999998,"5min":2.9409999999999998,"15min":2.9409999999999998},"last":0.78300000000000003}]},{"osd":2,"last update":"Tue Dec 12 09:44:16 2023","interfaces":[{"interface":"back","average":{"1min":1.1870000000000001,"5min":1.1870000000000001,"15min":1.1870000000000001},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":2.613,"5min":2.613,"15min":2.613},"last":0.64100000000000001},{"interface":"front","average":{"1min":1.1850000000000001,"5min":1.1850000000000001,"15min":1.1850000000000001},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":3.0430000000000001,"5min":3.0430000000000001,"15min":3.0430000000000001},"last":0.52700000000000002}]},{"osd":4,"last update":"Tue Dec 12 09:44:16 2023","interfaces":[{"interface":"back","average":{"1min":1.383,"5min":1.383,"15min":1.383},"min":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":3.5019999999999998,"5min":3.5019999999999998,"15min":3.5019999999999998},"last":1.218},{"interface":"front","average":{"1min":1.4830000000000001,"5min":1.4830000000000001,"15min":1.4830000000000001},"min":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"max":{"1min":2.9889999999999999,"5min":2.9889999999999999,"15min":2.9889999999999999},"last":0.79800000000000004}]},{"osd":5,"last update":"Tue Dec 12 09:44:16 2023","interfaces":[{"interface":"back","average":{"1min":1.5,"5min":1.5,"15min":1.5},"min":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"max":{"1min":4.2480000000000002,"5min":4.2480000000000002,"15min":4.2480000000000002},"last":0.73599999999999999},{"interface":"front","average":{"1min":1.5920000000000001,"5min":1.5920000000000001,"15min":1.5920000000000001},"min":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"max":{"1min":5.5060000000000002,"5min":5.5060000000000002,"15min":5.5060000000000002},"last":1.1279999999999999}]},{"osd":6,"last update":"Tue Dec 12 09:44:16 2023","interfaces":[{"interface":"back","average":{"1min":1.458,"5min":1.458,"15min":1.458},"min":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"max":{"1min":3.1400000000000001,"5min":3.1400000000000001,"15min":3.1400000000000001},"last":0.83199999999999996},{"interface":"front","average":{"1min":1.5469999999999999,"5min":1.5469999999999999,"15min":1.5469999999999999},"min":{"1min":0.627,"5min":0.627,"15min":0.627},"max":{"1min":4.3179999999999996,"5min":4.3179999999999996,"15min":4.3179999999999996},"last":1.288}]},{"osd":7,"last update":"Tue Dec 12 09:44:16 2023","interfaces":[{"interface":"back","average":{"1min":1.5920000000000001,"5min":1.5920000000000001,"15min":1.5920000000000001},"min":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"max":{"1min":5.3979999999999997,"5min":5.3979999999999997,"15min":5.3979999999999997},"last":1.054},{"interface":"front","average":{"1min":1.554,"5min":1.554,"15min":1.554},"min":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"max":{"1min":3.4129999999999998,"5min":3.4129999999999998,"15min":3.4129999999999998},"last":0.75800000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574864,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27404,"kb_used_data":380,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344436,"statfs":{"total":96636764160,"available":96608702464,"internally_reserved":0,"allocated":389120,"data_stored":150842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 12 09:44:15 2023","interfaces":[{"interface":"back","average":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":1.458,"5min":1.458,"15min":1.458},"last":0.98799999999999999},{"interface":"front","average":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":1.4370000000000001,"5min":1.4370000000000001,"15min":1.4370000000000001},"last":1.343}]},{"osd":1,"last update":"Tue Dec 12 09:44:15 2023","interfaces":[{"interface":"back","average":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.593,"5min":1.593,"15min":1.593},"last":0.83399999999999996},{"interface":"front","average":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":1.758,"5min":1.758,"15min":1.758},"last":0.92500000000000004}]},{"osd":3,"last update":"Tue Dec 12 09:44:15 2023","interfaces":[{"interface":"back","average":{"1min":1.0569999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.8879999999999999,"5min":1.8879999999999999,"15min":1.8879999999999999},"last":1.0780000000000001},{"interface":"front","average":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":1.8120000000000001,"5min":1.8120000000000001,"15min":1.8120000000000001},"last":1.131}]},{"osd":4,"last update":"Tue Dec 12 09:44:15 2023","interfaces":[{"interface":"back","average":{"1min":1.2270000000000001,"5min":1.2270000000000001,"15min":1.2270000000000001},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":2.5760000000000001,"5min":2.5760000000000001,"15min":2.5760000000000001},"last":1.2070000000000001},{"interface":"front","average":{"1min":1.3939999999999999,"5min":1.3939999999999999,"15min":1.3939999999999999},"min":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":2.8069999999999999,"5min":2.8069999999999999,"15min":2.8069999999999999},"last":1.522}]},{"osd":5,"last update":"Tue Dec 12 09:44:15 2023","interfaces":[{"interface":"back","average":{"1min":1.379,"5min":1.379,"15min":1.379},"min":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"max":{"1min":2.3109999999999999,"5min":2.3109999999999999,"15min":2.3109999999999999},"last":1.2929999999999999},{"interface":"front","average":{"1min":1.351,"5min":1.351,"15min":1.351},"min":{"1min":0.627,"5min":0.627,"15min":0.627},"max":{"1min":2.5110000000000001,"5min":2.5110000000000001,"15min":2.5110000000000001},"last":1.3979999999999999}]},{"osd":6,"last update":"Tue Dec 12 09:44:15 2023","interfaces":[{"interface":"back","average":{"1min":1.4370000000000001,"5min":1.4370000000000001,"15min":1.4370000000000001},"min":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"max":{"1min":2.907,"5min":2.907,"15min":2.907},"last":1.6479999999999999},{"interface":"front","average":{"1min":1.429,"5min":1.429,"15min":1.429},"min":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"max":{"1min":2.375,"5min":2.375,"15min":2.375},"last":1.4730000000000001}]},{"osd":7,"last update":"Tue Dec 12 09:44:15 2023","interfaces":[{"interface":"back","average":{"1min":1.4570000000000001,"5min":1.4570000000000001,"15min":1.4570000000000001},"min":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"max":{"1min":2.3370000000000002,"5min":2.3370000000000002,"15min":2.3370000000000002},"last":1.706},{"interface":"front","average":{"1min":1.5129999999999999,"5min":1.5129999999999999,"15min":1.5129999999999999},"min":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"max":{"1min":2.488,"5min":2.488,"15min":2.488},"last":1.5649999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574864,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27412,"kb_used_data":392,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344428,"statfs":{"total":96636764160,"available":96608694272,"internally_reserved":0,"allocated":401408,"data_stored":152406,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 12 09:44:15 2023","interfaces":[{"interface":"back","average":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":2.794,"5min":2.794,"15min":2.794},"last":0.82499999999999996},{"interface":"front","average":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":2.1379999999999999,"5min":2.1379999999999999,"15min":2.1379999999999999},"last":0.83599999999999997}]},{"osd":2,"last update":"Tue Dec 12 09:44:15 2023","interfaces":[{"interface":"back","average":{"1min":0.98599999999999999,"5min":0.98599999999999999,"15min":0.98599999999999999},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":6.3390000000000004,"5min":6.3390000000000004,"15min":6.3390000000000004},"last":0.752},{"interface":"front","average":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":2.823,"5min":2.823,"15min":2.823},"last":0.78100000000000003}]},{"osd":3,"last update":"Tue Dec 12 09:44:15 2023","interfaces":[{"interface":"back","average":{"1min":1.0509999999999999,"5min":1.0509999999999999,"15min":1.0509999999999999},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":2.7519999999999998,"5min":2.7519999999999998,"15min":2.7519999999999998},"last":0.88200000000000001},{"interface":"front","average":{"1min":1.008,"5min":1.008,"15min":1.008},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":2.2559999999999998,"5min":2.2559999999999998,"15min":2.2559999999999998},"last":0.90900000000000003}]},{"osd":4,"last update":"Tue Dec 12 09:44:15 2023","interfaces":[{"interface":"back","average":{"1min":1.399,"5min":1.399,"15min":1.399},"min":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"max":{"1min":6.423,"5min":6.423,"15min":6.423},"last":1.1299999999999999},{"interface":"front","average":{"1min":1.194,"5min":1.194,"15min":1.194},"min":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"max":{"1min":2.2309999999999999,"5min":2.2309999999999999,"15min":2.2309999999999999},"last":1.157}]},{"osd":5,"last update":"Tue Dec 12 09:44:15 2023","interfaces":[{"interface":"back","average":{"1min":1.4670000000000001,"5min":1.4670000000000001,"15min":1.4670000000000001},"min":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"max":{"1min":6.2830000000000004,"5min":6.2830000000000004,"15min":6.2830000000000004},"last":1.351},{"interface":"front","average":{"1min":1.375,"5min":1.375,"15min":1.375},"min":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"max":{"1min":2.73,"5min":2.73,"15min":2.73},"last":1.4339999999999999}]},{"osd":6,"last update":"Tue Dec 12 09:44:15 2023","interfaces":[{"interface":"back","average":{"1min":1.5600000000000001,"5min":1.5600000000000001,"15min":1.5600000000000001},"min":{"1min":0.875,"5min":0.875,"15min":0.875},"max":{"1min":6.468,"5min":6.468,"15min":6.468},"last":1.4099999999999999},{"interface":"front","average":{"1min":1.5800000000000001,"5min":1.5800000000000001,"15min":1.5800000000000001},"min":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"max":{"1min":6.3129999999999997,"5min":6.3129999999999997,"15min":6.3129999999999997},"last":1.484}]},{"osd":7,"last update":"Tue Dec 12 09:44:15 2023","interfaces":[{"interface":"back","average":{"1min":1.407,"5min":1.407,"15min":1.407},"min":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"max":{"1min":2.9009999999999998,"5min":2.9009999999999998,"15min":2.9009999999999998},"last":1.111},{"interface":"front","average":{"1min":1.556,"5min":1.556,"15min":1.556},"min":{"1min":0.752,"5min":0.752,"15min":0.752},"max":{"1min":6.242,"5min":6.242,"15min":6.242},"last":1.3140000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574866,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27464,"kb_used_data":440,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344376,"statfs":{"total":96636764160,"available":96608641024,"internally_reserved":0,"allocated":450560,"data_stored":741140,"data_compressed":32422,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Dec 12 09:44:16 2023","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":1.3600000000000001,"5min":1.3600000000000001,"15min":1.3600000000000001},"last":0.82299999999999995},{"interface":"front","average":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":1.282,"5min":1.282,"15min":1.282},"last":1.3460000000000001}]},{"osd":2,"last update":"Tue Dec 12 09:44:16 2023","interfaces":[{"interface":"back","average":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":1.2529999999999999,"5min":1.2529999999999999,"15min":1.2529999999999999},"last":0.91900000000000004},{"interface":"front","average":{"1min":0.995,"5min":0.995,"15min":0.995},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":1.649,"5min":1.649,"15min":1.649},"last":1.1619999999999999}]},{"osd":3,"last update":"Tue Dec 12 09:44:16 2023","interfaces":[{"interface":"back","average":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.4990000000000001,"5min":1.4990000000000001,"15min":1.4990000000000001},"last":1.2529999999999999},{"interface":"front","average":{"1min":1.004,"5min":1.004,"15min":1.004},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.7689999999999999,"5min":1.7689999999999999,"15min":1.7689999999999999},"last":1.4790000000000001}]},{"osd":4,"last update":"Tue Dec 12 09:44:16 2023","interfaces":[{"interface":"back","average":{"1min":1.2869999999999999,"5min":1.2869999999999999,"15min":1.2869999999999999},"min":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"max":{"1min":2.073,"5min":2.073,"15min":2.073},"last":1.29},{"interface":"front","average":{"1min":1.2929999999999999,"5min":1.2929999999999999,"15min":1.2929999999999999},"min":{"1min":0.877,"5min":0.877,"15min":0.877},"max":{"1min":3.0699999999999998,"5min":3.0699999999999998,"15min":3.0699999999999998},"last":1.4259999999999999}]},{"osd":5,"last update":"Tue Dec 12 09:44:16 2023","interfaces":[{"interface":"back","average":{"1min":1.2330000000000001,"5min":1.2330000000000001,"15min":1.2330000000000001},"min":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":3.1909999999999998,"5min":3.1909999999999998,"15min":3.1909999999999998},"last":1.0089999999999999},{"interface":"front","average":{"1min":1.3069999999999999,"5min":1.3069999999999999,"15min":1.3069999999999999},"min":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"max":{"1min":1.9750000000000001,"5min":1.9750000000000001,"15min":1.9750000000000001},"last":1.0740000000000001}]},{"osd":6,"last update":"Tue Dec 12 09:44:16 2023","interfaces":[{"interface":"back","average":{"1min":1.3380000000000001,"5min":1.3380000000000001,"15min":1.3380000000000001},"min":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"max":{"1min":1.9630000000000001,"5min":1.9630000000000001,"15min":1.9630000000000001},"last":1.3080000000000001},{"interface":"front","average":{"1min":1.3919999999999999,"5min":1.3919999999999999,"15min":1.3919999999999999},"min":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"max":{"1min":2.9100000000000001,"5min":2.9100000000000001,"15min":2.9100000000000001},"last":1.391}]},{"osd":7,"last update":"Tue Dec 12 09:44:16 2023","interfaces":[{"interface":"back","average":{"1min":1.4450000000000001,"5min":1.4450000000000001,"15min":1.4450000000000001},"min":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"max":{"1min":2.992,"5min":2.992,"15min":2.992},"last":1.45},{"interface":"front","average":{"1min":1.3300000000000001,"5min":1.3300000000000001,"15min":1.3300000000000001},"min":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"max":{"1min":2.7690000000000001,"5min":2.7690000000000001,"15min":2.7690000000000001},"last":1.522}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32422,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32422,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-12T09:44:26.474 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-12-12T09:44:26.474 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-12-12T09:44:26.713 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:26.711+0000 7f0bf3fff640 1 Processor -- start 2023-12-12T09:44:26.713 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:26.712+0000 7f0bf3fff640 1 -- start start 2023-12-12T09:44:26.714 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:26.713+0000 7f0bf3fff640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f0bf40c5070 0x7f0bf4154530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:26.715 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:26.713+0000 7f0bf3fff640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0bf40c1080 con 0x7f0bf414e770 2023-12-12T09:44:26.715 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:26.713+0000 7f0bf3fff640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0bf4155470 con 0x7f0bf40a4f30 2023-12-12T09:44:26.715 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:26.713+0000 7f0bf3fff640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0bf4155190 con 0x7f0bf40c5070 2023-12-12T09:44:26.715 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:26.714+0000 7f0bf2ffd640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f0bf414e770 0x7f0bf40c1510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:49066/0 (socket says 172.21.15.73:49066) 2023-12-12T09:44:26.715 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:26.714+0000 7f0bf2ffd640 1 -- 172.21.15.73:0/475168532 learned_addr learned my addr 172.21.15.73:0/475168532 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-12T09:44:26.717 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:26.714+0000 7f0bf27fc640 1 -- 172.21.15.73:0/475168532 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2533610401 0 0) 0x7f0bf40c1080 con 0x7f0bf414e770 2023-12-12T09:44:26.717 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:26.714+0000 7f0bf27fc640 1 -- 172.21.15.73:0/475168532 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0be0005730 con 0x7f0bf414e770 2023-12-12T09:44:26.717 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:26.714+0000 7f0bf37fe640 1 --2- 172.21.15.73:0/475168532 >> v2:172.21.15.142:3300/0 conn(0x7f0bf40c5070 0x7f0bf4154530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:26.717 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:26.714+0000 7f0bf27fc640 1 -- 172.21.15.73:0/475168532 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3882140070 0 0) 0x7f0be0005730 con 0x7f0bf414e770 2023-12-12T09:44:26.717 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:26.714+0000 7f0bf27fc640 1 -- 172.21.15.73:0/475168532 >> v2:172.21.15.142:3300/0 conn(0x7f0bf40c5070 msgr2=0x7f0bf4154530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:44:26.717 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:26.714+0000 7f0bf27fc640 1 --2- 172.21.15.73:0/475168532 >> v2:172.21.15.142:3300/0 conn(0x7f0bf40c5070 0x7f0bf4154530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:26.717 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:26.714+0000 7f0bf27fc640 1 -- 172.21.15.73:0/475168532 >> v1:172.21.15.142:6789/0 conn(0x7f0bf40a4f30 legacy=0x7f0bf40a9a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:44:26.717 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:26.714+0000 7f0bf27fc640 1 -- 172.21.15.73:0/475168532 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bf40c0d10 con 0x7f0bf414e770 2023-12-12T09:44:26.717 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:26.714+0000 7f0bf27fc640 1 -- 172.21.15.73:0/475168532 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3186547832 0 0) 0x7f0be4001670 con 0x7f0bf414e770 2023-12-12T09:44:26.717 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:26.715+0000 7f0bf27fc640 1 -- 172.21.15.73:0/475168532 >> v1:172.21.15.73:6789/0 conn(0x7f0bf414e770 legacy=0x7f0bf40c1510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:26.718 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:26.715+0000 7f0bf27fc640 1 --2- 172.21.15.73:0/475168532 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0be0005bd0 0x7f0be0005fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:26.718 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:26.715+0000 7f0bf27fc640 1 --2- 172.21.15.73:0/475168532 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0be00069d0 0x7f0be0006e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:26.718 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:26.715+0000 7f0bf27fc640 1 --2- 172.21.15.73:0/475168532 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0be0007390 0x7f0be000ff90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:26.718 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:26.715+0000 7f0bf27fc640 1 -- 172.21.15.73:0/475168532 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bf4155190 con 0x7f0be00069d0 2023-12-12T09:44:26.718 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:26.715+0000 7f0bf27fc640 1 -- 172.21.15.73:0/475168532 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0be0010660 con 0x7f0be0007390 2023-12-12T09:44:26.718 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:26.715+0000 7f0bf27fc640 1 -- 172.21.15.73:0/475168532 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0be0010820 con 0x7f0be0005bd0 2023-12-12T09:44:26.718 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:26.715+0000 7f0bebfff640 1 --2- 172.21.15.73:0/475168532 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0be00069d0 0x7f0be0006e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:26.718 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:26.715+0000 7f0bebfff640 1 -- 172.21.15.73:0/475168532 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0be0005bd0 msgr2=0x7f0be0005fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:44:26.718 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:26.715+0000 7f0bebfff640 1 --2- 172.21.15.73:0/475168532 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0be0005bd0 0x7f0be0005fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:26.718 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:26.715+0000 7f0bebfff640 1 -- 172.21.15.73:0/475168532 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0be0007390 msgr2=0x7f0be000ff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:44:26.718 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:26.715+0000 7f0bebfff640 1 --2- 172.21.15.73:0/475168532 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0be0007390 0x7f0be000ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:26.718 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:26.715+0000 7f0bebfff640 1 -- 172.21.15.73:0/475168532 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0be0005730 con 0x7f0be00069d0 2023-12-12T09:44:26.718 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:26.715+0000 7f0bf37fe640 1 -- 172.21.15.73:0/475168532 reap_dead start 2023-12-12T09:44:26.720 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:26.716+0000 7f0bebfff640 1 --2- 172.21.15.73:0/475168532 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0be00069d0 0x7f0be0006e50 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f0bdc001650 tx=0x7f0be0007a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62659d5970e5b3e6 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:44:26.720 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:26.716+0000 7f0bf27fc640 1 -- 172.21.15.73:0/475168532 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bdc005270 con 0x7f0be00069d0 2023-12-12T09:44:26.720 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:26.716+0000 7f0bf27fc640 1 -- 172.21.15.73:0/475168532 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0bdc02e070 con 0x7f0be00069d0 2023-12-12T09:44:26.720 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:26.716+0000 7f0bf27fc640 1 -- 172.21.15.73:0/475168532 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bdc003610 con 0x7f0be00069d0 2023-12-12T09:44:26.720 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:26.717+0000 7f0bf3fff640 1 -- 172.21.15.73:0/475168532 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0be00069d0 msgr2=0x7f0be0006e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:26.720 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:26.717+0000 7f0bf3fff640 1 --2- 172.21.15.73:0/475168532 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0be00069d0 0x7f0be0006e50 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f0bdc001650 tx=0x7f0be0007a00 comp rx=0 tx=0).stop 2023-12-12T09:44:26.720 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:26.717+0000 7f0bf3fff640 1 -- 172.21.15.73:0/475168532 shutdown_connections 2023-12-12T09:44:26.720 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:26.717+0000 7f0bf3fff640 1 --2- 172.21.15.73:0/475168532 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0be00069d0 0x7f0be0006e50 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:26.721 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:26.717+0000 7f0bf3fff640 1 -- 172.21.15.73:0/475168532 >> 172.21.15.73:0/475168532 conn(0x7f0bf406a4e0 msgr2=0x7f0bf406a8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:44:26.721 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:26.717+0000 7f0bf3fff640 1 -- 172.21.15.73:0/475168532 shutdown_connections 2023-12-12T09:44:26.721 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:26.717+0000 7f0bf3fff640 1 -- 172.21.15.73:0/475168532 wait complete. 2023-12-12T09:44:26.721 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:26.719+0000 7f0bf3fff640 1 Processor -- start 2023-12-12T09:44:26.721 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:26.719+0000 7f0bf3fff640 1 -- start start 2023-12-12T09:44:26.723 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:26.720+0000 7f0bf3fff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0be00069d0 0x7f0bf4145e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:26.723 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:26.720+0000 7f0bf3fff640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0bf4154450 0x7f0bf4143c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:26.723 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:26.720+0000 7f0bf3fff640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0bf41441a0 0x7f0bf41e87b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:26.723 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:26.720+0000 7f0bf3fff640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bf414ef60 con 0x7f0be00069d0 2023-12-12T09:44:26.723 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:26.720+0000 7f0bf3fff640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bf414f220 con 0x7f0bf41441a0 2023-12-12T09:44:26.723 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:26.720+0000 7f0bf3fff640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0bf4151c80 con 0x7f0bf4154450 2023-12-12T09:44:26.723 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:26.720+0000 7f0bf2ffd640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0be00069d0 0x7f0bf4145e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:26.723 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:26.720+0000 7f0bf2ffd640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0be00069d0 0x7f0bf4145e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:42498/0 (socket says 172.21.15.73:42498) 2023-12-12T09:44:26.723 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:26.720+0000 7f0bf2ffd640 1 -- 172.21.15.73:0/397647450 learned_addr learned my addr 172.21.15.73:0/397647450 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:44:26.724 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:26.720+0000 7f0bebfff640 1 --2- 172.21.15.73:0/397647450 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0bf4154450 0x7f0bf4143c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:26.724 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:26.720+0000 7f0bf37fe640 1 --2- 172.21.15.73:0/397647450 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0bf41441a0 0x7f0bf41e87b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:26.724 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:26.720+0000 7f0bf2ffd640 1 -- 172.21.15.73:0/397647450 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0bf4154450 msgr2=0x7f0bf4143c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:26.724 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:26.720+0000 7f0bf2ffd640 1 --2- 172.21.15.73:0/397647450 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0bf4154450 0x7f0bf4143c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:26.724 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:26.720+0000 7f0bf2ffd640 1 -- 172.21.15.73:0/397647450 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0bf41441a0 msgr2=0x7f0bf41e87b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:26.724 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:26.720+0000 7f0bf2ffd640 1 --2- 172.21.15.73:0/397647450 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0bf41441a0 0x7f0bf41e87b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:26.724 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:26.720+0000 7f0bf2ffd640 1 -- 172.21.15.73:0/397647450 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bf41531c0 con 0x7f0be00069d0 2023-12-12T09:44:26.724 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:26.720+0000 7f0bf37fe640 1 --2- 172.21.15.73:0/397647450 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0bf41441a0 0x7f0bf41e87b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:44:26.724 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:26.721+0000 7f0bf2ffd640 1 --2- 172.21.15.73:0/397647450 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0be00069d0 0x7f0bf4145e50 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f0be400c730 tx=0x7f0be400cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:44:26.724 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:26.721+0000 7f0bf0ff9640 1 -- 172.21.15.73:0/397647450 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0be40072d0 con 0x7f0be00069d0 2023-12-12T09:44:26.724 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:26.721+0000 7f0bf0ff9640 1 -- 172.21.15.73:0/397647450 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0be4007430 con 0x7f0be00069d0 2023-12-12T09:44:26.724 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:26.721+0000 7f0bf0ff9640 1 -- 172.21.15.73:0/397647450 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0be40047e0 con 0x7f0be00069d0 2023-12-12T09:44:26.724 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:26.721+0000 7f0bf3fff640 1 -- 172.21.15.73:0/397647450 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0bf41534a0 con 0x7f0be00069d0 2023-12-12T09:44:26.724 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:26.721+0000 7f0bf3fff640 1 -- 172.21.15.73:0/397647450 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0bf4151910 con 0x7f0be00069d0 2023-12-12T09:44:26.724 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:26.722+0000 7f0bf3fff640 1 -- 172.21.15.73:0/397647450 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0bf4144580 con 0x7f0be00069d0 2023-12-12T09:44:26.725 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:26.723+0000 7f0bf0ff9640 1 -- 172.21.15.73:0/397647450 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f0be4004940 con 0x7f0be00069d0 2023-12-12T09:44:26.725 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:26.724+0000 7f0bf0ff9640 1 --2- 172.21.15.73:0/397647450 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f0bd406ae40 0x7f0bd406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:26.725 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:26.724+0000 7f0bf0ff9640 1 -- 172.21.15.73:0/397647450 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0be4088920 con 0x7f0be00069d0 2023-12-12T09:44:26.725 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:26.724+0000 7f0bebfff640 1 --2- 172.21.15.73:0/397647450 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f0bd406ae40 0x7f0bd406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:26.726 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:26.725+0000 7f0bebfff640 1 --2- 172.21.15.73:0/397647450 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f0bd406ae40 0x7f0bd406d300 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f0bdc001650 tx=0x7f0bdc009030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:44:26.735 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:26.729+0000 7f0bf0ff9640 1 -- 172.21.15.73:0/397647450 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f0be4053a70 con 0x7f0be00069d0 2023-12-12T09:44:26.986 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:26.984+0000 7f0bf3fff640 1 -- 172.21.15.73:0/397647450 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f0bf4153690 con 0x7f0be00069d0 2023-12-12T09:44:26.991 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:26.990+0000 7f0bf0ff9640 1 -- 172.21.15.73:0/397647450 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v11) v1 ==== 190+0+147 (secure 0 0 0) 0x7f0be4018020 con 0x7f0be00069d0 2023-12-12T09:44:26.991 INFO:teuthology.orchestra.run.smithi073.stdout:[client.0] 2023-12-12T09:44:26.991 INFO:teuthology.orchestra.run.smithi073.stdout: key = AQD/Knhl/4KuBxAAdAlGb7dYkXXlgPJp0Qcecg== 2023-12-12T09:44:26.991 INFO:teuthology.orchestra.run.smithi073.stdout: caps mds = "allow" 2023-12-12T09:44:26.991 INFO:teuthology.orchestra.run.smithi073.stdout: caps mon = "allow r" 2023-12-12T09:44:26.992 INFO:teuthology.orchestra.run.smithi073.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2023-12-12T09:44:26.992 INFO:teuthology.orchestra.run.smithi073.stderr:updated caps for client.0 2023-12-12T09:44:26.995 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:26.994+0000 7f0bf3fff640 1 -- 172.21.15.73:0/397647450 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f0bd406ae40 msgr2=0x7f0bd406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:26.995 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:26.994+0000 7f0bf3fff640 1 --2- 172.21.15.73:0/397647450 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f0bd406ae40 0x7f0bd406d300 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f0bdc001650 tx=0x7f0bdc009030 comp rx=0 tx=0).stop 2023-12-12T09:44:26.995 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:26.994+0000 7f0bf3fff640 1 -- 172.21.15.73:0/397647450 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0be00069d0 msgr2=0x7f0bf4145e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:26.995 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:26.994+0000 7f0bf3fff640 1 --2- 172.21.15.73:0/397647450 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0be00069d0 0x7f0bf4145e50 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f0be400c730 tx=0x7f0be400cbf0 comp rx=0 tx=0).stop 2023-12-12T09:44:26.996 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:26.994+0000 7f0bf3fff640 1 -- 172.21.15.73:0/397647450 shutdown_connections 2023-12-12T09:44:26.996 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:26.994+0000 7f0bf3fff640 1 --2- 172.21.15.73:0/397647450 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f0bd406ae40 0x7f0bd406d300 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:26.996 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:26.994+0000 7f0bf3fff640 1 --2- 172.21.15.73:0/397647450 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0bf41441a0 0x7f0bf41e87b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:26.996 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:26.994+0000 7f0bf3fff640 1 --2- 172.21.15.73:0/397647450 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0bf4154450 0x7f0bf4143c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:26.996 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:26.994+0000 7f0bf3fff640 1 --2- 172.21.15.73:0/397647450 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0be00069d0 0x7f0bf4145e50 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:26.996 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:26.994+0000 7f0bf3fff640 1 -- 172.21.15.73:0/397647450 >> 172.21.15.73:0/397647450 conn(0x7f0bf406a4e0 msgr2=0x7f0bf406c090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:44:26.996 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:26.994+0000 7f0bf3fff640 1 -- 172.21.15.73:0/397647450 shutdown_connections 2023-12-12T09:44:26.996 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:26.994+0000 7f0bf3fff640 1 -- 172.21.15.73:0/397647450 wait complete. 2023-12-12T09:44:27.013 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-12T09:44:27.224 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:27.223+0000 7f2c252ad640 1 Processor -- start 2023-12-12T09:44:27.224 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:27.223+0000 7f2c252ad640 1 -- start start 2023-12-12T09:44:27.226 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:27.224+0000 7f2c252ad640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f2c200a50f0 0x7f2c200a9050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:27.226 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:27.225+0000 7f2c252ad640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c200c0b50 con 0x7f2c2006bf20 2023-12-12T09:44:27.226 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:27.225+0000 7f2c252ad640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c2006c880 con 0x7f2c201552e0 2023-12-12T09:44:27.226 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:27.225+0000 7f2c252ad640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c200c04d0 con 0x7f2c200a50f0 2023-12-12T09:44:27.226 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:27.225+0000 7f2c1f7fe640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f2c2006bf20 0x7f2c200a9590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:49068/0 (socket says 172.21.15.73:49068) 2023-12-12T09:44:27.226 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:27.225+0000 7f2c1f7fe640 1 -- 172.21.15.73:0/1087814889 learned_addr learned my addr 172.21.15.73:0/1087814889 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-12T09:44:27.228 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:27.225+0000 7f2c167fc640 1 --2- 172.21.15.73:0/1087814889 >> v2:172.21.15.142:3300/0 conn(0x7f2c200a50f0 0x7f2c200a9050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:27.228 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:27.225+0000 7f2c1e7fc640 1 -- 172.21.15.73:0/1087814889 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3552132094 0 0) 0x7f2c200c0b50 con 0x7f2c2006bf20 2023-12-12T09:44:27.228 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:27.225+0000 7f2c1e7fc640 1 -- 172.21.15.73:0/1087814889 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2c0c005730 con 0x7f2c2006bf20 2023-12-12T09:44:27.228 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:27.226+0000 7f2c1e7fc640 1 -- 172.21.15.73:0/1087814889 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 961938489 0 0) 0x7f2c0c005730 con 0x7f2c2006bf20 2023-12-12T09:44:27.228 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:27.226+0000 7f2c1e7fc640 1 -- 172.21.15.73:0/1087814889 >> v2:172.21.15.142:3300/0 conn(0x7f2c200a50f0 msgr2=0x7f2c200a9050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:44:27.228 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:27.226+0000 7f2c1e7fc640 1 --2- 172.21.15.73:0/1087814889 >> v2:172.21.15.142:3300/0 conn(0x7f2c200a50f0 0x7f2c200a9050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:27.228 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:27.226+0000 7f2c1e7fc640 1 -- 172.21.15.73:0/1087814889 >> v1:172.21.15.142:6789/0 conn(0x7f2c201552e0 legacy=0x7f2c200c49c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:27.228 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:27.226+0000 7f2c1e7fc640 1 -- 172.21.15.73:0/1087814889 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c2006cb60 con 0x7f2c2006bf20 2023-12-12T09:44:27.229 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:27.226+0000 7f2c1e7fc640 1 -- 172.21.15.73:0/1087814889 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3186547832 0 0) 0x7f2c180019f0 con 0x7f2c2006bf20 2023-12-12T09:44:27.229 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:27.226+0000 7f2c1e7fc640 1 -- 172.21.15.73:0/1087814889 >> v1:172.21.15.73:6789/0 conn(0x7f2c2006bf20 legacy=0x7f2c200a9590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:27.229 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:27.226+0000 7f2c1e7fc640 1 --2- 172.21.15.73:0/1087814889 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2c0c005b80 0x7f2c0c005fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:27.229 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:27.226+0000 7f2c1e7fc640 1 --2- 172.21.15.73:0/1087814889 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2c0c0069d0 0x7f2c0c006e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:27.229 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:27.226+0000 7f2c1e7fc640 1 --2- 172.21.15.73:0/1087814889 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2c0c007390 0x7f2c0c00db90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:27.229 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:27.226+0000 7f2c1e7fc640 1 -- 172.21.15.73:0/1087814889 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c200c04d0 con 0x7f2c0c0069d0 2023-12-12T09:44:27.229 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:27.226+0000 7f2c1e7fc640 1 -- 172.21.15.73:0/1087814889 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c0c00e330 con 0x7f2c0c007390 2023-12-12T09:44:27.229 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:27.226+0000 7f2c1e7fc640 1 -- 172.21.15.73:0/1087814889 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c0c00e4f0 con 0x7f2c0c005b80 2023-12-12T09:44:27.229 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:27.226+0000 7f2c167fc640 1 --2- 172.21.15.73:0/1087814889 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2c0c0069d0 0x7f2c0c006e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:27.229 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:27.227+0000 7f2c1f7fe640 1 --2- 172.21.15.73:0/1087814889 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2c0c007390 0x7f2c0c00db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:27.229 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:27.227+0000 7f2c1effd640 1 --2- 172.21.15.73:0/1087814889 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2c0c005b80 0x7f2c0c005fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:27.229 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:27.227+0000 7f2c167fc640 1 -- 172.21.15.73:0/1087814889 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2c0c005b80 msgr2=0x7f2c0c005fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:44:27.229 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:27.227+0000 7f2c167fc640 1 --2- 172.21.15.73:0/1087814889 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2c0c005b80 0x7f2c0c005fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:27.229 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:27.227+0000 7f2c167fc640 1 -- 172.21.15.73:0/1087814889 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2c0c007390 msgr2=0x7f2c0c00db90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:44:27.230 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:27.227+0000 7f2c167fc640 1 --2- 172.21.15.73:0/1087814889 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2c0c007390 0x7f2c0c00db90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:27.230 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:27.227+0000 7f2c167fc640 1 -- 172.21.15.73:0/1087814889 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c0c005730 con 0x7f2c0c0069d0 2023-12-12T09:44:27.230 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:27.227+0000 7f2c1f7fe640 1 --2- 172.21.15.73:0/1087814889 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2c0c007390 0x7f2c0c00db90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:44:27.230 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:27.227+0000 7f2c1f7fe640 1 -- 172.21.15.73:0/1087814889 reap_dead start 2023-12-12T09:44:27.231 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:27.228+0000 7f2c167fc640 1 --2- 172.21.15.73:0/1087814889 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2c0c0069d0 0x7f2c0c006e50 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f2c08009a90 tx=0x7f2c0c007a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc1dd715c5b38e93 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:44:27.231 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:27.228+0000 7f2c1e7fc640 1 -- 172.21.15.73:0/1087814889 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c0802c680 con 0x7f2c0c0069d0 2023-12-12T09:44:27.231 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:27.228+0000 7f2c1e7fc640 1 -- 172.21.15.73:0/1087814889 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c0802c7e0 con 0x7f2c0c0069d0 2023-12-12T09:44:27.231 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:27.228+0000 7f2c1e7fc640 1 -- 172.21.15.73:0/1087814889 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c0802cb70 con 0x7f2c0c0069d0 2023-12-12T09:44:27.231 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:27.228+0000 7f2c252ad640 1 -- 172.21.15.73:0/1087814889 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2c0c0069d0 msgr2=0x7f2c0c006e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:27.231 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:27.228+0000 7f2c252ad640 1 --2- 172.21.15.73:0/1087814889 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2c0c0069d0 0x7f2c0c006e50 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f2c08009a90 tx=0x7f2c0c007a00 comp rx=0 tx=0).stop 2023-12-12T09:44:27.231 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:27.229+0000 7f2c252ad640 1 -- 172.21.15.73:0/1087814889 shutdown_connections 2023-12-12T09:44:27.231 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:27.229+0000 7f2c252ad640 1 --2- 172.21.15.73:0/1087814889 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2c0c0069d0 0x7f2c0c006e50 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:27.231 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:27.229+0000 7f2c252ad640 1 -- 172.21.15.73:0/1087814889 >> 172.21.15.73:0/1087814889 conn(0x7f2c200a8130 msgr2=0x7f2c200c24b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:44:27.232 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:27.229+0000 7f2c252ad640 1 -- 172.21.15.73:0/1087814889 shutdown_connections 2023-12-12T09:44:27.232 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:27.229+0000 7f2c252ad640 1 -- 172.21.15.73:0/1087814889 wait complete. 2023-12-12T09:44:27.232 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:27.230+0000 7f2c252ad640 1 Processor -- start 2023-12-12T09:44:27.233 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:27.230+0000 7f2c252ad640 1 -- start start 2023-12-12T09:44:27.233 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:27.231+0000 7f2c252ad640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2c0c0069d0 0x7f2c20150660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:27.233 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:27.231+0000 7f2c252ad640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2c201dd500 0x7f2c2014b060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:27.233 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:27.231+0000 7f2c252ad640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2c201ea840 0x7f2c201ed3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:27.233 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:27.231+0000 7f2c252ad640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c201dd020 con 0x7f2c201ea840 2023-12-12T09:44:27.233 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:27.231+0000 7f2c252ad640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c201ead40 con 0x7f2c201dd500 2023-12-12T09:44:27.233 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:27.231+0000 7f2c252ad640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c201db320 con 0x7f2c0c0069d0 2023-12-12T09:44:27.233 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:27.232+0000 7f2c1f7fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2c201ea840 0x7f2c201ed3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:27.233 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:27.232+0000 7f2c1f7fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2c201ea840 0x7f2c201ed3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:42524/0 (socket says 172.21.15.73:42524) 2023-12-12T09:44:27.233 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:27.232+0000 7f2c1f7fe640 1 -- 172.21.15.73:0/290653516 learned_addr learned my addr 172.21.15.73:0/290653516 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:44:27.234 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:27.232+0000 7f2c1f7fe640 1 -- 172.21.15.73:0/290653516 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2c0c0069d0 msgr2=0x7f2c20150660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:27.234 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:27.232+0000 7f2c1f7fe640 1 --2- 172.21.15.73:0/290653516 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2c0c0069d0 0x7f2c20150660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:27.234 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:27.232+0000 7f2c1f7fe640 1 -- 172.21.15.73:0/290653516 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2c201dd500 msgr2=0x7f2c2014b060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:27.234 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:27.232+0000 7f2c1f7fe640 1 --2- 172.21.15.73:0/290653516 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2c201dd500 0x7f2c2014b060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:27.235 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:27.232+0000 7f2c1f7fe640 1 -- 172.21.15.73:0/290653516 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c201db600 con 0x7f2c201ea840 2023-12-12T09:44:27.235 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:27.232+0000 7f2c1f7fe640 1 --2- 172.21.15.73:0/290653516 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2c201ea840 0x7f2c201ed3b0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f2c180012e0 tx=0x7f2c1800b4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:44:27.235 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:27.233+0000 7f2c17fff640 1 -- 172.21.15.73:0/290653516 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c18004d60 con 0x7f2c201ea840 2023-12-12T09:44:27.235 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:27.233+0000 7f2c17fff640 1 -- 172.21.15.73:0/290653516 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c1800bb80 con 0x7f2c201ea840 2023-12-12T09:44:27.235 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:27.233+0000 7f2c252ad640 1 -- 172.21.15.73:0/290653516 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c20150ba0 con 0x7f2c201ea840 2023-12-12T09:44:27.235 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:27.233+0000 7f2c17fff640 1 -- 172.21.15.73:0/290653516 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c18007110 con 0x7f2c201ea840 2023-12-12T09:44:27.235 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:27.233+0000 7f2c252ad640 1 -- 172.21.15.73:0/290653516 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c201db8e0 con 0x7f2c201ea840 2023-12-12T09:44:27.235 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:27.234+0000 7f2c252ad640 1 -- 172.21.15.73:0/290653516 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c20067580 con 0x7f2c201ea840 2023-12-12T09:44:27.236 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:27.235+0000 7f2c17fff640 1 -- 172.21.15.73:0/290653516 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f2c18007270 con 0x7f2c201ea840 2023-12-12T09:44:27.237 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:27.236+0000 7f2c17fff640 1 --2- 172.21.15.73:0/290653516 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f2c0006ae70 0x7f2c0006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:27.237 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:27.236+0000 7f2c17fff640 1 -- 172.21.15.73:0/290653516 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2c18089820 con 0x7f2c201ea840 2023-12-12T09:44:27.237 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:27.236+0000 7f2c1effd640 1 --2- 172.21.15.73:0/290653516 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f2c0006ae70 0x7f2c0006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:27.238 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:27.237+0000 7f2c1effd640 1 --2- 172.21.15.73:0/290653516 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f2c0006ae70 0x7f2c0006d330 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f2c20067ab0 tx=0x7f2c10009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:44:27.242 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:27.241+0000 7f2c17fff640 1 -- 172.21.15.73:0/290653516 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f2c180548c0 con 0x7f2c201ea840 2023-12-12T09:44:27.471 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:27.469+0000 7f2c252ad640 1 -- 172.21.15.73:0/290653516 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2c2006ddd0 con 0x7f2c201ea840 2023-12-12T09:44:27.472 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:27.471+0000 7f2c17fff640 1 -- 172.21.15.73:0/290653516 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) v1 ==== 94+0+4916 (secure 0 0 0) 0x7f2c18057ee0 con 0x7f2c201ea840 2023-12-12T09:44:27.472 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-12T09:44:27.472 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":15,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4517,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6835/2407815368","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6833","nonce":2407815368},{"type":"v1","addr":"172.21.15.142:6835","nonce":2407815368}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":4720,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6834/153753304","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6832","nonce":153753304},{"type":"v1","addr":"172.21.15.142:6834","nonce":153753304}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":4962,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6836/2500303907","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":2500303907},{"type":"v1","addr":"172.21.15.73:6836","nonce":2500303907}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-12T09:44:20.925302+0000","modified":"2023-12-12T09:44:24.049947+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4965},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4965":{"gid":4965,"name":"c","rank":0,"incarnation":12,"state":"up:active","state_seq":4,"addr":"172.21.15.73:6837/1534083424","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6835","nonce":1534083424},{"type":"v1","addr":"172.21.15.73:6837","nonce":1534083424}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-12-12T09:44:27.472 INFO:teuthology.orchestra.run.smithi073.stderr:dumped fsmap epoch 15 2023-12-12T09:44:27.475 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:27.473+0000 7f2c252ad640 1 -- 172.21.15.73:0/290653516 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f2c0006ae70 msgr2=0x7f2c0006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:27.475 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:27.473+0000 7f2c252ad640 1 --2- 172.21.15.73:0/290653516 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f2c0006ae70 0x7f2c0006d330 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f2c20067ab0 tx=0x7f2c10009040 comp rx=0 tx=0).stop 2023-12-12T09:44:27.475 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:27.474+0000 7f2c252ad640 1 -- 172.21.15.73:0/290653516 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2c201ea840 msgr2=0x7f2c201ed3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:27.475 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:27.474+0000 7f2c252ad640 1 --2- 172.21.15.73:0/290653516 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2c201ea840 0x7f2c201ed3b0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f2c180012e0 tx=0x7f2c1800b4a0 comp rx=0 tx=0).stop 2023-12-12T09:44:27.475 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:27.474+0000 7f2c252ad640 1 -- 172.21.15.73:0/290653516 shutdown_connections 2023-12-12T09:44:27.476 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:27.474+0000 7f2c252ad640 1 --2- 172.21.15.73:0/290653516 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f2c0006ae70 0x7f2c0006d330 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:27.476 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:27.474+0000 7f2c252ad640 1 --2- 172.21.15.73:0/290653516 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2c201ea840 0x7f2c201ed3b0 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:27.476 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:27.474+0000 7f2c252ad640 1 --2- 172.21.15.73:0/290653516 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2c201dd500 0x7f2c2014b060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:27.476 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:27.474+0000 7f2c252ad640 1 --2- 172.21.15.73:0/290653516 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2c0c0069d0 0x7f2c20150660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:27.476 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:27.474+0000 7f2c252ad640 1 -- 172.21.15.73:0/290653516 >> 172.21.15.73:0/290653516 conn(0x7f2c200a8130 msgr2=0x7f2c200c4120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:44:27.476 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:27.474+0000 7f2c252ad640 1 -- 172.21.15.73:0/290653516 shutdown_connections 2023-12-12T09:44:27.476 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:27.474+0000 7f2c252ad640 1 -- 172.21.15.73:0/290653516 wait complete. 2023-12-12T09:44:27.897 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 15, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-12-12T09:44:20.925302+0000', 'modified': '2023-12-12T09:44:24.049947+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4965}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4965': {'gid': 4965, 'name': 'c', 'rank': 0, 'incarnation': 12, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.73:6837/1534083424', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.73:6835', 'nonce': 1534083424}, {'type': 'v1', 'addr': '172.21.15.73:6837', 'nonce': 1534083424}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [5], 'metadata_pool': 4, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-12-12T09:44:27.898 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-12-12T09:44:27.898 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-12-12T09:44:28.120 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:28.118+0000 7fe157d0f640 1 Processor -- start 2023-12-12T09:44:28.120 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:28.118+0000 7fe157d0f640 1 -- start start 2023-12-12T09:44:28.122 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:28.120+0000 7fe157d0f640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fe150155dd0 0x7fe150159440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:28.122 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:28.120+0000 7fe157d0f640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fe1500c0710 0x7fe1500c0c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:28.122 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:28.120+0000 7fe157d0f640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe15006c9d0 con 0x7fe1500c11a0 2023-12-12T09:44:28.122 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:28.120+0000 7fe157d0f640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1500c1b80 con 0x7fe150155dd0 2023-12-12T09:44:28.122 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:28.120+0000 7fe157d0f640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1500c1e60 con 0x7fe1500c0710 2023-12-12T09:44:28.122 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:28.120+0000 7fe155aab640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fe150155dd0 0x7fe150159440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:28.122 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:28.120+0000 7fe155aab640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fe150155dd0 0x7fe150159440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:42526/0 (socket says 172.21.15.73:42526) 2023-12-12T09:44:28.122 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:28.120+0000 7fe155aab640 1 -- 172.21.15.73:0/3307761391 learned_addr learned my addr 172.21.15.73:0/3307761391 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:44:28.122 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:28.121+0000 7fe155aab640 1 -- 172.21.15.73:0/3307761391 >> v2:172.21.15.142:3300/0 conn(0x7fe1500c0710 msgr2=0x7fe1500c0c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:44:28.123 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:28.121+0000 7fe1552aa640 1 --2- 172.21.15.73:0/3307761391 >> v2:172.21.15.142:3300/0 conn(0x7fe1500c0710 0x7fe1500c0c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:28.123 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:28.121+0000 7fe155aab640 1 --2- 172.21.15.73:0/3307761391 >> v2:172.21.15.142:3300/0 conn(0x7fe1500c0710 0x7fe1500c0c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:28.123 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:28.121+0000 7fe155aab640 1 -- 172.21.15.73:0/3307761391 >> v1:172.21.15.142:6789/0 conn(0x7fe1500c11a0 legacy=0x7fe150071cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:44:28.123 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:28.121+0000 7fe155aab640 1 -- 172.21.15.73:0/3307761391 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe15006c660 con 0x7fe150155dd0 2023-12-12T09:44:28.124 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:28.122+0000 7fe155aab640 1 --2- 172.21.15.73:0/3307761391 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe150155dd0 0x7fe150159440 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fe15006b5a0 tx=0x7fe14402bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=546c2f8d439c8499 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:44:28.124 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:28.122+0000 7fe154aa9640 1 -- 172.21.15.73:0/3307761391 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe14402ca80 con 0x7fe150155dd0 2023-12-12T09:44:28.124 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:28.122+0000 7fe154aa9640 1 -- 172.21.15.73:0/3307761391 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe14402cbe0 con 0x7fe150155dd0 2023-12-12T09:44:28.124 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:28.122+0000 7fe154aa9640 1 -- 172.21.15.73:0/3307761391 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1440343f0 con 0x7fe150155dd0 2023-12-12T09:44:28.124 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:28.123+0000 7fe157d0f640 1 -- 172.21.15.73:0/3307761391 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe150155dd0 msgr2=0x7fe150159440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:28.124 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:28.123+0000 7fe157d0f640 1 --2- 172.21.15.73:0/3307761391 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe150155dd0 0x7fe150159440 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fe15006b5a0 tx=0x7fe14402bee0 comp rx=0 tx=0).stop 2023-12-12T09:44:28.124 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:28.123+0000 7fe157d0f640 1 -- 172.21.15.73:0/3307761391 shutdown_connections 2023-12-12T09:44:28.125 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:28.123+0000 7fe157d0f640 1 --2- 172.21.15.73:0/3307761391 >> v2:172.21.15.142:3300/0 conn(0x7fe1500c0710 0x7fe1500c0c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:28.125 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:28.123+0000 7fe157d0f640 1 --2- 172.21.15.73:0/3307761391 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe150155dd0 0x7fe150159440 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:28.125 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:28.123+0000 7fe157d0f640 1 -- 172.21.15.73:0/3307761391 >> 172.21.15.73:0/3307761391 conn(0x7fe1500a77d0 msgr2=0x7fe1500a7bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:44:28.125 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:28.123+0000 7fe157d0f640 1 -- 172.21.15.73:0/3307761391 shutdown_connections 2023-12-12T09:44:28.125 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:28.123+0000 7fe157d0f640 1 -- 172.21.15.73:0/3307761391 wait complete. 2023-12-12T09:44:28.126 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:28.125+0000 7fe157d0f640 1 Processor -- start 2023-12-12T09:44:28.126 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:28.125+0000 7fe157d0f640 1 -- start start 2023-12-12T09:44:28.128 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:28.127+0000 7fe157d0f640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe1500c0710 0x7fe1501ee680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:28.128 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:28.127+0000 7fe157d0f640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe1500c11a0 0x7fe1500a6170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:28.128 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:28.127+0000 7fe157d0f640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe150155dd0 0x7fe150152c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:28.129 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:28.127+0000 7fe157d0f640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1500a27f0 con 0x7fe1500c0710 2023-12-12T09:44:28.129 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:28.127+0000 7fe157d0f640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1501eebc0 con 0x7fe150155dd0 2023-12-12T09:44:28.129 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:28.127+0000 7fe157d0f640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1500a3390 con 0x7fe1500c11a0 2023-12-12T09:44:28.129 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:28.127+0000 7fe155aab640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe1500c0710 0x7fe1501ee680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:28.129 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:28.127+0000 7fe155aab640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe1500c0710 0x7fe1501ee680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:42532/0 (socket says 172.21.15.73:42532) 2023-12-12T09:44:28.129 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:28.127+0000 7fe155aab640 1 -- 172.21.15.73:0/2843333452 learned_addr learned my addr 172.21.15.73:0/2843333452 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:44:28.129 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:28.127+0000 7fe155aab640 1 -- 172.21.15.73:0/2843333452 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe1500c11a0 msgr2=0x7fe1500a6170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:28.129 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:28.127+0000 7fe155aab640 1 --2- 172.21.15.73:0/2843333452 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe1500c11a0 0x7fe1500a6170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:28.129 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:28.127+0000 7fe155aab640 1 -- 172.21.15.73:0/2843333452 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe150155dd0 msgr2=0x7fe150152c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:28.129 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:28.127+0000 7fe155aab640 1 --2- 172.21.15.73:0/2843333452 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe150155dd0 0x7fe150152c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:28.129 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:28.127+0000 7fe155aab640 1 -- 172.21.15.73:0/2843333452 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe144009b30 con 0x7fe1500c0710 2023-12-12T09:44:28.129 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:28.128+0000 7fe155aab640 1 --2- 172.21.15.73:0/2843333452 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe1500c0710 0x7fe1501ee680 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fe144000f80 tx=0x7fe144004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:44:28.130 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:28.128+0000 7fe14e7fc640 1 -- 172.21.15.73:0/2843333452 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe14403e450 con 0x7fe1500c0710 2023-12-12T09:44:28.130 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:28.128+0000 7fe14e7fc640 1 -- 172.21.15.73:0/2843333452 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe14403e5f0 con 0x7fe1500c0710 2023-12-12T09:44:28.130 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:28.128+0000 7fe14e7fc640 1 -- 172.21.15.73:0/2843333452 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe14403e9a0 con 0x7fe1500c0710 2023-12-12T09:44:28.130 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:28.128+0000 7fe157d0f640 1 -- 172.21.15.73:0/2843333452 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1501563c0 con 0x7fe1500c0710 2023-12-12T09:44:28.130 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:28.128+0000 7fe157d0f640 1 -- 172.21.15.73:0/2843333452 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1500a2d40 con 0x7fe1500c0710 2023-12-12T09:44:28.132 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:28.130+0000 7fe14e7fc640 1 -- 172.21.15.73:0/2843333452 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fe14402cd50 con 0x7fe1500c0710 2023-12-12T09:44:28.133 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:28.131+0000 7fe14e7fc640 1 --2- 172.21.15.73:0/2843333452 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fe13406ae40 0x7fe13406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:28.134 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:28.131+0000 7fe14e7fc640 1 -- 172.21.15.73:0/2843333452 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe1440ac270 con 0x7fe1500c0710 2023-12-12T09:44:28.134 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:28.132+0000 7fe1552aa640 1 --2- 172.21.15.73:0/2843333452 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fe13406ae40 0x7fe13406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:28.134 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:28.132+0000 7fe15a97e740 1 Processor -- start 2023-12-12T09:44:28.134 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:28.132+0000 7fe15a97e740 1 -- start start 2023-12-12T09:44:28.136 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:28.132+0000 7fe1552aa640 1 --2- 172.21.15.73:0/2843333452 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fe13406ae40 0x7fe13406d300 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fe13c006fd0 tx=0x7fe13c008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:44:28.136 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:28.133+0000 7fe15a97e740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55aad5e8bab0 0x55aad5ec63a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:28.137 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:28.133+0000 7fe15a97e740 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55aad5e8be90 0x55aad5ec68e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:28.137 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:28.133+0000 7fe15a97e740 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55aad5e8cb40 0x55aad5ec7910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:28.137 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:28.133+0000 7fe15a97e740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aad5df8f40 con 0x55aad5e8bab0 2023-12-12T09:44:28.137 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:28.133+0000 7fe15a97e740 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aad5df6630 con 0x55aad5e8be90 2023-12-12T09:44:28.137 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:28.133+0000 7fe15a97e740 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x55aad5df1f20 con 0x55aad5e8cb40 2023-12-12T09:44:28.137 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:28.133+0000 7fe155aab640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55aad5e8bab0 0x55aad5ec63a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:28.137 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:28.133+0000 7fe155aab640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55aad5e8bab0 0x55aad5ec63a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:42536/0 (socket says 172.21.15.73:42536) 2023-12-12T09:44:28.137 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:28.133+0000 7fe155aab640 1 -- 172.21.15.73:0/4226503206 learned_addr learned my addr 172.21.15.73:0/4226503206 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:44:28.137 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:28.133+0000 7fe155aab640 1 -- 172.21.15.73:0/4226503206 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55aad5e8cb40 msgr2=0x55aad5ec7910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:44:28.137 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:28.133+0000 7fe155aab640 1 --2- 172.21.15.73:0/4226503206 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55aad5e8cb40 0x55aad5ec7910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:28.137 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:28.133+0000 7fe155aab640 1 -- 172.21.15.73:0/4226503206 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55aad5e8be90 msgr2=0x55aad5ec68e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:44:28.137 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:28.133+0000 7fe155aab640 1 --2- 172.21.15.73:0/4226503206 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55aad5e8be90 0x55aad5ec68e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:28.137 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:28.133+0000 7fe155aab640 1 -- 172.21.15.73:0/4226503206 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55aad5db4910 con 0x55aad5e8bab0 2023-12-12T09:44:28.138 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:28.134+0000 7fe155aab640 1 --2- 172.21.15.73:0/4226503206 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55aad5e8bab0 0x55aad5ec63a0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fe144082da0 tx=0x7fe14407a930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89b5f90fed11d65 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:44:28.138 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:28.134+0000 7fe1337fe640 1 -- 172.21.15.73:0/4226503206 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe14407afd0 con 0x55aad5e8bab0 2023-12-12T09:44:28.138 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:28.134+0000 7fe1337fe640 1 -- 172.21.15.73:0/4226503206 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe14407f120 con 0x55aad5e8bab0 2023-12-12T09:44:28.138 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:28.134+0000 7fe1337fe640 1 -- 172.21.15.73:0/4226503206 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1440832d0 con 0x55aad5e8bab0 2023-12-12T09:44:28.138 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:28.134+0000 7fe15a97e740 1 -- 172.21.15.73:0/4226503206 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55aad5e8bab0 msgr2=0x55aad5ec63a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:28.138 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:28.134+0000 7fe15a97e740 1 --2- 172.21.15.73:0/4226503206 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55aad5e8bab0 0x55aad5ec63a0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fe144082da0 tx=0x7fe14407a930 comp rx=0 tx=0).stop 2023-12-12T09:44:28.138 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:28.135+0000 7fe15a97e740 1 -- 172.21.15.73:0/4226503206 shutdown_connections 2023-12-12T09:44:28.138 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:28.135+0000 7fe15a97e740 1 --2- 172.21.15.73:0/4226503206 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55aad5e8cb40 0x55aad5ec7910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:28.138 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:28.135+0000 7fe15a97e740 1 --2- 172.21.15.73:0/4226503206 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55aad5e8be90 0x55aad5ec68e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:28.138 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:28.135+0000 7fe15a97e740 1 --2- 172.21.15.73:0/4226503206 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55aad5e8bab0 0x55aad5ec63a0 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:28.138 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:28.135+0000 7fe15a97e740 1 -- 172.21.15.73:0/4226503206 >> 172.21.15.73:0/4226503206 conn(0x55aad5e88410 msgr2=0x55aad5eacb90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:44:28.138 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:28.135+0000 7fe15a97e740 1 -- 172.21.15.73:0/4226503206 shutdown_connections 2023-12-12T09:44:28.138 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:28.135+0000 7fe15a97e740 1 -- 172.21.15.73:0/4226503206 wait complete. 2023-12-12T09:44:28.138 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:28.135+0000 7fe15a97e740 1 -- start start 2023-12-12T09:44:28.139 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:28.136+0000 7fe15a97e740 1 Processor -- start 2023-12-12T09:44:28.143 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:28.137+0000 7fe15a97e740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55aad5e8be90 0x55aad5eb0400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:28.143 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:28.137+0000 7fe15a97e740 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55aad5e8cb40 0x55aad5eae320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:28.143 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:28.137+0000 7fe15a97e740 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55aad5eae860 0x55aad5ea9780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:28.143 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:28.137+0000 7fe15a97e740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aad5d8e2f0 con 0x55aad5e8be90 2023-12-12T09:44:28.143 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:28.137+0000 7fe15a97e740 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aad5dabc70 con 0x55aad5eae860 2023-12-12T09:44:28.143 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:28.137+0000 7fe15a97e740 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x55aad5b54f20 con 0x55aad5e8cb40 2023-12-12T09:44:28.143 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:28.137+0000 7fe15a97e740 10 client.0 _ll_register_callbacks cb 0x55aad5db03b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-12T09:44:28.146 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:28.137+0000 7fe155aab640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55aad5e8be90 0x55aad5eb0400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:28.146 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:28.137+0000 7fe155aab640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55aad5e8be90 0x55aad5eb0400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:42546/0 (socket says 172.21.15.73:42546) 2023-12-12T09:44:28.146 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:28.137+0000 7fe155aab640 1 -- 172.21.15.73:0/1529348646 learned_addr learned my addr 172.21.15.73:0/1529348646 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:44:28.146 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:28.137+0000 7fe155aab640 1 -- 172.21.15.73:0/1529348646 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55aad5e8cb40 msgr2=0x55aad5eae320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:44:28.146 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:28.137+0000 7fe155aab640 1 --2- 172.21.15.73:0/1529348646 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55aad5e8cb40 0x55aad5eae320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:28.147 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:28.137+0000 7fe155aab640 1 -- 172.21.15.73:0/1529348646 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55aad5eae860 msgr2=0x55aad5ea9780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:44:28.147 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:28.137+0000 7fe155aab640 1 --2- 172.21.15.73:0/1529348646 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55aad5eae860 0x55aad5ea9780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:28.147 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:28.137+0000 7fe155aab640 1 -- 172.21.15.73:0/1529348646 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1500a2d40 con 0x55aad5e8be90 2023-12-12T09:44:28.147 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:28.138+0000 7fe155aab640 1 --2- 172.21.15.73:0/1529348646 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55aad5e8be90 0x55aad5eb0400 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fe1440774d0 tx=0x7fe1440ac040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b210038d2a74f198 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:44:28.147 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:28.138+0000 7fe130ff9640 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2023-12-12T09:44:28.147 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:28.138+0000 7fe130ff9640 1 -- 172.21.15.73:0/1529348646 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe144081270 con 0x55aad5e8be90 2023-12-12T09:44:28.147 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:28.138+0000 7fe130ff9640 1 -- 172.21.15.73:0/1529348646 <== mon.0 v2:172.21.15.73:3300/0 2 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe1440832d0 con 0x55aad5e8be90 2023-12-12T09:44:28.147 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:28.138+0000 7fe15a97e740 1 -- 172.21.15.73:0/1529348646 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55aad5deadb0 con 0x55aad5e8be90 2023-12-12T09:44:28.148 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:28.138+0000 7fe130ff9640 1 -- 172.21.15.73:0/1529348646 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=15) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe1440aa290 con 0x55aad5e8be90 2023-12-12T09:44:28.148 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:28.138+0000 7fe15a97e740 10 client.5133 fetch_fsmap learned FSMap version 15 2023-12-12T09:44:28.148 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:28.138+0000 7fe15a97e740 1 -- 172.21.15.73:0/1529348646 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=15,monmap=2+}) v3 -- 0x55aad5df05a0 con 0x55aad5e8be90 2023-12-12T09:44:28.148 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:28.138+0000 7fe130ff9640 1 -- 172.21.15.73:0/1529348646 <== mon.0 v2:172.21.15.73:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe14409d080 con 0x55aad5e8be90 2023-12-12T09:44:28.148 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:28.138+0000 7fe130ff9640 1 -- 172.21.15.73:0/1529348646 <== mon.0 v2:172.21.15.73:3300/0 5 ==== fsmap(e 15) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fe14408ed20 con 0x55aad5e8be90 2023-12-12T09:44:28.148 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:28.138+0000 7fe15a97e740 10 client.5133 fetch_fsmap finished waiting for FSMap version 15 2023-12-12T09:44:28.148 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:28.138+0000 7fe15a97e740 10 client.5133 resolve_mds: resolved name 'c' to daemon mds.c 2023-12-12T09:44:28.148 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:28.138+0000 7fe15a97e740 20 client.5133 populate_metadata read hostname 'smithi073' 2023-12-12T09:44:28.148 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:28.138+0000 7fe15a97e740 1 --2- 172.21.15.73:0/1529348646 >> [v2:172.21.15.73:6835/1534083424,v1:172.21.15.73:6837/1534083424] conn(0x55aad5ea9fa0 0x55aad5edb1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:28.148 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:28.138+0000 7fe15a97e740 4 client.5133 mds_command: new command op to 4965 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-12-12T09:44:28.148 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:28.138+0000 7fe15a97e740 1 -- 172.21.15.73:0/1529348646 --> [v2:172.21.15.73:6835/1534083424,v1:172.21.15.73:6837/1534083424] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55aad5deaad0 con 0x55aad5ea9fa0 2023-12-12T09:44:28.148 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:28.139+0000 7fe1552aa640 1 --2- 172.21.15.73:0/1529348646 >> [v2:172.21.15.73:6835/1534083424,v1:172.21.15.73:6837/1534083424] conn(0x55aad5ea9fa0 0x55aad5edb1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:28.149 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:28.139+0000 7fe1552aa640 1 --2- 172.21.15.73:0/1529348646 >> [v2:172.21.15.73:6835/1534083424,v1:172.21.15.73:6837/1534083424] conn(0x55aad5ea9fa0 0x55aad5edb1e0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ef5e9da79c0a1096 server_cookie=3b763d41b1873b5f in_seq=0 out_seq=0 2023-12-12T09:44:28.149 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:28.139+0000 7fe130ff9640 10 client.5133 ms_handle_connect on v2:172.21.15.73:6835/1534083424 2023-12-12T09:44:28.149 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:28.140+0000 7fe130ff9640 1 -- 172.21.15.73:0/1529348646 <== mds.0 v2:172.21.15.73:6835/1534083424 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55aad5deaad0 con 0x55aad5ea9fa0 2023-12-12T09:44:28.149 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:28.140+0000 7fe130ff9640 10 client.5133 handle_command_reply: tid=0 2023-12-12T09:44:28.149 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:28.140+0000 7fe15a97e740 1 client.5133 shutdown 2023-12-12T09:44:28.149 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:28.140+0000 7fe15a97e740 1 -- 172.21.15.73:0/1529348646 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55aad5e8be90 msgr2=0x55aad5eb0400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:28.149 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:28.140+0000 7fe15a97e740 1 --2- 172.21.15.73:0/1529348646 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55aad5e8be90 0x55aad5eb0400 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fe1440774d0 tx=0x7fe1440ac040 comp rx=0 tx=0).stop 2023-12-12T09:44:28.149 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:28.140+0000 7fe15a97e740 1 -- 172.21.15.73:0/1529348646 shutdown_connections 2023-12-12T09:44:28.149 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:28.140+0000 7fe15a97e740 1 --2- 172.21.15.73:0/1529348646 >> [v2:172.21.15.73:6835/1534083424,v1:172.21.15.73:6837/1534083424] conn(0x55aad5ea9fa0 0x55aad5edb1e0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:28.149 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:28.140+0000 7fe15a97e740 1 --2- 172.21.15.73:0/1529348646 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55aad5eae860 0x55aad5ea9780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:28.150 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:28.140+0000 7fe15a97e740 1 --2- 172.21.15.73:0/1529348646 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55aad5e8cb40 0x55aad5eae320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:28.150 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:28.140+0000 7fe15a97e740 1 --2- 172.21.15.73:0/1529348646 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55aad5e8be90 0x55aad5eb0400 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:28.150 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:28.140+0000 7fe130ff9640 0 client.5133 ms_handle_reset on v2:172.21.15.73:6835/1534083424 2023-12-12T09:44:28.150 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:28.140+0000 7fe15a97e740 1 -- 172.21.15.73:0/1529348646 >> 172.21.15.73:0/1529348646 conn(0x55aad5e8bab0 msgr2=0x55aad5e852e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:44:28.150 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:28.140+0000 7fe15a97e740 1 -- 172.21.15.73:0/1529348646 shutdown_connections 2023-12-12T09:44:28.150 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:28.140+0000 7fe15a97e740 1 -- 172.21.15.73:0/1529348646 wait complete. 2023-12-12T09:44:28.150 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:28.141+0000 7fe15a97e740 20 client.5133 trim_cache size 0 max 16384 2023-12-12T09:44:28.158 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:28.157+0000 7fe15a97e740 1 Processor -- start 2023-12-12T09:44:28.159 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:28.157+0000 7fe15a97e740 1 -- start start 2023-12-12T09:44:28.161 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:28.158+0000 7fe15a97e740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55aad5e8be90 0x55aad5eac280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:28.161 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:28.158+0000 7fe15a97e740 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55aad5e8cb40 0x55aad5ec63a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:28.161 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:28.158+0000 7fe15a97e740 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55aad5eae860 0x55aad5ec9710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:28.161 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:28.158+0000 7fe15a97e740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aad5e8c650 con 0x55aad5e8be90 2023-12-12T09:44:28.161 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:28.158+0000 7fe15a97e740 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aad5df10c0 con 0x55aad5e8cb40 2023-12-12T09:44:28.162 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:28.158+0000 7fe15a97e740 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x55aad5eb0da0 con 0x55aad5eae860 2023-12-12T09:44:28.162 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:28.158+0000 7fe155aab640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55aad5e8be90 0x55aad5eac280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:28.162 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:28.158+0000 7fe155aab640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55aad5e8be90 0x55aad5eac280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:42556/0 (socket says 172.21.15.73:42556) 2023-12-12T09:44:28.162 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:28.158+0000 7fe155aab640 1 -- 172.21.15.73:0/1832479139 learned_addr learned my addr 172.21.15.73:0/1832479139 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:44:28.162 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:28.159+0000 7fe155aab640 1 -- 172.21.15.73:0/1832479139 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55aad5eae860 msgr2=0x55aad5ec9710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:44:28.162 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:28.159+0000 7fe155aab640 1 --2- 172.21.15.73:0/1832479139 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55aad5eae860 0x55aad5ec9710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:28.162 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:28.159+0000 7fe1552aa640 1 --2- 172.21.15.73:0/1832479139 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55aad5e8cb40 0x55aad5ec63a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:28.162 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:28.159+0000 7fe155aab640 1 -- 172.21.15.73:0/1832479139 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55aad5e8cb40 msgr2=0x55aad5ec63a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:44:28.162 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:28.159+0000 7fe155aab640 1 --2- 172.21.15.73:0/1832479139 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55aad5e8cb40 0x55aad5ec63a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:28.162 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:28.159+0000 7fe155aab640 1 -- 172.21.15.73:0/1832479139 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55aad5d8db80 con 0x55aad5e8be90 2023-12-12T09:44:28.162 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:28.159+0000 7fe155aab640 1 --2- 172.21.15.73:0/1832479139 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55aad5e8be90 0x55aad5eac280 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fe14402c4f0 tx=0x7fe1440a6070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7ef4d22dfa8a31a server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:44:28.162 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:28.159+0000 7fe133fff640 1 -- 172.21.15.73:0/1832479139 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1440aa290 con 0x55aad5e8be90 2023-12-12T09:44:28.163 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:28.159+0000 7fe133fff640 1 -- 172.21.15.73:0/1832479139 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55aad5deadb0 con 0x55aad5e8be90 2023-12-12T09:44:28.163 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:28.159+0000 7fe133fff640 1 -- 172.21.15.73:0/1832479139 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe144081270 con 0x55aad5e8be90 2023-12-12T09:44:28.163 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:28.160+0000 7fe15a97e740 1 -- 172.21.15.73:0/1832479139 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55aad5e8be90 msgr2=0x55aad5eac280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:28.163 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:28.160+0000 7fe15a97e740 1 --2- 172.21.15.73:0/1832479139 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55aad5e8be90 0x55aad5eac280 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fe14402c4f0 tx=0x7fe1440a6070 comp rx=0 tx=0).stop 2023-12-12T09:44:28.163 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:28.160+0000 7fe15a97e740 1 -- 172.21.15.73:0/1832479139 shutdown_connections 2023-12-12T09:44:28.163 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:28.160+0000 7fe15a97e740 1 --2- 172.21.15.73:0/1832479139 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55aad5eae860 0x55aad5ec9710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:28.163 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:28.160+0000 7fe15a97e740 1 --2- 172.21.15.73:0/1832479139 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55aad5e8cb40 0x55aad5ec63a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:28.163 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:28.160+0000 7fe15a97e740 1 --2- 172.21.15.73:0/1832479139 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55aad5e8be90 0x55aad5eac280 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:28.163 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:28.160+0000 7fe15a97e740 1 -- 172.21.15.73:0/1832479139 >> 172.21.15.73:0/1832479139 conn(0x55aad5e8bab0 msgr2=0x55aad5e88fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:44:28.163 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:28.160+0000 7fe15a97e740 1 -- 172.21.15.73:0/1832479139 shutdown_connections 2023-12-12T09:44:28.163 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:28.160+0000 7fe15a97e740 1 -- 172.21.15.73:0/1832479139 wait complete. 2023-12-12T09:44:28.166 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:28.161+0000 7fe15a97e740 1 -- start start 2023-12-12T09:44:28.167 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:28.161+0000 7fe15a97e740 1 Processor -- start 2023-12-12T09:44:28.167 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:28.162+0000 7fe15a97e740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55aad5e8be90 0x55aad5ed4960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:28.167 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:28.162+0000 7fe15a97e740 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55aad5e8cb40 0x55aad5f32200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:28.167 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:28.162+0000 7fe15a97e740 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55aad5eae860 0x55aad5f32740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:28.167 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:28.162+0000 7fe15a97e740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aad5f32cd0 con 0x55aad5e8be90 2023-12-12T09:44:28.167 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:28.162+0000 7fe15a97e740 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aad5e8aa30 con 0x55aad5eae860 2023-12-12T09:44:28.167 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:28.162+0000 7fe15a97e740 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x55aad5e8ac80 con 0x55aad5e8cb40 2023-12-12T09:44:28.167 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:28.162+0000 7fe15a97e740 10 client.0 _ll_register_callbacks cb 0x7fe144091070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-12T09:44:28.167 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:28.162+0000 7fe155aab640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55aad5e8be90 0x55aad5ed4960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:28.167 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:28.162+0000 7fe155aab640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55aad5e8be90 0x55aad5ed4960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:42564/0 (socket says 172.21.15.73:42564) 2023-12-12T09:44:28.167 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:28.162+0000 7fe155aab640 1 -- 172.21.15.73:0/1655902695 learned_addr learned my addr 172.21.15.73:0/1655902695 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:44:28.167 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:28.162+0000 7fe155aab640 1 -- 172.21.15.73:0/1655902695 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55aad5e8cb40 msgr2=0x55aad5f32200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:44:28.167 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:28.162+0000 7fe155aab640 1 --2- 172.21.15.73:0/1655902695 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55aad5e8cb40 0x55aad5f32200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:28.167 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:28.162+0000 7fe155aab640 1 -- 172.21.15.73:0/1655902695 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55aad5eae860 msgr2=0x55aad5f32740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:44:28.168 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:28.162+0000 7fe155aab640 1 --2- 172.21.15.73:0/1655902695 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55aad5eae860 0x55aad5f32740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:28.168 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:28.162+0000 7fe155aab640 1 -- 172.21.15.73:0/1655902695 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1500a2d40 con 0x55aad5e8be90 2023-12-12T09:44:28.168 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:28.163+0000 7fe155aab640 1 --2- 172.21.15.73:0/1655902695 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55aad5e8be90 0x55aad5ed4960 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fe1440aa500 tx=0x7fe144009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58e0406af1cac1b1 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:44:28.168 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:28.163+0000 7fe130ff9640 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2023-12-12T09:44:28.168 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:28.163+0000 7fe130ff9640 1 -- 172.21.15.73:0/1655902695 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe14407a4c0 con 0x55aad5e8be90 2023-12-12T09:44:28.168 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:28.163+0000 7fe130ff9640 1 -- 172.21.15.73:0/1655902695 <== mon.0 v2:172.21.15.73:3300/0 2 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe1440832d0 con 0x55aad5e8be90 2023-12-12T09:44:28.168 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:28.163+0000 7fe15a97e740 1 -- 172.21.15.73:0/1655902695 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fe14407f120 con 0x55aad5e8be90 2023-12-12T09:44:28.168 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:28.163+0000 7fe130ff9640 1 -- 172.21.15.73:0/1655902695 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=15) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe144082e40 con 0x55aad5e8be90 2023-12-12T09:44:28.168 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:28.163+0000 7fe15a97e740 10 client.5139 fetch_fsmap learned FSMap version 15 2023-12-12T09:44:28.168 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:28.163+0000 7fe15a97e740 1 -- 172.21.15.73:0/1655902695 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=15,monmap=2+}) v3 -- 0x55aad5db3170 con 0x55aad5e8be90 2023-12-12T09:44:28.168 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:28.163+0000 7fe130ff9640 1 -- 172.21.15.73:0/1655902695 <== mon.0 v2:172.21.15.73:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe14407f120 con 0x55aad5e8be90 2023-12-12T09:44:28.168 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:28.163+0000 7fe130ff9640 1 -- 172.21.15.73:0/1655902695 <== mon.0 v2:172.21.15.73:3300/0 5 ==== fsmap(e 15) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fe1440a2070 con 0x55aad5e8be90 2023-12-12T09:44:28.168 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:28.164+0000 7fe15a97e740 10 client.5139 fetch_fsmap finished waiting for FSMap version 15 2023-12-12T09:44:28.169 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:28.164+0000 7fe15a97e740 10 client.5139 resolve_mds: resolved name 'c' to daemon mds.c 2023-12-12T09:44:28.169 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:28.164+0000 7fe15a97e740 20 client.5139 populate_metadata read hostname 'smithi073' 2023-12-12T09:44:28.169 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:28.164+0000 7fe15a97e740 1 --2- 172.21.15.73:0/1655902695 >> [v2:172.21.15.73:6835/1534083424,v1:172.21.15.73:6837/1534083424] conn(0x55aad5f2f420 0x55aad5f2f800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:28.169 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:28.164+0000 7fe15a97e740 4 client.5139 mds_command: new command op to 4965 tid=0 multi_id=0 [{"prefix": "status"}] 2023-12-12T09:44:28.169 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:28.164+0000 7fe15a97e740 1 -- 172.21.15.73:0/1655902695 --> [v2:172.21.15.73:6835/1534083424,v1:172.21.15.73:6837/1534083424] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55aad5af26c0 con 0x55aad5f2f420 2023-12-12T09:44:28.169 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:28.164+0000 7fe1552aa640 1 --2- 172.21.15.73:0/1655902695 >> [v2:172.21.15.73:6835/1534083424,v1:172.21.15.73:6837/1534083424] conn(0x55aad5f2f420 0x55aad5f2f800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:28.169 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:28.164+0000 7fe1552aa640 1 --2- 172.21.15.73:0/1655902695 >> [v2:172.21.15.73:6835/1534083424,v1:172.21.15.73:6837/1534083424] conn(0x55aad5f2f420 0x55aad5f2f800 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4ad566a0d537f17 server_cookie=f035f30d8afbf2ef in_seq=0 out_seq=0 2023-12-12T09:44:28.169 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:28.164+0000 7fe130ff9640 10 client.5139 ms_handle_connect on v2:172.21.15.73:6835/1534083424 2023-12-12T09:44:28.169 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:28.165+0000 7fe130ff9640 1 -- 172.21.15.73:0/1655902695 <== mds.0 v2:172.21.15.73:6835/1534083424 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+325 (crc 0 0 0) 0x55aad5af26c0 con 0x55aad5f2f420 2023-12-12T09:44:28.169 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:28.165+0000 7fe130ff9640 10 client.5139 handle_command_reply: tid=0 2023-12-12T09:44:28.169 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:28.165+0000 7fe15a97e740 1 client.5139 shutdown 2023-12-12T09:44:28.169 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:28.165+0000 7fe15a97e740 1 -- 172.21.15.73:0/1655902695 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55aad5e8be90 msgr2=0x55aad5ed4960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:28.169 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:28.165+0000 7fe15a97e740 1 --2- 172.21.15.73:0/1655902695 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55aad5e8be90 0x55aad5ed4960 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fe1440aa500 tx=0x7fe144009040 comp rx=0 tx=0).stop 2023-12-12T09:44:28.169 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:28.165+0000 7fe15a97e740 1 -- 172.21.15.73:0/1655902695 shutdown_connections 2023-12-12T09:44:28.170 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:28.165+0000 7fe15a97e740 1 --2- 172.21.15.73:0/1655902695 >> [v2:172.21.15.73:6835/1534083424,v1:172.21.15.73:6837/1534083424] conn(0x55aad5f2f420 0x55aad5f2f800 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:28.170 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:28.165+0000 7fe15a97e740 1 --2- 172.21.15.73:0/1655902695 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55aad5eae860 0x55aad5f32740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:28.170 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:28.165+0000 7fe15a97e740 1 --2- 172.21.15.73:0/1655902695 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55aad5e8cb40 0x55aad5f32200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:28.170 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:28.165+0000 7fe130ff9640 0 client.5139 ms_handle_reset on v2:172.21.15.73:6835/1534083424 2023-12-12T09:44:28.170 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:28.165+0000 7fe15a97e740 1 --2- 172.21.15.73:0/1655902695 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55aad5e8be90 0x55aad5ed4960 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:28.170 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:28.165+0000 7fe15a97e740 1 -- 172.21.15.73:0/1655902695 >> 172.21.15.73:0/1655902695 conn(0x55aad5e8bab0 msgr2=0x55aad5ea9300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:44:28.170 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:28.165+0000 7fe15a97e740 1 -- 172.21.15.73:0/1655902695 shutdown_connections 2023-12-12T09:44:28.170 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:28.165+0000 7fe15a97e740 1 -- 172.21.15.73:0/1655902695 wait complete. 2023-12-12T09:44:28.170 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:28.165+0000 7fe15a97e740 20 client.5139 trim_cache size 0 max 16384 2023-12-12T09:44:28.170 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2023-12-12T09:44:28.171 INFO:teuthology.orchestra.run.smithi073.stdout: "cluster_fsid": "ba240992-02b8-4c7e-92f2-27eb29ac433b", 2023-12-12T09:44:28.171 INFO:teuthology.orchestra.run.smithi073.stdout: "whoami": 0, 2023-12-12T09:44:28.171 INFO:teuthology.orchestra.run.smithi073.stdout: "id": 4965, 2023-12-12T09:44:28.171 INFO:teuthology.orchestra.run.smithi073.stdout: "want_state": "up:active", 2023-12-12T09:44:28.171 INFO:teuthology.orchestra.run.smithi073.stdout: "state": "up:active", 2023-12-12T09:44:28.171 INFO:teuthology.orchestra.run.smithi073.stdout: "fs_name": "cephfs", 2023-12-12T09:44:28.171 INFO:teuthology.orchestra.run.smithi073.stdout: "rank_uptime": 6.6801510940000002, 2023-12-12T09:44:28.171 INFO:teuthology.orchestra.run.smithi073.stdout: "mdsmap_epoch": 15, 2023-12-12T09:44:28.171 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap_epoch": 34, 2023-12-12T09:44:28.171 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap_epoch_barrier": 34, 2023-12-12T09:44:28.171 INFO:teuthology.orchestra.run.smithi073.stdout: "uptime": 16.490683162 2023-12-12T09:44:28.171 INFO:teuthology.orchestra.run.smithi073.stdout:} 2023-12-12T09:44:28.172 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:28.166+0000 7fe157d0f640 1 -- 172.21.15.73:0/2843333452 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fe13406ae40 msgr2=0x7fe13406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:28.172 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:28.166+0000 7fe157d0f640 1 --2- 172.21.15.73:0/2843333452 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fe13406ae40 0x7fe13406d300 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fe13c006fd0 tx=0x7fe13c008040 comp rx=0 tx=0).stop 2023-12-12T09:44:28.172 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:28.166+0000 7fe157d0f640 1 -- 172.21.15.73:0/2843333452 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe1500c0710 msgr2=0x7fe1501ee680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:28.172 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:28.166+0000 7fe157d0f640 1 --2- 172.21.15.73:0/2843333452 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe1500c0710 0x7fe1501ee680 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fe144000f80 tx=0x7fe144004a40 comp rx=0 tx=0).stop 2023-12-12T09:44:28.173 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:28.166+0000 7fe157d0f640 1 -- 172.21.15.73:0/2843333452 shutdown_connections 2023-12-12T09:44:28.173 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:28.166+0000 7fe157d0f640 1 --2- 172.21.15.73:0/2843333452 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fe13406ae40 0x7fe13406d300 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:28.173 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:28.166+0000 7fe157d0f640 1 --2- 172.21.15.73:0/2843333452 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe150155dd0 0x7fe150152c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:28.173 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:28.166+0000 7fe157d0f640 1 --2- 172.21.15.73:0/2843333452 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe1500c11a0 0x7fe1500a6170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:28.173 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:28.166+0000 7fe157d0f640 1 --2- 172.21.15.73:0/2843333452 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe1500c0710 0x7fe1501ee680 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:28.173 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:28.166+0000 7fe157d0f640 1 -- 172.21.15.73:0/2843333452 >> 172.21.15.73:0/2843333452 conn(0x7fe1500a77d0 msgr2=0x7fe150153b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:44:28.173 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:28.166+0000 7fe157d0f640 1 -- 172.21.15.73:0/2843333452 shutdown_connections 2023-12-12T09:44:28.173 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:28.166+0000 7fe157d0f640 1 -- 172.21.15.73:0/2843333452 wait complete. 2023-12-12T09:44:28.183 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-12-12T09:44:28.395 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:28.394+0000 7f9fd87e3640 1 Processor -- start 2023-12-12T09:44:28.396 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:28.394+0000 7f9fd87e3640 1 -- start start 2023-12-12T09:44:28.397 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:28.396+0000 7f9fd87e3640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f9fd00c49d0 0x7f9fd00c6e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:28.397 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:28.396+0000 7f9fd87e3640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9fd0070dd0 con 0x7f9fd00c6a60 2023-12-12T09:44:28.397 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:28.396+0000 7f9fd87e3640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9fd01557a0 con 0x7f9fd00c52c0 2023-12-12T09:44:28.397 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:28.396+0000 7f9fd87e3640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9fd0154c20 con 0x7f9fd00c49d0 2023-12-12T09:44:28.398 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:28.396+0000 7f9fd657f640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f9fd00c6a60 0x7f9fd0151720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:49078/0 (socket says 172.21.15.73:49078) 2023-12-12T09:44:28.398 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:28.396+0000 7f9fd657f640 1 -- 172.21.15.73:0/3977108339 learned_addr learned my addr 172.21.15.73:0/3977108339 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-12T09:44:28.398 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:28.396+0000 7f9fd6d80640 1 --2- 172.21.15.73:0/3977108339 >> v2:172.21.15.73:3300/0 conn(0x7f9fd00c49d0 0x7f9fd00c6e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:28.399 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:28.397+0000 7f9fd557d640 1 -- 172.21.15.73:0/3977108339 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 617647594 0 0) 0x7f9fd0070dd0 con 0x7f9fd00c6a60 2023-12-12T09:44:28.399 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:28.397+0000 7f9fd557d640 1 -- 172.21.15.73:0/3977108339 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9fbc003520 con 0x7f9fd00c6a60 2023-12-12T09:44:28.399 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:28.397+0000 7f9fd6d80640 1 -- 172.21.15.73:0/3977108339 >> v1:172.21.15.142:6789/0 conn(0x7f9fd00c52c0 legacy=0x7f9fd0159bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:44:28.399 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:28.397+0000 7f9fd6d80640 1 -- 172.21.15.73:0/3977108339 >> v1:172.21.15.73:6789/0 conn(0x7f9fd00c6a60 legacy=0x7f9fd0151720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:28.399 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:28.397+0000 7f9fd6d80640 1 -- 172.21.15.73:0/3977108339 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fd0154f00 con 0x7f9fd00c49d0 2023-12-12T09:44:28.399 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:28.398+0000 7f9fd6d80640 1 --2- 172.21.15.73:0/3977108339 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9fd00c49d0 0x7f9fd00c6e40 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f9fc8009d90 tx=0x7f9fc802beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3454aba074830f7 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:44:28.400 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:28.398+0000 7f9fd557d640 1 -- 172.21.15.73:0/3977108339 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fc802cc60 con 0x7f9fd00c49d0 2023-12-12T09:44:28.400 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:28.398+0000 7f9fd557d640 1 -- 172.21.15.73:0/3977108339 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fc802cdc0 con 0x7f9fd00c49d0 2023-12-12T09:44:28.400 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:28.398+0000 7f9fd557d640 1 -- 172.21.15.73:0/3977108339 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fc8034660 con 0x7f9fd00c49d0 2023-12-12T09:44:28.400 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:28.399+0000 7f9fd87e3640 1 -- 172.21.15.73:0/3977108339 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9fd00c49d0 msgr2=0x7f9fd00c6e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:28.401 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:28.399+0000 7f9fd87e3640 1 --2- 172.21.15.73:0/3977108339 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9fd00c49d0 0x7f9fd00c6e40 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f9fc8009d90 tx=0x7f9fc802beb0 comp rx=0 tx=0).stop 2023-12-12T09:44:28.401 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:28.399+0000 7f9fd87e3640 1 -- 172.21.15.73:0/3977108339 shutdown_connections 2023-12-12T09:44:28.401 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:28.399+0000 7f9fd87e3640 1 --2- 172.21.15.73:0/3977108339 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9fd00c49d0 0x7f9fd00c6e40 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:28.401 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:28.399+0000 7f9fd87e3640 1 -- 172.21.15.73:0/3977108339 >> 172.21.15.73:0/3977108339 conn(0x7f9fd00c35d0 msgr2=0x7f9fd00c39e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:44:28.401 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:28.399+0000 7f9fd87e3640 1 -- 172.21.15.73:0/3977108339 shutdown_connections 2023-12-12T09:44:28.401 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:28.399+0000 7f9fd87e3640 1 -- 172.21.15.73:0/3977108339 wait complete. 2023-12-12T09:44:28.402 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:28.401+0000 7f9fd87e3640 1 Processor -- start 2023-12-12T09:44:28.402 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:28.401+0000 7f9fd87e3640 1 -- start start 2023-12-12T09:44:28.405 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:28.402+0000 7f9fd87e3640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9fd00c49d0 0x7f9fd006e150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:28.405 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:28.402+0000 7f9fd87e3640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9fd00c52c0 0x7f9fd014c4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:28.405 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:28.402+0000 7f9fd87e3640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9fd00c6a60 0x7f9fd014c9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:28.405 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:28.402+0000 7f9fd87e3640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fd014e0d0 con 0x7f9fd00c52c0 2023-12-12T09:44:28.405 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:28.402+0000 7f9fd87e3640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fd006f020 con 0x7f9fd00c49d0 2023-12-12T09:44:28.405 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:28.402+0000 7f9fd87e3640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9fd00ab940 con 0x7f9fd00c6a60 2023-12-12T09:44:28.405 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:28.403+0000 7f9fd5d7e640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9fd00c52c0 0x7f9fd014c4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:28.405 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:28.403+0000 7f9fd5d7e640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9fd00c52c0 0x7f9fd014c4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:42570/0 (socket says 172.21.15.73:42570) 2023-12-12T09:44:28.405 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:28.403+0000 7f9fd5d7e640 1 -- 172.21.15.73:0/3351295558 learned_addr learned my addr 172.21.15.73:0/3351295558 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:44:28.406 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:28.403+0000 7f9fd657f640 1 --2- 172.21.15.73:0/3351295558 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9fd00c49d0 0x7f9fd006e150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:28.406 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:28.403+0000 7f9fd6d80640 1 --2- 172.21.15.73:0/3351295558 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9fd00c6a60 0x7f9fd014c9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:28.406 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:28.403+0000 7f9fd5d7e640 1 -- 172.21.15.73:0/3351295558 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9fd00c6a60 msgr2=0x7f9fd014c9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:28.406 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:28.403+0000 7f9fd5d7e640 1 --2- 172.21.15.73:0/3351295558 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9fd00c6a60 0x7f9fd014c9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:28.406 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:28.403+0000 7f9fd5d7e640 1 -- 172.21.15.73:0/3351295558 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9fd00c49d0 msgr2=0x7f9fd006e150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:28.406 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:28.403+0000 7f9fd5d7e640 1 --2- 172.21.15.73:0/3351295558 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9fd00c49d0 0x7f9fd006e150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:28.406 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:28.403+0000 7f9fd5d7e640 1 -- 172.21.15.73:0/3351295558 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fc8009a70 con 0x7f9fd00c52c0 2023-12-12T09:44:28.406 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:28.403+0000 7f9fd5d7e640 1 --2- 172.21.15.73:0/3351295558 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9fd00c52c0 0x7f9fd014c4a0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f9fc000c430 tx=0x7f9fc000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:44:28.406 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:28.404+0000 7f9fc6ffd640 1 -- 172.21.15.73:0/3351295558 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fc0011790 con 0x7f9fd00c52c0 2023-12-12T09:44:28.406 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:28.404+0000 7f9fc6ffd640 1 -- 172.21.15.73:0/3351295558 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fc00118f0 con 0x7f9fd00c52c0 2023-12-12T09:44:28.406 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:28.404+0000 7f9fd87e3640 1 -- 172.21.15.73:0/3351295558 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9fd00ab660 con 0x7f9fd00c52c0 2023-12-12T09:44:28.406 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:28.404+0000 7f9fc6ffd640 1 -- 172.21.15.73:0/3351295558 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fc0011ca0 con 0x7f9fd00c52c0 2023-12-12T09:44:28.406 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:28.404+0000 7f9fd87e3640 1 -- 172.21.15.73:0/3351295558 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9fd00aa6b0 con 0x7f9fd00c52c0 2023-12-12T09:44:28.407 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:28.405+0000 7f9fd87e3640 1 -- 172.21.15.73:0/3351295558 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9fd0067580 con 0x7f9fd00c52c0 2023-12-12T09:44:28.407 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:28.406+0000 7f9fc6ffd640 1 -- 172.21.15.73:0/3351295558 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f9fc001c460 con 0x7f9fd00c52c0 2023-12-12T09:44:28.408 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:28.407+0000 7f9fc6ffd640 1 --2- 172.21.15.73:0/3351295558 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f9fb406ae40 0x7f9fb406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:28.408 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:28.407+0000 7f9fc6ffd640 1 -- 172.21.15.73:0/3351295558 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9fc0089670 con 0x7f9fd00c52c0 2023-12-12T09:44:28.408 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:28.407+0000 7f9fd657f640 1 --2- 172.21.15.73:0/3351295558 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f9fb406ae40 0x7f9fb406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:28.409 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:28.408+0000 7f9fd657f640 1 --2- 172.21.15.73:0/3351295558 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f9fb406ae40 0x7f9fb406d300 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f9fcc0011e0 tx=0x7f9fcc009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:44:28.412 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:28.411+0000 7f9fc6ffd640 1 -- 172.21.15.73:0/3351295558 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f9fc0054680 con 0x7f9fd00c52c0 2023-12-12T09:44:28.645 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:28.644+0000 7f9fd87e3640 1 -- 172.21.15.73:0/3351295558 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f9fd00c6840 con 0x7f9fd00c52c0 2023-12-12T09:44:28.646 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:28.645+0000 7f9fc6ffd640 1 -- 172.21.15.73:0/3351295558 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v15) v1 ==== 53+0+73 (secure 0 0 0) 0x7f9fc0057ca0 con 0x7f9fd00c52c0 2023-12-12T09:44:28.646 INFO:teuthology.orchestra.run.smithi073.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-12-12T09:44:28.649 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:28.648+0000 7f9fd87e3640 1 -- 172.21.15.73:0/3351295558 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f9fb406ae40 msgr2=0x7f9fb406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:28.649 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:28.648+0000 7f9fd87e3640 1 --2- 172.21.15.73:0/3351295558 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f9fb406ae40 0x7f9fb406d300 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f9fcc0011e0 tx=0x7f9fcc009040 comp rx=0 tx=0).stop 2023-12-12T09:44:28.649 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:28.648+0000 7f9fd87e3640 1 -- 172.21.15.73:0/3351295558 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9fd00c52c0 msgr2=0x7f9fd014c4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:28.650 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:28.648+0000 7f9fd87e3640 1 --2- 172.21.15.73:0/3351295558 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9fd00c52c0 0x7f9fd014c4a0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f9fc000c430 tx=0x7f9fc000c8f0 comp rx=0 tx=0).stop 2023-12-12T09:44:28.650 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:28.648+0000 7f9fd87e3640 1 -- 172.21.15.73:0/3351295558 shutdown_connections 2023-12-12T09:44:28.650 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:28.648+0000 7f9fd87e3640 1 --2- 172.21.15.73:0/3351295558 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f9fb406ae40 0x7f9fb406d300 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:28.650 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:28.648+0000 7f9fd87e3640 1 --2- 172.21.15.73:0/3351295558 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9fd00c6a60 0x7f9fd014c9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:28.650 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:28.648+0000 7f9fd87e3640 1 --2- 172.21.15.73:0/3351295558 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9fd00c52c0 0x7f9fd014c4a0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:28.650 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:28.648+0000 7f9fd87e3640 1 --2- 172.21.15.73:0/3351295558 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9fd00c49d0 0x7f9fd006e150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:28.650 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:28.648+0000 7f9fd87e3640 1 -- 172.21.15.73:0/3351295558 >> 172.21.15.73:0/3351295558 conn(0x7f9fd00c35d0 msgr2=0x7f9fd00a78e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:44:28.650 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:28.648+0000 7f9fd87e3640 1 -- 172.21.15.73:0/3351295558 shutdown_connections 2023-12-12T09:44:28.650 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:28.648+0000 7f9fd87e3640 1 -- 172.21.15.73:0/3351295558 wait complete. 2023-12-12T09:44:28.668 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-12-12T09:44:28.668 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-12T09:44:28.668 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi073.front.sepia.ceph.com 2023-12-12T09:44:28.668 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-12-12T09:44:28.668 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-12-12T09:44:28.668 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-12-12T09:44:28.668 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-12-12T09:44:28.668 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-12-12T09:44:28.668 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-12-12T09:44:28.669 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T09:44:28.669 DEBUG:teuthology.orchestra.run.smithi073:> ip addr 2023-12-12T09:44:28.720 INFO:teuthology.orchestra.run.smithi073.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-12T09:44:28.720 INFO:teuthology.orchestra.run.smithi073.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-12T09:44:28.720 INFO:teuthology.orchestra.run.smithi073.stdout: inet 127.0.0.1/8 scope host lo 2023-12-12T09:44:28.721 INFO:teuthology.orchestra.run.smithi073.stdout: valid_lft forever preferred_lft forever 2023-12-12T09:44:28.721 INFO:teuthology.orchestra.run.smithi073.stdout: inet6 ::1/128 scope host 2023-12-12T09:44:28.721 INFO:teuthology.orchestra.run.smithi073.stdout: valid_lft forever preferred_lft forever 2023-12-12T09:44:28.721 INFO:teuthology.orchestra.run.smithi073.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-12T09:44:28.721 INFO:teuthology.orchestra.run.smithi073.stdout: link/ether 0c:c4:7a:d8:d9:ea brd ff:ff:ff:ff:ff:ff 2023-12-12T09:44:28.721 INFO:teuthology.orchestra.run.smithi073.stdout: altname enp7s0f0 2023-12-12T09:44:28.721 INFO:teuthology.orchestra.run.smithi073.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-12T09:44:28.721 INFO:teuthology.orchestra.run.smithi073.stdout: link/ether 0c:c4:7a:d8:d9:eb brd ff:ff:ff:ff:ff:ff 2023-12-12T09:44:28.721 INFO:teuthology.orchestra.run.smithi073.stdout: altname enp7s0f1 2023-12-12T09:44:28.721 INFO:teuthology.orchestra.run.smithi073.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-12T09:44:28.721 INFO:teuthology.orchestra.run.smithi073.stdout: link/ether 0c:c4:7a:8f:ce:7c brd ff:ff:ff:ff:ff:ff 2023-12-12T09:44:28.721 INFO:teuthology.orchestra.run.smithi073.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-12T09:44:28.721 INFO:teuthology.orchestra.run.smithi073.stdout: link/ether 0c:c4:7a:8f:ce:7d brd ff:ff:ff:ff:ff:ff 2023-12-12T09:44:28.722 INFO:teuthology.orchestra.run.smithi073.stdout: inet 172.21.15.73/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-12-12T09:44:28.722 INFO:teuthology.orchestra.run.smithi073.stdout: valid_lft 42330sec preferred_lft 42330sec 2023-12-12T09:44:28.722 INFO:teuthology.orchestra.run.smithi073.stdout: inet6 fe80::ec4:7aff:fe8f:ce7d/64 scope link 2023-12-12T09:44:28.722 INFO:teuthology.orchestra.run.smithi073.stdout: valid_lft forever preferred_lft forever 2023-12-12T09:44:28.722 INFO:teuthology.orchestra.run.smithi073.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-12-12T09:44:28.722 INFO:teuthology.orchestra.run.smithi073.stdout: link/ether ae:cf:b6:bf:45:8d brd ff:ff:ff:ff:ff:ff 2023-12-12T09:44:28.722 INFO:teuthology.orchestra.run.smithi073.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-12-12T09:44:28.722 INFO:teuthology.orchestra.run.smithi073.stdout: valid_lft forever preferred_lft forever 2023-12-12T09:44:28.722 INFO:teuthology.orchestra.run.smithi073.stdout: inet6 fe80::f4:a9ff:febd:c3fb/64 scope link 2023-12-12T09:44:28.722 INFO:teuthology.orchestra.run.smithi073.stdout: valid_lft forever preferred_lft forever 2023-12-12T09:44:28.722 INFO:teuthology.orchestra.run.smithi073.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-12T09:44:28.722 INFO:teuthology.orchestra.run.smithi073.stdout: link/ether ae:cf:b6:bf:45:8d brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-12T09:44:28.723 INFO:teuthology.orchestra.run.smithi073.stdout: inet6 fe80::accf:b6ff:febf:458d/64 scope link 2023-12-12T09:44:28.723 INFO:teuthology.orchestra.run.smithi073.stdout: valid_lft forever preferred_lft forever 2023-12-12T09:44:28.724 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T09:44:28.724 DEBUG:teuthology.orchestra.run.smithi073:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-12T09:44:28.813 INFO:teuthology.orchestra.run.smithi073.stdout:1 2023-12-12T09:44:28.817 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T09:44:28.817 DEBUG:teuthology.orchestra.run.smithi073:> route 2023-12-12T09:44:28.875 INFO:teuthology.orchestra.run.smithi073.stdout:Kernel IP routing table 2023-12-12T09:44:28.875 INFO:teuthology.orchestra.run.smithi073.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-12T09:44:28.875 INFO:teuthology.orchestra.run.smithi073.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-12-12T09:44:28.875 INFO:teuthology.orchestra.run.smithi073.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-12-12T09:44:28.875 INFO:teuthology.orchestra.run.smithi073.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-12T09:44:28.875 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T09:44:28.875 DEBUG:teuthology.orchestra.run.smithi073:> (cd / && exec bash -c ' 2023-12-12T09:44:28.876 DEBUG:teuthology.orchestra.run.smithi073:> set -e 2023-12-12T09:44:28.876 DEBUG:teuthology.orchestra.run.smithi073:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-12-12T09:44:28.876 DEBUG:teuthology.orchestra.run.smithi073:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-12-12T09:44:28.876 DEBUG:teuthology.orchestra.run.smithi073:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-12-12T09:44:28.876 DEBUG:teuthology.orchestra.run.smithi073:> ') 2023-12-12T09:44:29.057 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T09:44:29.057 DEBUG:teuthology.orchestra.run.smithi073:> ip netns list 2023-12-12T09:44:29.111 INFO:teuthology.orchestra.run.smithi073.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-12-12T09:44:29.112 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-12-12T09:44:29.112 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T09:44:29.112 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip link set brx.0 up 2023-12-12T09:44:29.209 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-12T09:44:29.209 DEBUG:teuthology.orchestra.run.smithi073:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-12-12T09:44:29.262 INFO:teuthology.orchestra.run.smithi073.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-12-12T09:44:29.262 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-12T09:44:29.263 DEBUG:teuthology.orchestra.run.smithi073:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-12-12T09:44:29.313 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2023-12-12T09:44:29.314 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T09:44:29.314 DEBUG:teuthology.orchestra.run.smithi073:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-12T09:44:29.451 INFO:teuthology.orchestra.run.smithi073.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-12T09:44:29.452 INFO:teuthology.orchestra.run.smithi073.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-12T09:44:29.484 INFO:teuthology.orchestra.run.smithi073.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-12T09:44:29.484 INFO:teuthology.orchestra.run.smithi073.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-12T09:44:29.485 INFO:teuthology.orchestra.run.smithi073.stdout:mount.ceph: resolved to: "172.21.15.73:3300,172.21.15.142:3300,172.21.15.142:3301" 2023-12-12T09:44:29.485 INFO:teuthology.orchestra.run.smithi073.stdout:mount.ceph: trying mount with new device syntax: 0@ba240992-02b8-4c7e-92f2-27eb29ac433b.cephfs=/ 2023-12-12T09:44:29.485 INFO:teuthology.orchestra.run.smithi073.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.73:3300/172.21.15.142:3300/172.21.15.142:3301" will pass to kernel 2023-12-12T09:44:29.487 INFO:teuthology.orchestra.run.smithi073.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2023-12-12T09:44:29.487 INFO:teuthology.orchestra.run.smithi073.stdout: You just mounted a file system that supports labels which does not 2023-12-12T09:44:29.487 INFO:teuthology.orchestra.run.smithi073.stdout: contain labels, onto an SELinux box. It is likely that confined 2023-12-12T09:44:29.487 INFO:teuthology.orchestra.run.smithi073.stdout: applications will generate AVC messages and not be allowed access to 2023-12-12T09:44:29.487 INFO:teuthology.orchestra.run.smithi073.stdout: this file system. For more details see restorecon(8) and mount(8). 2023-12-12T09:44:29.491 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-12-12T09:44:29.492 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T09:44:29.492 DEBUG:teuthology.orchestra.run.smithi073:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-12-12T09:44:29.577 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T09:44:29.578 DEBUG:teuthology.orchestra.run.smithi073:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-12T09:44:29.637 INFO:teuthology.orchestra.run.smithi073.stdout:client4574 2023-12-12T09:44:29.637 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2023-12-12T09:44:29.637 DEBUG:teuthology.orchestra.run.smithi073:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-12T09:44:29.685 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-12-12T09:44:29.947 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:29.945+0000 7f39b8f83640 1 Processor -- start 2023-12-12T09:44:29.947 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:29.946+0000 7f39b8f83640 1 -- start start 2023-12-12T09:44:29.948 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:29.947+0000 7f39b8f83640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f39b4155330 0x7f39b40c7dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:29.948 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:29.947+0000 7f39b8f83640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f39b40c5290 0x7f39b40c6e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:29.948 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:29.947+0000 7f39b8f83640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39b40705c0 con 0x7f39b40c8310 2023-12-12T09:44:29.949 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:29.947+0000 7f39b8f83640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39b40c7a60 con 0x7f39b40c5290 2023-12-12T09:44:29.949 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:29.947+0000 7f39b8f83640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39b40c1620 con 0x7f39b4155330 2023-12-12T09:44:29.949 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:29.947+0000 7f39b2d9d640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f39b40c8310 0x7f39b40c7350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:32810/0 (socket says 172.21.15.73:32810) 2023-12-12T09:44:29.949 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:29.947+0000 7f39b2d9d640 1 -- 172.21.15.73:0/807880386 learned_addr learned my addr 172.21.15.73:0/807880386 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-12T09:44:29.951 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:29.948+0000 7f39b259c640 1 --2- 172.21.15.73:0/807880386 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f39b4155330 0x7f39b40c7dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:29.951 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:29.948+0000 7f39b1d9b640 1 --2- 172.21.15.73:0/807880386 >> v2:172.21.15.142:3300/0 conn(0x7f39b40c5290 0x7f39b40c6e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:29.951 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:29.948+0000 7f39b159a640 1 -- 172.21.15.73:0/807880386 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3525556213 0 0) 0x7f39b40705c0 con 0x7f39b40c8310 2023-12-12T09:44:29.951 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:29.948+0000 7f39b159a640 1 -- 172.21.15.73:0/807880386 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f39a0003520 con 0x7f39b40c8310 2023-12-12T09:44:29.951 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:29.948+0000 7f39b159a640 1 -- 172.21.15.73:0/807880386 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3902039265 0 0) 0x7f39a0003520 con 0x7f39b40c8310 2023-12-12T09:44:29.951 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:29.948+0000 7f39b159a640 1 -- 172.21.15.73:0/807880386 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f39b4155330 msgr2=0x7f39b40c7dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:44:29.951 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:29.948+0000 7f39b159a640 1 --2- 172.21.15.73:0/807880386 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f39b4155330 0x7f39b40c7dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:29.951 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:29.948+0000 7f39b159a640 1 -- 172.21.15.73:0/807880386 >> v2:172.21.15.142:3300/0 conn(0x7f39b40c5290 msgr2=0x7f39b40c6e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:44:29.951 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:29.948+0000 7f39b159a640 1 --2- 172.21.15.73:0/807880386 >> v2:172.21.15.142:3300/0 conn(0x7f39b40c5290 0x7f39b40c6e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:29.951 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:29.948+0000 7f39b159a640 1 -- 172.21.15.73:0/807880386 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39b40c1340 con 0x7f39b40c8310 2023-12-12T09:44:29.951 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:29.948+0000 7f39b159a640 1 -- 172.21.15.73:0/807880386 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3186547832 0 0) 0x7f39ac001670 con 0x7f39b40c8310 2023-12-12T09:44:29.952 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:29.948+0000 7f39b159a640 1 -- 172.21.15.73:0/807880386 >> v1:172.21.15.73:6789/0 conn(0x7f39b40c8310 legacy=0x7f39b40c7350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:29.952 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:29.948+0000 7f39b159a640 1 --2- 172.21.15.73:0/807880386 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f39a0003970 0x7f39a0003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:29.952 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:29.949+0000 7f39b159a640 1 --2- 172.21.15.73:0/807880386 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f39a00047c0 0x7f39a0004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:29.952 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:29.949+0000 7f39b159a640 1 --2- 172.21.15.73:0/807880386 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f39b4155330 0x7f39a0005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:29.952 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:29.949+0000 7f39b159a640 1 -- 172.21.15.73:0/807880386 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39b40c7a60 con 0x7f39a00047c0 2023-12-12T09:44:29.952 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:29.949+0000 7f39b159a640 1 -- 172.21.15.73:0/807880386 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39b40c1620 con 0x7f39a0003970 2023-12-12T09:44:29.952 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:29.949+0000 7f39b159a640 1 -- 172.21.15.73:0/807880386 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39a000ba00 con 0x7f39b4155330 2023-12-12T09:44:29.952 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:29.949+0000 7f39b1d9b640 1 --2- 172.21.15.73:0/807880386 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f39a00047c0 0x7f39a0004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:29.952 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:29.949+0000 7f39b2d9d640 1 --2- 172.21.15.73:0/807880386 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f39b4155330 0x7f39a0005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:29.952 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:29.949+0000 7f39b1d9b640 1 -- 172.21.15.73:0/807880386 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f39b4155330 msgr2=0x7f39a0005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:44:29.952 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:29.949+0000 7f39b259c640 1 --2- 172.21.15.73:0/807880386 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f39a0003970 0x7f39a0003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:29.952 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:29.949+0000 7f39b1d9b640 1 --2- 172.21.15.73:0/807880386 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f39b4155330 0x7f39a0005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:29.952 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:29.949+0000 7f39b1d9b640 1 -- 172.21.15.73:0/807880386 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f39a0003970 msgr2=0x7f39a0003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:44:29.952 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:29.949+0000 7f39b1d9b640 1 --2- 172.21.15.73:0/807880386 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f39a0003970 0x7f39a0003d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:29.953 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:29.949+0000 7f39b1d9b640 1 -- 172.21.15.73:0/807880386 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39a0003520 con 0x7f39a00047c0 2023-12-12T09:44:29.953 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:29.949+0000 7f39b2d9d640 1 --2- 172.21.15.73:0/807880386 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f39b4155330 0x7f39a0005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:44:29.954 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:29.950+0000 7f39b1d9b640 1 --2- 172.21.15.73:0/807880386 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f39a00047c0 0x7f39a0004c40 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f399c009a90 tx=0x7f39a00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4f597f95bc6995 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:44:29.954 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:29.951+0000 7f39b159a640 1 -- 172.21.15.73:0/807880386 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f399c02c6b0 con 0x7f39a00047c0 2023-12-12T09:44:29.954 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:29.951+0000 7f39b159a640 1 -- 172.21.15.73:0/807880386 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f399c02c810 con 0x7f39a00047c0 2023-12-12T09:44:29.954 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:29.951+0000 7f39b159a640 1 -- 172.21.15.73:0/807880386 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f399c02cba0 con 0x7f39a00047c0 2023-12-12T09:44:29.954 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:29.951+0000 7f39b8f83640 1 -- 172.21.15.73:0/807880386 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f39a00047c0 msgr2=0x7f39a0004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:29.954 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:29.951+0000 7f39b8f83640 1 --2- 172.21.15.73:0/807880386 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f39a00047c0 0x7f39a0004c40 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f399c009a90 tx=0x7f39a00057f0 comp rx=0 tx=0).stop 2023-12-12T09:44:29.954 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:29.951+0000 7f39b2d9d640 1 -- 172.21.15.73:0/807880386 reap_dead start 2023-12-12T09:44:29.955 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:29.951+0000 7f39b8f83640 1 -- 172.21.15.73:0/807880386 shutdown_connections 2023-12-12T09:44:29.955 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:29.951+0000 7f39b8f83640 1 -- 172.21.15.73:0/807880386 >> 172.21.15.73:0/807880386 conn(0x7f39b4071f30 msgr2=0x7f39b4072310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:44:29.955 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:29.951+0000 7f39b8f83640 1 -- 172.21.15.73:0/807880386 shutdown_connections 2023-12-12T09:44:29.955 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:29.951+0000 7f39b8f83640 1 -- 172.21.15.73:0/807880386 wait complete. 2023-12-12T09:44:29.955 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:29.953+0000 7f39b8f83640 1 Processor -- start 2023-12-12T09:44:29.955 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:29.953+0000 7f39b8f83640 1 -- start start 2023-12-12T09:44:29.956 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:29.954+0000 7f39b8f83640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f39a00047c0 0x7f39b40abcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:29.957 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:29.954+0000 7f39b8f83640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f39b40a8930 0x7f39b40a8db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:29.957 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:29.954+0000 7f39b8f83640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f39b41ed880 0x7f39b41edd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:29.957 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:29.954+0000 7f39b8f83640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39b4156cb0 con 0x7f39b40a8930 2023-12-12T09:44:29.957 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:29.954+0000 7f39b8f83640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39b41e9d20 con 0x7f39b41ed880 2023-12-12T09:44:29.957 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:29.954+0000 7f39b8f83640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39b4157ec0 con 0x7f39a00047c0 2023-12-12T09:44:29.957 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:29.954+0000 7f39b1d9b640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f39b40a8930 0x7f39b40a8db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:29.957 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:29.954+0000 7f39b1d9b640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f39b40a8930 0x7f39b40a8db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:41578/0 (socket says 172.21.15.73:41578) 2023-12-12T09:44:29.957 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:29.954+0000 7f39b1d9b640 1 -- 172.21.15.73:0/3919041444 learned_addr learned my addr 172.21.15.73:0/3919041444 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:44:29.957 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:29.955+0000 7f39b259c640 1 --2- 172.21.15.73:0/3919041444 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f39a00047c0 0x7f39b40abcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:29.957 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:29.955+0000 7f39b1d9b640 1 -- 172.21.15.73:0/3919041444 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f39a00047c0 msgr2=0x7f39b40abcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:29.957 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:29.955+0000 7f39b1d9b640 1 --2- 172.21.15.73:0/3919041444 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f39a00047c0 0x7f39b40abcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:29.957 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:29.955+0000 7f39b1d9b640 1 -- 172.21.15.73:0/3919041444 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f39b41ed880 msgr2=0x7f39b41edd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:29.957 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:29.955+0000 7f39b1d9b640 1 --2- 172.21.15.73:0/3919041444 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f39b41ed880 0x7f39b41edd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:29.957 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:29.955+0000 7f39b1d9b640 1 -- 172.21.15.73:0/3919041444 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39b41ed310 con 0x7f39b40a8930 2023-12-12T09:44:29.958 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:29.955+0000 7f39b259c640 1 --2- 172.21.15.73:0/3919041444 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f39a00047c0 0x7f39b40abcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:44:29.958 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:29.955+0000 7f39b1d9b640 1 --2- 172.21.15.73:0/3919041444 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f39b40a8930 0x7f39b40a8db0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f399c037040 tx=0x7f399c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:44:29.958 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:29.955+0000 7f39aaffd640 1 -- 172.21.15.73:0/3919041444 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f399c003810 con 0x7f39b40a8930 2023-12-12T09:44:29.958 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:29.955+0000 7f39aaffd640 1 -- 172.21.15.73:0/3919041444 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f399c003970 con 0x7f39b40a8930 2023-12-12T09:44:29.958 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:29.955+0000 7f39aaffd640 1 -- 172.21.15.73:0/3919041444 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f399c003d20 con 0x7f39b40a8930 2023-12-12T09:44:29.958 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:29.955+0000 7f39b8f83640 1 -- 172.21.15.73:0/3919041444 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39b41ee240 con 0x7f39b40a8930 2023-12-12T09:44:29.958 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:29.956+0000 7f39b8f83640 1 -- 172.21.15.73:0/3919041444 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39b4158440 con 0x7f39b40a8930 2023-12-12T09:44:29.958 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:29.957+0000 7f39b8f83640 1 -- 172.21.15.73:0/3919041444 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f39b406fd90 con 0x7f39b40a8930 2023-12-12T09:44:29.959 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:29.957+0000 7f39aaffd640 1 -- 172.21.15.73:0/3919041444 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f399c040450 con 0x7f39b40a8930 2023-12-12T09:44:29.960 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:29.959+0000 7f39aaffd640 1 --2- 172.21.15.73:0/3919041444 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f399406ae70 0x7f399406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:29.960 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:29.959+0000 7f39aaffd640 1 -- 172.21.15.73:0/3919041444 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f399c0ab560 con 0x7f39b40a8930 2023-12-12T09:44:29.960 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:29.959+0000 7f39b259c640 1 --2- 172.21.15.73:0/3919041444 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f399406ae70 0x7f399406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:29.961 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:29.960+0000 7f39b259c640 1 --2- 172.21.15.73:0/3919041444 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f399406ae70 0x7f399406d330 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f39b40aa950 tx=0x7f39a400d040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:44:29.964 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:29.963+0000 7f39aaffd640 1 -- 172.21.15.73:0/3919041444 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f399c076600 con 0x7f39b40a8930 2023-12-12T09:44:30.194 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:30.193+0000 7f39b8f83640 1 -- 172.21.15.73:0/3919041444 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f39b40c5e30 con 0x7f39b40a8930 2023-12-12T09:44:30.195 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:30.194+0000 7f39aaffd640 1 -- 172.21.15.73:0/3919041444 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v15) v1 ==== 53+0+73 (secure 0 0 0) 0x7f39b40c5e30 con 0x7f39b40a8930 2023-12-12T09:44:30.195 INFO:teuthology.orchestra.run.smithi073.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-12-12T09:44:30.198 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:30.196+0000 7f39b8f83640 1 -- 172.21.15.73:0/3919041444 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f399406ae70 msgr2=0x7f399406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:30.198 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:30.196+0000 7f39b8f83640 1 --2- 172.21.15.73:0/3919041444 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f399406ae70 0x7f399406d330 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f39b40aa950 tx=0x7f39a400d040 comp rx=0 tx=0).stop 2023-12-12T09:44:30.198 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:30.196+0000 7f39b8f83640 1 -- 172.21.15.73:0/3919041444 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f39b40a8930 msgr2=0x7f39b40a8db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:30.198 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:30.196+0000 7f39b8f83640 1 --2- 172.21.15.73:0/3919041444 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f39b40a8930 0x7f39b40a8db0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f399c037040 tx=0x7f399c004730 comp rx=0 tx=0).stop 2023-12-12T09:44:30.198 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:30.197+0000 7f39b8f83640 1 -- 172.21.15.73:0/3919041444 shutdown_connections 2023-12-12T09:44:30.198 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:30.197+0000 7f39b8f83640 1 --2- 172.21.15.73:0/3919041444 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f399406ae70 0x7f399406d330 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:30.198 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:30.197+0000 7f39b8f83640 1 --2- 172.21.15.73:0/3919041444 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f39b41ed880 0x7f39b41edd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:30.198 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:30.197+0000 7f39b8f83640 1 --2- 172.21.15.73:0/3919041444 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f39b40a8930 0x7f39b40a8db0 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:30.198 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:30.197+0000 7f39b8f83640 1 --2- 172.21.15.73:0/3919041444 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f39a00047c0 0x7f39b40abcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:30.199 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:30.197+0000 7f39b8f83640 1 -- 172.21.15.73:0/3919041444 >> 172.21.15.73:0/3919041444 conn(0x7f39b4071f30 msgr2=0x7f39b414eda0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:44:30.199 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:30.197+0000 7f39b8f83640 1 -- 172.21.15.73:0/3919041444 shutdown_connections 2023-12-12T09:44:30.199 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:30.197+0000 7f39b8f83640 1 -- 172.21.15.73:0/3919041444 wait complete. 2023-12-12T09:44:30.217 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-12-12T09:44:30.217 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-12T09:44:30.217 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi142.front.sepia.ceph.com 2023-12-12T09:44:30.217 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-12-12T09:44:30.217 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-12-12T09:44:30.217 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-12-12T09:44:30.217 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-12-12T09:44:30.217 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-12-12T09:44:30.217 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-12-12T09:44:30.217 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T09:44:30.218 DEBUG:teuthology.orchestra.run.smithi142:> ip addr 2023-12-12T09:44:30.279 INFO:teuthology.orchestra.run.smithi142.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-12T09:44:30.280 INFO:teuthology.orchestra.run.smithi142.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-12T09:44:30.280 INFO:teuthology.orchestra.run.smithi142.stdout: inet 127.0.0.1/8 scope host lo 2023-12-12T09:44:30.280 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2023-12-12T09:44:30.280 INFO:teuthology.orchestra.run.smithi142.stdout: inet6 ::1/128 scope host 2023-12-12T09:44:30.280 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2023-12-12T09:44:30.280 INFO:teuthology.orchestra.run.smithi142.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-12T09:44:30.280 INFO:teuthology.orchestra.run.smithi142.stdout: link/ether 0c:c4:7a:d9:36:3c brd ff:ff:ff:ff:ff:ff 2023-12-12T09:44:30.280 INFO:teuthology.orchestra.run.smithi142.stdout: altname enp7s0f0 2023-12-12T09:44:30.280 INFO:teuthology.orchestra.run.smithi142.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-12T09:44:30.280 INFO:teuthology.orchestra.run.smithi142.stdout: link/ether 0c:c4:7a:d9:36:3d brd ff:ff:ff:ff:ff:ff 2023-12-12T09:44:30.280 INFO:teuthology.orchestra.run.smithi142.stdout: altname enp7s0f1 2023-12-12T09:44:30.280 INFO:teuthology.orchestra.run.smithi142.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-12T09:44:30.281 INFO:teuthology.orchestra.run.smithi142.stdout: link/ether 0c:c4:7a:88:6e:0c brd ff:ff:ff:ff:ff:ff 2023-12-12T09:44:30.281 INFO:teuthology.orchestra.run.smithi142.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-12T09:44:30.281 INFO:teuthology.orchestra.run.smithi142.stdout: link/ether 0c:c4:7a:88:6e:0d brd ff:ff:ff:ff:ff:ff 2023-12-12T09:44:30.281 INFO:teuthology.orchestra.run.smithi142.stdout: inet 172.21.15.142/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-12-12T09:44:30.281 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft 42332sec preferred_lft 42332sec 2023-12-12T09:44:30.281 INFO:teuthology.orchestra.run.smithi142.stdout: inet6 fe80::ec4:7aff:fe88:6e0d/64 scope link 2023-12-12T09:44:30.281 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2023-12-12T09:44:30.281 INFO:teuthology.orchestra.run.smithi142.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-12-12T09:44:30.281 INFO:teuthology.orchestra.run.smithi142.stdout: link/ether de:1c:dd:95:c8:e6 brd ff:ff:ff:ff:ff:ff 2023-12-12T09:44:30.281 INFO:teuthology.orchestra.run.smithi142.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-12-12T09:44:30.281 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2023-12-12T09:44:30.281 INFO:teuthology.orchestra.run.smithi142.stdout: inet6 fe80::f8b8:b6ff:fe33:420d/64 scope link 2023-12-12T09:44:30.281 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2023-12-12T09:44:30.281 INFO:teuthology.orchestra.run.smithi142.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-12T09:44:30.281 INFO:teuthology.orchestra.run.smithi142.stdout: link/ether de:1c:dd:95:c8:e6 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-12-12T09:44:30.281 INFO:teuthology.orchestra.run.smithi142.stdout: inet6 fe80::dc1c:ddff:fe95:c8e6/64 scope link 2023-12-12T09:44:30.282 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2023-12-12T09:44:30.283 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T09:44:30.283 DEBUG:teuthology.orchestra.run.smithi142:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-12T09:44:30.373 INFO:teuthology.orchestra.run.smithi142.stdout:1 2023-12-12T09:44:30.377 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T09:44:30.378 DEBUG:teuthology.orchestra.run.smithi142:> route 2023-12-12T09:44:30.430 INFO:teuthology.orchestra.run.smithi142.stdout:Kernel IP routing table 2023-12-12T09:44:30.430 INFO:teuthology.orchestra.run.smithi142.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-12T09:44:30.430 INFO:teuthology.orchestra.run.smithi142.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-12-12T09:44:30.430 INFO:teuthology.orchestra.run.smithi142.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-12-12T09:44:30.430 INFO:teuthology.orchestra.run.smithi142.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-12T09:44:30.430 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T09:44:30.431 DEBUG:teuthology.orchestra.run.smithi142:> (cd / && exec bash -c ' 2023-12-12T09:44:30.431 DEBUG:teuthology.orchestra.run.smithi142:> set -e 2023-12-12T09:44:30.431 DEBUG:teuthology.orchestra.run.smithi142:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-12-12T09:44:30.431 DEBUG:teuthology.orchestra.run.smithi142:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-12-12T09:44:30.431 DEBUG:teuthology.orchestra.run.smithi142:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-12-12T09:44:30.431 DEBUG:teuthology.orchestra.run.smithi142:> ') 2023-12-12T09:44:30.606 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T09:44:30.607 DEBUG:teuthology.orchestra.run.smithi142:> ip netns list 2023-12-12T09:44:30.658 INFO:teuthology.orchestra.run.smithi142.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-12-12T09:44:30.659 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-12-12T09:44:30.660 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T09:44:30.660 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip link set brx.0 up 2023-12-12T09:44:30.743 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-12T09:44:30.744 DEBUG:teuthology.orchestra.run.smithi142:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-12-12T09:44:30.793 INFO:teuthology.orchestra.run.smithi142.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-12-12T09:44:30.794 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-12T09:44:30.794 DEBUG:teuthology.orchestra.run.smithi142:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-12-12T09:44:30.846 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2023-12-12T09:44:30.847 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T09:44:30.847 DEBUG:teuthology.orchestra.run.smithi142:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-12T09:44:30.986 INFO:teuthology.orchestra.run.smithi142.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-12T09:44:30.986 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-12T09:44:31.023 INFO:teuthology.orchestra.run.smithi142.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-12T09:44:31.023 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-12T09:44:31.023 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: resolved to: "172.21.15.73:3300,172.21.15.142:3300,172.21.15.142:3301" 2023-12-12T09:44:31.023 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: trying mount with new device syntax: 1@ba240992-02b8-4c7e-92f2-27eb29ac433b.cephfs=/ 2023-12-12T09:44:31.023 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.73:3300/172.21.15.142:3300/172.21.15.142:3301" will pass to kernel 2023-12-12T09:44:31.025 INFO:teuthology.orchestra.run.smithi142.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2023-12-12T09:44:31.025 INFO:teuthology.orchestra.run.smithi142.stdout: You just mounted a file system that supports labels which does not 2023-12-12T09:44:31.025 INFO:teuthology.orchestra.run.smithi142.stdout: contain labels, onto an SELinux box. It is likely that confined 2023-12-12T09:44:31.026 INFO:teuthology.orchestra.run.smithi142.stdout: applications will generate AVC messages and not be allowed access to 2023-12-12T09:44:31.026 INFO:teuthology.orchestra.run.smithi142.stdout: this file system. For more details see restorecon(8) and mount(8). 2023-12-12T09:44:31.031 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-12-12T09:44:31.031 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T09:44:31.031 DEBUG:teuthology.orchestra.run.smithi142:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-12-12T09:44:31.104 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T09:44:31.105 DEBUG:teuthology.orchestra.run.smithi142:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-12T09:44:31.152 INFO:teuthology.orchestra.run.smithi142.stdout:client4822 2023-12-12T09:44:31.152 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2023-12-12T09:44:31.152 DEBUG:teuthology.orchestra.run.smithi142:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-12T09:44:31.195 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth rm client.testuser 2023-12-12T09:44:31.418 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:31.416+0000 7f8cd597c640 1 Processor -- start 2023-12-12T09:44:31.419 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:31.416+0000 7f8cd597c640 1 -- start start 2023-12-12T09:44:31.419 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:31.418+0000 7f8cd597c640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f8cd006fca0 0x7f8cd0072700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:31.419 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:31.418+0000 7f8cd597c640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f8cd00c0420 0x7f8cd0070080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:31.420 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:31.418+0000 7f8cd597c640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8cd0152560 con 0x7f8cd00c10d0 2023-12-12T09:44:31.420 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:31.418+0000 7f8cd597c640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8cd0152ec0 con 0x7f8cd00c0420 2023-12-12T09:44:31.420 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:31.418+0000 7f8cd597c640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8cd00c53d0 con 0x7f8cd006fca0 2023-12-12T09:44:31.420 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:31.418+0000 7f8ccf7fe640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f8cd00c10d0 0x7f8cd00c1560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:32812/0 (socket says 172.21.15.73:32812) 2023-12-12T09:44:31.420 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:31.418+0000 7f8ccf7fe640 1 -- 172.21.15.73:0/2707560846 learned_addr learned my addr 172.21.15.73:0/2707560846 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-12T09:44:31.420 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:31.418+0000 7f8cc7fff640 1 --2- 172.21.15.73:0/2707560846 >> v2:172.21.15.73:3300/0 conn(0x7f8cd00c0420 0x7f8cd0070080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:31.420 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:31.419+0000 7f8cceffd640 1 --2- 172.21.15.73:0/2707560846 >> v2:172.21.15.142:3300/0 conn(0x7f8cd006fca0 0x7f8cd0072700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:31.421 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:31.419+0000 7f8cce7fc640 1 -- 172.21.15.73:0/2707560846 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3698196425 0 0) 0x7f8cd0152560 con 0x7f8cd00c10d0 2023-12-12T09:44:31.421 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:31.419+0000 7f8cce7fc640 1 -- 172.21.15.73:0/2707560846 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8cbc003520 con 0x7f8cd00c10d0 2023-12-12T09:44:31.421 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:31.419+0000 7f8cc7fff640 1 -- 172.21.15.73:0/2707560846 >> v2:172.21.15.142:3300/0 conn(0x7f8cd006fca0 msgr2=0x7f8cd0072700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:44:31.421 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:31.419+0000 7f8cc7fff640 1 --2- 172.21.15.73:0/2707560846 >> v2:172.21.15.142:3300/0 conn(0x7f8cd006fca0 0x7f8cd0072700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:31.421 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:31.419+0000 7f8cc7fff640 1 -- 172.21.15.73:0/2707560846 >> v1:172.21.15.73:6789/0 conn(0x7f8cd00c10d0 legacy=0x7f8cd00c1560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:31.421 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:31.419+0000 7f8cc7fff640 1 -- 172.21.15.73:0/2707560846 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cd01532e0 con 0x7f8cd00c0420 2023-12-12T09:44:31.423 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:31.420+0000 7f8cc7fff640 1 --2- 172.21.15.73:0/2707560846 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8cd00c0420 0x7f8cd0070080 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f8cd0073cc0 tx=0x7f8cb802b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b8366f5d1ad19fd server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:44:31.423 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:31.421+0000 7f8cce7fc640 1 -- 172.21.15.73:0/2707560846 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cb802e070 con 0x7f8cd00c0420 2023-12-12T09:44:31.423 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:31.421+0000 7f8cce7fc640 1 -- 172.21.15.73:0/2707560846 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8cb80315a0 con 0x7f8cd00c0420 2023-12-12T09:44:31.423 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:31.421+0000 7f8cce7fc640 1 -- 172.21.15.73:0/2707560846 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cb8031930 con 0x7f8cd00c0420 2023-12-12T09:44:31.423 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:31.421+0000 7f8cd597c640 1 -- 172.21.15.73:0/2707560846 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8cd00c0420 msgr2=0x7f8cd0070080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:31.423 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:31.421+0000 7f8cd597c640 1 --2- 172.21.15.73:0/2707560846 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8cd00c0420 0x7f8cd0070080 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f8cd0073cc0 tx=0x7f8cb802b840 comp rx=0 tx=0).stop 2023-12-12T09:44:31.423 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:31.421+0000 7f8cd597c640 1 -- 172.21.15.73:0/2707560846 shutdown_connections 2023-12-12T09:44:31.423 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:31.421+0000 7f8cd597c640 1 --2- 172.21.15.73:0/2707560846 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8cd00c0420 0x7f8cd0070080 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:31.423 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:31.421+0000 7f8cd597c640 1 --2- 172.21.15.73:0/2707560846 >> v2:172.21.15.142:3300/0 conn(0x7f8cd006fca0 0x7f8cd0072700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:31.423 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:31.421+0000 7f8cd597c640 1 -- 172.21.15.73:0/2707560846 >> 172.21.15.73:0/2707560846 conn(0x7f8cd00a77d0 msgr2=0x7f8cd00a7bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:44:31.423 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:31.421+0000 7f8cd597c640 1 -- 172.21.15.73:0/2707560846 shutdown_connections 2023-12-12T09:44:31.423 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:31.421+0000 7f8cd597c640 1 -- 172.21.15.73:0/2707560846 wait complete. 2023-12-12T09:44:31.424 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:31.423+0000 7f8cd597c640 1 Processor -- start 2023-12-12T09:44:31.424 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:31.423+0000 7f8cd597c640 1 -- start start 2023-12-12T09:44:31.426 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:31.424+0000 7f8cd597c640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8cd006fca0 0x7f8cd01518e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:31.426 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:31.424+0000 7f8cd597c640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8cd00c0420 0x7f8cd01556d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:31.426 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:31.424+0000 7f8cd597c640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8cd00c10d0 0x7f8cd0155c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:31.426 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:31.424+0000 7f8cd597c640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cd01edbd0 con 0x7f8cd00c10d0 2023-12-12T09:44:31.426 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:31.424+0000 7f8cd597c640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cd00aa810 con 0x7f8cd006fca0 2023-12-12T09:44:31.426 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:31.424+0000 7f8cd597c640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8cd01ea2e0 con 0x7f8cd00c0420 2023-12-12T09:44:31.427 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:31.424+0000 7f8ccf7fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8cd00c10d0 0x7f8cd0155c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:31.427 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:31.424+0000 7f8ccf7fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8cd00c10d0 0x7f8cd0155c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:41604/0 (socket says 172.21.15.73:41604) 2023-12-12T09:44:31.427 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:31.424+0000 7f8ccf7fe640 1 -- 172.21.15.73:0/1918295812 learned_addr learned my addr 172.21.15.73:0/1918295812 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:44:31.427 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:31.425+0000 7f8cc7fff640 1 --2- 172.21.15.73:0/1918295812 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8cd00c0420 0x7f8cd01556d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:31.427 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:31.425+0000 7f8cceffd640 1 --2- 172.21.15.73:0/1918295812 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8cd006fca0 0x7f8cd01518e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:31.427 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:31.425+0000 7f8ccf7fe640 1 -- 172.21.15.73:0/1918295812 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8cd00c0420 msgr2=0x7f8cd01556d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:31.428 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:31.425+0000 7f8ccf7fe640 1 --2- 172.21.15.73:0/1918295812 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8cd00c0420 0x7f8cd01556d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:31.428 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:31.425+0000 7f8ccf7fe640 1 -- 172.21.15.73:0/1918295812 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8cd006fca0 msgr2=0x7f8cd01518e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:31.428 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:31.425+0000 7f8ccf7fe640 1 --2- 172.21.15.73:0/1918295812 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8cd006fca0 0x7f8cd01518e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:31.428 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:31.425+0000 7f8ccf7fe640 1 -- 172.21.15.73:0/1918295812 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cb8009400 con 0x7f8cd00c10d0 2023-12-12T09:44:31.428 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:31.425+0000 7f8ccf7fe640 1 --2- 172.21.15.73:0/1918295812 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8cd00c10d0 0x7f8cd0155c10 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f8cc800cb40 tx=0x7f8cc800a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:44:31.430 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:31.425+0000 7f8cccff9640 1 -- 172.21.15.73:0/1918295812 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cc800aca0 con 0x7f8cd00c10d0 2023-12-12T09:44:31.430 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:31.425+0000 7f8cccff9640 1 -- 172.21.15.73:0/1918295812 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8cc800ae00 con 0x7f8cd00c10d0 2023-12-12T09:44:31.430 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:31.425+0000 7f8cccff9640 1 -- 172.21.15.73:0/1918295812 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cc8012620 con 0x7f8cd00c10d0 2023-12-12T09:44:31.430 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:31.425+0000 7f8cd597c640 1 -- 172.21.15.73:0/1918295812 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8cd01ea4f0 con 0x7f8cd00c10d0 2023-12-12T09:44:31.430 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:31.426+0000 7f8cd597c640 1 -- 172.21.15.73:0/1918295812 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8cd01eaab0 con 0x7f8cd00c10d0 2023-12-12T09:44:31.431 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:31.427+0000 7f8cd597c640 1 -- 172.21.15.73:0/1918295812 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8cd00c5520 con 0x7f8cd00c10d0 2023-12-12T09:44:31.431 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:31.427+0000 7f8cccff9640 1 -- 172.21.15.73:0/1918295812 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f8cc8007070 con 0x7f8cd00c10d0 2023-12-12T09:44:31.431 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:31.428+0000 7f8cccff9640 1 --2- 172.21.15.73:0/1918295812 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f8cb006ae70 0x7f8cb006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:31.431 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:31.428+0000 7f8cccff9640 1 -- 172.21.15.73:0/1918295812 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8cc8089670 con 0x7f8cd00c10d0 2023-12-12T09:44:31.431 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:31.429+0000 7f8cceffd640 1 --2- 172.21.15.73:0/1918295812 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f8cb006ae70 0x7f8cb006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:31.431 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:31.429+0000 7f8cceffd640 1 --2- 172.21.15.73:0/1918295812 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f8cb006ae70 0x7f8cb006d330 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f8cd01e8120 tx=0x7f8cc0008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:44:31.434 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:31.433+0000 7f8cccff9640 1 -- 172.21.15.73:0/1918295812 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f8cc8054710 con 0x7f8cd00c10d0 2023-12-12T09:44:31.702 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:31.701+0000 7f8cd597c640 1 -- 172.21.15.73:0/1918295812 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "auth rm", "entity": "client.testuser"} v 0) v1 -- 0x7f8cd00c5760 con 0x7f8cd00c10d0 2023-12-12T09:44:31.703 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:31.702+0000 7f8cccff9640 1 -- 172.21.15.73:0/1918295812 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "auth rm", "entity": "client.testuser"}]=0 v11) v1 ==== 84+0+0 (secure 0 0 0) 0x7f8cc8057d30 con 0x7f8cd00c10d0 2023-12-12T09:44:31.706 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:31.704+0000 7f8cd597c640 1 -- 172.21.15.73:0/1918295812 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f8cb006ae70 msgr2=0x7f8cb006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:31.706 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:31.704+0000 7f8cd597c640 1 --2- 172.21.15.73:0/1918295812 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f8cb006ae70 0x7f8cb006d330 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f8cd01e8120 tx=0x7f8cc0008040 comp rx=0 tx=0).stop 2023-12-12T09:44:31.706 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:31.704+0000 7f8cd597c640 1 -- 172.21.15.73:0/1918295812 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8cd00c10d0 msgr2=0x7f8cd0155c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:31.706 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:31.704+0000 7f8cd597c640 1 --2- 172.21.15.73:0/1918295812 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8cd00c10d0 0x7f8cd0155c10 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f8cc800cb40 tx=0x7f8cc800a060 comp rx=0 tx=0).stop 2023-12-12T09:44:31.706 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:31.705+0000 7f8cd597c640 1 -- 172.21.15.73:0/1918295812 shutdown_connections 2023-12-12T09:44:31.706 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:31.705+0000 7f8cd597c640 1 --2- 172.21.15.73:0/1918295812 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f8cb006ae70 0x7f8cb006d330 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:31.706 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:31.705+0000 7f8cd597c640 1 --2- 172.21.15.73:0/1918295812 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8cd00c10d0 0x7f8cd0155c10 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:31.706 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:31.705+0000 7f8cd597c640 1 --2- 172.21.15.73:0/1918295812 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8cd00c0420 0x7f8cd01556d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:31.706 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:31.705+0000 7f8cd597c640 1 --2- 172.21.15.73:0/1918295812 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8cd006fca0 0x7f8cd01518e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:31.707 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:31.705+0000 7f8cd597c640 1 -- 172.21.15.73:0/1918295812 >> 172.21.15.73:0/1918295812 conn(0x7f8cd00a77d0 msgr2=0x7f8cd00c3820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:44:31.707 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:31.705+0000 7f8cd597c640 1 -- 172.21.15.73:0/1918295812 shutdown_connections 2023-12-12T09:44:31.707 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:31.705+0000 7f8cd597c640 1 -- 172.21.15.73:0/1918295812 wait complete. 2023-12-12T09:44:31.726 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-12T09:44:31.934 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:31.933+0000 7fd05ee31640 1 Processor -- start 2023-12-12T09:44:31.934 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:31.933+0000 7fd05ee31640 1 -- start start 2023-12-12T09:44:31.936 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:31.934+0000 7fd05ee31640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fd05806db70 0x7fd0580c39b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:31.936 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:31.934+0000 7fd05ee31640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fd0580c5070 0x7fd0580c3ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:31.936 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:31.934+0000 7fd05ee31640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd058152610 con 0x7fd05814fa40 2023-12-12T09:44:31.936 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:31.934+0000 7fd05ee31640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0581528f0 con 0x7fd05806db70 2023-12-12T09:44:31.936 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:31.934+0000 7fd05ee31640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd058152bd0 con 0x7fd0580c5070 2023-12-12T09:44:31.936 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:31.935+0000 7fd057fff640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fd05806db70 0x7fd0580c39b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:31.936 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:31.935+0000 7fd05cbcd640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7fd05814fa40 0x7fd05806a4e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:32820/0 (socket says 172.21.15.73:32820) 2023-12-12T09:44:31.936 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:31.935+0000 7fd05cbcd640 1 -- 172.21.15.73:0/821010274 learned_addr learned my addr 172.21.15.73:0/821010274 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-12T09:44:31.937 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:31.935+0000 7fd057fff640 1 -- 172.21.15.73:0/821010274 >> v2:172.21.15.142:3300/0 conn(0x7fd0580c5070 msgr2=0x7fd0580c3ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:44:31.937 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:31.935+0000 7fd057fff640 1 --2- 172.21.15.73:0/821010274 >> v2:172.21.15.142:3300/0 conn(0x7fd0580c5070 0x7fd0580c3ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:31.937 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:31.935+0000 7fd057fff640 1 -- 172.21.15.73:0/821010274 >> v1:172.21.15.73:6789/0 conn(0x7fd05814fa40 legacy=0x7fd05806a4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:31.937 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:31.935+0000 7fd057fff640 1 -- 172.21.15.73:0/821010274 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd058152eb0 con 0x7fd05806db70 2023-12-12T09:44:31.937 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:31.936+0000 7fd057fff640 1 --2- 172.21.15.73:0/821010274 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd05806db70 0x7fd0580c39b0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fd05806fc50 tx=0x7fd04402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d35fadfd8fb46d15 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:44:31.939 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:31.937+0000 7fd0577fe640 1 -- 172.21.15.73:0/821010274 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd044031830 con 0x7fd05806db70 2023-12-12T09:44:31.939 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:31.937+0000 7fd0577fe640 1 -- 172.21.15.73:0/821010274 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd044031990 con 0x7fd05806db70 2023-12-12T09:44:31.939 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:31.937+0000 7fd0577fe640 1 -- 172.21.15.73:0/821010274 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd044031d20 con 0x7fd05806db70 2023-12-12T09:44:31.939 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:31.937+0000 7fd05ee31640 1 -- 172.21.15.73:0/821010274 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd05806db70 msgr2=0x7fd0580c39b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:31.939 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:31.937+0000 7fd05ee31640 1 --2- 172.21.15.73:0/821010274 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd05806db70 0x7fd0580c39b0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fd05806fc50 tx=0x7fd04402b8d0 comp rx=0 tx=0).stop 2023-12-12T09:44:31.939 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:31.937+0000 7fd05ee31640 1 -- 172.21.15.73:0/821010274 shutdown_connections 2023-12-12T09:44:31.939 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:31.937+0000 7fd05ee31640 1 --2- 172.21.15.73:0/821010274 >> v2:172.21.15.142:3300/0 conn(0x7fd0580c5070 0x7fd0580c3ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:31.939 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:31.937+0000 7fd05ee31640 1 --2- 172.21.15.73:0/821010274 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd05806db70 0x7fd0580c39b0 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:31.939 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:31.938+0000 7fd05ee31640 1 -- 172.21.15.73:0/821010274 >> 172.21.15.73:0/821010274 conn(0x7fd0580a8130 msgr2=0x7fd0580c24b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:44:31.940 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:31.938+0000 7fd05ee31640 1 -- 172.21.15.73:0/821010274 shutdown_connections 2023-12-12T09:44:31.940 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:31.938+0000 7fd05ee31640 1 -- 172.21.15.73:0/821010274 wait complete. 2023-12-12T09:44:31.940 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:31.939+0000 7fd05ee31640 1 Processor -- start 2023-12-12T09:44:31.940 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:31.939+0000 7fd05ee31640 1 -- start start 2023-12-12T09:44:31.943 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:31.940+0000 7fd05ee31640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd05806db70 0x7fd0581ea810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:31.943 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:31.940+0000 7fd05ee31640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd0580c5070 0x7fd0581515a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:31.943 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:31.940+0000 7fd05ee31640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd05814fa40 0x7fd0581d8800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:31.943 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:31.940+0000 7fd05ee31640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0581ea3f0 con 0x7fd05814fa40 2023-12-12T09:44:31.943 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:31.940+0000 7fd05ee31640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0581edd70 con 0x7fd0580c5070 2023-12-12T09:44:31.943 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:31.940+0000 7fd05ee31640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0581ee050 con 0x7fd05806db70 2023-12-12T09:44:31.943 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:31.941+0000 7fd05d3ce640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd05814fa40 0x7fd0581d8800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:31.943 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:31.941+0000 7fd05d3ce640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd05814fa40 0x7fd0581d8800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:41626/0 (socket says 172.21.15.73:41626) 2023-12-12T09:44:31.943 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:31.941+0000 7fd05d3ce640 1 -- 172.21.15.73:0/1692932930 learned_addr learned my addr 172.21.15.73:0/1692932930 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:44:31.943 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:31.941+0000 7fd057fff640 1 --2- 172.21.15.73:0/1692932930 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd0580c5070 0x7fd0581515a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:31.943 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:31.941+0000 7fd05cbcd640 1 --2- 172.21.15.73:0/1692932930 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd05806db70 0x7fd0581ea810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:31.944 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:31.941+0000 7fd05d3ce640 1 -- 172.21.15.73:0/1692932930 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd05806db70 msgr2=0x7fd0581ea810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:31.944 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:31.941+0000 7fd05d3ce640 1 --2- 172.21.15.73:0/1692932930 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd05806db70 0x7fd0581ea810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:31.944 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:31.941+0000 7fd05d3ce640 1 -- 172.21.15.73:0/1692932930 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd0580c5070 msgr2=0x7fd0581515a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:31.944 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:31.941+0000 7fd05d3ce640 1 --2- 172.21.15.73:0/1692932930 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd0580c5070 0x7fd0581515a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:31.944 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:31.941+0000 7fd05d3ce640 1 -- 172.21.15.73:0/1692932930 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd044009400 con 0x7fd05814fa40 2023-12-12T09:44:31.944 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:31.941+0000 7fd05d3ce640 1 --2- 172.21.15.73:0/1692932930 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd05814fa40 0x7fd0581d8800 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fd05000b970 tx=0x7fd05000be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:44:31.944 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:31.942+0000 7fd0557fa640 1 -- 172.21.15.73:0/1692932930 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd05000cb40 con 0x7fd05814fa40 2023-12-12T09:44:31.944 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:31.942+0000 7fd0557fa640 1 -- 172.21.15.73:0/1692932930 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd05000ccc0 con 0x7fd05814fa40 2023-12-12T09:44:31.944 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:31.942+0000 7fd05ee31640 1 -- 172.21.15.73:0/1692932930 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0581ea010 con 0x7fd05814fa40 2023-12-12T09:44:31.944 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:31.942+0000 7fd0557fa640 1 -- 172.21.15.73:0/1692932930 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd050014680 con 0x7fd05814fa40 2023-12-12T09:44:31.944 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:31.942+0000 7fd05ee31640 1 -- 172.21.15.73:0/1692932930 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0581de470 con 0x7fd05814fa40 2023-12-12T09:44:31.945 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:31.943+0000 7fd05ee31640 1 -- 172.21.15.73:0/1692932930 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd058067580 con 0x7fd05814fa40 2023-12-12T09:44:31.945 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:31.944+0000 7fd0557fa640 1 -- 172.21.15.73:0/1692932930 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fd05001d3b0 con 0x7fd05814fa40 2023-12-12T09:44:31.946 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:31.945+0000 7fd0557fa640 1 --2- 172.21.15.73:0/1692932930 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fd03c06ae40 0x7fd03c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:31.946 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:31.945+0000 7fd0557fa640 1 -- 172.21.15.73:0/1692932930 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd050089530 con 0x7fd05814fa40 2023-12-12T09:44:31.946 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:31.945+0000 7fd05cbcd640 1 --2- 172.21.15.73:0/1692932930 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fd03c06ae40 0x7fd03c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:31.946 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:31.946+0000 7fd05cbcd640 1 --2- 172.21.15.73:0/1692932930 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fd03c06ae40 0x7fd03c06d300 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fd04c005880 tx=0x7fd04c009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:44:31.950 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:31.949+0000 7fd0557fa640 1 -- 172.21.15.73:0/1692932930 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fd050054670 con 0x7fd05814fa40 2023-12-12T09:44:32.141 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:32.139+0000 7fd05ee31640 1 -- 172.21.15.73:0/1692932930 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd0580c00f0 con 0x7fd05814fa40 2023-12-12T09:44:32.142 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:32.142+0000 7fd0557fa640 1 -- 172.21.15.73:0/1692932930 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v34) v1 ==== 74+0+16581 (secure 0 0 0) 0x7fd050057c90 con 0x7fd05814fa40 2023-12-12T09:44:32.143 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-12T09:44:32.143 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":34,"fsid":"ba240992-02b8-4c7e-92f2-27eb29ac433b","created":"2023-12-12T09:43:02.454719+0000","modified":"2023-12-12T09:44:22.500256+0000","last_up_change":"2023-12-12T09:43:13.913440+0000","last_in_change":"2023-12-12T09:43:05.925348+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-12T09:43:15.525508+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-12-12T09:44:18.641446+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-12-12T09:44:19.952405+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"dd9074be-dbe2-4c34-9896-a4223d8d3940","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":4047810203},{"type":"v1","addr":"172.21.15.73:6801","nonce":4047810203}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":4047810203},{"type":"v1","addr":"172.21.15.73:6803","nonce":4047810203}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":4047810203},{"type":"v1","addr":"172.21.15.73:6807","nonce":4047810203}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":4047810203},{"type":"v1","addr":"172.21.15.73:6805","nonce":4047810203}]},"public_addr":"172.21.15.73:6801/4047810203","cluster_addr":"172.21.15.73:6803/4047810203","heartbeat_back_addr":"172.21.15.73:6807/4047810203","heartbeat_front_addr":"172.21.15.73:6805/4047810203","state":["exists","up"]},{"osd":1,"uuid":"c4a05052-96d4-4758-a4e1-1a37f1e07fed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":1356058331},{"type":"v1","addr":"172.21.15.73:6824","nonce":1356058331}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":1356058331},{"type":"v1","addr":"172.21.15.73:6827","nonce":1356058331}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":1356058331},{"type":"v1","addr":"172.21.15.73:6831","nonce":1356058331}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":1356058331},{"type":"v1","addr":"172.21.15.73:6829","nonce":1356058331}]},"public_addr":"172.21.15.73:6824/1356058331","cluster_addr":"172.21.15.73:6827/1356058331","heartbeat_back_addr":"172.21.15.73:6831/1356058331","heartbeat_front_addr":"172.21.15.73:6829/1356058331","state":["exists","up"]},{"osd":2,"uuid":"512bc8ac-72c2-40d4-b3d2-d867a92c5213","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":1228903316},{"type":"v1","addr":"172.21.15.73:6817","nonce":1228903316}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":1228903316},{"type":"v1","addr":"172.21.15.73:6819","nonce":1228903316}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6823","nonce":1228903316},{"type":"v1","addr":"172.21.15.73:6825","nonce":1228903316}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":1228903316},{"type":"v1","addr":"172.21.15.73:6821","nonce":1228903316}]},"public_addr":"172.21.15.73:6817/1228903316","cluster_addr":"172.21.15.73:6819/1228903316","heartbeat_back_addr":"172.21.15.73:6825/1228903316","heartbeat_front_addr":"172.21.15.73:6821/1228903316","state":["exists","up"]},{"osd":3,"uuid":"3d1a91e0-42bf-437a-8eae-8d357c8f63a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":1293329670},{"type":"v1","addr":"172.21.15.73:6809","nonce":1293329670}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6810","nonce":1293329670},{"type":"v1","addr":"172.21.15.73:6811","nonce":1293329670}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":1293329670},{"type":"v1","addr":"172.21.15.73:6815","nonce":1293329670}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":1293329670},{"type":"v1","addr":"172.21.15.73:6813","nonce":1293329670}]},"public_addr":"172.21.15.73:6809/1293329670","cluster_addr":"172.21.15.73:6811/1293329670","heartbeat_back_addr":"172.21.15.73:6815/1293329670","heartbeat_front_addr":"172.21.15.73:6813/1293329670","state":["exists","up"]},{"osd":4,"uuid":"4b302fff-834c-4069-ac19-00e46f6c87b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":3727975702},{"type":"v1","addr":"172.21.15.142:6801","nonce":3727975702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":3727975702},{"type":"v1","addr":"172.21.15.142:6803","nonce":3727975702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6809","nonce":3727975702},{"type":"v1","addr":"172.21.15.142:6811","nonce":3727975702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6805","nonce":3727975702},{"type":"v1","addr":"172.21.15.142:6807","nonce":3727975702}]},"public_addr":"172.21.15.142:6801/3727975702","cluster_addr":"172.21.15.142:6803/3727975702","heartbeat_back_addr":"172.21.15.142:6811/3727975702","heartbeat_front_addr":"172.21.15.142:6807/3727975702","state":["exists","up"]},{"osd":5,"uuid":"d7cdace2-67d0-45cc-95f2-515cf6ef1b82","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6817","nonce":2353193632},{"type":"v1","addr":"172.21.15.142:6819","nonce":2353193632}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6821","nonce":2353193632},{"type":"v1","addr":"172.21.15.142:6823","nonce":2353193632}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6829","nonce":2353193632},{"type":"v1","addr":"172.21.15.142:6831","nonce":2353193632}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6825","nonce":2353193632},{"type":"v1","addr":"172.21.15.142:6827","nonce":2353193632}]},"public_addr":"172.21.15.142:6819/2353193632","cluster_addr":"172.21.15.142:6823/2353193632","heartbeat_back_addr":"172.21.15.142:6831/2353193632","heartbeat_front_addr":"172.21.15.142:6827/2353193632","state":["exists","up"]},{"osd":6,"uuid":"649ce78a-5626-445c-aedc-a651ed05a6f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":2006111986},{"type":"v1","addr":"172.21.15.142:6806","nonce":2006111986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":2006111986},{"type":"v1","addr":"172.21.15.142:6810","nonce":2006111986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":2006111986},{"type":"v1","addr":"172.21.15.142:6815","nonce":2006111986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":2006111986},{"type":"v1","addr":"172.21.15.142:6813","nonce":2006111986}]},"public_addr":"172.21.15.142:6806/2006111986","cluster_addr":"172.21.15.142:6810/2006111986","heartbeat_back_addr":"172.21.15.142:6815/2006111986","heartbeat_front_addr":"172.21.15.142:6813/2006111986","state":["exists","up"]},{"osd":7,"uuid":"af15ae3b-c1d0-4acf-92db-8a1805494d13","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":2573794341},{"type":"v1","addr":"172.21.15.142:6818","nonce":2573794341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":2573794341},{"type":"v1","addr":"172.21.15.142:6822","nonce":2573794341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":2573794341},{"type":"v1","addr":"172.21.15.142:6830","nonce":2573794341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":2573794341},{"type":"v1","addr":"172.21.15.142:6826","nonce":2573794341}]},"public_addr":"172.21.15.142:6818/2573794341","cluster_addr":"172.21.15.142:6822/2573794341","heartbeat_back_addr":"172.21.15.142:6830/2573794341","heartbeat_front_addr":"172.21.15.142:6826/2573794341","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.185824+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.262103+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.225556+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:10.523459+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:10.706035+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.257339+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.301776+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.051960+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-12T09:44:32.146 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:32.144+0000 7fd05ee31640 1 -- 172.21.15.73:0/1692932930 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fd03c06ae40 msgr2=0x7fd03c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:32.146 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:32.144+0000 7fd05ee31640 1 --2- 172.21.15.73:0/1692932930 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fd03c06ae40 0x7fd03c06d300 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fd04c005880 tx=0x7fd04c009040 comp rx=0 tx=0).stop 2023-12-12T09:44:32.146 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:32.144+0000 7fd05ee31640 1 -- 172.21.15.73:0/1692932930 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd05814fa40 msgr2=0x7fd0581d8800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:32.146 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:32.144+0000 7fd05ee31640 1 --2- 172.21.15.73:0/1692932930 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd05814fa40 0x7fd0581d8800 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fd05000b970 tx=0x7fd05000be30 comp rx=0 tx=0).stop 2023-12-12T09:44:32.146 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:32.144+0000 7fd05ee31640 1 -- 172.21.15.73:0/1692932930 shutdown_connections 2023-12-12T09:44:32.146 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:32.144+0000 7fd05ee31640 1 --2- 172.21.15.73:0/1692932930 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fd03c06ae40 0x7fd03c06d300 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:32.146 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:32.144+0000 7fd05ee31640 1 --2- 172.21.15.73:0/1692932930 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd05814fa40 0x7fd0581d8800 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:32.146 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:32.144+0000 7fd05ee31640 1 --2- 172.21.15.73:0/1692932930 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd0580c5070 0x7fd0581515a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:32.146 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:32.144+0000 7fd05ee31640 1 --2- 172.21.15.73:0/1692932930 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd05806db70 0x7fd0581ea810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:32.146 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:32.144+0000 7fd05ee31640 1 -- 172.21.15.73:0/1692932930 >> 172.21.15.73:0/1692932930 conn(0x7fd0580a8130 msgr2=0x7fd0580a66c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:44:32.147 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:32.145+0000 7fd05ee31640 1 -- 172.21.15.73:0/1692932930 shutdown_connections 2023-12-12T09:44:32.147 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:32.145+0000 7fd05ee31640 1 -- 172.21.15.73:0/1692932930 wait complete. 2023-12-12T09:44:32.165 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-12T09:43:15.525508+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-12T09:44:18.641446+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '33', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data', 'create_time': '2023-12-12T09:44:19.952405+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '34', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-12T09:44:32.166 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-12T09:44:32.383 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:32.381+0000 7f5f54989640 1 Processor -- start 2023-12-12T09:44:32.383 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:32.382+0000 7f5f54989640 1 -- start start 2023-12-12T09:44:32.385 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:32.383+0000 7f5f54989640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5f5006d350 0x7f5f5006dc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:32.385 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:32.383+0000 7f5f54989640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f5f50152500 0x7f5f50152990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:32.385 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:32.383+0000 7f5f54989640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f500c16c0 con 0x7f5f5014f8c0 2023-12-12T09:44:32.385 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:32.383+0000 7f5f54989640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f500c1090 con 0x7f5f50152500 2023-12-12T09:44:32.385 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:32.383+0000 7f5f54989640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f500c14b0 con 0x7f5f5006d350 2023-12-12T09:44:32.385 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:32.383+0000 7f5f4ed9d640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f5f50152500 0x7f5f50152990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:32.385 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:32.384+0000 7f5f4ed9d640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f5f50152500 0x7f5f50152990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:41634/0 (socket says 172.21.15.73:41634) 2023-12-12T09:44:32.385 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:32.384+0000 7f5f4ed9d640 1 -- 172.21.15.73:0/1714655906 learned_addr learned my addr 172.21.15.73:0/1714655906 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:44:32.386 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:32.384+0000 7f5f4dd9b640 1 --2- 172.21.15.73:0/1714655906 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5f5006d350 0x7f5f5006dc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:32.386 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:32.384+0000 7f5f4ed9d640 1 -- 172.21.15.73:0/1714655906 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5f5006d350 msgr2=0x7f5f5006dc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:44:32.386 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:32.384+0000 7f5f4ed9d640 1 --2- 172.21.15.73:0/1714655906 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5f5006d350 0x7f5f5006dc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:32.386 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:32.384+0000 7f5f4ed9d640 1 -- 172.21.15.73:0/1714655906 >> v1:172.21.15.142:6789/0 conn(0x7f5f5014f8c0 legacy=0x7f5f50071e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:32.386 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:32.384+0000 7f5f4ed9d640 1 -- 172.21.15.73:0/1714655906 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f500c19a0 con 0x7f5f50152500 2023-12-12T09:44:32.386 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:32.385+0000 7f5f4ed9d640 1 --2- 172.21.15.73:0/1714655906 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5f50152500 0x7f5f50152990 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f5f48009870 tx=0x7f5f4802b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e4770d52f64f376 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:44:32.387 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:32.386+0000 7f5f4d59a640 1 -- 172.21.15.73:0/1714655906 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f48030840 con 0x7f5f50152500 2023-12-12T09:44:32.387 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:32.386+0000 7f5f4d59a640 1 -- 172.21.15.73:0/1714655906 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f480309a0 con 0x7f5f50152500 2023-12-12T09:44:32.387 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:32.386+0000 7f5f4d59a640 1 -- 172.21.15.73:0/1714655906 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f48030d30 con 0x7f5f50152500 2023-12-12T09:44:32.388 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:32.386+0000 7f5f54989640 1 -- 172.21.15.73:0/1714655906 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5f50152500 msgr2=0x7f5f50152990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:32.388 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:32.386+0000 7f5f54989640 1 --2- 172.21.15.73:0/1714655906 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5f50152500 0x7f5f50152990 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f5f48009870 tx=0x7f5f4802b980 comp rx=0 tx=0).stop 2023-12-12T09:44:32.388 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:32.386+0000 7f5f54989640 1 -- 172.21.15.73:0/1714655906 shutdown_connections 2023-12-12T09:44:32.388 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:32.386+0000 7f5f54989640 1 --2- 172.21.15.73:0/1714655906 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5f50152500 0x7f5f50152990 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:32.388 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:32.386+0000 7f5f54989640 1 --2- 172.21.15.73:0/1714655906 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5f5006d350 0x7f5f5006dc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:32.388 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:32.386+0000 7f5f54989640 1 -- 172.21.15.73:0/1714655906 >> 172.21.15.73:0/1714655906 conn(0x7f5f5006a4e0 msgr2=0x7f5f5006a8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:44:32.388 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:32.386+0000 7f5f54989640 1 -- 172.21.15.73:0/1714655906 shutdown_connections 2023-12-12T09:44:32.388 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:32.386+0000 7f5f54989640 1 -- 172.21.15.73:0/1714655906 wait complete. 2023-12-12T09:44:32.389 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:32.388+0000 7f5f54989640 1 Processor -- start 2023-12-12T09:44:32.389 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:32.388+0000 7f5f54989640 1 -- start start 2023-12-12T09:44:32.392 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:32.389+0000 7f5f54989640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5f5006d350 0x7f5f50070f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:32.392 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:32.389+0000 7f5f54989640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5f5014f8c0 0x7f5f501ea320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:32.392 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:32.389+0000 7f5f54989640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5f50152500 0x7f5f501ea860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:32.392 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:32.389+0000 7f5f54989640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f500aa550 con 0x7f5f50152500 2023-12-12T09:44:32.392 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:32.389+0000 7f5f54989640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f500ab660 con 0x7f5f5006d350 2023-12-12T09:44:32.392 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:32.389+0000 7f5f54989640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f5014c3a0 con 0x7f5f5014f8c0 2023-12-12T09:44:32.392 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:32.389+0000 7f5f4ed9d640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5f50152500 0x7f5f501ea860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:32.392 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:32.389+0000 7f5f4ed9d640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5f50152500 0x7f5f501ea860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:41650/0 (socket says 172.21.15.73:41650) 2023-12-12T09:44:32.392 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:32.390+0000 7f5f4ed9d640 1 -- 172.21.15.73:0/3055245283 learned_addr learned my addr 172.21.15.73:0/3055245283 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:44:32.393 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:32.390+0000 7f5f4e59c640 1 --2- 172.21.15.73:0/3055245283 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5f5006d350 0x7f5f50070f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:32.393 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:32.390+0000 7f5f4dd9b640 1 --2- 172.21.15.73:0/3055245283 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5f5014f8c0 0x7f5f501ea320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:32.393 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:32.390+0000 7f5f4ed9d640 1 -- 172.21.15.73:0/3055245283 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5f5014f8c0 msgr2=0x7f5f501ea320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:32.393 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:32.390+0000 7f5f4ed9d640 1 --2- 172.21.15.73:0/3055245283 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5f5014f8c0 0x7f5f501ea320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:32.393 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:32.390+0000 7f5f4ed9d640 1 -- 172.21.15.73:0/3055245283 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5f5006d350 msgr2=0x7f5f50070f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:32.393 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:32.390+0000 7f5f4ed9d640 1 --2- 172.21.15.73:0/3055245283 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5f5006d350 0x7f5f50070f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:32.393 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:32.390+0000 7f5f4ed9d640 1 -- 172.21.15.73:0/3055245283 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f480094d0 con 0x7f5f50152500 2023-12-12T09:44:32.393 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:32.390+0000 7f5f4ed9d640 1 --2- 172.21.15.73:0/3055245283 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5f50152500 0x7f5f501ea860 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f5f480090b0 tx=0x7f5f48004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:44:32.393 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:32.391+0000 7f5f46ffd640 1 -- 172.21.15.73:0/3055245283 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f4803e040 con 0x7f5f50152500 2023-12-12T09:44:32.393 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:32.391+0000 7f5f46ffd640 1 -- 172.21.15.73:0/3055245283 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f48039c90 con 0x7f5f50152500 2023-12-12T09:44:32.393 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:32.391+0000 7f5f46ffd640 1 -- 172.21.15.73:0/3055245283 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f480443f0 con 0x7f5f50152500 2023-12-12T09:44:32.393 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:32.391+0000 7f5f54989640 1 -- 172.21.15.73:0/3055245283 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f5014c680 con 0x7f5f50152500 2023-12-12T09:44:32.393 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:32.391+0000 7f5f54989640 1 -- 172.21.15.73:0/3055245283 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f50071450 con 0x7f5f50152500 2023-12-12T09:44:32.394 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:32.392+0000 7f5f54989640 1 -- 172.21.15.73:0/3055245283 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f50067070 con 0x7f5f50152500 2023-12-12T09:44:32.394 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:32.393+0000 7f5f46ffd640 1 -- 172.21.15.73:0/3055245283 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f5f48043390 con 0x7f5f50152500 2023-12-12T09:44:32.396 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:32.395+0000 7f5f46ffd640 1 --2- 172.21.15.73:0/3055245283 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f5f3006ae70 0x7f5f3006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:32.396 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:32.395+0000 7f5f46ffd640 1 -- 172.21.15.73:0/3055245283 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5f480ab950 con 0x7f5f50152500 2023-12-12T09:44:32.396 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:32.395+0000 7f5f4e59c640 1 --2- 172.21.15.73:0/3055245283 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f5f3006ae70 0x7f5f3006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:32.397 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:32.396+0000 7f5f4e59c640 1 --2- 172.21.15.73:0/3055245283 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f5f3006ae70 0x7f5f3006d330 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f5f5014be80 tx=0x7f5f40009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:44:32.401 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:32.400+0000 7f5f46ffd640 1 -- 172.21.15.73:0/3055245283 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f5f48076aa0 con 0x7f5f50152500 2023-12-12T09:44:32.593 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:32.590+0000 7f5f54989640 1 -- 172.21.15.73:0/3055245283 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f5f50067580 con 0x7f5f50152500 2023-12-12T09:44:32.593 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:32.591+0000 7f5f46ffd640 1 -- 172.21.15.73:0/3055245283 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v34) v1 ==== 93+0+10 (secure 0 0 0) 0x7f5f4807a0c0 con 0x7f5f50152500 2023-12-12T09:44:32.594 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 1 2023-12-12T09:44:32.595 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:32.593+0000 7f5f54989640 1 -- 172.21.15.73:0/3055245283 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f5f3006ae70 msgr2=0x7f5f3006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:32.595 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:32.593+0000 7f5f54989640 1 --2- 172.21.15.73:0/3055245283 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f5f3006ae70 0x7f5f3006d330 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f5f5014be80 tx=0x7f5f40009040 comp rx=0 tx=0).stop 2023-12-12T09:44:32.595 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:32.594+0000 7f5f54989640 1 -- 172.21.15.73:0/3055245283 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5f50152500 msgr2=0x7f5f501ea860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:32.596 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:32.594+0000 7f5f54989640 1 --2- 172.21.15.73:0/3055245283 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5f50152500 0x7f5f501ea860 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f5f480090b0 tx=0x7f5f48004730 comp rx=0 tx=0).stop 2023-12-12T09:44:32.596 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:32.594+0000 7f5f54989640 1 -- 172.21.15.73:0/3055245283 shutdown_connections 2023-12-12T09:44:32.596 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:32.594+0000 7f5f54989640 1 --2- 172.21.15.73:0/3055245283 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f5f3006ae70 0x7f5f3006d330 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:32.596 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:32.594+0000 7f5f54989640 1 --2- 172.21.15.73:0/3055245283 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5f50152500 0x7f5f501ea860 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:32.596 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:32.594+0000 7f5f54989640 1 --2- 172.21.15.73:0/3055245283 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5f5014f8c0 0x7f5f501ea320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:32.596 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:32.594+0000 7f5f54989640 1 --2- 172.21.15.73:0/3055245283 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5f5006d350 0x7f5f50070f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:32.596 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:32.594+0000 7f5f54989640 1 -- 172.21.15.73:0/3055245283 >> 172.21.15.73:0/3055245283 conn(0x7f5f5006a4e0 msgr2=0x7f5f500c6210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:44:32.597 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:32.594+0000 7f5f54989640 1 -- 172.21.15.73:0/3055245283 shutdown_connections 2023-12-12T09:44:32.597 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:32.594+0000 7f5f54989640 1 -- 172.21.15.73:0/3055245283 wait complete. 2023-12-12T09:44:32.614 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-12T09:44:32.837 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:32.833+0000 7fef64153640 1 Processor -- start 2023-12-12T09:44:32.837 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:32.833+0000 7fef64153640 1 -- start start 2023-12-12T09:44:32.847 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:32.834+0000 7fef64153640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fef5c14ea60 0x7fef5c0c5420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:32.847 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:32.834+0000 7fef64153640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fef5c0c0320 0x7fef5c0c20b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:32.847 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:32.834+0000 7fef64153640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef5c0c3390 con 0x7fef5c0a4c90 2023-12-12T09:44:32.847 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:32.834+0000 7fef64153640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef5c0c0750 con 0x7fef5c0c0320 2023-12-12T09:44:32.847 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:32.834+0000 7fef64153640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef5c0c4b30 con 0x7fef5c14ea60 2023-12-12T09:44:32.847 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:32.835+0000 7fef626f0640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fef5c0c0320 0x7fef5c0c20b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:32.847 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:32.835+0000 7fef616ee640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7fef5c0a4c90 0x7fef5c0c4420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:32836/0 (socket says 172.21.15.73:32836) 2023-12-12T09:44:32.848 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:32.835+0000 7fef616ee640 1 -- 172.21.15.73:0/2126059666 learned_addr learned my addr 172.21.15.73:0/2126059666 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-12T09:44:32.848 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:32.835+0000 7fef61eef640 1 --2- 172.21.15.73:0/2126059666 >> v2:172.21.15.142:3300/0 conn(0x7fef5c14ea60 0x7fef5c0c5420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:32.848 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:32.835+0000 7fef60eed640 1 -- 172.21.15.73:0/2126059666 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3702428642 0 0) 0x7fef5c0c3390 con 0x7fef5c0a4c90 2023-12-12T09:44:32.848 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:32.835+0000 7fef626f0640 1 -- 172.21.15.73:0/2126059666 >> v2:172.21.15.142:3300/0 conn(0x7fef5c14ea60 msgr2=0x7fef5c0c5420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:44:32.848 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:32.835+0000 7fef626f0640 1 --2- 172.21.15.73:0/2126059666 >> v2:172.21.15.142:3300/0 conn(0x7fef5c14ea60 0x7fef5c0c5420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:32.848 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:32.835+0000 7fef626f0640 1 -- 172.21.15.73:0/2126059666 >> v1:172.21.15.73:6789/0 conn(0x7fef5c0a4c90 legacy=0x7fef5c0c4420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:32.848 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:32.835+0000 7fef626f0640 1 -- 172.21.15.73:0/2126059666 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef5c151e60 con 0x7fef5c0c0320 2023-12-12T09:44:32.848 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:32.835+0000 7fef61eef640 1 --2- 172.21.15.73:0/2126059666 >> v2:172.21.15.142:3300/0 conn(0x7fef5c14ea60 0x7fef5c0c5420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:44:32.848 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:32.836+0000 7fef626f0640 1 --2- 172.21.15.73:0/2126059666 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fef5c0c0320 0x7fef5c0c20b0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fef5c06b490 tx=0x7fef5402e050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f182029d56ef23e4 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:44:32.848 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:32.837+0000 7fef60eed640 1 -- 172.21.15.73:0/2126059666 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef5402ee00 con 0x7fef5c0c0320 2023-12-12T09:44:32.849 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:32.837+0000 7fef60eed640 1 -- 172.21.15.73:0/2126059666 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef54036440 con 0x7fef5c0c0320 2023-12-12T09:44:32.849 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:32.837+0000 7fef60eed640 1 -- 172.21.15.73:0/2126059666 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef540367d0 con 0x7fef5c0c0320 2023-12-12T09:44:32.849 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:32.837+0000 7fef64153640 1 -- 172.21.15.73:0/2126059666 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fef5c0c0320 msgr2=0x7fef5c0c20b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:32.849 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:32.837+0000 7fef64153640 1 --2- 172.21.15.73:0/2126059666 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fef5c0c0320 0x7fef5c0c20b0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fef5c06b490 tx=0x7fef5402e050 comp rx=0 tx=0).stop 2023-12-12T09:44:32.849 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:32.837+0000 7fef64153640 1 -- 172.21.15.73:0/2126059666 shutdown_connections 2023-12-12T09:44:32.849 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:32.837+0000 7fef64153640 1 --2- 172.21.15.73:0/2126059666 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fef5c0c0320 0x7fef5c0c20b0 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:32.849 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:32.837+0000 7fef64153640 1 --2- 172.21.15.73:0/2126059666 >> v2:172.21.15.142:3300/0 conn(0x7fef5c14ea60 0x7fef5c0c5420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:32.849 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:32.837+0000 7fef64153640 1 -- 172.21.15.73:0/2126059666 >> 172.21.15.73:0/2126059666 conn(0x7fef5c06a4e0 msgr2=0x7fef5c06a8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:44:32.849 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:32.837+0000 7fef64153640 1 -- 172.21.15.73:0/2126059666 shutdown_connections 2023-12-12T09:44:32.849 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:32.837+0000 7fef64153640 1 -- 172.21.15.73:0/2126059666 wait complete. 2023-12-12T09:44:32.849 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:32.839+0000 7fef64153640 1 Processor -- start 2023-12-12T09:44:32.849 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:32.839+0000 7fef64153640 1 -- start start 2023-12-12T09:44:32.850 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:32.840+0000 7fef64153640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fef5c0a4c90 0x7fef5c0aa8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:32.850 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:32.840+0000 7fef64153640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fef5c0c0320 0x7fef5c0a89d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:32.850 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:32.840+0000 7fef64153640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fef5c14ea60 0x7fef5c13ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:32.850 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:32.840+0000 7fef64153640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef5c143690 con 0x7fef5c14ea60 2023-12-12T09:44:32.850 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:32.840+0000 7fef64153640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef5c144780 con 0x7fef5c0a4c90 2023-12-12T09:44:32.850 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:32.840+0000 7fef64153640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef5c1e6380 con 0x7fef5c0c0320 2023-12-12T09:44:32.850 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:32.840+0000 7fef626f0640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fef5c14ea60 0x7fef5c13ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:32.850 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:32.840+0000 7fef626f0640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fef5c14ea60 0x7fef5c13ccc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:41658/0 (socket says 172.21.15.73:41658) 2023-12-12T09:44:32.850 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:32.840+0000 7fef626f0640 1 -- 172.21.15.73:0/1287877945 learned_addr learned my addr 172.21.15.73:0/1287877945 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:44:32.850 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:32.841+0000 7fef61eef640 1 --2- 172.21.15.73:0/1287877945 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fef5c0a4c90 0x7fef5c0aa8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:32.850 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:32.841+0000 7fef616ee640 1 --2- 172.21.15.73:0/1287877945 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fef5c0c0320 0x7fef5c0a89d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:32.850 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:32.841+0000 7fef626f0640 1 -- 172.21.15.73:0/1287877945 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fef5c0c0320 msgr2=0x7fef5c0a89d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:32.850 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:32.841+0000 7fef626f0640 1 --2- 172.21.15.73:0/1287877945 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fef5c0c0320 0x7fef5c0a89d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:32.851 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:32.841+0000 7fef626f0640 1 -- 172.21.15.73:0/1287877945 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fef5c0a4c90 msgr2=0x7fef5c0aa8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:32.851 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:32.841+0000 7fef626f0640 1 --2- 172.21.15.73:0/1287877945 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fef5c0a4c90 0x7fef5c0aa8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:32.851 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:32.841+0000 7fef626f0640 1 -- 172.21.15.73:0/1287877945 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef54009a70 con 0x7fef5c14ea60 2023-12-12T09:44:32.851 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:32.841+0000 7fef626f0640 1 --2- 172.21.15.73:0/1287877945 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fef5c14ea60 0x7fef5c13ccc0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fef5402e660 tx=0x7fef54004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:44:32.851 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:32.841+0000 7fef527fc640 1 -- 172.21.15.73:0/1287877945 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef54040820 con 0x7fef5c14ea60 2023-12-12T09:44:32.851 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:32.841+0000 7fef527fc640 1 -- 172.21.15.73:0/1287877945 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef54040980 con 0x7fef5c14ea60 2023-12-12T09:44:32.851 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:32.842+0000 7fef527fc640 1 -- 172.21.15.73:0/1287877945 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef54040cf0 con 0x7fef5c14ea60 2023-12-12T09:44:32.851 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:32.842+0000 7fef64153640 1 -- 172.21.15.73:0/1287877945 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef5c144c70 con 0x7fef5c14ea60 2023-12-12T09:44:32.851 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:32.842+0000 7fef64153640 1 -- 172.21.15.73:0/1287877945 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef5c144990 con 0x7fef5c14ea60 2023-12-12T09:44:32.851 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:32.843+0000 7fef64153640 1 -- 172.21.15.73:0/1287877945 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef5c074890 con 0x7fef5c14ea60 2023-12-12T09:44:32.851 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:32.844+0000 7fef527fc640 1 -- 172.21.15.73:0/1287877945 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fef5403d050 con 0x7fef5c14ea60 2023-12-12T09:44:32.851 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:32.844+0000 7fef527fc640 1 --2- 172.21.15.73:0/1287877945 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fef4006ae40 0x7fef4006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:32.852 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:32.844+0000 7fef527fc640 1 -- 172.21.15.73:0/1287877945 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fef540ae2c0 con 0x7fef5c14ea60 2023-12-12T09:44:32.852 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:32.845+0000 7fef61eef640 1 --2- 172.21.15.73:0/1287877945 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fef4006ae40 0x7fef4006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:32.852 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:32.845+0000 7fef61eef640 1 --2- 172.21.15.73:0/1287877945 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fef4006ae40 0x7fef4006d300 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fef5800a950 tx=0x7fef58008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:44:32.852 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:32.849+0000 7fef527fc640 1 -- 172.21.15.73:0/1287877945 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fef540792e0 con 0x7fef5c14ea60 2023-12-12T09:44:33.041 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:33.039+0000 7fef64153640 1 -- 172.21.15.73:0/1287877945 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fef5c067070 con 0x7fef5c14ea60 2023-12-12T09:44:33.041 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:33.040+0000 7fef527fc640 1 -- 172.21.15.73:0/1287877945 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v34) v1 ==== 104+0+11 (secure 0 0 0) 0x7fef5407c900 con 0x7fef5c14ea60 2023-12-12T09:44:33.042 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 32 2023-12-12T09:44:33.044 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:33.043+0000 7fef64153640 1 -- 172.21.15.73:0/1287877945 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fef4006ae40 msgr2=0x7fef4006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:33.045 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:33.043+0000 7fef64153640 1 --2- 172.21.15.73:0/1287877945 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fef4006ae40 0x7fef4006d300 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fef5800a950 tx=0x7fef58008040 comp rx=0 tx=0).stop 2023-12-12T09:44:33.045 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:33.043+0000 7fef64153640 1 -- 172.21.15.73:0/1287877945 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fef5c14ea60 msgr2=0x7fef5c13ccc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:33.045 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:33.043+0000 7fef64153640 1 --2- 172.21.15.73:0/1287877945 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fef5c14ea60 0x7fef5c13ccc0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fef5402e660 tx=0x7fef54004a40 comp rx=0 tx=0).stop 2023-12-12T09:44:33.045 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:33.043+0000 7fef64153640 1 -- 172.21.15.73:0/1287877945 shutdown_connections 2023-12-12T09:44:33.045 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:33.043+0000 7fef64153640 1 --2- 172.21.15.73:0/1287877945 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fef4006ae40 0x7fef4006d300 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:33.045 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:33.043+0000 7fef64153640 1 --2- 172.21.15.73:0/1287877945 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fef5c14ea60 0x7fef5c13ccc0 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:33.045 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:33.043+0000 7fef64153640 1 --2- 172.21.15.73:0/1287877945 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fef5c0c0320 0x7fef5c0a89d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:33.045 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:33.043+0000 7fef64153640 1 --2- 172.21.15.73:0/1287877945 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fef5c0a4c90 0x7fef5c0aa8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:33.045 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:33.043+0000 7fef64153640 1 -- 172.21.15.73:0/1287877945 >> 172.21.15.73:0/1287877945 conn(0x7fef5c06a4e0 msgr2=0x7fef5c06dc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:44:33.045 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:33.043+0000 7fef64153640 1 -- 172.21.15.73:0/1287877945 shutdown_connections 2023-12-12T09:44:33.045 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:33.043+0000 7fef64153640 1 -- 172.21.15.73:0/1287877945 wait complete. 2023-12-12T09:44:33.064 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-12T09:44:33.281 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:33.280+0000 7f0c4ac1e640 1 Processor -- start 2023-12-12T09:44:33.282 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:33.280+0000 7f0c4ac1e640 1 -- start start 2023-12-12T09:44:33.283 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:33.282+0000 7f0c4ac1e640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f0c44151820 0x7f0c44154460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:33.283 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:33.282+0000 7f0c4ac1e640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f0c44151c00 0x7f0c440c0d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:33.284 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:33.282+0000 7f0c4ac1e640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c441588e0 con 0x7f0c440c0830 2023-12-12T09:44:33.284 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:33.282+0000 7f0c4ac1e640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c440c0640 con 0x7f0c44151820 2023-12-12T09:44:33.284 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:33.282+0000 7f0c4ac1e640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c440c2c40 con 0x7f0c44151c00 2023-12-12T09:44:33.284 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:33.282+0000 7f0c489ba640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f0c44151820 0x7f0c44154460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:33.284 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:33.282+0000 7f0c491bb640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f0c440c0830 0x7f0c440bf7b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:32840/0 (socket says 172.21.15.73:32840) 2023-12-12T09:44:33.284 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:33.282+0000 7f0c491bb640 1 -- 172.21.15.73:0/1620300788 learned_addr learned my addr 172.21.15.73:0/1620300788 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-12T09:44:33.286 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:33.283+0000 7f0c43fff640 1 --2- 172.21.15.73:0/1620300788 >> v2:172.21.15.142:3300/0 conn(0x7f0c44151c00 0x7f0c440c0d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:33.286 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:33.283+0000 7f0c437fe640 1 -- 172.21.15.73:0/1620300788 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2449818875 0 0) 0x7f0c441588e0 con 0x7f0c440c0830 2023-12-12T09:44:33.286 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:33.283+0000 7f0c437fe640 1 -- 172.21.15.73:0/1620300788 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0c2c003520 con 0x7f0c440c0830 2023-12-12T09:44:33.286 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:33.283+0000 7f0c489ba640 1 -- 172.21.15.73:0/1620300788 >> v2:172.21.15.142:3300/0 conn(0x7f0c44151c00 msgr2=0x7f0c440c0d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:44:33.286 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:33.283+0000 7f0c489ba640 1 --2- 172.21.15.73:0/1620300788 >> v2:172.21.15.142:3300/0 conn(0x7f0c44151c00 0x7f0c440c0d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:33.286 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:33.283+0000 7f0c489ba640 1 -- 172.21.15.73:0/1620300788 >> v1:172.21.15.73:6789/0 conn(0x7f0c440c0830 legacy=0x7f0c440bf7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:33.287 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:33.283+0000 7f0c489ba640 1 -- 172.21.15.73:0/1620300788 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c440c0360 con 0x7f0c44151820 2023-12-12T09:44:33.287 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:33.283+0000 7f0c43fff640 1 --2- 172.21.15.73:0/1620300788 >> v2:172.21.15.142:3300/0 conn(0x7f0c44151c00 0x7f0c440c0d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:44:33.287 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:33.284+0000 7f0c489ba640 1 --2- 172.21.15.73:0/1620300788 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0c44151820 0x7f0c44154460 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f0c440c73c0 tx=0x7f0c3402be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b8499684ed73cc6 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:44:33.287 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:33.284+0000 7f0c437fe640 1 -- 172.21.15.73:0/1620300788 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c3402cbe0 con 0x7f0c44151820 2023-12-12T09:44:33.287 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:33.284+0000 7f0c437fe640 1 -- 172.21.15.73:0/1620300788 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c3402cd40 con 0x7f0c44151820 2023-12-12T09:44:33.287 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:33.284+0000 7f0c437fe640 1 -- 172.21.15.73:0/1620300788 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c34034640 con 0x7f0c44151820 2023-12-12T09:44:33.287 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:33.285+0000 7f0c4ac1e640 1 -- 172.21.15.73:0/1620300788 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0c44151820 msgr2=0x7f0c44154460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:33.287 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:33.285+0000 7f0c4ac1e640 1 --2- 172.21.15.73:0/1620300788 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0c44151820 0x7f0c44154460 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f0c440c73c0 tx=0x7f0c3402be30 comp rx=0 tx=0).stop 2023-12-12T09:44:33.287 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:33.285+0000 7f0c4ac1e640 1 -- 172.21.15.73:0/1620300788 shutdown_connections 2023-12-12T09:44:33.287 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:33.285+0000 7f0c4ac1e640 1 --2- 172.21.15.73:0/1620300788 >> v2:172.21.15.142:3300/0 conn(0x7f0c44151c00 0x7f0c440c0d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:33.287 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:33.285+0000 7f0c4ac1e640 1 --2- 172.21.15.73:0/1620300788 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0c44151820 0x7f0c44154460 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:33.287 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:33.285+0000 7f0c4ac1e640 1 -- 172.21.15.73:0/1620300788 >> 172.21.15.73:0/1620300788 conn(0x7f0c440c6380 msgr2=0x7f0c440c6760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:44:33.287 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:33.285+0000 7f0c4ac1e640 1 -- 172.21.15.73:0/1620300788 shutdown_connections 2023-12-12T09:44:33.287 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:33.285+0000 7f0c4ac1e640 1 -- 172.21.15.73:0/1620300788 wait complete. 2023-12-12T09:44:33.288 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:33.287+0000 7f0c4ac1e640 1 Processor -- start 2023-12-12T09:44:33.288 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:33.287+0000 7f0c4ac1e640 1 -- start start 2023-12-12T09:44:33.290 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:33.288+0000 7f0c4ac1e640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0c440c0830 0x7f0c44152540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:33.290 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:33.288+0000 7f0c4ac1e640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0c44151820 0x7f0c44155790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:33.290 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:33.288+0000 7f0c4ac1e640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0c441dedf0 0x7f0c44155cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:33.290 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:33.288+0000 7f0c4ac1e640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c441ddf00 con 0x7f0c440c0830 2023-12-12T09:44:33.290 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:33.288+0000 7f0c4ac1e640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c44154590 con 0x7f0c441dedf0 2023-12-12T09:44:33.290 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:33.288+0000 7f0c4ac1e640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c44154870 con 0x7f0c44151820 2023-12-12T09:44:33.290 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:33.288+0000 7f0c489ba640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0c440c0830 0x7f0c44152540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:33.291 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:33.288+0000 7f0c489ba640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0c440c0830 0x7f0c44152540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:41672/0 (socket says 172.21.15.73:41672) 2023-12-12T09:44:33.291 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:33.288+0000 7f0c489ba640 1 -- 172.21.15.73:0/1509230595 learned_addr learned my addr 172.21.15.73:0/1509230595 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:44:33.291 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:33.288+0000 7f0c489ba640 1 -- 172.21.15.73:0/1509230595 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0c44151820 msgr2=0x7f0c44155790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:33.291 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:33.288+0000 7f0c489ba640 1 --2- 172.21.15.73:0/1509230595 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0c44151820 0x7f0c44155790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:33.291 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:33.288+0000 7f0c489ba640 1 -- 172.21.15.73:0/1509230595 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0c441dedf0 msgr2=0x7f0c44155cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:33.291 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:33.288+0000 7f0c489ba640 1 --2- 172.21.15.73:0/1509230595 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0c441dedf0 0x7f0c44155cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:33.291 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:33.288+0000 7f0c489ba640 1 -- 172.21.15.73:0/1509230595 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c34009a70 con 0x7f0c440c0830 2023-12-12T09:44:33.291 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:33.289+0000 7f0c489ba640 1 --2- 172.21.15.73:0/1509230595 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0c440c0830 0x7f0c44152540 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f0c34009e80 tx=0x7f0c34004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:44:33.291 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:33.289+0000 7f0c417fa640 1 -- 172.21.15.73:0/1509230595 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c3403e610 con 0x7f0c440c0830 2023-12-12T09:44:33.291 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:33.289+0000 7f0c417fa640 1 -- 172.21.15.73:0/1509230595 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c3403e790 con 0x7f0c440c0830 2023-12-12T09:44:33.291 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:33.289+0000 7f0c417fa640 1 -- 172.21.15.73:0/1509230595 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c3403eb40 con 0x7f0c440c0830 2023-12-12T09:44:33.291 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:33.289+0000 7f0c4ac1e640 1 -- 172.21.15.73:0/1509230595 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c441dd840 con 0x7f0c440c0830 2023-12-12T09:44:33.291 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:33.289+0000 7f0c4ac1e640 1 -- 172.21.15.73:0/1509230595 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c44152a80 con 0x7f0c440c0830 2023-12-12T09:44:33.292 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:33.290+0000 7f0c4ac1e640 1 -- 172.21.15.73:0/1509230595 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c441de040 con 0x7f0c440c0830 2023-12-12T09:44:33.292 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:33.291+0000 7f0c417fa640 1 -- 172.21.15.73:0/1509230595 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f0c3403b050 con 0x7f0c440c0830 2023-12-12T09:44:33.293 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:33.292+0000 7f0c417fa640 1 --2- 172.21.15.73:0/1509230595 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f0c3006ae40 0x7f0c3006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:33.293 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:33.292+0000 7f0c417fa640 1 -- 172.21.15.73:0/1509230595 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0c340abf80 con 0x7f0c440c0830 2023-12-12T09:44:33.293 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:33.292+0000 7f0c43fff640 1 --2- 172.21.15.73:0/1509230595 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f0c3006ae40 0x7f0c3006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:33.294 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:33.293+0000 7f0c43fff640 1 --2- 172.21.15.73:0/1509230595 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f0c3006ae40 0x7f0c3006d300 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f0c38006fd0 tx=0x7f0c38008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:44:33.297 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:33.296+0000 7f0c417fa640 1 -- 172.21.15.73:0/1509230595 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f0c34077020 con 0x7f0c440c0830 2023-12-12T09:44:33.488 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:33.487+0000 7f0c4ac1e640 1 -- 172.21.15.73:0/1509230595 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f0c44067580 con 0x7f0c440c0830 2023-12-12T09:44:33.488 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:33.487+0000 7f0c417fa640 1 -- 172.21.15.73:0/1509230595 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v34) v1 ==== 100+0+11 (secure 0 0 0) 0x7f0c34009450 con 0x7f0c440c0830 2023-12-12T09:44:33.489 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 64 2023-12-12T09:44:33.491 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:33.490+0000 7f0c4ac1e640 1 -- 172.21.15.73:0/1509230595 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f0c3006ae40 msgr2=0x7f0c3006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:33.491 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:33.490+0000 7f0c4ac1e640 1 --2- 172.21.15.73:0/1509230595 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f0c3006ae40 0x7f0c3006d300 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f0c38006fd0 tx=0x7f0c38008040 comp rx=0 tx=0).stop 2023-12-12T09:44:33.491 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:33.490+0000 7f0c4ac1e640 1 -- 172.21.15.73:0/1509230595 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0c440c0830 msgr2=0x7f0c44152540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:33.491 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:33.490+0000 7f0c4ac1e640 1 --2- 172.21.15.73:0/1509230595 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0c440c0830 0x7f0c44152540 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f0c34009e80 tx=0x7f0c34004a40 comp rx=0 tx=0).stop 2023-12-12T09:44:33.492 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:33.490+0000 7f0c4ac1e640 1 -- 172.21.15.73:0/1509230595 shutdown_connections 2023-12-12T09:44:33.492 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:33.490+0000 7f0c4ac1e640 1 --2- 172.21.15.73:0/1509230595 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f0c3006ae40 0x7f0c3006d300 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:33.492 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:33.490+0000 7f0c4ac1e640 1 --2- 172.21.15.73:0/1509230595 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0c441dedf0 0x7f0c44155cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:33.492 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:33.490+0000 7f0c4ac1e640 1 --2- 172.21.15.73:0/1509230595 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0c44151820 0x7f0c44155790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:33.492 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:33.490+0000 7f0c4ac1e640 1 --2- 172.21.15.73:0/1509230595 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0c440c0830 0x7f0c44152540 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:33.492 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:33.490+0000 7f0c4ac1e640 1 -- 172.21.15.73:0/1509230595 >> 172.21.15.73:0/1509230595 conn(0x7f0c440c6380 msgr2=0x7f0c440c6760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:44:33.492 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:33.490+0000 7f0c4ac1e640 1 -- 172.21.15.73:0/1509230595 shutdown_connections 2023-12-12T09:44:33.492 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:33.490+0000 7f0c4ac1e640 1 -- 172.21.15.73:0/1509230595 wait complete. 2023-12-12T09:44:33.510 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-12-12T09:44:33.722 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:33.721+0000 7f50d3da5640 1 Processor -- start 2023-12-12T09:44:33.723 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:33.721+0000 7f50d3da5640 1 -- start start 2023-12-12T09:44:33.724 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:33.723+0000 7f50d3da5640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f50cc14fa40 0x7f50cc06a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:33.724 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:33.723+0000 7f50d3da5640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f50cc06db70 0x7f50cc0c39b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:33.724 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:33.723+0000 7f50d3da5640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50cc152610 con 0x7f50cc0c5070 2023-12-12T09:44:33.724 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:33.723+0000 7f50d3da5640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50cc1528f0 con 0x7f50cc14fa40 2023-12-12T09:44:33.724 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:33.723+0000 7f50d3da5640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50cc152bd0 con 0x7f50cc06db70 2023-12-12T09:44:33.725 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:33.723+0000 7f50d1b41640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f50cc14fa40 0x7f50cc06a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:33.725 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:33.723+0000 7f50d2342640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f50cc0c5070 0x7f50cc0c3ef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:32848/0 (socket says 172.21.15.73:32848) 2023-12-12T09:44:33.725 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:33.723+0000 7f50d2342640 1 -- 172.21.15.73:0/3352461266 learned_addr learned my addr 172.21.15.73:0/3352461266 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-12T09:44:33.725 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:33.724+0000 7f50d1340640 1 --2- 172.21.15.73:0/3352461266 >> v2:172.21.15.142:3300/0 conn(0x7f50cc06db70 0x7f50cc0c39b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:33.725 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:33.724+0000 7f50d1b41640 1 -- 172.21.15.73:0/3352461266 >> v2:172.21.15.142:3300/0 conn(0x7f50cc06db70 msgr2=0x7f50cc0c39b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:44:33.725 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:33.724+0000 7f50d1b41640 1 --2- 172.21.15.73:0/3352461266 >> v2:172.21.15.142:3300/0 conn(0x7f50cc06db70 0x7f50cc0c39b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:33.725 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:33.724+0000 7f50d1b41640 1 -- 172.21.15.73:0/3352461266 >> v1:172.21.15.73:6789/0 conn(0x7f50cc0c5070 legacy=0x7f50cc0c3ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:33.726 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:33.724+0000 7f50d1b41640 1 -- 172.21.15.73:0/3352461266 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50cc152eb0 con 0x7f50cc14fa40 2023-12-12T09:44:33.726 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:33.725+0000 7f50d1b41640 1 --2- 172.21.15.73:0/3352461266 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f50cc14fa40 0x7f50cc06a4e0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f50cc0aaf60 tx=0x7f50c802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b5d36c3dbf9e771 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:44:33.726 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:33.725+0000 7f50d0b3f640 1 -- 172.21.15.73:0/3352461266 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50c8031830 con 0x7f50cc14fa40 2023-12-12T09:44:33.726 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:33.725+0000 7f50d0b3f640 1 -- 172.21.15.73:0/3352461266 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50c8031990 con 0x7f50cc14fa40 2023-12-12T09:44:33.726 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:33.725+0000 7f50d0b3f640 1 -- 172.21.15.73:0/3352461266 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50c8031d20 con 0x7f50cc14fa40 2023-12-12T09:44:33.727 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:33.726+0000 7f50d3da5640 1 -- 172.21.15.73:0/3352461266 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f50cc14fa40 msgr2=0x7f50cc06a4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:33.727 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:33.726+0000 7f50d3da5640 1 --2- 172.21.15.73:0/3352461266 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f50cc14fa40 0x7f50cc06a4e0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f50cc0aaf60 tx=0x7f50c802b8d0 comp rx=0 tx=0).stop 2023-12-12T09:44:33.727 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:33.726+0000 7f50d3da5640 1 -- 172.21.15.73:0/3352461266 shutdown_connections 2023-12-12T09:44:33.728 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:33.726+0000 7f50d3da5640 1 --2- 172.21.15.73:0/3352461266 >> v2:172.21.15.142:3300/0 conn(0x7f50cc06db70 0x7f50cc0c39b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:33.728 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:33.726+0000 7f50d3da5640 1 --2- 172.21.15.73:0/3352461266 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f50cc14fa40 0x7f50cc06a4e0 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:33.728 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:33.726+0000 7f50d3da5640 1 -- 172.21.15.73:0/3352461266 >> 172.21.15.73:0/3352461266 conn(0x7f50cc0a8130 msgr2=0x7f50cc0c24b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:44:33.728 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:33.726+0000 7f50d3da5640 1 -- 172.21.15.73:0/3352461266 shutdown_connections 2023-12-12T09:44:33.728 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:33.726+0000 7f50d3da5640 1 -- 172.21.15.73:0/3352461266 wait complete. 2023-12-12T09:44:33.729 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:33.728+0000 7f50d3da5640 1 Processor -- start 2023-12-12T09:44:33.730 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:33.728+0000 7f50d3da5640 1 -- start start 2023-12-12T09:44:33.732 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:33.729+0000 7f50d3da5640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f50cc06db70 0x7f50cc1e9e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:33.733 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:33.729+0000 7f50d3da5640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f50cc0c5070 0x7f50cc0a6aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:33.733 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:33.729+0000 7f50d3da5640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f50cc14fa40 0x7f50cc1508a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:33.733 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:33.729+0000 7f50d3da5640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50cc1ea4f0 con 0x7f50cc0c5070 2023-12-12T09:44:33.733 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:33.729+0000 7f50d3da5640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50cc1ea7d0 con 0x7f50cc06db70 2023-12-12T09:44:33.733 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:33.729+0000 7f50d3da5640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50cc1eaab0 con 0x7f50cc14fa40 2023-12-12T09:44:33.733 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:33.730+0000 7f50d1340640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f50cc0c5070 0x7f50cc0a6aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:33.734 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:33.730+0000 7f50d1340640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f50cc0c5070 0x7f50cc0a6aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:41696/0 (socket says 172.21.15.73:41696) 2023-12-12T09:44:33.734 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:33.730+0000 7f50d1340640 1 -- 172.21.15.73:0/1569038423 learned_addr learned my addr 172.21.15.73:0/1569038423 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:44:33.734 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:33.730+0000 7f50d1b41640 1 --2- 172.21.15.73:0/1569038423 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f50cc06db70 0x7f50cc1e9e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:33.734 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:33.730+0000 7f50d1340640 1 -- 172.21.15.73:0/1569038423 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f50cc14fa40 msgr2=0x7f50cc1508a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:33.734 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:33.730+0000 7f50d1340640 1 --2- 172.21.15.73:0/1569038423 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f50cc14fa40 0x7f50cc1508a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:33.734 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:33.730+0000 7f50d1340640 1 -- 172.21.15.73:0/1569038423 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f50cc06db70 msgr2=0x7f50cc1e9e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:33.735 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:33.730+0000 7f50d1340640 1 --2- 172.21.15.73:0/1569038423 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f50cc06db70 0x7f50cc1e9e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:33.735 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:33.730+0000 7f50d1340640 1 -- 172.21.15.73:0/1569038423 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50c8009400 con 0x7f50cc0c5070 2023-12-12T09:44:33.735 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:33.730+0000 7f50d1340640 1 --2- 172.21.15.73:0/1569038423 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f50cc0c5070 0x7f50cc0a6aa0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f50bc00d5f0 tx=0x7f50bc00dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:44:33.735 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:33.731+0000 7f50c27fc640 1 -- 172.21.15.73:0/1569038423 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50bc0125f0 con 0x7f50cc0c5070 2023-12-12T09:44:33.735 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:33.731+0000 7f50c27fc640 1 -- 172.21.15.73:0/1569038423 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50bc012750 con 0x7f50cc0c5070 2023-12-12T09:44:33.735 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:33.731+0000 7f50d3da5640 1 -- 172.21.15.73:0/1569038423 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50cc1ead90 con 0x7f50cc0c5070 2023-12-12T09:44:33.735 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:33.731+0000 7f50c27fc640 1 -- 172.21.15.73:0/1569038423 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50bc012b00 con 0x7f50cc0c5070 2023-12-12T09:44:33.736 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:33.731+0000 7f50d3da5640 1 -- 172.21.15.73:0/1569038423 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50cc0a6fe0 con 0x7f50cc0c5070 2023-12-12T09:44:33.737 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:33.732+0000 7f50d3da5640 1 -- 172.21.15.73:0/1569038423 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50cc0c1240 con 0x7f50cc0c5070 2023-12-12T09:44:33.737 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:33.733+0000 7f50c27fc640 1 -- 172.21.15.73:0/1569038423 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f50bc012c60 con 0x7f50cc0c5070 2023-12-12T09:44:33.737 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:33.734+0000 7f50c27fc640 1 --2- 172.21.15.73:0/1569038423 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f50b006ae40 0x7f50b006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:33.737 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:33.734+0000 7f50c27fc640 1 -- 172.21.15.73:0/1569038423 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f50bc089ba0 con 0x7f50cc0c5070 2023-12-12T09:44:33.737 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:33.735+0000 7f50d1b41640 1 --2- 172.21.15.73:0/1569038423 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f50b006ae40 0x7f50b006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:33.737 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:33.735+0000 7f50d1b41640 1 --2- 172.21.15.73:0/1569038423 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f50b006ae40 0x7f50b006d300 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f50c8036000 tx=0x7f50c8008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:44:33.740 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:33.739+0000 7f50c27fc640 1 -- 172.21.15.73:0/1569038423 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f50bc054bb0 con 0x7f50cc0c5070 2023-12-12T09:44:33.931 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:33.929+0000 7f50d3da5640 1 -- 172.21.15.73:0/1569038423 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f50cc067580 con 0x7f50cc0c5070 2023-12-12T09:44:33.931 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:33.930+0000 7f50c27fc640 1 -- 172.21.15.73:0/1569038423 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v34) v1 ==== 84+0+207 (secure 0 0 0) 0x7f50bc0581d0 con 0x7f50cc0c5070 2023-12-12T09:44:33.931 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-12T09:44:33.932 INFO:teuthology.orchestra.run.smithi073.stdout:[ 2023-12-12T09:44:33.932 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-12-12T09:44:33.932 INFO:teuthology.orchestra.run.smithi073.stdout: "poolnum": 1, 2023-12-12T09:44:33.932 INFO:teuthology.orchestra.run.smithi073.stdout: "poolname": ".mgr" 2023-12-12T09:44:33.932 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-12-12T09:44:33.932 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-12-12T09:44:33.932 INFO:teuthology.orchestra.run.smithi073.stdout: "poolnum": 4, 2023-12-12T09:44:33.932 INFO:teuthology.orchestra.run.smithi073.stdout: "poolname": "cephfs_metadata" 2023-12-12T09:44:33.932 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-12-12T09:44:33.932 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-12-12T09:44:33.932 INFO:teuthology.orchestra.run.smithi073.stdout: "poolnum": 5, 2023-12-12T09:44:33.932 INFO:teuthology.orchestra.run.smithi073.stdout: "poolname": "cephfs_data" 2023-12-12T09:44:33.932 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-12-12T09:44:33.932 INFO:teuthology.orchestra.run.smithi073.stdout:] 2023-12-12T09:44:33.933 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:33.932+0000 7f50d3da5640 1 -- 172.21.15.73:0/1569038423 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f50b006ae40 msgr2=0x7f50b006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:33.933 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:33.932+0000 7f50d3da5640 1 --2- 172.21.15.73:0/1569038423 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f50b006ae40 0x7f50b006d300 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f50c8036000 tx=0x7f50c8008030 comp rx=0 tx=0).stop 2023-12-12T09:44:33.934 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:33.932+0000 7f50d3da5640 1 -- 172.21.15.73:0/1569038423 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f50cc0c5070 msgr2=0x7f50cc0a6aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:33.934 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:33.932+0000 7f50d3da5640 1 --2- 172.21.15.73:0/1569038423 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f50cc0c5070 0x7f50cc0a6aa0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f50bc00d5f0 tx=0x7f50bc00dab0 comp rx=0 tx=0).stop 2023-12-12T09:44:33.934 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:33.933+0000 7f50d3da5640 1 -- 172.21.15.73:0/1569038423 shutdown_connections 2023-12-12T09:44:33.934 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:33.933+0000 7f50d3da5640 1 --2- 172.21.15.73:0/1569038423 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f50b006ae40 0x7f50b006d300 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:33.934 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:33.933+0000 7f50d3da5640 1 --2- 172.21.15.73:0/1569038423 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f50cc14fa40 0x7f50cc1508a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:33.935 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:33.933+0000 7f50d3da5640 1 --2- 172.21.15.73:0/1569038423 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f50cc0c5070 0x7f50cc0a6aa0 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:33.935 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:33.933+0000 7f50d3da5640 1 --2- 172.21.15.73:0/1569038423 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f50cc06db70 0x7f50cc1e9e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:33.935 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:33.933+0000 7f50d3da5640 1 -- 172.21.15.73:0/1569038423 >> 172.21.15.73:0/1569038423 conn(0x7f50cc0a8130 msgr2=0x7f50cc0c1630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:44:33.935 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:33.933+0000 7f50d3da5640 1 -- 172.21.15.73:0/1569038423 shutdown_connections 2023-12-12T09:44:33.935 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:33.933+0000 7f50d3da5640 1 -- 172.21.15.73:0/1569038423 wait complete. 2023-12-12T09:44:33.953 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs2' 2023-12-12T09:44:33.953 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs2_metadata --pg_num_min 64 2023-12-12T09:44:34.168 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:34.166+0000 7f255e978640 1 Processor -- start 2023-12-12T09:44:34.168 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:34.166+0000 7f255e978640 1 -- start start 2023-12-12T09:44:34.170 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:34.167+0000 7f255e978640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f25580a4f00 0x7f25580c38b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:34.170 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:34.168+0000 7f255e978640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f255806bf90 con 0x7f25580c3df0 2023-12-12T09:44:34.170 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:34.168+0000 7f255e978640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f255806bcb0 con 0x7f255806b820 2023-12-12T09:44:34.170 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:34.168+0000 7f255e978640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25581523e0 con 0x7f25580a4f00 2023-12-12T09:44:34.170 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:34.168+0000 7f2557fff640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f25580a4f00 0x7f25580c38b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:34.171 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:34.168+0000 7f2557fff640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f25580a4f00 0x7f25580c38b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:41704/0 (socket says 172.21.15.73:41704) 2023-12-12T09:44:34.171 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:34.168+0000 7f2557fff640 1 -- 172.21.15.73:0/252089607 learned_addr learned my addr 172.21.15.73:0/252089607 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:44:34.171 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:34.168+0000 7f2557fff640 1 -- 172.21.15.73:0/252089607 >> v1:172.21.15.142:6789/0 conn(0x7f255806b820 legacy=0x7f255814be60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:44:34.171 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:34.168+0000 7f2557fff640 1 -- 172.21.15.73:0/252089607 >> v1:172.21.15.73:6789/0 conn(0x7f25580c3df0 legacy=0x7f255815cbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:34.171 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:34.168+0000 7f2557fff640 1 -- 172.21.15.73:0/252089607 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25581526c0 con 0x7f25580a4f00 2023-12-12T09:44:34.173 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:34.169+0000 7f2557fff640 1 --2- 172.21.15.73:0/252089607 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f25580a4f00 0x7f25580c38b0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f2548009870 tx=0x7f254802b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f73e2a6047ab7124 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:44:34.174 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:34.170+0000 7f2556ffd640 1 -- 172.21.15.73:0/252089607 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2548031870 con 0x7f25580a4f00 2023-12-12T09:44:34.174 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:34.170+0000 7f2556ffd640 1 -- 172.21.15.73:0/252089607 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25480319d0 con 0x7f25580a4f00 2023-12-12T09:44:34.174 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:34.170+0000 7f2556ffd640 1 -- 172.21.15.73:0/252089607 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2548031d60 con 0x7f25580a4f00 2023-12-12T09:44:34.174 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:34.170+0000 7f255e978640 1 -- 172.21.15.73:0/252089607 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f25580a4f00 msgr2=0x7f25580c38b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:34.174 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:34.170+0000 7f255e978640 1 --2- 172.21.15.73:0/252089607 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f25580a4f00 0x7f25580c38b0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f2548009870 tx=0x7f254802b910 comp rx=0 tx=0).stop 2023-12-12T09:44:34.174 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:34.170+0000 7f255e978640 1 -- 172.21.15.73:0/252089607 shutdown_connections 2023-12-12T09:44:34.175 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:34.170+0000 7f255e978640 1 --2- 172.21.15.73:0/252089607 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f25580a4f00 0x7f25580c38b0 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:34.175 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:34.170+0000 7f255e978640 1 -- 172.21.15.73:0/252089607 >> 172.21.15.73:0/252089607 conn(0x7f255806a6c0 msgr2=0x7f255806aaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:44:34.175 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:34.171+0000 7f255e978640 1 -- 172.21.15.73:0/252089607 shutdown_connections 2023-12-12T09:44:34.175 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:34.171+0000 7f255e978640 1 -- 172.21.15.73:0/252089607 wait complete. 2023-12-12T09:44:34.175 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:34.172+0000 7f255e978640 1 Processor -- start 2023-12-12T09:44:34.175 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:34.172+0000 7f255e978640 1 -- start start 2023-12-12T09:44:34.178 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:34.173+0000 7f255e978640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f25580a4f00 0x7f25581489b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:34.178 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:34.173+0000 7f255e978640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f25580c3df0 0x7f2558155910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:34.178 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:34.173+0000 7f255e978640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2558155e50 0x7f25581e7ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:34.178 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:34.173+0000 7f255e978640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2558148ef0 con 0x7f25580a4f00 2023-12-12T09:44:34.178 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:34.173+0000 7f255e978640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25581dbf20 con 0x7f2558155e50 2023-12-12T09:44:34.179 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:34.173+0000 7f255e978640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25581dc200 con 0x7f25580c3df0 2023-12-12T09:44:34.179 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:34.173+0000 7f2557fff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f25580a4f00 0x7f25581489b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:34.179 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:34.174+0000 7f2557fff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f25580a4f00 0x7f25581489b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:41718/0 (socket says 172.21.15.73:41718) 2023-12-12T09:44:34.179 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:34.174+0000 7f2557fff640 1 -- 172.21.15.73:0/2594254018 learned_addr learned my addr 172.21.15.73:0/2594254018 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:44:34.179 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:34.174+0000 7f2557fff640 1 -- 172.21.15.73:0/2594254018 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f25580c3df0 msgr2=0x7f2558155910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:34.179 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:34.174+0000 7f2557fff640 1 --2- 172.21.15.73:0/2594254018 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f25580c3df0 0x7f2558155910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:34.179 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:34.174+0000 7f2557fff640 1 -- 172.21.15.73:0/2594254018 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2558155e50 msgr2=0x7f25581e7ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:34.180 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:34.174+0000 7f2557fff640 1 --2- 172.21.15.73:0/2594254018 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2558155e50 0x7f25581e7ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:34.180 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:34.174+0000 7f2557fff640 1 -- 172.21.15.73:0/2594254018 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25480094d0 con 0x7f25580a4f00 2023-12-12T09:44:34.180 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:34.174+0000 7f2557fff640 1 --2- 172.21.15.73:0/2594254018 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f25580a4f00 0x7f25581489b0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f2548009870 tx=0x7f25480046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:44:34.180 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:34.174+0000 7f2554ff9640 1 -- 172.21.15.73:0/2594254018 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f254803ad30 con 0x7f25580a4f00 2023-12-12T09:44:34.180 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:34.174+0000 7f2554ff9640 1 -- 172.21.15.73:0/2594254018 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f254803ae90 con 0x7f25580a4f00 2023-12-12T09:44:34.180 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:34.175+0000 7f255e978640 1 -- 172.21.15.73:0/2594254018 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25581dc4e0 con 0x7f25580a4f00 2023-12-12T09:44:34.180 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:34.175+0000 7f2554ff9640 1 -- 172.21.15.73:0/2594254018 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2548044630 con 0x7f25580a4f00 2023-12-12T09:44:34.181 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:34.175+0000 7f255e978640 1 -- 172.21.15.73:0/2594254018 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25581553f0 con 0x7f25580a4f00 2023-12-12T09:44:34.181 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:34.176+0000 7f255e978640 1 -- 172.21.15.73:0/2594254018 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f255806dfb0 con 0x7f25580a4f00 2023-12-12T09:44:34.181 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:34.177+0000 7f2554ff9640 1 -- 172.21.15.73:0/2594254018 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f254804d450 con 0x7f25580a4f00 2023-12-12T09:44:34.182 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:34.177+0000 7f2554ff9640 1 --2- 172.21.15.73:0/2594254018 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f254406ae40 0x7f254406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:34.182 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:34.178+0000 7f2554ff9640 1 -- 172.21.15.73:0/2594254018 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f254802d040 con 0x7f25580a4f00 2023-12-12T09:44:34.182 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:34.178+0000 7f25577fe640 1 --2- 172.21.15.73:0/2594254018 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f254406ae40 0x7f254406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:34.182 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:34.178+0000 7f25577fe640 1 --2- 172.21.15.73:0/2594254018 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f254406ae40 0x7f254406d300 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f25580c2110 tx=0x7f254c0079b0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:44:34.183 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:34.182+0000 7f2554ff9640 1 -- 172.21.15.73:0/2594254018 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f2548076df0 con 0x7f25580a4f00 2023-12-12T09:44:34.371 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:34.369+0000 7f255e978640 1 -- 172.21.15.73:0/2594254018 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs2_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f2558067470 con 0x7f25580a4f00 2023-12-12T09:44:34.614 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:34.612+0000 7f2554ff9640 1 -- 172.21.15.73:0/2594254018 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs2_metadata", "pg_num_min": 64}]=0 pool 'cephfs2_metadata' created v35) v1 ==== 140+0+0 (secure 0 0 0) 0x7f254807a410 con 0x7f25580a4f00 2023-12-12T09:44:34.614 INFO:teuthology.orchestra.run.smithi073.stderr:pool 'cephfs2_metadata' created 2023-12-12T09:44:34.618 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:34.616+0000 7f255e978640 1 -- 172.21.15.73:0/2594254018 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f254406ae40 msgr2=0x7f254406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:34.618 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:34.616+0000 7f255e978640 1 --2- 172.21.15.73:0/2594254018 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f254406ae40 0x7f254406d300 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f25580c2110 tx=0x7f254c0079b0 comp rx=0 tx=0).stop 2023-12-12T09:44:34.618 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:34.616+0000 7f255e978640 1 -- 172.21.15.73:0/2594254018 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f25580a4f00 msgr2=0x7f25581489b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:34.619 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:34.616+0000 7f255e978640 1 --2- 172.21.15.73:0/2594254018 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f25580a4f00 0x7f25581489b0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f2548009870 tx=0x7f25480046c0 comp rx=0 tx=0).stop 2023-12-12T09:44:34.619 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:34.616+0000 7f255e978640 1 -- 172.21.15.73:0/2594254018 shutdown_connections 2023-12-12T09:44:34.619 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:34.616+0000 7f255e978640 1 --2- 172.21.15.73:0/2594254018 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f254406ae40 0x7f254406d300 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:34.619 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:34.616+0000 7f255e978640 1 --2- 172.21.15.73:0/2594254018 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2558155e50 0x7f25581e7ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:34.619 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:34.616+0000 7f255e978640 1 --2- 172.21.15.73:0/2594254018 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f25580c3df0 0x7f2558155910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:34.619 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:34.616+0000 7f255e978640 1 --2- 172.21.15.73:0/2594254018 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f25580a4f00 0x7f25581489b0 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:34.619 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:34.616+0000 7f255e978640 1 -- 172.21.15.73:0/2594254018 >> 172.21.15.73:0/2594254018 conn(0x7f255806a6c0 msgr2=0x7f255806aaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:44:34.619 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:34.616+0000 7f255e978640 1 -- 172.21.15.73:0/2594254018 shutdown_connections 2023-12-12T09:44:34.619 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:34.617+0000 7f255e978640 1 -- 172.21.15.73:0/2594254018 wait complete. 2023-12-12T09:44:34.644 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs2_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-12-12T09:44:34.841 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:34.840+0000 7f15d49db640 1 Processor -- start 2023-12-12T09:44:34.841 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:34.840+0000 7f15d49db640 1 -- start start 2023-12-12T09:44:34.842 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:34.841+0000 7f15d49db640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f15d00a4d00 0x7f15d00c0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:34.842 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:34.841+0000 7f15d49db640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f15d01529a0 0x7f15d00a8880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:34.843 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:34.841+0000 7f15d49db640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15d01521e0 con 0x7f15d014c190 2023-12-12T09:44:34.843 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:34.841+0000 7f15d49db640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15d00c1890 con 0x7f15d01529a0 2023-12-12T09:44:34.843 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:34.841+0000 7f15d49db640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15d0151fd0 con 0x7f15d00a4d00 2023-12-12T09:44:34.843 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:34.841+0000 7f15cf7fe640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f15d014c190 0x7f15d01555c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:32878/0 (socket says 172.21.15.73:32878) 2023-12-12T09:44:34.843 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:34.841+0000 7f15cf7fe640 1 -- 172.21.15.73:0/2279984844 learned_addr learned my addr 172.21.15.73:0/2279984844 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-12T09:44:34.845 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:34.842+0000 7f15ce7fc640 1 -- 172.21.15.73:0/2279984844 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2280972449 0 0) 0x7f15d01521e0 con 0x7f15d014c190 2023-12-12T09:44:34.845 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:34.842+0000 7f15ce7fc640 1 -- 172.21.15.73:0/2279984844 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f15b8003520 con 0x7f15d014c190 2023-12-12T09:44:34.845 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:34.842+0000 7f15cffff640 1 --2- 172.21.15.73:0/2279984844 >> v2:172.21.15.142:3300/0 conn(0x7f15d01529a0 0x7f15d00a8880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:34.845 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:34.842+0000 7f15ceffd640 1 --2- 172.21.15.73:0/2279984844 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f15d00a4d00 0x7f15d00c0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:34.845 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:34.842+0000 7f15ce7fc640 1 -- 172.21.15.73:0/2279984844 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1218784815 0 0) 0x7f15b8003520 con 0x7f15d014c190 2023-12-12T09:44:34.846 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:34.842+0000 7f15ce7fc640 1 -- 172.21.15.73:0/2279984844 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f15d00a4d00 msgr2=0x7f15d00c0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:44:34.846 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:34.842+0000 7f15ce7fc640 1 --2- 172.21.15.73:0/2279984844 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f15d00a4d00 0x7f15d00c0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:34.846 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:34.842+0000 7f15ce7fc640 1 -- 172.21.15.73:0/2279984844 >> v2:172.21.15.142:3300/0 conn(0x7f15d01529a0 msgr2=0x7f15d00a8880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:44:34.846 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:34.842+0000 7f15ce7fc640 1 --2- 172.21.15.73:0/2279984844 >> v2:172.21.15.142:3300/0 conn(0x7f15d01529a0 0x7f15d00a8880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:34.846 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:34.842+0000 7f15ce7fc640 1 -- 172.21.15.73:0/2279984844 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15d00c1aa0 con 0x7f15d014c190 2023-12-12T09:44:34.846 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:34.842+0000 7f15ce7fc640 1 -- 172.21.15.73:0/2279984844 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3186547832 0 0) 0x7f15c0001670 con 0x7f15d014c190 2023-12-12T09:44:34.846 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:34.842+0000 7f15cffff640 1 --2- 172.21.15.73:0/2279984844 >> v2:172.21.15.142:3300/0 conn(0x7f15d01529a0 0x7f15d00a8880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-12T09:44:34.846 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:34.842+0000 7f15ce7fc640 1 -- 172.21.15.73:0/2279984844 >> v1:172.21.15.73:6789/0 conn(0x7f15d014c190 legacy=0x7f15d01555c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:34.846 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:34.842+0000 7f15ce7fc640 1 --2- 172.21.15.73:0/2279984844 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f15b8003970 0x7f15b8003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:34.846 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:34.842+0000 7f15ce7fc640 1 --2- 172.21.15.73:0/2279984844 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f15d00a4d00 0x7f15b80047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:34.846 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:34.842+0000 7f15ce7fc640 1 --2- 172.21.15.73:0/2279984844 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f15b8004d00 0x7f15b8005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:34.847 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:34.842+0000 7f15ce7fc640 1 -- 172.21.15.73:0/2279984844 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15d00c1890 con 0x7f15b8004d00 2023-12-12T09:44:34.847 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:34.842+0000 7f15ce7fc640 1 -- 172.21.15.73:0/2279984844 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15d0151fd0 con 0x7f15b8003970 2023-12-12T09:44:34.847 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:34.842+0000 7f15ce7fc640 1 -- 172.21.15.73:0/2279984844 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15b800bb10 con 0x7f15d00a4d00 2023-12-12T09:44:34.847 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:34.843+0000 7f15cffff640 1 --2- 172.21.15.73:0/2279984844 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f15b8004d00 0x7f15b8005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:34.847 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:34.843+0000 7f15cf7fe640 1 --2- 172.21.15.73:0/2279984844 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f15b8003970 0x7f15b8003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:34.847 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:34.843+0000 7f15ceffd640 1 --2- 172.21.15.73:0/2279984844 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f15d00a4d00 0x7f15b80047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:34.847 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:34.843+0000 7f15cffff640 1 -- 172.21.15.73:0/2279984844 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f15d00a4d00 msgr2=0x7f15b80047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:44:34.847 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:34.843+0000 7f15cffff640 1 --2- 172.21.15.73:0/2279984844 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f15d00a4d00 0x7f15b80047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:34.847 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:34.843+0000 7f15cffff640 1 -- 172.21.15.73:0/2279984844 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f15b8003970 msgr2=0x7f15b8003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:44:34.847 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:34.843+0000 7f15cffff640 1 --2- 172.21.15.73:0/2279984844 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f15b8003970 0x7f15b8003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:34.847 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:34.843+0000 7f15cffff640 1 -- 172.21.15.73:0/2279984844 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15b8003520 con 0x7f15b8004d00 2023-12-12T09:44:34.848 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:34.843+0000 7f15ceffd640 1 --2- 172.21.15.73:0/2279984844 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f15d00a4d00 0x7f15b80047c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:44:34.854 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:34.844+0000 7f15cffff640 1 --2- 172.21.15.73:0/2279984844 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f15b8004d00 0x7f15b8005180 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f15c80073e0 tx=0x7f15b80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8652a954208d439b server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:44:34.854 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:34.844+0000 7f15ce7fc640 1 -- 172.21.15.73:0/2279984844 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15c802cdc0 con 0x7f15b8004d00 2023-12-12T09:44:34.855 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:34.844+0000 7f15ce7fc640 1 -- 172.21.15.73:0/2279984844 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15c8034440 con 0x7f15b8004d00 2023-12-12T09:44:34.855 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:34.845+0000 7f15ce7fc640 1 -- 172.21.15.73:0/2279984844 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15c80347b0 con 0x7f15b8004d00 2023-12-12T09:44:34.855 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:34.845+0000 7f15d49db640 1 -- 172.21.15.73:0/2279984844 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f15b8004d00 msgr2=0x7f15b8005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:34.855 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:34.845+0000 7f15d49db640 1 --2- 172.21.15.73:0/2279984844 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f15b8004d00 0x7f15b8005180 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f15c80073e0 tx=0x7f15b80057f0 comp rx=0 tx=0).stop 2023-12-12T09:44:34.855 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:34.845+0000 7f15cffff640 1 -- 172.21.15.73:0/2279984844 reap_dead start 2023-12-12T09:44:34.855 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:34.845+0000 7f15d49db640 1 -- 172.21.15.73:0/2279984844 shutdown_connections 2023-12-12T09:44:34.855 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:34.845+0000 7f15d49db640 1 -- 172.21.15.73:0/2279984844 >> 172.21.15.73:0/2279984844 conn(0x7f15d006a4e0 msgr2=0x7f15d006a8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:44:34.855 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:34.845+0000 7f15d49db640 1 -- 172.21.15.73:0/2279984844 shutdown_connections 2023-12-12T09:44:34.855 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:34.845+0000 7f15d49db640 1 -- 172.21.15.73:0/2279984844 wait complete. 2023-12-12T09:44:34.856 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:34.847+0000 7f15d49db640 1 Processor -- start 2023-12-12T09:44:34.856 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:34.847+0000 7f15d49db640 1 -- start start 2023-12-12T09:44:34.856 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:34.848+0000 7f15d49db640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f15d0154a70 0x7f15d00bf610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:34.856 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:34.848+0000 7f15d49db640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f15d00c6340 0x7f15d01ea000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:34.856 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:34.848+0000 7f15d49db640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f15d01ede80 0x7f15d0071940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:34.857 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:34.848+0000 7f15d49db640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15d00c5230 con 0x7f15d00c6340 2023-12-12T09:44:34.857 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:34.848+0000 7f15d49db640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15d01ed9f0 con 0x7f15d01ede80 2023-12-12T09:44:34.857 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:34.848+0000 7f15d49db640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15d01ea540 con 0x7f15d0154a70 2023-12-12T09:44:34.857 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:34.848+0000 7f15ceffd640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f15d00c6340 0x7f15d01ea000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:34.857 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:34.848+0000 7f15ceffd640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f15d00c6340 0x7f15d01ea000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:41736/0 (socket says 172.21.15.73:41736) 2023-12-12T09:44:34.857 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:34.848+0000 7f15ceffd640 1 -- 172.21.15.73:0/4008784593 learned_addr learned my addr 172.21.15.73:0/4008784593 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:44:34.857 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:34.848+0000 7f15ceffd640 1 -- 172.21.15.73:0/4008784593 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f15d0154a70 msgr2=0x7f15d00bf610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:34.857 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:34.848+0000 7f15ceffd640 1 --2- 172.21.15.73:0/4008784593 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f15d0154a70 0x7f15d00bf610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:34.857 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:34.848+0000 7f15ceffd640 1 -- 172.21.15.73:0/4008784593 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f15d01ede80 msgr2=0x7f15d0071940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:34.858 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:34.848+0000 7f15ceffd640 1 --2- 172.21.15.73:0/4008784593 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f15d01ede80 0x7f15d0071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:34.858 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:34.848+0000 7f15ceffd640 1 -- 172.21.15.73:0/4008784593 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15d00c4820 con 0x7f15d00c6340 2023-12-12T09:44:34.858 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:34.849+0000 7f15ceffd640 1 --2- 172.21.15.73:0/4008784593 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f15d00c6340 0x7f15d01ea000 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f15c400e810 tx=0x7f15c400ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:44:34.858 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:34.849+0000 7f15b7fff640 1 -- 172.21.15.73:0/4008784593 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15c400c670 con 0x7f15d00c6340 2023-12-12T09:44:34.858 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:34.849+0000 7f15b7fff640 1 -- 172.21.15.73:0/4008784593 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15c400c7d0 con 0x7f15d00c6340 2023-12-12T09:44:34.858 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:34.849+0000 7f15b7fff640 1 -- 172.21.15.73:0/4008784593 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15c400cb40 con 0x7f15d00c6340 2023-12-12T09:44:34.858 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:34.849+0000 7f15d49db640 1 -- 172.21.15.73:0/4008784593 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15d00c4b00 con 0x7f15d00c6340 2023-12-12T09:44:34.858 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:34.849+0000 7f15d49db640 1 -- 172.21.15.73:0/4008784593 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15d00c4de0 con 0x7f15d00c6340 2023-12-12T09:44:34.858 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:34.850+0000 7f15d49db640 1 -- 172.21.15.73:0/4008784593 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15d006b0a0 con 0x7f15d00c6340 2023-12-12T09:44:34.858 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:34.852+0000 7f15b7fff640 1 -- 172.21.15.73:0/4008784593 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f15c400cca0 con 0x7f15d00c6340 2023-12-12T09:44:34.858 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:34.852+0000 7f15b7fff640 1 --2- 172.21.15.73:0/4008784593 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f15bc06ae40 0x7f15bc06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:34.858 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:34.852+0000 7f15b7fff640 1 -- 172.21.15.73:0/4008784593 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6080+0+0 (secure 0 0 0) 0x7f15c40898b0 con 0x7f15d00c6340 2023-12-12T09:44:34.858 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:34.853+0000 7f15cf7fe640 1 --2- 172.21.15.73:0/4008784593 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f15bc06ae40 0x7f15bc06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:34.858 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:34.853+0000 7f15cf7fe640 1 --2- 172.21.15.73:0/4008784593 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f15bc06ae40 0x7f15bc06d300 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f15c0001050 tx=0x7f15c0004800 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:44:34.859 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:34.856+0000 7f15b7fff640 1 -- 172.21.15.73:0/4008784593 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f15c4054880 con 0x7f15d00c6340 2023-12-12T09:44:35.036 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:35.035+0000 7f15d49db640 1 -- 172.21.15.73:0/4008784593 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs2_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f15d00c2060 con 0x7f15d00c6340 2023-12-12T09:44:35.620 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:35.618+0000 7f15b7fff640 1 -- 172.21.15.73:0/4008784593 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs2_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs2_data' created v36) v1 ==== 172+0+0 (secure 0 0 0) 0x7f15c4057ea0 con 0x7f15d00c6340 2023-12-12T09:44:35.620 INFO:teuthology.orchestra.run.smithi073.stderr:pool 'cephfs2_data' created 2023-12-12T09:44:35.624 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:35.623+0000 7f15d49db640 1 -- 172.21.15.73:0/4008784593 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f15bc06ae40 msgr2=0x7f15bc06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:35.624 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:35.623+0000 7f15d49db640 1 --2- 172.21.15.73:0/4008784593 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f15bc06ae40 0x7f15bc06d300 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f15c0001050 tx=0x7f15c0004800 comp rx=0 tx=0).stop 2023-12-12T09:44:35.624 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:35.623+0000 7f15d49db640 1 -- 172.21.15.73:0/4008784593 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f15d00c6340 msgr2=0x7f15d01ea000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:35.625 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:35.623+0000 7f15d49db640 1 --2- 172.21.15.73:0/4008784593 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f15d00c6340 0x7f15d01ea000 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f15c400e810 tx=0x7f15c400ecd0 comp rx=0 tx=0).stop 2023-12-12T09:44:35.625 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:35.624+0000 7f15d49db640 1 -- 172.21.15.73:0/4008784593 shutdown_connections 2023-12-12T09:44:35.625 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:35.624+0000 7f15d49db640 1 --2- 172.21.15.73:0/4008784593 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f15bc06ae40 0x7f15bc06d300 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:35.626 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:35.624+0000 7f15d49db640 1 --2- 172.21.15.73:0/4008784593 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f15d01ede80 0x7f15d0071940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:35.626 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:35.624+0000 7f15d49db640 1 --2- 172.21.15.73:0/4008784593 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f15d00c6340 0x7f15d01ea000 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:35.626 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:35.624+0000 7f15d49db640 1 --2- 172.21.15.73:0/4008784593 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f15d0154a70 0x7f15d00bf610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:35.626 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:35.624+0000 7f15d49db640 1 -- 172.21.15.73:0/4008784593 >> 172.21.15.73:0/4008784593 conn(0x7f15d006a4e0 msgr2=0x7f15d006a8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:44:35.626 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:35.624+0000 7f15d49db640 1 -- 172.21.15.73:0/4008784593 shutdown_connections 2023-12-12T09:44:35.626 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:35.624+0000 7f15d49db640 1 -- 172.21.15.73:0/4008784593 wait complete. 2023-12-12T09:44:35.665 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs2 cephfs2_metadata cephfs2_data 2023-12-12T09:44:35.853 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:35.852+0000 7f01465b6640 1 Processor -- start 2023-12-12T09:44:35.853 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:35.852+0000 7f01465b6640 1 -- start start 2023-12-12T09:44:35.854 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:35.853+0000 7f01465b6640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f014014f8c0 0x7f014006dc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:35.854 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:35.853+0000 7f01465b6640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f014006d350 0x7f0140071e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:35.854 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:35.853+0000 7f01465b6640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01400c16c0 con 0x7f01400723a0 2023-12-12T09:44:35.854 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:35.853+0000 7f01465b6640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01400c1090 con 0x7f014006d350 2023-12-12T09:44:35.855 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:35.853+0000 7f01465b6640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01400c14b0 con 0x7f014014f8c0 2023-12-12T09:44:35.855 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:35.854+0000 7f0137fff640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f014006d350 0x7f0140071e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:35.855 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:35.854+0000 7f013ffff640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f014014f8c0 0x7f014006dc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:35.855 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:35.854+0000 7f013ffff640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f014014f8c0 0x7f014006dc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.73:59926/0 (socket says 172.21.15.73:59926) 2023-12-12T09:44:35.855 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:35.854+0000 7f013ffff640 1 -- 172.21.15.73:0/1576414336 learned_addr learned my addr 172.21.15.73:0/1576414336 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:44:35.856 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:35.855+0000 7f013ffff640 1 -- 172.21.15.73:0/1576414336 >> v2:172.21.15.142:3300/0 conn(0x7f014006d350 msgr2=0x7f0140071e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:44:35.856 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:35.855+0000 7f013ffff640 1 --2- 172.21.15.73:0/1576414336 >> v2:172.21.15.142:3300/0 conn(0x7f014006d350 0x7f0140071e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:35.856 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:35.855+0000 7f013ffff640 1 -- 172.21.15.73:0/1576414336 >> v1:172.21.15.142:6789/0 conn(0x7f01400723a0 legacy=0x7f0140152500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:35.856 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:35.855+0000 7f013ffff640 1 -- 172.21.15.73:0/1576414336 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01400c19a0 con 0x7f014014f8c0 2023-12-12T09:44:35.856 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:35.855+0000 7f013f7fe640 1 -- 172.21.15.73:0/1576414336 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3012879603 0 0) 0x7f01400c16c0 con 0x7f01400723a0 2023-12-12T09:44:35.857 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:35.856+0000 7f013ffff640 1 --2- 172.21.15.73:0/1576414336 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f014014f8c0 0x7f014006dc40 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f01300098a0 tx=0x7f013002b970 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dd1a95d5845f0380 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:44:35.857 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:35.856+0000 7f013f7fe640 1 -- 172.21.15.73:0/1576414336 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0130030830 con 0x7f014014f8c0 2023-12-12T09:44:35.858 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:35.856+0000 7f013f7fe640 1 -- 172.21.15.73:0/1576414336 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0130030990 con 0x7f014014f8c0 2023-12-12T09:44:35.858 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:35.856+0000 7f013f7fe640 1 -- 172.21.15.73:0/1576414336 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0130030d20 con 0x7f014014f8c0 2023-12-12T09:44:35.858 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:35.857+0000 7f01465b6640 1 -- 172.21.15.73:0/1576414336 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f014014f8c0 msgr2=0x7f014006dc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:35.858 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:35.857+0000 7f01465b6640 1 --2- 172.21.15.73:0/1576414336 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f014014f8c0 0x7f014006dc40 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f01300098a0 tx=0x7f013002b970 comp rx=0 tx=0).stop 2023-12-12T09:44:35.859 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:35.857+0000 7f01465b6640 1 -- 172.21.15.73:0/1576414336 shutdown_connections 2023-12-12T09:44:35.859 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:35.857+0000 7f01465b6640 1 --2- 172.21.15.73:0/1576414336 >> v2:172.21.15.142:3300/0 conn(0x7f014006d350 0x7f0140071e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:35.859 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:35.857+0000 7f01465b6640 1 --2- 172.21.15.73:0/1576414336 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f014014f8c0 0x7f014006dc40 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:35.859 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:35.857+0000 7f01465b6640 1 -- 172.21.15.73:0/1576414336 >> 172.21.15.73:0/1576414336 conn(0x7f014006a4e0 msgr2=0x7f014006a8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:44:35.859 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:35.857+0000 7f01465b6640 1 -- 172.21.15.73:0/1576414336 shutdown_connections 2023-12-12T09:44:35.859 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:35.857+0000 7f01465b6640 1 -- 172.21.15.73:0/1576414336 wait complete. 2023-12-12T09:44:35.860 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:35.859+0000 7f01465b6640 1 Processor -- start 2023-12-12T09:44:35.860 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:35.859+0000 7f01465b6640 1 -- start start 2023-12-12T09:44:35.863 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:35.860+0000 7f01465b6640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f014006d350 0x7f0140153880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:35.863 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:35.860+0000 7f01465b6640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f01400723a0 0x7f0140151bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:35.863 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:35.860+0000 7f01465b6640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f014014f8c0 0x7f0140154b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:35.863 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:35.860+0000 7f01465b6640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01401517d0 con 0x7f014014f8c0 2023-12-12T09:44:35.863 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:35.860+0000 7f01465b6640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01401e7a80 con 0x7f014006d350 2023-12-12T09:44:35.863 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:35.860+0000 7f01465b6640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0140150ec0 con 0x7f01400723a0 2023-12-12T09:44:35.863 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:35.860+0000 7f0144b53640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f014014f8c0 0x7f0140154b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:35.863 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:35.860+0000 7f0144b53640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f014014f8c0 0x7f0140154b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:41752/0 (socket says 172.21.15.73:41752) 2023-12-12T09:44:35.863 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:35.860+0000 7f0144b53640 1 -- 172.21.15.73:0/3768702216 learned_addr learned my addr 172.21.15.73:0/3768702216 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:44:35.863 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:35.860+0000 7f013ffff640 1 --2- 172.21.15.73:0/3768702216 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f014006d350 0x7f0140153880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:35.863 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:35.861+0000 7f0137fff640 1 --2- 172.21.15.73:0/3768702216 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f01400723a0 0x7f0140151bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:35.863 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:35.861+0000 7f0144b53640 1 -- 172.21.15.73:0/3768702216 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f01400723a0 msgr2=0x7f0140151bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:35.864 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:35.861+0000 7f0144b53640 1 --2- 172.21.15.73:0/3768702216 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f01400723a0 0x7f0140151bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:35.864 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:35.861+0000 7f0144b53640 1 -- 172.21.15.73:0/3768702216 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f014006d350 msgr2=0x7f0140153880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:35.864 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:35.861+0000 7f0144b53640 1 --2- 172.21.15.73:0/3768702216 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f014006d350 0x7f0140153880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:35.864 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:35.861+0000 7f0144b53640 1 -- 172.21.15.73:0/3768702216 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01300094d0 con 0x7f014014f8c0 2023-12-12T09:44:35.864 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:35.861+0000 7f0144b53640 1 --2- 172.21.15.73:0/3768702216 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f014014f8c0 0x7f0140154b80 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f0138001560 tx=0x7f013800cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:44:35.864 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:35.861+0000 7f013d7fa640 1 -- 172.21.15.73:0/3768702216 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0138003da0 con 0x7f014014f8c0 2023-12-12T09:44:35.864 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:35.861+0000 7f013d7fa640 1 -- 172.21.15.73:0/3768702216 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0138005070 con 0x7f014014f8c0 2023-12-12T09:44:35.864 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:35.861+0000 7f01465b6640 1 -- 172.21.15.73:0/3768702216 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f014014b8d0 con 0x7f014014f8c0 2023-12-12T09:44:35.864 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:35.861+0000 7f013d7fa640 1 -- 172.21.15.73:0/3768702216 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0138005420 con 0x7f014014f8c0 2023-12-12T09:44:35.864 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:35.861+0000 7f01465b6640 1 -- 172.21.15.73:0/3768702216 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0140151110 con 0x7f014014f8c0 2023-12-12T09:44:35.865 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:35.862+0000 7f01465b6640 1 -- 172.21.15.73:0/3768702216 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0140067070 con 0x7f014014f8c0 2023-12-12T09:44:35.865 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:35.864+0000 7f013d7fa640 1 -- 172.21.15.73:0/3768702216 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f0138005580 con 0x7f014014f8c0 2023-12-12T09:44:35.866 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:35.865+0000 7f013d7fa640 1 --2- 172.21.15.73:0/3768702216 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f012006ae40 0x7f012006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:35.866 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:35.865+0000 7f013d7fa640 1 -- 172.21.15.73:0/3768702216 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6463+0+0 (secure 0 0 0) 0x7f01380891c0 con 0x7f014014f8c0 2023-12-12T09:44:35.866 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:35.865+0000 7f013ffff640 1 --2- 172.21.15.73:0/3768702216 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f012006ae40 0x7f012006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:35.867 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:35.866+0000 7f013ffff640 1 --2- 172.21.15.73:0/3768702216 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f012006ae40 0x7f012006d300 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f0130036000 tx=0x7f013003b040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:44:35.871 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:35.871+0000 7f013d7fa640 1 -- 172.21.15.73:0/3768702216 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f0138053f70 con 0x7f014014f8c0 2023-12-12T09:44:36.097 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:36.095+0000 7f01465b6640 1 -- 172.21.15.73:0/3768702216 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs2", "metadata": "cephfs2_metadata", "data": "cephfs2_data"} v 0) v1 -- 0x7f0140067580 con 0x7f014014f8c0 2023-12-12T09:44:36.661 INFO:teuthology.orchestra.run.smithi073.stderr:new fs with metadata pool 6 and data pool 7 2023-12-12T09:44:36.662 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:36.659+0000 7f013d7fa640 1 -- 172.21.15.73:0/3768702216 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs2", "metadata": "cephfs2_metadata", "data": "cephfs2_data"}]=0 new fs with metadata pool 6 and data pool 7 v16) v1 ==== 175+0+0 (secure 0 0 0) 0x7f01380170c0 con 0x7f014014f8c0 2023-12-12T09:44:36.667 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:36.666+0000 7f01465b6640 1 -- 172.21.15.73:0/3768702216 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f012006ae40 msgr2=0x7f012006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:36.667 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:36.666+0000 7f01465b6640 1 --2- 172.21.15.73:0/3768702216 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f012006ae40 0x7f012006d300 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f0130036000 tx=0x7f013003b040 comp rx=0 tx=0).stop 2023-12-12T09:44:36.667 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:36.666+0000 7f01465b6640 1 -- 172.21.15.73:0/3768702216 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f014014f8c0 msgr2=0x7f0140154b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:36.667 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:36.666+0000 7f01465b6640 1 --2- 172.21.15.73:0/3768702216 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f014014f8c0 0x7f0140154b80 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f0138001560 tx=0x7f013800cc70 comp rx=0 tx=0).stop 2023-12-12T09:44:36.668 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:36.666+0000 7f01465b6640 1 -- 172.21.15.73:0/3768702216 shutdown_connections 2023-12-12T09:44:36.668 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:36.666+0000 7f01465b6640 1 --2- 172.21.15.73:0/3768702216 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f012006ae40 0x7f012006d300 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:36.668 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:36.666+0000 7f01465b6640 1 --2- 172.21.15.73:0/3768702216 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f014014f8c0 0x7f0140154b80 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:36.668 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:36.666+0000 7f01465b6640 1 --2- 172.21.15.73:0/3768702216 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f01400723a0 0x7f0140151bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:36.668 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:36.666+0000 7f01465b6640 1 --2- 172.21.15.73:0/3768702216 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f014006d350 0x7f0140153880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:36.668 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:36.666+0000 7f01465b6640 1 -- 172.21.15.73:0/3768702216 >> 172.21.15.73:0/3768702216 conn(0x7f014006a4e0 msgr2=0x7f014014e4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:44:36.671 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:36.670+0000 7f01465b6640 1 -- 172.21.15.73:0/3768702216 shutdown_connections 2023-12-12T09:44:36.671 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:36.670+0000 7f01465b6640 1 -- 172.21.15.73:0/3768702216 wait complete. 2023-12-12T09:44:36.706 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-12T09:44:36.879 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:36.878+0000 7efd45905640 1 Processor -- start 2023-12-12T09:44:36.879 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:36.878+0000 7efd45905640 1 -- start start 2023-12-12T09:44:36.881 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:36.879+0000 7efd45905640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7efd4014e840 0x7efd400a9a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:36.881 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:36.879+0000 7efd45905640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efd400c1dd0 0x7efd4015bab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:36.881 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:36.879+0000 7efd45905640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd400c1b10 con 0x7efd400ab700 2023-12-12T09:44:36.881 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:36.880+0000 7efd45905640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd400c2c60 con 0x7efd4014e840 2023-12-12T09:44:36.881 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:36.880+0000 7efd45905640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd400c1830 con 0x7efd400c1dd0 2023-12-12T09:44:36.881 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:36.880+0000 7efd3effd640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7efd4014e840 0x7efd400a9a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:36.882 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:36.880+0000 7efd3effd640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7efd4014e840 0x7efd400a9a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.73:49350/0 (socket says 172.21.15.73:49350) 2023-12-12T09:44:36.882 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:36.880+0000 7efd3effd640 1 -- 172.21.15.73:0/2032702556 learned_addr learned my addr 172.21.15.73:0/2032702556 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:44:36.882 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:36.880+0000 7efd3f7fe640 1 --2- 172.21.15.73:0/2032702556 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efd400c1dd0 0x7efd4015bab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:36.882 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:36.881+0000 7efd3effd640 1 -- 172.21.15.73:0/2032702556 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efd400c1dd0 msgr2=0x7efd4015bab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:44:36.883 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:36.881+0000 7efd3effd640 1 --2- 172.21.15.73:0/2032702556 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efd400c1dd0 0x7efd4015bab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:36.883 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:36.881+0000 7efd3effd640 1 -- 172.21.15.73:0/2032702556 >> v1:172.21.15.142:6789/0 conn(0x7efd400ab700 legacy=0x7efd400c0d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:36.883 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:36.881+0000 7efd3effd640 1 -- 172.21.15.73:0/2032702556 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd40151ce0 con 0x7efd4014e840 2023-12-12T09:44:36.883 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:36.882+0000 7efd3effd640 1 --2- 172.21.15.73:0/2032702556 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efd4014e840 0x7efd400a9a60 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7efd30009870 tx=0x7efd3002b8f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3df09ca187b4ae04 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:44:36.884 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:36.883+0000 7efd3dffb640 1 -- 172.21.15.73:0/2032702556 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd30031640 con 0x7efd4014e840 2023-12-12T09:44:36.884 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:36.883+0000 7efd3dffb640 1 -- 172.21.15.73:0/2032702556 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd300317a0 con 0x7efd4014e840 2023-12-12T09:44:36.884 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:36.883+0000 7efd3dffb640 1 -- 172.21.15.73:0/2032702556 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd30031b30 con 0x7efd4014e840 2023-12-12T09:44:36.885 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:36.883+0000 7efd45905640 1 -- 172.21.15.73:0/2032702556 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efd4014e840 msgr2=0x7efd400a9a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:36.885 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:36.883+0000 7efd45905640 1 --2- 172.21.15.73:0/2032702556 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efd4014e840 0x7efd400a9a60 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7efd30009870 tx=0x7efd3002b8f0 comp rx=0 tx=0).stop 2023-12-12T09:44:36.885 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:36.884+0000 7efd45905640 1 -- 172.21.15.73:0/2032702556 shutdown_connections 2023-12-12T09:44:36.885 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:36.884+0000 7efd45905640 1 --2- 172.21.15.73:0/2032702556 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efd400c1dd0 0x7efd4015bab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:36.885 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:36.884+0000 7efd45905640 1 --2- 172.21.15.73:0/2032702556 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efd4014e840 0x7efd400a9a60 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:36.886 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:36.884+0000 7efd45905640 1 -- 172.21.15.73:0/2032702556 >> 172.21.15.73:0/2032702556 conn(0x7efd400c6380 msgr2=0x7efd400c6760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:44:36.886 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:36.884+0000 7efd45905640 1 -- 172.21.15.73:0/2032702556 shutdown_connections 2023-12-12T09:44:36.886 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:36.884+0000 7efd45905640 1 -- 172.21.15.73:0/2032702556 wait complete. 2023-12-12T09:44:36.886 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:36.885+0000 7efd45905640 1 Processor -- start 2023-12-12T09:44:36.886 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:36.886+0000 7efd45905640 1 -- start start 2023-12-12T09:44:36.888 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:36.886+0000 7efd45905640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efd400ab700 0x7efd400bfa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:36.888 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:36.886+0000 7efd45905640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efd400c1dd0 0x7efd40142db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:36.888 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:36.886+0000 7efd45905640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efd4014e840 0x7efd401432f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:36.888 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:36.886+0000 7efd45905640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd400c5cf0 con 0x7efd4014e840 2023-12-12T09:44:36.889 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:36.886+0000 7efd45905640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd401ea900 con 0x7efd400ab700 2023-12-12T09:44:36.889 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:36.886+0000 7efd45905640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd401eb8d0 con 0x7efd400c1dd0 2023-12-12T09:44:36.889 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:36.887+0000 7efd3f7fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efd4014e840 0x7efd401432f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:36.889 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:36.887+0000 7efd3f7fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efd4014e840 0x7efd401432f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:41762/0 (socket says 172.21.15.73:41762) 2023-12-12T09:44:36.889 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:36.887+0000 7efd3f7fe640 1 -- 172.21.15.73:0/899726381 learned_addr learned my addr 172.21.15.73:0/899726381 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:44:36.889 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:36.887+0000 7efd3effd640 1 --2- 172.21.15.73:0/899726381 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efd400ab700 0x7efd400bfa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:36.889 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:36.887+0000 7efd3e7fc640 1 --2- 172.21.15.73:0/899726381 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efd400c1dd0 0x7efd40142db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:36.890 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:36.887+0000 7efd3f7fe640 1 -- 172.21.15.73:0/899726381 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efd400c1dd0 msgr2=0x7efd40142db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:36.890 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:36.887+0000 7efd3f7fe640 1 --2- 172.21.15.73:0/899726381 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efd400c1dd0 0x7efd40142db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:36.890 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:36.887+0000 7efd3f7fe640 1 -- 172.21.15.73:0/899726381 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efd400ab700 msgr2=0x7efd400bfa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:36.890 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:36.887+0000 7efd3f7fe640 1 --2- 172.21.15.73:0/899726381 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efd400ab700 0x7efd400bfa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:36.891 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:36.887+0000 7efd3f7fe640 1 -- 172.21.15.73:0/899726381 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd300094d0 con 0x7efd4014e840 2023-12-12T09:44:36.891 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:36.888+0000 7efd3f7fe640 1 --2- 172.21.15.73:0/899726381 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efd4014e840 0x7efd401432f0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7efd3800efc0 tx=0x7efd3800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:44:36.891 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:36.888+0000 7efd27fff640 1 -- 172.21.15.73:0/899726381 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd38009b20 con 0x7efd4014e840 2023-12-12T09:44:36.891 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:36.888+0000 7efd27fff640 1 -- 172.21.15.73:0/899726381 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd3800f040 con 0x7efd4014e840 2023-12-12T09:44:36.891 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:36.888+0000 7efd27fff640 1 -- 172.21.15.73:0/899726381 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd380146c0 con 0x7efd4014e840 2023-12-12T09:44:36.891 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:36.888+0000 7efd45905640 1 -- 172.21.15.73:0/899726381 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd401eb440 con 0x7efd4014e840 2023-12-12T09:44:36.891 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:36.888+0000 7efd45905640 1 -- 172.21.15.73:0/899726381 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd40143830 con 0x7efd4014e840 2023-12-12T09:44:36.891 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:36.889+0000 7efd45905640 1 -- 172.21.15.73:0/899726381 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd401eb5d0 con 0x7efd4014e840 2023-12-12T09:44:36.891 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:36.890+0000 7efd27fff640 1 -- 172.21.15.73:0/899726381 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7efd38014820 con 0x7efd4014e840 2023-12-12T09:44:36.893 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:36.892+0000 7efd27fff640 1 --2- 172.21.15.73:0/899726381 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7efd2c06ae70 0x7efd2c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:36.893 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:36.892+0000 7efd27fff640 1 -- 172.21.15.73:0/899726381 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6565+0+0 (secure 0 0 0) 0x7efd3808a670 con 0x7efd4014e840 2023-12-12T09:44:36.893 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:36.892+0000 7efd3effd640 1 --2- 172.21.15.73:0/899726381 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7efd2c06ae70 0x7efd2c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:36.894 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:36.893+0000 7efd3effd640 1 --2- 172.21.15.73:0/899726381 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7efd2c06ae70 0x7efd2c06d330 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7efd30036000 tx=0x7efd3003c040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:44:36.898 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:36.896+0000 7efd27fff640 1 -- 172.21.15.73:0/899726381 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7efd38055450 con 0x7efd4014e840 2023-12-12T09:44:37.081 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:37.080+0000 7efd45905640 1 -- 172.21.15.73:0/899726381 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7efd400c3c30 con 0x7efd4014e840 2023-12-12T09:44:37.083 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:37.082+0000 7efd27fff640 1 -- 172.21.15.73:0/899726381 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v37) v1 ==== 74+0+20254 (secure 0 0 0) 0x7efd38009e60 con 0x7efd4014e840 2023-12-12T09:44:37.083 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-12T09:44:37.083 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":37,"fsid":"ba240992-02b8-4c7e-92f2-27eb29ac433b","created":"2023-12-12T09:43:02.454719+0000","modified":"2023-12-12T09:44:36.097813+0000","last_up_change":"2023-12-12T09:43:13.913440+0000","last_in_change":"2023-12-12T09:43:05.925348+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-12T09:43:15.525508+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-12-12T09:44:18.641446+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-12-12T09:44:19.952405+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs2_metadata","create_time":"2023-12-12T09:44:34.424645+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs2_data","create_time":"2023-12-12T09:44:35.090149+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"dd9074be-dbe2-4c34-9896-a4223d8d3940","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":4047810203},{"type":"v1","addr":"172.21.15.73:6801","nonce":4047810203}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":4047810203},{"type":"v1","addr":"172.21.15.73:6803","nonce":4047810203}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":4047810203},{"type":"v1","addr":"172.21.15.73:6807","nonce":4047810203}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":4047810203},{"type":"v1","addr":"172.21.15.73:6805","nonce":4047810203}]},"public_addr":"172.21.15.73:6801/4047810203","cluster_addr":"172.21.15.73:6803/4047810203","heartbeat_back_addr":"172.21.15.73:6807/4047810203","heartbeat_front_addr":"172.21.15.73:6805/4047810203","state":["exists","up"]},{"osd":1,"uuid":"c4a05052-96d4-4758-a4e1-1a37f1e07fed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":1356058331},{"type":"v1","addr":"172.21.15.73:6824","nonce":1356058331}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":1356058331},{"type":"v1","addr":"172.21.15.73:6827","nonce":1356058331}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":1356058331},{"type":"v1","addr":"172.21.15.73:6831","nonce":1356058331}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":1356058331},{"type":"v1","addr":"172.21.15.73:6829","nonce":1356058331}]},"public_addr":"172.21.15.73:6824/1356058331","cluster_addr":"172.21.15.73:6827/1356058331","heartbeat_back_addr":"172.21.15.73:6831/1356058331","heartbeat_front_addr":"172.21.15.73:6829/1356058331","state":["exists","up"]},{"osd":2,"uuid":"512bc8ac-72c2-40d4-b3d2-d867a92c5213","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":1228903316},{"type":"v1","addr":"172.21.15.73:6817","nonce":1228903316}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":1228903316},{"type":"v1","addr":"172.21.15.73:6819","nonce":1228903316}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6823","nonce":1228903316},{"type":"v1","addr":"172.21.15.73:6825","nonce":1228903316}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":1228903316},{"type":"v1","addr":"172.21.15.73:6821","nonce":1228903316}]},"public_addr":"172.21.15.73:6817/1228903316","cluster_addr":"172.21.15.73:6819/1228903316","heartbeat_back_addr":"172.21.15.73:6825/1228903316","heartbeat_front_addr":"172.21.15.73:6821/1228903316","state":["exists","up"]},{"osd":3,"uuid":"3d1a91e0-42bf-437a-8eae-8d357c8f63a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":1293329670},{"type":"v1","addr":"172.21.15.73:6809","nonce":1293329670}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6810","nonce":1293329670},{"type":"v1","addr":"172.21.15.73:6811","nonce":1293329670}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":1293329670},{"type":"v1","addr":"172.21.15.73:6815","nonce":1293329670}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":1293329670},{"type":"v1","addr":"172.21.15.73:6813","nonce":1293329670}]},"public_addr":"172.21.15.73:6809/1293329670","cluster_addr":"172.21.15.73:6811/1293329670","heartbeat_back_addr":"172.21.15.73:6815/1293329670","heartbeat_front_addr":"172.21.15.73:6813/1293329670","state":["exists","up"]},{"osd":4,"uuid":"4b302fff-834c-4069-ac19-00e46f6c87b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":3727975702},{"type":"v1","addr":"172.21.15.142:6801","nonce":3727975702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":3727975702},{"type":"v1","addr":"172.21.15.142:6803","nonce":3727975702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6809","nonce":3727975702},{"type":"v1","addr":"172.21.15.142:6811","nonce":3727975702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6805","nonce":3727975702},{"type":"v1","addr":"172.21.15.142:6807","nonce":3727975702}]},"public_addr":"172.21.15.142:6801/3727975702","cluster_addr":"172.21.15.142:6803/3727975702","heartbeat_back_addr":"172.21.15.142:6811/3727975702","heartbeat_front_addr":"172.21.15.142:6807/3727975702","state":["exists","up"]},{"osd":5,"uuid":"d7cdace2-67d0-45cc-95f2-515cf6ef1b82","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6817","nonce":2353193632},{"type":"v1","addr":"172.21.15.142:6819","nonce":2353193632}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6821","nonce":2353193632},{"type":"v1","addr":"172.21.15.142:6823","nonce":2353193632}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6829","nonce":2353193632},{"type":"v1","addr":"172.21.15.142:6831","nonce":2353193632}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6825","nonce":2353193632},{"type":"v1","addr":"172.21.15.142:6827","nonce":2353193632}]},"public_addr":"172.21.15.142:6819/2353193632","cluster_addr":"172.21.15.142:6823/2353193632","heartbeat_back_addr":"172.21.15.142:6831/2353193632","heartbeat_front_addr":"172.21.15.142:6827/2353193632","state":["exists","up"]},{"osd":6,"uuid":"649ce78a-5626-445c-aedc-a651ed05a6f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":2006111986},{"type":"v1","addr":"172.21.15.142:6806","nonce":2006111986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":2006111986},{"type":"v1","addr":"172.21.15.142:6810","nonce":2006111986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":2006111986},{"type":"v1","addr":"172.21.15.142:6815","nonce":2006111986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":2006111986},{"type":"v1","addr":"172.21.15.142:6813","nonce":2006111986}]},"public_addr":"172.21.15.142:6806/2006111986","cluster_addr":"172.21.15.142:6810/2006111986","heartbeat_back_addr":"172.21.15.142:6815/2006111986","heartbeat_front_addr":"172.21.15.142:6813/2006111986","state":["exists","up"]},{"osd":7,"uuid":"af15ae3b-c1d0-4acf-92db-8a1805494d13","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":2573794341},{"type":"v1","addr":"172.21.15.142:6818","nonce":2573794341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":2573794341},{"type":"v1","addr":"172.21.15.142:6822","nonce":2573794341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":2573794341},{"type":"v1","addr":"172.21.15.142:6830","nonce":2573794341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":2573794341},{"type":"v1","addr":"172.21.15.142:6826","nonce":2573794341}]},"public_addr":"172.21.15.142:6818/2573794341","cluster_addr":"172.21.15.142:6822/2573794341","heartbeat_back_addr":"172.21.15.142:6830/2573794341","heartbeat_front_addr":"172.21.15.142:6826/2573794341","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.185824+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.262103+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.225556+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:10.523459+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:10.706035+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.257339+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.301776+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.051960+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-12T09:44:37.085 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:37.084+0000 7efd45905640 1 -- 172.21.15.73:0/899726381 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7efd2c06ae70 msgr2=0x7efd2c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:37.085 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:37.084+0000 7efd45905640 1 --2- 172.21.15.73:0/899726381 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7efd2c06ae70 0x7efd2c06d330 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7efd30036000 tx=0x7efd3003c040 comp rx=0 tx=0).stop 2023-12-12T09:44:37.085 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:37.084+0000 7efd45905640 1 -- 172.21.15.73:0/899726381 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efd4014e840 msgr2=0x7efd401432f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:37.085 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:37.084+0000 7efd45905640 1 --2- 172.21.15.73:0/899726381 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efd4014e840 0x7efd401432f0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7efd3800efc0 tx=0x7efd3800c490 comp rx=0 tx=0).stop 2023-12-12T09:44:37.085 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:37.084+0000 7efd45905640 1 -- 172.21.15.73:0/899726381 shutdown_connections 2023-12-12T09:44:37.086 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:37.084+0000 7efd45905640 1 --2- 172.21.15.73:0/899726381 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7efd2c06ae70 0x7efd2c06d330 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:37.086 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:37.084+0000 7efd45905640 1 --2- 172.21.15.73:0/899726381 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efd4014e840 0x7efd401432f0 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:37.086 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:37.084+0000 7efd45905640 1 --2- 172.21.15.73:0/899726381 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efd400c1dd0 0x7efd40142db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:37.086 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:37.084+0000 7efd45905640 1 --2- 172.21.15.73:0/899726381 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efd400ab700 0x7efd400bfa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:37.086 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:37.084+0000 7efd45905640 1 -- 172.21.15.73:0/899726381 >> 172.21.15.73:0/899726381 conn(0x7efd400c6380 msgr2=0x7efd400c0d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:44:37.086 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:37.084+0000 7efd45905640 1 -- 172.21.15.73:0/899726381 shutdown_connections 2023-12-12T09:44:37.086 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:37.084+0000 7efd45905640 1 -- 172.21.15.73:0/899726381 wait complete. 2023-12-12T09:44:37.110 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-12T09:44:37.300 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:37.299+0000 7fdc683a9640 1 Processor -- start 2023-12-12T09:44:37.300 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:37.299+0000 7fdc683a9640 1 -- start start 2023-12-12T09:44:37.301 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:37.300+0000 7fdc683a9640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fdc6014fa40 0x7fdc6006a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:37.301 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:37.300+0000 7fdc683a9640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdc600c5070 0x7fdc600c40c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:37.301 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:37.300+0000 7fdc683a9640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc60152610 con 0x7fdc6006db70 2023-12-12T09:44:37.301 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:37.300+0000 7fdc683a9640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc601528f0 con 0x7fdc6014fa40 2023-12-12T09:44:37.302 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:37.300+0000 7fdc683a9640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc60152bd0 con 0x7fdc600c5070 2023-12-12T09:44:37.302 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:37.301+0000 7fdc66145640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fdc6014fa40 0x7fdc6006a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:37.303 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:37.301+0000 7fdc65944640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7fdc6006db70 0x7fdc600c39b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:32888/0 (socket says 172.21.15.73:32888) 2023-12-12T09:44:37.303 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:37.301+0000 7fdc65944640 1 -- 172.21.15.73:0/4041602224 learned_addr learned my addr 172.21.15.73:0/4041602224 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-12T09:44:37.303 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:37.301+0000 7fdc66946640 1 --2- 172.21.15.73:0/4041602224 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdc600c5070 0x7fdc600c40c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:37.303 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:37.301+0000 7fdc66145640 1 -- 172.21.15.73:0/4041602224 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdc600c5070 msgr2=0x7fdc600c40c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:44:37.303 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:37.301+0000 7fdc66145640 1 --2- 172.21.15.73:0/4041602224 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdc600c5070 0x7fdc600c40c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:37.303 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:37.301+0000 7fdc66145640 1 -- 172.21.15.73:0/4041602224 >> v1:172.21.15.73:6789/0 conn(0x7fdc6006db70 legacy=0x7fdc600c39b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:37.303 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:37.301+0000 7fdc66145640 1 -- 172.21.15.73:0/4041602224 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc60152eb0 con 0x7fdc6014fa40 2023-12-12T09:44:37.303 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:37.301+0000 7fdc65143640 1 -- 172.21.15.73:0/4041602224 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 650445549 0 0) 0x7fdc60152610 con 0x7fdc6006db70 2023-12-12T09:44:37.304 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:37.302+0000 7fdc66145640 1 --2- 172.21.15.73:0/4041602224 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdc6014fa40 0x7fdc6006a4e0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fdc5c0097a0 tx=0x7fdc5c02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f8b4ca4067dce11 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:44:37.304 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:37.302+0000 7fdc65143640 1 -- 172.21.15.73:0/4041602224 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc5c031830 con 0x7fdc6014fa40 2023-12-12T09:44:37.304 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:37.303+0000 7fdc65143640 1 -- 172.21.15.73:0/4041602224 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc5c031990 con 0x7fdc6014fa40 2023-12-12T09:44:37.305 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:37.303+0000 7fdc65143640 1 -- 172.21.15.73:0/4041602224 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc5c031d20 con 0x7fdc6014fa40 2023-12-12T09:44:37.305 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:37.303+0000 7fdc683a9640 1 -- 172.21.15.73:0/4041602224 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdc6014fa40 msgr2=0x7fdc6006a4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:37.305 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:37.303+0000 7fdc683a9640 1 --2- 172.21.15.73:0/4041602224 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdc6014fa40 0x7fdc6006a4e0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fdc5c0097a0 tx=0x7fdc5c02b8d0 comp rx=0 tx=0).stop 2023-12-12T09:44:37.305 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:37.303+0000 7fdc683a9640 1 -- 172.21.15.73:0/4041602224 shutdown_connections 2023-12-12T09:44:37.305 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:37.303+0000 7fdc683a9640 1 --2- 172.21.15.73:0/4041602224 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdc600c5070 0x7fdc600c40c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:37.305 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:37.303+0000 7fdc683a9640 1 --2- 172.21.15.73:0/4041602224 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdc6014fa40 0x7fdc6006a4e0 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:37.305 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:37.303+0000 7fdc683a9640 1 -- 172.21.15.73:0/4041602224 >> 172.21.15.73:0/4041602224 conn(0x7fdc600a8130 msgr2=0x7fdc600c24b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:44:37.305 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:37.303+0000 7fdc683a9640 1 -- 172.21.15.73:0/4041602224 shutdown_connections 2023-12-12T09:44:37.305 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:37.303+0000 7fdc683a9640 1 -- 172.21.15.73:0/4041602224 wait complete. 2023-12-12T09:44:37.306 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:37.305+0000 7fdc683a9640 1 Processor -- start 2023-12-12T09:44:37.306 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:37.305+0000 7fdc683a9640 1 -- start start 2023-12-12T09:44:37.308 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:37.306+0000 7fdc683a9640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdc6006db70 0x7fdc6014a190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:37.308 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:37.306+0000 7fdc683a9640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdc600c5070 0x7fdc600707c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:37.308 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:37.306+0000 7fdc683a9640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdc6014fa40 0x7fdc60070d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:37.308 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:37.306+0000 7fdc683a9640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc60151b80 con 0x7fdc6006db70 2023-12-12T09:44:37.308 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:37.306+0000 7fdc683a9640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc601ebb60 con 0x7fdc6014fa40 2023-12-12T09:44:37.308 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:37.306+0000 7fdc683a9640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc60151e20 con 0x7fdc600c5070 2023-12-12T09:44:37.308 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:37.306+0000 7fdc66145640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdc6006db70 0x7fdc6014a190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:37.308 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:37.306+0000 7fdc66145640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdc6006db70 0x7fdc6014a190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:41782/0 (socket says 172.21.15.73:41782) 2023-12-12T09:44:37.308 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:37.306+0000 7fdc66145640 1 -- 172.21.15.73:0/297366805 learned_addr learned my addr 172.21.15.73:0/297366805 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:44:37.308 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:37.307+0000 7fdc66145640 1 -- 172.21.15.73:0/297366805 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdc600c5070 msgr2=0x7fdc600707c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:37.308 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:37.307+0000 7fdc66145640 1 --2- 172.21.15.73:0/297366805 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdc600c5070 0x7fdc600707c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:37.308 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:37.307+0000 7fdc66145640 1 -- 172.21.15.73:0/297366805 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdc6014fa40 msgr2=0x7fdc60070d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:37.309 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:37.307+0000 7fdc66145640 1 --2- 172.21.15.73:0/297366805 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdc6014fa40 0x7fdc60070d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:37.309 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:37.307+0000 7fdc66145640 1 -- 172.21.15.73:0/297366805 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc5c009400 con 0x7fdc6006db70 2023-12-12T09:44:37.309 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:37.307+0000 7fdc66145640 1 --2- 172.21.15.73:0/297366805 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdc6006db70 0x7fdc6014a190 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fdc5c02bee0 tx=0x7fdc5c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:44:37.309 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:37.307+0000 7fdc56ffd640 1 -- 172.21.15.73:0/297366805 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc5c03a6f0 con 0x7fdc6006db70 2023-12-12T09:44:37.310 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:37.307+0000 7fdc56ffd640 1 -- 172.21.15.73:0/297366805 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc5c03a870 con 0x7fdc6006db70 2023-12-12T09:44:37.310 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:37.307+0000 7fdc683a9640 1 -- 172.21.15.73:0/297366805 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc601ebe40 con 0x7fdc6006db70 2023-12-12T09:44:37.310 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:37.307+0000 7fdc56ffd640 1 -- 172.21.15.73:0/297366805 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc5c03ac20 con 0x7fdc6006db70 2023-12-12T09:44:37.310 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:37.307+0000 7fdc683a9640 1 -- 172.21.15.73:0/297366805 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc600bffa0 con 0x7fdc6006db70 2023-12-12T09:44:37.310 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:37.308+0000 7fdc683a9640 1 -- 172.21.15.73:0/297366805 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc60067580 con 0x7fdc6006db70 2023-12-12T09:44:37.310 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:37.309+0000 7fdc56ffd640 1 -- 172.21.15.73:0/297366805 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fdc5c030380 con 0x7fdc6006db70 2023-12-12T09:44:37.311 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:37.310+0000 7fdc56ffd640 1 --2- 172.21.15.73:0/297366805 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fdc4406ae40 0x7fdc4406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:37.311 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:37.310+0000 7fdc56ffd640 1 -- 172.21.15.73:0/297366805 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fdc5c0ab340 con 0x7fdc6006db70 2023-12-12T09:44:37.311 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:37.310+0000 7fdc65944640 1 --2- 172.21.15.73:0/297366805 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fdc4406ae40 0x7fdc4406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:37.312 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:37.311+0000 7fdc65944640 1 --2- 172.21.15.73:0/297366805 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fdc4406ae40 0x7fdc4406d300 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fdc50007fd0 tx=0x7fdc50007960 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:44:37.316 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:37.315+0000 7fdc56ffd640 1 -- 172.21.15.73:0/297366805 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fdc5c076120 con 0x7fdc6006db70 2023-12-12T09:44:37.420 INFO:tasks.ceph.mds.a.smithi073.stderr:2023-12-12T09:44:37.419+0000 7f6e825c8640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-12-12T09:44:37.508 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:37.506+0000 7fdc683a9640 1 -- 172.21.15.73:0/297366805 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fdc60151fe0 con 0x7fdc6006db70 2023-12-12T09:44:37.512 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:37.511+0000 7fdc56ffd640 1 -- 172.21.15.73:0/297366805 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v37) v1 ==== 74+0+20254 (secure 0 0 0) 0x7fdc5c079740 con 0x7fdc6006db70 2023-12-12T09:44:37.513 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-12T09:44:37.513 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":37,"fsid":"ba240992-02b8-4c7e-92f2-27eb29ac433b","created":"2023-12-12T09:43:02.454719+0000","modified":"2023-12-12T09:44:36.097813+0000","last_up_change":"2023-12-12T09:43:13.913440+0000","last_in_change":"2023-12-12T09:43:05.925348+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-12T09:43:15.525508+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-12-12T09:44:18.641446+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-12-12T09:44:19.952405+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs2_metadata","create_time":"2023-12-12T09:44:34.424645+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs2_data","create_time":"2023-12-12T09:44:35.090149+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"dd9074be-dbe2-4c34-9896-a4223d8d3940","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":4047810203},{"type":"v1","addr":"172.21.15.73:6801","nonce":4047810203}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":4047810203},{"type":"v1","addr":"172.21.15.73:6803","nonce":4047810203}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":4047810203},{"type":"v1","addr":"172.21.15.73:6807","nonce":4047810203}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":4047810203},{"type":"v1","addr":"172.21.15.73:6805","nonce":4047810203}]},"public_addr":"172.21.15.73:6801/4047810203","cluster_addr":"172.21.15.73:6803/4047810203","heartbeat_back_addr":"172.21.15.73:6807/4047810203","heartbeat_front_addr":"172.21.15.73:6805/4047810203","state":["exists","up"]},{"osd":1,"uuid":"c4a05052-96d4-4758-a4e1-1a37f1e07fed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":1356058331},{"type":"v1","addr":"172.21.15.73:6824","nonce":1356058331}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":1356058331},{"type":"v1","addr":"172.21.15.73:6827","nonce":1356058331}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":1356058331},{"type":"v1","addr":"172.21.15.73:6831","nonce":1356058331}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":1356058331},{"type":"v1","addr":"172.21.15.73:6829","nonce":1356058331}]},"public_addr":"172.21.15.73:6824/1356058331","cluster_addr":"172.21.15.73:6827/1356058331","heartbeat_back_addr":"172.21.15.73:6831/1356058331","heartbeat_front_addr":"172.21.15.73:6829/1356058331","state":["exists","up"]},{"osd":2,"uuid":"512bc8ac-72c2-40d4-b3d2-d867a92c5213","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":1228903316},{"type":"v1","addr":"172.21.15.73:6817","nonce":1228903316}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":1228903316},{"type":"v1","addr":"172.21.15.73:6819","nonce":1228903316}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6823","nonce":1228903316},{"type":"v1","addr":"172.21.15.73:6825","nonce":1228903316}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":1228903316},{"type":"v1","addr":"172.21.15.73:6821","nonce":1228903316}]},"public_addr":"172.21.15.73:6817/1228903316","cluster_addr":"172.21.15.73:6819/1228903316","heartbeat_back_addr":"172.21.15.73:6825/1228903316","heartbeat_front_addr":"172.21.15.73:6821/1228903316","state":["exists","up"]},{"osd":3,"uuid":"3d1a91e0-42bf-437a-8eae-8d357c8f63a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":1293329670},{"type":"v1","addr":"172.21.15.73:6809","nonce":1293329670}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6810","nonce":1293329670},{"type":"v1","addr":"172.21.15.73:6811","nonce":1293329670}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":1293329670},{"type":"v1","addr":"172.21.15.73:6815","nonce":1293329670}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":1293329670},{"type":"v1","addr":"172.21.15.73:6813","nonce":1293329670}]},"public_addr":"172.21.15.73:6809/1293329670","cluster_addr":"172.21.15.73:6811/1293329670","heartbeat_back_addr":"172.21.15.73:6815/1293329670","heartbeat_front_addr":"172.21.15.73:6813/1293329670","state":["exists","up"]},{"osd":4,"uuid":"4b302fff-834c-4069-ac19-00e46f6c87b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":3727975702},{"type":"v1","addr":"172.21.15.142:6801","nonce":3727975702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":3727975702},{"type":"v1","addr":"172.21.15.142:6803","nonce":3727975702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6809","nonce":3727975702},{"type":"v1","addr":"172.21.15.142:6811","nonce":3727975702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6805","nonce":3727975702},{"type":"v1","addr":"172.21.15.142:6807","nonce":3727975702}]},"public_addr":"172.21.15.142:6801/3727975702","cluster_addr":"172.21.15.142:6803/3727975702","heartbeat_back_addr":"172.21.15.142:6811/3727975702","heartbeat_front_addr":"172.21.15.142:6807/3727975702","state":["exists","up"]},{"osd":5,"uuid":"d7cdace2-67d0-45cc-95f2-515cf6ef1b82","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6817","nonce":2353193632},{"type":"v1","addr":"172.21.15.142:6819","nonce":2353193632}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6821","nonce":2353193632},{"type":"v1","addr":"172.21.15.142:6823","nonce":2353193632}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6829","nonce":2353193632},{"type":"v1","addr":"172.21.15.142:6831","nonce":2353193632}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6825","nonce":2353193632},{"type":"v1","addr":"172.21.15.142:6827","nonce":2353193632}]},"public_addr":"172.21.15.142:6819/2353193632","cluster_addr":"172.21.15.142:6823/2353193632","heartbeat_back_addr":"172.21.15.142:6831/2353193632","heartbeat_front_addr":"172.21.15.142:6827/2353193632","state":["exists","up"]},{"osd":6,"uuid":"649ce78a-5626-445c-aedc-a651ed05a6f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":2006111986},{"type":"v1","addr":"172.21.15.142:6806","nonce":2006111986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":2006111986},{"type":"v1","addr":"172.21.15.142:6810","nonce":2006111986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":2006111986},{"type":"v1","addr":"172.21.15.142:6815","nonce":2006111986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":2006111986},{"type":"v1","addr":"172.21.15.142:6813","nonce":2006111986}]},"public_addr":"172.21.15.142:6806/2006111986","cluster_addr":"172.21.15.142:6810/2006111986","heartbeat_back_addr":"172.21.15.142:6815/2006111986","heartbeat_front_addr":"172.21.15.142:6813/2006111986","state":["exists","up"]},{"osd":7,"uuid":"af15ae3b-c1d0-4acf-92db-8a1805494d13","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":2573794341},{"type":"v1","addr":"172.21.15.142:6818","nonce":2573794341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":2573794341},{"type":"v1","addr":"172.21.15.142:6822","nonce":2573794341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":2573794341},{"type":"v1","addr":"172.21.15.142:6830","nonce":2573794341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":2573794341},{"type":"v1","addr":"172.21.15.142:6826","nonce":2573794341}]},"public_addr":"172.21.15.142:6818/2573794341","cluster_addr":"172.21.15.142:6822/2573794341","heartbeat_back_addr":"172.21.15.142:6830/2573794341","heartbeat_front_addr":"172.21.15.142:6826/2573794341","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.185824+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.262103+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.225556+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:10.523459+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:10.706035+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.257339+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.301776+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.051960+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-12T09:44:37.516 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:37.515+0000 7fdc683a9640 1 -- 172.21.15.73:0/297366805 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fdc4406ae40 msgr2=0x7fdc4406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:37.516 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:37.515+0000 7fdc683a9640 1 --2- 172.21.15.73:0/297366805 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fdc4406ae40 0x7fdc4406d300 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fdc50007fd0 tx=0x7fdc50007960 comp rx=0 tx=0).stop 2023-12-12T09:44:37.516 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:37.515+0000 7fdc683a9640 1 -- 172.21.15.73:0/297366805 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdc6006db70 msgr2=0x7fdc6014a190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:37.516 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:37.515+0000 7fdc683a9640 1 --2- 172.21.15.73:0/297366805 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdc6006db70 0x7fdc6014a190 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fdc5c02bee0 tx=0x7fdc5c0046c0 comp rx=0 tx=0).stop 2023-12-12T09:44:37.516 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:37.515+0000 7fdc683a9640 1 -- 172.21.15.73:0/297366805 shutdown_connections 2023-12-12T09:44:37.516 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:37.515+0000 7fdc683a9640 1 --2- 172.21.15.73:0/297366805 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fdc4406ae40 0x7fdc4406d300 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:37.517 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:37.515+0000 7fdc683a9640 1 --2- 172.21.15.73:0/297366805 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdc6014fa40 0x7fdc60070d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:37.517 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:37.515+0000 7fdc683a9640 1 --2- 172.21.15.73:0/297366805 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdc600c5070 0x7fdc600707c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:37.517 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:37.515+0000 7fdc683a9640 1 --2- 172.21.15.73:0/297366805 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdc6006db70 0x7fdc6014a190 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:37.517 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:37.515+0000 7fdc683a9640 1 -- 172.21.15.73:0/297366805 >> 172.21.15.73:0/297366805 conn(0x7fdc600a8130 msgr2=0x7fdc600a5b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:44:37.517 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:37.515+0000 7fdc683a9640 1 -- 172.21.15.73:0/297366805 shutdown_connections 2023-12-12T09:44:37.517 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:37.515+0000 7fdc683a9640 1 -- 172.21.15.73:0/297366805 wait complete. 2023-12-12T09:44:37.535 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs2 standby_count_wanted 0 2023-12-12T09:44:37.741 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:37.740+0000 7fa1c1fa9640 1 Processor -- start 2023-12-12T09:44:37.741 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:37.740+0000 7fa1c1fa9640 1 -- start start 2023-12-12T09:44:37.743 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:37.741+0000 7fa1c1fa9640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fa1bc14f8c0 0x7fa1bc06dc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:37.743 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:37.741+0000 7fa1c1fa9640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1bc0c16c0 con 0x7fa1bc152500 2023-12-12T09:44:37.743 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:37.741+0000 7fa1c1fa9640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1bc0c19a0 con 0x7fa1bc06d350 2023-12-12T09:44:37.743 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:37.741+0000 7fa1c1fa9640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1bc0c1090 con 0x7fa1bc14f8c0 2023-12-12T09:44:37.743 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:37.742+0000 7fa1bb7fe640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fa1bc14f8c0 0x7fa1bc06dc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:37.743 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:37.742+0000 7fa1bbfff640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7fa1bc152500 0x7fa1bc152990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:32896/0 (socket says 172.21.15.73:32896) 2023-12-12T09:44:37.743 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:37.742+0000 7fa1bbfff640 1 -- 172.21.15.73:0/3847281662 learned_addr learned my addr 172.21.15.73:0/3847281662 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-12T09:44:37.744 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:37.742+0000 7fa1bb7fe640 1 -- 172.21.15.73:0/3847281662 >> v1:172.21.15.142:6789/0 conn(0x7fa1bc06d350 legacy=0x7fa1bc071e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:44:37.744 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:37.742+0000 7fa1bb7fe640 1 -- 172.21.15.73:0/3847281662 >> v1:172.21.15.73:6789/0 conn(0x7fa1bc152500 legacy=0x7fa1bc152990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:37.744 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:37.742+0000 7fa1bb7fe640 1 -- 172.21.15.73:0/3847281662 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1bc0c1c80 con 0x7fa1bc14f8c0 2023-12-12T09:44:37.744 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:37.742+0000 7fa1ba7fc640 1 -- 172.21.15.73:0/3847281662 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 529900373 0 0) 0x7fa1bc0c16c0 con 0x7fa1bc152500 2023-12-12T09:44:37.744 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:37.743+0000 7fa1bb7fe640 1 --2- 172.21.15.73:0/3847281662 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa1bc14f8c0 0x7fa1bc06dc40 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fa1ac0097a0 tx=0x7fa1ac02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb5dd710ae30ab4c server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:44:37.745 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:37.743+0000 7fa1ba7fc640 1 -- 172.21.15.73:0/3847281662 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1ac031830 con 0x7fa1bc14f8c0 2023-12-12T09:44:37.746 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:37.744+0000 7fa1ba7fc640 1 -- 172.21.15.73:0/3847281662 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1ac031990 con 0x7fa1bc14f8c0 2023-12-12T09:44:37.746 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:37.744+0000 7fa1ba7fc640 1 -- 172.21.15.73:0/3847281662 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1ac031d20 con 0x7fa1bc14f8c0 2023-12-12T09:44:37.746 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:37.744+0000 7fa1c1fa9640 1 -- 172.21.15.73:0/3847281662 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa1bc14f8c0 msgr2=0x7fa1bc06dc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:37.746 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:37.744+0000 7fa1c1fa9640 1 --2- 172.21.15.73:0/3847281662 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa1bc14f8c0 0x7fa1bc06dc40 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fa1ac0097a0 tx=0x7fa1ac02b8d0 comp rx=0 tx=0).stop 2023-12-12T09:44:37.746 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:37.744+0000 7fa1c1fa9640 1 -- 172.21.15.73:0/3847281662 shutdown_connections 2023-12-12T09:44:37.746 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:37.744+0000 7fa1c1fa9640 1 --2- 172.21.15.73:0/3847281662 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa1bc14f8c0 0x7fa1bc06dc40 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:37.746 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:37.744+0000 7fa1c1fa9640 1 -- 172.21.15.73:0/3847281662 >> 172.21.15.73:0/3847281662 conn(0x7fa1bc06a4e0 msgr2=0x7fa1bc06a8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:44:37.746 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:37.744+0000 7fa1c1fa9640 1 -- 172.21.15.73:0/3847281662 shutdown_connections 2023-12-12T09:44:37.746 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:37.744+0000 7fa1c1fa9640 1 -- 172.21.15.73:0/3847281662 wait complete. 2023-12-12T09:44:37.747 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:37.746+0000 7fa1c1fa9640 1 Processor -- start 2023-12-12T09:44:37.747 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:37.746+0000 7fa1c1fa9640 1 -- start start 2023-12-12T09:44:37.748 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:37.747+0000 7fa1c1fa9640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa1bc06d350 0x7fa1bc0a57b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:37.748 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:37.747+0000 7fa1c1fa9640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa1bc14f8c0 0x7fa1bc155f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:37.748 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:37.747+0000 7fa1c1fa9640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa1bc152500 0x7fa1bc156480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:37.748 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:37.747+0000 7fa1c1fa9640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1bc1543e0 con 0x7fa1bc06d350 2023-12-12T09:44:37.748 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:37.747+0000 7fa1c1fa9640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1bc0a6090 con 0x7fa1bc14f8c0 2023-12-12T09:44:37.748 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:37.747+0000 7fa1c1fa9640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1bc153a60 con 0x7fa1bc152500 2023-12-12T09:44:37.750 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:37.747+0000 7fa1bb7fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa1bc06d350 0x7fa1bc0a57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:37.750 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:37.747+0000 7fa1bb7fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa1bc06d350 0x7fa1bc0a57b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:41792/0 (socket says 172.21.15.73:41792) 2023-12-12T09:44:37.750 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:37.747+0000 7fa1bb7fe640 1 -- 172.21.15.73:0/1553251431 learned_addr learned my addr 172.21.15.73:0/1553251431 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:44:37.750 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:37.748+0000 7fa1baffd640 1 --2- 172.21.15.73:0/1553251431 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa1bc14f8c0 0x7fa1bc155f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:37.750 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:37.748+0000 7fa1bbfff640 1 --2- 172.21.15.73:0/1553251431 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa1bc152500 0x7fa1bc156480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:37.751 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:37.748+0000 7fa1bb7fe640 1 -- 172.21.15.73:0/1553251431 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa1bc152500 msgr2=0x7fa1bc156480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:37.751 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:37.748+0000 7fa1bb7fe640 1 --2- 172.21.15.73:0/1553251431 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa1bc152500 0x7fa1bc156480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:37.751 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:37.748+0000 7fa1bb7fe640 1 -- 172.21.15.73:0/1553251431 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa1bc14f8c0 msgr2=0x7fa1bc155f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:37.751 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:37.748+0000 7fa1bb7fe640 1 --2- 172.21.15.73:0/1553251431 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa1bc14f8c0 0x7fa1bc155f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:37.751 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:37.748+0000 7fa1bb7fe640 1 -- 172.21.15.73:0/1553251431 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1ac009400 con 0x7fa1bc06d350 2023-12-12T09:44:37.751 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:37.748+0000 7fa1baffd640 1 --2- 172.21.15.73:0/1553251431 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa1bc14f8c0 0x7fa1bc155f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-12T09:44:37.751 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:37.748+0000 7fa1bb7fe640 1 --2- 172.21.15.73:0/1553251431 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa1bc06d350 0x7fa1bc0a57b0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fa1ac0098c0 tx=0x7fa1ac0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:44:37.751 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:37.748+0000 7fa1a3fff640 1 -- 172.21.15.73:0/1553251431 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1ac03ba70 con 0x7fa1bc06d350 2023-12-12T09:44:37.751 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:37.748+0000 7fa1a3fff640 1 -- 172.21.15.73:0/1553251431 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1ac03bbf0 con 0x7fa1bc06d350 2023-12-12T09:44:37.751 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:37.749+0000 7fa1c1fa9640 1 -- 172.21.15.73:0/1553251431 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1bc1eae50 con 0x7fa1bc06d350 2023-12-12T09:44:37.751 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:37.749+0000 7fa1a3fff640 1 -- 172.21.15.73:0/1553251431 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1ac0453f0 con 0x7fa1bc06d350 2023-12-12T09:44:37.751 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:37.749+0000 7fa1c1fa9640 1 -- 172.21.15.73:0/1553251431 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1bc154000 con 0x7fa1bc06d350 2023-12-12T09:44:37.752 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:37.750+0000 7fa1c1fa9640 1 -- 172.21.15.73:0/1553251431 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa1bc067070 con 0x7fa1bc06d350 2023-12-12T09:44:37.752 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:37.751+0000 7fa1a3fff640 1 -- 172.21.15.73:0/1553251431 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fa1ac04e450 con 0x7fa1bc06d350 2023-12-12T09:44:37.752 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:37.752+0000 7fa1a3fff640 1 --2- 172.21.15.73:0/1553251431 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fa1a806ae40 0x7fa1a806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:37.753 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:37.752+0000 7fa1a3fff640 1 -- 172.21.15.73:0/1553251431 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fa1ac0abbe0 con 0x7fa1bc06d350 2023-12-12T09:44:37.753 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:37.752+0000 7fa1baffd640 1 --2- 172.21.15.73:0/1553251431 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fa1a806ae40 0x7fa1a806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:37.753 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:37.753+0000 7fa1baffd640 1 --2- 172.21.15.73:0/1553251431 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fa1a806ae40 0x7fa1a806d300 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fa1bc0a6bc0 tx=0x7fa1b0009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:44:37.756 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:37.756+0000 7fa1a3fff640 1 -- 172.21.15.73:0/1553251431 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fa1ac076a50 con 0x7fa1bc06d350 2023-12-12T09:44:37.966 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:37.965+0000 7fa1c1fa9640 1 -- 172.21.15.73:0/1553251431 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs2", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fa1bc14c4c0 con 0x7fa1bc06d350 2023-12-12T09:44:38.676 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:38.675+0000 7fa1a3fff640 1 -- 172.21.15.73:0/1553251431 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs2", "var": "standby_count_wanted", "val": "0"}]=0 v18) v1 ==== 119+0+0 (secure 0 0 0) 0x7fa1ac07a070 con 0x7fa1bc06d350 2023-12-12T09:44:38.680 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:38.679+0000 7fa1c1fa9640 1 -- 172.21.15.73:0/1553251431 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fa1a806ae40 msgr2=0x7fa1a806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:38.680 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:38.679+0000 7fa1c1fa9640 1 --2- 172.21.15.73:0/1553251431 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fa1a806ae40 0x7fa1a806d300 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fa1bc0a6bc0 tx=0x7fa1b0009040 comp rx=0 tx=0).stop 2023-12-12T09:44:38.680 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:38.679+0000 7fa1c1fa9640 1 -- 172.21.15.73:0/1553251431 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa1bc06d350 msgr2=0x7fa1bc0a57b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:38.680 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:38.679+0000 7fa1c1fa9640 1 --2- 172.21.15.73:0/1553251431 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa1bc06d350 0x7fa1bc0a57b0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fa1ac0098c0 tx=0x7fa1ac0046c0 comp rx=0 tx=0).stop 2023-12-12T09:44:38.681 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:38.679+0000 7fa1c1fa9640 1 -- 172.21.15.73:0/1553251431 shutdown_connections 2023-12-12T09:44:38.681 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:38.679+0000 7fa1c1fa9640 1 --2- 172.21.15.73:0/1553251431 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fa1a806ae40 0x7fa1a806d300 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:38.681 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:38.679+0000 7fa1c1fa9640 1 --2- 172.21.15.73:0/1553251431 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa1bc152500 0x7fa1bc156480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:38.681 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:38.679+0000 7fa1c1fa9640 1 --2- 172.21.15.73:0/1553251431 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa1bc14f8c0 0x7fa1bc155f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:38.681 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:38.679+0000 7fa1c1fa9640 1 --2- 172.21.15.73:0/1553251431 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa1bc06d350 0x7fa1bc0a57b0 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:38.681 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:38.679+0000 7fa1c1fa9640 1 -- 172.21.15.73:0/1553251431 >> 172.21.15.73:0/1553251431 conn(0x7fa1bc06a4e0 msgr2=0x7fa1bc152990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:44:38.681 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:38.679+0000 7fa1c1fa9640 1 -- 172.21.15.73:0/1553251431 shutdown_connections 2023-12-12T09:44:38.681 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:38.679+0000 7fa1c1fa9640 1 -- 172.21.15.73:0/1553251431 wait complete. 2023-12-12T09:44:38.699 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-12-12T09:44:38.699 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs2 allow_standby_replay false 2023-12-12T09:44:38.907 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:38.906+0000 7f5946fa9640 1 Processor -- start 2023-12-12T09:44:38.907 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:38.906+0000 7f5946fa9640 1 -- start start 2023-12-12T09:44:38.909 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:38.907+0000 7f5946fa9640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f594006d350 0x7f594006dc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:38.909 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:38.907+0000 7f5946fa9640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f5940152500 0x7f5940152990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:38.909 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:38.908+0000 7f5946fa9640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59400c16c0 con 0x7f594014f8c0 2023-12-12T09:44:38.909 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:38.908+0000 7f5946fa9640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59400c1090 con 0x7f5940152500 2023-12-12T09:44:38.909 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:38.908+0000 7f5946fa9640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59400c14b0 con 0x7f594006d350 2023-12-12T09:44:38.909 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:38.908+0000 7f5944d45640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f594014f8c0 0x7f5940071e60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:44362/0 (socket says 172.21.15.73:44362) 2023-12-12T09:44:38.909 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:38.908+0000 7f5944d45640 1 -- 172.21.15.73:0/2891640242 learned_addr learned my addr 172.21.15.73:0/2891640242 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-12T09:44:38.909 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:38.908+0000 7f5945546640 1 --2- 172.21.15.73:0/2891640242 >> v2:172.21.15.73:3300/0 conn(0x7f5940152500 0x7f5940152990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:38.910 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:38.908+0000 7f593f7fe640 1 -- 172.21.15.73:0/2891640242 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3439116815 0 0) 0x7f59400c16c0 con 0x7f594014f8c0 2023-12-12T09:44:38.910 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:38.908+0000 7f593f7fe640 1 -- 172.21.15.73:0/2891640242 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5930003520 con 0x7f594014f8c0 2023-12-12T09:44:38.910 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:38.908+0000 7f5945546640 1 -- 172.21.15.73:0/2891640242 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f594006d350 msgr2=0x7f594006dc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:44:38.910 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:38.908+0000 7f5945546640 1 --2- 172.21.15.73:0/2891640242 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f594006d350 0x7f594006dc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:38.911 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:38.908+0000 7f5945546640 1 -- 172.21.15.73:0/2891640242 >> v1:172.21.15.73:6789/0 conn(0x7f594014f8c0 legacy=0x7f5940071e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:38.911 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:38.908+0000 7f5945546640 1 -- 172.21.15.73:0/2891640242 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59400c19a0 con 0x7f5940152500 2023-12-12T09:44:38.911 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:38.909+0000 7f5945546640 1 --2- 172.21.15.73:0/2891640242 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5940152500 0x7f5940152990 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f5938009d90 tx=0x7f593802bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=619eb6a96f5af43a server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:44:38.912 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:38.910+0000 7f593f7fe640 1 -- 172.21.15.73:0/2891640242 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f593802cc50 con 0x7f5940152500 2023-12-12T09:44:38.912 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:38.910+0000 7f593f7fe640 1 -- 172.21.15.73:0/2891640242 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f593802cdb0 con 0x7f5940152500 2023-12-12T09:44:38.912 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:38.910+0000 7f593f7fe640 1 -- 172.21.15.73:0/2891640242 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5938034660 con 0x7f5940152500 2023-12-12T09:44:38.912 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:38.910+0000 7f5946fa9640 1 -- 172.21.15.73:0/2891640242 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5940152500 msgr2=0x7f5940152990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:38.912 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:38.910+0000 7f5946fa9640 1 --2- 172.21.15.73:0/2891640242 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5940152500 0x7f5940152990 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f5938009d90 tx=0x7f593802bea0 comp rx=0 tx=0).stop 2023-12-12T09:44:38.912 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:38.910+0000 7f5946fa9640 1 -- 172.21.15.73:0/2891640242 shutdown_connections 2023-12-12T09:44:38.912 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:38.910+0000 7f5946fa9640 1 --2- 172.21.15.73:0/2891640242 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f594006d350 0x7f594006dc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:38.912 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:38.910+0000 7f5946fa9640 1 --2- 172.21.15.73:0/2891640242 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5940152500 0x7f5940152990 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:38.912 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:38.910+0000 7f5946fa9640 1 -- 172.21.15.73:0/2891640242 >> 172.21.15.73:0/2891640242 conn(0x7f594006a4e0 msgr2=0x7f594006a8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:44:38.912 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:38.910+0000 7f5946fa9640 1 -- 172.21.15.73:0/2891640242 shutdown_connections 2023-12-12T09:44:38.912 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:38.910+0000 7f5946fa9640 1 -- 172.21.15.73:0/2891640242 wait complete. 2023-12-12T09:44:38.913 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:38.912+0000 7f5946fa9640 1 Processor -- start 2023-12-12T09:44:38.913 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:38.912+0000 7f5946fa9640 1 -- start start 2023-12-12T09:44:38.915 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:38.913+0000 7f5946fa9640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f594006d350 0x7f59401444e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:38.915 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:38.913+0000 7f5946fa9640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f594014f8c0 0x7f59401e4cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:38.915 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:38.913+0000 7f5946fa9640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5940152500 0x7f59401e51f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:38.915 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:38.913+0000 7f5946fa9640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59401427c0 con 0x7f5940152500 2023-12-12T09:44:38.915 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:38.913+0000 7f5946fa9640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59401e5730 con 0x7f594014f8c0 2023-12-12T09:44:38.915 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:38.913+0000 7f5946fa9640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5940154540 con 0x7f594006d350 2023-12-12T09:44:38.915 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:38.913+0000 7f5945546640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5940152500 0x7f59401e51f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:38.915 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:38.913+0000 7f5945546640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5940152500 0x7f59401e51f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:52632/0 (socket says 172.21.15.73:52632) 2023-12-12T09:44:38.915 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:38.913+0000 7f5945546640 1 -- 172.21.15.73:0/943382261 learned_addr learned my addr 172.21.15.73:0/943382261 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:44:38.916 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:38.914+0000 7f5945546640 1 -- 172.21.15.73:0/943382261 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f594006d350 msgr2=0x7f59401444e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:38.916 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:38.914+0000 7f5944d45640 1 --2- 172.21.15.73:0/943382261 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f594006d350 0x7f59401444e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:38.916 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:38.914+0000 7f593ffff640 1 --2- 172.21.15.73:0/943382261 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f594014f8c0 0x7f59401e4cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:38.916 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:38.914+0000 7f5945546640 1 --2- 172.21.15.73:0/943382261 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f594006d350 0x7f59401444e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:38.916 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:38.914+0000 7f5945546640 1 -- 172.21.15.73:0/943382261 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f594014f8c0 msgr2=0x7f59401e4cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:38.916 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:38.914+0000 7f5945546640 1 --2- 172.21.15.73:0/943382261 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f594014f8c0 0x7f59401e4cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:38.916 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:38.914+0000 7f5945546640 1 -- 172.21.15.73:0/943382261 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5938009a70 con 0x7f5940152500 2023-12-12T09:44:38.916 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:38.914+0000 7f5944d45640 1 --2- 172.21.15.73:0/943382261 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f594006d350 0x7f59401444e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:44:38.916 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:38.914+0000 7f5945546640 1 --2- 172.21.15.73:0/943382261 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5940152500 0x7f59401e51f0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f5938037040 tx=0x7f5938004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:44:38.917 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:38.914+0000 7f593d7fa640 1 -- 172.21.15.73:0/943382261 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5938040650 con 0x7f5940152500 2023-12-12T09:44:38.917 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:38.914+0000 7f593d7fa640 1 -- 172.21.15.73:0/943382261 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59380407b0 con 0x7f5940152500 2023-12-12T09:44:38.917 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:38.914+0000 7f5946fa9640 1 -- 172.21.15.73:0/943382261 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5940150270 con 0x7f5940152500 2023-12-12T09:44:38.917 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:38.914+0000 7f593d7fa640 1 -- 172.21.15.73:0/943382261 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5938040b60 con 0x7f5940152500 2023-12-12T09:44:38.917 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:38.915+0000 7f5946fa9640 1 -- 172.21.15.73:0/943382261 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5940154a90 con 0x7f5940152500 2023-12-12T09:44:38.917 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:38.915+0000 7f5946fa9640 1 -- 172.21.15.73:0/943382261 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f594014fca0 con 0x7f5940152500 2023-12-12T09:44:38.918 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:38.916+0000 7f593d7fa640 1 -- 172.21.15.73:0/943382261 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f5938040cc0 con 0x7f5940152500 2023-12-12T09:44:38.919 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:38.918+0000 7f593d7fa640 1 --2- 172.21.15.73:0/943382261 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f592406ae40 0x7f592406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:38.919 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:38.918+0000 7f593d7fa640 1 -- 172.21.15.73:0/943382261 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f59380ac770 con 0x7f5940152500 2023-12-12T09:44:38.919 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:38.918+0000 7f5944d45640 1 --2- 172.21.15.73:0/943382261 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f592406ae40 0x7f592406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:38.919 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:38.919+0000 7f5944d45640 1 --2- 172.21.15.73:0/943382261 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f592406ae40 0x7f592406d300 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f59340011e0 tx=0x7f5934009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:44:38.924 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:38.923+0000 7f593d7fa640 1 -- 172.21.15.73:0/943382261 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f5938077570 con 0x7f5940152500 2023-12-12T09:44:39.151 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:39.150+0000 7f5946fa9640 1 -- 172.21.15.73:0/943382261 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs2", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f5940067070 con 0x7f5940152500 2023-12-12T09:44:39.689 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:39.688+0000 7f593d7fa640 1 -- 172.21.15.73:0/943382261 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs2", "var": "allow_standby_replay", "val": "false"}]=0 v19) v1 ==== 123+0+0 (secure 0 0 0) 0x7f5938009450 con 0x7f5940152500 2023-12-12T09:44:39.693 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:39.692+0000 7f5946fa9640 1 -- 172.21.15.73:0/943382261 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f592406ae40 msgr2=0x7f592406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:39.694 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:39.692+0000 7f5946fa9640 1 --2- 172.21.15.73:0/943382261 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f592406ae40 0x7f592406d300 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f59340011e0 tx=0x7f5934009040 comp rx=0 tx=0).stop 2023-12-12T09:44:39.694 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:39.692+0000 7f5946fa9640 1 -- 172.21.15.73:0/943382261 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5940152500 msgr2=0x7f59401e51f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:39.694 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:39.692+0000 7f5946fa9640 1 --2- 172.21.15.73:0/943382261 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5940152500 0x7f59401e51f0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f5938037040 tx=0x7f5938004a40 comp rx=0 tx=0).stop 2023-12-12T09:44:39.694 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:39.693+0000 7f5946fa9640 1 -- 172.21.15.73:0/943382261 shutdown_connections 2023-12-12T09:44:39.694 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:39.693+0000 7f5946fa9640 1 --2- 172.21.15.73:0/943382261 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f592406ae40 0x7f592406d300 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:39.694 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:39.693+0000 7f5946fa9640 1 --2- 172.21.15.73:0/943382261 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5940152500 0x7f59401e51f0 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:39.695 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:39.693+0000 7f5946fa9640 1 --2- 172.21.15.73:0/943382261 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f594014f8c0 0x7f59401e4cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:39.695 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:39.693+0000 7f5946fa9640 1 --2- 172.21.15.73:0/943382261 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f594006d350 0x7f59401444e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:39.695 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:39.693+0000 7f5946fa9640 1 -- 172.21.15.73:0/943382261 >> 172.21.15.73:0/943382261 conn(0x7f594006a4e0 msgr2=0x7f5940152910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:44:39.695 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:39.693+0000 7f5946fa9640 1 -- 172.21.15.73:0/943382261 shutdown_connections 2023-12-12T09:44:39.695 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:39.693+0000 7f5946fa9640 1 -- 172.21.15.73:0/943382261 wait complete. 2023-12-12T09:44:39.713 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs2' 2023-12-12T09:44:39.713 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-12T09:44:39.924 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:39.922+0000 7f04ca8e0640 1 Processor -- start 2023-12-12T09:44:39.924 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:39.923+0000 7f04ca8e0640 1 -- start start 2023-12-12T09:44:39.925 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:39.924+0000 7f04ca8e0640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f04c406db70 0x7f04c40c39b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:39.925 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:39.924+0000 7f04ca8e0640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f04c40c5070 0x7f04c40c3ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:39.925 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:39.924+0000 7f04ca8e0640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04c4152610 con 0x7f04c414fa40 2023-12-12T09:44:39.925 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:39.924+0000 7f04ca8e0640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04c41528f0 con 0x7f04c406db70 2023-12-12T09:44:39.925 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:39.924+0000 7f04ca8e0640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04c4152bd0 con 0x7f04c40c5070 2023-12-12T09:44:39.925 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:39.924+0000 7f04c3fff640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f04c414fa40 0x7f04c406a4e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:44376/0 (socket says 172.21.15.73:44376) 2023-12-12T09:44:39.925 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:39.924+0000 7f04c3fff640 1 -- 172.21.15.73:0/82987276 learned_addr learned my addr 172.21.15.73:0/82987276 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-12T09:44:39.925 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:39.924+0000 7f04bbfff640 1 --2- 172.21.15.73:0/82987276 >> v2:172.21.15.73:3300/0 conn(0x7f04c406db70 0x7f04c40c39b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:39.926 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:39.924+0000 7f04c37fe640 1 -- 172.21.15.73:0/82987276 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2582327427 0 0) 0x7f04c4152610 con 0x7f04c414fa40 2023-12-12T09:44:39.926 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:39.924+0000 7f04c37fe640 1 -- 172.21.15.73:0/82987276 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f04b0003520 con 0x7f04c414fa40 2023-12-12T09:44:39.926 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:39.925+0000 7f04c8e7d640 1 --2- 172.21.15.73:0/82987276 >> v2:172.21.15.142:3300/0 conn(0x7f04c40c5070 0x7f04c40c3ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:39.927 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:39.925+0000 7f04bbfff640 1 -- 172.21.15.73:0/82987276 >> v2:172.21.15.142:3300/0 conn(0x7f04c40c5070 msgr2=0x7f04c40c3ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:44:39.927 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:39.925+0000 7f04bbfff640 1 --2- 172.21.15.73:0/82987276 >> v2:172.21.15.142:3300/0 conn(0x7f04c40c5070 0x7f04c40c3ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:39.927 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:39.925+0000 7f04bbfff640 1 -- 172.21.15.73:0/82987276 >> v1:172.21.15.73:6789/0 conn(0x7f04c414fa40 legacy=0x7f04c406a4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:39.927 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:39.925+0000 7f04bbfff640 1 -- 172.21.15.73:0/82987276 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04c4152eb0 con 0x7f04c406db70 2023-12-12T09:44:39.927 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:39.925+0000 7f04c8e7d640 1 --2- 172.21.15.73:0/82987276 >> v2:172.21.15.142:3300/0 conn(0x7f04c40c5070 0x7f04c40c3ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:44:39.928 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:39.926+0000 7f04bbfff640 1 --2- 172.21.15.73:0/82987276 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f04c406db70 0x7f04c40c39b0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f04c406fc50 tx=0x7f04ac02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51b461906c127fad server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:44:39.928 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:39.926+0000 7f04c37fe640 1 -- 172.21.15.73:0/82987276 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04ac031830 con 0x7f04c406db70 2023-12-12T09:44:39.928 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:39.926+0000 7f04c37fe640 1 -- 172.21.15.73:0/82987276 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04ac031990 con 0x7f04c406db70 2023-12-12T09:44:39.928 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:39.926+0000 7f04c37fe640 1 -- 172.21.15.73:0/82987276 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04ac031d20 con 0x7f04c406db70 2023-12-12T09:44:39.928 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:39.927+0000 7f04ca8e0640 1 -- 172.21.15.73:0/82987276 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f04c406db70 msgr2=0x7f04c40c39b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:39.928 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:39.927+0000 7f04ca8e0640 1 --2- 172.21.15.73:0/82987276 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f04c406db70 0x7f04c40c39b0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f04c406fc50 tx=0x7f04ac02b8d0 comp rx=0 tx=0).stop 2023-12-12T09:44:39.928 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:39.927+0000 7f04ca8e0640 1 -- 172.21.15.73:0/82987276 shutdown_connections 2023-12-12T09:44:39.928 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:39.927+0000 7f04ca8e0640 1 --2- 172.21.15.73:0/82987276 >> v2:172.21.15.142:3300/0 conn(0x7f04c40c5070 0x7f04c40c3ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:39.929 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:39.927+0000 7f04ca8e0640 1 --2- 172.21.15.73:0/82987276 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f04c406db70 0x7f04c40c39b0 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:39.929 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:39.927+0000 7f04ca8e0640 1 -- 172.21.15.73:0/82987276 >> 172.21.15.73:0/82987276 conn(0x7f04c40a8130 msgr2=0x7f04c40c24b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:44:39.929 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:39.927+0000 7f04ca8e0640 1 -- 172.21.15.73:0/82987276 shutdown_connections 2023-12-12T09:44:39.929 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:39.927+0000 7f04ca8e0640 1 -- 172.21.15.73:0/82987276 wait complete. 2023-12-12T09:44:39.929 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:39.928+0000 7f04ca8e0640 1 Processor -- start 2023-12-12T09:44:39.929 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:39.929+0000 7f04ca8e0640 1 -- start start 2023-12-12T09:44:39.931 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:39.929+0000 7f04ca8e0640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f04c406db70 0x7f04c4150700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:39.931 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:39.929+0000 7f04ca8e0640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f04c40c5070 0x7f04c4071520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:39.931 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:39.930+0000 7f04ca8e0640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f04c414fa40 0x7f04c41ecdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:39.931 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:39.930+0000 7f04ca8e0640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04c4153c60 con 0x7f04c406db70 2023-12-12T09:44:39.931 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:39.930+0000 7f04ca8e0640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04c4154600 con 0x7f04c414fa40 2023-12-12T09:44:39.932 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:39.930+0000 7f04ca8e0640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04c414c830 con 0x7f04c40c5070 2023-12-12T09:44:39.932 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:39.930+0000 7f04c3fff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f04c406db70 0x7f04c4150700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:39.932 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:39.930+0000 7f04c3fff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f04c406db70 0x7f04c4150700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:52656/0 (socket says 172.21.15.73:52656) 2023-12-12T09:44:39.932 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:39.930+0000 7f04c3fff640 1 -- 172.21.15.73:0/3526257352 learned_addr learned my addr 172.21.15.73:0/3526257352 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:44:39.932 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:39.930+0000 7f04c3fff640 1 -- 172.21.15.73:0/3526257352 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f04c40c5070 msgr2=0x7f04c4071520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:39.932 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:39.930+0000 7f04c3fff640 1 --2- 172.21.15.73:0/3526257352 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f04c40c5070 0x7f04c4071520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:39.932 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:39.930+0000 7f04c3fff640 1 -- 172.21.15.73:0/3526257352 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f04c414fa40 msgr2=0x7f04c41ecdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:39.932 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:39.930+0000 7f04c3fff640 1 --2- 172.21.15.73:0/3526257352 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f04c414fa40 0x7f04c41ecdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:39.932 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:39.930+0000 7f04c3fff640 1 -- 172.21.15.73:0/3526257352 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04ac009400 con 0x7f04c406db70 2023-12-12T09:44:39.932 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:39.930+0000 7f04c3fff640 1 --2- 172.21.15.73:0/3526257352 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f04c406db70 0x7f04c4150700 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f04b400c500 tx=0x7f04b400c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:44:39.933 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:39.931+0000 7f04c17fa640 1 -- 172.21.15.73:0/3526257352 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04b4005ce0 con 0x7f04c406db70 2023-12-12T09:44:39.933 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:39.931+0000 7f04c17fa640 1 -- 172.21.15.73:0/3526257352 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04b4005e40 con 0x7f04c406db70 2023-12-12T09:44:39.933 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:39.931+0000 7f04c17fa640 1 -- 172.21.15.73:0/3526257352 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04b4007330 con 0x7f04c406db70 2023-12-12T09:44:39.933 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:39.931+0000 7f04ca8e0640 1 -- 172.21.15.73:0/3526257352 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04c4153980 con 0x7f04c406db70 2023-12-12T09:44:39.933 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:39.931+0000 7f04ca8e0640 1 -- 172.21.15.73:0/3526257352 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04c4071a60 con 0x7f04c406db70 2023-12-12T09:44:39.933 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:39.932+0000 7f04ca8e0640 1 -- 172.21.15.73:0/3526257352 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f04c4154180 con 0x7f04c406db70 2023-12-12T09:44:39.934 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:39.933+0000 7f04c17fa640 1 -- 172.21.15.73:0/3526257352 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f04b4007550 con 0x7f04c406db70 2023-12-12T09:44:39.935 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:39.934+0000 7f04c17fa640 1 --2- 172.21.15.73:0/3526257352 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f04a406ae40 0x7f04a406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:39.935 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:39.934+0000 7f04c17fa640 1 -- 172.21.15.73:0/3526257352 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f04b4088fe0 con 0x7f04c406db70 2023-12-12T09:44:39.936 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:39.934+0000 7f04bbfff640 1 --2- 172.21.15.73:0/3526257352 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f04a406ae40 0x7f04a406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:39.936 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:39.935+0000 7f04bbfff640 1 --2- 172.21.15.73:0/3526257352 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f04a406ae40 0x7f04a406d300 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f04ac036000 tx=0x7f04ac030000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:44:39.940 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:39.939+0000 7f04c17fa640 1 -- 172.21.15.73:0/3526257352 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f04c4154180 con 0x7f04c406db70 2023-12-12T09:44:40.164 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:40.163+0000 7f04ca8e0640 1 -- 172.21.15.73:0/3526257352 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f04c4154180 con 0x7f04c406db70 2023-12-12T09:44:40.164 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:40.163+0000 7f04c17fa640 1 -- 172.21.15.73:0/3526257352 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) v1 ==== 94+0+6133 (secure 0 0 0) 0x7f04c4154180 con 0x7f04c406db70 2023-12-12T09:44:40.165 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-12T09:44:40.165 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":19,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4517,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6835/2407815368","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6833","nonce":2407815368},{"type":"v1","addr":"172.21.15.142:6835","nonce":2407815368}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":4720,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6834/153753304","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6832","nonce":153753304},{"type":"v1","addr":"172.21.15.142:6834","nonce":153753304}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-12T09:44:20.925302+0000","modified":"2023-12-12T09:44:24.049947+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4965},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4965":{"gid":4965,"name":"c","rank":0,"incarnation":12,"state":"up:active","state_seq":4,"addr":"172.21.15.73:6837/1534083424","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6835","nonce":1534083424},{"type":"v1","addr":"172.21.15.73:6837","nonce":1534083424}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2},{"mdsmap":{"epoch":19,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-12T09:44:36.098486+0000","modified":"2023-12-12T09:44:39.152510+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4962},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4962":{"gid":4962,"name":"a","rank":0,"incarnation":16,"state":"up:active","state_seq":8,"addr":"172.21.15.73:6836/2500303907","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":2500303907},{"type":"v1","addr":"172.21.15.73:6836","nonce":2500303907}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-12-12T09:44:40.165 INFO:teuthology.orchestra.run.smithi073.stderr:dumped fsmap epoch 19 2023-12-12T09:44:40.167 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:40.165+0000 7f04ca8e0640 1 -- 172.21.15.73:0/3526257352 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f04a406ae40 msgr2=0x7f04a406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:40.167 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:40.165+0000 7f04ca8e0640 1 --2- 172.21.15.73:0/3526257352 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f04a406ae40 0x7f04a406d300 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f04ac036000 tx=0x7f04ac030000 comp rx=0 tx=0).stop 2023-12-12T09:44:40.167 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:40.165+0000 7f04ca8e0640 1 -- 172.21.15.73:0/3526257352 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f04c406db70 msgr2=0x7f04c4150700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:40.167 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:40.165+0000 7f04ca8e0640 1 --2- 172.21.15.73:0/3526257352 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f04c406db70 0x7f04c4150700 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f04b400c500 tx=0x7f04b400c9c0 comp rx=0 tx=0).stop 2023-12-12T09:44:40.167 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:40.165+0000 7f04ca8e0640 1 -- 172.21.15.73:0/3526257352 shutdown_connections 2023-12-12T09:44:40.167 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:40.166+0000 7f04ca8e0640 1 --2- 172.21.15.73:0/3526257352 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f04a406ae40 0x7f04a406d300 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:40.167 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:40.166+0000 7f04ca8e0640 1 --2- 172.21.15.73:0/3526257352 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f04c414fa40 0x7f04c41ecdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:40.167 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:40.166+0000 7f04ca8e0640 1 --2- 172.21.15.73:0/3526257352 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f04c40c5070 0x7f04c4071520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:40.168 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:40.166+0000 7f04ca8e0640 1 --2- 172.21.15.73:0/3526257352 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f04c406db70 0x7f04c4150700 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:40.168 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:40.166+0000 7f04ca8e0640 1 -- 172.21.15.73:0/3526257352 >> 172.21.15.73:0/3526257352 conn(0x7f04c40a8130 msgr2=0x7f04c40c0ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:44:40.168 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:40.166+0000 7f04ca8e0640 1 -- 172.21.15.73:0/3526257352 shutdown_connections 2023-12-12T09:44:40.168 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:40.166+0000 7f04ca8e0640 1 -- 172.21.15.73:0/3526257352 wait complete. 2023-12-12T09:44:40.185 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-12T09:44:40.393 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:40.392+0000 7f351359e640 1 Processor -- start 2023-12-12T09:44:40.393 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:40.392+0000 7f351359e640 1 -- start start 2023-12-12T09:44:40.395 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:40.393+0000 7f351359e640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f35140c37b0 0x7f3514151cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:40.395 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:40.393+0000 7f351359e640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f35140ab4a0 0x7f35140a9df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:40.395 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:40.393+0000 7f351359e640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35141521f0 con 0x7f351414e700 2023-12-12T09:44:40.395 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:40.393+0000 7f351359e640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35140ab2d0 con 0x7f35140c37b0 2023-12-12T09:44:40.395 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:40.393+0000 7f351359e640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f351406bb10 con 0x7f35140ab4a0 2023-12-12T09:44:40.395 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:40.394+0000 7f351259c640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f351414e700 0x7f35140c02b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:44388/0 (socket says 172.21.15.73:44388) 2023-12-12T09:44:40.395 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:40.394+0000 7f351259c640 1 -- 172.21.15.73:0/3345631832 learned_addr learned my addr 172.21.15.73:0/3345631832 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-12T09:44:40.395 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:40.394+0000 7f350bfff640 1 --2- 172.21.15.73:0/3345631832 >> v2:172.21.15.73:3300/0 conn(0x7f35140c37b0 0x7f3514151cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:40.396 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:40.394+0000 7f3512d9d640 1 --2- 172.21.15.73:0/3345631832 >> v2:172.21.15.142:3300/0 conn(0x7f35140ab4a0 0x7f35140a9df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:40.396 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:40.394+0000 7f3511d9b640 1 -- 172.21.15.73:0/3345631832 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 251691685 0 0) 0x7f3504001110 con 0x7f351414e700 2023-12-12T09:44:40.396 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:40.394+0000 7f3511d9b640 1 -- 172.21.15.73:0/3345631832 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3500003520 con 0x7f351414e700 2023-12-12T09:44:40.396 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:40.394+0000 7f350bfff640 1 -- 172.21.15.73:0/3345631832 >> v2:172.21.15.142:3300/0 conn(0x7f35140ab4a0 msgr2=0x7f35140a9df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:44:40.396 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:40.394+0000 7f350bfff640 1 --2- 172.21.15.73:0/3345631832 >> v2:172.21.15.142:3300/0 conn(0x7f35140ab4a0 0x7f35140a9df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:40.396 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:40.394+0000 7f350bfff640 1 -- 172.21.15.73:0/3345631832 >> v1:172.21.15.73:6789/0 conn(0x7f351414e700 legacy=0x7f35140c02b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:40.396 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:40.394+0000 7f350bfff640 1 -- 172.21.15.73:0/3345631832 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35140aaff0 con 0x7f35140c37b0 2023-12-12T09:44:40.397 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:40.396+0000 7f350bfff640 1 --2- 172.21.15.73:0/3345631832 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f35140c37b0 0x7f3514151cb0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f35140a8f70 tx=0x7f34fc02b7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=507ae5f42733adae server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:44:40.397 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:40.396+0000 7f3511d9b640 1 -- 172.21.15.73:0/3345631832 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34fc031710 con 0x7f35140c37b0 2023-12-12T09:44:40.397 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:40.396+0000 7f3511d9b640 1 -- 172.21.15.73:0/3345631832 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34fc02f050 con 0x7f35140c37b0 2023-12-12T09:44:40.397 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:40.396+0000 7f3511d9b640 1 -- 172.21.15.73:0/3345631832 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34fc031a90 con 0x7f35140c37b0 2023-12-12T09:44:40.398 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:40.397+0000 7f351359e640 1 -- 172.21.15.73:0/3345631832 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f35140c37b0 msgr2=0x7f3514151cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:40.398 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:40.397+0000 7f351359e640 1 --2- 172.21.15.73:0/3345631832 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f35140c37b0 0x7f3514151cb0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f35140a8f70 tx=0x7f34fc02b7b0 comp rx=0 tx=0).stop 2023-12-12T09:44:40.398 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:40.397+0000 7f351359e640 1 -- 172.21.15.73:0/3345631832 shutdown_connections 2023-12-12T09:44:40.398 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:40.397+0000 7f351359e640 1 --2- 172.21.15.73:0/3345631832 >> v2:172.21.15.142:3300/0 conn(0x7f35140ab4a0 0x7f35140a9df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:40.399 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:40.397+0000 7f351359e640 1 --2- 172.21.15.73:0/3345631832 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f35140c37b0 0x7f3514151cb0 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:40.399 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:40.397+0000 7f351359e640 1 -- 172.21.15.73:0/3345631832 >> 172.21.15.73:0/3345631832 conn(0x7f35140c23b0 msgr2=0x7f35140c2790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:44:40.399 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:40.397+0000 7f351359e640 1 -- 172.21.15.73:0/3345631832 shutdown_connections 2023-12-12T09:44:40.399 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:40.397+0000 7f351359e640 1 -- 172.21.15.73:0/3345631832 wait complete. 2023-12-12T09:44:40.399 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:40.398+0000 7f351359e640 1 Processor -- start 2023-12-12T09:44:40.399 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:40.399+0000 7f351359e640 1 -- start start 2023-12-12T09:44:40.402 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:40.399+0000 7f351359e640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f35140ab4a0 0x7f3514154b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:40.402 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:40.399+0000 7f351359e640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f35140c37b0 0x7f3514070c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:40.402 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:40.399+0000 7f351359e640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f351414e700 0x7f3514071150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:40.402 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:40.399+0000 7f351359e640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35140720f0 con 0x7f351414e700 2023-12-12T09:44:40.402 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:40.399+0000 7f351359e640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35141ea970 con 0x7f35140ab4a0 2023-12-12T09:44:40.402 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:40.399+0000 7f351359e640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35141eac50 con 0x7f35140c37b0 2023-12-12T09:44:40.402 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:40.400+0000 7f3512d9d640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f351414e700 0x7f3514071150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:40.402 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:40.400+0000 7f3512d9d640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f351414e700 0x7f3514071150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:52674/0 (socket says 172.21.15.73:52674) 2023-12-12T09:44:40.402 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:40.400+0000 7f3512d9d640 1 -- 172.21.15.73:0/2881703993 learned_addr learned my addr 172.21.15.73:0/2881703993 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:44:40.402 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:40.400+0000 7f3512d9d640 1 -- 172.21.15.73:0/2881703993 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f35140c37b0 msgr2=0x7f3514070c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:40.402 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:40.400+0000 7f3512d9d640 1 --2- 172.21.15.73:0/2881703993 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f35140c37b0 0x7f3514070c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:40.402 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:40.400+0000 7f3512d9d640 1 -- 172.21.15.73:0/2881703993 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f35140ab4a0 msgr2=0x7f3514154b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:40.403 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:40.400+0000 7f3512d9d640 1 --2- 172.21.15.73:0/2881703993 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f35140ab4a0 0x7f3514154b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:40.403 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:40.400+0000 7f3512d9d640 1 -- 172.21.15.73:0/2881703993 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34fc009400 con 0x7f351414e700 2023-12-12T09:44:40.403 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:40.400+0000 7f3512d9d640 1 --2- 172.21.15.73:0/2881703993 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f351414e700 0x7f3514071150 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f350c007e40 tx=0x7f350c00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:44:40.403 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:40.400+0000 7f350affd640 1 -- 172.21.15.73:0/2881703993 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f350c014620 con 0x7f351414e700 2023-12-12T09:44:40.403 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:40.401+0000 7f350affd640 1 -- 172.21.15.73:0/2881703993 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f350c00ee90 con 0x7f351414e700 2023-12-12T09:44:40.403 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:40.401+0000 7f350affd640 1 -- 172.21.15.73:0/2881703993 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f350c0149e0 con 0x7f351414e700 2023-12-12T09:44:40.403 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:40.401+0000 7f351359e640 1 -- 172.21.15.73:0/2881703993 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3514070130 con 0x7f351414e700 2023-12-12T09:44:40.403 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:40.401+0000 7f351359e640 1 -- 172.21.15.73:0/2881703993 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35140706f0 con 0x7f351414e700 2023-12-12T09:44:40.404 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:40.402+0000 7f351359e640 1 -- 172.21.15.73:0/2881703993 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3514067400 con 0x7f351414e700 2023-12-12T09:44:40.404 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:40.403+0000 7f350affd640 1 -- 172.21.15.73:0/2881703993 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f350c014b40 con 0x7f351414e700 2023-12-12T09:44:40.404 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:40.403+0000 7f350affd640 1 --2- 172.21.15.73:0/2881703993 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f34f406ae40 0x7f34f406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:40.404 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:40.403+0000 7f350affd640 1 -- 172.21.15.73:0/2881703993 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f350c08a3a0 con 0x7f351414e700 2023-12-12T09:44:40.405 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:40.404+0000 7f351259c640 1 --2- 172.21.15.73:0/2881703993 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f34f406ae40 0x7f34f406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:40.405 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:40.404+0000 7f351259c640 1 --2- 172.21.15.73:0/2881703993 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f34f406ae40 0x7f34f406d300 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f3504005880 tx=0x7f3504001150 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:44:40.409 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:40.408+0000 7f350affd640 1 -- 172.21.15.73:0/2881703993 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f350c0550e0 con 0x7f351414e700 2023-12-12T09:44:40.601 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:40.600+0000 7f351359e640 1 -- 172.21.15.73:0/2881703993 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f351414db40 con 0x7f351414e700 2023-12-12T09:44:40.605 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:40.604+0000 7f350affd640 1 -- 172.21.15.73:0/2881703993 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v38) v1 ==== 74+0+20241 (secure 0 0 0) 0x7f350c058700 con 0x7f351414e700 2023-12-12T09:44:40.605 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-12T09:44:40.605 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":38,"fsid":"ba240992-02b8-4c7e-92f2-27eb29ac433b","created":"2023-12-12T09:43:02.454719+0000","modified":"2023-12-12T09:44:37.659373+0000","last_up_change":"2023-12-12T09:43:13.913440+0000","last_in_change":"2023-12-12T09:43:05.925348+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-12T09:43:15.525508+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-12-12T09:44:18.641446+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-12-12T09:44:19.952405+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs2_metadata","create_time":"2023-12-12T09:44:34.424645+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs2_data","create_time":"2023-12-12T09:44:35.090149+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"dd9074be-dbe2-4c34-9896-a4223d8d3940","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":4047810203},{"type":"v1","addr":"172.21.15.73:6801","nonce":4047810203}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":4047810203},{"type":"v1","addr":"172.21.15.73:6803","nonce":4047810203}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":4047810203},{"type":"v1","addr":"172.21.15.73:6807","nonce":4047810203}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":4047810203},{"type":"v1","addr":"172.21.15.73:6805","nonce":4047810203}]},"public_addr":"172.21.15.73:6801/4047810203","cluster_addr":"172.21.15.73:6803/4047810203","heartbeat_back_addr":"172.21.15.73:6807/4047810203","heartbeat_front_addr":"172.21.15.73:6805/4047810203","state":["exists","up"]},{"osd":1,"uuid":"c4a05052-96d4-4758-a4e1-1a37f1e07fed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":1356058331},{"type":"v1","addr":"172.21.15.73:6824","nonce":1356058331}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":1356058331},{"type":"v1","addr":"172.21.15.73:6827","nonce":1356058331}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":1356058331},{"type":"v1","addr":"172.21.15.73:6831","nonce":1356058331}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":1356058331},{"type":"v1","addr":"172.21.15.73:6829","nonce":1356058331}]},"public_addr":"172.21.15.73:6824/1356058331","cluster_addr":"172.21.15.73:6827/1356058331","heartbeat_back_addr":"172.21.15.73:6831/1356058331","heartbeat_front_addr":"172.21.15.73:6829/1356058331","state":["exists","up"]},{"osd":2,"uuid":"512bc8ac-72c2-40d4-b3d2-d867a92c5213","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":1228903316},{"type":"v1","addr":"172.21.15.73:6817","nonce":1228903316}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":1228903316},{"type":"v1","addr":"172.21.15.73:6819","nonce":1228903316}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6823","nonce":1228903316},{"type":"v1","addr":"172.21.15.73:6825","nonce":1228903316}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":1228903316},{"type":"v1","addr":"172.21.15.73:6821","nonce":1228903316}]},"public_addr":"172.21.15.73:6817/1228903316","cluster_addr":"172.21.15.73:6819/1228903316","heartbeat_back_addr":"172.21.15.73:6825/1228903316","heartbeat_front_addr":"172.21.15.73:6821/1228903316","state":["exists","up"]},{"osd":3,"uuid":"3d1a91e0-42bf-437a-8eae-8d357c8f63a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":1293329670},{"type":"v1","addr":"172.21.15.73:6809","nonce":1293329670}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6810","nonce":1293329670},{"type":"v1","addr":"172.21.15.73:6811","nonce":1293329670}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":1293329670},{"type":"v1","addr":"172.21.15.73:6815","nonce":1293329670}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":1293329670},{"type":"v1","addr":"172.21.15.73:6813","nonce":1293329670}]},"public_addr":"172.21.15.73:6809/1293329670","cluster_addr":"172.21.15.73:6811/1293329670","heartbeat_back_addr":"172.21.15.73:6815/1293329670","heartbeat_front_addr":"172.21.15.73:6813/1293329670","state":["exists","up"]},{"osd":4,"uuid":"4b302fff-834c-4069-ac19-00e46f6c87b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":3727975702},{"type":"v1","addr":"172.21.15.142:6801","nonce":3727975702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":3727975702},{"type":"v1","addr":"172.21.15.142:6803","nonce":3727975702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6809","nonce":3727975702},{"type":"v1","addr":"172.21.15.142:6811","nonce":3727975702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6805","nonce":3727975702},{"type":"v1","addr":"172.21.15.142:6807","nonce":3727975702}]},"public_addr":"172.21.15.142:6801/3727975702","cluster_addr":"172.21.15.142:6803/3727975702","heartbeat_back_addr":"172.21.15.142:6811/3727975702","heartbeat_front_addr":"172.21.15.142:6807/3727975702","state":["exists","up"]},{"osd":5,"uuid":"d7cdace2-67d0-45cc-95f2-515cf6ef1b82","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6817","nonce":2353193632},{"type":"v1","addr":"172.21.15.142:6819","nonce":2353193632}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6821","nonce":2353193632},{"type":"v1","addr":"172.21.15.142:6823","nonce":2353193632}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6829","nonce":2353193632},{"type":"v1","addr":"172.21.15.142:6831","nonce":2353193632}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6825","nonce":2353193632},{"type":"v1","addr":"172.21.15.142:6827","nonce":2353193632}]},"public_addr":"172.21.15.142:6819/2353193632","cluster_addr":"172.21.15.142:6823/2353193632","heartbeat_back_addr":"172.21.15.142:6831/2353193632","heartbeat_front_addr":"172.21.15.142:6827/2353193632","state":["exists","up"]},{"osd":6,"uuid":"649ce78a-5626-445c-aedc-a651ed05a6f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":2006111986},{"type":"v1","addr":"172.21.15.142:6806","nonce":2006111986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":2006111986},{"type":"v1","addr":"172.21.15.142:6810","nonce":2006111986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":2006111986},{"type":"v1","addr":"172.21.15.142:6815","nonce":2006111986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":2006111986},{"type":"v1","addr":"172.21.15.142:6813","nonce":2006111986}]},"public_addr":"172.21.15.142:6806/2006111986","cluster_addr":"172.21.15.142:6810/2006111986","heartbeat_back_addr":"172.21.15.142:6815/2006111986","heartbeat_front_addr":"172.21.15.142:6813/2006111986","state":["exists","up"]},{"osd":7,"uuid":"af15ae3b-c1d0-4acf-92db-8a1805494d13","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":2573794341},{"type":"v1","addr":"172.21.15.142:6818","nonce":2573794341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":2573794341},{"type":"v1","addr":"172.21.15.142:6822","nonce":2573794341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":2573794341},{"type":"v1","addr":"172.21.15.142:6830","nonce":2573794341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":2573794341},{"type":"v1","addr":"172.21.15.142:6826","nonce":2573794341}]},"public_addr":"172.21.15.142:6818/2573794341","cluster_addr":"172.21.15.142:6822/2573794341","heartbeat_back_addr":"172.21.15.142:6830/2573794341","heartbeat_front_addr":"172.21.15.142:6826/2573794341","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.185824+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.262103+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.225556+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:10.523459+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:10.706035+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.257339+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.301776+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.051960+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-12T09:44:40.607 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:40.606+0000 7f351359e640 1 -- 172.21.15.73:0/2881703993 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f34f406ae40 msgr2=0x7f34f406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:40.607 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:40.606+0000 7f351359e640 1 --2- 172.21.15.73:0/2881703993 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f34f406ae40 0x7f34f406d300 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f3504005880 tx=0x7f3504001150 comp rx=0 tx=0).stop 2023-12-12T09:44:40.607 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:40.606+0000 7f351359e640 1 -- 172.21.15.73:0/2881703993 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f351414e700 msgr2=0x7f3514071150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:40.607 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:40.606+0000 7f351359e640 1 --2- 172.21.15.73:0/2881703993 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f351414e700 0x7f3514071150 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f350c007e40 tx=0x7f350c00e4b0 comp rx=0 tx=0).stop 2023-12-12T09:44:40.608 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:40.606+0000 7f351359e640 1 -- 172.21.15.73:0/2881703993 shutdown_connections 2023-12-12T09:44:40.608 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:40.606+0000 7f351359e640 1 --2- 172.21.15.73:0/2881703993 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f34f406ae40 0x7f34f406d300 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:40.608 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:40.606+0000 7f351359e640 1 --2- 172.21.15.73:0/2881703993 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f351414e700 0x7f3514071150 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:40.608 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:40.606+0000 7f351359e640 1 --2- 172.21.15.73:0/2881703993 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f35140c37b0 0x7f3514070c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:40.608 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:40.606+0000 7f351359e640 1 --2- 172.21.15.73:0/2881703993 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f35140ab4a0 0x7f3514154b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:40.608 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:40.606+0000 7f351359e640 1 -- 172.21.15.73:0/2881703993 >> 172.21.15.73:0/2881703993 conn(0x7f35140c23b0 msgr2=0x7f35140c1020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:44:40.608 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:40.607+0000 7f351359e640 1 -- 172.21.15.73:0/2881703993 shutdown_connections 2023-12-12T09:44:40.608 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:40.607+0000 7f351359e640 1 -- 172.21.15.73:0/2881703993 wait complete. 2023-12-12T09:44:40.627 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-12-12T09:44:40.627 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-12T09:44:40.828 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:40.827+0000 7fcb08e56640 1 Processor -- start 2023-12-12T09:44:40.828 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:40.827+0000 7fcb08e56640 1 -- start start 2023-12-12T09:44:40.830 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:40.828+0000 7fcb08e56640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fcb040c5070 0x7fcb040c40c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:40.830 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:40.828+0000 7fcb08e56640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb04152610 con 0x7fcb0406db70 2023-12-12T09:44:40.830 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:40.828+0000 7fcb08e56640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb041528f0 con 0x7fcb0414fa40 2023-12-12T09:44:40.830 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:40.828+0000 7fcb08e56640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb04152bd0 con 0x7fcb040c5070 2023-12-12T09:44:40.830 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:40.829+0000 7fcafbfff640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7fcb0406db70 0x7fcb040c39b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:44404/0 (socket says 172.21.15.73:44404) 2023-12-12T09:44:40.830 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:40.829+0000 7fcafbfff640 1 -- 172.21.15.73:0/3769092626 learned_addr learned my addr 172.21.15.73:0/3769092626 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-12T09:44:40.832 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:40.829+0000 7fcb01d9b640 1 -- 172.21.15.73:0/3769092626 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1235536159 0 0) 0x7fcb04152610 con 0x7fcb0406db70 2023-12-12T09:44:40.832 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:40.829+0000 7fcb02d9d640 1 --2- 172.21.15.73:0/3769092626 >> v2:172.21.15.142:3300/0 conn(0x7fcb040c5070 0x7fcb040c40c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:40.832 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:40.829+0000 7fcb01d9b640 1 -- 172.21.15.73:0/3769092626 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcaf0003520 con 0x7fcb0406db70 2023-12-12T09:44:40.832 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:40.829+0000 7fcb01d9b640 1 -- 172.21.15.73:0/3769092626 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3406480400 0 0) 0x7fcaf0003520 con 0x7fcb0406db70 2023-12-12T09:44:40.832 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:40.829+0000 7fcb01d9b640 1 -- 172.21.15.73:0/3769092626 >> v2:172.21.15.142:3300/0 conn(0x7fcb040c5070 msgr2=0x7fcb040c40c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:44:40.832 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:40.829+0000 7fcb01d9b640 1 --2- 172.21.15.73:0/3769092626 >> v2:172.21.15.142:3300/0 conn(0x7fcb040c5070 0x7fcb040c40c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:40.832 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:40.830+0000 7fcb01d9b640 1 -- 172.21.15.73:0/3769092626 >> v1:172.21.15.142:6789/0 conn(0x7fcb0414fa40 legacy=0x7fcb0406a4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:40.832 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:40.830+0000 7fcb01d9b640 1 -- 172.21.15.73:0/3769092626 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb04152eb0 con 0x7fcb0406db70 2023-12-12T09:44:40.832 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:40.830+0000 7fcb01d9b640 1 -- 172.21.15.73:0/3769092626 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3186547832 0 0) 0x7fcaec001670 con 0x7fcb0406db70 2023-12-12T09:44:40.832 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:40.830+0000 7fcb01d9b640 1 -- 172.21.15.73:0/3769092626 >> v1:172.21.15.73:6789/0 conn(0x7fcb0406db70 legacy=0x7fcb040c39b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:40.833 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:40.830+0000 7fcb01d9b640 1 --2- 172.21.15.73:0/3769092626 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcaf0003970 0x7fcaf0003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:40.833 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:40.830+0000 7fcb01d9b640 1 --2- 172.21.15.73:0/3769092626 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcaf00047c0 0x7fcaf0004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:40.833 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:40.830+0000 7fcb01d9b640 1 --2- 172.21.15.73:0/3769092626 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcaf0005180 0x7fcaf000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:40.833 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:40.830+0000 7fcb01d9b640 1 -- 172.21.15.73:0/3769092626 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb04152bd0 con 0x7fcaf00047c0 2023-12-12T09:44:40.833 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:40.830+0000 7fcb01d9b640 1 -- 172.21.15.73:0/3769092626 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcaf000c0d0 con 0x7fcaf0005180 2023-12-12T09:44:40.833 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:40.830+0000 7fcb01d9b640 1 -- 172.21.15.73:0/3769092626 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcaf000c290 con 0x7fcaf0003970 2023-12-12T09:44:40.833 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:40.830+0000 7fcafbfff640 1 --2- 172.21.15.73:0/3769092626 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcaf00047c0 0x7fcaf0004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:40.833 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:40.830+0000 7fcb0259c640 1 --2- 172.21.15.73:0/3769092626 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcaf0003970 0x7fcaf0003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:40.833 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:40.830+0000 7fcafbfff640 1 -- 172.21.15.73:0/3769092626 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcaf0003970 msgr2=0x7fcaf0003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:44:40.833 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:40.830+0000 7fcb02d9d640 1 --2- 172.21.15.73:0/3769092626 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcaf0005180 0x7fcaf000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:40.833 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:40.830+0000 7fcafbfff640 1 --2- 172.21.15.73:0/3769092626 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcaf0003970 0x7fcaf0003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:40.833 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:40.830+0000 7fcafbfff640 1 -- 172.21.15.73:0/3769092626 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcaf0005180 msgr2=0x7fcaf000b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:44:40.833 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:40.830+0000 7fcafbfff640 1 --2- 172.21.15.73:0/3769092626 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcaf0005180 0x7fcaf000b980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:40.833 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:40.830+0000 7fcafbfff640 1 -- 172.21.15.73:0/3769092626 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcaf0003520 con 0x7fcaf00047c0 2023-12-12T09:44:40.834 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:40.830+0000 7fcb02d9d640 1 -- 172.21.15.73:0/3769092626 reap_dead start 2023-12-12T09:44:40.834 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:40.830+0000 7fcb0259c640 1 --2- 172.21.15.73:0/3769092626 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcaf0003970 0x7fcaf0003d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:44:40.835 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:40.832+0000 7fcafbfff640 1 --2- 172.21.15.73:0/3769092626 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcaf00047c0 0x7fcaf0004c40 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fcaec00c240 tx=0x7fcaf00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84dd22e610ca1c50 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:44:40.835 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:40.832+0000 7fcb01d9b640 1 -- 172.21.15.73:0/3769092626 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcaec005ad0 con 0x7fcaf00047c0 2023-12-12T09:44:40.835 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:40.832+0000 7fcb01d9b640 1 -- 172.21.15.73:0/3769092626 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcaec005c30 con 0x7fcaf00047c0 2023-12-12T09:44:40.835 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:40.832+0000 7fcb01d9b640 1 -- 172.21.15.73:0/3769092626 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcaec02caf0 con 0x7fcaf00047c0 2023-12-12T09:44:40.835 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:40.832+0000 7fcb08e56640 1 -- 172.21.15.73:0/3769092626 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcaf00047c0 msgr2=0x7fcaf0004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:40.835 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:40.832+0000 7fcb08e56640 1 --2- 172.21.15.73:0/3769092626 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcaf00047c0 0x7fcaf0004c40 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fcaec00c240 tx=0x7fcaf00057f0 comp rx=0 tx=0).stop 2023-12-12T09:44:40.835 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:40.833+0000 7fcb08e56640 1 -- 172.21.15.73:0/3769092626 shutdown_connections 2023-12-12T09:44:40.835 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:40.833+0000 7fcb08e56640 1 --2- 172.21.15.73:0/3769092626 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcaf00047c0 0x7fcaf0004c40 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:40.835 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:40.833+0000 7fcb08e56640 1 -- 172.21.15.73:0/3769092626 >> 172.21.15.73:0/3769092626 conn(0x7fcb040a8130 msgr2=0x7fcb040c24b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:44:40.835 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:40.833+0000 7fcb08e56640 1 -- 172.21.15.73:0/3769092626 shutdown_connections 2023-12-12T09:44:40.835 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:40.833+0000 7fcb08e56640 1 -- 172.21.15.73:0/3769092626 wait complete. 2023-12-12T09:44:40.837 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:40.834+0000 7fcb08e56640 1 Processor -- start 2023-12-12T09:44:40.837 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:40.834+0000 7fcb08e56640 1 -- start start 2023-12-12T09:44:40.837 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:40.835+0000 7fcb08e56640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcaf00047c0 0x7fcb040713e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:40.837 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:40.835+0000 7fcb08e56640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcb041536f0 0x7fcb0414a270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:40.837 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:40.835+0000 7fcb08e56640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcb041eaf20 0x7fcb041eb3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:40.837 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:40.835+0000 7fcb08e56640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb041557b0 con 0x7fcb041536f0 2023-12-12T09:44:40.837 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:40.835+0000 7fcb08e56640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb041eb8e0 con 0x7fcaf00047c0 2023-12-12T09:44:40.837 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:40.835+0000 7fcb08e56640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb0414abc0 con 0x7fcb041eaf20 2023-12-12T09:44:40.837 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:40.836+0000 7fcafbfff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcb041536f0 0x7fcb0414a270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:40.837 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:40.836+0000 7fcafbfff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcb041536f0 0x7fcb0414a270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:52690/0 (socket says 172.21.15.73:52690) 2023-12-12T09:44:40.837 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:40.836+0000 7fcafbfff640 1 -- 172.21.15.73:0/1637277223 learned_addr learned my addr 172.21.15.73:0/1637277223 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:44:40.839 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:40.836+0000 7fcafbfff640 1 -- 172.21.15.73:0/1637277223 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcb041eaf20 msgr2=0x7fcb041eb3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:40.839 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:40.836+0000 7fcafbfff640 1 --2- 172.21.15.73:0/1637277223 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcb041eaf20 0x7fcb041eb3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:40.839 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:40.836+0000 7fcafbfff640 1 -- 172.21.15.73:0/1637277223 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcaf00047c0 msgr2=0x7fcb040713e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:40.839 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:40.836+0000 7fcafbfff640 1 --2- 172.21.15.73:0/1637277223 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcaf00047c0 0x7fcb040713e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:40.839 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:40.836+0000 7fcafbfff640 1 -- 172.21.15.73:0/1637277223 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb04071a70 con 0x7fcb041536f0 2023-12-12T09:44:40.839 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:40.836+0000 7fcafbfff640 1 --2- 172.21.15.73:0/1637277223 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcb041536f0 0x7fcb0414a270 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fcaec001930 tx=0x7fcaec02e070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:44:40.839 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:40.837+0000 7fcafaffd640 1 -- 172.21.15.73:0/1637277223 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcaec03c040 con 0x7fcb041536f0 2023-12-12T09:44:40.839 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:40.837+0000 7fcafaffd640 1 -- 172.21.15.73:0/1637277223 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcaec02cd80 con 0x7fcb041536f0 2023-12-12T09:44:40.839 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:40.837+0000 7fcb08e56640 1 -- 172.21.15.73:0/1637277223 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb04071d50 con 0x7fcb041536f0 2023-12-12T09:44:40.839 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:40.837+0000 7fcafaffd640 1 -- 172.21.15.73:0/1637277223 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcaec007290 con 0x7fcb041536f0 2023-12-12T09:44:40.839 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:40.837+0000 7fcb08e56640 1 -- 172.21.15.73:0/1637277223 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb04155440 con 0x7fcb041536f0 2023-12-12T09:44:40.840 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:40.838+0000 7fcb08e56640 1 -- 172.21.15.73:0/1637277223 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb041555d0 con 0x7fcb041536f0 2023-12-12T09:44:40.840 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:40.839+0000 7fcafaffd640 1 -- 172.21.15.73:0/1637277223 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fcaec032070 con 0x7fcb041536f0 2023-12-12T09:44:40.841 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:40.840+0000 7fcafaffd640 1 --2- 172.21.15.73:0/1637277223 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fcae406ae70 0x7fcae406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:40.841 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:40.840+0000 7fcafaffd640 1 -- 172.21.15.73:0/1637277223 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fcaec0aae70 con 0x7fcb041536f0 2023-12-12T09:44:40.841 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:40.840+0000 7fcb0259c640 1 --2- 172.21.15.73:0/1637277223 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fcae406ae70 0x7fcae406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:40.841 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:40.841+0000 7fcb0259c640 1 --2- 172.21.15.73:0/1637277223 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fcae406ae70 0x7fcae406d330 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fcaf4007fd0 tx=0x7fcaf4009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:44:40.845 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:40.844+0000 7fcafaffd640 1 -- 172.21.15.73:0/1637277223 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fcaec075bb0 con 0x7fcb041536f0 2023-12-12T09:44:41.031 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:41.030+0000 7fcb08e56640 1 -- 172.21.15.73:0/1637277223 --> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fcb0414fe20 con 0x7fcae406ae70 2023-12-12T09:44:41.073 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:41.072+0000 7fcafaffd640 1 -- 172.21.15.73:0/1637277223 <== mgr.4110 v2:172.21.15.73:6832/779985841 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+510797 (secure 0 0 0) 0x7fcaf40123d0 con 0x7fcae406ae70 2023-12-12T09:44:41.082 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-12T09:44:41.086 INFO:teuthology.orchestra.run.smithi073.stderr:dumped all 2023-12-12T09:44:41.088 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:41.079+0000 7fcb08e56640 1 -- 172.21.15.73:0/1637277223 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fcae406ae70 msgr2=0x7fcae406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:41.088 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:41.079+0000 7fcb08e56640 1 --2- 172.21.15.73:0/1637277223 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fcae406ae70 0x7fcae406d330 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fcaf4007fd0 tx=0x7fcaf4009040 comp rx=0 tx=0).stop 2023-12-12T09:44:41.088 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:41.079+0000 7fcb08e56640 1 -- 172.21.15.73:0/1637277223 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcb041536f0 msgr2=0x7fcb0414a270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:41.088 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:41.079+0000 7fcb08e56640 1 --2- 172.21.15.73:0/1637277223 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcb041536f0 0x7fcb0414a270 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fcaec001930 tx=0x7fcaec02e070 comp rx=0 tx=0).stop 2023-12-12T09:44:41.088 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:41.079+0000 7fcb08e56640 1 -- 172.21.15.73:0/1637277223 shutdown_connections 2023-12-12T09:44:41.089 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:41.079+0000 7fcb08e56640 1 --2- 172.21.15.73:0/1637277223 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fcae406ae70 0x7fcae406d330 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:41.089 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:41.079+0000 7fcb08e56640 1 --2- 172.21.15.73:0/1637277223 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcb041eaf20 0x7fcb041eb3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:41.089 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:41.079+0000 7fcb08e56640 1 --2- 172.21.15.73:0/1637277223 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcb041536f0 0x7fcb0414a270 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:41.089 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:41.079+0000 7fcb08e56640 1 --2- 172.21.15.73:0/1637277223 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcaf00047c0 0x7fcb040713e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:41.089 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:41.079+0000 7fcb08e56640 1 -- 172.21.15.73:0/1637277223 >> 172.21.15.73:0/1637277223 conn(0x7fcb040a8130 msgr2=0x7fcb040c5ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:44:41.089 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:41.080+0000 7fcb08e56640 1 -- 172.21.15.73:0/1637277223 shutdown_connections 2023-12-12T09:44:41.089 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:41.080+0000 7fcb08e56640 1 -- 172.21.15.73:0/1637277223 wait complete. 2023-12-12T09:44:41.101 INFO:teuthology.orchestra.run.smithi073.stdout:{"pg_ready":true,"pg_map":{"version":74,"stamp":"2023-12-12T09:44:39.479364+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594273,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":206,"num_write_kb":2433,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":158,"ondisk_log_size":158,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219368,"kb_used_data":3200,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755352,"statfs":{"total":773094113280,"available":772869480448,"internally_reserved":0,"allocated":3276800,"data_stored":2394722,"data_compressed":64844,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.863094"},"pg_stats":[{"pgid":"7.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-12T09:44:35.613810+0000","last_change":"2023-12-12T09:44:35.613810+0000","last_active":"2023-12-12T09:44:35.613810+0000","last_peered":"2023-12-12T09:44:35.613810+0000","last_clean":"2023-12-12T09:44:35.613810+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:44:35.613810+0000","last_undegraded":"2023-12-12T09:44:35.613810+0000","last_fullsized":"2023-12-12T09:44:35.613810+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:35.613810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:35.613810+0000","last_clean_scrub_stamp":"2023-12-12T09:44:35.613810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":176,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-12T09:44:21.512754+0000","last_change":"2023-12-12T09:43:17.203315+0000","last_active":"2023-12-12T09:44:21.512754+0000","last_peered":"2023-12-12T09:44:21.512754+0000","last_clean":"2023-12-12T09:44:21.512754+0000","last_became_active":"2023-12-12T09:43:17.200779+0000","last_became_peered":"2023-12-12T09:43:17.200779+0000","last_unstale":"2023-12-12T09:44:21.512754+0000","last_undegraded":"2023-12-12T09:44:21.512754+0000","last_fullsized":"2023-12-12T09:44:21.512754+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:43:15.931922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:43:15.931922+0000","last_clean_scrub_stamp":"2023-12-12T09:43:15.931922+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T21:42:10.929640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-12T09:44:21.507274+0000","last_change":"2023-12-12T09:44:20.519204+0000","last_active":"2023-12-12T09:44:21.507274+0000","last_peered":"2023-12-12T09:44:21.507274+0000","last_clean":"2023-12-12T09:44:21.507274+0000","last_became_active":"2023-12-12T09:44:20.518590+0000","last_became_peered":"2023-12-12T09:44:20.518590+0000","last_unstale":"2023-12-12T09:44:21.507274+0000","last_undegraded":"2023-12-12T09:44:21.507274+0000","last_fullsized":"2023-12-12T09:44:21.507274+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:19.449520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:19.449520+0000","last_clean_scrub_stamp":"2023-12-12T09:44:19.449520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T16:04:09.402682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-12T09:44:22.513812+0000","last_change":"2023-12-12T09:44:21.525532+0000","last_active":"2023-12-12T09:44:22.513812+0000","last_peered":"2023-12-12T09:44:22.513812+0000","last_clean":"2023-12-12T09:44:22.513812+0000","last_became_active":"2023-12-12T09:44:21.521828+0000","last_became_peered":"2023-12-12T09:44:21.521828+0000","last_unstale":"2023-12-12T09:44:22.513812+0000","last_undegraded":"2023-12-12T09:44:22.513812+0000","last_fullsized":"2023-12-12T09:44:22.513812+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_clean_scrub_stamp":"2023-12-12T09:44:20.465592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T13:05:01.026963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-12T09:44:34.598834+0000","last_change":"2023-12-12T09:44:34.598834+0000","last_active":"2023-12-12T09:44:34.598834+0000","last_peered":"2023-12-12T09:44:34.598834+0000","last_clean":"2023-12-12T09:44:34.598834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:44:34.598834+0000","last_undegraded":"2023-12-12T09:44:34.598834+0000","last_fullsized":"2023-12-12T09:44:34.598834+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:34.598834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:34.598834+0000","last_clean_scrub_stamp":"2023-12-12T09:44:34.598834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-12T09:44:35.613810+0000","last_change":"2023-12-12T09:44:35.613810+0000","last_active":"2023-12-12T09:44:35.613810+0000","last_peered":"2023-12-12T09:44:35.613810+0000","last_clean":"2023-12-12T09:44:35.613810+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:44:35.613810+0000","last_undegraded":"2023-12-12T09:44:35.613810+0000","last_fullsized":"2023-12-12T09:44:35.613810+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:35.613810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:35.613810+0000","last_clean_scrub_stamp":"2023-12-12T09:44:35.613810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-12T09:44:21.496636+0000","last_change":"2023-12-12T09:44:20.514669+0000","last_active":"2023-12-12T09:44:21.496636+0000","last_peered":"2023-12-12T09:44:21.496636+0000","last_clean":"2023-12-12T09:44:21.496636+0000","last_became_active":"2023-12-12T09:44:20.514346+0000","last_became_peered":"2023-12-12T09:44:20.514346+0000","last_unstale":"2023-12-12T09:44:21.496636+0000","last_undegraded":"2023-12-12T09:44:21.496636+0000","last_fullsized":"2023-12-12T09:44:21.496636+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:19.449520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:19.449520+0000","last_clean_scrub_stamp":"2023-12-12T09:44:19.449520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T12:21:36.280435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-12T09:44:24.019975+0000","last_change":"2023-12-12T09:44:21.530146+0000","last_active":"2023-12-12T09:44:24.019975+0000","last_peered":"2023-12-12T09:44:24.019975+0000","last_clean":"2023-12-12T09:44:24.019975+0000","last_became_active":"2023-12-12T09:44:21.526991+0000","last_became_peered":"2023-12-12T09:44:21.526991+0000","last_unstale":"2023-12-12T09:44:24.019975+0000","last_undegraded":"2023-12-12T09:44:24.019975+0000","last_fullsized":"2023-12-12T09:44:24.019975+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_clean_scrub_stamp":"2023-12-12T09:44:20.465592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T21:42:36.877781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-12T09:44:34.598834+0000","last_change":"2023-12-12T09:44:34.598834+0000","last_active":"2023-12-12T09:44:34.598834+0000","last_peered":"2023-12-12T09:44:34.598834+0000","last_clean":"2023-12-12T09:44:34.598834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:44:34.598834+0000","last_undegraded":"2023-12-12T09:44:34.598834+0000","last_fullsized":"2023-12-12T09:44:34.598834+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:34.598834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:34.598834+0000","last_clean_scrub_stamp":"2023-12-12T09:44:34.598834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-12T09:44:35.613810+0000","last_change":"2023-12-12T09:44:35.613810+0000","last_active":"2023-12-12T09:44:35.613810+0000","last_peered":"2023-12-12T09:44:35.613810+0000","last_clean":"2023-12-12T09:44:35.613810+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:44:35.613810+0000","last_undegraded":"2023-12-12T09:44:35.613810+0000","last_fullsized":"2023-12-12T09:44:35.613810+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:35.613810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:35.613810+0000","last_clean_scrub_stamp":"2023-12-12T09:44:35.613810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-12T09:44:21.499858+0000","last_change":"2023-12-12T09:44:20.508411+0000","last_active":"2023-12-12T09:44:21.499858+0000","last_peered":"2023-12-12T09:44:21.499858+0000","last_clean":"2023-12-12T09:44:21.499858+0000","last_became_active":"2023-12-12T09:44:20.508071+0000","last_became_peered":"2023-12-12T09:44:20.508071+0000","last_unstale":"2023-12-12T09:44:21.499858+0000","last_undegraded":"2023-12-12T09:44:21.499858+0000","last_fullsized":"2023-12-12T09:44:21.499858+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:19.449520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:19.449520+0000","last_clean_scrub_stamp":"2023-12-12T09:44:19.449520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T19:38:07.725951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-12T09:44:22.508601+0000","last_change":"2023-12-12T09:44:21.529727+0000","last_active":"2023-12-12T09:44:22.508601+0000","last_peered":"2023-12-12T09:44:22.508601+0000","last_clean":"2023-12-12T09:44:22.508601+0000","last_became_active":"2023-12-12T09:44:21.528750+0000","last_became_peered":"2023-12-12T09:44:21.528750+0000","last_unstale":"2023-12-12T09:44:22.508601+0000","last_undegraded":"2023-12-12T09:44:22.508601+0000","last_fullsized":"2023-12-12T09:44:22.508601+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_clean_scrub_stamp":"2023-12-12T09:44:20.465592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T10:50:32.155095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-12T09:44:34.598834+0000","last_change":"2023-12-12T09:44:34.598834+0000","last_active":"2023-12-12T09:44:34.598834+0000","last_peered":"2023-12-12T09:44:34.598834+0000","last_clean":"2023-12-12T09:44:34.598834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:44:34.598834+0000","last_undegraded":"2023-12-12T09:44:34.598834+0000","last_fullsized":"2023-12-12T09:44:34.598834+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:34.598834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:34.598834+0000","last_clean_scrub_stamp":"2023-12-12T09:44:34.598834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-12T09:44:35.613810+0000","last_change":"2023-12-12T09:44:35.613810+0000","last_active":"2023-12-12T09:44:35.613810+0000","last_peered":"2023-12-12T09:44:35.613810+0000","last_clean":"2023-12-12T09:44:35.613810+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:44:35.613810+0000","last_undegraded":"2023-12-12T09:44:35.613810+0000","last_fullsized":"2023-12-12T09:44:35.613810+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:35.613810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:35.613810+0000","last_clean_scrub_stamp":"2023-12-12T09:44:35.613810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-12T09:44:21.498144+0000","last_change":"2023-12-12T09:44:20.512148+0000","last_active":"2023-12-12T09:44:21.498144+0000","last_peered":"2023-12-12T09:44:21.498144+0000","last_clean":"2023-12-12T09:44:21.498144+0000","last_became_active":"2023-12-12T09:44:20.510963+0000","last_became_peered":"2023-12-12T09:44:20.510963+0000","last_unstale":"2023-12-12T09:44:21.498144+0000","last_undegraded":"2023-12-12T09:44:21.498144+0000","last_fullsized":"2023-12-12T09:44:21.498144+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:19.449520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:19.449520+0000","last_clean_scrub_stamp":"2023-12-12T09:44:19.449520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T19:38:07.725951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-12T09:44:24.019623+0000","last_change":"2023-12-12T09:44:21.513642+0000","last_active":"2023-12-12T09:44:24.019623+0000","last_peered":"2023-12-12T09:44:24.019623+0000","last_clean":"2023-12-12T09:44:24.019623+0000","last_became_active":"2023-12-12T09:44:21.513346+0000","last_became_peered":"2023-12-12T09:44:21.513346+0000","last_unstale":"2023-12-12T09:44:24.019623+0000","last_undegraded":"2023-12-12T09:44:24.019623+0000","last_fullsized":"2023-12-12T09:44:24.019623+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_clean_scrub_stamp":"2023-12-12T09:44:20.465592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T21:19:34.161140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-12T09:44:34.598834+0000","last_change":"2023-12-12T09:44:34.598834+0000","last_active":"2023-12-12T09:44:34.598834+0000","last_peered":"2023-12-12T09:44:34.598834+0000","last_clean":"2023-12-12T09:44:34.598834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:44:34.598834+0000","last_undegraded":"2023-12-12T09:44:34.598834+0000","last_fullsized":"2023-12-12T09:44:34.598834+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:34.598834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:34.598834+0000","last_clean_scrub_stamp":"2023-12-12T09:44:34.598834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-12T09:44:35.613810+0000","last_change":"2023-12-12T09:44:35.613810+0000","last_active":"2023-12-12T09:44:35.613810+0000","last_peered":"2023-12-12T09:44:35.613810+0000","last_clean":"2023-12-12T09:44:35.613810+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:44:35.613810+0000","last_undegraded":"2023-12-12T09:44:35.613810+0000","last_fullsized":"2023-12-12T09:44:35.613810+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:35.613810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:35.613810+0000","last_clean_scrub_stamp":"2023-12-12T09:44:35.613810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-12T09:44:21.488692+0000","last_change":"2023-12-12T09:44:20.506663+0000","last_active":"2023-12-12T09:44:21.488692+0000","last_peered":"2023-12-12T09:44:21.488692+0000","last_clean":"2023-12-12T09:44:21.488692+0000","last_became_active":"2023-12-12T09:44:20.506077+0000","last_became_peered":"2023-12-12T09:44:20.506077+0000","last_unstale":"2023-12-12T09:44:21.488692+0000","last_undegraded":"2023-12-12T09:44:21.488692+0000","last_fullsized":"2023-12-12T09:44:21.488692+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:19.449520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:19.449520+0000","last_clean_scrub_stamp":"2023-12-12T09:44:19.449520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T19:16:24.812720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-12T09:44:22.686138+0000","last_change":"2023-12-12T09:44:21.518935+0000","last_active":"2023-12-12T09:44:22.686138+0000","last_peered":"2023-12-12T09:44:22.686138+0000","last_clean":"2023-12-12T09:44:22.686138+0000","last_became_active":"2023-12-12T09:44:21.518647+0000","last_became_peered":"2023-12-12T09:44:21.518647+0000","last_unstale":"2023-12-12T09:44:22.686138+0000","last_undegraded":"2023-12-12T09:44:22.686138+0000","last_fullsized":"2023-12-12T09:44:22.686138+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_clean_scrub_stamp":"2023-12-12T09:44:20.465592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T19:38:08.742023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-12T09:44:34.598834+0000","last_change":"2023-12-12T09:44:34.598834+0000","last_active":"2023-12-12T09:44:34.598834+0000","last_peered":"2023-12-12T09:44:34.598834+0000","last_clean":"2023-12-12T09:44:34.598834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:44:34.598834+0000","last_undegraded":"2023-12-12T09:44:34.598834+0000","last_fullsized":"2023-12-12T09:44:34.598834+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:34.598834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:34.598834+0000","last_clean_scrub_stamp":"2023-12-12T09:44:34.598834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-12T09:44:35.613810+0000","last_change":"2023-12-12T09:44:35.613810+0000","last_active":"2023-12-12T09:44:35.613810+0000","last_peered":"2023-12-12T09:44:35.613810+0000","last_clean":"2023-12-12T09:44:35.613810+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:44:35.613810+0000","last_undegraded":"2023-12-12T09:44:35.613810+0000","last_fullsized":"2023-12-12T09:44:35.613810+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:35.613810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:35.613810+0000","last_clean_scrub_stamp":"2023-12-12T09:44:35.613810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-12T09:44:21.503969+0000","last_change":"2023-12-12T09:44:20.511329+0000","last_active":"2023-12-12T09:44:21.503969+0000","last_peered":"2023-12-12T09:44:21.503969+0000","last_clean":"2023-12-12T09:44:21.503969+0000","last_became_active":"2023-12-12T09:44:20.510982+0000","last_became_peered":"2023-12-12T09:44:20.510982+0000","last_unstale":"2023-12-12T09:44:21.503969+0000","last_undegraded":"2023-12-12T09:44:21.503969+0000","last_fullsized":"2023-12-12T09:44:21.503969+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:19.449520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:19.449520+0000","last_clean_scrub_stamp":"2023-12-12T09:44:19.449520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T10:43:47.019227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-12T09:44:24.019990+0000","last_change":"2023-12-12T09:44:21.515107+0000","last_active":"2023-12-12T09:44:24.019990+0000","last_peered":"2023-12-12T09:44:24.019990+0000","last_clean":"2023-12-12T09:44:24.019990+0000","last_became_active":"2023-12-12T09:44:21.514827+0000","last_became_peered":"2023-12-12T09:44:21.514827+0000","last_unstale":"2023-12-12T09:44:24.019990+0000","last_undegraded":"2023-12-12T09:44:24.019990+0000","last_fullsized":"2023-12-12T09:44:24.019990+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_clean_scrub_stamp":"2023-12-12T09:44:20.465592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T10:43:48.035299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-12T09:44:34.598834+0000","last_change":"2023-12-12T09:44:34.598834+0000","last_active":"2023-12-12T09:44:34.598834+0000","last_peered":"2023-12-12T09:44:34.598834+0000","last_clean":"2023-12-12T09:44:34.598834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:44:34.598834+0000","last_undegraded":"2023-12-12T09:44:34.598834+0000","last_fullsized":"2023-12-12T09:44:34.598834+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:34.598834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:34.598834+0000","last_clean_scrub_stamp":"2023-12-12T09:44:34.598834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-12T09:44:35.613810+0000","last_change":"2023-12-12T09:44:35.613810+0000","last_active":"2023-12-12T09:44:35.613810+0000","last_peered":"2023-12-12T09:44:35.613810+0000","last_clean":"2023-12-12T09:44:35.613810+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:44:35.613810+0000","last_undegraded":"2023-12-12T09:44:35.613810+0000","last_fullsized":"2023-12-12T09:44:35.613810+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:35.613810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:35.613810+0000","last_clean_scrub_stamp":"2023-12-12T09:44:35.613810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.6","version":"34'1","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-12T09:44:24.020418+0000","last_change":"2023-12-12T09:44:20.505916+0000","last_active":"2023-12-12T09:44:24.020418+0000","last_peered":"2023-12-12T09:44:24.020418+0000","last_clean":"2023-12-12T09:44:24.020418+0000","last_became_active":"2023-12-12T09:44:20.505632+0000","last_became_peered":"2023-12-12T09:44:20.505632+0000","last_unstale":"2023-12-12T09:44:24.020418+0000","last_undegraded":"2023-12-12T09:44:24.020418+0000","last_fullsized":"2023-12-12T09:44:24.020418+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:19.449520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:19.449520+0000","last_clean_scrub_stamp":"2023-12-12T09:44:19.449520+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T12:00:32.399540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-12T09:44:22.516242+0000","last_change":"2023-12-12T09:44:21.521339+0000","last_active":"2023-12-12T09:44:22.516242+0000","last_peered":"2023-12-12T09:44:22.516242+0000","last_clean":"2023-12-12T09:44:22.516242+0000","last_became_active":"2023-12-12T09:44:21.521079+0000","last_became_peered":"2023-12-12T09:44:21.521079+0000","last_unstale":"2023-12-12T09:44:22.516242+0000","last_undegraded":"2023-12-12T09:44:22.516242+0000","last_fullsized":"2023-12-12T09:44:22.516242+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_clean_scrub_stamp":"2023-12-12T09:44:20.465592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T21:03:17.881060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-12T09:44:34.598834+0000","last_change":"2023-12-12T09:44:34.598834+0000","last_active":"2023-12-12T09:44:34.598834+0000","last_peered":"2023-12-12T09:44:34.598834+0000","last_clean":"2023-12-12T09:44:34.598834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:44:34.598834+0000","last_undegraded":"2023-12-12T09:44:34.598834+0000","last_fullsized":"2023-12-12T09:44:34.598834+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:34.598834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:34.598834+0000","last_clean_scrub_stamp":"2023-12-12T09:44:34.598834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-12T09:44:35.613810+0000","last_change":"2023-12-12T09:44:35.613810+0000","last_active":"2023-12-12T09:44:35.613810+0000","last_peered":"2023-12-12T09:44:35.613810+0000","last_clean":"2023-12-12T09:44:35.613810+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:44:35.613810+0000","last_undegraded":"2023-12-12T09:44:35.613810+0000","last_fullsized":"2023-12-12T09:44:35.613810+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:35.613810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:35.613810+0000","last_clean_scrub_stamp":"2023-12-12T09:44:35.613810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.7","version":"33'2","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-12T09:44:21.535958+0000","last_change":"2023-12-12T09:44:20.511011+0000","last_active":"2023-12-12T09:44:21.535958+0000","last_peered":"2023-12-12T09:44:21.535958+0000","last_clean":"2023-12-12T09:44:21.535958+0000","last_became_active":"2023-12-12T09:44:20.510709+0000","last_became_peered":"2023-12-12T09:44:20.510709+0000","last_unstale":"2023-12-12T09:44:21.535958+0000","last_undegraded":"2023-12-12T09:44:21.535958+0000","last_fullsized":"2023-12-12T09:44:21.535958+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:19.449520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:19.449520+0000","last_clean_scrub_stamp":"2023-12-12T09:44:19.449520+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T12:49:11.267636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-12T09:44:24.022357+0000","last_change":"2023-12-12T09:44:21.521774+0000","last_active":"2023-12-12T09:44:24.022357+0000","last_peered":"2023-12-12T09:44:24.022357+0000","last_clean":"2023-12-12T09:44:24.022357+0000","last_became_active":"2023-12-12T09:44:21.521431+0000","last_became_peered":"2023-12-12T09:44:21.521431+0000","last_unstale":"2023-12-12T09:44:24.022357+0000","last_undegraded":"2023-12-12T09:44:24.022357+0000","last_fullsized":"2023-12-12T09:44:24.022357+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_clean_scrub_stamp":"2023-12-12T09:44:20.465592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T19:05:15.078557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-12T09:44:34.598834+0000","last_change":"2023-12-12T09:44:34.598834+0000","last_active":"2023-12-12T09:44:34.598834+0000","last_peered":"2023-12-12T09:44:34.598834+0000","last_clean":"2023-12-12T09:44:34.598834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:44:34.598834+0000","last_undegraded":"2023-12-12T09:44:34.598834+0000","last_fullsized":"2023-12-12T09:44:34.598834+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:34.598834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:34.598834+0000","last_clean_scrub_stamp":"2023-12-12T09:44:34.598834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-12T09:44:35.613810+0000","last_change":"2023-12-12T09:44:35.613810+0000","last_active":"2023-12-12T09:44:35.613810+0000","last_peered":"2023-12-12T09:44:35.613810+0000","last_clean":"2023-12-12T09:44:35.613810+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:44:35.613810+0000","last_undegraded":"2023-12-12T09:44:35.613810+0000","last_fullsized":"2023-12-12T09:44:35.613810+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:35.613810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:35.613810+0000","last_clean_scrub_stamp":"2023-12-12T09:44:35.613810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-12T09:44:21.503960+0000","last_change":"2023-12-12T09:44:20.519234+0000","last_active":"2023-12-12T09:44:21.503960+0000","last_peered":"2023-12-12T09:44:21.503960+0000","last_clean":"2023-12-12T09:44:21.503960+0000","last_became_active":"2023-12-12T09:44:20.518728+0000","last_became_peered":"2023-12-12T09:44:20.518728+0000","last_unstale":"2023-12-12T09:44:21.503960+0000","last_undegraded":"2023-12-12T09:44:21.503960+0000","last_fullsized":"2023-12-12T09:44:21.503960+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:19.449520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:19.449520+0000","last_clean_scrub_stamp":"2023-12-12T09:44:19.449520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T14:50:34.872309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-12T09:44:22.513495+0000","last_change":"2023-12-12T09:44:21.527012+0000","last_active":"2023-12-12T09:44:22.513495+0000","last_peered":"2023-12-12T09:44:22.513495+0000","last_clean":"2023-12-12T09:44:22.513495+0000","last_became_active":"2023-12-12T09:44:21.525770+0000","last_became_peered":"2023-12-12T09:44:21.525770+0000","last_unstale":"2023-12-12T09:44:22.513495+0000","last_undegraded":"2023-12-12T09:44:22.513495+0000","last_fullsized":"2023-12-12T09:44:22.513495+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_clean_scrub_stamp":"2023-12-12T09:44:20.465592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T10:50:32.155095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-12T09:44:34.598834+0000","last_change":"2023-12-12T09:44:34.598834+0000","last_active":"2023-12-12T09:44:34.598834+0000","last_peered":"2023-12-12T09:44:34.598834+0000","last_clean":"2023-12-12T09:44:34.598834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:44:34.598834+0000","last_undegraded":"2023-12-12T09:44:34.598834+0000","last_fullsized":"2023-12-12T09:44:34.598834+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:34.598834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:34.598834+0000","last_clean_scrub_stamp":"2023-12-12T09:44:34.598834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-12T09:44:35.613810+0000","last_change":"2023-12-12T09:44:35.613810+0000","last_active":"2023-12-12T09:44:35.613810+0000","last_peered":"2023-12-12T09:44:35.613810+0000","last_clean":"2023-12-12T09:44:35.613810+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:44:35.613810+0000","last_undegraded":"2023-12-12T09:44:35.613810+0000","last_fullsized":"2023-12-12T09:44:35.613810+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:35.613810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:35.613810+0000","last_clean_scrub_stamp":"2023-12-12T09:44:35.613810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-12T09:44:21.500123+0000","last_change":"2023-12-12T09:44:20.509876+0000","last_active":"2023-12-12T09:44:21.500123+0000","last_peered":"2023-12-12T09:44:21.500123+0000","last_clean":"2023-12-12T09:44:21.500123+0000","last_became_active":"2023-12-12T09:44:20.509580+0000","last_became_peered":"2023-12-12T09:44:20.509580+0000","last_unstale":"2023-12-12T09:44:21.500123+0000","last_undegraded":"2023-12-12T09:44:21.500123+0000","last_fullsized":"2023-12-12T09:44:21.500123+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:19.449520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:19.449520+0000","last_clean_scrub_stamp":"2023-12-12T09:44:19.449520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T12:00:32.399540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-12T09:44:24.023156+0000","last_change":"2023-12-12T09:44:21.508562+0000","last_active":"2023-12-12T09:44:24.023156+0000","last_peered":"2023-12-12T09:44:24.023156+0000","last_clean":"2023-12-12T09:44:24.023156+0000","last_became_active":"2023-12-12T09:44:21.508207+0000","last_became_peered":"2023-12-12T09:44:21.508207+0000","last_unstale":"2023-12-12T09:44:24.023156+0000","last_undegraded":"2023-12-12T09:44:24.023156+0000","last_fullsized":"2023-12-12T09:44:24.023156+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_clean_scrub_stamp":"2023-12-12T09:44:20.465592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T14:54:55.495724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-12T09:44:34.598834+0000","last_change":"2023-12-12T09:44:34.598834+0000","last_active":"2023-12-12T09:44:34.598834+0000","last_peered":"2023-12-12T09:44:34.598834+0000","last_clean":"2023-12-12T09:44:34.598834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:44:34.598834+0000","last_undegraded":"2023-12-12T09:44:34.598834+0000","last_fullsized":"2023-12-12T09:44:34.598834+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:34.598834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:34.598834+0000","last_clean_scrub_stamp":"2023-12-12T09:44:34.598834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-12T09:44:35.613810+0000","last_change":"2023-12-12T09:44:35.613810+0000","last_active":"2023-12-12T09:44:35.613810+0000","last_peered":"2023-12-12T09:44:35.613810+0000","last_clean":"2023-12-12T09:44:35.613810+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:44:35.613810+0000","last_undegraded":"2023-12-12T09:44:35.613810+0000","last_fullsized":"2023-12-12T09:44:35.613810+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:35.613810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:35.613810+0000","last_clean_scrub_stamp":"2023-12-12T09:44:35.613810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-12T09:44:21.507039+0000","last_change":"2023-12-12T09:44:20.515913+0000","last_active":"2023-12-12T09:44:21.507039+0000","last_peered":"2023-12-12T09:44:21.507039+0000","last_clean":"2023-12-12T09:44:21.507039+0000","last_became_active":"2023-12-12T09:44:20.515642+0000","last_became_peered":"2023-12-12T09:44:20.515642+0000","last_unstale":"2023-12-12T09:44:21.507039+0000","last_undegraded":"2023-12-12T09:44:21.507039+0000","last_fullsized":"2023-12-12T09:44:21.507039+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:19.449520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:19.449520+0000","last_clean_scrub_stamp":"2023-12-12T09:44:19.449520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T21:18:35.916411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-12T09:44:24.021829+0000","last_change":"2023-12-12T09:44:21.511615+0000","last_active":"2023-12-12T09:44:24.021829+0000","last_peered":"2023-12-12T09:44:24.021829+0000","last_clean":"2023-12-12T09:44:24.021829+0000","last_became_active":"2023-12-12T09:44:21.509251+0000","last_became_peered":"2023-12-12T09:44:21.509251+0000","last_unstale":"2023-12-12T09:44:24.021829+0000","last_undegraded":"2023-12-12T09:44:24.021829+0000","last_fullsized":"2023-12-12T09:44:24.021829+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_clean_scrub_stamp":"2023-12-12T09:44:20.465592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T19:18:46.146779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-12T09:44:34.598834+0000","last_change":"2023-12-12T09:44:34.598834+0000","last_active":"2023-12-12T09:44:34.598834+0000","last_peered":"2023-12-12T09:44:34.598834+0000","last_clean":"2023-12-12T09:44:34.598834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:44:34.598834+0000","last_undegraded":"2023-12-12T09:44:34.598834+0000","last_fullsized":"2023-12-12T09:44:34.598834+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:34.598834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:34.598834+0000","last_clean_scrub_stamp":"2023-12-12T09:44:34.598834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-12T09:44:35.613810+0000","last_change":"2023-12-12T09:44:35.613810+0000","last_active":"2023-12-12T09:44:35.613810+0000","last_peered":"2023-12-12T09:44:35.613810+0000","last_clean":"2023-12-12T09:44:35.613810+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:44:35.613810+0000","last_undegraded":"2023-12-12T09:44:35.613810+0000","last_fullsized":"2023-12-12T09:44:35.613810+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:35.613810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:35.613810+0000","last_clean_scrub_stamp":"2023-12-12T09:44:35.613810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.b","version":"33'2","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-12T09:44:21.515512+0000","last_change":"2023-12-12T09:44:20.506834+0000","last_active":"2023-12-12T09:44:21.515512+0000","last_peered":"2023-12-12T09:44:21.515512+0000","last_clean":"2023-12-12T09:44:21.515512+0000","last_became_active":"2023-12-12T09:44:20.506432+0000","last_became_peered":"2023-12-12T09:44:20.506432+0000","last_unstale":"2023-12-12T09:44:21.515512+0000","last_undegraded":"2023-12-12T09:44:21.515512+0000","last_fullsized":"2023-12-12T09:44:21.515512+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:19.449520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:19.449520+0000","last_clean_scrub_stamp":"2023-12-12T09:44:19.449520+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T21:18:35.916411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-12T09:44:24.021425+0000","last_change":"2023-12-12T09:44:21.529516+0000","last_active":"2023-12-12T09:44:24.021425+0000","last_peered":"2023-12-12T09:44:24.021425+0000","last_clean":"2023-12-12T09:44:24.021425+0000","last_became_active":"2023-12-12T09:44:21.528160+0000","last_became_peered":"2023-12-12T09:44:21.528160+0000","last_unstale":"2023-12-12T09:44:24.021425+0000","last_undegraded":"2023-12-12T09:44:24.021425+0000","last_fullsized":"2023-12-12T09:44:24.021425+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_clean_scrub_stamp":"2023-12-12T09:44:20.465592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T19:57:06.191557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-12T09:44:34.598834+0000","last_change":"2023-12-12T09:44:34.598834+0000","last_active":"2023-12-12T09:44:34.598834+0000","last_peered":"2023-12-12T09:44:34.598834+0000","last_clean":"2023-12-12T09:44:34.598834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:44:34.598834+0000","last_undegraded":"2023-12-12T09:44:34.598834+0000","last_fullsized":"2023-12-12T09:44:34.598834+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:34.598834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:34.598834+0000","last_clean_scrub_stamp":"2023-12-12T09:44:34.598834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-12T09:44:35.613810+0000","last_change":"2023-12-12T09:44:35.613810+0000","last_active":"2023-12-12T09:44:35.613810+0000","last_peered":"2023-12-12T09:44:35.613810+0000","last_clean":"2023-12-12T09:44:35.613810+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:44:35.613810+0000","last_undegraded":"2023-12-12T09:44:35.613810+0000","last_fullsized":"2023-12-12T09:44:35.613810+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:35.613810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:35.613810+0000","last_clean_scrub_stamp":"2023-12-12T09:44:35.613810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-12T09:44:21.499026+0000","last_change":"2023-12-12T09:44:20.507016+0000","last_active":"2023-12-12T09:44:21.499026+0000","last_peered":"2023-12-12T09:44:21.499026+0000","last_clean":"2023-12-12T09:44:21.499026+0000","last_became_active":"2023-12-12T09:44:20.506728+0000","last_became_peered":"2023-12-12T09:44:20.506728+0000","last_unstale":"2023-12-12T09:44:21.499026+0000","last_undegraded":"2023-12-12T09:44:21.499026+0000","last_fullsized":"2023-12-12T09:44:21.499026+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:19.449520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:19.449520+0000","last_clean_scrub_stamp":"2023-12-12T09:44:19.449520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T20:21:31.990503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-12T09:44:24.021650+0000","last_change":"2023-12-12T09:44:21.508894+0000","last_active":"2023-12-12T09:44:24.021650+0000","last_peered":"2023-12-12T09:44:24.021650+0000","last_clean":"2023-12-12T09:44:24.021650+0000","last_became_active":"2023-12-12T09:44:21.508640+0000","last_became_peered":"2023-12-12T09:44:21.508640+0000","last_unstale":"2023-12-12T09:44:24.021650+0000","last_undegraded":"2023-12-12T09:44:24.021650+0000","last_fullsized":"2023-12-12T09:44:24.021650+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_clean_scrub_stamp":"2023-12-12T09:44:20.465592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T20:16:13.594869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-12T09:44:34.598834+0000","last_change":"2023-12-12T09:44:34.598834+0000","last_active":"2023-12-12T09:44:34.598834+0000","last_peered":"2023-12-12T09:44:34.598834+0000","last_clean":"2023-12-12T09:44:34.598834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:44:34.598834+0000","last_undegraded":"2023-12-12T09:44:34.598834+0000","last_fullsized":"2023-12-12T09:44:34.598834+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:34.598834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:34.598834+0000","last_clean_scrub_stamp":"2023-12-12T09:44:34.598834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-12T09:44:35.613810+0000","last_change":"2023-12-12T09:44:35.613810+0000","last_active":"2023-12-12T09:44:35.613810+0000","last_peered":"2023-12-12T09:44:35.613810+0000","last_clean":"2023-12-12T09:44:35.613810+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:44:35.613810+0000","last_undegraded":"2023-12-12T09:44:35.613810+0000","last_fullsized":"2023-12-12T09:44:35.613810+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:35.613810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:35.613810+0000","last_clean_scrub_stamp":"2023-12-12T09:44:35.613810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.d","version":"33'1","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-12T09:44:21.535209+0000","last_change":"2023-12-12T09:44:20.511043+0000","last_active":"2023-12-12T09:44:21.535209+0000","last_peered":"2023-12-12T09:44:21.535209+0000","last_clean":"2023-12-12T09:44:21.535209+0000","last_became_active":"2023-12-12T09:44:20.510215+0000","last_became_peered":"2023-12-12T09:44:20.510215+0000","last_unstale":"2023-12-12T09:44:21.535209+0000","last_undegraded":"2023-12-12T09:44:21.535209+0000","last_fullsized":"2023-12-12T09:44:21.535209+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:19.449520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:19.449520+0000","last_clean_scrub_stamp":"2023-12-12T09:44:19.449520+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T19:16:24.812720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-12T09:44:24.021580+0000","last_change":"2023-12-12T09:44:21.536677+0000","last_active":"2023-12-12T09:44:24.021580+0000","last_peered":"2023-12-12T09:44:24.021580+0000","last_clean":"2023-12-12T09:44:24.021580+0000","last_became_active":"2023-12-12T09:44:21.535741+0000","last_became_peered":"2023-12-12T09:44:21.535741+0000","last_unstale":"2023-12-12T09:44:24.021580+0000","last_undegraded":"2023-12-12T09:44:24.021580+0000","last_fullsized":"2023-12-12T09:44:24.021580+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_clean_scrub_stamp":"2023-12-12T09:44:20.465592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T20:58:54.834367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-12T09:44:34.598834+0000","last_change":"2023-12-12T09:44:34.598834+0000","last_active":"2023-12-12T09:44:34.598834+0000","last_peered":"2023-12-12T09:44:34.598834+0000","last_clean":"2023-12-12T09:44:34.598834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:44:34.598834+0000","last_undegraded":"2023-12-12T09:44:34.598834+0000","last_fullsized":"2023-12-12T09:44:34.598834+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:34.598834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:34.598834+0000","last_clean_scrub_stamp":"2023-12-12T09:44:34.598834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-12T09:44:35.613810+0000","last_change":"2023-12-12T09:44:35.613810+0000","last_active":"2023-12-12T09:44:35.613810+0000","last_peered":"2023-12-12T09:44:35.613810+0000","last_clean":"2023-12-12T09:44:35.613810+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:44:35.613810+0000","last_undegraded":"2023-12-12T09:44:35.613810+0000","last_fullsized":"2023-12-12T09:44:35.613810+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:35.613810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:35.613810+0000","last_clean_scrub_stamp":"2023-12-12T09:44:35.613810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.e","version":"33'2","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-12T09:44:21.531013+0000","last_change":"2023-12-12T09:44:20.516846+0000","last_active":"2023-12-12T09:44:21.531013+0000","last_peered":"2023-12-12T09:44:21.531013+0000","last_clean":"2023-12-12T09:44:21.531013+0000","last_became_active":"2023-12-12T09:44:20.514593+0000","last_became_peered":"2023-12-12T09:44:20.514593+0000","last_unstale":"2023-12-12T09:44:21.531013+0000","last_undegraded":"2023-12-12T09:44:21.531013+0000","last_fullsized":"2023-12-12T09:44:21.531013+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:19.449520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:19.449520+0000","last_clean_scrub_stamp":"2023-12-12T09:44:19.449520+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T16:36:32.055010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-12T09:44:22.515709+0000","last_change":"2023-12-12T09:44:21.528910+0000","last_active":"2023-12-12T09:44:22.515709+0000","last_peered":"2023-12-12T09:44:22.515709+0000","last_clean":"2023-12-12T09:44:22.515709+0000","last_became_active":"2023-12-12T09:44:21.528597+0000","last_became_peered":"2023-12-12T09:44:21.528597+0000","last_unstale":"2023-12-12T09:44:22.515709+0000","last_undegraded":"2023-12-12T09:44:22.515709+0000","last_fullsized":"2023-12-12T09:44:22.515709+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_clean_scrub_stamp":"2023-12-12T09:44:20.465592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T10:03:17.158642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-12T09:44:34.598834+0000","last_change":"2023-12-12T09:44:34.598834+0000","last_active":"2023-12-12T09:44:34.598834+0000","last_peered":"2023-12-12T09:44:34.598834+0000","last_clean":"2023-12-12T09:44:34.598834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:44:34.598834+0000","last_undegraded":"2023-12-12T09:44:34.598834+0000","last_fullsized":"2023-12-12T09:44:34.598834+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:34.598834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:34.598834+0000","last_clean_scrub_stamp":"2023-12-12T09:44:34.598834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-12T09:44:35.613810+0000","last_change":"2023-12-12T09:44:35.613810+0000","last_active":"2023-12-12T09:44:35.613810+0000","last_peered":"2023-12-12T09:44:35.613810+0000","last_clean":"2023-12-12T09:44:35.613810+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:44:35.613810+0000","last_undegraded":"2023-12-12T09:44:35.613810+0000","last_fullsized":"2023-12-12T09:44:35.613810+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:35.613810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:35.613810+0000","last_clean_scrub_stamp":"2023-12-12T09:44:35.613810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.f","version":"33'1","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-12T09:44:21.535871+0000","last_change":"2023-12-12T09:44:20.505080+0000","last_active":"2023-12-12T09:44:21.535871+0000","last_peered":"2023-12-12T09:44:21.535871+0000","last_clean":"2023-12-12T09:44:21.535871+0000","last_became_active":"2023-12-12T09:44:20.504727+0000","last_became_peered":"2023-12-12T09:44:20.504727+0000","last_unstale":"2023-12-12T09:44:21.535871+0000","last_undegraded":"2023-12-12T09:44:21.535871+0000","last_fullsized":"2023-12-12T09:44:21.535871+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:19.449520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:19.449520+0000","last_clean_scrub_stamp":"2023-12-12T09:44:19.449520+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T12:07:41.908376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-12T09:44:24.020681+0000","last_change":"2023-12-12T09:44:21.530767+0000","last_active":"2023-12-12T09:44:24.020681+0000","last_peered":"2023-12-12T09:44:24.020681+0000","last_clean":"2023-12-12T09:44:24.020681+0000","last_became_active":"2023-12-12T09:44:21.530072+0000","last_became_peered":"2023-12-12T09:44:21.530072+0000","last_unstale":"2023-12-12T09:44:24.020681+0000","last_undegraded":"2023-12-12T09:44:24.020681+0000","last_fullsized":"2023-12-12T09:44:24.020681+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_clean_scrub_stamp":"2023-12-12T09:44:20.465592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T12:49:12.283708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-12T09:44:34.598834+0000","last_change":"2023-12-12T09:44:34.598834+0000","last_active":"2023-12-12T09:44:34.598834+0000","last_peered":"2023-12-12T09:44:34.598834+0000","last_clean":"2023-12-12T09:44:34.598834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:44:34.598834+0000","last_undegraded":"2023-12-12T09:44:34.598834+0000","last_fullsized":"2023-12-12T09:44:34.598834+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:34.598834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:34.598834+0000","last_clean_scrub_stamp":"2023-12-12T09:44:34.598834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-12T09:44:35.613810+0000","last_change":"2023-12-12T09:44:35.613810+0000","last_active":"2023-12-12T09:44:35.613810+0000","last_peered":"2023-12-12T09:44:35.613810+0000","last_clean":"2023-12-12T09:44:35.613810+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:44:35.613810+0000","last_undegraded":"2023-12-12T09:44:35.613810+0000","last_fullsized":"2023-12-12T09:44:35.613810+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:35.613810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:35.613810+0000","last_clean_scrub_stamp":"2023-12-12T09:44:35.613810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.10","version":"33'8","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-12T09:44:21.529853+0000","last_change":"2023-12-12T09:44:20.505770+0000","last_active":"2023-12-12T09:44:21.529853+0000","last_peered":"2023-12-12T09:44:21.529853+0000","last_clean":"2023-12-12T09:44:21.529853+0000","last_became_active":"2023-12-12T09:44:20.505511+0000","last_became_peered":"2023-12-12T09:44:20.505511+0000","last_unstale":"2023-12-12T09:44:21.529853+0000","last_undegraded":"2023-12-12T09:44:21.529853+0000","last_fullsized":"2023-12-12T09:44:21.529853+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:19.449520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:19.449520+0000","last_clean_scrub_stamp":"2023-12-12T09:44:19.449520+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T12:23:16.125156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-12T09:44:22.686230+0000","last_change":"2023-12-12T09:44:21.531855+0000","last_active":"2023-12-12T09:44:22.686230+0000","last_peered":"2023-12-12T09:44:22.686230+0000","last_clean":"2023-12-12T09:44:22.686230+0000","last_became_active":"2023-12-12T09:44:21.531294+0000","last_became_peered":"2023-12-12T09:44:21.531294+0000","last_unstale":"2023-12-12T09:44:22.686230+0000","last_undegraded":"2023-12-12T09:44:22.686230+0000","last_fullsized":"2023-12-12T09:44:22.686230+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_clean_scrub_stamp":"2023-12-12T09:44:20.465592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T21:42:36.877781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-12T09:44:34.598834+0000","last_change":"2023-12-12T09:44:34.598834+0000","last_active":"2023-12-12T09:44:34.598834+0000","last_peered":"2023-12-12T09:44:34.598834+0000","last_clean":"2023-12-12T09:44:34.598834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:44:34.598834+0000","last_undegraded":"2023-12-12T09:44:34.598834+0000","last_fullsized":"2023-12-12T09:44:34.598834+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:34.598834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:34.598834+0000","last_clean_scrub_stamp":"2023-12-12T09:44:34.598834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-12T09:44:35.613810+0000","last_change":"2023-12-12T09:44:35.613810+0000","last_active":"2023-12-12T09:44:35.613810+0000","last_peered":"2023-12-12T09:44:35.613810+0000","last_clean":"2023-12-12T09:44:35.613810+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:44:35.613810+0000","last_undegraded":"2023-12-12T09:44:35.613810+0000","last_fullsized":"2023-12-12T09:44:35.613810+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:35.613810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:35.613810+0000","last_clean_scrub_stamp":"2023-12-12T09:44:35.613810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-12T09:44:21.495413+0000","last_change":"2023-12-12T09:44:20.514956+0000","last_active":"2023-12-12T09:44:21.495413+0000","last_peered":"2023-12-12T09:44:21.495413+0000","last_clean":"2023-12-12T09:44:21.495413+0000","last_became_active":"2023-12-12T09:44:20.513186+0000","last_became_peered":"2023-12-12T09:44:20.513186+0000","last_unstale":"2023-12-12T09:44:21.495413+0000","last_undegraded":"2023-12-12T09:44:21.495413+0000","last_fullsized":"2023-12-12T09:44:21.495413+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:19.449520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:19.449520+0000","last_clean_scrub_stamp":"2023-12-12T09:44:19.449520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T12:49:11.267636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-12T09:44:22.513406+0000","last_change":"2023-12-12T09:44:21.532046+0000","last_active":"2023-12-12T09:44:22.513406+0000","last_peered":"2023-12-12T09:44:22.513406+0000","last_clean":"2023-12-12T09:44:22.513406+0000","last_became_active":"2023-12-12T09:44:21.531801+0000","last_became_peered":"2023-12-12T09:44:21.531801+0000","last_unstale":"2023-12-12T09:44:22.513406+0000","last_undegraded":"2023-12-12T09:44:22.513406+0000","last_fullsized":"2023-12-12T09:44:22.513406+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_clean_scrub_stamp":"2023-12-12T09:44:20.465592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T12:23:17.141227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-12T09:44:34.598834+0000","last_change":"2023-12-12T09:44:34.598834+0000","last_active":"2023-12-12T09:44:34.598834+0000","last_peered":"2023-12-12T09:44:34.598834+0000","last_clean":"2023-12-12T09:44:34.598834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:44:34.598834+0000","last_undegraded":"2023-12-12T09:44:34.598834+0000","last_fullsized":"2023-12-12T09:44:34.598834+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:34.598834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:34.598834+0000","last_clean_scrub_stamp":"2023-12-12T09:44:34.598834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-12T09:44:35.613810+0000","last_change":"2023-12-12T09:44:35.613810+0000","last_active":"2023-12-12T09:44:35.613810+0000","last_peered":"2023-12-12T09:44:35.613810+0000","last_clean":"2023-12-12T09:44:35.613810+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:44:35.613810+0000","last_undegraded":"2023-12-12T09:44:35.613810+0000","last_fullsized":"2023-12-12T09:44:35.613810+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:35.613810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:35.613810+0000","last_clean_scrub_stamp":"2023-12-12T09:44:35.613810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-12T09:44:21.498015+0000","last_change":"2023-12-12T09:44:20.513932+0000","last_active":"2023-12-12T09:44:21.498015+0000","last_peered":"2023-12-12T09:44:21.498015+0000","last_clean":"2023-12-12T09:44:21.498015+0000","last_became_active":"2023-12-12T09:44:20.513676+0000","last_became_peered":"2023-12-12T09:44:20.513676+0000","last_unstale":"2023-12-12T09:44:21.498015+0000","last_undegraded":"2023-12-12T09:44:21.498015+0000","last_fullsized":"2023-12-12T09:44:21.498015+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:19.449520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:19.449520+0000","last_clean_scrub_stamp":"2023-12-12T09:44:19.449520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T19:16:24.812720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-12T09:44:22.510253+0000","last_change":"2023-12-12T09:44:21.498629+0000","last_active":"2023-12-12T09:44:22.510253+0000","last_peered":"2023-12-12T09:44:22.510253+0000","last_clean":"2023-12-12T09:44:22.510253+0000","last_became_active":"2023-12-12T09:44:21.498281+0000","last_became_peered":"2023-12-12T09:44:21.498281+0000","last_unstale":"2023-12-12T09:44:22.510253+0000","last_undegraded":"2023-12-12T09:44:22.510253+0000","last_fullsized":"2023-12-12T09:44:22.510253+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_clean_scrub_stamp":"2023-12-12T09:44:20.465592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T15:26:37.478870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-12T09:44:34.598834+0000","last_change":"2023-12-12T09:44:34.598834+0000","last_active":"2023-12-12T09:44:34.598834+0000","last_peered":"2023-12-12T09:44:34.598834+0000","last_clean":"2023-12-12T09:44:34.598834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:44:34.598834+0000","last_undegraded":"2023-12-12T09:44:34.598834+0000","last_fullsized":"2023-12-12T09:44:34.598834+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:34.598834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:34.598834+0000","last_clean_scrub_stamp":"2023-12-12T09:44:34.598834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-12T09:44:35.613810+0000","last_change":"2023-12-12T09:44:35.613810+0000","last_active":"2023-12-12T09:44:35.613810+0000","last_peered":"2023-12-12T09:44:35.613810+0000","last_clean":"2023-12-12T09:44:35.613810+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:44:35.613810+0000","last_undegraded":"2023-12-12T09:44:35.613810+0000","last_fullsized":"2023-12-12T09:44:35.613810+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:35.613810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:35.613810+0000","last_clean_scrub_stamp":"2023-12-12T09:44:35.613810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.13","version":"33'2","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-12T09:44:21.534665+0000","last_change":"2023-12-12T09:44:20.516223+0000","last_active":"2023-12-12T09:44:21.534665+0000","last_peered":"2023-12-12T09:44:21.534665+0000","last_clean":"2023-12-12T09:44:21.534665+0000","last_became_active":"2023-12-12T09:44:20.515976+0000","last_became_peered":"2023-12-12T09:44:20.515976+0000","last_unstale":"2023-12-12T09:44:21.534665+0000","last_undegraded":"2023-12-12T09:44:21.534665+0000","last_fullsized":"2023-12-12T09:44:21.534665+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:19.449520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:19.449520+0000","last_clean_scrub_stamp":"2023-12-12T09:44:19.449520+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T16:04:09.402682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-12T09:44:24.020444+0000","last_change":"2023-12-12T09:44:21.522639+0000","last_active":"2023-12-12T09:44:24.020444+0000","last_peered":"2023-12-12T09:44:24.020444+0000","last_clean":"2023-12-12T09:44:24.020444+0000","last_became_active":"2023-12-12T09:44:21.522313+0000","last_became_peered":"2023-12-12T09:44:21.522313+0000","last_unstale":"2023-12-12T09:44:24.020444+0000","last_undegraded":"2023-12-12T09:44:24.020444+0000","last_fullsized":"2023-12-12T09:44:24.020444+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_clean_scrub_stamp":"2023-12-12T09:44:20.465592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T12:38:15.250056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-12T09:44:34.598834+0000","last_change":"2023-12-12T09:44:34.598834+0000","last_active":"2023-12-12T09:44:34.598834+0000","last_peered":"2023-12-12T09:44:34.598834+0000","last_clean":"2023-12-12T09:44:34.598834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:44:34.598834+0000","last_undegraded":"2023-12-12T09:44:34.598834+0000","last_fullsized":"2023-12-12T09:44:34.598834+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:34.598834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:34.598834+0000","last_clean_scrub_stamp":"2023-12-12T09:44:34.598834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-12T09:44:35.613810+0000","last_change":"2023-12-12T09:44:35.613810+0000","last_active":"2023-12-12T09:44:35.613810+0000","last_peered":"2023-12-12T09:44:35.613810+0000","last_clean":"2023-12-12T09:44:35.613810+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:44:35.613810+0000","last_undegraded":"2023-12-12T09:44:35.613810+0000","last_fullsized":"2023-12-12T09:44:35.613810+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:35.613810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:35.613810+0000","last_clean_scrub_stamp":"2023-12-12T09:44:35.613810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.14","version":"34'8","reported_seq":20,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-12T09:44:29.482577+0000","last_change":"2023-12-12T09:44:20.509723+0000","last_active":"2023-12-12T09:44:29.482577+0000","last_peered":"2023-12-12T09:44:29.482577+0000","last_clean":"2023-12-12T09:44:29.482577+0000","last_became_active":"2023-12-12T09:44:20.509311+0000","last_became_peered":"2023-12-12T09:44:20.509311+0000","last_unstale":"2023-12-12T09:44:29.482577+0000","last_undegraded":"2023-12-12T09:44:29.482577+0000","last_fullsized":"2023-12-12T09:44:29.482577+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:19.449520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:19.449520+0000","last_clean_scrub_stamp":"2023-12-12T09:44:19.449520+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T20:58:53.818296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3107,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-12T09:44:22.515625+0000","last_change":"2023-12-12T09:44:21.514238+0000","last_active":"2023-12-12T09:44:22.515625+0000","last_peered":"2023-12-12T09:44:22.515625+0000","last_clean":"2023-12-12T09:44:22.515625+0000","last_became_active":"2023-12-12T09:44:21.513900+0000","last_became_peered":"2023-12-12T09:44:21.513900+0000","last_unstale":"2023-12-12T09:44:22.515625+0000","last_undegraded":"2023-12-12T09:44:22.515625+0000","last_fullsized":"2023-12-12T09:44:22.515625+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_clean_scrub_stamp":"2023-12-12T09:44:20.465592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T12:23:17.141227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-12T09:44:34.598834+0000","last_change":"2023-12-12T09:44:34.598834+0000","last_active":"2023-12-12T09:44:34.598834+0000","last_peered":"2023-12-12T09:44:34.598834+0000","last_clean":"2023-12-12T09:44:34.598834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:44:34.598834+0000","last_undegraded":"2023-12-12T09:44:34.598834+0000","last_fullsized":"2023-12-12T09:44:34.598834+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:34.598834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:34.598834+0000","last_clean_scrub_stamp":"2023-12-12T09:44:34.598834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-12T09:44:35.613810+0000","last_change":"2023-12-12T09:44:35.613810+0000","last_active":"2023-12-12T09:44:35.613810+0000","last_peered":"2023-12-12T09:44:35.613810+0000","last_clean":"2023-12-12T09:44:35.613810+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:44:35.613810+0000","last_undegraded":"2023-12-12T09:44:35.613810+0000","last_fullsized":"2023-12-12T09:44:35.613810+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:35.613810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:35.613810+0000","last_clean_scrub_stamp":"2023-12-12T09:44:35.613810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.15","version":"33'3","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-12T09:44:21.524147+0000","last_change":"2023-12-12T09:44:20.516043+0000","last_active":"2023-12-12T09:44:21.524147+0000","last_peered":"2023-12-12T09:44:21.524147+0000","last_clean":"2023-12-12T09:44:21.524147+0000","last_became_active":"2023-12-12T09:44:20.515717+0000","last_became_peered":"2023-12-12T09:44:20.515717+0000","last_unstale":"2023-12-12T09:44:21.524147+0000","last_undegraded":"2023-12-12T09:44:21.524147+0000","last_fullsized":"2023-12-12T09:44:21.524147+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:19.449520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:19.449520+0000","last_clean_scrub_stamp":"2023-12-12T09:44:19.449520+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T12:38:14.233984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-12T09:44:22.509198+0000","last_change":"2023-12-12T09:44:21.515459+0000","last_active":"2023-12-12T09:44:22.509198+0000","last_peered":"2023-12-12T09:44:22.509198+0000","last_clean":"2023-12-12T09:44:22.509198+0000","last_became_active":"2023-12-12T09:44:21.515182+0000","last_became_peered":"2023-12-12T09:44:21.515182+0000","last_unstale":"2023-12-12T09:44:22.509198+0000","last_undegraded":"2023-12-12T09:44:22.509198+0000","last_fullsized":"2023-12-12T09:44:22.509198+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_clean_scrub_stamp":"2023-12-12T09:44:20.465592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T20:53:13.479872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-12T09:44:34.598834+0000","last_change":"2023-12-12T09:44:34.598834+0000","last_active":"2023-12-12T09:44:34.598834+0000","last_peered":"2023-12-12T09:44:34.598834+0000","last_clean":"2023-12-12T09:44:34.598834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:44:34.598834+0000","last_undegraded":"2023-12-12T09:44:34.598834+0000","last_fullsized":"2023-12-12T09:44:34.598834+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:34.598834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:34.598834+0000","last_clean_scrub_stamp":"2023-12-12T09:44:34.598834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-12T09:44:35.613810+0000","last_change":"2023-12-12T09:44:35.613810+0000","last_active":"2023-12-12T09:44:35.613810+0000","last_peered":"2023-12-12T09:44:35.613810+0000","last_clean":"2023-12-12T09:44:35.613810+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:44:35.613810+0000","last_undegraded":"2023-12-12T09:44:35.613810+0000","last_fullsized":"2023-12-12T09:44:35.613810+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:35.613810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:35.613810+0000","last_clean_scrub_stamp":"2023-12-12T09:44:35.613810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-12T09:44:21.488771+0000","last_change":"2023-12-12T09:44:20.505493+0000","last_active":"2023-12-12T09:44:21.488771+0000","last_peered":"2023-12-12T09:44:21.488771+0000","last_clean":"2023-12-12T09:44:21.488771+0000","last_became_active":"2023-12-12T09:44:20.503452+0000","last_became_peered":"2023-12-12T09:44:20.503452+0000","last_unstale":"2023-12-12T09:44:21.488771+0000","last_undegraded":"2023-12-12T09:44:21.488771+0000","last_fullsized":"2023-12-12T09:44:21.488771+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:19.449520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:19.449520+0000","last_clean_scrub_stamp":"2023-12-12T09:44:19.449520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T19:38:07.725951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-12T09:44:22.509556+0000","last_change":"2023-12-12T09:44:21.528120+0000","last_active":"2023-12-12T09:44:22.509556+0000","last_peered":"2023-12-12T09:44:22.509556+0000","last_clean":"2023-12-12T09:44:22.509556+0000","last_became_active":"2023-12-12T09:44:21.527860+0000","last_became_peered":"2023-12-12T09:44:21.527860+0000","last_unstale":"2023-12-12T09:44:22.509556+0000","last_undegraded":"2023-12-12T09:44:22.509556+0000","last_fullsized":"2023-12-12T09:44:22.509556+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_clean_scrub_stamp":"2023-12-12T09:44:20.465592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T21:03:17.881060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-12T09:44:34.598834+0000","last_change":"2023-12-12T09:44:34.598834+0000","last_active":"2023-12-12T09:44:34.598834+0000","last_peered":"2023-12-12T09:44:34.598834+0000","last_clean":"2023-12-12T09:44:34.598834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:44:34.598834+0000","last_undegraded":"2023-12-12T09:44:34.598834+0000","last_fullsized":"2023-12-12T09:44:34.598834+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:34.598834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:34.598834+0000","last_clean_scrub_stamp":"2023-12-12T09:44:34.598834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-12T09:44:35.613810+0000","last_change":"2023-12-12T09:44:35.613810+0000","last_active":"2023-12-12T09:44:35.613810+0000","last_peered":"2023-12-12T09:44:35.613810+0000","last_clean":"2023-12-12T09:44:35.613810+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:44:35.613810+0000","last_undegraded":"2023-12-12T09:44:35.613810+0000","last_fullsized":"2023-12-12T09:44:35.613810+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:35.613810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:35.613810+0000","last_clean_scrub_stamp":"2023-12-12T09:44:35.613810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-12T09:44:21.496356+0000","last_change":"2023-12-12T09:44:20.515405+0000","last_active":"2023-12-12T09:44:21.496356+0000","last_peered":"2023-12-12T09:44:21.496356+0000","last_clean":"2023-12-12T09:44:21.496356+0000","last_became_active":"2023-12-12T09:44:20.515184+0000","last_became_peered":"2023-12-12T09:44:20.515184+0000","last_unstale":"2023-12-12T09:44:21.496356+0000","last_undegraded":"2023-12-12T09:44:21.496356+0000","last_fullsized":"2023-12-12T09:44:21.496356+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:19.449520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:19.449520+0000","last_clean_scrub_stamp":"2023-12-12T09:44:19.449520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T11:40:19.759789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-12T09:44:22.516476+0000","last_change":"2023-12-12T09:44:21.516583+0000","last_active":"2023-12-12T09:44:22.516476+0000","last_peered":"2023-12-12T09:44:22.516476+0000","last_clean":"2023-12-12T09:44:22.516476+0000","last_became_active":"2023-12-12T09:44:21.515986+0000","last_became_peered":"2023-12-12T09:44:21.515986+0000","last_unstale":"2023-12-12T09:44:22.516476+0000","last_undegraded":"2023-12-12T09:44:22.516476+0000","last_fullsized":"2023-12-12T09:44:22.516476+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_clean_scrub_stamp":"2023-12-12T09:44:20.465592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T14:08:30.510607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-12T09:44:34.598834+0000","last_change":"2023-12-12T09:44:34.598834+0000","last_active":"2023-12-12T09:44:34.598834+0000","last_peered":"2023-12-12T09:44:34.598834+0000","last_clean":"2023-12-12T09:44:34.598834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:44:34.598834+0000","last_undegraded":"2023-12-12T09:44:34.598834+0000","last_fullsized":"2023-12-12T09:44:34.598834+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:34.598834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:34.598834+0000","last_clean_scrub_stamp":"2023-12-12T09:44:34.598834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-12T09:44:35.613810+0000","last_change":"2023-12-12T09:44:35.613810+0000","last_active":"2023-12-12T09:44:35.613810+0000","last_peered":"2023-12-12T09:44:35.613810+0000","last_clean":"2023-12-12T09:44:35.613810+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:44:35.613810+0000","last_undegraded":"2023-12-12T09:44:35.613810+0000","last_fullsized":"2023-12-12T09:44:35.613810+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:35.613810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:35.613810+0000","last_clean_scrub_stamp":"2023-12-12T09:44:35.613810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-12T09:44:21.494190+0000","last_change":"2023-12-12T09:44:20.516411+0000","last_active":"2023-12-12T09:44:21.494190+0000","last_peered":"2023-12-12T09:44:21.494190+0000","last_clean":"2023-12-12T09:44:21.494190+0000","last_became_active":"2023-12-12T09:44:20.516143+0000","last_became_peered":"2023-12-12T09:44:20.516143+0000","last_unstale":"2023-12-12T09:44:21.494190+0000","last_undegraded":"2023-12-12T09:44:21.494190+0000","last_fullsized":"2023-12-12T09:44:21.494190+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:19.449520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:19.449520+0000","last_clean_scrub_stamp":"2023-12-12T09:44:19.449520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T20:16:12.578797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-12T09:44:24.020767+0000","last_change":"2023-12-12T09:44:21.520960+0000","last_active":"2023-12-12T09:44:24.020767+0000","last_peered":"2023-12-12T09:44:24.020767+0000","last_clean":"2023-12-12T09:44:24.020767+0000","last_became_active":"2023-12-12T09:44:21.520630+0000","last_became_peered":"2023-12-12T09:44:21.520630+0000","last_unstale":"2023-12-12T09:44:24.020767+0000","last_undegraded":"2023-12-12T09:44:24.020767+0000","last_fullsized":"2023-12-12T09:44:24.020767+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_clean_scrub_stamp":"2023-12-12T09:44:20.465592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T18:54:29.796762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-12T09:44:34.598834+0000","last_change":"2023-12-12T09:44:34.598834+0000","last_active":"2023-12-12T09:44:34.598834+0000","last_peered":"2023-12-12T09:44:34.598834+0000","last_clean":"2023-12-12T09:44:34.598834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:44:34.598834+0000","last_undegraded":"2023-12-12T09:44:34.598834+0000","last_fullsized":"2023-12-12T09:44:34.598834+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:34.598834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:34.598834+0000","last_clean_scrub_stamp":"2023-12-12T09:44:34.598834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-12T09:44:35.613810+0000","last_change":"2023-12-12T09:44:35.613810+0000","last_active":"2023-12-12T09:44:35.613810+0000","last_peered":"2023-12-12T09:44:35.613810+0000","last_clean":"2023-12-12T09:44:35.613810+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:44:35.613810+0000","last_undegraded":"2023-12-12T09:44:35.613810+0000","last_fullsized":"2023-12-12T09:44:35.613810+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:35.613810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:35.613810+0000","last_clean_scrub_stamp":"2023-12-12T09:44:35.613810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-12T09:44:21.495485+0000","last_change":"2023-12-12T09:44:20.510572+0000","last_active":"2023-12-12T09:44:21.495485+0000","last_peered":"2023-12-12T09:44:21.495485+0000","last_clean":"2023-12-12T09:44:21.495485+0000","last_became_active":"2023-12-12T09:44:20.510324+0000","last_became_peered":"2023-12-12T09:44:20.510324+0000","last_unstale":"2023-12-12T09:44:21.495485+0000","last_undegraded":"2023-12-12T09:44:21.495485+0000","last_fullsized":"2023-12-12T09:44:21.495485+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:19.449520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:19.449520+0000","last_clean_scrub_stamp":"2023-12-12T09:44:19.449520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T12:38:14.233984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-12T09:44:24.020131+0000","last_change":"2023-12-12T09:44:21.528208+0000","last_active":"2023-12-12T09:44:24.020131+0000","last_peered":"2023-12-12T09:44:24.020131+0000","last_clean":"2023-12-12T09:44:24.020131+0000","last_became_active":"2023-12-12T09:44:21.524386+0000","last_became_peered":"2023-12-12T09:44:21.524386+0000","last_unstale":"2023-12-12T09:44:24.020131+0000","last_undegraded":"2023-12-12T09:44:24.020131+0000","last_fullsized":"2023-12-12T09:44:24.020131+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_clean_scrub_stamp":"2023-12-12T09:44:20.465592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T10:43:48.035299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-12T09:44:34.598834+0000","last_change":"2023-12-12T09:44:34.598834+0000","last_active":"2023-12-12T09:44:34.598834+0000","last_peered":"2023-12-12T09:44:34.598834+0000","last_clean":"2023-12-12T09:44:34.598834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:44:34.598834+0000","last_undegraded":"2023-12-12T09:44:34.598834+0000","last_fullsized":"2023-12-12T09:44:34.598834+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:34.598834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:34.598834+0000","last_clean_scrub_stamp":"2023-12-12T09:44:34.598834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-12T09:44:35.613810+0000","last_change":"2023-12-12T09:44:35.613810+0000","last_active":"2023-12-12T09:44:35.613810+0000","last_peered":"2023-12-12T09:44:35.613810+0000","last_clean":"2023-12-12T09:44:35.613810+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:44:35.613810+0000","last_undegraded":"2023-12-12T09:44:35.613810+0000","last_fullsized":"2023-12-12T09:44:35.613810+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:35.613810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:35.613810+0000","last_clean_scrub_stamp":"2023-12-12T09:44:35.613810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1a","version":"33'1","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-12T09:44:21.529396+0000","last_change":"2023-12-12T09:44:20.507138+0000","last_active":"2023-12-12T09:44:21.529396+0000","last_peered":"2023-12-12T09:44:21.529396+0000","last_clean":"2023-12-12T09:44:21.529396+0000","last_became_active":"2023-12-12T09:44:20.506706+0000","last_became_peered":"2023-12-12T09:44:20.506706+0000","last_unstale":"2023-12-12T09:44:21.529396+0000","last_undegraded":"2023-12-12T09:44:21.529396+0000","last_fullsized":"2023-12-12T09:44:21.529396+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:19.449520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:19.449520+0000","last_clean_scrub_stamp":"2023-12-12T09:44:19.449520+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T14:59:36.480275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-12T09:44:22.515617+0000","last_change":"2023-12-12T09:44:21.510952+0000","last_active":"2023-12-12T09:44:22.515617+0000","last_peered":"2023-12-12T09:44:22.515617+0000","last_clean":"2023-12-12T09:44:22.515617+0000","last_became_active":"2023-12-12T09:44:21.510672+0000","last_became_peered":"2023-12-12T09:44:21.510672+0000","last_unstale":"2023-12-12T09:44:22.515617+0000","last_undegraded":"2023-12-12T09:44:22.515617+0000","last_fullsized":"2023-12-12T09:44:22.515617+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_clean_scrub_stamp":"2023-12-12T09:44:20.465592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T12:21:37.296506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-12T09:44:34.598834+0000","last_change":"2023-12-12T09:44:34.598834+0000","last_active":"2023-12-12T09:44:34.598834+0000","last_peered":"2023-12-12T09:44:34.598834+0000","last_clean":"2023-12-12T09:44:34.598834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:44:34.598834+0000","last_undegraded":"2023-12-12T09:44:34.598834+0000","last_fullsized":"2023-12-12T09:44:34.598834+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:34.598834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:34.598834+0000","last_clean_scrub_stamp":"2023-12-12T09:44:34.598834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-12T09:44:35.613810+0000","last_change":"2023-12-12T09:44:35.613810+0000","last_active":"2023-12-12T09:44:35.613810+0000","last_peered":"2023-12-12T09:44:35.613810+0000","last_clean":"2023-12-12T09:44:35.613810+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:44:35.613810+0000","last_undegraded":"2023-12-12T09:44:35.613810+0000","last_fullsized":"2023-12-12T09:44:35.613810+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:35.613810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:35.613810+0000","last_clean_scrub_stamp":"2023-12-12T09:44:35.613810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1b","version":"33'1","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-12T09:44:21.535515+0000","last_change":"2023-12-12T09:44:20.506547+0000","last_active":"2023-12-12T09:44:21.535515+0000","last_peered":"2023-12-12T09:44:21.535515+0000","last_clean":"2023-12-12T09:44:21.535515+0000","last_became_active":"2023-12-12T09:44:20.506207+0000","last_became_peered":"2023-12-12T09:44:20.506207+0000","last_unstale":"2023-12-12T09:44:21.535515+0000","last_undegraded":"2023-12-12T09:44:21.535515+0000","last_fullsized":"2023-12-12T09:44:21.535515+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:19.449520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:19.449520+0000","last_clean_scrub_stamp":"2023-12-12T09:44:19.449520+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T21:18:35.916411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-12T09:44:22.514010+0000","last_change":"2023-12-12T09:44:21.532639+0000","last_active":"2023-12-12T09:44:22.514010+0000","last_peered":"2023-12-12T09:44:22.514010+0000","last_clean":"2023-12-12T09:44:22.514010+0000","last_became_active":"2023-12-12T09:44:21.532369+0000","last_became_peered":"2023-12-12T09:44:21.532369+0000","last_unstale":"2023-12-12T09:44:22.514010+0000","last_undegraded":"2023-12-12T09:44:22.514010+0000","last_fullsized":"2023-12-12T09:44:22.514010+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_clean_scrub_stamp":"2023-12-12T09:44:20.465592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T14:08:30.510607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-12T09:44:34.598834+0000","last_change":"2023-12-12T09:44:34.598834+0000","last_active":"2023-12-12T09:44:34.598834+0000","last_peered":"2023-12-12T09:44:34.598834+0000","last_clean":"2023-12-12T09:44:34.598834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:44:34.598834+0000","last_undegraded":"2023-12-12T09:44:34.598834+0000","last_fullsized":"2023-12-12T09:44:34.598834+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:34.598834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:34.598834+0000","last_clean_scrub_stamp":"2023-12-12T09:44:34.598834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-12T09:44:35.613810+0000","last_change":"2023-12-12T09:44:35.613810+0000","last_active":"2023-12-12T09:44:35.613810+0000","last_peered":"2023-12-12T09:44:35.613810+0000","last_clean":"2023-12-12T09:44:35.613810+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:44:35.613810+0000","last_undegraded":"2023-12-12T09:44:35.613810+0000","last_fullsized":"2023-12-12T09:44:35.613810+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:35.613810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:35.613810+0000","last_clean_scrub_stamp":"2023-12-12T09:44:35.613810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-12T09:44:34.598834+0000","last_change":"2023-12-12T09:44:34.598834+0000","last_active":"2023-12-12T09:44:34.598834+0000","last_peered":"2023-12-12T09:44:34.598834+0000","last_clean":"2023-12-12T09:44:34.598834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:44:34.598834+0000","last_undegraded":"2023-12-12T09:44:34.598834+0000","last_fullsized":"2023-12-12T09:44:34.598834+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:34.598834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:34.598834+0000","last_clean_scrub_stamp":"2023-12-12T09:44:34.598834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1c","version":"33'2","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-12T09:44:21.532628+0000","last_change":"2023-12-12T09:44:20.509167+0000","last_active":"2023-12-12T09:44:21.532628+0000","last_peered":"2023-12-12T09:44:21.532628+0000","last_clean":"2023-12-12T09:44:21.532628+0000","last_became_active":"2023-12-12T09:44:20.508808+0000","last_became_peered":"2023-12-12T09:44:20.508808+0000","last_unstale":"2023-12-12T09:44:21.532628+0000","last_undegraded":"2023-12-12T09:44:21.532628+0000","last_fullsized":"2023-12-12T09:44:21.532628+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:19.449520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:19.449520+0000","last_clean_scrub_stamp":"2023-12-12T09:44:19.449520+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T18:14:15.788144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-12T09:44:24.022148+0000","last_change":"2023-12-12T09:44:21.531916+0000","last_active":"2023-12-12T09:44:24.022148+0000","last_peered":"2023-12-12T09:44:24.022148+0000","last_clean":"2023-12-12T09:44:24.022148+0000","last_became_active":"2023-12-12T09:44:21.531595+0000","last_became_peered":"2023-12-12T09:44:21.531595+0000","last_unstale":"2023-12-12T09:44:24.022148+0000","last_undegraded":"2023-12-12T09:44:24.022148+0000","last_fullsized":"2023-12-12T09:44:24.022148+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_clean_scrub_stamp":"2023-12-12T09:44:20.465592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T12:23:17.141227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-12T09:44:35.613810+0000","last_change":"2023-12-12T09:44:35.613810+0000","last_active":"2023-12-12T09:44:35.613810+0000","last_peered":"2023-12-12T09:44:35.613810+0000","last_clean":"2023-12-12T09:44:35.613810+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:44:35.613810+0000","last_undegraded":"2023-12-12T09:44:35.613810+0000","last_fullsized":"2023-12-12T09:44:35.613810+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:35.613810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:35.613810+0000","last_clean_scrub_stamp":"2023-12-12T09:44:35.613810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-12T09:44:34.598834+0000","last_change":"2023-12-12T09:44:34.598834+0000","last_active":"2023-12-12T09:44:34.598834+0000","last_peered":"2023-12-12T09:44:34.598834+0000","last_clean":"2023-12-12T09:44:34.598834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:44:34.598834+0000","last_undegraded":"2023-12-12T09:44:34.598834+0000","last_fullsized":"2023-12-12T09:44:34.598834+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:34.598834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:34.598834+0000","last_clean_scrub_stamp":"2023-12-12T09:44:34.598834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1d","version":"33'2","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-12T09:44:21.532618+0000","last_change":"2023-12-12T09:44:20.505973+0000","last_active":"2023-12-12T09:44:21.532618+0000","last_peered":"2023-12-12T09:44:21.532618+0000","last_clean":"2023-12-12T09:44:21.532618+0000","last_became_active":"2023-12-12T09:44:20.505716+0000","last_became_peered":"2023-12-12T09:44:20.505716+0000","last_unstale":"2023-12-12T09:44:21.532618+0000","last_undegraded":"2023-12-12T09:44:21.532618+0000","last_fullsized":"2023-12-12T09:44:21.532618+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:19.449520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:19.449520+0000","last_clean_scrub_stamp":"2023-12-12T09:44:19.449520+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T14:50:34.872309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-12T09:44:24.020668+0000","last_change":"2023-12-12T09:44:21.531214+0000","last_active":"2023-12-12T09:44:24.020668+0000","last_peered":"2023-12-12T09:44:24.020668+0000","last_clean":"2023-12-12T09:44:24.020668+0000","last_became_active":"2023-12-12T09:44:21.530559+0000","last_became_peered":"2023-12-12T09:44:21.530559+0000","last_unstale":"2023-12-12T09:44:24.020668+0000","last_undegraded":"2023-12-12T09:44:24.020668+0000","last_fullsized":"2023-12-12T09:44:24.020668+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_clean_scrub_stamp":"2023-12-12T09:44:20.465592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T12:07:42.924447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-12T09:44:35.613810+0000","last_change":"2023-12-12T09:44:35.613810+0000","last_active":"2023-12-12T09:44:35.613810+0000","last_peered":"2023-12-12T09:44:35.613810+0000","last_clean":"2023-12-12T09:44:35.613810+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:44:35.613810+0000","last_undegraded":"2023-12-12T09:44:35.613810+0000","last_fullsized":"2023-12-12T09:44:35.613810+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:35.613810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:35.613810+0000","last_clean_scrub_stamp":"2023-12-12T09:44:35.613810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1e","version":"33'1","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-12T09:44:21.517240+0000","last_change":"2023-12-12T09:44:20.512943+0000","last_active":"2023-12-12T09:44:21.517240+0000","last_peered":"2023-12-12T09:44:21.517240+0000","last_clean":"2023-12-12T09:44:21.517240+0000","last_became_active":"2023-12-12T09:44:20.512655+0000","last_became_peered":"2023-12-12T09:44:20.512655+0000","last_unstale":"2023-12-12T09:44:21.517240+0000","last_undegraded":"2023-12-12T09:44:21.517240+0000","last_fullsized":"2023-12-12T09:44:21.517240+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:19.449520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:19.449520+0000","last_clean_scrub_stamp":"2023-12-12T09:44:19.449520+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T20:21:31.990503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-12T09:44:22.686533+0000","last_change":"2023-12-12T09:44:21.535215+0000","last_active":"2023-12-12T09:44:22.686533+0000","last_peered":"2023-12-12T09:44:22.686533+0000","last_clean":"2023-12-12T09:44:22.686533+0000","last_became_active":"2023-12-12T09:44:21.534935+0000","last_became_peered":"2023-12-12T09:44:21.534935+0000","last_unstale":"2023-12-12T09:44:22.686533+0000","last_undegraded":"2023-12-12T09:44:22.686533+0000","last_fullsized":"2023-12-12T09:44:22.686533+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_clean_scrub_stamp":"2023-12-12T09:44:20.465592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T21:19:34.161140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-12T09:44:34.598834+0000","last_change":"2023-12-12T09:44:34.598834+0000","last_active":"2023-12-12T09:44:34.598834+0000","last_peered":"2023-12-12T09:44:34.598834+0000","last_clean":"2023-12-12T09:44:34.598834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:44:34.598834+0000","last_undegraded":"2023-12-12T09:44:34.598834+0000","last_fullsized":"2023-12-12T09:44:34.598834+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:34.598834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:34.598834+0000","last_clean_scrub_stamp":"2023-12-12T09:44:34.598834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-12T09:44:35.613810+0000","last_change":"2023-12-12T09:44:35.613810+0000","last_active":"2023-12-12T09:44:35.613810+0000","last_peered":"2023-12-12T09:44:35.613810+0000","last_clean":"2023-12-12T09:44:35.613810+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:44:35.613810+0000","last_undegraded":"2023-12-12T09:44:35.613810+0000","last_fullsized":"2023-12-12T09:44:35.613810+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:35.613810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:35.613810+0000","last_clean_scrub_stamp":"2023-12-12T09:44:35.613810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1f","version":"33'4","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-12T09:44:21.521245+0000","last_change":"2023-12-12T09:44:20.514272+0000","last_active":"2023-12-12T09:44:21.521245+0000","last_peered":"2023-12-12T09:44:21.521245+0000","last_clean":"2023-12-12T09:44:21.521245+0000","last_became_active":"2023-12-12T09:44:20.513997+0000","last_became_peered":"2023-12-12T09:44:20.513997+0000","last_unstale":"2023-12-12T09:44:21.521245+0000","last_undegraded":"2023-12-12T09:44:21.521245+0000","last_fullsized":"2023-12-12T09:44:21.521245+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:19.449520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:19.449520+0000","last_clean_scrub_stamp":"2023-12-12T09:44:19.449520+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T16:36:32.055010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-12T09:44:24.020168+0000","last_change":"2023-12-12T09:44:21.520102+0000","last_active":"2023-12-12T09:44:24.020168+0000","last_peered":"2023-12-12T09:44:24.020168+0000","last_clean":"2023-12-12T09:44:24.020168+0000","last_became_active":"2023-12-12T09:44:21.517595+0000","last_became_peered":"2023-12-12T09:44:21.517595+0000","last_unstale":"2023-12-12T09:44:24.020168+0000","last_undegraded":"2023-12-12T09:44:24.020168+0000","last_fullsized":"2023-12-12T09:44:24.020168+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_clean_scrub_stamp":"2023-12-12T09:44:20.465592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T12:07:42.924447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-12T09:44:34.598834+0000","last_change":"2023-12-12T09:44:34.598834+0000","last_active":"2023-12-12T09:44:34.598834+0000","last_peered":"2023-12-12T09:44:34.598834+0000","last_clean":"2023-12-12T09:44:34.598834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:44:34.598834+0000","last_undegraded":"2023-12-12T09:44:34.598834+0000","last_fullsized":"2023-12-12T09:44:34.598834+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:34.598834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:34.598834+0000","last_clean_scrub_stamp":"2023-12-12T09:44:34.598834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-12T09:44:35.613810+0000","last_change":"2023-12-12T09:44:35.613810+0000","last_active":"2023-12-12T09:44:35.613810+0000","last_peered":"2023-12-12T09:44:35.613810+0000","last_clean":"2023-12-12T09:44:35.613810+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:44:35.613810+0000","last_undegraded":"2023-12-12T09:44:35.613810+0000","last_fullsized":"2023-12-12T09:44:35.613810+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:35.613810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:35.613810+0000","last_clean_scrub_stamp":"2023-12-12T09:44:35.613810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-12T09:44:22.513103+0000","last_change":"2023-12-12T09:44:21.533072+0000","last_active":"2023-12-12T09:44:22.513103+0000","last_peered":"2023-12-12T09:44:22.513103+0000","last_clean":"2023-12-12T09:44:22.513103+0000","last_became_active":"2023-12-12T09:44:21.532524+0000","last_became_peered":"2023-12-12T09:44:21.532524+0000","last_unstale":"2023-12-12T09:44:22.513103+0000","last_undegraded":"2023-12-12T09:44:22.513103+0000","last_fullsized":"2023-12-12T09:44:22.513103+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_clean_scrub_stamp":"2023-12-12T09:44:20.465592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T12:21:37.296506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-12T09:44:35.613810+0000","last_change":"2023-12-12T09:44:35.613810+0000","last_active":"2023-12-12T09:44:35.613810+0000","last_peered":"2023-12-12T09:44:35.613810+0000","last_clean":"2023-12-12T09:44:35.613810+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:44:35.613810+0000","last_undegraded":"2023-12-12T09:44:35.613810+0000","last_fullsized":"2023-12-12T09:44:35.613810+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:35.613810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:35.613810+0000","last_clean_scrub_stamp":"2023-12-12T09:44:35.613810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-12T09:44:22.686183+0000","last_change":"2023-12-12T09:44:21.511525+0000","last_active":"2023-12-12T09:44:22.686183+0000","last_peered":"2023-12-12T09:44:22.686183+0000","last_clean":"2023-12-12T09:44:22.686183+0000","last_became_active":"2023-12-12T09:44:21.511270+0000","last_became_peered":"2023-12-12T09:44:21.511270+0000","last_unstale":"2023-12-12T09:44:22.686183+0000","last_undegraded":"2023-12-12T09:44:22.686183+0000","last_fullsized":"2023-12-12T09:44:22.686183+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_clean_scrub_stamp":"2023-12-12T09:44:20.465592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T12:00:33.415612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-12T09:44:35.613810+0000","last_change":"2023-12-12T09:44:35.613810+0000","last_active":"2023-12-12T09:44:35.613810+0000","last_peered":"2023-12-12T09:44:35.613810+0000","last_clean":"2023-12-12T09:44:35.613810+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:44:35.613810+0000","last_undegraded":"2023-12-12T09:44:35.613810+0000","last_fullsized":"2023-12-12T09:44:35.613810+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:35.613810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:35.613810+0000","last_clean_scrub_stamp":"2023-12-12T09:44:35.613810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-12T09:44:22.513416+0000","last_change":"2023-12-12T09:44:21.525189+0000","last_active":"2023-12-12T09:44:22.513416+0000","last_peered":"2023-12-12T09:44:22.513416+0000","last_clean":"2023-12-12T09:44:22.513416+0000","last_became_active":"2023-12-12T09:44:21.524872+0000","last_became_peered":"2023-12-12T09:44:21.524872+0000","last_unstale":"2023-12-12T09:44:22.513416+0000","last_undegraded":"2023-12-12T09:44:22.513416+0000","last_fullsized":"2023-12-12T09:44:22.513416+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_clean_scrub_stamp":"2023-12-12T09:44:20.465592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T10:03:17.158642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-12T09:44:35.613810+0000","last_change":"2023-12-12T09:44:35.613810+0000","last_active":"2023-12-12T09:44:35.613810+0000","last_peered":"2023-12-12T09:44:35.613810+0000","last_clean":"2023-12-12T09:44:35.613810+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:44:35.613810+0000","last_undegraded":"2023-12-12T09:44:35.613810+0000","last_fullsized":"2023-12-12T09:44:35.613810+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:35.613810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:35.613810+0000","last_clean_scrub_stamp":"2023-12-12T09:44:35.613810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-12T09:44:24.020721+0000","last_change":"2023-12-12T09:44:21.529115+0000","last_active":"2023-12-12T09:44:24.020721+0000","last_peered":"2023-12-12T09:44:24.020721+0000","last_clean":"2023-12-12T09:44:24.020721+0000","last_became_active":"2023-12-12T09:44:21.528843+0000","last_became_peered":"2023-12-12T09:44:21.528843+0000","last_unstale":"2023-12-12T09:44:24.020721+0000","last_undegraded":"2023-12-12T09:44:24.020721+0000","last_fullsized":"2023-12-12T09:44:24.020721+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_clean_scrub_stamp":"2023-12-12T09:44:20.465592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T12:38:15.250056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-12T09:44:35.613810+0000","last_change":"2023-12-12T09:44:35.613810+0000","last_active":"2023-12-12T09:44:35.613810+0000","last_peered":"2023-12-12T09:44:35.613810+0000","last_clean":"2023-12-12T09:44:35.613810+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:44:35.613810+0000","last_undegraded":"2023-12-12T09:44:35.613810+0000","last_fullsized":"2023-12-12T09:44:35.613810+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:35.613810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:35.613810+0000","last_clean_scrub_stamp":"2023-12-12T09:44:35.613810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-12T09:44:22.516135+0000","last_change":"2023-12-12T09:44:21.517720+0000","last_active":"2023-12-12T09:44:22.516135+0000","last_peered":"2023-12-12T09:44:22.516135+0000","last_clean":"2023-12-12T09:44:22.516135+0000","last_became_active":"2023-12-12T09:44:21.517332+0000","last_became_peered":"2023-12-12T09:44:21.517332+0000","last_unstale":"2023-12-12T09:44:22.516135+0000","last_undegraded":"2023-12-12T09:44:22.516135+0000","last_fullsized":"2023-12-12T09:44:22.516135+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_clean_scrub_stamp":"2023-12-12T09:44:20.465592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T13:05:01.026963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-12T09:44:35.613810+0000","last_change":"2023-12-12T09:44:35.613810+0000","last_active":"2023-12-12T09:44:35.613810+0000","last_peered":"2023-12-12T09:44:35.613810+0000","last_clean":"2023-12-12T09:44:35.613810+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:44:35.613810+0000","last_undegraded":"2023-12-12T09:44:35.613810+0000","last_fullsized":"2023-12-12T09:44:35.613810+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:35.613810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:35.613810+0000","last_clean_scrub_stamp":"2023-12-12T09:44:35.613810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-12T09:44:24.021839+0000","last_change":"2023-12-12T09:44:21.532041+0000","last_active":"2023-12-12T09:44:24.021839+0000","last_peered":"2023-12-12T09:44:24.021839+0000","last_clean":"2023-12-12T09:44:24.021839+0000","last_became_active":"2023-12-12T09:44:21.531731+0000","last_became_peered":"2023-12-12T09:44:21.531731+0000","last_unstale":"2023-12-12T09:44:24.021839+0000","last_undegraded":"2023-12-12T09:44:24.021839+0000","last_fullsized":"2023-12-12T09:44:24.021839+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_clean_scrub_stamp":"2023-12-12T09:44:20.465592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T12:21:37.296506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-12T09:44:35.613810+0000","last_change":"2023-12-12T09:44:35.613810+0000","last_active":"2023-12-12T09:44:35.613810+0000","last_peered":"2023-12-12T09:44:35.613810+0000","last_clean":"2023-12-12T09:44:35.613810+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:44:35.613810+0000","last_undegraded":"2023-12-12T09:44:35.613810+0000","last_fullsized":"2023-12-12T09:44:35.613810+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:35.613810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:35.613810+0000","last_clean_scrub_stamp":"2023-12-12T09:44:35.613810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-12T09:44:22.510146+0000","last_change":"2023-12-12T09:44:21.522457+0000","last_active":"2023-12-12T09:44:22.510146+0000","last_peered":"2023-12-12T09:44:22.510146+0000","last_clean":"2023-12-12T09:44:22.510146+0000","last_became_active":"2023-12-12T09:44:21.522168+0000","last_became_peered":"2023-12-12T09:44:21.522168+0000","last_unstale":"2023-12-12T09:44:22.510146+0000","last_undegraded":"2023-12-12T09:44:22.510146+0000","last_fullsized":"2023-12-12T09:44:22.510146+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_clean_scrub_stamp":"2023-12-12T09:44:20.465592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T11:42:56.191775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-12T09:44:35.613810+0000","last_change":"2023-12-12T09:44:35.613810+0000","last_active":"2023-12-12T09:44:35.613810+0000","last_peered":"2023-12-12T09:44:35.613810+0000","last_clean":"2023-12-12T09:44:35.613810+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:44:35.613810+0000","last_undegraded":"2023-12-12T09:44:35.613810+0000","last_fullsized":"2023-12-12T09:44:35.613810+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:35.613810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:35.613810+0000","last_clean_scrub_stamp":"2023-12-12T09:44:35.613810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-12T09:44:24.022778+0000","last_change":"2023-12-12T09:44:21.526204+0000","last_active":"2023-12-12T09:44:24.022778+0000","last_peered":"2023-12-12T09:44:24.022778+0000","last_clean":"2023-12-12T09:44:24.022778+0000","last_became_active":"2023-12-12T09:44:21.525855+0000","last_became_peered":"2023-12-12T09:44:21.525855+0000","last_unstale":"2023-12-12T09:44:24.022778+0000","last_undegraded":"2023-12-12T09:44:24.022778+0000","last_fullsized":"2023-12-12T09:44:24.022778+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_clean_scrub_stamp":"2023-12-12T09:44:20.465592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T10:03:17.158642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-12T09:44:35.613810+0000","last_change":"2023-12-12T09:44:35.613810+0000","last_active":"2023-12-12T09:44:35.613810+0000","last_peered":"2023-12-12T09:44:35.613810+0000","last_clean":"2023-12-12T09:44:35.613810+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:44:35.613810+0000","last_undegraded":"2023-12-12T09:44:35.613810+0000","last_fullsized":"2023-12-12T09:44:35.613810+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:35.613810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:35.613810+0000","last_clean_scrub_stamp":"2023-12-12T09:44:35.613810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-12T09:44:22.515006+0000","last_change":"2023-12-12T09:44:21.519677+0000","last_active":"2023-12-12T09:44:22.515006+0000","last_peered":"2023-12-12T09:44:22.515006+0000","last_clean":"2023-12-12T09:44:22.515006+0000","last_became_active":"2023-12-12T09:44:21.519364+0000","last_became_peered":"2023-12-12T09:44:21.519364+0000","last_unstale":"2023-12-12T09:44:22.515006+0000","last_undegraded":"2023-12-12T09:44:22.515006+0000","last_fullsized":"2023-12-12T09:44:22.515006+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_clean_scrub_stamp":"2023-12-12T09:44:20.465592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T11:40:20.775860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-12T09:44:35.613810+0000","last_change":"2023-12-12T09:44:35.613810+0000","last_active":"2023-12-12T09:44:35.613810+0000","last_peered":"2023-12-12T09:44:35.613810+0000","last_clean":"2023-12-12T09:44:35.613810+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:44:35.613810+0000","last_undegraded":"2023-12-12T09:44:35.613810+0000","last_fullsized":"2023-12-12T09:44:35.613810+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:35.613810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:35.613810+0000","last_clean_scrub_stamp":"2023-12-12T09:44:35.613810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-12T09:44:24.019206+0000","last_change":"2023-12-12T09:44:21.522714+0000","last_active":"2023-12-12T09:44:24.019206+0000","last_peered":"2023-12-12T09:44:24.019206+0000","last_clean":"2023-12-12T09:44:24.019206+0000","last_became_active":"2023-12-12T09:44:21.519272+0000","last_became_peered":"2023-12-12T09:44:21.519272+0000","last_unstale":"2023-12-12T09:44:24.019206+0000","last_undegraded":"2023-12-12T09:44:24.019206+0000","last_fullsized":"2023-12-12T09:44:24.019206+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_clean_scrub_stamp":"2023-12-12T09:44:20.465592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T21:42:36.877781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-12T09:44:35.613810+0000","last_change":"2023-12-12T09:44:35.613810+0000","last_active":"2023-12-12T09:44:35.613810+0000","last_peered":"2023-12-12T09:44:35.613810+0000","last_clean":"2023-12-12T09:44:35.613810+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:44:35.613810+0000","last_undegraded":"2023-12-12T09:44:35.613810+0000","last_fullsized":"2023-12-12T09:44:35.613810+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:35.613810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:35.613810+0000","last_clean_scrub_stamp":"2023-12-12T09:44:35.613810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-12T09:44:24.020967+0000","last_change":"2023-12-12T09:44:21.507419+0000","last_active":"2023-12-12T09:44:24.020967+0000","last_peered":"2023-12-12T09:44:24.020967+0000","last_clean":"2023-12-12T09:44:24.020967+0000","last_became_active":"2023-12-12T09:44:21.507005+0000","last_became_peered":"2023-12-12T09:44:21.507005+0000","last_unstale":"2023-12-12T09:44:24.020967+0000","last_undegraded":"2023-12-12T09:44:24.020967+0000","last_fullsized":"2023-12-12T09:44:24.020967+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_clean_scrub_stamp":"2023-12-12T09:44:20.465592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T14:50:35.888381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-12T09:44:35.613810+0000","last_change":"2023-12-12T09:44:35.613810+0000","last_active":"2023-12-12T09:44:35.613810+0000","last_peered":"2023-12-12T09:44:35.613810+0000","last_clean":"2023-12-12T09:44:35.613810+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:44:35.613810+0000","last_undegraded":"2023-12-12T09:44:35.613810+0000","last_fullsized":"2023-12-12T09:44:35.613810+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:35.613810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:35.613810+0000","last_clean_scrub_stamp":"2023-12-12T09:44:35.613810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-12T09:44:24.020043+0000","last_change":"2023-12-12T09:44:21.524113+0000","last_active":"2023-12-12T09:44:24.020043+0000","last_peered":"2023-12-12T09:44:24.020043+0000","last_clean":"2023-12-12T09:44:24.020043+0000","last_became_active":"2023-12-12T09:44:21.523749+0000","last_became_peered":"2023-12-12T09:44:21.523749+0000","last_unstale":"2023-12-12T09:44:24.020043+0000","last_undegraded":"2023-12-12T09:44:24.020043+0000","last_fullsized":"2023-12-12T09:44:24.020043+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_clean_scrub_stamp":"2023-12-12T09:44:20.465592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T21:19:34.161140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-12T09:44:35.613810+0000","last_change":"2023-12-12T09:44:35.613810+0000","last_active":"2023-12-12T09:44:35.613810+0000","last_peered":"2023-12-12T09:44:35.613810+0000","last_clean":"2023-12-12T09:44:35.613810+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:44:35.613810+0000","last_undegraded":"2023-12-12T09:44:35.613810+0000","last_fullsized":"2023-12-12T09:44:35.613810+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:35.613810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:35.613810+0000","last_clean_scrub_stamp":"2023-12-12T09:44:35.613810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-12T09:44:24.022105+0000","last_change":"2023-12-12T09:44:21.521072+0000","last_active":"2023-12-12T09:44:24.022105+0000","last_peered":"2023-12-12T09:44:24.022105+0000","last_clean":"2023-12-12T09:44:24.022105+0000","last_became_active":"2023-12-12T09:44:21.520779+0000","last_became_peered":"2023-12-12T09:44:21.520779+0000","last_unstale":"2023-12-12T09:44:24.022105+0000","last_undegraded":"2023-12-12T09:44:24.022105+0000","last_fullsized":"2023-12-12T09:44:24.022105+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_clean_scrub_stamp":"2023-12-12T09:44:20.465592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T18:50:23.713305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-12T09:44:35.613810+0000","last_change":"2023-12-12T09:44:35.613810+0000","last_active":"2023-12-12T09:44:35.613810+0000","last_peered":"2023-12-12T09:44:35.613810+0000","last_clean":"2023-12-12T09:44:35.613810+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:44:35.613810+0000","last_undegraded":"2023-12-12T09:44:35.613810+0000","last_fullsized":"2023-12-12T09:44:35.613810+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:35.613810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:35.613810+0000","last_clean_scrub_stamp":"2023-12-12T09:44:35.613810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-12T09:44:22.509308+0000","last_change":"2023-12-12T09:44:21.515576+0000","last_active":"2023-12-12T09:44:22.509308+0000","last_peered":"2023-12-12T09:44:22.509308+0000","last_clean":"2023-12-12T09:44:22.509308+0000","last_became_active":"2023-12-12T09:44:21.515246+0000","last_became_peered":"2023-12-12T09:44:21.515246+0000","last_unstale":"2023-12-12T09:44:22.509308+0000","last_undegraded":"2023-12-12T09:44:22.509308+0000","last_fullsized":"2023-12-12T09:44:22.509308+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_clean_scrub_stamp":"2023-12-12T09:44:20.465592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T13:05:01.026963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-12T09:44:35.613810+0000","last_change":"2023-12-12T09:44:35.613810+0000","last_active":"2023-12-12T09:44:35.613810+0000","last_peered":"2023-12-12T09:44:35.613810+0000","last_clean":"2023-12-12T09:44:35.613810+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:44:35.613810+0000","last_undegraded":"2023-12-12T09:44:35.613810+0000","last_fullsized":"2023-12-12T09:44:35.613810+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:35.613810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:35.613810+0000","last_clean_scrub_stamp":"2023-12-12T09:44:35.613810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-12T09:44:22.509834+0000","last_change":"2023-12-12T09:44:21.510970+0000","last_active":"2023-12-12T09:44:22.509834+0000","last_peered":"2023-12-12T09:44:22.509834+0000","last_clean":"2023-12-12T09:44:22.509834+0000","last_became_active":"2023-12-12T09:44:21.508875+0000","last_became_peered":"2023-12-12T09:44:21.508875+0000","last_unstale":"2023-12-12T09:44:22.509834+0000","last_undegraded":"2023-12-12T09:44:22.509834+0000","last_fullsized":"2023-12-12T09:44:22.509834+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_clean_scrub_stamp":"2023-12-12T09:44:20.465592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T11:36:54.156220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-12T09:44:35.613810+0000","last_change":"2023-12-12T09:44:35.613810+0000","last_active":"2023-12-12T09:44:35.613810+0000","last_peered":"2023-12-12T09:44:35.613810+0000","last_clean":"2023-12-12T09:44:35.613810+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:44:35.613810+0000","last_undegraded":"2023-12-12T09:44:35.613810+0000","last_fullsized":"2023-12-12T09:44:35.613810+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:35.613810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:35.613810+0000","last_clean_scrub_stamp":"2023-12-12T09:44:35.613810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-12T09:44:22.514859+0000","last_change":"2023-12-12T09:44:21.524561+0000","last_active":"2023-12-12T09:44:22.514859+0000","last_peered":"2023-12-12T09:44:22.514859+0000","last_clean":"2023-12-12T09:44:22.514859+0000","last_became_active":"2023-12-12T09:44:21.524316+0000","last_became_peered":"2023-12-12T09:44:21.524316+0000","last_unstale":"2023-12-12T09:44:22.514859+0000","last_undegraded":"2023-12-12T09:44:22.514859+0000","last_fullsized":"2023-12-12T09:44:22.514859+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_clean_scrub_stamp":"2023-12-12T09:44:20.465592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T18:05:42.865925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-12T09:44:35.613810+0000","last_change":"2023-12-12T09:44:35.613810+0000","last_active":"2023-12-12T09:44:35.613810+0000","last_peered":"2023-12-12T09:44:35.613810+0000","last_clean":"2023-12-12T09:44:35.613810+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:44:35.613810+0000","last_undegraded":"2023-12-12T09:44:35.613810+0000","last_fullsized":"2023-12-12T09:44:35.613810+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:35.613810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:35.613810+0000","last_clean_scrub_stamp":"2023-12-12T09:44:35.613810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-12T09:44:22.513635+0000","last_change":"2023-12-12T09:44:21.526715+0000","last_active":"2023-12-12T09:44:22.513635+0000","last_peered":"2023-12-12T09:44:22.513635+0000","last_clean":"2023-12-12T09:44:22.513635+0000","last_became_active":"2023-12-12T09:44:21.526475+0000","last_became_peered":"2023-12-12T09:44:21.526475+0000","last_unstale":"2023-12-12T09:44:22.513635+0000","last_undegraded":"2023-12-12T09:44:22.513635+0000","last_fullsized":"2023-12-12T09:44:22.513635+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_clean_scrub_stamp":"2023-12-12T09:44:20.465592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T20:53:13.479872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-12T09:44:35.613810+0000","last_change":"2023-12-12T09:44:35.613810+0000","last_active":"2023-12-12T09:44:35.613810+0000","last_peered":"2023-12-12T09:44:35.613810+0000","last_clean":"2023-12-12T09:44:35.613810+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:44:35.613810+0000","last_undegraded":"2023-12-12T09:44:35.613810+0000","last_fullsized":"2023-12-12T09:44:35.613810+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:35.613810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:35.613810+0000","last_clean_scrub_stamp":"2023-12-12T09:44:35.613810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-12T09:44:22.515117+0000","last_change":"2023-12-12T09:44:21.517469+0000","last_active":"2023-12-12T09:44:22.515117+0000","last_peered":"2023-12-12T09:44:22.515117+0000","last_clean":"2023-12-12T09:44:22.515117+0000","last_became_active":"2023-12-12T09:44:21.517156+0000","last_became_peered":"2023-12-12T09:44:21.517156+0000","last_unstale":"2023-12-12T09:44:22.515117+0000","last_undegraded":"2023-12-12T09:44:22.515117+0000","last_fullsized":"2023-12-12T09:44:22.515117+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_clean_scrub_stamp":"2023-12-12T09:44:20.465592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T20:58:54.834367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-12T09:44:35.613810+0000","last_change":"2023-12-12T09:44:35.613810+0000","last_active":"2023-12-12T09:44:35.613810+0000","last_peered":"2023-12-12T09:44:35.613810+0000","last_clean":"2023-12-12T09:44:35.613810+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:44:35.613810+0000","last_undegraded":"2023-12-12T09:44:35.613810+0000","last_fullsized":"2023-12-12T09:44:35.613810+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:35.613810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:35.613810+0000","last_clean_scrub_stamp":"2023-12-12T09:44:35.613810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-12T09:44:22.510035+0000","last_change":"2023-12-12T09:44:21.515103+0000","last_active":"2023-12-12T09:44:22.510035+0000","last_peered":"2023-12-12T09:44:22.510035+0000","last_clean":"2023-12-12T09:44:22.510035+0000","last_became_active":"2023-12-12T09:44:21.514438+0000","last_became_peered":"2023-12-12T09:44:21.514438+0000","last_unstale":"2023-12-12T09:44:22.510035+0000","last_undegraded":"2023-12-12T09:44:22.510035+0000","last_fullsized":"2023-12-12T09:44:22.510035+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_clean_scrub_stamp":"2023-12-12T09:44:20.465592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T18:05:42.865925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-12T09:44:35.613810+0000","last_change":"2023-12-12T09:44:35.613810+0000","last_active":"2023-12-12T09:44:35.613810+0000","last_peered":"2023-12-12T09:44:35.613810+0000","last_clean":"2023-12-12T09:44:35.613810+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:44:35.613810+0000","last_undegraded":"2023-12-12T09:44:35.613810+0000","last_fullsized":"2023-12-12T09:44:35.613810+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:35.613810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:35.613810+0000","last_clean_scrub_stamp":"2023-12-12T09:44:35.613810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-12T09:44:24.021696+0000","last_change":"2023-12-12T09:44:21.510175+0000","last_active":"2023-12-12T09:44:24.021696+0000","last_peered":"2023-12-12T09:44:24.021696+0000","last_clean":"2023-12-12T09:44:24.021696+0000","last_became_active":"2023-12-12T09:44:21.509923+0000","last_became_peered":"2023-12-12T09:44:21.509923+0000","last_unstale":"2023-12-12T09:44:24.021696+0000","last_undegraded":"2023-12-12T09:44:24.021696+0000","last_fullsized":"2023-12-12T09:44:24.021696+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_clean_scrub_stamp":"2023-12-12T09:44:20.465592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T18:46:45.450477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-12T09:44:35.613810+0000","last_change":"2023-12-12T09:44:35.613810+0000","last_active":"2023-12-12T09:44:35.613810+0000","last_peered":"2023-12-12T09:44:35.613810+0000","last_clean":"2023-12-12T09:44:35.613810+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:44:35.613810+0000","last_undegraded":"2023-12-12T09:44:35.613810+0000","last_fullsized":"2023-12-12T09:44:35.613810+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:35.613810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:35.613810+0000","last_clean_scrub_stamp":"2023-12-12T09:44:35.613810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-12T09:44:22.515933+0000","last_change":"2023-12-12T09:44:21.517566+0000","last_active":"2023-12-12T09:44:22.515933+0000","last_peered":"2023-12-12T09:44:22.515933+0000","last_clean":"2023-12-12T09:44:22.515933+0000","last_became_active":"2023-12-12T09:44:21.517004+0000","last_became_peered":"2023-12-12T09:44:21.517004+0000","last_unstale":"2023-12-12T09:44:22.515933+0000","last_undegraded":"2023-12-12T09:44:22.515933+0000","last_fullsized":"2023-12-12T09:44:22.515933+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_clean_scrub_stamp":"2023-12-12T09:44:20.465592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T10:50:32.155095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-12T09:44:35.613810+0000","last_change":"2023-12-12T09:44:35.613810+0000","last_active":"2023-12-12T09:44:35.613810+0000","last_peered":"2023-12-12T09:44:35.613810+0000","last_clean":"2023-12-12T09:44:35.613810+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:44:35.613810+0000","last_undegraded":"2023-12-12T09:44:35.613810+0000","last_fullsized":"2023-12-12T09:44:35.613810+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:35.613810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:35.613810+0000","last_clean_scrub_stamp":"2023-12-12T09:44:35.613810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-12T09:44:22.514214+0000","last_change":"2023-12-12T09:44:21.536596+0000","last_active":"2023-12-12T09:44:22.514214+0000","last_peered":"2023-12-12T09:44:22.514214+0000","last_clean":"2023-12-12T09:44:22.514214+0000","last_became_active":"2023-12-12T09:44:21.536304+0000","last_became_peered":"2023-12-12T09:44:21.536304+0000","last_unstale":"2023-12-12T09:44:22.514214+0000","last_undegraded":"2023-12-12T09:44:22.514214+0000","last_fullsized":"2023-12-12T09:44:22.514214+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_clean_scrub_stamp":"2023-12-12T09:44:20.465592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T11:36:54.156220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-12T09:44:35.613810+0000","last_change":"2023-12-12T09:44:35.613810+0000","last_active":"2023-12-12T09:44:35.613810+0000","last_peered":"2023-12-12T09:44:35.613810+0000","last_clean":"2023-12-12T09:44:35.613810+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:44:35.613810+0000","last_undegraded":"2023-12-12T09:44:35.613810+0000","last_fullsized":"2023-12-12T09:44:35.613810+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:35.613810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:35.613810+0000","last_clean_scrub_stamp":"2023-12-12T09:44:35.613810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-12T09:44:24.020933+0000","last_change":"2023-12-12T09:44:21.515196+0000","last_active":"2023-12-12T09:44:24.020933+0000","last_peered":"2023-12-12T09:44:24.020933+0000","last_clean":"2023-12-12T09:44:24.020933+0000","last_became_active":"2023-12-12T09:44:21.514944+0000","last_became_peered":"2023-12-12T09:44:21.514944+0000","last_unstale":"2023-12-12T09:44:24.020933+0000","last_undegraded":"2023-12-12T09:44:24.020933+0000","last_fullsized":"2023-12-12T09:44:24.020933+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_clean_scrub_stamp":"2023-12-12T09:44:20.465592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T14:50:35.888381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-12T09:44:35.613810+0000","last_change":"2023-12-12T09:44:35.613810+0000","last_active":"2023-12-12T09:44:35.613810+0000","last_peered":"2023-12-12T09:44:35.613810+0000","last_clean":"2023-12-12T09:44:35.613810+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:44:35.613810+0000","last_undegraded":"2023-12-12T09:44:35.613810+0000","last_fullsized":"2023-12-12T09:44:35.613810+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:35.613810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:35.613810+0000","last_clean_scrub_stamp":"2023-12-12T09:44:35.613810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-12T09:44:24.020933+0000","last_change":"2023-12-12T09:44:21.531885+0000","last_active":"2023-12-12T09:44:24.020933+0000","last_peered":"2023-12-12T09:44:24.020933+0000","last_clean":"2023-12-12T09:44:24.020933+0000","last_became_active":"2023-12-12T09:44:21.531436+0000","last_became_peered":"2023-12-12T09:44:21.531436+0000","last_unstale":"2023-12-12T09:44:24.020933+0000","last_undegraded":"2023-12-12T09:44:24.020933+0000","last_fullsized":"2023-12-12T09:44:24.020933+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_clean_scrub_stamp":"2023-12-12T09:44:20.465592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T18:54:29.796762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-12T09:44:35.613810+0000","last_change":"2023-12-12T09:44:35.613810+0000","last_active":"2023-12-12T09:44:35.613810+0000","last_peered":"2023-12-12T09:44:35.613810+0000","last_clean":"2023-12-12T09:44:35.613810+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:44:35.613810+0000","last_undegraded":"2023-12-12T09:44:35.613810+0000","last_fullsized":"2023-12-12T09:44:35.613810+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:35.613810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:35.613810+0000","last_clean_scrub_stamp":"2023-12-12T09:44:35.613810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-12T09:44:22.513007+0000","last_change":"2023-12-12T09:44:21.526128+0000","last_active":"2023-12-12T09:44:22.513007+0000","last_peered":"2023-12-12T09:44:22.513007+0000","last_clean":"2023-12-12T09:44:22.513007+0000","last_became_active":"2023-12-12T09:44:21.521368+0000","last_became_peered":"2023-12-12T09:44:21.521368+0000","last_unstale":"2023-12-12T09:44:22.513007+0000","last_undegraded":"2023-12-12T09:44:22.513007+0000","last_fullsized":"2023-12-12T09:44:22.513007+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_clean_scrub_stamp":"2023-12-12T09:44:20.465592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T20:58:54.834367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-12T09:44:35.613810+0000","last_change":"2023-12-12T09:44:35.613810+0000","last_active":"2023-12-12T09:44:35.613810+0000","last_peered":"2023-12-12T09:44:35.613810+0000","last_clean":"2023-12-12T09:44:35.613810+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:44:35.613810+0000","last_undegraded":"2023-12-12T09:44:35.613810+0000","last_fullsized":"2023-12-12T09:44:35.613810+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:35.613810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:35.613810+0000","last_clean_scrub_stamp":"2023-12-12T09:44:35.613810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-12T09:44:22.513863+0000","last_change":"2023-12-12T09:44:21.526135+0000","last_active":"2023-12-12T09:44:22.513863+0000","last_peered":"2023-12-12T09:44:22.513863+0000","last_clean":"2023-12-12T09:44:22.513863+0000","last_became_active":"2023-12-12T09:44:21.525852+0000","last_became_peered":"2023-12-12T09:44:21.525852+0000","last_unstale":"2023-12-12T09:44:22.513863+0000","last_undegraded":"2023-12-12T09:44:22.513863+0000","last_fullsized":"2023-12-12T09:44:22.513863+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_clean_scrub_stamp":"2023-12-12T09:44:20.465592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T21:03:17.881060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-12T09:44:35.613810+0000","last_change":"2023-12-12T09:44:35.613810+0000","last_active":"2023-12-12T09:44:35.613810+0000","last_peered":"2023-12-12T09:44:35.613810+0000","last_clean":"2023-12-12T09:44:35.613810+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:44:35.613810+0000","last_undegraded":"2023-12-12T09:44:35.613810+0000","last_fullsized":"2023-12-12T09:44:35.613810+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:35.613810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:35.613810+0000","last_clean_scrub_stamp":"2023-12-12T09:44:35.613810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-12T09:44:22.510245+0000","last_change":"2023-12-12T09:44:21.520418+0000","last_active":"2023-12-12T09:44:22.510245+0000","last_peered":"2023-12-12T09:44:22.510245+0000","last_clean":"2023-12-12T09:44:22.510245+0000","last_became_active":"2023-12-12T09:44:21.520070+0000","last_became_peered":"2023-12-12T09:44:21.520070+0000","last_unstale":"2023-12-12T09:44:22.510245+0000","last_undegraded":"2023-12-12T09:44:22.510245+0000","last_fullsized":"2023-12-12T09:44:22.510245+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_clean_scrub_stamp":"2023-12-12T09:44:20.465592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T20:42:57.403954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-12T09:44:35.613810+0000","last_change":"2023-12-12T09:44:35.613810+0000","last_active":"2023-12-12T09:44:35.613810+0000","last_peered":"2023-12-12T09:44:35.613810+0000","last_clean":"2023-12-12T09:44:35.613810+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:44:35.613810+0000","last_undegraded":"2023-12-12T09:44:35.613810+0000","last_fullsized":"2023-12-12T09:44:35.613810+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:35.613810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:35.613810+0000","last_clean_scrub_stamp":"2023-12-12T09:44:35.613810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-12T09:44:24.021568+0000","last_change":"2023-12-12T09:44:21.517132+0000","last_active":"2023-12-12T09:44:24.021568+0000","last_peered":"2023-12-12T09:44:24.021568+0000","last_clean":"2023-12-12T09:44:24.021568+0000","last_became_active":"2023-12-12T09:44:21.516794+0000","last_became_peered":"2023-12-12T09:44:21.516794+0000","last_unstale":"2023-12-12T09:44:24.021568+0000","last_undegraded":"2023-12-12T09:44:24.021568+0000","last_fullsized":"2023-12-12T09:44:24.021568+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_clean_scrub_stamp":"2023-12-12T09:44:20.465592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T14:59:37.496347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-12T09:44:35.613810+0000","last_change":"2023-12-12T09:44:35.613810+0000","last_active":"2023-12-12T09:44:35.613810+0000","last_peered":"2023-12-12T09:44:35.613810+0000","last_clean":"2023-12-12T09:44:35.613810+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:44:35.613810+0000","last_undegraded":"2023-12-12T09:44:35.613810+0000","last_fullsized":"2023-12-12T09:44:35.613810+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:35.613810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:35.613810+0000","last_clean_scrub_stamp":"2023-12-12T09:44:35.613810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-12T09:44:24.021218+0000","last_change":"2023-12-12T09:44:21.536425+0000","last_active":"2023-12-12T09:44:24.021218+0000","last_peered":"2023-12-12T09:44:24.021218+0000","last_clean":"2023-12-12T09:44:24.021218+0000","last_became_active":"2023-12-12T09:44:21.534962+0000","last_became_peered":"2023-12-12T09:44:21.534962+0000","last_unstale":"2023-12-12T09:44:24.021218+0000","last_undegraded":"2023-12-12T09:44:24.021218+0000","last_fullsized":"2023-12-12T09:44:24.021218+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_clean_scrub_stamp":"2023-12-12T09:44:20.465592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T11:40:20.775860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-12T09:44:35.613810+0000","last_change":"2023-12-12T09:44:35.613810+0000","last_active":"2023-12-12T09:44:35.613810+0000","last_peered":"2023-12-12T09:44:35.613810+0000","last_clean":"2023-12-12T09:44:35.613810+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:44:35.613810+0000","last_undegraded":"2023-12-12T09:44:35.613810+0000","last_fullsized":"2023-12-12T09:44:35.613810+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:35.613810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:35.613810+0000","last_clean_scrub_stamp":"2023-12-12T09:44:35.613810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-12T09:44:22.516115+0000","last_change":"2023-12-12T09:44:21.516991+0000","last_active":"2023-12-12T09:44:22.516115+0000","last_peered":"2023-12-12T09:44:22.516115+0000","last_clean":"2023-12-12T09:44:22.516115+0000","last_became_active":"2023-12-12T09:44:21.516690+0000","last_became_peered":"2023-12-12T09:44:21.516690+0000","last_unstale":"2023-12-12T09:44:22.516115+0000","last_undegraded":"2023-12-12T09:44:22.516115+0000","last_fullsized":"2023-12-12T09:44:22.516115+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_clean_scrub_stamp":"2023-12-12T09:44:20.465592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T20:53:13.479872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-12T09:44:35.613810+0000","last_change":"2023-12-12T09:44:35.613810+0000","last_active":"2023-12-12T09:44:35.613810+0000","last_peered":"2023-12-12T09:44:35.613810+0000","last_clean":"2023-12-12T09:44:35.613810+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:44:35.613810+0000","last_undegraded":"2023-12-12T09:44:35.613810+0000","last_fullsized":"2023-12-12T09:44:35.613810+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:35.613810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:35.613810+0000","last_clean_scrub_stamp":"2023-12-12T09:44:35.613810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-12T09:44:22.509764+0000","last_change":"2023-12-12T09:44:21.513912+0000","last_active":"2023-12-12T09:44:22.509764+0000","last_peered":"2023-12-12T09:44:22.509764+0000","last_clean":"2023-12-12T09:44:22.509764+0000","last_became_active":"2023-12-12T09:44:21.513624+0000","last_became_peered":"2023-12-12T09:44:21.513624+0000","last_unstale":"2023-12-12T09:44:22.509764+0000","last_undegraded":"2023-12-12T09:44:22.509764+0000","last_fullsized":"2023-12-12T09:44:22.509764+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_clean_scrub_stamp":"2023-12-12T09:44:20.465592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T14:08:30.510607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-12T09:44:35.613810+0000","last_change":"2023-12-12T09:44:35.613810+0000","last_active":"2023-12-12T09:44:35.613810+0000","last_peered":"2023-12-12T09:44:35.613810+0000","last_clean":"2023-12-12T09:44:35.613810+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:44:35.613810+0000","last_undegraded":"2023-12-12T09:44:35.613810+0000","last_fullsized":"2023-12-12T09:44:35.613810+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:35.613810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:35.613810+0000","last_clean_scrub_stamp":"2023-12-12T09:44:35.613810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3f","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-12T09:44:22.686611+0000","last_change":"2023-12-12T09:44:21.521409+0000","last_active":"2023-12-12T09:44:22.686611+0000","last_peered":"2023-12-12T09:44:22.686611+0000","last_clean":"2023-12-12T09:44:22.686611+0000","last_became_active":"2023-12-12T09:44:21.520807+0000","last_became_peered":"2023-12-12T09:44:21.520807+0000","last_unstale":"2023-12-12T09:44:22.686611+0000","last_undegraded":"2023-12-12T09:44:22.686611+0000","last_fullsized":"2023-12-12T09:44:22.686611+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_clean_scrub_stamp":"2023-12-12T09:44:20.465592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T10:43:48.035299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":3905,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":7810,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":41,"ondisk_log_size":41,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":64844,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574868,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27468,"kb_used_data":444,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344372,"statfs":{"total":96636764160,"available":96608636928,"internally_reserved":0,"allocated":454656,"data_stored":741230,"data_compressed":32422,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 12 09:44:15 2023","interfaces":[{"interface":"back","average":{"1min":0.999,"5min":0.999,"15min":0.999},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.8089999999999999,"5min":1.8089999999999999,"15min":1.8089999999999999},"last":0.77100000000000002},{"interface":"front","average":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"min":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"max":{"1min":1.4279999999999999,"5min":1.4279999999999999,"15min":1.4279999999999999},"last":0.95499999999999996}]},{"osd":1,"last update":"Tue Dec 12 09:44:15 2023","interfaces":[{"interface":"back","average":{"1min":1.198,"5min":1.198,"15min":1.198},"min":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"max":{"1min":1.7729999999999999,"5min":1.7729999999999999,"15min":1.7729999999999999},"last":0.86499999999999999},{"interface":"front","average":{"1min":1.216,"5min":1.216,"15min":1.216},"min":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"max":{"1min":3.1150000000000002,"5min":3.1150000000000002,"15min":3.1150000000000002},"last":0.91200000000000003}]},{"osd":2,"last update":"Tue Dec 12 09:44:15 2023","interfaces":[{"interface":"back","average":{"1min":1.262,"5min":1.262,"15min":1.262},"min":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"max":{"1min":2.2050000000000001,"5min":2.2050000000000001,"15min":2.2050000000000001},"last":1.212},{"interface":"front","average":{"1min":1.2450000000000001,"5min":1.2450000000000001,"15min":1.2450000000000001},"min":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":3.2759999999999998,"5min":3.2759999999999998,"15min":3.2759999999999998},"last":1.143}]},{"osd":3,"last update":"Tue Dec 12 09:44:15 2023","interfaces":[{"interface":"back","average":{"1min":1.3169999999999999,"5min":1.3169999999999999,"15min":1.3169999999999999},"min":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"max":{"1min":3.1819999999999999,"5min":3.1819999999999999,"15min":3.1819999999999999},"last":1.0900000000000001},{"interface":"front","average":{"1min":1.2949999999999999,"5min":1.2949999999999999,"15min":1.2949999999999999},"min":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"max":{"1min":1.8740000000000001,"5min":1.8740000000000001,"15min":1.8740000000000001},"last":1.0569999999999999}]},{"osd":4,"last update":"Tue Dec 12 09:44:15 2023","interfaces":[{"interface":"back","average":{"1min":1.3520000000000001,"5min":1.3520000000000001,"15min":1.3520000000000001},"min":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"max":{"1min":2.5529999999999999,"5min":2.5529999999999999,"15min":2.5529999999999999},"last":0.83699999999999997},{"interface":"front","average":{"1min":1.4550000000000001,"5min":1.4550000000000001,"15min":1.4550000000000001},"min":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"max":{"1min":2.351,"5min":2.351,"15min":2.351},"last":0.79400000000000004}]},{"osd":5,"last update":"Tue Dec 12 09:44:15 2023","interfaces":[{"interface":"back","average":{"1min":1.335,"5min":1.335,"15min":1.335},"min":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"max":{"1min":1.9610000000000001,"5min":1.9610000000000001,"15min":1.9610000000000001},"last":1.1699999999999999},{"interface":"front","average":{"1min":1.5369999999999999,"5min":1.5369999999999999,"15min":1.5369999999999999},"min":{"1min":1.2050000000000001,"5min":1.2050000000000001,"15min":1.2050000000000001},"max":{"1min":2.4159999999999999,"5min":2.4159999999999999,"15min":2.4159999999999999},"last":1.014}]},{"osd":6,"last update":"Tue Dec 12 09:44:15 2023","interfaces":[{"interface":"back","average":{"1min":1.417,"5min":1.417,"15min":1.417},"min":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"max":{"1min":2.0510000000000002,"5min":2.0510000000000002,"15min":2.0510000000000002},"last":1.5},{"interface":"front","average":{"1min":1.635,"5min":1.635,"15min":1.635},"min":{"1min":1.256,"5min":1.256,"15min":1.256},"max":{"1min":2.5800000000000001,"5min":2.5800000000000001,"15min":2.5800000000000001},"last":1.1100000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574866,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27408,"kb_used_data":384,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344432,"statfs":{"total":96636764160,"available":96608698368,"internally_reserved":0,"allocated":393216,"data_stored":151388,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 12 09:44:14 2023","interfaces":[{"interface":"back","average":{"1min":1.1930000000000001,"5min":1.1930000000000001,"15min":1.1930000000000001},"min":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":3.6429999999999998,"5min":3.6429999999999998,"15min":3.6429999999999998},"last":1.044},{"interface":"front","average":{"1min":1.0700000000000001,"5min":1.0700000000000001,"15min":1.0700000000000001},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":2.6059999999999999,"5min":2.6059999999999999,"15min":2.6059999999999999},"last":1.5780000000000001}]},{"osd":1,"last update":"Tue Dec 12 09:44:14 2023","interfaces":[{"interface":"back","average":{"1min":1.0620000000000001,"5min":1.0620000000000001,"15min":1.0620000000000001},"min":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"max":{"1min":2.0169999999999999,"5min":2.0169999999999999,"15min":2.0169999999999999},"last":1.2929999999999999},{"interface":"front","average":{"1min":1.2010000000000001,"5min":1.2010000000000001,"15min":1.2010000000000001},"min":{"1min":0.747,"5min":0.747,"15min":0.747},"max":{"1min":1.7,"5min":1.7,"15min":1.7},"last":1.369}]},{"osd":2,"last update":"Tue Dec 12 09:44:14 2023","interfaces":[{"interface":"back","average":{"1min":1.236,"5min":1.236,"15min":1.236},"min":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"max":{"1min":1.804,"5min":1.804,"15min":1.804},"last":1.232},{"interface":"front","average":{"1min":1.3129999999999999,"5min":1.3129999999999999,"15min":1.3129999999999999},"min":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"max":{"1min":2.2160000000000002,"5min":2.2160000000000002,"15min":2.2160000000000002},"last":1.3320000000000001}]},{"osd":3,"last update":"Tue Dec 12 09:44:14 2023","interfaces":[{"interface":"back","average":{"1min":1.218,"5min":1.218,"15min":1.218},"min":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"max":{"1min":2.665,"5min":2.665,"15min":2.665},"last":1.0960000000000001},{"interface":"front","average":{"1min":1.2310000000000001,"5min":1.2310000000000001,"15min":1.2310000000000001},"min":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"max":{"1min":1.8620000000000001,"5min":1.8620000000000001,"15min":1.8620000000000001},"last":1.1910000000000001}]},{"osd":4,"last update":"Tue Dec 12 09:44:14 2023","interfaces":[{"interface":"back","average":{"1min":1.2749999999999999,"5min":1.2749999999999999,"15min":1.2749999999999999},"min":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":2.0310000000000001,"5min":2.0310000000000001,"15min":2.0310000000000001},"last":1.143},{"interface":"front","average":{"1min":1.407,"5min":1.407,"15min":1.407},"min":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"max":{"1min":2.2799999999999998,"5min":2.2799999999999998,"15min":2.2799999999999998},"last":1.508}]},{"osd":5,"last update":"Tue Dec 12 09:44:14 2023","interfaces":[{"interface":"back","average":{"1min":1.4410000000000001,"5min":1.4410000000000001,"15min":1.4410000000000001},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":2.1739999999999999,"5min":2.1739999999999999,"15min":2.1739999999999999},"last":0.97499999999999998},{"interface":"front","average":{"1min":1.4770000000000001,"5min":1.4770000000000001,"15min":1.4770000000000001},"min":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"max":{"1min":1.929,"5min":1.929,"15min":1.929},"last":1.4710000000000001}]},{"osd":7,"last update":"Tue Dec 12 09:44:14 2023","interfaces":[{"interface":"back","average":{"1min":1.5089999999999999,"5min":1.5089999999999999,"15min":1.5089999999999999},"min":{"1min":0.754,"5min":0.754,"15min":0.754},"max":{"1min":1.994,"5min":1.994,"15min":1.994},"last":1.2689999999999999},{"interface":"front","average":{"1min":1.5389999999999999,"5min":1.5389999999999999,"15min":1.5389999999999999},"min":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"max":{"1min":2.0800000000000001,"5min":2.0800000000000001,"15min":2.0800000000000001},"last":1.421}]}]},{"osd":5,"up_from":13,"seq":55834574866,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27404,"kb_used_data":384,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344436,"statfs":{"total":96636764160,"available":96608702464,"internally_reserved":0,"allocated":393216,"data_stored":151444,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 12 09:44:14 2023","interfaces":[{"interface":"back","average":{"1min":1.02,"5min":1.02,"15min":1.02},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.5209999999999999,"5min":1.5209999999999999,"15min":1.5209999999999999},"last":1.145},{"interface":"front","average":{"1min":1.1299999999999999,"5min":1.1299999999999999,"15min":1.1299999999999999},"min":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"max":{"1min":1.508,"5min":1.508,"15min":1.508},"last":0.77400000000000002}]},{"osd":1,"last update":"Tue Dec 12 09:44:14 2023","interfaces":[{"interface":"back","average":{"1min":1.226,"5min":1.226,"15min":1.226},"min":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"max":{"1min":1.5940000000000001,"5min":1.5940000000000001,"15min":1.5940000000000001},"last":0.67200000000000004},{"interface":"front","average":{"1min":1.0920000000000001,"5min":1.0920000000000001,"15min":1.0920000000000001},"min":{"1min":0.753,"5min":0.753,"15min":0.753},"max":{"1min":1.5840000000000001,"5min":1.5840000000000001,"15min":1.5840000000000001},"last":1.0289999999999999}]},{"osd":2,"last update":"Tue Dec 12 09:44:14 2023","interfaces":[{"interface":"back","average":{"1min":1.3169999999999999,"5min":1.3169999999999999,"15min":1.3169999999999999},"min":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"max":{"1min":1.7889999999999999,"5min":1.7889999999999999,"15min":1.7889999999999999},"last":1.0780000000000001},{"interface":"front","average":{"1min":1.421,"5min":1.421,"15min":1.421},"min":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"max":{"1min":2.1600000000000001,"5min":2.1600000000000001,"15min":2.1600000000000001},"last":1.2270000000000001}]},{"osd":3,"last update":"Tue Dec 12 09:44:14 2023","interfaces":[{"interface":"back","average":{"1min":1.371,"5min":1.371,"15min":1.371},"min":{"1min":1.002,"5min":1.002,"15min":1.002},"max":{"1min":2.1499999999999999,"5min":2.1499999999999999,"15min":2.1499999999999999},"last":1.179},{"interface":"front","average":{"1min":1.492,"5min":1.492,"15min":1.492},"min":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"max":{"1min":1.8939999999999999,"5min":1.8939999999999999,"15min":1.8939999999999999},"last":0.97399999999999998}]},{"osd":4,"last update":"Tue Dec 12 09:44:14 2023","interfaces":[{"interface":"back","average":{"1min":1.4910000000000001,"5min":1.4910000000000001,"15min":1.4910000000000001},"min":{"1min":0.995,"5min":0.995,"15min":0.995},"max":{"1min":2.391,"5min":2.391,"15min":2.391},"last":0.90100000000000002},{"interface":"front","average":{"1min":1.5880000000000001,"5min":1.5880000000000001,"15min":1.5880000000000001},"min":{"1min":1.0940000000000001,"5min":1.0940000000000001,"15min":1.0940000000000001},"max":{"1min":2.5430000000000001,"5min":2.5430000000000001,"15min":2.5430000000000001},"last":1.286}]},{"osd":6,"last update":"Tue Dec 12 09:44:14 2023","interfaces":[{"interface":"back","average":{"1min":1.5960000000000001,"5min":1.5960000000000001,"15min":1.5960000000000001},"min":{"1min":1.034,"5min":1.034,"15min":1.034},"max":{"1min":2.0840000000000001,"5min":2.0840000000000001,"15min":2.0840000000000001},"last":1.01},{"interface":"front","average":{"1min":1.631,"5min":1.631,"15min":1.631},"min":{"1min":1.155,"5min":1.155,"15min":1.155},"max":{"1min":2.306,"5min":2.306,"15min":2.306},"last":0.627}]},{"osd":7,"last update":"Tue Dec 12 09:44:14 2023","interfaces":[{"interface":"back","average":{"1min":1.7849999999999999,"5min":1.7849999999999999,"15min":1.7849999999999999},"min":{"1min":1.2090000000000001,"5min":1.2090000000000001,"15min":1.2090000000000001},"max":{"1min":2.6880000000000002,"5min":2.6880000000000002,"15min":2.6880000000000002},"last":1.345},{"interface":"front","average":{"1min":1.748,"5min":1.748,"15min":1.748},"min":{"1min":1.1220000000000001,"5min":1.1220000000000001,"15min":1.1220000000000001},"max":{"1min":2.3410000000000002,"5min":2.3410000000000002,"15min":2.3410000000000002},"last":1.115}]}]},{"osd":4,"up_from":13,"seq":55834574868,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27404,"kb_used_data":384,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344436,"statfs":{"total":96636764160,"available":96608702464,"internally_reserved":0,"allocated":393216,"data_stored":150876,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 12 09:44:14 2023","interfaces":[{"interface":"back","average":{"1min":1.0549999999999999,"5min":1.0549999999999999,"15min":1.0549999999999999},"min":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":1.5820000000000001,"5min":1.5820000000000001,"15min":1.5820000000000001},"last":0.75600000000000001},{"interface":"front","average":{"1min":1.0549999999999999,"5min":1.0549999999999999,"15min":1.0549999999999999},"min":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"max":{"1min":1.492,"5min":1.492,"15min":1.492},"last":1.0209999999999999}]},{"osd":1,"last update":"Tue Dec 12 09:44:14 2023","interfaces":[{"interface":"back","average":{"1min":1.044,"5min":1.044,"15min":1.044},"min":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"max":{"1min":1.3360000000000001,"5min":1.3360000000000001,"15min":1.3360000000000001},"last":0.67900000000000005},{"interface":"front","average":{"1min":1.181,"5min":1.181,"15min":1.181},"min":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"max":{"1min":1.8720000000000001,"5min":1.8720000000000001,"15min":1.8720000000000001},"last":0.874}]},{"osd":2,"last update":"Tue Dec 12 09:44:14 2023","interfaces":[{"interface":"back","average":{"1min":1.119,"5min":1.119,"15min":1.119},"min":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"max":{"1min":1.429,"5min":1.429,"15min":1.429},"last":1.3160000000000001},{"interface":"front","average":{"1min":1.294,"5min":1.294,"15min":1.294},"min":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"max":{"1min":2.1640000000000001,"5min":2.1640000000000001,"15min":2.1640000000000001},"last":1.117}]},{"osd":3,"last update":"Tue Dec 12 09:44:14 2023","interfaces":[{"interface":"back","average":{"1min":1.2030000000000001,"5min":1.2030000000000001,"15min":1.2030000000000001},"min":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"max":{"1min":1.635,"5min":1.635,"15min":1.635},"last":1.2190000000000001},{"interface":"front","average":{"1min":1.238,"5min":1.238,"15min":1.238},"min":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"max":{"1min":2.0499999999999998,"5min":2.0499999999999998,"15min":2.0499999999999998},"last":0.92900000000000005}]},{"osd":5,"last update":"Tue Dec 12 09:44:14 2023","interfaces":[{"interface":"back","average":{"1min":1.468,"5min":1.468,"15min":1.468},"min":{"1min":1,"5min":1,"15min":1},"max":{"1min":2.3159999999999998,"5min":2.3159999999999998,"15min":2.3159999999999998},"last":0.98899999999999999},{"interface":"front","average":{"1min":1.3500000000000001,"5min":1.3500000000000001,"15min":1.3500000000000001},"min":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"max":{"1min":2.117,"5min":2.117,"15min":2.117},"last":1.468}]},{"osd":6,"last update":"Tue Dec 12 09:44:14 2023","interfaces":[{"interface":"back","average":{"1min":1.403,"5min":1.403,"15min":1.403},"min":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"max":{"1min":2.246,"5min":2.246,"15min":2.246},"last":1.083},{"interface":"front","average":{"1min":1.5489999999999999,"5min":1.5489999999999999,"15min":1.5489999999999999},"min":{"1min":1.2430000000000001,"5min":1.2430000000000001,"15min":1.2430000000000001},"max":{"1min":2.5099999999999998,"5min":2.5099999999999998,"15min":2.5099999999999998},"last":1.26}]},{"osd":7,"last update":"Tue Dec 12 09:44:14 2023","interfaces":[{"interface":"back","average":{"1min":1.5049999999999999,"5min":1.5049999999999999,"15min":1.5049999999999999},"min":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"max":{"1min":2.5710000000000002,"5min":2.5710000000000002,"15min":2.5710000000000002},"last":1.405},{"interface":"front","average":{"1min":1.5129999999999999,"5min":1.5129999999999999,"15min":1.5129999999999999},"min":{"1min":1.0600000000000001,"5min":1.0600000000000001,"15min":1.0600000000000001},"max":{"1min":2.3919999999999999,"5min":2.3919999999999999,"15min":2.3919999999999999},"last":1.359}]}]},{"osd":3,"up_from":13,"seq":55834574866,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27408,"kb_used_data":392,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344432,"statfs":{"total":96636764160,"available":96608698368,"internally_reserved":0,"allocated":401408,"data_stored":153901,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 12 09:44:16 2023","interfaces":[{"interface":"back","average":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":1.4830000000000001,"5min":1.4830000000000001,"15min":1.4830000000000001},"last":1.1930000000000001},{"interface":"front","average":{"1min":1.137,"5min":1.137,"15min":1.137},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":3.3370000000000002,"5min":3.3370000000000002,"15min":3.3370000000000002},"last":0.67600000000000005}]},{"osd":1,"last update":"Tue Dec 12 09:44:16 2023","interfaces":[{"interface":"back","average":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":1.4610000000000001,"5min":1.4610000000000001,"15min":1.4610000000000001},"last":0.63800000000000001},{"interface":"front","average":{"1min":1.069,"5min":1.069,"15min":1.069},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":2.9409999999999998,"5min":2.9409999999999998,"15min":2.9409999999999998},"last":0.753}]},{"osd":2,"last update":"Tue Dec 12 09:44:16 2023","interfaces":[{"interface":"back","average":{"1min":1.1870000000000001,"5min":1.1870000000000001,"15min":1.1870000000000001},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":2.613,"5min":2.613,"15min":2.613},"last":0.80000000000000004},{"interface":"front","average":{"1min":1.1850000000000001,"5min":1.1850000000000001,"15min":1.1850000000000001},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":3.0430000000000001,"5min":3.0430000000000001,"15min":3.0430000000000001},"last":0.996}]},{"osd":4,"last update":"Tue Dec 12 09:44:16 2023","interfaces":[{"interface":"back","average":{"1min":1.383,"5min":1.383,"15min":1.383},"min":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":3.5019999999999998,"5min":3.5019999999999998,"15min":3.5019999999999998},"last":1.1299999999999999},{"interface":"front","average":{"1min":1.4830000000000001,"5min":1.4830000000000001,"15min":1.4830000000000001},"min":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"max":{"1min":2.9889999999999999,"5min":2.9889999999999999,"15min":2.9889999999999999},"last":1.248}]},{"osd":5,"last update":"Tue Dec 12 09:44:16 2023","interfaces":[{"interface":"back","average":{"1min":1.5,"5min":1.5,"15min":1.5},"min":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"max":{"1min":4.2480000000000002,"5min":4.2480000000000002,"15min":4.2480000000000002},"last":1.391},{"interface":"front","average":{"1min":1.5920000000000001,"5min":1.5920000000000001,"15min":1.5920000000000001},"min":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"max":{"1min":5.5060000000000002,"5min":5.5060000000000002,"15min":5.5060000000000002},"last":1.2849999999999999}]},{"osd":6,"last update":"Tue Dec 12 09:44:16 2023","interfaces":[{"interface":"back","average":{"1min":1.458,"5min":1.458,"15min":1.458},"min":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"max":{"1min":3.1400000000000001,"5min":3.1400000000000001,"15min":3.1400000000000001},"last":1.1699999999999999},{"interface":"front","average":{"1min":1.5469999999999999,"5min":1.5469999999999999,"15min":1.5469999999999999},"min":{"1min":0.627,"5min":0.627,"15min":0.627},"max":{"1min":4.3179999999999996,"5min":4.3179999999999996,"15min":4.3179999999999996},"last":1.3120000000000001}]},{"osd":7,"last update":"Tue Dec 12 09:44:16 2023","interfaces":[{"interface":"back","average":{"1min":1.5920000000000001,"5min":1.5920000000000001,"15min":1.5920000000000001},"min":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"max":{"1min":5.3979999999999997,"5min":5.3979999999999997,"15min":5.3979999999999997},"last":1.4159999999999999},{"interface":"front","average":{"1min":1.554,"5min":1.554,"15min":1.554},"min":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"max":{"1min":3.4129999999999998,"5min":3.4129999999999998,"15min":3.4129999999999998},"last":1.3580000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574866,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27404,"kb_used_data":380,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344436,"statfs":{"total":96636764160,"available":96608702464,"internally_reserved":0,"allocated":389120,"data_stored":150842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 12 09:44:15 2023","interfaces":[{"interface":"back","average":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":1.458,"5min":1.458,"15min":1.458},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":1.4370000000000001,"5min":1.4370000000000001,"15min":1.4370000000000001},"last":0.36199999999999999}]},{"osd":1,"last update":"Tue Dec 12 09:44:15 2023","interfaces":[{"interface":"back","average":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.593,"5min":1.593,"15min":1.593},"last":0.39500000000000002},{"interface":"front","average":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":1.758,"5min":1.758,"15min":1.758},"last":0.48299999999999998}]},{"osd":3,"last update":"Tue Dec 12 09:44:15 2023","interfaces":[{"interface":"back","average":{"1min":1.0569999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.8879999999999999,"5min":1.8879999999999999,"15min":1.8879999999999999},"last":0.57399999999999995},{"interface":"front","average":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":1.8120000000000001,"5min":1.8120000000000001,"15min":1.8120000000000001},"last":0.46000000000000002}]},{"osd":4,"last update":"Tue Dec 12 09:44:15 2023","interfaces":[{"interface":"back","average":{"1min":1.2270000000000001,"5min":1.2270000000000001,"15min":1.2270000000000001},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":2.5760000000000001,"5min":2.5760000000000001,"15min":2.5760000000000001},"last":0.98799999999999999},{"interface":"front","average":{"1min":1.3939999999999999,"5min":1.3939999999999999,"15min":1.3939999999999999},"min":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":2.8069999999999999,"5min":2.8069999999999999,"15min":2.8069999999999999},"last":0.84299999999999997}]},{"osd":5,"last update":"Tue Dec 12 09:44:15 2023","interfaces":[{"interface":"back","average":{"1min":1.379,"5min":1.379,"15min":1.379},"min":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"max":{"1min":2.3109999999999999,"5min":2.3109999999999999,"15min":2.3109999999999999},"last":1.0760000000000001},{"interface":"front","average":{"1min":1.351,"5min":1.351,"15min":1.351},"min":{"1min":0.627,"5min":0.627,"15min":0.627},"max":{"1min":2.5110000000000001,"5min":2.5110000000000001,"15min":2.5110000000000001},"last":0.79400000000000004}]},{"osd":6,"last update":"Tue Dec 12 09:44:15 2023","interfaces":[{"interface":"back","average":{"1min":1.4370000000000001,"5min":1.4370000000000001,"15min":1.4370000000000001},"min":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"max":{"1min":2.907,"5min":2.907,"15min":2.907},"last":1.046},{"interface":"front","average":{"1min":1.429,"5min":1.429,"15min":1.429},"min":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"max":{"1min":2.375,"5min":2.375,"15min":2.375},"last":1.147}]},{"osd":7,"last update":"Tue Dec 12 09:44:15 2023","interfaces":[{"interface":"back","average":{"1min":1.4570000000000001,"5min":1.4570000000000001,"15min":1.4570000000000001},"min":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"max":{"1min":2.3370000000000002,"5min":2.3370000000000002,"15min":2.3370000000000002},"last":0.94499999999999995},{"interface":"front","average":{"1min":1.5129999999999999,"5min":1.5129999999999999,"15min":1.5129999999999999},"min":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"max":{"1min":2.488,"5min":2.488,"15min":2.488},"last":1.117}]}]},{"osd":1,"up_from":13,"seq":55834574866,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27408,"kb_used_data":392,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344432,"statfs":{"total":96636764160,"available":96608698368,"internally_reserved":0,"allocated":401408,"data_stored":153901,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 12 09:44:15 2023","interfaces":[{"interface":"back","average":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":2.794,"5min":2.794,"15min":2.794},"last":1.101},{"interface":"front","average":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":2.1379999999999999,"5min":2.1379999999999999,"15min":2.1379999999999999},"last":1.0429999999999999}]},{"osd":2,"last update":"Tue Dec 12 09:44:15 2023","interfaces":[{"interface":"back","average":{"1min":0.98599999999999999,"5min":0.98599999999999999,"15min":0.98599999999999999},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":6.3390000000000004,"5min":6.3390000000000004,"15min":6.3390000000000004},"last":1.206},{"interface":"front","average":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":2.823,"5min":2.823,"15min":2.823},"last":1.3500000000000001}]},{"osd":3,"last update":"Tue Dec 12 09:44:15 2023","interfaces":[{"interface":"back","average":{"1min":1.0509999999999999,"5min":1.0509999999999999,"15min":1.0509999999999999},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":2.7519999999999998,"5min":2.7519999999999998,"15min":2.7519999999999998},"last":1.2829999999999999},{"interface":"front","average":{"1min":1.008,"5min":1.008,"15min":1.008},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":2.2559999999999998,"5min":2.2559999999999998,"15min":2.2559999999999998},"last":1.3819999999999999}]},{"osd":4,"last update":"Tue Dec 12 09:44:15 2023","interfaces":[{"interface":"back","average":{"1min":1.399,"5min":1.399,"15min":1.399},"min":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"max":{"1min":6.423,"5min":6.423,"15min":6.423},"last":1.306},{"interface":"front","average":{"1min":1.194,"5min":1.194,"15min":1.194},"min":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"max":{"1min":2.2309999999999999,"5min":2.2309999999999999,"15min":2.2309999999999999},"last":1.2509999999999999}]},{"osd":5,"last update":"Tue Dec 12 09:44:15 2023","interfaces":[{"interface":"back","average":{"1min":1.4670000000000001,"5min":1.4670000000000001,"15min":1.4670000000000001},"min":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"max":{"1min":6.2830000000000004,"5min":6.2830000000000004,"15min":6.2830000000000004},"last":1.4259999999999999},{"interface":"front","average":{"1min":1.375,"5min":1.375,"15min":1.375},"min":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"max":{"1min":2.73,"5min":2.73,"15min":2.73},"last":1.4570000000000001}]},{"osd":6,"last update":"Tue Dec 12 09:44:15 2023","interfaces":[{"interface":"back","average":{"1min":1.5600000000000001,"5min":1.5600000000000001,"15min":1.5600000000000001},"min":{"1min":0.875,"5min":0.875,"15min":0.875},"max":{"1min":6.468,"5min":6.468,"15min":6.468},"last":1.51},{"interface":"front","average":{"1min":1.5800000000000001,"5min":1.5800000000000001,"15min":1.5800000000000001},"min":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"max":{"1min":6.3129999999999997,"5min":6.3129999999999997,"15min":6.3129999999999997},"last":1.4850000000000001}]},{"osd":7,"last update":"Tue Dec 12 09:44:15 2023","interfaces":[{"interface":"back","average":{"1min":1.407,"5min":1.407,"15min":1.407},"min":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"max":{"1min":2.9009999999999998,"5min":2.9009999999999998,"15min":2.9009999999999998},"last":1.532},{"interface":"front","average":{"1min":1.556,"5min":1.556,"15min":1.556},"min":{"1min":0.752,"5min":0.752,"15min":0.752},"max":{"1min":6.242,"5min":6.242,"15min":6.242},"last":1.996}]}]},{"osd":0,"up_from":13,"seq":55834574868,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27464,"kb_used_data":440,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344376,"statfs":{"total":96636764160,"available":96608641024,"internally_reserved":0,"allocated":450560,"data_stored":741140,"data_compressed":32422,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Dec 12 09:44:16 2023","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":1.3600000000000001,"5min":1.3600000000000001,"15min":1.3600000000000001},"last":0.747},{"interface":"front","average":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":1.282,"5min":1.282,"15min":1.282},"last":0.81299999999999994}]},{"osd":2,"last update":"Tue Dec 12 09:44:16 2023","interfaces":[{"interface":"back","average":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":1.2529999999999999,"5min":1.2529999999999999,"15min":1.2529999999999999},"last":1.1739999999999999},{"interface":"front","average":{"1min":0.995,"5min":0.995,"15min":0.995},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":1.649,"5min":1.649,"15min":1.649},"last":1.1319999999999999}]},{"osd":3,"last update":"Tue Dec 12 09:44:16 2023","interfaces":[{"interface":"back","average":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.4990000000000001,"5min":1.4990000000000001,"15min":1.4990000000000001},"last":0.90000000000000002},{"interface":"front","average":{"1min":1.004,"5min":1.004,"15min":1.004},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.7689999999999999,"5min":1.7689999999999999,"15min":1.7689999999999999},"last":1.079}]},{"osd":4,"last update":"Tue Dec 12 09:44:16 2023","interfaces":[{"interface":"back","average":{"1min":1.2869999999999999,"5min":1.2869999999999999,"15min":1.2869999999999999},"min":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"max":{"1min":2.073,"5min":2.073,"15min":2.073},"last":1.2350000000000001},{"interface":"front","average":{"1min":1.2929999999999999,"5min":1.2929999999999999,"15min":1.2929999999999999},"min":{"1min":0.877,"5min":0.877,"15min":0.877},"max":{"1min":3.0699999999999998,"5min":3.0699999999999998,"15min":3.0699999999999998},"last":1.044}]},{"osd":5,"last update":"Tue Dec 12 09:44:16 2023","interfaces":[{"interface":"back","average":{"1min":1.2330000000000001,"5min":1.2330000000000001,"15min":1.2330000000000001},"min":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":3.1909999999999998,"5min":3.1909999999999998,"15min":3.1909999999999998},"last":0.98599999999999999},{"interface":"front","average":{"1min":1.3069999999999999,"5min":1.3069999999999999,"15min":1.3069999999999999},"min":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"max":{"1min":1.9750000000000001,"5min":1.9750000000000001,"15min":1.9750000000000001},"last":1.2210000000000001}]},{"osd":6,"last update":"Tue Dec 12 09:44:16 2023","interfaces":[{"interface":"back","average":{"1min":1.3380000000000001,"5min":1.3380000000000001,"15min":1.3380000000000001},"min":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"max":{"1min":1.9630000000000001,"5min":1.9630000000000001,"15min":1.9630000000000001},"last":1.524},{"interface":"front","average":{"1min":1.3919999999999999,"5min":1.3919999999999999,"15min":1.3919999999999999},"min":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"max":{"1min":2.9100000000000001,"5min":2.9100000000000001,"15min":2.9100000000000001},"last":1.4850000000000001}]},{"osd":7,"last update":"Tue Dec 12 09:44:16 2023","interfaces":[{"interface":"back","average":{"1min":1.4450000000000001,"5min":1.4450000000000001,"15min":1.4450000000000001},"min":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"max":{"1min":2.992,"5min":2.992,"15min":2.992},"last":1.579},{"interface":"front","average":{"1min":1.3300000000000001,"5min":1.3300000000000001,"15min":1.3300000000000001},"min":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"max":{"1min":2.7690000000000001,"5min":2.7690000000000001,"15min":2.7690000000000001},"last":1.363}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32422,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32422,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":3129,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":3129,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-12T09:44:41.111 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-12T09:44:41.348 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:41.347+0000 7f9450b8a640 1 Processor -- start 2023-12-12T09:44:41.348 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:41.347+0000 7f9450b8a640 1 -- start start 2023-12-12T09:44:41.350 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:41.348+0000 7f9450b8a640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f944c1552e0 0x7f944c0c49c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:41.350 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:41.348+0000 7f9450b8a640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f944c06bf20 0x7f944c0a9760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:41.350 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:41.349+0000 7f9450b8a640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f944c0c0b50 con 0x7f944c0a50f0 2023-12-12T09:44:41.350 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:41.349+0000 7f9450b8a640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f944c0c04d0 con 0x7f944c06bf20 2023-12-12T09:44:41.350 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:41.349+0000 7f9450b8a640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f944c06c880 con 0x7f944c1552e0 2023-12-12T09:44:41.350 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:41.349+0000 7f9449d9b640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f944c0a50f0 0x7f944c0a9050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:44406/0 (socket says 172.21.15.73:44406) 2023-12-12T09:44:41.350 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:41.349+0000 7f9449d9b640 1 -- 172.21.15.73:0/1824017259 learned_addr learned my addr 172.21.15.73:0/1824017259 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-12T09:44:41.352 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:41.349+0000 7f944a59c640 1 --2- 172.21.15.73:0/1824017259 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f944c1552e0 0x7f944c0c49c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:41.352 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:41.349+0000 7f944959a640 1 -- 172.21.15.73:0/1824017259 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 341624213 0 0) 0x7f944c0c0b50 con 0x7f944c0a50f0 2023-12-12T09:44:41.352 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:41.349+0000 7f944959a640 1 -- 172.21.15.73:0/1824017259 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9434003520 con 0x7f944c0a50f0 2023-12-12T09:44:41.352 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:41.349+0000 7f944ad9d640 1 --2- 172.21.15.73:0/1824017259 >> v2:172.21.15.142:3300/0 conn(0x7f944c06bf20 0x7f944c0a9760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:41.352 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:41.350+0000 7f944959a640 1 -- 172.21.15.73:0/1824017259 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1868044832 0 0) 0x7f9434003520 con 0x7f944c0a50f0 2023-12-12T09:44:41.353 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:41.350+0000 7f944959a640 1 -- 172.21.15.73:0/1824017259 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f944c1552e0 msgr2=0x7f944c0c49c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:44:41.353 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:41.350+0000 7f944959a640 1 --2- 172.21.15.73:0/1824017259 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f944c1552e0 0x7f944c0c49c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:41.353 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:41.350+0000 7f944959a640 1 -- 172.21.15.73:0/1824017259 >> v2:172.21.15.142:3300/0 conn(0x7f944c06bf20 msgr2=0x7f944c0a9760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:44:41.353 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:41.350+0000 7f944959a640 1 --2- 172.21.15.73:0/1824017259 >> v2:172.21.15.142:3300/0 conn(0x7f944c06bf20 0x7f944c0a9760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:41.353 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:41.350+0000 7f944959a640 1 -- 172.21.15.73:0/1824017259 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f944c06cb60 con 0x7f944c0a50f0 2023-12-12T09:44:41.353 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:41.350+0000 7f944959a640 1 -- 172.21.15.73:0/1824017259 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3186547832 0 0) 0x7f9440001670 con 0x7f944c0a50f0 2023-12-12T09:44:41.353 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:41.350+0000 7f944959a640 1 -- 172.21.15.73:0/1824017259 >> v1:172.21.15.73:6789/0 conn(0x7f944c0a50f0 legacy=0x7f944c0a9050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:41.353 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:41.350+0000 7f944959a640 1 --2- 172.21.15.73:0/1824017259 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f944c1552e0 0x7f9434003970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:41.353 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:41.350+0000 7f944959a640 1 --2- 172.21.15.73:0/1824017259 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9434003ef0 0x7f94340047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:41.353 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:41.350+0000 7f944959a640 1 --2- 172.21.15.73:0/1824017259 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9434004d00 0x7f9434005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:41.353 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:41.350+0000 7f944959a640 1 -- 172.21.15.73:0/1824017259 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f944c0c04d0 con 0x7f9434003ef0 2023-12-12T09:44:41.353 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:41.350+0000 7f944959a640 1 -- 172.21.15.73:0/1824017259 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f944c06c880 con 0x7f9434004d00 2023-12-12T09:44:41.354 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:41.350+0000 7f944959a640 1 -- 172.21.15.73:0/1824017259 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f943400dc90 con 0x7f944c1552e0 2023-12-12T09:44:41.354 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:41.350+0000 7f9449d9b640 1 --2- 172.21.15.73:0/1824017259 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9434003ef0 0x7f94340047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:41.354 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:41.350+0000 7f944a59c640 1 --2- 172.21.15.73:0/1824017259 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f944c1552e0 0x7f9434003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:41.354 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:41.350+0000 7f9449d9b640 1 -- 172.21.15.73:0/1824017259 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f944c1552e0 msgr2=0x7f9434003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:44:41.354 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:41.350+0000 7f944ad9d640 1 --2- 172.21.15.73:0/1824017259 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9434004d00 0x7f9434005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:41.354 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:41.351+0000 7f9449d9b640 1 --2- 172.21.15.73:0/1824017259 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f944c1552e0 0x7f9434003970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:41.354 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:41.351+0000 7f9449d9b640 1 -- 172.21.15.73:0/1824017259 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9434004d00 msgr2=0x7f9434005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:44:41.354 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:41.351+0000 7f9449d9b640 1 --2- 172.21.15.73:0/1824017259 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9434004d00 0x7f9434005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:41.354 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:41.351+0000 7f9449d9b640 1 -- 172.21.15.73:0/1824017259 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9434003520 con 0x7f9434003ef0 2023-12-12T09:44:41.354 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:41.351+0000 7f944ad9d640 1 --2- 172.21.15.73:0/1824017259 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9434004d00 0x7f9434005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:44:41.354 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:41.351+0000 7f944a59c640 1 --2- 172.21.15.73:0/1824017259 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f944c1552e0 0x7f9434003970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:44:41.356 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:41.352+0000 7f9449d9b640 1 --2- 172.21.15.73:0/1824017259 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9434003ef0 0x7f94340047c0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f944000c210 tx=0x7f94340057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e30279e7e3241fe server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:44:41.356 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:41.352+0000 7f944959a640 1 -- 172.21.15.73:0/1824017259 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9440005ad0 con 0x7f9434003ef0 2023-12-12T09:44:41.356 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:41.352+0000 7f944959a640 1 -- 172.21.15.73:0/1824017259 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9440005c30 con 0x7f9434003ef0 2023-12-12T09:44:41.356 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:41.352+0000 7f944959a640 1 -- 172.21.15.73:0/1824017259 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f944002c890 con 0x7f9434003ef0 2023-12-12T09:44:41.356 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:41.352+0000 7f9450b8a640 1 -- 172.21.15.73:0/1824017259 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9434003ef0 msgr2=0x7f94340047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:41.356 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:41.352+0000 7f9450b8a640 1 --2- 172.21.15.73:0/1824017259 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9434003ef0 0x7f94340047c0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f944000c210 tx=0x7f94340057f0 comp rx=0 tx=0).stop 2023-12-12T09:44:41.356 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:41.352+0000 7f944ad9d640 1 -- 172.21.15.73:0/1824017259 reap_dead start 2023-12-12T09:44:41.356 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:41.352+0000 7f9450b8a640 1 -- 172.21.15.73:0/1824017259 shutdown_connections 2023-12-12T09:44:41.356 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:41.352+0000 7f9450b8a640 1 -- 172.21.15.73:0/1824017259 >> 172.21.15.73:0/1824017259 conn(0x7f944c0a8130 msgr2=0x7f944c0c24b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:44:41.356 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:41.353+0000 7f9450b8a640 1 -- 172.21.15.73:0/1824017259 shutdown_connections 2023-12-12T09:44:41.357 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:41.353+0000 7f9450b8a640 1 -- 172.21.15.73:0/1824017259 wait complete. 2023-12-12T09:44:41.357 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:41.354+0000 7f9450b8a640 1 Processor -- start 2023-12-12T09:44:41.357 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:41.354+0000 7f9450b8a640 1 -- start start 2023-12-12T09:44:41.359 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:41.355+0000 7f9450b8a640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9434003ef0 0x7f944c1edb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:41.359 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:41.355+0000 7f9450b8a640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f944c1da870 0x7f944c070a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:41.359 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:41.355+0000 7f9450b8a640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f944c070f90 0x7f944c150c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:41.359 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:41.355+0000 7f9450b8a640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f944c1dbd80 con 0x7f9434003ef0 2023-12-12T09:44:41.359 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:41.355+0000 7f9450b8a640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f944c071d90 con 0x7f944c070f90 2023-12-12T09:44:41.359 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:41.355+0000 7f9450b8a640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f944c1db550 con 0x7f944c1da870 2023-12-12T09:44:41.359 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:41.356+0000 7f944a59c640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9434003ef0 0x7f944c1edb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:41.359 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:41.356+0000 7f944a59c640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9434003ef0 0x7f944c1edb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:52710/0 (socket says 172.21.15.73:52710) 2023-12-12T09:44:41.359 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:41.356+0000 7f944a59c640 1 -- 172.21.15.73:0/305725314 learned_addr learned my addr 172.21.15.73:0/305725314 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:44:41.359 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:41.356+0000 7f944a59c640 1 -- 172.21.15.73:0/305725314 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f944c1da870 msgr2=0x7f944c070a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:41.360 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:41.356+0000 7f944a59c640 1 --2- 172.21.15.73:0/305725314 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f944c1da870 0x7f944c070a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:41.360 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:41.356+0000 7f944a59c640 1 -- 172.21.15.73:0/305725314 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f944c070f90 msgr2=0x7f944c150c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:41.360 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:41.356+0000 7f944a59c640 1 --2- 172.21.15.73:0/305725314 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f944c070f90 0x7f944c150c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:41.360 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:41.356+0000 7f944a59c640 1 -- 172.21.15.73:0/305725314 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f944c1db220 con 0x7f9434003ef0 2023-12-12T09:44:41.360 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:41.356+0000 7f944a59c640 1 --2- 172.21.15.73:0/305725314 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9434003ef0 0x7f944c1edb70 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f943c0108b0 tx=0x7f943c010d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:44:41.360 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:41.356+0000 7f943affd640 1 -- 172.21.15.73:0/305725314 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f943c00eb60 con 0x7f9434003ef0 2023-12-12T09:44:41.360 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:41.356+0000 7f943affd640 1 -- 172.21.15.73:0/305725314 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f943c00ecc0 con 0x7f9434003ef0 2023-12-12T09:44:41.360 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:41.356+0000 7f9450b8a640 1 -- 172.21.15.73:0/305725314 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f944c1de650 con 0x7f9434003ef0 2023-12-12T09:44:41.360 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:41.357+0000 7f943affd640 1 -- 172.21.15.73:0/305725314 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f943c01c400 con 0x7f9434003ef0 2023-12-12T09:44:41.360 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:41.357+0000 7f9450b8a640 1 -- 172.21.15.73:0/305725314 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f944c1ee790 con 0x7f9434003ef0 2023-12-12T09:44:41.360 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:41.358+0000 7f9450b8a640 1 -- 172.21.15.73:0/305725314 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f944c067580 con 0x7f9434003ef0 2023-12-12T09:44:41.361 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:41.359+0000 7f943affd640 1 -- 172.21.15.73:0/305725314 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f943c01c560 con 0x7f9434003ef0 2023-12-12T09:44:41.361 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:41.360+0000 7f943affd640 1 --2- 172.21.15.73:0/305725314 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f942c06ae70 0x7f942c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:41.361 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:41.360+0000 7f943affd640 1 -- 172.21.15.73:0/305725314 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f943c089ed0 con 0x7f9434003ef0 2023-12-12T09:44:41.361 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:41.360+0000 7f9449d9b640 1 --2- 172.21.15.73:0/305725314 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f942c06ae70 0x7f942c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:41.362 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:41.361+0000 7f9449d9b640 1 --2- 172.21.15.73:0/305725314 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f942c06ae70 0x7f942c06d330 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f9440034000 tx=0x7f944002e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:44:41.365 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:41.364+0000 7f943affd640 1 -- 172.21.15.73:0/305725314 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f943c054cd0 con 0x7f9434003ef0 2023-12-12T09:44:41.555 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:41.554+0000 7f9450b8a640 1 -- 172.21.15.73:0/305725314 --> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f944c0c1ff0 con 0x7f942c06ae70 2023-12-12T09:44:41.570 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:41.569+0000 7f943affd640 1 -- 172.21.15.73:0/305725314 <== mgr.4110 v2:172.21.15.73:6832/779985841 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+525734 (secure 0 0 0) 0x7f94400014b0 con 0x7f942c06ae70 2023-12-12T09:44:41.575 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-12T09:44:41.582 INFO:teuthology.orchestra.run.smithi073.stderr:dumped all 2023-12-12T09:44:41.584 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:41.580+0000 7f9450b8a640 1 -- 172.21.15.73:0/305725314 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f942c06ae70 msgr2=0x7f942c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:41.584 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:41.580+0000 7f9450b8a640 1 --2- 172.21.15.73:0/305725314 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f942c06ae70 0x7f942c06d330 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f9440034000 tx=0x7f944002e000 comp rx=0 tx=0).stop 2023-12-12T09:44:41.584 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:41.580+0000 7f9450b8a640 1 -- 172.21.15.73:0/305725314 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9434003ef0 msgr2=0x7f944c1edb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:41.584 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:41.580+0000 7f9450b8a640 1 --2- 172.21.15.73:0/305725314 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9434003ef0 0x7f944c1edb70 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f943c0108b0 tx=0x7f943c010d70 comp rx=0 tx=0).stop 2023-12-12T09:44:41.584 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:41.580+0000 7f9450b8a640 1 -- 172.21.15.73:0/305725314 shutdown_connections 2023-12-12T09:44:41.584 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:41.580+0000 7f9450b8a640 1 --2- 172.21.15.73:0/305725314 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f942c06ae70 0x7f942c06d330 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:41.584 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:41.580+0000 7f9450b8a640 1 --2- 172.21.15.73:0/305725314 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f944c070f90 0x7f944c150c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:41.584 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:41.580+0000 7f9450b8a640 1 --2- 172.21.15.73:0/305725314 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f944c1da870 0x7f944c070a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:41.585 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:41.580+0000 7f9450b8a640 1 --2- 172.21.15.73:0/305725314 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9434003ef0 0x7f944c1edb70 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:41.585 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:41.580+0000 7f9450b8a640 1 -- 172.21.15.73:0/305725314 >> 172.21.15.73:0/305725314 conn(0x7f944c0a8130 msgr2=0x7f944c0c0d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:44:41.585 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:41.581+0000 7f9450b8a640 1 -- 172.21.15.73:0/305725314 shutdown_connections 2023-12-12T09:44:41.585 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:41.581+0000 7f9450b8a640 1 -- 172.21.15.73:0/305725314 wait complete. 2023-12-12T09:44:41.602 INFO:teuthology.orchestra.run.smithi073.stdout:{"pg_ready":true,"pg_map":{"version":75,"stamp":"2023-12-12T09:44:41.479948+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":596683,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":250,"num_write_kb":2447,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":27,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":196,"ondisk_log_size":196,"up":386,"acting":386,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":325,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219800,"kb_used_data":3612,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754920,"statfs":{"total":773094113280,"available":772869038080,"internally_reserved":0,"allocated":3698688,"data_stored":2606735,"data_compressed":64844,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":38,"apply_latency_ms":38,"commit_latency_ns":38000000,"apply_latency_ns":38000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001778"},"pg_stats":[{"pgid":"7.6","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-12T09:44:38.631847+0000","last_change":"2023-12-12T09:44:36.695336+0000","last_active":"2023-12-12T09:44:38.631847+0000","last_peered":"2023-12-12T09:44:38.631847+0000","last_clean":"2023-12-12T09:44:38.631847+0000","last_became_active":"2023-12-12T09:44:36.693620+0000","last_became_peered":"2023-12-12T09:44:36.693620+0000","last_unstale":"2023-12-12T09:44:38.631847+0000","last_undegraded":"2023-12-12T09:44:38.631847+0000","last_fullsized":"2023-12-12T09:44:38.631847+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:35.613810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:35.613810+0000","last_clean_scrub_stamp":"2023-12-12T09:44:35.613810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T11:38:33.721181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":180,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-12-12T09:44:36.665763+0000","last_change":"2023-12-12T09:43:17.203315+0000","last_active":"2023-12-12T09:44:36.665763+0000","last_peered":"2023-12-12T09:44:36.665763+0000","last_clean":"2023-12-12T09:44:36.665763+0000","last_became_active":"2023-12-12T09:43:17.200779+0000","last_became_peered":"2023-12-12T09:43:17.200779+0000","last_unstale":"2023-12-12T09:44:36.665763+0000","last_undegraded":"2023-12-12T09:44:36.665763+0000","last_fullsized":"2023-12-12T09:44:36.665763+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:43:15.931922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:43:15.931922+0000","last_clean_scrub_stamp":"2023-12-12T09:43:15.931922+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T21:42:10.929640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":16,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-12-12T09:44:36.676577+0000","last_change":"2023-12-12T09:44:20.519204+0000","last_active":"2023-12-12T09:44:36.676577+0000","last_peered":"2023-12-12T09:44:36.676577+0000","last_clean":"2023-12-12T09:44:36.676577+0000","last_became_active":"2023-12-12T09:44:20.518590+0000","last_became_peered":"2023-12-12T09:44:20.518590+0000","last_unstale":"2023-12-12T09:44:36.676577+0000","last_undegraded":"2023-12-12T09:44:36.676577+0000","last_fullsized":"2023-12-12T09:44:36.676577+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:19.449520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:19.449520+0000","last_clean_scrub_stamp":"2023-12-12T09:44:19.449520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T16:04:09.402682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":15,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-12-12T09:44:36.663136+0000","last_change":"2023-12-12T09:44:21.525532+0000","last_active":"2023-12-12T09:44:36.663136+0000","last_peered":"2023-12-12T09:44:36.663136+0000","last_clean":"2023-12-12T09:44:36.663136+0000","last_became_active":"2023-12-12T09:44:21.521828+0000","last_became_peered":"2023-12-12T09:44:21.521828+0000","last_unstale":"2023-12-12T09:44:36.663136+0000","last_undegraded":"2023-12-12T09:44:36.663136+0000","last_fullsized":"2023-12-12T09:44:36.663136+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_clean_scrub_stamp":"2023-12-12T09:44:20.465592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T13:05:01.026963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"37'2","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-12T09:44:37.673425+0000","last_change":"2023-12-12T09:44:35.653272+0000","last_active":"2023-12-12T09:44:37.673425+0000","last_peered":"2023-12-12T09:44:37.673425+0000","last_clean":"2023-12-12T09:44:37.673425+0000","last_became_active":"2023-12-12T09:44:35.652974+0000","last_became_peered":"2023-12-12T09:44:35.652974+0000","last_unstale":"2023-12-12T09:44:37.673425+0000","last_undegraded":"2023-12-12T09:44:37.673425+0000","last_fullsized":"2023-12-12T09:44:37.673425+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:34.598834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:34.598834+0000","last_clean_scrub_stamp":"2023-12-12T09:44:34.598834+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T20:22:11.987842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-12T09:44:39.348667+0000","last_change":"2023-12-12T09:44:36.683548+0000","last_active":"2023-12-12T09:44:39.348667+0000","last_peered":"2023-12-12T09:44:39.348667+0000","last_clean":"2023-12-12T09:44:39.348667+0000","last_became_active":"2023-12-12T09:44:36.683298+0000","last_became_peered":"2023-12-12T09:44:36.683298+0000","last_unstale":"2023-12-12T09:44:39.348667+0000","last_undegraded":"2023-12-12T09:44:39.348667+0000","last_fullsized":"2023-12-12T09:44:39.348667+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:35.613810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:35.613810+0000","last_clean_scrub_stamp":"2023-12-12T09:44:35.613810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T13:37:59.530476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":16,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-12-12T09:44:36.667964+0000","last_change":"2023-12-12T09:44:20.514669+0000","last_active":"2023-12-12T09:44:36.667964+0000","last_peered":"2023-12-12T09:44:36.667964+0000","last_clean":"2023-12-12T09:44:36.667964+0000","last_became_active":"2023-12-12T09:44:20.514346+0000","last_became_peered":"2023-12-12T09:44:20.514346+0000","last_unstale":"2023-12-12T09:44:36.667964+0000","last_undegraded":"2023-12-12T09:44:36.667964+0000","last_fullsized":"2023-12-12T09:44:36.667964+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:19.449520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:19.449520+0000","last_clean_scrub_stamp":"2023-12-12T09:44:19.449520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T12:21:36.280435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":15,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-12-12T09:44:36.660325+0000","last_change":"2023-12-12T09:44:21.530146+0000","last_active":"2023-12-12T09:44:36.660325+0000","last_peered":"2023-12-12T09:44:36.660325+0000","last_clean":"2023-12-12T09:44:36.660325+0000","last_became_active":"2023-12-12T09:44:21.526991+0000","last_became_peered":"2023-12-12T09:44:21.526991+0000","last_unstale":"2023-12-12T09:44:36.660325+0000","last_undegraded":"2023-12-12T09:44:36.660325+0000","last_fullsized":"2023-12-12T09:44:36.660325+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_clean_scrub_stamp":"2023-12-12T09:44:20.465592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T21:42:36.877781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-12T09:44:38.657506+0000","last_change":"2023-12-12T09:44:35.658828+0000","last_active":"2023-12-12T09:44:38.657506+0000","last_peered":"2023-12-12T09:44:38.657506+0000","last_clean":"2023-12-12T09:44:38.657506+0000","last_became_active":"2023-12-12T09:44:35.657040+0000","last_became_peered":"2023-12-12T09:44:35.657040+0000","last_unstale":"2023-12-12T09:44:38.657506+0000","last_undegraded":"2023-12-12T09:44:38.657506+0000","last_fullsized":"2023-12-12T09:44:38.657506+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:34.598834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:34.598834+0000","last_clean_scrub_stamp":"2023-12-12T09:44:34.598834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T14:12:36.683649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-12T09:44:39.348888+0000","last_change":"2023-12-12T09:44:36.685208+0000","last_active":"2023-12-12T09:44:39.348888+0000","last_peered":"2023-12-12T09:44:39.348888+0000","last_clean":"2023-12-12T09:44:39.348888+0000","last_became_active":"2023-12-12T09:44:36.684598+0000","last_became_peered":"2023-12-12T09:44:36.684598+0000","last_unstale":"2023-12-12T09:44:39.348888+0000","last_undegraded":"2023-12-12T09:44:39.348888+0000","last_fullsized":"2023-12-12T09:44:39.348888+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:35.613810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:35.613810+0000","last_clean_scrub_stamp":"2023-12-12T09:44:35.613810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T21:41:14.455396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":16,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-12-12T09:44:36.660758+0000","last_change":"2023-12-12T09:44:20.508411+0000","last_active":"2023-12-12T09:44:36.660758+0000","last_peered":"2023-12-12T09:44:36.660758+0000","last_clean":"2023-12-12T09:44:36.660758+0000","last_became_active":"2023-12-12T09:44:20.508071+0000","last_became_peered":"2023-12-12T09:44:20.508071+0000","last_unstale":"2023-12-12T09:44:36.660758+0000","last_undegraded":"2023-12-12T09:44:36.660758+0000","last_fullsized":"2023-12-12T09:44:36.660758+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:19.449520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:19.449520+0000","last_clean_scrub_stamp":"2023-12-12T09:44:19.449520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T19:38:07.725951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":15,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-12-12T09:44:36.667802+0000","last_change":"2023-12-12T09:44:21.529727+0000","last_active":"2023-12-12T09:44:36.667802+0000","last_peered":"2023-12-12T09:44:36.667802+0000","last_clean":"2023-12-12T09:44:36.667802+0000","last_became_active":"2023-12-12T09:44:21.528750+0000","last_became_peered":"2023-12-12T09:44:21.528750+0000","last_unstale":"2023-12-12T09:44:36.667802+0000","last_undegraded":"2023-12-12T09:44:36.667802+0000","last_fullsized":"2023-12-12T09:44:36.667802+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_clean_scrub_stamp":"2023-12-12T09:44:20.465592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T10:50:32.155095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-12T09:44:39.114409+0000","last_change":"2023-12-12T09:44:35.662449+0000","last_active":"2023-12-12T09:44:39.114409+0000","last_peered":"2023-12-12T09:44:39.114409+0000","last_clean":"2023-12-12T09:44:39.114409+0000","last_became_active":"2023-12-12T09:44:35.662177+0000","last_became_peered":"2023-12-12T09:44:35.662177+0000","last_unstale":"2023-12-12T09:44:39.114409+0000","last_undegraded":"2023-12-12T09:44:39.114409+0000","last_fullsized":"2023-12-12T09:44:39.114409+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:34.598834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:34.598834+0000","last_clean_scrub_stamp":"2023-12-12T09:44:34.598834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T14:54:52.313229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-12T09:44:38.656619+0000","last_change":"2023-12-12T09:44:36.678990+0000","last_active":"2023-12-12T09:44:38.656619+0000","last_peered":"2023-12-12T09:44:38.656619+0000","last_clean":"2023-12-12T09:44:38.656619+0000","last_became_active":"2023-12-12T09:44:36.678659+0000","last_became_peered":"2023-12-12T09:44:36.678659+0000","last_unstale":"2023-12-12T09:44:38.656619+0000","last_undegraded":"2023-12-12T09:44:38.656619+0000","last_fullsized":"2023-12-12T09:44:38.656619+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:35.613810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:35.613810+0000","last_clean_scrub_stamp":"2023-12-12T09:44:35.613810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T12:31:30.869348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":15,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-12-12T09:44:35.640133+0000","last_change":"2023-12-12T09:44:20.512148+0000","last_active":"2023-12-12T09:44:35.640133+0000","last_peered":"2023-12-12T09:44:35.640133+0000","last_clean":"2023-12-12T09:44:35.640133+0000","last_became_active":"2023-12-12T09:44:20.510963+0000","last_became_peered":"2023-12-12T09:44:20.510963+0000","last_unstale":"2023-12-12T09:44:35.640133+0000","last_undegraded":"2023-12-12T09:44:35.640133+0000","last_fullsized":"2023-12-12T09:44:35.640133+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:19.449520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:19.449520+0000","last_clean_scrub_stamp":"2023-12-12T09:44:19.449520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T19:38:07.725951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":15,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-12-12T09:44:36.669463+0000","last_change":"2023-12-12T09:44:21.513642+0000","last_active":"2023-12-12T09:44:36.669463+0000","last_peered":"2023-12-12T09:44:36.669463+0000","last_clean":"2023-12-12T09:44:36.669463+0000","last_became_active":"2023-12-12T09:44:21.513346+0000","last_became_peered":"2023-12-12T09:44:21.513346+0000","last_unstale":"2023-12-12T09:44:36.669463+0000","last_undegraded":"2023-12-12T09:44:36.669463+0000","last_fullsized":"2023-12-12T09:44:36.669463+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_clean_scrub_stamp":"2023-12-12T09:44:20.465592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T21:19:34.161140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-12T09:44:38.630802+0000","last_change":"2023-12-12T09:44:35.654211+0000","last_active":"2023-12-12T09:44:38.630802+0000","last_peered":"2023-12-12T09:44:38.630802+0000","last_clean":"2023-12-12T09:44:38.630802+0000","last_became_active":"2023-12-12T09:44:35.652000+0000","last_became_peered":"2023-12-12T09:44:35.652000+0000","last_unstale":"2023-12-12T09:44:38.630802+0000","last_undegraded":"2023-12-12T09:44:38.630802+0000","last_fullsized":"2023-12-12T09:44:38.630802+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:34.598834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:34.598834+0000","last_clean_scrub_stamp":"2023-12-12T09:44:34.598834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T21:03:32.014302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-12T09:44:37.670136+0000","last_change":"2023-12-12T09:44:36.680029+0000","last_active":"2023-12-12T09:44:37.670136+0000","last_peered":"2023-12-12T09:44:37.670136+0000","last_clean":"2023-12-12T09:44:37.670136+0000","last_became_active":"2023-12-12T09:44:36.679623+0000","last_became_peered":"2023-12-12T09:44:36.679623+0000","last_unstale":"2023-12-12T09:44:37.670136+0000","last_undegraded":"2023-12-12T09:44:37.670136+0000","last_fullsized":"2023-12-12T09:44:37.670136+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:35.613810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:35.613810+0000","last_clean_scrub_stamp":"2023-12-12T09:44:35.613810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T16:53:45.536132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":16,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-12-12T09:44:36.669948+0000","last_change":"2023-12-12T09:44:20.506663+0000","last_active":"2023-12-12T09:44:36.669948+0000","last_peered":"2023-12-12T09:44:36.669948+0000","last_clean":"2023-12-12T09:44:36.669948+0000","last_became_active":"2023-12-12T09:44:20.506077+0000","last_became_peered":"2023-12-12T09:44:20.506077+0000","last_unstale":"2023-12-12T09:44:36.669948+0000","last_undegraded":"2023-12-12T09:44:36.669948+0000","last_fullsized":"2023-12-12T09:44:36.669948+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:19.449520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:19.449520+0000","last_clean_scrub_stamp":"2023-12-12T09:44:19.449520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T19:16:24.812720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":15,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-12-12T09:44:36.670350+0000","last_change":"2023-12-12T09:44:21.518935+0000","last_active":"2023-12-12T09:44:36.670350+0000","last_peered":"2023-12-12T09:44:36.670350+0000","last_clean":"2023-12-12T09:44:36.670350+0000","last_became_active":"2023-12-12T09:44:21.518647+0000","last_became_peered":"2023-12-12T09:44:21.518647+0000","last_unstale":"2023-12-12T09:44:36.670350+0000","last_undegraded":"2023-12-12T09:44:36.670350+0000","last_fullsized":"2023-12-12T09:44:36.670350+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_clean_scrub_stamp":"2023-12-12T09:44:20.465592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T19:38:08.742023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-12-12T09:44:36.666417+0000","last_change":"2023-12-12T09:44:35.652911+0000","last_active":"2023-12-12T09:44:36.666417+0000","last_peered":"2023-12-12T09:44:36.666417+0000","last_clean":"2023-12-12T09:44:36.666417+0000","last_became_active":"2023-12-12T09:44:35.652615+0000","last_became_peered":"2023-12-12T09:44:35.652615+0000","last_unstale":"2023-12-12T09:44:36.666417+0000","last_undegraded":"2023-12-12T09:44:36.666417+0000","last_fullsized":"2023-12-12T09:44:36.666417+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:34.598834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:34.598834+0000","last_clean_scrub_stamp":"2023-12-12T09:44:34.598834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T15:01:08.079004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-12T09:44:37.671215+0000","last_change":"2023-12-12T09:44:36.701716+0000","last_active":"2023-12-12T09:44:37.671215+0000","last_peered":"2023-12-12T09:44:37.671215+0000","last_clean":"2023-12-12T09:44:37.671215+0000","last_became_active":"2023-12-12T09:44:36.701407+0000","last_became_peered":"2023-12-12T09:44:36.701407+0000","last_unstale":"2023-12-12T09:44:37.671215+0000","last_undegraded":"2023-12-12T09:44:37.671215+0000","last_fullsized":"2023-12-12T09:44:37.671215+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:35.613810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:35.613810+0000","last_clean_scrub_stamp":"2023-12-12T09:44:35.613810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T15:35:25.157642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":15,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-12-12T09:44:35.641177+0000","last_change":"2023-12-12T09:44:20.511329+0000","last_active":"2023-12-12T09:44:35.641177+0000","last_peered":"2023-12-12T09:44:35.641177+0000","last_clean":"2023-12-12T09:44:35.641177+0000","last_became_active":"2023-12-12T09:44:20.510982+0000","last_became_peered":"2023-12-12T09:44:20.510982+0000","last_unstale":"2023-12-12T09:44:35.641177+0000","last_undegraded":"2023-12-12T09:44:35.641177+0000","last_fullsized":"2023-12-12T09:44:35.641177+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:19.449520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:19.449520+0000","last_clean_scrub_stamp":"2023-12-12T09:44:19.449520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T10:43:47.019227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":15,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-12-12T09:44:36.667157+0000","last_change":"2023-12-12T09:44:21.515107+0000","last_active":"2023-12-12T09:44:36.667157+0000","last_peered":"2023-12-12T09:44:36.667157+0000","last_clean":"2023-12-12T09:44:36.667157+0000","last_became_active":"2023-12-12T09:44:21.514827+0000","last_became_peered":"2023-12-12T09:44:21.514827+0000","last_unstale":"2023-12-12T09:44:36.667157+0000","last_undegraded":"2023-12-12T09:44:36.667157+0000","last_fullsized":"2023-12-12T09:44:36.667157+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_clean_scrub_stamp":"2023-12-12T09:44:20.465592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T10:43:48.035299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-12T09:44:39.349978+0000","last_change":"2023-12-12T09:44:35.662358+0000","last_active":"2023-12-12T09:44:39.349978+0000","last_peered":"2023-12-12T09:44:39.349978+0000","last_clean":"2023-12-12T09:44:39.349978+0000","last_became_active":"2023-12-12T09:44:35.661947+0000","last_became_peered":"2023-12-12T09:44:35.661947+0000","last_unstale":"2023-12-12T09:44:39.349978+0000","last_undegraded":"2023-12-12T09:44:39.349978+0000","last_fullsized":"2023-12-12T09:44:39.349978+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:34.598834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:34.598834+0000","last_clean_scrub_stamp":"2023-12-12T09:44:34.598834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T11:38:32.706205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-12T09:44:39.114916+0000","last_change":"2023-12-12T09:44:36.681882+0000","last_active":"2023-12-12T09:44:39.114916+0000","last_peered":"2023-12-12T09:44:39.114916+0000","last_clean":"2023-12-12T09:44:39.114916+0000","last_became_active":"2023-12-12T09:44:36.681579+0000","last_became_peered":"2023-12-12T09:44:36.681579+0000","last_unstale":"2023-12-12T09:44:39.114916+0000","last_undegraded":"2023-12-12T09:44:39.114916+0000","last_fullsized":"2023-12-12T09:44:39.114916+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:35.613810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:35.613810+0000","last_clean_scrub_stamp":"2023-12-12T09:44:35.613810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T14:59:14.282572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"34'1","reported_seq":17,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-12-12T09:44:36.675627+0000","last_change":"2023-12-12T09:44:20.505916+0000","last_active":"2023-12-12T09:44:36.675627+0000","last_peered":"2023-12-12T09:44:36.675627+0000","last_clean":"2023-12-12T09:44:36.675627+0000","last_became_active":"2023-12-12T09:44:20.505632+0000","last_became_peered":"2023-12-12T09:44:20.505632+0000","last_unstale":"2023-12-12T09:44:36.675627+0000","last_undegraded":"2023-12-12T09:44:36.675627+0000","last_fullsized":"2023-12-12T09:44:36.675627+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:19.449520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:19.449520+0000","last_clean_scrub_stamp":"2023-12-12T09:44:19.449520+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T12:00:32.399540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":15,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-12-12T09:44:36.658887+0000","last_change":"2023-12-12T09:44:21.521339+0000","last_active":"2023-12-12T09:44:36.658887+0000","last_peered":"2023-12-12T09:44:36.658887+0000","last_clean":"2023-12-12T09:44:36.658887+0000","last_became_active":"2023-12-12T09:44:21.521079+0000","last_became_peered":"2023-12-12T09:44:21.521079+0000","last_unstale":"2023-12-12T09:44:36.658887+0000","last_undegraded":"2023-12-12T09:44:36.658887+0000","last_fullsized":"2023-12-12T09:44:36.658887+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_clean_scrub_stamp":"2023-12-12T09:44:20.465592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T21:03:17.881060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-12-12T09:44:36.667760+0000","last_change":"2023-12-12T09:44:35.648084+0000","last_active":"2023-12-12T09:44:36.667760+0000","last_peered":"2023-12-12T09:44:36.667760+0000","last_clean":"2023-12-12T09:44:36.667760+0000","last_became_active":"2023-12-12T09:44:35.647820+0000","last_became_peered":"2023-12-12T09:44:35.647820+0000","last_unstale":"2023-12-12T09:44:36.667760+0000","last_undegraded":"2023-12-12T09:44:36.667760+0000","last_fullsized":"2023-12-12T09:44:36.667760+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:34.598834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:34.598834+0000","last_clean_scrub_stamp":"2023-12-12T09:44:34.598834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T11:13:35.308291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-12T09:44:38.631086+0000","last_change":"2023-12-12T09:44:36.694193+0000","last_active":"2023-12-12T09:44:38.631086+0000","last_peered":"2023-12-12T09:44:38.631086+0000","last_clean":"2023-12-12T09:44:38.631086+0000","last_became_active":"2023-12-12T09:44:36.693878+0000","last_became_peered":"2023-12-12T09:44:36.693878+0000","last_unstale":"2023-12-12T09:44:38.631086+0000","last_undegraded":"2023-12-12T09:44:38.631086+0000","last_fullsized":"2023-12-12T09:44:38.631086+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:35.613810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:35.613810+0000","last_clean_scrub_stamp":"2023-12-12T09:44:35.613810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T12:05:02.659374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"33'2","reported_seq":17,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-12-12T09:44:35.642603+0000","last_change":"2023-12-12T09:44:20.511011+0000","last_active":"2023-12-12T09:44:35.642603+0000","last_peered":"2023-12-12T09:44:35.642603+0000","last_clean":"2023-12-12T09:44:35.642603+0000","last_became_active":"2023-12-12T09:44:20.510709+0000","last_became_peered":"2023-12-12T09:44:20.510709+0000","last_unstale":"2023-12-12T09:44:35.642603+0000","last_undegraded":"2023-12-12T09:44:35.642603+0000","last_fullsized":"2023-12-12T09:44:35.642603+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:19.449520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:19.449520+0000","last_clean_scrub_stamp":"2023-12-12T09:44:19.449520+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T12:49:11.267636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":15,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-12-12T09:44:36.649988+0000","last_change":"2023-12-12T09:44:21.521774+0000","last_active":"2023-12-12T09:44:36.649988+0000","last_peered":"2023-12-12T09:44:36.649988+0000","last_clean":"2023-12-12T09:44:36.649988+0000","last_became_active":"2023-12-12T09:44:21.521431+0000","last_became_peered":"2023-12-12T09:44:21.521431+0000","last_unstale":"2023-12-12T09:44:36.649988+0000","last_undegraded":"2023-12-12T09:44:36.649988+0000","last_fullsized":"2023-12-12T09:44:36.649988+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_clean_scrub_stamp":"2023-12-12T09:44:20.465592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T19:05:15.078557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-12T09:44:39.115209+0000","last_change":"2023-12-12T09:44:35.662356+0000","last_active":"2023-12-12T09:44:39.115209+0000","last_peered":"2023-12-12T09:44:39.115209+0000","last_clean":"2023-12-12T09:44:39.115209+0000","last_became_active":"2023-12-12T09:44:35.662107+0000","last_became_peered":"2023-12-12T09:44:35.662107+0000","last_unstale":"2023-12-12T09:44:39.115209+0000","last_undegraded":"2023-12-12T09:44:39.115209+0000","last_fullsized":"2023-12-12T09:44:39.115209+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:34.598834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:34.598834+0000","last_clean_scrub_stamp":"2023-12-12T09:44:34.598834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T10:18:12.298090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-12-12T09:44:36.689624+0000","last_change":"2023-12-12T09:44:36.681837+0000","last_active":"2023-12-12T09:44:36.689624+0000","last_peered":"2023-12-12T09:44:36.689624+0000","last_clean":"2023-12-12T09:44:36.689624+0000","last_became_active":"2023-12-12T09:44:36.681530+0000","last_became_peered":"2023-12-12T09:44:36.681530+0000","last_unstale":"2023-12-12T09:44:36.689624+0000","last_undegraded":"2023-12-12T09:44:36.689624+0000","last_fullsized":"2023-12-12T09:44:36.689624+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:35.613810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:35.613810+0000","last_clean_scrub_stamp":"2023-12-12T09:44:35.613810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T16:53:46.370125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":16,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-12-12T09:44:36.655984+0000","last_change":"2023-12-12T09:44:20.519234+0000","last_active":"2023-12-12T09:44:36.655984+0000","last_peered":"2023-12-12T09:44:36.655984+0000","last_clean":"2023-12-12T09:44:36.655984+0000","last_became_active":"2023-12-12T09:44:20.518728+0000","last_became_peered":"2023-12-12T09:44:20.518728+0000","last_unstale":"2023-12-12T09:44:36.655984+0000","last_undegraded":"2023-12-12T09:44:36.655984+0000","last_fullsized":"2023-12-12T09:44:36.655984+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:19.449520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:19.449520+0000","last_clean_scrub_stamp":"2023-12-12T09:44:19.449520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T14:50:34.872309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":15,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-12-12T09:44:36.664689+0000","last_change":"2023-12-12T09:44:21.527012+0000","last_active":"2023-12-12T09:44:36.664689+0000","last_peered":"2023-12-12T09:44:36.664689+0000","last_clean":"2023-12-12T09:44:36.664689+0000","last_became_active":"2023-12-12T09:44:21.525770+0000","last_became_peered":"2023-12-12T09:44:21.525770+0000","last_unstale":"2023-12-12T09:44:36.664689+0000","last_undegraded":"2023-12-12T09:44:36.664689+0000","last_fullsized":"2023-12-12T09:44:36.664689+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_clean_scrub_stamp":"2023-12-12T09:44:20.465592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T10:50:32.155095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-12T09:44:37.670227+0000","last_change":"2023-12-12T09:44:35.647662+0000","last_active":"2023-12-12T09:44:37.670227+0000","last_peered":"2023-12-12T09:44:37.670227+0000","last_clean":"2023-12-12T09:44:37.670227+0000","last_became_active":"2023-12-12T09:44:35.647396+0000","last_became_peered":"2023-12-12T09:44:35.647396+0000","last_unstale":"2023-12-12T09:44:37.670227+0000","last_undegraded":"2023-12-12T09:44:37.670227+0000","last_fullsized":"2023-12-12T09:44:37.670227+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:34.598834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:34.598834+0000","last_clean_scrub_stamp":"2023-12-12T09:44:34.598834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T14:54:52.313229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-12T09:44:39.348455+0000","last_change":"2023-12-12T09:44:36.684790+0000","last_active":"2023-12-12T09:44:39.348455+0000","last_peered":"2023-12-12T09:44:39.348455+0000","last_clean":"2023-12-12T09:44:39.348455+0000","last_became_active":"2023-12-12T09:44:36.680745+0000","last_became_peered":"2023-12-12T09:44:36.680745+0000","last_unstale":"2023-12-12T09:44:39.348455+0000","last_undegraded":"2023-12-12T09:44:39.348455+0000","last_fullsized":"2023-12-12T09:44:39.348455+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:35.613810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:35.613810+0000","last_clean_scrub_stamp":"2023-12-12T09:44:35.613810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T15:50:24.911543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":16,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-12-12T09:44:36.660535+0000","last_change":"2023-12-12T09:44:20.509876+0000","last_active":"2023-12-12T09:44:36.660535+0000","last_peered":"2023-12-12T09:44:36.660535+0000","last_clean":"2023-12-12T09:44:36.660535+0000","last_became_active":"2023-12-12T09:44:20.509580+0000","last_became_peered":"2023-12-12T09:44:20.509580+0000","last_unstale":"2023-12-12T09:44:36.660535+0000","last_undegraded":"2023-12-12T09:44:36.660535+0000","last_fullsized":"2023-12-12T09:44:36.660535+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:19.449520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:19.449520+0000","last_clean_scrub_stamp":"2023-12-12T09:44:19.449520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T12:00:32.399540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":15,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-12-12T09:44:36.648493+0000","last_change":"2023-12-12T09:44:21.508562+0000","last_active":"2023-12-12T09:44:36.648493+0000","last_peered":"2023-12-12T09:44:36.648493+0000","last_clean":"2023-12-12T09:44:36.648493+0000","last_became_active":"2023-12-12T09:44:21.508207+0000","last_became_peered":"2023-12-12T09:44:21.508207+0000","last_unstale":"2023-12-12T09:44:36.648493+0000","last_undegraded":"2023-12-12T09:44:36.648493+0000","last_fullsized":"2023-12-12T09:44:36.648493+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_clean_scrub_stamp":"2023-12-12T09:44:20.465592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T14:54:55.495724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"37'2","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-12T09:44:39.349116+0000","last_change":"2023-12-12T09:44:35.658736+0000","last_active":"2023-12-12T09:44:39.349116+0000","last_peered":"2023-12-12T09:44:39.349116+0000","last_clean":"2023-12-12T09:44:39.349116+0000","last_became_active":"2023-12-12T09:44:35.658452+0000","last_became_peered":"2023-12-12T09:44:35.658452+0000","last_unstale":"2023-12-12T09:44:39.349116+0000","last_undegraded":"2023-12-12T09:44:39.349116+0000","last_fullsized":"2023-12-12T09:44:39.349116+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:34.598834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:34.598834+0000","last_clean_scrub_stamp":"2023-12-12T09:44:34.598834+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T19:56:10.457023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-12T09:44:38.630768+0000","last_change":"2023-12-12T09:44:36.692107+0000","last_active":"2023-12-12T09:44:38.630768+0000","last_peered":"2023-12-12T09:44:38.630768+0000","last_clean":"2023-12-12T09:44:38.630768+0000","last_became_active":"2023-12-12T09:44:36.691836+0000","last_became_peered":"2023-12-12T09:44:36.691836+0000","last_unstale":"2023-12-12T09:44:38.630768+0000","last_undegraded":"2023-12-12T09:44:38.630768+0000","last_fullsized":"2023-12-12T09:44:38.630768+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:35.613810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:35.613810+0000","last_clean_scrub_stamp":"2023-12-12T09:44:35.613810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T17:28:18.218353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":16,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-12-12T09:44:36.670436+0000","last_change":"2023-12-12T09:44:20.515913+0000","last_active":"2023-12-12T09:44:36.670436+0000","last_peered":"2023-12-12T09:44:36.670436+0000","last_clean":"2023-12-12T09:44:36.670436+0000","last_became_active":"2023-12-12T09:44:20.515642+0000","last_became_peered":"2023-12-12T09:44:20.515642+0000","last_unstale":"2023-12-12T09:44:36.670436+0000","last_undegraded":"2023-12-12T09:44:36.670436+0000","last_fullsized":"2023-12-12T09:44:36.670436+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:19.449520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:19.449520+0000","last_clean_scrub_stamp":"2023-12-12T09:44:19.449520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T21:18:35.916411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":15,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-12-12T09:44:36.649123+0000","last_change":"2023-12-12T09:44:21.511615+0000","last_active":"2023-12-12T09:44:36.649123+0000","last_peered":"2023-12-12T09:44:36.649123+0000","last_clean":"2023-12-12T09:44:36.649123+0000","last_became_active":"2023-12-12T09:44:21.509251+0000","last_became_peered":"2023-12-12T09:44:21.509251+0000","last_unstale":"2023-12-12T09:44:36.649123+0000","last_undegraded":"2023-12-12T09:44:36.649123+0000","last_fullsized":"2023-12-12T09:44:36.649123+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_clean_scrub_stamp":"2023-12-12T09:44:20.465592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T19:18:46.146779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-12T09:44:39.114933+0000","last_change":"2023-12-12T09:44:35.663012+0000","last_active":"2023-12-12T09:44:39.114933+0000","last_peered":"2023-12-12T09:44:39.114933+0000","last_clean":"2023-12-12T09:44:39.114933+0000","last_became_active":"2023-12-12T09:44:35.661850+0000","last_became_peered":"2023-12-12T09:44:35.661850+0000","last_unstale":"2023-12-12T09:44:39.114933+0000","last_undegraded":"2023-12-12T09:44:39.114933+0000","last_fullsized":"2023-12-12T09:44:39.114933+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:34.598834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:34.598834+0000","last_clean_scrub_stamp":"2023-12-12T09:44:34.598834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T12:05:01.644399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-12T09:44:37.666022+0000","last_change":"2023-12-12T09:44:36.677106+0000","last_active":"2023-12-12T09:44:37.666022+0000","last_peered":"2023-12-12T09:44:37.666022+0000","last_clean":"2023-12-12T09:44:37.666022+0000","last_became_active":"2023-12-12T09:44:36.676300+0000","last_became_peered":"2023-12-12T09:44:36.676300+0000","last_unstale":"2023-12-12T09:44:37.666022+0000","last_undegraded":"2023-12-12T09:44:37.666022+0000","last_fullsized":"2023-12-12T09:44:37.666022+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:35.613810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:35.613810+0000","last_clean_scrub_stamp":"2023-12-12T09:44:35.613810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T11:40:35.924078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"33'2","reported_seq":18,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-12-12T09:44:36.669570+0000","last_change":"2023-12-12T09:44:20.506834+0000","last_active":"2023-12-12T09:44:36.669570+0000","last_peered":"2023-12-12T09:44:36.669570+0000","last_clean":"2023-12-12T09:44:36.669570+0000","last_became_active":"2023-12-12T09:44:20.506432+0000","last_became_peered":"2023-12-12T09:44:20.506432+0000","last_unstale":"2023-12-12T09:44:36.669570+0000","last_undegraded":"2023-12-12T09:44:36.669570+0000","last_fullsized":"2023-12-12T09:44:36.669570+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:19.449520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:19.449520+0000","last_clean_scrub_stamp":"2023-12-12T09:44:19.449520+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T21:18:35.916411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":15,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-12-12T09:44:36.647675+0000","last_change":"2023-12-12T09:44:21.529516+0000","last_active":"2023-12-12T09:44:36.647675+0000","last_peered":"2023-12-12T09:44:36.647675+0000","last_clean":"2023-12-12T09:44:36.647675+0000","last_became_active":"2023-12-12T09:44:21.528160+0000","last_became_peered":"2023-12-12T09:44:21.528160+0000","last_unstale":"2023-12-12T09:44:36.647675+0000","last_undegraded":"2023-12-12T09:44:36.647675+0000","last_fullsized":"2023-12-12T09:44:36.647675+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_clean_scrub_stamp":"2023-12-12T09:44:20.465592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T19:57:06.191557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-12T09:44:38.631629+0000","last_change":"2023-12-12T09:44:35.650961+0000","last_active":"2023-12-12T09:44:38.631629+0000","last_peered":"2023-12-12T09:44:38.631629+0000","last_clean":"2023-12-12T09:44:38.631629+0000","last_became_active":"2023-12-12T09:44:35.650680+0000","last_became_peered":"2023-12-12T09:44:35.650680+0000","last_unstale":"2023-12-12T09:44:38.631629+0000","last_undegraded":"2023-12-12T09:44:38.631629+0000","last_fullsized":"2023-12-12T09:44:38.631629+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:34.598834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:34.598834+0000","last_clean_scrub_stamp":"2023-12-12T09:44:34.598834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T16:53:45.355149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-12T09:44:38.631798+0000","last_change":"2023-12-12T09:44:36.698739+0000","last_active":"2023-12-12T09:44:38.631798+0000","last_peered":"2023-12-12T09:44:38.631798+0000","last_clean":"2023-12-12T09:44:38.631798+0000","last_became_active":"2023-12-12T09:44:36.698446+0000","last_became_peered":"2023-12-12T09:44:36.698446+0000","last_unstale":"2023-12-12T09:44:38.631798+0000","last_undegraded":"2023-12-12T09:44:38.631798+0000","last_fullsized":"2023-12-12T09:44:38.631798+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:35.613810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:35.613810+0000","last_clean_scrub_stamp":"2023-12-12T09:44:35.613810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T12:57:09.988722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":16,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-12-12T09:44:36.661363+0000","last_change":"2023-12-12T09:44:20.507016+0000","last_active":"2023-12-12T09:44:36.661363+0000","last_peered":"2023-12-12T09:44:36.661363+0000","last_clean":"2023-12-12T09:44:36.661363+0000","last_became_active":"2023-12-12T09:44:20.506728+0000","last_became_peered":"2023-12-12T09:44:20.506728+0000","last_unstale":"2023-12-12T09:44:36.661363+0000","last_undegraded":"2023-12-12T09:44:36.661363+0000","last_fullsized":"2023-12-12T09:44:36.661363+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:19.449520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:19.449520+0000","last_clean_scrub_stamp":"2023-12-12T09:44:19.449520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T20:21:31.990503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":15,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-12-12T09:44:36.648373+0000","last_change":"2023-12-12T09:44:21.508894+0000","last_active":"2023-12-12T09:44:36.648373+0000","last_peered":"2023-12-12T09:44:36.648373+0000","last_clean":"2023-12-12T09:44:36.648373+0000","last_became_active":"2023-12-12T09:44:21.508640+0000","last_became_peered":"2023-12-12T09:44:21.508640+0000","last_unstale":"2023-12-12T09:44:36.648373+0000","last_undegraded":"2023-12-12T09:44:36.648373+0000","last_fullsized":"2023-12-12T09:44:36.648373+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_clean_scrub_stamp":"2023-12-12T09:44:20.465592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T20:16:13.594869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"37'2","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-12T09:44:38.658011+0000","last_change":"2023-12-12T09:44:35.660900+0000","last_active":"2023-12-12T09:44:38.658011+0000","last_peered":"2023-12-12T09:44:38.658011+0000","last_clean":"2023-12-12T09:44:38.658011+0000","last_became_active":"2023-12-12T09:44:35.660595+0000","last_became_peered":"2023-12-12T09:44:35.660595+0000","last_unstale":"2023-12-12T09:44:38.658011+0000","last_undegraded":"2023-12-12T09:44:38.658011+0000","last_fullsized":"2023-12-12T09:44:38.658011+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:34.598834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:34.598834+0000","last_clean_scrub_stamp":"2023-12-12T09:44:34.598834+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T15:01:08.079004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-12T09:44:37.666834+0000","last_change":"2023-12-12T09:44:36.661566+0000","last_active":"2023-12-12T09:44:37.666834+0000","last_peered":"2023-12-12T09:44:37.666834+0000","last_clean":"2023-12-12T09:44:37.666834+0000","last_became_active":"2023-12-12T09:44:36.661033+0000","last_became_peered":"2023-12-12T09:44:36.661033+0000","last_unstale":"2023-12-12T09:44:37.666834+0000","last_undegraded":"2023-12-12T09:44:37.666834+0000","last_fullsized":"2023-12-12T09:44:37.666834+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:35.613810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:35.613810+0000","last_clean_scrub_stamp":"2023-12-12T09:44:35.613810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T12:23:32.289445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"33'1","reported_seq":17,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-12-12T09:44:36.663524+0000","last_change":"2023-12-12T09:44:20.511043+0000","last_active":"2023-12-12T09:44:36.663524+0000","last_peered":"2023-12-12T09:44:36.663524+0000","last_clean":"2023-12-12T09:44:36.663524+0000","last_became_active":"2023-12-12T09:44:20.510215+0000","last_became_peered":"2023-12-12T09:44:20.510215+0000","last_unstale":"2023-12-12T09:44:36.663524+0000","last_undegraded":"2023-12-12T09:44:36.663524+0000","last_fullsized":"2023-12-12T09:44:36.663524+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:19.449520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:19.449520+0000","last_clean_scrub_stamp":"2023-12-12T09:44:19.449520+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T19:16:24.812720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-12-12T09:44:35.641310+0000","last_change":"2023-12-12T09:44:21.536677+0000","last_active":"2023-12-12T09:44:35.641310+0000","last_peered":"2023-12-12T09:44:35.641310+0000","last_clean":"2023-12-12T09:44:35.641310+0000","last_became_active":"2023-12-12T09:44:21.535741+0000","last_became_peered":"2023-12-12T09:44:21.535741+0000","last_unstale":"2023-12-12T09:44:35.641310+0000","last_undegraded":"2023-12-12T09:44:35.641310+0000","last_fullsized":"2023-12-12T09:44:35.641310+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_clean_scrub_stamp":"2023-12-12T09:44:20.465592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T20:58:54.834367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"37'1","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-12T09:44:37.666786+0000","last_change":"2023-12-12T09:44:35.656135+0000","last_active":"2023-12-12T09:44:37.666786+0000","last_peered":"2023-12-12T09:44:37.666786+0000","last_clean":"2023-12-12T09:44:37.666786+0000","last_became_active":"2023-12-12T09:44:35.655532+0000","last_became_peered":"2023-12-12T09:44:35.655532+0000","last_unstale":"2023-12-12T09:44:37.666786+0000","last_undegraded":"2023-12-12T09:44:37.666786+0000","last_fullsized":"2023-12-12T09:44:37.666786+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:34.598834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:34.598834+0000","last_clean_scrub_stamp":"2023-12-12T09:44:34.598834+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T14:50:50.021624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-12T09:44:37.671977+0000","last_change":"2023-12-12T09:44:36.685186+0000","last_active":"2023-12-12T09:44:37.671977+0000","last_peered":"2023-12-12T09:44:37.671977+0000","last_clean":"2023-12-12T09:44:37.671977+0000","last_became_active":"2023-12-12T09:44:36.684861+0000","last_became_peered":"2023-12-12T09:44:36.684861+0000","last_unstale":"2023-12-12T09:44:37.671977+0000","last_undegraded":"2023-12-12T09:44:37.671977+0000","last_fullsized":"2023-12-12T09:44:37.671977+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:35.613810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:35.613810+0000","last_clean_scrub_stamp":"2023-12-12T09:44:35.613810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T11:13:36.323267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.e","version":"33'2","reported_seq":18,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-12-12T09:44:36.662012+0000","last_change":"2023-12-12T09:44:20.516846+0000","last_active":"2023-12-12T09:44:36.662012+0000","last_peered":"2023-12-12T09:44:36.662012+0000","last_clean":"2023-12-12T09:44:36.662012+0000","last_became_active":"2023-12-12T09:44:20.514593+0000","last_became_peered":"2023-12-12T09:44:20.514593+0000","last_unstale":"2023-12-12T09:44:36.662012+0000","last_undegraded":"2023-12-12T09:44:36.662012+0000","last_fullsized":"2023-12-12T09:44:36.662012+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:19.449520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:19.449520+0000","last_clean_scrub_stamp":"2023-12-12T09:44:19.449520+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T16:36:32.055010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":15,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-12-12T09:44:36.658667+0000","last_change":"2023-12-12T09:44:21.528910+0000","last_active":"2023-12-12T09:44:36.658667+0000","last_peered":"2023-12-12T09:44:36.658667+0000","last_clean":"2023-12-12T09:44:36.658667+0000","last_became_active":"2023-12-12T09:44:21.528597+0000","last_became_peered":"2023-12-12T09:44:21.528597+0000","last_unstale":"2023-12-12T09:44:36.658667+0000","last_undegraded":"2023-12-12T09:44:36.658667+0000","last_fullsized":"2023-12-12T09:44:36.658667+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_clean_scrub_stamp":"2023-12-12T09:44:20.465592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T10:03:17.158642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-12T09:44:39.349709+0000","last_change":"2023-12-12T09:44:35.654387+0000","last_active":"2023-12-12T09:44:39.349709+0000","last_peered":"2023-12-12T09:44:39.349709+0000","last_clean":"2023-12-12T09:44:39.349709+0000","last_became_active":"2023-12-12T09:44:35.654070+0000","last_became_peered":"2023-12-12T09:44:35.654070+0000","last_unstale":"2023-12-12T09:44:39.349709+0000","last_undegraded":"2023-12-12T09:44:39.349709+0000","last_fullsized":"2023-12-12T09:44:39.349709+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:34.598834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:34.598834+0000","last_clean_scrub_stamp":"2023-12-12T09:44:34.598834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T19:31:01.352071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-12T09:44:37.670008+0000","last_change":"2023-12-12T09:44:36.696620+0000","last_active":"2023-12-12T09:44:37.670008+0000","last_peered":"2023-12-12T09:44:37.670008+0000","last_clean":"2023-12-12T09:44:37.670008+0000","last_became_active":"2023-12-12T09:44:36.696301+0000","last_became_peered":"2023-12-12T09:44:36.696301+0000","last_unstale":"2023-12-12T09:44:37.670008+0000","last_undegraded":"2023-12-12T09:44:37.670008+0000","last_fullsized":"2023-12-12T09:44:37.670008+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:35.613810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:35.613810+0000","last_clean_scrub_stamp":"2023-12-12T09:44:35.613810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T18:05:58.014144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.f","version":"33'1","reported_seq":16,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-12-12T09:44:35.642513+0000","last_change":"2023-12-12T09:44:20.505080+0000","last_active":"2023-12-12T09:44:35.642513+0000","last_peered":"2023-12-12T09:44:35.642513+0000","last_clean":"2023-12-12T09:44:35.642513+0000","last_became_active":"2023-12-12T09:44:20.504727+0000","last_became_peered":"2023-12-12T09:44:20.504727+0000","last_unstale":"2023-12-12T09:44:35.642513+0000","last_undegraded":"2023-12-12T09:44:35.642513+0000","last_fullsized":"2023-12-12T09:44:35.642513+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:19.449520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:19.449520+0000","last_clean_scrub_stamp":"2023-12-12T09:44:19.449520+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T12:07:41.908376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":15,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-12-12T09:44:36.661713+0000","last_change":"2023-12-12T09:44:21.530767+0000","last_active":"2023-12-12T09:44:36.661713+0000","last_peered":"2023-12-12T09:44:36.661713+0000","last_clean":"2023-12-12T09:44:36.661713+0000","last_became_active":"2023-12-12T09:44:21.530072+0000","last_became_peered":"2023-12-12T09:44:21.530072+0000","last_unstale":"2023-12-12T09:44:36.661713+0000","last_undegraded":"2023-12-12T09:44:36.661713+0000","last_fullsized":"2023-12-12T09:44:36.661713+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_clean_scrub_stamp":"2023-12-12T09:44:20.465592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T12:49:12.283708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"37'1","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-12T09:44:37.673073+0000","last_change":"2023-12-12T09:44:35.647206+0000","last_active":"2023-12-12T09:44:37.673073+0000","last_peered":"2023-12-12T09:44:37.673073+0000","last_clean":"2023-12-12T09:44:37.673073+0000","last_became_active":"2023-12-12T09:44:35.646938+0000","last_became_peered":"2023-12-12T09:44:35.646938+0000","last_unstale":"2023-12-12T09:44:37.673073+0000","last_undegraded":"2023-12-12T09:44:37.673073+0000","last_fullsized":"2023-12-12T09:44:37.673073+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:34.598834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:34.598834+0000","last_clean_scrub_stamp":"2023-12-12T09:44:34.598834+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T11:47:29.098367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-12T09:44:38.631976+0000","last_change":"2023-12-12T09:44:36.683084+0000","last_active":"2023-12-12T09:44:38.631976+0000","last_peered":"2023-12-12T09:44:38.631976+0000","last_clean":"2023-12-12T09:44:38.631976+0000","last_became_active":"2023-12-12T09:44:36.682525+0000","last_became_peered":"2023-12-12T09:44:36.682525+0000","last_unstale":"2023-12-12T09:44:38.631976+0000","last_undegraded":"2023-12-12T09:44:38.631976+0000","last_fullsized":"2023-12-12T09:44:38.631976+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:35.613810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:35.613810+0000","last_clean_scrub_stamp":"2023-12-12T09:44:35.613810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T20:37:14.056550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"33'8","reported_seq":24,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-12-12T09:44:36.670275+0000","last_change":"2023-12-12T09:44:20.505770+0000","last_active":"2023-12-12T09:44:36.670275+0000","last_peered":"2023-12-12T09:44:36.670275+0000","last_clean":"2023-12-12T09:44:36.670275+0000","last_became_active":"2023-12-12T09:44:20.505511+0000","last_became_peered":"2023-12-12T09:44:20.505511+0000","last_unstale":"2023-12-12T09:44:36.670275+0000","last_undegraded":"2023-12-12T09:44:36.670275+0000","last_fullsized":"2023-12-12T09:44:36.670275+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:19.449520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:19.449520+0000","last_clean_scrub_stamp":"2023-12-12T09:44:19.449520+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T12:23:16.125156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":15,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-12-12T09:44:36.669409+0000","last_change":"2023-12-12T09:44:21.531855+0000","last_active":"2023-12-12T09:44:36.669409+0000","last_peered":"2023-12-12T09:44:36.669409+0000","last_clean":"2023-12-12T09:44:36.669409+0000","last_became_active":"2023-12-12T09:44:21.531294+0000","last_became_peered":"2023-12-12T09:44:21.531294+0000","last_unstale":"2023-12-12T09:44:36.669409+0000","last_undegraded":"2023-12-12T09:44:36.669409+0000","last_fullsized":"2023-12-12T09:44:36.669409+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_clean_scrub_stamp":"2023-12-12T09:44:20.465592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T21:42:36.877781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-12T09:44:39.114169+0000","last_change":"2023-12-12T09:44:35.664065+0000","last_active":"2023-12-12T09:44:39.114169+0000","last_peered":"2023-12-12T09:44:39.114169+0000","last_clean":"2023-12-12T09:44:39.114169+0000","last_became_active":"2023-12-12T09:44:35.663789+0000","last_became_peered":"2023-12-12T09:44:35.663789+0000","last_unstale":"2023-12-12T09:44:39.114169+0000","last_undegraded":"2023-12-12T09:44:39.114169+0000","last_fullsized":"2023-12-12T09:44:39.114169+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:34.598834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:34.598834+0000","last_clean_scrub_stamp":"2023-12-12T09:44:34.598834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T17:28:17.203377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-12T09:44:37.671387+0000","last_change":"2023-12-12T09:44:36.701232+0000","last_active":"2023-12-12T09:44:37.671387+0000","last_peered":"2023-12-12T09:44:37.671387+0000","last_clean":"2023-12-12T09:44:37.671387+0000","last_became_active":"2023-12-12T09:44:36.700957+0000","last_became_peered":"2023-12-12T09:44:36.700957+0000","last_unstale":"2023-12-12T09:44:37.671387+0000","last_undegraded":"2023-12-12T09:44:37.671387+0000","last_fullsized":"2023-12-12T09:44:37.671387+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:35.613810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:35.613810+0000","last_clean_scrub_stamp":"2023-12-12T09:44:35.613810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T15:01:09.093979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":16,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-12-12T09:44:36.668522+0000","last_change":"2023-12-12T09:44:20.514956+0000","last_active":"2023-12-12T09:44:36.668522+0000","last_peered":"2023-12-12T09:44:36.668522+0000","last_clean":"2023-12-12T09:44:36.668522+0000","last_became_active":"2023-12-12T09:44:20.513186+0000","last_became_peered":"2023-12-12T09:44:20.513186+0000","last_unstale":"2023-12-12T09:44:36.668522+0000","last_undegraded":"2023-12-12T09:44:36.668522+0000","last_fullsized":"2023-12-12T09:44:36.668522+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:19.449520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:19.449520+0000","last_clean_scrub_stamp":"2023-12-12T09:44:19.449520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T12:49:11.267636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":15,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-12-12T09:44:36.665056+0000","last_change":"2023-12-12T09:44:21.532046+0000","last_active":"2023-12-12T09:44:36.665056+0000","last_peered":"2023-12-12T09:44:36.665056+0000","last_clean":"2023-12-12T09:44:36.665056+0000","last_became_active":"2023-12-12T09:44:21.531801+0000","last_became_peered":"2023-12-12T09:44:21.531801+0000","last_unstale":"2023-12-12T09:44:36.665056+0000","last_undegraded":"2023-12-12T09:44:36.665056+0000","last_fullsized":"2023-12-12T09:44:36.665056+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_clean_scrub_stamp":"2023-12-12T09:44:20.465592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T12:23:17.141227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"37'2","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-12T09:44:39.348925+0000","last_change":"2023-12-12T09:44:35.656102+0000","last_active":"2023-12-12T09:44:39.348925+0000","last_peered":"2023-12-12T09:44:39.348925+0000","last_clean":"2023-12-12T09:44:39.348925+0000","last_became_active":"2023-12-12T09:44:35.655951+0000","last_became_peered":"2023-12-12T09:44:35.655951+0000","last_unstale":"2023-12-12T09:44:39.348925+0000","last_undegraded":"2023-12-12T09:44:39.348925+0000","last_fullsized":"2023-12-12T09:44:39.348925+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:34.598834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:34.598834+0000","last_clean_scrub_stamp":"2023-12-12T09:44:34.598834+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T14:59:13.267597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-12T09:44:39.114017+0000","last_change":"2023-12-12T09:44:36.688289+0000","last_active":"2023-12-12T09:44:39.114017+0000","last_peered":"2023-12-12T09:44:39.114017+0000","last_clean":"2023-12-12T09:44:39.114017+0000","last_became_active":"2023-12-12T09:44:36.687978+0000","last_became_peered":"2023-12-12T09:44:36.687978+0000","last_unstale":"2023-12-12T09:44:39.114017+0000","last_undegraded":"2023-12-12T09:44:39.114017+0000","last_fullsized":"2023-12-12T09:44:39.114017+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:35.613810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:35.613810+0000","last_clean_scrub_stamp":"2023-12-12T09:44:35.613810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T11:38:33.721181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":15,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-12-12T09:44:35.640048+0000","last_change":"2023-12-12T09:44:20.513932+0000","last_active":"2023-12-12T09:44:35.640048+0000","last_peered":"2023-12-12T09:44:35.640048+0000","last_clean":"2023-12-12T09:44:35.640048+0000","last_became_active":"2023-12-12T09:44:20.513676+0000","last_became_peered":"2023-12-12T09:44:20.513676+0000","last_unstale":"2023-12-12T09:44:35.640048+0000","last_undegraded":"2023-12-12T09:44:35.640048+0000","last_fullsized":"2023-12-12T09:44:35.640048+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:19.449520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:19.449520+0000","last_clean_scrub_stamp":"2023-12-12T09:44:19.449520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T19:16:24.812720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":15,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-12-12T09:44:36.671127+0000","last_change":"2023-12-12T09:44:21.498629+0000","last_active":"2023-12-12T09:44:36.671127+0000","last_peered":"2023-12-12T09:44:36.671127+0000","last_clean":"2023-12-12T09:44:36.671127+0000","last_became_active":"2023-12-12T09:44:21.498281+0000","last_became_peered":"2023-12-12T09:44:21.498281+0000","last_unstale":"2023-12-12T09:44:36.671127+0000","last_undegraded":"2023-12-12T09:44:36.671127+0000","last_fullsized":"2023-12-12T09:44:36.671127+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_clean_scrub_stamp":"2023-12-12T09:44:20.465592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T15:26:37.478870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"37'8","reported_seq":20,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-12T09:44:38.630748+0000","last_change":"2023-12-12T09:44:35.654340+0000","last_active":"2023-12-12T09:44:38.630748+0000","last_peered":"2023-12-12T09:44:38.630748+0000","last_clean":"2023-12-12T09:44:38.630748+0000","last_became_active":"2023-12-12T09:44:35.654047+0000","last_became_peered":"2023-12-12T09:44:35.654047+0000","last_unstale":"2023-12-12T09:44:38.630748+0000","last_undegraded":"2023-12-12T09:44:38.630748+0000","last_fullsized":"2023-12-12T09:44:38.630748+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:34.598834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:34.598834+0000","last_clean_scrub_stamp":"2023-12-12T09:44:34.598834+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T13:05:15.160206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-12T09:44:39.348133+0000","last_change":"2023-12-12T09:44:36.677469+0000","last_active":"2023-12-12T09:44:39.348133+0000","last_peered":"2023-12-12T09:44:39.348133+0000","last_clean":"2023-12-12T09:44:39.348133+0000","last_became_active":"2023-12-12T09:44:36.677176+0000","last_became_peered":"2023-12-12T09:44:36.677176+0000","last_unstale":"2023-12-12T09:44:39.348133+0000","last_undegraded":"2023-12-12T09:44:39.348133+0000","last_fullsized":"2023-12-12T09:44:39.348133+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:35.613810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:35.613810+0000","last_clean_scrub_stamp":"2023-12-12T09:44:35.613810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T16:51:47.973201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.13","version":"33'2","reported_seq":18,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-12-12T09:44:36.660717+0000","last_change":"2023-12-12T09:44:20.516223+0000","last_active":"2023-12-12T09:44:36.660717+0000","last_peered":"2023-12-12T09:44:36.660717+0000","last_clean":"2023-12-12T09:44:36.660717+0000","last_became_active":"2023-12-12T09:44:20.515976+0000","last_became_peered":"2023-12-12T09:44:20.515976+0000","last_unstale":"2023-12-12T09:44:36.660717+0000","last_undegraded":"2023-12-12T09:44:36.660717+0000","last_fullsized":"2023-12-12T09:44:36.660717+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:19.449520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:19.449520+0000","last_clean_scrub_stamp":"2023-12-12T09:44:19.449520+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T16:04:09.402682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-12-12T09:44:35.639973+0000","last_change":"2023-12-12T09:44:21.522639+0000","last_active":"2023-12-12T09:44:35.639973+0000","last_peered":"2023-12-12T09:44:35.639973+0000","last_clean":"2023-12-12T09:44:35.639973+0000","last_became_active":"2023-12-12T09:44:21.522313+0000","last_became_peered":"2023-12-12T09:44:21.522313+0000","last_unstale":"2023-12-12T09:44:35.639973+0000","last_undegraded":"2023-12-12T09:44:35.639973+0000","last_fullsized":"2023-12-12T09:44:35.639973+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_clean_scrub_stamp":"2023-12-12T09:44:20.465592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T12:38:15.250056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-12T09:44:39.348404+0000","last_change":"2023-12-12T09:44:35.651405+0000","last_active":"2023-12-12T09:44:39.348404+0000","last_peered":"2023-12-12T09:44:39.348404+0000","last_clean":"2023-12-12T09:44:39.348404+0000","last_became_active":"2023-12-12T09:44:35.651099+0000","last_became_peered":"2023-12-12T09:44:35.651099+0000","last_unstale":"2023-12-12T09:44:39.348404+0000","last_undegraded":"2023-12-12T09:44:39.348404+0000","last_fullsized":"2023-12-12T09:44:39.348404+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:34.598834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:34.598834+0000","last_clean_scrub_stamp":"2023-12-12T09:44:34.598834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T12:57:08.973746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-12T09:44:39.115769+0000","last_change":"2023-12-12T09:44:36.674281+0000","last_active":"2023-12-12T09:44:39.115769+0000","last_peered":"2023-12-12T09:44:39.115769+0000","last_clean":"2023-12-12T09:44:39.115769+0000","last_became_active":"2023-12-12T09:44:36.673999+0000","last_became_peered":"2023-12-12T09:44:36.673999+0000","last_unstale":"2023-12-12T09:44:39.115769+0000","last_undegraded":"2023-12-12T09:44:39.115769+0000","last_fullsized":"2023-12-12T09:44:39.115769+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:35.613810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:35.613810+0000","last_clean_scrub_stamp":"2023-12-12T09:44:35.613810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T16:30:13.047997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"34'8","reported_seq":24,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-12-12T09:44:36.668533+0000","last_change":"2023-12-12T09:44:20.509723+0000","last_active":"2023-12-12T09:44:36.668533+0000","last_peered":"2023-12-12T09:44:36.668533+0000","last_clean":"2023-12-12T09:44:36.668533+0000","last_became_active":"2023-12-12T09:44:20.509311+0000","last_became_peered":"2023-12-12T09:44:20.509311+0000","last_unstale":"2023-12-12T09:44:36.668533+0000","last_undegraded":"2023-12-12T09:44:36.668533+0000","last_fullsized":"2023-12-12T09:44:36.668533+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:19.449520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:19.449520+0000","last_clean_scrub_stamp":"2023-12-12T09:44:19.449520+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T20:58:53.818296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3107,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":15,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-12-12T09:44:36.657964+0000","last_change":"2023-12-12T09:44:21.514238+0000","last_active":"2023-12-12T09:44:36.657964+0000","last_peered":"2023-12-12T09:44:36.657964+0000","last_clean":"2023-12-12T09:44:36.657964+0000","last_became_active":"2023-12-12T09:44:21.513900+0000","last_became_peered":"2023-12-12T09:44:21.513900+0000","last_unstale":"2023-12-12T09:44:36.657964+0000","last_undegraded":"2023-12-12T09:44:36.657964+0000","last_fullsized":"2023-12-12T09:44:36.657964+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_clean_scrub_stamp":"2023-12-12T09:44:20.465592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T12:23:17.141227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-12T09:44:38.631291+0000","last_change":"2023-12-12T09:44:35.663238+0000","last_active":"2023-12-12T09:44:38.631291+0000","last_peered":"2023-12-12T09:44:38.631291+0000","last_clean":"2023-12-12T09:44:38.631291+0000","last_became_active":"2023-12-12T09:44:35.662964+0000","last_became_peered":"2023-12-12T09:44:35.662964+0000","last_unstale":"2023-12-12T09:44:38.631291+0000","last_undegraded":"2023-12-12T09:44:38.631291+0000","last_fullsized":"2023-12-12T09:44:38.631291+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:34.598834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:34.598834+0000","last_clean_scrub_stamp":"2023-12-12T09:44:34.598834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T12:33:13.442183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-12T09:44:38.658071+0000","last_change":"2023-12-12T09:44:36.695661+0000","last_active":"2023-12-12T09:44:38.658071+0000","last_peered":"2023-12-12T09:44:38.658071+0000","last_clean":"2023-12-12T09:44:38.658071+0000","last_became_active":"2023-12-12T09:44:36.695388+0000","last_became_peered":"2023-12-12T09:44:36.695388+0000","last_unstale":"2023-12-12T09:44:38.658071+0000","last_undegraded":"2023-12-12T09:44:38.658071+0000","last_fullsized":"2023-12-12T09:44:38.658071+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:35.613810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:35.613810+0000","last_clean_scrub_stamp":"2023-12-12T09:44:35.613810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T16:53:45.536132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.15","version":"33'3","reported_seq":19,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-12-12T09:44:36.658463+0000","last_change":"2023-12-12T09:44:20.516043+0000","last_active":"2023-12-12T09:44:36.658463+0000","last_peered":"2023-12-12T09:44:36.658463+0000","last_clean":"2023-12-12T09:44:36.658463+0000","last_became_active":"2023-12-12T09:44:20.515717+0000","last_became_peered":"2023-12-12T09:44:20.515717+0000","last_unstale":"2023-12-12T09:44:36.658463+0000","last_undegraded":"2023-12-12T09:44:36.658463+0000","last_fullsized":"2023-12-12T09:44:36.658463+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:19.449520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:19.449520+0000","last_clean_scrub_stamp":"2023-12-12T09:44:19.449520+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T12:38:14.233984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":15,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-12-12T09:44:36.668456+0000","last_change":"2023-12-12T09:44:21.515459+0000","last_active":"2023-12-12T09:44:36.668456+0000","last_peered":"2023-12-12T09:44:36.668456+0000","last_clean":"2023-12-12T09:44:36.668456+0000","last_became_active":"2023-12-12T09:44:21.515182+0000","last_became_peered":"2023-12-12T09:44:21.515182+0000","last_unstale":"2023-12-12T09:44:36.668456+0000","last_undegraded":"2023-12-12T09:44:36.668456+0000","last_fullsized":"2023-12-12T09:44:36.668456+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_clean_scrub_stamp":"2023-12-12T09:44:20.465592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T20:53:13.479872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-12T09:44:38.658173+0000","last_change":"2023-12-12T09:44:35.658566+0000","last_active":"2023-12-12T09:44:38.658173+0000","last_peered":"2023-12-12T09:44:38.658173+0000","last_clean":"2023-12-12T09:44:38.658173+0000","last_became_active":"2023-12-12T09:44:35.658297+0000","last_became_peered":"2023-12-12T09:44:35.658297+0000","last_unstale":"2023-12-12T09:44:38.658173+0000","last_undegraded":"2023-12-12T09:44:38.658173+0000","last_fullsized":"2023-12-12T09:44:38.658173+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:34.598834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:34.598834+0000","last_clean_scrub_stamp":"2023-12-12T09:44:34.598834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T12:33:13.442183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-12T09:44:39.114558+0000","last_change":"2023-12-12T09:44:36.685779+0000","last_active":"2023-12-12T09:44:39.114558+0000","last_peered":"2023-12-12T09:44:39.114558+0000","last_clean":"2023-12-12T09:44:39.114558+0000","last_became_active":"2023-12-12T09:44:36.685391+0000","last_became_peered":"2023-12-12T09:44:36.685391+0000","last_unstale":"2023-12-12T09:44:39.114558+0000","last_undegraded":"2023-12-12T09:44:39.114558+0000","last_fullsized":"2023-12-12T09:44:39.114558+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:35.613810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:35.613810+0000","last_clean_scrub_stamp":"2023-12-12T09:44:35.613810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T12:06:03.002982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":16,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-12-12T09:44:36.675519+0000","last_change":"2023-12-12T09:44:20.505493+0000","last_active":"2023-12-12T09:44:36.675519+0000","last_peered":"2023-12-12T09:44:36.675519+0000","last_clean":"2023-12-12T09:44:36.675519+0000","last_became_active":"2023-12-12T09:44:20.503452+0000","last_became_peered":"2023-12-12T09:44:20.503452+0000","last_unstale":"2023-12-12T09:44:36.675519+0000","last_undegraded":"2023-12-12T09:44:36.675519+0000","last_fullsized":"2023-12-12T09:44:36.675519+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:19.449520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:19.449520+0000","last_clean_scrub_stamp":"2023-12-12T09:44:19.449520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T19:38:07.725951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":15,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-12-12T09:44:36.670889+0000","last_change":"2023-12-12T09:44:21.528120+0000","last_active":"2023-12-12T09:44:36.670889+0000","last_peered":"2023-12-12T09:44:36.670889+0000","last_clean":"2023-12-12T09:44:36.670889+0000","last_became_active":"2023-12-12T09:44:21.527860+0000","last_became_peered":"2023-12-12T09:44:21.527860+0000","last_unstale":"2023-12-12T09:44:36.670889+0000","last_undegraded":"2023-12-12T09:44:36.670889+0000","last_fullsized":"2023-12-12T09:44:36.670889+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_clean_scrub_stamp":"2023-12-12T09:44:20.465592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T21:03:17.881060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"37'6","reported_seq":18,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-12T09:44:37.666957+0000","last_change":"2023-12-12T09:44:35.657826+0000","last_active":"2023-12-12T09:44:37.666957+0000","last_peered":"2023-12-12T09:44:37.666957+0000","last_clean":"2023-12-12T09:44:37.666957+0000","last_became_active":"2023-12-12T09:44:35.657572+0000","last_became_peered":"2023-12-12T09:44:35.657572+0000","last_unstale":"2023-12-12T09:44:37.666957+0000","last_undegraded":"2023-12-12T09:44:37.666957+0000","last_fullsized":"2023-12-12T09:44:37.666957+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:34.598834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:34.598834+0000","last_clean_scrub_stamp":"2023-12-12T09:44:34.598834+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T12:38:29.383298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-12T09:44:39.349598+0000","last_change":"2023-12-12T09:44:36.691592+0000","last_active":"2023-12-12T09:44:39.349598+0000","last_peered":"2023-12-12T09:44:39.349598+0000","last_clean":"2023-12-12T09:44:39.349598+0000","last_became_active":"2023-12-12T09:44:36.691309+0000","last_became_peered":"2023-12-12T09:44:36.691309+0000","last_unstale":"2023-12-12T09:44:39.349598+0000","last_undegraded":"2023-12-12T09:44:39.349598+0000","last_fullsized":"2023-12-12T09:44:39.349598+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:35.613810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:35.613810+0000","last_clean_scrub_stamp":"2023-12-12T09:44:35.613810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T15:07:00.239933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":16,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-12-12T09:44:36.670990+0000","last_change":"2023-12-12T09:44:20.515405+0000","last_active":"2023-12-12T09:44:36.670990+0000","last_peered":"2023-12-12T09:44:36.670990+0000","last_clean":"2023-12-12T09:44:36.670990+0000","last_became_active":"2023-12-12T09:44:20.515184+0000","last_became_peered":"2023-12-12T09:44:20.515184+0000","last_unstale":"2023-12-12T09:44:36.670990+0000","last_undegraded":"2023-12-12T09:44:36.670990+0000","last_fullsized":"2023-12-12T09:44:36.670990+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:19.449520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:19.449520+0000","last_clean_scrub_stamp":"2023-12-12T09:44:19.449520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T11:40:19.759789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":15,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-12-12T09:44:36.658260+0000","last_change":"2023-12-12T09:44:21.516583+0000","last_active":"2023-12-12T09:44:36.658260+0000","last_peered":"2023-12-12T09:44:36.658260+0000","last_clean":"2023-12-12T09:44:36.658260+0000","last_became_active":"2023-12-12T09:44:21.515986+0000","last_became_peered":"2023-12-12T09:44:21.515986+0000","last_unstale":"2023-12-12T09:44:36.658260+0000","last_undegraded":"2023-12-12T09:44:36.658260+0000","last_fullsized":"2023-12-12T09:44:36.658260+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_clean_scrub_stamp":"2023-12-12T09:44:20.465592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T14:08:30.510607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"37'3","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-12T09:44:39.115138+0000","last_change":"2023-12-12T09:44:35.662319+0000","last_active":"2023-12-12T09:44:39.115138+0000","last_peered":"2023-12-12T09:44:39.115138+0000","last_clean":"2023-12-12T09:44:39.115138+0000","last_became_active":"2023-12-12T09:44:35.662060+0000","last_became_peered":"2023-12-12T09:44:35.662060+0000","last_unstale":"2023-12-12T09:44:39.115138+0000","last_undegraded":"2023-12-12T09:44:39.115138+0000","last_fullsized":"2023-12-12T09:44:39.115138+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:34.598834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:34.598834+0000","last_clean_scrub_stamp":"2023-12-12T09:44:34.598834+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T16:53:44.521157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-12T09:44:38.631631+0000","last_change":"2023-12-12T09:44:36.686185+0000","last_active":"2023-12-12T09:44:38.631631+0000","last_peered":"2023-12-12T09:44:38.631631+0000","last_clean":"2023-12-12T09:44:38.631631+0000","last_became_active":"2023-12-12T09:44:36.682839+0000","last_became_peered":"2023-12-12T09:44:36.682839+0000","last_unstale":"2023-12-12T09:44:38.631631+0000","last_undegraded":"2023-12-12T09:44:38.631631+0000","last_fullsized":"2023-12-12T09:44:38.631631+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:35.613810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:35.613810+0000","last_clean_scrub_stamp":"2023-12-12T09:44:35.613810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T19:31:02.367047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":16,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-12-12T09:44:36.659803+0000","last_change":"2023-12-12T09:44:20.516411+0000","last_active":"2023-12-12T09:44:36.659803+0000","last_peered":"2023-12-12T09:44:36.659803+0000","last_clean":"2023-12-12T09:44:36.659803+0000","last_became_active":"2023-12-12T09:44:20.516143+0000","last_became_peered":"2023-12-12T09:44:20.516143+0000","last_unstale":"2023-12-12T09:44:36.659803+0000","last_undegraded":"2023-12-12T09:44:36.659803+0000","last_fullsized":"2023-12-12T09:44:36.659803+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:19.449520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:19.449520+0000","last_clean_scrub_stamp":"2023-12-12T09:44:19.449520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T20:16:12.578797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-12-12T09:44:35.639359+0000","last_change":"2023-12-12T09:44:21.520960+0000","last_active":"2023-12-12T09:44:35.639359+0000","last_peered":"2023-12-12T09:44:35.639359+0000","last_clean":"2023-12-12T09:44:35.639359+0000","last_became_active":"2023-12-12T09:44:21.520630+0000","last_became_peered":"2023-12-12T09:44:21.520630+0000","last_unstale":"2023-12-12T09:44:35.639359+0000","last_undegraded":"2023-12-12T09:44:35.639359+0000","last_fullsized":"2023-12-12T09:44:35.639359+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_clean_scrub_stamp":"2023-12-12T09:44:20.465592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T18:54:29.796762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"37'1","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-12T09:44:38.657115+0000","last_change":"2023-12-12T09:44:35.660186+0000","last_active":"2023-12-12T09:44:38.657115+0000","last_peered":"2023-12-12T09:44:38.657115+0000","last_clean":"2023-12-12T09:44:38.657115+0000","last_became_active":"2023-12-12T09:44:35.657299+0000","last_became_peered":"2023-12-12T09:44:35.657299+0000","last_unstale":"2023-12-12T09:44:38.657115+0000","last_undegraded":"2023-12-12T09:44:38.657115+0000","last_fullsized":"2023-12-12T09:44:38.657115+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:34.598834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:34.598834+0000","last_clean_scrub_stamp":"2023-12-12T09:44:34.598834+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T15:35:24.142667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-12T09:44:38.656821+0000","last_change":"2023-12-12T09:44:36.682397+0000","last_active":"2023-12-12T09:44:38.656821+0000","last_peered":"2023-12-12T09:44:38.656821+0000","last_clean":"2023-12-12T09:44:38.656821+0000","last_became_active":"2023-12-12T09:44:36.682096+0000","last_became_peered":"2023-12-12T09:44:36.682096+0000","last_unstale":"2023-12-12T09:44:38.656821+0000","last_undegraded":"2023-12-12T09:44:38.656821+0000","last_fullsized":"2023-12-12T09:44:38.656821+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:35.613810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:35.613810+0000","last_clean_scrub_stamp":"2023-12-12T09:44:35.613810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T20:42:38.295226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":16,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-12-12T09:44:36.668599+0000","last_change":"2023-12-12T09:44:20.510572+0000","last_active":"2023-12-12T09:44:36.668599+0000","last_peered":"2023-12-12T09:44:36.668599+0000","last_clean":"2023-12-12T09:44:36.668599+0000","last_became_active":"2023-12-12T09:44:20.510324+0000","last_became_peered":"2023-12-12T09:44:20.510324+0000","last_unstale":"2023-12-12T09:44:36.668599+0000","last_undegraded":"2023-12-12T09:44:36.668599+0000","last_fullsized":"2023-12-12T09:44:36.668599+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:19.449520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:19.449520+0000","last_clean_scrub_stamp":"2023-12-12T09:44:19.449520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T12:38:14.233984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":15,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-12-12T09:44:36.659393+0000","last_change":"2023-12-12T09:44:21.528208+0000","last_active":"2023-12-12T09:44:36.659393+0000","last_peered":"2023-12-12T09:44:36.659393+0000","last_clean":"2023-12-12T09:44:36.659393+0000","last_became_active":"2023-12-12T09:44:21.524386+0000","last_became_peered":"2023-12-12T09:44:21.524386+0000","last_unstale":"2023-12-12T09:44:36.659393+0000","last_undegraded":"2023-12-12T09:44:36.659393+0000","last_fullsized":"2023-12-12T09:44:36.659393+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_clean_scrub_stamp":"2023-12-12T09:44:20.465592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T10:43:48.035299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"37'1","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-12T09:44:39.348836+0000","last_change":"2023-12-12T09:44:35.658718+0000","last_active":"2023-12-12T09:44:39.348836+0000","last_peered":"2023-12-12T09:44:39.348836+0000","last_clean":"2023-12-12T09:44:39.348836+0000","last_became_active":"2023-12-12T09:44:35.658446+0000","last_became_peered":"2023-12-12T09:44:35.658446+0000","last_unstale":"2023-12-12T09:44:39.348836+0000","last_undegraded":"2023-12-12T09:44:39.348836+0000","last_fullsized":"2023-12-12T09:44:39.348836+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:34.598834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:34.598834+0000","last_clean_scrub_stamp":"2023-12-12T09:44:34.598834+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T12:06:01.988006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-12T09:44:37.669307+0000","last_change":"2023-12-12T09:44:36.681302+0000","last_active":"2023-12-12T09:44:37.669307+0000","last_peered":"2023-12-12T09:44:37.669307+0000","last_clean":"2023-12-12T09:44:37.669307+0000","last_became_active":"2023-12-12T09:44:36.680796+0000","last_became_peered":"2023-12-12T09:44:36.680796+0000","last_unstale":"2023-12-12T09:44:37.669307+0000","last_undegraded":"2023-12-12T09:44:37.669307+0000","last_fullsized":"2023-12-12T09:44:37.669307+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:35.613810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:35.613810+0000","last_clean_scrub_stamp":"2023-12-12T09:44:35.613810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T14:08:45.658825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1a","version":"33'1","reported_seq":17,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-12-12T09:44:36.662274+0000","last_change":"2023-12-12T09:44:20.507138+0000","last_active":"2023-12-12T09:44:36.662274+0000","last_peered":"2023-12-12T09:44:36.662274+0000","last_clean":"2023-12-12T09:44:36.662274+0000","last_became_active":"2023-12-12T09:44:20.506706+0000","last_became_peered":"2023-12-12T09:44:20.506706+0000","last_unstale":"2023-12-12T09:44:36.662274+0000","last_undegraded":"2023-12-12T09:44:36.662274+0000","last_fullsized":"2023-12-12T09:44:36.662274+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:19.449520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:19.449520+0000","last_clean_scrub_stamp":"2023-12-12T09:44:19.449520+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T14:59:36.480275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":15,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-12-12T09:44:36.658004+0000","last_change":"2023-12-12T09:44:21.510952+0000","last_active":"2023-12-12T09:44:36.658004+0000","last_peered":"2023-12-12T09:44:36.658004+0000","last_clean":"2023-12-12T09:44:36.658004+0000","last_became_active":"2023-12-12T09:44:21.510672+0000","last_became_peered":"2023-12-12T09:44:21.510672+0000","last_unstale":"2023-12-12T09:44:36.658004+0000","last_undegraded":"2023-12-12T09:44:36.658004+0000","last_fullsized":"2023-12-12T09:44:36.658004+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_clean_scrub_stamp":"2023-12-12T09:44:20.465592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T12:21:37.296506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-12T09:44:38.630497+0000","last_change":"2023-12-12T09:44:35.647186+0000","last_active":"2023-12-12T09:44:38.630497+0000","last_peered":"2023-12-12T09:44:38.630497+0000","last_clean":"2023-12-12T09:44:38.630497+0000","last_became_active":"2023-12-12T09:44:35.646908+0000","last_became_peered":"2023-12-12T09:44:35.646908+0000","last_unstale":"2023-12-12T09:44:38.630497+0000","last_undegraded":"2023-12-12T09:44:38.630497+0000","last_fullsized":"2023-12-12T09:44:38.630497+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:34.598834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:34.598834+0000","last_clean_scrub_stamp":"2023-12-12T09:44:34.598834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T11:43:10.325017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-12T09:44:38.630549+0000","last_change":"2023-12-12T09:44:36.679907+0000","last_active":"2023-12-12T09:44:38.630549+0000","last_peered":"2023-12-12T09:44:38.630549+0000","last_clean":"2023-12-12T09:44:38.630549+0000","last_became_active":"2023-12-12T09:44:36.679619+0000","last_became_peered":"2023-12-12T09:44:36.679619+0000","last_unstale":"2023-12-12T09:44:38.630549+0000","last_undegraded":"2023-12-12T09:44:38.630549+0000","last_fullsized":"2023-12-12T09:44:38.630549+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:35.613810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:35.613810+0000","last_clean_scrub_stamp":"2023-12-12T09:44:35.613810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T11:47:30.113343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"33'1","reported_seq":17,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-12-12T09:44:36.660469+0000","last_change":"2023-12-12T09:44:20.506547+0000","last_active":"2023-12-12T09:44:36.660469+0000","last_peered":"2023-12-12T09:44:36.660469+0000","last_clean":"2023-12-12T09:44:36.660469+0000","last_became_active":"2023-12-12T09:44:20.506207+0000","last_became_peered":"2023-12-12T09:44:20.506207+0000","last_unstale":"2023-12-12T09:44:36.660469+0000","last_undegraded":"2023-12-12T09:44:36.660469+0000","last_fullsized":"2023-12-12T09:44:36.660469+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:19.449520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:19.449520+0000","last_clean_scrub_stamp":"2023-12-12T09:44:19.449520+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T21:18:35.916411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":15,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-12-12T09:44:36.664759+0000","last_change":"2023-12-12T09:44:21.532639+0000","last_active":"2023-12-12T09:44:36.664759+0000","last_peered":"2023-12-12T09:44:36.664759+0000","last_clean":"2023-12-12T09:44:36.664759+0000","last_became_active":"2023-12-12T09:44:21.532369+0000","last_became_peered":"2023-12-12T09:44:21.532369+0000","last_unstale":"2023-12-12T09:44:36.664759+0000","last_undegraded":"2023-12-12T09:44:36.664759+0000","last_fullsized":"2023-12-12T09:44:36.664759+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_clean_scrub_stamp":"2023-12-12T09:44:20.465592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T14:08:30.510607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-12T09:44:37.671260+0000","last_change":"2023-12-12T09:44:35.646516+0000","last_active":"2023-12-12T09:44:37.671260+0000","last_peered":"2023-12-12T09:44:37.671260+0000","last_clean":"2023-12-12T09:44:37.671260+0000","last_became_active":"2023-12-12T09:44:35.646167+0000","last_became_peered":"2023-12-12T09:44:35.646167+0000","last_unstale":"2023-12-12T09:44:37.671260+0000","last_undegraded":"2023-12-12T09:44:37.671260+0000","last_fullsized":"2023-12-12T09:44:37.671260+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:34.598834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:34.598834+0000","last_clean_scrub_stamp":"2023-12-12T09:44:34.598834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T17:28:17.203377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-12T09:44:37.670196+0000","last_change":"2023-12-12T09:44:36.680875+0000","last_active":"2023-12-12T09:44:37.670196+0000","last_peered":"2023-12-12T09:44:37.670196+0000","last_clean":"2023-12-12T09:44:37.670196+0000","last_became_active":"2023-12-12T09:44:36.680536+0000","last_became_peered":"2023-12-12T09:44:36.680536+0000","last_unstale":"2023-12-12T09:44:37.670196+0000","last_undegraded":"2023-12-12T09:44:37.670196+0000","last_fullsized":"2023-12-12T09:44:37.670196+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:35.613810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:35.613810+0000","last_clean_scrub_stamp":"2023-12-12T09:44:35.613810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T11:43:11.339993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"37'1","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-12T09:44:38.658250+0000","last_change":"2023-12-12T09:44:35.656759+0000","last_active":"2023-12-12T09:44:38.658250+0000","last_peered":"2023-12-12T09:44:38.658250+0000","last_clean":"2023-12-12T09:44:38.658250+0000","last_became_active":"2023-12-12T09:44:35.656477+0000","last_became_peered":"2023-12-12T09:44:35.656477+0000","last_unstale":"2023-12-12T09:44:38.658250+0000","last_undegraded":"2023-12-12T09:44:38.658250+0000","last_fullsized":"2023-12-12T09:44:38.658250+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:34.598834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:34.598834+0000","last_clean_scrub_stamp":"2023-12-12T09:44:34.598834+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T11:13:35.308291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"33'2","reported_seq":18,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-12-12T09:44:36.650370+0000","last_change":"2023-12-12T09:44:20.509167+0000","last_active":"2023-12-12T09:44:36.650370+0000","last_peered":"2023-12-12T09:44:36.650370+0000","last_clean":"2023-12-12T09:44:36.650370+0000","last_became_active":"2023-12-12T09:44:20.508808+0000","last_became_peered":"2023-12-12T09:44:20.508808+0000","last_unstale":"2023-12-12T09:44:36.650370+0000","last_undegraded":"2023-12-12T09:44:36.650370+0000","last_fullsized":"2023-12-12T09:44:36.650370+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:19.449520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:19.449520+0000","last_clean_scrub_stamp":"2023-12-12T09:44:19.449520+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T18:14:15.788144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-12-12T09:44:35.641806+0000","last_change":"2023-12-12T09:44:21.531916+0000","last_active":"2023-12-12T09:44:35.641806+0000","last_peered":"2023-12-12T09:44:35.641806+0000","last_clean":"2023-12-12T09:44:35.641806+0000","last_became_active":"2023-12-12T09:44:21.531595+0000","last_became_peered":"2023-12-12T09:44:21.531595+0000","last_unstale":"2023-12-12T09:44:35.641806+0000","last_undegraded":"2023-12-12T09:44:35.641806+0000","last_fullsized":"2023-12-12T09:44:35.641806+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_clean_scrub_stamp":"2023-12-12T09:44:20.465592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T12:23:17.141227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-12-12T09:44:36.690884+0000","last_change":"2023-12-12T09:44:36.685786+0000","last_active":"2023-12-12T09:44:36.690884+0000","last_peered":"2023-12-12T09:44:36.690884+0000","last_clean":"2023-12-12T09:44:36.690884+0000","last_became_active":"2023-12-12T09:44:36.685520+0000","last_became_peered":"2023-12-12T09:44:36.685520+0000","last_unstale":"2023-12-12T09:44:36.690884+0000","last_undegraded":"2023-12-12T09:44:36.690884+0000","last_fullsized":"2023-12-12T09:44:36.690884+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:35.613810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:35.613810+0000","last_clean_scrub_stamp":"2023-12-12T09:44:35.613810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T15:35:25.157642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"37'4","reported_seq":16,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-12T09:44:39.350149+0000","last_change":"2023-12-12T09:44:35.654435+0000","last_active":"2023-12-12T09:44:39.350149+0000","last_peered":"2023-12-12T09:44:39.350149+0000","last_clean":"2023-12-12T09:44:39.350149+0000","last_became_active":"2023-12-12T09:44:35.654147+0000","last_became_peered":"2023-12-12T09:44:35.654147+0000","last_unstale":"2023-12-12T09:44:39.350149+0000","last_undegraded":"2023-12-12T09:44:39.350149+0000","last_fullsized":"2023-12-12T09:44:39.350149+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:34.598834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:34.598834+0000","last_clean_scrub_stamp":"2023-12-12T09:44:34.598834+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T20:37:13.041575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"33'2","reported_seq":18,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-12-12T09:44:36.668987+0000","last_change":"2023-12-12T09:44:20.505973+0000","last_active":"2023-12-12T09:44:36.668987+0000","last_peered":"2023-12-12T09:44:36.668987+0000","last_clean":"2023-12-12T09:44:36.668987+0000","last_became_active":"2023-12-12T09:44:20.505716+0000","last_became_peered":"2023-12-12T09:44:20.505716+0000","last_unstale":"2023-12-12T09:44:36.668987+0000","last_undegraded":"2023-12-12T09:44:36.668987+0000","last_fullsized":"2023-12-12T09:44:36.668987+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:19.449520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:19.449520+0000","last_clean_scrub_stamp":"2023-12-12T09:44:19.449520+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T14:50:34.872309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":15,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-12-12T09:44:36.661204+0000","last_change":"2023-12-12T09:44:21.531214+0000","last_active":"2023-12-12T09:44:36.661204+0000","last_peered":"2023-12-12T09:44:36.661204+0000","last_clean":"2023-12-12T09:44:36.661204+0000","last_became_active":"2023-12-12T09:44:21.530559+0000","last_became_peered":"2023-12-12T09:44:21.530559+0000","last_unstale":"2023-12-12T09:44:36.661204+0000","last_undegraded":"2023-12-12T09:44:36.661204+0000","last_fullsized":"2023-12-12T09:44:36.661204+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_clean_scrub_stamp":"2023-12-12T09:44:20.465592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T12:07:42.924447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-12-12T09:44:36.690786+0000","last_change":"2023-12-12T09:44:36.685530+0000","last_active":"2023-12-12T09:44:36.690786+0000","last_peered":"2023-12-12T09:44:36.690786+0000","last_clean":"2023-12-12T09:44:36.690786+0000","last_became_active":"2023-12-12T09:44:36.685221+0000","last_became_peered":"2023-12-12T09:44:36.685221+0000","last_unstale":"2023-12-12T09:44:36.690786+0000","last_undegraded":"2023-12-12T09:44:36.690786+0000","last_fullsized":"2023-12-12T09:44:36.690786+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:35.613810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:35.613810+0000","last_clean_scrub_stamp":"2023-12-12T09:44:35.613810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T14:12:37.698625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"33'1","reported_seq":17,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-12-12T09:44:36.675436+0000","last_change":"2023-12-12T09:44:20.512943+0000","last_active":"2023-12-12T09:44:36.675436+0000","last_peered":"2023-12-12T09:44:36.675436+0000","last_clean":"2023-12-12T09:44:36.675436+0000","last_became_active":"2023-12-12T09:44:20.512655+0000","last_became_peered":"2023-12-12T09:44:20.512655+0000","last_unstale":"2023-12-12T09:44:36.675436+0000","last_undegraded":"2023-12-12T09:44:36.675436+0000","last_fullsized":"2023-12-12T09:44:36.675436+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:19.449520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:19.449520+0000","last_clean_scrub_stamp":"2023-12-12T09:44:19.449520+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T20:21:31.990503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":15,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-12-12T09:44:36.676477+0000","last_change":"2023-12-12T09:44:21.535215+0000","last_active":"2023-12-12T09:44:36.676477+0000","last_peered":"2023-12-12T09:44:36.676477+0000","last_clean":"2023-12-12T09:44:36.676477+0000","last_became_active":"2023-12-12T09:44:21.534935+0000","last_became_peered":"2023-12-12T09:44:21.534935+0000","last_unstale":"2023-12-12T09:44:36.676477+0000","last_undegraded":"2023-12-12T09:44:36.676477+0000","last_fullsized":"2023-12-12T09:44:36.676477+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_clean_scrub_stamp":"2023-12-12T09:44:20.465592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T21:19:34.161140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"37'2","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-12T09:44:39.114454+0000","last_change":"2023-12-12T09:44:35.664778+0000","last_active":"2023-12-12T09:44:39.114454+0000","last_peered":"2023-12-12T09:44:39.114454+0000","last_clean":"2023-12-12T09:44:39.114454+0000","last_became_active":"2023-12-12T09:44:35.664366+0000","last_became_peered":"2023-12-12T09:44:35.664366+0000","last_unstale":"2023-12-12T09:44:39.114454+0000","last_undegraded":"2023-12-12T09:44:39.114454+0000","last_fullsized":"2023-12-12T09:44:39.114454+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:34.598834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:34.598834+0000","last_clean_scrub_stamp":"2023-12-12T09:44:34.598834+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T16:28:49.633670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-12T09:44:37.672236+0000","last_change":"2023-12-12T09:44:36.679037+0000","last_active":"2023-12-12T09:44:37.672236+0000","last_peered":"2023-12-12T09:44:37.672236+0000","last_clean":"2023-12-12T09:44:37.672236+0000","last_became_active":"2023-12-12T09:44:36.678689+0000","last_became_peered":"2023-12-12T09:44:36.678689+0000","last_unstale":"2023-12-12T09:44:37.672236+0000","last_undegraded":"2023-12-12T09:44:37.672236+0000","last_fullsized":"2023-12-12T09:44:37.672236+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:35.613810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:35.613810+0000","last_clean_scrub_stamp":"2023-12-12T09:44:35.613810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T12:57:09.988722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"33'4","reported_seq":20,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-12-12T09:44:36.676586+0000","last_change":"2023-12-12T09:44:20.514272+0000","last_active":"2023-12-12T09:44:36.676586+0000","last_peered":"2023-12-12T09:44:36.676586+0000","last_clean":"2023-12-12T09:44:36.676586+0000","last_became_active":"2023-12-12T09:44:20.513997+0000","last_became_peered":"2023-12-12T09:44:20.513997+0000","last_unstale":"2023-12-12T09:44:36.676586+0000","last_undegraded":"2023-12-12T09:44:36.676586+0000","last_fullsized":"2023-12-12T09:44:36.676586+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:19.449520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:19.449520+0000","last_clean_scrub_stamp":"2023-12-12T09:44:19.449520+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T16:36:32.055010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":15,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-12-12T09:44:36.675345+0000","last_change":"2023-12-12T09:44:21.520102+0000","last_active":"2023-12-12T09:44:36.675345+0000","last_peered":"2023-12-12T09:44:36.675345+0000","last_clean":"2023-12-12T09:44:36.675345+0000","last_became_active":"2023-12-12T09:44:21.517595+0000","last_became_peered":"2023-12-12T09:44:21.517595+0000","last_unstale":"2023-12-12T09:44:36.675345+0000","last_undegraded":"2023-12-12T09:44:36.675345+0000","last_fullsized":"2023-12-12T09:44:36.675345+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_clean_scrub_stamp":"2023-12-12T09:44:20.465592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T12:07:42.924447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"37'2","reported_seq":13,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-12-12T09:44:36.709354+0000","last_change":"2023-12-12T09:44:35.652971+0000","last_active":"2023-12-12T09:44:36.709354+0000","last_peered":"2023-12-12T09:44:36.709354+0000","last_clean":"2023-12-12T09:44:36.709354+0000","last_became_active":"2023-12-12T09:44:35.652677+0000","last_became_peered":"2023-12-12T09:44:35.652677+0000","last_unstale":"2023-12-12T09:44:36.709354+0000","last_undegraded":"2023-12-12T09:44:36.709354+0000","last_fullsized":"2023-12-12T09:44:36.709354+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:34.598834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:34.598834+0000","last_clean_scrub_stamp":"2023-12-12T09:44:34.598834+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T12:33:13.442183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-12T09:44:38.656775+0000","last_change":"2023-12-12T09:44:36.674256+0000","last_active":"2023-12-12T09:44:38.656775+0000","last_peered":"2023-12-12T09:44:38.656775+0000","last_clean":"2023-12-12T09:44:38.656775+0000","last_became_active":"2023-12-12T09:44:36.673696+0000","last_became_peered":"2023-12-12T09:44:36.673696+0000","last_unstale":"2023-12-12T09:44:38.656775+0000","last_undegraded":"2023-12-12T09:44:38.656775+0000","last_fullsized":"2023-12-12T09:44:38.656775+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:35.613810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:35.613810+0000","last_clean_scrub_stamp":"2023-12-12T09:44:35.613810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T17:28:18.218353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":15,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-12-12T09:44:36.664864+0000","last_change":"2023-12-12T09:44:21.533072+0000","last_active":"2023-12-12T09:44:36.664864+0000","last_peered":"2023-12-12T09:44:36.664864+0000","last_clean":"2023-12-12T09:44:36.664864+0000","last_became_active":"2023-12-12T09:44:21.532524+0000","last_became_peered":"2023-12-12T09:44:21.532524+0000","last_unstale":"2023-12-12T09:44:36.664864+0000","last_undegraded":"2023-12-12T09:44:36.664864+0000","last_fullsized":"2023-12-12T09:44:36.664864+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_clean_scrub_stamp":"2023-12-12T09:44:20.465592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T12:21:37.296506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-12T09:44:37.672671+0000","last_change":"2023-12-12T09:44:36.685916+0000","last_active":"2023-12-12T09:44:37.672671+0000","last_peered":"2023-12-12T09:44:37.672671+0000","last_clean":"2023-12-12T09:44:37.672671+0000","last_became_active":"2023-12-12T09:44:36.685212+0000","last_became_peered":"2023-12-12T09:44:36.685212+0000","last_unstale":"2023-12-12T09:44:37.672671+0000","last_undegraded":"2023-12-12T09:44:37.672671+0000","last_fullsized":"2023-12-12T09:44:37.672671+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:35.613810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:35.613810+0000","last_clean_scrub_stamp":"2023-12-12T09:44:35.613810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T12:33:14.457159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":15,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-12-12T09:44:36.669213+0000","last_change":"2023-12-12T09:44:21.511525+0000","last_active":"2023-12-12T09:44:36.669213+0000","last_peered":"2023-12-12T09:44:36.669213+0000","last_clean":"2023-12-12T09:44:36.669213+0000","last_became_active":"2023-12-12T09:44:21.511270+0000","last_became_peered":"2023-12-12T09:44:21.511270+0000","last_unstale":"2023-12-12T09:44:36.669213+0000","last_undegraded":"2023-12-12T09:44:36.669213+0000","last_fullsized":"2023-12-12T09:44:36.669213+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_clean_scrub_stamp":"2023-12-12T09:44:20.465592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T12:00:33.415612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-12T09:44:37.666213+0000","last_change":"2023-12-12T09:44:36.679138+0000","last_active":"2023-12-12T09:44:37.666213+0000","last_peered":"2023-12-12T09:44:37.666213+0000","last_clean":"2023-12-12T09:44:37.666213+0000","last_became_active":"2023-12-12T09:44:36.678828+0000","last_became_peered":"2023-12-12T09:44:36.678828+0000","last_unstale":"2023-12-12T09:44:37.666213+0000","last_undegraded":"2023-12-12T09:44:37.666213+0000","last_fullsized":"2023-12-12T09:44:37.666213+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:35.613810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:35.613810+0000","last_clean_scrub_stamp":"2023-12-12T09:44:35.613810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T12:21:52.444724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":15,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-12-12T09:44:36.664653+0000","last_change":"2023-12-12T09:44:21.525189+0000","last_active":"2023-12-12T09:44:36.664653+0000","last_peered":"2023-12-12T09:44:36.664653+0000","last_clean":"2023-12-12T09:44:36.664653+0000","last_became_active":"2023-12-12T09:44:21.524872+0000","last_became_peered":"2023-12-12T09:44:21.524872+0000","last_unstale":"2023-12-12T09:44:36.664653+0000","last_undegraded":"2023-12-12T09:44:36.664653+0000","last_fullsized":"2023-12-12T09:44:36.664653+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_clean_scrub_stamp":"2023-12-12T09:44:20.465592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T10:03:17.158642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-12T09:44:39.348403+0000","last_change":"2023-12-12T09:44:36.678113+0000","last_active":"2023-12-12T09:44:39.348403+0000","last_peered":"2023-12-12T09:44:39.348403+0000","last_clean":"2023-12-12T09:44:39.348403+0000","last_became_active":"2023-12-12T09:44:36.677530+0000","last_became_peered":"2023-12-12T09:44:36.677530+0000","last_unstale":"2023-12-12T09:44:39.348403+0000","last_undegraded":"2023-12-12T09:44:39.348403+0000","last_fullsized":"2023-12-12T09:44:39.348403+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:35.613810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:35.613810+0000","last_clean_scrub_stamp":"2023-12-12T09:44:35.613810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T18:28:48.774180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":15,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-12-12T09:44:36.660219+0000","last_change":"2023-12-12T09:44:21.529115+0000","last_active":"2023-12-12T09:44:36.660219+0000","last_peered":"2023-12-12T09:44:36.660219+0000","last_clean":"2023-12-12T09:44:36.660219+0000","last_became_active":"2023-12-12T09:44:21.528843+0000","last_became_peered":"2023-12-12T09:44:21.528843+0000","last_unstale":"2023-12-12T09:44:36.660219+0000","last_undegraded":"2023-12-12T09:44:36.660219+0000","last_fullsized":"2023-12-12T09:44:36.660219+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_clean_scrub_stamp":"2023-12-12T09:44:20.465592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T12:38:15.250056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-12T09:44:37.666977+0000","last_change":"2023-12-12T09:44:36.682948+0000","last_active":"2023-12-12T09:44:37.666977+0000","last_peered":"2023-12-12T09:44:37.666977+0000","last_clean":"2023-12-12T09:44:37.666977+0000","last_became_active":"2023-12-12T09:44:36.682181+0000","last_became_peered":"2023-12-12T09:44:36.682181+0000","last_unstale":"2023-12-12T09:44:37.666977+0000","last_undegraded":"2023-12-12T09:44:37.666977+0000","last_fullsized":"2023-12-12T09:44:37.666977+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:35.613810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:35.613810+0000","last_clean_scrub_stamp":"2023-12-12T09:44:35.613810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T10:50:47.303313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":15,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-12-12T09:44:36.659244+0000","last_change":"2023-12-12T09:44:21.517720+0000","last_active":"2023-12-12T09:44:36.659244+0000","last_peered":"2023-12-12T09:44:36.659244+0000","last_clean":"2023-12-12T09:44:36.659244+0000","last_became_active":"2023-12-12T09:44:21.517332+0000","last_became_peered":"2023-12-12T09:44:21.517332+0000","last_unstale":"2023-12-12T09:44:36.659244+0000","last_undegraded":"2023-12-12T09:44:36.659244+0000","last_fullsized":"2023-12-12T09:44:36.659244+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_clean_scrub_stamp":"2023-12-12T09:44:20.465592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T13:05:01.026963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-12T09:44:37.672191+0000","last_change":"2023-12-12T09:44:36.686233+0000","last_active":"2023-12-12T09:44:37.672191+0000","last_peered":"2023-12-12T09:44:37.672191+0000","last_clean":"2023-12-12T09:44:37.672191+0000","last_became_active":"2023-12-12T09:44:36.684811+0000","last_became_peered":"2023-12-12T09:44:36.684811+0000","last_unstale":"2023-12-12T09:44:37.672191+0000","last_undegraded":"2023-12-12T09:44:37.672191+0000","last_fullsized":"2023-12-12T09:44:37.672191+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:35.613810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:35.613810+0000","last_clean_scrub_stamp":"2023-12-12T09:44:35.613810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T14:12:37.698625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-12-12T09:44:35.641744+0000","last_change":"2023-12-12T09:44:21.532041+0000","last_active":"2023-12-12T09:44:35.641744+0000","last_peered":"2023-12-12T09:44:35.641744+0000","last_clean":"2023-12-12T09:44:35.641744+0000","last_became_active":"2023-12-12T09:44:21.531731+0000","last_became_peered":"2023-12-12T09:44:21.531731+0000","last_unstale":"2023-12-12T09:44:35.641744+0000","last_undegraded":"2023-12-12T09:44:35.641744+0000","last_fullsized":"2023-12-12T09:44:35.641744+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_clean_scrub_stamp":"2023-12-12T09:44:20.465592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T12:21:37.296506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-12T09:44:37.671993+0000","last_change":"2023-12-12T09:44:36.665881+0000","last_active":"2023-12-12T09:44:37.671993+0000","last_peered":"2023-12-12T09:44:37.671993+0000","last_clean":"2023-12-12T09:44:37.671993+0000","last_became_active":"2023-12-12T09:44:36.659566+0000","last_became_peered":"2023-12-12T09:44:36.659566+0000","last_unstale":"2023-12-12T09:44:37.671993+0000","last_undegraded":"2023-12-12T09:44:37.671993+0000","last_fullsized":"2023-12-12T09:44:37.671993+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:35.613810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:35.613810+0000","last_clean_scrub_stamp":"2023-12-12T09:44:35.613810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T19:31:02.367047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":15,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-12-12T09:44:36.676376+0000","last_change":"2023-12-12T09:44:21.522457+0000","last_active":"2023-12-12T09:44:36.676376+0000","last_peered":"2023-12-12T09:44:36.676376+0000","last_clean":"2023-12-12T09:44:36.676376+0000","last_became_active":"2023-12-12T09:44:21.522168+0000","last_became_peered":"2023-12-12T09:44:21.522168+0000","last_unstale":"2023-12-12T09:44:36.676376+0000","last_undegraded":"2023-12-12T09:44:36.676376+0000","last_fullsized":"2023-12-12T09:44:36.676376+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_clean_scrub_stamp":"2023-12-12T09:44:20.465592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T11:42:56.191775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-12T09:44:38.657404+0000","last_change":"2023-12-12T09:44:36.673564+0000","last_active":"2023-12-12T09:44:38.657404+0000","last_peered":"2023-12-12T09:44:38.657404+0000","last_clean":"2023-12-12T09:44:38.657404+0000","last_became_active":"2023-12-12T09:44:36.673264+0000","last_became_peered":"2023-12-12T09:44:36.673264+0000","last_unstale":"2023-12-12T09:44:38.657404+0000","last_undegraded":"2023-12-12T09:44:38.657404+0000","last_fullsized":"2023-12-12T09:44:38.657404+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:35.613810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:35.613810+0000","last_clean_scrub_stamp":"2023-12-12T09:44:35.613810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T14:54:53.328204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-12-12T09:44:35.642352+0000","last_change":"2023-12-12T09:44:21.526204+0000","last_active":"2023-12-12T09:44:35.642352+0000","last_peered":"2023-12-12T09:44:35.642352+0000","last_clean":"2023-12-12T09:44:35.642352+0000","last_became_active":"2023-12-12T09:44:21.525855+0000","last_became_peered":"2023-12-12T09:44:21.525855+0000","last_unstale":"2023-12-12T09:44:35.642352+0000","last_undegraded":"2023-12-12T09:44:35.642352+0000","last_fullsized":"2023-12-12T09:44:35.642352+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_clean_scrub_stamp":"2023-12-12T09:44:20.465592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T10:03:17.158642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-12T09:44:38.630765+0000","last_change":"2023-12-12T09:44:36.696358+0000","last_active":"2023-12-12T09:44:38.630765+0000","last_peered":"2023-12-12T09:44:38.630765+0000","last_clean":"2023-12-12T09:44:38.630765+0000","last_became_active":"2023-12-12T09:44:36.692638+0000","last_became_peered":"2023-12-12T09:44:36.692638+0000","last_unstale":"2023-12-12T09:44:38.630765+0000","last_undegraded":"2023-12-12T09:44:38.630765+0000","last_fullsized":"2023-12-12T09:44:38.630765+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:35.613810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:35.613810+0000","last_clean_scrub_stamp":"2023-12-12T09:44:35.613810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T20:22:13.002817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":15,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-12-12T09:44:36.655814+0000","last_change":"2023-12-12T09:44:21.519677+0000","last_active":"2023-12-12T09:44:36.655814+0000","last_peered":"2023-12-12T09:44:36.655814+0000","last_clean":"2023-12-12T09:44:36.655814+0000","last_became_active":"2023-12-12T09:44:21.519364+0000","last_became_peered":"2023-12-12T09:44:21.519364+0000","last_unstale":"2023-12-12T09:44:36.655814+0000","last_undegraded":"2023-12-12T09:44:36.655814+0000","last_fullsized":"2023-12-12T09:44:36.655814+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_clean_scrub_stamp":"2023-12-12T09:44:20.465592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T11:40:20.775860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-12T09:44:39.349539+0000","last_change":"2023-12-12T09:44:36.686677+0000","last_active":"2023-12-12T09:44:39.349539+0000","last_peered":"2023-12-12T09:44:39.349539+0000","last_clean":"2023-12-12T09:44:39.349539+0000","last_became_active":"2023-12-12T09:44:36.686408+0000","last_became_peered":"2023-12-12T09:44:36.686408+0000","last_unstale":"2023-12-12T09:44:39.349539+0000","last_undegraded":"2023-12-12T09:44:39.349539+0000","last_fullsized":"2023-12-12T09:44:39.349539+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:35.613810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:35.613810+0000","last_clean_scrub_stamp":"2023-12-12T09:44:35.613810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T15:16:24.365761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":15,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-12-12T09:44:36.671456+0000","last_change":"2023-12-12T09:44:21.522714+0000","last_active":"2023-12-12T09:44:36.671456+0000","last_peered":"2023-12-12T09:44:36.671456+0000","last_clean":"2023-12-12T09:44:36.671456+0000","last_became_active":"2023-12-12T09:44:21.519272+0000","last_became_peered":"2023-12-12T09:44:21.519272+0000","last_unstale":"2023-12-12T09:44:36.671456+0000","last_undegraded":"2023-12-12T09:44:36.671456+0000","last_fullsized":"2023-12-12T09:44:36.671456+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_clean_scrub_stamp":"2023-12-12T09:44:20.465592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T21:42:36.877781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-12T09:44:37.670296+0000","last_change":"2023-12-12T09:44:36.679594+0000","last_active":"2023-12-12T09:44:37.670296+0000","last_peered":"2023-12-12T09:44:37.670296+0000","last_clean":"2023-12-12T09:44:37.670296+0000","last_became_active":"2023-12-12T09:44:36.679301+0000","last_became_peered":"2023-12-12T09:44:36.679301+0000","last_unstale":"2023-12-12T09:44:37.670296+0000","last_undegraded":"2023-12-12T09:44:37.670296+0000","last_fullsized":"2023-12-12T09:44:37.670296+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:35.613810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:35.613810+0000","last_clean_scrub_stamp":"2023-12-12T09:44:35.613810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T20:43:12.552172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":15,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-12-12T09:44:36.662427+0000","last_change":"2023-12-12T09:44:21.507419+0000","last_active":"2023-12-12T09:44:36.662427+0000","last_peered":"2023-12-12T09:44:36.662427+0000","last_clean":"2023-12-12T09:44:36.662427+0000","last_became_active":"2023-12-12T09:44:21.507005+0000","last_became_peered":"2023-12-12T09:44:21.507005+0000","last_unstale":"2023-12-12T09:44:36.662427+0000","last_undegraded":"2023-12-12T09:44:36.662427+0000","last_fullsized":"2023-12-12T09:44:36.662427+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_clean_scrub_stamp":"2023-12-12T09:44:20.465592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T14:50:35.888381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-12T09:44:37.670410+0000","last_change":"2023-12-12T09:44:36.682700+0000","last_active":"2023-12-12T09:44:37.670410+0000","last_peered":"2023-12-12T09:44:37.670410+0000","last_clean":"2023-12-12T09:44:37.670410+0000","last_became_active":"2023-12-12T09:44:36.679684+0000","last_became_peered":"2023-12-12T09:44:36.679684+0000","last_unstale":"2023-12-12T09:44:37.670410+0000","last_undegraded":"2023-12-12T09:44:37.670410+0000","last_fullsized":"2023-12-12T09:44:37.670410+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:35.613810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:35.613810+0000","last_clean_scrub_stamp":"2023-12-12T09:44:35.613810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T15:26:52.627089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":15,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-12-12T09:44:36.660125+0000","last_change":"2023-12-12T09:44:21.524113+0000","last_active":"2023-12-12T09:44:36.660125+0000","last_peered":"2023-12-12T09:44:36.660125+0000","last_clean":"2023-12-12T09:44:36.660125+0000","last_became_active":"2023-12-12T09:44:21.523749+0000","last_became_peered":"2023-12-12T09:44:21.523749+0000","last_unstale":"2023-12-12T09:44:36.660125+0000","last_undegraded":"2023-12-12T09:44:36.660125+0000","last_fullsized":"2023-12-12T09:44:36.660125+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_clean_scrub_stamp":"2023-12-12T09:44:20.465592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T21:19:34.161140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-12T09:44:38.657688+0000","last_change":"2023-12-12T09:44:36.694835+0000","last_active":"2023-12-12T09:44:38.657688+0000","last_peered":"2023-12-12T09:44:38.657688+0000","last_clean":"2023-12-12T09:44:38.657688+0000","last_became_active":"2023-12-12T09:44:36.694521+0000","last_became_peered":"2023-12-12T09:44:36.694521+0000","last_unstale":"2023-12-12T09:44:38.657688+0000","last_undegraded":"2023-12-12T09:44:38.657688+0000","last_fullsized":"2023-12-12T09:44:38.657688+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:35.613810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:35.613810+0000","last_clean_scrub_stamp":"2023-12-12T09:44:35.613810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T11:47:30.113343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":15,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-12-12T09:44:36.650039+0000","last_change":"2023-12-12T09:44:21.521072+0000","last_active":"2023-12-12T09:44:36.650039+0000","last_peered":"2023-12-12T09:44:36.650039+0000","last_clean":"2023-12-12T09:44:36.650039+0000","last_became_active":"2023-12-12T09:44:21.520779+0000","last_became_peered":"2023-12-12T09:44:21.520779+0000","last_unstale":"2023-12-12T09:44:36.650039+0000","last_undegraded":"2023-12-12T09:44:36.650039+0000","last_fullsized":"2023-12-12T09:44:36.650039+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_clean_scrub_stamp":"2023-12-12T09:44:20.465592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T18:50:23.713305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-12T09:44:38.657945+0000","last_change":"2023-12-12T09:44:36.673355+0000","last_active":"2023-12-12T09:44:38.657945+0000","last_peered":"2023-12-12T09:44:38.657945+0000","last_clean":"2023-12-12T09:44:38.657945+0000","last_became_active":"2023-12-12T09:44:36.671651+0000","last_became_peered":"2023-12-12T09:44:36.671651+0000","last_unstale":"2023-12-12T09:44:38.657945+0000","last_undegraded":"2023-12-12T09:44:38.657945+0000","last_fullsized":"2023-12-12T09:44:38.657945+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:35.613810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:35.613810+0000","last_clean_scrub_stamp":"2023-12-12T09:44:35.613810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T12:05:02.659374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":15,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-12-12T09:44:36.668896+0000","last_change":"2023-12-12T09:44:21.515576+0000","last_active":"2023-12-12T09:44:36.668896+0000","last_peered":"2023-12-12T09:44:36.668896+0000","last_clean":"2023-12-12T09:44:36.668896+0000","last_became_active":"2023-12-12T09:44:21.515246+0000","last_became_peered":"2023-12-12T09:44:21.515246+0000","last_unstale":"2023-12-12T09:44:36.668896+0000","last_undegraded":"2023-12-12T09:44:36.668896+0000","last_fullsized":"2023-12-12T09:44:36.668896+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_clean_scrub_stamp":"2023-12-12T09:44:20.465592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T13:05:01.026963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-12T09:44:37.666886+0000","last_change":"2023-12-12T09:44:36.696397+0000","last_active":"2023-12-12T09:44:37.666886+0000","last_peered":"2023-12-12T09:44:37.666886+0000","last_clean":"2023-12-12T09:44:37.666886+0000","last_became_active":"2023-12-12T09:44:36.696011+0000","last_became_peered":"2023-12-12T09:44:36.696011+0000","last_unstale":"2023-12-12T09:44:37.666886+0000","last_undegraded":"2023-12-12T09:44:37.666886+0000","last_fullsized":"2023-12-12T09:44:37.666886+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:35.613810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:35.613810+0000","last_clean_scrub_stamp":"2023-12-12T09:44:35.613810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T10:03:32.306860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":15,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-12-12T09:44:36.671328+0000","last_change":"2023-12-12T09:44:21.510970+0000","last_active":"2023-12-12T09:44:36.671328+0000","last_peered":"2023-12-12T09:44:36.671328+0000","last_clean":"2023-12-12T09:44:36.671328+0000","last_became_active":"2023-12-12T09:44:21.508875+0000","last_became_peered":"2023-12-12T09:44:21.508875+0000","last_unstale":"2023-12-12T09:44:36.671328+0000","last_undegraded":"2023-12-12T09:44:36.671328+0000","last_fullsized":"2023-12-12T09:44:36.671328+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_clean_scrub_stamp":"2023-12-12T09:44:20.465592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T11:36:54.156220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-12T09:44:37.671213+0000","last_change":"2023-12-12T09:44:36.695545+0000","last_active":"2023-12-12T09:44:37.671213+0000","last_peered":"2023-12-12T09:44:37.671213+0000","last_clean":"2023-12-12T09:44:37.671213+0000","last_became_active":"2023-12-12T09:44:36.695256+0000","last_became_peered":"2023-12-12T09:44:36.695256+0000","last_unstale":"2023-12-12T09:44:37.671213+0000","last_undegraded":"2023-12-12T09:44:37.671213+0000","last_fullsized":"2023-12-12T09:44:37.671213+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:35.613810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:35.613810+0000","last_clean_scrub_stamp":"2023-12-12T09:44:35.613810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T16:53:46.370125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":15,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-12-12T09:44:36.667068+0000","last_change":"2023-12-12T09:44:21.524561+0000","last_active":"2023-12-12T09:44:36.667068+0000","last_peered":"2023-12-12T09:44:36.667068+0000","last_clean":"2023-12-12T09:44:36.667068+0000","last_became_active":"2023-12-12T09:44:21.524316+0000","last_became_peered":"2023-12-12T09:44:21.524316+0000","last_unstale":"2023-12-12T09:44:36.667068+0000","last_undegraded":"2023-12-12T09:44:36.667068+0000","last_fullsized":"2023-12-12T09:44:36.667068+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_clean_scrub_stamp":"2023-12-12T09:44:20.465592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T18:05:42.865925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-12T09:44:38.630489+0000","last_change":"2023-12-12T09:44:36.695946+0000","last_active":"2023-12-12T09:44:38.630489+0000","last_peered":"2023-12-12T09:44:38.630489+0000","last_clean":"2023-12-12T09:44:38.630489+0000","last_became_active":"2023-12-12T09:44:36.694143+0000","last_became_peered":"2023-12-12T09:44:36.694143+0000","last_unstale":"2023-12-12T09:44:38.630489+0000","last_undegraded":"2023-12-12T09:44:38.630489+0000","last_fullsized":"2023-12-12T09:44:38.630489+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:35.613810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:35.613810+0000","last_clean_scrub_stamp":"2023-12-12T09:44:35.613810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T14:54:53.328204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":15,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-12-12T09:44:36.665601+0000","last_change":"2023-12-12T09:44:21.526715+0000","last_active":"2023-12-12T09:44:36.665601+0000","last_peered":"2023-12-12T09:44:36.665601+0000","last_clean":"2023-12-12T09:44:36.665601+0000","last_became_active":"2023-12-12T09:44:21.526475+0000","last_became_peered":"2023-12-12T09:44:21.526475+0000","last_unstale":"2023-12-12T09:44:36.665601+0000","last_undegraded":"2023-12-12T09:44:36.665601+0000","last_fullsized":"2023-12-12T09:44:36.665601+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_clean_scrub_stamp":"2023-12-12T09:44:20.465592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T20:53:13.479872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-12T09:44:37.666082+0000","last_change":"2023-12-12T09:44:36.677675+0000","last_active":"2023-12-12T09:44:37.666082+0000","last_peered":"2023-12-12T09:44:37.666082+0000","last_clean":"2023-12-12T09:44:37.666082+0000","last_became_active":"2023-12-12T09:44:36.677415+0000","last_became_peered":"2023-12-12T09:44:36.677415+0000","last_unstale":"2023-12-12T09:44:37.666082+0000","last_undegraded":"2023-12-12T09:44:37.666082+0000","last_fullsized":"2023-12-12T09:44:37.666082+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:35.613810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:35.613810+0000","last_clean_scrub_stamp":"2023-12-12T09:44:35.613810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T20:59:09.982586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":15,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-12-12T09:44:36.656514+0000","last_change":"2023-12-12T09:44:21.517469+0000","last_active":"2023-12-12T09:44:36.656514+0000","last_peered":"2023-12-12T09:44:36.656514+0000","last_clean":"2023-12-12T09:44:36.656514+0000","last_became_active":"2023-12-12T09:44:21.517156+0000","last_became_peered":"2023-12-12T09:44:21.517156+0000","last_unstale":"2023-12-12T09:44:36.656514+0000","last_undegraded":"2023-12-12T09:44:36.656514+0000","last_fullsized":"2023-12-12T09:44:36.656514+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_clean_scrub_stamp":"2023-12-12T09:44:20.465592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T20:58:54.834367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-12T09:44:37.669563+0000","last_change":"2023-12-12T09:44:36.686273+0000","last_active":"2023-12-12T09:44:37.669563+0000","last_peered":"2023-12-12T09:44:37.669563+0000","last_clean":"2023-12-12T09:44:37.669563+0000","last_became_active":"2023-12-12T09:44:36.685859+0000","last_became_peered":"2023-12-12T09:44:36.685859+0000","last_unstale":"2023-12-12T09:44:37.669563+0000","last_undegraded":"2023-12-12T09:44:37.669563+0000","last_fullsized":"2023-12-12T09:44:37.669563+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:35.613810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:35.613810+0000","last_clean_scrub_stamp":"2023-12-12T09:44:35.613810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T11:37:09.304439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":15,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-12-12T09:44:36.670068+0000","last_change":"2023-12-12T09:44:21.515103+0000","last_active":"2023-12-12T09:44:36.670068+0000","last_peered":"2023-12-12T09:44:36.670068+0000","last_clean":"2023-12-12T09:44:36.670068+0000","last_became_active":"2023-12-12T09:44:21.514438+0000","last_became_peered":"2023-12-12T09:44:21.514438+0000","last_unstale":"2023-12-12T09:44:36.670068+0000","last_undegraded":"2023-12-12T09:44:36.670068+0000","last_fullsized":"2023-12-12T09:44:36.670068+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_clean_scrub_stamp":"2023-12-12T09:44:20.465592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T18:05:42.865925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-12T09:44:39.348238+0000","last_change":"2023-12-12T09:44:36.678285+0000","last_active":"2023-12-12T09:44:39.348238+0000","last_peered":"2023-12-12T09:44:39.348238+0000","last_clean":"2023-12-12T09:44:39.348238+0000","last_became_active":"2023-12-12T09:44:36.677868+0000","last_became_peered":"2023-12-12T09:44:36.677868+0000","last_unstale":"2023-12-12T09:44:39.348238+0000","last_undegraded":"2023-12-12T09:44:39.348238+0000","last_fullsized":"2023-12-12T09:44:39.348238+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:35.613810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:35.613810+0000","last_clean_scrub_stamp":"2023-12-12T09:44:35.613810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T16:17:33.872332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":15,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-12-12T09:44:36.648912+0000","last_change":"2023-12-12T09:44:21.510175+0000","last_active":"2023-12-12T09:44:36.648912+0000","last_peered":"2023-12-12T09:44:36.648912+0000","last_clean":"2023-12-12T09:44:36.648912+0000","last_became_active":"2023-12-12T09:44:21.509923+0000","last_became_peered":"2023-12-12T09:44:21.509923+0000","last_unstale":"2023-12-12T09:44:36.648912+0000","last_undegraded":"2023-12-12T09:44:36.648912+0000","last_fullsized":"2023-12-12T09:44:36.648912+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_clean_scrub_stamp":"2023-12-12T09:44:20.465592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T18:46:45.450477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-12T09:44:38.631307+0000","last_change":"2023-12-12T09:44:36.693782+0000","last_active":"2023-12-12T09:44:38.631307+0000","last_peered":"2023-12-12T09:44:38.631307+0000","last_clean":"2023-12-12T09:44:38.631307+0000","last_became_active":"2023-12-12T09:44:36.693468+0000","last_became_peered":"2023-12-12T09:44:36.693468+0000","last_unstale":"2023-12-12T09:44:38.631307+0000","last_undegraded":"2023-12-12T09:44:38.631307+0000","last_fullsized":"2023-12-12T09:44:38.631307+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:35.613810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:35.613810+0000","last_clean_scrub_stamp":"2023-12-12T09:44:35.613810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T16:53:45.536132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":15,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-12-12T09:44:36.659027+0000","last_change":"2023-12-12T09:44:21.517566+0000","last_active":"2023-12-12T09:44:36.659027+0000","last_peered":"2023-12-12T09:44:36.659027+0000","last_clean":"2023-12-12T09:44:36.659027+0000","last_became_active":"2023-12-12T09:44:21.517004+0000","last_became_peered":"2023-12-12T09:44:21.517004+0000","last_unstale":"2023-12-12T09:44:36.659027+0000","last_undegraded":"2023-12-12T09:44:36.659027+0000","last_fullsized":"2023-12-12T09:44:36.659027+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_clean_scrub_stamp":"2023-12-12T09:44:20.465592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T10:50:32.155095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-12T09:44:38.631381+0000","last_change":"2023-12-12T09:44:36.698240+0000","last_active":"2023-12-12T09:44:38.631381+0000","last_peered":"2023-12-12T09:44:38.631381+0000","last_clean":"2023-12-12T09:44:38.631381+0000","last_became_active":"2023-12-12T09:44:36.697679+0000","last_became_peered":"2023-12-12T09:44:36.697679+0000","last_unstale":"2023-12-12T09:44:38.631381+0000","last_undegraded":"2023-12-12T09:44:38.631381+0000","last_fullsized":"2023-12-12T09:44:38.631381+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:35.613810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:35.613810+0000","last_clean_scrub_stamp":"2023-12-12T09:44:35.613810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T10:18:13.313066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":15,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-12-12T09:44:36.665870+0000","last_change":"2023-12-12T09:44:21.536596+0000","last_active":"2023-12-12T09:44:36.665870+0000","last_peered":"2023-12-12T09:44:36.665870+0000","last_clean":"2023-12-12T09:44:36.665870+0000","last_became_active":"2023-12-12T09:44:21.536304+0000","last_became_peered":"2023-12-12T09:44:21.536304+0000","last_unstale":"2023-12-12T09:44:36.665870+0000","last_undegraded":"2023-12-12T09:44:36.665870+0000","last_fullsized":"2023-12-12T09:44:36.665870+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_clean_scrub_stamp":"2023-12-12T09:44:20.465592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T11:36:54.156220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-12T09:44:37.671631+0000","last_change":"2023-12-12T09:44:36.663863+0000","last_active":"2023-12-12T09:44:37.671631+0000","last_peered":"2023-12-12T09:44:37.671631+0000","last_clean":"2023-12-12T09:44:37.671631+0000","last_became_active":"2023-12-12T09:44:36.663355+0000","last_became_peered":"2023-12-12T09:44:36.663355+0000","last_unstale":"2023-12-12T09:44:37.671631+0000","last_undegraded":"2023-12-12T09:44:37.671631+0000","last_fullsized":"2023-12-12T09:44:37.671631+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:35.613810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:35.613810+0000","last_clean_scrub_stamp":"2023-12-12T09:44:35.613810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T11:19:37.028130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-12-12T09:44:35.641944+0000","last_change":"2023-12-12T09:44:21.515196+0000","last_active":"2023-12-12T09:44:35.641944+0000","last_peered":"2023-12-12T09:44:35.641944+0000","last_clean":"2023-12-12T09:44:35.641944+0000","last_became_active":"2023-12-12T09:44:21.514944+0000","last_became_peered":"2023-12-12T09:44:21.514944+0000","last_unstale":"2023-12-12T09:44:35.641944+0000","last_undegraded":"2023-12-12T09:44:35.641944+0000","last_fullsized":"2023-12-12T09:44:35.641944+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_clean_scrub_stamp":"2023-12-12T09:44:20.465592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T14:50:35.888381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-12T09:44:38.632026+0000","last_change":"2023-12-12T09:44:36.685603+0000","last_active":"2023-12-12T09:44:38.632026+0000","last_peered":"2023-12-12T09:44:38.632026+0000","last_clean":"2023-12-12T09:44:38.632026+0000","last_became_active":"2023-12-12T09:44:36.685357+0000","last_became_peered":"2023-12-12T09:44:36.685357+0000","last_unstale":"2023-12-12T09:44:38.632026+0000","last_undegraded":"2023-12-12T09:44:38.632026+0000","last_fullsized":"2023-12-12T09:44:38.632026+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:35.613810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:35.613810+0000","last_clean_scrub_stamp":"2023-12-12T09:44:35.613810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T12:06:03.002982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":15,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-12-12T09:44:36.663069+0000","last_change":"2023-12-12T09:44:21.531885+0000","last_active":"2023-12-12T09:44:36.663069+0000","last_peered":"2023-12-12T09:44:36.663069+0000","last_clean":"2023-12-12T09:44:36.663069+0000","last_became_active":"2023-12-12T09:44:21.531436+0000","last_became_peered":"2023-12-12T09:44:21.531436+0000","last_unstale":"2023-12-12T09:44:36.663069+0000","last_undegraded":"2023-12-12T09:44:36.663069+0000","last_fullsized":"2023-12-12T09:44:36.663069+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_clean_scrub_stamp":"2023-12-12T09:44:20.465592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T18:54:29.796762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-12T09:44:39.348457+0000","last_change":"2023-12-12T09:44:36.684897+0000","last_active":"2023-12-12T09:44:39.348457+0000","last_peered":"2023-12-12T09:44:39.348457+0000","last_clean":"2023-12-12T09:44:39.348457+0000","last_became_active":"2023-12-12T09:44:36.683835+0000","last_became_peered":"2023-12-12T09:44:36.683835+0000","last_unstale":"2023-12-12T09:44:39.348457+0000","last_undegraded":"2023-12-12T09:44:39.348457+0000","last_fullsized":"2023-12-12T09:44:39.348457+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:35.613810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:35.613810+0000","last_clean_scrub_stamp":"2023-12-12T09:44:35.613810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T09:59:50.885591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":15,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-12-12T09:44:36.664625+0000","last_change":"2023-12-12T09:44:21.526128+0000","last_active":"2023-12-12T09:44:36.664625+0000","last_peered":"2023-12-12T09:44:36.664625+0000","last_clean":"2023-12-12T09:44:36.664625+0000","last_became_active":"2023-12-12T09:44:21.521368+0000","last_became_peered":"2023-12-12T09:44:21.521368+0000","last_unstale":"2023-12-12T09:44:36.664625+0000","last_undegraded":"2023-12-12T09:44:36.664625+0000","last_fullsized":"2023-12-12T09:44:36.664625+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_clean_scrub_stamp":"2023-12-12T09:44:20.465592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T20:58:54.834367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-12T09:44:37.671522+0000","last_change":"2023-12-12T09:44:36.687536+0000","last_active":"2023-12-12T09:44:37.671522+0000","last_peered":"2023-12-12T09:44:37.671522+0000","last_clean":"2023-12-12T09:44:37.671522+0000","last_became_active":"2023-12-12T09:44:36.687112+0000","last_became_peered":"2023-12-12T09:44:36.687112+0000","last_unstale":"2023-12-12T09:44:37.671522+0000","last_undegraded":"2023-12-12T09:44:37.671522+0000","last_fullsized":"2023-12-12T09:44:37.671522+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:35.613810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:35.613810+0000","last_clean_scrub_stamp":"2023-12-12T09:44:35.613810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T10:18:13.313066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":15,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-12-12T09:44:36.664708+0000","last_change":"2023-12-12T09:44:21.526135+0000","last_active":"2023-12-12T09:44:36.664708+0000","last_peered":"2023-12-12T09:44:36.664708+0000","last_clean":"2023-12-12T09:44:36.664708+0000","last_became_active":"2023-12-12T09:44:21.525852+0000","last_became_peered":"2023-12-12T09:44:21.525852+0000","last_unstale":"2023-12-12T09:44:36.664708+0000","last_undegraded":"2023-12-12T09:44:36.664708+0000","last_fullsized":"2023-12-12T09:44:36.664708+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_clean_scrub_stamp":"2023-12-12T09:44:20.465592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T21:03:17.881060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-12T09:44:38.630158+0000","last_change":"2023-12-12T09:44:36.683138+0000","last_active":"2023-12-12T09:44:38.630158+0000","last_peered":"2023-12-12T09:44:38.630158+0000","last_clean":"2023-12-12T09:44:38.630158+0000","last_became_active":"2023-12-12T09:44:36.682749+0000","last_became_peered":"2023-12-12T09:44:36.682749+0000","last_unstale":"2023-12-12T09:44:38.630158+0000","last_undegraded":"2023-12-12T09:44:38.630158+0000","last_fullsized":"2023-12-12T09:44:38.630158+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:35.613810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:35.613810+0000","last_clean_scrub_stamp":"2023-12-12T09:44:35.613810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T20:42:38.295226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":15,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-12-12T09:44:36.669981+0000","last_change":"2023-12-12T09:44:21.520418+0000","last_active":"2023-12-12T09:44:36.669981+0000","last_peered":"2023-12-12T09:44:36.669981+0000","last_clean":"2023-12-12T09:44:36.669981+0000","last_became_active":"2023-12-12T09:44:21.520070+0000","last_became_peered":"2023-12-12T09:44:21.520070+0000","last_unstale":"2023-12-12T09:44:36.669981+0000","last_undegraded":"2023-12-12T09:44:36.669981+0000","last_fullsized":"2023-12-12T09:44:36.669981+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_clean_scrub_stamp":"2023-12-12T09:44:20.465592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T20:42:57.403954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-12T09:44:39.114490+0000","last_change":"2023-12-12T09:44:36.683647+0000","last_active":"2023-12-12T09:44:39.114490+0000","last_peered":"2023-12-12T09:44:39.114490+0000","last_clean":"2023-12-12T09:44:39.114490+0000","last_became_active":"2023-12-12T09:44:36.683048+0000","last_became_peered":"2023-12-12T09:44:36.683048+0000","last_unstale":"2023-12-12T09:44:39.114490+0000","last_undegraded":"2023-12-12T09:44:39.114490+0000","last_fullsized":"2023-12-12T09:44:39.114490+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:35.613810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:35.613810+0000","last_clean_scrub_stamp":"2023-12-12T09:44:35.613810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T20:37:14.056550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":15,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-12-12T09:44:36.648690+0000","last_change":"2023-12-12T09:44:21.517132+0000","last_active":"2023-12-12T09:44:36.648690+0000","last_peered":"2023-12-12T09:44:36.648690+0000","last_clean":"2023-12-12T09:44:36.648690+0000","last_became_active":"2023-12-12T09:44:21.516794+0000","last_became_peered":"2023-12-12T09:44:21.516794+0000","last_unstale":"2023-12-12T09:44:36.648690+0000","last_undegraded":"2023-12-12T09:44:36.648690+0000","last_fullsized":"2023-12-12T09:44:36.648690+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_clean_scrub_stamp":"2023-12-12T09:44:20.465592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T14:59:37.496347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-12T09:44:37.673227+0000","last_change":"2023-12-12T09:44:36.695303+0000","last_active":"2023-12-12T09:44:37.673227+0000","last_peered":"2023-12-12T09:44:37.673227+0000","last_clean":"2023-12-12T09:44:37.673227+0000","last_became_active":"2023-12-12T09:44:36.694106+0000","last_became_peered":"2023-12-12T09:44:36.694106+0000","last_unstale":"2023-12-12T09:44:37.673227+0000","last_undegraded":"2023-12-12T09:44:37.673227+0000","last_fullsized":"2023-12-12T09:44:37.673227+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:35.613810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:35.613810+0000","last_clean_scrub_stamp":"2023-12-12T09:44:35.613810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T11:38:33.721181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-12-12T09:44:35.640997+0000","last_change":"2023-12-12T09:44:21.536425+0000","last_active":"2023-12-12T09:44:35.640997+0000","last_peered":"2023-12-12T09:44:35.640997+0000","last_clean":"2023-12-12T09:44:35.640997+0000","last_became_active":"2023-12-12T09:44:21.534962+0000","last_became_peered":"2023-12-12T09:44:21.534962+0000","last_unstale":"2023-12-12T09:44:35.640997+0000","last_undegraded":"2023-12-12T09:44:35.640997+0000","last_fullsized":"2023-12-12T09:44:35.640997+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_clean_scrub_stamp":"2023-12-12T09:44:20.465592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T11:40:20.775860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.3f","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-12T09:44:39.115676+0000","last_change":"2023-12-12T09:44:36.677277+0000","last_active":"2023-12-12T09:44:39.115676+0000","last_peered":"2023-12-12T09:44:39.115676+0000","last_clean":"2023-12-12T09:44:39.115676+0000","last_became_active":"2023-12-12T09:44:36.677004+0000","last_became_peered":"2023-12-12T09:44:36.677004+0000","last_unstale":"2023-12-12T09:44:39.115676+0000","last_undegraded":"2023-12-12T09:44:39.115676+0000","last_fullsized":"2023-12-12T09:44:39.115676+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:35.613810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:35.613810+0000","last_clean_scrub_stamp":"2023-12-12T09:44:35.613810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T19:56:11.471998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":15,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-12-12T09:44:36.658210+0000","last_change":"2023-12-12T09:44:21.516991+0000","last_active":"2023-12-12T09:44:36.658210+0000","last_peered":"2023-12-12T09:44:36.658210+0000","last_clean":"2023-12-12T09:44:36.658210+0000","last_became_active":"2023-12-12T09:44:21.516690+0000","last_became_peered":"2023-12-12T09:44:21.516690+0000","last_unstale":"2023-12-12T09:44:36.658210+0000","last_undegraded":"2023-12-12T09:44:36.658210+0000","last_fullsized":"2023-12-12T09:44:36.658210+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_clean_scrub_stamp":"2023-12-12T09:44:20.465592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T20:53:13.479872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-12T09:44:38.631498+0000","last_change":"2023-12-12T09:44:36.694777+0000","last_active":"2023-12-12T09:44:38.631498+0000","last_peered":"2023-12-12T09:44:38.631498+0000","last_clean":"2023-12-12T09:44:38.631498+0000","last_became_active":"2023-12-12T09:44:36.694465+0000","last_became_peered":"2023-12-12T09:44:36.694465+0000","last_unstale":"2023-12-12T09:44:38.631498+0000","last_undegraded":"2023-12-12T09:44:38.631498+0000","last_fullsized":"2023-12-12T09:44:38.631498+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:35.613810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:35.613810+0000","last_clean_scrub_stamp":"2023-12-12T09:44:35.613810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T11:19:37.028130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":15,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-12-12T09:44:36.671229+0000","last_change":"2023-12-12T09:44:21.513912+0000","last_active":"2023-12-12T09:44:36.671229+0000","last_peered":"2023-12-12T09:44:36.671229+0000","last_clean":"2023-12-12T09:44:36.671229+0000","last_became_active":"2023-12-12T09:44:21.513624+0000","last_became_peered":"2023-12-12T09:44:21.513624+0000","last_unstale":"2023-12-12T09:44:36.671229+0000","last_undegraded":"2023-12-12T09:44:36.671229+0000","last_fullsized":"2023-12-12T09:44:36.671229+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_clean_scrub_stamp":"2023-12-12T09:44:20.465592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T14:08:30.510607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-12T09:44:38.657874+0000","last_change":"2023-12-12T09:44:36.677578+0000","last_active":"2023-12-12T09:44:38.657874+0000","last_peered":"2023-12-12T09:44:38.657874+0000","last_clean":"2023-12-12T09:44:38.657874+0000","last_became_active":"2023-12-12T09:44:36.677235+0000","last_became_peered":"2023-12-12T09:44:36.677235+0000","last_unstale":"2023-12-12T09:44:38.657874+0000","last_undegraded":"2023-12-12T09:44:38.657874+0000","last_fullsized":"2023-12-12T09:44:38.657874+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:35.613810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:35.613810+0000","last_clean_scrub_stamp":"2023-12-12T09:44:35.613810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T20:22:13.002817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.3f","version":"0'0","reported_seq":15,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-12-12T09:44:36.676382+0000","last_change":"2023-12-12T09:44:21.521409+0000","last_active":"2023-12-12T09:44:36.676382+0000","last_peered":"2023-12-12T09:44:36.676382+0000","last_clean":"2023-12-12T09:44:36.676382+0000","last_became_active":"2023-12-12T09:44:21.520807+0000","last_became_peered":"2023-12-12T09:44:21.520807+0000","last_unstale":"2023-12-12T09:44:36.676382+0000","last_undegraded":"2023-12-12T09:44:36.676382+0000","last_fullsized":"2023-12-12T09:44:36.676382+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:44:20.465592+0000","last_clean_scrub_stamp":"2023-12-12T09:44:20.465592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T10:43:48.035299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":3905,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":7810,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":41,"ondisk_log_size":41,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":64844,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574869,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27504,"kb_used_data":484,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344336,"statfs":{"total":96636764160,"available":96608600064,"internally_reserved":0,"allocated":495616,"data_stored":762746,"data_compressed":32422,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 12 09:44:15 2023","interfaces":[{"interface":"back","average":{"1min":0.999,"5min":0.999,"15min":0.999},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.8089999999999999,"5min":1.8089999999999999,"15min":1.8089999999999999},"last":1.607},{"interface":"front","average":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"min":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"max":{"1min":1.4279999999999999,"5min":1.4279999999999999,"15min":1.4279999999999999},"last":0.96399999999999997}]},{"osd":1,"last update":"Tue Dec 12 09:44:15 2023","interfaces":[{"interface":"back","average":{"1min":1.198,"5min":1.198,"15min":1.198},"min":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"max":{"1min":1.7729999999999999,"5min":1.7729999999999999,"15min":1.7729999999999999},"last":0.84299999999999997},{"interface":"front","average":{"1min":1.216,"5min":1.216,"15min":1.216},"min":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"max":{"1min":3.1150000000000002,"5min":3.1150000000000002,"15min":3.1150000000000002},"last":0.77000000000000002}]},{"osd":2,"last update":"Tue Dec 12 09:44:15 2023","interfaces":[{"interface":"back","average":{"1min":1.262,"5min":1.262,"15min":1.262},"min":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"max":{"1min":2.2050000000000001,"5min":2.2050000000000001,"15min":2.2050000000000001},"last":0.89900000000000002},{"interface":"front","average":{"1min":1.2450000000000001,"5min":1.2450000000000001,"15min":1.2450000000000001},"min":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":3.2759999999999998,"5min":3.2759999999999998,"15min":3.2759999999999998},"last":1.446}]},{"osd":3,"last update":"Tue Dec 12 09:44:15 2023","interfaces":[{"interface":"back","average":{"1min":1.3169999999999999,"5min":1.3169999999999999,"15min":1.3169999999999999},"min":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"max":{"1min":3.1819999999999999,"5min":3.1819999999999999,"15min":3.1819999999999999},"last":1.1519999999999999},{"interface":"front","average":{"1min":1.2949999999999999,"5min":1.2949999999999999,"15min":1.2949999999999999},"min":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"max":{"1min":1.8740000000000001,"5min":1.8740000000000001,"15min":1.8740000000000001},"last":1.046}]},{"osd":4,"last update":"Tue Dec 12 09:44:15 2023","interfaces":[{"interface":"back","average":{"1min":1.3520000000000001,"5min":1.3520000000000001,"15min":1.3520000000000001},"min":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"max":{"1min":2.5529999999999999,"5min":2.5529999999999999,"15min":2.5529999999999999},"last":1.3120000000000001},{"interface":"front","average":{"1min":1.4550000000000001,"5min":1.4550000000000001,"15min":1.4550000000000001},"min":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"max":{"1min":2.351,"5min":2.351,"15min":2.351},"last":1.117}]},{"osd":5,"last update":"Tue Dec 12 09:44:15 2023","interfaces":[{"interface":"back","average":{"1min":1.335,"5min":1.335,"15min":1.335},"min":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"max":{"1min":1.9610000000000001,"5min":1.9610000000000001,"15min":1.9610000000000001},"last":1.2130000000000001},{"interface":"front","average":{"1min":1.5369999999999999,"5min":1.5369999999999999,"15min":1.5369999999999999},"min":{"1min":1.2050000000000001,"5min":1.2050000000000001,"15min":1.2050000000000001},"max":{"1min":2.4159999999999999,"5min":2.4159999999999999,"15min":2.4159999999999999},"last":1.3839999999999999}]},{"osd":6,"last update":"Tue Dec 12 09:44:15 2023","interfaces":[{"interface":"back","average":{"1min":1.417,"5min":1.417,"15min":1.417},"min":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"max":{"1min":2.0510000000000002,"5min":2.0510000000000002,"15min":2.0510000000000002},"last":1.3480000000000001},{"interface":"front","average":{"1min":1.635,"5min":1.635,"15min":1.635},"min":{"1min":1.256,"5min":1.256,"15min":1.256},"max":{"1min":2.5800000000000001,"5min":2.5800000000000001,"15min":2.5800000000000001},"last":1.5449999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574867,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27464,"kb_used_data":440,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344376,"statfs":{"total":96636764160,"available":96608641024,"internally_reserved":0,"allocated":450560,"data_stored":180643,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 12 09:44:14 2023","interfaces":[{"interface":"back","average":{"1min":1.1930000000000001,"5min":1.1930000000000001,"15min":1.1930000000000001},"min":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":3.6429999999999998,"5min":3.6429999999999998,"15min":3.6429999999999998},"last":1.044},{"interface":"front","average":{"1min":1.0700000000000001,"5min":1.0700000000000001,"15min":1.0700000000000001},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":2.6059999999999999,"5min":2.6059999999999999,"15min":2.6059999999999999},"last":1.5780000000000001}]},{"osd":1,"last update":"Tue Dec 12 09:44:14 2023","interfaces":[{"interface":"back","average":{"1min":1.0620000000000001,"5min":1.0620000000000001,"15min":1.0620000000000001},"min":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"max":{"1min":2.0169999999999999,"5min":2.0169999999999999,"15min":2.0169999999999999},"last":1.2929999999999999},{"interface":"front","average":{"1min":1.2010000000000001,"5min":1.2010000000000001,"15min":1.2010000000000001},"min":{"1min":0.747,"5min":0.747,"15min":0.747},"max":{"1min":1.7,"5min":1.7,"15min":1.7},"last":1.369}]},{"osd":2,"last update":"Tue Dec 12 09:44:14 2023","interfaces":[{"interface":"back","average":{"1min":1.236,"5min":1.236,"15min":1.236},"min":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"max":{"1min":1.804,"5min":1.804,"15min":1.804},"last":1.232},{"interface":"front","average":{"1min":1.3129999999999999,"5min":1.3129999999999999,"15min":1.3129999999999999},"min":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"max":{"1min":2.2160000000000002,"5min":2.2160000000000002,"15min":2.2160000000000002},"last":1.3320000000000001}]},{"osd":3,"last update":"Tue Dec 12 09:44:14 2023","interfaces":[{"interface":"back","average":{"1min":1.218,"5min":1.218,"15min":1.218},"min":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"max":{"1min":2.665,"5min":2.665,"15min":2.665},"last":1.0960000000000001},{"interface":"front","average":{"1min":1.2310000000000001,"5min":1.2310000000000001,"15min":1.2310000000000001},"min":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"max":{"1min":1.8620000000000001,"5min":1.8620000000000001,"15min":1.8620000000000001},"last":1.1910000000000001}]},{"osd":4,"last update":"Tue Dec 12 09:44:14 2023","interfaces":[{"interface":"back","average":{"1min":1.2749999999999999,"5min":1.2749999999999999,"15min":1.2749999999999999},"min":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":2.0310000000000001,"5min":2.0310000000000001,"15min":2.0310000000000001},"last":1.143},{"interface":"front","average":{"1min":1.407,"5min":1.407,"15min":1.407},"min":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"max":{"1min":2.2799999999999998,"5min":2.2799999999999998,"15min":2.2799999999999998},"last":1.508}]},{"osd":5,"last update":"Tue Dec 12 09:44:14 2023","interfaces":[{"interface":"back","average":{"1min":1.4410000000000001,"5min":1.4410000000000001,"15min":1.4410000000000001},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":2.1739999999999999,"5min":2.1739999999999999,"15min":2.1739999999999999},"last":0.97499999999999998},{"interface":"front","average":{"1min":1.4770000000000001,"5min":1.4770000000000001,"15min":1.4770000000000001},"min":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"max":{"1min":1.929,"5min":1.929,"15min":1.929},"last":1.4710000000000001}]},{"osd":7,"last update":"Tue Dec 12 09:44:14 2023","interfaces":[{"interface":"back","average":{"1min":1.5089999999999999,"5min":1.5089999999999999,"15min":1.5089999999999999},"min":{"1min":0.754,"5min":0.754,"15min":0.754},"max":{"1min":1.994,"5min":1.994,"15min":1.994},"last":1.2689999999999999},{"interface":"front","average":{"1min":1.5389999999999999,"5min":1.5389999999999999,"15min":1.5389999999999999},"min":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"max":{"1min":2.0800000000000001,"5min":2.0800000000000001,"15min":2.0800000000000001},"last":1.421}]}]},{"osd":5,"up_from":13,"seq":55834574867,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27460,"kb_used_data":436,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344380,"statfs":{"total":96636764160,"available":96608645120,"internally_reserved":0,"allocated":446464,"data_stored":180097,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 12 09:44:14 2023","interfaces":[{"interface":"back","average":{"1min":1.02,"5min":1.02,"15min":1.02},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.5209999999999999,"5min":1.5209999999999999,"15min":1.5209999999999999},"last":0.68899999999999995},{"interface":"front","average":{"1min":1.1299999999999999,"5min":1.1299999999999999,"15min":1.1299999999999999},"min":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"max":{"1min":1.508,"5min":1.508,"15min":1.508},"last":0.71799999999999997}]},{"osd":1,"last update":"Tue Dec 12 09:44:14 2023","interfaces":[{"interface":"back","average":{"1min":1.226,"5min":1.226,"15min":1.226},"min":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"max":{"1min":1.5940000000000001,"5min":1.5940000000000001,"15min":1.5940000000000001},"last":0.63700000000000001},{"interface":"front","average":{"1min":1.0920000000000001,"5min":1.0920000000000001,"15min":1.0920000000000001},"min":{"1min":0.753,"5min":0.753,"15min":0.753},"max":{"1min":1.5840000000000001,"5min":1.5840000000000001,"15min":1.5840000000000001},"last":0.66400000000000003}]},{"osd":2,"last update":"Tue Dec 12 09:44:14 2023","interfaces":[{"interface":"back","average":{"1min":1.3169999999999999,"5min":1.3169999999999999,"15min":1.3169999999999999},"min":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"max":{"1min":1.7889999999999999,"5min":1.7889999999999999,"15min":1.7889999999999999},"last":0.75700000000000001},{"interface":"front","average":{"1min":1.421,"5min":1.421,"15min":1.421},"min":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"max":{"1min":2.1600000000000001,"5min":2.1600000000000001,"15min":2.1600000000000001},"last":0.83699999999999997}]},{"osd":3,"last update":"Tue Dec 12 09:44:14 2023","interfaces":[{"interface":"back","average":{"1min":1.371,"5min":1.371,"15min":1.371},"min":{"1min":1.002,"5min":1.002,"15min":1.002},"max":{"1min":2.1499999999999999,"5min":2.1499999999999999,"15min":2.1499999999999999},"last":0.77300000000000002},{"interface":"front","average":{"1min":1.492,"5min":1.492,"15min":1.492},"min":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"max":{"1min":1.8939999999999999,"5min":1.8939999999999999,"15min":1.8939999999999999},"last":0.87}]},{"osd":4,"last update":"Tue Dec 12 09:44:14 2023","interfaces":[{"interface":"back","average":{"1min":1.4910000000000001,"5min":1.4910000000000001,"15min":1.4910000000000001},"min":{"1min":0.995,"5min":0.995,"15min":0.995},"max":{"1min":2.391,"5min":2.391,"15min":2.391},"last":0.85199999999999998},{"interface":"front","average":{"1min":1.5880000000000001,"5min":1.5880000000000001,"15min":1.5880000000000001},"min":{"1min":1.0940000000000001,"5min":1.0940000000000001,"15min":1.0940000000000001},"max":{"1min":2.5430000000000001,"5min":2.5430000000000001,"15min":2.5430000000000001},"last":0.80800000000000005}]},{"osd":6,"last update":"Tue Dec 12 09:44:14 2023","interfaces":[{"interface":"back","average":{"1min":1.5960000000000001,"5min":1.5960000000000001,"15min":1.5960000000000001},"min":{"1min":1.034,"5min":1.034,"15min":1.034},"max":{"1min":2.0840000000000001,"5min":2.0840000000000001,"15min":2.0840000000000001},"last":0.82099999999999995},{"interface":"front","average":{"1min":1.631,"5min":1.631,"15min":1.631},"min":{"1min":1.155,"5min":1.155,"15min":1.155},"max":{"1min":2.306,"5min":2.306,"15min":2.306},"last":0.79300000000000004}]},{"osd":7,"last update":"Tue Dec 12 09:44:14 2023","interfaces":[{"interface":"back","average":{"1min":1.7849999999999999,"5min":1.7849999999999999,"15min":1.7849999999999999},"min":{"1min":1.2090000000000001,"5min":1.2090000000000001,"15min":1.2090000000000001},"max":{"1min":2.6880000000000002,"5min":2.6880000000000002,"15min":2.6880000000000002},"last":0.88200000000000001},{"interface":"front","average":{"1min":1.748,"5min":1.748,"15min":1.748},"min":{"1min":1.1220000000000001,"5min":1.1220000000000001,"15min":1.1220000000000001},"max":{"1min":2.3410000000000002,"5min":2.3410000000000002,"15min":2.3410000000000002},"last":0.89900000000000002}]}]},{"osd":4,"up_from":13,"seq":55834574869,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27468,"kb_used_data":444,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344372,"statfs":{"total":96636764160,"available":96608636928,"internally_reserved":0,"allocated":454656,"data_stored":181071,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 12 09:44:14 2023","interfaces":[{"interface":"back","average":{"1min":1.0549999999999999,"5min":1.0549999999999999,"15min":1.0549999999999999},"min":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":1.5820000000000001,"5min":1.5820000000000001,"15min":1.5820000000000001},"last":1.7010000000000001},{"interface":"front","average":{"1min":1.0549999999999999,"5min":1.0549999999999999,"15min":1.0549999999999999},"min":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"max":{"1min":1.492,"5min":1.492,"15min":1.492},"last":1.0109999999999999}]},{"osd":1,"last update":"Tue Dec 12 09:44:14 2023","interfaces":[{"interface":"back","average":{"1min":1.044,"5min":1.044,"15min":1.044},"min":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"max":{"1min":1.3360000000000001,"5min":1.3360000000000001,"15min":1.3360000000000001},"last":0.93999999999999995},{"interface":"front","average":{"1min":1.181,"5min":1.181,"15min":1.181},"min":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"max":{"1min":1.8720000000000001,"5min":1.8720000000000001,"15min":1.8720000000000001},"last":0.878}]},{"osd":2,"last update":"Tue Dec 12 09:44:14 2023","interfaces":[{"interface":"back","average":{"1min":1.119,"5min":1.119,"15min":1.119},"min":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"max":{"1min":1.429,"5min":1.429,"15min":1.429},"last":1.4590000000000001},{"interface":"front","average":{"1min":1.294,"5min":1.294,"15min":1.294},"min":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"max":{"1min":2.1640000000000001,"5min":2.1640000000000001,"15min":2.1640000000000001},"last":1.4950000000000001}]},{"osd":3,"last update":"Tue Dec 12 09:44:14 2023","interfaces":[{"interface":"back","average":{"1min":1.2030000000000001,"5min":1.2030000000000001,"15min":1.2030000000000001},"min":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"max":{"1min":1.635,"5min":1.635,"15min":1.635},"last":1.2889999999999999},{"interface":"front","average":{"1min":1.238,"5min":1.238,"15min":1.238},"min":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"max":{"1min":2.0499999999999998,"5min":2.0499999999999998,"15min":2.0499999999999998},"last":1.232}]},{"osd":5,"last update":"Tue Dec 12 09:44:14 2023","interfaces":[{"interface":"back","average":{"1min":1.468,"5min":1.468,"15min":1.468},"min":{"1min":1,"5min":1,"15min":1},"max":{"1min":2.3159999999999998,"5min":2.3159999999999998,"15min":2.3159999999999998},"last":1.385},{"interface":"front","average":{"1min":1.3500000000000001,"5min":1.3500000000000001,"15min":1.3500000000000001},"min":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"max":{"1min":2.117,"5min":2.117,"15min":2.117},"last":1.978}]},{"osd":6,"last update":"Tue Dec 12 09:44:14 2023","interfaces":[{"interface":"back","average":{"1min":1.403,"5min":1.403,"15min":1.403},"min":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"max":{"1min":2.246,"5min":2.246,"15min":2.246},"last":1.546},{"interface":"front","average":{"1min":1.5489999999999999,"5min":1.5489999999999999,"15min":1.5489999999999999},"min":{"1min":1.2430000000000001,"5min":1.2430000000000001,"15min":1.2430000000000001},"max":{"1min":2.5099999999999998,"5min":2.5099999999999998,"15min":2.5099999999999998},"last":1.917}]},{"osd":7,"last update":"Tue Dec 12 09:44:14 2023","interfaces":[{"interface":"back","average":{"1min":1.5049999999999999,"5min":1.5049999999999999,"15min":1.5049999999999999},"min":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"max":{"1min":2.5710000000000002,"5min":2.5710000000000002,"15min":2.5710000000000002},"last":1.6000000000000001},{"interface":"front","average":{"1min":1.5129999999999999,"5min":1.5129999999999999,"15min":1.5129999999999999},"min":{"1min":1.0600000000000001,"5min":1.0600000000000001,"15min":1.0600000000000001},"max":{"1min":2.3919999999999999,"5min":2.3919999999999999,"15min":2.3919999999999999},"last":1.6459999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574867,"num_pgs":58,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27468,"kb_used_data":440,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344372,"statfs":{"total":96636764160,"available":96608636928,"internally_reserved":0,"allocated":450560,"data_stored":175965,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 12 09:44:16 2023","interfaces":[{"interface":"back","average":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":1.4830000000000001,"5min":1.4830000000000001,"15min":1.4830000000000001},"last":1.1759999999999999},{"interface":"front","average":{"1min":1.137,"5min":1.137,"15min":1.137},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":3.3370000000000002,"5min":3.3370000000000002,"15min":3.3370000000000002},"last":0.94499999999999995}]},{"osd":1,"last update":"Tue Dec 12 09:44:16 2023","interfaces":[{"interface":"back","average":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":1.4610000000000001,"5min":1.4610000000000001,"15min":1.4610000000000001},"last":0.85099999999999998},{"interface":"front","average":{"1min":1.069,"5min":1.069,"15min":1.069},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":2.9409999999999998,"5min":2.9409999999999998,"15min":2.9409999999999998},"last":0.88400000000000001}]},{"osd":2,"last update":"Tue Dec 12 09:44:16 2023","interfaces":[{"interface":"back","average":{"1min":1.1870000000000001,"5min":1.1870000000000001,"15min":1.1870000000000001},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":2.613,"5min":2.613,"15min":2.613},"last":1.0049999999999999},{"interface":"front","average":{"1min":1.1850000000000001,"5min":1.1850000000000001,"15min":1.1850000000000001},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":3.0430000000000001,"5min":3.0430000000000001,"15min":3.0430000000000001},"last":1.2689999999999999}]},{"osd":4,"last update":"Tue Dec 12 09:44:16 2023","interfaces":[{"interface":"back","average":{"1min":1.383,"5min":1.383,"15min":1.383},"min":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":3.5019999999999998,"5min":3.5019999999999998,"15min":3.5019999999999998},"last":1.397},{"interface":"front","average":{"1min":1.4830000000000001,"5min":1.4830000000000001,"15min":1.4830000000000001},"min":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"max":{"1min":2.9889999999999999,"5min":2.9889999999999999,"15min":2.9889999999999999},"last":1.4490000000000001}]},{"osd":5,"last update":"Tue Dec 12 09:44:16 2023","interfaces":[{"interface":"back","average":{"1min":1.5,"5min":1.5,"15min":1.5},"min":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"max":{"1min":4.2480000000000002,"5min":4.2480000000000002,"15min":4.2480000000000002},"last":1.526},{"interface":"front","average":{"1min":1.5920000000000001,"5min":1.5920000000000001,"15min":1.5920000000000001},"min":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"max":{"1min":5.5060000000000002,"5min":5.5060000000000002,"15min":5.5060000000000002},"last":1.4950000000000001}]},{"osd":6,"last update":"Tue Dec 12 09:44:16 2023","interfaces":[{"interface":"back","average":{"1min":1.458,"5min":1.458,"15min":1.458},"min":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"max":{"1min":3.1400000000000001,"5min":3.1400000000000001,"15min":3.1400000000000001},"last":1.3500000000000001},{"interface":"front","average":{"1min":1.5469999999999999,"5min":1.5469999999999999,"15min":1.5469999999999999},"min":{"1min":0.627,"5min":0.627,"15min":0.627},"max":{"1min":4.3179999999999996,"5min":4.3179999999999996,"15min":4.3179999999999996},"last":1.6759999999999999}]},{"osd":7,"last update":"Tue Dec 12 09:44:16 2023","interfaces":[{"interface":"back","average":{"1min":1.5920000000000001,"5min":1.5920000000000001,"15min":1.5920000000000001},"min":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"max":{"1min":5.3979999999999997,"5min":5.3979999999999997,"15min":5.3979999999999997},"last":1.6319999999999999},{"interface":"front","average":{"1min":1.554,"5min":1.554,"15min":1.554},"min":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"max":{"1min":3.4129999999999998,"5min":3.4129999999999998,"15min":3.4129999999999998},"last":1.599}]}]},{"osd":2,"up_from":13,"seq":55834574867,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27468,"kb_used_data":444,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344372,"statfs":{"total":96636764160,"available":96608636928,"internally_reserved":0,"allocated":454656,"data_stored":181059,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 12 09:44:15 2023","interfaces":[{"interface":"back","average":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":1.458,"5min":1.458,"15min":1.458},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":1.4370000000000001,"5min":1.4370000000000001,"15min":1.4370000000000001},"last":0.36199999999999999}]},{"osd":1,"last update":"Tue Dec 12 09:44:15 2023","interfaces":[{"interface":"back","average":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.593,"5min":1.593,"15min":1.593},"last":0.39500000000000002},{"interface":"front","average":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":1.758,"5min":1.758,"15min":1.758},"last":0.48299999999999998}]},{"osd":3,"last update":"Tue Dec 12 09:44:15 2023","interfaces":[{"interface":"back","average":{"1min":1.0569999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.8879999999999999,"5min":1.8879999999999999,"15min":1.8879999999999999},"last":0.57399999999999995},{"interface":"front","average":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":1.8120000000000001,"5min":1.8120000000000001,"15min":1.8120000000000001},"last":0.46000000000000002}]},{"osd":4,"last update":"Tue Dec 12 09:44:15 2023","interfaces":[{"interface":"back","average":{"1min":1.2270000000000001,"5min":1.2270000000000001,"15min":1.2270000000000001},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":2.5760000000000001,"5min":2.5760000000000001,"15min":2.5760000000000001},"last":0.98799999999999999},{"interface":"front","average":{"1min":1.3939999999999999,"5min":1.3939999999999999,"15min":1.3939999999999999},"min":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":2.8069999999999999,"5min":2.8069999999999999,"15min":2.8069999999999999},"last":0.84299999999999997}]},{"osd":5,"last update":"Tue Dec 12 09:44:15 2023","interfaces":[{"interface":"back","average":{"1min":1.379,"5min":1.379,"15min":1.379},"min":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"max":{"1min":2.3109999999999999,"5min":2.3109999999999999,"15min":2.3109999999999999},"last":1.0760000000000001},{"interface":"front","average":{"1min":1.351,"5min":1.351,"15min":1.351},"min":{"1min":0.627,"5min":0.627,"15min":0.627},"max":{"1min":2.5110000000000001,"5min":2.5110000000000001,"15min":2.5110000000000001},"last":0.79400000000000004}]},{"osd":6,"last update":"Tue Dec 12 09:44:15 2023","interfaces":[{"interface":"back","average":{"1min":1.4370000000000001,"5min":1.4370000000000001,"15min":1.4370000000000001},"min":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"max":{"1min":2.907,"5min":2.907,"15min":2.907},"last":1.046},{"interface":"front","average":{"1min":1.429,"5min":1.429,"15min":1.429},"min":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"max":{"1min":2.375,"5min":2.375,"15min":2.375},"last":1.147}]},{"osd":7,"last update":"Tue Dec 12 09:44:15 2023","interfaces":[{"interface":"back","average":{"1min":1.4570000000000001,"5min":1.4570000000000001,"15min":1.4570000000000001},"min":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"max":{"1min":2.3370000000000002,"5min":2.3370000000000002,"15min":2.3370000000000002},"last":0.94499999999999995},{"interface":"front","average":{"1min":1.5129999999999999,"5min":1.5129999999999999,"15min":1.5129999999999999},"min":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"max":{"1min":2.488,"5min":2.488,"15min":2.488},"last":1.117}]}]},{"osd":1,"up_from":13,"seq":55834574867,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27452,"kb_used_data":432,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344388,"statfs":{"total":96636764160,"available":96608653312,"internally_reserved":0,"allocated":442368,"data_stored":175397,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 12 09:44:15 2023","interfaces":[{"interface":"back","average":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":2.794,"5min":2.794,"15min":2.794},"last":1.0589999999999999},{"interface":"front","average":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":2.1379999999999999,"5min":2.1379999999999999,"15min":2.1379999999999999},"last":0.79700000000000004}]},{"osd":2,"last update":"Tue Dec 12 09:44:15 2023","interfaces":[{"interface":"back","average":{"1min":0.98599999999999999,"5min":0.98599999999999999,"15min":0.98599999999999999},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":6.3390000000000004,"5min":6.3390000000000004,"15min":6.3390000000000004},"last":1.0229999999999999},{"interface":"front","average":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":2.823,"5min":2.823,"15min":2.823},"last":0.878}]},{"osd":3,"last update":"Tue Dec 12 09:44:15 2023","interfaces":[{"interface":"back","average":{"1min":1.0509999999999999,"5min":1.0509999999999999,"15min":1.0509999999999999},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":2.7519999999999998,"5min":2.7519999999999998,"15min":2.7519999999999998},"last":1.123},{"interface":"front","average":{"1min":1.008,"5min":1.008,"15min":1.008},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":2.2559999999999998,"5min":2.2559999999999998,"15min":2.2559999999999998},"last":0.90500000000000003}]},{"osd":4,"last update":"Tue Dec 12 09:44:15 2023","interfaces":[{"interface":"back","average":{"1min":1.399,"5min":1.399,"15min":1.399},"min":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"max":{"1min":6.423,"5min":6.423,"15min":6.423},"last":1.1399999999999999},{"interface":"front","average":{"1min":1.194,"5min":1.194,"15min":1.194},"min":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"max":{"1min":2.2309999999999999,"5min":2.2309999999999999,"15min":2.2309999999999999},"last":1.1930000000000001}]},{"osd":5,"last update":"Tue Dec 12 09:44:15 2023","interfaces":[{"interface":"back","average":{"1min":1.4670000000000001,"5min":1.4670000000000001,"15min":1.4670000000000001},"min":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"max":{"1min":6.2830000000000004,"5min":6.2830000000000004,"15min":6.2830000000000004},"last":1.2949999999999999},{"interface":"front","average":{"1min":1.375,"5min":1.375,"15min":1.375},"min":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"max":{"1min":2.73,"5min":2.73,"15min":2.73},"last":1.3320000000000001}]},{"osd":6,"last update":"Tue Dec 12 09:44:15 2023","interfaces":[{"interface":"back","average":{"1min":1.5600000000000001,"5min":1.5600000000000001,"15min":1.5600000000000001},"min":{"1min":0.875,"5min":0.875,"15min":0.875},"max":{"1min":6.468,"5min":6.468,"15min":6.468},"last":1.266},{"interface":"front","average":{"1min":1.5800000000000001,"5min":1.5800000000000001,"15min":1.5800000000000001},"min":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"max":{"1min":6.3129999999999997,"5min":6.3129999999999997,"15min":6.3129999999999997},"last":1.2410000000000001}]},{"osd":7,"last update":"Tue Dec 12 09:44:15 2023","interfaces":[{"interface":"back","average":{"1min":1.407,"5min":1.407,"15min":1.407},"min":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"max":{"1min":2.9009999999999998,"5min":2.9009999999999998,"15min":2.9009999999999998},"last":1.087},{"interface":"front","average":{"1min":1.556,"5min":1.556,"15min":1.556},"min":{"1min":0.752,"5min":0.752,"15min":0.752},"max":{"1min":6.242,"5min":6.242,"15min":6.242},"last":1.379}]}]},{"osd":0,"up_from":13,"seq":55834574869,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27516,"kb_used_data":492,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344324,"statfs":{"total":96636764160,"available":96608587776,"internally_reserved":0,"allocated":503808,"data_stored":769757,"data_compressed":32422,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Dec 12 09:44:16 2023","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":1.3600000000000001,"5min":1.3600000000000001,"15min":1.3600000000000001},"last":0.78900000000000003},{"interface":"front","average":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":1.282,"5min":1.282,"15min":1.282},"last":1.274}]},{"osd":2,"last update":"Tue Dec 12 09:44:16 2023","interfaces":[{"interface":"back","average":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":1.2529999999999999,"5min":1.2529999999999999,"15min":1.2529999999999999},"last":1.079},{"interface":"front","average":{"1min":0.995,"5min":0.995,"15min":0.995},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":1.649,"5min":1.649,"15min":1.649},"last":1.3839999999999999}]},{"osd":3,"last update":"Tue Dec 12 09:44:16 2023","interfaces":[{"interface":"back","average":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.4990000000000001,"5min":1.4990000000000001,"15min":1.4990000000000001},"last":1.141},{"interface":"front","average":{"1min":1.004,"5min":1.004,"15min":1.004},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.7689999999999999,"5min":1.7689999999999999,"15min":1.7689999999999999},"last":1.1890000000000001}]},{"osd":4,"last update":"Tue Dec 12 09:44:16 2023","interfaces":[{"interface":"back","average":{"1min":1.2869999999999999,"5min":1.2869999999999999,"15min":1.2869999999999999},"min":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"max":{"1min":2.073,"5min":2.073,"15min":2.073},"last":1.5169999999999999},{"interface":"front","average":{"1min":1.2929999999999999,"5min":1.2929999999999999,"15min":1.2929999999999999},"min":{"1min":0.877,"5min":0.877,"15min":0.877},"max":{"1min":3.0699999999999998,"5min":3.0699999999999998,"15min":3.0699999999999998},"last":1.333}]},{"osd":5,"last update":"Tue Dec 12 09:44:16 2023","interfaces":[{"interface":"back","average":{"1min":1.2330000000000001,"5min":1.2330000000000001,"15min":1.2330000000000001},"min":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":3.1909999999999998,"5min":3.1909999999999998,"15min":3.1909999999999998},"last":1.7030000000000001},{"interface":"front","average":{"1min":1.3069999999999999,"5min":1.3069999999999999,"15min":1.3069999999999999},"min":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"max":{"1min":1.9750000000000001,"5min":1.9750000000000001,"15min":1.9750000000000001},"last":1.762}]},{"osd":6,"last update":"Tue Dec 12 09:44:16 2023","interfaces":[{"interface":"back","average":{"1min":1.3380000000000001,"5min":1.3380000000000001,"15min":1.3380000000000001},"min":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"max":{"1min":1.9630000000000001,"5min":1.9630000000000001,"15min":1.9630000000000001},"last":1.6160000000000001},{"interface":"front","average":{"1min":1.3919999999999999,"5min":1.3919999999999999,"15min":1.3919999999999999},"min":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"max":{"1min":2.9100000000000001,"5min":2.9100000000000001,"15min":2.9100000000000001},"last":1.6659999999999999}]},{"osd":7,"last update":"Tue Dec 12 09:44:16 2023","interfaces":[{"interface":"back","average":{"1min":1.4450000000000001,"5min":1.4450000000000001,"15min":1.4450000000000001},"min":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"max":{"1min":2.992,"5min":2.992,"15min":2.992},"last":1.5760000000000001},{"interface":"front","average":{"1min":1.3300000000000001,"5min":1.3300000000000001,"15min":1.3300000000000001},"min":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"max":{"1min":2.7690000000000001,"5min":2.7690000000000001,"15min":2.7690000000000001},"last":1.254}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32422,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32422,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":3129,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":3129,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-12T09:44:41.611 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-12-12T09:44:41.613 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.1 mon 'allow r' osd 'allow rw pool=cephfs2_data' mds allow 2023-12-12T09:44:41.872 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:41.870+0000 7f5401568640 1 Processor -- start 2023-12-12T09:44:41.872 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:41.871+0000 7f5401568640 1 -- start start 2023-12-12T09:44:41.873 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:41.872+0000 7f5401568640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f53fc14f8c0 0x7f53fc06dc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:41.874 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:41.872+0000 7f5401568640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53fc0c16c0 con 0x7f53fc152500 2023-12-12T09:44:41.874 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:41.872+0000 7f5401568640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53fc0c19a0 con 0x7f53fc06d350 2023-12-12T09:44:41.874 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:41.872+0000 7f5401568640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53fc0c1090 con 0x7f53fc14f8c0 2023-12-12T09:44:41.874 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:41.873+0000 7f53fb7fe640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f53fc152500 0x7f53fc152990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:44420/0 (socket says 172.21.15.73:44420) 2023-12-12T09:44:41.874 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:41.873+0000 7f53fb7fe640 1 -- 172.21.15.73:0/1997837911 learned_addr learned my addr 172.21.15.73:0/1997837911 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-12T09:44:41.876 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:41.873+0000 7f53faffd640 1 --2- 172.21.15.73:0/1997837911 >> v2:172.21.15.142:3300/0 conn(0x7f53fc14f8c0 0x7f53fc06dc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:41.876 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:41.873+0000 7f53f9ffb640 1 -- 172.21.15.73:0/1997837911 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2189020097 0 0) 0x7f53fc0c16c0 con 0x7f53fc152500 2023-12-12T09:44:41.876 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:41.873+0000 7f53f9ffb640 1 -- 172.21.15.73:0/1997837911 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f53e8003520 con 0x7f53fc152500 2023-12-12T09:44:41.876 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:41.873+0000 7f53f9ffb640 1 -- 172.21.15.73:0/1997837911 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2484616767 0 0) 0x7f53e8003520 con 0x7f53fc152500 2023-12-12T09:44:41.876 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:41.873+0000 7f53f9ffb640 1 -- 172.21.15.73:0/1997837911 >> v2:172.21.15.142:3300/0 conn(0x7f53fc14f8c0 msgr2=0x7f53fc06dc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:44:41.876 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:41.873+0000 7f53f9ffb640 1 --2- 172.21.15.73:0/1997837911 >> v2:172.21.15.142:3300/0 conn(0x7f53fc14f8c0 0x7f53fc06dc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:41.876 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:41.873+0000 7f53f9ffb640 1 -- 172.21.15.73:0/1997837911 >> v1:172.21.15.142:6789/0 conn(0x7f53fc06d350 legacy=0x7f53fc071e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:44:41.876 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:41.873+0000 7f53f9ffb640 1 -- 172.21.15.73:0/1997837911 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53fc0c1c80 con 0x7f53fc152500 2023-12-12T09:44:41.876 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:41.873+0000 7f53f9ffb640 1 -- 172.21.15.73:0/1997837911 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3186547832 0 0) 0x7f53f4001670 con 0x7f53fc152500 2023-12-12T09:44:41.876 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:41.873+0000 7f53f9ffb640 1 -- 172.21.15.73:0/1997837911 >> v1:172.21.15.73:6789/0 conn(0x7f53fc152500 legacy=0x7f53fc152990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:41.877 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:41.873+0000 7f53f9ffb640 1 --2- 172.21.15.73:0/1997837911 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f53e80039c0 0x7f53e8003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:41.877 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:41.874+0000 7f53f9ffb640 1 --2- 172.21.15.73:0/1997837911 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f53e80047c0 0x7f53e8004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:41.877 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:41.874+0000 7f53f9ffb640 1 --2- 172.21.15.73:0/1997837911 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f53e8005180 0x7f53e800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:41.877 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:41.874+0000 7f53f9ffb640 1 -- 172.21.15.73:0/1997837911 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53e800c050 con 0x7f53e8005180 2023-12-12T09:44:41.877 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:41.874+0000 7f53f9ffb640 1 -- 172.21.15.73:0/1997837911 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53e800c190 con 0x7f53e80047c0 2023-12-12T09:44:41.877 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:41.874+0000 7f53f9ffb640 1 -- 172.21.15.73:0/1997837911 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53e800c350 con 0x7f53e80039c0 2023-12-12T09:44:41.877 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:41.874+0000 7f53fb7fe640 1 --2- 172.21.15.73:0/1997837911 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f53e8005180 0x7f53e800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:41.877 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:41.874+0000 7f53fa7fc640 1 --2- 172.21.15.73:0/1997837911 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f53e80047c0 0x7f53e8004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:41.877 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:41.874+0000 7f53faffd640 1 --2- 172.21.15.73:0/1997837911 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f53e80039c0 0x7f53e8003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:41.877 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:41.874+0000 7f53fb7fe640 1 -- 172.21.15.73:0/1997837911 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f53e80039c0 msgr2=0x7f53e8003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:44:41.877 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:41.874+0000 7f53fb7fe640 1 --2- 172.21.15.73:0/1997837911 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f53e80039c0 0x7f53e8003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:41.878 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:41.874+0000 7f53fb7fe640 1 -- 172.21.15.73:0/1997837911 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f53e80047c0 msgr2=0x7f53e8004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:44:41.878 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:41.874+0000 7f53fb7fe640 1 --2- 172.21.15.73:0/1997837911 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f53e80047c0 0x7f53e8004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:41.878 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:41.874+0000 7f53fb7fe640 1 -- 172.21.15.73:0/1997837911 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53e8003520 con 0x7f53e8005180 2023-12-12T09:44:41.879 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:41.875+0000 7f53fb7fe640 1 -- 172.21.15.73:0/1997837911 reap_dead start 2023-12-12T09:44:41.879 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:41.875+0000 7f53fb7fe640 1 --2- 172.21.15.73:0/1997837911 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f53e8005180 0x7f53e800b980 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f53f400c190 tx=0x7f53e80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac8e2de322972ace server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:44:41.879 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:41.876+0000 7f53f9ffb640 1 -- 172.21.15.73:0/1997837911 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53f4005ad0 con 0x7f53e8005180 2023-12-12T09:44:41.879 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:41.876+0000 7f53f9ffb640 1 -- 172.21.15.73:0/1997837911 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53f4005c70 con 0x7f53e8005180 2023-12-12T09:44:41.879 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:41.876+0000 7f53f9ffb640 1 -- 172.21.15.73:0/1997837911 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53f402c810 con 0x7f53e8005180 2023-12-12T09:44:41.879 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:41.876+0000 7f5401568640 1 -- 172.21.15.73:0/1997837911 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f53e8005180 msgr2=0x7f53e800b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:41.879 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:41.876+0000 7f5401568640 1 --2- 172.21.15.73:0/1997837911 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f53e8005180 0x7f53e800b980 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f53f400c190 tx=0x7f53e80057f0 comp rx=0 tx=0).stop 2023-12-12T09:44:41.880 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:41.876+0000 7f5401568640 1 -- 172.21.15.73:0/1997837911 shutdown_connections 2023-12-12T09:44:41.880 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:41.876+0000 7f5401568640 1 --2- 172.21.15.73:0/1997837911 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f53e8005180 0x7f53e800b980 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:41.880 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:41.876+0000 7f5401568640 1 -- 172.21.15.73:0/1997837911 >> 172.21.15.73:0/1997837911 conn(0x7f53fc06a4e0 msgr2=0x7f53fc06a8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:44:41.880 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:41.876+0000 7f5401568640 1 -- 172.21.15.73:0/1997837911 shutdown_connections 2023-12-12T09:44:41.880 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:41.876+0000 7f5401568640 1 -- 172.21.15.73:0/1997837911 wait complete. 2023-12-12T09:44:41.880 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:41.878+0000 7f5401568640 1 Processor -- start 2023-12-12T09:44:41.880 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:41.878+0000 7f5401568640 1 -- start start 2023-12-12T09:44:41.882 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:41.879+0000 7f5401568640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f53e8005180 0x7f53fc156170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:41.882 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:41.879+0000 7f5401568640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f53fc1566b0 0x7f53fc150200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:41.882 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:41.879+0000 7f5401568640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f53fc150740 0x7f53fc1ed090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:41.882 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:41.879+0000 7f5401568640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53fc0a6040 con 0x7f53fc1566b0 2023-12-12T09:44:41.882 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:41.879+0000 7f5401568640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53fc150c60 con 0x7f53fc150740 2023-12-12T09:44:41.882 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:41.879+0000 7f5401568640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53fc1edd80 con 0x7f53e8005180 2023-12-12T09:44:41.882 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:41.879+0000 7f53fa7fc640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f53fc1566b0 0x7f53fc150200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:41.883 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:41.879+0000 7f53fa7fc640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f53fc1566b0 0x7f53fc150200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:52736/0 (socket says 172.21.15.73:52736) 2023-12-12T09:44:41.883 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:41.879+0000 7f53fa7fc640 1 -- 172.21.15.73:0/312179402 learned_addr learned my addr 172.21.15.73:0/312179402 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:44:41.883 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:41.880+0000 7f53fb7fe640 1 --2- 172.21.15.73:0/312179402 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f53fc150740 0x7f53fc1ed090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:41.883 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:41.880+0000 7f53faffd640 1 --2- 172.21.15.73:0/312179402 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f53e8005180 0x7f53fc156170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:41.883 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:41.880+0000 7f53fa7fc640 1 -- 172.21.15.73:0/312179402 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f53e8005180 msgr2=0x7f53fc156170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:41.883 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:41.880+0000 7f53fa7fc640 1 --2- 172.21.15.73:0/312179402 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f53e8005180 0x7f53fc156170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:41.883 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:41.880+0000 7f53fa7fc640 1 -- 172.21.15.73:0/312179402 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f53fc150740 msgr2=0x7f53fc1ed090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:41.883 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:41.880+0000 7f53fa7fc640 1 --2- 172.21.15.73:0/312179402 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f53fc150740 0x7f53fc1ed090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:41.883 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:41.880+0000 7f53fa7fc640 1 -- 172.21.15.73:0/312179402 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53fc0a5cd0 con 0x7f53fc1566b0 2023-12-12T09:44:41.883 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:41.880+0000 7f53faffd640 1 --2- 172.21.15.73:0/312179402 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f53e8005180 0x7f53fc156170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:44:41.883 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:41.880+0000 7f53fa7fc640 1 --2- 172.21.15.73:0/312179402 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f53fc1566b0 0x7f53fc150200 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f53e400e460 tx=0x7f53e400e920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:44:41.883 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:41.880+0000 7f53f37fe640 1 -- 172.21.15.73:0/312179402 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53e40135f0 con 0x7f53fc1566b0 2023-12-12T09:44:41.883 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:41.881+0000 7f53f37fe640 1 -- 172.21.15.73:0/312179402 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53e4013750 con 0x7f53fc1566b0 2023-12-12T09:44:41.884 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:41.881+0000 7f53f37fe640 1 -- 172.21.15.73:0/312179402 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53e4013b00 con 0x7f53fc1566b0 2023-12-12T09:44:41.884 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:41.881+0000 7f5401568640 1 -- 172.21.15.73:0/312179402 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53fc151dc0 con 0x7f53fc1566b0 2023-12-12T09:44:41.884 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:41.881+0000 7f5401568640 1 -- 172.21.15.73:0/312179402 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53fc146d10 con 0x7f53fc1566b0 2023-12-12T09:44:41.885 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:41.882+0000 7f5401568640 1 -- 172.21.15.73:0/312179402 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f53fc067070 con 0x7f53fc1566b0 2023-12-12T09:44:41.885 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:41.883+0000 7f53f37fe640 1 -- 172.21.15.73:0/312179402 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f53e4013c60 con 0x7f53fc1566b0 2023-12-12T09:44:41.885 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:41.884+0000 7f53f37fe640 1 --2- 172.21.15.73:0/312179402 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f53dc06ae40 0x7f53dc06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:41.885 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:41.884+0000 7f53f37fe640 1 -- 172.21.15.73:0/312179402 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f53e4089720 con 0x7f53fc1566b0 2023-12-12T09:44:41.885 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:41.884+0000 7f53faffd640 1 --2- 172.21.15.73:0/312179402 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f53dc06ae40 0x7f53dc06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:41.885 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:41.884+0000 7f53faffd640 1 --2- 172.21.15.73:0/312179402 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f53dc06ae40 0x7f53dc06d300 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f53fc1523f0 tx=0x7f53ec00b040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:44:41.889 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:41.888+0000 7f53f37fe640 1 -- 172.21.15.73:0/312179402 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f53e4054460 con 0x7f53fc1566b0 2023-12-12T09:44:42.154 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:42.153+0000 7f5401568640 1 -- 172.21.15.73:0/312179402 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.1", "caps": ["mon", "allow r", "osd", "allow rw pool=cephfs2_data", "mds", "allow"]} v 0) v1 -- 0x7f53fc067580 con 0x7f53fc1566b0 2023-12-12T09:44:42.159 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:42.157+0000 7f53f37fe640 1 -- 172.21.15.73:0/312179402 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.1", "caps": ["mon", "allow r", "osd", "allow rw pool=cephfs2_data", "mds", "allow"]}]=0 updated caps for client.1 v12) v1 ==== 185+0+142 (secure 0 0 0) 0x7f53e4057a80 con 0x7f53fc1566b0 2023-12-12T09:44:42.159 INFO:teuthology.orchestra.run.smithi073.stdout:[client.1] 2023-12-12T09:44:42.159 INFO:teuthology.orchestra.run.smithi073.stdout: key = AQD/KnhlLq6aERAAgTQwqvltAggkGpb77Zngsg== 2023-12-12T09:44:42.159 INFO:teuthology.orchestra.run.smithi073.stdout: caps mds = "allow" 2023-12-12T09:44:42.159 INFO:teuthology.orchestra.run.smithi073.stdout: caps mon = "allow r" 2023-12-12T09:44:42.159 INFO:teuthology.orchestra.run.smithi073.stdout: caps osd = "allow rw pool=cephfs2_data" 2023-12-12T09:44:42.159 INFO:teuthology.orchestra.run.smithi073.stderr:updated caps for client.1 2023-12-12T09:44:42.162 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:42.160+0000 7f5401568640 1 -- 172.21.15.73:0/312179402 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f53dc06ae40 msgr2=0x7f53dc06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:42.162 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:42.160+0000 7f5401568640 1 --2- 172.21.15.73:0/312179402 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f53dc06ae40 0x7f53dc06d300 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f53fc1523f0 tx=0x7f53ec00b040 comp rx=0 tx=0).stop 2023-12-12T09:44:42.162 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:42.160+0000 7f5401568640 1 -- 172.21.15.73:0/312179402 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f53fc1566b0 msgr2=0x7f53fc150200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:42.162 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:42.160+0000 7f5401568640 1 --2- 172.21.15.73:0/312179402 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f53fc1566b0 0x7f53fc150200 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f53e400e460 tx=0x7f53e400e920 comp rx=0 tx=0).stop 2023-12-12T09:44:42.162 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:42.160+0000 7f5401568640 1 -- 172.21.15.73:0/312179402 shutdown_connections 2023-12-12T09:44:42.162 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:42.160+0000 7f5401568640 1 --2- 172.21.15.73:0/312179402 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f53dc06ae40 0x7f53dc06d300 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:42.162 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:42.160+0000 7f5401568640 1 --2- 172.21.15.73:0/312179402 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f53fc150740 0x7f53fc1ed090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:42.162 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:42.160+0000 7f5401568640 1 --2- 172.21.15.73:0/312179402 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f53fc1566b0 0x7f53fc150200 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:42.162 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:42.160+0000 7f5401568640 1 --2- 172.21.15.73:0/312179402 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f53e8005180 0x7f53fc156170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:42.162 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:42.160+0000 7f5401568640 1 -- 172.21.15.73:0/312179402 >> 172.21.15.73:0/312179402 conn(0x7f53fc06a4e0 msgr2=0x7f53fc0c3780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:44:42.162 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:42.161+0000 7f5401568640 1 -- 172.21.15.73:0/312179402 shutdown_connections 2023-12-12T09:44:42.163 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:42.161+0000 7f5401568640 1 -- 172.21.15.73:0/312179402 wait complete. 2023-12-12T09:44:42.180 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2023-12-12T09:44:42.181 DEBUG:teuthology.orchestra.run.smithi142:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-12T09:44:42.240 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2023-12-12T09:44:42.240 DEBUG:teuthology.orchestra.run.smithi142:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-12T09:44:42.291 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-12T09:44:42.515 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:42.514+0000 7fdac5f6c640 1 Processor -- start 2023-12-12T09:44:42.515 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:42.514+0000 7fdac5f6c640 1 -- start start 2023-12-12T09:44:42.516 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:42.515+0000 7fdac5f6c640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fdac00a9470 0x7fdac00aae00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:42.517 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:42.515+0000 7fdac5f6c640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdac0153300 con 0x7fdac00ab340 2023-12-12T09:44:42.517 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:42.515+0000 7fdac5f6c640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdac00c2160 con 0x7fdac014fbb0 2023-12-12T09:44:42.517 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:42.515+0000 7fdac5f6c640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdac00aa000 con 0x7fdac00a9470 2023-12-12T09:44:42.517 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:42.516+0000 7fdabffff640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fdac00a9470 0x7fdac00aae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:42.517 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:42.516+0000 7fdac576b640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7fdac00ab340 0x7fdac015cbf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:44436/0 (socket says 172.21.15.73:44436) 2023-12-12T09:44:42.517 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:42.516+0000 7fdac576b640 1 -- 172.21.15.73:0/723697276 learned_addr learned my addr 172.21.15.73:0/723697276 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-12T09:44:42.518 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:42.516+0000 7fdabf7fe640 1 -- 172.21.15.73:0/723697276 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2177044105 0 0) 0x7fdac0153300 con 0x7fdac00ab340 2023-12-12T09:44:42.518 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:42.516+0000 7fdabf7fe640 1 -- 172.21.15.73:0/723697276 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdab0003520 con 0x7fdac00ab340 2023-12-12T09:44:42.518 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:42.516+0000 7fdabffff640 1 -- 172.21.15.73:0/723697276 >> v1:172.21.15.142:6789/0 conn(0x7fdac014fbb0 legacy=0x7fdac00c09e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:44:42.518 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:42.516+0000 7fdabffff640 1 -- 172.21.15.73:0/723697276 >> v1:172.21.15.73:6789/0 conn(0x7fdac00ab340 legacy=0x7fdac015cbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:42.518 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:42.516+0000 7fdabffff640 1 -- 172.21.15.73:0/723697276 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdac0153020 con 0x7fdac00a9470 2023-12-12T09:44:42.518 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:42.517+0000 7fdabffff640 1 --2- 172.21.15.73:0/723697276 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdac00a9470 0x7fdac00aae00 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fdaac0097a0 tx=0x7fdaac02b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6106eb509696743 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:44:42.519 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:42.518+0000 7fdabf7fe640 1 -- 172.21.15.73:0/723697276 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdaac02e070 con 0x7fdac00a9470 2023-12-12T09:44:42.519 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:42.518+0000 7fdabf7fe640 1 -- 172.21.15.73:0/723697276 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdaac0315a0 con 0x7fdac00a9470 2023-12-12T09:44:42.519 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:42.518+0000 7fdabf7fe640 1 -- 172.21.15.73:0/723697276 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdaac031930 con 0x7fdac00a9470 2023-12-12T09:44:42.520 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:42.518+0000 7fdac5f6c640 1 -- 172.21.15.73:0/723697276 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdac00a9470 msgr2=0x7fdac00aae00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:42.520 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:42.518+0000 7fdac5f6c640 1 --2- 172.21.15.73:0/723697276 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdac00a9470 0x7fdac00aae00 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fdaac0097a0 tx=0x7fdaac02b840 comp rx=0 tx=0).stop 2023-12-12T09:44:42.520 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:42.518+0000 7fdac5f6c640 1 -- 172.21.15.73:0/723697276 shutdown_connections 2023-12-12T09:44:42.520 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:42.518+0000 7fdac5f6c640 1 --2- 172.21.15.73:0/723697276 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdac00a9470 0x7fdac00aae00 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:42.520 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:42.518+0000 7fdac5f6c640 1 -- 172.21.15.73:0/723697276 >> 172.21.15.73:0/723697276 conn(0x7fdac00c23b0 msgr2=0x7fdac00c2790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:44:42.520 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:42.518+0000 7fdac5f6c640 1 -- 172.21.15.73:0/723697276 shutdown_connections 2023-12-12T09:44:42.520 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:42.518+0000 7fdac5f6c640 1 -- 172.21.15.73:0/723697276 wait complete. 2023-12-12T09:44:42.521 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:42.520+0000 7fdac5f6c640 1 Processor -- start 2023-12-12T09:44:42.521 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:42.520+0000 7fdac5f6c640 1 -- start start 2023-12-12T09:44:42.523 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:42.521+0000 7fdac5f6c640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdac00a9470 0x7fdac0151fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:42.523 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:42.521+0000 7fdac5f6c640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdac00ab340 0x7fdac01ed570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:42.523 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:42.521+0000 7fdac5f6c640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdac014fbb0 0x7fdac006f9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:42.523 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:42.521+0000 7fdac5f6c640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdac00c1d40 con 0x7fdac00ab340 2023-12-12T09:44:42.524 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:42.521+0000 7fdac5f6c640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdac01ece70 con 0x7fdac00a9470 2023-12-12T09:44:42.524 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:42.521+0000 7fdac5f6c640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdac01ed0e0 con 0x7fdac014fbb0 2023-12-12T09:44:42.524 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:42.521+0000 7fdabffff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdac00ab340 0x7fdac01ed570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:42.524 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:42.521+0000 7fdabffff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdac00ab340 0x7fdac01ed570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:52756/0 (socket says 172.21.15.73:52756) 2023-12-12T09:44:42.524 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:42.521+0000 7fdabffff640 1 -- 172.21.15.73:0/1985273305 learned_addr learned my addr 172.21.15.73:0/1985273305 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:44:42.524 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:42.522+0000 7fdac4f6a640 1 --2- 172.21.15.73:0/1985273305 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdac00a9470 0x7fdac0151fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:42.524 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:42.522+0000 7fdabffff640 1 -- 172.21.15.73:0/1985273305 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdac014fbb0 msgr2=0x7fdac006f9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:42.524 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:42.522+0000 7fdabffff640 1 --2- 172.21.15.73:0/1985273305 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdac014fbb0 0x7fdac006f9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:42.524 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:42.522+0000 7fdabffff640 1 -- 172.21.15.73:0/1985273305 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdac00a9470 msgr2=0x7fdac0151fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:42.524 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:42.522+0000 7fdabffff640 1 --2- 172.21.15.73:0/1985273305 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdac00a9470 0x7fdac0151fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:42.524 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:42.522+0000 7fdabffff640 1 -- 172.21.15.73:0/1985273305 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdaac009400 con 0x7fdac00ab340 2023-12-12T09:44:42.524 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:42.522+0000 7fdac4f6a640 1 --2- 172.21.15.73:0/1985273305 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdac00a9470 0x7fdac0151fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:44:42.525 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:42.522+0000 7fdabffff640 1 --2- 172.21.15.73:0/1985273305 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdac00ab340 0x7fdac01ed570 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fdaac034040 tx=0x7fdaac0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:44:42.525 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:42.522+0000 7fdabd7fa640 1 -- 172.21.15.73:0/1985273305 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdaac032840 con 0x7fdac00ab340 2023-12-12T09:44:42.525 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:42.522+0000 7fdabd7fa640 1 -- 172.21.15.73:0/1985273305 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdaac0329c0 con 0x7fdac00ab340 2023-12-12T09:44:42.525 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:42.523+0000 7fdabd7fa640 1 -- 172.21.15.73:0/1985273305 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdaac032d70 con 0x7fdac00ab340 2023-12-12T09:44:42.526 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:42.523+0000 7fdac5f6c640 1 -- 172.21.15.73:0/1985273305 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdac00a51e0 con 0x7fdac00ab340 2023-12-12T09:44:42.526 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:42.523+0000 7fdac5f6c640 1 -- 172.21.15.73:0/1985273305 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdac0072300 con 0x7fdac00ab340 2023-12-12T09:44:42.526 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:42.524+0000 7fdac5f6c640 1 -- 172.21.15.73:0/1985273305 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdac01ed250 con 0x7fdac00ab340 2023-12-12T09:44:42.526 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:42.525+0000 7fdabd7fa640 1 -- 172.21.15.73:0/1985273305 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fdaac04d3f0 con 0x7fdac00ab340 2023-12-12T09:44:42.527 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:42.526+0000 7fdabd7fa640 1 --2- 172.21.15.73:0/1985273305 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fdaa406ae40 0x7fdaa406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:42.527 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:42.526+0000 7fdabd7fa640 1 -- 172.21.15.73:0/1985273305 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fdaac0ab4c0 con 0x7fdac00ab340 2023-12-12T09:44:42.527 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:42.526+0000 7fdac4f6a640 1 --2- 172.21.15.73:0/1985273305 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fdaa406ae40 0x7fdaa406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:42.527 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:42.527+0000 7fdac4f6a640 1 --2- 172.21.15.73:0/1985273305 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fdaa406ae40 0x7fdaa406d300 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fdac00c65c0 tx=0x7fdab4009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:44:42.532 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:42.531+0000 7fdabd7fa640 1 -- 172.21.15.73:0/1985273305 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fdaac076200 con 0x7fdac00ab340 2023-12-12T09:44:42.720 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:42.719+0000 7fdac5f6c640 1 -- 172.21.15.73:0/1985273305 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fdac0067400 con 0x7fdac00ab340 2023-12-12T09:44:42.722 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:42.721+0000 7fdabd7fa640 1 -- 172.21.15.73:0/1985273305 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v38) v1 ==== 74+0+20241 (secure 0 0 0) 0x7fdaac079820 con 0x7fdac00ab340 2023-12-12T09:44:42.723 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-12T09:44:42.723 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":38,"fsid":"ba240992-02b8-4c7e-92f2-27eb29ac433b","created":"2023-12-12T09:43:02.454719+0000","modified":"2023-12-12T09:44:37.659373+0000","last_up_change":"2023-12-12T09:43:13.913440+0000","last_in_change":"2023-12-12T09:43:05.925348+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-12T09:43:15.525508+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-12-12T09:44:18.641446+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-12-12T09:44:19.952405+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs2_metadata","create_time":"2023-12-12T09:44:34.424645+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs2_data","create_time":"2023-12-12T09:44:35.090149+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"dd9074be-dbe2-4c34-9896-a4223d8d3940","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":4047810203},{"type":"v1","addr":"172.21.15.73:6801","nonce":4047810203}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":4047810203},{"type":"v1","addr":"172.21.15.73:6803","nonce":4047810203}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":4047810203},{"type":"v1","addr":"172.21.15.73:6807","nonce":4047810203}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":4047810203},{"type":"v1","addr":"172.21.15.73:6805","nonce":4047810203}]},"public_addr":"172.21.15.73:6801/4047810203","cluster_addr":"172.21.15.73:6803/4047810203","heartbeat_back_addr":"172.21.15.73:6807/4047810203","heartbeat_front_addr":"172.21.15.73:6805/4047810203","state":["exists","up"]},{"osd":1,"uuid":"c4a05052-96d4-4758-a4e1-1a37f1e07fed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":1356058331},{"type":"v1","addr":"172.21.15.73:6824","nonce":1356058331}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":1356058331},{"type":"v1","addr":"172.21.15.73:6827","nonce":1356058331}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":1356058331},{"type":"v1","addr":"172.21.15.73:6831","nonce":1356058331}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":1356058331},{"type":"v1","addr":"172.21.15.73:6829","nonce":1356058331}]},"public_addr":"172.21.15.73:6824/1356058331","cluster_addr":"172.21.15.73:6827/1356058331","heartbeat_back_addr":"172.21.15.73:6831/1356058331","heartbeat_front_addr":"172.21.15.73:6829/1356058331","state":["exists","up"]},{"osd":2,"uuid":"512bc8ac-72c2-40d4-b3d2-d867a92c5213","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":1228903316},{"type":"v1","addr":"172.21.15.73:6817","nonce":1228903316}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":1228903316},{"type":"v1","addr":"172.21.15.73:6819","nonce":1228903316}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6823","nonce":1228903316},{"type":"v1","addr":"172.21.15.73:6825","nonce":1228903316}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":1228903316},{"type":"v1","addr":"172.21.15.73:6821","nonce":1228903316}]},"public_addr":"172.21.15.73:6817/1228903316","cluster_addr":"172.21.15.73:6819/1228903316","heartbeat_back_addr":"172.21.15.73:6825/1228903316","heartbeat_front_addr":"172.21.15.73:6821/1228903316","state":["exists","up"]},{"osd":3,"uuid":"3d1a91e0-42bf-437a-8eae-8d357c8f63a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":1293329670},{"type":"v1","addr":"172.21.15.73:6809","nonce":1293329670}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6810","nonce":1293329670},{"type":"v1","addr":"172.21.15.73:6811","nonce":1293329670}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":1293329670},{"type":"v1","addr":"172.21.15.73:6815","nonce":1293329670}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":1293329670},{"type":"v1","addr":"172.21.15.73:6813","nonce":1293329670}]},"public_addr":"172.21.15.73:6809/1293329670","cluster_addr":"172.21.15.73:6811/1293329670","heartbeat_back_addr":"172.21.15.73:6815/1293329670","heartbeat_front_addr":"172.21.15.73:6813/1293329670","state":["exists","up"]},{"osd":4,"uuid":"4b302fff-834c-4069-ac19-00e46f6c87b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":3727975702},{"type":"v1","addr":"172.21.15.142:6801","nonce":3727975702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":3727975702},{"type":"v1","addr":"172.21.15.142:6803","nonce":3727975702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6809","nonce":3727975702},{"type":"v1","addr":"172.21.15.142:6811","nonce":3727975702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6805","nonce":3727975702},{"type":"v1","addr":"172.21.15.142:6807","nonce":3727975702}]},"public_addr":"172.21.15.142:6801/3727975702","cluster_addr":"172.21.15.142:6803/3727975702","heartbeat_back_addr":"172.21.15.142:6811/3727975702","heartbeat_front_addr":"172.21.15.142:6807/3727975702","state":["exists","up"]},{"osd":5,"uuid":"d7cdace2-67d0-45cc-95f2-515cf6ef1b82","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6817","nonce":2353193632},{"type":"v1","addr":"172.21.15.142:6819","nonce":2353193632}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6821","nonce":2353193632},{"type":"v1","addr":"172.21.15.142:6823","nonce":2353193632}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6829","nonce":2353193632},{"type":"v1","addr":"172.21.15.142:6831","nonce":2353193632}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6825","nonce":2353193632},{"type":"v1","addr":"172.21.15.142:6827","nonce":2353193632}]},"public_addr":"172.21.15.142:6819/2353193632","cluster_addr":"172.21.15.142:6823/2353193632","heartbeat_back_addr":"172.21.15.142:6831/2353193632","heartbeat_front_addr":"172.21.15.142:6827/2353193632","state":["exists","up"]},{"osd":6,"uuid":"649ce78a-5626-445c-aedc-a651ed05a6f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":2006111986},{"type":"v1","addr":"172.21.15.142:6806","nonce":2006111986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":2006111986},{"type":"v1","addr":"172.21.15.142:6810","nonce":2006111986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":2006111986},{"type":"v1","addr":"172.21.15.142:6815","nonce":2006111986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":2006111986},{"type":"v1","addr":"172.21.15.142:6813","nonce":2006111986}]},"public_addr":"172.21.15.142:6806/2006111986","cluster_addr":"172.21.15.142:6810/2006111986","heartbeat_back_addr":"172.21.15.142:6815/2006111986","heartbeat_front_addr":"172.21.15.142:6813/2006111986","state":["exists","up"]},{"osd":7,"uuid":"af15ae3b-c1d0-4acf-92db-8a1805494d13","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":2573794341},{"type":"v1","addr":"172.21.15.142:6818","nonce":2573794341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":2573794341},{"type":"v1","addr":"172.21.15.142:6822","nonce":2573794341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":2573794341},{"type":"v1","addr":"172.21.15.142:6830","nonce":2573794341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":2573794341},{"type":"v1","addr":"172.21.15.142:6826","nonce":2573794341}]},"public_addr":"172.21.15.142:6818/2573794341","cluster_addr":"172.21.15.142:6822/2573794341","heartbeat_back_addr":"172.21.15.142:6830/2573794341","heartbeat_front_addr":"172.21.15.142:6826/2573794341","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.185824+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.262103+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.225556+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:10.523459+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:10.706035+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.257339+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.301776+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.051960+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-12T09:44:42.725 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:42.724+0000 7fdac5f6c640 1 -- 172.21.15.73:0/1985273305 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fdaa406ae40 msgr2=0x7fdaa406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:42.726 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:42.724+0000 7fdac5f6c640 1 --2- 172.21.15.73:0/1985273305 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fdaa406ae40 0x7fdaa406d300 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fdac00c65c0 tx=0x7fdab4009040 comp rx=0 tx=0).stop 2023-12-12T09:44:42.726 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:42.724+0000 7fdac5f6c640 1 -- 172.21.15.73:0/1985273305 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdac00ab340 msgr2=0x7fdac01ed570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:42.726 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:42.724+0000 7fdac5f6c640 1 --2- 172.21.15.73:0/1985273305 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdac00ab340 0x7fdac01ed570 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fdaac034040 tx=0x7fdaac0046c0 comp rx=0 tx=0).stop 2023-12-12T09:44:42.726 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:42.724+0000 7fdac5f6c640 1 -- 172.21.15.73:0/1985273305 shutdown_connections 2023-12-12T09:44:42.726 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:42.724+0000 7fdac5f6c640 1 --2- 172.21.15.73:0/1985273305 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fdaa406ae40 0x7fdaa406d300 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:42.726 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:42.724+0000 7fdac5f6c640 1 --2- 172.21.15.73:0/1985273305 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdac014fbb0 0x7fdac006f9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:42.726 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:42.724+0000 7fdac5f6c640 1 --2- 172.21.15.73:0/1985273305 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdac00ab340 0x7fdac01ed570 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:42.726 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:42.724+0000 7fdac5f6c640 1 --2- 172.21.15.73:0/1985273305 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdac00a9470 0x7fdac0151fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:42.726 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:42.724+0000 7fdac5f6c640 1 -- 172.21.15.73:0/1985273305 >> 172.21.15.73:0/1985273305 conn(0x7fdac00c23b0 msgr2=0x7fdac00a6880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:44:42.726 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:42.724+0000 7fdac5f6c640 1 -- 172.21.15.73:0/1985273305 shutdown_connections 2023-12-12T09:44:42.726 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:42.724+0000 7fdac5f6c640 1 -- 172.21.15.73:0/1985273305 wait complete. 2023-12-12T09:44:42.744 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-12T09:43:15.525508+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-12T09:44:18.641446+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '33', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data', 'create_time': '2023-12-12T09:44:19.952405+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '34', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs2_metadata', 'create_time': '2023-12-12T09:44:34.424645+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '37', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs2'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'cephfs2_data', 'create_time': '2023-12-12T09:44:35.090149+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '38', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs2'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-12T09:44:42.745 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-12T09:44:42.954 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:42.953+0000 7f1ef1aea640 1 Processor -- start 2023-12-12T09:44:42.954 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:42.953+0000 7f1ef1aea640 1 -- start start 2023-12-12T09:44:42.956 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:42.955+0000 7f1ef1aea640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1eec1518c0 0x7f1eec0a4d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:42.956 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:42.955+0000 7f1ef1aea640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1eec0bf800 con 0x7f1eec154d50 2023-12-12T09:44:42.956 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:42.955+0000 7f1ef1aea640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1eec0bfae0 con 0x7f1eec06c850 2023-12-12T09:44:42.956 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:42.955+0000 7f1ef1aea640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1eec157a60 con 0x7f1eec1518c0 2023-12-12T09:44:42.956 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:42.955+0000 7f1eebfff640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f1eec154d50 0x7f1eec0bec00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:44446/0 (socket says 172.21.15.73:44446) 2023-12-12T09:44:42.956 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:42.955+0000 7f1eebfff640 1 -- 172.21.15.73:0/4219106564 learned_addr learned my addr 172.21.15.73:0/4219106564 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-12T09:44:42.958 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:42.956+0000 7f1ef0ae8640 1 --2- 172.21.15.73:0/4219106564 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1eec1518c0 0x7f1eec0a4d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:42.959 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:42.956+0000 7f1eeb7fe640 1 -- 172.21.15.73:0/4219106564 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2017827246 0 0) 0x7f1eec0bf800 con 0x7f1eec154d50 2023-12-12T09:44:42.959 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:42.956+0000 7f1eeb7fe640 1 -- 172.21.15.73:0/4219106564 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1edc003520 con 0x7f1eec154d50 2023-12-12T09:44:42.959 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:42.956+0000 7f1eeb7fe640 1 -- 172.21.15.73:0/4219106564 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 150281567 0 0) 0x7f1edc003520 con 0x7f1eec154d50 2023-12-12T09:44:42.959 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:42.956+0000 7f1eeb7fe640 1 -- 172.21.15.73:0/4219106564 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1eec1518c0 msgr2=0x7f1eec0a4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:44:42.959 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:42.956+0000 7f1eeb7fe640 1 --2- 172.21.15.73:0/4219106564 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1eec1518c0 0x7f1eec0a4d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:42.959 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:42.956+0000 7f1eeb7fe640 1 -- 172.21.15.73:0/4219106564 >> v1:172.21.15.142:6789/0 conn(0x7f1eec06c850 legacy=0x7f1eec157f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:42.959 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:42.956+0000 7f1eeb7fe640 1 -- 172.21.15.73:0/4219106564 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1eec151ca0 con 0x7f1eec154d50 2023-12-12T09:44:42.959 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:42.956+0000 7f1eeb7fe640 1 -- 172.21.15.73:0/4219106564 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3186547832 0 0) 0x7f1ed8001670 con 0x7f1eec154d50 2023-12-12T09:44:42.959 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:42.956+0000 7f1eeb7fe640 1 -- 172.21.15.73:0/4219106564 >> v1:172.21.15.73:6789/0 conn(0x7f1eec154d50 legacy=0x7f1eec0bec00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:42.959 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:42.956+0000 7f1eeb7fe640 1 --2- 172.21.15.73:0/4219106564 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1eec1518c0 0x7f1edc0039a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:42.959 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:42.956+0000 7f1eeb7fe640 1 --2- 172.21.15.73:0/4219106564 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1edc003f20 0x7f1edc0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:42.960 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:42.956+0000 7f1eeb7fe640 1 --2- 172.21.15.73:0/4219106564 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1edc004d00 0x7f1edc005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:42.960 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:42.956+0000 7f1eeb7fe640 1 -- 172.21.15.73:0/4219106564 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1eec157a60 con 0x7f1edc004d00 2023-12-12T09:44:42.960 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:42.956+0000 7f1eeb7fe640 1 -- 172.21.15.73:0/4219106564 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1edc00ba60 con 0x7f1edc003f20 2023-12-12T09:44:42.960 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:42.956+0000 7f1eeb7fe640 1 -- 172.21.15.73:0/4219106564 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1edc00bc20 con 0x7f1eec1518c0 2023-12-12T09:44:42.960 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:42.957+0000 7f1ef12e9640 1 --2- 172.21.15.73:0/4219106564 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1edc004d00 0x7f1edc005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:42.960 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:42.957+0000 7f1eebfff640 1 --2- 172.21.15.73:0/4219106564 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1edc003f20 0x7f1edc0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:42.960 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:42.957+0000 7f1ef0ae8640 1 --2- 172.21.15.73:0/4219106564 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1eec1518c0 0x7f1edc0039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:42.960 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:42.957+0000 7f1ef12e9640 1 -- 172.21.15.73:0/4219106564 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1eec1518c0 msgr2=0x7f1edc0039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:44:42.960 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:42.957+0000 7f1ef12e9640 1 --2- 172.21.15.73:0/4219106564 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1eec1518c0 0x7f1edc0039a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:42.960 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:42.957+0000 7f1ef12e9640 1 -- 172.21.15.73:0/4219106564 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1edc003f20 msgr2=0x7f1edc0047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:44:42.960 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:42.957+0000 7f1ef12e9640 1 --2- 172.21.15.73:0/4219106564 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1edc003f20 0x7f1edc0047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:42.960 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:42.957+0000 7f1ef12e9640 1 -- 172.21.15.73:0/4219106564 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1edc003520 con 0x7f1edc004d00 2023-12-12T09:44:42.960 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:42.957+0000 7f1ef0ae8640 1 --2- 172.21.15.73:0/4219106564 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1eec1518c0 0x7f1edc0039a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:44:42.962 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:42.958+0000 7f1ef12e9640 1 --2- 172.21.15.73:0/4219106564 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1edc004d00 0x7f1edc005180 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f1ee4001e50 tx=0x7f1edc0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed6bb267bd704e16 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:44:42.962 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:42.958+0000 7f1eeb7fe640 1 -- 172.21.15.73:0/4219106564 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ee4003b70 con 0x7f1edc004d00 2023-12-12T09:44:42.962 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:42.958+0000 7f1eeb7fe640 1 -- 172.21.15.73:0/4219106564 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ee4003cd0 con 0x7f1edc004d00 2023-12-12T09:44:42.962 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:42.958+0000 7f1eeb7fe640 1 -- 172.21.15.73:0/4219106564 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ee4005310 con 0x7f1edc004d00 2023-12-12T09:44:42.962 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:42.959+0000 7f1ef1aea640 1 -- 172.21.15.73:0/4219106564 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1edc004d00 msgr2=0x7f1edc005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:42.962 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:42.959+0000 7f1ef1aea640 1 --2- 172.21.15.73:0/4219106564 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1edc004d00 0x7f1edc005180 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f1ee4001e50 tx=0x7f1edc0057f0 comp rx=0 tx=0).stop 2023-12-12T09:44:42.962 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:42.959+0000 7f1ef12e9640 1 -- 172.21.15.73:0/4219106564 reap_dead start 2023-12-12T09:44:42.962 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:42.959+0000 7f1ef1aea640 1 -- 172.21.15.73:0/4219106564 shutdown_connections 2023-12-12T09:44:42.962 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:42.959+0000 7f1ef1aea640 1 -- 172.21.15.73:0/4219106564 >> 172.21.15.73:0/4219106564 conn(0x7f1eec06a4e0 msgr2=0x7f1eec06a8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:44:42.962 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:42.959+0000 7f1ef1aea640 1 -- 172.21.15.73:0/4219106564 shutdown_connections 2023-12-12T09:44:42.963 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:42.959+0000 7f1ef1aea640 1 -- 172.21.15.73:0/4219106564 wait complete. 2023-12-12T09:44:42.963 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:42.961+0000 7f1ef1aea640 1 Processor -- start 2023-12-12T09:44:42.963 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:42.961+0000 7f1ef1aea640 1 -- start start 2023-12-12T09:44:42.967 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:42.962+0000 7f1ef1aea640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1edc004d00 0x7f1eec157dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:42.967 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:42.962+0000 7f1ef1aea640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1eec157350 0x7f1eec071b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:42.967 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:42.962+0000 7f1ef1aea640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1eec158310 0x7f1eec0720b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:42.967 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:42.962+0000 7f1ef1aea640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1eec0725f0 con 0x7f1edc004d00 2023-12-12T09:44:42.967 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:42.962+0000 7f1ef1aea640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1eec0ab060 con 0x7f1eec157350 2023-12-12T09:44:42.968 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:42.962+0000 7f1ef1aea640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1eec14dcb0 con 0x7f1eec158310 2023-12-12T09:44:42.968 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:42.962+0000 7f1ef0ae8640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1edc004d00 0x7f1eec157dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:42.968 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:42.962+0000 7f1ef0ae8640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1edc004d00 0x7f1eec157dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:52770/0 (socket says 172.21.15.73:52770) 2023-12-12T09:44:42.968 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:42.962+0000 7f1ef0ae8640 1 -- 172.21.15.73:0/3434117800 learned_addr learned my addr 172.21.15.73:0/3434117800 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:44:42.968 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:42.962+0000 7f1ef0ae8640 1 -- 172.21.15.73:0/3434117800 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1eec158310 msgr2=0x7f1eec0720b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:42.968 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:42.962+0000 7f1ef0ae8640 1 --2- 172.21.15.73:0/3434117800 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1eec158310 0x7f1eec0720b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:42.968 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:42.962+0000 7f1ef0ae8640 1 -- 172.21.15.73:0/3434117800 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1eec157350 msgr2=0x7f1eec071b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:42.968 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:42.962+0000 7f1ef0ae8640 1 --2- 172.21.15.73:0/3434117800 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1eec157350 0x7f1eec071b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:42.968 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:42.962+0000 7f1ef0ae8640 1 -- 172.21.15.73:0/3434117800 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1eec14df90 con 0x7f1edc004d00 2023-12-12T09:44:42.968 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:42.962+0000 7f1ef0ae8640 1 --2- 172.21.15.73:0/3434117800 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1edc004d00 0x7f1eec157dd0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f1ee00108e0 tx=0x7f1ee0010da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:44:42.969 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:42.963+0000 7f1ee97fa640 1 -- 172.21.15.73:0/3434117800 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ee000eba0 con 0x7f1edc004d00 2023-12-12T09:44:42.969 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:42.963+0000 7f1ee97fa640 1 -- 172.21.15.73:0/3434117800 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ee000ed00 con 0x7f1edc004d00 2023-12-12T09:44:42.969 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:42.963+0000 7f1ef1aea640 1 -- 172.21.15.73:0/3434117800 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1eec14e270 con 0x7f1edc004d00 2023-12-12T09:44:42.969 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:42.963+0000 7f1ee97fa640 1 -- 172.21.15.73:0/3434117800 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ee001c600 con 0x7f1edc004d00 2023-12-12T09:44:42.969 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:42.963+0000 7f1ef1aea640 1 -- 172.21.15.73:0/3434117800 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1eec14e830 con 0x7f1edc004d00 2023-12-12T09:44:42.969 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:42.964+0000 7f1ef1aea640 1 -- 172.21.15.73:0/3434117800 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1eec067400 con 0x7f1edc004d00 2023-12-12T09:44:42.969 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:42.965+0000 7f1ee97fa640 1 -- 172.21.15.73:0/3434117800 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f1ee001c760 con 0x7f1edc004d00 2023-12-12T09:44:42.969 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:42.966+0000 7f1ee97fa640 1 --2- 172.21.15.73:0/3434117800 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f1ed006ae40 0x7f1ed006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:42.969 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:42.966+0000 7f1ee97fa640 1 -- 172.21.15.73:0/3434117800 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f1ee008a0f0 con 0x7f1edc004d00 2023-12-12T09:44:42.969 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:42.966+0000 7f1eebfff640 1 --2- 172.21.15.73:0/3434117800 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f1ed006ae40 0x7f1ed006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:42.970 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:42.966+0000 7f1eebfff640 1 --2- 172.21.15.73:0/3434117800 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f1ed006ae40 0x7f1ed006d300 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f1ed8001eb0 tx=0x7f1ed8001d60 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:44:42.971 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:42.970+0000 7f1ee97fa640 1 -- 172.21.15.73:0/3434117800 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f1ee0054da0 con 0x7f1edc004d00 2023-12-12T09:44:43.161 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:43.160+0000 7f1ef1aea640 1 -- 172.21.15.73:0/3434117800 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f1eec0c46e0 con 0x7f1edc004d00 2023-12-12T09:44:43.162 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:43.161+0000 7f1ee97fa640 1 -- 172.21.15.73:0/3434117800 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v38) v1 ==== 93+0+10 (secure 0 0 0) 0x7f1ee00583c0 con 0x7f1edc004d00 2023-12-12T09:44:43.162 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 1 2023-12-12T09:44:43.165 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:43.163+0000 7f1ef1aea640 1 -- 172.21.15.73:0/3434117800 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f1ed006ae40 msgr2=0x7f1ed006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:43.165 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:43.163+0000 7f1ef1aea640 1 --2- 172.21.15.73:0/3434117800 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f1ed006ae40 0x7f1ed006d300 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f1ed8001eb0 tx=0x7f1ed8001d60 comp rx=0 tx=0).stop 2023-12-12T09:44:43.165 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:43.163+0000 7f1ef1aea640 1 -- 172.21.15.73:0/3434117800 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1edc004d00 msgr2=0x7f1eec157dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:43.165 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:43.163+0000 7f1ef1aea640 1 --2- 172.21.15.73:0/3434117800 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1edc004d00 0x7f1eec157dd0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f1ee00108e0 tx=0x7f1ee0010da0 comp rx=0 tx=0).stop 2023-12-12T09:44:43.165 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:43.164+0000 7f1ef1aea640 1 -- 172.21.15.73:0/3434117800 shutdown_connections 2023-12-12T09:44:43.165 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:43.164+0000 7f1ef1aea640 1 --2- 172.21.15.73:0/3434117800 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f1ed006ae40 0x7f1ed006d300 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:43.165 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:43.164+0000 7f1ef1aea640 1 --2- 172.21.15.73:0/3434117800 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1eec158310 0x7f1eec0720b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:43.165 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:43.164+0000 7f1ef1aea640 1 --2- 172.21.15.73:0/3434117800 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1eec157350 0x7f1eec071b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:43.166 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:43.164+0000 7f1ef1aea640 1 --2- 172.21.15.73:0/3434117800 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1edc004d00 0x7f1eec157dd0 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:43.166 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:43.164+0000 7f1ef1aea640 1 -- 172.21.15.73:0/3434117800 >> 172.21.15.73:0/3434117800 conn(0x7f1eec06a4e0 msgr2=0x7f1eec0bec00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:44:43.166 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:43.164+0000 7f1ef1aea640 1 -- 172.21.15.73:0/3434117800 shutdown_connections 2023-12-12T09:44:43.166 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:43.164+0000 7f1ef1aea640 1 -- 172.21.15.73:0/3434117800 wait complete. 2023-12-12T09:44:43.182 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-12T09:44:43.400 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:43.399+0000 7f67903a9640 1 Processor -- start 2023-12-12T09:44:43.400 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:43.399+0000 7f67903a9640 1 -- start start 2023-12-12T09:44:43.401 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:43.400+0000 7f67903a9640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f67880a4f00 0x7f67880c38b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:43.402 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:43.400+0000 7f67903a9640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f678806b820 0x7f678814be60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:43.402 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:43.400+0000 7f67903a9640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f678806bf90 con 0x7f67880c3df0 2023-12-12T09:44:43.402 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:43.400+0000 7f67903a9640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f678806bcb0 con 0x7f678806b820 2023-12-12T09:44:43.402 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:43.400+0000 7f67903a9640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67881523e0 con 0x7f67880a4f00 2023-12-12T09:44:43.403 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:43.401+0000 7f678d944640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f678806b820 0x7f678814be60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:43.403 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:43.401+0000 7f678e946640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f67880c3df0 0x7f6788155830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:44460/0 (socket says 172.21.15.73:44460) 2023-12-12T09:44:43.403 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:43.401+0000 7f678e946640 1 -- 172.21.15.73:0/2994245576 learned_addr learned my addr 172.21.15.73:0/2994245576 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-12T09:44:43.403 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:43.401+0000 7f678e145640 1 --2- 172.21.15.73:0/2994245576 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f67880a4f00 0x7f67880c38b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:43.403 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:43.401+0000 7f678d944640 1 -- 172.21.15.73:0/2994245576 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f67880a4f00 msgr2=0x7f67880c38b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:44:43.403 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:43.401+0000 7f678d944640 1 --2- 172.21.15.73:0/2994245576 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f67880a4f00 0x7f67880c38b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:43.403 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:43.401+0000 7f678d944640 1 -- 172.21.15.73:0/2994245576 >> v1:172.21.15.73:6789/0 conn(0x7f67880c3df0 legacy=0x7f6788155830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:43.403 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:43.401+0000 7f678d143640 1 -- 172.21.15.73:0/2994245576 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3408725010 0 0) 0x7f678806bf90 con 0x7f67880c3df0 2023-12-12T09:44:43.403 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:43.402+0000 7f678d944640 1 -- 172.21.15.73:0/2994245576 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67881526c0 con 0x7f678806b820 2023-12-12T09:44:43.404 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:43.403+0000 7f678d944640 1 --2- 172.21.15.73:0/2994245576 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f678806b820 0x7f678814be60 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f67740097a0 tx=0x7f677402b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f9ffcd602a348c9 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:44:43.404 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:43.403+0000 7f678d143640 1 -- 172.21.15.73:0/2994245576 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f677402e070 con 0x7f678806b820 2023-12-12T09:44:43.404 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:43.403+0000 7f678d143640 1 -- 172.21.15.73:0/2994245576 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67740315a0 con 0x7f678806b820 2023-12-12T09:44:43.404 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:43.403+0000 7f678d143640 1 -- 172.21.15.73:0/2994245576 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6774031930 con 0x7f678806b820 2023-12-12T09:44:43.405 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:43.404+0000 7f67903a9640 1 -- 172.21.15.73:0/2994245576 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f678806b820 msgr2=0x7f678814be60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:43.405 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:43.404+0000 7f67903a9640 1 --2- 172.21.15.73:0/2994245576 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f678806b820 0x7f678814be60 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f67740097a0 tx=0x7f677402b840 comp rx=0 tx=0).stop 2023-12-12T09:44:43.405 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:43.404+0000 7f67903a9640 1 -- 172.21.15.73:0/2994245576 shutdown_connections 2023-12-12T09:44:43.405 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:43.404+0000 7f67903a9640 1 --2- 172.21.15.73:0/2994245576 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f678806b820 0x7f678814be60 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:43.405 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:43.404+0000 7f67903a9640 1 --2- 172.21.15.73:0/2994245576 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f67880a4f00 0x7f67880c38b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:43.405 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:43.404+0000 7f67903a9640 1 -- 172.21.15.73:0/2994245576 >> 172.21.15.73:0/2994245576 conn(0x7f678806a6c0 msgr2=0x7f678806aaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:44:43.405 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:43.404+0000 7f67903a9640 1 -- 172.21.15.73:0/2994245576 shutdown_connections 2023-12-12T09:44:43.405 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:43.404+0000 7f67903a9640 1 -- 172.21.15.73:0/2994245576 wait complete. 2023-12-12T09:44:43.406 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:43.405+0000 7f67903a9640 1 Processor -- start 2023-12-12T09:44:43.407 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:43.406+0000 7f67903a9640 1 -- start start 2023-12-12T09:44:43.409 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:43.406+0000 7f67903a9640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f67880a4f00 0x7f6788072070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:43.409 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:43.407+0000 7f67903a9640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f67880c3df0 0x7f67880a9990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:43.409 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:43.407+0000 7f67903a9640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f67880c1d60 0x7f67881ed540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:43.409 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:43.407+0000 7f67903a9640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6788154d30 con 0x7f67880c3df0 2023-12-12T09:44:43.409 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:43.407+0000 7f67903a9640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67881565f0 con 0x7f67880c1d60 2023-12-12T09:44:43.409 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:43.407+0000 7f67903a9640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67881ed0b0 con 0x7f67880a4f00 2023-12-12T09:44:43.409 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:43.407+0000 7f678d944640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f67880c3df0 0x7f67880a9990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:43.410 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:43.407+0000 7f678d944640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f67880c3df0 0x7f67880a9990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:52782/0 (socket says 172.21.15.73:52782) 2023-12-12T09:44:43.410 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:43.407+0000 7f678d944640 1 -- 172.21.15.73:0/3973817596 learned_addr learned my addr 172.21.15.73:0/3973817596 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:44:43.410 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:43.407+0000 7f678d944640 1 -- 172.21.15.73:0/3973817596 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f67880a4f00 msgr2=0x7f6788072070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:43.410 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:43.407+0000 7f678d944640 1 --2- 172.21.15.73:0/3973817596 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f67880a4f00 0x7f6788072070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:43.410 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:43.407+0000 7f678d944640 1 -- 172.21.15.73:0/3973817596 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f67880c1d60 msgr2=0x7f67881ed540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:43.410 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:43.407+0000 7f678d944640 1 --2- 172.21.15.73:0/3973817596 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f67880c1d60 0x7f67881ed540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:43.410 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:43.407+0000 7f678d944640 1 -- 172.21.15.73:0/3973817596 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6774009400 con 0x7f67880c3df0 2023-12-12T09:44:43.410 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:43.408+0000 7f678d944640 1 --2- 172.21.15.73:0/3973817596 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f67880c3df0 0x7f67880a9990 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f67740098c0 tx=0x7f67740046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:44:43.410 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:43.408+0000 7f6786ffd640 1 -- 172.21.15.73:0/3973817596 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6774004230 con 0x7f67880c3df0 2023-12-12T09:44:43.410 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:43.408+0000 7f6786ffd640 1 -- 172.21.15.73:0/3973817596 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6774031f00 con 0x7f67880c3df0 2023-12-12T09:44:43.410 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:43.408+0000 7f6786ffd640 1 -- 172.21.15.73:0/3973817596 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6774032640 con 0x7f67880c3df0 2023-12-12T09:44:43.410 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:43.408+0000 7f67903a9640 1 -- 172.21.15.73:0/3973817596 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6788154990 con 0x7f67880c3df0 2023-12-12T09:44:43.410 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:43.408+0000 7f67903a9640 1 -- 172.21.15.73:0/3973817596 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6788146b40 con 0x7f67880c3df0 2023-12-12T09:44:43.411 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:43.409+0000 7f67903a9640 1 -- 172.21.15.73:0/3973817596 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6788067470 con 0x7f67880c3df0 2023-12-12T09:44:43.411 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:43.410+0000 7f6786ffd640 1 -- 172.21.15.73:0/3973817596 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f67740327a0 con 0x7f67880c3df0 2023-12-12T09:44:43.412 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:43.411+0000 7f6786ffd640 1 --2- 172.21.15.73:0/3973817596 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f676c06ae40 0x7f676c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:43.412 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:43.411+0000 7f6786ffd640 1 -- 172.21.15.73:0/3973817596 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f67740aba40 con 0x7f67880c3df0 2023-12-12T09:44:43.412 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:43.411+0000 7f678e145640 1 --2- 172.21.15.73:0/3973817596 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f676c06ae40 0x7f676c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:43.412 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:43.412+0000 7f678e145640 1 --2- 172.21.15.73:0/3973817596 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f676c06ae40 0x7f676c06d300 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f677c0070b0 tx=0x7f677c007040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:44:43.416 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:43.415+0000 7f6786ffd640 1 -- 172.21.15.73:0/3973817596 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f6774076780 con 0x7f67880c3df0 2023-12-12T09:44:43.604 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:43.603+0000 7f67903a9640 1 -- 172.21.15.73:0/3973817596 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f67881ed1f0 con 0x7f67880c3df0 2023-12-12T09:44:43.604 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:43.603+0000 7f6786ffd640 1 -- 172.21.15.73:0/3973817596 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v38) v1 ==== 104+0+11 (secure 0 0 0) 0x7f6774079da0 con 0x7f67880c3df0 2023-12-12T09:44:43.605 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 32 2023-12-12T09:44:43.607 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:43.606+0000 7f67903a9640 1 -- 172.21.15.73:0/3973817596 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f676c06ae40 msgr2=0x7f676c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:43.607 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:43.606+0000 7f67903a9640 1 --2- 172.21.15.73:0/3973817596 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f676c06ae40 0x7f676c06d300 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f677c0070b0 tx=0x7f677c007040 comp rx=0 tx=0).stop 2023-12-12T09:44:43.607 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:43.606+0000 7f67903a9640 1 -- 172.21.15.73:0/3973817596 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f67880c3df0 msgr2=0x7f67880a9990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:43.607 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:43.606+0000 7f67903a9640 1 --2- 172.21.15.73:0/3973817596 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f67880c3df0 0x7f67880a9990 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f67740098c0 tx=0x7f67740046c0 comp rx=0 tx=0).stop 2023-12-12T09:44:43.608 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:43.606+0000 7f67903a9640 1 -- 172.21.15.73:0/3973817596 shutdown_connections 2023-12-12T09:44:43.608 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:43.606+0000 7f67903a9640 1 --2- 172.21.15.73:0/3973817596 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f676c06ae40 0x7f676c06d300 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:43.608 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:43.606+0000 7f67903a9640 1 --2- 172.21.15.73:0/3973817596 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f67880c1d60 0x7f67881ed540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:43.608 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:43.606+0000 7f67903a9640 1 --2- 172.21.15.73:0/3973817596 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f67880c3df0 0x7f67880a9990 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:43.608 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:43.606+0000 7f67903a9640 1 --2- 172.21.15.73:0/3973817596 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f67880a4f00 0x7f6788072070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:43.608 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:43.606+0000 7f67903a9640 1 -- 172.21.15.73:0/3973817596 >> 172.21.15.73:0/3973817596 conn(0x7f678806a6c0 msgr2=0x7f678806aaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:44:43.608 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:43.606+0000 7f67903a9640 1 -- 172.21.15.73:0/3973817596 shutdown_connections 2023-12-12T09:44:43.608 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:43.606+0000 7f67903a9640 1 -- 172.21.15.73:0/3973817596 wait complete. 2023-12-12T09:44:43.626 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-12T09:44:43.843 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:43.842+0000 7f1036aff640 1 Processor -- start 2023-12-12T09:44:43.844 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:43.842+0000 7f1036aff640 1 -- start start 2023-12-12T09:44:43.845 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:43.844+0000 7f1036aff640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f10300c6590 0x7f10300c6970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:43.845 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:43.844+0000 7f1036aff640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f10300c81e0 0x7f103006c0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:43.846 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:43.844+0000 7f1036aff640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f103006c630 con 0x7f1030154b40 2023-12-12T09:44:43.846 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:43.844+0000 7f1036aff640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1030154430 con 0x7f10300c6590 2023-12-12T09:44:43.846 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:43.844+0000 7f1036aff640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10300c4540 con 0x7f10300c81e0 2023-12-12T09:44:43.846 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:43.844+0000 7f1035afd640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f10300c6590 0x7f10300c6970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:43.846 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:43.844+0000 7f1035afd640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f10300c6590 0x7f10300c6970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:52796/0 (socket says 172.21.15.73:52796) 2023-12-12T09:44:43.846 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:43.844+0000 7f1035afd640 1 -- 172.21.15.73:0/2522481587 learned_addr learned my addr 172.21.15.73:0/2522481587 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:44:43.846 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:43.844+0000 7f10352fc640 1 --2- 172.21.15.73:0/2522481587 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f10300c81e0 0x7f103006c0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:43.846 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:43.844+0000 7f1035afd640 1 -- 172.21.15.73:0/2522481587 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f10300c81e0 msgr2=0x7f103006c0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:44:43.846 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:43.844+0000 7f1035afd640 1 --2- 172.21.15.73:0/2522481587 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f10300c81e0 0x7f103006c0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:43.846 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:43.844+0000 7f1035afd640 1 -- 172.21.15.73:0/2522481587 >> v1:172.21.15.142:6789/0 conn(0x7f1030154b40 legacy=0x7f10301579c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:44:43.846 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:43.845+0000 7f1035afd640 1 -- 172.21.15.73:0/2522481587 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10300c5030 con 0x7f10300c6590 2023-12-12T09:44:43.846 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:43.845+0000 7f10352fc640 1 --2- 172.21.15.73:0/2522481587 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f10300c81e0 0x7f103006c0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:44:43.847 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:43.846+0000 7f1035afd640 1 --2- 172.21.15.73:0/2522481587 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f10300c6590 0x7f10300c6970 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f102c009870 tx=0x7f102c02b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e72a6e8588f965e server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:44:43.847 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:43.846+0000 7f1034afb640 1 -- 172.21.15.73:0/2522481587 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f102c031640 con 0x7f10300c6590 2023-12-12T09:44:43.847 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:43.846+0000 7f1034afb640 1 -- 172.21.15.73:0/2522481587 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f102c0317a0 con 0x7f10300c6590 2023-12-12T09:44:43.847 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:43.846+0000 7f1034afb640 1 -- 172.21.15.73:0/2522481587 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f102c031b30 con 0x7f10300c6590 2023-12-12T09:44:43.848 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:43.846+0000 7f1036aff640 1 -- 172.21.15.73:0/2522481587 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f10300c6590 msgr2=0x7f10300c6970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:43.848 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:43.846+0000 7f1036aff640 1 --2- 172.21.15.73:0/2522481587 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f10300c6590 0x7f10300c6970 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f102c009870 tx=0x7f102c02b8f0 comp rx=0 tx=0).stop 2023-12-12T09:44:43.848 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:43.847+0000 7f1036aff640 1 -- 172.21.15.73:0/2522481587 shutdown_connections 2023-12-12T09:44:43.848 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:43.847+0000 7f1036aff640 1 --2- 172.21.15.73:0/2522481587 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f10300c81e0 0x7f103006c0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:43.848 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:43.847+0000 7f1036aff640 1 --2- 172.21.15.73:0/2522481587 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f10300c6590 0x7f10300c6970 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:43.848 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:43.847+0000 7f1036aff640 1 -- 172.21.15.73:0/2522481587 >> 172.21.15.73:0/2522481587 conn(0x7f10300ab770 msgr2=0x7f10300abb80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:44:43.848 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:43.847+0000 7f1036aff640 1 -- 172.21.15.73:0/2522481587 shutdown_connections 2023-12-12T09:44:43.848 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:43.847+0000 7f1036aff640 1 -- 172.21.15.73:0/2522481587 wait complete. 2023-12-12T09:44:43.849 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:43.848+0000 7f1036aff640 1 Processor -- start 2023-12-12T09:44:43.849 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:43.848+0000 7f1036aff640 1 -- start start 2023-12-12T09:44:43.852 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:43.849+0000 7f1036aff640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f10300c6590 0x7f10301ecef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:43.852 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:43.849+0000 7f1036aff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f10300c81e0 0x7f10301ed430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:43.852 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:43.849+0000 7f1036aff640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1030154b40 0x7f10300af060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:43.852 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:43.849+0000 7f1036aff640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1030157ed0 con 0x7f10300c81e0 2023-12-12T09:44:43.852 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:43.849+0000 7f1036aff640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10301ed970 con 0x7f10300c6590 2023-12-12T09:44:43.852 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:43.849+0000 7f1036aff640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10301eab80 con 0x7f1030154b40 2023-12-12T09:44:43.852 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:43.849+0000 7f10352fc640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f10300c81e0 0x7f10301ed430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:43.852 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:43.850+0000 7f10352fc640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f10300c81e0 0x7f10301ed430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:52802/0 (socket says 172.21.15.73:52802) 2023-12-12T09:44:43.852 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:43.850+0000 7f10352fc640 1 -- 172.21.15.73:0/2547964833 learned_addr learned my addr 172.21.15.73:0/2547964833 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:44:43.853 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:43.850+0000 7f10352fc640 1 -- 172.21.15.73:0/2547964833 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1030154b40 msgr2=0x7f10300af060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:43.853 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:43.850+0000 7f10352fc640 1 --2- 172.21.15.73:0/2547964833 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1030154b40 0x7f10300af060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:43.853 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:43.850+0000 7f10352fc640 1 -- 172.21.15.73:0/2547964833 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f10300c6590 msgr2=0x7f10301ecef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:43.853 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:43.850+0000 7f10352fc640 1 --2- 172.21.15.73:0/2547964833 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f10300c6590 0x7f10301ecef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:43.853 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:43.850+0000 7f10352fc640 1 -- 172.21.15.73:0/2547964833 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f102c0094d0 con 0x7f10300c81e0 2023-12-12T09:44:43.853 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:43.850+0000 7f10352fc640 1 --2- 172.21.15.73:0/2547964833 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f10300c81e0 0x7f10301ed430 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f102000c7f0 tx=0x7f102000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:44:43.853 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:43.850+0000 7f10267fc640 1 -- 172.21.15.73:0/2547964833 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f102000cea0 con 0x7f10300c81e0 2023-12-12T09:44:43.853 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:43.850+0000 7f10267fc640 1 -- 172.21.15.73:0/2547964833 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1020005b90 con 0x7f10300c81e0 2023-12-12T09:44:43.853 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:43.850+0000 7f10267fc640 1 -- 172.21.15.73:0/2547964833 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1020007830 con 0x7f10300c81e0 2023-12-12T09:44:43.853 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:43.850+0000 7f1036aff640 1 -- 172.21.15.73:0/2547964833 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10300c3ff0 con 0x7f10300c81e0 2023-12-12T09:44:43.853 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:43.851+0000 7f1036aff640 1 -- 172.21.15.73:0/2547964833 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f103014ec00 con 0x7f10300c81e0 2023-12-12T09:44:43.854 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:43.852+0000 7f1036aff640 1 -- 172.21.15.73:0/2547964833 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1030067400 con 0x7f10300c81e0 2023-12-12T09:44:43.854 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:43.852+0000 7f10267fc640 1 -- 172.21.15.73:0/2547964833 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f1020007990 con 0x7f10300c81e0 2023-12-12T09:44:43.855 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:43.854+0000 7f10267fc640 1 --2- 172.21.15.73:0/2547964833 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f101406ae40 0x7f101406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:43.855 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:43.854+0000 7f10267fc640 1 -- 172.21.15.73:0/2547964833 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f10200899a0 con 0x7f10300c81e0 2023-12-12T09:44:43.855 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:43.854+0000 7f1035afd640 1 --2- 172.21.15.73:0/2547964833 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f101406ae40 0x7f101406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:43.855 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:43.855+0000 7f1035afd640 1 --2- 172.21.15.73:0/2547964833 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f101406ae40 0x7f101406d300 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f102c036000 tx=0x7f102c030000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:44:43.859 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:43.858+0000 7f10267fc640 1 -- 172.21.15.73:0/2547964833 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f1020054650 con 0x7f10300c81e0 2023-12-12T09:44:44.051 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:44.049+0000 7f1036aff640 1 -- 172.21.15.73:0/2547964833 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f10300c73b0 con 0x7f10300c81e0 2023-12-12T09:44:44.052 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:44.050+0000 7f10267fc640 1 -- 172.21.15.73:0/2547964833 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v38) v1 ==== 100+0+11 (secure 0 0 0) 0x7f102001e0a0 con 0x7f10300c81e0 2023-12-12T09:44:44.052 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 64 2023-12-12T09:44:44.054 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:44.053+0000 7f1036aff640 1 -- 172.21.15.73:0/2547964833 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f101406ae40 msgr2=0x7f101406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:44.054 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:44.053+0000 7f1036aff640 1 --2- 172.21.15.73:0/2547964833 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f101406ae40 0x7f101406d300 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f102c036000 tx=0x7f102c030000 comp rx=0 tx=0).stop 2023-12-12T09:44:44.054 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:44.053+0000 7f1036aff640 1 -- 172.21.15.73:0/2547964833 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f10300c81e0 msgr2=0x7f10301ed430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:44.054 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:44.053+0000 7f1036aff640 1 --2- 172.21.15.73:0/2547964833 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f10300c81e0 0x7f10301ed430 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f102000c7f0 tx=0x7f102000ccb0 comp rx=0 tx=0).stop 2023-12-12T09:44:44.055 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:44.053+0000 7f1036aff640 1 -- 172.21.15.73:0/2547964833 shutdown_connections 2023-12-12T09:44:44.055 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:44.053+0000 7f1036aff640 1 --2- 172.21.15.73:0/2547964833 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f101406ae40 0x7f101406d300 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:44.055 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:44.053+0000 7f1036aff640 1 --2- 172.21.15.73:0/2547964833 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1030154b40 0x7f10300af060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:44.055 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:44.053+0000 7f1036aff640 1 --2- 172.21.15.73:0/2547964833 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f10300c81e0 0x7f10301ed430 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:44.055 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:44.053+0000 7f1036aff640 1 --2- 172.21.15.73:0/2547964833 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f10300c6590 0x7f10301ecef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:44.055 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:44.053+0000 7f1036aff640 1 -- 172.21.15.73:0/2547964833 >> 172.21.15.73:0/2547964833 conn(0x7f10300ab770 msgr2=0x7f10300c8630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:44:44.055 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:44.053+0000 7f1036aff640 1 -- 172.21.15.73:0/2547964833 shutdown_connections 2023-12-12T09:44:44.055 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:44.053+0000 7f1036aff640 1 -- 172.21.15.73:0/2547964833 wait complete. 2023-12-12T09:44:44.073 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_metadata pg_num 2023-12-12T09:44:44.277 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:44.276+0000 7fc9a9dbe640 1 Processor -- start 2023-12-12T09:44:44.277 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:44.276+0000 7fc9a9dbe640 1 -- start start 2023-12-12T09:44:44.279 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:44.278+0000 7fc9a9dbe640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc9a414f8c0 0x7fc9a406dc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:44.279 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:44.278+0000 7fc9a9dbe640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fc9a406d350 0x7fc9a4071e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:44.279 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:44.278+0000 7fc9a9dbe640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9a40c16c0 con 0x7fc9a40723a0 2023-12-12T09:44:44.279 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:44.278+0000 7fc9a9dbe640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9a40c1090 con 0x7fc9a406d350 2023-12-12T09:44:44.279 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:44.278+0000 7fc9a9dbe640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9a40c14b0 con 0x7fc9a414f8c0 2023-12-12T09:44:44.279 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:44.278+0000 7fc9a3fff640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7fc9a40723a0 0x7fc9a4152500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:44474/0 (socket says 172.21.15.73:44474) 2023-12-12T09:44:44.279 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:44.278+0000 7fc9a3fff640 1 -- 172.21.15.73:0/1541525041 learned_addr learned my addr 172.21.15.73:0/1541525041 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-12T09:44:44.281 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:44.278+0000 7fc9a37fe640 1 --2- 172.21.15.73:0/1541525041 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc9a414f8c0 0x7fc9a406dc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:44.281 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:44.278+0000 7fc9a2ffd640 1 --2- 172.21.15.73:0/1541525041 >> v2:172.21.15.142:3300/0 conn(0x7fc9a406d350 0x7fc9a4071e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:44.281 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:44.279+0000 7fc9a27fc640 1 -- 172.21.15.73:0/1541525041 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1324863641 0 0) 0x7fc9a40c16c0 con 0x7fc9a40723a0 2023-12-12T09:44:44.282 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:44.279+0000 7fc9a27fc640 1 -- 172.21.15.73:0/1541525041 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc98c003520 con 0x7fc9a40723a0 2023-12-12T09:44:44.282 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:44.279+0000 7fc9a27fc640 1 -- 172.21.15.73:0/1541525041 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2876582231 0 0) 0x7fc98c003520 con 0x7fc9a40723a0 2023-12-12T09:44:44.282 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:44.279+0000 7fc9a27fc640 1 -- 172.21.15.73:0/1541525041 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc9a414f8c0 msgr2=0x7fc9a406dc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:44:44.282 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:44.279+0000 7fc9a27fc640 1 --2- 172.21.15.73:0/1541525041 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc9a414f8c0 0x7fc9a406dc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:44.282 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:44.279+0000 7fc9a27fc640 1 -- 172.21.15.73:0/1541525041 >> v2:172.21.15.142:3300/0 conn(0x7fc9a406d350 msgr2=0x7fc9a4071e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:44:44.282 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:44.279+0000 7fc9a27fc640 1 --2- 172.21.15.73:0/1541525041 >> v2:172.21.15.142:3300/0 conn(0x7fc9a406d350 0x7fc9a4071e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:44.282 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:44.279+0000 7fc9a27fc640 1 -- 172.21.15.73:0/1541525041 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9a40c19a0 con 0x7fc9a40723a0 2023-12-12T09:44:44.282 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:44.279+0000 7fc9a27fc640 1 -- 172.21.15.73:0/1541525041 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3186547832 0 0) 0x7fc99c0019f0 con 0x7fc9a40723a0 2023-12-12T09:44:44.282 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:44.279+0000 7fc9a27fc640 1 -- 172.21.15.73:0/1541525041 >> v1:172.21.15.73:6789/0 conn(0x7fc9a40723a0 legacy=0x7fc9a4152500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:44.282 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:44.279+0000 7fc9a27fc640 1 --2- 172.21.15.73:0/1541525041 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc98c003970 0x7fc98c003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:44.282 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:44.279+0000 7fc9a27fc640 1 --2- 172.21.15.73:0/1541525041 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc98c0047c0 0x7fc98c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:44.282 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:44.279+0000 7fc9a27fc640 1 --2- 172.21.15.73:0/1541525041 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc9a414f8c0 0x7fc98c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:44.282 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:44.279+0000 7fc9a27fc640 1 -- 172.21.15.73:0/1541525041 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9a40c14b0 con 0x7fc98c0047c0 2023-12-12T09:44:44.282 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:44.279+0000 7fc9a27fc640 1 -- 172.21.15.73:0/1541525041 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc98c00b980 con 0x7fc98c003970 2023-12-12T09:44:44.283 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:44.279+0000 7fc9a27fc640 1 -- 172.21.15.73:0/1541525041 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc98c00bac0 con 0x7fc9a414f8c0 2023-12-12T09:44:44.283 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:44.279+0000 7fc9a2ffd640 1 --2- 172.21.15.73:0/1541525041 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc98c0047c0 0x7fc98c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:44.283 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:44.280+0000 7fc9a37fe640 1 --2- 172.21.15.73:0/1541525041 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc98c003970 0x7fc98c003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:44.283 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:44.280+0000 7fc9a3fff640 1 --2- 172.21.15.73:0/1541525041 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc9a414f8c0 0x7fc98c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:44.283 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:44.280+0000 7fc9a2ffd640 1 -- 172.21.15.73:0/1541525041 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc9a414f8c0 msgr2=0x7fc98c005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:44:44.283 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:44.280+0000 7fc9a2ffd640 1 --2- 172.21.15.73:0/1541525041 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc9a414f8c0 0x7fc98c005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:44.283 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:44.280+0000 7fc9a2ffd640 1 -- 172.21.15.73:0/1541525041 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc98c003970 msgr2=0x7fc98c003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:44:44.283 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:44.280+0000 7fc9a2ffd640 1 --2- 172.21.15.73:0/1541525041 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc98c003970 0x7fc98c003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:44.283 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:44.280+0000 7fc9a2ffd640 1 -- 172.21.15.73:0/1541525041 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc98c003520 con 0x7fc98c0047c0 2023-12-12T09:44:44.283 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:44.280+0000 7fc9a3fff640 1 --2- 172.21.15.73:0/1541525041 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc9a414f8c0 0x7fc98c005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:44:44.284 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:44.281+0000 7fc9a2ffd640 1 --2- 172.21.15.73:0/1541525041 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc98c0047c0 0x7fc98c004c40 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fc998009ac0 tx=0x7fc98c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad246ffbb1d911b server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:44:44.284 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:44.281+0000 7fc9a27fc640 1 -- 172.21.15.73:0/1541525041 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc99802c710 con 0x7fc98c0047c0 2023-12-12T09:44:44.285 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:44.281+0000 7fc9a27fc640 1 -- 172.21.15.73:0/1541525041 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc99802c870 con 0x7fc98c0047c0 2023-12-12T09:44:44.285 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:44.281+0000 7fc9a27fc640 1 -- 172.21.15.73:0/1541525041 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc99802cc00 con 0x7fc98c0047c0 2023-12-12T09:44:44.285 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:44.282+0000 7fc9a9dbe640 1 -- 172.21.15.73:0/1541525041 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc98c0047c0 msgr2=0x7fc98c004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:44.285 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:44.282+0000 7fc9a9dbe640 1 --2- 172.21.15.73:0/1541525041 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc98c0047c0 0x7fc98c004c40 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fc998009ac0 tx=0x7fc98c0057f0 comp rx=0 tx=0).stop 2023-12-12T09:44:44.285 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:44.282+0000 7fc9a3fff640 1 -- 172.21.15.73:0/1541525041 reap_dead start 2023-12-12T09:44:44.285 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:44.282+0000 7fc9a9dbe640 1 -- 172.21.15.73:0/1541525041 shutdown_connections 2023-12-12T09:44:44.285 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:44.282+0000 7fc9a9dbe640 1 -- 172.21.15.73:0/1541525041 >> 172.21.15.73:0/1541525041 conn(0x7fc9a406a4e0 msgr2=0x7fc9a406a8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:44:44.285 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:44.282+0000 7fc9a9dbe640 1 -- 172.21.15.73:0/1541525041 shutdown_connections 2023-12-12T09:44:44.285 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:44.282+0000 7fc9a9dbe640 1 -- 172.21.15.73:0/1541525041 wait complete. 2023-12-12T09:44:44.285 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:44.284+0000 7fc9a9dbe640 1 Processor -- start 2023-12-12T09:44:44.285 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:44.284+0000 7fc9a9dbe640 1 -- start start 2023-12-12T09:44:44.288 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:44.284+0000 7fc9a9dbe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc98c0047c0 0x7fc9a4071160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:44.289 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:44.284+0000 7fc9a9dbe640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc9a4151c50 0x7fc9a41ed3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:44.289 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:44.285+0000 7fc9a9dbe640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc9a40befc0 0x7fc9a40a5570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:44.289 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:44.285+0000 7fc9a9dbe640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9a40703d0 con 0x7fc98c0047c0 2023-12-12T09:44:44.289 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:44.285+0000 7fc9a9dbe640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9a40a5140 con 0x7fc9a4151c50 2023-12-12T09:44:44.290 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:44.285+0000 7fc9a9dbe640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9a40705e0 con 0x7fc9a40befc0 2023-12-12T09:44:44.290 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:44.285+0000 7fc9a37fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc98c0047c0 0x7fc9a4071160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:44.290 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:44.285+0000 7fc9a37fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc98c0047c0 0x7fc9a4071160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:52830/0 (socket says 172.21.15.73:52830) 2023-12-12T09:44:44.290 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:44.285+0000 7fc9a37fe640 1 -- 172.21.15.73:0/3790966123 learned_addr learned my addr 172.21.15.73:0/3790966123 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:44:44.290 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:44.285+0000 7fc9a37fe640 1 -- 172.21.15.73:0/3790966123 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc9a40befc0 msgr2=0x7fc9a40a5570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:44.290 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:44.285+0000 7fc9a37fe640 1 --2- 172.21.15.73:0/3790966123 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc9a40befc0 0x7fc9a40a5570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:44.290 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:44.285+0000 7fc9a2ffd640 1 --2- 172.21.15.73:0/3790966123 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc9a4151c50 0x7fc9a41ed3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:44.290 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:44.285+0000 7fc9a37fe640 1 -- 172.21.15.73:0/3790966123 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc9a4151c50 msgr2=0x7fc9a41ed3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:44.290 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:44.285+0000 7fc9a37fe640 1 --2- 172.21.15.73:0/3790966123 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc9a4151c50 0x7fc9a41ed3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:44.290 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:44.285+0000 7fc9a37fe640 1 -- 172.21.15.73:0/3790966123 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9a40708c0 con 0x7fc98c0047c0 2023-12-12T09:44:44.290 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:44.286+0000 7fc9a37fe640 1 --2- 172.21.15.73:0/3790966123 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc98c0047c0 0x7fc9a4071160 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fc994011600 tx=0x7fc994011ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:44:44.290 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:44.286+0000 7fc98bfff640 1 -- 172.21.15.73:0/3790966123 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc99400f920 con 0x7fc98c0047c0 2023-12-12T09:44:44.290 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:44.286+0000 7fc98bfff640 1 -- 172.21.15.73:0/3790966123 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc99400fa80 con 0x7fc98c0047c0 2023-12-12T09:44:44.290 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:44.286+0000 7fc9a9dbe640 1 -- 172.21.15.73:0/3790966123 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9a4070ba0 con 0x7fc98c0047c0 2023-12-12T09:44:44.291 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:44.286+0000 7fc98bfff640 1 -- 172.21.15.73:0/3790966123 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc99400fdf0 con 0x7fc98c0047c0 2023-12-12T09:44:44.291 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:44.286+0000 7fc9a9dbe640 1 -- 172.21.15.73:0/3790966123 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9a40bf470 con 0x7fc98c0047c0 2023-12-12T09:44:44.291 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:44.287+0000 7fc9a9dbe640 1 -- 172.21.15.73:0/3790966123 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc9a4067070 con 0x7fc98c0047c0 2023-12-12T09:44:44.291 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:44.288+0000 7fc98bfff640 1 -- 172.21.15.73:0/3790966123 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fc994015460 con 0x7fc98c0047c0 2023-12-12T09:44:44.291 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:44.289+0000 7fc98bfff640 1 --2- 172.21.15.73:0/3790966123 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fc99006ae70 0x7fc99006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:44.292 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:44.289+0000 7fc98bfff640 1 -- 172.21.15.73:0/3790966123 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fc99408a120 con 0x7fc98c0047c0 2023-12-12T09:44:44.292 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:44.289+0000 7fc9a2ffd640 1 --2- 172.21.15.73:0/3790966123 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fc99006ae70 0x7fc99006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:44.292 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:44.290+0000 7fc9a2ffd640 1 --2- 172.21.15.73:0/3790966123 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fc99006ae70 0x7fc99006d330 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fc998036000 tx=0x7fc998030000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:44:44.294 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:44.294+0000 7fc98bfff640 1 -- 172.21.15.73:0/3790966123 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fc994054e60 con 0x7fc98c0047c0 2023-12-12T09:44:44.468 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:44.467+0000 7fc9a9dbe640 1 -- 172.21.15.73:0/3790966123 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"} v 0) v1 -- 0x7fc9a4067580 con 0x7fc98c0047c0 2023-12-12T09:44:44.469 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:44.468+0000 7fc98bfff640 1 -- 172.21.15.73:0/3790966123 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"}]=0 v38) v1 ==== 105+0+11 (secure 0 0 0) 0x7fc994058480 con 0x7fc98c0047c0 2023-12-12T09:44:44.469 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 32 2023-12-12T09:44:44.473 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:44.471+0000 7fc9a9dbe640 1 -- 172.21.15.73:0/3790966123 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fc99006ae70 msgr2=0x7fc99006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:44.473 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:44.471+0000 7fc9a9dbe640 1 --2- 172.21.15.73:0/3790966123 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fc99006ae70 0x7fc99006d330 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fc998036000 tx=0x7fc998030000 comp rx=0 tx=0).stop 2023-12-12T09:44:44.473 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:44.471+0000 7fc9a9dbe640 1 -- 172.21.15.73:0/3790966123 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc98c0047c0 msgr2=0x7fc9a4071160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:44.473 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:44.471+0000 7fc9a9dbe640 1 --2- 172.21.15.73:0/3790966123 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc98c0047c0 0x7fc9a4071160 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fc994011600 tx=0x7fc994011ac0 comp rx=0 tx=0).stop 2023-12-12T09:44:44.473 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:44.471+0000 7fc9a9dbe640 1 -- 172.21.15.73:0/3790966123 shutdown_connections 2023-12-12T09:44:44.473 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:44.471+0000 7fc9a9dbe640 1 --2- 172.21.15.73:0/3790966123 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fc99006ae70 0x7fc99006d330 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:44.473 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:44.471+0000 7fc9a9dbe640 1 --2- 172.21.15.73:0/3790966123 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc9a40befc0 0x7fc9a40a5570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:44.473 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:44.471+0000 7fc9a9dbe640 1 --2- 172.21.15.73:0/3790966123 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc9a4151c50 0x7fc9a41ed3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:44.473 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:44.471+0000 7fc9a9dbe640 1 --2- 172.21.15.73:0/3790966123 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc98c0047c0 0x7fc9a4071160 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:44.473 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:44.471+0000 7fc9a9dbe640 1 -- 172.21.15.73:0/3790966123 >> 172.21.15.73:0/3790966123 conn(0x7fc9a406a4e0 msgr2=0x7fc9a40c4b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:44:44.473 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:44.472+0000 7fc9a9dbe640 1 -- 172.21.15.73:0/3790966123 shutdown_connections 2023-12-12T09:44:44.474 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:44.472+0000 7fc9a9dbe640 1 -- 172.21.15.73:0/3790966123 wait complete. 2023-12-12T09:44:44.491 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_data pg_num 2023-12-12T09:44:44.696 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:44.695+0000 7f915ffff640 1 Processor -- start 2023-12-12T09:44:44.696 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:44.695+0000 7f915ffff640 1 -- start start 2023-12-12T09:44:44.697 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:44.696+0000 7f915ffff640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f91600ae750 0x7f91600aeb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:44.697 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:44.696+0000 7f915ffff640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f91600c4560 0x7f9160154bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:44.697 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:44.696+0000 7f915ffff640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9160154760 con 0x7f91600c9460 2023-12-12T09:44:44.698 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:44.696+0000 7f915ffff640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91600acb90 con 0x7f91600ae750 2023-12-12T09:44:44.698 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:44.696+0000 7f915ffff640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91600ace70 con 0x7f91600c4560 2023-12-12T09:44:44.698 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:44.697+0000 7f915effd640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f91600ae750 0x7f91600aeb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:44.699 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:44.697+0000 7f9157fff640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f91600c9460 0x7f9160157840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:44490/0 (socket says 172.21.15.73:44490) 2023-12-12T09:44:44.699 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:44.697+0000 7f9157fff640 1 -- 172.21.15.73:0/2423499523 learned_addr learned my addr 172.21.15.73:0/2423499523 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-12T09:44:44.699 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:44.697+0000 7f915f7fe640 1 --2- 172.21.15.73:0/2423499523 >> v2:172.21.15.142:3300/0 conn(0x7f91600c4560 0x7f9160154bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:44.699 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:44.697+0000 7f915effd640 1 -- 172.21.15.73:0/2423499523 >> v2:172.21.15.142:3300/0 conn(0x7f91600c4560 msgr2=0x7f9160154bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:44:44.699 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:44.697+0000 7f915effd640 1 --2- 172.21.15.73:0/2423499523 >> v2:172.21.15.142:3300/0 conn(0x7f91600c4560 0x7f9160154bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:44.699 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:44.697+0000 7f915e7fc640 1 -- 172.21.15.73:0/2423499523 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3159486922 0 0) 0x7f9160154760 con 0x7f91600c9460 2023-12-12T09:44:44.699 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:44.697+0000 7f915effd640 1 -- 172.21.15.73:0/2423499523 >> v1:172.21.15.73:6789/0 conn(0x7f91600c9460 legacy=0x7f9160157840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:44.699 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:44.697+0000 7f915effd640 1 -- 172.21.15.73:0/2423499523 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91601543f0 con 0x7f91600ae750 2023-12-12T09:44:44.699 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:44.697+0000 7f915f7fe640 1 --2- 172.21.15.73:0/2423499523 >> v2:172.21.15.142:3300/0 conn(0x7f91600c4560 0x7f9160154bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:44:44.700 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:44.699+0000 7f915effd640 1 --2- 172.21.15.73:0/2423499523 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f91600ae750 0x7f91600aeb30 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f91600c9af0 tx=0x7f915002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=713ee120e962b2f2 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:44:44.700 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:44.699+0000 7f915e7fc640 1 -- 172.21.15.73:0/2423499523 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9150031830 con 0x7f91600ae750 2023-12-12T09:44:44.700 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:44.699+0000 7f915e7fc640 1 -- 172.21.15.73:0/2423499523 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9150031990 con 0x7f91600ae750 2023-12-12T09:44:44.700 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:44.699+0000 7f915e7fc640 1 -- 172.21.15.73:0/2423499523 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9150031d20 con 0x7f91600ae750 2023-12-12T09:44:44.701 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:44.699+0000 7f915ffff640 1 -- 172.21.15.73:0/2423499523 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f91600ae750 msgr2=0x7f91600aeb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:44.701 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:44.699+0000 7f915ffff640 1 --2- 172.21.15.73:0/2423499523 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f91600ae750 0x7f91600aeb30 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f91600c9af0 tx=0x7f915002b8d0 comp rx=0 tx=0).stop 2023-12-12T09:44:44.701 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:44.700+0000 7f915ffff640 1 -- 172.21.15.73:0/2423499523 shutdown_connections 2023-12-12T09:44:44.702 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:44.700+0000 7f915ffff640 1 --2- 172.21.15.73:0/2423499523 >> v2:172.21.15.142:3300/0 conn(0x7f91600c4560 0x7f9160154bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:44.702 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:44.700+0000 7f915ffff640 1 --2- 172.21.15.73:0/2423499523 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f91600ae750 0x7f91600aeb30 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:44.702 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:44.700+0000 7f915ffff640 1 -- 172.21.15.73:0/2423499523 >> 172.21.15.73:0/2423499523 conn(0x7f91600abc10 msgr2=0x7f91600ac020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:44:44.702 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:44.700+0000 7f915ffff640 1 -- 172.21.15.73:0/2423499523 shutdown_connections 2023-12-12T09:44:44.702 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:44.700+0000 7f915ffff640 1 -- 172.21.15.73:0/2423499523 wait complete. 2023-12-12T09:44:44.702 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:44.701+0000 7f915ffff640 1 Processor -- start 2023-12-12T09:44:44.702 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:44.701+0000 7f915ffff640 1 -- start start 2023-12-12T09:44:44.704 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:44.702+0000 7f915ffff640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f91600ae750 0x7f91601ea4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:44.704 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:44.702+0000 7f915ffff640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f91600c4560 0x7f91601eda70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:44.704 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:44.702+0000 7f915ffff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f91600c9460 0x7f916014ee50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:44.704 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:44.702+0000 7f915ffff640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91601ed060 con 0x7f91600c9460 2023-12-12T09:44:44.704 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:44.702+0000 7f915ffff640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91601483d0 con 0x7f91600c4560 2023-12-12T09:44:44.704 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:44.702+0000 7f915ffff640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91601ed5e0 con 0x7f91600ae750 2023-12-12T09:44:44.704 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:44.703+0000 7f915f7fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f91600c9460 0x7f916014ee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:44.704 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:44.703+0000 7f915f7fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f91600c9460 0x7f916014ee50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:52844/0 (socket says 172.21.15.73:52844) 2023-12-12T09:44:44.704 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:44.703+0000 7f915f7fe640 1 -- 172.21.15.73:0/3896375746 learned_addr learned my addr 172.21.15.73:0/3896375746 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:44:44.705 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:44.703+0000 7f915f7fe640 1 -- 172.21.15.73:0/3896375746 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f91600ae750 msgr2=0x7f91601ea4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:44.705 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:44.703+0000 7f915f7fe640 1 --2- 172.21.15.73:0/3896375746 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f91600ae750 0x7f91601ea4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:44.705 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:44.703+0000 7f915f7fe640 1 -- 172.21.15.73:0/3896375746 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f91600c4560 msgr2=0x7f91601eda70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:44.705 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:44.703+0000 7f915f7fe640 1 --2- 172.21.15.73:0/3896375746 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f91600c4560 0x7f91601eda70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:44.705 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:44.703+0000 7f915f7fe640 1 -- 172.21.15.73:0/3896375746 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9150009400 con 0x7f91600c9460 2023-12-12T09:44:44.706 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:44.703+0000 7f915f7fe640 1 --2- 172.21.15.73:0/3896375746 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f91600c9460 0x7f916014ee50 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f915800cef0 tx=0x7f915800a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:44:44.706 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:44.704+0000 7f91577fe640 1 -- 172.21.15.73:0/3896375746 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f915800d840 con 0x7f91600c9460 2023-12-12T09:44:44.706 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:44.704+0000 7f91577fe640 1 -- 172.21.15.73:0/3896375746 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f915800d9c0 con 0x7f91600c9460 2023-12-12T09:44:44.706 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:44.704+0000 7f91577fe640 1 -- 172.21.15.73:0/3896375746 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f915800dd70 con 0x7f91600c9460 2023-12-12T09:44:44.706 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:44.704+0000 7f915ffff640 1 -- 172.21.15.73:0/3896375746 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91601eaa30 con 0x7f91600c9460 2023-12-12T09:44:44.706 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:44.704+0000 7f915ffff640 1 -- 172.21.15.73:0/3896375746 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f916006c410 con 0x7f91600c9460 2023-12-12T09:44:44.706 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:44.705+0000 7f915ffff640 1 -- 172.21.15.73:0/3896375746 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91600adc50 con 0x7f91600c9460 2023-12-12T09:44:44.707 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:44.706+0000 7f91577fe640 1 -- 172.21.15.73:0/3896375746 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f915801e3b0 con 0x7f91600c9460 2023-12-12T09:44:44.708 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:44.707+0000 7f91577fe640 1 --2- 172.21.15.73:0/3896375746 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f914006ae70 0x7f914006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:44.708 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:44.707+0000 7f91577fe640 1 -- 172.21.15.73:0/3896375746 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f915808a420 con 0x7f91600c9460 2023-12-12T09:44:44.708 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:44.707+0000 7f915effd640 1 --2- 172.21.15.73:0/3896375746 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f914006ae70 0x7f914006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:44.709 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:44.708+0000 7f915effd640 1 --2- 172.21.15.73:0/3896375746 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f914006ae70 0x7f914006d330 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f9150036000 tx=0x7f9150030000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:44:44.712 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:44.711+0000 7f91577fe640 1 -- 172.21.15.73:0/3896375746 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f9158055220 con 0x7f91600c9460 2023-12-12T09:44:44.903 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:44.901+0000 7f915ffff640 1 -- 172.21.15.73:0/3896375746 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"} v 0) v1 -- 0x7f91601ed750 con 0x7f91600c9460 2023-12-12T09:44:44.903 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:44.902+0000 7f91577fe640 1 -- 172.21.15.73:0/3896375746 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"}]=0 v38) v1 ==== 101+0+11 (secure 0 0 0) 0x7f9158058840 con 0x7f91600c9460 2023-12-12T09:44:44.903 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 64 2023-12-12T09:44:44.906 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:44.904+0000 7f915ffff640 1 -- 172.21.15.73:0/3896375746 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f914006ae70 msgr2=0x7f914006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:44.906 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:44.904+0000 7f915ffff640 1 --2- 172.21.15.73:0/3896375746 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f914006ae70 0x7f914006d330 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f9150036000 tx=0x7f9150030000 comp rx=0 tx=0).stop 2023-12-12T09:44:44.906 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:44.904+0000 7f915ffff640 1 -- 172.21.15.73:0/3896375746 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f91600c9460 msgr2=0x7f916014ee50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:44.906 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:44.905+0000 7f915ffff640 1 --2- 172.21.15.73:0/3896375746 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f91600c9460 0x7f916014ee50 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f915800cef0 tx=0x7f915800a710 comp rx=0 tx=0).stop 2023-12-12T09:44:44.906 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:44.905+0000 7f915ffff640 1 -- 172.21.15.73:0/3896375746 shutdown_connections 2023-12-12T09:44:44.906 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:44.905+0000 7f915ffff640 1 --2- 172.21.15.73:0/3896375746 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f914006ae70 0x7f914006d330 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:44.907 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:44.905+0000 7f915ffff640 1 --2- 172.21.15.73:0/3896375746 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f91600c9460 0x7f916014ee50 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:44.907 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:44.905+0000 7f915ffff640 1 --2- 172.21.15.73:0/3896375746 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f91600c4560 0x7f91601eda70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:44.907 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:44.905+0000 7f915ffff640 1 --2- 172.21.15.73:0/3896375746 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f91600ae750 0x7f91601ea4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:44.907 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:44.905+0000 7f915ffff640 1 -- 172.21.15.73:0/3896375746 >> 172.21.15.73:0/3896375746 conn(0x7f91600abc10 msgr2=0x7f91600c4a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:44:44.907 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:44.905+0000 7f915ffff640 1 -- 172.21.15.73:0/3896375746 shutdown_connections 2023-12-12T09:44:44.907 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:44.905+0000 7f915ffff640 1 -- 172.21.15.73:0/3896375746 wait complete. 2023-12-12T09:44:44.925 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-12T09:44:45.138 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:45.136+0000 7f7cfb5a9640 1 Processor -- start 2023-12-12T09:44:45.138 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:45.137+0000 7f7cfb5a9640 1 -- start start 2023-12-12T09:44:45.139 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:45.138+0000 7f7cfb5a9640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7cf40c50f0 0x7f7cf40c3a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:45.139 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:45.138+0000 7f7cfb5a9640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f7cf40c3f90 0x7f7cf406ce30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:45.139 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:45.138+0000 7f7cfb5a9640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f7cf40c21a0 0x7f7cf4154640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:45.140 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:45.138+0000 7f7cfb5a9640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7cf406dc30 con 0x7f7cf40c21a0 2023-12-12T09:44:45.140 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:45.138+0000 7f7cfb5a9640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7cf406c2d0 con 0x7f7cf40c3f90 2023-12-12T09:44:45.140 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:45.138+0000 7f7cfb5a9640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7cf41541b0 con 0x7f7cf40c50f0 2023-12-12T09:44:45.140 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:45.138+0000 7f7cf9b46640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f7cf40c21a0 0x7f7cf4154640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:45.140 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:45.138+0000 7f7cf9b46640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f7cf40c21a0 0x7f7cf4154640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:52852/0 (socket says 172.21.15.73:52852) 2023-12-12T09:44:45.140 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:45.138+0000 7f7cf9b46640 1 -- 172.21.15.73:0/1730865739 learned_addr learned my addr 172.21.15.73:0/1730865739 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:44:45.141 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:45.139+0000 7f7cf8b44640 1 --2- 172.21.15.73:0/1730865739 >> v2:172.21.15.142:3300/0 conn(0x7f7cf40c3f90 0x7f7cf406ce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:45.141 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:45.139+0000 7f7cf9345640 1 --2- 172.21.15.73:0/1730865739 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7cf40c50f0 0x7f7cf40c3a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:45.141 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:45.139+0000 7f7cf9b46640 1 -- 172.21.15.73:0/1730865739 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7cf40c50f0 msgr2=0x7f7cf40c3a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:44:45.141 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:45.139+0000 7f7cf9b46640 1 --2- 172.21.15.73:0/1730865739 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7cf40c50f0 0x7f7cf40c3a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:45.141 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:45.139+0000 7f7cf9b46640 1 -- 172.21.15.73:0/1730865739 >> v2:172.21.15.142:3300/0 conn(0x7f7cf40c3f90 msgr2=0x7f7cf406ce30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:44:45.141 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:45.139+0000 7f7cf9b46640 1 --2- 172.21.15.73:0/1730865739 >> v2:172.21.15.142:3300/0 conn(0x7f7cf40c3f90 0x7f7cf406ce30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:45.142 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:45.139+0000 7f7cf9b46640 1 -- 172.21.15.73:0/1730865739 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7cf40c57b0 con 0x7f7cf40c21a0 2023-12-12T09:44:45.142 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:45.139+0000 7f7cf8b44640 1 --2- 172.21.15.73:0/1730865739 >> v2:172.21.15.142:3300/0 conn(0x7f7cf40c3f90 0x7f7cf406ce30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:44:45.142 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:45.139+0000 7f7cf9345640 1 --2- 172.21.15.73:0/1730865739 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7cf40c50f0 0x7f7cf40c3a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:44:45.142 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:45.140+0000 7f7cf9b46640 1 --2- 172.21.15.73:0/1730865739 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7cf40c21a0 0x7f7cf4154640 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f7cf4074280 tx=0x7f7cec02dfc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91fb1d7cb2af9cc5 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:44:45.142 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:45.140+0000 7f7cf3fff640 1 -- 172.21.15.73:0/1730865739 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cec02ed70 con 0x7f7cf40c21a0 2023-12-12T09:44:45.142 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:45.140+0000 7f7cf3fff640 1 -- 172.21.15.73:0/1730865739 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7cec036440 con 0x7f7cf40c21a0 2023-12-12T09:44:45.142 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:45.140+0000 7f7cf3fff640 1 -- 172.21.15.73:0/1730865739 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cec0367d0 con 0x7f7cf40c21a0 2023-12-12T09:44:45.143 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:45.141+0000 7f7cfb5a9640 1 -- 172.21.15.73:0/1730865739 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7cf40c21a0 msgr2=0x7f7cf4154640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:45.143 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:45.141+0000 7f7cfb5a9640 1 --2- 172.21.15.73:0/1730865739 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7cf40c21a0 0x7f7cf4154640 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f7cf4074280 tx=0x7f7cec02dfc0 comp rx=0 tx=0).stop 2023-12-12T09:44:45.143 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:45.141+0000 7f7cfb5a9640 1 -- 172.21.15.73:0/1730865739 shutdown_connections 2023-12-12T09:44:45.143 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:45.141+0000 7f7cfb5a9640 1 --2- 172.21.15.73:0/1730865739 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7cf40c21a0 0x7f7cf4154640 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:45.143 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:45.141+0000 7f7cfb5a9640 1 --2- 172.21.15.73:0/1730865739 >> v2:172.21.15.142:3300/0 conn(0x7f7cf40c3f90 0x7f7cf406ce30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:45.143 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:45.141+0000 7f7cfb5a9640 1 --2- 172.21.15.73:0/1730865739 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7cf40c50f0 0x7f7cf40c3a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:45.143 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:45.141+0000 7f7cfb5a9640 1 -- 172.21.15.73:0/1730865739 >> 172.21.15.73:0/1730865739 conn(0x7f7cf40c2630 msgr2=0x7f7cf40c2a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:44:45.143 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:45.141+0000 7f7cfb5a9640 1 -- 172.21.15.73:0/1730865739 shutdown_connections 2023-12-12T09:44:45.143 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:45.141+0000 7f7cfb5a9640 1 -- 172.21.15.73:0/1730865739 wait complete. 2023-12-12T09:44:45.144 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:45.143+0000 7f7cfb5a9640 1 Processor -- start 2023-12-12T09:44:45.144 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:45.143+0000 7f7cfb5a9640 1 -- start start 2023-12-12T09:44:45.145 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:45.144+0000 7f7cfb5a9640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7cf40c21a0 0x7f7cf40a9f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:45.145 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:45.144+0000 7f7cfb5a9640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7cf40c3f90 0x7f7cf40a4aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:45.145 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:45.144+0000 7f7cfb5a9640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7cf40c50f0 0x7f7cf40bf1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:45.146 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:45.144+0000 7f7cfb5a9640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cf40a6a10 con 0x7f7cf40c3f90 2023-12-12T09:44:45.146 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:45.144+0000 7f7cfb5a9640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cf40a51a0 con 0x7f7cf40c21a0 2023-12-12T09:44:45.146 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:45.144+0000 7f7cfb5a9640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7cf41ed820 con 0x7f7cf40c50f0 2023-12-12T09:44:45.146 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:45.144+0000 7f7cf8b44640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7cf40c3f90 0x7f7cf40a4aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:45.146 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:45.144+0000 7f7cf8b44640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7cf40c3f90 0x7f7cf40a4aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:52862/0 (socket says 172.21.15.73:52862) 2023-12-12T09:44:45.146 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:45.144+0000 7f7cf8b44640 1 -- 172.21.15.73:0/3372773614 learned_addr learned my addr 172.21.15.73:0/3372773614 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:44:45.146 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:45.144+0000 7f7cf8b44640 1 -- 172.21.15.73:0/3372773614 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7cf40c50f0 msgr2=0x7f7cf40bf1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:45.146 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:45.144+0000 7f7cf8b44640 1 --2- 172.21.15.73:0/3372773614 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7cf40c50f0 0x7f7cf40bf1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:45.146 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:45.144+0000 7f7cf8b44640 1 -- 172.21.15.73:0/3372773614 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7cf40c21a0 msgr2=0x7f7cf40a9f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:45.146 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:45.144+0000 7f7cf8b44640 1 --2- 172.21.15.73:0/3372773614 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7cf40c21a0 0x7f7cf40a9f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:45.146 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:45.144+0000 7f7cf8b44640 1 -- 172.21.15.73:0/3372773614 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7cec00b770 con 0x7f7cf40c3f90 2023-12-12T09:44:45.146 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:45.145+0000 7f7cf8b44640 1 --2- 172.21.15.73:0/3372773614 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7cf40c3f90 0x7f7cf40a4aa0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f7ce800c7f0 tx=0x7f7ce800cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:44:45.147 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:45.145+0000 7f7cf1ffb640 1 -- 172.21.15.73:0/3372773614 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ce8007a30 con 0x7f7cf40c3f90 2023-12-12T09:44:45.147 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:45.145+0000 7f7cf1ffb640 1 -- 172.21.15.73:0/3372773614 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ce8007b90 con 0x7f7cf40c3f90 2023-12-12T09:44:45.147 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:45.145+0000 7f7cfb5a9640 1 -- 172.21.15.73:0/3372773614 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7cf41edb00 con 0x7f7cf40c3f90 2023-12-12T09:44:45.147 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:45.145+0000 7f7cf1ffb640 1 -- 172.21.15.73:0/3372773614 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ce800ce40 con 0x7f7cf40c3f90 2023-12-12T09:44:45.147 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:45.145+0000 7f7cfb5a9640 1 -- 172.21.15.73:0/3372773614 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7cf40bf710 con 0x7f7cf40c3f90 2023-12-12T09:44:45.148 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:45.146+0000 7f7cfb5a9640 1 -- 172.21.15.73:0/3372773614 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7cf41ed680 con 0x7f7cf40c3f90 2023-12-12T09:44:45.149 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:45.147+0000 7f7cf1ffb640 1 -- 172.21.15.73:0/3372773614 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f7ce80113f0 con 0x7f7cf40c3f90 2023-12-12T09:44:45.149 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:45.148+0000 7f7cf1ffb640 1 --2- 172.21.15.73:0/3372773614 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f7ce006ae40 0x7f7ce006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:45.149 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:45.148+0000 7f7cf1ffb640 1 -- 172.21.15.73:0/3372773614 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f7ce8089ad0 con 0x7f7cf40c3f90 2023-12-12T09:44:45.150 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:45.148+0000 7f7cf9345640 1 --2- 172.21.15.73:0/3372773614 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f7ce006ae40 0x7f7ce006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:45.150 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:45.149+0000 7f7cf9345640 1 --2- 172.21.15.73:0/3372773614 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f7ce006ae40 0x7f7ce006d300 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f7ce4007130 tx=0x7f7ce4007300 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:44:45.153 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:45.152+0000 7f7cf1ffb640 1 -- 172.21.15.73:0/3372773614 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f7cf41ed680 con 0x7f7cf40c3f90 2023-12-12T09:44:45.354 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:45.352+0000 7f7cfb5a9640 1 -- 172.21.15.73:0/3372773614 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f7cf41ee020 con 0x7f7cf40c3f90 2023-12-12T09:44:45.354 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:45.353+0000 7f7cf1ffb640 1 -- 172.21.15.73:0/3372773614 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v38) v1 ==== 80+0+0 (secure 0 0 0) 0x7f7cf41ee020 con 0x7f7cf40c3f90 2023-12-12T09:44:45.355 INFO:teuthology.orchestra.run.smithi073.stderr:listed 0 entries 2023-12-12T09:44:45.357 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:45.356+0000 7f7cfb5a9640 1 -- 172.21.15.73:0/3372773614 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f7ce006ae40 msgr2=0x7f7ce006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:45.358 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:45.356+0000 7f7cfb5a9640 1 --2- 172.21.15.73:0/3372773614 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f7ce006ae40 0x7f7ce006d300 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f7ce4007130 tx=0x7f7ce4007300 comp rx=0 tx=0).stop 2023-12-12T09:44:45.358 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:45.356+0000 7f7cfb5a9640 1 -- 172.21.15.73:0/3372773614 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7cf40c3f90 msgr2=0x7f7cf40a4aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:45.358 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:45.356+0000 7f7cfb5a9640 1 --2- 172.21.15.73:0/3372773614 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7cf40c3f90 0x7f7cf40a4aa0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f7ce800c7f0 tx=0x7f7ce800cbf0 comp rx=0 tx=0).stop 2023-12-12T09:44:45.358 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:45.356+0000 7f7cfb5a9640 1 -- 172.21.15.73:0/3372773614 shutdown_connections 2023-12-12T09:44:45.358 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:45.356+0000 7f7cfb5a9640 1 --2- 172.21.15.73:0/3372773614 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f7ce006ae40 0x7f7ce006d300 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:45.358 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:45.356+0000 7f7cfb5a9640 1 --2- 172.21.15.73:0/3372773614 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7cf40c50f0 0x7f7cf40bf1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:45.358 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:45.356+0000 7f7cfb5a9640 1 --2- 172.21.15.73:0/3372773614 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7cf40c3f90 0x7f7cf40a4aa0 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:45.358 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:45.356+0000 7f7cfb5a9640 1 --2- 172.21.15.73:0/3372773614 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7cf40c21a0 0x7f7cf40a9f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:45.358 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:45.356+0000 7f7cfb5a9640 1 -- 172.21.15.73:0/3372773614 >> 172.21.15.73:0/3372773614 conn(0x7f7cf40c2630 msgr2=0x7f7cf40c0220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:44:45.358 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:45.356+0000 7f7cfb5a9640 1 -- 172.21.15.73:0/3372773614 shutdown_connections 2023-12-12T09:44:45.358 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:45.356+0000 7f7cfb5a9640 1 -- 172.21.15.73:0/3372773614 wait complete. 2023-12-12T09:44:45.375 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-12-12T09:44:45.375 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T09:44:45.376 DEBUG:teuthology.orchestra.run.smithi142:> sudo umount /home/ubuntu/cephtest/mnt.1 2023-12-12T09:44:45.495 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi142.front.sepia.ceph.com 2023-12-12T09:44:45.496 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T09:44:45.496 DEBUG:teuthology.orchestra.run.smithi142:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-12-12T09:44:45.551 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2023-12-12T09:44:45.551 DEBUG:teuthology.orchestra.run.smithi142:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-12T09:44:45.597 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054289,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498808k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249400k,nr_inodes=812350,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498808k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 2023-12-12T09:44:45.597 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-12-12T09:44:45.820 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:45.819+0000 7ff02a725640 1 Processor -- start 2023-12-12T09:44:45.821 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:45.819+0000 7ff02a725640 1 -- start start 2023-12-12T09:44:45.823 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:45.821+0000 7ff02a725640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7ff0240a5040 0x7ff02406bf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:45.823 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:45.821+0000 7ff02a725640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff02406a4e0 0x7ff02406a930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:45.823 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:45.821+0000 7ff02a725640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff024158c00 con 0x7ff0240c3ad0 2023-12-12T09:44:45.823 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:45.821+0000 7ff02a725640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff02406c4d0 con 0x7ff0240a5040 2023-12-12T09:44:45.823 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:45.821+0000 7ff02a725640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0240c4d00 con 0x7ff02406a4e0 2023-12-12T09:44:45.823 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:45.821+0000 7ff023fff640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7ff0240a5040 0x7ff02406bf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:45.823 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:45.821+0000 7ff01bfff640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7ff0240c3ad0 0x7ff0241584f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:44494/0 (socket says 172.21.15.73:44494) 2023-12-12T09:44:45.823 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:45.821+0000 7ff01bfff640 1 -- 172.21.15.73:0/187775780 learned_addr learned my addr 172.21.15.73:0/187775780 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-12T09:44:45.824 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:45.821+0000 7ff028cc2640 1 --2- 172.21.15.73:0/187775780 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff02406a4e0 0x7ff02406a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:45.824 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:45.821+0000 7ff023fff640 1 -- 172.21.15.73:0/187775780 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff02406a4e0 msgr2=0x7ff02406a930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:44:45.824 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:45.821+0000 7ff023fff640 1 --2- 172.21.15.73:0/187775780 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff02406a4e0 0x7ff02406a930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:45.824 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:45.821+0000 7ff023fff640 1 -- 172.21.15.73:0/187775780 >> v1:172.21.15.73:6789/0 conn(0x7ff0240c3ad0 legacy=0x7ff0241584f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:45.824 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:45.822+0000 7ff023fff640 1 -- 172.21.15.73:0/187775780 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0240c5100 con 0x7ff0240a5040 2023-12-12T09:44:45.824 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:45.822+0000 7ff028cc2640 1 --2- 172.21.15.73:0/187775780 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff02406a4e0 0x7ff02406a930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:44:45.824 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:45.821+0000 7ff0237fe640 1 -- 172.21.15.73:0/187775780 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2464861335 0 0) 0x7ff024158c00 con 0x7ff0240c3ad0 2023-12-12T09:44:45.825 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:45.823+0000 7ff023fff640 1 --2- 172.21.15.73:0/187775780 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff0240a5040 0x7ff02406bf90 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7ff0140097a0 tx=0x7ff01402b940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84e62b17b297cf28 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:44:45.825 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:45.823+0000 7ff0237fe640 1 -- 172.21.15.73:0/187775780 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff014030800 con 0x7ff0240a5040 2023-12-12T09:44:45.825 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:45.823+0000 7ff0237fe640 1 -- 172.21.15.73:0/187775780 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff014030960 con 0x7ff0240a5040 2023-12-12T09:44:45.825 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:45.823+0000 7ff0237fe640 1 -- 172.21.15.73:0/187775780 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff014030cf0 con 0x7ff0240a5040 2023-12-12T09:44:45.826 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:45.823+0000 7ff02a725640 1 -- 172.21.15.73:0/187775780 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff0240a5040 msgr2=0x7ff02406bf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:45.826 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:45.823+0000 7ff02a725640 1 --2- 172.21.15.73:0/187775780 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff0240a5040 0x7ff02406bf90 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7ff0140097a0 tx=0x7ff01402b940 comp rx=0 tx=0).stop 2023-12-12T09:44:45.826 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:45.824+0000 7ff02a725640 1 -- 172.21.15.73:0/187775780 shutdown_connections 2023-12-12T09:44:45.826 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:45.824+0000 7ff02a725640 1 --2- 172.21.15.73:0/187775780 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff02406a4e0 0x7ff02406a930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:45.826 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:45.824+0000 7ff02a725640 1 --2- 172.21.15.73:0/187775780 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff0240a5040 0x7ff02406bf90 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:45.826 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:45.824+0000 7ff02a725640 1 -- 172.21.15.73:0/187775780 >> 172.21.15.73:0/187775780 conn(0x7ff0240a8130 msgr2=0x7ff0240c24b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:44:45.826 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:45.824+0000 7ff02a725640 1 -- 172.21.15.73:0/187775780 shutdown_connections 2023-12-12T09:44:45.826 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:45.824+0000 7ff02a725640 1 -- 172.21.15.73:0/187775780 wait complete. 2023-12-12T09:44:45.827 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:45.825+0000 7ff02a725640 1 Processor -- start 2023-12-12T09:44:45.827 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:45.825+0000 7ff02a725640 1 -- start start 2023-12-12T09:44:45.829 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:45.826+0000 7ff02a725640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff02406a4e0 0x7ff0241de4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:45.829 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:45.826+0000 7ff02a725640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff0240a5040 0x7ff02406fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:45.829 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:45.826+0000 7ff02a725640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff0240c3ad0 0x7ff0240a9710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:45.829 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:45.826+0000 7ff02a725640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0241dec70 con 0x7ff0240a5040 2023-12-12T09:44:45.829 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:45.826+0000 7ff02a725640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0240aa8e0 con 0x7ff02406a4e0 2023-12-12T09:44:45.829 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:45.826+0000 7ff02a725640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0240aae60 con 0x7ff0240c3ad0 2023-12-12T09:44:45.829 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:45.827+0000 7ff01bfff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff0240a5040 0x7ff02406fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:45.829 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:45.827+0000 7ff01bfff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff0240a5040 0x7ff02406fcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:52880/0 (socket says 172.21.15.73:52880) 2023-12-12T09:44:45.829 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:45.827+0000 7ff01bfff640 1 -- 172.21.15.73:0/4180883900 learned_addr learned my addr 172.21.15.73:0/4180883900 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:44:45.829 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:45.827+0000 7ff023fff640 1 --2- 172.21.15.73:0/4180883900 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff02406a4e0 0x7ff0241de4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:45.830 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:45.827+0000 7ff01bfff640 1 -- 172.21.15.73:0/4180883900 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff0240c3ad0 msgr2=0x7ff0240a9710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:45.830 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:45.827+0000 7ff01bfff640 1 --2- 172.21.15.73:0/4180883900 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff0240c3ad0 0x7ff0240a9710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:45.830 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:45.827+0000 7ff01bfff640 1 -- 172.21.15.73:0/4180883900 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff02406a4e0 msgr2=0x7ff0241de4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:45.830 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:45.827+0000 7ff01bfff640 1 --2- 172.21.15.73:0/4180883900 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff02406a4e0 0x7ff0241de4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:45.830 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:45.827+0000 7ff01bfff640 1 -- 172.21.15.73:0/4180883900 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff014009400 con 0x7ff0240a5040 2023-12-12T09:44:45.830 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:45.827+0000 7ff01bfff640 1 --2- 172.21.15.73:0/4180883900 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff0240a5040 0x7ff02406fcc0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7ff00c00c430 tx=0x7ff00c00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:44:45.830 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:45.828+0000 7ff0217fa640 1 -- 172.21.15.73:0/4180883900 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff00c0074e0 con 0x7ff0240a5040 2023-12-12T09:44:45.830 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:45.828+0000 7ff0217fa640 1 -- 172.21.15.73:0/4180883900 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff00c007660 con 0x7ff0240a5040 2023-12-12T09:44:45.830 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:45.828+0000 7ff0217fa640 1 -- 172.21.15.73:0/4180883900 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff00c004a20 con 0x7ff0240a5040 2023-12-12T09:44:45.830 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:45.828+0000 7ff02a725640 1 -- 172.21.15.73:0/4180883900 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0240aa0e0 con 0x7ff0240a5040 2023-12-12T09:44:45.830 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:45.828+0000 7ff02a725640 1 -- 172.21.15.73:0/4180883900 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0240aaaf0 con 0x7ff0240a5040 2023-12-12T09:44:45.831 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:45.829+0000 7ff02a725640 1 -- 172.21.15.73:0/4180883900 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff024157f90 con 0x7ff0240a5040 2023-12-12T09:44:45.831 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:45.830+0000 7ff0217fa640 1 -- 172.21.15.73:0/4180883900 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7ff00c004b80 con 0x7ff0240a5040 2023-12-12T09:44:45.832 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:45.831+0000 7ff0217fa640 1 --2- 172.21.15.73:0/4180883900 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7ff00406ae40 0x7ff00406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:45.832 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:45.831+0000 7ff0217fa640 1 -- 172.21.15.73:0/4180883900 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6565+0+0 (secure 0 0 0) 0x7ff00c089750 con 0x7ff0240a5040 2023-12-12T09:44:45.832 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:45.831+0000 7ff023fff640 1 --2- 172.21.15.73:0/4180883900 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7ff00406ae40 0x7ff00406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:45.833 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:45.832+0000 7ff023fff640 1 --2- 172.21.15.73:0/4180883900 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7ff00406ae40 0x7ff00406d300 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7ff014036000 tx=0x7ff01403b040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:44:45.836 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:45.835+0000 7ff0217fa640 1 -- 172.21.15.73:0/4180883900 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7ff00c054530 con 0x7ff0240a5040 2023-12-12T09:44:46.062 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:46.061+0000 7ff02a725640 1 -- 172.21.15.73:0/4180883900 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7ff024067580 con 0x7ff0240a5040 2023-12-12T09:44:46.063 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:46.062+0000 7ff0217fa640 1 -- 172.21.15.73:0/4180883900 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v19) v1 ==== 53+0+149 (secure 0 0 0) 0x7ff00c057b50 con 0x7ff0240a5040 2023-12-12T09:44:46.063 INFO:teuthology.orchestra.run.smithi073.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-12-12T09:44:46.063 INFO:teuthology.orchestra.run.smithi073.stdout:name: cephfs2, metadata pool: cephfs2_metadata, data pools: [cephfs2_data ] 2023-12-12T09:44:46.067 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:46.064+0000 7ff02a725640 1 -- 172.21.15.73:0/4180883900 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7ff00406ae40 msgr2=0x7ff00406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:46.067 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:46.064+0000 7ff02a725640 1 --2- 172.21.15.73:0/4180883900 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7ff00406ae40 0x7ff00406d300 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7ff014036000 tx=0x7ff01403b040 comp rx=0 tx=0).stop 2023-12-12T09:44:46.067 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:46.064+0000 7ff02a725640 1 -- 172.21.15.73:0/4180883900 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff0240a5040 msgr2=0x7ff02406fcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:46.067 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:46.064+0000 7ff02a725640 1 --2- 172.21.15.73:0/4180883900 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff0240a5040 0x7ff02406fcc0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7ff00c00c430 tx=0x7ff00c00c8f0 comp rx=0 tx=0).stop 2023-12-12T09:44:46.067 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:46.064+0000 7ff02a725640 1 -- 172.21.15.73:0/4180883900 shutdown_connections 2023-12-12T09:44:46.067 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:46.064+0000 7ff02a725640 1 --2- 172.21.15.73:0/4180883900 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7ff00406ae40 0x7ff00406d300 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:46.067 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:46.064+0000 7ff02a725640 1 --2- 172.21.15.73:0/4180883900 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff0240c3ad0 0x7ff0240a9710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:46.067 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:46.064+0000 7ff02a725640 1 --2- 172.21.15.73:0/4180883900 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff0240a5040 0x7ff02406fcc0 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:46.067 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:46.064+0000 7ff02a725640 1 --2- 172.21.15.73:0/4180883900 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff02406a4e0 0x7ff0241de4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:46.067 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:46.064+0000 7ff02a725640 1 -- 172.21.15.73:0/4180883900 >> 172.21.15.73:0/4180883900 conn(0x7ff0240a8130 msgr2=0x7ff0241583f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:44:46.068 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:46.065+0000 7ff02a725640 1 -- 172.21.15.73:0/4180883900 shutdown_connections 2023-12-12T09:44:46.068 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:46.065+0000 7ff02a725640 1 -- 172.21.15.73:0/4180883900 wait complete. 2023-12-12T09:44:46.084 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs2; just confirmed its presence on cluster 2023-12-12T09:44:46.084 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-12T09:44:46.084 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi142.front.sepia.ceph.com 2023-12-12T09:44:46.085 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-12-12T09:44:46.085 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-12-12T09:44:46.085 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs2 2023-12-12T09:44:46.085 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-12-12T09:44:46.085 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-12-12T09:44:46.085 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-12-12T09:44:46.085 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T09:44:46.085 DEBUG:teuthology.orchestra.run.smithi142:> ip addr 2023-12-12T09:44:46.149 INFO:teuthology.orchestra.run.smithi142.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-12T09:44:46.149 INFO:teuthology.orchestra.run.smithi142.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-12T09:44:46.149 INFO:teuthology.orchestra.run.smithi142.stdout: inet 127.0.0.1/8 scope host lo 2023-12-12T09:44:46.149 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2023-12-12T09:44:46.149 INFO:teuthology.orchestra.run.smithi142.stdout: inet6 ::1/128 scope host 2023-12-12T09:44:46.149 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2023-12-12T09:44:46.149 INFO:teuthology.orchestra.run.smithi142.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-12T09:44:46.149 INFO:teuthology.orchestra.run.smithi142.stdout: link/ether 0c:c4:7a:d9:36:3c brd ff:ff:ff:ff:ff:ff 2023-12-12T09:44:46.149 INFO:teuthology.orchestra.run.smithi142.stdout: altname enp7s0f0 2023-12-12T09:44:46.149 INFO:teuthology.orchestra.run.smithi142.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-12T09:44:46.150 INFO:teuthology.orchestra.run.smithi142.stdout: link/ether 0c:c4:7a:d9:36:3d brd ff:ff:ff:ff:ff:ff 2023-12-12T09:44:46.150 INFO:teuthology.orchestra.run.smithi142.stdout: altname enp7s0f1 2023-12-12T09:44:46.150 INFO:teuthology.orchestra.run.smithi142.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-12T09:44:46.150 INFO:teuthology.orchestra.run.smithi142.stdout: link/ether 0c:c4:7a:88:6e:0c brd ff:ff:ff:ff:ff:ff 2023-12-12T09:44:46.150 INFO:teuthology.orchestra.run.smithi142.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-12T09:44:46.150 INFO:teuthology.orchestra.run.smithi142.stdout: link/ether 0c:c4:7a:88:6e:0d brd ff:ff:ff:ff:ff:ff 2023-12-12T09:44:46.150 INFO:teuthology.orchestra.run.smithi142.stdout: inet 172.21.15.142/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-12-12T09:44:46.150 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft 42316sec preferred_lft 42316sec 2023-12-12T09:44:46.150 INFO:teuthology.orchestra.run.smithi142.stdout: inet6 fe80::ec4:7aff:fe88:6e0d/64 scope link 2023-12-12T09:44:46.150 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2023-12-12T09:44:46.150 INFO:teuthology.orchestra.run.smithi142.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-12-12T09:44:46.150 INFO:teuthology.orchestra.run.smithi142.stdout: link/ether de:1c:dd:95:c8:e6 brd ff:ff:ff:ff:ff:ff 2023-12-12T09:44:46.150 INFO:teuthology.orchestra.run.smithi142.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-12-12T09:44:46.150 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2023-12-12T09:44:46.151 INFO:teuthology.orchestra.run.smithi142.stdout: inet6 fe80::f8b8:b6ff:fe33:420d/64 scope link 2023-12-12T09:44:46.151 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2023-12-12T09:44:46.151 INFO:teuthology.orchestra.run.smithi142.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-12T09:44:46.151 INFO:teuthology.orchestra.run.smithi142.stdout: link/ether de:1c:dd:95:c8:e6 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-12-12T09:44:46.151 INFO:teuthology.orchestra.run.smithi142.stdout: inet6 fe80::dc1c:ddff:fe95:c8e6/64 scope link 2023-12-12T09:44:46.151 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2023-12-12T09:44:46.151 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T09:44:46.151 DEBUG:teuthology.orchestra.run.smithi142:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-12T09:44:46.243 INFO:teuthology.orchestra.run.smithi142.stdout:1 2023-12-12T09:44:46.247 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T09:44:46.247 DEBUG:teuthology.orchestra.run.smithi142:> route 2023-12-12T09:44:46.301 INFO:teuthology.orchestra.run.smithi142.stdout:Kernel IP routing table 2023-12-12T09:44:46.301 INFO:teuthology.orchestra.run.smithi142.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-12T09:44:46.302 INFO:teuthology.orchestra.run.smithi142.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-12-12T09:44:46.302 INFO:teuthology.orchestra.run.smithi142.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-12-12T09:44:46.302 INFO:teuthology.orchestra.run.smithi142.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-12T09:44:46.302 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T09:44:46.302 DEBUG:teuthology.orchestra.run.smithi142:> (cd / && exec bash -c ' 2023-12-12T09:44:46.302 DEBUG:teuthology.orchestra.run.smithi142:> set -e 2023-12-12T09:44:46.302 DEBUG:teuthology.orchestra.run.smithi142:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-12-12T09:44:46.302 DEBUG:teuthology.orchestra.run.smithi142:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-12-12T09:44:46.302 DEBUG:teuthology.orchestra.run.smithi142:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-12-12T09:44:46.302 DEBUG:teuthology.orchestra.run.smithi142:> ') 2023-12-12T09:44:46.489 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T09:44:46.490 DEBUG:teuthology.orchestra.run.smithi142:> ip netns list 2023-12-12T09:44:46.542 INFO:teuthology.orchestra.run.smithi142.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-12-12T09:44:46.542 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-12-12T09:44:46.542 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T09:44:46.543 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip link set brx.0 up 2023-12-12T09:44:46.626 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-12T09:44:46.626 DEBUG:teuthology.orchestra.run.smithi142:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-12-12T09:44:46.679 INFO:teuthology.orchestra.run.smithi142.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-12-12T09:44:46.680 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-12T09:44:46.680 DEBUG:teuthology.orchestra.run.smithi142:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-12-12T09:44:46.729 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs2=/ 2023-12-12T09:44:46.729 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T09:44:46.729 DEBUG:teuthology.orchestra.run.smithi142:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs2=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-12T09:44:46.867 INFO:teuthology.orchestra.run.smithi142.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-12T09:44:46.867 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-12T09:44:46.902 INFO:teuthology.orchestra.run.smithi142.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-12T09:44:46.902 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-12T09:44:46.902 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: resolved to: "172.21.15.73:3300,172.21.15.142:3300,172.21.15.142:3301" 2023-12-12T09:44:46.902 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: trying mount with new device syntax: 1@ba240992-02b8-4c7e-92f2-27eb29ac433b.cephfs2=/ 2023-12-12T09:44:46.902 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.73:3300/172.21.15.142:3300/172.21.15.142:3301" will pass to kernel 2023-12-12T09:44:46.904 INFO:teuthology.orchestra.run.smithi142.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2023-12-12T09:44:46.904 INFO:teuthology.orchestra.run.smithi142.stdout: You just mounted a file system that supports labels which does not 2023-12-12T09:44:46.904 INFO:teuthology.orchestra.run.smithi142.stdout: contain labels, onto an SELinux box. It is likely that confined 2023-12-12T09:44:46.904 INFO:teuthology.orchestra.run.smithi142.stdout: applications will generate AVC messages and not be allowed access to 2023-12-12T09:44:46.905 INFO:teuthology.orchestra.run.smithi142.stdout: this file system. For more details see restorecon(8) and mount(8). 2023-12-12T09:44:46.910 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-12-12T09:44:46.911 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T09:44:46.911 DEBUG:teuthology.orchestra.run.smithi142:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-12-12T09:44:46.992 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T09:44:46.992 DEBUG:teuthology.orchestra.run.smithi142:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-12T09:44:47.065 INFO:teuthology.orchestra.run.smithi142.stdout:client5352 2023-12-12T09:44:47.065 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2023-12-12T09:44:47.065 DEBUG:teuthology.orchestra.run.smithi142:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-12T09:44:47.123 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs authorize cephfs client.testuser / rw 2023-12-12T09:44:47.351 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:47.350+0000 7f52c853e640 1 Processor -- start 2023-12-12T09:44:47.351 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:47.350+0000 7f52c853e640 1 -- start start 2023-12-12T09:44:47.353 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:47.351+0000 7f52c853e640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f52c00c5420 0x7f52c00c0320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:47.353 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:47.351+0000 7f52c853e640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52c00c3390 con 0x7f52c00a4c90 2023-12-12T09:44:47.353 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:47.351+0000 7f52c853e640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52c00c4b30 con 0x7f52c014ea60 2023-12-12T09:44:47.353 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:47.351+0000 7f52c853e640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52c00c5820 con 0x7f52c00c5420 2023-12-12T09:44:47.353 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:47.352+0000 7f52c6adb640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f52c00c5420 0x7f52c00c0320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:47.353 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:47.352+0000 7f52c6adb640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f52c00c5420 0x7f52c00c0320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:52882/0 (socket says 172.21.15.73:52882) 2023-12-12T09:44:47.353 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:47.352+0000 7f52c6adb640 1 -- 172.21.15.73:0/520298313 learned_addr learned my addr 172.21.15.73:0/520298313 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:44:47.353 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:47.352+0000 7f52c5ad9640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f52c00a4c90 0x7f52c00c20b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:44500/0 (socket says 172.21.15.73:44500) 2023-12-12T09:44:47.354 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:47.352+0000 7f52c6adb640 1 -- 172.21.15.73:0/520298313 >> v1:172.21.15.142:6789/0 conn(0x7f52c014ea60 legacy=0x7f52c00c4420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:44:47.354 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:47.352+0000 7f52c6adb640 1 -- 172.21.15.73:0/520298313 >> v1:172.21.15.73:6789/0 conn(0x7f52c00a4c90 legacy=0x7f52c00c20b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:47.354 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:47.352+0000 7f52c6adb640 1 -- 172.21.15.73:0/520298313 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52c0151e60 con 0x7f52c00c5420 2023-12-12T09:44:47.354 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:47.353+0000 7f52c6adb640 1 --2- 172.21.15.73:0/520298313 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f52c00c5420 0x7f52c00c0320 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f52b8009e50 tx=0x7f52b802bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb985edfb29ada5e server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:44:47.355 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:47.354+0000 7f52c52d8640 1 -- 172.21.15.73:0/520298313 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52b802ca80 con 0x7f52c00c5420 2023-12-12T09:44:47.355 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:47.354+0000 7f52c52d8640 1 -- 172.21.15.73:0/520298313 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52b802cbe0 con 0x7f52c00c5420 2023-12-12T09:44:47.355 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:47.354+0000 7f52c52d8640 1 -- 172.21.15.73:0/520298313 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52b80343f0 con 0x7f52c00c5420 2023-12-12T09:44:47.355 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:47.354+0000 7f52c853e640 1 -- 172.21.15.73:0/520298313 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f52c00c5420 msgr2=0x7f52c00c0320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:47.355 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:47.354+0000 7f52c853e640 1 --2- 172.21.15.73:0/520298313 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f52c00c5420 0x7f52c00c0320 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f52b8009e50 tx=0x7f52b802bee0 comp rx=0 tx=0).stop 2023-12-12T09:44:47.356 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:47.354+0000 7f52c853e640 1 -- 172.21.15.73:0/520298313 shutdown_connections 2023-12-12T09:44:47.356 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:47.354+0000 7f52c853e640 1 --2- 172.21.15.73:0/520298313 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f52c00c5420 0x7f52c00c0320 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:47.356 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:47.354+0000 7f52c853e640 1 -- 172.21.15.73:0/520298313 >> 172.21.15.73:0/520298313 conn(0x7f52c006a4e0 msgr2=0x7f52c006a8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:44:47.356 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:47.354+0000 7f52c853e640 1 -- 172.21.15.73:0/520298313 shutdown_connections 2023-12-12T09:44:47.356 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:47.354+0000 7f52c853e640 1 -- 172.21.15.73:0/520298313 wait complete. 2023-12-12T09:44:47.357 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:47.356+0000 7f52c853e640 1 Processor -- start 2023-12-12T09:44:47.357 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:47.356+0000 7f52c853e640 1 -- start start 2023-12-12T09:44:47.359 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:47.357+0000 7f52c853e640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f52c00a4c90 0x7f52c0147110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:47.359 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:47.357+0000 7f52c853e640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f52c00c5420 0x7f52c0150ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:47.359 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:47.357+0000 7f52c853e640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f52c014ea60 0x7f52c013d230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:47.359 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:47.357+0000 7f52c853e640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52c01421c0 con 0x7f52c014ea60 2023-12-12T09:44:47.359 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:47.357+0000 7f52c853e640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52c00a89d0 con 0x7f52c00c5420 2023-12-12T09:44:47.359 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:47.357+0000 7f52c853e640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52c00ab3e0 con 0x7f52c00a4c90 2023-12-12T09:44:47.359 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:47.357+0000 7f52c6adb640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f52c014ea60 0x7f52c013d230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:47.359 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:47.357+0000 7f52c6adb640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f52c014ea60 0x7f52c013d230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:52884/0 (socket says 172.21.15.73:52884) 2023-12-12T09:44:47.359 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:47.357+0000 7f52c6adb640 1 -- 172.21.15.73:0/1832711368 learned_addr learned my addr 172.21.15.73:0/1832711368 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:44:47.359 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:47.358+0000 7f52c5ad9640 1 --2- 172.21.15.73:0/1832711368 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f52c00c5420 0x7f52c0150ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:47.360 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:47.358+0000 7f52c62da640 1 --2- 172.21.15.73:0/1832711368 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f52c00a4c90 0x7f52c0147110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:47.360 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:47.358+0000 7f52c6adb640 1 -- 172.21.15.73:0/1832711368 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f52c00a4c90 msgr2=0x7f52c0147110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:47.360 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:47.358+0000 7f52c6adb640 1 --2- 172.21.15.73:0/1832711368 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f52c00a4c90 0x7f52c0147110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:47.360 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:47.358+0000 7f52c6adb640 1 -- 172.21.15.73:0/1832711368 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f52c00c5420 msgr2=0x7f52c0150ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:47.360 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:47.358+0000 7f52c6adb640 1 --2- 172.21.15.73:0/1832711368 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f52c00c5420 0x7f52c0150ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:47.360 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:47.358+0000 7f52c6adb640 1 -- 172.21.15.73:0/1832711368 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52b8009b30 con 0x7f52c014ea60 2023-12-12T09:44:47.361 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:47.358+0000 7f52c6adb640 1 --2- 172.21.15.73:0/1832711368 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f52c014ea60 0x7f52c013d230 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f52b8036040 tx=0x7f52b8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:44:47.361 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:47.358+0000 7f52b6ffd640 1 -- 172.21.15.73:0/1832711368 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52b803e450 con 0x7f52c014ea60 2023-12-12T09:44:47.361 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:47.358+0000 7f52b6ffd640 1 -- 172.21.15.73:0/1832711368 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52b803e5d0 con 0x7f52c014ea60 2023-12-12T09:44:47.361 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:47.358+0000 7f52b6ffd640 1 -- 172.21.15.73:0/1832711368 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52b803e980 con 0x7f52c014ea60 2023-12-12T09:44:47.361 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:47.359+0000 7f52c853e640 1 -- 172.21.15.73:0/1832711368 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52c0142410 con 0x7f52c014ea60 2023-12-12T09:44:47.361 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:47.359+0000 7f52c853e640 1 -- 172.21.15.73:0/1832711368 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52c00a8e60 con 0x7f52c014ea60 2023-12-12T09:44:47.361 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:47.360+0000 7f52c853e640 1 -- 172.21.15.73:0/1832711368 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52c0067070 con 0x7f52c014ea60 2023-12-12T09:44:47.362 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:47.361+0000 7f52b6ffd640 1 -- 172.21.15.73:0/1832711368 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f52b802cd50 con 0x7f52c014ea60 2023-12-12T09:44:47.363 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:47.362+0000 7f52b6ffd640 1 --2- 172.21.15.73:0/1832711368 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f52a406ae40 0x7f52a406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:47.363 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:47.362+0000 7f52b6ffd640 1 -- 172.21.15.73:0/1832711368 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f52b80ac580 con 0x7f52c014ea60 2023-12-12T09:44:47.363 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:47.362+0000 7f52c62da640 1 --2- 172.21.15.73:0/1832711368 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f52a406ae40 0x7f52a406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:47.364 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:47.363+0000 7f52c62da640 1 --2- 172.21.15.73:0/1832711368 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f52a406ae40 0x7f52a406d300 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f52bc006fd0 tx=0x7f52bc008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:44:47.368 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:47.367+0000 7f52b6ffd640 1 -- 172.21.15.73:0/1832711368 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f52b8077490 con 0x7f52c014ea60 2023-12-12T09:44:47.596 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:47.595+0000 7f52c853e640 1 -- 172.21.15.73:0/1832711368 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs authorize", "filesystem": "cephfs", "entity": "client.testuser", "caps": ["/", "rw"]} v 0) v1 -- 0x7f52c00a8b40 con 0x7f52c014ea60 2023-12-12T09:44:47.601 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:47.600+0000 7f52b6ffd640 1 -- 172.21.15.73:0/1832711368 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs authorize", "filesystem": "cephfs", "entity": "client.testuser", "caps": ["/", "rw"]}]=0 v13) v1 ==== 134+0+185 (secure 0 0 0) 0x7f52b807aab0 con 0x7f52c014ea60 2023-12-12T09:44:47.601 INFO:teuthology.orchestra.run.smithi073.stdout:[client.testuser] 2023-12-12T09:44:47.601 INFO:teuthology.orchestra.run.smithi073.stdout: key = AQCPK3hlZNaVIxAA196SzaOrmMbcymy0Qh6b2w== 2023-12-12T09:44:47.601 INFO:teuthology.orchestra.run.smithi073.stdout: caps mds = "allow rw fsname=cephfs" 2023-12-12T09:44:47.602 INFO:teuthology.orchestra.run.smithi073.stdout: caps mon = "allow r fsname=cephfs" 2023-12-12T09:44:47.602 INFO:teuthology.orchestra.run.smithi073.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2023-12-12T09:44:47.604 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:47.603+0000 7f52c853e640 1 -- 172.21.15.73:0/1832711368 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f52a406ae40 msgr2=0x7f52a406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:47.604 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:47.603+0000 7f52c853e640 1 --2- 172.21.15.73:0/1832711368 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f52a406ae40 0x7f52a406d300 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f52bc006fd0 tx=0x7f52bc008040 comp rx=0 tx=0).stop 2023-12-12T09:44:47.604 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:47.603+0000 7f52c853e640 1 -- 172.21.15.73:0/1832711368 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f52c014ea60 msgr2=0x7f52c013d230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:47.604 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:47.603+0000 7f52c853e640 1 --2- 172.21.15.73:0/1832711368 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f52c014ea60 0x7f52c013d230 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f52b8036040 tx=0x7f52b8004a40 comp rx=0 tx=0).stop 2023-12-12T09:44:47.605 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:47.603+0000 7f52c853e640 1 -- 172.21.15.73:0/1832711368 shutdown_connections 2023-12-12T09:44:47.605 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:47.603+0000 7f52c853e640 1 --2- 172.21.15.73:0/1832711368 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f52a406ae40 0x7f52a406d300 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:47.605 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:47.603+0000 7f52c853e640 1 --2- 172.21.15.73:0/1832711368 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f52c014ea60 0x7f52c013d230 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:47.605 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:47.603+0000 7f52c853e640 1 --2- 172.21.15.73:0/1832711368 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f52c00c5420 0x7f52c0150ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:47.605 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:47.603+0000 7f52c853e640 1 --2- 172.21.15.73:0/1832711368 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f52c00a4c90 0x7f52c0147110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:47.605 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:47.603+0000 7f52c853e640 1 -- 172.21.15.73:0/1832711368 >> 172.21.15.73:0/1832711368 conn(0x7f52c006a4e0 msgr2=0x7f52c006d620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:44:47.605 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:47.603+0000 7f52c853e640 1 -- 172.21.15.73:0/1832711368 shutdown_connections 2023-12-12T09:44:47.605 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:47.603+0000 7f52c853e640 1 -- 172.21.15.73:0/1832711368 wait complete. 2023-12-12T09:44:47.623 DEBUG:teuthology.orchestra.run.smithi073:> mktemp 2023-12-12T09:44:47.672 INFO:teuthology.orchestra.run.smithi073.stdout:/tmp/tmp.kVjhhLWB2K 2023-12-12T09:44:47.672 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2023-12-12T09:44:47.673 DEBUG:teuthology.orchestra.run.smithi073:> dd of=/tmp/tmp.kVjhhLWB2K 2023-12-12T09:44:47.720 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2023-12-12T09:44:47.720 DEBUG:teuthology.orchestra.run.smithi073:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-12T09:44:47.818 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2023-12-12T09:44:47.819 DEBUG:teuthology.orchestra.run.smithi073:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-12T09:44:47.867 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-12T09:44:48.132 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:48.130+0000 7ff54ff6e640 1 Processor -- start 2023-12-12T09:44:48.132 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:48.131+0000 7ff54ff6e640 1 -- start start 2023-12-12T09:44:48.133 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:48.132+0000 7ff54ff6e640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff54814fa40 0x7ff54806a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:48.133 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:48.132+0000 7ff54ff6e640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7ff5480c5070 0x7ff5480c40c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:48.133 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:48.132+0000 7ff54ff6e640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff548152610 con 0x7ff54806db70 2023-12-12T09:44:48.134 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:48.132+0000 7ff54ff6e640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5481528f0 con 0x7ff5480c5070 2023-12-12T09:44:48.134 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:48.132+0000 7ff54ff6e640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff548152bd0 con 0x7ff54814fa40 2023-12-12T09:44:48.134 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:48.132+0000 7ff54d509640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7ff54806db70 0x7ff5480c39b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:44508/0 (socket says 172.21.15.73:44508) 2023-12-12T09:44:48.134 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:48.132+0000 7ff54d509640 1 -- 172.21.15.73:0/3634569295 learned_addr learned my addr 172.21.15.73:0/3634569295 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-12T09:44:48.136 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:48.133+0000 7ff54e50b640 1 --2- 172.21.15.73:0/3634569295 >> v2:172.21.15.142:3300/0 conn(0x7ff5480c5070 0x7ff5480c40c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:48.136 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:48.133+0000 7ff54dd0a640 1 --2- 172.21.15.73:0/3634569295 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff54814fa40 0x7ff54806a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:48.136 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:48.133+0000 7ff54cd08640 1 -- 172.21.15.73:0/3634569295 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1807986178 0 0) 0x7ff548152610 con 0x7ff54806db70 2023-12-12T09:44:48.136 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:48.133+0000 7ff54cd08640 1 -- 172.21.15.73:0/3634569295 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff530003520 con 0x7ff54806db70 2023-12-12T09:44:48.136 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:48.133+0000 7ff54cd08640 1 -- 172.21.15.73:0/3634569295 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 95026062 0 0) 0x7ff530003520 con 0x7ff54806db70 2023-12-12T09:44:48.136 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:48.133+0000 7ff54cd08640 1 -- 172.21.15.73:0/3634569295 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff54814fa40 msgr2=0x7ff54806a4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:44:48.136 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:48.133+0000 7ff54cd08640 1 --2- 172.21.15.73:0/3634569295 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff54814fa40 0x7ff54806a4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:48.136 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:48.133+0000 7ff54cd08640 1 -- 172.21.15.73:0/3634569295 >> v2:172.21.15.142:3300/0 conn(0x7ff5480c5070 msgr2=0x7ff5480c40c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:44:48.136 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:48.133+0000 7ff54cd08640 1 --2- 172.21.15.73:0/3634569295 >> v2:172.21.15.142:3300/0 conn(0x7ff5480c5070 0x7ff5480c40c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:48.136 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:48.133+0000 7ff54cd08640 1 -- 172.21.15.73:0/3634569295 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff548152eb0 con 0x7ff54806db70 2023-12-12T09:44:48.136 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:48.133+0000 7ff54cd08640 1 -- 172.21.15.73:0/3634569295 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3186547832 0 0) 0x7ff53c001670 con 0x7ff54806db70 2023-12-12T09:44:48.136 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:48.133+0000 7ff54cd08640 1 -- 172.21.15.73:0/3634569295 >> v1:172.21.15.73:6789/0 conn(0x7ff54806db70 legacy=0x7ff5480c39b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:48.137 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:48.133+0000 7ff54cd08640 1 --2- 172.21.15.73:0/3634569295 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff530003970 0x7ff530003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:48.137 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:48.133+0000 7ff54cd08640 1 --2- 172.21.15.73:0/3634569295 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff5300047c0 0x7ff530004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:48.137 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:48.134+0000 7ff54cd08640 1 --2- 172.21.15.73:0/3634569295 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff54814fa40 0x7ff530005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:48.137 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:48.134+0000 7ff54cd08640 1 -- 172.21.15.73:0/3634569295 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5481528f0 con 0x7ff530003970 2023-12-12T09:44:48.137 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:48.134+0000 7ff54cd08640 1 -- 172.21.15.73:0/3634569295 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff548152bd0 con 0x7ff5300047c0 2023-12-12T09:44:48.137 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:48.134+0000 7ff54cd08640 1 -- 172.21.15.73:0/3634569295 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff53000b980 con 0x7ff54814fa40 2023-12-12T09:44:48.137 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:48.134+0000 7ff54dd0a640 1 --2- 172.21.15.73:0/3634569295 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff530003970 0x7ff530003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:48.137 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:48.134+0000 7ff54d509640 1 --2- 172.21.15.73:0/3634569295 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff5300047c0 0x7ff530004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:48.137 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:48.134+0000 7ff54e50b640 1 --2- 172.21.15.73:0/3634569295 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff54814fa40 0x7ff530005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:48.137 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:48.135+0000 7ff54dd0a640 1 -- 172.21.15.73:0/3634569295 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff54814fa40 msgr2=0x7ff530005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:44:48.137 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:48.135+0000 7ff54dd0a640 1 --2- 172.21.15.73:0/3634569295 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff54814fa40 0x7ff530005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:48.137 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:48.135+0000 7ff54dd0a640 1 -- 172.21.15.73:0/3634569295 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff5300047c0 msgr2=0x7ff530004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:44:48.137 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:48.135+0000 7ff54dd0a640 1 --2- 172.21.15.73:0/3634569295 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff5300047c0 0x7ff530004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:48.137 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:48.135+0000 7ff54dd0a640 1 -- 172.21.15.73:0/3634569295 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff530003520 con 0x7ff530003970 2023-12-12T09:44:48.138 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:48.135+0000 7ff54e50b640 1 --2- 172.21.15.73:0/3634569295 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff54814fa40 0x7ff530005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-12T09:44:48.139 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:48.136+0000 7ff54dd0a640 1 --2- 172.21.15.73:0/3634569295 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff530003970 0x7ff530003d90 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7ff538009fc0 tx=0x7ff5300057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f74e9ee8b80efa2a server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:44:48.139 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:48.136+0000 7ff54cd08640 1 -- 172.21.15.73:0/3634569295 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff53802cc00 con 0x7ff530003970 2023-12-12T09:44:48.139 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:48.136+0000 7ff54cd08640 1 -- 172.21.15.73:0/3634569295 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff53800f040 con 0x7ff530003970 2023-12-12T09:44:48.139 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:48.136+0000 7ff54cd08640 1 -- 172.21.15.73:0/3634569295 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff538034440 con 0x7ff530003970 2023-12-12T09:44:48.139 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:48.136+0000 7ff54ff6e640 1 -- 172.21.15.73:0/3634569295 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff530003970 msgr2=0x7ff530003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:48.139 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:48.136+0000 7ff54ff6e640 1 --2- 172.21.15.73:0/3634569295 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff530003970 0x7ff530003d90 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7ff538009fc0 tx=0x7ff5300057f0 comp rx=0 tx=0).stop 2023-12-12T09:44:48.139 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:48.137+0000 7ff54e50b640 1 -- 172.21.15.73:0/3634569295 reap_dead start 2023-12-12T09:44:48.139 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:48.137+0000 7ff54ff6e640 1 -- 172.21.15.73:0/3634569295 shutdown_connections 2023-12-12T09:44:48.139 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:48.137+0000 7ff54ff6e640 1 -- 172.21.15.73:0/3634569295 >> 172.21.15.73:0/3634569295 conn(0x7ff5480a8130 msgr2=0x7ff5480c24b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:44:48.139 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:48.137+0000 7ff54ff6e640 1 -- 172.21.15.73:0/3634569295 shutdown_connections 2023-12-12T09:44:48.139 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:48.137+0000 7ff54ff6e640 1 -- 172.21.15.73:0/3634569295 wait complete. 2023-12-12T09:44:48.140 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:48.139+0000 7ff54ff6e640 1 Processor -- start 2023-12-12T09:44:48.140 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:48.139+0000 7ff54ff6e640 1 -- start start 2023-12-12T09:44:48.143 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:48.139+0000 7ff54ff6e640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff530003970 0x7ff5481e85e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:48.143 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:48.140+0000 7ff54ff6e640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff5481537e0 0x7ff548154570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:48.143 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:48.140+0000 7ff54ff6e640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff5480c0ce0 0x7ff548150b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:48.143 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:48.140+0000 7ff54ff6e640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5481e8bc0 con 0x7ff5480c0ce0 2023-12-12T09:44:48.143 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:48.140+0000 7ff54ff6e640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff548151fd0 con 0x7ff530003970 2023-12-12T09:44:48.143 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:48.140+0000 7ff54ff6e640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5481522b0 con 0x7ff5481537e0 2023-12-12T09:44:48.143 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:48.140+0000 7ff54e50b640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff5480c0ce0 0x7ff548150b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:48.143 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:48.140+0000 7ff54e50b640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff5480c0ce0 0x7ff548150b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:52894/0 (socket says 172.21.15.73:52894) 2023-12-12T09:44:48.143 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:48.140+0000 7ff54e50b640 1 -- 172.21.15.73:0/260674255 learned_addr learned my addr 172.21.15.73:0/260674255 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:44:48.143 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:48.140+0000 7ff54e50b640 1 -- 172.21.15.73:0/260674255 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff5481537e0 msgr2=0x7ff548154570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:48.143 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:48.140+0000 7ff54e50b640 1 --2- 172.21.15.73:0/260674255 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff5481537e0 0x7ff548154570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:48.144 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:48.140+0000 7ff54e50b640 1 -- 172.21.15.73:0/260674255 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff530003970 msgr2=0x7ff5481e85e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:48.144 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:48.140+0000 7ff54dd0a640 1 --2- 172.21.15.73:0/260674255 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff530003970 0x7ff5481e85e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:48.144 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:48.140+0000 7ff54e50b640 1 --2- 172.21.15.73:0/260674255 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff530003970 0x7ff5481e85e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:48.144 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:48.140+0000 7ff54e50b640 1 -- 172.21.15.73:0/260674255 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff548150380 con 0x7ff5480c0ce0 2023-12-12T09:44:48.144 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:48.141+0000 7ff54e50b640 1 --2- 172.21.15.73:0/260674255 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff5480c0ce0 0x7ff548150b80 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7ff54806e480 tx=0x7ff540009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:44:48.144 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:48.141+0000 7ff5467fc640 1 -- 172.21.15.73:0/260674255 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff540004440 con 0x7ff5480c0ce0 2023-12-12T09:44:48.144 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:48.141+0000 7ff5467fc640 1 -- 172.21.15.73:0/260674255 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff540003610 con 0x7ff5480c0ce0 2023-12-12T09:44:48.144 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:48.141+0000 7ff5467fc640 1 -- 172.21.15.73:0/260674255 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5400039c0 con 0x7ff5480c0ce0 2023-12-12T09:44:48.144 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:48.141+0000 7ff54ff6e640 1 -- 172.21.15.73:0/260674255 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff548150660 con 0x7ff5480c0ce0 2023-12-12T09:44:48.144 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:48.141+0000 7ff54ff6e640 1 -- 172.21.15.73:0/260674255 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5480c1190 con 0x7ff5480c0ce0 2023-12-12T09:44:48.145 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:48.142+0000 7ff54ff6e640 1 -- 172.21.15.73:0/260674255 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff548150850 con 0x7ff5480c0ce0 2023-12-12T09:44:48.145 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:48.143+0000 7ff5467fc640 1 -- 172.21.15.73:0/260674255 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7ff540003b20 con 0x7ff5480c0ce0 2023-12-12T09:44:48.145 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:48.144+0000 7ff5467fc640 1 --2- 172.21.15.73:0/260674255 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7ff53406ae70 0x7ff53406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:48.145 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:48.144+0000 7ff5467fc640 1 -- 172.21.15.73:0/260674255 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6565+0+0 (secure 0 0 0) 0x7ff540089d40 con 0x7ff5480c0ce0 2023-12-12T09:44:48.145 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:48.144+0000 7ff54dd0a640 1 --2- 172.21.15.73:0/260674255 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7ff53406ae70 0x7ff53406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:48.146 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:48.145+0000 7ff54dd0a640 1 --2- 172.21.15.73:0/260674255 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7ff53406ae70 0x7ff53406d330 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7ff538036000 tx=0x7ff53802e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:44:48.150 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:48.149+0000 7ff5467fc640 1 -- 172.21.15.73:0/260674255 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7ff540054b20 con 0x7ff5480c0ce0 2023-12-12T09:44:48.345 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:48.343+0000 7ff54ff6e640 1 -- 172.21.15.73:0/260674255 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff5480c4580 con 0x7ff5480c0ce0 2023-12-12T09:44:48.347 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:48.346+0000 7ff5467fc640 1 -- 172.21.15.73:0/260674255 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v38) v1 ==== 74+0+20241 (secure 0 0 0) 0x7ff540058140 con 0x7ff5480c0ce0 2023-12-12T09:44:48.348 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-12T09:44:48.348 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":38,"fsid":"ba240992-02b8-4c7e-92f2-27eb29ac433b","created":"2023-12-12T09:43:02.454719+0000","modified":"2023-12-12T09:44:37.659373+0000","last_up_change":"2023-12-12T09:43:13.913440+0000","last_in_change":"2023-12-12T09:43:05.925348+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-12T09:43:15.525508+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-12-12T09:44:18.641446+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-12-12T09:44:19.952405+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs2_metadata","create_time":"2023-12-12T09:44:34.424645+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs2_data","create_time":"2023-12-12T09:44:35.090149+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"dd9074be-dbe2-4c34-9896-a4223d8d3940","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":4047810203},{"type":"v1","addr":"172.21.15.73:6801","nonce":4047810203}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":4047810203},{"type":"v1","addr":"172.21.15.73:6803","nonce":4047810203}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":4047810203},{"type":"v1","addr":"172.21.15.73:6807","nonce":4047810203}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":4047810203},{"type":"v1","addr":"172.21.15.73:6805","nonce":4047810203}]},"public_addr":"172.21.15.73:6801/4047810203","cluster_addr":"172.21.15.73:6803/4047810203","heartbeat_back_addr":"172.21.15.73:6807/4047810203","heartbeat_front_addr":"172.21.15.73:6805/4047810203","state":["exists","up"]},{"osd":1,"uuid":"c4a05052-96d4-4758-a4e1-1a37f1e07fed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":1356058331},{"type":"v1","addr":"172.21.15.73:6824","nonce":1356058331}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":1356058331},{"type":"v1","addr":"172.21.15.73:6827","nonce":1356058331}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":1356058331},{"type":"v1","addr":"172.21.15.73:6831","nonce":1356058331}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":1356058331},{"type":"v1","addr":"172.21.15.73:6829","nonce":1356058331}]},"public_addr":"172.21.15.73:6824/1356058331","cluster_addr":"172.21.15.73:6827/1356058331","heartbeat_back_addr":"172.21.15.73:6831/1356058331","heartbeat_front_addr":"172.21.15.73:6829/1356058331","state":["exists","up"]},{"osd":2,"uuid":"512bc8ac-72c2-40d4-b3d2-d867a92c5213","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":1228903316},{"type":"v1","addr":"172.21.15.73:6817","nonce":1228903316}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":1228903316},{"type":"v1","addr":"172.21.15.73:6819","nonce":1228903316}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6823","nonce":1228903316},{"type":"v1","addr":"172.21.15.73:6825","nonce":1228903316}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":1228903316},{"type":"v1","addr":"172.21.15.73:6821","nonce":1228903316}]},"public_addr":"172.21.15.73:6817/1228903316","cluster_addr":"172.21.15.73:6819/1228903316","heartbeat_back_addr":"172.21.15.73:6825/1228903316","heartbeat_front_addr":"172.21.15.73:6821/1228903316","state":["exists","up"]},{"osd":3,"uuid":"3d1a91e0-42bf-437a-8eae-8d357c8f63a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":1293329670},{"type":"v1","addr":"172.21.15.73:6809","nonce":1293329670}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6810","nonce":1293329670},{"type":"v1","addr":"172.21.15.73:6811","nonce":1293329670}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":1293329670},{"type":"v1","addr":"172.21.15.73:6815","nonce":1293329670}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":1293329670},{"type":"v1","addr":"172.21.15.73:6813","nonce":1293329670}]},"public_addr":"172.21.15.73:6809/1293329670","cluster_addr":"172.21.15.73:6811/1293329670","heartbeat_back_addr":"172.21.15.73:6815/1293329670","heartbeat_front_addr":"172.21.15.73:6813/1293329670","state":["exists","up"]},{"osd":4,"uuid":"4b302fff-834c-4069-ac19-00e46f6c87b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":3727975702},{"type":"v1","addr":"172.21.15.142:6801","nonce":3727975702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":3727975702},{"type":"v1","addr":"172.21.15.142:6803","nonce":3727975702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6809","nonce":3727975702},{"type":"v1","addr":"172.21.15.142:6811","nonce":3727975702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6805","nonce":3727975702},{"type":"v1","addr":"172.21.15.142:6807","nonce":3727975702}]},"public_addr":"172.21.15.142:6801/3727975702","cluster_addr":"172.21.15.142:6803/3727975702","heartbeat_back_addr":"172.21.15.142:6811/3727975702","heartbeat_front_addr":"172.21.15.142:6807/3727975702","state":["exists","up"]},{"osd":5,"uuid":"d7cdace2-67d0-45cc-95f2-515cf6ef1b82","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6817","nonce":2353193632},{"type":"v1","addr":"172.21.15.142:6819","nonce":2353193632}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6821","nonce":2353193632},{"type":"v1","addr":"172.21.15.142:6823","nonce":2353193632}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6829","nonce":2353193632},{"type":"v1","addr":"172.21.15.142:6831","nonce":2353193632}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6825","nonce":2353193632},{"type":"v1","addr":"172.21.15.142:6827","nonce":2353193632}]},"public_addr":"172.21.15.142:6819/2353193632","cluster_addr":"172.21.15.142:6823/2353193632","heartbeat_back_addr":"172.21.15.142:6831/2353193632","heartbeat_front_addr":"172.21.15.142:6827/2353193632","state":["exists","up"]},{"osd":6,"uuid":"649ce78a-5626-445c-aedc-a651ed05a6f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":2006111986},{"type":"v1","addr":"172.21.15.142:6806","nonce":2006111986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":2006111986},{"type":"v1","addr":"172.21.15.142:6810","nonce":2006111986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":2006111986},{"type":"v1","addr":"172.21.15.142:6815","nonce":2006111986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":2006111986},{"type":"v1","addr":"172.21.15.142:6813","nonce":2006111986}]},"public_addr":"172.21.15.142:6806/2006111986","cluster_addr":"172.21.15.142:6810/2006111986","heartbeat_back_addr":"172.21.15.142:6815/2006111986","heartbeat_front_addr":"172.21.15.142:6813/2006111986","state":["exists","up"]},{"osd":7,"uuid":"af15ae3b-c1d0-4acf-92db-8a1805494d13","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":2573794341},{"type":"v1","addr":"172.21.15.142:6818","nonce":2573794341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":2573794341},{"type":"v1","addr":"172.21.15.142:6822","nonce":2573794341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":2573794341},{"type":"v1","addr":"172.21.15.142:6830","nonce":2573794341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":2573794341},{"type":"v1","addr":"172.21.15.142:6826","nonce":2573794341}]},"public_addr":"172.21.15.142:6818/2573794341","cluster_addr":"172.21.15.142:6822/2573794341","heartbeat_back_addr":"172.21.15.142:6830/2573794341","heartbeat_front_addr":"172.21.15.142:6826/2573794341","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.185824+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.262103+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.225556+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:10.523459+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:10.706035+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.257339+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.301776+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.051960+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-12T09:44:48.350 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:48.349+0000 7ff54ff6e640 1 -- 172.21.15.73:0/260674255 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7ff53406ae70 msgr2=0x7ff53406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:48.350 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:48.349+0000 7ff54ff6e640 1 --2- 172.21.15.73:0/260674255 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7ff53406ae70 0x7ff53406d330 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7ff538036000 tx=0x7ff53802e000 comp rx=0 tx=0).stop 2023-12-12T09:44:48.350 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:48.349+0000 7ff54ff6e640 1 -- 172.21.15.73:0/260674255 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff5480c0ce0 msgr2=0x7ff548150b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:48.350 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:48.349+0000 7ff54ff6e640 1 --2- 172.21.15.73:0/260674255 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff5480c0ce0 0x7ff548150b80 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7ff54806e480 tx=0x7ff540009f90 comp rx=0 tx=0).stop 2023-12-12T09:44:48.350 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:48.349+0000 7ff54ff6e640 1 -- 172.21.15.73:0/260674255 shutdown_connections 2023-12-12T09:44:48.351 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:48.349+0000 7ff54ff6e640 1 --2- 172.21.15.73:0/260674255 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7ff53406ae70 0x7ff53406d330 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:48.351 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:48.349+0000 7ff54ff6e640 1 --2- 172.21.15.73:0/260674255 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff5480c0ce0 0x7ff548150b80 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:48.351 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:48.349+0000 7ff54ff6e640 1 --2- 172.21.15.73:0/260674255 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff5481537e0 0x7ff548154570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:48.351 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:48.349+0000 7ff54ff6e640 1 --2- 172.21.15.73:0/260674255 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff530003970 0x7ff5481e85e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:48.351 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:48.349+0000 7ff54ff6e640 1 -- 172.21.15.73:0/260674255 >> 172.21.15.73:0/260674255 conn(0x7ff5480a8130 msgr2=0x7ff5480a6810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:44:48.351 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:48.349+0000 7ff54ff6e640 1 -- 172.21.15.73:0/260674255 shutdown_connections 2023-12-12T09:44:48.351 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:48.349+0000 7ff54ff6e640 1 -- 172.21.15.73:0/260674255 wait complete. 2023-12-12T09:44:48.370 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-12T09:43:15.525508+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-12T09:44:18.641446+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '33', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data', 'create_time': '2023-12-12T09:44:19.952405+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '34', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs2_metadata', 'create_time': '2023-12-12T09:44:34.424645+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '37', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs2'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'cephfs2_data', 'create_time': '2023-12-12T09:44:35.090149+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '38', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs2'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-12T09:44:48.371 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-12T09:44:48.482 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T09:44:48.491 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T09:44:48.587 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:48.586+0000 7f2245125640 1 Processor -- start 2023-12-12T09:44:48.587 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:48.586+0000 7f2245125640 1 -- start start 2023-12-12T09:44:48.591 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:48.587+0000 7f2245125640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2240070340 0x7f22400c32f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:48.591 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:48.587+0000 7f2245125640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22400c7510 con 0x7f22400c3830 2023-12-12T09:44:48.591 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:48.587+0000 7f2245125640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2240158410 con 0x7f22401588a0 2023-12-12T09:44:48.591 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:48.587+0000 7f2245125640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f224006ce90 con 0x7f2240070340 2023-12-12T09:44:48.591 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:48.588+0000 7f223f59e640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f22400c3830 0x7f224015ef70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:44514/0 (socket says 172.21.15.73:44514) 2023-12-12T09:44:48.591 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:48.588+0000 7f223f59e640 1 -- 172.21.15.73:0/2659544967 learned_addr learned my addr 172.21.15.73:0/2659544967 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-12T09:44:48.591 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:48.588+0000 7f223ed9d640 1 --2- 172.21.15.73:0/2659544967 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2240070340 0x7f22400c32f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:48.591 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:48.588+0000 7f223dd9b640 1 -- 172.21.15.73:0/2659544967 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 164184998 0 0) 0x7f22400c7510 con 0x7f22400c3830 2023-12-12T09:44:48.591 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:48.588+0000 7f223dd9b640 1 -- 172.21.15.73:0/2659544967 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2228003520 con 0x7f22400c3830 2023-12-12T09:44:48.592 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:48.589+0000 7f223dd9b640 1 -- 172.21.15.73:0/2659544967 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2575906099 0 0) 0x7f2228003520 con 0x7f22400c3830 2023-12-12T09:44:48.592 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:48.589+0000 7f223dd9b640 1 -- 172.21.15.73:0/2659544967 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2240070340 msgr2=0x7f22400c32f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:44:48.592 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:48.589+0000 7f223dd9b640 1 --2- 172.21.15.73:0/2659544967 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2240070340 0x7f22400c32f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:48.592 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:48.589+0000 7f223dd9b640 1 -- 172.21.15.73:0/2659544967 >> v1:172.21.15.142:6789/0 conn(0x7f22401588a0 legacy=0x7f22400c0f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:48.592 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:48.589+0000 7f223dd9b640 1 -- 172.21.15.73:0/2659544967 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22400c7760 con 0x7f22400c3830 2023-12-12T09:44:48.592 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:48.589+0000 7f223dd9b640 1 -- 172.21.15.73:0/2659544967 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3186547832 0 0) 0x7f22380019f0 con 0x7f22400c3830 2023-12-12T09:44:48.592 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:48.589+0000 7f223dd9b640 1 -- 172.21.15.73:0/2659544967 >> v1:172.21.15.73:6789/0 conn(0x7f22400c3830 legacy=0x7f224015ef70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:48.592 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:48.589+0000 7f223dd9b640 1 --2- 172.21.15.73:0/2659544967 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f22280039a0 0x7f2228003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:48.592 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:48.589+0000 7f223dd9b640 1 --2- 172.21.15.73:0/2659544967 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f22280047c0 0x7f2228004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:48.592 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:48.589+0000 7f223dd9b640 1 --2- 172.21.15.73:0/2659544967 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2240070340 0x7f22280051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:48.593 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:48.589+0000 7f223dd9b640 1 -- 172.21.15.73:0/2659544967 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f224006ce90 con 0x7f22280047c0 2023-12-12T09:44:48.593 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:48.589+0000 7f223dd9b640 1 -- 172.21.15.73:0/2659544967 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f222800bab0 con 0x7f22280039a0 2023-12-12T09:44:48.593 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:48.589+0000 7f223dd9b640 1 -- 172.21.15.73:0/2659544967 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f222800bc70 con 0x7f2240070340 2023-12-12T09:44:48.593 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:48.589+0000 7f223e59c640 1 --2- 172.21.15.73:0/2659544967 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f22280047c0 0x7f2228004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:48.593 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:48.589+0000 7f223ed9d640 1 --2- 172.21.15.73:0/2659544967 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f22280039a0 0x7f2228003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:48.593 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:48.589+0000 7f223f59e640 1 --2- 172.21.15.73:0/2659544967 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2240070340 0x7f22280051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:48.593 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:48.589+0000 7f223e59c640 1 -- 172.21.15.73:0/2659544967 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2240070340 msgr2=0x7f22280051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:44:48.593 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:48.589+0000 7f223e59c640 1 --2- 172.21.15.73:0/2659544967 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2240070340 0x7f22280051c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:48.593 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:48.589+0000 7f223e59c640 1 -- 172.21.15.73:0/2659544967 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f22280039a0 msgr2=0x7f2228003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:44:48.593 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:48.589+0000 7f223e59c640 1 --2- 172.21.15.73:0/2659544967 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f22280039a0 0x7f2228003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:48.593 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:48.589+0000 7f223e59c640 1 -- 172.21.15.73:0/2659544967 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2228003520 con 0x7f22280047c0 2023-12-12T09:44:48.597 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:48.590+0000 7f223e59c640 1 --2- 172.21.15.73:0/2659544967 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f22280047c0 0x7f2228004c40 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f2234001750 tx=0x7f22280057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16cb14e0026301c8 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:44:48.597 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:48.591+0000 7f223dd9b640 1 -- 172.21.15.73:0/2659544967 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22340052d0 con 0x7f22280047c0 2023-12-12T09:44:48.597 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:48.591+0000 7f223dd9b640 1 -- 172.21.15.73:0/2659544967 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f223402e050 con 0x7f22280047c0 2023-12-12T09:44:48.597 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:48.591+0000 7f223dd9b640 1 -- 172.21.15.73:0/2659544967 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22340035f0 con 0x7f22280047c0 2023-12-12T09:44:48.597 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:48.591+0000 7f2245125640 1 -- 172.21.15.73:0/2659544967 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f22280047c0 msgr2=0x7f2228004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:48.597 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:48.591+0000 7f2245125640 1 --2- 172.21.15.73:0/2659544967 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f22280047c0 0x7f2228004c40 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f2234001750 tx=0x7f22280057f0 comp rx=0 tx=0).stop 2023-12-12T09:44:48.597 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:48.591+0000 7f223f59e640 1 -- 172.21.15.73:0/2659544967 reap_dead start 2023-12-12T09:44:48.598 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:48.591+0000 7f2245125640 1 -- 172.21.15.73:0/2659544967 shutdown_connections 2023-12-12T09:44:48.598 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:48.591+0000 7f2245125640 1 -- 172.21.15.73:0/2659544967 >> 172.21.15.73:0/2659544967 conn(0x7f22400c7ba0 msgr2=0x7f22400c7fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:44:48.598 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:48.591+0000 7f2245125640 1 -- 172.21.15.73:0/2659544967 shutdown_connections 2023-12-12T09:44:48.598 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:48.591+0000 7f2245125640 1 -- 172.21.15.73:0/2659544967 wait complete. 2023-12-12T09:44:48.598 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:48.593+0000 7f2245125640 1 Processor -- start 2023-12-12T09:44:48.598 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:48.593+0000 7f2245125640 1 -- start start 2023-12-12T09:44:48.598 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:48.594+0000 7f2245125640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f22280047c0 0x7f22400ab680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:48.598 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:48.594+0000 7f2245125640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f22400aab30 0x7f22401ed4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:48.598 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:48.594+0000 7f2245125640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2240157480 0x7f22401567a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:48.598 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:48.594+0000 7f2245125640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22400a8460 con 0x7f2240157480 2023-12-12T09:44:48.598 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:48.594+0000 7f2245125640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2240155d00 con 0x7f22280047c0 2023-12-12T09:44:48.599 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:48.594+0000 7f2245125640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22401edce0 con 0x7f22400aab30 2023-12-12T09:44:48.599 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:48.594+0000 7f223f59e640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2240157480 0x7f22401567a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:48.599 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:48.595+0000 7f223f59e640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2240157480 0x7f22401567a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:52914/0 (socket says 172.21.15.73:52914) 2023-12-12T09:44:48.599 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:48.595+0000 7f223f59e640 1 -- 172.21.15.73:0/2466561242 learned_addr learned my addr 172.21.15.73:0/2466561242 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:44:48.599 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:48.595+0000 7f223ed9d640 1 --2- 172.21.15.73:0/2466561242 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f22280047c0 0x7f22400ab680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:48.599 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:48.595+0000 7f223e59c640 1 --2- 172.21.15.73:0/2466561242 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f22400aab30 0x7f22401ed4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:48.599 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:48.595+0000 7f223f59e640 1 -- 172.21.15.73:0/2466561242 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f22400aab30 msgr2=0x7f22401ed4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:48.599 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:48.595+0000 7f223f59e640 1 --2- 172.21.15.73:0/2466561242 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f22400aab30 0x7f22401ed4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:48.599 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:48.595+0000 7f223f59e640 1 -- 172.21.15.73:0/2466561242 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f22280047c0 msgr2=0x7f22400ab680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:48.599 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:48.595+0000 7f223f59e640 1 --2- 172.21.15.73:0/2466561242 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f22280047c0 0x7f22400ab680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:48.600 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:48.595+0000 7f223f59e640 1 -- 172.21.15.73:0/2466561242 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22401edfc0 con 0x7f2240157480 2023-12-12T09:44:48.600 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:48.595+0000 7f223f59e640 1 --2- 172.21.15.73:0/2466561242 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2240157480 0x7f22401567a0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f2238001370 tx=0x7f223800b4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:44:48.600 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:48.595+0000 7f22277fe640 1 -- 172.21.15.73:0/2466561242 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f223800bb80 con 0x7f2240157480 2023-12-12T09:44:48.600 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:48.595+0000 7f22277fe640 1 -- 172.21.15.73:0/2466561242 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f223800bd00 con 0x7f2240157480 2023-12-12T09:44:48.600 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:48.595+0000 7f22277fe640 1 -- 172.21.15.73:0/2466561242 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2238007350 con 0x7f2240157480 2023-12-12T09:44:48.600 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:48.596+0000 7f2245125640 1 -- 172.21.15.73:0/2466561242 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2240155fa0 con 0x7f2240157480 2023-12-12T09:44:48.600 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:48.596+0000 7f2245125640 1 -- 172.21.15.73:0/2466561242 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22401ed9e0 con 0x7f2240157480 2023-12-12T09:44:48.601 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:48.597+0000 7f2245125640 1 -- 172.21.15.73:0/2466561242 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22401564c0 con 0x7f2240157480 2023-12-12T09:44:48.601 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:48.598+0000 7f22277fe640 1 -- 172.21.15.73:0/2466561242 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f22380074b0 con 0x7f2240157480 2023-12-12T09:44:48.601 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:48.599+0000 7f22277fe640 1 --2- 172.21.15.73:0/2466561242 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f222c06ae40 0x7f222c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:48.601 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:48.599+0000 7f22277fe640 1 -- 172.21.15.73:0/2466561242 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f2238089c90 con 0x7f2240157480 2023-12-12T09:44:48.602 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:48.599+0000 7f223ed9d640 1 --2- 172.21.15.73:0/2466561242 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f222c06ae40 0x7f222c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:48.602 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:48.600+0000 7f223ed9d640 1 --2- 172.21.15.73:0/2466561242 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f222c06ae40 0x7f222c06d300 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f22400a7480 tx=0x7f2230008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:44:48.604 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:48.603+0000 7f22277fe640 1 -- 172.21.15.73:0/2466561242 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f22401564c0 con 0x7f2240157480 2023-12-12T09:44:48.794 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:48.793+0000 7f2245125640 1 -- 172.21.15.73:0/2466561242 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f22401564c0 con 0x7f2240157480 2023-12-12T09:44:48.795 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:48.794+0000 7f22277fe640 1 -- 172.21.15.73:0/2466561242 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v38) v1 ==== 93+0+10 (secure 0 0 0) 0x7f22401564c0 con 0x7f2240157480 2023-12-12T09:44:48.795 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 1 2023-12-12T09:44:48.798 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:48.796+0000 7f2245125640 1 -- 172.21.15.73:0/2466561242 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f222c06ae40 msgr2=0x7f222c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:48.798 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:48.796+0000 7f2245125640 1 --2- 172.21.15.73:0/2466561242 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f222c06ae40 0x7f222c06d300 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f22400a7480 tx=0x7f2230008040 comp rx=0 tx=0).stop 2023-12-12T09:44:48.798 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:48.796+0000 7f2245125640 1 -- 172.21.15.73:0/2466561242 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2240157480 msgr2=0x7f22401567a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:48.798 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:48.796+0000 7f2245125640 1 --2- 172.21.15.73:0/2466561242 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2240157480 0x7f22401567a0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f2238001370 tx=0x7f223800b4a0 comp rx=0 tx=0).stop 2023-12-12T09:44:48.798 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:48.796+0000 7f2245125640 1 -- 172.21.15.73:0/2466561242 shutdown_connections 2023-12-12T09:44:48.798 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:48.796+0000 7f2245125640 1 --2- 172.21.15.73:0/2466561242 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f222c06ae40 0x7f222c06d300 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:48.798 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:48.796+0000 7f2245125640 1 --2- 172.21.15.73:0/2466561242 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2240157480 0x7f22401567a0 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:48.798 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:48.796+0000 7f2245125640 1 --2- 172.21.15.73:0/2466561242 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f22400aab30 0x7f22401ed4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:48.798 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:48.796+0000 7f2245125640 1 --2- 172.21.15.73:0/2466561242 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f22280047c0 0x7f22400ab680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:48.798 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:48.796+0000 7f2245125640 1 -- 172.21.15.73:0/2466561242 >> 172.21.15.73:0/2466561242 conn(0x7f22400c7ba0 msgr2=0x7f22400c2640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:44:48.798 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:48.796+0000 7f2245125640 1 -- 172.21.15.73:0/2466561242 shutdown_connections 2023-12-12T09:44:48.798 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:48.796+0000 7f2245125640 1 -- 172.21.15.73:0/2466561242 wait complete. 2023-12-12T09:44:48.817 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-12T09:44:49.083 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:49.082+0000 7f31dcc00640 1 Processor -- start 2023-12-12T09:44:49.084 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:49.082+0000 7f31dcc00640 1 -- start start 2023-12-12T09:44:49.085 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:49.084+0000 7f31dcc00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f31d80c0320 0x7f31d806cc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:49.086 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:49.084+0000 7f31dcc00640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31d80c1520 con 0x7f31d80c23b0 2023-12-12T09:44:49.086 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:49.084+0000 7f31dcc00640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31d80c2c20 con 0x7f31d80c2790 2023-12-12T09:44:49.086 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:49.084+0000 7f31dcc00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31d80c46f0 con 0x7f31d80c0320 2023-12-12T09:44:49.086 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:49.084+0000 7f31d659c640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f31d80c23b0 0x7f31d8159410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:52796/0 (socket says 172.21.15.73:52796) 2023-12-12T09:44:49.086 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:49.084+0000 7f31d659c640 1 -- 172.21.15.73:0/3471038219 learned_addr learned my addr 172.21.15.73:0/3471038219 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-12T09:44:49.086 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:49.084+0000 7f31cdd9b640 1 --2- 172.21.15.73:0/3471038219 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f31d80c0320 0x7f31d806cc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:49.089 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:49.085+0000 7f31d5d9b640 1 -- 172.21.15.73:0/3471038219 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 343513742 0 0) 0x7f31c8001110 con 0x7f31d80c23b0 2023-12-12T09:44:49.090 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:49.085+0000 7f31d5d9b640 1 -- 172.21.15.73:0/3471038219 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f31c4003520 con 0x7f31d80c23b0 2023-12-12T09:44:49.090 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:49.085+0000 7f31cdd9b640 1 -- 172.21.15.73:0/3471038219 >> v1:172.21.15.142:6789/0 conn(0x7f31d80c2790 legacy=0x7f31d80c50d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:49.090 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:49.085+0000 7f31cdd9b640 1 -- 172.21.15.73:0/3471038219 >> v1:172.21.15.73:6789/0 conn(0x7f31d80c23b0 legacy=0x7f31d8159410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:49.090 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:49.085+0000 7f31cdd9b640 1 -- 172.21.15.73:0/3471038219 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31d80c57e0 con 0x7f31d80c0320 2023-12-12T09:44:49.090 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:49.086+0000 7f31cdd9b640 1 --2- 172.21.15.73:0/3471038219 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f31d80c0320 0x7f31d806cc90 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f31c00097d0 tx=0x7f31c002b820 comp rx=0 tx=0).ready entity=mon.2 client_cookie=682a325fb3fb2132 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:44:49.090 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:49.087+0000 7f31d5d9b640 1 -- 172.21.15.73:0/3471038219 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31c0031780 con 0x7f31d80c0320 2023-12-12T09:44:49.090 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:49.087+0000 7f31d5d9b640 1 -- 172.21.15.73:0/3471038219 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31c00318e0 con 0x7f31d80c0320 2023-12-12T09:44:49.090 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:49.087+0000 7f31d5d9b640 1 -- 172.21.15.73:0/3471038219 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31c0031c50 con 0x7f31d80c0320 2023-12-12T09:44:49.090 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:49.087+0000 7f31dcc00640 1 -- 172.21.15.73:0/3471038219 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f31d80c0320 msgr2=0x7f31d806cc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:49.090 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:49.087+0000 7f31dcc00640 1 --2- 172.21.15.73:0/3471038219 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f31d80c0320 0x7f31d806cc90 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f31c00097d0 tx=0x7f31c002b820 comp rx=0 tx=0).stop 2023-12-12T09:44:49.090 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:49.088+0000 7f31dcc00640 1 -- 172.21.15.73:0/3471038219 shutdown_connections 2023-12-12T09:44:49.090 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:49.088+0000 7f31dcc00640 1 --2- 172.21.15.73:0/3471038219 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f31d80c0320 0x7f31d806cc90 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:49.090 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:49.088+0000 7f31dcc00640 1 -- 172.21.15.73:0/3471038219 >> 172.21.15.73:0/3471038219 conn(0x7f31d806a4e0 msgr2=0x7f31d806a8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:44:49.091 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:49.088+0000 7f31dcc00640 1 -- 172.21.15.73:0/3471038219 shutdown_connections 2023-12-12T09:44:49.091 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:49.088+0000 7f31dcc00640 1 -- 172.21.15.73:0/3471038219 wait complete. 2023-12-12T09:44:49.091 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:49.089+0000 7f31dcc00640 1 Processor -- start 2023-12-12T09:44:49.091 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:49.090+0000 7f31dcc00640 1 -- start start 2023-12-12T09:44:49.092 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:49.091+0000 7f31dcc00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f31d80c0320 0x7f31d814ceb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:49.092 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:49.091+0000 7f31dcc00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f31d80c23b0 0x7f31d80aa650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:49.092 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:49.091+0000 7f31dcc00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f31d80c2790 0x7f31d81502a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:49.092 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:49.091+0000 7f31dcc00640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31d81ef370 con 0x7f31d80c2790 2023-12-12T09:44:49.092 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:49.091+0000 7f31dcc00640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31d814cbd0 con 0x7f31d80c23b0 2023-12-12T09:44:49.092 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:49.091+0000 7f31dcc00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31d81ee5b0 con 0x7f31d80c0320 2023-12-12T09:44:49.093 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:49.091+0000 7f31d6d9d640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f31d80c2790 0x7f31d81502a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:49.093 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:49.091+0000 7f31d6d9d640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f31d80c2790 0x7f31d81502a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:34064/0 (socket says 172.21.15.73:34064) 2023-12-12T09:44:49.093 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:49.091+0000 7f31d6d9d640 1 -- 172.21.15.73:0/3284645071 learned_addr learned my addr 172.21.15.73:0/3284645071 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:44:49.093 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:49.091+0000 7f31d659c640 1 --2- 172.21.15.73:0/3284645071 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f31d80c0320 0x7f31d814ceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:49.094 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:49.092+0000 7f31cdd9b640 1 --2- 172.21.15.73:0/3284645071 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f31d80c23b0 0x7f31d80aa650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:49.094 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:49.092+0000 7f31d6d9d640 1 -- 172.21.15.73:0/3284645071 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f31d80c0320 msgr2=0x7f31d814ceb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:49.094 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:49.092+0000 7f31d6d9d640 1 --2- 172.21.15.73:0/3284645071 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f31d80c0320 0x7f31d814ceb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:49.094 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:49.092+0000 7f31d6d9d640 1 -- 172.21.15.73:0/3284645071 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f31d80c23b0 msgr2=0x7f31d80aa650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:49.094 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:49.092+0000 7f31d6d9d640 1 --2- 172.21.15.73:0/3284645071 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f31d80c23b0 0x7f31d80aa650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:49.094 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:49.092+0000 7f31d6d9d640 1 -- 172.21.15.73:0/3284645071 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31c0009400 con 0x7f31d80c2790 2023-12-12T09:44:49.094 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:49.092+0000 7f31d659c640 1 --2- 172.21.15.73:0/3284645071 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f31d80c0320 0x7f31d814ceb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-12T09:44:49.094 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:49.092+0000 7f31d6d9d640 1 --2- 172.21.15.73:0/3284645071 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f31d80c2790 0x7f31d81502a0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f31d000c7a0 tx=0x7f31d000cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:44:49.095 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:49.092+0000 7f31cf7fe640 1 -- 172.21.15.73:0/3284645071 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31d0003b70 con 0x7f31d80c2790 2023-12-12T09:44:49.095 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:49.092+0000 7f31cf7fe640 1 -- 172.21.15.73:0/3284645071 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31d0003cf0 con 0x7f31d80c2790 2023-12-12T09:44:49.095 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:49.092+0000 7f31dcc00640 1 -- 172.21.15.73:0/3284645071 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31d81ee890 con 0x7f31d80c2790 2023-12-12T09:44:49.095 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:49.092+0000 7f31cf7fe640 1 -- 172.21.15.73:0/3284645071 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31d0003ea0 con 0x7f31d80c2790 2023-12-12T09:44:49.095 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:49.092+0000 7f31dcc00640 1 -- 172.21.15.73:0/3284645071 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31d81eee50 con 0x7f31d80c2790 2023-12-12T09:44:49.095 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:49.093+0000 7f31dcc00640 1 -- 172.21.15.73:0/3284645071 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31d81eefe0 con 0x7f31d80c2790 2023-12-12T09:44:49.095 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:49.094+0000 7f31cf7fe640 1 -- 172.21.15.73:0/3284645071 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f31d000aa90 con 0x7f31d80c2790 2023-12-12T09:44:49.096 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:49.095+0000 7f31cf7fe640 1 --2- 172.21.15.73:0/3284645071 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f31b806ae40 0x7f31b806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:49.096 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:49.095+0000 7f31cf7fe640 1 -- 172.21.15.73:0/3284645071 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f31d0089620 con 0x7f31d80c2790 2023-12-12T09:44:49.097 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:49.096+0000 7f31d659c640 1 --2- 172.21.15.73:0/3284645071 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f31b806ae40 0x7f31b806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:49.097 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:49.096+0000 7f31d659c640 1 --2- 172.21.15.73:0/3284645071 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f31b806ae40 0x7f31b806d300 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f31c8001270 tx=0x7f31c8009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:44:49.102 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:49.101+0000 7f31cf7fe640 1 -- 172.21.15.73:0/3284645071 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f31d0054360 con 0x7f31d80c2790 2023-12-12T09:44:49.294 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:49.293+0000 7f31dcc00640 1 -- 172.21.15.73:0/3284645071 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f31d80c2c20 con 0x7f31d80c2790 2023-12-12T09:44:49.295 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:49.294+0000 7f31cf7fe640 1 -- 172.21.15.73:0/3284645071 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v38) v1 ==== 104+0+11 (secure 0 0 0) 0x7f31d80c2c20 con 0x7f31d80c2790 2023-12-12T09:44:49.295 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 32 2023-12-12T09:44:49.297 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:49.296+0000 7f31dcc00640 1 -- 172.21.15.73:0/3284645071 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f31b806ae40 msgr2=0x7f31b806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:49.298 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:49.296+0000 7f31dcc00640 1 --2- 172.21.15.73:0/3284645071 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f31b806ae40 0x7f31b806d300 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f31c8001270 tx=0x7f31c8009040 comp rx=0 tx=0).stop 2023-12-12T09:44:49.298 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:49.296+0000 7f31dcc00640 1 -- 172.21.15.73:0/3284645071 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f31d80c2790 msgr2=0x7f31d81502a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:49.298 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:49.296+0000 7f31dcc00640 1 --2- 172.21.15.73:0/3284645071 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f31d80c2790 0x7f31d81502a0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f31d000c7a0 tx=0x7f31d000cc60 comp rx=0 tx=0).stop 2023-12-12T09:44:49.298 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:49.296+0000 7f31dcc00640 1 -- 172.21.15.73:0/3284645071 shutdown_connections 2023-12-12T09:44:49.298 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:49.296+0000 7f31dcc00640 1 --2- 172.21.15.73:0/3284645071 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f31b806ae40 0x7f31b806d300 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:49.298 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:49.296+0000 7f31dcc00640 1 --2- 172.21.15.73:0/3284645071 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f31d80c2790 0x7f31d81502a0 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:49.298 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:49.296+0000 7f31dcc00640 1 --2- 172.21.15.73:0/3284645071 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f31d80c23b0 0x7f31d80aa650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:49.298 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:49.296+0000 7f31dcc00640 1 --2- 172.21.15.73:0/3284645071 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f31d80c0320 0x7f31d814ceb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:49.298 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:49.296+0000 7f31dcc00640 1 -- 172.21.15.73:0/3284645071 >> 172.21.15.73:0/3284645071 conn(0x7f31d806a4e0 msgr2=0x7f31d8073410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:44:49.298 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:49.296+0000 7f31dcc00640 1 -- 172.21.15.73:0/3284645071 shutdown_connections 2023-12-12T09:44:49.298 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:49.297+0000 7f31dcc00640 1 -- 172.21.15.73:0/3284645071 wait complete. 2023-12-12T09:44:49.315 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-12T09:44:49.528 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:49.526+0000 7f2caaa9f640 1 Processor -- start 2023-12-12T09:44:49.528 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:49.527+0000 7f2caaa9f640 1 -- start start 2023-12-12T09:44:49.529 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:49.528+0000 7f2caaa9f640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f2ca40a4d00 0x7f2ca40c0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:49.529 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:49.528+0000 7f2caaa9f640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2ca41529a0 0x7f2ca40a8880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:49.530 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:49.528+0000 7f2caaa9f640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ca41521e0 con 0x7f2ca414c190 2023-12-12T09:44:49.530 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:49.528+0000 7f2caaa9f640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ca40c1890 con 0x7f2ca40a4d00 2023-12-12T09:44:49.530 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:49.528+0000 7f2caaa9f640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ca4151fd0 con 0x7f2ca41529a0 2023-12-12T09:44:49.530 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:49.528+0000 7f2ca929c640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f2ca40a4d00 0x7f2ca40c0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:49.530 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:49.528+0000 7f2ca929c640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f2ca40a4d00 0x7f2ca40c0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:34068/0 (socket says 172.21.15.73:34068) 2023-12-12T09:44:49.530 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:49.528+0000 7f2ca929c640 1 -- 172.21.15.73:0/3370002559 learned_addr learned my addr 172.21.15.73:0/3370002559 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:44:49.531 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:49.529+0000 7f2caa29e640 1 --2- 172.21.15.73:0/3370002559 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2ca41529a0 0x7f2ca40a8880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:49.531 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:49.529+0000 7f2ca929c640 1 -- 172.21.15.73:0/3370002559 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2ca41529a0 msgr2=0x7f2ca40a8880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:44:49.531 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:49.529+0000 7f2ca929c640 1 --2- 172.21.15.73:0/3370002559 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2ca41529a0 0x7f2ca40a8880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:49.531 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:49.529+0000 7f2ca929c640 1 -- 172.21.15.73:0/3370002559 >> v1:172.21.15.142:6789/0 conn(0x7f2ca414c190 legacy=0x7f2ca41555c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:44:49.531 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:49.529+0000 7f2ca929c640 1 -- 172.21.15.73:0/3370002559 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ca40c1aa0 con 0x7f2ca40a4d00 2023-12-12T09:44:49.531 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:49.530+0000 7f2ca929c640 1 --2- 172.21.15.73:0/3370002559 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2ca40a4d00 0x7f2ca40c0e00 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f2c94009870 tx=0x7f2c9402b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e328ce9d8b8a0d2c server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:44:49.532 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:49.531+0000 7f2ca8a9b640 1 -- 172.21.15.73:0/3370002559 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c940317c0 con 0x7f2ca40a4d00 2023-12-12T09:44:49.532 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:49.531+0000 7f2ca8a9b640 1 -- 172.21.15.73:0/3370002559 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c94031920 con 0x7f2ca40a4d00 2023-12-12T09:44:49.532 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:49.531+0000 7f2ca8a9b640 1 -- 172.21.15.73:0/3370002559 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c94031cb0 con 0x7f2ca40a4d00 2023-12-12T09:44:49.533 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:49.531+0000 7f2caaa9f640 1 -- 172.21.15.73:0/3370002559 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2ca40a4d00 msgr2=0x7f2ca40c0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:49.533 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:49.531+0000 7f2caaa9f640 1 --2- 172.21.15.73:0/3370002559 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2ca40a4d00 0x7f2ca40c0e00 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f2c94009870 tx=0x7f2c9402b860 comp rx=0 tx=0).stop 2023-12-12T09:44:49.533 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:49.531+0000 7f2caaa9f640 1 -- 172.21.15.73:0/3370002559 shutdown_connections 2023-12-12T09:44:49.533 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:49.531+0000 7f2caaa9f640 1 --2- 172.21.15.73:0/3370002559 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2ca41529a0 0x7f2ca40a8880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:49.533 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:49.531+0000 7f2caaa9f640 1 --2- 172.21.15.73:0/3370002559 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2ca40a4d00 0x7f2ca40c0e00 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:49.533 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:49.531+0000 7f2caaa9f640 1 -- 172.21.15.73:0/3370002559 >> 172.21.15.73:0/3370002559 conn(0x7f2ca406a4e0 msgr2=0x7f2ca406a8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:44:49.533 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:49.531+0000 7f2caaa9f640 1 -- 172.21.15.73:0/3370002559 shutdown_connections 2023-12-12T09:44:49.533 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:49.532+0000 7f2caaa9f640 1 -- 172.21.15.73:0/3370002559 wait complete. 2023-12-12T09:44:49.534 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:49.533+0000 7f2caaa9f640 1 Processor -- start 2023-12-12T09:44:49.534 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:49.533+0000 7f2caaa9f640 1 -- start start 2023-12-12T09:44:49.537 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:49.534+0000 7f2caaa9f640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2ca40a4d00 0x7f2ca414f3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:49.537 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:49.534+0000 7f2caaa9f640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2ca414c190 0x7f2ca4148970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:49.537 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:49.534+0000 7f2caaa9f640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2ca41529a0 0x7f2ca41ea250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:49.537 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:49.534+0000 7f2caaa9f640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ca4153a40 con 0x7f2ca414c190 2023-12-12T09:44:49.537 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:49.534+0000 7f2caaa9f640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ca40a7290 con 0x7f2ca41529a0 2023-12-12T09:44:49.537 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:49.534+0000 7f2caaa9f640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ca414ec80 con 0x7f2ca40a4d00 2023-12-12T09:44:49.537 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:49.535+0000 7f2ca929c640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2ca414c190 0x7f2ca4148970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:49.537 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:49.535+0000 7f2ca929c640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2ca414c190 0x7f2ca4148970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:34072/0 (socket says 172.21.15.73:34072) 2023-12-12T09:44:49.537 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:49.535+0000 7f2ca929c640 1 -- 172.21.15.73:0/1841788372 learned_addr learned my addr 172.21.15.73:0/1841788372 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:44:49.537 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:49.535+0000 7f2ca9a9d640 1 --2- 172.21.15.73:0/1841788372 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2ca40a4d00 0x7f2ca414f3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:49.538 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:49.535+0000 7f2ca929c640 1 -- 172.21.15.73:0/1841788372 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2ca40a4d00 msgr2=0x7f2ca414f3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:49.538 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:49.535+0000 7f2caa29e640 1 --2- 172.21.15.73:0/1841788372 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2ca41529a0 0x7f2ca41ea250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:49.538 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:49.535+0000 7f2ca929c640 1 --2- 172.21.15.73:0/1841788372 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2ca40a4d00 0x7f2ca414f3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:49.538 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:49.535+0000 7f2ca929c640 1 -- 172.21.15.73:0/1841788372 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2ca41529a0 msgr2=0x7f2ca41ea250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:49.538 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:49.535+0000 7f2ca929c640 1 --2- 172.21.15.73:0/1841788372 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2ca41529a0 0x7f2ca41ea250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:49.538 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:49.535+0000 7f2ca929c640 1 -- 172.21.15.73:0/1841788372 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c940094d0 con 0x7f2ca414c190 2023-12-12T09:44:49.538 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:49.535+0000 7f2ca9a9d640 1 --2- 172.21.15.73:0/1841788372 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2ca40a4d00 0x7f2ca414f3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:44:49.538 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:49.535+0000 7f2ca929c640 1 --2- 172.21.15.73:0/1841788372 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2ca414c190 0x7f2ca4148970 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f2c94000c00 tx=0x7f2c940046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:44:49.538 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:49.536+0000 7f2c9a7fc640 1 -- 172.21.15.73:0/1841788372 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c94032860 con 0x7f2ca414c190 2023-12-12T09:44:49.538 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:49.536+0000 7f2c9a7fc640 1 -- 172.21.15.73:0/1841788372 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c940329c0 con 0x7f2ca414c190 2023-12-12T09:44:49.538 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:49.536+0000 7f2c9a7fc640 1 -- 172.21.15.73:0/1841788372 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c94032d70 con 0x7f2ca414c190 2023-12-12T09:44:49.538 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:49.536+0000 7f2caaa9f640 1 -- 172.21.15.73:0/1841788372 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ca414ef60 con 0x7f2ca414c190 2023-12-12T09:44:49.538 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:49.536+0000 7f2caaa9f640 1 -- 172.21.15.73:0/1841788372 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ca414f930 con 0x7f2ca414c190 2023-12-12T09:44:49.539 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:49.537+0000 7f2caaa9f640 1 -- 172.21.15.73:0/1841788372 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ca40c2060 con 0x7f2ca414c190 2023-12-12T09:44:49.539 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:49.538+0000 7f2c9a7fc640 1 -- 172.21.15.73:0/1841788372 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f2c9404e450 con 0x7f2ca414c190 2023-12-12T09:44:49.540 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:49.539+0000 7f2c9a7fc640 1 --2- 172.21.15.73:0/1841788372 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f2c8806ae40 0x7f2c8806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:49.540 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:49.539+0000 7f2c9a7fc640 1 -- 172.21.15.73:0/1841788372 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f2c940abc30 con 0x7f2ca414c190 2023-12-12T09:44:49.540 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:49.539+0000 7f2ca9a9d640 1 --2- 172.21.15.73:0/1841788372 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f2c8806ae40 0x7f2c8806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:49.540 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:49.540+0000 7f2ca9a9d640 1 --2- 172.21.15.73:0/1841788372 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f2c8806ae40 0x7f2c8806d300 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f2ca000a830 tx=0x7f2ca0008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:44:49.544 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:49.543+0000 7f2c9a7fc640 1 -- 172.21.15.73:0/1841788372 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f2c94076ac0 con 0x7f2ca414c190 2023-12-12T09:44:49.734 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:49.733+0000 7f2caaa9f640 1 -- 172.21.15.73:0/1841788372 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f2ca4067400 con 0x7f2ca414c190 2023-12-12T09:44:49.735 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:49.734+0000 7f2c9a7fc640 1 -- 172.21.15.73:0/1841788372 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v38) v1 ==== 100+0+11 (secure 0 0 0) 0x7f2c9407a0e0 con 0x7f2ca414c190 2023-12-12T09:44:49.735 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 64 2023-12-12T09:44:49.738 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:49.737+0000 7f2caaa9f640 1 -- 172.21.15.73:0/1841788372 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f2c8806ae40 msgr2=0x7f2c8806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:49.738 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:49.737+0000 7f2caaa9f640 1 --2- 172.21.15.73:0/1841788372 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f2c8806ae40 0x7f2c8806d300 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f2ca000a830 tx=0x7f2ca0008040 comp rx=0 tx=0).stop 2023-12-12T09:44:49.739 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:49.737+0000 7f2caaa9f640 1 -- 172.21.15.73:0/1841788372 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2ca414c190 msgr2=0x7f2ca4148970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:49.739 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:49.737+0000 7f2caaa9f640 1 --2- 172.21.15.73:0/1841788372 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2ca414c190 0x7f2ca4148970 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f2c94000c00 tx=0x7f2c940046c0 comp rx=0 tx=0).stop 2023-12-12T09:44:49.739 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:49.737+0000 7f2caaa9f640 1 -- 172.21.15.73:0/1841788372 shutdown_connections 2023-12-12T09:44:49.739 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:49.737+0000 7f2caaa9f640 1 --2- 172.21.15.73:0/1841788372 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f2c8806ae40 0x7f2c8806d300 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:49.739 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:49.737+0000 7f2caaa9f640 1 --2- 172.21.15.73:0/1841788372 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2ca41529a0 0x7f2ca41ea250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:49.739 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:49.737+0000 7f2caaa9f640 1 --2- 172.21.15.73:0/1841788372 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2ca414c190 0x7f2ca4148970 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:49.739 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:49.737+0000 7f2caaa9f640 1 --2- 172.21.15.73:0/1841788372 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2ca40a4d00 0x7f2ca414f3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:49.739 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:49.737+0000 7f2caaa9f640 1 -- 172.21.15.73:0/1841788372 >> 172.21.15.73:0/1841788372 conn(0x7f2ca406a4e0 msgr2=0x7f2ca414b440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:44:49.739 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:49.737+0000 7f2caaa9f640 1 -- 172.21.15.73:0/1841788372 shutdown_connections 2023-12-12T09:44:49.739 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:49.737+0000 7f2caaa9f640 1 -- 172.21.15.73:0/1841788372 wait complete. 2023-12-12T09:44:49.756 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_metadata pg_num 2023-12-12T09:44:49.974 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:49.973+0000 7ff8f3933640 1 Processor -- start 2023-12-12T09:44:49.975 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:49.973+0000 7ff8f3933640 1 -- start start 2023-12-12T09:44:49.976 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:49.975+0000 7ff8f3933640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff8ec14ea60 0x7ff8ec0c5420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:49.976 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:49.975+0000 7ff8f3933640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7ff8ec0a4c90 0x7ff8ec0c0320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:49.976 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:49.975+0000 7ff8f3933640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7ff8ec0c4420 0x7ff8ec0c20b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:49.976 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:49.975+0000 7ff8f3933640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8ec0c3390 con 0x7ff8ec0a4c90 2023-12-12T09:44:49.977 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:49.975+0000 7ff8f3933640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8ec151e60 con 0x7ff8ec0c4420 2023-12-12T09:44:49.977 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:49.975+0000 7ff8f3933640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8ec152140 con 0x7ff8ec14ea60 2023-12-12T09:44:49.977 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:49.975+0000 7ff8f0ece640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7ff8ec0a4c90 0x7ff8ec0c0320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:49.977 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:49.975+0000 7ff8f0ece640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7ff8ec0a4c90 0x7ff8ec0c0320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:34074/0 (socket says 172.21.15.73:34074) 2023-12-12T09:44:49.977 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:49.975+0000 7ff8f0ece640 1 -- 172.21.15.73:0/2933807915 learned_addr learned my addr 172.21.15.73:0/2933807915 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:44:49.978 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:49.976+0000 7ff8f1ed0640 1 --2- 172.21.15.73:0/2933807915 >> v2:172.21.15.142:3300/0 conn(0x7ff8ec0c4420 0x7ff8ec0c20b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:49.978 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:49.976+0000 7ff8f16cf640 1 --2- 172.21.15.73:0/2933807915 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff8ec14ea60 0x7ff8ec0c5420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:49.978 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:49.976+0000 7ff8f0ece640 1 -- 172.21.15.73:0/2933807915 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff8ec14ea60 msgr2=0x7ff8ec0c5420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:44:49.978 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:49.976+0000 7ff8f0ece640 1 --2- 172.21.15.73:0/2933807915 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff8ec14ea60 0x7ff8ec0c5420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:49.978 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:49.976+0000 7ff8f0ece640 1 -- 172.21.15.73:0/2933807915 >> v2:172.21.15.142:3300/0 conn(0x7ff8ec0c4420 msgr2=0x7ff8ec0c20b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:44:49.979 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:49.976+0000 7ff8f0ece640 1 --2- 172.21.15.73:0/2933807915 >> v2:172.21.15.142:3300/0 conn(0x7ff8ec0c4420 0x7ff8ec0c20b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:49.979 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:49.976+0000 7ff8f0ece640 1 -- 172.21.15.73:0/2933807915 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8ec0c3940 con 0x7ff8ec0a4c90 2023-12-12T09:44:49.979 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:49.977+0000 7ff8f0ece640 1 --2- 172.21.15.73:0/2933807915 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff8ec0a4c90 0x7ff8ec0c0320 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7ff8ec06b5a0 tx=0x7ff8dc02b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ddaec23081e7afb server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:44:49.979 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:49.977+0000 7ff8e3fff640 1 -- 172.21.15.73:0/2933807915 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8dc0317e0 con 0x7ff8ec0a4c90 2023-12-12T09:44:49.979 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:49.977+0000 7ff8e3fff640 1 -- 172.21.15.73:0/2933807915 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8dc031940 con 0x7ff8ec0a4c90 2023-12-12T09:44:49.979 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:49.977+0000 7ff8e3fff640 1 -- 172.21.15.73:0/2933807915 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8dc031cd0 con 0x7ff8ec0a4c90 2023-12-12T09:44:49.980 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:49.978+0000 7ff8f3933640 1 -- 172.21.15.73:0/2933807915 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff8ec0a4c90 msgr2=0x7ff8ec0c0320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:49.980 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:49.978+0000 7ff8f3933640 1 --2- 172.21.15.73:0/2933807915 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff8ec0a4c90 0x7ff8ec0c0320 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7ff8ec06b5a0 tx=0x7ff8dc02b880 comp rx=0 tx=0).stop 2023-12-12T09:44:49.980 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:49.978+0000 7ff8f3933640 1 -- 172.21.15.73:0/2933807915 shutdown_connections 2023-12-12T09:44:49.980 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:49.978+0000 7ff8f3933640 1 --2- 172.21.15.73:0/2933807915 >> v2:172.21.15.142:3300/0 conn(0x7ff8ec0c4420 0x7ff8ec0c20b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:49.980 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:49.978+0000 7ff8f3933640 1 --2- 172.21.15.73:0/2933807915 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff8ec0a4c90 0x7ff8ec0c0320 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:49.980 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:49.978+0000 7ff8f3933640 1 --2- 172.21.15.73:0/2933807915 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff8ec14ea60 0x7ff8ec0c5420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:49.980 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:49.978+0000 7ff8f3933640 1 -- 172.21.15.73:0/2933807915 >> 172.21.15.73:0/2933807915 conn(0x7ff8ec06a4e0 msgr2=0x7ff8ec06a8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:44:49.980 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:49.978+0000 7ff8f3933640 1 -- 172.21.15.73:0/2933807915 shutdown_connections 2023-12-12T09:44:49.980 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:49.978+0000 7ff8f3933640 1 -- 172.21.15.73:0/2933807915 wait complete. 2023-12-12T09:44:49.981 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:49.980+0000 7ff8f3933640 1 Processor -- start 2023-12-12T09:44:49.981 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:49.980+0000 7ff8f3933640 1 -- start start 2023-12-12T09:44:49.984 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:49.982+0000 7ff8f3933640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff8ec0a4c90 0x7ff8ec1dfab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:49.984 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:49.982+0000 7ff8f3933640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff8ec0c4420 0x7ff8ec14aec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:49.984 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:49.982+0000 7ff8f3933640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff8ec14ea60 0x7ff8ec14b400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:49.985 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:49.982+0000 7ff8f3933640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8ec14b940 con 0x7ff8ec0a4c90 2023-12-12T09:44:49.985 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:49.982+0000 7ff8f3933640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8ec14f0b0 con 0x7ff8ec14ea60 2023-12-12T09:44:49.985 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:49.982+0000 7ff8f3933640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8ec14c360 con 0x7ff8ec0c4420 2023-12-12T09:44:49.985 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:49.982+0000 7ff8f16cf640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff8ec0a4c90 0x7ff8ec1dfab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:49.985 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:49.982+0000 7ff8f16cf640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff8ec0a4c90 0x7ff8ec1dfab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:34080/0 (socket says 172.21.15.73:34080) 2023-12-12T09:44:49.985 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:49.982+0000 7ff8f16cf640 1 -- 172.21.15.73:0/3302472988 learned_addr learned my addr 172.21.15.73:0/3302472988 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:44:49.985 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:49.982+0000 7ff8f16cf640 1 -- 172.21.15.73:0/3302472988 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff8ec0c4420 msgr2=0x7ff8ec14aec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:49.985 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:49.982+0000 7ff8f0ece640 1 --2- 172.21.15.73:0/3302472988 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff8ec0c4420 0x7ff8ec14aec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:49.985 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:49.982+0000 7ff8f16cf640 1 --2- 172.21.15.73:0/3302472988 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff8ec0c4420 0x7ff8ec14aec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:49.986 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:49.982+0000 7ff8f16cf640 1 -- 172.21.15.73:0/3302472988 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff8ec14ea60 msgr2=0x7ff8ec14b400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:49.986 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:49.982+0000 7ff8f16cf640 1 --2- 172.21.15.73:0/3302472988 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff8ec14ea60 0x7ff8ec14b400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:49.986 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:49.982+0000 7ff8f16cf640 1 -- 172.21.15.73:0/3302472988 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8dc0094d0 con 0x7ff8ec0a4c90 2023-12-12T09:44:49.986 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:49.982+0000 7ff8f0ece640 1 --2- 172.21.15.73:0/3302472988 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff8ec0c4420 0x7ff8ec14aec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:44:49.986 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:49.983+0000 7ff8f16cf640 1 --2- 172.21.15.73:0/3302472988 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff8ec0a4c90 0x7ff8ec1dfab0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7ff8e800d620 tx=0x7ff8e800dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:44:49.986 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:49.983+0000 7ff8e1ffb640 1 -- 172.21.15.73:0/3302472988 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8e800b620 con 0x7ff8ec0a4c90 2023-12-12T09:44:49.986 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:49.983+0000 7ff8e1ffb640 1 -- 172.21.15.73:0/3302472988 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8e800b780 con 0x7ff8ec0a4c90 2023-12-12T09:44:49.986 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:49.983+0000 7ff8e1ffb640 1 -- 172.21.15.73:0/3302472988 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8e800bb30 con 0x7ff8ec0a4c90 2023-12-12T09:44:49.986 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:49.983+0000 7ff8f3933640 1 -- 172.21.15.73:0/3302472988 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8ec1513e0 con 0x7ff8ec0a4c90 2023-12-12T09:44:49.986 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:49.983+0000 7ff8f3933640 1 -- 172.21.15.73:0/3302472988 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8ec151070 con 0x7ff8ec0a4c90 2023-12-12T09:44:49.987 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:49.985+0000 7ff8f3933640 1 -- 172.21.15.73:0/3302472988 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8ec067070 con 0x7ff8ec0a4c90 2023-12-12T09:44:49.987 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:49.985+0000 7ff8e1ffb640 1 -- 172.21.15.73:0/3302472988 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7ff8e800bc90 con 0x7ff8ec0a4c90 2023-12-12T09:44:49.987 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:49.986+0000 7ff8e1ffb640 1 --2- 172.21.15.73:0/3302472988 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7ff8d006ae40 0x7ff8d006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:49.988 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:49.987+0000 7ff8e1ffb640 1 -- 172.21.15.73:0/3302472988 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6565+0+0 (secure 0 0 0) 0x7ff8e8089ce0 con 0x7ff8ec0a4c90 2023-12-12T09:44:49.988 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:49.987+0000 7ff8f0ece640 1 --2- 172.21.15.73:0/3302472988 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7ff8d006ae40 0x7ff8d006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:49.989 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:49.988+0000 7ff8f0ece640 1 --2- 172.21.15.73:0/3302472988 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7ff8d006ae40 0x7ff8d006d300 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7ff8dc036000 tx=0x7ff8dc03d040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:44:49.992 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:49.991+0000 7ff8e1ffb640 1 -- 172.21.15.73:0/3302472988 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7ff8e8054ac0 con 0x7ff8ec0a4c90 2023-12-12T09:44:50.185 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:50.183+0000 7ff8f3933640 1 -- 172.21.15.73:0/3302472988 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"} v 0) v1 -- 0x7ff8ec067580 con 0x7ff8ec0a4c90 2023-12-12T09:44:50.185 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:50.184+0000 7ff8e1ffb640 1 -- 172.21.15.73:0/3302472988 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"}]=0 v38) v1 ==== 105+0+11 (secure 0 0 0) 0x7ff8e80580e0 con 0x7ff8ec0a4c90 2023-12-12T09:44:50.186 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 32 2023-12-12T09:44:50.187 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:50.186+0000 7ff8f3933640 1 -- 172.21.15.73:0/3302472988 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7ff8d006ae40 msgr2=0x7ff8d006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:50.188 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:50.186+0000 7ff8f3933640 1 --2- 172.21.15.73:0/3302472988 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7ff8d006ae40 0x7ff8d006d300 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7ff8dc036000 tx=0x7ff8dc03d040 comp rx=0 tx=0).stop 2023-12-12T09:44:50.188 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:50.186+0000 7ff8f3933640 1 -- 172.21.15.73:0/3302472988 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff8ec0a4c90 msgr2=0x7ff8ec1dfab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:50.188 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:50.186+0000 7ff8f3933640 1 --2- 172.21.15.73:0/3302472988 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff8ec0a4c90 0x7ff8ec1dfab0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7ff8e800d620 tx=0x7ff8e800dae0 comp rx=0 tx=0).stop 2023-12-12T09:44:50.189 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:50.187+0000 7ff8f3933640 1 -- 172.21.15.73:0/3302472988 shutdown_connections 2023-12-12T09:44:50.189 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:50.187+0000 7ff8f3933640 1 --2- 172.21.15.73:0/3302472988 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7ff8d006ae40 0x7ff8d006d300 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:50.190 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:50.187+0000 7ff8f3933640 1 --2- 172.21.15.73:0/3302472988 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff8ec14ea60 0x7ff8ec14b400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:50.190 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:50.187+0000 7ff8f3933640 1 --2- 172.21.15.73:0/3302472988 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff8ec0c4420 0x7ff8ec14aec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:50.190 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:50.187+0000 7ff8f3933640 1 --2- 172.21.15.73:0/3302472988 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff8ec0a4c90 0x7ff8ec1dfab0 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:50.191 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:50.187+0000 7ff8f3933640 1 -- 172.21.15.73:0/3302472988 >> 172.21.15.73:0/3302472988 conn(0x7ff8ec06a4e0 msgr2=0x7ff8ec06a8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:44:50.191 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:50.187+0000 7ff8f3933640 1 -- 172.21.15.73:0/3302472988 shutdown_connections 2023-12-12T09:44:50.191 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:50.187+0000 7ff8f3933640 1 -- 172.21.15.73:0/3302472988 wait complete. 2023-12-12T09:44:50.207 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_data pg_num 2023-12-12T09:44:50.411 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:50.410+0000 7f905ca67640 1 Processor -- start 2023-12-12T09:44:50.411 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:50.410+0000 7f905ca67640 1 -- start start 2023-12-12T09:44:50.413 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:50.411+0000 7f905ca67640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f90580c0e00 0x7f90580a8880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:50.413 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:50.411+0000 7f905ca67640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90581521e0 con 0x7f905814c190 2023-12-12T09:44:50.413 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:50.411+0000 7f905ca67640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90580c1aa0 con 0x7f90580a4d00 2023-12-12T09:44:50.413 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:50.411+0000 7f905ca67640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90580c1290 con 0x7f90580c0e00 2023-12-12T09:44:50.413 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:50.412+0000 7f90577fe640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f905814c190 0x7f90581555c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:52804/0 (socket says 172.21.15.73:52804) 2023-12-12T09:44:50.413 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:50.412+0000 7f90577fe640 1 -- 172.21.15.73:0/172347506 learned_addr learned my addr 172.21.15.73:0/172347506 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-12T09:44:50.416 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:50.412+0000 7f9056ffd640 1 -- 172.21.15.73:0/172347506 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 594821318 0 0) 0x7f90581521e0 con 0x7f905814c190 2023-12-12T09:44:50.416 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:50.412+0000 7f9056ffd640 1 -- 172.21.15.73:0/172347506 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9044003520 con 0x7f905814c190 2023-12-12T09:44:50.417 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:50.412+0000 7f9057fff640 1 --2- 172.21.15.73:0/172347506 >> v2:172.21.15.142:3300/0 conn(0x7f90580c0e00 0x7f90580a8880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:50.417 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:50.412+0000 7f9056ffd640 1 -- 172.21.15.73:0/172347506 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2608382787 0 0) 0x7f9044003520 con 0x7f905814c190 2023-12-12T09:44:50.417 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:50.412+0000 7f9056ffd640 1 -- 172.21.15.73:0/172347506 >> v2:172.21.15.142:3300/0 conn(0x7f90580c0e00 msgr2=0x7f90580a8880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:44:50.417 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:50.412+0000 7f9056ffd640 1 --2- 172.21.15.73:0/172347506 >> v2:172.21.15.142:3300/0 conn(0x7f90580c0e00 0x7f90580a8880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:50.417 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:50.412+0000 7f9056ffd640 1 -- 172.21.15.73:0/172347506 >> v1:172.21.15.142:6789/0 conn(0x7f90580a4d00 legacy=0x7f90581529a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:50.417 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:50.413+0000 7f9056ffd640 1 -- 172.21.15.73:0/172347506 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90580c1d80 con 0x7f905814c190 2023-12-12T09:44:50.417 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:50.413+0000 7f9056ffd640 1 -- 172.21.15.73:0/172347506 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3186547832 0 0) 0x7f9048001670 con 0x7f905814c190 2023-12-12T09:44:50.417 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:50.413+0000 7f9056ffd640 1 -- 172.21.15.73:0/172347506 >> v1:172.21.15.73:6789/0 conn(0x7f905814c190 legacy=0x7f90581555c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:50.417 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:50.413+0000 7f9056ffd640 1 --2- 172.21.15.73:0/172347506 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9044003970 0x7f9044003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:50.417 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:50.413+0000 7f9056ffd640 1 --2- 172.21.15.73:0/172347506 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f90440047c0 0x7f9044004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:50.417 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:50.413+0000 7f9056ffd640 1 --2- 172.21.15.73:0/172347506 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f90440052a0 0x7f904400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:50.417 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:50.413+0000 7f9056ffd640 1 -- 172.21.15.73:0/172347506 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90580c1290 con 0x7f90440047c0 2023-12-12T09:44:50.418 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:50.413+0000 7f9056ffd640 1 -- 172.21.15.73:0/172347506 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f904400c170 con 0x7f9044003970 2023-12-12T09:44:50.418 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:50.413+0000 7f9056ffd640 1 -- 172.21.15.73:0/172347506 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f904400c330 con 0x7f90440052a0 2023-12-12T09:44:50.418 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:50.413+0000 7f904effd640 1 --2- 172.21.15.73:0/172347506 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f90440047c0 0x7f9044004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:50.418 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:50.413+0000 7f90577fe640 1 --2- 172.21.15.73:0/172347506 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9044003970 0x7f9044003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:50.418 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:50.413+0000 7f904effd640 1 -- 172.21.15.73:0/172347506 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f90440052a0 msgr2=0x7f904400b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:44:50.418 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:50.413+0000 7f904effd640 1 --2- 172.21.15.73:0/172347506 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f90440052a0 0x7f904400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:50.418 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:50.413+0000 7f904effd640 1 -- 172.21.15.73:0/172347506 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9044003970 msgr2=0x7f9044003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:44:50.418 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:50.413+0000 7f904effd640 1 --2- 172.21.15.73:0/172347506 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9044003970 0x7f9044003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:50.418 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:50.413+0000 7f904effd640 1 -- 172.21.15.73:0/172347506 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9044003520 con 0x7f90440047c0 2023-12-12T09:44:50.418 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:50.413+0000 7f9057fff640 1 -- 172.21.15.73:0/172347506 reap_dead start 2023-12-12T09:44:50.418 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:50.413+0000 7f90577fe640 1 --2- 172.21.15.73:0/172347506 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9044003970 0x7f9044003d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:44:50.418 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:50.414+0000 7f904effd640 1 --2- 172.21.15.73:0/172347506 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f90440047c0 0x7f9044004c40 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f9040001720 tx=0x7f90440057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a563ce446169227e server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:44:50.419 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:50.415+0000 7f9056ffd640 1 -- 172.21.15.73:0/172347506 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90400052d0 con 0x7f90440047c0 2023-12-12T09:44:50.419 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:50.415+0000 7f9056ffd640 1 -- 172.21.15.73:0/172347506 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f904002e050 con 0x7f90440047c0 2023-12-12T09:44:50.419 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:50.415+0000 7f9056ffd640 1 -- 172.21.15.73:0/172347506 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9040003830 con 0x7f90440047c0 2023-12-12T09:44:50.419 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:50.415+0000 7f905ca67640 1 -- 172.21.15.73:0/172347506 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f90440047c0 msgr2=0x7f9044004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:50.419 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:50.415+0000 7f905ca67640 1 --2- 172.21.15.73:0/172347506 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f90440047c0 0x7f9044004c40 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f9040001720 tx=0x7f90440057f0 comp rx=0 tx=0).stop 2023-12-12T09:44:50.419 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:50.415+0000 7f905ca67640 1 -- 172.21.15.73:0/172347506 shutdown_connections 2023-12-12T09:44:50.419 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:50.415+0000 7f905ca67640 1 --2- 172.21.15.73:0/172347506 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f90440047c0 0x7f9044004c40 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:50.419 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:50.415+0000 7f905ca67640 1 -- 172.21.15.73:0/172347506 >> 172.21.15.73:0/172347506 conn(0x7f905806a4e0 msgr2=0x7f905806a8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:44:50.419 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:50.415+0000 7f905ca67640 1 -- 172.21.15.73:0/172347506 shutdown_connections 2023-12-12T09:44:50.419 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:50.415+0000 7f905ca67640 1 -- 172.21.15.73:0/172347506 wait complete. 2023-12-12T09:44:50.421 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:50.417+0000 7f905ca67640 1 Processor -- start 2023-12-12T09:44:50.421 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:50.417+0000 7f905ca67640 1 -- start start 2023-12-12T09:44:50.421 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:50.418+0000 7f905ca67640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f90440047c0 0x7f905806c270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:50.421 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:50.418+0000 7f905ca67640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9058154420 0x7f90580c49c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:50.422 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:50.418+0000 7f905ca67640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9058151560 0x7f90581519c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:50.422 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:50.418+0000 7f905ca67640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9058153ec0 con 0x7f90440047c0 2023-12-12T09:44:50.422 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:50.418+0000 7f905ca67640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f905806c900 con 0x7f9058151560 2023-12-12T09:44:50.422 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:50.418+0000 7f905ca67640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9058153520 con 0x7f9058154420 2023-12-12T09:44:50.422 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:50.418+0000 7f90577fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f90440047c0 0x7f905806c270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:50.422 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:50.419+0000 7f90577fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f90440047c0 0x7f905806c270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:34098/0 (socket says 172.21.15.73:34098) 2023-12-12T09:44:50.422 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:50.419+0000 7f90577fe640 1 -- 172.21.15.73:0/48562796 learned_addr learned my addr 172.21.15.73:0/48562796 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:44:50.422 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:50.419+0000 7f9057fff640 1 --2- 172.21.15.73:0/48562796 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9058151560 0x7f90581519c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:50.422 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:50.419+0000 7f90577fe640 1 -- 172.21.15.73:0/48562796 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9058154420 msgr2=0x7f90580c49c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:50.422 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:50.419+0000 7f90577fe640 1 --2- 172.21.15.73:0/48562796 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9058154420 0x7f90580c49c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:50.422 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:50.419+0000 7f90577fe640 1 -- 172.21.15.73:0/48562796 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9058151560 msgr2=0x7f90581519c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:50.423 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:50.419+0000 7f90577fe640 1 --2- 172.21.15.73:0/48562796 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9058151560 0x7f90581519c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:50.423 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:50.419+0000 7f90577fe640 1 -- 172.21.15.73:0/48562796 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9058153800 con 0x7f90440047c0 2023-12-12T09:44:50.423 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:50.419+0000 7f9057fff640 1 --2- 172.21.15.73:0/48562796 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9058151560 0x7f90581519c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:44:50.423 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:50.419+0000 7f90577fe640 1 --2- 172.21.15.73:0/48562796 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f90440047c0 0x7f905806c270 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f904800d810 tx=0x7f904800dcd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:44:50.423 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:50.419+0000 7f9054ff9640 1 -- 172.21.15.73:0/48562796 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90480074e0 con 0x7f90440047c0 2023-12-12T09:44:50.423 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:50.419+0000 7f9054ff9640 1 -- 172.21.15.73:0/48562796 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9048007640 con 0x7f90440047c0 2023-12-12T09:44:50.423 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:50.419+0000 7f9054ff9640 1 -- 172.21.15.73:0/48562796 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90480049e0 con 0x7f90440047c0 2023-12-12T09:44:50.423 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:50.420+0000 7f905ca67640 1 -- 172.21.15.73:0/48562796 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9058153ae0 con 0x7f90440047c0 2023-12-12T09:44:50.423 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:50.420+0000 7f905ca67640 1 -- 172.21.15.73:0/48562796 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90580c5410 con 0x7f90440047c0 2023-12-12T09:44:50.424 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:50.421+0000 7f905ca67640 1 -- 172.21.15.73:0/48562796 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9058154130 con 0x7f90440047c0 2023-12-12T09:44:50.424 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:50.422+0000 7f9054ff9640 1 -- 172.21.15.73:0/48562796 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f9048004b40 con 0x7f90440047c0 2023-12-12T09:44:50.424 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:50.423+0000 7f9054ff9640 1 --2- 172.21.15.73:0/48562796 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f903806ae40 0x7f903806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:50.424 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:50.423+0000 7f9054ff9640 1 -- 172.21.15.73:0/48562796 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f9048089300 con 0x7f90440047c0 2023-12-12T09:44:50.424 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:50.423+0000 7f904effd640 1 --2- 172.21.15.73:0/48562796 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f903806ae40 0x7f903806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:50.425 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:50.424+0000 7f904effd640 1 --2- 172.21.15.73:0/48562796 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f903806ae40 0x7f903806d300 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f9040033000 tx=0x7f904002f000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:44:50.428 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:50.427+0000 7f9054ff9640 1 -- 172.21.15.73:0/48562796 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f9048054040 con 0x7f90440047c0 2023-12-12T09:44:50.620 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:50.618+0000 7f905ca67640 1 -- 172.21.15.73:0/48562796 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"} v 0) v1 -- 0x7f90580c2060 con 0x7f90440047c0 2023-12-12T09:44:50.621 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:50.619+0000 7f9054ff9640 1 -- 172.21.15.73:0/48562796 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"}]=0 v38) v1 ==== 101+0+11 (secure 0 0 0) 0x7f9048057660 con 0x7f90440047c0 2023-12-12T09:44:50.621 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 64 2023-12-12T09:44:50.624 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:50.622+0000 7f905ca67640 1 -- 172.21.15.73:0/48562796 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f903806ae40 msgr2=0x7f903806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:50.624 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:50.622+0000 7f905ca67640 1 --2- 172.21.15.73:0/48562796 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f903806ae40 0x7f903806d300 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f9040033000 tx=0x7f904002f000 comp rx=0 tx=0).stop 2023-12-12T09:44:50.624 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:50.622+0000 7f905ca67640 1 -- 172.21.15.73:0/48562796 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f90440047c0 msgr2=0x7f905806c270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:50.624 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:50.622+0000 7f905ca67640 1 --2- 172.21.15.73:0/48562796 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f90440047c0 0x7f905806c270 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f904800d810 tx=0x7f904800dcd0 comp rx=0 tx=0).stop 2023-12-12T09:44:50.624 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:50.622+0000 7f905ca67640 1 -- 172.21.15.73:0/48562796 shutdown_connections 2023-12-12T09:44:50.624 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:50.622+0000 7f905ca67640 1 --2- 172.21.15.73:0/48562796 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f903806ae40 0x7f903806d300 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:50.624 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:50.622+0000 7f905ca67640 1 --2- 172.21.15.73:0/48562796 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9058151560 0x7f90581519c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:50.624 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:50.622+0000 7f905ca67640 1 --2- 172.21.15.73:0/48562796 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9058154420 0x7f90580c49c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:50.624 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:50.622+0000 7f905ca67640 1 --2- 172.21.15.73:0/48562796 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f90440047c0 0x7f905806c270 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:50.624 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:50.622+0000 7f905ca67640 1 -- 172.21.15.73:0/48562796 >> 172.21.15.73:0/48562796 conn(0x7f905806a4e0 msgr2=0x7f90580a5550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:44:50.624 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:50.622+0000 7f905ca67640 1 -- 172.21.15.73:0/48562796 shutdown_connections 2023-12-12T09:44:50.624 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:50.622+0000 7f905ca67640 1 -- 172.21.15.73:0/48562796 wait complete. 2023-12-12T09:44:50.642 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-12T09:44:50.853 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:50.851+0000 7fd2958cf640 1 Processor -- start 2023-12-12T09:44:50.853 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:50.852+0000 7fd2958cf640 1 -- start start 2023-12-12T09:44:50.855 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:50.853+0000 7fd2958cf640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fd29006fca0 0x7fd290072700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:50.855 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:50.853+0000 7fd2958cf640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd290152560 con 0x7fd2900c0420 2023-12-12T09:44:50.855 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:50.853+0000 7fd2958cf640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2901532e0 con 0x7fd2900c17e0 2023-12-12T09:44:50.855 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:50.853+0000 7fd2958cf640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd290152ec0 con 0x7fd29006fca0 2023-12-12T09:44:50.855 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:50.854+0000 7fd2867fc640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7fd2900c0420 0x7fd2900c10d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:52816/0 (socket says 172.21.15.73:52816) 2023-12-12T09:44:50.855 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:50.854+0000 7fd2867fc640 1 -- 172.21.15.73:0/448049958 learned_addr learned my addr 172.21.15.73:0/448049958 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-12T09:44:50.857 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:50.854+0000 7fd28effd640 1 --2- 172.21.15.73:0/448049958 >> v2:172.21.15.142:3300/0 conn(0x7fd29006fca0 0x7fd290072700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:50.857 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:50.854+0000 7fd28e7fc640 1 -- 172.21.15.73:0/448049958 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1662409333 0 0) 0x7fd290152560 con 0x7fd2900c0420 2023-12-12T09:44:50.857 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:50.854+0000 7fd28e7fc640 1 -- 172.21.15.73:0/448049958 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd27c003520 con 0x7fd2900c0420 2023-12-12T09:44:50.858 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:50.854+0000 7fd28e7fc640 1 -- 172.21.15.73:0/448049958 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2411904865 0 0) 0x7fd27c003520 con 0x7fd2900c0420 2023-12-12T09:44:50.858 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:50.854+0000 7fd28e7fc640 1 -- 172.21.15.73:0/448049958 >> v2:172.21.15.142:3300/0 conn(0x7fd29006fca0 msgr2=0x7fd290072700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:44:50.858 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:50.854+0000 7fd28e7fc640 1 --2- 172.21.15.73:0/448049958 >> v2:172.21.15.142:3300/0 conn(0x7fd29006fca0 0x7fd290072700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:50.858 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:50.855+0000 7fd28e7fc640 1 -- 172.21.15.73:0/448049958 >> v1:172.21.15.142:6789/0 conn(0x7fd2900c17e0 legacy=0x7fd29015ccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:50.858 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:50.855+0000 7fd28e7fc640 1 -- 172.21.15.73:0/448049958 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd290152800 con 0x7fd2900c0420 2023-12-12T09:44:50.858 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:50.855+0000 7fd28e7fc640 1 -- 172.21.15.73:0/448049958 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3186547832 0 0) 0x7fd278001670 con 0x7fd2900c0420 2023-12-12T09:44:50.858 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:50.855+0000 7fd28e7fc640 1 -- 172.21.15.73:0/448049958 >> v1:172.21.15.73:6789/0 conn(0x7fd2900c0420 legacy=0x7fd2900c10d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:50.858 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:50.855+0000 7fd28e7fc640 1 --2- 172.21.15.73:0/448049958 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd27c003970 0x7fd27c003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:50.858 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:50.855+0000 7fd28e7fc640 1 --2- 172.21.15.73:0/448049958 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd27c0047c0 0x7fd27c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:50.858 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:50.855+0000 7fd28e7fc640 1 --2- 172.21.15.73:0/448049958 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd27c005180 0x7fd27c00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:50.859 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:50.855+0000 7fd28e7fc640 1 -- 172.21.15.73:0/448049958 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd290152ec0 con 0x7fd27c005180 2023-12-12T09:44:50.859 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:50.855+0000 7fd28e7fc640 1 -- 172.21.15.73:0/448049958 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd27c00c120 con 0x7fd27c003970 2023-12-12T09:44:50.859 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:50.855+0000 7fd28e7fc640 1 -- 172.21.15.73:0/448049958 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd27c00c2e0 con 0x7fd27c0047c0 2023-12-12T09:44:50.859 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:50.855+0000 7fd28f7fe640 1 --2- 172.21.15.73:0/448049958 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd27c005180 0x7fd27c00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:50.859 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:50.855+0000 7fd28effd640 1 --2- 172.21.15.73:0/448049958 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd27c003970 0x7fd27c003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:50.859 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:50.855+0000 7fd2867fc640 1 --2- 172.21.15.73:0/448049958 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd27c0047c0 0x7fd27c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:50.859 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:50.855+0000 7fd28f7fe640 1 -- 172.21.15.73:0/448049958 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd27c0047c0 msgr2=0x7fd27c004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:44:50.859 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:50.855+0000 7fd28f7fe640 1 --2- 172.21.15.73:0/448049958 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd27c0047c0 0x7fd27c004c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:50.859 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:50.855+0000 7fd28f7fe640 1 -- 172.21.15.73:0/448049958 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd27c003970 msgr2=0x7fd27c003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:44:50.859 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:50.855+0000 7fd28f7fe640 1 --2- 172.21.15.73:0/448049958 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd27c003970 0x7fd27c003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:50.859 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:50.855+0000 7fd28f7fe640 1 -- 172.21.15.73:0/448049958 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd27c003520 con 0x7fd27c005180 2023-12-12T09:44:50.859 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:50.855+0000 7fd28effd640 1 --2- 172.21.15.73:0/448049958 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd27c003970 0x7fd27c003d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:44:50.859 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:50.856+0000 7fd28f7fe640 1 -- 172.21.15.73:0/448049958 reap_dead start 2023-12-12T09:44:50.859 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:50.856+0000 7fd28f7fe640 1 --2- 172.21.15.73:0/448049958 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd27c005180 0x7fd27c00b980 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7fd288001e50 tx=0x7fd27c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=546934713c409a7e server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:44:50.861 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:50.857+0000 7fd28e7fc640 1 -- 172.21.15.73:0/448049958 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd288003b70 con 0x7fd27c005180 2023-12-12T09:44:50.861 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:50.857+0000 7fd28e7fc640 1 -- 172.21.15.73:0/448049958 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd288003cf0 con 0x7fd27c005180 2023-12-12T09:44:50.861 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:50.857+0000 7fd28e7fc640 1 -- 172.21.15.73:0/448049958 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd288005310 con 0x7fd27c005180 2023-12-12T09:44:50.861 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:50.857+0000 7fd2958cf640 1 -- 172.21.15.73:0/448049958 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd27c005180 msgr2=0x7fd27c00b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:50.861 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:50.857+0000 7fd2958cf640 1 --2- 172.21.15.73:0/448049958 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd27c005180 0x7fd27c00b980 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7fd288001e50 tx=0x7fd27c0057f0 comp rx=0 tx=0).stop 2023-12-12T09:44:50.861 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:50.857+0000 7fd2958cf640 1 -- 172.21.15.73:0/448049958 shutdown_connections 2023-12-12T09:44:50.861 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:50.857+0000 7fd2958cf640 1 --2- 172.21.15.73:0/448049958 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd27c005180 0x7fd27c00b980 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:50.861 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:50.857+0000 7fd2958cf640 1 -- 172.21.15.73:0/448049958 >> 172.21.15.73:0/448049958 conn(0x7fd2900a77d0 msgr2=0x7fd2900a7bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:44:50.861 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:50.857+0000 7fd2958cf640 1 -- 172.21.15.73:0/448049958 shutdown_connections 2023-12-12T09:44:50.861 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:50.857+0000 7fd2958cf640 1 -- 172.21.15.73:0/448049958 wait complete. 2023-12-12T09:44:50.861 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:50.859+0000 7fd2958cf640 1 Processor -- start 2023-12-12T09:44:50.862 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:50.859+0000 7fd2958cf640 1 -- start start 2023-12-12T09:44:50.863 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:50.860+0000 7fd2958cf640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd27c005180 0x7fd2901ebb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:50.863 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:50.860+0000 7fd2958cf640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd29014af60 0x7fd290154a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:50.863 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:50.860+0000 7fd2958cf640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd290154fb0 0x7fd2900a9360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:50.863 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:50.860+0000 7fd2958cf640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2900aadb0 con 0x7fd27c005180 2023-12-12T09:44:50.864 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:50.860+0000 7fd2958cf640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2900aa780 con 0x7fd29014af60 2023-12-12T09:44:50.864 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:50.860+0000 7fd2958cf640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2901ec350 con 0x7fd290154fb0 2023-12-12T09:44:50.864 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:50.860+0000 7fd28effd640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd27c005180 0x7fd2901ebb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:50.864 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:50.860+0000 7fd28effd640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd27c005180 0x7fd2901ebb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:34120/0 (socket says 172.21.15.73:34120) 2023-12-12T09:44:50.864 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:50.860+0000 7fd28effd640 1 -- 172.21.15.73:0/682916730 learned_addr learned my addr 172.21.15.73:0/682916730 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:44:50.864 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:50.861+0000 7fd28effd640 1 -- 172.21.15.73:0/682916730 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd290154fb0 msgr2=0x7fd2900a9360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:50.864 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:50.861+0000 7fd2867fc640 1 --2- 172.21.15.73:0/682916730 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd29014af60 0x7fd290154a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:50.864 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:50.861+0000 7fd28effd640 1 --2- 172.21.15.73:0/682916730 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd290154fb0 0x7fd2900a9360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:50.864 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:50.861+0000 7fd28effd640 1 -- 172.21.15.73:0/682916730 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd29014af60 msgr2=0x7fd290154a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:50.864 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:50.861+0000 7fd28effd640 1 --2- 172.21.15.73:0/682916730 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd29014af60 0x7fd290154a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:50.864 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:50.861+0000 7fd28effd640 1 -- 172.21.15.73:0/682916730 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2901ec5f0 con 0x7fd27c005180 2023-12-12T09:44:50.864 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:50.861+0000 7fd28effd640 1 --2- 172.21.15.73:0/682916730 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd27c005180 0x7fd2901ebb10 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7fd2800108b0 tx=0x7fd280010d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:44:50.864 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:50.861+0000 7fd28cff9640 1 -- 172.21.15.73:0/682916730 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd28000eb60 con 0x7fd27c005180 2023-12-12T09:44:50.864 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:50.861+0000 7fd28cff9640 1 -- 172.21.15.73:0/682916730 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd28000ecc0 con 0x7fd27c005180 2023-12-12T09:44:50.864 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:50.861+0000 7fd2958cf640 1 -- 172.21.15.73:0/682916730 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2900aa9d0 con 0x7fd27c005180 2023-12-12T09:44:50.865 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:50.861+0000 7fd28cff9640 1 -- 172.21.15.73:0/682916730 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd28001c400 con 0x7fd27c005180 2023-12-12T09:44:50.865 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:50.862+0000 7fd2958cf640 1 -- 172.21.15.73:0/682916730 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2900ab740 con 0x7fd27c005180 2023-12-12T09:44:50.865 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:50.863+0000 7fd2958cf640 1 -- 172.21.15.73:0/682916730 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd290067580 con 0x7fd27c005180 2023-12-12T09:44:50.866 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:50.863+0000 7fd28cff9640 1 -- 172.21.15.73:0/682916730 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fd28001c560 con 0x7fd27c005180 2023-12-12T09:44:50.866 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:50.864+0000 7fd28cff9640 1 --2- 172.21.15.73:0/682916730 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fd27006ae70 0x7fd27006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:50.866 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:50.864+0000 7fd28cff9640 1 -- 172.21.15.73:0/682916730 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fd280089f80 con 0x7fd27c005180 2023-12-12T09:44:50.866 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:50.865+0000 7fd2867fc640 1 --2- 172.21.15.73:0/682916730 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fd27006ae70 0x7fd27006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:50.866 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:50.865+0000 7fd2867fc640 1 --2- 172.21.15.73:0/682916730 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fd27006ae70 0x7fd27006d330 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fd2780017a0 tx=0x7fd278009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:44:50.870 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:50.869+0000 7fd28cff9640 1 -- 172.21.15.73:0/682916730 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fd280054d70 con 0x7fd27c005180 2023-12-12T09:44:51.077 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:51.076+0000 7fd2958cf640 1 -- 172.21.15.73:0/682916730 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fd2900c15c0 con 0x7fd27c005180 2023-12-12T09:44:51.078 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:51.077+0000 7fd28cff9640 1 -- 172.21.15.73:0/682916730 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v38) v1 ==== 80+0+0 (secure 0 0 0) 0x7fd280058390 con 0x7fd27c005180 2023-12-12T09:44:51.078 INFO:teuthology.orchestra.run.smithi073.stderr:listed 0 entries 2023-12-12T09:44:51.081 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:51.080+0000 7fd2958cf640 1 -- 172.21.15.73:0/682916730 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fd27006ae70 msgr2=0x7fd27006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:51.081 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:51.080+0000 7fd2958cf640 1 --2- 172.21.15.73:0/682916730 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fd27006ae70 0x7fd27006d330 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fd2780017a0 tx=0x7fd278009040 comp rx=0 tx=0).stop 2023-12-12T09:44:51.081 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:51.080+0000 7fd2958cf640 1 -- 172.21.15.73:0/682916730 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd27c005180 msgr2=0x7fd2901ebb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:51.081 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:51.080+0000 7fd2958cf640 1 --2- 172.21.15.73:0/682916730 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd27c005180 0x7fd2901ebb10 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7fd2800108b0 tx=0x7fd280010d70 comp rx=0 tx=0).stop 2023-12-12T09:44:51.082 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:51.080+0000 7fd2958cf640 1 -- 172.21.15.73:0/682916730 shutdown_connections 2023-12-12T09:44:51.082 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:51.080+0000 7fd2958cf640 1 --2- 172.21.15.73:0/682916730 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fd27006ae70 0x7fd27006d330 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:51.082 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:51.080+0000 7fd2958cf640 1 --2- 172.21.15.73:0/682916730 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd290154fb0 0x7fd2900a9360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:51.082 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:51.080+0000 7fd2958cf640 1 --2- 172.21.15.73:0/682916730 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd29014af60 0x7fd290154a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:51.082 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:51.080+0000 7fd2958cf640 1 --2- 172.21.15.73:0/682916730 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd27c005180 0x7fd2901ebb10 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:51.082 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:51.080+0000 7fd2958cf640 1 -- 172.21.15.73:0/682916730 >> 172.21.15.73:0/682916730 conn(0x7fd2900a77d0 msgr2=0x7fd2901509a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:44:51.082 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:51.080+0000 7fd2958cf640 1 -- 172.21.15.73:0/682916730 shutdown_connections 2023-12-12T09:44:51.082 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:51.080+0000 7fd2958cf640 1 -- 172.21.15.73:0/682916730 wait complete. 2023-12-12T09:44:51.100 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-12-12T09:44:51.100 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T09:44:51.100 DEBUG:teuthology.orchestra.run.smithi073:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-12-12T09:44:51.204 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi073.front.sepia.ceph.com 2023-12-12T09:44:51.204 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T09:44:51.204 DEBUG:teuthology.orchestra.run.smithi073:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-12-12T09:44:51.255 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2023-12-12T09:44:51.255 DEBUG:teuthology.orchestra.run.smithi073:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-12T09:44:51.304 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054284,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498800k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249396k,nr_inodes=812349,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498800k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 2023-12-12T09:44:51.304 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-12-12T09:44:51.564 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:51.562+0000 7f45affce640 1 Processor -- start 2023-12-12T09:44:51.564 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:51.563+0000 7f45affce640 1 -- start start 2023-12-12T09:44:51.566 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:51.564+0000 7f45affce640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f45a806a750 0x7f45a8159020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:51.566 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:51.564+0000 7f45affce640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f45a8071f00 0x7f45a8155aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:51.566 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:51.564+0000 7f45affce640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f45a80bfdc0 0x7f45a815bec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:51.566 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:51.564+0000 7f45affce640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45a80727c0 con 0x7f45a80bfdc0 2023-12-12T09:44:51.566 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:51.564+0000 7f45affce640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45a81588f0 con 0x7f45a806a750 2023-12-12T09:44:51.567 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:51.564+0000 7f45affce640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45a8158b90 con 0x7f45a8071f00 2023-12-12T09:44:51.567 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:51.565+0000 7f45ae56b640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f45a80bfdc0 0x7f45a815bec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:51.567 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:51.565+0000 7f45ae56b640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f45a80bfdc0 0x7f45a815bec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:34136/0 (socket says 172.21.15.73:34136) 2023-12-12T09:44:51.567 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:51.565+0000 7f45ae56b640 1 -- 172.21.15.73:0/3595028939 learned_addr learned my addr 172.21.15.73:0/3595028939 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:44:51.567 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:51.565+0000 7f45ad569640 1 --2- 172.21.15.73:0/3595028939 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f45a8071f00 0x7f45a8155aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:51.567 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:51.565+0000 7f45add6a640 1 --2- 172.21.15.73:0/3595028939 >> v2:172.21.15.142:3300/0 conn(0x7f45a806a750 0x7f45a8159020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:51.567 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:51.565+0000 7f45ae56b640 1 -- 172.21.15.73:0/3595028939 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f45a8071f00 msgr2=0x7f45a8155aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:44:51.567 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:51.565+0000 7f45ae56b640 1 --2- 172.21.15.73:0/3595028939 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f45a8071f00 0x7f45a8155aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:51.567 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:51.565+0000 7f45ae56b640 1 -- 172.21.15.73:0/3595028939 >> v2:172.21.15.142:3300/0 conn(0x7f45a806a750 msgr2=0x7f45a8159020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:44:51.567 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:51.565+0000 7f45ae56b640 1 --2- 172.21.15.73:0/3595028939 >> v2:172.21.15.142:3300/0 conn(0x7f45a806a750 0x7f45a8159020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:51.567 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:51.565+0000 7f45ae56b640 1 -- 172.21.15.73:0/3595028939 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45a80c4e30 con 0x7f45a80bfdc0 2023-12-12T09:44:51.567 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:51.565+0000 7f45add6a640 1 --2- 172.21.15.73:0/3595028939 >> v2:172.21.15.142:3300/0 conn(0x7f45a806a750 0x7f45a8159020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:44:51.568 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:51.566+0000 7f45ae56b640 1 --2- 172.21.15.73:0/3595028939 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f45a80bfdc0 0x7f45a815bec0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f45a806e3c0 tx=0x7f45a002bdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cfac6a65c24c58ff server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:44:51.568 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:51.566+0000 7f45acd68640 1 -- 172.21.15.73:0/3595028939 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45a002c950 con 0x7f45a80bfdc0 2023-12-12T09:44:51.568 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:51.567+0000 7f45acd68640 1 -- 172.21.15.73:0/3595028939 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45a002cab0 con 0x7f45a80bfdc0 2023-12-12T09:44:51.568 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:51.567+0000 7f45acd68640 1 -- 172.21.15.73:0/3595028939 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45a002ce40 con 0x7f45a80bfdc0 2023-12-12T09:44:51.568 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:51.567+0000 7f45affce640 1 -- 172.21.15.73:0/3595028939 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f45a80bfdc0 msgr2=0x7f45a815bec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:51.568 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:51.567+0000 7f45affce640 1 --2- 172.21.15.73:0/3595028939 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f45a80bfdc0 0x7f45a815bec0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f45a806e3c0 tx=0x7f45a002bdb0 comp rx=0 tx=0).stop 2023-12-12T09:44:51.569 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:51.567+0000 7f45affce640 1 -- 172.21.15.73:0/3595028939 shutdown_connections 2023-12-12T09:44:51.569 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:51.567+0000 7f45affce640 1 --2- 172.21.15.73:0/3595028939 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f45a80bfdc0 0x7f45a815bec0 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:51.569 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:51.567+0000 7f45affce640 1 --2- 172.21.15.73:0/3595028939 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f45a8071f00 0x7f45a8155aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:51.569 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:51.567+0000 7f45affce640 1 --2- 172.21.15.73:0/3595028939 >> v2:172.21.15.142:3300/0 conn(0x7f45a806a750 0x7f45a8159020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:51.569 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:51.567+0000 7f45affce640 1 -- 172.21.15.73:0/3595028939 >> 172.21.15.73:0/3595028939 conn(0x7f45a80a8130 msgr2=0x7f45a80c24b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:44:51.569 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:51.567+0000 7f45affce640 1 -- 172.21.15.73:0/3595028939 shutdown_connections 2023-12-12T09:44:51.569 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:51.568+0000 7f45affce640 1 -- 172.21.15.73:0/3595028939 wait complete. 2023-12-12T09:44:51.570 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:51.569+0000 7f45affce640 1 Processor -- start 2023-12-12T09:44:51.570 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:51.569+0000 7f45affce640 1 -- start start 2023-12-12T09:44:51.571 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:51.570+0000 7f45affce640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f45a806a750 0x7f45a81ef3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:51.571 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:51.570+0000 7f45affce640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f45a8071f00 0x7f45a81ef8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:51.572 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:51.570+0000 7f45affce640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f45a80bfdc0 0x7f45a8153d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:51.572 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:51.570+0000 7f45affce640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45a815cca0 con 0x7f45a80bfdc0 2023-12-12T09:44:51.572 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:51.570+0000 7f45affce640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45a815aec0 con 0x7f45a806a750 2023-12-12T09:44:51.572 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:51.570+0000 7f45affce640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45a815b1a0 con 0x7f45a8071f00 2023-12-12T09:44:51.572 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:51.570+0000 7f45ae56b640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f45a80bfdc0 0x7f45a8153d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:51.572 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:51.571+0000 7f45ae56b640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f45a80bfdc0 0x7f45a8153d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:34144/0 (socket says 172.21.15.73:34144) 2023-12-12T09:44:51.572 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:51.571+0000 7f45ae56b640 1 -- 172.21.15.73:0/472299358 learned_addr learned my addr 172.21.15.73:0/472299358 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:44:51.573 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:51.571+0000 7f45ad569640 1 --2- 172.21.15.73:0/472299358 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f45a8071f00 0x7f45a81ef8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:51.573 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:51.571+0000 7f45ae56b640 1 -- 172.21.15.73:0/472299358 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f45a8071f00 msgr2=0x7f45a81ef8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:51.573 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:51.571+0000 7f45ae56b640 1 --2- 172.21.15.73:0/472299358 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f45a8071f00 0x7f45a81ef8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:51.573 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:51.571+0000 7f45ae56b640 1 -- 172.21.15.73:0/472299358 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f45a806a750 msgr2=0x7f45a81ef3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:51.574 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:51.571+0000 7f45add6a640 1 --2- 172.21.15.73:0/472299358 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f45a806a750 0x7f45a81ef3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:51.574 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:51.571+0000 7f45ae56b640 1 --2- 172.21.15.73:0/472299358 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f45a806a750 0x7f45a81ef3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:51.574 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:51.571+0000 7f45ae56b640 1 -- 172.21.15.73:0/472299358 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45a0009b30 con 0x7f45a80bfdc0 2023-12-12T09:44:51.574 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:51.571+0000 7f45add6a640 1 --2- 172.21.15.73:0/472299358 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f45a806a750 0x7f45a81ef3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:44:51.574 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:51.571+0000 7f45ae56b640 1 --2- 172.21.15.73:0/472299358 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f45a80bfdc0 0x7f45a8153d30 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f45a0036040 tx=0x7f45a0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:44:51.574 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:51.571+0000 7f45a67fc640 1 -- 172.21.15.73:0/472299358 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45a0009510 con 0x7f45a80bfdc0 2023-12-12T09:44:51.574 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:51.572+0000 7f45a67fc640 1 -- 172.21.15.73:0/472299358 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45a003e450 con 0x7f45a80bfdc0 2023-12-12T09:44:51.574 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:51.572+0000 7f45a67fc640 1 -- 172.21.15.73:0/472299358 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45a003e800 con 0x7f45a80bfdc0 2023-12-12T09:44:51.574 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:51.572+0000 7f45affce640 1 -- 172.21.15.73:0/472299358 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45a815b480 con 0x7f45a80bfdc0 2023-12-12T09:44:51.574 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:51.572+0000 7f45affce640 1 -- 172.21.15.73:0/472299358 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45a815c950 con 0x7f45a80bfdc0 2023-12-12T09:44:51.575 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:51.573+0000 7f45affce640 1 -- 172.21.15.73:0/472299358 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45a806cac0 con 0x7f45a80bfdc0 2023-12-12T09:44:51.575 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:51.574+0000 7f45a67fc640 1 -- 172.21.15.73:0/472299358 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f45a003e960 con 0x7f45a80bfdc0 2023-12-12T09:44:51.575 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:51.575+0000 7f45a67fc640 1 --2- 172.21.15.73:0/472299358 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f459406ae70 0x7f459406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:51.576 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:51.575+0000 7f45a67fc640 1 -- 172.21.15.73:0/472299358 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f45a00ac6e0 con 0x7f45a80bfdc0 2023-12-12T09:44:51.576 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:51.575+0000 7f45add6a640 1 --2- 172.21.15.73:0/472299358 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f459406ae70 0x7f459406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:51.577 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:51.576+0000 7f45add6a640 1 --2- 172.21.15.73:0/472299358 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f459406ae70 0x7f459406d330 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f4598006fd0 tx=0x7f4598008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:44:51.580 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:51.579+0000 7f45a67fc640 1 -- 172.21.15.73:0/472299358 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f45a0077420 con 0x7f45a80bfdc0 2023-12-12T09:44:51.816 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:51.815+0000 7f45affce640 1 -- 172.21.15.73:0/472299358 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f45a815b9a0 con 0x7f45a80bfdc0 2023-12-12T09:44:51.817 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:51.816+0000 7f45a67fc640 1 -- 172.21.15.73:0/472299358 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v19) v1 ==== 53+0+149 (secure 0 0 0) 0x7f45a007aa40 con 0x7f45a80bfdc0 2023-12-12T09:44:51.817 INFO:teuthology.orchestra.run.smithi073.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-12-12T09:44:51.817 INFO:teuthology.orchestra.run.smithi073.stdout:name: cephfs2, metadata pool: cephfs2_metadata, data pools: [cephfs2_data ] 2023-12-12T09:44:51.821 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:51.819+0000 7f45affce640 1 -- 172.21.15.73:0/472299358 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f459406ae70 msgr2=0x7f459406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:51.821 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:51.819+0000 7f45affce640 1 --2- 172.21.15.73:0/472299358 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f459406ae70 0x7f459406d330 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f4598006fd0 tx=0x7f4598008040 comp rx=0 tx=0).stop 2023-12-12T09:44:51.821 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:51.819+0000 7f45affce640 1 -- 172.21.15.73:0/472299358 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f45a80bfdc0 msgr2=0x7f45a8153d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:51.821 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:51.819+0000 7f45affce640 1 --2- 172.21.15.73:0/472299358 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f45a80bfdc0 0x7f45a8153d30 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f45a0036040 tx=0x7f45a0004a40 comp rx=0 tx=0).stop 2023-12-12T09:44:51.821 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:51.819+0000 7f45affce640 1 -- 172.21.15.73:0/472299358 shutdown_connections 2023-12-12T09:44:51.821 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:51.819+0000 7f45affce640 1 --2- 172.21.15.73:0/472299358 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f459406ae70 0x7f459406d330 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:51.821 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:51.819+0000 7f45affce640 1 --2- 172.21.15.73:0/472299358 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f45a80bfdc0 0x7f45a8153d30 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:51.821 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:51.819+0000 7f45affce640 1 --2- 172.21.15.73:0/472299358 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f45a8071f00 0x7f45a81ef8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:51.821 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:51.819+0000 7f45affce640 1 --2- 172.21.15.73:0/472299358 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f45a806a750 0x7f45a81ef3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:51.821 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:51.819+0000 7f45affce640 1 -- 172.21.15.73:0/472299358 >> 172.21.15.73:0/472299358 conn(0x7f45a80a8130 msgr2=0x7f45a8154b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:44:51.822 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:51.819+0000 7f45affce640 1 -- 172.21.15.73:0/472299358 shutdown_connections 2023-12-12T09:44:51.822 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:51.819+0000 7f45affce640 1 -- 172.21.15.73:0/472299358 wait complete. 2023-12-12T09:44:51.838 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs2; just confirmed its presence on cluster 2023-12-12T09:44:51.838 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-12T09:44:51.838 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi073.front.sepia.ceph.com 2023-12-12T09:44:51.838 INFO:tasks.cephfs.mount:self.client.name = client.testuser 2023-12-12T09:44:51.838 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-12-12T09:44:51.838 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs2 2023-12-12T09:44:51.838 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-12-12T09:44:51.838 INFO:tasks.cephfs.mount:self.client_keyring_path = /tmp/tmp.kVjhhLWB2K 2023-12-12T09:44:51.838 DEBUG:teuthology.orchestra.run.smithi073:> mktemp 2023-12-12T09:44:51.887 INFO:teuthology.orchestra.run.smithi073.stdout:/tmp/tmp.SFOfJZDKCo 2023-12-12T09:44:51.887 DEBUG:teuthology.orchestra.run.smithi073:> sudo cp /tmp/tmp.kVjhhLWB2K /tmp/tmp.SFOfJZDKCo 2023-12-12T09:44:51.980 DEBUG:teuthology.orchestra.run.smithi073:> sudo chmod 0666 /tmp/tmp.SFOfJZDKCo 2023-12-12T09:44:52.141 DEBUG:teuthology.orchestra.remote:smithi073:/tmp/tmp.SFOfJZDKCo is 185B 2023-12-12T09:44:52.204 DEBUG:teuthology.orchestra.run.smithi073:> rm -fr /tmp/tmp.SFOfJZDKCo 2023-12-12T09:44:52.257 INFO:tasks.cephfs.mount:keyring content - [client.testuser] key = AQCPK3hlZNaVIxAA196SzaOrmMbcymy0Qh6b2w== caps mds = "allow rw fsname=cephfs" caps mon = "allow r fsname=cephfs" caps osd = "allow rw tag cephfs data=cephfs" 2023-12-12T09:44:52.257 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-12-12T09:44:52.258 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T09:44:52.258 DEBUG:teuthology.orchestra.run.smithi073:> ip addr 2023-12-12T09:44:52.310 INFO:teuthology.orchestra.run.smithi073.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-12T09:44:52.311 INFO:teuthology.orchestra.run.smithi073.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-12T09:44:52.311 INFO:teuthology.orchestra.run.smithi073.stdout: inet 127.0.0.1/8 scope host lo 2023-12-12T09:44:52.311 INFO:teuthology.orchestra.run.smithi073.stdout: valid_lft forever preferred_lft forever 2023-12-12T09:44:52.311 INFO:teuthology.orchestra.run.smithi073.stdout: inet6 ::1/128 scope host 2023-12-12T09:44:52.311 INFO:teuthology.orchestra.run.smithi073.stdout: valid_lft forever preferred_lft forever 2023-12-12T09:44:52.311 INFO:teuthology.orchestra.run.smithi073.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-12T09:44:52.311 INFO:teuthology.orchestra.run.smithi073.stdout: link/ether 0c:c4:7a:d8:d9:ea brd ff:ff:ff:ff:ff:ff 2023-12-12T09:44:52.311 INFO:teuthology.orchestra.run.smithi073.stdout: altname enp7s0f0 2023-12-12T09:44:52.312 INFO:teuthology.orchestra.run.smithi073.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-12T09:44:52.312 INFO:teuthology.orchestra.run.smithi073.stdout: link/ether 0c:c4:7a:d8:d9:eb brd ff:ff:ff:ff:ff:ff 2023-12-12T09:44:52.312 INFO:teuthology.orchestra.run.smithi073.stdout: altname enp7s0f1 2023-12-12T09:44:52.312 INFO:teuthology.orchestra.run.smithi073.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-12T09:44:52.312 INFO:teuthology.orchestra.run.smithi073.stdout: link/ether 0c:c4:7a:8f:ce:7c brd ff:ff:ff:ff:ff:ff 2023-12-12T09:44:52.312 INFO:teuthology.orchestra.run.smithi073.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-12T09:44:52.312 INFO:teuthology.orchestra.run.smithi073.stdout: link/ether 0c:c4:7a:8f:ce:7d brd ff:ff:ff:ff:ff:ff 2023-12-12T09:44:52.313 INFO:teuthology.orchestra.run.smithi073.stdout: inet 172.21.15.73/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-12-12T09:44:52.313 INFO:teuthology.orchestra.run.smithi073.stdout: valid_lft 42307sec preferred_lft 42307sec 2023-12-12T09:44:52.313 INFO:teuthology.orchestra.run.smithi073.stdout: inet6 fe80::ec4:7aff:fe8f:ce7d/64 scope link 2023-12-12T09:44:52.313 INFO:teuthology.orchestra.run.smithi073.stdout: valid_lft forever preferred_lft forever 2023-12-12T09:44:52.313 INFO:teuthology.orchestra.run.smithi073.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-12-12T09:44:52.313 INFO:teuthology.orchestra.run.smithi073.stdout: link/ether ae:cf:b6:bf:45:8d brd ff:ff:ff:ff:ff:ff 2023-12-12T09:44:52.313 INFO:teuthology.orchestra.run.smithi073.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-12-12T09:44:52.313 INFO:teuthology.orchestra.run.smithi073.stdout: valid_lft forever preferred_lft forever 2023-12-12T09:44:52.314 INFO:teuthology.orchestra.run.smithi073.stdout: inet6 fe80::f4:a9ff:febd:c3fb/64 scope link 2023-12-12T09:44:52.314 INFO:teuthology.orchestra.run.smithi073.stdout: valid_lft forever preferred_lft forever 2023-12-12T09:44:52.314 INFO:teuthology.orchestra.run.smithi073.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-12T09:44:52.314 INFO:teuthology.orchestra.run.smithi073.stdout: link/ether ae:cf:b6:bf:45:8d brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-12T09:44:52.314 INFO:teuthology.orchestra.run.smithi073.stdout: inet6 fe80::accf:b6ff:febf:458d/64 scope link 2023-12-12T09:44:52.314 INFO:teuthology.orchestra.run.smithi073.stdout: valid_lft forever preferred_lft forever 2023-12-12T09:44:52.314 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T09:44:52.315 DEBUG:teuthology.orchestra.run.smithi073:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-12T09:44:52.404 INFO:teuthology.orchestra.run.smithi073.stdout:1 2023-12-12T09:44:52.408 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T09:44:52.408 DEBUG:teuthology.orchestra.run.smithi073:> route 2023-12-12T09:44:52.463 INFO:teuthology.orchestra.run.smithi073.stdout:Kernel IP routing table 2023-12-12T09:44:52.463 INFO:teuthology.orchestra.run.smithi073.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-12T09:44:52.463 INFO:teuthology.orchestra.run.smithi073.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-12-12T09:44:52.463 INFO:teuthology.orchestra.run.smithi073.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-12-12T09:44:52.463 INFO:teuthology.orchestra.run.smithi073.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-12T09:44:52.464 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T09:44:52.464 DEBUG:teuthology.orchestra.run.smithi073:> (cd / && exec bash -c ' 2023-12-12T09:44:52.464 DEBUG:teuthology.orchestra.run.smithi073:> set -e 2023-12-12T09:44:52.464 DEBUG:teuthology.orchestra.run.smithi073:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-12-12T09:44:52.464 DEBUG:teuthology.orchestra.run.smithi073:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-12-12T09:44:52.464 DEBUG:teuthology.orchestra.run.smithi073:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-12-12T09:44:52.464 DEBUG:teuthology.orchestra.run.smithi073:> ') 2023-12-12T09:44:52.647 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T09:44:52.647 DEBUG:teuthology.orchestra.run.smithi073:> ip netns list 2023-12-12T09:44:52.700 INFO:teuthology.orchestra.run.smithi073.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-12-12T09:44:52.700 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-12-12T09:44:52.700 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T09:44:52.700 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip link set brx.0 up 2023-12-12T09:44:52.785 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-12T09:44:52.785 DEBUG:teuthology.orchestra.run.smithi073:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-12-12T09:44:52.839 INFO:teuthology.orchestra.run.smithi073.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-12-12T09:44:52.839 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-12T09:44:52.839 DEBUG:teuthology.orchestra.run.smithi073:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-12-12T09:44:52.891 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2023-12-12T09:44:52.892 DEBUG:teuthology.orchestra.run.smithi073:> dd if=/tmp/tmp.kVjhhLWB2K of=/dev/stdout 2023-12-12T09:44:52.943 INFO:tasks.cephfs.kernel_mount:mounting using device: testuser@.cephfs2=/ 2023-12-12T09:44:52.943 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T09:44:52.943 DEBUG:teuthology.orchestra.run.smithi073:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph testuser@.cephfs2=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,secret=AQCPK3hlZNaVIxAA196SzaOrmMbcymy0Qh6b2w==,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-12T09:44:53.078 INFO:teuthology.orchestra.run.smithi073.stdout:parsing options: rw,norequire_active_mds,secret=AQCPK3hlZNaVIxAA196SzaOrmMbcymy0Qh6b2w==,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-12T09:44:53.079 INFO:teuthology.orchestra.run.smithi073.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-12T09:44:53.079 INFO:teuthology.orchestra.run.smithi073.stdout:keyring.get_secret failed 2023-12-12T09:44:53.113 INFO:teuthology.orchestra.run.smithi073.stderr:mount.ceph: kernel BUG! 2023-12-12T09:44:53.114 INFO:teuthology.orchestra.run.smithi073.stderr:mount error: no mds server is up or the cluster is laggy 2023-12-12T09:44:53.114 INFO:teuthology.orchestra.run.smithi073.stdout:parsing options: rw,norequire_active_mds,secret=AQCPK3hlZNaVIxAA196SzaOrmMbcymy0Qh6b2w==,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-12T09:44:53.114 INFO:teuthology.orchestra.run.smithi073.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-12T09:44:53.114 INFO:teuthology.orchestra.run.smithi073.stdout:mount.ceph: resolved to: "172.21.15.73:3300,172.21.15.142:3300,172.21.15.142:3301" 2023-12-12T09:44:53.114 INFO:teuthology.orchestra.run.smithi073.stdout:mount.ceph: trying mount with new device syntax: testuser@ba240992-02b8-4c7e-92f2-27eb29ac433b.cephfs2=/ 2023-12-12T09:44:53.114 INFO:teuthology.orchestra.run.smithi073.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=testuser,ms_mode=prefer-crc,key=testuser,mon_addr=172.21.15.73:3300/172.21.15.142:3300/172.21.15.142:3301" will pass to kernel 2023-12-12T09:44:53.120 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-12-12T09:44:53.120 INFO:tasks.cephfs.kernel_mount:mount command failed 2023-12-12T09:44:53.121 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-12-12T09:44:53.121 DEBUG:teuthology.orchestra.run.smithi073:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-12T09:44:53.230 DEBUG:teuthology.orchestra.run.smithi142:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-12T09:44:53.357 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-12-12T09:44:53.357 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2023-12-12T09:44:53.357 DEBUG:teuthology.orchestra.run.smithi073:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-12T09:44:53.418 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054284,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498800k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249396k,nr_inodes=812349,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498800k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 2023-12-12T09:44:53.418 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2023-12-12T09:44:53.418 DEBUG:teuthology.orchestra.run.smithi142:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-12T09:44:53.480 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2023-12-12T09:44:53.480 DEBUG:teuthology.orchestra.run.smithi142:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-12T09:44:53.534 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-12T09:44:53.753 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:53.752+0000 7f9812141640 1 Processor -- start 2023-12-12T09:44:53.753 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:53.752+0000 7f9812141640 1 -- start start 2023-12-12T09:44:53.754 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:53.754+0000 7f9812141640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f980c14fa40 0x7f980c06a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:53.754 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:53.754+0000 7f9812141640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f980c06db70 0x7f980c0c39b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:53.754 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:53.754+0000 7f9812141640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f980c152610 con 0x7f980c0c5070 2023-12-12T09:44:53.754 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:53.754+0000 7f9812141640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f980c1528f0 con 0x7f980c14fa40 2023-12-12T09:44:53.754 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:53.754+0000 7f9812141640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f980c152bd0 con 0x7f980c06db70 2023-12-12T09:44:53.754 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:53.754+0000 7f980bfff640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f980c0c5070 0x7f980c0c3ef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:52824/0 (socket says 172.21.15.73:52824) 2023-12-12T09:44:53.755 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:53.754+0000 7f980bfff640 1 -- 172.21.15.73:0/3394803221 learned_addr learned my addr 172.21.15.73:0/3394803221 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-12T09:44:53.756 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:53.755+0000 7f9803fff640 1 --2- 172.21.15.73:0/3394803221 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f980c06db70 0x7f980c0c39b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:53.756 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:53.755+0000 7f980b7fe640 1 --2- 172.21.15.73:0/3394803221 >> v2:172.21.15.142:3300/0 conn(0x7f980c14fa40 0x7f980c06a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:53.756 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:53.755+0000 7f980affd640 1 -- 172.21.15.73:0/3394803221 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2782485873 0 0) 0x7f980c152610 con 0x7f980c0c5070 2023-12-12T09:44:53.756 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:53.755+0000 7f980affd640 1 -- 172.21.15.73:0/3394803221 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f97f8003520 con 0x7f980c0c5070 2023-12-12T09:44:53.757 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:53.755+0000 7f980affd640 1 -- 172.21.15.73:0/3394803221 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1619363027 0 0) 0x7f97f8003520 con 0x7f980c0c5070 2023-12-12T09:44:53.757 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:53.755+0000 7f980affd640 1 -- 172.21.15.73:0/3394803221 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f980c06db70 msgr2=0x7f980c0c39b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:44:53.757 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:53.755+0000 7f980affd640 1 --2- 172.21.15.73:0/3394803221 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f980c06db70 0x7f980c0c39b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:53.757 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:53.755+0000 7f980affd640 1 -- 172.21.15.73:0/3394803221 >> v2:172.21.15.142:3300/0 conn(0x7f980c14fa40 msgr2=0x7f980c06a4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:44:53.757 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:53.755+0000 7f980affd640 1 --2- 172.21.15.73:0/3394803221 >> v2:172.21.15.142:3300/0 conn(0x7f980c14fa40 0x7f980c06a4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:53.757 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:53.755+0000 7f980affd640 1 -- 172.21.15.73:0/3394803221 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f980c152eb0 con 0x7f980c0c5070 2023-12-12T09:44:53.757 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:53.755+0000 7f980affd640 1 -- 172.21.15.73:0/3394803221 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3186547832 0 0) 0x7f98040019f0 con 0x7f980c0c5070 2023-12-12T09:44:53.757 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:53.755+0000 7f980affd640 1 -- 172.21.15.73:0/3394803221 >> v1:172.21.15.73:6789/0 conn(0x7f980c0c5070 legacy=0x7f980c0c3ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:53.757 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:53.755+0000 7f980affd640 1 --2- 172.21.15.73:0/3394803221 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f97f8003970 0x7f97f8003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:53.757 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:53.755+0000 7f980affd640 1 --2- 172.21.15.73:0/3394803221 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f97f80047c0 0x7f97f8004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:53.757 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:53.755+0000 7f980affd640 1 --2- 172.21.15.73:0/3394803221 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f980c06db70 0x7f97f8005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:53.757 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:53.755+0000 7f980affd640 1 -- 172.21.15.73:0/3394803221 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f980c1528f0 con 0x7f97f8003970 2023-12-12T09:44:53.757 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:53.755+0000 7f980affd640 1 -- 172.21.15.73:0/3394803221 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f980c152bd0 con 0x7f97f80047c0 2023-12-12T09:44:53.757 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:53.755+0000 7f980affd640 1 -- 172.21.15.73:0/3394803221 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97f800b980 con 0x7f980c06db70 2023-12-12T09:44:53.758 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:53.756+0000 7f980b7fe640 1 --2- 172.21.15.73:0/3394803221 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f97f8003970 0x7f97f8003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:53.758 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:53.756+0000 7f980bfff640 1 --2- 172.21.15.73:0/3394803221 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f980c06db70 0x7f97f8005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:53.758 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:53.756+0000 7f980b7fe640 1 -- 172.21.15.73:0/3394803221 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f980c06db70 msgr2=0x7f97f8005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:44:53.758 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:53.756+0000 7f980b7fe640 1 --2- 172.21.15.73:0/3394803221 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f980c06db70 0x7f97f8005180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:53.758 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:53.756+0000 7f980b7fe640 1 -- 172.21.15.73:0/3394803221 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f97f80047c0 msgr2=0x7f97f8004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:44:53.758 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:53.756+0000 7f980b7fe640 1 --2- 172.21.15.73:0/3394803221 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f97f80047c0 0x7f97f8004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:53.758 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:53.756+0000 7f980b7fe640 1 -- 172.21.15.73:0/3394803221 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97f8003520 con 0x7f97f8003970 2023-12-12T09:44:53.759 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:53.757+0000 7f980b7fe640 1 --2- 172.21.15.73:0/3394803221 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f97f8003970 0x7f97f8003d90 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f97fc009ac0 tx=0x7f97f80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7faaa22f388e79e server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:44:53.759 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:53.757+0000 7f980affd640 1 -- 172.21.15.73:0/3394803221 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97fc02c6d0 con 0x7f97f8003970 2023-12-12T09:44:53.759 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:53.757+0000 7f980affd640 1 -- 172.21.15.73:0/3394803221 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97fc02c830 con 0x7f97f8003970 2023-12-12T09:44:53.759 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:53.757+0000 7f980affd640 1 -- 172.21.15.73:0/3394803221 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97fc02cbc0 con 0x7f97f8003970 2023-12-12T09:44:53.759 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:53.758+0000 7f9812141640 1 -- 172.21.15.73:0/3394803221 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f97f8003970 msgr2=0x7f97f8003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:53.759 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:53.758+0000 7f9812141640 1 --2- 172.21.15.73:0/3394803221 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f97f8003970 0x7f97f8003d90 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f97fc009ac0 tx=0x7f97f80057f0 comp rx=0 tx=0).stop 2023-12-12T09:44:53.761 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:53.758+0000 7f980bfff640 1 -- 172.21.15.73:0/3394803221 reap_dead start 2023-12-12T09:44:53.761 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:53.758+0000 7f9812141640 1 -- 172.21.15.73:0/3394803221 shutdown_connections 2023-12-12T09:44:53.761 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:53.758+0000 7f9812141640 1 -- 172.21.15.73:0/3394803221 >> 172.21.15.73:0/3394803221 conn(0x7f980c0a8130 msgr2=0x7f980c0c24b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:44:53.761 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:53.758+0000 7f9812141640 1 -- 172.21.15.73:0/3394803221 shutdown_connections 2023-12-12T09:44:53.761 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:53.758+0000 7f9812141640 1 -- 172.21.15.73:0/3394803221 wait complete. 2023-12-12T09:44:53.763 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:53.760+0000 7f9812141640 1 Processor -- start 2023-12-12T09:44:53.763 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:53.760+0000 7f9812141640 1 -- start start 2023-12-12T09:44:53.763 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:53.761+0000 7f9812141640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f97f8003970 0x7f980c0a9f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:53.763 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:53.761+0000 7f9812141640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f980c14b740 0x7f980c0bf050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:53.763 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:53.761+0000 7f9812141640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f980c1eaa20 0x7f980c0a8b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:53.763 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:53.761+0000 7f9812141640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f980c0aa4a0 con 0x7f980c14b740 2023-12-12T09:44:53.763 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:53.761+0000 7f9812141640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f980c0aa9b0 con 0x7f97f8003970 2023-12-12T09:44:53.763 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:53.761+0000 7f9812141640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f980c1e9f80 con 0x7f980c1eaa20 2023-12-12T09:44:53.763 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:53.761+0000 7f9803fff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f980c14b740 0x7f980c0bf050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:53.763 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:53.761+0000 7f9803fff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f980c14b740 0x7f980c0bf050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:34158/0 (socket says 172.21.15.73:34158) 2023-12-12T09:44:53.763 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:53.761+0000 7f9803fff640 1 -- 172.21.15.73:0/2702311305 learned_addr learned my addr 172.21.15.73:0/2702311305 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:44:53.763 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:53.762+0000 7f980b7fe640 1 --2- 172.21.15.73:0/2702311305 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f97f8003970 0x7f980c0a9f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:53.763 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:53.762+0000 7f980bfff640 1 --2- 172.21.15.73:0/2702311305 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f980c1eaa20 0x7f980c0a8b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:53.764 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:53.762+0000 7f9803fff640 1 -- 172.21.15.73:0/2702311305 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f980c1eaa20 msgr2=0x7f980c0a8b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:53.764 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:53.762+0000 7f9803fff640 1 --2- 172.21.15.73:0/2702311305 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f980c1eaa20 0x7f980c0a8b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:53.764 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:53.762+0000 7f9803fff640 1 -- 172.21.15.73:0/2702311305 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f97f8003970 msgr2=0x7f980c0a9f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:53.764 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:53.762+0000 7f9803fff640 1 --2- 172.21.15.73:0/2702311305 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f97f8003970 0x7f980c0a9f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:53.764 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:53.762+0000 7f9803fff640 1 -- 172.21.15.73:0/2702311305 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f980c0aa6d0 con 0x7f980c14b740 2023-12-12T09:44:53.764 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:53.762+0000 7f9803fff640 1 --2- 172.21.15.73:0/2702311305 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f980c14b740 0x7f980c0bf050 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f97f400e7c0 tx=0x7f97f400ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:44:53.764 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:53.762+0000 7f9808ff9640 1 -- 172.21.15.73:0/2702311305 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97f400eed0 con 0x7f980c14b740 2023-12-12T09:44:53.764 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:53.762+0000 7f9808ff9640 1 -- 172.21.15.73:0/2702311305 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97f400c8c0 con 0x7f980c14b740 2023-12-12T09:44:53.764 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:53.762+0000 7f9812141640 1 -- 172.21.15.73:0/2702311305 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f980c1ea220 con 0x7f980c14b740 2023-12-12T09:44:53.764 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:53.762+0000 7f9808ff9640 1 -- 172.21.15.73:0/2702311305 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97f400cc50 con 0x7f980c14b740 2023-12-12T09:44:53.765 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:53.762+0000 7f9812141640 1 -- 172.21.15.73:0/2702311305 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f980c1df480 con 0x7f980c14b740 2023-12-12T09:44:53.765 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:53.764+0000 7f9812141640 1 -- 172.21.15.73:0/2702311305 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f980c1e9de0 con 0x7f980c14b740 2023-12-12T09:44:53.765 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:53.765+0000 7f9808ff9640 1 -- 172.21.15.73:0/2702311305 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f97f4013470 con 0x7f980c14b740 2023-12-12T09:44:53.765 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:53.765+0000 7f9808ff9640 1 --2- 172.21.15.73:0/2702311305 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f97ec06ae40 0x7f97ec06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:53.766 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:53.766+0000 7f9808ff9640 1 -- 172.21.15.73:0/2702311305 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f97f40899b0 con 0x7f980c14b740 2023-12-12T09:44:53.766 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:53.766+0000 7f980b7fe640 1 --2- 172.21.15.73:0/2702311305 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f97ec06ae40 0x7f97ec06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:53.766 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:53.766+0000 7f980b7fe640 1 --2- 172.21.15.73:0/2702311305 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f97ec06ae40 0x7f97ec06d300 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f97fc036000 tx=0x7f97fc030000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:44:53.770 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:53.770+0000 7f9808ff9640 1 -- 172.21.15.73:0/2702311305 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f980c1e9de0 con 0x7f980c14b740 2023-12-12T09:44:53.960 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:53.959+0000 7f9812141640 1 -- 172.21.15.73:0/2702311305 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f980c1e9de0 con 0x7f980c14b740 2023-12-12T09:44:53.965 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:53.963+0000 7f9808ff9640 1 -- 172.21.15.73:0/2702311305 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v38) v1 ==== 74+0+20241 (secure 0 0 0) 0x7f980c1e9de0 con 0x7f980c14b740 2023-12-12T09:44:53.966 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-12T09:44:53.966 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":38,"fsid":"ba240992-02b8-4c7e-92f2-27eb29ac433b","created":"2023-12-12T09:43:02.454719+0000","modified":"2023-12-12T09:44:37.659373+0000","last_up_change":"2023-12-12T09:43:13.913440+0000","last_in_change":"2023-12-12T09:43:05.925348+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-12T09:43:15.525508+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-12-12T09:44:18.641446+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-12-12T09:44:19.952405+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs2_metadata","create_time":"2023-12-12T09:44:34.424645+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs2_data","create_time":"2023-12-12T09:44:35.090149+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"dd9074be-dbe2-4c34-9896-a4223d8d3940","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":4047810203},{"type":"v1","addr":"172.21.15.73:6801","nonce":4047810203}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":4047810203},{"type":"v1","addr":"172.21.15.73:6803","nonce":4047810203}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":4047810203},{"type":"v1","addr":"172.21.15.73:6807","nonce":4047810203}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":4047810203},{"type":"v1","addr":"172.21.15.73:6805","nonce":4047810203}]},"public_addr":"172.21.15.73:6801/4047810203","cluster_addr":"172.21.15.73:6803/4047810203","heartbeat_back_addr":"172.21.15.73:6807/4047810203","heartbeat_front_addr":"172.21.15.73:6805/4047810203","state":["exists","up"]},{"osd":1,"uuid":"c4a05052-96d4-4758-a4e1-1a37f1e07fed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":1356058331},{"type":"v1","addr":"172.21.15.73:6824","nonce":1356058331}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":1356058331},{"type":"v1","addr":"172.21.15.73:6827","nonce":1356058331}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":1356058331},{"type":"v1","addr":"172.21.15.73:6831","nonce":1356058331}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":1356058331},{"type":"v1","addr":"172.21.15.73:6829","nonce":1356058331}]},"public_addr":"172.21.15.73:6824/1356058331","cluster_addr":"172.21.15.73:6827/1356058331","heartbeat_back_addr":"172.21.15.73:6831/1356058331","heartbeat_front_addr":"172.21.15.73:6829/1356058331","state":["exists","up"]},{"osd":2,"uuid":"512bc8ac-72c2-40d4-b3d2-d867a92c5213","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":1228903316},{"type":"v1","addr":"172.21.15.73:6817","nonce":1228903316}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":1228903316},{"type":"v1","addr":"172.21.15.73:6819","nonce":1228903316}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6823","nonce":1228903316},{"type":"v1","addr":"172.21.15.73:6825","nonce":1228903316}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":1228903316},{"type":"v1","addr":"172.21.15.73:6821","nonce":1228903316}]},"public_addr":"172.21.15.73:6817/1228903316","cluster_addr":"172.21.15.73:6819/1228903316","heartbeat_back_addr":"172.21.15.73:6825/1228903316","heartbeat_front_addr":"172.21.15.73:6821/1228903316","state":["exists","up"]},{"osd":3,"uuid":"3d1a91e0-42bf-437a-8eae-8d357c8f63a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":1293329670},{"type":"v1","addr":"172.21.15.73:6809","nonce":1293329670}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6810","nonce":1293329670},{"type":"v1","addr":"172.21.15.73:6811","nonce":1293329670}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":1293329670},{"type":"v1","addr":"172.21.15.73:6815","nonce":1293329670}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":1293329670},{"type":"v1","addr":"172.21.15.73:6813","nonce":1293329670}]},"public_addr":"172.21.15.73:6809/1293329670","cluster_addr":"172.21.15.73:6811/1293329670","heartbeat_back_addr":"172.21.15.73:6815/1293329670","heartbeat_front_addr":"172.21.15.73:6813/1293329670","state":["exists","up"]},{"osd":4,"uuid":"4b302fff-834c-4069-ac19-00e46f6c87b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":3727975702},{"type":"v1","addr":"172.21.15.142:6801","nonce":3727975702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":3727975702},{"type":"v1","addr":"172.21.15.142:6803","nonce":3727975702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6809","nonce":3727975702},{"type":"v1","addr":"172.21.15.142:6811","nonce":3727975702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6805","nonce":3727975702},{"type":"v1","addr":"172.21.15.142:6807","nonce":3727975702}]},"public_addr":"172.21.15.142:6801/3727975702","cluster_addr":"172.21.15.142:6803/3727975702","heartbeat_back_addr":"172.21.15.142:6811/3727975702","heartbeat_front_addr":"172.21.15.142:6807/3727975702","state":["exists","up"]},{"osd":5,"uuid":"d7cdace2-67d0-45cc-95f2-515cf6ef1b82","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6817","nonce":2353193632},{"type":"v1","addr":"172.21.15.142:6819","nonce":2353193632}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6821","nonce":2353193632},{"type":"v1","addr":"172.21.15.142:6823","nonce":2353193632}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6829","nonce":2353193632},{"type":"v1","addr":"172.21.15.142:6831","nonce":2353193632}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6825","nonce":2353193632},{"type":"v1","addr":"172.21.15.142:6827","nonce":2353193632}]},"public_addr":"172.21.15.142:6819/2353193632","cluster_addr":"172.21.15.142:6823/2353193632","heartbeat_back_addr":"172.21.15.142:6831/2353193632","heartbeat_front_addr":"172.21.15.142:6827/2353193632","state":["exists","up"]},{"osd":6,"uuid":"649ce78a-5626-445c-aedc-a651ed05a6f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":2006111986},{"type":"v1","addr":"172.21.15.142:6806","nonce":2006111986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":2006111986},{"type":"v1","addr":"172.21.15.142:6810","nonce":2006111986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":2006111986},{"type":"v1","addr":"172.21.15.142:6815","nonce":2006111986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":2006111986},{"type":"v1","addr":"172.21.15.142:6813","nonce":2006111986}]},"public_addr":"172.21.15.142:6806/2006111986","cluster_addr":"172.21.15.142:6810/2006111986","heartbeat_back_addr":"172.21.15.142:6815/2006111986","heartbeat_front_addr":"172.21.15.142:6813/2006111986","state":["exists","up"]},{"osd":7,"uuid":"af15ae3b-c1d0-4acf-92db-8a1805494d13","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":2573794341},{"type":"v1","addr":"172.21.15.142:6818","nonce":2573794341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":2573794341},{"type":"v1","addr":"172.21.15.142:6822","nonce":2573794341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":2573794341},{"type":"v1","addr":"172.21.15.142:6830","nonce":2573794341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":2573794341},{"type":"v1","addr":"172.21.15.142:6826","nonce":2573794341}]},"public_addr":"172.21.15.142:6818/2573794341","cluster_addr":"172.21.15.142:6822/2573794341","heartbeat_back_addr":"172.21.15.142:6830/2573794341","heartbeat_front_addr":"172.21.15.142:6826/2573794341","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.185824+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.262103+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.225556+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:10.523459+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:10.706035+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.257339+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.301776+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.051960+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-12T09:44:53.966 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:53.966+0000 7f9812141640 1 -- 172.21.15.73:0/2702311305 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f97ec06ae40 msgr2=0x7f97ec06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:53.967 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:53.966+0000 7f9812141640 1 --2- 172.21.15.73:0/2702311305 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f97ec06ae40 0x7f97ec06d300 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f97fc036000 tx=0x7f97fc030000 comp rx=0 tx=0).stop 2023-12-12T09:44:53.967 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:53.966+0000 7f9812141640 1 -- 172.21.15.73:0/2702311305 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f980c14b740 msgr2=0x7f980c0bf050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:53.967 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:53.966+0000 7f9812141640 1 --2- 172.21.15.73:0/2702311305 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f980c14b740 0x7f980c0bf050 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f97f400e7c0 tx=0x7f97f400ec80 comp rx=0 tx=0).stop 2023-12-12T09:44:53.967 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:53.966+0000 7f9812141640 1 -- 172.21.15.73:0/2702311305 shutdown_connections 2023-12-12T09:44:53.967 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:53.966+0000 7f9812141640 1 --2- 172.21.15.73:0/2702311305 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f97ec06ae40 0x7f97ec06d300 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:53.967 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:53.966+0000 7f9812141640 1 --2- 172.21.15.73:0/2702311305 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f980c1eaa20 0x7f980c0a8b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:53.967 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:53.966+0000 7f9812141640 1 --2- 172.21.15.73:0/2702311305 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f980c14b740 0x7f980c0bf050 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:53.967 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:53.966+0000 7f9812141640 1 --2- 172.21.15.73:0/2702311305 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f97f8003970 0x7f980c0a9f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:53.967 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:53.966+0000 7f9812141640 1 -- 172.21.15.73:0/2702311305 >> 172.21.15.73:0/2702311305 conn(0x7f980c0a8130 msgr2=0x7f980c0c38b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:44:53.967 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:53.966+0000 7f9812141640 1 -- 172.21.15.73:0/2702311305 shutdown_connections 2023-12-12T09:44:53.967 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:53.966+0000 7f9812141640 1 -- 172.21.15.73:0/2702311305 wait complete. 2023-12-12T09:44:53.985 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-12T09:43:15.525508+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-12T09:44:18.641446+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '33', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data', 'create_time': '2023-12-12T09:44:19.952405+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '34', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs2_metadata', 'create_time': '2023-12-12T09:44:34.424645+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '37', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs2'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'cephfs2_data', 'create_time': '2023-12-12T09:44:35.090149+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '38', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs2'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-12T09:44:53.986 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-12T09:44:54.200 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:54.199+0000 7f2029d1d640 1 Processor -- start 2023-12-12T09:44:54.200 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:54.200+0000 7f2029d1d640 1 -- start start 2023-12-12T09:44:54.201 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:54.201+0000 7f2029d1d640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f20240a62e0 0x7f20240c1b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:54.201 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:54.201+0000 7f2029d1d640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f20240c5390 0x7f20240c20c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:54.201 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:54.201+0000 7f2029d1d640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f202414ecb0 con 0x7f20240c1630 2023-12-12T09:44:54.201 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:54.201+0000 7f2029d1d640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20240c2a00 con 0x7f20240a62e0 2023-12-12T09:44:54.201 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:54.201+0000 7f2029d1d640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20240c5f40 con 0x7f20240c5390 2023-12-12T09:44:54.202 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:54.202+0000 7f20237fe640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f20240a62e0 0x7f20240c1b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:54.202 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:54.202+0000 7f2022ffd640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f20240c5390 0x7f20240c20c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:54.202 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:54.202+0000 7f20237fe640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f20240a62e0 0x7f20240c1b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.73:59332/0 (socket says 172.21.15.73:59332) 2023-12-12T09:44:54.202 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:54.202+0000 7f20237fe640 1 -- 172.21.15.73:0/687589244 learned_addr learned my addr 172.21.15.73:0/687589244 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:44:54.203 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:54.202+0000 7f20237fe640 1 -- 172.21.15.73:0/687589244 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f20240c5390 msgr2=0x7f20240c20c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:44:54.203 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:54.202+0000 7f20237fe640 1 --2- 172.21.15.73:0/687589244 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f20240c5390 0x7f20240c20c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:54.203 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:54.202+0000 7f20237fe640 1 -- 172.21.15.73:0/687589244 >> v1:172.21.15.142:6789/0 conn(0x7f20240c1630 legacy=0x7f2024070d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:54.203 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:54.202+0000 7f20237fe640 1 -- 172.21.15.73:0/687589244 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20240c6220 con 0x7f20240a62e0 2023-12-12T09:44:54.204 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:54.204+0000 7f20237fe640 1 --2- 172.21.15.73:0/687589244 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f20240a62e0 0x7f20240c1b80 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f2014009e50 tx=0x7f201402be50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1fb70e6e574d19a0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:44:54.204 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:54.204+0000 7f20227fc640 1 -- 172.21.15.73:0/687589244 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f201402c9f0 con 0x7f20240a62e0 2023-12-12T09:44:54.204 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:54.204+0000 7f20227fc640 1 -- 172.21.15.73:0/687589244 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f201402cb50 con 0x7f20240a62e0 2023-12-12T09:44:54.204 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:54.204+0000 7f20227fc640 1 -- 172.21.15.73:0/687589244 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20140343f0 con 0x7f20240a62e0 2023-12-12T09:44:54.205 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:54.205+0000 7f2029d1d640 1 -- 172.21.15.73:0/687589244 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f20240a62e0 msgr2=0x7f20240c1b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:54.205 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:54.205+0000 7f2029d1d640 1 --2- 172.21.15.73:0/687589244 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f20240a62e0 0x7f20240c1b80 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f2014009e50 tx=0x7f201402be50 comp rx=0 tx=0).stop 2023-12-12T09:44:54.205 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:54.205+0000 7f2029d1d640 1 -- 172.21.15.73:0/687589244 shutdown_connections 2023-12-12T09:44:54.205 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:54.205+0000 7f2029d1d640 1 --2- 172.21.15.73:0/687589244 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f20240c5390 0x7f20240c20c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:54.206 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:54.205+0000 7f2029d1d640 1 --2- 172.21.15.73:0/687589244 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f20240a62e0 0x7f20240c1b80 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:54.206 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:54.205+0000 7f2029d1d640 1 -- 172.21.15.73:0/687589244 >> 172.21.15.73:0/687589244 conn(0x7f20240c6ab0 msgr2=0x7f20240c6e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:44:54.206 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:54.205+0000 7f2029d1d640 1 -- 172.21.15.73:0/687589244 shutdown_connections 2023-12-12T09:44:54.206 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:54.205+0000 7f2029d1d640 1 -- 172.21.15.73:0/687589244 wait complete. 2023-12-12T09:44:54.207 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:54.207+0000 7f2029d1d640 1 Processor -- start 2023-12-12T09:44:54.207 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:54.207+0000 7f2029d1d640 1 -- start start 2023-12-12T09:44:54.209 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:54.208+0000 7f2029d1d640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f20240a62e0 0x7f20240ab740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:54.209 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:54.208+0000 7f2029d1d640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f20240c1630 0x7f2024152600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:54.210 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:54.208+0000 7f2029d1d640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f20240c5390 0x7f2024150320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:54.210 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:54.208+0000 7f2029d1d640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20241e8260 con 0x7f20240c1630 2023-12-12T09:44:54.210 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:54.208+0000 7f2029d1d640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20240abdb0 con 0x7f20240a62e0 2023-12-12T09:44:54.210 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:54.208+0000 7f2029d1d640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20240ac090 con 0x7f20240c5390 2023-12-12T09:44:54.210 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:54.208+0000 7f2022ffd640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f20240c1630 0x7f2024152600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:54.210 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:54.208+0000 7f2022ffd640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f20240c1630 0x7f2024152600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:34174/0 (socket says 172.21.15.73:34174) 2023-12-12T09:44:54.210 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:54.208+0000 7f2022ffd640 1 -- 172.21.15.73:0/2064208674 learned_addr learned my addr 172.21.15.73:0/2064208674 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:44:54.210 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:54.208+0000 7f20237fe640 1 --2- 172.21.15.73:0/2064208674 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f20240a62e0 0x7f20240ab740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:54.210 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:54.208+0000 7f2023fff640 1 --2- 172.21.15.73:0/2064208674 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f20240c5390 0x7f2024150320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:54.210 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:54.209+0000 7f2022ffd640 1 -- 172.21.15.73:0/2064208674 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f20240c5390 msgr2=0x7f2024150320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:54.210 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:54.209+0000 7f2022ffd640 1 --2- 172.21.15.73:0/2064208674 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f20240c5390 0x7f2024150320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:54.210 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:54.209+0000 7f2022ffd640 1 -- 172.21.15.73:0/2064208674 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f20240a62e0 msgr2=0x7f20240ab740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:54.210 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:54.209+0000 7f2022ffd640 1 --2- 172.21.15.73:0/2064208674 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f20240a62e0 0x7f20240ab740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:54.210 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:54.209+0000 7f2022ffd640 1 -- 172.21.15.73:0/2064208674 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2014009b30 con 0x7f20240c1630 2023-12-12T09:44:54.210 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:54.209+0000 7f2023fff640 1 --2- 172.21.15.73:0/2064208674 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f20240c5390 0x7f2024150320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:44:54.211 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:54.209+0000 7f2022ffd640 1 --2- 172.21.15.73:0/2064208674 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f20240c1630 0x7f2024152600 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f200c00e870 tx=0x7f200c00ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:44:54.211 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:54.209+0000 7f201bfff640 1 -- 172.21.15.73:0/2064208674 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f200c0094f0 con 0x7f20240c1630 2023-12-12T09:44:54.211 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:54.209+0000 7f201bfff640 1 -- 172.21.15.73:0/2064208674 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f200c00c940 con 0x7f20240c1630 2023-12-12T09:44:54.211 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:54.209+0000 7f201bfff640 1 -- 172.21.15.73:0/2064208674 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f200c00ccf0 con 0x7f20240c1630 2023-12-12T09:44:54.211 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:54.209+0000 7f2029d1d640 1 -- 172.21.15.73:0/2064208674 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20240ac370 con 0x7f20240c1630 2023-12-12T09:44:54.211 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:54.209+0000 7f2029d1d640 1 -- 172.21.15.73:0/2064208674 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2024149840 con 0x7f20240c1630 2023-12-12T09:44:54.211 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:54.211+0000 7f2029d1d640 1 -- 172.21.15.73:0/2064208674 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f20241e84d0 con 0x7f20240c1630 2023-12-12T09:44:54.211 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:54.212+0000 7f201bfff640 1 -- 172.21.15.73:0/2064208674 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f200c013470 con 0x7f20240c1630 2023-12-12T09:44:54.213 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:54.212+0000 7f201bfff640 1 --2- 172.21.15.73:0/2064208674 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f200406ae40 0x7f200406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:54.213 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:54.213+0000 7f201bfff640 1 -- 172.21.15.73:0/2064208674 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f200c089a00 con 0x7f20240c1630 2023-12-12T09:44:54.213 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:54.213+0000 7f20237fe640 1 --2- 172.21.15.73:0/2064208674 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f200406ae40 0x7f200406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:54.213 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:54.213+0000 7f20237fe640 1 --2- 172.21.15.73:0/2064208674 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f200406ae40 0x7f200406d300 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f2014035000 tx=0x7f2014030000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:44:54.217 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:54.217+0000 7f201bfff640 1 -- 172.21.15.73:0/2064208674 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f200c0547e0 con 0x7f20240c1630 2023-12-12T09:44:54.407 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:54.407+0000 7f2029d1d640 1 -- 172.21.15.73:0/2064208674 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f20240c3060 con 0x7f20240c1630 2023-12-12T09:44:54.408 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:54.407+0000 7f201bfff640 1 -- 172.21.15.73:0/2064208674 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v38) v1 ==== 93+0+10 (secure 0 0 0) 0x7f200c0170a0 con 0x7f20240c1630 2023-12-12T09:44:54.408 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 1 2023-12-12T09:44:54.410 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:54.410+0000 7f2029d1d640 1 -- 172.21.15.73:0/2064208674 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f200406ae40 msgr2=0x7f200406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:54.411 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:54.410+0000 7f2029d1d640 1 --2- 172.21.15.73:0/2064208674 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f200406ae40 0x7f200406d300 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f2014035000 tx=0x7f2014030000 comp rx=0 tx=0).stop 2023-12-12T09:44:54.411 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:54.410+0000 7f2029d1d640 1 -- 172.21.15.73:0/2064208674 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f20240c1630 msgr2=0x7f2024152600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:54.411 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:54.410+0000 7f2029d1d640 1 --2- 172.21.15.73:0/2064208674 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f20240c1630 0x7f2024152600 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f200c00e870 tx=0x7f200c00ed30 comp rx=0 tx=0).stop 2023-12-12T09:44:54.411 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:54.410+0000 7f2029d1d640 1 -- 172.21.15.73:0/2064208674 shutdown_connections 2023-12-12T09:44:54.411 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:54.410+0000 7f2029d1d640 1 --2- 172.21.15.73:0/2064208674 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f200406ae40 0x7f200406d300 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:54.411 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:54.410+0000 7f2029d1d640 1 --2- 172.21.15.73:0/2064208674 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f20240c5390 0x7f2024150320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:54.411 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:54.410+0000 7f2029d1d640 1 --2- 172.21.15.73:0/2064208674 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f20240c1630 0x7f2024152600 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:54.411 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:54.410+0000 7f2029d1d640 1 --2- 172.21.15.73:0/2064208674 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f20240a62e0 0x7f20240ab740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:54.411 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:54.410+0000 7f2029d1d640 1 -- 172.21.15.73:0/2064208674 >> 172.21.15.73:0/2064208674 conn(0x7f20240c6ab0 msgr2=0x7f20240c3d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:44:54.411 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:54.410+0000 7f2029d1d640 1 -- 172.21.15.73:0/2064208674 shutdown_connections 2023-12-12T09:44:54.411 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:54.410+0000 7f2029d1d640 1 -- 172.21.15.73:0/2064208674 wait complete. 2023-12-12T09:44:54.429 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-12T09:44:54.647 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:54.647+0000 7f47a9c72640 1 Processor -- start 2023-12-12T09:44:54.647 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:54.647+0000 7f47a9c72640 1 -- start start 2023-12-12T09:44:54.649 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:54.648+0000 7f47a9c72640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f47a414f8c0 0x7f47a406dc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:54.649 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:54.648+0000 7f47a9c72640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f47a406d350 0x7f47a4071e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:54.649 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:54.648+0000 7f47a9c72640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47a40c16c0 con 0x7f47a40723a0 2023-12-12T09:44:54.649 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:54.648+0000 7f47a9c72640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47a40c1090 con 0x7f47a414f8c0 2023-12-12T09:44:54.649 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:54.648+0000 7f47a9c72640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47a40c14b0 con 0x7f47a406d350 2023-12-12T09:44:54.649 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:54.649+0000 7f47a37fe640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f47a414f8c0 0x7f47a406dc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:54.649 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:54.649+0000 7f47a3fff640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f47a40723a0 0x7f47a4152500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:52840/0 (socket says 172.21.15.73:52840) 2023-12-12T09:44:54.649 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:54.649+0000 7f47a3fff640 1 -- 172.21.15.73:0/4060481647 learned_addr learned my addr 172.21.15.73:0/4060481647 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-12T09:44:54.650 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:54.649+0000 7f479bfff640 1 --2- 172.21.15.73:0/4060481647 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f47a406d350 0x7f47a4071e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:54.650 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:54.649+0000 7f47a37fe640 1 -- 172.21.15.73:0/4060481647 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f47a406d350 msgr2=0x7f47a4071e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:44:54.650 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:54.649+0000 7f47a37fe640 1 --2- 172.21.15.73:0/4060481647 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f47a406d350 0x7f47a4071e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:54.650 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:54.649+0000 7f47a37fe640 1 -- 172.21.15.73:0/4060481647 >> v1:172.21.15.73:6789/0 conn(0x7f47a40723a0 legacy=0x7f47a4152500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:54.651 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:54.649+0000 7f47a2ffd640 1 -- 172.21.15.73:0/4060481647 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3472571501 0 0) 0x7f47a40c16c0 con 0x7f47a40723a0 2023-12-12T09:44:54.651 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:54.649+0000 7f47a37fe640 1 -- 172.21.15.73:0/4060481647 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47a40c19a0 con 0x7f47a414f8c0 2023-12-12T09:44:54.651 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:54.649+0000 7f479bfff640 1 --2- 172.21.15.73:0/4060481647 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f47a406d350 0x7f47a4071e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:44:54.651 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:54.650+0000 7f47a37fe640 1 --2- 172.21.15.73:0/4060481647 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f47a414f8c0 0x7f47a406dc40 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f47940097d0 tx=0x7f479402b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8688ab8c534c9002 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:44:54.652 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:54.651+0000 7f47a2ffd640 1 -- 172.21.15.73:0/4060481647 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f479402d040 con 0x7f47a414f8c0 2023-12-12T09:44:54.652 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:54.651+0000 7f47a2ffd640 1 -- 172.21.15.73:0/4060481647 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4794031810 con 0x7f47a414f8c0 2023-12-12T09:44:54.652 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:54.651+0000 7f47a2ffd640 1 -- 172.21.15.73:0/4060481647 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4794031ba0 con 0x7f47a414f8c0 2023-12-12T09:44:54.652 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:54.651+0000 7f47a9c72640 1 -- 172.21.15.73:0/4060481647 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f47a414f8c0 msgr2=0x7f47a406dc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:54.652 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:54.651+0000 7f47a9c72640 1 --2- 172.21.15.73:0/4060481647 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f47a414f8c0 0x7f47a406dc40 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f47940097d0 tx=0x7f479402b8b0 comp rx=0 tx=0).stop 2023-12-12T09:44:54.652 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:54.651+0000 7f47a9c72640 1 -- 172.21.15.73:0/4060481647 shutdown_connections 2023-12-12T09:44:54.652 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:54.651+0000 7f47a9c72640 1 --2- 172.21.15.73:0/4060481647 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f47a406d350 0x7f47a4071e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:54.652 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:54.651+0000 7f47a9c72640 1 --2- 172.21.15.73:0/4060481647 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f47a414f8c0 0x7f47a406dc40 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:54.652 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:54.651+0000 7f47a9c72640 1 -- 172.21.15.73:0/4060481647 >> 172.21.15.73:0/4060481647 conn(0x7f47a406a4e0 msgr2=0x7f47a406a8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:44:54.653 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:54.651+0000 7f47a9c72640 1 -- 172.21.15.73:0/4060481647 shutdown_connections 2023-12-12T09:44:54.653 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:54.651+0000 7f47a9c72640 1 -- 172.21.15.73:0/4060481647 wait complete. 2023-12-12T09:44:54.653 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:54.653+0000 7f47a9c72640 1 Processor -- start 2023-12-12T09:44:54.653 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:54.653+0000 7f47a9c72640 1 -- start start 2023-12-12T09:44:54.654 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:54.654+0000 7f47a9c72640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f47a406d350 0x7f47a41549f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:54.654 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:54.654+0000 7f47a9c72640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f47a40723a0 0x7f47a4070f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:54.655 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:54.654+0000 7f47a9c72640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f47a414f8c0 0x7f47a41eda90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:54.655 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:54.654+0000 7f47a9c72640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47a40a9820 con 0x7f47a40723a0 2023-12-12T09:44:54.655 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:54.654+0000 7f47a9c72640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47a4154f30 con 0x7f47a414f8c0 2023-12-12T09:44:54.655 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:54.654+0000 7f47a9c72640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47a4071440 con 0x7f47a406d350 2023-12-12T09:44:54.655 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:54.654+0000 7f479bfff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f47a40723a0 0x7f47a4070f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:54.655 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:54.654+0000 7f479bfff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f47a40723a0 0x7f47a4070f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:34186/0 (socket says 172.21.15.73:34186) 2023-12-12T09:44:54.655 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:54.654+0000 7f479bfff640 1 -- 172.21.15.73:0/3896339230 learned_addr learned my addr 172.21.15.73:0/3896339230 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:44:54.656 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:54.655+0000 7f47a37fe640 1 --2- 172.21.15.73:0/3896339230 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f47a406d350 0x7f47a41549f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:54.656 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:54.655+0000 7f47a3fff640 1 --2- 172.21.15.73:0/3896339230 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f47a414f8c0 0x7f47a41eda90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:54.656 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:54.655+0000 7f479bfff640 1 -- 172.21.15.73:0/3896339230 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f47a406d350 msgr2=0x7f47a41549f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:54.656 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:54.655+0000 7f479bfff640 1 --2- 172.21.15.73:0/3896339230 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f47a406d350 0x7f47a41549f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:54.656 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:54.655+0000 7f479bfff640 1 -- 172.21.15.73:0/3896339230 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f47a414f8c0 msgr2=0x7f47a41eda90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:54.656 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:54.655+0000 7f479bfff640 1 --2- 172.21.15.73:0/3896339230 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f47a414f8c0 0x7f47a41eda90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:54.656 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:54.655+0000 7f479bfff640 1 -- 172.21.15.73:0/3896339230 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4794009400 con 0x7f47a40723a0 2023-12-12T09:44:54.657 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:54.655+0000 7f479bfff640 1 --2- 172.21.15.73:0/3896339230 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f47a40723a0 0x7f47a4070f00 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f478c00c7f0 tx=0x7f478c00cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:44:54.657 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:54.655+0000 7f47a0ff9640 1 -- 172.21.15.73:0/3896339230 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f478c007a30 con 0x7f47a40723a0 2023-12-12T09:44:54.657 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:54.655+0000 7f47a0ff9640 1 -- 172.21.15.73:0/3896339230 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f478c007b90 con 0x7f47a40723a0 2023-12-12T09:44:54.657 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:54.655+0000 7f47a0ff9640 1 -- 172.21.15.73:0/3896339230 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f478c00ce40 con 0x7f47a40723a0 2023-12-12T09:44:54.657 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:54.655+0000 7f47a9c72640 1 -- 172.21.15.73:0/3896339230 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47a4153c50 con 0x7f47a40723a0 2023-12-12T09:44:54.657 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:54.656+0000 7f47a9c72640 1 -- 172.21.15.73:0/3896339230 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47a4154210 con 0x7f47a40723a0 2023-12-12T09:44:54.657 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:54.657+0000 7f47a9c72640 1 -- 172.21.15.73:0/3896339230 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47a4067070 con 0x7f47a40723a0 2023-12-12T09:44:54.657 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:54.658+0000 7f47a0ff9640 1 -- 172.21.15.73:0/3896339230 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f478c0113f0 con 0x7f47a40723a0 2023-12-12T09:44:54.658 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:54.658+0000 7f47a0ff9640 1 --2- 172.21.15.73:0/3896339230 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f478406ae40 0x7f478406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:54.659 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:54.659+0000 7f47a0ff9640 1 -- 172.21.15.73:0/3896339230 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f478c089b70 con 0x7f47a40723a0 2023-12-12T09:44:54.659 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:54.659+0000 7f47a37fe640 1 --2- 172.21.15.73:0/3896339230 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f478406ae40 0x7f478406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:54.662 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:54.659+0000 7f47a37fe640 1 --2- 172.21.15.73:0/3896339230 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f478406ae40 0x7f478406d300 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f4794036000 tx=0x7f479403c040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:44:54.663 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:54.663+0000 7f47a0ff9640 1 -- 172.21.15.73:0/3896339230 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f478c0548b0 con 0x7f47a40723a0 2023-12-12T09:44:54.855 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:54.855+0000 7f47a9c72640 1 -- 172.21.15.73:0/3896339230 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f47a4067580 con 0x7f47a40723a0 2023-12-12T09:44:54.855 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:54.855+0000 7f47a0ff9640 1 -- 172.21.15.73:0/3896339230 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v38) v1 ==== 104+0+11 (secure 0 0 0) 0x7f478c057ed0 con 0x7f47a40723a0 2023-12-12T09:44:54.856 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 32 2023-12-12T09:44:54.859 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:54.858+0000 7f47a9c72640 1 -- 172.21.15.73:0/3896339230 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f478406ae40 msgr2=0x7f478406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:54.859 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:54.858+0000 7f47a9c72640 1 --2- 172.21.15.73:0/3896339230 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f478406ae40 0x7f478406d300 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f4794036000 tx=0x7f479403c040 comp rx=0 tx=0).stop 2023-12-12T09:44:54.859 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:54.858+0000 7f47a9c72640 1 -- 172.21.15.73:0/3896339230 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f47a40723a0 msgr2=0x7f47a4070f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:54.859 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:54.858+0000 7f47a9c72640 1 --2- 172.21.15.73:0/3896339230 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f47a40723a0 0x7f47a4070f00 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f478c00c7f0 tx=0x7f478c00cbf0 comp rx=0 tx=0).stop 2023-12-12T09:44:54.859 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:54.858+0000 7f47a9c72640 1 -- 172.21.15.73:0/3896339230 shutdown_connections 2023-12-12T09:44:54.859 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:54.858+0000 7f47a9c72640 1 --2- 172.21.15.73:0/3896339230 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f478406ae40 0x7f478406d300 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:54.859 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:54.858+0000 7f47a9c72640 1 --2- 172.21.15.73:0/3896339230 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f47a414f8c0 0x7f47a41eda90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:54.859 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:54.858+0000 7f47a9c72640 1 --2- 172.21.15.73:0/3896339230 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f47a40723a0 0x7f47a4070f00 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:54.859 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:54.858+0000 7f47a9c72640 1 --2- 172.21.15.73:0/3896339230 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f47a406d350 0x7f47a41549f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:54.859 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:54.858+0000 7f47a9c72640 1 -- 172.21.15.73:0/3896339230 >> 172.21.15.73:0/3896339230 conn(0x7f47a406a4e0 msgr2=0x7f47a40bf990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:44:54.859 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:54.858+0000 7f47a9c72640 1 -- 172.21.15.73:0/3896339230 shutdown_connections 2023-12-12T09:44:54.859 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:54.859+0000 7f47a9c72640 1 -- 172.21.15.73:0/3896339230 wait complete. 2023-12-12T09:44:54.877 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-12T09:44:55.093 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:55.093+0000 7f428d97c640 1 Processor -- start 2023-12-12T09:44:55.093 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:55.093+0000 7f428d97c640 1 -- start start 2023-12-12T09:44:55.094 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:55.094+0000 7f428d97c640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f428806d350 0x7f428806dc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:55.094 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:55.094+0000 7f428d97c640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4288152500 0x7f4288152990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:55.094 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:55.094+0000 7f428d97c640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42880c16c0 con 0x7f428814f8c0 2023-12-12T09:44:55.095 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:55.094+0000 7f428d97c640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42880c1090 con 0x7f428806d350 2023-12-12T09:44:55.095 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:55.094+0000 7f428d97c640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42880c14b0 con 0x7f4288152500 2023-12-12T09:44:55.095 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:55.095+0000 7f4286ffd640 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f428814f8c0 0x7f4288071e60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.73:45400/0 (socket says 172.21.15.73:45400) 2023-12-12T09:44:55.095 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:55.095+0000 7f4286ffd640 1 -- 172.21.15.73:0/1874329646 learned_addr learned my addr 172.21.15.73:0/1874329646 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-12T09:44:55.095 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:55.095+0000 7f42877fe640 1 --2- 172.21.15.73:0/1874329646 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4288152500 0x7f4288152990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:55.095 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:55.095+0000 7f427ffff640 1 --2- 172.21.15.73:0/1874329646 >> v2:172.21.15.142:3300/0 conn(0x7f428806d350 0x7f428806dc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:55.096 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:55.096+0000 7f42867fc640 1 -- 172.21.15.73:0/1874329646 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2523316557 0 0) 0x7f42880c16c0 con 0x7f428814f8c0 2023-12-12T09:44:55.096 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:55.096+0000 7f42867fc640 1 -- 172.21.15.73:0/1874329646 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4274003520 con 0x7f428814f8c0 2023-12-12T09:44:55.096 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:55.096+0000 7f42877fe640 1 -- 172.21.15.73:0/1874329646 >> v2:172.21.15.142:3300/0 conn(0x7f428806d350 msgr2=0x7f428806dc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:44:55.096 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:55.096+0000 7f42877fe640 1 --2- 172.21.15.73:0/1874329646 >> v2:172.21.15.142:3300/0 conn(0x7f428806d350 0x7f428806dc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:55.096 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:55.096+0000 7f42877fe640 1 -- 172.21.15.73:0/1874329646 >> v1:172.21.15.142:6789/0 conn(0x7f428814f8c0 legacy=0x7f4288071e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:55.097 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:55.096+0000 7f42877fe640 1 -- 172.21.15.73:0/1874329646 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42880c19a0 con 0x7f4288152500 2023-12-12T09:44:55.097 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:55.097+0000 7f42877fe640 1 --2- 172.21.15.73:0/1874329646 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4288152500 0x7f4288152990 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f4280009d90 tx=0x7f428002bea0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8d999dab8a18b2dd server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:44:55.098 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:55.098+0000 7f42867fc640 1 -- 172.21.15.73:0/1874329646 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f428002cc50 con 0x7f4288152500 2023-12-12T09:44:55.098 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:55.098+0000 7f42867fc640 1 -- 172.21.15.73:0/1874329646 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f428002cdb0 con 0x7f4288152500 2023-12-12T09:44:55.098 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:55.098+0000 7f42867fc640 1 -- 172.21.15.73:0/1874329646 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4280034640 con 0x7f4288152500 2023-12-12T09:44:55.099 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:55.099+0000 7f428d97c640 1 -- 172.21.15.73:0/1874329646 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4288152500 msgr2=0x7f4288152990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:55.099 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:55.099+0000 7f428d97c640 1 --2- 172.21.15.73:0/1874329646 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4288152500 0x7f4288152990 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f4280009d90 tx=0x7f428002bea0 comp rx=0 tx=0).stop 2023-12-12T09:44:55.099 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:55.099+0000 7f428d97c640 1 -- 172.21.15.73:0/1874329646 shutdown_connections 2023-12-12T09:44:55.099 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:55.099+0000 7f428d97c640 1 --2- 172.21.15.73:0/1874329646 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4288152500 0x7f4288152990 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:55.099 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:55.099+0000 7f428d97c640 1 --2- 172.21.15.73:0/1874329646 >> v2:172.21.15.142:3300/0 conn(0x7f428806d350 0x7f428806dc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:55.099 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:55.099+0000 7f428d97c640 1 -- 172.21.15.73:0/1874329646 >> 172.21.15.73:0/1874329646 conn(0x7f428806a4e0 msgr2=0x7f428806a8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:44:55.100 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:55.099+0000 7f428d97c640 1 -- 172.21.15.73:0/1874329646 shutdown_connections 2023-12-12T09:44:55.100 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:55.099+0000 7f428d97c640 1 -- 172.21.15.73:0/1874329646 wait complete. 2023-12-12T09:44:55.101 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:55.101+0000 7f428d97c640 1 Processor -- start 2023-12-12T09:44:55.101 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:55.101+0000 7f428d97c640 1 -- start start 2023-12-12T09:44:55.104 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:55.102+0000 7f428d97c640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f428806d350 0x7f428814c4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:55.104 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:55.102+0000 7f428d97c640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f428814f8c0 0x7f42880a9470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:55.104 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:55.102+0000 7f428d97c640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4288152500 0x7f42881ea6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:55.104 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:55.102+0000 7f428d97c640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42880aa3f0 con 0x7f428806d350 2023-12-12T09:44:55.104 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:55.102+0000 7f428d97c640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f428814a600 con 0x7f428814f8c0 2023-12-12T09:44:55.104 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:55.102+0000 7f428d97c640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42880aa660 con 0x7f4288152500 2023-12-12T09:44:55.104 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:55.102+0000 7f4286ffd640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f428806d350 0x7f428814c4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:55.104 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:55.102+0000 7f4286ffd640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f428806d350 0x7f428814c4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:34194/0 (socket says 172.21.15.73:34194) 2023-12-12T09:44:55.104 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:55.102+0000 7f4286ffd640 1 -- 172.21.15.73:0/3862714506 learned_addr learned my addr 172.21.15.73:0/3862714506 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:44:55.104 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:55.102+0000 7f42877fe640 1 --2- 172.21.15.73:0/3862714506 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4288152500 0x7f42881ea6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:55.104 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:55.102+0000 7f427ffff640 1 --2- 172.21.15.73:0/3862714506 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f428814f8c0 0x7f42880a9470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:55.105 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:55.103+0000 7f4286ffd640 1 -- 172.21.15.73:0/3862714506 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4288152500 msgr2=0x7f42881ea6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:55.105 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:55.103+0000 7f4286ffd640 1 --2- 172.21.15.73:0/3862714506 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4288152500 0x7f42881ea6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:55.105 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:55.103+0000 7f4286ffd640 1 -- 172.21.15.73:0/3862714506 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f428814f8c0 msgr2=0x7f42880a9470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:55.105 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:55.103+0000 7f4286ffd640 1 --2- 172.21.15.73:0/3862714506 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f428814f8c0 0x7f42880a9470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:55.105 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:55.103+0000 7f4286ffd640 1 -- 172.21.15.73:0/3862714506 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4280009a70 con 0x7f428806d350 2023-12-12T09:44:55.105 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:55.103+0000 7f427ffff640 1 --2- 172.21.15.73:0/3862714506 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f428814f8c0 0x7f42880a9470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:44:55.105 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:55.103+0000 7f42877fe640 1 --2- 172.21.15.73:0/3862714506 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4288152500 0x7f42881ea6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:44:55.105 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:55.103+0000 7f4286ffd640 1 --2- 172.21.15.73:0/3862714506 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f428806d350 0x7f428814c4c0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f427800c500 tx=0x7f427800c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:44:55.105 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:55.103+0000 7f4284ff9640 1 -- 172.21.15.73:0/3862714506 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4278005ce0 con 0x7f428806d350 2023-12-12T09:44:55.105 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:55.103+0000 7f4284ff9640 1 -- 172.21.15.73:0/3862714506 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4278005e40 con 0x7f428806d350 2023-12-12T09:44:55.105 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:55.103+0000 7f4284ff9640 1 -- 172.21.15.73:0/3862714506 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4278007330 con 0x7f428806d350 2023-12-12T09:44:55.105 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:55.103+0000 7f428d97c640 1 -- 172.21.15.73:0/3862714506 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42880aafb0 con 0x7f428806d350 2023-12-12T09:44:55.105 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:55.103+0000 7f428d97c640 1 -- 172.21.15.73:0/3862714506 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42881ea1b0 con 0x7f428806d350 2023-12-12T09:44:55.106 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:55.104+0000 7f428d97c640 1 -- 172.21.15.73:0/3862714506 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4288067070 con 0x7f428806d350 2023-12-12T09:44:55.106 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:55.105+0000 7f4284ff9640 1 -- 172.21.15.73:0/3862714506 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f4278007550 con 0x7f428806d350 2023-12-12T09:44:55.106 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:55.106+0000 7f4284ff9640 1 --2- 172.21.15.73:0/3862714506 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f426806ae40 0x7f426806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:55.106 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:55.106+0000 7f4284ff9640 1 -- 172.21.15.73:0/3862714506 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f4278088fe0 con 0x7f428806d350 2023-12-12T09:44:55.106 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:55.106+0000 7f427ffff640 1 --2- 172.21.15.73:0/3862714506 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f426806ae40 0x7f426806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:55.107 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:55.107+0000 7f427ffff640 1 --2- 172.21.15.73:0/3862714506 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f426806ae40 0x7f426806d300 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f428814b650 tx=0x7f4270008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:44:55.110 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:55.111+0000 7f4284ff9640 1 -- 172.21.15.73:0/3862714506 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f4278053e20 con 0x7f428806d350 2023-12-12T09:44:55.300 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:55.300+0000 7f428d97c640 1 -- 172.21.15.73:0/3862714506 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f42880724f0 con 0x7f428806d350 2023-12-12T09:44:55.301 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:55.301+0000 7f4284ff9640 1 -- 172.21.15.73:0/3862714506 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v38) v1 ==== 100+0+11 (secure 0 0 0) 0x7f4278017020 con 0x7f428806d350 2023-12-12T09:44:55.301 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 64 2023-12-12T09:44:55.304 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:55.304+0000 7f428d97c640 1 -- 172.21.15.73:0/3862714506 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f426806ae40 msgr2=0x7f426806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:55.304 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:55.304+0000 7f428d97c640 1 --2- 172.21.15.73:0/3862714506 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f426806ae40 0x7f426806d300 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f428814b650 tx=0x7f4270008040 comp rx=0 tx=0).stop 2023-12-12T09:44:55.305 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:55.304+0000 7f428d97c640 1 -- 172.21.15.73:0/3862714506 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f428806d350 msgr2=0x7f428814c4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:55.305 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:55.304+0000 7f428d97c640 1 --2- 172.21.15.73:0/3862714506 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f428806d350 0x7f428814c4c0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f427800c500 tx=0x7f427800c9c0 comp rx=0 tx=0).stop 2023-12-12T09:44:55.305 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:55.304+0000 7f428d97c640 1 -- 172.21.15.73:0/3862714506 shutdown_connections 2023-12-12T09:44:55.305 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:55.304+0000 7f428d97c640 1 --2- 172.21.15.73:0/3862714506 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f426806ae40 0x7f426806d300 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:55.305 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:55.304+0000 7f428d97c640 1 --2- 172.21.15.73:0/3862714506 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4288152500 0x7f42881ea6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:55.305 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:55.304+0000 7f428d97c640 1 --2- 172.21.15.73:0/3862714506 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f428814f8c0 0x7f42880a9470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:55.305 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:55.304+0000 7f428d97c640 1 --2- 172.21.15.73:0/3862714506 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f428806d350 0x7f428814c4c0 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:55.305 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:55.304+0000 7f428d97c640 1 -- 172.21.15.73:0/3862714506 >> 172.21.15.73:0/3862714506 conn(0x7f428806a4e0 msgr2=0x7f428806a8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:44:55.305 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:55.304+0000 7f428d97c640 1 -- 172.21.15.73:0/3862714506 shutdown_connections 2023-12-12T09:44:55.305 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:55.304+0000 7f428d97c640 1 -- 172.21.15.73:0/3862714506 wait complete. 2023-12-12T09:44:55.322 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_metadata pg_num 2023-12-12T09:44:55.534 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:55.534+0000 7f731021e640 1 Processor -- start 2023-12-12T09:44:55.534 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:55.534+0000 7f731021e640 1 -- start start 2023-12-12T09:44:55.536 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:55.535+0000 7f731021e640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f730814ea60 0x7f73080c5420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:55.536 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:55.535+0000 7f731021e640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f73080c0320 0x7f73080c20b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:55.536 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:55.536+0000 7f731021e640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73080c3390 con 0x7f73080a4c90 2023-12-12T09:44:55.537 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:55.536+0000 7f731021e640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73080c0750 con 0x7f73080c0320 2023-12-12T09:44:55.537 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:55.536+0000 7f731021e640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73080c4b30 con 0x7f730814ea60 2023-12-12T09:44:55.537 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:55.536+0000 7f730e7bb640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f73080c0320 0x7f73080c20b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:55.537 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:55.536+0000 7f730e7bb640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f73080c0320 0x7f73080c20b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:34208/0 (socket says 172.21.15.73:34208) 2023-12-12T09:44:55.537 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:55.536+0000 7f730e7bb640 1 -- 172.21.15.73:0/4070238411 learned_addr learned my addr 172.21.15.73:0/4070238411 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:44:55.537 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:55.536+0000 7f730d7b9640 1 --1- 172.21.15.73:0/4070238411 >> v1:172.21.15.73:6789/0 conn(0x7f73080a4c90 0x7f73080c4420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:52844/0 (socket says 172.21.15.73:52844) 2023-12-12T09:44:55.537 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:55.536+0000 7f730e7bb640 1 -- 172.21.15.73:0/4070238411 >> v2:172.21.15.142:3300/0 conn(0x7f730814ea60 msgr2=0x7f73080c5420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:44:55.537 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:55.536+0000 7f730dfba640 1 --2- 172.21.15.73:0/4070238411 >> v2:172.21.15.142:3300/0 conn(0x7f730814ea60 0x7f73080c5420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:55.537 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:55.536+0000 7f730e7bb640 1 --2- 172.21.15.73:0/4070238411 >> v2:172.21.15.142:3300/0 conn(0x7f730814ea60 0x7f73080c5420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:55.537 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:55.536+0000 7f730e7bb640 1 -- 172.21.15.73:0/4070238411 >> v1:172.21.15.73:6789/0 conn(0x7f73080a4c90 legacy=0x7f73080c4420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:55.537 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:55.536+0000 7f730cfb8640 1 -- 172.21.15.73:0/4070238411 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2882926141 0 0) 0x7f73080c3390 con 0x7f73080a4c90 2023-12-12T09:44:55.537 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:55.536+0000 7f730e7bb640 1 -- 172.21.15.73:0/4070238411 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7308151e60 con 0x7f73080c0320 2023-12-12T09:44:55.538 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:55.537+0000 7f730e7bb640 1 --2- 172.21.15.73:0/4070238411 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f73080c0320 0x7f73080c20b0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f730806b490 tx=0x7f730002bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf857220a5fe3c2 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:44:55.539 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:55.538+0000 7f730cfb8640 1 -- 172.21.15.73:0/4070238411 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f730002ca80 con 0x7f73080c0320 2023-12-12T09:44:55.539 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:55.538+0000 7f730cfb8640 1 -- 172.21.15.73:0/4070238411 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f730002cbe0 con 0x7f73080c0320 2023-12-12T09:44:55.539 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:55.538+0000 7f730cfb8640 1 -- 172.21.15.73:0/4070238411 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73000343f0 con 0x7f73080c0320 2023-12-12T09:44:55.539 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:55.538+0000 7f731021e640 1 -- 172.21.15.73:0/4070238411 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f73080c0320 msgr2=0x7f73080c20b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:55.539 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:55.538+0000 7f731021e640 1 --2- 172.21.15.73:0/4070238411 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f73080c0320 0x7f73080c20b0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f730806b490 tx=0x7f730002bee0 comp rx=0 tx=0).stop 2023-12-12T09:44:55.539 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:55.538+0000 7f731021e640 1 -- 172.21.15.73:0/4070238411 shutdown_connections 2023-12-12T09:44:55.539 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:55.538+0000 7f731021e640 1 --2- 172.21.15.73:0/4070238411 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f73080c0320 0x7f73080c20b0 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:55.539 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:55.538+0000 7f731021e640 1 --2- 172.21.15.73:0/4070238411 >> v2:172.21.15.142:3300/0 conn(0x7f730814ea60 0x7f73080c5420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:55.539 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:55.538+0000 7f731021e640 1 -- 172.21.15.73:0/4070238411 >> 172.21.15.73:0/4070238411 conn(0x7f730806a4e0 msgr2=0x7f730806a8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:44:55.539 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:55.538+0000 7f731021e640 1 -- 172.21.15.73:0/4070238411 shutdown_connections 2023-12-12T09:44:55.539 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:55.538+0000 7f731021e640 1 -- 172.21.15.73:0/4070238411 wait complete. 2023-12-12T09:44:55.540 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:55.540+0000 7f731021e640 1 Processor -- start 2023-12-12T09:44:55.540 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:55.540+0000 7f731021e640 1 -- start start 2023-12-12T09:44:55.543 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:55.541+0000 7f731021e640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f73080a4c90 0x7f730814c4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:55.543 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:55.541+0000 7f731021e640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f73080c0320 0x7f7308148790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:55.543 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:55.541+0000 7f731021e640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f730814ea60 0x7f73081ed080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:55.543 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:55.541+0000 7f731021e640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f730814c030 con 0x7f73080a4c90 2023-12-12T09:44:55.543 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:55.541+0000 7f731021e640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7308149000 con 0x7f73080c0320 2023-12-12T09:44:55.543 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:55.541+0000 7f731021e640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7308149580 con 0x7f730814ea60 2023-12-12T09:44:55.543 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:55.541+0000 7f730dfba640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f73080a4c90 0x7f730814c4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:55.543 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:55.541+0000 7f730dfba640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f73080a4c90 0x7f730814c4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:34214/0 (socket says 172.21.15.73:34214) 2023-12-12T09:44:55.543 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:55.541+0000 7f730dfba640 1 -- 172.21.15.73:0/4148581475 learned_addr learned my addr 172.21.15.73:0/4148581475 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:44:55.543 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:55.542+0000 7f730d7b9640 1 --2- 172.21.15.73:0/4148581475 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f73080c0320 0x7f7308148790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:55.543 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:55.542+0000 7f730dfba640 1 -- 172.21.15.73:0/4148581475 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f730814ea60 msgr2=0x7f73081ed080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:55.543 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:55.542+0000 7f730e7bb640 1 --2- 172.21.15.73:0/4148581475 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f730814ea60 0x7f73081ed080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:55.544 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:55.542+0000 7f730dfba640 1 --2- 172.21.15.73:0/4148581475 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f730814ea60 0x7f73081ed080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:55.544 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:55.542+0000 7f730dfba640 1 -- 172.21.15.73:0/4148581475 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f73080c0320 msgr2=0x7f7308148790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:55.544 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:55.542+0000 7f730dfba640 1 --2- 172.21.15.73:0/4148581475 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f73080c0320 0x7f7308148790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:55.544 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:55.542+0000 7f730dfba640 1 -- 172.21.15.73:0/4148581475 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7300009b30 con 0x7f73080a4c90 2023-12-12T09:44:55.544 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:55.542+0000 7f730d7b9640 1 --2- 172.21.15.73:0/4148581475 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f73080c0320 0x7f7308148790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:44:55.544 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:55.542+0000 7f730dfba640 1 --2- 172.21.15.73:0/4148581475 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f73080a4c90 0x7f730814c4c0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f730400c7f0 tx=0x7f730400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:44:55.544 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:55.542+0000 7f72fe7fc640 1 -- 172.21.15.73:0/4148581475 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7304004220 con 0x7f73080a4c90 2023-12-12T09:44:55.544 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:55.542+0000 7f72fe7fc640 1 -- 172.21.15.73:0/4148581475 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7304004380 con 0x7f73080a4c90 2023-12-12T09:44:55.544 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:55.542+0000 7f72fe7fc640 1 -- 172.21.15.73:0/4148581475 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7304007840 con 0x7f73080a4c90 2023-12-12T09:44:55.544 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:55.542+0000 7f731021e640 1 -- 172.21.15.73:0/4148581475 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73080ab4c0 con 0x7f73080a4c90 2023-12-12T09:44:55.544 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:55.543+0000 7f731021e640 1 -- 172.21.15.73:0/4148581475 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7308148cd0 con 0x7f73080a4c90 2023-12-12T09:44:55.545 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:55.544+0000 7f731021e640 1 -- 172.21.15.73:0/4148581475 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7308067070 con 0x7f73080a4c90 2023-12-12T09:44:55.545 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:55.545+0000 7f72fe7fc640 1 -- 172.21.15.73:0/4148581475 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f7304007bb0 con 0x7f73080a4c90 2023-12-12T09:44:55.545 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:55.545+0000 7f72fe7fc640 1 --2- 172.21.15.73:0/4148581475 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f72ec06ae40 0x7f72ec06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:55.545 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:55.545+0000 7f72fe7fc640 1 -- 172.21.15.73:0/4148581475 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f7304089930 con 0x7f73080a4c90 2023-12-12T09:44:55.546 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:55.546+0000 7f730d7b9640 1 --2- 172.21.15.73:0/4148581475 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f72ec06ae40 0x7f72ec06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:55.546 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:55.546+0000 7f730d7b9640 1 --2- 172.21.15.73:0/4148581475 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f72ec06ae40 0x7f72ec06d300 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f73081ddc30 tx=0x7f72f8009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:44:55.550 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:55.550+0000 7f72fe7fc640 1 -- 172.21.15.73:0/4148581475 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f73040545e0 con 0x7f73080a4c90 2023-12-12T09:44:55.743 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:55.742+0000 7f731021e640 1 -- 172.21.15.73:0/4148581475 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"} v 0) v1 -- 0x7f7308067580 con 0x7f73080a4c90 2023-12-12T09:44:55.743 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:55.743+0000 7f72fe7fc640 1 -- 172.21.15.73:0/4148581475 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"}]=0 v38) v1 ==== 105+0+11 (secure 0 0 0) 0x7f730401e0b0 con 0x7f73080a4c90 2023-12-12T09:44:55.743 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 32 2023-12-12T09:44:55.746 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:55.746+0000 7f731021e640 1 -- 172.21.15.73:0/4148581475 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f72ec06ae40 msgr2=0x7f72ec06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:55.746 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:55.746+0000 7f731021e640 1 --2- 172.21.15.73:0/4148581475 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f72ec06ae40 0x7f72ec06d300 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f73081ddc30 tx=0x7f72f8009040 comp rx=0 tx=0).stop 2023-12-12T09:44:55.746 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:55.746+0000 7f731021e640 1 -- 172.21.15.73:0/4148581475 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f73080a4c90 msgr2=0x7f730814c4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:55.746 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:55.746+0000 7f731021e640 1 --2- 172.21.15.73:0/4148581475 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f73080a4c90 0x7f730814c4c0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f730400c7f0 tx=0x7f730400ccb0 comp rx=0 tx=0).stop 2023-12-12T09:44:55.747 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:55.746+0000 7f731021e640 1 -- 172.21.15.73:0/4148581475 shutdown_connections 2023-12-12T09:44:55.747 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:55.746+0000 7f731021e640 1 --2- 172.21.15.73:0/4148581475 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f72ec06ae40 0x7f72ec06d300 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:55.747 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:55.746+0000 7f731021e640 1 --2- 172.21.15.73:0/4148581475 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f730814ea60 0x7f73081ed080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:55.747 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:55.746+0000 7f731021e640 1 --2- 172.21.15.73:0/4148581475 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f73080c0320 0x7f7308148790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:55.747 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:55.746+0000 7f731021e640 1 --2- 172.21.15.73:0/4148581475 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f73080a4c90 0x7f730814c4c0 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:55.747 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:55.746+0000 7f731021e640 1 -- 172.21.15.73:0/4148581475 >> 172.21.15.73:0/4148581475 conn(0x7f730806a4e0 msgr2=0x7f730806a8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:44:55.747 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:55.746+0000 7f731021e640 1 -- 172.21.15.73:0/4148581475 shutdown_connections 2023-12-12T09:44:55.747 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:55.746+0000 7f731021e640 1 -- 172.21.15.73:0/4148581475 wait complete. 2023-12-12T09:44:55.765 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_data pg_num 2023-12-12T09:44:55.974 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:55.974+0000 7f04ed51d640 1 Processor -- start 2023-12-12T09:44:55.974 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:55.974+0000 7f04ed51d640 1 -- start start 2023-12-12T09:44:55.976 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:55.976+0000 7f04ed51d640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f04e8151c80 0x7f04e8155080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:55.976 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:55.976+0000 7f04ed51d640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04e81581d0 con 0x7f04e80c0310 2023-12-12T09:44:55.976 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:55.976+0000 7f04ed51d640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04e81545e0 con 0x7f04e8070bf0 2023-12-12T09:44:55.977 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:55.976+0000 7f04ed51d640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04e80715f0 con 0x7f04e8151c80 2023-12-12T09:44:55.977 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:55.976+0000 7f04de7fc640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f04e80c0310 0x7f04e8157ac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:52860/0 (socket says 172.21.15.73:52860) 2023-12-12T09:44:55.977 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:55.976+0000 7f04de7fc640 1 -- 172.21.15.73:0/1163467213 learned_addr learned my addr 172.21.15.73:0/1163467213 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-12T09:44:55.978 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:55.977+0000 7f04e6ffd640 1 --2- 172.21.15.73:0/1163467213 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f04e8151c80 0x7f04e8155080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:55.978 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:55.977+0000 7f04e67fc640 1 -- 172.21.15.73:0/1163467213 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3069728081 0 0) 0x7f04e81581d0 con 0x7f04e80c0310 2023-12-12T09:44:55.978 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:55.977+0000 7f04e67fc640 1 -- 172.21.15.73:0/1163467213 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f04d4003520 con 0x7f04e80c0310 2023-12-12T09:44:55.978 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:55.977+0000 7f04e67fc640 1 -- 172.21.15.73:0/1163467213 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3394253559 0 0) 0x7f04d4003520 con 0x7f04e80c0310 2023-12-12T09:44:55.978 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:55.977+0000 7f04e67fc640 1 -- 172.21.15.73:0/1163467213 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f04e8151c80 msgr2=0x7f04e8155080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:44:55.978 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:55.977+0000 7f04e67fc640 1 --2- 172.21.15.73:0/1163467213 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f04e8151c80 0x7f04e8155080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:55.979 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:55.977+0000 7f04e67fc640 1 -- 172.21.15.73:0/1163467213 >> v1:172.21.15.142:6789/0 conn(0x7f04e8070bf0 legacy=0x7f04e80c1c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:55.979 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:55.977+0000 7f04e67fc640 1 -- 172.21.15.73:0/1163467213 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04e8154880 con 0x7f04e80c0310 2023-12-12T09:44:55.979 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:55.977+0000 7f04e67fc640 1 -- 172.21.15.73:0/1163467213 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3186547832 0 0) 0x7f04d0001670 con 0x7f04e80c0310 2023-12-12T09:44:55.979 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:55.977+0000 7f04e67fc640 1 -- 172.21.15.73:0/1163467213 >> v1:172.21.15.73:6789/0 conn(0x7f04e80c0310 legacy=0x7f04e8157ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:55.979 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:55.977+0000 7f04e67fc640 1 --2- 172.21.15.73:0/1163467213 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f04d40039a0 0x7f04d4003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:55.979 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:55.977+0000 7f04e67fc640 1 --2- 172.21.15.73:0/1163467213 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f04e8151c80 0x7f04d40047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:55.979 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:55.977+0000 7f04e67fc640 1 --2- 172.21.15.73:0/1163467213 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f04d4004d00 0x7f04d4005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:55.979 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:55.977+0000 7f04e67fc640 1 -- 172.21.15.73:0/1163467213 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04e80715f0 con 0x7f04d40039a0 2023-12-12T09:44:55.979 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:55.977+0000 7f04e67fc640 1 -- 172.21.15.73:0/1163467213 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04d400bb10 con 0x7f04d4004d00 2023-12-12T09:44:55.979 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:55.977+0000 7f04e67fc640 1 -- 172.21.15.73:0/1163467213 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04d400bcd0 con 0x7f04e8151c80 2023-12-12T09:44:55.979 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:55.978+0000 7f04e6ffd640 1 --2- 172.21.15.73:0/1163467213 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f04d40039a0 0x7f04d4003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:55.979 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:55.978+0000 7f04e6ffd640 1 -- 172.21.15.73:0/1163467213 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f04e8151c80 msgr2=0x7f04d40047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:44:55.979 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:55.978+0000 7f04e6ffd640 1 --2- 172.21.15.73:0/1163467213 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f04e8151c80 0x7f04d40047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:55.979 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:55.978+0000 7f04e6ffd640 1 -- 172.21.15.73:0/1163467213 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f04d4004d00 msgr2=0x7f04d4005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:44:55.979 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:55.978+0000 7f04e6ffd640 1 --2- 172.21.15.73:0/1163467213 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f04d4004d00 0x7f04d4005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:55.980 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:55.978+0000 7f04e6ffd640 1 -- 172.21.15.73:0/1163467213 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04d4003520 con 0x7f04d40039a0 2023-12-12T09:44:55.981 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:55.979+0000 7f04e6ffd640 1 --2- 172.21.15.73:0/1163467213 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f04d40039a0 0x7f04d4003dc0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f04d8009fc0 tx=0x7f04d40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=283b7c1691b20e92 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:44:55.981 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:55.980+0000 7f04e67fc640 1 -- 172.21.15.73:0/1163467213 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04d802cc60 con 0x7f04d40039a0 2023-12-12T09:44:55.981 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:55.980+0000 7f04e67fc640 1 -- 172.21.15.73:0/1163467213 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04d800f040 con 0x7f04d40039a0 2023-12-12T09:44:55.981 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:55.980+0000 7f04e67fc640 1 -- 172.21.15.73:0/1163467213 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04d8034440 con 0x7f04d40039a0 2023-12-12T09:44:55.981 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:55.980+0000 7f04ed51d640 1 -- 172.21.15.73:0/1163467213 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f04d40039a0 msgr2=0x7f04d4003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:55.981 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:55.980+0000 7f04ed51d640 1 --2- 172.21.15.73:0/1163467213 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f04d40039a0 0x7f04d4003dc0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f04d8009fc0 tx=0x7f04d40057f0 comp rx=0 tx=0).stop 2023-12-12T09:44:55.981 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:55.980+0000 7f04e77fe640 1 -- 172.21.15.73:0/1163467213 reap_dead start 2023-12-12T09:44:55.981 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:55.980+0000 7f04ed51d640 1 -- 172.21.15.73:0/1163467213 shutdown_connections 2023-12-12T09:44:55.981 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:55.980+0000 7f04ed51d640 1 -- 172.21.15.73:0/1163467213 >> 172.21.15.73:0/1163467213 conn(0x7f04e80c6020 msgr2=0x7f04e80c6430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:44:55.981 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:55.980+0000 7f04ed51d640 1 -- 172.21.15.73:0/1163467213 shutdown_connections 2023-12-12T09:44:55.981 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:55.981+0000 7f04ed51d640 1 -- 172.21.15.73:0/1163467213 wait complete. 2023-12-12T09:44:55.982 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:55.982+0000 7f04ed51d640 1 Processor -- start 2023-12-12T09:44:55.982 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:55.982+0000 7f04ed51d640 1 -- start start 2023-12-12T09:44:55.984 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:55.983+0000 7f04ed51d640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f04d40039a0 0x7f04e8157de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:55.984 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:55.983+0000 7f04ed51d640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f04e814aab0 0x7f04e80c4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:55.984 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:55.983+0000 7f04ed51d640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f04e8148ed0 0x7f04e8149350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:55.984 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:55.983+0000 7f04ed51d640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04e8156250 con 0x7f04e814aab0 2023-12-12T09:44:55.984 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:55.983+0000 7f04ed51d640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04e8148400 con 0x7f04d40039a0 2023-12-12T09:44:55.984 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:55.983+0000 7f04ed51d640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04e8149890 con 0x7f04e8148ed0 2023-12-12T09:44:55.984 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:55.984+0000 7f04de7fc640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f04e814aab0 0x7f04e80c4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:55.984 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:55.984+0000 7f04de7fc640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f04e814aab0 0x7f04e80c4ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:34220/0 (socket says 172.21.15.73:34220) 2023-12-12T09:44:55.984 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:55.984+0000 7f04de7fc640 1 -- 172.21.15.73:0/3787619655 learned_addr learned my addr 172.21.15.73:0/3787619655 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:44:55.985 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:55.984+0000 7f04e6ffd640 1 --2- 172.21.15.73:0/3787619655 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f04d40039a0 0x7f04e8157de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:55.985 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:55.984+0000 7f04de7fc640 1 -- 172.21.15.73:0/3787619655 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f04e8148ed0 msgr2=0x7f04e8149350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:55.985 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:55.984+0000 7f04de7fc640 1 --2- 172.21.15.73:0/3787619655 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f04e8148ed0 0x7f04e8149350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:55.985 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:55.984+0000 7f04de7fc640 1 -- 172.21.15.73:0/3787619655 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f04d40039a0 msgr2=0x7f04e8157de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:55.985 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:55.984+0000 7f04de7fc640 1 --2- 172.21.15.73:0/3787619655 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f04d40039a0 0x7f04e8157de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:55.986 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:55.984+0000 7f04de7fc640 1 -- 172.21.15.73:0/3787619655 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04e8148930 con 0x7f04e814aab0 2023-12-12T09:44:55.986 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:55.984+0000 7f04de7fc640 1 --2- 172.21.15.73:0/3787619655 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f04e814aab0 0x7f04e80c4ed0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f04d0000ff0 tx=0x7f04d000cb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:44:55.986 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:55.984+0000 7f04dffff640 1 -- 172.21.15.73:0/3787619655 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04d00072d0 con 0x7f04e814aab0 2023-12-12T09:44:55.986 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:55.984+0000 7f04dffff640 1 -- 172.21.15.73:0/3787619655 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04d0007430 con 0x7f04e814aab0 2023-12-12T09:44:55.986 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:55.984+0000 7f04dffff640 1 -- 172.21.15.73:0/3787619655 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04d00047e0 con 0x7f04e814aab0 2023-12-12T09:44:55.986 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:55.984+0000 7f04ed51d640 1 -- 172.21.15.73:0/3787619655 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04e8152720 con 0x7f04e814aab0 2023-12-12T09:44:55.986 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:55.985+0000 7f04ed51d640 1 -- 172.21.15.73:0/3787619655 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04e8155770 con 0x7f04e814aab0 2023-12-12T09:44:55.986 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:55.986+0000 7f04ed51d640 1 -- 172.21.15.73:0/3787619655 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f04e8067580 con 0x7f04e814aab0 2023-12-12T09:44:55.987 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:55.987+0000 7f04dffff640 1 -- 172.21.15.73:0/3787619655 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f04d0004b50 con 0x7f04e814aab0 2023-12-12T09:44:55.988 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:55.988+0000 7f04dffff640 1 --2- 172.21.15.73:0/3787619655 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f04c806ae40 0x7f04c806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:55.988 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:55.988+0000 7f04dffff640 1 -- 172.21.15.73:0/3787619655 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f04d00890b0 con 0x7f04e814aab0 2023-12-12T09:44:55.988 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:55.988+0000 7f04e6ffd640 1 --2- 172.21.15.73:0/3787619655 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f04c806ae40 0x7f04c806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:55.989 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:55.989+0000 7f04e6ffd640 1 --2- 172.21.15.73:0/3787619655 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f04c806ae40 0x7f04c806d300 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f04d8036000 tx=0x7f04d802e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:44:55.992 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:55.992+0000 7f04dffff640 1 -- 172.21.15.73:0/3787619655 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f04d0053df0 con 0x7f04e814aab0 2023-12-12T09:44:56.180 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:56.180+0000 7f04ed51d640 1 -- 172.21.15.73:0/3787619655 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"} v 0) v1 -- 0x7f04e80c2890 con 0x7f04e814aab0 2023-12-12T09:44:56.181 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:56.181+0000 7f04dffff640 1 -- 172.21.15.73:0/3787619655 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"}]=0 v38) v1 ==== 101+0+11 (secure 0 0 0) 0x7f04d0018020 con 0x7f04e814aab0 2023-12-12T09:44:56.181 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 64 2023-12-12T09:44:56.184 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:56.184+0000 7f04ed51d640 1 -- 172.21.15.73:0/3787619655 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f04c806ae40 msgr2=0x7f04c806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:56.184 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:56.184+0000 7f04ed51d640 1 --2- 172.21.15.73:0/3787619655 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f04c806ae40 0x7f04c806d300 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f04d8036000 tx=0x7f04d802e000 comp rx=0 tx=0).stop 2023-12-12T09:44:56.185 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:56.184+0000 7f04ed51d640 1 -- 172.21.15.73:0/3787619655 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f04e814aab0 msgr2=0x7f04e80c4ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:56.185 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:56.184+0000 7f04ed51d640 1 --2- 172.21.15.73:0/3787619655 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f04e814aab0 0x7f04e80c4ed0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f04d0000ff0 tx=0x7f04d000cb90 comp rx=0 tx=0).stop 2023-12-12T09:44:56.185 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:56.184+0000 7f04ed51d640 1 -- 172.21.15.73:0/3787619655 shutdown_connections 2023-12-12T09:44:56.185 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:56.184+0000 7f04ed51d640 1 --2- 172.21.15.73:0/3787619655 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f04c806ae40 0x7f04c806d300 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:56.185 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:56.184+0000 7f04ed51d640 1 --2- 172.21.15.73:0/3787619655 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f04e8148ed0 0x7f04e8149350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:56.185 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:56.184+0000 7f04ed51d640 1 --2- 172.21.15.73:0/3787619655 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f04e814aab0 0x7f04e80c4ed0 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:56.185 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:56.184+0000 7f04ed51d640 1 --2- 172.21.15.73:0/3787619655 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f04d40039a0 0x7f04e8157de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:56.185 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:56.184+0000 7f04ed51d640 1 -- 172.21.15.73:0/3787619655 >> 172.21.15.73:0/3787619655 conn(0x7f04e80c6020 msgr2=0x7f04e806cb30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:44:56.185 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:56.184+0000 7f04ed51d640 1 -- 172.21.15.73:0/3787619655 shutdown_connections 2023-12-12T09:44:56.185 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:56.184+0000 7f04ed51d640 1 -- 172.21.15.73:0/3787619655 wait complete. 2023-12-12T09:44:56.204 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-12T09:44:56.416 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:56.416+0000 7fb54f5a5640 1 Processor -- start 2023-12-12T09:44:56.417 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:56.416+0000 7fb54f5a5640 1 -- start start 2023-12-12T09:44:56.418 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:56.418+0000 7fb54f5a5640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fb5480a9fa0 0x7fb5480bfd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:56.418 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:56.418+0000 7fb54f5a5640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb54806b740 0x7fb548154d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:56.418 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:56.418+0000 7fb54f5a5640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb548154890 con 0x7fb548151b00 2023-12-12T09:44:56.418 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:56.418+0000 7fb54f5a5640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5480c2ad0 con 0x7fb5480a9fa0 2023-12-12T09:44:56.419 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:56.418+0000 7fb54f5a5640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5481545f0 con 0x7fb54806b740 2023-12-12T09:44:56.424 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:56.419+0000 7fb54cb40640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fb5480a9fa0 0x7fb5480bfd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:56.424 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:56.419+0000 7fb54db42640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb54806b740 0x7fb548154d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:56.424 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:56.419+0000 7fb54db42640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb54806b740 0x7fb548154d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.73:56076/0 (socket says 172.21.15.73:56076) 2023-12-12T09:44:56.424 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:56.419+0000 7fb54db42640 1 -- 172.21.15.73:0/491611438 learned_addr learned my addr 172.21.15.73:0/491611438 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:44:56.424 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:56.419+0000 7fb54cb40640 1 -- 172.21.15.73:0/491611438 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb54806b740 msgr2=0x7fb548154d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:44:56.424 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:56.419+0000 7fb54cb40640 1 --2- 172.21.15.73:0/491611438 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb54806b740 0x7fb548154d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:56.424 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:56.419+0000 7fb54cb40640 1 -- 172.21.15.73:0/491611438 >> v1:172.21.15.142:6789/0 conn(0x7fb548151b00 legacy=0x7fb5480c2d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:56.424 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:56.419+0000 7fb54cb40640 1 -- 172.21.15.73:0/491611438 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb548158690 con 0x7fb5480a9fa0 2023-12-12T09:44:56.424 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:56.420+0000 7fb54db42640 1 --2- 172.21.15.73:0/491611438 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb54806b740 0x7fb548154d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-12T09:44:56.424 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:56.421+0000 7fb54cb40640 1 --2- 172.21.15.73:0/491611438 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb5480a9fa0 0x7fb5480bfd50 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fb5380097d0 tx=0x7fb53802b820 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1029a1aff9c61f1b server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:44:56.424 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:56.421+0000 7fb53ffff640 1 -- 172.21.15.73:0/491611438 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb538031780 con 0x7fb5480a9fa0 2023-12-12T09:44:56.424 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:56.421+0000 7fb53ffff640 1 -- 172.21.15.73:0/491611438 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5380318e0 con 0x7fb5480a9fa0 2023-12-12T09:44:56.425 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:56.421+0000 7fb53ffff640 1 -- 172.21.15.73:0/491611438 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb538031c70 con 0x7fb5480a9fa0 2023-12-12T09:44:56.425 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:56.422+0000 7fb54f5a5640 1 -- 172.21.15.73:0/491611438 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb5480a9fa0 msgr2=0x7fb5480bfd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:56.425 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:56.422+0000 7fb54f5a5640 1 --2- 172.21.15.73:0/491611438 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb5480a9fa0 0x7fb5480bfd50 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fb5380097d0 tx=0x7fb53802b820 comp rx=0 tx=0).stop 2023-12-12T09:44:56.425 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:56.422+0000 7fb54f5a5640 1 -- 172.21.15.73:0/491611438 shutdown_connections 2023-12-12T09:44:56.425 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:56.422+0000 7fb54f5a5640 1 --2- 172.21.15.73:0/491611438 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb54806b740 0x7fb548154d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:56.425 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:56.422+0000 7fb54f5a5640 1 --2- 172.21.15.73:0/491611438 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb5480a9fa0 0x7fb5480bfd50 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:56.425 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:56.422+0000 7fb54f5a5640 1 -- 172.21.15.73:0/491611438 >> 172.21.15.73:0/491611438 conn(0x7fb5480a8820 msgr2=0x7fb5480a9530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:44:56.425 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:56.422+0000 7fb54f5a5640 1 -- 172.21.15.73:0/491611438 shutdown_connections 2023-12-12T09:44:56.425 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:56.422+0000 7fb54f5a5640 1 -- 172.21.15.73:0/491611438 wait complete. 2023-12-12T09:44:56.428 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:56.424+0000 7fb54f5a5640 1 Processor -- start 2023-12-12T09:44:56.428 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:56.424+0000 7fb54f5a5640 1 -- start start 2023-12-12T09:44:56.428 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:56.425+0000 7fb54f5a5640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb54806b740 0x7fb5480c15d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:56.428 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:56.425+0000 7fb54f5a5640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb5480a9fa0 0x7fb5481eb2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:56.428 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:56.425+0000 7fb54f5a5640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb548151b00 0x7fb5481eb7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:56.428 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:56.425+0000 7fb54f5a5640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb54814ac70 con 0x7fb54806b740 2023-12-12T09:44:56.428 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:56.425+0000 7fb54f5a5640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5481eddc0 con 0x7fb548151b00 2023-12-12T09:44:56.428 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:56.425+0000 7fb54f5a5640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5481ee2f0 con 0x7fb5480a9fa0 2023-12-12T09:44:56.428 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:56.425+0000 7fb54d341640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb54806b740 0x7fb5480c15d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:56.428 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:56.425+0000 7fb54d341640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb54806b740 0x7fb5480c15d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:34228/0 (socket says 172.21.15.73:34228) 2023-12-12T09:44:56.429 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:56.425+0000 7fb54d341640 1 -- 172.21.15.73:0/2634376157 learned_addr learned my addr 172.21.15.73:0/2634376157 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:44:56.429 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:56.426+0000 7fb54db42640 1 --2- 172.21.15.73:0/2634376157 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb548151b00 0x7fb5481eb7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:56.429 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:56.426+0000 7fb54cb40640 1 --2- 172.21.15.73:0/2634376157 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb5480a9fa0 0x7fb5481eb2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:56.429 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:56.426+0000 7fb54d341640 1 -- 172.21.15.73:0/2634376157 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb5480a9fa0 msgr2=0x7fb5481eb2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:56.429 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:56.426+0000 7fb54d341640 1 --2- 172.21.15.73:0/2634376157 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb5480a9fa0 0x7fb5481eb2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:56.429 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:56.426+0000 7fb54d341640 1 -- 172.21.15.73:0/2634376157 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb548151b00 msgr2=0x7fb5481eb7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:56.429 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:56.426+0000 7fb54d341640 1 --2- 172.21.15.73:0/2634376157 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb548151b00 0x7fb5481eb7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:56.429 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:56.426+0000 7fb54d341640 1 -- 172.21.15.73:0/2634376157 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb540009b30 con 0x7fb54806b740 2023-12-12T09:44:56.429 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:56.426+0000 7fb54db42640 1 --2- 172.21.15.73:0/2634376157 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb548151b00 0x7fb5481eb7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:44:56.429 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:56.426+0000 7fb54d341640 1 --2- 172.21.15.73:0/2634376157 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb54806b740 0x7fb5480c15d0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7fb54400c400 tx=0x7fb54400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:44:56.429 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:56.426+0000 7fb53dffb640 1 -- 172.21.15.73:0/2634376157 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5440052d0 con 0x7fb54806b740 2023-12-12T09:44:56.429 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:56.426+0000 7fb53dffb640 1 -- 172.21.15.73:0/2634376157 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb544005430 con 0x7fb54806b740 2023-12-12T09:44:56.429 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:56.427+0000 7fb54f5a5640 1 -- 172.21.15.73:0/2634376157 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb538009400 con 0x7fb54806b740 2023-12-12T09:44:56.429 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:56.427+0000 7fb53dffb640 1 -- 172.21.15.73:0/2634376157 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb544003830 con 0x7fb54806b740 2023-12-12T09:44:56.429 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:56.427+0000 7fb54f5a5640 1 -- 172.21.15.73:0/2634376157 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5480c41c0 con 0x7fb54806b740 2023-12-12T09:44:56.429 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:56.428+0000 7fb54f5a5640 1 -- 172.21.15.73:0/2634376157 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb548157250 con 0x7fb54806b740 2023-12-12T09:44:56.430 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:56.429+0000 7fb53dffb640 1 -- 172.21.15.73:0/2634376157 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fb544003990 con 0x7fb54806b740 2023-12-12T09:44:56.430 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:56.430+0000 7fb53dffb640 1 --2- 172.21.15.73:0/2634376157 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fb52c06ae40 0x7fb52c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:56.430 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:56.430+0000 7fb53dffb640 1 -- 172.21.15.73:0/2634376157 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fb544088ee0 con 0x7fb54806b740 2023-12-12T09:44:56.430 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:56.430+0000 7fb54cb40640 1 --2- 172.21.15.73:0/2634376157 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fb52c06ae40 0x7fb52c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:56.431 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:56.431+0000 7fb54cb40640 1 --2- 172.21.15.73:0/2634376157 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fb52c06ae40 0x7fb52c06d300 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fb538036000 tx=0x7fb53803d040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:44:56.434 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:56.434+0000 7fb53dffb640 1 -- 172.21.15.73:0/2634376157 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fb544053c20 con 0x7fb54806b740 2023-12-12T09:44:56.642 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:56.642+0000 7fb54f5a5640 1 -- 172.21.15.73:0/2634376157 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fb548067580 con 0x7fb54806b740 2023-12-12T09:44:56.643 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:56.643+0000 7fb53dffb640 1 -- 172.21.15.73:0/2634376157 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v38) v1 ==== 80+0+0 (secure 0 0 0) 0x7fb544017080 con 0x7fb54806b740 2023-12-12T09:44:56.643 INFO:teuthology.orchestra.run.smithi073.stderr:listed 0 entries 2023-12-12T09:44:56.646 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:56.645+0000 7fb54f5a5640 1 -- 172.21.15.73:0/2634376157 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fb52c06ae40 msgr2=0x7fb52c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:56.646 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:56.645+0000 7fb54f5a5640 1 --2- 172.21.15.73:0/2634376157 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fb52c06ae40 0x7fb52c06d300 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fb538036000 tx=0x7fb53803d040 comp rx=0 tx=0).stop 2023-12-12T09:44:56.646 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:56.645+0000 7fb54f5a5640 1 -- 172.21.15.73:0/2634376157 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb54806b740 msgr2=0x7fb5480c15d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:56.646 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:56.645+0000 7fb54f5a5640 1 --2- 172.21.15.73:0/2634376157 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb54806b740 0x7fb5480c15d0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7fb54400c400 tx=0x7fb54400c8c0 comp rx=0 tx=0).stop 2023-12-12T09:44:56.646 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:56.645+0000 7fb54f5a5640 1 -- 172.21.15.73:0/2634376157 shutdown_connections 2023-12-12T09:44:56.646 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:56.645+0000 7fb54f5a5640 1 --2- 172.21.15.73:0/2634376157 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fb52c06ae40 0x7fb52c06d300 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:56.646 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:56.645+0000 7fb54f5a5640 1 --2- 172.21.15.73:0/2634376157 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb548151b00 0x7fb5481eb7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:56.646 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:56.645+0000 7fb54f5a5640 1 --2- 172.21.15.73:0/2634376157 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb5480a9fa0 0x7fb5481eb2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:56.646 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:56.645+0000 7fb54f5a5640 1 --2- 172.21.15.73:0/2634376157 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb54806b740 0x7fb5480c15d0 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:56.646 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:56.645+0000 7fb54f5a5640 1 -- 172.21.15.73:0/2634376157 >> 172.21.15.73:0/2634376157 conn(0x7fb5480a8820 msgr2=0x7fb5480aa380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:44:56.646 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:56.646+0000 7fb54f5a5640 1 -- 172.21.15.73:0/2634376157 shutdown_connections 2023-12-12T09:44:56.646 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:56.646+0000 7fb54f5a5640 1 -- 172.21.15.73:0/2634376157 wait complete. 2023-12-12T09:44:56.665 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-12-12T09:44:56.665 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T09:44:56.665 DEBUG:teuthology.orchestra.run.smithi142:> sudo umount /home/ubuntu/cephtest/mnt.1 2023-12-12T09:44:56.781 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi142.front.sepia.ceph.com 2023-12-12T09:44:56.781 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T09:44:56.781 DEBUG:teuthology.orchestra.run.smithi142:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-12-12T09:44:56.833 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-12T09:44:57.057 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:57.057+0000 7f6a25101640 1 Processor -- start 2023-12-12T09:44:57.057 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:57.057+0000 7f6a25101640 1 -- start start 2023-12-12T09:44:57.058 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:57.058+0000 7f6a25101640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f6a2006db70 0x7f6a200c39b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:57.058 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:57.058+0000 7f6a25101640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f6a200c5070 0x7f6a200c3ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:57.059 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:57.058+0000 7f6a25101640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a20152610 con 0x7f6a2014fa40 2023-12-12T09:44:57.059 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:57.058+0000 7f6a25101640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a201528f0 con 0x7f6a2006db70 2023-12-12T09:44:57.059 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:57.058+0000 7f6a25101640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a20152bd0 con 0x7f6a200c5070 2023-12-12T09:44:57.060 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:57.059+0000 7f6a17fff640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f6a2006db70 0x7f6a200c39b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:57.060 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:57.059+0000 7f6a17fff640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f6a2006db70 0x7f6a200c39b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:34234/0 (socket says 172.21.15.73:34234) 2023-12-12T09:44:57.060 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:57.059+0000 7f6a17fff640 1 -- 172.21.15.73:0/1830803623 learned_addr learned my addr 172.21.15.73:0/1830803623 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:44:57.060 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:57.059+0000 7f6a1f59e640 1 --2- 172.21.15.73:0/1830803623 >> v2:172.21.15.142:3300/0 conn(0x7f6a200c5070 0x7f6a200c3ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:57.060 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:57.059+0000 7f6a17fff640 1 -- 172.21.15.73:0/1830803623 >> v2:172.21.15.142:3300/0 conn(0x7f6a200c5070 msgr2=0x7f6a200c3ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:44:57.060 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:57.059+0000 7f6a17fff640 1 --2- 172.21.15.73:0/1830803623 >> v2:172.21.15.142:3300/0 conn(0x7f6a200c5070 0x7f6a200c3ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:57.060 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:57.059+0000 7f6a17fff640 1 -- 172.21.15.73:0/1830803623 >> v1:172.21.15.142:6789/0 conn(0x7f6a2014fa40 legacy=0x7f6a2006a4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:44:57.060 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:57.059+0000 7f6a17fff640 1 -- 172.21.15.73:0/1830803623 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a20152eb0 con 0x7f6a2006db70 2023-12-12T09:44:57.060 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:57.059+0000 7f6a1f59e640 1 --2- 172.21.15.73:0/1830803623 >> v2:172.21.15.142:3300/0 conn(0x7f6a200c5070 0x7f6a200c3ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:44:57.061 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:57.060+0000 7f6a17fff640 1 --2- 172.21.15.73:0/1830803623 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6a2006db70 0x7f6a200c39b0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f6a2006fc50 tx=0x7f6a0802b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a42a54769d77c356 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:44:57.061 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:57.061+0000 7f6a1e59c640 1 -- 172.21.15.73:0/1830803623 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a08031870 con 0x7f6a2006db70 2023-12-12T09:44:57.061 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:57.061+0000 7f6a1e59c640 1 -- 172.21.15.73:0/1830803623 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a080319d0 con 0x7f6a2006db70 2023-12-12T09:44:57.061 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:57.061+0000 7f6a1e59c640 1 -- 172.21.15.73:0/1830803623 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a08031d60 con 0x7f6a2006db70 2023-12-12T09:44:57.062 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:57.061+0000 7f6a25101640 1 -- 172.21.15.73:0/1830803623 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6a2006db70 msgr2=0x7f6a200c39b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:57.062 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:57.061+0000 7f6a25101640 1 --2- 172.21.15.73:0/1830803623 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6a2006db70 0x7f6a200c39b0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f6a2006fc50 tx=0x7f6a0802b910 comp rx=0 tx=0).stop 2023-12-12T09:44:57.062 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:57.061+0000 7f6a25101640 1 -- 172.21.15.73:0/1830803623 shutdown_connections 2023-12-12T09:44:57.062 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:57.061+0000 7f6a25101640 1 --2- 172.21.15.73:0/1830803623 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6a2006db70 0x7f6a200c39b0 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:57.062 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:57.061+0000 7f6a25101640 1 --2- 172.21.15.73:0/1830803623 >> v2:172.21.15.142:3300/0 conn(0x7f6a200c5070 0x7f6a200c3ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:57.062 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:57.061+0000 7f6a25101640 1 -- 172.21.15.73:0/1830803623 >> 172.21.15.73:0/1830803623 conn(0x7f6a200a8130 msgr2=0x7f6a200c24b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:44:57.062 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:57.061+0000 7f6a25101640 1 -- 172.21.15.73:0/1830803623 shutdown_connections 2023-12-12T09:44:57.062 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:57.061+0000 7f6a25101640 1 -- 172.21.15.73:0/1830803623 wait complete. 2023-12-12T09:44:57.063 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:57.063+0000 7f6a25101640 1 Processor -- start 2023-12-12T09:44:57.063 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:57.063+0000 7f6a25101640 1 -- start start 2023-12-12T09:44:57.066 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:57.064+0000 7f6a25101640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6a2006db70 0x7f6a200a6aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:57.066 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:57.064+0000 7f6a25101640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6a200c5070 0x7f6a201537e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:57.067 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:57.064+0000 7f6a25101640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6a2014fa40 0x7f6a2014b640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:57.067 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:57.064+0000 7f6a25101640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a2014c5f0 con 0x7f6a200c5070 2023-12-12T09:44:57.067 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:57.064+0000 7f6a25101640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a201541d0 con 0x7f6a2006db70 2023-12-12T09:44:57.067 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:57.064+0000 7f6a25101640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a201568b0 con 0x7f6a2014fa40 2023-12-12T09:44:57.067 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:57.064+0000 7f6a17fff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6a200c5070 0x7f6a201537e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:57.067 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:57.064+0000 7f6a17fff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6a200c5070 0x7f6a201537e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:34250/0 (socket says 172.21.15.73:34250) 2023-12-12T09:44:57.067 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:57.064+0000 7f6a17fff640 1 -- 172.21.15.73:0/356338789 learned_addr learned my addr 172.21.15.73:0/356338789 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:44:57.067 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:57.065+0000 7f6a1ed9d640 1 --2- 172.21.15.73:0/356338789 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6a2006db70 0x7f6a200a6aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:57.067 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:57.065+0000 7f6a17fff640 1 -- 172.21.15.73:0/356338789 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6a2014fa40 msgr2=0x7f6a2014b640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:57.067 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:57.065+0000 7f6a17fff640 1 --2- 172.21.15.73:0/356338789 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6a2014fa40 0x7f6a2014b640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:57.067 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:57.065+0000 7f6a17fff640 1 -- 172.21.15.73:0/356338789 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6a2006db70 msgr2=0x7f6a200a6aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:57.067 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:57.065+0000 7f6a17fff640 1 --2- 172.21.15.73:0/356338789 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6a2006db70 0x7f6a200a6aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:57.067 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:57.065+0000 7f6a17fff640 1 -- 172.21.15.73:0/356338789 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a080094d0 con 0x7f6a200c5070 2023-12-12T09:44:57.067 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:57.065+0000 7f6a1ed9d640 1 --2- 172.21.15.73:0/356338789 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6a2006db70 0x7f6a200a6aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:44:57.067 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:57.065+0000 7f6a17fff640 1 --2- 172.21.15.73:0/356338789 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6a200c5070 0x7f6a201537e0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f6a08000c00 tx=0x7f6a080046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:44:57.068 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:57.065+0000 7f6a177fe640 1 -- 172.21.15.73:0/356338789 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a08031840 con 0x7f6a200c5070 2023-12-12T09:44:57.068 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:57.066+0000 7f6a177fe640 1 -- 172.21.15.73:0/356338789 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a080443f0 con 0x7f6a200c5070 2023-12-12T09:44:57.068 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:57.066+0000 7f6a177fe640 1 -- 172.21.15.73:0/356338789 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a080447a0 con 0x7f6a200c5070 2023-12-12T09:44:57.068 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:57.066+0000 7f6a25101640 1 -- 172.21.15.73:0/356338789 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a200a7340 con 0x7f6a200c5070 2023-12-12T09:44:57.068 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:57.066+0000 7f6a25101640 1 -- 172.21.15.73:0/356338789 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a201565d0 con 0x7f6a200c5070 2023-12-12T09:44:57.068 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:57.067+0000 7f6a25101640 1 -- 172.21.15.73:0/356338789 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a20154340 con 0x7f6a200c5070 2023-12-12T09:44:57.068 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:57.068+0000 7f6a177fe640 1 -- 172.21.15.73:0/356338789 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f6a0804d450 con 0x7f6a200c5070 2023-12-12T09:44:57.069 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:57.069+0000 7f6a177fe640 1 --2- 172.21.15.73:0/356338789 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f6a0006ae40 0x7f6a0006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:57.069 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:57.069+0000 7f6a177fe640 1 -- 172.21.15.73:0/356338789 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f6a0802d040 con 0x7f6a200c5070 2023-12-12T09:44:57.069 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:57.069+0000 7f6a1ed9d640 1 --2- 172.21.15.73:0/356338789 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f6a0006ae40 0x7f6a0006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:57.069 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:57.070+0000 7f6a1ed9d640 1 --2- 172.21.15.73:0/356338789 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f6a0006ae40 0x7f6a0006d300 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f6a10007fd0 tx=0x7f6a10009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:44:57.073 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:57.073+0000 7f6a177fe640 1 -- 172.21.15.73:0/356338789 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f6a20154340 con 0x7f6a200c5070 2023-12-12T09:44:57.301 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:57.301+0000 7f6a25101640 1 -- 172.21.15.73:0/356338789 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6a20154340 con 0x7f6a200c5070 2023-12-12T09:44:57.302 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:57.302+0000 7f6a177fe640 1 -- 172.21.15.73:0/356338789 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) v1 ==== 94+0+6133 (secure 0 0 0) 0x7f6a20154340 con 0x7f6a200c5070 2023-12-12T09:44:57.303 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-12T09:44:57.303 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":19,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4517,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6835/2407815368","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6833","nonce":2407815368},{"type":"v1","addr":"172.21.15.142:6835","nonce":2407815368}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":4720,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6834/153753304","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6832","nonce":153753304},{"type":"v1","addr":"172.21.15.142:6834","nonce":153753304}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-12T09:44:20.925302+0000","modified":"2023-12-12T09:44:24.049947+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4965},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4965":{"gid":4965,"name":"c","rank":0,"incarnation":12,"state":"up:active","state_seq":4,"addr":"172.21.15.73:6837/1534083424","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6835","nonce":1534083424},{"type":"v1","addr":"172.21.15.73:6837","nonce":1534083424}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2},{"mdsmap":{"epoch":19,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-12T09:44:36.098486+0000","modified":"2023-12-12T09:44:39.152510+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4962},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4962":{"gid":4962,"name":"a","rank":0,"incarnation":16,"state":"up:active","state_seq":8,"addr":"172.21.15.73:6836/2500303907","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":2500303907},{"type":"v1","addr":"172.21.15.73:6836","nonce":2500303907}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-12-12T09:44:57.303 INFO:teuthology.orchestra.run.smithi073.stderr:dumped fsmap epoch 19 2023-12-12T09:44:57.305 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:57.305+0000 7f6a25101640 1 -- 172.21.15.73:0/356338789 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f6a0006ae40 msgr2=0x7f6a0006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:57.305 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:57.305+0000 7f6a25101640 1 --2- 172.21.15.73:0/356338789 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f6a0006ae40 0x7f6a0006d300 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f6a10007fd0 tx=0x7f6a10009040 comp rx=0 tx=0).stop 2023-12-12T09:44:57.306 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:57.305+0000 7f6a25101640 1 -- 172.21.15.73:0/356338789 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6a200c5070 msgr2=0x7f6a201537e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:57.306 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:57.305+0000 7f6a25101640 1 --2- 172.21.15.73:0/356338789 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6a200c5070 0x7f6a201537e0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f6a08000c00 tx=0x7f6a080046c0 comp rx=0 tx=0).stop 2023-12-12T09:44:57.306 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:57.305+0000 7f6a25101640 1 -- 172.21.15.73:0/356338789 shutdown_connections 2023-12-12T09:44:57.306 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:57.305+0000 7f6a25101640 1 --2- 172.21.15.73:0/356338789 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f6a0006ae40 0x7f6a0006d300 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:57.306 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:57.305+0000 7f6a25101640 1 --2- 172.21.15.73:0/356338789 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6a2014fa40 0x7f6a2014b640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:57.306 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:57.305+0000 7f6a25101640 1 --2- 172.21.15.73:0/356338789 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6a200c5070 0x7f6a201537e0 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:57.306 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:57.305+0000 7f6a25101640 1 --2- 172.21.15.73:0/356338789 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6a2006db70 0x7f6a200a6aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:57.306 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:57.305+0000 7f6a25101640 1 -- 172.21.15.73:0/356338789 >> 172.21.15.73:0/356338789 conn(0x7f6a200a8130 msgr2=0x7f6a200c2070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:44:57.306 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:57.305+0000 7f6a25101640 1 -- 172.21.15.73:0/356338789 shutdown_connections 2023-12-12T09:44:57.306 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:57.305+0000 7f6a25101640 1 -- 172.21.15.73:0/356338789 wait complete. 2023-12-12T09:44:57.324 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-12T09:44:57.535 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:57.535+0000 7f52ab010640 1 Processor -- start 2023-12-12T09:44:57.536 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:57.535+0000 7f52ab010640 1 -- start start 2023-12-12T09:44:57.538 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:57.537+0000 7f52ab010640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f52a4151b90 0x7f52a40c7c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:57.538 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:57.537+0000 7f52ab010640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f52a406b580 0x7f52a4158390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:57.538 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:57.537+0000 7f52ab010640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52a4157f00 con 0x7f52a41588d0 2023-12-12T09:44:57.538 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:57.537+0000 7f52ab010640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52a40c61f0 con 0x7f52a406b580 2023-12-12T09:44:57.538 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:57.537+0000 7f52ab010640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52a40c64d0 con 0x7f52a4151b90 2023-12-12T09:44:57.538 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:57.537+0000 7f52a3fff640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f52a406b580 0x7f52a4158390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:57.538 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:57.537+0000 7f52a3fff640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f52a406b580 0x7f52a4158390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:34262/0 (socket says 172.21.15.73:34262) 2023-12-12T09:44:57.538 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:57.537+0000 7f52a3fff640 1 -- 172.21.15.73:0/561911002 learned_addr learned my addr 172.21.15.73:0/561911002 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:44:57.538 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:57.537+0000 7f52a8dac640 1 --2- 172.21.15.73:0/561911002 >> v2:172.21.15.142:3300/0 conn(0x7f52a4151b90 0x7f52a40c7c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:57.538 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:57.538+0000 7f52a3fff640 1 -- 172.21.15.73:0/561911002 >> v2:172.21.15.142:3300/0 conn(0x7f52a4151b90 msgr2=0x7f52a40c7c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:44:57.538 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:57.538+0000 7f52a3fff640 1 --2- 172.21.15.73:0/561911002 >> v2:172.21.15.142:3300/0 conn(0x7f52a4151b90 0x7f52a40c7c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:57.538 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:57.538+0000 7f52a3fff640 1 -- 172.21.15.73:0/561911002 >> v1:172.21.15.142:6789/0 conn(0x7f52a41588d0 legacy=0x7f52a40c4710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:44:57.539 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:57.538+0000 7f52a3fff640 1 -- 172.21.15.73:0/561911002 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52a4157b90 con 0x7f52a406b580 2023-12-12T09:44:57.539 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:57.539+0000 7f52a3fff640 1 --2- 172.21.15.73:0/561911002 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f52a406b580 0x7f52a4158390 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f52a408afd0 tx=0x7f529002b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52392f9887e42685 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:44:57.539 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:57.539+0000 7f52a37fe640 1 -- 172.21.15.73:0/561911002 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52900317e0 con 0x7f52a406b580 2023-12-12T09:44:57.539 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:57.539+0000 7f52a37fe640 1 -- 172.21.15.73:0/561911002 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5290031940 con 0x7f52a406b580 2023-12-12T09:44:57.540 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:57.539+0000 7f52a37fe640 1 -- 172.21.15.73:0/561911002 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5290031cd0 con 0x7f52a406b580 2023-12-12T09:44:57.540 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:57.540+0000 7f52ab010640 1 -- 172.21.15.73:0/561911002 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f52a406b580 msgr2=0x7f52a4158390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:57.540 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:57.540+0000 7f52ab010640 1 --2- 172.21.15.73:0/561911002 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f52a406b580 0x7f52a4158390 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f52a408afd0 tx=0x7f529002b880 comp rx=0 tx=0).stop 2023-12-12T09:44:57.541 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:57.540+0000 7f52ab010640 1 -- 172.21.15.73:0/561911002 shutdown_connections 2023-12-12T09:44:57.541 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:57.540+0000 7f52ab010640 1 --2- 172.21.15.73:0/561911002 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f52a406b580 0x7f52a4158390 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:57.541 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:57.540+0000 7f52ab010640 1 --2- 172.21.15.73:0/561911002 >> v2:172.21.15.142:3300/0 conn(0x7f52a4151b90 0x7f52a40c7c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:57.541 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:57.540+0000 7f52ab010640 1 -- 172.21.15.73:0/561911002 >> 172.21.15.73:0/561911002 conn(0x7f52a40ab880 msgr2=0x7f52a40abc90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:44:57.541 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:57.540+0000 7f52ab010640 1 -- 172.21.15.73:0/561911002 shutdown_connections 2023-12-12T09:44:57.541 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:57.540+0000 7f52ab010640 1 -- 172.21.15.73:0/561911002 wait complete. 2023-12-12T09:44:57.542 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:57.542+0000 7f52ab010640 1 Processor -- start 2023-12-12T09:44:57.542 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:57.542+0000 7f52ab010640 1 -- start start 2023-12-12T09:44:57.543 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:57.543+0000 7f52ab010640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f52a406b580 0x7f52a4154ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:57.543 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:57.543+0000 7f52ab010640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f52a4151b90 0x7f52a41ede00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:57.543 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:57.543+0000 7f52ab010640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f52a41588d0 0x7f52a41e9590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:57.543 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:57.543+0000 7f52ab010640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52a414e560 con 0x7f52a41588d0 2023-12-12T09:44:57.543 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:57.543+0000 7f52ab010640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52a4150e10 con 0x7f52a4151b90 2023-12-12T09:44:57.543 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:57.543+0000 7f52ab010640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52a4150850 con 0x7f52a406b580 2023-12-12T09:44:57.544 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:57.543+0000 7f52a95ad640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f52a41588d0 0x7f52a41e9590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:57.544 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:57.543+0000 7f52a95ad640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f52a41588d0 0x7f52a41e9590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:34274/0 (socket says 172.21.15.73:34274) 2023-12-12T09:44:57.544 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:57.543+0000 7f52a95ad640 1 -- 172.21.15.73:0/1907555559 learned_addr learned my addr 172.21.15.73:0/1907555559 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:44:57.545 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:57.544+0000 7f52a95ad640 1 -- 172.21.15.73:0/1907555559 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f52a406b580 msgr2=0x7f52a4154ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:57.545 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:57.544+0000 7f52a95ad640 1 --2- 172.21.15.73:0/1907555559 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f52a406b580 0x7f52a4154ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:57.545 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:57.544+0000 7f52a3fff640 1 --2- 172.21.15.73:0/1907555559 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f52a4151b90 0x7f52a41ede00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:57.545 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:57.544+0000 7f52a95ad640 1 -- 172.21.15.73:0/1907555559 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f52a4151b90 msgr2=0x7f52a41ede00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:57.545 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:57.544+0000 7f52a95ad640 1 --2- 172.21.15.73:0/1907555559 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f52a4151b90 0x7f52a41ede00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:57.545 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:57.544+0000 7f52a95ad640 1 -- 172.21.15.73:0/1907555559 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52900094d0 con 0x7f52a41588d0 2023-12-12T09:44:57.545 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:57.544+0000 7f52a95ad640 1 --2- 172.21.15.73:0/1907555559 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f52a41588d0 0x7f52a41e9590 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f529c00c6d0 tx=0x7f529c00cb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:44:57.545 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:57.544+0000 7f52a17fa640 1 -- 172.21.15.73:0/1907555559 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f529c00a840 con 0x7f52a41588d0 2023-12-12T09:44:57.546 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:57.544+0000 7f52a17fa640 1 -- 172.21.15.73:0/1907555559 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f529c00a9a0 con 0x7f52a41588d0 2023-12-12T09:44:57.546 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:57.544+0000 7f52a17fa640 1 -- 172.21.15.73:0/1907555559 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f529c00ad90 con 0x7f52a41588d0 2023-12-12T09:44:57.546 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:57.544+0000 7f52ab010640 1 -- 172.21.15.73:0/1907555559 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52a4150b30 con 0x7f52a41588d0 2023-12-12T09:44:57.546 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:57.544+0000 7f52ab010640 1 -- 172.21.15.73:0/1907555559 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52a41511c0 con 0x7f52a41588d0 2023-12-12T09:44:57.546 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:57.546+0000 7f52ab010640 1 -- 172.21.15.73:0/1907555559 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52a41ea220 con 0x7f52a41588d0 2023-12-12T09:44:57.547 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:57.546+0000 7f52a17fa640 1 -- 172.21.15.73:0/1907555559 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f529c012630 con 0x7f52a41588d0 2023-12-12T09:44:57.547 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:57.547+0000 7f52a17fa640 1 --2- 172.21.15.73:0/1907555559 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f528806ae40 0x7f528806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:57.547 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:57.547+0000 7f52a17fa640 1 -- 172.21.15.73:0/1907555559 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f529c089ff0 con 0x7f52a41588d0 2023-12-12T09:44:57.548 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:57.548+0000 7f52a8dac640 1 --2- 172.21.15.73:0/1907555559 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f528806ae40 0x7f528806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:57.548 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:57.548+0000 7f52a8dac640 1 --2- 172.21.15.73:0/1907555559 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f528806ae40 0x7f528806d300 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f5298006fd0 tx=0x7f5298008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:44:57.552 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:57.552+0000 7f52a17fa640 1 -- 172.21.15.73:0/1907555559 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f52a41ea220 con 0x7f52a41588d0 2023-12-12T09:44:57.748 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:57.748+0000 7f52ab010640 1 -- 172.21.15.73:0/1907555559 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f52a41ea220 con 0x7f52a41588d0 2023-12-12T09:44:57.750 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:57.750+0000 7f52a17fa640 1 -- 172.21.15.73:0/1907555559 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v38) v1 ==== 74+0+20241 (secure 0 0 0) 0x7f52a41ea220 con 0x7f52a41588d0 2023-12-12T09:44:57.751 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-12T09:44:57.751 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":38,"fsid":"ba240992-02b8-4c7e-92f2-27eb29ac433b","created":"2023-12-12T09:43:02.454719+0000","modified":"2023-12-12T09:44:37.659373+0000","last_up_change":"2023-12-12T09:43:13.913440+0000","last_in_change":"2023-12-12T09:43:05.925348+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-12T09:43:15.525508+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-12-12T09:44:18.641446+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-12-12T09:44:19.952405+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs2_metadata","create_time":"2023-12-12T09:44:34.424645+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs2_data","create_time":"2023-12-12T09:44:35.090149+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"dd9074be-dbe2-4c34-9896-a4223d8d3940","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":4047810203},{"type":"v1","addr":"172.21.15.73:6801","nonce":4047810203}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":4047810203},{"type":"v1","addr":"172.21.15.73:6803","nonce":4047810203}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":4047810203},{"type":"v1","addr":"172.21.15.73:6807","nonce":4047810203}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":4047810203},{"type":"v1","addr":"172.21.15.73:6805","nonce":4047810203}]},"public_addr":"172.21.15.73:6801/4047810203","cluster_addr":"172.21.15.73:6803/4047810203","heartbeat_back_addr":"172.21.15.73:6807/4047810203","heartbeat_front_addr":"172.21.15.73:6805/4047810203","state":["exists","up"]},{"osd":1,"uuid":"c4a05052-96d4-4758-a4e1-1a37f1e07fed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":1356058331},{"type":"v1","addr":"172.21.15.73:6824","nonce":1356058331}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":1356058331},{"type":"v1","addr":"172.21.15.73:6827","nonce":1356058331}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":1356058331},{"type":"v1","addr":"172.21.15.73:6831","nonce":1356058331}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":1356058331},{"type":"v1","addr":"172.21.15.73:6829","nonce":1356058331}]},"public_addr":"172.21.15.73:6824/1356058331","cluster_addr":"172.21.15.73:6827/1356058331","heartbeat_back_addr":"172.21.15.73:6831/1356058331","heartbeat_front_addr":"172.21.15.73:6829/1356058331","state":["exists","up"]},{"osd":2,"uuid":"512bc8ac-72c2-40d4-b3d2-d867a92c5213","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":1228903316},{"type":"v1","addr":"172.21.15.73:6817","nonce":1228903316}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":1228903316},{"type":"v1","addr":"172.21.15.73:6819","nonce":1228903316}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6823","nonce":1228903316},{"type":"v1","addr":"172.21.15.73:6825","nonce":1228903316}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":1228903316},{"type":"v1","addr":"172.21.15.73:6821","nonce":1228903316}]},"public_addr":"172.21.15.73:6817/1228903316","cluster_addr":"172.21.15.73:6819/1228903316","heartbeat_back_addr":"172.21.15.73:6825/1228903316","heartbeat_front_addr":"172.21.15.73:6821/1228903316","state":["exists","up"]},{"osd":3,"uuid":"3d1a91e0-42bf-437a-8eae-8d357c8f63a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":1293329670},{"type":"v1","addr":"172.21.15.73:6809","nonce":1293329670}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6810","nonce":1293329670},{"type":"v1","addr":"172.21.15.73:6811","nonce":1293329670}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":1293329670},{"type":"v1","addr":"172.21.15.73:6815","nonce":1293329670}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":1293329670},{"type":"v1","addr":"172.21.15.73:6813","nonce":1293329670}]},"public_addr":"172.21.15.73:6809/1293329670","cluster_addr":"172.21.15.73:6811/1293329670","heartbeat_back_addr":"172.21.15.73:6815/1293329670","heartbeat_front_addr":"172.21.15.73:6813/1293329670","state":["exists","up"]},{"osd":4,"uuid":"4b302fff-834c-4069-ac19-00e46f6c87b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":3727975702},{"type":"v1","addr":"172.21.15.142:6801","nonce":3727975702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":3727975702},{"type":"v1","addr":"172.21.15.142:6803","nonce":3727975702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6809","nonce":3727975702},{"type":"v1","addr":"172.21.15.142:6811","nonce":3727975702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6805","nonce":3727975702},{"type":"v1","addr":"172.21.15.142:6807","nonce":3727975702}]},"public_addr":"172.21.15.142:6801/3727975702","cluster_addr":"172.21.15.142:6803/3727975702","heartbeat_back_addr":"172.21.15.142:6811/3727975702","heartbeat_front_addr":"172.21.15.142:6807/3727975702","state":["exists","up"]},{"osd":5,"uuid":"d7cdace2-67d0-45cc-95f2-515cf6ef1b82","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6817","nonce":2353193632},{"type":"v1","addr":"172.21.15.142:6819","nonce":2353193632}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6821","nonce":2353193632},{"type":"v1","addr":"172.21.15.142:6823","nonce":2353193632}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6829","nonce":2353193632},{"type":"v1","addr":"172.21.15.142:6831","nonce":2353193632}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6825","nonce":2353193632},{"type":"v1","addr":"172.21.15.142:6827","nonce":2353193632}]},"public_addr":"172.21.15.142:6819/2353193632","cluster_addr":"172.21.15.142:6823/2353193632","heartbeat_back_addr":"172.21.15.142:6831/2353193632","heartbeat_front_addr":"172.21.15.142:6827/2353193632","state":["exists","up"]},{"osd":6,"uuid":"649ce78a-5626-445c-aedc-a651ed05a6f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":2006111986},{"type":"v1","addr":"172.21.15.142:6806","nonce":2006111986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":2006111986},{"type":"v1","addr":"172.21.15.142:6810","nonce":2006111986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":2006111986},{"type":"v1","addr":"172.21.15.142:6815","nonce":2006111986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":2006111986},{"type":"v1","addr":"172.21.15.142:6813","nonce":2006111986}]},"public_addr":"172.21.15.142:6806/2006111986","cluster_addr":"172.21.15.142:6810/2006111986","heartbeat_back_addr":"172.21.15.142:6815/2006111986","heartbeat_front_addr":"172.21.15.142:6813/2006111986","state":["exists","up"]},{"osd":7,"uuid":"af15ae3b-c1d0-4acf-92db-8a1805494d13","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":2573794341},{"type":"v1","addr":"172.21.15.142:6818","nonce":2573794341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":2573794341},{"type":"v1","addr":"172.21.15.142:6822","nonce":2573794341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":2573794341},{"type":"v1","addr":"172.21.15.142:6830","nonce":2573794341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":2573794341},{"type":"v1","addr":"172.21.15.142:6826","nonce":2573794341}]},"public_addr":"172.21.15.142:6818/2573794341","cluster_addr":"172.21.15.142:6822/2573794341","heartbeat_back_addr":"172.21.15.142:6830/2573794341","heartbeat_front_addr":"172.21.15.142:6826/2573794341","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.185824+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.262103+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.225556+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:10.523459+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:10.706035+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.257339+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.301776+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.051960+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-12T09:44:57.753 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:57.753+0000 7f52ab010640 1 -- 172.21.15.73:0/1907555559 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f528806ae40 msgr2=0x7f528806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:57.754 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:57.753+0000 7f52ab010640 1 --2- 172.21.15.73:0/1907555559 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f528806ae40 0x7f528806d300 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f5298006fd0 tx=0x7f5298008040 comp rx=0 tx=0).stop 2023-12-12T09:44:57.754 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:57.753+0000 7f52ab010640 1 -- 172.21.15.73:0/1907555559 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f52a41588d0 msgr2=0x7f52a41e9590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:57.754 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:57.753+0000 7f52ab010640 1 --2- 172.21.15.73:0/1907555559 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f52a41588d0 0x7f52a41e9590 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f529c00c6d0 tx=0x7f529c00cb90 comp rx=0 tx=0).stop 2023-12-12T09:44:57.754 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:57.753+0000 7f52ab010640 1 -- 172.21.15.73:0/1907555559 shutdown_connections 2023-12-12T09:44:57.754 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:57.753+0000 7f52ab010640 1 --2- 172.21.15.73:0/1907555559 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f528806ae40 0x7f528806d300 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:57.754 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:57.753+0000 7f52ab010640 1 --2- 172.21.15.73:0/1907555559 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f52a41588d0 0x7f52a41e9590 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:57.754 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:57.753+0000 7f52ab010640 1 --2- 172.21.15.73:0/1907555559 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f52a4151b90 0x7f52a41ede00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:57.754 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:57.753+0000 7f52ab010640 1 --2- 172.21.15.73:0/1907555559 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f52a406b580 0x7f52a4154ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:57.754 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:57.753+0000 7f52ab010640 1 -- 172.21.15.73:0/1907555559 >> 172.21.15.73:0/1907555559 conn(0x7f52a40ab880 msgr2=0x7f52a40c4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:44:57.754 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:57.753+0000 7f52ab010640 1 -- 172.21.15.73:0/1907555559 shutdown_connections 2023-12-12T09:44:57.754 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:57.753+0000 7f52ab010640 1 -- 172.21.15.73:0/1907555559 wait complete. 2023-12-12T09:44:57.772 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-12T09:43:15.525508+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-12T09:44:18.641446+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '33', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data', 'create_time': '2023-12-12T09:44:19.952405+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '34', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs2_metadata', 'create_time': '2023-12-12T09:44:34.424645+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '37', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs2'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'cephfs2_data', 'create_time': '2023-12-12T09:44:35.090149+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '38', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs2'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-12T09:44:57.773 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-12T09:44:57.989 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:57.988+0000 7f6060409640 1 Processor -- start 2023-12-12T09:44:57.989 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:57.988+0000 7f6060409640 1 -- start start 2023-12-12T09:44:57.990 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:57.990+0000 7f6060409640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f605806d350 0x7f605806dc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:57.990 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:57.990+0000 7f6060409640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f6058152500 0x7f6058152990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:57.990 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:57.990+0000 7f6060409640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60580c16c0 con 0x7f605814f8c0 2023-12-12T09:44:57.990 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:57.990+0000 7f6060409640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60580c1090 con 0x7f605806d350 2023-12-12T09:44:57.990 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:57.990+0000 7f6060409640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60580c14b0 con 0x7f6058152500 2023-12-12T09:44:57.991 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:57.990+0000 7f605d9a4640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f605806d350 0x7f605806dc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:57.991 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:57.990+0000 7f605d9a4640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f605806d350 0x7f605806dc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:34282/0 (socket says 172.21.15.73:34282) 2023-12-12T09:44:57.991 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:57.990+0000 7f605d9a4640 1 -- 172.21.15.73:0/3574133517 learned_addr learned my addr 172.21.15.73:0/3574133517 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:44:57.991 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:57.991+0000 7f605e9a6640 1 --2- 172.21.15.73:0/3574133517 >> v2:172.21.15.142:3300/0 conn(0x7f6058152500 0x7f6058152990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:57.991 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:57.991+0000 7f605d9a4640 1 -- 172.21.15.73:0/3574133517 >> v2:172.21.15.142:3300/0 conn(0x7f6058152500 msgr2=0x7f6058152990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:44:57.991 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:57.991+0000 7f605d9a4640 1 --2- 172.21.15.73:0/3574133517 >> v2:172.21.15.142:3300/0 conn(0x7f6058152500 0x7f6058152990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:57.991 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:57.991+0000 7f605d9a4640 1 -- 172.21.15.73:0/3574133517 >> v1:172.21.15.142:6789/0 conn(0x7f605814f8c0 legacy=0x7f6058071e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:44:57.991 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:57.991+0000 7f605d9a4640 1 -- 172.21.15.73:0/3574133517 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60580c19a0 con 0x7f605806d350 2023-12-12T09:44:57.992 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:57.992+0000 7f605d9a4640 1 --2- 172.21.15.73:0/3574133517 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f605806d350 0x7f605806dc40 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f60580c34e0 tx=0x7f604802b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17e25817ba821917 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:44:57.992 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:57.992+0000 7f605d1a3640 1 -- 172.21.15.73:0/3574133517 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6048031870 con 0x7f605806d350 2023-12-12T09:44:57.992 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:57.992+0000 7f605d1a3640 1 -- 172.21.15.73:0/3574133517 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60480319d0 con 0x7f605806d350 2023-12-12T09:44:57.992 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:57.992+0000 7f605d1a3640 1 -- 172.21.15.73:0/3574133517 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6048031d60 con 0x7f605806d350 2023-12-12T09:44:57.993 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:57.993+0000 7f6060409640 1 -- 172.21.15.73:0/3574133517 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f605806d350 msgr2=0x7f605806dc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:57.993 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:57.993+0000 7f6060409640 1 --2- 172.21.15.73:0/3574133517 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f605806d350 0x7f605806dc40 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f60580c34e0 tx=0x7f604802b910 comp rx=0 tx=0).stop 2023-12-12T09:44:57.993 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:57.993+0000 7f6060409640 1 -- 172.21.15.73:0/3574133517 shutdown_connections 2023-12-12T09:44:57.993 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:57.993+0000 7f6060409640 1 --2- 172.21.15.73:0/3574133517 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f605806d350 0x7f605806dc40 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:57.993 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:57.993+0000 7f6060409640 1 --2- 172.21.15.73:0/3574133517 >> v2:172.21.15.142:3300/0 conn(0x7f6058152500 0x7f6058152990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:57.994 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:57.993+0000 7f6060409640 1 -- 172.21.15.73:0/3574133517 >> 172.21.15.73:0/3574133517 conn(0x7f605806a4e0 msgr2=0x7f605806a8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:44:57.994 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:57.993+0000 7f6060409640 1 -- 172.21.15.73:0/3574133517 shutdown_connections 2023-12-12T09:44:57.994 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:57.993+0000 7f6060409640 1 -- 172.21.15.73:0/3574133517 wait complete. 2023-12-12T09:44:57.995 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:57.995+0000 7f6060409640 1 Processor -- start 2023-12-12T09:44:57.995 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:57.995+0000 7f6060409640 1 -- start start 2023-12-12T09:44:57.999 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:57.997+0000 7f6060409640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f605806d350 0x7f60580a6b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:57.999 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:57.997+0000 7f6060409640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f605814f8c0 0x7f6058144b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:57.999 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:57.997+0000 7f6060409640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6058152500 0x7f60581450c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:57.999 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:57.997+0000 7f6060409640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60580a8790 con 0x7f605814f8c0 2023-12-12T09:44:57.999 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:57.997+0000 7f6060409640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60580bf630 con 0x7f6058152500 2023-12-12T09:44:58.000 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:57.997+0000 7f6060409640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60580a89e0 con 0x7f605806d350 2023-12-12T09:44:58.000 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:57.997+0000 7f605d9a4640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f605814f8c0 0x7f6058144b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:58.000 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:57.997+0000 7f605d9a4640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f605814f8c0 0x7f6058144b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:34288/0 (socket says 172.21.15.73:34288) 2023-12-12T09:44:58.000 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:57.997+0000 7f605d9a4640 1 -- 172.21.15.73:0/2892171784 learned_addr learned my addr 172.21.15.73:0/2892171784 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:44:58.000 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:57.997+0000 7f605d9a4640 1 -- 172.21.15.73:0/2892171784 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f605806d350 msgr2=0x7f60580a6b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:58.000 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:57.997+0000 7f605e1a5640 1 --2- 172.21.15.73:0/2892171784 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f605806d350 0x7f60580a6b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:58.000 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:57.997+0000 7f605d9a4640 1 --2- 172.21.15.73:0/2892171784 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f605806d350 0x7f60580a6b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:58.000 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:57.997+0000 7f605d9a4640 1 -- 172.21.15.73:0/2892171784 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6058152500 msgr2=0x7f60581450c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:58.000 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:57.997+0000 7f605e9a6640 1 --2- 172.21.15.73:0/2892171784 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6058152500 0x7f60581450c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:58.000 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:57.997+0000 7f605d9a4640 1 --2- 172.21.15.73:0/2892171784 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6058152500 0x7f60581450c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:58.000 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:57.997+0000 7f605d9a4640 1 -- 172.21.15.73:0/2892171784 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60480094d0 con 0x7f605814f8c0 2023-12-12T09:44:58.000 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:57.998+0000 7f605d9a4640 1 --2- 172.21.15.73:0/2892171784 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f605814f8c0 0x7f6058144b80 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f6048000c00 tx=0x7f60480046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:44:58.001 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:57.998+0000 7f604effd640 1 -- 172.21.15.73:0/2892171784 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f604803ad10 con 0x7f605814f8c0 2023-12-12T09:44:58.001 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:57.998+0000 7f604effd640 1 -- 172.21.15.73:0/2892171784 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f604803ae70 con 0x7f605814f8c0 2023-12-12T09:44:58.001 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:57.998+0000 7f6060409640 1 -- 172.21.15.73:0/2892171784 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60580a8cc0 con 0x7f605814f8c0 2023-12-12T09:44:58.001 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:57.998+0000 7f604effd640 1 -- 172.21.15.73:0/2892171784 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6048044610 con 0x7f605814f8c0 2023-12-12T09:44:58.001 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:57.998+0000 7f6060409640 1 -- 172.21.15.73:0/2892171784 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60580ab530 con 0x7f605814f8c0 2023-12-12T09:44:58.001 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:57.999+0000 7f6060409640 1 -- 172.21.15.73:0/2892171784 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6058067070 con 0x7f605814f8c0 2023-12-12T09:44:58.001 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:58.001+0000 7f604effd640 1 -- 172.21.15.73:0/2892171784 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f604804d450 con 0x7f605814f8c0 2023-12-12T09:44:58.002 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:58.002+0000 7f604effd640 1 --2- 172.21.15.73:0/2892171784 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f603c06ae40 0x7f603c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:58.002 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:58.002+0000 7f604effd640 1 -- 172.21.15.73:0/2892171784 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f604802d040 con 0x7f605814f8c0 2023-12-12T09:44:58.002 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:58.002+0000 7f605e1a5640 1 --2- 172.21.15.73:0/2892171784 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f603c06ae40 0x7f603c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:58.002 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:58.003+0000 7f605e1a5640 1 --2- 172.21.15.73:0/2892171784 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f603c06ae40 0x7f603c06d300 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f60581e7f50 tx=0x7f6054009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:44:58.008 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:58.007+0000 7f604effd640 1 -- 172.21.15.73:0/2892171784 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f6048076d80 con 0x7f605814f8c0 2023-12-12T09:44:58.196 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:58.195+0000 7f6060409640 1 -- 172.21.15.73:0/2892171784 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f6058067580 con 0x7f605814f8c0 2023-12-12T09:44:58.196 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:58.196+0000 7f604effd640 1 -- 172.21.15.73:0/2892171784 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v38) v1 ==== 93+0+10 (secure 0 0 0) 0x7f604807a3a0 con 0x7f605814f8c0 2023-12-12T09:44:58.197 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 1 2023-12-12T09:44:58.199 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:58.199+0000 7f6060409640 1 -- 172.21.15.73:0/2892171784 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f603c06ae40 msgr2=0x7f603c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:58.199 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:58.199+0000 7f6060409640 1 --2- 172.21.15.73:0/2892171784 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f603c06ae40 0x7f603c06d300 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f60581e7f50 tx=0x7f6054009040 comp rx=0 tx=0).stop 2023-12-12T09:44:58.200 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:58.199+0000 7f6060409640 1 -- 172.21.15.73:0/2892171784 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f605814f8c0 msgr2=0x7f6058144b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:58.200 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:58.199+0000 7f6060409640 1 --2- 172.21.15.73:0/2892171784 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f605814f8c0 0x7f6058144b80 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f6048000c00 tx=0x7f60480046c0 comp rx=0 tx=0).stop 2023-12-12T09:44:58.200 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:58.199+0000 7f6060409640 1 -- 172.21.15.73:0/2892171784 shutdown_connections 2023-12-12T09:44:58.200 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:58.199+0000 7f6060409640 1 --2- 172.21.15.73:0/2892171784 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f603c06ae40 0x7f603c06d300 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:58.200 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:58.199+0000 7f6060409640 1 --2- 172.21.15.73:0/2892171784 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6058152500 0x7f60581450c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:58.200 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:58.199+0000 7f6060409640 1 --2- 172.21.15.73:0/2892171784 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f605814f8c0 0x7f6058144b80 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:58.200 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:58.199+0000 7f6060409640 1 --2- 172.21.15.73:0/2892171784 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f605806d350 0x7f60580a6b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:58.200 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:58.199+0000 7f6060409640 1 -- 172.21.15.73:0/2892171784 >> 172.21.15.73:0/2892171784 conn(0x7f605806a4e0 msgr2=0x7f60580c3780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:44:58.200 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:58.199+0000 7f6060409640 1 -- 172.21.15.73:0/2892171784 shutdown_connections 2023-12-12T09:44:58.200 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:58.199+0000 7f6060409640 1 -- 172.21.15.73:0/2892171784 wait complete. 2023-12-12T09:44:58.218 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-12T09:44:58.432 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:58.432+0000 7f45eab05640 1 Processor -- start 2023-12-12T09:44:58.432 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:58.432+0000 7f45eab05640 1 -- start start 2023-12-12T09:44:58.434 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:58.433+0000 7f45eab05640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f45e414f8c0 0x7f45e406dc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:58.434 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:58.434+0000 7f45eab05640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f45e4152500 0x7f45e4152990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:58.434 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:58.434+0000 7f45eab05640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45e40c16c0 con 0x7f45e406d350 2023-12-12T09:44:58.434 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:58.434+0000 7f45eab05640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45e40c1090 con 0x7f45e4152500 2023-12-12T09:44:58.434 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:58.434+0000 7f45eab05640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45e40c14b0 con 0x7f45e414f8c0 2023-12-12T09:44:58.435 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:58.434+0000 7f45e90a2640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f45e4152500 0x7f45e4152990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:58.435 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:58.434+0000 7f45e3fff640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f45e406d350 0x7f45e4071e60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:52866/0 (socket says 172.21.15.73:52866) 2023-12-12T09:44:58.435 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:58.434+0000 7f45e3fff640 1 -- 172.21.15.73:0/2170750951 learned_addr learned my addr 172.21.15.73:0/2170750951 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-12T09:44:58.435 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:58.434+0000 7f45e88a1640 1 --2- 172.21.15.73:0/2170750951 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f45e414f8c0 0x7f45e406dc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:58.435 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:58.435+0000 7f45e90a2640 1 -- 172.21.15.73:0/2170750951 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f45e414f8c0 msgr2=0x7f45e406dc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:44:58.435 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:58.435+0000 7f45e90a2640 1 --2- 172.21.15.73:0/2170750951 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f45e414f8c0 0x7f45e406dc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:58.435 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:58.435+0000 7f45e90a2640 1 -- 172.21.15.73:0/2170750951 >> v1:172.21.15.73:6789/0 conn(0x7f45e406d350 legacy=0x7f45e4071e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:58.435 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:58.435+0000 7f45e90a2640 1 -- 172.21.15.73:0/2170750951 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45e40c19a0 con 0x7f45e4152500 2023-12-12T09:44:58.435 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:58.435+0000 7f45e37fe640 1 -- 172.21.15.73:0/2170750951 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3048344330 0 0) 0x7f45e40c16c0 con 0x7f45e406d350 2023-12-12T09:44:58.435 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:58.435+0000 7f45e88a1640 1 --2- 172.21.15.73:0/2170750951 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f45e414f8c0 0x7f45e406dc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-12T09:44:58.436 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:58.436+0000 7f45e90a2640 1 --2- 172.21.15.73:0/2170750951 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f45e4152500 0x7f45e4152990 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f45dc009d90 tx=0x7f45dc02bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=385009c6bc246596 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:44:58.436 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:58.436+0000 7f45e37fe640 1 -- 172.21.15.73:0/2170750951 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45dc02cc50 con 0x7f45e4152500 2023-12-12T09:44:58.436 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:58.436+0000 7f45e37fe640 1 -- 172.21.15.73:0/2170750951 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45dc02cdb0 con 0x7f45e4152500 2023-12-12T09:44:58.436 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:58.436+0000 7f45e37fe640 1 -- 172.21.15.73:0/2170750951 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45dc034660 con 0x7f45e4152500 2023-12-12T09:44:58.437 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:58.437+0000 7f45eab05640 1 -- 172.21.15.73:0/2170750951 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f45e4152500 msgr2=0x7f45e4152990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:58.437 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:58.437+0000 7f45eab05640 1 --2- 172.21.15.73:0/2170750951 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f45e4152500 0x7f45e4152990 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f45dc009d90 tx=0x7f45dc02bea0 comp rx=0 tx=0).stop 2023-12-12T09:44:58.437 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:58.437+0000 7f45eab05640 1 -- 172.21.15.73:0/2170750951 shutdown_connections 2023-12-12T09:44:58.437 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:58.437+0000 7f45eab05640 1 --2- 172.21.15.73:0/2170750951 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f45e4152500 0x7f45e4152990 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:58.437 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:58.437+0000 7f45eab05640 1 --2- 172.21.15.73:0/2170750951 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f45e414f8c0 0x7f45e406dc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:58.438 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:58.437+0000 7f45eab05640 1 -- 172.21.15.73:0/2170750951 >> 172.21.15.73:0/2170750951 conn(0x7f45e406a4e0 msgr2=0x7f45e406a8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:44:58.438 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:58.437+0000 7f45eab05640 1 -- 172.21.15.73:0/2170750951 shutdown_connections 2023-12-12T09:44:58.438 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:58.437+0000 7f45eab05640 1 -- 172.21.15.73:0/2170750951 wait complete. 2023-12-12T09:44:58.439 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:58.439+0000 7f45eab05640 1 Processor -- start 2023-12-12T09:44:58.439 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:58.439+0000 7f45eab05640 1 -- start start 2023-12-12T09:44:58.440 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:58.440+0000 7f45eab05640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f45e406d350 0x7f45e414d8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:58.440 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:58.440+0000 7f45eab05640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f45e414f8c0 0x7f45e41e6cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:58.440 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:58.440+0000 7f45eab05640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f45e4152500 0x7f45e41eb650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:58.441 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:58.440+0000 7f45eab05640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45e41538d0 con 0x7f45e414f8c0 2023-12-12T09:44:58.441 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:58.440+0000 7f45eab05640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45e41eda60 con 0x7f45e406d350 2023-12-12T09:44:58.441 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:58.440+0000 7f45eab05640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45e41edd40 con 0x7f45e4152500 2023-12-12T09:44:58.441 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:58.440+0000 7f45e3fff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f45e414f8c0 0x7f45e41e6cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:58.441 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:58.440+0000 7f45e3fff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f45e414f8c0 0x7f45e41e6cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:34300/0 (socket says 172.21.15.73:34300) 2023-12-12T09:44:58.441 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:58.440+0000 7f45e3fff640 1 -- 172.21.15.73:0/337273640 learned_addr learned my addr 172.21.15.73:0/337273640 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:44:58.441 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:58.440+0000 7f45e3fff640 1 -- 172.21.15.73:0/337273640 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f45e4152500 msgr2=0x7f45e41eb650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:58.441 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:58.440+0000 7f45e3fff640 1 --2- 172.21.15.73:0/337273640 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f45e4152500 0x7f45e41eb650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:58.441 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:58.440+0000 7f45e3fff640 1 -- 172.21.15.73:0/337273640 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f45e406d350 msgr2=0x7f45e414d8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:58.441 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:58.440+0000 7f45e3fff640 1 --2- 172.21.15.73:0/337273640 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f45e406d350 0x7f45e414d8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:58.441 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:58.440+0000 7f45e3fff640 1 -- 172.21.15.73:0/337273640 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45dc009a70 con 0x7f45e414f8c0 2023-12-12T09:44:58.442 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:58.441+0000 7f45e3fff640 1 --2- 172.21.15.73:0/337273640 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f45e414f8c0 0x7f45e41e6cd0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f45d000c430 tx=0x7f45d000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:44:58.442 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:58.441+0000 7f45e17fa640 1 -- 172.21.15.73:0/337273640 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45d00074e0 con 0x7f45e414f8c0 2023-12-12T09:44:58.442 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:58.441+0000 7f45e17fa640 1 -- 172.21.15.73:0/337273640 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45d0007660 con 0x7f45e414f8c0 2023-12-12T09:44:58.442 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:58.441+0000 7f45e17fa640 1 -- 172.21.15.73:0/337273640 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45d0004a20 con 0x7f45e414f8c0 2023-12-12T09:44:58.442 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:58.441+0000 7f45eab05640 1 -- 172.21.15.73:0/337273640 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45e41eae50 con 0x7f45e414f8c0 2023-12-12T09:44:58.442 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:58.441+0000 7f45eab05640 1 -- 172.21.15.73:0/337273640 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45e4153560 con 0x7f45e414f8c0 2023-12-12T09:44:58.442 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:58.442+0000 7f45eab05640 1 -- 172.21.15.73:0/337273640 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45e414fca0 con 0x7f45e414f8c0 2023-12-12T09:44:58.443 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:58.443+0000 7f45e17fa640 1 -- 172.21.15.73:0/337273640 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f45d0004b80 con 0x7f45e414f8c0 2023-12-12T09:44:58.444 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:58.444+0000 7f45e17fa640 1 --2- 172.21.15.73:0/337273640 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f45c806ae40 0x7f45c806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:58.444 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:58.444+0000 7f45e17fa640 1 -- 172.21.15.73:0/337273640 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f45d0089820 con 0x7f45e414f8c0 2023-12-12T09:44:58.444 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:58.444+0000 7f45e88a1640 1 --2- 172.21.15.73:0/337273640 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f45c806ae40 0x7f45c806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:58.445 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:58.445+0000 7f45e88a1640 1 --2- 172.21.15.73:0/337273640 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f45c806ae40 0x7f45c806d300 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f45d8006e80 tx=0x7f45d8008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:44:58.448 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:58.448+0000 7f45e17fa640 1 -- 172.21.15.73:0/337273640 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f45d0054560 con 0x7f45e414f8c0 2023-12-12T09:44:58.641 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:58.641+0000 7f45eab05640 1 -- 172.21.15.73:0/337273640 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f45e41eb370 con 0x7f45e414f8c0 2023-12-12T09:44:58.642 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:58.641+0000 7f45e17fa640 1 -- 172.21.15.73:0/337273640 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v38) v1 ==== 104+0+11 (secure 0 0 0) 0x7f45d0057b80 con 0x7f45e414f8c0 2023-12-12T09:44:58.642 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 32 2023-12-12T09:44:58.644 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:58.644+0000 7f45eab05640 1 -- 172.21.15.73:0/337273640 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f45c806ae40 msgr2=0x7f45c806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:58.645 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:58.644+0000 7f45eab05640 1 --2- 172.21.15.73:0/337273640 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f45c806ae40 0x7f45c806d300 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f45d8006e80 tx=0x7f45d8008040 comp rx=0 tx=0).stop 2023-12-12T09:44:58.645 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:58.644+0000 7f45eab05640 1 -- 172.21.15.73:0/337273640 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f45e414f8c0 msgr2=0x7f45e41e6cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:58.645 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:58.644+0000 7f45eab05640 1 --2- 172.21.15.73:0/337273640 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f45e414f8c0 0x7f45e41e6cd0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f45d000c430 tx=0x7f45d000c8f0 comp rx=0 tx=0).stop 2023-12-12T09:44:58.645 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:58.644+0000 7f45eab05640 1 -- 172.21.15.73:0/337273640 shutdown_connections 2023-12-12T09:44:58.645 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:58.644+0000 7f45eab05640 1 --2- 172.21.15.73:0/337273640 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f45c806ae40 0x7f45c806d300 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:58.645 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:58.644+0000 7f45eab05640 1 --2- 172.21.15.73:0/337273640 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f45e4152500 0x7f45e41eb650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:58.645 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:58.644+0000 7f45eab05640 1 --2- 172.21.15.73:0/337273640 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f45e414f8c0 0x7f45e41e6cd0 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:58.645 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:58.644+0000 7f45eab05640 1 --2- 172.21.15.73:0/337273640 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f45e406d350 0x7f45e414d8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:58.645 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:58.644+0000 7f45eab05640 1 -- 172.21.15.73:0/337273640 >> 172.21.15.73:0/337273640 conn(0x7f45e406a4e0 msgr2=0x7f45e40c59a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:44:58.645 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:58.644+0000 7f45eab05640 1 -- 172.21.15.73:0/337273640 shutdown_connections 2023-12-12T09:44:58.645 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:58.644+0000 7f45eab05640 1 -- 172.21.15.73:0/337273640 wait complete. 2023-12-12T09:44:58.664 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-12T09:44:58.883 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:58.883+0000 7fe232a7c640 1 Processor -- start 2023-12-12T09:44:58.883 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:58.883+0000 7fe232a7c640 1 -- start start 2023-12-12T09:44:58.885 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:58.884+0000 7fe232a7c640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe22c14f8c0 0x7fe22c06dc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:58.885 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:58.885+0000 7fe232a7c640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe22c0c16c0 con 0x7fe22c06d350 2023-12-12T09:44:58.885 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:58.885+0000 7fe232a7c640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe22c0c19a0 con 0x7fe22c152500 2023-12-12T09:44:58.885 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:58.885+0000 7fe232a7c640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe22c0c1090 con 0x7fe22c14f8c0 2023-12-12T09:44:58.885 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:58.885+0000 7fe22bfff640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7fe22c06d350 0x7fe22c071e60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:51102/0 (socket says 172.21.15.73:51102) 2023-12-12T09:44:58.885 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:58.885+0000 7fe22bfff640 1 -- 172.21.15.73:0/423206884 learned_addr learned my addr 172.21.15.73:0/423206884 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-12T09:44:58.887 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:58.885+0000 7fe230818640 1 --2- 172.21.15.73:0/423206884 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe22c14f8c0 0x7fe22c06dc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:58.887 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:58.885+0000 7fe22b7fe640 1 -- 172.21.15.73:0/423206884 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 241750176 0 0) 0x7fe22c0c16c0 con 0x7fe22c06d350 2023-12-12T09:44:58.887 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:58.885+0000 7fe22b7fe640 1 -- 172.21.15.73:0/423206884 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe21c003520 con 0x7fe22c06d350 2023-12-12T09:44:58.887 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:58.886+0000 7fe22b7fe640 1 -- 172.21.15.73:0/423206884 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1897360097 0 0) 0x7fe21c003520 con 0x7fe22c06d350 2023-12-12T09:44:58.887 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:58.886+0000 7fe22b7fe640 1 -- 172.21.15.73:0/423206884 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe22c14f8c0 msgr2=0x7fe22c06dc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:44:58.887 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:58.886+0000 7fe22b7fe640 1 --2- 172.21.15.73:0/423206884 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe22c14f8c0 0x7fe22c06dc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:58.887 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:58.886+0000 7fe22b7fe640 1 -- 172.21.15.73:0/423206884 >> v1:172.21.15.142:6789/0 conn(0x7fe22c152500 legacy=0x7fe22c152990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:58.888 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:58.886+0000 7fe22b7fe640 1 -- 172.21.15.73:0/423206884 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe22c0c1c80 con 0x7fe22c06d350 2023-12-12T09:44:58.888 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:58.886+0000 7fe22b7fe640 1 -- 172.21.15.73:0/423206884 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3186547832 0 0) 0x7fe218001670 con 0x7fe22c06d350 2023-12-12T09:44:58.888 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:58.886+0000 7fe22b7fe640 1 -- 172.21.15.73:0/423206884 >> v1:172.21.15.73:6789/0 conn(0x7fe22c06d350 legacy=0x7fe22c071e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:58.888 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:58.886+0000 7fe22b7fe640 1 --2- 172.21.15.73:0/423206884 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe22c14f8c0 0x7fe21c0039a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:58.888 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:58.886+0000 7fe22b7fe640 1 --2- 172.21.15.73:0/423206884 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe21c003f20 0x7fe21c0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:58.888 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:58.886+0000 7fe22b7fe640 1 --2- 172.21.15.73:0/423206884 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe21c004d00 0x7fe21c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:58.888 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:58.886+0000 7fe22b7fe640 1 -- 172.21.15.73:0/423206884 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe21c00ba30 con 0x7fe21c004d00 2023-12-12T09:44:58.888 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:58.886+0000 7fe22b7fe640 1 -- 172.21.15.73:0/423206884 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe21c00bba0 con 0x7fe21c003f20 2023-12-12T09:44:58.888 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:58.886+0000 7fe22b7fe640 1 -- 172.21.15.73:0/423206884 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe21c00bd60 con 0x7fe22c14f8c0 2023-12-12T09:44:58.888 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:58.886+0000 7fe231019640 1 --2- 172.21.15.73:0/423206884 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe21c004d00 0x7fe21c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:58.888 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:58.887+0000 7fe230818640 1 --2- 172.21.15.73:0/423206884 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe22c14f8c0 0x7fe21c0039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:58.888 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:58.887+0000 7fe22bfff640 1 --2- 172.21.15.73:0/423206884 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe21c003f20 0x7fe21c0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:58.888 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:58.887+0000 7fe231019640 1 -- 172.21.15.73:0/423206884 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe22c14f8c0 msgr2=0x7fe21c0039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:44:58.889 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:58.887+0000 7fe231019640 1 --2- 172.21.15.73:0/423206884 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe22c14f8c0 0x7fe21c0039a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:58.889 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:58.887+0000 7fe231019640 1 -- 172.21.15.73:0/423206884 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe21c003f20 msgr2=0x7fe21c0047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:44:58.889 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:58.887+0000 7fe231019640 1 --2- 172.21.15.73:0/423206884 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe21c003f20 0x7fe21c0047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:58.889 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:58.887+0000 7fe231019640 1 -- 172.21.15.73:0/423206884 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe21c003520 con 0x7fe21c004d00 2023-12-12T09:44:58.889 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:58.887+0000 7fe22bfff640 1 --2- 172.21.15.73:0/423206884 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe21c003f20 0x7fe21c0047c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:44:58.890 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:58.888+0000 7fe231019640 1 --2- 172.21.15.73:0/423206884 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe21c004d00 0x7fe21c005180 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7fe224001e50 tx=0x7fe21c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d620c4d0aa44b3b server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:44:58.890 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:58.888+0000 7fe22b7fe640 1 -- 172.21.15.73:0/423206884 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe224003b70 con 0x7fe21c004d00 2023-12-12T09:44:58.890 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:58.888+0000 7fe22b7fe640 1 -- 172.21.15.73:0/423206884 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe224003cd0 con 0x7fe21c004d00 2023-12-12T09:44:58.890 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:58.888+0000 7fe22b7fe640 1 -- 172.21.15.73:0/423206884 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe224005310 con 0x7fe21c004d00 2023-12-12T09:44:58.890 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:58.888+0000 7fe232a7c640 1 -- 172.21.15.73:0/423206884 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe21c004d00 msgr2=0x7fe21c005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:58.890 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:58.888+0000 7fe232a7c640 1 --2- 172.21.15.73:0/423206884 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe21c004d00 0x7fe21c005180 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7fe224001e50 tx=0x7fe21c0057f0 comp rx=0 tx=0).stop 2023-12-12T09:44:58.890 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:58.888+0000 7fe231019640 1 -- 172.21.15.73:0/423206884 reap_dead start 2023-12-12T09:44:58.890 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:58.889+0000 7fe232a7c640 1 -- 172.21.15.73:0/423206884 shutdown_connections 2023-12-12T09:44:58.891 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:58.889+0000 7fe232a7c640 1 -- 172.21.15.73:0/423206884 >> 172.21.15.73:0/423206884 conn(0x7fe22c06a4e0 msgr2=0x7fe22c06a8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:44:58.891 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:58.889+0000 7fe232a7c640 1 -- 172.21.15.73:0/423206884 shutdown_connections 2023-12-12T09:44:58.891 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:58.889+0000 7fe232a7c640 1 -- 172.21.15.73:0/423206884 wait complete. 2023-12-12T09:44:58.892 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:58.890+0000 7fe232a7c640 1 Processor -- start 2023-12-12T09:44:58.892 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:58.891+0000 7fe232a7c640 1 -- start start 2023-12-12T09:44:58.892 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:58.891+0000 7fe232a7c640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe21c004d00 0x7fe22c14b920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:58.893 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:58.891+0000 7fe232a7c640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe22c14be60 0x7fe22c1e9ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:58.893 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:58.891+0000 7fe232a7c640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe22c1ea530 0x7fe22c0bed50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:58.893 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:58.891+0000 7fe232a7c640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe22c1edf70 con 0x7fe21c004d00 2023-12-12T09:44:58.893 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:58.891+0000 7fe232a7c640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe22c1ee4a0 con 0x7fe22c1ea530 2023-12-12T09:44:58.893 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:58.891+0000 7fe232a7c640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe22c145d90 con 0x7fe22c14be60 2023-12-12T09:44:58.893 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:58.892+0000 7fe230818640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe21c004d00 0x7fe22c14b920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:58.893 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:58.892+0000 7fe230818640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe21c004d00 0x7fe22c14b920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:37934/0 (socket says 172.21.15.73:37934) 2023-12-12T09:44:58.893 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:58.892+0000 7fe230818640 1 -- 172.21.15.73:0/2495267430 learned_addr learned my addr 172.21.15.73:0/2495267430 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:44:58.893 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:58.892+0000 7fe230818640 1 -- 172.21.15.73:0/2495267430 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe22c14be60 msgr2=0x7fe22c1e9ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:58.893 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:58.892+0000 7fe230818640 1 --2- 172.21.15.73:0/2495267430 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe22c14be60 0x7fe22c1e9ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:58.893 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:58.892+0000 7fe230818640 1 -- 172.21.15.73:0/2495267430 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe22c1ea530 msgr2=0x7fe22c0bed50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:58.893 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:58.892+0000 7fe230818640 1 --2- 172.21.15.73:0/2495267430 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe22c1ea530 0x7fe22c0bed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:58.893 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:58.892+0000 7fe230818640 1 -- 172.21.15.73:0/2495267430 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe22c1ee1c0 con 0x7fe21c004d00 2023-12-12T09:44:58.893 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:58.892+0000 7fe230818640 1 --2- 172.21.15.73:0/2495267430 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe21c004d00 0x7fe22c14b920 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7fe220011630 tx=0x7fe220011af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:44:58.894 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:58.893+0000 7fe2297fa640 1 -- 172.21.15.73:0/2495267430 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe220015870 con 0x7fe21c004d00 2023-12-12T09:44:58.894 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:58.893+0000 7fe2297fa640 1 -- 172.21.15.73:0/2495267430 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2200159d0 con 0x7fe21c004d00 2023-12-12T09:44:58.895 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:58.893+0000 7fe232a7c640 1 -- 172.21.15.73:0/2495267430 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe22c071710 con 0x7fe21c004d00 2023-12-12T09:44:58.895 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:58.893+0000 7fe2297fa640 1 -- 172.21.15.73:0/2495267430 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe220015d40 con 0x7fe21c004d00 2023-12-12T09:44:58.895 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:58.893+0000 7fe232a7c640 1 -- 172.21.15.73:0/2495267430 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe22c0bf290 con 0x7fe21c004d00 2023-12-12T09:44:58.895 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:58.894+0000 7fe232a7c640 1 -- 172.21.15.73:0/2495267430 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe22c067070 con 0x7fe21c004d00 2023-12-12T09:44:58.895 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:58.895+0000 7fe2297fa640 1 -- 172.21.15.73:0/2495267430 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fe22000f490 con 0x7fe21c004d00 2023-12-12T09:44:58.896 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:58.896+0000 7fe2297fa640 1 --2- 172.21.15.73:0/2495267430 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fe21006ae40 0x7fe21006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:58.896 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:58.896+0000 7fe2297fa640 1 -- 172.21.15.73:0/2495267430 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fe22008a130 con 0x7fe21c004d00 2023-12-12T09:44:58.896 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:58.896+0000 7fe22bfff640 1 --2- 172.21.15.73:0/2495267430 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fe21006ae40 0x7fe21006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:58.897 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:58.897+0000 7fe22bfff640 1 --2- 172.21.15.73:0/2495267430 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fe21006ae40 0x7fe21006d300 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fe218001eb0 tx=0x7fe218009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:44:58.900 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:58.900+0000 7fe2297fa640 1 -- 172.21.15.73:0/2495267430 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fe220054f10 con 0x7fe21c004d00 2023-12-12T09:44:59.090 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:59.089+0000 7fe232a7c640 1 -- 172.21.15.73:0/2495267430 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fe22c149a60 con 0x7fe21c004d00 2023-12-12T09:44:59.090 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:59.090+0000 7fe2297fa640 1 -- 172.21.15.73:0/2495267430 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v38) v1 ==== 100+0+11 (secure 0 0 0) 0x7fe220058530 con 0x7fe21c004d00 2023-12-12T09:44:59.091 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 64 2023-12-12T09:44:59.093 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:59.093+0000 7fe232a7c640 1 -- 172.21.15.73:0/2495267430 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fe21006ae40 msgr2=0x7fe21006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:59.093 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:59.093+0000 7fe232a7c640 1 --2- 172.21.15.73:0/2495267430 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fe21006ae40 0x7fe21006d300 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fe218001eb0 tx=0x7fe218009040 comp rx=0 tx=0).stop 2023-12-12T09:44:59.094 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:59.093+0000 7fe232a7c640 1 -- 172.21.15.73:0/2495267430 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe21c004d00 msgr2=0x7fe22c14b920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:59.094 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:59.093+0000 7fe232a7c640 1 --2- 172.21.15.73:0/2495267430 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe21c004d00 0x7fe22c14b920 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7fe220011630 tx=0x7fe220011af0 comp rx=0 tx=0).stop 2023-12-12T09:44:59.094 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:59.093+0000 7fe232a7c640 1 -- 172.21.15.73:0/2495267430 shutdown_connections 2023-12-12T09:44:59.094 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:59.093+0000 7fe232a7c640 1 --2- 172.21.15.73:0/2495267430 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fe21006ae40 0x7fe21006d300 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:59.094 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:59.093+0000 7fe232a7c640 1 --2- 172.21.15.73:0/2495267430 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe22c1ea530 0x7fe22c0bed50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:59.094 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:59.093+0000 7fe232a7c640 1 --2- 172.21.15.73:0/2495267430 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe22c14be60 0x7fe22c1e9ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:59.094 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:59.093+0000 7fe232a7c640 1 --2- 172.21.15.73:0/2495267430 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe21c004d00 0x7fe22c14b920 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:59.094 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:59.093+0000 7fe232a7c640 1 -- 172.21.15.73:0/2495267430 >> 172.21.15.73:0/2495267430 conn(0x7fe22c06a4e0 msgr2=0x7fe22c1528e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:44:59.094 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:59.093+0000 7fe232a7c640 1 -- 172.21.15.73:0/2495267430 shutdown_connections 2023-12-12T09:44:59.094 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:59.093+0000 7fe232a7c640 1 -- 172.21.15.73:0/2495267430 wait complete. 2023-12-12T09:44:59.112 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_metadata pg_num 2023-12-12T09:44:59.322 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:59.322+0000 7f155ab06640 1 Processor -- start 2023-12-12T09:44:59.322 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:59.322+0000 7f155ab06640 1 -- start start 2023-12-12T09:44:59.324 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:59.323+0000 7f155ab06640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f155406db60 0x7f1554151cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:59.324 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:59.324+0000 7f155ab06640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f15540c17f0 0x7f15540a88f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:59.324 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:59.324+0000 7f155ab06640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1554155050 con 0x7f15540c1120 2023-12-12T09:44:59.324 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:59.324+0000 7f155ab06640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15540a8e30 con 0x7f155406db60 2023-12-12T09:44:59.324 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:59.324+0000 7f155ab06640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1554155580 con 0x7f15540c17f0 2023-12-12T09:44:59.324 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:59.324+0000 7f1559b04640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f155406db60 0x7f1554151cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:59.324 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:59.324+0000 7f1559303640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f15540c1120 0x7f15540c4850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:51112/0 (socket says 172.21.15.73:51112) 2023-12-12T09:44:59.325 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:59.324+0000 7f1559303640 1 -- 172.21.15.73:0/1830801466 learned_addr learned my addr 172.21.15.73:0/1830801466 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-12T09:44:59.325 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:59.324+0000 7f155a305640 1 --2- 172.21.15.73:0/1830801466 >> v2:172.21.15.142:3300/0 conn(0x7f15540c17f0 0x7f15540a88f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:59.325 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:59.324+0000 7f1559b04640 1 -- 172.21.15.73:0/1830801466 >> v2:172.21.15.142:3300/0 conn(0x7f15540c17f0 msgr2=0x7f15540a88f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:44:59.325 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:59.324+0000 7f1559b04640 1 --2- 172.21.15.73:0/1830801466 >> v2:172.21.15.142:3300/0 conn(0x7f15540c17f0 0x7f15540a88f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:59.325 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:59.324+0000 7f1559b04640 1 -- 172.21.15.73:0/1830801466 >> v1:172.21.15.73:6789/0 conn(0x7f15540c1120 legacy=0x7f15540c4850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:59.326 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:59.324+0000 7f1559b04640 1 -- 172.21.15.73:0/1830801466 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15540a9040 con 0x7f155406db60 2023-12-12T09:44:59.326 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:59.326+0000 7f1559b04640 1 --2- 172.21.15.73:0/1830801466 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f155406db60 0x7f1554151cd0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f1554072d30 tx=0x7f155002b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91366c96534ec780 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:44:59.326 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:59.326+0000 7f1558b02640 1 -- 172.21.15.73:0/1830801466 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f155002e070 con 0x7f155406db60 2023-12-12T09:44:59.326 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:59.326+0000 7f1558b02640 1 -- 172.21.15.73:0/1830801466 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15500315a0 con 0x7f155406db60 2023-12-12T09:44:59.327 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:59.326+0000 7f1558b02640 1 -- 172.21.15.73:0/1830801466 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1550031930 con 0x7f155406db60 2023-12-12T09:44:59.327 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:59.327+0000 7f155ab06640 1 -- 172.21.15.73:0/1830801466 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f155406db60 msgr2=0x7f1554151cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:59.327 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:59.327+0000 7f155ab06640 1 --2- 172.21.15.73:0/1830801466 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f155406db60 0x7f1554151cd0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f1554072d30 tx=0x7f155002b840 comp rx=0 tx=0).stop 2023-12-12T09:44:59.327 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:59.327+0000 7f155ab06640 1 -- 172.21.15.73:0/1830801466 shutdown_connections 2023-12-12T09:44:59.328 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:59.327+0000 7f155ab06640 1 --2- 172.21.15.73:0/1830801466 >> v2:172.21.15.142:3300/0 conn(0x7f15540c17f0 0x7f15540a88f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:59.328 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:59.327+0000 7f155ab06640 1 --2- 172.21.15.73:0/1830801466 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f155406db60 0x7f1554151cd0 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:59.328 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:59.327+0000 7f155ab06640 1 -- 172.21.15.73:0/1830801466 >> 172.21.15.73:0/1830801466 conn(0x7f15540c2520 msgr2=0x7f15540c2900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:44:59.328 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:59.327+0000 7f155ab06640 1 -- 172.21.15.73:0/1830801466 shutdown_connections 2023-12-12T09:44:59.328 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:59.327+0000 7f155ab06640 1 -- 172.21.15.73:0/1830801466 wait complete. 2023-12-12T09:44:59.329 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:59.329+0000 7f155ab06640 1 Processor -- start 2023-12-12T09:44:59.329 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:59.329+0000 7f155ab06640 1 -- start start 2023-12-12T09:44:59.330 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:59.330+0000 7f155ab06640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f155406db60 0x7f15541503e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:59.330 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:59.330+0000 7f155ab06640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f15540c1120 0x7f1554149e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:59.330 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:59.330+0000 7f155ab06640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f15540c17f0 0x7f155414a370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:59.330 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:59.330+0000 7f155ab06640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f155414cc00 con 0x7f155406db60 2023-12-12T09:44:59.331 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:59.330+0000 7f155ab06640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f155414b360 con 0x7f15540c1120 2023-12-12T09:44:59.331 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:59.330+0000 7f155ab06640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f155414b640 con 0x7f15540c17f0 2023-12-12T09:44:59.331 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:59.330+0000 7f1559b04640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f155406db60 0x7f15541503e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:59.331 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:59.330+0000 7f1559b04640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f155406db60 0x7f15541503e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:37948/0 (socket says 172.21.15.73:37948) 2023-12-12T09:44:59.331 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:59.330+0000 7f1559b04640 1 -- 172.21.15.73:0/2845959585 learned_addr learned my addr 172.21.15.73:0/2845959585 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:44:59.332 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:59.331+0000 7f1559303640 1 --2- 172.21.15.73:0/2845959585 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f15540c1120 0x7f1554149e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:59.332 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:59.331+0000 7f155a305640 1 --2- 172.21.15.73:0/2845959585 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f15540c17f0 0x7f155414a370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:59.332 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:59.331+0000 7f1559b04640 1 -- 172.21.15.73:0/2845959585 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f15540c17f0 msgr2=0x7f155414a370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:59.333 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:59.331+0000 7f1559b04640 1 --2- 172.21.15.73:0/2845959585 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f15540c17f0 0x7f155414a370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:59.333 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:59.331+0000 7f1559b04640 1 -- 172.21.15.73:0/2845959585 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f15540c1120 msgr2=0x7f1554149e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:59.333 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:59.331+0000 7f1559b04640 1 --2- 172.21.15.73:0/2845959585 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f15540c1120 0x7f1554149e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:59.333 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:59.331+0000 7f1559b04640 1 -- 172.21.15.73:0/2845959585 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1550009400 con 0x7f155406db60 2023-12-12T09:44:59.333 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:59.331+0000 7f155a305640 1 --2- 172.21.15.73:0/2845959585 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f15540c17f0 0x7f155414a370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:44:59.333 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:59.331+0000 7f1559b04640 1 --2- 172.21.15.73:0/2845959585 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f155406db60 0x7f15541503e0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f1550009890 tx=0x7f15500046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:44:59.333 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:59.331+0000 7f15467fc640 1 -- 172.21.15.73:0/2845959585 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1550032840 con 0x7f155406db60 2023-12-12T09:44:59.333 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:59.331+0000 7f15467fc640 1 -- 172.21.15.73:0/2845959585 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15500329a0 con 0x7f155406db60 2023-12-12T09:44:59.333 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:59.331+0000 7f15467fc640 1 -- 172.21.15.73:0/2845959585 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1550032d50 con 0x7f155406db60 2023-12-12T09:44:59.333 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:59.331+0000 7f155ab06640 1 -- 172.21.15.73:0/2845959585 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f155414b920 con 0x7f155406db60 2023-12-12T09:44:59.333 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:59.332+0000 7f155ab06640 1 -- 172.21.15.73:0/2845959585 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f155414c890 con 0x7f155406db60 2023-12-12T09:44:59.334 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:59.333+0000 7f155ab06640 1 -- 172.21.15.73:0/2845959585 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1554067400 con 0x7f155406db60 2023-12-12T09:44:59.334 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:59.334+0000 7f15467fc640 1 -- 172.21.15.73:0/2845959585 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f155003b3f0 con 0x7f155406db60 2023-12-12T09:44:59.335 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:59.334+0000 7f15467fc640 1 --2- 172.21.15.73:0/2845959585 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f153806ae40 0x7f153806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:59.335 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:59.335+0000 7f15467fc640 1 -- 172.21.15.73:0/2845959585 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f15500ab9b0 con 0x7f155406db60 2023-12-12T09:44:59.335 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:59.335+0000 7f1559303640 1 --2- 172.21.15.73:0/2845959585 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f153806ae40 0x7f153806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:59.335 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:59.335+0000 7f1559303640 1 --2- 172.21.15.73:0/2845959585 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f153806ae40 0x7f153806d300 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f1554150da0 tx=0x7f1548009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:44:59.339 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:59.339+0000 7f15467fc640 1 -- 172.21.15.73:0/2845959585 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f1550076670 con 0x7f155406db60 2023-12-12T09:44:59.532 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:59.532+0000 7f155ab06640 1 -- 172.21.15.73:0/2845959585 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"} v 0) v1 -- 0x7f15540c0f00 con 0x7f155406db60 2023-12-12T09:44:59.533 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:59.533+0000 7f15467fc640 1 -- 172.21.15.73:0/2845959585 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"}]=0 v38) v1 ==== 105+0+11 (secure 0 0 0) 0x7f1550079c90 con 0x7f155406db60 2023-12-12T09:44:59.533 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 32 2023-12-12T09:44:59.536 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:59.536+0000 7f155ab06640 1 -- 172.21.15.73:0/2845959585 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f153806ae40 msgr2=0x7f153806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:59.536 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:59.536+0000 7f155ab06640 1 --2- 172.21.15.73:0/2845959585 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f153806ae40 0x7f153806d300 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f1554150da0 tx=0x7f1548009040 comp rx=0 tx=0).stop 2023-12-12T09:44:59.536 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:59.536+0000 7f155ab06640 1 -- 172.21.15.73:0/2845959585 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f155406db60 msgr2=0x7f15541503e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:59.537 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:59.536+0000 7f155ab06640 1 --2- 172.21.15.73:0/2845959585 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f155406db60 0x7f15541503e0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f1550009890 tx=0x7f15500046c0 comp rx=0 tx=0).stop 2023-12-12T09:44:59.537 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:59.536+0000 7f155ab06640 1 -- 172.21.15.73:0/2845959585 shutdown_connections 2023-12-12T09:44:59.537 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:59.536+0000 7f155ab06640 1 --2- 172.21.15.73:0/2845959585 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f153806ae40 0x7f153806d300 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:59.537 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:59.536+0000 7f155ab06640 1 --2- 172.21.15.73:0/2845959585 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f15540c17f0 0x7f155414a370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:59.537 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:59.536+0000 7f155ab06640 1 --2- 172.21.15.73:0/2845959585 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f15540c1120 0x7f1554149e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:59.537 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:59.536+0000 7f155ab06640 1 --2- 172.21.15.73:0/2845959585 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f155406db60 0x7f15541503e0 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:59.537 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:59.536+0000 7f155ab06640 1 -- 172.21.15.73:0/2845959585 >> 172.21.15.73:0/2845959585 conn(0x7f15540c2520 msgr2=0x7f15540c2900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:44:59.537 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:59.536+0000 7f155ab06640 1 -- 172.21.15.73:0/2845959585 shutdown_connections 2023-12-12T09:44:59.537 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:59.536+0000 7f155ab06640 1 -- 172.21.15.73:0/2845959585 wait complete. 2023-12-12T09:44:59.553 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_data pg_num 2023-12-12T09:44:59.762 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:59.762+0000 7f86f96bb640 1 Processor -- start 2023-12-12T09:44:59.762 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:59.762+0000 7f86f96bb640 1 -- start start 2023-12-12T09:44:59.764 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:59.763+0000 7f86f96bb640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f86f414ea60 0x7f86f40c5420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:59.764 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:59.763+0000 7f86f96bb640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f86f40a4c90 0x7f86f40c0320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:59.764 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:59.763+0000 7f86f96bb640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86f40c3390 con 0x7f86f40c4420 2023-12-12T09:44:59.764 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:59.763+0000 7f86f96bb640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86f4151e60 con 0x7f86f414ea60 2023-12-12T09:44:59.764 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:59.763+0000 7f86f96bb640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86f4152140 con 0x7f86f40a4c90 2023-12-12T09:44:59.764 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:59.764+0000 7f86f2ffd640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f86f414ea60 0x7f86f40c5420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:59.764 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:59.764+0000 7f86f2ffd640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f86f414ea60 0x7f86f40c5420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:37964/0 (socket says 172.21.15.73:37964) 2023-12-12T09:44:59.764 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:59.764+0000 7f86f2ffd640 1 -- 172.21.15.73:0/3167633907 learned_addr learned my addr 172.21.15.73:0/3167633907 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:44:59.765 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:59.764+0000 7f86f2ffd640 1 -- 172.21.15.73:0/3167633907 >> v2:172.21.15.142:3300/0 conn(0x7f86f40a4c90 msgr2=0x7f86f40c0320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:44:59.765 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:59.764+0000 7f86f2ffd640 1 --2- 172.21.15.73:0/3167633907 >> v2:172.21.15.142:3300/0 conn(0x7f86f40a4c90 0x7f86f40c0320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:59.765 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:59.764+0000 7f86f2ffd640 1 -- 172.21.15.73:0/3167633907 >> v1:172.21.15.142:6789/0 conn(0x7f86f40c4420 legacy=0x7f86f40c20b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:44:59.765 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:59.764+0000 7f86f2ffd640 1 -- 172.21.15.73:0/3167633907 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86f40c3940 con 0x7f86f414ea60 2023-12-12T09:44:59.766 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:59.765+0000 7f86f2ffd640 1 --2- 172.21.15.73:0/3167633907 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f86f414ea60 0x7f86f40c5420 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f86f406f730 tx=0x7f86e402b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7947c6d9c982cdaa server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:44:59.766 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:59.766+0000 7f86f1ffb640 1 -- 172.21.15.73:0/3167633907 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86e40317e0 con 0x7f86f414ea60 2023-12-12T09:44:59.766 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:59.766+0000 7f86f1ffb640 1 -- 172.21.15.73:0/3167633907 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86e4031940 con 0x7f86f414ea60 2023-12-12T09:44:59.766 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:59.766+0000 7f86f1ffb640 1 -- 172.21.15.73:0/3167633907 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86e4031cd0 con 0x7f86f414ea60 2023-12-12T09:44:59.767 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:59.766+0000 7f86f96bb640 1 -- 172.21.15.73:0/3167633907 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f86f414ea60 msgr2=0x7f86f40c5420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:59.767 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:59.766+0000 7f86f96bb640 1 --2- 172.21.15.73:0/3167633907 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f86f414ea60 0x7f86f40c5420 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f86f406f730 tx=0x7f86e402b880 comp rx=0 tx=0).stop 2023-12-12T09:44:59.767 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:59.766+0000 7f86f96bb640 1 -- 172.21.15.73:0/3167633907 shutdown_connections 2023-12-12T09:44:59.767 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:59.766+0000 7f86f96bb640 1 --2- 172.21.15.73:0/3167633907 >> v2:172.21.15.142:3300/0 conn(0x7f86f40a4c90 0x7f86f40c0320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:59.767 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:59.766+0000 7f86f96bb640 1 --2- 172.21.15.73:0/3167633907 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f86f414ea60 0x7f86f40c5420 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:59.767 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:59.766+0000 7f86f96bb640 1 -- 172.21.15.73:0/3167633907 >> 172.21.15.73:0/3167633907 conn(0x7f86f406a4e0 msgr2=0x7f86f406a8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:44:59.767 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:59.767+0000 7f86f96bb640 1 -- 172.21.15.73:0/3167633907 shutdown_connections 2023-12-12T09:44:59.767 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:59.767+0000 7f86f96bb640 1 -- 172.21.15.73:0/3167633907 wait complete. 2023-12-12T09:44:59.768 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:59.768+0000 7f86f96bb640 1 Processor -- start 2023-12-12T09:44:59.769 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:59.769+0000 7f86f96bb640 1 -- start start 2023-12-12T09:44:59.770 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:59.770+0000 7f86f96bb640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f86f40a4c90 0x7f86f415d040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:59.770 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:59.770+0000 7f86f96bb640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f86f40c4420 0x7f86f406d650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:59.770 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:59.770+0000 7f86f96bb640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f86f414ea60 0x7f86f40aaa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:59.770 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:59.770+0000 7f86f96bb640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86f40a9a20 con 0x7f86f414ea60 2023-12-12T09:44:59.770 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:59.770+0000 7f86f96bb640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86f40a9c70 con 0x7f86f40a4c90 2023-12-12T09:44:59.770 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:59.770+0000 7f86f96bb640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86f40a9f50 con 0x7f86f40c4420 2023-12-12T09:44:59.771 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:59.770+0000 7f86f37fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f86f414ea60 0x7f86f40aaa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:59.771 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:59.770+0000 7f86f37fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f86f414ea60 0x7f86f40aaa30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:37978/0 (socket says 172.21.15.73:37978) 2023-12-12T09:44:59.771 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:59.770+0000 7f86f37fe640 1 -- 172.21.15.73:0/3509927182 learned_addr learned my addr 172.21.15.73:0/3509927182 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:44:59.772 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:59.770+0000 7f86f37fe640 1 -- 172.21.15.73:0/3509927182 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f86f40c4420 msgr2=0x7f86f406d650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:59.772 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:59.770+0000 7f86f37fe640 1 --2- 172.21.15.73:0/3509927182 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f86f40c4420 0x7f86f406d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:59.772 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:59.770+0000 7f86f37fe640 1 -- 172.21.15.73:0/3509927182 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f86f40a4c90 msgr2=0x7f86f415d040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:59.772 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:59.770+0000 7f86f37fe640 1 --2- 172.21.15.73:0/3509927182 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f86f40a4c90 0x7f86f415d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:59.772 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:59.771+0000 7f86f37fe640 1 -- 172.21.15.73:0/3509927182 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86e40094d0 con 0x7f86f414ea60 2023-12-12T09:44:59.772 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:59.771+0000 7f86f37fe640 1 --2- 172.21.15.73:0/3509927182 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f86f414ea60 0x7f86f40aaa30 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f86ec00c780 tx=0x7f86ec00cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:44:59.772 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:59.771+0000 7f86db7fe640 1 -- 172.21.15.73:0/3509927182 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86ec003d80 con 0x7f86f414ea60 2023-12-12T09:44:59.772 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:59.771+0000 7f86db7fe640 1 -- 172.21.15.73:0/3509927182 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86ec00ce90 con 0x7f86f414ea60 2023-12-12T09:44:59.772 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:59.771+0000 7f86db7fe640 1 -- 172.21.15.73:0/3509927182 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86ec0052b0 con 0x7f86f414ea60 2023-12-12T09:44:59.772 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:59.771+0000 7f86f96bb640 1 -- 172.21.15.73:0/3509927182 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86f40aa230 con 0x7f86f414ea60 2023-12-12T09:44:59.772 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:59.771+0000 7f86f96bb640 1 -- 172.21.15.73:0/3509927182 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86f406db90 con 0x7f86f414ea60 2023-12-12T09:44:59.773 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:59.772+0000 7f86f96bb640 1 -- 172.21.15.73:0/3509927182 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86f40aa750 con 0x7f86f414ea60 2023-12-12T09:44:59.773 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:59.774+0000 7f86db7fe640 1 -- 172.21.15.73:0/3509927182 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f86ec005410 con 0x7f86f414ea60 2023-12-12T09:44:59.774 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:59.774+0000 7f86db7fe640 1 --2- 172.21.15.73:0/3509927182 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f86e006ae40 0x7f86e006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:44:59.774 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:59.775+0000 7f86db7fe640 1 -- 172.21.15.73:0/3509927182 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f86ec088d90 con 0x7f86f414ea60 2023-12-12T09:44:59.775 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:59.775+0000 7f86f2ffd640 1 --2- 172.21.15.73:0/3509927182 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f86e006ae40 0x7f86e006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:44:59.775 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:59.776+0000 7f86f2ffd640 1 --2- 172.21.15.73:0/3509927182 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f86e006ae40 0x7f86e006d300 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f86e4036000 tx=0x7f86e4030000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:44:59.779 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:59.779+0000 7f86db7fe640 1 -- 172.21.15.73:0/3509927182 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f86f40aa750 con 0x7f86f414ea60 2023-12-12T09:44:59.969 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:59.968+0000 7f86f96bb640 1 -- 172.21.15.73:0/3509927182 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"} v 0) v1 -- 0x7f86f40aa750 con 0x7f86f414ea60 2023-12-12T09:44:59.969 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:59.969+0000 7f86db7fe640 1 -- 172.21.15.73:0/3509927182 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"}]=0 v38) v1 ==== 101+0+11 (secure 0 0 0) 0x7f86f40aa750 con 0x7f86f414ea60 2023-12-12T09:44:59.970 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 64 2023-12-12T09:44:59.972 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:59.972+0000 7f86f96bb640 1 -- 172.21.15.73:0/3509927182 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f86e006ae40 msgr2=0x7f86e006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:59.972 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:59.972+0000 7f86f96bb640 1 --2- 172.21.15.73:0/3509927182 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f86e006ae40 0x7f86e006d300 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f86e4036000 tx=0x7f86e4030000 comp rx=0 tx=0).stop 2023-12-12T09:44:59.972 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:59.972+0000 7f86f96bb640 1 -- 172.21.15.73:0/3509927182 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f86f414ea60 msgr2=0x7f86f40aaa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:44:59.972 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:59.972+0000 7f86f96bb640 1 --2- 172.21.15.73:0/3509927182 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f86f414ea60 0x7f86f40aaa30 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f86ec00c780 tx=0x7f86ec00cc40 comp rx=0 tx=0).stop 2023-12-12T09:44:59.973 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:59.972+0000 7f86f96bb640 1 -- 172.21.15.73:0/3509927182 shutdown_connections 2023-12-12T09:44:59.973 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:59.972+0000 7f86f96bb640 1 --2- 172.21.15.73:0/3509927182 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f86e006ae40 0x7f86e006d300 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:59.973 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:59.972+0000 7f86f96bb640 1 --2- 172.21.15.73:0/3509927182 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f86f414ea60 0x7f86f40aaa30 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:59.973 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:59.972+0000 7f86f96bb640 1 --2- 172.21.15.73:0/3509927182 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f86f40c4420 0x7f86f406d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:59.973 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:59.972+0000 7f86f96bb640 1 --2- 172.21.15.73:0/3509927182 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f86f40a4c90 0x7f86f415d040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:44:59.973 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:59.972+0000 7f86f96bb640 1 -- 172.21.15.73:0/3509927182 >> 172.21.15.73:0/3509927182 conn(0x7f86f406a4e0 msgr2=0x7f86f41451d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:44:59.973 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:59.972+0000 7f86f96bb640 1 -- 172.21.15.73:0/3509927182 shutdown_connections 2023-12-12T09:44:59.973 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:44:59.972+0000 7f86f96bb640 1 -- 172.21.15.73:0/3509927182 wait complete. 2023-12-12T09:44:59.990 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-12T09:45:00.200 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:00.199+0000 7f553dbf1640 1 Processor -- start 2023-12-12T09:45:00.200 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:00.199+0000 7f553dbf1640 1 -- start start 2023-12-12T09:45:00.210 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:00.201+0000 7f553dbf1640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f5538151b90 0x7f55380c7c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:00.210 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:00.201+0000 7f553dbf1640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f553806b580 0x7f5538158390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:00.210 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:00.201+0000 7f553dbf1640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5538157f00 con 0x7f55381588d0 2023-12-12T09:45:00.211 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:00.201+0000 7f553dbf1640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55380c61f0 con 0x7f5538151b90 2023-12-12T09:45:00.211 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:00.201+0000 7f553dbf1640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55380c64d0 con 0x7f553806b580 2023-12-12T09:45:00.211 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:00.201+0000 7f5537fff640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f55381588d0 0x7f55380c4710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:51116/0 (socket says 172.21.15.73:51116) 2023-12-12T09:45:00.211 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:00.201+0000 7f5537fff640 1 -- 172.21.15.73:0/1645449312 learned_addr learned my addr 172.21.15.73:0/1645449312 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-12T09:45:00.211 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:00.202+0000 7f552ffff640 1 --2- 172.21.15.73:0/1645449312 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f553806b580 0x7f5538158390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:00.211 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:00.202+0000 7f55377fe640 1 --2- 172.21.15.73:0/1645449312 >> v2:172.21.15.142:3300/0 conn(0x7f5538151b90 0x7f55380c7c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:00.211 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:00.202+0000 7f5536ffd640 1 -- 172.21.15.73:0/1645449312 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 183443189 0 0) 0x7f5538157f00 con 0x7f55381588d0 2023-12-12T09:45:00.211 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:00.202+0000 7f5536ffd640 1 -- 172.21.15.73:0/1645449312 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5524003520 con 0x7f55381588d0 2023-12-12T09:45:00.211 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:00.202+0000 7f5536ffd640 1 -- 172.21.15.73:0/1645449312 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3545340650 0 0) 0x7f5524003520 con 0x7f55381588d0 2023-12-12T09:45:00.212 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:00.202+0000 7f5536ffd640 1 -- 172.21.15.73:0/1645449312 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f553806b580 msgr2=0x7f5538158390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:45:00.212 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:00.202+0000 7f5536ffd640 1 --2- 172.21.15.73:0/1645449312 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f553806b580 0x7f5538158390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:00.212 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:00.202+0000 7f5536ffd640 1 -- 172.21.15.73:0/1645449312 >> v2:172.21.15.142:3300/0 conn(0x7f5538151b90 msgr2=0x7f55380c7c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:45:00.212 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:00.202+0000 7f5536ffd640 1 --2- 172.21.15.73:0/1645449312 >> v2:172.21.15.142:3300/0 conn(0x7f5538151b90 0x7f55380c7c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:00.212 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:00.202+0000 7f5536ffd640 1 -- 172.21.15.73:0/1645449312 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5538157b90 con 0x7f55381588d0 2023-12-12T09:45:00.212 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:00.202+0000 7f5536ffd640 1 -- 172.21.15.73:0/1645449312 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3186547832 0 0) 0x7f55300019f0 con 0x7f55381588d0 2023-12-12T09:45:00.212 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:00.202+0000 7f5536ffd640 1 -- 172.21.15.73:0/1645449312 >> v1:172.21.15.73:6789/0 conn(0x7f55381588d0 legacy=0x7f55380c4710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:00.213 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:00.202+0000 7f5536ffd640 1 --2- 172.21.15.73:0/1645449312 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5524003970 0x7f5524003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:00.213 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:00.202+0000 7f5536ffd640 1 --2- 172.21.15.73:0/1645449312 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f553806b580 0x7f55240047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:00.213 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:00.202+0000 7f5536ffd640 1 --2- 172.21.15.73:0/1645449312 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5524004d00 0x7f5524005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:00.213 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:00.202+0000 7f5536ffd640 1 -- 172.21.15.73:0/1645449312 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55380c61f0 con 0x7f5524004d00 2023-12-12T09:45:00.213 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:00.202+0000 7f5536ffd640 1 -- 172.21.15.73:0/1645449312 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55380c64d0 con 0x7f5524003970 2023-12-12T09:45:00.213 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:00.202+0000 7f5536ffd640 1 -- 172.21.15.73:0/1645449312 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f552400b980 con 0x7f553806b580 2023-12-12T09:45:00.213 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:00.203+0000 7f5537fff640 1 --2- 172.21.15.73:0/1645449312 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5524004d00 0x7f5524005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:00.214 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:00.203+0000 7f552ffff640 1 --2- 172.21.15.73:0/1645449312 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f553806b580 0x7f55240047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:00.214 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:00.203+0000 7f55377fe640 1 --2- 172.21.15.73:0/1645449312 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5524003970 0x7f5524003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:00.214 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:00.203+0000 7f5537fff640 1 -- 172.21.15.73:0/1645449312 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f553806b580 msgr2=0x7f55240047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:45:00.214 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:00.203+0000 7f5537fff640 1 --2- 172.21.15.73:0/1645449312 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f553806b580 0x7f55240047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:00.214 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:00.203+0000 7f5537fff640 1 -- 172.21.15.73:0/1645449312 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5524003970 msgr2=0x7f5524003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:45:00.215 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:00.203+0000 7f5537fff640 1 --2- 172.21.15.73:0/1645449312 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5524003970 0x7f5524003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:00.215 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:00.203+0000 7f5537fff640 1 -- 172.21.15.73:0/1645449312 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5524003520 con 0x7f5524004d00 2023-12-12T09:45:00.215 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:00.203+0000 7f55377fe640 1 --2- 172.21.15.73:0/1645449312 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5524003970 0x7f5524003d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:45:00.216 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:00.203+0000 7f552ffff640 1 --2- 172.21.15.73:0/1645449312 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f553806b580 0x7f55240047c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-12T09:45:00.216 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:00.204+0000 7f5537fff640 1 --2- 172.21.15.73:0/1645449312 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5524004d00 0x7f5524005180 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f553000a860 tx=0x7f55240057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4bfcfbce6c390d2 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:45:00.216 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:00.204+0000 7f5536ffd640 1 -- 172.21.15.73:0/1645449312 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5530034630 con 0x7f5524004d00 2023-12-12T09:45:00.216 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:00.204+0000 7f5536ffd640 1 -- 172.21.15.73:0/1645449312 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f553002f070 con 0x7f5524004d00 2023-12-12T09:45:00.218 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:00.205+0000 7f5536ffd640 1 -- 172.21.15.73:0/1645449312 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55300349f0 con 0x7f5524004d00 2023-12-12T09:45:00.218 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:00.205+0000 7f553dbf1640 1 -- 172.21.15.73:0/1645449312 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5524004d00 msgr2=0x7f5524005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:00.218 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:00.205+0000 7f553dbf1640 1 --2- 172.21.15.73:0/1645449312 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5524004d00 0x7f5524005180 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f553000a860 tx=0x7f55240057f0 comp rx=0 tx=0).stop 2023-12-12T09:45:00.219 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:00.205+0000 7f5537fff640 1 -- 172.21.15.73:0/1645449312 reap_dead start 2023-12-12T09:45:00.219 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:00.205+0000 7f553dbf1640 1 -- 172.21.15.73:0/1645449312 shutdown_connections 2023-12-12T09:45:00.219 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:00.205+0000 7f553dbf1640 1 -- 172.21.15.73:0/1645449312 >> 172.21.15.73:0/1645449312 conn(0x7f55380ab880 msgr2=0x7f55380abc90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:45:00.219 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:00.205+0000 7f553dbf1640 1 -- 172.21.15.73:0/1645449312 shutdown_connections 2023-12-12T09:45:00.219 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:00.205+0000 7f553dbf1640 1 -- 172.21.15.73:0/1645449312 wait complete. 2023-12-12T09:45:00.219 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:00.207+0000 7f553dbf1640 1 Processor -- start 2023-12-12T09:45:00.219 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:00.207+0000 7f553dbf1640 1 -- start start 2023-12-12T09:45:00.219 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:00.208+0000 7f553dbf1640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5524004d00 0x7f55380bde30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:00.219 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:00.208+0000 7f553dbf1640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5538154b10 0x7f5538149090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:00.219 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:00.208+0000 7f553dbf1640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f55380be600 0x7f55381495d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:00.220 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:00.208+0000 7f553dbf1640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5538153260 con 0x7f55380be600 2023-12-12T09:45:00.220 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:00.208+0000 7f553dbf1640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55381e9f60 con 0x7f5524004d00 2023-12-12T09:45:00.220 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:00.208+0000 7f553dbf1640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55381555d0 con 0x7f5538154b10 2023-12-12T09:45:00.220 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:00.208+0000 7f5537fff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f55380be600 0x7f55381495d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:00.220 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:00.208+0000 7f5537fff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f55380be600 0x7f55381495d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:37986/0 (socket says 172.21.15.73:37986) 2023-12-12T09:45:00.220 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:00.208+0000 7f5537fff640 1 -- 172.21.15.73:0/4280584602 learned_addr learned my addr 172.21.15.73:0/4280584602 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:45:00.220 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:00.209+0000 7f552ffff640 1 --2- 172.21.15.73:0/4280584602 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5538154b10 0x7f5538149090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:00.220 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:00.209+0000 7f55377fe640 1 --2- 172.21.15.73:0/4280584602 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5524004d00 0x7f55380bde30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:00.220 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:00.209+0000 7f5537fff640 1 -- 172.21.15.73:0/4280584602 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5538154b10 msgr2=0x7f5538149090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:00.220 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:00.209+0000 7f5537fff640 1 --2- 172.21.15.73:0/4280584602 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5538154b10 0x7f5538149090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:00.220 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:00.209+0000 7f5537fff640 1 -- 172.21.15.73:0/4280584602 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5524004d00 msgr2=0x7f55380bde30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:00.221 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:00.209+0000 7f5537fff640 1 --2- 172.21.15.73:0/4280584602 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5524004d00 0x7f55380bde30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:00.221 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:00.209+0000 7f5537fff640 1 -- 172.21.15.73:0/4280584602 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5538152b60 con 0x7f55380be600 2023-12-12T09:45:00.221 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:00.209+0000 7f552ffff640 1 --2- 172.21.15.73:0/4280584602 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5538154b10 0x7f5538149090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:45:00.221 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:00.209+0000 7f55377fe640 1 --2- 172.21.15.73:0/4280584602 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5524004d00 0x7f55380bde30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:45:00.221 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:00.209+0000 7f5537fff640 1 --2- 172.21.15.73:0/4280584602 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f55380be600 0x7f55381495d0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f553002cba0 tx=0x7f5530001d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:45:00.221 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:00.209+0000 7f5534ff9640 1 -- 172.21.15.73:0/4280584602 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5530034840 con 0x7f55380be600 2023-12-12T09:45:00.222 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:00.209+0000 7f5534ff9640 1 -- 172.21.15.73:0/4280584602 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55300349a0 con 0x7f55380be600 2023-12-12T09:45:00.222 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:00.210+0000 7f553dbf1640 1 -- 172.21.15.73:0/4280584602 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55381552f0 con 0x7f55380be600 2023-12-12T09:45:00.222 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:00.210+0000 7f5534ff9640 1 -- 172.21.15.73:0/4280584602 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5530034d10 con 0x7f55380be600 2023-12-12T09:45:00.222 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:00.210+0000 7f553dbf1640 1 -- 172.21.15.73:0/4280584602 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5538152880 con 0x7f55380be600 2023-12-12T09:45:00.224 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:00.211+0000 7f553dbf1640 1 -- 172.21.15.73:0/4280584602 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5538066f50 con 0x7f55380be600 2023-12-12T09:45:00.224 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:00.212+0000 7f5534ff9640 1 -- 172.21.15.73:0/4280584602 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f5530031030 con 0x7f55380be600 2023-12-12T09:45:00.224 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:00.212+0000 7f5534ff9640 1 --2- 172.21.15.73:0/4280584602 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f551806ae70 0x7f551806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:00.224 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:00.213+0000 7f5534ff9640 1 -- 172.21.15.73:0/4280584602 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f55300ab7b0 con 0x7f55380be600 2023-12-12T09:45:00.225 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:00.213+0000 7f55377fe640 1 --2- 172.21.15.73:0/4280584602 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f551806ae70 0x7f551806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:00.225 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:00.214+0000 7f55377fe640 1 --2- 172.21.15.73:0/4280584602 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f551806ae70 0x7f551806d330 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f55381e7da0 tx=0x7f5528008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:45:00.225 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:00.217+0000 7f5534ff9640 1 -- 172.21.15.73:0/4280584602 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f5530076590 con 0x7f55380be600 2023-12-12T09:45:00.444 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:00.444+0000 7f553dbf1640 1 -- 172.21.15.73:0/4280584602 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5538066f50 con 0x7f55380be600 2023-12-12T09:45:00.445 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:00.445+0000 7f5534ff9640 1 -- 172.21.15.73:0/4280584602 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) v1 ==== 94+0+6133 (secure 0 0 0) 0x7f5530001fd0 con 0x7f55380be600 2023-12-12T09:45:00.446 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-12T09:45:00.446 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":19,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4517,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6835/2407815368","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6833","nonce":2407815368},{"type":"v1","addr":"172.21.15.142:6835","nonce":2407815368}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":4720,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6834/153753304","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6832","nonce":153753304},{"type":"v1","addr":"172.21.15.142:6834","nonce":153753304}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-12T09:44:20.925302+0000","modified":"2023-12-12T09:44:24.049947+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4965},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4965":{"gid":4965,"name":"c","rank":0,"incarnation":12,"state":"up:active","state_seq":4,"addr":"172.21.15.73:6837/1534083424","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6835","nonce":1534083424},{"type":"v1","addr":"172.21.15.73:6837","nonce":1534083424}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2},{"mdsmap":{"epoch":19,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-12T09:44:36.098486+0000","modified":"2023-12-12T09:44:39.152510+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4962},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4962":{"gid":4962,"name":"a","rank":0,"incarnation":16,"state":"up:active","state_seq":8,"addr":"172.21.15.73:6836/2500303907","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":2500303907},{"type":"v1","addr":"172.21.15.73:6836","nonce":2500303907}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-12-12T09:45:00.446 INFO:teuthology.orchestra.run.smithi073.stderr:dumped fsmap epoch 19 2023-12-12T09:45:00.448 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:00.448+0000 7f553dbf1640 1 -- 172.21.15.73:0/4280584602 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f551806ae70 msgr2=0x7f551806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:00.448 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:00.448+0000 7f553dbf1640 1 --2- 172.21.15.73:0/4280584602 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f551806ae70 0x7f551806d330 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f55381e7da0 tx=0x7f5528008040 comp rx=0 tx=0).stop 2023-12-12T09:45:00.448 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:00.448+0000 7f553dbf1640 1 -- 172.21.15.73:0/4280584602 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f55380be600 msgr2=0x7f55381495d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:00.448 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:00.448+0000 7f553dbf1640 1 --2- 172.21.15.73:0/4280584602 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f55380be600 0x7f55381495d0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f553002cba0 tx=0x7f5530001d80 comp rx=0 tx=0).stop 2023-12-12T09:45:00.449 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:00.448+0000 7f553dbf1640 1 -- 172.21.15.73:0/4280584602 shutdown_connections 2023-12-12T09:45:00.449 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:00.448+0000 7f553dbf1640 1 --2- 172.21.15.73:0/4280584602 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f551806ae70 0x7f551806d330 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:00.449 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:00.448+0000 7f553dbf1640 1 --2- 172.21.15.73:0/4280584602 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f55380be600 0x7f55381495d0 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:00.449 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:00.448+0000 7f553dbf1640 1 --2- 172.21.15.73:0/4280584602 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5538154b10 0x7f5538149090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:00.449 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:00.448+0000 7f553dbf1640 1 --2- 172.21.15.73:0/4280584602 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5524004d00 0x7f55380bde30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:00.449 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:00.448+0000 7f553dbf1640 1 -- 172.21.15.73:0/4280584602 >> 172.21.15.73:0/4280584602 conn(0x7f55380ab880 msgr2=0x7f553814b710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:45:00.449 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:00.448+0000 7f553dbf1640 1 -- 172.21.15.73:0/4280584602 shutdown_connections 2023-12-12T09:45:00.449 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:00.448+0000 7f553dbf1640 1 -- 172.21.15.73:0/4280584602 wait complete. 2023-12-12T09:45:00.468 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-12T09:45:00.673 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:00.673+0000 7feeaddc5640 1 Processor -- start 2023-12-12T09:45:00.674 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:00.673+0000 7feeaddc5640 1 -- start start 2023-12-12T09:45:00.675 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:00.675+0000 7feeaddc5640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7feea814fa40 0x7feea806a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:00.675 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:00.675+0000 7feeaddc5640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feea8152610 con 0x7feea806db70 2023-12-12T09:45:00.675 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:00.675+0000 7feeaddc5640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feea81528f0 con 0x7feea80c5070 2023-12-12T09:45:00.675 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:00.675+0000 7feeaddc5640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feea8152bd0 con 0x7feea814fa40 2023-12-12T09:45:00.675 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:00.675+0000 7fee9ffff640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7feea806db70 0x7feea80c39b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:51132/0 (socket says 172.21.15.73:51132) 2023-12-12T09:45:00.675 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:00.675+0000 7fee9ffff640 1 -- 172.21.15.73:0/3116546818 learned_addr learned my addr 172.21.15.73:0/3116546818 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-12T09:45:00.677 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:00.676+0000 7feea77fe640 1 --2- 172.21.15.73:0/3116546818 >> v2:172.21.15.142:3300/0 conn(0x7feea814fa40 0x7feea806a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:00.678 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:00.676+0000 7feea6ffd640 1 -- 172.21.15.73:0/3116546818 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 926660501 0 0) 0x7feea8152610 con 0x7feea806db70 2023-12-12T09:45:00.678 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:00.676+0000 7feea6ffd640 1 -- 172.21.15.73:0/3116546818 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fee94003520 con 0x7feea806db70 2023-12-12T09:45:00.678 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:00.676+0000 7feea6ffd640 1 -- 172.21.15.73:0/3116546818 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2149417987 0 0) 0x7fee94003520 con 0x7feea806db70 2023-12-12T09:45:00.678 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:00.676+0000 7feea6ffd640 1 -- 172.21.15.73:0/3116546818 >> v2:172.21.15.142:3300/0 conn(0x7feea814fa40 msgr2=0x7feea806a4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:45:00.678 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:00.676+0000 7feea6ffd640 1 --2- 172.21.15.73:0/3116546818 >> v2:172.21.15.142:3300/0 conn(0x7feea814fa40 0x7feea806a4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:00.678 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:00.676+0000 7feea6ffd640 1 -- 172.21.15.73:0/3116546818 >> v1:172.21.15.142:6789/0 conn(0x7feea80c5070 legacy=0x7feea80c40c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:00.678 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:00.676+0000 7feea6ffd640 1 -- 172.21.15.73:0/3116546818 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feea8152eb0 con 0x7feea806db70 2023-12-12T09:45:00.678 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:00.676+0000 7feea6ffd640 1 -- 172.21.15.73:0/3116546818 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3186547832 0 0) 0x7fee90001670 con 0x7feea806db70 2023-12-12T09:45:00.678 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:00.676+0000 7feea6ffd640 1 -- 172.21.15.73:0/3116546818 >> v1:172.21.15.73:6789/0 conn(0x7feea806db70 legacy=0x7feea80c39b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:00.678 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:00.676+0000 7feea6ffd640 1 --2- 172.21.15.73:0/3116546818 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fee940039c0 0x7fee94003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:00.678 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:00.676+0000 7feea6ffd640 1 --2- 172.21.15.73:0/3116546818 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fee940047c0 0x7fee94004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:00.679 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:00.676+0000 7feea6ffd640 1 --2- 172.21.15.73:0/3116546818 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fee940051d0 0x7fee9400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:00.679 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:00.676+0000 7feea6ffd640 1 -- 172.21.15.73:0/3116546818 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feea8152bd0 con 0x7fee940047c0 2023-12-12T09:45:00.679 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:00.676+0000 7feea6ffd640 1 -- 172.21.15.73:0/3116546818 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee9400c120 con 0x7fee940051d0 2023-12-12T09:45:00.679 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:00.676+0000 7feea6ffd640 1 -- 172.21.15.73:0/3116546818 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee9400c2e0 con 0x7fee940039c0 2023-12-12T09:45:00.679 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:00.677+0000 7fee9ffff640 1 --2- 172.21.15.73:0/3116546818 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fee940047c0 0x7fee94004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:00.679 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:00.677+0000 7feea77fe640 1 --2- 172.21.15.73:0/3116546818 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fee940039c0 0x7fee94003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:00.679 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:00.677+0000 7feea7fff640 1 --2- 172.21.15.73:0/3116546818 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fee940051d0 0x7fee9400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:00.679 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:00.677+0000 7fee9ffff640 1 -- 172.21.15.73:0/3116546818 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fee940039c0 msgr2=0x7fee94003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:45:00.679 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:00.677+0000 7fee9ffff640 1 --2- 172.21.15.73:0/3116546818 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fee940039c0 0x7fee94003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:00.679 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:00.677+0000 7fee9ffff640 1 -- 172.21.15.73:0/3116546818 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fee940051d0 msgr2=0x7fee9400b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:45:00.679 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:00.677+0000 7fee9ffff640 1 --2- 172.21.15.73:0/3116546818 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fee940051d0 0x7fee9400b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:00.679 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:00.677+0000 7fee9ffff640 1 -- 172.21.15.73:0/3116546818 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee94003520 con 0x7fee940047c0 2023-12-12T09:45:00.679 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:00.677+0000 7feea77fe640 1 --2- 172.21.15.73:0/3116546818 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fee940039c0 0x7fee94003de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:45:00.679 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:00.677+0000 7feea7fff640 1 --2- 172.21.15.73:0/3116546818 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fee940051d0 0x7fee9400b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:45:00.679 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:00.677+0000 7feea7fff640 1 -- 172.21.15.73:0/3116546818 reap_dead start 2023-12-12T09:45:00.681 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:00.678+0000 7fee9ffff640 1 --2- 172.21.15.73:0/3116546818 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fee940047c0 0x7fee94004c40 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7fee90001eb0 tx=0x7fee940057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=889a29595fbb1809 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:45:00.681 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:00.679+0000 7feea6ffd640 1 -- 172.21.15.73:0/3116546818 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee90005ad0 con 0x7fee940047c0 2023-12-12T09:45:00.681 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:00.679+0000 7feea6ffd640 1 -- 172.21.15.73:0/3116546818 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee90005c50 con 0x7fee940047c0 2023-12-12T09:45:00.681 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:00.679+0000 7feea6ffd640 1 -- 172.21.15.73:0/3116546818 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee9002c7c0 con 0x7fee940047c0 2023-12-12T09:45:00.681 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:00.679+0000 7feeaddc5640 1 -- 172.21.15.73:0/3116546818 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fee940047c0 msgr2=0x7fee94004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:00.681 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:00.679+0000 7feeaddc5640 1 --2- 172.21.15.73:0/3116546818 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fee940047c0 0x7fee94004c40 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7fee90001eb0 tx=0x7fee940057f0 comp rx=0 tx=0).stop 2023-12-12T09:45:00.681 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:00.680+0000 7feeaddc5640 1 -- 172.21.15.73:0/3116546818 shutdown_connections 2023-12-12T09:45:00.681 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:00.680+0000 7feeaddc5640 1 --2- 172.21.15.73:0/3116546818 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fee940047c0 0x7fee94004c40 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:00.681 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:00.680+0000 7feeaddc5640 1 -- 172.21.15.73:0/3116546818 >> 172.21.15.73:0/3116546818 conn(0x7feea80a8130 msgr2=0x7feea80c24b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:45:00.681 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:00.680+0000 7feeaddc5640 1 -- 172.21.15.73:0/3116546818 shutdown_connections 2023-12-12T09:45:00.681 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:00.680+0000 7feeaddc5640 1 -- 172.21.15.73:0/3116546818 wait complete. 2023-12-12T09:45:00.682 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:00.681+0000 7feeaddc5640 1 Processor -- start 2023-12-12T09:45:00.682 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:00.682+0000 7feeaddc5640 1 -- start start 2023-12-12T09:45:00.683 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:00.683+0000 7feeaddc5640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fee940047c0 0x7feea814ae90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:00.683 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:00.683+0000 7feeaddc5640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7feea81e5c50 0x7feea81502e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:00.683 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:00.683+0000 7feeaddc5640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7feea8150bb0 0x7feea8141830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:00.683 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:00.683+0000 7feeaddc5640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feea806fcc0 con 0x7feea81e5c50 2023-12-12T09:45:00.683 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:00.683+0000 7feeaddc5640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feea81e9bd0 con 0x7fee940047c0 2023-12-12T09:45:00.684 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:00.683+0000 7feeaddc5640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feea81ea100 con 0x7feea8150bb0 2023-12-12T09:45:00.684 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:00.683+0000 7fee9ffff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7feea81e5c50 0x7feea81502e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:00.684 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:00.683+0000 7fee9ffff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7feea81e5c50 0x7feea81502e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:37996/0 (socket says 172.21.15.73:37996) 2023-12-12T09:45:00.684 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:00.683+0000 7fee9ffff640 1 -- 172.21.15.73:0/2661026531 learned_addr learned my addr 172.21.15.73:0/2661026531 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:45:00.685 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:00.684+0000 7feea7fff640 1 --2- 172.21.15.73:0/2661026531 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7feea8150bb0 0x7feea8141830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:00.685 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:00.684+0000 7feea77fe640 1 --2- 172.21.15.73:0/2661026531 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fee940047c0 0x7feea814ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:00.685 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:00.684+0000 7fee9ffff640 1 -- 172.21.15.73:0/2661026531 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7feea8150bb0 msgr2=0x7feea8141830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:00.685 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:00.684+0000 7fee9ffff640 1 --2- 172.21.15.73:0/2661026531 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7feea8150bb0 0x7feea8141830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:00.686 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:00.684+0000 7fee9ffff640 1 -- 172.21.15.73:0/2661026531 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fee940047c0 msgr2=0x7feea814ae90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:00.686 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:00.684+0000 7fee9ffff640 1 --2- 172.21.15.73:0/2661026531 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fee940047c0 0x7feea814ae90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:00.686 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:00.684+0000 7fee9ffff640 1 -- 172.21.15.73:0/2661026531 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feea8070460 con 0x7feea81e5c50 2023-12-12T09:45:00.686 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:00.684+0000 7feea77fe640 1 --2- 172.21.15.73:0/2661026531 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fee940047c0 0x7feea814ae90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:45:00.686 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:00.684+0000 7fee9ffff640 1 --2- 172.21.15.73:0/2661026531 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7feea81e5c50 0x7feea81502e0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7fee90000c00 tx=0x7fee9002e070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:45:00.686 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:00.684+0000 7feea4ff9640 1 -- 172.21.15.73:0/2661026531 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee9003c040 con 0x7feea81e5c50 2023-12-12T09:45:00.686 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:00.684+0000 7feea4ff9640 1 -- 172.21.15.73:0/2661026531 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee9002cd10 con 0x7feea81e5c50 2023-12-12T09:45:00.686 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:00.684+0000 7feeaddc5640 1 -- 172.21.15.73:0/2661026531 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feea806ff10 con 0x7feea81e5c50 2023-12-12T09:45:00.686 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:00.684+0000 7feea4ff9640 1 -- 172.21.15.73:0/2661026531 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee900072b0 con 0x7feea81e5c50 2023-12-12T09:45:00.686 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:00.685+0000 7feeaddc5640 1 -- 172.21.15.73:0/2661026531 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feea814b3d0 con 0x7feea81e5c50 2023-12-12T09:45:00.687 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:00.686+0000 7feeaddc5640 1 -- 172.21.15.73:0/2661026531 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feea80705f0 con 0x7feea81e5c50 2023-12-12T09:45:00.687 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:00.687+0000 7feea4ff9640 1 -- 172.21.15.73:0/2661026531 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fee90032070 con 0x7feea81e5c50 2023-12-12T09:45:00.688 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:00.688+0000 7feea4ff9640 1 --2- 172.21.15.73:0/2661026531 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fee8806ae70 0x7fee8806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:00.688 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:00.688+0000 7feea4ff9640 1 -- 172.21.15.73:0/2661026531 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fee900aaef0 con 0x7feea81e5c50 2023-12-12T09:45:00.688 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:00.688+0000 7feea77fe640 1 --2- 172.21.15.73:0/2661026531 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fee8806ae70 0x7fee8806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:00.689 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:00.689+0000 7feea77fe640 1 --2- 172.21.15.73:0/2661026531 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fee8806ae70 0x7fee8806d330 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7feea8067ab0 tx=0x7fee98008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:45:00.693 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:00.693+0000 7feea4ff9640 1 -- 172.21.15.73:0/2661026531 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fee90075cd0 con 0x7feea81e5c50 2023-12-12T09:45:00.886 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:00.885+0000 7feeaddc5640 1 -- 172.21.15.73:0/2661026531 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7feea80a5870 con 0x7feea81e5c50 2023-12-12T09:45:00.889 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:00.889+0000 7feea4ff9640 1 -- 172.21.15.73:0/2661026531 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v38) v1 ==== 74+0+20241 (secure 0 0 0) 0x7fee900792f0 con 0x7feea81e5c50 2023-12-12T09:45:00.890 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-12T09:45:00.890 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":38,"fsid":"ba240992-02b8-4c7e-92f2-27eb29ac433b","created":"2023-12-12T09:43:02.454719+0000","modified":"2023-12-12T09:44:37.659373+0000","last_up_change":"2023-12-12T09:43:13.913440+0000","last_in_change":"2023-12-12T09:43:05.925348+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-12T09:43:15.525508+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-12-12T09:44:18.641446+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-12-12T09:44:19.952405+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs2_metadata","create_time":"2023-12-12T09:44:34.424645+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs2_data","create_time":"2023-12-12T09:44:35.090149+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"dd9074be-dbe2-4c34-9896-a4223d8d3940","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":4047810203},{"type":"v1","addr":"172.21.15.73:6801","nonce":4047810203}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":4047810203},{"type":"v1","addr":"172.21.15.73:6803","nonce":4047810203}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":4047810203},{"type":"v1","addr":"172.21.15.73:6807","nonce":4047810203}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":4047810203},{"type":"v1","addr":"172.21.15.73:6805","nonce":4047810203}]},"public_addr":"172.21.15.73:6801/4047810203","cluster_addr":"172.21.15.73:6803/4047810203","heartbeat_back_addr":"172.21.15.73:6807/4047810203","heartbeat_front_addr":"172.21.15.73:6805/4047810203","state":["exists","up"]},{"osd":1,"uuid":"c4a05052-96d4-4758-a4e1-1a37f1e07fed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":1356058331},{"type":"v1","addr":"172.21.15.73:6824","nonce":1356058331}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":1356058331},{"type":"v1","addr":"172.21.15.73:6827","nonce":1356058331}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":1356058331},{"type":"v1","addr":"172.21.15.73:6831","nonce":1356058331}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":1356058331},{"type":"v1","addr":"172.21.15.73:6829","nonce":1356058331}]},"public_addr":"172.21.15.73:6824/1356058331","cluster_addr":"172.21.15.73:6827/1356058331","heartbeat_back_addr":"172.21.15.73:6831/1356058331","heartbeat_front_addr":"172.21.15.73:6829/1356058331","state":["exists","up"]},{"osd":2,"uuid":"512bc8ac-72c2-40d4-b3d2-d867a92c5213","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":1228903316},{"type":"v1","addr":"172.21.15.73:6817","nonce":1228903316}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":1228903316},{"type":"v1","addr":"172.21.15.73:6819","nonce":1228903316}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6823","nonce":1228903316},{"type":"v1","addr":"172.21.15.73:6825","nonce":1228903316}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":1228903316},{"type":"v1","addr":"172.21.15.73:6821","nonce":1228903316}]},"public_addr":"172.21.15.73:6817/1228903316","cluster_addr":"172.21.15.73:6819/1228903316","heartbeat_back_addr":"172.21.15.73:6825/1228903316","heartbeat_front_addr":"172.21.15.73:6821/1228903316","state":["exists","up"]},{"osd":3,"uuid":"3d1a91e0-42bf-437a-8eae-8d357c8f63a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":1293329670},{"type":"v1","addr":"172.21.15.73:6809","nonce":1293329670}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6810","nonce":1293329670},{"type":"v1","addr":"172.21.15.73:6811","nonce":1293329670}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":1293329670},{"type":"v1","addr":"172.21.15.73:6815","nonce":1293329670}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":1293329670},{"type":"v1","addr":"172.21.15.73:6813","nonce":1293329670}]},"public_addr":"172.21.15.73:6809/1293329670","cluster_addr":"172.21.15.73:6811/1293329670","heartbeat_back_addr":"172.21.15.73:6815/1293329670","heartbeat_front_addr":"172.21.15.73:6813/1293329670","state":["exists","up"]},{"osd":4,"uuid":"4b302fff-834c-4069-ac19-00e46f6c87b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":3727975702},{"type":"v1","addr":"172.21.15.142:6801","nonce":3727975702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":3727975702},{"type":"v1","addr":"172.21.15.142:6803","nonce":3727975702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6809","nonce":3727975702},{"type":"v1","addr":"172.21.15.142:6811","nonce":3727975702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6805","nonce":3727975702},{"type":"v1","addr":"172.21.15.142:6807","nonce":3727975702}]},"public_addr":"172.21.15.142:6801/3727975702","cluster_addr":"172.21.15.142:6803/3727975702","heartbeat_back_addr":"172.21.15.142:6811/3727975702","heartbeat_front_addr":"172.21.15.142:6807/3727975702","state":["exists","up"]},{"osd":5,"uuid":"d7cdace2-67d0-45cc-95f2-515cf6ef1b82","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6817","nonce":2353193632},{"type":"v1","addr":"172.21.15.142:6819","nonce":2353193632}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6821","nonce":2353193632},{"type":"v1","addr":"172.21.15.142:6823","nonce":2353193632}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6829","nonce":2353193632},{"type":"v1","addr":"172.21.15.142:6831","nonce":2353193632}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6825","nonce":2353193632},{"type":"v1","addr":"172.21.15.142:6827","nonce":2353193632}]},"public_addr":"172.21.15.142:6819/2353193632","cluster_addr":"172.21.15.142:6823/2353193632","heartbeat_back_addr":"172.21.15.142:6831/2353193632","heartbeat_front_addr":"172.21.15.142:6827/2353193632","state":["exists","up"]},{"osd":6,"uuid":"649ce78a-5626-445c-aedc-a651ed05a6f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":2006111986},{"type":"v1","addr":"172.21.15.142:6806","nonce":2006111986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":2006111986},{"type":"v1","addr":"172.21.15.142:6810","nonce":2006111986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":2006111986},{"type":"v1","addr":"172.21.15.142:6815","nonce":2006111986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":2006111986},{"type":"v1","addr":"172.21.15.142:6813","nonce":2006111986}]},"public_addr":"172.21.15.142:6806/2006111986","cluster_addr":"172.21.15.142:6810/2006111986","heartbeat_back_addr":"172.21.15.142:6815/2006111986","heartbeat_front_addr":"172.21.15.142:6813/2006111986","state":["exists","up"]},{"osd":7,"uuid":"af15ae3b-c1d0-4acf-92db-8a1805494d13","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":2573794341},{"type":"v1","addr":"172.21.15.142:6818","nonce":2573794341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":2573794341},{"type":"v1","addr":"172.21.15.142:6822","nonce":2573794341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":2573794341},{"type":"v1","addr":"172.21.15.142:6830","nonce":2573794341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":2573794341},{"type":"v1","addr":"172.21.15.142:6826","nonce":2573794341}]},"public_addr":"172.21.15.142:6818/2573794341","cluster_addr":"172.21.15.142:6822/2573794341","heartbeat_back_addr":"172.21.15.142:6830/2573794341","heartbeat_front_addr":"172.21.15.142:6826/2573794341","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.185824+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.262103+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.225556+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:10.523459+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:10.706035+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.257339+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.301776+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.051960+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-12T09:45:00.892 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:00.891+0000 7feeaddc5640 1 -- 172.21.15.73:0/2661026531 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fee8806ae70 msgr2=0x7fee8806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:00.892 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:00.891+0000 7feeaddc5640 1 --2- 172.21.15.73:0/2661026531 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fee8806ae70 0x7fee8806d330 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7feea8067ab0 tx=0x7fee98008040 comp rx=0 tx=0).stop 2023-12-12T09:45:00.892 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:00.891+0000 7feeaddc5640 1 -- 172.21.15.73:0/2661026531 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7feea81e5c50 msgr2=0x7feea81502e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:00.892 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:00.891+0000 7feeaddc5640 1 --2- 172.21.15.73:0/2661026531 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7feea81e5c50 0x7feea81502e0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7fee90000c00 tx=0x7fee9002e070 comp rx=0 tx=0).stop 2023-12-12T09:45:00.892 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:00.892+0000 7feeaddc5640 1 -- 172.21.15.73:0/2661026531 shutdown_connections 2023-12-12T09:45:00.893 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:00.892+0000 7feeaddc5640 1 --2- 172.21.15.73:0/2661026531 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fee8806ae70 0x7fee8806d330 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:00.893 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:00.892+0000 7feeaddc5640 1 --2- 172.21.15.73:0/2661026531 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7feea8150bb0 0x7feea8141830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:00.893 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:00.892+0000 7feeaddc5640 1 --2- 172.21.15.73:0/2661026531 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7feea81e5c50 0x7feea81502e0 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:00.893 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:00.892+0000 7feeaddc5640 1 --2- 172.21.15.73:0/2661026531 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fee940047c0 0x7feea814ae90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:00.893 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:00.892+0000 7feeaddc5640 1 -- 172.21.15.73:0/2661026531 >> 172.21.15.73:0/2661026531 conn(0x7feea80a8130 msgr2=0x7feea806a4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:45:00.893 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:00.892+0000 7feeaddc5640 1 -- 172.21.15.73:0/2661026531 shutdown_connections 2023-12-12T09:45:00.893 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:00.892+0000 7feeaddc5640 1 -- 172.21.15.73:0/2661026531 wait complete. 2023-12-12T09:45:00.912 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-12-12T09:45:00.912 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-12T09:45:01.126 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:01.126+0000 7f6b61ba5640 1 Processor -- start 2023-12-12T09:45:01.126 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:01.126+0000 7f6b61ba5640 1 -- start start 2023-12-12T09:45:01.127 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:01.127+0000 7f6b61ba5640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6b5c14fa40 0x7f6b5c06a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:01.128 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:01.127+0000 7f6b61ba5640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f6b5c0c5070 0x7f6b5c0c40c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:01.128 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:01.127+0000 7f6b61ba5640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b5c152610 con 0x7f6b5c06db70 2023-12-12T09:45:01.128 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:01.127+0000 7f6b61ba5640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b5c1528f0 con 0x7f6b5c0c5070 2023-12-12T09:45:01.128 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:01.127+0000 7f6b61ba5640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b5c152bd0 con 0x7f6b5c14fa40 2023-12-12T09:45:01.128 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:01.128+0000 7f6b5bfff640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f6b5c0c5070 0x7f6b5c0c40c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:01.128 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:01.128+0000 7f6b5b7fe640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6b5c14fa40 0x7f6b5c06a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:01.129 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:01.128+0000 7f6b5bfff640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f6b5c0c5070 0x7f6b5c0c40c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.73:49802/0 (socket says 172.21.15.73:49802) 2023-12-12T09:45:01.129 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:01.128+0000 7f6b5bfff640 1 -- 172.21.15.73:0/2293538906 learned_addr learned my addr 172.21.15.73:0/2293538906 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:45:01.129 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:01.128+0000 7f6b5b7fe640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6b5c14fa40 0x7f6b5c06a4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.73:51816/0 (socket says 172.21.15.73:51816) 2023-12-12T09:45:01.129 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:01.129+0000 7f6b5b7fe640 1 -- 172.21.15.73:0/2293538906 >> v2:172.21.15.142:3300/0 conn(0x7f6b5c0c5070 msgr2=0x7f6b5c0c40c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:45:01.129 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:01.129+0000 7f6b5b7fe640 1 --2- 172.21.15.73:0/2293538906 >> v2:172.21.15.142:3300/0 conn(0x7f6b5c0c5070 0x7f6b5c0c40c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:01.130 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:01.129+0000 7f6b5b7fe640 1 -- 172.21.15.73:0/2293538906 >> v1:172.21.15.142:6789/0 conn(0x7f6b5c06db70 legacy=0x7f6b5c0c39b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:01.130 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:01.129+0000 7f6b5b7fe640 1 -- 172.21.15.73:0/2293538906 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b5c152eb0 con 0x7f6b5c14fa40 2023-12-12T09:45:01.130 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:01.130+0000 7f6b5b7fe640 1 --2- 172.21.15.73:0/2293538906 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6b5c14fa40 0x7f6b5c06a4e0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f6b4c0097a0 tx=0x7f6b4c02b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=37b806c0c6a7733e server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:45:01.131 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:01.131+0000 7f6b5affd640 1 -- 172.21.15.73:0/2293538906 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b4c031830 con 0x7f6b5c14fa40 2023-12-12T09:45:01.131 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:01.131+0000 7f6b5affd640 1 -- 172.21.15.73:0/2293538906 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b4c031990 con 0x7f6b5c14fa40 2023-12-12T09:45:01.131 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:01.131+0000 7f6b5affd640 1 -- 172.21.15.73:0/2293538906 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b4c031d20 con 0x7f6b5c14fa40 2023-12-12T09:45:01.132 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:01.131+0000 7f6b61ba5640 1 -- 172.21.15.73:0/2293538906 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6b5c14fa40 msgr2=0x7f6b5c06a4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:01.132 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:01.131+0000 7f6b61ba5640 1 --2- 172.21.15.73:0/2293538906 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6b5c14fa40 0x7f6b5c06a4e0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f6b4c0097a0 tx=0x7f6b4c02b8d0 comp rx=0 tx=0).stop 2023-12-12T09:45:01.132 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:01.132+0000 7f6b61ba5640 1 -- 172.21.15.73:0/2293538906 shutdown_connections 2023-12-12T09:45:01.133 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:01.132+0000 7f6b61ba5640 1 --2- 172.21.15.73:0/2293538906 >> v2:172.21.15.142:3300/0 conn(0x7f6b5c0c5070 0x7f6b5c0c40c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:01.133 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:01.132+0000 7f6b61ba5640 1 --2- 172.21.15.73:0/2293538906 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6b5c14fa40 0x7f6b5c06a4e0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:01.133 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:01.132+0000 7f6b61ba5640 1 -- 172.21.15.73:0/2293538906 >> 172.21.15.73:0/2293538906 conn(0x7f6b5c0a8130 msgr2=0x7f6b5c0c24b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:45:01.133 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:01.132+0000 7f6b61ba5640 1 -- 172.21.15.73:0/2293538906 shutdown_connections 2023-12-12T09:45:01.133 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:01.132+0000 7f6b61ba5640 1 -- 172.21.15.73:0/2293538906 wait complete. 2023-12-12T09:45:01.133 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:01.133+0000 7f6b61ba5640 1 Processor -- start 2023-12-12T09:45:01.133 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:01.133+0000 7f6b61ba5640 1 -- start start 2023-12-12T09:45:01.135 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:01.134+0000 7f6b61ba5640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6b5c06db70 0x7f6b5c1de8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:01.135 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:01.134+0000 7f6b61ba5640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6b5c0c5070 0x7f6b5c14cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:01.135 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:01.134+0000 7f6b61ba5640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6b5c14fa40 0x7f6b5c14d530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:01.135 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:01.134+0000 7f6b61ba5640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b5c1d9640 con 0x7f6b5c0c5070 2023-12-12T09:45:01.135 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:01.134+0000 7f6b61ba5640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b5c0aa7c0 con 0x7f6b5c14fa40 2023-12-12T09:45:01.135 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:01.134+0000 7f6b61ba5640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b5c1ed8c0 con 0x7f6b5c06db70 2023-12-12T09:45:01.135 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:01.135+0000 7f6b52ffd640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6b5c0c5070 0x7f6b5c14cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:01.135 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:01.135+0000 7f6b52ffd640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6b5c0c5070 0x7f6b5c14cff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:38010/0 (socket says 172.21.15.73:38010) 2023-12-12T09:45:01.135 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:01.135+0000 7f6b52ffd640 1 -- 172.21.15.73:0/3127808899 learned_addr learned my addr 172.21.15.73:0/3127808899 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:45:01.136 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:01.135+0000 7f6b5bfff640 1 --2- 172.21.15.73:0/3127808899 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6b5c14fa40 0x7f6b5c14d530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:01.136 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:01.135+0000 7f6b5b7fe640 1 --2- 172.21.15.73:0/3127808899 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6b5c06db70 0x7f6b5c1de8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:01.137 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:01.135+0000 7f6b52ffd640 1 -- 172.21.15.73:0/3127808899 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6b5c06db70 msgr2=0x7f6b5c1de8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:01.137 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:01.135+0000 7f6b52ffd640 1 --2- 172.21.15.73:0/3127808899 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6b5c06db70 0x7f6b5c1de8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:01.137 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:01.135+0000 7f6b52ffd640 1 -- 172.21.15.73:0/3127808899 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6b5c14fa40 msgr2=0x7f6b5c14d530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:01.137 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:01.135+0000 7f6b52ffd640 1 --2- 172.21.15.73:0/3127808899 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6b5c14fa40 0x7f6b5c14d530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:01.137 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:01.135+0000 7f6b52ffd640 1 -- 172.21.15.73:0/3127808899 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b4c009400 con 0x7f6b5c0c5070 2023-12-12T09:45:01.137 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:01.135+0000 7f6b52ffd640 1 --2- 172.21.15.73:0/3127808899 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6b5c0c5070 0x7f6b5c14cff0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f6b4400c3c0 tx=0x7f6b4400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:45:01.137 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:01.136+0000 7f6b58ff9640 1 -- 172.21.15.73:0/3127808899 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b440052d0 con 0x7f6b5c0c5070 2023-12-12T09:45:01.137 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:01.136+0000 7f6b58ff9640 1 -- 172.21.15.73:0/3127808899 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b44005450 con 0x7f6b5c0c5070 2023-12-12T09:45:01.137 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:01.136+0000 7f6b58ff9640 1 -- 172.21.15.73:0/3127808899 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b44003830 con 0x7f6b5c0c5070 2023-12-12T09:45:01.137 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:01.136+0000 7f6b61ba5640 1 -- 172.21.15.73:0/3127808899 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b5c1edba0 con 0x7f6b5c0c5070 2023-12-12T09:45:01.137 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:01.136+0000 7f6b61ba5640 1 -- 172.21.15.73:0/3127808899 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b5c0aaaa0 con 0x7f6b5c0c5070 2023-12-12T09:45:01.138 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:01.137+0000 7f6b61ba5640 1 -- 172.21.15.73:0/3127808899 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b5c067560 con 0x7f6b5c0c5070 2023-12-12T09:45:01.138 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:01.138+0000 7f6b58ff9640 1 -- 172.21.15.73:0/3127808899 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f6b44003990 con 0x7f6b5c0c5070 2023-12-12T09:45:01.139 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:01.139+0000 7f6b58ff9640 1 --2- 172.21.15.73:0/3127808899 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f6b3c06ae40 0x7f6b3c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:01.139 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:01.139+0000 7f6b58ff9640 1 -- 172.21.15.73:0/3127808899 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f6b44088e70 con 0x7f6b5c0c5070 2023-12-12T09:45:01.139 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:01.139+0000 7f6b5b7fe640 1 --2- 172.21.15.73:0/3127808899 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f6b3c06ae40 0x7f6b3c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:01.140 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:01.140+0000 7f6b5b7fe640 1 --2- 172.21.15.73:0/3127808899 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f6b3c06ae40 0x7f6b3c06d300 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f6b4c036000 tx=0x7f6b4c008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:45:01.143 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:01.143+0000 7f6b58ff9640 1 -- 172.21.15.73:0/3127808899 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f6b44053bb0 con 0x7f6b5c0c5070 2023-12-12T09:45:01.372 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:01.372+0000 7f6b61ba5640 1 -- 172.21.15.73:0/3127808899 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6b5c0008d0 con 0x7f6b5c0c5070 2023-12-12T09:45:01.373 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:01.373+0000 7f6b58ff9640 1 -- 172.21.15.73:0/3127808899 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) v1 ==== 94+0+6133 (secure 0 0 0) 0x7f6b44017090 con 0x7f6b5c0c5070 2023-12-12T09:45:01.374 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-12T09:45:01.374 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":19,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4517,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6835/2407815368","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6833","nonce":2407815368},{"type":"v1","addr":"172.21.15.142:6835","nonce":2407815368}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":4720,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6834/153753304","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6832","nonce":153753304},{"type":"v1","addr":"172.21.15.142:6834","nonce":153753304}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-12T09:44:20.925302+0000","modified":"2023-12-12T09:44:24.049947+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4965},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4965":{"gid":4965,"name":"c","rank":0,"incarnation":12,"state":"up:active","state_seq":4,"addr":"172.21.15.73:6837/1534083424","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6835","nonce":1534083424},{"type":"v1","addr":"172.21.15.73:6837","nonce":1534083424}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2},{"mdsmap":{"epoch":19,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-12T09:44:36.098486+0000","modified":"2023-12-12T09:44:39.152510+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4962},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4962":{"gid":4962,"name":"a","rank":0,"incarnation":16,"state":"up:active","state_seq":8,"addr":"172.21.15.73:6836/2500303907","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":2500303907},{"type":"v1","addr":"172.21.15.73:6836","nonce":2500303907}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-12-12T09:45:01.374 INFO:teuthology.orchestra.run.smithi073.stderr:dumped fsmap epoch 19 2023-12-12T09:45:01.377 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:01.376+0000 7f6b61ba5640 1 -- 172.21.15.73:0/3127808899 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f6b3c06ae40 msgr2=0x7f6b3c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:01.377 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:01.376+0000 7f6b61ba5640 1 --2- 172.21.15.73:0/3127808899 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f6b3c06ae40 0x7f6b3c06d300 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f6b4c036000 tx=0x7f6b4c008030 comp rx=0 tx=0).stop 2023-12-12T09:45:01.377 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:01.376+0000 7f6b61ba5640 1 -- 172.21.15.73:0/3127808899 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6b5c0c5070 msgr2=0x7f6b5c14cff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:01.377 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:01.376+0000 7f6b61ba5640 1 --2- 172.21.15.73:0/3127808899 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6b5c0c5070 0x7f6b5c14cff0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f6b4400c3c0 tx=0x7f6b4400c880 comp rx=0 tx=0).stop 2023-12-12T09:45:01.377 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:01.376+0000 7f6b61ba5640 1 -- 172.21.15.73:0/3127808899 shutdown_connections 2023-12-12T09:45:01.377 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:01.376+0000 7f6b61ba5640 1 --2- 172.21.15.73:0/3127808899 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f6b3c06ae40 0x7f6b3c06d300 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:01.377 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:01.376+0000 7f6b61ba5640 1 --2- 172.21.15.73:0/3127808899 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6b5c14fa40 0x7f6b5c14d530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:01.377 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:01.376+0000 7f6b61ba5640 1 --2- 172.21.15.73:0/3127808899 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6b5c0c5070 0x7f6b5c14cff0 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:01.377 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:01.376+0000 7f6b61ba5640 1 --2- 172.21.15.73:0/3127808899 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6b5c06db70 0x7f6b5c1de8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:01.377 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:01.376+0000 7f6b61ba5640 1 -- 172.21.15.73:0/3127808899 >> 172.21.15.73:0/3127808899 conn(0x7f6b5c0a8130 msgr2=0x7f6b5c0c63b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:45:01.377 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:01.376+0000 7f6b61ba5640 1 -- 172.21.15.73:0/3127808899 shutdown_connections 2023-12-12T09:45:01.377 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:01.376+0000 7f6b61ba5640 1 -- 172.21.15.73:0/3127808899 wait complete. 2023-12-12T09:45:01.396 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-12T09:45:01.609 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:01.609+0000 7f8ca9402640 1 Processor -- start 2023-12-12T09:45:01.609 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:01.609+0000 7f8ca9402640 1 -- start start 2023-12-12T09:45:01.610 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:01.610+0000 7f8ca9402640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f8ca414fa40 0x7f8ca406a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:01.611 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:01.610+0000 7f8ca9402640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ca4152610 con 0x7f8ca40c5070 2023-12-12T09:45:01.611 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:01.610+0000 7f8ca9402640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ca41528f0 con 0x7f8ca406db70 2023-12-12T09:45:01.611 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:01.610+0000 7f8ca9402640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ca4152bd0 con 0x7f8ca414fa40 2023-12-12T09:45:01.611 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:01.611+0000 7f8ca37fe640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f8ca40c5070 0x7f8ca40c40c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:51144/0 (socket says 172.21.15.73:51144) 2023-12-12T09:45:01.611 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:01.611+0000 7f8ca37fe640 1 -- 172.21.15.73:0/3721453430 learned_addr learned my addr 172.21.15.73:0/3721453430 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-12T09:45:01.613 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:01.611+0000 7f8ca2ffd640 1 --2- 172.21.15.73:0/3721453430 >> v2:172.21.15.142:3300/0 conn(0x7f8ca414fa40 0x7f8ca406a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:01.613 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:01.611+0000 7f8ca27fc640 1 -- 172.21.15.73:0/3721453430 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2910075813 0 0) 0x7f8ca4152610 con 0x7f8ca40c5070 2023-12-12T09:45:01.613 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:01.611+0000 7f8ca27fc640 1 -- 172.21.15.73:0/3721453430 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8c90003520 con 0x7f8ca40c5070 2023-12-12T09:45:01.613 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:01.612+0000 7f8ca27fc640 1 -- 172.21.15.73:0/3721453430 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 499030392 0 0) 0x7f8c90003520 con 0x7f8ca40c5070 2023-12-12T09:45:01.613 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:01.612+0000 7f8ca27fc640 1 -- 172.21.15.73:0/3721453430 >> v2:172.21.15.142:3300/0 conn(0x7f8ca414fa40 msgr2=0x7f8ca406a4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:45:01.613 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:01.612+0000 7f8ca27fc640 1 --2- 172.21.15.73:0/3721453430 >> v2:172.21.15.142:3300/0 conn(0x7f8ca414fa40 0x7f8ca406a4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:01.613 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:01.612+0000 7f8ca27fc640 1 -- 172.21.15.73:0/3721453430 >> v1:172.21.15.142:6789/0 conn(0x7f8ca406db70 legacy=0x7f8ca40c39b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:01.613 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:01.612+0000 7f8ca27fc640 1 -- 172.21.15.73:0/3721453430 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ca4152eb0 con 0x7f8ca40c5070 2023-12-12T09:45:01.613 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:01.612+0000 7f8ca27fc640 1 -- 172.21.15.73:0/3721453430 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3186547832 0 0) 0x7f8c9c0019f0 con 0x7f8ca40c5070 2023-12-12T09:45:01.613 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:01.612+0000 7f8ca27fc640 1 -- 172.21.15.73:0/3721453430 >> v1:172.21.15.73:6789/0 conn(0x7f8ca40c5070 legacy=0x7f8ca40c40c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:01.613 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:01.612+0000 7f8ca27fc640 1 --2- 172.21.15.73:0/3721453430 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8c90003970 0x7f8c90003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:01.613 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:01.612+0000 7f8ca27fc640 1 --2- 172.21.15.73:0/3721453430 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8c900047c0 0x7f8c90004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:01.613 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:01.612+0000 7f8ca27fc640 1 --2- 172.21.15.73:0/3721453430 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8c900052a0 0x7f8c9000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:01.614 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:01.612+0000 7f8ca27fc640 1 -- 172.21.15.73:0/3721453430 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ca4152bd0 con 0x7f8c900047c0 2023-12-12T09:45:01.614 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:01.612+0000 7f8ca27fc640 1 -- 172.21.15.73:0/3721453430 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c9000c170 con 0x7f8c900052a0 2023-12-12T09:45:01.614 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:01.612+0000 7f8ca27fc640 1 -- 172.21.15.73:0/3721453430 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c9000c330 con 0x7f8c90003970 2023-12-12T09:45:01.614 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:01.612+0000 7f8ca2ffd640 1 --2- 172.21.15.73:0/3721453430 >> v2:172.21.15.142:3300/0 conn(0x7f8ca414fa40 0x7f8ca406a4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-12T09:45:01.614 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:01.612+0000 7f8c9a7fc640 1 --2- 172.21.15.73:0/3721453430 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8c900047c0 0x7f8c90004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:01.614 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:01.612+0000 7f8c9a7fc640 1 -- 172.21.15.73:0/3721453430 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8c90003970 msgr2=0x7f8c90003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:45:01.614 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:01.612+0000 7f8c9a7fc640 1 --2- 172.21.15.73:0/3721453430 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8c90003970 0x7f8c90003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:01.614 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:01.612+0000 7f8c9a7fc640 1 -- 172.21.15.73:0/3721453430 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8c900052a0 msgr2=0x7f8c9000b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:45:01.614 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:01.612+0000 7f8c9a7fc640 1 --2- 172.21.15.73:0/3721453430 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8c900052a0 0x7f8c9000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:01.614 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:01.612+0000 7f8c9a7fc640 1 -- 172.21.15.73:0/3721453430 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c90003520 con 0x7f8c900047c0 2023-12-12T09:45:01.614 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:01.612+0000 7f8ca37fe640 1 -- 172.21.15.73:0/3721453430 reap_dead start 2023-12-12T09:45:01.620 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:01.613+0000 7f8c9a7fc640 1 --2- 172.21.15.73:0/3721453430 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8c900047c0 0x7f8c90004c40 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f8c8c001720 tx=0x7f8c900057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9fbe83eeaa97df7d server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:45:01.620 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:01.614+0000 7f8ca27fc640 1 -- 172.21.15.73:0/3721453430 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c8c0052d0 con 0x7f8c900047c0 2023-12-12T09:45:01.620 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:01.614+0000 7f8ca27fc640 1 -- 172.21.15.73:0/3721453430 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c8c02e050 con 0x7f8c900047c0 2023-12-12T09:45:01.620 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:01.614+0000 7f8ca27fc640 1 -- 172.21.15.73:0/3721453430 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c8c003830 con 0x7f8c900047c0 2023-12-12T09:45:01.620 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:01.614+0000 7f8ca9402640 1 -- 172.21.15.73:0/3721453430 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8c900047c0 msgr2=0x7f8c90004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:01.620 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:01.614+0000 7f8ca9402640 1 --2- 172.21.15.73:0/3721453430 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8c900047c0 0x7f8c90004c40 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f8c8c001720 tx=0x7f8c900057f0 comp rx=0 tx=0).stop 2023-12-12T09:45:01.620 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:01.614+0000 7f8ca9402640 1 -- 172.21.15.73:0/3721453430 shutdown_connections 2023-12-12T09:45:01.621 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:01.614+0000 7f8ca9402640 1 --2- 172.21.15.73:0/3721453430 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8c900047c0 0x7f8c90004c40 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:01.621 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:01.614+0000 7f8ca9402640 1 -- 172.21.15.73:0/3721453430 >> 172.21.15.73:0/3721453430 conn(0x7f8ca40a8130 msgr2=0x7f8ca40c24b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:45:01.621 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:01.614+0000 7f8ca9402640 1 -- 172.21.15.73:0/3721453430 shutdown_connections 2023-12-12T09:45:01.621 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:01.614+0000 7f8ca9402640 1 -- 172.21.15.73:0/3721453430 wait complete. 2023-12-12T09:45:01.621 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:01.616+0000 7f8ca9402640 1 Processor -- start 2023-12-12T09:45:01.621 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:01.616+0000 7f8ca9402640 1 -- start start 2023-12-12T09:45:01.621 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:01.617+0000 7f8ca9402640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8c900047c0 0x7f8ca40a8e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:01.621 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:01.617+0000 7f8ca9402640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8ca4151ee0 0x7f8ca4150b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:01.621 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:01.617+0000 7f8ca9402640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8ca40aa200 0x7f8ca41ed5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:01.621 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:01.617+0000 7f8ca9402640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ca41ece80 con 0x7f8ca4151ee0 2023-12-12T09:45:01.621 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:01.617+0000 7f8ca9402640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ca40714c0 con 0x7f8ca40aa200 2023-12-12T09:45:01.622 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:01.617+0000 7f8ca9402640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ca40717a0 con 0x7f8c900047c0 2023-12-12T09:45:01.622 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:01.617+0000 7f8c9a7fc640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8ca4151ee0 0x7f8ca4150b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:01.622 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:01.617+0000 7f8c9a7fc640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8ca4151ee0 0x7f8ca4150b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:38030/0 (socket says 172.21.15.73:38030) 2023-12-12T09:45:01.622 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:01.617+0000 7f8c9a7fc640 1 -- 172.21.15.73:0/3577567358 learned_addr learned my addr 172.21.15.73:0/3577567358 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:45:01.622 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:01.618+0000 7f8ca2ffd640 1 --2- 172.21.15.73:0/3577567358 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8c900047c0 0x7f8ca40a8e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:01.623 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:01.618+0000 7f8ca37fe640 1 --2- 172.21.15.73:0/3577567358 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8ca40aa200 0x7f8ca41ed5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:01.623 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:01.618+0000 7f8c9a7fc640 1 -- 172.21.15.73:0/3577567358 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8c900047c0 msgr2=0x7f8ca40a8e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:01.623 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:01.618+0000 7f8c9a7fc640 1 --2- 172.21.15.73:0/3577567358 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8c900047c0 0x7f8ca40a8e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:01.623 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:01.618+0000 7f8c9a7fc640 1 -- 172.21.15.73:0/3577567358 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8ca40aa200 msgr2=0x7f8ca41ed5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:01.623 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:01.618+0000 7f8c9a7fc640 1 --2- 172.21.15.73:0/3577567358 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8ca40aa200 0x7f8ca41ed5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:01.623 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:01.618+0000 7f8c9a7fc640 1 -- 172.21.15.73:0/3577567358 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ca4071a80 con 0x7f8ca4151ee0 2023-12-12T09:45:01.623 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:01.618+0000 7f8c9a7fc640 1 --2- 172.21.15.73:0/3577567358 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8ca4151ee0 0x7f8ca4150b40 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f8c8c02bbc0 tx=0x7f8c8c001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:45:01.623 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:01.618+0000 7f8c9bfff640 1 -- 172.21.15.73:0/3577567358 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c8c0076c0 con 0x7f8ca4151ee0 2023-12-12T09:45:01.623 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:01.618+0000 7f8c9bfff640 1 -- 172.21.15.73:0/3577567358 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c8c007a30 con 0x7f8ca4151ee0 2023-12-12T09:45:01.623 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:01.618+0000 7f8c9bfff640 1 -- 172.21.15.73:0/3577567358 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c8c006be0 con 0x7f8ca4151ee0 2023-12-12T09:45:01.623 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:01.618+0000 7f8ca9402640 1 -- 172.21.15.73:0/3577567358 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ca41ed0d0 con 0x7f8ca4151ee0 2023-12-12T09:45:01.623 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:01.618+0000 7f8ca9402640 1 -- 172.21.15.73:0/3577567358 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ca40a6d10 con 0x7f8ca4151ee0 2023-12-12T09:45:01.623 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:01.619+0000 7f8ca9402640 1 -- 172.21.15.73:0/3577567358 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ca41ed260 con 0x7f8ca4151ee0 2023-12-12T09:45:01.624 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:01.620+0000 7f8c9bfff640 1 -- 172.21.15.73:0/3577567358 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f8c8c006d40 con 0x7f8ca4151ee0 2023-12-12T09:45:01.624 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:01.621+0000 7f8c9bfff640 1 --2- 172.21.15.73:0/3577567358 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f8c8406aec0 0x7f8c8406d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:01.624 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:01.621+0000 7f8c9bfff640 1 -- 172.21.15.73:0/3577567358 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f8c8c0ab5f0 con 0x7f8ca4151ee0 2023-12-12T09:45:01.625 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:01.622+0000 7f8ca2ffd640 1 --2- 172.21.15.73:0/3577567358 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f8c8406aec0 0x7f8c8406d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:01.625 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:01.622+0000 7f8ca2ffd640 1 --2- 172.21.15.73:0/3577567358 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f8c8406aec0 0x7f8c8406d380 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f8c94006a90 tx=0x7f8c94008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:45:01.625 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:01.626+0000 7f8c9bfff640 1 -- 172.21.15.73:0/3577567358 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f8c8c0763b0 con 0x7f8ca4151ee0 2023-12-12T09:45:01.856 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:01.856+0000 7f8ca9402640 1 -- 172.21.15.73:0/3577567358 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8ca40718e0 con 0x7f8ca4151ee0 2023-12-12T09:45:01.857 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:01.857+0000 7f8c9bfff640 1 -- 172.21.15.73:0/3577567358 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) v1 ==== 94+0+6133 (secure 0 0 0) 0x7f8ca40718e0 con 0x7f8ca4151ee0 2023-12-12T09:45:01.858 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-12T09:45:01.858 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":19,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4517,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6835/2407815368","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6833","nonce":2407815368},{"type":"v1","addr":"172.21.15.142:6835","nonce":2407815368}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":4720,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6834/153753304","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6832","nonce":153753304},{"type":"v1","addr":"172.21.15.142:6834","nonce":153753304}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-12T09:44:20.925302+0000","modified":"2023-12-12T09:44:24.049947+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4965},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4965":{"gid":4965,"name":"c","rank":0,"incarnation":12,"state":"up:active","state_seq":4,"addr":"172.21.15.73:6837/1534083424","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6835","nonce":1534083424},{"type":"v1","addr":"172.21.15.73:6837","nonce":1534083424}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2},{"mdsmap":{"epoch":19,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-12T09:44:36.098486+0000","modified":"2023-12-12T09:44:39.152510+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4962},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4962":{"gid":4962,"name":"a","rank":0,"incarnation":16,"state":"up:active","state_seq":8,"addr":"172.21.15.73:6836/2500303907","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":2500303907},{"type":"v1","addr":"172.21.15.73:6836","nonce":2500303907}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-12-12T09:45:01.858 INFO:teuthology.orchestra.run.smithi073.stderr:dumped fsmap epoch 19 2023-12-12T09:45:01.860 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:01.860+0000 7f8ca9402640 1 -- 172.21.15.73:0/3577567358 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f8c8406aec0 msgr2=0x7f8c8406d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:01.860 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:01.860+0000 7f8ca9402640 1 --2- 172.21.15.73:0/3577567358 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f8c8406aec0 0x7f8c8406d380 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f8c94006a90 tx=0x7f8c94008040 comp rx=0 tx=0).stop 2023-12-12T09:45:01.860 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:01.860+0000 7f8ca9402640 1 -- 172.21.15.73:0/3577567358 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8ca4151ee0 msgr2=0x7f8ca4150b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:01.860 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:01.860+0000 7f8ca9402640 1 --2- 172.21.15.73:0/3577567358 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8ca4151ee0 0x7f8ca4150b40 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f8c8c02bbc0 tx=0x7f8c8c001120 comp rx=0 tx=0).stop 2023-12-12T09:45:01.860 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:01.860+0000 7f8ca9402640 1 -- 172.21.15.73:0/3577567358 shutdown_connections 2023-12-12T09:45:01.860 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:01.860+0000 7f8ca9402640 1 --2- 172.21.15.73:0/3577567358 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f8c8406aec0 0x7f8c8406d380 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:01.861 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:01.860+0000 7f8ca9402640 1 --2- 172.21.15.73:0/3577567358 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8ca40aa200 0x7f8ca41ed5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:01.861 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:01.860+0000 7f8ca9402640 1 --2- 172.21.15.73:0/3577567358 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8ca4151ee0 0x7f8ca4150b40 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:01.861 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:01.860+0000 7f8ca9402640 1 --2- 172.21.15.73:0/3577567358 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8c900047c0 0x7f8ca40a8e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:01.861 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:01.860+0000 7f8ca9402640 1 -- 172.21.15.73:0/3577567358 >> 172.21.15.73:0/3577567358 conn(0x7f8ca40a8130 msgr2=0x7f8ca414dc90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:45:01.861 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:01.860+0000 7f8ca9402640 1 -- 172.21.15.73:0/3577567358 shutdown_connections 2023-12-12T09:45:01.861 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:01.860+0000 7f8ca9402640 1 -- 172.21.15.73:0/3577567358 wait complete. 2023-12-12T09:45:01.880 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-12T09:45:02.088 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:02.088+0000 7f8762e32640 1 Processor -- start 2023-12-12T09:45:02.088 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:02.088+0000 7f8762e32640 1 -- start start 2023-12-12T09:45:02.089 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:02.089+0000 7f8762e32640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f875c14fa40 0x7f875c06a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:02.089 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:02.089+0000 7f8762e32640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f875c06db70 0x7f875c0c39b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:02.089 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:02.089+0000 7f8762e32640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f875c152610 con 0x7f875c0c5070 2023-12-12T09:45:02.089 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:02.089+0000 7f8762e32640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f875c1528f0 con 0x7f875c14fa40 2023-12-12T09:45:02.090 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:02.089+0000 7f8762e32640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f875c152bd0 con 0x7f875c06db70 2023-12-12T09:45:02.090 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:02.090+0000 7f8760bce640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f875c14fa40 0x7f875c06a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:02.090 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:02.090+0000 7f8760bce640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f875c14fa40 0x7f875c06a4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.73:49842/0 (socket says 172.21.15.73:49842) 2023-12-12T09:45:02.090 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:02.090+0000 7f8760bce640 1 -- 172.21.15.73:0/2576339702 learned_addr learned my addr 172.21.15.73:0/2576339702 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:45:02.090 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:02.090+0000 7f875bfff640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f875c06db70 0x7f875c0c39b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:02.091 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:02.091+0000 7f875bfff640 1 -- 172.21.15.73:0/2576339702 >> v2:172.21.15.142:3300/0 conn(0x7f875c14fa40 msgr2=0x7f875c06a4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:45:02.091 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:02.091+0000 7f875bfff640 1 --2- 172.21.15.73:0/2576339702 >> v2:172.21.15.142:3300/0 conn(0x7f875c14fa40 0x7f875c06a4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:02.091 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:02.091+0000 7f875bfff640 1 -- 172.21.15.73:0/2576339702 >> v1:172.21.15.142:6789/0 conn(0x7f875c0c5070 legacy=0x7f875c0c3ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:02.091 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:02.091+0000 7f875bfff640 1 -- 172.21.15.73:0/2576339702 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f875c152eb0 con 0x7f875c06db70 2023-12-12T09:45:02.091 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:02.091+0000 7f8760bce640 1 --2- 172.21.15.73:0/2576339702 >> v2:172.21.15.142:3300/0 conn(0x7f875c14fa40 0x7f875c06a4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-12T09:45:02.092 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:02.092+0000 7f875bfff640 1 --2- 172.21.15.73:0/2576339702 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f875c06db70 0x7f875c0c39b0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f87480097a0 tx=0x7f874802b8b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=623dc33d80c4954b server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:45:02.093 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:02.093+0000 7f875b7fe640 1 -- 172.21.15.73:0/2576339702 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f874802d040 con 0x7f875c06db70 2023-12-12T09:45:02.093 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:02.093+0000 7f875b7fe640 1 -- 172.21.15.73:0/2576339702 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8748031810 con 0x7f875c06db70 2023-12-12T09:45:02.093 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:02.093+0000 7f875b7fe640 1 -- 172.21.15.73:0/2576339702 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8748031ba0 con 0x7f875c06db70 2023-12-12T09:45:02.094 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:02.094+0000 7f8762e32640 1 -- 172.21.15.73:0/2576339702 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f875c06db70 msgr2=0x7f875c0c39b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:02.094 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:02.094+0000 7f8762e32640 1 --2- 172.21.15.73:0/2576339702 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f875c06db70 0x7f875c0c39b0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f87480097a0 tx=0x7f874802b8b0 comp rx=0 tx=0).stop 2023-12-12T09:45:02.094 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:02.094+0000 7f8762e32640 1 -- 172.21.15.73:0/2576339702 shutdown_connections 2023-12-12T09:45:02.094 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:02.094+0000 7f8762e32640 1 --2- 172.21.15.73:0/2576339702 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f875c06db70 0x7f875c0c39b0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:02.094 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:02.094+0000 7f8762e32640 1 --2- 172.21.15.73:0/2576339702 >> v2:172.21.15.142:3300/0 conn(0x7f875c14fa40 0x7f875c06a4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:02.094 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:02.094+0000 7f8762e32640 1 -- 172.21.15.73:0/2576339702 >> 172.21.15.73:0/2576339702 conn(0x7f875c0a8130 msgr2=0x7f875c0c24b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:45:02.095 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:02.094+0000 7f8762e32640 1 -- 172.21.15.73:0/2576339702 shutdown_connections 2023-12-12T09:45:02.095 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:02.094+0000 7f8762e32640 1 -- 172.21.15.73:0/2576339702 wait complete. 2023-12-12T09:45:02.095 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:02.095+0000 7f8762e32640 1 Processor -- start 2023-12-12T09:45:02.096 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:02.096+0000 7f8762e32640 1 -- start start 2023-12-12T09:45:02.097 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:02.096+0000 7f8762e32640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f875c06db70 0x7f875c0bf440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:02.097 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:02.096+0000 7f8762e32640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f875c0c5070 0x7f875c0bf980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:02.097 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:02.096+0000 7f8762e32640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f875c14fa40 0x7f875c14aca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:02.097 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:02.096+0000 7f8762e32640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f875c0bb3b0 con 0x7f875c14fa40 2023-12-12T09:45:02.097 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:02.096+0000 7f8762e32640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f875c0a5e90 con 0x7f875c06db70 2023-12-12T09:45:02.097 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:02.096+0000 7f8762e32640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f875c0bfec0 con 0x7f875c0c5070 2023-12-12T09:45:02.098 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:02.097+0000 7f87613cf640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f875c14fa40 0x7f875c14aca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:02.098 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:02.097+0000 7f87613cf640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f875c14fa40 0x7f875c14aca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:38038/0 (socket says 172.21.15.73:38038) 2023-12-12T09:45:02.098 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:02.097+0000 7f87613cf640 1 -- 172.21.15.73:0/696490442 learned_addr learned my addr 172.21.15.73:0/696490442 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:45:02.099 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:02.097+0000 7f875bfff640 1 --2- 172.21.15.73:0/696490442 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f875c0c5070 0x7f875c0bf980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:02.099 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:02.097+0000 7f8760bce640 1 --2- 172.21.15.73:0/696490442 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f875c06db70 0x7f875c0bf440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:02.099 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:02.097+0000 7f87613cf640 1 -- 172.21.15.73:0/696490442 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f875c0c5070 msgr2=0x7f875c0bf980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:02.099 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:02.097+0000 7f87613cf640 1 --2- 172.21.15.73:0/696490442 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f875c0c5070 0x7f875c0bf980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:02.099 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:02.097+0000 7f87613cf640 1 -- 172.21.15.73:0/696490442 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f875c06db70 msgr2=0x7f875c0bf440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:02.099 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:02.097+0000 7f87613cf640 1 --2- 172.21.15.73:0/696490442 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f875c06db70 0x7f875c0bf440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:02.099 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:02.097+0000 7f87613cf640 1 -- 172.21.15.73:0/696490442 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87500094d0 con 0x7f875c14fa40 2023-12-12T09:45:02.100 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:02.098+0000 7f87613cf640 1 --2- 172.21.15.73:0/696490442 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f875c14fa40 0x7f875c14aca0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f875400c7a0 tx=0x7f875400cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:45:02.100 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:02.098+0000 7f87597fa640 1 -- 172.21.15.73:0/696490442 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8754003b70 con 0x7f875c14fa40 2023-12-12T09:45:02.100 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:02.098+0000 7f87597fa640 1 -- 172.21.15.73:0/696490442 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8754003cf0 con 0x7f875c14fa40 2023-12-12T09:45:02.100 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:02.098+0000 7f87597fa640 1 -- 172.21.15.73:0/696490442 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8754003ea0 con 0x7f875c14fa40 2023-12-12T09:45:02.100 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:02.098+0000 7f8762e32640 1 -- 172.21.15.73:0/696490442 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8748009400 con 0x7f875c14fa40 2023-12-12T09:45:02.100 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:02.098+0000 7f8762e32640 1 -- 172.21.15.73:0/696490442 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f875c1e8680 con 0x7f875c14fa40 2023-12-12T09:45:02.100 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:02.099+0000 7f8762e32640 1 -- 172.21.15.73:0/696490442 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f875c0c4580 con 0x7f875c14fa40 2023-12-12T09:45:02.100 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:02.100+0000 7f87597fa640 1 -- 172.21.15.73:0/696490442 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f875400aa90 con 0x7f875c14fa40 2023-12-12T09:45:02.101 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:02.101+0000 7f87597fa640 1 --2- 172.21.15.73:0/696490442 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f874006ae40 0x7f874006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:02.101 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:02.101+0000 7f87597fa640 1 -- 172.21.15.73:0/696490442 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f8754089820 con 0x7f875c14fa40 2023-12-12T09:45:02.101 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:02.101+0000 7f8760bce640 1 --2- 172.21.15.73:0/696490442 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f874006ae40 0x7f874006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:02.102 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:02.102+0000 7f8760bce640 1 --2- 172.21.15.73:0/696490442 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f874006ae40 0x7f874006d300 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f8750009cf0 tx=0x7f8750008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:45:02.105 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:02.105+0000 7f87597fa640 1 -- 172.21.15.73:0/696490442 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f8754054560 con 0x7f875c14fa40 2023-12-12T09:45:02.296 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:02.296+0000 7f8762e32640 1 -- 172.21.15.73:0/696490442 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f875c06ae90 con 0x7f875c14fa40 2023-12-12T09:45:02.300 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:02.299+0000 7f87597fa640 1 -- 172.21.15.73:0/696490442 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v38) v1 ==== 74+0+20241 (secure 0 0 0) 0x7f8754057b80 con 0x7f875c14fa40 2023-12-12T09:45:02.300 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-12T09:45:02.301 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":38,"fsid":"ba240992-02b8-4c7e-92f2-27eb29ac433b","created":"2023-12-12T09:43:02.454719+0000","modified":"2023-12-12T09:44:37.659373+0000","last_up_change":"2023-12-12T09:43:13.913440+0000","last_in_change":"2023-12-12T09:43:05.925348+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-12T09:43:15.525508+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-12-12T09:44:18.641446+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-12-12T09:44:19.952405+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs2_metadata","create_time":"2023-12-12T09:44:34.424645+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs2_data","create_time":"2023-12-12T09:44:35.090149+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"dd9074be-dbe2-4c34-9896-a4223d8d3940","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":4047810203},{"type":"v1","addr":"172.21.15.73:6801","nonce":4047810203}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":4047810203},{"type":"v1","addr":"172.21.15.73:6803","nonce":4047810203}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":4047810203},{"type":"v1","addr":"172.21.15.73:6807","nonce":4047810203}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":4047810203},{"type":"v1","addr":"172.21.15.73:6805","nonce":4047810203}]},"public_addr":"172.21.15.73:6801/4047810203","cluster_addr":"172.21.15.73:6803/4047810203","heartbeat_back_addr":"172.21.15.73:6807/4047810203","heartbeat_front_addr":"172.21.15.73:6805/4047810203","state":["exists","up"]},{"osd":1,"uuid":"c4a05052-96d4-4758-a4e1-1a37f1e07fed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":1356058331},{"type":"v1","addr":"172.21.15.73:6824","nonce":1356058331}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":1356058331},{"type":"v1","addr":"172.21.15.73:6827","nonce":1356058331}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":1356058331},{"type":"v1","addr":"172.21.15.73:6831","nonce":1356058331}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":1356058331},{"type":"v1","addr":"172.21.15.73:6829","nonce":1356058331}]},"public_addr":"172.21.15.73:6824/1356058331","cluster_addr":"172.21.15.73:6827/1356058331","heartbeat_back_addr":"172.21.15.73:6831/1356058331","heartbeat_front_addr":"172.21.15.73:6829/1356058331","state":["exists","up"]},{"osd":2,"uuid":"512bc8ac-72c2-40d4-b3d2-d867a92c5213","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":1228903316},{"type":"v1","addr":"172.21.15.73:6817","nonce":1228903316}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":1228903316},{"type":"v1","addr":"172.21.15.73:6819","nonce":1228903316}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6823","nonce":1228903316},{"type":"v1","addr":"172.21.15.73:6825","nonce":1228903316}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":1228903316},{"type":"v1","addr":"172.21.15.73:6821","nonce":1228903316}]},"public_addr":"172.21.15.73:6817/1228903316","cluster_addr":"172.21.15.73:6819/1228903316","heartbeat_back_addr":"172.21.15.73:6825/1228903316","heartbeat_front_addr":"172.21.15.73:6821/1228903316","state":["exists","up"]},{"osd":3,"uuid":"3d1a91e0-42bf-437a-8eae-8d357c8f63a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":1293329670},{"type":"v1","addr":"172.21.15.73:6809","nonce":1293329670}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6810","nonce":1293329670},{"type":"v1","addr":"172.21.15.73:6811","nonce":1293329670}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":1293329670},{"type":"v1","addr":"172.21.15.73:6815","nonce":1293329670}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":1293329670},{"type":"v1","addr":"172.21.15.73:6813","nonce":1293329670}]},"public_addr":"172.21.15.73:6809/1293329670","cluster_addr":"172.21.15.73:6811/1293329670","heartbeat_back_addr":"172.21.15.73:6815/1293329670","heartbeat_front_addr":"172.21.15.73:6813/1293329670","state":["exists","up"]},{"osd":4,"uuid":"4b302fff-834c-4069-ac19-00e46f6c87b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":3727975702},{"type":"v1","addr":"172.21.15.142:6801","nonce":3727975702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":3727975702},{"type":"v1","addr":"172.21.15.142:6803","nonce":3727975702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6809","nonce":3727975702},{"type":"v1","addr":"172.21.15.142:6811","nonce":3727975702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6805","nonce":3727975702},{"type":"v1","addr":"172.21.15.142:6807","nonce":3727975702}]},"public_addr":"172.21.15.142:6801/3727975702","cluster_addr":"172.21.15.142:6803/3727975702","heartbeat_back_addr":"172.21.15.142:6811/3727975702","heartbeat_front_addr":"172.21.15.142:6807/3727975702","state":["exists","up"]},{"osd":5,"uuid":"d7cdace2-67d0-45cc-95f2-515cf6ef1b82","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6817","nonce":2353193632},{"type":"v1","addr":"172.21.15.142:6819","nonce":2353193632}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6821","nonce":2353193632},{"type":"v1","addr":"172.21.15.142:6823","nonce":2353193632}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6829","nonce":2353193632},{"type":"v1","addr":"172.21.15.142:6831","nonce":2353193632}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6825","nonce":2353193632},{"type":"v1","addr":"172.21.15.142:6827","nonce":2353193632}]},"public_addr":"172.21.15.142:6819/2353193632","cluster_addr":"172.21.15.142:6823/2353193632","heartbeat_back_addr":"172.21.15.142:6831/2353193632","heartbeat_front_addr":"172.21.15.142:6827/2353193632","state":["exists","up"]},{"osd":6,"uuid":"649ce78a-5626-445c-aedc-a651ed05a6f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":2006111986},{"type":"v1","addr":"172.21.15.142:6806","nonce":2006111986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":2006111986},{"type":"v1","addr":"172.21.15.142:6810","nonce":2006111986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":2006111986},{"type":"v1","addr":"172.21.15.142:6815","nonce":2006111986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":2006111986},{"type":"v1","addr":"172.21.15.142:6813","nonce":2006111986}]},"public_addr":"172.21.15.142:6806/2006111986","cluster_addr":"172.21.15.142:6810/2006111986","heartbeat_back_addr":"172.21.15.142:6815/2006111986","heartbeat_front_addr":"172.21.15.142:6813/2006111986","state":["exists","up"]},{"osd":7,"uuid":"af15ae3b-c1d0-4acf-92db-8a1805494d13","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":2573794341},{"type":"v1","addr":"172.21.15.142:6818","nonce":2573794341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":2573794341},{"type":"v1","addr":"172.21.15.142:6822","nonce":2573794341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":2573794341},{"type":"v1","addr":"172.21.15.142:6830","nonce":2573794341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":2573794341},{"type":"v1","addr":"172.21.15.142:6826","nonce":2573794341}]},"public_addr":"172.21.15.142:6818/2573794341","cluster_addr":"172.21.15.142:6822/2573794341","heartbeat_back_addr":"172.21.15.142:6830/2573794341","heartbeat_front_addr":"172.21.15.142:6826/2573794341","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.185824+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.262103+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.225556+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:10.523459+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:10.706035+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.257339+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.301776+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.051960+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-12T09:45:02.302 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:02.301+0000 7f8762e32640 1 -- 172.21.15.73:0/696490442 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f874006ae40 msgr2=0x7f874006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:02.302 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:02.301+0000 7f8762e32640 1 --2- 172.21.15.73:0/696490442 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f874006ae40 0x7f874006d300 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f8750009cf0 tx=0x7f8750008040 comp rx=0 tx=0).stop 2023-12-12T09:45:02.302 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:02.301+0000 7f8762e32640 1 -- 172.21.15.73:0/696490442 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f875c14fa40 msgr2=0x7f875c14aca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:02.302 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:02.301+0000 7f8762e32640 1 --2- 172.21.15.73:0/696490442 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f875c14fa40 0x7f875c14aca0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f875400c7a0 tx=0x7f875400cc60 comp rx=0 tx=0).stop 2023-12-12T09:45:02.302 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:02.301+0000 7f8762e32640 1 -- 172.21.15.73:0/696490442 shutdown_connections 2023-12-12T09:45:02.302 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:02.301+0000 7f8762e32640 1 --2- 172.21.15.73:0/696490442 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f874006ae40 0x7f874006d300 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:02.302 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:02.301+0000 7f8762e32640 1 --2- 172.21.15.73:0/696490442 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f875c14fa40 0x7f875c14aca0 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:02.302 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:02.301+0000 7f8762e32640 1 --2- 172.21.15.73:0/696490442 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f875c0c5070 0x7f875c0bf980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:02.302 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:02.301+0000 7f8762e32640 1 --2- 172.21.15.73:0/696490442 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f875c06db70 0x7f875c0bf440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:02.303 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:02.302+0000 7f8762e32640 1 -- 172.21.15.73:0/696490442 >> 172.21.15.73:0/696490442 conn(0x7f875c0a8130 msgr2=0x7f875c0c1ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:45:02.303 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:02.302+0000 7f8762e32640 1 -- 172.21.15.73:0/696490442 shutdown_connections 2023-12-12T09:45:02.303 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:02.302+0000 7f8762e32640 1 -- 172.21.15.73:0/696490442 wait complete. 2023-12-12T09:45:02.321 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-12-12T09:45:02.530 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:02.529+0000 7f14a8e56640 1 Processor -- start 2023-12-12T09:45:02.530 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:02.529+0000 7f14a8e56640 1 -- start start 2023-12-12T09:45:02.531 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:02.531+0000 7f14a8e56640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f14a406fca0 0x7f14a4072700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:02.531 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:02.531+0000 7f14a8e56640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14a4152560 con 0x7f14a40c17e0 2023-12-12T09:45:02.531 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:02.531+0000 7f14a8e56640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14a41532e0 con 0x7f14a40c0420 2023-12-12T09:45:02.532 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:02.531+0000 7f14a8e56640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14a4152ec0 con 0x7f14a406fca0 2023-12-12T09:45:02.532 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:02.531+0000 7f14a2d9d640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f14a40c17e0 0x7f14a415ccd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:51146/0 (socket says 172.21.15.73:51146) 2023-12-12T09:45:02.532 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:02.531+0000 7f14a2d9d640 1 -- 172.21.15.73:0/4020286967 learned_addr learned my addr 172.21.15.73:0/4020286967 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-12T09:45:02.532 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:02.531+0000 7f14a259c640 1 --2- 172.21.15.73:0/4020286967 >> v2:172.21.15.142:3300/0 conn(0x7f14a406fca0 0x7f14a4072700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:02.533 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:02.532+0000 7f14a1d9b640 1 -- 172.21.15.73:0/4020286967 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2424290805 0 0) 0x7f14a4152560 con 0x7f14a40c17e0 2023-12-12T09:45:02.534 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:02.532+0000 7f14a1d9b640 1 -- 172.21.15.73:0/4020286967 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1490003520 con 0x7f14a40c17e0 2023-12-12T09:45:02.534 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:02.532+0000 7f14a1d9b640 1 -- 172.21.15.73:0/4020286967 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3595606000 0 0) 0x7f1490003520 con 0x7f14a40c17e0 2023-12-12T09:45:02.534 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:02.532+0000 7f14a1d9b640 1 -- 172.21.15.73:0/4020286967 >> v2:172.21.15.142:3300/0 conn(0x7f14a406fca0 msgr2=0x7f14a4072700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:45:02.534 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:02.532+0000 7f14a1d9b640 1 --2- 172.21.15.73:0/4020286967 >> v2:172.21.15.142:3300/0 conn(0x7f14a406fca0 0x7f14a4072700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:02.534 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:02.532+0000 7f14a1d9b640 1 -- 172.21.15.73:0/4020286967 >> v1:172.21.15.142:6789/0 conn(0x7f14a40c0420 legacy=0x7f14a40c10d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:02.534 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:02.532+0000 7f14a1d9b640 1 -- 172.21.15.73:0/4020286967 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14a4152800 con 0x7f14a40c17e0 2023-12-12T09:45:02.534 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:02.532+0000 7f14a1d9b640 1 -- 172.21.15.73:0/4020286967 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3186547832 0 0) 0x7f149c0019f0 con 0x7f14a40c17e0 2023-12-12T09:45:02.534 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:02.532+0000 7f14a1d9b640 1 -- 172.21.15.73:0/4020286967 >> v1:172.21.15.73:6789/0 conn(0x7f14a40c17e0 legacy=0x7f14a415ccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:02.534 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:02.532+0000 7f14a1d9b640 1 --2- 172.21.15.73:0/4020286967 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f14900039c0 0x7f1490003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:02.534 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:02.532+0000 7f14a1d9b640 1 --2- 172.21.15.73:0/4020286967 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f14900047c0 0x7f1490004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:02.534 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:02.532+0000 7f14a1d9b640 1 --2- 172.21.15.73:0/4020286967 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f14900051d0 0x7f149000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:02.534 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:02.532+0000 7f14a1d9b640 1 -- 172.21.15.73:0/4020286967 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14a4152ec0 con 0x7f14900039c0 2023-12-12T09:45:02.535 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:02.532+0000 7f14a1d9b640 1 -- 172.21.15.73:0/4020286967 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f149000c120 con 0x7f14900047c0 2023-12-12T09:45:02.535 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:02.532+0000 7f14a1d9b640 1 -- 172.21.15.73:0/4020286967 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f149000c2e0 con 0x7f14900051d0 2023-12-12T09:45:02.535 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:02.533+0000 7f14a259c640 1 --2- 172.21.15.73:0/4020286967 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f14900039c0 0x7f1490003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:02.535 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:02.533+0000 7f14a259c640 1 -- 172.21.15.73:0/4020286967 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f14900051d0 msgr2=0x7f149000b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:45:02.535 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:02.533+0000 7f14a259c640 1 --2- 172.21.15.73:0/4020286967 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f14900051d0 0x7f149000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:02.535 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:02.533+0000 7f14a259c640 1 -- 172.21.15.73:0/4020286967 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f14900047c0 msgr2=0x7f1490004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:45:02.535 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:02.533+0000 7f149bfff640 1 --2- 172.21.15.73:0/4020286967 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f14900047c0 0x7f1490004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:02.535 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:02.533+0000 7f14a259c640 1 --2- 172.21.15.73:0/4020286967 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f14900047c0 0x7f1490004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:02.535 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:02.533+0000 7f14a2d9d640 1 -- 172.21.15.73:0/4020286967 reap_dead start 2023-12-12T09:45:02.535 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:02.533+0000 7f14a259c640 1 -- 172.21.15.73:0/4020286967 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1490003520 con 0x7f14900039c0 2023-12-12T09:45:02.535 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:02.533+0000 7f149bfff640 1 --2- 172.21.15.73:0/4020286967 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f14900047c0 0x7f1490004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:45:02.537 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:02.534+0000 7f14a259c640 1 --2- 172.21.15.73:0/4020286967 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f14900039c0 0x7f1490003de0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f1494009a90 tx=0x7f14900057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7cc9bcc34e22cdf server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:45:02.537 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:02.534+0000 7f14a1d9b640 1 -- 172.21.15.73:0/4020286967 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f149402c680 con 0x7f14900039c0 2023-12-12T09:45:02.537 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:02.534+0000 7f14a1d9b640 1 -- 172.21.15.73:0/4020286967 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f149402c7e0 con 0x7f14900039c0 2023-12-12T09:45:02.537 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:02.534+0000 7f14a1d9b640 1 -- 172.21.15.73:0/4020286967 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f149402cb70 con 0x7f14900039c0 2023-12-12T09:45:02.537 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:02.535+0000 7f14a8e56640 1 -- 172.21.15.73:0/4020286967 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f14900039c0 msgr2=0x7f1490003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:02.537 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:02.535+0000 7f14a8e56640 1 --2- 172.21.15.73:0/4020286967 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f14900039c0 0x7f1490003de0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f1494009a90 tx=0x7f14900057f0 comp rx=0 tx=0).stop 2023-12-12T09:45:02.537 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:02.535+0000 7f14a8e56640 1 -- 172.21.15.73:0/4020286967 shutdown_connections 2023-12-12T09:45:02.537 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:02.535+0000 7f14a8e56640 1 --2- 172.21.15.73:0/4020286967 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f14900039c0 0x7f1490003de0 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:02.537 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:02.535+0000 7f14a8e56640 1 -- 172.21.15.73:0/4020286967 >> 172.21.15.73:0/4020286967 conn(0x7f14a40a77d0 msgr2=0x7f14a40a7bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:45:02.537 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:02.535+0000 7f14a8e56640 1 -- 172.21.15.73:0/4020286967 shutdown_connections 2023-12-12T09:45:02.538 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:02.535+0000 7f14a8e56640 1 -- 172.21.15.73:0/4020286967 wait complete. 2023-12-12T09:45:02.538 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:02.537+0000 7f14a8e56640 1 Processor -- start 2023-12-12T09:45:02.539 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:02.537+0000 7f14a8e56640 1 -- start start 2023-12-12T09:45:02.539 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:02.538+0000 7f14a8e56640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f14900039c0 0x7f14a414c280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:02.539 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:02.538+0000 7f14a8e56640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f14a40a88c0 0x7f14a41558f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:02.540 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:02.538+0000 7f14a8e56640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f14a4155e30 0x7f14a40ab5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:02.540 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:02.538+0000 7f14a8e56640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14a406d360 con 0x7f14900039c0 2023-12-12T09:45:02.540 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:02.538+0000 7f14a8e56640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14a406d570 con 0x7f14a4155e30 2023-12-12T09:45:02.540 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:02.538+0000 7f14a8e56640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14a406d850 con 0x7f14a40a88c0 2023-12-12T09:45:02.540 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:02.538+0000 7f14a259c640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f14900039c0 0x7f14a414c280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:02.540 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:02.538+0000 7f14a259c640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f14900039c0 0x7f14a414c280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:38058/0 (socket says 172.21.15.73:38058) 2023-12-12T09:45:02.540 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:02.538+0000 7f14a259c640 1 -- 172.21.15.73:0/2038529033 learned_addr learned my addr 172.21.15.73:0/2038529033 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:45:02.540 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:02.539+0000 7f14a259c640 1 -- 172.21.15.73:0/2038529033 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f14a40a88c0 msgr2=0x7f14a41558f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:02.540 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:02.539+0000 7f14a259c640 1 --2- 172.21.15.73:0/2038529033 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f14a40a88c0 0x7f14a41558f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:02.540 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:02.539+0000 7f14a259c640 1 -- 172.21.15.73:0/2038529033 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f14a4155e30 msgr2=0x7f14a40ab5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:02.540 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:02.539+0000 7f14a259c640 1 --2- 172.21.15.73:0/2038529033 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f14a4155e30 0x7f14a40ab5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:02.540 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:02.539+0000 7f14a259c640 1 -- 172.21.15.73:0/2038529033 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14a406c3a0 con 0x7f14900039c0 2023-12-12T09:45:02.541 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:02.539+0000 7f14a259c640 1 --2- 172.21.15.73:0/2038529033 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f14900039c0 0x7f14a414c280 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f149402c220 tx=0x7f1494004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:45:02.541 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:02.539+0000 7f149affd640 1 -- 172.21.15.73:0/2038529033 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1494003810 con 0x7f14900039c0 2023-12-12T09:45:02.541 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:02.539+0000 7f149affd640 1 -- 172.21.15.73:0/2038529033 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1494003970 con 0x7f14900039c0 2023-12-12T09:45:02.541 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:02.539+0000 7f149affd640 1 -- 172.21.15.73:0/2038529033 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1494003d00 con 0x7f14900039c0 2023-12-12T09:45:02.541 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:02.539+0000 7f14a8e56640 1 -- 172.21.15.73:0/2038529033 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14a406c680 con 0x7f14900039c0 2023-12-12T09:45:02.541 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:02.539+0000 7f14a8e56640 1 -- 172.21.15.73:0/2038529033 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14a414c7c0 con 0x7f14900039c0 2023-12-12T09:45:02.541 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:02.541+0000 7f14a8e56640 1 -- 172.21.15.73:0/2038529033 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f14a4067580 con 0x7f14900039c0 2023-12-12T09:45:02.542 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:02.542+0000 7f149affd640 1 -- 172.21.15.73:0/2038529033 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f1494034440 con 0x7f14900039c0 2023-12-12T09:45:02.542 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:02.542+0000 7f149affd640 1 --2- 172.21.15.73:0/2038529033 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f148406ae40 0x7f148406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:02.542 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:02.542+0000 7f149affd640 1 -- 172.21.15.73:0/2038529033 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f14940ab910 con 0x7f14900039c0 2023-12-12T09:45:02.543 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:02.543+0000 7f149bfff640 1 --2- 172.21.15.73:0/2038529033 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f148406ae40 0x7f148406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:02.543 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:02.543+0000 7f149bfff640 1 --2- 172.21.15.73:0/2038529033 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f148406ae40 0x7f148406d300 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f148c007fd0 tx=0x7f148c009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:45:02.547 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:02.547+0000 7f149affd640 1 -- 172.21.15.73:0/2038529033 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f14940768c0 con 0x7f14900039c0 2023-12-12T09:45:02.776 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:02.776+0000 7f14a8e56640 1 -- 172.21.15.73:0/2038529033 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f14a406d990 con 0x7f14900039c0 2023-12-12T09:45:02.777 INFO:tasks.ceph.mon.a.smithi073.stderr:2023-12-12T09:45:02.776+0000 7f81027f3640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-12-12T09:45:02.780 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:02.780+0000 7f149affd640 1 -- 172.21.15.73:0/2038529033 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v20) v1 ==== 161+0+0 (secure 0 0 0) 0x7f14a406d990 con 0x7f14900039c0 2023-12-12T09:45:02.780 INFO:teuthology.orchestra.run.smithi073.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-12-12T09:45:02.784 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:02.784+0000 7f14a8e56640 1 -- 172.21.15.73:0/2038529033 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f148406ae40 msgr2=0x7f148406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:02.784 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:02.784+0000 7f14a8e56640 1 --2- 172.21.15.73:0/2038529033 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f148406ae40 0x7f148406d300 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f148c007fd0 tx=0x7f148c009040 comp rx=0 tx=0).stop 2023-12-12T09:45:02.784 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:02.784+0000 7f14a8e56640 1 -- 172.21.15.73:0/2038529033 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f14900039c0 msgr2=0x7f14a414c280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:02.784 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:02.784+0000 7f14a8e56640 1 --2- 172.21.15.73:0/2038529033 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f14900039c0 0x7f14a414c280 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f149402c220 tx=0x7f1494004730 comp rx=0 tx=0).stop 2023-12-12T09:45:02.784 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:02.784+0000 7f14a8e56640 1 -- 172.21.15.73:0/2038529033 shutdown_connections 2023-12-12T09:45:02.785 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:02.784+0000 7f14a8e56640 1 --2- 172.21.15.73:0/2038529033 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f148406ae40 0x7f148406d300 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:02.785 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:02.784+0000 7f14a8e56640 1 --2- 172.21.15.73:0/2038529033 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f14a4155e30 0x7f14a40ab5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:02.785 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:02.784+0000 7f14a8e56640 1 --2- 172.21.15.73:0/2038529033 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f14a40a88c0 0x7f14a41558f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:02.785 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:02.784+0000 7f14a8e56640 1 --2- 172.21.15.73:0/2038529033 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f14900039c0 0x7f14a414c280 secure :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f149402c220 tx=0x7f1494004730 comp rx=0 tx=0).stop 2023-12-12T09:45:02.785 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:02.784+0000 7f14a8e56640 1 -- 172.21.15.73:0/2038529033 >> 172.21.15.73:0/2038529033 conn(0x7f14a40a77d0 msgr2=0x7f14a40a6960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:45:02.785 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:02.785+0000 7f14a8e56640 1 -- 172.21.15.73:0/2038529033 shutdown_connections 2023-12-12T09:45:02.785 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:02.785+0000 7f14a8e56640 1 -- 172.21.15.73:0/2038529033 wait complete. 2023-12-12T09:45:02.790 INFO:tasks.ceph.mds.c.smithi073.stderr: -3091> 2023-12-12T09:44:22.418+0000 7fd3b2a6e640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-12-12T09:45:02.803 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-12-12T09:45:02.841 INFO:tasks.ceph.mds.c.smithi073.stdout:starting mds.c at 2023-12-12T09:45:02.987 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:02.986+0000 7fb7279d7640 1 Processor -- start 2023-12-12T09:45:02.987 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:02.986+0000 7fb7279d7640 1 -- start start 2023-12-12T09:45:02.988 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:02.988+0000 7fb7279d7640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fb7200c23b0 0x7fb7200c0320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:02.988 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:02.988+0000 7fb7279d7640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7200c1520 con 0x7fb72006cc90 2023-12-12T09:45:02.988 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:02.988+0000 7fb7279d7640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7200c2c20 con 0x7fb7200c2790 2023-12-12T09:45:02.988 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:02.988+0000 7fb7279d7640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7200c46f0 con 0x7fb7200c23b0 2023-12-12T09:45:02.988 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:02.988+0000 7fb724f72640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7fb72006cc90 0x7fb720159410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:51160/0 (socket says 172.21.15.73:51160) 2023-12-12T09:45:02.989 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:02.988+0000 7fb724f72640 1 -- 172.21.15.73:0/1808004133 learned_addr learned my addr 172.21.15.73:0/1808004133 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-12T09:45:02.990 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:02.989+0000 7fb725773640 1 --2- 172.21.15.73:0/1808004133 >> v2:172.21.15.142:3300/0 conn(0x7fb7200c23b0 0x7fb7200c0320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:02.991 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:02.989+0000 7fb717fff640 1 -- 172.21.15.73:0/1808004133 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2825736859 0 0) 0x7fb710001110 con 0x7fb72006cc90 2023-12-12T09:45:02.991 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:02.989+0000 7fb717fff640 1 -- 172.21.15.73:0/1808004133 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb70c003520 con 0x7fb72006cc90 2023-12-12T09:45:02.991 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:02.989+0000 7fb717fff640 1 -- 172.21.15.73:0/1808004133 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3719944298 0 0) 0x7fb70c003520 con 0x7fb72006cc90 2023-12-12T09:45:02.991 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:02.989+0000 7fb717fff640 1 -- 172.21.15.73:0/1808004133 >> v2:172.21.15.142:3300/0 conn(0x7fb7200c23b0 msgr2=0x7fb7200c0320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:45:02.991 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:02.989+0000 7fb717fff640 1 --2- 172.21.15.73:0/1808004133 >> v2:172.21.15.142:3300/0 conn(0x7fb7200c23b0 0x7fb7200c0320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:02.991 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:02.989+0000 7fb717fff640 1 -- 172.21.15.73:0/1808004133 >> v1:172.21.15.142:6789/0 conn(0x7fb7200c2790 legacy=0x7fb7200c50d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:02.991 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:02.989+0000 7fb717fff640 1 -- 172.21.15.73:0/1808004133 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb72006d0d0 con 0x7fb72006cc90 2023-12-12T09:45:02.991 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:02.989+0000 7fb717fff640 1 -- 172.21.15.73:0/1808004133 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3186547832 0 0) 0x7fb710001800 con 0x7fb72006cc90 2023-12-12T09:45:02.991 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:02.989+0000 7fb717fff640 1 -- 172.21.15.73:0/1808004133 >> v1:172.21.15.73:6789/0 conn(0x7fb72006cc90 legacy=0x7fb720159410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:02.991 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:02.989+0000 7fb717fff640 1 --2- 172.21.15.73:0/1808004133 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb70c003970 0x7fb70c003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:02.991 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:02.989+0000 7fb717fff640 1 --2- 172.21.15.73:0/1808004133 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb70c0047c0 0x7fb70c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:02.991 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:02.989+0000 7fb717fff640 1 --2- 172.21.15.73:0/1808004133 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb70c0052a0 0x7fb70c00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:02.991 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:02.989+0000 7fb717fff640 1 -- 172.21.15.73:0/1808004133 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7200c46f0 con 0x7fb70c003970 2023-12-12T09:45:02.992 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:02.989+0000 7fb717fff640 1 -- 172.21.15.73:0/1808004133 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb70c00c170 con 0x7fb70c0052a0 2023-12-12T09:45:02.992 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:02.989+0000 7fb717fff640 1 -- 172.21.15.73:0/1808004133 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb70c00c330 con 0x7fb70c0047c0 2023-12-12T09:45:02.992 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:02.990+0000 7fb725773640 1 --2- 172.21.15.73:0/1808004133 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb70c003970 0x7fb70c003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:02.992 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:02.990+0000 7fb725773640 1 -- 172.21.15.73:0/1808004133 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb70c0047c0 msgr2=0x7fb70c004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:45:02.992 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:02.990+0000 7fb725773640 1 --2- 172.21.15.73:0/1808004133 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb70c0047c0 0x7fb70c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:02.992 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:02.990+0000 7fb725773640 1 -- 172.21.15.73:0/1808004133 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb70c0052a0 msgr2=0x7fb70c00b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:45:02.992 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:02.990+0000 7fb725773640 1 --2- 172.21.15.73:0/1808004133 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb70c0052a0 0x7fb70c00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:02.992 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:02.990+0000 7fb725773640 1 -- 172.21.15.73:0/1808004133 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb70c003520 con 0x7fb70c003970 2023-12-12T09:45:02.992 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:02.990+0000 7fb725f74640 1 -- 172.21.15.73:0/1808004133 reap_dead start 2023-12-12T09:45:02.993 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:02.991+0000 7fb725773640 1 --2- 172.21.15.73:0/1808004133 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb70c003970 0x7fb70c003d90 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7fb71c009a90 tx=0x7fb70c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7b45dc786238f81 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:45:02.993 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:02.991+0000 7fb717fff640 1 -- 172.21.15.73:0/1808004133 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb71c02c6b0 con 0x7fb70c003970 2023-12-12T09:45:02.993 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:02.991+0000 7fb717fff640 1 -- 172.21.15.73:0/1808004133 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb71c02c810 con 0x7fb70c003970 2023-12-12T09:45:02.993 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:02.991+0000 7fb717fff640 1 -- 172.21.15.73:0/1808004133 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb71c02cba0 con 0x7fb70c003970 2023-12-12T09:45:02.994 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:02.992+0000 7fb7279d7640 1 -- 172.21.15.73:0/1808004133 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb70c003970 msgr2=0x7fb70c003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:02.994 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:02.992+0000 7fb7279d7640 1 --2- 172.21.15.73:0/1808004133 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb70c003970 0x7fb70c003d90 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7fb71c009a90 tx=0x7fb70c0057f0 comp rx=0 tx=0).stop 2023-12-12T09:45:02.994 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:02.992+0000 7fb7279d7640 1 -- 172.21.15.73:0/1808004133 shutdown_connections 2023-12-12T09:45:02.994 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:02.992+0000 7fb7279d7640 1 --2- 172.21.15.73:0/1808004133 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb70c003970 0x7fb70c003d90 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:02.994 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:02.992+0000 7fb7279d7640 1 -- 172.21.15.73:0/1808004133 >> 172.21.15.73:0/1808004133 conn(0x7fb72006a4e0 msgr2=0x7fb72006a8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:45:02.994 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:02.992+0000 7fb7279d7640 1 -- 172.21.15.73:0/1808004133 shutdown_connections 2023-12-12T09:45:02.994 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:02.992+0000 7fb7279d7640 1 -- 172.21.15.73:0/1808004133 wait complete. 2023-12-12T09:45:02.995 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:02.994+0000 7fb7279d7640 1 Processor -- start 2023-12-12T09:45:02.996 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:02.994+0000 7fb7279d7640 1 -- start start 2023-12-12T09:45:02.996 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:02.995+0000 7fb7279d7640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb70c003970 0x7fb7200ab290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:02.996 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:02.995+0000 7fb7279d7640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb7201e5500 0x7fb7201e5980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:02.996 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:02.995+0000 7fb7279d7640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb72014ed40 0x7fb72014f1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:02.996 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:02.995+0000 7fb7279d7640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7201f27f0 con 0x7fb7201e5500 2023-12-12T09:45:02.996 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:02.995+0000 7fb7279d7640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7201f1be0 con 0x7fb70c003970 2023-12-12T09:45:02.996 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:02.995+0000 7fb7279d7640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7201f1ec0 con 0x7fb72014ed40 2023-12-12T09:45:02.996 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:02.995+0000 7fb724f72640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb7201e5500 0x7fb7201e5980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:02.996 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:02.995+0000 7fb724f72640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb7201e5500 0x7fb7201e5980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:38094/0 (socket says 172.21.15.73:38094) 2023-12-12T09:45:02.996 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:02.995+0000 7fb724f72640 1 -- 172.21.15.73:0/239094121 learned_addr learned my addr 172.21.15.73:0/239094121 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:45:02.996 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:02.995+0000 7fb724f72640 1 -- 172.21.15.73:0/239094121 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb72014ed40 msgr2=0x7fb72014f1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:02.996 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:02.995+0000 7fb724f72640 1 --2- 172.21.15.73:0/239094121 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb72014ed40 0x7fb72014f1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:02.996 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:02.995+0000 7fb724f72640 1 -- 172.21.15.73:0/239094121 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb70c003970 msgr2=0x7fb7200ab290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:02.996 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:02.995+0000 7fb724f72640 1 --2- 172.21.15.73:0/239094121 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb70c003970 0x7fb7200ab290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:02.997 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:02.995+0000 7fb724f72640 1 -- 172.21.15.73:0/239094121 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7201f21a0 con 0x7fb7201e5500 2023-12-12T09:45:02.997 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:02.996+0000 7fb724f72640 1 --2- 172.21.15.73:0/239094121 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb7201e5500 0x7fb7201e5980 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7fb71000c730 tx=0x7fb71000cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:45:02.998 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:02.996+0000 7fb715ffb640 1 -- 172.21.15.73:0/239094121 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7100072d0 con 0x7fb7201e5500 2023-12-12T09:45:02.998 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:02.996+0000 7fb715ffb640 1 -- 172.21.15.73:0/239094121 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb710007450 con 0x7fb7201e5500 2023-12-12T09:45:02.999 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:02.996+0000 7fb715ffb640 1 -- 172.21.15.73:0/239094121 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7100047e0 con 0x7fb7201e5500 2023-12-12T09:45:02.999 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:02.996+0000 7fb7279d7640 1 -- 172.21.15.73:0/239094121 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7201f2480 con 0x7fb7201e5500 2023-12-12T09:45:02.999 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:02.996+0000 7fb7279d7640 1 -- 172.21.15.73:0/239094121 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb72015c480 con 0x7fb7201e5500 2023-12-12T09:45:02.999 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:02.997+0000 7fb7279d7640 1 -- 172.21.15.73:0/239094121 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb720067070 con 0x7fb7201e5500 2023-12-12T09:45:02.999 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:02.998+0000 7fb715ffb640 1 -- 172.21.15.73:0/239094121 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fb710004b70 con 0x7fb7201e5500 2023-12-12T09:45:03.000 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:02.999+0000 7fb715ffb640 1 --2- 172.21.15.73:0/239094121 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fb70406ae70 0x7fb70406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:03.000 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:02.999+0000 7fb715ffb640 1 -- 172.21.15.73:0/239094121 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6651+0+0 (secure 0 0 0) 0x7fb710088e20 con 0x7fb7201e5500 2023-12-12T09:45:03.000 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:02.999+0000 7fb725773640 1 --2- 172.21.15.73:0/239094121 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fb70406ae70 0x7fb70406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:03.000 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:03.000+0000 7fb725773640 1 --2- 172.21.15.73:0/239094121 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fb70406ae70 0x7fb70406d330 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fb71c036000 tx=0x7fb71c02e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:45:03.003 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:03.003+0000 7fb715ffb640 1 -- 172.21.15.73:0/239094121 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fb710053a90 con 0x7fb7201e5500 2023-12-12T09:45:03.226 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:03.226+0000 7fb7279d7640 1 -- 172.21.15.73:0/239094121 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fb7200c1520 con 0x7fb7201e5500 2023-12-12T09:45:03.784 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:03.784+0000 7fb715ffb640 1 -- 172.21.15.73:0/239094121 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v21) v1 ==== 104+0+0 (secure 0 0 0) 0x7fb7200c1520 con 0x7fb7201e5500 2023-12-12T09:45:03.790 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:03.787+0000 7fb7279d7640 1 -- 172.21.15.73:0/239094121 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fb70406ae70 msgr2=0x7fb70406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:03.790 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:03.787+0000 7fb7279d7640 1 --2- 172.21.15.73:0/239094121 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fb70406ae70 0x7fb70406d330 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fb71c036000 tx=0x7fb71c02e000 comp rx=0 tx=0).stop 2023-12-12T09:45:03.790 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:03.787+0000 7fb7279d7640 1 -- 172.21.15.73:0/239094121 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb7201e5500 msgr2=0x7fb7201e5980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:03.791 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:03.787+0000 7fb7279d7640 1 --2- 172.21.15.73:0/239094121 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb7201e5500 0x7fb7201e5980 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7fb71000c730 tx=0x7fb71000cbf0 comp rx=0 tx=0).stop 2023-12-12T09:45:03.791 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:03.787+0000 7fb7279d7640 1 -- 172.21.15.73:0/239094121 shutdown_connections 2023-12-12T09:45:03.791 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:03.787+0000 7fb7279d7640 1 --2- 172.21.15.73:0/239094121 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fb70406ae70 0x7fb70406d330 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:03.791 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:03.787+0000 7fb7279d7640 1 --2- 172.21.15.73:0/239094121 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb72014ed40 0x7fb72014f1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:03.791 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:03.787+0000 7fb7279d7640 1 --2- 172.21.15.73:0/239094121 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb7201e5500 0x7fb7201e5980 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:03.791 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:03.787+0000 7fb7279d7640 1 --2- 172.21.15.73:0/239094121 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb70c003970 0x7fb7200ab290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:03.791 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:03.787+0000 7fb7279d7640 1 -- 172.21.15.73:0/239094121 >> 172.21.15.73:0/239094121 conn(0x7fb72006a4e0 msgr2=0x7fb7201564c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:45:03.791 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:03.788+0000 7fb7279d7640 1 -- 172.21.15.73:0/239094121 shutdown_connections 2023-12-12T09:45:03.791 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:03.788+0000 7fb7279d7640 1 -- 172.21.15.73:0/239094121 wait complete. 2023-12-12T09:45:03.808 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-12-12T09:45:04.066 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:04.066+0000 7f16ccc56640 1 Processor -- start 2023-12-12T09:45:04.067 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:04.066+0000 7f16ccc56640 1 -- start start 2023-12-12T09:45:04.068 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:04.067+0000 7f16ccc56640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f16c814f8c0 0x7f16c806dc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:04.068 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:04.068+0000 7f16ccc56640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f16c8152500 0x7f16c8152990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:04.068 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:04.068+0000 7f16ccc56640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16c80c16c0 con 0x7f16c806d350 2023-12-12T09:45:04.068 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:04.068+0000 7f16ccc56640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16c80c1090 con 0x7f16c814f8c0 2023-12-12T09:45:04.068 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:04.068+0000 7f16ccc56640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16c80c14b0 con 0x7f16c8152500 2023-12-12T09:45:04.068 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:04.068+0000 7f16bffff640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f16c806d350 0x7f16c8071e60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:51166/0 (socket says 172.21.15.73:51166) 2023-12-12T09:45:04.068 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:04.068+0000 7f16bffff640 1 -- 172.21.15.73:0/3925116800 learned_addr learned my addr 172.21.15.73:0/3925116800 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-12T09:45:04.069 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:04.068+0000 7f16c659c640 1 --2- 172.21.15.73:0/3925116800 >> v2:172.21.15.73:3300/0 conn(0x7f16c814f8c0 0x7f16c806dc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:04.069 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:04.068+0000 7f16c5d9b640 1 -- 172.21.15.73:0/3925116800 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 251997019 0 0) 0x7f16c80c16c0 con 0x7f16c806d350 2023-12-12T09:45:04.069 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:04.068+0000 7f16c6d9d640 1 --2- 172.21.15.73:0/3925116800 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f16c8152500 0x7f16c8152990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:04.069 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:04.068+0000 7f16c5d9b640 1 -- 172.21.15.73:0/3925116800 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f16b4003520 con 0x7f16c806d350 2023-12-12T09:45:04.070 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:04.069+0000 7f16c659c640 1 -- 172.21.15.73:0/3925116800 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f16c8152500 msgr2=0x7f16c8152990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:45:04.070 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:04.069+0000 7f16c659c640 1 --2- 172.21.15.73:0/3925116800 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f16c8152500 0x7f16c8152990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:04.070 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:04.069+0000 7f16c659c640 1 -- 172.21.15.73:0/3925116800 >> v1:172.21.15.73:6789/0 conn(0x7f16c806d350 legacy=0x7f16c8071e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:04.070 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:04.069+0000 7f16c659c640 1 -- 172.21.15.73:0/3925116800 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16c80c19a0 con 0x7f16c814f8c0 2023-12-12T09:45:04.070 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:04.070+0000 7f16c659c640 1 --2- 172.21.15.73:0/3925116800 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f16c814f8c0 0x7f16c806dc40 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f16b80097a0 tx=0x7f16b802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96ae2b61ae8e166f server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:45:04.072 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:04.071+0000 7f16c5d9b640 1 -- 172.21.15.73:0/3925116800 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16b8031830 con 0x7f16c814f8c0 2023-12-12T09:45:04.072 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:04.071+0000 7f16c5d9b640 1 -- 172.21.15.73:0/3925116800 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16b8031990 con 0x7f16c814f8c0 2023-12-12T09:45:04.072 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:04.071+0000 7f16c5d9b640 1 -- 172.21.15.73:0/3925116800 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16b8031d20 con 0x7f16c814f8c0 2023-12-12T09:45:04.072 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:04.071+0000 7f16ccc56640 1 -- 172.21.15.73:0/3925116800 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f16c814f8c0 msgr2=0x7f16c806dc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:04.072 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:04.071+0000 7f16ccc56640 1 --2- 172.21.15.73:0/3925116800 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f16c814f8c0 0x7f16c806dc40 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f16b80097a0 tx=0x7f16b802b8d0 comp rx=0 tx=0).stop 2023-12-12T09:45:04.072 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:04.071+0000 7f16ccc56640 1 -- 172.21.15.73:0/3925116800 shutdown_connections 2023-12-12T09:45:04.072 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:04.071+0000 7f16ccc56640 1 --2- 172.21.15.73:0/3925116800 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f16c8152500 0x7f16c8152990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:04.072 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:04.071+0000 7f16ccc56640 1 --2- 172.21.15.73:0/3925116800 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f16c814f8c0 0x7f16c806dc40 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:04.072 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:04.071+0000 7f16ccc56640 1 -- 172.21.15.73:0/3925116800 >> 172.21.15.73:0/3925116800 conn(0x7f16c806a4e0 msgr2=0x7f16c806a8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:45:04.072 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:04.072+0000 7f16ccc56640 1 -- 172.21.15.73:0/3925116800 shutdown_connections 2023-12-12T09:45:04.072 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:04.072+0000 7f16ccc56640 1 -- 172.21.15.73:0/3925116800 wait complete. 2023-12-12T09:45:04.073 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:04.073+0000 7f16ccc56640 1 Processor -- start 2023-12-12T09:45:04.073 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:04.073+0000 7f16ccc56640 1 -- start start 2023-12-12T09:45:04.075 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:04.074+0000 7f16ccc56640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f16c806d350 0x7f16c81eae80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:04.075 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:04.074+0000 7f16ccc56640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f16c814f8c0 0x7f16c81512f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:04.075 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:04.074+0000 7f16ccc56640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f16c8152500 0x7f16c81e80f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:04.075 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:04.074+0000 7f16ccc56640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16c81e7910 con 0x7f16c806d350 2023-12-12T09:45:04.075 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:04.074+0000 7f16ccc56640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16c80a9900 con 0x7f16c8152500 2023-12-12T09:45:04.075 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:04.074+0000 7f16ccc56640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16c80a9be0 con 0x7f16c814f8c0 2023-12-12T09:45:04.075 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:04.074+0000 7f16c659c640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f16c806d350 0x7f16c81eae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:04.075 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:04.074+0000 7f16c659c640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f16c806d350 0x7f16c81eae80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:38106/0 (socket says 172.21.15.73:38106) 2023-12-12T09:45:04.076 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:04.074+0000 7f16c659c640 1 -- 172.21.15.73:0/4258584551 learned_addr learned my addr 172.21.15.73:0/4258584551 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:45:04.076 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:04.075+0000 7f16bffff640 1 --2- 172.21.15.73:0/4258584551 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f16c814f8c0 0x7f16c81512f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:04.076 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:04.075+0000 7f16c659c640 1 -- 172.21.15.73:0/4258584551 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f16c814f8c0 msgr2=0x7f16c81512f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:04.076 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:04.075+0000 7f16c659c640 1 --2- 172.21.15.73:0/4258584551 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f16c814f8c0 0x7f16c81512f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:04.076 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:04.075+0000 7f16c659c640 1 -- 172.21.15.73:0/4258584551 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f16c8152500 msgr2=0x7f16c81e80f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:04.076 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:04.075+0000 7f16c659c640 1 --2- 172.21.15.73:0/4258584551 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f16c8152500 0x7f16c81e80f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:04.076 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:04.075+0000 7f16c659c640 1 -- 172.21.15.73:0/4258584551 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16b8009400 con 0x7f16c806d350 2023-12-12T09:45:04.076 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:04.075+0000 7f16bffff640 1 --2- 172.21.15.73:0/4258584551 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f16c814f8c0 0x7f16c81512f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:45:04.077 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:04.075+0000 7f16c659c640 1 --2- 172.21.15.73:0/4258584551 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f16c806d350 0x7f16c81eae80 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f16b802bee0 tx=0x7f16b80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:45:04.077 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:04.075+0000 7f16beffd640 1 -- 172.21.15.73:0/4258584551 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16b803a6f0 con 0x7f16c806d350 2023-12-12T09:45:04.077 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:04.076+0000 7f16beffd640 1 -- 172.21.15.73:0/4258584551 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16b803a870 con 0x7f16c806d350 2023-12-12T09:45:04.077 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:04.076+0000 7f16ccc56640 1 -- 172.21.15.73:0/4258584551 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16c80a9ec0 con 0x7f16c806d350 2023-12-12T09:45:04.077 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:04.076+0000 7f16beffd640 1 -- 172.21.15.73:0/4258584551 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16b803ac20 con 0x7f16c806d350 2023-12-12T09:45:04.077 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:04.076+0000 7f16ccc56640 1 -- 172.21.15.73:0/4258584551 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16c8151830 con 0x7f16c806d350 2023-12-12T09:45:04.077 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:04.077+0000 7f16ccc56640 1 -- 172.21.15.73:0/4258584551 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f16c8067070 con 0x7f16c806d350 2023-12-12T09:45:04.078 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:04.077+0000 7f16beffd640 1 -- 172.21.15.73:0/4258584551 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f16b804c3b0 con 0x7f16c806d350 2023-12-12T09:45:04.078 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:04.078+0000 7f16beffd640 1 --2- 172.21.15.73:0/4258584551 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f16a806ae40 0x7f16a806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:04.078 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:04.078+0000 7f16beffd640 1 -- 172.21.15.73:0/4258584551 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6651+0+0 (secure 0 0 0) 0x7f16b80ab610 con 0x7f16c806d350 2023-12-12T09:45:04.079 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:04.079+0000 7f16bffff640 1 --2- 172.21.15.73:0/4258584551 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f16a806ae40 0x7f16a806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:04.079 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:04.079+0000 7f16bffff640 1 --2- 172.21.15.73:0/4258584551 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f16a806ae40 0x7f16a806d300 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f16c814af90 tx=0x7f16b0009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:45:04.083 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:04.083+0000 7f16beffd640 1 -- 172.21.15.73:0/4258584551 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f16b8076420 con 0x7f16c806d350 2023-12-12T09:45:04.273 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:04.271+0000 7f16ccc56640 1 -- 172.21.15.73:0/4258584551 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f16c8067580 con 0x7f16c806d350 2023-12-12T09:45:04.799 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:04.797+0000 7f16beffd640 1 -- 172.21.15.73:0/4258584551 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v40) v1 ==== 181+0+0 (secure 0 0 0) 0x7f16b8079a40 con 0x7f16c806d350 2023-12-12T09:45:04.799 INFO:teuthology.orchestra.run.smithi073.stderr:pool 'cephfs_metadata' removed 2023-12-12T09:45:04.803 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:04.801+0000 7f16ccc56640 1 -- 172.21.15.73:0/4258584551 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f16a806ae40 msgr2=0x7f16a806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:04.803 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:04.801+0000 7f16ccc56640 1 --2- 172.21.15.73:0/4258584551 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f16a806ae40 0x7f16a806d300 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f16c814af90 tx=0x7f16b0009040 comp rx=0 tx=0).stop 2023-12-12T09:45:04.803 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:04.801+0000 7f16ccc56640 1 -- 172.21.15.73:0/4258584551 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f16c806d350 msgr2=0x7f16c81eae80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:04.803 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:04.801+0000 7f16ccc56640 1 --2- 172.21.15.73:0/4258584551 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f16c806d350 0x7f16c81eae80 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f16b802bee0 tx=0x7f16b80046c0 comp rx=0 tx=0).stop 2023-12-12T09:45:04.803 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:04.801+0000 7f16ccc56640 1 -- 172.21.15.73:0/4258584551 shutdown_connections 2023-12-12T09:45:04.803 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:04.801+0000 7f16ccc56640 1 --2- 172.21.15.73:0/4258584551 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f16a806ae40 0x7f16a806d300 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:04.803 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:04.801+0000 7f16ccc56640 1 --2- 172.21.15.73:0/4258584551 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f16c8152500 0x7f16c81e80f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:04.803 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:04.801+0000 7f16ccc56640 1 --2- 172.21.15.73:0/4258584551 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f16c814f8c0 0x7f16c81512f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:04.803 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:04.801+0000 7f16ccc56640 1 --2- 172.21.15.73:0/4258584551 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f16c806d350 0x7f16c81eae80 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:04.803 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:04.801+0000 7f16ccc56640 1 -- 172.21.15.73:0/4258584551 >> 172.21.15.73:0/4258584551 conn(0x7f16c806a4e0 msgr2=0x7f16c80bfa20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:45:04.803 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:04.802+0000 7f16ccc56640 1 -- 172.21.15.73:0/4258584551 shutdown_connections 2023-12-12T09:45:04.803 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:04.802+0000 7f16ccc56640 1 -- 172.21.15.73:0/4258584551 wait complete. 2023-12-12T09:45:04.828 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-12-12T09:45:05.049 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:05.047+0000 7f271b98e640 1 Processor -- start 2023-12-12T09:45:05.049 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:05.047+0000 7f271b98e640 1 -- start start 2023-12-12T09:45:05.050 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:05.049+0000 7f271b98e640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f271414f8c0 0x7f271406dc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:05.050 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:05.049+0000 7f271b98e640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f271406d350 0x7f2714071e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:05.050 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:05.049+0000 7f271b98e640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f27140723a0 0x7f2714152500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:05.050 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:05.049+0000 7f271b98e640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27140c1090 con 0x7f271414f8c0 2023-12-12T09:45:05.050 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:05.049+0000 7f271b98e640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27140c14b0 con 0x7f271406d350 2023-12-12T09:45:05.051 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:05.049+0000 7f271b98e640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27140c16c0 con 0x7f27140723a0 2023-12-12T09:45:05.051 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:05.049+0000 7f271972a640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f271414f8c0 0x7f271406dc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:05.051 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:05.049+0000 7f271972a640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f271414f8c0 0x7f271406dc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:38122/0 (socket says 172.21.15.73:38122) 2023-12-12T09:45:05.051 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:05.049+0000 7f271972a640 1 -- 172.21.15.73:0/3842962004 learned_addr learned my addr 172.21.15.73:0/3842962004 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:45:05.051 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:05.050+0000 7f2718f29640 1 --2- 172.21.15.73:0/3842962004 >> v2:172.21.15.142:3300/0 conn(0x7f271406d350 0x7f2714071e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:05.052 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:05.050+0000 7f2719f2b640 1 --2- 172.21.15.73:0/3842962004 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f27140723a0 0x7f2714152500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:05.052 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:05.050+0000 7f271972a640 1 -- 172.21.15.73:0/3842962004 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f27140723a0 msgr2=0x7f2714152500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:45:05.052 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:05.050+0000 7f271972a640 1 --2- 172.21.15.73:0/3842962004 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f27140723a0 0x7f2714152500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:05.052 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:05.050+0000 7f271972a640 1 -- 172.21.15.73:0/3842962004 >> v2:172.21.15.142:3300/0 conn(0x7f271406d350 msgr2=0x7f2714071e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:45:05.052 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:05.050+0000 7f271972a640 1 --2- 172.21.15.73:0/3842962004 >> v2:172.21.15.142:3300/0 conn(0x7f271406d350 0x7f2714071e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:05.052 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:05.050+0000 7f271972a640 1 -- 172.21.15.73:0/3842962004 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27140c19a0 con 0x7f271414f8c0 2023-12-12T09:45:05.052 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:05.050+0000 7f2718f29640 1 --2- 172.21.15.73:0/3842962004 >> v2:172.21.15.142:3300/0 conn(0x7f271406d350 0x7f2714071e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:45:05.053 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:05.051+0000 7f271972a640 1 --2- 172.21.15.73:0/3842962004 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f271414f8c0 0x7f271406dc40 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f27140c3430 tx=0x7f270802bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa87b5e95d54e51d server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:45:05.053 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:05.051+0000 7f2713fff640 1 -- 172.21.15.73:0/3842962004 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f270802ca70 con 0x7f271414f8c0 2023-12-12T09:45:05.053 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:05.051+0000 7f2713fff640 1 -- 172.21.15.73:0/3842962004 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f270802cbd0 con 0x7f271414f8c0 2023-12-12T09:45:05.053 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:05.051+0000 7f2713fff640 1 -- 172.21.15.73:0/3842962004 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27080343f0 con 0x7f271414f8c0 2023-12-12T09:45:05.054 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:05.052+0000 7f271b98e640 1 -- 172.21.15.73:0/3842962004 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f271414f8c0 msgr2=0x7f271406dc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:05.054 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:05.052+0000 7f271b98e640 1 --2- 172.21.15.73:0/3842962004 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f271414f8c0 0x7f271406dc40 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f27140c3430 tx=0x7f270802bed0 comp rx=0 tx=0).stop 2023-12-12T09:45:05.054 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:05.052+0000 7f271b98e640 1 -- 172.21.15.73:0/3842962004 shutdown_connections 2023-12-12T09:45:05.054 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:05.052+0000 7f271b98e640 1 --2- 172.21.15.73:0/3842962004 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f27140723a0 0x7f2714152500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:05.054 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:05.052+0000 7f271b98e640 1 --2- 172.21.15.73:0/3842962004 >> v2:172.21.15.142:3300/0 conn(0x7f271406d350 0x7f2714071e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:05.054 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:05.052+0000 7f271b98e640 1 --2- 172.21.15.73:0/3842962004 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f271414f8c0 0x7f271406dc40 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:05.054 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:05.052+0000 7f271b98e640 1 -- 172.21.15.73:0/3842962004 >> 172.21.15.73:0/3842962004 conn(0x7f271406a4e0 msgr2=0x7f271406a8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:45:05.054 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:05.052+0000 7f271b98e640 1 -- 172.21.15.73:0/3842962004 shutdown_connections 2023-12-12T09:45:05.054 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:05.052+0000 7f271b98e640 1 -- 172.21.15.73:0/3842962004 wait complete. 2023-12-12T09:45:05.055 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:05.054+0000 7f271b98e640 1 Processor -- start 2023-12-12T09:45:05.055 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:05.054+0000 7f271b98e640 1 -- start start 2023-12-12T09:45:05.056 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:05.055+0000 7f271b98e640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f271406d350 0x7f27141537c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:05.057 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:05.055+0000 7f271b98e640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f27140723a0 0x7f2714144b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:05.057 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:05.055+0000 7f271b98e640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f271414f8c0 0x7f2714145070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:05.057 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:05.055+0000 7f271b98e640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2714151700 con 0x7f271406d350 2023-12-12T09:45:05.057 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:05.055+0000 7f271b98e640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2714150200 con 0x7f27140723a0 2023-12-12T09:45:05.057 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:05.055+0000 7f271b98e640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27141455b0 con 0x7f271414f8c0 2023-12-12T09:45:05.057 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:05.055+0000 7f271972a640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f271406d350 0x7f27141537c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:05.057 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:05.055+0000 7f271972a640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f271406d350 0x7f27141537c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:38126/0 (socket says 172.21.15.73:38126) 2023-12-12T09:45:05.057 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:05.055+0000 7f271972a640 1 -- 172.21.15.73:0/4137027001 learned_addr learned my addr 172.21.15.73:0/4137027001 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:45:05.057 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:05.055+0000 7f271972a640 1 -- 172.21.15.73:0/4137027001 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f271414f8c0 msgr2=0x7f2714145070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:05.058 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:05.055+0000 7f271972a640 1 --2- 172.21.15.73:0/4137027001 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f271414f8c0 0x7f2714145070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:05.058 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:05.055+0000 7f271972a640 1 -- 172.21.15.73:0/4137027001 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f27140723a0 msgr2=0x7f2714144b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:05.058 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:05.055+0000 7f271972a640 1 --2- 172.21.15.73:0/4137027001 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f27140723a0 0x7f2714144b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:05.058 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:05.055+0000 7f271972a640 1 -- 172.21.15.73:0/4137027001 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2708009b30 con 0x7f271406d350 2023-12-12T09:45:05.058 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:05.056+0000 7f271972a640 1 --2- 172.21.15.73:0/4137027001 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f271406d350 0x7f27141537c0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f2708000f80 tx=0x7f2708004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:45:05.059 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:05.056+0000 7f2711ffb640 1 -- 172.21.15.73:0/4137027001 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f270803e450 con 0x7f271406d350 2023-12-12T09:45:05.060 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:05.056+0000 7f2711ffb640 1 -- 172.21.15.73:0/4137027001 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f270803e5f0 con 0x7f271406d350 2023-12-12T09:45:05.060 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:05.056+0000 7f271b98e640 1 -- 172.21.15.73:0/4137027001 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2714150450 con 0x7f271406d350 2023-12-12T09:45:05.060 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:05.056+0000 7f2711ffb640 1 -- 172.21.15.73:0/4137027001 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f270803e9a0 con 0x7f271406d350 2023-12-12T09:45:05.060 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:05.056+0000 7f271b98e640 1 -- 172.21.15.73:0/4137027001 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2714150a10 con 0x7f271406d350 2023-12-12T09:45:05.060 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:05.057+0000 7f271b98e640 1 -- 172.21.15.73:0/4137027001 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2714067070 con 0x7f271406d350 2023-12-12T09:45:05.060 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:05.058+0000 7f2711ffb640 1 -- 172.21.15.73:0/4137027001 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f270803eb00 con 0x7f271406d350 2023-12-12T09:45:05.061 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:05.059+0000 7f2711ffb640 1 --2- 172.21.15.73:0/4137027001 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f26f806ae70 0x7f26f806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:05.061 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:05.059+0000 7f2711ffb640 1 -- 172.21.15.73:0/4137027001 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6213+0+0 (secure 0 0 0) 0x7f27080ac6a0 con 0x7f271406d350 2023-12-12T09:45:05.061 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:05.059+0000 7f2718f29640 1 --2- 172.21.15.73:0/4137027001 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f26f806ae70 0x7f26f806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:05.061 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:05.060+0000 7f2718f29640 1 --2- 172.21.15.73:0/4137027001 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f26f806ae70 0x7f26f806d330 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f2700006fd0 tx=0x7f2700008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:45:05.064 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:05.063+0000 7f2711ffb640 1 -- 172.21.15.73:0/4137027001 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f27080777b0 con 0x7f271406d350 2023-12-12T09:45:05.254 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:05.253+0000 7f271b98e640 1 -- 172.21.15.73:0/4137027001 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f271414fca0 con 0x7f271406d350 2023-12-12T09:45:05.802 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:05.801+0000 7f2711ffb640 1 -- 172.21.15.73:0/4137027001 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v41) v1 ==== 169+0+0 (secure 0 0 0) 0x7f270803edb0 con 0x7f271406d350 2023-12-12T09:45:05.803 INFO:teuthology.orchestra.run.smithi073.stderr:pool 'cephfs_data' removed 2023-12-12T09:45:05.806 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:05.804+0000 7f271b98e640 1 -- 172.21.15.73:0/4137027001 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f26f806ae70 msgr2=0x7f26f806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:05.806 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:05.804+0000 7f271b98e640 1 --2- 172.21.15.73:0/4137027001 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f26f806ae70 0x7f26f806d330 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f2700006fd0 tx=0x7f2700008040 comp rx=0 tx=0).stop 2023-12-12T09:45:05.806 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:05.804+0000 7f271b98e640 1 -- 172.21.15.73:0/4137027001 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f271406d350 msgr2=0x7f27141537c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:05.806 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:05.804+0000 7f271b98e640 1 --2- 172.21.15.73:0/4137027001 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f271406d350 0x7f27141537c0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f2708000f80 tx=0x7f2708004a40 comp rx=0 tx=0).stop 2023-12-12T09:45:05.806 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:05.804+0000 7f271b98e640 1 -- 172.21.15.73:0/4137027001 shutdown_connections 2023-12-12T09:45:05.806 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:05.804+0000 7f271b98e640 1 --2- 172.21.15.73:0/4137027001 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f26f806ae70 0x7f26f806d330 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:05.806 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:05.804+0000 7f271b98e640 1 --2- 172.21.15.73:0/4137027001 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f271414f8c0 0x7f2714145070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:05.806 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:05.804+0000 7f271b98e640 1 --2- 172.21.15.73:0/4137027001 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f27140723a0 0x7f2714144b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:05.806 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:05.804+0000 7f271b98e640 1 --2- 172.21.15.73:0/4137027001 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f271406d350 0x7f27141537c0 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:05.807 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:05.804+0000 7f271b98e640 1 -- 172.21.15.73:0/4137027001 >> 172.21.15.73:0/4137027001 conn(0x7f271406a4e0 msgr2=0x7f271406a8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:45:05.807 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:05.805+0000 7f271b98e640 1 -- 172.21.15.73:0/4137027001 shutdown_connections 2023-12-12T09:45:05.807 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:05.805+0000 7f271b98e640 1 -- 172.21.15.73:0/4137027001 wait complete. 2023-12-12T09:45:05.831 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-12T09:45:06.042 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:06.040+0000 7fd37a29b640 1 Processor -- start 2023-12-12T09:45:06.042 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:06.041+0000 7fd37a29b640 1 -- start start 2023-12-12T09:45:06.047 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:06.042+0000 7fd37a29b640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd3740a5040 0x7fd37406bf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:06.047 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:06.042+0000 7fd37a29b640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fd37406a4e0 0x7fd37406a950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:06.047 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:06.042+0000 7fd37a29b640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd374158c00 con 0x7fd3740c3ad0 2023-12-12T09:45:06.047 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:06.042+0000 7fd37a29b640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd37406c4d0 con 0x7fd37406a4e0 2023-12-12T09:45:06.047 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:06.042+0000 7fd37a29b640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3740c4d00 con 0x7fd3740a5040 2023-12-12T09:45:06.048 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:06.042+0000 7fd3737fe640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7fd3740c3ad0 0x7fd3741584f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:51180/0 (socket says 172.21.15.73:51180) 2023-12-12T09:45:06.048 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:06.042+0000 7fd378838640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fd37406a4e0 0x7fd37406a950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:06.048 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:06.042+0000 7fd3737fe640 1 -- 172.21.15.73:0/126775822 learned_addr learned my addr 172.21.15.73:0/126775822 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-12T09:45:06.048 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:06.043+0000 7fd373fff640 1 --2- 172.21.15.73:0/126775822 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd3740a5040 0x7fd37406bf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:06.048 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:06.043+0000 7fd378838640 1 -- 172.21.15.73:0/126775822 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd3740a5040 msgr2=0x7fd37406bf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:45:06.048 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:06.043+0000 7fd378838640 1 --2- 172.21.15.73:0/126775822 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd3740a5040 0x7fd37406bf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:06.048 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:06.043+0000 7fd378838640 1 -- 172.21.15.73:0/126775822 >> v1:172.21.15.73:6789/0 conn(0x7fd3740c3ad0 legacy=0x7fd3741584f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:06.048 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:06.043+0000 7fd378838640 1 -- 172.21.15.73:0/126775822 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3740c5100 con 0x7fd37406a4e0 2023-12-12T09:45:06.048 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:06.043+0000 7fd372ffd640 1 -- 172.21.15.73:0/126775822 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 609952722 0 0) 0x7fd374158c00 con 0x7fd3740c3ad0 2023-12-12T09:45:06.048 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:06.044+0000 7fd378838640 1 --2- 172.21.15.73:0/126775822 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd37406a4e0 0x7fd37406a950 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7fd36c0097a0 tx=0x7fd36c02b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aefa560fae698fa7 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:45:06.048 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:06.044+0000 7fd372ffd640 1 -- 172.21.15.73:0/126775822 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd36c030610 con 0x7fd37406a4e0 2023-12-12T09:45:06.048 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:06.044+0000 7fd372ffd640 1 -- 172.21.15.73:0/126775822 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd36c030770 con 0x7fd37406a4e0 2023-12-12T09:45:06.048 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:06.044+0000 7fd372ffd640 1 -- 172.21.15.73:0/126775822 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd36c030b00 con 0x7fd37406a4e0 2023-12-12T09:45:06.048 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:06.045+0000 7fd37a29b640 1 -- 172.21.15.73:0/126775822 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd37406a4e0 msgr2=0x7fd37406a950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:06.049 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:06.045+0000 7fd37a29b640 1 --2- 172.21.15.73:0/126775822 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd37406a4e0 0x7fd37406a950 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7fd36c0097a0 tx=0x7fd36c02b960 comp rx=0 tx=0).stop 2023-12-12T09:45:06.049 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:06.045+0000 7fd37a29b640 1 -- 172.21.15.73:0/126775822 shutdown_connections 2023-12-12T09:45:06.049 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:06.045+0000 7fd37a29b640 1 --2- 172.21.15.73:0/126775822 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd37406a4e0 0x7fd37406a950 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:06.049 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:06.045+0000 7fd37a29b640 1 --2- 172.21.15.73:0/126775822 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd3740a5040 0x7fd37406bf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:06.049 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:06.045+0000 7fd37a29b640 1 -- 172.21.15.73:0/126775822 >> 172.21.15.73:0/126775822 conn(0x7fd3740a8130 msgr2=0x7fd3740c24b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:45:06.049 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:06.045+0000 7fd37a29b640 1 -- 172.21.15.73:0/126775822 shutdown_connections 2023-12-12T09:45:06.049 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:06.045+0000 7fd37a29b640 1 -- 172.21.15.73:0/126775822 wait complete. 2023-12-12T09:45:06.051 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:06.047+0000 7fd37a29b640 1 Processor -- start 2023-12-12T09:45:06.051 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:06.047+0000 7fd37a29b640 1 -- start start 2023-12-12T09:45:06.051 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:06.048+0000 7fd37a29b640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd37406a4e0 0x7fd374152bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:06.052 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:06.048+0000 7fd37a29b640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd3740a5040 0x7fd374153130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:06.052 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:06.048+0000 7fd37a29b640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd3740c3ad0 0x7fd37413faf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:06.052 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:06.048+0000 7fd37a29b640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3740a9040 con 0x7fd37406a4e0 2023-12-12T09:45:06.052 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:06.048+0000 7fd37a29b640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd374156380 con 0x7fd3740c3ad0 2023-12-12T09:45:06.052 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:06.048+0000 7fd37a29b640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3740a87c0 con 0x7fd3740a5040 2023-12-12T09:45:06.052 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:06.048+0000 7fd373fff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd37406a4e0 0x7fd374152bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:06.053 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:06.048+0000 7fd373fff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd37406a4e0 0x7fd374152bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:38158/0 (socket says 172.21.15.73:38158) 2023-12-12T09:45:06.053 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:06.048+0000 7fd373fff640 1 -- 172.21.15.73:0/682125713 learned_addr learned my addr 172.21.15.73:0/682125713 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:45:06.053 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:06.049+0000 7fd3737fe640 1 --2- 172.21.15.73:0/682125713 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd3740a5040 0x7fd374153130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:06.053 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:06.049+0000 7fd378838640 1 --2- 172.21.15.73:0/682125713 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd3740c3ad0 0x7fd37413faf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:06.053 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:06.049+0000 7fd373fff640 1 -- 172.21.15.73:0/682125713 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd3740a5040 msgr2=0x7fd374153130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:06.053 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:06.049+0000 7fd373fff640 1 --2- 172.21.15.73:0/682125713 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd3740a5040 0x7fd374153130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:06.053 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:06.049+0000 7fd373fff640 1 -- 172.21.15.73:0/682125713 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd3740c3ad0 msgr2=0x7fd37413faf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:06.053 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:06.049+0000 7fd373fff640 1 --2- 172.21.15.73:0/682125713 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd3740c3ad0 0x7fd37413faf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:06.053 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:06.049+0000 7fd373fff640 1 -- 172.21.15.73:0/682125713 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd36c009400 con 0x7fd37406a4e0 2023-12-12T09:45:06.053 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:06.049+0000 7fd3737fe640 1 --2- 172.21.15.73:0/682125713 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd3740a5040 0x7fd374153130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:45:06.053 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:06.049+0000 7fd373fff640 1 --2- 172.21.15.73:0/682125713 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd37406a4e0 0x7fd374152bf0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7fd364007f20 tx=0x7fd36400e570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:45:06.054 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:06.049+0000 7fd370ff9640 1 -- 172.21.15.73:0/682125713 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd364014620 con 0x7fd37406a4e0 2023-12-12T09:45:06.054 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:06.049+0000 7fd370ff9640 1 -- 172.21.15.73:0/682125713 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd364014780 con 0x7fd37406a4e0 2023-12-12T09:45:06.054 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:06.049+0000 7fd37a29b640 1 -- 172.21.15.73:0/682125713 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd374071540 con 0x7fd37406a4e0 2023-12-12T09:45:06.054 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:06.049+0000 7fd370ff9640 1 -- 172.21.15.73:0/682125713 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd364014b30 con 0x7fd37406a4e0 2023-12-12T09:45:06.054 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:06.049+0000 7fd37a29b640 1 -- 172.21.15.73:0/682125713 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd374071820 con 0x7fd37406a4e0 2023-12-12T09:45:06.055 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:06.050+0000 7fd37a29b640 1 -- 172.21.15.73:0/682125713 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd374067580 con 0x7fd37406a4e0 2023-12-12T09:45:06.055 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:06.051+0000 7fd370ff9640 1 -- 172.21.15.73:0/682125713 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fd364014c90 con 0x7fd37406a4e0 2023-12-12T09:45:06.055 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:06.052+0000 7fd370ff9640 1 --2- 172.21.15.73:0/682125713 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fd35406ae40 0x7fd35406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:06.055 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:06.052+0000 7fd370ff9640 1 -- 172.21.15.73:0/682125713 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 5799+0+0 (secure 0 0 0) 0x7fd36408a0a0 con 0x7fd37406a4e0 2023-12-12T09:45:06.056 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:06.053+0000 7fd3737fe640 1 --2- 172.21.15.73:0/682125713 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fd35406ae40 0x7fd35406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:06.056 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:06.053+0000 7fd3737fe640 1 --2- 172.21.15.73:0/682125713 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fd35406ae40 0x7fd35406d300 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fd37414f360 tx=0x7fd35c009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:45:06.057 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:06.056+0000 7fd370ff9640 1 -- 172.21.15.73:0/682125713 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fd3640550e0 con 0x7fd37406a4e0 2023-12-12T09:45:06.252 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:06.251+0000 7fd37a29b640 1 -- 172.21.15.73:0/682125713 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd3740c3040 con 0x7fd37406a4e0 2023-12-12T09:45:06.255 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:06.254+0000 7fd370ff9640 1 -- 172.21.15.73:0/682125713 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v41) v1 ==== 74+0+16658 (secure 0 0 0) 0x7fd364058700 con 0x7fd37406a4e0 2023-12-12T09:45:06.256 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-12T09:45:06.256 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":41,"fsid":"ba240992-02b8-4c7e-92f2-27eb29ac433b","created":"2023-12-12T09:43:02.454719+0000","modified":"2023-12-12T09:45:05.798881+0000","last_up_change":"2023-12-12T09:43:13.913440+0000","last_in_change":"2023-12-12T09:43:05.925348+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-12T09:43:15.525508+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs2_metadata","create_time":"2023-12-12T09:44:34.424645+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs2_data","create_time":"2023-12-12T09:44:35.090149+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"dd9074be-dbe2-4c34-9896-a4223d8d3940","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":4047810203},{"type":"v1","addr":"172.21.15.73:6801","nonce":4047810203}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":4047810203},{"type":"v1","addr":"172.21.15.73:6803","nonce":4047810203}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":4047810203},{"type":"v1","addr":"172.21.15.73:6807","nonce":4047810203}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":4047810203},{"type":"v1","addr":"172.21.15.73:6805","nonce":4047810203}]},"public_addr":"172.21.15.73:6801/4047810203","cluster_addr":"172.21.15.73:6803/4047810203","heartbeat_back_addr":"172.21.15.73:6807/4047810203","heartbeat_front_addr":"172.21.15.73:6805/4047810203","state":["exists","up"]},{"osd":1,"uuid":"c4a05052-96d4-4758-a4e1-1a37f1e07fed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":1356058331},{"type":"v1","addr":"172.21.15.73:6824","nonce":1356058331}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":1356058331},{"type":"v1","addr":"172.21.15.73:6827","nonce":1356058331}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":1356058331},{"type":"v1","addr":"172.21.15.73:6831","nonce":1356058331}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":1356058331},{"type":"v1","addr":"172.21.15.73:6829","nonce":1356058331}]},"public_addr":"172.21.15.73:6824/1356058331","cluster_addr":"172.21.15.73:6827/1356058331","heartbeat_back_addr":"172.21.15.73:6831/1356058331","heartbeat_front_addr":"172.21.15.73:6829/1356058331","state":["exists","up"]},{"osd":2,"uuid":"512bc8ac-72c2-40d4-b3d2-d867a92c5213","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":1228903316},{"type":"v1","addr":"172.21.15.73:6817","nonce":1228903316}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":1228903316},{"type":"v1","addr":"172.21.15.73:6819","nonce":1228903316}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6823","nonce":1228903316},{"type":"v1","addr":"172.21.15.73:6825","nonce":1228903316}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":1228903316},{"type":"v1","addr":"172.21.15.73:6821","nonce":1228903316}]},"public_addr":"172.21.15.73:6817/1228903316","cluster_addr":"172.21.15.73:6819/1228903316","heartbeat_back_addr":"172.21.15.73:6825/1228903316","heartbeat_front_addr":"172.21.15.73:6821/1228903316","state":["exists","up"]},{"osd":3,"uuid":"3d1a91e0-42bf-437a-8eae-8d357c8f63a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":1293329670},{"type":"v1","addr":"172.21.15.73:6809","nonce":1293329670}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6810","nonce":1293329670},{"type":"v1","addr":"172.21.15.73:6811","nonce":1293329670}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":1293329670},{"type":"v1","addr":"172.21.15.73:6815","nonce":1293329670}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":1293329670},{"type":"v1","addr":"172.21.15.73:6813","nonce":1293329670}]},"public_addr":"172.21.15.73:6809/1293329670","cluster_addr":"172.21.15.73:6811/1293329670","heartbeat_back_addr":"172.21.15.73:6815/1293329670","heartbeat_front_addr":"172.21.15.73:6813/1293329670","state":["exists","up"]},{"osd":4,"uuid":"4b302fff-834c-4069-ac19-00e46f6c87b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":3727975702},{"type":"v1","addr":"172.21.15.142:6801","nonce":3727975702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":3727975702},{"type":"v1","addr":"172.21.15.142:6803","nonce":3727975702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6809","nonce":3727975702},{"type":"v1","addr":"172.21.15.142:6811","nonce":3727975702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6805","nonce":3727975702},{"type":"v1","addr":"172.21.15.142:6807","nonce":3727975702}]},"public_addr":"172.21.15.142:6801/3727975702","cluster_addr":"172.21.15.142:6803/3727975702","heartbeat_back_addr":"172.21.15.142:6811/3727975702","heartbeat_front_addr":"172.21.15.142:6807/3727975702","state":["exists","up"]},{"osd":5,"uuid":"d7cdace2-67d0-45cc-95f2-515cf6ef1b82","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6817","nonce":2353193632},{"type":"v1","addr":"172.21.15.142:6819","nonce":2353193632}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6821","nonce":2353193632},{"type":"v1","addr":"172.21.15.142:6823","nonce":2353193632}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6829","nonce":2353193632},{"type":"v1","addr":"172.21.15.142:6831","nonce":2353193632}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6825","nonce":2353193632},{"type":"v1","addr":"172.21.15.142:6827","nonce":2353193632}]},"public_addr":"172.21.15.142:6819/2353193632","cluster_addr":"172.21.15.142:6823/2353193632","heartbeat_back_addr":"172.21.15.142:6831/2353193632","heartbeat_front_addr":"172.21.15.142:6827/2353193632","state":["exists","up"]},{"osd":6,"uuid":"649ce78a-5626-445c-aedc-a651ed05a6f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":2006111986},{"type":"v1","addr":"172.21.15.142:6806","nonce":2006111986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":2006111986},{"type":"v1","addr":"172.21.15.142:6810","nonce":2006111986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":2006111986},{"type":"v1","addr":"172.21.15.142:6815","nonce":2006111986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":2006111986},{"type":"v1","addr":"172.21.15.142:6813","nonce":2006111986}]},"public_addr":"172.21.15.142:6806/2006111986","cluster_addr":"172.21.15.142:6810/2006111986","heartbeat_back_addr":"172.21.15.142:6815/2006111986","heartbeat_front_addr":"172.21.15.142:6813/2006111986","state":["exists","up"]},{"osd":7,"uuid":"af15ae3b-c1d0-4acf-92db-8a1805494d13","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":2573794341},{"type":"v1","addr":"172.21.15.142:6818","nonce":2573794341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":2573794341},{"type":"v1","addr":"172.21.15.142:6822","nonce":2573794341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":2573794341},{"type":"v1","addr":"172.21.15.142:6830","nonce":2573794341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":2573794341},{"type":"v1","addr":"172.21.15.142:6826","nonce":2573794341}]},"public_addr":"172.21.15.142:6818/2573794341","cluster_addr":"172.21.15.142:6822/2573794341","heartbeat_back_addr":"172.21.15.142:6830/2573794341","heartbeat_front_addr":"172.21.15.142:6826/2573794341","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.185824+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.262103+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.225556+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:10.523459+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:10.706035+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.257339+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.301776+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.051960+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.73:6837/1534083424":"2023-12-13T09:45:02.776929+0000","172.21.15.73:6835/1534083424":"2023-12-13T09:45:02.776929+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-12T09:45:06.259 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:06.257+0000 7fd37a29b640 1 -- 172.21.15.73:0/682125713 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fd35406ae40 msgr2=0x7fd35406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:06.259 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:06.257+0000 7fd37a29b640 1 --2- 172.21.15.73:0/682125713 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fd35406ae40 0x7fd35406d300 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fd37414f360 tx=0x7fd35c009040 comp rx=0 tx=0).stop 2023-12-12T09:45:06.259 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:06.257+0000 7fd37a29b640 1 -- 172.21.15.73:0/682125713 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd37406a4e0 msgr2=0x7fd374152bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:06.259 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:06.257+0000 7fd37a29b640 1 --2- 172.21.15.73:0/682125713 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd37406a4e0 0x7fd374152bf0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7fd364007f20 tx=0x7fd36400e570 comp rx=0 tx=0).stop 2023-12-12T09:45:06.259 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:06.257+0000 7fd37a29b640 1 -- 172.21.15.73:0/682125713 shutdown_connections 2023-12-12T09:45:06.259 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:06.257+0000 7fd37a29b640 1 --2- 172.21.15.73:0/682125713 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fd35406ae40 0x7fd35406d300 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:06.259 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:06.257+0000 7fd37a29b640 1 --2- 172.21.15.73:0/682125713 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd3740c3ad0 0x7fd37413faf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:06.259 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:06.257+0000 7fd37a29b640 1 --2- 172.21.15.73:0/682125713 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd3740a5040 0x7fd374153130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:06.259 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:06.257+0000 7fd37a29b640 1 --2- 172.21.15.73:0/682125713 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd37406a4e0 0x7fd374152bf0 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:06.259 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:06.257+0000 7fd37a29b640 1 -- 172.21.15.73:0/682125713 >> 172.21.15.73:0/682125713 conn(0x7fd3740a8130 msgr2=0x7fd37406d150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:45:06.259 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:06.257+0000 7fd37a29b640 1 -- 172.21.15.73:0/682125713 shutdown_connections 2023-12-12T09:45:06.259 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:06.257+0000 7fd37a29b640 1 -- 172.21.15.73:0/682125713 wait complete. 2023-12-12T09:45:06.277 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-12T09:43:15.525508+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs2_metadata', 'create_time': '2023-12-12T09:44:34.424645+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '37', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs2'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'cephfs2_data', 'create_time': '2023-12-12T09:44:35.090149+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '38', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs2'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-12T09:45:06.278 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-12T09:45:06.488 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:06.487+0000 7f6c39248640 1 Processor -- start 2023-12-12T09:45:06.488 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:06.487+0000 7f6c39248640 1 -- start start 2023-12-12T09:45:06.491 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:06.488+0000 7f6c39248640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f6c3414f8c0 0x7f6c3406dc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:06.491 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:06.488+0000 7f6c39248640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6c3406d350 0x7f6c34071e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:06.491 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:06.488+0000 7f6c39248640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c340c16c0 con 0x7f6c340723a0 2023-12-12T09:45:06.491 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:06.488+0000 7f6c39248640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c340c1090 con 0x7f6c3414f8c0 2023-12-12T09:45:06.491 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:06.488+0000 7f6c39248640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c340c14b0 con 0x7f6c3406d350 2023-12-12T09:45:06.491 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:06.489+0000 7f6c32d9d640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f6c3414f8c0 0x7f6c3406dc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:06.491 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:06.489+0000 7f6c32d9d640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f6c3414f8c0 0x7f6c3406dc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:38162/0 (socket says 172.21.15.73:38162) 2023-12-12T09:45:06.491 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:06.489+0000 7f6c32d9d640 1 -- 172.21.15.73:0/3380700989 learned_addr learned my addr 172.21.15.73:0/3380700989 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:45:06.491 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:06.489+0000 7f6c3259c640 1 --2- 172.21.15.73:0/3380700989 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6c3406d350 0x7f6c34071e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:06.491 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:06.489+0000 7f6c32d9d640 1 -- 172.21.15.73:0/3380700989 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6c3406d350 msgr2=0x7f6c34071e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:45:06.491 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:06.489+0000 7f6c32d9d640 1 --2- 172.21.15.73:0/3380700989 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6c3406d350 0x7f6c34071e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:06.491 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:06.489+0000 7f6c32d9d640 1 -- 172.21.15.73:0/3380700989 >> v1:172.21.15.142:6789/0 conn(0x7f6c340723a0 legacy=0x7f6c34152500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:45:06.492 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:06.489+0000 7f6c32d9d640 1 -- 172.21.15.73:0/3380700989 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c340c19a0 con 0x7f6c3414f8c0 2023-12-12T09:45:06.493 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:06.490+0000 7f6c32d9d640 1 --2- 172.21.15.73:0/3380700989 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6c3414f8c0 0x7f6c3406dc40 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f6c240098a0 tx=0x7f6c2402b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f5b4e31496a5dd0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:45:06.493 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:06.491+0000 7f6c31d9b640 1 -- 172.21.15.73:0/3380700989 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c24031640 con 0x7f6c3414f8c0 2023-12-12T09:45:06.493 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:06.491+0000 7f6c31d9b640 1 -- 172.21.15.73:0/3380700989 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c240317a0 con 0x7f6c3414f8c0 2023-12-12T09:45:06.493 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:06.491+0000 7f6c31d9b640 1 -- 172.21.15.73:0/3380700989 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c24031b30 con 0x7f6c3414f8c0 2023-12-12T09:45:06.493 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:06.491+0000 7f6c39248640 1 -- 172.21.15.73:0/3380700989 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6c3414f8c0 msgr2=0x7f6c3406dc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:06.493 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:06.491+0000 7f6c39248640 1 --2- 172.21.15.73:0/3380700989 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6c3414f8c0 0x7f6c3406dc40 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f6c240098a0 tx=0x7f6c2402b8f0 comp rx=0 tx=0).stop 2023-12-12T09:45:06.493 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:06.492+0000 7f6c39248640 1 -- 172.21.15.73:0/3380700989 shutdown_connections 2023-12-12T09:45:06.493 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:06.492+0000 7f6c39248640 1 --2- 172.21.15.73:0/3380700989 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6c3406d350 0x7f6c34071e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:06.494 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:06.492+0000 7f6c39248640 1 --2- 172.21.15.73:0/3380700989 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6c3414f8c0 0x7f6c3406dc40 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:06.494 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:06.492+0000 7f6c39248640 1 -- 172.21.15.73:0/3380700989 >> 172.21.15.73:0/3380700989 conn(0x7f6c3406a4e0 msgr2=0x7f6c3406a8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:45:06.494 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:06.492+0000 7f6c39248640 1 -- 172.21.15.73:0/3380700989 shutdown_connections 2023-12-12T09:45:06.494 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:06.492+0000 7f6c39248640 1 -- 172.21.15.73:0/3380700989 wait complete. 2023-12-12T09:45:06.494 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:06.493+0000 7f6c39248640 1 Processor -- start 2023-12-12T09:45:06.494 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:06.493+0000 7f6c39248640 1 -- start start 2023-12-12T09:45:06.497 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:06.494+0000 7f6c39248640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6c3406d350 0x7f6c34148f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:06.497 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:06.494+0000 7f6c39248640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6c340723a0 0x7f6c340befc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:06.497 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:06.494+0000 7f6c39248640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6c3414f8c0 0x7f6c34147f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:06.497 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:06.494+0000 7f6c39248640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c340a8df0 con 0x7f6c3406d350 2023-12-12T09:45:06.497 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:06.494+0000 7f6c39248640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c34070ee0 con 0x7f6c340723a0 2023-12-12T09:45:06.497 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:06.494+0000 7f6c39248640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c341ee440 con 0x7f6c3414f8c0 2023-12-12T09:45:06.497 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:06.495+0000 7f6c32d9d640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6c3406d350 0x7f6c34148f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:06.497 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:06.495+0000 7f6c32d9d640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6c3406d350 0x7f6c34148f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:38164/0 (socket says 172.21.15.73:38164) 2023-12-12T09:45:06.497 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:06.495+0000 7f6c32d9d640 1 -- 172.21.15.73:0/1560692204 learned_addr learned my addr 172.21.15.73:0/1560692204 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:45:06.498 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:06.495+0000 7f6c3259c640 1 --2- 172.21.15.73:0/1560692204 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6c340723a0 0x7f6c340befc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:06.498 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:06.495+0000 7f6c32d9d640 1 -- 172.21.15.73:0/1560692204 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6c3414f8c0 msgr2=0x7f6c34147f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:06.498 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:06.495+0000 7f6c32d9d640 1 --2- 172.21.15.73:0/1560692204 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6c3414f8c0 0x7f6c34147f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:06.498 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:06.495+0000 7f6c32d9d640 1 -- 172.21.15.73:0/1560692204 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6c340723a0 msgr2=0x7f6c340befc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:06.498 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:06.495+0000 7f6c32d9d640 1 --2- 172.21.15.73:0/1560692204 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6c340723a0 0x7f6c340befc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:06.498 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:06.495+0000 7f6c32d9d640 1 -- 172.21.15.73:0/1560692204 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c240094d0 con 0x7f6c3406d350 2023-12-12T09:45:06.498 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:06.495+0000 7f6c32d9d640 1 --2- 172.21.15.73:0/1560692204 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6c3406d350 0x7f6c34148f90 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f6c240098a0 tx=0x7f6c240046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:45:06.498 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:06.496+0000 7f6c1b7fe640 1 -- 172.21.15.73:0/1560692204 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c2403ac60 con 0x7f6c3406d350 2023-12-12T09:45:06.498 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:06.496+0000 7f6c1b7fe640 1 -- 172.21.15.73:0/1560692204 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c2403adc0 con 0x7f6c3406d350 2023-12-12T09:45:06.498 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:06.496+0000 7f6c39248640 1 -- 172.21.15.73:0/1560692204 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c34153c50 con 0x7f6c3406d350 2023-12-12T09:45:06.498 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:06.496+0000 7f6c1b7fe640 1 -- 172.21.15.73:0/1560692204 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c24044630 con 0x7f6c3406d350 2023-12-12T09:45:06.498 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:06.496+0000 7f6c39248640 1 -- 172.21.15.73:0/1560692204 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c340bf500 con 0x7f6c3406d350 2023-12-12T09:45:06.499 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:06.497+0000 7f6c39248640 1 -- 172.21.15.73:0/1560692204 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c34153e60 con 0x7f6c3406d350 2023-12-12T09:45:06.499 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:06.498+0000 7f6c1b7fe640 1 -- 172.21.15.73:0/1560692204 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f6c2402f050 con 0x7f6c3406d350 2023-12-12T09:45:06.500 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:06.499+0000 7f6c1b7fe640 1 --2- 172.21.15.73:0/1560692204 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f6c2006ae40 0x7f6c2006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:06.500 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:06.499+0000 7f6c1b7fe640 1 -- 172.21.15.73:0/1560692204 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 5799+0+0 (secure 0 0 0) 0x7f6c240ab4b0 con 0x7f6c3406d350 2023-12-12T09:45:06.500 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:06.499+0000 7f6c3259c640 1 --2- 172.21.15.73:0/1560692204 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f6c2006ae40 0x7f6c2006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:06.501 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:06.500+0000 7f6c3259c640 1 --2- 172.21.15.73:0/1560692204 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f6c2006ae40 0x7f6c2006d300 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f6c341569d0 tx=0x7f6c28008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:45:06.504 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:06.503+0000 7f6c1b7fe640 1 -- 172.21.15.73:0/1560692204 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f6c240764f0 con 0x7f6c3406d350 2023-12-12T09:45:06.708 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:06.706+0000 7f6c39248640 1 -- 172.21.15.73:0/1560692204 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f6c34067070 con 0x7f6c3406d350 2023-12-12T09:45:06.708 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:06.707+0000 7f6c1b7fe640 1 -- 172.21.15.73:0/1560692204 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v41) v1 ==== 93+0+10 (secure 0 0 0) 0x7f6c24031e60 con 0x7f6c3406d350 2023-12-12T09:45:06.708 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 1 2023-12-12T09:45:06.712 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:06.710+0000 7f6c39248640 1 -- 172.21.15.73:0/1560692204 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f6c2006ae40 msgr2=0x7f6c2006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:06.712 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:06.710+0000 7f6c39248640 1 --2- 172.21.15.73:0/1560692204 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f6c2006ae40 0x7f6c2006d300 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f6c341569d0 tx=0x7f6c28008040 comp rx=0 tx=0).stop 2023-12-12T09:45:06.712 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:06.710+0000 7f6c39248640 1 -- 172.21.15.73:0/1560692204 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6c3406d350 msgr2=0x7f6c34148f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:06.712 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:06.710+0000 7f6c39248640 1 --2- 172.21.15.73:0/1560692204 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6c3406d350 0x7f6c34148f90 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f6c240098a0 tx=0x7f6c240046c0 comp rx=0 tx=0).stop 2023-12-12T09:45:06.712 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:06.710+0000 7f6c39248640 1 -- 172.21.15.73:0/1560692204 shutdown_connections 2023-12-12T09:45:06.712 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:06.710+0000 7f6c39248640 1 --2- 172.21.15.73:0/1560692204 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f6c2006ae40 0x7f6c2006d300 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:06.712 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:06.710+0000 7f6c39248640 1 --2- 172.21.15.73:0/1560692204 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6c3414f8c0 0x7f6c34147f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:06.712 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:06.710+0000 7f6c39248640 1 --2- 172.21.15.73:0/1560692204 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6c340723a0 0x7f6c340befc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:06.712 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:06.710+0000 7f6c39248640 1 --2- 172.21.15.73:0/1560692204 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6c3406d350 0x7f6c34148f90 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:06.712 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:06.710+0000 7f6c39248640 1 -- 172.21.15.73:0/1560692204 >> 172.21.15.73:0/1560692204 conn(0x7f6c3406a4e0 msgr2=0x7f6c34073310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:45:06.712 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:06.710+0000 7f6c39248640 1 -- 172.21.15.73:0/1560692204 shutdown_connections 2023-12-12T09:45:06.712 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:06.710+0000 7f6c39248640 1 -- 172.21.15.73:0/1560692204 wait complete. 2023-12-12T09:45:06.729 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_metadata pg_num 2023-12-12T09:45:06.939 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:06.937+0000 7ff04783d640 1 Processor -- start 2023-12-12T09:45:06.939 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:06.937+0000 7ff04783d640 1 -- start start 2023-12-12T09:45:06.940 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:06.939+0000 7ff04783d640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7ff04006d350 0x7ff04006dc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:06.940 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:06.939+0000 7ff04783d640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7ff040152500 0x7ff040152990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:06.940 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:06.939+0000 7ff04783d640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0400c16c0 con 0x7ff04014f8c0 2023-12-12T09:45:06.940 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:06.939+0000 7ff04783d640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0400c1090 con 0x7ff040152500 2023-12-12T09:45:06.940 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:06.939+0000 7ff04783d640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0400c14b0 con 0x7ff04006d350 2023-12-12T09:45:06.941 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:06.939+0000 7ff0455d9640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7ff04014f8c0 0x7ff040071e60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:51192/0 (socket says 172.21.15.73:51192) 2023-12-12T09:45:06.941 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:06.939+0000 7ff0455d9640 1 -- 172.21.15.73:0/259677264 learned_addr learned my addr 172.21.15.73:0/259677264 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-12T09:45:06.941 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:06.939+0000 7ff045dda640 1 --2- 172.21.15.73:0/259677264 >> v2:172.21.15.73:3300/0 conn(0x7ff040152500 0x7ff040152990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:06.941 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:06.939+0000 7ff044dd8640 1 --2- 172.21.15.73:0/259677264 >> v2:172.21.15.142:3300/0 conn(0x7ff04006d350 0x7ff04006dc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:06.941 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:06.940+0000 7ff045dda640 1 -- 172.21.15.73:0/259677264 >> v2:172.21.15.142:3300/0 conn(0x7ff04006d350 msgr2=0x7ff04006dc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:45:06.941 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:06.940+0000 7ff037fff640 1 -- 172.21.15.73:0/259677264 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 569837365 0 0) 0x7ff0400c16c0 con 0x7ff04014f8c0 2023-12-12T09:45:06.941 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:06.940+0000 7ff045dda640 1 --2- 172.21.15.73:0/259677264 >> v2:172.21.15.142:3300/0 conn(0x7ff04006d350 0x7ff04006dc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:06.942 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:06.940+0000 7ff045dda640 1 -- 172.21.15.73:0/259677264 >> v1:172.21.15.73:6789/0 conn(0x7ff04014f8c0 legacy=0x7ff040071e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:06.942 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:06.940+0000 7ff045dda640 1 -- 172.21.15.73:0/259677264 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0400c19a0 con 0x7ff040152500 2023-12-12T09:45:06.943 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:06.941+0000 7ff045dda640 1 --2- 172.21.15.73:0/259677264 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff040152500 0x7ff040152990 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7ff0400c3430 tx=0x7ff03802bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc68eabee6770ac9 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:45:06.943 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:06.941+0000 7ff037fff640 1 -- 172.21.15.73:0/259677264 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff03802cc80 con 0x7ff040152500 2023-12-12T09:45:06.943 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:06.941+0000 7ff037fff640 1 -- 172.21.15.73:0/259677264 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff03802cde0 con 0x7ff040152500 2023-12-12T09:45:06.944 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:06.941+0000 7ff037fff640 1 -- 172.21.15.73:0/259677264 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff038034660 con 0x7ff040152500 2023-12-12T09:45:06.944 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:06.941+0000 7ff04783d640 1 -- 172.21.15.73:0/259677264 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff040152500 msgr2=0x7ff040152990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:06.944 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:06.941+0000 7ff04783d640 1 --2- 172.21.15.73:0/259677264 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff040152500 0x7ff040152990 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7ff0400c3430 tx=0x7ff03802bed0 comp rx=0 tx=0).stop 2023-12-12T09:45:06.944 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:06.942+0000 7ff04783d640 1 -- 172.21.15.73:0/259677264 shutdown_connections 2023-12-12T09:45:06.944 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:06.942+0000 7ff04783d640 1 --2- 172.21.15.73:0/259677264 >> v2:172.21.15.142:3300/0 conn(0x7ff04006d350 0x7ff04006dc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:06.944 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:06.942+0000 7ff04783d640 1 --2- 172.21.15.73:0/259677264 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff040152500 0x7ff040152990 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:06.944 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:06.942+0000 7ff04783d640 1 -- 172.21.15.73:0/259677264 >> 172.21.15.73:0/259677264 conn(0x7ff04006a4e0 msgr2=0x7ff04006a8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:45:06.944 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:06.942+0000 7ff04783d640 1 -- 172.21.15.73:0/259677264 shutdown_connections 2023-12-12T09:45:06.944 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:06.942+0000 7ff04783d640 1 -- 172.21.15.73:0/259677264 wait complete. 2023-12-12T09:45:06.945 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:06.943+0000 7ff04783d640 1 Processor -- start 2023-12-12T09:45:06.945 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:06.943+0000 7ff04783d640 1 -- start start 2023-12-12T09:45:06.947 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:06.944+0000 7ff04783d640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff04006d350 0x7ff040154580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:06.947 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:06.944+0000 7ff04783d640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff04014f8c0 0x7ff0401e9c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:06.947 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:06.944+0000 7ff04783d640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff040152500 0x7ff0401ea1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:06.947 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:06.944+0000 7ff04783d640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff040155020 con 0x7ff04014f8c0 2023-12-12T09:45:06.947 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:06.944+0000 7ff04783d640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff040156750 con 0x7ff04006d350 2023-12-12T09:45:06.947 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:06.944+0000 7ff04783d640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0401eda40 con 0x7ff040152500 2023-12-12T09:45:06.947 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:06.945+0000 7ff044dd8640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff04014f8c0 0x7ff0401e9c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:06.948 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:06.945+0000 7ff044dd8640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff04014f8c0 0x7ff0401e9c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:38180/0 (socket says 172.21.15.73:38180) 2023-12-12T09:45:06.948 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:06.945+0000 7ff044dd8640 1 -- 172.21.15.73:0/1951151061 learned_addr learned my addr 172.21.15.73:0/1951151061 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:45:06.948 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:06.945+0000 7ff044dd8640 1 -- 172.21.15.73:0/1951151061 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff040152500 msgr2=0x7ff0401ea1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:06.948 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:06.945+0000 7ff0455d9640 1 --2- 172.21.15.73:0/1951151061 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff04006d350 0x7ff040154580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:06.948 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:06.945+0000 7ff044dd8640 1 --2- 172.21.15.73:0/1951151061 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff040152500 0x7ff0401ea1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:06.948 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:06.945+0000 7ff044dd8640 1 -- 172.21.15.73:0/1951151061 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff04006d350 msgr2=0x7ff040154580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:06.948 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:06.945+0000 7ff044dd8640 1 --2- 172.21.15.73:0/1951151061 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff04006d350 0x7ff040154580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:06.948 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:06.945+0000 7ff044dd8640 1 -- 172.21.15.73:0/1951151061 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff038009a70 con 0x7ff04014f8c0 2023-12-12T09:45:06.948 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:06.945+0000 7ff044dd8640 1 --2- 172.21.15.73:0/1951151061 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff04014f8c0 0x7ff0401e9c80 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7ff03000d620 tx=0x7ff03000dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:45:06.948 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:06.946+0000 7ff035ffb640 1 -- 172.21.15.73:0/1951151061 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff03000b620 con 0x7ff04014f8c0 2023-12-12T09:45:06.948 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:06.946+0000 7ff035ffb640 1 -- 172.21.15.73:0/1951151061 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff03000b780 con 0x7ff04014f8c0 2023-12-12T09:45:06.948 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:06.946+0000 7ff04783d640 1 -- 172.21.15.73:0/1951151061 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff040156470 con 0x7ff04014f8c0 2023-12-12T09:45:06.948 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:06.946+0000 7ff035ffb640 1 -- 172.21.15.73:0/1951151061 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff03000bb30 con 0x7ff04014f8c0 2023-12-12T09:45:06.948 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:06.946+0000 7ff04783d640 1 -- 172.21.15.73:0/1951151061 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0401ed6d0 con 0x7ff04014f8c0 2023-12-12T09:45:06.949 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:06.947+0000 7ff04783d640 1 -- 172.21.15.73:0/1951151061 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff0401ed250 con 0x7ff04014f8c0 2023-12-12T09:45:06.949 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:06.948+0000 7ff035ffb640 1 -- 172.21.15.73:0/1951151061 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7ff03000bc90 con 0x7ff04014f8c0 2023-12-12T09:45:06.950 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:06.949+0000 7ff035ffb640 1 --2- 172.21.15.73:0/1951151061 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7ff02406aec0 0x7ff02406d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:06.950 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:06.949+0000 7ff035ffb640 1 -- 172.21.15.73:0/1951151061 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 5799+0+0 (secure 0 0 0) 0x7ff030089aa0 con 0x7ff04014f8c0 2023-12-12T09:45:06.950 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:06.949+0000 7ff0455d9640 1 --2- 172.21.15.73:0/1951151061 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7ff02406aec0 0x7ff02406d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:06.951 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:06.950+0000 7ff0455d9640 1 --2- 172.21.15.73:0/1951151061 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7ff02406aec0 0x7ff02406d380 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7ff03c007fd0 tx=0x7ff03c009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:45:06.954 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:06.953+0000 7ff035ffb640 1 -- 172.21.15.73:0/1951151061 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7ff0401ed250 con 0x7ff04014f8c0 2023-12-12T09:45:07.144 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:07.142+0000 7ff04783d640 1 -- 172.21.15.73:0/1951151061 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"} v 0) v1 -- 0x7ff0401ed250 con 0x7ff04014f8c0 2023-12-12T09:45:07.145 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:07.143+0000 7ff035ffb640 1 -- 172.21.15.73:0/1951151061 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"}]=0 v41) v1 ==== 105+0+11 (secure 0 0 0) 0x7ff0401ed250 con 0x7ff04014f8c0 2023-12-12T09:45:07.145 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 32 2023-12-12T09:45:07.147 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:07.146+0000 7ff04783d640 1 -- 172.21.15.73:0/1951151061 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7ff02406aec0 msgr2=0x7ff02406d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:07.147 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:07.146+0000 7ff04783d640 1 --2- 172.21.15.73:0/1951151061 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7ff02406aec0 0x7ff02406d380 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7ff03c007fd0 tx=0x7ff03c009040 comp rx=0 tx=0).stop 2023-12-12T09:45:07.148 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:07.146+0000 7ff04783d640 1 -- 172.21.15.73:0/1951151061 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff04014f8c0 msgr2=0x7ff0401e9c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:07.148 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:07.146+0000 7ff04783d640 1 --2- 172.21.15.73:0/1951151061 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff04014f8c0 0x7ff0401e9c80 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7ff03000d620 tx=0x7ff03000dae0 comp rx=0 tx=0).stop 2023-12-12T09:45:07.148 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:07.146+0000 7ff04783d640 1 -- 172.21.15.73:0/1951151061 shutdown_connections 2023-12-12T09:45:07.148 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:07.146+0000 7ff04783d640 1 --2- 172.21.15.73:0/1951151061 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7ff02406aec0 0x7ff02406d380 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:07.148 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:07.146+0000 7ff04783d640 1 --2- 172.21.15.73:0/1951151061 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff040152500 0x7ff0401ea1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:07.148 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:07.146+0000 7ff04783d640 1 --2- 172.21.15.73:0/1951151061 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff04014f8c0 0x7ff0401e9c80 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:07.148 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:07.146+0000 7ff04783d640 1 --2- 172.21.15.73:0/1951151061 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff04006d350 0x7ff040154580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:07.148 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:07.146+0000 7ff04783d640 1 -- 172.21.15.73:0/1951151061 >> 172.21.15.73:0/1951151061 conn(0x7ff04006a4e0 msgr2=0x7ff04006a8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:45:07.148 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:07.146+0000 7ff04783d640 1 -- 172.21.15.73:0/1951151061 shutdown_connections 2023-12-12T09:45:07.148 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:07.146+0000 7ff04783d640 1 -- 172.21.15.73:0/1951151061 wait complete. 2023-12-12T09:45:07.166 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_data pg_num 2023-12-12T09:45:07.382 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:07.381+0000 7f1a8d175640 1 Processor -- start 2023-12-12T09:45:07.383 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:07.381+0000 7f1a8d175640 1 -- start start 2023-12-12T09:45:07.384 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:07.382+0000 7f1a8d175640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f1a8814e770 0x7f1a880c5070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:07.384 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:07.382+0000 7f1a8d175640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f1a880a4f30 0x7f1a880c1510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:07.384 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:07.382+0000 7f1a8d175640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1a880a9a30 0x7f1a88154530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:07.384 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:07.382+0000 7f1a8d175640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a880c1080 con 0x7f1a8814e770 2023-12-12T09:45:07.384 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:07.382+0000 7f1a8d175640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a88155470 con 0x7f1a880a4f30 2023-12-12T09:45:07.384 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:07.382+0000 7f1a8d175640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a88155190 con 0x7f1a880a9a30 2023-12-12T09:45:07.384 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:07.383+0000 7f1a87fff640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f1a8814e770 0x7f1a880c5070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:07.384 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:07.383+0000 7f1a87fff640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f1a8814e770 0x7f1a880c5070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:38184/0 (socket says 172.21.15.73:38184) 2023-12-12T09:45:07.384 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:07.383+0000 7f1a87fff640 1 -- 172.21.15.73:0/4083744170 learned_addr learned my addr 172.21.15.73:0/4083744170 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:45:07.385 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:07.383+0000 7f1a87fff640 1 -- 172.21.15.73:0/4083744170 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1a880a9a30 msgr2=0x7f1a88154530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:45:07.385 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:07.383+0000 7f1a87fff640 1 --2- 172.21.15.73:0/4083744170 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1a880a9a30 0x7f1a88154530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:07.385 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:07.383+0000 7f1a87fff640 1 -- 172.21.15.73:0/4083744170 >> v2:172.21.15.142:3300/0 conn(0x7f1a880a4f30 msgr2=0x7f1a880c1510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:45:07.385 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:07.383+0000 7f1a87fff640 1 --2- 172.21.15.73:0/4083744170 >> v2:172.21.15.142:3300/0 conn(0x7f1a880a4f30 0x7f1a880c1510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:07.385 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:07.383+0000 7f1a87fff640 1 -- 172.21.15.73:0/4083744170 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a880c0d10 con 0x7f1a8814e770 2023-12-12T09:45:07.385 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:07.384+0000 7f1a87fff640 1 --2- 172.21.15.73:0/4083744170 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1a8814e770 0x7f1a880c5070 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f1a880a8e90 tx=0x7f1a7802bdc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7bf3c870940b8b0e server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:45:07.387 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:07.384+0000 7f1a877fe640 1 -- 172.21.15.73:0/4083744170 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a7802c960 con 0x7f1a8814e770 2023-12-12T09:45:07.387 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:07.385+0000 7f1a877fe640 1 -- 172.21.15.73:0/4083744170 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a7802cac0 con 0x7f1a8814e770 2023-12-12T09:45:07.387 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:07.385+0000 7f1a877fe640 1 -- 172.21.15.73:0/4083744170 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a7802ce50 con 0x7f1a8814e770 2023-12-12T09:45:07.387 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:07.385+0000 7f1a8d175640 1 -- 172.21.15.73:0/4083744170 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1a8814e770 msgr2=0x7f1a880c5070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:07.387 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:07.385+0000 7f1a8d175640 1 --2- 172.21.15.73:0/4083744170 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1a8814e770 0x7f1a880c5070 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f1a880a8e90 tx=0x7f1a7802bdc0 comp rx=0 tx=0).stop 2023-12-12T09:45:07.387 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:07.385+0000 7f1a8d175640 1 -- 172.21.15.73:0/4083744170 shutdown_connections 2023-12-12T09:45:07.387 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:07.385+0000 7f1a8d175640 1 --2- 172.21.15.73:0/4083744170 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1a880a9a30 0x7f1a88154530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:07.387 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:07.385+0000 7f1a8d175640 1 --2- 172.21.15.73:0/4083744170 >> v2:172.21.15.142:3300/0 conn(0x7f1a880a4f30 0x7f1a880c1510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:07.387 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:07.385+0000 7f1a8d175640 1 --2- 172.21.15.73:0/4083744170 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1a8814e770 0x7f1a880c5070 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:07.387 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:07.385+0000 7f1a8d175640 1 -- 172.21.15.73:0/4083744170 >> 172.21.15.73:0/4083744170 conn(0x7f1a8806a4e0 msgr2=0x7f1a8806a8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:45:07.387 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:07.385+0000 7f1a8d175640 1 -- 172.21.15.73:0/4083744170 shutdown_connections 2023-12-12T09:45:07.387 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:07.385+0000 7f1a8d175640 1 -- 172.21.15.73:0/4083744170 wait complete. 2023-12-12T09:45:07.388 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:07.387+0000 7f1a8d175640 1 Processor -- start 2023-12-12T09:45:07.388 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:07.387+0000 7f1a8d175640 1 -- start start 2023-12-12T09:45:07.391 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:07.388+0000 7f1a8d175640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1a880a4f30 0x7f1a88145e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:07.391 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:07.388+0000 7f1a8d175640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1a880a9a30 0x7f1a8814ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:07.391 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:07.388+0000 7f1a8d175640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1a8814e770 0x7f1a88151180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:07.392 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:07.388+0000 7f1a8d175640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a881475f0 con 0x7f1a880a9a30 2023-12-12T09:45:07.392 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:07.388+0000 7f1a8d175640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a88147030 con 0x7f1a880a4f30 2023-12-12T09:45:07.392 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:07.388+0000 7f1a8d175640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a88150a60 con 0x7f1a8814e770 2023-12-12T09:45:07.392 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:07.388+0000 7f1a7f7fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1a880a9a30 0x7f1a8814ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:07.392 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:07.388+0000 7f1a7f7fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1a880a9a30 0x7f1a8814ef60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:38196/0 (socket says 172.21.15.73:38196) 2023-12-12T09:45:07.392 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:07.388+0000 7f1a7f7fe640 1 -- 172.21.15.73:0/574827007 learned_addr learned my addr 172.21.15.73:0/574827007 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:45:07.392 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:07.389+0000 7f1a87fff640 1 --2- 172.21.15.73:0/574827007 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1a880a4f30 0x7f1a88145e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:07.392 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:07.389+0000 7f1a8c974640 1 --2- 172.21.15.73:0/574827007 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1a8814e770 0x7f1a88151180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:07.392 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:07.389+0000 7f1a7f7fe640 1 -- 172.21.15.73:0/574827007 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1a8814e770 msgr2=0x7f1a88151180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:07.392 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:07.389+0000 7f1a7f7fe640 1 --2- 172.21.15.73:0/574827007 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1a8814e770 0x7f1a88151180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:07.392 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:07.389+0000 7f1a7f7fe640 1 -- 172.21.15.73:0/574827007 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1a880a4f30 msgr2=0x7f1a88145e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:07.392 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:07.389+0000 7f1a7f7fe640 1 --2- 172.21.15.73:0/574827007 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1a880a4f30 0x7f1a88145e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:07.392 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:07.389+0000 7f1a7f7fe640 1 -- 172.21.15.73:0/574827007 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a78009b30 con 0x7f1a880a9a30 2023-12-12T09:45:07.392 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:07.389+0000 7f1a87fff640 1 --2- 172.21.15.73:0/574827007 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1a880a4f30 0x7f1a88145e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:45:07.393 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:07.389+0000 7f1a8c974640 1 --2- 172.21.15.73:0/574827007 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1a8814e770 0x7f1a88151180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:45:07.393 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:07.389+0000 7f1a7f7fe640 1 --2- 172.21.15.73:0/574827007 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1a880a9a30 0x7f1a8814ef60 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f1a7000b440 tx=0x7f1a7000b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:45:07.393 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:07.389+0000 7f1a857fa640 1 -- 172.21.15.73:0/574827007 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a70011890 con 0x7f1a880a9a30 2023-12-12T09:45:07.393 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:07.389+0000 7f1a857fa640 1 -- 172.21.15.73:0/574827007 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a700119f0 con 0x7f1a880a9a30 2023-12-12T09:45:07.393 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:07.389+0000 7f1a857fa640 1 -- 172.21.15.73:0/574827007 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a70011da0 con 0x7f1a880a9a30 2023-12-12T09:45:07.393 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:07.389+0000 7f1a8d175640 1 -- 172.21.15.73:0/574827007 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a88151c00 con 0x7f1a880a9a30 2023-12-12T09:45:07.393 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:07.390+0000 7f1a8d175640 1 -- 172.21.15.73:0/574827007 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a8814f4a0 con 0x7f1a880a9a30 2023-12-12T09:45:07.393 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:07.391+0000 7f1a8d175640 1 -- 172.21.15.73:0/574827007 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a88067400 con 0x7f1a880a9a30 2023-12-12T09:45:07.394 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:07.392+0000 7f1a857fa640 1 -- 172.21.15.73:0/574827007 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f1a7001a400 con 0x7f1a880a9a30 2023-12-12T09:45:07.394 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:07.393+0000 7f1a857fa640 1 --2- 172.21.15.73:0/574827007 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f1a6806ae70 0x7f1a6806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:07.394 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:07.393+0000 7f1a857fa640 1 -- 172.21.15.73:0/574827007 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 5799+0+0 (secure 0 0 0) 0x7f1a70089950 con 0x7f1a880a9a30 2023-12-12T09:45:07.394 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:07.393+0000 7f1a87fff640 1 --2- 172.21.15.73:0/574827007 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f1a6806ae70 0x7f1a6806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:07.395 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:07.394+0000 7f1a87fff640 1 --2- 172.21.15.73:0/574827007 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f1a6806ae70 0x7f1a6806d330 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f1a78035000 tx=0x7f1a78030000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:45:07.399 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:07.398+0000 7f1a857fa640 1 -- 172.21.15.73:0/574827007 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f1a70054990 con 0x7f1a880a9a30 2023-12-12T09:45:07.589 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:07.587+0000 7f1a8d175640 1 -- 172.21.15.73:0/574827007 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"} v 0) v1 -- 0x7f1a880c1fd0 con 0x7f1a880a9a30 2023-12-12T09:45:07.589 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:07.588+0000 7f1a857fa640 1 -- 172.21.15.73:0/574827007 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"}]=0 v41) v1 ==== 101+0+11 (secure 0 0 0) 0x7f1a70015020 con 0x7f1a880a9a30 2023-12-12T09:45:07.590 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 64 2023-12-12T09:45:07.593 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:07.591+0000 7f1a8d175640 1 -- 172.21.15.73:0/574827007 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f1a6806ae70 msgr2=0x7f1a6806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:07.593 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:07.591+0000 7f1a8d175640 1 --2- 172.21.15.73:0/574827007 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f1a6806ae70 0x7f1a6806d330 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f1a78035000 tx=0x7f1a78030000 comp rx=0 tx=0).stop 2023-12-12T09:45:07.593 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:07.591+0000 7f1a8d175640 1 -- 172.21.15.73:0/574827007 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1a880a9a30 msgr2=0x7f1a8814ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:07.593 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:07.591+0000 7f1a8d175640 1 --2- 172.21.15.73:0/574827007 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1a880a9a30 0x7f1a8814ef60 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f1a7000b440 tx=0x7f1a7000b900 comp rx=0 tx=0).stop 2023-12-12T09:45:07.593 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:07.591+0000 7f1a8d175640 1 -- 172.21.15.73:0/574827007 shutdown_connections 2023-12-12T09:45:07.593 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:07.591+0000 7f1a8d175640 1 --2- 172.21.15.73:0/574827007 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f1a6806ae70 0x7f1a6806d330 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:07.593 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:07.591+0000 7f1a8d175640 1 --2- 172.21.15.73:0/574827007 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1a8814e770 0x7f1a88151180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:07.593 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:07.591+0000 7f1a8d175640 1 --2- 172.21.15.73:0/574827007 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1a880a9a30 0x7f1a8814ef60 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:07.593 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:07.591+0000 7f1a8d175640 1 --2- 172.21.15.73:0/574827007 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1a880a4f30 0x7f1a88145e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:07.593 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:07.591+0000 7f1a8d175640 1 -- 172.21.15.73:0/574827007 >> 172.21.15.73:0/574827007 conn(0x7f1a8806a4e0 msgr2=0x7f1a880c4d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:45:07.593 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:07.591+0000 7f1a8d175640 1 -- 172.21.15.73:0/574827007 shutdown_connections 2023-12-12T09:45:07.594 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:07.591+0000 7f1a8d175640 1 -- 172.21.15.73:0/574827007 wait complete. 2023-12-12T09:45:07.611 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-12T09:45:07.823 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:07.821+0000 7fed1f6e7640 1 Processor -- start 2023-12-12T09:45:07.823 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:07.822+0000 7fed1f6e7640 1 -- start start 2023-12-12T09:45:07.825 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:07.823+0000 7fed1f6e7640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fed1814fa40 0x7fed1806a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:07.825 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:07.823+0000 7fed1f6e7640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed18152610 con 0x7fed1806db70 2023-12-12T09:45:07.825 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:07.823+0000 7fed1f6e7640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed181528f0 con 0x7fed180c5070 2023-12-12T09:45:07.825 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:07.823+0000 7fed1f6e7640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed18152bd0 con 0x7fed1814fa40 2023-12-12T09:45:07.825 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:07.823+0000 7fed1d483640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fed1814fa40 0x7fed1806a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:07.825 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:07.824+0000 7fed1d483640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fed1814fa40 0x7fed1806a4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:38212/0 (socket says 172.21.15.73:38212) 2023-12-12T09:45:07.825 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:07.824+0000 7fed1d483640 1 -- 172.21.15.73:0/1164791525 learned_addr learned my addr 172.21.15.73:0/1164791525 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:45:07.825 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:07.824+0000 7fed1cc82640 1 --1- 172.21.15.73:0/1164791525 >> v1:172.21.15.73:6789/0 conn(0x7fed1806db70 0x7fed180c39b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:51206/0 (socket says 172.21.15.73:51206) 2023-12-12T09:45:07.825 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:07.824+0000 7fed1d483640 1 -- 172.21.15.73:0/1164791525 >> v1:172.21.15.142:6789/0 conn(0x7fed180c5070 legacy=0x7fed180c40c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:45:07.826 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:07.824+0000 7fed1d483640 1 -- 172.21.15.73:0/1164791525 >> v1:172.21.15.73:6789/0 conn(0x7fed1806db70 legacy=0x7fed180c39b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:07.826 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:07.824+0000 7fed1d483640 1 -- 172.21.15.73:0/1164791525 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed18152eb0 con 0x7fed1814fa40 2023-12-12T09:45:07.827 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:07.826+0000 7fed1d483640 1 --2- 172.21.15.73:0/1164791525 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fed1814fa40 0x7fed1806a4e0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7fed14009870 tx=0x7fed1402b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8a5ed76e87ff4f server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:45:07.828 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:07.827+0000 7fed0ffff640 1 -- 172.21.15.73:0/1164791525 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed14031860 con 0x7fed1814fa40 2023-12-12T09:45:07.828 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:07.827+0000 7fed0ffff640 1 -- 172.21.15.73:0/1164791525 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed140319c0 con 0x7fed1814fa40 2023-12-12T09:45:07.828 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:07.827+0000 7fed0ffff640 1 -- 172.21.15.73:0/1164791525 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed14031d50 con 0x7fed1814fa40 2023-12-12T09:45:07.829 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:07.827+0000 7fed1f6e7640 1 -- 172.21.15.73:0/1164791525 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fed1814fa40 msgr2=0x7fed1806a4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:07.829 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:07.827+0000 7fed1f6e7640 1 --2- 172.21.15.73:0/1164791525 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fed1814fa40 0x7fed1806a4e0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7fed14009870 tx=0x7fed1402b900 comp rx=0 tx=0).stop 2023-12-12T09:45:07.829 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:07.828+0000 7fed1f6e7640 1 -- 172.21.15.73:0/1164791525 shutdown_connections 2023-12-12T09:45:07.829 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:07.828+0000 7fed1f6e7640 1 --2- 172.21.15.73:0/1164791525 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fed1814fa40 0x7fed1806a4e0 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:07.829 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:07.828+0000 7fed1f6e7640 1 -- 172.21.15.73:0/1164791525 >> 172.21.15.73:0/1164791525 conn(0x7fed180a8130 msgr2=0x7fed180c24b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:45:07.830 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:07.828+0000 7fed1f6e7640 1 -- 172.21.15.73:0/1164791525 shutdown_connections 2023-12-12T09:45:07.830 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:07.828+0000 7fed1f6e7640 1 -- 172.21.15.73:0/1164791525 wait complete. 2023-12-12T09:45:07.830 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:07.829+0000 7fed1f6e7640 1 Processor -- start 2023-12-12T09:45:07.830 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:07.829+0000 7fed1f6e7640 1 -- start start 2023-12-12T09:45:07.833 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:07.830+0000 7fed1f6e7640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fed1806db70 0x7fed181ed040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:07.833 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:07.830+0000 7fed1f6e7640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fed180c5070 0x7fed18148830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:07.833 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:07.830+0000 7fed1f6e7640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fed1814fa40 0x7fed18151360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:07.833 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:07.830+0000 7fed1f6e7640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed18150ed0 con 0x7fed180c5070 2023-12-12T09:45:07.834 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:07.830+0000 7fed1f6e7640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed180a73e0 con 0x7fed1806db70 2023-12-12T09:45:07.834 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:07.830+0000 7fed1f6e7640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed18148d70 con 0x7fed1814fa40 2023-12-12T09:45:07.834 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:07.831+0000 7fed1cc82640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fed180c5070 0x7fed18148830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:07.834 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:07.831+0000 7fed1cc82640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fed180c5070 0x7fed18148830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:38226/0 (socket says 172.21.15.73:38226) 2023-12-12T09:45:07.834 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:07.831+0000 7fed1cc82640 1 -- 172.21.15.73:0/581652677 learned_addr learned my addr 172.21.15.73:0/581652677 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:45:07.834 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:07.831+0000 7fed1d483640 1 --2- 172.21.15.73:0/581652677 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fed1806db70 0x7fed181ed040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:07.834 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:07.831+0000 7fed1cc82640 1 -- 172.21.15.73:0/581652677 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fed1814fa40 msgr2=0x7fed18151360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:07.834 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:07.831+0000 7fed1dc84640 1 --2- 172.21.15.73:0/581652677 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fed1814fa40 0x7fed18151360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:07.834 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:07.831+0000 7fed1cc82640 1 --2- 172.21.15.73:0/581652677 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fed1814fa40 0x7fed18151360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:07.834 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:07.831+0000 7fed1cc82640 1 -- 172.21.15.73:0/581652677 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fed1806db70 msgr2=0x7fed181ed040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:07.834 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:07.831+0000 7fed1cc82640 1 --2- 172.21.15.73:0/581652677 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fed1806db70 0x7fed181ed040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:07.834 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:07.831+0000 7fed1cc82640 1 -- 172.21.15.73:0/581652677 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed140094d0 con 0x7fed180c5070 2023-12-12T09:45:07.834 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:07.832+0000 7fed1cc82640 1 --2- 172.21.15.73:0/581652677 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fed180c5070 0x7fed18148830 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7fed0800c3e0 tx=0x7fed0800c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:45:07.834 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:07.832+0000 7fed0dffb640 1 -- 172.21.15.73:0/581652677 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed080074e0 con 0x7fed180c5070 2023-12-12T09:45:07.835 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:07.832+0000 7fed0dffb640 1 -- 172.21.15.73:0/581652677 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed08007640 con 0x7fed180c5070 2023-12-12T09:45:07.835 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:07.832+0000 7fed1f6e7640 1 -- 172.21.15.73:0/581652677 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed180a9930 con 0x7fed180c5070 2023-12-12T09:45:07.835 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:07.832+0000 7fed0dffb640 1 -- 172.21.15.73:0/581652677 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed080049e0 con 0x7fed180c5070 2023-12-12T09:45:07.835 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:07.832+0000 7fed1f6e7640 1 -- 172.21.15.73:0/581652677 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed180a9ef0 con 0x7fed180c5070 2023-12-12T09:45:07.835 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:07.833+0000 7fed1f6e7640 1 -- 172.21.15.73:0/581652677 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed18151080 con 0x7fed180c5070 2023-12-12T09:45:07.836 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:07.834+0000 7fed0dffb640 1 -- 172.21.15.73:0/581652677 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fed08004b40 con 0x7fed180c5070 2023-12-12T09:45:07.837 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:07.835+0000 7fed0dffb640 1 --2- 172.21.15.73:0/581652677 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fecfc06ae70 0x7fecfc06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:07.837 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:07.836+0000 7fed0dffb640 1 -- 172.21.15.73:0/581652677 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 5799+0+0 (secure 0 0 0) 0x7fed08088fe0 con 0x7fed180c5070 2023-12-12T09:45:07.837 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:07.836+0000 7fed1d483640 1 --2- 172.21.15.73:0/581652677 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fecfc06ae70 0x7fecfc06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:07.838 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:07.836+0000 7fed1d483640 1 --2- 172.21.15.73:0/581652677 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fecfc06ae70 0x7fecfc06d330 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fed14036000 tx=0x7fed1403c040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:45:07.841 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:07.840+0000 7fed0dffb640 1 -- 172.21.15.73:0/581652677 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fed18151080 con 0x7fed180c5070 2023-12-12T09:45:08.064 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:08.062+0000 7fed1f6e7640 1 -- 172.21.15.73:0/581652677 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fed18067580 con 0x7fed180c5070 2023-12-12T09:45:08.064 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:08.063+0000 7fed0dffb640 1 -- 172.21.15.73:0/581652677 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) v1 ==== 94+0+4918 (secure 0 0 0) 0x7fed08054080 con 0x7fed180c5070 2023-12-12T09:45:08.065 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-12T09:45:08.065 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":21,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4517,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6835/2407815368","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6833","nonce":2407815368},{"type":"v1","addr":"172.21.15.142:6835","nonce":2407815368}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":4720,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6834/153753304","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6832","nonce":153753304},{"type":"v1","addr":"172.21.15.142:6834","nonce":153753304}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":5532,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6837/3504911419","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6835","nonce":3504911419},{"type":"v1","addr":"172.21.15.73:6837","nonce":3504911419}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":19,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-12T09:44:36.098486+0000","modified":"2023-12-12T09:44:39.152510+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4962},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4962":{"gid":4962,"name":"a","rank":0,"incarnation":16,"state":"up:active","state_seq":8,"addr":"172.21.15.73:6836/2500303907","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":2500303907},{"type":"v1","addr":"172.21.15.73:6836","nonce":2500303907}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-12-12T09:45:08.065 INFO:teuthology.orchestra.run.smithi073.stderr:dumped fsmap epoch 21 2023-12-12T09:45:08.067 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:08.066+0000 7fed1f6e7640 1 -- 172.21.15.73:0/581652677 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fecfc06ae70 msgr2=0x7fecfc06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:08.067 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:08.066+0000 7fed1f6e7640 1 --2- 172.21.15.73:0/581652677 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fecfc06ae70 0x7fecfc06d330 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fed14036000 tx=0x7fed1403c040 comp rx=0 tx=0).stop 2023-12-12T09:45:08.067 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:08.066+0000 7fed1f6e7640 1 -- 172.21.15.73:0/581652677 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fed180c5070 msgr2=0x7fed18148830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:08.068 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:08.066+0000 7fed1f6e7640 1 --2- 172.21.15.73:0/581652677 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fed180c5070 0x7fed18148830 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7fed0800c3e0 tx=0x7fed0800c8a0 comp rx=0 tx=0).stop 2023-12-12T09:45:08.068 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:08.066+0000 7fed1f6e7640 1 -- 172.21.15.73:0/581652677 shutdown_connections 2023-12-12T09:45:08.068 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:08.066+0000 7fed1f6e7640 1 --2- 172.21.15.73:0/581652677 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fecfc06ae70 0x7fecfc06d330 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:08.068 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:08.066+0000 7fed1f6e7640 1 --2- 172.21.15.73:0/581652677 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fed1814fa40 0x7fed18151360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:08.068 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:08.066+0000 7fed1f6e7640 1 --2- 172.21.15.73:0/581652677 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fed180c5070 0x7fed18148830 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:08.068 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:08.066+0000 7fed1f6e7640 1 --2- 172.21.15.73:0/581652677 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fed1806db70 0x7fed181ed040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:08.068 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:08.066+0000 7fed1f6e7640 1 -- 172.21.15.73:0/581652677 >> 172.21.15.73:0/581652677 conn(0x7fed180a8130 msgr2=0x7fed180c63b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:45:08.068 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:08.066+0000 7fed1f6e7640 1 -- 172.21.15.73:0/581652677 shutdown_connections 2023-12-12T09:45:08.068 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:08.066+0000 7fed1f6e7640 1 -- 172.21.15.73:0/581652677 wait complete. 2023-12-12T09:45:08.087 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-12T09:45:08.294 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:08.293+0000 7f7444a9b640 1 Processor -- start 2023-12-12T09:45:08.294 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:08.293+0000 7f7444a9b640 1 -- start start 2023-12-12T09:45:08.295 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:08.294+0000 7f7444a9b640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f744006db70 0x7f74400c39b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:08.295 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:08.294+0000 7f7444a9b640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f74400c5070 0x7f74400c3ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:08.296 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:08.294+0000 7f7444a9b640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7440152610 con 0x7f744014fa40 2023-12-12T09:45:08.296 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:08.294+0000 7f7444a9b640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74401528f0 con 0x7f74400c5070 2023-12-12T09:45:08.296 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:08.294+0000 7f7444a9b640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7440152bd0 con 0x7f744006db70 2023-12-12T09:45:08.296 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:08.294+0000 7f743e59c640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f744014fa40 0x7f744006a4e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:51210/0 (socket says 172.21.15.73:51210) 2023-12-12T09:45:08.296 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:08.294+0000 7f743e59c640 1 -- 172.21.15.73:0/3397564474 learned_addr learned my addr 172.21.15.73:0/3397564474 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-12T09:45:08.298 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:08.295+0000 7f743dd9b640 1 -- 172.21.15.73:0/3397564474 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1374908240 0 0) 0x7f7440152610 con 0x7f744014fa40 2023-12-12T09:45:08.298 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:08.295+0000 7f743ed9d640 1 --2- 172.21.15.73:0/3397564474 >> v2:172.21.15.142:3300/0 conn(0x7f74400c5070 0x7f74400c3ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:08.298 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:08.295+0000 7f743dd9b640 1 -- 172.21.15.73:0/3397564474 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f742c003520 con 0x7f744014fa40 2023-12-12T09:45:08.298 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:08.295+0000 7f7437fff640 1 --2- 172.21.15.73:0/3397564474 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f744006db70 0x7f74400c39b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:08.299 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:08.295+0000 7f743dd9b640 1 -- 172.21.15.73:0/3397564474 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3186398043 0 0) 0x7f742c003520 con 0x7f744014fa40 2023-12-12T09:45:08.299 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:08.295+0000 7f743dd9b640 1 -- 172.21.15.73:0/3397564474 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f744006db70 msgr2=0x7f74400c39b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:45:08.299 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:08.295+0000 7f743dd9b640 1 --2- 172.21.15.73:0/3397564474 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f744006db70 0x7f74400c39b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:08.299 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:08.295+0000 7f743dd9b640 1 -- 172.21.15.73:0/3397564474 >> v2:172.21.15.142:3300/0 conn(0x7f74400c5070 msgr2=0x7f74400c3ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:45:08.299 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:08.295+0000 7f743dd9b640 1 --2- 172.21.15.73:0/3397564474 >> v2:172.21.15.142:3300/0 conn(0x7f74400c5070 0x7f74400c3ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:08.299 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:08.295+0000 7f743dd9b640 1 -- 172.21.15.73:0/3397564474 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7440152eb0 con 0x7f744014fa40 2023-12-12T09:45:08.299 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:08.295+0000 7f743dd9b640 1 -- 172.21.15.73:0/3397564474 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3186547832 0 0) 0x7f7430001670 con 0x7f744014fa40 2023-12-12T09:45:08.299 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:08.295+0000 7f743dd9b640 1 -- 172.21.15.73:0/3397564474 >> v1:172.21.15.73:6789/0 conn(0x7f744014fa40 legacy=0x7f744006a4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:08.299 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:08.295+0000 7f743dd9b640 1 --2- 172.21.15.73:0/3397564474 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f742c003970 0x7f742c003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:08.299 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:08.295+0000 7f743dd9b640 1 --2- 172.21.15.73:0/3397564474 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f742c0047c0 0x7f742c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:08.299 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:08.295+0000 7f743dd9b640 1 --2- 172.21.15.73:0/3397564474 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f744006db70 0x7f742c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:08.299 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:08.295+0000 7f743dd9b640 1 -- 172.21.15.73:0/3397564474 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74401528f0 con 0x7f742c003970 2023-12-12T09:45:08.299 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:08.295+0000 7f743dd9b640 1 -- 172.21.15.73:0/3397564474 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7440152bd0 con 0x7f742c0047c0 2023-12-12T09:45:08.299 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:08.295+0000 7f743dd9b640 1 -- 172.21.15.73:0/3397564474 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f742c00ba80 con 0x7f744006db70 2023-12-12T09:45:08.300 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:08.295+0000 7f743e59c640 1 --2- 172.21.15.73:0/3397564474 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f742c003970 0x7f742c003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:08.300 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:08.296+0000 7f743ed9d640 1 --2- 172.21.15.73:0/3397564474 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f744006db70 0x7f742c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:08.300 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:08.296+0000 7f7437fff640 1 --2- 172.21.15.73:0/3397564474 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f742c0047c0 0x7f742c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:08.300 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:08.296+0000 7f743e59c640 1 -- 172.21.15.73:0/3397564474 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f744006db70 msgr2=0x7f742c005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:45:08.300 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:08.296+0000 7f743e59c640 1 --2- 172.21.15.73:0/3397564474 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f744006db70 0x7f742c005180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:08.300 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:08.296+0000 7f743e59c640 1 -- 172.21.15.73:0/3397564474 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f742c0047c0 msgr2=0x7f742c004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:45:08.300 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:08.296+0000 7f743e59c640 1 --2- 172.21.15.73:0/3397564474 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f742c0047c0 0x7f742c004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:08.300 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:08.296+0000 7f743e59c640 1 -- 172.21.15.73:0/3397564474 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f742c003520 con 0x7f742c003970 2023-12-12T09:45:08.300 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:08.296+0000 7f7437fff640 1 --2- 172.21.15.73:0/3397564474 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f742c0047c0 0x7f742c004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:45:08.300 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:08.297+0000 7f743e59c640 1 --2- 172.21.15.73:0/3397564474 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f742c003970 0x7f742c003d90 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f7430001050 tx=0x7f742c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68b5afb43d6f99ae server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:45:08.300 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:08.297+0000 7f743dd9b640 1 -- 172.21.15.73:0/3397564474 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7430005ad0 con 0x7f742c003970 2023-12-12T09:45:08.300 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:08.297+0000 7f743dd9b640 1 -- 172.21.15.73:0/3397564474 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7430005c30 con 0x7f742c003970 2023-12-12T09:45:08.300 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:08.297+0000 7f743dd9b640 1 -- 172.21.15.73:0/3397564474 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f743002c7c0 con 0x7f742c003970 2023-12-12T09:45:08.302 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:08.298+0000 7f7444a9b640 1 -- 172.21.15.73:0/3397564474 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f742c003970 msgr2=0x7f742c003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:08.302 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:08.298+0000 7f7444a9b640 1 --2- 172.21.15.73:0/3397564474 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f742c003970 0x7f742c003d90 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f7430001050 tx=0x7f742c0057f0 comp rx=0 tx=0).stop 2023-12-12T09:45:08.302 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:08.298+0000 7f743ed9d640 1 -- 172.21.15.73:0/3397564474 reap_dead start 2023-12-12T09:45:08.302 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:08.298+0000 7f7444a9b640 1 -- 172.21.15.73:0/3397564474 shutdown_connections 2023-12-12T09:45:08.302 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:08.298+0000 7f7444a9b640 1 -- 172.21.15.73:0/3397564474 >> 172.21.15.73:0/3397564474 conn(0x7f74400a8130 msgr2=0x7f74400c24b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:45:08.302 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:08.298+0000 7f7444a9b640 1 -- 172.21.15.73:0/3397564474 shutdown_connections 2023-12-12T09:45:08.302 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:08.298+0000 7f7444a9b640 1 -- 172.21.15.73:0/3397564474 wait complete. 2023-12-12T09:45:08.302 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:08.300+0000 7f7444a9b640 1 Processor -- start 2023-12-12T09:45:08.302 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:08.300+0000 7f7444a9b640 1 -- start start 2023-12-12T09:45:08.303 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:08.301+0000 7f7444a9b640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f742c003970 0x7f74401d9030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:08.303 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:08.301+0000 7f7444a9b640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f74400bd6f0 0x7f74401eb240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:08.303 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:08.301+0000 7f7444a9b640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f744014ca80 0x7f744014cf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:08.303 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:08.301+0000 7f7444a9b640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74400bb450 con 0x7f744014ca80 2023-12-12T09:45:08.303 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:08.301+0000 7f7444a9b640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74400bd2f0 con 0x7f74400bd6f0 2023-12-12T09:45:08.303 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:08.301+0000 7f7444a9b640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74400bd010 con 0x7f742c003970 2023-12-12T09:45:08.303 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:08.301+0000 7f743ed9d640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f744014ca80 0x7f744014cf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:08.303 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:08.301+0000 7f743ed9d640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f744014ca80 0x7f744014cf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:38236/0 (socket says 172.21.15.73:38236) 2023-12-12T09:45:08.303 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:08.301+0000 7f743ed9d640 1 -- 172.21.15.73:0/3267475103 learned_addr learned my addr 172.21.15.73:0/3267475103 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:45:08.304 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:08.301+0000 7f743ed9d640 1 -- 172.21.15.73:0/3267475103 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f742c003970 msgr2=0x7f74401d9030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:08.304 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:08.301+0000 7f743ed9d640 1 --2- 172.21.15.73:0/3267475103 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f742c003970 0x7f74401d9030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:08.304 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:08.301+0000 7f743ed9d640 1 -- 172.21.15.73:0/3267475103 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f74400bd6f0 msgr2=0x7f74401eb240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:08.304 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:08.301+0000 7f743ed9d640 1 --2- 172.21.15.73:0/3267475103 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f74400bd6f0 0x7f74401eb240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:08.305 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:08.301+0000 7f743ed9d640 1 -- 172.21.15.73:0/3267475103 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74401eba80 con 0x7f744014ca80 2023-12-12T09:45:08.305 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:08.302+0000 7f743ed9d640 1 --2- 172.21.15.73:0/3267475103 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f744014ca80 0x7f744014cf30 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f744006e080 tx=0x7f7438009cb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:45:08.305 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:08.302+0000 7f7436ffd640 1 -- 172.21.15.73:0/3267475103 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7438007cf0 con 0x7f744014ca80 2023-12-12T09:45:08.305 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:08.302+0000 7f7436ffd640 1 -- 172.21.15.73:0/3267475103 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7438007e70 con 0x7f744014ca80 2023-12-12T09:45:08.305 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:08.302+0000 7f7444a9b640 1 -- 172.21.15.73:0/3267475103 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74401ebd60 con 0x7f744014ca80 2023-12-12T09:45:08.305 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:08.302+0000 7f7436ffd640 1 -- 172.21.15.73:0/3267475103 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7438014620 con 0x7f744014ca80 2023-12-12T09:45:08.305 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:08.302+0000 7f7444a9b640 1 -- 172.21.15.73:0/3267475103 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74401eb780 con 0x7f744014ca80 2023-12-12T09:45:08.305 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:08.303+0000 7f7444a9b640 1 -- 172.21.15.73:0/3267475103 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74401ebef0 con 0x7f744014ca80 2023-12-12T09:45:08.306 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:08.304+0000 7f7436ffd640 1 -- 172.21.15.73:0/3267475103 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f743801d3b0 con 0x7f744014ca80 2023-12-12T09:45:08.306 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:08.305+0000 7f7436ffd640 1 --2- 172.21.15.73:0/3267475103 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f742006ae40 0x7f742006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:08.306 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:08.305+0000 7f7436ffd640 1 -- 172.21.15.73:0/3267475103 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 5799+0+0 (secure 0 0 0) 0x7f7438089280 con 0x7f744014ca80 2023-12-12T09:45:08.306 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:08.305+0000 7f743e59c640 1 --2- 172.21.15.73:0/3267475103 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f742006ae40 0x7f742006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:08.307 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:08.306+0000 7f743e59c640 1 --2- 172.21.15.73:0/3267475103 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f742006ae40 0x7f742006d300 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f742c0057a0 tx=0x7f743002e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:45:08.311 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:08.310+0000 7f7436ffd640 1 -- 172.21.15.73:0/3267475103 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f74380542c0 con 0x7f744014ca80 2023-12-12T09:45:08.488 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:08.487+0000 7f7444a9b640 1 -- 172.21.15.73:0/3267475103 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f74400c35a0 con 0x7f744014ca80 2023-12-12T09:45:08.490 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:08.489+0000 7f7436ffd640 1 -- 172.21.15.73:0/3267475103 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v41) v1 ==== 74+0+16658 (secure 0 0 0) 0x7f74380578e0 con 0x7f744014ca80 2023-12-12T09:45:08.490 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-12T09:45:08.490 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":41,"fsid":"ba240992-02b8-4c7e-92f2-27eb29ac433b","created":"2023-12-12T09:43:02.454719+0000","modified":"2023-12-12T09:45:05.798881+0000","last_up_change":"2023-12-12T09:43:13.913440+0000","last_in_change":"2023-12-12T09:43:05.925348+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-12T09:43:15.525508+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs2_metadata","create_time":"2023-12-12T09:44:34.424645+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs2_data","create_time":"2023-12-12T09:44:35.090149+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"dd9074be-dbe2-4c34-9896-a4223d8d3940","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":4047810203},{"type":"v1","addr":"172.21.15.73:6801","nonce":4047810203}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":4047810203},{"type":"v1","addr":"172.21.15.73:6803","nonce":4047810203}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":4047810203},{"type":"v1","addr":"172.21.15.73:6807","nonce":4047810203}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":4047810203},{"type":"v1","addr":"172.21.15.73:6805","nonce":4047810203}]},"public_addr":"172.21.15.73:6801/4047810203","cluster_addr":"172.21.15.73:6803/4047810203","heartbeat_back_addr":"172.21.15.73:6807/4047810203","heartbeat_front_addr":"172.21.15.73:6805/4047810203","state":["exists","up"]},{"osd":1,"uuid":"c4a05052-96d4-4758-a4e1-1a37f1e07fed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":1356058331},{"type":"v1","addr":"172.21.15.73:6824","nonce":1356058331}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":1356058331},{"type":"v1","addr":"172.21.15.73:6827","nonce":1356058331}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":1356058331},{"type":"v1","addr":"172.21.15.73:6831","nonce":1356058331}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":1356058331},{"type":"v1","addr":"172.21.15.73:6829","nonce":1356058331}]},"public_addr":"172.21.15.73:6824/1356058331","cluster_addr":"172.21.15.73:6827/1356058331","heartbeat_back_addr":"172.21.15.73:6831/1356058331","heartbeat_front_addr":"172.21.15.73:6829/1356058331","state":["exists","up"]},{"osd":2,"uuid":"512bc8ac-72c2-40d4-b3d2-d867a92c5213","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":1228903316},{"type":"v1","addr":"172.21.15.73:6817","nonce":1228903316}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":1228903316},{"type":"v1","addr":"172.21.15.73:6819","nonce":1228903316}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6823","nonce":1228903316},{"type":"v1","addr":"172.21.15.73:6825","nonce":1228903316}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":1228903316},{"type":"v1","addr":"172.21.15.73:6821","nonce":1228903316}]},"public_addr":"172.21.15.73:6817/1228903316","cluster_addr":"172.21.15.73:6819/1228903316","heartbeat_back_addr":"172.21.15.73:6825/1228903316","heartbeat_front_addr":"172.21.15.73:6821/1228903316","state":["exists","up"]},{"osd":3,"uuid":"3d1a91e0-42bf-437a-8eae-8d357c8f63a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":1293329670},{"type":"v1","addr":"172.21.15.73:6809","nonce":1293329670}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6810","nonce":1293329670},{"type":"v1","addr":"172.21.15.73:6811","nonce":1293329670}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":1293329670},{"type":"v1","addr":"172.21.15.73:6815","nonce":1293329670}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":1293329670},{"type":"v1","addr":"172.21.15.73:6813","nonce":1293329670}]},"public_addr":"172.21.15.73:6809/1293329670","cluster_addr":"172.21.15.73:6811/1293329670","heartbeat_back_addr":"172.21.15.73:6815/1293329670","heartbeat_front_addr":"172.21.15.73:6813/1293329670","state":["exists","up"]},{"osd":4,"uuid":"4b302fff-834c-4069-ac19-00e46f6c87b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":3727975702},{"type":"v1","addr":"172.21.15.142:6801","nonce":3727975702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":3727975702},{"type":"v1","addr":"172.21.15.142:6803","nonce":3727975702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6809","nonce":3727975702},{"type":"v1","addr":"172.21.15.142:6811","nonce":3727975702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6805","nonce":3727975702},{"type":"v1","addr":"172.21.15.142:6807","nonce":3727975702}]},"public_addr":"172.21.15.142:6801/3727975702","cluster_addr":"172.21.15.142:6803/3727975702","heartbeat_back_addr":"172.21.15.142:6811/3727975702","heartbeat_front_addr":"172.21.15.142:6807/3727975702","state":["exists","up"]},{"osd":5,"uuid":"d7cdace2-67d0-45cc-95f2-515cf6ef1b82","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6817","nonce":2353193632},{"type":"v1","addr":"172.21.15.142:6819","nonce":2353193632}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6821","nonce":2353193632},{"type":"v1","addr":"172.21.15.142:6823","nonce":2353193632}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6829","nonce":2353193632},{"type":"v1","addr":"172.21.15.142:6831","nonce":2353193632}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6825","nonce":2353193632},{"type":"v1","addr":"172.21.15.142:6827","nonce":2353193632}]},"public_addr":"172.21.15.142:6819/2353193632","cluster_addr":"172.21.15.142:6823/2353193632","heartbeat_back_addr":"172.21.15.142:6831/2353193632","heartbeat_front_addr":"172.21.15.142:6827/2353193632","state":["exists","up"]},{"osd":6,"uuid":"649ce78a-5626-445c-aedc-a651ed05a6f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":2006111986},{"type":"v1","addr":"172.21.15.142:6806","nonce":2006111986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":2006111986},{"type":"v1","addr":"172.21.15.142:6810","nonce":2006111986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":2006111986},{"type":"v1","addr":"172.21.15.142:6815","nonce":2006111986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":2006111986},{"type":"v1","addr":"172.21.15.142:6813","nonce":2006111986}]},"public_addr":"172.21.15.142:6806/2006111986","cluster_addr":"172.21.15.142:6810/2006111986","heartbeat_back_addr":"172.21.15.142:6815/2006111986","heartbeat_front_addr":"172.21.15.142:6813/2006111986","state":["exists","up"]},{"osd":7,"uuid":"af15ae3b-c1d0-4acf-92db-8a1805494d13","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":2573794341},{"type":"v1","addr":"172.21.15.142:6818","nonce":2573794341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":2573794341},{"type":"v1","addr":"172.21.15.142:6822","nonce":2573794341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":2573794341},{"type":"v1","addr":"172.21.15.142:6830","nonce":2573794341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":2573794341},{"type":"v1","addr":"172.21.15.142:6826","nonce":2573794341}]},"public_addr":"172.21.15.142:6818/2573794341","cluster_addr":"172.21.15.142:6822/2573794341","heartbeat_back_addr":"172.21.15.142:6830/2573794341","heartbeat_front_addr":"172.21.15.142:6826/2573794341","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.185824+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.262103+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.225556+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:10.523459+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:10.706035+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.257339+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.301776+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.051960+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.73:6837/1534083424":"2023-12-13T09:45:02.776929+0000","172.21.15.73:6835/1534083424":"2023-12-13T09:45:02.776929+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-12T09:45:08.493 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:08.491+0000 7f7444a9b640 1 -- 172.21.15.73:0/3267475103 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f742006ae40 msgr2=0x7f742006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:08.493 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:08.491+0000 7f7444a9b640 1 --2- 172.21.15.73:0/3267475103 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f742006ae40 0x7f742006d300 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f742c0057a0 tx=0x7f743002e000 comp rx=0 tx=0).stop 2023-12-12T09:45:08.493 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:08.491+0000 7f7444a9b640 1 -- 172.21.15.73:0/3267475103 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f744014ca80 msgr2=0x7f744014cf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:08.493 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:08.491+0000 7f7444a9b640 1 --2- 172.21.15.73:0/3267475103 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f744014ca80 0x7f744014cf30 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f744006e080 tx=0x7f7438009cb0 comp rx=0 tx=0).stop 2023-12-12T09:45:08.493 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:08.491+0000 7f7444a9b640 1 -- 172.21.15.73:0/3267475103 shutdown_connections 2023-12-12T09:45:08.493 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:08.491+0000 7f7444a9b640 1 --2- 172.21.15.73:0/3267475103 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f742006ae40 0x7f742006d300 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:08.493 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:08.491+0000 7f7444a9b640 1 --2- 172.21.15.73:0/3267475103 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f744014ca80 0x7f744014cf30 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:08.493 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:08.491+0000 7f7444a9b640 1 --2- 172.21.15.73:0/3267475103 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f74400bd6f0 0x7f74401eb240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:08.493 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:08.491+0000 7f7444a9b640 1 --2- 172.21.15.73:0/3267475103 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f742c003970 0x7f74401d9030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:08.493 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:08.491+0000 7f7444a9b640 1 -- 172.21.15.73:0/3267475103 >> 172.21.15.73:0/3267475103 conn(0x7f74400a8130 msgr2=0x7f74400c2440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:45:08.493 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:08.492+0000 7f7444a9b640 1 -- 172.21.15.73:0/3267475103 shutdown_connections 2023-12-12T09:45:08.493 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:08.492+0000 7f7444a9b640 1 -- 172.21.15.73:0/3267475103 wait complete. 2023-12-12T09:45:08.511 INFO:tasks.cephfs.filesystem:Destroying file system cephfs2 and related pools 2023-12-12T09:45:08.512 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-12T09:45:08.720 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:08.719+0000 7f8654e64640 1 Processor -- start 2023-12-12T09:45:08.720 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:08.719+0000 7f8654e64640 1 -- start start 2023-12-12T09:45:08.722 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:08.720+0000 7f8654e64640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f86500a50f0 0x7f86500a9050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:08.722 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:08.720+0000 7f8654e64640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f865006bf20 0x7f86500a9590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:08.722 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:08.720+0000 7f8654e64640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86500c0b50 con 0x7f86501552e0 2023-12-12T09:45:08.722 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:08.720+0000 7f8654e64640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86500c04d0 con 0x7f865006bf20 2023-12-12T09:45:08.722 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:08.720+0000 7f8654e64640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f865006c880 con 0x7f86500a50f0 2023-12-12T09:45:08.723 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:08.721+0000 7f864ed9d640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f865006bf20 0x7f86500a9590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:08.723 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:08.721+0000 7f8645d9b640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f86500a50f0 0x7f86500a9050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:08.723 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:08.721+0000 7f864ed9d640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f865006bf20 0x7f86500a9590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.73:50048/0 (socket says 172.21.15.73:50048) 2023-12-12T09:45:08.723 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:08.721+0000 7f864ed9d640 1 -- 172.21.15.73:0/730789043 learned_addr learned my addr 172.21.15.73:0/730789043 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:45:08.724 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:08.722+0000 7f864ed9d640 1 -- 172.21.15.73:0/730789043 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f86500a50f0 msgr2=0x7f86500a9050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:45:08.724 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:08.722+0000 7f864ed9d640 1 --2- 172.21.15.73:0/730789043 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f86500a50f0 0x7f86500a9050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:08.724 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:08.722+0000 7f864ed9d640 1 -- 172.21.15.73:0/730789043 >> v1:172.21.15.142:6789/0 conn(0x7f86501552e0 legacy=0x7f86500c49c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:08.724 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:08.722+0000 7f864ed9d640 1 -- 172.21.15.73:0/730789043 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f865006cb60 con 0x7f865006bf20 2023-12-12T09:45:08.724 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:08.723+0000 7f864ed9d640 1 --2- 172.21.15.73:0/730789043 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f865006bf20 0x7f86500a9590 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f8648009e50 tx=0x7f864802bed0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b7b61f164c9049a3 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:45:08.725 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:08.724+0000 7f864dd9b640 1 -- 172.21.15.73:0/730789043 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f864802ca70 con 0x7f865006bf20 2023-12-12T09:45:08.725 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:08.724+0000 7f864dd9b640 1 -- 172.21.15.73:0/730789043 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f864802cbd0 con 0x7f865006bf20 2023-12-12T09:45:08.725 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:08.724+0000 7f864dd9b640 1 -- 172.21.15.73:0/730789043 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86480343f0 con 0x7f865006bf20 2023-12-12T09:45:08.726 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:08.724+0000 7f8654e64640 1 -- 172.21.15.73:0/730789043 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f865006bf20 msgr2=0x7f86500a9590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:08.726 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:08.724+0000 7f8654e64640 1 --2- 172.21.15.73:0/730789043 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f865006bf20 0x7f86500a9590 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f8648009e50 tx=0x7f864802bed0 comp rx=0 tx=0).stop 2023-12-12T09:45:08.726 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:08.724+0000 7f8654e64640 1 -- 172.21.15.73:0/730789043 shutdown_connections 2023-12-12T09:45:08.726 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:08.724+0000 7f8654e64640 1 --2- 172.21.15.73:0/730789043 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f86500a50f0 0x7f86500a9050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:08.726 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:08.724+0000 7f8654e64640 1 --2- 172.21.15.73:0/730789043 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f865006bf20 0x7f86500a9590 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:08.726 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:08.725+0000 7f8654e64640 1 -- 172.21.15.73:0/730789043 >> 172.21.15.73:0/730789043 conn(0x7f86500a8130 msgr2=0x7f86500c24b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:45:08.726 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:08.725+0000 7f8654e64640 1 -- 172.21.15.73:0/730789043 shutdown_connections 2023-12-12T09:45:08.726 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:08.725+0000 7f8654e64640 1 -- 172.21.15.73:0/730789043 wait complete. 2023-12-12T09:45:08.727 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:08.726+0000 7f8654e64640 1 Processor -- start 2023-12-12T09:45:08.727 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:08.726+0000 7f8654e64640 1 -- start start 2023-12-12T09:45:08.730 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:08.727+0000 7f8654e64640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f865006bf20 0x7f86501e12f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:08.730 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:08.727+0000 7f8654e64640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f86500a50f0 0x7f865014ea90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:08.730 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:08.727+0000 7f8654e64640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f86501552e0 0x7f86501506c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:08.730 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:08.727+0000 7f8654e64640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f865014f5e0 con 0x7f86500a50f0 2023-12-12T09:45:08.730 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:08.727+0000 7f8654e64640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86500a8fa0 con 0x7f865006bf20 2023-12-12T09:45:08.730 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:08.727+0000 7f8654e64640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8650071760 con 0x7f86501552e0 2023-12-12T09:45:08.730 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:08.727+0000 7f8645d9b640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f86500a50f0 0x7f865014ea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:08.731 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:08.728+0000 7f8645d9b640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f86500a50f0 0x7f865014ea90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:38246/0 (socket says 172.21.15.73:38246) 2023-12-12T09:45:08.731 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:08.728+0000 7f8645d9b640 1 -- 172.21.15.73:0/1153219489 learned_addr learned my addr 172.21.15.73:0/1153219489 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:45:08.731 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:08.728+0000 7f8645d9b640 1 -- 172.21.15.73:0/1153219489 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f86501552e0 msgr2=0x7f86501506c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:08.731 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:08.728+0000 7f864ed9d640 1 --2- 172.21.15.73:0/1153219489 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f86501552e0 0x7f86501506c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:08.731 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:08.728+0000 7f864e59c640 1 --2- 172.21.15.73:0/1153219489 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f865006bf20 0x7f86501e12f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:08.731 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:08.728+0000 7f8645d9b640 1 --2- 172.21.15.73:0/1153219489 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f86501552e0 0x7f86501506c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:08.731 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:08.728+0000 7f8645d9b640 1 -- 172.21.15.73:0/1153219489 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f865006bf20 msgr2=0x7f86501e12f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:08.731 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:08.728+0000 7f8645d9b640 1 --2- 172.21.15.73:0/1153219489 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f865006bf20 0x7f86501e12f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:08.731 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:08.728+0000 7f8645d9b640 1 -- 172.21.15.73:0/1153219489 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8648009b30 con 0x7f86500a50f0 2023-12-12T09:45:08.731 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:08.728+0000 7f864e59c640 1 --2- 172.21.15.73:0/1153219489 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f865006bf20 0x7f86501e12f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:45:08.732 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:08.728+0000 7f8645d9b640 1 --2- 172.21.15.73:0/1153219489 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f86500a50f0 0x7f865014ea90 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f863800e980 tx=0x7f863800ee40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:45:08.732 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:08.729+0000 7f86477fe640 1 -- 172.21.15.73:0/1153219489 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8638009670 con 0x7f86500a50f0 2023-12-12T09:45:08.732 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:08.729+0000 7f86477fe640 1 -- 172.21.15.73:0/1153219489 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f863800ca00 con 0x7f86500a50f0 2023-12-12T09:45:08.732 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:08.729+0000 7f86477fe640 1 -- 172.21.15.73:0/1153219489 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f863800cd90 con 0x7f86500a50f0 2023-12-12T09:45:08.732 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:08.729+0000 7f8654e64640 1 -- 172.21.15.73:0/1153219489 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8650070800 con 0x7f86500a50f0 2023-12-12T09:45:08.732 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:08.729+0000 7f8654e64640 1 -- 172.21.15.73:0/1153219489 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8650070ae0 con 0x7f86500a50f0 2023-12-12T09:45:08.732 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:08.730+0000 7f8654e64640 1 -- 172.21.15.73:0/1153219489 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86500a9130 con 0x7f86500a50f0 2023-12-12T09:45:08.733 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:08.731+0000 7f86477fe640 1 -- 172.21.15.73:0/1153219489 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f8638013470 con 0x7f86500a50f0 2023-12-12T09:45:08.733 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:08.732+0000 7f86477fe640 1 --2- 172.21.15.73:0/1153219489 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f863406ae40 0x7f863406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:08.733 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:08.732+0000 7f86477fe640 1 -- 172.21.15.73:0/1153219489 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 5799+0+0 (secure 0 0 0) 0x7f86380898d0 con 0x7f86500a50f0 2023-12-12T09:45:08.734 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:08.732+0000 7f864e59c640 1 --2- 172.21.15.73:0/1153219489 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f863406ae40 0x7f863406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:08.734 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:08.733+0000 7f864e59c640 1 --2- 172.21.15.73:0/1153219489 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f863406ae40 0x7f863406d300 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f86500a9890 tx=0x7f8640009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:45:08.737 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:08.736+0000 7f86477fe640 1 -- 172.21.15.73:0/1153219489 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f8638054910 con 0x7f86500a50f0 2023-12-12T09:45:08.969 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:08.968+0000 7f8654e64640 1 -- 172.21.15.73:0/1153219489 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8650067580 con 0x7f86500a50f0 2023-12-12T09:45:08.970 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:08.969+0000 7f86477fe640 1 -- 172.21.15.73:0/1153219489 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) v1 ==== 94+0+4918 (secure 0 0 0) 0x7f8638017090 con 0x7f86500a50f0 2023-12-12T09:45:08.970 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-12T09:45:08.970 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":21,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4517,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6835/2407815368","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6833","nonce":2407815368},{"type":"v1","addr":"172.21.15.142:6835","nonce":2407815368}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":4720,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6834/153753304","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6832","nonce":153753304},{"type":"v1","addr":"172.21.15.142:6834","nonce":153753304}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":5532,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6837/3504911419","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6835","nonce":3504911419},{"type":"v1","addr":"172.21.15.73:6837","nonce":3504911419}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":19,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-12T09:44:36.098486+0000","modified":"2023-12-12T09:44:39.152510+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4962},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4962":{"gid":4962,"name":"a","rank":0,"incarnation":16,"state":"up:active","state_seq":8,"addr":"172.21.15.73:6836/2500303907","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":2500303907},{"type":"v1","addr":"172.21.15.73:6836","nonce":2500303907}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-12-12T09:45:08.970 INFO:teuthology.orchestra.run.smithi073.stderr:dumped fsmap epoch 21 2023-12-12T09:45:08.973 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:08.971+0000 7f8654e64640 1 -- 172.21.15.73:0/1153219489 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f863406ae40 msgr2=0x7f863406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:08.973 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:08.971+0000 7f8654e64640 1 --2- 172.21.15.73:0/1153219489 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f863406ae40 0x7f863406d300 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f86500a9890 tx=0x7f8640009040 comp rx=0 tx=0).stop 2023-12-12T09:45:08.973 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:08.971+0000 7f8654e64640 1 -- 172.21.15.73:0/1153219489 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f86500a50f0 msgr2=0x7f865014ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:08.973 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:08.971+0000 7f8654e64640 1 --2- 172.21.15.73:0/1153219489 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f86500a50f0 0x7f865014ea90 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f863800e980 tx=0x7f863800ee40 comp rx=0 tx=0).stop 2023-12-12T09:45:08.973 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:08.971+0000 7f8654e64640 1 -- 172.21.15.73:0/1153219489 shutdown_connections 2023-12-12T09:45:08.973 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:08.971+0000 7f8654e64640 1 --2- 172.21.15.73:0/1153219489 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f863406ae40 0x7f863406d300 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:08.973 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:08.971+0000 7f8654e64640 1 --2- 172.21.15.73:0/1153219489 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f86501552e0 0x7f86501506c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:08.973 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:08.971+0000 7f8654e64640 1 --2- 172.21.15.73:0/1153219489 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f86500a50f0 0x7f865014ea90 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:08.973 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:08.971+0000 7f8654e64640 1 --2- 172.21.15.73:0/1153219489 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f865006bf20 0x7f86501e12f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:08.973 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:08.971+0000 7f8654e64640 1 -- 172.21.15.73:0/1153219489 >> 172.21.15.73:0/1153219489 conn(0x7f86500a8130 msgr2=0x7f86500a6bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:45:08.974 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:08.972+0000 7f8654e64640 1 -- 172.21.15.73:0/1153219489 shutdown_connections 2023-12-12T09:45:08.974 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:08.972+0000 7f8654e64640 1 -- 172.21.15.73:0/1153219489 wait complete. 2023-12-12T09:45:08.992 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-12T09:45:09.203 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:09.202+0000 7fdaa7fff640 1 Processor -- start 2023-12-12T09:45:09.203 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:09.202+0000 7fdaa7fff640 1 -- start start 2023-12-12T09:45:09.205 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:09.203+0000 7fdaa7fff640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdaa80a9470 0x7fdaa80aae00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:09.205 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:09.203+0000 7fdaa7fff640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fdaa80ab340 0x7fdaa815cbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:09.205 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:09.204+0000 7fdaa7fff640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdaa8153300 con 0x7fdaa814fbb0 2023-12-12T09:45:09.205 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:09.204+0000 7fdaa7fff640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdaa80aa000 con 0x7fdaa80ab340 2023-12-12T09:45:09.205 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:09.204+0000 7fdaa7fff640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdaa80c1d40 con 0x7fdaa80a9470 2023-12-12T09:45:09.205 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:09.204+0000 7fdaa6ffd640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7fdaa814fbb0 0x7fdaa80c09e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:58416/0 (socket says 172.21.15.73:58416) 2023-12-12T09:45:09.205 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:09.204+0000 7fdaa6ffd640 1 -- 172.21.15.73:0/1773531568 learned_addr learned my addr 172.21.15.73:0/1773531568 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-12T09:45:09.207 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:09.204+0000 7fdaa67fc640 1 -- 172.21.15.73:0/1773531568 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1156269797 0 0) 0x7fdaa8153300 con 0x7fdaa814fbb0 2023-12-12T09:45:09.207 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:09.204+0000 7fda9ffff640 1 --2- 172.21.15.73:0/1773531568 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdaa80a9470 0x7fdaa80aae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:09.207 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:09.204+0000 7fdaa77fe640 1 --2- 172.21.15.73:0/1773531568 >> v2:172.21.15.142:3300/0 conn(0x7fdaa80ab340 0x7fdaa815cbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:09.207 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:09.204+0000 7fdaa67fc640 1 -- 172.21.15.73:0/1773531568 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fda94003520 con 0x7fdaa814fbb0 2023-12-12T09:45:09.207 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:09.205+0000 7fdaa67fc640 1 -- 172.21.15.73:0/1773531568 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4269202470 0 0) 0x7fda94003520 con 0x7fdaa814fbb0 2023-12-12T09:45:09.207 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:09.205+0000 7fdaa67fc640 1 -- 172.21.15.73:0/1773531568 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdaa80a9470 msgr2=0x7fdaa80aae00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:45:09.208 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:09.205+0000 7fdaa67fc640 1 --2- 172.21.15.73:0/1773531568 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdaa80a9470 0x7fdaa80aae00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:09.208 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:09.205+0000 7fdaa67fc640 1 -- 172.21.15.73:0/1773531568 >> v2:172.21.15.142:3300/0 conn(0x7fdaa80ab340 msgr2=0x7fdaa815cbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:45:09.208 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:09.205+0000 7fdaa67fc640 1 --2- 172.21.15.73:0/1773531568 >> v2:172.21.15.142:3300/0 conn(0x7fdaa80ab340 0x7fdaa815cbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:09.208 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:09.205+0000 7fdaa67fc640 1 -- 172.21.15.73:0/1773531568 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdaa80c2160 con 0x7fdaa814fbb0 2023-12-12T09:45:09.208 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:09.205+0000 7fdaa67fc640 1 -- 172.21.15.73:0/1773531568 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3186547832 0 0) 0x7fda98001670 con 0x7fdaa814fbb0 2023-12-12T09:45:09.208 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:09.205+0000 7fdaa67fc640 1 -- 172.21.15.73:0/1773531568 >> v1:172.21.15.73:6789/0 conn(0x7fdaa814fbb0 legacy=0x7fdaa80c09e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:09.208 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:09.205+0000 7fdaa67fc640 1 --2- 172.21.15.73:0/1773531568 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fda94003970 0x7fda94003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:09.208 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:09.205+0000 7fdaa67fc640 1 --2- 172.21.15.73:0/1773531568 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fda940047c0 0x7fda94004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:09.208 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:09.205+0000 7fdaa67fc640 1 --2- 172.21.15.73:0/1773531568 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdaa80a9470 0x7fda940051a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:09.208 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:09.205+0000 7fdaa67fc640 1 -- 172.21.15.73:0/1773531568 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdaa80aa000 con 0x7fda94003970 2023-12-12T09:45:09.208 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:09.205+0000 7fdaa67fc640 1 -- 172.21.15.73:0/1773531568 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdaa80c1d40 con 0x7fda940047c0 2023-12-12T09:45:09.208 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:09.205+0000 7fdaa67fc640 1 -- 172.21.15.73:0/1773531568 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda9400ff20 con 0x7fdaa80a9470 2023-12-12T09:45:09.208 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:09.205+0000 7fdaa6ffd640 1 --2- 172.21.15.73:0/1773531568 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fda94003970 0x7fda94003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:09.208 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:09.206+0000 7fda9ffff640 1 --2- 172.21.15.73:0/1773531568 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fda940047c0 0x7fda94004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:09.209 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:09.206+0000 7fdaa6ffd640 1 -- 172.21.15.73:0/1773531568 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdaa80a9470 msgr2=0x7fda940051a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:45:09.209 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:09.206+0000 7fdaa6ffd640 1 --2- 172.21.15.73:0/1773531568 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdaa80a9470 0x7fda940051a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:09.209 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:09.206+0000 7fdaa6ffd640 1 -- 172.21.15.73:0/1773531568 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fda940047c0 msgr2=0x7fda94004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:45:09.209 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:09.206+0000 7fdaa6ffd640 1 --2- 172.21.15.73:0/1773531568 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fda940047c0 0x7fda94004c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:09.209 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:09.206+0000 7fdaa6ffd640 1 -- 172.21.15.73:0/1773531568 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda94003520 con 0x7fda94003970 2023-12-12T09:45:09.210 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:09.207+0000 7fdaa6ffd640 1 --2- 172.21.15.73:0/1773531568 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fda94003970 0x7fda94003d90 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7fda9800c190 tx=0x7fda940057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f62ec01c15d5aac0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:45:09.210 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:09.207+0000 7fdaa67fc640 1 -- 172.21.15.73:0/1773531568 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda98005ad0 con 0x7fda94003970 2023-12-12T09:45:09.210 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:09.207+0000 7fdaa67fc640 1 -- 172.21.15.73:0/1773531568 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda98005c50 con 0x7fda94003970 2023-12-12T09:45:09.210 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:09.207+0000 7fdaa67fc640 1 -- 172.21.15.73:0/1773531568 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda9802c810 con 0x7fda94003970 2023-12-12T09:45:09.211 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:09.207+0000 7fdaa7fff640 1 -- 172.21.15.73:0/1773531568 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fda94003970 msgr2=0x7fda94003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:09.211 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:09.207+0000 7fdaa7fff640 1 --2- 172.21.15.73:0/1773531568 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fda94003970 0x7fda94003d90 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7fda9800c190 tx=0x7fda940057f0 comp rx=0 tx=0).stop 2023-12-12T09:45:09.211 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:09.207+0000 7fdaa77fe640 1 -- 172.21.15.73:0/1773531568 reap_dead start 2023-12-12T09:45:09.211 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:09.208+0000 7fdaa7fff640 1 -- 172.21.15.73:0/1773531568 shutdown_connections 2023-12-12T09:45:09.211 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:09.208+0000 7fdaa7fff640 1 -- 172.21.15.73:0/1773531568 >> 172.21.15.73:0/1773531568 conn(0x7fdaa80c23b0 msgr2=0x7fdaa80c2790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:45:09.211 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:09.208+0000 7fdaa7fff640 1 -- 172.21.15.73:0/1773531568 shutdown_connections 2023-12-12T09:45:09.211 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:09.208+0000 7fdaa7fff640 1 -- 172.21.15.73:0/1773531568 wait complete. 2023-12-12T09:45:09.211 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:09.209+0000 7fdaa7fff640 1 Processor -- start 2023-12-12T09:45:09.211 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:09.209+0000 7fdaa7fff640 1 -- start start 2023-12-12T09:45:09.213 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:09.210+0000 7fdaa7fff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fda94003970 0x7fdaa8155280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:09.213 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:09.210+0000 7fdaa7fff640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdaa81536c0 0x7fdaa81557c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:09.213 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:09.210+0000 7fdaa7fff640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdaa8149a00 0x7fdaa8149e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:09.213 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:09.210+0000 7fdaa7fff640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdaa8155d00 con 0x7fda94003970 2023-12-12T09:45:09.213 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:09.210+0000 7fdaa7fff640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdaa81e6460 con 0x7fdaa8149a00 2023-12-12T09:45:09.213 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:09.210+0000 7fdaa7fff640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdaa81e6990 con 0x7fdaa81536c0 2023-12-12T09:45:09.213 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:09.210+0000 7fdaa6ffd640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fda94003970 0x7fdaa8155280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:09.213 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:09.211+0000 7fdaa6ffd640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fda94003970 0x7fdaa8155280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:37990/0 (socket says 172.21.15.73:37990) 2023-12-12T09:45:09.213 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:09.211+0000 7fdaa6ffd640 1 -- 172.21.15.73:0/2051113566 learned_addr learned my addr 172.21.15.73:0/2051113566 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:45:09.214 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:09.211+0000 7fda9ffff640 1 --2- 172.21.15.73:0/2051113566 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdaa81536c0 0x7fdaa81557c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:09.214 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:09.211+0000 7fdaa77fe640 1 --2- 172.21.15.73:0/2051113566 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdaa8149a00 0x7fdaa8149e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:09.214 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:09.211+0000 7fdaa6ffd640 1 -- 172.21.15.73:0/2051113566 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdaa81536c0 msgr2=0x7fdaa81557c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:09.214 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:09.211+0000 7fdaa6ffd640 1 --2- 172.21.15.73:0/2051113566 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdaa81536c0 0x7fdaa81557c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:09.214 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:09.211+0000 7fdaa6ffd640 1 -- 172.21.15.73:0/2051113566 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdaa8149a00 msgr2=0x7fdaa8149e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:09.214 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:09.211+0000 7fdaa6ffd640 1 --2- 172.21.15.73:0/2051113566 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdaa8149a00 0x7fdaa8149e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:09.214 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:09.211+0000 7fdaa6ffd640 1 -- 172.21.15.73:0/2051113566 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdaa81567c0 con 0x7fda94003970 2023-12-12T09:45:09.214 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:09.211+0000 7fdaa6ffd640 1 --2- 172.21.15.73:0/2051113566 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fda94003970 0x7fdaa8155280 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7fda98000c00 tx=0x7fdaa80c1c40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:45:09.214 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:09.212+0000 7fda9f7fe640 1 -- 172.21.15.73:0/2051113566 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda9803c040 con 0x7fda94003970 2023-12-12T09:45:09.214 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:09.212+0000 7fda9f7fe640 1 -- 172.21.15.73:0/2051113566 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda9802dd30 con 0x7fda94003970 2023-12-12T09:45:09.214 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:09.212+0000 7fda9f7fe640 1 -- 172.21.15.73:0/2051113566 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda9802dea0 con 0x7fda94003970 2023-12-12T09:45:09.214 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:09.212+0000 7fdaa7fff640 1 -- 172.21.15.73:0/2051113566 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdaa81e66b0 con 0x7fda94003970 2023-12-12T09:45:09.215 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:09.212+0000 7fdaa7fff640 1 -- 172.21.15.73:0/2051113566 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdaa81564e0 con 0x7fda94003970 2023-12-12T09:45:09.215 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:09.213+0000 7fdaa7fff640 1 -- 172.21.15.73:0/2051113566 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdaa8067400 con 0x7fda94003970 2023-12-12T09:45:09.215 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:09.214+0000 7fda9f7fe640 1 -- 172.21.15.73:0/2051113566 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fda98032070 con 0x7fda94003970 2023-12-12T09:45:09.216 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:09.215+0000 7fda9f7fe640 1 --2- 172.21.15.73:0/2051113566 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fda8806ae40 0x7fda8806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:09.216 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:09.215+0000 7fda9f7fe640 1 -- 172.21.15.73:0/2051113566 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 5857+0+0 (secure 0 0 0) 0x7fda980ab160 con 0x7fda94003970 2023-12-12T09:45:09.216 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:09.215+0000 7fda9ffff640 1 --2- 172.21.15.73:0/2051113566 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fda8806ae40 0x7fda8806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:09.217 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:09.216+0000 7fda9ffff640 1 --2- 172.21.15.73:0/2051113566 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fda8806ae40 0x7fda8806d300 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fdaa80a5040 tx=0x7fda90008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:45:09.220 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:09.219+0000 7fda9f7fe640 1 -- 172.21.15.73:0/2051113566 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fda98076160 con 0x7fda94003970 2023-12-12T09:45:09.445 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:09.444+0000 7fdaa7fff640 1 -- 172.21.15.73:0/2051113566 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fdaa80a50d0 con 0x7fda94003970 2023-12-12T09:45:09.446 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:09.445+0000 7fda9f7fe640 1 -- 172.21.15.73:0/2051113566 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) v1 ==== 94+0+4918 (secure 0 0 0) 0x7fda98079780 con 0x7fda94003970 2023-12-12T09:45:09.447 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-12T09:45:09.447 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":21,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4517,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6835/2407815368","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6833","nonce":2407815368},{"type":"v1","addr":"172.21.15.142:6835","nonce":2407815368}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":4720,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6834/153753304","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6832","nonce":153753304},{"type":"v1","addr":"172.21.15.142:6834","nonce":153753304}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":5532,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6837/3504911419","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6835","nonce":3504911419},{"type":"v1","addr":"172.21.15.73:6837","nonce":3504911419}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":19,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-12T09:44:36.098486+0000","modified":"2023-12-12T09:44:39.152510+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4962},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4962":{"gid":4962,"name":"a","rank":0,"incarnation":16,"state":"up:active","state_seq":8,"addr":"172.21.15.73:6836/2500303907","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":2500303907},{"type":"v1","addr":"172.21.15.73:6836","nonce":2500303907}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-12-12T09:45:09.447 INFO:teuthology.orchestra.run.smithi073.stderr:dumped fsmap epoch 21 2023-12-12T09:45:09.449 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:09.448+0000 7fdaa7fff640 1 -- 172.21.15.73:0/2051113566 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fda8806ae40 msgr2=0x7fda8806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:09.449 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:09.448+0000 7fdaa7fff640 1 --2- 172.21.15.73:0/2051113566 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fda8806ae40 0x7fda8806d300 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fdaa80a5040 tx=0x7fda90008040 comp rx=0 tx=0).stop 2023-12-12T09:45:09.449 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:09.448+0000 7fdaa7fff640 1 -- 172.21.15.73:0/2051113566 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fda94003970 msgr2=0x7fdaa8155280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:09.449 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:09.448+0000 7fdaa7fff640 1 --2- 172.21.15.73:0/2051113566 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fda94003970 0x7fdaa8155280 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7fda98000c00 tx=0x7fdaa80c1c40 comp rx=0 tx=0).stop 2023-12-12T09:45:09.450 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:09.448+0000 7fdaa7fff640 1 -- 172.21.15.73:0/2051113566 shutdown_connections 2023-12-12T09:45:09.450 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:09.448+0000 7fdaa7fff640 1 --2- 172.21.15.73:0/2051113566 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fda8806ae40 0x7fda8806d300 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:09.450 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:09.448+0000 7fdaa7fff640 1 --2- 172.21.15.73:0/2051113566 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdaa8149a00 0x7fdaa8149e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:09.450 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:09.448+0000 7fdaa7fff640 1 --2- 172.21.15.73:0/2051113566 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdaa81536c0 0x7fdaa81557c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:09.450 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:09.448+0000 7fdaa7fff640 1 --2- 172.21.15.73:0/2051113566 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fda94003970 0x7fdaa8155280 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:09.450 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:09.448+0000 7fdaa7fff640 1 -- 172.21.15.73:0/2051113566 >> 172.21.15.73:0/2051113566 conn(0x7fdaa80c23b0 msgr2=0x7fdaa80ab750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:45:09.450 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:09.448+0000 7fdaa7fff640 1 -- 172.21.15.73:0/2051113566 shutdown_connections 2023-12-12T09:45:09.450 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:09.448+0000 7fdaa7fff640 1 -- 172.21.15.73:0/2051113566 wait complete. 2023-12-12T09:45:09.468 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-12T09:45:09.680 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:09.679+0000 7fa48cdb6640 1 Processor -- start 2023-12-12T09:45:09.680 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:09.679+0000 7fa48cdb6640 1 -- start start 2023-12-12T09:45:09.682 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:09.680+0000 7fa48cdb6640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fa48806bf90 0x7fa4881584f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:09.682 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:09.680+0000 7fa48cdb6640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4880c4d00 con 0x7fa4880a5040 2023-12-12T09:45:09.682 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:09.681+0000 7fa48cdb6640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa48806c400 con 0x7fa48806a4e0 2023-12-12T09:45:09.682 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:09.681+0000 7fa48cdb6640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4880c5100 con 0x7fa48806bf90 2023-12-12T09:45:09.682 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:09.681+0000 7fa48659c640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7fa4880a5040 0x7fa4880c3ad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:58418/0 (socket says 172.21.15.73:58418) 2023-12-12T09:45:09.682 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:09.681+0000 7fa47ffff640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fa48806bf90 0x7fa4881584f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:09.682 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:09.681+0000 7fa48659c640 1 -- 172.21.15.73:0/2166437030 learned_addr learned my addr 172.21.15.73:0/2166437030 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-12T09:45:09.683 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:09.681+0000 7fa47ffff640 1 -- 172.21.15.73:0/2166437030 >> v1:172.21.15.142:6789/0 conn(0x7fa48806a4e0 legacy=0x7fa48815f020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:45:09.683 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:09.681+0000 7fa47ffff640 1 -- 172.21.15.73:0/2166437030 >> v1:172.21.15.73:6789/0 conn(0x7fa4880a5040 legacy=0x7fa4880c3ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:09.683 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:09.682+0000 7fa47ffff640 1 -- 172.21.15.73:0/2166437030 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4880c53e0 con 0x7fa48806bf90 2023-12-12T09:45:09.683 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:09.682+0000 7fa485d9b640 1 -- 172.21.15.73:0/2166437030 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 226068239 0 0) 0x7fa4880c4d00 con 0x7fa4880a5040 2023-12-12T09:45:09.684 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:09.683+0000 7fa47ffff640 1 --2- 172.21.15.73:0/2166437030 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa48806bf90 0x7fa4881584f0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7fa4700097a0 tx=0x7fa47002b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b6c34c54c48af5f server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:45:09.684 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:09.683+0000 7fa485d9b640 1 -- 172.21.15.73:0/2166437030 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa470030610 con 0x7fa48806bf90 2023-12-12T09:45:09.684 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:09.683+0000 7fa485d9b640 1 -- 172.21.15.73:0/2166437030 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa470030770 con 0x7fa48806bf90 2023-12-12T09:45:09.684 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:09.683+0000 7fa485d9b640 1 -- 172.21.15.73:0/2166437030 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa470030b00 con 0x7fa48806bf90 2023-12-12T09:45:09.685 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:09.684+0000 7fa48cdb6640 1 -- 172.21.15.73:0/2166437030 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa48806bf90 msgr2=0x7fa4881584f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:09.685 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:09.684+0000 7fa48cdb6640 1 --2- 172.21.15.73:0/2166437030 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa48806bf90 0x7fa4881584f0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7fa4700097a0 tx=0x7fa47002b960 comp rx=0 tx=0).stop 2023-12-12T09:45:09.685 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:09.684+0000 7fa48cdb6640 1 -- 172.21.15.73:0/2166437030 shutdown_connections 2023-12-12T09:45:09.685 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:09.684+0000 7fa48cdb6640 1 --2- 172.21.15.73:0/2166437030 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa48806bf90 0x7fa4881584f0 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:09.685 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:09.684+0000 7fa48cdb6640 1 -- 172.21.15.73:0/2166437030 >> 172.21.15.73:0/2166437030 conn(0x7fa4880a8130 msgr2=0x7fa4880c24b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:45:09.685 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:09.684+0000 7fa48cdb6640 1 -- 172.21.15.73:0/2166437030 shutdown_connections 2023-12-12T09:45:09.685 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:09.684+0000 7fa48cdb6640 1 -- 172.21.15.73:0/2166437030 wait complete. 2023-12-12T09:45:09.687 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:09.686+0000 7fa48cdb6640 1 Processor -- start 2023-12-12T09:45:09.687 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:09.686+0000 7fa48cdb6640 1 -- start start 2023-12-12T09:45:09.688 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:09.687+0000 7fa48cdb6640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa48806a4e0 0x7fa48814c370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:09.688 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:09.687+0000 7fa48cdb6640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa48806bf90 0x7fa488150400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:09.688 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:09.687+0000 7fa48cdb6640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa4880a5040 0x7fa48814a7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:09.688 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:09.687+0000 7fa48cdb6640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa48814c9e0 con 0x7fa4880a5040 2023-12-12T09:45:09.688 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:09.687+0000 7fa48cdb6640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa48814b4d0 con 0x7fa48806bf90 2023-12-12T09:45:09.688 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:09.687+0000 7fa48cdb6640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa48814f230 con 0x7fa48806a4e0 2023-12-12T09:45:09.688 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:09.687+0000 7fa486d9d640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa4880a5040 0x7fa48814a7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:09.688 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:09.687+0000 7fa486d9d640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa4880a5040 0x7fa48814a7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:38012/0 (socket says 172.21.15.73:38012) 2023-12-12T09:45:09.689 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:09.687+0000 7fa486d9d640 1 -- 172.21.15.73:0/4025600502 learned_addr learned my addr 172.21.15.73:0/4025600502 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:45:09.690 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:09.687+0000 7fa486d9d640 1 -- 172.21.15.73:0/4025600502 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa48806a4e0 msgr2=0x7fa48814c370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:09.690 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:09.687+0000 7fa47ffff640 1 --2- 172.21.15.73:0/4025600502 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa48806bf90 0x7fa488150400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:09.690 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:09.687+0000 7fa486d9d640 1 --2- 172.21.15.73:0/4025600502 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa48806a4e0 0x7fa48814c370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:09.690 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:09.687+0000 7fa486d9d640 1 -- 172.21.15.73:0/4025600502 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa48806bf90 msgr2=0x7fa488150400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:09.690 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:09.687+0000 7fa486d9d640 1 --2- 172.21.15.73:0/4025600502 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa48806bf90 0x7fa488150400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:09.690 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:09.687+0000 7fa486d9d640 1 -- 172.21.15.73:0/4025600502 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa470009400 con 0x7fa4880a5040 2023-12-12T09:45:09.690 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:09.688+0000 7fa486d9d640 1 --2- 172.21.15.73:0/4025600502 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa4880a5040 0x7fa48814a7c0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7fa48000b990 tx=0x7fa48000be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:45:09.690 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:09.688+0000 7fa47effd640 1 -- 172.21.15.73:0/4025600502 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa48000cba0 con 0x7fa4880a5040 2023-12-12T09:45:09.690 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:09.688+0000 7fa47effd640 1 -- 172.21.15.73:0/4025600502 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa48000cd00 con 0x7fa4880a5040 2023-12-12T09:45:09.690 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:09.688+0000 7fa47effd640 1 -- 172.21.15.73:0/4025600502 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa480014680 con 0x7fa4880a5040 2023-12-12T09:45:09.690 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:09.688+0000 7fa48cdb6640 1 -- 172.21.15.73:0/4025600502 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa48814b1f0 con 0x7fa4880a5040 2023-12-12T09:45:09.690 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:09.688+0000 7fa48cdb6640 1 -- 172.21.15.73:0/4025600502 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4881514c0 con 0x7fa4880a5040 2023-12-12T09:45:09.691 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:09.689+0000 7fa48cdb6640 1 -- 172.21.15.73:0/4025600502 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa488067580 con 0x7fa4880a5040 2023-12-12T09:45:09.691 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:09.690+0000 7fa47effd640 1 -- 172.21.15.73:0/4025600502 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fa48001d3b0 con 0x7fa4880a5040 2023-12-12T09:45:09.692 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:09.691+0000 7fa47effd640 1 --2- 172.21.15.73:0/4025600502 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fa46806ae40 0x7fa46806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:09.693 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:09.691+0000 7fa47effd640 1 -- 172.21.15.73:0/4025600502 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 5857+0+0 (secure 0 0 0) 0x7fa4800895f0 con 0x7fa4880a5040 2023-12-12T09:45:09.693 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:09.691+0000 7fa48659c640 1 --2- 172.21.15.73:0/4025600502 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fa46806ae40 0x7fa46806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:09.693 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:09.692+0000 7fa48659c640 1 --2- 172.21.15.73:0/4025600502 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fa46806ae40 0x7fa46806d300 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fa478007fd0 tx=0x7fa478007920 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:45:09.697 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:09.696+0000 7fa47effd640 1 -- 172.21.15.73:0/4025600502 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fa480054690 con 0x7fa4880a5040 2023-12-12T09:45:09.896 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:09.895+0000 7fa48cdb6640 1 -- 172.21.15.73:0/4025600502 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa4880c3040 con 0x7fa4880a5040 2023-12-12T09:45:09.898 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:09.897+0000 7fa47effd640 1 -- 172.21.15.73:0/4025600502 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v43) v1 ==== 74+0+16809 (secure 0 0 0) 0x7fa480057cb0 con 0x7fa4880a5040 2023-12-12T09:45:09.899 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-12T09:45:09.899 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":43,"fsid":"ba240992-02b8-4c7e-92f2-27eb29ac433b","created":"2023-12-12T09:43:02.454719+0000","modified":"2023-12-12T09:45:09.840709+0000","last_up_change":"2023-12-12T09:43:13.913440+0000","last_in_change":"2023-12-12T09:43:05.925348+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-12T09:43:15.525508+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs2_metadata","create_time":"2023-12-12T09:44:34.424645+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs2_data","create_time":"2023-12-12T09:44:35.090149+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"dd9074be-dbe2-4c34-9896-a4223d8d3940","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":4047810203},{"type":"v1","addr":"172.21.15.73:6801","nonce":4047810203}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":4047810203},{"type":"v1","addr":"172.21.15.73:6803","nonce":4047810203}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":4047810203},{"type":"v1","addr":"172.21.15.73:6807","nonce":4047810203}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":4047810203},{"type":"v1","addr":"172.21.15.73:6805","nonce":4047810203}]},"public_addr":"172.21.15.73:6801/4047810203","cluster_addr":"172.21.15.73:6803/4047810203","heartbeat_back_addr":"172.21.15.73:6807/4047810203","heartbeat_front_addr":"172.21.15.73:6805/4047810203","state":["exists","up"]},{"osd":1,"uuid":"c4a05052-96d4-4758-a4e1-1a37f1e07fed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":1356058331},{"type":"v1","addr":"172.21.15.73:6824","nonce":1356058331}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":1356058331},{"type":"v1","addr":"172.21.15.73:6827","nonce":1356058331}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":1356058331},{"type":"v1","addr":"172.21.15.73:6831","nonce":1356058331}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":1356058331},{"type":"v1","addr":"172.21.15.73:6829","nonce":1356058331}]},"public_addr":"172.21.15.73:6824/1356058331","cluster_addr":"172.21.15.73:6827/1356058331","heartbeat_back_addr":"172.21.15.73:6831/1356058331","heartbeat_front_addr":"172.21.15.73:6829/1356058331","state":["exists","up"]},{"osd":2,"uuid":"512bc8ac-72c2-40d4-b3d2-d867a92c5213","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":1228903316},{"type":"v1","addr":"172.21.15.73:6817","nonce":1228903316}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":1228903316},{"type":"v1","addr":"172.21.15.73:6819","nonce":1228903316}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6823","nonce":1228903316},{"type":"v1","addr":"172.21.15.73:6825","nonce":1228903316}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":1228903316},{"type":"v1","addr":"172.21.15.73:6821","nonce":1228903316}]},"public_addr":"172.21.15.73:6817/1228903316","cluster_addr":"172.21.15.73:6819/1228903316","heartbeat_back_addr":"172.21.15.73:6825/1228903316","heartbeat_front_addr":"172.21.15.73:6821/1228903316","state":["exists","up"]},{"osd":3,"uuid":"3d1a91e0-42bf-437a-8eae-8d357c8f63a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":1293329670},{"type":"v1","addr":"172.21.15.73:6809","nonce":1293329670}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6810","nonce":1293329670},{"type":"v1","addr":"172.21.15.73:6811","nonce":1293329670}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":1293329670},{"type":"v1","addr":"172.21.15.73:6815","nonce":1293329670}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":1293329670},{"type":"v1","addr":"172.21.15.73:6813","nonce":1293329670}]},"public_addr":"172.21.15.73:6809/1293329670","cluster_addr":"172.21.15.73:6811/1293329670","heartbeat_back_addr":"172.21.15.73:6815/1293329670","heartbeat_front_addr":"172.21.15.73:6813/1293329670","state":["exists","up"]},{"osd":4,"uuid":"4b302fff-834c-4069-ac19-00e46f6c87b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":3727975702},{"type":"v1","addr":"172.21.15.142:6801","nonce":3727975702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":3727975702},{"type":"v1","addr":"172.21.15.142:6803","nonce":3727975702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6809","nonce":3727975702},{"type":"v1","addr":"172.21.15.142:6811","nonce":3727975702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6805","nonce":3727975702},{"type":"v1","addr":"172.21.15.142:6807","nonce":3727975702}]},"public_addr":"172.21.15.142:6801/3727975702","cluster_addr":"172.21.15.142:6803/3727975702","heartbeat_back_addr":"172.21.15.142:6811/3727975702","heartbeat_front_addr":"172.21.15.142:6807/3727975702","state":["exists","up"]},{"osd":5,"uuid":"d7cdace2-67d0-45cc-95f2-515cf6ef1b82","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6817","nonce":2353193632},{"type":"v1","addr":"172.21.15.142:6819","nonce":2353193632}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6821","nonce":2353193632},{"type":"v1","addr":"172.21.15.142:6823","nonce":2353193632}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6829","nonce":2353193632},{"type":"v1","addr":"172.21.15.142:6831","nonce":2353193632}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6825","nonce":2353193632},{"type":"v1","addr":"172.21.15.142:6827","nonce":2353193632}]},"public_addr":"172.21.15.142:6819/2353193632","cluster_addr":"172.21.15.142:6823/2353193632","heartbeat_back_addr":"172.21.15.142:6831/2353193632","heartbeat_front_addr":"172.21.15.142:6827/2353193632","state":["exists","up"]},{"osd":6,"uuid":"649ce78a-5626-445c-aedc-a651ed05a6f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":2006111986},{"type":"v1","addr":"172.21.15.142:6806","nonce":2006111986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":2006111986},{"type":"v1","addr":"172.21.15.142:6810","nonce":2006111986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":2006111986},{"type":"v1","addr":"172.21.15.142:6815","nonce":2006111986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":2006111986},{"type":"v1","addr":"172.21.15.142:6813","nonce":2006111986}]},"public_addr":"172.21.15.142:6806/2006111986","cluster_addr":"172.21.15.142:6810/2006111986","heartbeat_back_addr":"172.21.15.142:6815/2006111986","heartbeat_front_addr":"172.21.15.142:6813/2006111986","state":["exists","up"]},{"osd":7,"uuid":"af15ae3b-c1d0-4acf-92db-8a1805494d13","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":2573794341},{"type":"v1","addr":"172.21.15.142:6818","nonce":2573794341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":2573794341},{"type":"v1","addr":"172.21.15.142:6822","nonce":2573794341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":2573794341},{"type":"v1","addr":"172.21.15.142:6830","nonce":2573794341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":2573794341},{"type":"v1","addr":"172.21.15.142:6826","nonce":2573794341}]},"public_addr":"172.21.15.142:6818/2573794341","cluster_addr":"172.21.15.142:6822/2573794341","heartbeat_back_addr":"172.21.15.142:6830/2573794341","heartbeat_front_addr":"172.21.15.142:6826/2573794341","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.185824+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.262103+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.225556+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:10.523459+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:10.706035+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.257339+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.301776+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.051960+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"7.9","mappings":[{"from":0,"to":5}]},{"pgid":"7.2d","mappings":[{"from":0,"to":4}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.73:6837/1534083424":"2023-12-13T09:45:02.776929+0000","172.21.15.73:6835/1534083424":"2023-12-13T09:45:02.776929+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-12T09:45:09.901 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:09.900+0000 7fa48cdb6640 1 -- 172.21.15.73:0/4025600502 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fa46806ae40 msgr2=0x7fa46806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:09.901 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:09.900+0000 7fa48cdb6640 1 --2- 172.21.15.73:0/4025600502 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fa46806ae40 0x7fa46806d300 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fa478007fd0 tx=0x7fa478007920 comp rx=0 tx=0).stop 2023-12-12T09:45:09.901 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:09.900+0000 7fa48cdb6640 1 -- 172.21.15.73:0/4025600502 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa4880a5040 msgr2=0x7fa48814a7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:09.902 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:09.900+0000 7fa48cdb6640 1 --2- 172.21.15.73:0/4025600502 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa4880a5040 0x7fa48814a7c0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7fa48000b990 tx=0x7fa48000be50 comp rx=0 tx=0).stop 2023-12-12T09:45:09.902 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:09.900+0000 7fa48cdb6640 1 -- 172.21.15.73:0/4025600502 shutdown_connections 2023-12-12T09:45:09.902 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:09.900+0000 7fa48cdb6640 1 --2- 172.21.15.73:0/4025600502 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fa46806ae40 0x7fa46806d300 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:09.902 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:09.900+0000 7fa48cdb6640 1 --2- 172.21.15.73:0/4025600502 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa4880a5040 0x7fa48814a7c0 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:09.902 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:09.900+0000 7fa48cdb6640 1 --2- 172.21.15.73:0/4025600502 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa48806bf90 0x7fa488150400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:09.902 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:09.900+0000 7fa48cdb6640 1 --2- 172.21.15.73:0/4025600502 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa48806a4e0 0x7fa48814c370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:09.902 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:09.900+0000 7fa48cdb6640 1 -- 172.21.15.73:0/4025600502 >> 172.21.15.73:0/4025600502 conn(0x7fa4880a8130 msgr2=0x7fa4880a6ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:45:09.902 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:09.900+0000 7fa48cdb6640 1 -- 172.21.15.73:0/4025600502 shutdown_connections 2023-12-12T09:45:09.902 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:09.900+0000 7fa48cdb6640 1 -- 172.21.15.73:0/4025600502 wait complete. 2023-12-12T09:45:09.921 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs2 2023-12-12T09:45:10.134 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:10.133+0000 7f155fe23640 1 Processor -- start 2023-12-12T09:45:10.134 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:10.133+0000 7f155fe23640 1 -- start start 2023-12-12T09:45:10.136 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:10.134+0000 7f155fe23640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f15580c0420 0x7f15580c17e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:10.136 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:10.134+0000 7f155fe23640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f1558072700 0x7f1558070080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:10.136 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:10.134+0000 7f155fe23640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1558152560 con 0x7f155806fca0 2023-12-12T09:45:10.136 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:10.134+0000 7f155fe23640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1558152ec0 con 0x7f1558072700 2023-12-12T09:45:10.136 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:10.134+0000 7f155fe23640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15580c53d0 con 0x7f15580c0420 2023-12-12T09:45:10.136 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:10.135+0000 7f155e3c0640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f1558072700 0x7f1558070080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:10.136 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:10.135+0000 7f155dbbf640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f155806fca0 0x7f15580c10d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:58434/0 (socket says 172.21.15.73:58434) 2023-12-12T09:45:10.136 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:10.135+0000 7f155dbbf640 1 -- 172.21.15.73:0/2079223501 learned_addr learned my addr 172.21.15.73:0/2079223501 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-12T09:45:10.137 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:10.135+0000 7f155d3be640 1 --2- 172.21.15.73:0/2079223501 >> v2:172.21.15.142:3300/0 conn(0x7f15580c0420 0x7f15580c17e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:10.137 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:10.135+0000 7f155cbbd640 1 -- 172.21.15.73:0/2079223501 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 340068938 0 0) 0x7f1558152560 con 0x7f155806fca0 2023-12-12T09:45:10.137 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:10.135+0000 7f155cbbd640 1 -- 172.21.15.73:0/2079223501 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1544003520 con 0x7f155806fca0 2023-12-12T09:45:10.137 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:10.135+0000 7f155e3c0640 1 -- 172.21.15.73:0/2079223501 >> v2:172.21.15.142:3300/0 conn(0x7f15580c0420 msgr2=0x7f15580c17e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:45:10.138 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:10.135+0000 7f155e3c0640 1 --2- 172.21.15.73:0/2079223501 >> v2:172.21.15.142:3300/0 conn(0x7f15580c0420 0x7f15580c17e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:10.138 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:10.135+0000 7f155e3c0640 1 -- 172.21.15.73:0/2079223501 >> v1:172.21.15.73:6789/0 conn(0x7f155806fca0 legacy=0x7f15580c10d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:10.138 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:10.135+0000 7f155e3c0640 1 -- 172.21.15.73:0/2079223501 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15581532e0 con 0x7f1558072700 2023-12-12T09:45:10.143 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:10.137+0000 7f155e3c0640 1 --2- 172.21.15.73:0/2079223501 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1558072700 0x7f1558070080 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f15580abd90 tx=0x7f155002be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5195865b1923461 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:45:10.143 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:10.137+0000 7f155cbbd640 1 -- 172.21.15.73:0/2079223501 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f155002cbf0 con 0x7f1558072700 2023-12-12T09:45:10.143 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:10.137+0000 7f155cbbd640 1 -- 172.21.15.73:0/2079223501 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f155002cd50 con 0x7f1558072700 2023-12-12T09:45:10.143 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:10.137+0000 7f155cbbd640 1 -- 172.21.15.73:0/2079223501 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1550034640 con 0x7f1558072700 2023-12-12T09:45:10.144 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:10.138+0000 7f155fe23640 1 -- 172.21.15.73:0/2079223501 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1558072700 msgr2=0x7f1558070080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:10.144 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:10.138+0000 7f155fe23640 1 --2- 172.21.15.73:0/2079223501 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1558072700 0x7f1558070080 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f15580abd90 tx=0x7f155002be40 comp rx=0 tx=0).stop 2023-12-12T09:45:10.144 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:10.138+0000 7f155fe23640 1 -- 172.21.15.73:0/2079223501 shutdown_connections 2023-12-12T09:45:10.144 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:10.138+0000 7f155fe23640 1 --2- 172.21.15.73:0/2079223501 >> v2:172.21.15.142:3300/0 conn(0x7f15580c0420 0x7f15580c17e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:10.144 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:10.138+0000 7f155fe23640 1 --2- 172.21.15.73:0/2079223501 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1558072700 0x7f1558070080 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:10.144 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:10.138+0000 7f155fe23640 1 -- 172.21.15.73:0/2079223501 >> 172.21.15.73:0/2079223501 conn(0x7f15580a77d0 msgr2=0x7f15580a7bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:45:10.144 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:10.138+0000 7f155fe23640 1 -- 172.21.15.73:0/2079223501 shutdown_connections 2023-12-12T09:45:10.144 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:10.138+0000 7f155fe23640 1 -- 172.21.15.73:0/2079223501 wait complete. 2023-12-12T09:45:10.144 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:10.139+0000 7f155fe23640 1 Processor -- start 2023-12-12T09:45:10.144 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:10.140+0000 7f155fe23640 1 -- start start 2023-12-12T09:45:10.144 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:10.140+0000 7f155fe23640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f155806fca0 0x7f15581454a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:10.144 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:10.140+0000 7f155fe23640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1558072700 0x7f1558155180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:10.144 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:10.140+0000 7f155fe23640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f15580c0420 0x7f15581556c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:10.144 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:10.140+0000 7f155fe23640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15580a88c0 con 0x7f155806fca0 2023-12-12T09:45:10.145 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:10.140+0000 7f155fe23640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15581eab10 con 0x7f1558072700 2023-12-12T09:45:10.145 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:10.140+0000 7f155fe23640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15581562e0 con 0x7f15580c0420 2023-12-12T09:45:10.145 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:10.141+0000 7f155dbbf640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f155806fca0 0x7f15581454a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:10.145 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:10.141+0000 7f155dbbf640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f155806fca0 0x7f15581454a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:38034/0 (socket says 172.21.15.73:38034) 2023-12-12T09:45:10.145 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:10.141+0000 7f155dbbf640 1 -- 172.21.15.73:0/2360842026 learned_addr learned my addr 172.21.15.73:0/2360842026 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:45:10.145 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:10.141+0000 7f155dbbf640 1 -- 172.21.15.73:0/2360842026 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f15580c0420 msgr2=0x7f15581556c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:10.145 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:10.141+0000 7f155dbbf640 1 --2- 172.21.15.73:0/2360842026 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f15580c0420 0x7f15581556c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:10.145 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:10.141+0000 7f155d3be640 1 --2- 172.21.15.73:0/2360842026 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1558072700 0x7f1558155180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:10.145 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:10.141+0000 7f155dbbf640 1 -- 172.21.15.73:0/2360842026 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1558072700 msgr2=0x7f1558155180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:10.145 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:10.141+0000 7f155dbbf640 1 --2- 172.21.15.73:0/2360842026 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1558072700 0x7f1558155180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:10.145 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:10.141+0000 7f155dbbf640 1 -- 172.21.15.73:0/2360842026 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1550009a70 con 0x7f155806fca0 2023-12-12T09:45:10.145 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:10.142+0000 7f155dbbf640 1 --2- 172.21.15.73:0/2360842026 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f155806fca0 0x7f15581454a0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f155400c390 tx=0x7f155400c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:45:10.145 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:10.142+0000 7f154e7fc640 1 -- 172.21.15.73:0/2360842026 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1554005ce0 con 0x7f155806fca0 2023-12-12T09:45:10.145 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:10.142+0000 7f154e7fc640 1 -- 172.21.15.73:0/2360842026 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1554005e40 con 0x7f155806fca0 2023-12-12T09:45:10.146 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:10.142+0000 7f155fe23640 1 -- 172.21.15.73:0/2360842026 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15581565c0 con 0x7f155806fca0 2023-12-12T09:45:10.146 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:10.142+0000 7f154e7fc640 1 -- 172.21.15.73:0/2360842026 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15540072f0 con 0x7f155806fca0 2023-12-12T09:45:10.146 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:10.142+0000 7f155fe23640 1 -- 172.21.15.73:0/2360842026 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15581459e0 con 0x7f155806fca0 2023-12-12T09:45:10.146 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:10.143+0000 7f155fe23640 1 -- 172.21.15.73:0/2360842026 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15580a8d50 con 0x7f155806fca0 2023-12-12T09:45:10.147 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:10.144+0000 7f154e7fc640 1 -- 172.21.15.73:0/2360842026 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f1554007450 con 0x7f155806fca0 2023-12-12T09:45:10.147 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:10.145+0000 7f154e7fc640 1 --2- 172.21.15.73:0/2360842026 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f153c06ae70 0x7f153c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:10.147 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:10.145+0000 7f154e7fc640 1 -- 172.21.15.73:0/2360842026 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5857+0+0 (secure 0 0 0) 0x7f1554088bf0 con 0x7f155806fca0 2023-12-12T09:45:10.147 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:10.145+0000 7f155d3be640 1 --2- 172.21.15.73:0/2360842026 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f153c06ae70 0x7f153c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:10.147 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:10.146+0000 7f155d3be640 1 --2- 172.21.15.73:0/2360842026 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f153c06ae70 0x7f153c06d330 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f15580a5610 tx=0x7f1548008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:45:10.151 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:10.150+0000 7f154e7fc640 1 -- 172.21.15.73:0/2360842026 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f15580a8d50 con 0x7f155806fca0 2023-12-12T09:45:10.378 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:10.376+0000 7f155fe23640 1 -- 172.21.15.73:0/2360842026 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs2"} v 0) v1 -- 0x7f15580a8d50 con 0x7f155806fca0 2023-12-12T09:45:10.379 INFO:tasks.ceph.mon.a.smithi073.stderr:2023-12-12T09:45:10.378+0000 7f81027f3640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-12-12T09:45:10.383 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:10.382+0000 7f154e7fc640 1 -- 172.21.15.73:0/2360842026 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs2"}]=0 cephfs2 marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v22) v1 ==== 163+0+0 (secure 0 0 0) 0x7f15580a8d50 con 0x7f155806fca0 2023-12-12T09:45:10.383 INFO:teuthology.orchestra.run.smithi073.stderr:cephfs2 marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-12-12T09:45:10.387 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:10.385+0000 7f155fe23640 1 -- 172.21.15.73:0/2360842026 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f153c06ae70 msgr2=0x7f153c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:10.387 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:10.385+0000 7f155fe23640 1 --2- 172.21.15.73:0/2360842026 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f153c06ae70 0x7f153c06d330 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f15580a5610 tx=0x7f1548008040 comp rx=0 tx=0).stop 2023-12-12T09:45:10.387 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:10.385+0000 7f155fe23640 1 -- 172.21.15.73:0/2360842026 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f155806fca0 msgr2=0x7f15581454a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:10.387 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:10.385+0000 7f155fe23640 1 --2- 172.21.15.73:0/2360842026 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f155806fca0 0x7f15581454a0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f155400c390 tx=0x7f155400c850 comp rx=0 tx=0).stop 2023-12-12T09:45:10.387 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:10.385+0000 7f155fe23640 1 -- 172.21.15.73:0/2360842026 shutdown_connections 2023-12-12T09:45:10.387 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:10.385+0000 7f155fe23640 1 --2- 172.21.15.73:0/2360842026 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f153c06ae70 0x7f153c06d330 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:10.387 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:10.385+0000 7f155fe23640 1 --2- 172.21.15.73:0/2360842026 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f15580c0420 0x7f15581556c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:10.387 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:10.385+0000 7f155fe23640 1 --2- 172.21.15.73:0/2360842026 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1558072700 0x7f1558155180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:10.387 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:10.385+0000 7f155fe23640 1 --2- 172.21.15.73:0/2360842026 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f155806fca0 0x7f15581454a0 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:10.387 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:10.385+0000 7f155fe23640 1 -- 172.21.15.73:0/2360842026 >> 172.21.15.73:0/2360842026 conn(0x7f15580a77d0 msgr2=0x7f1558071cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:45:10.387 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:10.385+0000 7f155fe23640 1 -- 172.21.15.73:0/2360842026 shutdown_connections 2023-12-12T09:45:10.387 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:10.385+0000 7f155fe23640 1 -- 172.21.15.73:0/2360842026 wait complete. 2023-12-12T09:45:10.408 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs2 --yes-i-really-mean-it 2023-12-12T09:45:10.409 INFO:tasks.ceph.mds.a.smithi073.stderr: -2318> 2023-12-12T09:44:37.419+0000 7f6e825c8640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-12-12T09:45:10.461 INFO:tasks.ceph.mds.a.smithi073.stdout:starting mds.a at 2023-12-12T09:45:10.597 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:10.596+0000 7f1c49bbe640 1 Processor -- start 2023-12-12T09:45:10.597 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:10.596+0000 7f1c49bbe640 1 -- start start 2023-12-12T09:45:10.598 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:10.597+0000 7f1c49bbe640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f1c440c1520 0x7f1c440c1980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:10.598 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:10.597+0000 7f1c49bbe640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c44158950 con 0x7f1c44151dc0 2023-12-12T09:45:10.598 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:10.597+0000 7f1c49bbe640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c440c4c20 con 0x7f1c440c1ec0 2023-12-12T09:45:10.599 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:10.597+0000 7f1c49bbe640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c441521a0 con 0x7f1c440c1520 2023-12-12T09:45:10.599 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:10.597+0000 7f1c437fe640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f1c44151dc0 0x7f1c440bed50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:58462/0 (socket says 172.21.15.73:58462) 2023-12-12T09:45:10.599 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:10.597+0000 7f1c437fe640 1 -- 172.21.15.73:0/37297649 learned_addr learned my addr 172.21.15.73:0/37297649 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-12T09:45:10.599 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:10.597+0000 7f1c3bfff640 1 --2- 172.21.15.73:0/37297649 >> v2:172.21.15.73:3300/0 conn(0x7f1c440c1520 0x7f1c440c1980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:10.599 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:10.598+0000 7f1c42ffd640 1 -- 172.21.15.73:0/37297649 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1169589944 0 0) 0x7f1c44158950 con 0x7f1c44151dc0 2023-12-12T09:45:10.599 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:10.598+0000 7f1c42ffd640 1 -- 172.21.15.73:0/37297649 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1c30003520 con 0x7f1c44151dc0 2023-12-12T09:45:10.599 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:10.598+0000 7f1c3bfff640 1 -- 172.21.15.73:0/37297649 >> v1:172.21.15.142:6789/0 conn(0x7f1c440c1ec0 legacy=0x7f1c4415ef80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:45:10.600 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:10.598+0000 7f1c3bfff640 1 -- 172.21.15.73:0/37297649 >> v1:172.21.15.73:6789/0 conn(0x7f1c44151dc0 legacy=0x7f1c440bed50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:10.600 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:10.598+0000 7f1c3bfff640 1 -- 172.21.15.73:0/37297649 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c440c4f00 con 0x7f1c440c1520 2023-12-12T09:45:10.600 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:10.599+0000 7f1c3bfff640 1 --2- 172.21.15.73:0/37297649 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1c440c1520 0x7f1c440c1980 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f1c2c0097a0 tx=0x7f1c2c02b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d178bba95508b8e server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:45:10.600 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:10.599+0000 7f1c42ffd640 1 -- 172.21.15.73:0/37297649 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c2c02e070 con 0x7f1c440c1520 2023-12-12T09:45:10.600 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:10.599+0000 7f1c42ffd640 1 -- 172.21.15.73:0/37297649 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c2c0315a0 con 0x7f1c440c1520 2023-12-12T09:45:10.601 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:10.599+0000 7f1c42ffd640 1 -- 172.21.15.73:0/37297649 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c2c031930 con 0x7f1c440c1520 2023-12-12T09:45:10.601 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:10.600+0000 7f1c49bbe640 1 -- 172.21.15.73:0/37297649 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1c440c1520 msgr2=0x7f1c440c1980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:10.601 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:10.600+0000 7f1c49bbe640 1 --2- 172.21.15.73:0/37297649 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1c440c1520 0x7f1c440c1980 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f1c2c0097a0 tx=0x7f1c2c02b840 comp rx=0 tx=0).stop 2023-12-12T09:45:10.601 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:10.600+0000 7f1c49bbe640 1 -- 172.21.15.73:0/37297649 shutdown_connections 2023-12-12T09:45:10.602 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:10.600+0000 7f1c49bbe640 1 --2- 172.21.15.73:0/37297649 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1c440c1520 0x7f1c440c1980 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:10.602 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:10.600+0000 7f1c49bbe640 1 -- 172.21.15.73:0/37297649 >> 172.21.15.73:0/37297649 conn(0x7f1c440c59a0 msgr2=0x7f1c440c5db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:45:10.602 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:10.600+0000 7f1c49bbe640 1 -- 172.21.15.73:0/37297649 shutdown_connections 2023-12-12T09:45:10.602 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:10.600+0000 7f1c49bbe640 1 -- 172.21.15.73:0/37297649 wait complete. 2023-12-12T09:45:10.603 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:10.602+0000 7f1c49bbe640 1 Processor -- start 2023-12-12T09:45:10.603 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:10.602+0000 7f1c49bbe640 1 -- start start 2023-12-12T09:45:10.605 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:10.603+0000 7f1c49bbe640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1c440c1520 0x7f1c440719b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:10.605 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:10.603+0000 7f1c49bbe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1c440c1ec0 0x7f1c44071ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:10.605 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:10.603+0000 7f1c49bbe640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1c44151dc0 0x7f1c441479b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:10.605 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:10.603+0000 7f1c49bbe640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c440c06d0 con 0x7f1c440c1ec0 2023-12-12T09:45:10.605 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:10.603+0000 7f1c49bbe640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c44072430 con 0x7f1c440c1520 2023-12-12T09:45:10.605 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:10.603+0000 7f1c49bbe640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c44070020 con 0x7f1c44151dc0 2023-12-12T09:45:10.605 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:10.603+0000 7f1c3bfff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1c440c1ec0 0x7f1c44071ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:10.605 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:10.603+0000 7f1c3bfff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1c440c1ec0 0x7f1c44071ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:38080/0 (socket says 172.21.15.73:38080) 2023-12-12T09:45:10.606 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:10.603+0000 7f1c3bfff640 1 -- 172.21.15.73:0/3341764441 learned_addr learned my addr 172.21.15.73:0/3341764441 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:45:10.606 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:10.603+0000 7f1c437fe640 1 --2- 172.21.15.73:0/3341764441 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1c440c1520 0x7f1c440719b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:10.606 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:10.604+0000 7f1c3bfff640 1 -- 172.21.15.73:0/3341764441 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1c44151dc0 msgr2=0x7f1c441479b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:10.606 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:10.604+0000 7f1c3bfff640 1 --2- 172.21.15.73:0/3341764441 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1c44151dc0 0x7f1c441479b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:10.606 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:10.604+0000 7f1c3bfff640 1 -- 172.21.15.73:0/3341764441 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1c440c1520 msgr2=0x7f1c440719b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:10.606 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:10.604+0000 7f1c3bfff640 1 --2- 172.21.15.73:0/3341764441 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1c440c1520 0x7f1c440719b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:10.606 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:10.604+0000 7f1c3bfff640 1 -- 172.21.15.73:0/3341764441 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c2c009400 con 0x7f1c440c1ec0 2023-12-12T09:45:10.606 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:10.604+0000 7f1c3bfff640 1 --2- 172.21.15.73:0/3341764441 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1c440c1ec0 0x7f1c44071ef0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f1c2c034040 tx=0x7f1c2c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:45:10.607 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:10.604+0000 7f1c40ff9640 1 -- 172.21.15.73:0/3341764441 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c2c032840 con 0x7f1c440c1ec0 2023-12-12T09:45:10.607 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:10.604+0000 7f1c40ff9640 1 -- 172.21.15.73:0/3341764441 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c2c0329c0 con 0x7f1c440c1ec0 2023-12-12T09:45:10.607 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:10.604+0000 7f1c49bbe640 1 -- 172.21.15.73:0/3341764441 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c4406fcd0 con 0x7f1c440c1ec0 2023-12-12T09:45:10.607 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:10.604+0000 7f1c40ff9640 1 -- 172.21.15.73:0/3341764441 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c2c032d70 con 0x7f1c440c1ec0 2023-12-12T09:45:10.607 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:10.604+0000 7f1c49bbe640 1 -- 172.21.15.73:0/3341764441 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c441eaf30 con 0x7f1c440c1ec0 2023-12-12T09:45:10.607 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:10.606+0000 7f1c49bbe640 1 -- 172.21.15.73:0/3341764441 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c441eb180 con 0x7f1c440c1ec0 2023-12-12T09:45:10.608 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:10.606+0000 7f1c40ff9640 1 -- 172.21.15.73:0/3341764441 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f1c2c03b3f0 con 0x7f1c440c1ec0 2023-12-12T09:45:10.608 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:10.607+0000 7f1c40ff9640 1 --2- 172.21.15.73:0/3341764441 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f1c2406ae40 0x7f1c2406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:10.608 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:10.607+0000 7f1c40ff9640 1 -- 172.21.15.73:0/3341764441 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5943+0+0 (secure 0 0 0) 0x7f1c2c0ab5f0 con 0x7f1c440c1ec0 2023-12-12T09:45:10.609 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:10.607+0000 7f1c437fe640 1 --2- 172.21.15.73:0/3341764441 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f1c2406ae40 0x7f1c2406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:10.609 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:10.608+0000 7f1c437fe640 1 --2- 172.21.15.73:0/3341764441 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f1c2406ae40 0x7f1c2406d300 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f1c340011e0 tx=0x7f1c34009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:45:10.613 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:10.612+0000 7f1c40ff9640 1 -- 172.21.15.73:0/3341764441 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f1c2c0765a0 con 0x7f1c440c1ec0 2023-12-12T09:45:10.833 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:10.832+0000 7f1c49bbe640 1 -- 172.21.15.73:0/3341764441 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs2", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f1c441eb5f0 con 0x7f1c440c1ec0 2023-12-12T09:45:11.387 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:11.385+0000 7f1c40ff9640 1 -- 172.21.15.73:0/3341764441 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs2", "yes_i_really_mean_it": true}]=0 v23) v1 ==== 105+0+0 (secure 0 0 0) 0x7f1c2c079bc0 con 0x7f1c440c1ec0 2023-12-12T09:45:11.390 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:11.389+0000 7f1c49bbe640 1 -- 172.21.15.73:0/3341764441 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f1c2406ae40 msgr2=0x7f1c2406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:11.390 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:11.389+0000 7f1c49bbe640 1 --2- 172.21.15.73:0/3341764441 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f1c2406ae40 0x7f1c2406d300 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f1c340011e0 tx=0x7f1c34009040 comp rx=0 tx=0).stop 2023-12-12T09:45:11.390 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:11.389+0000 7f1c49bbe640 1 -- 172.21.15.73:0/3341764441 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1c440c1ec0 msgr2=0x7f1c44071ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:11.390 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:11.389+0000 7f1c49bbe640 1 --2- 172.21.15.73:0/3341764441 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1c440c1ec0 0x7f1c44071ef0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f1c2c034040 tx=0x7f1c2c0046c0 comp rx=0 tx=0).stop 2023-12-12T09:45:11.391 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:11.389+0000 7f1c49bbe640 1 -- 172.21.15.73:0/3341764441 shutdown_connections 2023-12-12T09:45:11.391 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:11.389+0000 7f1c49bbe640 1 --2- 172.21.15.73:0/3341764441 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f1c2406ae40 0x7f1c2406d300 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:11.391 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:11.389+0000 7f1c49bbe640 1 --2- 172.21.15.73:0/3341764441 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1c44151dc0 0x7f1c441479b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:11.391 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:11.389+0000 7f1c49bbe640 1 --2- 172.21.15.73:0/3341764441 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1c440c1ec0 0x7f1c44071ef0 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:11.391 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:11.389+0000 7f1c49bbe640 1 --2- 172.21.15.73:0/3341764441 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1c440c1520 0x7f1c440719b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:11.391 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:11.389+0000 7f1c49bbe640 1 -- 172.21.15.73:0/3341764441 >> 172.21.15.73:0/3341764441 conn(0x7f1c440c59a0 msgr2=0x7f1c440a5600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:45:11.391 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:11.389+0000 7f1c49bbe640 1 -- 172.21.15.73:0/3341764441 shutdown_connections 2023-12-12T09:45:11.391 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:11.389+0000 7f1c49bbe640 1 -- 172.21.15.73:0/3341764441 wait complete. 2023-12-12T09:45:11.412 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs2_metadata cephfs2_metadata --yes-i-really-really-mean-it 2023-12-12T09:45:11.620 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:11.619+0000 7fbf8ea1a640 1 Processor -- start 2023-12-12T09:45:11.621 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:11.619+0000 7fbf8ea1a640 1 -- start start 2023-12-12T09:45:11.623 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:11.621+0000 7fbf8ea1a640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fbf880c03f0 0x7fbf880c07d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:11.623 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:11.621+0000 7fbf8ea1a640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbf880c1990 0x7fbf88159d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:11.623 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:11.621+0000 7fbf8ea1a640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fbf880c0d10 0x7fbf8815a2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:11.623 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:11.621+0000 7fbf8ea1a640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf8815ba10 con 0x7fbf880c03f0 2023-12-12T09:45:11.623 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:11.621+0000 7fbf8ea1a640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf881595b0 con 0x7fbf880c0d10 2023-12-12T09:45:11.623 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:11.621+0000 7fbf8ea1a640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf881589a0 con 0x7fbf880c1990 2023-12-12T09:45:11.623 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:11.621+0000 7fbf8da18640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fbf880c03f0 0x7fbf880c07d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:11.623 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:11.621+0000 7fbf8da18640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fbf880c03f0 0x7fbf880c07d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:38092/0 (socket says 172.21.15.73:38092) 2023-12-12T09:45:11.624 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:11.621+0000 7fbf8da18640 1 -- 172.21.15.73:0/1049593428 learned_addr learned my addr 172.21.15.73:0/1049593428 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:45:11.624 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:11.621+0000 7fbf8da18640 1 -- 172.21.15.73:0/1049593428 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbf880c1990 msgr2=0x7fbf88159d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:45:11.624 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:11.621+0000 7fbf8da18640 1 --2- 172.21.15.73:0/1049593428 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbf880c1990 0x7fbf88159d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:11.624 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:11.621+0000 7fbf8da18640 1 -- 172.21.15.73:0/1049593428 >> v2:172.21.15.142:3300/0 conn(0x7fbf880c0d10 msgr2=0x7fbf8815a2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:45:11.624 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:11.621+0000 7fbf8e219640 1 --2- 172.21.15.73:0/1049593428 >> v2:172.21.15.142:3300/0 conn(0x7fbf880c0d10 0x7fbf8815a2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:11.624 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:11.622+0000 7fbf8da18640 1 --2- 172.21.15.73:0/1049593428 >> v2:172.21.15.142:3300/0 conn(0x7fbf880c0d10 0x7fbf8815a2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:11.624 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:11.622+0000 7fbf8da18640 1 -- 172.21.15.73:0/1049593428 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf88158c80 con 0x7fbf880c03f0 2023-12-12T09:45:11.624 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:11.622+0000 7fbf8e219640 1 --2- 172.21.15.73:0/1049593428 >> v2:172.21.15.142:3300/0 conn(0x7fbf880c0d10 0x7fbf8815a2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:45:11.625 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:11.623+0000 7fbf8da18640 1 --2- 172.21.15.73:0/1049593428 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbf880c03f0 0x7fbf880c07d0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7fbf881561b0 tx=0x7fbf8402b7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5e779d388444002 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:45:11.625 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:11.623+0000 7fbf8ca16640 1 -- 172.21.15.73:0/1049593428 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf84031740 con 0x7fbf880c03f0 2023-12-12T09:45:11.626 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:11.623+0000 7fbf8ca16640 1 -- 172.21.15.73:0/1049593428 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf840318a0 con 0x7fbf880c03f0 2023-12-12T09:45:11.626 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:11.623+0000 7fbf8ca16640 1 -- 172.21.15.73:0/1049593428 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf84031c30 con 0x7fbf880c03f0 2023-12-12T09:45:11.626 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:11.624+0000 7fbf8ea1a640 1 -- 172.21.15.73:0/1049593428 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbf880c03f0 msgr2=0x7fbf880c07d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:11.626 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:11.624+0000 7fbf8ea1a640 1 --2- 172.21.15.73:0/1049593428 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbf880c03f0 0x7fbf880c07d0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7fbf881561b0 tx=0x7fbf8402b7e0 comp rx=0 tx=0).stop 2023-12-12T09:45:11.626 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:11.624+0000 7fbf8ea1a640 1 -- 172.21.15.73:0/1049593428 shutdown_connections 2023-12-12T09:45:11.626 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:11.624+0000 7fbf8ea1a640 1 --2- 172.21.15.73:0/1049593428 >> v2:172.21.15.142:3300/0 conn(0x7fbf880c0d10 0x7fbf8815a2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:11.626 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:11.624+0000 7fbf8ea1a640 1 --2- 172.21.15.73:0/1049593428 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbf880c1990 0x7fbf88159d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:11.626 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:11.624+0000 7fbf8ea1a640 1 --2- 172.21.15.73:0/1049593428 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbf880c03f0 0x7fbf880c07d0 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:11.626 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:11.624+0000 7fbf8ea1a640 1 -- 172.21.15.73:0/1049593428 >> 172.21.15.73:0/1049593428 conn(0x7fbf8806a4e0 msgr2=0x7fbf8806a8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:45:11.626 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:11.624+0000 7fbf8ea1a640 1 -- 172.21.15.73:0/1049593428 shutdown_connections 2023-12-12T09:45:11.626 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:11.624+0000 7fbf8ea1a640 1 -- 172.21.15.73:0/1049593428 wait complete. 2023-12-12T09:45:11.627 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:11.626+0000 7fbf8ea1a640 1 Processor -- start 2023-12-12T09:45:11.627 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:11.626+0000 7fbf8ea1a640 1 -- start start 2023-12-12T09:45:11.629 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:11.627+0000 7fbf8ea1a640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbf880c03f0 0x7fbf881f23d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:11.629 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:11.627+0000 7fbf8ea1a640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbf880c0d10 0x7fbf8814d810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:11.629 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:11.628+0000 7fbf8ea1a640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbf880c1990 0x7fbf881eea80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:11.629 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:11.628+0000 7fbf8ea1a640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf881ee5f0 con 0x7fbf880c03f0 2023-12-12T09:45:11.629 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:11.628+0000 7fbf8ea1a640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf880c3ec0 con 0x7fbf880c1990 2023-12-12T09:45:11.629 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:11.628+0000 7fbf8ea1a640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf880c3900 con 0x7fbf880c0d10 2023-12-12T09:45:11.629 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:11.628+0000 7fbf8da18640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbf880c03f0 0x7fbf881f23d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:11.629 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:11.628+0000 7fbf8da18640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbf880c03f0 0x7fbf881f23d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:38104/0 (socket says 172.21.15.73:38104) 2023-12-12T09:45:11.629 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:11.628+0000 7fbf8da18640 1 -- 172.21.15.73:0/1630487481 learned_addr learned my addr 172.21.15.73:0/1630487481 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:45:11.631 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:11.628+0000 7fbf8da18640 1 -- 172.21.15.73:0/1630487481 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbf880c0d10 msgr2=0x7fbf8814d810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:11.631 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:11.628+0000 7fbf8da18640 1 --2- 172.21.15.73:0/1630487481 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbf880c0d10 0x7fbf8814d810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:11.631 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:11.628+0000 7fbf8da18640 1 -- 172.21.15.73:0/1630487481 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbf880c1990 msgr2=0x7fbf881eea80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:11.631 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:11.628+0000 7fbf8da18640 1 --2- 172.21.15.73:0/1630487481 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbf880c1990 0x7fbf881eea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:11.631 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:11.628+0000 7fbf8da18640 1 -- 172.21.15.73:0/1630487481 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf840094d0 con 0x7fbf880c03f0 2023-12-12T09:45:11.631 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:11.629+0000 7fbf8da18640 1 --2- 172.21.15.73:0/1630487481 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbf880c03f0 0x7fbf881f23d0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7fbf8402b820 tx=0x7fbf840046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:45:11.631 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:11.629+0000 7fbf7e7fc640 1 -- 172.21.15.73:0/1630487481 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf84033c70 con 0x7fbf880c03f0 2023-12-12T09:45:11.631 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:11.629+0000 7fbf7e7fc640 1 -- 172.21.15.73:0/1630487481 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf84033e10 con 0x7fbf880c03f0 2023-12-12T09:45:11.631 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:11.629+0000 7fbf8ea1a640 1 -- 172.21.15.73:0/1630487481 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf880c3be0 con 0x7fbf880c03f0 2023-12-12T09:45:11.631 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:11.629+0000 7fbf7e7fc640 1 -- 172.21.15.73:0/1630487481 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf8403c640 con 0x7fbf880c03f0 2023-12-12T09:45:11.631 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:11.629+0000 7fbf8ea1a640 1 -- 172.21.15.73:0/1630487481 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf880a8750 con 0x7fbf880c03f0 2023-12-12T09:45:11.632 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:11.630+0000 7fbf8ea1a640 1 -- 172.21.15.73:0/1630487481 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf88067400 con 0x7fbf880c03f0 2023-12-12T09:45:11.632 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:11.631+0000 7fbf7e7fc640 1 -- 172.21.15.73:0/1630487481 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fbf8403a040 con 0x7fbf880c03f0 2023-12-12T09:45:11.633 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:11.632+0000 7fbf7e7fc640 1 --2- 172.21.15.73:0/1630487481 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fbf6c06ae40 0x7fbf6c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:11.633 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:11.632+0000 7fbf7e7fc640 1 -- 172.21.15.73:0/1630487481 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5943+0+0 (secure 0 0 0) 0x7fbf840ab440 con 0x7fbf880c03f0 2023-12-12T09:45:11.634 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:11.632+0000 7fbf8d217640 1 --2- 172.21.15.73:0/1630487481 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fbf6c06ae40 0x7fbf6c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:11.634 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:11.633+0000 7fbf8d217640 1 --2- 172.21.15.73:0/1630487481 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fbf6c06ae40 0x7fbf6c06d300 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fbf881582e0 tx=0x7fbf78006bf0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:45:11.637 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:11.636+0000 7fbf7e7fc640 1 -- 172.21.15.73:0/1630487481 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fbf84076510 con 0x7fbf880c03f0 2023-12-12T09:45:11.826 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:11.825+0000 7fbf8ea1a640 1 -- 172.21.15.73:0/1630487481 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs2_metadata", "pool2": "cephfs2_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fbf880c3a40 con 0x7fbf880c03f0 2023-12-12T09:45:12.396 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:12.395+0000 7fbf7e7fc640 1 -- 172.21.15.73:0/1630487481 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs2_metadata", "pool2": "cephfs2_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs2_metadata' removed v45) v1 ==== 184+0+0 (secure 0 0 0) 0x7fbf880c3a40 con 0x7fbf880c03f0 2023-12-12T09:45:12.396 INFO:teuthology.orchestra.run.smithi073.stderr:pool 'cephfs2_metadata' removed 2023-12-12T09:45:12.400 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:12.399+0000 7fbf8ea1a640 1 -- 172.21.15.73:0/1630487481 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fbf6c06ae40 msgr2=0x7fbf6c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:12.400 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:12.399+0000 7fbf8ea1a640 1 --2- 172.21.15.73:0/1630487481 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fbf6c06ae40 0x7fbf6c06d300 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fbf881582e0 tx=0x7fbf78006bf0 comp rx=0 tx=0).stop 2023-12-12T09:45:12.400 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:12.399+0000 7fbf8ea1a640 1 -- 172.21.15.73:0/1630487481 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbf880c03f0 msgr2=0x7fbf881f23d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:12.400 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:12.399+0000 7fbf8ea1a640 1 --2- 172.21.15.73:0/1630487481 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbf880c03f0 0x7fbf881f23d0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7fbf8402b820 tx=0x7fbf840046c0 comp rx=0 tx=0).stop 2023-12-12T09:45:12.400 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:12.399+0000 7fbf8ea1a640 1 -- 172.21.15.73:0/1630487481 shutdown_connections 2023-12-12T09:45:12.401 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:12.399+0000 7fbf8ea1a640 1 --2- 172.21.15.73:0/1630487481 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fbf6c06ae40 0x7fbf6c06d300 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:12.401 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:12.399+0000 7fbf8ea1a640 1 --2- 172.21.15.73:0/1630487481 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbf880c1990 0x7fbf881eea80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:12.401 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:12.399+0000 7fbf8ea1a640 1 --2- 172.21.15.73:0/1630487481 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbf880c0d10 0x7fbf8814d810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:12.401 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:12.400+0000 7fbf8ea1a640 1 --2- 172.21.15.73:0/1630487481 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbf880c03f0 0x7fbf881f23d0 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:12.401 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:12.400+0000 7fbf8ea1a640 1 -- 172.21.15.73:0/1630487481 >> 172.21.15.73:0/1630487481 conn(0x7fbf8806a4e0 msgr2=0x7fbf88159d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:45:12.401 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:12.400+0000 7fbf8ea1a640 1 -- 172.21.15.73:0/1630487481 shutdown_connections 2023-12-12T09:45:12.401 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:12.400+0000 7fbf8ea1a640 1 -- 172.21.15.73:0/1630487481 wait complete. 2023-12-12T09:45:12.422 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs2_data cephfs2_data --yes-i-really-really-mean-it 2023-12-12T09:45:12.637 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:12.635+0000 7ff433e90640 1 Processor -- start 2023-12-12T09:45:12.637 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:12.635+0000 7ff433e90640 1 -- start start 2023-12-12T09:45:12.638 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:12.637+0000 7ff433e90640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7ff42c0c84d0 0x7ff42c06c340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:12.638 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:12.637+0000 7ff433e90640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff42c06c880 0x7ff42c0c68c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:12.639 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:12.637+0000 7ff433e90640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff42c06bb80 con 0x7ff42c152000 2023-12-12T09:45:12.639 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:12.637+0000 7ff433e90640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff42c0c4830 con 0x7ff42c0c84d0 2023-12-12T09:45:12.639 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:12.637+0000 7ff433e90640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff42c0c4b10 con 0x7ff42c06c880 2023-12-12T09:45:12.639 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:12.637+0000 7ff43142b640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7ff42c0c84d0 0x7ff42c06c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:12.639 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:12.637+0000 7ff43142b640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7ff42c0c84d0 0x7ff42c06c340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:38116/0 (socket says 172.21.15.73:38116) 2023-12-12T09:45:12.639 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:12.637+0000 7ff43142b640 1 -- 172.21.15.73:0/3205551121 learned_addr learned my addr 172.21.15.73:0/3205551121 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:45:12.640 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:12.638+0000 7ff43242d640 1 --2- 172.21.15.73:0/3205551121 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff42c06c880 0x7ff42c0c68c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:12.640 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:12.638+0000 7ff43142b640 1 -- 172.21.15.73:0/3205551121 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff42c06c880 msgr2=0x7ff42c0c68c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:45:12.640 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:12.638+0000 7ff43142b640 1 --2- 172.21.15.73:0/3205551121 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff42c06c880 0x7ff42c0c68c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:12.640 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:12.638+0000 7ff43142b640 1 -- 172.21.15.73:0/3205551121 >> v1:172.21.15.142:6789/0 conn(0x7ff42c152000 legacy=0x7ff42c1551e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:45:12.640 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:12.638+0000 7ff43142b640 1 -- 172.21.15.73:0/3205551121 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff42c0c4df0 con 0x7ff42c0c84d0 2023-12-12T09:45:12.640 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:12.639+0000 7ff43142b640 1 --2- 172.21.15.73:0/3205551121 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff42c0c84d0 0x7ff42c06c340 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7ff420009870 tx=0x7ff42002b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1043dd366dd12797 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:45:12.641 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:12.639+0000 7ff430c2a640 1 -- 172.21.15.73:0/3205551121 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4200317c0 con 0x7ff42c0c84d0 2023-12-12T09:45:12.642 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:12.639+0000 7ff430c2a640 1 -- 172.21.15.73:0/3205551121 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff420031920 con 0x7ff42c0c84d0 2023-12-12T09:45:12.642 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:12.639+0000 7ff430c2a640 1 -- 172.21.15.73:0/3205551121 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff420031cb0 con 0x7ff42c0c84d0 2023-12-12T09:45:12.642 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:12.640+0000 7ff433e90640 1 -- 172.21.15.73:0/3205551121 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff42c0c84d0 msgr2=0x7ff42c06c340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:12.642 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:12.640+0000 7ff433e90640 1 --2- 172.21.15.73:0/3205551121 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff42c0c84d0 0x7ff42c06c340 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7ff420009870 tx=0x7ff42002b860 comp rx=0 tx=0).stop 2023-12-12T09:45:12.642 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:12.640+0000 7ff433e90640 1 -- 172.21.15.73:0/3205551121 shutdown_connections 2023-12-12T09:45:12.642 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:12.640+0000 7ff433e90640 1 --2- 172.21.15.73:0/3205551121 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff42c06c880 0x7ff42c0c68c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:12.642 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:12.640+0000 7ff433e90640 1 --2- 172.21.15.73:0/3205551121 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff42c0c84d0 0x7ff42c06c340 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:12.642 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:12.640+0000 7ff433e90640 1 -- 172.21.15.73:0/3205551121 >> 172.21.15.73:0/3205551121 conn(0x7ff42c0ab9e0 msgr2=0x7ff42c0abdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:45:12.642 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:12.640+0000 7ff433e90640 1 -- 172.21.15.73:0/3205551121 shutdown_connections 2023-12-12T09:45:12.642 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:12.640+0000 7ff433e90640 1 -- 172.21.15.73:0/3205551121 wait complete. 2023-12-12T09:45:12.643 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:12.642+0000 7ff433e90640 1 Processor -- start 2023-12-12T09:45:12.643 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:12.642+0000 7ff433e90640 1 -- start start 2023-12-12T09:45:12.645 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:12.643+0000 7ff433e90640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff42c06c880 0x7ff42c0c3910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:12.645 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:12.643+0000 7ff433e90640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff42c0c84d0 0x7ff42c14a6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:12.645 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:12.643+0000 7ff433e90640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff42c0acbf0 0x7ff42c14abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:12.646 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:12.643+0000 7ff433e90640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff42c14b440 con 0x7ff42c0c84d0 2023-12-12T09:45:12.646 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:12.643+0000 7ff433e90640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff42c0c2460 con 0x7ff42c06c880 2023-12-12T09:45:12.646 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:12.643+0000 7ff433e90640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff42c0c1b30 con 0x7ff42c0acbf0 2023-12-12T09:45:12.646 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:12.643+0000 7ff43142b640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff42c0c84d0 0x7ff42c14a6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:12.646 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:12.643+0000 7ff43142b640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff42c0c84d0 0x7ff42c14a6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:38124/0 (socket says 172.21.15.73:38124) 2023-12-12T09:45:12.646 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:12.643+0000 7ff43142b640 1 -- 172.21.15.73:0/181772250 learned_addr learned my addr 172.21.15.73:0/181772250 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:45:12.646 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:12.643+0000 7ff43142b640 1 -- 172.21.15.73:0/181772250 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff42c0acbf0 msgr2=0x7ff42c14abe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:12.646 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:12.643+0000 7ff43142b640 1 --2- 172.21.15.73:0/181772250 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff42c0acbf0 0x7ff42c14abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:12.646 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:12.643+0000 7ff431c2c640 1 --2- 172.21.15.73:0/181772250 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff42c06c880 0x7ff42c0c3910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:12.646 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:12.643+0000 7ff43142b640 1 -- 172.21.15.73:0/181772250 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff42c06c880 msgr2=0x7ff42c0c3910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:12.646 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:12.643+0000 7ff43142b640 1 --2- 172.21.15.73:0/181772250 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff42c06c880 0x7ff42c0c3910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:12.646 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:12.643+0000 7ff43142b640 1 -- 172.21.15.73:0/181772250 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4200094d0 con 0x7ff42c0c84d0 2023-12-12T09:45:12.647 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:12.644+0000 7ff43142b640 1 --2- 172.21.15.73:0/181772250 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff42c0c84d0 0x7ff42c14a6a0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7ff42002b8a0 tx=0x7ff4200046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:45:12.647 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:12.644+0000 7ff42a7fc640 1 -- 172.21.15.73:0/181772250 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff420032860 con 0x7ff42c0c84d0 2023-12-12T09:45:12.647 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:12.644+0000 7ff42a7fc640 1 -- 172.21.15.73:0/181772250 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4200329c0 con 0x7ff42c0c84d0 2023-12-12T09:45:12.647 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:12.644+0000 7ff42a7fc640 1 -- 172.21.15.73:0/181772250 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff420032d70 con 0x7ff42c0c84d0 2023-12-12T09:45:12.647 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:12.644+0000 7ff433e90640 1 -- 172.21.15.73:0/181772250 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff42c0c1e10 con 0x7ff42c0c84d0 2023-12-12T09:45:12.647 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:12.644+0000 7ff433e90640 1 -- 172.21.15.73:0/181772250 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff42c0c3e50 con 0x7ff42c0c84d0 2023-12-12T09:45:12.648 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:12.645+0000 7ff433e90640 1 -- 172.21.15.73:0/181772250 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff42c0c25f0 con 0x7ff42c0c84d0 2023-12-12T09:45:12.648 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:12.646+0000 7ff42a7fc640 1 -- 172.21.15.73:0/181772250 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7ff42004e450 con 0x7ff42c0c84d0 2023-12-12T09:45:12.648 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:12.647+0000 7ff42a7fc640 1 --2- 172.21.15.73:0/181772250 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7ff41806ae40 0x7ff41806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:12.648 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:12.647+0000 7ff42a7fc640 1 -- 172.21.15.73:0/181772250 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5503+0+0 (secure 0 0 0) 0x7ff4200ab760 con 0x7ff42c0c84d0 2023-12-12T09:45:12.649 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:12.648+0000 7ff431c2c640 1 --2- 172.21.15.73:0/181772250 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7ff41806ae40 0x7ff41806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:12.649 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:12.648+0000 7ff431c2c640 1 --2- 172.21.15.73:0/181772250 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7ff41806ae40 0x7ff41806d300 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7ff41c007fd0 tx=0x7ff41c009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:45:12.653 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:12.652+0000 7ff42a7fc640 1 -- 172.21.15.73:0/181772250 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7ff4200769f0 con 0x7ff42c0c84d0 2023-12-12T09:45:12.843 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:12.841+0000 7ff433e90640 1 -- 172.21.15.73:0/181772250 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs2_data", "pool2": "cephfs2_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7ff42c067580 con 0x7ff42c0c84d0 2023-12-12T09:45:13.410 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:13.407+0000 7ff42a7fc640 1 -- 172.21.15.73:0/181772250 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs2_data", "pool2": "cephfs2_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs2_data' removed v46) v1 ==== 172+0+0 (secure 0 0 0) 0x7ff42007a010 con 0x7ff42c0c84d0 2023-12-12T09:45:13.410 INFO:teuthology.orchestra.run.smithi073.stderr:pool 'cephfs2_data' removed 2023-12-12T09:45:13.412 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:13.410+0000 7ff433e90640 1 -- 172.21.15.73:0/181772250 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7ff41806ae40 msgr2=0x7ff41806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:13.412 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:13.411+0000 7ff433e90640 1 --2- 172.21.15.73:0/181772250 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7ff41806ae40 0x7ff41806d300 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7ff41c007fd0 tx=0x7ff41c009040 comp rx=0 tx=0).stop 2023-12-12T09:45:13.412 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:13.411+0000 7ff433e90640 1 -- 172.21.15.73:0/181772250 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff42c0c84d0 msgr2=0x7ff42c14a6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:13.412 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:13.411+0000 7ff433e90640 1 --2- 172.21.15.73:0/181772250 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff42c0c84d0 0x7ff42c14a6a0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7ff42002b8a0 tx=0x7ff4200046c0 comp rx=0 tx=0).stop 2023-12-12T09:45:13.413 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:13.411+0000 7ff433e90640 1 -- 172.21.15.73:0/181772250 shutdown_connections 2023-12-12T09:45:13.413 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:13.411+0000 7ff433e90640 1 --2- 172.21.15.73:0/181772250 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7ff41806ae40 0x7ff41806d300 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:13.413 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:13.411+0000 7ff433e90640 1 --2- 172.21.15.73:0/181772250 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff42c0acbf0 0x7ff42c14abe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:13.413 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:13.411+0000 7ff433e90640 1 --2- 172.21.15.73:0/181772250 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff42c0c84d0 0x7ff42c14a6a0 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:13.413 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:13.411+0000 7ff433e90640 1 --2- 172.21.15.73:0/181772250 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff42c06c880 0x7ff42c0c3910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:13.413 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:13.411+0000 7ff433e90640 1 -- 172.21.15.73:0/181772250 >> 172.21.15.73:0/181772250 conn(0x7ff42c0ab9e0 msgr2=0x7ff42c0abdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:45:13.413 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:13.411+0000 7ff433e90640 1 -- 172.21.15.73:0/181772250 shutdown_connections 2023-12-12T09:45:13.413 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:13.411+0000 7ff433e90640 1 -- 172.21.15.73:0/181772250 wait complete. 2023-12-12T09:45:13.437 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-12-12T09:45:13.654 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:13.653+0000 7f3ca4390640 1 Processor -- start 2023-12-12T09:45:13.654 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:13.653+0000 7f3ca4390640 1 -- start start 2023-12-12T09:45:13.656 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:13.654+0000 7f3ca4390640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3c9c0c23b0 0x7f3c9c0c0320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:13.656 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:13.654+0000 7f3ca4390640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f3c9c06cc90 0x7f3c9c0c2790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:13.656 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:13.654+0000 7f3ca4390640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f3c9c159410 0x7f3c9c0c50d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:13.656 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:13.654+0000 7f3ca4390640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c9c0c46f0 con 0x7f3c9c06cc90 2023-12-12T09:45:13.656 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:13.654+0000 7f3ca4390640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c9c0c1520 con 0x7f3c9c159410 2023-12-12T09:45:13.656 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:13.654+0000 7f3ca4390640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c9c06d0d0 con 0x7f3c9c0c23b0 2023-12-12T09:45:13.657 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:13.654+0000 7f3ca192b640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f3c9c06cc90 0x7f3c9c0c2790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:13.657 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:13.654+0000 7f3ca192b640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f3c9c06cc90 0x7f3c9c0c2790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:38130/0 (socket says 172.21.15.73:38130) 2023-12-12T09:45:13.657 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:13.655+0000 7f3ca192b640 1 -- 172.21.15.73:0/1961055234 learned_addr learned my addr 172.21.15.73:0/1961055234 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:45:13.657 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:13.655+0000 7f3ca212c640 1 --2- 172.21.15.73:0/1961055234 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3c9c0c23b0 0x7f3c9c0c0320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:13.657 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:13.655+0000 7f3ca292d640 1 --2- 172.21.15.73:0/1961055234 >> v2:172.21.15.142:3300/0 conn(0x7f3c9c159410 0x7f3c9c0c50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:13.657 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:13.655+0000 7f3ca192b640 1 -- 172.21.15.73:0/1961055234 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3c9c0c23b0 msgr2=0x7f3c9c0c0320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:45:13.657 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:13.655+0000 7f3ca192b640 1 --2- 172.21.15.73:0/1961055234 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3c9c0c23b0 0x7f3c9c0c0320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:13.657 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:13.655+0000 7f3ca192b640 1 -- 172.21.15.73:0/1961055234 >> v2:172.21.15.142:3300/0 conn(0x7f3c9c159410 msgr2=0x7f3c9c0c50d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:45:13.657 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:13.655+0000 7f3ca192b640 1 --2- 172.21.15.73:0/1961055234 >> v2:172.21.15.142:3300/0 conn(0x7f3c9c159410 0x7f3c9c0c50d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:13.657 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:13.655+0000 7f3ca192b640 1 -- 172.21.15.73:0/1961055234 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c9c0c0920 con 0x7f3c9c06cc90 2023-12-12T09:45:13.657 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:13.655+0000 7f3ca212c640 1 --2- 172.21.15.73:0/1961055234 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3c9c0c23b0 0x7f3c9c0c0320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:45:13.657 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:13.655+0000 7f3ca292d640 1 --2- 172.21.15.73:0/1961055234 >> v2:172.21.15.142:3300/0 conn(0x7f3c9c159410 0x7f3c9c0c50d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:45:13.658 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:13.656+0000 7f3ca192b640 1 --2- 172.21.15.73:0/1961055234 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3c9c06cc90 0x7f3c9c0c2790 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f3c9c074250 tx=0x7f3c8c02b800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=559f768a59c281f6 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:45:13.658 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:13.656+0000 7f3ca112a640 1 -- 172.21.15.73:0/1961055234 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c8c031760 con 0x7f3c9c06cc90 2023-12-12T09:45:13.658 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:13.656+0000 7f3ca112a640 1 -- 172.21.15.73:0/1961055234 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c8c0318c0 con 0x7f3c9c06cc90 2023-12-12T09:45:13.659 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:13.656+0000 7f3ca112a640 1 -- 172.21.15.73:0/1961055234 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c8c031c50 con 0x7f3c9c06cc90 2023-12-12T09:45:13.659 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:13.657+0000 7f3ca4390640 1 -- 172.21.15.73:0/1961055234 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3c9c06cc90 msgr2=0x7f3c9c0c2790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:13.659 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:13.657+0000 7f3ca4390640 1 --2- 172.21.15.73:0/1961055234 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3c9c06cc90 0x7f3c9c0c2790 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f3c9c074250 tx=0x7f3c8c02b800 comp rx=0 tx=0).stop 2023-12-12T09:45:13.659 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:13.657+0000 7f3ca4390640 1 -- 172.21.15.73:0/1961055234 shutdown_connections 2023-12-12T09:45:13.659 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:13.657+0000 7f3ca4390640 1 --2- 172.21.15.73:0/1961055234 >> v2:172.21.15.142:3300/0 conn(0x7f3c9c159410 0x7f3c9c0c50d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:13.659 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:13.657+0000 7f3ca4390640 1 --2- 172.21.15.73:0/1961055234 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3c9c06cc90 0x7f3c9c0c2790 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:13.659 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:13.657+0000 7f3ca4390640 1 --2- 172.21.15.73:0/1961055234 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3c9c0c23b0 0x7f3c9c0c0320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:13.659 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:13.657+0000 7f3ca4390640 1 -- 172.21.15.73:0/1961055234 >> 172.21.15.73:0/1961055234 conn(0x7f3c9c06a4e0 msgr2=0x7f3c9c06a8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:45:13.659 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:13.657+0000 7f3ca4390640 1 -- 172.21.15.73:0/1961055234 shutdown_connections 2023-12-12T09:45:13.659 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:13.657+0000 7f3ca4390640 1 -- 172.21.15.73:0/1961055234 wait complete. 2023-12-12T09:45:13.660 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:13.659+0000 7f3ca4390640 1 Processor -- start 2023-12-12T09:45:13.660 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:13.659+0000 7f3ca4390640 1 -- start start 2023-12-12T09:45:13.662 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:13.660+0000 7f3ca4390640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3c9c06cc90 0x7f3c9c15c550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:13.663 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:13.660+0000 7f3ca4390640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3c9c0c23b0 0x7f3c9c152810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:13.663 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:13.660+0000 7f3ca4390640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3c9c159410 0x7f3c9c1502a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:13.663 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:13.660+0000 7f3ca4390640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c9c15ca90 con 0x7f3c9c159410 2023-12-12T09:45:13.663 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:13.660+0000 7f3ca4390640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c9c1f2340 con 0x7f3c9c06cc90 2023-12-12T09:45:13.663 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:13.660+0000 7f3ca4390640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c9c1f2870 con 0x7f3c9c0c23b0 2023-12-12T09:45:13.663 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:13.660+0000 7f3ca292d640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3c9c159410 0x7f3c9c1502a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:13.663 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:13.660+0000 7f3ca292d640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3c9c159410 0x7f3c9c1502a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:38138/0 (socket says 172.21.15.73:38138) 2023-12-12T09:45:13.663 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:13.660+0000 7f3ca292d640 1 -- 172.21.15.73:0/752374695 learned_addr learned my addr 172.21.15.73:0/752374695 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:45:13.663 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:13.660+0000 7f3ca212c640 1 --2- 172.21.15.73:0/752374695 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3c9c06cc90 0x7f3c9c15c550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:13.663 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:13.661+0000 7f3ca192b640 1 --2- 172.21.15.73:0/752374695 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3c9c0c23b0 0x7f3c9c152810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:13.663 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:13.661+0000 7f3ca292d640 1 -- 172.21.15.73:0/752374695 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3c9c0c23b0 msgr2=0x7f3c9c152810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:13.663 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:13.661+0000 7f3ca292d640 1 --2- 172.21.15.73:0/752374695 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3c9c0c23b0 0x7f3c9c152810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:13.663 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:13.661+0000 7f3ca292d640 1 -- 172.21.15.73:0/752374695 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3c9c06cc90 msgr2=0x7f3c9c15c550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:13.663 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:13.661+0000 7f3ca292d640 1 --2- 172.21.15.73:0/752374695 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3c9c06cc90 0x7f3c9c15c550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:13.663 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:13.661+0000 7f3ca292d640 1 -- 172.21.15.73:0/752374695 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c8c0094d0 con 0x7f3c9c159410 2023-12-12T09:45:13.664 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:13.661+0000 7f3ca292d640 1 --2- 172.21.15.73:0/752374695 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3c9c159410 0x7f3c9c1502a0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f3c9400cf20 tx=0x7f3c9400a7d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:45:13.664 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:13.661+0000 7f3c92ffd640 1 -- 172.21.15.73:0/752374695 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c9400d840 con 0x7f3c9c159410 2023-12-12T09:45:13.664 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:13.661+0000 7f3c92ffd640 1 -- 172.21.15.73:0/752374695 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c9400d9a0 con 0x7f3c9c159410 2023-12-12T09:45:13.664 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:13.661+0000 7f3c92ffd640 1 -- 172.21.15.73:0/752374695 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c9400dd50 con 0x7f3c9c159410 2023-12-12T09:45:13.664 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:13.661+0000 7f3ca4390640 1 -- 172.21.15.73:0/752374695 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c9c14f6c0 con 0x7f3c9c159410 2023-12-12T09:45:13.664 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:13.661+0000 7f3ca4390640 1 -- 172.21.15.73:0/752374695 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c9c071010 con 0x7f3c9c159410 2023-12-12T09:45:13.664 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:13.663+0000 7f3ca4390640 1 -- 172.21.15.73:0/752374695 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c9c067070 con 0x7f3c9c159410 2023-12-12T09:45:13.664 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:13.663+0000 7f3c92ffd640 1 -- 172.21.15.73:0/752374695 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f3c9401e3b0 con 0x7f3c9c159410 2023-12-12T09:45:13.665 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:13.664+0000 7f3c92ffd640 1 --2- 172.21.15.73:0/752374695 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f3c8006ae40 0x7f3c8006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:13.665 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:13.664+0000 7f3c92ffd640 1 -- 172.21.15.73:0/752374695 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f3c94089e50 con 0x7f3c9c159410 2023-12-12T09:45:13.666 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:13.665+0000 7f3ca212c640 1 --2- 172.21.15.73:0/752374695 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f3c8006ae40 0x7f3c8006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:13.666 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:13.665+0000 7f3ca212c640 1 --2- 172.21.15.73:0/752374695 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f3c8006ae40 0x7f3c8006d300 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f3c9800a980 tx=0x7f3c98008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:45:13.670 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:13.669+0000 7f3c92ffd640 1 -- 172.21.15.73:0/752374695 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f3c94055190 con 0x7f3c9c159410 2023-12-12T09:45:13.860 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:13.859+0000 7f3ca4390640 1 -- 172.21.15.73:0/752374695 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f3c9c067580 con 0x7f3c9c159410 2023-12-12T09:45:13.866 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:13.865+0000 7f3c92ffd640 1 -- 172.21.15.73:0/752374695 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v11) v1 ==== 104+0+0 (secure 0 0 0) 0x7f3c940587b0 con 0x7f3c9c159410 2023-12-12T09:45:13.869 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:13.867+0000 7f3ca4390640 1 -- 172.21.15.73:0/752374695 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f3c8006ae40 msgr2=0x7f3c8006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:13.869 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:13.867+0000 7f3ca4390640 1 --2- 172.21.15.73:0/752374695 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f3c8006ae40 0x7f3c8006d300 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f3c9800a980 tx=0x7f3c98008040 comp rx=0 tx=0).stop 2023-12-12T09:45:13.869 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:13.867+0000 7f3ca4390640 1 -- 172.21.15.73:0/752374695 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3c9c159410 msgr2=0x7f3c9c1502a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:13.869 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:13.867+0000 7f3ca4390640 1 --2- 172.21.15.73:0/752374695 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3c9c159410 0x7f3c9c1502a0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f3c9400cf20 tx=0x7f3c9400a7d0 comp rx=0 tx=0).stop 2023-12-12T09:45:13.869 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:13.868+0000 7f3ca4390640 1 -- 172.21.15.73:0/752374695 shutdown_connections 2023-12-12T09:45:13.869 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:13.868+0000 7f3ca4390640 1 --2- 172.21.15.73:0/752374695 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f3c8006ae40 0x7f3c8006d300 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:13.869 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:13.868+0000 7f3ca4390640 1 --2- 172.21.15.73:0/752374695 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3c9c159410 0x7f3c9c1502a0 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:13.869 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:13.868+0000 7f3ca4390640 1 --2- 172.21.15.73:0/752374695 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3c9c0c23b0 0x7f3c9c152810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:13.870 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:13.868+0000 7f3ca4390640 1 --2- 172.21.15.73:0/752374695 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3c9c06cc90 0x7f3c9c15c550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:13.870 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:13.868+0000 7f3ca4390640 1 -- 172.21.15.73:0/752374695 >> 172.21.15.73:0/752374695 conn(0x7f3c9c06a4e0 msgr2=0x7f3c9c0c5ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:45:13.870 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:13.868+0000 7f3ca4390640 1 -- 172.21.15.73:0/752374695 shutdown_connections 2023-12-12T09:45:13.870 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:13.868+0000 7f3ca4390640 1 -- 172.21.15.73:0/752374695 wait complete. 2023-12-12T09:45:13.887 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_multifs_auth.TestClientsWithoutAuth.test_mount_all_caps_absent' 2023-12-12T09:45:14.107 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:14.106+0000 7f763db63640 1 Processor -- start 2023-12-12T09:45:14.108 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:14.106+0000 7f763db63640 1 -- start start 2023-12-12T09:45:14.108 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:14.107+0000 7f763db63640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f76381550a0 0x7f76380c4710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:14.108 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:14.107+0000 7f763db63640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76380a5390 con 0x7f7638158640 2023-12-12T09:45:14.109 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:14.107+0000 7f763db63640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7638158a90 con 0x7f763806d280 2023-12-12T09:45:14.109 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:14.107+0000 7f763db63640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76380c0450 con 0x7f76381550a0 2023-12-12T09:45:14.111 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:14.108+0000 7f763d362640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f7638158640 0x7f76380c0b50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:58472/0 (socket says 172.21.15.73:58472) 2023-12-12T09:45:14.111 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:14.108+0000 7f763d362640 1 -- 172.21.15.73:0/592275767 learned_addr learned my addr 172.21.15.73:0/592275767 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-12T09:45:14.111 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:14.108+0000 7f763cb61640 1 --2- 172.21.15.73:0/592275767 >> v2:172.21.15.142:3300/0 conn(0x7f76381550a0 0x7f76380c4710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:14.111 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:14.108+0000 7f76377fe640 1 -- 172.21.15.73:0/592275767 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 914011167 0 0) 0x7f76380a5390 con 0x7f7638158640 2023-12-12T09:45:14.111 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:14.108+0000 7f76377fe640 1 -- 172.21.15.73:0/592275767 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7620003520 con 0x7f7638158640 2023-12-12T09:45:14.111 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:14.109+0000 7f76377fe640 1 -- 172.21.15.73:0/592275767 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1631585009 0 0) 0x7f7620003520 con 0x7f7638158640 2023-12-12T09:45:14.111 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:14.109+0000 7f76377fe640 1 -- 172.21.15.73:0/592275767 >> v2:172.21.15.142:3300/0 conn(0x7f76381550a0 msgr2=0x7f76380c4710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:45:14.111 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:14.109+0000 7f76377fe640 1 --2- 172.21.15.73:0/592275767 >> v2:172.21.15.142:3300/0 conn(0x7f76381550a0 0x7f76380c4710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:14.111 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:14.109+0000 7f76377fe640 1 -- 172.21.15.73:0/592275767 >> v1:172.21.15.142:6789/0 conn(0x7f763806d280 legacy=0x7f763806bee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:14.111 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:14.109+0000 7f76377fe640 1 -- 172.21.15.73:0/592275767 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76380c06f0 con 0x7f7638158640 2023-12-12T09:45:14.111 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:14.109+0000 7f76377fe640 1 -- 172.21.15.73:0/592275767 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3186547832 0 0) 0x7f76300019f0 con 0x7f7638158640 2023-12-12T09:45:14.111 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:14.109+0000 7f76377fe640 1 -- 172.21.15.73:0/592275767 >> v1:172.21.15.73:6789/0 conn(0x7f7638158640 legacy=0x7f76380c0b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:14.111 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:14.109+0000 7f76377fe640 1 --2- 172.21.15.73:0/592275767 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7620003970 0x7f7620003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:14.112 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:14.109+0000 7f76377fe640 1 --2- 172.21.15.73:0/592275767 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f76200047c0 0x7f7620004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:14.112 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:14.109+0000 7f76377fe640 1 --2- 172.21.15.73:0/592275767 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7620005180 0x7f762000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:14.112 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:14.109+0000 7f76377fe640 1 -- 172.21.15.73:0/592275767 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76380c0450 con 0x7f7620005180 2023-12-12T09:45:14.112 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:14.109+0000 7f76377fe640 1 -- 172.21.15.73:0/592275767 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f762000c020 con 0x7f7620003970 2023-12-12T09:45:14.112 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:14.109+0000 7f76377fe640 1 -- 172.21.15.73:0/592275767 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f762000c1e0 con 0x7f76200047c0 2023-12-12T09:45:14.112 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:14.109+0000 7f763d362640 1 --2- 172.21.15.73:0/592275767 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7620005180 0x7f762000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:14.112 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:14.109+0000 7f763cb61640 1 --2- 172.21.15.73:0/592275767 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7620003970 0x7f7620003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:14.112 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:14.109+0000 7f7637fff640 1 --2- 172.21.15.73:0/592275767 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f76200047c0 0x7f7620004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:14.112 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:14.110+0000 7f763d362640 1 -- 172.21.15.73:0/592275767 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f76200047c0 msgr2=0x7f7620004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:45:14.112 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:14.110+0000 7f763d362640 1 --2- 172.21.15.73:0/592275767 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f76200047c0 0x7f7620004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:14.112 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:14.110+0000 7f763d362640 1 -- 172.21.15.73:0/592275767 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7620003970 msgr2=0x7f7620003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:45:14.112 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:14.110+0000 7f763d362640 1 --2- 172.21.15.73:0/592275767 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7620003970 0x7f7620003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:14.112 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:14.110+0000 7f763d362640 1 -- 172.21.15.73:0/592275767 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7620003520 con 0x7f7620005180 2023-12-12T09:45:14.112 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:14.110+0000 7f7637fff640 1 --2- 172.21.15.73:0/592275767 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f76200047c0 0x7f7620004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:45:14.114 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:14.110+0000 7f763d362640 1 -- 172.21.15.73:0/592275767 reap_dead start 2023-12-12T09:45:14.114 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:14.111+0000 7f763d362640 1 --2- 172.21.15.73:0/592275767 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7620005180 0x7f762000b980 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f763000a830 tx=0x7f76200057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c86e63a86cf3dcb server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:45:14.114 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:14.111+0000 7f76377fe640 1 -- 172.21.15.73:0/592275767 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76300072d0 con 0x7f7620005180 2023-12-12T09:45:14.114 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:14.111+0000 7f76377fe640 1 -- 172.21.15.73:0/592275767 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f763002f070 con 0x7f7620005180 2023-12-12T09:45:14.114 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:14.111+0000 7f76377fe640 1 -- 172.21.15.73:0/592275767 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76300076b0 con 0x7f7620005180 2023-12-12T09:45:14.114 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:14.111+0000 7f763db63640 1 -- 172.21.15.73:0/592275767 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7620005180 msgr2=0x7f762000b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:14.114 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:14.111+0000 7f763db63640 1 --2- 172.21.15.73:0/592275767 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7620005180 0x7f762000b980 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f763000a830 tx=0x7f76200057f0 comp rx=0 tx=0).stop 2023-12-12T09:45:14.114 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:14.112+0000 7f763db63640 1 -- 172.21.15.73:0/592275767 shutdown_connections 2023-12-12T09:45:14.114 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:14.112+0000 7f763db63640 1 --2- 172.21.15.73:0/592275767 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7620005180 0x7f762000b980 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:14.114 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:14.112+0000 7f763db63640 1 -- 172.21.15.73:0/592275767 >> 172.21.15.73:0/592275767 conn(0x7f76380a7840 msgr2=0x7f76380a7c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:45:14.114 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:14.112+0000 7f763db63640 1 -- 172.21.15.73:0/592275767 shutdown_connections 2023-12-12T09:45:14.114 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:14.112+0000 7f763db63640 1 -- 172.21.15.73:0/592275767 wait complete. 2023-12-12T09:45:14.116 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:14.113+0000 7f763db63640 1 Processor -- start 2023-12-12T09:45:14.116 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:14.114+0000 7f763db63640 1 -- start start 2023-12-12T09:45:14.116 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:14.114+0000 7f763db63640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7620005180 0x7f76380aa6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:14.116 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:14.114+0000 7f763db63640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f76380704b0 0x7f76381ed040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:14.116 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:14.114+0000 7f763db63640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f76380a8c70 0x7f76380a90f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:14.116 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:14.114+0000 7f763db63640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76380a9dd0 con 0x7f76380a8c70 2023-12-12T09:45:14.116 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:14.115+0000 7f763db63640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7638070230 con 0x7f76380704b0 2023-12-12T09:45:14.116 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:14.115+0000 7f763db63640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76380a9630 con 0x7f7620005180 2023-12-12T09:45:14.116 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:14.115+0000 7f763d362640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f76380a8c70 0x7f76380a90f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:14.116 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:14.115+0000 7f763d362640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f76380a8c70 0x7f76380a90f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:38166/0 (socket says 172.21.15.73:38166) 2023-12-12T09:45:14.117 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:14.115+0000 7f763d362640 1 -- 172.21.15.73:0/4143518679 learned_addr learned my addr 172.21.15.73:0/4143518679 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:45:14.119 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:14.115+0000 7f763cb61640 1 --2- 172.21.15.73:0/4143518679 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7620005180 0x7f76380aa6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:14.119 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:14.115+0000 7f7637fff640 1 --2- 172.21.15.73:0/4143518679 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f76380704b0 0x7f76381ed040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:14.119 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:14.115+0000 7f763d362640 1 -- 172.21.15.73:0/4143518679 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7620005180 msgr2=0x7f76380aa6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:14.119 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:14.115+0000 7f763d362640 1 --2- 172.21.15.73:0/4143518679 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7620005180 0x7f76380aa6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:14.119 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:14.115+0000 7f763d362640 1 -- 172.21.15.73:0/4143518679 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f76380704b0 msgr2=0x7f76381ed040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:14.119 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:14.115+0000 7f763d362640 1 --2- 172.21.15.73:0/4143518679 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f76380704b0 0x7f76381ed040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:14.119 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:14.115+0000 7f763d362640 1 -- 172.21.15.73:0/4143518679 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76380a9850 con 0x7f76380a8c70 2023-12-12T09:45:14.119 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:14.115+0000 7f7637fff640 1 --2- 172.21.15.73:0/4143518679 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f76380704b0 0x7f76381ed040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:45:14.119 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:14.116+0000 7f763d362640 1 --2- 172.21.15.73:0/4143518679 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f76380a8c70 0x7f76380a90f0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f763000a920 tx=0x7f7630001d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:45:14.119 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:14.116+0000 7f76357fa640 1 -- 172.21.15.73:0/4143518679 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76300019b0 con 0x7f76380a8c70 2023-12-12T09:45:14.120 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:14.116+0000 7f76357fa640 1 -- 172.21.15.73:0/4143518679 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7630001250 con 0x7f76380a8c70 2023-12-12T09:45:14.120 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:14.116+0000 7f76357fa640 1 -- 172.21.15.73:0/4143518679 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7630004d80 con 0x7f76380a8c70 2023-12-12T09:45:14.120 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:14.116+0000 7f763db63640 1 -- 172.21.15.73:0/4143518679 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76380715b0 con 0x7f76380a8c70 2023-12-12T09:45:14.120 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:14.116+0000 7f763db63640 1 -- 172.21.15.73:0/4143518679 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f763806fe50 con 0x7f76380a8c70 2023-12-12T09:45:14.120 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:14.117+0000 7f763db63640 1 -- 172.21.15.73:0/4143518679 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f763806fcb0 con 0x7f76380a8c70 2023-12-12T09:45:14.121 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:14.118+0000 7f76357fa640 1 -- 172.21.15.73:0/4143518679 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f7630031030 con 0x7f76380a8c70 2023-12-12T09:45:14.121 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:14.119+0000 7f76357fa640 1 --2- 172.21.15.73:0/4143518679 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f762406ae40 0x7f762406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:14.121 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:14.119+0000 7f76357fa640 1 -- 172.21.15.73:0/4143518679 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f76300aa520 con 0x7f76380a8c70 2023-12-12T09:45:14.121 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:14.119+0000 7f763cb61640 1 --2- 172.21.15.73:0/4143518679 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f762406ae40 0x7f762406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:14.121 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:14.120+0000 7f763cb61640 1 --2- 172.21.15.73:0/4143518679 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f762406ae40 0x7f762406d300 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f762c0098d0 tx=0x7f762c008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:45:14.124 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:14.123+0000 7f76357fa640 1 -- 172.21.15.73:0/4143518679 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f763806fcb0 con 0x7f76380a8c70 2023-12-12T09:45:14.387 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:14.386+0000 7f763db63640 1 -- 172.21.15.73:0/4143518679 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_multifs_auth.TestClientsWithoutAuth.test_mount_all_caps_absent"]} v 0) v1 -- 0x7f763806fcb0 con 0x7f76380a8c70 2023-12-12T09:45:14.418 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:14.417+0000 7f76357fa640 1 -- 172.21.15.73:0/4143518679 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_multifs_auth.TestClientsWithoutAuth.test_mount_all_caps_absent"]}]=0 v123) v1 ==== 159+0+0 (secure 0 0 0) 0x7f763806fcb0 con 0x7f76380a8c70 2023-12-12T09:45:14.421 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:14.420+0000 7f763db63640 1 -- 172.21.15.73:0/4143518679 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f762406ae40 msgr2=0x7f762406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:14.421 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:14.420+0000 7f763db63640 1 --2- 172.21.15.73:0/4143518679 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f762406ae40 0x7f762406d300 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f762c0098d0 tx=0x7f762c008040 comp rx=0 tx=0).stop 2023-12-12T09:45:14.422 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:14.420+0000 7f763db63640 1 -- 172.21.15.73:0/4143518679 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f76380a8c70 msgr2=0x7f76380a90f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:14.422 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:14.420+0000 7f763db63640 1 --2- 172.21.15.73:0/4143518679 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f76380a8c70 0x7f76380a90f0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f763000a920 tx=0x7f7630001d80 comp rx=0 tx=0).stop 2023-12-12T09:45:14.422 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:14.420+0000 7f763db63640 1 -- 172.21.15.73:0/4143518679 shutdown_connections 2023-12-12T09:45:14.422 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:14.420+0000 7f763db63640 1 --2- 172.21.15.73:0/4143518679 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f762406ae40 0x7f762406d300 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:14.422 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:14.420+0000 7f763db63640 1 --2- 172.21.15.73:0/4143518679 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f76380a8c70 0x7f76380a90f0 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:14.422 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:14.420+0000 7f763db63640 1 --2- 172.21.15.73:0/4143518679 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f76380704b0 0x7f76381ed040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:14.422 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:14.420+0000 7f763db63640 1 --2- 172.21.15.73:0/4143518679 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7620005180 0x7f76380aa6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:14.422 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:14.420+0000 7f763db63640 1 -- 172.21.15.73:0/4143518679 >> 172.21.15.73:0/4143518679 conn(0x7f76380a7840 msgr2=0x7f76380c5cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:45:14.422 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:14.420+0000 7f763db63640 1 -- 172.21.15.73:0/4143518679 shutdown_connections 2023-12-12T09:45:14.422 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:14.420+0000 7f763db63640 1 -- 172.21.15.73:0/4143518679 wait complete. 2023-12-12T09:45:14.442 INFO:tasks.cephfs_test_runner:test_mount_all_caps_absent (tasks.cephfs.test_multifs_auth.TestClientsWithoutAuth) ... ok 2023-12-12T09:45:14.442 INFO:tasks.cephfs_test_runner:Starting test: test_mount_mon_and_osd_caps_present_mds_caps_absent (tasks.cephfs.test_multifs_auth.TestClientsWithoutAuth) 2023-12-12T09:45:14.442 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-12T09:45:14.652 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:14.651+0000 7fd3d8b73640 1 Processor -- start 2023-12-12T09:45:14.653 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:14.651+0000 7fd3d8b73640 1 -- start start 2023-12-12T09:45:14.654 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:14.652+0000 7fd3d8b73640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd3d4151e40 0x7fd3d40c6200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:14.654 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:14.652+0000 7fd3d8b73640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fd3d40c7cb0 0x7fd3d406ab50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:14.655 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:14.652+0000 7fd3d8b73640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3d40c49c0 con 0x7fd3d40c80f0 2023-12-12T09:45:14.655 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:14.652+0000 7fd3d8b73640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3d406bad0 con 0x7fd3d40c7cb0 2023-12-12T09:45:14.655 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:14.652+0000 7fd3d8b73640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3d40c5d70 con 0x7fd3d4151e40 2023-12-12T09:45:14.655 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:14.653+0000 7fd3c9d9b640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fd3d40c7cb0 0x7fd3d406ab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:14.655 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:14.653+0000 7fd3c9d9b640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fd3d40c7cb0 0x7fd3d406ab50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:38168/0 (socket says 172.21.15.73:38168) 2023-12-12T09:45:14.655 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:14.653+0000 7fd3c9d9b640 1 -- 172.21.15.73:0/2171360220 learned_addr learned my addr 172.21.15.73:0/2171360220 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:45:14.655 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:14.653+0000 7fd3c9d9b640 1 -- 172.21.15.73:0/2171360220 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd3d4151e40 msgr2=0x7fd3d40c6200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:45:14.655 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:14.653+0000 7fd3d259c640 1 --2- 172.21.15.73:0/2171360220 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd3d4151e40 0x7fd3d40c6200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:14.655 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:14.653+0000 7fd3c9d9b640 1 --2- 172.21.15.73:0/2171360220 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd3d4151e40 0x7fd3d40c6200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:14.655 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:14.653+0000 7fd3c9d9b640 1 -- 172.21.15.73:0/2171360220 >> v1:172.21.15.142:6789/0 conn(0x7fd3d40c80f0 legacy=0x7fd3d406b090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:45:14.655 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:14.653+0000 7fd3c9d9b640 1 -- 172.21.15.73:0/2171360220 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3d4154640 con 0x7fd3d40c7cb0 2023-12-12T09:45:14.655 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:14.653+0000 7fd3d259c640 1 --2- 172.21.15.73:0/2171360220 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd3d4151e40 0x7fd3d40c6200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:45:14.656 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:14.654+0000 7fd3c9d9b640 1 --2- 172.21.15.73:0/2171360220 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd3d40c7cb0 0x7fd3d406ab50 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7fd3bc009870 tx=0x7fd3bc02b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63a876c7037bd8fe server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:45:14.656 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:14.655+0000 7fd3d1d9b640 1 -- 172.21.15.73:0/2171360220 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3bc031640 con 0x7fd3d40c7cb0 2023-12-12T09:45:14.656 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:14.655+0000 7fd3d1d9b640 1 -- 172.21.15.73:0/2171360220 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3bc0317a0 con 0x7fd3d40c7cb0 2023-12-12T09:45:14.656 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:14.655+0000 7fd3d1d9b640 1 -- 172.21.15.73:0/2171360220 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3bc031b30 con 0x7fd3d40c7cb0 2023-12-12T09:45:14.657 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:14.655+0000 7fd3d8b73640 1 -- 172.21.15.73:0/2171360220 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd3d40c7cb0 msgr2=0x7fd3d406ab50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:14.657 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:14.655+0000 7fd3d8b73640 1 --2- 172.21.15.73:0/2171360220 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd3d40c7cb0 0x7fd3d406ab50 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7fd3bc009870 tx=0x7fd3bc02b8f0 comp rx=0 tx=0).stop 2023-12-12T09:45:14.657 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:14.656+0000 7fd3d8b73640 1 -- 172.21.15.73:0/2171360220 shutdown_connections 2023-12-12T09:45:14.657 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:14.656+0000 7fd3d8b73640 1 --2- 172.21.15.73:0/2171360220 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd3d40c7cb0 0x7fd3d406ab50 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:14.657 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:14.656+0000 7fd3d8b73640 1 --2- 172.21.15.73:0/2171360220 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd3d4151e40 0x7fd3d40c6200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:14.657 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:14.656+0000 7fd3d8b73640 1 -- 172.21.15.73:0/2171360220 >> 172.21.15.73:0/2171360220 conn(0x7fd3d40ab8a0 msgr2=0x7fd3d40abcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:45:14.658 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:14.656+0000 7fd3d8b73640 1 -- 172.21.15.73:0/2171360220 shutdown_connections 2023-12-12T09:45:14.658 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:14.656+0000 7fd3d8b73640 1 -- 172.21.15.73:0/2171360220 wait complete. 2023-12-12T09:45:14.658 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:14.657+0000 7fd3d8b73640 1 Processor -- start 2023-12-12T09:45:14.658 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:14.658+0000 7fd3d8b73640 1 -- start start 2023-12-12T09:45:14.661 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:14.658+0000 7fd3d8b73640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd3d40c7cb0 0x7fd3d40c2ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:14.661 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:14.658+0000 7fd3d8b73640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd3d40c80f0 0x7fd3d41ed780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:14.661 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:14.658+0000 7fd3d8b73640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd3d4151e40 0x7fd3d41edcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:14.661 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:14.659+0000 7fd3d8b73640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3d40c2a10 con 0x7fd3d40c80f0 2023-12-12T09:45:14.661 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:14.659+0000 7fd3d8b73640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3d41ee3b0 con 0x7fd3d4151e40 2023-12-12T09:45:14.661 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:14.659+0000 7fd3d8b73640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3d4156050 con 0x7fd3d40c7cb0 2023-12-12T09:45:14.661 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:14.659+0000 7fd3c9d9b640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd3d40c80f0 0x7fd3d41ed780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:14.661 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:14.659+0000 7fd3c9d9b640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd3d40c80f0 0x7fd3d41ed780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:38182/0 (socket says 172.21.15.73:38182) 2023-12-12T09:45:14.661 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:14.659+0000 7fd3c9d9b640 1 -- 172.21.15.73:0/2957812268 learned_addr learned my addr 172.21.15.73:0/2957812268 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:45:14.661 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:14.659+0000 7fd3c9d9b640 1 -- 172.21.15.73:0/2957812268 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd3d40c7cb0 msgr2=0x7fd3d40c2ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:14.661 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:14.659+0000 7fd3d259c640 1 --2- 172.21.15.73:0/2957812268 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd3d40c7cb0 0x7fd3d40c2ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:14.661 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:14.659+0000 7fd3c9d9b640 1 --2- 172.21.15.73:0/2957812268 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd3d40c7cb0 0x7fd3d40c2ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:14.661 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:14.659+0000 7fd3d2d9d640 1 --2- 172.21.15.73:0/2957812268 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd3d4151e40 0x7fd3d41edcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:14.662 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:14.659+0000 7fd3c9d9b640 1 -- 172.21.15.73:0/2957812268 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd3d4151e40 msgr2=0x7fd3d41edcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:14.662 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:14.659+0000 7fd3c9d9b640 1 --2- 172.21.15.73:0/2957812268 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd3d4151e40 0x7fd3d41edcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:14.662 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:14.659+0000 7fd3c9d9b640 1 -- 172.21.15.73:0/2957812268 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3bc0094d0 con 0x7fd3d40c80f0 2023-12-12T09:45:14.662 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:14.659+0000 7fd3d259c640 1 --2- 172.21.15.73:0/2957812268 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd3d40c7cb0 0x7fd3d40c2ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:45:14.662 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:14.660+0000 7fd3c9d9b640 1 --2- 172.21.15.73:0/2957812268 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd3d40c80f0 0x7fd3d41ed780 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7fd3bc000c00 tx=0x7fd3bc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:45:14.663 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:14.660+0000 7fd3cb7fe640 1 -- 172.21.15.73:0/2957812268 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3bc03ac60 con 0x7fd3d40c80f0 2023-12-12T09:45:14.663 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:14.660+0000 7fd3cb7fe640 1 -- 172.21.15.73:0/2957812268 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3bc03adc0 con 0x7fd3d40c80f0 2023-12-12T09:45:14.663 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:14.660+0000 7fd3cb7fe640 1 -- 172.21.15.73:0/2957812268 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3bc044630 con 0x7fd3d40c80f0 2023-12-12T09:45:14.663 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:14.660+0000 7fd3d8b73640 1 -- 172.21.15.73:0/2957812268 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3d4155a90 con 0x7fd3d40c80f0 2023-12-12T09:45:14.663 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:14.660+0000 7fd3d8b73640 1 -- 172.21.15.73:0/2957812268 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3d40c3a90 con 0x7fd3d40c80f0 2023-12-12T09:45:14.663 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:14.661+0000 7fd3d8b73640 1 -- 172.21.15.73:0/2957812268 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3d40c2bc0 con 0x7fd3d40c80f0 2023-12-12T09:45:14.663 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:14.662+0000 7fd3cb7fe640 1 -- 172.21.15.73:0/2957812268 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fd3bc02f050 con 0x7fd3d40c80f0 2023-12-12T09:45:14.665 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:14.663+0000 7fd3cb7fe640 1 --2- 172.21.15.73:0/2957812268 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fd3b406ae70 0x7fd3b406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:14.665 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:14.664+0000 7fd3cb7fe640 1 -- 172.21.15.73:0/2957812268 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5029+0+0 (secure 0 0 0) 0x7fd3bc0ab3e0 con 0x7fd3d40c80f0 2023-12-12T09:45:14.665 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:14.664+0000 7fd3d259c640 1 --2- 172.21.15.73:0/2957812268 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fd3b406ae70 0x7fd3b406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:14.665 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:14.664+0000 7fd3d259c640 1 --2- 172.21.15.73:0/2957812268 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fd3b406ae70 0x7fd3b406d330 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fd3d4158c00 tx=0x7fd3c40074b0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:45:14.669 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:14.668+0000 7fd3cb7fe640 1 -- 172.21.15.73:0/2957812268 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fd3d40c2bc0 con 0x7fd3d40c80f0 2023-12-12T09:45:14.862 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:14.860+0000 7fd3d8b73640 1 -- 172.21.15.73:0/2957812268 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd3d4067580 con 0x7fd3d40c80f0 2023-12-12T09:45:14.862 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:14.861+0000 7fd3cb7fe640 1 -- 172.21.15.73:0/2957812268 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v46) v1 ==== 74+0+13128 (secure 0 0 0) 0x7fd3bc0767b0 con 0x7fd3d40c80f0 2023-12-12T09:45:14.863 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-12T09:45:14.863 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":46,"fsid":"ba240992-02b8-4c7e-92f2-27eb29ac433b","created":"2023-12-12T09:43:02.454719+0000","modified":"2023-12-12T09:45:13.396510+0000","last_up_change":"2023-12-12T09:43:13.913440+0000","last_in_change":"2023-12-12T09:43:05.925348+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-12T09:43:15.525508+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"dd9074be-dbe2-4c34-9896-a4223d8d3940","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":4047810203},{"type":"v1","addr":"172.21.15.73:6801","nonce":4047810203}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":4047810203},{"type":"v1","addr":"172.21.15.73:6803","nonce":4047810203}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":4047810203},{"type":"v1","addr":"172.21.15.73:6807","nonce":4047810203}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":4047810203},{"type":"v1","addr":"172.21.15.73:6805","nonce":4047810203}]},"public_addr":"172.21.15.73:6801/4047810203","cluster_addr":"172.21.15.73:6803/4047810203","heartbeat_back_addr":"172.21.15.73:6807/4047810203","heartbeat_front_addr":"172.21.15.73:6805/4047810203","state":["exists","up"]},{"osd":1,"uuid":"c4a05052-96d4-4758-a4e1-1a37f1e07fed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":1356058331},{"type":"v1","addr":"172.21.15.73:6824","nonce":1356058331}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":1356058331},{"type":"v1","addr":"172.21.15.73:6827","nonce":1356058331}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":1356058331},{"type":"v1","addr":"172.21.15.73:6831","nonce":1356058331}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":1356058331},{"type":"v1","addr":"172.21.15.73:6829","nonce":1356058331}]},"public_addr":"172.21.15.73:6824/1356058331","cluster_addr":"172.21.15.73:6827/1356058331","heartbeat_back_addr":"172.21.15.73:6831/1356058331","heartbeat_front_addr":"172.21.15.73:6829/1356058331","state":["exists","up"]},{"osd":2,"uuid":"512bc8ac-72c2-40d4-b3d2-d867a92c5213","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":1228903316},{"type":"v1","addr":"172.21.15.73:6817","nonce":1228903316}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":1228903316},{"type":"v1","addr":"172.21.15.73:6819","nonce":1228903316}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6823","nonce":1228903316},{"type":"v1","addr":"172.21.15.73:6825","nonce":1228903316}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":1228903316},{"type":"v1","addr":"172.21.15.73:6821","nonce":1228903316}]},"public_addr":"172.21.15.73:6817/1228903316","cluster_addr":"172.21.15.73:6819/1228903316","heartbeat_back_addr":"172.21.15.73:6825/1228903316","heartbeat_front_addr":"172.21.15.73:6821/1228903316","state":["exists","up"]},{"osd":3,"uuid":"3d1a91e0-42bf-437a-8eae-8d357c8f63a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":1293329670},{"type":"v1","addr":"172.21.15.73:6809","nonce":1293329670}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6810","nonce":1293329670},{"type":"v1","addr":"172.21.15.73:6811","nonce":1293329670}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":1293329670},{"type":"v1","addr":"172.21.15.73:6815","nonce":1293329670}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":1293329670},{"type":"v1","addr":"172.21.15.73:6813","nonce":1293329670}]},"public_addr":"172.21.15.73:6809/1293329670","cluster_addr":"172.21.15.73:6811/1293329670","heartbeat_back_addr":"172.21.15.73:6815/1293329670","heartbeat_front_addr":"172.21.15.73:6813/1293329670","state":["exists","up"]},{"osd":4,"uuid":"4b302fff-834c-4069-ac19-00e46f6c87b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":3727975702},{"type":"v1","addr":"172.21.15.142:6801","nonce":3727975702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":3727975702},{"type":"v1","addr":"172.21.15.142:6803","nonce":3727975702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6809","nonce":3727975702},{"type":"v1","addr":"172.21.15.142:6811","nonce":3727975702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6805","nonce":3727975702},{"type":"v1","addr":"172.21.15.142:6807","nonce":3727975702}]},"public_addr":"172.21.15.142:6801/3727975702","cluster_addr":"172.21.15.142:6803/3727975702","heartbeat_back_addr":"172.21.15.142:6811/3727975702","heartbeat_front_addr":"172.21.15.142:6807/3727975702","state":["exists","up"]},{"osd":5,"uuid":"d7cdace2-67d0-45cc-95f2-515cf6ef1b82","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6817","nonce":2353193632},{"type":"v1","addr":"172.21.15.142:6819","nonce":2353193632}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6821","nonce":2353193632},{"type":"v1","addr":"172.21.15.142:6823","nonce":2353193632}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6829","nonce":2353193632},{"type":"v1","addr":"172.21.15.142:6831","nonce":2353193632}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6825","nonce":2353193632},{"type":"v1","addr":"172.21.15.142:6827","nonce":2353193632}]},"public_addr":"172.21.15.142:6819/2353193632","cluster_addr":"172.21.15.142:6823/2353193632","heartbeat_back_addr":"172.21.15.142:6831/2353193632","heartbeat_front_addr":"172.21.15.142:6827/2353193632","state":["exists","up"]},{"osd":6,"uuid":"649ce78a-5626-445c-aedc-a651ed05a6f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":2006111986},{"type":"v1","addr":"172.21.15.142:6806","nonce":2006111986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":2006111986},{"type":"v1","addr":"172.21.15.142:6810","nonce":2006111986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":2006111986},{"type":"v1","addr":"172.21.15.142:6815","nonce":2006111986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":2006111986},{"type":"v1","addr":"172.21.15.142:6813","nonce":2006111986}]},"public_addr":"172.21.15.142:6806/2006111986","cluster_addr":"172.21.15.142:6810/2006111986","heartbeat_back_addr":"172.21.15.142:6815/2006111986","heartbeat_front_addr":"172.21.15.142:6813/2006111986","state":["exists","up"]},{"osd":7,"uuid":"af15ae3b-c1d0-4acf-92db-8a1805494d13","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":2573794341},{"type":"v1","addr":"172.21.15.142:6818","nonce":2573794341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":2573794341},{"type":"v1","addr":"172.21.15.142:6822","nonce":2573794341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":2573794341},{"type":"v1","addr":"172.21.15.142:6830","nonce":2573794341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":2573794341},{"type":"v1","addr":"172.21.15.142:6826","nonce":2573794341}]},"public_addr":"172.21.15.142:6818/2573794341","cluster_addr":"172.21.15.142:6822/2573794341","heartbeat_back_addr":"172.21.15.142:6830/2573794341","heartbeat_front_addr":"172.21.15.142:6826/2573794341","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.185824+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.262103+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.225556+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:10.523459+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:10.706035+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.257339+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.301776+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.051960+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.73:6834/2500303907":"2023-12-13T09:45:10.378903+0000","172.21.15.73:6837/1534083424":"2023-12-13T09:45:02.776929+0000","172.21.15.73:6836/2500303907":"2023-12-13T09:45:10.378903+0000","172.21.15.73:6835/1534083424":"2023-12-13T09:45:02.776929+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-12T09:45:14.865 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:14.864+0000 7fd3d8b73640 1 -- 172.21.15.73:0/2957812268 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fd3b406ae70 msgr2=0x7fd3b406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:14.865 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:14.864+0000 7fd3d8b73640 1 --2- 172.21.15.73:0/2957812268 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fd3b406ae70 0x7fd3b406d330 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fd3d4158c00 tx=0x7fd3c40074b0 comp rx=0 tx=0).stop 2023-12-12T09:45:14.865 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:14.864+0000 7fd3d8b73640 1 -- 172.21.15.73:0/2957812268 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd3d40c80f0 msgr2=0x7fd3d41ed780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:14.866 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:14.864+0000 7fd3d8b73640 1 --2- 172.21.15.73:0/2957812268 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd3d40c80f0 0x7fd3d41ed780 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7fd3bc000c00 tx=0x7fd3bc0046c0 comp rx=0 tx=0).stop 2023-12-12T09:45:14.866 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:14.864+0000 7fd3d8b73640 1 -- 172.21.15.73:0/2957812268 shutdown_connections 2023-12-12T09:45:14.866 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:14.864+0000 7fd3d8b73640 1 --2- 172.21.15.73:0/2957812268 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fd3b406ae70 0x7fd3b406d330 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:14.866 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:14.864+0000 7fd3d8b73640 1 --2- 172.21.15.73:0/2957812268 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd3d4151e40 0x7fd3d41edcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:14.866 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:14.864+0000 7fd3d8b73640 1 --2- 172.21.15.73:0/2957812268 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd3d40c80f0 0x7fd3d41ed780 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:14.866 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:14.864+0000 7fd3d8b73640 1 --2- 172.21.15.73:0/2957812268 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd3d40c7cb0 0x7fd3d40c2ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:14.866 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:14.864+0000 7fd3d8b73640 1 -- 172.21.15.73:0/2957812268 >> 172.21.15.73:0/2957812268 conn(0x7fd3d40ab8a0 msgr2=0x7fd3d4154b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:45:14.866 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:14.864+0000 7fd3d8b73640 1 -- 172.21.15.73:0/2957812268 shutdown_connections 2023-12-12T09:45:14.866 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:14.864+0000 7fd3d8b73640 1 -- 172.21.15.73:0/2957812268 wait complete. 2023-12-12T09:45:14.886 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-12T09:43:15.525508+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-12T09:45:14.886 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-12T09:45:15.100 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:15.099+0000 7f78ee79e640 1 Processor -- start 2023-12-12T09:45:15.101 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:15.100+0000 7f78ee79e640 1 -- start start 2023-12-12T09:45:15.103 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:15.101+0000 7f78ee79e640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f78e81519d0 0x7f78e80c7d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:15.103 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:15.101+0000 7f78ee79e640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f78e806c420 0x7f78e80ca140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:15.103 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:15.101+0000 7f78ee79e640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f78e80ca680 0x7f78e81543d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:15.103 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:15.101+0000 7f78ee79e640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78e8158670 con 0x7f78e806c420 2023-12-12T09:45:15.103 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:15.101+0000 7f78ee79e640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78e80c5f30 con 0x7f78e81519d0 2023-12-12T09:45:15.104 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:15.101+0000 7f78ee79e640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78e80c82c0 con 0x7f78e80ca680 2023-12-12T09:45:15.104 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:15.102+0000 7f78ecf9b640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f78e806c420 0x7f78e80ca140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:15.104 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:15.102+0000 7f78ecf9b640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f78e806c420 0x7f78e80ca140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:38186/0 (socket says 172.21.15.73:38186) 2023-12-12T09:45:15.104 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:15.102+0000 7f78ecf9b640 1 -- 172.21.15.73:0/3168290453 learned_addr learned my addr 172.21.15.73:0/3168290453 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:45:15.104 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:15.102+0000 7f78ed79c640 1 --2- 172.21.15.73:0/3168290453 >> v2:172.21.15.142:3300/0 conn(0x7f78e81519d0 0x7f78e80c7d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:15.104 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:15.102+0000 7f78edf9d640 1 --2- 172.21.15.73:0/3168290453 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f78e80ca680 0x7f78e81543d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:15.104 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:15.102+0000 7f78ecf9b640 1 -- 172.21.15.73:0/3168290453 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f78e80ca680 msgr2=0x7f78e81543d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:45:15.104 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:15.102+0000 7f78ecf9b640 1 --2- 172.21.15.73:0/3168290453 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f78e80ca680 0x7f78e81543d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:15.104 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:15.102+0000 7f78ecf9b640 1 -- 172.21.15.73:0/3168290453 >> v2:172.21.15.142:3300/0 conn(0x7f78e81519d0 msgr2=0x7f78e80c7d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:45:15.104 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:15.102+0000 7f78ecf9b640 1 --2- 172.21.15.73:0/3168290453 >> v2:172.21.15.142:3300/0 conn(0x7f78e81519d0 0x7f78e80c7d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:15.104 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:15.102+0000 7f78ecf9b640 1 -- 172.21.15.73:0/3168290453 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78e8157a60 con 0x7f78e806c420 2023-12-12T09:45:15.105 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:15.103+0000 7f78ecf9b640 1 --2- 172.21.15.73:0/3168290453 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f78e806c420 0x7f78e80ca140 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f78e8072bf0 tx=0x7f78dc02b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9e173d4197404c9 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:45:15.105 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:15.104+0000 7f78e7fff640 1 -- 172.21.15.73:0/3168290453 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78dc0317e0 con 0x7f78e806c420 2023-12-12T09:45:15.105 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:15.104+0000 7f78e7fff640 1 -- 172.21.15.73:0/3168290453 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78dc031940 con 0x7f78e806c420 2023-12-12T09:45:15.105 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:15.104+0000 7f78e7fff640 1 -- 172.21.15.73:0/3168290453 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78dc031cd0 con 0x7f78e806c420 2023-12-12T09:45:15.106 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:15.104+0000 7f78ee79e640 1 -- 172.21.15.73:0/3168290453 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f78e806c420 msgr2=0x7f78e80ca140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:15.106 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:15.104+0000 7f78ee79e640 1 --2- 172.21.15.73:0/3168290453 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f78e806c420 0x7f78e80ca140 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f78e8072bf0 tx=0x7f78dc02b880 comp rx=0 tx=0).stop 2023-12-12T09:45:15.106 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:15.104+0000 7f78ee79e640 1 -- 172.21.15.73:0/3168290453 shutdown_connections 2023-12-12T09:45:15.106 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:15.104+0000 7f78ee79e640 1 --2- 172.21.15.73:0/3168290453 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f78e80ca680 0x7f78e81543d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:15.106 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:15.104+0000 7f78ee79e640 1 --2- 172.21.15.73:0/3168290453 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f78e806c420 0x7f78e80ca140 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:15.106 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:15.104+0000 7f78ee79e640 1 --2- 172.21.15.73:0/3168290453 >> v2:172.21.15.142:3300/0 conn(0x7f78e81519d0 0x7f78e80c7d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:15.106 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:15.104+0000 7f78ee79e640 1 -- 172.21.15.73:0/3168290453 >> 172.21.15.73:0/3168290453 conn(0x7f78e8072030 msgr2=0x7f78e8072440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:45:15.106 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:15.105+0000 7f78ee79e640 1 -- 172.21.15.73:0/3168290453 shutdown_connections 2023-12-12T09:45:15.106 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:15.105+0000 7f78ee79e640 1 -- 172.21.15.73:0/3168290453 wait complete. 2023-12-12T09:45:15.107 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:15.106+0000 7f78ee79e640 1 Processor -- start 2023-12-12T09:45:15.107 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:15.106+0000 7f78ee79e640 1 -- start start 2023-12-12T09:45:15.110 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:15.107+0000 7f78ee79e640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f78e806c420 0x7f78e80aa8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:15.110 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:15.107+0000 7f78ee79e640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f78e80ca680 0x7f78e8154620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:15.110 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:15.107+0000 7f78ee79e640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f78e81519d0 0x7f78e8154b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:15.110 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:15.107+0000 7f78ee79e640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78e80be360 con 0x7f78e81519d0 2023-12-12T09:45:15.110 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:15.107+0000 7f78ee79e640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78e80bd790 con 0x7f78e80ca680 2023-12-12T09:45:15.110 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:15.107+0000 7f78ee79e640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78e80bdd50 con 0x7f78e806c420 2023-12-12T09:45:15.110 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:15.108+0000 7f78edf9d640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f78e81519d0 0x7f78e8154b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:15.110 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:15.108+0000 7f78edf9d640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f78e81519d0 0x7f78e8154b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:38200/0 (socket says 172.21.15.73:38200) 2023-12-12T09:45:15.110 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:15.108+0000 7f78edf9d640 1 -- 172.21.15.73:0/456196277 learned_addr learned my addr 172.21.15.73:0/456196277 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:45:15.110 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:15.108+0000 7f78ed79c640 1 --2- 172.21.15.73:0/456196277 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f78e806c420 0x7f78e80aa8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:15.111 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:15.108+0000 7f78ecf9b640 1 --2- 172.21.15.73:0/456196277 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f78e80ca680 0x7f78e8154620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:15.111 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:15.108+0000 7f78edf9d640 1 -- 172.21.15.73:0/456196277 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f78e806c420 msgr2=0x7f78e80aa8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:15.111 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:15.108+0000 7f78edf9d640 1 --2- 172.21.15.73:0/456196277 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f78e806c420 0x7f78e80aa8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:15.111 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:15.108+0000 7f78edf9d640 1 -- 172.21.15.73:0/456196277 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f78e80ca680 msgr2=0x7f78e8154620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:15.111 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:15.108+0000 7f78edf9d640 1 --2- 172.21.15.73:0/456196277 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f78e80ca680 0x7f78e8154620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:15.111 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:15.108+0000 7f78edf9d640 1 -- 172.21.15.73:0/456196277 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78dc0094d0 con 0x7f78e81519d0 2023-12-12T09:45:15.111 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:15.108+0000 7f78edf9d640 1 --2- 172.21.15.73:0/456196277 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f78e81519d0 0x7f78e8154b60 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f78e000c5a0 tx=0x7f78e000ca60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:45:15.111 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:15.109+0000 7f78e5ffb640 1 -- 172.21.15.73:0/456196277 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78e0004220 con 0x7f78e81519d0 2023-12-12T09:45:15.111 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:15.109+0000 7f78e5ffb640 1 -- 172.21.15.73:0/456196277 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78e0004380 con 0x7f78e81519d0 2023-12-12T09:45:15.111 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:15.109+0000 7f78e5ffb640 1 -- 172.21.15.73:0/456196277 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78e0003850 con 0x7f78e81519d0 2023-12-12T09:45:15.111 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:15.109+0000 7f78ee79e640 1 -- 172.21.15.73:0/456196277 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78e81550a0 con 0x7f78e81519d0 2023-12-12T09:45:15.111 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:15.109+0000 7f78ee79e640 1 -- 172.21.15.73:0/456196277 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78e81ea7d0 con 0x7f78e81519d0 2023-12-12T09:45:15.112 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:15.110+0000 7f78ee79e640 1 -- 172.21.15.73:0/456196277 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f78e8067400 con 0x7f78e81519d0 2023-12-12T09:45:15.112 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:15.111+0000 7f78e5ffb640 1 -- 172.21.15.73:0/456196277 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f78e00039b0 con 0x7f78e81519d0 2023-12-12T09:45:15.113 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:15.112+0000 7f78e5ffb640 1 --2- 172.21.15.73:0/456196277 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f78d406ae40 0x7f78d406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:15.113 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:15.112+0000 7f78e5ffb640 1 -- 172.21.15.73:0/456196277 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f78e0089090 con 0x7f78e81519d0 2023-12-12T09:45:15.113 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:15.112+0000 7f78ed79c640 1 --2- 172.21.15.73:0/456196277 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f78d406ae40 0x7f78d406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:15.114 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:15.113+0000 7f78ed79c640 1 --2- 172.21.15.73:0/456196277 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f78d406ae40 0x7f78d406d300 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f78d8009a60 tx=0x7f78d8003990 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:45:15.118 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:15.117+0000 7f78e5ffb640 1 -- 172.21.15.73:0/456196277 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f78e00543d0 con 0x7f78e81519d0 2023-12-12T09:45:15.311 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:15.310+0000 7f78ee79e640 1 -- 172.21.15.73:0/456196277 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f78e80c7b60 con 0x7f78e81519d0 2023-12-12T09:45:15.312 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:15.311+0000 7f78e5ffb640 1 -- 172.21.15.73:0/456196277 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v46) v1 ==== 93+0+10 (secure 0 0 0) 0x7f78e00579f0 con 0x7f78e81519d0 2023-12-12T09:45:15.312 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 1 2023-12-12T09:45:15.314 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:15.313+0000 7f78ee79e640 1 -- 172.21.15.73:0/456196277 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f78d406ae40 msgr2=0x7f78d406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:15.314 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:15.313+0000 7f78ee79e640 1 --2- 172.21.15.73:0/456196277 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f78d406ae40 0x7f78d406d300 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f78d8009a60 tx=0x7f78d8003990 comp rx=0 tx=0).stop 2023-12-12T09:45:15.315 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:15.313+0000 7f78ee79e640 1 -- 172.21.15.73:0/456196277 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f78e81519d0 msgr2=0x7f78e8154b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:15.315 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:15.313+0000 7f78ee79e640 1 --2- 172.21.15.73:0/456196277 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f78e81519d0 0x7f78e8154b60 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f78e000c5a0 tx=0x7f78e000ca60 comp rx=0 tx=0).stop 2023-12-12T09:45:15.315 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:15.313+0000 7f78ee79e640 1 -- 172.21.15.73:0/456196277 shutdown_connections 2023-12-12T09:45:15.315 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:15.313+0000 7f78ee79e640 1 --2- 172.21.15.73:0/456196277 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f78d406ae40 0x7f78d406d300 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:15.315 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:15.313+0000 7f78ee79e640 1 --2- 172.21.15.73:0/456196277 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f78e81519d0 0x7f78e8154b60 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:15.315 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:15.313+0000 7f78ee79e640 1 --2- 172.21.15.73:0/456196277 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f78e80ca680 0x7f78e8154620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:15.315 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:15.313+0000 7f78ee79e640 1 --2- 172.21.15.73:0/456196277 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f78e806c420 0x7f78e80aa8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:15.315 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:15.313+0000 7f78ee79e640 1 -- 172.21.15.73:0/456196277 >> 172.21.15.73:0/456196277 conn(0x7f78e8072030 msgr2=0x7f78e80c6c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:45:15.315 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:15.313+0000 7f78ee79e640 1 -- 172.21.15.73:0/456196277 shutdown_connections 2023-12-12T09:45:15.315 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:15.313+0000 7f78ee79e640 1 -- 172.21.15.73:0/456196277 wait complete. 2023-12-12T09:45:15.333 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_multifs_auth.TestClientsWithoutAuth.test_mount_mon_and_osd_caps_present_mds_caps_absent' 2023-12-12T09:45:15.544 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:15.543+0000 7f308ffff640 1 Processor -- start 2023-12-12T09:45:15.544 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:15.543+0000 7f308ffff640 1 -- start start 2023-12-12T09:45:15.545 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:15.544+0000 7f308ffff640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f309014fbb0 0x7f30900c09e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:15.546 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:15.544+0000 7f308ffff640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f30900c0f20 0x7f30900aae00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:15.546 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:15.544+0000 7f308ffff640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f30900a9470 0x7f30900ab340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:15.546 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:15.544+0000 7f308ffff640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30900aa000 con 0x7f30900a9470 2023-12-12T09:45:15.546 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:15.544+0000 7f308ffff640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30900c1d40 con 0x7f309014fbb0 2023-12-12T09:45:15.546 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:15.544+0000 7f308ffff640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3090153300 con 0x7f30900c0f20 2023-12-12T09:45:15.546 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:15.544+0000 7f308f7fe640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f30900a9470 0x7f30900ab340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:15.546 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:15.544+0000 7f308f7fe640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f30900a9470 0x7f30900ab340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:38208/0 (socket says 172.21.15.73:38208) 2023-12-12T09:45:15.546 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:15.544+0000 7f308f7fe640 1 -- 172.21.15.73:0/3263404642 learned_addr learned my addr 172.21.15.73:0/3263404642 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:45:15.547 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:15.545+0000 7f308f7fe640 1 -- 172.21.15.73:0/3263404642 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f30900c0f20 msgr2=0x7f30900aae00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:45:15.547 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:15.545+0000 7f308f7fe640 1 --2- 172.21.15.73:0/3263404642 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f30900c0f20 0x7f30900aae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:15.547 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:15.545+0000 7f308f7fe640 1 -- 172.21.15.73:0/3263404642 >> v2:172.21.15.142:3300/0 conn(0x7f309014fbb0 msgr2=0x7f30900c09e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:45:15.547 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:15.545+0000 7f308effd640 1 --2- 172.21.15.73:0/3263404642 >> v2:172.21.15.142:3300/0 conn(0x7f309014fbb0 0x7f30900c09e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:15.547 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:15.545+0000 7f308f7fe640 1 --2- 172.21.15.73:0/3263404642 >> v2:172.21.15.142:3300/0 conn(0x7f309014fbb0 0x7f30900c09e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:15.547 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:15.545+0000 7f308f7fe640 1 -- 172.21.15.73:0/3263404642 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30900c2160 con 0x7f30900a9470 2023-12-12T09:45:15.547 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:15.546+0000 7f308f7fe640 1 --2- 172.21.15.73:0/3263404642 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f30900a9470 0x7f30900ab340 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f30900a9330 tx=0x7f308802b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=373e9a3901047b71 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:45:15.548 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:15.546+0000 7f308dffb640 1 -- 172.21.15.73:0/3263404642 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30880317c0 con 0x7f30900a9470 2023-12-12T09:45:15.548 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:15.546+0000 7f308dffb640 1 -- 172.21.15.73:0/3263404642 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3088031920 con 0x7f30900a9470 2023-12-12T09:45:15.548 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:15.546+0000 7f308dffb640 1 -- 172.21.15.73:0/3263404642 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3088031cb0 con 0x7f30900a9470 2023-12-12T09:45:15.549 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:15.547+0000 7f308ffff640 1 -- 172.21.15.73:0/3263404642 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f30900a9470 msgr2=0x7f30900ab340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:15.549 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:15.547+0000 7f308ffff640 1 --2- 172.21.15.73:0/3263404642 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f30900a9470 0x7f30900ab340 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f30900a9330 tx=0x7f308802b860 comp rx=0 tx=0).stop 2023-12-12T09:45:15.549 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:15.547+0000 7f308ffff640 1 -- 172.21.15.73:0/3263404642 shutdown_connections 2023-12-12T09:45:15.549 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:15.547+0000 7f308ffff640 1 --2- 172.21.15.73:0/3263404642 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f30900a9470 0x7f30900ab340 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:15.549 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:15.547+0000 7f308ffff640 1 --2- 172.21.15.73:0/3263404642 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f30900c0f20 0x7f30900aae00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:15.549 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:15.547+0000 7f308ffff640 1 --2- 172.21.15.73:0/3263404642 >> v2:172.21.15.142:3300/0 conn(0x7f309014fbb0 0x7f30900c09e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:15.549 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:15.547+0000 7f308ffff640 1 -- 172.21.15.73:0/3263404642 >> 172.21.15.73:0/3263404642 conn(0x7f30900c23b0 msgr2=0x7f30900c2790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:45:15.549 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:15.547+0000 7f308ffff640 1 -- 172.21.15.73:0/3263404642 shutdown_connections 2023-12-12T09:45:15.549 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:15.547+0000 7f308ffff640 1 -- 172.21.15.73:0/3263404642 wait complete. 2023-12-12T09:45:15.550 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:15.549+0000 7f308ffff640 1 Processor -- start 2023-12-12T09:45:15.550 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:15.549+0000 7f308ffff640 1 -- start start 2023-12-12T09:45:15.551 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:15.550+0000 7f308ffff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f30900a9470 0x7f3090155b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:15.551 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:15.550+0000 7f308ffff640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f30900c0f20 0x7f309006cac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:15.552 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:15.550+0000 7f308ffff640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f309014fbb0 0x7f30901ed590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:15.552 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:15.550+0000 7f308ffff640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30901ea410 con 0x7f30900a9470 2023-12-12T09:45:15.552 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:15.550+0000 7f308ffff640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30901ea130 con 0x7f30900c0f20 2023-12-12T09:45:15.552 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:15.550+0000 7f308ffff640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f309006fc20 con 0x7f309014fbb0 2023-12-12T09:45:15.552 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:15.550+0000 7f308effd640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f30900a9470 0x7f3090155b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:15.552 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:15.550+0000 7f308effd640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f30900a9470 0x7f3090155b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:38224/0 (socket says 172.21.15.73:38224) 2023-12-12T09:45:15.552 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:15.550+0000 7f308effd640 1 -- 172.21.15.73:0/1941138819 learned_addr learned my addr 172.21.15.73:0/1941138819 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:45:15.552 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:15.550+0000 7f308effd640 1 -- 172.21.15.73:0/1941138819 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f309014fbb0 msgr2=0x7f30901ed590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:15.552 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:15.550+0000 7f308effd640 1 --2- 172.21.15.73:0/1941138819 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f309014fbb0 0x7f30901ed590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:15.552 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:15.550+0000 7f308effd640 1 -- 172.21.15.73:0/1941138819 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f30900c0f20 msgr2=0x7f309006cac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:15.552 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:15.550+0000 7f308effd640 1 --2- 172.21.15.73:0/1941138819 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f30900c0f20 0x7f309006cac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:15.552 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:15.550+0000 7f308effd640 1 -- 172.21.15.73:0/1941138819 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30880094d0 con 0x7f30900a9470 2023-12-12T09:45:15.553 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:15.551+0000 7f308effd640 1 --2- 172.21.15.73:0/1941138819 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f30900a9470 0x7f3090155b20 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f308000ccd0 tx=0x7f308000a5c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:45:15.553 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:15.551+0000 7f3087fff640 1 -- 172.21.15.73:0/1941138819 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3080003990 con 0x7f30900a9470 2023-12-12T09:45:15.553 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:15.551+0000 7f3087fff640 1 -- 172.21.15.73:0/1941138819 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3080003af0 con 0x7f30900a9470 2023-12-12T09:45:15.553 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:15.551+0000 7f3087fff640 1 -- 172.21.15.73:0/1941138819 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3080004020 con 0x7f30900a9470 2023-12-12T09:45:15.553 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:15.551+0000 7f308ffff640 1 -- 172.21.15.73:0/1941138819 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f309006ff00 con 0x7f30900a9470 2023-12-12T09:45:15.553 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:15.551+0000 7f308ffff640 1 -- 172.21.15.73:0/1941138819 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f309006d000 con 0x7f30900a9470 2023-12-12T09:45:15.554 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:15.552+0000 7f308ffff640 1 -- 172.21.15.73:0/1941138819 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f309006fa80 con 0x7f30900a9470 2023-12-12T09:45:15.554 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:15.553+0000 7f3087fff640 1 -- 172.21.15.73:0/1941138819 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f3080004180 con 0x7f30900a9470 2023-12-12T09:45:15.555 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:15.554+0000 7f3087fff640 1 --2- 172.21.15.73:0/1941138819 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f307006ae40 0x7f307006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:15.555 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:15.554+0000 7f3087fff640 1 -- 172.21.15.73:0/1941138819 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f3080089800 con 0x7f30900a9470 2023-12-12T09:45:15.555 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:15.554+0000 7f308e7fc640 1 --2- 172.21.15.73:0/1941138819 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f307006ae40 0x7f307006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:15.556 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:15.555+0000 7f308e7fc640 1 --2- 172.21.15.73:0/1941138819 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f307006ae40 0x7f307006d300 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f3090156220 tx=0x7f3078006c90 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:45:15.559 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:15.558+0000 7f3087fff640 1 -- 172.21.15.73:0/1941138819 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f309006fa80 con 0x7f30900a9470 2023-12-12T09:45:15.822 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:15.821+0000 7f308ffff640 1 -- 172.21.15.73:0/1941138819 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_multifs_auth.TestClientsWithoutAuth.test_mount_mon_and_osd_caps_present_mds_caps_absent"]} v 0) v1 -- 0x7f3090070420 con 0x7f30900a9470 2023-12-12T09:45:16.433 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:16.431+0000 7f3087fff640 1 -- 172.21.15.73:0/1941138819 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_multifs_auth.TestClientsWithoutAuth.test_mount_mon_and_osd_caps_present_mds_caps_absent"]}]=0 v125) v1 ==== 187+0+0 (secure 0 0 0) 0x7f3090070420 con 0x7f30900a9470 2023-12-12T09:45:16.437 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:16.435+0000 7f308ffff640 1 -- 172.21.15.73:0/1941138819 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f307006ae40 msgr2=0x7f307006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:16.437 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:16.435+0000 7f308ffff640 1 --2- 172.21.15.73:0/1941138819 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f307006ae40 0x7f307006d300 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f3090156220 tx=0x7f3078006c90 comp rx=0 tx=0).stop 2023-12-12T09:45:16.437 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:16.435+0000 7f308ffff640 1 -- 172.21.15.73:0/1941138819 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f30900a9470 msgr2=0x7f3090155b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:16.437 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:16.435+0000 7f308ffff640 1 --2- 172.21.15.73:0/1941138819 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f30900a9470 0x7f3090155b20 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f308000ccd0 tx=0x7f308000a5c0 comp rx=0 tx=0).stop 2023-12-12T09:45:16.437 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:16.435+0000 7f308ffff640 1 -- 172.21.15.73:0/1941138819 shutdown_connections 2023-12-12T09:45:16.438 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:16.435+0000 7f308ffff640 1 --2- 172.21.15.73:0/1941138819 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f307006ae40 0x7f307006d300 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:16.438 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:16.435+0000 7f308ffff640 1 --2- 172.21.15.73:0/1941138819 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f309014fbb0 0x7f30901ed590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:16.438 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:16.435+0000 7f308ffff640 1 --2- 172.21.15.73:0/1941138819 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f30900c0f20 0x7f309006cac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:16.438 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:16.435+0000 7f308ffff640 1 --2- 172.21.15.73:0/1941138819 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f30900a9470 0x7f3090155b20 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:16.438 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:16.435+0000 7f308ffff640 1 -- 172.21.15.73:0/1941138819 >> 172.21.15.73:0/1941138819 conn(0x7f30900c23b0 msgr2=0x7f30900bece0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:45:16.438 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:16.435+0000 7f308ffff640 1 -- 172.21.15.73:0/1941138819 shutdown_connections 2023-12-12T09:45:16.438 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:16.435+0000 7f308ffff640 1 -- 172.21.15.73:0/1941138819 wait complete. 2023-12-12T09:45:16.457 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-12-12T09:45:16.672 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:16.670+0000 7f6f57248640 1 Processor -- start 2023-12-12T09:45:16.672 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:16.671+0000 7f6f57248640 1 -- start start 2023-12-12T09:45:16.673 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:16.672+0000 7f6f57248640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f6f500c0320 0x7f6f5006cc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:16.674 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:16.672+0000 7f6f57248640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6f500c2790 0x7f6f500c50d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:16.674 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:16.672+0000 7f6f57248640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f500c1520 con 0x7f6f500c23b0 2023-12-12T09:45:16.674 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:16.672+0000 7f6f57248640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f500c46f0 con 0x7f6f500c0320 2023-12-12T09:45:16.674 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:16.672+0000 7f6f57248640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f500c2c20 con 0x7f6f500c2790 2023-12-12T09:45:16.674 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:16.672+0000 7f6f47fff640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f6f500c0320 0x7f6f5006cc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:16.674 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:16.672+0000 7f6f47fff640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f6f500c0320 0x7f6f5006cc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:38234/0 (socket says 172.21.15.73:38234) 2023-12-12T09:45:16.674 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:16.673+0000 7f6f47fff640 1 -- 172.21.15.73:0/538260338 learned_addr learned my addr 172.21.15.73:0/538260338 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:45:16.675 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:16.673+0000 7f6f557e5640 1 --2- 172.21.15.73:0/538260338 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6f500c2790 0x7f6f500c50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:16.675 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:16.673+0000 7f6f47fff640 1 -- 172.21.15.73:0/538260338 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6f500c2790 msgr2=0x7f6f500c50d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:45:16.676 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:16.673+0000 7f6f47fff640 1 --2- 172.21.15.73:0/538260338 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6f500c2790 0x7f6f500c50d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:16.676 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:16.673+0000 7f6f47fff640 1 -- 172.21.15.73:0/538260338 >> v1:172.21.15.142:6789/0 conn(0x7f6f500c23b0 legacy=0x7f6f50159410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:45:16.676 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:16.673+0000 7f6f47fff640 1 -- 172.21.15.73:0/538260338 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f500c0920 con 0x7f6f500c0320 2023-12-12T09:45:16.676 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:16.674+0000 7f6f47fff640 1 --2- 172.21.15.73:0/538260338 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6f500c0320 0x7f6f5006cc90 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f6f40009870 tx=0x7f6f4002b7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc7ad709f78fa920 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:45:16.677 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:16.675+0000 7f6f477fe640 1 -- 172.21.15.73:0/538260338 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f40031740 con 0x7f6f500c0320 2023-12-12T09:45:16.677 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:16.675+0000 7f6f477fe640 1 -- 172.21.15.73:0/538260338 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f400318a0 con 0x7f6f500c0320 2023-12-12T09:45:16.677 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:16.675+0000 7f6f477fe640 1 -- 172.21.15.73:0/538260338 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f40031c30 con 0x7f6f500c0320 2023-12-12T09:45:16.677 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:16.675+0000 7f6f57248640 1 -- 172.21.15.73:0/538260338 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6f500c0320 msgr2=0x7f6f5006cc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:16.677 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:16.675+0000 7f6f57248640 1 --2- 172.21.15.73:0/538260338 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6f500c0320 0x7f6f5006cc90 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f6f40009870 tx=0x7f6f4002b7e0 comp rx=0 tx=0).stop 2023-12-12T09:45:16.677 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:16.675+0000 7f6f57248640 1 -- 172.21.15.73:0/538260338 shutdown_connections 2023-12-12T09:45:16.677 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:16.675+0000 7f6f57248640 1 --2- 172.21.15.73:0/538260338 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6f500c2790 0x7f6f500c50d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:16.678 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:16.675+0000 7f6f57248640 1 --2- 172.21.15.73:0/538260338 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6f500c0320 0x7f6f5006cc90 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:16.678 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:16.675+0000 7f6f57248640 1 -- 172.21.15.73:0/538260338 >> 172.21.15.73:0/538260338 conn(0x7f6f5006a4e0 msgr2=0x7f6f5006a8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:45:16.678 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:16.676+0000 7f6f57248640 1 -- 172.21.15.73:0/538260338 shutdown_connections 2023-12-12T09:45:16.678 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:16.676+0000 7f6f57248640 1 -- 172.21.15.73:0/538260338 wait complete. 2023-12-12T09:45:16.678 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:16.677+0000 7f6f57248640 1 Processor -- start 2023-12-12T09:45:16.678 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:16.677+0000 7f6f57248640 1 -- start start 2023-12-12T09:45:16.681 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:16.678+0000 7f6f57248640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6f500c0320 0x7f6f5015c630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:16.682 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:16.678+0000 7f6f57248640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6f500c23b0 0x7f6f500a93f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:16.682 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:16.678+0000 7f6f57248640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6f500c2790 0x7f6f500a9930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:16.682 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:16.678+0000 7f6f57248640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f500aaef0 con 0x7f6f500c2790 2023-12-12T09:45:16.682 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:16.678+0000 7f6f57248640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f5015ab00 con 0x7f6f500c0320 2023-12-12T09:45:16.682 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:16.678+0000 7f6f57248640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f5015ade0 con 0x7f6f500c23b0 2023-12-12T09:45:16.682 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:16.679+0000 7f6f557e5640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6f500c2790 0x7f6f500a9930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:16.682 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:16.679+0000 7f6f557e5640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6f500c2790 0x7f6f500a9930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:38240/0 (socket says 172.21.15.73:38240) 2023-12-12T09:45:16.682 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:16.679+0000 7f6f557e5640 1 -- 172.21.15.73:0/1897421504 learned_addr learned my addr 172.21.15.73:0/1897421504 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:45:16.682 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:16.679+0000 7f6f47fff640 1 --2- 172.21.15.73:0/1897421504 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6f500c23b0 0x7f6f500a93f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:16.682 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:16.679+0000 7f6f54fe4640 1 --2- 172.21.15.73:0/1897421504 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6f500c0320 0x7f6f5015c630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:16.683 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:16.679+0000 7f6f557e5640 1 -- 172.21.15.73:0/1897421504 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6f500c23b0 msgr2=0x7f6f500a93f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:16.683 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:16.679+0000 7f6f557e5640 1 --2- 172.21.15.73:0/1897421504 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6f500c23b0 0x7f6f500a93f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:16.683 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:16.679+0000 7f6f557e5640 1 -- 172.21.15.73:0/1897421504 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6f500c0320 msgr2=0x7f6f5015c630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:16.683 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:16.679+0000 7f6f557e5640 1 --2- 172.21.15.73:0/1897421504 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6f500c0320 0x7f6f5015c630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:16.683 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:16.679+0000 7f6f557e5640 1 -- 172.21.15.73:0/1897421504 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f400094d0 con 0x7f6f500c2790 2023-12-12T09:45:16.683 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:16.679+0000 7f6f47fff640 1 --2- 172.21.15.73:0/1897421504 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6f500c23b0 0x7f6f500a93f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:45:16.683 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:16.680+0000 7f6f557e5640 1 --2- 172.21.15.73:0/1897421504 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6f500c2790 0x7f6f500a9930 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f6f48007e40 tx=0x7f6f4800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:45:16.683 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:16.680+0000 7f6f457fa640 1 -- 172.21.15.73:0/1897421504 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f48014620 con 0x7f6f500c2790 2023-12-12T09:45:16.683 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:16.680+0000 7f6f457fa640 1 -- 172.21.15.73:0/1897421504 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f4800ee90 con 0x7f6f500c2790 2023-12-12T09:45:16.683 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:16.680+0000 7f6f457fa640 1 -- 172.21.15.73:0/1897421504 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f480149e0 con 0x7f6f500c2790 2023-12-12T09:45:16.683 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:16.680+0000 7f6f57248640 1 -- 172.21.15.73:0/1897421504 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f5015b0c0 con 0x7f6f500c2790 2023-12-12T09:45:16.684 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:16.680+0000 7f6f57248640 1 -- 172.21.15.73:0/1897421504 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f5015b680 con 0x7f6f500c2790 2023-12-12T09:45:16.684 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:16.681+0000 7f6f57248640 1 -- 172.21.15.73:0/1897421504 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f50067070 con 0x7f6f500c2790 2023-12-12T09:45:16.684 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:16.682+0000 7f6f457fa640 1 -- 172.21.15.73:0/1897421504 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f6f48014b40 con 0x7f6f500c2790 2023-12-12T09:45:16.685 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:16.683+0000 7f6f457fa640 1 --2- 172.21.15.73:0/1897421504 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f6f3c06ae70 0x7f6f3c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:16.685 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:16.683+0000 7f6f457fa640 1 -- 172.21.15.73:0/1897421504 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f6f48089dc0 con 0x7f6f500c2790 2023-12-12T09:45:16.685 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:16.683+0000 7f6f54fe4640 1 --2- 172.21.15.73:0/1897421504 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f6f3c06ae70 0x7f6f3c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:16.685 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:16.684+0000 7f6f54fe4640 1 --2- 172.21.15.73:0/1897421504 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f6f3c06ae70 0x7f6f3c06d330 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f6f4c004ea0 tx=0x7f6f4c009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:45:16.690 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:16.687+0000 7f6f457fa640 1 -- 172.21.15.73:0/1897421504 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f6f48055070 con 0x7f6f500c2790 2023-12-12T09:45:16.878 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:16.877+0000 7f6f57248640 1 -- 172.21.15.73:0/1897421504 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f6f5015b810 con 0x7f6f500c2790 2023-12-12T09:45:16.884 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:16.883+0000 7f6f457fa640 1 -- 172.21.15.73:0/1897421504 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v12)=0 v12) v1 ==== 122+0+0 (secure 0 0 0) 0x7f6f48058690 con 0x7f6f500c2790 2023-12-12T09:45:16.886 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:16.885+0000 7f6f57248640 1 -- 172.21.15.73:0/1897421504 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f6f3c06ae70 msgr2=0x7f6f3c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:16.886 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:16.885+0000 7f6f57248640 1 --2- 172.21.15.73:0/1897421504 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f6f3c06ae70 0x7f6f3c06d330 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f6f4c004ea0 tx=0x7f6f4c009040 comp rx=0 tx=0).stop 2023-12-12T09:45:16.887 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:16.885+0000 7f6f57248640 1 -- 172.21.15.73:0/1897421504 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6f500c2790 msgr2=0x7f6f500a9930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:16.887 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:16.885+0000 7f6f57248640 1 --2- 172.21.15.73:0/1897421504 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6f500c2790 0x7f6f500a9930 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f6f48007e40 tx=0x7f6f4800e4b0 comp rx=0 tx=0).stop 2023-12-12T09:45:16.887 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:16.886+0000 7f6f57248640 1 -- 172.21.15.73:0/1897421504 shutdown_connections 2023-12-12T09:45:16.887 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:16.886+0000 7f6f57248640 1 --2- 172.21.15.73:0/1897421504 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f6f3c06ae70 0x7f6f3c06d330 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:16.887 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:16.886+0000 7f6f57248640 1 --2- 172.21.15.73:0/1897421504 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6f500c2790 0x7f6f500a9930 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:16.888 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:16.886+0000 7f6f57248640 1 --2- 172.21.15.73:0/1897421504 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6f500c23b0 0x7f6f500a93f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:16.888 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:16.886+0000 7f6f57248640 1 --2- 172.21.15.73:0/1897421504 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6f500c0320 0x7f6f5015c630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:16.888 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:16.886+0000 7f6f57248640 1 -- 172.21.15.73:0/1897421504 >> 172.21.15.73:0/1897421504 conn(0x7f6f5006a4e0 msgr2=0x7f6f50159200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:45:16.888 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:16.886+0000 7f6f57248640 1 -- 172.21.15.73:0/1897421504 shutdown_connections 2023-12-12T09:45:16.888 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:16.886+0000 7f6f57248640 1 -- 172.21.15.73:0/1897421504 wait complete. 2023-12-12T09:45:16.906 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-12-12T09:45:16.906 DEBUG:teuthology.orchestra.run.smithi073:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-12T09:45:17.025 DEBUG:teuthology.orchestra.run.smithi142:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-12T09:45:17.147 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-12-12T09:45:17.147 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2023-12-12T09:45:17.147 DEBUG:teuthology.orchestra.run.smithi073:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-12T09:45:17.208 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054284,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498800k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249396k,nr_inodes=812349,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498800k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 2023-12-12T09:45:17.208 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2023-12-12T09:45:17.208 DEBUG:teuthology.orchestra.run.smithi142:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-12T09:45:17.269 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054289,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498808k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249400k,nr_inodes=812350,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498808k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 2023-12-12T09:45:17.269 INFO:tasks.cephfs.cephfs_test_case:[, ] 2023-12-12T09:45:17.270 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-12T09:45:17.491 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:17.490+0000 7f2308609640 1 Processor -- start 2023-12-12T09:45:17.491 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:17.490+0000 7f2308609640 1 -- start start 2023-12-12T09:45:17.496 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:17.492+0000 7f2308609640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f23000a50f0 0x7f23000a9050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:17.496 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:17.492+0000 7f2308609640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f230006bf20 0x7f23000a9590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:17.496 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:17.492+0000 7f2308609640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23000c0b50 con 0x7f23001552e0 2023-12-12T09:45:17.496 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:17.492+0000 7f2308609640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23000c04d0 con 0x7f23000a50f0 2023-12-12T09:45:17.496 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:17.492+0000 7f2308609640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f230006c880 con 0x7f230006bf20 2023-12-12T09:45:17.497 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:17.492+0000 7f23063a5640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f23001552e0 0x7f23000c49c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:58488/0 (socket says 172.21.15.73:58488) 2023-12-12T09:45:17.497 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:17.492+0000 7f23063a5640 1 -- 172.21.15.73:0/2745815583 learned_addr learned my addr 172.21.15.73:0/2745815583 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-12T09:45:17.497 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:17.492+0000 7f23053a3640 1 -- 172.21.15.73:0/2745815583 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 770593315 0 0) 0x7f23000c0b50 con 0x7f23001552e0 2023-12-12T09:45:17.497 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:17.492+0000 7f23053a3640 1 -- 172.21.15.73:0/2745815583 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f22ec003520 con 0x7f23001552e0 2023-12-12T09:45:17.497 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:17.492+0000 7f2306ba6640 1 --2- 172.21.15.73:0/2745815583 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f230006bf20 0x7f23000a9590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:17.497 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:17.492+0000 7f2305ba4640 1 --2- 172.21.15.73:0/2745815583 >> v2:172.21.15.142:3300/0 conn(0x7f23000a50f0 0x7f23000a9050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:17.498 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:17.493+0000 7f23053a3640 1 -- 172.21.15.73:0/2745815583 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3912631548 0 0) 0x7f22ec003520 con 0x7f23001552e0 2023-12-12T09:45:17.498 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:17.493+0000 7f23053a3640 1 -- 172.21.15.73:0/2745815583 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f230006bf20 msgr2=0x7f23000a9590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:45:17.498 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:17.493+0000 7f23053a3640 1 --2- 172.21.15.73:0/2745815583 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f230006bf20 0x7f23000a9590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:17.498 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:17.493+0000 7f23053a3640 1 -- 172.21.15.73:0/2745815583 >> v2:172.21.15.142:3300/0 conn(0x7f23000a50f0 msgr2=0x7f23000a9050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:45:17.499 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:17.493+0000 7f23053a3640 1 --2- 172.21.15.73:0/2745815583 >> v2:172.21.15.142:3300/0 conn(0x7f23000a50f0 0x7f23000a9050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:17.499 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:17.493+0000 7f23053a3640 1 -- 172.21.15.73:0/2745815583 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f230006cb60 con 0x7f23001552e0 2023-12-12T09:45:17.499 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:17.493+0000 7f23053a3640 1 -- 172.21.15.73:0/2745815583 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3186547832 0 0) 0x7f22f4001670 con 0x7f23001552e0 2023-12-12T09:45:17.499 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:17.493+0000 7f23053a3640 1 -- 172.21.15.73:0/2745815583 >> v1:172.21.15.73:6789/0 conn(0x7f23001552e0 legacy=0x7f23000c49c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:17.499 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:17.493+0000 7f23053a3640 1 --2- 172.21.15.73:0/2745815583 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f230006bf20 0x7f22ec003970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:17.500 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:17.493+0000 7f23053a3640 1 --2- 172.21.15.73:0/2745815583 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f22ec003ff0 0x7f22ec0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:17.500 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:17.493+0000 7f23053a3640 1 --2- 172.21.15.73:0/2745815583 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f22ec004d00 0x7f22ec005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:17.500 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:17.493+0000 7f23053a3640 1 -- 172.21.15.73:0/2745815583 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23000c04d0 con 0x7f22ec003ff0 2023-12-12T09:45:17.500 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:17.493+0000 7f23053a3640 1 -- 172.21.15.73:0/2745815583 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f230006c880 con 0x7f22ec004d00 2023-12-12T09:45:17.500 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:17.493+0000 7f23053a3640 1 -- 172.21.15.73:0/2745815583 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22ec00bb90 con 0x7f230006bf20 2023-12-12T09:45:17.501 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:17.493+0000 7f2305ba4640 1 --2- 172.21.15.73:0/2745815583 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f22ec003ff0 0x7f22ec0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:17.501 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:17.494+0000 7f23063a5640 1 --2- 172.21.15.73:0/2745815583 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f230006bf20 0x7f22ec003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:17.502 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:17.494+0000 7f2305ba4640 1 -- 172.21.15.73:0/2745815583 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f230006bf20 msgr2=0x7f22ec003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:45:17.502 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:17.494+0000 7f2305ba4640 1 --2- 172.21.15.73:0/2745815583 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f230006bf20 0x7f22ec003970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:17.502 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:17.494+0000 7f2305ba4640 1 -- 172.21.15.73:0/2745815583 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f22ec004d00 msgr2=0x7f22ec005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:45:17.505 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:17.494+0000 7f2305ba4640 1 --2- 172.21.15.73:0/2745815583 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f22ec004d00 0x7f22ec005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:17.505 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:17.494+0000 7f2305ba4640 1 -- 172.21.15.73:0/2745815583 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22ec003520 con 0x7f22ec003ff0 2023-12-12T09:45:17.505 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:17.494+0000 7f23063a5640 1 --2- 172.21.15.73:0/2745815583 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f230006bf20 0x7f22ec003970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:45:17.505 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:17.495+0000 7f2305ba4640 1 --2- 172.21.15.73:0/2745815583 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f22ec003ff0 0x7f22ec0047c0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f22fc009ba0 tx=0x7f22ec0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5a98d0a4632f2a9 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:45:17.509 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:17.495+0000 7f23053a3640 1 -- 172.21.15.73:0/2745815583 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22fc036440 con 0x7f22ec003ff0 2023-12-12T09:45:17.509 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:17.495+0000 7f23053a3640 1 -- 172.21.15.73:0/2745815583 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22fc0365a0 con 0x7f22ec003ff0 2023-12-12T09:45:17.510 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:17.495+0000 7f23053a3640 1 -- 172.21.15.73:0/2745815583 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22fc036930 con 0x7f22ec003ff0 2023-12-12T09:45:17.510 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:17.496+0000 7f2308609640 1 -- 172.21.15.73:0/2745815583 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f22ec003ff0 msgr2=0x7f22ec0047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:17.510 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:17.496+0000 7f2308609640 1 --2- 172.21.15.73:0/2745815583 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f22ec003ff0 0x7f22ec0047c0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f22fc009ba0 tx=0x7f22ec0057f0 comp rx=0 tx=0).stop 2023-12-12T09:45:17.510 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:17.496+0000 7f2306ba6640 1 -- 172.21.15.73:0/2745815583 reap_dead start 2023-12-12T09:45:17.510 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:17.496+0000 7f2308609640 1 -- 172.21.15.73:0/2745815583 shutdown_connections 2023-12-12T09:45:17.510 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:17.496+0000 7f2308609640 1 -- 172.21.15.73:0/2745815583 >> 172.21.15.73:0/2745815583 conn(0x7f23000a8130 msgr2=0x7f23000c24b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:45:17.510 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:17.496+0000 7f2308609640 1 -- 172.21.15.73:0/2745815583 shutdown_connections 2023-12-12T09:45:17.510 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:17.496+0000 7f2308609640 1 -- 172.21.15.73:0/2745815583 wait complete. 2023-12-12T09:45:17.510 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:17.498+0000 7f2308609640 1 Processor -- start 2023-12-12T09:45:17.514 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:17.498+0000 7f2308609640 1 -- start start 2023-12-12T09:45:17.514 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:17.499+0000 7f2308609640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f22ec003ff0 0x7f23001dc2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:17.514 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:17.499+0000 7f2308609640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2300070eb0 0x7f23000bf050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:17.514 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:17.499+0000 7f2308609640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f23001da900 0x7f23001dad80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:17.514 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:17.499+0000 7f2308609640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f230006feb0 con 0x7f2300070eb0 2023-12-12T09:45:17.514 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:17.499+0000 7f2308609640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2300070a30 con 0x7f23001da900 2023-12-12T09:45:17.514 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:17.499+0000 7f2308609640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2300070100 con 0x7f22ec003ff0 2023-12-12T09:45:17.514 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:17.499+0000 7f2305ba4640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2300070eb0 0x7f23000bf050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:17.515 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:17.499+0000 7f2305ba4640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2300070eb0 0x7f23000bf050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:38254/0 (socket says 172.21.15.73:38254) 2023-12-12T09:45:17.515 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:17.499+0000 7f2305ba4640 1 -- 172.21.15.73:0/506839263 learned_addr learned my addr 172.21.15.73:0/506839263 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:45:17.515 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:17.499+0000 7f2305ba4640 1 -- 172.21.15.73:0/506839263 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f22ec003ff0 msgr2=0x7f23001dc2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:17.515 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:17.499+0000 7f2305ba4640 1 --2- 172.21.15.73:0/506839263 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f22ec003ff0 0x7f23001dc2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:17.515 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:17.499+0000 7f2305ba4640 1 -- 172.21.15.73:0/506839263 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f23001da900 msgr2=0x7f23001dad80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:17.515 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:17.500+0000 7f2305ba4640 1 --2- 172.21.15.73:0/506839263 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f23001da900 0x7f23001dad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:17.515 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:17.500+0000 7f2305ba4640 1 -- 172.21.15.73:0/506839263 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23000703e0 con 0x7f2300070eb0 2023-12-12T09:45:17.515 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:17.500+0000 7f2305ba4640 1 --2- 172.21.15.73:0/506839263 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2300070eb0 0x7f23000bf050 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f22fc039040 tx=0x7f22fc004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:45:17.515 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:17.500+0000 7f22f2ffd640 1 -- 172.21.15.73:0/506839263 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22fc045070 con 0x7f2300070eb0 2023-12-12T09:45:17.515 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:17.500+0000 7f22f2ffd640 1 -- 172.21.15.73:0/506839263 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22fc003990 con 0x7f2300070eb0 2023-12-12T09:45:17.515 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:17.500+0000 7f22f2ffd640 1 -- 172.21.15.73:0/506839263 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22fc003d40 con 0x7f2300070eb0 2023-12-12T09:45:17.515 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:17.500+0000 7f2308609640 1 -- 172.21.15.73:0/506839263 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23000706c0 con 0x7f2300070eb0 2023-12-12T09:45:17.515 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:17.500+0000 7f2308609640 1 -- 172.21.15.73:0/506839263 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f230014e990 con 0x7f2300070eb0 2023-12-12T09:45:17.515 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:17.501+0000 7f2308609640 1 -- 172.21.15.73:0/506839263 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f230014ebb0 con 0x7f2300070eb0 2023-12-12T09:45:17.516 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:17.502+0000 7f22f2ffd640 1 -- 172.21.15.73:0/506839263 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f22fc03d070 con 0x7f2300070eb0 2023-12-12T09:45:17.516 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:17.503+0000 7f22f2ffd640 1 --2- 172.21.15.73:0/506839263 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f22e406ae40 0x7f22e406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:17.516 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:17.503+0000 7f22f2ffd640 1 -- 172.21.15.73:0/506839263 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f22fc0abc10 con 0x7f2300070eb0 2023-12-12T09:45:17.516 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:17.503+0000 7f23063a5640 1 --2- 172.21.15.73:0/506839263 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f22e406ae40 0x7f22e406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:17.516 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:17.504+0000 7f23063a5640 1 --2- 172.21.15.73:0/506839263 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f22e406ae40 0x7f22e406d300 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f22f4001050 tx=0x7f22f4009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:45:17.516 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:17.508+0000 7f22f2ffd640 1 -- 172.21.15.73:0/506839263 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f22fc077070 con 0x7f2300070eb0 2023-12-12T09:45:17.737 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:17.735+0000 7f2308609640 1 -- 172.21.15.73:0/506839263 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f230006cfd0 con 0x7f2300070eb0 2023-12-12T09:45:17.738 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:17.736+0000 7f22f2ffd640 1 -- 172.21.15.73:0/506839263 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) v1 ==== 94+0+3702 (secure 0 0 0) 0x7f230006cfd0 con 0x7f2300070eb0 2023-12-12T09:45:17.738 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-12T09:45:17.738 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":23,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4517,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6835/2407815368","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6833","nonce":2407815368},{"type":"v1","addr":"172.21.15.142:6835","nonce":2407815368}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":4720,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6834/153753304","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6832","nonce":153753304},{"type":"v1","addr":"172.21.15.142:6834","nonce":153753304}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":5532,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6837/3504911419","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6835","nonce":3504911419},{"type":"v1","addr":"172.21.15.73:6837","nonce":3504911419}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":21},{"gid":5631,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6836/1188233621","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":1188233621},{"type":"v1","addr":"172.21.15.73:6836","nonce":1188233621}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":23}],"filesystems":[]} 2023-12-12T09:45:17.738 INFO:teuthology.orchestra.run.smithi073.stderr:dumped fsmap epoch 23 2023-12-12T09:45:17.740 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:17.739+0000 7f2308609640 1 -- 172.21.15.73:0/506839263 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f22e406ae40 msgr2=0x7f22e406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:17.740 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:17.739+0000 7f2308609640 1 --2- 172.21.15.73:0/506839263 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f22e406ae40 0x7f22e406d300 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f22f4001050 tx=0x7f22f4009040 comp rx=0 tx=0).stop 2023-12-12T09:45:17.740 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:17.739+0000 7f2308609640 1 -- 172.21.15.73:0/506839263 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2300070eb0 msgr2=0x7f23000bf050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:17.741 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:17.739+0000 7f2308609640 1 --2- 172.21.15.73:0/506839263 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2300070eb0 0x7f23000bf050 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f22fc039040 tx=0x7f22fc004ab0 comp rx=0 tx=0).stop 2023-12-12T09:45:17.741 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:17.739+0000 7f2308609640 1 -- 172.21.15.73:0/506839263 shutdown_connections 2023-12-12T09:45:17.741 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:17.739+0000 7f2308609640 1 --2- 172.21.15.73:0/506839263 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f22e406ae40 0x7f22e406d300 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:17.741 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:17.739+0000 7f2308609640 1 --2- 172.21.15.73:0/506839263 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f23001da900 0x7f23001dad80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:17.741 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:17.739+0000 7f2308609640 1 --2- 172.21.15.73:0/506839263 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2300070eb0 0x7f23000bf050 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:17.741 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:17.739+0000 7f2308609640 1 --2- 172.21.15.73:0/506839263 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f22ec003ff0 0x7f23001dc2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:17.741 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:17.739+0000 7f2308609640 1 -- 172.21.15.73:0/506839263 >> 172.21.15.73:0/506839263 conn(0x7f23000a8130 msgr2=0x7f23000c35a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:45:17.741 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:17.739+0000 7f2308609640 1 -- 172.21.15.73:0/506839263 shutdown_connections 2023-12-12T09:45:17.741 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:17.739+0000 7f2308609640 1 -- 172.21.15.73:0/506839263 wait complete. 2023-12-12T09:45:17.760 INFO:tasks.ceph.mds.a:Restarting daemon 2023-12-12T09:45:17.761 INFO:tasks.ceph.mds.a:Stopping old one... 2023-12-12T09:45:17.761 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-12-12T09:45:17.761 INFO:teuthology.orchestra.run:waiting for 300 2023-12-12T09:45:17.761 INFO:tasks.ceph.mds.c:Restarting daemon 2023-12-12T09:45:17.761 INFO:tasks.ceph.mds.c:Stopping old one... 2023-12-12T09:45:17.761 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-12-12T09:45:17.761 INFO:teuthology.orchestra.run:waiting for 300 2023-12-12T09:45:17.762 INFO:tasks.ceph.mds.b:Restarting daemon 2023-12-12T09:45:17.762 INFO:tasks.ceph.mds.b:Stopping old one... 2023-12-12T09:45:17.762 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-12-12T09:45:17.762 INFO:teuthology.orchestra.run:waiting for 300 2023-12-12T09:45:17.762 INFO:tasks.ceph.mds.d:Restarting daemon 2023-12-12T09:45:17.762 INFO:tasks.ceph.mds.d:Stopping old one... 2023-12-12T09:45:17.762 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-12-12T09:45:17.763 INFO:teuthology.orchestra.run:waiting for 300 2023-12-12T09:45:17.777 INFO:tasks.ceph.mds.a:Stopped 2023-12-12T09:45:17.777 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-12-12T09:45:17.778 INFO:tasks.ceph.mds.c:Stopped 2023-12-12T09:45:17.779 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-12-12T09:45:17.782 INFO:tasks.ceph.mds.b:Stopped 2023-12-12T09:45:17.782 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-12-12T09:45:17.786 INFO:tasks.ceph.mds.d:Stopped 2023-12-12T09:45:17.786 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-12-12T09:45:17.827 INFO:tasks.ceph.mds.a:Started 2023-12-12T09:45:17.828 DEBUG:teuthology.parallel:result is None 2023-12-12T09:45:17.834 INFO:tasks.ceph.mds.b:Started 2023-12-12T09:45:17.835 DEBUG:teuthology.parallel:result is None 2023-12-12T09:45:17.835 INFO:tasks.ceph.mds.c:Started 2023-12-12T09:45:17.836 DEBUG:teuthology.parallel:result is None 2023-12-12T09:45:17.842 INFO:tasks.ceph.mds.d:Started 2023-12-12T09:45:17.842 DEBUG:teuthology.parallel:result is None 2023-12-12T09:45:17.843 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-12-12T09:45:17.984 INFO:tasks.ceph.mds.a.smithi073.stdout:starting mds.a at 2023-12-12T09:45:17.988 INFO:tasks.ceph.mds.c.smithi073.stdout:starting mds.c at 2023-12-12T09:45:18.002 INFO:tasks.ceph.mds.b.smithi142.stdout:starting mds.b at 2023-12-12T09:45:18.003 INFO:tasks.ceph.mds.d.smithi142.stdout:starting mds.d at 2023-12-12T09:45:18.029 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:18.028+0000 7fc8b10ad640 1 Processor -- start 2023-12-12T09:45:18.030 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:18.028+0000 7fc8b10ad640 1 -- start start 2023-12-12T09:45:18.034 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:18.029+0000 7fc8b10ad640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fc8ac0ca000 0x7fc8ac0ca3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:18.035 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:18.029+0000 7fc8b10ad640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc8ac154c40 0x7fc8ac15ee10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:18.035 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:18.029+0000 7fc8b10ad640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8ac0c7240 con 0x7fc8ac0c81e0 2023-12-12T09:45:18.035 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:18.029+0000 7fc8b10ad640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8ac0c5170 con 0x7fc8ac0ca000 2023-12-12T09:45:18.035 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:18.029+0000 7fc8b10ad640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8ac06c480 con 0x7fc8ac154c40 2023-12-12T09:45:18.035 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:18.029+0000 7fc8ab7fe640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7fc8ac0c81e0 0x7fc8ac154530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:58520/0 (socket says 172.21.15.73:58520) 2023-12-12T09:45:18.035 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:18.029+0000 7fc8ab7fe640 1 -- 172.21.15.73:0/1580789248 learned_addr learned my addr 172.21.15.73:0/1580789248 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-12T09:45:18.036 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:18.030+0000 7fc8abfff640 1 --2- 172.21.15.73:0/1580789248 >> v2:172.21.15.142:3300/0 conn(0x7fc8ac0ca000 0x7fc8ac0ca3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:18.036 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:18.030+0000 7fc8b08ac640 1 --2- 172.21.15.73:0/1580789248 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc8ac154c40 0x7fc8ac15ee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:18.036 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:18.030+0000 7fc8aaffd640 1 -- 172.21.15.73:0/1580789248 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3755877368 0 0) 0x7fc8ac0c7240 con 0x7fc8ac0c81e0 2023-12-12T09:45:18.036 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:18.030+0000 7fc8aaffd640 1 -- 172.21.15.73:0/1580789248 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc894003520 con 0x7fc8ac0c81e0 2023-12-12T09:45:18.036 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:18.030+0000 7fc8abfff640 1 -- 172.21.15.73:0/1580789248 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc8ac154c40 msgr2=0x7fc8ac15ee10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:45:18.036 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:18.030+0000 7fc8abfff640 1 --2- 172.21.15.73:0/1580789248 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc8ac154c40 0x7fc8ac15ee10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:18.036 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:18.030+0000 7fc8abfff640 1 -- 172.21.15.73:0/1580789248 >> v1:172.21.15.73:6789/0 conn(0x7fc8ac0c81e0 legacy=0x7fc8ac154530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:18.037 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:18.030+0000 7fc8abfff640 1 -- 172.21.15.73:0/1580789248 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8ac0c6910 con 0x7fc8ac0ca000 2023-12-12T09:45:18.037 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:18.031+0000 7fc8abfff640 1 --2- 172.21.15.73:0/1580789248 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc8ac0ca000 0x7fc8ac0ca3e0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fc89c0097a0 tx=0x7fc89c02b8b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d0db2c6d071a053b server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:45:18.037 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:18.031+0000 7fc8aaffd640 1 -- 172.21.15.73:0/1580789248 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc89c02d040 con 0x7fc8ac0ca000 2023-12-12T09:45:18.037 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:18.031+0000 7fc8aaffd640 1 -- 172.21.15.73:0/1580789248 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc89c031810 con 0x7fc8ac0ca000 2023-12-12T09:45:18.037 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:18.031+0000 7fc8aaffd640 1 -- 172.21.15.73:0/1580789248 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc89c031ba0 con 0x7fc8ac0ca000 2023-12-12T09:45:18.037 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:18.032+0000 7fc8b10ad640 1 -- 172.21.15.73:0/1580789248 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc8ac0ca000 msgr2=0x7fc8ac0ca3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:18.037 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:18.032+0000 7fc8b10ad640 1 --2- 172.21.15.73:0/1580789248 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc8ac0ca000 0x7fc8ac0ca3e0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fc89c0097a0 tx=0x7fc89c02b8b0 comp rx=0 tx=0).stop 2023-12-12T09:45:18.038 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:18.032+0000 7fc8b10ad640 1 -- 172.21.15.73:0/1580789248 shutdown_connections 2023-12-12T09:45:18.038 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:18.032+0000 7fc8b10ad640 1 --2- 172.21.15.73:0/1580789248 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc8ac154c40 0x7fc8ac15ee10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:18.038 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:18.032+0000 7fc8b10ad640 1 --2- 172.21.15.73:0/1580789248 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc8ac0ca000 0x7fc8ac0ca3e0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:18.038 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:18.032+0000 7fc8b10ad640 1 -- 172.21.15.73:0/1580789248 >> 172.21.15.73:0/1580789248 conn(0x7fc8ac071df0 msgr2=0x7fc8ac072200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:45:18.038 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:18.032+0000 7fc8b10ad640 1 -- 172.21.15.73:0/1580789248 shutdown_connections 2023-12-12T09:45:18.038 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:18.032+0000 7fc8b10ad640 1 -- 172.21.15.73:0/1580789248 wait complete. 2023-12-12T09:45:18.043 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:18.034+0000 7fc8b10ad640 1 Processor -- start 2023-12-12T09:45:18.043 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:18.034+0000 7fc8b10ad640 1 -- start start 2023-12-12T09:45:18.044 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:18.035+0000 7fc8b10ad640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc8ac0c81e0 0x7fc8ac1ed3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:18.044 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:18.035+0000 7fc8b10ad640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc8ac0ca000 0x7fc8ac1ed8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:18.044 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:18.035+0000 7fc8b10ad640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc8ac154c40 0x7fc8ac156660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:18.044 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:18.035+0000 7fc8b10ad640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8ac0c20e0 con 0x7fc8ac0c81e0 2023-12-12T09:45:18.044 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:18.035+0000 7fc8b10ad640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8ac0c2980 con 0x7fc8ac0ca000 2023-12-12T09:45:18.044 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:18.035+0000 7fc8b10ad640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8ac1edf30 con 0x7fc8ac154c40 2023-12-12T09:45:18.045 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:18.035+0000 7fc8abfff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc8ac0c81e0 0x7fc8ac1ed3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:18.045 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:18.035+0000 7fc8abfff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc8ac0c81e0 0x7fc8ac1ed3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:38274/0 (socket says 172.21.15.73:38274) 2023-12-12T09:45:18.045 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:18.035+0000 7fc8abfff640 1 -- 172.21.15.73:0/3272448009 learned_addr learned my addr 172.21.15.73:0/3272448009 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:45:18.045 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:18.035+0000 7fc8b08ac640 1 --2- 172.21.15.73:0/3272448009 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc8ac154c40 0x7fc8ac156660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:18.045 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:18.035+0000 7fc8ab7fe640 1 --2- 172.21.15.73:0/3272448009 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc8ac0ca000 0x7fc8ac1ed8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:18.045 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:18.036+0000 7fc8abfff640 1 -- 172.21.15.73:0/3272448009 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc8ac154c40 msgr2=0x7fc8ac156660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:18.045 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:18.036+0000 7fc8abfff640 1 --2- 172.21.15.73:0/3272448009 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc8ac154c40 0x7fc8ac156660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:18.046 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:18.036+0000 7fc8abfff640 1 -- 172.21.15.73:0/3272448009 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc8ac0ca000 msgr2=0x7fc8ac1ed8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:18.046 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:18.036+0000 7fc8abfff640 1 --2- 172.21.15.73:0/3272448009 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc8ac0ca000 0x7fc8ac1ed8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:18.046 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:18.036+0000 7fc8abfff640 1 -- 172.21.15.73:0/3272448009 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc89c009400 con 0x7fc8ac0c81e0 2023-12-12T09:45:18.046 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:18.036+0000 7fc8b08ac640 1 --2- 172.21.15.73:0/3272448009 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc8ac154c40 0x7fc8ac156660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-12T09:45:18.046 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:18.036+0000 7fc8abfff640 1 --2- 172.21.15.73:0/3272448009 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc8ac0c81e0 0x7fc8ac1ed3b0 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7fc89c0098c0 tx=0x7fc89c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:45:18.046 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:18.036+0000 7fc8a8ff9640 1 -- 172.21.15.73:0/3272448009 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc89c03ad60 con 0x7fc8ac0c81e0 2023-12-12T09:45:18.047 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:18.036+0000 7fc8a8ff9640 1 -- 172.21.15.73:0/3272448009 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc89c044400 con 0x7fc8ac0c81e0 2023-12-12T09:45:18.047 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:18.036+0000 7fc8a8ff9640 1 -- 172.21.15.73:0/3272448009 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc89c0445b0 con 0x7fc8ac0c81e0 2023-12-12T09:45:18.047 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:18.036+0000 7fc8b10ad640 1 -- 172.21.15.73:0/3272448009 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8ac0c2330 con 0x7fc8ac0c81e0 2023-12-12T09:45:18.047 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:18.036+0000 7fc8b10ad640 1 -- 172.21.15.73:0/3272448009 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8ac155530 con 0x7fc8ac0c81e0 2023-12-12T09:45:18.047 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:18.037+0000 7fc8b10ad640 1 -- 172.21.15.73:0/3272448009 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc8ac1556c0 con 0x7fc8ac0c81e0 2023-12-12T09:45:18.047 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:18.038+0000 7fc8a8ff9640 1 -- 172.21.15.73:0/3272448009 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fc89c04d440 con 0x7fc8ac0c81e0 2023-12-12T09:45:18.048 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:18.039+0000 7fc8a8ff9640 1 --2- 172.21.15.73:0/3272448009 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fc89806ae40 0x7fc89806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:18.048 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:18.039+0000 7fc8a8ff9640 1 -- 172.21.15.73:0/3272448009 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5029+0+0 (secure 0 0 0) 0x7fc89c0ab670 con 0x7fc8ac0c81e0 2023-12-12T09:45:18.048 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:18.039+0000 7fc8ab7fe640 1 --2- 172.21.15.73:0/3272448009 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fc89806ae40 0x7fc89806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:18.048 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:18.040+0000 7fc8ab7fe640 1 --2- 172.21.15.73:0/3272448009 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fc89806ae40 0x7fc89806d300 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fc8ac0c3520 tx=0x7fc8a0009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:45:18.049 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:18.044+0000 7fc8a8ff9640 1 -- 172.21.15.73:0/3272448009 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fc89c076a50 con 0x7fc8ac0c81e0 2023-12-12T09:45:18.246 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:18.245+0000 7fc8b10ad640 1 -- 172.21.15.73:0/3272448009 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7fc8ac067400 con 0x7fc8ac0c81e0 2023-12-12T09:45:18.466 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:18.464+0000 7fc8a8ff9640 1 -- 172.21.15.73:0/3272448009 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v48) v1 ==== 97+0+0 (secure 0 0 0) 0x7fc89c07a070 con 0x7fc8ac0c81e0 2023-12-12T09:45:18.466 INFO:teuthology.orchestra.run.smithi073.stderr: removed all blocklist entries 2023-12-12T09:45:18.470 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:18.468+0000 7fc8b10ad640 1 -- 172.21.15.73:0/3272448009 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fc89806ae40 msgr2=0x7fc89806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:18.470 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:18.468+0000 7fc8b10ad640 1 --2- 172.21.15.73:0/3272448009 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fc89806ae40 0x7fc89806d300 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fc8ac0c3520 tx=0x7fc8a0009040 comp rx=0 tx=0).stop 2023-12-12T09:45:18.470 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:18.468+0000 7fc8b10ad640 1 -- 172.21.15.73:0/3272448009 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc8ac0c81e0 msgr2=0x7fc8ac1ed3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:18.470 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:18.468+0000 7fc8b10ad640 1 --2- 172.21.15.73:0/3272448009 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc8ac0c81e0 0x7fc8ac1ed3b0 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7fc89c0098c0 tx=0x7fc89c0046c0 comp rx=0 tx=0).stop 2023-12-12T09:45:18.470 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:18.468+0000 7fc8b10ad640 1 -- 172.21.15.73:0/3272448009 shutdown_connections 2023-12-12T09:45:18.470 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:18.468+0000 7fc8b10ad640 1 --2- 172.21.15.73:0/3272448009 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fc89806ae40 0x7fc89806d300 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:18.470 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:18.468+0000 7fc8b10ad640 1 --2- 172.21.15.73:0/3272448009 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc8ac154c40 0x7fc8ac156660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:18.470 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:18.468+0000 7fc8b10ad640 1 --2- 172.21.15.73:0/3272448009 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc8ac0ca000 0x7fc8ac1ed8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:18.470 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:18.468+0000 7fc8b10ad640 1 --2- 172.21.15.73:0/3272448009 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc8ac0c81e0 0x7fc8ac1ed3b0 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:18.471 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:18.468+0000 7fc8b10ad640 1 -- 172.21.15.73:0/3272448009 >> 172.21.15.73:0/3272448009 conn(0x7fc8ac071df0 msgr2=0x7fc8ac154190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:45:18.471 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:18.468+0000 7fc8b10ad640 1 -- 172.21.15.73:0/3272448009 shutdown_connections 2023-12-12T09:45:18.471 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:18.469+0000 7fc8b10ad640 1 -- 172.21.15.73:0/3272448009 wait complete. 2023-12-12T09:45:18.492 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-12-12T09:45:18.631 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T09:45:18.640 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T09:45:18.686 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:18.684+0000 7efd14b01640 1 Processor -- start 2023-12-12T09:45:18.686 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:18.685+0000 7efd14b01640 1 -- start start 2023-12-12T09:45:18.688 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:18.686+0000 7efd14b01640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7efd1014fa40 0x7efd1006a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:18.688 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:18.686+0000 7efd14b01640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7efd1006db70 0x7efd100c39b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:18.688 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:18.686+0000 7efd14b01640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd10152610 con 0x7efd100c5070 2023-12-12T09:45:18.688 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:18.686+0000 7efd14b01640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd101528f0 con 0x7efd1006db70 2023-12-12T09:45:18.688 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:18.686+0000 7efd14b01640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd10152bd0 con 0x7efd1014fa40 2023-12-12T09:45:18.688 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:18.686+0000 7efd07fff640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7efd1006db70 0x7efd100c39b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:18.688 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:18.686+0000 7efd0ed9d640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7efd100c5070 0x7efd100c3ef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:58536/0 (socket says 172.21.15.73:58536) 2023-12-12T09:45:18.688 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:18.686+0000 7efd07fff640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7efd1006db70 0x7efd100c39b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:38282/0 (socket says 172.21.15.73:38282) 2023-12-12T09:45:18.688 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:18.686+0000 7efd0ed9d640 1 -- 172.21.15.73:0/3990106403 learned_addr learned my addr 172.21.15.73:0/3990106403 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-12T09:45:18.688 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:18.687+0000 7efd0e59c640 1 --2- 172.21.15.73:0/3990106403 >> v2:172.21.15.142:3300/0 conn(0x7efd1014fa40 0x7efd1006a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:18.689 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:18.687+0000 7efd07fff640 1 -- 172.21.15.73:0/3990106403 >> v2:172.21.15.142:3300/0 conn(0x7efd1014fa40 msgr2=0x7efd1006a4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:45:18.689 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:18.687+0000 7efd07fff640 1 --2- 172.21.15.73:0/3990106403 >> v2:172.21.15.142:3300/0 conn(0x7efd1014fa40 0x7efd1006a4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:18.689 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:18.687+0000 7efd07fff640 1 -- 172.21.15.73:0/3990106403 >> v1:172.21.15.73:6789/0 conn(0x7efd100c5070 legacy=0x7efd100c3ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:18.689 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:18.687+0000 7efd07fff640 1 -- 172.21.15.73:0/3990106403 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd10152eb0 con 0x7efd1006db70 2023-12-12T09:45:18.689 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:18.688+0000 7efd07fff640 1 --2- 172.21.15.73:0/3990106403 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efd1006db70 0x7efd100c39b0 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7efd1006e480 tx=0x7efcf802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54a33835fcf33f06 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:45:18.690 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:18.689+0000 7efd0dd9b640 1 -- 172.21.15.73:0/3990106403 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcf8031830 con 0x7efd1006db70 2023-12-12T09:45:18.690 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:18.689+0000 7efd0dd9b640 1 -- 172.21.15.73:0/3990106403 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efcf8031990 con 0x7efd1006db70 2023-12-12T09:45:18.690 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:18.689+0000 7efd0dd9b640 1 -- 172.21.15.73:0/3990106403 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcf8031d20 con 0x7efd1006db70 2023-12-12T09:45:18.690 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:18.689+0000 7efd14b01640 1 -- 172.21.15.73:0/3990106403 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efd1006db70 msgr2=0x7efd100c39b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:18.690 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:18.689+0000 7efd14b01640 1 --2- 172.21.15.73:0/3990106403 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efd1006db70 0x7efd100c39b0 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7efd1006e480 tx=0x7efcf802b8d0 comp rx=0 tx=0).stop 2023-12-12T09:45:18.691 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:18.689+0000 7efd14b01640 1 -- 172.21.15.73:0/3990106403 shutdown_connections 2023-12-12T09:45:18.691 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:18.689+0000 7efd14b01640 1 --2- 172.21.15.73:0/3990106403 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efd1006db70 0x7efd100c39b0 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:18.691 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:18.689+0000 7efd14b01640 1 --2- 172.21.15.73:0/3990106403 >> v2:172.21.15.142:3300/0 conn(0x7efd1014fa40 0x7efd1006a4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:18.691 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:18.689+0000 7efd14b01640 1 -- 172.21.15.73:0/3990106403 >> 172.21.15.73:0/3990106403 conn(0x7efd100a8130 msgr2=0x7efd100c24b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:45:18.691 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:18.689+0000 7efd14b01640 1 -- 172.21.15.73:0/3990106403 shutdown_connections 2023-12-12T09:45:18.692 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:18.689+0000 7efd14b01640 1 -- 172.21.15.73:0/3990106403 wait complete. 2023-12-12T09:45:18.692 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:18.691+0000 7efd14b01640 1 Processor -- start 2023-12-12T09:45:18.692 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:18.691+0000 7efd14b01640 1 -- start start 2023-12-12T09:45:18.695 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:18.692+0000 7efd14b01640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efd1006db70 0x7efd101537e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:18.695 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:18.692+0000 7efd14b01640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efd100c5070 0x7efd101e7c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:18.695 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:18.692+0000 7efd14b01640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efd1014fa40 0x7efd1014acb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:18.695 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:18.692+0000 7efd14b01640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd10154550 con 0x7efd1006db70 2023-12-12T09:45:18.695 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:18.692+0000 7efd14b01640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd10154380 con 0x7efd1014fa40 2023-12-12T09:45:18.695 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:18.692+0000 7efd14b01640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd101e81d0 con 0x7efd100c5070 2023-12-12T09:45:18.695 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:18.692+0000 7efd0e59c640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efd1006db70 0x7efd101537e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:18.695 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:18.692+0000 7efd0e59c640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efd1006db70 0x7efd101537e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:38288/0 (socket says 172.21.15.73:38288) 2023-12-12T09:45:18.695 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:18.692+0000 7efd0e59c640 1 -- 172.21.15.73:0/4074206541 learned_addr learned my addr 172.21.15.73:0/4074206541 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:45:18.695 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:18.693+0000 7efd0ed9d640 1 --2- 172.21.15.73:0/4074206541 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efd1014fa40 0x7efd1014acb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:18.695 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:18.693+0000 7efd07fff640 1 --2- 172.21.15.73:0/4074206541 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efd100c5070 0x7efd101e7c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:18.696 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:18.693+0000 7efd0e59c640 1 -- 172.21.15.73:0/4074206541 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efd100c5070 msgr2=0x7efd101e7c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:18.696 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:18.693+0000 7efd0e59c640 1 --2- 172.21.15.73:0/4074206541 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efd100c5070 0x7efd101e7c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:18.696 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:18.693+0000 7efd0e59c640 1 -- 172.21.15.73:0/4074206541 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efd1014fa40 msgr2=0x7efd1014acb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:18.696 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:18.693+0000 7efd0e59c640 1 --2- 172.21.15.73:0/4074206541 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efd1014fa40 0x7efd1014acb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:18.696 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:18.693+0000 7efd0e59c640 1 -- 172.21.15.73:0/4074206541 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcf8009400 con 0x7efd1006db70 2023-12-12T09:45:18.696 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:18.693+0000 7efd0e59c640 1 --2- 172.21.15.73:0/4074206541 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efd1006db70 0x7efd101537e0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7efd0000e9b0 tx=0x7efd0000ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:45:18.696 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:18.693+0000 7efd06ffd640 1 -- 172.21.15.73:0/4074206541 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd00009670 con 0x7efd1006db70 2023-12-12T09:45:18.696 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:18.693+0000 7efd06ffd640 1 -- 172.21.15.73:0/4074206541 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd0000c9a0 con 0x7efd1006db70 2023-12-12T09:45:18.696 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:18.693+0000 7efd06ffd640 1 -- 172.21.15.73:0/4074206541 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd0000cd50 con 0x7efd1006db70 2023-12-12T09:45:18.696 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:18.693+0000 7efd14b01640 1 -- 172.21.15.73:0/4074206541 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd10153dc0 con 0x7efd1006db70 2023-12-12T09:45:18.696 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:18.694+0000 7efd14b01640 1 -- 172.21.15.73:0/4074206541 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd101eb330 con 0x7efd1006db70 2023-12-12T09:45:18.697 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:18.695+0000 7efd14b01640 1 -- 172.21.15.73:0/4074206541 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd10067580 con 0x7efd1006db70 2023-12-12T09:45:18.698 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:18.697+0000 7efd06ffd640 1 -- 172.21.15.73:0/4074206541 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7efd00013470 con 0x7efd1006db70 2023-12-12T09:45:18.699 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:18.698+0000 7efd06ffd640 1 --2- 172.21.15.73:0/4074206541 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7efcf006ae40 0x7efcf006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:18.699 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:18.698+0000 7efd06ffd640 1 -- 172.21.15.73:0/4074206541 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 4857+0+0 (secure 0 0 0) 0x7efd00089470 con 0x7efd1006db70 2023-12-12T09:45:18.699 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:18.698+0000 7efd07fff640 1 --2- 172.21.15.73:0/4074206541 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7efcf006ae40 0x7efcf006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:18.700 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:18.699+0000 7efd07fff640 1 --2- 172.21.15.73:0/4074206541 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7efcf006ae40 0x7efcf006d300 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7efcf8036000 tx=0x7efcf803c040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:45:18.704 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:18.703+0000 7efd06ffd640 1 -- 172.21.15.73:0/4074206541 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7efd00054910 con 0x7efd1006db70 2023-12-12T09:45:18.964 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:18.963+0000 7efd14b01640 1 -- 172.21.15.73:0/4074206541 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7efd100c64e0 con 0x7efd1006db70 2023-12-12T09:45:18.965 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:18.964+0000 7efd06ffd640 1 -- 172.21.15.73:0/4074206541 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v13) v1 ==== 80+0+5021 (secure 0 0 0) 0x7efd00057f30 con 0x7efd1006db70 2023-12-12T09:45:18.965 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-12T09:45:18.965 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2023-12-12T09:45:18.965 INFO:teuthology.orchestra.run.smithi073.stdout: "auth_dump": [ 2023-12-12T09:45:18.965 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-12-12T09:45:18.965 INFO:teuthology.orchestra.run.smithi073.stdout: "entity": "mds.a", 2023-12-12T09:45:18.966 INFO:teuthology.orchestra.run.smithi073.stdout: "key": "AQD+KnhltpiJCBAAkARF8P9XMNmVBOclyUE0FQ==", 2023-12-12T09:45:18.966 INFO:teuthology.orchestra.run.smithi073.stdout: "caps": { 2023-12-12T09:45:18.966 INFO:teuthology.orchestra.run.smithi073.stdout: "mds": "allow", 2023-12-12T09:45:18.966 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr": "allow *", 2023-12-12T09:45:18.966 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": "allow *", 2023-12-12T09:45:18.966 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": "allow *" 2023-12-12T09:45:18.966 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-12-12T09:45:18.966 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-12-12T09:45:18.966 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-12-12T09:45:18.966 INFO:teuthology.orchestra.run.smithi073.stdout: "entity": "mds.b", 2023-12-12T09:45:18.966 INFO:teuthology.orchestra.run.smithi073.stdout: "key": "AQD+KnhlmYRlKBAAVfJyNKwqFR1brRr+uFNhPA==", 2023-12-12T09:45:18.966 INFO:teuthology.orchestra.run.smithi073.stdout: "caps": { 2023-12-12T09:45:18.966 INFO:teuthology.orchestra.run.smithi073.stdout: "mds": "allow", 2023-12-12T09:45:18.967 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr": "allow *", 2023-12-12T09:45:18.967 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": "allow *", 2023-12-12T09:45:18.967 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": "allow *" 2023-12-12T09:45:18.967 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-12-12T09:45:18.967 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-12-12T09:45:18.967 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-12-12T09:45:18.967 INFO:teuthology.orchestra.run.smithi073.stdout: "entity": "mds.c", 2023-12-12T09:45:18.967 INFO:teuthology.orchestra.run.smithi073.stdout: "key": "AQD+KnhlmFweGRAAOp4JMzmBBBakD0PZJ+h3kA==", 2023-12-12T09:45:18.967 INFO:teuthology.orchestra.run.smithi073.stdout: "caps": { 2023-12-12T09:45:18.967 INFO:teuthology.orchestra.run.smithi073.stdout: "mds": "allow", 2023-12-12T09:45:18.967 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr": "allow *", 2023-12-12T09:45:18.967 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": "allow *", 2023-12-12T09:45:18.967 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": "allow *" 2023-12-12T09:45:18.967 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-12-12T09:45:18.967 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-12-12T09:45:18.968 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-12-12T09:45:18.968 INFO:teuthology.orchestra.run.smithi073.stdout: "entity": "mds.d", 2023-12-12T09:45:18.968 INFO:teuthology.orchestra.run.smithi073.stdout: "key": "AQD+Knhl2IWUNhAA0/c8VA4L8iJXGUmjQ0Y6Tw==", 2023-12-12T09:45:18.968 INFO:teuthology.orchestra.run.smithi073.stdout: "caps": { 2023-12-12T09:45:18.968 INFO:teuthology.orchestra.run.smithi073.stdout: "mds": "allow", 2023-12-12T09:45:18.968 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr": "allow *", 2023-12-12T09:45:18.968 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": "allow *", 2023-12-12T09:45:18.968 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": "allow *" 2023-12-12T09:45:18.968 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-12-12T09:45:18.968 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-12-12T09:45:18.968 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-12-12T09:45:18.968 INFO:teuthology.orchestra.run.smithi073.stdout: "entity": "osd.0", 2023-12-12T09:45:18.968 INFO:teuthology.orchestra.run.smithi073.stdout: "key": "AQADK3hlOX7MFBAAOOzt4ZXOGwlGwyySWJgz4Q==", 2023-12-12T09:45:18.968 INFO:teuthology.orchestra.run.smithi073.stdout: "caps": { 2023-12-12T09:45:18.968 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr": "allow profile osd", 2023-12-12T09:45:18.968 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": "allow profile osd", 2023-12-12T09:45:18.969 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": "allow *" 2023-12-12T09:45:18.969 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-12-12T09:45:18.969 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-12-12T09:45:18.969 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-12-12T09:45:18.969 INFO:teuthology.orchestra.run.smithi073.stdout: "entity": "osd.1", 2023-12-12T09:45:18.969 INFO:teuthology.orchestra.run.smithi073.stdout: "key": "AQAGK3hl+zgiLhAAO2mzDGz2F88weMdDaHYN9w==", 2023-12-12T09:45:18.969 INFO:teuthology.orchestra.run.smithi073.stdout: "caps": { 2023-12-12T09:45:18.969 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr": "allow profile osd", 2023-12-12T09:45:18.969 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": "allow profile osd", 2023-12-12T09:45:18.969 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": "allow *" 2023-12-12T09:45:18.969 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-12-12T09:45:18.969 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-12-12T09:45:18.969 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-12-12T09:45:18.969 INFO:teuthology.orchestra.run.smithi073.stdout: "entity": "osd.2", 2023-12-12T09:45:18.970 INFO:teuthology.orchestra.run.smithi073.stdout: "key": "AQAJK3hlRjtuOBAAmRB8r8bmB4W8yfGT+XaT8A==", 2023-12-12T09:45:18.970 INFO:teuthology.orchestra.run.smithi073.stdout: "caps": { 2023-12-12T09:45:18.970 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr": "allow profile osd", 2023-12-12T09:45:18.970 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": "allow profile osd", 2023-12-12T09:45:18.970 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": "allow *" 2023-12-12T09:45:18.970 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-12-12T09:45:18.970 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-12-12T09:45:18.970 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-12-12T09:45:18.970 INFO:teuthology.orchestra.run.smithi073.stdout: "entity": "osd.3", 2023-12-12T09:45:18.970 INFO:teuthology.orchestra.run.smithi073.stdout: "key": "AQANK3hlmDDlBhAAGk3Yf40DqtpTTcDlbCsnCg==", 2023-12-12T09:45:18.970 INFO:teuthology.orchestra.run.smithi073.stdout: "caps": { 2023-12-12T09:45:18.970 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr": "allow profile osd", 2023-12-12T09:45:18.970 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": "allow profile osd", 2023-12-12T09:45:18.970 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": "allow *" 2023-12-12T09:45:18.970 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-12-12T09:45:18.971 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-12-12T09:45:18.971 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-12-12T09:45:18.971 INFO:teuthology.orchestra.run.smithi073.stdout: "entity": "osd.4", 2023-12-12T09:45:18.971 INFO:teuthology.orchestra.run.smithi073.stdout: "key": "AQAUK3hlQqQlBBAALgzKsaHojYauYpl7vx86uQ==", 2023-12-12T09:45:18.971 INFO:teuthology.orchestra.run.smithi073.stdout: "caps": { 2023-12-12T09:45:18.971 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr": "allow profile osd", 2023-12-12T09:45:18.971 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": "allow profile osd", 2023-12-12T09:45:18.971 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": "allow *" 2023-12-12T09:45:18.971 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-12-12T09:45:18.971 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-12-12T09:45:18.971 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-12-12T09:45:18.971 INFO:teuthology.orchestra.run.smithi073.stdout: "entity": "osd.5", 2023-12-12T09:45:18.971 INFO:teuthology.orchestra.run.smithi073.stdout: "key": "AQAXK3hl2/oEHRAAQKg28eQUCVyqKo7+mE1mpA==", 2023-12-12T09:45:18.971 INFO:teuthology.orchestra.run.smithi073.stdout: "caps": { 2023-12-12T09:45:18.972 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr": "allow profile osd", 2023-12-12T09:45:18.972 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": "allow profile osd", 2023-12-12T09:45:18.972 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": "allow *" 2023-12-12T09:45:18.972 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-12-12T09:45:18.972 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-12-12T09:45:18.972 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-12-12T09:45:18.972 INFO:teuthology.orchestra.run.smithi073.stdout: "entity": "osd.6", 2023-12-12T09:45:18.972 INFO:teuthology.orchestra.run.smithi073.stdout: "key": "AQAaK3hleownKBAADG0Bq08cGxCwBfMPkR30pg==", 2023-12-12T09:45:18.972 INFO:teuthology.orchestra.run.smithi073.stdout: "caps": { 2023-12-12T09:45:18.972 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr": "allow profile osd", 2023-12-12T09:45:18.972 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": "allow profile osd", 2023-12-12T09:45:18.972 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": "allow *" 2023-12-12T09:45:18.972 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-12-12T09:45:18.972 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-12-12T09:45:18.972 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-12-12T09:45:18.973 INFO:teuthology.orchestra.run.smithi073.stdout: "entity": "osd.7", 2023-12-12T09:45:18.973 INFO:teuthology.orchestra.run.smithi073.stdout: "key": "AQAdK3hlqOPJMhAAF/cz3Xce+skpwDFCsb+8BQ==", 2023-12-12T09:45:18.973 INFO:teuthology.orchestra.run.smithi073.stdout: "caps": { 2023-12-12T09:45:18.973 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr": "allow profile osd", 2023-12-12T09:45:18.973 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": "allow profile osd", 2023-12-12T09:45:18.973 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": "allow *" 2023-12-12T09:45:18.973 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-12-12T09:45:18.973 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-12-12T09:45:18.973 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-12-12T09:45:18.973 INFO:teuthology.orchestra.run.smithi073.stdout: "entity": "client.0", 2023-12-12T09:45:18.973 INFO:teuthology.orchestra.run.smithi073.stdout: "key": "AQD/Knhl/4KuBxAAdAlGb7dYkXXlgPJp0Qcecg==", 2023-12-12T09:45:18.973 INFO:teuthology.orchestra.run.smithi073.stdout: "caps": { 2023-12-12T09:45:18.973 INFO:teuthology.orchestra.run.smithi073.stdout: "mds": "allow", 2023-12-12T09:45:18.973 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": "allow r", 2023-12-12T09:45:18.973 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-12-12T09:45:18.974 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-12-12T09:45:18.974 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-12-12T09:45:18.974 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-12-12T09:45:18.974 INFO:teuthology.orchestra.run.smithi073.stdout: "entity": "client.1", 2023-12-12T09:45:18.974 INFO:teuthology.orchestra.run.smithi073.stdout: "key": "AQD/KnhlLq6aERAAgTQwqvltAggkGpb77Zngsg==", 2023-12-12T09:45:18.974 INFO:teuthology.orchestra.run.smithi073.stdout: "caps": { 2023-12-12T09:45:18.974 INFO:teuthology.orchestra.run.smithi073.stdout: "mds": "allow", 2023-12-12T09:45:18.974 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": "allow r", 2023-12-12T09:45:18.974 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": "allow rw pool=cephfs2_data" 2023-12-12T09:45:18.974 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-12-12T09:45:18.974 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-12-12T09:45:18.974 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-12-12T09:45:18.974 INFO:teuthology.orchestra.run.smithi073.stdout: "entity": "client.admin", 2023-12-12T09:45:18.974 INFO:teuthology.orchestra.run.smithi073.stdout: "key": "AQD8KnhlpfsBOBAAE2SZE5bav1875HDrdGXBDQ==", 2023-12-12T09:45:18.974 INFO:teuthology.orchestra.run.smithi073.stdout: "caps": { 2023-12-12T09:45:18.975 INFO:teuthology.orchestra.run.smithi073.stdout: "mds": "allow *", 2023-12-12T09:45:18.975 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr": "allow *", 2023-12-12T09:45:18.975 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": "allow *", 2023-12-12T09:45:18.975 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": "allow *" 2023-12-12T09:45:18.975 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-12-12T09:45:18.975 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-12-12T09:45:18.975 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-12-12T09:45:18.975 INFO:teuthology.orchestra.run.smithi073.stdout: "entity": "client.testuser", 2023-12-12T09:45:18.975 INFO:teuthology.orchestra.run.smithi073.stdout: "key": "AQCPK3hlZNaVIxAA196SzaOrmMbcymy0Qh6b2w==", 2023-12-12T09:45:18.975 INFO:teuthology.orchestra.run.smithi073.stdout: "caps": { 2023-12-12T09:45:18.975 INFO:teuthology.orchestra.run.smithi073.stdout: "mds": "allow rw fsname=cephfs", 2023-12-12T09:45:18.975 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": "allow r fsname=cephfs", 2023-12-12T09:45:18.975 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-12-12T09:45:18.975 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-12-12T09:45:18.975 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-12-12T09:45:18.976 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-12-12T09:45:18.976 INFO:teuthology.orchestra.run.smithi073.stdout: "entity": "mgr.x", 2023-12-12T09:45:18.976 INFO:teuthology.orchestra.run.smithi073.stdout: "key": "AQD9Knhls5L9NxAAQ8z4BOLLDQvKzZhSGc7oCg==", 2023-12-12T09:45:18.976 INFO:teuthology.orchestra.run.smithi073.stdout: "caps": { 2023-12-12T09:45:18.976 INFO:teuthology.orchestra.run.smithi073.stdout: "mds": "allow *", 2023-12-12T09:45:18.976 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": "allow profile mgr", 2023-12-12T09:45:18.976 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": "allow *" 2023-12-12T09:45:18.976 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-12-12T09:45:18.976 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-12-12T09:45:18.976 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-12-12T09:45:18.976 INFO:teuthology.orchestra.run.smithi073.stdout: "entity": "mgr.y", 2023-12-12T09:45:18.976 INFO:teuthology.orchestra.run.smithi073.stdout: "key": "AQD9KnhlWTNgKxAAmpMhLYOvVwJkRPAEtHSQAg==", 2023-12-12T09:45:18.976 INFO:teuthology.orchestra.run.smithi073.stdout: "caps": { 2023-12-12T09:45:18.976 INFO:teuthology.orchestra.run.smithi073.stdout: "mds": "allow *", 2023-12-12T09:45:18.976 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": "allow profile mgr", 2023-12-12T09:45:18.977 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": "allow *" 2023-12-12T09:45:18.977 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-12-12T09:45:18.977 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-12-12T09:45:18.977 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-12-12T09:45:18.977 INFO:teuthology.orchestra.run.smithi073.stdout:} 2023-12-12T09:45:18.978 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:18.966+0000 7efd14b01640 1 -- 172.21.15.73:0/4074206541 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7efcf006ae40 msgr2=0x7efcf006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:18.978 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:18.966+0000 7efd14b01640 1 --2- 172.21.15.73:0/4074206541 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7efcf006ae40 0x7efcf006d300 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7efcf8036000 tx=0x7efcf803c040 comp rx=0 tx=0).stop 2023-12-12T09:45:18.978 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:18.966+0000 7efd14b01640 1 -- 172.21.15.73:0/4074206541 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efd1006db70 msgr2=0x7efd101537e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:18.979 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:18.966+0000 7efd14b01640 1 --2- 172.21.15.73:0/4074206541 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efd1006db70 0x7efd101537e0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7efd0000e9b0 tx=0x7efd0000ee70 comp rx=0 tx=0).stop 2023-12-12T09:45:18.979 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:18.966+0000 7efd14b01640 1 -- 172.21.15.73:0/4074206541 shutdown_connections 2023-12-12T09:45:18.979 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:18.966+0000 7efd14b01640 1 --2- 172.21.15.73:0/4074206541 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7efcf006ae40 0x7efcf006d300 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:18.979 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:18.966+0000 7efd14b01640 1 --2- 172.21.15.73:0/4074206541 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efd1014fa40 0x7efd1014acb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:18.979 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:18.966+0000 7efd14b01640 1 --2- 172.21.15.73:0/4074206541 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efd100c5070 0x7efd101e7c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:18.979 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:18.966+0000 7efd14b01640 1 --2- 172.21.15.73:0/4074206541 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efd1006db70 0x7efd101537e0 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:18.979 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:18.966+0000 7efd14b01640 1 -- 172.21.15.73:0/4074206541 >> 172.21.15.73:0/4074206541 conn(0x7efd100a8130 msgr2=0x7efd100a5820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:45:18.979 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:18.967+0000 7efd14b01640 1 -- 172.21.15.73:0/4074206541 shutdown_connections 2023-12-12T09:45:18.979 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:18.967+0000 7efd14b01640 1 -- 172.21.15.73:0/4074206541 wait complete. 2023-12-12T09:45:18.986 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.testuser 2023-12-12T09:45:19.190 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:19.188+0000 7f3ce1975640 1 Processor -- start 2023-12-12T09:45:19.190 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:19.188+0000 7f3ce1975640 1 -- start start 2023-12-12T09:45:19.194 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:19.189+0000 7f3ce1975640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3cdc0aae70 0x7f3cdc14f2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:19.194 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:19.189+0000 7f3ce1975640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f3cdc0a4c90 0x7f3cdc14f7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:19.194 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:19.189+0000 7f3ce1975640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f3cdc0c3740 0x7f3cdc0c3bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:19.194 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:19.189+0000 7f3ce1975640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3cdc06c3f0 con 0x7f3cdc0a4c90 2023-12-12T09:45:19.194 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:19.189+0000 7f3ce1975640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3cdc152240 con 0x7f3cdc0c3740 2023-12-12T09:45:19.194 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:19.189+0000 7f3ce1975640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3cdc152520 con 0x7f3cdc0aae70 2023-12-12T09:45:19.194 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:19.190+0000 7f3cdbfff640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f3cdc0a4c90 0x7f3cdc14f7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:19.195 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:19.190+0000 7f3cdbfff640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f3cdc0a4c90 0x7f3cdc14f7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:45160/0 (socket says 172.21.15.73:45160) 2023-12-12T09:45:19.195 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:19.190+0000 7f3cdbfff640 1 -- 172.21.15.73:0/518285213 learned_addr learned my addr 172.21.15.73:0/518285213 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:45:19.195 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:19.190+0000 7f3cdbfff640 1 -- 172.21.15.73:0/518285213 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3cdc0aae70 msgr2=0x7f3cdc14f2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:45:19.195 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:19.190+0000 7f3cdbfff640 1 --2- 172.21.15.73:0/518285213 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3cdc0aae70 0x7f3cdc14f2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:19.195 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:19.190+0000 7f3cdbfff640 1 -- 172.21.15.73:0/518285213 >> v2:172.21.15.142:3300/0 conn(0x7f3cdc0c3740 msgr2=0x7f3cdc0c3bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:45:19.195 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:19.190+0000 7f3cdbfff640 1 --2- 172.21.15.73:0/518285213 >> v2:172.21.15.142:3300/0 conn(0x7f3cdc0c3740 0x7f3cdc0c3bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:19.195 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:19.190+0000 7f3cdbfff640 1 -- 172.21.15.73:0/518285213 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cdc152800 con 0x7f3cdc0a4c90 2023-12-12T09:45:19.195 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:19.191+0000 7f3cdbfff640 1 --2- 172.21.15.73:0/518285213 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3cdc0a4c90 0x7f3cdc14f7f0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f3cdc0a89a0 tx=0x7f3cc802b7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea2ed7c829f97a29 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:45:19.196 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:19.191+0000 7f3cdb7fe640 1 -- 172.21.15.73:0/518285213 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cc8031750 con 0x7f3cdc0a4c90 2023-12-12T09:45:19.196 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:19.192+0000 7f3cdb7fe640 1 -- 172.21.15.73:0/518285213 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3cc80318b0 con 0x7f3cdc0a4c90 2023-12-12T09:45:19.196 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:19.192+0000 7f3cdb7fe640 1 -- 172.21.15.73:0/518285213 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cc8031c40 con 0x7f3cdc0a4c90 2023-12-12T09:45:19.196 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:19.192+0000 7f3ce1975640 1 -- 172.21.15.73:0/518285213 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3cdc0a4c90 msgr2=0x7f3cdc14f7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:19.196 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:19.192+0000 7f3ce1975640 1 --2- 172.21.15.73:0/518285213 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3cdc0a4c90 0x7f3cdc14f7f0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f3cdc0a89a0 tx=0x7f3cc802b7f0 comp rx=0 tx=0).stop 2023-12-12T09:45:19.196 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:19.192+0000 7f3ce1975640 1 -- 172.21.15.73:0/518285213 shutdown_connections 2023-12-12T09:45:19.196 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:19.192+0000 7f3ce1975640 1 --2- 172.21.15.73:0/518285213 >> v2:172.21.15.142:3300/0 conn(0x7f3cdc0c3740 0x7f3cdc0c3bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:19.197 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:19.192+0000 7f3ce1975640 1 --2- 172.21.15.73:0/518285213 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3cdc0a4c90 0x7f3cdc14f7f0 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:19.197 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:19.192+0000 7f3ce1975640 1 --2- 172.21.15.73:0/518285213 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3cdc0aae70 0x7f3cdc14f2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:19.197 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:19.192+0000 7f3ce1975640 1 -- 172.21.15.73:0/518285213 >> 172.21.15.73:0/518285213 conn(0x7f3cdc0a75f0 msgr2=0x7f3cdc0a7a00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:45:19.197 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:19.192+0000 7f3ce1975640 1 -- 172.21.15.73:0/518285213 shutdown_connections 2023-12-12T09:45:19.197 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:19.192+0000 7f3ce1975640 1 -- 172.21.15.73:0/518285213 wait complete. 2023-12-12T09:45:19.200 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:19.194+0000 7f3ce1975640 1 Processor -- start 2023-12-12T09:45:19.201 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:19.194+0000 7f3ce1975640 1 -- start start 2023-12-12T09:45:19.201 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:19.195+0000 7f3ce1975640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3cdc0a4c90 0x7f3cdc1ea910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:19.201 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:19.195+0000 7f3ce1975640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3cdc0aae70 0x7f3cdc14c330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:19.201 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:19.195+0000 7f3ce1975640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3cdc0c3740 0x7f3cdc155770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:19.201 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:19.195+0000 7f3ce1975640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cdc14aac0 con 0x7f3cdc0c3740 2023-12-12T09:45:19.201 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:19.195+0000 7f3ce1975640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cdc072850 con 0x7f3cdc0a4c90 2023-12-12T09:45:19.201 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:19.195+0000 7f3ce1975640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3cdc149a20 con 0x7f3cdc0aae70 2023-12-12T09:45:19.201 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:19.195+0000 7f3ce1174640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3cdc0c3740 0x7f3cdc155770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:19.202 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:19.195+0000 7f3ce1174640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3cdc0c3740 0x7f3cdc155770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:45172/0 (socket says 172.21.15.73:45172) 2023-12-12T09:45:19.202 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:19.195+0000 7f3ce1174640 1 -- 172.21.15.73:0/3965491305 learned_addr learned my addr 172.21.15.73:0/3965491305 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:45:19.202 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:19.196+0000 7f3ce1174640 1 -- 172.21.15.73:0/3965491305 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3cdc0aae70 msgr2=0x7f3cdc14c330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:19.202 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:19.196+0000 7f3ce1174640 1 --2- 172.21.15.73:0/3965491305 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3cdc0aae70 0x7f3cdc14c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:19.202 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:19.196+0000 7f3ce1174640 1 -- 172.21.15.73:0/3965491305 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3cdc0a4c90 msgr2=0x7f3cdc1ea910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:19.202 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:19.196+0000 7f3ce0973640 1 --2- 172.21.15.73:0/3965491305 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3cdc0a4c90 0x7f3cdc1ea910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:19.202 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:19.196+0000 7f3ce1174640 1 --2- 172.21.15.73:0/3965491305 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3cdc0a4c90 0x7f3cdc1ea910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:19.202 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:19.196+0000 7f3ce1174640 1 -- 172.21.15.73:0/3965491305 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cc80094d0 con 0x7f3cdc0c3740 2023-12-12T09:45:19.202 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:19.196+0000 7f3ce1174640 1 --2- 172.21.15.73:0/3965491305 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3cdc0c3740 0x7f3cdc155770 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f3cd400b970 tx=0x7f3cd400be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:45:19.202 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:19.196+0000 7f3cd97fa640 1 -- 172.21.15.73:0/3965491305 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cd400cb40 con 0x7f3cdc0c3740 2023-12-12T09:45:19.202 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:19.196+0000 7f3cd97fa640 1 -- 172.21.15.73:0/3965491305 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3cd400ccc0 con 0x7f3cdc0c3740 2023-12-12T09:45:19.202 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:19.196+0000 7f3cd97fa640 1 -- 172.21.15.73:0/3965491305 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cd4014680 con 0x7f3cdc0c3740 2023-12-12T09:45:19.202 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:19.196+0000 7f3ce1975640 1 -- 172.21.15.73:0/3965491305 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3cdc149d00 con 0x7f3cdc0c3740 2023-12-12T09:45:19.202 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:19.196+0000 7f3ce1975640 1 -- 172.21.15.73:0/3965491305 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3cdc14a2c0 con 0x7f3cdc0c3740 2023-12-12T09:45:19.203 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:19.198+0000 7f3ce1975640 1 -- 172.21.15.73:0/3965491305 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3cdc06c030 con 0x7f3cdc0c3740 2023-12-12T09:45:19.203 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:19.198+0000 7f3cd97fa640 1 -- 172.21.15.73:0/3965491305 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f3cd401d3b0 con 0x7f3cdc0c3740 2023-12-12T09:45:19.203 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:19.200+0000 7f3cd97fa640 1 --2- 172.21.15.73:0/3965491305 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f3cc006ae40 0x7f3cc006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:19.203 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:19.200+0000 7f3cd97fa640 1 -- 172.21.15.73:0/3965491305 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f3cd40891c0 con 0x7f3cdc0c3740 2023-12-12T09:45:19.203 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:19.200+0000 7f3ce0973640 1 --2- 172.21.15.73:0/3965491305 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f3cc006ae40 0x7f3cc006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:19.204 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:19.201+0000 7f3ce0973640 1 --2- 172.21.15.73:0/3965491305 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f3cc006ae40 0x7f3cc006d300 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f3cd000a770 tx=0x7f3cd0008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:45:19.205 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:19.204+0000 7f3cd97fa640 1 -- 172.21.15.73:0/3965491305 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f3cd40580e0 con 0x7f3cdc0c3740 2023-12-12T09:45:19.467 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:19.465+0000 7f3ce1975640 1 -- 172.21.15.73:0/3965491305 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.testuser"} v 0) v1 -- 0x7f3cdc067400 con 0x7f3cdc0c3740 2023-12-12T09:45:19.473 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:19.472+0000 7f3cd97fa640 1 -- 172.21.15.73:0/3965491305 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.testuser"}]=0 v14) v1 ==== 85+0+0 (secure 0 0 0) 0x7f3cd4087e60 con 0x7f3cdc0c3740 2023-12-12T09:45:19.476 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:19.475+0000 7f3ce1975640 1 -- 172.21.15.73:0/3965491305 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f3cc006ae40 msgr2=0x7f3cc006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:19.476 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:19.475+0000 7f3ce1975640 1 --2- 172.21.15.73:0/3965491305 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f3cc006ae40 0x7f3cc006d300 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f3cd000a770 tx=0x7f3cd0008040 comp rx=0 tx=0).stop 2023-12-12T09:45:19.476 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:19.475+0000 7f3ce1975640 1 -- 172.21.15.73:0/3965491305 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3cdc0c3740 msgr2=0x7f3cdc155770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:19.476 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:19.475+0000 7f3ce1975640 1 --2- 172.21.15.73:0/3965491305 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3cdc0c3740 0x7f3cdc155770 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f3cd400b970 tx=0x7f3cd400be30 comp rx=0 tx=0).stop 2023-12-12T09:45:19.477 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:19.475+0000 7f3ce1975640 1 -- 172.21.15.73:0/3965491305 shutdown_connections 2023-12-12T09:45:19.477 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:19.475+0000 7f3ce1975640 1 --2- 172.21.15.73:0/3965491305 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f3cc006ae40 0x7f3cc006d300 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:19.477 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:19.475+0000 7f3ce1975640 1 --2- 172.21.15.73:0/3965491305 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3cdc0c3740 0x7f3cdc155770 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:19.477 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:19.475+0000 7f3ce1975640 1 --2- 172.21.15.73:0/3965491305 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3cdc0aae70 0x7f3cdc14c330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:19.477 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:19.475+0000 7f3ce1975640 1 --2- 172.21.15.73:0/3965491305 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3cdc0a4c90 0x7f3cdc1ea910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:19.477 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:19.475+0000 7f3ce1975640 1 -- 172.21.15.73:0/3965491305 >> 172.21.15.73:0/3965491305 conn(0x7f3cdc0a75f0 msgr2=0x7f3cdc1dd590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:45:19.477 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:19.475+0000 7f3ce1975640 1 -- 172.21.15.73:0/3965491305 shutdown_connections 2023-12-12T09:45:19.477 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:19.475+0000 7f3ce1975640 1 -- 172.21.15.73:0/3965491305 wait complete. 2023-12-12T09:45:19.497 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-12T09:45:19.699 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:19.697+0000 7f325e2e0640 1 Processor -- start 2023-12-12T09:45:19.699 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:19.698+0000 7f325e2e0640 1 -- start start 2023-12-12T09:45:19.702 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:19.699+0000 7f325e2e0640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f32580a6150 0x7f3258151ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:19.702 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:19.699+0000 7f325e2e0640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32580c2ba0 con 0x7f3258152020 2023-12-12T09:45:19.702 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:19.699+0000 7f325e2e0640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3258151300 con 0x7f3258071e20 2023-12-12T09:45:19.702 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:19.699+0000 7f325e2e0640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32580c2e40 con 0x7f32580a6150 2023-12-12T09:45:19.702 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:19.699+0000 7f32577fe640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f3258152020 0x7f32580722c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:35042/0 (socket says 172.21.15.73:35042) 2023-12-12T09:45:19.703 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:19.699+0000 7f32577fe640 1 -- 172.21.15.73:0/80904022 learned_addr learned my addr 172.21.15.73:0/80904022 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-12T09:45:19.703 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:19.700+0000 7f3256ffd640 1 -- 172.21.15.73:0/80904022 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3689904499 0 0) 0x7f32580c2ba0 con 0x7f3258152020 2023-12-12T09:45:19.703 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:19.700+0000 7f3257fff640 1 --2- 172.21.15.73:0/80904022 >> v2:172.21.15.142:3300/0 conn(0x7f32580a6150 0x7f3258151ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:19.703 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:19.700+0000 7f3256ffd640 1 -- 172.21.15.73:0/80904022 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3244005730 con 0x7f3258152020 2023-12-12T09:45:19.703 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:19.700+0000 7f3256ffd640 1 -- 172.21.15.73:0/80904022 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 201854942 0 0) 0x7f3244005730 con 0x7f3258152020 2023-12-12T09:45:19.703 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:19.700+0000 7f3256ffd640 1 -- 172.21.15.73:0/80904022 >> v2:172.21.15.142:3300/0 conn(0x7f32580a6150 msgr2=0x7f3258151ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:45:19.703 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:19.700+0000 7f3256ffd640 1 --2- 172.21.15.73:0/80904022 >> v2:172.21.15.142:3300/0 conn(0x7f32580a6150 0x7f3258151ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:19.703 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:19.700+0000 7f3256ffd640 1 -- 172.21.15.73:0/80904022 >> v1:172.21.15.142:6789/0 conn(0x7f3258071e20 legacy=0x7f32580c30f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:45:19.703 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:19.700+0000 7f3256ffd640 1 -- 172.21.15.73:0/80904022 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3258155320 con 0x7f3258152020 2023-12-12T09:45:19.703 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:19.700+0000 7f3256ffd640 1 -- 172.21.15.73:0/80904022 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3186547832 0 0) 0x7f3240001670 con 0x7f3258152020 2023-12-12T09:45:19.703 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:19.700+0000 7f3256ffd640 1 -- 172.21.15.73:0/80904022 >> v1:172.21.15.73:6789/0 conn(0x7f3258152020 legacy=0x7f32580722c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:19.703 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:19.700+0000 7f3256ffd640 1 --2- 172.21.15.73:0/80904022 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3244005b80 0x7f3244005f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:19.703 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:19.700+0000 7f3256ffd640 1 --2- 172.21.15.73:0/80904022 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f32440069d0 0x7f3244006e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:19.704 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:19.700+0000 7f3256ffd640 1 --2- 172.21.15.73:0/80904022 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f32440074b0 0x7f324400db90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:19.704 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:19.700+0000 7f3256ffd640 1 -- 172.21.15.73:0/80904022 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32580c2e40 con 0x7f32440074b0 2023-12-12T09:45:19.704 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:19.700+0000 7f3256ffd640 1 -- 172.21.15.73:0/80904022 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f324400e360 con 0x7f32440069d0 2023-12-12T09:45:19.704 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:19.700+0000 7f3256ffd640 1 -- 172.21.15.73:0/80904022 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f324400e520 con 0x7f3244005b80 2023-12-12T09:45:19.704 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:19.701+0000 7f325c87d640 1 --2- 172.21.15.73:0/80904022 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f32440074b0 0x7f324400db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:19.704 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:19.701+0000 7f32577fe640 1 --2- 172.21.15.73:0/80904022 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f32440069d0 0x7f3244006e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:19.704 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:19.701+0000 7f3257fff640 1 --2- 172.21.15.73:0/80904022 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3244005b80 0x7f3244005f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:19.705 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:19.701+0000 7f325c87d640 1 -- 172.21.15.73:0/80904022 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3244005b80 msgr2=0x7f3244005f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:45:19.706 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:19.701+0000 7f325c87d640 1 --2- 172.21.15.73:0/80904022 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3244005b80 0x7f3244005f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:19.706 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:19.701+0000 7f325c87d640 1 -- 172.21.15.73:0/80904022 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f32440069d0 msgr2=0x7f3244006e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:45:19.706 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:19.701+0000 7f325c87d640 1 --2- 172.21.15.73:0/80904022 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f32440069d0 0x7f3244006e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:19.706 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:19.701+0000 7f325c87d640 1 -- 172.21.15.73:0/80904022 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3244005730 con 0x7f32440074b0 2023-12-12T09:45:19.706 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:19.702+0000 7f325c87d640 1 -- 172.21.15.73:0/80904022 reap_dead start 2023-12-12T09:45:19.706 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:19.703+0000 7f325c87d640 1 --2- 172.21.15.73:0/80904022 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f32440074b0 0x7f324400db90 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f3250003d80 tx=0x7f3244007a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c690205da63c8fb1 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:45:19.706 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:19.703+0000 7f3256ffd640 1 -- 172.21.15.73:0/80904022 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3250007220 con 0x7f32440074b0 2023-12-12T09:45:19.706 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:19.703+0000 7f3256ffd640 1 -- 172.21.15.73:0/80904022 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f325002e050 con 0x7f32440074b0 2023-12-12T09:45:19.706 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:19.703+0000 7f3256ffd640 1 -- 172.21.15.73:0/80904022 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32500075e0 con 0x7f32440074b0 2023-12-12T09:45:19.706 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:19.704+0000 7f325e2e0640 1 -- 172.21.15.73:0/80904022 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f32440074b0 msgr2=0x7f324400db90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:19.706 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:19.704+0000 7f325e2e0640 1 --2- 172.21.15.73:0/80904022 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f32440074b0 0x7f324400db90 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f3250003d80 tx=0x7f3244007a00 comp rx=0 tx=0).stop 2023-12-12T09:45:19.707 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:19.704+0000 7f325e2e0640 1 -- 172.21.15.73:0/80904022 shutdown_connections 2023-12-12T09:45:19.707 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:19.704+0000 7f325e2e0640 1 --2- 172.21.15.73:0/80904022 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f32440074b0 0x7f324400db90 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:19.707 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:19.704+0000 7f325e2e0640 1 -- 172.21.15.73:0/80904022 >> 172.21.15.73:0/80904022 conn(0x7f325806d590 msgr2=0x7f325806b5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:45:19.707 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:19.704+0000 7f325e2e0640 1 -- 172.21.15.73:0/80904022 shutdown_connections 2023-12-12T09:45:19.707 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:19.704+0000 7f325e2e0640 1 -- 172.21.15.73:0/80904022 wait complete. 2023-12-12T09:45:19.707 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:19.706+0000 7f325e2e0640 1 Processor -- start 2023-12-12T09:45:19.707 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:19.706+0000 7f325e2e0640 1 -- start start 2023-12-12T09:45:19.710 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:19.707+0000 7f325e2e0640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f32440074b0 0x7f32580a99e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:19.710 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:19.707+0000 7f325e2e0640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f32581e9280 0x7f32580a7c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:19.710 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:19.707+0000 7f325e2e0640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f325814b9d0 0x7f325814be50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:19.710 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:19.707+0000 7f325e2e0640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32580bc070 con 0x7f325814b9d0 2023-12-12T09:45:19.710 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:19.707+0000 7f325e2e0640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32580a77e0 con 0x7f32581e9280 2023-12-12T09:45:19.710 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:19.707+0000 7f325e2e0640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32580a7500 con 0x7f32440074b0 2023-12-12T09:45:19.710 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:19.707+0000 7f325c87d640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f325814b9d0 0x7f325814be50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:19.710 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:19.707+0000 7f325c87d640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f325814b9d0 0x7f325814be50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:45200/0 (socket says 172.21.15.73:45200) 2023-12-12T09:45:19.710 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:19.707+0000 7f325c87d640 1 -- 172.21.15.73:0/2360027443 learned_addr learned my addr 172.21.15.73:0/2360027443 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:45:19.711 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:19.707+0000 7f3257fff640 1 --2- 172.21.15.73:0/2360027443 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f32440074b0 0x7f32580a99e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:19.711 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:19.707+0000 7f32577fe640 1 --2- 172.21.15.73:0/2360027443 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f32581e9280 0x7f32580a7c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:19.711 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:19.707+0000 7f325c87d640 1 -- 172.21.15.73:0/2360027443 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f32440074b0 msgr2=0x7f32580a99e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:19.711 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:19.707+0000 7f325c87d640 1 --2- 172.21.15.73:0/2360027443 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f32440074b0 0x7f32580a99e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:19.711 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:19.707+0000 7f325c87d640 1 -- 172.21.15.73:0/2360027443 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f32581e9280 msgr2=0x7f32580a7c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:19.711 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:19.707+0000 7f325c87d640 1 --2- 172.21.15.73:0/2360027443 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f32581e9280 0x7f32580a7c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:19.711 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:19.707+0000 7f325c87d640 1 -- 172.21.15.73:0/2360027443 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3258150350 con 0x7f325814b9d0 2023-12-12T09:45:19.711 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:19.708+0000 7f325c87d640 1 --2- 172.21.15.73:0/2360027443 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f325814b9d0 0x7f325814be50 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f3250003ea0 tx=0x7f32500036f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:45:19.711 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:19.708+0000 7f3254ff9640 1 -- 172.21.15.73:0/2360027443 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3250006ea0 con 0x7f325814b9d0 2023-12-12T09:45:19.711 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:19.708+0000 7f3254ff9640 1 -- 172.21.15.73:0/2360027443 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f325003e470 con 0x7f325814b9d0 2023-12-12T09:45:19.711 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:19.708+0000 7f325e2e0640 1 -- 172.21.15.73:0/2360027443 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32581505f0 con 0x7f325814b9d0 2023-12-12T09:45:19.712 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:19.708+0000 7f3254ff9640 1 -- 172.21.15.73:0/2360027443 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f325003e820 con 0x7f325814b9d0 2023-12-12T09:45:19.712 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:19.708+0000 7f325e2e0640 1 -- 172.21.15.73:0/2360027443 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32581e9da0 con 0x7f325814b9d0 2023-12-12T09:45:19.712 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:19.709+0000 7f325e2e0640 1 -- 172.21.15.73:0/2360027443 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f32580a7990 con 0x7f325814b9d0 2023-12-12T09:45:19.712 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:19.710+0000 7f3254ff9640 1 -- 172.21.15.73:0/2360027443 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f325003e980 con 0x7f325814b9d0 2023-12-12T09:45:19.713 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:19.711+0000 7f3254ff9640 1 --2- 172.21.15.73:0/2360027443 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f323806ae70 0x7f323806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:19.713 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:19.711+0000 7f3254ff9640 1 -- 172.21.15.73:0/2360027443 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f32500aaff0 con 0x7f325814b9d0 2023-12-12T09:45:19.713 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:19.711+0000 7f3257fff640 1 --2- 172.21.15.73:0/2360027443 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f323806ae70 0x7f323806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:19.713 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:19.712+0000 7f3257fff640 1 --2- 172.21.15.73:0/2360027443 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f323806ae70 0x7f323806d330 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f32480041e0 tx=0x7f324800b040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:45:19.716 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:19.715+0000 7f3254ff9640 1 -- 172.21.15.73:0/2360027443 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f32580a7990 con 0x7f325814b9d0 2023-12-12T09:45:19.908 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:19.906+0000 7f325e2e0640 1 -- 172.21.15.73:0/2360027443 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f32580a7990 con 0x7f325814b9d0 2023-12-12T09:45:19.909 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:19.908+0000 7f3254ff9640 1 -- 172.21.15.73:0/2360027443 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v50) v1 ==== 74+0+12869 (secure 0 0 0) 0x7f32580a7990 con 0x7f325814b9d0 2023-12-12T09:45:19.909 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-12T09:45:19.909 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":50,"fsid":"ba240992-02b8-4c7e-92f2-27eb29ac433b","created":"2023-12-12T09:43:02.454719+0000","modified":"2023-12-12T09:45:18.478439+0000","last_up_change":"2023-12-12T09:43:13.913440+0000","last_in_change":"2023-12-12T09:43:05.925348+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-12T09:43:15.525508+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"dd9074be-dbe2-4c34-9896-a4223d8d3940","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":4047810203},{"type":"v1","addr":"172.21.15.73:6801","nonce":4047810203}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":4047810203},{"type":"v1","addr":"172.21.15.73:6803","nonce":4047810203}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":4047810203},{"type":"v1","addr":"172.21.15.73:6807","nonce":4047810203}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":4047810203},{"type":"v1","addr":"172.21.15.73:6805","nonce":4047810203}]},"public_addr":"172.21.15.73:6801/4047810203","cluster_addr":"172.21.15.73:6803/4047810203","heartbeat_back_addr":"172.21.15.73:6807/4047810203","heartbeat_front_addr":"172.21.15.73:6805/4047810203","state":["exists","up"]},{"osd":1,"uuid":"c4a05052-96d4-4758-a4e1-1a37f1e07fed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":1356058331},{"type":"v1","addr":"172.21.15.73:6824","nonce":1356058331}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":1356058331},{"type":"v1","addr":"172.21.15.73:6827","nonce":1356058331}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":1356058331},{"type":"v1","addr":"172.21.15.73:6831","nonce":1356058331}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":1356058331},{"type":"v1","addr":"172.21.15.73:6829","nonce":1356058331}]},"public_addr":"172.21.15.73:6824/1356058331","cluster_addr":"172.21.15.73:6827/1356058331","heartbeat_back_addr":"172.21.15.73:6831/1356058331","heartbeat_front_addr":"172.21.15.73:6829/1356058331","state":["exists","up"]},{"osd":2,"uuid":"512bc8ac-72c2-40d4-b3d2-d867a92c5213","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":1228903316},{"type":"v1","addr":"172.21.15.73:6817","nonce":1228903316}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":1228903316},{"type":"v1","addr":"172.21.15.73:6819","nonce":1228903316}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6823","nonce":1228903316},{"type":"v1","addr":"172.21.15.73:6825","nonce":1228903316}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":1228903316},{"type":"v1","addr":"172.21.15.73:6821","nonce":1228903316}]},"public_addr":"172.21.15.73:6817/1228903316","cluster_addr":"172.21.15.73:6819/1228903316","heartbeat_back_addr":"172.21.15.73:6825/1228903316","heartbeat_front_addr":"172.21.15.73:6821/1228903316","state":["exists","up"]},{"osd":3,"uuid":"3d1a91e0-42bf-437a-8eae-8d357c8f63a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":1293329670},{"type":"v1","addr":"172.21.15.73:6809","nonce":1293329670}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6810","nonce":1293329670},{"type":"v1","addr":"172.21.15.73:6811","nonce":1293329670}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":1293329670},{"type":"v1","addr":"172.21.15.73:6815","nonce":1293329670}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":1293329670},{"type":"v1","addr":"172.21.15.73:6813","nonce":1293329670}]},"public_addr":"172.21.15.73:6809/1293329670","cluster_addr":"172.21.15.73:6811/1293329670","heartbeat_back_addr":"172.21.15.73:6815/1293329670","heartbeat_front_addr":"172.21.15.73:6813/1293329670","state":["exists","up"]},{"osd":4,"uuid":"4b302fff-834c-4069-ac19-00e46f6c87b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":3727975702},{"type":"v1","addr":"172.21.15.142:6801","nonce":3727975702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":3727975702},{"type":"v1","addr":"172.21.15.142:6803","nonce":3727975702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6809","nonce":3727975702},{"type":"v1","addr":"172.21.15.142:6811","nonce":3727975702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6805","nonce":3727975702},{"type":"v1","addr":"172.21.15.142:6807","nonce":3727975702}]},"public_addr":"172.21.15.142:6801/3727975702","cluster_addr":"172.21.15.142:6803/3727975702","heartbeat_back_addr":"172.21.15.142:6811/3727975702","heartbeat_front_addr":"172.21.15.142:6807/3727975702","state":["exists","up"]},{"osd":5,"uuid":"d7cdace2-67d0-45cc-95f2-515cf6ef1b82","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6817","nonce":2353193632},{"type":"v1","addr":"172.21.15.142:6819","nonce":2353193632}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6821","nonce":2353193632},{"type":"v1","addr":"172.21.15.142:6823","nonce":2353193632}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6829","nonce":2353193632},{"type":"v1","addr":"172.21.15.142:6831","nonce":2353193632}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6825","nonce":2353193632},{"type":"v1","addr":"172.21.15.142:6827","nonce":2353193632}]},"public_addr":"172.21.15.142:6819/2353193632","cluster_addr":"172.21.15.142:6823/2353193632","heartbeat_back_addr":"172.21.15.142:6831/2353193632","heartbeat_front_addr":"172.21.15.142:6827/2353193632","state":["exists","up"]},{"osd":6,"uuid":"649ce78a-5626-445c-aedc-a651ed05a6f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":2006111986},{"type":"v1","addr":"172.21.15.142:6806","nonce":2006111986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":2006111986},{"type":"v1","addr":"172.21.15.142:6810","nonce":2006111986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":2006111986},{"type":"v1","addr":"172.21.15.142:6815","nonce":2006111986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":2006111986},{"type":"v1","addr":"172.21.15.142:6813","nonce":2006111986}]},"public_addr":"172.21.15.142:6806/2006111986","cluster_addr":"172.21.15.142:6810/2006111986","heartbeat_back_addr":"172.21.15.142:6815/2006111986","heartbeat_front_addr":"172.21.15.142:6813/2006111986","state":["exists","up"]},{"osd":7,"uuid":"af15ae3b-c1d0-4acf-92db-8a1805494d13","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":2573794341},{"type":"v1","addr":"172.21.15.142:6818","nonce":2573794341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":2573794341},{"type":"v1","addr":"172.21.15.142:6822","nonce":2573794341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":2573794341},{"type":"v1","addr":"172.21.15.142:6830","nonce":2573794341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":2573794341},{"type":"v1","addr":"172.21.15.142:6826","nonce":2573794341}]},"public_addr":"172.21.15.142:6818/2573794341","cluster_addr":"172.21.15.142:6822/2573794341","heartbeat_back_addr":"172.21.15.142:6830/2573794341","heartbeat_front_addr":"172.21.15.142:6826/2573794341","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.185824+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.262103+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.225556+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:10.523459+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:10.706035+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.257339+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.301776+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.051960+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-12T09:45:19.911 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:19.910+0000 7f325e2e0640 1 -- 172.21.15.73:0/2360027443 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f323806ae70 msgr2=0x7f323806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:19.911 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:19.910+0000 7f325e2e0640 1 --2- 172.21.15.73:0/2360027443 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f323806ae70 0x7f323806d330 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f32480041e0 tx=0x7f324800b040 comp rx=0 tx=0).stop 2023-12-12T09:45:19.912 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:19.910+0000 7f325e2e0640 1 -- 172.21.15.73:0/2360027443 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f325814b9d0 msgr2=0x7f325814be50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:19.912 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:19.910+0000 7f325e2e0640 1 --2- 172.21.15.73:0/2360027443 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f325814b9d0 0x7f325814be50 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f3250003ea0 tx=0x7f32500036f0 comp rx=0 tx=0).stop 2023-12-12T09:45:19.912 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:19.911+0000 7f325e2e0640 1 -- 172.21.15.73:0/2360027443 shutdown_connections 2023-12-12T09:45:19.912 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:19.911+0000 7f325e2e0640 1 --2- 172.21.15.73:0/2360027443 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f323806ae70 0x7f323806d330 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:19.912 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:19.911+0000 7f325e2e0640 1 --2- 172.21.15.73:0/2360027443 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f325814b9d0 0x7f325814be50 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:19.912 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:19.911+0000 7f325e2e0640 1 --2- 172.21.15.73:0/2360027443 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f32581e9280 0x7f32580a7c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:19.913 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:19.911+0000 7f325e2e0640 1 --2- 172.21.15.73:0/2360027443 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f32440074b0 0x7f32580a99e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:19.913 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:19.911+0000 7f325e2e0640 1 -- 172.21.15.73:0/2360027443 >> 172.21.15.73:0/2360027443 conn(0x7f325806d590 msgr2=0x7f3258154970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:45:19.913 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:19.911+0000 7f325e2e0640 1 -- 172.21.15.73:0/2360027443 shutdown_connections 2023-12-12T09:45:19.913 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:19.911+0000 7f325e2e0640 1 -- 172.21.15.73:0/2360027443 wait complete. 2023-12-12T09:45:19.931 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-12T09:43:15.525508+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-12T09:45:19.931 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-12T09:45:20.138 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:20.137+0000 7f5843ffc640 1 Processor -- start 2023-12-12T09:45:20.139 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:20.137+0000 7f5843ffc640 1 -- start start 2023-12-12T09:45:20.140 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:20.139+0000 7f5843ffc640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f583c14f8c0 0x7f583c06dc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:20.140 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:20.139+0000 7f5843ffc640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f583c06d350 0x7f583c071e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:20.140 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:20.139+0000 7f5843ffc640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f583c0c16c0 con 0x7f583c0723a0 2023-12-12T09:45:20.140 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:20.139+0000 7f5843ffc640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f583c0c1090 con 0x7f583c06d350 2023-12-12T09:45:20.141 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:20.139+0000 7f5843ffc640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f583c0c14b0 con 0x7f583c14f8c0 2023-12-12T09:45:20.142 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:20.139+0000 7f5841d98640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f583c14f8c0 0x7f583c06dc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:20.142 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:20.139+0000 7f5841d98640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f583c14f8c0 0x7f583c06dc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.73:57808/0 (socket says 172.21.15.73:57808) 2023-12-12T09:45:20.142 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:20.139+0000 7f5841d98640 1 -- 172.21.15.73:0/2544047306 learned_addr learned my addr 172.21.15.73:0/2544047306 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:45:20.142 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:20.139+0000 7f5841597640 1 --2- 172.21.15.73:0/2544047306 >> v2:172.21.15.142:3300/0 conn(0x7f583c06d350 0x7f583c071e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:20.142 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:20.140+0000 7f5841d98640 1 -- 172.21.15.73:0/2544047306 >> v2:172.21.15.142:3300/0 conn(0x7f583c06d350 msgr2=0x7f583c071e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:45:20.142 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:20.140+0000 7f5841d98640 1 --2- 172.21.15.73:0/2544047306 >> v2:172.21.15.142:3300/0 conn(0x7f583c06d350 0x7f583c071e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:20.142 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:20.140+0000 7f5841d98640 1 -- 172.21.15.73:0/2544047306 >> v1:172.21.15.142:6789/0 conn(0x7f583c0723a0 legacy=0x7f583c152500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:20.142 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:20.140+0000 7f5841d98640 1 -- 172.21.15.73:0/2544047306 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f583c0c19a0 con 0x7f583c14f8c0 2023-12-12T09:45:20.144 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:20.141+0000 7f5841d98640 1 --2- 172.21.15.73:0/2544047306 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f583c14f8c0 0x7f583c06dc40 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f58380098a0 tx=0x7f583802b980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=152ae06d8f3d3f84 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:45:20.144 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:20.142+0000 7f5840d96640 1 -- 172.21.15.73:0/2544047306 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5838030840 con 0x7f583c14f8c0 2023-12-12T09:45:20.144 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:20.142+0000 7f5840d96640 1 -- 172.21.15.73:0/2544047306 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58380309a0 con 0x7f583c14f8c0 2023-12-12T09:45:20.144 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:20.142+0000 7f5840d96640 1 -- 172.21.15.73:0/2544047306 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5838030d30 con 0x7f583c14f8c0 2023-12-12T09:45:20.145 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:20.142+0000 7f5843ffc640 1 -- 172.21.15.73:0/2544047306 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f583c14f8c0 msgr2=0x7f583c06dc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:20.145 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:20.142+0000 7f5843ffc640 1 --2- 172.21.15.73:0/2544047306 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f583c14f8c0 0x7f583c06dc40 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f58380098a0 tx=0x7f583802b980 comp rx=0 tx=0).stop 2023-12-12T09:45:20.145 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:20.143+0000 7f5843ffc640 1 -- 172.21.15.73:0/2544047306 shutdown_connections 2023-12-12T09:45:20.147 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:20.143+0000 7f5843ffc640 1 --2- 172.21.15.73:0/2544047306 >> v2:172.21.15.142:3300/0 conn(0x7f583c06d350 0x7f583c071e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:20.147 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:20.143+0000 7f5843ffc640 1 --2- 172.21.15.73:0/2544047306 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f583c14f8c0 0x7f583c06dc40 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:20.148 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:20.143+0000 7f5843ffc640 1 -- 172.21.15.73:0/2544047306 >> 172.21.15.73:0/2544047306 conn(0x7f583c06a4e0 msgr2=0x7f583c06a8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:45:20.148 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:20.143+0000 7f5843ffc640 1 -- 172.21.15.73:0/2544047306 shutdown_connections 2023-12-12T09:45:20.148 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:20.143+0000 7f5843ffc640 1 -- 172.21.15.73:0/2544047306 wait complete. 2023-12-12T09:45:20.150 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:20.144+0000 7f5843ffc640 1 Processor -- start 2023-12-12T09:45:20.150 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:20.145+0000 7f5843ffc640 1 -- start start 2023-12-12T09:45:20.150 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:20.145+0000 7f5843ffc640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f583c06d350 0x7f583c1eb3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:20.150 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:20.145+0000 7f5843ffc640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f583c0723a0 0x7f583c1ea9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:20.150 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:20.146+0000 7f5843ffc640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f583c14f8c0 0x7f583c151670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:20.150 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:20.146+0000 7f5843ffc640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f583c1eaf20 con 0x7f583c0723a0 2023-12-12T09:45:20.150 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:20.146+0000 7f5843ffc640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f583c14d0f0 con 0x7f583c06d350 2023-12-12T09:45:20.150 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:20.146+0000 7f5843ffc640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f583c145c30 con 0x7f583c14f8c0 2023-12-12T09:45:20.150 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:20.146+0000 7f5841597640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f583c0723a0 0x7f583c1ea9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:20.150 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:20.146+0000 7f5841597640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f583c0723a0 0x7f583c1ea9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:45202/0 (socket says 172.21.15.73:45202) 2023-12-12T09:45:20.150 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:20.146+0000 7f5841597640 1 -- 172.21.15.73:0/3808525891 learned_addr learned my addr 172.21.15.73:0/3808525891 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:45:20.151 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:20.146+0000 7f5842599640 1 --2- 172.21.15.73:0/3808525891 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f583c14f8c0 0x7f583c151670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:20.151 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:20.146+0000 7f5841d98640 1 --2- 172.21.15.73:0/3808525891 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f583c06d350 0x7f583c1eb3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:20.151 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:20.146+0000 7f5841597640 1 -- 172.21.15.73:0/3808525891 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f583c14f8c0 msgr2=0x7f583c151670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:20.151 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:20.146+0000 7f5841597640 1 --2- 172.21.15.73:0/3808525891 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f583c14f8c0 0x7f583c151670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:20.151 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:20.146+0000 7f5841597640 1 -- 172.21.15.73:0/3808525891 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f583c06d350 msgr2=0x7f583c1eb3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:20.151 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:20.146+0000 7f5841597640 1 --2- 172.21.15.73:0/3808525891 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f583c06d350 0x7f583c1eb3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:20.151 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:20.146+0000 7f5841597640 1 -- 172.21.15.73:0/3808525891 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58380094d0 con 0x7f583c0723a0 2023-12-12T09:45:20.151 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:20.146+0000 7f5841d98640 1 --2- 172.21.15.73:0/3808525891 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f583c06d350 0x7f583c1eb3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:45:20.151 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:20.147+0000 7f5841597640 1 --2- 172.21.15.73:0/3808525891 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f583c0723a0 0x7f583c1ea9e0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f582c00e9b0 tx=0x7f582c00ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:45:20.151 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:20.147+0000 7f58327fc640 1 -- 172.21.15.73:0/3808525891 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f582c009670 con 0x7f583c0723a0 2023-12-12T09:45:20.151 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:20.147+0000 7f58327fc640 1 -- 172.21.15.73:0/3808525891 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f582c00c9a0 con 0x7f583c0723a0 2023-12-12T09:45:20.151 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:20.147+0000 7f5843ffc640 1 -- 172.21.15.73:0/3808525891 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f583c14e910 con 0x7f583c0723a0 2023-12-12T09:45:20.151 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:20.147+0000 7f58327fc640 1 -- 172.21.15.73:0/3808525891 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f582c00cd50 con 0x7f583c0723a0 2023-12-12T09:45:20.151 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:20.147+0000 7f5843ffc640 1 -- 172.21.15.73:0/3808525891 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f583c14eed0 con 0x7f583c0723a0 2023-12-12T09:45:20.151 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:20.148+0000 7f5843ffc640 1 -- 172.21.15.73:0/3808525891 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f583c14f0f0 con 0x7f583c0723a0 2023-12-12T09:45:20.152 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:20.150+0000 7f58327fc640 1 -- 172.21.15.73:0/3808525891 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f582c013470 con 0x7f583c0723a0 2023-12-12T09:45:20.152 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:20.150+0000 7f58327fc640 1 --2- 172.21.15.73:0/3808525891 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f582006ae40 0x7f582006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:20.152 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:20.151+0000 7f58327fc640 1 -- 172.21.15.73:0/3808525891 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f582c0897b0 con 0x7f583c0723a0 2023-12-12T09:45:20.152 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:20.151+0000 7f5841d98640 1 --2- 172.21.15.73:0/3808525891 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f582006ae40 0x7f582006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:20.153 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:20.151+0000 7f5841d98640 1 --2- 172.21.15.73:0/3808525891 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f582006ae40 0x7f582006d300 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f5838036000 tx=0x7f583803b040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:45:20.156 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:20.155+0000 7f58327fc640 1 -- 172.21.15.73:0/3808525891 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f582c054c40 con 0x7f583c0723a0 2023-12-12T09:45:20.345 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:20.343+0000 7f5843ffc640 1 -- 172.21.15.73:0/3808525891 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f583c067070 con 0x7f583c0723a0 2023-12-12T09:45:20.346 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:20.344+0000 7f58327fc640 1 -- 172.21.15.73:0/3808525891 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v50) v1 ==== 93+0+10 (secure 0 0 0) 0x7f582c058260 con 0x7f583c0723a0 2023-12-12T09:45:20.346 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 1 2023-12-12T09:45:20.349 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:20.347+0000 7f5843ffc640 1 -- 172.21.15.73:0/3808525891 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f582006ae40 msgr2=0x7f582006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:20.349 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:20.347+0000 7f5843ffc640 1 --2- 172.21.15.73:0/3808525891 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f582006ae40 0x7f582006d300 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f5838036000 tx=0x7f583803b040 comp rx=0 tx=0).stop 2023-12-12T09:45:20.349 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:20.347+0000 7f5843ffc640 1 -- 172.21.15.73:0/3808525891 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f583c0723a0 msgr2=0x7f583c1ea9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:20.349 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:20.347+0000 7f5843ffc640 1 --2- 172.21.15.73:0/3808525891 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f583c0723a0 0x7f583c1ea9e0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f582c00e9b0 tx=0x7f582c00ee70 comp rx=0 tx=0).stop 2023-12-12T09:45:20.350 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:20.347+0000 7f5843ffc640 1 -- 172.21.15.73:0/3808525891 shutdown_connections 2023-12-12T09:45:20.350 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:20.347+0000 7f5843ffc640 1 --2- 172.21.15.73:0/3808525891 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f582006ae40 0x7f582006d300 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:20.350 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:20.347+0000 7f5843ffc640 1 --2- 172.21.15.73:0/3808525891 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f583c14f8c0 0x7f583c151670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:20.350 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:20.347+0000 7f5843ffc640 1 --2- 172.21.15.73:0/3808525891 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f583c0723a0 0x7f583c1ea9e0 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:20.350 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:20.347+0000 7f5843ffc640 1 --2- 172.21.15.73:0/3808525891 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f583c06d350 0x7f583c1eb3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:20.350 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:20.347+0000 7f5843ffc640 1 -- 172.21.15.73:0/3808525891 >> 172.21.15.73:0/3808525891 conn(0x7f583c06a4e0 msgr2=0x7f583c0c59a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:45:20.350 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:20.347+0000 7f5843ffc640 1 -- 172.21.15.73:0/3808525891 shutdown_connections 2023-12-12T09:45:20.350 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:20.347+0000 7f5843ffc640 1 -- 172.21.15.73:0/3808525891 wait complete. 2023-12-12T09:45:20.366 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-12-12T09:45:20.573 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:20.572+0000 7f3e42a87640 1 Processor -- start 2023-12-12T09:45:20.574 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:20.572+0000 7f3e42a87640 1 -- start start 2023-12-12T09:45:20.580 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:20.574+0000 7f3e42a87640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f3e3c14fa40 0x7f3e3c06a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:20.580 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:20.574+0000 7f3e42a87640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f3e3c0c5070 0x7f3e3c0c40c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:20.580 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:20.574+0000 7f3e42a87640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e3c152610 con 0x7f3e3c06db70 2023-12-12T09:45:20.580 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:20.574+0000 7f3e42a87640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e3c1528f0 con 0x7f3e3c14fa40 2023-12-12T09:45:20.581 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:20.574+0000 7f3e42a87640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e3c152bd0 con 0x7f3e3c0c5070 2023-12-12T09:45:20.581 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:20.574+0000 7f3e40823640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f3e3c14fa40 0x7f3e3c06a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:20.581 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:20.574+0000 7f3e40823640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f3e3c14fa40 0x7f3e3c06a4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:45206/0 (socket says 172.21.15.73:45206) 2023-12-12T09:45:20.581 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:20.574+0000 7f3e40823640 1 -- 172.21.15.73:0/3666728577 learned_addr learned my addr 172.21.15.73:0/3666728577 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:45:20.581 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:20.574+0000 7f3e41024640 1 --2- 172.21.15.73:0/3666728577 >> v2:172.21.15.142:3300/0 conn(0x7f3e3c0c5070 0x7f3e3c0c40c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:20.581 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:20.574+0000 7f3e40823640 1 -- 172.21.15.73:0/3666728577 >> v2:172.21.15.142:3300/0 conn(0x7f3e3c0c5070 msgr2=0x7f3e3c0c40c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:45:20.581 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:20.574+0000 7f3e40823640 1 --2- 172.21.15.73:0/3666728577 >> v2:172.21.15.142:3300/0 conn(0x7f3e3c0c5070 0x7f3e3c0c40c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:20.581 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:20.574+0000 7f3e40823640 1 -- 172.21.15.73:0/3666728577 >> v1:172.21.15.142:6789/0 conn(0x7f3e3c06db70 legacy=0x7f3e3c0c39b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:45:20.581 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:20.574+0000 7f3e40823640 1 -- 172.21.15.73:0/3666728577 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e3c152eb0 con 0x7f3e3c14fa40 2023-12-12T09:45:20.581 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:20.575+0000 7f3e40823640 1 --2- 172.21.15.73:0/3666728577 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3e3c14fa40 0x7f3e3c06a4e0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f3e3c06fc50 tx=0x7f3e2c02b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff6ab864f138d453 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:45:20.581 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:20.576+0000 7f3e3b7fe640 1 -- 172.21.15.73:0/3666728577 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e2c031870 con 0x7f3e3c14fa40 2023-12-12T09:45:20.581 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:20.576+0000 7f3e3b7fe640 1 -- 172.21.15.73:0/3666728577 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e2c0319d0 con 0x7f3e3c14fa40 2023-12-12T09:45:20.581 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:20.576+0000 7f3e3b7fe640 1 -- 172.21.15.73:0/3666728577 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e2c031d60 con 0x7f3e3c14fa40 2023-12-12T09:45:20.582 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:20.576+0000 7f3e42a87640 1 -- 172.21.15.73:0/3666728577 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3e3c14fa40 msgr2=0x7f3e3c06a4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:20.582 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:20.576+0000 7f3e42a87640 1 --2- 172.21.15.73:0/3666728577 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3e3c14fa40 0x7f3e3c06a4e0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f3e3c06fc50 tx=0x7f3e2c02b910 comp rx=0 tx=0).stop 2023-12-12T09:45:20.582 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:20.577+0000 7f3e42a87640 1 -- 172.21.15.73:0/3666728577 shutdown_connections 2023-12-12T09:45:20.582 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:20.577+0000 7f3e42a87640 1 --2- 172.21.15.73:0/3666728577 >> v2:172.21.15.142:3300/0 conn(0x7f3e3c0c5070 0x7f3e3c0c40c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:20.582 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:20.577+0000 7f3e42a87640 1 --2- 172.21.15.73:0/3666728577 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3e3c14fa40 0x7f3e3c06a4e0 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:20.582 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:20.577+0000 7f3e42a87640 1 -- 172.21.15.73:0/3666728577 >> 172.21.15.73:0/3666728577 conn(0x7f3e3c0a8130 msgr2=0x7f3e3c0c24b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:45:20.582 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:20.577+0000 7f3e42a87640 1 -- 172.21.15.73:0/3666728577 shutdown_connections 2023-12-12T09:45:20.582 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:20.577+0000 7f3e42a87640 1 -- 172.21.15.73:0/3666728577 wait complete. 2023-12-12T09:45:20.582 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:20.578+0000 7f3e42a87640 1 Processor -- start 2023-12-12T09:45:20.582 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:20.579+0000 7f3e42a87640 1 -- start start 2023-12-12T09:45:20.585 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:20.579+0000 7f3e42a87640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3e3c06db70 0x7f3e3c1ed5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:20.585 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:20.579+0000 7f3e42a87640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3e3c0c5070 0x7f3e3c071170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:20.585 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:20.579+0000 7f3e42a87640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3e3c14fa40 0x7f3e3c1ea6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:20.585 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:20.579+0000 7f3e42a87640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e3c1edbd0 con 0x7f3e3c0c5070 2023-12-12T09:45:20.585 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:20.579+0000 7f3e42a87640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e3c1edeb0 con 0x7f3e3c14fa40 2023-12-12T09:45:20.585 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:20.579+0000 7f3e42a87640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e3c1ee190 con 0x7f3e3c06db70 2023-12-12T09:45:20.585 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:20.580+0000 7f3e3bfff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3e3c0c5070 0x7f3e3c071170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:20.585 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:20.580+0000 7f3e3bfff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3e3c0c5070 0x7f3e3c071170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:45210/0 (socket says 172.21.15.73:45210) 2023-12-12T09:45:20.585 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:20.580+0000 7f3e3bfff640 1 -- 172.21.15.73:0/3872770751 learned_addr learned my addr 172.21.15.73:0/3872770751 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:45:20.585 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:20.580+0000 7f3e3bfff640 1 -- 172.21.15.73:0/3872770751 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3e3c06db70 msgr2=0x7f3e3c1ed5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:20.585 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:20.580+0000 7f3e3bfff640 1 --2- 172.21.15.73:0/3872770751 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3e3c06db70 0x7f3e3c1ed5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:20.586 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:20.580+0000 7f3e3bfff640 1 -- 172.21.15.73:0/3872770751 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3e3c14fa40 msgr2=0x7f3e3c1ea6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:20.586 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:20.580+0000 7f3e3bfff640 1 --2- 172.21.15.73:0/3872770751 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3e3c14fa40 0x7f3e3c1ea6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:20.586 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:20.580+0000 7f3e3bfff640 1 -- 172.21.15.73:0/3872770751 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e2c0094d0 con 0x7f3e3c0c5070 2023-12-12T09:45:20.586 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:20.580+0000 7f3e3bfff640 1 --2- 172.21.15.73:0/3872770751 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3e3c0c5070 0x7f3e3c071170 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f3e2400b3e0 tx=0x7f3e2400b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:45:20.586 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:20.581+0000 7f3e397fa640 1 -- 172.21.15.73:0/3872770751 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e24011830 con 0x7f3e3c0c5070 2023-12-12T09:45:20.586 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:20.581+0000 7f3e397fa640 1 -- 172.21.15.73:0/3872770751 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e240119b0 con 0x7f3e3c0c5070 2023-12-12T09:45:20.586 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:20.581+0000 7f3e397fa640 1 -- 172.21.15.73:0/3872770751 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e24011d60 con 0x7f3e3c0c5070 2023-12-12T09:45:20.586 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:20.581+0000 7f3e42a87640 1 -- 172.21.15.73:0/3872770751 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e3c1ee470 con 0x7f3e3c0c5070 2023-12-12T09:45:20.586 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:20.581+0000 7f3e42a87640 1 -- 172.21.15.73:0/3872770751 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e3c0716b0 con 0x7f3e3c0c5070 2023-12-12T09:45:20.586 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:20.582+0000 7f3e42a87640 1 -- 172.21.15.73:0/3872770751 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e3c1ea3d0 con 0x7f3e3c0c5070 2023-12-12T09:45:20.586 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:20.583+0000 7f3e397fa640 1 -- 172.21.15.73:0/3872770751 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f3e2401a400 con 0x7f3e3c0c5070 2023-12-12T09:45:20.586 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:20.584+0000 7f3e397fa640 1 --2- 172.21.15.73:0/3872770751 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f3e1c06ae70 0x7f3e1c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:20.586 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:20.584+0000 7f3e397fa640 1 -- 172.21.15.73:0/3872770751 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f3e240894b0 con 0x7f3e3c0c5070 2023-12-12T09:45:20.587 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:20.584+0000 7f3e40823640 1 --2- 172.21.15.73:0/3872770751 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f3e1c06ae70 0x7f3e1c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:20.587 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:20.585+0000 7f3e40823640 1 --2- 172.21.15.73:0/3872770751 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f3e1c06ae70 0x7f3e1c06d330 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f3e2c036000 tx=0x7f3e2c030000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:45:20.589 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:20.588+0000 7f3e397fa640 1 -- 172.21.15.73:0/3872770751 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f3e3c1ea3d0 con 0x7f3e3c0c5070 2023-12-12T09:45:20.782 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:20.778+0000 7f3e42a87640 1 -- 172.21.15.73:0/3872770751 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f3e3c1ea3d0 con 0x7f3e3c0c5070 2023-12-12T09:45:20.782 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:20.779+0000 7f3e397fa640 1 -- 172.21.15.73:0/3872770751 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v50) v1 ==== 84+0+65 (secure 0 0 0) 0x7f3e3c1ea3d0 con 0x7f3e3c0c5070 2023-12-12T09:45:20.782 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-12T09:45:20.783 INFO:teuthology.orchestra.run.smithi073.stdout:[ 2023-12-12T09:45:20.783 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-12-12T09:45:20.783 INFO:teuthology.orchestra.run.smithi073.stdout: "poolnum": 1, 2023-12-12T09:45:20.783 INFO:teuthology.orchestra.run.smithi073.stdout: "poolname": ".mgr" 2023-12-12T09:45:20.783 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-12-12T09:45:20.783 INFO:teuthology.orchestra.run.smithi073.stdout:] 2023-12-12T09:45:20.784 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:20.782+0000 7f3e42a87640 1 -- 172.21.15.73:0/3872770751 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f3e1c06ae70 msgr2=0x7f3e1c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:20.784 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:20.782+0000 7f3e42a87640 1 --2- 172.21.15.73:0/3872770751 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f3e1c06ae70 0x7f3e1c06d330 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f3e2c036000 tx=0x7f3e2c030000 comp rx=0 tx=0).stop 2023-12-12T09:45:20.784 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:20.782+0000 7f3e42a87640 1 -- 172.21.15.73:0/3872770751 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3e3c0c5070 msgr2=0x7f3e3c071170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:20.784 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:20.782+0000 7f3e42a87640 1 --2- 172.21.15.73:0/3872770751 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3e3c0c5070 0x7f3e3c071170 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f3e2400b3e0 tx=0x7f3e2400b8a0 comp rx=0 tx=0).stop 2023-12-12T09:45:20.784 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:20.782+0000 7f3e42a87640 1 -- 172.21.15.73:0/3872770751 shutdown_connections 2023-12-12T09:45:20.784 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:20.782+0000 7f3e42a87640 1 --2- 172.21.15.73:0/3872770751 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f3e1c06ae70 0x7f3e1c06d330 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:20.784 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:20.782+0000 7f3e42a87640 1 --2- 172.21.15.73:0/3872770751 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3e3c14fa40 0x7f3e3c1ea6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:20.784 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:20.782+0000 7f3e42a87640 1 --2- 172.21.15.73:0/3872770751 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3e3c0c5070 0x7f3e3c071170 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:20.784 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:20.782+0000 7f3e42a87640 1 --2- 172.21.15.73:0/3872770751 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3e3c06db70 0x7f3e3c1ed5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:20.785 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:20.782+0000 7f3e42a87640 1 -- 172.21.15.73:0/3872770751 >> 172.21.15.73:0/3872770751 conn(0x7f3e3c0a8130 msgr2=0x7f3e3c0c63b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:45:20.785 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:20.782+0000 7f3e42a87640 1 -- 172.21.15.73:0/3872770751 shutdown_connections 2023-12-12T09:45:20.785 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:20.782+0000 7f3e42a87640 1 -- 172.21.15.73:0/3872770751 wait complete. 2023-12-12T09:45:20.802 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-12-12T09:45:20.803 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-12-12T09:45:21.011 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:21.010+0000 7f82a0bb6640 1 Processor -- start 2023-12-12T09:45:21.012 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:21.010+0000 7f82a0bb6640 1 -- start start 2023-12-12T09:45:21.013 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:21.011+0000 7f82a0bb6640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f829c14ea60 0x7f829c0c5420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:21.013 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:21.011+0000 7f82a0bb6640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f829c0c3390 con 0x7f829c0c0320 2023-12-12T09:45:21.013 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:21.012+0000 7f82a0bb6640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f829c0c4b30 con 0x7f829c0a4c90 2023-12-12T09:45:21.013 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:21.012+0000 7f82a0bb6640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f829c0c0750 con 0x7f829c14ea60 2023-12-12T09:45:21.013 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:21.012+0000 7f829a59c640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f829c14ea60 0x7f829c0c5420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:21.013 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:21.012+0000 7f829ad9d640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f829c0c0320 0x7f829c0c20b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:35052/0 (socket says 172.21.15.73:35052) 2023-12-12T09:45:21.013 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:21.012+0000 7f829ad9d640 1 -- 172.21.15.73:0/2833897242 learned_addr learned my addr 172.21.15.73:0/2833897242 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-12T09:45:21.014 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:21.012+0000 7f829a59c640 1 -- 172.21.15.73:0/2833897242 >> v1:172.21.15.142:6789/0 conn(0x7f829c0a4c90 legacy=0x7f829c0c4420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:45:21.014 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:21.012+0000 7f829a59c640 1 -- 172.21.15.73:0/2833897242 >> v1:172.21.15.73:6789/0 conn(0x7f829c0c0320 legacy=0x7f829c0c20b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:21.014 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:21.012+0000 7f829a59c640 1 -- 172.21.15.73:0/2833897242 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f829c151e60 con 0x7f829c14ea60 2023-12-12T09:45:21.015 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:21.013+0000 7f829a59c640 1 --2- 172.21.15.73:0/2833897242 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f829c14ea60 0x7f829c0c5420 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f828c0097a0 tx=0x7f828c02b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aad5dc1e5177b718 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:45:21.015 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:21.014+0000 7f8299d9b640 1 -- 172.21.15.73:0/2833897242 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f828c02e070 con 0x7f829c14ea60 2023-12-12T09:45:21.015 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:21.014+0000 7f8299d9b640 1 -- 172.21.15.73:0/2833897242 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f828c0315a0 con 0x7f829c14ea60 2023-12-12T09:45:21.015 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:21.014+0000 7f8299d9b640 1 -- 172.21.15.73:0/2833897242 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f828c031930 con 0x7f829c14ea60 2023-12-12T09:45:21.016 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:21.014+0000 7f82a0bb6640 1 -- 172.21.15.73:0/2833897242 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f829c14ea60 msgr2=0x7f829c0c5420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:21.016 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:21.014+0000 7f82a0bb6640 1 --2- 172.21.15.73:0/2833897242 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f829c14ea60 0x7f829c0c5420 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f828c0097a0 tx=0x7f828c02b840 comp rx=0 tx=0).stop 2023-12-12T09:45:21.016 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:21.014+0000 7f82a0bb6640 1 -- 172.21.15.73:0/2833897242 shutdown_connections 2023-12-12T09:45:21.016 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:21.014+0000 7f82a0bb6640 1 --2- 172.21.15.73:0/2833897242 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f829c14ea60 0x7f829c0c5420 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:21.016 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:21.014+0000 7f82a0bb6640 1 -- 172.21.15.73:0/2833897242 >> 172.21.15.73:0/2833897242 conn(0x7f829c06a4e0 msgr2=0x7f829c06a8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:45:21.016 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:21.015+0000 7f82a0bb6640 1 -- 172.21.15.73:0/2833897242 shutdown_connections 2023-12-12T09:45:21.017 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:21.015+0000 7f82a0bb6640 1 -- 172.21.15.73:0/2833897242 wait complete. 2023-12-12T09:45:21.017 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:21.016+0000 7f82a0bb6640 1 Processor -- start 2023-12-12T09:45:21.017 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:21.016+0000 7f82a0bb6640 1 -- start start 2023-12-12T09:45:21.020 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:21.017+0000 7f82a0bb6640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f829c0a4c90 0x7f829c1e9d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:21.020 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:21.017+0000 7f82a0bb6640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f829c0c0320 0x7f829c06cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:21.020 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:21.017+0000 7f82a0bb6640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f829c14ea60 0x7f829c13ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:21.020 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:21.017+0000 7f82a0bb6640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f829c14d380 con 0x7f829c0a4c90 2023-12-12T09:45:21.020 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:21.017+0000 7f82a0bb6640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f829c1ea370 con 0x7f829c0c0320 2023-12-12T09:45:21.020 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:21.017+0000 7f82a0bb6640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f829c1ea650 con 0x7f829c14ea60 2023-12-12T09:45:21.020 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:21.017+0000 7f829a59c640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f829c0a4c90 0x7f829c1e9d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:21.021 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:21.017+0000 7f829a59c640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f829c0a4c90 0x7f829c1e9d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:45234/0 (socket says 172.21.15.73:45234) 2023-12-12T09:45:21.021 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:21.017+0000 7f829a59c640 1 -- 172.21.15.73:0/734890561 learned_addr learned my addr 172.21.15.73:0/734890561 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:45:21.021 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:21.018+0000 7f829a59c640 1 -- 172.21.15.73:0/734890561 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f829c14ea60 msgr2=0x7f829c13ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:21.021 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:21.018+0000 7f829a59c640 1 --2- 172.21.15.73:0/734890561 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f829c14ea60 0x7f829c13ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:21.021 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:21.018+0000 7f829a59c640 1 -- 172.21.15.73:0/734890561 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f829c0c0320 msgr2=0x7f829c06cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:21.021 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:21.018+0000 7f829a59c640 1 --2- 172.21.15.73:0/734890561 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f829c0c0320 0x7f829c06cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:21.021 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:21.018+0000 7f829a59c640 1 -- 172.21.15.73:0/734890561 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f828c009400 con 0x7f829c0a4c90 2023-12-12T09:45:21.021 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:21.018+0000 7f829a59c640 1 --2- 172.21.15.73:0/734890561 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f829c0a4c90 0x7f829c1e9d20 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f828c034040 tx=0x7f828c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:45:21.021 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:21.018+0000 7f8292ffd640 1 -- 172.21.15.73:0/734890561 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f828c032900 con 0x7f829c0a4c90 2023-12-12T09:45:21.021 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:21.018+0000 7f8292ffd640 1 -- 172.21.15.73:0/734890561 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f828c032a80 con 0x7f829c0a4c90 2023-12-12T09:45:21.021 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:21.018+0000 7f8292ffd640 1 -- 172.21.15.73:0/734890561 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f828c032e30 con 0x7f829c0a4c90 2023-12-12T09:45:21.021 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:21.018+0000 7f82a0bb6640 1 -- 172.21.15.73:0/734890561 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f829c1ea930 con 0x7f829c0a4c90 2023-12-12T09:45:21.021 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:21.019+0000 7f82a0bb6640 1 -- 172.21.15.73:0/734890561 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f829c06d440 con 0x7f829c0a4c90 2023-12-12T09:45:21.022 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:21.019+0000 7f82a0bb6640 1 -- 172.21.15.73:0/734890561 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f829c0c3920 con 0x7f829c0a4c90 2023-12-12T09:45:21.022 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:21.020+0000 7f8292ffd640 1 -- 172.21.15.73:0/734890561 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f828c03b3f0 con 0x7f829c0a4c90 2023-12-12T09:45:21.022 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:21.021+0000 7f8292ffd640 1 --2- 172.21.15.73:0/734890561 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f827c06ae40 0x7f827c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:21.023 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:21.021+0000 7f8292ffd640 1 -- 172.21.15.73:0/734890561 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f828c0ab390 con 0x7f829c0a4c90 2023-12-12T09:45:21.023 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:21.022+0000 7f8293fff640 1 --2- 172.21.15.73:0/734890561 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f827c06ae40 0x7f827c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:21.023 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:21.022+0000 7f8293fff640 1 --2- 172.21.15.73:0/734890561 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f827c06ae40 0x7f827c06d300 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f829c0abe10 tx=0x7f82840079b0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:45:21.028 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:21.026+0000 7f8292ffd640 1 -- 172.21.15.73:0/734890561 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f829c0c3920 con 0x7f829c0a4c90 2023-12-12T09:45:21.215 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:21.214+0000 7f82a0bb6640 1 -- 172.21.15.73:0/734890561 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f829c0c3920 con 0x7f829c0a4c90 2023-12-12T09:45:21.493 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:21.492+0000 7f8292ffd640 1 -- 172.21.15.73:0/734890561 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v51) v1 ==== 138+0+0 (secure 0 0 0) 0x7f829c0c3920 con 0x7f829c0a4c90 2023-12-12T09:45:21.494 INFO:teuthology.orchestra.run.smithi073.stderr:pool 'cephfs_metadata' created 2023-12-12T09:45:21.497 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:21.495+0000 7f82a0bb6640 1 -- 172.21.15.73:0/734890561 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f827c06ae40 msgr2=0x7f827c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:21.497 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:21.495+0000 7f82a0bb6640 1 --2- 172.21.15.73:0/734890561 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f827c06ae40 0x7f827c06d300 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f829c0abe10 tx=0x7f82840079b0 comp rx=0 tx=0).stop 2023-12-12T09:45:21.497 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:21.495+0000 7f82a0bb6640 1 -- 172.21.15.73:0/734890561 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f829c0a4c90 msgr2=0x7f829c1e9d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:21.497 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:21.495+0000 7f82a0bb6640 1 --2- 172.21.15.73:0/734890561 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f829c0a4c90 0x7f829c1e9d20 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f828c034040 tx=0x7f828c0046c0 comp rx=0 tx=0).stop 2023-12-12T09:45:21.497 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:21.496+0000 7f82a0bb6640 1 -- 172.21.15.73:0/734890561 shutdown_connections 2023-12-12T09:45:21.497 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:21.496+0000 7f82a0bb6640 1 --2- 172.21.15.73:0/734890561 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f827c06ae40 0x7f827c06d300 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:21.497 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:21.496+0000 7f82a0bb6640 1 --2- 172.21.15.73:0/734890561 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f829c14ea60 0x7f829c13ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:21.497 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:21.496+0000 7f82a0bb6640 1 --2- 172.21.15.73:0/734890561 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f829c0c0320 0x7f829c06cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:21.497 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:21.496+0000 7f82a0bb6640 1 --2- 172.21.15.73:0/734890561 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f829c0a4c90 0x7f829c1e9d20 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:21.498 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:21.496+0000 7f82a0bb6640 1 -- 172.21.15.73:0/734890561 >> 172.21.15.73:0/734890561 conn(0x7f829c06a4e0 msgr2=0x7f829c0c4420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:45:21.498 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:21.496+0000 7f82a0bb6640 1 -- 172.21.15.73:0/734890561 shutdown_connections 2023-12-12T09:45:21.498 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:21.496+0000 7f82a0bb6640 1 -- 172.21.15.73:0/734890561 wait complete. 2023-12-12T09:45:21.521 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-12-12T09:45:21.721 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:21.720+0000 7f1a79b48640 1 Processor -- start 2023-12-12T09:45:21.722 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:21.720+0000 7f1a79b48640 1 -- start start 2023-12-12T09:45:21.723 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:21.722+0000 7f1a79b48640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f1a7414f8c0 0x7f1a7406dc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:21.723 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:21.722+0000 7f1a79b48640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f1a7406d350 0x7f1a74071e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:21.723 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:21.722+0000 7f1a79b48640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a740c16c0 con 0x7f1a740723a0 2023-12-12T09:45:21.723 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:21.722+0000 7f1a79b48640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a740c1090 con 0x7f1a7406d350 2023-12-12T09:45:21.723 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:21.722+0000 7f1a79b48640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a740c14b0 con 0x7f1a7414f8c0 2023-12-12T09:45:21.723 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:21.722+0000 7f1a72ffd640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f1a7406d350 0x7f1a74071e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:21.724 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:21.722+0000 7f1a72ffd640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f1a7406d350 0x7f1a74071e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:45246/0 (socket says 172.21.15.73:45246) 2023-12-12T09:45:21.724 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:21.722+0000 7f1a72ffd640 1 -- 172.21.15.73:0/547206300 learned_addr learned my addr 172.21.15.73:0/547206300 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:45:21.724 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:21.722+0000 7f1a737fe640 1 --2- 172.21.15.73:0/547206300 >> v2:172.21.15.142:3300/0 conn(0x7f1a7414f8c0 0x7f1a7406dc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:21.724 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:21.722+0000 7f1a72ffd640 1 -- 172.21.15.73:0/547206300 >> v2:172.21.15.142:3300/0 conn(0x7f1a7414f8c0 msgr2=0x7f1a7406dc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:45:21.724 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:21.722+0000 7f1a72ffd640 1 --2- 172.21.15.73:0/547206300 >> v2:172.21.15.142:3300/0 conn(0x7f1a7414f8c0 0x7f1a7406dc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:21.724 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:21.722+0000 7f1a72ffd640 1 -- 172.21.15.73:0/547206300 >> v1:172.21.15.142:6789/0 conn(0x7f1a740723a0 legacy=0x7f1a74152500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:45:21.725 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:21.722+0000 7f1a72ffd640 1 -- 172.21.15.73:0/547206300 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a740c19a0 con 0x7f1a7406d350 2023-12-12T09:45:21.725 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:21.723+0000 7f1a72ffd640 1 --2- 172.21.15.73:0/547206300 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1a7406d350 0x7f1a74071e60 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f1a740c34b0 tx=0x7f1a6802b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f2bf08bbecbf091 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:45:21.726 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:21.724+0000 7f1a727fc640 1 -- 172.21.15.73:0/547206300 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a68031870 con 0x7f1a7406d350 2023-12-12T09:45:21.726 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:21.724+0000 7f1a727fc640 1 -- 172.21.15.73:0/547206300 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a680319d0 con 0x7f1a7406d350 2023-12-12T09:45:21.726 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:21.724+0000 7f1a727fc640 1 -- 172.21.15.73:0/547206300 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a68031d60 con 0x7f1a7406d350 2023-12-12T09:45:21.726 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:21.724+0000 7f1a79b48640 1 -- 172.21.15.73:0/547206300 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1a7406d350 msgr2=0x7f1a74071e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:21.726 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:21.724+0000 7f1a79b48640 1 --2- 172.21.15.73:0/547206300 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1a7406d350 0x7f1a74071e60 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f1a740c34b0 tx=0x7f1a6802b910 comp rx=0 tx=0).stop 2023-12-12T09:45:21.726 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:21.724+0000 7f1a79b48640 1 -- 172.21.15.73:0/547206300 shutdown_connections 2023-12-12T09:45:21.726 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:21.724+0000 7f1a79b48640 1 --2- 172.21.15.73:0/547206300 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1a7406d350 0x7f1a74071e60 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:21.726 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:21.725+0000 7f1a79b48640 1 --2- 172.21.15.73:0/547206300 >> v2:172.21.15.142:3300/0 conn(0x7f1a7414f8c0 0x7f1a7406dc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:21.726 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:21.725+0000 7f1a79b48640 1 -- 172.21.15.73:0/547206300 >> 172.21.15.73:0/547206300 conn(0x7f1a7406a4e0 msgr2=0x7f1a7406a8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:45:21.726 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:21.725+0000 7f1a79b48640 1 -- 172.21.15.73:0/547206300 shutdown_connections 2023-12-12T09:45:21.727 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:21.725+0000 7f1a79b48640 1 -- 172.21.15.73:0/547206300 wait complete. 2023-12-12T09:45:21.727 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:21.726+0000 7f1a79b48640 1 Processor -- start 2023-12-12T09:45:21.727 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:21.726+0000 7f1a79b48640 1 -- start start 2023-12-12T09:45:21.728 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:21.727+0000 7f1a79b48640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1a7406d350 0x7f1a74071bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:21.729 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:21.727+0000 7f1a79b48640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1a740723a0 0x7f1a74153990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:21.729 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:21.727+0000 7f1a79b48640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1a7414f8c0 0x7f1a74148b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:21.729 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:21.727+0000 7f1a79b48640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a74154f90 con 0x7f1a740723a0 2023-12-12T09:45:21.729 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:21.727+0000 7f1a79b48640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a74156620 con 0x7f1a7414f8c0 2023-12-12T09:45:21.729 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:21.727+0000 7f1a79b48640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a74155a10 con 0x7f1a7406d350 2023-12-12T09:45:21.730 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:21.728+0000 7f1a72ffd640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1a740723a0 0x7f1a74153990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:21.730 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:21.728+0000 7f1a72ffd640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1a740723a0 0x7f1a74153990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:45248/0 (socket says 172.21.15.73:45248) 2023-12-12T09:45:21.730 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:21.728+0000 7f1a72ffd640 1 -- 172.21.15.73:0/2281913532 learned_addr learned my addr 172.21.15.73:0/2281913532 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:45:21.730 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:21.728+0000 7f1a737fe640 1 --2- 172.21.15.73:0/2281913532 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1a7406d350 0x7f1a74071bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:21.731 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:21.728+0000 7f1a72ffd640 1 -- 172.21.15.73:0/2281913532 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1a7406d350 msgr2=0x7f1a74071bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:21.731 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:21.728+0000 7f1a72ffd640 1 --2- 172.21.15.73:0/2281913532 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1a7406d350 0x7f1a74071bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:21.731 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:21.728+0000 7f1a72ffd640 1 -- 172.21.15.73:0/2281913532 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1a7414f8c0 msgr2=0x7f1a74148b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:21.731 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:21.728+0000 7f1a73fff640 1 --2- 172.21.15.73:0/2281913532 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1a7414f8c0 0x7f1a74148b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:21.731 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:21.728+0000 7f1a72ffd640 1 --2- 172.21.15.73:0/2281913532 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1a7414f8c0 0x7f1a74148b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:21.731 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:21.728+0000 7f1a72ffd640 1 -- 172.21.15.73:0/2281913532 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a680094d0 con 0x7f1a740723a0 2023-12-12T09:45:21.731 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:21.729+0000 7f1a72ffd640 1 --2- 172.21.15.73:0/2281913532 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1a740723a0 0x7f1a74153990 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f1a68000c00 tx=0x7f1a680046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:45:21.731 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:21.729+0000 7f1a5bfff640 1 -- 172.21.15.73:0/2281913532 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a6803ad10 con 0x7f1a740723a0 2023-12-12T09:45:21.731 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:21.729+0000 7f1a5bfff640 1 -- 172.21.15.73:0/2281913532 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a6803ae70 con 0x7f1a740723a0 2023-12-12T09:45:21.731 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:21.729+0000 7f1a5bfff640 1 -- 172.21.15.73:0/2281913532 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a68044610 con 0x7f1a740723a0 2023-12-12T09:45:21.731 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:21.729+0000 7f1a79b48640 1 -- 172.21.15.73:0/2281913532 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a74155cf0 con 0x7f1a740723a0 2023-12-12T09:45:21.731 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:21.729+0000 7f1a79b48640 1 -- 172.21.15.73:0/2281913532 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a741562b0 con 0x7f1a740723a0 2023-12-12T09:45:21.732 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:21.730+0000 7f1a79b48640 1 -- 172.21.15.73:0/2281913532 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a74067070 con 0x7f1a740723a0 2023-12-12T09:45:21.732 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:21.731+0000 7f1a5bfff640 1 -- 172.21.15.73:0/2281913532 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f1a6804d450 con 0x7f1a740723a0 2023-12-12T09:45:21.733 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:21.732+0000 7f1a5bfff640 1 --2- 172.21.15.73:0/2281913532 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f1a6006ae40 0x7f1a6006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:21.733 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:21.732+0000 7f1a5bfff640 1 -- 172.21.15.73:0/2281913532 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 5227+0+0 (secure 0 0 0) 0x7f1a6802d040 con 0x7f1a740723a0 2023-12-12T09:45:21.734 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:21.733+0000 7f1a737fe640 1 --2- 172.21.15.73:0/2281913532 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f1a6006ae40 0x7f1a6006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:21.734 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:21.733+0000 7f1a737fe640 1 --2- 172.21.15.73:0/2281913532 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f1a6006ae40 0x7f1a6006d300 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f1a64006fd0 tx=0x7f1a64008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:45:21.738 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:21.738+0000 7f1a5bfff640 1 -- 172.21.15.73:0/2281913532 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f1a68076dd0 con 0x7f1a740723a0 2023-12-12T09:45:21.933 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:21.931+0000 7f1a79b48640 1 -- 172.21.15.73:0/2281913532 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f1a74067580 con 0x7f1a740723a0 2023-12-12T09:45:22.505 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:22.503+0000 7f1a5bfff640 1 -- 172.21.15.73:0/2281913532 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v52) v1 ==== 170+0+0 (secure 0 0 0) 0x7f1a6807a3f0 con 0x7f1a740723a0 2023-12-12T09:45:22.505 INFO:teuthology.orchestra.run.smithi073.stderr:pool 'cephfs_data' created 2023-12-12T09:45:22.510 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:22.508+0000 7f1a79b48640 1 -- 172.21.15.73:0/2281913532 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f1a6006ae40 msgr2=0x7f1a6006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:22.510 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:22.508+0000 7f1a79b48640 1 --2- 172.21.15.73:0/2281913532 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f1a6006ae40 0x7f1a6006d300 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f1a64006fd0 tx=0x7f1a64008040 comp rx=0 tx=0).stop 2023-12-12T09:45:22.510 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:22.508+0000 7f1a79b48640 1 -- 172.21.15.73:0/2281913532 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1a740723a0 msgr2=0x7f1a74153990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:22.510 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:22.508+0000 7f1a79b48640 1 --2- 172.21.15.73:0/2281913532 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1a740723a0 0x7f1a74153990 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f1a68000c00 tx=0x7f1a680046c0 comp rx=0 tx=0).stop 2023-12-12T09:45:22.510 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:22.508+0000 7f1a79b48640 1 -- 172.21.15.73:0/2281913532 shutdown_connections 2023-12-12T09:45:22.510 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:22.508+0000 7f1a79b48640 1 --2- 172.21.15.73:0/2281913532 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f1a6006ae40 0x7f1a6006d300 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:22.511 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:22.508+0000 7f1a79b48640 1 --2- 172.21.15.73:0/2281913532 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1a7414f8c0 0x7f1a74148b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:22.511 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:22.508+0000 7f1a79b48640 1 --2- 172.21.15.73:0/2281913532 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1a740723a0 0x7f1a74153990 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:22.511 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:22.508+0000 7f1a79b48640 1 --2- 172.21.15.73:0/2281913532 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1a7406d350 0x7f1a74071bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:22.511 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:22.508+0000 7f1a79b48640 1 -- 172.21.15.73:0/2281913532 >> 172.21.15.73:0/2281913532 conn(0x7f1a7406a4e0 msgr2=0x7f1a7414ebc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:45:22.511 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:22.509+0000 7f1a79b48640 1 -- 172.21.15.73:0/2281913532 shutdown_connections 2023-12-12T09:45:22.511 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:22.509+0000 7f1a79b48640 1 -- 172.21.15.73:0/2281913532 wait complete. 2023-12-12T09:45:22.543 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-12-12T09:45:22.729 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:22.728+0000 7f2a2831d640 1 Processor -- start 2023-12-12T09:45:22.730 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:22.728+0000 7f2a2831d640 1 -- start start 2023-12-12T09:45:22.731 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:22.729+0000 7f2a2831d640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2a20151c30 0x7f2a2006d440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:22.731 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:22.729+0000 7f2a2831d640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f2a200bed50 0x7f2a200bf1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:22.731 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:22.729+0000 7f2a2831d640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a201582e0 con 0x7f2a200c3930 2023-12-12T09:45:22.731 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:22.729+0000 7f2a2831d640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a200a54d0 con 0x7f2a200bed50 2023-12-12T09:45:22.731 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:22.729+0000 7f2a2831d640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a200a4f50 con 0x7f2a20151c30 2023-12-12T09:45:22.732 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:22.730+0000 7f2a260b9640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2a20151c30 0x7f2a2006d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:22.732 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:22.730+0000 7f2a268ba640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f2a200bed50 0x7f2a200bf1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:22.732 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:22.730+0000 7f2a268ba640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f2a200bed50 0x7f2a200bf1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.73:56262/0 (socket says 172.21.15.73:56262) 2023-12-12T09:45:22.732 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:22.730+0000 7f2a268ba640 1 -- 172.21.15.73:0/3331859612 learned_addr learned my addr 172.21.15.73:0/3331859612 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:45:22.732 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:22.731+0000 7f2a268ba640 1 -- 172.21.15.73:0/3331859612 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2a20151c30 msgr2=0x7f2a2006d440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:45:22.733 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:22.731+0000 7f2a268ba640 1 --2- 172.21.15.73:0/3331859612 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2a20151c30 0x7f2a2006d440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:22.733 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:22.731+0000 7f2a268ba640 1 -- 172.21.15.73:0/3331859612 >> v1:172.21.15.142:6789/0 conn(0x7f2a200c3930 legacy=0x7f2a20157bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:22.733 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:22.731+0000 7f2a268ba640 1 -- 172.21.15.73:0/3331859612 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a20155260 con 0x7f2a200bed50 2023-12-12T09:45:22.733 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:22.731+0000 7f2a260b9640 1 --2- 172.21.15.73:0/3331859612 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2a20151c30 0x7f2a2006d440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-12T09:45:22.733 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:22.732+0000 7f2a268ba640 1 --2- 172.21.15.73:0/3331859612 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2a200bed50 0x7f2a200bf1c0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f2a18009e50 tx=0x7f2a1802bed0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4e4e1fcd1cdc6f2d server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:45:22.735 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:22.733+0000 7f2a250b7640 1 -- 172.21.15.73:0/3331859612 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a1802ca70 con 0x7f2a200bed50 2023-12-12T09:45:22.735 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:22.733+0000 7f2a250b7640 1 -- 172.21.15.73:0/3331859612 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a1802cbd0 con 0x7f2a200bed50 2023-12-12T09:45:22.735 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:22.733+0000 7f2a250b7640 1 -- 172.21.15.73:0/3331859612 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a180343f0 con 0x7f2a200bed50 2023-12-12T09:45:22.735 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:22.734+0000 7f2a2831d640 1 -- 172.21.15.73:0/3331859612 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2a200bed50 msgr2=0x7f2a200bf1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:22.735 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:22.734+0000 7f2a2831d640 1 --2- 172.21.15.73:0/3331859612 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2a200bed50 0x7f2a200bf1c0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f2a18009e50 tx=0x7f2a1802bed0 comp rx=0 tx=0).stop 2023-12-12T09:45:22.735 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:22.734+0000 7f2a2831d640 1 -- 172.21.15.73:0/3331859612 shutdown_connections 2023-12-12T09:45:22.735 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:22.734+0000 7f2a2831d640 1 --2- 172.21.15.73:0/3331859612 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2a200bed50 0x7f2a200bf1c0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:22.736 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:22.734+0000 7f2a2831d640 1 --2- 172.21.15.73:0/3331859612 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2a20151c30 0x7f2a2006d440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:22.736 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:22.734+0000 7f2a2831d640 1 -- 172.21.15.73:0/3331859612 >> 172.21.15.73:0/3331859612 conn(0x7f2a2006a4e0 msgr2=0x7f2a2006a8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:45:22.736 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:22.734+0000 7f2a2831d640 1 -- 172.21.15.73:0/3331859612 shutdown_connections 2023-12-12T09:45:22.736 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:22.734+0000 7f2a2831d640 1 -- 172.21.15.73:0/3331859612 wait complete. 2023-12-12T09:45:22.737 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:22.736+0000 7f2a2831d640 1 Processor -- start 2023-12-12T09:45:22.737 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:22.736+0000 7f2a2831d640 1 -- start start 2023-12-12T09:45:22.739 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:22.737+0000 7f2a2831d640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2a200bed50 0x7f2a2014e3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:22.739 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:22.737+0000 7f2a2831d640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2a200c3930 0x7f2a20148550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:22.739 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:22.737+0000 7f2a2831d640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2a20151c30 0x7f2a20071f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:22.739 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:22.737+0000 7f2a2831d640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a200702f0 con 0x7f2a200bed50 2023-12-12T09:45:22.739 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:22.737+0000 7f2a2831d640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a200705d0 con 0x7f2a20151c30 2023-12-12T09:45:22.739 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:22.737+0000 7f2a2831d640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a200708b0 con 0x7f2a200c3930 2023-12-12T09:45:22.739 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:22.738+0000 7f2a260b9640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2a200bed50 0x7f2a2014e3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:22.739 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:22.738+0000 7f2a260b9640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2a200bed50 0x7f2a2014e3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:45252/0 (socket says 172.21.15.73:45252) 2023-12-12T09:45:22.739 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:22.738+0000 7f2a260b9640 1 -- 172.21.15.73:0/2839445521 learned_addr learned my addr 172.21.15.73:0/2839445521 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:45:22.740 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:22.738+0000 7f2a258b8640 1 --2- 172.21.15.73:0/2839445521 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2a200c3930 0x7f2a20148550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:22.740 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:22.738+0000 7f2a268ba640 1 --2- 172.21.15.73:0/2839445521 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2a20151c30 0x7f2a20071f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:22.740 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:22.738+0000 7f2a260b9640 1 -- 172.21.15.73:0/2839445521 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2a200c3930 msgr2=0x7f2a20148550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:22.741 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:22.738+0000 7f2a260b9640 1 --2- 172.21.15.73:0/2839445521 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2a200c3930 0x7f2a20148550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:22.741 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:22.738+0000 7f2a260b9640 1 -- 172.21.15.73:0/2839445521 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2a20151c30 msgr2=0x7f2a20071f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:22.741 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:22.738+0000 7f2a260b9640 1 --2- 172.21.15.73:0/2839445521 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2a20151c30 0x7f2a20071f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:22.741 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:22.738+0000 7f2a260b9640 1 -- 172.21.15.73:0/2839445521 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a1c009400 con 0x7f2a200bed50 2023-12-12T09:45:22.741 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:22.738+0000 7f2a268ba640 1 --2- 172.21.15.73:0/2839445521 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2a20151c30 0x7f2a20071f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:45:22.741 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:22.738+0000 7f2a260b9640 1 --2- 172.21.15.73:0/2839445521 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2a200bed50 0x7f2a2014e3b0 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f2a1c00e960 tx=0x7f2a1c00ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:45:22.741 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:22.739+0000 7f2a16ffd640 1 -- 172.21.15.73:0/2839445521 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a1c00ca00 con 0x7f2a200bed50 2023-12-12T09:45:22.741 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:22.739+0000 7f2a16ffd640 1 -- 172.21.15.73:0/2839445521 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a1c00cb60 con 0x7f2a200bed50 2023-12-12T09:45:22.741 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:22.739+0000 7f2a2831d640 1 -- 172.21.15.73:0/2839445521 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a18009b30 con 0x7f2a200bed50 2023-12-12T09:45:22.741 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:22.739+0000 7f2a16ffd640 1 -- 172.21.15.73:0/2839445521 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a1c013470 con 0x7f2a200bed50 2023-12-12T09:45:22.741 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:22.739+0000 7f2a2831d640 1 -- 172.21.15.73:0/2839445521 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a20156100 con 0x7f2a200bed50 2023-12-12T09:45:22.742 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:22.740+0000 7f2a2831d640 1 -- 172.21.15.73:0/2839445521 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a20067070 con 0x7f2a200bed50 2023-12-12T09:45:22.743 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:22.742+0000 7f2a16ffd640 1 -- 172.21.15.73:0/2839445521 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f2a1c0135d0 con 0x7f2a200bed50 2023-12-12T09:45:22.743 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:22.742+0000 7f2a16ffd640 1 --2- 172.21.15.73:0/2839445521 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f2a0406ae40 0x7f2a0406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:22.744 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:22.743+0000 7f2a16ffd640 1 -- 172.21.15.73:0/2839445521 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 5609+0+0 (secure 0 0 0) 0x7f2a1c089830 con 0x7f2a200bed50 2023-12-12T09:45:22.744 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:22.743+0000 7f2a258b8640 1 --2- 172.21.15.73:0/2839445521 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f2a0406ae40 0x7f2a0406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:22.745 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:22.744+0000 7f2a258b8640 1 --2- 172.21.15.73:0/2839445521 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f2a0406ae40 0x7f2a0406d300 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f2a201545a0 tx=0x7f2a10009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:45:22.749 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:22.748+0000 7f2a16ffd640 1 -- 172.21.15.73:0/2839445521 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f2a1c054930 con 0x7f2a200bed50 2023-12-12T09:45:22.969 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:22.968+0000 7f2a2831d640 1 -- 172.21.15.73:0/2839445521 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f2a20067580 con 0x7f2a200bed50 2023-12-12T09:45:23.509 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:23.507+0000 7f2a16ffd640 1 -- 172.21.15.73:0/2839445521 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 8 and data pool 9 v26) v1 ==== 172+0+0 (secure 0 0 0) 0x7f2a1c057f50 con 0x7f2a200bed50 2023-12-12T09:45:23.509 INFO:teuthology.orchestra.run.smithi073.stderr:new fs with metadata pool 8 and data pool 9 2023-12-12T09:45:23.512 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:23.511+0000 7f2a2831d640 1 -- 172.21.15.73:0/2839445521 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f2a0406ae40 msgr2=0x7f2a0406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:23.513 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:23.511+0000 7f2a2831d640 1 --2- 172.21.15.73:0/2839445521 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f2a0406ae40 0x7f2a0406d300 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f2a201545a0 tx=0x7f2a10009040 comp rx=0 tx=0).stop 2023-12-12T09:45:23.513 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:23.511+0000 7f2a2831d640 1 -- 172.21.15.73:0/2839445521 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2a200bed50 msgr2=0x7f2a2014e3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:23.513 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:23.511+0000 7f2a2831d640 1 --2- 172.21.15.73:0/2839445521 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2a200bed50 0x7f2a2014e3b0 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f2a1c00e960 tx=0x7f2a1c00ee20 comp rx=0 tx=0).stop 2023-12-12T09:45:23.513 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:23.511+0000 7f2a2831d640 1 -- 172.21.15.73:0/2839445521 shutdown_connections 2023-12-12T09:45:23.513 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:23.511+0000 7f2a2831d640 1 --2- 172.21.15.73:0/2839445521 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f2a0406ae40 0x7f2a0406d300 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:23.513 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:23.511+0000 7f2a2831d640 1 --2- 172.21.15.73:0/2839445521 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2a20151c30 0x7f2a20071f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:23.514 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:23.511+0000 7f2a2831d640 1 --2- 172.21.15.73:0/2839445521 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2a200c3930 0x7f2a20148550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:23.514 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:23.511+0000 7f2a2831d640 1 --2- 172.21.15.73:0/2839445521 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2a200bed50 0x7f2a2014e3b0 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:23.514 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:23.512+0000 7f2a2831d640 1 -- 172.21.15.73:0/2839445521 >> 172.21.15.73:0/2839445521 conn(0x7f2a2006a4e0 msgr2=0x7f2a200c4c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:45:23.515 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:23.514+0000 7f2a2831d640 1 -- 172.21.15.73:0/2839445521 shutdown_connections 2023-12-12T09:45:23.516 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:23.514+0000 7f2a2831d640 1 -- 172.21.15.73:0/2839445521 wait complete. 2023-12-12T09:45:23.562 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-12T09:45:23.741 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:23.740+0000 7f0f9b97c640 1 Processor -- start 2023-12-12T09:45:23.742 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:23.740+0000 7f0f9b97c640 1 -- start start 2023-12-12T09:45:23.743 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:23.742+0000 7f0f9b97c640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f0f9406a4e0 0x7f0f9406a8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:23.743 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:23.742+0000 7f0f9b97c640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f94158c00 con 0x7f0f940a5040 2023-12-12T09:45:23.743 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:23.742+0000 7f0f9b97c640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f940c4d00 con 0x7f0f9406bf90 2023-12-12T09:45:23.743 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:23.742+0000 7f0f9b97c640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f9406c400 con 0x7f0f9406a4e0 2023-12-12T09:45:23.743 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:23.742+0000 7f0f99718640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f0f940a5040 0x7f0f940c3ad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:35064/0 (socket says 172.21.15.73:35064) 2023-12-12T09:45:23.743 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:23.742+0000 7f0f99718640 1 -- 172.21.15.73:0/1579595363 learned_addr learned my addr 172.21.15.73:0/1579595363 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-12T09:45:23.745 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:23.742+0000 7f0f99f19640 1 --2- 172.21.15.73:0/1579595363 >> v2:172.21.15.142:3300/0 conn(0x7f0f9406a4e0 0x7f0f9406a8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:23.745 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:23.742+0000 7f0f8bfff640 1 -- 172.21.15.73:0/1579595363 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3188475743 0 0) 0x7f0f94158c00 con 0x7f0f940a5040 2023-12-12T09:45:23.745 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:23.742+0000 7f0f8bfff640 1 -- 172.21.15.73:0/1579595363 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0f80003520 con 0x7f0f940a5040 2023-12-12T09:45:23.745 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:23.743+0000 7f0f8bfff640 1 -- 172.21.15.73:0/1579595363 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 193656679 0 0) 0x7f0f80003520 con 0x7f0f940a5040 2023-12-12T09:45:23.745 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:23.743+0000 7f0f8bfff640 1 -- 172.21.15.73:0/1579595363 >> v2:172.21.15.142:3300/0 conn(0x7f0f9406a4e0 msgr2=0x7f0f9406a8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:45:23.746 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:23.743+0000 7f0f8bfff640 1 --2- 172.21.15.73:0/1579595363 >> v2:172.21.15.142:3300/0 conn(0x7f0f9406a4e0 0x7f0f9406a8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:23.746 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:23.743+0000 7f0f8bfff640 1 -- 172.21.15.73:0/1579595363 >> v1:172.21.15.142:6789/0 conn(0x7f0f9406bf90 legacy=0x7f0f941584f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:23.746 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:23.743+0000 7f0f8bfff640 1 -- 172.21.15.73:0/1579595363 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f940c5100 con 0x7f0f940a5040 2023-12-12T09:45:23.746 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:23.743+0000 7f0f8bfff640 1 -- 172.21.15.73:0/1579595363 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3186547832 0 0) 0x7f0f90001670 con 0x7f0f940a5040 2023-12-12T09:45:23.746 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:23.743+0000 7f0f8bfff640 1 -- 172.21.15.73:0/1579595363 >> v1:172.21.15.73:6789/0 conn(0x7f0f940a5040 legacy=0x7f0f940c3ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:23.746 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:23.743+0000 7f0f8bfff640 1 --2- 172.21.15.73:0/1579595363 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0f800039c0 0x7f0f80003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:23.746 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:23.743+0000 7f0f8bfff640 1 --2- 172.21.15.73:0/1579595363 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0f800047c0 0x7f0f80004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:23.746 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:23.743+0000 7f0f8bfff640 1 --2- 172.21.15.73:0/1579595363 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0f80005180 0x7f0f8000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:23.746 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:23.743+0000 7f0f8bfff640 1 -- 172.21.15.73:0/1579595363 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f9406c400 con 0x7f0f800047c0 2023-12-12T09:45:23.746 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:23.743+0000 7f0f8bfff640 1 -- 172.21.15.73:0/1579595363 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f8000c060 con 0x7f0f800039c0 2023-12-12T09:45:23.746 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:23.743+0000 7f0f8bfff640 1 -- 172.21.15.73:0/1579595363 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f8000c220 con 0x7f0f80005180 2023-12-12T09:45:23.746 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:23.743+0000 7f0f98f17640 1 --2- 172.21.15.73:0/1579595363 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0f800047c0 0x7f0f80004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:23.746 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:23.744+0000 7f0f99718640 1 --2- 172.21.15.73:0/1579595363 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0f800039c0 0x7f0f80003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:23.747 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:23.744+0000 7f0f99f19640 1 --2- 172.21.15.73:0/1579595363 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0f80005180 0x7f0f8000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:23.747 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:23.744+0000 7f0f98f17640 1 -- 172.21.15.73:0/1579595363 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0f80005180 msgr2=0x7f0f8000b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:45:23.747 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:23.744+0000 7f0f98f17640 1 --2- 172.21.15.73:0/1579595363 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0f80005180 0x7f0f8000b980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:23.747 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:23.744+0000 7f0f98f17640 1 -- 172.21.15.73:0/1579595363 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0f800039c0 msgr2=0x7f0f80003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:45:23.747 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:23.744+0000 7f0f98f17640 1 --2- 172.21.15.73:0/1579595363 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0f800039c0 0x7f0f80003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:23.747 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:23.744+0000 7f0f98f17640 1 -- 172.21.15.73:0/1579595363 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f80003520 con 0x7f0f800047c0 2023-12-12T09:45:23.747 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:23.744+0000 7f0f99f19640 1 -- 172.21.15.73:0/1579595363 reap_dead start 2023-12-12T09:45:23.748 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:23.745+0000 7f0f98f17640 1 --2- 172.21.15.73:0/1579595363 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0f800047c0 0x7f0f80004c40 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f0f84001750 tx=0x7f0f800057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4379ef26e6dc5e server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:45:23.748 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:23.745+0000 7f0f8bfff640 1 -- 172.21.15.73:0/1579595363 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f840052d0 con 0x7f0f800047c0 2023-12-12T09:45:23.748 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:23.745+0000 7f0f8bfff640 1 -- 172.21.15.73:0/1579595363 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f8402e050 con 0x7f0f800047c0 2023-12-12T09:45:23.748 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:23.745+0000 7f0f8bfff640 1 -- 172.21.15.73:0/1579595363 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f84003830 con 0x7f0f800047c0 2023-12-12T09:45:23.748 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:23.746+0000 7f0f9b97c640 1 -- 172.21.15.73:0/1579595363 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0f800047c0 msgr2=0x7f0f80004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:23.748 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:23.746+0000 7f0f9b97c640 1 --2- 172.21.15.73:0/1579595363 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0f800047c0 0x7f0f80004c40 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f0f84001750 tx=0x7f0f800057f0 comp rx=0 tx=0).stop 2023-12-12T09:45:23.748 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:23.746+0000 7f0f9b97c640 1 -- 172.21.15.73:0/1579595363 shutdown_connections 2023-12-12T09:45:23.748 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:23.746+0000 7f0f9b97c640 1 --2- 172.21.15.73:0/1579595363 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0f800047c0 0x7f0f80004c40 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:23.748 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:23.746+0000 7f0f9b97c640 1 -- 172.21.15.73:0/1579595363 >> 172.21.15.73:0/1579595363 conn(0x7f0f940a8130 msgr2=0x7f0f940c24b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:45:23.749 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:23.746+0000 7f0f9b97c640 1 -- 172.21.15.73:0/1579595363 shutdown_connections 2023-12-12T09:45:23.749 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:23.746+0000 7f0f9b97c640 1 -- 172.21.15.73:0/1579595363 wait complete. 2023-12-12T09:45:23.749 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:23.748+0000 7f0f9b97c640 1 Processor -- start 2023-12-12T09:45:23.749 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:23.748+0000 7f0f9b97c640 1 -- start start 2023-12-12T09:45:23.751 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:23.749+0000 7f0f9b97c640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0f800047c0 0x7f0f941e04e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:23.751 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:23.749+0000 7f0f9b97c640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0f940aa200 0x7f0f940706d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:23.751 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:23.749+0000 7f0f9b97c640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0f94070c10 0x7f0f941eda00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:23.751 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:23.749+0000 7f0f9b97c640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f940718d0 con 0x7f0f940aa200 2023-12-12T09:45:23.751 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:23.749+0000 7f0f9b97c640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f940a9d20 con 0x7f0f800047c0 2023-12-12T09:45:23.751 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:23.749+0000 7f0f9b97c640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f941ee610 con 0x7f0f94070c10 2023-12-12T09:45:23.751 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:23.749+0000 7f0f98f17640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0f940aa200 0x7f0f940706d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:23.751 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:23.749+0000 7f0f98f17640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0f940aa200 0x7f0f940706d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:45284/0 (socket says 172.21.15.73:45284) 2023-12-12T09:45:23.751 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:23.749+0000 7f0f98f17640 1 -- 172.21.15.73:0/1522669312 learned_addr learned my addr 172.21.15.73:0/1522669312 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:45:23.751 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:23.749+0000 7f0f99f19640 1 --2- 172.21.15.73:0/1522669312 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0f94070c10 0x7f0f941eda00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:23.751 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:23.749+0000 7f0f98f17640 1 -- 172.21.15.73:0/1522669312 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0f94070c10 msgr2=0x7f0f941eda00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:23.751 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:23.749+0000 7f0f98f17640 1 --2- 172.21.15.73:0/1522669312 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0f94070c10 0x7f0f941eda00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:23.752 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:23.749+0000 7f0f99718640 1 --2- 172.21.15.73:0/1522669312 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0f800047c0 0x7f0f941e04e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:23.752 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:23.749+0000 7f0f98f17640 1 -- 172.21.15.73:0/1522669312 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0f800047c0 msgr2=0x7f0f941e04e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:23.752 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:23.749+0000 7f0f98f17640 1 --2- 172.21.15.73:0/1522669312 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0f800047c0 0x7f0f941e04e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:23.752 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:23.749+0000 7f0f98f17640 1 -- 172.21.15.73:0/1522669312 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f940a9230 con 0x7f0f940aa200 2023-12-12T09:45:23.752 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:23.750+0000 7f0f98f17640 1 --2- 172.21.15.73:0/1522669312 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0f940aa200 0x7f0f940706d0 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f0f84000c00 tx=0x7f0f84001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:45:23.753 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:23.750+0000 7f0f89ffb640 1 -- 172.21.15.73:0/1522669312 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f840076c0 con 0x7f0f940aa200 2023-12-12T09:45:23.753 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:23.750+0000 7f0f89ffb640 1 -- 172.21.15.73:0/1522669312 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f84007a30 con 0x7f0f940aa200 2023-12-12T09:45:23.753 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:23.750+0000 7f0f9b97c640 1 -- 172.21.15.73:0/1522669312 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f940a9510 con 0x7f0f940aa200 2023-12-12T09:45:23.753 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:23.750+0000 7f0f89ffb640 1 -- 172.21.15.73:0/1522669312 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f84006be0 con 0x7f0f940aa200 2023-12-12T09:45:23.753 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:23.750+0000 7f0f9b97c640 1 -- 172.21.15.73:0/1522669312 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f940aaa00 con 0x7f0f940aa200 2023-12-12T09:45:23.753 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:23.751+0000 7f0f9b97c640 1 -- 172.21.15.73:0/1522669312 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f940a9e90 con 0x7f0f940aa200 2023-12-12T09:45:23.753 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:23.752+0000 7f0f89ffb640 1 -- 172.21.15.73:0/1522669312 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f0f84006d40 con 0x7f0f940aa200 2023-12-12T09:45:23.755 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:23.753+0000 7f0f89ffb640 1 --2- 172.21.15.73:0/1522669312 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f0f7806ae70 0x7f0f7806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:23.755 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:23.754+0000 7f0f89ffb640 1 -- 172.21.15.73:0/1522669312 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0f840ab2c0 con 0x7f0f940aa200 2023-12-12T09:45:23.755 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:23.754+0000 7f0f99718640 1 --2- 172.21.15.73:0/1522669312 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f0f7806ae70 0x7f0f7806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:23.755 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:23.754+0000 7f0f99718640 1 --2- 172.21.15.73:0/1522669312 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f0f7806ae70 0x7f0f7806d330 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f0f94156540 tx=0x7f0f90000ed0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:45:23.759 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:23.758+0000 7f0f89ffb640 1 -- 172.21.15.73:0/1522669312 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f0f940a9e90 con 0x7f0f940aa200 2023-12-12T09:45:23.942 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:23.940+0000 7f0f9b97c640 1 -- 172.21.15.73:0/1522669312 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0f940a9e90 con 0x7f0f940aa200 2023-12-12T09:45:23.945 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:23.943+0000 7f0f89ffb640 1 -- 172.21.15.73:0/1522669312 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v53) v1 ==== 74+0+16590 (secure 0 0 0) 0x7f0f940a9e90 con 0x7f0f940aa200 2023-12-12T09:45:23.945 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-12T09:45:23.945 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":53,"fsid":"ba240992-02b8-4c7e-92f2-27eb29ac433b","created":"2023-12-12T09:43:02.454719+0000","modified":"2023-12-12T09:45:22.970493+0000","last_up_change":"2023-12-12T09:43:13.913440+0000","last_in_change":"2023-12-12T09:43:05.925348+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-12T09:43:15.525508+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-12-12T09:45:21.264815+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"53","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-12-12T09:45:21.981834+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"53","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"dd9074be-dbe2-4c34-9896-a4223d8d3940","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":4047810203},{"type":"v1","addr":"172.21.15.73:6801","nonce":4047810203}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":4047810203},{"type":"v1","addr":"172.21.15.73:6803","nonce":4047810203}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":4047810203},{"type":"v1","addr":"172.21.15.73:6807","nonce":4047810203}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":4047810203},{"type":"v1","addr":"172.21.15.73:6805","nonce":4047810203}]},"public_addr":"172.21.15.73:6801/4047810203","cluster_addr":"172.21.15.73:6803/4047810203","heartbeat_back_addr":"172.21.15.73:6807/4047810203","heartbeat_front_addr":"172.21.15.73:6805/4047810203","state":["exists","up"]},{"osd":1,"uuid":"c4a05052-96d4-4758-a4e1-1a37f1e07fed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":1356058331},{"type":"v1","addr":"172.21.15.73:6824","nonce":1356058331}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":1356058331},{"type":"v1","addr":"172.21.15.73:6827","nonce":1356058331}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":1356058331},{"type":"v1","addr":"172.21.15.73:6831","nonce":1356058331}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":1356058331},{"type":"v1","addr":"172.21.15.73:6829","nonce":1356058331}]},"public_addr":"172.21.15.73:6824/1356058331","cluster_addr":"172.21.15.73:6827/1356058331","heartbeat_back_addr":"172.21.15.73:6831/1356058331","heartbeat_front_addr":"172.21.15.73:6829/1356058331","state":["exists","up"]},{"osd":2,"uuid":"512bc8ac-72c2-40d4-b3d2-d867a92c5213","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":1228903316},{"type":"v1","addr":"172.21.15.73:6817","nonce":1228903316}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":1228903316},{"type":"v1","addr":"172.21.15.73:6819","nonce":1228903316}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6823","nonce":1228903316},{"type":"v1","addr":"172.21.15.73:6825","nonce":1228903316}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":1228903316},{"type":"v1","addr":"172.21.15.73:6821","nonce":1228903316}]},"public_addr":"172.21.15.73:6817/1228903316","cluster_addr":"172.21.15.73:6819/1228903316","heartbeat_back_addr":"172.21.15.73:6825/1228903316","heartbeat_front_addr":"172.21.15.73:6821/1228903316","state":["exists","up"]},{"osd":3,"uuid":"3d1a91e0-42bf-437a-8eae-8d357c8f63a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":1293329670},{"type":"v1","addr":"172.21.15.73:6809","nonce":1293329670}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6810","nonce":1293329670},{"type":"v1","addr":"172.21.15.73:6811","nonce":1293329670}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":1293329670},{"type":"v1","addr":"172.21.15.73:6815","nonce":1293329670}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":1293329670},{"type":"v1","addr":"172.21.15.73:6813","nonce":1293329670}]},"public_addr":"172.21.15.73:6809/1293329670","cluster_addr":"172.21.15.73:6811/1293329670","heartbeat_back_addr":"172.21.15.73:6815/1293329670","heartbeat_front_addr":"172.21.15.73:6813/1293329670","state":["exists","up"]},{"osd":4,"uuid":"4b302fff-834c-4069-ac19-00e46f6c87b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":3727975702},{"type":"v1","addr":"172.21.15.142:6801","nonce":3727975702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":3727975702},{"type":"v1","addr":"172.21.15.142:6803","nonce":3727975702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6809","nonce":3727975702},{"type":"v1","addr":"172.21.15.142:6811","nonce":3727975702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6805","nonce":3727975702},{"type":"v1","addr":"172.21.15.142:6807","nonce":3727975702}]},"public_addr":"172.21.15.142:6801/3727975702","cluster_addr":"172.21.15.142:6803/3727975702","heartbeat_back_addr":"172.21.15.142:6811/3727975702","heartbeat_front_addr":"172.21.15.142:6807/3727975702","state":["exists","up"]},{"osd":5,"uuid":"d7cdace2-67d0-45cc-95f2-515cf6ef1b82","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6817","nonce":2353193632},{"type":"v1","addr":"172.21.15.142:6819","nonce":2353193632}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6821","nonce":2353193632},{"type":"v1","addr":"172.21.15.142:6823","nonce":2353193632}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6829","nonce":2353193632},{"type":"v1","addr":"172.21.15.142:6831","nonce":2353193632}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6825","nonce":2353193632},{"type":"v1","addr":"172.21.15.142:6827","nonce":2353193632}]},"public_addr":"172.21.15.142:6819/2353193632","cluster_addr":"172.21.15.142:6823/2353193632","heartbeat_back_addr":"172.21.15.142:6831/2353193632","heartbeat_front_addr":"172.21.15.142:6827/2353193632","state":["exists","up"]},{"osd":6,"uuid":"649ce78a-5626-445c-aedc-a651ed05a6f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":2006111986},{"type":"v1","addr":"172.21.15.142:6806","nonce":2006111986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":2006111986},{"type":"v1","addr":"172.21.15.142:6810","nonce":2006111986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":2006111986},{"type":"v1","addr":"172.21.15.142:6815","nonce":2006111986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":2006111986},{"type":"v1","addr":"172.21.15.142:6813","nonce":2006111986}]},"public_addr":"172.21.15.142:6806/2006111986","cluster_addr":"172.21.15.142:6810/2006111986","heartbeat_back_addr":"172.21.15.142:6815/2006111986","heartbeat_front_addr":"172.21.15.142:6813/2006111986","state":["exists","up"]},{"osd":7,"uuid":"af15ae3b-c1d0-4acf-92db-8a1805494d13","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":2573794341},{"type":"v1","addr":"172.21.15.142:6818","nonce":2573794341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":2573794341},{"type":"v1","addr":"172.21.15.142:6822","nonce":2573794341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":2573794341},{"type":"v1","addr":"172.21.15.142:6830","nonce":2573794341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":2573794341},{"type":"v1","addr":"172.21.15.142:6826","nonce":2573794341}]},"public_addr":"172.21.15.142:6818/2573794341","cluster_addr":"172.21.15.142:6822/2573794341","heartbeat_back_addr":"172.21.15.142:6830/2573794341","heartbeat_front_addr":"172.21.15.142:6826/2573794341","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.185824+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.262103+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.225556+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:10.523459+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:10.706035+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.257339+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.301776+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.051960+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-12T09:45:23.948 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:23.946+0000 7f0f9b97c640 1 -- 172.21.15.73:0/1522669312 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f0f7806ae70 msgr2=0x7f0f7806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:23.948 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:23.946+0000 7f0f9b97c640 1 --2- 172.21.15.73:0/1522669312 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f0f7806ae70 0x7f0f7806d330 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f0f94156540 tx=0x7f0f90000ed0 comp rx=0 tx=0).stop 2023-12-12T09:45:23.948 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:23.946+0000 7f0f9b97c640 1 -- 172.21.15.73:0/1522669312 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0f940aa200 msgr2=0x7f0f940706d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:23.948 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:23.946+0000 7f0f9b97c640 1 --2- 172.21.15.73:0/1522669312 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0f940aa200 0x7f0f940706d0 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f0f84000c00 tx=0x7f0f84001120 comp rx=0 tx=0).stop 2023-12-12T09:45:23.948 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:23.946+0000 7f0f9b97c640 1 -- 172.21.15.73:0/1522669312 shutdown_connections 2023-12-12T09:45:23.948 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:23.946+0000 7f0f9b97c640 1 --2- 172.21.15.73:0/1522669312 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f0f7806ae70 0x7f0f7806d330 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:23.948 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:23.946+0000 7f0f9b97c640 1 --2- 172.21.15.73:0/1522669312 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0f94070c10 0x7f0f941eda00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:23.948 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:23.946+0000 7f0f9b97c640 1 --2- 172.21.15.73:0/1522669312 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0f940aa200 0x7f0f940706d0 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:23.948 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:23.946+0000 7f0f9b97c640 1 --2- 172.21.15.73:0/1522669312 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0f800047c0 0x7f0f941e04e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:23.948 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:23.946+0000 7f0f9b97c640 1 -- 172.21.15.73:0/1522669312 >> 172.21.15.73:0/1522669312 conn(0x7f0f940a8130 msgr2=0x7f0f94158460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:45:23.948 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:23.946+0000 7f0f9b97c640 1 -- 172.21.15.73:0/1522669312 shutdown_connections 2023-12-12T09:45:23.948 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:23.947+0000 7f0f9b97c640 1 -- 172.21.15.73:0/1522669312 wait complete. 2023-12-12T09:45:23.966 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-12T09:45:24.166 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:24.165+0000 7f66f430f640 1 Processor -- start 2023-12-12T09:45:24.166 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:24.165+0000 7f66f430f640 1 -- start start 2023-12-12T09:45:24.167 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:24.166+0000 7f66f430f640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f66ec06db70 0x7f66ec0c39b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:24.168 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:24.166+0000 7f66f430f640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66ec152610 con 0x7f66ec0c5070 2023-12-12T09:45:24.168 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:24.166+0000 7f66f430f640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66ec1528f0 con 0x7f66ec14fa40 2023-12-12T09:45:24.168 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:24.166+0000 7f66f430f640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66ec152bd0 con 0x7f66ec06db70 2023-12-12T09:45:24.170 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:24.167+0000 7f66f28ac640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f66ec0c5070 0x7f66ec0c3ef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:35068/0 (socket says 172.21.15.73:35068) 2023-12-12T09:45:24.170 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:24.167+0000 7f66f28ac640 1 -- 172.21.15.73:0/2290416032 learned_addr learned my addr 172.21.15.73:0/2290416032 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-12T09:45:24.171 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:24.167+0000 7f66f18aa640 1 --2- 172.21.15.73:0/2290416032 >> v2:172.21.15.142:3300/0 conn(0x7f66ec06db70 0x7f66ec0c39b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:24.171 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:24.167+0000 7f66f10a9640 1 -- 172.21.15.73:0/2290416032 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 672159970 0 0) 0x7f66ec152610 con 0x7f66ec0c5070 2023-12-12T09:45:24.171 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:24.167+0000 7f66f10a9640 1 -- 172.21.15.73:0/2290416032 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f66d8003520 con 0x7f66ec0c5070 2023-12-12T09:45:24.171 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:24.168+0000 7f66f10a9640 1 -- 172.21.15.73:0/2290416032 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 208969512 0 0) 0x7f66d8003520 con 0x7f66ec0c5070 2023-12-12T09:45:24.171 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:24.168+0000 7f66f10a9640 1 -- 172.21.15.73:0/2290416032 >> v2:172.21.15.142:3300/0 conn(0x7f66ec06db70 msgr2=0x7f66ec0c39b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:45:24.171 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:24.168+0000 7f66f10a9640 1 --2- 172.21.15.73:0/2290416032 >> v2:172.21.15.142:3300/0 conn(0x7f66ec06db70 0x7f66ec0c39b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:24.171 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:24.168+0000 7f66f10a9640 1 -- 172.21.15.73:0/2290416032 >> v1:172.21.15.142:6789/0 conn(0x7f66ec14fa40 legacy=0x7f66ec06a4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:24.171 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:24.168+0000 7f66f10a9640 1 -- 172.21.15.73:0/2290416032 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66ec152eb0 con 0x7f66ec0c5070 2023-12-12T09:45:24.171 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:24.168+0000 7f66f10a9640 1 -- 172.21.15.73:0/2290416032 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3186547832 0 0) 0x7f66e40019f0 con 0x7f66ec0c5070 2023-12-12T09:45:24.171 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:24.168+0000 7f66f10a9640 1 -- 172.21.15.73:0/2290416032 >> v1:172.21.15.73:6789/0 conn(0x7f66ec0c5070 legacy=0x7f66ec0c3ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:24.171 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:24.168+0000 7f66f10a9640 1 --2- 172.21.15.73:0/2290416032 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f66d80039c0 0x7f66d8003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:24.171 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:24.168+0000 7f66f10a9640 1 --2- 172.21.15.73:0/2290416032 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f66d80047c0 0x7f66d8004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:24.171 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:24.168+0000 7f66f10a9640 1 --2- 172.21.15.73:0/2290416032 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f66d8005180 0x7f66d800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:24.171 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:24.168+0000 7f66f10a9640 1 -- 172.21.15.73:0/2290416032 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66ec152bd0 con 0x7f66d8005180 2023-12-12T09:45:24.172 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:24.168+0000 7f66f10a9640 1 -- 172.21.15.73:0/2290416032 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66d800c080 con 0x7f66d80039c0 2023-12-12T09:45:24.172 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:24.168+0000 7f66f10a9640 1 -- 172.21.15.73:0/2290416032 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66d800c240 con 0x7f66d80047c0 2023-12-12T09:45:24.172 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:24.168+0000 7f66f28ac640 1 --2- 172.21.15.73:0/2290416032 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f66d8005180 0x7f66d800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:24.172 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:24.168+0000 7f66f20ab640 1 --2- 172.21.15.73:0/2290416032 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f66d80039c0 0x7f66d8003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:24.172 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:24.169+0000 7f66f18aa640 1 --2- 172.21.15.73:0/2290416032 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f66d80047c0 0x7f66d8004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:24.172 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:24.169+0000 7f66f28ac640 1 -- 172.21.15.73:0/2290416032 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f66d80047c0 msgr2=0x7f66d8004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:45:24.172 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:24.169+0000 7f66f28ac640 1 --2- 172.21.15.73:0/2290416032 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f66d80047c0 0x7f66d8004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:24.172 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:24.169+0000 7f66f28ac640 1 -- 172.21.15.73:0/2290416032 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f66d80039c0 msgr2=0x7f66d8003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:45:24.173 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:24.169+0000 7f66f28ac640 1 --2- 172.21.15.73:0/2290416032 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f66d80039c0 0x7f66d8003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:24.173 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:24.169+0000 7f66f28ac640 1 -- 172.21.15.73:0/2290416032 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66d8003520 con 0x7f66d8005180 2023-12-12T09:45:24.173 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:24.169+0000 7f66f20ab640 1 --2- 172.21.15.73:0/2290416032 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f66d80039c0 0x7f66d8003de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-12T09:45:24.174 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:24.170+0000 7f66f28ac640 1 -- 172.21.15.73:0/2290416032 reap_dead start 2023-12-12T09:45:24.174 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:24.170+0000 7f66f28ac640 1 --2- 172.21.15.73:0/2290416032 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f66d8005180 0x7f66d800b980 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f66e400a760 tx=0x7f66d80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a343787ab82a3791 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:45:24.174 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:24.170+0000 7f66f10a9640 1 -- 172.21.15.73:0/2290416032 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66e4034630 con 0x7f66d8005180 2023-12-12T09:45:24.174 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:24.170+0000 7f66f10a9640 1 -- 172.21.15.73:0/2290416032 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66e402f070 con 0x7f66d8005180 2023-12-12T09:45:24.175 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:24.170+0000 7f66f10a9640 1 -- 172.21.15.73:0/2290416032 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66e40349f0 con 0x7f66d8005180 2023-12-12T09:45:24.175 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:24.171+0000 7f66f430f640 1 -- 172.21.15.73:0/2290416032 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f66d8005180 msgr2=0x7f66d800b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:24.175 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:24.171+0000 7f66f430f640 1 --2- 172.21.15.73:0/2290416032 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f66d8005180 0x7f66d800b980 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f66e400a760 tx=0x7f66d80057f0 comp rx=0 tx=0).stop 2023-12-12T09:45:24.175 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:24.171+0000 7f66f430f640 1 -- 172.21.15.73:0/2290416032 shutdown_connections 2023-12-12T09:45:24.175 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:24.171+0000 7f66f430f640 1 --2- 172.21.15.73:0/2290416032 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f66d8005180 0x7f66d800b980 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:24.175 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:24.171+0000 7f66f430f640 1 -- 172.21.15.73:0/2290416032 >> 172.21.15.73:0/2290416032 conn(0x7f66ec0a8130 msgr2=0x7f66ec0c24b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:45:24.175 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:24.171+0000 7f66f430f640 1 -- 172.21.15.73:0/2290416032 shutdown_connections 2023-12-12T09:45:24.175 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:24.171+0000 7f66f430f640 1 -- 172.21.15.73:0/2290416032 wait complete. 2023-12-12T09:45:24.175 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:24.173+0000 7f66f430f640 1 Processor -- start 2023-12-12T09:45:24.175 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:24.173+0000 7f66f430f640 1 -- start start 2023-12-12T09:45:24.177 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:24.174+0000 7f66f430f640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f66d8005180 0x7f66ec070f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:24.177 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:24.174+0000 7f66f430f640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f66ec153d10 0x7f66ec155d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:24.177 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:24.174+0000 7f66f430f640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f66ec1502e0 0x7f66ec14c050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:24.177 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:24.174+0000 7f66f430f640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66ec071460 con 0x7f66ec1502e0 2023-12-12T09:45:24.177 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:24.174+0000 7f66f430f640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66ec156860 con 0x7f66ec153d10 2023-12-12T09:45:24.177 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:24.174+0000 7f66f430f640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66ec154370 con 0x7f66d8005180 2023-12-12T09:45:24.178 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:24.174+0000 7f66f28ac640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f66ec1502e0 0x7f66ec14c050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:24.178 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:24.174+0000 7f66f28ac640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f66ec1502e0 0x7f66ec14c050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:45310/0 (socket says 172.21.15.73:45310) 2023-12-12T09:45:24.178 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:24.174+0000 7f66f28ac640 1 -- 172.21.15.73:0/3191052686 learned_addr learned my addr 172.21.15.73:0/3191052686 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:45:24.178 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:24.174+0000 7f66f18aa640 1 --2- 172.21.15.73:0/3191052686 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f66ec153d10 0x7f66ec155d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:24.178 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:24.174+0000 7f66f28ac640 1 -- 172.21.15.73:0/3191052686 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f66d8005180 msgr2=0x7f66ec070f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:24.178 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:24.174+0000 7f66f20ab640 1 --2- 172.21.15.73:0/3191052686 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f66d8005180 0x7f66ec070f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:24.178 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:24.174+0000 7f66f28ac640 1 --2- 172.21.15.73:0/3191052686 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f66d8005180 0x7f66ec070f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:24.178 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:24.174+0000 7f66f28ac640 1 -- 172.21.15.73:0/3191052686 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f66ec153d10 msgr2=0x7f66ec155d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:24.178 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:24.174+0000 7f66f28ac640 1 --2- 172.21.15.73:0/3191052686 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f66ec153d10 0x7f66ec155d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:24.178 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:24.174+0000 7f66f28ac640 1 -- 172.21.15.73:0/3191052686 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66ec071ac0 con 0x7f66ec1502e0 2023-12-12T09:45:24.178 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:24.174+0000 7f66f18aa640 1 --2- 172.21.15.73:0/3191052686 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f66ec153d10 0x7f66ec155d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:45:24.178 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:24.175+0000 7f66f28ac640 1 --2- 172.21.15.73:0/3191052686 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f66ec1502e0 0x7f66ec14c050 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f66e400a760 tx=0x7f66e4001cb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:45:24.178 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:24.175+0000 7f66e2ffd640 1 -- 172.21.15.73:0/3191052686 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66e4040680 con 0x7f66ec1502e0 2023-12-12T09:45:24.178 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:24.175+0000 7f66e2ffd640 1 -- 172.21.15.73:0/3191052686 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66e40407e0 con 0x7f66ec1502e0 2023-12-12T09:45:24.179 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:24.175+0000 7f66e2ffd640 1 -- 172.21.15.73:0/3191052686 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66e4040b70 con 0x7f66ec1502e0 2023-12-12T09:45:24.179 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:24.175+0000 7f66f430f640 1 -- 172.21.15.73:0/3191052686 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66ec156580 con 0x7f66ec1502e0 2023-12-12T09:45:24.179 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:24.175+0000 7f66f430f640 1 -- 172.21.15.73:0/3191052686 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66ec071da0 con 0x7f66ec1502e0 2023-12-12T09:45:24.179 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:24.176+0000 7f66f430f640 1 -- 172.21.15.73:0/3191052686 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f66ec067580 con 0x7f66ec1502e0 2023-12-12T09:45:24.180 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:24.177+0000 7f66e2ffd640 1 -- 172.21.15.73:0/3191052686 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f66e4031030 con 0x7f66ec1502e0 2023-12-12T09:45:24.180 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:24.178+0000 7f66e2ffd640 1 --2- 172.21.15.73:0/3191052686 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f66d006ae40 0x7f66d006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:24.180 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:24.178+0000 7f66e2ffd640 1 -- 172.21.15.73:0/3191052686 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f66e40ab260 con 0x7f66ec1502e0 2023-12-12T09:45:24.180 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:24.178+0000 7f66f20ab640 1 --2- 172.21.15.73:0/3191052686 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f66d006ae40 0x7f66d006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:24.180 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:24.179+0000 7f66f20ab640 1 --2- 172.21.15.73:0/3191052686 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f66d006ae40 0x7f66d006d300 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f66e8001530 tx=0x7f66e8009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:45:24.183 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:24.182+0000 7f66e2ffd640 1 -- 172.21.15.73:0/3191052686 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f66e40763a0 con 0x7f66ec1502e0 2023-12-12T09:45:24.376 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:24.374+0000 7f66f430f640 1 -- 172.21.15.73:0/3191052686 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f66ec0bf890 con 0x7f66ec1502e0 2023-12-12T09:45:24.379 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:24.377+0000 7f66e2ffd640 1 -- 172.21.15.73:0/3191052686 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v53) v1 ==== 74+0+16590 (secure 0 0 0) 0x7f66e40799c0 con 0x7f66ec1502e0 2023-12-12T09:45:24.379 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-12T09:45:24.379 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":53,"fsid":"ba240992-02b8-4c7e-92f2-27eb29ac433b","created":"2023-12-12T09:43:02.454719+0000","modified":"2023-12-12T09:45:22.970493+0000","last_up_change":"2023-12-12T09:43:13.913440+0000","last_in_change":"2023-12-12T09:43:05.925348+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-12T09:43:15.525508+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-12-12T09:45:21.264815+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"53","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-12-12T09:45:21.981834+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"53","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"dd9074be-dbe2-4c34-9896-a4223d8d3940","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":4047810203},{"type":"v1","addr":"172.21.15.73:6801","nonce":4047810203}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":4047810203},{"type":"v1","addr":"172.21.15.73:6803","nonce":4047810203}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":4047810203},{"type":"v1","addr":"172.21.15.73:6807","nonce":4047810203}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":4047810203},{"type":"v1","addr":"172.21.15.73:6805","nonce":4047810203}]},"public_addr":"172.21.15.73:6801/4047810203","cluster_addr":"172.21.15.73:6803/4047810203","heartbeat_back_addr":"172.21.15.73:6807/4047810203","heartbeat_front_addr":"172.21.15.73:6805/4047810203","state":["exists","up"]},{"osd":1,"uuid":"c4a05052-96d4-4758-a4e1-1a37f1e07fed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":1356058331},{"type":"v1","addr":"172.21.15.73:6824","nonce":1356058331}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":1356058331},{"type":"v1","addr":"172.21.15.73:6827","nonce":1356058331}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":1356058331},{"type":"v1","addr":"172.21.15.73:6831","nonce":1356058331}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":1356058331},{"type":"v1","addr":"172.21.15.73:6829","nonce":1356058331}]},"public_addr":"172.21.15.73:6824/1356058331","cluster_addr":"172.21.15.73:6827/1356058331","heartbeat_back_addr":"172.21.15.73:6831/1356058331","heartbeat_front_addr":"172.21.15.73:6829/1356058331","state":["exists","up"]},{"osd":2,"uuid":"512bc8ac-72c2-40d4-b3d2-d867a92c5213","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":1228903316},{"type":"v1","addr":"172.21.15.73:6817","nonce":1228903316}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":1228903316},{"type":"v1","addr":"172.21.15.73:6819","nonce":1228903316}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6823","nonce":1228903316},{"type":"v1","addr":"172.21.15.73:6825","nonce":1228903316}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":1228903316},{"type":"v1","addr":"172.21.15.73:6821","nonce":1228903316}]},"public_addr":"172.21.15.73:6817/1228903316","cluster_addr":"172.21.15.73:6819/1228903316","heartbeat_back_addr":"172.21.15.73:6825/1228903316","heartbeat_front_addr":"172.21.15.73:6821/1228903316","state":["exists","up"]},{"osd":3,"uuid":"3d1a91e0-42bf-437a-8eae-8d357c8f63a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":1293329670},{"type":"v1","addr":"172.21.15.73:6809","nonce":1293329670}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6810","nonce":1293329670},{"type":"v1","addr":"172.21.15.73:6811","nonce":1293329670}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":1293329670},{"type":"v1","addr":"172.21.15.73:6815","nonce":1293329670}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":1293329670},{"type":"v1","addr":"172.21.15.73:6813","nonce":1293329670}]},"public_addr":"172.21.15.73:6809/1293329670","cluster_addr":"172.21.15.73:6811/1293329670","heartbeat_back_addr":"172.21.15.73:6815/1293329670","heartbeat_front_addr":"172.21.15.73:6813/1293329670","state":["exists","up"]},{"osd":4,"uuid":"4b302fff-834c-4069-ac19-00e46f6c87b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":3727975702},{"type":"v1","addr":"172.21.15.142:6801","nonce":3727975702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":3727975702},{"type":"v1","addr":"172.21.15.142:6803","nonce":3727975702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6809","nonce":3727975702},{"type":"v1","addr":"172.21.15.142:6811","nonce":3727975702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6805","nonce":3727975702},{"type":"v1","addr":"172.21.15.142:6807","nonce":3727975702}]},"public_addr":"172.21.15.142:6801/3727975702","cluster_addr":"172.21.15.142:6803/3727975702","heartbeat_back_addr":"172.21.15.142:6811/3727975702","heartbeat_front_addr":"172.21.15.142:6807/3727975702","state":["exists","up"]},{"osd":5,"uuid":"d7cdace2-67d0-45cc-95f2-515cf6ef1b82","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6817","nonce":2353193632},{"type":"v1","addr":"172.21.15.142:6819","nonce":2353193632}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6821","nonce":2353193632},{"type":"v1","addr":"172.21.15.142:6823","nonce":2353193632}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6829","nonce":2353193632},{"type":"v1","addr":"172.21.15.142:6831","nonce":2353193632}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6825","nonce":2353193632},{"type":"v1","addr":"172.21.15.142:6827","nonce":2353193632}]},"public_addr":"172.21.15.142:6819/2353193632","cluster_addr":"172.21.15.142:6823/2353193632","heartbeat_back_addr":"172.21.15.142:6831/2353193632","heartbeat_front_addr":"172.21.15.142:6827/2353193632","state":["exists","up"]},{"osd":6,"uuid":"649ce78a-5626-445c-aedc-a651ed05a6f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":2006111986},{"type":"v1","addr":"172.21.15.142:6806","nonce":2006111986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":2006111986},{"type":"v1","addr":"172.21.15.142:6810","nonce":2006111986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":2006111986},{"type":"v1","addr":"172.21.15.142:6815","nonce":2006111986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":2006111986},{"type":"v1","addr":"172.21.15.142:6813","nonce":2006111986}]},"public_addr":"172.21.15.142:6806/2006111986","cluster_addr":"172.21.15.142:6810/2006111986","heartbeat_back_addr":"172.21.15.142:6815/2006111986","heartbeat_front_addr":"172.21.15.142:6813/2006111986","state":["exists","up"]},{"osd":7,"uuid":"af15ae3b-c1d0-4acf-92db-8a1805494d13","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":2573794341},{"type":"v1","addr":"172.21.15.142:6818","nonce":2573794341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":2573794341},{"type":"v1","addr":"172.21.15.142:6822","nonce":2573794341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":2573794341},{"type":"v1","addr":"172.21.15.142:6830","nonce":2573794341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":2573794341},{"type":"v1","addr":"172.21.15.142:6826","nonce":2573794341}]},"public_addr":"172.21.15.142:6818/2573794341","cluster_addr":"172.21.15.142:6822/2573794341","heartbeat_back_addr":"172.21.15.142:6830/2573794341","heartbeat_front_addr":"172.21.15.142:6826/2573794341","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.185824+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.262103+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.225556+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:10.523459+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:10.706035+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.257339+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.301776+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.051960+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-12T09:45:24.382 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:24.380+0000 7f66f430f640 1 -- 172.21.15.73:0/3191052686 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f66d006ae40 msgr2=0x7f66d006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:24.382 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:24.380+0000 7f66f430f640 1 --2- 172.21.15.73:0/3191052686 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f66d006ae40 0x7f66d006d300 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f66e8001530 tx=0x7f66e8009040 comp rx=0 tx=0).stop 2023-12-12T09:45:24.382 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:24.380+0000 7f66f430f640 1 -- 172.21.15.73:0/3191052686 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f66ec1502e0 msgr2=0x7f66ec14c050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:24.382 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:24.380+0000 7f66f430f640 1 --2- 172.21.15.73:0/3191052686 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f66ec1502e0 0x7f66ec14c050 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f66e400a760 tx=0x7f66e4001cb0 comp rx=0 tx=0).stop 2023-12-12T09:45:24.382 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:24.380+0000 7f66f430f640 1 -- 172.21.15.73:0/3191052686 shutdown_connections 2023-12-12T09:45:24.382 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:24.380+0000 7f66f430f640 1 --2- 172.21.15.73:0/3191052686 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f66d006ae40 0x7f66d006d300 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:24.382 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:24.380+0000 7f66f430f640 1 --2- 172.21.15.73:0/3191052686 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f66ec1502e0 0x7f66ec14c050 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:24.382 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:24.380+0000 7f66f430f640 1 --2- 172.21.15.73:0/3191052686 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f66ec153d10 0x7f66ec155d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:24.382 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:24.380+0000 7f66f430f640 1 --2- 172.21.15.73:0/3191052686 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f66d8005180 0x7f66ec070f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:24.383 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:24.380+0000 7f66f430f640 1 -- 172.21.15.73:0/3191052686 >> 172.21.15.73:0/3191052686 conn(0x7f66ec0a8130 msgr2=0x7f66ec0bede0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:45:24.383 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:24.381+0000 7f66f430f640 1 -- 172.21.15.73:0/3191052686 shutdown_connections 2023-12-12T09:45:24.383 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:24.381+0000 7f66f430f640 1 -- 172.21.15.73:0/3191052686 wait complete. 2023-12-12T09:45:24.401 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-12-12T09:45:24.623 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:24.621+0000 7f1c03ead640 1 Processor -- start 2023-12-12T09:45:24.623 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:24.622+0000 7f1c03ead640 1 -- start start 2023-12-12T09:45:24.624 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:24.623+0000 7f1c03ead640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1bfc14ea60 0x7f1bfc0c5420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:24.624 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:24.623+0000 7f1c03ead640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1bfc0c3390 con 0x7f1bfc0c0320 2023-12-12T09:45:24.624 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:24.623+0000 7f1c03ead640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1bfc0c4b30 con 0x7f1bfc0a4c90 2023-12-12T09:45:24.624 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:24.623+0000 7f1c03ead640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1bfc151e60 con 0x7f1bfc14ea60 2023-12-12T09:45:24.626 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:24.623+0000 7f1c0244a640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f1bfc0c0320 0x7f1bfc0c20b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:35078/0 (socket says 172.21.15.73:35078) 2023-12-12T09:45:24.626 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:24.623+0000 7f1c0244a640 1 -- 172.21.15.73:0/4076991408 learned_addr learned my addr 172.21.15.73:0/4076991408 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-12T09:45:24.626 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:24.624+0000 7f1c01c49640 1 --2- 172.21.15.73:0/4076991408 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1bfc14ea60 0x7f1bfc0c5420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:24.626 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:24.624+0000 7f1c00c47640 1 -- 172.21.15.73:0/4076991408 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3663162792 0 0) 0x7f1bfc0c3390 con 0x7f1bfc0c0320 2023-12-12T09:45:24.626 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:24.624+0000 7f1c00c47640 1 -- 172.21.15.73:0/4076991408 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1be8003520 con 0x7f1bfc0c0320 2023-12-12T09:45:24.626 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:24.624+0000 7f1c00c47640 1 -- 172.21.15.73:0/4076991408 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1015087714 0 0) 0x7f1be8003520 con 0x7f1bfc0c0320 2023-12-12T09:45:24.626 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:24.624+0000 7f1c00c47640 1 -- 172.21.15.73:0/4076991408 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1bfc14ea60 msgr2=0x7f1bfc0c5420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:45:24.626 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:24.624+0000 7f1c00c47640 1 --2- 172.21.15.73:0/4076991408 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1bfc14ea60 0x7f1bfc0c5420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:24.626 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:24.624+0000 7f1c00c47640 1 -- 172.21.15.73:0/4076991408 >> v1:172.21.15.142:6789/0 conn(0x7f1bfc0a4c90 legacy=0x7f1bfc0c4420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:24.626 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:24.624+0000 7f1c00c47640 1 -- 172.21.15.73:0/4076991408 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bfc152140 con 0x7f1bfc0c0320 2023-12-12T09:45:24.626 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:24.624+0000 7f1c00c47640 1 -- 172.21.15.73:0/4076991408 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3186547832 0 0) 0x7f1bf40019f0 con 0x7f1bfc0c0320 2023-12-12T09:45:24.626 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:24.624+0000 7f1c00c47640 1 -- 172.21.15.73:0/4076991408 >> v1:172.21.15.73:6789/0 conn(0x7f1bfc0c0320 legacy=0x7f1bfc0c20b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:24.627 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:24.624+0000 7f1c00c47640 1 --2- 172.21.15.73:0/4076991408 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1be80039a0 0x7f1be8003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:24.627 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:24.624+0000 7f1c00c47640 1 --2- 172.21.15.73:0/4076991408 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1be80047c0 0x7f1be8004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:24.627 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:24.624+0000 7f1c00c47640 1 --2- 172.21.15.73:0/4076991408 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1bfc14ea60 0x7f1be80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:24.627 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:24.624+0000 7f1c00c47640 1 -- 172.21.15.73:0/4076991408 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bfc151e60 con 0x7f1be80039a0 2023-12-12T09:45:24.627 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:24.624+0000 7f1c00c47640 1 -- 172.21.15.73:0/4076991408 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1be800dcc0 con 0x7f1be80047c0 2023-12-12T09:45:24.627 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:24.624+0000 7f1c00c47640 1 -- 172.21.15.73:0/4076991408 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1be800de80 con 0x7f1bfc14ea60 2023-12-12T09:45:24.627 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:24.625+0000 7f1c01c49640 1 --2- 172.21.15.73:0/4076991408 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1be80039a0 0x7f1be8003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:24.628 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:24.625+0000 7f1c01c49640 1 -- 172.21.15.73:0/4076991408 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1bfc14ea60 msgr2=0x7f1be80051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:45:24.628 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:24.625+0000 7f1c01c49640 1 --2- 172.21.15.73:0/4076991408 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1bfc14ea60 0x7f1be80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:24.628 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:24.625+0000 7f1c01c49640 1 -- 172.21.15.73:0/4076991408 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1be80047c0 msgr2=0x7f1be8004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:45:24.629 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:24.625+0000 7f1c01c49640 1 --2- 172.21.15.73:0/4076991408 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1be80047c0 0x7f1be8004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:24.629 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:24.625+0000 7f1c01c49640 1 -- 172.21.15.73:0/4076991408 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1be8003520 con 0x7f1be80039a0 2023-12-12T09:45:24.629 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:24.626+0000 7f1c01c49640 1 --2- 172.21.15.73:0/4076991408 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1be80039a0 0x7f1be8003dc0 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f1bf8009ac0 tx=0x7f1be80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eeedd4f8c4bec232 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:45:24.629 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:24.626+0000 7f1c00c47640 1 -- 172.21.15.73:0/4076991408 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bf802c710 con 0x7f1be80039a0 2023-12-12T09:45:24.629 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:24.626+0000 7f1c00c47640 1 -- 172.21.15.73:0/4076991408 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1bf802c870 con 0x7f1be80039a0 2023-12-12T09:45:24.629 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:24.626+0000 7f1c00c47640 1 -- 172.21.15.73:0/4076991408 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bf802cc00 con 0x7f1be80039a0 2023-12-12T09:45:24.629 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:24.627+0000 7f1c03ead640 1 -- 172.21.15.73:0/4076991408 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1be80039a0 msgr2=0x7f1be8003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:24.629 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:24.627+0000 7f1c03ead640 1 --2- 172.21.15.73:0/4076991408 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1be80039a0 0x7f1be8003dc0 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f1bf8009ac0 tx=0x7f1be80057f0 comp rx=0 tx=0).stop 2023-12-12T09:45:24.629 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:24.627+0000 7f1c0244a640 1 -- 172.21.15.73:0/4076991408 reap_dead start 2023-12-12T09:45:24.629 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:24.627+0000 7f1c03ead640 1 -- 172.21.15.73:0/4076991408 shutdown_connections 2023-12-12T09:45:24.629 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:24.627+0000 7f1c03ead640 1 -- 172.21.15.73:0/4076991408 >> 172.21.15.73:0/4076991408 conn(0x7f1bfc06a4e0 msgr2=0x7f1bfc06a8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:45:24.629 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:24.627+0000 7f1c03ead640 1 -- 172.21.15.73:0/4076991408 shutdown_connections 2023-12-12T09:45:24.629 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:24.627+0000 7f1c03ead640 1 -- 172.21.15.73:0/4076991408 wait complete. 2023-12-12T09:45:24.630 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:24.629+0000 7f1c03ead640 1 Processor -- start 2023-12-12T09:45:24.630 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:24.629+0000 7f1c03ead640 1 -- start start 2023-12-12T09:45:24.631 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:24.630+0000 7f1c03ead640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1be80039a0 0x7f1bfc14ac90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:24.631 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:24.630+0000 7f1c03ead640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1bfc1e5ad0 0x7f1bfc1544a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:24.631 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:24.630+0000 7f1c03ead640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1bfc150450 0x7f1bfc1e9690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:24.631 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:24.630+0000 7f1c03ead640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bfc147c30 con 0x7f1bfc1e5ad0 2023-12-12T09:45:24.631 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:24.630+0000 7f1c03ead640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bfc145910 con 0x7f1be80039a0 2023-12-12T09:45:24.631 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:24.630+0000 7f1c03ead640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1bfc14f810 con 0x7f1bfc150450 2023-12-12T09:45:24.631 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:24.630+0000 7f1c01448640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1bfc1e5ad0 0x7f1bfc1544a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:24.632 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:24.630+0000 7f1c01448640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1bfc1e5ad0 0x7f1bfc1544a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:45324/0 (socket says 172.21.15.73:45324) 2023-12-12T09:45:24.632 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:24.630+0000 7f1c01448640 1 -- 172.21.15.73:0/250318485 learned_addr learned my addr 172.21.15.73:0/250318485 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:45:24.633 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:24.630+0000 7f1c01448640 1 -- 172.21.15.73:0/250318485 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1bfc150450 msgr2=0x7f1bfc1e9690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:24.633 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:24.630+0000 7f1c01448640 1 --2- 172.21.15.73:0/250318485 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1bfc150450 0x7f1bfc1e9690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:24.633 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:24.630+0000 7f1c01448640 1 -- 172.21.15.73:0/250318485 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1be80039a0 msgr2=0x7f1bfc14ac90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:24.633 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:24.630+0000 7f1c01448640 1 --2- 172.21.15.73:0/250318485 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1be80039a0 0x7f1bfc14ac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:24.633 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:24.630+0000 7f1c01448640 1 -- 172.21.15.73:0/250318485 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bfc14f250 con 0x7f1bfc1e5ad0 2023-12-12T09:45:24.633 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:24.631+0000 7f1c01448640 1 --2- 172.21.15.73:0/250318485 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1bfc1e5ad0 0x7f1bfc1544a0 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f1bec00c500 tx=0x7f1bec00c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:45:24.633 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:24.631+0000 7f1bf27fc640 1 -- 172.21.15.73:0/250318485 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bec0052d0 con 0x7f1bfc1e5ad0 2023-12-12T09:45:24.634 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:24.631+0000 7f1bf27fc640 1 -- 172.21.15.73:0/250318485 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1bec005430 con 0x7f1bfc1e5ad0 2023-12-12T09:45:24.634 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:24.631+0000 7f1bf27fc640 1 -- 172.21.15.73:0/250318485 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bec012870 con 0x7f1bfc1e5ad0 2023-12-12T09:45:24.634 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:24.631+0000 7f1c03ead640 1 -- 172.21.15.73:0/250318485 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1bfc14f530 con 0x7f1bfc1e5ad0 2023-12-12T09:45:24.634 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:24.631+0000 7f1c03ead640 1 -- 172.21.15.73:0/250318485 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1bfc14b1d0 con 0x7f1bfc1e5ad0 2023-12-12T09:45:24.635 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:24.632+0000 7f1c03ead640 1 -- 172.21.15.73:0/250318485 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1bfc067070 con 0x7f1bfc1e5ad0 2023-12-12T09:45:24.635 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:24.634+0000 7f1bf27fc640 1 -- 172.21.15.73:0/250318485 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f1bec0129d0 con 0x7f1bfc1e5ad0 2023-12-12T09:45:24.636 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:24.635+0000 7f1bf27fc640 1 --2- 172.21.15.73:0/250318485 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f1be006ae70 0x7f1be006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:24.636 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:24.635+0000 7f1bf27fc640 1 -- 172.21.15.73:0/250318485 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1bec089140 con 0x7f1bfc1e5ad0 2023-12-12T09:45:24.636 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:24.635+0000 7f1c01c49640 1 --2- 172.21.15.73:0/250318485 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f1be006ae70 0x7f1be006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:24.637 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:24.636+0000 7f1c01c49640 1 --2- 172.21.15.73:0/250318485 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f1be006ae70 0x7f1be006d330 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f1bf8036000 tx=0x7f1bf802e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:45:24.641 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:24.640+0000 7f1bf27fc640 1 -- 172.21.15.73:0/250318485 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f1bec054280 con 0x7f1bfc1e5ad0 2023-12-12T09:45:24.869 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:24.868+0000 7f1c03ead640 1 -- 172.21.15.73:0/250318485 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f1bfc067580 con 0x7f1bfc1e5ad0 2023-12-12T09:45:25.555 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:25.554+0000 7f1bf27fc640 1 -- 172.21.15.73:0/250318485 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v29) v1 ==== 118+0+0 (secure 0 0 0) 0x7f1bec0578a0 con 0x7f1bfc1e5ad0 2023-12-12T09:45:25.559 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:25.557+0000 7f1c03ead640 1 -- 172.21.15.73:0/250318485 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f1be006ae70 msgr2=0x7f1be006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:25.559 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:25.557+0000 7f1c03ead640 1 --2- 172.21.15.73:0/250318485 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f1be006ae70 0x7f1be006d330 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f1bf8036000 tx=0x7f1bf802e000 comp rx=0 tx=0).stop 2023-12-12T09:45:25.559 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:25.557+0000 7f1c03ead640 1 -- 172.21.15.73:0/250318485 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1bfc1e5ad0 msgr2=0x7f1bfc1544a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:25.559 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:25.557+0000 7f1c03ead640 1 --2- 172.21.15.73:0/250318485 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1bfc1e5ad0 0x7f1bfc1544a0 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f1bec00c500 tx=0x7f1bec00c9c0 comp rx=0 tx=0).stop 2023-12-12T09:45:25.559 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:25.558+0000 7f1c03ead640 1 -- 172.21.15.73:0/250318485 shutdown_connections 2023-12-12T09:45:25.560 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:25.558+0000 7f1c03ead640 1 --2- 172.21.15.73:0/250318485 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f1be006ae70 0x7f1be006d330 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:25.560 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:25.558+0000 7f1c03ead640 1 --2- 172.21.15.73:0/250318485 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1bfc150450 0x7f1bfc1e9690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:25.560 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:25.558+0000 7f1c03ead640 1 --2- 172.21.15.73:0/250318485 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1bfc1e5ad0 0x7f1bfc1544a0 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:25.560 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:25.558+0000 7f1c03ead640 1 --2- 172.21.15.73:0/250318485 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1be80039a0 0x7f1bfc14ac90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:25.560 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:25.558+0000 7f1c03ead640 1 -- 172.21.15.73:0/250318485 >> 172.21.15.73:0/250318485 conn(0x7f1bfc06a4e0 msgr2=0x7f1bfc06a8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:45:25.560 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:25.558+0000 7f1c03ead640 1 -- 172.21.15.73:0/250318485 shutdown_connections 2023-12-12T09:45:25.560 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:25.558+0000 7f1c03ead640 1 -- 172.21.15.73:0/250318485 wait complete. 2023-12-12T09:45:25.580 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-12-12T09:45:25.580 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-12-12T09:45:25.794 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:25.793+0000 7f5bb6da9640 1 Processor -- start 2023-12-12T09:45:25.794 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:25.793+0000 7f5bb6da9640 1 -- start start 2023-12-12T09:45:25.795 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:25.794+0000 7f5bb6da9640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f5bb00c2730 0x7f5bb00c41c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:25.796 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:25.794+0000 7f5bb6da9640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5bb006db30 con 0x7f5bb00ad750 2023-12-12T09:45:25.796 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:25.794+0000 7f5bb6da9640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5bb006dd80 con 0x7f5bb01523f0 2023-12-12T09:45:25.796 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:25.794+0000 7f5bb6da9640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5bb006e060 con 0x7f5bb00c2730 2023-12-12T09:45:25.796 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:25.794+0000 7f5bb5346640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f5bb00c2730 0x7f5bb00c41c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:25.796 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:25.794+0000 7f5bb4b45640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f5bb00ad750 0x7f5bb00a7020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:35094/0 (socket says 172.21.15.73:35094) 2023-12-12T09:45:25.796 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:25.794+0000 7f5bb4b45640 1 -- 172.21.15.73:0/354017657 learned_addr learned my addr 172.21.15.73:0/354017657 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-12T09:45:25.797 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:25.795+0000 7f5bb5346640 1 -- 172.21.15.73:0/354017657 >> v1:172.21.15.142:6789/0 conn(0x7f5bb01523f0 legacy=0x7f5bb00c47c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:45:25.797 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:25.795+0000 7f5bb5346640 1 -- 172.21.15.73:0/354017657 >> v1:172.21.15.73:6789/0 conn(0x7f5bb00ad750 legacy=0x7f5bb00a7020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:25.797 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:25.795+0000 7f5bb5346640 1 -- 172.21.15.73:0/354017657 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bb00c75c0 con 0x7f5bb00c2730 2023-12-12T09:45:25.797 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:25.795+0000 7f5baf7fe640 1 -- 172.21.15.73:0/354017657 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 772121107 0 0) 0x7f5bb006db30 con 0x7f5bb00ad750 2023-12-12T09:45:25.797 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:25.796+0000 7f5bb5346640 1 --2- 172.21.15.73:0/354017657 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5bb00c2730 0x7f5bb00c41c0 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f5ba8009d90 tx=0x7f5ba802be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2b830f32a4de7e0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:45:25.798 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:25.796+0000 7f5baf7fe640 1 -- 172.21.15.73:0/354017657 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ba802cbd0 con 0x7f5bb00c2730 2023-12-12T09:45:25.798 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:25.796+0000 7f5baf7fe640 1 -- 172.21.15.73:0/354017657 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ba802cd30 con 0x7f5bb00c2730 2023-12-12T09:45:25.798 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:25.796+0000 7f5baf7fe640 1 -- 172.21.15.73:0/354017657 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ba802cea0 con 0x7f5bb00c2730 2023-12-12T09:45:25.798 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:25.797+0000 7f5bb6da9640 1 -- 172.21.15.73:0/354017657 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5bb00c2730 msgr2=0x7f5bb00c41c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:25.799 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:25.797+0000 7f5bb6da9640 1 --2- 172.21.15.73:0/354017657 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5bb00c2730 0x7f5bb00c41c0 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f5ba8009d90 tx=0x7f5ba802be20 comp rx=0 tx=0).stop 2023-12-12T09:45:25.799 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:25.797+0000 7f5bb6da9640 1 -- 172.21.15.73:0/354017657 shutdown_connections 2023-12-12T09:45:25.799 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:25.797+0000 7f5bb6da9640 1 --2- 172.21.15.73:0/354017657 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5bb00c2730 0x7f5bb00c41c0 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:25.799 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:25.797+0000 7f5bb6da9640 1 -- 172.21.15.73:0/354017657 >> 172.21.15.73:0/354017657 conn(0x7f5bb00c7d30 msgr2=0x7f5bb00c8110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:45:25.799 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:25.797+0000 7f5bb6da9640 1 -- 172.21.15.73:0/354017657 shutdown_connections 2023-12-12T09:45:25.799 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:25.797+0000 7f5bb6da9640 1 -- 172.21.15.73:0/354017657 wait complete. 2023-12-12T09:45:25.800 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:25.799+0000 7f5bb6da9640 1 Processor -- start 2023-12-12T09:45:25.800 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:25.799+0000 7f5bb6da9640 1 -- start start 2023-12-12T09:45:25.802 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:25.800+0000 7f5bb6da9640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5bb00ad750 0x7f5bb01e53c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:25.802 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:25.800+0000 7f5bb6da9640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5bb00c2730 0x7f5bb00a8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:25.802 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:25.800+0000 7f5bb6da9640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5bb01523f0 0x7f5bb0155930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:25.802 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:25.800+0000 7f5bb6da9640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bb01e7b50 con 0x7f5bb00ad750 2023-12-12T09:45:25.802 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:25.800+0000 7f5bb6da9640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bb01e8970 con 0x7f5bb00c2730 2023-12-12T09:45:25.802 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:25.800+0000 7f5bb6da9640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5bb01e7d60 con 0x7f5bb01523f0 2023-12-12T09:45:25.802 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:25.800+0000 7f5bb4b45640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5bb00ad750 0x7f5bb01e53c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:25.802 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:25.800+0000 7f5bb4b45640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5bb00ad750 0x7f5bb01e53c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:45330/0 (socket says 172.21.15.73:45330) 2023-12-12T09:45:25.802 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:25.800+0000 7f5bb4b45640 1 -- 172.21.15.73:0/2580719695 learned_addr learned my addr 172.21.15.73:0/2580719695 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:45:25.802 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:25.800+0000 7f5bb4b45640 1 -- 172.21.15.73:0/2580719695 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5bb01523f0 msgr2=0x7f5bb0155930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:25.802 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:25.800+0000 7f5bb4b45640 1 --2- 172.21.15.73:0/2580719695 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5bb01523f0 0x7f5bb0155930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:25.802 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:25.800+0000 7f5bb4b45640 1 -- 172.21.15.73:0/2580719695 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5bb00c2730 msgr2=0x7f5bb00a8c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:25.803 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:25.800+0000 7f5bb4b45640 1 --2- 172.21.15.73:0/2580719695 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5bb00c2730 0x7f5bb00a8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:25.803 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:25.800+0000 7f5bb4b45640 1 -- 172.21.15.73:0/2580719695 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ba8009a70 con 0x7f5bb00ad750 2023-12-12T09:45:25.803 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:25.801+0000 7f5bb4b45640 1 --2- 172.21.15.73:0/2580719695 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5bb00ad750 0x7f5bb01e53c0 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f5ba000c430 tx=0x7f5ba000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:45:25.803 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:25.801+0000 7f5bad7fa640 1 -- 172.21.15.73:0/2580719695 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ba00074e0 con 0x7f5bb00ad750 2023-12-12T09:45:25.804 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:25.801+0000 7f5bad7fa640 1 -- 172.21.15.73:0/2580719695 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ba0007660 con 0x7f5bb00ad750 2023-12-12T09:45:25.804 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:25.801+0000 7f5bad7fa640 1 -- 172.21.15.73:0/2580719695 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ba0004a20 con 0x7f5bb00ad750 2023-12-12T09:45:25.804 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:25.801+0000 7f5bb6da9640 1 -- 172.21.15.73:0/2580719695 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5bb01e8040 con 0x7f5bb00ad750 2023-12-12T09:45:25.804 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:25.801+0000 7f5bb6da9640 1 -- 172.21.15.73:0/2580719695 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5bb01e8600 con 0x7f5bb00ad750 2023-12-12T09:45:25.804 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:25.802+0000 7f5bb6da9640 1 -- 172.21.15.73:0/2580719695 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5bb0067580 con 0x7f5bb00ad750 2023-12-12T09:45:25.804 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:25.803+0000 7f5bad7fa640 1 -- 172.21.15.73:0/2580719695 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f5ba0004b80 con 0x7f5bb00ad750 2023-12-12T09:45:25.805 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:25.804+0000 7f5bad7fa640 1 --2- 172.21.15.73:0/2580719695 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f5b9006ae40 0x7f5b9006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:25.805 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:25.804+0000 7f5bad7fa640 1 -- 172.21.15.73:0/2580719695 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5ba0089390 con 0x7f5bb00ad750 2023-12-12T09:45:25.805 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:25.804+0000 7f5baffff640 1 --2- 172.21.15.73:0/2580719695 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f5b9006ae40 0x7f5b9006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:25.806 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:25.805+0000 7f5baffff640 1 --2- 172.21.15.73:0/2580719695 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f5b9006ae40 0x7f5b9006d300 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f5bb0151360 tx=0x7f5b980079b0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:45:25.809 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:25.808+0000 7f5bad7fa640 1 -- 172.21.15.73:0/2580719695 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f5ba00544d0 con 0x7f5bb00ad750 2023-12-12T09:45:26.028 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:26.026+0000 7f5bb6da9640 1 -- 172.21.15.73:0/2580719695 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f5bb00c7200 con 0x7f5bb00ad750 2023-12-12T09:45:26.559 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:26.557+0000 7f5bad7fa640 1 -- 172.21.15.73:0/2580719695 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v30) v1 ==== 122+0+0 (secure 0 0 0) 0x7f5ba0057af0 con 0x7f5bb00ad750 2023-12-12T09:45:26.563 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:26.561+0000 7f5bb6da9640 1 -- 172.21.15.73:0/2580719695 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f5b9006ae40 msgr2=0x7f5b9006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:26.563 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:26.561+0000 7f5bb6da9640 1 --2- 172.21.15.73:0/2580719695 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f5b9006ae40 0x7f5b9006d300 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f5bb0151360 tx=0x7f5b980079b0 comp rx=0 tx=0).stop 2023-12-12T09:45:26.563 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:26.561+0000 7f5bb6da9640 1 -- 172.21.15.73:0/2580719695 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5bb00ad750 msgr2=0x7f5bb01e53c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:26.563 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:26.561+0000 7f5bb6da9640 1 --2- 172.21.15.73:0/2580719695 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5bb00ad750 0x7f5bb01e53c0 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f5ba000c430 tx=0x7f5ba000c8f0 comp rx=0 tx=0).stop 2023-12-12T09:45:26.563 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:26.562+0000 7f5bb6da9640 1 -- 172.21.15.73:0/2580719695 shutdown_connections 2023-12-12T09:45:26.563 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:26.562+0000 7f5bb6da9640 1 --2- 172.21.15.73:0/2580719695 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f5b9006ae40 0x7f5b9006d300 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:26.563 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:26.562+0000 7f5bb6da9640 1 --2- 172.21.15.73:0/2580719695 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5bb01523f0 0x7f5bb0155930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:26.564 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:26.562+0000 7f5bb6da9640 1 --2- 172.21.15.73:0/2580719695 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5bb00c2730 0x7f5bb00a8c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:26.564 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:26.562+0000 7f5bb6da9640 1 --2- 172.21.15.73:0/2580719695 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5bb00ad750 0x7f5bb01e53c0 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:26.564 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:26.562+0000 7f5bb6da9640 1 -- 172.21.15.73:0/2580719695 >> 172.21.15.73:0/2580719695 conn(0x7f5bb00c7d30 msgr2=0x7f5bb00a7020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:45:26.564 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:26.562+0000 7f5bb6da9640 1 -- 172.21.15.73:0/2580719695 shutdown_connections 2023-12-12T09:45:26.564 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:26.562+0000 7f5bb6da9640 1 -- 172.21.15.73:0/2580719695 wait complete. 2023-12-12T09:45:26.584 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-12-12T09:45:26.584 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-12T09:45:26.773 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:26.772+0000 7f1816039640 1 Processor -- start 2023-12-12T09:45:26.773 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:26.772+0000 7f1816039640 1 -- start start 2023-12-12T09:45:26.775 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:26.773+0000 7f1816039640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f18100c37b0 0x7f1810151cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:26.775 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:26.773+0000 7f1816039640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f18100ab4a0 0x7f18100a9df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:26.775 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:26.773+0000 7f1816039640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18101521f0 con 0x7f181014e700 2023-12-12T09:45:26.775 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:26.773+0000 7f1816039640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18100ab2d0 con 0x7f18100ab4a0 2023-12-12T09:45:26.775 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:26.773+0000 7f1816039640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f181006bb10 con 0x7f18100c37b0 2023-12-12T09:45:26.775 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:26.774+0000 7f1815037640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f181014e700 0x7f18100c02b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:35096/0 (socket says 172.21.15.73:35096) 2023-12-12T09:45:26.775 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:26.774+0000 7f1815037640 1 -- 172.21.15.73:0/2557426197 learned_addr learned my addr 172.21.15.73:0/2557426197 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-12T09:45:26.777 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:26.774+0000 7f1807fff640 1 -- 172.21.15.73:0/2557426197 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2101483540 0 0) 0x7f180c001110 con 0x7f181014e700 2023-12-12T09:45:26.777 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:26.774+0000 7f1807fff640 1 -- 172.21.15.73:0/2557426197 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f17fc005730 con 0x7f181014e700 2023-12-12T09:45:26.777 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:26.774+0000 7f1814836640 1 --2- 172.21.15.73:0/2557426197 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f18100c37b0 0x7f1810151cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:26.777 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:26.774+0000 7f1815838640 1 --2- 172.21.15.73:0/2557426197 >> v2:172.21.15.142:3300/0 conn(0x7f18100ab4a0 0x7f18100a9df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:26.777 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:26.774+0000 7f1807fff640 1 -- 172.21.15.73:0/2557426197 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3194333323 0 0) 0x7f17fc005730 con 0x7f181014e700 2023-12-12T09:45:26.777 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:26.774+0000 7f1807fff640 1 -- 172.21.15.73:0/2557426197 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f18100c37b0 msgr2=0x7f1810151cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:45:26.777 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:26.774+0000 7f1807fff640 1 --2- 172.21.15.73:0/2557426197 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f18100c37b0 0x7f1810151cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:26.777 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:26.774+0000 7f1807fff640 1 -- 172.21.15.73:0/2557426197 >> v2:172.21.15.142:3300/0 conn(0x7f18100ab4a0 msgr2=0x7f18100a9df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:45:26.777 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:26.774+0000 7f1807fff640 1 --2- 172.21.15.73:0/2557426197 >> v2:172.21.15.142:3300/0 conn(0x7f18100ab4a0 0x7f18100a9df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:26.777 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:26.774+0000 7f1807fff640 1 -- 172.21.15.73:0/2557426197 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18100aaff0 con 0x7f181014e700 2023-12-12T09:45:26.777 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:26.774+0000 7f1807fff640 1 -- 172.21.15.73:0/2557426197 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3186547832 0 0) 0x7f180c001800 con 0x7f181014e700 2023-12-12T09:45:26.778 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:26.774+0000 7f1807fff640 1 -- 172.21.15.73:0/2557426197 >> v1:172.21.15.73:6789/0 conn(0x7f181014e700 legacy=0x7f18100c02b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:26.778 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:26.775+0000 7f1807fff640 1 --2- 172.21.15.73:0/2557426197 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f17fc005b80 0x7f17fc005fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:26.778 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:26.775+0000 7f1807fff640 1 --2- 172.21.15.73:0/2557426197 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f17fc0069d0 0x7f17fc006e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:26.778 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:26.775+0000 7f1807fff640 1 --2- 172.21.15.73:0/2557426197 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f18100c37b0 0x7f17fc007460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:26.778 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:26.775+0000 7f1807fff640 1 -- 172.21.15.73:0/2557426197 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18100ab2d0 con 0x7f17fc0069d0 2023-12-12T09:45:26.778 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:26.775+0000 7f1807fff640 1 -- 172.21.15.73:0/2557426197 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f181006bb10 con 0x7f17fc005b80 2023-12-12T09:45:26.778 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:26.775+0000 7f1807fff640 1 -- 172.21.15.73:0/2557426197 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17fc00ddd0 con 0x7f18100c37b0 2023-12-12T09:45:26.778 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:26.775+0000 7f1814836640 1 --2- 172.21.15.73:0/2557426197 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f17fc0069d0 0x7f17fc006e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:26.778 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:26.775+0000 7f1814836640 1 -- 172.21.15.73:0/2557426197 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f18100c37b0 msgr2=0x7f17fc007460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:45:26.778 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:26.775+0000 7f1814836640 1 --2- 172.21.15.73:0/2557426197 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f18100c37b0 0x7f17fc007460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:26.778 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:26.775+0000 7f1814836640 1 -- 172.21.15.73:0/2557426197 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f17fc005b80 msgr2=0x7f17fc005fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:45:26.778 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:26.775+0000 7f1814836640 1 --2- 172.21.15.73:0/2557426197 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f17fc005b80 0x7f17fc005fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:26.778 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:26.775+0000 7f1814836640 1 -- 172.21.15.73:0/2557426197 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17fc005730 con 0x7f17fc0069d0 2023-12-12T09:45:26.780 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:26.776+0000 7f1814836640 1 --2- 172.21.15.73:0/2557426197 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f17fc0069d0 0x7f17fc006e50 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f180000ba30 tx=0x7f17fc007a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=452a6900b1fee930 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:45:26.780 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:26.776+0000 7f1807fff640 1 -- 172.21.15.73:0/2557426197 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1800032680 con 0x7f17fc0069d0 2023-12-12T09:45:26.780 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:26.776+0000 7f1807fff640 1 -- 172.21.15.73:0/2557426197 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18000327e0 con 0x7f17fc0069d0 2023-12-12T09:45:26.780 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:26.776+0000 7f1807fff640 1 -- 172.21.15.73:0/2557426197 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1800032b70 con 0x7f17fc0069d0 2023-12-12T09:45:26.780 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:26.777+0000 7f1816039640 1 -- 172.21.15.73:0/2557426197 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f17fc0069d0 msgr2=0x7f17fc006e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:26.780 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:26.777+0000 7f1816039640 1 --2- 172.21.15.73:0/2557426197 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f17fc0069d0 0x7f17fc006e50 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f180000ba30 tx=0x7f17fc007a00 comp rx=0 tx=0).stop 2023-12-12T09:45:26.780 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:26.777+0000 7f1815838640 1 -- 172.21.15.73:0/2557426197 reap_dead start 2023-12-12T09:45:26.780 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:26.777+0000 7f1816039640 1 -- 172.21.15.73:0/2557426197 shutdown_connections 2023-12-12T09:45:26.780 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:26.777+0000 7f1816039640 1 -- 172.21.15.73:0/2557426197 >> 172.21.15.73:0/2557426197 conn(0x7f18100c23b0 msgr2=0x7f18100c2790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:45:26.781 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:26.777+0000 7f1816039640 1 -- 172.21.15.73:0/2557426197 shutdown_connections 2023-12-12T09:45:26.781 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:26.777+0000 7f1816039640 1 -- 172.21.15.73:0/2557426197 wait complete. 2023-12-12T09:45:26.781 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:26.779+0000 7f1816039640 1 Processor -- start 2023-12-12T09:45:26.781 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:26.779+0000 7f1816039640 1 -- start start 2023-12-12T09:45:26.783 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:26.780+0000 7f1816039640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f17fc0069d0 0x7f18101525a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:26.783 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:26.780+0000 7f1816039640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1810154f90 0x7f1810153d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:26.783 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:26.780+0000 7f1816039640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f18101ed790 0x7f18101ddaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:26.783 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:26.780+0000 7f1816039640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f181014f630 con 0x7f18101ed790 2023-12-12T09:45:26.783 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:26.780+0000 7f1816039640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18101ed020 con 0x7f17fc0069d0 2023-12-12T09:45:26.783 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:26.780+0000 7f1816039640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f181014f840 con 0x7f1810154f90 2023-12-12T09:45:26.783 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:26.780+0000 7f1815838640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f18101ed790 0x7f18101ddaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:26.783 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:26.780+0000 7f1815838640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f18101ed790 0x7f18101ddaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:45354/0 (socket says 172.21.15.73:45354) 2023-12-12T09:45:26.783 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:26.780+0000 7f1815838640 1 -- 172.21.15.73:0/3011757191 learned_addr learned my addr 172.21.15.73:0/3011757191 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:45:26.783 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:26.780+0000 7f1815838640 1 -- 172.21.15.73:0/3011757191 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1810154f90 msgr2=0x7f1810153d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:26.783 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:26.780+0000 7f1815838640 1 --2- 172.21.15.73:0/3011757191 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1810154f90 0x7f1810153d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:26.783 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:26.780+0000 7f1815838640 1 -- 172.21.15.73:0/3011757191 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f17fc0069d0 msgr2=0x7f18101525a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:26.783 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:26.780+0000 7f1815838640 1 --2- 172.21.15.73:0/3011757191 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f17fc0069d0 0x7f18101525a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:26.783 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:26.780+0000 7f1815838640 1 -- 172.21.15.73:0/3011757191 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f181014fb20 con 0x7f18101ed790 2023-12-12T09:45:26.784 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:26.781+0000 7f1815838640 1 --2- 172.21.15.73:0/3011757191 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f18101ed790 0x7f18101ddaa0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f18100a8600 tx=0x7f180800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:45:26.784 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:26.781+0000 7f1805ffb640 1 -- 172.21.15.73:0/3011757191 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f180800ed90 con 0x7f18101ed790 2023-12-12T09:45:26.784 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:26.781+0000 7f1805ffb640 1 -- 172.21.15.73:0/3011757191 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1808014420 con 0x7f18101ed790 2023-12-12T09:45:26.784 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:26.781+0000 7f1805ffb640 1 -- 172.21.15.73:0/3011757191 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18080147d0 con 0x7f18101ed790 2023-12-12T09:45:26.784 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:26.781+0000 7f1816039640 1 -- 172.21.15.73:0/3011757191 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f181014fe00 con 0x7f18101ed790 2023-12-12T09:45:26.784 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:26.781+0000 7f1816039640 1 -- 172.21.15.73:0/3011757191 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1810154280 con 0x7f18101ed790 2023-12-12T09:45:26.784 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:26.782+0000 7f1816039640 1 -- 172.21.15.73:0/3011757191 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18101ed4b0 con 0x7f18101ed790 2023-12-12T09:45:26.785 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:26.783+0000 7f1805ffb640 1 -- 172.21.15.73:0/3011757191 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f1808014930 con 0x7f18101ed790 2023-12-12T09:45:26.785 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:26.784+0000 7f1805ffb640 1 --2- 172.21.15.73:0/3011757191 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f17f406ae40 0x7f17f406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:26.786 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:26.784+0000 7f1805ffb640 1 -- 172.21.15.73:0/3011757191 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1808089980 con 0x7f18101ed790 2023-12-12T09:45:26.786 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:26.784+0000 7f1815037640 1 --2- 172.21.15.73:0/3011757191 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f17f406ae40 0x7f17f406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:26.786 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:26.785+0000 7f1815037640 1 --2- 172.21.15.73:0/3011757191 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f17f406ae40 0x7f17f406d300 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f180c0012b0 tx=0x7f180c0011c0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:45:26.790 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:26.789+0000 7f1805ffb640 1 -- 172.21.15.73:0/3011757191 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f18101ed4b0 con 0x7f18101ed790 2023-12-12T09:45:26.998 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:26.997+0000 7f1816039640 1 -- 172.21.15.73:0/3011757191 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f18101ed4b0 con 0x7f18101ed790 2023-12-12T09:45:26.999 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:26.998+0000 7f1805ffb640 1 -- 172.21.15.73:0/3011757191 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) v1 ==== 94+0+4916 (secure 0 0 0) 0x7f18101ed4b0 con 0x7f18101ed790 2023-12-12T09:45:26.999 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-12T09:45:26.999 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":30,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4736,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6834/2964437845","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6832","nonce":2964437845},{"type":"v1","addr":"172.21.15.142:6834","nonce":2964437845}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":25},{"gid":5044,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6837/3698725764","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6836","nonce":3698725764},{"type":"v1","addr":"172.21.15.73:6837","nonce":3698725764}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":25},{"gid":5059,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6835/2931058847","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6833","nonce":2931058847},{"type":"v1","addr":"172.21.15.142:6835","nonce":2931058847}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":25}],"filesystems":[{"mdsmap":{"epoch":30,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-12T09:45:22.971300+0000","modified":"2023-12-12T09:45:26.028731+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5703},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5703":{"gid":5703,"name":"a","rank":0,"incarnation":26,"state":"up:active","state_seq":3,"addr":"172.21.15.73:6835/744058726","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":744058726},{"type":"v1","addr":"172.21.15.73:6835","nonce":744058726}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2023-12-12T09:45:26.999 INFO:teuthology.orchestra.run.smithi073.stderr:dumped fsmap epoch 30 2023-12-12T09:45:27.002 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:27.000+0000 7f1816039640 1 -- 172.21.15.73:0/3011757191 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f17f406ae40 msgr2=0x7f17f406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:27.002 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:27.000+0000 7f1816039640 1 --2- 172.21.15.73:0/3011757191 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f17f406ae40 0x7f17f406d300 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f180c0012b0 tx=0x7f180c0011c0 comp rx=0 tx=0).stop 2023-12-12T09:45:27.002 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:27.000+0000 7f1816039640 1 -- 172.21.15.73:0/3011757191 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f18101ed790 msgr2=0x7f18101ddaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:27.002 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:27.000+0000 7f1816039640 1 --2- 172.21.15.73:0/3011757191 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f18101ed790 0x7f18101ddaa0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f18100a8600 tx=0x7f180800e4b0 comp rx=0 tx=0).stop 2023-12-12T09:45:27.002 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:27.000+0000 7f1816039640 1 -- 172.21.15.73:0/3011757191 shutdown_connections 2023-12-12T09:45:27.002 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:27.000+0000 7f1816039640 1 --2- 172.21.15.73:0/3011757191 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f17f406ae40 0x7f17f406d300 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:27.002 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:27.000+0000 7f1816039640 1 --2- 172.21.15.73:0/3011757191 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f18101ed790 0x7f18101ddaa0 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:27.002 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:27.000+0000 7f1816039640 1 --2- 172.21.15.73:0/3011757191 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1810154f90 0x7f1810153d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:27.002 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:27.000+0000 7f1816039640 1 --2- 172.21.15.73:0/3011757191 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f17fc0069d0 0x7f18101525a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:27.002 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:27.000+0000 7f1816039640 1 -- 172.21.15.73:0/3011757191 >> 172.21.15.73:0/3011757191 conn(0x7f18100c23b0 msgr2=0x7f18100c0600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:45:27.002 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:27.000+0000 7f1816039640 1 -- 172.21.15.73:0/3011757191 shutdown_connections 2023-12-12T09:45:27.002 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:27.000+0000 7f1816039640 1 -- 172.21.15.73:0/3011757191 wait complete. 2023-12-12T09:45:27.019 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-12T09:45:27.228 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:27.226+0000 7f5b98e3d640 1 Processor -- start 2023-12-12T09:45:27.228 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:27.227+0000 7f5b98e3d640 1 -- start start 2023-12-12T09:45:27.230 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:27.228+0000 7f5b98e3d640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f5b9406bf90 0x7f5b941584f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:27.230 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:27.228+0000 7f5b98e3d640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5b9406a4e0 0x7f5b9406a930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:27.230 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:27.228+0000 7f5b98e3d640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b940c4d00 con 0x7f5b940a5040 2023-12-12T09:45:27.230 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:27.228+0000 7f5b98e3d640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b9406c400 con 0x7f5b9406bf90 2023-12-12T09:45:27.230 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:27.228+0000 7f5b98e3d640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b940c5100 con 0x7f5b9406a4e0 2023-12-12T09:45:27.231 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:27.228+0000 7f5b91d9b640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f5b9406bf90 0x7f5b941584f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:27.231 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:27.228+0000 7f5b91d9b640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f5b9406bf90 0x7f5b941584f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:45360/0 (socket says 172.21.15.73:45360) 2023-12-12T09:45:27.231 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:27.228+0000 7f5b91d9b640 1 -- 172.21.15.73:0/3023772020 learned_addr learned my addr 172.21.15.73:0/3023772020 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:45:27.231 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:27.228+0000 7f5b9259c640 1 --1- 172.21.15.73:0/3023772020 >> v1:172.21.15.73:6789/0 conn(0x7f5b940a5040 0x7f5b940c3ad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:35108/0 (socket says 172.21.15.73:35108) 2023-12-12T09:45:27.231 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:27.229+0000 7f5b92d9d640 1 --2- 172.21.15.73:0/3023772020 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5b9406a4e0 0x7f5b9406a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:27.231 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:27.229+0000 7f5b91d9b640 1 -- 172.21.15.73:0/3023772020 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5b9406a4e0 msgr2=0x7f5b9406a930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:45:27.231 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:27.229+0000 7f5b91d9b640 1 --2- 172.21.15.73:0/3023772020 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5b9406a4e0 0x7f5b9406a930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:27.231 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:27.229+0000 7f5b91d9b640 1 -- 172.21.15.73:0/3023772020 >> v1:172.21.15.73:6789/0 conn(0x7f5b940a5040 legacy=0x7f5b940c3ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:27.231 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:27.229+0000 7f5b91d9b640 1 -- 172.21.15.73:0/3023772020 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b940c53e0 con 0x7f5b9406bf90 2023-12-12T09:45:27.231 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:27.229+0000 7f5b9159a640 1 -- 172.21.15.73:0/3023772020 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2613029060 0 0) 0x7f5b940c4d00 con 0x7f5b940a5040 2023-12-12T09:45:27.231 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:27.229+0000 7f5b92d9d640 1 --2- 172.21.15.73:0/3023772020 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5b9406a4e0 0x7f5b9406a930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:45:27.232 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:27.230+0000 7f5b91d9b640 1 --2- 172.21.15.73:0/3023772020 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5b9406bf90 0x7f5b941584f0 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f5b7c009870 tx=0x7f5b7c02ba20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9e8fd4876f81c58 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:45:27.232 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:27.230+0000 7f5b9159a640 1 -- 172.21.15.73:0/3023772020 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b7c02f840 con 0x7f5b9406bf90 2023-12-12T09:45:27.233 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:27.230+0000 7f5b9159a640 1 -- 172.21.15.73:0/3023772020 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b7c02f9a0 con 0x7f5b9406bf90 2023-12-12T09:45:27.233 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:27.230+0000 7f5b9159a640 1 -- 172.21.15.73:0/3023772020 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b7c02fd30 con 0x7f5b9406bf90 2023-12-12T09:45:27.233 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:27.231+0000 7f5b98e3d640 1 -- 172.21.15.73:0/3023772020 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5b9406bf90 msgr2=0x7f5b941584f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:27.233 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:27.231+0000 7f5b98e3d640 1 --2- 172.21.15.73:0/3023772020 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5b9406bf90 0x7f5b941584f0 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f5b7c009870 tx=0x7f5b7c02ba20 comp rx=0 tx=0).stop 2023-12-12T09:45:27.233 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:27.231+0000 7f5b98e3d640 1 -- 172.21.15.73:0/3023772020 shutdown_connections 2023-12-12T09:45:27.233 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:27.231+0000 7f5b98e3d640 1 --2- 172.21.15.73:0/3023772020 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5b9406a4e0 0x7f5b9406a930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:27.233 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:27.231+0000 7f5b98e3d640 1 --2- 172.21.15.73:0/3023772020 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5b9406bf90 0x7f5b941584f0 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:27.233 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:27.231+0000 7f5b98e3d640 1 -- 172.21.15.73:0/3023772020 >> 172.21.15.73:0/3023772020 conn(0x7f5b940a8130 msgr2=0x7f5b940c24b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:45:27.233 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:27.231+0000 7f5b98e3d640 1 -- 172.21.15.73:0/3023772020 shutdown_connections 2023-12-12T09:45:27.233 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:27.231+0000 7f5b98e3d640 1 -- 172.21.15.73:0/3023772020 wait complete. 2023-12-12T09:45:27.234 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:27.233+0000 7f5b98e3d640 1 Processor -- start 2023-12-12T09:45:27.234 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:27.233+0000 7f5b98e3d640 1 -- start start 2023-12-12T09:45:27.235 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:27.234+0000 7f5b98e3d640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5b9406a4e0 0x7f5b940a87c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:27.236 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:27.234+0000 7f5b98e3d640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5b9406bf90 0x7f5b940aa530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:27.236 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:27.234+0000 7f5b98e3d640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5b940a5040 0x7f5b94070f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:27.236 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:27.234+0000 7f5b98e3d640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b9414ece0 con 0x7f5b9406a4e0 2023-12-12T09:45:27.236 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:27.234+0000 7f5b98e3d640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b940a9020 con 0x7f5b9406bf90 2023-12-12T09:45:27.236 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:27.234+0000 7f5b98e3d640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b94157b20 con 0x7f5b940a5040 2023-12-12T09:45:27.237 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:27.235+0000 7f5b9259c640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5b9406a4e0 0x7f5b940a87c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:27.237 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:27.235+0000 7f5b9259c640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5b9406a4e0 0x7f5b940a87c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:45376/0 (socket says 172.21.15.73:45376) 2023-12-12T09:45:27.237 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:27.235+0000 7f5b9259c640 1 -- 172.21.15.73:0/2849155252 learned_addr learned my addr 172.21.15.73:0/2849155252 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:45:27.237 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:27.235+0000 7f5b92d9d640 1 --2- 172.21.15.73:0/2849155252 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5b940a5040 0x7f5b94070f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:27.237 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:27.235+0000 7f5b91d9b640 1 --2- 172.21.15.73:0/2849155252 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5b9406bf90 0x7f5b940aa530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:27.238 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:27.235+0000 7f5b9259c640 1 -- 172.21.15.73:0/2849155252 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5b940a5040 msgr2=0x7f5b94070f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:27.238 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:27.235+0000 7f5b9259c640 1 --2- 172.21.15.73:0/2849155252 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5b940a5040 0x7f5b94070f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:27.238 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:27.235+0000 7f5b9259c640 1 -- 172.21.15.73:0/2849155252 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5b9406bf90 msgr2=0x7f5b940aa530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:27.238 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:27.235+0000 7f5b9259c640 1 --2- 172.21.15.73:0/2849155252 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5b9406bf90 0x7f5b940aa530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:27.238 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:27.235+0000 7f5b9259c640 1 -- 172.21.15.73:0/2849155252 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b7c0094d0 con 0x7f5b9406a4e0 2023-12-12T09:45:27.238 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:27.235+0000 7f5b9259c640 1 --2- 172.21.15.73:0/2849155252 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5b9406a4e0 0x7f5b940a87c0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f5b8400c7b0 tx=0x7f5b8400cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:45:27.238 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:27.236+0000 7f5b8affd640 1 -- 172.21.15.73:0/2849155252 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b8400a640 con 0x7f5b9406a4e0 2023-12-12T09:45:27.238 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:27.236+0000 7f5b8affd640 1 -- 172.21.15.73:0/2849155252 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b8400a7c0 con 0x7f5b9406a4e0 2023-12-12T09:45:27.238 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:27.236+0000 7f5b8affd640 1 -- 172.21.15.73:0/2849155252 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b8400ab70 con 0x7f5b9406a4e0 2023-12-12T09:45:27.238 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:27.236+0000 7f5b98e3d640 1 -- 172.21.15.73:0/2849155252 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b940a8d00 con 0x7f5b9406a4e0 2023-12-12T09:45:27.239 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:27.236+0000 7f5b98e3d640 1 -- 172.21.15.73:0/2849155252 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b941eb0a0 con 0x7f5b9406a4e0 2023-12-12T09:45:27.239 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:27.237+0000 7f5b98e3d640 1 -- 172.21.15.73:0/2849155252 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b94157cb0 con 0x7f5b9406a4e0 2023-12-12T09:45:27.239 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:27.238+0000 7f5b8affd640 1 -- 172.21.15.73:0/2849155252 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f5b8400acd0 con 0x7f5b9406a4e0 2023-12-12T09:45:27.240 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:27.239+0000 7f5b8affd640 1 --2- 172.21.15.73:0/2849155252 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f5b7406ae70 0x7f5b7406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:27.240 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:27.239+0000 7f5b8affd640 1 -- 172.21.15.73:0/2849155252 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5b84088ec0 con 0x7f5b9406a4e0 2023-12-12T09:45:27.240 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:27.239+0000 7f5b91d9b640 1 --2- 172.21.15.73:0/2849155252 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f5b7406ae70 0x7f5b7406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:27.241 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:27.240+0000 7f5b91d9b640 1 --2- 172.21.15.73:0/2849155252 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f5b7406ae70 0x7f5b7406d330 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f5b7c036000 tx=0x7f5b7c039040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:45:27.244 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:27.243+0000 7f5b8affd640 1 -- 172.21.15.73:0/2849155252 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f5b84053f60 con 0x7f5b9406a4e0 2023-12-12T09:45:27.436 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:27.435+0000 7f5b98e3d640 1 -- 172.21.15.73:0/2849155252 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5b94072ae0 con 0x7f5b9406a4e0 2023-12-12T09:45:27.439 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:27.438+0000 7f5b8affd640 1 -- 172.21.15.73:0/2849155252 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v54) v1 ==== 74+0+16577 (secure 0 0 0) 0x7f5b84017020 con 0x7f5b9406a4e0 2023-12-12T09:45:27.439 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-12T09:45:27.440 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":54,"fsid":"ba240992-02b8-4c7e-92f2-27eb29ac433b","created":"2023-12-12T09:43:02.454719+0000","modified":"2023-12-12T09:45:24.524160+0000","last_up_change":"2023-12-12T09:43:13.913440+0000","last_in_change":"2023-12-12T09:43:05.925348+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-12T09:43:15.525508+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-12-12T09:45:21.264815+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"53","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-12-12T09:45:21.981834+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"54","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"dd9074be-dbe2-4c34-9896-a4223d8d3940","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":4047810203},{"type":"v1","addr":"172.21.15.73:6801","nonce":4047810203}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":4047810203},{"type":"v1","addr":"172.21.15.73:6803","nonce":4047810203}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":4047810203},{"type":"v1","addr":"172.21.15.73:6807","nonce":4047810203}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":4047810203},{"type":"v1","addr":"172.21.15.73:6805","nonce":4047810203}]},"public_addr":"172.21.15.73:6801/4047810203","cluster_addr":"172.21.15.73:6803/4047810203","heartbeat_back_addr":"172.21.15.73:6807/4047810203","heartbeat_front_addr":"172.21.15.73:6805/4047810203","state":["exists","up"]},{"osd":1,"uuid":"c4a05052-96d4-4758-a4e1-1a37f1e07fed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":1356058331},{"type":"v1","addr":"172.21.15.73:6824","nonce":1356058331}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":1356058331},{"type":"v1","addr":"172.21.15.73:6827","nonce":1356058331}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":1356058331},{"type":"v1","addr":"172.21.15.73:6831","nonce":1356058331}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":1356058331},{"type":"v1","addr":"172.21.15.73:6829","nonce":1356058331}]},"public_addr":"172.21.15.73:6824/1356058331","cluster_addr":"172.21.15.73:6827/1356058331","heartbeat_back_addr":"172.21.15.73:6831/1356058331","heartbeat_front_addr":"172.21.15.73:6829/1356058331","state":["exists","up"]},{"osd":2,"uuid":"512bc8ac-72c2-40d4-b3d2-d867a92c5213","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":1228903316},{"type":"v1","addr":"172.21.15.73:6817","nonce":1228903316}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":1228903316},{"type":"v1","addr":"172.21.15.73:6819","nonce":1228903316}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6823","nonce":1228903316},{"type":"v1","addr":"172.21.15.73:6825","nonce":1228903316}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":1228903316},{"type":"v1","addr":"172.21.15.73:6821","nonce":1228903316}]},"public_addr":"172.21.15.73:6817/1228903316","cluster_addr":"172.21.15.73:6819/1228903316","heartbeat_back_addr":"172.21.15.73:6825/1228903316","heartbeat_front_addr":"172.21.15.73:6821/1228903316","state":["exists","up"]},{"osd":3,"uuid":"3d1a91e0-42bf-437a-8eae-8d357c8f63a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":1293329670},{"type":"v1","addr":"172.21.15.73:6809","nonce":1293329670}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6810","nonce":1293329670},{"type":"v1","addr":"172.21.15.73:6811","nonce":1293329670}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":1293329670},{"type":"v1","addr":"172.21.15.73:6815","nonce":1293329670}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":1293329670},{"type":"v1","addr":"172.21.15.73:6813","nonce":1293329670}]},"public_addr":"172.21.15.73:6809/1293329670","cluster_addr":"172.21.15.73:6811/1293329670","heartbeat_back_addr":"172.21.15.73:6815/1293329670","heartbeat_front_addr":"172.21.15.73:6813/1293329670","state":["exists","up"]},{"osd":4,"uuid":"4b302fff-834c-4069-ac19-00e46f6c87b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":3727975702},{"type":"v1","addr":"172.21.15.142:6801","nonce":3727975702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":3727975702},{"type":"v1","addr":"172.21.15.142:6803","nonce":3727975702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6809","nonce":3727975702},{"type":"v1","addr":"172.21.15.142:6811","nonce":3727975702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6805","nonce":3727975702},{"type":"v1","addr":"172.21.15.142:6807","nonce":3727975702}]},"public_addr":"172.21.15.142:6801/3727975702","cluster_addr":"172.21.15.142:6803/3727975702","heartbeat_back_addr":"172.21.15.142:6811/3727975702","heartbeat_front_addr":"172.21.15.142:6807/3727975702","state":["exists","up"]},{"osd":5,"uuid":"d7cdace2-67d0-45cc-95f2-515cf6ef1b82","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6817","nonce":2353193632},{"type":"v1","addr":"172.21.15.142:6819","nonce":2353193632}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6821","nonce":2353193632},{"type":"v1","addr":"172.21.15.142:6823","nonce":2353193632}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6829","nonce":2353193632},{"type":"v1","addr":"172.21.15.142:6831","nonce":2353193632}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6825","nonce":2353193632},{"type":"v1","addr":"172.21.15.142:6827","nonce":2353193632}]},"public_addr":"172.21.15.142:6819/2353193632","cluster_addr":"172.21.15.142:6823/2353193632","heartbeat_back_addr":"172.21.15.142:6831/2353193632","heartbeat_front_addr":"172.21.15.142:6827/2353193632","state":["exists","up"]},{"osd":6,"uuid":"649ce78a-5626-445c-aedc-a651ed05a6f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":2006111986},{"type":"v1","addr":"172.21.15.142:6806","nonce":2006111986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":2006111986},{"type":"v1","addr":"172.21.15.142:6810","nonce":2006111986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":2006111986},{"type":"v1","addr":"172.21.15.142:6815","nonce":2006111986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":2006111986},{"type":"v1","addr":"172.21.15.142:6813","nonce":2006111986}]},"public_addr":"172.21.15.142:6806/2006111986","cluster_addr":"172.21.15.142:6810/2006111986","heartbeat_back_addr":"172.21.15.142:6815/2006111986","heartbeat_front_addr":"172.21.15.142:6813/2006111986","state":["exists","up"]},{"osd":7,"uuid":"af15ae3b-c1d0-4acf-92db-8a1805494d13","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":2573794341},{"type":"v1","addr":"172.21.15.142:6818","nonce":2573794341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":2573794341},{"type":"v1","addr":"172.21.15.142:6822","nonce":2573794341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":2573794341},{"type":"v1","addr":"172.21.15.142:6830","nonce":2573794341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":2573794341},{"type":"v1","addr":"172.21.15.142:6826","nonce":2573794341}]},"public_addr":"172.21.15.142:6818/2573794341","cluster_addr":"172.21.15.142:6822/2573794341","heartbeat_back_addr":"172.21.15.142:6830/2573794341","heartbeat_front_addr":"172.21.15.142:6826/2573794341","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.185824+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.262103+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.225556+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:10.523459+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:10.706035+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.257339+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.301776+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.051960+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-12T09:45:27.441 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:27.440+0000 7f5b98e3d640 1 -- 172.21.15.73:0/2849155252 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f5b7406ae70 msgr2=0x7f5b7406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:27.442 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:27.440+0000 7f5b98e3d640 1 --2- 172.21.15.73:0/2849155252 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f5b7406ae70 0x7f5b7406d330 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f5b7c036000 tx=0x7f5b7c039040 comp rx=0 tx=0).stop 2023-12-12T09:45:27.442 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:27.440+0000 7f5b98e3d640 1 -- 172.21.15.73:0/2849155252 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5b9406a4e0 msgr2=0x7f5b940a87c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:27.442 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:27.440+0000 7f5b98e3d640 1 --2- 172.21.15.73:0/2849155252 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5b9406a4e0 0x7f5b940a87c0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f5b8400c7b0 tx=0x7f5b8400cc70 comp rx=0 tx=0).stop 2023-12-12T09:45:27.442 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:27.441+0000 7f5b98e3d640 1 -- 172.21.15.73:0/2849155252 shutdown_connections 2023-12-12T09:45:27.442 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:27.441+0000 7f5b98e3d640 1 --2- 172.21.15.73:0/2849155252 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f5b7406ae70 0x7f5b7406d330 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:27.443 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:27.441+0000 7f5b98e3d640 1 --2- 172.21.15.73:0/2849155252 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5b940a5040 0x7f5b94070f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:27.443 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:27.441+0000 7f5b98e3d640 1 --2- 172.21.15.73:0/2849155252 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5b9406bf90 0x7f5b940aa530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:27.443 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:27.441+0000 7f5b98e3d640 1 --2- 172.21.15.73:0/2849155252 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5b9406a4e0 0x7f5b940a87c0 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:27.443 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:27.441+0000 7f5b98e3d640 1 -- 172.21.15.73:0/2849155252 >> 172.21.15.73:0/2849155252 conn(0x7f5b940a8130 msgr2=0x7f5b940c3ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:45:27.443 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:27.441+0000 7f5b98e3d640 1 -- 172.21.15.73:0/2849155252 shutdown_connections 2023-12-12T09:45:27.443 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:27.441+0000 7f5b98e3d640 1 -- 172.21.15.73:0/2849155252 wait complete. 2023-12-12T09:45:27.462 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-12-12T09:45:27.462 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-12T09:45:27.673 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:27.671+0000 7f0428690640 1 Processor -- start 2023-12-12T09:45:27.673 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:27.671+0000 7f0428690640 1 -- start start 2023-12-12T09:45:27.680 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:27.673+0000 7f0428690640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f04201552e0 0x7f04200c49c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:27.681 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:27.673+0000 7f0428690640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04200c0b50 con 0x7f042006bf20 2023-12-12T09:45:27.681 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:27.673+0000 7f0428690640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f042006c880 con 0x7f04200a50f0 2023-12-12T09:45:27.681 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:27.673+0000 7f0428690640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04200c04d0 con 0x7f04201552e0 2023-12-12T09:45:27.682 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:27.673+0000 7f0426c2d640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f042006bf20 0x7f042015bb90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:35116/0 (socket says 172.21.15.73:35116) 2023-12-12T09:45:27.682 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:27.673+0000 7f0426c2d640 1 -- 172.21.15.73:0/2084417485 learned_addr learned my addr 172.21.15.73:0/2084417485 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-12T09:45:27.682 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:27.674+0000 7f042642c640 1 --2- 172.21.15.73:0/2084417485 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f04201552e0 0x7f04200c49c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:27.682 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:27.673+0000 7f042542a640 1 -- 172.21.15.73:0/2084417485 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 35190781 0 0) 0x7f04200c0b50 con 0x7f042006bf20 2023-12-12T09:45:27.682 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:27.674+0000 7f042542a640 1 -- 172.21.15.73:0/2084417485 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f040c005730 con 0x7f042006bf20 2023-12-12T09:45:27.682 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:27.674+0000 7f042542a640 1 -- 172.21.15.73:0/2084417485 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4152857421 0 0) 0x7f040c005730 con 0x7f042006bf20 2023-12-12T09:45:27.682 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:27.674+0000 7f042542a640 1 -- 172.21.15.73:0/2084417485 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f04201552e0 msgr2=0x7f04200c49c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:45:27.682 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:27.674+0000 7f042542a640 1 --2- 172.21.15.73:0/2084417485 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f04201552e0 0x7f04200c49c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:27.683 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:27.674+0000 7f042542a640 1 -- 172.21.15.73:0/2084417485 >> v1:172.21.15.142:6789/0 conn(0x7f04200a50f0 legacy=0x7f04200a9050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:27.683 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:27.674+0000 7f042542a640 1 -- 172.21.15.73:0/2084417485 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f042006cb60 con 0x7f042006bf20 2023-12-12T09:45:27.683 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:27.674+0000 7f042542a640 1 -- 172.21.15.73:0/2084417485 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3186547832 0 0) 0x7f04180019f0 con 0x7f042006bf20 2023-12-12T09:45:27.683 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:27.674+0000 7f042542a640 1 -- 172.21.15.73:0/2084417485 >> v1:172.21.15.73:6789/0 conn(0x7f042006bf20 legacy=0x7f042015bb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:27.683 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:27.674+0000 7f042542a640 1 --2- 172.21.15.73:0/2084417485 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f040c005bb0 0x7f040c005fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:27.683 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:27.674+0000 7f042542a640 1 --2- 172.21.15.73:0/2084417485 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f040c0069d0 0x7f040c006e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:27.683 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:27.674+0000 7f042542a640 1 --2- 172.21.15.73:0/2084417485 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f040c0073e0 0x7f040c00db90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:27.683 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:27.674+0000 7f042542a640 1 -- 172.21.15.73:0/2084417485 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04200c04d0 con 0x7f040c0073e0 2023-12-12T09:45:27.683 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:27.674+0000 7f042542a640 1 -- 172.21.15.73:0/2084417485 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f040c00e2e0 con 0x7f040c005bb0 2023-12-12T09:45:27.683 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:27.674+0000 7f042542a640 1 -- 172.21.15.73:0/2084417485 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f040c00e4a0 con 0x7f040c0069d0 2023-12-12T09:45:27.683 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:27.674+0000 7f042642c640 1 --2- 172.21.15.73:0/2084417485 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f04201552e0 0x7f04200c49c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-12T09:45:27.683 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:27.674+0000 7f0426c2d640 1 --2- 172.21.15.73:0/2084417485 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f040c0073e0 0x7f040c00db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:27.683 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:27.675+0000 7f0425c2b640 1 --2- 172.21.15.73:0/2084417485 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f040c0069d0 0x7f040c006e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:27.684 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:27.675+0000 7f0426c2d640 1 -- 172.21.15.73:0/2084417485 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f040c0069d0 msgr2=0x7f040c006e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:45:27.684 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:27.675+0000 7f0426c2d640 1 --2- 172.21.15.73:0/2084417485 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f040c0069d0 0x7f040c006e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:27.684 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:27.675+0000 7f0426c2d640 1 -- 172.21.15.73:0/2084417485 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f040c005bb0 msgr2=0x7f040c005fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:45:27.684 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:27.675+0000 7f042642c640 1 --2- 172.21.15.73:0/2084417485 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f040c005bb0 0x7f040c005fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:27.684 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:27.675+0000 7f0426c2d640 1 --2- 172.21.15.73:0/2084417485 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f040c005bb0 0x7f040c005fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:27.684 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:27.675+0000 7f0426c2d640 1 -- 172.21.15.73:0/2084417485 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f040c005730 con 0x7f040c0073e0 2023-12-12T09:45:27.684 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:27.675+0000 7f0425c2b640 1 --2- 172.21.15.73:0/2084417485 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f040c0069d0 0x7f040c006e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:45:27.684 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:27.676+0000 7f0426c2d640 1 --2- 172.21.15.73:0/2084417485 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f040c0073e0 0x7f040c00db90 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f041800a820 tx=0x7f040c007a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=155f76b9875995b2 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:45:27.685 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:27.676+0000 7f042542a640 1 -- 172.21.15.73:0/2084417485 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04180072d0 con 0x7f040c0073e0 2023-12-12T09:45:27.685 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:27.676+0000 7f042542a640 1 -- 172.21.15.73:0/2084417485 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f041802f070 con 0x7f040c0073e0 2023-12-12T09:45:27.685 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:27.676+0000 7f042542a640 1 -- 172.21.15.73:0/2084417485 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04180076b0 con 0x7f040c0073e0 2023-12-12T09:45:27.685 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:27.677+0000 7f0428690640 1 -- 172.21.15.73:0/2084417485 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f040c0073e0 msgr2=0x7f040c00db90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:27.685 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:27.677+0000 7f0428690640 1 --2- 172.21.15.73:0/2084417485 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f040c0073e0 0x7f040c00db90 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f041800a820 tx=0x7f040c007a00 comp rx=0 tx=0).stop 2023-12-12T09:45:27.685 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:27.677+0000 7f0426c2d640 1 -- 172.21.15.73:0/2084417485 reap_dead start 2023-12-12T09:45:27.685 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:27.677+0000 7f0428690640 1 -- 172.21.15.73:0/2084417485 shutdown_connections 2023-12-12T09:45:27.685 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:27.677+0000 7f0428690640 1 -- 172.21.15.73:0/2084417485 >> 172.21.15.73:0/2084417485 conn(0x7f04200a8130 msgr2=0x7f04200c24b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:45:27.686 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:27.677+0000 7f0428690640 1 -- 172.21.15.73:0/2084417485 shutdown_connections 2023-12-12T09:45:27.686 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:27.677+0000 7f0428690640 1 -- 172.21.15.73:0/2084417485 wait complete. 2023-12-12T09:45:27.686 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:27.679+0000 7f0428690640 1 Processor -- start 2023-12-12T09:45:27.686 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:27.679+0000 7f0428690640 1 -- start start 2023-12-12T09:45:27.690 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:27.680+0000 7f0428690640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f040c0073e0 0x7f0420071d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:27.690 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:27.680+0000 7f0428690640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f04201ea0b0 0x7f04201511f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:27.690 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:27.680+0000 7f0428690640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0420151730 0x7f04201ed620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:27.691 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:27.680+0000 7f0428690640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f042014f880 con 0x7f040c0073e0 2023-12-12T09:45:27.691 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:27.680+0000 7f0428690640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0420150d60 con 0x7f0420151730 2023-12-12T09:45:27.691 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:27.680+0000 7f0428690640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04201ea970 con 0x7f04201ea0b0 2023-12-12T09:45:27.691 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:27.680+0000 7f042642c640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f040c0073e0 0x7f0420071d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:27.691 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:27.680+0000 7f042642c640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f040c0073e0 0x7f0420071d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:45402/0 (socket says 172.21.15.73:45402) 2023-12-12T09:45:27.692 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:27.680+0000 7f042642c640 1 -- 172.21.15.73:0/3218583989 learned_addr learned my addr 172.21.15.73:0/3218583989 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:45:27.692 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:27.681+0000 7f0425c2b640 1 --2- 172.21.15.73:0/3218583989 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f04201ea0b0 0x7f04201511f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:27.692 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:27.681+0000 7f0426c2d640 1 --2- 172.21.15.73:0/3218583989 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0420151730 0x7f04201ed620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:27.692 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:27.681+0000 7f042642c640 1 -- 172.21.15.73:0/3218583989 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f04201ea0b0 msgr2=0x7f04201511f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:27.692 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:27.681+0000 7f042642c640 1 --2- 172.21.15.73:0/3218583989 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f04201ea0b0 0x7f04201511f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:27.693 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:27.681+0000 7f042642c640 1 -- 172.21.15.73:0/3218583989 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0420151730 msgr2=0x7f04201ed620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:27.693 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:27.681+0000 7f042642c640 1 --2- 172.21.15.73:0/3218583989 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0420151730 0x7f04201ed620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:27.693 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:27.681+0000 7f042642c640 1 -- 172.21.15.73:0/3218583989 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04201eac50 con 0x7f040c0073e0 2023-12-12T09:45:27.693 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:27.681+0000 7f042642c640 1 --2- 172.21.15.73:0/3218583989 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f040c0073e0 0x7f0420071d90 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f041c00f4c0 tx=0x7f041c00f980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:45:27.693 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:27.681+0000 7f0416ffd640 1 -- 172.21.15.73:0/3218583989 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f041c014890 con 0x7f040c0073e0 2023-12-12T09:45:27.693 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:27.681+0000 7f0416ffd640 1 -- 172.21.15.73:0/3218583989 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f041c00c030 con 0x7f040c0073e0 2023-12-12T09:45:27.693 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:27.681+0000 7f0416ffd640 1 -- 172.21.15.73:0/3218583989 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f041c014c10 con 0x7f040c0073e0 2023-12-12T09:45:27.694 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:27.681+0000 7f0428690640 1 -- 172.21.15.73:0/3218583989 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04201eaf30 con 0x7f040c0073e0 2023-12-12T09:45:27.694 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:27.681+0000 7f0428690640 1 -- 172.21.15.73:0/3218583989 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0420150960 con 0x7f040c0073e0 2023-12-12T09:45:27.694 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:27.682+0000 7f0428690640 1 -- 172.21.15.73:0/3218583989 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0420067580 con 0x7f040c0073e0 2023-12-12T09:45:27.694 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:27.683+0000 7f0416ffd640 1 -- 172.21.15.73:0/3218583989 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f041c0133e0 con 0x7f040c0073e0 2023-12-12T09:45:27.694 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:27.684+0000 7f0416ffd640 1 --2- 172.21.15.73:0/3218583989 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f040406ae70 0x7f040406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:27.694 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:27.684+0000 7f0416ffd640 1 -- 172.21.15.73:0/3218583989 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f041c089740 con 0x7f040c0073e0 2023-12-12T09:45:27.694 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:27.684+0000 7f0425c2b640 1 --2- 172.21.15.73:0/3218583989 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f040406ae70 0x7f040406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:27.694 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:27.685+0000 7f0425c2b640 1 --2- 172.21.15.73:0/3218583989 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f040406ae70 0x7f040406d330 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f0410007fd0 tx=0x7f0410009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:45:27.694 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:27.689+0000 7f0416ffd640 1 -- 172.21.15.73:0/3218583989 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f041c054880 con 0x7f040c0073e0 2023-12-12T09:45:27.876 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:27.874+0000 7f0428690640 1 -- 172.21.15.73:0/3218583989 --> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f04200c1ff0 con 0x7f040406ae70 2023-12-12T09:45:27.885 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:27.884+0000 7f0416ffd640 1 -- 172.21.15.73:0/3218583989 <== mgr.4110 v2:172.21.15.73:6832/779985841 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286685 (secure 0 0 0) 0x7f041000d040 con 0x7f040406ae70 2023-12-12T09:45:27.890 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-12T09:45:27.891 INFO:teuthology.orchestra.run.smithi073.stderr:dumped all 2023-12-12T09:45:27.893 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:27.890+0000 7f0428690640 1 -- 172.21.15.73:0/3218583989 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f040406ae70 msgr2=0x7f040406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:27.893 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:27.890+0000 7f0428690640 1 --2- 172.21.15.73:0/3218583989 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f040406ae70 0x7f040406d330 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f0410007fd0 tx=0x7f0410009040 comp rx=0 tx=0).stop 2023-12-12T09:45:27.893 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:27.890+0000 7f0428690640 1 -- 172.21.15.73:0/3218583989 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f040c0073e0 msgr2=0x7f0420071d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:27.893 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:27.890+0000 7f0428690640 1 --2- 172.21.15.73:0/3218583989 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f040c0073e0 0x7f0420071d90 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f041c00f4c0 tx=0x7f041c00f980 comp rx=0 tx=0).stop 2023-12-12T09:45:27.893 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:27.890+0000 7f0428690640 1 -- 172.21.15.73:0/3218583989 shutdown_connections 2023-12-12T09:45:27.893 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:27.890+0000 7f0428690640 1 --2- 172.21.15.73:0/3218583989 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f040406ae70 0x7f040406d330 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:27.893 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:27.890+0000 7f0428690640 1 --2- 172.21.15.73:0/3218583989 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0420151730 0x7f04201ed620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:27.893 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:27.890+0000 7f0428690640 1 --2- 172.21.15.73:0/3218583989 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f04201ea0b0 0x7f04201511f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:27.893 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:27.890+0000 7f0428690640 1 --2- 172.21.15.73:0/3218583989 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f040c0073e0 0x7f0420071d90 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:27.893 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:27.890+0000 7f0428690640 1 -- 172.21.15.73:0/3218583989 >> 172.21.15.73:0/3218583989 conn(0x7f04200a8130 msgr2=0x7f04200a5b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:45:27.894 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:27.891+0000 7f0428690640 1 -- 172.21.15.73:0/3218583989 shutdown_connections 2023-12-12T09:45:27.894 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:27.891+0000 7f0428690640 1 -- 172.21.15.73:0/3218583989 wait complete. 2023-12-12T09:45:27.910 INFO:teuthology.orchestra.run.smithi073.stdout:{"pg_ready":true,"pg_map":{"version":114,"stamp":"2023-12-12T09:45:27.496025+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":91,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":221348,"kb_used_data":5148,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754753372,"statfs":{"total":773094113280,"available":772867452928,"internally_reserved":0,"allocated":5271552,"data_stored":3339274,"data_compressed":64844,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":36,"apply_latency_ms":36,"commit_latency_ns":36000000,"apply_latency_ns":36000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.000147"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-12T09:45:23.546338+0000","last_change":"2023-12-12T09:45:23.538728+0000","last_active":"2023-12-12T09:45:23.546338+0000","last_peered":"2023-12-12T09:45:23.546338+0000","last_clean":"2023-12-12T09:45:23.546338+0000","last_became_active":"2023-12-12T09:45:23.538477+0000","last_became_peered":"2023-12-12T09:45:23.538477+0000","last_unstale":"2023-12-12T09:45:23.546338+0000","last_undegraded":"2023-12-12T09:45:23.546338+0000","last_fullsized":"2023-12-12T09:45:23.546338+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_clean_scrub_stamp":"2023-12-12T09:45:22.493994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T11:48:16.993527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-12T09:45:23.554393+0000","last_change":"2023-12-12T09:45:23.550472+0000","last_active":"2023-12-12T09:45:23.554393+0000","last_peered":"2023-12-12T09:45:23.554393+0000","last_clean":"2023-12-12T09:45:23.554393+0000","last_became_active":"2023-12-12T09:45:23.550233+0000","last_became_peered":"2023-12-12T09:45:23.550233+0000","last_unstale":"2023-12-12T09:45:23.554393+0000","last_undegraded":"2023-12-12T09:45:23.554393+0000","last_fullsized":"2023-12-12T09:45:23.554393+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_clean_scrub_stamp":"2023-12-12T09:45:22.493994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T14:20:09.952370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-12T09:45:23.556886+0000","last_change":"2023-12-12T09:45:23.550621+0000","last_active":"2023-12-12T09:45:23.556886+0000","last_peered":"2023-12-12T09:45:23.556886+0000","last_clean":"2023-12-12T09:45:23.556886+0000","last_became_active":"2023-12-12T09:45:23.550284+0000","last_became_peered":"2023-12-12T09:45:23.550284+0000","last_unstale":"2023-12-12T09:45:23.556886+0000","last_undegraded":"2023-12-12T09:45:23.556886+0000","last_fullsized":"2023-12-12T09:45:23.556886+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_clean_scrub_stamp":"2023-12-12T09:45:22.493994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T15:31:33.286934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-12T09:45:23.537539+0000","last_change":"2023-12-12T09:45:23.529454+0000","last_active":"2023-12-12T09:45:23.537539+0000","last_peered":"2023-12-12T09:45:23.537539+0000","last_clean":"2023-12-12T09:45:23.537539+0000","last_became_active":"2023-12-12T09:45:23.529064+0000","last_became_peered":"2023-12-12T09:45:23.529064+0000","last_unstale":"2023-12-12T09:45:23.537539+0000","last_undegraded":"2023-12-12T09:45:23.537539+0000","last_fullsized":"2023-12-12T09:45:23.537539+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_clean_scrub_stamp":"2023-12-12T09:45:22.493994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T15:15:38.448721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-12T09:45:23.542335+0000","last_change":"2023-12-12T09:45:23.532127+0000","last_active":"2023-12-12T09:45:23.542335+0000","last_peered":"2023-12-12T09:45:23.542335+0000","last_clean":"2023-12-12T09:45:23.542335+0000","last_became_active":"2023-12-12T09:45:23.531850+0000","last_became_peered":"2023-12-12T09:45:23.531850+0000","last_unstale":"2023-12-12T09:45:23.542335+0000","last_undegraded":"2023-12-12T09:45:23.542335+0000","last_fullsized":"2023-12-12T09:45:23.542335+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_clean_scrub_stamp":"2023-12-12T09:45:22.493994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T20:22:59.883001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-12T09:45:23.536211+0000","last_change":"2023-12-12T09:45:23.531673+0000","last_active":"2023-12-12T09:45:23.536211+0000","last_peered":"2023-12-12T09:45:23.536211+0000","last_clean":"2023-12-12T09:45:23.536211+0000","last_became_active":"2023-12-12T09:45:23.530075+0000","last_became_peered":"2023-12-12T09:45:23.530075+0000","last_unstale":"2023-12-12T09:45:23.536211+0000","last_undegraded":"2023-12-12T09:45:23.536211+0000","last_fullsized":"2023-12-12T09:45:23.536211+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_clean_scrub_stamp":"2023-12-12T09:45:22.493994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T14:03:03.059227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-12T09:45:23.555806+0000","last_change":"2023-12-12T09:45:23.545363+0000","last_active":"2023-12-12T09:45:23.555806+0000","last_peered":"2023-12-12T09:45:23.555806+0000","last_clean":"2023-12-12T09:45:23.555806+0000","last_became_active":"2023-12-12T09:45:23.543029+0000","last_became_peered":"2023-12-12T09:45:23.543029+0000","last_unstale":"2023-12-12T09:45:23.555806+0000","last_undegraded":"2023-12-12T09:45:23.555806+0000","last_fullsized":"2023-12-12T09:45:23.555806+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_clean_scrub_stamp":"2023-12-12T09:45:22.493994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T14:10:03.420375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-12T09:45:23.544882+0000","last_change":"2023-12-12T09:45:23.540907+0000","last_active":"2023-12-12T09:45:23.544882+0000","last_peered":"2023-12-12T09:45:23.544882+0000","last_clean":"2023-12-12T09:45:23.544882+0000","last_became_active":"2023-12-12T09:45:23.540653+0000","last_became_peered":"2023-12-12T09:45:23.540653+0000","last_unstale":"2023-12-12T09:45:23.544882+0000","last_undegraded":"2023-12-12T09:45:23.544882+0000","last_fullsized":"2023-12-12T09:45:23.544882+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_clean_scrub_stamp":"2023-12-12T09:45:22.493994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T17:51:26.545637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-12T09:45:23.558319+0000","last_change":"2023-12-12T09:45:23.552916+0000","last_active":"2023-12-12T09:45:23.558319+0000","last_peered":"2023-12-12T09:45:23.558319+0000","last_clean":"2023-12-12T09:45:23.558319+0000","last_became_active":"2023-12-12T09:45:23.552025+0000","last_became_peered":"2023-12-12T09:45:23.552025+0000","last_unstale":"2023-12-12T09:45:23.558319+0000","last_undegraded":"2023-12-12T09:45:23.558319+0000","last_fullsized":"2023-12-12T09:45:23.558319+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_clean_scrub_stamp":"2023-12-12T09:45:22.493994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T20:54:18.455210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-12T09:45:23.550563+0000","last_change":"2023-12-12T09:45:23.545833+0000","last_active":"2023-12-12T09:45:23.550563+0000","last_peered":"2023-12-12T09:45:23.550563+0000","last_clean":"2023-12-12T09:45:23.550563+0000","last_became_active":"2023-12-12T09:45:23.545073+0000","last_became_peered":"2023-12-12T09:45:23.545073+0000","last_unstale":"2023-12-12T09:45:23.550563+0000","last_undegraded":"2023-12-12T09:45:23.550563+0000","last_fullsized":"2023-12-12T09:45:23.550563+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_clean_scrub_stamp":"2023-12-12T09:45:22.493994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T20:52:45.344852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-12T09:45:23.548728+0000","last_change":"2023-12-12T09:45:23.542993+0000","last_active":"2023-12-12T09:45:23.548728+0000","last_peered":"2023-12-12T09:45:23.548728+0000","last_clean":"2023-12-12T09:45:23.548728+0000","last_became_active":"2023-12-12T09:45:23.542770+0000","last_became_peered":"2023-12-12T09:45:23.542770+0000","last_unstale":"2023-12-12T09:45:23.548728+0000","last_undegraded":"2023-12-12T09:45:23.548728+0000","last_fullsized":"2023-12-12T09:45:23.548728+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_clean_scrub_stamp":"2023-12-12T09:45:22.493994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T14:30:36.106005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-12T09:45:23.556455+0000","last_change":"2023-12-12T09:45:23.552839+0000","last_active":"2023-12-12T09:45:23.556455+0000","last_peered":"2023-12-12T09:45:23.556455+0000","last_clean":"2023-12-12T09:45:23.556455+0000","last_became_active":"2023-12-12T09:45:23.548568+0000","last_became_peered":"2023-12-12T09:45:23.548568+0000","last_unstale":"2023-12-12T09:45:23.556455+0000","last_undegraded":"2023-12-12T09:45:23.556455+0000","last_fullsized":"2023-12-12T09:45:23.556455+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_clean_scrub_stamp":"2023-12-12T09:45:22.493994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T19:52:29.626502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-12T09:45:23.538411+0000","last_change":"2023-12-12T09:45:23.536465+0000","last_active":"2023-12-12T09:45:23.538411+0000","last_peered":"2023-12-12T09:45:23.538411+0000","last_clean":"2023-12-12T09:45:23.538411+0000","last_became_active":"2023-12-12T09:45:23.536019+0000","last_became_peered":"2023-12-12T09:45:23.536019+0000","last_unstale":"2023-12-12T09:45:23.538411+0000","last_undegraded":"2023-12-12T09:45:23.538411+0000","last_fullsized":"2023-12-12T09:45:23.538411+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_clean_scrub_stamp":"2023-12-12T09:45:22.493994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T15:51:11.791727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-12T09:45:23.558185+0000","last_change":"2023-12-12T09:45:23.551554+0000","last_active":"2023-12-12T09:45:23.558185+0000","last_peered":"2023-12-12T09:45:23.558185+0000","last_clean":"2023-12-12T09:45:23.558185+0000","last_became_active":"2023-12-12T09:45:23.548473+0000","last_became_peered":"2023-12-12T09:45:23.548473+0000","last_unstale":"2023-12-12T09:45:23.558185+0000","last_undegraded":"2023-12-12T09:45:23.558185+0000","last_fullsized":"2023-12-12T09:45:23.558185+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_clean_scrub_stamp":"2023-12-12T09:45:22.493994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T15:31:33.286934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-12T09:45:23.555246+0000","last_change":"2023-12-12T09:45:23.543290+0000","last_active":"2023-12-12T09:45:23.555246+0000","last_peered":"2023-12-12T09:45:23.555246+0000","last_clean":"2023-12-12T09:45:23.555246+0000","last_became_active":"2023-12-12T09:45:23.542623+0000","last_became_peered":"2023-12-12T09:45:23.542623+0000","last_unstale":"2023-12-12T09:45:23.555246+0000","last_undegraded":"2023-12-12T09:45:23.555246+0000","last_fullsized":"2023-12-12T09:45:23.555246+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_clean_scrub_stamp":"2023-12-12T09:45:22.493994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T14:30:36.106005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-12T09:45:23.555709+0000","last_change":"2023-12-12T09:45:23.550153+0000","last_active":"2023-12-12T09:45:23.555709+0000","last_peered":"2023-12-12T09:45:23.555709+0000","last_clean":"2023-12-12T09:45:23.555709+0000","last_became_active":"2023-12-12T09:45:23.548835+0000","last_became_peered":"2023-12-12T09:45:23.548835+0000","last_unstale":"2023-12-12T09:45:23.555709+0000","last_undegraded":"2023-12-12T09:45:23.555709+0000","last_fullsized":"2023-12-12T09:45:23.555709+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_clean_scrub_stamp":"2023-12-12T09:45:22.493994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T15:31:33.286934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-12T09:45:23.545495+0000","last_change":"2023-12-12T09:45:23.542153+0000","last_active":"2023-12-12T09:45:23.545495+0000","last_peered":"2023-12-12T09:45:23.545495+0000","last_clean":"2023-12-12T09:45:23.545495+0000","last_became_active":"2023-12-12T09:45:23.541948+0000","last_became_peered":"2023-12-12T09:45:23.541948+0000","last_unstale":"2023-12-12T09:45:23.545495+0000","last_undegraded":"2023-12-12T09:45:23.545495+0000","last_fullsized":"2023-12-12T09:45:23.545495+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_clean_scrub_stamp":"2023-12-12T09:45:22.493994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T12:53:08.506599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-12T09:45:23.557747+0000","last_change":"2023-12-12T09:45:23.553823+0000","last_active":"2023-12-12T09:45:23.557747+0000","last_peered":"2023-12-12T09:45:23.557747+0000","last_clean":"2023-12-12T09:45:23.557747+0000","last_became_active":"2023-12-12T09:45:23.553411+0000","last_became_peered":"2023-12-12T09:45:23.553411+0000","last_unstale":"2023-12-12T09:45:23.557747+0000","last_undegraded":"2023-12-12T09:45:23.557747+0000","last_fullsized":"2023-12-12T09:45:23.557747+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_clean_scrub_stamp":"2023-12-12T09:45:22.493994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T14:03:03.059227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-12T09:45:23.546372+0000","last_change":"2023-12-12T09:45:23.538491+0000","last_active":"2023-12-12T09:45:23.546372+0000","last_peered":"2023-12-12T09:45:23.546372+0000","last_clean":"2023-12-12T09:45:23.546372+0000","last_became_active":"2023-12-12T09:45:23.538127+0000","last_became_peered":"2023-12-12T09:45:23.538127+0000","last_unstale":"2023-12-12T09:45:23.546372+0000","last_undegraded":"2023-12-12T09:45:23.546372+0000","last_fullsized":"2023-12-12T09:45:23.546372+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_clean_scrub_stamp":"2023-12-12T09:45:22.493994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T17:29:05.098537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-12T09:45:23.555717+0000","last_change":"2023-12-12T09:45:23.551873+0000","last_active":"2023-12-12T09:45:23.555717+0000","last_peered":"2023-12-12T09:45:23.555717+0000","last_clean":"2023-12-12T09:45:23.555717+0000","last_became_active":"2023-12-12T09:45:23.551158+0000","last_became_peered":"2023-12-12T09:45:23.551158+0000","last_unstale":"2023-12-12T09:45:23.555717+0000","last_undegraded":"2023-12-12T09:45:23.555717+0000","last_fullsized":"2023-12-12T09:45:23.555717+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_clean_scrub_stamp":"2023-12-12T09:45:22.493994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T14:16:48.793935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-12T09:45:23.555934+0000","last_change":"2023-12-12T09:45:23.549785+0000","last_active":"2023-12-12T09:45:23.555934+0000","last_peered":"2023-12-12T09:45:23.555934+0000","last_clean":"2023-12-12T09:45:23.555934+0000","last_became_active":"2023-12-12T09:45:23.548831+0000","last_became_peered":"2023-12-12T09:45:23.548831+0000","last_unstale":"2023-12-12T09:45:23.555934+0000","last_undegraded":"2023-12-12T09:45:23.555934+0000","last_fullsized":"2023-12-12T09:45:23.555934+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_clean_scrub_stamp":"2023-12-12T09:45:22.493994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T21:23:17.912081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-12T09:45:23.552840+0000","last_change":"2023-12-12T09:45:23.546134+0000","last_active":"2023-12-12T09:45:23.552840+0000","last_peered":"2023-12-12T09:45:23.552840+0000","last_clean":"2023-12-12T09:45:23.552840+0000","last_became_active":"2023-12-12T09:45:23.545808+0000","last_became_peered":"2023-12-12T09:45:23.545808+0000","last_unstale":"2023-12-12T09:45:23.552840+0000","last_undegraded":"2023-12-12T09:45:23.552840+0000","last_fullsized":"2023-12-12T09:45:23.552840+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_clean_scrub_stamp":"2023-12-12T09:45:22.493994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T12:04:22.521885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-12T09:45:23.558093+0000","last_change":"2023-12-12T09:45:23.555039+0000","last_active":"2023-12-12T09:45:23.558093+0000","last_peered":"2023-12-12T09:45:23.558093+0000","last_clean":"2023-12-12T09:45:23.558093+0000","last_became_active":"2023-12-12T09:45:23.554002+0000","last_became_peered":"2023-12-12T09:45:23.554002+0000","last_unstale":"2023-12-12T09:45:23.558093+0000","last_undegraded":"2023-12-12T09:45:23.558093+0000","last_fullsized":"2023-12-12T09:45:23.558093+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_clean_scrub_stamp":"2023-12-12T09:45:22.493994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T15:15:38.448721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-12T09:45:23.535910+0000","last_change":"2023-12-12T09:45:23.530338+0000","last_active":"2023-12-12T09:45:23.535910+0000","last_peered":"2023-12-12T09:45:23.535910+0000","last_clean":"2023-12-12T09:45:23.535910+0000","last_became_active":"2023-12-12T09:45:23.529963+0000","last_became_peered":"2023-12-12T09:45:23.529963+0000","last_unstale":"2023-12-12T09:45:23.535910+0000","last_undegraded":"2023-12-12T09:45:23.535910+0000","last_fullsized":"2023-12-12T09:45:23.535910+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_clean_scrub_stamp":"2023-12-12T09:45:22.493994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T21:42:01.335580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-12T09:45:23.535554+0000","last_change":"2023-12-12T09:45:23.528718+0000","last_active":"2023-12-12T09:45:23.535554+0000","last_peered":"2023-12-12T09:45:23.535554+0000","last_clean":"2023-12-12T09:45:23.535554+0000","last_became_active":"2023-12-12T09:45:23.525181+0000","last_became_peered":"2023-12-12T09:45:23.525181+0000","last_unstale":"2023-12-12T09:45:23.535554+0000","last_undegraded":"2023-12-12T09:45:23.535554+0000","last_fullsized":"2023-12-12T09:45:23.535554+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_clean_scrub_stamp":"2023-12-12T09:45:22.493994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T14:55:40.208388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-12T09:45:23.555280+0000","last_change":"2023-12-12T09:45:23.546891+0000","last_active":"2023-12-12T09:45:23.555280+0000","last_peered":"2023-12-12T09:45:23.555280+0000","last_clean":"2023-12-12T09:45:23.555280+0000","last_became_active":"2023-12-12T09:45:23.544703+0000","last_became_peered":"2023-12-12T09:45:23.544703+0000","last_unstale":"2023-12-12T09:45:23.555280+0000","last_undegraded":"2023-12-12T09:45:23.555280+0000","last_fullsized":"2023-12-12T09:45:23.555280+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_clean_scrub_stamp":"2023-12-12T09:45:22.493994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T10:40:43.209236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-12T09:45:23.552138+0000","last_change":"2023-12-12T09:45:23.542373+0000","last_active":"2023-12-12T09:45:23.552138+0000","last_peered":"2023-12-12T09:45:23.552138+0000","last_clean":"2023-12-12T09:45:23.552138+0000","last_became_active":"2023-12-12T09:45:23.541920+0000","last_became_peered":"2023-12-12T09:45:23.541920+0000","last_unstale":"2023-12-12T09:45:23.552138+0000","last_undegraded":"2023-12-12T09:45:23.552138+0000","last_fullsized":"2023-12-12T09:45:23.552138+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_clean_scrub_stamp":"2023-12-12T09:45:22.493994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T20:27:09.962474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-12T09:45:23.546587+0000","last_change":"2023-12-12T09:45:23.541091+0000","last_active":"2023-12-12T09:45:23.546587+0000","last_peered":"2023-12-12T09:45:23.546587+0000","last_clean":"2023-12-12T09:45:23.546587+0000","last_became_active":"2023-12-12T09:45:23.540514+0000","last_became_peered":"2023-12-12T09:45:23.540514+0000","last_unstale":"2023-12-12T09:45:23.546587+0000","last_undegraded":"2023-12-12T09:45:23.546587+0000","last_fullsized":"2023-12-12T09:45:23.546587+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_clean_scrub_stamp":"2023-12-12T09:45:22.493994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T20:43:25.175410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-12T09:45:23.554136+0000","last_change":"2023-12-12T09:45:23.546206+0000","last_active":"2023-12-12T09:45:23.554136+0000","last_peered":"2023-12-12T09:45:23.554136+0000","last_clean":"2023-12-12T09:45:23.554136+0000","last_became_active":"2023-12-12T09:45:23.545933+0000","last_became_peered":"2023-12-12T09:45:23.545933+0000","last_unstale":"2023-12-12T09:45:23.554136+0000","last_undegraded":"2023-12-12T09:45:23.554136+0000","last_fullsized":"2023-12-12T09:45:23.554136+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_clean_scrub_stamp":"2023-12-12T09:45:22.493994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T10:08:57.049367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-12T09:45:23.557999+0000","last_change":"2023-12-12T09:45:23.554368+0000","last_active":"2023-12-12T09:45:23.557999+0000","last_peered":"2023-12-12T09:45:23.557999+0000","last_clean":"2023-12-12T09:45:23.557999+0000","last_became_active":"2023-12-12T09:45:23.554034+0000","last_became_peered":"2023-12-12T09:45:23.554034+0000","last_unstale":"2023-12-12T09:45:23.557999+0000","last_undegraded":"2023-12-12T09:45:23.557999+0000","last_fullsized":"2023-12-12T09:45:23.557999+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_clean_scrub_stamp":"2023-12-12T09:45:22.493994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T17:58:31.519111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-12T09:45:23.540805+0000","last_change":"2023-12-12T09:45:23.529597+0000","last_active":"2023-12-12T09:45:23.540805+0000","last_peered":"2023-12-12T09:45:23.540805+0000","last_clean":"2023-12-12T09:45:23.540805+0000","last_became_active":"2023-12-12T09:45:23.524375+0000","last_became_peered":"2023-12-12T09:45:23.524375+0000","last_unstale":"2023-12-12T09:45:23.540805+0000","last_undegraded":"2023-12-12T09:45:23.540805+0000","last_fullsized":"2023-12-12T09:45:23.540805+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_clean_scrub_stamp":"2023-12-12T09:45:22.493994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T12:32:17.749532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-12T09:45:23.558862+0000","last_change":"2023-12-12T09:45:23.553950+0000","last_active":"2023-12-12T09:45:23.558862+0000","last_peered":"2023-12-12T09:45:23.558862+0000","last_clean":"2023-12-12T09:45:23.558862+0000","last_became_active":"2023-12-12T09:45:23.551990+0000","last_became_peered":"2023-12-12T09:45:23.551990+0000","last_unstale":"2023-12-12T09:45:23.558862+0000","last_undegraded":"2023-12-12T09:45:23.558862+0000","last_fullsized":"2023-12-12T09:45:23.558862+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_clean_scrub_stamp":"2023-12-12T09:45:22.493994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T10:40:43.209236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-12T09:45:23.555763+0000","last_change":"2023-12-12T09:45:23.551190+0000","last_active":"2023-12-12T09:45:23.555763+0000","last_peered":"2023-12-12T09:45:23.555763+0000","last_clean":"2023-12-12T09:45:23.555763+0000","last_became_active":"2023-12-12T09:45:23.550956+0000","last_became_peered":"2023-12-12T09:45:23.550956+0000","last_unstale":"2023-12-12T09:45:23.555763+0000","last_undegraded":"2023-12-12T09:45:23.555763+0000","last_fullsized":"2023-12-12T09:45:23.555763+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_clean_scrub_stamp":"2023-12-12T09:45:22.493994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T19:52:29.626502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1f","version":"53'4","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-12T09:45:23.548439+0000","last_change":"2023-12-12T09:45:22.537277+0000","last_active":"2023-12-12T09:45:23.548439+0000","last_peered":"2023-12-12T09:45:23.548439+0000","last_clean":"2023-12-12T09:45:23.548439+0000","last_became_active":"2023-12-12T09:45:22.536893+0000","last_became_peered":"2023-12-12T09:45:22.536893+0000","last_unstale":"2023-12-12T09:45:23.548439+0000","last_undegraded":"2023-12-12T09:45:23.548439+0000","last_fullsized":"2023-12-12T09:45:23.548439+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:21.477323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:21.477323+0000","last_clean_scrub_stamp":"2023-12-12T09:45:21.477323+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T16:38:00.043063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-12T09:45:23.556080+0000","last_change":"2023-12-12T09:45:23.549535+0000","last_active":"2023-12-12T09:45:23.556080+0000","last_peered":"2023-12-12T09:45:23.556080+0000","last_clean":"2023-12-12T09:45:23.556080+0000","last_became_active":"2023-12-12T09:45:23.549256+0000","last_became_peered":"2023-12-12T09:45:23.549256+0000","last_unstale":"2023-12-12T09:45:23.556080+0000","last_undegraded":"2023-12-12T09:45:23.556080+0000","last_fullsized":"2023-12-12T09:45:23.556080+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_clean_scrub_stamp":"2023-12-12T09:45:22.493994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T20:54:18.455210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"53'1","reported_seq":12,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-12T09:45:23.551252+0000","last_change":"2023-12-12T09:45:22.543679+0000","last_active":"2023-12-12T09:45:23.551252+0000","last_peered":"2023-12-12T09:45:23.551252+0000","last_clean":"2023-12-12T09:45:23.551252+0000","last_became_active":"2023-12-12T09:45:22.543357+0000","last_became_peered":"2023-12-12T09:45:22.543357+0000","last_unstale":"2023-12-12T09:45:23.551252+0000","last_undegraded":"2023-12-12T09:45:23.551252+0000","last_fullsized":"2023-12-12T09:45:23.551252+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:21.477323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:21.477323+0000","last_clean_scrub_stamp":"2023-12-12T09:45:21.477323+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T13:19:15.975105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-12T09:45:23.538889+0000","last_change":"2023-12-12T09:45:23.531455+0000","last_active":"2023-12-12T09:45:23.538889+0000","last_peered":"2023-12-12T09:45:23.538889+0000","last_clean":"2023-12-12T09:45:23.538889+0000","last_became_active":"2023-12-12T09:45:23.531164+0000","last_became_peered":"2023-12-12T09:45:23.531164+0000","last_unstale":"2023-12-12T09:45:23.538889+0000","last_undegraded":"2023-12-12T09:45:23.538889+0000","last_fullsized":"2023-12-12T09:45:23.538889+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_clean_scrub_stamp":"2023-12-12T09:45:22.493994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T13:28:38.787401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"53'2","reported_seq":13,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-12T09:45:23.547851+0000","last_change":"2023-12-12T09:45:22.531101+0000","last_active":"2023-12-12T09:45:23.547851+0000","last_peered":"2023-12-12T09:45:23.547851+0000","last_clean":"2023-12-12T09:45:23.547851+0000","last_became_active":"2023-12-12T09:45:22.530822+0000","last_became_peered":"2023-12-12T09:45:22.530822+0000","last_unstale":"2023-12-12T09:45:23.547851+0000","last_undegraded":"2023-12-12T09:45:23.547851+0000","last_fullsized":"2023-12-12T09:45:23.547851+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:21.477323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:21.477323+0000","last_clean_scrub_stamp":"2023-12-12T09:45:21.477323+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T21:23:16.895410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-12T09:45:23.555392+0000","last_change":"2023-12-12T09:45:23.548842+0000","last_active":"2023-12-12T09:45:23.555392+0000","last_peered":"2023-12-12T09:45:23.555392+0000","last_clean":"2023-12-12T09:45:23.555392+0000","last_became_active":"2023-12-12T09:45:23.548561+0000","last_became_peered":"2023-12-12T09:45:23.548561+0000","last_unstale":"2023-12-12T09:45:23.555392+0000","last_undegraded":"2023-12-12T09:45:23.555392+0000","last_fullsized":"2023-12-12T09:45:23.555392+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_clean_scrub_stamp":"2023-12-12T09:45:22.493994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T19:01:50.522909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1c","version":"53'2","reported_seq":13,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-12T09:45:23.557075+0000","last_change":"2023-12-12T09:45:22.540050+0000","last_active":"2023-12-12T09:45:23.557075+0000","last_peered":"2023-12-12T09:45:23.557075+0000","last_clean":"2023-12-12T09:45:23.557075+0000","last_became_active":"2023-12-12T09:45:22.539726+0000","last_became_peered":"2023-12-12T09:45:22.539726+0000","last_unstale":"2023-12-12T09:45:23.557075+0000","last_undegraded":"2023-12-12T09:45:23.557075+0000","last_fullsized":"2023-12-12T09:45:23.557075+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:21.477323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:21.477323+0000","last_clean_scrub_stamp":"2023-12-12T09:45:21.477323+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T19:19:47.388523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-12T09:45:23.538130+0000","last_change":"2023-12-12T09:45:23.536948+0000","last_active":"2023-12-12T09:45:23.538130+0000","last_peered":"2023-12-12T09:45:23.538130+0000","last_clean":"2023-12-12T09:45:23.538130+0000","last_became_active":"2023-12-12T09:45:23.536696+0000","last_became_peered":"2023-12-12T09:45:23.536696+0000","last_unstale":"2023-12-12T09:45:23.538130+0000","last_undegraded":"2023-12-12T09:45:23.538130+0000","last_fullsized":"2023-12-12T09:45:23.538130+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_clean_scrub_stamp":"2023-12-12T09:45:22.493994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T20:14:20.654636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"53'1","reported_seq":12,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-12T09:45:23.554640+0000","last_change":"2023-12-12T09:45:22.543941+0000","last_active":"2023-12-12T09:45:23.554640+0000","last_peered":"2023-12-12T09:45:23.554640+0000","last_clean":"2023-12-12T09:45:23.554640+0000","last_became_active":"2023-12-12T09:45:22.543584+0000","last_became_peered":"2023-12-12T09:45:22.543584+0000","last_unstale":"2023-12-12T09:45:23.554640+0000","last_undegraded":"2023-12-12T09:45:23.554640+0000","last_fullsized":"2023-12-12T09:45:23.554640+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:21.477323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:21.477323+0000","last_clean_scrub_stamp":"2023-12-12T09:45:21.477323+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T13:28:37.770730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-12T09:45:23.558654+0000","last_change":"2023-12-12T09:45:23.553762+0000","last_active":"2023-12-12T09:45:23.558654+0000","last_peered":"2023-12-12T09:45:23.558654+0000","last_clean":"2023-12-12T09:45:23.558654+0000","last_became_active":"2023-12-12T09:45:23.553518+0000","last_became_peered":"2023-12-12T09:45:23.553518+0000","last_unstale":"2023-12-12T09:45:23.558654+0000","last_undegraded":"2023-12-12T09:45:23.558654+0000","last_fullsized":"2023-12-12T09:45:23.558654+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_clean_scrub_stamp":"2023-12-12T09:45:22.493994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T18:41:29.720316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1a","version":"53'1","reported_seq":12,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-12T09:45:23.548286+0000","last_change":"2023-12-12T09:45:22.535525+0000","last_active":"2023-12-12T09:45:23.548286+0000","last_peered":"2023-12-12T09:45:23.548286+0000","last_clean":"2023-12-12T09:45:23.548286+0000","last_became_active":"2023-12-12T09:45:22.534726+0000","last_became_peered":"2023-12-12T09:45:22.534726+0000","last_unstale":"2023-12-12T09:45:23.548286+0000","last_undegraded":"2023-12-12T09:45:23.548286+0000","last_fullsized":"2023-12-12T09:45:23.548286+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:21.477323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:21.477323+0000","last_clean_scrub_stamp":"2023-12-12T09:45:21.477323+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T16:23:29.088120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-12T09:45:23.554388+0000","last_change":"2023-12-12T09:45:23.550084+0000","last_active":"2023-12-12T09:45:23.554388+0000","last_peered":"2023-12-12T09:45:23.554388+0000","last_clean":"2023-12-12T09:45:23.554388+0000","last_became_active":"2023-12-12T09:45:23.549808+0000","last_became_peered":"2023-12-12T09:45:23.549808+0000","last_unstale":"2023-12-12T09:45:23.554388+0000","last_undegraded":"2023-12-12T09:45:23.554388+0000","last_fullsized":"2023-12-12T09:45:23.554388+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_clean_scrub_stamp":"2023-12-12T09:45:22.493994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T10:00:37.765775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-12T09:45:23.516843+0000","last_change":"2023-12-12T09:45:22.531465+0000","last_active":"2023-12-12T09:45:23.516843+0000","last_peered":"2023-12-12T09:45:23.516843+0000","last_clean":"2023-12-12T09:45:23.516843+0000","last_became_active":"2023-12-12T09:45:22.531205+0000","last_became_peered":"2023-12-12T09:45:22.531205+0000","last_unstale":"2023-12-12T09:45:23.516843+0000","last_undegraded":"2023-12-12T09:45:23.516843+0000","last_fullsized":"2023-12-12T09:45:23.516843+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:21.477323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:21.477323+0000","last_clean_scrub_stamp":"2023-12-12T09:45:21.477323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T13:28:37.770730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-12T09:45:23.545499+0000","last_change":"2023-12-12T09:45:23.542175+0000","last_active":"2023-12-12T09:45:23.545499+0000","last_peered":"2023-12-12T09:45:23.545499+0000","last_clean":"2023-12-12T09:45:23.545499+0000","last_became_active":"2023-12-12T09:45:23.541908+0000","last_became_peered":"2023-12-12T09:45:23.541908+0000","last_unstale":"2023-12-12T09:45:23.545499+0000","last_undegraded":"2023-12-12T09:45:23.545499+0000","last_fullsized":"2023-12-12T09:45:23.545499+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_clean_scrub_stamp":"2023-12-12T09:45:22.493994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T17:31:24.263383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-12T09:45:23.534041+0000","last_change":"2023-12-12T09:45:22.540369+0000","last_active":"2023-12-12T09:45:23.534041+0000","last_peered":"2023-12-12T09:45:23.534041+0000","last_clean":"2023-12-12T09:45:23.534041+0000","last_became_active":"2023-12-12T09:45:22.540054+0000","last_became_peered":"2023-12-12T09:45:22.540054+0000","last_unstale":"2023-12-12T09:45:23.534041+0000","last_undegraded":"2023-12-12T09:45:23.534041+0000","last_fullsized":"2023-12-12T09:45:23.534041+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:21.477323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:21.477323+0000","last_clean_scrub_stamp":"2023-12-12T09:45:21.477323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T14:03:02.042556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-12T09:45:23.558309+0000","last_change":"2023-12-12T09:45:23.552875+0000","last_active":"2023-12-12T09:45:23.558309+0000","last_peered":"2023-12-12T09:45:23.558309+0000","last_clean":"2023-12-12T09:45:23.558309+0000","last_became_active":"2023-12-12T09:45:23.551034+0000","last_became_peered":"2023-12-12T09:45:23.551034+0000","last_unstale":"2023-12-12T09:45:23.558309+0000","last_undegraded":"2023-12-12T09:45:23.558309+0000","last_fullsized":"2023-12-12T09:45:23.558309+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_clean_scrub_stamp":"2023-12-12T09:45:22.493994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T18:05:50.089314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-12T09:45:23.537176+0000","last_change":"2023-12-12T09:45:22.546259+0000","last_active":"2023-12-12T09:45:23.537176+0000","last_peered":"2023-12-12T09:45:23.537176+0000","last_clean":"2023-12-12T09:45:23.537176+0000","last_became_active":"2023-12-12T09:45:22.545948+0000","last_became_peered":"2023-12-12T09:45:22.545948+0000","last_unstale":"2023-12-12T09:45:23.537176+0000","last_undegraded":"2023-12-12T09:45:23.537176+0000","last_fullsized":"2023-12-12T09:45:23.537176+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:21.477323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:21.477323+0000","last_clean_scrub_stamp":"2023-12-12T09:45:21.477323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T19:19:47.388523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-12T09:45:23.558885+0000","last_change":"2023-12-12T09:45:23.556637+0000","last_active":"2023-12-12T09:45:23.558885+0000","last_peered":"2023-12-12T09:45:23.558885+0000","last_clean":"2023-12-12T09:45:23.558885+0000","last_became_active":"2023-12-12T09:45:23.556344+0000","last_became_peered":"2023-12-12T09:45:23.556344+0000","last_unstale":"2023-12-12T09:45:23.558885+0000","last_undegraded":"2023-12-12T09:45:23.558885+0000","last_fullsized":"2023-12-12T09:45:23.558885+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_clean_scrub_stamp":"2023-12-12T09:45:22.493994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T19:52:29.626502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-12T09:45:23.533254+0000","last_change":"2023-12-12T09:45:22.537346+0000","last_active":"2023-12-12T09:45:23.533254+0000","last_peered":"2023-12-12T09:45:23.533254+0000","last_clean":"2023-12-12T09:45:23.533254+0000","last_became_active":"2023-12-12T09:45:22.535141+0000","last_became_peered":"2023-12-12T09:45:22.535141+0000","last_unstale":"2023-12-12T09:45:23.533254+0000","last_undegraded":"2023-12-12T09:45:23.533254+0000","last_fullsized":"2023-12-12T09:45:23.533254+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:21.477323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:21.477323+0000","last_clean_scrub_stamp":"2023-12-12T09:45:21.477323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T18:37:25.938135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-12T09:45:23.556142+0000","last_change":"2023-12-12T09:45:23.549595+0000","last_active":"2023-12-12T09:45:23.556142+0000","last_peered":"2023-12-12T09:45:23.556142+0000","last_clean":"2023-12-12T09:45:23.556142+0000","last_became_active":"2023-12-12T09:45:23.549247+0000","last_became_peered":"2023-12-12T09:45:23.549247+0000","last_unstale":"2023-12-12T09:45:23.556142+0000","last_undegraded":"2023-12-12T09:45:23.556142+0000","last_fullsized":"2023-12-12T09:45:23.556142+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_clean_scrub_stamp":"2023-12-12T09:45:22.493994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T14:10:03.420375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.15","version":"53'3","reported_seq":14,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-12T09:45:23.558205+0000","last_change":"2023-12-12T09:45:22.546308+0000","last_active":"2023-12-12T09:45:23.558205+0000","last_peered":"2023-12-12T09:45:23.558205+0000","last_clean":"2023-12-12T09:45:23.558205+0000","last_became_active":"2023-12-12T09:45:22.545942+0000","last_became_peered":"2023-12-12T09:45:22.545942+0000","last_unstale":"2023-12-12T09:45:23.558205+0000","last_undegraded":"2023-12-12T09:45:23.558205+0000","last_fullsized":"2023-12-12T09:45:23.558205+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:21.477323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:21.477323+0000","last_clean_scrub_stamp":"2023-12-12T09:45:21.477323+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T13:07:07.278574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-12T09:45:23.559276+0000","last_change":"2023-12-12T09:45:23.557554+0000","last_active":"2023-12-12T09:45:23.559276+0000","last_peered":"2023-12-12T09:45:23.559276+0000","last_clean":"2023-12-12T09:45:23.559276+0000","last_became_active":"2023-12-12T09:45:23.557239+0000","last_became_peered":"2023-12-12T09:45:23.557239+0000","last_unstale":"2023-12-12T09:45:23.559276+0000","last_undegraded":"2023-12-12T09:45:23.559276+0000","last_fullsized":"2023-12-12T09:45:23.559276+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_clean_scrub_stamp":"2023-12-12T09:45:22.493994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T16:23:30.104791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.14","version":"53'6","reported_seq":17,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-12T09:45:23.561272+0000","last_change":"2023-12-12T09:45:22.543924+0000","last_active":"2023-12-12T09:45:23.561272+0000","last_peered":"2023-12-12T09:45:23.561272+0000","last_clean":"2023-12-12T09:45:23.561272+0000","last_became_active":"2023-12-12T09:45:22.543617+0000","last_became_peered":"2023-12-12T09:45:22.543617+0000","last_unstale":"2023-12-12T09:45:23.561272+0000","last_undegraded":"2023-12-12T09:45:23.561272+0000","last_fullsized":"2023-12-12T09:45:23.561272+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:21.477323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:21.477323+0000","last_clean_scrub_stamp":"2023-12-12T09:45:21.477323+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T20:52:44.328181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-12T09:45:23.544229+0000","last_change":"2023-12-12T09:45:23.542417+0000","last_active":"2023-12-12T09:45:23.544229+0000","last_peered":"2023-12-12T09:45:23.544229+0000","last_clean":"2023-12-12T09:45:23.544229+0000","last_became_active":"2023-12-12T09:45:23.541778+0000","last_became_peered":"2023-12-12T09:45:23.541778+0000","last_unstale":"2023-12-12T09:45:23.544229+0000","last_undegraded":"2023-12-12T09:45:23.544229+0000","last_fullsized":"2023-12-12T09:45:23.544229+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_clean_scrub_stamp":"2023-12-12T09:45:22.493994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T16:38:01.059734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"53'2","reported_seq":13,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-12T09:45:23.550685+0000","last_change":"2023-12-12T09:45:22.531079+0000","last_active":"2023-12-12T09:45:23.550685+0000","last_peered":"2023-12-12T09:45:23.550685+0000","last_clean":"2023-12-12T09:45:23.550685+0000","last_became_active":"2023-12-12T09:45:22.530821+0000","last_became_peered":"2023-12-12T09:45:22.530821+0000","last_unstale":"2023-12-12T09:45:23.550685+0000","last_undegraded":"2023-12-12T09:45:23.550685+0000","last_fullsized":"2023-12-12T09:45:23.550685+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:21.477323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:21.477323+0000","last_clean_scrub_stamp":"2023-12-12T09:45:21.477323+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T14:54:09.644707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-12T09:45:23.555970+0000","last_change":"2023-12-12T09:45:23.550533+0000","last_active":"2023-12-12T09:45:23.555970+0000","last_peered":"2023-12-12T09:45:23.555970+0000","last_clean":"2023-12-12T09:45:23.555970+0000","last_became_active":"2023-12-12T09:45:23.548384+0000","last_became_peered":"2023-12-12T09:45:23.548384+0000","last_unstale":"2023-12-12T09:45:23.555970+0000","last_undegraded":"2023-12-12T09:45:23.555970+0000","last_fullsized":"2023-12-12T09:45:23.555970+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_clean_scrub_stamp":"2023-12-12T09:45:22.493994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T20:27:09.962474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-12T09:45:23.516774+0000","last_change":"2023-12-12T09:45:22.540556+0000","last_active":"2023-12-12T09:45:23.516774+0000","last_peered":"2023-12-12T09:45:23.516774+0000","last_clean":"2023-12-12T09:45:23.516774+0000","last_became_active":"2023-12-12T09:45:22.540265+0000","last_became_peered":"2023-12-12T09:45:22.540265+0000","last_unstale":"2023-12-12T09:45:23.516774+0000","last_undegraded":"2023-12-12T09:45:23.516774+0000","last_fullsized":"2023-12-12T09:45:23.516774+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:21.477323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:21.477323+0000","last_clean_scrub_stamp":"2023-12-12T09:45:21.477323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T18:29:34.637693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-12T09:45:23.557885+0000","last_change":"2023-12-12T09:45:23.550480+0000","last_active":"2023-12-12T09:45:23.557885+0000","last_peered":"2023-12-12T09:45:23.557885+0000","last_clean":"2023-12-12T09:45:23.557885+0000","last_became_active":"2023-12-12T09:45:23.549473+0000","last_became_peered":"2023-12-12T09:45:23.549473+0000","last_unstale":"2023-12-12T09:45:23.557885+0000","last_undegraded":"2023-12-12T09:45:23.557885+0000","last_fullsized":"2023-12-12T09:45:23.557885+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_clean_scrub_stamp":"2023-12-12T09:45:22.493994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T16:38:01.059734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-12T09:45:23.517180+0000","last_change":"2023-12-12T09:45:22.540441+0000","last_active":"2023-12-12T09:45:23.517180+0000","last_peered":"2023-12-12T09:45:23.517180+0000","last_clean":"2023-12-12T09:45:23.517180+0000","last_became_active":"2023-12-12T09:45:22.539379+0000","last_became_peered":"2023-12-12T09:45:22.539379+0000","last_unstale":"2023-12-12T09:45:23.517180+0000","last_undegraded":"2023-12-12T09:45:23.517180+0000","last_fullsized":"2023-12-12T09:45:23.517180+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:21.477323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:21.477323+0000","last_clean_scrub_stamp":"2023-12-12T09:45:21.477323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T14:03:02.042556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-12T09:45:23.558851+0000","last_change":"2023-12-12T09:45:23.556070+0000","last_active":"2023-12-12T09:45:23.558851+0000","last_peered":"2023-12-12T09:45:23.558851+0000","last_clean":"2023-12-12T09:45:23.558851+0000","last_became_active":"2023-12-12T09:45:23.554580+0000","last_became_peered":"2023-12-12T09:45:23.554580+0000","last_unstale":"2023-12-12T09:45:23.558851+0000","last_undegraded":"2023-12-12T09:45:23.558851+0000","last_fullsized":"2023-12-12T09:45:23.558851+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_clean_scrub_stamp":"2023-12-12T09:45:22.493994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T10:40:43.209236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.10","version":"53'8","reported_seq":19,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-12T09:45:23.557244+0000","last_change":"2023-12-12T09:45:22.546154+0000","last_active":"2023-12-12T09:45:23.557244+0000","last_peered":"2023-12-12T09:45:23.557244+0000","last_clean":"2023-12-12T09:45:23.557244+0000","last_became_active":"2023-12-12T09:45:22.545903+0000","last_became_peered":"2023-12-12T09:45:22.545903+0000","last_unstale":"2023-12-12T09:45:23.557244+0000","last_undegraded":"2023-12-12T09:45:23.557244+0000","last_fullsized":"2023-12-12T09:45:23.557244+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:21.477323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:21.477323+0000","last_clean_scrub_stamp":"2023-12-12T09:45:21.477323+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T16:38:00.043063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-12T09:45:23.555902+0000","last_change":"2023-12-12T09:45:23.551062+0000","last_active":"2023-12-12T09:45:23.555902+0000","last_peered":"2023-12-12T09:45:23.555902+0000","last_clean":"2023-12-12T09:45:23.555902+0000","last_became_active":"2023-12-12T09:45:23.549387+0000","last_became_peered":"2023-12-12T09:45:23.549387+0000","last_unstale":"2023-12-12T09:45:23.555902+0000","last_undegraded":"2023-12-12T09:45:23.555902+0000","last_fullsized":"2023-12-12T09:45:23.555902+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_clean_scrub_stamp":"2023-12-12T09:45:22.493994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T19:01:50.522909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.f","version":"53'1","reported_seq":12,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-12T09:45:23.546845+0000","last_change":"2023-12-12T09:45:22.532050+0000","last_active":"2023-12-12T09:45:23.546845+0000","last_peered":"2023-12-12T09:45:23.546845+0000","last_clean":"2023-12-12T09:45:23.546845+0000","last_became_active":"2023-12-12T09:45:22.531712+0000","last_became_peered":"2023-12-12T09:45:22.531712+0000","last_unstale":"2023-12-12T09:45:23.546845+0000","last_undegraded":"2023-12-12T09:45:23.546845+0000","last_fullsized":"2023-12-12T09:45:23.546845+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:21.477323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:21.477323+0000","last_clean_scrub_stamp":"2023-12-12T09:45:21.477323+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T12:43:03.230562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-12T09:45:23.537430+0000","last_change":"2023-12-12T09:45:23.531234+0000","last_active":"2023-12-12T09:45:23.537430+0000","last_peered":"2023-12-12T09:45:23.537430+0000","last_clean":"2023-12-12T09:45:23.537430+0000","last_became_active":"2023-12-12T09:45:23.530849+0000","last_became_peered":"2023-12-12T09:45:23.530849+0000","last_unstale":"2023-12-12T09:45:23.537430+0000","last_undegraded":"2023-12-12T09:45:23.537430+0000","last_fullsized":"2023-12-12T09:45:23.537430+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_clean_scrub_stamp":"2023-12-12T09:45:22.493994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T17:58:31.519111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.e","version":"53'2","reported_seq":13,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-12T09:45:23.536329+0000","last_change":"2023-12-12T09:45:22.535653+0000","last_active":"2023-12-12T09:45:23.536329+0000","last_peered":"2023-12-12T09:45:23.536329+0000","last_clean":"2023-12-12T09:45:23.536329+0000","last_became_active":"2023-12-12T09:45:22.534893+0000","last_became_peered":"2023-12-12T09:45:22.534893+0000","last_unstale":"2023-12-12T09:45:23.536329+0000","last_undegraded":"2023-12-12T09:45:23.536329+0000","last_fullsized":"2023-12-12T09:45:23.536329+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:21.477323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:21.477323+0000","last_clean_scrub_stamp":"2023-12-12T09:45:21.477323+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T13:07:07.278574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-12T09:45:23.542070+0000","last_change":"2023-12-12T09:45:23.539711+0000","last_active":"2023-12-12T09:45:23.542070+0000","last_peered":"2023-12-12T09:45:23.542070+0000","last_clean":"2023-12-12T09:45:23.542070+0000","last_became_active":"2023-12-12T09:45:23.539296+0000","last_became_peered":"2023-12-12T09:45:23.539296+0000","last_unstale":"2023-12-12T09:45:23.542070+0000","last_undegraded":"2023-12-12T09:45:23.542070+0000","last_fullsized":"2023-12-12T09:45:23.542070+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_clean_scrub_stamp":"2023-12-12T09:45:22.493994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T12:19:37.793666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"53'1","reported_seq":12,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-12T09:45:23.557284+0000","last_change":"2023-12-12T09:45:22.540703+0000","last_active":"2023-12-12T09:45:23.557284+0000","last_peered":"2023-12-12T09:45:23.557284+0000","last_clean":"2023-12-12T09:45:23.557284+0000","last_became_active":"2023-12-12T09:45:22.540383+0000","last_became_peered":"2023-12-12T09:45:22.540383+0000","last_unstale":"2023-12-12T09:45:23.557284+0000","last_undegraded":"2023-12-12T09:45:23.557284+0000","last_fullsized":"2023-12-12T09:45:23.557284+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:21.477323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:21.477323+0000","last_clean_scrub_stamp":"2023-12-12T09:45:21.477323+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T20:27:08.945803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-12T09:45:23.559296+0000","last_change":"2023-12-12T09:45:23.558032+0000","last_active":"2023-12-12T09:45:23.559296+0000","last_peered":"2023-12-12T09:45:23.559296+0000","last_clean":"2023-12-12T09:45:23.559296+0000","last_became_active":"2023-12-12T09:45:23.557676+0000","last_became_peered":"2023-12-12T09:45:23.557676+0000","last_unstale":"2023-12-12T09:45:23.559296+0000","last_undegraded":"2023-12-12T09:45:23.559296+0000","last_fullsized":"2023-12-12T09:45:23.559296+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_clean_scrub_stamp":"2023-12-12T09:45:22.493994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T15:49:16.147997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-12T09:45:23.520645+0000","last_change":"2023-12-12T09:45:22.533152+0000","last_active":"2023-12-12T09:45:23.520645+0000","last_peered":"2023-12-12T09:45:23.520645+0000","last_clean":"2023-12-12T09:45:23.520645+0000","last_became_active":"2023-12-12T09:45:22.532826+0000","last_became_peered":"2023-12-12T09:45:22.532826+0000","last_unstale":"2023-12-12T09:45:23.520645+0000","last_undegraded":"2023-12-12T09:45:23.520645+0000","last_fullsized":"2023-12-12T09:45:23.520645+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:21.477323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:21.477323+0000","last_clean_scrub_stamp":"2023-12-12T09:45:21.477323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T15:15:37.432050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-12T09:45:23.544249+0000","last_change":"2023-12-12T09:45:23.542634+0000","last_active":"2023-12-12T09:45:23.544249+0000","last_peered":"2023-12-12T09:45:23.544249+0000","last_clean":"2023-12-12T09:45:23.544249+0000","last_became_active":"2023-12-12T09:45:23.542138+0000","last_became_peered":"2023-12-12T09:45:23.542138+0000","last_unstale":"2023-12-12T09:45:23.544249+0000","last_undegraded":"2023-12-12T09:45:23.544249+0000","last_fullsized":"2023-12-12T09:45:23.544249+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_clean_scrub_stamp":"2023-12-12T09:45:22.493994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T15:31:33.286934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.b","version":"53'2","reported_seq":13,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-12T09:45:23.542454+0000","last_change":"2023-12-12T09:45:22.544938+0000","last_active":"2023-12-12T09:45:23.542454+0000","last_peered":"2023-12-12T09:45:23.542454+0000","last_clean":"2023-12-12T09:45:23.542454+0000","last_became_active":"2023-12-12T09:45:22.544532+0000","last_became_peered":"2023-12-12T09:45:22.544532+0000","last_unstale":"2023-12-12T09:45:23.542454+0000","last_undegraded":"2023-12-12T09:45:23.542454+0000","last_fullsized":"2023-12-12T09:45:23.542454+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:21.477323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:21.477323+0000","last_clean_scrub_stamp":"2023-12-12T09:45:21.477323+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T17:50:24.664842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-12T09:45:23.555807+0000","last_change":"2023-12-12T09:45:23.551020+0000","last_active":"2023-12-12T09:45:23.555807+0000","last_peered":"2023-12-12T09:45:23.555807+0000","last_clean":"2023-12-12T09:45:23.555807+0000","last_became_active":"2023-12-12T09:45:23.550753+0000","last_became_peered":"2023-12-12T09:45:23.550753+0000","last_unstale":"2023-12-12T09:45:23.555807+0000","last_undegraded":"2023-12-12T09:45:23.555807+0000","last_fullsized":"2023-12-12T09:45:23.555807+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_clean_scrub_stamp":"2023-12-12T09:45:22.493994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T19:19:48.405194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-12T09:45:23.513839+0000","last_change":"2023-12-12T09:45:22.532615+0000","last_active":"2023-12-12T09:45:23.513839+0000","last_peered":"2023-12-12T09:45:23.513839+0000","last_clean":"2023-12-12T09:45:23.513839+0000","last_became_active":"2023-12-12T09:45:22.530254+0000","last_became_peered":"2023-12-12T09:45:22.530254+0000","last_unstale":"2023-12-12T09:45:23.513839+0000","last_undegraded":"2023-12-12T09:45:23.513839+0000","last_fullsized":"2023-12-12T09:45:23.513839+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:21.477323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:21.477323+0000","last_clean_scrub_stamp":"2023-12-12T09:45:21.477323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T15:07:46.103446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-12T09:45:23.558086+0000","last_change":"2023-12-12T09:45:23.552576+0000","last_active":"2023-12-12T09:45:23.558086+0000","last_peered":"2023-12-12T09:45:23.558086+0000","last_clean":"2023-12-12T09:45:23.558086+0000","last_became_active":"2023-12-12T09:45:23.552159+0000","last_became_peered":"2023-12-12T09:45:23.552159+0000","last_unstale":"2023-12-12T09:45:23.558086+0000","last_undegraded":"2023-12-12T09:45:23.558086+0000","last_fullsized":"2023-12-12T09:45:23.558086+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_clean_scrub_stamp":"2023-12-12T09:45:22.493994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T15:49:16.147997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-12T09:45:23.521947+0000","last_change":"2023-12-12T09:45:22.529781+0000","last_active":"2023-12-12T09:45:23.521947+0000","last_peered":"2023-12-12T09:45:23.521947+0000","last_clean":"2023-12-12T09:45:23.521947+0000","last_became_active":"2023-12-12T09:45:22.529493+0000","last_became_peered":"2023-12-12T09:45:22.529493+0000","last_unstale":"2023-12-12T09:45:23.521947+0000","last_undegraded":"2023-12-12T09:45:23.521947+0000","last_fullsized":"2023-12-12T09:45:23.521947+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:21.477323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:21.477323+0000","last_clean_scrub_stamp":"2023-12-12T09:45:21.477323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T19:01:49.506238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-12T09:45:23.534601+0000","last_change":"2023-12-12T09:45:23.528110+0000","last_active":"2023-12-12T09:45:23.534601+0000","last_peered":"2023-12-12T09:45:23.534601+0000","last_clean":"2023-12-12T09:45:23.534601+0000","last_became_active":"2023-12-12T09:45:23.527594+0000","last_became_peered":"2023-12-12T09:45:23.527594+0000","last_unstale":"2023-12-12T09:45:23.534601+0000","last_undegraded":"2023-12-12T09:45:23.534601+0000","last_fullsized":"2023-12-12T09:45:23.534601+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_clean_scrub_stamp":"2023-12-12T09:45:22.493994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T16:23:30.104791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"53'2","reported_seq":13,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-12T09:45:23.551304+0000","last_change":"2023-12-12T09:45:22.530462+0000","last_active":"2023-12-12T09:45:23.551304+0000","last_peered":"2023-12-12T09:45:23.551304+0000","last_clean":"2023-12-12T09:45:23.551304+0000","last_became_active":"2023-12-12T09:45:22.529388+0000","last_became_peered":"2023-12-12T09:45:22.529388+0000","last_unstale":"2023-12-12T09:45:23.551304+0000","last_undegraded":"2023-12-12T09:45:23.551304+0000","last_fullsized":"2023-12-12T09:45:23.551304+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:21.477323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:21.477323+0000","last_clean_scrub_stamp":"2023-12-12T09:45:21.477323+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T13:28:37.770730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-12T09:45:23.556236+0000","last_change":"2023-12-12T09:45:23.552672+0000","last_active":"2023-12-12T09:45:23.556236+0000","last_peered":"2023-12-12T09:45:23.556236+0000","last_clean":"2023-12-12T09:45:23.556236+0000","last_became_active":"2023-12-12T09:45:23.548550+0000","last_became_peered":"2023-12-12T09:45:23.548550+0000","last_unstale":"2023-12-12T09:45:23.556236+0000","last_undegraded":"2023-12-12T09:45:23.556236+0000","last_fullsized":"2023-12-12T09:45:23.556236+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_clean_scrub_stamp":"2023-12-12T09:45:22.493994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T15:49:16.147997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-12T09:45:23.522519+0000","last_change":"2023-12-12T09:45:22.532022+0000","last_active":"2023-12-12T09:45:23.522519+0000","last_peered":"2023-12-12T09:45:23.522519+0000","last_clean":"2023-12-12T09:45:23.522519+0000","last_became_active":"2023-12-12T09:45:22.530250+0000","last_became_peered":"2023-12-12T09:45:22.530250+0000","last_unstale":"2023-12-12T09:45:23.522519+0000","last_undegraded":"2023-12-12T09:45:23.522519+0000","last_fullsized":"2023-12-12T09:45:23.522519+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:21.477323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:21.477323+0000","last_clean_scrub_stamp":"2023-12-12T09:45:21.477323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T17:31:23.246712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-12T09:45:23.556123+0000","last_change":"2023-12-12T09:45:23.549497+0000","last_active":"2023-12-12T09:45:23.556123+0000","last_peered":"2023-12-12T09:45:23.556123+0000","last_clean":"2023-12-12T09:45:23.556123+0000","last_became_active":"2023-12-12T09:45:23.549188+0000","last_became_peered":"2023-12-12T09:45:23.549188+0000","last_unstale":"2023-12-12T09:45:23.556123+0000","last_undegraded":"2023-12-12T09:45:23.556123+0000","last_fullsized":"2023-12-12T09:45:23.556123+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_clean_scrub_stamp":"2023-12-12T09:45:22.493994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T18:05:50.089314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-12T09:45:23.517613+0000","last_change":"2023-12-12T09:45:22.532250+0000","last_active":"2023-12-12T09:45:23.517613+0000","last_peered":"2023-12-12T09:45:23.517613+0000","last_clean":"2023-12-12T09:45:23.517613+0000","last_became_active":"2023-12-12T09:45:22.531649+0000","last_became_peered":"2023-12-12T09:45:22.531649+0000","last_unstale":"2023-12-12T09:45:23.517613+0000","last_undegraded":"2023-12-12T09:45:23.517613+0000","last_fullsized":"2023-12-12T09:45:23.517613+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:21.477323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:21.477323+0000","last_clean_scrub_stamp":"2023-12-12T09:45:21.477323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T13:38:45.393988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-12T09:45:23.552155+0000","last_change":"2023-12-12T09:45:23.542523+0000","last_active":"2023-12-12T09:45:23.552155+0000","last_peered":"2023-12-12T09:45:23.552155+0000","last_clean":"2023-12-12T09:45:23.552155+0000","last_became_active":"2023-12-12T09:45:23.541977+0000","last_became_peered":"2023-12-12T09:45:23.541977+0000","last_unstale":"2023-12-12T09:45:23.552155+0000","last_undegraded":"2023-12-12T09:45:23.552155+0000","last_fullsized":"2023-12-12T09:45:23.552155+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_clean_scrub_stamp":"2023-12-12T09:45:22.493994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T17:58:31.519111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-12T09:45:23.523604+0000","last_change":"2023-12-12T09:45:22.545221+0000","last_active":"2023-12-12T09:45:23.523604+0000","last_peered":"2023-12-12T09:45:23.523604+0000","last_clean":"2023-12-12T09:45:23.523604+0000","last_became_active":"2023-12-12T09:45:22.544683+0000","last_became_peered":"2023-12-12T09:45:22.544683+0000","last_unstale":"2023-12-12T09:45:23.523604+0000","last_undegraded":"2023-12-12T09:45:23.523604+0000","last_fullsized":"2023-12-12T09:45:23.523604+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:21.477323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:21.477323+0000","last_clean_scrub_stamp":"2023-12-12T09:45:21.477323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T21:23:16.895410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-12T09:45:23.545412+0000","last_change":"2023-12-12T09:45:23.544018+0000","last_active":"2023-12-12T09:45:23.545412+0000","last_peered":"2023-12-12T09:45:23.545412+0000","last_clean":"2023-12-12T09:45:23.545412+0000","last_became_active":"2023-12-12T09:45:23.543769+0000","last_became_peered":"2023-12-12T09:45:23.543769+0000","last_unstale":"2023-12-12T09:45:23.545412+0000","last_undegraded":"2023-12-12T09:45:23.545412+0000","last_fullsized":"2023-12-12T09:45:23.545412+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_clean_scrub_stamp":"2023-12-12T09:45:22.493994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T16:08:55.346248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-12T09:45:23.513808+0000","last_change":"2023-12-12T09:45:22.536839+0000","last_active":"2023-12-12T09:45:23.513808+0000","last_peered":"2023-12-12T09:45:23.513808+0000","last_clean":"2023-12-12T09:45:23.513808+0000","last_became_active":"2023-12-12T09:45:22.536573+0000","last_became_peered":"2023-12-12T09:45:22.536573+0000","last_unstale":"2023-12-12T09:45:23.513808+0000","last_undegraded":"2023-12-12T09:45:23.513808+0000","last_fullsized":"2023-12-12T09:45:23.513808+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:21.477323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:21.477323+0000","last_clean_scrub_stamp":"2023-12-12T09:45:21.477323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T15:17:10.229273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-12T09:45:23.555952+0000","last_change":"2023-12-12T09:45:23.549992+0000","last_active":"2023-12-12T09:45:23.555952+0000","last_peered":"2023-12-12T09:45:23.555952+0000","last_clean":"2023-12-12T09:45:23.555952+0000","last_became_active":"2023-12-12T09:45:23.549317+0000","last_became_peered":"2023-12-12T09:45:23.549317+0000","last_unstale":"2023-12-12T09:45:23.555952+0000","last_undegraded":"2023-12-12T09:45:23.555952+0000","last_fullsized":"2023-12-12T09:45:23.555952+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_clean_scrub_stamp":"2023-12-12T09:45:22.493994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T17:31:24.263383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-12T09:45:23.535707+0000","last_change":"2023-12-12T09:45:22.540030+0000","last_active":"2023-12-12T09:45:23.535707+0000","last_peered":"2023-12-12T09:45:23.535707+0000","last_clean":"2023-12-12T09:45:23.535707+0000","last_became_active":"2023-12-12T09:45:22.539590+0000","last_became_peered":"2023-12-12T09:45:22.539590+0000","last_unstale":"2023-12-12T09:45:23.535707+0000","last_undegraded":"2023-12-12T09:45:23.535707+0000","last_fullsized":"2023-12-12T09:45:23.535707+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:21.477323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:21.477323+0000","last_clean_scrub_stamp":"2023-12-12T09:45:21.477323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T15:15:37.432050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-12T09:45:23.547219+0000","last_change":"2023-12-12T09:45:23.545375+0000","last_active":"2023-12-12T09:45:23.547219+0000","last_peered":"2023-12-12T09:45:23.547219+0000","last_clean":"2023-12-12T09:45:23.547219+0000","last_became_active":"2023-12-12T09:45:23.544964+0000","last_became_peered":"2023-12-12T09:45:23.544964+0000","last_unstale":"2023-12-12T09:45:23.547219+0000","last_undegraded":"2023-12-12T09:45:23.547219+0000","last_fullsized":"2023-12-12T09:45:23.547219+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_clean_scrub_stamp":"2023-12-12T09:45:22.493994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T21:42:01.335580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-12T09:45:23.513241+0000","last_change":"2023-12-12T09:45:22.517716+0000","last_active":"2023-12-12T09:45:23.513241+0000","last_peered":"2023-12-12T09:45:23.513241+0000","last_clean":"2023-12-12T09:45:23.513241+0000","last_became_active":"2023-12-12T09:45:22.517234+0000","last_became_peered":"2023-12-12T09:45:22.517234+0000","last_unstale":"2023-12-12T09:45:23.513241+0000","last_undegraded":"2023-12-12T09:45:23.513241+0000","last_fullsized":"2023-12-12T09:45:23.513241+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:21.477323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:21.477323+0000","last_clean_scrub_stamp":"2023-12-12T09:45:21.477323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T13:38:45.393988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-12T09:45:23.539672+0000","last_change":"2023-12-12T09:45:23.538139+0000","last_active":"2023-12-12T09:45:23.539672+0000","last_peered":"2023-12-12T09:45:23.539672+0000","last_clean":"2023-12-12T09:45:23.539672+0000","last_became_active":"2023-12-12T09:45:23.537879+0000","last_became_peered":"2023-12-12T09:45:23.537879+0000","last_unstale":"2023-12-12T09:45:23.539672+0000","last_undegraded":"2023-12-12T09:45:23.539672+0000","last_fullsized":"2023-12-12T09:45:23.539672+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_clean_scrub_stamp":"2023-12-12T09:45:22.493994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T13:07:08.295245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-12T09:45:23.530997+0000","last_change":"2023-12-12T09:45:22.533709+0000","last_active":"2023-12-12T09:45:23.530997+0000","last_peered":"2023-12-12T09:45:23.530997+0000","last_clean":"2023-12-12T09:45:23.530997+0000","last_became_active":"2023-12-12T09:45:22.533228+0000","last_became_peered":"2023-12-12T09:45:22.533228+0000","last_unstale":"2023-12-12T09:45:23.530997+0000","last_undegraded":"2023-12-12T09:45:23.530997+0000","last_fullsized":"2023-12-12T09:45:23.530997+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:21.477323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:21.477323+0000","last_clean_scrub_stamp":"2023-12-12T09:45:21.477323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T14:11:53.124266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-12T09:45:23.554144+0000","last_change":"2023-12-12T09:45:23.551562+0000","last_active":"2023-12-12T09:45:23.554144+0000","last_peered":"2023-12-12T09:45:23.554144+0000","last_clean":"2023-12-12T09:45:23.554144+0000","last_became_active":"2023-12-12T09:45:23.551292+0000","last_became_peered":"2023-12-12T09:45:23.551292+0000","last_unstale":"2023-12-12T09:45:23.554144+0000","last_undegraded":"2023-12-12T09:45:23.554144+0000","last_fullsized":"2023-12-12T09:45:23.554144+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_clean_scrub_stamp":"2023-12-12T09:45:22.493994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T16:46:32.423265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-12T09:45:23.518470+0000","last_change":"2023-12-12T09:45:22.537353+0000","last_active":"2023-12-12T09:45:23.518470+0000","last_peered":"2023-12-12T09:45:23.518470+0000","last_clean":"2023-12-12T09:45:23.518470+0000","last_became_active":"2023-12-12T09:45:22.536855+0000","last_became_peered":"2023-12-12T09:45:22.536855+0000","last_unstale":"2023-12-12T09:45:23.518470+0000","last_undegraded":"2023-12-12T09:45:23.518470+0000","last_fullsized":"2023-12-12T09:45:23.518470+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:21.477323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:21.477323+0000","last_clean_scrub_stamp":"2023-12-12T09:45:21.477323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T15:17:10.229273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":193,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-12T09:45:22.540331+0000","last_change":"2023-12-12T09:43:17.203315+0000","last_active":"2023-12-12T09:45:22.540331+0000","last_peered":"2023-12-12T09:45:22.540331+0000","last_clean":"2023-12-12T09:45:22.540331+0000","last_became_active":"2023-12-12T09:43:17.200779+0000","last_became_peered":"2023-12-12T09:43:17.200779+0000","last_unstale":"2023-12-12T09:45:22.540331+0000","last_undegraded":"2023-12-12T09:45:22.540331+0000","last_fullsized":"2023-12-12T09:45:22.540331+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:43:15.931922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:43:15.931922+0000","last_clean_scrub_stamp":"2023-12-12T09:43:15.931922+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T21:42:10.929640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":64844,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574878,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27720,"kb_used_data":692,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344120,"statfs":{"total":96636764160,"available":96608378880,"internally_reserved":0,"allocated":708608,"data_stored":859754,"data_compressed":32422,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 12 09:45:16 2023","interfaces":[{"interface":"back","average":{"1min":1.0700000000000001,"5min":1.0129999999999999,"15min":1.0029999999999999},"min":{"1min":0.64800000000000002,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.607,"5min":1.8089999999999999,"15min":1.8089999999999999},"last":0.99399999999999999},{"interface":"front","average":{"1min":1.135,"5min":0.99399999999999999,"15min":0.96999999999999997},"min":{"1min":0.72099999999999997,"5min":0.66300000000000003,"15min":0.66300000000000003},"max":{"1min":1.619,"5min":1.619,"15min":1.619},"last":1.5980000000000001}]},{"osd":1,"last update":"Tue Dec 12 09:45:16 2023","interfaces":[{"interface":"back","average":{"1min":1.149,"5min":1.1879999999999999,"15min":1.194},"min":{"1min":0.83799999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"max":{"1min":1.5629999999999999,"5min":1.7729999999999999,"15min":1.7729999999999999},"last":1.4610000000000001},{"interface":"front","average":{"1min":1.1419999999999999,"5min":1.2010000000000001,"15min":1.2110000000000001},"min":{"1min":0.77000000000000002,"5min":0.71499999999999997,"15min":0.71499999999999997},"max":{"1min":1.542,"5min":3.1150000000000002,"15min":3.1150000000000002},"last":1.1619999999999999}]},{"osd":2,"last update":"Tue Dec 12 09:45:16 2023","interfaces":[{"interface":"back","average":{"1min":1.1379999999999999,"5min":1.2370000000000001,"15min":1.2529999999999999},"min":{"1min":0.80100000000000005,"5min":0.77700000000000002,"15min":0.77700000000000002},"max":{"1min":1.5449999999999999,"5min":2.2050000000000001,"15min":2.2050000000000001},"last":1.3720000000000001},{"interface":"front","average":{"1min":1.141,"5min":1.224,"15min":1.238},"min":{"1min":0.81399999999999995,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.4890000000000001,"5min":3.2759999999999998,"15min":3.2759999999999998},"last":1.2090000000000001}]},{"osd":3,"last update":"Tue Dec 12 09:45:16 2023","interfaces":[{"interface":"back","average":{"1min":1.1930000000000001,"5min":1.292,"15min":1.3080000000000001},"min":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"max":{"1min":1.587,"5min":3.1819999999999999,"15min":3.1819999999999999},"last":1.117},{"interface":"front","average":{"1min":1.2210000000000001,"5min":1.28,"15min":1.29},"min":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"max":{"1min":1.587,"5min":1.8740000000000001,"15min":1.8740000000000001},"last":1.3049999999999999}]},{"osd":4,"last update":"Tue Dec 12 09:45:16 2023","interfaces":[{"interface":"back","average":{"1min":1.2450000000000001,"5min":1.3300000000000001,"15min":1.3440000000000001},"min":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.647,"5min":2.5529999999999999,"15min":2.5529999999999999},"last":1.4079999999999999},{"interface":"front","average":{"1min":1.2290000000000001,"5min":1.409,"15min":1.4390000000000001},"min":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"max":{"1min":1.6319999999999999,"5min":2.351,"15min":2.351},"last":1.258}]},{"osd":5,"last update":"Tue Dec 12 09:45:16 2023","interfaces":[{"interface":"back","average":{"1min":1.294,"5min":1.3260000000000001,"15min":1.3320000000000001},"min":{"1min":1.0649999999999999,"5min":0.84499999999999997,"15min":0.84499999999999997},"max":{"1min":1.575,"5min":1.9610000000000001,"15min":1.9610000000000001},"last":0.93300000000000005},{"interface":"front","average":{"1min":1.389,"5min":1.5069999999999999,"15min":1.5269999999999999},"min":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":1.6950000000000001,"5min":2.4159999999999999,"15min":2.4159999999999999},"last":1.514}]},{"osd":6,"last update":"Tue Dec 12 09:45:16 2023","interfaces":[{"interface":"back","average":{"1min":1.427,"5min":1.419,"15min":1.417},"min":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"max":{"1min":1.821,"5min":2.0510000000000002,"15min":2.0510000000000002},"last":1.0409999999999999},{"interface":"front","average":{"1min":1.4850000000000001,"5min":1.605,"15min":1.625},"min":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"max":{"1min":1.821,"5min":2.5800000000000001,"15min":2.5800000000000001},"last":1.571}]}]},{"osd":6,"up_from":13,"seq":55834574876,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27644,"kb_used_data":620,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344196,"statfs":{"total":96636764160,"available":96608456704,"internally_reserved":0,"allocated":634880,"data_stored":269226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 12 09:45:15 2023","interfaces":[{"interface":"back","average":{"1min":0.96799999999999997,"5min":1.1479999999999999,"15min":1.1779999999999999},"min":{"1min":0.63200000000000001,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":1.597,"5min":3.6429999999999998,"15min":3.6429999999999998},"last":1.0820000000000001},{"interface":"front","average":{"1min":1.119,"5min":1.079,"15min":1.073},"min":{"1min":0.58499999999999996,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.871,"5min":2.6059999999999999,"15min":2.6059999999999999},"last":0.60099999999999998}]},{"osd":1,"last update":"Tue Dec 12 09:45:15 2023","interfaces":[{"interface":"back","average":{"1min":1.1639999999999999,"5min":1.0820000000000001,"15min":1.0680000000000001},"min":{"1min":0.80400000000000005,"5min":0.69499999999999995,"15min":0.69499999999999995},"max":{"1min":1.482,"5min":2.0169999999999999,"15min":2.0169999999999999},"last":0.69199999999999995},{"interface":"front","average":{"1min":1.1719999999999999,"5min":1.1950000000000001,"15min":1.1990000000000001},"min":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"max":{"1min":1.5700000000000001,"5min":1.7,"15min":1.7},"last":0.93700000000000006}]},{"osd":2,"last update":"Tue Dec 12 09:45:15 2023","interfaces":[{"interface":"back","average":{"1min":1.149,"5min":1.218,"15min":1.23},"min":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"max":{"1min":1.72,"5min":1.804,"15min":1.804},"last":1.2809999999999999},{"interface":"front","average":{"1min":1.1479999999999999,"5min":1.28,"15min":1.302},"min":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"max":{"1min":1.5840000000000001,"5min":2.2160000000000002,"15min":2.2160000000000002},"last":0.98399999999999999}]},{"osd":3,"last update":"Tue Dec 12 09:45:15 2023","interfaces":[{"interface":"back","average":{"1min":1.2090000000000001,"5min":1.216,"15min":1.2170000000000001},"min":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"max":{"1min":1.661,"5min":2.665,"15min":2.665},"last":1.1799999999999999},{"interface":"front","average":{"1min":1.111,"5min":1.2070000000000001,"15min":1.2230000000000001},"min":{"1min":0.72899999999999998,"5min":0.65700000000000003,"15min":0.65700000000000003},"max":{"1min":1.569,"5min":1.8620000000000001,"15min":1.8620000000000001},"last":0.82399999999999995}]},{"osd":4,"last update":"Tue Dec 12 09:45:15 2023","interfaces":[{"interface":"back","average":{"1min":1.276,"5min":1.2749999999999999,"15min":1.2749999999999999},"min":{"1min":0.66100000000000003,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":1.778,"5min":2.0310000000000001,"15min":2.0310000000000001},"last":1.415},{"interface":"front","average":{"1min":1.3939999999999999,"5min":1.4039999999999999,"15min":1.4059999999999999},"min":{"1min":0.753,"5min":0.66200000000000003,"15min":0.66200000000000003},"max":{"1min":1.8149999999999999,"5min":2.2799999999999998,"15min":2.2799999999999998},"last":1.373}]},{"osd":5,"last update":"Tue Dec 12 09:45:15 2023","interfaces":[{"interface":"back","average":{"1min":1.296,"5min":1.4119999999999999,"15min":1.431},"min":{"1min":0.68600000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.766,"5min":2.1739999999999999,"15min":2.1739999999999999},"last":1.133},{"interface":"front","average":{"1min":1.4730000000000001,"5min":1.476,"15min":1.476},"min":{"1min":0.99399999999999999,"5min":0.80100000000000005,"15min":0.80100000000000005},"max":{"1min":1.909,"5min":1.929,"15min":1.929},"last":1.524}]},{"osd":7,"last update":"Tue Dec 12 09:45:15 2023","interfaces":[{"interface":"back","average":{"1min":1.4059999999999999,"5min":1.488,"15min":1.502},"min":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.6859999999999999,"5min":1.994,"15min":1.994},"last":1.46},{"interface":"front","average":{"1min":1.3779999999999999,"5min":1.506,"15min":1.528},"min":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"max":{"1min":1.839,"5min":2.0800000000000001,"15min":2.0800000000000001},"last":1.0389999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574876,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27652,"kb_used_data":628,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344188,"statfs":{"total":96636764160,"available":96608448512,"internally_reserved":0,"allocated":643072,"data_stored":269878,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 12 09:45:16 2023","interfaces":[{"interface":"back","average":{"1min":1.022,"5min":1.02,"15min":1.02},"min":{"1min":0.65600000000000003,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.7310000000000001,"5min":1.7310000000000001,"15min":1.7310000000000001},"last":0.81799999999999995},{"interface":"front","average":{"1min":1.04,"5min":1.1120000000000001,"15min":1.1240000000000001},"min":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.595,"5min":1.595,"15min":1.595},"last":0.75800000000000001}]},{"osd":1,"last update":"Tue Dec 12 09:45:16 2023","interfaces":[{"interface":"back","average":{"1min":1,"5min":1.1799999999999999,"15min":1.21},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.756,"5min":1.756,"15min":1.756},"last":0.999},{"interface":"front","average":{"1min":1.071,"5min":1.087,"15min":1.0900000000000001},"min":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"max":{"1min":1.5549999999999999,"5min":1.5840000000000001,"15min":1.5840000000000001},"last":1.0429999999999999}]},{"osd":2,"last update":"Tue Dec 12 09:45:16 2023","interfaces":[{"interface":"back","average":{"1min":1.1619999999999999,"5min":1.286,"15min":1.306},"min":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"max":{"1min":1.536,"5min":1.7889999999999999,"15min":1.7889999999999999},"last":1.5509999999999999},{"interface":"front","average":{"1min":1.157,"5min":1.3680000000000001,"15min":1.403},"min":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"max":{"1min":1.5369999999999999,"5min":2.1600000000000001,"15min":2.1600000000000001},"last":0.90000000000000002}]},{"osd":3,"last update":"Tue Dec 12 09:45:16 2023","interfaces":[{"interface":"back","average":{"1min":1.202,"5min":1.337,"15min":1.359},"min":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"max":{"1min":1.6950000000000001,"5min":2.1499999999999999,"15min":2.1499999999999999},"last":1.2889999999999999},{"interface":"front","average":{"1min":1.2390000000000001,"5min":1.4410000000000001,"15min":1.4750000000000001},"min":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"max":{"1min":1.6060000000000001,"5min":1.8939999999999999,"15min":1.8939999999999999},"last":1.679}]},{"osd":4,"last update":"Tue Dec 12 09:45:16 2023","interfaces":[{"interface":"back","average":{"1min":1.3100000000000001,"5min":1.454,"15min":1.478},"min":{"1min":0.746,"5min":0.746,"15min":0.746},"max":{"1min":1.841,"5min":2.391,"15min":2.391},"last":1.6479999999999999},{"interface":"front","average":{"1min":1.4470000000000001,"5min":1.5589999999999999,"15min":1.5780000000000001},"min":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"max":{"1min":1.958,"5min":2.5430000000000001,"15min":2.5430000000000001},"last":1.8520000000000001}]},{"osd":6,"last update":"Tue Dec 12 09:45:16 2023","interfaces":[{"interface":"back","average":{"1min":1.3320000000000001,"5min":1.5429999999999999,"15min":1.5780000000000001},"min":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.7230000000000001,"5min":2.0840000000000001,"15min":2.0840000000000001},"last":1.782},{"interface":"front","average":{"1min":1.373,"5min":1.579,"15min":1.613},"min":{"1min":0.627,"5min":0.627,"15min":0.627},"max":{"1min":1.9970000000000001,"5min":2.306,"15min":2.306},"last":1.1850000000000001}]},{"osd":7,"last update":"Tue Dec 12 09:45:16 2023","interfaces":[{"interface":"back","average":{"1min":1.538,"5min":1.7350000000000001,"15min":1.768},"min":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"max":{"1min":2.2469999999999999,"5min":2.6880000000000002,"15min":2.6880000000000002},"last":1.996},{"interface":"front","average":{"1min":1.4550000000000001,"5min":1.6890000000000001,"15min":1.728},"min":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"max":{"1min":1.8260000000000001,"5min":2.3410000000000002,"15min":2.3410000000000002},"last":1.956}]}]},{"osd":4,"up_from":13,"seq":55834574878,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27660,"kb_used_data":632,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344180,"statfs":{"total":96636764160,"available":96608440320,"internally_reserved":0,"allocated":647168,"data_stored":270838,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 12 09:45:15 2023","interfaces":[{"interface":"back","average":{"1min":1.0129999999999999,"5min":1.046,"15min":1.052},"min":{"1min":0.65100000000000002,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":1.7010000000000001,"5min":1.7010000000000001,"15min":1.7010000000000001},"last":1.417},{"interface":"front","average":{"1min":0.98899999999999999,"5min":1.0409999999999999,"15min":1.05},"min":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":1.3080000000000001,"5min":1.492,"15min":1.492},"last":1.3700000000000001}]},{"osd":1,"last update":"Tue Dec 12 09:45:15 2023","interfaces":[{"interface":"back","average":{"1min":1.0580000000000001,"5min":1.046,"15min":1.044},"min":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":1.468,"5min":1.468,"15min":1.468},"last":1.496},{"interface":"front","average":{"1min":1.143,"5min":1.173,"15min":1.1779999999999999},"min":{"1min":0.76600000000000001,"5min":0.73699999999999999,"15min":0.73699999999999999},"max":{"1min":1.599,"5min":1.8720000000000001,"15min":1.8720000000000001},"last":1.526}]},{"osd":2,"last update":"Tue Dec 12 09:45:15 2023","interfaces":[{"interface":"back","average":{"1min":1.145,"5min":1.1240000000000001,"15min":1.1200000000000001},"min":{"1min":0.82699999999999996,"5min":0.71499999999999997,"15min":0.71499999999999997},"max":{"1min":1.4590000000000001,"5min":1.4590000000000001,"15min":1.4590000000000001},"last":1.0780000000000001},{"interface":"front","average":{"1min":1.238,"5min":1.282,"15min":1.29},"min":{"1min":0.76400000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"max":{"1min":1.675,"5min":2.1640000000000001,"15min":2.1640000000000001},"last":1.1379999999999999}]},{"osd":3,"last update":"Tue Dec 12 09:45:15 2023","interfaces":[{"interface":"back","average":{"1min":1.2569999999999999,"5min":1.2130000000000001,"15min":1.206},"min":{"1min":0.89700000000000002,"5min":0.83399999999999996,"15min":0.83399999999999996},"max":{"1min":1.52,"5min":1.635,"15min":1.635},"last":1.4530000000000001},{"interface":"front","average":{"1min":1.222,"5min":1.234,"15min":1.236},"min":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"max":{"1min":1.7290000000000001,"5min":2.0499999999999998,"15min":2.0499999999999998},"last":1.2130000000000001}]},{"osd":5,"last update":"Tue Dec 12 09:45:15 2023","interfaces":[{"interface":"back","average":{"1min":1.272,"5min":1.4279999999999999,"15min":1.454},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.794,"5min":2.3159999999999998,"15min":2.3159999999999998},"last":1.323},{"interface":"front","average":{"1min":1.361,"5min":1.3520000000000001,"15min":1.3500000000000001},"min":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"max":{"1min":1.978,"5min":2.117,"15min":2.117},"last":1.268}]},{"osd":6,"last update":"Tue Dec 12 09:45:15 2023","interfaces":[{"interface":"back","average":{"1min":1.3180000000000001,"5min":1.3859999999999999,"15min":1.397},"min":{"1min":0.84999999999999998,"5min":0.81200000000000006,"15min":0.81200000000000006},"max":{"1min":1.927,"5min":2.246,"15min":2.246},"last":0.98099999999999998},{"interface":"front","average":{"1min":1.4610000000000001,"5min":1.5309999999999999,"15min":1.5429999999999999},"min":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"max":{"1min":1.917,"5min":2.5099999999999998,"15min":2.5099999999999998},"last":1.6000000000000001}]},{"osd":7,"last update":"Tue Dec 12 09:45:15 2023","interfaces":[{"interface":"back","average":{"1min":1.4630000000000001,"5min":1.496,"15min":1.502},"min":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"max":{"1min":1.9830000000000001,"5min":2.5710000000000002,"15min":2.5710000000000002},"last":1.5609999999999999},{"interface":"front","average":{"1min":1.508,"5min":1.512,"15min":1.512},"min":{"1min":1.0900000000000001,"5min":1.0600000000000001,"15min":1.0600000000000001},"max":{"1min":2.1600000000000001,"5min":2.3919999999999999,"15min":2.3919999999999999},"last":1.389}]}]},{"osd":3,"up_from":13,"seq":55834574876,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27652,"kb_used_data":628,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344188,"statfs":{"total":96636764160,"available":96608448512,"internally_reserved":0,"allocated":643072,"data_stored":269282,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 12 09:45:17 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.873,"15min":0.89900000000000002},"min":{"1min":0.318,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":1.1930000000000001,"5min":1.4830000000000001,"15min":1.4830000000000001},"last":1.2350000000000001},{"interface":"front","average":{"1min":0.71699999999999997,"5min":1.0529999999999999,"15min":1.109},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":1.2370000000000001,"5min":3.3370000000000002,"15min":3.3370000000000002},"last":0.83899999999999997}]},{"osd":1,"last update":"Tue Dec 12 09:45:17 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.88200000000000001,"15min":0.90700000000000003},"min":{"1min":0.48799999999999999,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":1.077,"5min":1.4610000000000001,"15min":1.4610000000000001},"last":1.0249999999999999},{"interface":"front","average":{"1min":0.84099999999999997,"5min":1.0229999999999999,"15min":1.0529999999999999},"min":{"1min":0.52700000000000002,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.6100000000000001,"5min":2.9409999999999998,"15min":2.9409999999999998},"last":1.4750000000000001}]},{"osd":2,"last update":"Tue Dec 12 09:45:17 2023","interfaces":[{"interface":"back","average":{"1min":0.874,"5min":1.1240000000000001,"15min":1.1659999999999999},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.5680000000000001,"5min":2.613,"15min":2.613},"last":0.89600000000000002},{"interface":"front","average":{"1min":0.89800000000000002,"5min":1.127,"15min":1.165},"min":{"1min":0.47199999999999998,"5min":0.437,"15min":0.437},"max":{"1min":1.4390000000000001,"5min":3.0430000000000001,"15min":3.0430000000000001},"last":1.411}]},{"osd":4,"last update":"Tue Dec 12 09:45:17 2023","interfaces":[{"interface":"back","average":{"1min":1.2190000000000001,"5min":1.3500000000000001,"15min":1.3720000000000001},"min":{"1min":0.73399999999999999,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.851,"5min":3.5019999999999998,"15min":3.5019999999999998},"last":0.95899999999999996},{"interface":"front","average":{"1min":1.1439999999999999,"5min":1.415,"15min":1.46},"min":{"1min":0.755,"5min":0.755,"15min":0.755},"max":{"1min":1.593,"5min":2.9889999999999999,"15min":2.9889999999999999},"last":1.103}]},{"osd":5,"last update":"Tue Dec 12 09:45:17 2023","interfaces":[{"interface":"back","average":{"1min":1.254,"5min":1.45,"15min":1.4830000000000001},"min":{"1min":0.73599999999999999,"5min":0.68000000000000005,"15min":0.68000000000000005},"max":{"1min":1.589,"5min":4.2480000000000002,"15min":4.2480000000000002},"last":1.585},{"interface":"front","average":{"1min":1.2090000000000001,"5min":1.5149999999999999,"15min":1.5660000000000001},"min":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"max":{"1min":1.7,"5min":5.5060000000000002,"15min":5.5060000000000002},"last":1.05}]},{"osd":6,"last update":"Tue Dec 12 09:45:17 2023","interfaces":[{"interface":"back","average":{"1min":1.1240000000000001,"5min":1.391,"15min":1.4350000000000001},"min":{"1min":0.79100000000000004,"5min":0.76500000000000001,"15min":0.76500000000000001},"max":{"1min":1.472,"5min":3.1400000000000001,"15min":3.1400000000000001},"last":1.3460000000000001},{"interface":"front","average":{"1min":1.288,"5min":1.4950000000000001,"15min":1.5289999999999999},"min":{"1min":0.70099999999999996,"5min":0.627,"15min":0.627},"max":{"1min":1.694,"5min":4.3179999999999996,"15min":4.3179999999999996},"last":1.5309999999999999}]},{"osd":7,"last update":"Tue Dec 12 09:45:17 2023","interfaces":[{"interface":"back","average":{"1min":1.236,"5min":1.52,"15min":1.5680000000000001},"min":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"max":{"1min":1.6759999999999999,"5min":5.3979999999999997,"15min":5.3979999999999997},"last":1.3009999999999999},{"interface":"front","average":{"1min":1.228,"5min":1.488,"15min":1.532},"min":{"1min":0.75800000000000001,"5min":0.74299999999999999,"15min":0.74299999999999999},"max":{"1min":1.663,"5min":3.4129999999999998,"15min":3.4129999999999998},"last":1.446}]}]},{"osd":2,"up_from":13,"seq":55834574876,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27652,"kb_used_data":628,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344188,"statfs":{"total":96636764160,"available":96608448512,"internally_reserved":0,"allocated":643072,"data_stored":269282,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 12 09:45:16 2023","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.81000000000000005,"15min":0.81599999999999995},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":1.212,"5min":1.458,"15min":1.458},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.84899999999999998,"5min":0.90000000000000002,"15min":0.90800000000000003},"min":{"1min":0.36199999999999999,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":1.623,"5min":1.623,"15min":1.623},"last":1.0509999999999999}]},{"osd":1,"last update":"Tue Dec 12 09:45:16 2023","interfaces":[{"interface":"back","average":{"1min":0.82999999999999996,"5min":0.85699999999999998,"15min":0.86099999999999999},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":1.375,"5min":1.593,"15min":1.593},"last":0.752},{"interface":"front","average":{"1min":0.84099999999999997,"5min":0.877,"15min":0.88300000000000001},"min":{"1min":0.46999999999999997,"5min":0.443,"15min":0.443},"max":{"1min":1.4330000000000001,"5min":1.758,"15min":1.758},"last":0.78500000000000003}]},{"osd":3,"last update":"Tue Dec 12 09:45:16 2023","interfaces":[{"interface":"back","average":{"1min":0.93999999999999995,"5min":1.0329999999999999,"15min":1.0489999999999999},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.343,"5min":1.8879999999999999,"15min":1.8879999999999999},"last":1.276},{"interface":"front","average":{"1min":0.86599999999999999,"5min":0.97999999999999998,"15min":0.999},"min":{"1min":0.46000000000000002,"5min":0.432,"15min":0.432},"max":{"1min":1.4419999999999999,"5min":1.8120000000000001,"15min":1.8120000000000001},"last":0.93300000000000005}]},{"osd":4,"last update":"Tue Dec 12 09:45:16 2023","interfaces":[{"interface":"back","average":{"1min":1.141,"5min":1.2090000000000001,"15min":1.2210000000000001},"min":{"1min":0.69599999999999995,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.3859999999999999,"5min":2.5760000000000001,"15min":2.5760000000000001},"last":0.97699999999999998},{"interface":"front","average":{"1min":1.1870000000000001,"5min":1.3520000000000001,"15min":1.3799999999999999},"min":{"1min":0.79400000000000004,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":2.04,"5min":2.8069999999999999,"15min":2.8069999999999999},"last":1.153}]},{"osd":5,"last update":"Tue Dec 12 09:45:16 2023","interfaces":[{"interface":"back","average":{"1min":1.3260000000000001,"5min":1.3680000000000001,"15min":1.375},"min":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"max":{"1min":1.764,"5min":2.3109999999999999,"15min":2.3109999999999999},"last":1.194},{"interface":"front","average":{"1min":1.196,"5min":1.3200000000000001,"15min":1.3400000000000001},"min":{"1min":0.79400000000000004,"5min":0.627,"15min":0.627},"max":{"1min":1.546,"5min":2.5110000000000001,"15min":2.5110000000000001},"last":0.88700000000000001}]},{"osd":6,"last update":"Tue Dec 12 09:45:16 2023","interfaces":[{"interface":"back","average":{"1min":1.329,"5min":1.415,"15min":1.429},"min":{"1min":0.82499999999999996,"5min":0.69599999999999995,"15min":0.69599999999999995},"max":{"1min":2.6139999999999999,"5min":2.907,"15min":2.907},"last":1.3779999999999999},{"interface":"front","average":{"1min":1.403,"5min":1.423,"15min":1.427},"min":{"1min":0.85099999999999998,"5min":0.82799999999999996,"15min":0.82799999999999996},"max":{"1min":2.6000000000000001,"5min":2.6000000000000001,"15min":2.6000000000000001},"last":1.339}]},{"osd":7,"last update":"Tue Dec 12 09:45:16 2023","interfaces":[{"interface":"back","average":{"1min":1.3049999999999999,"5min":1.4259999999999999,"15min":1.446},"min":{"1min":0.78500000000000003,"5min":0.71599999999999997,"15min":0.71599999999999997},"max":{"1min":2.1339999999999999,"5min":2.3370000000000002,"15min":2.3370000000000002},"last":1.4790000000000001},{"interface":"front","average":{"1min":1.4159999999999999,"5min":1.4930000000000001,"15min":1.506},"min":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"max":{"1min":1.915,"5min":2.488,"15min":2.488},"last":1.3959999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574876,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27644,"kb_used_data":620,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344196,"statfs":{"total":96636764160,"available":96608456704,"internally_reserved":0,"allocated":634880,"data_stored":269226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 12 09:45:16 2023","interfaces":[{"interface":"back","average":{"1min":0.79400000000000004,"5min":0.84299999999999997,"15min":0.85099999999999998},"min":{"1min":0.50800000000000001,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":1.319,"5min":2.794,"15min":2.794},"last":0.99199999999999999},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.84999999999999998,"15min":0.85999999999999999},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":1.167,"5min":2.1379999999999999,"15min":2.1379999999999999},"last":0.91800000000000004}]},{"osd":2,"last update":"Tue Dec 12 09:45:16 2023","interfaces":[{"interface":"back","average":{"1min":0.89200000000000002,"5min":0.96699999999999997,"15min":0.97899999999999998},"min":{"1min":0.437,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":1.5649999999999999,"5min":6.3390000000000004,"15min":6.3390000000000004},"last":0.85799999999999998},{"interface":"front","average":{"1min":0.94299999999999995,"5min":0.96199999999999997,"15min":0.96499999999999997},"min":{"1min":0.53200000000000003,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.5629999999999999,"5min":2.823,"15min":2.823},"last":1.1559999999999999}]},{"osd":3,"last update":"Tue Dec 12 09:45:16 2023","interfaces":[{"interface":"back","average":{"1min":1.0620000000000001,"5min":1.0529999999999999,"15min":1.0509999999999999},"min":{"1min":0.56699999999999995,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":1.6519999999999999,"5min":2.7519999999999998,"15min":2.7519999999999998},"last":1.248},{"interface":"front","average":{"1min":1.018,"5min":1.01,"15min":1.008},"min":{"1min":0.55600000000000005,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":1.8640000000000001,"5min":2.2559999999999998,"15min":2.2559999999999998},"last":1.2050000000000001}]},{"osd":4,"last update":"Tue Dec 12 09:45:16 2023","interfaces":[{"interface":"back","average":{"1min":1.1100000000000001,"5min":1.341,"15min":1.379},"min":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"max":{"1min":1.694,"5min":6.423,"15min":6.423},"last":1.286},{"interface":"front","average":{"1min":1.1899999999999999,"5min":1.1930000000000001,"15min":1.1930000000000001},"min":{"1min":0.80500000000000005,"5min":0.80000000000000004,"15min":0.80000000000000004},"max":{"1min":1.585,"5min":2.2309999999999999,"15min":2.2309999999999999},"last":1.331}]},{"osd":5,"last update":"Tue Dec 12 09:45:16 2023","interfaces":[{"interface":"back","average":{"1min":1.22,"5min":1.417,"15min":1.45},"min":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"max":{"1min":1.8220000000000001,"5min":6.2830000000000004,"15min":6.2830000000000004},"last":1.4970000000000001},{"interface":"front","average":{"1min":1.2729999999999999,"5min":1.3540000000000001,"15min":1.3680000000000001},"min":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"max":{"1min":1.7609999999999999,"5min":2.73,"15min":2.73},"last":1.425}]},{"osd":6,"last update":"Tue Dec 12 09:45:16 2023","interfaces":[{"interface":"back","average":{"1min":1.3180000000000001,"5min":1.5109999999999999,"15min":1.5429999999999999},"min":{"1min":0.751,"5min":0.751,"15min":0.751},"max":{"1min":2.1589999999999998,"5min":6.468,"15min":6.468},"last":1.7210000000000001},{"interface":"front","average":{"1min":1.2529999999999999,"5min":1.514,"15min":1.5580000000000001},"min":{"1min":0.85899999999999999,"5min":0.84699999999999998,"15min":0.84699999999999998},"max":{"1min":1.7949999999999999,"5min":6.3129999999999997,"15min":6.3129999999999997},"last":1.585}]},{"osd":7,"last update":"Tue Dec 12 09:45:16 2023","interfaces":[{"interface":"back","average":{"1min":1.333,"5min":1.3919999999999999,"15min":1.4019999999999999},"min":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"max":{"1min":1.9399999999999999,"5min":2.9009999999999998,"15min":2.9009999999999998},"last":1.534},{"interface":"front","average":{"1min":1.345,"5min":1.5129999999999999,"15min":1.5409999999999999},"min":{"1min":0.83999999999999997,"5min":0.752,"15min":0.752},"max":{"1min":1.996,"5min":6.242,"15min":6.242},"last":1.6379999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574878,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27724,"kb_used_data":700,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344116,"statfs":{"total":96636764160,"available":96608374784,"internally_reserved":0,"allocated":716800,"data_stored":861788,"data_compressed":32422,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Dec 12 09:45:18 2023","interfaces":[{"interface":"back","average":{"1min":0.81699999999999995,"5min":0.78000000000000003,"15min":0.77400000000000002},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":1.639,"5min":1.639,"15min":1.639},"last":0.92200000000000004},{"interface":"front","average":{"1min":0.91800000000000004,"5min":0.83699999999999997,"15min":0.82299999999999995},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":1.5680000000000001,"5min":1.5680000000000001,"15min":1.5680000000000001},"last":0.68799999999999994}]},{"osd":2,"last update":"Tue Dec 12 09:45:18 2023","interfaces":[{"interface":"back","average":{"1min":0.95099999999999996,"5min":0.879,"15min":0.86699999999999999},"min":{"1min":0.34300000000000003,"5min":0.316,"15min":0.316},"max":{"1min":1.748,"5min":1.748,"15min":1.748},"last":1.3260000000000001},{"interface":"front","average":{"1min":1.0469999999999999,"5min":1.0049999999999999,"15min":0.998},"min":{"1min":0.53600000000000003,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":1.6080000000000001,"5min":1.649,"15min":1.649},"last":0.54400000000000004}]},{"osd":3,"last update":"Tue Dec 12 09:45:18 2023","interfaces":[{"interface":"back","average":{"1min":0.81499999999999995,"5min":0.84499999999999997,"15min":0.84999999999999998},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":1.2529999999999999,"5min":1.4990000000000001,"15min":1.4990000000000001},"last":1.0089999999999999},{"interface":"front","average":{"1min":1.0509999999999999,"5min":1.0129999999999999,"15min":1.0069999999999999},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":1.579,"5min":1.7689999999999999,"15min":1.7689999999999999},"last":0.84399999999999997}]},{"osd":4,"last update":"Tue Dec 12 09:45:18 2023","interfaces":[{"interface":"back","average":{"1min":1.3360000000000001,"5min":1.296,"15min":1.29},"min":{"1min":0.82999999999999996,"5min":0.80400000000000005,"15min":0.80400000000000005},"max":{"1min":1.923,"5min":2.073,"15min":2.073},"last":1.0760000000000001},{"interface":"front","average":{"1min":1.2,"5min":1.274,"15min":1.286},"min":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"max":{"1min":1.6359999999999999,"5min":3.0699999999999998,"15min":3.0699999999999998},"last":1.141}]},{"osd":5,"last update":"Tue Dec 12 09:45:18 2023","interfaces":[{"interface":"back","average":{"1min":1.173,"5min":1.2210000000000001,"15min":1.2290000000000001},"min":{"1min":0.73499999999999999,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.9690000000000001,"5min":3.1909999999999998,"15min":3.1909999999999998},"last":1.401},{"interface":"front","average":{"1min":1.2749999999999999,"5min":1.3,"15min":1.304},"min":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"max":{"1min":2.1200000000000001,"5min":2.1200000000000001,"15min":2.1200000000000001},"last":0.97099999999999997}]},{"osd":6,"last update":"Tue Dec 12 09:45:18 2023","interfaces":[{"interface":"back","average":{"1min":1.333,"5min":1.337,"15min":1.337},"min":{"1min":0.752,"5min":0.67500000000000004,"15min":0.67500000000000004},"max":{"1min":2.04,"5min":2.04,"15min":2.04},"last":1.22},{"interface":"front","average":{"1min":1.361,"5min":1.385,"15min":1.389},"min":{"1min":0.95399999999999996,"5min":0.73099999999999998,"15min":0.73099999999999998},"max":{"1min":1.7010000000000001,"5min":2.9100000000000001,"15min":2.9100000000000001},"last":1.181}]},{"osd":7,"last update":"Tue Dec 12 09:45:18 2023","interfaces":[{"interface":"back","average":{"1min":1.3999999999999999,"5min":1.4359999999999999,"15min":1.4419999999999999},"min":{"1min":0.70299999999999996,"5min":0.66800000000000004,"15min":0.66800000000000004},"max":{"1min":1.847,"5min":2.992,"15min":2.992},"last":1.367},{"interface":"front","average":{"1min":1.3169999999999999,"5min":1.327,"15min":1.329},"min":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"max":{"1min":1.8120000000000001,"5min":2.7690000000000001,"15min":2.7690000000000001},"last":1.28}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32422,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32422,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-12T09:45:27.916 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-12T09:45:28.172 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:28.170+0000 7f683746b640 1 Processor -- start 2023-12-12T09:45:28.172 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:28.171+0000 7f683746b640 1 -- start start 2023-12-12T09:45:28.175 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:28.172+0000 7f683746b640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f683006a750 0x7f6830159020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:28.175 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:28.172+0000 7f683746b640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f68300bfdc0 0x7f68300c38b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:28.175 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:28.172+0000 7f683746b640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6830158b90 con 0x7f6830071f00 2023-12-12T09:45:28.175 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:28.172+0000 7f683746b640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68300727c0 con 0x7f68300bfdc0 2023-12-12T09:45:28.175 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:28.172+0000 7f683746b640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68301588f0 con 0x7f683006a750 2023-12-12T09:45:28.175 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:28.172+0000 7f6835a08640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f68300bfdc0 0x7f68300c38b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:28.176 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:28.172+0000 7f6835a08640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f68300bfdc0 0x7f68300c38b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:45406/0 (socket says 172.21.15.73:45406) 2023-12-12T09:45:28.176 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:28.173+0000 7f6835a08640 1 -- 172.21.15.73:0/4230577012 learned_addr learned my addr 172.21.15.73:0/4230577012 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:45:28.176 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:28.173+0000 7f6835207640 1 --2- 172.21.15.73:0/4230577012 >> v2:172.21.15.142:3300/0 conn(0x7f683006a750 0x7f6830159020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:28.176 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:28.173+0000 7f6835a08640 1 -- 172.21.15.73:0/4230577012 >> v2:172.21.15.142:3300/0 conn(0x7f683006a750 msgr2=0x7f6830159020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:45:28.176 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:28.173+0000 7f6835a08640 1 --2- 172.21.15.73:0/4230577012 >> v2:172.21.15.142:3300/0 conn(0x7f683006a750 0x7f6830159020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:28.176 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:28.173+0000 7f6835a08640 1 -- 172.21.15.73:0/4230577012 >> v1:172.21.15.142:6789/0 conn(0x7f6830071f00 legacy=0x7f6830155aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:45:28.176 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:28.173+0000 7f6835a08640 1 -- 172.21.15.73:0/4230577012 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68300c4e30 con 0x7f68300bfdc0 2023-12-12T09:45:28.177 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:28.174+0000 7f6835a08640 1 --2- 172.21.15.73:0/4230577012 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f68300bfdc0 0x7f68300c38b0 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f683006e3c0 tx=0x7f682802bdc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12bf6a105e9b6f27 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:45:28.177 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:28.175+0000 7f6827fff640 1 -- 172.21.15.73:0/4230577012 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f682802c960 con 0x7f68300bfdc0 2023-12-12T09:45:28.177 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:28.175+0000 7f6827fff640 1 -- 172.21.15.73:0/4230577012 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f682802cac0 con 0x7f68300bfdc0 2023-12-12T09:45:28.178 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:28.175+0000 7f6827fff640 1 -- 172.21.15.73:0/4230577012 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f682802ce50 con 0x7f68300bfdc0 2023-12-12T09:45:28.178 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:28.175+0000 7f683746b640 1 -- 172.21.15.73:0/4230577012 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f68300bfdc0 msgr2=0x7f68300c38b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:28.178 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:28.175+0000 7f683746b640 1 --2- 172.21.15.73:0/4230577012 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f68300bfdc0 0x7f68300c38b0 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f683006e3c0 tx=0x7f682802bdc0 comp rx=0 tx=0).stop 2023-12-12T09:45:28.178 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:28.175+0000 7f683746b640 1 -- 172.21.15.73:0/4230577012 shutdown_connections 2023-12-12T09:45:28.178 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:28.175+0000 7f683746b640 1 --2- 172.21.15.73:0/4230577012 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f68300bfdc0 0x7f68300c38b0 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:28.178 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:28.175+0000 7f683746b640 1 --2- 172.21.15.73:0/4230577012 >> v2:172.21.15.142:3300/0 conn(0x7f683006a750 0x7f6830159020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:28.178 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:28.175+0000 7f683746b640 1 -- 172.21.15.73:0/4230577012 >> 172.21.15.73:0/4230577012 conn(0x7f68300a8130 msgr2=0x7f68300c24b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:45:28.178 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:28.175+0000 7f683746b640 1 -- 172.21.15.73:0/4230577012 shutdown_connections 2023-12-12T09:45:28.178 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:28.176+0000 7f683746b640 1 -- 172.21.15.73:0/4230577012 wait complete. 2023-12-12T09:45:28.179 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:28.177+0000 7f683746b640 1 Processor -- start 2023-12-12T09:45:28.179 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:28.177+0000 7f683746b640 1 -- start start 2023-12-12T09:45:28.180 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:28.178+0000 7f683746b640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f683006a750 0x7f68300aa2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:28.180 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:28.178+0000 7f683746b640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6830071f00 0x7f68300a9a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:28.180 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:28.178+0000 7f683746b640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f68300bfdc0 0x7f68301ee840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:28.180 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:28.178+0000 7f683746b640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6830150dd0 con 0x7f683006a750 2023-12-12T09:45:28.180 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:28.178+0000 7f683746b640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68300aad90 con 0x7f6830071f00 2023-12-12T09:45:28.180 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:28.178+0000 7f683746b640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6830150520 con 0x7f68300bfdc0 2023-12-12T09:45:28.180 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:28.178+0000 7f6835207640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f683006a750 0x7f68300aa2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:28.180 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:28.179+0000 7f6835207640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f683006a750 0x7f68300aa2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:45412/0 (socket says 172.21.15.73:45412) 2023-12-12T09:45:28.181 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:28.179+0000 7f6835207640 1 -- 172.21.15.73:0/2434120751 learned_addr learned my addr 172.21.15.73:0/2434120751 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:45:28.181 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:28.179+0000 7f6834a06640 1 --2- 172.21.15.73:0/2434120751 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6830071f00 0x7f68300a9a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:28.181 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:28.179+0000 7f6835207640 1 -- 172.21.15.73:0/2434120751 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f68300bfdc0 msgr2=0x7f68301ee840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:28.181 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:28.179+0000 7f6835207640 1 --2- 172.21.15.73:0/2434120751 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f68300bfdc0 0x7f68301ee840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:28.181 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:28.179+0000 7f6835207640 1 -- 172.21.15.73:0/2434120751 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6830071f00 msgr2=0x7f68300a9a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:28.181 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:28.179+0000 7f6835207640 1 --2- 172.21.15.73:0/2434120751 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6830071f00 0x7f68300a9a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:28.181 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:28.179+0000 7f6835207640 1 -- 172.21.15.73:0/2434120751 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6828009b30 con 0x7f683006a750 2023-12-12T09:45:28.182 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:28.179+0000 7f6835207640 1 --2- 172.21.15.73:0/2434120751 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f683006a750 0x7f68300aa2d0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f682c00d620 tx=0x7f682c00dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:45:28.182 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:28.179+0000 7f6825ffb640 1 -- 172.21.15.73:0/2434120751 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f682c00b620 con 0x7f683006a750 2023-12-12T09:45:28.182 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:28.180+0000 7f6825ffb640 1 -- 172.21.15.73:0/2434120751 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f682c00b780 con 0x7f683006a750 2023-12-12T09:45:28.182 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:28.180+0000 7f683746b640 1 -- 172.21.15.73:0/2434120751 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6830150750 con 0x7f683006a750 2023-12-12T09:45:28.182 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:28.180+0000 7f6825ffb640 1 -- 172.21.15.73:0/2434120751 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f682c00bb30 con 0x7f683006a750 2023-12-12T09:45:28.182 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:28.180+0000 7f683746b640 1 -- 172.21.15.73:0/2434120751 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68300aa860 con 0x7f683006a750 2023-12-12T09:45:28.182 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:28.181+0000 7f683746b640 1 -- 172.21.15.73:0/2434120751 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f683006cac0 con 0x7f683006a750 2023-12-12T09:45:28.183 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:28.182+0000 7f6825ffb640 1 -- 172.21.15.73:0/2434120751 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f682c00bc90 con 0x7f683006a750 2023-12-12T09:45:28.184 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:28.183+0000 7f6825ffb640 1 --2- 172.21.15.73:0/2434120751 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f681406ae40 0x7f681406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:28.184 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:28.183+0000 7f6825ffb640 1 -- 172.21.15.73:0/2434120751 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f682c089af0 con 0x7f683006a750 2023-12-12T09:45:28.184 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:28.183+0000 7f6834a06640 1 --2- 172.21.15.73:0/2434120751 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f681406ae40 0x7f681406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:28.185 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:28.184+0000 7f6834a06640 1 --2- 172.21.15.73:0/2434120751 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f681406ae40 0x7f681406d300 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f683015cf00 tx=0x7f6820008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:45:28.188 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:28.187+0000 7f6825ffb640 1 -- 172.21.15.73:0/2434120751 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f682c054b90 con 0x7f683006a750 2023-12-12T09:45:28.374 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:28.372+0000 7f683746b640 1 -- 172.21.15.73:0/2434120751 --> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f6830072450 con 0x7f681406ae40 2023-12-12T09:45:28.383 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:28.381+0000 7f6825ffb640 1 -- 172.21.15.73:0/2434120751 <== mgr.4110 v2:172.21.15.73:6832/779985841 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286685 (secure 0 0 0) 0x7f682000c4f0 con 0x7f681406ae40 2023-12-12T09:45:28.389 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-12T09:45:28.391 INFO:teuthology.orchestra.run.smithi073.stderr:dumped all 2023-12-12T09:45:28.393 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:28.388+0000 7f683746b640 1 -- 172.21.15.73:0/2434120751 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f681406ae40 msgr2=0x7f681406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:28.394 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:28.388+0000 7f683746b640 1 --2- 172.21.15.73:0/2434120751 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f681406ae40 0x7f681406d300 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f683015cf00 tx=0x7f6820008040 comp rx=0 tx=0).stop 2023-12-12T09:45:28.394 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:28.388+0000 7f683746b640 1 -- 172.21.15.73:0/2434120751 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f683006a750 msgr2=0x7f68300aa2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:28.394 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:28.388+0000 7f683746b640 1 --2- 172.21.15.73:0/2434120751 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f683006a750 0x7f68300aa2d0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f682c00d620 tx=0x7f682c00dae0 comp rx=0 tx=0).stop 2023-12-12T09:45:28.394 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:28.388+0000 7f683746b640 1 -- 172.21.15.73:0/2434120751 shutdown_connections 2023-12-12T09:45:28.394 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:28.388+0000 7f683746b640 1 --2- 172.21.15.73:0/2434120751 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f681406ae40 0x7f681406d300 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:28.395 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:28.388+0000 7f683746b640 1 --2- 172.21.15.73:0/2434120751 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f68300bfdc0 0x7f68301ee840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:28.395 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:28.388+0000 7f683746b640 1 --2- 172.21.15.73:0/2434120751 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6830071f00 0x7f68300a9a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:28.395 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:28.388+0000 7f683746b640 1 --2- 172.21.15.73:0/2434120751 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f683006a750 0x7f68300aa2d0 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:28.395 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:28.388+0000 7f683746b640 1 -- 172.21.15.73:0/2434120751 >> 172.21.15.73:0/2434120751 conn(0x7f68300a8130 msgr2=0x7f6830154590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:45:28.395 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:28.388+0000 7f683746b640 1 -- 172.21.15.73:0/2434120751 shutdown_connections 2023-12-12T09:45:28.395 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:28.388+0000 7f683746b640 1 -- 172.21.15.73:0/2434120751 wait complete. 2023-12-12T09:45:28.409 INFO:teuthology.orchestra.run.smithi073.stdout:{"pg_ready":true,"pg_map":{"version":114,"stamp":"2023-12-12T09:45:27.496025+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":91,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":221348,"kb_used_data":5148,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754753372,"statfs":{"total":773094113280,"available":772867452928,"internally_reserved":0,"allocated":5271552,"data_stored":3339274,"data_compressed":64844,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":36,"apply_latency_ms":36,"commit_latency_ns":36000000,"apply_latency_ns":36000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.000147"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-12T09:45:23.546338+0000","last_change":"2023-12-12T09:45:23.538728+0000","last_active":"2023-12-12T09:45:23.546338+0000","last_peered":"2023-12-12T09:45:23.546338+0000","last_clean":"2023-12-12T09:45:23.546338+0000","last_became_active":"2023-12-12T09:45:23.538477+0000","last_became_peered":"2023-12-12T09:45:23.538477+0000","last_unstale":"2023-12-12T09:45:23.546338+0000","last_undegraded":"2023-12-12T09:45:23.546338+0000","last_fullsized":"2023-12-12T09:45:23.546338+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_clean_scrub_stamp":"2023-12-12T09:45:22.493994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T11:48:16.993527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-12T09:45:23.554393+0000","last_change":"2023-12-12T09:45:23.550472+0000","last_active":"2023-12-12T09:45:23.554393+0000","last_peered":"2023-12-12T09:45:23.554393+0000","last_clean":"2023-12-12T09:45:23.554393+0000","last_became_active":"2023-12-12T09:45:23.550233+0000","last_became_peered":"2023-12-12T09:45:23.550233+0000","last_unstale":"2023-12-12T09:45:23.554393+0000","last_undegraded":"2023-12-12T09:45:23.554393+0000","last_fullsized":"2023-12-12T09:45:23.554393+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_clean_scrub_stamp":"2023-12-12T09:45:22.493994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T14:20:09.952370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-12T09:45:23.556886+0000","last_change":"2023-12-12T09:45:23.550621+0000","last_active":"2023-12-12T09:45:23.556886+0000","last_peered":"2023-12-12T09:45:23.556886+0000","last_clean":"2023-12-12T09:45:23.556886+0000","last_became_active":"2023-12-12T09:45:23.550284+0000","last_became_peered":"2023-12-12T09:45:23.550284+0000","last_unstale":"2023-12-12T09:45:23.556886+0000","last_undegraded":"2023-12-12T09:45:23.556886+0000","last_fullsized":"2023-12-12T09:45:23.556886+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_clean_scrub_stamp":"2023-12-12T09:45:22.493994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T15:31:33.286934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-12T09:45:23.537539+0000","last_change":"2023-12-12T09:45:23.529454+0000","last_active":"2023-12-12T09:45:23.537539+0000","last_peered":"2023-12-12T09:45:23.537539+0000","last_clean":"2023-12-12T09:45:23.537539+0000","last_became_active":"2023-12-12T09:45:23.529064+0000","last_became_peered":"2023-12-12T09:45:23.529064+0000","last_unstale":"2023-12-12T09:45:23.537539+0000","last_undegraded":"2023-12-12T09:45:23.537539+0000","last_fullsized":"2023-12-12T09:45:23.537539+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_clean_scrub_stamp":"2023-12-12T09:45:22.493994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T15:15:38.448721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-12T09:45:23.542335+0000","last_change":"2023-12-12T09:45:23.532127+0000","last_active":"2023-12-12T09:45:23.542335+0000","last_peered":"2023-12-12T09:45:23.542335+0000","last_clean":"2023-12-12T09:45:23.542335+0000","last_became_active":"2023-12-12T09:45:23.531850+0000","last_became_peered":"2023-12-12T09:45:23.531850+0000","last_unstale":"2023-12-12T09:45:23.542335+0000","last_undegraded":"2023-12-12T09:45:23.542335+0000","last_fullsized":"2023-12-12T09:45:23.542335+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_clean_scrub_stamp":"2023-12-12T09:45:22.493994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T20:22:59.883001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-12T09:45:23.536211+0000","last_change":"2023-12-12T09:45:23.531673+0000","last_active":"2023-12-12T09:45:23.536211+0000","last_peered":"2023-12-12T09:45:23.536211+0000","last_clean":"2023-12-12T09:45:23.536211+0000","last_became_active":"2023-12-12T09:45:23.530075+0000","last_became_peered":"2023-12-12T09:45:23.530075+0000","last_unstale":"2023-12-12T09:45:23.536211+0000","last_undegraded":"2023-12-12T09:45:23.536211+0000","last_fullsized":"2023-12-12T09:45:23.536211+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_clean_scrub_stamp":"2023-12-12T09:45:22.493994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T14:03:03.059227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-12T09:45:23.555806+0000","last_change":"2023-12-12T09:45:23.545363+0000","last_active":"2023-12-12T09:45:23.555806+0000","last_peered":"2023-12-12T09:45:23.555806+0000","last_clean":"2023-12-12T09:45:23.555806+0000","last_became_active":"2023-12-12T09:45:23.543029+0000","last_became_peered":"2023-12-12T09:45:23.543029+0000","last_unstale":"2023-12-12T09:45:23.555806+0000","last_undegraded":"2023-12-12T09:45:23.555806+0000","last_fullsized":"2023-12-12T09:45:23.555806+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_clean_scrub_stamp":"2023-12-12T09:45:22.493994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T14:10:03.420375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-12T09:45:23.544882+0000","last_change":"2023-12-12T09:45:23.540907+0000","last_active":"2023-12-12T09:45:23.544882+0000","last_peered":"2023-12-12T09:45:23.544882+0000","last_clean":"2023-12-12T09:45:23.544882+0000","last_became_active":"2023-12-12T09:45:23.540653+0000","last_became_peered":"2023-12-12T09:45:23.540653+0000","last_unstale":"2023-12-12T09:45:23.544882+0000","last_undegraded":"2023-12-12T09:45:23.544882+0000","last_fullsized":"2023-12-12T09:45:23.544882+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_clean_scrub_stamp":"2023-12-12T09:45:22.493994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T17:51:26.545637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-12T09:45:23.558319+0000","last_change":"2023-12-12T09:45:23.552916+0000","last_active":"2023-12-12T09:45:23.558319+0000","last_peered":"2023-12-12T09:45:23.558319+0000","last_clean":"2023-12-12T09:45:23.558319+0000","last_became_active":"2023-12-12T09:45:23.552025+0000","last_became_peered":"2023-12-12T09:45:23.552025+0000","last_unstale":"2023-12-12T09:45:23.558319+0000","last_undegraded":"2023-12-12T09:45:23.558319+0000","last_fullsized":"2023-12-12T09:45:23.558319+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_clean_scrub_stamp":"2023-12-12T09:45:22.493994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T20:54:18.455210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-12T09:45:23.550563+0000","last_change":"2023-12-12T09:45:23.545833+0000","last_active":"2023-12-12T09:45:23.550563+0000","last_peered":"2023-12-12T09:45:23.550563+0000","last_clean":"2023-12-12T09:45:23.550563+0000","last_became_active":"2023-12-12T09:45:23.545073+0000","last_became_peered":"2023-12-12T09:45:23.545073+0000","last_unstale":"2023-12-12T09:45:23.550563+0000","last_undegraded":"2023-12-12T09:45:23.550563+0000","last_fullsized":"2023-12-12T09:45:23.550563+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_clean_scrub_stamp":"2023-12-12T09:45:22.493994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T20:52:45.344852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-12T09:45:23.548728+0000","last_change":"2023-12-12T09:45:23.542993+0000","last_active":"2023-12-12T09:45:23.548728+0000","last_peered":"2023-12-12T09:45:23.548728+0000","last_clean":"2023-12-12T09:45:23.548728+0000","last_became_active":"2023-12-12T09:45:23.542770+0000","last_became_peered":"2023-12-12T09:45:23.542770+0000","last_unstale":"2023-12-12T09:45:23.548728+0000","last_undegraded":"2023-12-12T09:45:23.548728+0000","last_fullsized":"2023-12-12T09:45:23.548728+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_clean_scrub_stamp":"2023-12-12T09:45:22.493994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T14:30:36.106005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-12T09:45:23.556455+0000","last_change":"2023-12-12T09:45:23.552839+0000","last_active":"2023-12-12T09:45:23.556455+0000","last_peered":"2023-12-12T09:45:23.556455+0000","last_clean":"2023-12-12T09:45:23.556455+0000","last_became_active":"2023-12-12T09:45:23.548568+0000","last_became_peered":"2023-12-12T09:45:23.548568+0000","last_unstale":"2023-12-12T09:45:23.556455+0000","last_undegraded":"2023-12-12T09:45:23.556455+0000","last_fullsized":"2023-12-12T09:45:23.556455+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_clean_scrub_stamp":"2023-12-12T09:45:22.493994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T19:52:29.626502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-12T09:45:23.538411+0000","last_change":"2023-12-12T09:45:23.536465+0000","last_active":"2023-12-12T09:45:23.538411+0000","last_peered":"2023-12-12T09:45:23.538411+0000","last_clean":"2023-12-12T09:45:23.538411+0000","last_became_active":"2023-12-12T09:45:23.536019+0000","last_became_peered":"2023-12-12T09:45:23.536019+0000","last_unstale":"2023-12-12T09:45:23.538411+0000","last_undegraded":"2023-12-12T09:45:23.538411+0000","last_fullsized":"2023-12-12T09:45:23.538411+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_clean_scrub_stamp":"2023-12-12T09:45:22.493994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T15:51:11.791727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-12T09:45:23.558185+0000","last_change":"2023-12-12T09:45:23.551554+0000","last_active":"2023-12-12T09:45:23.558185+0000","last_peered":"2023-12-12T09:45:23.558185+0000","last_clean":"2023-12-12T09:45:23.558185+0000","last_became_active":"2023-12-12T09:45:23.548473+0000","last_became_peered":"2023-12-12T09:45:23.548473+0000","last_unstale":"2023-12-12T09:45:23.558185+0000","last_undegraded":"2023-12-12T09:45:23.558185+0000","last_fullsized":"2023-12-12T09:45:23.558185+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_clean_scrub_stamp":"2023-12-12T09:45:22.493994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T15:31:33.286934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-12T09:45:23.555246+0000","last_change":"2023-12-12T09:45:23.543290+0000","last_active":"2023-12-12T09:45:23.555246+0000","last_peered":"2023-12-12T09:45:23.555246+0000","last_clean":"2023-12-12T09:45:23.555246+0000","last_became_active":"2023-12-12T09:45:23.542623+0000","last_became_peered":"2023-12-12T09:45:23.542623+0000","last_unstale":"2023-12-12T09:45:23.555246+0000","last_undegraded":"2023-12-12T09:45:23.555246+0000","last_fullsized":"2023-12-12T09:45:23.555246+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_clean_scrub_stamp":"2023-12-12T09:45:22.493994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T14:30:36.106005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-12T09:45:23.555709+0000","last_change":"2023-12-12T09:45:23.550153+0000","last_active":"2023-12-12T09:45:23.555709+0000","last_peered":"2023-12-12T09:45:23.555709+0000","last_clean":"2023-12-12T09:45:23.555709+0000","last_became_active":"2023-12-12T09:45:23.548835+0000","last_became_peered":"2023-12-12T09:45:23.548835+0000","last_unstale":"2023-12-12T09:45:23.555709+0000","last_undegraded":"2023-12-12T09:45:23.555709+0000","last_fullsized":"2023-12-12T09:45:23.555709+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_clean_scrub_stamp":"2023-12-12T09:45:22.493994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T15:31:33.286934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-12T09:45:23.545495+0000","last_change":"2023-12-12T09:45:23.542153+0000","last_active":"2023-12-12T09:45:23.545495+0000","last_peered":"2023-12-12T09:45:23.545495+0000","last_clean":"2023-12-12T09:45:23.545495+0000","last_became_active":"2023-12-12T09:45:23.541948+0000","last_became_peered":"2023-12-12T09:45:23.541948+0000","last_unstale":"2023-12-12T09:45:23.545495+0000","last_undegraded":"2023-12-12T09:45:23.545495+0000","last_fullsized":"2023-12-12T09:45:23.545495+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_clean_scrub_stamp":"2023-12-12T09:45:22.493994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T12:53:08.506599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-12T09:45:23.557747+0000","last_change":"2023-12-12T09:45:23.553823+0000","last_active":"2023-12-12T09:45:23.557747+0000","last_peered":"2023-12-12T09:45:23.557747+0000","last_clean":"2023-12-12T09:45:23.557747+0000","last_became_active":"2023-12-12T09:45:23.553411+0000","last_became_peered":"2023-12-12T09:45:23.553411+0000","last_unstale":"2023-12-12T09:45:23.557747+0000","last_undegraded":"2023-12-12T09:45:23.557747+0000","last_fullsized":"2023-12-12T09:45:23.557747+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_clean_scrub_stamp":"2023-12-12T09:45:22.493994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T14:03:03.059227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-12T09:45:23.546372+0000","last_change":"2023-12-12T09:45:23.538491+0000","last_active":"2023-12-12T09:45:23.546372+0000","last_peered":"2023-12-12T09:45:23.546372+0000","last_clean":"2023-12-12T09:45:23.546372+0000","last_became_active":"2023-12-12T09:45:23.538127+0000","last_became_peered":"2023-12-12T09:45:23.538127+0000","last_unstale":"2023-12-12T09:45:23.546372+0000","last_undegraded":"2023-12-12T09:45:23.546372+0000","last_fullsized":"2023-12-12T09:45:23.546372+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_clean_scrub_stamp":"2023-12-12T09:45:22.493994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T17:29:05.098537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-12T09:45:23.555717+0000","last_change":"2023-12-12T09:45:23.551873+0000","last_active":"2023-12-12T09:45:23.555717+0000","last_peered":"2023-12-12T09:45:23.555717+0000","last_clean":"2023-12-12T09:45:23.555717+0000","last_became_active":"2023-12-12T09:45:23.551158+0000","last_became_peered":"2023-12-12T09:45:23.551158+0000","last_unstale":"2023-12-12T09:45:23.555717+0000","last_undegraded":"2023-12-12T09:45:23.555717+0000","last_fullsized":"2023-12-12T09:45:23.555717+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_clean_scrub_stamp":"2023-12-12T09:45:22.493994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T14:16:48.793935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-12T09:45:23.555934+0000","last_change":"2023-12-12T09:45:23.549785+0000","last_active":"2023-12-12T09:45:23.555934+0000","last_peered":"2023-12-12T09:45:23.555934+0000","last_clean":"2023-12-12T09:45:23.555934+0000","last_became_active":"2023-12-12T09:45:23.548831+0000","last_became_peered":"2023-12-12T09:45:23.548831+0000","last_unstale":"2023-12-12T09:45:23.555934+0000","last_undegraded":"2023-12-12T09:45:23.555934+0000","last_fullsized":"2023-12-12T09:45:23.555934+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_clean_scrub_stamp":"2023-12-12T09:45:22.493994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T21:23:17.912081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-12T09:45:23.552840+0000","last_change":"2023-12-12T09:45:23.546134+0000","last_active":"2023-12-12T09:45:23.552840+0000","last_peered":"2023-12-12T09:45:23.552840+0000","last_clean":"2023-12-12T09:45:23.552840+0000","last_became_active":"2023-12-12T09:45:23.545808+0000","last_became_peered":"2023-12-12T09:45:23.545808+0000","last_unstale":"2023-12-12T09:45:23.552840+0000","last_undegraded":"2023-12-12T09:45:23.552840+0000","last_fullsized":"2023-12-12T09:45:23.552840+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_clean_scrub_stamp":"2023-12-12T09:45:22.493994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T12:04:22.521885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-12T09:45:23.558093+0000","last_change":"2023-12-12T09:45:23.555039+0000","last_active":"2023-12-12T09:45:23.558093+0000","last_peered":"2023-12-12T09:45:23.558093+0000","last_clean":"2023-12-12T09:45:23.558093+0000","last_became_active":"2023-12-12T09:45:23.554002+0000","last_became_peered":"2023-12-12T09:45:23.554002+0000","last_unstale":"2023-12-12T09:45:23.558093+0000","last_undegraded":"2023-12-12T09:45:23.558093+0000","last_fullsized":"2023-12-12T09:45:23.558093+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_clean_scrub_stamp":"2023-12-12T09:45:22.493994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T15:15:38.448721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-12T09:45:23.535910+0000","last_change":"2023-12-12T09:45:23.530338+0000","last_active":"2023-12-12T09:45:23.535910+0000","last_peered":"2023-12-12T09:45:23.535910+0000","last_clean":"2023-12-12T09:45:23.535910+0000","last_became_active":"2023-12-12T09:45:23.529963+0000","last_became_peered":"2023-12-12T09:45:23.529963+0000","last_unstale":"2023-12-12T09:45:23.535910+0000","last_undegraded":"2023-12-12T09:45:23.535910+0000","last_fullsized":"2023-12-12T09:45:23.535910+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_clean_scrub_stamp":"2023-12-12T09:45:22.493994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T21:42:01.335580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-12T09:45:23.535554+0000","last_change":"2023-12-12T09:45:23.528718+0000","last_active":"2023-12-12T09:45:23.535554+0000","last_peered":"2023-12-12T09:45:23.535554+0000","last_clean":"2023-12-12T09:45:23.535554+0000","last_became_active":"2023-12-12T09:45:23.525181+0000","last_became_peered":"2023-12-12T09:45:23.525181+0000","last_unstale":"2023-12-12T09:45:23.535554+0000","last_undegraded":"2023-12-12T09:45:23.535554+0000","last_fullsized":"2023-12-12T09:45:23.535554+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_clean_scrub_stamp":"2023-12-12T09:45:22.493994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T14:55:40.208388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-12T09:45:23.555280+0000","last_change":"2023-12-12T09:45:23.546891+0000","last_active":"2023-12-12T09:45:23.555280+0000","last_peered":"2023-12-12T09:45:23.555280+0000","last_clean":"2023-12-12T09:45:23.555280+0000","last_became_active":"2023-12-12T09:45:23.544703+0000","last_became_peered":"2023-12-12T09:45:23.544703+0000","last_unstale":"2023-12-12T09:45:23.555280+0000","last_undegraded":"2023-12-12T09:45:23.555280+0000","last_fullsized":"2023-12-12T09:45:23.555280+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_clean_scrub_stamp":"2023-12-12T09:45:22.493994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T10:40:43.209236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-12T09:45:23.552138+0000","last_change":"2023-12-12T09:45:23.542373+0000","last_active":"2023-12-12T09:45:23.552138+0000","last_peered":"2023-12-12T09:45:23.552138+0000","last_clean":"2023-12-12T09:45:23.552138+0000","last_became_active":"2023-12-12T09:45:23.541920+0000","last_became_peered":"2023-12-12T09:45:23.541920+0000","last_unstale":"2023-12-12T09:45:23.552138+0000","last_undegraded":"2023-12-12T09:45:23.552138+0000","last_fullsized":"2023-12-12T09:45:23.552138+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_clean_scrub_stamp":"2023-12-12T09:45:22.493994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T20:27:09.962474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-12T09:45:23.546587+0000","last_change":"2023-12-12T09:45:23.541091+0000","last_active":"2023-12-12T09:45:23.546587+0000","last_peered":"2023-12-12T09:45:23.546587+0000","last_clean":"2023-12-12T09:45:23.546587+0000","last_became_active":"2023-12-12T09:45:23.540514+0000","last_became_peered":"2023-12-12T09:45:23.540514+0000","last_unstale":"2023-12-12T09:45:23.546587+0000","last_undegraded":"2023-12-12T09:45:23.546587+0000","last_fullsized":"2023-12-12T09:45:23.546587+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_clean_scrub_stamp":"2023-12-12T09:45:22.493994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T20:43:25.175410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-12T09:45:23.554136+0000","last_change":"2023-12-12T09:45:23.546206+0000","last_active":"2023-12-12T09:45:23.554136+0000","last_peered":"2023-12-12T09:45:23.554136+0000","last_clean":"2023-12-12T09:45:23.554136+0000","last_became_active":"2023-12-12T09:45:23.545933+0000","last_became_peered":"2023-12-12T09:45:23.545933+0000","last_unstale":"2023-12-12T09:45:23.554136+0000","last_undegraded":"2023-12-12T09:45:23.554136+0000","last_fullsized":"2023-12-12T09:45:23.554136+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_clean_scrub_stamp":"2023-12-12T09:45:22.493994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T10:08:57.049367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-12T09:45:23.557999+0000","last_change":"2023-12-12T09:45:23.554368+0000","last_active":"2023-12-12T09:45:23.557999+0000","last_peered":"2023-12-12T09:45:23.557999+0000","last_clean":"2023-12-12T09:45:23.557999+0000","last_became_active":"2023-12-12T09:45:23.554034+0000","last_became_peered":"2023-12-12T09:45:23.554034+0000","last_unstale":"2023-12-12T09:45:23.557999+0000","last_undegraded":"2023-12-12T09:45:23.557999+0000","last_fullsized":"2023-12-12T09:45:23.557999+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_clean_scrub_stamp":"2023-12-12T09:45:22.493994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T17:58:31.519111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-12T09:45:23.540805+0000","last_change":"2023-12-12T09:45:23.529597+0000","last_active":"2023-12-12T09:45:23.540805+0000","last_peered":"2023-12-12T09:45:23.540805+0000","last_clean":"2023-12-12T09:45:23.540805+0000","last_became_active":"2023-12-12T09:45:23.524375+0000","last_became_peered":"2023-12-12T09:45:23.524375+0000","last_unstale":"2023-12-12T09:45:23.540805+0000","last_undegraded":"2023-12-12T09:45:23.540805+0000","last_fullsized":"2023-12-12T09:45:23.540805+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_clean_scrub_stamp":"2023-12-12T09:45:22.493994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T12:32:17.749532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-12T09:45:23.558862+0000","last_change":"2023-12-12T09:45:23.553950+0000","last_active":"2023-12-12T09:45:23.558862+0000","last_peered":"2023-12-12T09:45:23.558862+0000","last_clean":"2023-12-12T09:45:23.558862+0000","last_became_active":"2023-12-12T09:45:23.551990+0000","last_became_peered":"2023-12-12T09:45:23.551990+0000","last_unstale":"2023-12-12T09:45:23.558862+0000","last_undegraded":"2023-12-12T09:45:23.558862+0000","last_fullsized":"2023-12-12T09:45:23.558862+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_clean_scrub_stamp":"2023-12-12T09:45:22.493994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T10:40:43.209236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-12T09:45:23.555763+0000","last_change":"2023-12-12T09:45:23.551190+0000","last_active":"2023-12-12T09:45:23.555763+0000","last_peered":"2023-12-12T09:45:23.555763+0000","last_clean":"2023-12-12T09:45:23.555763+0000","last_became_active":"2023-12-12T09:45:23.550956+0000","last_became_peered":"2023-12-12T09:45:23.550956+0000","last_unstale":"2023-12-12T09:45:23.555763+0000","last_undegraded":"2023-12-12T09:45:23.555763+0000","last_fullsized":"2023-12-12T09:45:23.555763+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_clean_scrub_stamp":"2023-12-12T09:45:22.493994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T19:52:29.626502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1f","version":"53'4","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-12T09:45:23.548439+0000","last_change":"2023-12-12T09:45:22.537277+0000","last_active":"2023-12-12T09:45:23.548439+0000","last_peered":"2023-12-12T09:45:23.548439+0000","last_clean":"2023-12-12T09:45:23.548439+0000","last_became_active":"2023-12-12T09:45:22.536893+0000","last_became_peered":"2023-12-12T09:45:22.536893+0000","last_unstale":"2023-12-12T09:45:23.548439+0000","last_undegraded":"2023-12-12T09:45:23.548439+0000","last_fullsized":"2023-12-12T09:45:23.548439+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:21.477323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:21.477323+0000","last_clean_scrub_stamp":"2023-12-12T09:45:21.477323+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T16:38:00.043063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-12T09:45:23.556080+0000","last_change":"2023-12-12T09:45:23.549535+0000","last_active":"2023-12-12T09:45:23.556080+0000","last_peered":"2023-12-12T09:45:23.556080+0000","last_clean":"2023-12-12T09:45:23.556080+0000","last_became_active":"2023-12-12T09:45:23.549256+0000","last_became_peered":"2023-12-12T09:45:23.549256+0000","last_unstale":"2023-12-12T09:45:23.556080+0000","last_undegraded":"2023-12-12T09:45:23.556080+0000","last_fullsized":"2023-12-12T09:45:23.556080+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_clean_scrub_stamp":"2023-12-12T09:45:22.493994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T20:54:18.455210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"53'1","reported_seq":12,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-12T09:45:23.551252+0000","last_change":"2023-12-12T09:45:22.543679+0000","last_active":"2023-12-12T09:45:23.551252+0000","last_peered":"2023-12-12T09:45:23.551252+0000","last_clean":"2023-12-12T09:45:23.551252+0000","last_became_active":"2023-12-12T09:45:22.543357+0000","last_became_peered":"2023-12-12T09:45:22.543357+0000","last_unstale":"2023-12-12T09:45:23.551252+0000","last_undegraded":"2023-12-12T09:45:23.551252+0000","last_fullsized":"2023-12-12T09:45:23.551252+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:21.477323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:21.477323+0000","last_clean_scrub_stamp":"2023-12-12T09:45:21.477323+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T13:19:15.975105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-12T09:45:23.538889+0000","last_change":"2023-12-12T09:45:23.531455+0000","last_active":"2023-12-12T09:45:23.538889+0000","last_peered":"2023-12-12T09:45:23.538889+0000","last_clean":"2023-12-12T09:45:23.538889+0000","last_became_active":"2023-12-12T09:45:23.531164+0000","last_became_peered":"2023-12-12T09:45:23.531164+0000","last_unstale":"2023-12-12T09:45:23.538889+0000","last_undegraded":"2023-12-12T09:45:23.538889+0000","last_fullsized":"2023-12-12T09:45:23.538889+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_clean_scrub_stamp":"2023-12-12T09:45:22.493994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T13:28:38.787401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"53'2","reported_seq":13,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-12T09:45:23.547851+0000","last_change":"2023-12-12T09:45:22.531101+0000","last_active":"2023-12-12T09:45:23.547851+0000","last_peered":"2023-12-12T09:45:23.547851+0000","last_clean":"2023-12-12T09:45:23.547851+0000","last_became_active":"2023-12-12T09:45:22.530822+0000","last_became_peered":"2023-12-12T09:45:22.530822+0000","last_unstale":"2023-12-12T09:45:23.547851+0000","last_undegraded":"2023-12-12T09:45:23.547851+0000","last_fullsized":"2023-12-12T09:45:23.547851+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:21.477323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:21.477323+0000","last_clean_scrub_stamp":"2023-12-12T09:45:21.477323+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T21:23:16.895410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-12T09:45:23.555392+0000","last_change":"2023-12-12T09:45:23.548842+0000","last_active":"2023-12-12T09:45:23.555392+0000","last_peered":"2023-12-12T09:45:23.555392+0000","last_clean":"2023-12-12T09:45:23.555392+0000","last_became_active":"2023-12-12T09:45:23.548561+0000","last_became_peered":"2023-12-12T09:45:23.548561+0000","last_unstale":"2023-12-12T09:45:23.555392+0000","last_undegraded":"2023-12-12T09:45:23.555392+0000","last_fullsized":"2023-12-12T09:45:23.555392+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_clean_scrub_stamp":"2023-12-12T09:45:22.493994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T19:01:50.522909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1c","version":"53'2","reported_seq":13,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-12T09:45:23.557075+0000","last_change":"2023-12-12T09:45:22.540050+0000","last_active":"2023-12-12T09:45:23.557075+0000","last_peered":"2023-12-12T09:45:23.557075+0000","last_clean":"2023-12-12T09:45:23.557075+0000","last_became_active":"2023-12-12T09:45:22.539726+0000","last_became_peered":"2023-12-12T09:45:22.539726+0000","last_unstale":"2023-12-12T09:45:23.557075+0000","last_undegraded":"2023-12-12T09:45:23.557075+0000","last_fullsized":"2023-12-12T09:45:23.557075+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:21.477323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:21.477323+0000","last_clean_scrub_stamp":"2023-12-12T09:45:21.477323+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T19:19:47.388523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-12T09:45:23.538130+0000","last_change":"2023-12-12T09:45:23.536948+0000","last_active":"2023-12-12T09:45:23.538130+0000","last_peered":"2023-12-12T09:45:23.538130+0000","last_clean":"2023-12-12T09:45:23.538130+0000","last_became_active":"2023-12-12T09:45:23.536696+0000","last_became_peered":"2023-12-12T09:45:23.536696+0000","last_unstale":"2023-12-12T09:45:23.538130+0000","last_undegraded":"2023-12-12T09:45:23.538130+0000","last_fullsized":"2023-12-12T09:45:23.538130+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_clean_scrub_stamp":"2023-12-12T09:45:22.493994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T20:14:20.654636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"53'1","reported_seq":12,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-12T09:45:23.554640+0000","last_change":"2023-12-12T09:45:22.543941+0000","last_active":"2023-12-12T09:45:23.554640+0000","last_peered":"2023-12-12T09:45:23.554640+0000","last_clean":"2023-12-12T09:45:23.554640+0000","last_became_active":"2023-12-12T09:45:22.543584+0000","last_became_peered":"2023-12-12T09:45:22.543584+0000","last_unstale":"2023-12-12T09:45:23.554640+0000","last_undegraded":"2023-12-12T09:45:23.554640+0000","last_fullsized":"2023-12-12T09:45:23.554640+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:21.477323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:21.477323+0000","last_clean_scrub_stamp":"2023-12-12T09:45:21.477323+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T13:28:37.770730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-12T09:45:23.558654+0000","last_change":"2023-12-12T09:45:23.553762+0000","last_active":"2023-12-12T09:45:23.558654+0000","last_peered":"2023-12-12T09:45:23.558654+0000","last_clean":"2023-12-12T09:45:23.558654+0000","last_became_active":"2023-12-12T09:45:23.553518+0000","last_became_peered":"2023-12-12T09:45:23.553518+0000","last_unstale":"2023-12-12T09:45:23.558654+0000","last_undegraded":"2023-12-12T09:45:23.558654+0000","last_fullsized":"2023-12-12T09:45:23.558654+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_clean_scrub_stamp":"2023-12-12T09:45:22.493994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T18:41:29.720316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1a","version":"53'1","reported_seq":12,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-12T09:45:23.548286+0000","last_change":"2023-12-12T09:45:22.535525+0000","last_active":"2023-12-12T09:45:23.548286+0000","last_peered":"2023-12-12T09:45:23.548286+0000","last_clean":"2023-12-12T09:45:23.548286+0000","last_became_active":"2023-12-12T09:45:22.534726+0000","last_became_peered":"2023-12-12T09:45:22.534726+0000","last_unstale":"2023-12-12T09:45:23.548286+0000","last_undegraded":"2023-12-12T09:45:23.548286+0000","last_fullsized":"2023-12-12T09:45:23.548286+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:21.477323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:21.477323+0000","last_clean_scrub_stamp":"2023-12-12T09:45:21.477323+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T16:23:29.088120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-12T09:45:23.554388+0000","last_change":"2023-12-12T09:45:23.550084+0000","last_active":"2023-12-12T09:45:23.554388+0000","last_peered":"2023-12-12T09:45:23.554388+0000","last_clean":"2023-12-12T09:45:23.554388+0000","last_became_active":"2023-12-12T09:45:23.549808+0000","last_became_peered":"2023-12-12T09:45:23.549808+0000","last_unstale":"2023-12-12T09:45:23.554388+0000","last_undegraded":"2023-12-12T09:45:23.554388+0000","last_fullsized":"2023-12-12T09:45:23.554388+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_clean_scrub_stamp":"2023-12-12T09:45:22.493994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T10:00:37.765775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-12T09:45:23.516843+0000","last_change":"2023-12-12T09:45:22.531465+0000","last_active":"2023-12-12T09:45:23.516843+0000","last_peered":"2023-12-12T09:45:23.516843+0000","last_clean":"2023-12-12T09:45:23.516843+0000","last_became_active":"2023-12-12T09:45:22.531205+0000","last_became_peered":"2023-12-12T09:45:22.531205+0000","last_unstale":"2023-12-12T09:45:23.516843+0000","last_undegraded":"2023-12-12T09:45:23.516843+0000","last_fullsized":"2023-12-12T09:45:23.516843+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:21.477323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:21.477323+0000","last_clean_scrub_stamp":"2023-12-12T09:45:21.477323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T13:28:37.770730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-12T09:45:23.545499+0000","last_change":"2023-12-12T09:45:23.542175+0000","last_active":"2023-12-12T09:45:23.545499+0000","last_peered":"2023-12-12T09:45:23.545499+0000","last_clean":"2023-12-12T09:45:23.545499+0000","last_became_active":"2023-12-12T09:45:23.541908+0000","last_became_peered":"2023-12-12T09:45:23.541908+0000","last_unstale":"2023-12-12T09:45:23.545499+0000","last_undegraded":"2023-12-12T09:45:23.545499+0000","last_fullsized":"2023-12-12T09:45:23.545499+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_clean_scrub_stamp":"2023-12-12T09:45:22.493994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T17:31:24.263383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-12T09:45:23.534041+0000","last_change":"2023-12-12T09:45:22.540369+0000","last_active":"2023-12-12T09:45:23.534041+0000","last_peered":"2023-12-12T09:45:23.534041+0000","last_clean":"2023-12-12T09:45:23.534041+0000","last_became_active":"2023-12-12T09:45:22.540054+0000","last_became_peered":"2023-12-12T09:45:22.540054+0000","last_unstale":"2023-12-12T09:45:23.534041+0000","last_undegraded":"2023-12-12T09:45:23.534041+0000","last_fullsized":"2023-12-12T09:45:23.534041+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:21.477323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:21.477323+0000","last_clean_scrub_stamp":"2023-12-12T09:45:21.477323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T14:03:02.042556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-12T09:45:23.558309+0000","last_change":"2023-12-12T09:45:23.552875+0000","last_active":"2023-12-12T09:45:23.558309+0000","last_peered":"2023-12-12T09:45:23.558309+0000","last_clean":"2023-12-12T09:45:23.558309+0000","last_became_active":"2023-12-12T09:45:23.551034+0000","last_became_peered":"2023-12-12T09:45:23.551034+0000","last_unstale":"2023-12-12T09:45:23.558309+0000","last_undegraded":"2023-12-12T09:45:23.558309+0000","last_fullsized":"2023-12-12T09:45:23.558309+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_clean_scrub_stamp":"2023-12-12T09:45:22.493994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T18:05:50.089314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-12T09:45:23.537176+0000","last_change":"2023-12-12T09:45:22.546259+0000","last_active":"2023-12-12T09:45:23.537176+0000","last_peered":"2023-12-12T09:45:23.537176+0000","last_clean":"2023-12-12T09:45:23.537176+0000","last_became_active":"2023-12-12T09:45:22.545948+0000","last_became_peered":"2023-12-12T09:45:22.545948+0000","last_unstale":"2023-12-12T09:45:23.537176+0000","last_undegraded":"2023-12-12T09:45:23.537176+0000","last_fullsized":"2023-12-12T09:45:23.537176+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:21.477323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:21.477323+0000","last_clean_scrub_stamp":"2023-12-12T09:45:21.477323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T19:19:47.388523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-12T09:45:23.558885+0000","last_change":"2023-12-12T09:45:23.556637+0000","last_active":"2023-12-12T09:45:23.558885+0000","last_peered":"2023-12-12T09:45:23.558885+0000","last_clean":"2023-12-12T09:45:23.558885+0000","last_became_active":"2023-12-12T09:45:23.556344+0000","last_became_peered":"2023-12-12T09:45:23.556344+0000","last_unstale":"2023-12-12T09:45:23.558885+0000","last_undegraded":"2023-12-12T09:45:23.558885+0000","last_fullsized":"2023-12-12T09:45:23.558885+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_clean_scrub_stamp":"2023-12-12T09:45:22.493994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T19:52:29.626502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-12T09:45:23.533254+0000","last_change":"2023-12-12T09:45:22.537346+0000","last_active":"2023-12-12T09:45:23.533254+0000","last_peered":"2023-12-12T09:45:23.533254+0000","last_clean":"2023-12-12T09:45:23.533254+0000","last_became_active":"2023-12-12T09:45:22.535141+0000","last_became_peered":"2023-12-12T09:45:22.535141+0000","last_unstale":"2023-12-12T09:45:23.533254+0000","last_undegraded":"2023-12-12T09:45:23.533254+0000","last_fullsized":"2023-12-12T09:45:23.533254+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:21.477323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:21.477323+0000","last_clean_scrub_stamp":"2023-12-12T09:45:21.477323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T18:37:25.938135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-12T09:45:23.556142+0000","last_change":"2023-12-12T09:45:23.549595+0000","last_active":"2023-12-12T09:45:23.556142+0000","last_peered":"2023-12-12T09:45:23.556142+0000","last_clean":"2023-12-12T09:45:23.556142+0000","last_became_active":"2023-12-12T09:45:23.549247+0000","last_became_peered":"2023-12-12T09:45:23.549247+0000","last_unstale":"2023-12-12T09:45:23.556142+0000","last_undegraded":"2023-12-12T09:45:23.556142+0000","last_fullsized":"2023-12-12T09:45:23.556142+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_clean_scrub_stamp":"2023-12-12T09:45:22.493994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T14:10:03.420375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.15","version":"53'3","reported_seq":14,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-12T09:45:23.558205+0000","last_change":"2023-12-12T09:45:22.546308+0000","last_active":"2023-12-12T09:45:23.558205+0000","last_peered":"2023-12-12T09:45:23.558205+0000","last_clean":"2023-12-12T09:45:23.558205+0000","last_became_active":"2023-12-12T09:45:22.545942+0000","last_became_peered":"2023-12-12T09:45:22.545942+0000","last_unstale":"2023-12-12T09:45:23.558205+0000","last_undegraded":"2023-12-12T09:45:23.558205+0000","last_fullsized":"2023-12-12T09:45:23.558205+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:21.477323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:21.477323+0000","last_clean_scrub_stamp":"2023-12-12T09:45:21.477323+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T13:07:07.278574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-12T09:45:23.559276+0000","last_change":"2023-12-12T09:45:23.557554+0000","last_active":"2023-12-12T09:45:23.559276+0000","last_peered":"2023-12-12T09:45:23.559276+0000","last_clean":"2023-12-12T09:45:23.559276+0000","last_became_active":"2023-12-12T09:45:23.557239+0000","last_became_peered":"2023-12-12T09:45:23.557239+0000","last_unstale":"2023-12-12T09:45:23.559276+0000","last_undegraded":"2023-12-12T09:45:23.559276+0000","last_fullsized":"2023-12-12T09:45:23.559276+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_clean_scrub_stamp":"2023-12-12T09:45:22.493994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T16:23:30.104791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.14","version":"53'6","reported_seq":17,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-12T09:45:23.561272+0000","last_change":"2023-12-12T09:45:22.543924+0000","last_active":"2023-12-12T09:45:23.561272+0000","last_peered":"2023-12-12T09:45:23.561272+0000","last_clean":"2023-12-12T09:45:23.561272+0000","last_became_active":"2023-12-12T09:45:22.543617+0000","last_became_peered":"2023-12-12T09:45:22.543617+0000","last_unstale":"2023-12-12T09:45:23.561272+0000","last_undegraded":"2023-12-12T09:45:23.561272+0000","last_fullsized":"2023-12-12T09:45:23.561272+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:21.477323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:21.477323+0000","last_clean_scrub_stamp":"2023-12-12T09:45:21.477323+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T20:52:44.328181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-12T09:45:23.544229+0000","last_change":"2023-12-12T09:45:23.542417+0000","last_active":"2023-12-12T09:45:23.544229+0000","last_peered":"2023-12-12T09:45:23.544229+0000","last_clean":"2023-12-12T09:45:23.544229+0000","last_became_active":"2023-12-12T09:45:23.541778+0000","last_became_peered":"2023-12-12T09:45:23.541778+0000","last_unstale":"2023-12-12T09:45:23.544229+0000","last_undegraded":"2023-12-12T09:45:23.544229+0000","last_fullsized":"2023-12-12T09:45:23.544229+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_clean_scrub_stamp":"2023-12-12T09:45:22.493994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T16:38:01.059734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"53'2","reported_seq":13,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-12T09:45:23.550685+0000","last_change":"2023-12-12T09:45:22.531079+0000","last_active":"2023-12-12T09:45:23.550685+0000","last_peered":"2023-12-12T09:45:23.550685+0000","last_clean":"2023-12-12T09:45:23.550685+0000","last_became_active":"2023-12-12T09:45:22.530821+0000","last_became_peered":"2023-12-12T09:45:22.530821+0000","last_unstale":"2023-12-12T09:45:23.550685+0000","last_undegraded":"2023-12-12T09:45:23.550685+0000","last_fullsized":"2023-12-12T09:45:23.550685+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:21.477323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:21.477323+0000","last_clean_scrub_stamp":"2023-12-12T09:45:21.477323+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T14:54:09.644707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-12T09:45:23.555970+0000","last_change":"2023-12-12T09:45:23.550533+0000","last_active":"2023-12-12T09:45:23.555970+0000","last_peered":"2023-12-12T09:45:23.555970+0000","last_clean":"2023-12-12T09:45:23.555970+0000","last_became_active":"2023-12-12T09:45:23.548384+0000","last_became_peered":"2023-12-12T09:45:23.548384+0000","last_unstale":"2023-12-12T09:45:23.555970+0000","last_undegraded":"2023-12-12T09:45:23.555970+0000","last_fullsized":"2023-12-12T09:45:23.555970+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_clean_scrub_stamp":"2023-12-12T09:45:22.493994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T20:27:09.962474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-12T09:45:23.516774+0000","last_change":"2023-12-12T09:45:22.540556+0000","last_active":"2023-12-12T09:45:23.516774+0000","last_peered":"2023-12-12T09:45:23.516774+0000","last_clean":"2023-12-12T09:45:23.516774+0000","last_became_active":"2023-12-12T09:45:22.540265+0000","last_became_peered":"2023-12-12T09:45:22.540265+0000","last_unstale":"2023-12-12T09:45:23.516774+0000","last_undegraded":"2023-12-12T09:45:23.516774+0000","last_fullsized":"2023-12-12T09:45:23.516774+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:21.477323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:21.477323+0000","last_clean_scrub_stamp":"2023-12-12T09:45:21.477323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T18:29:34.637693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-12T09:45:23.557885+0000","last_change":"2023-12-12T09:45:23.550480+0000","last_active":"2023-12-12T09:45:23.557885+0000","last_peered":"2023-12-12T09:45:23.557885+0000","last_clean":"2023-12-12T09:45:23.557885+0000","last_became_active":"2023-12-12T09:45:23.549473+0000","last_became_peered":"2023-12-12T09:45:23.549473+0000","last_unstale":"2023-12-12T09:45:23.557885+0000","last_undegraded":"2023-12-12T09:45:23.557885+0000","last_fullsized":"2023-12-12T09:45:23.557885+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_clean_scrub_stamp":"2023-12-12T09:45:22.493994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T16:38:01.059734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-12T09:45:23.517180+0000","last_change":"2023-12-12T09:45:22.540441+0000","last_active":"2023-12-12T09:45:23.517180+0000","last_peered":"2023-12-12T09:45:23.517180+0000","last_clean":"2023-12-12T09:45:23.517180+0000","last_became_active":"2023-12-12T09:45:22.539379+0000","last_became_peered":"2023-12-12T09:45:22.539379+0000","last_unstale":"2023-12-12T09:45:23.517180+0000","last_undegraded":"2023-12-12T09:45:23.517180+0000","last_fullsized":"2023-12-12T09:45:23.517180+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:21.477323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:21.477323+0000","last_clean_scrub_stamp":"2023-12-12T09:45:21.477323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T14:03:02.042556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-12T09:45:23.558851+0000","last_change":"2023-12-12T09:45:23.556070+0000","last_active":"2023-12-12T09:45:23.558851+0000","last_peered":"2023-12-12T09:45:23.558851+0000","last_clean":"2023-12-12T09:45:23.558851+0000","last_became_active":"2023-12-12T09:45:23.554580+0000","last_became_peered":"2023-12-12T09:45:23.554580+0000","last_unstale":"2023-12-12T09:45:23.558851+0000","last_undegraded":"2023-12-12T09:45:23.558851+0000","last_fullsized":"2023-12-12T09:45:23.558851+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_clean_scrub_stamp":"2023-12-12T09:45:22.493994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T10:40:43.209236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.10","version":"53'8","reported_seq":19,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-12T09:45:23.557244+0000","last_change":"2023-12-12T09:45:22.546154+0000","last_active":"2023-12-12T09:45:23.557244+0000","last_peered":"2023-12-12T09:45:23.557244+0000","last_clean":"2023-12-12T09:45:23.557244+0000","last_became_active":"2023-12-12T09:45:22.545903+0000","last_became_peered":"2023-12-12T09:45:22.545903+0000","last_unstale":"2023-12-12T09:45:23.557244+0000","last_undegraded":"2023-12-12T09:45:23.557244+0000","last_fullsized":"2023-12-12T09:45:23.557244+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:21.477323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:21.477323+0000","last_clean_scrub_stamp":"2023-12-12T09:45:21.477323+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T16:38:00.043063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-12T09:45:23.555902+0000","last_change":"2023-12-12T09:45:23.551062+0000","last_active":"2023-12-12T09:45:23.555902+0000","last_peered":"2023-12-12T09:45:23.555902+0000","last_clean":"2023-12-12T09:45:23.555902+0000","last_became_active":"2023-12-12T09:45:23.549387+0000","last_became_peered":"2023-12-12T09:45:23.549387+0000","last_unstale":"2023-12-12T09:45:23.555902+0000","last_undegraded":"2023-12-12T09:45:23.555902+0000","last_fullsized":"2023-12-12T09:45:23.555902+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_clean_scrub_stamp":"2023-12-12T09:45:22.493994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T19:01:50.522909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.f","version":"53'1","reported_seq":12,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-12T09:45:23.546845+0000","last_change":"2023-12-12T09:45:22.532050+0000","last_active":"2023-12-12T09:45:23.546845+0000","last_peered":"2023-12-12T09:45:23.546845+0000","last_clean":"2023-12-12T09:45:23.546845+0000","last_became_active":"2023-12-12T09:45:22.531712+0000","last_became_peered":"2023-12-12T09:45:22.531712+0000","last_unstale":"2023-12-12T09:45:23.546845+0000","last_undegraded":"2023-12-12T09:45:23.546845+0000","last_fullsized":"2023-12-12T09:45:23.546845+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:21.477323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:21.477323+0000","last_clean_scrub_stamp":"2023-12-12T09:45:21.477323+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T12:43:03.230562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-12T09:45:23.537430+0000","last_change":"2023-12-12T09:45:23.531234+0000","last_active":"2023-12-12T09:45:23.537430+0000","last_peered":"2023-12-12T09:45:23.537430+0000","last_clean":"2023-12-12T09:45:23.537430+0000","last_became_active":"2023-12-12T09:45:23.530849+0000","last_became_peered":"2023-12-12T09:45:23.530849+0000","last_unstale":"2023-12-12T09:45:23.537430+0000","last_undegraded":"2023-12-12T09:45:23.537430+0000","last_fullsized":"2023-12-12T09:45:23.537430+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_clean_scrub_stamp":"2023-12-12T09:45:22.493994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T17:58:31.519111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.e","version":"53'2","reported_seq":13,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-12T09:45:23.536329+0000","last_change":"2023-12-12T09:45:22.535653+0000","last_active":"2023-12-12T09:45:23.536329+0000","last_peered":"2023-12-12T09:45:23.536329+0000","last_clean":"2023-12-12T09:45:23.536329+0000","last_became_active":"2023-12-12T09:45:22.534893+0000","last_became_peered":"2023-12-12T09:45:22.534893+0000","last_unstale":"2023-12-12T09:45:23.536329+0000","last_undegraded":"2023-12-12T09:45:23.536329+0000","last_fullsized":"2023-12-12T09:45:23.536329+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:21.477323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:21.477323+0000","last_clean_scrub_stamp":"2023-12-12T09:45:21.477323+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T13:07:07.278574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-12T09:45:23.542070+0000","last_change":"2023-12-12T09:45:23.539711+0000","last_active":"2023-12-12T09:45:23.542070+0000","last_peered":"2023-12-12T09:45:23.542070+0000","last_clean":"2023-12-12T09:45:23.542070+0000","last_became_active":"2023-12-12T09:45:23.539296+0000","last_became_peered":"2023-12-12T09:45:23.539296+0000","last_unstale":"2023-12-12T09:45:23.542070+0000","last_undegraded":"2023-12-12T09:45:23.542070+0000","last_fullsized":"2023-12-12T09:45:23.542070+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_clean_scrub_stamp":"2023-12-12T09:45:22.493994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T12:19:37.793666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"53'1","reported_seq":12,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-12T09:45:23.557284+0000","last_change":"2023-12-12T09:45:22.540703+0000","last_active":"2023-12-12T09:45:23.557284+0000","last_peered":"2023-12-12T09:45:23.557284+0000","last_clean":"2023-12-12T09:45:23.557284+0000","last_became_active":"2023-12-12T09:45:22.540383+0000","last_became_peered":"2023-12-12T09:45:22.540383+0000","last_unstale":"2023-12-12T09:45:23.557284+0000","last_undegraded":"2023-12-12T09:45:23.557284+0000","last_fullsized":"2023-12-12T09:45:23.557284+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:21.477323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:21.477323+0000","last_clean_scrub_stamp":"2023-12-12T09:45:21.477323+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T20:27:08.945803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-12T09:45:23.559296+0000","last_change":"2023-12-12T09:45:23.558032+0000","last_active":"2023-12-12T09:45:23.559296+0000","last_peered":"2023-12-12T09:45:23.559296+0000","last_clean":"2023-12-12T09:45:23.559296+0000","last_became_active":"2023-12-12T09:45:23.557676+0000","last_became_peered":"2023-12-12T09:45:23.557676+0000","last_unstale":"2023-12-12T09:45:23.559296+0000","last_undegraded":"2023-12-12T09:45:23.559296+0000","last_fullsized":"2023-12-12T09:45:23.559296+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_clean_scrub_stamp":"2023-12-12T09:45:22.493994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T15:49:16.147997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-12T09:45:23.520645+0000","last_change":"2023-12-12T09:45:22.533152+0000","last_active":"2023-12-12T09:45:23.520645+0000","last_peered":"2023-12-12T09:45:23.520645+0000","last_clean":"2023-12-12T09:45:23.520645+0000","last_became_active":"2023-12-12T09:45:22.532826+0000","last_became_peered":"2023-12-12T09:45:22.532826+0000","last_unstale":"2023-12-12T09:45:23.520645+0000","last_undegraded":"2023-12-12T09:45:23.520645+0000","last_fullsized":"2023-12-12T09:45:23.520645+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:21.477323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:21.477323+0000","last_clean_scrub_stamp":"2023-12-12T09:45:21.477323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T15:15:37.432050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-12T09:45:23.544249+0000","last_change":"2023-12-12T09:45:23.542634+0000","last_active":"2023-12-12T09:45:23.544249+0000","last_peered":"2023-12-12T09:45:23.544249+0000","last_clean":"2023-12-12T09:45:23.544249+0000","last_became_active":"2023-12-12T09:45:23.542138+0000","last_became_peered":"2023-12-12T09:45:23.542138+0000","last_unstale":"2023-12-12T09:45:23.544249+0000","last_undegraded":"2023-12-12T09:45:23.544249+0000","last_fullsized":"2023-12-12T09:45:23.544249+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_clean_scrub_stamp":"2023-12-12T09:45:22.493994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T15:31:33.286934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.b","version":"53'2","reported_seq":13,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-12T09:45:23.542454+0000","last_change":"2023-12-12T09:45:22.544938+0000","last_active":"2023-12-12T09:45:23.542454+0000","last_peered":"2023-12-12T09:45:23.542454+0000","last_clean":"2023-12-12T09:45:23.542454+0000","last_became_active":"2023-12-12T09:45:22.544532+0000","last_became_peered":"2023-12-12T09:45:22.544532+0000","last_unstale":"2023-12-12T09:45:23.542454+0000","last_undegraded":"2023-12-12T09:45:23.542454+0000","last_fullsized":"2023-12-12T09:45:23.542454+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:21.477323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:21.477323+0000","last_clean_scrub_stamp":"2023-12-12T09:45:21.477323+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T17:50:24.664842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-12T09:45:23.555807+0000","last_change":"2023-12-12T09:45:23.551020+0000","last_active":"2023-12-12T09:45:23.555807+0000","last_peered":"2023-12-12T09:45:23.555807+0000","last_clean":"2023-12-12T09:45:23.555807+0000","last_became_active":"2023-12-12T09:45:23.550753+0000","last_became_peered":"2023-12-12T09:45:23.550753+0000","last_unstale":"2023-12-12T09:45:23.555807+0000","last_undegraded":"2023-12-12T09:45:23.555807+0000","last_fullsized":"2023-12-12T09:45:23.555807+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_clean_scrub_stamp":"2023-12-12T09:45:22.493994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T19:19:48.405194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-12T09:45:23.513839+0000","last_change":"2023-12-12T09:45:22.532615+0000","last_active":"2023-12-12T09:45:23.513839+0000","last_peered":"2023-12-12T09:45:23.513839+0000","last_clean":"2023-12-12T09:45:23.513839+0000","last_became_active":"2023-12-12T09:45:22.530254+0000","last_became_peered":"2023-12-12T09:45:22.530254+0000","last_unstale":"2023-12-12T09:45:23.513839+0000","last_undegraded":"2023-12-12T09:45:23.513839+0000","last_fullsized":"2023-12-12T09:45:23.513839+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:21.477323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:21.477323+0000","last_clean_scrub_stamp":"2023-12-12T09:45:21.477323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T15:07:46.103446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-12T09:45:23.558086+0000","last_change":"2023-12-12T09:45:23.552576+0000","last_active":"2023-12-12T09:45:23.558086+0000","last_peered":"2023-12-12T09:45:23.558086+0000","last_clean":"2023-12-12T09:45:23.558086+0000","last_became_active":"2023-12-12T09:45:23.552159+0000","last_became_peered":"2023-12-12T09:45:23.552159+0000","last_unstale":"2023-12-12T09:45:23.558086+0000","last_undegraded":"2023-12-12T09:45:23.558086+0000","last_fullsized":"2023-12-12T09:45:23.558086+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_clean_scrub_stamp":"2023-12-12T09:45:22.493994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T15:49:16.147997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-12T09:45:23.521947+0000","last_change":"2023-12-12T09:45:22.529781+0000","last_active":"2023-12-12T09:45:23.521947+0000","last_peered":"2023-12-12T09:45:23.521947+0000","last_clean":"2023-12-12T09:45:23.521947+0000","last_became_active":"2023-12-12T09:45:22.529493+0000","last_became_peered":"2023-12-12T09:45:22.529493+0000","last_unstale":"2023-12-12T09:45:23.521947+0000","last_undegraded":"2023-12-12T09:45:23.521947+0000","last_fullsized":"2023-12-12T09:45:23.521947+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:21.477323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:21.477323+0000","last_clean_scrub_stamp":"2023-12-12T09:45:21.477323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T19:01:49.506238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-12T09:45:23.534601+0000","last_change":"2023-12-12T09:45:23.528110+0000","last_active":"2023-12-12T09:45:23.534601+0000","last_peered":"2023-12-12T09:45:23.534601+0000","last_clean":"2023-12-12T09:45:23.534601+0000","last_became_active":"2023-12-12T09:45:23.527594+0000","last_became_peered":"2023-12-12T09:45:23.527594+0000","last_unstale":"2023-12-12T09:45:23.534601+0000","last_undegraded":"2023-12-12T09:45:23.534601+0000","last_fullsized":"2023-12-12T09:45:23.534601+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_clean_scrub_stamp":"2023-12-12T09:45:22.493994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T16:23:30.104791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"53'2","reported_seq":13,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-12T09:45:23.551304+0000","last_change":"2023-12-12T09:45:22.530462+0000","last_active":"2023-12-12T09:45:23.551304+0000","last_peered":"2023-12-12T09:45:23.551304+0000","last_clean":"2023-12-12T09:45:23.551304+0000","last_became_active":"2023-12-12T09:45:22.529388+0000","last_became_peered":"2023-12-12T09:45:22.529388+0000","last_unstale":"2023-12-12T09:45:23.551304+0000","last_undegraded":"2023-12-12T09:45:23.551304+0000","last_fullsized":"2023-12-12T09:45:23.551304+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:21.477323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:21.477323+0000","last_clean_scrub_stamp":"2023-12-12T09:45:21.477323+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T13:28:37.770730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-12T09:45:23.556236+0000","last_change":"2023-12-12T09:45:23.552672+0000","last_active":"2023-12-12T09:45:23.556236+0000","last_peered":"2023-12-12T09:45:23.556236+0000","last_clean":"2023-12-12T09:45:23.556236+0000","last_became_active":"2023-12-12T09:45:23.548550+0000","last_became_peered":"2023-12-12T09:45:23.548550+0000","last_unstale":"2023-12-12T09:45:23.556236+0000","last_undegraded":"2023-12-12T09:45:23.556236+0000","last_fullsized":"2023-12-12T09:45:23.556236+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_clean_scrub_stamp":"2023-12-12T09:45:22.493994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T15:49:16.147997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-12T09:45:23.522519+0000","last_change":"2023-12-12T09:45:22.532022+0000","last_active":"2023-12-12T09:45:23.522519+0000","last_peered":"2023-12-12T09:45:23.522519+0000","last_clean":"2023-12-12T09:45:23.522519+0000","last_became_active":"2023-12-12T09:45:22.530250+0000","last_became_peered":"2023-12-12T09:45:22.530250+0000","last_unstale":"2023-12-12T09:45:23.522519+0000","last_undegraded":"2023-12-12T09:45:23.522519+0000","last_fullsized":"2023-12-12T09:45:23.522519+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:21.477323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:21.477323+0000","last_clean_scrub_stamp":"2023-12-12T09:45:21.477323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T17:31:23.246712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-12T09:45:23.556123+0000","last_change":"2023-12-12T09:45:23.549497+0000","last_active":"2023-12-12T09:45:23.556123+0000","last_peered":"2023-12-12T09:45:23.556123+0000","last_clean":"2023-12-12T09:45:23.556123+0000","last_became_active":"2023-12-12T09:45:23.549188+0000","last_became_peered":"2023-12-12T09:45:23.549188+0000","last_unstale":"2023-12-12T09:45:23.556123+0000","last_undegraded":"2023-12-12T09:45:23.556123+0000","last_fullsized":"2023-12-12T09:45:23.556123+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_clean_scrub_stamp":"2023-12-12T09:45:22.493994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T18:05:50.089314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-12T09:45:23.517613+0000","last_change":"2023-12-12T09:45:22.532250+0000","last_active":"2023-12-12T09:45:23.517613+0000","last_peered":"2023-12-12T09:45:23.517613+0000","last_clean":"2023-12-12T09:45:23.517613+0000","last_became_active":"2023-12-12T09:45:22.531649+0000","last_became_peered":"2023-12-12T09:45:22.531649+0000","last_unstale":"2023-12-12T09:45:23.517613+0000","last_undegraded":"2023-12-12T09:45:23.517613+0000","last_fullsized":"2023-12-12T09:45:23.517613+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:21.477323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:21.477323+0000","last_clean_scrub_stamp":"2023-12-12T09:45:21.477323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T13:38:45.393988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-12T09:45:23.552155+0000","last_change":"2023-12-12T09:45:23.542523+0000","last_active":"2023-12-12T09:45:23.552155+0000","last_peered":"2023-12-12T09:45:23.552155+0000","last_clean":"2023-12-12T09:45:23.552155+0000","last_became_active":"2023-12-12T09:45:23.541977+0000","last_became_peered":"2023-12-12T09:45:23.541977+0000","last_unstale":"2023-12-12T09:45:23.552155+0000","last_undegraded":"2023-12-12T09:45:23.552155+0000","last_fullsized":"2023-12-12T09:45:23.552155+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_clean_scrub_stamp":"2023-12-12T09:45:22.493994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T17:58:31.519111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-12T09:45:23.523604+0000","last_change":"2023-12-12T09:45:22.545221+0000","last_active":"2023-12-12T09:45:23.523604+0000","last_peered":"2023-12-12T09:45:23.523604+0000","last_clean":"2023-12-12T09:45:23.523604+0000","last_became_active":"2023-12-12T09:45:22.544683+0000","last_became_peered":"2023-12-12T09:45:22.544683+0000","last_unstale":"2023-12-12T09:45:23.523604+0000","last_undegraded":"2023-12-12T09:45:23.523604+0000","last_fullsized":"2023-12-12T09:45:23.523604+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:21.477323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:21.477323+0000","last_clean_scrub_stamp":"2023-12-12T09:45:21.477323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T21:23:16.895410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-12T09:45:23.545412+0000","last_change":"2023-12-12T09:45:23.544018+0000","last_active":"2023-12-12T09:45:23.545412+0000","last_peered":"2023-12-12T09:45:23.545412+0000","last_clean":"2023-12-12T09:45:23.545412+0000","last_became_active":"2023-12-12T09:45:23.543769+0000","last_became_peered":"2023-12-12T09:45:23.543769+0000","last_unstale":"2023-12-12T09:45:23.545412+0000","last_undegraded":"2023-12-12T09:45:23.545412+0000","last_fullsized":"2023-12-12T09:45:23.545412+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_clean_scrub_stamp":"2023-12-12T09:45:22.493994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T16:08:55.346248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-12T09:45:23.513808+0000","last_change":"2023-12-12T09:45:22.536839+0000","last_active":"2023-12-12T09:45:23.513808+0000","last_peered":"2023-12-12T09:45:23.513808+0000","last_clean":"2023-12-12T09:45:23.513808+0000","last_became_active":"2023-12-12T09:45:22.536573+0000","last_became_peered":"2023-12-12T09:45:22.536573+0000","last_unstale":"2023-12-12T09:45:23.513808+0000","last_undegraded":"2023-12-12T09:45:23.513808+0000","last_fullsized":"2023-12-12T09:45:23.513808+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:21.477323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:21.477323+0000","last_clean_scrub_stamp":"2023-12-12T09:45:21.477323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T15:17:10.229273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-12T09:45:23.555952+0000","last_change":"2023-12-12T09:45:23.549992+0000","last_active":"2023-12-12T09:45:23.555952+0000","last_peered":"2023-12-12T09:45:23.555952+0000","last_clean":"2023-12-12T09:45:23.555952+0000","last_became_active":"2023-12-12T09:45:23.549317+0000","last_became_peered":"2023-12-12T09:45:23.549317+0000","last_unstale":"2023-12-12T09:45:23.555952+0000","last_undegraded":"2023-12-12T09:45:23.555952+0000","last_fullsized":"2023-12-12T09:45:23.555952+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_clean_scrub_stamp":"2023-12-12T09:45:22.493994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T17:31:24.263383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-12T09:45:23.535707+0000","last_change":"2023-12-12T09:45:22.540030+0000","last_active":"2023-12-12T09:45:23.535707+0000","last_peered":"2023-12-12T09:45:23.535707+0000","last_clean":"2023-12-12T09:45:23.535707+0000","last_became_active":"2023-12-12T09:45:22.539590+0000","last_became_peered":"2023-12-12T09:45:22.539590+0000","last_unstale":"2023-12-12T09:45:23.535707+0000","last_undegraded":"2023-12-12T09:45:23.535707+0000","last_fullsized":"2023-12-12T09:45:23.535707+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:21.477323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:21.477323+0000","last_clean_scrub_stamp":"2023-12-12T09:45:21.477323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T15:15:37.432050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-12T09:45:23.547219+0000","last_change":"2023-12-12T09:45:23.545375+0000","last_active":"2023-12-12T09:45:23.547219+0000","last_peered":"2023-12-12T09:45:23.547219+0000","last_clean":"2023-12-12T09:45:23.547219+0000","last_became_active":"2023-12-12T09:45:23.544964+0000","last_became_peered":"2023-12-12T09:45:23.544964+0000","last_unstale":"2023-12-12T09:45:23.547219+0000","last_undegraded":"2023-12-12T09:45:23.547219+0000","last_fullsized":"2023-12-12T09:45:23.547219+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_clean_scrub_stamp":"2023-12-12T09:45:22.493994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T21:42:01.335580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-12T09:45:23.513241+0000","last_change":"2023-12-12T09:45:22.517716+0000","last_active":"2023-12-12T09:45:23.513241+0000","last_peered":"2023-12-12T09:45:23.513241+0000","last_clean":"2023-12-12T09:45:23.513241+0000","last_became_active":"2023-12-12T09:45:22.517234+0000","last_became_peered":"2023-12-12T09:45:22.517234+0000","last_unstale":"2023-12-12T09:45:23.513241+0000","last_undegraded":"2023-12-12T09:45:23.513241+0000","last_fullsized":"2023-12-12T09:45:23.513241+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:21.477323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:21.477323+0000","last_clean_scrub_stamp":"2023-12-12T09:45:21.477323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T13:38:45.393988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-12T09:45:23.539672+0000","last_change":"2023-12-12T09:45:23.538139+0000","last_active":"2023-12-12T09:45:23.539672+0000","last_peered":"2023-12-12T09:45:23.539672+0000","last_clean":"2023-12-12T09:45:23.539672+0000","last_became_active":"2023-12-12T09:45:23.537879+0000","last_became_peered":"2023-12-12T09:45:23.537879+0000","last_unstale":"2023-12-12T09:45:23.539672+0000","last_undegraded":"2023-12-12T09:45:23.539672+0000","last_fullsized":"2023-12-12T09:45:23.539672+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_clean_scrub_stamp":"2023-12-12T09:45:22.493994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T13:07:08.295245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-12T09:45:23.530997+0000","last_change":"2023-12-12T09:45:22.533709+0000","last_active":"2023-12-12T09:45:23.530997+0000","last_peered":"2023-12-12T09:45:23.530997+0000","last_clean":"2023-12-12T09:45:23.530997+0000","last_became_active":"2023-12-12T09:45:22.533228+0000","last_became_peered":"2023-12-12T09:45:22.533228+0000","last_unstale":"2023-12-12T09:45:23.530997+0000","last_undegraded":"2023-12-12T09:45:23.530997+0000","last_fullsized":"2023-12-12T09:45:23.530997+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:21.477323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:21.477323+0000","last_clean_scrub_stamp":"2023-12-12T09:45:21.477323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T14:11:53.124266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-12T09:45:23.554144+0000","last_change":"2023-12-12T09:45:23.551562+0000","last_active":"2023-12-12T09:45:23.554144+0000","last_peered":"2023-12-12T09:45:23.554144+0000","last_clean":"2023-12-12T09:45:23.554144+0000","last_became_active":"2023-12-12T09:45:23.551292+0000","last_became_peered":"2023-12-12T09:45:23.551292+0000","last_unstale":"2023-12-12T09:45:23.554144+0000","last_undegraded":"2023-12-12T09:45:23.554144+0000","last_fullsized":"2023-12-12T09:45:23.554144+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_clean_scrub_stamp":"2023-12-12T09:45:22.493994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T16:46:32.423265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-12T09:45:23.518470+0000","last_change":"2023-12-12T09:45:22.537353+0000","last_active":"2023-12-12T09:45:23.518470+0000","last_peered":"2023-12-12T09:45:23.518470+0000","last_clean":"2023-12-12T09:45:23.518470+0000","last_became_active":"2023-12-12T09:45:22.536855+0000","last_became_peered":"2023-12-12T09:45:22.536855+0000","last_unstale":"2023-12-12T09:45:23.518470+0000","last_undegraded":"2023-12-12T09:45:23.518470+0000","last_fullsized":"2023-12-12T09:45:23.518470+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:21.477323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:21.477323+0000","last_clean_scrub_stamp":"2023-12-12T09:45:21.477323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T15:17:10.229273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":193,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-12T09:45:22.540331+0000","last_change":"2023-12-12T09:43:17.203315+0000","last_active":"2023-12-12T09:45:22.540331+0000","last_peered":"2023-12-12T09:45:22.540331+0000","last_clean":"2023-12-12T09:45:22.540331+0000","last_became_active":"2023-12-12T09:43:17.200779+0000","last_became_peered":"2023-12-12T09:43:17.200779+0000","last_unstale":"2023-12-12T09:45:22.540331+0000","last_undegraded":"2023-12-12T09:45:22.540331+0000","last_fullsized":"2023-12-12T09:45:22.540331+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:43:15.931922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:43:15.931922+0000","last_clean_scrub_stamp":"2023-12-12T09:43:15.931922+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T21:42:10.929640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":64844,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574878,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27720,"kb_used_data":692,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344120,"statfs":{"total":96636764160,"available":96608378880,"internally_reserved":0,"allocated":708608,"data_stored":859754,"data_compressed":32422,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 12 09:45:16 2023","interfaces":[{"interface":"back","average":{"1min":1.0700000000000001,"5min":1.0129999999999999,"15min":1.0029999999999999},"min":{"1min":0.64800000000000002,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.607,"5min":1.8089999999999999,"15min":1.8089999999999999},"last":0.99399999999999999},{"interface":"front","average":{"1min":1.135,"5min":0.99399999999999999,"15min":0.96999999999999997},"min":{"1min":0.72099999999999997,"5min":0.66300000000000003,"15min":0.66300000000000003},"max":{"1min":1.619,"5min":1.619,"15min":1.619},"last":1.5980000000000001}]},{"osd":1,"last update":"Tue Dec 12 09:45:16 2023","interfaces":[{"interface":"back","average":{"1min":1.149,"5min":1.1879999999999999,"15min":1.194},"min":{"1min":0.83799999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"max":{"1min":1.5629999999999999,"5min":1.7729999999999999,"15min":1.7729999999999999},"last":1.4610000000000001},{"interface":"front","average":{"1min":1.1419999999999999,"5min":1.2010000000000001,"15min":1.2110000000000001},"min":{"1min":0.77000000000000002,"5min":0.71499999999999997,"15min":0.71499999999999997},"max":{"1min":1.542,"5min":3.1150000000000002,"15min":3.1150000000000002},"last":1.1619999999999999}]},{"osd":2,"last update":"Tue Dec 12 09:45:16 2023","interfaces":[{"interface":"back","average":{"1min":1.1379999999999999,"5min":1.2370000000000001,"15min":1.2529999999999999},"min":{"1min":0.80100000000000005,"5min":0.77700000000000002,"15min":0.77700000000000002},"max":{"1min":1.5449999999999999,"5min":2.2050000000000001,"15min":2.2050000000000001},"last":1.3720000000000001},{"interface":"front","average":{"1min":1.141,"5min":1.224,"15min":1.238},"min":{"1min":0.81399999999999995,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.4890000000000001,"5min":3.2759999999999998,"15min":3.2759999999999998},"last":1.2090000000000001}]},{"osd":3,"last update":"Tue Dec 12 09:45:16 2023","interfaces":[{"interface":"back","average":{"1min":1.1930000000000001,"5min":1.292,"15min":1.3080000000000001},"min":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"max":{"1min":1.587,"5min":3.1819999999999999,"15min":3.1819999999999999},"last":1.117},{"interface":"front","average":{"1min":1.2210000000000001,"5min":1.28,"15min":1.29},"min":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"max":{"1min":1.587,"5min":1.8740000000000001,"15min":1.8740000000000001},"last":1.3049999999999999}]},{"osd":4,"last update":"Tue Dec 12 09:45:16 2023","interfaces":[{"interface":"back","average":{"1min":1.2450000000000001,"5min":1.3300000000000001,"15min":1.3440000000000001},"min":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.647,"5min":2.5529999999999999,"15min":2.5529999999999999},"last":1.4079999999999999},{"interface":"front","average":{"1min":1.2290000000000001,"5min":1.409,"15min":1.4390000000000001},"min":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"max":{"1min":1.6319999999999999,"5min":2.351,"15min":2.351},"last":1.258}]},{"osd":5,"last update":"Tue Dec 12 09:45:16 2023","interfaces":[{"interface":"back","average":{"1min":1.294,"5min":1.3260000000000001,"15min":1.3320000000000001},"min":{"1min":1.0649999999999999,"5min":0.84499999999999997,"15min":0.84499999999999997},"max":{"1min":1.575,"5min":1.9610000000000001,"15min":1.9610000000000001},"last":0.93300000000000005},{"interface":"front","average":{"1min":1.389,"5min":1.5069999999999999,"15min":1.5269999999999999},"min":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":1.6950000000000001,"5min":2.4159999999999999,"15min":2.4159999999999999},"last":1.514}]},{"osd":6,"last update":"Tue Dec 12 09:45:16 2023","interfaces":[{"interface":"back","average":{"1min":1.427,"5min":1.419,"15min":1.417},"min":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"max":{"1min":1.821,"5min":2.0510000000000002,"15min":2.0510000000000002},"last":1.0409999999999999},{"interface":"front","average":{"1min":1.4850000000000001,"5min":1.605,"15min":1.625},"min":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"max":{"1min":1.821,"5min":2.5800000000000001,"15min":2.5800000000000001},"last":1.571}]}]},{"osd":6,"up_from":13,"seq":55834574876,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27644,"kb_used_data":620,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344196,"statfs":{"total":96636764160,"available":96608456704,"internally_reserved":0,"allocated":634880,"data_stored":269226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 12 09:45:15 2023","interfaces":[{"interface":"back","average":{"1min":0.96799999999999997,"5min":1.1479999999999999,"15min":1.1779999999999999},"min":{"1min":0.63200000000000001,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":1.597,"5min":3.6429999999999998,"15min":3.6429999999999998},"last":1.0820000000000001},{"interface":"front","average":{"1min":1.119,"5min":1.079,"15min":1.073},"min":{"1min":0.58499999999999996,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.871,"5min":2.6059999999999999,"15min":2.6059999999999999},"last":0.60099999999999998}]},{"osd":1,"last update":"Tue Dec 12 09:45:15 2023","interfaces":[{"interface":"back","average":{"1min":1.1639999999999999,"5min":1.0820000000000001,"15min":1.0680000000000001},"min":{"1min":0.80400000000000005,"5min":0.69499999999999995,"15min":0.69499999999999995},"max":{"1min":1.482,"5min":2.0169999999999999,"15min":2.0169999999999999},"last":0.69199999999999995},{"interface":"front","average":{"1min":1.1719999999999999,"5min":1.1950000000000001,"15min":1.1990000000000001},"min":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"max":{"1min":1.5700000000000001,"5min":1.7,"15min":1.7},"last":0.93700000000000006}]},{"osd":2,"last update":"Tue Dec 12 09:45:15 2023","interfaces":[{"interface":"back","average":{"1min":1.149,"5min":1.218,"15min":1.23},"min":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"max":{"1min":1.72,"5min":1.804,"15min":1.804},"last":1.2809999999999999},{"interface":"front","average":{"1min":1.1479999999999999,"5min":1.28,"15min":1.302},"min":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"max":{"1min":1.5840000000000001,"5min":2.2160000000000002,"15min":2.2160000000000002},"last":0.98399999999999999}]},{"osd":3,"last update":"Tue Dec 12 09:45:15 2023","interfaces":[{"interface":"back","average":{"1min":1.2090000000000001,"5min":1.216,"15min":1.2170000000000001},"min":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"max":{"1min":1.661,"5min":2.665,"15min":2.665},"last":1.1799999999999999},{"interface":"front","average":{"1min":1.111,"5min":1.2070000000000001,"15min":1.2230000000000001},"min":{"1min":0.72899999999999998,"5min":0.65700000000000003,"15min":0.65700000000000003},"max":{"1min":1.569,"5min":1.8620000000000001,"15min":1.8620000000000001},"last":0.82399999999999995}]},{"osd":4,"last update":"Tue Dec 12 09:45:15 2023","interfaces":[{"interface":"back","average":{"1min":1.276,"5min":1.2749999999999999,"15min":1.2749999999999999},"min":{"1min":0.66100000000000003,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":1.778,"5min":2.0310000000000001,"15min":2.0310000000000001},"last":1.415},{"interface":"front","average":{"1min":1.3939999999999999,"5min":1.4039999999999999,"15min":1.4059999999999999},"min":{"1min":0.753,"5min":0.66200000000000003,"15min":0.66200000000000003},"max":{"1min":1.8149999999999999,"5min":2.2799999999999998,"15min":2.2799999999999998},"last":1.373}]},{"osd":5,"last update":"Tue Dec 12 09:45:15 2023","interfaces":[{"interface":"back","average":{"1min":1.296,"5min":1.4119999999999999,"15min":1.431},"min":{"1min":0.68600000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.766,"5min":2.1739999999999999,"15min":2.1739999999999999},"last":1.133},{"interface":"front","average":{"1min":1.4730000000000001,"5min":1.476,"15min":1.476},"min":{"1min":0.99399999999999999,"5min":0.80100000000000005,"15min":0.80100000000000005},"max":{"1min":1.909,"5min":1.929,"15min":1.929},"last":1.524}]},{"osd":7,"last update":"Tue Dec 12 09:45:15 2023","interfaces":[{"interface":"back","average":{"1min":1.4059999999999999,"5min":1.488,"15min":1.502},"min":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.6859999999999999,"5min":1.994,"15min":1.994},"last":1.46},{"interface":"front","average":{"1min":1.3779999999999999,"5min":1.506,"15min":1.528},"min":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"max":{"1min":1.839,"5min":2.0800000000000001,"15min":2.0800000000000001},"last":1.0389999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574876,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27652,"kb_used_data":628,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344188,"statfs":{"total":96636764160,"available":96608448512,"internally_reserved":0,"allocated":643072,"data_stored":269878,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 12 09:45:16 2023","interfaces":[{"interface":"back","average":{"1min":1.022,"5min":1.02,"15min":1.02},"min":{"1min":0.65600000000000003,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.7310000000000001,"5min":1.7310000000000001,"15min":1.7310000000000001},"last":0.81799999999999995},{"interface":"front","average":{"1min":1.04,"5min":1.1120000000000001,"15min":1.1240000000000001},"min":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.595,"5min":1.595,"15min":1.595},"last":0.75800000000000001}]},{"osd":1,"last update":"Tue Dec 12 09:45:16 2023","interfaces":[{"interface":"back","average":{"1min":1,"5min":1.1799999999999999,"15min":1.21},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.756,"5min":1.756,"15min":1.756},"last":0.999},{"interface":"front","average":{"1min":1.071,"5min":1.087,"15min":1.0900000000000001},"min":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"max":{"1min":1.5549999999999999,"5min":1.5840000000000001,"15min":1.5840000000000001},"last":1.0429999999999999}]},{"osd":2,"last update":"Tue Dec 12 09:45:16 2023","interfaces":[{"interface":"back","average":{"1min":1.1619999999999999,"5min":1.286,"15min":1.306},"min":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"max":{"1min":1.536,"5min":1.7889999999999999,"15min":1.7889999999999999},"last":1.5509999999999999},{"interface":"front","average":{"1min":1.157,"5min":1.3680000000000001,"15min":1.403},"min":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"max":{"1min":1.5369999999999999,"5min":2.1600000000000001,"15min":2.1600000000000001},"last":0.90000000000000002}]},{"osd":3,"last update":"Tue Dec 12 09:45:16 2023","interfaces":[{"interface":"back","average":{"1min":1.202,"5min":1.337,"15min":1.359},"min":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"max":{"1min":1.6950000000000001,"5min":2.1499999999999999,"15min":2.1499999999999999},"last":1.2889999999999999},{"interface":"front","average":{"1min":1.2390000000000001,"5min":1.4410000000000001,"15min":1.4750000000000001},"min":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"max":{"1min":1.6060000000000001,"5min":1.8939999999999999,"15min":1.8939999999999999},"last":1.679}]},{"osd":4,"last update":"Tue Dec 12 09:45:16 2023","interfaces":[{"interface":"back","average":{"1min":1.3100000000000001,"5min":1.454,"15min":1.478},"min":{"1min":0.746,"5min":0.746,"15min":0.746},"max":{"1min":1.841,"5min":2.391,"15min":2.391},"last":1.6479999999999999},{"interface":"front","average":{"1min":1.4470000000000001,"5min":1.5589999999999999,"15min":1.5780000000000001},"min":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"max":{"1min":1.958,"5min":2.5430000000000001,"15min":2.5430000000000001},"last":1.8520000000000001}]},{"osd":6,"last update":"Tue Dec 12 09:45:16 2023","interfaces":[{"interface":"back","average":{"1min":1.3320000000000001,"5min":1.5429999999999999,"15min":1.5780000000000001},"min":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.7230000000000001,"5min":2.0840000000000001,"15min":2.0840000000000001},"last":1.782},{"interface":"front","average":{"1min":1.373,"5min":1.579,"15min":1.613},"min":{"1min":0.627,"5min":0.627,"15min":0.627},"max":{"1min":1.9970000000000001,"5min":2.306,"15min":2.306},"last":1.1850000000000001}]},{"osd":7,"last update":"Tue Dec 12 09:45:16 2023","interfaces":[{"interface":"back","average":{"1min":1.538,"5min":1.7350000000000001,"15min":1.768},"min":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"max":{"1min":2.2469999999999999,"5min":2.6880000000000002,"15min":2.6880000000000002},"last":1.996},{"interface":"front","average":{"1min":1.4550000000000001,"5min":1.6890000000000001,"15min":1.728},"min":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"max":{"1min":1.8260000000000001,"5min":2.3410000000000002,"15min":2.3410000000000002},"last":1.956}]}]},{"osd":4,"up_from":13,"seq":55834574878,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27660,"kb_used_data":632,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344180,"statfs":{"total":96636764160,"available":96608440320,"internally_reserved":0,"allocated":647168,"data_stored":270838,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 12 09:45:15 2023","interfaces":[{"interface":"back","average":{"1min":1.0129999999999999,"5min":1.046,"15min":1.052},"min":{"1min":0.65100000000000002,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":1.7010000000000001,"5min":1.7010000000000001,"15min":1.7010000000000001},"last":1.417},{"interface":"front","average":{"1min":0.98899999999999999,"5min":1.0409999999999999,"15min":1.05},"min":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":1.3080000000000001,"5min":1.492,"15min":1.492},"last":1.3700000000000001}]},{"osd":1,"last update":"Tue Dec 12 09:45:15 2023","interfaces":[{"interface":"back","average":{"1min":1.0580000000000001,"5min":1.046,"15min":1.044},"min":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":1.468,"5min":1.468,"15min":1.468},"last":1.496},{"interface":"front","average":{"1min":1.143,"5min":1.173,"15min":1.1779999999999999},"min":{"1min":0.76600000000000001,"5min":0.73699999999999999,"15min":0.73699999999999999},"max":{"1min":1.599,"5min":1.8720000000000001,"15min":1.8720000000000001},"last":1.526}]},{"osd":2,"last update":"Tue Dec 12 09:45:15 2023","interfaces":[{"interface":"back","average":{"1min":1.145,"5min":1.1240000000000001,"15min":1.1200000000000001},"min":{"1min":0.82699999999999996,"5min":0.71499999999999997,"15min":0.71499999999999997},"max":{"1min":1.4590000000000001,"5min":1.4590000000000001,"15min":1.4590000000000001},"last":1.0780000000000001},{"interface":"front","average":{"1min":1.238,"5min":1.282,"15min":1.29},"min":{"1min":0.76400000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"max":{"1min":1.675,"5min":2.1640000000000001,"15min":2.1640000000000001},"last":1.1379999999999999}]},{"osd":3,"last update":"Tue Dec 12 09:45:15 2023","interfaces":[{"interface":"back","average":{"1min":1.2569999999999999,"5min":1.2130000000000001,"15min":1.206},"min":{"1min":0.89700000000000002,"5min":0.83399999999999996,"15min":0.83399999999999996},"max":{"1min":1.52,"5min":1.635,"15min":1.635},"last":1.4530000000000001},{"interface":"front","average":{"1min":1.222,"5min":1.234,"15min":1.236},"min":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"max":{"1min":1.7290000000000001,"5min":2.0499999999999998,"15min":2.0499999999999998},"last":1.2130000000000001}]},{"osd":5,"last update":"Tue Dec 12 09:45:15 2023","interfaces":[{"interface":"back","average":{"1min":1.272,"5min":1.4279999999999999,"15min":1.454},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.794,"5min":2.3159999999999998,"15min":2.3159999999999998},"last":1.323},{"interface":"front","average":{"1min":1.361,"5min":1.3520000000000001,"15min":1.3500000000000001},"min":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"max":{"1min":1.978,"5min":2.117,"15min":2.117},"last":1.268}]},{"osd":6,"last update":"Tue Dec 12 09:45:15 2023","interfaces":[{"interface":"back","average":{"1min":1.3180000000000001,"5min":1.3859999999999999,"15min":1.397},"min":{"1min":0.84999999999999998,"5min":0.81200000000000006,"15min":0.81200000000000006},"max":{"1min":1.927,"5min":2.246,"15min":2.246},"last":0.98099999999999998},{"interface":"front","average":{"1min":1.4610000000000001,"5min":1.5309999999999999,"15min":1.5429999999999999},"min":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"max":{"1min":1.917,"5min":2.5099999999999998,"15min":2.5099999999999998},"last":1.6000000000000001}]},{"osd":7,"last update":"Tue Dec 12 09:45:15 2023","interfaces":[{"interface":"back","average":{"1min":1.4630000000000001,"5min":1.496,"15min":1.502},"min":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"max":{"1min":1.9830000000000001,"5min":2.5710000000000002,"15min":2.5710000000000002},"last":1.5609999999999999},{"interface":"front","average":{"1min":1.508,"5min":1.512,"15min":1.512},"min":{"1min":1.0900000000000001,"5min":1.0600000000000001,"15min":1.0600000000000001},"max":{"1min":2.1600000000000001,"5min":2.3919999999999999,"15min":2.3919999999999999},"last":1.389}]}]},{"osd":3,"up_from":13,"seq":55834574876,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27652,"kb_used_data":628,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344188,"statfs":{"total":96636764160,"available":96608448512,"internally_reserved":0,"allocated":643072,"data_stored":269282,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 12 09:45:17 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.873,"15min":0.89900000000000002},"min":{"1min":0.318,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":1.1930000000000001,"5min":1.4830000000000001,"15min":1.4830000000000001},"last":1.2350000000000001},{"interface":"front","average":{"1min":0.71699999999999997,"5min":1.0529999999999999,"15min":1.109},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":1.2370000000000001,"5min":3.3370000000000002,"15min":3.3370000000000002},"last":0.83899999999999997}]},{"osd":1,"last update":"Tue Dec 12 09:45:17 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.88200000000000001,"15min":0.90700000000000003},"min":{"1min":0.48799999999999999,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":1.077,"5min":1.4610000000000001,"15min":1.4610000000000001},"last":1.0249999999999999},{"interface":"front","average":{"1min":0.84099999999999997,"5min":1.0229999999999999,"15min":1.0529999999999999},"min":{"1min":0.52700000000000002,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.6100000000000001,"5min":2.9409999999999998,"15min":2.9409999999999998},"last":1.4750000000000001}]},{"osd":2,"last update":"Tue Dec 12 09:45:17 2023","interfaces":[{"interface":"back","average":{"1min":0.874,"5min":1.1240000000000001,"15min":1.1659999999999999},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.5680000000000001,"5min":2.613,"15min":2.613},"last":0.89600000000000002},{"interface":"front","average":{"1min":0.89800000000000002,"5min":1.127,"15min":1.165},"min":{"1min":0.47199999999999998,"5min":0.437,"15min":0.437},"max":{"1min":1.4390000000000001,"5min":3.0430000000000001,"15min":3.0430000000000001},"last":1.411}]},{"osd":4,"last update":"Tue Dec 12 09:45:17 2023","interfaces":[{"interface":"back","average":{"1min":1.2190000000000001,"5min":1.3500000000000001,"15min":1.3720000000000001},"min":{"1min":0.73399999999999999,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.851,"5min":3.5019999999999998,"15min":3.5019999999999998},"last":0.95899999999999996},{"interface":"front","average":{"1min":1.1439999999999999,"5min":1.415,"15min":1.46},"min":{"1min":0.755,"5min":0.755,"15min":0.755},"max":{"1min":1.593,"5min":2.9889999999999999,"15min":2.9889999999999999},"last":1.103}]},{"osd":5,"last update":"Tue Dec 12 09:45:17 2023","interfaces":[{"interface":"back","average":{"1min":1.254,"5min":1.45,"15min":1.4830000000000001},"min":{"1min":0.73599999999999999,"5min":0.68000000000000005,"15min":0.68000000000000005},"max":{"1min":1.589,"5min":4.2480000000000002,"15min":4.2480000000000002},"last":1.585},{"interface":"front","average":{"1min":1.2090000000000001,"5min":1.5149999999999999,"15min":1.5660000000000001},"min":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"max":{"1min":1.7,"5min":5.5060000000000002,"15min":5.5060000000000002},"last":1.05}]},{"osd":6,"last update":"Tue Dec 12 09:45:17 2023","interfaces":[{"interface":"back","average":{"1min":1.1240000000000001,"5min":1.391,"15min":1.4350000000000001},"min":{"1min":0.79100000000000004,"5min":0.76500000000000001,"15min":0.76500000000000001},"max":{"1min":1.472,"5min":3.1400000000000001,"15min":3.1400000000000001},"last":1.3460000000000001},{"interface":"front","average":{"1min":1.288,"5min":1.4950000000000001,"15min":1.5289999999999999},"min":{"1min":0.70099999999999996,"5min":0.627,"15min":0.627},"max":{"1min":1.694,"5min":4.3179999999999996,"15min":4.3179999999999996},"last":1.5309999999999999}]},{"osd":7,"last update":"Tue Dec 12 09:45:17 2023","interfaces":[{"interface":"back","average":{"1min":1.236,"5min":1.52,"15min":1.5680000000000001},"min":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"max":{"1min":1.6759999999999999,"5min":5.3979999999999997,"15min":5.3979999999999997},"last":1.3009999999999999},{"interface":"front","average":{"1min":1.228,"5min":1.488,"15min":1.532},"min":{"1min":0.75800000000000001,"5min":0.74299999999999999,"15min":0.74299999999999999},"max":{"1min":1.663,"5min":3.4129999999999998,"15min":3.4129999999999998},"last":1.446}]}]},{"osd":2,"up_from":13,"seq":55834574876,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27652,"kb_used_data":628,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344188,"statfs":{"total":96636764160,"available":96608448512,"internally_reserved":0,"allocated":643072,"data_stored":269282,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 12 09:45:16 2023","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.81000000000000005,"15min":0.81599999999999995},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":1.212,"5min":1.458,"15min":1.458},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.84899999999999998,"5min":0.90000000000000002,"15min":0.90800000000000003},"min":{"1min":0.36199999999999999,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":1.623,"5min":1.623,"15min":1.623},"last":1.0509999999999999}]},{"osd":1,"last update":"Tue Dec 12 09:45:16 2023","interfaces":[{"interface":"back","average":{"1min":0.82999999999999996,"5min":0.85699999999999998,"15min":0.86099999999999999},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":1.375,"5min":1.593,"15min":1.593},"last":0.752},{"interface":"front","average":{"1min":0.84099999999999997,"5min":0.877,"15min":0.88300000000000001},"min":{"1min":0.46999999999999997,"5min":0.443,"15min":0.443},"max":{"1min":1.4330000000000001,"5min":1.758,"15min":1.758},"last":0.78500000000000003}]},{"osd":3,"last update":"Tue Dec 12 09:45:16 2023","interfaces":[{"interface":"back","average":{"1min":0.93999999999999995,"5min":1.0329999999999999,"15min":1.0489999999999999},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.343,"5min":1.8879999999999999,"15min":1.8879999999999999},"last":1.276},{"interface":"front","average":{"1min":0.86599999999999999,"5min":0.97999999999999998,"15min":0.999},"min":{"1min":0.46000000000000002,"5min":0.432,"15min":0.432},"max":{"1min":1.4419999999999999,"5min":1.8120000000000001,"15min":1.8120000000000001},"last":0.93300000000000005}]},{"osd":4,"last update":"Tue Dec 12 09:45:16 2023","interfaces":[{"interface":"back","average":{"1min":1.141,"5min":1.2090000000000001,"15min":1.2210000000000001},"min":{"1min":0.69599999999999995,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.3859999999999999,"5min":2.5760000000000001,"15min":2.5760000000000001},"last":0.97699999999999998},{"interface":"front","average":{"1min":1.1870000000000001,"5min":1.3520000000000001,"15min":1.3799999999999999},"min":{"1min":0.79400000000000004,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":2.04,"5min":2.8069999999999999,"15min":2.8069999999999999},"last":1.153}]},{"osd":5,"last update":"Tue Dec 12 09:45:16 2023","interfaces":[{"interface":"back","average":{"1min":1.3260000000000001,"5min":1.3680000000000001,"15min":1.375},"min":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"max":{"1min":1.764,"5min":2.3109999999999999,"15min":2.3109999999999999},"last":1.194},{"interface":"front","average":{"1min":1.196,"5min":1.3200000000000001,"15min":1.3400000000000001},"min":{"1min":0.79400000000000004,"5min":0.627,"15min":0.627},"max":{"1min":1.546,"5min":2.5110000000000001,"15min":2.5110000000000001},"last":0.88700000000000001}]},{"osd":6,"last update":"Tue Dec 12 09:45:16 2023","interfaces":[{"interface":"back","average":{"1min":1.329,"5min":1.415,"15min":1.429},"min":{"1min":0.82499999999999996,"5min":0.69599999999999995,"15min":0.69599999999999995},"max":{"1min":2.6139999999999999,"5min":2.907,"15min":2.907},"last":1.3779999999999999},{"interface":"front","average":{"1min":1.403,"5min":1.423,"15min":1.427},"min":{"1min":0.85099999999999998,"5min":0.82799999999999996,"15min":0.82799999999999996},"max":{"1min":2.6000000000000001,"5min":2.6000000000000001,"15min":2.6000000000000001},"last":1.339}]},{"osd":7,"last update":"Tue Dec 12 09:45:16 2023","interfaces":[{"interface":"back","average":{"1min":1.3049999999999999,"5min":1.4259999999999999,"15min":1.446},"min":{"1min":0.78500000000000003,"5min":0.71599999999999997,"15min":0.71599999999999997},"max":{"1min":2.1339999999999999,"5min":2.3370000000000002,"15min":2.3370000000000002},"last":1.4790000000000001},{"interface":"front","average":{"1min":1.4159999999999999,"5min":1.4930000000000001,"15min":1.506},"min":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"max":{"1min":1.915,"5min":2.488,"15min":2.488},"last":1.3959999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574876,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27644,"kb_used_data":620,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344196,"statfs":{"total":96636764160,"available":96608456704,"internally_reserved":0,"allocated":634880,"data_stored":269226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 12 09:45:16 2023","interfaces":[{"interface":"back","average":{"1min":0.79400000000000004,"5min":0.84299999999999997,"15min":0.85099999999999998},"min":{"1min":0.50800000000000001,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":1.319,"5min":2.794,"15min":2.794},"last":0.99199999999999999},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.84999999999999998,"15min":0.85999999999999999},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":1.167,"5min":2.1379999999999999,"15min":2.1379999999999999},"last":0.91800000000000004}]},{"osd":2,"last update":"Tue Dec 12 09:45:16 2023","interfaces":[{"interface":"back","average":{"1min":0.89200000000000002,"5min":0.96699999999999997,"15min":0.97899999999999998},"min":{"1min":0.437,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":1.5649999999999999,"5min":6.3390000000000004,"15min":6.3390000000000004},"last":0.85799999999999998},{"interface":"front","average":{"1min":0.94299999999999995,"5min":0.96199999999999997,"15min":0.96499999999999997},"min":{"1min":0.53200000000000003,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.5629999999999999,"5min":2.823,"15min":2.823},"last":1.1559999999999999}]},{"osd":3,"last update":"Tue Dec 12 09:45:16 2023","interfaces":[{"interface":"back","average":{"1min":1.0620000000000001,"5min":1.0529999999999999,"15min":1.0509999999999999},"min":{"1min":0.56699999999999995,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":1.6519999999999999,"5min":2.7519999999999998,"15min":2.7519999999999998},"last":1.248},{"interface":"front","average":{"1min":1.018,"5min":1.01,"15min":1.008},"min":{"1min":0.55600000000000005,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":1.8640000000000001,"5min":2.2559999999999998,"15min":2.2559999999999998},"last":1.2050000000000001}]},{"osd":4,"last update":"Tue Dec 12 09:45:16 2023","interfaces":[{"interface":"back","average":{"1min":1.1100000000000001,"5min":1.341,"15min":1.379},"min":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"max":{"1min":1.694,"5min":6.423,"15min":6.423},"last":1.286},{"interface":"front","average":{"1min":1.1899999999999999,"5min":1.1930000000000001,"15min":1.1930000000000001},"min":{"1min":0.80500000000000005,"5min":0.80000000000000004,"15min":0.80000000000000004},"max":{"1min":1.585,"5min":2.2309999999999999,"15min":2.2309999999999999},"last":1.331}]},{"osd":5,"last update":"Tue Dec 12 09:45:16 2023","interfaces":[{"interface":"back","average":{"1min":1.22,"5min":1.417,"15min":1.45},"min":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"max":{"1min":1.8220000000000001,"5min":6.2830000000000004,"15min":6.2830000000000004},"last":1.4970000000000001},{"interface":"front","average":{"1min":1.2729999999999999,"5min":1.3540000000000001,"15min":1.3680000000000001},"min":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"max":{"1min":1.7609999999999999,"5min":2.73,"15min":2.73},"last":1.425}]},{"osd":6,"last update":"Tue Dec 12 09:45:16 2023","interfaces":[{"interface":"back","average":{"1min":1.3180000000000001,"5min":1.5109999999999999,"15min":1.5429999999999999},"min":{"1min":0.751,"5min":0.751,"15min":0.751},"max":{"1min":2.1589999999999998,"5min":6.468,"15min":6.468},"last":1.7210000000000001},{"interface":"front","average":{"1min":1.2529999999999999,"5min":1.514,"15min":1.5580000000000001},"min":{"1min":0.85899999999999999,"5min":0.84699999999999998,"15min":0.84699999999999998},"max":{"1min":1.7949999999999999,"5min":6.3129999999999997,"15min":6.3129999999999997},"last":1.585}]},{"osd":7,"last update":"Tue Dec 12 09:45:16 2023","interfaces":[{"interface":"back","average":{"1min":1.333,"5min":1.3919999999999999,"15min":1.4019999999999999},"min":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"max":{"1min":1.9399999999999999,"5min":2.9009999999999998,"15min":2.9009999999999998},"last":1.534},{"interface":"front","average":{"1min":1.345,"5min":1.5129999999999999,"15min":1.5409999999999999},"min":{"1min":0.83999999999999997,"5min":0.752,"15min":0.752},"max":{"1min":1.996,"5min":6.242,"15min":6.242},"last":1.6379999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574878,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27724,"kb_used_data":700,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344116,"statfs":{"total":96636764160,"available":96608374784,"internally_reserved":0,"allocated":716800,"data_stored":861788,"data_compressed":32422,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Dec 12 09:45:18 2023","interfaces":[{"interface":"back","average":{"1min":0.81699999999999995,"5min":0.78000000000000003,"15min":0.77400000000000002},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":1.639,"5min":1.639,"15min":1.639},"last":0.92200000000000004},{"interface":"front","average":{"1min":0.91800000000000004,"5min":0.83699999999999997,"15min":0.82299999999999995},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":1.5680000000000001,"5min":1.5680000000000001,"15min":1.5680000000000001},"last":0.68799999999999994}]},{"osd":2,"last update":"Tue Dec 12 09:45:18 2023","interfaces":[{"interface":"back","average":{"1min":0.95099999999999996,"5min":0.879,"15min":0.86699999999999999},"min":{"1min":0.34300000000000003,"5min":0.316,"15min":0.316},"max":{"1min":1.748,"5min":1.748,"15min":1.748},"last":1.3260000000000001},{"interface":"front","average":{"1min":1.0469999999999999,"5min":1.0049999999999999,"15min":0.998},"min":{"1min":0.53600000000000003,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":1.6080000000000001,"5min":1.649,"15min":1.649},"last":0.54400000000000004}]},{"osd":3,"last update":"Tue Dec 12 09:45:18 2023","interfaces":[{"interface":"back","average":{"1min":0.81499999999999995,"5min":0.84499999999999997,"15min":0.84999999999999998},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":1.2529999999999999,"5min":1.4990000000000001,"15min":1.4990000000000001},"last":1.0089999999999999},{"interface":"front","average":{"1min":1.0509999999999999,"5min":1.0129999999999999,"15min":1.0069999999999999},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":1.579,"5min":1.7689999999999999,"15min":1.7689999999999999},"last":0.84399999999999997}]},{"osd":4,"last update":"Tue Dec 12 09:45:18 2023","interfaces":[{"interface":"back","average":{"1min":1.3360000000000001,"5min":1.296,"15min":1.29},"min":{"1min":0.82999999999999996,"5min":0.80400000000000005,"15min":0.80400000000000005},"max":{"1min":1.923,"5min":2.073,"15min":2.073},"last":1.0760000000000001},{"interface":"front","average":{"1min":1.2,"5min":1.274,"15min":1.286},"min":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"max":{"1min":1.6359999999999999,"5min":3.0699999999999998,"15min":3.0699999999999998},"last":1.141}]},{"osd":5,"last update":"Tue Dec 12 09:45:18 2023","interfaces":[{"interface":"back","average":{"1min":1.173,"5min":1.2210000000000001,"15min":1.2290000000000001},"min":{"1min":0.73499999999999999,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.9690000000000001,"5min":3.1909999999999998,"15min":3.1909999999999998},"last":1.401},{"interface":"front","average":{"1min":1.2749999999999999,"5min":1.3,"15min":1.304},"min":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"max":{"1min":2.1200000000000001,"5min":2.1200000000000001,"15min":2.1200000000000001},"last":0.97099999999999997}]},{"osd":6,"last update":"Tue Dec 12 09:45:18 2023","interfaces":[{"interface":"back","average":{"1min":1.333,"5min":1.337,"15min":1.337},"min":{"1min":0.752,"5min":0.67500000000000004,"15min":0.67500000000000004},"max":{"1min":2.04,"5min":2.04,"15min":2.04},"last":1.22},{"interface":"front","average":{"1min":1.361,"5min":1.385,"15min":1.389},"min":{"1min":0.95399999999999996,"5min":0.73099999999999998,"15min":0.73099999999999998},"max":{"1min":1.7010000000000001,"5min":2.9100000000000001,"15min":2.9100000000000001},"last":1.181}]},{"osd":7,"last update":"Tue Dec 12 09:45:18 2023","interfaces":[{"interface":"back","average":{"1min":1.3999999999999999,"5min":1.4359999999999999,"15min":1.4419999999999999},"min":{"1min":0.70299999999999996,"5min":0.66800000000000004,"15min":0.66800000000000004},"max":{"1min":1.847,"5min":2.992,"15min":2.992},"last":1.367},{"interface":"front","average":{"1min":1.3169999999999999,"5min":1.327,"15min":1.329},"min":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"max":{"1min":1.8120000000000001,"5min":2.7690000000000001,"15min":2.7690000000000001},"last":1.28}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32422,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32422,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-12T09:45:28.416 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-12-12T09:45:28.417 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-12-12T09:45:28.468 INFO:tasks.ceph.mds.a.smithi073.stderr:2023-12-12T09:45:28.467+0000 7f97317fa640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-12-12T09:45:28.677 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:28.676+0000 7fc1a5e09640 1 Processor -- start 2023-12-12T09:45:28.677 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:28.676+0000 7fc1a5e09640 1 -- start start 2023-12-12T09:45:28.679 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:28.677+0000 7fc1a5e09640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fc1a00a4d00 0x7fc1a00c0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:28.679 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:28.677+0000 7fc1a5e09640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc1a01529a0 0x7fc1a00a8880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:28.679 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:28.677+0000 7fc1a5e09640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1a01521e0 con 0x7fc1a014c190 2023-12-12T09:45:28.679 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:28.677+0000 7fc1a5e09640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1a00c1890 con 0x7fc1a00a4d00 2023-12-12T09:45:28.679 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:28.677+0000 7fc1a5e09640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1a0151fd0 con 0x7fc1a01529a0 2023-12-12T09:45:28.680 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:28.678+0000 7fc19ffff640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fc1a00a4d00 0x7fc1a00c0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:28.680 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:28.678+0000 7fc1a5608640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc1a01529a0 0x7fc1a00a8880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:28.680 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:28.678+0000 7fc19ffff640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fc1a00a4d00 0x7fc1a00c0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.73:56404/0 (socket says 172.21.15.73:56404) 2023-12-12T09:45:28.680 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:28.678+0000 7fc19ffff640 1 -- 172.21.15.73:0/4133132173 learned_addr learned my addr 172.21.15.73:0/4133132173 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:45:28.680 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:28.679+0000 7fc19ffff640 1 -- 172.21.15.73:0/4133132173 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc1a01529a0 msgr2=0x7fc1a00a8880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:45:28.680 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:28.679+0000 7fc19ffff640 1 --2- 172.21.15.73:0/4133132173 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc1a01529a0 0x7fc1a00a8880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:28.680 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:28.679+0000 7fc19ffff640 1 -- 172.21.15.73:0/4133132173 >> v1:172.21.15.142:6789/0 conn(0x7fc1a014c190 legacy=0x7fc1a01555c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:28.680 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:28.679+0000 7fc19ffff640 1 -- 172.21.15.73:0/4133132173 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1a00c1aa0 con 0x7fc1a00a4d00 2023-12-12T09:45:28.681 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:28.680+0000 7fc19ffff640 1 --2- 172.21.15.73:0/4133132173 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc1a00a4d00 0x7fc1a00c0e00 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fc18c009870 tx=0x7fc18c02b8f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2f17f9ab61b1a1ae server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:45:28.682 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:28.681+0000 7fc19f7fe640 1 -- 172.21.15.73:0/4133132173 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc18c031640 con 0x7fc1a00a4d00 2023-12-12T09:45:28.682 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:28.681+0000 7fc19f7fe640 1 -- 172.21.15.73:0/4133132173 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc18c0317a0 con 0x7fc1a00a4d00 2023-12-12T09:45:28.682 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:28.681+0000 7fc19f7fe640 1 -- 172.21.15.73:0/4133132173 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc18c031b30 con 0x7fc1a00a4d00 2023-12-12T09:45:28.683 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:28.682+0000 7fc1a5e09640 1 -- 172.21.15.73:0/4133132173 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc1a00a4d00 msgr2=0x7fc1a00c0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:28.683 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:28.682+0000 7fc1a5e09640 1 --2- 172.21.15.73:0/4133132173 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc1a00a4d00 0x7fc1a00c0e00 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fc18c009870 tx=0x7fc18c02b8f0 comp rx=0 tx=0).stop 2023-12-12T09:45:28.683 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:28.682+0000 7fc1a5e09640 1 -- 172.21.15.73:0/4133132173 shutdown_connections 2023-12-12T09:45:28.683 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:28.682+0000 7fc1a5e09640 1 --2- 172.21.15.73:0/4133132173 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc1a01529a0 0x7fc1a00a8880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:28.684 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:28.682+0000 7fc1a5e09640 1 --2- 172.21.15.73:0/4133132173 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc1a00a4d00 0x7fc1a00c0e00 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:28.684 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:28.682+0000 7fc1a5e09640 1 -- 172.21.15.73:0/4133132173 >> 172.21.15.73:0/4133132173 conn(0x7fc1a006a4e0 msgr2=0x7fc1a006a8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:45:28.684 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:28.682+0000 7fc1a5e09640 1 -- 172.21.15.73:0/4133132173 shutdown_connections 2023-12-12T09:45:28.684 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:28.682+0000 7fc1a5e09640 1 -- 172.21.15.73:0/4133132173 wait complete. 2023-12-12T09:45:28.685 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:28.684+0000 7fc1a5e09640 1 Processor -- start 2023-12-12T09:45:28.685 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:28.684+0000 7fc1a5e09640 1 -- start start 2023-12-12T09:45:28.688 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:28.685+0000 7fc1a5e09640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc1a00a4d00 0x7fc1a014d960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:28.688 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:28.685+0000 7fc1a5e09640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc1a014c190 0x7fc1a0071c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:28.688 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:28.685+0000 7fc1a5e09640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc1a01529a0 0x7fc1a00a6440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:28.688 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:28.685+0000 7fc1a5e09640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1a01ebb00 con 0x7fc1a014c190 2023-12-12T09:45:28.688 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:28.685+0000 7fc1a5e09640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1a01eb1f0 con 0x7fc1a00a4d00 2023-12-12T09:45:28.688 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:28.685+0000 7fc1a5e09640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1a014df70 con 0x7fc1a01529a0 2023-12-12T09:45:28.688 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:28.685+0000 7fc19ffff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc1a014c190 0x7fc1a0071c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:28.688 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:28.685+0000 7fc19ffff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc1a014c190 0x7fc1a0071c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:45416/0 (socket says 172.21.15.73:45416) 2023-12-12T09:45:28.688 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:28.685+0000 7fc19ffff640 1 -- 172.21.15.73:0/3695155532 learned_addr learned my addr 172.21.15.73:0/3695155532 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:45:28.688 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:28.685+0000 7fc1a5608640 1 --2- 172.21.15.73:0/3695155532 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc1a01529a0 0x7fc1a00a6440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:28.688 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:28.685+0000 7fc1a4e07640 1 --2- 172.21.15.73:0/3695155532 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc1a00a4d00 0x7fc1a014d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:28.689 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:28.685+0000 7fc19ffff640 1 -- 172.21.15.73:0/3695155532 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc1a01529a0 msgr2=0x7fc1a00a6440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:28.689 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:28.685+0000 7fc19ffff640 1 --2- 172.21.15.73:0/3695155532 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc1a01529a0 0x7fc1a00a6440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:28.689 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:28.685+0000 7fc19ffff640 1 -- 172.21.15.73:0/3695155532 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc1a00a4d00 msgr2=0x7fc1a014d960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:28.689 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:28.685+0000 7fc19ffff640 1 --2- 172.21.15.73:0/3695155532 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc1a00a4d00 0x7fc1a014d960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:28.689 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:28.685+0000 7fc19ffff640 1 -- 172.21.15.73:0/3695155532 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc18c0094d0 con 0x7fc1a014c190 2023-12-12T09:45:28.689 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:28.685+0000 7fc1a4e07640 1 --2- 172.21.15.73:0/3695155532 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc1a00a4d00 0x7fc1a014d960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:45:28.689 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:28.686+0000 7fc19ffff640 1 --2- 172.21.15.73:0/3695155532 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc1a014c190 0x7fc1a0071c70 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7fc18c000c00 tx=0x7fc18c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:45:28.689 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:28.686+0000 7fc19d7fa640 1 -- 172.21.15.73:0/3695155532 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc18c03a930 con 0x7fc1a014c190 2023-12-12T09:45:28.689 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:28.686+0000 7fc19d7fa640 1 -- 172.21.15.73:0/3695155532 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc18c03aa90 con 0x7fc1a014c190 2023-12-12T09:45:28.689 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:28.686+0000 7fc19d7fa640 1 -- 172.21.15.73:0/3695155532 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc18c03ae40 con 0x7fc1a014c190 2023-12-12T09:45:28.689 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:28.686+0000 7fc1a5e09640 1 -- 172.21.15.73:0/3695155532 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1a01eb440 con 0x7fc1a014c190 2023-12-12T09:45:28.689 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:28.686+0000 7fc1a5e09640 1 -- 172.21.15.73:0/3695155532 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1a0146bf0 con 0x7fc1a014c190 2023-12-12T09:45:28.690 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:28.687+0000 7fc1a5e09640 1 -- 172.21.15.73:0/3695155532 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1a01ebc40 con 0x7fc1a014c190 2023-12-12T09:45:28.690 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:28.688+0000 7fc19d7fa640 1 -- 172.21.15.73:0/3695155532 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fc18c02f050 con 0x7fc1a014c190 2023-12-12T09:45:28.690 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:28.689+0000 7fc19d7fa640 1 --2- 172.21.15.73:0/3695155532 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fc18406ae40 0x7fc18406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:28.690 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:28.689+0000 7fc19d7fa640 1 -- 172.21.15.73:0/3695155532 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc18c0ab440 con 0x7fc1a014c190 2023-12-12T09:45:28.691 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:28.689+0000 7fc1a4e07640 1 --2- 172.21.15.73:0/3695155532 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fc18406ae40 0x7fc18406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:28.691 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:28.690+0000 7fc1a4e07640 1 --2- 172.21.15.73:0/3695155532 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fc18406ae40 0x7fc18406d300 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fc1940012e0 tx=0x7fc194009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:45:28.695 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:28.694+0000 7fc19d7fa640 1 -- 172.21.15.73:0/3695155532 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fc1a01ebc40 con 0x7fc1a014c190 2023-12-12T09:45:28.953 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:28.951+0000 7fc1a5e09640 1 -- 172.21.15.73:0/3695155532 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7fc1a01ebc40 con 0x7fc1a014c190 2023-12-12T09:45:28.956 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:28.955+0000 7fc19d7fa640 1 -- 172.21.15.73:0/3695155532 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v15) v1 ==== 190+0+147 (secure 0 0 0) 0x7fc1a01ebc40 con 0x7fc1a014c190 2023-12-12T09:45:28.956 INFO:teuthology.orchestra.run.smithi073.stdout:[client.0] 2023-12-12T09:45:28.957 INFO:teuthology.orchestra.run.smithi073.stdout: key = AQD/Knhl/4KuBxAAdAlGb7dYkXXlgPJp0Qcecg== 2023-12-12T09:45:28.957 INFO:teuthology.orchestra.run.smithi073.stdout: caps mds = "allow" 2023-12-12T09:45:28.957 INFO:teuthology.orchestra.run.smithi073.stdout: caps mon = "allow r" 2023-12-12T09:45:28.957 INFO:teuthology.orchestra.run.smithi073.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2023-12-12T09:45:28.957 INFO:teuthology.orchestra.run.smithi073.stderr:updated caps for client.0 2023-12-12T09:45:28.960 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:28.958+0000 7fc1a5e09640 1 -- 172.21.15.73:0/3695155532 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fc18406ae40 msgr2=0x7fc18406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:28.960 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:28.958+0000 7fc1a5e09640 1 --2- 172.21.15.73:0/3695155532 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fc18406ae40 0x7fc18406d300 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fc1940012e0 tx=0x7fc194009040 comp rx=0 tx=0).stop 2023-12-12T09:45:28.960 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:28.958+0000 7fc1a5e09640 1 -- 172.21.15.73:0/3695155532 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc1a014c190 msgr2=0x7fc1a0071c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:28.960 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:28.958+0000 7fc1a5e09640 1 --2- 172.21.15.73:0/3695155532 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc1a014c190 0x7fc1a0071c70 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7fc18c000c00 tx=0x7fc18c0046c0 comp rx=0 tx=0).stop 2023-12-12T09:45:28.960 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:28.958+0000 7fc1a5e09640 1 -- 172.21.15.73:0/3695155532 shutdown_connections 2023-12-12T09:45:28.960 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:28.958+0000 7fc1a5e09640 1 --2- 172.21.15.73:0/3695155532 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fc18406ae40 0x7fc18406d300 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:28.961 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:28.958+0000 7fc1a5e09640 1 --2- 172.21.15.73:0/3695155532 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc1a01529a0 0x7fc1a00a6440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:28.961 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:28.958+0000 7fc1a5e09640 1 --2- 172.21.15.73:0/3695155532 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc1a014c190 0x7fc1a0071c70 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:28.961 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:28.958+0000 7fc1a5e09640 1 --2- 172.21.15.73:0/3695155532 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc1a00a4d00 0x7fc1a014d960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:28.961 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:28.958+0000 7fc1a5e09640 1 -- 172.21.15.73:0/3695155532 >> 172.21.15.73:0/3695155532 conn(0x7fc1a006a4e0 msgr2=0x7fc1a00ab2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:45:28.961 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:28.958+0000 7fc1a5e09640 1 -- 172.21.15.73:0/3695155532 shutdown_connections 2023-12-12T09:45:28.961 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:28.958+0000 7fc1a5e09640 1 -- 172.21.15.73:0/3695155532 wait complete. 2023-12-12T09:45:28.978 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-12T09:45:29.237 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:29.235+0000 7fc47d1a9640 1 Processor -- start 2023-12-12T09:45:29.237 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:29.235+0000 7fc47d1a9640 1 -- start start 2023-12-12T09:45:29.238 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:29.237+0000 7fc47d1a9640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc47814fa40 0x7fc47806a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:29.238 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:29.237+0000 7fc47d1a9640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fc47806db70 0x7fc4780c39b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:29.238 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:29.237+0000 7fc47d1a9640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc478152610 con 0x7fc4780c5070 2023-12-12T09:45:29.238 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:29.237+0000 7fc47d1a9640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4781528f0 con 0x7fc47806db70 2023-12-12T09:45:29.238 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:29.237+0000 7fc47d1a9640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc478152bd0 con 0x7fc47814fa40 2023-12-12T09:45:29.239 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:29.238+0000 7fc476d9d640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc47814fa40 0x7fc47806a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:29.239 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:29.238+0000 7fc46ffff640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fc47806db70 0x7fc4780c39b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:29.239 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:29.238+0000 7fc46ffff640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fc47806db70 0x7fc4780c39b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.73:55054/0 (socket says 172.21.15.73:55054) 2023-12-12T09:45:29.240 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:29.238+0000 7fc46ffff640 1 -- 172.21.15.73:0/1763022294 learned_addr learned my addr 172.21.15.73:0/1763022294 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:45:29.240 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:29.238+0000 7fc476d9d640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc47814fa40 0x7fc47806a4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.73:38648/0 (socket says 172.21.15.73:38648) 2023-12-12T09:45:29.240 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:29.239+0000 7fc476d9d640 1 -- 172.21.15.73:0/1763022294 >> v2:172.21.15.142:3300/0 conn(0x7fc47806db70 msgr2=0x7fc4780c39b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:45:29.241 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:29.239+0000 7fc476d9d640 1 --2- 172.21.15.73:0/1763022294 >> v2:172.21.15.142:3300/0 conn(0x7fc47806db70 0x7fc4780c39b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:29.241 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:29.239+0000 7fc476d9d640 1 -- 172.21.15.73:0/1763022294 >> v1:172.21.15.142:6789/0 conn(0x7fc4780c5070 legacy=0x7fc4780c3ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:29.241 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:29.239+0000 7fc476d9d640 1 -- 172.21.15.73:0/1763022294 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc478152eb0 con 0x7fc47814fa40 2023-12-12T09:45:29.242 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:29.240+0000 7fc476d9d640 1 --2- 172.21.15.73:0/1763022294 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc47814fa40 0x7fc47806a4e0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fc4680097a0 tx=0x7fc46802b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d2eafeaeb844946d server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:45:29.242 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:29.241+0000 7fc47659c640 1 -- 172.21.15.73:0/1763022294 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc468031830 con 0x7fc47814fa40 2023-12-12T09:45:29.242 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:29.241+0000 7fc47659c640 1 -- 172.21.15.73:0/1763022294 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc468031990 con 0x7fc47814fa40 2023-12-12T09:45:29.242 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:29.241+0000 7fc47659c640 1 -- 172.21.15.73:0/1763022294 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc468031d20 con 0x7fc47814fa40 2023-12-12T09:45:29.243 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:29.242+0000 7fc47d1a9640 1 -- 172.21.15.73:0/1763022294 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc47814fa40 msgr2=0x7fc47806a4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:29.243 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:29.242+0000 7fc47d1a9640 1 --2- 172.21.15.73:0/1763022294 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc47814fa40 0x7fc47806a4e0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fc4680097a0 tx=0x7fc46802b8d0 comp rx=0 tx=0).stop 2023-12-12T09:45:29.243 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:29.242+0000 7fc47d1a9640 1 -- 172.21.15.73:0/1763022294 shutdown_connections 2023-12-12T09:45:29.243 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:29.242+0000 7fc47d1a9640 1 --2- 172.21.15.73:0/1763022294 >> v2:172.21.15.142:3300/0 conn(0x7fc47806db70 0x7fc4780c39b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:29.244 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:29.242+0000 7fc47d1a9640 1 --2- 172.21.15.73:0/1763022294 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc47814fa40 0x7fc47806a4e0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:29.244 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:29.242+0000 7fc47d1a9640 1 -- 172.21.15.73:0/1763022294 >> 172.21.15.73:0/1763022294 conn(0x7fc4780a8130 msgr2=0x7fc4780c24b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:45:29.244 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:29.242+0000 7fc47d1a9640 1 -- 172.21.15.73:0/1763022294 shutdown_connections 2023-12-12T09:45:29.244 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:29.242+0000 7fc47d1a9640 1 -- 172.21.15.73:0/1763022294 wait complete. 2023-12-12T09:45:29.245 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:29.244+0000 7fc47d1a9640 1 Processor -- start 2023-12-12T09:45:29.245 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:29.244+0000 7fc47d1a9640 1 -- start start 2023-12-12T09:45:29.246 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:29.245+0000 7fc47d1a9640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc47806db70 0x7fc4780a6b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:29.247 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:29.245+0000 7fc47d1a9640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc4780c5070 0x7fc4781e9a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:29.247 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:29.245+0000 7fc47d1a9640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc47814fa40 0x7fc4781d8860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:29.247 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:29.245+0000 7fc47d1a9640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4780a93d0 con 0x7fc4780c5070 2023-12-12T09:45:29.247 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:29.245+0000 7fc47d1a9640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4780aa4c0 con 0x7fc47814fa40 2023-12-12T09:45:29.247 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:29.245+0000 7fc47d1a9640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4780aaa40 con 0x7fc47806db70 2023-12-12T09:45:29.247 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:29.245+0000 7fc46ffff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc4780c5070 0x7fc4781e9a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:29.247 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:29.245+0000 7fc46ffff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc4780c5070 0x7fc4781e9a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:40856/0 (socket says 172.21.15.73:40856) 2023-12-12T09:45:29.247 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:29.245+0000 7fc46ffff640 1 -- 172.21.15.73:0/2016150798 learned_addr learned my addr 172.21.15.73:0/2016150798 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:45:29.247 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:29.245+0000 7fc476d9d640 1 --2- 172.21.15.73:0/2016150798 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc47806db70 0x7fc4780a6b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:29.247 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:29.245+0000 7fc47759e640 1 --2- 172.21.15.73:0/2016150798 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc47814fa40 0x7fc4781d8860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:29.247 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:29.245+0000 7fc46ffff640 1 -- 172.21.15.73:0/2016150798 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc47806db70 msgr2=0x7fc4780a6b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:29.247 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:29.245+0000 7fc46ffff640 1 --2- 172.21.15.73:0/2016150798 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc47806db70 0x7fc4780a6b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:29.247 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:29.245+0000 7fc46ffff640 1 -- 172.21.15.73:0/2016150798 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc47814fa40 msgr2=0x7fc4781d8860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:29.248 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:29.245+0000 7fc46ffff640 1 --2- 172.21.15.73:0/2016150798 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc47814fa40 0x7fc4781d8860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:29.248 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:29.245+0000 7fc46ffff640 1 -- 172.21.15.73:0/2016150798 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc468009400 con 0x7fc4780c5070 2023-12-12T09:45:29.248 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:29.246+0000 7fc47759e640 1 --2- 172.21.15.73:0/2016150798 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc47814fa40 0x7fc4781d8860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:45:29.248 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:29.246+0000 7fc46ffff640 1 --2- 172.21.15.73:0/2016150798 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc4780c5070 0x7fc4781e9a60 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7fc46000e870 tx=0x7fc46000ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:45:29.249 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:29.246+0000 7fc46f7fe640 1 -- 172.21.15.73:0/2016150798 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc46000c8e0 con 0x7fc4780c5070 2023-12-12T09:45:29.249 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:29.246+0000 7fc46f7fe640 1 -- 172.21.15.73:0/2016150798 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc46000ca40 con 0x7fc4780c5070 2023-12-12T09:45:29.249 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:29.246+0000 7fc47d1a9640 1 -- 172.21.15.73:0/2016150798 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4780a7080 con 0x7fc4780c5070 2023-12-12T09:45:29.249 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:29.246+0000 7fc46f7fe640 1 -- 172.21.15.73:0/2016150798 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc46000cdd0 con 0x7fc4780c5070 2023-12-12T09:45:29.249 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:29.246+0000 7fc47d1a9640 1 -- 172.21.15.73:0/2016150798 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4780aa6d0 con 0x7fc4780c5070 2023-12-12T09:45:29.249 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:29.248+0000 7fc47d1a9640 1 -- 172.21.15.73:0/2016150798 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc4780aab80 con 0x7fc4780c5070 2023-12-12T09:45:29.249 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:29.248+0000 7fc46f7fe640 1 -- 172.21.15.73:0/2016150798 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fc460013470 con 0x7fc4780c5070 2023-12-12T09:45:29.250 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:29.249+0000 7fc46f7fe640 1 --2- 172.21.15.73:0/2016150798 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fc45806ae70 0x7fc45806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:29.251 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:29.249+0000 7fc46f7fe640 1 -- 172.21.15.73:0/2016150798 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc460089690 con 0x7fc4780c5070 2023-12-12T09:45:29.251 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:29.250+0000 7fc476d9d640 1 --2- 172.21.15.73:0/2016150798 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fc45806ae70 0x7fc45806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:29.251 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:29.250+0000 7fc476d9d640 1 --2- 172.21.15.73:0/2016150798 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fc45806ae70 0x7fc45806d330 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fc468036000 tx=0x7fc46803c040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:45:29.255 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:29.254+0000 7fc46f7fe640 1 -- 172.21.15.73:0/2016150798 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fc4780aab80 con 0x7fc4780c5070 2023-12-12T09:45:29.484 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:29.482+0000 7fc47d1a9640 1 -- 172.21.15.73:0/2016150798 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc4780aab80 con 0x7fc4780c5070 2023-12-12T09:45:29.485 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:29.484+0000 7fc46f7fe640 1 -- 172.21.15.73:0/2016150798 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) v1 ==== 94+0+4916 (secure 0 0 0) 0x7fc4780aab80 con 0x7fc4780c5070 2023-12-12T09:45:29.485 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-12T09:45:29.485 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":30,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4736,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6834/2964437845","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6832","nonce":2964437845},{"type":"v1","addr":"172.21.15.142:6834","nonce":2964437845}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":25},{"gid":5044,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6837/3698725764","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6836","nonce":3698725764},{"type":"v1","addr":"172.21.15.73:6837","nonce":3698725764}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":25},{"gid":5059,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6835/2931058847","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6833","nonce":2931058847},{"type":"v1","addr":"172.21.15.142:6835","nonce":2931058847}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":25}],"filesystems":[{"mdsmap":{"epoch":30,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-12T09:45:22.971300+0000","modified":"2023-12-12T09:45:26.028731+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5703},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5703":{"gid":5703,"name":"a","rank":0,"incarnation":26,"state":"up:active","state_seq":3,"addr":"172.21.15.73:6835/744058726","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":744058726},{"type":"v1","addr":"172.21.15.73:6835","nonce":744058726}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2023-12-12T09:45:29.485 INFO:teuthology.orchestra.run.smithi073.stderr:dumped fsmap epoch 30 2023-12-12T09:45:29.488 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:29.486+0000 7fc47d1a9640 1 -- 172.21.15.73:0/2016150798 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fc45806ae70 msgr2=0x7fc45806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:29.488 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:29.486+0000 7fc47d1a9640 1 --2- 172.21.15.73:0/2016150798 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fc45806ae70 0x7fc45806d330 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fc468036000 tx=0x7fc46803c040 comp rx=0 tx=0).stop 2023-12-12T09:45:29.488 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:29.486+0000 7fc47d1a9640 1 -- 172.21.15.73:0/2016150798 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc4780c5070 msgr2=0x7fc4781e9a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:29.488 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:29.486+0000 7fc47d1a9640 1 --2- 172.21.15.73:0/2016150798 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc4780c5070 0x7fc4781e9a60 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7fc46000e870 tx=0x7fc46000ed30 comp rx=0 tx=0).stop 2023-12-12T09:45:29.488 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:29.486+0000 7fc47d1a9640 1 -- 172.21.15.73:0/2016150798 shutdown_connections 2023-12-12T09:45:29.488 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:29.486+0000 7fc47d1a9640 1 --2- 172.21.15.73:0/2016150798 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fc45806ae70 0x7fc45806d330 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:29.488 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:29.486+0000 7fc47d1a9640 1 --2- 172.21.15.73:0/2016150798 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc47814fa40 0x7fc4781d8860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:29.488 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:29.486+0000 7fc47d1a9640 1 --2- 172.21.15.73:0/2016150798 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc4780c5070 0x7fc4781e9a60 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:29.488 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:29.486+0000 7fc47d1a9640 1 --2- 172.21.15.73:0/2016150798 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc47806db70 0x7fc4780a6b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:29.488 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:29.486+0000 7fc47d1a9640 1 -- 172.21.15.73:0/2016150798 >> 172.21.15.73:0/2016150798 conn(0x7fc4780a8130 msgr2=0x7fc4780c63b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:45:29.488 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:29.487+0000 7fc47d1a9640 1 -- 172.21.15.73:0/2016150798 shutdown_connections 2023-12-12T09:45:29.489 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:29.487+0000 7fc47d1a9640 1 -- 172.21.15.73:0/2016150798 wait complete. 2023-12-12T09:45:29.910 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 30, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-12-12T09:45:22.971300+0000', 'modified': '2023-12-12T09:45:26.028731+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5703}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5703': {'gid': 5703, 'name': 'a', 'rank': 0, 'incarnation': 26, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.73:6835/744058726', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.73:6834', 'nonce': 744058726}, {'type': 'v1', 'addr': '172.21.15.73:6835', 'nonce': 744058726}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [9], 'metadata_pool': 8, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-12-12T09:45:29.910 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-12-12T09:45:29.910 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-12-12T09:45:30.133 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:30.132+0000 7fb6fd3ce640 1 Processor -- start 2023-12-12T09:45:30.133 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:30.132+0000 7fb6fd3ce640 1 -- start start 2023-12-12T09:45:30.135 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:30.134+0000 7fb6fd3ce640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fb6f80c3920 0x7fb6f814e480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:30.135 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:30.134+0000 7fb6fd3ce640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fb6f814e9c0 0x7fb6f80c14f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:30.135 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:30.134+0000 7fb6fd3ce640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6f80c04c0 con 0x7fb6f80a4f00 2023-12-12T09:45:30.136 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:30.134+0000 7fb6fd3ce640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6f80c58c0 con 0x7fb6f814e9c0 2023-12-12T09:45:30.136 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:30.134+0000 7fb6fd3ce640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6f80c0730 con 0x7fb6f80c3920 2023-12-12T09:45:30.136 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:30.134+0000 7fb6f77fe640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fb6f814e9c0 0x7fb6f80c14f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:30.136 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:30.134+0000 7fb6f77fe640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fb6f814e9c0 0x7fb6f80c14f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:40866/0 (socket says 172.21.15.73:40866) 2023-12-12T09:45:30.136 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:30.134+0000 7fb6f77fe640 1 -- 172.21.15.73:0/2475951224 learned_addr learned my addr 172.21.15.73:0/2475951224 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:45:30.136 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:30.134+0000 7fb6ee7fc640 1 --2- 172.21.15.73:0/2475951224 >> v2:172.21.15.142:3300/0 conn(0x7fb6f80c3920 0x7fb6f814e480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:30.137 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:30.134+0000 7fb6f77fe640 1 -- 172.21.15.73:0/2475951224 >> v2:172.21.15.142:3300/0 conn(0x7fb6f80c3920 msgr2=0x7fb6f814e480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:45:30.137 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:30.134+0000 7fb6f77fe640 1 --2- 172.21.15.73:0/2475951224 >> v2:172.21.15.142:3300/0 conn(0x7fb6f80c3920 0x7fb6f814e480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:30.137 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:30.134+0000 7fb6f77fe640 1 -- 172.21.15.73:0/2475951224 >> v1:172.21.15.142:6789/0 conn(0x7fb6f80a4f00 legacy=0x7fb6f8151ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:45:30.137 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:30.135+0000 7fb6f77fe640 1 -- 172.21.15.73:0/2475951224 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6f80c0a10 con 0x7fb6f814e9c0 2023-12-12T09:45:30.137 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:30.136+0000 7fb6f77fe640 1 --2- 172.21.15.73:0/2475951224 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb6f814e9c0 0x7fb6f80c14f0 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7fb6f80c00e0 tx=0x7fb6f002e060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24662d85ced521b9 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:45:30.138 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:30.136+0000 7fb6f67fc640 1 -- 172.21.15.73:0/2475951224 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6f002ec00 con 0x7fb6f814e9c0 2023-12-12T09:45:30.138 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:30.136+0000 7fb6f67fc640 1 -- 172.21.15.73:0/2475951224 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6f002ed60 con 0x7fb6f814e9c0 2023-12-12T09:45:30.138 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:30.136+0000 7fb6f67fc640 1 -- 172.21.15.73:0/2475951224 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6f0036610 con 0x7fb6f814e9c0 2023-12-12T09:45:30.138 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:30.137+0000 7fb6fd3ce640 1 -- 172.21.15.73:0/2475951224 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb6f814e9c0 msgr2=0x7fb6f80c14f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:30.138 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:30.137+0000 7fb6fd3ce640 1 --2- 172.21.15.73:0/2475951224 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb6f814e9c0 0x7fb6f80c14f0 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7fb6f80c00e0 tx=0x7fb6f002e060 comp rx=0 tx=0).stop 2023-12-12T09:45:30.139 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:30.137+0000 7fb6fd3ce640 1 -- 172.21.15.73:0/2475951224 shutdown_connections 2023-12-12T09:45:30.139 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:30.137+0000 7fb6fd3ce640 1 --2- 172.21.15.73:0/2475951224 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb6f814e9c0 0x7fb6f80c14f0 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:30.139 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:30.137+0000 7fb6fd3ce640 1 --2- 172.21.15.73:0/2475951224 >> v2:172.21.15.142:3300/0 conn(0x7fb6f80c3920 0x7fb6f814e480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:30.139 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:30.137+0000 7fb6fd3ce640 1 -- 172.21.15.73:0/2475951224 >> 172.21.15.73:0/2475951224 conn(0x7fb6f80a77d0 msgr2=0x7fb6f80a7bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:45:30.139 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:30.137+0000 7fb6fd3ce640 1 -- 172.21.15.73:0/2475951224 shutdown_connections 2023-12-12T09:45:30.139 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:30.137+0000 7fb6fd3ce640 1 -- 172.21.15.73:0/2475951224 wait complete. 2023-12-12T09:45:30.140 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:30.139+0000 7fb6fd3ce640 1 Processor -- start 2023-12-12T09:45:30.140 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:30.139+0000 7fb6fd3ce640 1 -- start start 2023-12-12T09:45:30.142 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:30.140+0000 7fb6fd3ce640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb6f80a4f00 0x7fb6f814c120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:30.142 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:30.140+0000 7fb6fd3ce640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb6f80c3920 0x7fb6f81eda40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:30.142 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:30.140+0000 7fb6fd3ce640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb6f814e9c0 0x7fb6f80c4230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:30.142 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:30.140+0000 7fb6fd3ce640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6f814d3d0 con 0x7fb6f814e9c0 2023-12-12T09:45:30.142 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:30.140+0000 7fb6fd3ce640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6f81e9980 con 0x7fb6f80c3920 2023-12-12T09:45:30.142 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:30.140+0000 7fb6fd3ce640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6f81ecf30 con 0x7fb6f80a4f00 2023-12-12T09:45:30.142 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:30.140+0000 7fb6f77fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb6f814e9c0 0x7fb6f80c4230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:30.142 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:30.140+0000 7fb6f77fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb6f814e9c0 0x7fb6f80c4230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:40874/0 (socket says 172.21.15.73:40874) 2023-12-12T09:45:30.142 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:30.140+0000 7fb6f77fe640 1 -- 172.21.15.73:0/1800656976 learned_addr learned my addr 172.21.15.73:0/1800656976 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:45:30.142 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:30.140+0000 7fb6f77fe640 1 -- 172.21.15.73:0/1800656976 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb6f80a4f00 msgr2=0x7fb6f814c120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:30.142 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:30.140+0000 7fb6ee7fc640 1 --2- 172.21.15.73:0/1800656976 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb6f80c3920 0x7fb6f81eda40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:30.142 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:30.140+0000 7fb6f6ffd640 1 --2- 172.21.15.73:0/1800656976 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb6f80a4f00 0x7fb6f814c120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:30.143 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:30.140+0000 7fb6f77fe640 1 --2- 172.21.15.73:0/1800656976 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb6f80a4f00 0x7fb6f814c120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:30.143 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:30.140+0000 7fb6f77fe640 1 -- 172.21.15.73:0/1800656976 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb6f80c3920 msgr2=0x7fb6f81eda40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:30.143 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:30.140+0000 7fb6f77fe640 1 --2- 172.21.15.73:0/1800656976 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb6f80c3920 0x7fb6f81eda40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:30.143 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:30.140+0000 7fb6f77fe640 1 -- 172.21.15.73:0/1800656976 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6f0009b30 con 0x7fb6f814e9c0 2023-12-12T09:45:30.143 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:30.141+0000 7fb6f77fe640 1 --2- 172.21.15.73:0/1800656976 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb6f814e9c0 0x7fb6f80c4230 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7fb6f0038040 tx=0x7fb6f0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:45:30.144 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:30.141+0000 7fb6effff640 1 -- 172.21.15.73:0/1800656976 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6f002ec00 con 0x7fb6f814e9c0 2023-12-12T09:45:30.144 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:30.141+0000 7fb6effff640 1 -- 172.21.15.73:0/1800656976 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6f0009510 con 0x7fb6f814e9c0 2023-12-12T09:45:30.144 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:30.141+0000 7fb6effff640 1 -- 172.21.15.73:0/1800656976 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6f003f6b0 con 0x7fb6f814e9c0 2023-12-12T09:45:30.144 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:30.141+0000 7fb6fd3ce640 1 -- 172.21.15.73:0/1800656976 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6f80715a0 con 0x7fb6f814e9c0 2023-12-12T09:45:30.144 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:30.141+0000 7fb6fd3ce640 1 -- 172.21.15.73:0/1800656976 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6f8072550 con 0x7fb6f814e9c0 2023-12-12T09:45:30.144 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:30.143+0000 7fb6effff640 1 -- 172.21.15.73:0/1800656976 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fb6f003f810 con 0x7fb6f814e9c0 2023-12-12T09:45:30.145 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:30.144+0000 7fb6effff640 1 --2- 172.21.15.73:0/1800656976 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fb6d806ae40 0x7fb6d806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:30.146 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:30.144+0000 7fb6effff640 1 -- 172.21.15.73:0/1800656976 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb6f00abe20 con 0x7fb6f814e9c0 2023-12-12T09:45:30.146 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:30.145+0000 7fb6f6ffd640 1 --2- 172.21.15.73:0/1800656976 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fb6d806ae40 0x7fb6d806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:30.146 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:30.145+0000 7fb6fff64740 1 Processor -- start 2023-12-12T09:45:30.146 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:30.145+0000 7fb6f6ffd640 1 --2- 172.21.15.73:0/1800656976 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fb6d806ae40 0x7fb6d806d300 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fb6e0003d90 tx=0x7fb6e0009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:45:30.146 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:30.145+0000 7fb6fff64740 1 -- start start 2023-12-12T09:45:30.149 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:30.146+0000 7fb6fff64740 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5605720ddab0 0x5605721183a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:30.149 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:30.146+0000 7fb6fff64740 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5605720dde90 0x5605721188e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:30.149 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:30.146+0000 7fb6fff64740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5605720deb40 0x560572119910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:30.149 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:30.146+0000 7fb6fff64740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x56057204af40 con 0x5605720deb40 2023-12-12T09:45:30.149 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:30.146+0000 7fb6fff64740 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x560572048630 con 0x5605720dde90 2023-12-12T09:45:30.149 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:30.146+0000 7fb6fff64740 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x560572043f20 con 0x5605720ddab0 2023-12-12T09:45:30.149 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:30.146+0000 7fb6f77fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5605720deb40 0x560572119910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:30.149 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:30.146+0000 7fb6f77fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5605720deb40 0x560572119910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:40882/0 (socket says 172.21.15.73:40882) 2023-12-12T09:45:30.149 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:30.146+0000 7fb6f77fe640 1 -- 172.21.15.73:0/261794772 learned_addr learned my addr 172.21.15.73:0/261794772 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:45:30.149 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:30.147+0000 7fb6f6ffd640 1 --2- 172.21.15.73:0/261794772 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5605720ddab0 0x5605721183a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:30.149 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:30.147+0000 7fb6ee7fc640 1 --2- 172.21.15.73:0/261794772 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5605720dde90 0x5605721188e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:30.149 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:30.147+0000 7fb6f77fe640 1 -- 172.21.15.73:0/261794772 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5605720ddab0 msgr2=0x5605721183a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:45:30.150 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:30.147+0000 7fb6f77fe640 1 --2- 172.21.15.73:0/261794772 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5605720ddab0 0x5605721183a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:30.150 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:30.147+0000 7fb6f77fe640 1 -- 172.21.15.73:0/261794772 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5605720dde90 msgr2=0x5605721188e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:45:30.150 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:30.147+0000 7fb6f77fe640 1 --2- 172.21.15.73:0/261794772 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5605720dde90 0x5605721188e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:30.150 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:30.147+0000 7fb6f77fe640 1 -- 172.21.15.73:0/261794772 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560572006910 con 0x5605720deb40 2023-12-12T09:45:30.150 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:30.147+0000 7fb6f6ffd640 1 --2- 172.21.15.73:0/261794772 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5605720ddab0 0x5605721183a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:45:30.150 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:30.147+0000 7fb6f77fe640 1 --2- 172.21.15.73:0/261794772 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5605720deb40 0x560572119910 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7fb6f0077080 tx=0x7fb6f007a5a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bdb76e38346f95a0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:45:30.150 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:30.147+0000 7fb6ecff9640 1 -- 172.21.15.73:0/261794772 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6f007ecd0 con 0x5605720deb40 2023-12-12T09:45:30.150 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:30.147+0000 7fb6ecff9640 1 -- 172.21.15.73:0/261794772 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6f0082e80 con 0x5605720deb40 2023-12-12T09:45:30.150 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:30.147+0000 7fb6ecff9640 1 -- 172.21.15.73:0/261794772 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6f0077290 con 0x5605720deb40 2023-12-12T09:45:30.154 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:30.148+0000 7fb6fff64740 1 -- 172.21.15.73:0/261794772 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5605720deb40 msgr2=0x560572119910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:30.154 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:30.148+0000 7fb6fff64740 1 --2- 172.21.15.73:0/261794772 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5605720deb40 0x560572119910 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7fb6f0077080 tx=0x7fb6f007a5a0 comp rx=0 tx=0).stop 2023-12-12T09:45:30.154 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:30.148+0000 7fb6fff64740 1 -- 172.21.15.73:0/261794772 shutdown_connections 2023-12-12T09:45:30.154 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:30.148+0000 7fb6fff64740 1 --2- 172.21.15.73:0/261794772 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5605720deb40 0x560572119910 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:30.154 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:30.148+0000 7fb6fff64740 1 --2- 172.21.15.73:0/261794772 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5605720dde90 0x5605721188e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:30.154 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:30.148+0000 7fb6fff64740 1 --2- 172.21.15.73:0/261794772 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5605720ddab0 0x5605721183a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:30.155 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:30.148+0000 7fb6fff64740 1 -- 172.21.15.73:0/261794772 >> 172.21.15.73:0/261794772 conn(0x5605720da410 msgr2=0x5605720feb90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:45:30.155 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:30.148+0000 7fb6fff64740 1 -- 172.21.15.73:0/261794772 shutdown_connections 2023-12-12T09:45:30.155 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:30.148+0000 7fb6fff64740 1 -- 172.21.15.73:0/261794772 wait complete. 2023-12-12T09:45:30.156 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:30.149+0000 7fb6fff64740 1 -- start start 2023-12-12T09:45:30.156 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:30.149+0000 7fb6fff64740 1 Processor -- start 2023-12-12T09:45:30.156 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:30.150+0000 7fb6fff64740 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5605720dde90 0x560572121d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:30.156 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:30.150+0000 7fb6fff64740 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5605720deb40 0x56057212a7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:30.156 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:30.150+0000 7fb6fff64740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56057211ffd0 0x5605720fb910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:30.156 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:30.150+0000 7fb6fff64740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x560571fe02f0 con 0x56057211ffd0 2023-12-12T09:45:30.156 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:30.150+0000 7fb6fff64740 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x560571ffdc70 con 0x5605720deb40 2023-12-12T09:45:30.156 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:30.150+0000 7fb6fff64740 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x560571da6f20 con 0x5605720dde90 2023-12-12T09:45:30.156 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:30.150+0000 7fb6fff64740 10 client.0 _ll_register_callbacks cb 0x5605720023b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-12T09:45:30.156 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:30.150+0000 7fb6f77fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56057211ffd0 0x5605720fb910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:30.156 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:30.150+0000 7fb6f77fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56057211ffd0 0x5605720fb910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:40892/0 (socket says 172.21.15.73:40892) 2023-12-12T09:45:30.156 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:30.150+0000 7fb6f77fe640 1 -- 172.21.15.73:0/575544212 learned_addr learned my addr 172.21.15.73:0/575544212 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:45:30.156 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:30.151+0000 7fb6f6ffd640 1 --2- 172.21.15.73:0/575544212 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5605720dde90 0x560572121d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:30.157 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:30.151+0000 7fb6ee7fc640 1 --2- 172.21.15.73:0/575544212 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5605720deb40 0x56057212a7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:30.157 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:30.151+0000 7fb6f77fe640 1 -- 172.21.15.73:0/575544212 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5605720dde90 msgr2=0x560572121d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:45:30.157 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:30.151+0000 7fb6f77fe640 1 --2- 172.21.15.73:0/575544212 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5605720dde90 0x560572121d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:30.157 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:30.151+0000 7fb6f77fe640 1 -- 172.21.15.73:0/575544212 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5605720deb40 msgr2=0x56057212a7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:45:30.157 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:30.151+0000 7fb6f77fe640 1 --2- 172.21.15.73:0/575544212 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5605720deb40 0x56057212a7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:30.157 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:30.151+0000 7fb6f77fe640 1 -- 172.21.15.73:0/575544212 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6f8072550 con 0x56057211ffd0 2023-12-12T09:45:30.157 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:30.151+0000 7fb6f77fe640 1 --2- 172.21.15.73:0/575544212 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56057211ffd0 0x5605720fb910 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7fb6f002e0a0 tx=0x7fb6f0009810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=822ed3f39801b35 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:45:30.157 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:30.151+0000 7fb6d5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2023-12-12T09:45:30.157 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:30.151+0000 7fb6d5ffb640 1 -- 172.21.15.73:0/575544212 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6f007a270 con 0x56057211ffd0 2023-12-12T09:45:30.157 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:30.151+0000 7fb6d5ffb640 1 -- 172.21.15.73:0/575544212 <== mon.0 v2:172.21.15.73:3300/0 2 ==== osd_map(54..54 src has 1..54) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb6f00aa030 con 0x56057211ffd0 2023-12-12T09:45:30.157 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:30.151+0000 7fb6fff64740 1 -- 172.21.15.73:0/575544212 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56057203cdb0 con 0x56057211ffd0 2023-12-12T09:45:30.157 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:30.151+0000 7fb6d5ffb640 1 -- 172.21.15.73:0/575544212 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb6f007ecd0 con 0x56057211ffd0 2023-12-12T09:45:30.157 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:30.151+0000 7fb6fff64740 10 client.5844 fetch_fsmap learned FSMap version 30 2023-12-12T09:45:30.157 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:30.151+0000 7fb6fff64740 1 -- 172.21.15.73:0/575544212 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=2+}) v3 -- 0x5605720425a0 con 0x56057211ffd0 2023-12-12T09:45:30.157 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:30.152+0000 7fb6d5ffb640 1 -- 172.21.15.73:0/575544212 <== mon.0 v2:172.21.15.73:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x56057203cdb0 con 0x56057211ffd0 2023-12-12T09:45:30.158 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:30.152+0000 7fb6d5ffb640 1 -- 172.21.15.73:0/575544212 <== mon.0 v2:172.21.15.73:3300/0 5 ==== fsmap(e 30) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fb6f0099350 con 0x56057211ffd0 2023-12-12T09:45:30.158 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:30.152+0000 7fb6fff64740 10 client.5844 fetch_fsmap finished waiting for FSMap version 30 2023-12-12T09:45:30.158 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:30.152+0000 7fb6fff64740 10 client.5844 resolve_mds: resolved name 'a' to daemon mds.a 2023-12-12T09:45:30.158 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:30.152+0000 7fb6fff64740 20 client.5844 populate_metadata read hostname 'smithi073' 2023-12-12T09:45:30.158 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:30.152+0000 7fb6fff64740 1 --2- 172.21.15.73:0/575544212 >> [v2:172.21.15.73:6834/744058726,v1:172.21.15.73:6835/744058726] conn(0x5605721021c0 0x56057212d460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:30.158 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:30.152+0000 7fb6fff64740 4 client.5844 mds_command: new command op to 5703 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-12-12T09:45:30.158 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:30.152+0000 7fb6fff64740 1 -- 172.21.15.73:0/575544212 --> [v2:172.21.15.73:6834/744058726,v1:172.21.15.73:6835/744058726] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56057203cad0 con 0x5605721021c0 2023-12-12T09:45:30.158 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:30.152+0000 7fb6f6ffd640 1 --2- 172.21.15.73:0/575544212 >> [v2:172.21.15.73:6834/744058726,v1:172.21.15.73:6835/744058726] conn(0x5605721021c0 0x56057212d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:30.158 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:30.153+0000 7fb6f6ffd640 1 --2- 172.21.15.73:0/575544212 >> [v2:172.21.15.73:6834/744058726,v1:172.21.15.73:6835/744058726] conn(0x5605721021c0 0x56057212d460 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=74f1e0a413e09b9b server_cookie=c990079bf78a6656 in_seq=0 out_seq=0 2023-12-12T09:45:30.158 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:30.153+0000 7fb6d5ffb640 10 client.5844 ms_handle_connect on v2:172.21.15.73:6834/744058726 2023-12-12T09:45:30.159 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:30.153+0000 7fb6d5ffb640 1 -- 172.21.15.73:0/575544212 <== mds.0 v2:172.21.15.73:6834/744058726 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x56057203cad0 con 0x5605721021c0 2023-12-12T09:45:30.160 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:30.153+0000 7fb6d5ffb640 10 client.5844 handle_command_reply: tid=0 2023-12-12T09:45:30.160 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:30.154+0000 7fb6fff64740 1 client.5844 shutdown 2023-12-12T09:45:30.160 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:30.154+0000 7fb6fff64740 1 -- 172.21.15.73:0/575544212 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56057211ffd0 msgr2=0x5605720fb910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:30.160 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:30.154+0000 7fb6fff64740 1 --2- 172.21.15.73:0/575544212 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56057211ffd0 0x5605720fb910 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7fb6f002e0a0 tx=0x7fb6f0009810 comp rx=0 tx=0).stop 2023-12-12T09:45:30.160 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:30.154+0000 7fb6fff64740 1 -- 172.21.15.73:0/575544212 shutdown_connections 2023-12-12T09:45:30.160 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:30.154+0000 7fb6fff64740 1 --2- 172.21.15.73:0/575544212 >> [v2:172.21.15.73:6834/744058726,v1:172.21.15.73:6835/744058726] conn(0x5605721021c0 0x56057212d460 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:30.160 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:30.154+0000 7fb6fff64740 1 --2- 172.21.15.73:0/575544212 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56057211ffd0 0x5605720fb910 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:30.160 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:30.154+0000 7fb6fff64740 1 --2- 172.21.15.73:0/575544212 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5605720deb40 0x56057212a7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:30.160 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:30.154+0000 7fb6fff64740 1 --2- 172.21.15.73:0/575544212 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5605720dde90 0x560572121d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:30.160 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:30.154+0000 7fb6fff64740 1 -- 172.21.15.73:0/575544212 >> 172.21.15.73:0/575544212 conn(0x5605720ddab0 msgr2=0x56057211b4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:45:30.160 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:30.154+0000 7fb6d5ffb640 0 client.5844 ms_handle_reset on v2:172.21.15.73:6834/744058726 2023-12-12T09:45:30.160 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:30.154+0000 7fb6fff64740 1 -- 172.21.15.73:0/575544212 shutdown_connections 2023-12-12T09:45:30.160 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:30.154+0000 7fb6fff64740 1 -- 172.21.15.73:0/575544212 wait complete. 2023-12-12T09:45:30.161 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:30.154+0000 7fb6fff64740 20 client.5844 trim_cache size 0 max 16384 2023-12-12T09:45:30.172 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:30.171+0000 7fb6fff64740 1 Processor -- start 2023-12-12T09:45:30.172 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:30.171+0000 7fb6fff64740 1 -- start start 2023-12-12T09:45:30.173 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:30.172+0000 7fb6fff64740 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5605720dde90 0x560572118680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:30.173 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:30.172+0000 7fb6fff64740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5605720deb40 0x56057213cac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:30.173 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:30.172+0000 7fb6fff64740 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x56057211ffd0 0x56057211b4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:30.173 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:30.172+0000 7fb6fff64740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x5605720ff520 con 0x5605720deb40 2023-12-12T09:45:30.173 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:30.172+0000 7fb6fff64740 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x560572117880 con 0x5605720dde90 2023-12-12T09:45:30.173 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:30.172+0000 7fb6fff64740 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x56057211c920 con 0x56057211ffd0 2023-12-12T09:45:30.174 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:30.172+0000 7fb6ee7fc640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5605720deb40 0x56057213cac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:30.174 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:30.172+0000 7fb6ee7fc640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5605720deb40 0x56057213cac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:40906/0 (socket says 172.21.15.73:40906) 2023-12-12T09:45:30.174 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:30.172+0000 7fb6ee7fc640 1 -- 172.21.15.73:0/359213882 learned_addr learned my addr 172.21.15.73:0/359213882 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:45:30.175 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:30.172+0000 7fb6ee7fc640 1 -- 172.21.15.73:0/359213882 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x56057211ffd0 msgr2=0x56057211b4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:45:30.175 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:30.172+0000 7fb6ee7fc640 1 --2- 172.21.15.73:0/359213882 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x56057211ffd0 0x56057211b4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:30.175 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:30.172+0000 7fb6ee7fc640 1 -- 172.21.15.73:0/359213882 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5605720dde90 msgr2=0x560572118680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:45:30.175 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:30.172+0000 7fb6ee7fc640 1 --2- 172.21.15.73:0/359213882 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5605720dde90 0x560572118680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:30.175 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:30.172+0000 7fb6ee7fc640 1 -- 172.21.15.73:0/359213882 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560571fdfb80 con 0x5605720deb40 2023-12-12T09:45:30.175 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:30.173+0000 7fb6ee7fc640 1 --2- 172.21.15.73:0/359213882 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5605720deb40 0x56057213cac0 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7fb6e8006fd0 tx=0x7fb6e800ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de24f1491e29d01a server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:45:30.175 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:30.173+0000 7fb6ed7fa640 1 -- 172.21.15.73:0/359213882 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6e8010a40 con 0x5605720deb40 2023-12-12T09:45:30.176 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:30.173+0000 7fb6ed7fa640 1 -- 172.21.15.73:0/359213882 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6e800c040 con 0x5605720deb40 2023-12-12T09:45:30.176 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:30.173+0000 7fb6ed7fa640 1 -- 172.21.15.73:0/359213882 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6e8010da0 con 0x5605720deb40 2023-12-12T09:45:30.176 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:30.174+0000 7fb6fff64740 1 -- 172.21.15.73:0/359213882 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5605720deb40 msgr2=0x56057213cac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:30.176 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:30.174+0000 7fb6fff64740 1 --2- 172.21.15.73:0/359213882 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5605720deb40 0x56057213cac0 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7fb6e8006fd0 tx=0x7fb6e800ecf0 comp rx=0 tx=0).stop 2023-12-12T09:45:30.176 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:30.174+0000 7fb6fff64740 1 -- 172.21.15.73:0/359213882 shutdown_connections 2023-12-12T09:45:30.176 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:30.174+0000 7fb6fff64740 1 --2- 172.21.15.73:0/359213882 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x56057211ffd0 0x56057211b4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:30.176 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:30.174+0000 7fb6fff64740 1 --2- 172.21.15.73:0/359213882 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5605720deb40 0x56057213cac0 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:30.176 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:30.174+0000 7fb6fff64740 1 --2- 172.21.15.73:0/359213882 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5605720dde90 0x560572118680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:30.176 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:30.174+0000 7fb6fff64740 1 -- 172.21.15.73:0/359213882 >> 172.21.15.73:0/359213882 conn(0x5605720ddab0 msgr2=0x56057211f8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:45:30.176 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:30.174+0000 7fb6fff64740 1 -- 172.21.15.73:0/359213882 shutdown_connections 2023-12-12T09:45:30.176 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:30.174+0000 7fb6fff64740 1 -- 172.21.15.73:0/359213882 wait complete. 2023-12-12T09:45:30.178 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:30.174+0000 7fb6fff64740 1 -- start start 2023-12-12T09:45:30.178 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:30.175+0000 7fb6fff64740 1 Processor -- start 2023-12-12T09:45:30.178 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:30.175+0000 7fb6fff64740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5605720dde90 0x5605720fe720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:30.178 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:30.175+0000 7fb6fff64740 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5605720deb40 0x560572120530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:30.178 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:30.175+0000 7fb6fff64740 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56057211ffd0 0x56057218ff20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:30.178 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:30.175+0000 7fb6fff64740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x5605720ff2a0 con 0x5605720dde90 2023-12-12T09:45:30.178 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:30.175+0000 7fb6fff64740 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x56057211c5a0 con 0x56057211ffd0 2023-12-12T09:45:30.178 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:30.175+0000 7fb6fff64740 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x560572121100 con 0x5605720deb40 2023-12-12T09:45:30.178 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:30.176+0000 7fb6fff64740 10 client.0 _ll_register_callbacks cb 0x7fb6f0091070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-12T09:45:30.178 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:30.176+0000 7fb6f6ffd640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5605720dde90 0x5605720fe720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:30.179 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:30.176+0000 7fb6f6ffd640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5605720dde90 0x5605720fe720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:40912/0 (socket says 172.21.15.73:40912) 2023-12-12T09:45:30.179 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:30.176+0000 7fb6f6ffd640 1 -- 172.21.15.73:0/622627075 learned_addr learned my addr 172.21.15.73:0/622627075 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:45:30.179 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:30.176+0000 7fb6f6ffd640 1 -- 172.21.15.73:0/622627075 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5605720deb40 msgr2=0x560572120530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:45:30.179 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:30.176+0000 7fb6f6ffd640 1 --2- 172.21.15.73:0/622627075 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5605720deb40 0x560572120530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:30.179 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:30.176+0000 7fb6f6ffd640 1 -- 172.21.15.73:0/622627075 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56057211ffd0 msgr2=0x56057218ff20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:45:30.179 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:30.176+0000 7fb6f6ffd640 1 --2- 172.21.15.73:0/622627075 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56057211ffd0 0x56057218ff20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:30.179 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:30.176+0000 7fb6f6ffd640 1 -- 172.21.15.73:0/622627075 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6e800e4c0 con 0x5605720dde90 2023-12-12T09:45:30.179 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:30.176+0000 7fb6f6ffd640 1 --2- 172.21.15.73:0/622627075 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5605720dde90 0x5605720fe720 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7fb6e000d150 tx=0x7fb6e0003760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29c77770a5c7c62c server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:45:30.179 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:30.176+0000 7fb6d5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2023-12-12T09:45:30.179 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:30.177+0000 7fb6d5ffb640 1 -- 172.21.15.73:0/622627075 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6e0019040 con 0x5605720dde90 2023-12-12T09:45:30.179 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:30.177+0000 7fb6d5ffb640 1 -- 172.21.15.73:0/622627075 <== mon.0 v2:172.21.15.73:3300/0 2 ==== osd_map(54..54 src has 1..54) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb6e0024e40 con 0x5605720dde90 2023-12-12T09:45:30.179 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:30.177+0000 7fb6fff64740 1 -- 172.21.15.73:0/622627075 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fb6f0082e80 con 0x5605720dde90 2023-12-12T09:45:30.182 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:30.177+0000 7fb6d5ffb640 1 -- 172.21.15.73:0/622627075 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb6e0014d70 con 0x5605720dde90 2023-12-12T09:45:30.182 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:30.177+0000 7fb6fff64740 10 client.5850 fetch_fsmap learned FSMap version 30 2023-12-12T09:45:30.182 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:30.177+0000 7fb6fff64740 1 -- 172.21.15.73:0/622627075 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=2+}) v3 -- 0x560572005170 con 0x5605720dde90 2023-12-12T09:45:30.182 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:30.177+0000 7fb6d5ffb640 1 -- 172.21.15.73:0/622627075 <== mon.0 v2:172.21.15.73:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6f0082e80 con 0x5605720dde90 2023-12-12T09:45:30.182 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:30.177+0000 7fb6d5ffb640 1 -- 172.21.15.73:0/622627075 <== mon.0 v2:172.21.15.73:3300/0 5 ==== fsmap(e 30) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fb6e00240b0 con 0x5605720dde90 2023-12-12T09:45:30.182 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:30.178+0000 7fb6fff64740 10 client.5850 fetch_fsmap finished waiting for FSMap version 30 2023-12-12T09:45:30.182 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:30.178+0000 7fb6fff64740 10 client.5850 resolve_mds: resolved name 'a' to daemon mds.a 2023-12-12T09:45:30.182 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:30.178+0000 7fb6fff64740 20 client.5850 populate_metadata read hostname 'smithi073' 2023-12-12T09:45:30.182 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:30.178+0000 7fb6fff64740 1 --2- 172.21.15.73:0/622627075 >> [v2:172.21.15.73:6834/744058726,v1:172.21.15.73:6835/744058726] conn(0x560572190650 0x560572189590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:30.182 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:30.178+0000 7fb6fff64740 4 client.5850 mds_command: new command op to 5703 tid=0 multi_id=0 [{"prefix": "status"}] 2023-12-12T09:45:30.182 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:30.178+0000 7fb6fff64740 1 -- 172.21.15.73:0/622627075 --> [v2:172.21.15.73:6834/744058726,v1:172.21.15.73:6835/744058726] -- command(tid 0: {"prefix": "status"}) v1 -- 0x560571d446c0 con 0x560572190650 2023-12-12T09:45:30.182 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:30.178+0000 7fb6ee7fc640 1 --2- 172.21.15.73:0/622627075 >> [v2:172.21.15.73:6834/744058726,v1:172.21.15.73:6835/744058726] conn(0x560572190650 0x560572189590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:30.182 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:30.179+0000 7fb6ee7fc640 1 --2- 172.21.15.73:0/622627075 >> [v2:172.21.15.73:6834/744058726,v1:172.21.15.73:6835/744058726] conn(0x560572190650 0x560572189590 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c50105de784fe862 server_cookie=cc9ae546681cbc3e in_seq=0 out_seq=0 2023-12-12T09:45:30.183 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:30.179+0000 7fb6d5ffb640 10 client.5850 ms_handle_connect on v2:172.21.15.73:6834/744058726 2023-12-12T09:45:30.183 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:30.179+0000 7fb6d5ffb640 1 -- 172.21.15.73:0/622627075 <== mds.0 v2:172.21.15.73:6834/744058726 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x560571d446c0 con 0x560572190650 2023-12-12T09:45:30.183 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:30.179+0000 7fb6d5ffb640 10 client.5850 handle_command_reply: tid=0 2023-12-12T09:45:30.183 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:30.179+0000 7fb6fff64740 1 client.5850 shutdown 2023-12-12T09:45:30.183 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:30.179+0000 7fb6fff64740 1 -- 172.21.15.73:0/622627075 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5605720dde90 msgr2=0x5605720fe720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:30.183 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:30.179+0000 7fb6fff64740 1 --2- 172.21.15.73:0/622627075 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5605720dde90 0x5605720fe720 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7fb6e000d150 tx=0x7fb6e0003760 comp rx=0 tx=0).stop 2023-12-12T09:45:30.183 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:30.179+0000 7fb6fff64740 1 -- 172.21.15.73:0/622627075 shutdown_connections 2023-12-12T09:45:30.183 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:30.179+0000 7fb6fff64740 1 --2- 172.21.15.73:0/622627075 >> [v2:172.21.15.73:6834/744058726,v1:172.21.15.73:6835/744058726] conn(0x560572190650 0x560572189590 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:30.183 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:30.179+0000 7fb6fff64740 1 --2- 172.21.15.73:0/622627075 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56057211ffd0 0x56057218ff20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:30.183 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:30.179+0000 7fb6fff64740 1 --2- 172.21.15.73:0/622627075 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5605720deb40 0x560572120530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:30.183 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:30.179+0000 7fb6fff64740 1 --2- 172.21.15.73:0/622627075 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5605720dde90 0x5605720fe720 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:30.183 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:30.179+0000 7fb6d5ffb640 0 client.5850 ms_handle_reset on v2:172.21.15.73:6834/744058726 2023-12-12T09:45:30.183 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:30.179+0000 7fb6fff64740 1 -- 172.21.15.73:0/622627075 >> 172.21.15.73:0/622627075 conn(0x5605720ddab0 msgr2=0x56057211e350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:45:30.184 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:30.179+0000 7fb6fff64740 1 -- 172.21.15.73:0/622627075 shutdown_connections 2023-12-12T09:45:30.184 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:30.179+0000 7fb6fff64740 1 -- 172.21.15.73:0/622627075 wait complete. 2023-12-12T09:45:30.184 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:30.179+0000 7fb6fff64740 20 client.5850 trim_cache size 0 max 16384 2023-12-12T09:45:30.184 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2023-12-12T09:45:30.184 INFO:teuthology.orchestra.run.smithi073.stdout: "cluster_fsid": "ba240992-02b8-4c7e-92f2-27eb29ac433b", 2023-12-12T09:45:30.184 INFO:teuthology.orchestra.run.smithi073.stdout: "whoami": 0, 2023-12-12T09:45:30.184 INFO:teuthology.orchestra.run.smithi073.stdout: "id": 5703, 2023-12-12T09:45:30.184 INFO:teuthology.orchestra.run.smithi073.stdout: "want_state": "up:active", 2023-12-12T09:45:30.184 INFO:teuthology.orchestra.run.smithi073.stdout: "state": "up:active", 2023-12-12T09:45:30.184 INFO:teuthology.orchestra.run.smithi073.stdout: "fs_name": "cephfs", 2023-12-12T09:45:30.184 INFO:teuthology.orchestra.run.smithi073.stdout: "rank_uptime": 6.6706559629999997, 2023-12-12T09:45:30.185 INFO:teuthology.orchestra.run.smithi073.stdout: "mdsmap_epoch": 30, 2023-12-12T09:45:30.185 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap_epoch": 54, 2023-12-12T09:45:30.185 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap_epoch_barrier": 54, 2023-12-12T09:45:30.185 INFO:teuthology.orchestra.run.smithi073.stdout: "uptime": 12.191351661000001 2023-12-12T09:45:30.185 INFO:teuthology.orchestra.run.smithi073.stdout:} 2023-12-12T09:45:30.186 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:30.180+0000 7fb6fd3ce640 1 -- 172.21.15.73:0/1800656976 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fb6d806ae40 msgr2=0x7fb6d806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:30.186 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:30.180+0000 7fb6fd3ce640 1 --2- 172.21.15.73:0/1800656976 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fb6d806ae40 0x7fb6d806d300 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fb6e0003d90 tx=0x7fb6e0009040 comp rx=0 tx=0).stop 2023-12-12T09:45:30.186 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:30.180+0000 7fb6fd3ce640 1 -- 172.21.15.73:0/1800656976 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb6f814e9c0 msgr2=0x7fb6f80c4230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:30.186 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:30.180+0000 7fb6fd3ce640 1 --2- 172.21.15.73:0/1800656976 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb6f814e9c0 0x7fb6f80c4230 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7fb6f0038040 tx=0x7fb6f0004a40 comp rx=0 tx=0).stop 2023-12-12T09:45:30.186 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:30.180+0000 7fb6fd3ce640 1 -- 172.21.15.73:0/1800656976 shutdown_connections 2023-12-12T09:45:30.186 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:30.180+0000 7fb6fd3ce640 1 --2- 172.21.15.73:0/1800656976 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fb6d806ae40 0x7fb6d806d300 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:30.186 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:30.180+0000 7fb6fd3ce640 1 --2- 172.21.15.73:0/1800656976 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb6f814e9c0 0x7fb6f80c4230 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:30.186 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:30.180+0000 7fb6fd3ce640 1 --2- 172.21.15.73:0/1800656976 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb6f80c3920 0x7fb6f81eda40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:30.186 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:30.180+0000 7fb6fd3ce640 1 --2- 172.21.15.73:0/1800656976 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb6f80a4f00 0x7fb6f814c120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:30.186 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:30.180+0000 7fb6fd3ce640 1 -- 172.21.15.73:0/1800656976 >> 172.21.15.73:0/1800656976 conn(0x7fb6f80a77d0 msgr2=0x7fb6f81481b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:45:30.186 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:30.180+0000 7fb6fd3ce640 1 -- 172.21.15.73:0/1800656976 shutdown_connections 2023-12-12T09:45:30.187 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:30.180+0000 7fb6fd3ce640 1 -- 172.21.15.73:0/1800656976 wait complete. 2023-12-12T09:45:30.198 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-12-12T09:45:30.402 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:30.400+0000 7fa4183fb640 1 Processor -- start 2023-12-12T09:45:30.402 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:30.400+0000 7fa4183fb640 1 -- start start 2023-12-12T09:45:30.403 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:30.402+0000 7fa4183fb640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fa41014fa40 0x7fa41006a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:30.403 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:30.402+0000 7fa4183fb640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa4100c5070 0x7fa4100c40c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:30.403 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:30.402+0000 7fa4183fb640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa410152610 con 0x7fa41006db70 2023-12-12T09:45:30.403 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:30.402+0000 7fa4183fb640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4101528f0 con 0x7fa41014fa40 2023-12-12T09:45:30.403 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:30.402+0000 7fa4183fb640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa410152bd0 con 0x7fa4100c5070 2023-12-12T09:45:30.404 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:30.403+0000 7fa416197640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fa41014fa40 0x7fa41006a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:30.404 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:30.403+0000 7fa416998640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa4100c5070 0x7fa4100c40c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:30.404 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:30.403+0000 7fa416197640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fa41014fa40 0x7fa41006a4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.73:55132/0 (socket says 172.21.15.73:55132) 2023-12-12T09:45:30.404 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:30.403+0000 7fa416197640 1 -- 172.21.15.73:0/2905795065 learned_addr learned my addr 172.21.15.73:0/2905795065 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:45:30.405 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:30.404+0000 7fa416998640 1 -- 172.21.15.73:0/2905795065 >> v2:172.21.15.142:3300/0 conn(0x7fa41014fa40 msgr2=0x7fa41006a4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:45:30.405 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:30.404+0000 7fa416998640 1 --2- 172.21.15.73:0/2905795065 >> v2:172.21.15.142:3300/0 conn(0x7fa41014fa40 0x7fa41006a4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:30.405 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:30.404+0000 7fa416998640 1 -- 172.21.15.73:0/2905795065 >> v1:172.21.15.142:6789/0 conn(0x7fa41006db70 legacy=0x7fa4100c39b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:30.405 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:30.404+0000 7fa416998640 1 -- 172.21.15.73:0/2905795065 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa410152eb0 con 0x7fa4100c5070 2023-12-12T09:45:30.406 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:30.405+0000 7fa416998640 1 --2- 172.21.15.73:0/2905795065 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa4100c5070 0x7fa4100c40c0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fa4080097a0 tx=0x7fa40802b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=33b4b7a46c36fb63 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:45:30.406 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:30.405+0000 7fa415195640 1 -- 172.21.15.73:0/2905795065 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa408031830 con 0x7fa4100c5070 2023-12-12T09:45:30.407 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:30.406+0000 7fa415195640 1 -- 172.21.15.73:0/2905795065 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa408031990 con 0x7fa4100c5070 2023-12-12T09:45:30.407 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:30.406+0000 7fa415195640 1 -- 172.21.15.73:0/2905795065 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa408031d20 con 0x7fa4100c5070 2023-12-12T09:45:30.407 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:30.406+0000 7fa4183fb640 1 -- 172.21.15.73:0/2905795065 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa4100c5070 msgr2=0x7fa4100c40c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:30.407 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:30.406+0000 7fa4183fb640 1 --2- 172.21.15.73:0/2905795065 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa4100c5070 0x7fa4100c40c0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fa4080097a0 tx=0x7fa40802b8d0 comp rx=0 tx=0).stop 2023-12-12T09:45:30.408 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:30.406+0000 7fa4183fb640 1 -- 172.21.15.73:0/2905795065 shutdown_connections 2023-12-12T09:45:30.408 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:30.406+0000 7fa4183fb640 1 --2- 172.21.15.73:0/2905795065 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa4100c5070 0x7fa4100c40c0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:30.408 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:30.406+0000 7fa4183fb640 1 --2- 172.21.15.73:0/2905795065 >> v2:172.21.15.142:3300/0 conn(0x7fa41014fa40 0x7fa41006a4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:30.408 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:30.406+0000 7fa4183fb640 1 -- 172.21.15.73:0/2905795065 >> 172.21.15.73:0/2905795065 conn(0x7fa4100a8130 msgr2=0x7fa4100c24b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:45:30.408 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:30.406+0000 7fa4183fb640 1 -- 172.21.15.73:0/2905795065 shutdown_connections 2023-12-12T09:45:30.408 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:30.406+0000 7fa4183fb640 1 -- 172.21.15.73:0/2905795065 wait complete. 2023-12-12T09:45:30.409 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:30.408+0000 7fa4183fb640 1 Processor -- start 2023-12-12T09:45:30.409 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:30.408+0000 7fa4183fb640 1 -- start start 2023-12-12T09:45:30.412 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:30.409+0000 7fa4183fb640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa41006db70 0x7fa410151cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:30.412 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:30.409+0000 7fa4183fb640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa4100c5070 0x7fa4101e9bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:30.412 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:30.409+0000 7fa4183fb640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa41014fa40 0x7fa41014a400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:30.412 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:30.409+0000 7fa4183fb640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4101edb50 con 0x7fa41006db70 2023-12-12T09:45:30.412 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:30.409+0000 7fa4183fb640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4101ee080 con 0x7fa4100c5070 2023-12-12T09:45:30.412 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:30.409+0000 7fa4183fb640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4100aa9d0 con 0x7fa41014fa40 2023-12-12T09:45:30.412 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:30.409+0000 7fa416197640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa41006db70 0x7fa410151cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:30.412 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:30.409+0000 7fa416197640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa41006db70 0x7fa410151cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:40926/0 (socket says 172.21.15.73:40926) 2023-12-12T09:45:30.412 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:30.409+0000 7fa416197640 1 -- 172.21.15.73:0/2742808941 learned_addr learned my addr 172.21.15.73:0/2742808941 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:45:30.412 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:30.410+0000 7fa415996640 1 --2- 172.21.15.73:0/2742808941 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa4100c5070 0x7fa4101e9bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:30.412 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:30.410+0000 7fa416998640 1 --2- 172.21.15.73:0/2742808941 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa41014fa40 0x7fa41014a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:30.413 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:30.410+0000 7fa416197640 1 -- 172.21.15.73:0/2742808941 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa41014fa40 msgr2=0x7fa41014a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:30.413 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:30.410+0000 7fa416197640 1 --2- 172.21.15.73:0/2742808941 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa41014fa40 0x7fa41014a400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:30.413 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:30.410+0000 7fa416197640 1 -- 172.21.15.73:0/2742808941 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa4100c5070 msgr2=0x7fa4101e9bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:30.413 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:30.410+0000 7fa416197640 1 --2- 172.21.15.73:0/2742808941 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa4100c5070 0x7fa4101e9bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:30.413 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:30.410+0000 7fa416197640 1 -- 172.21.15.73:0/2742808941 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa408009400 con 0x7fa41006db70 2023-12-12T09:45:30.413 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:30.410+0000 7fa416197640 1 --2- 172.21.15.73:0/2742808941 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa41006db70 0x7fa410151cc0 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7fa40400efc0 tx=0x7fa40400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:45:30.413 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:30.410+0000 7fa40effd640 1 -- 172.21.15.73:0/2742808941 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa40400cda0 con 0x7fa41006db70 2023-12-12T09:45:30.413 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:30.410+0000 7fa40effd640 1 -- 172.21.15.73:0/2742808941 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa40400f040 con 0x7fa41006db70 2023-12-12T09:45:30.413 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:30.410+0000 7fa40effd640 1 -- 172.21.15.73:0/2742808941 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa404014680 con 0x7fa41006db70 2023-12-12T09:45:30.413 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:30.410+0000 7fa4183fb640 1 -- 172.21.15.73:0/2742808941 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4101edda0 con 0x7fa41006db70 2023-12-12T09:45:30.413 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:30.411+0000 7fa4183fb640 1 -- 172.21.15.73:0/2742808941 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa410071940 con 0x7fa41006db70 2023-12-12T09:45:30.414 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:30.412+0000 7fa4183fb640 1 -- 172.21.15.73:0/2742808941 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa410071b00 con 0x7fa41006db70 2023-12-12T09:45:30.414 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:30.413+0000 7fa40effd640 1 -- 172.21.15.73:0/2742808941 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fa4040147e0 con 0x7fa41006db70 2023-12-12T09:45:30.414 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:30.413+0000 7fa40effd640 1 --2- 172.21.15.73:0/2742808941 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fa3f406ae40 0x7fa3f406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:30.414 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:30.414+0000 7fa40effd640 1 -- 172.21.15.73:0/2742808941 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa404089d50 con 0x7fa41006db70 2023-12-12T09:45:30.415 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:30.414+0000 7fa415996640 1 --2- 172.21.15.73:0/2742808941 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fa3f406ae40 0x7fa3f406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:30.415 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:30.414+0000 7fa415996640 1 --2- 172.21.15.73:0/2742808941 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fa3f406ae40 0x7fa3f406d300 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fa41006d780 tx=0x7fa3fc009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:45:30.419 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:30.418+0000 7fa40effd640 1 -- 172.21.15.73:0/2742808941 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fa40408d030 con 0x7fa41006db70 2023-12-12T09:45:30.653 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:30.651+0000 7fa4183fb640 1 -- 172.21.15.73:0/2742808941 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fa410067580 con 0x7fa41006db70 2023-12-12T09:45:30.654 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:30.652+0000 7fa40effd640 1 -- 172.21.15.73:0/2742808941 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v30) v1 ==== 53+0+73 (secure 0 0 0) 0x7fa404054e90 con 0x7fa41006db70 2023-12-12T09:45:30.654 INFO:teuthology.orchestra.run.smithi073.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-12-12T09:45:30.657 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:30.655+0000 7fa4183fb640 1 -- 172.21.15.73:0/2742808941 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fa3f406ae40 msgr2=0x7fa3f406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:30.657 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:30.655+0000 7fa4183fb640 1 --2- 172.21.15.73:0/2742808941 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fa3f406ae40 0x7fa3f406d300 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fa41006d780 tx=0x7fa3fc009040 comp rx=0 tx=0).stop 2023-12-12T09:45:30.657 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:30.655+0000 7fa4183fb640 1 -- 172.21.15.73:0/2742808941 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa41006db70 msgr2=0x7fa410151cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:30.657 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:30.655+0000 7fa4183fb640 1 --2- 172.21.15.73:0/2742808941 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa41006db70 0x7fa410151cc0 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7fa40400efc0 tx=0x7fa40400c490 comp rx=0 tx=0).stop 2023-12-12T09:45:30.657 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:30.655+0000 7fa4183fb640 1 -- 172.21.15.73:0/2742808941 shutdown_connections 2023-12-12T09:45:30.657 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:30.655+0000 7fa4183fb640 1 --2- 172.21.15.73:0/2742808941 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fa3f406ae40 0x7fa3f406d300 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:30.657 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:30.655+0000 7fa4183fb640 1 --2- 172.21.15.73:0/2742808941 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa41014fa40 0x7fa41014a400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:30.657 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:30.655+0000 7fa4183fb640 1 --2- 172.21.15.73:0/2742808941 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa4100c5070 0x7fa4101e9bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:30.657 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:30.655+0000 7fa4183fb640 1 --2- 172.21.15.73:0/2742808941 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa41006db70 0x7fa410151cc0 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:30.657 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:30.655+0000 7fa4183fb640 1 -- 172.21.15.73:0/2742808941 >> 172.21.15.73:0/2742808941 conn(0x7fa4100a8130 msgr2=0x7fa4100a65f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:45:30.658 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:30.655+0000 7fa4183fb640 1 -- 172.21.15.73:0/2742808941 shutdown_connections 2023-12-12T09:45:30.658 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:30.655+0000 7fa4183fb640 1 -- 172.21.15.73:0/2742808941 wait complete. 2023-12-12T09:45:30.676 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-12-12T09:45:30.677 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-12T09:45:30.677 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi073.front.sepia.ceph.com 2023-12-12T09:45:30.677 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-12-12T09:45:30.677 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-12-12T09:45:30.677 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-12-12T09:45:30.677 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-12-12T09:45:30.677 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-12-12T09:45:30.677 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-12-12T09:45:30.677 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T09:45:30.678 DEBUG:teuthology.orchestra.run.smithi073:> ip addr 2023-12-12T09:45:30.731 INFO:teuthology.orchestra.run.smithi073.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-12T09:45:30.731 INFO:teuthology.orchestra.run.smithi073.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-12T09:45:30.731 INFO:teuthology.orchestra.run.smithi073.stdout: inet 127.0.0.1/8 scope host lo 2023-12-12T09:45:30.731 INFO:teuthology.orchestra.run.smithi073.stdout: valid_lft forever preferred_lft forever 2023-12-12T09:45:30.731 INFO:teuthology.orchestra.run.smithi073.stdout: inet6 ::1/128 scope host 2023-12-12T09:45:30.731 INFO:teuthology.orchestra.run.smithi073.stdout: valid_lft forever preferred_lft forever 2023-12-12T09:45:30.731 INFO:teuthology.orchestra.run.smithi073.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-12T09:45:30.731 INFO:teuthology.orchestra.run.smithi073.stdout: link/ether 0c:c4:7a:d8:d9:ea brd ff:ff:ff:ff:ff:ff 2023-12-12T09:45:30.731 INFO:teuthology.orchestra.run.smithi073.stdout: altname enp7s0f0 2023-12-12T09:45:30.731 INFO:teuthology.orchestra.run.smithi073.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-12T09:45:30.732 INFO:teuthology.orchestra.run.smithi073.stdout: link/ether 0c:c4:7a:d8:d9:eb brd ff:ff:ff:ff:ff:ff 2023-12-12T09:45:30.732 INFO:teuthology.orchestra.run.smithi073.stdout: altname enp7s0f1 2023-12-12T09:45:30.732 INFO:teuthology.orchestra.run.smithi073.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-12T09:45:30.732 INFO:teuthology.orchestra.run.smithi073.stdout: link/ether 0c:c4:7a:8f:ce:7c brd ff:ff:ff:ff:ff:ff 2023-12-12T09:45:30.732 INFO:teuthology.orchestra.run.smithi073.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-12T09:45:30.732 INFO:teuthology.orchestra.run.smithi073.stdout: link/ether 0c:c4:7a:8f:ce:7d brd ff:ff:ff:ff:ff:ff 2023-12-12T09:45:30.732 INFO:teuthology.orchestra.run.smithi073.stdout: inet 172.21.15.73/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-12-12T09:45:30.732 INFO:teuthology.orchestra.run.smithi073.stdout: valid_lft 42268sec preferred_lft 42268sec 2023-12-12T09:45:30.732 INFO:teuthology.orchestra.run.smithi073.stdout: inet6 fe80::ec4:7aff:fe8f:ce7d/64 scope link 2023-12-12T09:45:30.732 INFO:teuthology.orchestra.run.smithi073.stdout: valid_lft forever preferred_lft forever 2023-12-12T09:45:30.732 INFO:teuthology.orchestra.run.smithi073.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-12-12T09:45:30.732 INFO:teuthology.orchestra.run.smithi073.stdout: link/ether ae:cf:b6:bf:45:8d brd ff:ff:ff:ff:ff:ff 2023-12-12T09:45:30.732 INFO:teuthology.orchestra.run.smithi073.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-12-12T09:45:30.732 INFO:teuthology.orchestra.run.smithi073.stdout: valid_lft forever preferred_lft forever 2023-12-12T09:45:30.732 INFO:teuthology.orchestra.run.smithi073.stdout: inet6 fe80::f4:a9ff:febd:c3fb/64 scope link 2023-12-12T09:45:30.733 INFO:teuthology.orchestra.run.smithi073.stdout: valid_lft forever preferred_lft forever 2023-12-12T09:45:30.733 INFO:teuthology.orchestra.run.smithi073.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-12T09:45:30.733 INFO:teuthology.orchestra.run.smithi073.stdout: link/ether ae:cf:b6:bf:45:8d brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-12T09:45:30.733 INFO:teuthology.orchestra.run.smithi073.stdout: inet6 fe80::accf:b6ff:febf:458d/64 scope link 2023-12-12T09:45:30.733 INFO:teuthology.orchestra.run.smithi073.stdout: valid_lft forever preferred_lft forever 2023-12-12T09:45:30.734 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T09:45:30.734 DEBUG:teuthology.orchestra.run.smithi073:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-12T09:45:30.823 INFO:teuthology.orchestra.run.smithi073.stdout:1 2023-12-12T09:45:30.828 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T09:45:30.828 DEBUG:teuthology.orchestra.run.smithi073:> route 2023-12-12T09:45:30.885 INFO:teuthology.orchestra.run.smithi073.stdout:Kernel IP routing table 2023-12-12T09:45:30.885 INFO:teuthology.orchestra.run.smithi073.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-12T09:45:30.885 INFO:teuthology.orchestra.run.smithi073.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-12-12T09:45:30.885 INFO:teuthology.orchestra.run.smithi073.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-12-12T09:45:30.885 INFO:teuthology.orchestra.run.smithi073.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-12T09:45:30.885 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T09:45:30.886 DEBUG:teuthology.orchestra.run.smithi073:> (cd / && exec bash -c ' 2023-12-12T09:45:30.886 DEBUG:teuthology.orchestra.run.smithi073:> set -e 2023-12-12T09:45:30.886 DEBUG:teuthology.orchestra.run.smithi073:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-12-12T09:45:30.886 DEBUG:teuthology.orchestra.run.smithi073:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-12-12T09:45:30.886 DEBUG:teuthology.orchestra.run.smithi073:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-12-12T09:45:30.886 DEBUG:teuthology.orchestra.run.smithi073:> ') 2023-12-12T09:45:31.070 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T09:45:31.070 DEBUG:teuthology.orchestra.run.smithi073:> ip netns list 2023-12-12T09:45:31.120 INFO:teuthology.orchestra.run.smithi073.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-12-12T09:45:31.121 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-12-12T09:45:31.121 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T09:45:31.121 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip link set brx.0 up 2023-12-12T09:45:31.209 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-12T09:45:31.209 DEBUG:teuthology.orchestra.run.smithi073:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-12-12T09:45:31.262 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-12T09:45:31.263 DEBUG:teuthology.orchestra.run.smithi073:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-12-12T09:45:31.318 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2023-12-12T09:45:31.319 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T09:45:31.319 DEBUG:teuthology.orchestra.run.smithi073:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-12T09:45:31.458 INFO:teuthology.orchestra.run.smithi073.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-12T09:45:31.459 INFO:teuthology.orchestra.run.smithi073.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-12T09:45:31.492 INFO:teuthology.orchestra.run.smithi073.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-12T09:45:31.492 INFO:teuthology.orchestra.run.smithi073.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-12T09:45:31.492 INFO:teuthology.orchestra.run.smithi073.stdout:mount.ceph: resolved to: "172.21.15.73:3300,172.21.15.142:3300,172.21.15.142:3301" 2023-12-12T09:45:31.492 INFO:teuthology.orchestra.run.smithi073.stdout:mount.ceph: trying mount with new device syntax: 0@ba240992-02b8-4c7e-92f2-27eb29ac433b.cephfs=/ 2023-12-12T09:45:31.492 INFO:teuthology.orchestra.run.smithi073.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.73:3300/172.21.15.142:3300/172.21.15.142:3301" will pass to kernel 2023-12-12T09:45:31.494 INFO:teuthology.orchestra.run.smithi073.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2023-12-12T09:45:31.494 INFO:teuthology.orchestra.run.smithi073.stdout: You just mounted a file system that supports labels which does not 2023-12-12T09:45:31.494 INFO:teuthology.orchestra.run.smithi073.stdout: contain labels, onto an SELinux box. It is likely that confined 2023-12-12T09:45:31.494 INFO:teuthology.orchestra.run.smithi073.stdout: applications will generate AVC messages and not be allowed access to 2023-12-12T09:45:31.494 INFO:teuthology.orchestra.run.smithi073.stdout: this file system. For more details see restorecon(8) and mount(8). 2023-12-12T09:45:31.498 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-12-12T09:45:31.498 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T09:45:31.499 DEBUG:teuthology.orchestra.run.smithi073:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-12-12T09:45:31.576 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T09:45:31.576 DEBUG:teuthology.orchestra.run.smithi073:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-12T09:45:31.640 INFO:teuthology.orchestra.run.smithi073.stdout:client5134 2023-12-12T09:45:31.640 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2023-12-12T09:45:31.641 DEBUG:teuthology.orchestra.run.smithi073:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-12T09:45:31.695 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-12-12T09:45:31.905 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:31.904+0000 7f0fde583640 1 Processor -- start 2023-12-12T09:45:31.906 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:31.904+0000 7f0fde583640 1 -- start start 2023-12-12T09:45:31.907 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:31.905+0000 7f0fde583640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f0fd80a50f0 0x7f0fd80a9050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:31.907 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:31.906+0000 7f0fde583640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0fd80c0b50 con 0x7f0fd81552e0 2023-12-12T09:45:31.907 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:31.906+0000 7f0fde583640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0fd806c880 con 0x7f0fd806bf20 2023-12-12T09:45:31.907 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:31.906+0000 7f0fde583640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0fd80c04d0 con 0x7f0fd80a50f0 2023-12-12T09:45:31.907 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:31.906+0000 7f0fd7fff640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f0fd81552e0 0x7f0fd80c49c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:48976/0 (socket says 172.21.15.73:48976) 2023-12-12T09:45:31.907 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:31.906+0000 7f0fd7fff640 1 -- 172.21.15.73:0/2378091140 learned_addr learned my addr 172.21.15.73:0/2378091140 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-12T09:45:31.909 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:31.906+0000 7f0fd6ffd640 1 -- 172.21.15.73:0/2378091140 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1512586093 0 0) 0x7f0fd80c0b50 con 0x7f0fd81552e0 2023-12-12T09:45:31.909 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:31.906+0000 7f0fd6ffd640 1 -- 172.21.15.73:0/2378091140 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0fc0005730 con 0x7f0fd81552e0 2023-12-12T09:45:31.909 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:31.906+0000 7f0fd77fe640 1 --2- 172.21.15.73:0/2378091140 >> v2:172.21.15.142:3300/0 conn(0x7f0fd80a50f0 0x7f0fd80a9050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:31.909 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:31.907+0000 7f0fd6ffd640 1 -- 172.21.15.73:0/2378091140 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2559383334 0 0) 0x7f0fc0005730 con 0x7f0fd81552e0 2023-12-12T09:45:31.909 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:31.907+0000 7f0fd6ffd640 1 -- 172.21.15.73:0/2378091140 >> v2:172.21.15.142:3300/0 conn(0x7f0fd80a50f0 msgr2=0x7f0fd80a9050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:45:31.909 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:31.907+0000 7f0fd6ffd640 1 --2- 172.21.15.73:0/2378091140 >> v2:172.21.15.142:3300/0 conn(0x7f0fd80a50f0 0x7f0fd80a9050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:31.909 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:31.907+0000 7f0fd6ffd640 1 -- 172.21.15.73:0/2378091140 >> v1:172.21.15.142:6789/0 conn(0x7f0fd806bf20 legacy=0x7f0fd80a9590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:31.909 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:31.907+0000 7f0fd6ffd640 1 -- 172.21.15.73:0/2378091140 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fd806cb60 con 0x7f0fd81552e0 2023-12-12T09:45:31.910 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:31.907+0000 7f0fd6ffd640 1 -- 172.21.15.73:0/2378091140 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3186547832 0 0) 0x7f0fc8001670 con 0x7f0fd81552e0 2023-12-12T09:45:31.910 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:31.907+0000 7f0fd6ffd640 1 -- 172.21.15.73:0/2378091140 >> v1:172.21.15.73:6789/0 conn(0x7f0fd81552e0 legacy=0x7f0fd80c49c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:31.910 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:31.907+0000 7f0fd6ffd640 1 --2- 172.21.15.73:0/2378091140 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0fc0005b80 0x7f0fc0005fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:31.910 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:31.907+0000 7f0fd6ffd640 1 --2- 172.21.15.73:0/2378091140 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0fc00069d0 0x7f0fc0006e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:31.910 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:31.907+0000 7f0fd6ffd640 1 --2- 172.21.15.73:0/2378091140 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0fc0007390 0x7f0fc000db90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:31.910 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:31.907+0000 7f0fd6ffd640 1 -- 172.21.15.73:0/2378091140 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fd80c04d0 con 0x7f0fc0007390 2023-12-12T09:45:31.910 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:31.907+0000 7f0fd6ffd640 1 -- 172.21.15.73:0/2378091140 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fc000e330 con 0x7f0fc0005b80 2023-12-12T09:45:31.910 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:31.907+0000 7f0fd6ffd640 1 -- 172.21.15.73:0/2378091140 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0fc000e4f0 con 0x7f0fc00069d0 2023-12-12T09:45:31.910 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:31.907+0000 7f0fdcb20640 1 --2- 172.21.15.73:0/2378091140 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0fc0007390 0x7f0fc000db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:31.910 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:31.908+0000 7f0fd7fff640 1 --2- 172.21.15.73:0/2378091140 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0fc0005b80 0x7f0fc0005fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:31.910 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:31.908+0000 7f0fd77fe640 1 --2- 172.21.15.73:0/2378091140 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0fc00069d0 0x7f0fc0006e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:31.910 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:31.908+0000 7f0fdcb20640 1 -- 172.21.15.73:0/2378091140 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0fc00069d0 msgr2=0x7f0fc0006e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:45:31.910 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:31.908+0000 7f0fdcb20640 1 --2- 172.21.15.73:0/2378091140 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0fc00069d0 0x7f0fc0006e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:31.911 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:31.908+0000 7f0fdcb20640 1 -- 172.21.15.73:0/2378091140 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0fc0005b80 msgr2=0x7f0fc0005fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:45:31.911 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:31.908+0000 7f0fdcb20640 1 --2- 172.21.15.73:0/2378091140 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0fc0005b80 0x7f0fc0005fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:31.911 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:31.908+0000 7f0fdcb20640 1 -- 172.21.15.73:0/2378091140 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fc0005730 con 0x7f0fc0007390 2023-12-12T09:45:31.912 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:31.909+0000 7f0fdcb20640 1 -- 172.21.15.73:0/2378091140 reap_dead start 2023-12-12T09:45:31.912 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:31.909+0000 7f0fdcb20640 1 --2- 172.21.15.73:0/2378091140 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0fc0007390 0x7f0fc000db90 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f0fd0001e50 tx=0x7f0fc0007a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95b598213359834b server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:45:31.912 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:31.909+0000 7f0fd6ffd640 1 -- 172.21.15.73:0/2378091140 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fd0003b70 con 0x7f0fc0007390 2023-12-12T09:45:31.912 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:31.909+0000 7f0fd6ffd640 1 -- 172.21.15.73:0/2378091140 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fd0003d10 con 0x7f0fc0007390 2023-12-12T09:45:31.912 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:31.909+0000 7f0fd6ffd640 1 -- 172.21.15.73:0/2378091140 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fd0005310 con 0x7f0fc0007390 2023-12-12T09:45:31.912 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:31.909+0000 7f0fde583640 1 -- 172.21.15.73:0/2378091140 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0fc0007390 msgr2=0x7f0fc000db90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:31.912 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:31.909+0000 7f0fde583640 1 --2- 172.21.15.73:0/2378091140 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0fc0007390 0x7f0fc000db90 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f0fd0001e50 tx=0x7f0fc0007a00 comp rx=0 tx=0).stop 2023-12-12T09:45:31.912 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:31.910+0000 7f0fde583640 1 -- 172.21.15.73:0/2378091140 shutdown_connections 2023-12-12T09:45:31.912 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:31.910+0000 7f0fde583640 1 --2- 172.21.15.73:0/2378091140 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0fc0007390 0x7f0fc000db90 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:31.912 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:31.910+0000 7f0fde583640 1 -- 172.21.15.73:0/2378091140 >> 172.21.15.73:0/2378091140 conn(0x7f0fd80a8130 msgr2=0x7f0fd80c24b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:45:31.913 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:31.910+0000 7f0fde583640 1 -- 172.21.15.73:0/2378091140 shutdown_connections 2023-12-12T09:45:31.913 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:31.910+0000 7f0fde583640 1 -- 172.21.15.73:0/2378091140 wait complete. 2023-12-12T09:45:31.913 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:31.911+0000 7f0fde583640 1 Processor -- start 2023-12-12T09:45:31.913 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:31.912+0000 7f0fde583640 1 -- start start 2023-12-12T09:45:31.914 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:31.913+0000 7f0fde583640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0fc0007390 0x7f0fd81dbd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:31.915 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:31.913+0000 7f0fde583640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0fd814e4f0 0x7f0fd81e61f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:31.915 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:31.913+0000 7f0fde583640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0fd81e6730 0x7f0fd81e9410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:31.915 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:31.913+0000 7f0fde583640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fd81dcb40 con 0x7f0fc0007390 2023-12-12T09:45:31.915 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:31.913+0000 7f0fde583640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fd8071460 con 0x7f0fd81e6730 2023-12-12T09:45:31.915 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:31.913+0000 7f0fde583640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0fd81e5b30 con 0x7f0fd814e4f0 2023-12-12T09:45:31.915 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:31.913+0000 7f0fd7fff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0fc0007390 0x7f0fd81dbd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:31.915 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:31.913+0000 7f0fd7fff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0fc0007390 0x7f0fd81dbd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:40952/0 (socket says 172.21.15.73:40952) 2023-12-12T09:45:31.915 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:31.913+0000 7f0fd7fff640 1 -- 172.21.15.73:0/3778747908 learned_addr learned my addr 172.21.15.73:0/3778747908 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:45:31.915 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:31.913+0000 7f0fd7fff640 1 -- 172.21.15.73:0/3778747908 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0fd814e4f0 msgr2=0x7f0fd81e61f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:31.915 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:31.913+0000 7f0fd7fff640 1 --2- 172.21.15.73:0/3778747908 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0fd814e4f0 0x7f0fd81e61f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:31.915 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:31.913+0000 7f0fd7fff640 1 -- 172.21.15.73:0/3778747908 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0fd81e6730 msgr2=0x7f0fd81e9410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:31.915 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:31.913+0000 7f0fd7fff640 1 --2- 172.21.15.73:0/3778747908 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0fd81e6730 0x7f0fd81e9410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:31.915 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:31.913+0000 7f0fd7fff640 1 -- 172.21.15.73:0/3778747908 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fd8070bc0 con 0x7f0fc0007390 2023-12-12T09:45:31.915 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:31.913+0000 7f0fd7fff640 1 --2- 172.21.15.73:0/3778747908 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0fc0007390 0x7f0fd81dbd10 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f0fc800e7f0 tx=0x7f0fc800ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:45:31.916 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:31.914+0000 7f0fd4ff9640 1 -- 172.21.15.73:0/3778747908 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fc800eea0 con 0x7f0fc0007390 2023-12-12T09:45:31.916 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:31.914+0000 7f0fd4ff9640 1 -- 172.21.15.73:0/3778747908 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fc800c870 con 0x7f0fc0007390 2023-12-12T09:45:31.916 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:31.914+0000 7f0fd4ff9640 1 -- 172.21.15.73:0/3778747908 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fc800cc00 con 0x7f0fc0007390 2023-12-12T09:45:31.916 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:31.914+0000 7f0fde583640 1 -- 172.21.15.73:0/3778747908 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0fd8070ea0 con 0x7f0fc0007390 2023-12-12T09:45:31.917 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:31.914+0000 7f0fde583640 1 -- 172.21.15.73:0/3778747908 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0fd81dc250 con 0x7f0fc0007390 2023-12-12T09:45:31.917 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:31.915+0000 7f0fde583640 1 -- 172.21.15.73:0/3778747908 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0fd81e9130 con 0x7f0fc0007390 2023-12-12T09:45:31.917 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:31.916+0000 7f0fd4ff9640 1 -- 172.21.15.73:0/3778747908 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f0fc801d460 con 0x7f0fc0007390 2023-12-12T09:45:31.918 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:31.917+0000 7f0fd4ff9640 1 --2- 172.21.15.73:0/3778747908 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f0fc406f250 0x7f0fc4071710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:31.918 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:31.917+0000 7f0fd4ff9640 1 -- 172.21.15.73:0/3778747908 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0fc8089580 con 0x7f0fc0007390 2023-12-12T09:45:31.918 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:31.917+0000 7f0fd77fe640 1 --2- 172.21.15.73:0/3778747908 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f0fc406f250 0x7f0fc4071710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:31.918 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:31.918+0000 7f0fd77fe640 1 --2- 172.21.15.73:0/3778747908 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f0fc406f250 0x7f0fc4071710 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f0fd8150d00 tx=0x7f0fcc008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:45:31.922 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:31.921+0000 7f0fd4ff9640 1 -- 172.21.15.73:0/3778747908 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f0fd81e9130 con 0x7f0fc0007390 2023-12-12T09:45:32.152 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:32.151+0000 7f0fde583640 1 -- 172.21.15.73:0/3778747908 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f0fd81e9130 con 0x7f0fc0007390 2023-12-12T09:45:32.153 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:32.152+0000 7f0fd4ff9640 1 -- 172.21.15.73:0/3778747908 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v30) v1 ==== 53+0+73 (secure 0 0 0) 0x7f0fd81e9130 con 0x7f0fc0007390 2023-12-12T09:45:32.153 INFO:teuthology.orchestra.run.smithi073.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-12-12T09:45:32.156 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:32.154+0000 7f0fde583640 1 -- 172.21.15.73:0/3778747908 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f0fc406f250 msgr2=0x7f0fc4071710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:32.156 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:32.154+0000 7f0fde583640 1 --2- 172.21.15.73:0/3778747908 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f0fc406f250 0x7f0fc4071710 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f0fd8150d00 tx=0x7f0fcc008040 comp rx=0 tx=0).stop 2023-12-12T09:45:32.156 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:32.154+0000 7f0fde583640 1 -- 172.21.15.73:0/3778747908 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0fc0007390 msgr2=0x7f0fd81dbd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:32.156 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:32.154+0000 7f0fde583640 1 --2- 172.21.15.73:0/3778747908 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0fc0007390 0x7f0fd81dbd10 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f0fc800e7f0 tx=0x7f0fc800ecb0 comp rx=0 tx=0).stop 2023-12-12T09:45:32.156 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:32.154+0000 7f0fde583640 1 -- 172.21.15.73:0/3778747908 shutdown_connections 2023-12-12T09:45:32.156 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:32.154+0000 7f0fde583640 1 --2- 172.21.15.73:0/3778747908 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f0fc406f250 0x7f0fc4071710 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:32.156 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:32.154+0000 7f0fde583640 1 --2- 172.21.15.73:0/3778747908 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0fd81e6730 0x7f0fd81e9410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:32.156 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:32.154+0000 7f0fde583640 1 --2- 172.21.15.73:0/3778747908 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0fd814e4f0 0x7f0fd81e61f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:32.156 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:32.154+0000 7f0fde583640 1 --2- 172.21.15.73:0/3778747908 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0fc0007390 0x7f0fd81dbd10 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:32.156 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:32.154+0000 7f0fde583640 1 -- 172.21.15.73:0/3778747908 >> 172.21.15.73:0/3778747908 conn(0x7f0fd80a8130 msgr2=0x7f0fd80c4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:45:32.157 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:32.155+0000 7f0fde583640 1 -- 172.21.15.73:0/3778747908 shutdown_connections 2023-12-12T09:45:32.157 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:32.155+0000 7f0fde583640 1 -- 172.21.15.73:0/3778747908 wait complete. 2023-12-12T09:45:32.174 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-12-12T09:45:32.174 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-12T09:45:32.174 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi142.front.sepia.ceph.com 2023-12-12T09:45:32.174 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-12-12T09:45:32.175 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-12-12T09:45:32.175 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-12-12T09:45:32.175 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-12-12T09:45:32.175 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-12-12T09:45:32.175 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-12-12T09:45:32.175 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T09:45:32.175 DEBUG:teuthology.orchestra.run.smithi142:> ip addr 2023-12-12T09:45:32.238 INFO:teuthology.orchestra.run.smithi142.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-12T09:45:32.240 INFO:teuthology.orchestra.run.smithi142.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-12T09:45:32.240 INFO:teuthology.orchestra.run.smithi142.stdout: inet 127.0.0.1/8 scope host lo 2023-12-12T09:45:32.240 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2023-12-12T09:45:32.240 INFO:teuthology.orchestra.run.smithi142.stdout: inet6 ::1/128 scope host 2023-12-12T09:45:32.240 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2023-12-12T09:45:32.240 INFO:teuthology.orchestra.run.smithi142.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-12T09:45:32.240 INFO:teuthology.orchestra.run.smithi142.stdout: link/ether 0c:c4:7a:d9:36:3c brd ff:ff:ff:ff:ff:ff 2023-12-12T09:45:32.240 INFO:teuthology.orchestra.run.smithi142.stdout: altname enp7s0f0 2023-12-12T09:45:32.240 INFO:teuthology.orchestra.run.smithi142.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-12T09:45:32.241 INFO:teuthology.orchestra.run.smithi142.stdout: link/ether 0c:c4:7a:d9:36:3d brd ff:ff:ff:ff:ff:ff 2023-12-12T09:45:32.241 INFO:teuthology.orchestra.run.smithi142.stdout: altname enp7s0f1 2023-12-12T09:45:32.241 INFO:teuthology.orchestra.run.smithi142.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-12T09:45:32.241 INFO:teuthology.orchestra.run.smithi142.stdout: link/ether 0c:c4:7a:88:6e:0c brd ff:ff:ff:ff:ff:ff 2023-12-12T09:45:32.241 INFO:teuthology.orchestra.run.smithi142.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-12T09:45:32.241 INFO:teuthology.orchestra.run.smithi142.stdout: link/ether 0c:c4:7a:88:6e:0d brd ff:ff:ff:ff:ff:ff 2023-12-12T09:45:32.241 INFO:teuthology.orchestra.run.smithi142.stdout: inet 172.21.15.142/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-12-12T09:45:32.241 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft 42270sec preferred_lft 42270sec 2023-12-12T09:45:32.241 INFO:teuthology.orchestra.run.smithi142.stdout: inet6 fe80::ec4:7aff:fe88:6e0d/64 scope link 2023-12-12T09:45:32.241 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2023-12-12T09:45:32.241 INFO:teuthology.orchestra.run.smithi142.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-12-12T09:45:32.242 INFO:teuthology.orchestra.run.smithi142.stdout: link/ether de:1c:dd:95:c8:e6 brd ff:ff:ff:ff:ff:ff 2023-12-12T09:45:32.242 INFO:teuthology.orchestra.run.smithi142.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-12-12T09:45:32.242 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2023-12-12T09:45:32.243 INFO:teuthology.orchestra.run.smithi142.stdout: inet6 fe80::f8b8:b6ff:fe33:420d/64 scope link 2023-12-12T09:45:32.243 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2023-12-12T09:45:32.243 INFO:teuthology.orchestra.run.smithi142.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-12T09:45:32.243 INFO:teuthology.orchestra.run.smithi142.stdout: link/ether de:1c:dd:95:c8:e6 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-12-12T09:45:32.243 INFO:teuthology.orchestra.run.smithi142.stdout: inet6 fe80::dc1c:ddff:fe95:c8e6/64 scope link 2023-12-12T09:45:32.243 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2023-12-12T09:45:32.245 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T09:45:32.245 DEBUG:teuthology.orchestra.run.smithi142:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-12T09:45:32.335 INFO:teuthology.orchestra.run.smithi142.stdout:1 2023-12-12T09:45:32.339 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T09:45:32.339 DEBUG:teuthology.orchestra.run.smithi142:> route 2023-12-12T09:45:32.394 INFO:teuthology.orchestra.run.smithi142.stdout:Kernel IP routing table 2023-12-12T09:45:32.395 INFO:teuthology.orchestra.run.smithi142.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-12T09:45:32.395 INFO:teuthology.orchestra.run.smithi142.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-12-12T09:45:32.395 INFO:teuthology.orchestra.run.smithi142.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-12-12T09:45:32.395 INFO:teuthology.orchestra.run.smithi142.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-12T09:45:32.396 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T09:45:32.396 DEBUG:teuthology.orchestra.run.smithi142:> (cd / && exec bash -c ' 2023-12-12T09:45:32.396 DEBUG:teuthology.orchestra.run.smithi142:> set -e 2023-12-12T09:45:32.396 DEBUG:teuthology.orchestra.run.smithi142:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-12-12T09:45:32.396 DEBUG:teuthology.orchestra.run.smithi142:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-12-12T09:45:32.396 DEBUG:teuthology.orchestra.run.smithi142:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-12-12T09:45:32.397 DEBUG:teuthology.orchestra.run.smithi142:> ') 2023-12-12T09:45:32.584 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T09:45:32.584 DEBUG:teuthology.orchestra.run.smithi142:> ip netns list 2023-12-12T09:45:32.638 INFO:teuthology.orchestra.run.smithi142.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-12-12T09:45:32.639 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-12-12T09:45:32.639 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T09:45:32.639 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip link set brx.0 up 2023-12-12T09:45:32.733 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-12T09:45:32.733 DEBUG:teuthology.orchestra.run.smithi142:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-12-12T09:45:32.789 INFO:teuthology.orchestra.run.smithi142.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-12-12T09:45:32.789 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-12T09:45:32.789 DEBUG:teuthology.orchestra.run.smithi142:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-12-12T09:45:32.840 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2023-12-12T09:45:32.841 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T09:45:32.841 DEBUG:teuthology.orchestra.run.smithi142:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-12T09:45:32.985 INFO:teuthology.orchestra.run.smithi142.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-12T09:45:32.985 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-12T09:45:33.020 INFO:teuthology.orchestra.run.smithi142.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-12T09:45:33.020 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-12T09:45:33.020 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: resolved to: "172.21.15.73:3300,172.21.15.142:3300,172.21.15.142:3301" 2023-12-12T09:45:33.021 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: trying mount with new device syntax: 1@ba240992-02b8-4c7e-92f2-27eb29ac433b.cephfs=/ 2023-12-12T09:45:33.021 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.73:3300/172.21.15.142:3300/172.21.15.142:3301" will pass to kernel 2023-12-12T09:45:33.022 INFO:teuthology.orchestra.run.smithi142.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2023-12-12T09:45:33.022 INFO:teuthology.orchestra.run.smithi142.stdout: You just mounted a file system that supports labels which does not 2023-12-12T09:45:33.022 INFO:teuthology.orchestra.run.smithi142.stdout: contain labels, onto an SELinux box. It is likely that confined 2023-12-12T09:45:33.022 INFO:teuthology.orchestra.run.smithi142.stdout: applications will generate AVC messages and not be allowed access to 2023-12-12T09:45:33.023 INFO:teuthology.orchestra.run.smithi142.stdout: this file system. For more details see restorecon(8) and mount(8). 2023-12-12T09:45:33.026 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-12-12T09:45:33.026 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T09:45:33.026 DEBUG:teuthology.orchestra.run.smithi142:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-12-12T09:45:33.105 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T09:45:33.105 DEBUG:teuthology.orchestra.run.smithi142:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-12T09:45:33.164 INFO:teuthology.orchestra.run.smithi142.stdout:client5862 2023-12-12T09:45:33.164 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2023-12-12T09:45:33.164 DEBUG:teuthology.orchestra.run.smithi142:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-12T09:45:33.220 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth rm client.testuser 2023-12-12T09:45:33.438 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:33.437+0000 7f5ee9ad3640 1 Processor -- start 2023-12-12T09:45:33.439 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:33.437+0000 7f5ee9ad3640 1 -- start start 2023-12-12T09:45:33.440 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:33.438+0000 7f5ee9ad3640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5ee406fca0 0x7f5ee4072700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:33.440 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:33.438+0000 7f5ee9ad3640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f5ee40c17e0 0x7f5ee4070080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:33.440 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:33.439+0000 7f5ee9ad3640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ee4152560 con 0x7f5ee40c0420 2023-12-12T09:45:33.440 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:33.439+0000 7f5ee9ad3640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ee4152ec0 con 0x7f5ee40c17e0 2023-12-12T09:45:33.440 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:33.439+0000 7f5ee9ad3640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ee40c53d0 con 0x7f5ee406fca0 2023-12-12T09:45:33.441 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:33.439+0000 7f5ee3fff640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f5ee40c17e0 0x7f5ee4070080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:33.441 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:33.439+0000 7f5ee3fff640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f5ee40c17e0 0x7f5ee4070080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:40964/0 (socket says 172.21.15.73:40964) 2023-12-12T09:45:33.441 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:33.439+0000 7f5ee3fff640 1 -- 172.21.15.73:0/2293978712 learned_addr learned my addr 172.21.15.73:0/2293978712 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:45:33.441 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:33.439+0000 7f5ee37fe640 1 --2- 172.21.15.73:0/2293978712 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5ee406fca0 0x7f5ee4072700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:33.441 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:33.439+0000 7f5ee3fff640 1 -- 172.21.15.73:0/2293978712 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5ee406fca0 msgr2=0x7f5ee4072700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:45:33.441 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:33.439+0000 7f5ee3fff640 1 --2- 172.21.15.73:0/2293978712 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5ee406fca0 0x7f5ee4072700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:33.441 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:33.439+0000 7f5ee3fff640 1 -- 172.21.15.73:0/2293978712 >> v1:172.21.15.142:6789/0 conn(0x7f5ee40c0420 legacy=0x7f5ee40c10d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:45:33.441 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:33.439+0000 7f5ee3fff640 1 -- 172.21.15.73:0/2293978712 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ee41532e0 con 0x7f5ee40c17e0 2023-12-12T09:45:33.442 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:33.441+0000 7f5ee3fff640 1 --2- 172.21.15.73:0/2293978712 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5ee40c17e0 0x7f5ee4070080 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f5edc009e50 tx=0x7f5edc02be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d002f3d1a3a214ea server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:45:33.442 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:33.441+0000 7f5ee2ffd640 1 -- 172.21.15.73:0/2293978712 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5edc02c9e0 con 0x7f5ee40c17e0 2023-12-12T09:45:33.442 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:33.441+0000 7f5ee2ffd640 1 -- 172.21.15.73:0/2293978712 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5edc02cb40 con 0x7f5ee40c17e0 2023-12-12T09:45:33.442 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:33.441+0000 7f5ee2ffd640 1 -- 172.21.15.73:0/2293978712 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5edc0343f0 con 0x7f5ee40c17e0 2023-12-12T09:45:33.443 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:33.442+0000 7f5ee9ad3640 1 -- 172.21.15.73:0/2293978712 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5ee40c17e0 msgr2=0x7f5ee4070080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:33.443 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:33.442+0000 7f5ee9ad3640 1 --2- 172.21.15.73:0/2293978712 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5ee40c17e0 0x7f5ee4070080 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f5edc009e50 tx=0x7f5edc02be40 comp rx=0 tx=0).stop 2023-12-12T09:45:33.443 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:33.442+0000 7f5ee9ad3640 1 -- 172.21.15.73:0/2293978712 shutdown_connections 2023-12-12T09:45:33.443 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:33.442+0000 7f5ee9ad3640 1 --2- 172.21.15.73:0/2293978712 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5ee40c17e0 0x7f5ee4070080 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:33.443 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:33.442+0000 7f5ee9ad3640 1 --2- 172.21.15.73:0/2293978712 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5ee406fca0 0x7f5ee4072700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:33.443 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:33.442+0000 7f5ee9ad3640 1 -- 172.21.15.73:0/2293978712 >> 172.21.15.73:0/2293978712 conn(0x7f5ee40a77d0 msgr2=0x7f5ee40a7bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:45:33.444 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:33.442+0000 7f5ee9ad3640 1 -- 172.21.15.73:0/2293978712 shutdown_connections 2023-12-12T09:45:33.444 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:33.442+0000 7f5ee9ad3640 1 -- 172.21.15.73:0/2293978712 wait complete. 2023-12-12T09:45:33.444 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:33.443+0000 7f5ee9ad3640 1 Processor -- start 2023-12-12T09:45:33.445 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:33.444+0000 7f5ee9ad3640 1 -- start start 2023-12-12T09:45:33.446 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:33.444+0000 7f5ee9ad3640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5ee406fca0 0x7f5ee41ea9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:33.446 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:33.444+0000 7f5ee9ad3640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5ee40c0420 0x7f5ee4154c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:33.446 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:33.444+0000 7f5ee9ad3640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5ee40c17e0 0x7f5ee41eda20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:33.446 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:33.444+0000 7f5ee9ad3640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ee41eaee0 con 0x7f5ee40c0420 2023-12-12T09:45:33.446 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:33.444+0000 7f5ee9ad3640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ee40aa260 con 0x7f5ee406fca0 2023-12-12T09:45:33.446 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:33.444+0000 7f5ee9ad3640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ee41ed590 con 0x7f5ee40c17e0 2023-12-12T09:45:33.446 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:33.445+0000 7f5edbfff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5ee40c0420 0x7f5ee4154c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:33.447 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:33.445+0000 7f5edbfff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5ee40c0420 0x7f5ee4154c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:40978/0 (socket says 172.21.15.73:40978) 2023-12-12T09:45:33.447 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:33.445+0000 7f5edbfff640 1 -- 172.21.15.73:0/2744691746 learned_addr learned my addr 172.21.15.73:0/2744691746 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:45:33.448 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:33.445+0000 7f5edbfff640 1 -- 172.21.15.73:0/2744691746 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5ee40c17e0 msgr2=0x7f5ee41eda20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:33.448 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:33.445+0000 7f5edbfff640 1 --2- 172.21.15.73:0/2744691746 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5ee40c17e0 0x7f5ee41eda20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:33.448 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:33.445+0000 7f5edbfff640 1 -- 172.21.15.73:0/2744691746 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5ee406fca0 msgr2=0x7f5ee41ea9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:33.448 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:33.445+0000 7f5edbfff640 1 --2- 172.21.15.73:0/2744691746 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5ee406fca0 0x7f5ee41ea9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:33.448 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:33.445+0000 7f5edbfff640 1 -- 172.21.15.73:0/2744691746 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5edc009b30 con 0x7f5ee40c0420 2023-12-12T09:45:33.448 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:33.445+0000 7f5edbfff640 1 --2- 172.21.15.73:0/2744691746 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5ee40c0420 0x7f5ee4154c40 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f5ecc00c430 tx=0x7f5ecc00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:45:33.448 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:33.446+0000 7f5ee0ff9640 1 -- 172.21.15.73:0/2744691746 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ecc011790 con 0x7f5ee40c0420 2023-12-12T09:45:33.449 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:33.446+0000 7f5ee0ff9640 1 -- 172.21.15.73:0/2744691746 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ecc0118f0 con 0x7f5ee40c0420 2023-12-12T09:45:33.449 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:33.446+0000 7f5ee0ff9640 1 -- 172.21.15.73:0/2744691746 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ecc011ce0 con 0x7f5ee40c0420 2023-12-12T09:45:33.449 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:33.446+0000 7f5ee9ad3640 1 -- 172.21.15.73:0/2744691746 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ee4156370 con 0x7f5ee40c0420 2023-12-12T09:45:33.449 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:33.446+0000 7f5ee9ad3640 1 -- 172.21.15.73:0/2744691746 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ee40ab7e0 con 0x7f5ee40c0420 2023-12-12T09:45:33.449 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:33.447+0000 7f5ee9ad3640 1 -- 172.21.15.73:0/2744691746 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ee4067580 con 0x7f5ee40c0420 2023-12-12T09:45:33.449 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:33.448+0000 7f5ee0ff9640 1 -- 172.21.15.73:0/2744691746 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f5ecc01c460 con 0x7f5ee40c0420 2023-12-12T09:45:33.451 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:33.449+0000 7f5ee0ff9640 1 --2- 172.21.15.73:0/2744691746 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f5ec406ae40 0x7f5ec406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:33.452 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:33.449+0000 7f5ee0ff9640 1 -- 172.21.15.73:0/2744691746 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5ecc089540 con 0x7f5ee40c0420 2023-12-12T09:45:33.452 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:33.449+0000 7f5ee37fe640 1 --2- 172.21.15.73:0/2744691746 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f5ec406ae40 0x7f5ec406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:33.452 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:33.450+0000 7f5ee37fe640 1 --2- 172.21.15.73:0/2744691746 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f5ec406ae40 0x7f5ec406d300 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f5ed4006fd0 tx=0x7f5ed4008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:45:33.455 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:33.454+0000 7f5ee0ff9640 1 -- 172.21.15.73:0/2744691746 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f5ecc054680 con 0x7f5ee40c0420 2023-12-12T09:45:33.716 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:33.715+0000 7f5ee9ad3640 1 -- 172.21.15.73:0/2744691746 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "auth rm", "entity": "client.testuser"} v 0) v1 -- 0x7f5ee40c5520 con 0x7f5ee40c0420 2023-12-12T09:45:33.718 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:33.716+0000 7f5ee0ff9640 1 -- 172.21.15.73:0/2744691746 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "auth rm", "entity": "client.testuser"}]=0 v15) v1 ==== 84+0+0 (secure 0 0 0) 0x7f5ecc057ca0 con 0x7f5ee40c0420 2023-12-12T09:45:33.719 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:33.718+0000 7f5ee9ad3640 1 -- 172.21.15.73:0/2744691746 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f5ec406ae40 msgr2=0x7f5ec406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:33.719 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:33.718+0000 7f5ee9ad3640 1 --2- 172.21.15.73:0/2744691746 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f5ec406ae40 0x7f5ec406d300 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f5ed4006fd0 tx=0x7f5ed4008040 comp rx=0 tx=0).stop 2023-12-12T09:45:33.720 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:33.718+0000 7f5ee9ad3640 1 -- 172.21.15.73:0/2744691746 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5ee40c0420 msgr2=0x7f5ee4154c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:33.720 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:33.718+0000 7f5ee9ad3640 1 --2- 172.21.15.73:0/2744691746 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5ee40c0420 0x7f5ee4154c40 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f5ecc00c430 tx=0x7f5ecc00c8f0 comp rx=0 tx=0).stop 2023-12-12T09:45:33.720 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:33.718+0000 7f5ee9ad3640 1 -- 172.21.15.73:0/2744691746 shutdown_connections 2023-12-12T09:45:33.720 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:33.718+0000 7f5ee9ad3640 1 --2- 172.21.15.73:0/2744691746 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f5ec406ae40 0x7f5ec406d300 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:33.720 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:33.718+0000 7f5ee9ad3640 1 --2- 172.21.15.73:0/2744691746 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5ee40c17e0 0x7f5ee41eda20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:33.720 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:33.718+0000 7f5ee9ad3640 1 --2- 172.21.15.73:0/2744691746 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5ee40c0420 0x7f5ee4154c40 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:33.720 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:33.718+0000 7f5ee9ad3640 1 --2- 172.21.15.73:0/2744691746 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5ee406fca0 0x7f5ee41ea9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:33.720 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:33.718+0000 7f5ee9ad3640 1 -- 172.21.15.73:0/2744691746 >> 172.21.15.73:0/2744691746 conn(0x7f5ee40a77d0 msgr2=0x7f5ee414df30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:45:33.721 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:33.719+0000 7f5ee9ad3640 1 -- 172.21.15.73:0/2744691746 shutdown_connections 2023-12-12T09:45:33.721 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:33.719+0000 7f5ee9ad3640 1 -- 172.21.15.73:0/2744691746 wait complete. 2023-12-12T09:45:33.739 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-12T09:45:33.954 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:33.953+0000 7f03019ce640 1 Processor -- start 2023-12-12T09:45:33.955 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:33.953+0000 7f03019ce640 1 -- start start 2023-12-12T09:45:33.956 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:33.955+0000 7f03019ce640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f02fc06db70 0x7f02fc0c39b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:33.956 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:33.955+0000 7f03019ce640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f02fc0c5070 0x7f02fc0c3ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:33.956 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:33.955+0000 7f03019ce640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02fc152610 con 0x7f02fc14fa40 2023-12-12T09:45:33.956 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:33.955+0000 7f03019ce640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02fc1528f0 con 0x7f02fc0c5070 2023-12-12T09:45:33.956 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:33.955+0000 7f03019ce640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02fc152bd0 con 0x7f02fc06db70 2023-12-12T09:45:33.957 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:33.955+0000 7f02fb7fe640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f02fc0c5070 0x7f02fc0c3ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:33.957 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:33.955+0000 7f02fb7fe640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f02fc0c5070 0x7f02fc0c3ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:40982/0 (socket says 172.21.15.73:40982) 2023-12-12T09:45:33.957 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:33.955+0000 7f02fb7fe640 1 -- 172.21.15.73:0/77541790 learned_addr learned my addr 172.21.15.73:0/77541790 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:45:33.958 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:33.956+0000 7f02fa7fc640 1 --2- 172.21.15.73:0/77541790 >> v2:172.21.15.142:3300/0 conn(0x7f02fc06db70 0x7f02fc0c39b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:33.958 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:33.956+0000 7f02fb7fe640 1 -- 172.21.15.73:0/77541790 >> v2:172.21.15.142:3300/0 conn(0x7f02fc06db70 msgr2=0x7f02fc0c39b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:45:33.958 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:33.956+0000 7f02fb7fe640 1 --2- 172.21.15.73:0/77541790 >> v2:172.21.15.142:3300/0 conn(0x7f02fc06db70 0x7f02fc0c39b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:33.958 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:33.956+0000 7f02fb7fe640 1 -- 172.21.15.73:0/77541790 >> v1:172.21.15.142:6789/0 conn(0x7f02fc14fa40 legacy=0x7f02fc06a4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:45:33.958 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:33.956+0000 7f02fb7fe640 1 -- 172.21.15.73:0/77541790 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02fc152eb0 con 0x7f02fc0c5070 2023-12-12T09:45:33.958 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:33.957+0000 7f02fb7fe640 1 --2- 172.21.15.73:0/77541790 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f02fc0c5070 0x7f02fc0c3ef0 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f02fc0aaf60 tx=0x7f02f402b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e75a1b6ffc19fdd2 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:45:33.959 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:33.957+0000 7f02f9ffb640 1 -- 172.21.15.73:0/77541790 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02f4031870 con 0x7f02fc0c5070 2023-12-12T09:45:33.959 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:33.957+0000 7f02f9ffb640 1 -- 172.21.15.73:0/77541790 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02f40319d0 con 0x7f02fc0c5070 2023-12-12T09:45:33.959 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:33.957+0000 7f02f9ffb640 1 -- 172.21.15.73:0/77541790 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02f4031d60 con 0x7f02fc0c5070 2023-12-12T09:45:33.959 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:33.958+0000 7f03019ce640 1 -- 172.21.15.73:0/77541790 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f02fc0c5070 msgr2=0x7f02fc0c3ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:33.959 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:33.958+0000 7f03019ce640 1 --2- 172.21.15.73:0/77541790 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f02fc0c5070 0x7f02fc0c3ef0 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f02fc0aaf60 tx=0x7f02f402b910 comp rx=0 tx=0).stop 2023-12-12T09:45:33.960 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:33.958+0000 7f03019ce640 1 -- 172.21.15.73:0/77541790 shutdown_connections 2023-12-12T09:45:33.960 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:33.958+0000 7f03019ce640 1 --2- 172.21.15.73:0/77541790 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f02fc0c5070 0x7f02fc0c3ef0 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:33.960 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:33.958+0000 7f03019ce640 1 --2- 172.21.15.73:0/77541790 >> v2:172.21.15.142:3300/0 conn(0x7f02fc06db70 0x7f02fc0c39b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:33.960 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:33.958+0000 7f03019ce640 1 -- 172.21.15.73:0/77541790 >> 172.21.15.73:0/77541790 conn(0x7f02fc0a8130 msgr2=0x7f02fc0c24b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:45:33.960 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:33.958+0000 7f03019ce640 1 -- 172.21.15.73:0/77541790 shutdown_connections 2023-12-12T09:45:33.960 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:33.958+0000 7f03019ce640 1 -- 172.21.15.73:0/77541790 wait complete. 2023-12-12T09:45:33.961 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:33.960+0000 7f03019ce640 1 Processor -- start 2023-12-12T09:45:33.962 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:33.960+0000 7f03019ce640 1 -- start start 2023-12-12T09:45:33.964 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:33.962+0000 7f03019ce640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f02fc06db70 0x7f02fc14a350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:33.964 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:33.962+0000 7f03019ce640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f02fc0c5070 0x7f02fc1e4a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:33.964 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:33.962+0000 7f03019ce640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f02fc14fa40 0x7f02fc1e4fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:33.964 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:33.962+0000 7f03019ce640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02fc0a5e80 con 0x7f02fc0c5070 2023-12-12T09:45:33.964 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:33.962+0000 7f03019ce640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02fc153ba0 con 0x7f02fc06db70 2023-12-12T09:45:33.964 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:33.962+0000 7f03019ce640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02fc1e8220 con 0x7f02fc14fa40 2023-12-12T09:45:33.964 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:33.962+0000 7f02fa7fc640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f02fc0c5070 0x7f02fc1e4a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:33.964 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:33.962+0000 7f02fa7fc640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f02fc0c5070 0x7f02fc1e4a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:40992/0 (socket says 172.21.15.73:40992) 2023-12-12T09:45:33.964 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:33.962+0000 7f02fa7fc640 1 -- 172.21.15.73:0/845379309 learned_addr learned my addr 172.21.15.73:0/845379309 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:45:33.964 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:33.962+0000 7f02fb7fe640 1 --2- 172.21.15.73:0/845379309 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f02fc14fa40 0x7f02fc1e4fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:33.965 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:33.962+0000 7f02faffd640 1 --2- 172.21.15.73:0/845379309 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f02fc06db70 0x7f02fc14a350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:33.965 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:33.962+0000 7f02fa7fc640 1 -- 172.21.15.73:0/845379309 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f02fc14fa40 msgr2=0x7f02fc1e4fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:33.965 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:33.962+0000 7f02fa7fc640 1 --2- 172.21.15.73:0/845379309 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f02fc14fa40 0x7f02fc1e4fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:33.965 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:33.962+0000 7f02fa7fc640 1 -- 172.21.15.73:0/845379309 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f02fc06db70 msgr2=0x7f02fc14a350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:33.965 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:33.962+0000 7f02fa7fc640 1 --2- 172.21.15.73:0/845379309 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f02fc06db70 0x7f02fc14a350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:33.965 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:33.962+0000 7f02fa7fc640 1 -- 172.21.15.73:0/845379309 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02f40094d0 con 0x7f02fc0c5070 2023-12-12T09:45:33.965 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:33.962+0000 7f02faffd640 1 --2- 172.21.15.73:0/845379309 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f02fc06db70 0x7f02fc14a350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:45:33.965 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:33.963+0000 7f02fa7fc640 1 --2- 172.21.15.73:0/845379309 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f02fc0c5070 0x7f02fc1e4a80 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f02e400c820 tx=0x7f02e400cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:45:33.966 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:33.963+0000 7f02f3fff640 1 -- 172.21.15.73:0/845379309 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02e4004020 con 0x7f02fc0c5070 2023-12-12T09:45:33.966 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:33.963+0000 7f02f3fff640 1 -- 172.21.15.73:0/845379309 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02e4004180 con 0x7f02fc0c5070 2023-12-12T09:45:33.966 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:33.963+0000 7f02f3fff640 1 -- 172.21.15.73:0/845379309 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02e4007830 con 0x7f02fc0c5070 2023-12-12T09:45:33.966 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:33.963+0000 7f03019ce640 1 -- 172.21.15.73:0/845379309 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02fc1e86b0 con 0x7f02fc0c5070 2023-12-12T09:45:33.966 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:33.963+0000 7f03019ce640 1 -- 172.21.15.73:0/845379309 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02fc1e7bd0 con 0x7f02fc0c5070 2023-12-12T09:45:33.966 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:33.964+0000 7f03019ce640 1 -- 172.21.15.73:0/845379309 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f02fc1e83b0 con 0x7f02fc0c5070 2023-12-12T09:45:33.967 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:33.966+0000 7f02f3fff640 1 -- 172.21.15.73:0/845379309 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f02e4007990 con 0x7f02fc0c5070 2023-12-12T09:45:33.968 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:33.967+0000 7f02f3fff640 1 --2- 172.21.15.73:0/845379309 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f02dc06ae70 0x7f02dc06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:33.968 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:33.967+0000 7f02f3fff640 1 -- 172.21.15.73:0/845379309 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f02e40891e0 con 0x7f02fc0c5070 2023-12-12T09:45:33.969 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:33.967+0000 7f02faffd640 1 --2- 172.21.15.73:0/845379309 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f02dc06ae70 0x7f02dc06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:33.969 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:33.968+0000 7f02faffd640 1 --2- 172.21.15.73:0/845379309 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f02dc06ae70 0x7f02dc06d330 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f02fc06c970 tx=0x7f02ec009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:45:33.974 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:33.972+0000 7f02f3fff640 1 -- 172.21.15.73:0/845379309 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f02e4054320 con 0x7f02fc0c5070 2023-12-12T09:45:34.160 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:34.159+0000 7f03019ce640 1 -- 172.21.15.73:0/845379309 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f02fc067580 con 0x7f02fc0c5070 2023-12-12T09:45:34.162 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:34.161+0000 7f02f3fff640 1 -- 172.21.15.73:0/845379309 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v54) v1 ==== 74+0+16577 (secure 0 0 0) 0x7f02e4057940 con 0x7f02fc0c5070 2023-12-12T09:45:34.163 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-12T09:45:34.163 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":54,"fsid":"ba240992-02b8-4c7e-92f2-27eb29ac433b","created":"2023-12-12T09:43:02.454719+0000","modified":"2023-12-12T09:45:24.524160+0000","last_up_change":"2023-12-12T09:43:13.913440+0000","last_in_change":"2023-12-12T09:43:05.925348+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-12T09:43:15.525508+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-12-12T09:45:21.264815+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"53","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-12-12T09:45:21.981834+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"54","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"dd9074be-dbe2-4c34-9896-a4223d8d3940","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":4047810203},{"type":"v1","addr":"172.21.15.73:6801","nonce":4047810203}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":4047810203},{"type":"v1","addr":"172.21.15.73:6803","nonce":4047810203}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":4047810203},{"type":"v1","addr":"172.21.15.73:6807","nonce":4047810203}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":4047810203},{"type":"v1","addr":"172.21.15.73:6805","nonce":4047810203}]},"public_addr":"172.21.15.73:6801/4047810203","cluster_addr":"172.21.15.73:6803/4047810203","heartbeat_back_addr":"172.21.15.73:6807/4047810203","heartbeat_front_addr":"172.21.15.73:6805/4047810203","state":["exists","up"]},{"osd":1,"uuid":"c4a05052-96d4-4758-a4e1-1a37f1e07fed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":1356058331},{"type":"v1","addr":"172.21.15.73:6824","nonce":1356058331}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":1356058331},{"type":"v1","addr":"172.21.15.73:6827","nonce":1356058331}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":1356058331},{"type":"v1","addr":"172.21.15.73:6831","nonce":1356058331}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":1356058331},{"type":"v1","addr":"172.21.15.73:6829","nonce":1356058331}]},"public_addr":"172.21.15.73:6824/1356058331","cluster_addr":"172.21.15.73:6827/1356058331","heartbeat_back_addr":"172.21.15.73:6831/1356058331","heartbeat_front_addr":"172.21.15.73:6829/1356058331","state":["exists","up"]},{"osd":2,"uuid":"512bc8ac-72c2-40d4-b3d2-d867a92c5213","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":1228903316},{"type":"v1","addr":"172.21.15.73:6817","nonce":1228903316}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":1228903316},{"type":"v1","addr":"172.21.15.73:6819","nonce":1228903316}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6823","nonce":1228903316},{"type":"v1","addr":"172.21.15.73:6825","nonce":1228903316}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":1228903316},{"type":"v1","addr":"172.21.15.73:6821","nonce":1228903316}]},"public_addr":"172.21.15.73:6817/1228903316","cluster_addr":"172.21.15.73:6819/1228903316","heartbeat_back_addr":"172.21.15.73:6825/1228903316","heartbeat_front_addr":"172.21.15.73:6821/1228903316","state":["exists","up"]},{"osd":3,"uuid":"3d1a91e0-42bf-437a-8eae-8d357c8f63a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":1293329670},{"type":"v1","addr":"172.21.15.73:6809","nonce":1293329670}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6810","nonce":1293329670},{"type":"v1","addr":"172.21.15.73:6811","nonce":1293329670}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":1293329670},{"type":"v1","addr":"172.21.15.73:6815","nonce":1293329670}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":1293329670},{"type":"v1","addr":"172.21.15.73:6813","nonce":1293329670}]},"public_addr":"172.21.15.73:6809/1293329670","cluster_addr":"172.21.15.73:6811/1293329670","heartbeat_back_addr":"172.21.15.73:6815/1293329670","heartbeat_front_addr":"172.21.15.73:6813/1293329670","state":["exists","up"]},{"osd":4,"uuid":"4b302fff-834c-4069-ac19-00e46f6c87b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":3727975702},{"type":"v1","addr":"172.21.15.142:6801","nonce":3727975702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":3727975702},{"type":"v1","addr":"172.21.15.142:6803","nonce":3727975702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6809","nonce":3727975702},{"type":"v1","addr":"172.21.15.142:6811","nonce":3727975702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6805","nonce":3727975702},{"type":"v1","addr":"172.21.15.142:6807","nonce":3727975702}]},"public_addr":"172.21.15.142:6801/3727975702","cluster_addr":"172.21.15.142:6803/3727975702","heartbeat_back_addr":"172.21.15.142:6811/3727975702","heartbeat_front_addr":"172.21.15.142:6807/3727975702","state":["exists","up"]},{"osd":5,"uuid":"d7cdace2-67d0-45cc-95f2-515cf6ef1b82","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6817","nonce":2353193632},{"type":"v1","addr":"172.21.15.142:6819","nonce":2353193632}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6821","nonce":2353193632},{"type":"v1","addr":"172.21.15.142:6823","nonce":2353193632}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6829","nonce":2353193632},{"type":"v1","addr":"172.21.15.142:6831","nonce":2353193632}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6825","nonce":2353193632},{"type":"v1","addr":"172.21.15.142:6827","nonce":2353193632}]},"public_addr":"172.21.15.142:6819/2353193632","cluster_addr":"172.21.15.142:6823/2353193632","heartbeat_back_addr":"172.21.15.142:6831/2353193632","heartbeat_front_addr":"172.21.15.142:6827/2353193632","state":["exists","up"]},{"osd":6,"uuid":"649ce78a-5626-445c-aedc-a651ed05a6f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":2006111986},{"type":"v1","addr":"172.21.15.142:6806","nonce":2006111986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":2006111986},{"type":"v1","addr":"172.21.15.142:6810","nonce":2006111986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":2006111986},{"type":"v1","addr":"172.21.15.142:6815","nonce":2006111986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":2006111986},{"type":"v1","addr":"172.21.15.142:6813","nonce":2006111986}]},"public_addr":"172.21.15.142:6806/2006111986","cluster_addr":"172.21.15.142:6810/2006111986","heartbeat_back_addr":"172.21.15.142:6815/2006111986","heartbeat_front_addr":"172.21.15.142:6813/2006111986","state":["exists","up"]},{"osd":7,"uuid":"af15ae3b-c1d0-4acf-92db-8a1805494d13","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":2573794341},{"type":"v1","addr":"172.21.15.142:6818","nonce":2573794341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":2573794341},{"type":"v1","addr":"172.21.15.142:6822","nonce":2573794341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":2573794341},{"type":"v1","addr":"172.21.15.142:6830","nonce":2573794341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":2573794341},{"type":"v1","addr":"172.21.15.142:6826","nonce":2573794341}]},"public_addr":"172.21.15.142:6818/2573794341","cluster_addr":"172.21.15.142:6822/2573794341","heartbeat_back_addr":"172.21.15.142:6830/2573794341","heartbeat_front_addr":"172.21.15.142:6826/2573794341","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.185824+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.262103+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.225556+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:10.523459+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:10.706035+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.257339+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.301776+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.051960+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-12T09:45:34.165 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:34.163+0000 7f03019ce640 1 -- 172.21.15.73:0/845379309 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f02dc06ae70 msgr2=0x7f02dc06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:34.165 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:34.163+0000 7f03019ce640 1 --2- 172.21.15.73:0/845379309 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f02dc06ae70 0x7f02dc06d330 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f02fc06c970 tx=0x7f02ec009040 comp rx=0 tx=0).stop 2023-12-12T09:45:34.165 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:34.163+0000 7f03019ce640 1 -- 172.21.15.73:0/845379309 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f02fc0c5070 msgr2=0x7f02fc1e4a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:34.165 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:34.163+0000 7f03019ce640 1 --2- 172.21.15.73:0/845379309 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f02fc0c5070 0x7f02fc1e4a80 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f02e400c820 tx=0x7f02e400cce0 comp rx=0 tx=0).stop 2023-12-12T09:45:34.165 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:34.163+0000 7f03019ce640 1 -- 172.21.15.73:0/845379309 shutdown_connections 2023-12-12T09:45:34.165 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:34.163+0000 7f03019ce640 1 --2- 172.21.15.73:0/845379309 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f02dc06ae70 0x7f02dc06d330 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:34.165 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:34.163+0000 7f03019ce640 1 --2- 172.21.15.73:0/845379309 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f02fc14fa40 0x7f02fc1e4fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:34.165 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:34.163+0000 7f03019ce640 1 --2- 172.21.15.73:0/845379309 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f02fc0c5070 0x7f02fc1e4a80 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:34.166 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:34.163+0000 7f03019ce640 1 --2- 172.21.15.73:0/845379309 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f02fc06db70 0x7f02fc14a350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:34.166 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:34.163+0000 7f03019ce640 1 -- 172.21.15.73:0/845379309 >> 172.21.15.73:0/845379309 conn(0x7f02fc0a8130 msgr2=0x7f02fc0a6650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:45:34.166 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:34.164+0000 7f03019ce640 1 -- 172.21.15.73:0/845379309 shutdown_connections 2023-12-12T09:45:34.166 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:34.164+0000 7f03019ce640 1 -- 172.21.15.73:0/845379309 wait complete. 2023-12-12T09:45:34.184 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-12T09:43:15.525508+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 8, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-12T09:45:21.264815+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '53', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 9, 'pool_name': 'cephfs_data', 'create_time': '2023-12-12T09:45:21.981834+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '54', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-12T09:45:34.184 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-12T09:45:34.391 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:34.389+0000 7f6eff54e640 1 Processor -- start 2023-12-12T09:45:34.391 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:34.390+0000 7f6eff54e640 1 -- start start 2023-12-12T09:45:34.392 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:34.391+0000 7f6eff54e640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6ef814c190 0x7f6ef80c0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:34.392 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:34.391+0000 7f6eff54e640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f6ef81529a0 0x7f6ef80a8880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:34.392 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:34.391+0000 7f6eff54e640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ef81521e0 con 0x7f6ef80a4d00 2023-12-12T09:45:34.392 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:34.391+0000 7f6eff54e640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ef80c1890 con 0x7f6ef81529a0 2023-12-12T09:45:34.393 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:34.391+0000 7f6eff54e640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ef8151fd0 con 0x7f6ef814c190 2023-12-12T09:45:34.393 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:34.391+0000 7f6efdd4b640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f6ef80a4d00 0x7f6ef81555c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:48978/0 (socket says 172.21.15.73:48978) 2023-12-12T09:45:34.393 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:34.391+0000 7f6efdd4b640 1 -- 172.21.15.73:0/483962067 learned_addr learned my addr 172.21.15.73:0/483962067 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-12T09:45:34.395 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:34.392+0000 7f6efd54a640 1 -- 172.21.15.73:0/483962067 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 430820402 0 0) 0x7f6ef81521e0 con 0x7f6ef80a4d00 2023-12-12T09:45:34.395 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:34.392+0000 7f6efd54a640 1 -- 172.21.15.73:0/483962067 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6ee4003520 con 0x7f6ef80a4d00 2023-12-12T09:45:34.396 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:34.392+0000 7f6efe54c640 1 --2- 172.21.15.73:0/483962067 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6ef814c190 0x7f6ef80c0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:34.396 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:34.392+0000 7f6efed4d640 1 --2- 172.21.15.73:0/483962067 >> v2:172.21.15.142:3300/0 conn(0x7f6ef81529a0 0x7f6ef80a8880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:34.396 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:34.392+0000 7f6efd54a640 1 -- 172.21.15.73:0/483962067 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2717994494 0 0) 0x7f6ee4003520 con 0x7f6ef80a4d00 2023-12-12T09:45:34.396 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:34.392+0000 7f6efd54a640 1 -- 172.21.15.73:0/483962067 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6ef814c190 msgr2=0x7f6ef80c0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:45:34.396 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:34.392+0000 7f6efd54a640 1 --2- 172.21.15.73:0/483962067 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6ef814c190 0x7f6ef80c0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:34.396 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:34.392+0000 7f6efd54a640 1 -- 172.21.15.73:0/483962067 >> v2:172.21.15.142:3300/0 conn(0x7f6ef81529a0 msgr2=0x7f6ef80a8880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:45:34.396 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:34.392+0000 7f6efd54a640 1 --2- 172.21.15.73:0/483962067 >> v2:172.21.15.142:3300/0 conn(0x7f6ef81529a0 0x7f6ef80a8880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:34.396 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:34.392+0000 7f6efd54a640 1 -- 172.21.15.73:0/483962067 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ef80c1aa0 con 0x7f6ef80a4d00 2023-12-12T09:45:34.396 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:34.392+0000 7f6efd54a640 1 -- 172.21.15.73:0/483962067 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3186547832 0 0) 0x7f6ee8001670 con 0x7f6ef80a4d00 2023-12-12T09:45:34.396 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:34.392+0000 7f6efd54a640 1 -- 172.21.15.73:0/483962067 >> v1:172.21.15.73:6789/0 conn(0x7f6ef80a4d00 legacy=0x7f6ef81555c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:34.396 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:34.392+0000 7f6efd54a640 1 --2- 172.21.15.73:0/483962067 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6ee4003970 0x7f6ee4003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:34.396 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:34.392+0000 7f6efd54a640 1 --2- 172.21.15.73:0/483962067 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6ef814c190 0x7f6ee40047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:34.396 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:34.392+0000 7f6efd54a640 1 --2- 172.21.15.73:0/483962067 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6ee4004d00 0x7f6ee4005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:34.397 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:34.392+0000 7f6efd54a640 1 -- 172.21.15.73:0/483962067 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ef80c1890 con 0x7f6ee4003970 2023-12-12T09:45:34.397 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:34.392+0000 7f6efd54a640 1 -- 172.21.15.73:0/483962067 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ef8151fd0 con 0x7f6ee4004d00 2023-12-12T09:45:34.397 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:34.392+0000 7f6efd54a640 1 -- 172.21.15.73:0/483962067 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ee400bae0 con 0x7f6ef814c190 2023-12-12T09:45:34.397 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:34.392+0000 7f6efe54c640 1 --2- 172.21.15.73:0/483962067 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6ee4003970 0x7f6ee4003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:34.397 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:34.393+0000 7f6efdd4b640 1 --2- 172.21.15.73:0/483962067 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6ef814c190 0x7f6ee40047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:34.397 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:34.393+0000 7f6efed4d640 1 --2- 172.21.15.73:0/483962067 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6ee4004d00 0x7f6ee4005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:34.397 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:34.393+0000 7f6efe54c640 1 -- 172.21.15.73:0/483962067 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6ef814c190 msgr2=0x7f6ee40047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:45:34.397 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:34.393+0000 7f6efe54c640 1 --2- 172.21.15.73:0/483962067 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6ef814c190 0x7f6ee40047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:34.397 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:34.393+0000 7f6efe54c640 1 -- 172.21.15.73:0/483962067 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6ee4004d00 msgr2=0x7f6ee4005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:45:34.397 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:34.393+0000 7f6efe54c640 1 --2- 172.21.15.73:0/483962067 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6ee4004d00 0x7f6ee4005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:34.397 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:34.393+0000 7f6efe54c640 1 -- 172.21.15.73:0/483962067 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ee4003520 con 0x7f6ee4003970 2023-12-12T09:45:34.397 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:34.393+0000 7f6efed4d640 1 --2- 172.21.15.73:0/483962067 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6ee4004d00 0x7f6ee4005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:45:34.397 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:34.394+0000 7f6efe54c640 1 --2- 172.21.15.73:0/483962067 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6ee4003970 0x7f6ee4003d90 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f6ef400ba30 tx=0x7f6ee40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d552d20b0b6fc37c server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:45:34.397 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:34.394+0000 7f6efd54a640 1 -- 172.21.15.73:0/483962067 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ef4032660 con 0x7f6ee4003970 2023-12-12T09:45:34.397 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:34.394+0000 7f6efd54a640 1 -- 172.21.15.73:0/483962067 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ef40327c0 con 0x7f6ee4003970 2023-12-12T09:45:34.398 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:34.394+0000 7f6efd54a640 1 -- 172.21.15.73:0/483962067 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ef4032b50 con 0x7f6ee4003970 2023-12-12T09:45:34.400 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:34.395+0000 7f6eff54e640 1 -- 172.21.15.73:0/483962067 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6ee4003970 msgr2=0x7f6ee4003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:34.400 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:34.395+0000 7f6eff54e640 1 --2- 172.21.15.73:0/483962067 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6ee4003970 0x7f6ee4003d90 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f6ef400ba30 tx=0x7f6ee40057f0 comp rx=0 tx=0).stop 2023-12-12T09:45:34.400 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:34.395+0000 7f6efed4d640 1 -- 172.21.15.73:0/483962067 reap_dead start 2023-12-12T09:45:34.400 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:34.395+0000 7f6eff54e640 1 -- 172.21.15.73:0/483962067 shutdown_connections 2023-12-12T09:45:34.400 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:34.395+0000 7f6eff54e640 1 -- 172.21.15.73:0/483962067 >> 172.21.15.73:0/483962067 conn(0x7f6ef806a4e0 msgr2=0x7f6ef806a8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:45:34.400 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:34.395+0000 7f6eff54e640 1 -- 172.21.15.73:0/483962067 shutdown_connections 2023-12-12T09:45:34.400 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:34.395+0000 7f6eff54e640 1 -- 172.21.15.73:0/483962067 wait complete. 2023-12-12T09:45:34.400 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:34.397+0000 7f6eff54e640 1 Processor -- start 2023-12-12T09:45:34.400 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:34.397+0000 7f6eff54e640 1 -- start start 2023-12-12T09:45:34.400 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:34.398+0000 7f6eff54e640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6ee4003970 0x7f6ef81de150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:34.400 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:34.398+0000 7f6eff54e640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6ef80c35d0 0x7f6ef81dc5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:34.401 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:34.398+0000 7f6eff54e640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6ef81e85d0 0x7f6ef8143ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:34.401 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:34.398+0000 7f6eff54e640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ef81dd350 con 0x7f6ef81e85d0 2023-12-12T09:45:34.401 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:34.398+0000 7f6eff54e640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ef81e81b0 con 0x7f6ee4003970 2023-12-12T09:45:34.401 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:34.398+0000 7f6eff54e640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ef81dc180 con 0x7f6ef80c35d0 2023-12-12T09:45:34.401 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:34.398+0000 7f6efed4d640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6ef81e85d0 0x7f6ef8143ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:34.401 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:34.398+0000 7f6efed4d640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6ef81e85d0 0x7f6ef8143ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:41020/0 (socket says 172.21.15.73:41020) 2023-12-12T09:45:34.401 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:34.398+0000 7f6efed4d640 1 -- 172.21.15.73:0/3790869910 learned_addr learned my addr 172.21.15.73:0/3790869910 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:45:34.401 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:34.398+0000 7f6efe54c640 1 --2- 172.21.15.73:0/3790869910 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6ee4003970 0x7f6ef81de150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:34.401 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:34.398+0000 7f6efed4d640 1 -- 172.21.15.73:0/3790869910 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6ef80c35d0 msgr2=0x7f6ef81dc5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:34.401 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:34.398+0000 7f6efdd4b640 1 --2- 172.21.15.73:0/3790869910 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6ef80c35d0 0x7f6ef81dc5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:34.401 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:34.398+0000 7f6efed4d640 1 --2- 172.21.15.73:0/3790869910 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6ef80c35d0 0x7f6ef81dc5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:34.401 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:34.398+0000 7f6efed4d640 1 -- 172.21.15.73:0/3790869910 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6ee4003970 msgr2=0x7f6ef81de150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:34.401 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:34.398+0000 7f6efed4d640 1 --2- 172.21.15.73:0/3790869910 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6ee4003970 0x7f6ef81de150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:34.401 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:34.398+0000 7f6efed4d640 1 -- 172.21.15.73:0/3790869910 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ef80a6e50 con 0x7f6ef81e85d0 2023-12-12T09:45:34.402 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:34.399+0000 7f6efed4d640 1 --2- 172.21.15.73:0/3790869910 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6ef81e85d0 0x7f6ef8143ac0 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f6ef80c5780 tx=0x7f6ef0009d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:45:34.402 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:34.399+0000 7f6eeeffd640 1 -- 172.21.15.73:0/3790869910 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ef0007c90 con 0x7f6ef81e85d0 2023-12-12T09:45:34.402 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:34.399+0000 7f6eeeffd640 1 -- 172.21.15.73:0/3790869910 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ef0007e10 con 0x7f6ef81e85d0 2023-12-12T09:45:34.403 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:34.399+0000 7f6eeeffd640 1 -- 172.21.15.73:0/3790869910 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ef0014640 con 0x7f6ef81e85d0 2023-12-12T09:45:34.403 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:34.399+0000 7f6eff54e640 1 -- 172.21.15.73:0/3790869910 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ef81db7d0 con 0x7f6ef81e85d0 2023-12-12T09:45:34.403 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:34.399+0000 7f6eff54e640 1 -- 172.21.15.73:0/3790869910 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ef81dcb10 con 0x7f6ef81e85d0 2023-12-12T09:45:34.403 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:34.400+0000 7f6eff54e640 1 -- 172.21.15.73:0/3790869910 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ef81e82f0 con 0x7f6ef81e85d0 2023-12-12T09:45:34.403 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:34.401+0000 7f6eeeffd640 1 -- 172.21.15.73:0/3790869910 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f6ef001d3b0 con 0x7f6ef81e85d0 2023-12-12T09:45:34.404 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:34.403+0000 7f6eeeffd640 1 --2- 172.21.15.73:0/3790869910 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f6edc06ae70 0x7f6edc06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:34.404 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:34.403+0000 7f6eeeffd640 1 -- 172.21.15.73:0/3790869910 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6ef0089320 con 0x7f6ef81e85d0 2023-12-12T09:45:34.404 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:34.403+0000 7f6efe54c640 1 --2- 172.21.15.73:0/3790869910 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f6edc06ae70 0x7f6edc06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:34.404 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:34.403+0000 7f6efe54c640 1 --2- 172.21.15.73:0/3790869910 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f6edc06ae70 0x7f6edc06d330 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f6ef400ba00 tx=0x7f6ef403d040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:45:34.409 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:34.407+0000 7f6eeeffd640 1 -- 172.21.15.73:0/3790869910 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f6ef81e82f0 con 0x7f6ef81e85d0 2023-12-12T09:45:34.598 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:34.597+0000 7f6eff54e640 1 -- 172.21.15.73:0/3790869910 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f6ef81e82f0 con 0x7f6ef81e85d0 2023-12-12T09:45:34.601 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:34.600+0000 7f6eeeffd640 1 -- 172.21.15.73:0/3790869910 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v54) v1 ==== 93+0+10 (secure 0 0 0) 0x7f6ef81e82f0 con 0x7f6ef81e85d0 2023-12-12T09:45:34.601 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 1 2023-12-12T09:45:34.604 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:34.602+0000 7f6eff54e640 1 -- 172.21.15.73:0/3790869910 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f6edc06ae70 msgr2=0x7f6edc06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:34.604 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:34.602+0000 7f6eff54e640 1 --2- 172.21.15.73:0/3790869910 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f6edc06ae70 0x7f6edc06d330 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f6ef400ba00 tx=0x7f6ef403d040 comp rx=0 tx=0).stop 2023-12-12T09:45:34.604 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:34.602+0000 7f6eff54e640 1 -- 172.21.15.73:0/3790869910 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6ef81e85d0 msgr2=0x7f6ef8143ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:34.605 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:34.602+0000 7f6eff54e640 1 --2- 172.21.15.73:0/3790869910 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6ef81e85d0 0x7f6ef8143ac0 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f6ef80c5780 tx=0x7f6ef0009d40 comp rx=0 tx=0).stop 2023-12-12T09:45:34.605 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:34.603+0000 7f6eff54e640 1 -- 172.21.15.73:0/3790869910 shutdown_connections 2023-12-12T09:45:34.605 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:34.603+0000 7f6eff54e640 1 --2- 172.21.15.73:0/3790869910 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f6edc06ae70 0x7f6edc06d330 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:34.605 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:34.603+0000 7f6eff54e640 1 --2- 172.21.15.73:0/3790869910 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6ef81e85d0 0x7f6ef8143ac0 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:34.605 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:34.603+0000 7f6eff54e640 1 --2- 172.21.15.73:0/3790869910 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6ef80c35d0 0x7f6ef81dc5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:34.605 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:34.603+0000 7f6eff54e640 1 --2- 172.21.15.73:0/3790869910 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6ee4003970 0x7f6ef81de150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:34.605 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:34.603+0000 7f6eff54e640 1 -- 172.21.15.73:0/3790869910 >> 172.21.15.73:0/3790869910 conn(0x7f6ef806a4e0 msgr2=0x7f6ef8147fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:45:34.605 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:34.603+0000 7f6eff54e640 1 -- 172.21.15.73:0/3790869910 shutdown_connections 2023-12-12T09:45:34.605 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:34.603+0000 7f6eff54e640 1 -- 172.21.15.73:0/3790869910 wait complete. 2023-12-12T09:45:34.623 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-12T09:45:34.830 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:34.829+0000 7fdd7d368640 1 Processor -- start 2023-12-12T09:45:34.830 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:34.829+0000 7fdd7d368640 1 -- start start 2023-12-12T09:45:34.832 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:34.830+0000 7fdd7d368640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdd780a5040 0x7fdd780c4370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:34.832 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:34.830+0000 7fdd7d368640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd780c57e0 con 0x7fdd7814e160 2023-12-12T09:45:34.832 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:34.830+0000 7fdd7d368640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd781517b0 con 0x7fdd780a4b10 2023-12-12T09:45:34.832 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:34.830+0000 7fdd7d368640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd780c1e10 con 0x7fdd780a5040 2023-12-12T09:45:34.832 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:34.831+0000 7fdd76ffd640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7fdd7814e160 0x7fdd7806cc90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:48986/0 (socket says 172.21.15.73:48986) 2023-12-12T09:45:34.832 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:34.831+0000 7fdd76ffd640 1 -- 172.21.15.73:0/3994643375 learned_addr learned my addr 172.21.15.73:0/3994643375 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-12T09:45:34.834 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:34.831+0000 7fdd75ffb640 1 -- 172.21.15.73:0/3994643375 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1371256498 0 0) 0x7fdd780c57e0 con 0x7fdd7814e160 2023-12-12T09:45:34.834 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:34.831+0000 7fdd75ffb640 1 -- 172.21.15.73:0/3994643375 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdd64003520 con 0x7fdd7814e160 2023-12-12T09:45:34.835 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:34.831+0000 7fdd777fe640 1 --2- 172.21.15.73:0/3994643375 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdd780a5040 0x7fdd780c4370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:34.835 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:34.832+0000 7fdd75ffb640 1 -- 172.21.15.73:0/3994643375 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 650938332 0 0) 0x7fdd64003520 con 0x7fdd7814e160 2023-12-12T09:45:34.835 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:34.832+0000 7fdd75ffb640 1 -- 172.21.15.73:0/3994643375 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdd780a5040 msgr2=0x7fdd780c4370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:45:34.835 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:34.832+0000 7fdd75ffb640 1 --2- 172.21.15.73:0/3994643375 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdd780a5040 0x7fdd780c4370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:34.835 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:34.832+0000 7fdd75ffb640 1 -- 172.21.15.73:0/3994643375 >> v1:172.21.15.142:6789/0 conn(0x7fdd780a4b10 legacy=0x7fdd780c3c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:34.835 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:34.832+0000 7fdd75ffb640 1 -- 172.21.15.73:0/3994643375 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd7806dd30 con 0x7fdd7814e160 2023-12-12T09:45:34.835 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:34.832+0000 7fdd75ffb640 1 -- 172.21.15.73:0/3994643375 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3186547832 0 0) 0x7fdd680019f0 con 0x7fdd7814e160 2023-12-12T09:45:34.835 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:34.832+0000 7fdd75ffb640 1 -- 172.21.15.73:0/3994643375 >> v1:172.21.15.73:6789/0 conn(0x7fdd7814e160 legacy=0x7fdd7806cc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:34.835 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:34.832+0000 7fdd75ffb640 1 --2- 172.21.15.73:0/3994643375 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdd640039a0 0x7fdd64003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:34.835 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:34.832+0000 7fdd75ffb640 1 --2- 172.21.15.73:0/3994643375 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdd640047c0 0x7fdd64004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:34.835 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:34.832+0000 7fdd75ffb640 1 --2- 172.21.15.73:0/3994643375 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdd780a5040 0x7fdd64005950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:34.835 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:34.832+0000 7fdd75ffb640 1 -- 172.21.15.73:0/3994643375 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd780c1e10 con 0x7fdd640047c0 2023-12-12T09:45:34.835 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:34.832+0000 7fdd75ffb640 1 -- 172.21.15.73:0/3994643375 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd640055c0 con 0x7fdd640039a0 2023-12-12T09:45:34.835 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:34.832+0000 7fdd75ffb640 1 -- 172.21.15.73:0/3994643375 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd64005e90 con 0x7fdd780a5040 2023-12-12T09:45:34.836 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:34.832+0000 7fdd767fc640 1 --2- 172.21.15.73:0/3994643375 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdd640047c0 0x7fdd64004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:34.836 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:34.832+0000 7fdd76ffd640 1 --2- 172.21.15.73:0/3994643375 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdd640039a0 0x7fdd64003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:34.836 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:34.832+0000 7fdd777fe640 1 --2- 172.21.15.73:0/3994643375 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdd780a5040 0x7fdd64005950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:34.836 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:34.833+0000 7fdd767fc640 1 -- 172.21.15.73:0/3994643375 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdd780a5040 msgr2=0x7fdd64005950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:45:34.836 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:34.833+0000 7fdd767fc640 1 --2- 172.21.15.73:0/3994643375 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdd780a5040 0x7fdd64005950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:34.836 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:34.833+0000 7fdd767fc640 1 -- 172.21.15.73:0/3994643375 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdd640039a0 msgr2=0x7fdd64003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:45:34.836 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:34.833+0000 7fdd767fc640 1 --2- 172.21.15.73:0/3994643375 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdd640039a0 0x7fdd64003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:34.836 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:34.833+0000 7fdd767fc640 1 -- 172.21.15.73:0/3994643375 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd64003520 con 0x7fdd640047c0 2023-12-12T09:45:34.837 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:34.834+0000 7fdd767fc640 1 --2- 172.21.15.73:0/3994643375 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdd640047c0 0x7fdd64004c40 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7fdd60001750 tx=0x7fdd640057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a766ac45edf1fc0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:45:34.837 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:34.834+0000 7fdd75ffb640 1 -- 172.21.15.73:0/3994643375 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd600052d0 con 0x7fdd640047c0 2023-12-12T09:45:34.837 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:34.834+0000 7fdd75ffb640 1 -- 172.21.15.73:0/3994643375 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd6002e050 con 0x7fdd640047c0 2023-12-12T09:45:34.837 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:34.834+0000 7fdd75ffb640 1 -- 172.21.15.73:0/3994643375 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd600035f0 con 0x7fdd640047c0 2023-12-12T09:45:34.838 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:34.834+0000 7fdd7d368640 1 -- 172.21.15.73:0/3994643375 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdd640047c0 msgr2=0x7fdd64004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:34.838 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:34.834+0000 7fdd7d368640 1 --2- 172.21.15.73:0/3994643375 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdd640047c0 0x7fdd64004c40 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7fdd60001750 tx=0x7fdd640057f0 comp rx=0 tx=0).stop 2023-12-12T09:45:34.838 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:34.834+0000 7fdd777fe640 1 -- 172.21.15.73:0/3994643375 reap_dead start 2023-12-12T09:45:34.838 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:34.835+0000 7fdd7d368640 1 -- 172.21.15.73:0/3994643375 shutdown_connections 2023-12-12T09:45:34.838 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:34.835+0000 7fdd7d368640 1 -- 172.21.15.73:0/3994643375 >> 172.21.15.73:0/3994643375 conn(0x7fdd7806a4e0 msgr2=0x7fdd7806a8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:45:34.838 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:34.835+0000 7fdd7d368640 1 -- 172.21.15.73:0/3994643375 shutdown_connections 2023-12-12T09:45:34.838 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:34.835+0000 7fdd7d368640 1 -- 172.21.15.73:0/3994643375 wait complete. 2023-12-12T09:45:34.838 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:34.836+0000 7fdd7d368640 1 Processor -- start 2023-12-12T09:45:34.840 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:34.836+0000 7fdd7d368640 1 -- start start 2023-12-12T09:45:34.840 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:34.837+0000 7fdd7d368640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdd640047c0 0x7fdd780a9e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:34.840 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:34.837+0000 7fdd7d368640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdd78150fa0 0x7fdd7814ef50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:34.840 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:34.837+0000 7fdd7d368640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdd7814b070 0x7fdd7814f490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:34.840 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:34.837+0000 7fdd7d368640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd7814f9d0 con 0x7fdd640047c0 2023-12-12T09:45:34.840 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:34.837+0000 7fdd7d368640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd78072680 con 0x7fdd7814b070 2023-12-12T09:45:34.840 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:34.837+0000 7fdd7d368640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd7814ea70 con 0x7fdd78150fa0 2023-12-12T09:45:34.840 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:34.838+0000 7fdd76ffd640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdd640047c0 0x7fdd780a9e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:34.841 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:34.838+0000 7fdd76ffd640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdd640047c0 0x7fdd780a9e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:41038/0 (socket says 172.21.15.73:41038) 2023-12-12T09:45:34.841 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:34.838+0000 7fdd76ffd640 1 -- 172.21.15.73:0/2955554604 learned_addr learned my addr 172.21.15.73:0/2955554604 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:45:34.841 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:34.838+0000 7fdd76ffd640 1 -- 172.21.15.73:0/2955554604 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdd78150fa0 msgr2=0x7fdd7814ef50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:34.841 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:34.838+0000 7fdd767fc640 1 --2- 172.21.15.73:0/2955554604 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdd78150fa0 0x7fdd7814ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:34.841 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:34.838+0000 7fdd76ffd640 1 --2- 172.21.15.73:0/2955554604 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdd78150fa0 0x7fdd7814ef50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:34.841 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:34.838+0000 7fdd76ffd640 1 -- 172.21.15.73:0/2955554604 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdd7814b070 msgr2=0x7fdd7814f490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:34.841 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:34.838+0000 7fdd777fe640 1 --2- 172.21.15.73:0/2955554604 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdd7814b070 0x7fdd7814f490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:34.841 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:34.838+0000 7fdd76ffd640 1 --2- 172.21.15.73:0/2955554604 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdd7814b070 0x7fdd7814f490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:34.841 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:34.838+0000 7fdd76ffd640 1 -- 172.21.15.73:0/2955554604 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd7814ab20 con 0x7fdd640047c0 2023-12-12T09:45:34.841 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:34.838+0000 7fdd76ffd640 1 --2- 172.21.15.73:0/2955554604 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdd640047c0 0x7fdd780a9e00 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7fdd68007990 tx=0x7fdd6800e530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:45:34.841 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:34.839+0000 7fdd6f7fe640 1 -- 172.21.15.73:0/2955554604 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd6800ee50 con 0x7fdd640047c0 2023-12-12T09:45:34.841 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:34.839+0000 7fdd6f7fe640 1 -- 172.21.15.73:0/2955554604 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd68013420 con 0x7fdd640047c0 2023-12-12T09:45:34.841 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:34.839+0000 7fdd6f7fe640 1 -- 172.21.15.73:0/2955554604 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd680137d0 con 0x7fdd640047c0 2023-12-12T09:45:34.842 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:34.839+0000 7fdd7d368640 1 -- 172.21.15.73:0/2955554604 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd781500f0 con 0x7fdd640047c0 2023-12-12T09:45:34.842 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:34.839+0000 7fdd7d368640 1 -- 172.21.15.73:0/2955554604 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd781506b0 con 0x7fdd640047c0 2023-12-12T09:45:34.842 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:34.840+0000 7fdd7d368640 1 -- 172.21.15.73:0/2955554604 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd78150840 con 0x7fdd640047c0 2023-12-12T09:45:34.842 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:34.841+0000 7fdd6f7fe640 1 -- 172.21.15.73:0/2955554604 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fdd68013930 con 0x7fdd640047c0 2023-12-12T09:45:34.843 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:34.842+0000 7fdd6f7fe640 1 --2- 172.21.15.73:0/2955554604 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fdd5806ae70 0x7fdd5806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:34.843 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:34.842+0000 7fdd6f7fe640 1 -- 172.21.15.73:0/2955554604 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fdd68089ea0 con 0x7fdd640047c0 2023-12-12T09:45:34.844 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:34.842+0000 7fdd767fc640 1 --2- 172.21.15.73:0/2955554604 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fdd5806ae70 0x7fdd5806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:34.844 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:34.843+0000 7fdd767fc640 1 --2- 172.21.15.73:0/2955554604 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fdd5806ae70 0x7fdd5806d330 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fdd60033000 tx=0x7fdd60009030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:45:34.848 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:34.847+0000 7fdd6f7fe640 1 -- 172.21.15.73:0/2955554604 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fdd68054f50 con 0x7fdd640047c0 2023-12-12T09:45:35.036 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:35.035+0000 7fdd7d368640 1 -- 172.21.15.73:0/2955554604 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fdd78067070 con 0x7fdd640047c0 2023-12-12T09:45:35.037 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:35.035+0000 7fdd6f7fe640 1 -- 172.21.15.73:0/2955554604 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v54) v1 ==== 104+0+11 (secure 0 0 0) 0x7fdd68058570 con 0x7fdd640047c0 2023-12-12T09:45:35.037 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 32 2023-12-12T09:45:35.039 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:35.038+0000 7fdd7d368640 1 -- 172.21.15.73:0/2955554604 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fdd5806ae70 msgr2=0x7fdd5806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:35.039 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:35.038+0000 7fdd7d368640 1 --2- 172.21.15.73:0/2955554604 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fdd5806ae70 0x7fdd5806d330 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fdd60033000 tx=0x7fdd60009030 comp rx=0 tx=0).stop 2023-12-12T09:45:35.040 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:35.038+0000 7fdd7d368640 1 -- 172.21.15.73:0/2955554604 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdd640047c0 msgr2=0x7fdd780a9e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:35.040 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:35.038+0000 7fdd7d368640 1 --2- 172.21.15.73:0/2955554604 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdd640047c0 0x7fdd780a9e00 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7fdd68007990 tx=0x7fdd6800e530 comp rx=0 tx=0).stop 2023-12-12T09:45:35.040 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:35.038+0000 7fdd7d368640 1 -- 172.21.15.73:0/2955554604 shutdown_connections 2023-12-12T09:45:35.040 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:35.038+0000 7fdd7d368640 1 --2- 172.21.15.73:0/2955554604 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fdd5806ae70 0x7fdd5806d330 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:35.040 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:35.038+0000 7fdd7d368640 1 --2- 172.21.15.73:0/2955554604 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdd7814b070 0x7fdd7814f490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:35.040 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:35.038+0000 7fdd7d368640 1 --2- 172.21.15.73:0/2955554604 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdd78150fa0 0x7fdd7814ef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:35.040 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:35.038+0000 7fdd7d368640 1 --2- 172.21.15.73:0/2955554604 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdd640047c0 0x7fdd780a9e00 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:35.040 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:35.038+0000 7fdd7d368640 1 -- 172.21.15.73:0/2955554604 >> 172.21.15.73:0/2955554604 conn(0x7fdd7806a4e0 msgr2=0x7fdd780c0660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:45:35.040 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:35.038+0000 7fdd7d368640 1 -- 172.21.15.73:0/2955554604 shutdown_connections 2023-12-12T09:45:35.040 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:35.038+0000 7fdd7d368640 1 -- 172.21.15.73:0/2955554604 wait complete. 2023-12-12T09:45:35.057 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-12T09:45:35.266 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:35.265+0000 7f76a211d640 1 Processor -- start 2023-12-12T09:45:35.266 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:35.265+0000 7f76a211d640 1 -- start start 2023-12-12T09:45:35.268 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:35.266+0000 7f76a211d640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f769c0a4c90 0x7f769c0c5420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:35.268 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:35.266+0000 7f76a211d640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f769c0c3390 con 0x7f769c14ea60 2023-12-12T09:45:35.268 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:35.266+0000 7f76a211d640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f769c0c4b30 con 0x7f769c0c0320 2023-12-12T09:45:35.268 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:35.266+0000 7f76a211d640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f769c0c0750 con 0x7f769c0a4c90 2023-12-12T09:45:35.268 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:35.267+0000 7f769b7fe640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f769c14ea60 0x7f769c0c4420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:48998/0 (socket says 172.21.15.73:48998) 2023-12-12T09:45:35.268 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:35.267+0000 7f769b7fe640 1 -- 172.21.15.73:0/3682415292 learned_addr learned my addr 172.21.15.73:0/3682415292 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-12T09:45:35.268 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:35.267+0000 7f769affd640 1 --2- 172.21.15.73:0/3682415292 >> v2:172.21.15.73:3300/0 conn(0x7f769c0a4c90 0x7f769c0c5420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:35.269 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:35.267+0000 7f769a7fc640 1 -- 172.21.15.73:0/3682415292 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 284589843 0 0) 0x7f769c0c3390 con 0x7f769c14ea60 2023-12-12T09:45:35.269 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:35.267+0000 7f769a7fc640 1 -- 172.21.15.73:0/3682415292 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7684003520 con 0x7f769c14ea60 2023-12-12T09:45:35.269 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:35.268+0000 7f769affd640 1 -- 172.21.15.73:0/3682415292 >> v1:172.21.15.142:6789/0 conn(0x7f769c0c0320 legacy=0x7f769c0c20b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:35.269 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:35.268+0000 7f769affd640 1 -- 172.21.15.73:0/3682415292 >> v1:172.21.15.73:6789/0 conn(0x7f769c14ea60 legacy=0x7f769c0c4420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:35.269 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:35.268+0000 7f769affd640 1 -- 172.21.15.73:0/3682415292 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f769c151e60 con 0x7f769c0a4c90 2023-12-12T09:45:35.270 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:35.269+0000 7f769affd640 1 --2- 172.21.15.73:0/3682415292 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f769c0a4c90 0x7f769c0c5420 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f7690009d90 tx=0x7f769002beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed7482ae42909600 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:45:35.270 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:35.269+0000 7f769a7fc640 1 -- 172.21.15.73:0/3682415292 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f769002cc60 con 0x7f769c0a4c90 2023-12-12T09:45:35.270 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:35.269+0000 7f769a7fc640 1 -- 172.21.15.73:0/3682415292 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f769002cdc0 con 0x7f769c0a4c90 2023-12-12T09:45:35.271 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:35.269+0000 7f769a7fc640 1 -- 172.21.15.73:0/3682415292 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7690034660 con 0x7f769c0a4c90 2023-12-12T09:45:35.271 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:35.269+0000 7f76a211d640 1 -- 172.21.15.73:0/3682415292 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f769c0a4c90 msgr2=0x7f769c0c5420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:35.271 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:35.269+0000 7f76a211d640 1 --2- 172.21.15.73:0/3682415292 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f769c0a4c90 0x7f769c0c5420 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f7690009d90 tx=0x7f769002beb0 comp rx=0 tx=0).stop 2023-12-12T09:45:35.272 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:35.270+0000 7f76a211d640 1 -- 172.21.15.73:0/3682415292 shutdown_connections 2023-12-12T09:45:35.272 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:35.270+0000 7f76a211d640 1 --2- 172.21.15.73:0/3682415292 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f769c0a4c90 0x7f769c0c5420 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:35.272 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:35.270+0000 7f76a211d640 1 -- 172.21.15.73:0/3682415292 >> 172.21.15.73:0/3682415292 conn(0x7f769c06a4e0 msgr2=0x7f769c06a8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:45:35.272 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:35.270+0000 7f76a211d640 1 -- 172.21.15.73:0/3682415292 shutdown_connections 2023-12-12T09:45:35.272 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:35.270+0000 7f76a211d640 1 -- 172.21.15.73:0/3682415292 wait complete. 2023-12-12T09:45:35.272 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:35.271+0000 7f76a211d640 1 Processor -- start 2023-12-12T09:45:35.273 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:35.272+0000 7f76a211d640 1 -- start start 2023-12-12T09:45:35.274 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:35.272+0000 7f76a211d640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f769c0a4c90 0x7f769c1e9fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:35.274 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:35.272+0000 7f76a211d640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f769c0c0320 0x7f769c14ae40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:35.274 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:35.272+0000 7f76a211d640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f769c14ea60 0x7f769c1eddb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:35.275 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:35.272+0000 7f76a211d640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f769c150c30 con 0x7f769c0c0320 2023-12-12T09:45:35.275 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:35.272+0000 7f76a211d640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f769c1eaf30 con 0x7f769c0a4c90 2023-12-12T09:45:35.275 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:35.272+0000 7f76a211d640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f769c0a7050 con 0x7f769c14ea60 2023-12-12T09:45:35.275 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:35.273+0000 7f769affd640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f769c0c0320 0x7f769c14ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:35.275 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:35.273+0000 7f769affd640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f769c0c0320 0x7f769c14ae40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:41060/0 (socket says 172.21.15.73:41060) 2023-12-12T09:45:35.275 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:35.273+0000 7f769affd640 1 -- 172.21.15.73:0/1989778945 learned_addr learned my addr 172.21.15.73:0/1989778945 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:45:35.275 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:35.273+0000 7f769affd640 1 -- 172.21.15.73:0/1989778945 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f769c14ea60 msgr2=0x7f769c1eddb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:35.275 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:35.273+0000 7f769affd640 1 --2- 172.21.15.73:0/1989778945 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f769c14ea60 0x7f769c1eddb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:35.275 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:35.273+0000 7f769affd640 1 -- 172.21.15.73:0/1989778945 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f769c0a4c90 msgr2=0x7f769c1e9fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:35.275 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:35.273+0000 7f769affd640 1 --2- 172.21.15.73:0/1989778945 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f769c0a4c90 0x7f769c1e9fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:35.275 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:35.273+0000 7f769affd640 1 -- 172.21.15.73:0/1989778945 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7690009a70 con 0x7f769c0c0320 2023-12-12T09:45:35.275 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:35.273+0000 7f769affd640 1 --2- 172.21.15.73:0/1989778945 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f769c0c0320 0x7f769c14ae40 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f7690037040 tx=0x7f7690004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:45:35.276 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:35.274+0000 7f7683fff640 1 -- 172.21.15.73:0/1989778945 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7690040650 con 0x7f769c0c0320 2023-12-12T09:45:35.276 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:35.274+0000 7f7683fff640 1 -- 172.21.15.73:0/1989778945 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76900407b0 con 0x7f769c0c0320 2023-12-12T09:45:35.276 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:35.274+0000 7f7683fff640 1 -- 172.21.15.73:0/1989778945 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7690040b60 con 0x7f769c0c0320 2023-12-12T09:45:35.276 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:35.274+0000 7f76a211d640 1 -- 172.21.15.73:0/1989778945 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f769c0a90a0 con 0x7f769c0c0320 2023-12-12T09:45:35.276 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:35.274+0000 7f76a211d640 1 -- 172.21.15.73:0/1989778945 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f769c1ed890 con 0x7f769c0c0320 2023-12-12T09:45:35.277 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:35.275+0000 7f76a211d640 1 -- 172.21.15.73:0/1989778945 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f769c067070 con 0x7f769c0c0320 2023-12-12T09:45:35.277 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:35.276+0000 7f7683fff640 1 -- 172.21.15.73:0/1989778945 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f7690040cc0 con 0x7f769c0c0320 2023-12-12T09:45:35.278 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:35.277+0000 7f7683fff640 1 --2- 172.21.15.73:0/1989778945 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f768806ae70 0x7f768806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:35.278 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:35.277+0000 7f7683fff640 1 -- 172.21.15.73:0/1989778945 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f76900ac370 con 0x7f769c0c0320 2023-12-12T09:45:35.279 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:35.277+0000 7f769b7fe640 1 --2- 172.21.15.73:0/1989778945 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f768806ae70 0x7f768806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:35.279 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:35.278+0000 7f769b7fe640 1 --2- 172.21.15.73:0/1989778945 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f768806ae70 0x7f768806d330 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f768c001570 tx=0x7f768c007930 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:45:35.283 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:35.282+0000 7f7683fff640 1 -- 172.21.15.73:0/1989778945 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f76900774b0 con 0x7f769c0c0320 2023-12-12T09:45:35.471 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:35.470+0000 7f76a211d640 1 -- 172.21.15.73:0/1989778945 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f769c1eda80 con 0x7f769c0c0320 2023-12-12T09:45:35.472 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:35.471+0000 7f7683fff640 1 -- 172.21.15.73:0/1989778945 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v54) v1 ==== 100+0+11 (secure 0 0 0) 0x7f769007aad0 con 0x7f769c0c0320 2023-12-12T09:45:35.472 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 64 2023-12-12T09:45:35.475 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:35.473+0000 7f76a211d640 1 -- 172.21.15.73:0/1989778945 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f768806ae70 msgr2=0x7f768806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:35.475 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:35.473+0000 7f76a211d640 1 --2- 172.21.15.73:0/1989778945 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f768806ae70 0x7f768806d330 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f768c001570 tx=0x7f768c007930 comp rx=0 tx=0).stop 2023-12-12T09:45:35.475 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:35.473+0000 7f76a211d640 1 -- 172.21.15.73:0/1989778945 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f769c0c0320 msgr2=0x7f769c14ae40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:35.475 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:35.473+0000 7f76a211d640 1 --2- 172.21.15.73:0/1989778945 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f769c0c0320 0x7f769c14ae40 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f7690037040 tx=0x7f7690004a40 comp rx=0 tx=0).stop 2023-12-12T09:45:35.475 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:35.474+0000 7f76a211d640 1 -- 172.21.15.73:0/1989778945 shutdown_connections 2023-12-12T09:45:35.476 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:35.474+0000 7f76a211d640 1 --2- 172.21.15.73:0/1989778945 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f768806ae70 0x7f768806d330 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:35.476 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:35.474+0000 7f76a211d640 1 --2- 172.21.15.73:0/1989778945 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f769c14ea60 0x7f769c1eddb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:35.476 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:35.474+0000 7f76a211d640 1 --2- 172.21.15.73:0/1989778945 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f769c0c0320 0x7f769c14ae40 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:35.476 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:35.474+0000 7f76a211d640 1 --2- 172.21.15.73:0/1989778945 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f769c0a4c90 0x7f769c1e9fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:35.476 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:35.474+0000 7f76a211d640 1 -- 172.21.15.73:0/1989778945 >> 172.21.15.73:0/1989778945 conn(0x7f769c06a4e0 msgr2=0x7f769c06a8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:45:35.476 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:35.474+0000 7f76a211d640 1 -- 172.21.15.73:0/1989778945 shutdown_connections 2023-12-12T09:45:35.476 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:35.474+0000 7f76a211d640 1 -- 172.21.15.73:0/1989778945 wait complete. 2023-12-12T09:45:35.494 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-12-12T09:45:35.692 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:35.691+0000 7f10178cf640 1 Processor -- start 2023-12-12T09:45:35.692 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:35.691+0000 7f10178cf640 1 -- start start 2023-12-12T09:45:35.694 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:35.692+0000 7f10178cf640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f101006bf20 0x7f10100a9760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:35.694 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:35.692+0000 7f10178cf640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10100c0b50 con 0x7f10101552e0 2023-12-12T09:45:35.694 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:35.692+0000 7f10178cf640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f101006c880 con 0x7f10100a50f0 2023-12-12T09:45:35.694 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:35.692+0000 7f10178cf640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10100c04d0 con 0x7f101006bf20 2023-12-12T09:45:35.694 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:35.693+0000 7f101566b640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f10101552e0 0x7f10100c49c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:49008/0 (socket says 172.21.15.73:49008) 2023-12-12T09:45:35.694 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:35.693+0000 7f101566b640 1 -- 172.21.15.73:0/2661492129 learned_addr learned my addr 172.21.15.73:0/2661492129 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-12T09:45:35.696 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:35.693+0000 7f1007fff640 1 -- 172.21.15.73:0/2661492129 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 90810862 0 0) 0x7f10100c0b50 con 0x7f10101552e0 2023-12-12T09:45:35.696 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:35.693+0000 7f1007fff640 1 -- 172.21.15.73:0/2661492129 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0ffc003520 con 0x7f10101552e0 2023-12-12T09:45:35.696 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:35.693+0000 7f1015e6c640 1 --2- 172.21.15.73:0/2661492129 >> v2:172.21.15.142:3300/0 conn(0x7f101006bf20 0x7f10100a9760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:35.696 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:35.693+0000 7f1007fff640 1 -- 172.21.15.73:0/2661492129 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2290725620 0 0) 0x7f0ffc003520 con 0x7f10101552e0 2023-12-12T09:45:35.696 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:35.693+0000 7f1007fff640 1 -- 172.21.15.73:0/2661492129 >> v2:172.21.15.142:3300/0 conn(0x7f101006bf20 msgr2=0x7f10100a9760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:45:35.697 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:35.693+0000 7f1007fff640 1 --2- 172.21.15.73:0/2661492129 >> v2:172.21.15.142:3300/0 conn(0x7f101006bf20 0x7f10100a9760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:35.697 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:35.693+0000 7f1007fff640 1 -- 172.21.15.73:0/2661492129 >> v1:172.21.15.142:6789/0 conn(0x7f10100a50f0 legacy=0x7f10100a9050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:45:35.697 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:35.693+0000 7f1007fff640 1 -- 172.21.15.73:0/2661492129 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f101006cb60 con 0x7f10101552e0 2023-12-12T09:45:35.697 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:35.694+0000 7f1007fff640 1 -- 172.21.15.73:0/2661492129 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3186547832 0 0) 0x7f100c001670 con 0x7f10101552e0 2023-12-12T09:45:35.697 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:35.694+0000 7f1007fff640 1 -- 172.21.15.73:0/2661492129 >> v1:172.21.15.73:6789/0 conn(0x7f10101552e0 legacy=0x7f10100c49c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:35.697 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:35.694+0000 7f1007fff640 1 --2- 172.21.15.73:0/2661492129 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0ffc003970 0x7f0ffc003d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:35.697 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:35.694+0000 7f1007fff640 1 --2- 172.21.15.73:0/2661492129 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0ffc0047c0 0x7f0ffc004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:35.697 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:35.694+0000 7f1007fff640 1 --2- 172.21.15.73:0/2661492129 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0ffc0052a0 0x7f0ffc00db90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:35.697 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:35.694+0000 7f1007fff640 1 -- 172.21.15.73:0/2661492129 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10100c04d0 con 0x7f0ffc003970 2023-12-12T09:45:35.697 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:35.694+0000 7f1007fff640 1 -- 172.21.15.73:0/2661492129 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ffc00e360 con 0x7f0ffc0047c0 2023-12-12T09:45:35.697 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:35.694+0000 7f1007fff640 1 -- 172.21.15.73:0/2661492129 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ffc00e520 con 0x7f0ffc0052a0 2023-12-12T09:45:35.697 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:35.694+0000 7f101566b640 1 --2- 172.21.15.73:0/2661492129 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0ffc003970 0x7f0ffc003d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:35.697 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:35.694+0000 7f1014e6a640 1 --2- 172.21.15.73:0/2661492129 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0ffc0047c0 0x7f0ffc004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:35.697 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:35.694+0000 7f101566b640 1 -- 172.21.15.73:0/2661492129 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0ffc0052a0 msgr2=0x7f0ffc00db90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:45:35.698 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:35.694+0000 7f1015e6c640 1 --2- 172.21.15.73:0/2661492129 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0ffc0052a0 0x7f0ffc00db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:35.698 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:35.694+0000 7f101566b640 1 --2- 172.21.15.73:0/2661492129 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0ffc0052a0 0x7f0ffc00db90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:35.698 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:35.694+0000 7f101566b640 1 -- 172.21.15.73:0/2661492129 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0ffc0047c0 msgr2=0x7f0ffc004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:45:35.698 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:35.694+0000 7f101566b640 1 --2- 172.21.15.73:0/2661492129 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0ffc0047c0 0x7f0ffc004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:35.698 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:35.694+0000 7f101566b640 1 -- 172.21.15.73:0/2661492129 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ffc003520 con 0x7f0ffc003970 2023-12-12T09:45:35.698 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:35.694+0000 7f1015e6c640 1 -- 172.21.15.73:0/2661492129 reap_dead start 2023-12-12T09:45:35.698 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:35.694+0000 7f1014e6a640 1 --2- 172.21.15.73:0/2661492129 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0ffc0047c0 0x7f0ffc004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:45:35.699 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:35.695+0000 7f101566b640 1 --2- 172.21.15.73:0/2661492129 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0ffc003970 0x7f0ffc003d70 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f100c00c210 tx=0x7f0ffc0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=293769ef453a99a9 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:45:35.699 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:35.696+0000 7f1007fff640 1 -- 172.21.15.73:0/2661492129 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f100c005ad0 con 0x7f0ffc003970 2023-12-12T09:45:35.699 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:35.696+0000 7f1007fff640 1 -- 172.21.15.73:0/2661492129 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f100c005c30 con 0x7f0ffc003970 2023-12-12T09:45:35.699 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:35.696+0000 7f1007fff640 1 -- 172.21.15.73:0/2661492129 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f100c02c850 con 0x7f0ffc003970 2023-12-12T09:45:35.699 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:35.696+0000 7f10178cf640 1 -- 172.21.15.73:0/2661492129 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0ffc003970 msgr2=0x7f0ffc003d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:35.699 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:35.696+0000 7f10178cf640 1 --2- 172.21.15.73:0/2661492129 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0ffc003970 0x7f0ffc003d70 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f100c00c210 tx=0x7f0ffc0057f0 comp rx=0 tx=0).stop 2023-12-12T09:45:35.699 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:35.696+0000 7f10178cf640 1 -- 172.21.15.73:0/2661492129 shutdown_connections 2023-12-12T09:45:35.699 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:35.696+0000 7f10178cf640 1 --2- 172.21.15.73:0/2661492129 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0ffc003970 0x7f0ffc003d70 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:35.699 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:35.696+0000 7f10178cf640 1 -- 172.21.15.73:0/2661492129 >> 172.21.15.73:0/2661492129 conn(0x7f10100a8130 msgr2=0x7f10100c24b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:45:35.700 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:35.697+0000 7f10178cf640 1 -- 172.21.15.73:0/2661492129 shutdown_connections 2023-12-12T09:45:35.700 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:35.697+0000 7f10178cf640 1 -- 172.21.15.73:0/2661492129 wait complete. 2023-12-12T09:45:35.701 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:35.698+0000 7f10178cf640 1 Processor -- start 2023-12-12T09:45:35.701 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:35.698+0000 7f10178cf640 1 -- start start 2023-12-12T09:45:35.701 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:35.699+0000 7f10178cf640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0ffc003970 0x7f1010071600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:35.701 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:35.699+0000 7f10178cf640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f10100999d0 0x7f10100bede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:35.701 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:35.699+0000 7f10178cf640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f10100bf320 0x7f10100a3aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:35.702 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:35.699+0000 7f10178cf640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10100a4f30 con 0x7f0ffc003970 2023-12-12T09:45:35.702 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:35.699+0000 7f10178cf640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10100a4720 con 0x7f10100bf320 2023-12-12T09:45:35.702 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:35.699+0000 7f10178cf640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1010099ed0 con 0x7f10100999d0 2023-12-12T09:45:35.702 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:35.699+0000 7f101566b640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0ffc003970 0x7f1010071600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:35.702 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:35.700+0000 7f101566b640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0ffc003970 0x7f1010071600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:41076/0 (socket says 172.21.15.73:41076) 2023-12-12T09:45:35.702 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:35.700+0000 7f101566b640 1 -- 172.21.15.73:0/1305127522 learned_addr learned my addr 172.21.15.73:0/1305127522 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:45:35.702 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:35.700+0000 7f1014e6a640 1 --2- 172.21.15.73:0/1305127522 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f10100999d0 0x7f10100bede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:35.702 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:35.700+0000 7f1015e6c640 1 --2- 172.21.15.73:0/1305127522 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f10100bf320 0x7f10100a3aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:35.702 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:35.700+0000 7f101566b640 1 -- 172.21.15.73:0/1305127522 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f10100999d0 msgr2=0x7f10100bede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:35.702 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:35.700+0000 7f101566b640 1 --2- 172.21.15.73:0/1305127522 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f10100999d0 0x7f10100bede0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:35.702 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:35.700+0000 7f101566b640 1 -- 172.21.15.73:0/1305127522 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f10100bf320 msgr2=0x7f10100a3aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:35.702 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:35.700+0000 7f101566b640 1 --2- 172.21.15.73:0/1305127522 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f10100bf320 0x7f10100a3aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:35.702 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:35.700+0000 7f101566b640 1 -- 172.21.15.73:0/1305127522 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10100a4970 con 0x7f0ffc003970 2023-12-12T09:45:35.703 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:35.700+0000 7f101566b640 1 --2- 172.21.15.73:0/1305127522 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0ffc003970 0x7f1010071600 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f100c02c3f0 tx=0x7f100c02e070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:45:35.703 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:35.701+0000 7f1005ffb640 1 -- 172.21.15.73:0/1305127522 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f100c03c040 con 0x7f0ffc003970 2023-12-12T09:45:35.703 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:35.701+0000 7f1005ffb640 1 -- 172.21.15.73:0/1305127522 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f100c02cd20 con 0x7f0ffc003970 2023-12-12T09:45:35.703 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:35.701+0000 7f10178cf640 1 -- 172.21.15.73:0/1305127522 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10100a4c50 con 0x7f0ffc003970 2023-12-12T09:45:35.703 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:35.701+0000 7f1005ffb640 1 -- 172.21.15.73:0/1305127522 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f100c007290 con 0x7f0ffc003970 2023-12-12T09:45:35.704 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:35.701+0000 7f10178cf640 1 -- 172.21.15.73:0/1305127522 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1010071b40 con 0x7f0ffc003970 2023-12-12T09:45:35.704 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:35.702+0000 7f10178cf640 1 -- 172.21.15.73:0/1305127522 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1010067580 con 0x7f0ffc003970 2023-12-12T09:45:35.704 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:35.703+0000 7f1005ffb640 1 -- 172.21.15.73:0/1305127522 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f100c032070 con 0x7f0ffc003970 2023-12-12T09:45:35.705 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:35.704+0000 7f1005ffb640 1 --2- 172.21.15.73:0/1305127522 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f0ff406ae70 0x7f0ff406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:35.705 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:35.704+0000 7f1005ffb640 1 -- 172.21.15.73:0/1305127522 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f100c0aa7a0 con 0x7f0ffc003970 2023-12-12T09:45:35.705 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:35.704+0000 7f1014e6a640 1 --2- 172.21.15.73:0/1305127522 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f0ff406ae70 0x7f0ff406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:35.706 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:35.705+0000 7f1014e6a640 1 --2- 172.21.15.73:0/1305127522 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f0ff406ae70 0x7f0ff406d330 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f1010152040 tx=0x7f1000009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:45:35.709 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:35.709+0000 7f1005ffb640 1 -- 172.21.15.73:0/1305127522 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f100c0757b0 con 0x7f0ffc003970 2023-12-12T09:45:35.900 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:35.899+0000 7f10178cf640 1 -- 172.21.15.73:0/1305127522 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f101009a240 con 0x7f0ffc003970 2023-12-12T09:45:35.901 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:35.901+0000 7f1005ffb640 1 -- 172.21.15.73:0/1305127522 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v54) v1 ==== 84+0+207 (secure 0 0 0) 0x7f100c045090 con 0x7f0ffc003970 2023-12-12T09:45:35.901 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-12T09:45:35.901 INFO:teuthology.orchestra.run.smithi073.stdout:[ 2023-12-12T09:45:35.902 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-12-12T09:45:35.902 INFO:teuthology.orchestra.run.smithi073.stdout: "poolnum": 1, 2023-12-12T09:45:35.902 INFO:teuthology.orchestra.run.smithi073.stdout: "poolname": ".mgr" 2023-12-12T09:45:35.902 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-12-12T09:45:35.902 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-12-12T09:45:35.902 INFO:teuthology.orchestra.run.smithi073.stdout: "poolnum": 8, 2023-12-12T09:45:35.902 INFO:teuthology.orchestra.run.smithi073.stdout: "poolname": "cephfs_metadata" 2023-12-12T09:45:35.902 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-12-12T09:45:35.902 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-12-12T09:45:35.902 INFO:teuthology.orchestra.run.smithi073.stdout: "poolnum": 9, 2023-12-12T09:45:35.902 INFO:teuthology.orchestra.run.smithi073.stdout: "poolname": "cephfs_data" 2023-12-12T09:45:35.902 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-12-12T09:45:35.902 INFO:teuthology.orchestra.run.smithi073.stdout:] 2023-12-12T09:45:35.904 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:35.904+0000 7f10178cf640 1 -- 172.21.15.73:0/1305127522 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f0ff406ae70 msgr2=0x7f0ff406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:35.904 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:35.904+0000 7f10178cf640 1 --2- 172.21.15.73:0/1305127522 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f0ff406ae70 0x7f0ff406d330 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f1010152040 tx=0x7f1000009040 comp rx=0 tx=0).stop 2023-12-12T09:45:35.905 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:35.904+0000 7f10178cf640 1 -- 172.21.15.73:0/1305127522 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0ffc003970 msgr2=0x7f1010071600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:35.905 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:35.904+0000 7f10178cf640 1 --2- 172.21.15.73:0/1305127522 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0ffc003970 0x7f1010071600 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f100c02c3f0 tx=0x7f100c02e070 comp rx=0 tx=0).stop 2023-12-12T09:45:35.905 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:35.904+0000 7f10178cf640 1 -- 172.21.15.73:0/1305127522 shutdown_connections 2023-12-12T09:45:35.905 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:35.904+0000 7f10178cf640 1 --2- 172.21.15.73:0/1305127522 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f0ff406ae70 0x7f0ff406d330 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:35.905 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:35.904+0000 7f10178cf640 1 --2- 172.21.15.73:0/1305127522 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f10100bf320 0x7f10100a3aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:35.905 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:35.904+0000 7f10178cf640 1 --2- 172.21.15.73:0/1305127522 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f10100999d0 0x7f10100bede0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:35.905 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:35.904+0000 7f10178cf640 1 --2- 172.21.15.73:0/1305127522 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0ffc003970 0x7f1010071600 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:35.905 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:35.904+0000 7f10178cf640 1 -- 172.21.15.73:0/1305127522 >> 172.21.15.73:0/1305127522 conn(0x7f10100a8130 msgr2=0x7f10100c4b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:45:35.905 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:35.904+0000 7f10178cf640 1 -- 172.21.15.73:0/1305127522 shutdown_connections 2023-12-12T09:45:35.905 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:35.904+0000 7f10178cf640 1 -- 172.21.15.73:0/1305127522 wait complete. 2023-12-12T09:45:35.923 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs2' 2023-12-12T09:45:35.924 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs2_metadata --pg_num_min 64 2023-12-12T09:45:36.132 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:36.131+0000 7f939e1d5640 1 Processor -- start 2023-12-12T09:45:36.132 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:36.132+0000 7f939e1d5640 1 -- start start 2023-12-12T09:45:36.139 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:36.133+0000 7f939e1d5640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f939806cc90 0x7f93980c2790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:36.139 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:36.133+0000 7f939e1d5640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93980c1520 con 0x7f93980c0320 2023-12-12T09:45:36.139 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:36.133+0000 7f939e1d5640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93980c57e0 con 0x7f93980c23b0 2023-12-12T09:45:36.139 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:36.133+0000 7f939e1d5640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93980c46f0 con 0x7f939806cc90 2023-12-12T09:45:36.139 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:36.133+0000 7f938ffff640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f93980c0320 0x7f93980c50d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:49020/0 (socket says 172.21.15.73:49020) 2023-12-12T09:45:36.139 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:36.133+0000 7f938ffff640 1 -- 172.21.15.73:0/3013898159 learned_addr learned my addr 172.21.15.73:0/3013898159 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-12T09:45:36.139 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:36.134+0000 7f9397fff640 1 --2- 172.21.15.73:0/3013898159 >> v2:172.21.15.142:3300/0 conn(0x7f939806cc90 0x7f93980c2790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:36.139 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:36.134+0000 7f9396ffd640 1 -- 172.21.15.73:0/3013898159 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2785505558 0 0) 0x7f9380001110 con 0x7f93980c0320 2023-12-12T09:45:36.139 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:36.134+0000 7f9396ffd640 1 -- 172.21.15.73:0/3013898159 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9384003520 con 0x7f93980c0320 2023-12-12T09:45:36.140 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:36.134+0000 7f9396ffd640 1 -- 172.21.15.73:0/3013898159 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2112225802 0 0) 0x7f9384003520 con 0x7f93980c0320 2023-12-12T09:45:36.140 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:36.134+0000 7f9396ffd640 1 -- 172.21.15.73:0/3013898159 >> v2:172.21.15.142:3300/0 conn(0x7f939806cc90 msgr2=0x7f93980c2790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:45:36.140 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:36.134+0000 7f9396ffd640 1 --2- 172.21.15.73:0/3013898159 >> v2:172.21.15.142:3300/0 conn(0x7f939806cc90 0x7f93980c2790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:36.140 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:36.134+0000 7f9396ffd640 1 -- 172.21.15.73:0/3013898159 >> v1:172.21.15.142:6789/0 conn(0x7f93980c23b0 legacy=0x7f9398159410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:36.140 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:36.134+0000 7f9396ffd640 1 -- 172.21.15.73:0/3013898159 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93980c0920 con 0x7f93980c0320 2023-12-12T09:45:36.140 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:36.134+0000 7f9396ffd640 1 -- 172.21.15.73:0/3013898159 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3186547832 0 0) 0x7f9380001800 con 0x7f93980c0320 2023-12-12T09:45:36.140 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:36.134+0000 7f9396ffd640 1 -- 172.21.15.73:0/3013898159 >> v1:172.21.15.73:6789/0 conn(0x7f93980c0320 legacy=0x7f93980c50d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:36.140 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:36.134+0000 7f9396ffd640 1 --2- 172.21.15.73:0/3013898159 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f93840039c0 0x7f9384003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:36.140 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:36.134+0000 7f9396ffd640 1 --2- 172.21.15.73:0/3013898159 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f93840047c0 0x7f9384004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:36.140 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:36.134+0000 7f9396ffd640 1 --2- 172.21.15.73:0/3013898159 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f93840052a0 0x7f938400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:36.140 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:36.134+0000 7f9396ffd640 1 -- 172.21.15.73:0/3013898159 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93980c46f0 con 0x7f93840052a0 2023-12-12T09:45:36.141 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:36.134+0000 7f9396ffd640 1 -- 172.21.15.73:0/3013898159 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f938400c1a0 con 0x7f93840047c0 2023-12-12T09:45:36.141 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:36.134+0000 7f9396ffd640 1 -- 172.21.15.73:0/3013898159 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f938400c360 con 0x7f93840039c0 2023-12-12T09:45:36.141 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:36.135+0000 7f9397fff640 1 --2- 172.21.15.73:0/3013898159 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f93840052a0 0x7f938400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:36.141 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:36.135+0000 7f93977fe640 1 --2- 172.21.15.73:0/3013898159 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f93840039c0 0x7f9384003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:36.141 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:36.135+0000 7f938ffff640 1 --2- 172.21.15.73:0/3013898159 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f93840047c0 0x7f9384004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:36.141 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:36.135+0000 7f9397fff640 1 -- 172.21.15.73:0/3013898159 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f93840039c0 msgr2=0x7f9384003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:45:36.141 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:36.135+0000 7f9397fff640 1 --2- 172.21.15.73:0/3013898159 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f93840039c0 0x7f9384003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:36.141 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:36.135+0000 7f9397fff640 1 -- 172.21.15.73:0/3013898159 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f93840047c0 msgr2=0x7f9384004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:45:36.142 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:36.135+0000 7f9397fff640 1 --2- 172.21.15.73:0/3013898159 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f93840047c0 0x7f9384004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:36.142 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:36.135+0000 7f9397fff640 1 -- 172.21.15.73:0/3013898159 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9384003520 con 0x7f93840052a0 2023-12-12T09:45:36.142 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:36.135+0000 7f93977fe640 1 --2- 172.21.15.73:0/3013898159 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f93840039c0 0x7f9384003de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:45:36.142 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:36.135+0000 7f938ffff640 1 --2- 172.21.15.73:0/3013898159 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f93840047c0 0x7f9384004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:45:36.142 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:36.136+0000 7f9397fff640 1 -- 172.21.15.73:0/3013898159 reap_dead start 2023-12-12T09:45:36.142 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:36.136+0000 7f9397fff640 1 --2- 172.21.15.73:0/3013898159 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f93840052a0 0x7f938400b980 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f9390009fc0 tx=0x7f93840057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b32cfb39cf9e60e server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:45:36.142 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:36.136+0000 7f9396ffd640 1 -- 172.21.15.73:0/3013898159 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f939002cc60 con 0x7f93840052a0 2023-12-12T09:45:36.142 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:36.136+0000 7f9396ffd640 1 -- 172.21.15.73:0/3013898159 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f939000f040 con 0x7f93840052a0 2023-12-12T09:45:36.142 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:36.136+0000 7f9396ffd640 1 -- 172.21.15.73:0/3013898159 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9390003990 con 0x7f93840052a0 2023-12-12T09:45:36.142 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:36.137+0000 7f939e1d5640 1 -- 172.21.15.73:0/3013898159 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f93840052a0 msgr2=0x7f938400b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:36.143 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:36.137+0000 7f939e1d5640 1 --2- 172.21.15.73:0/3013898159 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f93840052a0 0x7f938400b980 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f9390009fc0 tx=0x7f93840057f0 comp rx=0 tx=0).stop 2023-12-12T09:45:36.143 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:36.137+0000 7f939e1d5640 1 -- 172.21.15.73:0/3013898159 shutdown_connections 2023-12-12T09:45:36.143 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:36.137+0000 7f939e1d5640 1 --2- 172.21.15.73:0/3013898159 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f93840052a0 0x7f938400b980 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:36.143 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:36.137+0000 7f939e1d5640 1 -- 172.21.15.73:0/3013898159 >> 172.21.15.73:0/3013898159 conn(0x7f939806a4e0 msgr2=0x7f939806a8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:45:36.143 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:36.137+0000 7f939e1d5640 1 -- 172.21.15.73:0/3013898159 shutdown_connections 2023-12-12T09:45:36.143 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:36.137+0000 7f939e1d5640 1 -- 172.21.15.73:0/3013898159 wait complete. 2023-12-12T09:45:36.146 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:36.139+0000 7f939e1d5640 1 Processor -- start 2023-12-12T09:45:36.146 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:36.139+0000 7f939e1d5640 1 -- start start 2023-12-12T09:45:36.146 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:36.140+0000 7f939e1d5640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f93840052a0 0x7f93981e2c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:36.146 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:36.140+0000 7f939e1d5640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f93981e3440 0x7f93981f1a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:36.146 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:36.140+0000 7f939e1d5640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f93981f1f90 0x7f9398145860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:36.147 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:36.140+0000 7f939e1d5640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93980aa340 con 0x7f93840052a0 2023-12-12T09:45:36.147 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:36.140+0000 7f939e1d5640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93981e4780 con 0x7f93981e3440 2023-12-12T09:45:36.147 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:36.140+0000 7f939e1d5640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93981e4430 con 0x7f93981f1f90 2023-12-12T09:45:36.147 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:36.140+0000 7f93977fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f93840052a0 0x7f93981e2c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:36.147 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:36.140+0000 7f93977fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f93840052a0 0x7f93981e2c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:41082/0 (socket says 172.21.15.73:41082) 2023-12-12T09:45:36.147 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:36.140+0000 7f93977fe640 1 -- 172.21.15.73:0/488330300 learned_addr learned my addr 172.21.15.73:0/488330300 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:45:36.147 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:36.141+0000 7f938ffff640 1 --2- 172.21.15.73:0/488330300 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f93981e3440 0x7f93981f1a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:36.147 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:36.141+0000 7f93977fe640 1 -- 172.21.15.73:0/488330300 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f93981f1f90 msgr2=0x7f9398145860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:36.147 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:36.141+0000 7f9397fff640 1 --2- 172.21.15.73:0/488330300 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f93981f1f90 0x7f9398145860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:36.147 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:36.141+0000 7f93977fe640 1 --2- 172.21.15.73:0/488330300 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f93981f1f90 0x7f9398145860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:36.147 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:36.141+0000 7f93977fe640 1 -- 172.21.15.73:0/488330300 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f93981e3440 msgr2=0x7f93981f1a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:36.147 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:36.141+0000 7f93977fe640 1 --2- 172.21.15.73:0/488330300 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f93981e3440 0x7f93981f1a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:36.148 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:36.141+0000 7f93977fe640 1 -- 172.21.15.73:0/488330300 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93981e49d0 con 0x7f93840052a0 2023-12-12T09:45:36.148 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:36.141+0000 7f938ffff640 1 --2- 172.21.15.73:0/488330300 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f93981e3440 0x7f93981f1a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:45:36.148 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:36.141+0000 7f93977fe640 1 --2- 172.21.15.73:0/488330300 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f93840052a0 0x7f93981e2c30 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f938800d7a0 tx=0x7f938800dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:45:36.148 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:36.141+0000 7f9394ff9640 1 -- 172.21.15.73:0/488330300 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9388005270 con 0x7f93840052a0 2023-12-12T09:45:36.148 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:36.141+0000 7f9394ff9640 1 -- 172.21.15.73:0/488330300 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93880053d0 con 0x7f93840052a0 2023-12-12T09:45:36.148 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:36.141+0000 7f939e1d5640 1 -- 172.21.15.73:0/488330300 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93981e4cb0 con 0x7f93840052a0 2023-12-12T09:45:36.148 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:36.141+0000 7f9394ff9640 1 -- 172.21.15.73:0/488330300 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f938800b870 con 0x7f93840052a0 2023-12-12T09:45:36.148 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:36.141+0000 7f939e1d5640 1 -- 172.21.15.73:0/488330300 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93981e3170 con 0x7f93840052a0 2023-12-12T09:45:36.148 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:36.142+0000 7f939e1d5640 1 -- 172.21.15.73:0/488330300 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9398067070 con 0x7f93840052a0 2023-12-12T09:45:36.148 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:36.143+0000 7f9394ff9640 1 -- 172.21.15.73:0/488330300 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f938800b9d0 con 0x7f93840052a0 2023-12-12T09:45:36.148 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:36.144+0000 7f9394ff9640 1 --2- 172.21.15.73:0/488330300 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f937806ae40 0x7f937806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:36.148 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:36.144+0000 7f9394ff9640 1 -- 172.21.15.73:0/488330300 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9388089580 con 0x7f93840052a0 2023-12-12T09:45:36.149 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:36.144+0000 7f938ffff640 1 --2- 172.21.15.73:0/488330300 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f937806ae40 0x7f937806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:36.149 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:36.145+0000 7f938ffff640 1 --2- 172.21.15.73:0/488330300 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f937806ae40 0x7f937806d300 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f9380001eb0 tx=0x7f9380009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:45:36.149 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:36.148+0000 7f9394ff9640 1 -- 172.21.15.73:0/488330300 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f9388054590 con 0x7f93840052a0 2023-12-12T09:45:36.339 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:36.339+0000 7f939e1d5640 1 -- 172.21.15.73:0/488330300 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs2_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f9398067580 con 0x7f93840052a0 2023-12-12T09:45:36.622 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:36.621+0000 7f9394ff9640 1 -- 172.21.15.73:0/488330300 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs2_metadata", "pg_num_min": 64}]=0 pool 'cephfs2_metadata' created v55) v1 ==== 140+0+0 (secure 0 0 0) 0x7f9388019310 con 0x7f93840052a0 2023-12-12T09:45:36.622 INFO:teuthology.orchestra.run.smithi073.stderr:pool 'cephfs2_metadata' created 2023-12-12T09:45:36.625 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:36.625+0000 7f939e1d5640 1 -- 172.21.15.73:0/488330300 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f937806ae40 msgr2=0x7f937806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:36.625 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:36.625+0000 7f939e1d5640 1 --2- 172.21.15.73:0/488330300 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f937806ae40 0x7f937806d300 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f9380001eb0 tx=0x7f9380009040 comp rx=0 tx=0).stop 2023-12-12T09:45:36.625 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:36.625+0000 7f939e1d5640 1 -- 172.21.15.73:0/488330300 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f93840052a0 msgr2=0x7f93981e2c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:36.625 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:36.625+0000 7f939e1d5640 1 --2- 172.21.15.73:0/488330300 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f93840052a0 0x7f93981e2c30 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f938800d7a0 tx=0x7f938800dc60 comp rx=0 tx=0).stop 2023-12-12T09:45:36.626 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:36.625+0000 7f939e1d5640 1 -- 172.21.15.73:0/488330300 shutdown_connections 2023-12-12T09:45:36.626 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:36.625+0000 7f939e1d5640 1 --2- 172.21.15.73:0/488330300 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f937806ae40 0x7f937806d300 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:36.626 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:36.625+0000 7f939e1d5640 1 --2- 172.21.15.73:0/488330300 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f93981f1f90 0x7f9398145860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:36.626 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:36.625+0000 7f939e1d5640 1 --2- 172.21.15.73:0/488330300 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f93981e3440 0x7f93981f1a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:36.626 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:36.625+0000 7f939e1d5640 1 --2- 172.21.15.73:0/488330300 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f93840052a0 0x7f93981e2c30 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:36.626 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:36.625+0000 7f939e1d5640 1 -- 172.21.15.73:0/488330300 >> 172.21.15.73:0/488330300 conn(0x7f939806a4e0 msgr2=0x7f93980c4fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:45:36.626 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:36.626+0000 7f939e1d5640 1 -- 172.21.15.73:0/488330300 shutdown_connections 2023-12-12T09:45:36.626 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:36.626+0000 7f939e1d5640 1 -- 172.21.15.73:0/488330300 wait complete. 2023-12-12T09:45:36.650 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs2_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-12-12T09:45:36.851 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:36.851+0000 7f36f2a90640 1 Processor -- start 2023-12-12T09:45:36.851 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:36.851+0000 7f36f2a90640 1 -- start start 2023-12-12T09:45:36.853 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:36.852+0000 7f36f2a90640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f36ec0a4c90 0x7f36ec0c5420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:36.853 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:36.852+0000 7f36f2a90640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f36ec0c0320 0x7f36ec0c20b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:36.853 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:36.852+0000 7f36f2a90640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36ec0c3390 con 0x7f36ec14ea60 2023-12-12T09:45:36.853 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:36.852+0000 7f36f2a90640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36ec0c4b30 con 0x7f36ec0c0320 2023-12-12T09:45:36.853 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:36.852+0000 7f36f2a90640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36ec151e60 con 0x7f36ec0a4c90 2023-12-12T09:45:36.854 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:36.853+0000 7f36ebfff640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f36ec0a4c90 0x7f36ec0c5420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:36.855 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:36.853+0000 7f36f102d640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f36ec0c0320 0x7f36ec0c20b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:36.855 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:36.853+0000 7f36ebfff640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f36ec0a4c90 0x7f36ec0c5420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.73:38856/0 (socket says 172.21.15.73:38856) 2023-12-12T09:45:36.855 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:36.853+0000 7f36f082c640 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f36ec14ea60 0x7f36ec0c4420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.73:33080/0 (socket says 172.21.15.73:33080) 2023-12-12T09:45:36.855 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:36.853+0000 7f36ebfff640 1 -- 172.21.15.73:0/1299663821 learned_addr learned my addr 172.21.15.73:0/1299663821 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:45:36.855 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:36.854+0000 7f36ebfff640 1 -- 172.21.15.73:0/1299663821 >> v2:172.21.15.142:3300/0 conn(0x7f36ec0c0320 msgr2=0x7f36ec0c20b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:45:36.855 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:36.854+0000 7f36ebfff640 1 --2- 172.21.15.73:0/1299663821 >> v2:172.21.15.142:3300/0 conn(0x7f36ec0c0320 0x7f36ec0c20b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:36.855 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:36.854+0000 7f36ebfff640 1 -- 172.21.15.73:0/1299663821 >> v1:172.21.15.142:6789/0 conn(0x7f36ec14ea60 legacy=0x7f36ec0c4420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:36.855 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:36.854+0000 7f36ebfff640 1 -- 172.21.15.73:0/1299663821 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36ec152140 con 0x7f36ec0a4c90 2023-12-12T09:45:36.855 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:36.854+0000 7f36f102d640 1 --2- 172.21.15.73:0/1299663821 >> v2:172.21.15.142:3300/0 conn(0x7f36ec0c0320 0x7f36ec0c20b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-12T09:45:36.856 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:36.855+0000 7f36ebfff640 1 --2- 172.21.15.73:0/1299663821 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f36ec0a4c90 0x7f36ec0c5420 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f36dc009870 tx=0x7f36dc02b8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=178f0bf20276a3c5 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:45:36.858 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:36.856+0000 7f36eb7fe640 1 -- 172.21.15.73:0/1299663821 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36dc031640 con 0x7f36ec0a4c90 2023-12-12T09:45:36.858 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:36.856+0000 7f36eb7fe640 1 -- 172.21.15.73:0/1299663821 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36dc0317a0 con 0x7f36ec0a4c90 2023-12-12T09:45:36.858 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:36.856+0000 7f36eb7fe640 1 -- 172.21.15.73:0/1299663821 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36dc031b30 con 0x7f36ec0a4c90 2023-12-12T09:45:36.858 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:36.857+0000 7f36f2a90640 1 -- 172.21.15.73:0/1299663821 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f36ec0a4c90 msgr2=0x7f36ec0c5420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:36.858 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:36.857+0000 7f36f2a90640 1 --2- 172.21.15.73:0/1299663821 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f36ec0a4c90 0x7f36ec0c5420 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f36dc009870 tx=0x7f36dc02b8f0 comp rx=0 tx=0).stop 2023-12-12T09:45:36.859 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:36.857+0000 7f36f2a90640 1 -- 172.21.15.73:0/1299663821 shutdown_connections 2023-12-12T09:45:36.859 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:36.857+0000 7f36f2a90640 1 --2- 172.21.15.73:0/1299663821 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f36ec0a4c90 0x7f36ec0c5420 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:36.859 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:36.857+0000 7f36f2a90640 1 --2- 172.21.15.73:0/1299663821 >> v2:172.21.15.142:3300/0 conn(0x7f36ec0c0320 0x7f36ec0c20b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:36.859 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:36.857+0000 7f36f2a90640 1 -- 172.21.15.73:0/1299663821 >> 172.21.15.73:0/1299663821 conn(0x7f36ec06a4e0 msgr2=0x7f36ec06a8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:45:36.859 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:36.857+0000 7f36f2a90640 1 -- 172.21.15.73:0/1299663821 shutdown_connections 2023-12-12T09:45:36.860 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:36.857+0000 7f36f2a90640 1 -- 172.21.15.73:0/1299663821 wait complete. 2023-12-12T09:45:36.864 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:36.859+0000 7f36f2a90640 1 Processor -- start 2023-12-12T09:45:36.864 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:36.859+0000 7f36f2a90640 1 -- start start 2023-12-12T09:45:36.864 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:36.860+0000 7f36f2a90640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f36ec0a4c90 0x7f36ec146ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:36.865 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:36.860+0000 7f36f2a90640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f36ec0c0320 0x7f36ec1ec1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:36.865 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:36.860+0000 7f36f2a90640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f36ec14ea60 0x7f36ec1e8c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:36.867 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:36.860+0000 7f36f2a90640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36ec148cd0 con 0x7f36ec14ea60 2023-12-12T09:45:36.867 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:36.860+0000 7f36f2a90640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36ec1ec720 con 0x7f36ec0a4c90 2023-12-12T09:45:36.868 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:36.860+0000 7f36f2a90640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36ec0ab7e0 con 0x7f36ec0c0320 2023-12-12T09:45:36.868 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:36.860+0000 7f36f102d640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f36ec14ea60 0x7f36ec1e8c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:36.868 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:36.860+0000 7f36f102d640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f36ec14ea60 0x7f36ec1e8c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:41088/0 (socket says 172.21.15.73:41088) 2023-12-12T09:45:36.868 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:36.860+0000 7f36f102d640 1 -- 172.21.15.73:0/2190374660 learned_addr learned my addr 172.21.15.73:0/2190374660 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:45:36.868 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:36.860+0000 7f36f082c640 1 --2- 172.21.15.73:0/2190374660 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f36ec0a4c90 0x7f36ec146ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:36.868 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:36.860+0000 7f36ebfff640 1 --2- 172.21.15.73:0/2190374660 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f36ec0c0320 0x7f36ec1ec1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:36.869 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:36.860+0000 7f36f102d640 1 -- 172.21.15.73:0/2190374660 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f36ec0c0320 msgr2=0x7f36ec1ec1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:36.869 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:36.860+0000 7f36f102d640 1 --2- 172.21.15.73:0/2190374660 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f36ec0c0320 0x7f36ec1ec1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:36.869 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:36.861+0000 7f36f102d640 1 -- 172.21.15.73:0/2190374660 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f36ec0a4c90 msgr2=0x7f36ec146ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:36.869 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:36.861+0000 7f36f102d640 1 --2- 172.21.15.73:0/2190374660 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f36ec0a4c90 0x7f36ec146ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:36.869 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:36.861+0000 7f36f102d640 1 -- 172.21.15.73:0/2190374660 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36e4009a70 con 0x7f36ec14ea60 2023-12-12T09:45:36.869 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:36.861+0000 7f36f102d640 1 --2- 172.21.15.73:0/2190374660 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f36ec14ea60 0x7f36ec1e8c20 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f36e4009f00 tx=0x7f36e400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:45:36.869 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:36.861+0000 7f36e97fa640 1 -- 172.21.15.73:0/2190374660 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36e4009d70 con 0x7f36ec14ea60 2023-12-12T09:45:36.870 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:36.861+0000 7f36e97fa640 1 -- 172.21.15.73:0/2190374660 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36e400f040 con 0x7f36ec14ea60 2023-12-12T09:45:36.870 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:36.861+0000 7f36f2a90640 1 -- 172.21.15.73:0/2190374660 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36dc0094d0 con 0x7f36ec14ea60 2023-12-12T09:45:36.870 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:36.861+0000 7f36e97fa640 1 -- 172.21.15.73:0/2190374660 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36e4003bb0 con 0x7f36ec14ea60 2023-12-12T09:45:36.870 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:36.861+0000 7f36f2a90640 1 -- 172.21.15.73:0/2190374660 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36ec154150 con 0x7f36ec14ea60 2023-12-12T09:45:36.870 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:36.862+0000 7f36f2a90640 1 -- 172.21.15.73:0/2190374660 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36ec067070 con 0x7f36ec14ea60 2023-12-12T09:45:36.870 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:36.864+0000 7f36e97fa640 1 -- 172.21.15.73:0/2190374660 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f36e4014480 con 0x7f36ec14ea60 2023-12-12T09:45:36.871 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:36.864+0000 7f36e97fa640 1 --2- 172.21.15.73:0/2190374660 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f36d806ae40 0x7f36d806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:36.871 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:36.865+0000 7f36e97fa640 1 -- 172.21.15.73:0/2190374660 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6080+0+0 (secure 0 0 0) 0x7f36e408ab10 con 0x7f36ec14ea60 2023-12-12T09:45:36.871 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:36.865+0000 7f36f082c640 1 --2- 172.21.15.73:0/2190374660 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f36d806ae40 0x7f36d806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:36.871 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:36.865+0000 7f36f082c640 1 --2- 172.21.15.73:0/2190374660 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f36d806ae40 0x7f36d806d300 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f36e0000f60 tx=0x7f36e0007ca0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:45:36.872 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:36.868+0000 7f36e97fa640 1 -- 172.21.15.73:0/2190374660 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f36e4055ae0 con 0x7f36ec14ea60 2023-12-12T09:45:37.059 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:37.059+0000 7f36f2a90640 1 -- 172.21.15.73:0/2190374660 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs2_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f36ec067580 con 0x7f36ec14ea60 2023-12-12T09:45:37.627 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:37.627+0000 7f36e97fa640 1 -- 172.21.15.73:0/2190374660 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs2_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs2_data' created v56) v1 ==== 172+0+0 (secure 0 0 0) 0x7f36e4059100 con 0x7f36ec14ea60 2023-12-12T09:45:37.628 INFO:teuthology.orchestra.run.smithi073.stderr:pool 'cephfs2_data' created 2023-12-12T09:45:37.632 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:37.631+0000 7f36f2a90640 1 -- 172.21.15.73:0/2190374660 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f36d806ae40 msgr2=0x7f36d806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:37.632 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:37.631+0000 7f36f2a90640 1 --2- 172.21.15.73:0/2190374660 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f36d806ae40 0x7f36d806d300 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f36e0000f60 tx=0x7f36e0007ca0 comp rx=0 tx=0).stop 2023-12-12T09:45:37.632 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:37.631+0000 7f36f2a90640 1 -- 172.21.15.73:0/2190374660 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f36ec14ea60 msgr2=0x7f36ec1e8c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:37.632 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:37.631+0000 7f36f2a90640 1 --2- 172.21.15.73:0/2190374660 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f36ec14ea60 0x7f36ec1e8c20 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f36e4009f00 tx=0x7f36e400c490 comp rx=0 tx=0).stop 2023-12-12T09:45:37.633 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:37.631+0000 7f36f2a90640 1 -- 172.21.15.73:0/2190374660 shutdown_connections 2023-12-12T09:45:37.633 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:37.631+0000 7f36f2a90640 1 --2- 172.21.15.73:0/2190374660 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f36d806ae40 0x7f36d806d300 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:37.633 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:37.631+0000 7f36f2a90640 1 --2- 172.21.15.73:0/2190374660 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f36ec14ea60 0x7f36ec1e8c20 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:37.633 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:37.631+0000 7f36f2a90640 1 --2- 172.21.15.73:0/2190374660 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f36ec0c0320 0x7f36ec1ec1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:37.633 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:37.631+0000 7f36f2a90640 1 --2- 172.21.15.73:0/2190374660 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f36ec0a4c90 0x7f36ec146ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:37.633 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:37.631+0000 7f36f2a90640 1 -- 172.21.15.73:0/2190374660 >> 172.21.15.73:0/2190374660 conn(0x7f36ec06a4e0 msgr2=0x7f36ec06a8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:45:37.633 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:37.632+0000 7f36f2a90640 1 -- 172.21.15.73:0/2190374660 shutdown_connections 2023-12-12T09:45:37.633 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:37.632+0000 7f36f2a90640 1 -- 172.21.15.73:0/2190374660 wait complete. 2023-12-12T09:45:37.667 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs2 cephfs2_metadata cephfs2_data 2023-12-12T09:45:37.854 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:37.854+0000 7f80c8a7c640 1 Processor -- start 2023-12-12T09:45:37.855 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:37.854+0000 7f80c8a7c640 1 -- start start 2023-12-12T09:45:37.856 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:37.856+0000 7f80c8a7c640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f80c414ea60 0x7f80c40c5420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:37.856 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:37.856+0000 7f80c8a7c640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f80c40a4c90 0x7f80c40c0320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:37.856 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:37.856+0000 7f80c8a7c640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f80c40c4420 0x7f80c40c20b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:37.857 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:37.856+0000 7f80c8a7c640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80c40c3390 con 0x7f80c414ea60 2023-12-12T09:45:37.857 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:37.856+0000 7f80c8a7c640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80c4151e60 con 0x7f80c40a4c90 2023-12-12T09:45:37.857 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:37.856+0000 7f80c8a7c640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80c4152140 con 0x7f80c40c4420 2023-12-12T09:45:37.857 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:37.856+0000 7f80c259c640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f80c414ea60 0x7f80c40c5420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:37.857 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:37.856+0000 7f80c259c640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f80c414ea60 0x7f80c40c5420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:41098/0 (socket says 172.21.15.73:41098) 2023-12-12T09:45:37.857 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:37.856+0000 7f80c259c640 1 -- 172.21.15.73:0/226104586 learned_addr learned my addr 172.21.15.73:0/226104586 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:45:37.858 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:37.856+0000 7f80bbfff640 1 --2- 172.21.15.73:0/226104586 >> v2:172.21.15.142:3300/0 conn(0x7f80c40a4c90 0x7f80c40c0320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:37.858 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:37.857+0000 7f80c2d9d640 1 --2- 172.21.15.73:0/226104586 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f80c40c4420 0x7f80c40c20b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:37.858 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:37.857+0000 7f80c259c640 1 -- 172.21.15.73:0/226104586 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f80c40c4420 msgr2=0x7f80c40c20b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:45:37.858 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:37.857+0000 7f80c259c640 1 --2- 172.21.15.73:0/226104586 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f80c40c4420 0x7f80c40c20b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:37.858 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:37.857+0000 7f80c259c640 1 -- 172.21.15.73:0/226104586 >> v2:172.21.15.142:3300/0 conn(0x7f80c40a4c90 msgr2=0x7f80c40c0320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:45:37.858 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:37.857+0000 7f80c259c640 1 --2- 172.21.15.73:0/226104586 >> v2:172.21.15.142:3300/0 conn(0x7f80c40a4c90 0x7f80c40c0320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:37.858 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:37.857+0000 7f80c259c640 1 -- 172.21.15.73:0/226104586 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80c40c3940 con 0x7f80c414ea60 2023-12-12T09:45:37.858 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:37.857+0000 7f80c2d9d640 1 --2- 172.21.15.73:0/226104586 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f80c40c4420 0x7f80c40c20b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:45:37.859 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:37.858+0000 7f80c259c640 1 --2- 172.21.15.73:0/226104586 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f80c414ea60 0x7f80c40c5420 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f80c406f730 tx=0x7f80b402b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=749f27ff277acc94 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:45:37.860 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:37.858+0000 7f80c1d9b640 1 -- 172.21.15.73:0/226104586 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80b40317e0 con 0x7f80c414ea60 2023-12-12T09:45:37.860 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:37.858+0000 7f80c1d9b640 1 -- 172.21.15.73:0/226104586 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80b4031940 con 0x7f80c414ea60 2023-12-12T09:45:37.860 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:37.858+0000 7f80c1d9b640 1 -- 172.21.15.73:0/226104586 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80b4031cd0 con 0x7f80c414ea60 2023-12-12T09:45:37.860 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:37.859+0000 7f80c8a7c640 1 -- 172.21.15.73:0/226104586 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f80c414ea60 msgr2=0x7f80c40c5420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:37.861 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:37.859+0000 7f80c8a7c640 1 --2- 172.21.15.73:0/226104586 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f80c414ea60 0x7f80c40c5420 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f80c406f730 tx=0x7f80b402b880 comp rx=0 tx=0).stop 2023-12-12T09:45:37.861 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:37.859+0000 7f80c8a7c640 1 -- 172.21.15.73:0/226104586 shutdown_connections 2023-12-12T09:45:37.861 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:37.859+0000 7f80c8a7c640 1 --2- 172.21.15.73:0/226104586 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f80c40c4420 0x7f80c40c20b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:37.861 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:37.859+0000 7f80c8a7c640 1 --2- 172.21.15.73:0/226104586 >> v2:172.21.15.142:3300/0 conn(0x7f80c40a4c90 0x7f80c40c0320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:37.861 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:37.859+0000 7f80c8a7c640 1 --2- 172.21.15.73:0/226104586 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f80c414ea60 0x7f80c40c5420 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:37.862 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:37.859+0000 7f80c8a7c640 1 -- 172.21.15.73:0/226104586 >> 172.21.15.73:0/226104586 conn(0x7f80c406a4e0 msgr2=0x7f80c406a8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:45:37.862 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:37.859+0000 7f80c8a7c640 1 -- 172.21.15.73:0/226104586 shutdown_connections 2023-12-12T09:45:37.862 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:37.859+0000 7f80c8a7c640 1 -- 172.21.15.73:0/226104586 wait complete. 2023-12-12T09:45:37.864 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:37.861+0000 7f80c8a7c640 1 Processor -- start 2023-12-12T09:45:37.864 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:37.861+0000 7f80c8a7c640 1 -- start start 2023-12-12T09:45:37.864 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:37.862+0000 7f80c8a7c640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f80c40a4c90 0x7f80c4147960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:37.864 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:37.862+0000 7f80c8a7c640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f80c40c4420 0x7f80c4150320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:37.864 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:37.862+0000 7f80c8a7c640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f80c414ea60 0x7f80c41ed520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:37.864 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:37.862+0000 7f80c8a7c640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80c41470f0 con 0x7f80c414ea60 2023-12-12T09:45:37.864 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:37.862+0000 7f80c8a7c640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80c40a9760 con 0x7f80c40c4420 2023-12-12T09:45:37.865 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:37.862+0000 7f80c8a7c640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80c414fe90 con 0x7f80c40a4c90 2023-12-12T09:45:37.865 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:37.862+0000 7f80c2d9d640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f80c414ea60 0x7f80c41ed520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:37.865 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:37.862+0000 7f80c2d9d640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f80c414ea60 0x7f80c41ed520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:41110/0 (socket says 172.21.15.73:41110) 2023-12-12T09:45:37.865 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:37.862+0000 7f80c2d9d640 1 -- 172.21.15.73:0/2095579164 learned_addr learned my addr 172.21.15.73:0/2095579164 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:45:37.865 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:37.863+0000 7f80c259c640 1 --2- 172.21.15.73:0/2095579164 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f80c40a4c90 0x7f80c4147960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:37.865 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:37.863+0000 7f80bbfff640 1 --2- 172.21.15.73:0/2095579164 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f80c40c4420 0x7f80c4150320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:37.865 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:37.863+0000 7f80c2d9d640 1 -- 172.21.15.73:0/2095579164 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f80c40a4c90 msgr2=0x7f80c4147960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:37.865 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:37.863+0000 7f80c2d9d640 1 --2- 172.21.15.73:0/2095579164 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f80c40a4c90 0x7f80c4147960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:37.865 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:37.863+0000 7f80c2d9d640 1 -- 172.21.15.73:0/2095579164 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f80c40c4420 msgr2=0x7f80c4150320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:37.865 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:37.863+0000 7f80c2d9d640 1 --2- 172.21.15.73:0/2095579164 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f80c40c4420 0x7f80c4150320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:37.865 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:37.863+0000 7f80c2d9d640 1 -- 172.21.15.73:0/2095579164 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80b40094d0 con 0x7f80c414ea60 2023-12-12T09:45:37.865 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:37.863+0000 7f80c2d9d640 1 --2- 172.21.15.73:0/2095579164 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f80c414ea60 0x7f80c41ed520 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f80bc00cef0 tx=0x7f80bc00a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:45:37.865 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:37.863+0000 7f80baffd640 1 -- 172.21.15.73:0/2095579164 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80bc00d840 con 0x7f80c414ea60 2023-12-12T09:45:37.865 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:37.863+0000 7f80baffd640 1 -- 172.21.15.73:0/2095579164 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80bc00d9c0 con 0x7f80c414ea60 2023-12-12T09:45:37.866 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:37.863+0000 7f80c8a7c640 1 -- 172.21.15.73:0/2095579164 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80c414fb60 con 0x7f80c414ea60 2023-12-12T09:45:37.866 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:37.863+0000 7f80baffd640 1 -- 172.21.15.73:0/2095579164 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80bc00dd70 con 0x7f80c414ea60 2023-12-12T09:45:37.866 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:37.864+0000 7f80c8a7c640 1 -- 172.21.15.73:0/2095579164 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80c41ee3b0 con 0x7f80c414ea60 2023-12-12T09:45:37.866 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:37.865+0000 7f80c8a7c640 1 -- 172.21.15.73:0/2095579164 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f80c4067070 con 0x7f80c414ea60 2023-12-12T09:45:37.866 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:37.866+0000 7f80baffd640 1 -- 172.21.15.73:0/2095579164 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f80bc01e3b0 con 0x7f80c414ea60 2023-12-12T09:45:37.867 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:37.867+0000 7f80baffd640 1 --2- 172.21.15.73:0/2095579164 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f80a406ae70 0x7f80a406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:37.867 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:37.867+0000 7f80baffd640 1 -- 172.21.15.73:0/2095579164 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6463+0+0 (secure 0 0 0) 0x7f80bc08a310 con 0x7f80c414ea60 2023-12-12T09:45:37.867 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:37.867+0000 7f80c259c640 1 --2- 172.21.15.73:0/2095579164 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f80a406ae70 0x7f80a406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:37.868 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:37.868+0000 7f80c259c640 1 --2- 172.21.15.73:0/2095579164 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f80a406ae70 0x7f80a406d330 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f80b4036000 tx=0x7f80b403d040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:45:37.872 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:37.872+0000 7f80baffd640 1 -- 172.21.15.73:0/2095579164 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f80bc055180 con 0x7f80c414ea60 2023-12-12T09:45:38.102 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:38.102+0000 7f80c8a7c640 1 -- 172.21.15.73:0/2095579164 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs2", "metadata": "cephfs2_metadata", "data": "cephfs2_data"} v 0) v1 -- 0x7f80c4150000 con 0x7f80c414ea60 2023-12-12T09:45:38.652 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:38.651+0000 7f80baffd640 1 -- 172.21.15.73:0/2095579164 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs2", "metadata": "cephfs2_metadata", "data": "cephfs2_data"}]=0 new fs with metadata pool 10 and data pool 11 v31) v1 ==== 177+0+0 (secure 0 0 0) 0x7f80bc0587a0 con 0x7f80c414ea60 2023-12-12T09:45:38.652 INFO:teuthology.orchestra.run.smithi073.stderr:new fs with metadata pool 10 and data pool 11 2023-12-12T09:45:38.655 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:38.654+0000 7f80c8a7c640 1 -- 172.21.15.73:0/2095579164 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f80a406ae70 msgr2=0x7f80a406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:38.656 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:38.655+0000 7f80c8a7c640 1 --2- 172.21.15.73:0/2095579164 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f80a406ae70 0x7f80a406d330 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f80b4036000 tx=0x7f80b403d040 comp rx=0 tx=0).stop 2023-12-12T09:45:38.656 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:38.655+0000 7f80c8a7c640 1 -- 172.21.15.73:0/2095579164 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f80c414ea60 msgr2=0x7f80c41ed520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:38.656 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:38.655+0000 7f80c8a7c640 1 --2- 172.21.15.73:0/2095579164 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f80c414ea60 0x7f80c41ed520 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f80bc00cef0 tx=0x7f80bc00a710 comp rx=0 tx=0).stop 2023-12-12T09:45:38.656 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:38.655+0000 7f80c8a7c640 1 -- 172.21.15.73:0/2095579164 shutdown_connections 2023-12-12T09:45:38.656 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:38.655+0000 7f80c8a7c640 1 --2- 172.21.15.73:0/2095579164 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f80a406ae70 0x7f80a406d330 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:38.656 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:38.655+0000 7f80c8a7c640 1 --2- 172.21.15.73:0/2095579164 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f80c414ea60 0x7f80c41ed520 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:38.656 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:38.655+0000 7f80c8a7c640 1 --2- 172.21.15.73:0/2095579164 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f80c40c4420 0x7f80c4150320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:38.656 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:38.655+0000 7f80c8a7c640 1 --2- 172.21.15.73:0/2095579164 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f80c40a4c90 0x7f80c4147960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:38.656 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:38.655+0000 7f80c8a7c640 1 -- 172.21.15.73:0/2095579164 >> 172.21.15.73:0/2095579164 conn(0x7f80c406a4e0 msgr2=0x7f80c406a8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:45:38.656 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:38.655+0000 7f80c8a7c640 1 -- 172.21.15.73:0/2095579164 shutdown_connections 2023-12-12T09:45:38.656 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:38.655+0000 7f80c8a7c640 1 -- 172.21.15.73:0/2095579164 wait complete. 2023-12-12T09:45:38.681 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-12T09:45:38.880 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:38.880+0000 7f32517c9640 1 Processor -- start 2023-12-12T09:45:38.881 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:38.880+0000 7f32517c9640 1 -- start start 2023-12-12T09:45:38.882 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:38.882+0000 7f32517c9640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f324c06db70 0x7f324c0c39b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:38.882 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:38.882+0000 7f32517c9640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f324c0c5070 0x7f324c0c3ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:38.882 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:38.882+0000 7f32517c9640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f324c152610 con 0x7f324c14fa40 2023-12-12T09:45:38.882 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:38.882+0000 7f32517c9640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f324c1528f0 con 0x7f324c0c5070 2023-12-12T09:45:38.882 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:38.882+0000 7f32517c9640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f324c152bd0 con 0x7f324c06db70 2023-12-12T09:45:38.882 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:38.882+0000 7f324b7fe640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f324c0c5070 0x7f324c0c3ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:38.882 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:38.882+0000 7f324affd640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f324c14fa40 0x7f324c06a4e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:47220/0 (socket says 172.21.15.73:47220) 2023-12-12T09:45:38.883 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:38.882+0000 7f324affd640 1 -- 172.21.15.73:0/1833266877 learned_addr learned my addr 172.21.15.73:0/1833266877 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-12T09:45:38.883 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:38.882+0000 7f324a7fc640 1 --2- 172.21.15.73:0/1833266877 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f324c06db70 0x7f324c0c39b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:38.883 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:38.882+0000 7f324b7fe640 1 -- 172.21.15.73:0/1833266877 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f324c06db70 msgr2=0x7f324c0c39b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:45:38.883 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:38.882+0000 7f324b7fe640 1 --2- 172.21.15.73:0/1833266877 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f324c06db70 0x7f324c0c39b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:38.883 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:38.882+0000 7f324b7fe640 1 -- 172.21.15.73:0/1833266877 >> v1:172.21.15.73:6789/0 conn(0x7f324c14fa40 legacy=0x7f324c06a4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:38.884 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:38.883+0000 7f324b7fe640 1 -- 172.21.15.73:0/1833266877 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f324c152eb0 con 0x7f324c0c5070 2023-12-12T09:45:38.884 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:38.883+0000 7f324a7fc640 1 --2- 172.21.15.73:0/1833266877 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f324c06db70 0x7f324c0c39b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:45:38.884 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:38.884+0000 7f324b7fe640 1 --2- 172.21.15.73:0/1833266877 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f324c0c5070 0x7f324c0c3ef0 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f3244009d90 tx=0x7f324402beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e33290848c954efc server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:45:38.884 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:38.884+0000 7f3249ffb640 1 -- 172.21.15.73:0/1833266877 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f324402cc60 con 0x7f324c0c5070 2023-12-12T09:45:38.884 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:38.884+0000 7f3249ffb640 1 -- 172.21.15.73:0/1833266877 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f324402cdc0 con 0x7f324c0c5070 2023-12-12T09:45:38.884 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:38.884+0000 7f3249ffb640 1 -- 172.21.15.73:0/1833266877 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3244034660 con 0x7f324c0c5070 2023-12-12T09:45:38.885 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:38.884+0000 7f32517c9640 1 -- 172.21.15.73:0/1833266877 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f324c0c5070 msgr2=0x7f324c0c3ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:38.885 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:38.885+0000 7f32517c9640 1 --2- 172.21.15.73:0/1833266877 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f324c0c5070 0x7f324c0c3ef0 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f3244009d90 tx=0x7f324402beb0 comp rx=0 tx=0).stop 2023-12-12T09:45:38.885 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:38.885+0000 7f32517c9640 1 -- 172.21.15.73:0/1833266877 shutdown_connections 2023-12-12T09:45:38.885 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:38.885+0000 7f32517c9640 1 --2- 172.21.15.73:0/1833266877 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f324c06db70 0x7f324c0c39b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:38.885 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:38.885+0000 7f32517c9640 1 --2- 172.21.15.73:0/1833266877 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f324c0c5070 0x7f324c0c3ef0 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:38.885 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:38.885+0000 7f32517c9640 1 -- 172.21.15.73:0/1833266877 >> 172.21.15.73:0/1833266877 conn(0x7f324c0a8130 msgr2=0x7f324c0c24b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:45:38.886 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:38.885+0000 7f32517c9640 1 -- 172.21.15.73:0/1833266877 shutdown_connections 2023-12-12T09:45:38.886 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:38.885+0000 7f32517c9640 1 -- 172.21.15.73:0/1833266877 wait complete. 2023-12-12T09:45:38.886 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:38.886+0000 7f32517c9640 1 Processor -- start 2023-12-12T09:45:38.887 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:38.887+0000 7f32517c9640 1 -- start start 2023-12-12T09:45:38.888 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:38.887+0000 7f32517c9640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f324c06db70 0x7f324c0c42e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:38.888 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:38.887+0000 7f32517c9640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f324c0c5070 0x7f324c1dea30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:38.889 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:38.887+0000 7f32517c9640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f324c14fa40 0x7f324c1def70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:38.889 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:38.887+0000 7f32517c9640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f324c0a96f0 con 0x7f324c0c5070 2023-12-12T09:45:38.889 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:38.887+0000 7f32517c9640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f324c0a9f50 con 0x7f324c06db70 2023-12-12T09:45:38.889 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:38.887+0000 7f32517c9640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f324c1df4b0 con 0x7f324c14fa40 2023-12-12T09:45:38.889 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:38.888+0000 7f324a7fc640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f324c0c5070 0x7f324c1dea30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:38.889 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:38.888+0000 7f324a7fc640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f324c0c5070 0x7f324c1dea30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:42126/0 (socket says 172.21.15.73:42126) 2023-12-12T09:45:38.889 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:38.888+0000 7f324a7fc640 1 -- 172.21.15.73:0/4146764129 learned_addr learned my addr 172.21.15.73:0/4146764129 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:45:38.889 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:38.888+0000 7f324a7fc640 1 -- 172.21.15.73:0/4146764129 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f324c14fa40 msgr2=0x7f324c1def70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:38.889 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:38.888+0000 7f324a7fc640 1 --2- 172.21.15.73:0/4146764129 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f324c14fa40 0x7f324c1def70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:38.889 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:38.888+0000 7f324a7fc640 1 -- 172.21.15.73:0/4146764129 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f324c06db70 msgr2=0x7f324c0c42e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:38.889 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:38.888+0000 7f324affd640 1 --2- 172.21.15.73:0/4146764129 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f324c06db70 0x7f324c0c42e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:38.889 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:38.888+0000 7f324a7fc640 1 --2- 172.21.15.73:0/4146764129 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f324c06db70 0x7f324c0c42e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:38.889 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:38.888+0000 7f324a7fc640 1 -- 172.21.15.73:0/4146764129 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3244009a70 con 0x7f324c0c5070 2023-12-12T09:45:38.890 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:38.889+0000 7f324a7fc640 1 --2- 172.21.15.73:0/4146764129 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f324c0c5070 0x7f324c1dea30 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f324000c820 tx=0x7f324000cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:45:38.891 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:38.889+0000 7f32337fe640 1 -- 172.21.15.73:0/4146764129 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3240007a30 con 0x7f324c0c5070 2023-12-12T09:45:38.891 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:38.889+0000 7f32337fe640 1 -- 172.21.15.73:0/4146764129 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3240007b90 con 0x7f324c0c5070 2023-12-12T09:45:38.891 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:38.889+0000 7f32517c9640 1 -- 172.21.15.73:0/4146764129 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f324c0aa9c0 con 0x7f324c0c5070 2023-12-12T09:45:38.891 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:38.889+0000 7f32337fe640 1 -- 172.21.15.73:0/4146764129 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f324000ce10 con 0x7f324c0c5070 2023-12-12T09:45:38.891 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:38.889+0000 7f32517c9640 1 -- 172.21.15.73:0/4146764129 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f324c0a9be0 con 0x7f324c0c5070 2023-12-12T09:45:38.891 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:38.890+0000 7f32517c9640 1 -- 172.21.15.73:0/4146764129 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f324c067920 con 0x7f324c0c5070 2023-12-12T09:45:38.891 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:38.891+0000 7f32337fe640 1 -- 172.21.15.73:0/4146764129 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f32400113f0 con 0x7f324c0c5070 2023-12-12T09:45:38.892 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:38.892+0000 7f32337fe640 1 --2- 172.21.15.73:0/4146764129 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f323806ae40 0x7f323806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:38.892 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:38.892+0000 7f32337fe640 1 -- 172.21.15.73:0/4146764129 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f32400896a0 con 0x7f324c0c5070 2023-12-12T09:45:38.892 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:38.892+0000 7f324affd640 1 --2- 172.21.15.73:0/4146764129 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f323806ae40 0x7f323806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:38.893 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:38.893+0000 7f324affd640 1 --2- 172.21.15.73:0/4146764129 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f323806ae40 0x7f323806d300 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f323c005880 tx=0x7f323c009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:45:38.897 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:38.897+0000 7f32337fe640 1 -- 172.21.15.73:0/4146764129 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f3240054480 con 0x7f324c0c5070 2023-12-12T09:45:39.088 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:39.087+0000 7f32517c9640 1 -- 172.21.15.73:0/4146764129 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f324c067580 con 0x7f324c0c5070 2023-12-12T09:45:39.090 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:39.090+0000 7f32337fe640 1 -- 172.21.15.73:0/4146764129 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v57) v1 ==== 74+0+20305 (secure 0 0 0) 0x7f3240057aa0 con 0x7f324c0c5070 2023-12-12T09:45:39.091 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-12T09:45:39.091 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":57,"fsid":"ba240992-02b8-4c7e-92f2-27eb29ac433b","created":"2023-12-12T09:43:02.454719+0000","modified":"2023-12-12T09:45:38.103256+0000","last_up_change":"2023-12-12T09:43:13.913440+0000","last_in_change":"2023-12-12T09:43:05.925348+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-12T09:43:15.525508+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-12-12T09:45:21.264815+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"53","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-12-12T09:45:21.981834+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"54","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs2_metadata","create_time":"2023-12-12T09:45:36.388393+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"57","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs2_data","create_time":"2023-12-12T09:45:37.109653+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"57","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"dd9074be-dbe2-4c34-9896-a4223d8d3940","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":4047810203},{"type":"v1","addr":"172.21.15.73:6801","nonce":4047810203}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":4047810203},{"type":"v1","addr":"172.21.15.73:6803","nonce":4047810203}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":4047810203},{"type":"v1","addr":"172.21.15.73:6807","nonce":4047810203}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":4047810203},{"type":"v1","addr":"172.21.15.73:6805","nonce":4047810203}]},"public_addr":"172.21.15.73:6801/4047810203","cluster_addr":"172.21.15.73:6803/4047810203","heartbeat_back_addr":"172.21.15.73:6807/4047810203","heartbeat_front_addr":"172.21.15.73:6805/4047810203","state":["exists","up"]},{"osd":1,"uuid":"c4a05052-96d4-4758-a4e1-1a37f1e07fed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":1356058331},{"type":"v1","addr":"172.21.15.73:6824","nonce":1356058331}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":1356058331},{"type":"v1","addr":"172.21.15.73:6827","nonce":1356058331}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":1356058331},{"type":"v1","addr":"172.21.15.73:6831","nonce":1356058331}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":1356058331},{"type":"v1","addr":"172.21.15.73:6829","nonce":1356058331}]},"public_addr":"172.21.15.73:6824/1356058331","cluster_addr":"172.21.15.73:6827/1356058331","heartbeat_back_addr":"172.21.15.73:6831/1356058331","heartbeat_front_addr":"172.21.15.73:6829/1356058331","state":["exists","up"]},{"osd":2,"uuid":"512bc8ac-72c2-40d4-b3d2-d867a92c5213","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":1228903316},{"type":"v1","addr":"172.21.15.73:6817","nonce":1228903316}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":1228903316},{"type":"v1","addr":"172.21.15.73:6819","nonce":1228903316}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6823","nonce":1228903316},{"type":"v1","addr":"172.21.15.73:6825","nonce":1228903316}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":1228903316},{"type":"v1","addr":"172.21.15.73:6821","nonce":1228903316}]},"public_addr":"172.21.15.73:6817/1228903316","cluster_addr":"172.21.15.73:6819/1228903316","heartbeat_back_addr":"172.21.15.73:6825/1228903316","heartbeat_front_addr":"172.21.15.73:6821/1228903316","state":["exists","up"]},{"osd":3,"uuid":"3d1a91e0-42bf-437a-8eae-8d357c8f63a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":1293329670},{"type":"v1","addr":"172.21.15.73:6809","nonce":1293329670}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6810","nonce":1293329670},{"type":"v1","addr":"172.21.15.73:6811","nonce":1293329670}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":1293329670},{"type":"v1","addr":"172.21.15.73:6815","nonce":1293329670}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":1293329670},{"type":"v1","addr":"172.21.15.73:6813","nonce":1293329670}]},"public_addr":"172.21.15.73:6809/1293329670","cluster_addr":"172.21.15.73:6811/1293329670","heartbeat_back_addr":"172.21.15.73:6815/1293329670","heartbeat_front_addr":"172.21.15.73:6813/1293329670","state":["exists","up"]},{"osd":4,"uuid":"4b302fff-834c-4069-ac19-00e46f6c87b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":3727975702},{"type":"v1","addr":"172.21.15.142:6801","nonce":3727975702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":3727975702},{"type":"v1","addr":"172.21.15.142:6803","nonce":3727975702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6809","nonce":3727975702},{"type":"v1","addr":"172.21.15.142:6811","nonce":3727975702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6805","nonce":3727975702},{"type":"v1","addr":"172.21.15.142:6807","nonce":3727975702}]},"public_addr":"172.21.15.142:6801/3727975702","cluster_addr":"172.21.15.142:6803/3727975702","heartbeat_back_addr":"172.21.15.142:6811/3727975702","heartbeat_front_addr":"172.21.15.142:6807/3727975702","state":["exists","up"]},{"osd":5,"uuid":"d7cdace2-67d0-45cc-95f2-515cf6ef1b82","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6817","nonce":2353193632},{"type":"v1","addr":"172.21.15.142:6819","nonce":2353193632}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6821","nonce":2353193632},{"type":"v1","addr":"172.21.15.142:6823","nonce":2353193632}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6829","nonce":2353193632},{"type":"v1","addr":"172.21.15.142:6831","nonce":2353193632}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6825","nonce":2353193632},{"type":"v1","addr":"172.21.15.142:6827","nonce":2353193632}]},"public_addr":"172.21.15.142:6819/2353193632","cluster_addr":"172.21.15.142:6823/2353193632","heartbeat_back_addr":"172.21.15.142:6831/2353193632","heartbeat_front_addr":"172.21.15.142:6827/2353193632","state":["exists","up"]},{"osd":6,"uuid":"649ce78a-5626-445c-aedc-a651ed05a6f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":2006111986},{"type":"v1","addr":"172.21.15.142:6806","nonce":2006111986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":2006111986},{"type":"v1","addr":"172.21.15.142:6810","nonce":2006111986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":2006111986},{"type":"v1","addr":"172.21.15.142:6815","nonce":2006111986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":2006111986},{"type":"v1","addr":"172.21.15.142:6813","nonce":2006111986}]},"public_addr":"172.21.15.142:6806/2006111986","cluster_addr":"172.21.15.142:6810/2006111986","heartbeat_back_addr":"172.21.15.142:6815/2006111986","heartbeat_front_addr":"172.21.15.142:6813/2006111986","state":["exists","up"]},{"osd":7,"uuid":"af15ae3b-c1d0-4acf-92db-8a1805494d13","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":2573794341},{"type":"v1","addr":"172.21.15.142:6818","nonce":2573794341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":2573794341},{"type":"v1","addr":"172.21.15.142:6822","nonce":2573794341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":2573794341},{"type":"v1","addr":"172.21.15.142:6830","nonce":2573794341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":2573794341},{"type":"v1","addr":"172.21.15.142:6826","nonce":2573794341}]},"public_addr":"172.21.15.142:6818/2573794341","cluster_addr":"172.21.15.142:6822/2573794341","heartbeat_back_addr":"172.21.15.142:6830/2573794341","heartbeat_front_addr":"172.21.15.142:6826/2573794341","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.185824+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.262103+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.225556+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:10.523459+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:10.706035+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.257339+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.301776+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.051960+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-12T09:45:39.093 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:39.093+0000 7f32517c9640 1 -- 172.21.15.73:0/4146764129 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f323806ae40 msgr2=0x7f323806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:39.094 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:39.093+0000 7f32517c9640 1 --2- 172.21.15.73:0/4146764129 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f323806ae40 0x7f323806d300 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f323c005880 tx=0x7f323c009040 comp rx=0 tx=0).stop 2023-12-12T09:45:39.094 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:39.093+0000 7f32517c9640 1 -- 172.21.15.73:0/4146764129 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f324c0c5070 msgr2=0x7f324c1dea30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:39.094 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:39.093+0000 7f32517c9640 1 --2- 172.21.15.73:0/4146764129 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f324c0c5070 0x7f324c1dea30 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f324000c820 tx=0x7f324000cce0 comp rx=0 tx=0).stop 2023-12-12T09:45:39.094 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:39.093+0000 7f32517c9640 1 -- 172.21.15.73:0/4146764129 shutdown_connections 2023-12-12T09:45:39.094 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:39.093+0000 7f32517c9640 1 --2- 172.21.15.73:0/4146764129 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f323806ae40 0x7f323806d300 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:39.094 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:39.093+0000 7f32517c9640 1 --2- 172.21.15.73:0/4146764129 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f324c14fa40 0x7f324c1def70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:39.094 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:39.093+0000 7f32517c9640 1 --2- 172.21.15.73:0/4146764129 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f324c0c5070 0x7f324c1dea30 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:39.094 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:39.093+0000 7f32517c9640 1 --2- 172.21.15.73:0/4146764129 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f324c06db70 0x7f324c0c42e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:39.094 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:39.093+0000 7f32517c9640 1 -- 172.21.15.73:0/4146764129 >> 172.21.15.73:0/4146764129 conn(0x7f324c0a8130 msgr2=0x7f324c0a5ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:45:39.094 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:39.093+0000 7f32517c9640 1 -- 172.21.15.73:0/4146764129 shutdown_connections 2023-12-12T09:45:39.094 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:39.093+0000 7f32517c9640 1 -- 172.21.15.73:0/4146764129 wait complete. 2023-12-12T09:45:39.112 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-12T09:45:39.330 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:39.330+0000 7f9e4201e640 1 Processor -- start 2023-12-12T09:45:39.330 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:39.330+0000 7f9e4201e640 1 -- start start 2023-12-12T09:45:39.332 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:39.331+0000 7f9e4201e640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f9e3c0a5040 0x7f9e3c06bf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:39.332 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:39.331+0000 7f9e4201e640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f9e3c0c3ad0 0x7f9e3c1584f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:39.332 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:39.331+0000 7f9e4201e640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9e3c06a4e0 0x7f9e3c06a930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:39.332 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:39.331+0000 7f9e4201e640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e3c06c4d0 con 0x7f9e3c0c3ad0 2023-12-12T09:45:39.332 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:39.331+0000 7f9e4201e640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e3c0c4d00 con 0x7f9e3c0a5040 2023-12-12T09:45:39.332 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:39.331+0000 7f9e4201e640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e3c0c5100 con 0x7f9e3c06a4e0 2023-12-12T09:45:39.333 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:39.332+0000 7f9e33fff640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f9e3c0c3ad0 0x7f9e3c1584f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:39.333 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:39.332+0000 7f9e33fff640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f9e3c0c3ad0 0x7f9e3c1584f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:42136/0 (socket says 172.21.15.73:42136) 2023-12-12T09:45:39.333 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:39.332+0000 7f9e33fff640 1 -- 172.21.15.73:0/1995515869 learned_addr learned my addr 172.21.15.73:0/1995515869 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:45:39.333 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:39.332+0000 7f9e33fff640 1 -- 172.21.15.73:0/1995515869 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9e3c06a4e0 msgr2=0x7f9e3c06a930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:45:39.333 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:39.332+0000 7f9e33fff640 1 --2- 172.21.15.73:0/1995515869 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9e3c06a4e0 0x7f9e3c06a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:39.333 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:39.332+0000 7f9e33fff640 1 -- 172.21.15.73:0/1995515869 >> v2:172.21.15.142:3300/0 conn(0x7f9e3c0a5040 msgr2=0x7f9e3c06bf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:45:39.333 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:39.332+0000 7f9e33fff640 1 --2- 172.21.15.73:0/1995515869 >> v2:172.21.15.142:3300/0 conn(0x7f9e3c0a5040 0x7f9e3c06bf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:39.333 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:39.332+0000 7f9e33fff640 1 -- 172.21.15.73:0/1995515869 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e3c0c53e0 con 0x7f9e3c0c3ad0 2023-12-12T09:45:39.334 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:39.333+0000 7f9e33fff640 1 --2- 172.21.15.73:0/1995515869 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9e3c0c3ad0 0x7f9e3c1584f0 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f9e3c072cf0 tx=0x7f9e2402b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9974fb73387f32d7 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:45:39.334 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:39.333+0000 7f9e3affd640 1 -- 172.21.15.73:0/1995515869 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e24030860 con 0x7f9e3c0c3ad0 2023-12-12T09:45:39.334 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:39.333+0000 7f9e3affd640 1 -- 172.21.15.73:0/1995515869 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e240309c0 con 0x7f9e3c0c3ad0 2023-12-12T09:45:39.334 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:39.333+0000 7f9e3affd640 1 -- 172.21.15.73:0/1995515869 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e24030d50 con 0x7f9e3c0c3ad0 2023-12-12T09:45:39.335 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:39.334+0000 7f9e4201e640 1 -- 172.21.15.73:0/1995515869 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9e3c0c3ad0 msgr2=0x7f9e3c1584f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:39.335 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:39.334+0000 7f9e4201e640 1 --2- 172.21.15.73:0/1995515869 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9e3c0c3ad0 0x7f9e3c1584f0 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f9e3c072cf0 tx=0x7f9e2402b9a0 comp rx=0 tx=0).stop 2023-12-12T09:45:39.335 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:39.334+0000 7f9e4201e640 1 -- 172.21.15.73:0/1995515869 shutdown_connections 2023-12-12T09:45:39.335 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:39.334+0000 7f9e4201e640 1 --2- 172.21.15.73:0/1995515869 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9e3c06a4e0 0x7f9e3c06a930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:39.335 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:39.334+0000 7f9e4201e640 1 --2- 172.21.15.73:0/1995515869 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9e3c0c3ad0 0x7f9e3c1584f0 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:39.335 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:39.334+0000 7f9e4201e640 1 --2- 172.21.15.73:0/1995515869 >> v2:172.21.15.142:3300/0 conn(0x7f9e3c0a5040 0x7f9e3c06bf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:39.335 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:39.334+0000 7f9e4201e640 1 -- 172.21.15.73:0/1995515869 >> 172.21.15.73:0/1995515869 conn(0x7f9e3c0a8130 msgr2=0x7f9e3c0c24b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:45:39.335 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:39.335+0000 7f9e4201e640 1 -- 172.21.15.73:0/1995515869 shutdown_connections 2023-12-12T09:45:39.335 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:39.335+0000 7f9e4201e640 1 -- 172.21.15.73:0/1995515869 wait complete. 2023-12-12T09:45:39.336 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:39.336+0000 7f9e4201e640 1 Processor -- start 2023-12-12T09:45:39.336 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:39.336+0000 7f9e4201e640 1 -- start start 2023-12-12T09:45:39.338 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:39.337+0000 7f9e4201e640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9e3c06a4e0 0x7f9e3c1eaef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:39.338 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:39.337+0000 7f9e4201e640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9e3c0a5040 0x7f9e3c0c5c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:39.338 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:39.337+0000 7f9e4201e640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9e3c0c3ad0 0x7f9e3c1ddd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:39.338 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:39.337+0000 7f9e4201e640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e3c1eaa60 con 0x7f9e3c0c3ad0 2023-12-12T09:45:39.338 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:39.337+0000 7f9e4201e640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e3c0aad30 con 0x7f9e3c0a5040 2023-12-12T09:45:39.338 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:39.337+0000 7f9e4201e640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e3c1ea430 con 0x7f9e3c06a4e0 2023-12-12T09:45:39.338 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:39.338+0000 7f9e3bfff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9e3c0c3ad0 0x7f9e3c1ddd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:39.338 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:39.338+0000 7f9e3bfff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9e3c0c3ad0 0x7f9e3c1ddd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:42146/0 (socket says 172.21.15.73:42146) 2023-12-12T09:45:39.338 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:39.338+0000 7f9e3bfff640 1 -- 172.21.15.73:0/3976730542 learned_addr learned my addr 172.21.15.73:0/3976730542 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:45:39.339 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:39.338+0000 7f9e3b7fe640 1 --2- 172.21.15.73:0/3976730542 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9e3c06a4e0 0x7f9e3c1eaef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:39.340 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:39.338+0000 7f9e3bfff640 1 -- 172.21.15.73:0/3976730542 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9e3c06a4e0 msgr2=0x7f9e3c1eaef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:39.340 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:39.338+0000 7f9e3bfff640 1 --2- 172.21.15.73:0/3976730542 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9e3c06a4e0 0x7f9e3c1eaef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:39.340 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:39.338+0000 7f9e3bfff640 1 -- 172.21.15.73:0/3976730542 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9e3c0a5040 msgr2=0x7f9e3c0c5c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:39.340 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:39.338+0000 7f9e3bfff640 1 --2- 172.21.15.73:0/3976730542 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9e3c0a5040 0x7f9e3c0c5c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:39.340 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:39.338+0000 7f9e3bfff640 1 -- 172.21.15.73:0/3976730542 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e240094d0 con 0x7f9e3c0c3ad0 2023-12-12T09:45:39.340 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:39.338+0000 7f9e3bfff640 1 --2- 172.21.15.73:0/3976730542 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9e3c0c3ad0 0x7f9e3c1ddd00 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f9e3400b9a0 tx=0x7f9e3400be60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:45:39.340 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:39.339+0000 7f9e38ff9640 1 -- 172.21.15.73:0/3976730542 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e3400cba0 con 0x7f9e3c0c3ad0 2023-12-12T09:45:39.340 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:39.339+0000 7f9e38ff9640 1 -- 172.21.15.73:0/3976730542 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e3400cd20 con 0x7f9e3c0c3ad0 2023-12-12T09:45:39.340 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:39.339+0000 7f9e38ff9640 1 -- 172.21.15.73:0/3976730542 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e34014680 con 0x7f9e3c0c3ad0 2023-12-12T09:45:39.340 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:39.339+0000 7f9e4201e640 1 -- 172.21.15.73:0/3976730542 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e3c0999d0 con 0x7f9e3c0c3ad0 2023-12-12T09:45:39.340 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:39.339+0000 7f9e4201e640 1 -- 172.21.15.73:0/3976730542 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e3c099f90 con 0x7f9e3c0c3ad0 2023-12-12T09:45:39.341 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:39.340+0000 7f9e4201e640 1 -- 172.21.15.73:0/3976730542 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e3c067920 con 0x7f9e3c0c3ad0 2023-12-12T09:45:39.341 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:39.341+0000 7f9e38ff9640 1 -- 172.21.15.73:0/3976730542 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f9e3401d3b0 con 0x7f9e3c0c3ad0 2023-12-12T09:45:39.342 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:39.342+0000 7f9e38ff9640 1 --2- 172.21.15.73:0/3976730542 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f9e1c06ae40 0x7f9e1c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:39.342 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:39.342+0000 7f9e38ff9640 1 -- 172.21.15.73:0/3976730542 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f9e34089880 con 0x7f9e3c0c3ad0 2023-12-12T09:45:39.342 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:39.342+0000 7f9e3b7fe640 1 --2- 172.21.15.73:0/3976730542 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f9e1c06ae40 0x7f9e1c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:39.343 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:39.343+0000 7f9e3b7fe640 1 --2- 172.21.15.73:0/3976730542 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f9e1c06ae40 0x7f9e1c06d300 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f9e3c072a10 tx=0x7f9e2c008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:45:39.346 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:39.346+0000 7f9e38ff9640 1 -- 172.21.15.73:0/3976730542 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f9e34054660 con 0x7f9e3c0c3ad0 2023-12-12T09:45:39.541 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:39.540+0000 7f9e4201e640 1 -- 172.21.15.73:0/3976730542 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9e3c067580 con 0x7f9e3c0c3ad0 2023-12-12T09:45:39.544 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:39.544+0000 7f9e38ff9640 1 -- 172.21.15.73:0/3976730542 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v58) v1 ==== 74+0+20292 (secure 0 0 0) 0x7f9e34019090 con 0x7f9e3c0c3ad0 2023-12-12T09:45:39.545 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-12T09:45:39.545 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":58,"fsid":"ba240992-02b8-4c7e-92f2-27eb29ac433b","created":"2023-12-12T09:43:02.454719+0000","modified":"2023-12-12T09:45:39.273967+0000","last_up_change":"2023-12-12T09:43:13.913440+0000","last_in_change":"2023-12-12T09:43:05.925348+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-12T09:43:15.525508+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-12-12T09:45:21.264815+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"53","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-12-12T09:45:21.981834+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"54","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs2_metadata","create_time":"2023-12-12T09:45:36.388393+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"57","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs2_data","create_time":"2023-12-12T09:45:37.109653+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"58","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"dd9074be-dbe2-4c34-9896-a4223d8d3940","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":4047810203},{"type":"v1","addr":"172.21.15.73:6801","nonce":4047810203}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":4047810203},{"type":"v1","addr":"172.21.15.73:6803","nonce":4047810203}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":4047810203},{"type":"v1","addr":"172.21.15.73:6807","nonce":4047810203}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":4047810203},{"type":"v1","addr":"172.21.15.73:6805","nonce":4047810203}]},"public_addr":"172.21.15.73:6801/4047810203","cluster_addr":"172.21.15.73:6803/4047810203","heartbeat_back_addr":"172.21.15.73:6807/4047810203","heartbeat_front_addr":"172.21.15.73:6805/4047810203","state":["exists","up"]},{"osd":1,"uuid":"c4a05052-96d4-4758-a4e1-1a37f1e07fed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":1356058331},{"type":"v1","addr":"172.21.15.73:6824","nonce":1356058331}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":1356058331},{"type":"v1","addr":"172.21.15.73:6827","nonce":1356058331}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":1356058331},{"type":"v1","addr":"172.21.15.73:6831","nonce":1356058331}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":1356058331},{"type":"v1","addr":"172.21.15.73:6829","nonce":1356058331}]},"public_addr":"172.21.15.73:6824/1356058331","cluster_addr":"172.21.15.73:6827/1356058331","heartbeat_back_addr":"172.21.15.73:6831/1356058331","heartbeat_front_addr":"172.21.15.73:6829/1356058331","state":["exists","up"]},{"osd":2,"uuid":"512bc8ac-72c2-40d4-b3d2-d867a92c5213","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":1228903316},{"type":"v1","addr":"172.21.15.73:6817","nonce":1228903316}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":1228903316},{"type":"v1","addr":"172.21.15.73:6819","nonce":1228903316}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6823","nonce":1228903316},{"type":"v1","addr":"172.21.15.73:6825","nonce":1228903316}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":1228903316},{"type":"v1","addr":"172.21.15.73:6821","nonce":1228903316}]},"public_addr":"172.21.15.73:6817/1228903316","cluster_addr":"172.21.15.73:6819/1228903316","heartbeat_back_addr":"172.21.15.73:6825/1228903316","heartbeat_front_addr":"172.21.15.73:6821/1228903316","state":["exists","up"]},{"osd":3,"uuid":"3d1a91e0-42bf-437a-8eae-8d357c8f63a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":1293329670},{"type":"v1","addr":"172.21.15.73:6809","nonce":1293329670}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6810","nonce":1293329670},{"type":"v1","addr":"172.21.15.73:6811","nonce":1293329670}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":1293329670},{"type":"v1","addr":"172.21.15.73:6815","nonce":1293329670}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":1293329670},{"type":"v1","addr":"172.21.15.73:6813","nonce":1293329670}]},"public_addr":"172.21.15.73:6809/1293329670","cluster_addr":"172.21.15.73:6811/1293329670","heartbeat_back_addr":"172.21.15.73:6815/1293329670","heartbeat_front_addr":"172.21.15.73:6813/1293329670","state":["exists","up"]},{"osd":4,"uuid":"4b302fff-834c-4069-ac19-00e46f6c87b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":3727975702},{"type":"v1","addr":"172.21.15.142:6801","nonce":3727975702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":3727975702},{"type":"v1","addr":"172.21.15.142:6803","nonce":3727975702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6809","nonce":3727975702},{"type":"v1","addr":"172.21.15.142:6811","nonce":3727975702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6805","nonce":3727975702},{"type":"v1","addr":"172.21.15.142:6807","nonce":3727975702}]},"public_addr":"172.21.15.142:6801/3727975702","cluster_addr":"172.21.15.142:6803/3727975702","heartbeat_back_addr":"172.21.15.142:6811/3727975702","heartbeat_front_addr":"172.21.15.142:6807/3727975702","state":["exists","up"]},{"osd":5,"uuid":"d7cdace2-67d0-45cc-95f2-515cf6ef1b82","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6817","nonce":2353193632},{"type":"v1","addr":"172.21.15.142:6819","nonce":2353193632}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6821","nonce":2353193632},{"type":"v1","addr":"172.21.15.142:6823","nonce":2353193632}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6829","nonce":2353193632},{"type":"v1","addr":"172.21.15.142:6831","nonce":2353193632}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6825","nonce":2353193632},{"type":"v1","addr":"172.21.15.142:6827","nonce":2353193632}]},"public_addr":"172.21.15.142:6819/2353193632","cluster_addr":"172.21.15.142:6823/2353193632","heartbeat_back_addr":"172.21.15.142:6831/2353193632","heartbeat_front_addr":"172.21.15.142:6827/2353193632","state":["exists","up"]},{"osd":6,"uuid":"649ce78a-5626-445c-aedc-a651ed05a6f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":2006111986},{"type":"v1","addr":"172.21.15.142:6806","nonce":2006111986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":2006111986},{"type":"v1","addr":"172.21.15.142:6810","nonce":2006111986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":2006111986},{"type":"v1","addr":"172.21.15.142:6815","nonce":2006111986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":2006111986},{"type":"v1","addr":"172.21.15.142:6813","nonce":2006111986}]},"public_addr":"172.21.15.142:6806/2006111986","cluster_addr":"172.21.15.142:6810/2006111986","heartbeat_back_addr":"172.21.15.142:6815/2006111986","heartbeat_front_addr":"172.21.15.142:6813/2006111986","state":["exists","up"]},{"osd":7,"uuid":"af15ae3b-c1d0-4acf-92db-8a1805494d13","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":2573794341},{"type":"v1","addr":"172.21.15.142:6818","nonce":2573794341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":2573794341},{"type":"v1","addr":"172.21.15.142:6822","nonce":2573794341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":2573794341},{"type":"v1","addr":"172.21.15.142:6830","nonce":2573794341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":2573794341},{"type":"v1","addr":"172.21.15.142:6826","nonce":2573794341}]},"public_addr":"172.21.15.142:6818/2573794341","cluster_addr":"172.21.15.142:6822/2573794341","heartbeat_back_addr":"172.21.15.142:6830/2573794341","heartbeat_front_addr":"172.21.15.142:6826/2573794341","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.185824+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.262103+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.225556+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:10.523459+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:10.706035+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.257339+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.301776+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.051960+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-12T09:45:39.547 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:39.547+0000 7f9e4201e640 1 -- 172.21.15.73:0/3976730542 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f9e1c06ae40 msgr2=0x7f9e1c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:39.547 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:39.547+0000 7f9e4201e640 1 --2- 172.21.15.73:0/3976730542 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f9e1c06ae40 0x7f9e1c06d300 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f9e3c072a10 tx=0x7f9e2c008040 comp rx=0 tx=0).stop 2023-12-12T09:45:39.548 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:39.547+0000 7f9e4201e640 1 -- 172.21.15.73:0/3976730542 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9e3c0c3ad0 msgr2=0x7f9e3c1ddd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:39.548 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:39.547+0000 7f9e4201e640 1 --2- 172.21.15.73:0/3976730542 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9e3c0c3ad0 0x7f9e3c1ddd00 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f9e3400b9a0 tx=0x7f9e3400be60 comp rx=0 tx=0).stop 2023-12-12T09:45:39.548 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:39.547+0000 7f9e4201e640 1 -- 172.21.15.73:0/3976730542 shutdown_connections 2023-12-12T09:45:39.548 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:39.547+0000 7f9e4201e640 1 --2- 172.21.15.73:0/3976730542 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f9e1c06ae40 0x7f9e1c06d300 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:39.548 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:39.547+0000 7f9e4201e640 1 --2- 172.21.15.73:0/3976730542 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9e3c0c3ad0 0x7f9e3c1ddd00 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:39.548 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:39.547+0000 7f9e4201e640 1 --2- 172.21.15.73:0/3976730542 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9e3c0a5040 0x7f9e3c0c5c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:39.548 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:39.547+0000 7f9e4201e640 1 --2- 172.21.15.73:0/3976730542 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9e3c06a4e0 0x7f9e3c1eaef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:39.548 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:39.547+0000 7f9e4201e640 1 -- 172.21.15.73:0/3976730542 >> 172.21.15.73:0/3976730542 conn(0x7f9e3c0a8130 msgr2=0x7f9e3c06cfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:45:39.548 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:39.547+0000 7f9e4201e640 1 -- 172.21.15.73:0/3976730542 shutdown_connections 2023-12-12T09:45:39.548 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:39.547+0000 7f9e4201e640 1 -- 172.21.15.73:0/3976730542 wait complete. 2023-12-12T09:45:39.566 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs2 standby_count_wanted 0 2023-12-12T09:45:39.775 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:39.774+0000 7f9bc2e17640 1 Processor -- start 2023-12-12T09:45:39.775 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:39.775+0000 7f9bc2e17640 1 -- start start 2023-12-12T09:45:39.776 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:39.776+0000 7f9bc2e17640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f9bbc14ea60 0x7f9bbc0c5420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:39.776 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:39.776+0000 7f9bc2e17640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9bbc0a4c90 0x7f9bbc0c0320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:39.777 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:39.776+0000 7f9bc2e17640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9bbc0c3390 con 0x7f9bbc0c4420 2023-12-12T09:45:39.777 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:39.776+0000 7f9bc2e17640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9bbc151e60 con 0x7f9bbc14ea60 2023-12-12T09:45:39.777 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:39.776+0000 7f9bc2e17640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9bbc152140 con 0x7f9bbc0a4c90 2023-12-12T09:45:39.777 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:39.776+0000 7f9bc13b4640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f9bbc0c4420 0x7f9bbc0c20b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:47222/0 (socket says 172.21.15.73:47222) 2023-12-12T09:45:39.777 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:39.776+0000 7f9bc13b4640 1 -- 172.21.15.73:0/810076021 learned_addr learned my addr 172.21.15.73:0/810076021 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-12T09:45:39.779 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:39.777+0000 7f9bbbfff640 1 --2- 172.21.15.73:0/810076021 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9bbc0a4c90 0x7f9bbc0c0320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:39.779 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:39.777+0000 7f9bc0bb3640 1 --2- 172.21.15.73:0/810076021 >> v2:172.21.15.142:3300/0 conn(0x7f9bbc14ea60 0x7f9bbc0c5420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:39.779 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:39.777+0000 7f9bbb7fe640 1 -- 172.21.15.73:0/810076021 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1767379352 0 0) 0x7f9bbc0c3390 con 0x7f9bbc0c4420 2023-12-12T09:45:39.779 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:39.777+0000 7f9bbb7fe640 1 -- 172.21.15.73:0/810076021 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9bac003520 con 0x7f9bbc0c4420 2023-12-12T09:45:39.779 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:39.777+0000 7f9bbb7fe640 1 -- 172.21.15.73:0/810076021 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 935758043 0 0) 0x7f9bac003520 con 0x7f9bbc0c4420 2023-12-12T09:45:39.779 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:39.777+0000 7f9bbb7fe640 1 -- 172.21.15.73:0/810076021 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9bbc0a4c90 msgr2=0x7f9bbc0c0320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:45:39.779 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:39.777+0000 7f9bbb7fe640 1 --2- 172.21.15.73:0/810076021 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9bbc0a4c90 0x7f9bbc0c0320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:39.779 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:39.777+0000 7f9bbb7fe640 1 -- 172.21.15.73:0/810076021 >> v2:172.21.15.142:3300/0 conn(0x7f9bbc14ea60 msgr2=0x7f9bbc0c5420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:45:39.779 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:39.777+0000 7f9bbb7fe640 1 --2- 172.21.15.73:0/810076021 >> v2:172.21.15.142:3300/0 conn(0x7f9bbc14ea60 0x7f9bbc0c5420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:39.780 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:39.777+0000 7f9bbb7fe640 1 -- 172.21.15.73:0/810076021 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bbc0c3940 con 0x7f9bbc0c4420 2023-12-12T09:45:39.780 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:39.777+0000 7f9bbb7fe640 1 -- 172.21.15.73:0/810076021 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3186547832 0 0) 0x7f9bb40019f0 con 0x7f9bbc0c4420 2023-12-12T09:45:39.780 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:39.777+0000 7f9bc0bb3640 1 --2- 172.21.15.73:0/810076021 >> v2:172.21.15.142:3300/0 conn(0x7f9bbc14ea60 0x7f9bbc0c5420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-12T09:45:39.780 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:39.777+0000 7f9bbb7fe640 1 -- 172.21.15.73:0/810076021 >> v1:172.21.15.73:6789/0 conn(0x7f9bbc0c4420 legacy=0x7f9bbc0c20b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:39.780 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:39.777+0000 7f9bbb7fe640 1 --2- 172.21.15.73:0/810076021 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9bac003970 0x7f9bac003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:39.780 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:39.777+0000 7f9bbb7fe640 1 --2- 172.21.15.73:0/810076021 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9bac0047c0 0x7f9bac004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:39.780 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:39.777+0000 7f9bbb7fe640 1 --2- 172.21.15.73:0/810076021 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9bbc0a4c90 0x7f9bac005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:39.780 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:39.778+0000 7f9bbb7fe640 1 -- 172.21.15.73:0/810076021 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bbc151e60 con 0x7f9bac003970 2023-12-12T09:45:39.780 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:39.778+0000 7f9bbb7fe640 1 -- 172.21.15.73:0/810076021 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bbc152140 con 0x7f9bac0047c0 2023-12-12T09:45:39.780 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:39.778+0000 7f9bbb7fe640 1 -- 172.21.15.73:0/810076021 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9bac00ba80 con 0x7f9bbc0a4c90 2023-12-12T09:45:39.780 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:39.778+0000 7f9bc0bb3640 1 --2- 172.21.15.73:0/810076021 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9bac003970 0x7f9bac003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:39.780 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:39.778+0000 7f9bc0bb3640 1 -- 172.21.15.73:0/810076021 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9bbc0a4c90 msgr2=0x7f9bac005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:45:39.780 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:39.778+0000 7f9bc0bb3640 1 --2- 172.21.15.73:0/810076021 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9bbc0a4c90 0x7f9bac005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:39.780 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:39.778+0000 7f9bc0bb3640 1 -- 172.21.15.73:0/810076021 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9bac0047c0 msgr2=0x7f9bac004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:45:39.780 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:39.778+0000 7f9bc0bb3640 1 --2- 172.21.15.73:0/810076021 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9bac0047c0 0x7f9bac004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:39.781 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:39.778+0000 7f9bc0bb3640 1 -- 172.21.15.73:0/810076021 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bac003520 con 0x7f9bac003970 2023-12-12T09:45:39.782 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:39.779+0000 7f9bc0bb3640 1 --2- 172.21.15.73:0/810076021 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9bac003970 0x7f9bac003d90 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f9bb00098a0 tx=0x7f9bac0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=773e99b280c087a8 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:45:39.782 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:39.780+0000 7f9bbb7fe640 1 -- 172.21.15.73:0/810076021 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bb0004230 con 0x7f9bac003970 2023-12-12T09:45:39.782 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:39.780+0000 7f9bbb7fe640 1 -- 172.21.15.73:0/810076021 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9bb0004390 con 0x7f9bac003970 2023-12-12T09:45:39.782 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:39.780+0000 7f9bbb7fe640 1 -- 172.21.15.73:0/810076021 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bb0003830 con 0x7f9bac003970 2023-12-12T09:45:39.782 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:39.780+0000 7f9bc2e17640 1 -- 172.21.15.73:0/810076021 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9bac003970 msgr2=0x7f9bac003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:39.782 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:39.780+0000 7f9bc2e17640 1 --2- 172.21.15.73:0/810076021 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9bac003970 0x7f9bac003d90 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f9bb00098a0 tx=0x7f9bac0057f0 comp rx=0 tx=0).stop 2023-12-12T09:45:39.782 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:39.780+0000 7f9bc13b4640 1 -- 172.21.15.73:0/810076021 reap_dead start 2023-12-12T09:45:39.782 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:39.780+0000 7f9bc2e17640 1 -- 172.21.15.73:0/810076021 shutdown_connections 2023-12-12T09:45:39.782 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:39.780+0000 7f9bc2e17640 1 -- 172.21.15.73:0/810076021 >> 172.21.15.73:0/810076021 conn(0x7f9bbc06a4e0 msgr2=0x7f9bbc06a8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:45:39.782 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:39.780+0000 7f9bc2e17640 1 -- 172.21.15.73:0/810076021 shutdown_connections 2023-12-12T09:45:39.782 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:39.780+0000 7f9bc2e17640 1 -- 172.21.15.73:0/810076021 wait complete. 2023-12-12T09:45:39.783 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:39.782+0000 7f9bc2e17640 1 Processor -- start 2023-12-12T09:45:39.783 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:39.782+0000 7f9bc2e17640 1 -- start start 2023-12-12T09:45:39.784 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:39.783+0000 7f9bc2e17640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9bac003970 0x7f9bbc148230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:39.784 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:39.783+0000 7f9bc2e17640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9bbc1489e0 0x7f9bbc0a6b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:39.784 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:39.783+0000 7f9bc2e17640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9bbc1ea4f0 0x7f9bbc1ea980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:39.784 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:39.783+0000 7f9bc2e17640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bbc146a80 con 0x7f9bbc1489e0 2023-12-12T09:45:39.784 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:39.783+0000 7f9bc2e17640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bbc147da0 con 0x7f9bac003970 2023-12-12T09:45:39.784 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:39.783+0000 7f9bc2e17640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9bbc1e81b0 con 0x7f9bbc1ea4f0 2023-12-12T09:45:39.784 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:39.783+0000 7f9bbbfff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9bbc1489e0 0x7f9bbc0a6b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:39.784 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:39.783+0000 7f9bbbfff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9bbc1489e0 0x7f9bbc0a6b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:42172/0 (socket says 172.21.15.73:42172) 2023-12-12T09:45:39.784 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:39.783+0000 7f9bbbfff640 1 -- 172.21.15.73:0/2827255797 learned_addr learned my addr 172.21.15.73:0/2827255797 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:45:39.785 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:39.784+0000 7f9bbbfff640 1 -- 172.21.15.73:0/2827255797 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9bbc1ea4f0 msgr2=0x7f9bbc1ea980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:39.785 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:39.784+0000 7f9bbbfff640 1 --2- 172.21.15.73:0/2827255797 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9bbc1ea4f0 0x7f9bbc1ea980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:39.785 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:39.784+0000 7f9bbbfff640 1 -- 172.21.15.73:0/2827255797 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9bac003970 msgr2=0x7f9bbc148230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:39.785 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:39.784+0000 7f9bbbfff640 1 --2- 172.21.15.73:0/2827255797 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9bac003970 0x7f9bbc148230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:39.785 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:39.784+0000 7f9bbbfff640 1 -- 172.21.15.73:0/2827255797 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bbc145b20 con 0x7f9bbc1489e0 2023-12-12T09:45:39.785 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:39.784+0000 7f9bbbfff640 1 --2- 172.21.15.73:0/2827255797 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9bbc1489e0 0x7f9bbc0a6b90 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f9ba800e800 tx=0x7f9ba800ecc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:45:39.786 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:39.784+0000 7f9bb97fa640 1 -- 172.21.15.73:0/2827255797 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ba800c940 con 0x7f9bbc1489e0 2023-12-12T09:45:39.786 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:39.784+0000 7f9bb97fa640 1 -- 172.21.15.73:0/2827255797 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ba800cac0 con 0x7f9bbc1489e0 2023-12-12T09:45:39.786 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:39.784+0000 7f9bb97fa640 1 -- 172.21.15.73:0/2827255797 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ba800ce70 con 0x7f9bbc1489e0 2023-12-12T09:45:39.786 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:39.784+0000 7f9bc2e17640 1 -- 172.21.15.73:0/2827255797 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9bbc145d70 con 0x7f9bbc1489e0 2023-12-12T09:45:39.786 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:39.785+0000 7f9bc2e17640 1 -- 172.21.15.73:0/2827255797 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9bbc147a30 con 0x7f9bbc1489e0 2023-12-12T09:45:39.786 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:39.786+0000 7f9bc2e17640 1 -- 172.21.15.73:0/2827255797 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9bbc067070 con 0x7f9bbc1489e0 2023-12-12T09:45:39.787 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:39.786+0000 7f9bb97fa640 1 -- 172.21.15.73:0/2827255797 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f9ba8013470 con 0x7f9bbc1489e0 2023-12-12T09:45:39.787 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:39.787+0000 7f9bb97fa640 1 --2- 172.21.15.73:0/2827255797 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f9ba006ae70 0x7f9ba006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:39.787 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:39.787+0000 7f9bb97fa640 1 -- 172.21.15.73:0/2827255797 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f9ba8089a30 con 0x7f9bbc1489e0 2023-12-12T09:45:39.788 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:39.788+0000 7f9bc0bb3640 1 --2- 172.21.15.73:0/2827255797 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f9ba006ae70 0x7f9ba006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:39.788 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:39.788+0000 7f9bc0bb3640 1 --2- 172.21.15.73:0/2827255797 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f9ba006ae70 0x7f9ba006d330 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f9bb0035000 tx=0x7f9bb0030000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:45:39.792 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:39.792+0000 7f9bb97fa640 1 -- 172.21.15.73:0/2827255797 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f9ba8054770 con 0x7f9bbc1489e0 2023-12-12T09:45:40.027 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:40.027+0000 7f9bc2e17640 1 -- 172.21.15.73:0/2827255797 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs2", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f9bbc0c08a0 con 0x7f9bbc1489e0 2023-12-12T09:45:40.683 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:40.682+0000 7f9bb97fa640 1 -- 172.21.15.73:0/2827255797 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs2", "var": "standby_count_wanted", "val": "0"}]=0 v34) v1 ==== 119+0+0 (secure 0 0 0) 0x7f9ba8057d90 con 0x7f9bbc1489e0 2023-12-12T09:45:40.687 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:40.687+0000 7f9bc2e17640 1 -- 172.21.15.73:0/2827255797 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f9ba006ae70 msgr2=0x7f9ba006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:40.688 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:40.687+0000 7f9bc2e17640 1 --2- 172.21.15.73:0/2827255797 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f9ba006ae70 0x7f9ba006d330 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f9bb0035000 tx=0x7f9bb0030000 comp rx=0 tx=0).stop 2023-12-12T09:45:40.688 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:40.687+0000 7f9bc2e17640 1 -- 172.21.15.73:0/2827255797 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9bbc1489e0 msgr2=0x7f9bbc0a6b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:40.688 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:40.687+0000 7f9bc2e17640 1 --2- 172.21.15.73:0/2827255797 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9bbc1489e0 0x7f9bbc0a6b90 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f9ba800e800 tx=0x7f9ba800ecc0 comp rx=0 tx=0).stop 2023-12-12T09:45:40.688 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:40.687+0000 7f9bc2e17640 1 -- 172.21.15.73:0/2827255797 shutdown_connections 2023-12-12T09:45:40.688 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:40.687+0000 7f9bc2e17640 1 --2- 172.21.15.73:0/2827255797 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f9ba006ae70 0x7f9ba006d330 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:40.688 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:40.687+0000 7f9bc2e17640 1 --2- 172.21.15.73:0/2827255797 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9bbc1ea4f0 0x7f9bbc1ea980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:40.688 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:40.687+0000 7f9bc2e17640 1 --2- 172.21.15.73:0/2827255797 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9bbc1489e0 0x7f9bbc0a6b90 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:40.688 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:40.687+0000 7f9bc2e17640 1 --2- 172.21.15.73:0/2827255797 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9bac003970 0x7f9bbc148230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:40.688 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:40.687+0000 7f9bc2e17640 1 -- 172.21.15.73:0/2827255797 >> 172.21.15.73:0/2827255797 conn(0x7f9bbc06a4e0 msgr2=0x7f9bbc070d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:45:40.688 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:40.687+0000 7f9bc2e17640 1 -- 172.21.15.73:0/2827255797 shutdown_connections 2023-12-12T09:45:40.688 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:40.687+0000 7f9bc2e17640 1 -- 172.21.15.73:0/2827255797 wait complete. 2023-12-12T09:45:40.708 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-12-12T09:45:40.708 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs2 allow_standby_replay false 2023-12-12T09:45:40.915 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:40.915+0000 7f5e83f01640 1 Processor -- start 2023-12-12T09:45:40.916 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:40.915+0000 7f5e83f01640 1 -- start start 2023-12-12T09:45:40.917 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:40.917+0000 7f5e83f01640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5e7c06dc40 0x7f5e7c152c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:40.917 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:40.917+0000 7f5e83f01640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e7c0c16c0 con 0x7f5e7c06d350 2023-12-12T09:45:40.917 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:40.917+0000 7f5e83f01640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e7c0c19a0 con 0x7f5e7c14f8c0 2023-12-12T09:45:40.917 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:40.917+0000 7f5e83f01640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e7c0c1090 con 0x7f5e7c06dc40 2023-12-12T09:45:40.917 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:40.917+0000 7f5e8149c640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f5e7c06d350 0x7f5e7c152500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:47228/0 (socket says 172.21.15.73:47228) 2023-12-12T09:45:40.917 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:40.917+0000 7f5e8149c640 1 -- 172.21.15.73:0/2305923261 learned_addr learned my addr 172.21.15.73:0/2305923261 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-12T09:45:40.919 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:40.917+0000 7f5e8249e640 1 --2- 172.21.15.73:0/2305923261 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5e7c06dc40 0x7f5e7c152c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:40.919 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:40.917+0000 7f5e80c9b640 1 -- 172.21.15.73:0/2305923261 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3515304441 0 0) 0x7f5e7c0c16c0 con 0x7f5e7c06d350 2023-12-12T09:45:40.919 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:40.917+0000 7f5e80c9b640 1 -- 172.21.15.73:0/2305923261 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5e68003520 con 0x7f5e7c06d350 2023-12-12T09:45:40.920 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:40.918+0000 7f5e80c9b640 1 -- 172.21.15.73:0/2305923261 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 262541298 0 0) 0x7f5e68003520 con 0x7f5e7c06d350 2023-12-12T09:45:40.920 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:40.918+0000 7f5e80c9b640 1 -- 172.21.15.73:0/2305923261 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5e7c06dc40 msgr2=0x7f5e7c152c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:45:40.920 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:40.918+0000 7f5e80c9b640 1 --2- 172.21.15.73:0/2305923261 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5e7c06dc40 0x7f5e7c152c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:40.920 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:40.918+0000 7f5e80c9b640 1 -- 172.21.15.73:0/2305923261 >> v1:172.21.15.142:6789/0 conn(0x7f5e7c14f8c0 legacy=0x7f5e7c071e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:40.920 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:40.918+0000 7f5e80c9b640 1 -- 172.21.15.73:0/2305923261 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e7c0c1c80 con 0x7f5e7c06d350 2023-12-12T09:45:40.920 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:40.918+0000 7f5e80c9b640 1 -- 172.21.15.73:0/2305923261 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3186547832 0 0) 0x7f5e6c001670 con 0x7f5e7c06d350 2023-12-12T09:45:40.920 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:40.918+0000 7f5e80c9b640 1 -- 172.21.15.73:0/2305923261 >> v1:172.21.15.73:6789/0 conn(0x7f5e7c06d350 legacy=0x7f5e7c152500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:40.920 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:40.918+0000 7f5e80c9b640 1 --2- 172.21.15.73:0/2305923261 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5e680039a0 0x7f5e68003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:40.920 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:40.918+0000 7f5e80c9b640 1 --2- 172.21.15.73:0/2305923261 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5e680047c0 0x7f5e68004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:40.920 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:40.918+0000 7f5e80c9b640 1 --2- 172.21.15.73:0/2305923261 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5e7c06dc40 0x7f5e68005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:40.920 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:40.918+0000 7f5e80c9b640 1 -- 172.21.15.73:0/2305923261 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e6800ba30 con 0x7f5e680039a0 2023-12-12T09:45:40.920 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:40.918+0000 7f5e80c9b640 1 -- 172.21.15.73:0/2305923261 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e6800bba0 con 0x7f5e680047c0 2023-12-12T09:45:40.920 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:40.918+0000 7f5e80c9b640 1 -- 172.21.15.73:0/2305923261 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e6800bd60 con 0x7f5e7c06dc40 2023-12-12T09:45:40.920 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:40.918+0000 7f5e81c9d640 1 --2- 172.21.15.73:0/2305923261 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5e680039a0 0x7f5e68003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:40.920 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:40.919+0000 7f5e8249e640 1 --2- 172.21.15.73:0/2305923261 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5e7c06dc40 0x7f5e68005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:40.921 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:40.919+0000 7f5e8149c640 1 --2- 172.21.15.73:0/2305923261 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5e680047c0 0x7f5e68004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:40.921 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:40.919+0000 7f5e81c9d640 1 -- 172.21.15.73:0/2305923261 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5e7c06dc40 msgr2=0x7f5e68005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:45:40.921 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:40.919+0000 7f5e81c9d640 1 --2- 172.21.15.73:0/2305923261 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5e7c06dc40 0x7f5e68005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:40.921 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:40.919+0000 7f5e81c9d640 1 -- 172.21.15.73:0/2305923261 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5e680047c0 msgr2=0x7f5e68004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:45:40.921 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:40.919+0000 7f5e81c9d640 1 --2- 172.21.15.73:0/2305923261 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5e680047c0 0x7f5e68004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:40.921 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:40.919+0000 7f5e81c9d640 1 -- 172.21.15.73:0/2305923261 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e68003520 con 0x7f5e680039a0 2023-12-12T09:45:40.922 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:40.920+0000 7f5e81c9d640 1 --2- 172.21.15.73:0/2305923261 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5e680039a0 0x7f5e68003dc0 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f5e78001720 tx=0x7f5e680057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=140a30058185084c server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:45:40.922 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:40.920+0000 7f5e80c9b640 1 -- 172.21.15.73:0/2305923261 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e780052d0 con 0x7f5e680039a0 2023-12-12T09:45:40.922 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:40.920+0000 7f5e80c9b640 1 -- 172.21.15.73:0/2305923261 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e7802e050 con 0x7f5e680039a0 2023-12-12T09:45:40.922 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:40.920+0000 7f5e80c9b640 1 -- 172.21.15.73:0/2305923261 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e780035f0 con 0x7f5e680039a0 2023-12-12T09:45:40.922 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:40.921+0000 7f5e83f01640 1 -- 172.21.15.73:0/2305923261 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5e680039a0 msgr2=0x7f5e68003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:40.923 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:40.921+0000 7f5e83f01640 1 --2- 172.21.15.73:0/2305923261 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5e680039a0 0x7f5e68003dc0 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f5e78001720 tx=0x7f5e680057f0 comp rx=0 tx=0).stop 2023-12-12T09:45:40.923 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:40.921+0000 7f5e8249e640 1 -- 172.21.15.73:0/2305923261 reap_dead start 2023-12-12T09:45:40.923 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:40.921+0000 7f5e83f01640 1 -- 172.21.15.73:0/2305923261 shutdown_connections 2023-12-12T09:45:40.923 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:40.921+0000 7f5e83f01640 1 -- 172.21.15.73:0/2305923261 >> 172.21.15.73:0/2305923261 conn(0x7f5e7c06a4e0 msgr2=0x7f5e7c06a8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:45:40.923 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:40.921+0000 7f5e83f01640 1 -- 172.21.15.73:0/2305923261 shutdown_connections 2023-12-12T09:45:40.923 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:40.921+0000 7f5e83f01640 1 -- 172.21.15.73:0/2305923261 wait complete. 2023-12-12T09:45:40.923 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:40.923+0000 7f5e83f01640 1 Processor -- start 2023-12-12T09:45:40.923 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:40.923+0000 7f5e83f01640 1 -- start start 2023-12-12T09:45:40.925 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:40.924+0000 7f5e83f01640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5e680039a0 0x7f5e7c143740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:40.925 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:40.924+0000 7f5e83f01640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5e7c150580 0x7f5e7c150d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:40.925 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:40.924+0000 7f5e83f01640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5e7c150010 0x7f5e7c149b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:40.925 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:40.924+0000 7f5e83f01640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e7c144a20 con 0x7f5e7c150010 2023-12-12T09:45:40.925 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:40.924+0000 7f5e83f01640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e7c143c80 con 0x7f5e680039a0 2023-12-12T09:45:40.925 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:40.924+0000 7f5e83f01640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e7c144460 con 0x7f5e7c150580 2023-12-12T09:45:40.925 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:40.924+0000 7f5e8249e640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5e7c150010 0x7f5e7c149b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:40.925 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:40.924+0000 7f5e8249e640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5e7c150010 0x7f5e7c149b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:42178/0 (socket says 172.21.15.73:42178) 2023-12-12T09:45:40.925 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:40.924+0000 7f5e8249e640 1 -- 172.21.15.73:0/2305787677 learned_addr learned my addr 172.21.15.73:0/2305787677 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:45:40.925 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:40.925+0000 7f5e8249e640 1 -- 172.21.15.73:0/2305787677 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5e7c150580 msgr2=0x7f5e7c150d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:40.926 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:40.925+0000 7f5e8249e640 1 --2- 172.21.15.73:0/2305787677 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5e7c150580 0x7f5e7c150d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:40.926 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:40.925+0000 7f5e8249e640 1 -- 172.21.15.73:0/2305787677 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5e680039a0 msgr2=0x7f5e7c143740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:40.926 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:40.925+0000 7f5e8249e640 1 --2- 172.21.15.73:0/2305787677 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5e680039a0 0x7f5e7c143740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:40.926 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:40.925+0000 7f5e8249e640 1 -- 172.21.15.73:0/2305787677 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e7c1e8740 con 0x7f5e7c150010 2023-12-12T09:45:40.926 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:40.925+0000 7f5e8249e640 1 --2- 172.21.15.73:0/2305787677 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5e7c150010 0x7f5e7c149b60 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f5e7c06b360 tx=0x7f5e740115a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:45:40.927 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:40.925+0000 7f5e727fc640 1 -- 172.21.15.73:0/2305787677 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e7400e070 con 0x7f5e7c150010 2023-12-12T09:45:40.927 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:40.925+0000 7f5e727fc640 1 -- 172.21.15.73:0/2305787677 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e74011ed0 con 0x7f5e7c150010 2023-12-12T09:45:40.927 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:40.925+0000 7f5e727fc640 1 -- 172.21.15.73:0/2305787677 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e74003990 con 0x7f5e7c150010 2023-12-12T09:45:40.927 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:40.925+0000 7f5e83f01640 1 -- 172.21.15.73:0/2305787677 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e7c1e8a20 con 0x7f5e7c150010 2023-12-12T09:45:40.927 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:40.925+0000 7f5e83f01640 1 -- 172.21.15.73:0/2305787677 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e7c151280 con 0x7f5e7c150010 2023-12-12T09:45:40.927 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:40.926+0000 7f5e83f01640 1 -- 172.21.15.73:0/2305787677 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e7c067070 con 0x7f5e7c150010 2023-12-12T09:45:40.927 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:40.927+0000 7f5e727fc640 1 -- 172.21.15.73:0/2305787677 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f5e74003b10 con 0x7f5e7c150010 2023-12-12T09:45:40.928 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:40.928+0000 7f5e727fc640 1 --2- 172.21.15.73:0/2305787677 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f5e6006ae40 0x7f5e6006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:40.928 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:40.928+0000 7f5e727fc640 1 -- 172.21.15.73:0/2305787677 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f5e7408a240 con 0x7f5e7c150010 2023-12-12T09:45:40.928 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:40.928+0000 7f5e81c9d640 1 --2- 172.21.15.73:0/2305787677 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f5e6006ae40 0x7f5e6006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:40.929 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:40.929+0000 7f5e81c9d640 1 --2- 172.21.15.73:0/2305787677 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f5e6006ae40 0x7f5e6006d300 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f5e78033000 tx=0x7f5e7802f000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:45:40.932 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:40.932+0000 7f5e727fc640 1 -- 172.21.15.73:0/2305787677 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f5e74054ef0 con 0x7f5e7c150010 2023-12-12T09:45:41.148 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:41.147+0000 7f5e83f01640 1 -- 172.21.15.73:0/2305787677 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs2", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f5e7c067580 con 0x7f5e7c150010 2023-12-12T09:45:41.697 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:41.696+0000 7f5e727fc640 1 -- 172.21.15.73:0/2305787677 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs2", "var": "allow_standby_replay", "val": "false"}]=0 v35) v1 ==== 123+0+0 (secure 0 0 0) 0x7f5e74058510 con 0x7f5e7c150010 2023-12-12T09:45:41.701 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:41.700+0000 7f5e83f01640 1 -- 172.21.15.73:0/2305787677 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f5e6006ae40 msgr2=0x7f5e6006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:41.701 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:41.700+0000 7f5e83f01640 1 --2- 172.21.15.73:0/2305787677 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f5e6006ae40 0x7f5e6006d300 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f5e78033000 tx=0x7f5e7802f000 comp rx=0 tx=0).stop 2023-12-12T09:45:41.701 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:41.700+0000 7f5e83f01640 1 -- 172.21.15.73:0/2305787677 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5e7c150010 msgr2=0x7f5e7c149b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:41.701 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:41.700+0000 7f5e83f01640 1 --2- 172.21.15.73:0/2305787677 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5e7c150010 0x7f5e7c149b60 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f5e7c06b360 tx=0x7f5e740115a0 comp rx=0 tx=0).stop 2023-12-12T09:45:41.701 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:41.700+0000 7f5e83f01640 1 -- 172.21.15.73:0/2305787677 shutdown_connections 2023-12-12T09:45:41.701 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:41.700+0000 7f5e83f01640 1 --2- 172.21.15.73:0/2305787677 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f5e6006ae40 0x7f5e6006d300 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:41.701 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:41.700+0000 7f5e83f01640 1 --2- 172.21.15.73:0/2305787677 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5e7c150010 0x7f5e7c149b60 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:41.701 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:41.700+0000 7f5e83f01640 1 --2- 172.21.15.73:0/2305787677 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5e7c150580 0x7f5e7c150d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:41.701 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:41.700+0000 7f5e83f01640 1 --2- 172.21.15.73:0/2305787677 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5e680039a0 0x7f5e7c143740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:41.701 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:41.700+0000 7f5e83f01640 1 -- 172.21.15.73:0/2305787677 >> 172.21.15.73:0/2305787677 conn(0x7f5e7c06a4e0 msgr2=0x7f5e7c0c4b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:45:41.701 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:41.700+0000 7f5e83f01640 1 -- 172.21.15.73:0/2305787677 shutdown_connections 2023-12-12T09:45:41.701 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:41.700+0000 7f5e83f01640 1 -- 172.21.15.73:0/2305787677 wait complete. 2023-12-12T09:45:41.720 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs2' 2023-12-12T09:45:41.720 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-12T09:45:41.930 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:41.929+0000 7fde3ac52640 1 Processor -- start 2023-12-12T09:45:41.930 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:41.929+0000 7fde3ac52640 1 -- start start 2023-12-12T09:45:41.931 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:41.931+0000 7fde3ac52640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fde3406db70 0x7fde340c39b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:41.931 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:41.931+0000 7fde3ac52640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fde340c5070 0x7fde340c3ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:41.931 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:41.931+0000 7fde3ac52640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde34152610 con 0x7fde3414fa40 2023-12-12T09:45:41.931 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:41.931+0000 7fde3ac52640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde341528f0 con 0x7fde3406db70 2023-12-12T09:45:41.932 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:41.931+0000 7fde3ac52640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde34152bd0 con 0x7fde340c5070 2023-12-12T09:45:41.932 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:41.931+0000 7fde389ee640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7fde3414fa40 0x7fde3406a4e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:47236/0 (socket says 172.21.15.73:47236) 2023-12-12T09:45:41.932 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:41.931+0000 7fde389ee640 1 -- 172.21.15.73:0/2124591878 learned_addr learned my addr 172.21.15.73:0/2124591878 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-12T09:45:41.933 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:41.932+0000 7fde337fe640 1 -- 172.21.15.73:0/2124591878 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3347110546 0 0) 0x7fde34152610 con 0x7fde3414fa40 2023-12-12T09:45:41.933 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:41.932+0000 7fde33fff640 1 --2- 172.21.15.73:0/2124591878 >> v2:172.21.15.142:3300/0 conn(0x7fde3406db70 0x7fde340c39b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:41.933 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:41.932+0000 7fde391ef640 1 --2- 172.21.15.73:0/2124591878 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fde340c5070 0x7fde340c3ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:41.934 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:41.932+0000 7fde337fe640 1 -- 172.21.15.73:0/2124591878 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fde24003520 con 0x7fde3414fa40 2023-12-12T09:45:41.934 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:41.932+0000 7fde337fe640 1 -- 172.21.15.73:0/2124591878 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3555609211 0 0) 0x7fde24003520 con 0x7fde3414fa40 2023-12-12T09:45:41.934 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:41.932+0000 7fde337fe640 1 -- 172.21.15.73:0/2124591878 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fde340c5070 msgr2=0x7fde340c3ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:45:41.934 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:41.932+0000 7fde337fe640 1 --2- 172.21.15.73:0/2124591878 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fde340c5070 0x7fde340c3ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:41.934 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:41.932+0000 7fde337fe640 1 -- 172.21.15.73:0/2124591878 >> v2:172.21.15.142:3300/0 conn(0x7fde3406db70 msgr2=0x7fde340c39b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:45:41.934 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:41.932+0000 7fde337fe640 1 --2- 172.21.15.73:0/2124591878 >> v2:172.21.15.142:3300/0 conn(0x7fde3406db70 0x7fde340c39b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:41.934 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:41.932+0000 7fde337fe640 1 -- 172.21.15.73:0/2124591878 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde34152eb0 con 0x7fde3414fa40 2023-12-12T09:45:41.934 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:41.932+0000 7fde337fe640 1 -- 172.21.15.73:0/2124591878 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3186547832 0 0) 0x7fde28001670 con 0x7fde3414fa40 2023-12-12T09:45:41.934 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:41.932+0000 7fde337fe640 1 -- 172.21.15.73:0/2124591878 >> v1:172.21.15.73:6789/0 conn(0x7fde3414fa40 legacy=0x7fde3406a4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:41.934 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:41.932+0000 7fde337fe640 1 --2- 172.21.15.73:0/2124591878 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fde24003970 0x7fde24003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:41.934 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:41.932+0000 7fde337fe640 1 --2- 172.21.15.73:0/2124591878 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fde240047c0 0x7fde24004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:41.934 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:41.932+0000 7fde337fe640 1 --2- 172.21.15.73:0/2124591878 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fde24005180 0x7fde2400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:41.934 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:41.932+0000 7fde337fe640 1 -- 172.21.15.73:0/2124591878 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde341528f0 con 0x7fde240047c0 2023-12-12T09:45:41.935 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:41.932+0000 7fde337fe640 1 -- 172.21.15.73:0/2124591878 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde34152bd0 con 0x7fde24003970 2023-12-12T09:45:41.935 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:41.932+0000 7fde337fe640 1 -- 172.21.15.73:0/2124591878 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde2400bfc0 con 0x7fde24005180 2023-12-12T09:45:41.935 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:41.932+0000 7fde391ef640 1 --2- 172.21.15.73:0/2124591878 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fde340c5070 0x7fde340c3ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-12T09:45:41.935 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:41.932+0000 7fde33fff640 1 --2- 172.21.15.73:0/2124591878 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fde240047c0 0x7fde24004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:41.935 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:41.933+0000 7fde33fff640 1 -- 172.21.15.73:0/2124591878 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fde24005180 msgr2=0x7fde2400b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:45:41.935 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:41.933+0000 7fde33fff640 1 --2- 172.21.15.73:0/2124591878 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fde24005180 0x7fde2400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:41.935 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:41.933+0000 7fde389ee640 1 --2- 172.21.15.73:0/2124591878 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fde24003970 0x7fde24003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:41.935 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:41.933+0000 7fde33fff640 1 -- 172.21.15.73:0/2124591878 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fde24003970 msgr2=0x7fde24003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:45:41.935 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:41.933+0000 7fde33fff640 1 --2- 172.21.15.73:0/2124591878 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fde24003970 0x7fde24003d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:41.935 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:41.933+0000 7fde33fff640 1 -- 172.21.15.73:0/2124591878 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde24003520 con 0x7fde240047c0 2023-12-12T09:45:41.936 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:41.934+0000 7fde33fff640 1 --2- 172.21.15.73:0/2124591878 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fde240047c0 0x7fde24004c40 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7fde2000ba60 tx=0x7fde240057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc2d44fa8f66365d server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:45:41.936 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:41.934+0000 7fde337fe640 1 -- 172.21.15.73:0/2124591878 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde20032680 con 0x7fde240047c0 2023-12-12T09:45:41.936 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:41.934+0000 7fde337fe640 1 -- 172.21.15.73:0/2124591878 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde200327e0 con 0x7fde240047c0 2023-12-12T09:45:41.937 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:41.934+0000 7fde337fe640 1 -- 172.21.15.73:0/2124591878 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde20032b70 con 0x7fde240047c0 2023-12-12T09:45:41.937 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:41.935+0000 7fde3ac52640 1 -- 172.21.15.73:0/2124591878 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fde240047c0 msgr2=0x7fde24004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:41.937 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:41.935+0000 7fde3ac52640 1 --2- 172.21.15.73:0/2124591878 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fde240047c0 0x7fde24004c40 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7fde2000ba60 tx=0x7fde240057f0 comp rx=0 tx=0).stop 2023-12-12T09:45:41.937 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:41.935+0000 7fde391ef640 1 -- 172.21.15.73:0/2124591878 reap_dead start 2023-12-12T09:45:41.937 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:41.935+0000 7fde3ac52640 1 -- 172.21.15.73:0/2124591878 shutdown_connections 2023-12-12T09:45:41.937 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:41.935+0000 7fde3ac52640 1 -- 172.21.15.73:0/2124591878 >> 172.21.15.73:0/2124591878 conn(0x7fde340a8130 msgr2=0x7fde340c24b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:45:41.937 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:41.935+0000 7fde3ac52640 1 -- 172.21.15.73:0/2124591878 shutdown_connections 2023-12-12T09:45:41.937 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:41.935+0000 7fde3ac52640 1 -- 172.21.15.73:0/2124591878 wait complete. 2023-12-12T09:45:41.937 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:41.937+0000 7fde3ac52640 1 Processor -- start 2023-12-12T09:45:41.938 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:41.937+0000 7fde3ac52640 1 -- start start 2023-12-12T09:45:41.939 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:41.938+0000 7fde3ac52640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fde240047c0 0x7fde340719d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:41.939 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:41.938+0000 7fde3ac52640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fde3414c7e0 0x7fde34156140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:41.940 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:41.938+0000 7fde3ac52640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fde341e9fa0 0x7fde341ea420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:41.940 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:41.938+0000 7fde3ac52640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde340704c0 con 0x7fde3414c7e0 2023-12-12T09:45:41.940 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:41.938+0000 7fde3ac52640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde34070cd0 con 0x7fde341e9fa0 2023-12-12T09:45:41.940 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:41.938+0000 7fde3ac52640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde34070710 con 0x7fde240047c0 2023-12-12T09:45:41.940 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:41.938+0000 7fde33fff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fde3414c7e0 0x7fde34156140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:41.940 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:41.938+0000 7fde33fff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fde3414c7e0 0x7fde34156140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:42200/0 (socket says 172.21.15.73:42200) 2023-12-12T09:45:41.940 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:41.938+0000 7fde33fff640 1 -- 172.21.15.73:0/2094889187 learned_addr learned my addr 172.21.15.73:0/2094889187 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:45:41.940 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:41.938+0000 7fde33fff640 1 -- 172.21.15.73:0/2094889187 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fde240047c0 msgr2=0x7fde340719d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:41.940 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:41.938+0000 7fde33fff640 1 --2- 172.21.15.73:0/2094889187 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fde240047c0 0x7fde340719d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:41.940 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:41.938+0000 7fde33fff640 1 -- 172.21.15.73:0/2094889187 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fde341e9fa0 msgr2=0x7fde341ea420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:41.940 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:41.938+0000 7fde33fff640 1 --2- 172.21.15.73:0/2094889187 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fde341e9fa0 0x7fde341ea420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:41.940 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:41.938+0000 7fde33fff640 1 -- 172.21.15.73:0/2094889187 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde340709f0 con 0x7fde3414c7e0 2023-12-12T09:45:41.940 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:41.939+0000 7fde33fff640 1 --2- 172.21.15.73:0/2094889187 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fde3414c7e0 0x7fde34156140 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7fde2002bf00 tx=0x7fde20004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:45:41.940 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:41.939+0000 7fde317fa640 1 -- 172.21.15.73:0/2094889187 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde200308a0 con 0x7fde3414c7e0 2023-12-12T09:45:41.941 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:41.939+0000 7fde317fa640 1 -- 172.21.15.73:0/2094889187 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde20030a00 con 0x7fde3414c7e0 2023-12-12T09:45:41.941 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:41.939+0000 7fde3ac52640 1 -- 172.21.15.73:0/2094889187 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde340711d0 con 0x7fde3414c7e0 2023-12-12T09:45:41.941 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:41.939+0000 7fde317fa640 1 -- 172.21.15.73:0/2094889187 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde20030d90 con 0x7fde3414c7e0 2023-12-12T09:45:41.941 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:41.939+0000 7fde3ac52640 1 -- 172.21.15.73:0/2094889187 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde340a4a40 con 0x7fde3414c7e0 2023-12-12T09:45:41.941 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:41.941+0000 7fde3ac52640 1 -- 172.21.15.73:0/2094889187 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde34067580 con 0x7fde3414c7e0 2023-12-12T09:45:41.941 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:41.941+0000 7fde317fa640 1 -- 172.21.15.73:0/2094889187 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fde2003b420 con 0x7fde3414c7e0 2023-12-12T09:45:41.943 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:41.942+0000 7fde317fa640 1 --2- 172.21.15.73:0/2094889187 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fde1806ae40 0x7fde1806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:41.943 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:41.942+0000 7fde317fa640 1 -- 172.21.15.73:0/2094889187 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fde200abe40 con 0x7fde3414c7e0 2023-12-12T09:45:41.943 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:41.943+0000 7fde389ee640 1 --2- 172.21.15.73:0/2094889187 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fde1806ae40 0x7fde1806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:41.943 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:41.943+0000 7fde389ee640 1 --2- 172.21.15.73:0/2094889187 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fde1806ae40 0x7fde1806d300 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fde28000ff0 tx=0x7fde28009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:45:41.947 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:41.947+0000 7fde317fa640 1 -- 172.21.15.73:0/2094889187 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fde20076ce0 con 0x7fde3414c7e0 2023-12-12T09:45:42.158 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:42.158+0000 7fde3ac52640 1 -- 172.21.15.73:0/2094889187 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fde340a61c0 con 0x7fde3414c7e0 2023-12-12T09:45:42.159 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:42.159+0000 7fde317fa640 1 -- 172.21.15.73:0/2094889187 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 35 v35) v1 ==== 94+0+6135 (secure 0 0 0) 0x7fde20049090 con 0x7fde3414c7e0 2023-12-12T09:45:42.159 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-12T09:45:42.160 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":35,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4736,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6834/2964437845","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6832","nonce":2964437845},{"type":"v1","addr":"172.21.15.142:6834","nonce":2964437845}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":25},{"gid":5044,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6837/3698725764","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6836","nonce":3698725764},{"type":"v1","addr":"172.21.15.73:6837","nonce":3698725764}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":25}],"filesystems":[{"mdsmap":{"epoch":30,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-12T09:45:22.971300+0000","modified":"2023-12-12T09:45:26.028731+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5703},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5703":{"gid":5703,"name":"a","rank":0,"incarnation":26,"state":"up:active","state_seq":3,"addr":"172.21.15.73:6835/744058726","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":744058726},{"type":"v1","addr":"172.21.15.73:6835","nonce":744058726}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4},{"mdsmap":{"epoch":35,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-12T09:45:38.103609+0000","modified":"2023-12-12T09:45:41.148650+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5059},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5059":{"gid":5059,"name":"d","rank":0,"incarnation":31,"state":"up:active","state_seq":7,"addr":"172.21.15.142:6835/2931058847","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6833","nonce":2931058847},{"type":"v1","addr":"172.21.15.142:6835","nonce":2931058847}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2023-12-12T09:45:42.160 INFO:teuthology.orchestra.run.smithi073.stderr:dumped fsmap epoch 35 2023-12-12T09:45:42.162 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:42.161+0000 7fde3ac52640 1 -- 172.21.15.73:0/2094889187 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fde1806ae40 msgr2=0x7fde1806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:42.162 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:42.161+0000 7fde3ac52640 1 --2- 172.21.15.73:0/2094889187 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fde1806ae40 0x7fde1806d300 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fde28000ff0 tx=0x7fde28009040 comp rx=0 tx=0).stop 2023-12-12T09:45:42.162 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:42.161+0000 7fde3ac52640 1 -- 172.21.15.73:0/2094889187 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fde3414c7e0 msgr2=0x7fde34156140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:42.162 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:42.161+0000 7fde3ac52640 1 --2- 172.21.15.73:0/2094889187 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fde3414c7e0 0x7fde34156140 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7fde2002bf00 tx=0x7fde20004730 comp rx=0 tx=0).stop 2023-12-12T09:45:42.162 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:42.161+0000 7fde3ac52640 1 -- 172.21.15.73:0/2094889187 shutdown_connections 2023-12-12T09:45:42.162 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:42.161+0000 7fde3ac52640 1 --2- 172.21.15.73:0/2094889187 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fde1806ae40 0x7fde1806d300 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:42.162 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:42.161+0000 7fde3ac52640 1 --2- 172.21.15.73:0/2094889187 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fde341e9fa0 0x7fde341ea420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:42.162 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:42.161+0000 7fde3ac52640 1 --2- 172.21.15.73:0/2094889187 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fde3414c7e0 0x7fde34156140 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:42.162 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:42.161+0000 7fde3ac52640 1 --2- 172.21.15.73:0/2094889187 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fde240047c0 0x7fde340719d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:42.163 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:42.161+0000 7fde3ac52640 1 -- 172.21.15.73:0/2094889187 >> 172.21.15.73:0/2094889187 conn(0x7fde340a8130 msgr2=0x7fde340c1ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:45:42.163 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:42.161+0000 7fde3ac52640 1 -- 172.21.15.73:0/2094889187 shutdown_connections 2023-12-12T09:45:42.163 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:42.161+0000 7fde3ac52640 1 -- 172.21.15.73:0/2094889187 wait complete. 2023-12-12T09:45:42.180 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-12T09:45:42.394 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:42.394+0000 7f99f8448640 1 Processor -- start 2023-12-12T09:45:42.394 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:42.394+0000 7f99f8448640 1 -- start start 2023-12-12T09:45:42.396 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:42.395+0000 7f99f8448640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f99f014fa40 0x7f99f006a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:42.396 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:42.395+0000 7f99f8448640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f99f006db70 0x7f99f00c39b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:42.396 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:42.395+0000 7f99f8448640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99f0152610 con 0x7f99f00c5070 2023-12-12T09:45:42.396 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:42.395+0000 7f99f8448640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99f01528f0 con 0x7f99f006db70 2023-12-12T09:45:42.396 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:42.395+0000 7f99f8448640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99f0152bd0 con 0x7f99f014fa40 2023-12-12T09:45:42.397 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:42.396+0000 7f99f61e4640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f99f014fa40 0x7f99f006a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:42.397 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:42.396+0000 7f99f61e4640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f99f014fa40 0x7f99f006a4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.73:51888/0 (socket says 172.21.15.73:51888) 2023-12-12T09:45:42.397 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:42.396+0000 7f99f61e4640 1 -- 172.21.15.73:0/3864629549 learned_addr learned my addr 172.21.15.73:0/3864629549 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:45:42.397 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:42.396+0000 7f99f59e3640 1 --2- 172.21.15.73:0/3864629549 >> v2:172.21.15.142:3300/0 conn(0x7f99f006db70 0x7f99f00c39b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:42.397 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:42.397+0000 7f99f61e4640 1 -- 172.21.15.73:0/3864629549 >> v2:172.21.15.142:3300/0 conn(0x7f99f006db70 msgr2=0x7f99f00c39b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:45:42.398 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:42.397+0000 7f99f61e4640 1 --2- 172.21.15.73:0/3864629549 >> v2:172.21.15.142:3300/0 conn(0x7f99f006db70 0x7f99f00c39b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:42.398 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:42.397+0000 7f99f61e4640 1 -- 172.21.15.73:0/3864629549 >> v1:172.21.15.142:6789/0 conn(0x7f99f00c5070 legacy=0x7f99f00c3ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:42.398 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:42.397+0000 7f99f61e4640 1 -- 172.21.15.73:0/3864629549 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99f0152eb0 con 0x7f99f014fa40 2023-12-12T09:45:42.398 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:42.397+0000 7f99f51e2640 1 -- 172.21.15.73:0/3864629549 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2471095384 0 0) 0x7f99f0152610 con 0x7f99f00c5070 2023-12-12T09:45:42.398 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:42.398+0000 7f99f61e4640 1 --2- 172.21.15.73:0/3864629549 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f99f014fa40 0x7f99f006a4e0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f99ec009870 tx=0x7f99ec02b980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3e3b37224a57a98 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:45:42.399 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:42.399+0000 7f99f51e2640 1 -- 172.21.15.73:0/3864629549 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99ec030840 con 0x7f99f014fa40 2023-12-12T09:45:42.399 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:42.399+0000 7f99f51e2640 1 -- 172.21.15.73:0/3864629549 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99ec0309a0 con 0x7f99f014fa40 2023-12-12T09:45:42.399 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:42.399+0000 7f99f51e2640 1 -- 172.21.15.73:0/3864629549 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99ec030d30 con 0x7f99f014fa40 2023-12-12T09:45:42.400 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:42.399+0000 7f99f8448640 1 -- 172.21.15.73:0/3864629549 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f99f014fa40 msgr2=0x7f99f006a4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:42.400 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:42.399+0000 7f99f8448640 1 --2- 172.21.15.73:0/3864629549 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f99f014fa40 0x7f99f006a4e0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f99ec009870 tx=0x7f99ec02b980 comp rx=0 tx=0).stop 2023-12-12T09:45:42.401 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:42.399+0000 7f99f8448640 1 -- 172.21.15.73:0/3864629549 shutdown_connections 2023-12-12T09:45:42.401 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:42.399+0000 7f99f8448640 1 --2- 172.21.15.73:0/3864629549 >> v2:172.21.15.142:3300/0 conn(0x7f99f006db70 0x7f99f00c39b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:42.401 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:42.399+0000 7f99f8448640 1 --2- 172.21.15.73:0/3864629549 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f99f014fa40 0x7f99f006a4e0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:42.401 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:42.399+0000 7f99f8448640 1 -- 172.21.15.73:0/3864629549 >> 172.21.15.73:0/3864629549 conn(0x7f99f00a8130 msgr2=0x7f99f00c24b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:45:42.401 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:42.399+0000 7f99f8448640 1 -- 172.21.15.73:0/3864629549 shutdown_connections 2023-12-12T09:45:42.401 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:42.400+0000 7f99f8448640 1 -- 172.21.15.73:0/3864629549 wait complete. 2023-12-12T09:45:42.401 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:42.401+0000 7f99f8448640 1 Processor -- start 2023-12-12T09:45:42.402 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:42.401+0000 7f99f8448640 1 -- start start 2023-12-12T09:45:42.403 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:42.402+0000 7f99f8448640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f99f006db70 0x7f99f01dba80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:42.403 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:42.402+0000 7f99f8448640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f99f00c5070 0x7f99f00aa140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:42.403 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:42.402+0000 7f99f8448640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f99f014fa40 0x7f99f00aa680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:42.403 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:42.402+0000 7f99f8448640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99f00bf140 con 0x7f99f014fa40 2023-12-12T09:45:42.403 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:42.402+0000 7f99f8448640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99f00bf910 con 0x7f99f00c5070 2023-12-12T09:45:42.403 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:42.402+0000 7f99f8448640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99f01ea720 con 0x7f99f006db70 2023-12-12T09:45:42.405 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:42.403+0000 7f99f69e5640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f99f014fa40 0x7f99f00aa680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:42.405 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:42.403+0000 7f99f69e5640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f99f014fa40 0x7f99f00aa680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:42206/0 (socket says 172.21.15.73:42206) 2023-12-12T09:45:42.405 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:42.403+0000 7f99f69e5640 1 -- 172.21.15.73:0/959722901 learned_addr learned my addr 172.21.15.73:0/959722901 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:45:42.405 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:42.403+0000 7f99f61e4640 1 --2- 172.21.15.73:0/959722901 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f99f006db70 0x7f99f01dba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:42.405 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:42.403+0000 7f99f59e3640 1 --2- 172.21.15.73:0/959722901 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f99f00c5070 0x7f99f00aa140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:42.405 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:42.403+0000 7f99f69e5640 1 -- 172.21.15.73:0/959722901 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f99f006db70 msgr2=0x7f99f01dba80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:42.405 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:42.403+0000 7f99f69e5640 1 --2- 172.21.15.73:0/959722901 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f99f006db70 0x7f99f01dba80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:42.406 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:42.403+0000 7f99f69e5640 1 -- 172.21.15.73:0/959722901 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f99f00c5070 msgr2=0x7f99f00aa140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:42.406 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:42.404+0000 7f99f69e5640 1 --2- 172.21.15.73:0/959722901 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f99f00c5070 0x7f99f00aa140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:42.406 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:42.404+0000 7f99f69e5640 1 -- 172.21.15.73:0/959722901 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99ec0094d0 con 0x7f99f014fa40 2023-12-12T09:45:42.406 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:42.404+0000 7f99f59e3640 1 --2- 172.21.15.73:0/959722901 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f99f00c5070 0x7f99f00aa140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:45:42.406 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:42.404+0000 7f99f69e5640 1 --2- 172.21.15.73:0/959722901 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f99f014fa40 0x7f99f00aa680 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f99e800c760 tx=0x7f99e800cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:45:42.406 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:42.404+0000 7f99e6ffd640 1 -- 172.21.15.73:0/959722901 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99e8003da0 con 0x7f99f014fa40 2023-12-12T09:45:42.406 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:42.404+0000 7f99e6ffd640 1 -- 172.21.15.73:0/959722901 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99e800ce70 con 0x7f99f014fa40 2023-12-12T09:45:42.406 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:42.404+0000 7f99e6ffd640 1 -- 172.21.15.73:0/959722901 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99e8005290 con 0x7f99f014fa40 2023-12-12T09:45:42.406 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:42.404+0000 7f99f8448640 1 -- 172.21.15.73:0/959722901 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99f00bf350 con 0x7f99f014fa40 2023-12-12T09:45:42.406 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:42.404+0000 7f99f8448640 1 -- 172.21.15.73:0/959722901 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99f006d360 con 0x7f99f014fa40 2023-12-12T09:45:42.407 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:42.405+0000 7f99f8448640 1 -- 172.21.15.73:0/959722901 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99f0067580 con 0x7f99f014fa40 2023-12-12T09:45:42.407 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:42.406+0000 7f99e6ffd640 1 -- 172.21.15.73:0/959722901 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f99e80053f0 con 0x7f99f014fa40 2023-12-12T09:45:42.408 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:42.407+0000 7f99e6ffd640 1 --2- 172.21.15.73:0/959722901 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f99d406ae40 0x7f99d406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:42.408 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:42.407+0000 7f99e6ffd640 1 -- 172.21.15.73:0/959722901 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f99e80898c0 con 0x7f99f014fa40 2023-12-12T09:45:42.408 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:42.407+0000 7f99f61e4640 1 --2- 172.21.15.73:0/959722901 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f99d406ae40 0x7f99d406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:42.408 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:42.408+0000 7f99f61e4640 1 --2- 172.21.15.73:0/959722901 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f99d406ae40 0x7f99d406d300 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f99ec036000 tx=0x7f99ec008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:45:42.412 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:42.412+0000 7f99e6ffd640 1 -- 172.21.15.73:0/959722901 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f99e8054570 con 0x7f99f014fa40 2023-12-12T09:45:42.606 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:42.606+0000 7f99f8448640 1 -- 172.21.15.73:0/959722901 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f99f00c49d0 con 0x7f99f014fa40 2023-12-12T09:45:42.610 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:42.610+0000 7f99e6ffd640 1 -- 172.21.15.73:0/959722901 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v58) v1 ==== 74+0+20292 (secure 0 0 0) 0x7f99e8057b90 con 0x7f99f014fa40 2023-12-12T09:45:42.611 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-12T09:45:42.611 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":58,"fsid":"ba240992-02b8-4c7e-92f2-27eb29ac433b","created":"2023-12-12T09:43:02.454719+0000","modified":"2023-12-12T09:45:39.273967+0000","last_up_change":"2023-12-12T09:43:13.913440+0000","last_in_change":"2023-12-12T09:43:05.925348+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-12T09:43:15.525508+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-12-12T09:45:21.264815+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"53","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-12-12T09:45:21.981834+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"54","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs2_metadata","create_time":"2023-12-12T09:45:36.388393+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"57","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs2_data","create_time":"2023-12-12T09:45:37.109653+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"58","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"dd9074be-dbe2-4c34-9896-a4223d8d3940","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":4047810203},{"type":"v1","addr":"172.21.15.73:6801","nonce":4047810203}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":4047810203},{"type":"v1","addr":"172.21.15.73:6803","nonce":4047810203}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":4047810203},{"type":"v1","addr":"172.21.15.73:6807","nonce":4047810203}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":4047810203},{"type":"v1","addr":"172.21.15.73:6805","nonce":4047810203}]},"public_addr":"172.21.15.73:6801/4047810203","cluster_addr":"172.21.15.73:6803/4047810203","heartbeat_back_addr":"172.21.15.73:6807/4047810203","heartbeat_front_addr":"172.21.15.73:6805/4047810203","state":["exists","up"]},{"osd":1,"uuid":"c4a05052-96d4-4758-a4e1-1a37f1e07fed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":1356058331},{"type":"v1","addr":"172.21.15.73:6824","nonce":1356058331}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":1356058331},{"type":"v1","addr":"172.21.15.73:6827","nonce":1356058331}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":1356058331},{"type":"v1","addr":"172.21.15.73:6831","nonce":1356058331}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":1356058331},{"type":"v1","addr":"172.21.15.73:6829","nonce":1356058331}]},"public_addr":"172.21.15.73:6824/1356058331","cluster_addr":"172.21.15.73:6827/1356058331","heartbeat_back_addr":"172.21.15.73:6831/1356058331","heartbeat_front_addr":"172.21.15.73:6829/1356058331","state":["exists","up"]},{"osd":2,"uuid":"512bc8ac-72c2-40d4-b3d2-d867a92c5213","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":1228903316},{"type":"v1","addr":"172.21.15.73:6817","nonce":1228903316}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":1228903316},{"type":"v1","addr":"172.21.15.73:6819","nonce":1228903316}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6823","nonce":1228903316},{"type":"v1","addr":"172.21.15.73:6825","nonce":1228903316}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":1228903316},{"type":"v1","addr":"172.21.15.73:6821","nonce":1228903316}]},"public_addr":"172.21.15.73:6817/1228903316","cluster_addr":"172.21.15.73:6819/1228903316","heartbeat_back_addr":"172.21.15.73:6825/1228903316","heartbeat_front_addr":"172.21.15.73:6821/1228903316","state":["exists","up"]},{"osd":3,"uuid":"3d1a91e0-42bf-437a-8eae-8d357c8f63a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":1293329670},{"type":"v1","addr":"172.21.15.73:6809","nonce":1293329670}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6810","nonce":1293329670},{"type":"v1","addr":"172.21.15.73:6811","nonce":1293329670}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":1293329670},{"type":"v1","addr":"172.21.15.73:6815","nonce":1293329670}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":1293329670},{"type":"v1","addr":"172.21.15.73:6813","nonce":1293329670}]},"public_addr":"172.21.15.73:6809/1293329670","cluster_addr":"172.21.15.73:6811/1293329670","heartbeat_back_addr":"172.21.15.73:6815/1293329670","heartbeat_front_addr":"172.21.15.73:6813/1293329670","state":["exists","up"]},{"osd":4,"uuid":"4b302fff-834c-4069-ac19-00e46f6c87b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":3727975702},{"type":"v1","addr":"172.21.15.142:6801","nonce":3727975702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":3727975702},{"type":"v1","addr":"172.21.15.142:6803","nonce":3727975702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6809","nonce":3727975702},{"type":"v1","addr":"172.21.15.142:6811","nonce":3727975702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6805","nonce":3727975702},{"type":"v1","addr":"172.21.15.142:6807","nonce":3727975702}]},"public_addr":"172.21.15.142:6801/3727975702","cluster_addr":"172.21.15.142:6803/3727975702","heartbeat_back_addr":"172.21.15.142:6811/3727975702","heartbeat_front_addr":"172.21.15.142:6807/3727975702","state":["exists","up"]},{"osd":5,"uuid":"d7cdace2-67d0-45cc-95f2-515cf6ef1b82","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6817","nonce":2353193632},{"type":"v1","addr":"172.21.15.142:6819","nonce":2353193632}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6821","nonce":2353193632},{"type":"v1","addr":"172.21.15.142:6823","nonce":2353193632}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6829","nonce":2353193632},{"type":"v1","addr":"172.21.15.142:6831","nonce":2353193632}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6825","nonce":2353193632},{"type":"v1","addr":"172.21.15.142:6827","nonce":2353193632}]},"public_addr":"172.21.15.142:6819/2353193632","cluster_addr":"172.21.15.142:6823/2353193632","heartbeat_back_addr":"172.21.15.142:6831/2353193632","heartbeat_front_addr":"172.21.15.142:6827/2353193632","state":["exists","up"]},{"osd":6,"uuid":"649ce78a-5626-445c-aedc-a651ed05a6f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":2006111986},{"type":"v1","addr":"172.21.15.142:6806","nonce":2006111986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":2006111986},{"type":"v1","addr":"172.21.15.142:6810","nonce":2006111986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":2006111986},{"type":"v1","addr":"172.21.15.142:6815","nonce":2006111986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":2006111986},{"type":"v1","addr":"172.21.15.142:6813","nonce":2006111986}]},"public_addr":"172.21.15.142:6806/2006111986","cluster_addr":"172.21.15.142:6810/2006111986","heartbeat_back_addr":"172.21.15.142:6815/2006111986","heartbeat_front_addr":"172.21.15.142:6813/2006111986","state":["exists","up"]},{"osd":7,"uuid":"af15ae3b-c1d0-4acf-92db-8a1805494d13","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":2573794341},{"type":"v1","addr":"172.21.15.142:6818","nonce":2573794341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":2573794341},{"type":"v1","addr":"172.21.15.142:6822","nonce":2573794341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":2573794341},{"type":"v1","addr":"172.21.15.142:6830","nonce":2573794341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":2573794341},{"type":"v1","addr":"172.21.15.142:6826","nonce":2573794341}]},"public_addr":"172.21.15.142:6818/2573794341","cluster_addr":"172.21.15.142:6822/2573794341","heartbeat_back_addr":"172.21.15.142:6830/2573794341","heartbeat_front_addr":"172.21.15.142:6826/2573794341","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.185824+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.262103+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.225556+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:10.523459+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:10.706035+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.257339+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.301776+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.051960+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-12T09:45:42.613 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:42.613+0000 7f99f8448640 1 -- 172.21.15.73:0/959722901 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f99d406ae40 msgr2=0x7f99d406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:42.613 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:42.613+0000 7f99f8448640 1 --2- 172.21.15.73:0/959722901 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f99d406ae40 0x7f99d406d300 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f99ec036000 tx=0x7f99ec008030 comp rx=0 tx=0).stop 2023-12-12T09:45:42.613 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:42.613+0000 7f99f8448640 1 -- 172.21.15.73:0/959722901 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f99f014fa40 msgr2=0x7f99f00aa680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:42.614 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:42.613+0000 7f99f8448640 1 --2- 172.21.15.73:0/959722901 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f99f014fa40 0x7f99f00aa680 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f99e800c760 tx=0x7f99e800cc20 comp rx=0 tx=0).stop 2023-12-12T09:45:42.614 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:42.613+0000 7f99f8448640 1 -- 172.21.15.73:0/959722901 shutdown_connections 2023-12-12T09:45:42.614 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:42.613+0000 7f99f8448640 1 --2- 172.21.15.73:0/959722901 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f99d406ae40 0x7f99d406d300 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:42.614 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:42.613+0000 7f99f8448640 1 --2- 172.21.15.73:0/959722901 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f99f014fa40 0x7f99f00aa680 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:42.614 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:42.613+0000 7f99f8448640 1 --2- 172.21.15.73:0/959722901 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f99f00c5070 0x7f99f00aa140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:42.614 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:42.613+0000 7f99f8448640 1 --2- 172.21.15.73:0/959722901 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f99f006db70 0x7f99f01dba80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:42.614 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:42.613+0000 7f99f8448640 1 -- 172.21.15.73:0/959722901 >> 172.21.15.73:0/959722901 conn(0x7f99f00a8130 msgr2=0x7f99f00c63b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:45:42.614 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:42.613+0000 7f99f8448640 1 -- 172.21.15.73:0/959722901 shutdown_connections 2023-12-12T09:45:42.614 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:42.613+0000 7f99f8448640 1 -- 172.21.15.73:0/959722901 wait complete. 2023-12-12T09:45:42.631 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-12-12T09:45:42.631 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-12T09:45:42.845 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:42.844+0000 7ff119101640 1 Processor -- start 2023-12-12T09:45:42.845 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:42.845+0000 7ff119101640 1 -- start start 2023-12-12T09:45:42.846 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:42.846+0000 7ff119101640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7ff11406d160 0x7ff1140c62a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:42.846 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:42.846+0000 7ff119101640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7ff1140c67e0 0x7ff1140c1890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:42.846 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:42.846+0000 7ff119101640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1140c6050 con 0x7ff1140c5bc0 2023-12-12T09:45:42.847 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:42.846+0000 7ff119101640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1140c7180 con 0x7ff1140c67e0 2023-12-12T09:45:42.847 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:42.846+0000 7ff119101640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1140c3030 con 0x7ff11406d160 2023-12-12T09:45:42.847 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:42.846+0000 7ff11359e640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7ff1140c67e0 0x7ff1140c1890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:42.847 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:42.846+0000 7ff10a59c640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7ff1140c5bc0 0x7ff1140c1180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:47248/0 (socket says 172.21.15.73:47248) 2023-12-12T09:45:42.847 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:42.846+0000 7ff10a59c640 1 -- 172.21.15.73:0/3955452093 learned_addr learned my addr 172.21.15.73:0/3955452093 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-12T09:45:42.848 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:42.847+0000 7ff112d9d640 1 --2- 172.21.15.73:0/3955452093 >> v2:172.21.15.142:3300/0 conn(0x7ff11406d160 0x7ff1140c62a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:42.848 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:42.847+0000 7ff11359e640 1 -- 172.21.15.73:0/3955452093 >> v2:172.21.15.142:3300/0 conn(0x7ff11406d160 msgr2=0x7ff1140c62a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:45:42.848 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:42.847+0000 7ff11359e640 1 --2- 172.21.15.73:0/3955452093 >> v2:172.21.15.142:3300/0 conn(0x7ff11406d160 0x7ff1140c62a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:42.848 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:42.847+0000 7ff11359e640 1 -- 172.21.15.73:0/3955452093 >> v1:172.21.15.73:6789/0 conn(0x7ff1140c5bc0 legacy=0x7ff1140c1180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:42.848 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:42.847+0000 7ff11359e640 1 -- 172.21.15.73:0/3955452093 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1140c3310 con 0x7ff1140c67e0 2023-12-12T09:45:42.848 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:42.847+0000 7ff11259c640 1 -- 172.21.15.73:0/3955452093 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1119811134 0 0) 0x7ff1140c6050 con 0x7ff1140c5bc0 2023-12-12T09:45:42.849 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:42.848+0000 7ff11359e640 1 --2- 172.21.15.73:0/3955452093 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff1140c67e0 0x7ff1140c1890 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7ff114073c30 tx=0x7ff10c02b7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e75a051bf0c17aa server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:45:42.849 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:42.848+0000 7ff11259c640 1 -- 172.21.15.73:0/3955452093 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff10c031710 con 0x7ff1140c67e0 2023-12-12T09:45:42.849 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:42.849+0000 7ff11259c640 1 -- 172.21.15.73:0/3955452093 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff10c02f050 con 0x7ff1140c67e0 2023-12-12T09:45:42.849 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:42.849+0000 7ff11259c640 1 -- 172.21.15.73:0/3955452093 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff10c031a90 con 0x7ff1140c67e0 2023-12-12T09:45:42.850 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:42.849+0000 7ff119101640 1 -- 172.21.15.73:0/3955452093 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff1140c67e0 msgr2=0x7ff1140c1890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:42.850 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:42.849+0000 7ff119101640 1 --2- 172.21.15.73:0/3955452093 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff1140c67e0 0x7ff1140c1890 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7ff114073c30 tx=0x7ff10c02b7b0 comp rx=0 tx=0).stop 2023-12-12T09:45:42.850 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:42.849+0000 7ff119101640 1 -- 172.21.15.73:0/3955452093 shutdown_connections 2023-12-12T09:45:42.850 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:42.849+0000 7ff119101640 1 --2- 172.21.15.73:0/3955452093 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff1140c67e0 0x7ff1140c1890 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:42.850 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:42.849+0000 7ff119101640 1 --2- 172.21.15.73:0/3955452093 >> v2:172.21.15.142:3300/0 conn(0x7ff11406d160 0x7ff1140c62a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:42.850 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:42.849+0000 7ff119101640 1 -- 172.21.15.73:0/3955452093 >> 172.21.15.73:0/3955452093 conn(0x7ff1140c7cc0 msgr2=0x7ff1140c80a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:45:42.851 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:42.849+0000 7ff119101640 1 -- 172.21.15.73:0/3955452093 shutdown_connections 2023-12-12T09:45:42.851 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:42.849+0000 7ff119101640 1 -- 172.21.15.73:0/3955452093 wait complete. 2023-12-12T09:45:42.851 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:42.851+0000 7ff119101640 1 Processor -- start 2023-12-12T09:45:42.851 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:42.851+0000 7ff119101640 1 -- start start 2023-12-12T09:45:42.853 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:42.852+0000 7ff119101640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff11406d160 0x7ff1141ecda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:42.853 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:42.852+0000 7ff119101640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff1140c67e0 0x7ff114153470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:42.853 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:42.852+0000 7ff119101640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff114156040 0x7ff1141564f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:42.853 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:42.852+0000 7ff119101640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff114157d30 con 0x7ff11406d160 2023-12-12T09:45:42.853 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:42.852+0000 7ff119101640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1140a6b60 con 0x7ff114156040 2023-12-12T09:45:42.853 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:42.852+0000 7ff119101640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1140a66d0 con 0x7ff1140c67e0 2023-12-12T09:45:42.853 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:42.852+0000 7ff112d9d640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff11406d160 0x7ff1141ecda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:42.853 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:42.852+0000 7ff112d9d640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff11406d160 0x7ff1141ecda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:42224/0 (socket says 172.21.15.73:42224) 2023-12-12T09:45:42.853 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:42.852+0000 7ff112d9d640 1 -- 172.21.15.73:0/1866262680 learned_addr learned my addr 172.21.15.73:0/1866262680 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:45:42.855 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:42.853+0000 7ff11359e640 1 --2- 172.21.15.73:0/1866262680 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff114156040 0x7ff1141564f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:42.855 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:42.853+0000 7ff112d9d640 1 -- 172.21.15.73:0/1866262680 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff1140c67e0 msgr2=0x7ff114153470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:42.855 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:42.853+0000 7ff112d9d640 1 --2- 172.21.15.73:0/1866262680 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff1140c67e0 0x7ff114153470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:42.855 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:42.853+0000 7ff112d9d640 1 -- 172.21.15.73:0/1866262680 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff114156040 msgr2=0x7ff1141564f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:42.855 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:42.853+0000 7ff112d9d640 1 --2- 172.21.15.73:0/1866262680 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff114156040 0x7ff1141564f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:42.855 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:42.853+0000 7ff112d9d640 1 -- 172.21.15.73:0/1866262680 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff10c009400 con 0x7ff11406d160 2023-12-12T09:45:42.855 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:42.853+0000 7ff11359e640 1 --2- 172.21.15.73:0/1866262680 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff114156040 0x7ff1141564f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:45:42.855 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:42.853+0000 7ff112d9d640 1 --2- 172.21.15.73:0/1866262680 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff11406d160 0x7ff1141ecda0 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7ff104007e70 tx=0x7ff10400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:45:42.856 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:42.853+0000 7ff10bfff640 1 -- 172.21.15.73:0/1866262680 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff104014620 con 0x7ff11406d160 2023-12-12T09:45:42.856 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:42.854+0000 7ff10bfff640 1 -- 172.21.15.73:0/1866262680 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff104014780 con 0x7ff11406d160 2023-12-12T09:45:42.856 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:42.854+0000 7ff119101640 1 -- 172.21.15.73:0/1866262680 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1141584d0 con 0x7ff11406d160 2023-12-12T09:45:42.856 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:42.854+0000 7ff10bfff640 1 -- 172.21.15.73:0/1866262680 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff104014b30 con 0x7ff11406d160 2023-12-12T09:45:42.856 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:42.854+0000 7ff119101640 1 -- 172.21.15.73:0/1866262680 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1141581f0 con 0x7ff11406d160 2023-12-12T09:45:42.856 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:42.855+0000 7ff119101640 1 -- 172.21.15.73:0/1866262680 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff114067580 con 0x7ff11406d160 2023-12-12T09:45:42.856 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:42.856+0000 7ff10bfff640 1 -- 172.21.15.73:0/1866262680 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7ff104014c90 con 0x7ff11406d160 2023-12-12T09:45:42.857 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:42.857+0000 7ff10bfff640 1 --2- 172.21.15.73:0/1866262680 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7ff0f406ae40 0x7ff0f406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:42.857 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:42.857+0000 7ff10bfff640 1 -- 172.21.15.73:0/1866262680 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 6565+0+0 (secure 0 0 0) 0x7ff10408a2b0 con 0x7ff11406d160 2023-12-12T09:45:42.857 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:42.857+0000 7ff10a59c640 1 --2- 172.21.15.73:0/1866262680 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7ff0f406ae40 0x7ff0f406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:42.858 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:42.858+0000 7ff10a59c640 1 --2- 172.21.15.73:0/1866262680 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7ff0f406ae40 0x7ff0f406d300 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7ff0fc007fd0 tx=0x7ff0fc007960 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:45:42.861 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:42.861+0000 7ff10bfff640 1 -- 172.21.15.73:0/1866262680 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7ff104054ff0 con 0x7ff11406d160 2023-12-12T09:45:43.046 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:43.046+0000 7ff119101640 1 -- 172.21.15.73:0/1866262680 --> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ff1140c1d80 con 0x7ff0f406ae40 2023-12-12T09:45:43.063 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:43.063+0000 7ff10bfff640 1 -- 172.21.15.73:0/1866262680 <== mgr.4110 v2:172.21.15.73:6832/779985841 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+525343 (secure 0 0 0) 0x7ff1140c1d80 con 0x7ff0f406ae40 2023-12-12T09:45:43.071 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-12T09:45:43.075 INFO:teuthology.orchestra.run.smithi073.stderr:dumped all 2023-12-12T09:45:43.077 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:43.070+0000 7ff119101640 1 -- 172.21.15.73:0/1866262680 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7ff0f406ae40 msgr2=0x7ff0f406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:43.077 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:43.070+0000 7ff119101640 1 --2- 172.21.15.73:0/1866262680 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7ff0f406ae40 0x7ff0f406d300 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7ff0fc007fd0 tx=0x7ff0fc007960 comp rx=0 tx=0).stop 2023-12-12T09:45:43.077 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:43.070+0000 7ff119101640 1 -- 172.21.15.73:0/1866262680 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff11406d160 msgr2=0x7ff1141ecda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:43.077 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:43.070+0000 7ff119101640 1 --2- 172.21.15.73:0/1866262680 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff11406d160 0x7ff1141ecda0 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7ff104007e70 tx=0x7ff10400e4b0 comp rx=0 tx=0).stop 2023-12-12T09:45:43.077 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:43.070+0000 7ff119101640 1 -- 172.21.15.73:0/1866262680 shutdown_connections 2023-12-12T09:45:43.077 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:43.070+0000 7ff119101640 1 --2- 172.21.15.73:0/1866262680 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7ff0f406ae40 0x7ff0f406d300 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:43.077 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:43.070+0000 7ff119101640 1 --2- 172.21.15.73:0/1866262680 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff114156040 0x7ff1141564f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:43.077 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:43.070+0000 7ff119101640 1 --2- 172.21.15.73:0/1866262680 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff1140c67e0 0x7ff114153470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:43.077 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:43.071+0000 7ff119101640 1 --2- 172.21.15.73:0/1866262680 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff11406d160 0x7ff1141ecda0 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:43.077 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:43.071+0000 7ff119101640 1 -- 172.21.15.73:0/1866262680 >> 172.21.15.73:0/1866262680 conn(0x7ff1140c7cc0 msgr2=0x7ff1140c80a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:45:43.078 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:43.071+0000 7ff119101640 1 -- 172.21.15.73:0/1866262680 shutdown_connections 2023-12-12T09:45:43.078 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:43.071+0000 7ff119101640 1 -- 172.21.15.73:0/1866262680 wait complete. 2023-12-12T09:45:43.091 INFO:teuthology.orchestra.run.smithi073.stdout:{"pg_ready":true,"pg_map":{"version":125,"stamp":"2023-12-12T09:45:41.500491+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":596683,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":251,"num_write_kb":2447,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":27,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":197,"ondisk_log_size":197,"up":386,"acting":386,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":310,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":234268,"kb_used_data":5584,"kb_used_omap":12,"kb_used_meta":228531,"kb_avail":754740452,"statfs":{"total":773094113280,"available":772854222848,"internally_reserved":0,"allocated":5718016,"data_stored":3567364,"data_compressed":64844,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":12752,"internal_metadata":234016304},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":44,"apply_latency_ms":44,"commit_latency_ns":44000000,"apply_latency_ns":44000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.875720"},"pg_stats":[{"pgid":"11.3d","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-12-12T09:45:38.325098+0000","last_change":"2023-12-12T09:45:38.317031+0000","last_active":"2023-12-12T09:45:38.325098+0000","last_peered":"2023-12-12T09:45:38.325098+0000","last_clean":"2023-12-12T09:45:38.325098+0000","last_became_active":"2023-12-12T09:45:38.316206+0000","last_became_peered":"2023-12-12T09:45:38.316206+0000","last_unstale":"2023-12-12T09:45:38.325098+0000","last_undegraded":"2023-12-12T09:45:38.325098+0000","last_fullsized":"2023-12-12T09:45:38.325098+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:37.621350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:37.621350+0000","last_clean_scrub_stamp":"2023-12-12T09:45:37.621350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T19:16:43.947151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3f","version":"0'0","reported_seq":15,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-12-12T09:45:38.311485+0000","last_change":"2023-12-12T09:45:23.538728+0000","last_active":"2023-12-12T09:45:38.311485+0000","last_peered":"2023-12-12T09:45:38.311485+0000","last_clean":"2023-12-12T09:45:38.311485+0000","last_became_active":"2023-12-12T09:45:23.538477+0000","last_became_peered":"2023-12-12T09:45:23.538477+0000","last_unstale":"2023-12-12T09:45:38.311485+0000","last_undegraded":"2023-12-12T09:45:38.311485+0000","last_fullsized":"2023-12-12T09:45:38.311485+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_clean_scrub_stamp":"2023-12-12T09:45:22.493994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T19:31:49.247231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3c","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-12-12T09:45:38.315669+0000","last_change":"2023-12-12T09:45:38.309353+0000","last_active":"2023-12-12T09:45:38.315669+0000","last_peered":"2023-12-12T09:45:38.315669+0000","last_clean":"2023-12-12T09:45:38.315669+0000","last_became_active":"2023-12-12T09:45:38.308990+0000","last_became_peered":"2023-12-12T09:45:38.308990+0000","last_unstale":"2023-12-12T09:45:38.315669+0000","last_undegraded":"2023-12-12T09:45:38.315669+0000","last_fullsized":"2023-12-12T09:45:38.315669+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:37.621350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:37.621350+0000","last_clean_scrub_stamp":"2023-12-12T09:45:37.621350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T14:17:03.921292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":14,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-12-12T09:45:37.652788+0000","last_change":"2023-12-12T09:45:23.550472+0000","last_active":"2023-12-12T09:45:37.652788+0000","last_peered":"2023-12-12T09:45:37.652788+0000","last_clean":"2023-12-12T09:45:37.652788+0000","last_became_active":"2023-12-12T09:45:23.550233+0000","last_became_peered":"2023-12-12T09:45:23.550233+0000","last_unstale":"2023-12-12T09:45:37.652788+0000","last_undegraded":"2023-12-12T09:45:37.652788+0000","last_fullsized":"2023-12-12T09:45:37.652788+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_clean_scrub_stamp":"2023-12-12T09:45:22.493994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T12:17:13.855943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.3f","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-12-12T09:45:38.330202+0000","last_change":"2023-12-12T09:45:38.323649+0000","last_active":"2023-12-12T09:45:38.330202+0000","last_peered":"2023-12-12T09:45:38.330202+0000","last_clean":"2023-12-12T09:45:38.330202+0000","last_became_active":"2023-12-12T09:45:38.323284+0000","last_became_peered":"2023-12-12T09:45:38.323284+0000","last_unstale":"2023-12-12T09:45:38.330202+0000","last_undegraded":"2023-12-12T09:45:38.330202+0000","last_fullsized":"2023-12-12T09:45:38.330202+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:37.621350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:37.621350+0000","last_clean_scrub_stamp":"2023-12-12T09:45:37.621350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T13:19:13.590345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":14,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-12-12T09:45:37.666785+0000","last_change":"2023-12-12T09:45:23.550621+0000","last_active":"2023-12-12T09:45:37.666785+0000","last_peered":"2023-12-12T09:45:37.666785+0000","last_clean":"2023-12-12T09:45:37.666785+0000","last_became_active":"2023-12-12T09:45:23.550284+0000","last_became_peered":"2023-12-12T09:45:23.550284+0000","last_unstale":"2023-12-12T09:45:37.666785+0000","last_undegraded":"2023-12-12T09:45:37.666785+0000","last_fullsized":"2023-12-12T09:45:37.666785+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_clean_scrub_stamp":"2023-12-12T09:45:22.493994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T16:46:32.423265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.3e","version":"0'0","reported_seq":11,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-12T09:45:39.287245+0000","last_change":"2023-12-12T09:45:38.310863+0000","last_active":"2023-12-12T09:45:39.287245+0000","last_peered":"2023-12-12T09:45:39.287245+0000","last_clean":"2023-12-12T09:45:39.287245+0000","last_became_active":"2023-12-12T09:45:38.310076+0000","last_became_peered":"2023-12-12T09:45:38.310076+0000","last_unstale":"2023-12-12T09:45:39.287245+0000","last_undegraded":"2023-12-12T09:45:39.287245+0000","last_fullsized":"2023-12-12T09:45:39.287245+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:37.621350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:37.621350+0000","last_clean_scrub_stamp":"2023-12-12T09:45:37.621350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T20:28:29.320280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":15,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-12-12T09:45:38.283905+0000","last_change":"2023-12-12T09:45:23.529454+0000","last_active":"2023-12-12T09:45:38.283905+0000","last_peered":"2023-12-12T09:45:38.283905+0000","last_clean":"2023-12-12T09:45:38.283905+0000","last_became_active":"2023-12-12T09:45:23.529064+0000","last_became_peered":"2023-12-12T09:45:23.529064+0000","last_unstale":"2023-12-12T09:45:38.283905+0000","last_undegraded":"2023-12-12T09:45:38.283905+0000","last_fullsized":"2023-12-12T09:45:38.283905+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_clean_scrub_stamp":"2023-12-12T09:45:22.493994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T14:20:09.952370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":11,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-12T09:45:39.284466+0000","last_change":"2023-12-12T09:45:38.303922+0000","last_active":"2023-12-12T09:45:39.284466+0000","last_peered":"2023-12-12T09:45:39.284466+0000","last_clean":"2023-12-12T09:45:39.284466+0000","last_became_active":"2023-12-12T09:45:38.302932+0000","last_became_peered":"2023-12-12T09:45:38.302932+0000","last_unstale":"2023-12-12T09:45:39.284466+0000","last_undegraded":"2023-12-12T09:45:39.284466+0000","last_fullsized":"2023-12-12T09:45:39.284466+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:37.621350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:37.621350+0000","last_clean_scrub_stamp":"2023-12-12T09:45:37.621350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T18:35:36.452769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":15,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-12-12T09:45:38.300812+0000","last_change":"2023-12-12T09:45:23.532127+0000","last_active":"2023-12-12T09:45:38.300812+0000","last_peered":"2023-12-12T09:45:38.300812+0000","last_clean":"2023-12-12T09:45:38.300812+0000","last_became_active":"2023-12-12T09:45:23.531850+0000","last_became_peered":"2023-12-12T09:45:23.531850+0000","last_unstale":"2023-12-12T09:45:38.300812+0000","last_undegraded":"2023-12-12T09:45:38.300812+0000","last_fullsized":"2023-12-12T09:45:38.300812+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_clean_scrub_stamp":"2023-12-12T09:45:22.493994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T12:57:56.868905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":11,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-12T09:45:39.285023+0000","last_change":"2023-12-12T09:45:38.315615+0000","last_active":"2023-12-12T09:45:39.285023+0000","last_peered":"2023-12-12T09:45:39.285023+0000","last_clean":"2023-12-12T09:45:39.285023+0000","last_became_active":"2023-12-12T09:45:38.315225+0000","last_became_peered":"2023-12-12T09:45:38.315225+0000","last_unstale":"2023-12-12T09:45:39.285023+0000","last_undegraded":"2023-12-12T09:45:39.285023+0000","last_fullsized":"2023-12-12T09:45:39.285023+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:37.621350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:37.621350+0000","last_clean_scrub_stamp":"2023-12-12T09:45:37.621350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T12:43:19.374589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":14,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-12-12T09:45:37.631342+0000","last_change":"2023-12-12T09:45:23.531673+0000","last_active":"2023-12-12T09:45:37.631342+0000","last_peered":"2023-12-12T09:45:37.631342+0000","last_clean":"2023-12-12T09:45:37.631342+0000","last_became_active":"2023-12-12T09:45:23.530075+0000","last_became_peered":"2023-12-12T09:45:23.530075+0000","last_unstale":"2023-12-12T09:45:37.631342+0000","last_undegraded":"2023-12-12T09:45:37.631342+0000","last_fullsized":"2023-12-12T09:45:37.631342+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_clean_scrub_stamp":"2023-12-12T09:45:22.493994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T16:46:32.423265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.3b","version":"0'0","reported_seq":11,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-12T09:45:39.284731+0000","last_change":"2023-12-12T09:45:38.316148+0000","last_active":"2023-12-12T09:45:39.284731+0000","last_peered":"2023-12-12T09:45:39.284731+0000","last_clean":"2023-12-12T09:45:39.284731+0000","last_became_active":"2023-12-12T09:45:38.313223+0000","last_became_peered":"2023-12-12T09:45:38.313223+0000","last_unstale":"2023-12-12T09:45:39.284731+0000","last_undegraded":"2023-12-12T09:45:39.284731+0000","last_fullsized":"2023-12-12T09:45:39.284731+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:37.621350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:37.621350+0000","last_clean_scrub_stamp":"2023-12-12T09:45:37.621350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T14:03:18.186583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":14,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-12-12T09:45:37.647636+0000","last_change":"2023-12-12T09:45:23.545363+0000","last_active":"2023-12-12T09:45:37.647636+0000","last_peered":"2023-12-12T09:45:37.647636+0000","last_clean":"2023-12-12T09:45:37.647636+0000","last_became_active":"2023-12-12T09:45:23.543029+0000","last_became_peered":"2023-12-12T09:45:23.543029+0000","last_unstale":"2023-12-12T09:45:37.647636+0000","last_undegraded":"2023-12-12T09:45:37.647636+0000","last_fullsized":"2023-12-12T09:45:37.647636+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_clean_scrub_stamp":"2023-12-12T09:45:22.493994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T10:40:43.209236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.3a","version":"0'0","reported_seq":11,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-12T09:45:39.285751+0000","last_change":"2023-12-12T09:45:38.309787+0000","last_active":"2023-12-12T09:45:39.285751+0000","last_peered":"2023-12-12T09:45:39.285751+0000","last_clean":"2023-12-12T09:45:39.285751+0000","last_became_active":"2023-12-12T09:45:38.309474+0000","last_became_peered":"2023-12-12T09:45:38.309474+0000","last_unstale":"2023-12-12T09:45:39.285751+0000","last_undegraded":"2023-12-12T09:45:39.285751+0000","last_fullsized":"2023-12-12T09:45:39.285751+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:37.621350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:37.621350+0000","last_clean_scrub_stamp":"2023-12-12T09:45:37.621350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T12:23:52.875082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":14,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-12-12T09:45:37.645117+0000","last_change":"2023-12-12T09:45:23.540907+0000","last_active":"2023-12-12T09:45:37.645117+0000","last_peered":"2023-12-12T09:45:37.645117+0000","last_clean":"2023-12-12T09:45:37.645117+0000","last_became_active":"2023-12-12T09:45:23.540653+0000","last_became_peered":"2023-12-12T09:45:23.540653+0000","last_unstale":"2023-12-12T09:45:37.645117+0000","last_undegraded":"2023-12-12T09:45:37.645117+0000","last_fullsized":"2023-12-12T09:45:37.645117+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_clean_scrub_stamp":"2023-12-12T09:45:22.493994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T17:36:57.557008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-12-12T09:45:38.323524+0000","last_change":"2023-12-12T09:45:38.320674+0000","last_active":"2023-12-12T09:45:38.323524+0000","last_peered":"2023-12-12T09:45:38.323524+0000","last_clean":"2023-12-12T09:45:38.323524+0000","last_became_active":"2023-12-12T09:45:38.320385+0000","last_became_peered":"2023-12-12T09:45:38.320385+0000","last_unstale":"2023-12-12T09:45:38.323524+0000","last_undegraded":"2023-12-12T09:45:38.323524+0000","last_fullsized":"2023-12-12T09:45:38.323524+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:37.621350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:37.621350+0000","last_clean_scrub_stamp":"2023-12-12T09:45:37.621350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T21:11:52.430282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":14,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-12-12T09:45:37.652109+0000","last_change":"2023-12-12T09:45:23.552916+0000","last_active":"2023-12-12T09:45:37.652109+0000","last_peered":"2023-12-12T09:45:37.652109+0000","last_clean":"2023-12-12T09:45:37.652109+0000","last_became_active":"2023-12-12T09:45:23.552025+0000","last_became_peered":"2023-12-12T09:45:23.552025+0000","last_unstale":"2023-12-12T09:45:37.652109+0000","last_undegraded":"2023-12-12T09:45:37.652109+0000","last_fullsized":"2023-12-12T09:45:37.652109+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_clean_scrub_stamp":"2023-12-12T09:45:22.493994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T20:27:09.962474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.34","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-12-12T09:45:38.315650+0000","last_change":"2023-12-12T09:45:38.308744+0000","last_active":"2023-12-12T09:45:38.315650+0000","last_peered":"2023-12-12T09:45:38.315650+0000","last_clean":"2023-12-12T09:45:38.315650+0000","last_became_active":"2023-12-12T09:45:38.308404+0000","last_became_peered":"2023-12-12T09:45:38.308404+0000","last_unstale":"2023-12-12T09:45:38.315650+0000","last_undegraded":"2023-12-12T09:45:38.315650+0000","last_fullsized":"2023-12-12T09:45:38.315650+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:37.621350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:37.621350+0000","last_clean_scrub_stamp":"2023-12-12T09:45:37.621350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T12:53:23.633955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":14,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-12-12T09:45:37.646855+0000","last_change":"2023-12-12T09:45:23.545833+0000","last_active":"2023-12-12T09:45:37.646855+0000","last_peered":"2023-12-12T09:45:37.646855+0000","last_clean":"2023-12-12T09:45:37.646855+0000","last_became_active":"2023-12-12T09:45:23.545073+0000","last_became_peered":"2023-12-12T09:45:23.545073+0000","last_unstale":"2023-12-12T09:45:37.646855+0000","last_undegraded":"2023-12-12T09:45:37.646855+0000","last_fullsized":"2023-12-12T09:45:37.646855+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_clean_scrub_stamp":"2023-12-12T09:45:22.493994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T15:31:33.286934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":11,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-12T09:45:39.286176+0000","last_change":"2023-12-12T09:45:38.319611+0000","last_active":"2023-12-12T09:45:39.286176+0000","last_peered":"2023-12-12T09:45:39.286176+0000","last_clean":"2023-12-12T09:45:39.286176+0000","last_became_active":"2023-12-12T09:45:38.318910+0000","last_became_peered":"2023-12-12T09:45:38.318910+0000","last_unstale":"2023-12-12T09:45:39.286176+0000","last_undegraded":"2023-12-12T09:45:39.286176+0000","last_fullsized":"2023-12-12T09:45:39.286176+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:37.621350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:37.621350+0000","last_clean_scrub_stamp":"2023-12-12T09:45:37.621350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T17:58:46.646468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":14,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-12-12T09:45:37.644646+0000","last_change":"2023-12-12T09:45:23.542993+0000","last_active":"2023-12-12T09:45:37.644646+0000","last_peered":"2023-12-12T09:45:37.644646+0000","last_clean":"2023-12-12T09:45:37.644646+0000","last_became_active":"2023-12-12T09:45:23.542770+0000","last_became_peered":"2023-12-12T09:45:23.542770+0000","last_unstale":"2023-12-12T09:45:37.644646+0000","last_undegraded":"2023-12-12T09:45:37.644646+0000","last_fullsized":"2023-12-12T09:45:37.644646+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_clean_scrub_stamp":"2023-12-12T09:45:22.493994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T10:40:43.209236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-12-12T09:45:38.309232+0000","last_change":"2023-12-12T09:45:38.305292+0000","last_active":"2023-12-12T09:45:38.309232+0000","last_peered":"2023-12-12T09:45:38.309232+0000","last_clean":"2023-12-12T09:45:38.309232+0000","last_became_active":"2023-12-12T09:45:38.304979+0000","last_became_peered":"2023-12-12T09:45:38.304979+0000","last_unstale":"2023-12-12T09:45:38.309232+0000","last_undegraded":"2023-12-12T09:45:38.309232+0000","last_fullsized":"2023-12-12T09:45:38.309232+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:37.621350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:37.621350+0000","last_clean_scrub_stamp":"2023-12-12T09:45:37.621350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T17:51:41.672993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":15,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-12-12T09:45:38.284127+0000","last_change":"2023-12-12T09:45:23.552839+0000","last_active":"2023-12-12T09:45:38.284127+0000","last_peered":"2023-12-12T09:45:38.284127+0000","last_clean":"2023-12-12T09:45:38.284127+0000","last_became_active":"2023-12-12T09:45:23.548568+0000","last_became_peered":"2023-12-12T09:45:23.548568+0000","last_unstale":"2023-12-12T09:45:38.284127+0000","last_undegraded":"2023-12-12T09:45:38.284127+0000","last_fullsized":"2023-12-12T09:45:38.284127+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_clean_scrub_stamp":"2023-12-12T09:45:22.493994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T12:19:37.793666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-12-12T09:45:38.315348+0000","last_change":"2023-12-12T09:45:38.313084+0000","last_active":"2023-12-12T09:45:38.315348+0000","last_peered":"2023-12-12T09:45:38.315348+0000","last_clean":"2023-12-12T09:45:38.315348+0000","last_became_active":"2023-12-12T09:45:38.312776+0000","last_became_peered":"2023-12-12T09:45:38.312776+0000","last_unstale":"2023-12-12T09:45:38.315348+0000","last_undegraded":"2023-12-12T09:45:38.315348+0000","last_fullsized":"2023-12-12T09:45:38.315348+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:37.621350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:37.621350+0000","last_clean_scrub_stamp":"2023-12-12T09:45:37.621350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T12:17:28.983300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":15,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-12-12T09:45:38.295493+0000","last_change":"2023-12-12T09:45:23.536465+0000","last_active":"2023-12-12T09:45:38.295493+0000","last_peered":"2023-12-12T09:45:38.295493+0000","last_clean":"2023-12-12T09:45:38.295493+0000","last_became_active":"2023-12-12T09:45:23.536019+0000","last_became_peered":"2023-12-12T09:45:23.536019+0000","last_unstale":"2023-12-12T09:45:38.295493+0000","last_undegraded":"2023-12-12T09:45:38.295493+0000","last_fullsized":"2023-12-12T09:45:38.295493+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_clean_scrub_stamp":"2023-12-12T09:45:22.493994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T14:30:36.106005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.30","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-12-12T09:45:38.322864+0000","last_change":"2023-12-12T09:45:38.316692+0000","last_active":"2023-12-12T09:45:38.322864+0000","last_peered":"2023-12-12T09:45:38.322864+0000","last_clean":"2023-12-12T09:45:38.322864+0000","last_became_active":"2023-12-12T09:45:38.316309+0000","last_became_peered":"2023-12-12T09:45:38.316309+0000","last_unstale":"2023-12-12T09:45:38.322864+0000","last_undegraded":"2023-12-12T09:45:38.322864+0000","last_fullsized":"2023-12-12T09:45:38.322864+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:37.621350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:37.621350+0000","last_clean_scrub_stamp":"2023-12-12T09:45:37.621350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T18:41:44.847673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":14,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-12-12T09:45:37.649470+0000","last_change":"2023-12-12T09:45:23.551554+0000","last_active":"2023-12-12T09:45:37.649470+0000","last_peered":"2023-12-12T09:45:37.649470+0000","last_clean":"2023-12-12T09:45:37.649470+0000","last_became_active":"2023-12-12T09:45:23.548473+0000","last_became_peered":"2023-12-12T09:45:23.548473+0000","last_unstale":"2023-12-12T09:45:37.649470+0000","last_undegraded":"2023-12-12T09:45:37.649470+0000","last_fullsized":"2023-12-12T09:45:37.649470+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_clean_scrub_stamp":"2023-12-12T09:45:22.493994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T17:58:31.519111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.33","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-12-12T09:45:38.314476+0000","last_change":"2023-12-12T09:45:38.309527+0000","last_active":"2023-12-12T09:45:38.314476+0000","last_peered":"2023-12-12T09:45:38.314476+0000","last_clean":"2023-12-12T09:45:38.314476+0000","last_became_active":"2023-12-12T09:45:38.309233+0000","last_became_peered":"2023-12-12T09:45:38.309233+0000","last_unstale":"2023-12-12T09:45:38.314476+0000","last_undegraded":"2023-12-12T09:45:38.314476+0000","last_fullsized":"2023-12-12T09:45:38.314476+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:37.621350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:37.621350+0000","last_clean_scrub_stamp":"2023-12-12T09:45:37.621350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T12:01:01.058805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":14,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-12-12T09:45:37.648264+0000","last_change":"2023-12-12T09:45:23.543290+0000","last_active":"2023-12-12T09:45:37.648264+0000","last_peered":"2023-12-12T09:45:37.648264+0000","last_clean":"2023-12-12T09:45:37.648264+0000","last_became_active":"2023-12-12T09:45:23.542623+0000","last_became_peered":"2023-12-12T09:45:23.542623+0000","last_unstale":"2023-12-12T09:45:37.648264+0000","last_undegraded":"2023-12-12T09:45:37.648264+0000","last_fullsized":"2023-12-12T09:45:37.648264+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_clean_scrub_stamp":"2023-12-12T09:45:22.493994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T15:49:16.147997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":11,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-12T09:45:39.284758+0000","last_change":"2023-12-12T09:45:38.308049+0000","last_active":"2023-12-12T09:45:39.284758+0000","last_peered":"2023-12-12T09:45:39.284758+0000","last_clean":"2023-12-12T09:45:39.284758+0000","last_became_active":"2023-12-12T09:45:38.307662+0000","last_became_peered":"2023-12-12T09:45:38.307662+0000","last_unstale":"2023-12-12T09:45:39.284758+0000","last_undegraded":"2023-12-12T09:45:39.284758+0000","last_fullsized":"2023-12-12T09:45:39.284758+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:37.621350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:37.621350+0000","last_clean_scrub_stamp":"2023-12-12T09:45:37.621350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T15:31:48.414290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":14,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-12-12T09:45:37.631032+0000","last_change":"2023-12-12T09:45:23.550153+0000","last_active":"2023-12-12T09:45:37.631032+0000","last_peered":"2023-12-12T09:45:37.631032+0000","last_clean":"2023-12-12T09:45:37.631032+0000","last_became_active":"2023-12-12T09:45:23.548835+0000","last_became_peered":"2023-12-12T09:45:23.548835+0000","last_unstale":"2023-12-12T09:45:37.631032+0000","last_undegraded":"2023-12-12T09:45:37.631032+0000","last_fullsized":"2023-12-12T09:45:37.631032+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_clean_scrub_stamp":"2023-12-12T09:45:22.493994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T12:53:08.506599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2d","version":"0'0","reported_seq":11,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-12T09:45:39.286608+0000","last_change":"2023-12-12T09:45:38.319083+0000","last_active":"2023-12-12T09:45:39.286608+0000","last_peered":"2023-12-12T09:45:39.286608+0000","last_clean":"2023-12-12T09:45:39.286608+0000","last_became_active":"2023-12-12T09:45:38.316117+0000","last_became_peered":"2023-12-12T09:45:38.316117+0000","last_unstale":"2023-12-12T09:45:39.286608+0000","last_undegraded":"2023-12-12T09:45:39.286608+0000","last_fullsized":"2023-12-12T09:45:39.286608+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:37.621350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:37.621350+0000","last_clean_scrub_stamp":"2023-12-12T09:45:37.621350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T13:19:13.590345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":14,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-12-12T09:45:37.652618+0000","last_change":"2023-12-12T09:45:23.542153+0000","last_active":"2023-12-12T09:45:37.652618+0000","last_peered":"2023-12-12T09:45:37.652618+0000","last_clean":"2023-12-12T09:45:37.652618+0000","last_became_active":"2023-12-12T09:45:23.541948+0000","last_became_peered":"2023-12-12T09:45:23.541948+0000","last_unstale":"2023-12-12T09:45:37.652618+0000","last_undegraded":"2023-12-12T09:45:37.652618+0000","last_fullsized":"2023-12-12T09:45:37.652618+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_clean_scrub_stamp":"2023-12-12T09:45:22.493994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T09:57:07.126644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-12-12T09:45:38.316890+0000","last_change":"2023-12-12T09:45:38.314051+0000","last_active":"2023-12-12T09:45:38.316890+0000","last_peered":"2023-12-12T09:45:38.316890+0000","last_clean":"2023-12-12T09:45:38.316890+0000","last_became_active":"2023-12-12T09:45:38.312804+0000","last_became_peered":"2023-12-12T09:45:38.312804+0000","last_unstale":"2023-12-12T09:45:38.316890+0000","last_undegraded":"2023-12-12T09:45:38.316890+0000","last_fullsized":"2023-12-12T09:45:38.316890+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:37.621350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:37.621350+0000","last_clean_scrub_stamp":"2023-12-12T09:45:37.621350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T12:15:20.295162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":14,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-12-12T09:45:37.667880+0000","last_change":"2023-12-12T09:45:23.553823+0000","last_active":"2023-12-12T09:45:37.667880+0000","last_peered":"2023-12-12T09:45:37.667880+0000","last_clean":"2023-12-12T09:45:37.667880+0000","last_became_active":"2023-12-12T09:45:23.553411+0000","last_became_peered":"2023-12-12T09:45:23.553411+0000","last_unstale":"2023-12-12T09:45:37.667880+0000","last_undegraded":"2023-12-12T09:45:37.667880+0000","last_fullsized":"2023-12-12T09:45:37.667880+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_clean_scrub_stamp":"2023-12-12T09:45:22.493994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T14:20:09.952370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":11,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-12T09:45:39.286540+0000","last_change":"2023-12-12T09:45:38.319594+0000","last_active":"2023-12-12T09:45:39.286540+0000","last_peered":"2023-12-12T09:45:39.286540+0000","last_clean":"2023-12-12T09:45:39.286540+0000","last_became_active":"2023-12-12T09:45:38.318642+0000","last_became_peered":"2023-12-12T09:45:38.318642+0000","last_unstale":"2023-12-12T09:45:39.286540+0000","last_undegraded":"2023-12-12T09:45:39.286540+0000","last_fullsized":"2023-12-12T09:45:39.286540+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:37.621350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:37.621350+0000","last_clean_scrub_stamp":"2023-12-12T09:45:37.621350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T20:27:25.089830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":15,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-12-12T09:45:38.312301+0000","last_change":"2023-12-12T09:45:23.538491+0000","last_active":"2023-12-12T09:45:38.312301+0000","last_peered":"2023-12-12T09:45:38.312301+0000","last_clean":"2023-12-12T09:45:38.312301+0000","last_became_active":"2023-12-12T09:45:23.538127+0000","last_became_peered":"2023-12-12T09:45:23.538127+0000","last_unstale":"2023-12-12T09:45:38.312301+0000","last_undegraded":"2023-12-12T09:45:38.312301+0000","last_fullsized":"2023-12-12T09:45:38.312301+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_clean_scrub_stamp":"2023-12-12T09:45:22.493994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T10:19:00.193250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-12-12T09:45:38.315918+0000","last_change":"2023-12-12T09:45:38.309212+0000","last_active":"2023-12-12T09:45:38.315918+0000","last_peered":"2023-12-12T09:45:38.315918+0000","last_clean":"2023-12-12T09:45:38.315918+0000","last_became_active":"2023-12-12T09:45:38.308836+0000","last_became_peered":"2023-12-12T09:45:38.308836+0000","last_unstale":"2023-12-12T09:45:38.315918+0000","last_undegraded":"2023-12-12T09:45:38.315918+0000","last_fullsized":"2023-12-12T09:45:38.315918+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:37.621350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:37.621350+0000","last_clean_scrub_stamp":"2023-12-12T09:45:37.621350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T12:04:37.649241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":14,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-12-12T09:45:37.652501+0000","last_change":"2023-12-12T09:45:23.551873+0000","last_active":"2023-12-12T09:45:37.652501+0000","last_peered":"2023-12-12T09:45:37.652501+0000","last_clean":"2023-12-12T09:45:37.652501+0000","last_became_active":"2023-12-12T09:45:23.551158+0000","last_became_peered":"2023-12-12T09:45:23.551158+0000","last_unstale":"2023-12-12T09:45:37.652501+0000","last_undegraded":"2023-12-12T09:45:37.652501+0000","last_fullsized":"2023-12-12T09:45:37.652501+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_clean_scrub_stamp":"2023-12-12T09:45:22.493994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T20:28:14.192924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-12-12T09:45:38.322845+0000","last_change":"2023-12-12T09:45:38.318052+0000","last_active":"2023-12-12T09:45:38.322845+0000","last_peered":"2023-12-12T09:45:38.322845+0000","last_clean":"2023-12-12T09:45:38.322845+0000","last_became_active":"2023-12-12T09:45:38.317795+0000","last_became_peered":"2023-12-12T09:45:38.317795+0000","last_unstale":"2023-12-12T09:45:38.322845+0000","last_undegraded":"2023-12-12T09:45:38.322845+0000","last_fullsized":"2023-12-12T09:45:38.322845+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:37.621350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:37.621350+0000","last_clean_scrub_stamp":"2023-12-12T09:45:37.621350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T18:35:36.452769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":14,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-12-12T09:45:37.666374+0000","last_change":"2023-12-12T09:45:23.549785+0000","last_active":"2023-12-12T09:45:37.666374+0000","last_peered":"2023-12-12T09:45:37.666374+0000","last_clean":"2023-12-12T09:45:37.666374+0000","last_became_active":"2023-12-12T09:45:23.548831+0000","last_became_peered":"2023-12-12T09:45:23.548831+0000","last_unstale":"2023-12-12T09:45:37.666374+0000","last_undegraded":"2023-12-12T09:45:37.666374+0000","last_fullsized":"2023-12-12T09:45:37.666374+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_clean_scrub_stamp":"2023-12-12T09:45:22.493994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T12:19:37.793666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-12-12T09:45:38.327678+0000","last_change":"2023-12-12T09:45:38.322267+0000","last_active":"2023-12-12T09:45:38.327678+0000","last_peered":"2023-12-12T09:45:38.327678+0000","last_clean":"2023-12-12T09:45:38.327678+0000","last_became_active":"2023-12-12T09:45:38.321894+0000","last_became_peered":"2023-12-12T09:45:38.321894+0000","last_unstale":"2023-12-12T09:45:38.327678+0000","last_undegraded":"2023-12-12T09:45:38.327678+0000","last_fullsized":"2023-12-12T09:45:38.327678+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:37.621350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:37.621350+0000","last_clean_scrub_stamp":"2023-12-12T09:45:37.621350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T12:17:28.983300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":14,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-12-12T09:45:37.652269+0000","last_change":"2023-12-12T09:45:23.546134+0000","last_active":"2023-12-12T09:45:37.652269+0000","last_peered":"2023-12-12T09:45:37.652269+0000","last_clean":"2023-12-12T09:45:37.652269+0000","last_became_active":"2023-12-12T09:45:23.545808+0000","last_became_peered":"2023-12-12T09:45:23.545808+0000","last_unstale":"2023-12-12T09:45:37.652269+0000","last_undegraded":"2023-12-12T09:45:37.652269+0000","last_fullsized":"2023-12-12T09:45:37.652269+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_clean_scrub_stamp":"2023-12-12T09:45:22.493994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T18:13:20.201960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.2b","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-12-12T09:45:38.309265+0000","last_change":"2023-12-12T09:45:38.305454+0000","last_active":"2023-12-12T09:45:38.309265+0000","last_peered":"2023-12-12T09:45:38.309265+0000","last_clean":"2023-12-12T09:45:38.309265+0000","last_became_active":"2023-12-12T09:45:38.305122+0000","last_became_peered":"2023-12-12T09:45:38.305122+0000","last_unstale":"2023-12-12T09:45:38.309265+0000","last_undegraded":"2023-12-12T09:45:38.309265+0000","last_fullsized":"2023-12-12T09:45:38.309265+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:37.621350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:37.621350+0000","last_clean_scrub_stamp":"2023-12-12T09:45:37.621350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T12:53:23.633955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":14,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-12-12T09:45:37.665557+0000","last_change":"2023-12-12T09:45:23.555039+0000","last_active":"2023-12-12T09:45:37.665557+0000","last_peered":"2023-12-12T09:45:37.665557+0000","last_clean":"2023-12-12T09:45:37.665557+0000","last_became_active":"2023-12-12T09:45:23.554002+0000","last_became_peered":"2023-12-12T09:45:23.554002+0000","last_unstale":"2023-12-12T09:45:37.665557+0000","last_undegraded":"2023-12-12T09:45:37.665557+0000","last_fullsized":"2023-12-12T09:45:37.665557+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_clean_scrub_stamp":"2023-12-12T09:45:22.493994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T20:14:20.654636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-12-12T09:45:38.320880+0000","last_change":"2023-12-12T09:45:38.315377+0000","last_active":"2023-12-12T09:45:38.320880+0000","last_peered":"2023-12-12T09:45:38.320880+0000","last_clean":"2023-12-12T09:45:38.320880+0000","last_became_active":"2023-12-12T09:45:38.314552+0000","last_became_peered":"2023-12-12T09:45:38.314552+0000","last_unstale":"2023-12-12T09:45:38.320880+0000","last_undegraded":"2023-12-12T09:45:38.320880+0000","last_fullsized":"2023-12-12T09:45:38.320880+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:37.621350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:37.621350+0000","last_clean_scrub_stamp":"2023-12-12T09:45:37.621350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T10:09:12.176724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":15,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-12-12T09:45:38.304294+0000","last_change":"2023-12-12T09:45:23.530338+0000","last_active":"2023-12-12T09:45:38.304294+0000","last_peered":"2023-12-12T09:45:38.304294+0000","last_clean":"2023-12-12T09:45:38.304294+0000","last_became_active":"2023-12-12T09:45:23.529963+0000","last_became_peered":"2023-12-12T09:45:23.529963+0000","last_unstale":"2023-12-12T09:45:38.304294+0000","last_undegraded":"2023-12-12T09:45:38.304294+0000","last_fullsized":"2023-12-12T09:45:38.304294+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_clean_scrub_stamp":"2023-12-12T09:45:22.493994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T14:10:03.420375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-12-12T09:45:38.325007+0000","last_change":"2023-12-12T09:45:38.314719+0000","last_active":"2023-12-12T09:45:38.325007+0000","last_peered":"2023-12-12T09:45:38.325007+0000","last_clean":"2023-12-12T09:45:38.325007+0000","last_became_active":"2023-12-12T09:45:38.314468+0000","last_became_peered":"2023-12-12T09:45:38.314468+0000","last_unstale":"2023-12-12T09:45:38.325007+0000","last_undegraded":"2023-12-12T09:45:38.325007+0000","last_fullsized":"2023-12-12T09:45:38.325007+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:37.621350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:37.621350+0000","last_clean_scrub_stamp":"2023-12-12T09:45:37.621350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T18:20:48.118581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":15,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-12-12T09:45:38.311552+0000","last_change":"2023-12-12T09:45:23.528718+0000","last_active":"2023-12-12T09:45:38.311552+0000","last_peered":"2023-12-12T09:45:38.311552+0000","last_clean":"2023-12-12T09:45:38.311552+0000","last_became_active":"2023-12-12T09:45:23.525181+0000","last_became_peered":"2023-12-12T09:45:23.525181+0000","last_unstale":"2023-12-12T09:45:38.311552+0000","last_undegraded":"2023-12-12T09:45:38.311552+0000","last_fullsized":"2023-12-12T09:45:38.311552+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_clean_scrub_stamp":"2023-12-12T09:45:22.493994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T11:39:20.601364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-12-12T09:45:38.313081+0000","last_change":"2023-12-12T09:45:38.307793+0000","last_active":"2023-12-12T09:45:38.313081+0000","last_peered":"2023-12-12T09:45:38.313081+0000","last_clean":"2023-12-12T09:45:38.313081+0000","last_became_active":"2023-12-12T09:45:38.307379+0000","last_became_peered":"2023-12-12T09:45:38.307379+0000","last_unstale":"2023-12-12T09:45:38.313081+0000","last_undegraded":"2023-12-12T09:45:38.313081+0000","last_fullsized":"2023-12-12T09:45:38.313081+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:37.621350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:37.621350+0000","last_clean_scrub_stamp":"2023-12-12T09:45:37.621350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T14:20:25.079726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":15,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-12-12T09:45:38.292536+0000","last_change":"2023-12-12T09:45:23.546891+0000","last_active":"2023-12-12T09:45:38.292536+0000","last_peered":"2023-12-12T09:45:38.292536+0000","last_clean":"2023-12-12T09:45:38.292536+0000","last_became_active":"2023-12-12T09:45:23.544703+0000","last_became_peered":"2023-12-12T09:45:23.544703+0000","last_unstale":"2023-12-12T09:45:38.292536+0000","last_undegraded":"2023-12-12T09:45:38.292536+0000","last_fullsized":"2023-12-12T09:45:38.292536+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_clean_scrub_stamp":"2023-12-12T09:45:22.493994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T17:31:24.263383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-12-12T09:45:38.320255+0000","last_change":"2023-12-12T09:45:38.314695+0000","last_active":"2023-12-12T09:45:38.320255+0000","last_peered":"2023-12-12T09:45:38.320255+0000","last_clean":"2023-12-12T09:45:38.320255+0000","last_became_active":"2023-12-12T09:45:38.314341+0000","last_became_peered":"2023-12-12T09:45:38.314341+0000","last_unstale":"2023-12-12T09:45:38.320255+0000","last_undegraded":"2023-12-12T09:45:38.320255+0000","last_fullsized":"2023-12-12T09:45:38.320255+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:37.621350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:37.621350+0000","last_clean_scrub_stamp":"2023-12-12T09:45:37.621350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T16:46:47.550621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":14,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-12-12T09:45:37.632277+0000","last_change":"2023-12-12T09:45:23.542373+0000","last_active":"2023-12-12T09:45:37.632277+0000","last_peered":"2023-12-12T09:45:37.632277+0000","last_clean":"2023-12-12T09:45:37.632277+0000","last_became_active":"2023-12-12T09:45:23.541920+0000","last_became_peered":"2023-12-12T09:45:23.541920+0000","last_unstale":"2023-12-12T09:45:37.632277+0000","last_undegraded":"2023-12-12T09:45:37.632277+0000","last_fullsized":"2023-12-12T09:45:37.632277+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_clean_scrub_stamp":"2023-12-12T09:45:22.493994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T17:51:26.545637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":11,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-12T09:45:39.289099+0000","last_change":"2023-12-12T09:45:38.310075+0000","last_active":"2023-12-12T09:45:39.289099+0000","last_peered":"2023-12-12T09:45:39.289099+0000","last_clean":"2023-12-12T09:45:39.289099+0000","last_became_active":"2023-12-12T09:45:38.309769+0000","last_became_peered":"2023-12-12T09:45:38.309769+0000","last_unstale":"2023-12-12T09:45:39.289099+0000","last_undegraded":"2023-12-12T09:45:39.289099+0000","last_fullsized":"2023-12-12T09:45:39.289099+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:37.621350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:37.621350+0000","last_clean_scrub_stamp":"2023-12-12T09:45:37.621350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T20:26:20.414663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":15,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-12-12T09:45:38.304964+0000","last_change":"2023-12-12T09:45:23.541091+0000","last_active":"2023-12-12T09:45:38.304964+0000","last_peered":"2023-12-12T09:45:38.304964+0000","last_clean":"2023-12-12T09:45:38.304964+0000","last_became_active":"2023-12-12T09:45:23.540514+0000","last_became_peered":"2023-12-12T09:45:23.540514+0000","last_unstale":"2023-12-12T09:45:38.304964+0000","last_undegraded":"2023-12-12T09:45:38.304964+0000","last_fullsized":"2023-12-12T09:45:38.304964+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_clean_scrub_stamp":"2023-12-12T09:45:22.493994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T11:20:23.908314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":11,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-12T09:45:39.284454+0000","last_change":"2023-12-12T09:45:38.313232+0000","last_active":"2023-12-12T09:45:39.284454+0000","last_peered":"2023-12-12T09:45:39.284454+0000","last_clean":"2023-12-12T09:45:39.284454+0000","last_became_active":"2023-12-12T09:45:38.312938+0000","last_became_peered":"2023-12-12T09:45:38.312938+0000","last_unstale":"2023-12-12T09:45:39.284454+0000","last_undegraded":"2023-12-12T09:45:39.284454+0000","last_fullsized":"2023-12-12T09:45:39.284454+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:37.621350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:37.621350+0000","last_clean_scrub_stamp":"2023-12-12T09:45:37.621350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T21:33:57.012215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":14,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-12-12T09:45:37.652620+0000","last_change":"2023-12-12T09:45:23.546206+0000","last_active":"2023-12-12T09:45:37.652620+0000","last_peered":"2023-12-12T09:45:37.652620+0000","last_clean":"2023-12-12T09:45:37.652620+0000","last_became_active":"2023-12-12T09:45:23.545933+0000","last_became_peered":"2023-12-12T09:45:23.545933+0000","last_unstale":"2023-12-12T09:45:37.652620+0000","last_undegraded":"2023-12-12T09:45:37.652620+0000","last_fullsized":"2023-12-12T09:45:37.652620+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_clean_scrub_stamp":"2023-12-12T09:45:22.493994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T21:35:11.842669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":11,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-12T09:45:39.286644+0000","last_change":"2023-12-12T09:45:38.314253+0000","last_active":"2023-12-12T09:45:39.286644+0000","last_peered":"2023-12-12T09:45:39.286644+0000","last_clean":"2023-12-12T09:45:39.286644+0000","last_became_active":"2023-12-12T09:45:38.313932+0000","last_became_peered":"2023-12-12T09:45:38.313932+0000","last_unstale":"2023-12-12T09:45:39.286644+0000","last_undegraded":"2023-12-12T09:45:39.286644+0000","last_fullsized":"2023-12-12T09:45:39.286644+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:37.621350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:37.621350+0000","last_clean_scrub_stamp":"2023-12-12T09:45:37.621350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T12:17:28.983300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":14,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-12-12T09:45:37.665766+0000","last_change":"2023-12-12T09:45:23.554368+0000","last_active":"2023-12-12T09:45:37.665766+0000","last_peered":"2023-12-12T09:45:37.665766+0000","last_clean":"2023-12-12T09:45:37.665766+0000","last_became_active":"2023-12-12T09:45:23.554034+0000","last_became_peered":"2023-12-12T09:45:23.554034+0000","last_unstale":"2023-12-12T09:45:37.665766+0000","last_undegraded":"2023-12-12T09:45:37.665766+0000","last_fullsized":"2023-12-12T09:45:37.665766+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_clean_scrub_stamp":"2023-12-12T09:45:22.493994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T16:08:55.346248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-12-12T09:45:38.319574+0000","last_change":"2023-12-12T09:45:38.311589+0000","last_active":"2023-12-12T09:45:38.319574+0000","last_peered":"2023-12-12T09:45:38.319574+0000","last_clean":"2023-12-12T09:45:38.319574+0000","last_became_active":"2023-12-12T09:45:38.311243+0000","last_became_peered":"2023-12-12T09:45:38.311243+0000","last_unstale":"2023-12-12T09:45:38.319574+0000","last_undegraded":"2023-12-12T09:45:38.319574+0000","last_fullsized":"2023-12-12T09:45:38.319574+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:37.621350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:37.621350+0000","last_clean_scrub_stamp":"2023-12-12T09:45:37.621350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T17:32:34.172961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":15,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-12-12T09:45:38.302233+0000","last_change":"2023-12-12T09:45:23.529597+0000","last_active":"2023-12-12T09:45:38.302233+0000","last_peered":"2023-12-12T09:45:38.302233+0000","last_clean":"2023-12-12T09:45:38.302233+0000","last_became_active":"2023-12-12T09:45:23.524375+0000","last_became_peered":"2023-12-12T09:45:23.524375+0000","last_unstale":"2023-12-12T09:45:38.302233+0000","last_undegraded":"2023-12-12T09:45:38.302233+0000","last_fullsized":"2023-12-12T09:45:38.302233+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_clean_scrub_stamp":"2023-12-12T09:45:22.493994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T16:54:32.416316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":11,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-12T09:45:39.287551+0000","last_change":"2023-12-12T09:45:38.311059+0000","last_active":"2023-12-12T09:45:39.287551+0000","last_peered":"2023-12-12T09:45:39.287551+0000","last_clean":"2023-12-12T09:45:39.287551+0000","last_became_active":"2023-12-12T09:45:38.309505+0000","last_became_peered":"2023-12-12T09:45:38.309505+0000","last_unstale":"2023-12-12T09:45:39.287551+0000","last_undegraded":"2023-12-12T09:45:39.287551+0000","last_fullsized":"2023-12-12T09:45:39.287551+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:37.621350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:37.621350+0000","last_clean_scrub_stamp":"2023-12-12T09:45:37.621350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T21:35:26.970025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":14,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-12-12T09:45:37.631253+0000","last_change":"2023-12-12T09:45:23.553950+0000","last_active":"2023-12-12T09:45:37.631253+0000","last_peered":"2023-12-12T09:45:37.631253+0000","last_clean":"2023-12-12T09:45:37.631253+0000","last_became_active":"2023-12-12T09:45:23.551990+0000","last_became_peered":"2023-12-12T09:45:23.551990+0000","last_unstale":"2023-12-12T09:45:37.631253+0000","last_undegraded":"2023-12-12T09:45:37.631253+0000","last_fullsized":"2023-12-12T09:45:37.631253+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_clean_scrub_stamp":"2023-12-12T09:45:22.493994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T12:19:37.793666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":11,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-12T09:45:39.286047+0000","last_change":"2023-12-12T09:45:38.315488+0000","last_active":"2023-12-12T09:45:39.286047+0000","last_peered":"2023-12-12T09:45:39.286047+0000","last_clean":"2023-12-12T09:45:39.286047+0000","last_became_active":"2023-12-12T09:45:38.315214+0000","last_became_peered":"2023-12-12T09:45:38.315214+0000","last_unstale":"2023-12-12T09:45:39.286047+0000","last_undegraded":"2023-12-12T09:45:39.286047+0000","last_fullsized":"2023-12-12T09:45:39.286047+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:37.621350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:37.621350+0000","last_clean_scrub_stamp":"2023-12-12T09:45:37.621350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T18:13:35.329316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1d","version":"57'2","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-12-12T09:45:38.679989+0000","last_change":"2023-12-12T09:45:37.664314+0000","last_active":"2023-12-12T09:45:38.679989+0000","last_peered":"2023-12-12T09:45:38.679989+0000","last_clean":"2023-12-12T09:45:38.679989+0000","last_became_active":"2023-12-12T09:45:37.664049+0000","last_became_peered":"2023-12-12T09:45:37.664049+0000","last_unstale":"2023-12-12T09:45:38.679989+0000","last_undegraded":"2023-12-12T09:45:38.679989+0000","last_fullsized":"2023-12-12T09:45:38.679989+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:36.607138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:36.607138+0000","last_clean_scrub_stamp":"2023-12-12T09:45:36.607138+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T17:50:39.794657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":14,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-12-12T09:45:37.632732+0000","last_change":"2023-12-12T09:45:23.551190+0000","last_active":"2023-12-12T09:45:37.632732+0000","last_peered":"2023-12-12T09:45:37.632732+0000","last_clean":"2023-12-12T09:45:37.632732+0000","last_became_active":"2023-12-12T09:45:23.550956+0000","last_became_peered":"2023-12-12T09:45:23.550956+0000","last_unstale":"2023-12-12T09:45:37.632732+0000","last_undegraded":"2023-12-12T09:45:37.632732+0000","last_fullsized":"2023-12-12T09:45:37.632732+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_clean_scrub_stamp":"2023-12-12T09:45:22.493994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T14:11:54.140937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1f","version":"53'4","reported_seq":19,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-12-12T09:45:37.631614+0000","last_change":"2023-12-12T09:45:22.537277+0000","last_active":"2023-12-12T09:45:37.631614+0000","last_peered":"2023-12-12T09:45:37.631614+0000","last_clean":"2023-12-12T09:45:37.631614+0000","last_became_active":"2023-12-12T09:45:22.536893+0000","last_became_peered":"2023-12-12T09:45:22.536893+0000","last_unstale":"2023-12-12T09:45:37.631614+0000","last_undegraded":"2023-12-12T09:45:37.631614+0000","last_fullsized":"2023-12-12T09:45:37.631614+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:21.477323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:21.477323+0000","last_clean_scrub_stamp":"2023-12-12T09:45:21.477323+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T16:38:00.043063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-12-12T09:45:38.322883+0000","last_change":"2023-12-12T09:45:38.318399+0000","last_active":"2023-12-12T09:45:38.322883+0000","last_peered":"2023-12-12T09:45:38.322883+0000","last_clean":"2023-12-12T09:45:38.322883+0000","last_became_active":"2023-12-12T09:45:38.317682+0000","last_became_peered":"2023-12-12T09:45:38.317682+0000","last_unstale":"2023-12-12T09:45:38.322883+0000","last_undegraded":"2023-12-12T09:45:38.322883+0000","last_fullsized":"2023-12-12T09:45:38.322883+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:37.621350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:37.621350+0000","last_clean_scrub_stamp":"2023-12-12T09:45:37.621350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T21:35:26.970025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1c","version":"57'2","reported_seq":14,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-12T09:45:39.286770+0000","last_change":"2023-12-12T09:45:37.664992+0000","last_active":"2023-12-12T09:45:39.286770+0000","last_peered":"2023-12-12T09:45:39.286770+0000","last_clean":"2023-12-12T09:45:39.286770+0000","last_became_active":"2023-12-12T09:45:37.664644+0000","last_became_peered":"2023-12-12T09:45:37.664644+0000","last_unstale":"2023-12-12T09:45:39.286770+0000","last_undegraded":"2023-12-12T09:45:39.286770+0000","last_fullsized":"2023-12-12T09:45:39.286770+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:36.607138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:36.607138+0000","last_clean_scrub_stamp":"2023-12-12T09:45:36.607138+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T10:09:11.162511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":14,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-12-12T09:45:37.645050+0000","last_change":"2023-12-12T09:45:23.549535+0000","last_active":"2023-12-12T09:45:37.645050+0000","last_peered":"2023-12-12T09:45:37.645050+0000","last_clean":"2023-12-12T09:45:37.645050+0000","last_became_active":"2023-12-12T09:45:23.549256+0000","last_became_peered":"2023-12-12T09:45:23.549256+0000","last_unstale":"2023-12-12T09:45:37.645050+0000","last_undegraded":"2023-12-12T09:45:37.645050+0000","last_fullsized":"2023-12-12T09:45:37.645050+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_clean_scrub_stamp":"2023-12-12T09:45:22.493994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T15:15:38.448721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"53'1","reported_seq":16,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-12-12T09:45:37.652874+0000","last_change":"2023-12-12T09:45:22.543679+0000","last_active":"2023-12-12T09:45:37.652874+0000","last_peered":"2023-12-12T09:45:37.652874+0000","last_clean":"2023-12-12T09:45:37.652874+0000","last_became_active":"2023-12-12T09:45:22.543357+0000","last_became_peered":"2023-12-12T09:45:22.543357+0000","last_unstale":"2023-12-12T09:45:37.652874+0000","last_undegraded":"2023-12-12T09:45:37.652874+0000","last_fullsized":"2023-12-12T09:45:37.652874+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:21.477323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:21.477323+0000","last_clean_scrub_stamp":"2023-12-12T09:45:21.477323+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T13:19:15.975105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-12-12T09:45:38.323536+0000","last_change":"2023-12-12T09:45:38.321058+0000","last_active":"2023-12-12T09:45:38.323536+0000","last_peered":"2023-12-12T09:45:38.323536+0000","last_clean":"2023-12-12T09:45:38.323536+0000","last_became_active":"2023-12-12T09:45:38.320720+0000","last_became_peered":"2023-12-12T09:45:38.320720+0000","last_unstale":"2023-12-12T09:45:38.323536+0000","last_undegraded":"2023-12-12T09:45:38.323536+0000","last_fullsized":"2023-12-12T09:45:38.323536+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:37.621350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:37.621350+0000","last_clean_scrub_stamp":"2023-12-12T09:45:37.621350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T18:13:35.329316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1f","version":"57'4","reported_seq":15,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-12-12T09:45:38.688058+0000","last_change":"2023-12-12T09:45:37.671340+0000","last_active":"2023-12-12T09:45:38.688058+0000","last_peered":"2023-12-12T09:45:38.688058+0000","last_clean":"2023-12-12T09:45:38.688058+0000","last_became_active":"2023-12-12T09:45:37.671045+0000","last_became_peered":"2023-12-12T09:45:37.671045+0000","last_unstale":"2023-12-12T09:45:38.688058+0000","last_undegraded":"2023-12-12T09:45:38.688058+0000","last_fullsized":"2023-12-12T09:45:38.688058+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:36.607138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:36.607138+0000","last_clean_scrub_stamp":"2023-12-12T09:45:36.607138+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T12:01:00.044592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":14,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-12-12T09:45:37.631917+0000","last_change":"2023-12-12T09:45:23.531455+0000","last_active":"2023-12-12T09:45:37.631917+0000","last_peered":"2023-12-12T09:45:37.631917+0000","last_clean":"2023-12-12T09:45:37.631917+0000","last_became_active":"2023-12-12T09:45:23.531164+0000","last_became_peered":"2023-12-12T09:45:23.531164+0000","last_unstale":"2023-12-12T09:45:37.631917+0000","last_undegraded":"2023-12-12T09:45:37.631917+0000","last_fullsized":"2023-12-12T09:45:37.631917+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_clean_scrub_stamp":"2023-12-12T09:45:22.493994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T14:54:10.661378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"53'2","reported_seq":17,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-12-12T09:45:37.632615+0000","last_change":"2023-12-12T09:45:22.531101+0000","last_active":"2023-12-12T09:45:37.632615+0000","last_peered":"2023-12-12T09:45:37.632615+0000","last_clean":"2023-12-12T09:45:37.632615+0000","last_became_active":"2023-12-12T09:45:22.530822+0000","last_became_peered":"2023-12-12T09:45:22.530822+0000","last_unstale":"2023-12-12T09:45:37.632615+0000","last_undegraded":"2023-12-12T09:45:37.632615+0000","last_fullsized":"2023-12-12T09:45:37.632615+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:21.477323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:21.477323+0000","last_clean_scrub_stamp":"2023-12-12T09:45:21.477323+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T21:23:16.895410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":11,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-12T09:45:39.286786+0000","last_change":"2023-12-12T09:45:38.319771+0000","last_active":"2023-12-12T09:45:39.286786+0000","last_peered":"2023-12-12T09:45:39.286786+0000","last_clean":"2023-12-12T09:45:39.286786+0000","last_became_active":"2023-12-12T09:45:38.319344+0000","last_became_peered":"2023-12-12T09:45:38.319344+0000","last_unstale":"2023-12-12T09:45:39.286786+0000","last_undegraded":"2023-12-12T09:45:39.286786+0000","last_fullsized":"2023-12-12T09:45:39.286786+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:37.621350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:37.621350+0000","last_clean_scrub_stamp":"2023-12-12T09:45:37.621350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T19:02:05.650265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1e","version":"57'1","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-12-12T09:45:38.684885+0000","last_change":"2023-12-12T09:45:37.661347+0000","last_active":"2023-12-12T09:45:38.684885+0000","last_peered":"2023-12-12T09:45:38.684885+0000","last_clean":"2023-12-12T09:45:38.684885+0000","last_became_active":"2023-12-12T09:45:37.661023+0000","last_became_peered":"2023-12-12T09:45:37.661023+0000","last_unstale":"2023-12-12T09:45:38.684885+0000","last_undegraded":"2023-12-12T09:45:38.684885+0000","last_fullsized":"2023-12-12T09:45:38.684885+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:36.607138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:36.607138+0000","last_clean_scrub_stamp":"2023-12-12T09:45:36.607138+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T21:35:25.955813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":14,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-12-12T09:45:37.632736+0000","last_change":"2023-12-12T09:45:23.548842+0000","last_active":"2023-12-12T09:45:37.632736+0000","last_peered":"2023-12-12T09:45:37.632736+0000","last_clean":"2023-12-12T09:45:37.632736+0000","last_became_active":"2023-12-12T09:45:23.548561+0000","last_became_peered":"2023-12-12T09:45:23.548561+0000","last_unstale":"2023-12-12T09:45:37.632736+0000","last_undegraded":"2023-12-12T09:45:37.632736+0000","last_fullsized":"2023-12-12T09:45:37.632736+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_clean_scrub_stamp":"2023-12-12T09:45:22.493994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T10:08:57.049367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1c","version":"53'2","reported_seq":18,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-12-12T09:45:38.284403+0000","last_change":"2023-12-12T09:45:22.540050+0000","last_active":"2023-12-12T09:45:38.284403+0000","last_peered":"2023-12-12T09:45:38.284403+0000","last_clean":"2023-12-12T09:45:38.284403+0000","last_became_active":"2023-12-12T09:45:22.539726+0000","last_became_peered":"2023-12-12T09:45:22.539726+0000","last_unstale":"2023-12-12T09:45:38.284403+0000","last_undegraded":"2023-12-12T09:45:38.284403+0000","last_fullsized":"2023-12-12T09:45:38.284403+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:21.477323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:21.477323+0000","last_clean_scrub_stamp":"2023-12-12T09:45:21.477323+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T19:19:47.388523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":11,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-12T09:45:39.284157+0000","last_change":"2023-12-12T09:45:38.315934+0000","last_active":"2023-12-12T09:45:39.284157+0000","last_peered":"2023-12-12T09:45:39.284157+0000","last_clean":"2023-12-12T09:45:39.284157+0000","last_became_active":"2023-12-12T09:45:38.315644+0000","last_became_peered":"2023-12-12T09:45:38.315644+0000","last_unstale":"2023-12-12T09:45:39.284157+0000","last_undegraded":"2023-12-12T09:45:39.284157+0000","last_fullsized":"2023-12-12T09:45:39.284157+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:37.621350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:37.621350+0000","last_clean_scrub_stamp":"2023-12-12T09:45:37.621350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T16:38:16.187090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":11,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-12-12T09:45:38.285530+0000","last_change":"2023-12-12T09:45:37.661790+0000","last_active":"2023-12-12T09:45:38.285530+0000","last_peered":"2023-12-12T09:45:38.285530+0000","last_clean":"2023-12-12T09:45:38.285530+0000","last_became_active":"2023-12-12T09:45:37.661468+0000","last_became_peered":"2023-12-12T09:45:37.661468+0000","last_unstale":"2023-12-12T09:45:38.285530+0000","last_undegraded":"2023-12-12T09:45:38.285530+0000","last_fullsized":"2023-12-12T09:45:38.285530+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:36.607138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:36.607138+0000","last_clean_scrub_stamp":"2023-12-12T09:45:36.607138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T16:46:46.536409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":14,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-12-12T09:45:37.652379+0000","last_change":"2023-12-12T09:45:23.536948+0000","last_active":"2023-12-12T09:45:37.652379+0000","last_peered":"2023-12-12T09:45:37.652379+0000","last_clean":"2023-12-12T09:45:37.652379+0000","last_became_active":"2023-12-12T09:45:23.536696+0000","last_became_peered":"2023-12-12T09:45:23.536696+0000","last_unstale":"2023-12-12T09:45:37.652379+0000","last_undegraded":"2023-12-12T09:45:37.652379+0000","last_fullsized":"2023-12-12T09:45:37.652379+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_clean_scrub_stamp":"2023-12-12T09:45:22.493994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T21:33:41.884858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"53'1","reported_seq":16,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-12-12T09:45:37.649456+0000","last_change":"2023-12-12T09:45:22.543941+0000","last_active":"2023-12-12T09:45:37.649456+0000","last_peered":"2023-12-12T09:45:37.649456+0000","last_clean":"2023-12-12T09:45:37.649456+0000","last_became_active":"2023-12-12T09:45:22.543584+0000","last_became_peered":"2023-12-12T09:45:22.543584+0000","last_unstale":"2023-12-12T09:45:37.649456+0000","last_undegraded":"2023-12-12T09:45:37.649456+0000","last_fullsized":"2023-12-12T09:45:37.649456+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:21.477323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:21.477323+0000","last_clean_scrub_stamp":"2023-12-12T09:45:21.477323+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T13:28:37.770730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-12-12T09:45:38.315367+0000","last_change":"2023-12-12T09:45:38.313200+0000","last_active":"2023-12-12T09:45:38.315367+0000","last_peered":"2023-12-12T09:45:38.315367+0000","last_clean":"2023-12-12T09:45:38.315367+0000","last_became_active":"2023-12-12T09:45:38.312678+0000","last_became_peered":"2023-12-12T09:45:38.312678+0000","last_unstale":"2023-12-12T09:45:38.315367+0000","last_undegraded":"2023-12-12T09:45:38.315367+0000","last_fullsized":"2023-12-12T09:45:38.315367+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:37.621350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:37.621350+0000","last_clean_scrub_stamp":"2023-12-12T09:45:37.621350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T20:28:29.320280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":12,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-12T09:45:39.284250+0000","last_change":"2023-12-12T09:45:37.654995+0000","last_active":"2023-12-12T09:45:39.284250+0000","last_peered":"2023-12-12T09:45:39.284250+0000","last_clean":"2023-12-12T09:45:39.284250+0000","last_became_active":"2023-12-12T09:45:37.654684+0000","last_became_peered":"2023-12-12T09:45:37.654684+0000","last_unstale":"2023-12-12T09:45:39.284250+0000","last_undegraded":"2023-12-12T09:45:39.284250+0000","last_fullsized":"2023-12-12T09:45:39.284250+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:36.607138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:36.607138+0000","last_clean_scrub_stamp":"2023-12-12T09:45:36.607138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T20:54:32.568354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":14,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-12-12T09:45:37.652411+0000","last_change":"2023-12-12T09:45:23.553762+0000","last_active":"2023-12-12T09:45:37.652411+0000","last_peered":"2023-12-12T09:45:37.652411+0000","last_clean":"2023-12-12T09:45:37.652411+0000","last_became_active":"2023-12-12T09:45:23.553518+0000","last_became_peered":"2023-12-12T09:45:23.553518+0000","last_unstale":"2023-12-12T09:45:37.652411+0000","last_undegraded":"2023-12-12T09:45:37.652411+0000","last_fullsized":"2023-12-12T09:45:37.652411+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_clean_scrub_stamp":"2023-12-12T09:45:22.493994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T21:11:37.302926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1a","version":"53'1","reported_seq":16,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-12-12T09:45:37.631526+0000","last_change":"2023-12-12T09:45:22.535525+0000","last_active":"2023-12-12T09:45:37.631526+0000","last_peered":"2023-12-12T09:45:37.631526+0000","last_clean":"2023-12-12T09:45:37.631526+0000","last_became_active":"2023-12-12T09:45:22.534726+0000","last_became_peered":"2023-12-12T09:45:22.534726+0000","last_unstale":"2023-12-12T09:45:37.631526+0000","last_undegraded":"2023-12-12T09:45:37.631526+0000","last_fullsized":"2023-12-12T09:45:37.631526+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:21.477323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:21.477323+0000","last_clean_scrub_stamp":"2023-12-12T09:45:21.477323+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T16:23:29.088120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":11,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-12T09:45:39.287649+0000","last_change":"2023-12-12T09:45:38.312469+0000","last_active":"2023-12-12T09:45:39.287649+0000","last_peered":"2023-12-12T09:45:39.287649+0000","last_clean":"2023-12-12T09:45:39.287649+0000","last_became_active":"2023-12-12T09:45:38.311922+0000","last_became_peered":"2023-12-12T09:45:38.311922+0000","last_unstale":"2023-12-12T09:45:39.287649+0000","last_undegraded":"2023-12-12T09:45:39.287649+0000","last_fullsized":"2023-12-12T09:45:39.287649+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:37.621350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:37.621350+0000","last_clean_scrub_stamp":"2023-12-12T09:45:37.621350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T21:11:52.430282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1b","version":"57'1","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-12-12T09:45:38.676153+0000","last_change":"2023-12-12T09:45:37.661772+0000","last_active":"2023-12-12T09:45:38.676153+0000","last_peered":"2023-12-12T09:45:38.676153+0000","last_clean":"2023-12-12T09:45:38.676153+0000","last_became_active":"2023-12-12T09:45:37.661511+0000","last_became_peered":"2023-12-12T09:45:37.661511+0000","last_unstale":"2023-12-12T09:45:38.676153+0000","last_undegraded":"2023-12-12T09:45:38.676153+0000","last_fullsized":"2023-12-12T09:45:38.676153+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:36.607138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:36.607138+0000","last_clean_scrub_stamp":"2023-12-12T09:45:36.607138+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T10:33:43.572550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":15,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-12-12T09:45:38.304395+0000","last_change":"2023-12-12T09:45:23.550084+0000","last_active":"2023-12-12T09:45:38.304395+0000","last_peered":"2023-12-12T09:45:38.304395+0000","last_clean":"2023-12-12T09:45:38.304395+0000","last_became_active":"2023-12-12T09:45:23.549808+0000","last_became_peered":"2023-12-12T09:45:23.549808+0000","last_unstale":"2023-12-12T09:45:38.304395+0000","last_undegraded":"2023-12-12T09:45:38.304395+0000","last_fullsized":"2023-12-12T09:45:38.304395+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_clean_scrub_stamp":"2023-12-12T09:45:22.493994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T18:05:50.089314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":16,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-12-12T09:45:38.285385+0000","last_change":"2023-12-12T09:45:22.531465+0000","last_active":"2023-12-12T09:45:38.285385+0000","last_peered":"2023-12-12T09:45:38.285385+0000","last_clean":"2023-12-12T09:45:38.285385+0000","last_became_active":"2023-12-12T09:45:22.531205+0000","last_became_peered":"2023-12-12T09:45:22.531205+0000","last_unstale":"2023-12-12T09:45:38.285385+0000","last_undegraded":"2023-12-12T09:45:38.285385+0000","last_fullsized":"2023-12-12T09:45:38.285385+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:21.477323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:21.477323+0000","last_clean_scrub_stamp":"2023-12-12T09:45:21.477323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T13:28:37.770730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-12-12T09:45:38.319788+0000","last_change":"2023-12-12T09:45:38.313443+0000","last_active":"2023-12-12T09:45:38.319788+0000","last_peered":"2023-12-12T09:45:38.319788+0000","last_clean":"2023-12-12T09:45:38.319788+0000","last_became_active":"2023-12-12T09:45:38.313086+0000","last_became_peered":"2023-12-12T09:45:38.313086+0000","last_unstale":"2023-12-12T09:45:38.319788+0000","last_undegraded":"2023-12-12T09:45:38.319788+0000","last_fullsized":"2023-12-12T09:45:38.319788+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:37.621350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:37.621350+0000","last_clean_scrub_stamp":"2023-12-12T09:45:37.621350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T12:19:52.921022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.1a","version":"57'1","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-12T09:45:39.285907+0000","last_change":"2023-12-12T09:45:37.662619+0000","last_active":"2023-12-12T09:45:39.285907+0000","last_peered":"2023-12-12T09:45:39.285907+0000","last_clean":"2023-12-12T09:45:39.285907+0000","last_became_active":"2023-12-12T09:45:37.661632+0000","last_became_peered":"2023-12-12T09:45:37.661632+0000","last_unstale":"2023-12-12T09:45:39.285907+0000","last_undegraded":"2023-12-12T09:45:39.285907+0000","last_fullsized":"2023-12-12T09:45:39.285907+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:36.607138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:36.607138+0000","last_clean_scrub_stamp":"2023-12-12T09:45:36.607138+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T20:14:34.767780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":14,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-12-12T09:45:37.651320+0000","last_change":"2023-12-12T09:45:23.542175+0000","last_active":"2023-12-12T09:45:37.651320+0000","last_peered":"2023-12-12T09:45:37.651320+0000","last_clean":"2023-12-12T09:45:37.651320+0000","last_became_active":"2023-12-12T09:45:23.541908+0000","last_became_peered":"2023-12-12T09:45:23.541908+0000","last_unstale":"2023-12-12T09:45:37.651320+0000","last_undegraded":"2023-12-12T09:45:37.651320+0000","last_fullsized":"2023-12-12T09:45:37.651320+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_clean_scrub_stamp":"2023-12-12T09:45:22.493994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T12:15:05.167806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":15,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-12-12T09:45:37.650465+0000","last_change":"2023-12-12T09:45:22.540369+0000","last_active":"2023-12-12T09:45:37.650465+0000","last_peered":"2023-12-12T09:45:37.650465+0000","last_clean":"2023-12-12T09:45:37.650465+0000","last_became_active":"2023-12-12T09:45:22.540054+0000","last_became_peered":"2023-12-12T09:45:22.540054+0000","last_unstale":"2023-12-12T09:45:37.650465+0000","last_undegraded":"2023-12-12T09:45:37.650465+0000","last_fullsized":"2023-12-12T09:45:37.650465+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:21.477323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:21.477323+0000","last_clean_scrub_stamp":"2023-12-12T09:45:21.477323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T14:03:02.042556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":11,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-12T09:45:39.286256+0000","last_change":"2023-12-12T09:45:38.308618+0000","last_active":"2023-12-12T09:45:39.286256+0000","last_peered":"2023-12-12T09:45:39.286256+0000","last_clean":"2023-12-12T09:45:39.286256+0000","last_became_active":"2023-12-12T09:45:38.307785+0000","last_became_peered":"2023-12-12T09:45:38.307785+0000","last_unstale":"2023-12-12T09:45:39.286256+0000","last_undegraded":"2023-12-12T09:45:39.286256+0000","last_fullsized":"2023-12-12T09:45:39.286256+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:37.621350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:37.621350+0000","last_clean_scrub_stamp":"2023-12-12T09:45:37.621350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T12:15:20.295162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.15","version":"57'3","reported_seq":14,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-12-12T09:45:38.684679+0000","last_change":"2023-12-12T09:45:37.656613+0000","last_active":"2023-12-12T09:45:38.684679+0000","last_peered":"2023-12-12T09:45:38.684679+0000","last_clean":"2023-12-12T09:45:38.684679+0000","last_became_active":"2023-12-12T09:45:37.656145+0000","last_became_peered":"2023-12-12T09:45:37.656145+0000","last_unstale":"2023-12-12T09:45:38.684679+0000","last_undegraded":"2023-12-12T09:45:38.684679+0000","last_fullsized":"2023-12-12T09:45:38.684679+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:36.607138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:36.607138+0000","last_clean_scrub_stamp":"2023-12-12T09:45:36.607138+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T14:21:13.249073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":14,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-12-12T09:45:37.652235+0000","last_change":"2023-12-12T09:45:23.552875+0000","last_active":"2023-12-12T09:45:37.652235+0000","last_peered":"2023-12-12T09:45:37.652235+0000","last_clean":"2023-12-12T09:45:37.652235+0000","last_became_active":"2023-12-12T09:45:23.551034+0000","last_became_peered":"2023-12-12T09:45:23.551034+0000","last_unstale":"2023-12-12T09:45:37.652235+0000","last_undegraded":"2023-12-12T09:45:37.652235+0000","last_fullsized":"2023-12-12T09:45:37.652235+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_clean_scrub_stamp":"2023-12-12T09:45:22.493994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T19:01:50.522909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":15,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-12-12T09:45:37.667795+0000","last_change":"2023-12-12T09:45:22.546259+0000","last_active":"2023-12-12T09:45:37.667795+0000","last_peered":"2023-12-12T09:45:37.667795+0000","last_clean":"2023-12-12T09:45:37.667795+0000","last_became_active":"2023-12-12T09:45:22.545948+0000","last_became_peered":"2023-12-12T09:45:22.545948+0000","last_unstale":"2023-12-12T09:45:37.667795+0000","last_undegraded":"2023-12-12T09:45:37.667795+0000","last_fullsized":"2023-12-12T09:45:37.667795+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:21.477323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:21.477323+0000","last_clean_scrub_stamp":"2023-12-12T09:45:21.477323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T19:19:47.388523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":11,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-12T09:45:39.285473+0000","last_change":"2023-12-12T09:45:38.308843+0000","last_active":"2023-12-12T09:45:39.285473+0000","last_peered":"2023-12-12T09:45:39.285473+0000","last_clean":"2023-12-12T09:45:39.285473+0000","last_became_active":"2023-12-12T09:45:38.308367+0000","last_became_peered":"2023-12-12T09:45:38.308367+0000","last_unstale":"2023-12-12T09:45:39.285473+0000","last_undegraded":"2023-12-12T09:45:39.285473+0000","last_fullsized":"2023-12-12T09:45:39.285473+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:37.621350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:37.621350+0000","last_clean_scrub_stamp":"2023-12-12T09:45:37.621350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T10:40:58.336593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.14","version":"57'6","reported_seq":17,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-12-12T09:45:38.688553+0000","last_change":"2023-12-12T09:45:37.655387+0000","last_active":"2023-12-12T09:45:38.688553+0000","last_peered":"2023-12-12T09:45:38.688553+0000","last_clean":"2023-12-12T09:45:38.688553+0000","last_became_active":"2023-12-12T09:45:37.655122+0000","last_became_peered":"2023-12-12T09:45:37.655122+0000","last_unstale":"2023-12-12T09:45:38.688553+0000","last_undegraded":"2023-12-12T09:45:38.688553+0000","last_fullsized":"2023-12-12T09:45:38.688553+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:36.607138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:36.607138+0000","last_clean_scrub_stamp":"2023-12-12T09:45:36.607138+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T12:19:51.906810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":14,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-12-12T09:45:37.667770+0000","last_change":"2023-12-12T09:45:23.556637+0000","last_active":"2023-12-12T09:45:37.667770+0000","last_peered":"2023-12-12T09:45:37.667770+0000","last_clean":"2023-12-12T09:45:37.667770+0000","last_became_active":"2023-12-12T09:45:23.556344+0000","last_became_peered":"2023-12-12T09:45:23.556344+0000","last_unstale":"2023-12-12T09:45:37.667770+0000","last_undegraded":"2023-12-12T09:45:37.667770+0000","last_fullsized":"2023-12-12T09:45:37.667770+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_clean_scrub_stamp":"2023-12-12T09:45:22.493994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T14:11:54.140937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":15,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-12-12T09:45:37.652960+0000","last_change":"2023-12-12T09:45:22.537346+0000","last_active":"2023-12-12T09:45:37.652960+0000","last_peered":"2023-12-12T09:45:37.652960+0000","last_clean":"2023-12-12T09:45:37.652960+0000","last_became_active":"2023-12-12T09:45:22.535141+0000","last_became_peered":"2023-12-12T09:45:22.535141+0000","last_unstale":"2023-12-12T09:45:37.652960+0000","last_undegraded":"2023-12-12T09:45:37.652960+0000","last_fullsized":"2023-12-12T09:45:37.652960+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:21.477323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:21.477323+0000","last_clean_scrub_stamp":"2023-12-12T09:45:21.477323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T18:37:25.938135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":11,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-12T09:45:39.289104+0000","last_change":"2023-12-12T09:45:38.311804+0000","last_active":"2023-12-12T09:45:39.289104+0000","last_peered":"2023-12-12T09:45:39.289104+0000","last_clean":"2023-12-12T09:45:39.289104+0000","last_became_active":"2023-12-12T09:45:38.311335+0000","last_became_peered":"2023-12-12T09:45:38.311335+0000","last_unstale":"2023-12-12T09:45:39.289104+0000","last_undegraded":"2023-12-12T09:45:39.289104+0000","last_fullsized":"2023-12-12T09:45:39.289104+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:37.621350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:37.621350+0000","last_clean_scrub_stamp":"2023-12-12T09:45:37.621350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T15:35:25.282517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":11,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-12-12T09:45:38.291275+0000","last_change":"2023-12-12T09:45:37.657826+0000","last_active":"2023-12-12T09:45:38.291275+0000","last_peered":"2023-12-12T09:45:38.291275+0000","last_clean":"2023-12-12T09:45:38.291275+0000","last_became_active":"2023-12-12T09:45:37.657533+0000","last_became_peered":"2023-12-12T09:45:37.657533+0000","last_unstale":"2023-12-12T09:45:38.291275+0000","last_undegraded":"2023-12-12T09:45:38.291275+0000","last_fullsized":"2023-12-12T09:45:38.291275+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:36.607138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:36.607138+0000","last_clean_scrub_stamp":"2023-12-12T09:45:36.607138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T18:37:41.067950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":14,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-12-12T09:45:37.638699+0000","last_change":"2023-12-12T09:45:23.549595+0000","last_active":"2023-12-12T09:45:37.638699+0000","last_peered":"2023-12-12T09:45:37.638699+0000","last_clean":"2023-12-12T09:45:37.638699+0000","last_became_active":"2023-12-12T09:45:23.549247+0000","last_became_peered":"2023-12-12T09:45:23.549247+0000","last_unstale":"2023-12-12T09:45:37.638699+0000","last_undegraded":"2023-12-12T09:45:37.638699+0000","last_fullsized":"2023-12-12T09:45:37.638699+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_clean_scrub_stamp":"2023-12-12T09:45:22.493994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T14:03:03.059227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.15","version":"53'3","reported_seq":18,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-12-12T09:45:37.667028+0000","last_change":"2023-12-12T09:45:22.546308+0000","last_active":"2023-12-12T09:45:37.667028+0000","last_peered":"2023-12-12T09:45:37.667028+0000","last_clean":"2023-12-12T09:45:37.667028+0000","last_became_active":"2023-12-12T09:45:22.545942+0000","last_became_peered":"2023-12-12T09:45:22.545942+0000","last_unstale":"2023-12-12T09:45:37.667028+0000","last_undegraded":"2023-12-12T09:45:37.667028+0000","last_fullsized":"2023-12-12T09:45:37.667028+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:21.477323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:21.477323+0000","last_clean_scrub_stamp":"2023-12-12T09:45:21.477323+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T13:07:07.278574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-12-12T09:45:38.323755+0000","last_change":"2023-12-12T09:45:38.322221+0000","last_active":"2023-12-12T09:45:38.323755+0000","last_peered":"2023-12-12T09:45:38.323755+0000","last_clean":"2023-12-12T09:45:38.323755+0000","last_became_active":"2023-12-12T09:45:38.321756+0000","last_became_peered":"2023-12-12T09:45:38.321756+0000","last_unstale":"2023-12-12T09:45:38.323755+0000","last_undegraded":"2023-12-12T09:45:38.323755+0000","last_fullsized":"2023-12-12T09:45:38.323755+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:37.621350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:37.621350+0000","last_clean_scrub_stamp":"2023-12-12T09:45:37.621350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T20:28:29.320280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":12,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-12T09:45:39.286515+0000","last_change":"2023-12-12T09:45:37.670968+0000","last_active":"2023-12-12T09:45:39.286515+0000","last_peered":"2023-12-12T09:45:39.286515+0000","last_clean":"2023-12-12T09:45:39.286515+0000","last_became_active":"2023-12-12T09:45:37.670209+0000","last_became_peered":"2023-12-12T09:45:37.670209+0000","last_unstale":"2023-12-12T09:45:39.286515+0000","last_undegraded":"2023-12-12T09:45:39.286515+0000","last_fullsized":"2023-12-12T09:45:39.286515+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:36.607138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:36.607138+0000","last_clean_scrub_stamp":"2023-12-12T09:45:36.607138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T14:20:24.065514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":14,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-12-12T09:45:37.666870+0000","last_change":"2023-12-12T09:45:23.557554+0000","last_active":"2023-12-12T09:45:37.666870+0000","last_peered":"2023-12-12T09:45:37.666870+0000","last_clean":"2023-12-12T09:45:37.666870+0000","last_became_active":"2023-12-12T09:45:23.557239+0000","last_became_peered":"2023-12-12T09:45:23.557239+0000","last_unstale":"2023-12-12T09:45:37.666870+0000","last_undegraded":"2023-12-12T09:45:37.666870+0000","last_fullsized":"2023-12-12T09:45:37.666870+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_clean_scrub_stamp":"2023-12-12T09:45:22.493994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T14:16:48.793935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.14","version":"54'9","reported_seq":24,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-12-12T09:45:37.649815+0000","last_change":"2023-12-12T09:45:22.543924+0000","last_active":"2023-12-12T09:45:37.649815+0000","last_peered":"2023-12-12T09:45:37.649815+0000","last_clean":"2023-12-12T09:45:37.649815+0000","last_became_active":"2023-12-12T09:45:22.543617+0000","last_became_peered":"2023-12-12T09:45:22.543617+0000","last_unstale":"2023-12-12T09:45:37.649815+0000","last_undegraded":"2023-12-12T09:45:37.649815+0000","last_fullsized":"2023-12-12T09:45:37.649815+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:21.477323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:21.477323+0000","last_clean_scrub_stamp":"2023-12-12T09:45:21.477323+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T20:52:44.328181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3107,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-12-12T09:45:38.328138+0000","last_change":"2023-12-12T09:45:38.322753+0000","last_active":"2023-12-12T09:45:38.328138+0000","last_peered":"2023-12-12T09:45:38.328138+0000","last_clean":"2023-12-12T09:45:38.328138+0000","last_became_active":"2023-12-12T09:45:38.322472+0000","last_became_peered":"2023-12-12T09:45:38.322472+0000","last_unstale":"2023-12-12T09:45:38.328138+0000","last_undegraded":"2023-12-12T09:45:38.328138+0000","last_fullsized":"2023-12-12T09:45:38.328138+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:37.621350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:37.621350+0000","last_clean_scrub_stamp":"2023-12-12T09:45:37.621350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T18:13:35.329316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":12,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-12T09:45:39.285188+0000","last_change":"2023-12-12T09:45:37.652907+0000","last_active":"2023-12-12T09:45:39.285188+0000","last_peered":"2023-12-12T09:45:39.285188+0000","last_clean":"2023-12-12T09:45:39.285188+0000","last_became_active":"2023-12-12T09:45:37.652489+0000","last_became_peered":"2023-12-12T09:45:37.652489+0000","last_unstale":"2023-12-12T09:45:39.285188+0000","last_undegraded":"2023-12-12T09:45:39.285188+0000","last_fullsized":"2023-12-12T09:45:39.285188+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:36.607138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:36.607138+0000","last_clean_scrub_stamp":"2023-12-12T09:45:36.607138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T18:13:34.315104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":15,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-12-12T09:45:38.287705+0000","last_change":"2023-12-12T09:45:23.542417+0000","last_active":"2023-12-12T09:45:38.287705+0000","last_peered":"2023-12-12T09:45:38.287705+0000","last_clean":"2023-12-12T09:45:38.287705+0000","last_became_active":"2023-12-12T09:45:23.541778+0000","last_became_peered":"2023-12-12T09:45:23.541778+0000","last_unstale":"2023-12-12T09:45:38.287705+0000","last_undegraded":"2023-12-12T09:45:38.287705+0000","last_fullsized":"2023-12-12T09:45:38.287705+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_clean_scrub_stamp":"2023-12-12T09:45:22.493994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T13:07:08.295245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"53'2","reported_seq":17,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-12-12T09:45:37.652528+0000","last_change":"2023-12-12T09:45:22.531079+0000","last_active":"2023-12-12T09:45:37.652528+0000","last_peered":"2023-12-12T09:45:37.652528+0000","last_clean":"2023-12-12T09:45:37.652528+0000","last_became_active":"2023-12-12T09:45:22.530821+0000","last_became_peered":"2023-12-12T09:45:22.530821+0000","last_unstale":"2023-12-12T09:45:37.652528+0000","last_undegraded":"2023-12-12T09:45:37.652528+0000","last_fullsized":"2023-12-12T09:45:37.652528+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:21.477323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:21.477323+0000","last_clean_scrub_stamp":"2023-12-12T09:45:21.477323+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T14:54:09.644707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":11,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-12T09:45:39.284847+0000","last_change":"2023-12-12T09:45:38.319062+0000","last_active":"2023-12-12T09:45:39.284847+0000","last_peered":"2023-12-12T09:45:39.284847+0000","last_clean":"2023-12-12T09:45:39.284847+0000","last_became_active":"2023-12-12T09:45:38.318665+0000","last_became_peered":"2023-12-12T09:45:38.318665+0000","last_unstale":"2023-12-12T09:45:39.284847+0000","last_undegraded":"2023-12-12T09:45:39.284847+0000","last_fullsized":"2023-12-12T09:45:39.284847+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:37.621350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:37.621350+0000","last_clean_scrub_stamp":"2023-12-12T09:45:37.621350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T15:15:53.576077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.10","version":"57'8","reported_seq":19,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-12-12T09:45:38.678794+0000","last_change":"2023-12-12T09:45:37.669586+0000","last_active":"2023-12-12T09:45:38.678794+0000","last_peered":"2023-12-12T09:45:38.678794+0000","last_clean":"2023-12-12T09:45:38.678794+0000","last_became_active":"2023-12-12T09:45:37.669283+0000","last_became_peered":"2023-12-12T09:45:37.669283+0000","last_unstale":"2023-12-12T09:45:38.678794+0000","last_undegraded":"2023-12-12T09:45:38.678794+0000","last_fullsized":"2023-12-12T09:45:38.678794+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:36.607138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:36.607138+0000","last_clean_scrub_stamp":"2023-12-12T09:45:36.607138+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T14:12:08.254081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":14,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-12-12T09:45:37.666364+0000","last_change":"2023-12-12T09:45:23.550533+0000","last_active":"2023-12-12T09:45:37.666364+0000","last_peered":"2023-12-12T09:45:37.666364+0000","last_clean":"2023-12-12T09:45:37.666364+0000","last_became_active":"2023-12-12T09:45:23.548384+0000","last_became_peered":"2023-12-12T09:45:23.548384+0000","last_unstale":"2023-12-12T09:45:37.666364+0000","last_undegraded":"2023-12-12T09:45:37.666364+0000","last_fullsized":"2023-12-12T09:45:37.666364+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_clean_scrub_stamp":"2023-12-12T09:45:22.493994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T12:04:22.521885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":16,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-12-12T09:45:38.296388+0000","last_change":"2023-12-12T09:45:22.540556+0000","last_active":"2023-12-12T09:45:38.296388+0000","last_peered":"2023-12-12T09:45:38.296388+0000","last_clean":"2023-12-12T09:45:38.296388+0000","last_became_active":"2023-12-12T09:45:22.540265+0000","last_became_peered":"2023-12-12T09:45:22.540265+0000","last_unstale":"2023-12-12T09:45:38.296388+0000","last_undegraded":"2023-12-12T09:45:38.296388+0000","last_fullsized":"2023-12-12T09:45:38.296388+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:21.477323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:21.477323+0000","last_clean_scrub_stamp":"2023-12-12T09:45:21.477323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T18:29:34.637693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-12-12T09:45:38.322693+0000","last_change":"2023-12-12T09:45:38.317777+0000","last_active":"2023-12-12T09:45:38.322693+0000","last_peered":"2023-12-12T09:45:38.322693+0000","last_clean":"2023-12-12T09:45:38.322693+0000","last_became_active":"2023-12-12T09:45:38.317414+0000","last_became_peered":"2023-12-12T09:45:38.317414+0000","last_unstale":"2023-12-12T09:45:38.322693+0000","last_undegraded":"2023-12-12T09:45:38.322693+0000","last_fullsized":"2023-12-12T09:45:38.322693+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:37.621350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:37.621350+0000","last_clean_scrub_stamp":"2023-12-12T09:45:37.621350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T12:15:20.295162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"57'2","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-12-12T09:45:38.682086+0000","last_change":"2023-12-12T09:45:37.669818+0000","last_active":"2023-12-12T09:45:38.682086+0000","last_peered":"2023-12-12T09:45:38.682086+0000","last_clean":"2023-12-12T09:45:38.682086+0000","last_became_active":"2023-12-12T09:45:37.669494+0000","last_became_peered":"2023-12-12T09:45:37.669494+0000","last_unstale":"2023-12-12T09:45:38.682086+0000","last_undegraded":"2023-12-12T09:45:38.682086+0000","last_fullsized":"2023-12-12T09:45:38.682086+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:36.607138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:36.607138+0000","last_clean_scrub_stamp":"2023-12-12T09:45:36.607138+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T20:14:34.767780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":14,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-12-12T09:45:37.650218+0000","last_change":"2023-12-12T09:45:23.550480+0000","last_active":"2023-12-12T09:45:37.650218+0000","last_peered":"2023-12-12T09:45:37.650218+0000","last_clean":"2023-12-12T09:45:37.650218+0000","last_became_active":"2023-12-12T09:45:23.549473+0000","last_became_peered":"2023-12-12T09:45:23.549473+0000","last_unstale":"2023-12-12T09:45:37.650218+0000","last_undegraded":"2023-12-12T09:45:37.650218+0000","last_fullsized":"2023-12-12T09:45:37.650218+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_clean_scrub_stamp":"2023-12-12T09:45:22.493994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T16:23:30.104791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":16,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-12-12T09:45:38.285519+0000","last_change":"2023-12-12T09:45:22.540441+0000","last_active":"2023-12-12T09:45:38.285519+0000","last_peered":"2023-12-12T09:45:38.285519+0000","last_clean":"2023-12-12T09:45:38.285519+0000","last_became_active":"2023-12-12T09:45:22.539379+0000","last_became_peered":"2023-12-12T09:45:22.539379+0000","last_unstale":"2023-12-12T09:45:38.285519+0000","last_undegraded":"2023-12-12T09:45:38.285519+0000","last_fullsized":"2023-12-12T09:45:38.285519+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:21.477323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:21.477323+0000","last_clean_scrub_stamp":"2023-12-12T09:45:21.477323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T14:03:02.042556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":11,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-12T09:45:39.288193+0000","last_change":"2023-12-12T09:45:38.297728+0000","last_active":"2023-12-12T09:45:39.288193+0000","last_peered":"2023-12-12T09:45:39.288193+0000","last_clean":"2023-12-12T09:45:39.288193+0000","last_became_active":"2023-12-12T09:45:38.297313+0000","last_became_peered":"2023-12-12T09:45:38.297313+0000","last_unstale":"2023-12-12T09:45:39.288193+0000","last_undegraded":"2023-12-12T09:45:39.288193+0000","last_fullsized":"2023-12-12T09:45:39.288193+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:37.621350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:37.621350+0000","last_clean_scrub_stamp":"2023-12-12T09:45:37.621350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T09:57:22.254000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":12,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-12T09:45:39.286016+0000","last_change":"2023-12-12T09:45:37.662703+0000","last_active":"2023-12-12T09:45:39.286016+0000","last_peered":"2023-12-12T09:45:39.286016+0000","last_clean":"2023-12-12T09:45:39.286016+0000","last_became_active":"2023-12-12T09:45:37.661648+0000","last_became_peered":"2023-12-12T09:45:37.661648+0000","last_unstale":"2023-12-12T09:45:39.286016+0000","last_undegraded":"2023-12-12T09:45:39.286016+0000","last_fullsized":"2023-12-12T09:45:39.286016+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:36.607138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:36.607138+0000","last_clean_scrub_stamp":"2023-12-12T09:45:36.607138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T12:04:36.635029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":14,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-12-12T09:45:37.665974+0000","last_change":"2023-12-12T09:45:23.556070+0000","last_active":"2023-12-12T09:45:37.665974+0000","last_peered":"2023-12-12T09:45:37.665974+0000","last_clean":"2023-12-12T09:45:37.665974+0000","last_became_active":"2023-12-12T09:45:23.554580+0000","last_became_peered":"2023-12-12T09:45:23.554580+0000","last_unstale":"2023-12-12T09:45:37.665974+0000","last_undegraded":"2023-12-12T09:45:37.665974+0000","last_fullsized":"2023-12-12T09:45:37.665974+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_clean_scrub_stamp":"2023-12-12T09:45:22.493994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T12:53:08.506599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.10","version":"53'8","reported_seq":23,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-12-12T09:45:37.664798+0000","last_change":"2023-12-12T09:45:22.546154+0000","last_active":"2023-12-12T09:45:37.664798+0000","last_peered":"2023-12-12T09:45:37.664798+0000","last_clean":"2023-12-12T09:45:37.664798+0000","last_became_active":"2023-12-12T09:45:22.545903+0000","last_became_peered":"2023-12-12T09:45:22.545903+0000","last_unstale":"2023-12-12T09:45:37.664798+0000","last_undegraded":"2023-12-12T09:45:37.664798+0000","last_fullsized":"2023-12-12T09:45:37.664798+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:21.477323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:21.477323+0000","last_clean_scrub_stamp":"2023-12-12T09:45:21.477323+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T16:38:00.043063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-12-12T09:45:38.315627+0000","last_change":"2023-12-12T09:45:38.308645+0000","last_active":"2023-12-12T09:45:38.315627+0000","last_peered":"2023-12-12T09:45:38.315627+0000","last_clean":"2023-12-12T09:45:38.315627+0000","last_became_active":"2023-12-12T09:45:38.308334+0000","last_became_peered":"2023-12-12T09:45:38.308334+0000","last_unstale":"2023-12-12T09:45:38.315627+0000","last_undegraded":"2023-12-12T09:45:38.315627+0000","last_fullsized":"2023-12-12T09:45:38.315627+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:37.621350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:37.621350+0000","last_clean_scrub_stamp":"2023-12-12T09:45:37.621350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T14:20:25.079726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.d","version":"57'1","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-12T09:45:39.286950+0000","last_change":"2023-12-12T09:45:37.671206+0000","last_active":"2023-12-12T09:45:39.286950+0000","last_peered":"2023-12-12T09:45:39.286950+0000","last_clean":"2023-12-12T09:45:39.286950+0000","last_became_active":"2023-12-12T09:45:37.669225+0000","last_became_peered":"2023-12-12T09:45:37.669225+0000","last_unstale":"2023-12-12T09:45:39.286950+0000","last_undegraded":"2023-12-12T09:45:39.286950+0000","last_fullsized":"2023-12-12T09:45:39.286950+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:36.607138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:36.607138+0000","last_clean_scrub_stamp":"2023-12-12T09:45:36.607138+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T16:46:46.536409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":14,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-12-12T09:45:37.667590+0000","last_change":"2023-12-12T09:45:23.551062+0000","last_active":"2023-12-12T09:45:37.667590+0000","last_peered":"2023-12-12T09:45:37.667590+0000","last_clean":"2023-12-12T09:45:37.667590+0000","last_became_active":"2023-12-12T09:45:23.549387+0000","last_became_peered":"2023-12-12T09:45:23.549387+0000","last_unstale":"2023-12-12T09:45:37.667590+0000","last_undegraded":"2023-12-12T09:45:37.667590+0000","last_fullsized":"2023-12-12T09:45:37.667590+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_clean_scrub_stamp":"2023-12-12T09:45:22.493994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T10:08:57.049367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.f","version":"53'1","reported_seq":16,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-12-12T09:45:37.652850+0000","last_change":"2023-12-12T09:45:22.532050+0000","last_active":"2023-12-12T09:45:37.652850+0000","last_peered":"2023-12-12T09:45:37.652850+0000","last_clean":"2023-12-12T09:45:37.652850+0000","last_became_active":"2023-12-12T09:45:22.531712+0000","last_became_peered":"2023-12-12T09:45:22.531712+0000","last_unstale":"2023-12-12T09:45:37.652850+0000","last_undegraded":"2023-12-12T09:45:37.652850+0000","last_fullsized":"2023-12-12T09:45:37.652850+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:21.477323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:21.477323+0000","last_clean_scrub_stamp":"2023-12-12T09:45:21.477323+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T12:43:03.230562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":11,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-12T09:45:39.285819+0000","last_change":"2023-12-12T09:45:38.308663+0000","last_active":"2023-12-12T09:45:39.285819+0000","last_peered":"2023-12-12T09:45:39.285819+0000","last_clean":"2023-12-12T09:45:39.285819+0000","last_became_active":"2023-12-12T09:45:38.308013+0000","last_became_peered":"2023-12-12T09:45:38.308013+0000","last_unstale":"2023-12-12T09:45:39.285819+0000","last_undegraded":"2023-12-12T09:45:39.285819+0000","last_fullsized":"2023-12-12T09:45:39.285819+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:37.621350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:37.621350+0000","last_clean_scrub_stamp":"2023-12-12T09:45:37.621350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T15:49:31.275353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":11,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-12-12T09:45:38.298091+0000","last_change":"2023-12-12T09:45:37.673754+0000","last_active":"2023-12-12T09:45:38.298091+0000","last_peered":"2023-12-12T09:45:38.298091+0000","last_clean":"2023-12-12T09:45:38.298091+0000","last_became_active":"2023-12-12T09:45:37.673476+0000","last_became_peered":"2023-12-12T09:45:37.673476+0000","last_unstale":"2023-12-12T09:45:38.298091+0000","last_undegraded":"2023-12-12T09:45:38.298091+0000","last_fullsized":"2023-12-12T09:45:38.298091+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:36.607138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:36.607138+0000","last_clean_scrub_stamp":"2023-12-12T09:45:36.607138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T12:23:51.860870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":15,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-12-12T09:45:38.283779+0000","last_change":"2023-12-12T09:45:23.531234+0000","last_active":"2023-12-12T09:45:38.283779+0000","last_peered":"2023-12-12T09:45:38.283779+0000","last_clean":"2023-12-12T09:45:38.283779+0000","last_became_active":"2023-12-12T09:45:23.530849+0000","last_became_peered":"2023-12-12T09:45:23.530849+0000","last_unstale":"2023-12-12T09:45:38.283779+0000","last_undegraded":"2023-12-12T09:45:38.283779+0000","last_fullsized":"2023-12-12T09:45:38.283779+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_clean_scrub_stamp":"2023-12-12T09:45:22.493994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T16:08:55.346248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.e","version":"53'2","reported_seq":17,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-12-12T09:45:37.632853+0000","last_change":"2023-12-12T09:45:22.535653+0000","last_active":"2023-12-12T09:45:37.632853+0000","last_peered":"2023-12-12T09:45:37.632853+0000","last_clean":"2023-12-12T09:45:37.632853+0000","last_became_active":"2023-12-12T09:45:22.534893+0000","last_became_peered":"2023-12-12T09:45:22.534893+0000","last_unstale":"2023-12-12T09:45:37.632853+0000","last_undegraded":"2023-12-12T09:45:37.632853+0000","last_fullsized":"2023-12-12T09:45:37.632853+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:21.477323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:21.477323+0000","last_clean_scrub_stamp":"2023-12-12T09:45:21.477323+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T13:07:07.278574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-12-12T09:45:38.304671+0000","last_change":"2023-12-12T09:45:38.299478+0000","last_active":"2023-12-12T09:45:38.304671+0000","last_peered":"2023-12-12T09:45:38.304671+0000","last_clean":"2023-12-12T09:45:38.304671+0000","last_became_active":"2023-12-12T09:45:38.299059+0000","last_became_peered":"2023-12-12T09:45:38.299059+0000","last_unstale":"2023-12-12T09:45:38.304671+0000","last_undegraded":"2023-12-12T09:45:38.304671+0000","last_fullsized":"2023-12-12T09:45:38.304671+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:37.621350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:37.621350+0000","last_clean_scrub_stamp":"2023-12-12T09:45:37.621350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T14:17:03.921292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.f","version":"57'1","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-12T09:45:39.286861+0000","last_change":"2023-12-12T09:45:37.668157+0000","last_active":"2023-12-12T09:45:39.286861+0000","last_peered":"2023-12-12T09:45:39.286861+0000","last_clean":"2023-12-12T09:45:39.286861+0000","last_became_active":"2023-12-12T09:45:37.667375+0000","last_became_peered":"2023-12-12T09:45:37.667375+0000","last_unstale":"2023-12-12T09:45:39.286861+0000","last_undegraded":"2023-12-12T09:45:39.286861+0000","last_fullsized":"2023-12-12T09:45:39.286861+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:36.607138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:36.607138+0000","last_clean_scrub_stamp":"2023-12-12T09:45:36.607138+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T14:12:08.254081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":14,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-12-12T09:45:37.652632+0000","last_change":"2023-12-12T09:45:23.539711+0000","last_active":"2023-12-12T09:45:37.652632+0000","last_peered":"2023-12-12T09:45:37.652632+0000","last_clean":"2023-12-12T09:45:37.652632+0000","last_became_active":"2023-12-12T09:45:23.539296+0000","last_became_peered":"2023-12-12T09:45:23.539296+0000","last_unstale":"2023-12-12T09:45:37.652632+0000","last_undegraded":"2023-12-12T09:45:37.652632+0000","last_fullsized":"2023-12-12T09:45:37.652632+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_clean_scrub_stamp":"2023-12-12T09:45:22.493994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T12:00:45.931448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"53'1","reported_seq":17,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-12-12T09:45:38.285291+0000","last_change":"2023-12-12T09:45:22.540703+0000","last_active":"2023-12-12T09:45:38.285291+0000","last_peered":"2023-12-12T09:45:38.285291+0000","last_clean":"2023-12-12T09:45:38.285291+0000","last_became_active":"2023-12-12T09:45:22.540383+0000","last_became_peered":"2023-12-12T09:45:22.540383+0000","last_unstale":"2023-12-12T09:45:38.285291+0000","last_undegraded":"2023-12-12T09:45:38.285291+0000","last_fullsized":"2023-12-12T09:45:38.285291+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:21.477323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:21.477323+0000","last_clean_scrub_stamp":"2023-12-12T09:45:21.477323+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T20:27:08.945803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-12-12T09:45:38.318780+0000","last_change":"2023-12-12T09:45:38.313109+0000","last_active":"2023-12-12T09:45:38.318780+0000","last_peered":"2023-12-12T09:45:38.318780+0000","last_clean":"2023-12-12T09:45:38.318780+0000","last_became_active":"2023-12-12T09:45:38.312767+0000","last_became_peered":"2023-12-12T09:45:38.312767+0000","last_unstale":"2023-12-12T09:45:38.318780+0000","last_undegraded":"2023-12-12T09:45:38.318780+0000","last_fullsized":"2023-12-12T09:45:38.318780+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:37.621350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:37.621350+0000","last_clean_scrub_stamp":"2023-12-12T09:45:37.621350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T21:33:57.012215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"57'2","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-12-12T09:45:38.680807+0000","last_change":"2023-12-12T09:45:37.669581+0000","last_active":"2023-12-12T09:45:38.680807+0000","last_peered":"2023-12-12T09:45:38.680807+0000","last_clean":"2023-12-12T09:45:38.680807+0000","last_became_active":"2023-12-12T09:45:37.669298+0000","last_became_peered":"2023-12-12T09:45:37.669298+0000","last_unstale":"2023-12-12T09:45:38.680807+0000","last_undegraded":"2023-12-12T09:45:38.680807+0000","last_fullsized":"2023-12-12T09:45:38.680807+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:36.607138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:36.607138+0000","last_clean_scrub_stamp":"2023-12-12T09:45:36.607138+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T13:19:31.104920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":14,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-12-12T09:45:37.666949+0000","last_change":"2023-12-12T09:45:23.558032+0000","last_active":"2023-12-12T09:45:37.666949+0000","last_peered":"2023-12-12T09:45:37.666949+0000","last_clean":"2023-12-12T09:45:37.666949+0000","last_became_active":"2023-12-12T09:45:23.557676+0000","last_became_peered":"2023-12-12T09:45:23.557676+0000","last_unstale":"2023-12-12T09:45:37.666949+0000","last_undegraded":"2023-12-12T09:45:37.666949+0000","last_fullsized":"2023-12-12T09:45:37.666949+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_clean_scrub_stamp":"2023-12-12T09:45:22.493994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T18:41:29.720316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":15,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-12-12T09:45:37.632032+0000","last_change":"2023-12-12T09:45:22.533152+0000","last_active":"2023-12-12T09:45:37.632032+0000","last_peered":"2023-12-12T09:45:37.632032+0000","last_clean":"2023-12-12T09:45:37.632032+0000","last_became_active":"2023-12-12T09:45:22.532826+0000","last_became_peered":"2023-12-12T09:45:22.532826+0000","last_unstale":"2023-12-12T09:45:37.632032+0000","last_undegraded":"2023-12-12T09:45:37.632032+0000","last_fullsized":"2023-12-12T09:45:37.632032+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:21.477323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:21.477323+0000","last_clean_scrub_stamp":"2023-12-12T09:45:21.477323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T15:15:37.432050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-12-12T09:45:38.328215+0000","last_change":"2023-12-12T09:45:38.321884+0000","last_active":"2023-12-12T09:45:38.328215+0000","last_peered":"2023-12-12T09:45:38.328215+0000","last_clean":"2023-12-12T09:45:38.328215+0000","last_became_active":"2023-12-12T09:45:38.321553+0000","last_became_peered":"2023-12-12T09:45:38.321553+0000","last_unstale":"2023-12-12T09:45:38.328215+0000","last_undegraded":"2023-12-12T09:45:38.328215+0000","last_fullsized":"2023-12-12T09:45:38.328215+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:37.621350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:37.621350+0000","last_clean_scrub_stamp":"2023-12-12T09:45:37.621350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T13:44:21.224373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":12,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-12T09:45:39.284821+0000","last_change":"2023-12-12T09:45:37.660651+0000","last_active":"2023-12-12T09:45:39.284821+0000","last_peered":"2023-12-12T09:45:39.284821+0000","last_clean":"2023-12-12T09:45:39.284821+0000","last_became_active":"2023-12-12T09:45:37.660314+0000","last_became_peered":"2023-12-12T09:45:37.660314+0000","last_unstale":"2023-12-12T09:45:39.284821+0000","last_undegraded":"2023-12-12T09:45:39.284821+0000","last_fullsized":"2023-12-12T09:45:39.284821+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:36.607138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:36.607138+0000","last_clean_scrub_stamp":"2023-12-12T09:45:36.607138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T12:15:19.280950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":15,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-12-12T09:45:38.287919+0000","last_change":"2023-12-12T09:45:23.542634+0000","last_active":"2023-12-12T09:45:38.287919+0000","last_peered":"2023-12-12T09:45:38.287919+0000","last_clean":"2023-12-12T09:45:38.287919+0000","last_became_active":"2023-12-12T09:45:23.542138+0000","last_became_peered":"2023-12-12T09:45:23.542138+0000","last_unstale":"2023-12-12T09:45:38.287919+0000","last_undegraded":"2023-12-12T09:45:38.287919+0000","last_fullsized":"2023-12-12T09:45:38.287919+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_clean_scrub_stamp":"2023-12-12T09:45:22.493994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T20:14:20.654636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.b","version":"53'2","reported_seq":17,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-12-12T09:45:37.652714+0000","last_change":"2023-12-12T09:45:22.544938+0000","last_active":"2023-12-12T09:45:37.652714+0000","last_peered":"2023-12-12T09:45:37.652714+0000","last_clean":"2023-12-12T09:45:37.652714+0000","last_became_active":"2023-12-12T09:45:22.544532+0000","last_became_peered":"2023-12-12T09:45:22.544532+0000","last_unstale":"2023-12-12T09:45:37.652714+0000","last_undegraded":"2023-12-12T09:45:37.652714+0000","last_fullsized":"2023-12-12T09:45:37.652714+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:21.477323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:21.477323+0000","last_clean_scrub_stamp":"2023-12-12T09:45:21.477323+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T17:50:24.664842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-12-12T09:45:38.325240+0000","last_change":"2023-12-12T09:45:38.318220+0000","last_active":"2023-12-12T09:45:38.325240+0000","last_peered":"2023-12-12T09:45:38.325240+0000","last_clean":"2023-12-12T09:45:38.325240+0000","last_became_active":"2023-12-12T09:45:38.316945+0000","last_became_peered":"2023-12-12T09:45:38.316945+0000","last_unstale":"2023-12-12T09:45:38.325240+0000","last_undegraded":"2023-12-12T09:45:38.325240+0000","last_fullsized":"2023-12-12T09:45:38.325240+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:37.621350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:37.621350+0000","last_clean_scrub_stamp":"2023-12-12T09:45:37.621350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T14:28:41.399263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":11,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-12-12T09:45:38.291140+0000","last_change":"2023-12-12T09:45:37.657398+0000","last_active":"2023-12-12T09:45:38.291140+0000","last_peered":"2023-12-12T09:45:38.291140+0000","last_clean":"2023-12-12T09:45:38.291140+0000","last_became_active":"2023-12-12T09:45:37.656949+0000","last_became_peered":"2023-12-12T09:45:37.656949+0000","last_unstale":"2023-12-12T09:45:38.291140+0000","last_undegraded":"2023-12-12T09:45:38.291140+0000","last_fullsized":"2023-12-12T09:45:38.291140+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:36.607138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:36.607138+0000","last_clean_scrub_stamp":"2023-12-12T09:45:36.607138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T13:19:12.576132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":14,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-12-12T09:45:37.631494+0000","last_change":"2023-12-12T09:45:23.551020+0000","last_active":"2023-12-12T09:45:37.631494+0000","last_peered":"2023-12-12T09:45:37.631494+0000","last_clean":"2023-12-12T09:45:37.631494+0000","last_became_active":"2023-12-12T09:45:23.550753+0000","last_became_peered":"2023-12-12T09:45:23.550753+0000","last_unstale":"2023-12-12T09:45:37.631494+0000","last_undegraded":"2023-12-12T09:45:37.631494+0000","last_fullsized":"2023-12-12T09:45:37.631494+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_clean_scrub_stamp":"2023-12-12T09:45:22.493994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T14:16:48.793935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":15,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-12-12T09:45:37.637824+0000","last_change":"2023-12-12T09:45:22.532615+0000","last_active":"2023-12-12T09:45:37.637824+0000","last_peered":"2023-12-12T09:45:37.637824+0000","last_clean":"2023-12-12T09:45:37.637824+0000","last_became_active":"2023-12-12T09:45:22.530254+0000","last_became_peered":"2023-12-12T09:45:22.530254+0000","last_unstale":"2023-12-12T09:45:37.637824+0000","last_undegraded":"2023-12-12T09:45:37.637824+0000","last_fullsized":"2023-12-12T09:45:37.637824+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:21.477323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:21.477323+0000","last_clean_scrub_stamp":"2023-12-12T09:45:21.477323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T15:07:46.103446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-12-12T09:45:38.319598+0000","last_change":"2023-12-12T09:45:38.311198+0000","last_active":"2023-12-12T09:45:38.319598+0000","last_peered":"2023-12-12T09:45:38.319598+0000","last_clean":"2023-12-12T09:45:38.319598+0000","last_became_active":"2023-12-12T09:45:38.310897+0000","last_became_peered":"2023-12-12T09:45:38.310897+0000","last_unstale":"2023-12-12T09:45:38.319598+0000","last_undegraded":"2023-12-12T09:45:38.319598+0000","last_fullsized":"2023-12-12T09:45:38.319598+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:37.621350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:37.621350+0000","last_clean_scrub_stamp":"2023-12-12T09:45:37.621350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T14:07:55.779767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":12,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-12T09:45:39.286351+0000","last_change":"2023-12-12T09:45:37.666226+0000","last_active":"2023-12-12T09:45:39.286351+0000","last_peered":"2023-12-12T09:45:39.286351+0000","last_clean":"2023-12-12T09:45:39.286351+0000","last_became_active":"2023-12-12T09:45:37.665979+0000","last_became_peered":"2023-12-12T09:45:37.665979+0000","last_unstale":"2023-12-12T09:45:39.286351+0000","last_undegraded":"2023-12-12T09:45:39.286351+0000","last_fullsized":"2023-12-12T09:45:39.286351+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:36.607138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:36.607138+0000","last_clean_scrub_stamp":"2023-12-12T09:45:36.607138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T12:53:22.619743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":14,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-12-12T09:45:37.631136+0000","last_change":"2023-12-12T09:45:23.552576+0000","last_active":"2023-12-12T09:45:37.631136+0000","last_peered":"2023-12-12T09:45:37.631136+0000","last_clean":"2023-12-12T09:45:37.631136+0000","last_became_active":"2023-12-12T09:45:23.552159+0000","last_became_peered":"2023-12-12T09:45:23.552159+0000","last_unstale":"2023-12-12T09:45:37.631136+0000","last_undegraded":"2023-12-12T09:45:37.631136+0000","last_fullsized":"2023-12-12T09:45:37.631136+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_clean_scrub_stamp":"2023-12-12T09:45:22.493994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T14:20:09.952370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":16,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-12-12T09:45:38.285891+0000","last_change":"2023-12-12T09:45:22.529781+0000","last_active":"2023-12-12T09:45:38.285891+0000","last_peered":"2023-12-12T09:45:38.285891+0000","last_clean":"2023-12-12T09:45:38.285891+0000","last_became_active":"2023-12-12T09:45:22.529493+0000","last_became_peered":"2023-12-12T09:45:22.529493+0000","last_unstale":"2023-12-12T09:45:38.285891+0000","last_undegraded":"2023-12-12T09:45:38.285891+0000","last_fullsized":"2023-12-12T09:45:38.285891+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:21.477323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:21.477323+0000","last_clean_scrub_stamp":"2023-12-12T09:45:21.477323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T19:01:49.506238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-12-12T09:45:38.323609+0000","last_change":"2023-12-12T09:45:38.319105+0000","last_active":"2023-12-12T09:45:38.323609+0000","last_peered":"2023-12-12T09:45:38.323609+0000","last_clean":"2023-12-12T09:45:38.323609+0000","last_became_active":"2023-12-12T09:45:38.317288+0000","last_became_peered":"2023-12-12T09:45:38.317288+0000","last_unstale":"2023-12-12T09:45:38.323609+0000","last_undegraded":"2023-12-12T09:45:38.323609+0000","last_fullsized":"2023-12-12T09:45:38.323609+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:37.621350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:37.621350+0000","last_clean_scrub_stamp":"2023-12-12T09:45:37.621350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T17:37:12.684365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":12,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-12T09:45:39.285805+0000","last_change":"2023-12-12T09:45:37.654514+0000","last_active":"2023-12-12T09:45:39.285805+0000","last_peered":"2023-12-12T09:45:39.285805+0000","last_clean":"2023-12-12T09:45:39.285805+0000","last_became_active":"2023-12-12T09:45:37.654053+0000","last_became_peered":"2023-12-12T09:45:37.654053+0000","last_unstale":"2023-12-12T09:45:39.285805+0000","last_undegraded":"2023-12-12T09:45:39.285805+0000","last_fullsized":"2023-12-12T09:45:39.285805+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:36.607138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:36.607138+0000","last_clean_scrub_stamp":"2023-12-12T09:45:36.607138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T20:52:59.457996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":15,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-12-12T09:45:38.292855+0000","last_change":"2023-12-12T09:45:23.528110+0000","last_active":"2023-12-12T09:45:38.292855+0000","last_peered":"2023-12-12T09:45:38.292855+0000","last_clean":"2023-12-12T09:45:38.292855+0000","last_became_active":"2023-12-12T09:45:23.527594+0000","last_became_peered":"2023-12-12T09:45:23.527594+0000","last_unstale":"2023-12-12T09:45:38.292855+0000","last_undegraded":"2023-12-12T09:45:38.292855+0000","last_fullsized":"2023-12-12T09:45:38.292855+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_clean_scrub_stamp":"2023-12-12T09:45:22.493994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T12:04:22.521885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"53'2","reported_seq":17,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-12-12T09:45:37.645143+0000","last_change":"2023-12-12T09:45:22.530462+0000","last_active":"2023-12-12T09:45:37.645143+0000","last_peered":"2023-12-12T09:45:37.645143+0000","last_clean":"2023-12-12T09:45:37.645143+0000","last_became_active":"2023-12-12T09:45:22.529388+0000","last_became_peered":"2023-12-12T09:45:22.529388+0000","last_unstale":"2023-12-12T09:45:37.645143+0000","last_undegraded":"2023-12-12T09:45:37.645143+0000","last_fullsized":"2023-12-12T09:45:37.645143+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:21.477323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:21.477323+0000","last_clean_scrub_stamp":"2023-12-12T09:45:21.477323+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T13:28:37.770730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-12-12T09:45:38.323402+0000","last_change":"2023-12-12T09:45:38.318773+0000","last_active":"2023-12-12T09:45:38.323402+0000","last_peered":"2023-12-12T09:45:38.323402+0000","last_clean":"2023-12-12T09:45:38.323402+0000","last_became_active":"2023-12-12T09:45:38.318464+0000","last_became_peered":"2023-12-12T09:45:38.318464+0000","last_unstale":"2023-12-12T09:45:38.323402+0000","last_undegraded":"2023-12-12T09:45:38.323402+0000","last_fullsized":"2023-12-12T09:45:38.323402+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:37.621350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:37.621350+0000","last_clean_scrub_stamp":"2023-12-12T09:45:37.621350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T09:57:22.254000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":11,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-12-12T09:45:38.302326+0000","last_change":"2023-12-12T09:45:37.648973+0000","last_active":"2023-12-12T09:45:38.302326+0000","last_peered":"2023-12-12T09:45:38.302326+0000","last_clean":"2023-12-12T09:45:38.302326+0000","last_became_active":"2023-12-12T09:45:37.648708+0000","last_became_peered":"2023-12-12T09:45:37.648708+0000","last_unstale":"2023-12-12T09:45:38.302326+0000","last_undegraded":"2023-12-12T09:45:38.302326+0000","last_fullsized":"2023-12-12T09:45:38.302326+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:36.607138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:36.607138+0000","last_clean_scrub_stamp":"2023-12-12T09:45:36.607138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T18:35:35.438556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":15,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-12-12T09:45:38.283984+0000","last_change":"2023-12-12T09:45:23.552672+0000","last_active":"2023-12-12T09:45:38.283984+0000","last_peered":"2023-12-12T09:45:38.283984+0000","last_clean":"2023-12-12T09:45:38.283984+0000","last_became_active":"2023-12-12T09:45:23.548550+0000","last_became_peered":"2023-12-12T09:45:23.548550+0000","last_unstale":"2023-12-12T09:45:38.283984+0000","last_undegraded":"2023-12-12T09:45:38.283984+0000","last_fullsized":"2023-12-12T09:45:38.283984+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_clean_scrub_stamp":"2023-12-12T09:45:22.493994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T12:53:08.506599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"54'1","reported_seq":16,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-12-12T09:45:37.633546+0000","last_change":"2023-12-12T09:45:22.532022+0000","last_active":"2023-12-12T09:45:37.633546+0000","last_peered":"2023-12-12T09:45:37.633546+0000","last_clean":"2023-12-12T09:45:37.633546+0000","last_became_active":"2023-12-12T09:45:22.530250+0000","last_became_peered":"2023-12-12T09:45:22.530250+0000","last_unstale":"2023-12-12T09:45:37.633546+0000","last_undegraded":"2023-12-12T09:45:37.633546+0000","last_fullsized":"2023-12-12T09:45:37.633546+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:21.477323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:21.477323+0000","last_clean_scrub_stamp":"2023-12-12T09:45:21.477323+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T17:31:23.246712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-12-12T09:45:38.315907+0000","last_change":"2023-12-12T09:45:38.313146+0000","last_active":"2023-12-12T09:45:38.315907+0000","last_peered":"2023-12-12T09:45:38.315907+0000","last_clean":"2023-12-12T09:45:38.315907+0000","last_became_active":"2023-12-12T09:45:38.312814+0000","last_became_peered":"2023-12-12T09:45:38.312814+0000","last_unstale":"2023-12-12T09:45:38.315907+0000","last_undegraded":"2023-12-12T09:45:38.315907+0000","last_fullsized":"2023-12-12T09:45:38.315907+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:37.621350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:37.621350+0000","last_clean_scrub_stamp":"2023-12-12T09:45:37.621350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T21:33:57.012215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"57'2","reported_seq":14,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-12T09:45:39.286987+0000","last_change":"2023-12-12T09:45:37.667700+0000","last_active":"2023-12-12T09:45:39.286987+0000","last_peered":"2023-12-12T09:45:39.286987+0000","last_clean":"2023-12-12T09:45:39.286987+0000","last_became_active":"2023-12-12T09:45:37.667098+0000","last_became_peered":"2023-12-12T09:45:37.667098+0000","last_unstale":"2023-12-12T09:45:39.286987+0000","last_undegraded":"2023-12-12T09:45:39.286987+0000","last_fullsized":"2023-12-12T09:45:39.286987+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:36.607138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:36.607138+0000","last_clean_scrub_stamp":"2023-12-12T09:45:36.607138+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T14:54:24.774522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":14,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-12-12T09:45:37.638804+0000","last_change":"2023-12-12T09:45:23.549497+0000","last_active":"2023-12-12T09:45:37.638804+0000","last_peered":"2023-12-12T09:45:37.638804+0000","last_clean":"2023-12-12T09:45:37.638804+0000","last_became_active":"2023-12-12T09:45:23.549188+0000","last_became_peered":"2023-12-12T09:45:23.549188+0000","last_unstale":"2023-12-12T09:45:37.638804+0000","last_undegraded":"2023-12-12T09:45:37.638804+0000","last_fullsized":"2023-12-12T09:45:37.638804+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_clean_scrub_stamp":"2023-12-12T09:45:22.493994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T16:23:30.104791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":16,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-12-12T09:45:38.298316+0000","last_change":"2023-12-12T09:45:22.532250+0000","last_active":"2023-12-12T09:45:38.298316+0000","last_peered":"2023-12-12T09:45:38.298316+0000","last_clean":"2023-12-12T09:45:38.298316+0000","last_became_active":"2023-12-12T09:45:22.531649+0000","last_became_peered":"2023-12-12T09:45:22.531649+0000","last_unstale":"2023-12-12T09:45:38.298316+0000","last_undegraded":"2023-12-12T09:45:38.298316+0000","last_fullsized":"2023-12-12T09:45:38.298316+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:21.477323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:21.477323+0000","last_clean_scrub_stamp":"2023-12-12T09:45:21.477323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T13:38:45.393988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":11,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-12T09:45:39.288337+0000","last_change":"2023-12-12T09:45:38.301240+0000","last_active":"2023-12-12T09:45:39.288337+0000","last_peered":"2023-12-12T09:45:39.288337+0000","last_clean":"2023-12-12T09:45:39.288337+0000","last_became_active":"2023-12-12T09:45:38.300891+0000","last_became_peered":"2023-12-12T09:45:38.300891+0000","last_unstale":"2023-12-12T09:45:39.288337+0000","last_undegraded":"2023-12-12T09:45:39.288337+0000","last_fullsized":"2023-12-12T09:45:39.288337+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:37.621350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:37.621350+0000","last_clean_scrub_stamp":"2023-12-12T09:45:37.621350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T17:21:28.739394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":12,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-12T09:45:39.289351+0000","last_change":"2023-12-12T09:45:37.655215+0000","last_active":"2023-12-12T09:45:39.289351+0000","last_peered":"2023-12-12T09:45:39.289351+0000","last_clean":"2023-12-12T09:45:39.289351+0000","last_became_active":"2023-12-12T09:45:37.653537+0000","last_became_peered":"2023-12-12T09:45:37.653537+0000","last_unstale":"2023-12-12T09:45:39.289351+0000","last_undegraded":"2023-12-12T09:45:39.289351+0000","last_fullsized":"2023-12-12T09:45:39.289351+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:36.607138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:36.607138+0000","last_clean_scrub_stamp":"2023-12-12T09:45:36.607138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T20:28:28.306068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":14,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-12-12T09:45:37.632485+0000","last_change":"2023-12-12T09:45:23.542523+0000","last_active":"2023-12-12T09:45:37.632485+0000","last_peered":"2023-12-12T09:45:37.632485+0000","last_clean":"2023-12-12T09:45:37.632485+0000","last_became_active":"2023-12-12T09:45:23.541977+0000","last_became_peered":"2023-12-12T09:45:23.541977+0000","last_unstale":"2023-12-12T09:45:37.632485+0000","last_undegraded":"2023-12-12T09:45:37.632485+0000","last_fullsized":"2023-12-12T09:45:37.632485+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_clean_scrub_stamp":"2023-12-12T09:45:22.493994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T18:41:29.720316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":16,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-12-12T09:45:38.284400+0000","last_change":"2023-12-12T09:45:22.545221+0000","last_active":"2023-12-12T09:45:38.284400+0000","last_peered":"2023-12-12T09:45:38.284400+0000","last_clean":"2023-12-12T09:45:38.284400+0000","last_became_active":"2023-12-12T09:45:22.544683+0000","last_became_peered":"2023-12-12T09:45:22.544683+0000","last_unstale":"2023-12-12T09:45:38.284400+0000","last_undegraded":"2023-12-12T09:45:38.284400+0000","last_fullsized":"2023-12-12T09:45:38.284400+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:21.477323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:21.477323+0000","last_clean_scrub_stamp":"2023-12-12T09:45:21.477323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T21:23:16.895410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-12-12T09:45:38.319227+0000","last_change":"2023-12-12T09:45:38.313874+0000","last_active":"2023-12-12T09:45:38.319227+0000","last_peered":"2023-12-12T09:45:38.319227+0000","last_clean":"2023-12-12T09:45:38.319227+0000","last_became_active":"2023-12-12T09:45:38.313578+0000","last_became_peered":"2023-12-12T09:45:38.313578+0000","last_unstale":"2023-12-12T09:45:38.319227+0000","last_undegraded":"2023-12-12T09:45:38.319227+0000","last_fullsized":"2023-12-12T09:45:38.319227+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:37.621350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:37.621350+0000","last_clean_scrub_stamp":"2023-12-12T09:45:37.621350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T16:09:10.473605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":11,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-12-12T09:45:38.290229+0000","last_change":"2023-12-12T09:45:37.668606+0000","last_active":"2023-12-12T09:45:38.290229+0000","last_peered":"2023-12-12T09:45:38.290229+0000","last_clean":"2023-12-12T09:45:38.290229+0000","last_became_active":"2023-12-12T09:45:37.668341+0000","last_became_peered":"2023-12-12T09:45:37.668341+0000","last_unstale":"2023-12-12T09:45:38.290229+0000","last_undegraded":"2023-12-12T09:45:38.290229+0000","last_fullsized":"2023-12-12T09:45:38.290229+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:36.607138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:36.607138+0000","last_clean_scrub_stamp":"2023-12-12T09:45:36.607138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T14:54:24.774522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":14,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-12-12T09:45:37.652407+0000","last_change":"2023-12-12T09:45:23.544018+0000","last_active":"2023-12-12T09:45:37.652407+0000","last_peered":"2023-12-12T09:45:37.652407+0000","last_clean":"2023-12-12T09:45:37.652407+0000","last_became_active":"2023-12-12T09:45:23.543769+0000","last_became_peered":"2023-12-12T09:45:23.543769+0000","last_unstale":"2023-12-12T09:45:37.652407+0000","last_undegraded":"2023-12-12T09:45:37.652407+0000","last_fullsized":"2023-12-12T09:45:37.652407+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_clean_scrub_stamp":"2023-12-12T09:45:22.493994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T18:35:21.325412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":15,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-12-12T09:45:37.637976+0000","last_change":"2023-12-12T09:45:22.536839+0000","last_active":"2023-12-12T09:45:37.637976+0000","last_peered":"2023-12-12T09:45:37.637976+0000","last_clean":"2023-12-12T09:45:37.637976+0000","last_became_active":"2023-12-12T09:45:22.536573+0000","last_became_peered":"2023-12-12T09:45:22.536573+0000","last_unstale":"2023-12-12T09:45:37.637976+0000","last_undegraded":"2023-12-12T09:45:37.637976+0000","last_fullsized":"2023-12-12T09:45:37.637976+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:21.477323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:21.477323+0000","last_clean_scrub_stamp":"2023-12-12T09:45:21.477323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T15:17:10.229273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":11,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-12T09:45:39.285342+0000","last_change":"2023-12-12T09:45:38.310680+0000","last_active":"2023-12-12T09:45:39.285342+0000","last_peered":"2023-12-12T09:45:39.285342+0000","last_clean":"2023-12-12T09:45:39.285342+0000","last_became_active":"2023-12-12T09:45:38.310377+0000","last_became_peered":"2023-12-12T09:45:38.310377+0000","last_unstale":"2023-12-12T09:45:39.285342+0000","last_undegraded":"2023-12-12T09:45:39.285342+0000","last_fullsized":"2023-12-12T09:45:39.285342+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:37.621350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:37.621350+0000","last_clean_scrub_stamp":"2023-12-12T09:45:37.621350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T17:37:12.684365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":12,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-12T09:45:39.285234+0000","last_change":"2023-12-12T09:45:37.664691+0000","last_active":"2023-12-12T09:45:39.285234+0000","last_peered":"2023-12-12T09:45:39.285234+0000","last_clean":"2023-12-12T09:45:39.285234+0000","last_became_active":"2023-12-12T09:45:37.664220+0000","last_became_peered":"2023-12-12T09:45:37.664220+0000","last_unstale":"2023-12-12T09:45:39.285234+0000","last_undegraded":"2023-12-12T09:45:39.285234+0000","last_fullsized":"2023-12-12T09:45:39.285234+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:36.607138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:36.607138+0000","last_clean_scrub_stamp":"2023-12-12T09:45:36.607138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T13:19:31.104920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":14,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-12-12T09:45:37.666528+0000","last_change":"2023-12-12T09:45:23.549992+0000","last_active":"2023-12-12T09:45:37.666528+0000","last_peered":"2023-12-12T09:45:37.666528+0000","last_clean":"2023-12-12T09:45:37.666528+0000","last_became_active":"2023-12-12T09:45:23.549317+0000","last_became_peered":"2023-12-12T09:45:23.549317+0000","last_unstale":"2023-12-12T09:45:37.666528+0000","last_undegraded":"2023-12-12T09:45:37.666528+0000","last_fullsized":"2023-12-12T09:45:37.666528+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_clean_scrub_stamp":"2023-12-12T09:45:22.493994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T17:51:26.545637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":15,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-12-12T09:45:37.649640+0000","last_change":"2023-12-12T09:45:22.540030+0000","last_active":"2023-12-12T09:45:37.649640+0000","last_peered":"2023-12-12T09:45:37.649640+0000","last_clean":"2023-12-12T09:45:37.649640+0000","last_became_active":"2023-12-12T09:45:22.539590+0000","last_became_peered":"2023-12-12T09:45:22.539590+0000","last_unstale":"2023-12-12T09:45:37.649640+0000","last_undegraded":"2023-12-12T09:45:37.649640+0000","last_fullsized":"2023-12-12T09:45:37.649640+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:21.477323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:21.477323+0000","last_clean_scrub_stamp":"2023-12-12T09:45:21.477323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T15:15:37.432050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":11,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-12T09:45:39.285361+0000","last_change":"2023-12-12T09:45:38.318052+0000","last_active":"2023-12-12T09:45:39.285361+0000","last_peered":"2023-12-12T09:45:39.285361+0000","last_clean":"2023-12-12T09:45:39.285361+0000","last_became_active":"2023-12-12T09:45:38.317612+0000","last_became_peered":"2023-12-12T09:45:38.317612+0000","last_unstale":"2023-12-12T09:45:39.285361+0000","last_undegraded":"2023-12-12T09:45:39.285361+0000","last_fullsized":"2023-12-12T09:45:39.285361+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:37.621350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:37.621350+0000","last_clean_scrub_stamp":"2023-12-12T09:45:37.621350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T16:23:45.232148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":12,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-12T09:45:39.284622+0000","last_change":"2023-12-12T09:45:37.658418+0000","last_active":"2023-12-12T09:45:39.284622+0000","last_peered":"2023-12-12T09:45:39.284622+0000","last_clean":"2023-12-12T09:45:39.284622+0000","last_became_active":"2023-12-12T09:45:37.658122+0000","last_became_peered":"2023-12-12T09:45:37.658122+0000","last_unstale":"2023-12-12T09:45:39.284622+0000","last_undegraded":"2023-12-12T09:45:39.284622+0000","last_fullsized":"2023-12-12T09:45:39.284622+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:36.607138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:36.607138+0000","last_clean_scrub_stamp":"2023-12-12T09:45:36.607138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T14:30:50.219149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":14,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-12-12T09:45:37.637149+0000","last_change":"2023-12-12T09:45:23.545375+0000","last_active":"2023-12-12T09:45:37.637149+0000","last_peered":"2023-12-12T09:45:37.637149+0000","last_clean":"2023-12-12T09:45:37.637149+0000","last_became_active":"2023-12-12T09:45:23.544964+0000","last_became_peered":"2023-12-12T09:45:23.544964+0000","last_unstale":"2023-12-12T09:45:37.637149+0000","last_undegraded":"2023-12-12T09:45:37.637149+0000","last_fullsized":"2023-12-12T09:45:37.637149+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_clean_scrub_stamp":"2023-12-12T09:45:22.493994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T16:38:01.059734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":15,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-12-12T09:45:37.637510+0000","last_change":"2023-12-12T09:45:22.517716+0000","last_active":"2023-12-12T09:45:37.637510+0000","last_peered":"2023-12-12T09:45:37.637510+0000","last_clean":"2023-12-12T09:45:37.637510+0000","last_became_active":"2023-12-12T09:45:22.517234+0000","last_became_peered":"2023-12-12T09:45:22.517234+0000","last_unstale":"2023-12-12T09:45:37.637510+0000","last_undegraded":"2023-12-12T09:45:37.637510+0000","last_fullsized":"2023-12-12T09:45:37.637510+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:21.477323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:21.477323+0000","last_clean_scrub_stamp":"2023-12-12T09:45:21.477323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T13:38:45.393988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":11,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-12T09:45:39.287408+0000","last_change":"2023-12-12T09:45:38.316266+0000","last_active":"2023-12-12T09:45:39.287408+0000","last_peered":"2023-12-12T09:45:39.287408+0000","last_clean":"2023-12-12T09:45:39.287408+0000","last_became_active":"2023-12-12T09:45:38.315976+0000","last_became_peered":"2023-12-12T09:45:38.315976+0000","last_unstale":"2023-12-12T09:45:39.287408+0000","last_undegraded":"2023-12-12T09:45:39.287408+0000","last_fullsized":"2023-12-12T09:45:39.287408+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:37.621350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:37.621350+0000","last_clean_scrub_stamp":"2023-12-12T09:45:37.621350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T12:01:01.058805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":11,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-12-12T09:45:38.281453+0000","last_change":"2023-12-12T09:45:37.659553+0000","last_active":"2023-12-12T09:45:38.281453+0000","last_peered":"2023-12-12T09:45:38.281453+0000","last_clean":"2023-12-12T09:45:38.281453+0000","last_became_active":"2023-12-12T09:45:37.659282+0000","last_became_peered":"2023-12-12T09:45:37.659282+0000","last_unstale":"2023-12-12T09:45:38.281453+0000","last_undegraded":"2023-12-12T09:45:38.281453+0000","last_fullsized":"2023-12-12T09:45:38.281453+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:36.607138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:36.607138+0000","last_clean_scrub_stamp":"2023-12-12T09:45:36.607138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T17:31:38.376527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":14,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-12-12T09:45:37.651455+0000","last_change":"2023-12-12T09:45:23.538139+0000","last_active":"2023-12-12T09:45:37.651455+0000","last_peered":"2023-12-12T09:45:37.651455+0000","last_clean":"2023-12-12T09:45:37.651455+0000","last_became_active":"2023-12-12T09:45:23.537879+0000","last_became_peered":"2023-12-12T09:45:23.537879+0000","last_unstale":"2023-12-12T09:45:37.651455+0000","last_undegraded":"2023-12-12T09:45:37.651455+0000","last_fullsized":"2023-12-12T09:45:37.651455+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_clean_scrub_stamp":"2023-12-12T09:45:22.493994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T13:18:58.462988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":15,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-12-12T09:45:37.646732+0000","last_change":"2023-12-12T09:45:22.533709+0000","last_active":"2023-12-12T09:45:37.646732+0000","last_peered":"2023-12-12T09:45:37.646732+0000","last_clean":"2023-12-12T09:45:37.646732+0000","last_became_active":"2023-12-12T09:45:22.533228+0000","last_became_peered":"2023-12-12T09:45:22.533228+0000","last_unstale":"2023-12-12T09:45:37.646732+0000","last_undegraded":"2023-12-12T09:45:37.646732+0000","last_fullsized":"2023-12-12T09:45:37.646732+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:21.477323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:21.477323+0000","last_clean_scrub_stamp":"2023-12-12T09:45:21.477323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T14:11:53.124266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-12-12T09:45:38.325293+0000","last_change":"2023-12-12T09:45:38.318238+0000","last_active":"2023-12-12T09:45:38.325293+0000","last_peered":"2023-12-12T09:45:38.325293+0000","last_clean":"2023-12-12T09:45:38.325293+0000","last_became_active":"2023-12-12T09:45:38.317917+0000","last_became_peered":"2023-12-12T09:45:38.317917+0000","last_unstale":"2023-12-12T09:45:38.325293+0000","last_undegraded":"2023-12-12T09:45:38.325293+0000","last_fullsized":"2023-12-12T09:45:38.325293+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:37.621350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:37.621350+0000","last_clean_scrub_stamp":"2023-12-12T09:45:37.621350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T10:47:19.765504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.b","version":"57'2","reported_seq":14,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-12T09:45:39.286355+0000","last_change":"2023-12-12T09:45:37.665023+0000","last_active":"2023-12-12T09:45:39.286355+0000","last_peered":"2023-12-12T09:45:39.286355+0000","last_clean":"2023-12-12T09:45:39.286355+0000","last_became_active":"2023-12-12T09:45:37.664419+0000","last_became_peered":"2023-12-12T09:45:37.664419+0000","last_unstale":"2023-12-12T09:45:39.286355+0000","last_undegraded":"2023-12-12T09:45:39.286355+0000","last_fullsized":"2023-12-12T09:45:39.286355+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:36.607138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:36.607138+0000","last_clean_scrub_stamp":"2023-12-12T09:45:36.607138+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T16:09:09.459392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":14,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-12-12T09:45:37.646214+0000","last_change":"2023-12-12T09:45:23.551562+0000","last_active":"2023-12-12T09:45:37.646214+0000","last_peered":"2023-12-12T09:45:37.646214+0000","last_clean":"2023-12-12T09:45:37.646214+0000","last_became_active":"2023-12-12T09:45:23.551292+0000","last_became_peered":"2023-12-12T09:45:23.551292+0000","last_unstale":"2023-12-12T09:45:37.646214+0000","last_undegraded":"2023-12-12T09:45:37.646214+0000","last_fullsized":"2023-12-12T09:45:37.646214+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_clean_scrub_stamp":"2023-12-12T09:45:22.493994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T12:23:37.747726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":16,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-12-12T09:45:38.294433+0000","last_change":"2023-12-12T09:45:22.537353+0000","last_active":"2023-12-12T09:45:38.294433+0000","last_peered":"2023-12-12T09:45:38.294433+0000","last_clean":"2023-12-12T09:45:38.294433+0000","last_became_active":"2023-12-12T09:45:22.536855+0000","last_became_peered":"2023-12-12T09:45:22.536855+0000","last_unstale":"2023-12-12T09:45:38.294433+0000","last_undegraded":"2023-12-12T09:45:38.294433+0000","last_fullsized":"2023-12-12T09:45:38.294433+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:21.477323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:21.477323+0000","last_clean_scrub_stamp":"2023-12-12T09:45:21.477323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T15:17:10.229273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":197,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-12-12T09:45:37.664896+0000","last_change":"2023-12-12T09:43:17.203315+0000","last_active":"2023-12-12T09:45:37.664896+0000","last_peered":"2023-12-12T09:45:37.664896+0000","last_clean":"2023-12-12T09:45:37.664896+0000","last_became_active":"2023-12-12T09:43:17.200779+0000","last_became_peered":"2023-12-12T09:43:17.200779+0000","last_unstale":"2023-12-12T09:45:37.664896+0000","last_undegraded":"2023-12-12T09:45:37.664896+0000","last_fullsized":"2023-12-12T09:45:37.664896+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:43:15.931922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:43:15.931922+0000","last_clean_scrub_stamp":"2023-12-12T09:43:15.931922+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T21:42:10.929640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":3905,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":7810,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":64844,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574881,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31936,"kb_used_data":748,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339904,"statfs":{"total":96636764160,"available":96604061696,"internally_reserved":0,"allocated":765952,"data_stored":888104,"data_compressed":32422,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 12 09:45:16 2023","interfaces":[{"interface":"back","average":{"1min":1.0700000000000001,"5min":1.0129999999999999,"15min":1.0029999999999999},"min":{"1min":0.64800000000000002,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.607,"5min":1.8089999999999999,"15min":1.8089999999999999},"last":1.052},{"interface":"front","average":{"1min":1.135,"5min":0.99399999999999999,"15min":0.96999999999999997},"min":{"1min":0.72099999999999997,"5min":0.66300000000000003,"15min":0.66300000000000003},"max":{"1min":1.619,"5min":1.619,"15min":1.619},"last":0.98499999999999999}]},{"osd":1,"last update":"Tue Dec 12 09:45:16 2023","interfaces":[{"interface":"back","average":{"1min":1.149,"5min":1.1879999999999999,"15min":1.194},"min":{"1min":0.83799999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"max":{"1min":1.5629999999999999,"5min":1.7729999999999999,"15min":1.7729999999999999},"last":1.7210000000000001},{"interface":"front","average":{"1min":1.1419999999999999,"5min":1.2010000000000001,"15min":1.2110000000000001},"min":{"1min":0.77000000000000002,"5min":0.71499999999999997,"15min":0.71499999999999997},"max":{"1min":1.542,"5min":3.1150000000000002,"15min":3.1150000000000002},"last":1.226}]},{"osd":2,"last update":"Tue Dec 12 09:45:16 2023","interfaces":[{"interface":"back","average":{"1min":1.1379999999999999,"5min":1.2370000000000001,"15min":1.2529999999999999},"min":{"1min":0.80100000000000005,"5min":0.77700000000000002,"15min":0.77700000000000002},"max":{"1min":1.5449999999999999,"5min":2.2050000000000001,"15min":2.2050000000000001},"last":0.91500000000000004},{"interface":"front","average":{"1min":1.141,"5min":1.224,"15min":1.238},"min":{"1min":0.81399999999999995,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.4890000000000001,"5min":3.2759999999999998,"15min":3.2759999999999998},"last":1.1739999999999999}]},{"osd":3,"last update":"Tue Dec 12 09:45:16 2023","interfaces":[{"interface":"back","average":{"1min":1.1930000000000001,"5min":1.292,"15min":1.3080000000000001},"min":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"max":{"1min":1.587,"5min":3.1819999999999999,"15min":3.1819999999999999},"last":1.2829999999999999},{"interface":"front","average":{"1min":1.2210000000000001,"5min":1.28,"15min":1.29},"min":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"max":{"1min":1.587,"5min":1.8740000000000001,"15min":1.8740000000000001},"last":1.845}]},{"osd":4,"last update":"Tue Dec 12 09:45:16 2023","interfaces":[{"interface":"back","average":{"1min":1.2450000000000001,"5min":1.3300000000000001,"15min":1.3440000000000001},"min":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.647,"5min":2.5529999999999999,"15min":2.5529999999999999},"last":1.371},{"interface":"front","average":{"1min":1.2290000000000001,"5min":1.409,"15min":1.4390000000000001},"min":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"max":{"1min":1.6319999999999999,"5min":2.351,"15min":2.351},"last":1.343}]},{"osd":5,"last update":"Tue Dec 12 09:45:16 2023","interfaces":[{"interface":"back","average":{"1min":1.294,"5min":1.3260000000000001,"15min":1.3320000000000001},"min":{"1min":1.0649999999999999,"5min":0.84499999999999997,"15min":0.84499999999999997},"max":{"1min":1.575,"5min":1.9610000000000001,"15min":1.9610000000000001},"last":1.917},{"interface":"front","average":{"1min":1.389,"5min":1.5069999999999999,"15min":1.5269999999999999},"min":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":1.6950000000000001,"5min":2.4159999999999999,"15min":2.4159999999999999},"last":1.45}]},{"osd":6,"last update":"Tue Dec 12 09:45:16 2023","interfaces":[{"interface":"back","average":{"1min":1.427,"5min":1.419,"15min":1.417},"min":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"max":{"1min":1.821,"5min":2.0510000000000002,"15min":2.0510000000000002},"last":1.966},{"interface":"front","average":{"1min":1.4850000000000001,"5min":1.605,"15min":1.625},"min":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"max":{"1min":1.821,"5min":2.5800000000000001,"15min":2.5800000000000001},"last":1.5509999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574879,"num_pgs":52,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27700,"kb_used_data":676,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344140,"statfs":{"total":96636764160,"available":96608399360,"internally_reserved":0,"allocated":692224,"data_stored":297052,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 12 09:45:15 2023","interfaces":[{"interface":"back","average":{"1min":0.96799999999999997,"5min":1.1479999999999999,"15min":1.1779999999999999},"min":{"1min":0.63200000000000001,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":1.597,"5min":3.6429999999999998,"15min":3.6429999999999998},"last":0.74399999999999999},{"interface":"front","average":{"1min":1.119,"5min":1.079,"15min":1.073},"min":{"1min":0.58499999999999996,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.871,"5min":2.6059999999999999,"15min":2.6059999999999999},"last":0.83099999999999996}]},{"osd":1,"last update":"Tue Dec 12 09:45:15 2023","interfaces":[{"interface":"back","average":{"1min":1.1639999999999999,"5min":1.0820000000000001,"15min":1.0680000000000001},"min":{"1min":0.80400000000000005,"5min":0.69499999999999995,"15min":0.69499999999999995},"max":{"1min":1.482,"5min":2.0169999999999999,"15min":2.0169999999999999},"last":0.78600000000000003},{"interface":"front","average":{"1min":1.1719999999999999,"5min":1.1950000000000001,"15min":1.1990000000000001},"min":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"max":{"1min":1.5700000000000001,"5min":1.7,"15min":1.7},"last":0.96099999999999997}]},{"osd":2,"last update":"Tue Dec 12 09:45:15 2023","interfaces":[{"interface":"back","average":{"1min":1.149,"5min":1.218,"15min":1.23},"min":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"max":{"1min":1.72,"5min":1.804,"15min":1.804},"last":1.0840000000000001},{"interface":"front","average":{"1min":1.1479999999999999,"5min":1.28,"15min":1.302},"min":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"max":{"1min":1.5840000000000001,"5min":2.2160000000000002,"15min":2.2160000000000002},"last":0.92700000000000005}]},{"osd":3,"last update":"Tue Dec 12 09:45:15 2023","interfaces":[{"interface":"back","average":{"1min":1.2090000000000001,"5min":1.216,"15min":1.2170000000000001},"min":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"max":{"1min":1.661,"5min":2.665,"15min":2.665},"last":0.71899999999999997},{"interface":"front","average":{"1min":1.111,"5min":1.2070000000000001,"15min":1.2230000000000001},"min":{"1min":0.72899999999999998,"5min":0.65700000000000003,"15min":0.65700000000000003},"max":{"1min":1.569,"5min":1.8620000000000001,"15min":1.8620000000000001},"last":1.0369999999999999}]},{"osd":4,"last update":"Tue Dec 12 09:45:15 2023","interfaces":[{"interface":"back","average":{"1min":1.276,"5min":1.2749999999999999,"15min":1.2749999999999999},"min":{"1min":0.66100000000000003,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":1.778,"5min":2.0310000000000001,"15min":2.0310000000000001},"last":1.2090000000000001},{"interface":"front","average":{"1min":1.3939999999999999,"5min":1.4039999999999999,"15min":1.4059999999999999},"min":{"1min":0.753,"5min":0.66200000000000003,"15min":0.66200000000000003},"max":{"1min":1.8149999999999999,"5min":2.2799999999999998,"15min":2.2799999999999998},"last":0.95199999999999996}]},{"osd":5,"last update":"Tue Dec 12 09:45:15 2023","interfaces":[{"interface":"back","average":{"1min":1.296,"5min":1.4119999999999999,"15min":1.431},"min":{"1min":0.68600000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.766,"5min":2.1739999999999999,"15min":2.1739999999999999},"last":1.3879999999999999},{"interface":"front","average":{"1min":1.4730000000000001,"5min":1.476,"15min":1.476},"min":{"1min":0.99399999999999999,"5min":0.80100000000000005,"15min":0.80100000000000005},"max":{"1min":1.909,"5min":1.929,"15min":1.929},"last":1.3}]},{"osd":7,"last update":"Tue Dec 12 09:45:15 2023","interfaces":[{"interface":"back","average":{"1min":1.4059999999999999,"5min":1.488,"15min":1.502},"min":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.6859999999999999,"5min":1.994,"15min":1.994},"last":1.343},{"interface":"front","average":{"1min":1.3779999999999999,"5min":1.506,"15min":1.528},"min":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"max":{"1min":1.839,"5min":2.0800000000000001,"15min":2.0800000000000001},"last":1.2450000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574879,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27704,"kb_used_data":680,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344136,"statfs":{"total":96636764160,"available":96608395264,"internally_reserved":0,"allocated":696320,"data_stored":297702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 12 09:45:16 2023","interfaces":[{"interface":"back","average":{"1min":1.022,"5min":1.02,"15min":1.02},"min":{"1min":0.65600000000000003,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.7310000000000001,"5min":1.7310000000000001,"15min":1.7310000000000001},"last":0.81899999999999995},{"interface":"front","average":{"1min":1.04,"5min":1.1120000000000001,"15min":1.1240000000000001},"min":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.595,"5min":1.595,"15min":1.595},"last":1.01}]},{"osd":1,"last update":"Tue Dec 12 09:45:16 2023","interfaces":[{"interface":"back","average":{"1min":1,"5min":1.1799999999999999,"15min":1.21},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.756,"5min":1.756,"15min":1.756},"last":0.877},{"interface":"front","average":{"1min":1.071,"5min":1.087,"15min":1.0900000000000001},"min":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"max":{"1min":1.5549999999999999,"5min":1.5840000000000001,"15min":1.5840000000000001},"last":1.2130000000000001}]},{"osd":2,"last update":"Tue Dec 12 09:45:16 2023","interfaces":[{"interface":"back","average":{"1min":1.1619999999999999,"5min":1.286,"15min":1.306},"min":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"max":{"1min":1.536,"5min":1.7889999999999999,"15min":1.7889999999999999},"last":1.107},{"interface":"front","average":{"1min":1.157,"5min":1.3680000000000001,"15min":1.403},"min":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"max":{"1min":1.5369999999999999,"5min":2.1600000000000001,"15min":2.1600000000000001},"last":1.149}]},{"osd":3,"last update":"Tue Dec 12 09:45:16 2023","interfaces":[{"interface":"back","average":{"1min":1.202,"5min":1.337,"15min":1.359},"min":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"max":{"1min":1.6950000000000001,"5min":2.1499999999999999,"15min":2.1499999999999999},"last":0.95899999999999996},{"interface":"front","average":{"1min":1.2390000000000001,"5min":1.4410000000000001,"15min":1.4750000000000001},"min":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"max":{"1min":1.6060000000000001,"5min":1.8939999999999999,"15min":1.8939999999999999},"last":1.3300000000000001}]},{"osd":4,"last update":"Tue Dec 12 09:45:16 2023","interfaces":[{"interface":"back","average":{"1min":1.3100000000000001,"5min":1.454,"15min":1.478},"min":{"1min":0.746,"5min":0.746,"15min":0.746},"max":{"1min":1.841,"5min":2.391,"15min":2.391},"last":1.075},{"interface":"front","average":{"1min":1.4470000000000001,"5min":1.5589999999999999,"15min":1.5780000000000001},"min":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"max":{"1min":1.958,"5min":2.5430000000000001,"15min":2.5430000000000001},"last":1.3660000000000001}]},{"osd":6,"last update":"Tue Dec 12 09:45:16 2023","interfaces":[{"interface":"back","average":{"1min":1.3320000000000001,"5min":1.5429999999999999,"15min":1.5780000000000001},"min":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.7230000000000001,"5min":2.0840000000000001,"15min":2.0840000000000001},"last":1.4430000000000001},{"interface":"front","average":{"1min":1.373,"5min":1.579,"15min":1.613},"min":{"1min":0.627,"5min":0.627,"15min":0.627},"max":{"1min":1.9970000000000001,"5min":2.306,"15min":2.306},"last":1.2649999999999999}]},{"osd":7,"last update":"Tue Dec 12 09:45:16 2023","interfaces":[{"interface":"back","average":{"1min":1.538,"5min":1.7350000000000001,"15min":1.768},"min":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"max":{"1min":2.2469999999999999,"5min":2.6880000000000002,"15min":2.6880000000000002},"last":1.5309999999999999},{"interface":"front","average":{"1min":1.4550000000000001,"5min":1.6890000000000001,"15min":1.728},"min":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"max":{"1min":1.8260000000000001,"5min":2.3410000000000002,"15min":2.3410000000000002},"last":1.621}]}]},{"osd":4,"up_from":13,"seq":55834574881,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27708,"kb_used_data":680,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344132,"statfs":{"total":96636764160,"available":96608391168,"internally_reserved":0,"allocated":696320,"data_stored":300067,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 12 09:45:15 2023","interfaces":[{"interface":"back","average":{"1min":1.0129999999999999,"5min":1.046,"15min":1.052},"min":{"1min":0.65100000000000002,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":1.7010000000000001,"5min":1.7010000000000001,"15min":1.7010000000000001},"last":1.5880000000000001},{"interface":"front","average":{"1min":0.98899999999999999,"5min":1.0409999999999999,"15min":1.05},"min":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":1.3080000000000001,"5min":1.492,"15min":1.492},"last":1.5449999999999999}]},{"osd":1,"last update":"Tue Dec 12 09:45:15 2023","interfaces":[{"interface":"back","average":{"1min":1.0580000000000001,"5min":1.046,"15min":1.044},"min":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":1.468,"5min":1.468,"15min":1.468},"last":0.97499999999999998},{"interface":"front","average":{"1min":1.143,"5min":1.173,"15min":1.1779999999999999},"min":{"1min":0.76600000000000001,"5min":0.73699999999999999,"15min":0.73699999999999999},"max":{"1min":1.599,"5min":1.8720000000000001,"15min":1.8720000000000001},"last":0.86599999999999999}]},{"osd":2,"last update":"Tue Dec 12 09:45:15 2023","interfaces":[{"interface":"back","average":{"1min":1.145,"5min":1.1240000000000001,"15min":1.1200000000000001},"min":{"1min":0.82699999999999996,"5min":0.71499999999999997,"15min":0.71499999999999997},"max":{"1min":1.4590000000000001,"5min":1.4590000000000001,"15min":1.4590000000000001},"last":1.4470000000000001},{"interface":"front","average":{"1min":1.238,"5min":1.282,"15min":1.29},"min":{"1min":0.76400000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"max":{"1min":1.675,"5min":2.1640000000000001,"15min":2.1640000000000001},"last":1.4019999999999999}]},{"osd":3,"last update":"Tue Dec 12 09:45:15 2023","interfaces":[{"interface":"back","average":{"1min":1.2569999999999999,"5min":1.2130000000000001,"15min":1.206},"min":{"1min":0.89700000000000002,"5min":0.83399999999999996,"15min":0.83399999999999996},"max":{"1min":1.52,"5min":1.635,"15min":1.635},"last":1.2030000000000001},{"interface":"front","average":{"1min":1.222,"5min":1.234,"15min":1.236},"min":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"max":{"1min":1.7290000000000001,"5min":2.0499999999999998,"15min":2.0499999999999998},"last":1.4930000000000001}]},{"osd":5,"last update":"Tue Dec 12 09:45:15 2023","interfaces":[{"interface":"back","average":{"1min":1.272,"5min":1.4279999999999999,"15min":1.454},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.794,"5min":2.3159999999999998,"15min":2.3159999999999998},"last":1.113},{"interface":"front","average":{"1min":1.361,"5min":1.3520000000000001,"15min":1.3500000000000001},"min":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"max":{"1min":1.978,"5min":2.117,"15min":2.117},"last":1.3360000000000001}]},{"osd":6,"last update":"Tue Dec 12 09:45:15 2023","interfaces":[{"interface":"back","average":{"1min":1.3180000000000001,"5min":1.3859999999999999,"15min":1.397},"min":{"1min":0.84999999999999998,"5min":0.81200000000000006,"15min":0.81200000000000006},"max":{"1min":1.927,"5min":2.246,"15min":2.246},"last":1.671},{"interface":"front","average":{"1min":1.4610000000000001,"5min":1.5309999999999999,"15min":1.5429999999999999},"min":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"max":{"1min":1.917,"5min":2.5099999999999998,"15min":2.5099999999999998},"last":1.6919999999999999}]},{"osd":7,"last update":"Tue Dec 12 09:45:15 2023","interfaces":[{"interface":"back","average":{"1min":1.4630000000000001,"5min":1.496,"15min":1.502},"min":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"max":{"1min":1.9830000000000001,"5min":2.5710000000000002,"15min":2.5710000000000002},"last":1.6319999999999999},{"interface":"front","average":{"1min":1.508,"5min":1.512,"15min":1.512},"min":{"1min":1.0900000000000001,"5min":1.0600000000000001,"15min":1.0600000000000001},"max":{"1min":2.1600000000000001,"5min":2.3919999999999999,"15min":2.3919999999999999},"last":1.7390000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574879,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31868,"kb_used_data":684,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339972,"statfs":{"total":96636764160,"available":96604131328,"internally_reserved":0,"allocated":700416,"data_stored":297128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 12 09:45:17 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.873,"15min":0.89900000000000002},"min":{"1min":0.318,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":1.1930000000000001,"5min":1.4830000000000001,"15min":1.4830000000000001},"last":0.88700000000000001},{"interface":"front","average":{"1min":0.71699999999999997,"5min":1.0529999999999999,"15min":1.109},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":1.2370000000000001,"5min":3.3370000000000002,"15min":3.3370000000000002},"last":1.2669999999999999}]},{"osd":1,"last update":"Tue Dec 12 09:45:17 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.88200000000000001,"15min":0.90700000000000003},"min":{"1min":0.48799999999999999,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":1.077,"5min":1.4610000000000001,"15min":1.4610000000000001},"last":1.0429999999999999},{"interface":"front","average":{"1min":0.84099999999999997,"5min":1.0229999999999999,"15min":1.0529999999999999},"min":{"1min":0.52700000000000002,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.6100000000000001,"5min":2.9409999999999998,"15min":2.9409999999999998},"last":1.2050000000000001}]},{"osd":2,"last update":"Tue Dec 12 09:45:17 2023","interfaces":[{"interface":"back","average":{"1min":0.874,"5min":1.1240000000000001,"15min":1.1659999999999999},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.5680000000000001,"5min":2.613,"15min":2.613},"last":1.1830000000000001},{"interface":"front","average":{"1min":0.89800000000000002,"5min":1.127,"15min":1.165},"min":{"1min":0.47199999999999998,"5min":0.437,"15min":0.437},"max":{"1min":1.4390000000000001,"5min":3.0430000000000001,"15min":3.0430000000000001},"last":1.3420000000000001}]},{"osd":4,"last update":"Tue Dec 12 09:45:17 2023","interfaces":[{"interface":"back","average":{"1min":1.2190000000000001,"5min":1.3500000000000001,"15min":1.3720000000000001},"min":{"1min":0.73399999999999999,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.851,"5min":3.5019999999999998,"15min":3.5019999999999998},"last":1.151},{"interface":"front","average":{"1min":1.1439999999999999,"5min":1.415,"15min":1.46},"min":{"1min":0.755,"5min":0.755,"15min":0.755},"max":{"1min":1.593,"5min":2.9889999999999999,"15min":2.9889999999999999},"last":1.415}]},{"osd":5,"last update":"Tue Dec 12 09:45:17 2023","interfaces":[{"interface":"back","average":{"1min":1.254,"5min":1.45,"15min":1.4830000000000001},"min":{"1min":0.73599999999999999,"5min":0.68000000000000005,"15min":0.68000000000000005},"max":{"1min":1.589,"5min":4.2480000000000002,"15min":4.2480000000000002},"last":1.476},{"interface":"front","average":{"1min":1.2090000000000001,"5min":1.5149999999999999,"15min":1.5660000000000001},"min":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"max":{"1min":1.7,"5min":5.5060000000000002,"15min":5.5060000000000002},"last":1.3799999999999999}]},{"osd":6,"last update":"Tue Dec 12 09:45:17 2023","interfaces":[{"interface":"back","average":{"1min":1.1240000000000001,"5min":1.391,"15min":1.4350000000000001},"min":{"1min":0.79100000000000004,"5min":0.76500000000000001,"15min":0.76500000000000001},"max":{"1min":1.472,"5min":3.1400000000000001,"15min":3.1400000000000001},"last":1.2390000000000001},{"interface":"front","average":{"1min":1.288,"5min":1.4950000000000001,"15min":1.5289999999999999},"min":{"1min":0.70099999999999996,"5min":0.627,"15min":0.627},"max":{"1min":1.694,"5min":4.3179999999999996,"15min":4.3179999999999996},"last":1.665}]},{"osd":7,"last update":"Tue Dec 12 09:45:17 2023","interfaces":[{"interface":"back","average":{"1min":1.236,"5min":1.52,"15min":1.5680000000000001},"min":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"max":{"1min":1.6759999999999999,"5min":5.3979999999999997,"15min":5.3979999999999997},"last":1.4450000000000001},{"interface":"front","average":{"1min":1.228,"5min":1.488,"15min":1.532},"min":{"1min":0.75800000000000001,"5min":0.74299999999999999,"15min":0.74299999999999999},"max":{"1min":1.663,"5min":3.4129999999999998,"15min":3.4129999999999998},"last":1.526}]}]},{"osd":2,"up_from":13,"seq":55834574879,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27700,"kb_used_data":676,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344140,"statfs":{"total":96636764160,"available":96608399360,"internally_reserved":0,"allocated":692224,"data_stored":297016,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 12 09:45:16 2023","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.81000000000000005,"15min":0.81599999999999995},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":1.212,"5min":1.458,"15min":1.458},"last":1.036},{"interface":"front","average":{"1min":0.84899999999999998,"5min":0.90000000000000002,"15min":0.90800000000000003},"min":{"1min":0.36199999999999999,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":1.623,"5min":1.623,"15min":1.623},"last":0.94699999999999995}]},{"osd":1,"last update":"Tue Dec 12 09:45:16 2023","interfaces":[{"interface":"back","average":{"1min":0.82999999999999996,"5min":0.85699999999999998,"15min":0.86099999999999999},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":1.375,"5min":1.593,"15min":1.593},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.84099999999999997,"5min":0.877,"15min":0.88300000000000001},"min":{"1min":0.46999999999999997,"5min":0.443,"15min":0.443},"max":{"1min":1.4330000000000001,"5min":1.758,"15min":1.758},"last":1.077}]},{"osd":3,"last update":"Tue Dec 12 09:45:16 2023","interfaces":[{"interface":"back","average":{"1min":0.93999999999999995,"5min":1.0329999999999999,"15min":1.0489999999999999},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.343,"5min":1.8879999999999999,"15min":1.8879999999999999},"last":0.85299999999999998},{"interface":"front","average":{"1min":0.86599999999999999,"5min":0.97999999999999998,"15min":0.999},"min":{"1min":0.46000000000000002,"5min":0.432,"15min":0.432},"max":{"1min":1.4419999999999999,"5min":1.8120000000000001,"15min":1.8120000000000001},"last":0.89700000000000002}]},{"osd":4,"last update":"Tue Dec 12 09:45:16 2023","interfaces":[{"interface":"back","average":{"1min":1.141,"5min":1.2090000000000001,"15min":1.2210000000000001},"min":{"1min":0.69599999999999995,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.3859999999999999,"5min":2.5760000000000001,"15min":2.5760000000000001},"last":1.1020000000000001},{"interface":"front","average":{"1min":1.1870000000000001,"5min":1.3520000000000001,"15min":1.3799999999999999},"min":{"1min":0.79400000000000004,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":2.04,"5min":2.8069999999999999,"15min":2.8069999999999999},"last":1.2549999999999999}]},{"osd":5,"last update":"Tue Dec 12 09:45:16 2023","interfaces":[{"interface":"back","average":{"1min":1.3260000000000001,"5min":1.3680000000000001,"15min":1.375},"min":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"max":{"1min":1.764,"5min":2.3109999999999999,"15min":2.3109999999999999},"last":1.1719999999999999},{"interface":"front","average":{"1min":1.196,"5min":1.3200000000000001,"15min":1.3400000000000001},"min":{"1min":0.79400000000000004,"5min":0.627,"15min":0.627},"max":{"1min":1.546,"5min":2.5110000000000001,"15min":2.5110000000000001},"last":1.2110000000000001}]},{"osd":6,"last update":"Tue Dec 12 09:45:16 2023","interfaces":[{"interface":"back","average":{"1min":1.329,"5min":1.415,"15min":1.429},"min":{"1min":0.82499999999999996,"5min":0.69599999999999995,"15min":0.69599999999999995},"max":{"1min":2.6139999999999999,"5min":2.907,"15min":2.907},"last":1.3169999999999999},{"interface":"front","average":{"1min":1.403,"5min":1.423,"15min":1.427},"min":{"1min":0.85099999999999998,"5min":0.82799999999999996,"15min":0.82799999999999996},"max":{"1min":2.6000000000000001,"5min":2.6000000000000001,"15min":2.6000000000000001},"last":1.2909999999999999}]},{"osd":7,"last update":"Tue Dec 12 09:45:16 2023","interfaces":[{"interface":"back","average":{"1min":1.3049999999999999,"5min":1.4259999999999999,"15min":1.446},"min":{"1min":0.78500000000000003,"5min":0.71599999999999997,"15min":0.71599999999999997},"max":{"1min":2.1339999999999999,"5min":2.3370000000000002,"15min":2.3370000000000002},"last":1.3640000000000001},{"interface":"front","average":{"1min":1.4159999999999999,"5min":1.4930000000000001,"15min":1.506},"min":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"max":{"1min":1.915,"5min":2.488,"15min":2.488},"last":1.1140000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574879,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27716,"kb_used_data":692,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344124,"statfs":{"total":96636764160,"available":96608382976,"internally_reserved":0,"allocated":708608,"data_stored":299278,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 12 09:45:16 2023","interfaces":[{"interface":"back","average":{"1min":0.79400000000000004,"5min":0.84299999999999997,"15min":0.85099999999999998},"min":{"1min":0.50800000000000001,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":1.319,"5min":2.794,"15min":2.794},"last":1.427},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.84999999999999998,"15min":0.85999999999999999},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":1.167,"5min":2.1379999999999999,"15min":2.1379999999999999},"last":0.98999999999999999}]},{"osd":2,"last update":"Tue Dec 12 09:45:16 2023","interfaces":[{"interface":"back","average":{"1min":0.89200000000000002,"5min":0.96699999999999997,"15min":0.97899999999999998},"min":{"1min":0.437,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":1.5649999999999999,"5min":6.3390000000000004,"15min":6.3390000000000004},"last":0.78300000000000003},{"interface":"front","average":{"1min":0.94299999999999995,"5min":0.96199999999999997,"15min":0.96499999999999997},"min":{"1min":0.53200000000000003,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.5629999999999999,"5min":2.823,"15min":2.823},"last":0.91400000000000003}]},{"osd":3,"last update":"Tue Dec 12 09:45:16 2023","interfaces":[{"interface":"back","average":{"1min":1.0620000000000001,"5min":1.0529999999999999,"15min":1.0509999999999999},"min":{"1min":0.56699999999999995,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":1.6519999999999999,"5min":2.7519999999999998,"15min":2.7519999999999998},"last":1.0549999999999999},{"interface":"front","average":{"1min":1.018,"5min":1.01,"15min":1.008},"min":{"1min":0.55600000000000005,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":1.8640000000000001,"5min":2.2559999999999998,"15min":2.2559999999999998},"last":1.2}]},{"osd":4,"last update":"Tue Dec 12 09:45:16 2023","interfaces":[{"interface":"back","average":{"1min":1.1100000000000001,"5min":1.341,"15min":1.379},"min":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"max":{"1min":1.694,"5min":6.423,"15min":6.423},"last":1.379},{"interface":"front","average":{"1min":1.1899999999999999,"5min":1.1930000000000001,"15min":1.1930000000000001},"min":{"1min":0.80500000000000005,"5min":0.80000000000000004,"15min":0.80000000000000004},"max":{"1min":1.585,"5min":2.2309999999999999,"15min":2.2309999999999999},"last":1.474}]},{"osd":5,"last update":"Tue Dec 12 09:45:16 2023","interfaces":[{"interface":"back","average":{"1min":1.22,"5min":1.417,"15min":1.45},"min":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"max":{"1min":1.8220000000000001,"5min":6.2830000000000004,"15min":6.2830000000000004},"last":1.0309999999999999},{"interface":"front","average":{"1min":1.2729999999999999,"5min":1.3540000000000001,"15min":1.3680000000000001},"min":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"max":{"1min":1.7609999999999999,"5min":2.73,"15min":2.73},"last":1.347}]},{"osd":6,"last update":"Tue Dec 12 09:45:16 2023","interfaces":[{"interface":"back","average":{"1min":1.3180000000000001,"5min":1.5109999999999999,"15min":1.5429999999999999},"min":{"1min":0.751,"5min":0.751,"15min":0.751},"max":{"1min":2.1589999999999998,"5min":6.468,"15min":6.468},"last":1.1499999999999999},{"interface":"front","average":{"1min":1.2529999999999999,"5min":1.514,"15min":1.5580000000000001},"min":{"1min":0.85899999999999999,"5min":0.84699999999999998,"15min":0.84699999999999998},"max":{"1min":1.7949999999999999,"5min":6.3129999999999997,"15min":6.3129999999999997},"last":1.123}]},{"osd":7,"last update":"Tue Dec 12 09:45:16 2023","interfaces":[{"interface":"back","average":{"1min":1.333,"5min":1.3919999999999999,"15min":1.4019999999999999},"min":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"max":{"1min":1.9399999999999999,"5min":2.9009999999999998,"15min":2.9009999999999998},"last":1.5289999999999999},{"interface":"front","average":{"1min":1.345,"5min":1.5129999999999999,"15min":1.5409999999999999},"min":{"1min":0.83999999999999997,"5min":0.752,"15min":0.752},"max":{"1min":1.996,"5min":6.242,"15min":6.242},"last":1.254}]}]},{"osd":0,"up_from":13,"seq":55834574881,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31936,"kb_used_data":748,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339904,"statfs":{"total":96636764160,"available":96604061696,"internally_reserved":0,"allocated":765952,"data_stored":891017,"data_compressed":32422,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Dec 12 09:45:18 2023","interfaces":[{"interface":"back","average":{"1min":0.81699999999999995,"5min":0.78000000000000003,"15min":0.77400000000000002},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":1.639,"5min":1.639,"15min":1.639},"last":0.89800000000000002},{"interface":"front","average":{"1min":0.91800000000000004,"5min":0.83699999999999997,"15min":0.82299999999999995},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":1.5680000000000001,"5min":1.5680000000000001,"15min":1.5680000000000001},"last":0.93100000000000005}]},{"osd":2,"last update":"Tue Dec 12 09:45:18 2023","interfaces":[{"interface":"back","average":{"1min":0.95099999999999996,"5min":0.879,"15min":0.86699999999999999},"min":{"1min":0.34300000000000003,"5min":0.316,"15min":0.316},"max":{"1min":1.748,"5min":1.748,"15min":1.748},"last":0.96999999999999997},{"interface":"front","average":{"1min":1.0469999999999999,"5min":1.0049999999999999,"15min":0.998},"min":{"1min":0.53600000000000003,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":1.6080000000000001,"5min":1.649,"15min":1.649},"last":1.26}]},{"osd":3,"last update":"Tue Dec 12 09:45:18 2023","interfaces":[{"interface":"back","average":{"1min":0.81499999999999995,"5min":0.84499999999999997,"15min":0.84999999999999998},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":1.2529999999999999,"5min":1.4990000000000001,"15min":1.4990000000000001},"last":0.54700000000000004},{"interface":"front","average":{"1min":1.0509999999999999,"5min":1.0129999999999999,"15min":1.0069999999999999},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":1.579,"5min":1.7689999999999999,"15min":1.7689999999999999},"last":0.80700000000000005}]},{"osd":4,"last update":"Tue Dec 12 09:45:18 2023","interfaces":[{"interface":"back","average":{"1min":1.3360000000000001,"5min":1.296,"15min":1.29},"min":{"1min":0.82999999999999996,"5min":0.80400000000000005,"15min":0.80400000000000005},"max":{"1min":1.923,"5min":2.073,"15min":2.073},"last":1.03},{"interface":"front","average":{"1min":1.2,"5min":1.274,"15min":1.286},"min":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"max":{"1min":1.6359999999999999,"5min":3.0699999999999998,"15min":3.0699999999999998},"last":1.1120000000000001}]},{"osd":5,"last update":"Tue Dec 12 09:45:18 2023","interfaces":[{"interface":"back","average":{"1min":1.173,"5min":1.2210000000000001,"15min":1.2290000000000001},"min":{"1min":0.73499999999999999,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.9690000000000001,"5min":3.1909999999999998,"15min":3.1909999999999998},"last":0.99099999999999999},{"interface":"front","average":{"1min":1.2749999999999999,"5min":1.3,"15min":1.304},"min":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"max":{"1min":2.1200000000000001,"5min":2.1200000000000001,"15min":2.1200000000000001},"last":1.1839999999999999}]},{"osd":6,"last update":"Tue Dec 12 09:45:18 2023","interfaces":[{"interface":"back","average":{"1min":1.333,"5min":1.337,"15min":1.337},"min":{"1min":0.752,"5min":0.67500000000000004,"15min":0.67500000000000004},"max":{"1min":2.04,"5min":2.04,"15min":2.04},"last":1.302},{"interface":"front","average":{"1min":1.361,"5min":1.385,"15min":1.389},"min":{"1min":0.95399999999999996,"5min":0.73099999999999998,"15min":0.73099999999999998},"max":{"1min":1.7010000000000001,"5min":2.9100000000000001,"15min":2.9100000000000001},"last":1.484}]},{"osd":7,"last update":"Tue Dec 12 09:45:18 2023","interfaces":[{"interface":"back","average":{"1min":1.3999999999999999,"5min":1.4359999999999999,"15min":1.4419999999999999},"min":{"1min":0.70299999999999996,"5min":0.66800000000000004,"15min":0.66800000000000004},"max":{"1min":1.847,"5min":2.992,"15min":2.992},"last":1.536},{"interface":"front","average":{"1min":1.3169999999999999,"5min":1.327,"15min":1.329},"min":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"max":{"1min":1.8120000000000001,"5min":2.7690000000000001,"15min":2.7690000000000001},"last":1.056}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32422,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32422,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":3689,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3107,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2228,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-12T09:45:43.099 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-12T09:45:43.349 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:43.348+0000 7f9b1ddec640 1 Processor -- start 2023-12-12T09:45:43.349 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:43.349+0000 7f9b1ddec640 1 -- start start 2023-12-12T09:45:43.350 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:43.350+0000 7f9b1ddec640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f9b18071f00 0x7f9b18155aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:43.350 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:43.350+0000 7f9b1ddec640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b18158b90 con 0x7f9b1806a750 2023-12-12T09:45:43.351 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:43.350+0000 7f9b1ddec640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b180c4e30 con 0x7f9b180bfdc0 2023-12-12T09:45:43.351 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:43.350+0000 7f9b1ddec640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b180727c0 con 0x7f9b18071f00 2023-12-12T09:45:43.351 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:43.350+0000 7f9b177fe640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f9b1806a750 0x7f9b18159020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:47262/0 (socket says 172.21.15.73:47262) 2023-12-12T09:45:43.351 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:43.350+0000 7f9b177fe640 1 -- 172.21.15.73:0/4282418513 learned_addr learned my addr 172.21.15.73:0/4282418513 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-12T09:45:43.351 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:43.350+0000 7f9b16ffd640 1 --2- 172.21.15.73:0/4282418513 >> v2:172.21.15.73:3300/0 conn(0x7f9b18071f00 0x7f9b18155aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:43.351 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:43.351+0000 7f9b167fc640 1 -- 172.21.15.73:0/4282418513 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2283747918 0 0) 0x7f9b18158b90 con 0x7f9b1806a750 2023-12-12T09:45:43.352 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:43.351+0000 7f9b167fc640 1 -- 172.21.15.73:0/4282418513 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9b04003520 con 0x7f9b1806a750 2023-12-12T09:45:43.352 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:43.351+0000 7f9b16ffd640 1 -- 172.21.15.73:0/4282418513 >> v1:172.21.15.142:6789/0 conn(0x7f9b180bfdc0 legacy=0x7f9b180c38b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:45:43.352 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:43.351+0000 7f9b16ffd640 1 -- 172.21.15.73:0/4282418513 >> v1:172.21.15.73:6789/0 conn(0x7f9b1806a750 legacy=0x7f9b18159020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:43.352 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:43.351+0000 7f9b16ffd640 1 -- 172.21.15.73:0/4282418513 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b180c5110 con 0x7f9b18071f00 2023-12-12T09:45:43.353 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:43.352+0000 7f9b16ffd640 1 --2- 172.21.15.73:0/4282418513 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9b18071f00 0x7f9b18155aa0 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f9b000097a0 tx=0x7f9b0002b7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4672affb0d6d85d server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:45:43.353 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:43.352+0000 7f9b167fc640 1 -- 172.21.15.73:0/4282418513 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b0002f050 con 0x7f9b18071f00 2023-12-12T09:45:43.353 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:43.352+0000 7f9b167fc640 1 -- 172.21.15.73:0/4282418513 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b00031700 con 0x7f9b18071f00 2023-12-12T09:45:43.353 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:43.352+0000 7f9b167fc640 1 -- 172.21.15.73:0/4282418513 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b00031a70 con 0x7f9b18071f00 2023-12-12T09:45:43.353 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:43.353+0000 7f9b1ddec640 1 -- 172.21.15.73:0/4282418513 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9b18071f00 msgr2=0x7f9b18155aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:43.353 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:43.353+0000 7f9b1ddec640 1 --2- 172.21.15.73:0/4282418513 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9b18071f00 0x7f9b18155aa0 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f9b000097a0 tx=0x7f9b0002b7a0 comp rx=0 tx=0).stop 2023-12-12T09:45:43.353 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:43.353+0000 7f9b1ddec640 1 -- 172.21.15.73:0/4282418513 shutdown_connections 2023-12-12T09:45:43.353 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:43.353+0000 7f9b1ddec640 1 --2- 172.21.15.73:0/4282418513 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9b18071f00 0x7f9b18155aa0 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:43.353 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:43.353+0000 7f9b1ddec640 1 -- 172.21.15.73:0/4282418513 >> 172.21.15.73:0/4282418513 conn(0x7f9b180a8130 msgr2=0x7f9b180c24b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:45:43.354 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:43.353+0000 7f9b1ddec640 1 -- 172.21.15.73:0/4282418513 shutdown_connections 2023-12-12T09:45:43.354 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:43.353+0000 7f9b1ddec640 1 -- 172.21.15.73:0/4282418513 wait complete. 2023-12-12T09:45:43.355 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:43.354+0000 7f9b1ddec640 1 Processor -- start 2023-12-12T09:45:43.355 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:43.355+0000 7f9b1ddec640 1 -- start start 2023-12-12T09:45:43.357 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:43.355+0000 7f9b1ddec640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9b1806a750 0x7f9b181ef1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:43.357 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:43.356+0000 7f9b1ddec640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9b18071f00 0x7f9b1815a320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:43.357 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:43.356+0000 7f9b1ddec640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9b180bfdc0 0x7f9b181510c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:43.357 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:43.356+0000 7f9b1ddec640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b18156370 con 0x7f9b1806a750 2023-12-12T09:45:43.357 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:43.356+0000 7f9b1ddec640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b18156650 con 0x7f9b180bfdc0 2023-12-12T09:45:43.357 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:43.356+0000 7f9b1ddec640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b18156930 con 0x7f9b18071f00 2023-12-12T09:45:43.357 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:43.356+0000 7f9b177fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9b1806a750 0x7f9b181ef1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:43.358 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:43.356+0000 7f9b177fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9b1806a750 0x7f9b181ef1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:42242/0 (socket says 172.21.15.73:42242) 2023-12-12T09:45:43.358 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:43.356+0000 7f9b177fe640 1 -- 172.21.15.73:0/2051405792 learned_addr learned my addr 172.21.15.73:0/2051405792 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:45:43.358 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:43.356+0000 7f9b177fe640 1 -- 172.21.15.73:0/2051405792 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9b18071f00 msgr2=0x7f9b1815a320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:43.358 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:43.356+0000 7f9b177fe640 1 --2- 172.21.15.73:0/2051405792 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9b18071f00 0x7f9b1815a320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:43.358 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:43.356+0000 7f9b177fe640 1 -- 172.21.15.73:0/2051405792 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9b180bfdc0 msgr2=0x7f9b181510c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:43.358 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:43.356+0000 7f9b177fe640 1 --2- 172.21.15.73:0/2051405792 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9b180bfdc0 0x7f9b181510c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:43.358 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:43.356+0000 7f9b177fe640 1 -- 172.21.15.73:0/2051405792 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b00009400 con 0x7f9b1806a750 2023-12-12T09:45:43.358 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:43.357+0000 7f9b177fe640 1 --2- 172.21.15.73:0/2051405792 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9b1806a750 0x7f9b181ef1c0 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f9b0800cb40 tx=0x7f9b0800a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:45:43.358 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:43.357+0000 7f9b0ffff640 1 -- 172.21.15.73:0/2051405792 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b0800aca0 con 0x7f9b1806a750 2023-12-12T09:45:43.358 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:43.357+0000 7f9b0ffff640 1 -- 172.21.15.73:0/2051405792 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b0800ae00 con 0x7f9b1806a750 2023-12-12T09:45:43.358 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:43.357+0000 7f9b0ffff640 1 -- 172.21.15.73:0/2051405792 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b08012620 con 0x7f9b1806a750 2023-12-12T09:45:43.358 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:43.357+0000 7f9b1ddec640 1 -- 172.21.15.73:0/2051405792 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b18156c10 con 0x7f9b1806a750 2023-12-12T09:45:43.358 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:43.357+0000 7f9b1ddec640 1 -- 172.21.15.73:0/2051405792 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b18151c80 con 0x7f9b1806a750 2023-12-12T09:45:43.359 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:43.358+0000 7f9b1ddec640 1 -- 172.21.15.73:0/2051405792 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b181564b0 con 0x7f9b1806a750 2023-12-12T09:45:43.359 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:43.359+0000 7f9b0ffff640 1 -- 172.21.15.73:0/2051405792 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f9b08007070 con 0x7f9b1806a750 2023-12-12T09:45:43.360 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:43.360+0000 7f9b0ffff640 1 --2- 172.21.15.73:0/2051405792 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f9af806ae40 0x7f9af806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:43.360 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:43.360+0000 7f9b0ffff640 1 -- 172.21.15.73:0/2051405792 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f9b08089930 con 0x7f9b1806a750 2023-12-12T09:45:43.360 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:43.360+0000 7f9b16ffd640 1 --2- 172.21.15.73:0/2051405792 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f9af806ae40 0x7f9af806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:43.361 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:43.361+0000 7f9b16ffd640 1 --2- 172.21.15.73:0/2051405792 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f9af806ae40 0x7f9af806d300 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f9b00035000 tx=0x7f9b00030000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:45:43.367 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:43.365+0000 7f9b0ffff640 1 -- 172.21.15.73:0/2051405792 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f9b181564b0 con 0x7f9b1806a750 2023-12-12T09:45:43.555 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:43.554+0000 7f9b1ddec640 1 -- 172.21.15.73:0/2051405792 --> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f9b181567c0 con 0x7f9af806ae40 2023-12-12T09:45:43.594 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:43.593+0000 7f9b0ffff640 1 -- 172.21.15.73:0/2051405792 <== mgr.4110 v2:172.21.15.73:6832/779985841 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+525343 (secure 0 0 0) 0x7f9b181567c0 con 0x7f9af806ae40 2023-12-12T09:45:43.601 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-12T09:45:43.605 INFO:teuthology.orchestra.run.smithi073.stderr:dumped all 2023-12-12T09:45:43.607 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:43.601+0000 7f9b1ddec640 1 -- 172.21.15.73:0/2051405792 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f9af806ae40 msgr2=0x7f9af806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:43.607 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:43.601+0000 7f9b1ddec640 1 --2- 172.21.15.73:0/2051405792 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f9af806ae40 0x7f9af806d300 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f9b00035000 tx=0x7f9b00030000 comp rx=0 tx=0).stop 2023-12-12T09:45:43.607 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:43.601+0000 7f9b1ddec640 1 -- 172.21.15.73:0/2051405792 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9b1806a750 msgr2=0x7f9b181ef1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:43.607 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:43.601+0000 7f9b1ddec640 1 --2- 172.21.15.73:0/2051405792 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9b1806a750 0x7f9b181ef1c0 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f9b0800cb40 tx=0x7f9b0800a060 comp rx=0 tx=0).stop 2023-12-12T09:45:43.607 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:43.601+0000 7f9b1ddec640 1 -- 172.21.15.73:0/2051405792 shutdown_connections 2023-12-12T09:45:43.607 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:43.601+0000 7f9b1ddec640 1 --2- 172.21.15.73:0/2051405792 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f9af806ae40 0x7f9af806d300 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:43.607 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:43.601+0000 7f9b1ddec640 1 --2- 172.21.15.73:0/2051405792 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9b180bfdc0 0x7f9b181510c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:43.607 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:43.601+0000 7f9b1ddec640 1 --2- 172.21.15.73:0/2051405792 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9b18071f00 0x7f9b1815a320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:43.607 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:43.601+0000 7f9b1ddec640 1 --2- 172.21.15.73:0/2051405792 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9b1806a750 0x7f9b181ef1c0 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:43.607 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:43.601+0000 7f9b1ddec640 1 -- 172.21.15.73:0/2051405792 >> 172.21.15.73:0/2051405792 conn(0x7f9b180a8130 msgr2=0x7f9b18070cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:45:43.607 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:43.601+0000 7f9b1ddec640 1 -- 172.21.15.73:0/2051405792 shutdown_connections 2023-12-12T09:45:43.607 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:43.601+0000 7f9b1ddec640 1 -- 172.21.15.73:0/2051405792 wait complete. 2023-12-12T09:45:43.622 INFO:teuthology.orchestra.run.smithi073.stdout:{"pg_ready":true,"pg_map":{"version":126,"stamp":"2023-12-12T09:45:43.501734+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":596683,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":251,"num_write_kb":2447,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":27,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":197,"ondisk_log_size":197,"up":386,"acting":386,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":310,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":234268,"kb_used_data":5584,"kb_used_omap":12,"kb_used_meta":228531,"kb_avail":754740452,"statfs":{"total":773094113280,"available":772854222848,"internally_reserved":0,"allocated":5718016,"data_stored":3567364,"data_compressed":64844,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":12752,"internal_metadata":234016304},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":44,"apply_latency_ms":44,"commit_latency_ns":44000000,"apply_latency_ns":44000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.002690"},"pg_stats":[{"pgid":"11.3d","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-12-12T09:45:38.325098+0000","last_change":"2023-12-12T09:45:38.317031+0000","last_active":"2023-12-12T09:45:38.325098+0000","last_peered":"2023-12-12T09:45:38.325098+0000","last_clean":"2023-12-12T09:45:38.325098+0000","last_became_active":"2023-12-12T09:45:38.316206+0000","last_became_peered":"2023-12-12T09:45:38.316206+0000","last_unstale":"2023-12-12T09:45:38.325098+0000","last_undegraded":"2023-12-12T09:45:38.325098+0000","last_fullsized":"2023-12-12T09:45:38.325098+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:37.621350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:37.621350+0000","last_clean_scrub_stamp":"2023-12-12T09:45:37.621350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T19:16:43.947151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3f","version":"0'0","reported_seq":15,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-12-12T09:45:38.311485+0000","last_change":"2023-12-12T09:45:23.538728+0000","last_active":"2023-12-12T09:45:38.311485+0000","last_peered":"2023-12-12T09:45:38.311485+0000","last_clean":"2023-12-12T09:45:38.311485+0000","last_became_active":"2023-12-12T09:45:23.538477+0000","last_became_peered":"2023-12-12T09:45:23.538477+0000","last_unstale":"2023-12-12T09:45:38.311485+0000","last_undegraded":"2023-12-12T09:45:38.311485+0000","last_fullsized":"2023-12-12T09:45:38.311485+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_clean_scrub_stamp":"2023-12-12T09:45:22.493994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T19:31:49.247231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3c","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-12-12T09:45:38.315669+0000","last_change":"2023-12-12T09:45:38.309353+0000","last_active":"2023-12-12T09:45:38.315669+0000","last_peered":"2023-12-12T09:45:38.315669+0000","last_clean":"2023-12-12T09:45:38.315669+0000","last_became_active":"2023-12-12T09:45:38.308990+0000","last_became_peered":"2023-12-12T09:45:38.308990+0000","last_unstale":"2023-12-12T09:45:38.315669+0000","last_undegraded":"2023-12-12T09:45:38.315669+0000","last_fullsized":"2023-12-12T09:45:38.315669+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:37.621350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:37.621350+0000","last_clean_scrub_stamp":"2023-12-12T09:45:37.621350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T14:17:03.921292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":14,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-12-12T09:45:37.652788+0000","last_change":"2023-12-12T09:45:23.550472+0000","last_active":"2023-12-12T09:45:37.652788+0000","last_peered":"2023-12-12T09:45:37.652788+0000","last_clean":"2023-12-12T09:45:37.652788+0000","last_became_active":"2023-12-12T09:45:23.550233+0000","last_became_peered":"2023-12-12T09:45:23.550233+0000","last_unstale":"2023-12-12T09:45:37.652788+0000","last_undegraded":"2023-12-12T09:45:37.652788+0000","last_fullsized":"2023-12-12T09:45:37.652788+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_clean_scrub_stamp":"2023-12-12T09:45:22.493994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T12:17:13.855943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.3f","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-12-12T09:45:38.330202+0000","last_change":"2023-12-12T09:45:38.323649+0000","last_active":"2023-12-12T09:45:38.330202+0000","last_peered":"2023-12-12T09:45:38.330202+0000","last_clean":"2023-12-12T09:45:38.330202+0000","last_became_active":"2023-12-12T09:45:38.323284+0000","last_became_peered":"2023-12-12T09:45:38.323284+0000","last_unstale":"2023-12-12T09:45:38.330202+0000","last_undegraded":"2023-12-12T09:45:38.330202+0000","last_fullsized":"2023-12-12T09:45:38.330202+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:37.621350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:37.621350+0000","last_clean_scrub_stamp":"2023-12-12T09:45:37.621350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T13:19:13.590345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":14,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-12-12T09:45:37.666785+0000","last_change":"2023-12-12T09:45:23.550621+0000","last_active":"2023-12-12T09:45:37.666785+0000","last_peered":"2023-12-12T09:45:37.666785+0000","last_clean":"2023-12-12T09:45:37.666785+0000","last_became_active":"2023-12-12T09:45:23.550284+0000","last_became_peered":"2023-12-12T09:45:23.550284+0000","last_unstale":"2023-12-12T09:45:37.666785+0000","last_undegraded":"2023-12-12T09:45:37.666785+0000","last_fullsized":"2023-12-12T09:45:37.666785+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_clean_scrub_stamp":"2023-12-12T09:45:22.493994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T16:46:32.423265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.3e","version":"0'0","reported_seq":11,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-12T09:45:39.287245+0000","last_change":"2023-12-12T09:45:38.310863+0000","last_active":"2023-12-12T09:45:39.287245+0000","last_peered":"2023-12-12T09:45:39.287245+0000","last_clean":"2023-12-12T09:45:39.287245+0000","last_became_active":"2023-12-12T09:45:38.310076+0000","last_became_peered":"2023-12-12T09:45:38.310076+0000","last_unstale":"2023-12-12T09:45:39.287245+0000","last_undegraded":"2023-12-12T09:45:39.287245+0000","last_fullsized":"2023-12-12T09:45:39.287245+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:37.621350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:37.621350+0000","last_clean_scrub_stamp":"2023-12-12T09:45:37.621350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T20:28:29.320280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":15,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-12-12T09:45:38.283905+0000","last_change":"2023-12-12T09:45:23.529454+0000","last_active":"2023-12-12T09:45:38.283905+0000","last_peered":"2023-12-12T09:45:38.283905+0000","last_clean":"2023-12-12T09:45:38.283905+0000","last_became_active":"2023-12-12T09:45:23.529064+0000","last_became_peered":"2023-12-12T09:45:23.529064+0000","last_unstale":"2023-12-12T09:45:38.283905+0000","last_undegraded":"2023-12-12T09:45:38.283905+0000","last_fullsized":"2023-12-12T09:45:38.283905+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_clean_scrub_stamp":"2023-12-12T09:45:22.493994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T14:20:09.952370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":11,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-12T09:45:39.284466+0000","last_change":"2023-12-12T09:45:38.303922+0000","last_active":"2023-12-12T09:45:39.284466+0000","last_peered":"2023-12-12T09:45:39.284466+0000","last_clean":"2023-12-12T09:45:39.284466+0000","last_became_active":"2023-12-12T09:45:38.302932+0000","last_became_peered":"2023-12-12T09:45:38.302932+0000","last_unstale":"2023-12-12T09:45:39.284466+0000","last_undegraded":"2023-12-12T09:45:39.284466+0000","last_fullsized":"2023-12-12T09:45:39.284466+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:37.621350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:37.621350+0000","last_clean_scrub_stamp":"2023-12-12T09:45:37.621350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T18:35:36.452769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":15,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-12-12T09:45:38.300812+0000","last_change":"2023-12-12T09:45:23.532127+0000","last_active":"2023-12-12T09:45:38.300812+0000","last_peered":"2023-12-12T09:45:38.300812+0000","last_clean":"2023-12-12T09:45:38.300812+0000","last_became_active":"2023-12-12T09:45:23.531850+0000","last_became_peered":"2023-12-12T09:45:23.531850+0000","last_unstale":"2023-12-12T09:45:38.300812+0000","last_undegraded":"2023-12-12T09:45:38.300812+0000","last_fullsized":"2023-12-12T09:45:38.300812+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_clean_scrub_stamp":"2023-12-12T09:45:22.493994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T12:57:56.868905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":11,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-12T09:45:39.285023+0000","last_change":"2023-12-12T09:45:38.315615+0000","last_active":"2023-12-12T09:45:39.285023+0000","last_peered":"2023-12-12T09:45:39.285023+0000","last_clean":"2023-12-12T09:45:39.285023+0000","last_became_active":"2023-12-12T09:45:38.315225+0000","last_became_peered":"2023-12-12T09:45:38.315225+0000","last_unstale":"2023-12-12T09:45:39.285023+0000","last_undegraded":"2023-12-12T09:45:39.285023+0000","last_fullsized":"2023-12-12T09:45:39.285023+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:37.621350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:37.621350+0000","last_clean_scrub_stamp":"2023-12-12T09:45:37.621350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T12:43:19.374589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":14,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-12-12T09:45:37.631342+0000","last_change":"2023-12-12T09:45:23.531673+0000","last_active":"2023-12-12T09:45:37.631342+0000","last_peered":"2023-12-12T09:45:37.631342+0000","last_clean":"2023-12-12T09:45:37.631342+0000","last_became_active":"2023-12-12T09:45:23.530075+0000","last_became_peered":"2023-12-12T09:45:23.530075+0000","last_unstale":"2023-12-12T09:45:37.631342+0000","last_undegraded":"2023-12-12T09:45:37.631342+0000","last_fullsized":"2023-12-12T09:45:37.631342+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_clean_scrub_stamp":"2023-12-12T09:45:22.493994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T16:46:32.423265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.3b","version":"0'0","reported_seq":11,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-12T09:45:39.284731+0000","last_change":"2023-12-12T09:45:38.316148+0000","last_active":"2023-12-12T09:45:39.284731+0000","last_peered":"2023-12-12T09:45:39.284731+0000","last_clean":"2023-12-12T09:45:39.284731+0000","last_became_active":"2023-12-12T09:45:38.313223+0000","last_became_peered":"2023-12-12T09:45:38.313223+0000","last_unstale":"2023-12-12T09:45:39.284731+0000","last_undegraded":"2023-12-12T09:45:39.284731+0000","last_fullsized":"2023-12-12T09:45:39.284731+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:37.621350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:37.621350+0000","last_clean_scrub_stamp":"2023-12-12T09:45:37.621350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T14:03:18.186583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":14,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-12-12T09:45:37.647636+0000","last_change":"2023-12-12T09:45:23.545363+0000","last_active":"2023-12-12T09:45:37.647636+0000","last_peered":"2023-12-12T09:45:37.647636+0000","last_clean":"2023-12-12T09:45:37.647636+0000","last_became_active":"2023-12-12T09:45:23.543029+0000","last_became_peered":"2023-12-12T09:45:23.543029+0000","last_unstale":"2023-12-12T09:45:37.647636+0000","last_undegraded":"2023-12-12T09:45:37.647636+0000","last_fullsized":"2023-12-12T09:45:37.647636+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_clean_scrub_stamp":"2023-12-12T09:45:22.493994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T10:40:43.209236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.3a","version":"0'0","reported_seq":11,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-12T09:45:39.285751+0000","last_change":"2023-12-12T09:45:38.309787+0000","last_active":"2023-12-12T09:45:39.285751+0000","last_peered":"2023-12-12T09:45:39.285751+0000","last_clean":"2023-12-12T09:45:39.285751+0000","last_became_active":"2023-12-12T09:45:38.309474+0000","last_became_peered":"2023-12-12T09:45:38.309474+0000","last_unstale":"2023-12-12T09:45:39.285751+0000","last_undegraded":"2023-12-12T09:45:39.285751+0000","last_fullsized":"2023-12-12T09:45:39.285751+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:37.621350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:37.621350+0000","last_clean_scrub_stamp":"2023-12-12T09:45:37.621350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T12:23:52.875082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":14,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-12-12T09:45:37.645117+0000","last_change":"2023-12-12T09:45:23.540907+0000","last_active":"2023-12-12T09:45:37.645117+0000","last_peered":"2023-12-12T09:45:37.645117+0000","last_clean":"2023-12-12T09:45:37.645117+0000","last_became_active":"2023-12-12T09:45:23.540653+0000","last_became_peered":"2023-12-12T09:45:23.540653+0000","last_unstale":"2023-12-12T09:45:37.645117+0000","last_undegraded":"2023-12-12T09:45:37.645117+0000","last_fullsized":"2023-12-12T09:45:37.645117+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_clean_scrub_stamp":"2023-12-12T09:45:22.493994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T17:36:57.557008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-12-12T09:45:38.323524+0000","last_change":"2023-12-12T09:45:38.320674+0000","last_active":"2023-12-12T09:45:38.323524+0000","last_peered":"2023-12-12T09:45:38.323524+0000","last_clean":"2023-12-12T09:45:38.323524+0000","last_became_active":"2023-12-12T09:45:38.320385+0000","last_became_peered":"2023-12-12T09:45:38.320385+0000","last_unstale":"2023-12-12T09:45:38.323524+0000","last_undegraded":"2023-12-12T09:45:38.323524+0000","last_fullsized":"2023-12-12T09:45:38.323524+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:37.621350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:37.621350+0000","last_clean_scrub_stamp":"2023-12-12T09:45:37.621350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T21:11:52.430282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":14,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-12-12T09:45:37.652109+0000","last_change":"2023-12-12T09:45:23.552916+0000","last_active":"2023-12-12T09:45:37.652109+0000","last_peered":"2023-12-12T09:45:37.652109+0000","last_clean":"2023-12-12T09:45:37.652109+0000","last_became_active":"2023-12-12T09:45:23.552025+0000","last_became_peered":"2023-12-12T09:45:23.552025+0000","last_unstale":"2023-12-12T09:45:37.652109+0000","last_undegraded":"2023-12-12T09:45:37.652109+0000","last_fullsized":"2023-12-12T09:45:37.652109+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_clean_scrub_stamp":"2023-12-12T09:45:22.493994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T20:27:09.962474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.34","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-12-12T09:45:38.315650+0000","last_change":"2023-12-12T09:45:38.308744+0000","last_active":"2023-12-12T09:45:38.315650+0000","last_peered":"2023-12-12T09:45:38.315650+0000","last_clean":"2023-12-12T09:45:38.315650+0000","last_became_active":"2023-12-12T09:45:38.308404+0000","last_became_peered":"2023-12-12T09:45:38.308404+0000","last_unstale":"2023-12-12T09:45:38.315650+0000","last_undegraded":"2023-12-12T09:45:38.315650+0000","last_fullsized":"2023-12-12T09:45:38.315650+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:37.621350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:37.621350+0000","last_clean_scrub_stamp":"2023-12-12T09:45:37.621350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T12:53:23.633955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":14,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-12-12T09:45:37.646855+0000","last_change":"2023-12-12T09:45:23.545833+0000","last_active":"2023-12-12T09:45:37.646855+0000","last_peered":"2023-12-12T09:45:37.646855+0000","last_clean":"2023-12-12T09:45:37.646855+0000","last_became_active":"2023-12-12T09:45:23.545073+0000","last_became_peered":"2023-12-12T09:45:23.545073+0000","last_unstale":"2023-12-12T09:45:37.646855+0000","last_undegraded":"2023-12-12T09:45:37.646855+0000","last_fullsized":"2023-12-12T09:45:37.646855+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_clean_scrub_stamp":"2023-12-12T09:45:22.493994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T15:31:33.286934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":11,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-12T09:45:39.286176+0000","last_change":"2023-12-12T09:45:38.319611+0000","last_active":"2023-12-12T09:45:39.286176+0000","last_peered":"2023-12-12T09:45:39.286176+0000","last_clean":"2023-12-12T09:45:39.286176+0000","last_became_active":"2023-12-12T09:45:38.318910+0000","last_became_peered":"2023-12-12T09:45:38.318910+0000","last_unstale":"2023-12-12T09:45:39.286176+0000","last_undegraded":"2023-12-12T09:45:39.286176+0000","last_fullsized":"2023-12-12T09:45:39.286176+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:37.621350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:37.621350+0000","last_clean_scrub_stamp":"2023-12-12T09:45:37.621350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T17:58:46.646468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":14,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-12-12T09:45:37.644646+0000","last_change":"2023-12-12T09:45:23.542993+0000","last_active":"2023-12-12T09:45:37.644646+0000","last_peered":"2023-12-12T09:45:37.644646+0000","last_clean":"2023-12-12T09:45:37.644646+0000","last_became_active":"2023-12-12T09:45:23.542770+0000","last_became_peered":"2023-12-12T09:45:23.542770+0000","last_unstale":"2023-12-12T09:45:37.644646+0000","last_undegraded":"2023-12-12T09:45:37.644646+0000","last_fullsized":"2023-12-12T09:45:37.644646+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_clean_scrub_stamp":"2023-12-12T09:45:22.493994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T10:40:43.209236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-12-12T09:45:38.309232+0000","last_change":"2023-12-12T09:45:38.305292+0000","last_active":"2023-12-12T09:45:38.309232+0000","last_peered":"2023-12-12T09:45:38.309232+0000","last_clean":"2023-12-12T09:45:38.309232+0000","last_became_active":"2023-12-12T09:45:38.304979+0000","last_became_peered":"2023-12-12T09:45:38.304979+0000","last_unstale":"2023-12-12T09:45:38.309232+0000","last_undegraded":"2023-12-12T09:45:38.309232+0000","last_fullsized":"2023-12-12T09:45:38.309232+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:37.621350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:37.621350+0000","last_clean_scrub_stamp":"2023-12-12T09:45:37.621350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T17:51:41.672993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":15,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-12-12T09:45:38.284127+0000","last_change":"2023-12-12T09:45:23.552839+0000","last_active":"2023-12-12T09:45:38.284127+0000","last_peered":"2023-12-12T09:45:38.284127+0000","last_clean":"2023-12-12T09:45:38.284127+0000","last_became_active":"2023-12-12T09:45:23.548568+0000","last_became_peered":"2023-12-12T09:45:23.548568+0000","last_unstale":"2023-12-12T09:45:38.284127+0000","last_undegraded":"2023-12-12T09:45:38.284127+0000","last_fullsized":"2023-12-12T09:45:38.284127+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_clean_scrub_stamp":"2023-12-12T09:45:22.493994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T12:19:37.793666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-12-12T09:45:38.315348+0000","last_change":"2023-12-12T09:45:38.313084+0000","last_active":"2023-12-12T09:45:38.315348+0000","last_peered":"2023-12-12T09:45:38.315348+0000","last_clean":"2023-12-12T09:45:38.315348+0000","last_became_active":"2023-12-12T09:45:38.312776+0000","last_became_peered":"2023-12-12T09:45:38.312776+0000","last_unstale":"2023-12-12T09:45:38.315348+0000","last_undegraded":"2023-12-12T09:45:38.315348+0000","last_fullsized":"2023-12-12T09:45:38.315348+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:37.621350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:37.621350+0000","last_clean_scrub_stamp":"2023-12-12T09:45:37.621350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T12:17:28.983300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":15,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-12-12T09:45:38.295493+0000","last_change":"2023-12-12T09:45:23.536465+0000","last_active":"2023-12-12T09:45:38.295493+0000","last_peered":"2023-12-12T09:45:38.295493+0000","last_clean":"2023-12-12T09:45:38.295493+0000","last_became_active":"2023-12-12T09:45:23.536019+0000","last_became_peered":"2023-12-12T09:45:23.536019+0000","last_unstale":"2023-12-12T09:45:38.295493+0000","last_undegraded":"2023-12-12T09:45:38.295493+0000","last_fullsized":"2023-12-12T09:45:38.295493+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_clean_scrub_stamp":"2023-12-12T09:45:22.493994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T14:30:36.106005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.30","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-12-12T09:45:38.322864+0000","last_change":"2023-12-12T09:45:38.316692+0000","last_active":"2023-12-12T09:45:38.322864+0000","last_peered":"2023-12-12T09:45:38.322864+0000","last_clean":"2023-12-12T09:45:38.322864+0000","last_became_active":"2023-12-12T09:45:38.316309+0000","last_became_peered":"2023-12-12T09:45:38.316309+0000","last_unstale":"2023-12-12T09:45:38.322864+0000","last_undegraded":"2023-12-12T09:45:38.322864+0000","last_fullsized":"2023-12-12T09:45:38.322864+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:37.621350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:37.621350+0000","last_clean_scrub_stamp":"2023-12-12T09:45:37.621350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T18:41:44.847673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":14,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-12-12T09:45:37.649470+0000","last_change":"2023-12-12T09:45:23.551554+0000","last_active":"2023-12-12T09:45:37.649470+0000","last_peered":"2023-12-12T09:45:37.649470+0000","last_clean":"2023-12-12T09:45:37.649470+0000","last_became_active":"2023-12-12T09:45:23.548473+0000","last_became_peered":"2023-12-12T09:45:23.548473+0000","last_unstale":"2023-12-12T09:45:37.649470+0000","last_undegraded":"2023-12-12T09:45:37.649470+0000","last_fullsized":"2023-12-12T09:45:37.649470+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_clean_scrub_stamp":"2023-12-12T09:45:22.493994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T17:58:31.519111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.33","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-12-12T09:45:38.314476+0000","last_change":"2023-12-12T09:45:38.309527+0000","last_active":"2023-12-12T09:45:38.314476+0000","last_peered":"2023-12-12T09:45:38.314476+0000","last_clean":"2023-12-12T09:45:38.314476+0000","last_became_active":"2023-12-12T09:45:38.309233+0000","last_became_peered":"2023-12-12T09:45:38.309233+0000","last_unstale":"2023-12-12T09:45:38.314476+0000","last_undegraded":"2023-12-12T09:45:38.314476+0000","last_fullsized":"2023-12-12T09:45:38.314476+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:37.621350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:37.621350+0000","last_clean_scrub_stamp":"2023-12-12T09:45:37.621350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T12:01:01.058805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":14,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-12-12T09:45:37.648264+0000","last_change":"2023-12-12T09:45:23.543290+0000","last_active":"2023-12-12T09:45:37.648264+0000","last_peered":"2023-12-12T09:45:37.648264+0000","last_clean":"2023-12-12T09:45:37.648264+0000","last_became_active":"2023-12-12T09:45:23.542623+0000","last_became_peered":"2023-12-12T09:45:23.542623+0000","last_unstale":"2023-12-12T09:45:37.648264+0000","last_undegraded":"2023-12-12T09:45:37.648264+0000","last_fullsized":"2023-12-12T09:45:37.648264+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_clean_scrub_stamp":"2023-12-12T09:45:22.493994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T15:49:16.147997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":11,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-12T09:45:39.284758+0000","last_change":"2023-12-12T09:45:38.308049+0000","last_active":"2023-12-12T09:45:39.284758+0000","last_peered":"2023-12-12T09:45:39.284758+0000","last_clean":"2023-12-12T09:45:39.284758+0000","last_became_active":"2023-12-12T09:45:38.307662+0000","last_became_peered":"2023-12-12T09:45:38.307662+0000","last_unstale":"2023-12-12T09:45:39.284758+0000","last_undegraded":"2023-12-12T09:45:39.284758+0000","last_fullsized":"2023-12-12T09:45:39.284758+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:37.621350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:37.621350+0000","last_clean_scrub_stamp":"2023-12-12T09:45:37.621350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T15:31:48.414290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":14,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-12-12T09:45:37.631032+0000","last_change":"2023-12-12T09:45:23.550153+0000","last_active":"2023-12-12T09:45:37.631032+0000","last_peered":"2023-12-12T09:45:37.631032+0000","last_clean":"2023-12-12T09:45:37.631032+0000","last_became_active":"2023-12-12T09:45:23.548835+0000","last_became_peered":"2023-12-12T09:45:23.548835+0000","last_unstale":"2023-12-12T09:45:37.631032+0000","last_undegraded":"2023-12-12T09:45:37.631032+0000","last_fullsized":"2023-12-12T09:45:37.631032+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_clean_scrub_stamp":"2023-12-12T09:45:22.493994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T12:53:08.506599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2d","version":"0'0","reported_seq":11,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-12T09:45:39.286608+0000","last_change":"2023-12-12T09:45:38.319083+0000","last_active":"2023-12-12T09:45:39.286608+0000","last_peered":"2023-12-12T09:45:39.286608+0000","last_clean":"2023-12-12T09:45:39.286608+0000","last_became_active":"2023-12-12T09:45:38.316117+0000","last_became_peered":"2023-12-12T09:45:38.316117+0000","last_unstale":"2023-12-12T09:45:39.286608+0000","last_undegraded":"2023-12-12T09:45:39.286608+0000","last_fullsized":"2023-12-12T09:45:39.286608+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:37.621350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:37.621350+0000","last_clean_scrub_stamp":"2023-12-12T09:45:37.621350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T13:19:13.590345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":14,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-12-12T09:45:37.652618+0000","last_change":"2023-12-12T09:45:23.542153+0000","last_active":"2023-12-12T09:45:37.652618+0000","last_peered":"2023-12-12T09:45:37.652618+0000","last_clean":"2023-12-12T09:45:37.652618+0000","last_became_active":"2023-12-12T09:45:23.541948+0000","last_became_peered":"2023-12-12T09:45:23.541948+0000","last_unstale":"2023-12-12T09:45:37.652618+0000","last_undegraded":"2023-12-12T09:45:37.652618+0000","last_fullsized":"2023-12-12T09:45:37.652618+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_clean_scrub_stamp":"2023-12-12T09:45:22.493994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T09:57:07.126644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-12-12T09:45:38.316890+0000","last_change":"2023-12-12T09:45:38.314051+0000","last_active":"2023-12-12T09:45:38.316890+0000","last_peered":"2023-12-12T09:45:38.316890+0000","last_clean":"2023-12-12T09:45:38.316890+0000","last_became_active":"2023-12-12T09:45:38.312804+0000","last_became_peered":"2023-12-12T09:45:38.312804+0000","last_unstale":"2023-12-12T09:45:38.316890+0000","last_undegraded":"2023-12-12T09:45:38.316890+0000","last_fullsized":"2023-12-12T09:45:38.316890+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:37.621350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:37.621350+0000","last_clean_scrub_stamp":"2023-12-12T09:45:37.621350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T12:15:20.295162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":14,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-12-12T09:45:37.667880+0000","last_change":"2023-12-12T09:45:23.553823+0000","last_active":"2023-12-12T09:45:37.667880+0000","last_peered":"2023-12-12T09:45:37.667880+0000","last_clean":"2023-12-12T09:45:37.667880+0000","last_became_active":"2023-12-12T09:45:23.553411+0000","last_became_peered":"2023-12-12T09:45:23.553411+0000","last_unstale":"2023-12-12T09:45:37.667880+0000","last_undegraded":"2023-12-12T09:45:37.667880+0000","last_fullsized":"2023-12-12T09:45:37.667880+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_clean_scrub_stamp":"2023-12-12T09:45:22.493994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T14:20:09.952370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":11,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-12T09:45:39.286540+0000","last_change":"2023-12-12T09:45:38.319594+0000","last_active":"2023-12-12T09:45:39.286540+0000","last_peered":"2023-12-12T09:45:39.286540+0000","last_clean":"2023-12-12T09:45:39.286540+0000","last_became_active":"2023-12-12T09:45:38.318642+0000","last_became_peered":"2023-12-12T09:45:38.318642+0000","last_unstale":"2023-12-12T09:45:39.286540+0000","last_undegraded":"2023-12-12T09:45:39.286540+0000","last_fullsized":"2023-12-12T09:45:39.286540+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:37.621350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:37.621350+0000","last_clean_scrub_stamp":"2023-12-12T09:45:37.621350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T20:27:25.089830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":15,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-12-12T09:45:38.312301+0000","last_change":"2023-12-12T09:45:23.538491+0000","last_active":"2023-12-12T09:45:38.312301+0000","last_peered":"2023-12-12T09:45:38.312301+0000","last_clean":"2023-12-12T09:45:38.312301+0000","last_became_active":"2023-12-12T09:45:23.538127+0000","last_became_peered":"2023-12-12T09:45:23.538127+0000","last_unstale":"2023-12-12T09:45:38.312301+0000","last_undegraded":"2023-12-12T09:45:38.312301+0000","last_fullsized":"2023-12-12T09:45:38.312301+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_clean_scrub_stamp":"2023-12-12T09:45:22.493994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T10:19:00.193250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-12-12T09:45:38.315918+0000","last_change":"2023-12-12T09:45:38.309212+0000","last_active":"2023-12-12T09:45:38.315918+0000","last_peered":"2023-12-12T09:45:38.315918+0000","last_clean":"2023-12-12T09:45:38.315918+0000","last_became_active":"2023-12-12T09:45:38.308836+0000","last_became_peered":"2023-12-12T09:45:38.308836+0000","last_unstale":"2023-12-12T09:45:38.315918+0000","last_undegraded":"2023-12-12T09:45:38.315918+0000","last_fullsized":"2023-12-12T09:45:38.315918+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:37.621350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:37.621350+0000","last_clean_scrub_stamp":"2023-12-12T09:45:37.621350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T12:04:37.649241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":14,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-12-12T09:45:37.652501+0000","last_change":"2023-12-12T09:45:23.551873+0000","last_active":"2023-12-12T09:45:37.652501+0000","last_peered":"2023-12-12T09:45:37.652501+0000","last_clean":"2023-12-12T09:45:37.652501+0000","last_became_active":"2023-12-12T09:45:23.551158+0000","last_became_peered":"2023-12-12T09:45:23.551158+0000","last_unstale":"2023-12-12T09:45:37.652501+0000","last_undegraded":"2023-12-12T09:45:37.652501+0000","last_fullsized":"2023-12-12T09:45:37.652501+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_clean_scrub_stamp":"2023-12-12T09:45:22.493994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T20:28:14.192924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-12-12T09:45:38.322845+0000","last_change":"2023-12-12T09:45:38.318052+0000","last_active":"2023-12-12T09:45:38.322845+0000","last_peered":"2023-12-12T09:45:38.322845+0000","last_clean":"2023-12-12T09:45:38.322845+0000","last_became_active":"2023-12-12T09:45:38.317795+0000","last_became_peered":"2023-12-12T09:45:38.317795+0000","last_unstale":"2023-12-12T09:45:38.322845+0000","last_undegraded":"2023-12-12T09:45:38.322845+0000","last_fullsized":"2023-12-12T09:45:38.322845+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:37.621350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:37.621350+0000","last_clean_scrub_stamp":"2023-12-12T09:45:37.621350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T18:35:36.452769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":14,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-12-12T09:45:37.666374+0000","last_change":"2023-12-12T09:45:23.549785+0000","last_active":"2023-12-12T09:45:37.666374+0000","last_peered":"2023-12-12T09:45:37.666374+0000","last_clean":"2023-12-12T09:45:37.666374+0000","last_became_active":"2023-12-12T09:45:23.548831+0000","last_became_peered":"2023-12-12T09:45:23.548831+0000","last_unstale":"2023-12-12T09:45:37.666374+0000","last_undegraded":"2023-12-12T09:45:37.666374+0000","last_fullsized":"2023-12-12T09:45:37.666374+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_clean_scrub_stamp":"2023-12-12T09:45:22.493994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T12:19:37.793666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-12-12T09:45:38.327678+0000","last_change":"2023-12-12T09:45:38.322267+0000","last_active":"2023-12-12T09:45:38.327678+0000","last_peered":"2023-12-12T09:45:38.327678+0000","last_clean":"2023-12-12T09:45:38.327678+0000","last_became_active":"2023-12-12T09:45:38.321894+0000","last_became_peered":"2023-12-12T09:45:38.321894+0000","last_unstale":"2023-12-12T09:45:38.327678+0000","last_undegraded":"2023-12-12T09:45:38.327678+0000","last_fullsized":"2023-12-12T09:45:38.327678+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:37.621350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:37.621350+0000","last_clean_scrub_stamp":"2023-12-12T09:45:37.621350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T12:17:28.983300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":14,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-12-12T09:45:37.652269+0000","last_change":"2023-12-12T09:45:23.546134+0000","last_active":"2023-12-12T09:45:37.652269+0000","last_peered":"2023-12-12T09:45:37.652269+0000","last_clean":"2023-12-12T09:45:37.652269+0000","last_became_active":"2023-12-12T09:45:23.545808+0000","last_became_peered":"2023-12-12T09:45:23.545808+0000","last_unstale":"2023-12-12T09:45:37.652269+0000","last_undegraded":"2023-12-12T09:45:37.652269+0000","last_fullsized":"2023-12-12T09:45:37.652269+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_clean_scrub_stamp":"2023-12-12T09:45:22.493994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T18:13:20.201960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.2b","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-12-12T09:45:38.309265+0000","last_change":"2023-12-12T09:45:38.305454+0000","last_active":"2023-12-12T09:45:38.309265+0000","last_peered":"2023-12-12T09:45:38.309265+0000","last_clean":"2023-12-12T09:45:38.309265+0000","last_became_active":"2023-12-12T09:45:38.305122+0000","last_became_peered":"2023-12-12T09:45:38.305122+0000","last_unstale":"2023-12-12T09:45:38.309265+0000","last_undegraded":"2023-12-12T09:45:38.309265+0000","last_fullsized":"2023-12-12T09:45:38.309265+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:37.621350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:37.621350+0000","last_clean_scrub_stamp":"2023-12-12T09:45:37.621350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T12:53:23.633955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":14,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-12-12T09:45:37.665557+0000","last_change":"2023-12-12T09:45:23.555039+0000","last_active":"2023-12-12T09:45:37.665557+0000","last_peered":"2023-12-12T09:45:37.665557+0000","last_clean":"2023-12-12T09:45:37.665557+0000","last_became_active":"2023-12-12T09:45:23.554002+0000","last_became_peered":"2023-12-12T09:45:23.554002+0000","last_unstale":"2023-12-12T09:45:37.665557+0000","last_undegraded":"2023-12-12T09:45:37.665557+0000","last_fullsized":"2023-12-12T09:45:37.665557+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_clean_scrub_stamp":"2023-12-12T09:45:22.493994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T20:14:20.654636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-12-12T09:45:38.320880+0000","last_change":"2023-12-12T09:45:38.315377+0000","last_active":"2023-12-12T09:45:38.320880+0000","last_peered":"2023-12-12T09:45:38.320880+0000","last_clean":"2023-12-12T09:45:38.320880+0000","last_became_active":"2023-12-12T09:45:38.314552+0000","last_became_peered":"2023-12-12T09:45:38.314552+0000","last_unstale":"2023-12-12T09:45:38.320880+0000","last_undegraded":"2023-12-12T09:45:38.320880+0000","last_fullsized":"2023-12-12T09:45:38.320880+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:37.621350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:37.621350+0000","last_clean_scrub_stamp":"2023-12-12T09:45:37.621350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T10:09:12.176724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":15,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-12-12T09:45:38.304294+0000","last_change":"2023-12-12T09:45:23.530338+0000","last_active":"2023-12-12T09:45:38.304294+0000","last_peered":"2023-12-12T09:45:38.304294+0000","last_clean":"2023-12-12T09:45:38.304294+0000","last_became_active":"2023-12-12T09:45:23.529963+0000","last_became_peered":"2023-12-12T09:45:23.529963+0000","last_unstale":"2023-12-12T09:45:38.304294+0000","last_undegraded":"2023-12-12T09:45:38.304294+0000","last_fullsized":"2023-12-12T09:45:38.304294+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_clean_scrub_stamp":"2023-12-12T09:45:22.493994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T14:10:03.420375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-12-12T09:45:38.325007+0000","last_change":"2023-12-12T09:45:38.314719+0000","last_active":"2023-12-12T09:45:38.325007+0000","last_peered":"2023-12-12T09:45:38.325007+0000","last_clean":"2023-12-12T09:45:38.325007+0000","last_became_active":"2023-12-12T09:45:38.314468+0000","last_became_peered":"2023-12-12T09:45:38.314468+0000","last_unstale":"2023-12-12T09:45:38.325007+0000","last_undegraded":"2023-12-12T09:45:38.325007+0000","last_fullsized":"2023-12-12T09:45:38.325007+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:37.621350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:37.621350+0000","last_clean_scrub_stamp":"2023-12-12T09:45:37.621350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T18:20:48.118581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":15,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-12-12T09:45:38.311552+0000","last_change":"2023-12-12T09:45:23.528718+0000","last_active":"2023-12-12T09:45:38.311552+0000","last_peered":"2023-12-12T09:45:38.311552+0000","last_clean":"2023-12-12T09:45:38.311552+0000","last_became_active":"2023-12-12T09:45:23.525181+0000","last_became_peered":"2023-12-12T09:45:23.525181+0000","last_unstale":"2023-12-12T09:45:38.311552+0000","last_undegraded":"2023-12-12T09:45:38.311552+0000","last_fullsized":"2023-12-12T09:45:38.311552+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_clean_scrub_stamp":"2023-12-12T09:45:22.493994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T11:39:20.601364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-12-12T09:45:38.313081+0000","last_change":"2023-12-12T09:45:38.307793+0000","last_active":"2023-12-12T09:45:38.313081+0000","last_peered":"2023-12-12T09:45:38.313081+0000","last_clean":"2023-12-12T09:45:38.313081+0000","last_became_active":"2023-12-12T09:45:38.307379+0000","last_became_peered":"2023-12-12T09:45:38.307379+0000","last_unstale":"2023-12-12T09:45:38.313081+0000","last_undegraded":"2023-12-12T09:45:38.313081+0000","last_fullsized":"2023-12-12T09:45:38.313081+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:37.621350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:37.621350+0000","last_clean_scrub_stamp":"2023-12-12T09:45:37.621350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T14:20:25.079726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":15,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-12-12T09:45:38.292536+0000","last_change":"2023-12-12T09:45:23.546891+0000","last_active":"2023-12-12T09:45:38.292536+0000","last_peered":"2023-12-12T09:45:38.292536+0000","last_clean":"2023-12-12T09:45:38.292536+0000","last_became_active":"2023-12-12T09:45:23.544703+0000","last_became_peered":"2023-12-12T09:45:23.544703+0000","last_unstale":"2023-12-12T09:45:38.292536+0000","last_undegraded":"2023-12-12T09:45:38.292536+0000","last_fullsized":"2023-12-12T09:45:38.292536+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_clean_scrub_stamp":"2023-12-12T09:45:22.493994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T17:31:24.263383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-12-12T09:45:38.320255+0000","last_change":"2023-12-12T09:45:38.314695+0000","last_active":"2023-12-12T09:45:38.320255+0000","last_peered":"2023-12-12T09:45:38.320255+0000","last_clean":"2023-12-12T09:45:38.320255+0000","last_became_active":"2023-12-12T09:45:38.314341+0000","last_became_peered":"2023-12-12T09:45:38.314341+0000","last_unstale":"2023-12-12T09:45:38.320255+0000","last_undegraded":"2023-12-12T09:45:38.320255+0000","last_fullsized":"2023-12-12T09:45:38.320255+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:37.621350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:37.621350+0000","last_clean_scrub_stamp":"2023-12-12T09:45:37.621350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T16:46:47.550621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":14,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-12-12T09:45:37.632277+0000","last_change":"2023-12-12T09:45:23.542373+0000","last_active":"2023-12-12T09:45:37.632277+0000","last_peered":"2023-12-12T09:45:37.632277+0000","last_clean":"2023-12-12T09:45:37.632277+0000","last_became_active":"2023-12-12T09:45:23.541920+0000","last_became_peered":"2023-12-12T09:45:23.541920+0000","last_unstale":"2023-12-12T09:45:37.632277+0000","last_undegraded":"2023-12-12T09:45:37.632277+0000","last_fullsized":"2023-12-12T09:45:37.632277+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_clean_scrub_stamp":"2023-12-12T09:45:22.493994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T17:51:26.545637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":11,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-12T09:45:39.289099+0000","last_change":"2023-12-12T09:45:38.310075+0000","last_active":"2023-12-12T09:45:39.289099+0000","last_peered":"2023-12-12T09:45:39.289099+0000","last_clean":"2023-12-12T09:45:39.289099+0000","last_became_active":"2023-12-12T09:45:38.309769+0000","last_became_peered":"2023-12-12T09:45:38.309769+0000","last_unstale":"2023-12-12T09:45:39.289099+0000","last_undegraded":"2023-12-12T09:45:39.289099+0000","last_fullsized":"2023-12-12T09:45:39.289099+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:37.621350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:37.621350+0000","last_clean_scrub_stamp":"2023-12-12T09:45:37.621350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T20:26:20.414663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":15,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-12-12T09:45:38.304964+0000","last_change":"2023-12-12T09:45:23.541091+0000","last_active":"2023-12-12T09:45:38.304964+0000","last_peered":"2023-12-12T09:45:38.304964+0000","last_clean":"2023-12-12T09:45:38.304964+0000","last_became_active":"2023-12-12T09:45:23.540514+0000","last_became_peered":"2023-12-12T09:45:23.540514+0000","last_unstale":"2023-12-12T09:45:38.304964+0000","last_undegraded":"2023-12-12T09:45:38.304964+0000","last_fullsized":"2023-12-12T09:45:38.304964+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_clean_scrub_stamp":"2023-12-12T09:45:22.493994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T11:20:23.908314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":11,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-12T09:45:39.284454+0000","last_change":"2023-12-12T09:45:38.313232+0000","last_active":"2023-12-12T09:45:39.284454+0000","last_peered":"2023-12-12T09:45:39.284454+0000","last_clean":"2023-12-12T09:45:39.284454+0000","last_became_active":"2023-12-12T09:45:38.312938+0000","last_became_peered":"2023-12-12T09:45:38.312938+0000","last_unstale":"2023-12-12T09:45:39.284454+0000","last_undegraded":"2023-12-12T09:45:39.284454+0000","last_fullsized":"2023-12-12T09:45:39.284454+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:37.621350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:37.621350+0000","last_clean_scrub_stamp":"2023-12-12T09:45:37.621350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T21:33:57.012215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":14,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-12-12T09:45:37.652620+0000","last_change":"2023-12-12T09:45:23.546206+0000","last_active":"2023-12-12T09:45:37.652620+0000","last_peered":"2023-12-12T09:45:37.652620+0000","last_clean":"2023-12-12T09:45:37.652620+0000","last_became_active":"2023-12-12T09:45:23.545933+0000","last_became_peered":"2023-12-12T09:45:23.545933+0000","last_unstale":"2023-12-12T09:45:37.652620+0000","last_undegraded":"2023-12-12T09:45:37.652620+0000","last_fullsized":"2023-12-12T09:45:37.652620+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_clean_scrub_stamp":"2023-12-12T09:45:22.493994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T21:35:11.842669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":11,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-12T09:45:39.286644+0000","last_change":"2023-12-12T09:45:38.314253+0000","last_active":"2023-12-12T09:45:39.286644+0000","last_peered":"2023-12-12T09:45:39.286644+0000","last_clean":"2023-12-12T09:45:39.286644+0000","last_became_active":"2023-12-12T09:45:38.313932+0000","last_became_peered":"2023-12-12T09:45:38.313932+0000","last_unstale":"2023-12-12T09:45:39.286644+0000","last_undegraded":"2023-12-12T09:45:39.286644+0000","last_fullsized":"2023-12-12T09:45:39.286644+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:37.621350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:37.621350+0000","last_clean_scrub_stamp":"2023-12-12T09:45:37.621350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T12:17:28.983300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":14,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-12-12T09:45:37.665766+0000","last_change":"2023-12-12T09:45:23.554368+0000","last_active":"2023-12-12T09:45:37.665766+0000","last_peered":"2023-12-12T09:45:37.665766+0000","last_clean":"2023-12-12T09:45:37.665766+0000","last_became_active":"2023-12-12T09:45:23.554034+0000","last_became_peered":"2023-12-12T09:45:23.554034+0000","last_unstale":"2023-12-12T09:45:37.665766+0000","last_undegraded":"2023-12-12T09:45:37.665766+0000","last_fullsized":"2023-12-12T09:45:37.665766+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_clean_scrub_stamp":"2023-12-12T09:45:22.493994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T16:08:55.346248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-12-12T09:45:38.319574+0000","last_change":"2023-12-12T09:45:38.311589+0000","last_active":"2023-12-12T09:45:38.319574+0000","last_peered":"2023-12-12T09:45:38.319574+0000","last_clean":"2023-12-12T09:45:38.319574+0000","last_became_active":"2023-12-12T09:45:38.311243+0000","last_became_peered":"2023-12-12T09:45:38.311243+0000","last_unstale":"2023-12-12T09:45:38.319574+0000","last_undegraded":"2023-12-12T09:45:38.319574+0000","last_fullsized":"2023-12-12T09:45:38.319574+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:37.621350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:37.621350+0000","last_clean_scrub_stamp":"2023-12-12T09:45:37.621350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T17:32:34.172961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":15,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-12-12T09:45:38.302233+0000","last_change":"2023-12-12T09:45:23.529597+0000","last_active":"2023-12-12T09:45:38.302233+0000","last_peered":"2023-12-12T09:45:38.302233+0000","last_clean":"2023-12-12T09:45:38.302233+0000","last_became_active":"2023-12-12T09:45:23.524375+0000","last_became_peered":"2023-12-12T09:45:23.524375+0000","last_unstale":"2023-12-12T09:45:38.302233+0000","last_undegraded":"2023-12-12T09:45:38.302233+0000","last_fullsized":"2023-12-12T09:45:38.302233+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_clean_scrub_stamp":"2023-12-12T09:45:22.493994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T16:54:32.416316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":11,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-12T09:45:39.287551+0000","last_change":"2023-12-12T09:45:38.311059+0000","last_active":"2023-12-12T09:45:39.287551+0000","last_peered":"2023-12-12T09:45:39.287551+0000","last_clean":"2023-12-12T09:45:39.287551+0000","last_became_active":"2023-12-12T09:45:38.309505+0000","last_became_peered":"2023-12-12T09:45:38.309505+0000","last_unstale":"2023-12-12T09:45:39.287551+0000","last_undegraded":"2023-12-12T09:45:39.287551+0000","last_fullsized":"2023-12-12T09:45:39.287551+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:37.621350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:37.621350+0000","last_clean_scrub_stamp":"2023-12-12T09:45:37.621350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T21:35:26.970025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":14,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-12-12T09:45:37.631253+0000","last_change":"2023-12-12T09:45:23.553950+0000","last_active":"2023-12-12T09:45:37.631253+0000","last_peered":"2023-12-12T09:45:37.631253+0000","last_clean":"2023-12-12T09:45:37.631253+0000","last_became_active":"2023-12-12T09:45:23.551990+0000","last_became_peered":"2023-12-12T09:45:23.551990+0000","last_unstale":"2023-12-12T09:45:37.631253+0000","last_undegraded":"2023-12-12T09:45:37.631253+0000","last_fullsized":"2023-12-12T09:45:37.631253+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_clean_scrub_stamp":"2023-12-12T09:45:22.493994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T12:19:37.793666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":11,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-12T09:45:39.286047+0000","last_change":"2023-12-12T09:45:38.315488+0000","last_active":"2023-12-12T09:45:39.286047+0000","last_peered":"2023-12-12T09:45:39.286047+0000","last_clean":"2023-12-12T09:45:39.286047+0000","last_became_active":"2023-12-12T09:45:38.315214+0000","last_became_peered":"2023-12-12T09:45:38.315214+0000","last_unstale":"2023-12-12T09:45:39.286047+0000","last_undegraded":"2023-12-12T09:45:39.286047+0000","last_fullsized":"2023-12-12T09:45:39.286047+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:37.621350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:37.621350+0000","last_clean_scrub_stamp":"2023-12-12T09:45:37.621350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T18:13:35.329316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1d","version":"57'2","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-12-12T09:45:38.679989+0000","last_change":"2023-12-12T09:45:37.664314+0000","last_active":"2023-12-12T09:45:38.679989+0000","last_peered":"2023-12-12T09:45:38.679989+0000","last_clean":"2023-12-12T09:45:38.679989+0000","last_became_active":"2023-12-12T09:45:37.664049+0000","last_became_peered":"2023-12-12T09:45:37.664049+0000","last_unstale":"2023-12-12T09:45:38.679989+0000","last_undegraded":"2023-12-12T09:45:38.679989+0000","last_fullsized":"2023-12-12T09:45:38.679989+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:36.607138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:36.607138+0000","last_clean_scrub_stamp":"2023-12-12T09:45:36.607138+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T17:50:39.794657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":14,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-12-12T09:45:37.632732+0000","last_change":"2023-12-12T09:45:23.551190+0000","last_active":"2023-12-12T09:45:37.632732+0000","last_peered":"2023-12-12T09:45:37.632732+0000","last_clean":"2023-12-12T09:45:37.632732+0000","last_became_active":"2023-12-12T09:45:23.550956+0000","last_became_peered":"2023-12-12T09:45:23.550956+0000","last_unstale":"2023-12-12T09:45:37.632732+0000","last_undegraded":"2023-12-12T09:45:37.632732+0000","last_fullsized":"2023-12-12T09:45:37.632732+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_clean_scrub_stamp":"2023-12-12T09:45:22.493994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T14:11:54.140937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1f","version":"53'4","reported_seq":19,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-12-12T09:45:37.631614+0000","last_change":"2023-12-12T09:45:22.537277+0000","last_active":"2023-12-12T09:45:37.631614+0000","last_peered":"2023-12-12T09:45:37.631614+0000","last_clean":"2023-12-12T09:45:37.631614+0000","last_became_active":"2023-12-12T09:45:22.536893+0000","last_became_peered":"2023-12-12T09:45:22.536893+0000","last_unstale":"2023-12-12T09:45:37.631614+0000","last_undegraded":"2023-12-12T09:45:37.631614+0000","last_fullsized":"2023-12-12T09:45:37.631614+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:21.477323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:21.477323+0000","last_clean_scrub_stamp":"2023-12-12T09:45:21.477323+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T16:38:00.043063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-12-12T09:45:38.322883+0000","last_change":"2023-12-12T09:45:38.318399+0000","last_active":"2023-12-12T09:45:38.322883+0000","last_peered":"2023-12-12T09:45:38.322883+0000","last_clean":"2023-12-12T09:45:38.322883+0000","last_became_active":"2023-12-12T09:45:38.317682+0000","last_became_peered":"2023-12-12T09:45:38.317682+0000","last_unstale":"2023-12-12T09:45:38.322883+0000","last_undegraded":"2023-12-12T09:45:38.322883+0000","last_fullsized":"2023-12-12T09:45:38.322883+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:37.621350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:37.621350+0000","last_clean_scrub_stamp":"2023-12-12T09:45:37.621350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T21:35:26.970025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1c","version":"57'2","reported_seq":14,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-12T09:45:39.286770+0000","last_change":"2023-12-12T09:45:37.664992+0000","last_active":"2023-12-12T09:45:39.286770+0000","last_peered":"2023-12-12T09:45:39.286770+0000","last_clean":"2023-12-12T09:45:39.286770+0000","last_became_active":"2023-12-12T09:45:37.664644+0000","last_became_peered":"2023-12-12T09:45:37.664644+0000","last_unstale":"2023-12-12T09:45:39.286770+0000","last_undegraded":"2023-12-12T09:45:39.286770+0000","last_fullsized":"2023-12-12T09:45:39.286770+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:36.607138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:36.607138+0000","last_clean_scrub_stamp":"2023-12-12T09:45:36.607138+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T10:09:11.162511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":14,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-12-12T09:45:37.645050+0000","last_change":"2023-12-12T09:45:23.549535+0000","last_active":"2023-12-12T09:45:37.645050+0000","last_peered":"2023-12-12T09:45:37.645050+0000","last_clean":"2023-12-12T09:45:37.645050+0000","last_became_active":"2023-12-12T09:45:23.549256+0000","last_became_peered":"2023-12-12T09:45:23.549256+0000","last_unstale":"2023-12-12T09:45:37.645050+0000","last_undegraded":"2023-12-12T09:45:37.645050+0000","last_fullsized":"2023-12-12T09:45:37.645050+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_clean_scrub_stamp":"2023-12-12T09:45:22.493994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T15:15:38.448721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"53'1","reported_seq":16,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-12-12T09:45:37.652874+0000","last_change":"2023-12-12T09:45:22.543679+0000","last_active":"2023-12-12T09:45:37.652874+0000","last_peered":"2023-12-12T09:45:37.652874+0000","last_clean":"2023-12-12T09:45:37.652874+0000","last_became_active":"2023-12-12T09:45:22.543357+0000","last_became_peered":"2023-12-12T09:45:22.543357+0000","last_unstale":"2023-12-12T09:45:37.652874+0000","last_undegraded":"2023-12-12T09:45:37.652874+0000","last_fullsized":"2023-12-12T09:45:37.652874+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:21.477323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:21.477323+0000","last_clean_scrub_stamp":"2023-12-12T09:45:21.477323+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T13:19:15.975105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-12-12T09:45:38.323536+0000","last_change":"2023-12-12T09:45:38.321058+0000","last_active":"2023-12-12T09:45:38.323536+0000","last_peered":"2023-12-12T09:45:38.323536+0000","last_clean":"2023-12-12T09:45:38.323536+0000","last_became_active":"2023-12-12T09:45:38.320720+0000","last_became_peered":"2023-12-12T09:45:38.320720+0000","last_unstale":"2023-12-12T09:45:38.323536+0000","last_undegraded":"2023-12-12T09:45:38.323536+0000","last_fullsized":"2023-12-12T09:45:38.323536+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:37.621350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:37.621350+0000","last_clean_scrub_stamp":"2023-12-12T09:45:37.621350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T18:13:35.329316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1f","version":"57'4","reported_seq":15,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-12-12T09:45:38.688058+0000","last_change":"2023-12-12T09:45:37.671340+0000","last_active":"2023-12-12T09:45:38.688058+0000","last_peered":"2023-12-12T09:45:38.688058+0000","last_clean":"2023-12-12T09:45:38.688058+0000","last_became_active":"2023-12-12T09:45:37.671045+0000","last_became_peered":"2023-12-12T09:45:37.671045+0000","last_unstale":"2023-12-12T09:45:38.688058+0000","last_undegraded":"2023-12-12T09:45:38.688058+0000","last_fullsized":"2023-12-12T09:45:38.688058+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:36.607138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:36.607138+0000","last_clean_scrub_stamp":"2023-12-12T09:45:36.607138+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T12:01:00.044592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":14,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-12-12T09:45:37.631917+0000","last_change":"2023-12-12T09:45:23.531455+0000","last_active":"2023-12-12T09:45:37.631917+0000","last_peered":"2023-12-12T09:45:37.631917+0000","last_clean":"2023-12-12T09:45:37.631917+0000","last_became_active":"2023-12-12T09:45:23.531164+0000","last_became_peered":"2023-12-12T09:45:23.531164+0000","last_unstale":"2023-12-12T09:45:37.631917+0000","last_undegraded":"2023-12-12T09:45:37.631917+0000","last_fullsized":"2023-12-12T09:45:37.631917+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_clean_scrub_stamp":"2023-12-12T09:45:22.493994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T14:54:10.661378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"53'2","reported_seq":17,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-12-12T09:45:37.632615+0000","last_change":"2023-12-12T09:45:22.531101+0000","last_active":"2023-12-12T09:45:37.632615+0000","last_peered":"2023-12-12T09:45:37.632615+0000","last_clean":"2023-12-12T09:45:37.632615+0000","last_became_active":"2023-12-12T09:45:22.530822+0000","last_became_peered":"2023-12-12T09:45:22.530822+0000","last_unstale":"2023-12-12T09:45:37.632615+0000","last_undegraded":"2023-12-12T09:45:37.632615+0000","last_fullsized":"2023-12-12T09:45:37.632615+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:21.477323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:21.477323+0000","last_clean_scrub_stamp":"2023-12-12T09:45:21.477323+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T21:23:16.895410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":11,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-12T09:45:39.286786+0000","last_change":"2023-12-12T09:45:38.319771+0000","last_active":"2023-12-12T09:45:39.286786+0000","last_peered":"2023-12-12T09:45:39.286786+0000","last_clean":"2023-12-12T09:45:39.286786+0000","last_became_active":"2023-12-12T09:45:38.319344+0000","last_became_peered":"2023-12-12T09:45:38.319344+0000","last_unstale":"2023-12-12T09:45:39.286786+0000","last_undegraded":"2023-12-12T09:45:39.286786+0000","last_fullsized":"2023-12-12T09:45:39.286786+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:37.621350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:37.621350+0000","last_clean_scrub_stamp":"2023-12-12T09:45:37.621350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T19:02:05.650265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1e","version":"57'1","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-12-12T09:45:38.684885+0000","last_change":"2023-12-12T09:45:37.661347+0000","last_active":"2023-12-12T09:45:38.684885+0000","last_peered":"2023-12-12T09:45:38.684885+0000","last_clean":"2023-12-12T09:45:38.684885+0000","last_became_active":"2023-12-12T09:45:37.661023+0000","last_became_peered":"2023-12-12T09:45:37.661023+0000","last_unstale":"2023-12-12T09:45:38.684885+0000","last_undegraded":"2023-12-12T09:45:38.684885+0000","last_fullsized":"2023-12-12T09:45:38.684885+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:36.607138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:36.607138+0000","last_clean_scrub_stamp":"2023-12-12T09:45:36.607138+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T21:35:25.955813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":14,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-12-12T09:45:37.632736+0000","last_change":"2023-12-12T09:45:23.548842+0000","last_active":"2023-12-12T09:45:37.632736+0000","last_peered":"2023-12-12T09:45:37.632736+0000","last_clean":"2023-12-12T09:45:37.632736+0000","last_became_active":"2023-12-12T09:45:23.548561+0000","last_became_peered":"2023-12-12T09:45:23.548561+0000","last_unstale":"2023-12-12T09:45:37.632736+0000","last_undegraded":"2023-12-12T09:45:37.632736+0000","last_fullsized":"2023-12-12T09:45:37.632736+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_clean_scrub_stamp":"2023-12-12T09:45:22.493994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T10:08:57.049367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1c","version":"53'2","reported_seq":18,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-12-12T09:45:38.284403+0000","last_change":"2023-12-12T09:45:22.540050+0000","last_active":"2023-12-12T09:45:38.284403+0000","last_peered":"2023-12-12T09:45:38.284403+0000","last_clean":"2023-12-12T09:45:38.284403+0000","last_became_active":"2023-12-12T09:45:22.539726+0000","last_became_peered":"2023-12-12T09:45:22.539726+0000","last_unstale":"2023-12-12T09:45:38.284403+0000","last_undegraded":"2023-12-12T09:45:38.284403+0000","last_fullsized":"2023-12-12T09:45:38.284403+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:21.477323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:21.477323+0000","last_clean_scrub_stamp":"2023-12-12T09:45:21.477323+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T19:19:47.388523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":11,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-12T09:45:39.284157+0000","last_change":"2023-12-12T09:45:38.315934+0000","last_active":"2023-12-12T09:45:39.284157+0000","last_peered":"2023-12-12T09:45:39.284157+0000","last_clean":"2023-12-12T09:45:39.284157+0000","last_became_active":"2023-12-12T09:45:38.315644+0000","last_became_peered":"2023-12-12T09:45:38.315644+0000","last_unstale":"2023-12-12T09:45:39.284157+0000","last_undegraded":"2023-12-12T09:45:39.284157+0000","last_fullsized":"2023-12-12T09:45:39.284157+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:37.621350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:37.621350+0000","last_clean_scrub_stamp":"2023-12-12T09:45:37.621350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T16:38:16.187090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":11,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-12-12T09:45:38.285530+0000","last_change":"2023-12-12T09:45:37.661790+0000","last_active":"2023-12-12T09:45:38.285530+0000","last_peered":"2023-12-12T09:45:38.285530+0000","last_clean":"2023-12-12T09:45:38.285530+0000","last_became_active":"2023-12-12T09:45:37.661468+0000","last_became_peered":"2023-12-12T09:45:37.661468+0000","last_unstale":"2023-12-12T09:45:38.285530+0000","last_undegraded":"2023-12-12T09:45:38.285530+0000","last_fullsized":"2023-12-12T09:45:38.285530+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:36.607138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:36.607138+0000","last_clean_scrub_stamp":"2023-12-12T09:45:36.607138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T16:46:46.536409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":14,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-12-12T09:45:37.652379+0000","last_change":"2023-12-12T09:45:23.536948+0000","last_active":"2023-12-12T09:45:37.652379+0000","last_peered":"2023-12-12T09:45:37.652379+0000","last_clean":"2023-12-12T09:45:37.652379+0000","last_became_active":"2023-12-12T09:45:23.536696+0000","last_became_peered":"2023-12-12T09:45:23.536696+0000","last_unstale":"2023-12-12T09:45:37.652379+0000","last_undegraded":"2023-12-12T09:45:37.652379+0000","last_fullsized":"2023-12-12T09:45:37.652379+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_clean_scrub_stamp":"2023-12-12T09:45:22.493994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T21:33:41.884858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"53'1","reported_seq":16,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-12-12T09:45:37.649456+0000","last_change":"2023-12-12T09:45:22.543941+0000","last_active":"2023-12-12T09:45:37.649456+0000","last_peered":"2023-12-12T09:45:37.649456+0000","last_clean":"2023-12-12T09:45:37.649456+0000","last_became_active":"2023-12-12T09:45:22.543584+0000","last_became_peered":"2023-12-12T09:45:22.543584+0000","last_unstale":"2023-12-12T09:45:37.649456+0000","last_undegraded":"2023-12-12T09:45:37.649456+0000","last_fullsized":"2023-12-12T09:45:37.649456+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:21.477323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:21.477323+0000","last_clean_scrub_stamp":"2023-12-12T09:45:21.477323+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T13:28:37.770730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-12-12T09:45:38.315367+0000","last_change":"2023-12-12T09:45:38.313200+0000","last_active":"2023-12-12T09:45:38.315367+0000","last_peered":"2023-12-12T09:45:38.315367+0000","last_clean":"2023-12-12T09:45:38.315367+0000","last_became_active":"2023-12-12T09:45:38.312678+0000","last_became_peered":"2023-12-12T09:45:38.312678+0000","last_unstale":"2023-12-12T09:45:38.315367+0000","last_undegraded":"2023-12-12T09:45:38.315367+0000","last_fullsized":"2023-12-12T09:45:38.315367+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:37.621350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:37.621350+0000","last_clean_scrub_stamp":"2023-12-12T09:45:37.621350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T20:28:29.320280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":12,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-12T09:45:39.284250+0000","last_change":"2023-12-12T09:45:37.654995+0000","last_active":"2023-12-12T09:45:39.284250+0000","last_peered":"2023-12-12T09:45:39.284250+0000","last_clean":"2023-12-12T09:45:39.284250+0000","last_became_active":"2023-12-12T09:45:37.654684+0000","last_became_peered":"2023-12-12T09:45:37.654684+0000","last_unstale":"2023-12-12T09:45:39.284250+0000","last_undegraded":"2023-12-12T09:45:39.284250+0000","last_fullsized":"2023-12-12T09:45:39.284250+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:36.607138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:36.607138+0000","last_clean_scrub_stamp":"2023-12-12T09:45:36.607138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T20:54:32.568354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":14,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-12-12T09:45:37.652411+0000","last_change":"2023-12-12T09:45:23.553762+0000","last_active":"2023-12-12T09:45:37.652411+0000","last_peered":"2023-12-12T09:45:37.652411+0000","last_clean":"2023-12-12T09:45:37.652411+0000","last_became_active":"2023-12-12T09:45:23.553518+0000","last_became_peered":"2023-12-12T09:45:23.553518+0000","last_unstale":"2023-12-12T09:45:37.652411+0000","last_undegraded":"2023-12-12T09:45:37.652411+0000","last_fullsized":"2023-12-12T09:45:37.652411+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_clean_scrub_stamp":"2023-12-12T09:45:22.493994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T21:11:37.302926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1a","version":"53'1","reported_seq":16,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-12-12T09:45:37.631526+0000","last_change":"2023-12-12T09:45:22.535525+0000","last_active":"2023-12-12T09:45:37.631526+0000","last_peered":"2023-12-12T09:45:37.631526+0000","last_clean":"2023-12-12T09:45:37.631526+0000","last_became_active":"2023-12-12T09:45:22.534726+0000","last_became_peered":"2023-12-12T09:45:22.534726+0000","last_unstale":"2023-12-12T09:45:37.631526+0000","last_undegraded":"2023-12-12T09:45:37.631526+0000","last_fullsized":"2023-12-12T09:45:37.631526+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:21.477323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:21.477323+0000","last_clean_scrub_stamp":"2023-12-12T09:45:21.477323+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T16:23:29.088120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":11,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-12T09:45:39.287649+0000","last_change":"2023-12-12T09:45:38.312469+0000","last_active":"2023-12-12T09:45:39.287649+0000","last_peered":"2023-12-12T09:45:39.287649+0000","last_clean":"2023-12-12T09:45:39.287649+0000","last_became_active":"2023-12-12T09:45:38.311922+0000","last_became_peered":"2023-12-12T09:45:38.311922+0000","last_unstale":"2023-12-12T09:45:39.287649+0000","last_undegraded":"2023-12-12T09:45:39.287649+0000","last_fullsized":"2023-12-12T09:45:39.287649+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:37.621350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:37.621350+0000","last_clean_scrub_stamp":"2023-12-12T09:45:37.621350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T21:11:52.430282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1b","version":"57'1","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-12-12T09:45:38.676153+0000","last_change":"2023-12-12T09:45:37.661772+0000","last_active":"2023-12-12T09:45:38.676153+0000","last_peered":"2023-12-12T09:45:38.676153+0000","last_clean":"2023-12-12T09:45:38.676153+0000","last_became_active":"2023-12-12T09:45:37.661511+0000","last_became_peered":"2023-12-12T09:45:37.661511+0000","last_unstale":"2023-12-12T09:45:38.676153+0000","last_undegraded":"2023-12-12T09:45:38.676153+0000","last_fullsized":"2023-12-12T09:45:38.676153+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:36.607138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:36.607138+0000","last_clean_scrub_stamp":"2023-12-12T09:45:36.607138+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T10:33:43.572550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":15,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-12-12T09:45:38.304395+0000","last_change":"2023-12-12T09:45:23.550084+0000","last_active":"2023-12-12T09:45:38.304395+0000","last_peered":"2023-12-12T09:45:38.304395+0000","last_clean":"2023-12-12T09:45:38.304395+0000","last_became_active":"2023-12-12T09:45:23.549808+0000","last_became_peered":"2023-12-12T09:45:23.549808+0000","last_unstale":"2023-12-12T09:45:38.304395+0000","last_undegraded":"2023-12-12T09:45:38.304395+0000","last_fullsized":"2023-12-12T09:45:38.304395+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_clean_scrub_stamp":"2023-12-12T09:45:22.493994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T18:05:50.089314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":16,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-12-12T09:45:38.285385+0000","last_change":"2023-12-12T09:45:22.531465+0000","last_active":"2023-12-12T09:45:38.285385+0000","last_peered":"2023-12-12T09:45:38.285385+0000","last_clean":"2023-12-12T09:45:38.285385+0000","last_became_active":"2023-12-12T09:45:22.531205+0000","last_became_peered":"2023-12-12T09:45:22.531205+0000","last_unstale":"2023-12-12T09:45:38.285385+0000","last_undegraded":"2023-12-12T09:45:38.285385+0000","last_fullsized":"2023-12-12T09:45:38.285385+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:21.477323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:21.477323+0000","last_clean_scrub_stamp":"2023-12-12T09:45:21.477323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T13:28:37.770730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-12-12T09:45:38.319788+0000","last_change":"2023-12-12T09:45:38.313443+0000","last_active":"2023-12-12T09:45:38.319788+0000","last_peered":"2023-12-12T09:45:38.319788+0000","last_clean":"2023-12-12T09:45:38.319788+0000","last_became_active":"2023-12-12T09:45:38.313086+0000","last_became_peered":"2023-12-12T09:45:38.313086+0000","last_unstale":"2023-12-12T09:45:38.319788+0000","last_undegraded":"2023-12-12T09:45:38.319788+0000","last_fullsized":"2023-12-12T09:45:38.319788+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:37.621350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:37.621350+0000","last_clean_scrub_stamp":"2023-12-12T09:45:37.621350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T12:19:52.921022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.1a","version":"57'1","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-12T09:45:39.285907+0000","last_change":"2023-12-12T09:45:37.662619+0000","last_active":"2023-12-12T09:45:39.285907+0000","last_peered":"2023-12-12T09:45:39.285907+0000","last_clean":"2023-12-12T09:45:39.285907+0000","last_became_active":"2023-12-12T09:45:37.661632+0000","last_became_peered":"2023-12-12T09:45:37.661632+0000","last_unstale":"2023-12-12T09:45:39.285907+0000","last_undegraded":"2023-12-12T09:45:39.285907+0000","last_fullsized":"2023-12-12T09:45:39.285907+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:36.607138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:36.607138+0000","last_clean_scrub_stamp":"2023-12-12T09:45:36.607138+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T20:14:34.767780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":14,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-12-12T09:45:37.651320+0000","last_change":"2023-12-12T09:45:23.542175+0000","last_active":"2023-12-12T09:45:37.651320+0000","last_peered":"2023-12-12T09:45:37.651320+0000","last_clean":"2023-12-12T09:45:37.651320+0000","last_became_active":"2023-12-12T09:45:23.541908+0000","last_became_peered":"2023-12-12T09:45:23.541908+0000","last_unstale":"2023-12-12T09:45:37.651320+0000","last_undegraded":"2023-12-12T09:45:37.651320+0000","last_fullsized":"2023-12-12T09:45:37.651320+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_clean_scrub_stamp":"2023-12-12T09:45:22.493994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T12:15:05.167806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":15,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-12-12T09:45:37.650465+0000","last_change":"2023-12-12T09:45:22.540369+0000","last_active":"2023-12-12T09:45:37.650465+0000","last_peered":"2023-12-12T09:45:37.650465+0000","last_clean":"2023-12-12T09:45:37.650465+0000","last_became_active":"2023-12-12T09:45:22.540054+0000","last_became_peered":"2023-12-12T09:45:22.540054+0000","last_unstale":"2023-12-12T09:45:37.650465+0000","last_undegraded":"2023-12-12T09:45:37.650465+0000","last_fullsized":"2023-12-12T09:45:37.650465+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:21.477323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:21.477323+0000","last_clean_scrub_stamp":"2023-12-12T09:45:21.477323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T14:03:02.042556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":11,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-12T09:45:39.286256+0000","last_change":"2023-12-12T09:45:38.308618+0000","last_active":"2023-12-12T09:45:39.286256+0000","last_peered":"2023-12-12T09:45:39.286256+0000","last_clean":"2023-12-12T09:45:39.286256+0000","last_became_active":"2023-12-12T09:45:38.307785+0000","last_became_peered":"2023-12-12T09:45:38.307785+0000","last_unstale":"2023-12-12T09:45:39.286256+0000","last_undegraded":"2023-12-12T09:45:39.286256+0000","last_fullsized":"2023-12-12T09:45:39.286256+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:37.621350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:37.621350+0000","last_clean_scrub_stamp":"2023-12-12T09:45:37.621350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T12:15:20.295162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.15","version":"57'3","reported_seq":14,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-12-12T09:45:38.684679+0000","last_change":"2023-12-12T09:45:37.656613+0000","last_active":"2023-12-12T09:45:38.684679+0000","last_peered":"2023-12-12T09:45:38.684679+0000","last_clean":"2023-12-12T09:45:38.684679+0000","last_became_active":"2023-12-12T09:45:37.656145+0000","last_became_peered":"2023-12-12T09:45:37.656145+0000","last_unstale":"2023-12-12T09:45:38.684679+0000","last_undegraded":"2023-12-12T09:45:38.684679+0000","last_fullsized":"2023-12-12T09:45:38.684679+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:36.607138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:36.607138+0000","last_clean_scrub_stamp":"2023-12-12T09:45:36.607138+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T14:21:13.249073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":14,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-12-12T09:45:37.652235+0000","last_change":"2023-12-12T09:45:23.552875+0000","last_active":"2023-12-12T09:45:37.652235+0000","last_peered":"2023-12-12T09:45:37.652235+0000","last_clean":"2023-12-12T09:45:37.652235+0000","last_became_active":"2023-12-12T09:45:23.551034+0000","last_became_peered":"2023-12-12T09:45:23.551034+0000","last_unstale":"2023-12-12T09:45:37.652235+0000","last_undegraded":"2023-12-12T09:45:37.652235+0000","last_fullsized":"2023-12-12T09:45:37.652235+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_clean_scrub_stamp":"2023-12-12T09:45:22.493994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T19:01:50.522909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":15,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-12-12T09:45:37.667795+0000","last_change":"2023-12-12T09:45:22.546259+0000","last_active":"2023-12-12T09:45:37.667795+0000","last_peered":"2023-12-12T09:45:37.667795+0000","last_clean":"2023-12-12T09:45:37.667795+0000","last_became_active":"2023-12-12T09:45:22.545948+0000","last_became_peered":"2023-12-12T09:45:22.545948+0000","last_unstale":"2023-12-12T09:45:37.667795+0000","last_undegraded":"2023-12-12T09:45:37.667795+0000","last_fullsized":"2023-12-12T09:45:37.667795+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:21.477323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:21.477323+0000","last_clean_scrub_stamp":"2023-12-12T09:45:21.477323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T19:19:47.388523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":11,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-12T09:45:39.285473+0000","last_change":"2023-12-12T09:45:38.308843+0000","last_active":"2023-12-12T09:45:39.285473+0000","last_peered":"2023-12-12T09:45:39.285473+0000","last_clean":"2023-12-12T09:45:39.285473+0000","last_became_active":"2023-12-12T09:45:38.308367+0000","last_became_peered":"2023-12-12T09:45:38.308367+0000","last_unstale":"2023-12-12T09:45:39.285473+0000","last_undegraded":"2023-12-12T09:45:39.285473+0000","last_fullsized":"2023-12-12T09:45:39.285473+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:37.621350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:37.621350+0000","last_clean_scrub_stamp":"2023-12-12T09:45:37.621350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T10:40:58.336593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.14","version":"57'6","reported_seq":17,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-12-12T09:45:38.688553+0000","last_change":"2023-12-12T09:45:37.655387+0000","last_active":"2023-12-12T09:45:38.688553+0000","last_peered":"2023-12-12T09:45:38.688553+0000","last_clean":"2023-12-12T09:45:38.688553+0000","last_became_active":"2023-12-12T09:45:37.655122+0000","last_became_peered":"2023-12-12T09:45:37.655122+0000","last_unstale":"2023-12-12T09:45:38.688553+0000","last_undegraded":"2023-12-12T09:45:38.688553+0000","last_fullsized":"2023-12-12T09:45:38.688553+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:36.607138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:36.607138+0000","last_clean_scrub_stamp":"2023-12-12T09:45:36.607138+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T12:19:51.906810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":14,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-12-12T09:45:37.667770+0000","last_change":"2023-12-12T09:45:23.556637+0000","last_active":"2023-12-12T09:45:37.667770+0000","last_peered":"2023-12-12T09:45:37.667770+0000","last_clean":"2023-12-12T09:45:37.667770+0000","last_became_active":"2023-12-12T09:45:23.556344+0000","last_became_peered":"2023-12-12T09:45:23.556344+0000","last_unstale":"2023-12-12T09:45:37.667770+0000","last_undegraded":"2023-12-12T09:45:37.667770+0000","last_fullsized":"2023-12-12T09:45:37.667770+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_clean_scrub_stamp":"2023-12-12T09:45:22.493994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T14:11:54.140937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":15,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-12-12T09:45:37.652960+0000","last_change":"2023-12-12T09:45:22.537346+0000","last_active":"2023-12-12T09:45:37.652960+0000","last_peered":"2023-12-12T09:45:37.652960+0000","last_clean":"2023-12-12T09:45:37.652960+0000","last_became_active":"2023-12-12T09:45:22.535141+0000","last_became_peered":"2023-12-12T09:45:22.535141+0000","last_unstale":"2023-12-12T09:45:37.652960+0000","last_undegraded":"2023-12-12T09:45:37.652960+0000","last_fullsized":"2023-12-12T09:45:37.652960+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:21.477323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:21.477323+0000","last_clean_scrub_stamp":"2023-12-12T09:45:21.477323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T18:37:25.938135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":11,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-12T09:45:39.289104+0000","last_change":"2023-12-12T09:45:38.311804+0000","last_active":"2023-12-12T09:45:39.289104+0000","last_peered":"2023-12-12T09:45:39.289104+0000","last_clean":"2023-12-12T09:45:39.289104+0000","last_became_active":"2023-12-12T09:45:38.311335+0000","last_became_peered":"2023-12-12T09:45:38.311335+0000","last_unstale":"2023-12-12T09:45:39.289104+0000","last_undegraded":"2023-12-12T09:45:39.289104+0000","last_fullsized":"2023-12-12T09:45:39.289104+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:37.621350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:37.621350+0000","last_clean_scrub_stamp":"2023-12-12T09:45:37.621350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T15:35:25.282517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":11,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-12-12T09:45:38.291275+0000","last_change":"2023-12-12T09:45:37.657826+0000","last_active":"2023-12-12T09:45:38.291275+0000","last_peered":"2023-12-12T09:45:38.291275+0000","last_clean":"2023-12-12T09:45:38.291275+0000","last_became_active":"2023-12-12T09:45:37.657533+0000","last_became_peered":"2023-12-12T09:45:37.657533+0000","last_unstale":"2023-12-12T09:45:38.291275+0000","last_undegraded":"2023-12-12T09:45:38.291275+0000","last_fullsized":"2023-12-12T09:45:38.291275+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:36.607138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:36.607138+0000","last_clean_scrub_stamp":"2023-12-12T09:45:36.607138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T18:37:41.067950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":14,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-12-12T09:45:37.638699+0000","last_change":"2023-12-12T09:45:23.549595+0000","last_active":"2023-12-12T09:45:37.638699+0000","last_peered":"2023-12-12T09:45:37.638699+0000","last_clean":"2023-12-12T09:45:37.638699+0000","last_became_active":"2023-12-12T09:45:23.549247+0000","last_became_peered":"2023-12-12T09:45:23.549247+0000","last_unstale":"2023-12-12T09:45:37.638699+0000","last_undegraded":"2023-12-12T09:45:37.638699+0000","last_fullsized":"2023-12-12T09:45:37.638699+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_clean_scrub_stamp":"2023-12-12T09:45:22.493994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T14:03:03.059227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.15","version":"53'3","reported_seq":18,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-12-12T09:45:37.667028+0000","last_change":"2023-12-12T09:45:22.546308+0000","last_active":"2023-12-12T09:45:37.667028+0000","last_peered":"2023-12-12T09:45:37.667028+0000","last_clean":"2023-12-12T09:45:37.667028+0000","last_became_active":"2023-12-12T09:45:22.545942+0000","last_became_peered":"2023-12-12T09:45:22.545942+0000","last_unstale":"2023-12-12T09:45:37.667028+0000","last_undegraded":"2023-12-12T09:45:37.667028+0000","last_fullsized":"2023-12-12T09:45:37.667028+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:21.477323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:21.477323+0000","last_clean_scrub_stamp":"2023-12-12T09:45:21.477323+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T13:07:07.278574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-12-12T09:45:38.323755+0000","last_change":"2023-12-12T09:45:38.322221+0000","last_active":"2023-12-12T09:45:38.323755+0000","last_peered":"2023-12-12T09:45:38.323755+0000","last_clean":"2023-12-12T09:45:38.323755+0000","last_became_active":"2023-12-12T09:45:38.321756+0000","last_became_peered":"2023-12-12T09:45:38.321756+0000","last_unstale":"2023-12-12T09:45:38.323755+0000","last_undegraded":"2023-12-12T09:45:38.323755+0000","last_fullsized":"2023-12-12T09:45:38.323755+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:37.621350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:37.621350+0000","last_clean_scrub_stamp":"2023-12-12T09:45:37.621350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T20:28:29.320280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":12,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-12T09:45:39.286515+0000","last_change":"2023-12-12T09:45:37.670968+0000","last_active":"2023-12-12T09:45:39.286515+0000","last_peered":"2023-12-12T09:45:39.286515+0000","last_clean":"2023-12-12T09:45:39.286515+0000","last_became_active":"2023-12-12T09:45:37.670209+0000","last_became_peered":"2023-12-12T09:45:37.670209+0000","last_unstale":"2023-12-12T09:45:39.286515+0000","last_undegraded":"2023-12-12T09:45:39.286515+0000","last_fullsized":"2023-12-12T09:45:39.286515+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:36.607138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:36.607138+0000","last_clean_scrub_stamp":"2023-12-12T09:45:36.607138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T14:20:24.065514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":14,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-12-12T09:45:37.666870+0000","last_change":"2023-12-12T09:45:23.557554+0000","last_active":"2023-12-12T09:45:37.666870+0000","last_peered":"2023-12-12T09:45:37.666870+0000","last_clean":"2023-12-12T09:45:37.666870+0000","last_became_active":"2023-12-12T09:45:23.557239+0000","last_became_peered":"2023-12-12T09:45:23.557239+0000","last_unstale":"2023-12-12T09:45:37.666870+0000","last_undegraded":"2023-12-12T09:45:37.666870+0000","last_fullsized":"2023-12-12T09:45:37.666870+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_clean_scrub_stamp":"2023-12-12T09:45:22.493994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T14:16:48.793935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.14","version":"54'9","reported_seq":24,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-12-12T09:45:37.649815+0000","last_change":"2023-12-12T09:45:22.543924+0000","last_active":"2023-12-12T09:45:37.649815+0000","last_peered":"2023-12-12T09:45:37.649815+0000","last_clean":"2023-12-12T09:45:37.649815+0000","last_became_active":"2023-12-12T09:45:22.543617+0000","last_became_peered":"2023-12-12T09:45:22.543617+0000","last_unstale":"2023-12-12T09:45:37.649815+0000","last_undegraded":"2023-12-12T09:45:37.649815+0000","last_fullsized":"2023-12-12T09:45:37.649815+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:21.477323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:21.477323+0000","last_clean_scrub_stamp":"2023-12-12T09:45:21.477323+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T20:52:44.328181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3107,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-12-12T09:45:38.328138+0000","last_change":"2023-12-12T09:45:38.322753+0000","last_active":"2023-12-12T09:45:38.328138+0000","last_peered":"2023-12-12T09:45:38.328138+0000","last_clean":"2023-12-12T09:45:38.328138+0000","last_became_active":"2023-12-12T09:45:38.322472+0000","last_became_peered":"2023-12-12T09:45:38.322472+0000","last_unstale":"2023-12-12T09:45:38.328138+0000","last_undegraded":"2023-12-12T09:45:38.328138+0000","last_fullsized":"2023-12-12T09:45:38.328138+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:37.621350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:37.621350+0000","last_clean_scrub_stamp":"2023-12-12T09:45:37.621350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T18:13:35.329316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":12,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-12T09:45:39.285188+0000","last_change":"2023-12-12T09:45:37.652907+0000","last_active":"2023-12-12T09:45:39.285188+0000","last_peered":"2023-12-12T09:45:39.285188+0000","last_clean":"2023-12-12T09:45:39.285188+0000","last_became_active":"2023-12-12T09:45:37.652489+0000","last_became_peered":"2023-12-12T09:45:37.652489+0000","last_unstale":"2023-12-12T09:45:39.285188+0000","last_undegraded":"2023-12-12T09:45:39.285188+0000","last_fullsized":"2023-12-12T09:45:39.285188+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:36.607138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:36.607138+0000","last_clean_scrub_stamp":"2023-12-12T09:45:36.607138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T18:13:34.315104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":15,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-12-12T09:45:38.287705+0000","last_change":"2023-12-12T09:45:23.542417+0000","last_active":"2023-12-12T09:45:38.287705+0000","last_peered":"2023-12-12T09:45:38.287705+0000","last_clean":"2023-12-12T09:45:38.287705+0000","last_became_active":"2023-12-12T09:45:23.541778+0000","last_became_peered":"2023-12-12T09:45:23.541778+0000","last_unstale":"2023-12-12T09:45:38.287705+0000","last_undegraded":"2023-12-12T09:45:38.287705+0000","last_fullsized":"2023-12-12T09:45:38.287705+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_clean_scrub_stamp":"2023-12-12T09:45:22.493994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T13:07:08.295245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"53'2","reported_seq":17,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-12-12T09:45:37.652528+0000","last_change":"2023-12-12T09:45:22.531079+0000","last_active":"2023-12-12T09:45:37.652528+0000","last_peered":"2023-12-12T09:45:37.652528+0000","last_clean":"2023-12-12T09:45:37.652528+0000","last_became_active":"2023-12-12T09:45:22.530821+0000","last_became_peered":"2023-12-12T09:45:22.530821+0000","last_unstale":"2023-12-12T09:45:37.652528+0000","last_undegraded":"2023-12-12T09:45:37.652528+0000","last_fullsized":"2023-12-12T09:45:37.652528+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:21.477323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:21.477323+0000","last_clean_scrub_stamp":"2023-12-12T09:45:21.477323+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T14:54:09.644707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":11,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-12T09:45:39.284847+0000","last_change":"2023-12-12T09:45:38.319062+0000","last_active":"2023-12-12T09:45:39.284847+0000","last_peered":"2023-12-12T09:45:39.284847+0000","last_clean":"2023-12-12T09:45:39.284847+0000","last_became_active":"2023-12-12T09:45:38.318665+0000","last_became_peered":"2023-12-12T09:45:38.318665+0000","last_unstale":"2023-12-12T09:45:39.284847+0000","last_undegraded":"2023-12-12T09:45:39.284847+0000","last_fullsized":"2023-12-12T09:45:39.284847+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:37.621350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:37.621350+0000","last_clean_scrub_stamp":"2023-12-12T09:45:37.621350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T15:15:53.576077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.10","version":"57'8","reported_seq":19,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-12-12T09:45:38.678794+0000","last_change":"2023-12-12T09:45:37.669586+0000","last_active":"2023-12-12T09:45:38.678794+0000","last_peered":"2023-12-12T09:45:38.678794+0000","last_clean":"2023-12-12T09:45:38.678794+0000","last_became_active":"2023-12-12T09:45:37.669283+0000","last_became_peered":"2023-12-12T09:45:37.669283+0000","last_unstale":"2023-12-12T09:45:38.678794+0000","last_undegraded":"2023-12-12T09:45:38.678794+0000","last_fullsized":"2023-12-12T09:45:38.678794+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:36.607138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:36.607138+0000","last_clean_scrub_stamp":"2023-12-12T09:45:36.607138+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T14:12:08.254081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":14,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-12-12T09:45:37.666364+0000","last_change":"2023-12-12T09:45:23.550533+0000","last_active":"2023-12-12T09:45:37.666364+0000","last_peered":"2023-12-12T09:45:37.666364+0000","last_clean":"2023-12-12T09:45:37.666364+0000","last_became_active":"2023-12-12T09:45:23.548384+0000","last_became_peered":"2023-12-12T09:45:23.548384+0000","last_unstale":"2023-12-12T09:45:37.666364+0000","last_undegraded":"2023-12-12T09:45:37.666364+0000","last_fullsized":"2023-12-12T09:45:37.666364+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_clean_scrub_stamp":"2023-12-12T09:45:22.493994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T12:04:22.521885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":16,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-12-12T09:45:38.296388+0000","last_change":"2023-12-12T09:45:22.540556+0000","last_active":"2023-12-12T09:45:38.296388+0000","last_peered":"2023-12-12T09:45:38.296388+0000","last_clean":"2023-12-12T09:45:38.296388+0000","last_became_active":"2023-12-12T09:45:22.540265+0000","last_became_peered":"2023-12-12T09:45:22.540265+0000","last_unstale":"2023-12-12T09:45:38.296388+0000","last_undegraded":"2023-12-12T09:45:38.296388+0000","last_fullsized":"2023-12-12T09:45:38.296388+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:21.477323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:21.477323+0000","last_clean_scrub_stamp":"2023-12-12T09:45:21.477323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T18:29:34.637693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-12-12T09:45:38.322693+0000","last_change":"2023-12-12T09:45:38.317777+0000","last_active":"2023-12-12T09:45:38.322693+0000","last_peered":"2023-12-12T09:45:38.322693+0000","last_clean":"2023-12-12T09:45:38.322693+0000","last_became_active":"2023-12-12T09:45:38.317414+0000","last_became_peered":"2023-12-12T09:45:38.317414+0000","last_unstale":"2023-12-12T09:45:38.322693+0000","last_undegraded":"2023-12-12T09:45:38.322693+0000","last_fullsized":"2023-12-12T09:45:38.322693+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:37.621350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:37.621350+0000","last_clean_scrub_stamp":"2023-12-12T09:45:37.621350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T12:15:20.295162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"57'2","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-12-12T09:45:38.682086+0000","last_change":"2023-12-12T09:45:37.669818+0000","last_active":"2023-12-12T09:45:38.682086+0000","last_peered":"2023-12-12T09:45:38.682086+0000","last_clean":"2023-12-12T09:45:38.682086+0000","last_became_active":"2023-12-12T09:45:37.669494+0000","last_became_peered":"2023-12-12T09:45:37.669494+0000","last_unstale":"2023-12-12T09:45:38.682086+0000","last_undegraded":"2023-12-12T09:45:38.682086+0000","last_fullsized":"2023-12-12T09:45:38.682086+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:36.607138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:36.607138+0000","last_clean_scrub_stamp":"2023-12-12T09:45:36.607138+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T20:14:34.767780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":14,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-12-12T09:45:37.650218+0000","last_change":"2023-12-12T09:45:23.550480+0000","last_active":"2023-12-12T09:45:37.650218+0000","last_peered":"2023-12-12T09:45:37.650218+0000","last_clean":"2023-12-12T09:45:37.650218+0000","last_became_active":"2023-12-12T09:45:23.549473+0000","last_became_peered":"2023-12-12T09:45:23.549473+0000","last_unstale":"2023-12-12T09:45:37.650218+0000","last_undegraded":"2023-12-12T09:45:37.650218+0000","last_fullsized":"2023-12-12T09:45:37.650218+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_clean_scrub_stamp":"2023-12-12T09:45:22.493994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T16:23:30.104791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":16,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-12-12T09:45:38.285519+0000","last_change":"2023-12-12T09:45:22.540441+0000","last_active":"2023-12-12T09:45:38.285519+0000","last_peered":"2023-12-12T09:45:38.285519+0000","last_clean":"2023-12-12T09:45:38.285519+0000","last_became_active":"2023-12-12T09:45:22.539379+0000","last_became_peered":"2023-12-12T09:45:22.539379+0000","last_unstale":"2023-12-12T09:45:38.285519+0000","last_undegraded":"2023-12-12T09:45:38.285519+0000","last_fullsized":"2023-12-12T09:45:38.285519+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:21.477323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:21.477323+0000","last_clean_scrub_stamp":"2023-12-12T09:45:21.477323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T14:03:02.042556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":11,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-12T09:45:39.288193+0000","last_change":"2023-12-12T09:45:38.297728+0000","last_active":"2023-12-12T09:45:39.288193+0000","last_peered":"2023-12-12T09:45:39.288193+0000","last_clean":"2023-12-12T09:45:39.288193+0000","last_became_active":"2023-12-12T09:45:38.297313+0000","last_became_peered":"2023-12-12T09:45:38.297313+0000","last_unstale":"2023-12-12T09:45:39.288193+0000","last_undegraded":"2023-12-12T09:45:39.288193+0000","last_fullsized":"2023-12-12T09:45:39.288193+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:37.621350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:37.621350+0000","last_clean_scrub_stamp":"2023-12-12T09:45:37.621350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T09:57:22.254000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":12,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-12T09:45:39.286016+0000","last_change":"2023-12-12T09:45:37.662703+0000","last_active":"2023-12-12T09:45:39.286016+0000","last_peered":"2023-12-12T09:45:39.286016+0000","last_clean":"2023-12-12T09:45:39.286016+0000","last_became_active":"2023-12-12T09:45:37.661648+0000","last_became_peered":"2023-12-12T09:45:37.661648+0000","last_unstale":"2023-12-12T09:45:39.286016+0000","last_undegraded":"2023-12-12T09:45:39.286016+0000","last_fullsized":"2023-12-12T09:45:39.286016+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:36.607138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:36.607138+0000","last_clean_scrub_stamp":"2023-12-12T09:45:36.607138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T12:04:36.635029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":14,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-12-12T09:45:37.665974+0000","last_change":"2023-12-12T09:45:23.556070+0000","last_active":"2023-12-12T09:45:37.665974+0000","last_peered":"2023-12-12T09:45:37.665974+0000","last_clean":"2023-12-12T09:45:37.665974+0000","last_became_active":"2023-12-12T09:45:23.554580+0000","last_became_peered":"2023-12-12T09:45:23.554580+0000","last_unstale":"2023-12-12T09:45:37.665974+0000","last_undegraded":"2023-12-12T09:45:37.665974+0000","last_fullsized":"2023-12-12T09:45:37.665974+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_clean_scrub_stamp":"2023-12-12T09:45:22.493994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T12:53:08.506599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.10","version":"53'8","reported_seq":23,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-12-12T09:45:37.664798+0000","last_change":"2023-12-12T09:45:22.546154+0000","last_active":"2023-12-12T09:45:37.664798+0000","last_peered":"2023-12-12T09:45:37.664798+0000","last_clean":"2023-12-12T09:45:37.664798+0000","last_became_active":"2023-12-12T09:45:22.545903+0000","last_became_peered":"2023-12-12T09:45:22.545903+0000","last_unstale":"2023-12-12T09:45:37.664798+0000","last_undegraded":"2023-12-12T09:45:37.664798+0000","last_fullsized":"2023-12-12T09:45:37.664798+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:21.477323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:21.477323+0000","last_clean_scrub_stamp":"2023-12-12T09:45:21.477323+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T16:38:00.043063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-12-12T09:45:38.315627+0000","last_change":"2023-12-12T09:45:38.308645+0000","last_active":"2023-12-12T09:45:38.315627+0000","last_peered":"2023-12-12T09:45:38.315627+0000","last_clean":"2023-12-12T09:45:38.315627+0000","last_became_active":"2023-12-12T09:45:38.308334+0000","last_became_peered":"2023-12-12T09:45:38.308334+0000","last_unstale":"2023-12-12T09:45:38.315627+0000","last_undegraded":"2023-12-12T09:45:38.315627+0000","last_fullsized":"2023-12-12T09:45:38.315627+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:37.621350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:37.621350+0000","last_clean_scrub_stamp":"2023-12-12T09:45:37.621350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T14:20:25.079726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.d","version":"57'1","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-12T09:45:39.286950+0000","last_change":"2023-12-12T09:45:37.671206+0000","last_active":"2023-12-12T09:45:39.286950+0000","last_peered":"2023-12-12T09:45:39.286950+0000","last_clean":"2023-12-12T09:45:39.286950+0000","last_became_active":"2023-12-12T09:45:37.669225+0000","last_became_peered":"2023-12-12T09:45:37.669225+0000","last_unstale":"2023-12-12T09:45:39.286950+0000","last_undegraded":"2023-12-12T09:45:39.286950+0000","last_fullsized":"2023-12-12T09:45:39.286950+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:36.607138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:36.607138+0000","last_clean_scrub_stamp":"2023-12-12T09:45:36.607138+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T16:46:46.536409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":14,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-12-12T09:45:37.667590+0000","last_change":"2023-12-12T09:45:23.551062+0000","last_active":"2023-12-12T09:45:37.667590+0000","last_peered":"2023-12-12T09:45:37.667590+0000","last_clean":"2023-12-12T09:45:37.667590+0000","last_became_active":"2023-12-12T09:45:23.549387+0000","last_became_peered":"2023-12-12T09:45:23.549387+0000","last_unstale":"2023-12-12T09:45:37.667590+0000","last_undegraded":"2023-12-12T09:45:37.667590+0000","last_fullsized":"2023-12-12T09:45:37.667590+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_clean_scrub_stamp":"2023-12-12T09:45:22.493994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T10:08:57.049367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.f","version":"53'1","reported_seq":16,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-12-12T09:45:37.652850+0000","last_change":"2023-12-12T09:45:22.532050+0000","last_active":"2023-12-12T09:45:37.652850+0000","last_peered":"2023-12-12T09:45:37.652850+0000","last_clean":"2023-12-12T09:45:37.652850+0000","last_became_active":"2023-12-12T09:45:22.531712+0000","last_became_peered":"2023-12-12T09:45:22.531712+0000","last_unstale":"2023-12-12T09:45:37.652850+0000","last_undegraded":"2023-12-12T09:45:37.652850+0000","last_fullsized":"2023-12-12T09:45:37.652850+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:21.477323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:21.477323+0000","last_clean_scrub_stamp":"2023-12-12T09:45:21.477323+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T12:43:03.230562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":11,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-12T09:45:39.285819+0000","last_change":"2023-12-12T09:45:38.308663+0000","last_active":"2023-12-12T09:45:39.285819+0000","last_peered":"2023-12-12T09:45:39.285819+0000","last_clean":"2023-12-12T09:45:39.285819+0000","last_became_active":"2023-12-12T09:45:38.308013+0000","last_became_peered":"2023-12-12T09:45:38.308013+0000","last_unstale":"2023-12-12T09:45:39.285819+0000","last_undegraded":"2023-12-12T09:45:39.285819+0000","last_fullsized":"2023-12-12T09:45:39.285819+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:37.621350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:37.621350+0000","last_clean_scrub_stamp":"2023-12-12T09:45:37.621350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T15:49:31.275353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":11,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-12-12T09:45:38.298091+0000","last_change":"2023-12-12T09:45:37.673754+0000","last_active":"2023-12-12T09:45:38.298091+0000","last_peered":"2023-12-12T09:45:38.298091+0000","last_clean":"2023-12-12T09:45:38.298091+0000","last_became_active":"2023-12-12T09:45:37.673476+0000","last_became_peered":"2023-12-12T09:45:37.673476+0000","last_unstale":"2023-12-12T09:45:38.298091+0000","last_undegraded":"2023-12-12T09:45:38.298091+0000","last_fullsized":"2023-12-12T09:45:38.298091+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:36.607138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:36.607138+0000","last_clean_scrub_stamp":"2023-12-12T09:45:36.607138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T12:23:51.860870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":15,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-12-12T09:45:38.283779+0000","last_change":"2023-12-12T09:45:23.531234+0000","last_active":"2023-12-12T09:45:38.283779+0000","last_peered":"2023-12-12T09:45:38.283779+0000","last_clean":"2023-12-12T09:45:38.283779+0000","last_became_active":"2023-12-12T09:45:23.530849+0000","last_became_peered":"2023-12-12T09:45:23.530849+0000","last_unstale":"2023-12-12T09:45:38.283779+0000","last_undegraded":"2023-12-12T09:45:38.283779+0000","last_fullsized":"2023-12-12T09:45:38.283779+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_clean_scrub_stamp":"2023-12-12T09:45:22.493994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T16:08:55.346248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.e","version":"53'2","reported_seq":17,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-12-12T09:45:37.632853+0000","last_change":"2023-12-12T09:45:22.535653+0000","last_active":"2023-12-12T09:45:37.632853+0000","last_peered":"2023-12-12T09:45:37.632853+0000","last_clean":"2023-12-12T09:45:37.632853+0000","last_became_active":"2023-12-12T09:45:22.534893+0000","last_became_peered":"2023-12-12T09:45:22.534893+0000","last_unstale":"2023-12-12T09:45:37.632853+0000","last_undegraded":"2023-12-12T09:45:37.632853+0000","last_fullsized":"2023-12-12T09:45:37.632853+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:21.477323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:21.477323+0000","last_clean_scrub_stamp":"2023-12-12T09:45:21.477323+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T13:07:07.278574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-12-12T09:45:38.304671+0000","last_change":"2023-12-12T09:45:38.299478+0000","last_active":"2023-12-12T09:45:38.304671+0000","last_peered":"2023-12-12T09:45:38.304671+0000","last_clean":"2023-12-12T09:45:38.304671+0000","last_became_active":"2023-12-12T09:45:38.299059+0000","last_became_peered":"2023-12-12T09:45:38.299059+0000","last_unstale":"2023-12-12T09:45:38.304671+0000","last_undegraded":"2023-12-12T09:45:38.304671+0000","last_fullsized":"2023-12-12T09:45:38.304671+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:37.621350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:37.621350+0000","last_clean_scrub_stamp":"2023-12-12T09:45:37.621350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T14:17:03.921292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.f","version":"57'1","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-12T09:45:39.286861+0000","last_change":"2023-12-12T09:45:37.668157+0000","last_active":"2023-12-12T09:45:39.286861+0000","last_peered":"2023-12-12T09:45:39.286861+0000","last_clean":"2023-12-12T09:45:39.286861+0000","last_became_active":"2023-12-12T09:45:37.667375+0000","last_became_peered":"2023-12-12T09:45:37.667375+0000","last_unstale":"2023-12-12T09:45:39.286861+0000","last_undegraded":"2023-12-12T09:45:39.286861+0000","last_fullsized":"2023-12-12T09:45:39.286861+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:36.607138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:36.607138+0000","last_clean_scrub_stamp":"2023-12-12T09:45:36.607138+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T14:12:08.254081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":14,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-12-12T09:45:37.652632+0000","last_change":"2023-12-12T09:45:23.539711+0000","last_active":"2023-12-12T09:45:37.652632+0000","last_peered":"2023-12-12T09:45:37.652632+0000","last_clean":"2023-12-12T09:45:37.652632+0000","last_became_active":"2023-12-12T09:45:23.539296+0000","last_became_peered":"2023-12-12T09:45:23.539296+0000","last_unstale":"2023-12-12T09:45:37.652632+0000","last_undegraded":"2023-12-12T09:45:37.652632+0000","last_fullsized":"2023-12-12T09:45:37.652632+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_clean_scrub_stamp":"2023-12-12T09:45:22.493994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T12:00:45.931448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"53'1","reported_seq":17,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-12-12T09:45:38.285291+0000","last_change":"2023-12-12T09:45:22.540703+0000","last_active":"2023-12-12T09:45:38.285291+0000","last_peered":"2023-12-12T09:45:38.285291+0000","last_clean":"2023-12-12T09:45:38.285291+0000","last_became_active":"2023-12-12T09:45:22.540383+0000","last_became_peered":"2023-12-12T09:45:22.540383+0000","last_unstale":"2023-12-12T09:45:38.285291+0000","last_undegraded":"2023-12-12T09:45:38.285291+0000","last_fullsized":"2023-12-12T09:45:38.285291+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:21.477323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:21.477323+0000","last_clean_scrub_stamp":"2023-12-12T09:45:21.477323+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T20:27:08.945803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-12-12T09:45:38.318780+0000","last_change":"2023-12-12T09:45:38.313109+0000","last_active":"2023-12-12T09:45:38.318780+0000","last_peered":"2023-12-12T09:45:38.318780+0000","last_clean":"2023-12-12T09:45:38.318780+0000","last_became_active":"2023-12-12T09:45:38.312767+0000","last_became_peered":"2023-12-12T09:45:38.312767+0000","last_unstale":"2023-12-12T09:45:38.318780+0000","last_undegraded":"2023-12-12T09:45:38.318780+0000","last_fullsized":"2023-12-12T09:45:38.318780+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:37.621350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:37.621350+0000","last_clean_scrub_stamp":"2023-12-12T09:45:37.621350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T21:33:57.012215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"57'2","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-12-12T09:45:38.680807+0000","last_change":"2023-12-12T09:45:37.669581+0000","last_active":"2023-12-12T09:45:38.680807+0000","last_peered":"2023-12-12T09:45:38.680807+0000","last_clean":"2023-12-12T09:45:38.680807+0000","last_became_active":"2023-12-12T09:45:37.669298+0000","last_became_peered":"2023-12-12T09:45:37.669298+0000","last_unstale":"2023-12-12T09:45:38.680807+0000","last_undegraded":"2023-12-12T09:45:38.680807+0000","last_fullsized":"2023-12-12T09:45:38.680807+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:36.607138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:36.607138+0000","last_clean_scrub_stamp":"2023-12-12T09:45:36.607138+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T13:19:31.104920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":14,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-12-12T09:45:37.666949+0000","last_change":"2023-12-12T09:45:23.558032+0000","last_active":"2023-12-12T09:45:37.666949+0000","last_peered":"2023-12-12T09:45:37.666949+0000","last_clean":"2023-12-12T09:45:37.666949+0000","last_became_active":"2023-12-12T09:45:23.557676+0000","last_became_peered":"2023-12-12T09:45:23.557676+0000","last_unstale":"2023-12-12T09:45:37.666949+0000","last_undegraded":"2023-12-12T09:45:37.666949+0000","last_fullsized":"2023-12-12T09:45:37.666949+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_clean_scrub_stamp":"2023-12-12T09:45:22.493994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T18:41:29.720316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":15,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-12-12T09:45:37.632032+0000","last_change":"2023-12-12T09:45:22.533152+0000","last_active":"2023-12-12T09:45:37.632032+0000","last_peered":"2023-12-12T09:45:37.632032+0000","last_clean":"2023-12-12T09:45:37.632032+0000","last_became_active":"2023-12-12T09:45:22.532826+0000","last_became_peered":"2023-12-12T09:45:22.532826+0000","last_unstale":"2023-12-12T09:45:37.632032+0000","last_undegraded":"2023-12-12T09:45:37.632032+0000","last_fullsized":"2023-12-12T09:45:37.632032+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:21.477323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:21.477323+0000","last_clean_scrub_stamp":"2023-12-12T09:45:21.477323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T15:15:37.432050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-12-12T09:45:38.328215+0000","last_change":"2023-12-12T09:45:38.321884+0000","last_active":"2023-12-12T09:45:38.328215+0000","last_peered":"2023-12-12T09:45:38.328215+0000","last_clean":"2023-12-12T09:45:38.328215+0000","last_became_active":"2023-12-12T09:45:38.321553+0000","last_became_peered":"2023-12-12T09:45:38.321553+0000","last_unstale":"2023-12-12T09:45:38.328215+0000","last_undegraded":"2023-12-12T09:45:38.328215+0000","last_fullsized":"2023-12-12T09:45:38.328215+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:37.621350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:37.621350+0000","last_clean_scrub_stamp":"2023-12-12T09:45:37.621350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T13:44:21.224373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":12,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-12T09:45:39.284821+0000","last_change":"2023-12-12T09:45:37.660651+0000","last_active":"2023-12-12T09:45:39.284821+0000","last_peered":"2023-12-12T09:45:39.284821+0000","last_clean":"2023-12-12T09:45:39.284821+0000","last_became_active":"2023-12-12T09:45:37.660314+0000","last_became_peered":"2023-12-12T09:45:37.660314+0000","last_unstale":"2023-12-12T09:45:39.284821+0000","last_undegraded":"2023-12-12T09:45:39.284821+0000","last_fullsized":"2023-12-12T09:45:39.284821+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:36.607138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:36.607138+0000","last_clean_scrub_stamp":"2023-12-12T09:45:36.607138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T12:15:19.280950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":15,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-12-12T09:45:38.287919+0000","last_change":"2023-12-12T09:45:23.542634+0000","last_active":"2023-12-12T09:45:38.287919+0000","last_peered":"2023-12-12T09:45:38.287919+0000","last_clean":"2023-12-12T09:45:38.287919+0000","last_became_active":"2023-12-12T09:45:23.542138+0000","last_became_peered":"2023-12-12T09:45:23.542138+0000","last_unstale":"2023-12-12T09:45:38.287919+0000","last_undegraded":"2023-12-12T09:45:38.287919+0000","last_fullsized":"2023-12-12T09:45:38.287919+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_clean_scrub_stamp":"2023-12-12T09:45:22.493994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T20:14:20.654636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.b","version":"53'2","reported_seq":17,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-12-12T09:45:37.652714+0000","last_change":"2023-12-12T09:45:22.544938+0000","last_active":"2023-12-12T09:45:37.652714+0000","last_peered":"2023-12-12T09:45:37.652714+0000","last_clean":"2023-12-12T09:45:37.652714+0000","last_became_active":"2023-12-12T09:45:22.544532+0000","last_became_peered":"2023-12-12T09:45:22.544532+0000","last_unstale":"2023-12-12T09:45:37.652714+0000","last_undegraded":"2023-12-12T09:45:37.652714+0000","last_fullsized":"2023-12-12T09:45:37.652714+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:21.477323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:21.477323+0000","last_clean_scrub_stamp":"2023-12-12T09:45:21.477323+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T17:50:24.664842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-12-12T09:45:38.325240+0000","last_change":"2023-12-12T09:45:38.318220+0000","last_active":"2023-12-12T09:45:38.325240+0000","last_peered":"2023-12-12T09:45:38.325240+0000","last_clean":"2023-12-12T09:45:38.325240+0000","last_became_active":"2023-12-12T09:45:38.316945+0000","last_became_peered":"2023-12-12T09:45:38.316945+0000","last_unstale":"2023-12-12T09:45:38.325240+0000","last_undegraded":"2023-12-12T09:45:38.325240+0000","last_fullsized":"2023-12-12T09:45:38.325240+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:37.621350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:37.621350+0000","last_clean_scrub_stamp":"2023-12-12T09:45:37.621350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T14:28:41.399263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":11,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-12-12T09:45:38.291140+0000","last_change":"2023-12-12T09:45:37.657398+0000","last_active":"2023-12-12T09:45:38.291140+0000","last_peered":"2023-12-12T09:45:38.291140+0000","last_clean":"2023-12-12T09:45:38.291140+0000","last_became_active":"2023-12-12T09:45:37.656949+0000","last_became_peered":"2023-12-12T09:45:37.656949+0000","last_unstale":"2023-12-12T09:45:38.291140+0000","last_undegraded":"2023-12-12T09:45:38.291140+0000","last_fullsized":"2023-12-12T09:45:38.291140+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:36.607138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:36.607138+0000","last_clean_scrub_stamp":"2023-12-12T09:45:36.607138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T13:19:12.576132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":14,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-12-12T09:45:37.631494+0000","last_change":"2023-12-12T09:45:23.551020+0000","last_active":"2023-12-12T09:45:37.631494+0000","last_peered":"2023-12-12T09:45:37.631494+0000","last_clean":"2023-12-12T09:45:37.631494+0000","last_became_active":"2023-12-12T09:45:23.550753+0000","last_became_peered":"2023-12-12T09:45:23.550753+0000","last_unstale":"2023-12-12T09:45:37.631494+0000","last_undegraded":"2023-12-12T09:45:37.631494+0000","last_fullsized":"2023-12-12T09:45:37.631494+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_clean_scrub_stamp":"2023-12-12T09:45:22.493994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T14:16:48.793935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":15,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-12-12T09:45:37.637824+0000","last_change":"2023-12-12T09:45:22.532615+0000","last_active":"2023-12-12T09:45:37.637824+0000","last_peered":"2023-12-12T09:45:37.637824+0000","last_clean":"2023-12-12T09:45:37.637824+0000","last_became_active":"2023-12-12T09:45:22.530254+0000","last_became_peered":"2023-12-12T09:45:22.530254+0000","last_unstale":"2023-12-12T09:45:37.637824+0000","last_undegraded":"2023-12-12T09:45:37.637824+0000","last_fullsized":"2023-12-12T09:45:37.637824+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:21.477323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:21.477323+0000","last_clean_scrub_stamp":"2023-12-12T09:45:21.477323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T15:07:46.103446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-12-12T09:45:38.319598+0000","last_change":"2023-12-12T09:45:38.311198+0000","last_active":"2023-12-12T09:45:38.319598+0000","last_peered":"2023-12-12T09:45:38.319598+0000","last_clean":"2023-12-12T09:45:38.319598+0000","last_became_active":"2023-12-12T09:45:38.310897+0000","last_became_peered":"2023-12-12T09:45:38.310897+0000","last_unstale":"2023-12-12T09:45:38.319598+0000","last_undegraded":"2023-12-12T09:45:38.319598+0000","last_fullsized":"2023-12-12T09:45:38.319598+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:37.621350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:37.621350+0000","last_clean_scrub_stamp":"2023-12-12T09:45:37.621350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T14:07:55.779767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":12,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-12T09:45:39.286351+0000","last_change":"2023-12-12T09:45:37.666226+0000","last_active":"2023-12-12T09:45:39.286351+0000","last_peered":"2023-12-12T09:45:39.286351+0000","last_clean":"2023-12-12T09:45:39.286351+0000","last_became_active":"2023-12-12T09:45:37.665979+0000","last_became_peered":"2023-12-12T09:45:37.665979+0000","last_unstale":"2023-12-12T09:45:39.286351+0000","last_undegraded":"2023-12-12T09:45:39.286351+0000","last_fullsized":"2023-12-12T09:45:39.286351+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:36.607138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:36.607138+0000","last_clean_scrub_stamp":"2023-12-12T09:45:36.607138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T12:53:22.619743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":14,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-12-12T09:45:37.631136+0000","last_change":"2023-12-12T09:45:23.552576+0000","last_active":"2023-12-12T09:45:37.631136+0000","last_peered":"2023-12-12T09:45:37.631136+0000","last_clean":"2023-12-12T09:45:37.631136+0000","last_became_active":"2023-12-12T09:45:23.552159+0000","last_became_peered":"2023-12-12T09:45:23.552159+0000","last_unstale":"2023-12-12T09:45:37.631136+0000","last_undegraded":"2023-12-12T09:45:37.631136+0000","last_fullsized":"2023-12-12T09:45:37.631136+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_clean_scrub_stamp":"2023-12-12T09:45:22.493994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T14:20:09.952370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":16,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-12-12T09:45:38.285891+0000","last_change":"2023-12-12T09:45:22.529781+0000","last_active":"2023-12-12T09:45:38.285891+0000","last_peered":"2023-12-12T09:45:38.285891+0000","last_clean":"2023-12-12T09:45:38.285891+0000","last_became_active":"2023-12-12T09:45:22.529493+0000","last_became_peered":"2023-12-12T09:45:22.529493+0000","last_unstale":"2023-12-12T09:45:38.285891+0000","last_undegraded":"2023-12-12T09:45:38.285891+0000","last_fullsized":"2023-12-12T09:45:38.285891+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:21.477323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:21.477323+0000","last_clean_scrub_stamp":"2023-12-12T09:45:21.477323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T19:01:49.506238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-12-12T09:45:38.323609+0000","last_change":"2023-12-12T09:45:38.319105+0000","last_active":"2023-12-12T09:45:38.323609+0000","last_peered":"2023-12-12T09:45:38.323609+0000","last_clean":"2023-12-12T09:45:38.323609+0000","last_became_active":"2023-12-12T09:45:38.317288+0000","last_became_peered":"2023-12-12T09:45:38.317288+0000","last_unstale":"2023-12-12T09:45:38.323609+0000","last_undegraded":"2023-12-12T09:45:38.323609+0000","last_fullsized":"2023-12-12T09:45:38.323609+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:37.621350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:37.621350+0000","last_clean_scrub_stamp":"2023-12-12T09:45:37.621350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T17:37:12.684365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":12,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-12T09:45:39.285805+0000","last_change":"2023-12-12T09:45:37.654514+0000","last_active":"2023-12-12T09:45:39.285805+0000","last_peered":"2023-12-12T09:45:39.285805+0000","last_clean":"2023-12-12T09:45:39.285805+0000","last_became_active":"2023-12-12T09:45:37.654053+0000","last_became_peered":"2023-12-12T09:45:37.654053+0000","last_unstale":"2023-12-12T09:45:39.285805+0000","last_undegraded":"2023-12-12T09:45:39.285805+0000","last_fullsized":"2023-12-12T09:45:39.285805+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:36.607138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:36.607138+0000","last_clean_scrub_stamp":"2023-12-12T09:45:36.607138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T20:52:59.457996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":15,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-12-12T09:45:38.292855+0000","last_change":"2023-12-12T09:45:23.528110+0000","last_active":"2023-12-12T09:45:38.292855+0000","last_peered":"2023-12-12T09:45:38.292855+0000","last_clean":"2023-12-12T09:45:38.292855+0000","last_became_active":"2023-12-12T09:45:23.527594+0000","last_became_peered":"2023-12-12T09:45:23.527594+0000","last_unstale":"2023-12-12T09:45:38.292855+0000","last_undegraded":"2023-12-12T09:45:38.292855+0000","last_fullsized":"2023-12-12T09:45:38.292855+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_clean_scrub_stamp":"2023-12-12T09:45:22.493994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T12:04:22.521885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"53'2","reported_seq":17,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-12-12T09:45:37.645143+0000","last_change":"2023-12-12T09:45:22.530462+0000","last_active":"2023-12-12T09:45:37.645143+0000","last_peered":"2023-12-12T09:45:37.645143+0000","last_clean":"2023-12-12T09:45:37.645143+0000","last_became_active":"2023-12-12T09:45:22.529388+0000","last_became_peered":"2023-12-12T09:45:22.529388+0000","last_unstale":"2023-12-12T09:45:37.645143+0000","last_undegraded":"2023-12-12T09:45:37.645143+0000","last_fullsized":"2023-12-12T09:45:37.645143+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:21.477323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:21.477323+0000","last_clean_scrub_stamp":"2023-12-12T09:45:21.477323+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T13:28:37.770730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-12-12T09:45:38.323402+0000","last_change":"2023-12-12T09:45:38.318773+0000","last_active":"2023-12-12T09:45:38.323402+0000","last_peered":"2023-12-12T09:45:38.323402+0000","last_clean":"2023-12-12T09:45:38.323402+0000","last_became_active":"2023-12-12T09:45:38.318464+0000","last_became_peered":"2023-12-12T09:45:38.318464+0000","last_unstale":"2023-12-12T09:45:38.323402+0000","last_undegraded":"2023-12-12T09:45:38.323402+0000","last_fullsized":"2023-12-12T09:45:38.323402+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:37.621350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:37.621350+0000","last_clean_scrub_stamp":"2023-12-12T09:45:37.621350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T09:57:22.254000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":11,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-12-12T09:45:38.302326+0000","last_change":"2023-12-12T09:45:37.648973+0000","last_active":"2023-12-12T09:45:38.302326+0000","last_peered":"2023-12-12T09:45:38.302326+0000","last_clean":"2023-12-12T09:45:38.302326+0000","last_became_active":"2023-12-12T09:45:37.648708+0000","last_became_peered":"2023-12-12T09:45:37.648708+0000","last_unstale":"2023-12-12T09:45:38.302326+0000","last_undegraded":"2023-12-12T09:45:38.302326+0000","last_fullsized":"2023-12-12T09:45:38.302326+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:36.607138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:36.607138+0000","last_clean_scrub_stamp":"2023-12-12T09:45:36.607138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T18:35:35.438556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":15,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-12-12T09:45:38.283984+0000","last_change":"2023-12-12T09:45:23.552672+0000","last_active":"2023-12-12T09:45:38.283984+0000","last_peered":"2023-12-12T09:45:38.283984+0000","last_clean":"2023-12-12T09:45:38.283984+0000","last_became_active":"2023-12-12T09:45:23.548550+0000","last_became_peered":"2023-12-12T09:45:23.548550+0000","last_unstale":"2023-12-12T09:45:38.283984+0000","last_undegraded":"2023-12-12T09:45:38.283984+0000","last_fullsized":"2023-12-12T09:45:38.283984+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_clean_scrub_stamp":"2023-12-12T09:45:22.493994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T12:53:08.506599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"54'1","reported_seq":16,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-12-12T09:45:37.633546+0000","last_change":"2023-12-12T09:45:22.532022+0000","last_active":"2023-12-12T09:45:37.633546+0000","last_peered":"2023-12-12T09:45:37.633546+0000","last_clean":"2023-12-12T09:45:37.633546+0000","last_became_active":"2023-12-12T09:45:22.530250+0000","last_became_peered":"2023-12-12T09:45:22.530250+0000","last_unstale":"2023-12-12T09:45:37.633546+0000","last_undegraded":"2023-12-12T09:45:37.633546+0000","last_fullsized":"2023-12-12T09:45:37.633546+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:21.477323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:21.477323+0000","last_clean_scrub_stamp":"2023-12-12T09:45:21.477323+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T17:31:23.246712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-12-12T09:45:38.315907+0000","last_change":"2023-12-12T09:45:38.313146+0000","last_active":"2023-12-12T09:45:38.315907+0000","last_peered":"2023-12-12T09:45:38.315907+0000","last_clean":"2023-12-12T09:45:38.315907+0000","last_became_active":"2023-12-12T09:45:38.312814+0000","last_became_peered":"2023-12-12T09:45:38.312814+0000","last_unstale":"2023-12-12T09:45:38.315907+0000","last_undegraded":"2023-12-12T09:45:38.315907+0000","last_fullsized":"2023-12-12T09:45:38.315907+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:37.621350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:37.621350+0000","last_clean_scrub_stamp":"2023-12-12T09:45:37.621350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T21:33:57.012215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"57'2","reported_seq":14,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-12T09:45:39.286987+0000","last_change":"2023-12-12T09:45:37.667700+0000","last_active":"2023-12-12T09:45:39.286987+0000","last_peered":"2023-12-12T09:45:39.286987+0000","last_clean":"2023-12-12T09:45:39.286987+0000","last_became_active":"2023-12-12T09:45:37.667098+0000","last_became_peered":"2023-12-12T09:45:37.667098+0000","last_unstale":"2023-12-12T09:45:39.286987+0000","last_undegraded":"2023-12-12T09:45:39.286987+0000","last_fullsized":"2023-12-12T09:45:39.286987+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:36.607138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:36.607138+0000","last_clean_scrub_stamp":"2023-12-12T09:45:36.607138+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T14:54:24.774522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":14,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-12-12T09:45:37.638804+0000","last_change":"2023-12-12T09:45:23.549497+0000","last_active":"2023-12-12T09:45:37.638804+0000","last_peered":"2023-12-12T09:45:37.638804+0000","last_clean":"2023-12-12T09:45:37.638804+0000","last_became_active":"2023-12-12T09:45:23.549188+0000","last_became_peered":"2023-12-12T09:45:23.549188+0000","last_unstale":"2023-12-12T09:45:37.638804+0000","last_undegraded":"2023-12-12T09:45:37.638804+0000","last_fullsized":"2023-12-12T09:45:37.638804+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_clean_scrub_stamp":"2023-12-12T09:45:22.493994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T16:23:30.104791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":16,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-12-12T09:45:38.298316+0000","last_change":"2023-12-12T09:45:22.532250+0000","last_active":"2023-12-12T09:45:38.298316+0000","last_peered":"2023-12-12T09:45:38.298316+0000","last_clean":"2023-12-12T09:45:38.298316+0000","last_became_active":"2023-12-12T09:45:22.531649+0000","last_became_peered":"2023-12-12T09:45:22.531649+0000","last_unstale":"2023-12-12T09:45:38.298316+0000","last_undegraded":"2023-12-12T09:45:38.298316+0000","last_fullsized":"2023-12-12T09:45:38.298316+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:21.477323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:21.477323+0000","last_clean_scrub_stamp":"2023-12-12T09:45:21.477323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T13:38:45.393988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":11,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-12T09:45:39.288337+0000","last_change":"2023-12-12T09:45:38.301240+0000","last_active":"2023-12-12T09:45:39.288337+0000","last_peered":"2023-12-12T09:45:39.288337+0000","last_clean":"2023-12-12T09:45:39.288337+0000","last_became_active":"2023-12-12T09:45:38.300891+0000","last_became_peered":"2023-12-12T09:45:38.300891+0000","last_unstale":"2023-12-12T09:45:39.288337+0000","last_undegraded":"2023-12-12T09:45:39.288337+0000","last_fullsized":"2023-12-12T09:45:39.288337+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:37.621350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:37.621350+0000","last_clean_scrub_stamp":"2023-12-12T09:45:37.621350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T17:21:28.739394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":12,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-12T09:45:39.289351+0000","last_change":"2023-12-12T09:45:37.655215+0000","last_active":"2023-12-12T09:45:39.289351+0000","last_peered":"2023-12-12T09:45:39.289351+0000","last_clean":"2023-12-12T09:45:39.289351+0000","last_became_active":"2023-12-12T09:45:37.653537+0000","last_became_peered":"2023-12-12T09:45:37.653537+0000","last_unstale":"2023-12-12T09:45:39.289351+0000","last_undegraded":"2023-12-12T09:45:39.289351+0000","last_fullsized":"2023-12-12T09:45:39.289351+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:36.607138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:36.607138+0000","last_clean_scrub_stamp":"2023-12-12T09:45:36.607138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T20:28:28.306068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":14,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-12-12T09:45:37.632485+0000","last_change":"2023-12-12T09:45:23.542523+0000","last_active":"2023-12-12T09:45:37.632485+0000","last_peered":"2023-12-12T09:45:37.632485+0000","last_clean":"2023-12-12T09:45:37.632485+0000","last_became_active":"2023-12-12T09:45:23.541977+0000","last_became_peered":"2023-12-12T09:45:23.541977+0000","last_unstale":"2023-12-12T09:45:37.632485+0000","last_undegraded":"2023-12-12T09:45:37.632485+0000","last_fullsized":"2023-12-12T09:45:37.632485+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_clean_scrub_stamp":"2023-12-12T09:45:22.493994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T18:41:29.720316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":16,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-12-12T09:45:38.284400+0000","last_change":"2023-12-12T09:45:22.545221+0000","last_active":"2023-12-12T09:45:38.284400+0000","last_peered":"2023-12-12T09:45:38.284400+0000","last_clean":"2023-12-12T09:45:38.284400+0000","last_became_active":"2023-12-12T09:45:22.544683+0000","last_became_peered":"2023-12-12T09:45:22.544683+0000","last_unstale":"2023-12-12T09:45:38.284400+0000","last_undegraded":"2023-12-12T09:45:38.284400+0000","last_fullsized":"2023-12-12T09:45:38.284400+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:21.477323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:21.477323+0000","last_clean_scrub_stamp":"2023-12-12T09:45:21.477323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T21:23:16.895410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-12-12T09:45:38.319227+0000","last_change":"2023-12-12T09:45:38.313874+0000","last_active":"2023-12-12T09:45:38.319227+0000","last_peered":"2023-12-12T09:45:38.319227+0000","last_clean":"2023-12-12T09:45:38.319227+0000","last_became_active":"2023-12-12T09:45:38.313578+0000","last_became_peered":"2023-12-12T09:45:38.313578+0000","last_unstale":"2023-12-12T09:45:38.319227+0000","last_undegraded":"2023-12-12T09:45:38.319227+0000","last_fullsized":"2023-12-12T09:45:38.319227+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:37.621350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:37.621350+0000","last_clean_scrub_stamp":"2023-12-12T09:45:37.621350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T16:09:10.473605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":11,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-12-12T09:45:38.290229+0000","last_change":"2023-12-12T09:45:37.668606+0000","last_active":"2023-12-12T09:45:38.290229+0000","last_peered":"2023-12-12T09:45:38.290229+0000","last_clean":"2023-12-12T09:45:38.290229+0000","last_became_active":"2023-12-12T09:45:37.668341+0000","last_became_peered":"2023-12-12T09:45:37.668341+0000","last_unstale":"2023-12-12T09:45:38.290229+0000","last_undegraded":"2023-12-12T09:45:38.290229+0000","last_fullsized":"2023-12-12T09:45:38.290229+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:36.607138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:36.607138+0000","last_clean_scrub_stamp":"2023-12-12T09:45:36.607138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T14:54:24.774522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":14,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-12-12T09:45:37.652407+0000","last_change":"2023-12-12T09:45:23.544018+0000","last_active":"2023-12-12T09:45:37.652407+0000","last_peered":"2023-12-12T09:45:37.652407+0000","last_clean":"2023-12-12T09:45:37.652407+0000","last_became_active":"2023-12-12T09:45:23.543769+0000","last_became_peered":"2023-12-12T09:45:23.543769+0000","last_unstale":"2023-12-12T09:45:37.652407+0000","last_undegraded":"2023-12-12T09:45:37.652407+0000","last_fullsized":"2023-12-12T09:45:37.652407+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_clean_scrub_stamp":"2023-12-12T09:45:22.493994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T18:35:21.325412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":15,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-12-12T09:45:37.637976+0000","last_change":"2023-12-12T09:45:22.536839+0000","last_active":"2023-12-12T09:45:37.637976+0000","last_peered":"2023-12-12T09:45:37.637976+0000","last_clean":"2023-12-12T09:45:37.637976+0000","last_became_active":"2023-12-12T09:45:22.536573+0000","last_became_peered":"2023-12-12T09:45:22.536573+0000","last_unstale":"2023-12-12T09:45:37.637976+0000","last_undegraded":"2023-12-12T09:45:37.637976+0000","last_fullsized":"2023-12-12T09:45:37.637976+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:21.477323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:21.477323+0000","last_clean_scrub_stamp":"2023-12-12T09:45:21.477323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T15:17:10.229273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":11,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-12T09:45:39.285342+0000","last_change":"2023-12-12T09:45:38.310680+0000","last_active":"2023-12-12T09:45:39.285342+0000","last_peered":"2023-12-12T09:45:39.285342+0000","last_clean":"2023-12-12T09:45:39.285342+0000","last_became_active":"2023-12-12T09:45:38.310377+0000","last_became_peered":"2023-12-12T09:45:38.310377+0000","last_unstale":"2023-12-12T09:45:39.285342+0000","last_undegraded":"2023-12-12T09:45:39.285342+0000","last_fullsized":"2023-12-12T09:45:39.285342+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:37.621350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:37.621350+0000","last_clean_scrub_stamp":"2023-12-12T09:45:37.621350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T17:37:12.684365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":12,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-12T09:45:39.285234+0000","last_change":"2023-12-12T09:45:37.664691+0000","last_active":"2023-12-12T09:45:39.285234+0000","last_peered":"2023-12-12T09:45:39.285234+0000","last_clean":"2023-12-12T09:45:39.285234+0000","last_became_active":"2023-12-12T09:45:37.664220+0000","last_became_peered":"2023-12-12T09:45:37.664220+0000","last_unstale":"2023-12-12T09:45:39.285234+0000","last_undegraded":"2023-12-12T09:45:39.285234+0000","last_fullsized":"2023-12-12T09:45:39.285234+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:36.607138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:36.607138+0000","last_clean_scrub_stamp":"2023-12-12T09:45:36.607138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T13:19:31.104920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":14,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-12-12T09:45:37.666528+0000","last_change":"2023-12-12T09:45:23.549992+0000","last_active":"2023-12-12T09:45:37.666528+0000","last_peered":"2023-12-12T09:45:37.666528+0000","last_clean":"2023-12-12T09:45:37.666528+0000","last_became_active":"2023-12-12T09:45:23.549317+0000","last_became_peered":"2023-12-12T09:45:23.549317+0000","last_unstale":"2023-12-12T09:45:37.666528+0000","last_undegraded":"2023-12-12T09:45:37.666528+0000","last_fullsized":"2023-12-12T09:45:37.666528+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_clean_scrub_stamp":"2023-12-12T09:45:22.493994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T17:51:26.545637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":15,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-12-12T09:45:37.649640+0000","last_change":"2023-12-12T09:45:22.540030+0000","last_active":"2023-12-12T09:45:37.649640+0000","last_peered":"2023-12-12T09:45:37.649640+0000","last_clean":"2023-12-12T09:45:37.649640+0000","last_became_active":"2023-12-12T09:45:22.539590+0000","last_became_peered":"2023-12-12T09:45:22.539590+0000","last_unstale":"2023-12-12T09:45:37.649640+0000","last_undegraded":"2023-12-12T09:45:37.649640+0000","last_fullsized":"2023-12-12T09:45:37.649640+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:21.477323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:21.477323+0000","last_clean_scrub_stamp":"2023-12-12T09:45:21.477323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T15:15:37.432050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":11,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-12T09:45:39.285361+0000","last_change":"2023-12-12T09:45:38.318052+0000","last_active":"2023-12-12T09:45:39.285361+0000","last_peered":"2023-12-12T09:45:39.285361+0000","last_clean":"2023-12-12T09:45:39.285361+0000","last_became_active":"2023-12-12T09:45:38.317612+0000","last_became_peered":"2023-12-12T09:45:38.317612+0000","last_unstale":"2023-12-12T09:45:39.285361+0000","last_undegraded":"2023-12-12T09:45:39.285361+0000","last_fullsized":"2023-12-12T09:45:39.285361+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:37.621350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:37.621350+0000","last_clean_scrub_stamp":"2023-12-12T09:45:37.621350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T16:23:45.232148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":12,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-12T09:45:39.284622+0000","last_change":"2023-12-12T09:45:37.658418+0000","last_active":"2023-12-12T09:45:39.284622+0000","last_peered":"2023-12-12T09:45:39.284622+0000","last_clean":"2023-12-12T09:45:39.284622+0000","last_became_active":"2023-12-12T09:45:37.658122+0000","last_became_peered":"2023-12-12T09:45:37.658122+0000","last_unstale":"2023-12-12T09:45:39.284622+0000","last_undegraded":"2023-12-12T09:45:39.284622+0000","last_fullsized":"2023-12-12T09:45:39.284622+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:36.607138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:36.607138+0000","last_clean_scrub_stamp":"2023-12-12T09:45:36.607138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T14:30:50.219149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":14,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-12-12T09:45:37.637149+0000","last_change":"2023-12-12T09:45:23.545375+0000","last_active":"2023-12-12T09:45:37.637149+0000","last_peered":"2023-12-12T09:45:37.637149+0000","last_clean":"2023-12-12T09:45:37.637149+0000","last_became_active":"2023-12-12T09:45:23.544964+0000","last_became_peered":"2023-12-12T09:45:23.544964+0000","last_unstale":"2023-12-12T09:45:37.637149+0000","last_undegraded":"2023-12-12T09:45:37.637149+0000","last_fullsized":"2023-12-12T09:45:37.637149+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_clean_scrub_stamp":"2023-12-12T09:45:22.493994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T16:38:01.059734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":15,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-12-12T09:45:37.637510+0000","last_change":"2023-12-12T09:45:22.517716+0000","last_active":"2023-12-12T09:45:37.637510+0000","last_peered":"2023-12-12T09:45:37.637510+0000","last_clean":"2023-12-12T09:45:37.637510+0000","last_became_active":"2023-12-12T09:45:22.517234+0000","last_became_peered":"2023-12-12T09:45:22.517234+0000","last_unstale":"2023-12-12T09:45:37.637510+0000","last_undegraded":"2023-12-12T09:45:37.637510+0000","last_fullsized":"2023-12-12T09:45:37.637510+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:21.477323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:21.477323+0000","last_clean_scrub_stamp":"2023-12-12T09:45:21.477323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T13:38:45.393988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":11,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-12T09:45:39.287408+0000","last_change":"2023-12-12T09:45:38.316266+0000","last_active":"2023-12-12T09:45:39.287408+0000","last_peered":"2023-12-12T09:45:39.287408+0000","last_clean":"2023-12-12T09:45:39.287408+0000","last_became_active":"2023-12-12T09:45:38.315976+0000","last_became_peered":"2023-12-12T09:45:38.315976+0000","last_unstale":"2023-12-12T09:45:39.287408+0000","last_undegraded":"2023-12-12T09:45:39.287408+0000","last_fullsized":"2023-12-12T09:45:39.287408+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:37.621350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:37.621350+0000","last_clean_scrub_stamp":"2023-12-12T09:45:37.621350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T12:01:01.058805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":11,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-12-12T09:45:38.281453+0000","last_change":"2023-12-12T09:45:37.659553+0000","last_active":"2023-12-12T09:45:38.281453+0000","last_peered":"2023-12-12T09:45:38.281453+0000","last_clean":"2023-12-12T09:45:38.281453+0000","last_became_active":"2023-12-12T09:45:37.659282+0000","last_became_peered":"2023-12-12T09:45:37.659282+0000","last_unstale":"2023-12-12T09:45:38.281453+0000","last_undegraded":"2023-12-12T09:45:38.281453+0000","last_fullsized":"2023-12-12T09:45:38.281453+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:36.607138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:36.607138+0000","last_clean_scrub_stamp":"2023-12-12T09:45:36.607138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T17:31:38.376527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":14,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-12-12T09:45:37.651455+0000","last_change":"2023-12-12T09:45:23.538139+0000","last_active":"2023-12-12T09:45:37.651455+0000","last_peered":"2023-12-12T09:45:37.651455+0000","last_clean":"2023-12-12T09:45:37.651455+0000","last_became_active":"2023-12-12T09:45:23.537879+0000","last_became_peered":"2023-12-12T09:45:23.537879+0000","last_unstale":"2023-12-12T09:45:37.651455+0000","last_undegraded":"2023-12-12T09:45:37.651455+0000","last_fullsized":"2023-12-12T09:45:37.651455+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_clean_scrub_stamp":"2023-12-12T09:45:22.493994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T13:18:58.462988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":15,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-12-12T09:45:37.646732+0000","last_change":"2023-12-12T09:45:22.533709+0000","last_active":"2023-12-12T09:45:37.646732+0000","last_peered":"2023-12-12T09:45:37.646732+0000","last_clean":"2023-12-12T09:45:37.646732+0000","last_became_active":"2023-12-12T09:45:22.533228+0000","last_became_peered":"2023-12-12T09:45:22.533228+0000","last_unstale":"2023-12-12T09:45:37.646732+0000","last_undegraded":"2023-12-12T09:45:37.646732+0000","last_fullsized":"2023-12-12T09:45:37.646732+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:21.477323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:21.477323+0000","last_clean_scrub_stamp":"2023-12-12T09:45:21.477323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T14:11:53.124266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-12-12T09:45:38.325293+0000","last_change":"2023-12-12T09:45:38.318238+0000","last_active":"2023-12-12T09:45:38.325293+0000","last_peered":"2023-12-12T09:45:38.325293+0000","last_clean":"2023-12-12T09:45:38.325293+0000","last_became_active":"2023-12-12T09:45:38.317917+0000","last_became_peered":"2023-12-12T09:45:38.317917+0000","last_unstale":"2023-12-12T09:45:38.325293+0000","last_undegraded":"2023-12-12T09:45:38.325293+0000","last_fullsized":"2023-12-12T09:45:38.325293+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:37.621350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:37.621350+0000","last_clean_scrub_stamp":"2023-12-12T09:45:37.621350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T10:47:19.765504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.b","version":"57'2","reported_seq":14,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-12T09:45:39.286355+0000","last_change":"2023-12-12T09:45:37.665023+0000","last_active":"2023-12-12T09:45:39.286355+0000","last_peered":"2023-12-12T09:45:39.286355+0000","last_clean":"2023-12-12T09:45:39.286355+0000","last_became_active":"2023-12-12T09:45:37.664419+0000","last_became_peered":"2023-12-12T09:45:37.664419+0000","last_unstale":"2023-12-12T09:45:39.286355+0000","last_undegraded":"2023-12-12T09:45:39.286355+0000","last_fullsized":"2023-12-12T09:45:39.286355+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:36.607138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:36.607138+0000","last_clean_scrub_stamp":"2023-12-12T09:45:36.607138+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T16:09:09.459392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":14,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-12-12T09:45:37.646214+0000","last_change":"2023-12-12T09:45:23.551562+0000","last_active":"2023-12-12T09:45:37.646214+0000","last_peered":"2023-12-12T09:45:37.646214+0000","last_clean":"2023-12-12T09:45:37.646214+0000","last_became_active":"2023-12-12T09:45:23.551292+0000","last_became_peered":"2023-12-12T09:45:23.551292+0000","last_unstale":"2023-12-12T09:45:37.646214+0000","last_undegraded":"2023-12-12T09:45:37.646214+0000","last_fullsized":"2023-12-12T09:45:37.646214+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:22.493994+0000","last_clean_scrub_stamp":"2023-12-12T09:45:22.493994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T12:23:37.747726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":16,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-12-12T09:45:38.294433+0000","last_change":"2023-12-12T09:45:22.537353+0000","last_active":"2023-12-12T09:45:38.294433+0000","last_peered":"2023-12-12T09:45:38.294433+0000","last_clean":"2023-12-12T09:45:38.294433+0000","last_became_active":"2023-12-12T09:45:22.536855+0000","last_became_peered":"2023-12-12T09:45:22.536855+0000","last_unstale":"2023-12-12T09:45:38.294433+0000","last_undegraded":"2023-12-12T09:45:38.294433+0000","last_fullsized":"2023-12-12T09:45:38.294433+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:45:21.477323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:45:21.477323+0000","last_clean_scrub_stamp":"2023-12-12T09:45:21.477323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T15:17:10.229273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":197,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-12-12T09:45:37.664896+0000","last_change":"2023-12-12T09:43:17.203315+0000","last_active":"2023-12-12T09:45:37.664896+0000","last_peered":"2023-12-12T09:45:37.664896+0000","last_clean":"2023-12-12T09:45:37.664896+0000","last_became_active":"2023-12-12T09:43:17.200779+0000","last_became_peered":"2023-12-12T09:43:17.200779+0000","last_unstale":"2023-12-12T09:45:37.664896+0000","last_undegraded":"2023-12-12T09:45:37.664896+0000","last_fullsized":"2023-12-12T09:45:37.664896+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:43:15.931922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:43:15.931922+0000","last_clean_scrub_stamp":"2023-12-12T09:43:15.931922+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T21:42:10.929640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":3905,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":7810,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":64844,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574881,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31936,"kb_used_data":748,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339904,"statfs":{"total":96636764160,"available":96604061696,"internally_reserved":0,"allocated":765952,"data_stored":888104,"data_compressed":32422,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 12 09:45:16 2023","interfaces":[{"interface":"back","average":{"1min":1.0700000000000001,"5min":1.0129999999999999,"15min":1.0029999999999999},"min":{"1min":0.64800000000000002,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.607,"5min":1.8089999999999999,"15min":1.8089999999999999},"last":1.052},{"interface":"front","average":{"1min":1.135,"5min":0.99399999999999999,"15min":0.96999999999999997},"min":{"1min":0.72099999999999997,"5min":0.66300000000000003,"15min":0.66300000000000003},"max":{"1min":1.619,"5min":1.619,"15min":1.619},"last":0.98499999999999999}]},{"osd":1,"last update":"Tue Dec 12 09:45:16 2023","interfaces":[{"interface":"back","average":{"1min":1.149,"5min":1.1879999999999999,"15min":1.194},"min":{"1min":0.83799999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"max":{"1min":1.5629999999999999,"5min":1.7729999999999999,"15min":1.7729999999999999},"last":1.7210000000000001},{"interface":"front","average":{"1min":1.1419999999999999,"5min":1.2010000000000001,"15min":1.2110000000000001},"min":{"1min":0.77000000000000002,"5min":0.71499999999999997,"15min":0.71499999999999997},"max":{"1min":1.542,"5min":3.1150000000000002,"15min":3.1150000000000002},"last":1.226}]},{"osd":2,"last update":"Tue Dec 12 09:45:16 2023","interfaces":[{"interface":"back","average":{"1min":1.1379999999999999,"5min":1.2370000000000001,"15min":1.2529999999999999},"min":{"1min":0.80100000000000005,"5min":0.77700000000000002,"15min":0.77700000000000002},"max":{"1min":1.5449999999999999,"5min":2.2050000000000001,"15min":2.2050000000000001},"last":0.91500000000000004},{"interface":"front","average":{"1min":1.141,"5min":1.224,"15min":1.238},"min":{"1min":0.81399999999999995,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.4890000000000001,"5min":3.2759999999999998,"15min":3.2759999999999998},"last":1.1739999999999999}]},{"osd":3,"last update":"Tue Dec 12 09:45:16 2023","interfaces":[{"interface":"back","average":{"1min":1.1930000000000001,"5min":1.292,"15min":1.3080000000000001},"min":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"max":{"1min":1.587,"5min":3.1819999999999999,"15min":3.1819999999999999},"last":1.2829999999999999},{"interface":"front","average":{"1min":1.2210000000000001,"5min":1.28,"15min":1.29},"min":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"max":{"1min":1.587,"5min":1.8740000000000001,"15min":1.8740000000000001},"last":1.845}]},{"osd":4,"last update":"Tue Dec 12 09:45:16 2023","interfaces":[{"interface":"back","average":{"1min":1.2450000000000001,"5min":1.3300000000000001,"15min":1.3440000000000001},"min":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.647,"5min":2.5529999999999999,"15min":2.5529999999999999},"last":1.371},{"interface":"front","average":{"1min":1.2290000000000001,"5min":1.409,"15min":1.4390000000000001},"min":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"max":{"1min":1.6319999999999999,"5min":2.351,"15min":2.351},"last":1.343}]},{"osd":5,"last update":"Tue Dec 12 09:45:16 2023","interfaces":[{"interface":"back","average":{"1min":1.294,"5min":1.3260000000000001,"15min":1.3320000000000001},"min":{"1min":1.0649999999999999,"5min":0.84499999999999997,"15min":0.84499999999999997},"max":{"1min":1.575,"5min":1.9610000000000001,"15min":1.9610000000000001},"last":1.917},{"interface":"front","average":{"1min":1.389,"5min":1.5069999999999999,"15min":1.5269999999999999},"min":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":1.6950000000000001,"5min":2.4159999999999999,"15min":2.4159999999999999},"last":1.45}]},{"osd":6,"last update":"Tue Dec 12 09:45:16 2023","interfaces":[{"interface":"back","average":{"1min":1.427,"5min":1.419,"15min":1.417},"min":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"max":{"1min":1.821,"5min":2.0510000000000002,"15min":2.0510000000000002},"last":1.966},{"interface":"front","average":{"1min":1.4850000000000001,"5min":1.605,"15min":1.625},"min":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"max":{"1min":1.821,"5min":2.5800000000000001,"15min":2.5800000000000001},"last":1.5509999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574879,"num_pgs":52,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27700,"kb_used_data":676,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344140,"statfs":{"total":96636764160,"available":96608399360,"internally_reserved":0,"allocated":692224,"data_stored":297052,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 12 09:45:15 2023","interfaces":[{"interface":"back","average":{"1min":0.96799999999999997,"5min":1.1479999999999999,"15min":1.1779999999999999},"min":{"1min":0.63200000000000001,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":1.597,"5min":3.6429999999999998,"15min":3.6429999999999998},"last":0.74399999999999999},{"interface":"front","average":{"1min":1.119,"5min":1.079,"15min":1.073},"min":{"1min":0.58499999999999996,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.871,"5min":2.6059999999999999,"15min":2.6059999999999999},"last":0.83099999999999996}]},{"osd":1,"last update":"Tue Dec 12 09:45:15 2023","interfaces":[{"interface":"back","average":{"1min":1.1639999999999999,"5min":1.0820000000000001,"15min":1.0680000000000001},"min":{"1min":0.80400000000000005,"5min":0.69499999999999995,"15min":0.69499999999999995},"max":{"1min":1.482,"5min":2.0169999999999999,"15min":2.0169999999999999},"last":0.78600000000000003},{"interface":"front","average":{"1min":1.1719999999999999,"5min":1.1950000000000001,"15min":1.1990000000000001},"min":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"max":{"1min":1.5700000000000001,"5min":1.7,"15min":1.7},"last":0.96099999999999997}]},{"osd":2,"last update":"Tue Dec 12 09:45:15 2023","interfaces":[{"interface":"back","average":{"1min":1.149,"5min":1.218,"15min":1.23},"min":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"max":{"1min":1.72,"5min":1.804,"15min":1.804},"last":1.0840000000000001},{"interface":"front","average":{"1min":1.1479999999999999,"5min":1.28,"15min":1.302},"min":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"max":{"1min":1.5840000000000001,"5min":2.2160000000000002,"15min":2.2160000000000002},"last":0.92700000000000005}]},{"osd":3,"last update":"Tue Dec 12 09:45:15 2023","interfaces":[{"interface":"back","average":{"1min":1.2090000000000001,"5min":1.216,"15min":1.2170000000000001},"min":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"max":{"1min":1.661,"5min":2.665,"15min":2.665},"last":0.71899999999999997},{"interface":"front","average":{"1min":1.111,"5min":1.2070000000000001,"15min":1.2230000000000001},"min":{"1min":0.72899999999999998,"5min":0.65700000000000003,"15min":0.65700000000000003},"max":{"1min":1.569,"5min":1.8620000000000001,"15min":1.8620000000000001},"last":1.0369999999999999}]},{"osd":4,"last update":"Tue Dec 12 09:45:15 2023","interfaces":[{"interface":"back","average":{"1min":1.276,"5min":1.2749999999999999,"15min":1.2749999999999999},"min":{"1min":0.66100000000000003,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":1.778,"5min":2.0310000000000001,"15min":2.0310000000000001},"last":1.2090000000000001},{"interface":"front","average":{"1min":1.3939999999999999,"5min":1.4039999999999999,"15min":1.4059999999999999},"min":{"1min":0.753,"5min":0.66200000000000003,"15min":0.66200000000000003},"max":{"1min":1.8149999999999999,"5min":2.2799999999999998,"15min":2.2799999999999998},"last":0.95199999999999996}]},{"osd":5,"last update":"Tue Dec 12 09:45:15 2023","interfaces":[{"interface":"back","average":{"1min":1.296,"5min":1.4119999999999999,"15min":1.431},"min":{"1min":0.68600000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.766,"5min":2.1739999999999999,"15min":2.1739999999999999},"last":1.3879999999999999},{"interface":"front","average":{"1min":1.4730000000000001,"5min":1.476,"15min":1.476},"min":{"1min":0.99399999999999999,"5min":0.80100000000000005,"15min":0.80100000000000005},"max":{"1min":1.909,"5min":1.929,"15min":1.929},"last":1.3}]},{"osd":7,"last update":"Tue Dec 12 09:45:15 2023","interfaces":[{"interface":"back","average":{"1min":1.4059999999999999,"5min":1.488,"15min":1.502},"min":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.6859999999999999,"5min":1.994,"15min":1.994},"last":1.343},{"interface":"front","average":{"1min":1.3779999999999999,"5min":1.506,"15min":1.528},"min":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"max":{"1min":1.839,"5min":2.0800000000000001,"15min":2.0800000000000001},"last":1.2450000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574879,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27704,"kb_used_data":680,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344136,"statfs":{"total":96636764160,"available":96608395264,"internally_reserved":0,"allocated":696320,"data_stored":297702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 12 09:45:16 2023","interfaces":[{"interface":"back","average":{"1min":1.022,"5min":1.02,"15min":1.02},"min":{"1min":0.65600000000000003,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.7310000000000001,"5min":1.7310000000000001,"15min":1.7310000000000001},"last":0.81899999999999995},{"interface":"front","average":{"1min":1.04,"5min":1.1120000000000001,"15min":1.1240000000000001},"min":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.595,"5min":1.595,"15min":1.595},"last":1.01}]},{"osd":1,"last update":"Tue Dec 12 09:45:16 2023","interfaces":[{"interface":"back","average":{"1min":1,"5min":1.1799999999999999,"15min":1.21},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.756,"5min":1.756,"15min":1.756},"last":0.877},{"interface":"front","average":{"1min":1.071,"5min":1.087,"15min":1.0900000000000001},"min":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"max":{"1min":1.5549999999999999,"5min":1.5840000000000001,"15min":1.5840000000000001},"last":1.2130000000000001}]},{"osd":2,"last update":"Tue Dec 12 09:45:16 2023","interfaces":[{"interface":"back","average":{"1min":1.1619999999999999,"5min":1.286,"15min":1.306},"min":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"max":{"1min":1.536,"5min":1.7889999999999999,"15min":1.7889999999999999},"last":1.107},{"interface":"front","average":{"1min":1.157,"5min":1.3680000000000001,"15min":1.403},"min":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"max":{"1min":1.5369999999999999,"5min":2.1600000000000001,"15min":2.1600000000000001},"last":1.149}]},{"osd":3,"last update":"Tue Dec 12 09:45:16 2023","interfaces":[{"interface":"back","average":{"1min":1.202,"5min":1.337,"15min":1.359},"min":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"max":{"1min":1.6950000000000001,"5min":2.1499999999999999,"15min":2.1499999999999999},"last":0.95899999999999996},{"interface":"front","average":{"1min":1.2390000000000001,"5min":1.4410000000000001,"15min":1.4750000000000001},"min":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"max":{"1min":1.6060000000000001,"5min":1.8939999999999999,"15min":1.8939999999999999},"last":1.3300000000000001}]},{"osd":4,"last update":"Tue Dec 12 09:45:16 2023","interfaces":[{"interface":"back","average":{"1min":1.3100000000000001,"5min":1.454,"15min":1.478},"min":{"1min":0.746,"5min":0.746,"15min":0.746},"max":{"1min":1.841,"5min":2.391,"15min":2.391},"last":1.075},{"interface":"front","average":{"1min":1.4470000000000001,"5min":1.5589999999999999,"15min":1.5780000000000001},"min":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"max":{"1min":1.958,"5min":2.5430000000000001,"15min":2.5430000000000001},"last":1.3660000000000001}]},{"osd":6,"last update":"Tue Dec 12 09:45:16 2023","interfaces":[{"interface":"back","average":{"1min":1.3320000000000001,"5min":1.5429999999999999,"15min":1.5780000000000001},"min":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.7230000000000001,"5min":2.0840000000000001,"15min":2.0840000000000001},"last":1.4430000000000001},{"interface":"front","average":{"1min":1.373,"5min":1.579,"15min":1.613},"min":{"1min":0.627,"5min":0.627,"15min":0.627},"max":{"1min":1.9970000000000001,"5min":2.306,"15min":2.306},"last":1.2649999999999999}]},{"osd":7,"last update":"Tue Dec 12 09:45:16 2023","interfaces":[{"interface":"back","average":{"1min":1.538,"5min":1.7350000000000001,"15min":1.768},"min":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"max":{"1min":2.2469999999999999,"5min":2.6880000000000002,"15min":2.6880000000000002},"last":1.5309999999999999},{"interface":"front","average":{"1min":1.4550000000000001,"5min":1.6890000000000001,"15min":1.728},"min":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"max":{"1min":1.8260000000000001,"5min":2.3410000000000002,"15min":2.3410000000000002},"last":1.621}]}]},{"osd":4,"up_from":13,"seq":55834574881,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27708,"kb_used_data":680,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344132,"statfs":{"total":96636764160,"available":96608391168,"internally_reserved":0,"allocated":696320,"data_stored":300067,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 12 09:45:15 2023","interfaces":[{"interface":"back","average":{"1min":1.0129999999999999,"5min":1.046,"15min":1.052},"min":{"1min":0.65100000000000002,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":1.7010000000000001,"5min":1.7010000000000001,"15min":1.7010000000000001},"last":1.5880000000000001},{"interface":"front","average":{"1min":0.98899999999999999,"5min":1.0409999999999999,"15min":1.05},"min":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":1.3080000000000001,"5min":1.492,"15min":1.492},"last":1.5449999999999999}]},{"osd":1,"last update":"Tue Dec 12 09:45:15 2023","interfaces":[{"interface":"back","average":{"1min":1.0580000000000001,"5min":1.046,"15min":1.044},"min":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":1.468,"5min":1.468,"15min":1.468},"last":0.97499999999999998},{"interface":"front","average":{"1min":1.143,"5min":1.173,"15min":1.1779999999999999},"min":{"1min":0.76600000000000001,"5min":0.73699999999999999,"15min":0.73699999999999999},"max":{"1min":1.599,"5min":1.8720000000000001,"15min":1.8720000000000001},"last":0.86599999999999999}]},{"osd":2,"last update":"Tue Dec 12 09:45:15 2023","interfaces":[{"interface":"back","average":{"1min":1.145,"5min":1.1240000000000001,"15min":1.1200000000000001},"min":{"1min":0.82699999999999996,"5min":0.71499999999999997,"15min":0.71499999999999997},"max":{"1min":1.4590000000000001,"5min":1.4590000000000001,"15min":1.4590000000000001},"last":1.4470000000000001},{"interface":"front","average":{"1min":1.238,"5min":1.282,"15min":1.29},"min":{"1min":0.76400000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"max":{"1min":1.675,"5min":2.1640000000000001,"15min":2.1640000000000001},"last":1.4019999999999999}]},{"osd":3,"last update":"Tue Dec 12 09:45:15 2023","interfaces":[{"interface":"back","average":{"1min":1.2569999999999999,"5min":1.2130000000000001,"15min":1.206},"min":{"1min":0.89700000000000002,"5min":0.83399999999999996,"15min":0.83399999999999996},"max":{"1min":1.52,"5min":1.635,"15min":1.635},"last":1.2030000000000001},{"interface":"front","average":{"1min":1.222,"5min":1.234,"15min":1.236},"min":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"max":{"1min":1.7290000000000001,"5min":2.0499999999999998,"15min":2.0499999999999998},"last":1.4930000000000001}]},{"osd":5,"last update":"Tue Dec 12 09:45:15 2023","interfaces":[{"interface":"back","average":{"1min":1.272,"5min":1.4279999999999999,"15min":1.454},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.794,"5min":2.3159999999999998,"15min":2.3159999999999998},"last":1.113},{"interface":"front","average":{"1min":1.361,"5min":1.3520000000000001,"15min":1.3500000000000001},"min":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"max":{"1min":1.978,"5min":2.117,"15min":2.117},"last":1.3360000000000001}]},{"osd":6,"last update":"Tue Dec 12 09:45:15 2023","interfaces":[{"interface":"back","average":{"1min":1.3180000000000001,"5min":1.3859999999999999,"15min":1.397},"min":{"1min":0.84999999999999998,"5min":0.81200000000000006,"15min":0.81200000000000006},"max":{"1min":1.927,"5min":2.246,"15min":2.246},"last":1.671},{"interface":"front","average":{"1min":1.4610000000000001,"5min":1.5309999999999999,"15min":1.5429999999999999},"min":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"max":{"1min":1.917,"5min":2.5099999999999998,"15min":2.5099999999999998},"last":1.6919999999999999}]},{"osd":7,"last update":"Tue Dec 12 09:45:15 2023","interfaces":[{"interface":"back","average":{"1min":1.4630000000000001,"5min":1.496,"15min":1.502},"min":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"max":{"1min":1.9830000000000001,"5min":2.5710000000000002,"15min":2.5710000000000002},"last":1.6319999999999999},{"interface":"front","average":{"1min":1.508,"5min":1.512,"15min":1.512},"min":{"1min":1.0900000000000001,"5min":1.0600000000000001,"15min":1.0600000000000001},"max":{"1min":2.1600000000000001,"5min":2.3919999999999999,"15min":2.3919999999999999},"last":1.7390000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574879,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31868,"kb_used_data":684,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339972,"statfs":{"total":96636764160,"available":96604131328,"internally_reserved":0,"allocated":700416,"data_stored":297128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 12 09:45:17 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.873,"15min":0.89900000000000002},"min":{"1min":0.318,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":1.1930000000000001,"5min":1.4830000000000001,"15min":1.4830000000000001},"last":0.88700000000000001},{"interface":"front","average":{"1min":0.71699999999999997,"5min":1.0529999999999999,"15min":1.109},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":1.2370000000000001,"5min":3.3370000000000002,"15min":3.3370000000000002},"last":1.2669999999999999}]},{"osd":1,"last update":"Tue Dec 12 09:45:17 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.88200000000000001,"15min":0.90700000000000003},"min":{"1min":0.48799999999999999,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":1.077,"5min":1.4610000000000001,"15min":1.4610000000000001},"last":1.0429999999999999},{"interface":"front","average":{"1min":0.84099999999999997,"5min":1.0229999999999999,"15min":1.0529999999999999},"min":{"1min":0.52700000000000002,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.6100000000000001,"5min":2.9409999999999998,"15min":2.9409999999999998},"last":1.2050000000000001}]},{"osd":2,"last update":"Tue Dec 12 09:45:17 2023","interfaces":[{"interface":"back","average":{"1min":0.874,"5min":1.1240000000000001,"15min":1.1659999999999999},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.5680000000000001,"5min":2.613,"15min":2.613},"last":1.1830000000000001},{"interface":"front","average":{"1min":0.89800000000000002,"5min":1.127,"15min":1.165},"min":{"1min":0.47199999999999998,"5min":0.437,"15min":0.437},"max":{"1min":1.4390000000000001,"5min":3.0430000000000001,"15min":3.0430000000000001},"last":1.3420000000000001}]},{"osd":4,"last update":"Tue Dec 12 09:45:17 2023","interfaces":[{"interface":"back","average":{"1min":1.2190000000000001,"5min":1.3500000000000001,"15min":1.3720000000000001},"min":{"1min":0.73399999999999999,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.851,"5min":3.5019999999999998,"15min":3.5019999999999998},"last":1.151},{"interface":"front","average":{"1min":1.1439999999999999,"5min":1.415,"15min":1.46},"min":{"1min":0.755,"5min":0.755,"15min":0.755},"max":{"1min":1.593,"5min":2.9889999999999999,"15min":2.9889999999999999},"last":1.415}]},{"osd":5,"last update":"Tue Dec 12 09:45:17 2023","interfaces":[{"interface":"back","average":{"1min":1.254,"5min":1.45,"15min":1.4830000000000001},"min":{"1min":0.73599999999999999,"5min":0.68000000000000005,"15min":0.68000000000000005},"max":{"1min":1.589,"5min":4.2480000000000002,"15min":4.2480000000000002},"last":1.476},{"interface":"front","average":{"1min":1.2090000000000001,"5min":1.5149999999999999,"15min":1.5660000000000001},"min":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"max":{"1min":1.7,"5min":5.5060000000000002,"15min":5.5060000000000002},"last":1.3799999999999999}]},{"osd":6,"last update":"Tue Dec 12 09:45:17 2023","interfaces":[{"interface":"back","average":{"1min":1.1240000000000001,"5min":1.391,"15min":1.4350000000000001},"min":{"1min":0.79100000000000004,"5min":0.76500000000000001,"15min":0.76500000000000001},"max":{"1min":1.472,"5min":3.1400000000000001,"15min":3.1400000000000001},"last":1.2390000000000001},{"interface":"front","average":{"1min":1.288,"5min":1.4950000000000001,"15min":1.5289999999999999},"min":{"1min":0.70099999999999996,"5min":0.627,"15min":0.627},"max":{"1min":1.694,"5min":4.3179999999999996,"15min":4.3179999999999996},"last":1.665}]},{"osd":7,"last update":"Tue Dec 12 09:45:17 2023","interfaces":[{"interface":"back","average":{"1min":1.236,"5min":1.52,"15min":1.5680000000000001},"min":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"max":{"1min":1.6759999999999999,"5min":5.3979999999999997,"15min":5.3979999999999997},"last":1.4450000000000001},{"interface":"front","average":{"1min":1.228,"5min":1.488,"15min":1.532},"min":{"1min":0.75800000000000001,"5min":0.74299999999999999,"15min":0.74299999999999999},"max":{"1min":1.663,"5min":3.4129999999999998,"15min":3.4129999999999998},"last":1.526}]}]},{"osd":2,"up_from":13,"seq":55834574879,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27700,"kb_used_data":676,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344140,"statfs":{"total":96636764160,"available":96608399360,"internally_reserved":0,"allocated":692224,"data_stored":297016,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 12 09:45:16 2023","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.81000000000000005,"15min":0.81599999999999995},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":1.212,"5min":1.458,"15min":1.458},"last":1.036},{"interface":"front","average":{"1min":0.84899999999999998,"5min":0.90000000000000002,"15min":0.90800000000000003},"min":{"1min":0.36199999999999999,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":1.623,"5min":1.623,"15min":1.623},"last":0.94699999999999995}]},{"osd":1,"last update":"Tue Dec 12 09:45:16 2023","interfaces":[{"interface":"back","average":{"1min":0.82999999999999996,"5min":0.85699999999999998,"15min":0.86099999999999999},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":1.375,"5min":1.593,"15min":1.593},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.84099999999999997,"5min":0.877,"15min":0.88300000000000001},"min":{"1min":0.46999999999999997,"5min":0.443,"15min":0.443},"max":{"1min":1.4330000000000001,"5min":1.758,"15min":1.758},"last":1.077}]},{"osd":3,"last update":"Tue Dec 12 09:45:16 2023","interfaces":[{"interface":"back","average":{"1min":0.93999999999999995,"5min":1.0329999999999999,"15min":1.0489999999999999},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.343,"5min":1.8879999999999999,"15min":1.8879999999999999},"last":0.85299999999999998},{"interface":"front","average":{"1min":0.86599999999999999,"5min":0.97999999999999998,"15min":0.999},"min":{"1min":0.46000000000000002,"5min":0.432,"15min":0.432},"max":{"1min":1.4419999999999999,"5min":1.8120000000000001,"15min":1.8120000000000001},"last":0.89700000000000002}]},{"osd":4,"last update":"Tue Dec 12 09:45:16 2023","interfaces":[{"interface":"back","average":{"1min":1.141,"5min":1.2090000000000001,"15min":1.2210000000000001},"min":{"1min":0.69599999999999995,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.3859999999999999,"5min":2.5760000000000001,"15min":2.5760000000000001},"last":1.1020000000000001},{"interface":"front","average":{"1min":1.1870000000000001,"5min":1.3520000000000001,"15min":1.3799999999999999},"min":{"1min":0.79400000000000004,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":2.04,"5min":2.8069999999999999,"15min":2.8069999999999999},"last":1.2549999999999999}]},{"osd":5,"last update":"Tue Dec 12 09:45:16 2023","interfaces":[{"interface":"back","average":{"1min":1.3260000000000001,"5min":1.3680000000000001,"15min":1.375},"min":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"max":{"1min":1.764,"5min":2.3109999999999999,"15min":2.3109999999999999},"last":1.1719999999999999},{"interface":"front","average":{"1min":1.196,"5min":1.3200000000000001,"15min":1.3400000000000001},"min":{"1min":0.79400000000000004,"5min":0.627,"15min":0.627},"max":{"1min":1.546,"5min":2.5110000000000001,"15min":2.5110000000000001},"last":1.2110000000000001}]},{"osd":6,"last update":"Tue Dec 12 09:45:16 2023","interfaces":[{"interface":"back","average":{"1min":1.329,"5min":1.415,"15min":1.429},"min":{"1min":0.82499999999999996,"5min":0.69599999999999995,"15min":0.69599999999999995},"max":{"1min":2.6139999999999999,"5min":2.907,"15min":2.907},"last":1.3169999999999999},{"interface":"front","average":{"1min":1.403,"5min":1.423,"15min":1.427},"min":{"1min":0.85099999999999998,"5min":0.82799999999999996,"15min":0.82799999999999996},"max":{"1min":2.6000000000000001,"5min":2.6000000000000001,"15min":2.6000000000000001},"last":1.2909999999999999}]},{"osd":7,"last update":"Tue Dec 12 09:45:16 2023","interfaces":[{"interface":"back","average":{"1min":1.3049999999999999,"5min":1.4259999999999999,"15min":1.446},"min":{"1min":0.78500000000000003,"5min":0.71599999999999997,"15min":0.71599999999999997},"max":{"1min":2.1339999999999999,"5min":2.3370000000000002,"15min":2.3370000000000002},"last":1.3640000000000001},{"interface":"front","average":{"1min":1.4159999999999999,"5min":1.4930000000000001,"15min":1.506},"min":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"max":{"1min":1.915,"5min":2.488,"15min":2.488},"last":1.1140000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574879,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27716,"kb_used_data":692,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344124,"statfs":{"total":96636764160,"available":96608382976,"internally_reserved":0,"allocated":708608,"data_stored":299278,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 12 09:45:16 2023","interfaces":[{"interface":"back","average":{"1min":0.79400000000000004,"5min":0.84299999999999997,"15min":0.85099999999999998},"min":{"1min":0.50800000000000001,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":1.319,"5min":2.794,"15min":2.794},"last":1.427},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.84999999999999998,"15min":0.85999999999999999},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":1.167,"5min":2.1379999999999999,"15min":2.1379999999999999},"last":0.98999999999999999}]},{"osd":2,"last update":"Tue Dec 12 09:45:16 2023","interfaces":[{"interface":"back","average":{"1min":0.89200000000000002,"5min":0.96699999999999997,"15min":0.97899999999999998},"min":{"1min":0.437,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":1.5649999999999999,"5min":6.3390000000000004,"15min":6.3390000000000004},"last":0.78300000000000003},{"interface":"front","average":{"1min":0.94299999999999995,"5min":0.96199999999999997,"15min":0.96499999999999997},"min":{"1min":0.53200000000000003,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.5629999999999999,"5min":2.823,"15min":2.823},"last":0.91400000000000003}]},{"osd":3,"last update":"Tue Dec 12 09:45:16 2023","interfaces":[{"interface":"back","average":{"1min":1.0620000000000001,"5min":1.0529999999999999,"15min":1.0509999999999999},"min":{"1min":0.56699999999999995,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":1.6519999999999999,"5min":2.7519999999999998,"15min":2.7519999999999998},"last":1.0549999999999999},{"interface":"front","average":{"1min":1.018,"5min":1.01,"15min":1.008},"min":{"1min":0.55600000000000005,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":1.8640000000000001,"5min":2.2559999999999998,"15min":2.2559999999999998},"last":1.2}]},{"osd":4,"last update":"Tue Dec 12 09:45:16 2023","interfaces":[{"interface":"back","average":{"1min":1.1100000000000001,"5min":1.341,"15min":1.379},"min":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"max":{"1min":1.694,"5min":6.423,"15min":6.423},"last":1.379},{"interface":"front","average":{"1min":1.1899999999999999,"5min":1.1930000000000001,"15min":1.1930000000000001},"min":{"1min":0.80500000000000005,"5min":0.80000000000000004,"15min":0.80000000000000004},"max":{"1min":1.585,"5min":2.2309999999999999,"15min":2.2309999999999999},"last":1.474}]},{"osd":5,"last update":"Tue Dec 12 09:45:16 2023","interfaces":[{"interface":"back","average":{"1min":1.22,"5min":1.417,"15min":1.45},"min":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"max":{"1min":1.8220000000000001,"5min":6.2830000000000004,"15min":6.2830000000000004},"last":1.0309999999999999},{"interface":"front","average":{"1min":1.2729999999999999,"5min":1.3540000000000001,"15min":1.3680000000000001},"min":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"max":{"1min":1.7609999999999999,"5min":2.73,"15min":2.73},"last":1.347}]},{"osd":6,"last update":"Tue Dec 12 09:45:16 2023","interfaces":[{"interface":"back","average":{"1min":1.3180000000000001,"5min":1.5109999999999999,"15min":1.5429999999999999},"min":{"1min":0.751,"5min":0.751,"15min":0.751},"max":{"1min":2.1589999999999998,"5min":6.468,"15min":6.468},"last":1.1499999999999999},{"interface":"front","average":{"1min":1.2529999999999999,"5min":1.514,"15min":1.5580000000000001},"min":{"1min":0.85899999999999999,"5min":0.84699999999999998,"15min":0.84699999999999998},"max":{"1min":1.7949999999999999,"5min":6.3129999999999997,"15min":6.3129999999999997},"last":1.123}]},{"osd":7,"last update":"Tue Dec 12 09:45:16 2023","interfaces":[{"interface":"back","average":{"1min":1.333,"5min":1.3919999999999999,"15min":1.4019999999999999},"min":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"max":{"1min":1.9399999999999999,"5min":2.9009999999999998,"15min":2.9009999999999998},"last":1.5289999999999999},{"interface":"front","average":{"1min":1.345,"5min":1.5129999999999999,"15min":1.5409999999999999},"min":{"1min":0.83999999999999997,"5min":0.752,"15min":0.752},"max":{"1min":1.996,"5min":6.242,"15min":6.242},"last":1.254}]}]},{"osd":0,"up_from":13,"seq":55834574881,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31936,"kb_used_data":748,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339904,"statfs":{"total":96636764160,"available":96604061696,"internally_reserved":0,"allocated":765952,"data_stored":891017,"data_compressed":32422,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Dec 12 09:45:18 2023","interfaces":[{"interface":"back","average":{"1min":0.81699999999999995,"5min":0.78000000000000003,"15min":0.77400000000000002},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":1.639,"5min":1.639,"15min":1.639},"last":0.89800000000000002},{"interface":"front","average":{"1min":0.91800000000000004,"5min":0.83699999999999997,"15min":0.82299999999999995},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":1.5680000000000001,"5min":1.5680000000000001,"15min":1.5680000000000001},"last":0.93100000000000005}]},{"osd":2,"last update":"Tue Dec 12 09:45:18 2023","interfaces":[{"interface":"back","average":{"1min":0.95099999999999996,"5min":0.879,"15min":0.86699999999999999},"min":{"1min":0.34300000000000003,"5min":0.316,"15min":0.316},"max":{"1min":1.748,"5min":1.748,"15min":1.748},"last":0.96999999999999997},{"interface":"front","average":{"1min":1.0469999999999999,"5min":1.0049999999999999,"15min":0.998},"min":{"1min":0.53600000000000003,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":1.6080000000000001,"5min":1.649,"15min":1.649},"last":1.26}]},{"osd":3,"last update":"Tue Dec 12 09:45:18 2023","interfaces":[{"interface":"back","average":{"1min":0.81499999999999995,"5min":0.84499999999999997,"15min":0.84999999999999998},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":1.2529999999999999,"5min":1.4990000000000001,"15min":1.4990000000000001},"last":0.54700000000000004},{"interface":"front","average":{"1min":1.0509999999999999,"5min":1.0129999999999999,"15min":1.0069999999999999},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":1.579,"5min":1.7689999999999999,"15min":1.7689999999999999},"last":0.80700000000000005}]},{"osd":4,"last update":"Tue Dec 12 09:45:18 2023","interfaces":[{"interface":"back","average":{"1min":1.3360000000000001,"5min":1.296,"15min":1.29},"min":{"1min":0.82999999999999996,"5min":0.80400000000000005,"15min":0.80400000000000005},"max":{"1min":1.923,"5min":2.073,"15min":2.073},"last":1.03},{"interface":"front","average":{"1min":1.2,"5min":1.274,"15min":1.286},"min":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"max":{"1min":1.6359999999999999,"5min":3.0699999999999998,"15min":3.0699999999999998},"last":1.1120000000000001}]},{"osd":5,"last update":"Tue Dec 12 09:45:18 2023","interfaces":[{"interface":"back","average":{"1min":1.173,"5min":1.2210000000000001,"15min":1.2290000000000001},"min":{"1min":0.73499999999999999,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.9690000000000001,"5min":3.1909999999999998,"15min":3.1909999999999998},"last":0.99099999999999999},{"interface":"front","average":{"1min":1.2749999999999999,"5min":1.3,"15min":1.304},"min":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"max":{"1min":2.1200000000000001,"5min":2.1200000000000001,"15min":2.1200000000000001},"last":1.1839999999999999}]},{"osd":6,"last update":"Tue Dec 12 09:45:18 2023","interfaces":[{"interface":"back","average":{"1min":1.333,"5min":1.337,"15min":1.337},"min":{"1min":0.752,"5min":0.67500000000000004,"15min":0.67500000000000004},"max":{"1min":2.04,"5min":2.04,"15min":2.04},"last":1.302},{"interface":"front","average":{"1min":1.361,"5min":1.385,"15min":1.389},"min":{"1min":0.95399999999999996,"5min":0.73099999999999998,"15min":0.73099999999999998},"max":{"1min":1.7010000000000001,"5min":2.9100000000000001,"15min":2.9100000000000001},"last":1.484}]},{"osd":7,"last update":"Tue Dec 12 09:45:18 2023","interfaces":[{"interface":"back","average":{"1min":1.3999999999999999,"5min":1.4359999999999999,"15min":1.4419999999999999},"min":{"1min":0.70299999999999996,"5min":0.66800000000000004,"15min":0.66800000000000004},"max":{"1min":1.847,"5min":2.992,"15min":2.992},"last":1.536},{"interface":"front","average":{"1min":1.3169999999999999,"5min":1.327,"15min":1.329},"min":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"max":{"1min":1.8120000000000001,"5min":2.7690000000000001,"15min":2.7690000000000001},"last":1.056}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32422,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32422,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":3689,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3107,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2228,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-12T09:45:43.629 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-12-12T09:45:43.630 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.1 mon 'allow r' osd 'allow rw pool=cephfs2_data' mds allow 2023-12-12T09:45:43.889 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:43.889+0000 7f51df7b6640 1 Processor -- start 2023-12-12T09:45:43.889 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:43.889+0000 7f51df7b6640 1 -- start start 2023-12-12T09:45:43.891 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:43.890+0000 7f51df7b6640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f51d814f8c0 0x7f51d806dc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:43.891 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:43.890+0000 7f51df7b6640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f51d806d350 0x7f51d8071e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:43.891 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:43.890+0000 7f51df7b6640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51d80c16c0 con 0x7f51d80723a0 2023-12-12T09:45:43.891 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:43.890+0000 7f51df7b6640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51d80c1090 con 0x7f51d814f8c0 2023-12-12T09:45:43.891 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:43.890+0000 7f51df7b6640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51d80c14b0 con 0x7f51d806d350 2023-12-12T09:45:43.892 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:43.891+0000 7f51dd552640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f51d814f8c0 0x7f51d806dc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:43.892 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:43.891+0000 7f51dd552640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f51d814f8c0 0x7f51d806dc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:42252/0 (socket says 172.21.15.73:42252) 2023-12-12T09:45:43.892 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:43.891+0000 7f51dd552640 1 -- 172.21.15.73:0/2512790234 learned_addr learned my addr 172.21.15.73:0/2512790234 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:45:43.892 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:43.891+0000 7f51dd552640 1 -- 172.21.15.73:0/2512790234 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f51d806d350 msgr2=0x7f51d8071e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:45:43.892 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:43.891+0000 7f51dd552640 1 --2- 172.21.15.73:0/2512790234 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f51d806d350 0x7f51d8071e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:43.892 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:43.891+0000 7f51dd552640 1 -- 172.21.15.73:0/2512790234 >> v1:172.21.15.142:6789/0 conn(0x7f51d80723a0 legacy=0x7f51d8152500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:45:43.892 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:43.891+0000 7f51dd552640 1 -- 172.21.15.73:0/2512790234 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51d80c19a0 con 0x7f51d814f8c0 2023-12-12T09:45:43.893 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:43.892+0000 7f51dd552640 1 --2- 172.21.15.73:0/2512790234 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f51d814f8c0 0x7f51d806dc40 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f51d40098a0 tx=0x7f51d402b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95e39a094b9fc88a server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:45:43.893 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:43.892+0000 7f51cffff640 1 -- 172.21.15.73:0/2512790234 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51d4031640 con 0x7f51d814f8c0 2023-12-12T09:45:43.893 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:43.893+0000 7f51cffff640 1 -- 172.21.15.73:0/2512790234 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51d40317a0 con 0x7f51d814f8c0 2023-12-12T09:45:43.893 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:43.893+0000 7f51cffff640 1 -- 172.21.15.73:0/2512790234 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51d4031b30 con 0x7f51d814f8c0 2023-12-12T09:45:43.894 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:43.893+0000 7f51df7b6640 1 -- 172.21.15.73:0/2512790234 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f51d814f8c0 msgr2=0x7f51d806dc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:43.894 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:43.893+0000 7f51df7b6640 1 --2- 172.21.15.73:0/2512790234 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f51d814f8c0 0x7f51d806dc40 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f51d40098a0 tx=0x7f51d402b8f0 comp rx=0 tx=0).stop 2023-12-12T09:45:43.894 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:43.893+0000 7f51df7b6640 1 -- 172.21.15.73:0/2512790234 shutdown_connections 2023-12-12T09:45:43.894 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:43.893+0000 7f51df7b6640 1 --2- 172.21.15.73:0/2512790234 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f51d806d350 0x7f51d8071e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:43.894 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:43.893+0000 7f51df7b6640 1 --2- 172.21.15.73:0/2512790234 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f51d814f8c0 0x7f51d806dc40 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:43.894 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:43.893+0000 7f51df7b6640 1 -- 172.21.15.73:0/2512790234 >> 172.21.15.73:0/2512790234 conn(0x7f51d806a4e0 msgr2=0x7f51d806a8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:45:43.894 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:43.893+0000 7f51df7b6640 1 -- 172.21.15.73:0/2512790234 shutdown_connections 2023-12-12T09:45:43.894 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:43.893+0000 7f51df7b6640 1 -- 172.21.15.73:0/2512790234 wait complete. 2023-12-12T09:45:43.895 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:43.895+0000 7f51df7b6640 1 Processor -- start 2023-12-12T09:45:43.895 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:43.895+0000 7f51df7b6640 1 -- start start 2023-12-12T09:45:43.898 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:43.896+0000 7f51df7b6640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f51d806d350 0x7f51d8149120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:43.898 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:43.896+0000 7f51df7b6640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f51d80723a0 0x7f51d80a9630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:43.898 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:43.896+0000 7f51df7b6640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f51d814f8c0 0x7f51d813ec70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:43.898 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:43.896+0000 7f51df7b6640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51d80aa490 con 0x7f51d806d350 2023-12-12T09:45:43.898 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:43.896+0000 7f51df7b6640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51d80aaa50 con 0x7f51d814f8c0 2023-12-12T09:45:43.898 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:43.896+0000 7f51df7b6640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51d81e8cb0 con 0x7f51d80723a0 2023-12-12T09:45:43.898 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:43.896+0000 7f51dd552640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f51d806d350 0x7f51d8149120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:43.898 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:43.896+0000 7f51dd552640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f51d806d350 0x7f51d8149120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:42256/0 (socket says 172.21.15.73:42256) 2023-12-12T09:45:43.898 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:43.896+0000 7f51dd552640 1 -- 172.21.15.73:0/3081827131 learned_addr learned my addr 172.21.15.73:0/3081827131 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:45:43.898 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:43.897+0000 7f51dd552640 1 -- 172.21.15.73:0/3081827131 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f51d80723a0 msgr2=0x7f51d80a9630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:43.898 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:43.897+0000 7f51dcd51640 1 --2- 172.21.15.73:0/3081827131 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f51d80723a0 0x7f51d80a9630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:43.898 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:43.897+0000 7f51ddd53640 1 --2- 172.21.15.73:0/3081827131 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f51d814f8c0 0x7f51d813ec70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:43.898 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:43.897+0000 7f51dd552640 1 --2- 172.21.15.73:0/3081827131 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f51d80723a0 0x7f51d80a9630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:43.899 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:43.897+0000 7f51dd552640 1 -- 172.21.15.73:0/3081827131 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f51d814f8c0 msgr2=0x7f51d813ec70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:43.899 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:43.897+0000 7f51dd552640 1 --2- 172.21.15.73:0/3081827131 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f51d814f8c0 0x7f51d813ec70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:43.899 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:43.897+0000 7f51dd552640 1 -- 172.21.15.73:0/3081827131 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51d40094d0 con 0x7f51d806d350 2023-12-12T09:45:43.899 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:43.897+0000 7f51dcd51640 1 --2- 172.21.15.73:0/3081827131 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f51d80723a0 0x7f51d80a9630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:45:43.899 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:43.897+0000 7f51ddd53640 1 --2- 172.21.15.73:0/3081827131 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f51d814f8c0 0x7f51d813ec70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:45:43.899 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:43.897+0000 7f51dd552640 1 --2- 172.21.15.73:0/3081827131 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f51d806d350 0x7f51d8149120 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f51d40098a0 tx=0x7f51d40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:45:43.899 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:43.897+0000 7f51cdffb640 1 -- 172.21.15.73:0/3081827131 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51d403ac60 con 0x7f51d806d350 2023-12-12T09:45:43.899 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:43.897+0000 7f51cdffb640 1 -- 172.21.15.73:0/3081827131 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51d403adc0 con 0x7f51d806d350 2023-12-12T09:45:43.899 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:43.897+0000 7f51df7b6640 1 -- 172.21.15.73:0/3081827131 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51d81e8f90 con 0x7f51d806d350 2023-12-12T09:45:43.899 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:43.897+0000 7f51cdffb640 1 -- 172.21.15.73:0/3081827131 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51d4044630 con 0x7f51d806d350 2023-12-12T09:45:43.899 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:43.897+0000 7f51df7b6640 1 -- 172.21.15.73:0/3081827131 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51d80a9b70 con 0x7f51d806d350 2023-12-12T09:45:43.900 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:43.899+0000 7f51df7b6640 1 -- 172.21.15.73:0/3081827131 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f51d81e9120 con 0x7f51d806d350 2023-12-12T09:45:43.900 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:43.900+0000 7f51cdffb640 1 -- 172.21.15.73:0/3081827131 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f51d402f050 con 0x7f51d806d350 2023-12-12T09:45:43.901 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:43.901+0000 7f51cdffb640 1 --2- 172.21.15.73:0/3081827131 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f51bc06ae40 0x7f51bc06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:43.901 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:43.901+0000 7f51cdffb640 1 -- 172.21.15.73:0/3081827131 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f51d40ab960 con 0x7f51d806d350 2023-12-12T09:45:43.901 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:43.901+0000 7f51dcd51640 1 --2- 172.21.15.73:0/3081827131 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f51bc06ae40 0x7f51bc06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:43.902 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:43.902+0000 7f51dcd51640 1 --2- 172.21.15.73:0/3081827131 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f51bc06ae40 0x7f51bc06d300 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f51c8006fd0 tx=0x7f51c8008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:45:43.906 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:43.906+0000 7f51cdffb640 1 -- 172.21.15.73:0/3081827131 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f51d40766a0 con 0x7f51d806d350 2023-12-12T09:45:44.166 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:44.165+0000 7f51df7b6640 1 -- 172.21.15.73:0/3081827131 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.1", "caps": ["mon", "allow r", "osd", "allow rw pool=cephfs2_data", "mds", "allow"]} v 0) v1 -- 0x7f51d8067070 con 0x7f51d806d350 2023-12-12T09:45:44.169 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:44.168+0000 7f51cdffb640 1 -- 172.21.15.73:0/3081827131 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.1", "caps": ["mon", "allow r", "osd", "allow rw pool=cephfs2_data", "mds", "allow"]}]=0 updated caps for client.1 v16) v1 ==== 185+0+142 (secure 0 0 0) 0x7f51d4079cc0 con 0x7f51d806d350 2023-12-12T09:45:44.169 INFO:teuthology.orchestra.run.smithi073.stdout:[client.1] 2023-12-12T09:45:44.169 INFO:teuthology.orchestra.run.smithi073.stdout: key = AQD/KnhlLq6aERAAgTQwqvltAggkGpb77Zngsg== 2023-12-12T09:45:44.169 INFO:teuthology.orchestra.run.smithi073.stdout: caps mds = "allow" 2023-12-12T09:45:44.169 INFO:teuthology.orchestra.run.smithi073.stdout: caps mon = "allow r" 2023-12-12T09:45:44.169 INFO:teuthology.orchestra.run.smithi073.stdout: caps osd = "allow rw pool=cephfs2_data" 2023-12-12T09:45:44.169 INFO:teuthology.orchestra.run.smithi073.stderr:updated caps for client.1 2023-12-12T09:45:44.172 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:44.171+0000 7f51df7b6640 1 -- 172.21.15.73:0/3081827131 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f51bc06ae40 msgr2=0x7f51bc06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:44.172 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:44.171+0000 7f51df7b6640 1 --2- 172.21.15.73:0/3081827131 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f51bc06ae40 0x7f51bc06d300 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f51c8006fd0 tx=0x7f51c8008040 comp rx=0 tx=0).stop 2023-12-12T09:45:44.172 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:44.171+0000 7f51df7b6640 1 -- 172.21.15.73:0/3081827131 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f51d806d350 msgr2=0x7f51d8149120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:44.172 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:44.171+0000 7f51df7b6640 1 --2- 172.21.15.73:0/3081827131 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f51d806d350 0x7f51d8149120 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f51d40098a0 tx=0x7f51d40046c0 comp rx=0 tx=0).stop 2023-12-12T09:45:44.172 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:44.171+0000 7f51df7b6640 1 -- 172.21.15.73:0/3081827131 shutdown_connections 2023-12-12T09:45:44.172 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:44.171+0000 7f51df7b6640 1 --2- 172.21.15.73:0/3081827131 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f51bc06ae40 0x7f51bc06d300 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:44.172 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:44.171+0000 7f51df7b6640 1 --2- 172.21.15.73:0/3081827131 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f51d814f8c0 0x7f51d813ec70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:44.172 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:44.171+0000 7f51df7b6640 1 --2- 172.21.15.73:0/3081827131 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f51d80723a0 0x7f51d80a9630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:44.172 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:44.171+0000 7f51df7b6640 1 --2- 172.21.15.73:0/3081827131 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f51d806d350 0x7f51d8149120 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:44.173 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:44.171+0000 7f51df7b6640 1 -- 172.21.15.73:0/3081827131 >> 172.21.15.73:0/3081827131 conn(0x7f51d806a4e0 msgr2=0x7f51d80c59a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:45:44.173 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:44.172+0000 7f51df7b6640 1 -- 172.21.15.73:0/3081827131 shutdown_connections 2023-12-12T09:45:44.173 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:44.172+0000 7f51df7b6640 1 -- 172.21.15.73:0/3081827131 wait complete. 2023-12-12T09:45:44.191 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2023-12-12T09:45:44.191 DEBUG:teuthology.orchestra.run.smithi142:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-12T09:45:44.252 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2023-12-12T09:45:44.252 DEBUG:teuthology.orchestra.run.smithi142:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-12T09:45:44.308 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-12T09:45:44.478 INFO:tasks.ceph.mds.d.smithi142.stderr:2023-12-12T09:45:44.477+0000 7f7282b7d640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-12-12T09:45:44.531 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:44.530+0000 7f2863fff640 1 Processor -- start 2023-12-12T09:45:44.531 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:44.531+0000 7f2863fff640 1 -- start start 2023-12-12T09:45:44.533 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:44.532+0000 7f2863fff640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f286414fbb0 0x7f28640c09e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:44.533 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:44.532+0000 7f2863fff640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f28640c0f20 0x7f28640aae00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:44.533 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:44.532+0000 7f2863fff640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f28640a9470 0x7f28640ab340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:44.533 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:44.532+0000 7f2863fff640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28640aa000 con 0x7f28640a9470 2023-12-12T09:45:44.533 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:44.532+0000 7f2863fff640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28640c1d40 con 0x7f286414fbb0 2023-12-12T09:45:44.533 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:44.532+0000 7f2863fff640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2864153300 con 0x7f28640c0f20 2023-12-12T09:45:44.533 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:44.533+0000 7f28637fe640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f28640a9470 0x7f28640ab340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:44.533 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:44.533+0000 7f28637fe640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f28640a9470 0x7f28640ab340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:42260/0 (socket says 172.21.15.73:42260) 2023-12-12T09:45:44.533 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:44.533+0000 7f28637fe640 1 -- 172.21.15.73:0/377140448 learned_addr learned my addr 172.21.15.73:0/377140448 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:45:44.535 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:44.533+0000 7f285bfff640 1 --2- 172.21.15.73:0/377140448 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f28640c0f20 0x7f28640aae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:44.535 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:44.533+0000 7f28637fe640 1 -- 172.21.15.73:0/377140448 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f28640c0f20 msgr2=0x7f28640aae00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:45:44.535 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:44.533+0000 7f28637fe640 1 --2- 172.21.15.73:0/377140448 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f28640c0f20 0x7f28640aae00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:44.535 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:44.533+0000 7f2862ffd640 1 --2- 172.21.15.73:0/377140448 >> v2:172.21.15.142:3300/0 conn(0x7f286414fbb0 0x7f28640c09e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:44.535 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:44.533+0000 7f28637fe640 1 -- 172.21.15.73:0/377140448 >> v2:172.21.15.142:3300/0 conn(0x7f286414fbb0 msgr2=0x7f28640c09e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:45:44.536 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:44.533+0000 7f28637fe640 1 --2- 172.21.15.73:0/377140448 >> v2:172.21.15.142:3300/0 conn(0x7f286414fbb0 0x7f28640c09e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:44.536 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:44.533+0000 7f28637fe640 1 -- 172.21.15.73:0/377140448 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28640c2160 con 0x7f28640a9470 2023-12-12T09:45:44.536 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:44.533+0000 7f2862ffd640 1 --2- 172.21.15.73:0/377140448 >> v2:172.21.15.142:3300/0 conn(0x7f286414fbb0 0x7f28640c09e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:45:44.536 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:44.534+0000 7f28637fe640 1 --2- 172.21.15.73:0/377140448 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f28640a9470 0x7f28640ab340 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f28640a9330 tx=0x7f285c02be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95be5a56b143074b server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:45:44.536 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:44.535+0000 7f28627fc640 1 -- 172.21.15.73:0/377140448 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f285c02c9f0 con 0x7f28640a9470 2023-12-12T09:45:44.536 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:44.535+0000 7f28627fc640 1 -- 172.21.15.73:0/377140448 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f285c02cb50 con 0x7f28640a9470 2023-12-12T09:45:44.536 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:44.535+0000 7f28627fc640 1 -- 172.21.15.73:0/377140448 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f285c0343f0 con 0x7f28640a9470 2023-12-12T09:45:44.538 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:44.535+0000 7f2863fff640 1 -- 172.21.15.73:0/377140448 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f28640a9470 msgr2=0x7f28640ab340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:44.538 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:44.535+0000 7f2863fff640 1 --2- 172.21.15.73:0/377140448 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f28640a9470 0x7f28640ab340 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f28640a9330 tx=0x7f285c02be50 comp rx=0 tx=0).stop 2023-12-12T09:45:44.538 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:44.535+0000 7f2863fff640 1 -- 172.21.15.73:0/377140448 shutdown_connections 2023-12-12T09:45:44.538 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:44.535+0000 7f2863fff640 1 --2- 172.21.15.73:0/377140448 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f28640a9470 0x7f28640ab340 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:44.538 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:44.535+0000 7f2863fff640 1 --2- 172.21.15.73:0/377140448 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f28640c0f20 0x7f28640aae00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:44.538 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:44.535+0000 7f2863fff640 1 --2- 172.21.15.73:0/377140448 >> v2:172.21.15.142:3300/0 conn(0x7f286414fbb0 0x7f28640c09e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:44.539 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:44.535+0000 7f2863fff640 1 -- 172.21.15.73:0/377140448 >> 172.21.15.73:0/377140448 conn(0x7f28640c23b0 msgr2=0x7f28640c2790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:45:44.539 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:44.535+0000 7f2863fff640 1 -- 172.21.15.73:0/377140448 shutdown_connections 2023-12-12T09:45:44.539 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:44.535+0000 7f2863fff640 1 -- 172.21.15.73:0/377140448 wait complete. 2023-12-12T09:45:44.539 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:44.537+0000 7f2863fff640 1 Processor -- start 2023-12-12T09:45:44.539 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:44.537+0000 7f2863fff640 1 -- start start 2023-12-12T09:45:44.541 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:44.538+0000 7f2863fff640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f28640a9470 0x7f2864151b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:44.541 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:44.538+0000 7f2863fff640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f28640c0f20 0x7f286406d060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:44.541 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:44.538+0000 7f2863fff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f286414fbb0 0x7f286406c0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:44.541 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:44.538+0000 7f2863fff640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28641540e0 con 0x7f286414fbb0 2023-12-12T09:45:44.541 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:44.538+0000 7f2863fff640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28641543c0 con 0x7f28640a9470 2023-12-12T09:45:44.541 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:44.538+0000 7f2863fff640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28641546a0 con 0x7f28640c0f20 2023-12-12T09:45:44.542 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:44.538+0000 7f28637fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f286414fbb0 0x7f286406c0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:44.542 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:44.538+0000 7f28637fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f286414fbb0 0x7f286406c0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:42272/0 (socket says 172.21.15.73:42272) 2023-12-12T09:45:44.542 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:44.538+0000 7f28637fe640 1 -- 172.21.15.73:0/4178557715 learned_addr learned my addr 172.21.15.73:0/4178557715 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:45:44.542 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:44.539+0000 7f2862ffd640 1 --2- 172.21.15.73:0/4178557715 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f28640a9470 0x7f2864151b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:44.542 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:44.539+0000 7f285bfff640 1 --2- 172.21.15.73:0/4178557715 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f28640c0f20 0x7f286406d060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:44.542 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:44.539+0000 7f28637fe640 1 -- 172.21.15.73:0/4178557715 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f28640c0f20 msgr2=0x7f286406d060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:44.542 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:44.539+0000 7f28637fe640 1 --2- 172.21.15.73:0/4178557715 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f28640c0f20 0x7f286406d060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:44.542 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:44.539+0000 7f28637fe640 1 -- 172.21.15.73:0/4178557715 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f28640a9470 msgr2=0x7f2864151b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:44.542 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:44.539+0000 7f28637fe640 1 --2- 172.21.15.73:0/4178557715 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f28640a9470 0x7f2864151b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:44.542 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:44.539+0000 7f28637fe640 1 -- 172.21.15.73:0/4178557715 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f285c009b30 con 0x7f286414fbb0 2023-12-12T09:45:44.542 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:44.539+0000 7f285bfff640 1 --2- 172.21.15.73:0/4178557715 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f28640c0f20 0x7f286406d060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:45:44.542 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:44.539+0000 7f28637fe640 1 --2- 172.21.15.73:0/4178557715 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f286414fbb0 0x7f286406c0a0 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f285c036040 tx=0x7f285c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:45:44.542 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:44.539+0000 7f285b7fe640 1 -- 172.21.15.73:0/4178557715 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f285c03e450 con 0x7f286414fbb0 2023-12-12T09:45:44.542 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:44.540+0000 7f285b7fe640 1 -- 172.21.15.73:0/4178557715 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f285c03e5d0 con 0x7f286414fbb0 2023-12-12T09:45:44.542 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:44.540+0000 7f285b7fe640 1 -- 172.21.15.73:0/4178557715 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f285c03e980 con 0x7f286414fbb0 2023-12-12T09:45:44.543 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:44.540+0000 7f2863fff640 1 -- 172.21.15.73:0/4178557715 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f286406b8a0 con 0x7f286414fbb0 2023-12-12T09:45:44.543 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:44.540+0000 7f2863fff640 1 -- 172.21.15.73:0/4178557715 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f286406d5a0 con 0x7f286414fbb0 2023-12-12T09:45:44.543 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:44.541+0000 7f2863fff640 1 -- 172.21.15.73:0/4178557715 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f286406bdc0 con 0x7f286414fbb0 2023-12-12T09:45:44.543 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:44.542+0000 7f285b7fe640 1 -- 172.21.15.73:0/4178557715 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f285c03eae0 con 0x7f286414fbb0 2023-12-12T09:45:44.544 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:44.542+0000 7f285b7fe640 1 --2- 172.21.15.73:0/4178557715 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f284406ae40 0x7f284406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:44.544 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:44.543+0000 7f285b7fe640 1 -- 172.21.15.73:0/4178557715 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f285c0ac8e0 con 0x7f286414fbb0 2023-12-12T09:45:44.544 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:44.543+0000 7f2862ffd640 1 --2- 172.21.15.73:0/4178557715 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f284406ae40 0x7f284406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:44.544 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:44.543+0000 7f2862ffd640 1 --2- 172.21.15.73:0/4178557715 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f284406ae40 0x7f284406d300 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f285400a950 tx=0x7f2854008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:45:44.547 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:44.547+0000 7f285b7fe640 1 -- 172.21.15.73:0/4178557715 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f286406bdc0 con 0x7f286414fbb0 2023-12-12T09:45:44.737 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:44.737+0000 7f2863fff640 1 -- 172.21.15.73:0/4178557715 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f286406bdc0 con 0x7f286414fbb0 2023-12-12T09:45:44.741 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:44.741+0000 7f285b7fe640 1 -- 172.21.15.73:0/4178557715 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v58) v1 ==== 74+0+20292 (secure 0 0 0) 0x7f286406bdc0 con 0x7f286414fbb0 2023-12-12T09:45:44.742 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-12T09:45:44.742 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":58,"fsid":"ba240992-02b8-4c7e-92f2-27eb29ac433b","created":"2023-12-12T09:43:02.454719+0000","modified":"2023-12-12T09:45:39.273967+0000","last_up_change":"2023-12-12T09:43:13.913440+0000","last_in_change":"2023-12-12T09:43:05.925348+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-12T09:43:15.525508+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-12-12T09:45:21.264815+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"53","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-12-12T09:45:21.981834+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"54","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs2_metadata","create_time":"2023-12-12T09:45:36.388393+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"57","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs2_data","create_time":"2023-12-12T09:45:37.109653+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"58","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"dd9074be-dbe2-4c34-9896-a4223d8d3940","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":4047810203},{"type":"v1","addr":"172.21.15.73:6801","nonce":4047810203}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":4047810203},{"type":"v1","addr":"172.21.15.73:6803","nonce":4047810203}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":4047810203},{"type":"v1","addr":"172.21.15.73:6807","nonce":4047810203}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":4047810203},{"type":"v1","addr":"172.21.15.73:6805","nonce":4047810203}]},"public_addr":"172.21.15.73:6801/4047810203","cluster_addr":"172.21.15.73:6803/4047810203","heartbeat_back_addr":"172.21.15.73:6807/4047810203","heartbeat_front_addr":"172.21.15.73:6805/4047810203","state":["exists","up"]},{"osd":1,"uuid":"c4a05052-96d4-4758-a4e1-1a37f1e07fed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":1356058331},{"type":"v1","addr":"172.21.15.73:6824","nonce":1356058331}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":1356058331},{"type":"v1","addr":"172.21.15.73:6827","nonce":1356058331}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":1356058331},{"type":"v1","addr":"172.21.15.73:6831","nonce":1356058331}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":1356058331},{"type":"v1","addr":"172.21.15.73:6829","nonce":1356058331}]},"public_addr":"172.21.15.73:6824/1356058331","cluster_addr":"172.21.15.73:6827/1356058331","heartbeat_back_addr":"172.21.15.73:6831/1356058331","heartbeat_front_addr":"172.21.15.73:6829/1356058331","state":["exists","up"]},{"osd":2,"uuid":"512bc8ac-72c2-40d4-b3d2-d867a92c5213","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":1228903316},{"type":"v1","addr":"172.21.15.73:6817","nonce":1228903316}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":1228903316},{"type":"v1","addr":"172.21.15.73:6819","nonce":1228903316}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6823","nonce":1228903316},{"type":"v1","addr":"172.21.15.73:6825","nonce":1228903316}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":1228903316},{"type":"v1","addr":"172.21.15.73:6821","nonce":1228903316}]},"public_addr":"172.21.15.73:6817/1228903316","cluster_addr":"172.21.15.73:6819/1228903316","heartbeat_back_addr":"172.21.15.73:6825/1228903316","heartbeat_front_addr":"172.21.15.73:6821/1228903316","state":["exists","up"]},{"osd":3,"uuid":"3d1a91e0-42bf-437a-8eae-8d357c8f63a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":1293329670},{"type":"v1","addr":"172.21.15.73:6809","nonce":1293329670}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6810","nonce":1293329670},{"type":"v1","addr":"172.21.15.73:6811","nonce":1293329670}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":1293329670},{"type":"v1","addr":"172.21.15.73:6815","nonce":1293329670}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":1293329670},{"type":"v1","addr":"172.21.15.73:6813","nonce":1293329670}]},"public_addr":"172.21.15.73:6809/1293329670","cluster_addr":"172.21.15.73:6811/1293329670","heartbeat_back_addr":"172.21.15.73:6815/1293329670","heartbeat_front_addr":"172.21.15.73:6813/1293329670","state":["exists","up"]},{"osd":4,"uuid":"4b302fff-834c-4069-ac19-00e46f6c87b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":3727975702},{"type":"v1","addr":"172.21.15.142:6801","nonce":3727975702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":3727975702},{"type":"v1","addr":"172.21.15.142:6803","nonce":3727975702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6809","nonce":3727975702},{"type":"v1","addr":"172.21.15.142:6811","nonce":3727975702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6805","nonce":3727975702},{"type":"v1","addr":"172.21.15.142:6807","nonce":3727975702}]},"public_addr":"172.21.15.142:6801/3727975702","cluster_addr":"172.21.15.142:6803/3727975702","heartbeat_back_addr":"172.21.15.142:6811/3727975702","heartbeat_front_addr":"172.21.15.142:6807/3727975702","state":["exists","up"]},{"osd":5,"uuid":"d7cdace2-67d0-45cc-95f2-515cf6ef1b82","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6817","nonce":2353193632},{"type":"v1","addr":"172.21.15.142:6819","nonce":2353193632}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6821","nonce":2353193632},{"type":"v1","addr":"172.21.15.142:6823","nonce":2353193632}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6829","nonce":2353193632},{"type":"v1","addr":"172.21.15.142:6831","nonce":2353193632}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6825","nonce":2353193632},{"type":"v1","addr":"172.21.15.142:6827","nonce":2353193632}]},"public_addr":"172.21.15.142:6819/2353193632","cluster_addr":"172.21.15.142:6823/2353193632","heartbeat_back_addr":"172.21.15.142:6831/2353193632","heartbeat_front_addr":"172.21.15.142:6827/2353193632","state":["exists","up"]},{"osd":6,"uuid":"649ce78a-5626-445c-aedc-a651ed05a6f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":2006111986},{"type":"v1","addr":"172.21.15.142:6806","nonce":2006111986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":2006111986},{"type":"v1","addr":"172.21.15.142:6810","nonce":2006111986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":2006111986},{"type":"v1","addr":"172.21.15.142:6815","nonce":2006111986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":2006111986},{"type":"v1","addr":"172.21.15.142:6813","nonce":2006111986}]},"public_addr":"172.21.15.142:6806/2006111986","cluster_addr":"172.21.15.142:6810/2006111986","heartbeat_back_addr":"172.21.15.142:6815/2006111986","heartbeat_front_addr":"172.21.15.142:6813/2006111986","state":["exists","up"]},{"osd":7,"uuid":"af15ae3b-c1d0-4acf-92db-8a1805494d13","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":2573794341},{"type":"v1","addr":"172.21.15.142:6818","nonce":2573794341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":2573794341},{"type":"v1","addr":"172.21.15.142:6822","nonce":2573794341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":2573794341},{"type":"v1","addr":"172.21.15.142:6830","nonce":2573794341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":2573794341},{"type":"v1","addr":"172.21.15.142:6826","nonce":2573794341}]},"public_addr":"172.21.15.142:6818/2573794341","cluster_addr":"172.21.15.142:6822/2573794341","heartbeat_back_addr":"172.21.15.142:6830/2573794341","heartbeat_front_addr":"172.21.15.142:6826/2573794341","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.185824+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.262103+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.225556+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:10.523459+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:10.706035+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.257339+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.301776+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.051960+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-12T09:45:44.744 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:44.744+0000 7f2863fff640 1 -- 172.21.15.73:0/4178557715 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f284406ae40 msgr2=0x7f284406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:44.744 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:44.744+0000 7f2863fff640 1 --2- 172.21.15.73:0/4178557715 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f284406ae40 0x7f284406d300 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f285400a950 tx=0x7f2854008040 comp rx=0 tx=0).stop 2023-12-12T09:45:44.744 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:44.744+0000 7f2863fff640 1 -- 172.21.15.73:0/4178557715 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f286414fbb0 msgr2=0x7f286406c0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:44.744 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:44.744+0000 7f2863fff640 1 --2- 172.21.15.73:0/4178557715 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f286414fbb0 0x7f286406c0a0 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f285c036040 tx=0x7f285c004a40 comp rx=0 tx=0).stop 2023-12-12T09:45:44.745 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:44.744+0000 7f2863fff640 1 -- 172.21.15.73:0/4178557715 shutdown_connections 2023-12-12T09:45:44.745 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:44.744+0000 7f2863fff640 1 --2- 172.21.15.73:0/4178557715 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f284406ae40 0x7f284406d300 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:44.745 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:44.744+0000 7f2863fff640 1 --2- 172.21.15.73:0/4178557715 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f286414fbb0 0x7f286406c0a0 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:44.745 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:44.744+0000 7f2863fff640 1 --2- 172.21.15.73:0/4178557715 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f28640c0f20 0x7f286406d060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:44.745 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:44.744+0000 7f2863fff640 1 --2- 172.21.15.73:0/4178557715 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f28640a9470 0x7f2864151b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:44.745 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:44.744+0000 7f2863fff640 1 -- 172.21.15.73:0/4178557715 >> 172.21.15.73:0/4178557715 conn(0x7f28640c23b0 msgr2=0x7f28640c34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:45:44.745 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:44.744+0000 7f2863fff640 1 -- 172.21.15.73:0/4178557715 shutdown_connections 2023-12-12T09:45:44.745 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:44.744+0000 7f2863fff640 1 -- 172.21.15.73:0/4178557715 wait complete. 2023-12-12T09:45:44.764 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-12T09:43:15.525508+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 8, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-12T09:45:21.264815+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '53', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 9, 'pool_name': 'cephfs_data', 'create_time': '2023-12-12T09:45:21.981834+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '54', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 10, 'pool_name': 'cephfs2_metadata', 'create_time': '2023-12-12T09:45:36.388393+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '57', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs2'}}, 'read_balance': {'score_acting': 2.5, 'score_stable': 2.5, 'optimal_score': 1, 'raw_score_acting': 2.5, 'raw_score_stable': 2.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 11, 'pool_name': 'cephfs2_data', 'create_time': '2023-12-12T09:45:37.109653+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '58', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs2'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-12T09:45:44.765 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-12T09:45:44.978 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:44.977+0000 7f37b8c97640 1 Processor -- start 2023-12-12T09:45:44.978 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:44.977+0000 7f37b8c97640 1 -- start start 2023-12-12T09:45:44.979 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:44.979+0000 7f37b8c97640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f37b406dc40 0x7f37b4152c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:44.979 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:44.979+0000 7f37b8c97640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37b40c16c0 con 0x7f37b406d350 2023-12-12T09:45:44.979 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:44.979+0000 7f37b8c97640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37b40c19a0 con 0x7f37b414f8c0 2023-12-12T09:45:44.979 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:44.979+0000 7f37b8c97640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37b40c1090 con 0x7f37b406dc40 2023-12-12T09:45:44.980 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:44.979+0000 7f37b1d9b640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f37b406d350 0x7f37b4152500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:47278/0 (socket says 172.21.15.73:47278) 2023-12-12T09:45:44.980 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:44.979+0000 7f37b2d9d640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f37b406dc40 0x7f37b4152c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:44.980 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:44.979+0000 7f37b1d9b640 1 -- 172.21.15.73:0/4029663006 learned_addr learned my addr 172.21.15.73:0/4029663006 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-12T09:45:44.980 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:44.980+0000 7f37b159a640 1 -- 172.21.15.73:0/4029663006 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1310595921 0 0) 0x7f37b40c16c0 con 0x7f37b406d350 2023-12-12T09:45:44.980 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:44.980+0000 7f37b159a640 1 -- 172.21.15.73:0/4029663006 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f379c003520 con 0x7f37b406d350 2023-12-12T09:45:44.980 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:44.980+0000 7f37b2d9d640 1 -- 172.21.15.73:0/4029663006 >> v1:172.21.15.142:6789/0 conn(0x7f37b414f8c0 legacy=0x7f37b4071e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:44.981 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:44.980+0000 7f37b2d9d640 1 -- 172.21.15.73:0/4029663006 >> v1:172.21.15.73:6789/0 conn(0x7f37b406d350 legacy=0x7f37b4152500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:44.981 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:44.980+0000 7f37b2d9d640 1 -- 172.21.15.73:0/4029663006 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37b40c1c80 con 0x7f37b406dc40 2023-12-12T09:45:44.981 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:44.981+0000 7f37b2d9d640 1 --2- 172.21.15.73:0/4029663006 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f37b406dc40 0x7f37b4152c10 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f37ac009d90 tx=0x7f37ac02bf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1cff84c222cc471f server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:45:44.981 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:44.981+0000 7f37b159a640 1 -- 172.21.15.73:0/4029663006 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37ac02cd00 con 0x7f37b406dc40 2023-12-12T09:45:44.981 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:44.981+0000 7f37b159a640 1 -- 172.21.15.73:0/4029663006 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37ac02ce60 con 0x7f37b406dc40 2023-12-12T09:45:44.981 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:44.981+0000 7f37b159a640 1 -- 172.21.15.73:0/4029663006 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37ac034660 con 0x7f37b406dc40 2023-12-12T09:45:44.982 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:44.982+0000 7f37b8c97640 1 -- 172.21.15.73:0/4029663006 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f37b406dc40 msgr2=0x7f37b4152c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:44.982 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:44.982+0000 7f37b8c97640 1 --2- 172.21.15.73:0/4029663006 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f37b406dc40 0x7f37b4152c10 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f37ac009d90 tx=0x7f37ac02bf50 comp rx=0 tx=0).stop 2023-12-12T09:45:44.982 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:44.982+0000 7f37b8c97640 1 -- 172.21.15.73:0/4029663006 shutdown_connections 2023-12-12T09:45:44.983 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:44.982+0000 7f37b8c97640 1 --2- 172.21.15.73:0/4029663006 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f37b406dc40 0x7f37b4152c10 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:44.983 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:44.982+0000 7f37b8c97640 1 -- 172.21.15.73:0/4029663006 >> 172.21.15.73:0/4029663006 conn(0x7f37b406a4e0 msgr2=0x7f37b406a8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:45:44.983 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:44.982+0000 7f37b8c97640 1 -- 172.21.15.73:0/4029663006 shutdown_connections 2023-12-12T09:45:44.983 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:44.982+0000 7f37b8c97640 1 -- 172.21.15.73:0/4029663006 wait complete. 2023-12-12T09:45:44.987 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:44.984+0000 7f37b8c97640 1 Processor -- start 2023-12-12T09:45:44.987 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:44.984+0000 7f37b8c97640 1 -- start start 2023-12-12T09:45:44.987 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:44.985+0000 7f37b8c97640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f37b406d350 0x7f37b4153de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:44.987 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:44.985+0000 7f37b8c97640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f37b406dc40 0x7f37b414b1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:44.987 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:44.985+0000 7f37b8c97640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f37b414f8c0 0x7f37b41ea1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:44.987 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:44.985+0000 7f37b8c97640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37b4154320 con 0x7f37b406d350 2023-12-12T09:45:44.987 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:44.985+0000 7f37b8c97640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37b414eff0 con 0x7f37b414f8c0 2023-12-12T09:45:44.987 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:44.985+0000 7f37b8c97640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37b41eac50 con 0x7f37b406dc40 2023-12-12T09:45:44.987 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:44.985+0000 7f37b259c640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f37b406d350 0x7f37b4153de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:44.988 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:44.985+0000 7f37b259c640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f37b406d350 0x7f37b4153de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:42276/0 (socket says 172.21.15.73:42276) 2023-12-12T09:45:44.988 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:44.985+0000 7f37b259c640 1 -- 172.21.15.73:0/4072382677 learned_addr learned my addr 172.21.15.73:0/4072382677 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:45:44.988 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:44.985+0000 7f37b1d9b640 1 --2- 172.21.15.73:0/4072382677 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f37b406dc40 0x7f37b414b1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:44.988 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:44.985+0000 7f37b2d9d640 1 --2- 172.21.15.73:0/4072382677 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f37b414f8c0 0x7f37b41ea1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:44.988 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:44.985+0000 7f37b259c640 1 -- 172.21.15.73:0/4072382677 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f37b406dc40 msgr2=0x7f37b414b1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:44.988 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:44.985+0000 7f37b259c640 1 --2- 172.21.15.73:0/4072382677 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f37b406dc40 0x7f37b414b1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:44.988 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:44.985+0000 7f37b259c640 1 -- 172.21.15.73:0/4072382677 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f37b414f8c0 msgr2=0x7f37b41ea1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:44.988 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:44.985+0000 7f37b259c640 1 --2- 172.21.15.73:0/4072382677 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f37b414f8c0 0x7f37b41ea1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:44.988 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:44.985+0000 7f37b259c640 1 -- 172.21.15.73:0/4072382677 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37ac009a70 con 0x7f37b406d350 2023-12-12T09:45:44.988 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:44.985+0000 7f37b1d9b640 1 --2- 172.21.15.73:0/4072382677 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f37b406dc40 0x7f37b414b1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:45:44.988 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:44.986+0000 7f37b259c640 1 --2- 172.21.15.73:0/4072382677 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f37b406d350 0x7f37b4153de0 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f37a400c450 tx=0x7f37a400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:45:44.988 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:44.986+0000 7f37a2ffd640 1 -- 172.21.15.73:0/4072382677 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37a40052d0 con 0x7f37b406d350 2023-12-12T09:45:44.988 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:44.986+0000 7f37a2ffd640 1 -- 172.21.15.73:0/4072382677 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37a4005430 con 0x7f37b406d350 2023-12-12T09:45:44.988 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:44.986+0000 7f37a2ffd640 1 -- 172.21.15.73:0/4072382677 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37a4012870 con 0x7f37b406d350 2023-12-12T09:45:44.988 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:44.986+0000 7f37b8c97640 1 -- 172.21.15.73:0/4072382677 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37b414a6f0 con 0x7f37b406d350 2023-12-12T09:45:44.989 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:44.986+0000 7f37b8c97640 1 -- 172.21.15.73:0/4072382677 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37b414acb0 con 0x7f37b406d350 2023-12-12T09:45:44.989 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:44.987+0000 7f37b8c97640 1 -- 172.21.15.73:0/4072382677 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f37b4067070 con 0x7f37b406d350 2023-12-12T09:45:44.989 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:44.989+0000 7f37a2ffd640 1 -- 172.21.15.73:0/4072382677 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f37a40129d0 con 0x7f37b406d350 2023-12-12T09:45:44.990 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:44.990+0000 7f37a2ffd640 1 --2- 172.21.15.73:0/4072382677 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f379406ae40 0x7f379406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:44.990 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:44.990+0000 7f37a2ffd640 1 -- 172.21.15.73:0/4072382677 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f37a40894c0 con 0x7f37b406d350 2023-12-12T09:45:44.990 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:44.990+0000 7f37b1d9b640 1 --2- 172.21.15.73:0/4072382677 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f379406ae40 0x7f379406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:44.991 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:44.991+0000 7f37b1d9b640 1 --2- 172.21.15.73:0/4072382677 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f379406ae40 0x7f379406d300 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f37b414d600 tx=0x7f37a8009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:45:44.995 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:44.995+0000 7f37a2ffd640 1 -- 172.21.15.73:0/4072382677 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f37a4054200 con 0x7f37b406d350 2023-12-12T09:45:45.178 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:45.177+0000 7f37b8c97640 1 -- 172.21.15.73:0/4072382677 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f37b4067580 con 0x7f37b406d350 2023-12-12T09:45:45.178 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:45.178+0000 7f37a2ffd640 1 -- 172.21.15.73:0/4072382677 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v58) v1 ==== 93+0+10 (secure 0 0 0) 0x7f37a4057820 con 0x7f37b406d350 2023-12-12T09:45:45.178 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 1 2023-12-12T09:45:45.181 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:45.180+0000 7f37b8c97640 1 -- 172.21.15.73:0/4072382677 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f379406ae40 msgr2=0x7f379406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:45.181 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:45.180+0000 7f37b8c97640 1 --2- 172.21.15.73:0/4072382677 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f379406ae40 0x7f379406d300 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f37b414d600 tx=0x7f37a8009040 comp rx=0 tx=0).stop 2023-12-12T09:45:45.181 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:45.180+0000 7f37b8c97640 1 -- 172.21.15.73:0/4072382677 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f37b406d350 msgr2=0x7f37b4153de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:45.181 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:45.180+0000 7f37b8c97640 1 --2- 172.21.15.73:0/4072382677 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f37b406d350 0x7f37b4153de0 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f37a400c450 tx=0x7f37a400c910 comp rx=0 tx=0).stop 2023-12-12T09:45:45.181 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:45.180+0000 7f37b8c97640 1 -- 172.21.15.73:0/4072382677 shutdown_connections 2023-12-12T09:45:45.181 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:45.181+0000 7f37b8c97640 1 --2- 172.21.15.73:0/4072382677 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f379406ae40 0x7f379406d300 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:45.181 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:45.181+0000 7f37b8c97640 1 --2- 172.21.15.73:0/4072382677 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f37b414f8c0 0x7f37b41ea1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:45.181 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:45.181+0000 7f37b8c97640 1 --2- 172.21.15.73:0/4072382677 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f37b406dc40 0x7f37b414b1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:45.182 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:45.181+0000 7f37b8c97640 1 --2- 172.21.15.73:0/4072382677 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f37b406d350 0x7f37b4153de0 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:45.182 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:45.181+0000 7f37b8c97640 1 -- 172.21.15.73:0/4072382677 >> 172.21.15.73:0/4072382677 conn(0x7f37b406a4e0 msgr2=0x7f37b40c62b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:45:45.182 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:45.181+0000 7f37b8c97640 1 -- 172.21.15.73:0/4072382677 shutdown_connections 2023-12-12T09:45:45.182 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:45.181+0000 7f37b8c97640 1 -- 172.21.15.73:0/4072382677 wait complete. 2023-12-12T09:45:45.198 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-12T09:45:45.395 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:45.394+0000 7f8199e7c640 1 Processor -- start 2023-12-12T09:45:45.395 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:45.394+0000 7f8199e7c640 1 -- start start 2023-12-12T09:45:45.400 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:45.396+0000 7f8199e7c640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f81940c67c0 0x7f81940c7ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:45.400 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:45.396+0000 7f8199e7c640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81940c7030 con 0x7f81940c6ba0 2023-12-12T09:45:45.400 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:45.396+0000 7f8199e7c640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f819406c890 con 0x7f81941550a0 2023-12-12T09:45:45.400 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:45.396+0000 7f8199e7c640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81940c4af0 con 0x7f81940c67c0 2023-12-12T09:45:45.400 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:45.396+0000 7f8192ffd640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f81940c6ba0 0x7f819406c180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:47288/0 (socket says 172.21.15.73:47288) 2023-12-12T09:45:45.401 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:45.396+0000 7f8192ffd640 1 -- 172.21.15.73:0/1754291527 learned_addr learned my addr 172.21.15.73:0/1754291527 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-12T09:45:45.401 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:45.397+0000 7f81927fc640 1 -- 172.21.15.73:0/1754291527 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 289189377 0 0) 0x7f817c001110 con 0x7f81940c6ba0 2023-12-12T09:45:45.401 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:45.397+0000 7f81927fc640 1 -- 172.21.15.73:0/1754291527 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8180003520 con 0x7f81940c6ba0 2023-12-12T09:45:45.401 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:45.397+0000 7f81937fe640 1 --2- 172.21.15.73:0/1754291527 >> v2:172.21.15.142:3300/0 conn(0x7f81940c67c0 0x7f81940c7ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:45.401 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:45.397+0000 7f81927fc640 1 -- 172.21.15.73:0/1754291527 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2261460051 0 0) 0x7f8180003520 con 0x7f81940c6ba0 2023-12-12T09:45:45.401 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:45.397+0000 7f81927fc640 1 -- 172.21.15.73:0/1754291527 >> v2:172.21.15.142:3300/0 conn(0x7f81940c67c0 msgr2=0x7f81940c7ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:45:45.401 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:45.397+0000 7f81927fc640 1 --2- 172.21.15.73:0/1754291527 >> v2:172.21.15.142:3300/0 conn(0x7f81940c67c0 0x7f81940c7ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:45.401 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:45.397+0000 7f81927fc640 1 -- 172.21.15.73:0/1754291527 >> v1:172.21.15.142:6789/0 conn(0x7f81941550a0 legacy=0x7f819415efa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:45.401 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:45.397+0000 7f81927fc640 1 -- 172.21.15.73:0/1754291527 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81940c4dd0 con 0x7f81940c6ba0 2023-12-12T09:45:45.401 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:45.397+0000 7f81927fc640 1 -- 172.21.15.73:0/1754291527 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3186547832 0 0) 0x7f817c001800 con 0x7f81940c6ba0 2023-12-12T09:45:45.401 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:45.397+0000 7f81927fc640 1 -- 172.21.15.73:0/1754291527 >> v1:172.21.15.73:6789/0 conn(0x7f81940c6ba0 legacy=0x7f819406c180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:45.401 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:45.397+0000 7f81927fc640 1 --2- 172.21.15.73:0/1754291527 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8180003970 0x7f8180003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:45.401 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:45.397+0000 7f81927fc640 1 --2- 172.21.15.73:0/1754291527 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f81800047c0 0x7f8180004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:45.401 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:45.397+0000 7f81927fc640 1 --2- 172.21.15.73:0/1754291527 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8180005180 0x7f818000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:45.402 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:45.397+0000 7f81927fc640 1 -- 172.21.15.73:0/1754291527 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81940c4af0 con 0x7f8180003970 2023-12-12T09:45:45.402 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:45.397+0000 7f81927fc640 1 -- 172.21.15.73:0/1754291527 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f818000c0d0 con 0x7f81800047c0 2023-12-12T09:45:45.402 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:45.397+0000 7f81927fc640 1 -- 172.21.15.73:0/1754291527 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f818000c290 con 0x7f8180005180 2023-12-12T09:45:45.402 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:45.398+0000 7f81937fe640 1 --2- 172.21.15.73:0/1754291527 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8180003970 0x7f8180003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:45.402 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:45.398+0000 7f81937fe640 1 -- 172.21.15.73:0/1754291527 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8180005180 msgr2=0x7f818000b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:45:45.402 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:45.398+0000 7f81937fe640 1 --2- 172.21.15.73:0/1754291527 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8180005180 0x7f818000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:45.402 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:45.398+0000 7f81937fe640 1 -- 172.21.15.73:0/1754291527 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f81800047c0 msgr2=0x7f8180004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:45:45.402 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:45.398+0000 7f81937fe640 1 --2- 172.21.15.73:0/1754291527 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f81800047c0 0x7f8180004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:45.402 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:45.398+0000 7f81937fe640 1 -- 172.21.15.73:0/1754291527 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8180003520 con 0x7f8180003970 2023-12-12T09:45:45.402 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:45.398+0000 7f8193fff640 1 -- 172.21.15.73:0/1754291527 reap_dead start 2023-12-12T09:45:45.402 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:45.399+0000 7f81937fe640 1 --2- 172.21.15.73:0/1754291527 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8180003970 0x7f8180003d90 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f8184007360 tx=0x7f81800057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8e9e7a405289bdc server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:45:45.402 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:45.399+0000 7f81927fc640 1 -- 172.21.15.73:0/1754291527 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f818402ccb0 con 0x7f8180003970 2023-12-12T09:45:45.402 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:45.399+0000 7f81927fc640 1 -- 172.21.15.73:0/1754291527 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f818402ce10 con 0x7f8180003970 2023-12-12T09:45:45.403 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:45.399+0000 7f81927fc640 1 -- 172.21.15.73:0/1754291527 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8184034660 con 0x7f8180003970 2023-12-12T09:45:45.403 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:45.400+0000 7f8199e7c640 1 -- 172.21.15.73:0/1754291527 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8180003970 msgr2=0x7f8180003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:45.403 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:45.400+0000 7f8199e7c640 1 --2- 172.21.15.73:0/1754291527 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8180003970 0x7f8180003d90 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f8184007360 tx=0x7f81800057f0 comp rx=0 tx=0).stop 2023-12-12T09:45:45.403 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:45.400+0000 7f8199e7c640 1 -- 172.21.15.73:0/1754291527 shutdown_connections 2023-12-12T09:45:45.403 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:45.400+0000 7f8199e7c640 1 --2- 172.21.15.73:0/1754291527 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8180003970 0x7f8180003d90 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:45.403 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:45.400+0000 7f8199e7c640 1 -- 172.21.15.73:0/1754291527 >> 172.21.15.73:0/1754291527 conn(0x7f81940abb20 msgr2=0x7f81940abf30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:45:45.403 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:45.400+0000 7f8199e7c640 1 -- 172.21.15.73:0/1754291527 shutdown_connections 2023-12-12T09:45:45.403 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:45.400+0000 7f8199e7c640 1 -- 172.21.15.73:0/1754291527 wait complete. 2023-12-12T09:45:45.405 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:45.402+0000 7f8199e7c640 1 Processor -- start 2023-12-12T09:45:45.405 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:45.402+0000 7f8199e7c640 1 -- start start 2023-12-12T09:45:45.406 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:45.403+0000 7f8199e7c640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8180003970 0x7f81940acca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:45.406 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:45.403+0000 7f8199e7c640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8194148660 0x7f819414b900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:45.406 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:45.403+0000 7f8199e7c640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f81941480a0 0x7f819414be40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:45.406 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:45.403+0000 7f8199e7c640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f819414dd40 con 0x7f81941480a0 2023-12-12T09:45:45.406 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:45.403+0000 7f8199e7c640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81941eb030 con 0x7f8194148660 2023-12-12T09:45:45.406 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:45.403+0000 7f8199e7c640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f819414e000 con 0x7f8180003970 2023-12-12T09:45:45.406 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:45.403+0000 7f8193fff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f81941480a0 0x7f819414be40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:45.406 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:45.403+0000 7f8193fff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f81941480a0 0x7f819414be40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:42298/0 (socket says 172.21.15.73:42298) 2023-12-12T09:45:45.406 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:45.403+0000 7f8193fff640 1 -- 172.21.15.73:0/1277594422 learned_addr learned my addr 172.21.15.73:0/1277594422 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:45:45.406 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:45.403+0000 7f81937fe640 1 --2- 172.21.15.73:0/1277594422 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8180003970 0x7f81940acca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:45.406 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:45.403+0000 7f8193fff640 1 -- 172.21.15.73:0/1277594422 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8180003970 msgr2=0x7f81940acca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:45.406 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:45.403+0000 7f8193fff640 1 --2- 172.21.15.73:0/1277594422 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8180003970 0x7f81940acca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:45.406 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:45.403+0000 7f8192ffd640 1 --2- 172.21.15.73:0/1277594422 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8194148660 0x7f819414b900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:45.406 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:45.403+0000 7f8193fff640 1 -- 172.21.15.73:0/1277594422 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8194148660 msgr2=0x7f819414b900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:45.407 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:45.403+0000 7f8193fff640 1 --2- 172.21.15.73:0/1277594422 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8194148660 0x7f819414b900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:45.407 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:45.403+0000 7f8193fff640 1 -- 172.21.15.73:0/1277594422 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f819414e2e0 con 0x7f81941480a0 2023-12-12T09:45:45.407 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:45.404+0000 7f8193fff640 1 --2- 172.21.15.73:0/1277594422 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f81941480a0 0x7f819414be40 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f819408b340 tx=0x7f818c00c820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:45:45.407 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:45.404+0000 7f818bfff640 1 -- 172.21.15.73:0/1277594422 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f818c004220 con 0x7f81941480a0 2023-12-12T09:45:45.407 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:45.404+0000 7f818bfff640 1 -- 172.21.15.73:0/1277594422 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f818c0043a0 con 0x7f81941480a0 2023-12-12T09:45:45.407 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:45.404+0000 7f8199e7c640 1 -- 172.21.15.73:0/1277594422 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f819414b3e0 con 0x7f81941480a0 2023-12-12T09:45:45.407 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:45.404+0000 7f818bfff640 1 -- 172.21.15.73:0/1277594422 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f818c007310 con 0x7f81941480a0 2023-12-12T09:45:45.407 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:45.404+0000 7f8199e7c640 1 -- 172.21.15.73:0/1277594422 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81941eac50 con 0x7f81941480a0 2023-12-12T09:45:45.407 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:45.405+0000 7f8199e7c640 1 -- 172.21.15.73:0/1277594422 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f819406d140 con 0x7f81941480a0 2023-12-12T09:45:45.408 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:45.406+0000 7f818bfff640 1 -- 172.21.15.73:0/1277594422 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f818c0057c0 con 0x7f81941480a0 2023-12-12T09:45:45.408 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:45.407+0000 7f818bfff640 1 --2- 172.21.15.73:0/1277594422 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f817406ae40 0x7f817406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:45.408 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:45.407+0000 7f818bfff640 1 -- 172.21.15.73:0/1277594422 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f818c088ba0 con 0x7f81941480a0 2023-12-12T09:45:45.408 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:45.407+0000 7f81937fe640 1 --2- 172.21.15.73:0/1277594422 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f817406ae40 0x7f817406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:45.408 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:45.408+0000 7f81937fe640 1 --2- 172.21.15.73:0/1277594422 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f817406ae40 0x7f817406d300 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f8184036000 tx=0x7f8184030000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:45:45.411 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:45.411+0000 7f818bfff640 1 -- 172.21.15.73:0/1277594422 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f818c0538f0 con 0x7f81941480a0 2023-12-12T09:45:45.600 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:45.600+0000 7f8199e7c640 1 -- 172.21.15.73:0/1277594422 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f81940c8e30 con 0x7f81941480a0 2023-12-12T09:45:45.601 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:45.601+0000 7f818bfff640 1 -- 172.21.15.73:0/1277594422 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v58) v1 ==== 104+0+11 (secure 0 0 0) 0x7f818c00cea0 con 0x7f81941480a0 2023-12-12T09:45:45.601 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 32 2023-12-12T09:45:45.604 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:45.603+0000 7f8199e7c640 1 -- 172.21.15.73:0/1277594422 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f817406ae40 msgr2=0x7f817406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:45.604 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:45.603+0000 7f8199e7c640 1 --2- 172.21.15.73:0/1277594422 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f817406ae40 0x7f817406d300 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f8184036000 tx=0x7f8184030000 comp rx=0 tx=0).stop 2023-12-12T09:45:45.604 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:45.603+0000 7f8199e7c640 1 -- 172.21.15.73:0/1277594422 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f81941480a0 msgr2=0x7f819414be40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:45.604 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:45.603+0000 7f8199e7c640 1 --2- 172.21.15.73:0/1277594422 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f81941480a0 0x7f819414be40 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f819408b340 tx=0x7f818c00c820 comp rx=0 tx=0).stop 2023-12-12T09:45:45.604 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:45.603+0000 7f8199e7c640 1 -- 172.21.15.73:0/1277594422 shutdown_connections 2023-12-12T09:45:45.604 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:45.603+0000 7f8199e7c640 1 --2- 172.21.15.73:0/1277594422 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f817406ae40 0x7f817406d300 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:45.604 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:45.603+0000 7f8199e7c640 1 --2- 172.21.15.73:0/1277594422 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f81941480a0 0x7f819414be40 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:45.604 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:45.603+0000 7f8199e7c640 1 --2- 172.21.15.73:0/1277594422 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8194148660 0x7f819414b900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:45.605 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:45.603+0000 7f8199e7c640 1 --2- 172.21.15.73:0/1277594422 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8180003970 0x7f81940acca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:45.605 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:45.603+0000 7f8199e7c640 1 -- 172.21.15.73:0/1277594422 >> 172.21.15.73:0/1277594422 conn(0x7f81940abb20 msgr2=0x7f81940aa1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:45:45.605 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:45.604+0000 7f8199e7c640 1 -- 172.21.15.73:0/1277594422 shutdown_connections 2023-12-12T09:45:45.605 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:45.604+0000 7f8199e7c640 1 -- 172.21.15.73:0/1277594422 wait complete. 2023-12-12T09:45:45.622 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-12T09:45:45.837 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:45.837+0000 7f00792c2640 1 Processor -- start 2023-12-12T09:45:45.838 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:45.837+0000 7f00792c2640 1 -- start start 2023-12-12T09:45:45.839 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:45.838+0000 7f00792c2640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f007414ea60 0x7f00740c5420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:45.839 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:45.838+0000 7f00792c2640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f00740c0320 0x7f00740c20b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:45.839 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:45.838+0000 7f00792c2640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00740c3390 con 0x7f00740a4c90 2023-12-12T09:45:45.839 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:45.838+0000 7f00792c2640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00740c0750 con 0x7f00740c0320 2023-12-12T09:45:45.839 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:45.838+0000 7f00792c2640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00740c4b30 con 0x7f007414ea60 2023-12-12T09:45:45.839 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:45.839+0000 7f006a7fc640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f00740a4c90 0x7f00740c4420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:47292/0 (socket says 172.21.15.73:47292) 2023-12-12T09:45:45.839 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:45.839+0000 7f006a7fc640 1 -- 172.21.15.73:0/642339656 learned_addr learned my addr 172.21.15.73:0/642339656 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-12T09:45:45.840 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:45.839+0000 7f00737fe640 1 --2- 172.21.15.73:0/642339656 >> v2:172.21.15.73:3300/0 conn(0x7f00740c0320 0x7f00740c20b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:45.840 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:45.839+0000 7f00727fc640 1 -- 172.21.15.73:0/642339656 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1404069955 0 0) 0x7f00740c3390 con 0x7f00740a4c90 2023-12-12T09:45:45.840 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:45.839+0000 7f0072ffd640 1 --2- 172.21.15.73:0/642339656 >> v2:172.21.15.142:3300/0 conn(0x7f007414ea60 0x7f00740c5420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:45.840 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:45.839+0000 7f00727fc640 1 -- 172.21.15.73:0/642339656 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0060005730 con 0x7f00740a4c90 2023-12-12T09:45:45.840 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:45.839+0000 7f00737fe640 1 -- 172.21.15.73:0/642339656 >> v2:172.21.15.142:3300/0 conn(0x7f007414ea60 msgr2=0x7f00740c5420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:45:45.840 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:45.839+0000 7f00737fe640 1 --2- 172.21.15.73:0/642339656 >> v2:172.21.15.142:3300/0 conn(0x7f007414ea60 0x7f00740c5420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:45.841 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:45.839+0000 7f00737fe640 1 -- 172.21.15.73:0/642339656 >> v1:172.21.15.73:6789/0 conn(0x7f00740a4c90 legacy=0x7f00740c4420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:45.841 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:45.839+0000 7f00737fe640 1 -- 172.21.15.73:0/642339656 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0074151e60 con 0x7f00740c0320 2023-12-12T09:45:45.841 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:45.841+0000 7f00737fe640 1 --2- 172.21.15.73:0/642339656 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f00740c0320 0x7f00740c20b0 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f007406b490 tx=0x7f006c02b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2d291b4516fee3c server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:45:45.841 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:45.841+0000 7f00727fc640 1 -- 172.21.15.73:0/642339656 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f006c02e070 con 0x7f00740c0320 2023-12-12T09:45:45.841 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:45.841+0000 7f00727fc640 1 -- 172.21.15.73:0/642339656 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f006c0315a0 con 0x7f00740c0320 2023-12-12T09:45:45.841 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:45.841+0000 7f00727fc640 1 -- 172.21.15.73:0/642339656 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f006c031930 con 0x7f00740c0320 2023-12-12T09:45:45.842 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:45.841+0000 7f00792c2640 1 -- 172.21.15.73:0/642339656 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f00740c0320 msgr2=0x7f00740c20b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:45.842 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:45.841+0000 7f00792c2640 1 --2- 172.21.15.73:0/642339656 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f00740c0320 0x7f00740c20b0 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f007406b490 tx=0x7f006c02b840 comp rx=0 tx=0).stop 2023-12-12T09:45:45.843 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:45.842+0000 7f00792c2640 1 -- 172.21.15.73:0/642339656 shutdown_connections 2023-12-12T09:45:45.843 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:45.842+0000 7f00792c2640 1 --2- 172.21.15.73:0/642339656 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f00740c0320 0x7f00740c20b0 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:45.843 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:45.842+0000 7f00792c2640 1 --2- 172.21.15.73:0/642339656 >> v2:172.21.15.142:3300/0 conn(0x7f007414ea60 0x7f00740c5420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:45.843 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:45.842+0000 7f00792c2640 1 -- 172.21.15.73:0/642339656 >> 172.21.15.73:0/642339656 conn(0x7f007406a4e0 msgr2=0x7f007406a8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:45:45.843 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:45.842+0000 7f00792c2640 1 -- 172.21.15.73:0/642339656 shutdown_connections 2023-12-12T09:45:45.843 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:45.842+0000 7f00792c2640 1 -- 172.21.15.73:0/642339656 wait complete. 2023-12-12T09:45:45.844 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:45.843+0000 7f00792c2640 1 Processor -- start 2023-12-12T09:45:45.844 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:45.843+0000 7f00792c2640 1 -- start start 2023-12-12T09:45:45.845 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:45.844+0000 7f00792c2640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f00740a4c90 0x7f0074140710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:45.845 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:45.844+0000 7f00792c2640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f00740c0320 0x7f0074143030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:45.846 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:45.844+0000 7f00792c2640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f007414ea60 0x7f00741e5b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:45.846 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:45.844+0000 7f00792c2640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0074144060 con 0x7f007414ea60 2023-12-12T09:45:45.846 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:45.844+0000 7f00792c2640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0074148dd0 con 0x7f00740c0320 2023-12-12T09:45:45.846 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:45.844+0000 7f00792c2640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0074148af0 con 0x7f00740a4c90 2023-12-12T09:45:45.846 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:45.845+0000 7f00737fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f007414ea60 0x7f00741e5b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:45.846 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:45.845+0000 7f00737fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f007414ea60 0x7f00741e5b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:42324/0 (socket says 172.21.15.73:42324) 2023-12-12T09:45:45.846 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:45.845+0000 7f00737fe640 1 -- 172.21.15.73:0/3046996397 learned_addr learned my addr 172.21.15.73:0/3046996397 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:45:45.846 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:45.845+0000 7f0072ffd640 1 --2- 172.21.15.73:0/3046996397 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f00740a4c90 0x7f0074140710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:45.846 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:45.845+0000 7f00737fe640 1 -- 172.21.15.73:0/3046996397 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f00740a4c90 msgr2=0x7f0074140710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:45.846 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:45.845+0000 7f00737fe640 1 --2- 172.21.15.73:0/3046996397 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f00740a4c90 0x7f0074140710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:45.846 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:45.845+0000 7f00737fe640 1 -- 172.21.15.73:0/3046996397 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f00740c0320 msgr2=0x7f0074143030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:45.846 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:45.845+0000 7f00737fe640 1 --2- 172.21.15.73:0/3046996397 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f00740c0320 0x7f0074143030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:45.847 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:45.845+0000 7f00737fe640 1 -- 172.21.15.73:0/3046996397 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f006c009400 con 0x7f007414ea60 2023-12-12T09:45:45.847 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:45.845+0000 7f00737fe640 1 --2- 172.21.15.73:0/3046996397 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f007414ea60 0x7f00741e5b20 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f006c009890 tx=0x7f006c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:45:45.847 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:45.846+0000 7f006bfff640 1 -- 172.21.15.73:0/3046996397 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f006c032840 con 0x7f007414ea60 2023-12-12T09:45:45.847 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:45.846+0000 7f006bfff640 1 -- 172.21.15.73:0/3046996397 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f006c0329a0 con 0x7f007414ea60 2023-12-12T09:45:45.848 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:45.846+0000 7f006bfff640 1 -- 172.21.15.73:0/3046996397 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f006c032d30 con 0x7f007414ea60 2023-12-12T09:45:45.848 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:45.846+0000 7f00792c2640 1 -- 172.21.15.73:0/3046996397 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00741e91c0 con 0x7f007414ea60 2023-12-12T09:45:45.848 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:45.846+0000 7f00792c2640 1 -- 172.21.15.73:0/3046996397 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00741e9780 con 0x7f007414ea60 2023-12-12T09:45:45.848 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:45.847+0000 7f00792c2640 1 -- 172.21.15.73:0/3046996397 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0074067070 con 0x7f007414ea60 2023-12-12T09:45:45.848 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:45.848+0000 7f006bfff640 1 -- 172.21.15.73:0/3046996397 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f006c04e430 con 0x7f007414ea60 2023-12-12T09:45:45.849 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:45.849+0000 7f006bfff640 1 --2- 172.21.15.73:0/3046996397 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f005406ae40 0x7f005406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:45.849 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:45.849+0000 7f006bfff640 1 -- 172.21.15.73:0/3046996397 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f006c0ab890 con 0x7f007414ea60 2023-12-12T09:45:45.849 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:45.849+0000 7f0072ffd640 1 --2- 172.21.15.73:0/3046996397 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f005406ae40 0x7f005406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:45.849 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:45.849+0000 7f0072ffd640 1 --2- 172.21.15.73:0/3046996397 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f005406ae40 0x7f005406d300 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f0064009e90 tx=0x7f006400b040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:45:45.853 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:45.853+0000 7f006bfff640 1 -- 172.21.15.73:0/3046996397 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f006c0765d0 con 0x7f007414ea60 2023-12-12T09:45:46.029 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:46.029+0000 7f00792c2640 1 -- 172.21.15.73:0/3046996397 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f0074071f80 con 0x7f007414ea60 2023-12-12T09:45:46.030 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:46.030+0000 7f006bfff640 1 -- 172.21.15.73:0/3046996397 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v58) v1 ==== 100+0+11 (secure 0 0 0) 0x7f006c079bf0 con 0x7f007414ea60 2023-12-12T09:45:46.030 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 64 2023-12-12T09:45:46.033 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:46.032+0000 7f00792c2640 1 -- 172.21.15.73:0/3046996397 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f005406ae40 msgr2=0x7f005406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:46.033 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:46.032+0000 7f00792c2640 1 --2- 172.21.15.73:0/3046996397 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f005406ae40 0x7f005406d300 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f0064009e90 tx=0x7f006400b040 comp rx=0 tx=0).stop 2023-12-12T09:45:46.033 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:46.032+0000 7f00792c2640 1 -- 172.21.15.73:0/3046996397 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f007414ea60 msgr2=0x7f00741e5b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:46.033 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:46.032+0000 7f00792c2640 1 --2- 172.21.15.73:0/3046996397 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f007414ea60 0x7f00741e5b20 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f006c009890 tx=0x7f006c0046c0 comp rx=0 tx=0).stop 2023-12-12T09:45:46.033 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:46.033+0000 7f00792c2640 1 -- 172.21.15.73:0/3046996397 shutdown_connections 2023-12-12T09:45:46.033 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:46.033+0000 7f00792c2640 1 --2- 172.21.15.73:0/3046996397 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f005406ae40 0x7f005406d300 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:46.034 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:46.033+0000 7f00792c2640 1 --2- 172.21.15.73:0/3046996397 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f007414ea60 0x7f00741e5b20 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:46.034 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:46.033+0000 7f00792c2640 1 --2- 172.21.15.73:0/3046996397 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f00740c0320 0x7f0074143030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:46.034 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:46.033+0000 7f00792c2640 1 --2- 172.21.15.73:0/3046996397 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f00740a4c90 0x7f0074140710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:46.034 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:46.033+0000 7f00792c2640 1 -- 172.21.15.73:0/3046996397 >> 172.21.15.73:0/3046996397 conn(0x7f007406a4e0 msgr2=0x7f007406cc90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:45:46.034 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:46.033+0000 7f00792c2640 1 -- 172.21.15.73:0/3046996397 shutdown_connections 2023-12-12T09:45:46.034 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:46.033+0000 7f00792c2640 1 -- 172.21.15.73:0/3046996397 wait complete. 2023-12-12T09:45:46.050 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_metadata pg_num 2023-12-12T09:45:46.243 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:46.242+0000 7ff0e7ab4640 1 Processor -- start 2023-12-12T09:45:46.243 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:46.242+0000 7ff0e7ab4640 1 -- start start 2023-12-12T09:45:46.244 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:46.244+0000 7ff0e7ab4640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff0e014ea60 0x7ff0e00c5420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:46.244 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:46.244+0000 7ff0e7ab4640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0e00c3390 con 0x7ff0e00c0320 2023-12-12T09:45:46.244 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:46.244+0000 7ff0e7ab4640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0e00c4b30 con 0x7ff0e00a4c90 2023-12-12T09:45:46.245 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:46.244+0000 7ff0e7ab4640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0e0151e60 con 0x7ff0e014ea60 2023-12-12T09:45:46.245 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:46.244+0000 7ff0e6051640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7ff0e00c0320 0x7ff0e00c20b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:47296/0 (socket says 172.21.15.73:47296) 2023-12-12T09:45:46.245 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:46.244+0000 7ff0e6051640 1 -- 172.21.15.73:0/2717758709 learned_addr learned my addr 172.21.15.73:0/2717758709 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-12T09:45:46.247 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:46.245+0000 7ff0e5850640 1 --2- 172.21.15.73:0/2717758709 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff0e014ea60 0x7ff0e00c5420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:46.247 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:46.245+0000 7ff0e484e640 1 -- 172.21.15.73:0/2717758709 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3171551046 0 0) 0x7ff0e00c3390 con 0x7ff0e00c0320 2023-12-12T09:45:46.247 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:46.245+0000 7ff0e484e640 1 -- 172.21.15.73:0/2717758709 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff0cc003520 con 0x7ff0e00c0320 2023-12-12T09:45:46.247 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:46.245+0000 7ff0e484e640 1 -- 172.21.15.73:0/2717758709 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3767223382 0 0) 0x7ff0cc003520 con 0x7ff0e00c0320 2023-12-12T09:45:46.247 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:46.245+0000 7ff0e484e640 1 -- 172.21.15.73:0/2717758709 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff0e014ea60 msgr2=0x7ff0e00c5420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:45:46.247 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:46.245+0000 7ff0e484e640 1 --2- 172.21.15.73:0/2717758709 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff0e014ea60 0x7ff0e00c5420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:46.247 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:46.245+0000 7ff0e484e640 1 -- 172.21.15.73:0/2717758709 >> v1:172.21.15.142:6789/0 conn(0x7ff0e00a4c90 legacy=0x7ff0e00c4420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:46.247 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:46.245+0000 7ff0e484e640 1 -- 172.21.15.73:0/2717758709 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0e0152140 con 0x7ff0e00c0320 2023-12-12T09:45:46.248 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:46.245+0000 7ff0e484e640 1 -- 172.21.15.73:0/2717758709 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3186547832 0 0) 0x7ff0d80019f0 con 0x7ff0e00c0320 2023-12-12T09:45:46.248 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:46.245+0000 7ff0e484e640 1 -- 172.21.15.73:0/2717758709 >> v1:172.21.15.73:6789/0 conn(0x7ff0e00c0320 legacy=0x7ff0e00c20b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:46.248 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:46.245+0000 7ff0e484e640 1 --2- 172.21.15.73:0/2717758709 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff0e014ea60 0x7ff0cc0039a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:46.248 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:46.245+0000 7ff0e484e640 1 --2- 172.21.15.73:0/2717758709 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff0cc003f70 0x7ff0cc0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:46.248 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:46.245+0000 7ff0e484e640 1 --2- 172.21.15.73:0/2717758709 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff0cc004d00 0x7ff0cc005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:46.248 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:46.245+0000 7ff0e484e640 1 -- 172.21.15.73:0/2717758709 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0e0151e60 con 0x7ff0cc004d00 2023-12-12T09:45:46.248 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:46.245+0000 7ff0e484e640 1 -- 172.21.15.73:0/2717758709 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0cc00bb70 con 0x7ff0cc003f70 2023-12-12T09:45:46.248 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:46.245+0000 7ff0e484e640 1 -- 172.21.15.73:0/2717758709 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0cc00bd30 con 0x7ff0e014ea60 2023-12-12T09:45:46.248 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:46.246+0000 7ff0e6051640 1 --2- 172.21.15.73:0/2717758709 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff0cc004d00 0x7ff0cc005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:46.248 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:46.246+0000 7ff0e5850640 1 --2- 172.21.15.73:0/2717758709 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff0e014ea60 0x7ff0cc0039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:46.248 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:46.246+0000 7ff0e504f640 1 --2- 172.21.15.73:0/2717758709 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff0cc003f70 0x7ff0cc0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:46.248 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:46.246+0000 7ff0e6051640 1 -- 172.21.15.73:0/2717758709 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff0e014ea60 msgr2=0x7ff0cc0039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:45:46.248 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:46.246+0000 7ff0e6051640 1 --2- 172.21.15.73:0/2717758709 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff0e014ea60 0x7ff0cc0039a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:46.248 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:46.246+0000 7ff0e6051640 1 -- 172.21.15.73:0/2717758709 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff0cc003f70 msgr2=0x7ff0cc0047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:45:46.249 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:46.246+0000 7ff0e6051640 1 --2- 172.21.15.73:0/2717758709 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff0cc003f70 0x7ff0cc0047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:46.249 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:46.246+0000 7ff0e6051640 1 -- 172.21.15.73:0/2717758709 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0cc003520 con 0x7ff0cc004d00 2023-12-12T09:45:46.249 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:46.246+0000 7ff0e5850640 1 --2- 172.21.15.73:0/2717758709 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff0e014ea60 0x7ff0cc0039a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:45:46.249 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:46.246+0000 7ff0e504f640 1 --2- 172.21.15.73:0/2717758709 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff0cc003f70 0x7ff0cc0047c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:45:46.250 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:46.247+0000 7ff0e6051640 1 --2- 172.21.15.73:0/2717758709 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff0cc004d00 0x7ff0cc005180 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7ff0d800a370 tx=0x7ff0cc0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1be0233240cd6258 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:45:46.250 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:46.247+0000 7ff0e484e640 1 -- 172.21.15.73:0/2717758709 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0d8036630 con 0x7ff0cc004d00 2023-12-12T09:45:46.250 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:46.247+0000 7ff0e484e640 1 -- 172.21.15.73:0/2717758709 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0d8031070 con 0x7ff0cc004d00 2023-12-12T09:45:46.250 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:46.247+0000 7ff0e484e640 1 -- 172.21.15.73:0/2717758709 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0d8036a50 con 0x7ff0cc004d00 2023-12-12T09:45:46.250 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:46.248+0000 7ff0e7ab4640 1 -- 172.21.15.73:0/2717758709 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff0cc004d00 msgr2=0x7ff0cc005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:46.250 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:46.248+0000 7ff0e7ab4640 1 --2- 172.21.15.73:0/2717758709 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff0cc004d00 0x7ff0cc005180 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7ff0d800a370 tx=0x7ff0cc0057f0 comp rx=0 tx=0).stop 2023-12-12T09:45:46.250 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:46.248+0000 7ff0e6051640 1 -- 172.21.15.73:0/2717758709 reap_dead start 2023-12-12T09:45:46.250 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:46.248+0000 7ff0e7ab4640 1 -- 172.21.15.73:0/2717758709 shutdown_connections 2023-12-12T09:45:46.250 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:46.248+0000 7ff0e7ab4640 1 -- 172.21.15.73:0/2717758709 >> 172.21.15.73:0/2717758709 conn(0x7ff0e006a4e0 msgr2=0x7ff0e006a8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:45:46.250 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:46.248+0000 7ff0e7ab4640 1 -- 172.21.15.73:0/2717758709 shutdown_connections 2023-12-12T09:45:46.251 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:46.248+0000 7ff0e7ab4640 1 -- 172.21.15.73:0/2717758709 wait complete. 2023-12-12T09:45:46.251 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:46.250+0000 7ff0e7ab4640 1 Processor -- start 2023-12-12T09:45:46.251 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:46.250+0000 7ff0e7ab4640 1 -- start start 2023-12-12T09:45:46.253 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:46.251+0000 7ff0e7ab4640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff0cc004d00 0x7ff0e0155190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:46.253 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:46.251+0000 7ff0e7ab4640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff0e00a89d0 0x7ff0e014b010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:46.253 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:46.251+0000 7ff0e7ab4640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff0e014b550 0x7ff0e01e95f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:46.253 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:46.251+0000 7ff0e7ab4640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0e01556d0 con 0x7ff0cc004d00 2023-12-12T09:45:46.253 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:46.251+0000 7ff0e7ab4640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0e0151390 con 0x7ff0e00a89d0 2023-12-12T09:45:46.253 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:46.251+0000 7ff0e7ab4640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0e0150af0 con 0x7ff0e014b550 2023-12-12T09:45:46.253 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:46.252+0000 7ff0e5850640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff0cc004d00 0x7ff0e0155190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:46.253 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:46.252+0000 7ff0e5850640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff0cc004d00 0x7ff0e0155190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:42350/0 (socket says 172.21.15.73:42350) 2023-12-12T09:45:46.254 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:46.252+0000 7ff0e5850640 1 -- 172.21.15.73:0/4165863297 learned_addr learned my addr 172.21.15.73:0/4165863297 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:45:46.254 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:46.252+0000 7ff0e6051640 1 --2- 172.21.15.73:0/4165863297 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff0e014b550 0x7ff0e01e95f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:46.254 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:46.252+0000 7ff0e504f640 1 --2- 172.21.15.73:0/4165863297 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff0e00a89d0 0x7ff0e014b010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:46.254 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:46.252+0000 7ff0e5850640 1 -- 172.21.15.73:0/4165863297 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff0e014b550 msgr2=0x7ff0e01e95f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:46.254 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:46.252+0000 7ff0e5850640 1 --2- 172.21.15.73:0/4165863297 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff0e014b550 0x7ff0e01e95f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:46.254 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:46.252+0000 7ff0e5850640 1 -- 172.21.15.73:0/4165863297 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff0e00a89d0 msgr2=0x7ff0e014b010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:46.254 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:46.252+0000 7ff0e5850640 1 --2- 172.21.15.73:0/4165863297 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff0e00a89d0 0x7ff0e014b010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:46.254 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:46.252+0000 7ff0e5850640 1 -- 172.21.15.73:0/4165863297 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0e0150dd0 con 0x7ff0cc004d00 2023-12-12T09:45:46.254 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:46.252+0000 7ff0e5850640 1 --2- 172.21.15.73:0/4165863297 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff0cc004d00 0x7ff0e0155190 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7ff0dc0108b0 tx=0x7ff0dc010d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:45:46.254 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:46.253+0000 7ff0d67fc640 1 -- 172.21.15.73:0/4165863297 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0dc00eb60 con 0x7ff0cc004d00 2023-12-12T09:45:46.254 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:46.253+0000 7ff0d67fc640 1 -- 172.21.15.73:0/4165863297 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0dc00ecc0 con 0x7ff0cc004d00 2023-12-12T09:45:46.254 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:46.253+0000 7ff0d67fc640 1 -- 172.21.15.73:0/4165863297 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0dc01c400 con 0x7ff0cc004d00 2023-12-12T09:45:46.254 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:46.253+0000 7ff0e7ab4640 1 -- 172.21.15.73:0/4165863297 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0e01510b0 con 0x7ff0cc004d00 2023-12-12T09:45:46.254 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:46.253+0000 7ff0e7ab4640 1 -- 172.21.15.73:0/4165863297 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0e01e9b30 con 0x7ff0cc004d00 2023-12-12T09:45:46.255 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:46.254+0000 7ff0e7ab4640 1 -- 172.21.15.73:0/4165863297 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff0e0067070 con 0x7ff0cc004d00 2023-12-12T09:45:46.255 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:46.255+0000 7ff0d67fc640 1 -- 172.21.15.73:0/4165863297 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7ff0dc01c560 con 0x7ff0cc004d00 2023-12-12T09:45:46.256 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:46.256+0000 7ff0d67fc640 1 --2- 172.21.15.73:0/4165863297 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7ff0c406ae70 0x7ff0c406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:46.256 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:46.256+0000 7ff0d67fc640 1 -- 172.21.15.73:0/4165863297 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 6565+0+0 (secure 0 0 0) 0x7ff0dc089fe0 con 0x7ff0cc004d00 2023-12-12T09:45:46.256 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:46.256+0000 7ff0e504f640 1 --2- 172.21.15.73:0/4165863297 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7ff0c406ae70 0x7ff0c406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:46.257 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:46.257+0000 7ff0e504f640 1 --2- 172.21.15.73:0/4165863297 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7ff0c406ae70 0x7ff0c406d330 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7ff0e00a8db0 tx=0x7ff0d0009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:45:46.260 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:46.260+0000 7ff0d67fc640 1 -- 172.21.15.73:0/4165863297 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7ff0dc054d40 con 0x7ff0cc004d00 2023-12-12T09:45:46.457 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:46.456+0000 7ff0e7ab4640 1 -- 172.21.15.73:0/4165863297 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"} v 0) v1 -- 0x7ff0e0067580 con 0x7ff0cc004d00 2023-12-12T09:45:46.458 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:46.457+0000 7ff0d67fc640 1 -- 172.21.15.73:0/4165863297 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"}]=0 v58) v1 ==== 105+0+11 (secure 0 0 0) 0x7ff0dc058360 con 0x7ff0cc004d00 2023-12-12T09:45:46.458 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 32 2023-12-12T09:45:46.461 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:46.460+0000 7ff0e7ab4640 1 -- 172.21.15.73:0/4165863297 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7ff0c406ae70 msgr2=0x7ff0c406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:46.461 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:46.460+0000 7ff0e7ab4640 1 --2- 172.21.15.73:0/4165863297 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7ff0c406ae70 0x7ff0c406d330 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7ff0e00a8db0 tx=0x7ff0d0009040 comp rx=0 tx=0).stop 2023-12-12T09:45:46.461 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:46.460+0000 7ff0e7ab4640 1 -- 172.21.15.73:0/4165863297 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff0cc004d00 msgr2=0x7ff0e0155190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:46.461 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:46.460+0000 7ff0e7ab4640 1 --2- 172.21.15.73:0/4165863297 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff0cc004d00 0x7ff0e0155190 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7ff0dc0108b0 tx=0x7ff0dc010d70 comp rx=0 tx=0).stop 2023-12-12T09:45:46.461 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:46.460+0000 7ff0e7ab4640 1 -- 172.21.15.73:0/4165863297 shutdown_connections 2023-12-12T09:45:46.461 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:46.460+0000 7ff0e7ab4640 1 --2- 172.21.15.73:0/4165863297 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7ff0c406ae70 0x7ff0c406d330 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:46.461 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:46.460+0000 7ff0e7ab4640 1 --2- 172.21.15.73:0/4165863297 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff0e014b550 0x7ff0e01e95f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:46.461 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:46.460+0000 7ff0e7ab4640 1 --2- 172.21.15.73:0/4165863297 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff0e00a89d0 0x7ff0e014b010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:46.461 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:46.460+0000 7ff0e7ab4640 1 --2- 172.21.15.73:0/4165863297 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff0cc004d00 0x7ff0e0155190 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:46.461 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:46.460+0000 7ff0e7ab4640 1 -- 172.21.15.73:0/4165863297 >> 172.21.15.73:0/4165863297 conn(0x7ff0e006a4e0 msgr2=0x7ff0e006d500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:45:46.461 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:46.460+0000 7ff0e7ab4640 1 -- 172.21.15.73:0/4165863297 shutdown_connections 2023-12-12T09:45:46.461 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:46.460+0000 7ff0e7ab4640 1 -- 172.21.15.73:0/4165863297 wait complete. 2023-12-12T09:45:46.478 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_data pg_num 2023-12-12T09:45:46.693 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:46.693+0000 7f67c8444640 1 Processor -- start 2023-12-12T09:45:46.694 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:46.693+0000 7f67c8444640 1 -- start start 2023-12-12T09:45:46.695 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:46.695+0000 7f67c8444640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f67c00c3930 0x7f67c006d440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:46.695 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:46.695+0000 7f67c8444640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67c01582e0 con 0x7f67c00bed50 2023-12-12T09:45:46.695 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:46.695+0000 7f67c8444640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67c00a4f50 con 0x7f67c0151c30 2023-12-12T09:45:46.695 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:46.695+0000 7f67c8444640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67c00a54d0 con 0x7f67c00c3930 2023-12-12T09:45:46.695 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:46.695+0000 7f67c69e1640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f67c00bed50 0x7f67c00bf1c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:47308/0 (socket says 172.21.15.73:47308) 2023-12-12T09:45:46.695 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:46.695+0000 7f67c69e1640 1 -- 172.21.15.73:0/350090484 learned_addr learned my addr 172.21.15.73:0/350090484 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-12T09:45:46.697 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:46.695+0000 7f67c59df640 1 --2- 172.21.15.73:0/350090484 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f67c00c3930 0x7f67c006d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:46.697 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:46.695+0000 7f67c51de640 1 -- 172.21.15.73:0/350090484 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1401754089 0 0) 0x7f67c01582e0 con 0x7f67c00bed50 2023-12-12T09:45:46.697 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:46.695+0000 7f67c51de640 1 -- 172.21.15.73:0/350090484 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f67ac003520 con 0x7f67c00bed50 2023-12-12T09:45:46.698 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:46.696+0000 7f67c51de640 1 -- 172.21.15.73:0/350090484 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1339419176 0 0) 0x7f67ac003520 con 0x7f67c00bed50 2023-12-12T09:45:46.698 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:46.696+0000 7f67c51de640 1 -- 172.21.15.73:0/350090484 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f67c00c3930 msgr2=0x7f67c006d440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:45:46.698 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:46.696+0000 7f67c51de640 1 --2- 172.21.15.73:0/350090484 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f67c00c3930 0x7f67c006d440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:46.698 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:46.696+0000 7f67c51de640 1 -- 172.21.15.73:0/350090484 >> v1:172.21.15.142:6789/0 conn(0x7f67c0151c30 legacy=0x7f67c0157bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:46.698 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:46.696+0000 7f67c51de640 1 -- 172.21.15.73:0/350090484 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67c0155260 con 0x7f67c00bed50 2023-12-12T09:45:46.698 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:46.696+0000 7f67c51de640 1 -- 172.21.15.73:0/350090484 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3186547832 0 0) 0x7f67b80019f0 con 0x7f67c00bed50 2023-12-12T09:45:46.698 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:46.696+0000 7f67c51de640 1 -- 172.21.15.73:0/350090484 >> v1:172.21.15.73:6789/0 conn(0x7f67c00bed50 legacy=0x7f67c00bf1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:46.698 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:46.696+0000 7f67c51de640 1 --2- 172.21.15.73:0/350090484 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f67ac0039a0 0x7f67ac003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:46.698 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:46.696+0000 7f67c51de640 1 --2- 172.21.15.73:0/350090484 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f67c00c3930 0x7f67ac0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:46.698 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:46.696+0000 7f67c51de640 1 --2- 172.21.15.73:0/350090484 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f67ac004d00 0x7f67ac005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:46.699 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:46.696+0000 7f67c51de640 1 -- 172.21.15.73:0/350090484 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67c00a54d0 con 0x7f67ac0039a0 2023-12-12T09:45:46.699 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:46.696+0000 7f67c51de640 1 -- 172.21.15.73:0/350090484 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67ac00bb60 con 0x7f67ac004d00 2023-12-12T09:45:46.699 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:46.696+0000 7f67c51de640 1 -- 172.21.15.73:0/350090484 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67ac00bd20 con 0x7f67c00c3930 2023-12-12T09:45:46.699 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:46.696+0000 7f67c61e0640 1 --2- 172.21.15.73:0/350090484 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f67ac0039a0 0x7f67ac003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:46.699 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:46.697+0000 7f67c59df640 1 --2- 172.21.15.73:0/350090484 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f67c00c3930 0x7f67ac0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:46.699 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:46.697+0000 7f67c61e0640 1 -- 172.21.15.73:0/350090484 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f67c00c3930 msgr2=0x7f67ac0047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:45:46.699 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:46.697+0000 7f67c61e0640 1 --2- 172.21.15.73:0/350090484 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f67c00c3930 0x7f67ac0047c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:46.699 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:46.697+0000 7f67c61e0640 1 -- 172.21.15.73:0/350090484 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f67ac004d00 msgr2=0x7f67ac005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:45:46.699 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:46.697+0000 7f67c61e0640 1 --2- 172.21.15.73:0/350090484 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f67ac004d00 0x7f67ac005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:46.699 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:46.697+0000 7f67c61e0640 1 -- 172.21.15.73:0/350090484 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67ac003520 con 0x7f67ac0039a0 2023-12-12T09:45:46.701 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:46.698+0000 7f67c61e0640 1 --2- 172.21.15.73:0/350090484 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f67ac0039a0 0x7f67ac003dc0 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f67bc001750 tx=0x7f67ac0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7c4c6ac508f83a6 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:45:46.701 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:46.698+0000 7f67c51de640 1 -- 172.21.15.73:0/350090484 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67bc0052d0 con 0x7f67ac0039a0 2023-12-12T09:45:46.701 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:46.698+0000 7f67c51de640 1 -- 172.21.15.73:0/350090484 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67bc02e050 con 0x7f67ac0039a0 2023-12-12T09:45:46.701 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:46.698+0000 7f67c51de640 1 -- 172.21.15.73:0/350090484 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67bc0035f0 con 0x7f67ac0039a0 2023-12-12T09:45:46.701 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:46.698+0000 7f67c8444640 1 -- 172.21.15.73:0/350090484 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f67ac0039a0 msgr2=0x7f67ac003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:46.701 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:46.698+0000 7f67c8444640 1 --2- 172.21.15.73:0/350090484 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f67ac0039a0 0x7f67ac003dc0 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f67bc001750 tx=0x7f67ac0057f0 comp rx=0 tx=0).stop 2023-12-12T09:45:46.701 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:46.698+0000 7f67c69e1640 1 -- 172.21.15.73:0/350090484 reap_dead start 2023-12-12T09:45:46.701 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:46.699+0000 7f67c8444640 1 -- 172.21.15.73:0/350090484 shutdown_connections 2023-12-12T09:45:46.701 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:46.699+0000 7f67c8444640 1 -- 172.21.15.73:0/350090484 >> 172.21.15.73:0/350090484 conn(0x7f67c006a4e0 msgr2=0x7f67c006a8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:45:46.701 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:46.699+0000 7f67c8444640 1 -- 172.21.15.73:0/350090484 shutdown_connections 2023-12-12T09:45:46.701 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:46.699+0000 7f67c8444640 1 -- 172.21.15.73:0/350090484 wait complete. 2023-12-12T09:45:46.702 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:46.700+0000 7f67c8444640 1 Processor -- start 2023-12-12T09:45:46.702 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:46.700+0000 7f67c8444640 1 -- start start 2023-12-12T09:45:46.703 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:46.701+0000 7f67c8444640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f67ac0039a0 0x7f67c014a250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:46.704 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:46.701+0000 7f67c8444640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f67c0155c40 0x7f67c01538f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:46.704 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:46.701+0000 7f67c8444640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f67c0153e30 0x7f67c01ed8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:46.704 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:46.701+0000 7f67c8444640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67c014b1f0 con 0x7f67c0155c40 2023-12-12T09:45:46.704 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:46.701+0000 7f67c8444640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67c014a790 con 0x7f67c0153e30 2023-12-12T09:45:46.704 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:46.701+0000 7f67c8444640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67c01eaf20 con 0x7f67ac0039a0 2023-12-12T09:45:46.704 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:46.702+0000 7f67c59df640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f67c0155c40 0x7f67c01538f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:46.704 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:46.702+0000 7f67c59df640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f67c0155c40 0x7f67c01538f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:42360/0 (socket says 172.21.15.73:42360) 2023-12-12T09:45:46.704 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:46.702+0000 7f67c59df640 1 -- 172.21.15.73:0/2586922813 learned_addr learned my addr 172.21.15.73:0/2586922813 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:45:46.704 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:46.702+0000 7f67c59df640 1 -- 172.21.15.73:0/2586922813 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f67ac0039a0 msgr2=0x7f67c014a250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:46.704 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:46.702+0000 7f67c59df640 1 --2- 172.21.15.73:0/2586922813 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f67ac0039a0 0x7f67c014a250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:46.704 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:46.702+0000 7f67c59df640 1 -- 172.21.15.73:0/2586922813 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f67c0153e30 msgr2=0x7f67c01ed8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:46.704 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:46.702+0000 7f67c59df640 1 --2- 172.21.15.73:0/2586922813 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f67c0153e30 0x7f67c01ed8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:46.704 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:46.702+0000 7f67c59df640 1 -- 172.21.15.73:0/2586922813 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67c014ac30 con 0x7f67c0155c40 2023-12-12T09:45:46.704 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:46.702+0000 7f67c59df640 1 --2- 172.21.15.73:0/2586922813 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f67c0155c40 0x7f67c01538f0 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f67b000e7e0 tx=0x7f67b000eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:45:46.705 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:46.703+0000 7f67b6ffd640 1 -- 172.21.15.73:0/2586922813 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67b000c6d0 con 0x7f67c0155c40 2023-12-12T09:45:46.705 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:46.703+0000 7f67b6ffd640 1 -- 172.21.15.73:0/2586922813 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67b000c830 con 0x7f67c0155c40 2023-12-12T09:45:46.705 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:46.703+0000 7f67c8444640 1 -- 172.21.15.73:0/2586922813 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f67c014af10 con 0x7f67c0155c40 2023-12-12T09:45:46.705 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:46.703+0000 7f67b6ffd640 1 -- 172.21.15.73:0/2586922813 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67b000cbe0 con 0x7f67c0155c40 2023-12-12T09:45:46.705 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:46.703+0000 7f67c8444640 1 -- 172.21.15.73:0/2586922813 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67c01542b0 con 0x7f67c0155c40 2023-12-12T09:45:46.705 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:46.704+0000 7f67c8444640 1 -- 172.21.15.73:0/2586922813 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f67c0067070 con 0x7f67c0155c40 2023-12-12T09:45:46.705 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:46.705+0000 7f67b6ffd640 1 -- 172.21.15.73:0/2586922813 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f67b000cd40 con 0x7f67c0155c40 2023-12-12T09:45:46.706 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:46.706+0000 7f67b6ffd640 1 --2- 172.21.15.73:0/2586922813 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f67a406ae40 0x7f67a406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:46.707 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:46.706+0000 7f67b6ffd640 1 -- 172.21.15.73:0/2586922813 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f67b0089670 con 0x7f67c0155c40 2023-12-12T09:45:46.707 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:46.706+0000 7f67c61e0640 1 --2- 172.21.15.73:0/2586922813 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f67a406ae40 0x7f67a406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:46.707 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:46.707+0000 7f67c61e0640 1 --2- 172.21.15.73:0/2586922813 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f67a406ae40 0x7f67a406d300 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f67bc033000 tx=0x7f67bc02f000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:45:46.710 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:46.710+0000 7f67b6ffd640 1 -- 172.21.15.73:0/2586922813 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f67b0054430 con 0x7f67c0155c40 2023-12-12T09:45:46.900 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:46.898+0000 7f67c8444640 1 -- 172.21.15.73:0/2586922813 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"} v 0) v1 -- 0x7f67c0067580 con 0x7f67c0155c40 2023-12-12T09:45:46.900 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:46.899+0000 7f67b6ffd640 1 -- 172.21.15.73:0/2586922813 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"}]=0 v58) v1 ==== 101+0+11 (secure 0 0 0) 0x7f67b0009380 con 0x7f67c0155c40 2023-12-12T09:45:46.901 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 64 2023-12-12T09:45:46.904 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:46.902+0000 7f67c8444640 1 -- 172.21.15.73:0/2586922813 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f67a406ae40 msgr2=0x7f67a406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:46.904 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:46.902+0000 7f67c8444640 1 --2- 172.21.15.73:0/2586922813 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f67a406ae40 0x7f67a406d300 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f67bc033000 tx=0x7f67bc02f000 comp rx=0 tx=0).stop 2023-12-12T09:45:46.904 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:46.902+0000 7f67c8444640 1 -- 172.21.15.73:0/2586922813 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f67c0155c40 msgr2=0x7f67c01538f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:46.904 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:46.902+0000 7f67c8444640 1 --2- 172.21.15.73:0/2586922813 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f67c0155c40 0x7f67c01538f0 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f67b000e7e0 tx=0x7f67b000eca0 comp rx=0 tx=0).stop 2023-12-12T09:45:46.904 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:46.902+0000 7f67c8444640 1 -- 172.21.15.73:0/2586922813 shutdown_connections 2023-12-12T09:45:46.904 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:46.902+0000 7f67c8444640 1 --2- 172.21.15.73:0/2586922813 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f67a406ae40 0x7f67a406d300 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:46.905 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:46.902+0000 7f67c8444640 1 --2- 172.21.15.73:0/2586922813 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f67c0153e30 0x7f67c01ed8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:46.905 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:46.902+0000 7f67c8444640 1 --2- 172.21.15.73:0/2586922813 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f67c0155c40 0x7f67c01538f0 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:46.905 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:46.902+0000 7f67c8444640 1 --2- 172.21.15.73:0/2586922813 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f67ac0039a0 0x7f67c014a250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:46.905 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:46.902+0000 7f67c8444640 1 -- 172.21.15.73:0/2586922813 >> 172.21.15.73:0/2586922813 conn(0x7f67c006a4e0 msgr2=0x7f67c006d440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:45:46.905 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:46.902+0000 7f67c8444640 1 -- 172.21.15.73:0/2586922813 shutdown_connections 2023-12-12T09:45:46.905 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:46.903+0000 7f67c8444640 1 -- 172.21.15.73:0/2586922813 wait complete. 2023-12-12T09:45:46.923 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-12T09:45:47.129 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:47.127+0000 7fc2fdfce640 1 Processor -- start 2023-12-12T09:45:47.129 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:47.128+0000 7fc2fdfce640 1 -- start start 2023-12-12T09:45:47.130 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:47.129+0000 7fc2fdfce640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fc2f806fca0 0x7fc2f8072700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:47.131 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:47.129+0000 7fc2fdfce640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc2f80c0420 0x7fc2f8070080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:47.131 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:47.129+0000 7fc2fdfce640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fc2f80c10d0 0x7fc2f80c1580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:47.131 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:47.129+0000 7fc2fdfce640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2f8152ec0 con 0x7fc2f806fca0 2023-12-12T09:45:47.131 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:47.129+0000 7fc2fdfce640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2f80c53d0 con 0x7fc2f80c10d0 2023-12-12T09:45:47.131 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:47.129+0000 7fc2fdfce640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2f8070b70 con 0x7fc2f80c0420 2023-12-12T09:45:47.131 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:47.129+0000 7fc2f77fe640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fc2f806fca0 0x7fc2f8072700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:47.131 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:47.129+0000 7fc2f77fe640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fc2f806fca0 0x7fc2f8072700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:42368/0 (socket says 172.21.15.73:42368) 2023-12-12T09:45:47.131 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:47.129+0000 7fc2f77fe640 1 -- 172.21.15.73:0/3056714130 learned_addr learned my addr 172.21.15.73:0/3056714130 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:45:47.132 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:47.130+0000 7fc2effff640 1 --2- 172.21.15.73:0/3056714130 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc2f80c0420 0x7fc2f8070080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:47.132 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:47.130+0000 7fc2f77fe640 1 -- 172.21.15.73:0/3056714130 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc2f80c0420 msgr2=0x7fc2f8070080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:45:47.132 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:47.130+0000 7fc2f77fe640 1 --2- 172.21.15.73:0/3056714130 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc2f80c0420 0x7fc2f8070080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:47.132 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:47.130+0000 7fc2f77fe640 1 -- 172.21.15.73:0/3056714130 >> v2:172.21.15.142:3300/0 conn(0x7fc2f80c10d0 msgr2=0x7fc2f80c1580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:45:47.132 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:47.130+0000 7fc2f7fff640 1 --2- 172.21.15.73:0/3056714130 >> v2:172.21.15.142:3300/0 conn(0x7fc2f80c10d0 0x7fc2f80c1580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:47.132 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:47.130+0000 7fc2f77fe640 1 --2- 172.21.15.73:0/3056714130 >> v2:172.21.15.142:3300/0 conn(0x7fc2f80c10d0 0x7fc2f80c1580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:47.132 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:47.130+0000 7fc2f77fe640 1 -- 172.21.15.73:0/3056714130 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2f8152560 con 0x7fc2f806fca0 2023-12-12T09:45:47.133 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:47.131+0000 7fc2f77fe640 1 --2- 172.21.15.73:0/3056714130 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc2f806fca0 0x7fc2f8072700 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7fc2f806e460 tx=0x7fc2e802b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7132930b9a0c425 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:45:47.133 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:47.131+0000 7fc2f6ffd640 1 -- 172.21.15.73:0/3056714130 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2e80317c0 con 0x7fc2f806fca0 2023-12-12T09:45:47.133 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:47.131+0000 7fc2f6ffd640 1 -- 172.21.15.73:0/3056714130 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2e8031920 con 0x7fc2f806fca0 2023-12-12T09:45:47.133 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:47.131+0000 7fc2f6ffd640 1 -- 172.21.15.73:0/3056714130 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2e8031cb0 con 0x7fc2f806fca0 2023-12-12T09:45:47.134 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:47.132+0000 7fc2fdfce640 1 -- 172.21.15.73:0/3056714130 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc2f806fca0 msgr2=0x7fc2f8072700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:47.134 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:47.132+0000 7fc2fdfce640 1 --2- 172.21.15.73:0/3056714130 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc2f806fca0 0x7fc2f8072700 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7fc2f806e460 tx=0x7fc2e802b860 comp rx=0 tx=0).stop 2023-12-12T09:45:47.134 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:47.132+0000 7fc2fdfce640 1 -- 172.21.15.73:0/3056714130 shutdown_connections 2023-12-12T09:45:47.134 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:47.132+0000 7fc2fdfce640 1 --2- 172.21.15.73:0/3056714130 >> v2:172.21.15.142:3300/0 conn(0x7fc2f80c10d0 0x7fc2f80c1580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:47.134 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:47.132+0000 7fc2fdfce640 1 --2- 172.21.15.73:0/3056714130 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc2f80c0420 0x7fc2f8070080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:47.135 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:47.132+0000 7fc2fdfce640 1 --2- 172.21.15.73:0/3056714130 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc2f806fca0 0x7fc2f8072700 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:47.135 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:47.132+0000 7fc2fdfce640 1 -- 172.21.15.73:0/3056714130 >> 172.21.15.73:0/3056714130 conn(0x7fc2f80a77d0 msgr2=0x7fc2f80a7bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:45:47.135 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:47.132+0000 7fc2fdfce640 1 -- 172.21.15.73:0/3056714130 shutdown_connections 2023-12-12T09:45:47.135 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:47.132+0000 7fc2fdfce640 1 -- 172.21.15.73:0/3056714130 wait complete. 2023-12-12T09:45:47.135 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:47.134+0000 7fc2fdfce640 1 Processor -- start 2023-12-12T09:45:47.136 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:47.135+0000 7fc2fdfce640 1 -- start start 2023-12-12T09:45:47.139 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:47.136+0000 7fc2fdfce640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc2f806fca0 0x7fc2f814be80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:47.139 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:47.136+0000 7fc2fdfce640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc2f80c0420 0x7fc2f8149fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:47.139 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:47.136+0000 7fc2fdfce640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc2f80c10d0 0x7fc2f814a510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:47.139 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:47.136+0000 7fc2fdfce640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2f814aa50 con 0x7fc2f80c0420 2023-12-12T09:45:47.140 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:47.136+0000 7fc2fdfce640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2f8154790 con 0x7fc2f80c10d0 2023-12-12T09:45:47.140 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:47.136+0000 7fc2fdfce640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2f81ea9a0 con 0x7fc2f806fca0 2023-12-12T09:45:47.140 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:47.136+0000 7fc2effff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc2f80c0420 0x7fc2f8149fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:47.140 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:47.136+0000 7fc2effff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc2f80c0420 0x7fc2f8149fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:42374/0 (socket says 172.21.15.73:42374) 2023-12-12T09:45:47.140 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:47.136+0000 7fc2effff640 1 -- 172.21.15.73:0/4272411884 learned_addr learned my addr 172.21.15.73:0/4272411884 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:45:47.140 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:47.136+0000 7fc2f77fe640 1 --2- 172.21.15.73:0/4272411884 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc2f806fca0 0x7fc2f814be80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:47.140 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:47.136+0000 7fc2f7fff640 1 --2- 172.21.15.73:0/4272411884 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc2f80c10d0 0x7fc2f814a510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:47.140 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:47.137+0000 7fc2effff640 1 -- 172.21.15.73:0/4272411884 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc2f806fca0 msgr2=0x7fc2f814be80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:47.140 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:47.137+0000 7fc2effff640 1 --2- 172.21.15.73:0/4272411884 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc2f806fca0 0x7fc2f814be80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:47.140 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:47.137+0000 7fc2effff640 1 -- 172.21.15.73:0/4272411884 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc2f80c10d0 msgr2=0x7fc2f814a510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:47.140 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:47.137+0000 7fc2effff640 1 --2- 172.21.15.73:0/4272411884 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc2f80c10d0 0x7fc2f814a510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:47.140 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:47.137+0000 7fc2effff640 1 -- 172.21.15.73:0/4272411884 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2e80094d0 con 0x7fc2f80c0420 2023-12-12T09:45:47.140 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:47.137+0000 7fc2f7fff640 1 --2- 172.21.15.73:0/4272411884 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc2f80c10d0 0x7fc2f814a510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:45:47.141 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:47.137+0000 7fc2effff640 1 --2- 172.21.15.73:0/4272411884 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc2f80c0420 0x7fc2f8149fd0 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7fc2e000c570 tx=0x7fc2e000ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:45:47.141 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:47.137+0000 7fc2f4ff9640 1 -- 172.21.15.73:0/4272411884 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2e0004220 con 0x7fc2f80c0420 2023-12-12T09:45:47.141 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:47.137+0000 7fc2f4ff9640 1 -- 172.21.15.73:0/4272411884 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2e0004380 con 0x7fc2f80c0420 2023-12-12T09:45:47.141 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:47.137+0000 7fc2f4ff9640 1 -- 172.21.15.73:0/4272411884 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2e0003850 con 0x7fc2f80c0420 2023-12-12T09:45:47.141 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:47.137+0000 7fc2fdfce640 1 -- 172.21.15.73:0/4272411884 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2f81eac80 con 0x7fc2f80c0420 2023-12-12T09:45:47.141 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:47.137+0000 7fc2fdfce640 1 -- 172.21.15.73:0/4272411884 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2f8154cc0 con 0x7fc2f80c0420 2023-12-12T09:45:47.142 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:47.139+0000 7fc2fdfce640 1 -- 172.21.15.73:0/4272411884 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc2f81eae10 con 0x7fc2f80c0420 2023-12-12T09:45:47.142 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:47.139+0000 7fc2f4ff9640 1 -- 172.21.15.73:0/4272411884 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fc2e00039b0 con 0x7fc2f80c0420 2023-12-12T09:45:47.142 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:47.140+0000 7fc2f4ff9640 1 --2- 172.21.15.73:0/4272411884 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fc2d806ae70 0x7fc2d806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:47.142 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:47.140+0000 7fc2f4ff9640 1 -- 172.21.15.73:0/4272411884 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fc2e00895d0 con 0x7fc2f80c0420 2023-12-12T09:45:47.142 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:47.141+0000 7fc2f77fe640 1 --2- 172.21.15.73:0/4272411884 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fc2d806ae70 0x7fc2d806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:47.143 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:47.141+0000 7fc2f77fe640 1 --2- 172.21.15.73:0/4272411884 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fc2d806ae70 0x7fc2d806d330 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fc2e8036000 tx=0x7fc2e803d040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:45:47.146 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:47.145+0000 7fc2f4ff9640 1 -- 172.21.15.73:0/4272411884 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fc2e0054310 con 0x7fc2f80c0420 2023-12-12T09:45:47.350 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:47.349+0000 7fc2fdfce640 1 -- 172.21.15.73:0/4272411884 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fc2f814fce0 con 0x7fc2f80c0420 2023-12-12T09:45:47.351 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:47.350+0000 7fc2f4ff9640 1 -- 172.21.15.73:0/4272411884 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v58) v1 ==== 80+0+0 (secure 0 0 0) 0x7fc2e005ce60 con 0x7fc2f80c0420 2023-12-12T09:45:47.351 INFO:teuthology.orchestra.run.smithi073.stderr:listed 0 entries 2023-12-12T09:45:47.354 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:47.352+0000 7fc2fdfce640 1 -- 172.21.15.73:0/4272411884 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fc2d806ae70 msgr2=0x7fc2d806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:47.354 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:47.352+0000 7fc2fdfce640 1 --2- 172.21.15.73:0/4272411884 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fc2d806ae70 0x7fc2d806d330 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fc2e8036000 tx=0x7fc2e803d040 comp rx=0 tx=0).stop 2023-12-12T09:45:47.354 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:47.352+0000 7fc2fdfce640 1 -- 172.21.15.73:0/4272411884 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc2f80c0420 msgr2=0x7fc2f8149fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:47.354 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:47.352+0000 7fc2fdfce640 1 --2- 172.21.15.73:0/4272411884 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc2f80c0420 0x7fc2f8149fd0 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7fc2e000c570 tx=0x7fc2e000ca30 comp rx=0 tx=0).stop 2023-12-12T09:45:47.355 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:47.353+0000 7fc2fdfce640 1 -- 172.21.15.73:0/4272411884 shutdown_connections 2023-12-12T09:45:47.355 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:47.353+0000 7fc2fdfce640 1 --2- 172.21.15.73:0/4272411884 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fc2d806ae70 0x7fc2d806d330 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:47.355 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:47.353+0000 7fc2fdfce640 1 --2- 172.21.15.73:0/4272411884 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc2f80c10d0 0x7fc2f814a510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:47.355 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:47.353+0000 7fc2fdfce640 1 --2- 172.21.15.73:0/4272411884 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc2f80c0420 0x7fc2f8149fd0 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:47.355 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:47.353+0000 7fc2fdfce640 1 --2- 172.21.15.73:0/4272411884 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc2f806fca0 0x7fc2f814be80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:47.355 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:47.353+0000 7fc2fdfce640 1 -- 172.21.15.73:0/4272411884 >> 172.21.15.73:0/4272411884 conn(0x7fc2f80a77d0 msgr2=0x7fc2f8151b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:45:47.355 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:47.353+0000 7fc2fdfce640 1 -- 172.21.15.73:0/4272411884 shutdown_connections 2023-12-12T09:45:47.355 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:47.353+0000 7fc2fdfce640 1 -- 172.21.15.73:0/4272411884 wait complete. 2023-12-12T09:45:47.373 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-12-12T09:45:47.373 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T09:45:47.373 DEBUG:teuthology.orchestra.run.smithi142:> sudo umount /home/ubuntu/cephtest/mnt.1 2023-12-12T09:45:47.490 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi142.front.sepia.ceph.com 2023-12-12T09:45:47.490 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T09:45:47.490 DEBUG:teuthology.orchestra.run.smithi142:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-12-12T09:45:47.537 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2023-12-12T09:45:47.537 DEBUG:teuthology.orchestra.run.smithi142:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-12T09:45:47.636 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054289,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498808k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249400k,nr_inodes=812350,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498808k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 2023-12-12T09:45:47.636 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-12-12T09:45:47.848 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:47.847+0000 7f151fa68640 1 Processor -- start 2023-12-12T09:45:47.849 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:47.847+0000 7f151fa68640 1 -- start start 2023-12-12T09:45:47.851 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:47.848+0000 7f151fa68640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f15181552e0 0x7f15180c49c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:47.851 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:47.848+0000 7f151fa68640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f151806bf20 0x7f15180a9760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:47.851 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:47.849+0000 7f151fa68640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15180c0b50 con 0x7f15180a50f0 2023-12-12T09:45:47.851 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:47.849+0000 7f151fa68640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15180c04d0 con 0x7f151806bf20 2023-12-12T09:45:47.851 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:47.849+0000 7f151fa68640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f151806c880 con 0x7f15181552e0 2023-12-12T09:45:47.851 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:47.849+0000 7f151d003640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f15180a50f0 0x7f15180a9050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:47312/0 (socket says 172.21.15.73:47312) 2023-12-12T09:45:47.851 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:47.849+0000 7f151d003640 1 -- 172.21.15.73:0/437545526 learned_addr learned my addr 172.21.15.73:0/437545526 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-12T09:45:47.851 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:47.849+0000 7f151d804640 1 --2- 172.21.15.73:0/437545526 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f15181552e0 0x7f15180c49c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:47.851 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:47.849+0000 7f151e005640 1 --2- 172.21.15.73:0/437545526 >> v2:172.21.15.142:3300/0 conn(0x7f151806bf20 0x7f15180a9760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:47.851 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:47.849+0000 7f151c802640 1 -- 172.21.15.73:0/437545526 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 98177347 0 0) 0x7f15180c0b50 con 0x7f15180a50f0 2023-12-12T09:45:47.851 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:47.850+0000 7f151c802640 1 -- 172.21.15.73:0/437545526 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1504005730 con 0x7f15180a50f0 2023-12-12T09:45:47.853 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:47.850+0000 7f151c802640 1 -- 172.21.15.73:0/437545526 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 159687406 0 0) 0x7f1504005730 con 0x7f15180a50f0 2023-12-12T09:45:47.853 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:47.850+0000 7f151c802640 1 -- 172.21.15.73:0/437545526 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f15181552e0 msgr2=0x7f15180c49c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:45:47.853 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:47.850+0000 7f151c802640 1 --2- 172.21.15.73:0/437545526 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f15181552e0 0x7f15180c49c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:47.853 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:47.850+0000 7f151c802640 1 -- 172.21.15.73:0/437545526 >> v2:172.21.15.142:3300/0 conn(0x7f151806bf20 msgr2=0x7f15180a9760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:45:47.853 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:47.850+0000 7f151c802640 1 --2- 172.21.15.73:0/437545526 >> v2:172.21.15.142:3300/0 conn(0x7f151806bf20 0x7f15180a9760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:47.853 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:47.850+0000 7f151c802640 1 -- 172.21.15.73:0/437545526 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f151806cb60 con 0x7f15180a50f0 2023-12-12T09:45:47.853 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:47.850+0000 7f151c802640 1 -- 172.21.15.73:0/437545526 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3186547832 0 0) 0x7f1508001670 con 0x7f15180a50f0 2023-12-12T09:45:47.853 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:47.850+0000 7f151c802640 1 -- 172.21.15.73:0/437545526 >> v1:172.21.15.73:6789/0 conn(0x7f15180a50f0 legacy=0x7f15180a9050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:47.853 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:47.850+0000 7f151c802640 1 --2- 172.21.15.73:0/437545526 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1504005b80 0x7f1504005fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:47.853 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:47.850+0000 7f151c802640 1 --2- 172.21.15.73:0/437545526 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f15040069d0 0x7f1504006e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:47.853 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:47.850+0000 7f151c802640 1 --2- 172.21.15.73:0/437545526 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f15181552e0 0x7f1504007390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:47.854 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:47.850+0000 7f151c802640 1 -- 172.21.15.73:0/437545526 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15180c04d0 con 0x7f1504005b80 2023-12-12T09:45:47.854 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:47.850+0000 7f151c802640 1 -- 172.21.15.73:0/437545526 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f151806c880 con 0x7f15040069d0 2023-12-12T09:45:47.854 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:47.850+0000 7f151c802640 1 -- 172.21.15.73:0/437545526 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f150400db90 con 0x7f15181552e0 2023-12-12T09:45:47.854 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:47.850+0000 7f151d804640 1 --2- 172.21.15.73:0/437545526 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1504005b80 0x7f1504005fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:47.854 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:47.851+0000 7f151d804640 1 -- 172.21.15.73:0/437545526 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f15181552e0 msgr2=0x7f1504007390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:45:47.854 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:47.851+0000 7f151d804640 1 --2- 172.21.15.73:0/437545526 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f15181552e0 0x7f1504007390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:47.854 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:47.851+0000 7f151d804640 1 -- 172.21.15.73:0/437545526 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f15040069d0 msgr2=0x7f1504006e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:45:47.854 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:47.851+0000 7f151d804640 1 --2- 172.21.15.73:0/437545526 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f15040069d0 0x7f1504006e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:47.854 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:47.851+0000 7f151d804640 1 -- 172.21.15.73:0/437545526 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1504005730 con 0x7f1504005b80 2023-12-12T09:45:47.855 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:47.852+0000 7f151d804640 1 --2- 172.21.15.73:0/437545526 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1504005b80 0x7f1504005fa0 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f1514009af0 tx=0x7f1504007a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d32c9e1adfdc367 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:45:47.855 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:47.852+0000 7f151c802640 1 -- 172.21.15.73:0/437545526 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f151402c710 con 0x7f1504005b80 2023-12-12T09:45:47.855 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:47.852+0000 7f151c802640 1 -- 172.21.15.73:0/437545526 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f151402c870 con 0x7f1504005b80 2023-12-12T09:45:47.855 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:47.852+0000 7f151c802640 1 -- 172.21.15.73:0/437545526 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f151402cc00 con 0x7f1504005b80 2023-12-12T09:45:47.855 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:47.853+0000 7f151fa68640 1 -- 172.21.15.73:0/437545526 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1504005b80 msgr2=0x7f1504005fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:47.856 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:47.853+0000 7f151fa68640 1 --2- 172.21.15.73:0/437545526 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1504005b80 0x7f1504005fa0 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f1514009af0 tx=0x7f1504007a00 comp rx=0 tx=0).stop 2023-12-12T09:45:47.856 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:47.853+0000 7f151e005640 1 -- 172.21.15.73:0/437545526 reap_dead start 2023-12-12T09:45:47.856 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:47.853+0000 7f151fa68640 1 -- 172.21.15.73:0/437545526 shutdown_connections 2023-12-12T09:45:47.856 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:47.853+0000 7f151fa68640 1 -- 172.21.15.73:0/437545526 >> 172.21.15.73:0/437545526 conn(0x7f15180a8130 msgr2=0x7f15180c24b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:45:47.856 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:47.853+0000 7f151fa68640 1 -- 172.21.15.73:0/437545526 shutdown_connections 2023-12-12T09:45:47.856 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:47.853+0000 7f151fa68640 1 -- 172.21.15.73:0/437545526 wait complete. 2023-12-12T09:45:47.856 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:47.855+0000 7f151fa68640 1 Processor -- start 2023-12-12T09:45:47.856 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:47.855+0000 7f151fa68640 1 -- start start 2023-12-12T09:45:47.863 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:47.856+0000 7f151fa68640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1504005b80 0x7f1518151780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:47.863 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:47.856+0000 7f151fa68640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1518070e40 0x7f151814f8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:47.863 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:47.856+0000 7f151fa68640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f151814fde0 0x7f15180a9a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:47.864 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:47.856+0000 7f151fa68640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1518071840 con 0x7f151814fde0 2023-12-12T09:45:47.864 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:47.856+0000 7f151fa68640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1518071d70 con 0x7f1504005b80 2023-12-12T09:45:47.864 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:47.856+0000 7f151fa68640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1518151360 con 0x7f1518070e40 2023-12-12T09:45:47.864 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:47.856+0000 7f151e005640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f151814fde0 0x7f15180a9a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:47.864 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:47.856+0000 7f151e005640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f151814fde0 0x7f15180a9a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:42394/0 (socket says 172.21.15.73:42394) 2023-12-12T09:45:47.864 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:47.856+0000 7f151e005640 1 -- 172.21.15.73:0/2990628609 learned_addr learned my addr 172.21.15.73:0/2990628609 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:45:47.864 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:47.857+0000 7f151d003640 1 --2- 172.21.15.73:0/2990628609 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1518070e40 0x7f151814f8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:47.864 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:47.857+0000 7f151d804640 1 --2- 172.21.15.73:0/2990628609 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1504005b80 0x7f1518151780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:47.864 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:47.857+0000 7f151e005640 1 -- 172.21.15.73:0/2990628609 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1518070e40 msgr2=0x7f151814f8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:47.864 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:47.857+0000 7f151e005640 1 --2- 172.21.15.73:0/2990628609 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1518070e40 0x7f151814f8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:47.864 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:47.857+0000 7f151e005640 1 -- 172.21.15.73:0/2990628609 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1504005b80 msgr2=0x7f1518151780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:47.864 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:47.857+0000 7f151e005640 1 --2- 172.21.15.73:0/2990628609 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1504005b80 0x7f1518151780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:47.864 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:47.857+0000 7f151e005640 1 -- 172.21.15.73:0/2990628609 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15181eb7d0 con 0x7f151814fde0 2023-12-12T09:45:47.865 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:47.857+0000 7f151e005640 1 --2- 172.21.15.73:0/2990628609 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f151814fde0 0x7f15180a9a70 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f15180c5980 tx=0x7f151000b480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:45:47.865 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:47.857+0000 7f150e7fc640 1 -- 172.21.15.73:0/2990628609 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1510010040 con 0x7f151814fde0 2023-12-12T09:45:47.865 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:47.857+0000 7f150e7fc640 1 -- 172.21.15.73:0/2990628609 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f151000bae0 con 0x7f151814fde0 2023-12-12T09:45:47.865 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:47.858+0000 7f151fa68640 1 -- 172.21.15.73:0/2990628609 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1518071a90 con 0x7f151814fde0 2023-12-12T09:45:47.865 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:47.858+0000 7f150e7fc640 1 -- 172.21.15.73:0/2990628609 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f151000be70 con 0x7f151814fde0 2023-12-12T09:45:47.865 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:47.858+0000 7f151fa68640 1 -- 172.21.15.73:0/2990628609 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1518150260 con 0x7f151814fde0 2023-12-12T09:45:47.865 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:47.859+0000 7f151fa68640 1 -- 172.21.15.73:0/2990628609 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15180a9790 con 0x7f151814fde0 2023-12-12T09:45:47.865 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:47.860+0000 7f150e7fc640 1 -- 172.21.15.73:0/2990628609 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f151001d400 con 0x7f151814fde0 2023-12-12T09:45:47.865 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:47.861+0000 7f150e7fc640 1 --2- 172.21.15.73:0/2990628609 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f14fc06ae40 0x7f14fc06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:47.866 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:47.861+0000 7f150e7fc640 1 -- 172.21.15.73:0/2990628609 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f1510089fb0 con 0x7f151814fde0 2023-12-12T09:45:47.866 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:47.861+0000 7f151d804640 1 --2- 172.21.15.73:0/2990628609 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f14fc06ae40 0x7f14fc06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:47.866 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:47.862+0000 7f151d804640 1 --2- 172.21.15.73:0/2990628609 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f14fc06ae40 0x7f14fc06d300 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f1514036000 tx=0x7f1514030000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:45:47.867 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:47.866+0000 7f150e7fc640 1 -- 172.21.15.73:0/2990628609 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f15180a9790 con 0x7f151814fde0 2023-12-12T09:45:48.111 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:48.110+0000 7f151fa68640 1 -- 172.21.15.73:0/2990628609 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f15180a9790 con 0x7f151814fde0 2023-12-12T09:45:48.112 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:48.111+0000 7f150e7fc640 1 -- 172.21.15.73:0/2990628609 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v35) v1 ==== 53+0+149 (secure 0 0 0) 0x7f15180a9790 con 0x7f151814fde0 2023-12-12T09:45:48.112 INFO:teuthology.orchestra.run.smithi073.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-12-12T09:45:48.112 INFO:teuthology.orchestra.run.smithi073.stdout:name: cephfs2, metadata pool: cephfs2_metadata, data pools: [cephfs2_data ] 2023-12-12T09:45:48.114 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:48.113+0000 7f151fa68640 1 -- 172.21.15.73:0/2990628609 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f14fc06ae40 msgr2=0x7f14fc06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:48.114 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:48.113+0000 7f151fa68640 1 --2- 172.21.15.73:0/2990628609 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f14fc06ae40 0x7f14fc06d300 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f1514036000 tx=0x7f1514030000 comp rx=0 tx=0).stop 2023-12-12T09:45:48.114 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:48.113+0000 7f151fa68640 1 -- 172.21.15.73:0/2990628609 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f151814fde0 msgr2=0x7f15180a9a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:48.114 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:48.113+0000 7f151fa68640 1 --2- 172.21.15.73:0/2990628609 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f151814fde0 0x7f15180a9a70 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f15180c5980 tx=0x7f151000b480 comp rx=0 tx=0).stop 2023-12-12T09:45:48.115 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:48.113+0000 7f151fa68640 1 -- 172.21.15.73:0/2990628609 shutdown_connections 2023-12-12T09:45:48.115 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:48.113+0000 7f151fa68640 1 --2- 172.21.15.73:0/2990628609 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f14fc06ae40 0x7f14fc06d300 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:48.115 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:48.113+0000 7f151fa68640 1 --2- 172.21.15.73:0/2990628609 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f151814fde0 0x7f15180a9a70 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:48.115 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:48.113+0000 7f151fa68640 1 --2- 172.21.15.73:0/2990628609 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1518070e40 0x7f151814f8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:48.115 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:48.113+0000 7f151fa68640 1 --2- 172.21.15.73:0/2990628609 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1504005b80 0x7f1518151780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:48.115 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:48.113+0000 7f151fa68640 1 -- 172.21.15.73:0/2990628609 >> 172.21.15.73:0/2990628609 conn(0x7f15180a8130 msgr2=0x7f15180a6af0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:45:48.115 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:48.113+0000 7f151fa68640 1 -- 172.21.15.73:0/2990628609 shutdown_connections 2023-12-12T09:45:48.116 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:48.114+0000 7f151fa68640 1 -- 172.21.15.73:0/2990628609 wait complete. 2023-12-12T09:45:48.132 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs2; just confirmed its presence on cluster 2023-12-12T09:45:48.132 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-12T09:45:48.132 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi142.front.sepia.ceph.com 2023-12-12T09:45:48.132 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-12-12T09:45:48.133 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-12-12T09:45:48.133 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs2 2023-12-12T09:45:48.133 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-12-12T09:45:48.133 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-12-12T09:45:48.133 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-12-12T09:45:48.133 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T09:45:48.133 DEBUG:teuthology.orchestra.run.smithi142:> ip addr 2023-12-12T09:45:48.193 INFO:teuthology.orchestra.run.smithi142.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-12T09:45:48.193 INFO:teuthology.orchestra.run.smithi142.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-12T09:45:48.193 INFO:teuthology.orchestra.run.smithi142.stdout: inet 127.0.0.1/8 scope host lo 2023-12-12T09:45:48.193 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2023-12-12T09:45:48.193 INFO:teuthology.orchestra.run.smithi142.stdout: inet6 ::1/128 scope host 2023-12-12T09:45:48.193 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2023-12-12T09:45:48.193 INFO:teuthology.orchestra.run.smithi142.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-12T09:45:48.193 INFO:teuthology.orchestra.run.smithi142.stdout: link/ether 0c:c4:7a:d9:36:3c brd ff:ff:ff:ff:ff:ff 2023-12-12T09:45:48.194 INFO:teuthology.orchestra.run.smithi142.stdout: altname enp7s0f0 2023-12-12T09:45:48.194 INFO:teuthology.orchestra.run.smithi142.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-12T09:45:48.194 INFO:teuthology.orchestra.run.smithi142.stdout: link/ether 0c:c4:7a:d9:36:3d brd ff:ff:ff:ff:ff:ff 2023-12-12T09:45:48.194 INFO:teuthology.orchestra.run.smithi142.stdout: altname enp7s0f1 2023-12-12T09:45:48.194 INFO:teuthology.orchestra.run.smithi142.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-12T09:45:48.194 INFO:teuthology.orchestra.run.smithi142.stdout: link/ether 0c:c4:7a:88:6e:0c brd ff:ff:ff:ff:ff:ff 2023-12-12T09:45:48.194 INFO:teuthology.orchestra.run.smithi142.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-12T09:45:48.194 INFO:teuthology.orchestra.run.smithi142.stdout: link/ether 0c:c4:7a:88:6e:0d brd ff:ff:ff:ff:ff:ff 2023-12-12T09:45:48.194 INFO:teuthology.orchestra.run.smithi142.stdout: inet 172.21.15.142/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-12-12T09:45:48.194 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft 42254sec preferred_lft 42254sec 2023-12-12T09:45:48.194 INFO:teuthology.orchestra.run.smithi142.stdout: inet6 fe80::ec4:7aff:fe88:6e0d/64 scope link 2023-12-12T09:45:48.194 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2023-12-12T09:45:48.194 INFO:teuthology.orchestra.run.smithi142.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-12-12T09:45:48.194 INFO:teuthology.orchestra.run.smithi142.stdout: link/ether de:1c:dd:95:c8:e6 brd ff:ff:ff:ff:ff:ff 2023-12-12T09:45:48.194 INFO:teuthology.orchestra.run.smithi142.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-12-12T09:45:48.195 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2023-12-12T09:45:48.195 INFO:teuthology.orchestra.run.smithi142.stdout: inet6 fe80::f8b8:b6ff:fe33:420d/64 scope link 2023-12-12T09:45:48.195 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2023-12-12T09:45:48.195 INFO:teuthology.orchestra.run.smithi142.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-12T09:45:48.195 INFO:teuthology.orchestra.run.smithi142.stdout: link/ether de:1c:dd:95:c8:e6 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-12-12T09:45:48.195 INFO:teuthology.orchestra.run.smithi142.stdout: inet6 fe80::dc1c:ddff:fe95:c8e6/64 scope link 2023-12-12T09:45:48.195 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2023-12-12T09:45:48.196 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T09:45:48.196 DEBUG:teuthology.orchestra.run.smithi142:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-12T09:45:48.283 INFO:teuthology.orchestra.run.smithi142.stdout:1 2023-12-12T09:45:48.287 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T09:45:48.287 DEBUG:teuthology.orchestra.run.smithi142:> route 2023-12-12T09:45:48.336 INFO:teuthology.orchestra.run.smithi142.stdout:Kernel IP routing table 2023-12-12T09:45:48.336 INFO:teuthology.orchestra.run.smithi142.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-12T09:45:48.336 INFO:teuthology.orchestra.run.smithi142.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-12-12T09:45:48.336 INFO:teuthology.orchestra.run.smithi142.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-12-12T09:45:48.336 INFO:teuthology.orchestra.run.smithi142.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-12T09:45:48.337 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T09:45:48.337 DEBUG:teuthology.orchestra.run.smithi142:> (cd / && exec bash -c ' 2023-12-12T09:45:48.337 DEBUG:teuthology.orchestra.run.smithi142:> set -e 2023-12-12T09:45:48.337 DEBUG:teuthology.orchestra.run.smithi142:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-12-12T09:45:48.338 DEBUG:teuthology.orchestra.run.smithi142:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-12-12T09:45:48.338 DEBUG:teuthology.orchestra.run.smithi142:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-12-12T09:45:48.338 DEBUG:teuthology.orchestra.run.smithi142:> ') 2023-12-12T09:45:48.513 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T09:45:48.514 DEBUG:teuthology.orchestra.run.smithi142:> ip netns list 2023-12-12T09:45:48.564 INFO:teuthology.orchestra.run.smithi142.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-12-12T09:45:48.565 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-12-12T09:45:48.565 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T09:45:48.566 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip link set brx.0 up 2023-12-12T09:45:48.656 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-12T09:45:48.656 DEBUG:teuthology.orchestra.run.smithi142:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-12-12T09:45:48.711 INFO:teuthology.orchestra.run.smithi142.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-12-12T09:45:48.711 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-12T09:45:48.711 DEBUG:teuthology.orchestra.run.smithi142:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-12-12T09:45:48.764 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs2=/ 2023-12-12T09:45:48.764 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T09:45:48.764 DEBUG:teuthology.orchestra.run.smithi142:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs2=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-12T09:45:48.769 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T09:45:48.778 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T09:45:48.895 INFO:teuthology.orchestra.run.smithi142.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-12T09:45:48.895 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-12T09:45:48.927 INFO:teuthology.orchestra.run.smithi142.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-12T09:45:48.928 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-12T09:45:48.928 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: resolved to: "172.21.15.73:3300,172.21.15.142:3300,172.21.15.142:3301" 2023-12-12T09:45:48.928 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: trying mount with new device syntax: 1@ba240992-02b8-4c7e-92f2-27eb29ac433b.cephfs2=/ 2023-12-12T09:45:48.928 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.73:3300/172.21.15.142:3300/172.21.15.142:3301" will pass to kernel 2023-12-12T09:45:48.929 INFO:teuthology.orchestra.run.smithi142.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2023-12-12T09:45:48.930 INFO:teuthology.orchestra.run.smithi142.stdout: You just mounted a file system that supports labels which does not 2023-12-12T09:45:48.930 INFO:teuthology.orchestra.run.smithi142.stdout: contain labels, onto an SELinux box. It is likely that confined 2023-12-12T09:45:48.930 INFO:teuthology.orchestra.run.smithi142.stdout: applications will generate AVC messages and not be allowed access to 2023-12-12T09:45:48.930 INFO:teuthology.orchestra.run.smithi142.stdout: this file system. For more details see restorecon(8) and mount(8). 2023-12-12T09:45:48.933 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-12-12T09:45:48.933 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T09:45:48.933 DEBUG:teuthology.orchestra.run.smithi142:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-12-12T09:45:49.020 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T09:45:49.021 DEBUG:teuthology.orchestra.run.smithi142:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-12T09:45:49.087 INFO:teuthology.orchestra.run.smithi142.stdout:client6033 2023-12-12T09:45:49.087 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2023-12-12T09:45:49.087 DEBUG:teuthology.orchestra.run.smithi142:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-12T09:45:49.137 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth add client.testuser mon 'allow rw fsname=cephfs, allow rw fsname=cephfs2' osd 'allow rw tag cephfs data=cephfs, allow rw tag cephfs data=cephfs2' mds 'allow rw fsname=cephfs' 2023-12-12T09:45:49.370 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:49.369+0000 7f405ae9b640 1 Processor -- start 2023-12-12T09:45:49.370 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:49.369+0000 7f405ae9b640 1 -- start start 2023-12-12T09:45:49.372 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:49.370+0000 7f405ae9b640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f40540c3930 0x7f405406d440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:49.372 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:49.370+0000 7f405ae9b640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f40540bed50 0x7f40540bf160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:49.372 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:49.370+0000 7f405ae9b640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40541582e0 con 0x7f4054151c30 2023-12-12T09:45:49.372 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:49.370+0000 7f405ae9b640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40540a54d0 con 0x7f40540bed50 2023-12-12T09:45:49.372 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:49.370+0000 7f405ae9b640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40540a4f50 con 0x7f40540c3930 2023-12-12T09:45:49.372 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:49.371+0000 7f4059438640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f40540bed50 0x7f40540bf160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:49.372 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:49.371+0000 7f4059438640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f40540bed50 0x7f40540bf160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:48622/0 (socket says 172.21.15.73:48622) 2023-12-12T09:45:49.372 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:49.371+0000 7f4059438640 1 -- 172.21.15.73:0/640915465 learned_addr learned my addr 172.21.15.73:0/640915465 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:45:49.373 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:49.371+0000 7f4059438640 1 -- 172.21.15.73:0/640915465 >> v2:172.21.15.142:3300/0 conn(0x7f40540c3930 msgr2=0x7f405406d440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:45:49.373 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:49.371+0000 7f4059438640 1 --2- 172.21.15.73:0/640915465 >> v2:172.21.15.142:3300/0 conn(0x7f40540c3930 0x7f405406d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:49.373 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:49.371+0000 7f4059438640 1 -- 172.21.15.73:0/640915465 >> v1:172.21.15.142:6789/0 conn(0x7f4054151c30 legacy=0x7f4054157bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:45:49.373 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:49.371+0000 7f4059438640 1 -- 172.21.15.73:0/640915465 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4054155260 con 0x7f40540bed50 2023-12-12T09:45:49.374 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:49.372+0000 7f4059438640 1 --2- 172.21.15.73:0/640915465 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f40540bed50 0x7f40540bf160 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f405406f730 tx=0x7f404c02b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=966435734053f3b2 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:45:49.374 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:49.372+0000 7f40537fe640 1 -- 172.21.15.73:0/640915465 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f404c0317e0 con 0x7f40540bed50 2023-12-12T09:45:49.374 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:49.373+0000 7f40537fe640 1 -- 172.21.15.73:0/640915465 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f404c031940 con 0x7f40540bed50 2023-12-12T09:45:49.374 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:49.373+0000 7f40537fe640 1 -- 172.21.15.73:0/640915465 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f404c031cd0 con 0x7f40540bed50 2023-12-12T09:45:49.375 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:49.373+0000 7f405ae9b640 1 -- 172.21.15.73:0/640915465 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f40540bed50 msgr2=0x7f40540bf160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:49.375 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:49.373+0000 7f405ae9b640 1 --2- 172.21.15.73:0/640915465 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f40540bed50 0x7f40540bf160 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f405406f730 tx=0x7f404c02b880 comp rx=0 tx=0).stop 2023-12-12T09:45:49.375 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:49.373+0000 7f405ae9b640 1 -- 172.21.15.73:0/640915465 shutdown_connections 2023-12-12T09:45:49.375 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:49.373+0000 7f405ae9b640 1 --2- 172.21.15.73:0/640915465 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f40540bed50 0x7f40540bf160 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:49.376 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:49.373+0000 7f405ae9b640 1 --2- 172.21.15.73:0/640915465 >> v2:172.21.15.142:3300/0 conn(0x7f40540c3930 0x7f405406d440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:49.376 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:49.373+0000 7f405ae9b640 1 -- 172.21.15.73:0/640915465 >> 172.21.15.73:0/640915465 conn(0x7f405406a4e0 msgr2=0x7f405406a8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:45:49.376 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:49.373+0000 7f405ae9b640 1 -- 172.21.15.73:0/640915465 shutdown_connections 2023-12-12T09:45:49.376 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:49.373+0000 7f405ae9b640 1 -- 172.21.15.73:0/640915465 wait complete. 2023-12-12T09:45:49.376 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:49.375+0000 7f405ae9b640 1 Processor -- start 2023-12-12T09:45:49.376 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:49.375+0000 7f405ae9b640 1 -- start start 2023-12-12T09:45:49.378 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:49.376+0000 7f405ae9b640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f40540bed50 0x7f4054072640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:49.378 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:49.376+0000 7f405ae9b640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f40540c3930 0x7f40540c2570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:49.378 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:49.376+0000 7f405ae9b640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4054151c30 0x7f40541ed330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:49.378 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:49.376+0000 7f405ae9b640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4054155970 con 0x7f4054151c30 2023-12-12T09:45:49.378 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:49.376+0000 7f405ae9b640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40540c2fe0 con 0x7f40540bed50 2023-12-12T09:45:49.378 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:49.376+0000 7f405ae9b640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4054155c10 con 0x7f40540c3930 2023-12-12T09:45:49.379 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:49.376+0000 7f4059438640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4054151c30 0x7f40541ed330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:49.379 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:49.377+0000 7f4059438640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4054151c30 0x7f40541ed330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:48636/0 (socket says 172.21.15.73:48636) 2023-12-12T09:45:49.379 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:49.377+0000 7f4059438640 1 -- 172.21.15.73:0/3501808475 learned_addr learned my addr 172.21.15.73:0/3501808475 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:45:49.379 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:49.377+0000 7f4058c37640 1 --2- 172.21.15.73:0/3501808475 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f40540bed50 0x7f4054072640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:49.379 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:49.377+0000 7f4053fff640 1 --2- 172.21.15.73:0/3501808475 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f40540c3930 0x7f40540c2570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:49.379 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:49.377+0000 7f4059438640 1 -- 172.21.15.73:0/3501808475 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f40540c3930 msgr2=0x7f40540c2570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:49.379 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:49.377+0000 7f4059438640 1 --2- 172.21.15.73:0/3501808475 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f40540c3930 0x7f40540c2570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:49.379 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:49.377+0000 7f4059438640 1 -- 172.21.15.73:0/3501808475 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f40540bed50 msgr2=0x7f4054072640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:49.379 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:49.377+0000 7f4059438640 1 --2- 172.21.15.73:0/3501808475 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f40540bed50 0x7f4054072640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:49.379 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:49.377+0000 7f4059438640 1 -- 172.21.15.73:0/3501808475 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f404c0094d0 con 0x7f4054151c30 2023-12-12T09:45:49.380 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:49.377+0000 7f4059438640 1 --2- 172.21.15.73:0/3501808475 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4054151c30 0x7f40541ed330 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f404c0090b0 tx=0x7f404c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:45:49.380 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:49.378+0000 7f40517fa640 1 -- 172.21.15.73:0/3501808475 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f404c032940 con 0x7f4054151c30 2023-12-12T09:45:49.380 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:49.378+0000 7f40517fa640 1 -- 172.21.15.73:0/3501808475 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f404c032ac0 con 0x7f4054151c30 2023-12-12T09:45:49.380 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:49.378+0000 7f40517fa640 1 -- 172.21.15.73:0/3501808475 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f404c032e70 con 0x7f4054151c30 2023-12-12T09:45:49.380 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:49.378+0000 7f405ae9b640 1 -- 172.21.15.73:0/3501808475 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4054071b60 con 0x7f4054151c30 2023-12-12T09:45:49.380 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:49.378+0000 7f405ae9b640 1 -- 172.21.15.73:0/3501808475 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4054072120 con 0x7f4054151c30 2023-12-12T09:45:49.380 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:49.379+0000 7f405ae9b640 1 -- 172.21.15.73:0/3501808475 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4054067070 con 0x7f4054151c30 2023-12-12T09:45:49.381 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:49.380+0000 7f40517fa640 1 -- 172.21.15.73:0/3501808475 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f404c04d3f0 con 0x7f4054151c30 2023-12-12T09:45:49.382 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:49.381+0000 7f40517fa640 1 --2- 172.21.15.73:0/3501808475 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f403406ae40 0x7f403406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:49.382 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:49.381+0000 7f40517fa640 1 -- 172.21.15.73:0/3501808475 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f404c0ab830 con 0x7f4054151c30 2023-12-12T09:45:49.382 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:49.381+0000 7f4058c37640 1 --2- 172.21.15.73:0/3501808475 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f403406ae40 0x7f403406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:49.383 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:49.382+0000 7f4058c37640 1 --2- 172.21.15.73:0/3501808475 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f403406ae40 0x7f403406d300 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f4044009f50 tx=0x7f4044009570 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:45:49.387 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:49.386+0000 7f40517fa640 1 -- 172.21.15.73:0/3501808475 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f404c076570 con 0x7f4054151c30 2023-12-12T09:45:49.651 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:49.650+0000 7f405ae9b640 1 -- 172.21.15.73:0/3501808475 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "auth add", "entity": "client.testuser", "caps": ["mon", "allow rw fsname=cephfs, allow rw fsname=cephfs2", "osd", "allow rw tag cephfs data=cephfs, allow rw tag cephfs data=cephfs2", "mds", "allow rw fsname=cephfs"]} v 0) v1 -- 0x7f4054072310 con 0x7f4054151c30 2023-12-12T09:45:49.657 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:49.655+0000 7f40517fa640 1 -- 172.21.15.73:0/3501808475 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "auth add", "entity": "client.testuser", "caps": ["mon", "allow rw fsname=cephfs, allow rw fsname=cephfs2", "osd", "allow rw tag cephfs data=cephfs, allow rw tag cephfs data=cephfs2", "mds", "allow rw fsname=cephfs"]}]=0 added key for client.testuser v17) v1 ==== 291+0+0 (secure 0 0 0) 0x7f404c079b90 con 0x7f4054151c30 2023-12-12T09:45:49.657 INFO:teuthology.orchestra.run.smithi073.stderr:added key for client.testuser 2023-12-12T09:45:49.659 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:49.658+0000 7f405ae9b640 1 -- 172.21.15.73:0/3501808475 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f403406ae40 msgr2=0x7f403406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:49.660 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:49.658+0000 7f405ae9b640 1 --2- 172.21.15.73:0/3501808475 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f403406ae40 0x7f403406d300 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f4044009f50 tx=0x7f4044009570 comp rx=0 tx=0).stop 2023-12-12T09:45:49.660 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:49.658+0000 7f405ae9b640 1 -- 172.21.15.73:0/3501808475 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4054151c30 msgr2=0x7f40541ed330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:49.660 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:49.658+0000 7f405ae9b640 1 --2- 172.21.15.73:0/3501808475 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4054151c30 0x7f40541ed330 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f404c0090b0 tx=0x7f404c0046c0 comp rx=0 tx=0).stop 2023-12-12T09:45:49.660 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:49.658+0000 7f405ae9b640 1 -- 172.21.15.73:0/3501808475 shutdown_connections 2023-12-12T09:45:49.660 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:49.658+0000 7f405ae9b640 1 --2- 172.21.15.73:0/3501808475 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f403406ae40 0x7f403406d300 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:49.660 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:49.658+0000 7f405ae9b640 1 --2- 172.21.15.73:0/3501808475 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4054151c30 0x7f40541ed330 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:49.660 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:49.658+0000 7f405ae9b640 1 --2- 172.21.15.73:0/3501808475 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f40540c3930 0x7f40540c2570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:49.660 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:49.658+0000 7f405ae9b640 1 --2- 172.21.15.73:0/3501808475 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f40540bed50 0x7f4054072640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:49.660 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:49.658+0000 7f405ae9b640 1 -- 172.21.15.73:0/3501808475 >> 172.21.15.73:0/3501808475 conn(0x7f405406a4e0 msgr2=0x7f40540c4c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:45:49.660 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:49.658+0000 7f405ae9b640 1 -- 172.21.15.73:0/3501808475 shutdown_connections 2023-12-12T09:45:49.660 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:49.658+0000 7f405ae9b640 1 -- 172.21.15.73:0/3501808475 wait complete. 2023-12-12T09:45:49.679 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth get client.testuser 2023-12-12T09:45:49.890 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:49.889+0000 7faefe5b6640 1 Processor -- start 2023-12-12T09:45:49.890 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:49.889+0000 7faefe5b6640 1 -- start start 2023-12-12T09:45:49.892 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:49.890+0000 7faefe5b6640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7faef80c1a60 0x7faef8151b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:49.892 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:49.890+0000 7faefe5b6640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7faef80c4c10 0x7faef8154f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:49.892 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:49.890+0000 7faefe5b6640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faef81589a0 con 0x7faef80a4f40 2023-12-12T09:45:49.892 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:49.890+0000 7faefe5b6640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faef806c120 con 0x7faef80c1a60 2023-12-12T09:45:49.892 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:49.890+0000 7faefe5b6640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faef8157d90 con 0x7faef80c4c10 2023-12-12T09:45:49.892 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:49.890+0000 7faef7fff640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7faef80c1a60 0x7faef8151b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:49.892 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:49.891+0000 7faef7fff640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7faef80c1a60 0x7faef8151b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:48646/0 (socket says 172.21.15.73:48646) 2023-12-12T09:45:49.892 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:49.891+0000 7faef7fff640 1 -- 172.21.15.73:0/3032036703 learned_addr learned my addr 172.21.15.73:0/3032036703 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:45:49.893 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:49.891+0000 7faef7fff640 1 -- 172.21.15.73:0/3032036703 >> v2:172.21.15.142:3300/0 conn(0x7faef80c4c10 msgr2=0x7faef8154f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:45:49.893 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:49.891+0000 7faef7fff640 1 --2- 172.21.15.73:0/3032036703 >> v2:172.21.15.142:3300/0 conn(0x7faef80c4c10 0x7faef8154f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:49.893 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:49.891+0000 7faef7fff640 1 -- 172.21.15.73:0/3032036703 >> v1:172.21.15.73:6789/0 conn(0x7faef80a4f40 legacy=0x7faef8154860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:49.893 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:49.891+0000 7faef7fff640 1 -- 172.21.15.73:0/3032036703 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faef8158070 con 0x7faef80c1a60 2023-12-12T09:45:49.894 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:49.892+0000 7faef7fff640 1 --2- 172.21.15.73:0/3032036703 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7faef80c1a60 0x7faef8151b20 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7faef80a4ce0 tx=0x7faee802b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f31378ee3a86cbea server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:45:49.894 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:49.892+0000 7faef77fe640 1 -- 172.21.15.73:0/3032036703 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faee80317e0 con 0x7faef80c1a60 2023-12-12T09:45:49.894 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:49.893+0000 7faef77fe640 1 -- 172.21.15.73:0/3032036703 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faee8031940 con 0x7faef80c1a60 2023-12-12T09:45:49.894 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:49.893+0000 7faef77fe640 1 -- 172.21.15.73:0/3032036703 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faee8031cd0 con 0x7faef80c1a60 2023-12-12T09:45:49.895 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:49.893+0000 7faefe5b6640 1 -- 172.21.15.73:0/3032036703 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7faef80c1a60 msgr2=0x7faef8151b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:49.895 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:49.893+0000 7faefe5b6640 1 --2- 172.21.15.73:0/3032036703 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7faef80c1a60 0x7faef8151b20 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7faef80a4ce0 tx=0x7faee802b880 comp rx=0 tx=0).stop 2023-12-12T09:45:49.895 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:49.893+0000 7faefe5b6640 1 -- 172.21.15.73:0/3032036703 shutdown_connections 2023-12-12T09:45:49.895 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:49.893+0000 7faefe5b6640 1 --2- 172.21.15.73:0/3032036703 >> v2:172.21.15.142:3300/0 conn(0x7faef80c4c10 0x7faef8154f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:49.895 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:49.893+0000 7faefe5b6640 1 --2- 172.21.15.73:0/3032036703 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7faef80c1a60 0x7faef8151b20 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:49.895 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:49.893+0000 7faefe5b6640 1 -- 172.21.15.73:0/3032036703 >> 172.21.15.73:0/3032036703 conn(0x7faef80a77d0 msgr2=0x7faef80a7bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:45:49.895 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:49.893+0000 7faefe5b6640 1 -- 172.21.15.73:0/3032036703 shutdown_connections 2023-12-12T09:45:49.895 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:49.893+0000 7faefe5b6640 1 -- 172.21.15.73:0/3032036703 wait complete. 2023-12-12T09:45:49.896 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:49.895+0000 7faefe5b6640 1 Processor -- start 2023-12-12T09:45:49.896 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:49.895+0000 7faefe5b6640 1 -- start start 2023-12-12T09:45:49.897 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:49.896+0000 7faefe5b6640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7faef80a4f40 0x7faef81edbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:49.897 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:49.896+0000 7faefe5b6640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7faef80c1a60 0x7faef8153320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:49.897 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:49.896+0000 7faefe5b6640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7faef80c4c10 0x7faef80a5e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:49.898 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:49.896+0000 7faefe5b6640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faef81ed740 con 0x7faef80c4c10 2023-12-12T09:45:49.898 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:49.896+0000 7faefe5b6640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faef80a73e0 con 0x7faef80a4f40 2023-12-12T09:45:49.898 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:49.896+0000 7faefe5b6640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faef81ed130 con 0x7faef80c1a60 2023-12-12T09:45:49.898 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:49.896+0000 7faefcb53640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7faef80c4c10 0x7faef80a5e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:49.898 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:49.896+0000 7faefcb53640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7faef80c4c10 0x7faef80a5e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:48648/0 (socket says 172.21.15.73:48648) 2023-12-12T09:45:49.898 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:49.896+0000 7faefcb53640 1 -- 172.21.15.73:0/1311393765 learned_addr learned my addr 172.21.15.73:0/1311393765 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:45:49.899 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:49.897+0000 7faefcb53640 1 -- 172.21.15.73:0/1311393765 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7faef80c1a60 msgr2=0x7faef8153320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:49.899 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:49.897+0000 7faefcb53640 1 --2- 172.21.15.73:0/1311393765 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7faef80c1a60 0x7faef8153320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:49.899 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:49.897+0000 7faefcb53640 1 -- 172.21.15.73:0/1311393765 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7faef80a4f40 msgr2=0x7faef81edbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:49.899 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:49.897+0000 7faefcb53640 1 --2- 172.21.15.73:0/1311393765 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7faef80a4f40 0x7faef81edbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:49.899 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:49.897+0000 7faefcb53640 1 -- 172.21.15.73:0/1311393765 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faee80094d0 con 0x7faef80c4c10 2023-12-12T09:45:49.899 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:49.897+0000 7faefcb53640 1 --2- 172.21.15.73:0/1311393765 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7faef80c4c10 0x7faef80a5e20 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7faef000b970 tx=0x7faef000be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:45:49.899 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:49.897+0000 7faef57fa640 1 -- 172.21.15.73:0/1311393765 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faef000cb40 con 0x7faef80c4c10 2023-12-12T09:45:49.899 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:49.897+0000 7faef57fa640 1 -- 172.21.15.73:0/1311393765 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faef000ccc0 con 0x7faef80c4c10 2023-12-12T09:45:49.899 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:49.897+0000 7faef57fa640 1 -- 172.21.15.73:0/1311393765 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faef0014680 con 0x7faef80c4c10 2023-12-12T09:45:49.900 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:49.897+0000 7faefe5b6640 1 -- 172.21.15.73:0/1311393765 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faef80a7100 con 0x7faef80c4c10 2023-12-12T09:45:49.900 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:49.897+0000 7faefe5b6640 1 -- 172.21.15.73:0/1311393765 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faef80a6360 con 0x7faef80c4c10 2023-12-12T09:45:49.900 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:49.898+0000 7faefe5b6640 1 -- 172.21.15.73:0/1311393765 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faef8074760 con 0x7faef80c4c10 2023-12-12T09:45:49.900 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:49.899+0000 7faef57fa640 1 -- 172.21.15.73:0/1311393765 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7faef001d3b0 con 0x7faef80c4c10 2023-12-12T09:45:49.902 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:49.901+0000 7faef57fa640 1 --2- 172.21.15.73:0/1311393765 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7faedc06ae40 0x7faedc06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:49.902 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:49.901+0000 7faef57fa640 1 -- 172.21.15.73:0/1311393765 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 6565+0+0 (secure 0 0 0) 0x7faef0089900 con 0x7faef80c4c10 2023-12-12T09:45:49.902 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:49.901+0000 7faef7fff640 1 --2- 172.21.15.73:0/1311393765 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7faedc06ae40 0x7faedc06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:49.903 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:49.902+0000 7faef7fff640 1 --2- 172.21.15.73:0/1311393765 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7faedc06ae40 0x7faedc06d300 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7faee8036000 tx=0x7faee8030000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:45:49.906 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:49.905+0000 7faef57fa640 1 -- 172.21.15.73:0/1311393765 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7faef0054640 con 0x7faef80c4c10 2023-12-12T09:45:50.164 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:50.163+0000 7faefe5b6640 1 -- 172.21.15.73:0/1311393765 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "auth get", "entity": "client.testuser"} v 0) v1 -- 0x7faef8067580 con 0x7faef80c4c10 2023-12-12T09:45:50.165 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:50.164+0000 7faef57fa640 1 -- 172.21.15.73:0/1311393765 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "auth get", "entity": "client.testuser"}]=0 v17) v1 ==== 85+0+245 (secure 0 0 0) 0x7faef0019090 con 0x7faef80c4c10 2023-12-12T09:45:50.165 INFO:teuthology.orchestra.run.smithi073.stdout:[client.testuser] 2023-12-12T09:45:50.166 INFO:teuthology.orchestra.run.smithi073.stdout: key = AQDNK3hlCS/mJhAAS/jvgI5UicsVLO+EaGuuUQ== 2023-12-12T09:45:50.166 INFO:teuthology.orchestra.run.smithi073.stdout: caps mds = "allow rw fsname=cephfs" 2023-12-12T09:45:50.166 INFO:teuthology.orchestra.run.smithi073.stdout: caps mon = "allow rw fsname=cephfs, allow rw fsname=cephfs2" 2023-12-12T09:45:50.166 INFO:teuthology.orchestra.run.smithi073.stdout: caps osd = "allow rw tag cephfs data=cephfs, allow rw tag cephfs data=cephfs2" 2023-12-12T09:45:50.168 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:50.167+0000 7faefe5b6640 1 -- 172.21.15.73:0/1311393765 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7faedc06ae40 msgr2=0x7faedc06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:50.168 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:50.167+0000 7faefe5b6640 1 --2- 172.21.15.73:0/1311393765 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7faedc06ae40 0x7faedc06d300 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7faee8036000 tx=0x7faee8030000 comp rx=0 tx=0).stop 2023-12-12T09:45:50.168 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:50.167+0000 7faefe5b6640 1 -- 172.21.15.73:0/1311393765 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7faef80c4c10 msgr2=0x7faef80a5e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:50.168 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:50.167+0000 7faefe5b6640 1 --2- 172.21.15.73:0/1311393765 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7faef80c4c10 0x7faef80a5e20 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7faef000b970 tx=0x7faef000be30 comp rx=0 tx=0).stop 2023-12-12T09:45:50.169 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:50.167+0000 7faefe5b6640 1 -- 172.21.15.73:0/1311393765 shutdown_connections 2023-12-12T09:45:50.169 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:50.167+0000 7faefe5b6640 1 --2- 172.21.15.73:0/1311393765 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7faedc06ae40 0x7faedc06d300 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:50.169 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:50.167+0000 7faefe5b6640 1 --2- 172.21.15.73:0/1311393765 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7faef80c4c10 0x7faef80a5e20 unknown :-1 s=CLOSED pgs=702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:50.169 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:50.167+0000 7faefe5b6640 1 --2- 172.21.15.73:0/1311393765 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7faef80c1a60 0x7faef8153320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:50.169 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:50.167+0000 7faefe5b6640 1 --2- 172.21.15.73:0/1311393765 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7faef80a4f40 0x7faef81edbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:50.169 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:50.167+0000 7faefe5b6640 1 -- 172.21.15.73:0/1311393765 >> 172.21.15.73:0/1311393765 conn(0x7faef80a77d0 msgr2=0x7faef8151db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:45:50.169 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:50.167+0000 7faefe5b6640 1 -- 172.21.15.73:0/1311393765 shutdown_connections 2023-12-12T09:45:50.169 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:50.167+0000 7faefe5b6640 1 -- 172.21.15.73:0/1311393765 wait complete. 2023-12-12T09:45:50.187 DEBUG:teuthology.orchestra.run.smithi073:> mktemp 2023-12-12T09:45:50.232 INFO:teuthology.orchestra.run.smithi073.stdout:/tmp/tmp.EPLJclYIHE 2023-12-12T09:45:50.232 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2023-12-12T09:45:50.232 DEBUG:teuthology.orchestra.run.smithi073:> dd of=/tmp/tmp.EPLJclYIHE 2023-12-12T09:45:50.331 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2023-12-12T09:45:50.331 DEBUG:teuthology.orchestra.run.smithi073:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-12T09:45:50.431 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2023-12-12T09:45:50.431 DEBUG:teuthology.orchestra.run.smithi073:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-12T09:45:50.489 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-12T09:45:50.696 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:50.695+0000 7f28685e3640 1 Processor -- start 2023-12-12T09:45:50.697 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:50.695+0000 7f28685e3640 1 -- start start 2023-12-12T09:45:50.698 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:50.697+0000 7f28685e3640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f286014fa40 0x7f286006a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:50.698 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:50.697+0000 7f28685e3640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f286006db70 0x7f28600c39b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:50.698 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:50.697+0000 7f28685e3640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2860152610 con 0x7f28600c5070 2023-12-12T09:45:50.698 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:50.697+0000 7f28685e3640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28601528f0 con 0x7f286014fa40 2023-12-12T09:45:50.699 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:50.697+0000 7f28685e3640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2860152bd0 con 0x7f286006db70 2023-12-12T09:45:50.699 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:50.697+0000 7f286637f640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f286014fa40 0x7f286006a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:50.699 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:50.697+0000 7f2866b80640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f28600c5070 0x7f28600c3ef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:55782/0 (socket says 172.21.15.73:55782) 2023-12-12T09:45:50.699 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:50.697+0000 7f2866b80640 1 -- 172.21.15.73:0/3805561494 learned_addr learned my addr 172.21.15.73:0/3805561494 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-12T09:45:50.700 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:50.697+0000 7f2865b7e640 1 --2- 172.21.15.73:0/3805561494 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f286006db70 0x7f28600c39b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:50.700 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:50.698+0000 7f286537d640 1 -- 172.21.15.73:0/3805561494 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1099144 0 0) 0x7f2860152610 con 0x7f28600c5070 2023-12-12T09:45:50.700 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:50.698+0000 7f286537d640 1 -- 172.21.15.73:0/3805561494 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f284c003520 con 0x7f28600c5070 2023-12-12T09:45:50.700 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:50.698+0000 7f286637f640 1 -- 172.21.15.73:0/3805561494 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f286006db70 msgr2=0x7f28600c39b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:45:50.700 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:50.698+0000 7f286637f640 1 --2- 172.21.15.73:0/3805561494 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f286006db70 0x7f28600c39b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:50.700 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:50.698+0000 7f286637f640 1 -- 172.21.15.73:0/3805561494 >> v1:172.21.15.73:6789/0 conn(0x7f28600c5070 legacy=0x7f28600c3ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:50.700 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:50.698+0000 7f286637f640 1 -- 172.21.15.73:0/3805561494 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2860152eb0 con 0x7f286014fa40 2023-12-12T09:45:50.701 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:50.699+0000 7f286637f640 1 --2- 172.21.15.73:0/3805561494 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f286014fa40 0x7f286006a4e0 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f285c0097a0 tx=0x7f285c02b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee37896d476488a4 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:45:50.701 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:50.699+0000 7f286537d640 1 -- 172.21.15.73:0/3805561494 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f285c02d040 con 0x7f286014fa40 2023-12-12T09:45:50.701 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:50.699+0000 7f286537d640 1 -- 172.21.15.73:0/3805561494 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f285c031810 con 0x7f286014fa40 2023-12-12T09:45:50.701 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:50.699+0000 7f286537d640 1 -- 172.21.15.73:0/3805561494 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f285c031ba0 con 0x7f286014fa40 2023-12-12T09:45:50.701 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:50.700+0000 7f28685e3640 1 -- 172.21.15.73:0/3805561494 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f286014fa40 msgr2=0x7f286006a4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:50.701 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:50.700+0000 7f28685e3640 1 --2- 172.21.15.73:0/3805561494 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f286014fa40 0x7f286006a4e0 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f285c0097a0 tx=0x7f285c02b8b0 comp rx=0 tx=0).stop 2023-12-12T09:45:50.701 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:50.700+0000 7f28685e3640 1 -- 172.21.15.73:0/3805561494 shutdown_connections 2023-12-12T09:45:50.702 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:50.700+0000 7f28685e3640 1 --2- 172.21.15.73:0/3805561494 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f286006db70 0x7f28600c39b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:50.702 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:50.700+0000 7f28685e3640 1 --2- 172.21.15.73:0/3805561494 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f286014fa40 0x7f286006a4e0 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:50.702 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:50.700+0000 7f28685e3640 1 -- 172.21.15.73:0/3805561494 >> 172.21.15.73:0/3805561494 conn(0x7f28600a8130 msgr2=0x7f28600c24b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:45:50.702 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:50.700+0000 7f28685e3640 1 -- 172.21.15.73:0/3805561494 shutdown_connections 2023-12-12T09:45:50.702 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:50.700+0000 7f28685e3640 1 -- 172.21.15.73:0/3805561494 wait complete. 2023-12-12T09:45:50.703 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:50.702+0000 7f28685e3640 1 Processor -- start 2023-12-12T09:45:50.703 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:50.702+0000 7f28685e3640 1 -- start start 2023-12-12T09:45:50.704 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:50.703+0000 7f28685e3640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f286006db70 0x7f28601d9a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:50.704 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:50.703+0000 7f28685e3640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f28600c5070 0x7f28601ed6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:50.704 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:50.703+0000 7f28685e3640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f286014fa40 0x7f28600a8c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:50.704 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:50.703+0000 7f28685e3640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28600a9c70 con 0x7f286006db70 2023-12-12T09:45:50.704 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:50.703+0000 7f28685e3640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28601dc520 con 0x7f28600c5070 2023-12-12T09:45:50.704 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:50.703+0000 7f28685e3640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28600a7480 con 0x7f286014fa40 2023-12-12T09:45:50.704 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:50.703+0000 7f286637f640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f286006db70 0x7f28601d9a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:50.704 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:50.703+0000 7f286637f640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f286006db70 0x7f28601d9a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:48664/0 (socket says 172.21.15.73:48664) 2023-12-12T09:45:50.705 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:50.703+0000 7f286637f640 1 -- 172.21.15.73:0/2734283720 learned_addr learned my addr 172.21.15.73:0/2734283720 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:45:50.706 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:50.703+0000 7f286637f640 1 -- 172.21.15.73:0/2734283720 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f286014fa40 msgr2=0x7f28600a8c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:50.706 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:50.703+0000 7f286637f640 1 --2- 172.21.15.73:0/2734283720 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f286014fa40 0x7f28600a8c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:50.706 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:50.703+0000 7f286637f640 1 -- 172.21.15.73:0/2734283720 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f28600c5070 msgr2=0x7f28601ed6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:50.706 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:50.703+0000 7f286637f640 1 --2- 172.21.15.73:0/2734283720 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f28600c5070 0x7f28601ed6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:50.706 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:50.703+0000 7f286637f640 1 -- 172.21.15.73:0/2734283720 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f285c009400 con 0x7f286006db70 2023-12-12T09:45:50.706 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:50.704+0000 7f286637f640 1 --2- 172.21.15.73:0/2734283720 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f286006db70 0x7f28601d9a60 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f285c0098c0 tx=0x7f285c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:45:50.706 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:50.704+0000 7f2856ffd640 1 -- 172.21.15.73:0/2734283720 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f285c006e10 con 0x7f286006db70 2023-12-12T09:45:50.706 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:50.704+0000 7f2856ffd640 1 -- 172.21.15.73:0/2734283720 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f285c03ad60 con 0x7f286006db70 2023-12-12T09:45:50.706 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:50.704+0000 7f28685e3640 1 -- 172.21.15.73:0/2734283720 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28600a6180 con 0x7f286006db70 2023-12-12T09:45:50.706 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:50.704+0000 7f2856ffd640 1 -- 172.21.15.73:0/2734283720 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f285c044620 con 0x7f286006db70 2023-12-12T09:45:50.706 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:50.704+0000 7f28685e3640 1 -- 172.21.15.73:0/2734283720 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28600a6420 con 0x7f286006db70 2023-12-12T09:45:50.707 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:50.705+0000 7f28685e3640 1 -- 172.21.15.73:0/2734283720 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28600a6610 con 0x7f286006db70 2023-12-12T09:45:50.707 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:50.706+0000 7f2856ffd640 1 -- 172.21.15.73:0/2734283720 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f285c04d440 con 0x7f286006db70 2023-12-12T09:45:50.708 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:50.707+0000 7f2856ffd640 1 --2- 172.21.15.73:0/2734283720 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f284406ae70 0x7f284406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:50.708 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:50.707+0000 7f2856ffd640 1 -- 172.21.15.73:0/2734283720 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f285c0abcb0 con 0x7f286006db70 2023-12-12T09:45:50.708 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:50.707+0000 7f2865b7e640 1 --2- 172.21.15.73:0/2734283720 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f284406ae70 0x7f284406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:50.709 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:50.708+0000 7f2865b7e640 1 --2- 172.21.15.73:0/2734283720 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f284406ae70 0x7f284406d330 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f2850006fd0 tx=0x7f2850008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:45:50.712 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:50.711+0000 7f2856ffd640 1 -- 172.21.15.73:0/2734283720 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f285c0769f0 con 0x7f286006db70 2023-12-12T09:45:50.904 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:50.902+0000 7f28685e3640 1 -- 172.21.15.73:0/2734283720 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f28600a6610 con 0x7f286006db70 2023-12-12T09:45:50.906 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:50.905+0000 7f2856ffd640 1 -- 172.21.15.73:0/2734283720 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v58) v1 ==== 74+0+20292 (secure 0 0 0) 0x7f285c035090 con 0x7f286006db70 2023-12-12T09:45:50.907 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-12T09:45:50.907 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":58,"fsid":"ba240992-02b8-4c7e-92f2-27eb29ac433b","created":"2023-12-12T09:43:02.454719+0000","modified":"2023-12-12T09:45:39.273967+0000","last_up_change":"2023-12-12T09:43:13.913440+0000","last_in_change":"2023-12-12T09:43:05.925348+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-12T09:43:15.525508+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-12-12T09:45:21.264815+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"53","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-12-12T09:45:21.981834+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"54","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs2_metadata","create_time":"2023-12-12T09:45:36.388393+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"57","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs2_data","create_time":"2023-12-12T09:45:37.109653+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"58","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"dd9074be-dbe2-4c34-9896-a4223d8d3940","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":4047810203},{"type":"v1","addr":"172.21.15.73:6801","nonce":4047810203}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":4047810203},{"type":"v1","addr":"172.21.15.73:6803","nonce":4047810203}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":4047810203},{"type":"v1","addr":"172.21.15.73:6807","nonce":4047810203}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":4047810203},{"type":"v1","addr":"172.21.15.73:6805","nonce":4047810203}]},"public_addr":"172.21.15.73:6801/4047810203","cluster_addr":"172.21.15.73:6803/4047810203","heartbeat_back_addr":"172.21.15.73:6807/4047810203","heartbeat_front_addr":"172.21.15.73:6805/4047810203","state":["exists","up"]},{"osd":1,"uuid":"c4a05052-96d4-4758-a4e1-1a37f1e07fed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":1356058331},{"type":"v1","addr":"172.21.15.73:6824","nonce":1356058331}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":1356058331},{"type":"v1","addr":"172.21.15.73:6827","nonce":1356058331}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":1356058331},{"type":"v1","addr":"172.21.15.73:6831","nonce":1356058331}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":1356058331},{"type":"v1","addr":"172.21.15.73:6829","nonce":1356058331}]},"public_addr":"172.21.15.73:6824/1356058331","cluster_addr":"172.21.15.73:6827/1356058331","heartbeat_back_addr":"172.21.15.73:6831/1356058331","heartbeat_front_addr":"172.21.15.73:6829/1356058331","state":["exists","up"]},{"osd":2,"uuid":"512bc8ac-72c2-40d4-b3d2-d867a92c5213","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":1228903316},{"type":"v1","addr":"172.21.15.73:6817","nonce":1228903316}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":1228903316},{"type":"v1","addr":"172.21.15.73:6819","nonce":1228903316}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6823","nonce":1228903316},{"type":"v1","addr":"172.21.15.73:6825","nonce":1228903316}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":1228903316},{"type":"v1","addr":"172.21.15.73:6821","nonce":1228903316}]},"public_addr":"172.21.15.73:6817/1228903316","cluster_addr":"172.21.15.73:6819/1228903316","heartbeat_back_addr":"172.21.15.73:6825/1228903316","heartbeat_front_addr":"172.21.15.73:6821/1228903316","state":["exists","up"]},{"osd":3,"uuid":"3d1a91e0-42bf-437a-8eae-8d357c8f63a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":1293329670},{"type":"v1","addr":"172.21.15.73:6809","nonce":1293329670}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6810","nonce":1293329670},{"type":"v1","addr":"172.21.15.73:6811","nonce":1293329670}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":1293329670},{"type":"v1","addr":"172.21.15.73:6815","nonce":1293329670}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":1293329670},{"type":"v1","addr":"172.21.15.73:6813","nonce":1293329670}]},"public_addr":"172.21.15.73:6809/1293329670","cluster_addr":"172.21.15.73:6811/1293329670","heartbeat_back_addr":"172.21.15.73:6815/1293329670","heartbeat_front_addr":"172.21.15.73:6813/1293329670","state":["exists","up"]},{"osd":4,"uuid":"4b302fff-834c-4069-ac19-00e46f6c87b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":3727975702},{"type":"v1","addr":"172.21.15.142:6801","nonce":3727975702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":3727975702},{"type":"v1","addr":"172.21.15.142:6803","nonce":3727975702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6809","nonce":3727975702},{"type":"v1","addr":"172.21.15.142:6811","nonce":3727975702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6805","nonce":3727975702},{"type":"v1","addr":"172.21.15.142:6807","nonce":3727975702}]},"public_addr":"172.21.15.142:6801/3727975702","cluster_addr":"172.21.15.142:6803/3727975702","heartbeat_back_addr":"172.21.15.142:6811/3727975702","heartbeat_front_addr":"172.21.15.142:6807/3727975702","state":["exists","up"]},{"osd":5,"uuid":"d7cdace2-67d0-45cc-95f2-515cf6ef1b82","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6817","nonce":2353193632},{"type":"v1","addr":"172.21.15.142:6819","nonce":2353193632}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6821","nonce":2353193632},{"type":"v1","addr":"172.21.15.142:6823","nonce":2353193632}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6829","nonce":2353193632},{"type":"v1","addr":"172.21.15.142:6831","nonce":2353193632}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6825","nonce":2353193632},{"type":"v1","addr":"172.21.15.142:6827","nonce":2353193632}]},"public_addr":"172.21.15.142:6819/2353193632","cluster_addr":"172.21.15.142:6823/2353193632","heartbeat_back_addr":"172.21.15.142:6831/2353193632","heartbeat_front_addr":"172.21.15.142:6827/2353193632","state":["exists","up"]},{"osd":6,"uuid":"649ce78a-5626-445c-aedc-a651ed05a6f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":2006111986},{"type":"v1","addr":"172.21.15.142:6806","nonce":2006111986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":2006111986},{"type":"v1","addr":"172.21.15.142:6810","nonce":2006111986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":2006111986},{"type":"v1","addr":"172.21.15.142:6815","nonce":2006111986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":2006111986},{"type":"v1","addr":"172.21.15.142:6813","nonce":2006111986}]},"public_addr":"172.21.15.142:6806/2006111986","cluster_addr":"172.21.15.142:6810/2006111986","heartbeat_back_addr":"172.21.15.142:6815/2006111986","heartbeat_front_addr":"172.21.15.142:6813/2006111986","state":["exists","up"]},{"osd":7,"uuid":"af15ae3b-c1d0-4acf-92db-8a1805494d13","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":2573794341},{"type":"v1","addr":"172.21.15.142:6818","nonce":2573794341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":2573794341},{"type":"v1","addr":"172.21.15.142:6822","nonce":2573794341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":2573794341},{"type":"v1","addr":"172.21.15.142:6830","nonce":2573794341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":2573794341},{"type":"v1","addr":"172.21.15.142:6826","nonce":2573794341}]},"public_addr":"172.21.15.142:6818/2573794341","cluster_addr":"172.21.15.142:6822/2573794341","heartbeat_back_addr":"172.21.15.142:6830/2573794341","heartbeat_front_addr":"172.21.15.142:6826/2573794341","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.185824+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.262103+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.225556+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:10.523459+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:10.706035+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.257339+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.301776+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.051960+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-12T09:45:50.910 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:50.908+0000 7f28685e3640 1 -- 172.21.15.73:0/2734283720 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f284406ae70 msgr2=0x7f284406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:50.910 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:50.908+0000 7f28685e3640 1 --2- 172.21.15.73:0/2734283720 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f284406ae70 0x7f284406d330 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f2850006fd0 tx=0x7f2850008040 comp rx=0 tx=0).stop 2023-12-12T09:45:50.910 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:50.908+0000 7f28685e3640 1 -- 172.21.15.73:0/2734283720 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f286006db70 msgr2=0x7f28601d9a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:50.910 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:50.908+0000 7f28685e3640 1 --2- 172.21.15.73:0/2734283720 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f286006db70 0x7f28601d9a60 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f285c0098c0 tx=0x7f285c0046c0 comp rx=0 tx=0).stop 2023-12-12T09:45:50.910 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:50.908+0000 7f28685e3640 1 -- 172.21.15.73:0/2734283720 shutdown_connections 2023-12-12T09:45:50.910 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:50.908+0000 7f28685e3640 1 --2- 172.21.15.73:0/2734283720 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f284406ae70 0x7f284406d330 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:50.910 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:50.908+0000 7f28685e3640 1 --2- 172.21.15.73:0/2734283720 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f286014fa40 0x7f28600a8c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:50.910 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:50.908+0000 7f28685e3640 1 --2- 172.21.15.73:0/2734283720 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f28600c5070 0x7f28601ed6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:50.910 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:50.908+0000 7f28685e3640 1 --2- 172.21.15.73:0/2734283720 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f286006db70 0x7f28601d9a60 unknown :-1 s=CLOSED pgs=705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:50.911 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:50.908+0000 7f28685e3640 1 -- 172.21.15.73:0/2734283720 >> 172.21.15.73:0/2734283720 conn(0x7f28600a8130 msgr2=0x7f28600c38b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:45:50.911 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:50.908+0000 7f28685e3640 1 -- 172.21.15.73:0/2734283720 shutdown_connections 2023-12-12T09:45:50.911 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:50.908+0000 7f28685e3640 1 -- 172.21.15.73:0/2734283720 wait complete. 2023-12-12T09:45:50.929 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-12T09:43:15.525508+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 8, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-12T09:45:21.264815+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '53', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 9, 'pool_name': 'cephfs_data', 'create_time': '2023-12-12T09:45:21.981834+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '54', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 10, 'pool_name': 'cephfs2_metadata', 'create_time': '2023-12-12T09:45:36.388393+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '57', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs2'}}, 'read_balance': {'score_acting': 2.5, 'score_stable': 2.5, 'optimal_score': 1, 'raw_score_acting': 2.5, 'raw_score_stable': 2.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 11, 'pool_name': 'cephfs2_data', 'create_time': '2023-12-12T09:45:37.109653+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '58', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs2'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-12T09:45:50.930 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-12T09:45:51.142 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:51.140+0000 7f252ae5c640 1 Processor -- start 2023-12-12T09:45:51.142 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:51.140+0000 7f252ae5c640 1 -- start start 2023-12-12T09:45:51.143 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:51.142+0000 7f252ae5c640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f25240c7cc0 0x7f252406b290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:51.143 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:51.142+0000 7f252ae5c640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f252406b7d0 0x7f252415ef10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:51.144 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:51.142+0000 7f252ae5c640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2524154ea0 con 0x7f2524151c50 2023-12-12T09:45:51.144 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:51.142+0000 7f252ae5c640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2524152030 con 0x7f25240c7cc0 2023-12-12T09:45:51.144 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:51.142+0000 7f252ae5c640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f252406bc20 con 0x7f252406b7d0 2023-12-12T09:45:51.144 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:51.142+0000 7f2528bf8640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f2524151c50 0x7f25240c4740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:55788/0 (socket says 172.21.15.73:55788) 2023-12-12T09:45:51.144 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:51.142+0000 7f2528bf8640 1 -- 172.21.15.73:0/1832319585 learned_addr learned my addr 172.21.15.73:0/1832319585 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-12T09:45:51.146 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:51.143+0000 7f251bfff640 1 --2- 172.21.15.73:0/1832319585 >> v2:172.21.15.142:3300/0 conn(0x7f25240c7cc0 0x7f252406b290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:51.146 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:51.143+0000 7f25293f9640 1 --2- 172.21.15.73:0/1832319585 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f252406b7d0 0x7f252415ef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:51.146 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:51.143+0000 7f251b7fe640 1 -- 172.21.15.73:0/1832319585 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3457237873 0 0) 0x7f2524154ea0 con 0x7f2524151c50 2023-12-12T09:45:51.146 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:51.143+0000 7f251b7fe640 1 -- 172.21.15.73:0/1832319585 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f250c003520 con 0x7f2524151c50 2023-12-12T09:45:51.146 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:51.143+0000 7f251b7fe640 1 -- 172.21.15.73:0/1832319585 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4070682542 0 0) 0x7f250c003520 con 0x7f2524151c50 2023-12-12T09:45:51.146 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:51.143+0000 7f251b7fe640 1 -- 172.21.15.73:0/1832319585 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f252406b7d0 msgr2=0x7f252415ef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:45:51.146 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:51.143+0000 7f251b7fe640 1 --2- 172.21.15.73:0/1832319585 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f252406b7d0 0x7f252415ef10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:51.146 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:51.143+0000 7f251b7fe640 1 -- 172.21.15.73:0/1832319585 >> v2:172.21.15.142:3300/0 conn(0x7f25240c7cc0 msgr2=0x7f252406b290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:45:51.146 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:51.143+0000 7f251b7fe640 1 --2- 172.21.15.73:0/1832319585 >> v2:172.21.15.142:3300/0 conn(0x7f25240c7cc0 0x7f252406b290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:51.146 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:51.143+0000 7f251b7fe640 1 -- 172.21.15.73:0/1832319585 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2524154590 con 0x7f2524151c50 2023-12-12T09:45:51.146 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:51.143+0000 7f251b7fe640 1 -- 172.21.15.73:0/1832319585 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3186547832 0 0) 0x7f25200019f0 con 0x7f2524151c50 2023-12-12T09:45:51.146 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:51.143+0000 7f251b7fe640 1 -- 172.21.15.73:0/1832319585 >> v1:172.21.15.73:6789/0 conn(0x7f2524151c50 legacy=0x7f25240c4740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:51.147 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:51.143+0000 7f251b7fe640 1 --2- 172.21.15.73:0/1832319585 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f250c003970 0x7f250c003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:51.147 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:51.143+0000 7f251b7fe640 1 --2- 172.21.15.73:0/1832319585 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f250c0047c0 0x7f250c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:51.147 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:51.144+0000 7f251b7fe640 1 --2- 172.21.15.73:0/1832319585 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f252406b7d0 0x7f250c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:51.147 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:51.144+0000 7f251b7fe640 1 -- 172.21.15.73:0/1832319585 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2524152030 con 0x7f250c003970 2023-12-12T09:45:51.147 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:51.144+0000 7f251b7fe640 1 -- 172.21.15.73:0/1832319585 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f252406bc20 con 0x7f250c0047c0 2023-12-12T09:45:51.147 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:51.144+0000 7f251b7fe640 1 -- 172.21.15.73:0/1832319585 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f250c00b980 con 0x7f252406b7d0 2023-12-12T09:45:51.147 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:51.144+0000 7f2528bf8640 1 --2- 172.21.15.73:0/1832319585 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f250c003970 0x7f250c003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:51.147 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:51.144+0000 7f2528bf8640 1 -- 172.21.15.73:0/1832319585 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f252406b7d0 msgr2=0x7f250c005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:45:51.147 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:51.144+0000 7f2528bf8640 1 --2- 172.21.15.73:0/1832319585 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f252406b7d0 0x7f250c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:51.147 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:51.144+0000 7f2528bf8640 1 -- 172.21.15.73:0/1832319585 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f250c0047c0 msgr2=0x7f250c004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:45:51.147 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:51.144+0000 7f2528bf8640 1 --2- 172.21.15.73:0/1832319585 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f250c0047c0 0x7f250c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:51.147 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:51.144+0000 7f2528bf8640 1 -- 172.21.15.73:0/1832319585 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f250c003520 con 0x7f250c003970 2023-12-12T09:45:51.148 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:51.145+0000 7f2528bf8640 1 --2- 172.21.15.73:0/1832319585 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f250c003970 0x7f250c003d90 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f252000a890 tx=0x7f250c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d311be8c97a6631b server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:45:51.148 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:51.145+0000 7f251b7fe640 1 -- 172.21.15.73:0/1832319585 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2520034630 con 0x7f250c003970 2023-12-12T09:45:51.148 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:51.145+0000 7f251b7fe640 1 -- 172.21.15.73:0/1832319585 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f252002f070 con 0x7f250c003970 2023-12-12T09:45:51.149 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:51.146+0000 7f251b7fe640 1 -- 172.21.15.73:0/1832319585 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25200349f0 con 0x7f250c003970 2023-12-12T09:45:51.149 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:51.146+0000 7f252ae5c640 1 -- 172.21.15.73:0/1832319585 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f250c003970 msgr2=0x7f250c003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:51.149 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:51.146+0000 7f252ae5c640 1 --2- 172.21.15.73:0/1832319585 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f250c003970 0x7f250c003d90 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f252000a890 tx=0x7f250c0057f0 comp rx=0 tx=0).stop 2023-12-12T09:45:51.149 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:51.146+0000 7f25293f9640 1 -- 172.21.15.73:0/1832319585 reap_dead start 2023-12-12T09:45:51.149 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:51.146+0000 7f252ae5c640 1 -- 172.21.15.73:0/1832319585 shutdown_connections 2023-12-12T09:45:51.149 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:51.146+0000 7f252ae5c640 1 -- 172.21.15.73:0/1832319585 >> 172.21.15.73:0/1832319585 conn(0x7f25240ab970 msgr2=0x7f25240abd80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:45:51.149 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:51.146+0000 7f252ae5c640 1 -- 172.21.15.73:0/1832319585 shutdown_connections 2023-12-12T09:45:51.149 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:51.146+0000 7f252ae5c640 1 -- 172.21.15.73:0/1832319585 wait complete. 2023-12-12T09:45:51.149 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:51.148+0000 7f252ae5c640 1 Processor -- start 2023-12-12T09:45:51.150 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:51.148+0000 7f252ae5c640 1 -- start start 2023-12-12T09:45:51.150 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:51.149+0000 7f252ae5c640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f250c003970 0x7f252414d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:51.150 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:51.149+0000 7f252ae5c640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2524158790 0x7f2524144550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:51.150 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:51.149+0000 7f252ae5c640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2524144a90 0x7f2524150940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:51.150 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:51.149+0000 7f252ae5c640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25241ed060 con 0x7f2524158790 2023-12-12T09:45:51.150 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:51.149+0000 7f252ae5c640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f252414bef0 con 0x7f2524144a90 2023-12-12T09:45:51.150 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:51.149+0000 7f252ae5c640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25240afc80 con 0x7f250c003970 2023-12-12T09:45:51.152 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:51.149+0000 7f251bfff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2524158790 0x7f2524144550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:51.152 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:51.149+0000 7f251bfff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2524158790 0x7f2524144550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:48670/0 (socket says 172.21.15.73:48670) 2023-12-12T09:45:51.152 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:51.149+0000 7f251bfff640 1 -- 172.21.15.73:0/2408142224 learned_addr learned my addr 172.21.15.73:0/2408142224 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:45:51.152 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:51.150+0000 7f25293f9640 1 --2- 172.21.15.73:0/2408142224 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2524144a90 0x7f2524150940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:51.152 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:51.150+0000 7f2528bf8640 1 --2- 172.21.15.73:0/2408142224 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f250c003970 0x7f252414d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:51.152 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:51.150+0000 7f251bfff640 1 -- 172.21.15.73:0/2408142224 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f250c003970 msgr2=0x7f252414d4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:51.152 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:51.150+0000 7f251bfff640 1 --2- 172.21.15.73:0/2408142224 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f250c003970 0x7f252414d4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:51.152 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:51.150+0000 7f251bfff640 1 -- 172.21.15.73:0/2408142224 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2524144a90 msgr2=0x7f2524150940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:51.153 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:51.150+0000 7f251bfff640 1 --2- 172.21.15.73:0/2408142224 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2524144a90 0x7f2524150940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:51.153 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:51.150+0000 7f251bfff640 1 -- 172.21.15.73:0/2408142224 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f252414c140 con 0x7f2524158790 2023-12-12T09:45:51.153 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:51.150+0000 7f251bfff640 1 --2- 172.21.15.73:0/2408142224 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2524158790 0x7f2524144550 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f251400e860 tx=0x7f251400ed20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:45:51.153 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:51.150+0000 7f25197fa640 1 -- 172.21.15.73:0/2408142224 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2514009600 con 0x7f2524158790 2023-12-12T09:45:51.153 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:51.150+0000 7f25197fa640 1 -- 172.21.15.73:0/2408142224 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f251400c940 con 0x7f2524158790 2023-12-12T09:45:51.153 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:51.150+0000 7f25197fa640 1 -- 172.21.15.73:0/2408142224 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f251400ccd0 con 0x7f2524158790 2023-12-12T09:45:51.153 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:51.150+0000 7f252ae5c640 1 -- 172.21.15.73:0/2408142224 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f252414c420 con 0x7f2524158790 2023-12-12T09:45:51.153 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:51.151+0000 7f252ae5c640 1 -- 172.21.15.73:0/2408142224 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2524150420 con 0x7f2524158790 2023-12-12T09:45:51.153 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:51.152+0000 7f252ae5c640 1 -- 172.21.15.73:0/2408142224 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2524067470 con 0x7f2524158790 2023-12-12T09:45:51.154 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:51.153+0000 7f25197fa640 1 -- 172.21.15.73:0/2408142224 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f2514013470 con 0x7f2524158790 2023-12-12T09:45:51.156 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:51.153+0000 7f25197fa640 1 --2- 172.21.15.73:0/2408142224 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f251006ae40 0x7f251006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:51.156 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:51.154+0000 7f25197fa640 1 -- 172.21.15.73:0/2408142224 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f2514089b90 con 0x7f2524158790 2023-12-12T09:45:51.156 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:51.154+0000 7f2528bf8640 1 --2- 172.21.15.73:0/2408142224 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f251006ae40 0x7f251006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:51.156 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:51.154+0000 7f2528bf8640 1 --2- 172.21.15.73:0/2408142224 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f251006ae40 0x7f251006d300 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f2520034000 tx=0x7f2520009030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:45:51.159 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:51.158+0000 7f25197fa640 1 -- 172.21.15.73:0/2408142224 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f2514054840 con 0x7f2524158790 2023-12-12T09:45:51.353 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:51.349+0000 7f252ae5c640 1 -- 172.21.15.73:0/2408142224 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f252406c110 con 0x7f2524158790 2023-12-12T09:45:51.354 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:51.350+0000 7f25197fa640 1 -- 172.21.15.73:0/2408142224 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v58) v1 ==== 93+0+10 (secure 0 0 0) 0x7f25140170a0 con 0x7f2524158790 2023-12-12T09:45:51.354 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 1 2023-12-12T09:45:51.355 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:51.353+0000 7f252ae5c640 1 -- 172.21.15.73:0/2408142224 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f251006ae40 msgr2=0x7f251006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:51.355 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:51.353+0000 7f252ae5c640 1 --2- 172.21.15.73:0/2408142224 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f251006ae40 0x7f251006d300 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f2520034000 tx=0x7f2520009030 comp rx=0 tx=0).stop 2023-12-12T09:45:51.355 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:51.353+0000 7f252ae5c640 1 -- 172.21.15.73:0/2408142224 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2524158790 msgr2=0x7f2524144550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:51.355 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:51.353+0000 7f252ae5c640 1 --2- 172.21.15.73:0/2408142224 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2524158790 0x7f2524144550 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f251400e860 tx=0x7f251400ed20 comp rx=0 tx=0).stop 2023-12-12T09:45:51.355 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:51.353+0000 7f252ae5c640 1 -- 172.21.15.73:0/2408142224 shutdown_connections 2023-12-12T09:45:51.355 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:51.353+0000 7f252ae5c640 1 --2- 172.21.15.73:0/2408142224 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f251006ae40 0x7f251006d300 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:51.355 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:51.353+0000 7f252ae5c640 1 --2- 172.21.15.73:0/2408142224 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2524144a90 0x7f2524150940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:51.355 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:51.353+0000 7f252ae5c640 1 --2- 172.21.15.73:0/2408142224 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2524158790 0x7f2524144550 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:51.355 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:51.353+0000 7f252ae5c640 1 --2- 172.21.15.73:0/2408142224 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f250c003970 0x7f252414d4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:51.355 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:51.353+0000 7f252ae5c640 1 -- 172.21.15.73:0/2408142224 >> 172.21.15.73:0/2408142224 conn(0x7f25240ab970 msgr2=0x7f25240c4640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:45:51.356 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:51.353+0000 7f252ae5c640 1 -- 172.21.15.73:0/2408142224 shutdown_connections 2023-12-12T09:45:51.356 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:51.353+0000 7f252ae5c640 1 -- 172.21.15.73:0/2408142224 wait complete. 2023-12-12T09:45:51.373 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-12T09:45:51.580 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:51.579+0000 7fc18f2f3640 1 Processor -- start 2023-12-12T09:45:51.581 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:51.579+0000 7fc18f2f3640 1 -- start start 2023-12-12T09:45:51.582 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:51.580+0000 7fc18f2f3640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fc188151c30 0x7fc18806d440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:51.582 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:51.581+0000 7fc18f2f3640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc1880bed50 0x7fc1880bf1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:51.582 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:51.581+0000 7fc18f2f3640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1881582e0 con 0x7fc1880c3930 2023-12-12T09:45:51.582 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:51.581+0000 7fc18f2f3640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1880a54d0 con 0x7fc188151c30 2023-12-12T09:45:51.582 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:51.581+0000 7fc18f2f3640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1880a4f50 con 0x7fc1880bed50 2023-12-12T09:45:51.583 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:51.581+0000 7fc18c88e640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7fc1880c3930 0x7fc188157bd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:55802/0 (socket says 172.21.15.73:55802) 2023-12-12T09:45:51.583 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:51.581+0000 7fc18c88e640 1 -- 172.21.15.73:0/1914891865 learned_addr learned my addr 172.21.15.73:0/1914891865 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-12T09:45:51.583 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:51.581+0000 7fc18d08f640 1 --2- 172.21.15.73:0/1914891865 >> v2:172.21.15.73:3300/0 conn(0x7fc188151c30 0x7fc18806d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:51.583 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:51.581+0000 7fc17ffff640 1 -- 172.21.15.73:0/1914891865 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2285816705 0 0) 0x7fc1881582e0 con 0x7fc1880c3930 2023-12-12T09:45:51.584 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:51.581+0000 7fc17ffff640 1 -- 172.21.15.73:0/1914891865 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc174003520 con 0x7fc1880c3930 2023-12-12T09:45:51.584 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:51.581+0000 7fc18d08f640 1 -- 172.21.15.73:0/1914891865 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc1880bed50 msgr2=0x7fc1880bf1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:45:51.584 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:51.581+0000 7fc18d890640 1 --2- 172.21.15.73:0/1914891865 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc1880bed50 0x7fc1880bf1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:51.584 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:51.581+0000 7fc18d08f640 1 --2- 172.21.15.73:0/1914891865 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc1880bed50 0x7fc1880bf1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:51.584 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:51.582+0000 7fc18d08f640 1 -- 172.21.15.73:0/1914891865 >> v1:172.21.15.73:6789/0 conn(0x7fc1880c3930 legacy=0x7fc188157bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:51.584 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:51.582+0000 7fc18d08f640 1 -- 172.21.15.73:0/1914891865 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc188155260 con 0x7fc188151c30 2023-12-12T09:45:51.584 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:51.582+0000 7fc18d890640 1 --2- 172.21.15.73:0/1914891865 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc1880bed50 0x7fc1880bf1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:45:51.585 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:51.583+0000 7fc18d08f640 1 --2- 172.21.15.73:0/1914891865 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc188151c30 0x7fc18806d440 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7fc1840097a0 tx=0x7fc18402b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce0cfc3c34d67df server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:45:51.585 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:51.583+0000 7fc17ffff640 1 -- 172.21.15.73:0/1914891865 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc18402e070 con 0x7fc188151c30 2023-12-12T09:45:51.585 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:51.583+0000 7fc17ffff640 1 -- 172.21.15.73:0/1914891865 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1840315a0 con 0x7fc188151c30 2023-12-12T09:45:51.585 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:51.583+0000 7fc17ffff640 1 -- 172.21.15.73:0/1914891865 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc184031930 con 0x7fc188151c30 2023-12-12T09:45:51.585 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:51.583+0000 7fc18f2f3640 1 -- 172.21.15.73:0/1914891865 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc188151c30 msgr2=0x7fc18806d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:51.586 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:51.583+0000 7fc18f2f3640 1 --2- 172.21.15.73:0/1914891865 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc188151c30 0x7fc18806d440 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7fc1840097a0 tx=0x7fc18402b840 comp rx=0 tx=0).stop 2023-12-12T09:45:51.586 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:51.584+0000 7fc18f2f3640 1 -- 172.21.15.73:0/1914891865 shutdown_connections 2023-12-12T09:45:51.586 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:51.584+0000 7fc18f2f3640 1 --2- 172.21.15.73:0/1914891865 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc1880bed50 0x7fc1880bf1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:51.586 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:51.584+0000 7fc18f2f3640 1 --2- 172.21.15.73:0/1914891865 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc188151c30 0x7fc18806d440 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:51.586 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:51.584+0000 7fc18f2f3640 1 -- 172.21.15.73:0/1914891865 >> 172.21.15.73:0/1914891865 conn(0x7fc18806a4e0 msgr2=0x7fc18806a8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:45:51.586 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:51.584+0000 7fc18f2f3640 1 -- 172.21.15.73:0/1914891865 shutdown_connections 2023-12-12T09:45:51.586 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:51.584+0000 7fc18f2f3640 1 -- 172.21.15.73:0/1914891865 wait complete. 2023-12-12T09:45:51.586 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:51.585+0000 7fc18f2f3640 1 Processor -- start 2023-12-12T09:45:51.587 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:51.586+0000 7fc18f2f3640 1 -- start start 2023-12-12T09:45:51.589 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:51.586+0000 7fc18f2f3640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc1880bed50 0x7fc18806fea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:51.589 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:51.586+0000 7fc18f2f3640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc1880c3930 0x7fc18814a7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:51.589 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:51.586+0000 7fc18f2f3640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc188151c30 0x7fc18814acf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:51.589 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:51.587+0000 7fc18f2f3640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc188070aa0 con 0x7fc1880c3930 2023-12-12T09:45:51.589 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:51.587+0000 7fc18f2f3640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1880725e0 con 0x7fc188151c30 2023-12-12T09:45:51.589 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:51.587+0000 7fc18f2f3640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc188071cb0 con 0x7fc1880bed50 2023-12-12T09:45:51.589 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:51.587+0000 7fc18c88e640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc1880c3930 0x7fc18814a7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:51.589 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:51.587+0000 7fc18c88e640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc1880c3930 0x7fc18814a7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:48686/0 (socket says 172.21.15.73:48686) 2023-12-12T09:45:51.589 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:51.587+0000 7fc18c88e640 1 -- 172.21.15.73:0/2862028374 learned_addr learned my addr 172.21.15.73:0/2862028374 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:45:51.590 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:51.587+0000 7fc18c88e640 1 -- 172.21.15.73:0/2862028374 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc1880bed50 msgr2=0x7fc18806fea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:51.590 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:51.587+0000 7fc18c88e640 1 --2- 172.21.15.73:0/2862028374 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc1880bed50 0x7fc18806fea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:51.590 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:51.587+0000 7fc18c88e640 1 -- 172.21.15.73:0/2862028374 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc188151c30 msgr2=0x7fc18814acf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:51.590 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:51.587+0000 7fc18c88e640 1 --2- 172.21.15.73:0/2862028374 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc188151c30 0x7fc18814acf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:51.590 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:51.587+0000 7fc18c88e640 1 -- 172.21.15.73:0/2862028374 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc184009400 con 0x7fc1880c3930 2023-12-12T09:45:51.590 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:51.587+0000 7fc18c88e640 1 --2- 172.21.15.73:0/2862028374 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc1880c3930 0x7fc18814a7b0 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7fc17800c500 tx=0x7fc17800c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:45:51.590 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:51.588+0000 7fc17dffb640 1 -- 172.21.15.73:0/2862028374 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc178005ce0 con 0x7fc1880c3930 2023-12-12T09:45:51.590 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:51.588+0000 7fc17dffb640 1 -- 172.21.15.73:0/2862028374 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc178005e40 con 0x7fc1880c3930 2023-12-12T09:45:51.590 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:51.588+0000 7fc18f2f3640 1 -- 172.21.15.73:0/2862028374 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc188071f90 con 0x7fc1880c3930 2023-12-12T09:45:51.590 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:51.588+0000 7fc17dffb640 1 -- 172.21.15.73:0/2862028374 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc178007330 con 0x7fc1880c3930 2023-12-12T09:45:51.590 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:51.588+0000 7fc18f2f3640 1 -- 172.21.15.73:0/2862028374 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc188156c90 con 0x7fc1880c3930 2023-12-12T09:45:51.591 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:51.589+0000 7fc18f2f3640 1 -- 172.21.15.73:0/2862028374 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc188067070 con 0x7fc1880c3930 2023-12-12T09:45:51.591 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:51.590+0000 7fc17dffb640 1 -- 172.21.15.73:0/2862028374 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fc178007550 con 0x7fc1880c3930 2023-12-12T09:45:51.592 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:51.591+0000 7fc17dffb640 1 --2- 172.21.15.73:0/2862028374 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fc16c06ae40 0x7fc16c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:51.592 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:51.591+0000 7fc17dffb640 1 -- 172.21.15.73:0/2862028374 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fc178088f40 con 0x7fc1880c3930 2023-12-12T09:45:51.592 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:51.591+0000 7fc18d08f640 1 --2- 172.21.15.73:0/2862028374 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fc16c06ae40 0x7fc16c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:51.593 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:51.592+0000 7fc18d08f640 1 --2- 172.21.15.73:0/2862028374 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fc16c06ae40 0x7fc16c06d300 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fc184036000 tx=0x7fc184030000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:45:51.597 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:51.596+0000 7fc17dffb640 1 -- 172.21.15.73:0/2862028374 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fc178053de0 con 0x7fc1880c3930 2023-12-12T09:45:51.787 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:51.785+0000 7fc18f2f3640 1 -- 172.21.15.73:0/2862028374 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fc18814f450 con 0x7fc1880c3930 2023-12-12T09:45:51.788 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:51.786+0000 7fc17dffb640 1 -- 172.21.15.73:0/2862028374 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v58) v1 ==== 104+0+11 (secure 0 0 0) 0x7fc1780170a0 con 0x7fc1880c3930 2023-12-12T09:45:51.788 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 32 2023-12-12T09:45:51.790 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:51.789+0000 7fc18f2f3640 1 -- 172.21.15.73:0/2862028374 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fc16c06ae40 msgr2=0x7fc16c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:51.790 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:51.789+0000 7fc18f2f3640 1 --2- 172.21.15.73:0/2862028374 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fc16c06ae40 0x7fc16c06d300 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fc184036000 tx=0x7fc184030000 comp rx=0 tx=0).stop 2023-12-12T09:45:51.790 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:51.789+0000 7fc18f2f3640 1 -- 172.21.15.73:0/2862028374 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc1880c3930 msgr2=0x7fc18814a7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:51.791 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:51.789+0000 7fc18f2f3640 1 --2- 172.21.15.73:0/2862028374 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc1880c3930 0x7fc18814a7b0 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7fc17800c500 tx=0x7fc17800c9c0 comp rx=0 tx=0).stop 2023-12-12T09:45:51.791 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:51.789+0000 7fc18f2f3640 1 -- 172.21.15.73:0/2862028374 shutdown_connections 2023-12-12T09:45:51.791 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:51.789+0000 7fc18f2f3640 1 --2- 172.21.15.73:0/2862028374 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fc16c06ae40 0x7fc16c06d300 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:51.791 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:51.789+0000 7fc18f2f3640 1 --2- 172.21.15.73:0/2862028374 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc188151c30 0x7fc18814acf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:51.791 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:51.789+0000 7fc18f2f3640 1 --2- 172.21.15.73:0/2862028374 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc1880c3930 0x7fc18814a7b0 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:51.791 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:51.789+0000 7fc18f2f3640 1 --2- 172.21.15.73:0/2862028374 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc1880bed50 0x7fc18806fea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:51.791 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:51.789+0000 7fc18f2f3640 1 -- 172.21.15.73:0/2862028374 >> 172.21.15.73:0/2862028374 conn(0x7fc18806a4e0 msgr2=0x7fc1881548e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:45:51.791 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:51.789+0000 7fc18f2f3640 1 -- 172.21.15.73:0/2862028374 shutdown_connections 2023-12-12T09:45:51.791 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:51.789+0000 7fc18f2f3640 1 -- 172.21.15.73:0/2862028374 wait complete. 2023-12-12T09:45:51.809 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-12T09:45:52.005 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:52.004+0000 7f7ee19ae640 1 Processor -- start 2023-12-12T09:45:52.006 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:52.004+0000 7f7ee19ae640 1 -- start start 2023-12-12T09:45:52.007 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:52.006+0000 7f7ee19ae640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f7edc1543d0 0x7f7edc154840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:52.007 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:52.006+0000 7f7ee19ae640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7edc158670 con 0x7f7edc1519d0 2023-12-12T09:45:52.007 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:52.006+0000 7f7ee19ae640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7edc0c5f30 con 0x7f7edc06c420 2023-12-12T09:45:52.007 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:52.006+0000 7f7ee19ae640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7edc157a60 con 0x7f7edc1543d0 2023-12-12T09:45:52.007 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:52.006+0000 7f7ee09ac640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f7edc1519d0 0x7f7edc0c7d80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:55810/0 (socket says 172.21.15.73:55810) 2023-12-12T09:45:52.007 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:52.006+0000 7f7ee09ac640 1 -- 172.21.15.73:0/3307573761 learned_addr learned my addr 172.21.15.73:0/3307573761 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-12T09:45:52.007 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:52.006+0000 7f7ee11ad640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f7edc1543d0 0x7f7edc154840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:52.008 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:52.006+0000 7f7ee11ad640 1 -- 172.21.15.73:0/3307573761 >> v1:172.21.15.142:6789/0 conn(0x7f7edc06c420 legacy=0x7f7edc0ca140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:45:52.008 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:52.006+0000 7f7ee11ad640 1 -- 172.21.15.73:0/3307573761 >> v1:172.21.15.73:6789/0 conn(0x7f7edc1519d0 legacy=0x7f7edc0c7d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:52.008 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:52.006+0000 7f7ee11ad640 1 -- 172.21.15.73:0/3307573761 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7edc157d40 con 0x7f7edc1543d0 2023-12-12T09:45:52.008 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:52.006+0000 7f7edb7fe640 1 -- 172.21.15.73:0/3307573761 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3612296855 0 0) 0x7f7edc158670 con 0x7f7edc1519d0 2023-12-12T09:45:52.009 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:52.007+0000 7f7ee11ad640 1 --2- 172.21.15.73:0/3307573761 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7edc1543d0 0x7f7edc154840 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f7ed4009d90 tx=0x7f7ed402be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c94bf6c90f419012 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:45:52.009 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:52.008+0000 7f7edb7fe640 1 -- 172.21.15.73:0/3307573761 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ed402cbd0 con 0x7f7edc1543d0 2023-12-12T09:45:52.009 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:52.008+0000 7f7edb7fe640 1 -- 172.21.15.73:0/3307573761 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ed402cd30 con 0x7f7edc1543d0 2023-12-12T09:45:52.009 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:52.008+0000 7f7edb7fe640 1 -- 172.21.15.73:0/3307573761 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ed402cea0 con 0x7f7edc1543d0 2023-12-12T09:45:52.010 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:52.008+0000 7f7ee19ae640 1 -- 172.21.15.73:0/3307573761 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7edc1543d0 msgr2=0x7f7edc154840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:52.010 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:52.008+0000 7f7ee19ae640 1 --2- 172.21.15.73:0/3307573761 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7edc1543d0 0x7f7edc154840 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f7ed4009d90 tx=0x7f7ed402be20 comp rx=0 tx=0).stop 2023-12-12T09:45:52.010 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:52.008+0000 7f7ee19ae640 1 -- 172.21.15.73:0/3307573761 shutdown_connections 2023-12-12T09:45:52.010 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:52.008+0000 7f7ee19ae640 1 --2- 172.21.15.73:0/3307573761 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7edc1543d0 0x7f7edc154840 unknown :-1 s=CLOSED pgs=713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:52.010 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:52.008+0000 7f7ee19ae640 1 -- 172.21.15.73:0/3307573761 >> 172.21.15.73:0/3307573761 conn(0x7f7edc072030 msgr2=0x7f7edc072440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:45:52.010 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:52.008+0000 7f7ee19ae640 1 -- 172.21.15.73:0/3307573761 shutdown_connections 2023-12-12T09:45:52.010 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:52.008+0000 7f7ee19ae640 1 -- 172.21.15.73:0/3307573761 wait complete. 2023-12-12T09:45:52.011 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:52.010+0000 7f7ee19ae640 1 Processor -- start 2023-12-12T09:45:52.011 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:52.010+0000 7f7ee19ae640 1 -- start start 2023-12-12T09:45:52.014 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:52.011+0000 7f7ee19ae640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7edc06c420 0x7f7edc1483f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:52.014 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:52.011+0000 7f7ee19ae640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7edc1519d0 0x7f7edc1ea300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:52.014 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:52.011+0000 7f7ee19ae640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7edc1543d0 0x7f7edc150200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:52.014 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:52.011+0000 7f7ee19ae640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7edc0acbb0 con 0x7f7edc1543d0 2023-12-12T09:45:52.014 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:52.011+0000 7f7ee19ae640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7edc0c0a70 con 0x7f7edc1519d0 2023-12-12T09:45:52.014 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:52.011+0000 7f7ee19ae640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7edc1e9b60 con 0x7f7edc06c420 2023-12-12T09:45:52.015 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:52.011+0000 7f7ee11ad640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7edc1543d0 0x7f7edc150200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:52.015 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:52.011+0000 7f7ee11ad640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7edc1543d0 0x7f7edc150200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:48708/0 (socket says 172.21.15.73:48708) 2023-12-12T09:45:52.015 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:52.011+0000 7f7ee11ad640 1 -- 172.21.15.73:0/3407297947 learned_addr learned my addr 172.21.15.73:0/3407297947 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:45:52.015 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:52.012+0000 7f7edbfff640 1 --2- 172.21.15.73:0/3407297947 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7edc1519d0 0x7f7edc1ea300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:52.015 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:52.012+0000 7f7ee09ac640 1 --2- 172.21.15.73:0/3407297947 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7edc06c420 0x7f7edc1483f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:52.015 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:52.012+0000 7f7ee11ad640 1 -- 172.21.15.73:0/3407297947 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7edc06c420 msgr2=0x7f7edc1483f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:52.015 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:52.012+0000 7f7ee11ad640 1 --2- 172.21.15.73:0/3407297947 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7edc06c420 0x7f7edc1483f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:52.015 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:52.012+0000 7f7ee11ad640 1 -- 172.21.15.73:0/3407297947 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7edc1519d0 msgr2=0x7f7edc1ea300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:52.015 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:52.012+0000 7f7ee11ad640 1 --2- 172.21.15.73:0/3407297947 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7edc1519d0 0x7f7edc1ea300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:52.015 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:52.012+0000 7f7ee11ad640 1 -- 172.21.15.73:0/3407297947 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ed4009a70 con 0x7f7edc1543d0 2023-12-12T09:45:52.015 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:52.012+0000 7f7ee09ac640 1 --2- 172.21.15.73:0/3407297947 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7edc06c420 0x7f7edc1483f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:45:52.015 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:52.012+0000 7f7ee11ad640 1 --2- 172.21.15.73:0/3407297947 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7edc1543d0 0x7f7edc150200 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f7ed4009d90 tx=0x7f7ed4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:45:52.015 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:52.012+0000 7f7ed97fa640 1 -- 172.21.15.73:0/3407297947 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ed402cea0 con 0x7f7edc1543d0 2023-12-12T09:45:52.016 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:52.012+0000 7f7ed97fa640 1 -- 172.21.15.73:0/3407297947 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ed403e630 con 0x7f7edc1543d0 2023-12-12T09:45:52.016 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:52.012+0000 7f7ed97fa640 1 -- 172.21.15.73:0/3407297947 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ed403e9e0 con 0x7f7edc1543d0 2023-12-12T09:45:52.016 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:52.012+0000 7f7ee19ae640 1 -- 172.21.15.73:0/3407297947 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7edc1edb70 con 0x7f7edc1543d0 2023-12-12T09:45:52.016 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:52.012+0000 7f7ee19ae640 1 -- 172.21.15.73:0/3407297947 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7edc1ede50 con 0x7f7edc1543d0 2023-12-12T09:45:52.016 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:52.013+0000 7f7ee19ae640 1 -- 172.21.15.73:0/3407297947 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7edc067400 con 0x7f7edc1543d0 2023-12-12T09:45:52.017 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:52.014+0000 7f7ed97fa640 1 -- 172.21.15.73:0/3407297947 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f7ed403b050 con 0x7f7edc1543d0 2023-12-12T09:45:52.017 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:52.015+0000 7f7ed97fa640 1 --2- 172.21.15.73:0/3407297947 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f7ec006ae40 0x7f7ec006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:52.017 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:52.015+0000 7f7ed97fa640 1 -- 172.21.15.73:0/3407297947 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f7ed40aba30 con 0x7f7edc1543d0 2023-12-12T09:45:52.017 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:52.015+0000 7f7ee09ac640 1 --2- 172.21.15.73:0/3407297947 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f7ec006ae40 0x7f7ec006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:52.017 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:52.016+0000 7f7ee09ac640 1 --2- 172.21.15.73:0/3407297947 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f7ec006ae40 0x7f7ec006d300 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f7ed0007fd0 tx=0x7f7ed0009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:45:52.021 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:52.019+0000 7f7ed97fa640 1 -- 172.21.15.73:0/3407297947 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f7ed40766e0 con 0x7f7edc1543d0 2023-12-12T09:45:52.195 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:52.194+0000 7f7ee19ae640 1 -- 172.21.15.73:0/3407297947 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f7edc0c5f30 con 0x7f7edc1543d0 2023-12-12T09:45:52.196 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:52.195+0000 7f7ed97fa640 1 -- 172.21.15.73:0/3407297947 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v58) v1 ==== 100+0+11 (secure 0 0 0) 0x7f7edc0c5f30 con 0x7f7edc1543d0 2023-12-12T09:45:52.196 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 64 2023-12-12T09:45:52.198 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:52.197+0000 7f7ee19ae640 1 -- 172.21.15.73:0/3407297947 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f7ec006ae40 msgr2=0x7f7ec006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:52.199 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:52.197+0000 7f7ee19ae640 1 --2- 172.21.15.73:0/3407297947 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f7ec006ae40 0x7f7ec006d300 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f7ed0007fd0 tx=0x7f7ed0009040 comp rx=0 tx=0).stop 2023-12-12T09:45:52.199 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:52.197+0000 7f7ee19ae640 1 -- 172.21.15.73:0/3407297947 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7edc1543d0 msgr2=0x7f7edc150200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:52.199 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:52.197+0000 7f7ee19ae640 1 --2- 172.21.15.73:0/3407297947 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7edc1543d0 0x7f7edc150200 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f7ed4009d90 tx=0x7f7ed4004a40 comp rx=0 tx=0).stop 2023-12-12T09:45:52.199 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:52.197+0000 7f7ee19ae640 1 -- 172.21.15.73:0/3407297947 shutdown_connections 2023-12-12T09:45:52.199 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:52.197+0000 7f7ee19ae640 1 --2- 172.21.15.73:0/3407297947 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f7ec006ae40 0x7f7ec006d300 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:52.199 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:52.197+0000 7f7ee19ae640 1 --2- 172.21.15.73:0/3407297947 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7edc1543d0 0x7f7edc150200 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:52.199 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:52.197+0000 7f7ee19ae640 1 --2- 172.21.15.73:0/3407297947 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7edc1519d0 0x7f7edc1ea300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:52.199 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:52.197+0000 7f7ee19ae640 1 --2- 172.21.15.73:0/3407297947 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7edc06c420 0x7f7edc1483f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:52.200 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:52.198+0000 7f7ee19ae640 1 -- 172.21.15.73:0/3407297947 >> 172.21.15.73:0/3407297947 conn(0x7f7edc072030 msgr2=0x7f7edc0ab790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:45:52.200 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:52.198+0000 7f7ee19ae640 1 -- 172.21.15.73:0/3407297947 shutdown_connections 2023-12-12T09:45:52.200 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:52.198+0000 7f7ee19ae640 1 -- 172.21.15.73:0/3407297947 wait complete. 2023-12-12T09:45:52.216 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_metadata pg_num 2023-12-12T09:45:52.425 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:52.424+0000 7f41f2f5a640 1 Processor -- start 2023-12-12T09:45:52.426 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:52.424+0000 7f41f2f5a640 1 -- start start 2023-12-12T09:45:52.428 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:52.426+0000 7f41f2f5a640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f41ec0a4c90 0x7f41ec0c5420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:52.428 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:52.426+0000 7f41f2f5a640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41ec0c3390 con 0x7f41ec14ea60 2023-12-12T09:45:52.428 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:52.426+0000 7f41f2f5a640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41ec0c4b30 con 0x7f41ec0c0320 2023-12-12T09:45:52.428 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:52.426+0000 7f41f2f5a640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41ec0c0750 con 0x7f41ec0a4c90 2023-12-12T09:45:52.428 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:52.426+0000 7f41f0cf6640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f41ec14ea60 0x7f41ec0c4420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:55820/0 (socket says 172.21.15.73:55820) 2023-12-12T09:45:52.428 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:52.426+0000 7f41f0cf6640 1 -- 172.21.15.73:0/1247093944 learned_addr learned my addr 172.21.15.73:0/1247093944 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-12T09:45:52.428 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:52.426+0000 7f41ebfff640 1 --2- 172.21.15.73:0/1247093944 >> v2:172.21.15.73:3300/0 conn(0x7f41ec0a4c90 0x7f41ec0c5420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:52.428 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:52.427+0000 7f41ebfff640 1 -- 172.21.15.73:0/1247093944 >> v1:172.21.15.142:6789/0 conn(0x7f41ec0c0320 legacy=0x7f41ec0c20b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:45:52.428 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:52.427+0000 7f41ebfff640 1 -- 172.21.15.73:0/1247093944 >> v1:172.21.15.73:6789/0 conn(0x7f41ec14ea60 legacy=0x7f41ec0c4420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:52.429 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:52.427+0000 7f41ebfff640 1 -- 172.21.15.73:0/1247093944 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41ec151e60 con 0x7f41ec0a4c90 2023-12-12T09:45:52.429 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:52.428+0000 7f41ebfff640 1 --2- 172.21.15.73:0/1247093944 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f41ec0a4c90 0x7f41ec0c5420 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f41d80097a0 tx=0x7f41d802b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c74b63b82fd5581a server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:45:52.429 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:52.428+0000 7f41eb7fe640 1 -- 172.21.15.73:0/1247093944 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41d802e070 con 0x7f41ec0a4c90 2023-12-12T09:45:52.429 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:52.428+0000 7f41eb7fe640 1 -- 172.21.15.73:0/1247093944 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41d80315a0 con 0x7f41ec0a4c90 2023-12-12T09:45:52.429 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:52.428+0000 7f41eb7fe640 1 -- 172.21.15.73:0/1247093944 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41d8031930 con 0x7f41ec0a4c90 2023-12-12T09:45:52.430 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:52.429+0000 7f41f2f5a640 1 -- 172.21.15.73:0/1247093944 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f41ec0a4c90 msgr2=0x7f41ec0c5420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:52.430 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:52.429+0000 7f41f2f5a640 1 --2- 172.21.15.73:0/1247093944 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f41ec0a4c90 0x7f41ec0c5420 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f41d80097a0 tx=0x7f41d802b840 comp rx=0 tx=0).stop 2023-12-12T09:45:52.430 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:52.429+0000 7f41f2f5a640 1 -- 172.21.15.73:0/1247093944 shutdown_connections 2023-12-12T09:45:52.430 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:52.429+0000 7f41f2f5a640 1 --2- 172.21.15.73:0/1247093944 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f41ec0a4c90 0x7f41ec0c5420 unknown :-1 s=CLOSED pgs=716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:52.430 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:52.429+0000 7f41f2f5a640 1 -- 172.21.15.73:0/1247093944 >> 172.21.15.73:0/1247093944 conn(0x7f41ec06a4e0 msgr2=0x7f41ec06a8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:45:52.431 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:52.429+0000 7f41f2f5a640 1 -- 172.21.15.73:0/1247093944 shutdown_connections 2023-12-12T09:45:52.431 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:52.429+0000 7f41f2f5a640 1 -- 172.21.15.73:0/1247093944 wait complete. 2023-12-12T09:45:52.432 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:52.431+0000 7f41f2f5a640 1 Processor -- start 2023-12-12T09:45:52.432 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:52.431+0000 7f41f2f5a640 1 -- start start 2023-12-12T09:45:52.434 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:52.432+0000 7f41f2f5a640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f41ec0a4c90 0x7f41ec1dda40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:52.434 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:52.432+0000 7f41f2f5a640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f41ec0c0320 0x7f41ec1e9d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:52.434 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:52.432+0000 7f41f2f5a640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f41ec14ea60 0x7f41ec1ea240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:52.434 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:52.432+0000 7f41f2f5a640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41ec1ede60 con 0x7f41ec0a4c90 2023-12-12T09:45:52.434 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:52.432+0000 7f41f2f5a640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41ec1ed250 con 0x7f41ec14ea60 2023-12-12T09:45:52.434 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:52.432+0000 7f41f2f5a640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41ec1ed530 con 0x7f41ec0c0320 2023-12-12T09:45:52.434 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:52.432+0000 7f41f0cf6640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f41ec0a4c90 0x7f41ec1dda40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:52.434 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:52.432+0000 7f41f0cf6640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f41ec0a4c90 0x7f41ec1dda40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:48724/0 (socket says 172.21.15.73:48724) 2023-12-12T09:45:52.434 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:52.432+0000 7f41f0cf6640 1 -- 172.21.15.73:0/1830480887 learned_addr learned my addr 172.21.15.73:0/1830480887 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:45:52.434 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:52.432+0000 7f41f0cf6640 1 -- 172.21.15.73:0/1830480887 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f41ec0c0320 msgr2=0x7f41ec1e9d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:52.435 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:52.432+0000 7f41f0cf6640 1 --2- 172.21.15.73:0/1830480887 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f41ec0c0320 0x7f41ec1e9d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:52.435 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:52.432+0000 7f41f0cf6640 1 -- 172.21.15.73:0/1830480887 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f41ec14ea60 msgr2=0x7f41ec1ea240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:52.435 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:52.432+0000 7f41f14f7640 1 --2- 172.21.15.73:0/1830480887 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f41ec14ea60 0x7f41ec1ea240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:52.435 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:52.432+0000 7f41f0cf6640 1 --2- 172.21.15.73:0/1830480887 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f41ec14ea60 0x7f41ec1ea240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:52.435 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:52.432+0000 7f41f0cf6640 1 -- 172.21.15.73:0/1830480887 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41d8009400 con 0x7f41ec0a4c90 2023-12-12T09:45:52.435 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:52.433+0000 7f41f14f7640 1 --2- 172.21.15.73:0/1830480887 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f41ec14ea60 0x7f41ec1ea240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:45:52.435 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:52.433+0000 7f41f0cf6640 1 --2- 172.21.15.73:0/1830480887 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f41ec0a4c90 0x7f41ec1dda40 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f41e000c480 tx=0x7f41e000c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:45:52.436 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:52.433+0000 7f41e97fa640 1 -- 172.21.15.73:0/1830480887 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41e0005ce0 con 0x7f41ec0a4c90 2023-12-12T09:45:52.436 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:52.433+0000 7f41e97fa640 1 -- 172.21.15.73:0/1830480887 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41e0005e40 con 0x7f41ec0a4c90 2023-12-12T09:45:52.436 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:52.433+0000 7f41e97fa640 1 -- 172.21.15.73:0/1830480887 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41e00072d0 con 0x7f41ec0a4c90 2023-12-12T09:45:52.436 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:52.433+0000 7f41f2f5a640 1 -- 172.21.15.73:0/1830480887 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41ec1ed810 con 0x7f41ec0a4c90 2023-12-12T09:45:52.436 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:52.433+0000 7f41f2f5a640 1 -- 172.21.15.73:0/1830480887 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41ec1ddf80 con 0x7f41ec0a4c90 2023-12-12T09:45:52.436 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:52.434+0000 7f41f2f5a640 1 -- 172.21.15.73:0/1830480887 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f41ec067070 con 0x7f41ec0a4c90 2023-12-12T09:45:52.436 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:52.435+0000 7f41e97fa640 1 -- 172.21.15.73:0/1830480887 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f41e00074f0 con 0x7f41ec0a4c90 2023-12-12T09:45:52.437 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:52.436+0000 7f41e97fa640 1 --2- 172.21.15.73:0/1830480887 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f41d006ae40 0x7f41d006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:52.438 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:52.436+0000 7f41e97fa640 1 -- 172.21.15.73:0/1830480887 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f41e0088b00 con 0x7f41ec0a4c90 2023-12-12T09:45:52.438 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:52.436+0000 7f41ebfff640 1 --2- 172.21.15.73:0/1830480887 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f41d006ae40 0x7f41d006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:52.438 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:52.437+0000 7f41ebfff640 1 --2- 172.21.15.73:0/1830480887 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f41d006ae40 0x7f41d006d300 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f41d8036000 tx=0x7f41d8030000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:45:52.442 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:52.441+0000 7f41e97fa640 1 -- 172.21.15.73:0/1830480887 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f41e008ae60 con 0x7f41ec0a4c90 2023-12-12T09:45:52.631 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:52.630+0000 7f41f2f5a640 1 -- 172.21.15.73:0/1830480887 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"} v 0) v1 -- 0x7f41ec067580 con 0x7f41ec0a4c90 2023-12-12T09:45:52.632 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:52.630+0000 7f41e97fa640 1 -- 172.21.15.73:0/1830480887 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"}]=0 v58) v1 ==== 105+0+11 (secure 0 0 0) 0x7f41e00180b0 con 0x7f41ec0a4c90 2023-12-12T09:45:52.632 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 32 2023-12-12T09:45:52.635 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:52.633+0000 7f41f2f5a640 1 -- 172.21.15.73:0/1830480887 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f41d006ae40 msgr2=0x7f41d006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:52.635 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:52.633+0000 7f41f2f5a640 1 --2- 172.21.15.73:0/1830480887 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f41d006ae40 0x7f41d006d300 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f41d8036000 tx=0x7f41d8030000 comp rx=0 tx=0).stop 2023-12-12T09:45:52.635 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:52.633+0000 7f41f2f5a640 1 -- 172.21.15.73:0/1830480887 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f41ec0a4c90 msgr2=0x7f41ec1dda40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:52.635 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:52.633+0000 7f41f2f5a640 1 --2- 172.21.15.73:0/1830480887 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f41ec0a4c90 0x7f41ec1dda40 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f41e000c480 tx=0x7f41e000c940 comp rx=0 tx=0).stop 2023-12-12T09:45:52.635 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:52.633+0000 7f41f2f5a640 1 -- 172.21.15.73:0/1830480887 shutdown_connections 2023-12-12T09:45:52.635 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:52.633+0000 7f41f2f5a640 1 --2- 172.21.15.73:0/1830480887 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f41d006ae40 0x7f41d006d300 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:52.635 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:52.633+0000 7f41f2f5a640 1 --2- 172.21.15.73:0/1830480887 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f41ec14ea60 0x7f41ec1ea240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:52.635 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:52.633+0000 7f41f2f5a640 1 --2- 172.21.15.73:0/1830480887 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f41ec0c0320 0x7f41ec1e9d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:52.635 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:52.633+0000 7f41f2f5a640 1 --2- 172.21.15.73:0/1830480887 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f41ec0a4c90 0x7f41ec1dda40 unknown :-1 s=CLOSED pgs=717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:52.636 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:52.633+0000 7f41f2f5a640 1 -- 172.21.15.73:0/1830480887 >> 172.21.15.73:0/1830480887 conn(0x7f41ec06a4e0 msgr2=0x7f41ec0c4420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:45:52.636 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:52.634+0000 7f41f2f5a640 1 -- 172.21.15.73:0/1830480887 shutdown_connections 2023-12-12T09:45:52.636 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:52.634+0000 7f41f2f5a640 1 -- 172.21.15.73:0/1830480887 wait complete. 2023-12-12T09:45:52.654 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_data pg_num 2023-12-12T09:45:52.864 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:52.862+0000 7fa764690640 1 Processor -- start 2023-12-12T09:45:52.864 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:52.862+0000 7fa764690640 1 -- start start 2023-12-12T09:45:52.865 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:52.864+0000 7fa764690640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fa75c06da30 0x7fa75c06deb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:52.865 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:52.864+0000 7fa764690640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fa75c0c2fa0 0x7fa75c0c33d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:52.866 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:52.864+0000 7fa764690640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa75c153260 con 0x7fa75c14c520 2023-12-12T09:45:52.866 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:52.864+0000 7fa764690640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa75c1524a0 con 0x7fa75c06da30 2023-12-12T09:45:52.866 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:52.864+0000 7fa764690640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa75c152780 con 0x7fa75c0c2fa0 2023-12-12T09:45:52.866 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:52.864+0000 7fa761c2b640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fa75c06da30 0x7fa75c06deb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:52.866 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:52.864+0000 7fa761c2b640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fa75c06da30 0x7fa75c06deb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:48740/0 (socket says 172.21.15.73:48740) 2023-12-12T09:45:52.866 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:52.864+0000 7fa761c2b640 1 -- 172.21.15.73:0/3364302952 learned_addr learned my addr 172.21.15.73:0/3364302952 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:45:52.867 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:52.865+0000 7fa761c2b640 1 -- 172.21.15.73:0/3364302952 >> v2:172.21.15.142:3300/0 conn(0x7fa75c0c2fa0 msgr2=0x7fa75c0c33d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:45:52.867 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:52.865+0000 7fa761c2b640 1 --2- 172.21.15.73:0/3364302952 >> v2:172.21.15.142:3300/0 conn(0x7fa75c0c2fa0 0x7fa75c0c33d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:52.867 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:52.865+0000 7fa761c2b640 1 -- 172.21.15.73:0/3364302952 >> v1:172.21.15.142:6789/0 conn(0x7fa75c14c520 legacy=0x7fa75c0a6cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:45:52.867 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:52.865+0000 7fa761c2b640 1 -- 172.21.15.73:0/3364302952 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa75c152a60 con 0x7fa75c06da30 2023-12-12T09:45:52.867 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:52.866+0000 7fa761c2b640 1 --2- 172.21.15.73:0/3364302952 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa75c06da30 0x7fa75c06deb0 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7fa75c06f710 tx=0x7fa75002b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4983ae4da279fc1 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:45:52.868 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:52.866+0000 7fa76142a640 1 -- 172.21.15.73:0/3364302952 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7500317e0 con 0x7fa75c06da30 2023-12-12T09:45:52.868 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:52.866+0000 7fa76142a640 1 -- 172.21.15.73:0/3364302952 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa750031940 con 0x7fa75c06da30 2023-12-12T09:45:52.868 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:52.866+0000 7fa76142a640 1 -- 172.21.15.73:0/3364302952 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa750031cd0 con 0x7fa75c06da30 2023-12-12T09:45:52.868 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:52.867+0000 7fa764690640 1 -- 172.21.15.73:0/3364302952 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa75c06da30 msgr2=0x7fa75c06deb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:52.869 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:52.867+0000 7fa764690640 1 --2- 172.21.15.73:0/3364302952 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa75c06da30 0x7fa75c06deb0 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7fa75c06f710 tx=0x7fa75002b880 comp rx=0 tx=0).stop 2023-12-12T09:45:52.869 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:52.867+0000 7fa764690640 1 -- 172.21.15.73:0/3364302952 shutdown_connections 2023-12-12T09:45:52.869 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:52.867+0000 7fa764690640 1 --2- 172.21.15.73:0/3364302952 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa75c06da30 0x7fa75c06deb0 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:52.869 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:52.867+0000 7fa764690640 1 --2- 172.21.15.73:0/3364302952 >> v2:172.21.15.142:3300/0 conn(0x7fa75c0c2fa0 0x7fa75c0c33d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:52.869 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:52.867+0000 7fa764690640 1 -- 172.21.15.73:0/3364302952 >> 172.21.15.73:0/3364302952 conn(0x7fa75c0c7ba0 msgr2=0x7fa75c0c7fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:45:52.869 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:52.867+0000 7fa764690640 1 -- 172.21.15.73:0/3364302952 shutdown_connections 2023-12-12T09:45:52.869 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:52.867+0000 7fa764690640 1 -- 172.21.15.73:0/3364302952 wait complete. 2023-12-12T09:45:52.870 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:52.869+0000 7fa764690640 1 Processor -- start 2023-12-12T09:45:52.870 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:52.869+0000 7fa764690640 1 -- start start 2023-12-12T09:45:52.872 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:52.870+0000 7fa764690640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa75c06da30 0x7fa75c147d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:52.872 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:52.870+0000 7fa764690640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa75c0c2fa0 0x7fa75c146f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:52.872 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:52.870+0000 7fa764690640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa75c14c520 0x7fa75c1e8660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:52.872 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:52.870+0000 7fa764690640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa75c1e7e80 con 0x7fa75c0c2fa0 2023-12-12T09:45:52.872 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:52.870+0000 7fa764690640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa75c0ab190 con 0x7fa75c14c520 2023-12-12T09:45:52.872 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:52.870+0000 7fa764690640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa75c0ab470 con 0x7fa75c06da30 2023-12-12T09:45:52.872 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:52.870+0000 7fa761c2b640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa75c0c2fa0 0x7fa75c146f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:52.872 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:52.870+0000 7fa761c2b640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa75c0c2fa0 0x7fa75c146f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:48754/0 (socket says 172.21.15.73:48754) 2023-12-12T09:45:52.872 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:52.870+0000 7fa761c2b640 1 -- 172.21.15.73:0/1066119903 learned_addr learned my addr 172.21.15.73:0/1066119903 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:45:52.872 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:52.870+0000 7fa761c2b640 1 -- 172.21.15.73:0/1066119903 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa75c06da30 msgr2=0x7fa75c147d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:52.873 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:52.870+0000 7fa761c2b640 1 --2- 172.21.15.73:0/1066119903 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa75c06da30 0x7fa75c147d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:52.873 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:52.870+0000 7fa761c2b640 1 -- 172.21.15.73:0/1066119903 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa75c14c520 msgr2=0x7fa75c1e8660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:52.873 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:52.870+0000 7fa761c2b640 1 --2- 172.21.15.73:0/1066119903 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa75c14c520 0x7fa75c1e8660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:52.873 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:52.870+0000 7fa761c2b640 1 -- 172.21.15.73:0/1066119903 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7500094d0 con 0x7fa75c0c2fa0 2023-12-12T09:45:52.873 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:52.871+0000 7fa761c2b640 1 --2- 172.21.15.73:0/1066119903 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa75c0c2fa0 0x7fa75c146f60 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7fa75002b8c0 tx=0x7fa7500046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:45:52.873 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:52.871+0000 7fa75affd640 1 -- 172.21.15.73:0/1066119903 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa750032940 con 0x7fa75c0c2fa0 2023-12-12T09:45:52.874 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:52.871+0000 7fa75affd640 1 -- 172.21.15.73:0/1066119903 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa750032aa0 con 0x7fa75c0c2fa0 2023-12-12T09:45:52.874 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:52.871+0000 7fa75affd640 1 -- 172.21.15.73:0/1066119903 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa750032e50 con 0x7fa75c0c2fa0 2023-12-12T09:45:52.874 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:52.871+0000 7fa764690640 1 -- 172.21.15.73:0/1066119903 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa75c0ab750 con 0x7fa75c0c2fa0 2023-12-12T09:45:52.874 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:52.871+0000 7fa764690640 1 -- 172.21.15.73:0/1066119903 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa75c1474a0 con 0x7fa75c0c2fa0 2023-12-12T09:45:52.874 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:52.872+0000 7fa764690640 1 -- 172.21.15.73:0/1066119903 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa75c1e8380 con 0x7fa75c0c2fa0 2023-12-12T09:45:52.874 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:52.873+0000 7fa75affd640 1 -- 172.21.15.73:0/1066119903 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fa75004e450 con 0x7fa75c0c2fa0 2023-12-12T09:45:52.875 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:52.874+0000 7fa75affd640 1 --2- 172.21.15.73:0/1066119903 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fa74806ae70 0x7fa74806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:52.875 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:52.874+0000 7fa75affd640 1 -- 172.21.15.73:0/1066119903 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fa7500abb90 con 0x7fa75c0c2fa0 2023-12-12T09:45:52.876 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:52.875+0000 7fa76242c640 1 --2- 172.21.15.73:0/1066119903 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fa74806ae70 0x7fa74806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:52.876 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:52.875+0000 7fa76242c640 1 --2- 172.21.15.73:0/1066119903 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fa74806ae70 0x7fa74806d330 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fa75c1e8fb0 tx=0x7fa74c007d10 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:45:52.880 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:52.879+0000 7fa75affd640 1 -- 172.21.15.73:0/1066119903 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fa75c1e8380 con 0x7fa75c0c2fa0 2023-12-12T09:45:53.056 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:53.055+0000 7fa764690640 1 -- 172.21.15.73:0/1066119903 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"} v 0) v1 -- 0x7fa75c1e8380 con 0x7fa75c0c2fa0 2023-12-12T09:45:53.057 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:53.056+0000 7fa75affd640 1 -- 172.21.15.73:0/1066119903 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"}]=0 v58) v1 ==== 101+0+11 (secure 0 0 0) 0x7fa75c1e8380 con 0x7fa75c0c2fa0 2023-12-12T09:45:53.057 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 64 2023-12-12T09:45:53.060 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:53.058+0000 7fa764690640 1 -- 172.21.15.73:0/1066119903 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fa74806ae70 msgr2=0x7fa74806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:53.060 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:53.058+0000 7fa764690640 1 --2- 172.21.15.73:0/1066119903 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fa74806ae70 0x7fa74806d330 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fa75c1e8fb0 tx=0x7fa74c007d10 comp rx=0 tx=0).stop 2023-12-12T09:45:53.060 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:53.058+0000 7fa764690640 1 -- 172.21.15.73:0/1066119903 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa75c0c2fa0 msgr2=0x7fa75c146f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:53.060 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:53.058+0000 7fa764690640 1 --2- 172.21.15.73:0/1066119903 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa75c0c2fa0 0x7fa75c146f60 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7fa75002b8c0 tx=0x7fa7500046c0 comp rx=0 tx=0).stop 2023-12-12T09:45:53.060 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:53.058+0000 7fa764690640 1 -- 172.21.15.73:0/1066119903 shutdown_connections 2023-12-12T09:45:53.060 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:53.058+0000 7fa764690640 1 --2- 172.21.15.73:0/1066119903 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fa74806ae70 0x7fa74806d330 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:53.060 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:53.058+0000 7fa764690640 1 --2- 172.21.15.73:0/1066119903 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa75c14c520 0x7fa75c1e8660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:53.060 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:53.058+0000 7fa764690640 1 --2- 172.21.15.73:0/1066119903 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa75c0c2fa0 0x7fa75c146f60 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:53.061 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:53.058+0000 7fa764690640 1 --2- 172.21.15.73:0/1066119903 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa75c06da30 0x7fa75c147d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:53.061 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:53.058+0000 7fa764690640 1 -- 172.21.15.73:0/1066119903 >> 172.21.15.73:0/1066119903 conn(0x7fa75c0c7ba0 msgr2=0x7fa75c0c4620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:45:53.061 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:53.058+0000 7fa764690640 1 -- 172.21.15.73:0/1066119903 shutdown_connections 2023-12-12T09:45:53.061 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:53.058+0000 7fa764690640 1 -- 172.21.15.73:0/1066119903 wait complete. 2023-12-12T09:45:53.078 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-12T09:45:53.279 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:53.278+0000 7f32df933640 1 Processor -- start 2023-12-12T09:45:53.280 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:53.278+0000 7f32df933640 1 -- start start 2023-12-12T09:45:53.281 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:53.279+0000 7f32df933640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f32d80c1a60 0x7f32d8151b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:53.281 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:53.280+0000 7f32df933640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32d81589a0 con 0x7f32d80a4f40 2023-12-12T09:45:53.281 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:53.280+0000 7f32df933640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32d8157d90 con 0x7f32d80c4c10 2023-12-12T09:45:53.281 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:53.280+0000 7f32df933640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32d806c120 con 0x7f32d80c1a60 2023-12-12T09:45:53.281 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:53.280+0000 7f32dcece640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f32d80a4f40 0x7f32d8154860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:55828/0 (socket says 172.21.15.73:55828) 2023-12-12T09:45:53.282 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:53.280+0000 7f32dd6cf640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f32d80c1a60 0x7f32d8151b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:53.282 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:53.280+0000 7f32dcece640 1 -- 172.21.15.73:0/2559016038 learned_addr learned my addr 172.21.15.73:0/2559016038 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-12T09:45:53.282 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:53.280+0000 7f32cffff640 1 -- 172.21.15.73:0/2559016038 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3014919283 0 0) 0x7f32d81589a0 con 0x7f32d80a4f40 2023-12-12T09:45:53.282 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:53.281+0000 7f32cffff640 1 -- 172.21.15.73:0/2559016038 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f32c4003520 con 0x7f32d80a4f40 2023-12-12T09:45:53.282 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:53.281+0000 7f32dd6cf640 1 -- 172.21.15.73:0/2559016038 >> v1:172.21.15.142:6789/0 conn(0x7f32d80c4c10 legacy=0x7f32d8154f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:45:53.283 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:53.281+0000 7f32dd6cf640 1 -- 172.21.15.73:0/2559016038 >> v1:172.21.15.73:6789/0 conn(0x7f32d80a4f40 legacy=0x7f32d8154860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:53.283 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:53.281+0000 7f32dd6cf640 1 -- 172.21.15.73:0/2559016038 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32d8158070 con 0x7f32d80c1a60 2023-12-12T09:45:53.283 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:53.282+0000 7f32dd6cf640 1 --2- 172.21.15.73:0/2559016038 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f32d80c1a60 0x7f32d8151b20 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f32d40097a0 tx=0x7f32d402b7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1cdc2ae901c451a server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:45:53.283 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:53.282+0000 7f32cffff640 1 -- 172.21.15.73:0/2559016038 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32d402f050 con 0x7f32d80c1a60 2023-12-12T09:45:53.284 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:53.282+0000 7f32cffff640 1 -- 172.21.15.73:0/2559016038 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32d4031700 con 0x7f32d80c1a60 2023-12-12T09:45:53.284 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:53.282+0000 7f32cffff640 1 -- 172.21.15.73:0/2559016038 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32d4031a90 con 0x7f32d80c1a60 2023-12-12T09:45:53.284 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:53.283+0000 7f32df933640 1 -- 172.21.15.73:0/2559016038 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f32d80c1a60 msgr2=0x7f32d8151b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:53.284 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:53.283+0000 7f32df933640 1 --2- 172.21.15.73:0/2559016038 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f32d80c1a60 0x7f32d8151b20 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f32d40097a0 tx=0x7f32d402b7a0 comp rx=0 tx=0).stop 2023-12-12T09:45:53.285 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:53.283+0000 7f32df933640 1 -- 172.21.15.73:0/2559016038 shutdown_connections 2023-12-12T09:45:53.285 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:53.283+0000 7f32df933640 1 --2- 172.21.15.73:0/2559016038 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f32d80c1a60 0x7f32d8151b20 unknown :-1 s=CLOSED pgs=721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:53.285 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:53.283+0000 7f32df933640 1 -- 172.21.15.73:0/2559016038 >> 172.21.15.73:0/2559016038 conn(0x7f32d80a77d0 msgr2=0x7f32d80a7bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:45:53.285 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:53.283+0000 7f32df933640 1 -- 172.21.15.73:0/2559016038 shutdown_connections 2023-12-12T09:45:53.285 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:53.283+0000 7f32df933640 1 -- 172.21.15.73:0/2559016038 wait complete. 2023-12-12T09:45:53.286 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:53.284+0000 7f32df933640 1 Processor -- start 2023-12-12T09:45:53.286 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:53.285+0000 7f32df933640 1 -- start start 2023-12-12T09:45:53.287 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:53.285+0000 7f32df933640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f32d80a4f40 0x7f32d80ab670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:53.287 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:53.285+0000 7f32df933640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f32d80c1a60 0x7f32d80706a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:53.287 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:53.285+0000 7f32df933640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f32d80c4c10 0x7f32d80c29b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:53.287 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:53.285+0000 7f32df933640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32d8070ed0 con 0x7f32d80a4f40 2023-12-12T09:45:53.287 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:53.285+0000 7f32df933640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32d8071410 con 0x7f32d80c1a60 2023-12-12T09:45:53.287 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:53.285+0000 7f32df933640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32d80716f0 con 0x7f32d80c4c10 2023-12-12T09:45:53.287 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:53.286+0000 7f32dd6cf640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f32d80a4f40 0x7f32d80ab670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:53.287 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:53.286+0000 7f32dd6cf640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f32d80a4f40 0x7f32d80ab670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:48774/0 (socket says 172.21.15.73:48774) 2023-12-12T09:45:53.288 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:53.286+0000 7f32dd6cf640 1 -- 172.21.15.73:0/1778081085 learned_addr learned my addr 172.21.15.73:0/1778081085 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:45:53.289 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:53.286+0000 7f32dd6cf640 1 -- 172.21.15.73:0/1778081085 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f32d80c4c10 msgr2=0x7f32d80c29b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:53.289 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:53.286+0000 7f32dd6cf640 1 --2- 172.21.15.73:0/1778081085 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f32d80c4c10 0x7f32d80c29b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:53.289 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:53.286+0000 7f32dd6cf640 1 -- 172.21.15.73:0/1778081085 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f32d80c1a60 msgr2=0x7f32d80706a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:53.289 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:53.286+0000 7f32dd6cf640 1 --2- 172.21.15.73:0/1778081085 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f32d80c1a60 0x7f32d80706a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:53.289 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:53.286+0000 7f32dd6cf640 1 -- 172.21.15.73:0/1778081085 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32d4009400 con 0x7f32d80a4f40 2023-12-12T09:45:53.289 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:53.286+0000 7f32dd6cf640 1 --2- 172.21.15.73:0/1778081085 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f32d80a4f40 0x7f32d80ab670 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f32d4000c00 tx=0x7f32d40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:45:53.289 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:53.287+0000 7f32cdffb640 1 -- 172.21.15.73:0/1778081085 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32d40339b0 con 0x7f32d80a4f40 2023-12-12T09:45:53.289 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:53.287+0000 7f32cdffb640 1 -- 172.21.15.73:0/1778081085 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32d4033b10 con 0x7f32d80a4f40 2023-12-12T09:45:53.289 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:53.287+0000 7f32cdffb640 1 -- 172.21.15.73:0/1778081085 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32d403c400 con 0x7f32d80a4f40 2023-12-12T09:45:53.290 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:53.287+0000 7f32df933640 1 -- 172.21.15.73:0/1778081085 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32d80719d0 con 0x7f32d80a4f40 2023-12-12T09:45:53.290 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:53.287+0000 7f32df933640 1 -- 172.21.15.73:0/1778081085 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32d8070be0 con 0x7f32d80a4f40 2023-12-12T09:45:53.290 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:53.288+0000 7f32df933640 1 -- 172.21.15.73:0/1778081085 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f32d8071ef0 con 0x7f32d80a4f40 2023-12-12T09:45:53.290 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:53.289+0000 7f32cdffb640 1 -- 172.21.15.73:0/1778081085 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f32d403a040 con 0x7f32d80a4f40 2023-12-12T09:45:53.291 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:53.290+0000 7f32cdffb640 1 --2- 172.21.15.73:0/1778081085 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f32bc06ae70 0x7f32bc06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:53.292 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:53.290+0000 7f32cdffb640 1 -- 172.21.15.73:0/1778081085 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f32d40ab270 con 0x7f32d80a4f40 2023-12-12T09:45:53.292 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:53.290+0000 7f32dcece640 1 --2- 172.21.15.73:0/1778081085 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f32bc06ae70 0x7f32bc06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:53.293 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:53.291+0000 7f32dcece640 1 --2- 172.21.15.73:0/1778081085 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f32bc06ae70 0x7f32bc06d330 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f32d80abbb0 tx=0x7f32c8007930 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:45:53.296 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:53.294+0000 7f32cdffb640 1 -- 172.21.15.73:0/1778081085 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f32d4075fb0 con 0x7f32d80a4f40 2023-12-12T09:45:53.499 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:53.498+0000 7f32df933640 1 -- 172.21.15.73:0/1778081085 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f32d8067580 con 0x7f32d80a4f40 2023-12-12T09:45:53.501 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:53.499+0000 7f32cdffb640 1 -- 172.21.15.73:0/1778081085 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v58) v1 ==== 80+0+0 (secure 0 0 0) 0x7f32d40795d0 con 0x7f32d80a4f40 2023-12-12T09:45:53.501 INFO:teuthology.orchestra.run.smithi073.stderr:listed 0 entries 2023-12-12T09:45:53.503 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:53.501+0000 7f32df933640 1 -- 172.21.15.73:0/1778081085 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f32bc06ae70 msgr2=0x7f32bc06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:53.503 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:53.501+0000 7f32df933640 1 --2- 172.21.15.73:0/1778081085 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f32bc06ae70 0x7f32bc06d330 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f32d80abbb0 tx=0x7f32c8007930 comp rx=0 tx=0).stop 2023-12-12T09:45:53.503 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:53.501+0000 7f32df933640 1 -- 172.21.15.73:0/1778081085 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f32d80a4f40 msgr2=0x7f32d80ab670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:53.504 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:53.501+0000 7f32df933640 1 --2- 172.21.15.73:0/1778081085 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f32d80a4f40 0x7f32d80ab670 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f32d4000c00 tx=0x7f32d40046c0 comp rx=0 tx=0).stop 2023-12-12T09:45:53.504 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:53.502+0000 7f32df933640 1 -- 172.21.15.73:0/1778081085 shutdown_connections 2023-12-12T09:45:53.504 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:53.502+0000 7f32df933640 1 --2- 172.21.15.73:0/1778081085 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f32bc06ae70 0x7f32bc06d330 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:53.504 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:53.502+0000 7f32df933640 1 --2- 172.21.15.73:0/1778081085 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f32d80c4c10 0x7f32d80c29b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:53.504 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:53.502+0000 7f32df933640 1 --2- 172.21.15.73:0/1778081085 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f32d80c1a60 0x7f32d80706a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:53.504 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:53.502+0000 7f32df933640 1 --2- 172.21.15.73:0/1778081085 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f32d80a4f40 0x7f32d80ab670 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:53.504 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:53.502+0000 7f32df933640 1 -- 172.21.15.73:0/1778081085 >> 172.21.15.73:0/1778081085 conn(0x7f32d80a77d0 msgr2=0x7f32d806dd60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:45:53.504 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:53.502+0000 7f32df933640 1 -- 172.21.15.73:0/1778081085 shutdown_connections 2023-12-12T09:45:53.504 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:53.502+0000 7f32df933640 1 -- 172.21.15.73:0/1778081085 wait complete. 2023-12-12T09:45:53.520 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-12-12T09:45:53.520 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T09:45:53.521 DEBUG:teuthology.orchestra.run.smithi073:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-12-12T09:45:53.619 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi073.front.sepia.ceph.com 2023-12-12T09:45:53.619 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T09:45:53.620 DEBUG:teuthology.orchestra.run.smithi073:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-12-12T09:45:53.672 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2023-12-12T09:45:53.673 DEBUG:teuthology.orchestra.run.smithi073:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-12T09:45:53.720 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054284,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498800k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249396k,nr_inodes=812349,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498800k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 2023-12-12T09:45:53.720 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-12-12T09:45:53.976 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:53.974+0000 7f4c4d32c640 1 Processor -- start 2023-12-12T09:45:53.976 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:53.975+0000 7f4c4d32c640 1 -- start start 2023-12-12T09:45:53.977 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:53.976+0000 7f4c4d32c640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f4c480722c0 0x7f4c480a4d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:53.977 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:53.976+0000 7f4c4d32c640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f4c4806bf20 0x7f4c48150200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:53.977 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:53.976+0000 7f4c4d32c640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c4806c3b0 con 0x7f4c4806e060 2023-12-12T09:45:53.977 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:53.976+0000 7f4c4d32c640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c48072120 con 0x7f4c480722c0 2023-12-12T09:45:53.977 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:53.976+0000 7f4c4d32c640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c48150740 con 0x7f4c4806bf20 2023-12-12T09:45:53.979 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:53.976+0000 7f4c467fc640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f4c480722c0 0x7f4c480a4d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:53.979 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:53.976+0000 7f4c467fc640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f4c480722c0 0x7f4c480a4d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:48790/0 (socket says 172.21.15.73:48790) 2023-12-12T09:45:53.979 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:53.976+0000 7f4c467fc640 1 -- 172.21.15.73:0/1171690770 learned_addr learned my addr 172.21.15.73:0/1171690770 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:45:53.979 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:53.977+0000 7f4c477fe640 1 --2- 172.21.15.73:0/1171690770 >> v2:172.21.15.142:3300/0 conn(0x7f4c4806bf20 0x7f4c48150200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:53.979 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:53.977+0000 7f4c467fc640 1 -- 172.21.15.73:0/1171690770 >> v2:172.21.15.142:3300/0 conn(0x7f4c4806bf20 msgr2=0x7f4c48150200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:45:53.979 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:53.977+0000 7f4c467fc640 1 --2- 172.21.15.73:0/1171690770 >> v2:172.21.15.142:3300/0 conn(0x7f4c4806bf20 0x7f4c48150200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:53.979 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:53.977+0000 7f4c467fc640 1 -- 172.21.15.73:0/1171690770 >> v1:172.21.15.142:6789/0 conn(0x7f4c4806e060 legacy=0x7f4c480c5130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:45:53.979 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:53.977+0000 7f4c467fc640 1 -- 172.21.15.73:0/1171690770 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c480c0830 con 0x7f4c480722c0 2023-12-12T09:45:53.980 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:53.978+0000 7f4c467fc640 1 --2- 172.21.15.73:0/1171690770 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4c480722c0 0x7f4c480a4d20 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f4c480c0250 tx=0x7f4c3c02b7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb57889ef23aaee9 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:45:53.980 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:53.978+0000 7f4c45ffb640 1 -- 172.21.15.73:0/1171690770 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c3c031750 con 0x7f4c480722c0 2023-12-12T09:45:53.980 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:53.978+0000 7f4c45ffb640 1 -- 172.21.15.73:0/1171690770 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c3c0318b0 con 0x7f4c480722c0 2023-12-12T09:45:53.980 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:53.978+0000 7f4c45ffb640 1 -- 172.21.15.73:0/1171690770 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c3c031c40 con 0x7f4c480722c0 2023-12-12T09:45:53.981 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:53.979+0000 7f4c4d32c640 1 -- 172.21.15.73:0/1171690770 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4c480722c0 msgr2=0x7f4c480a4d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:53.981 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:53.979+0000 7f4c4d32c640 1 --2- 172.21.15.73:0/1171690770 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4c480722c0 0x7f4c480a4d20 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f4c480c0250 tx=0x7f4c3c02b7f0 comp rx=0 tx=0).stop 2023-12-12T09:45:53.981 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:53.979+0000 7f4c4d32c640 1 -- 172.21.15.73:0/1171690770 shutdown_connections 2023-12-12T09:45:53.981 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:53.979+0000 7f4c4d32c640 1 --2- 172.21.15.73:0/1171690770 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4c480722c0 0x7f4c480a4d20 unknown :-1 s=CLOSED pgs=723 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:53.981 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:53.979+0000 7f4c4d32c640 1 --2- 172.21.15.73:0/1171690770 >> v2:172.21.15.142:3300/0 conn(0x7f4c4806bf20 0x7f4c48150200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:53.981 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:53.979+0000 7f4c4d32c640 1 -- 172.21.15.73:0/1171690770 >> 172.21.15.73:0/1171690770 conn(0x7f4c480a8130 msgr2=0x7f4c480c24b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:45:53.981 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:53.979+0000 7f4c4d32c640 1 -- 172.21.15.73:0/1171690770 shutdown_connections 2023-12-12T09:45:53.981 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:53.979+0000 7f4c4d32c640 1 -- 172.21.15.73:0/1171690770 wait complete. 2023-12-12T09:45:53.982 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:53.981+0000 7f4c4d32c640 1 Processor -- start 2023-12-12T09:45:53.982 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:53.981+0000 7f4c4d32c640 1 -- start start 2023-12-12T09:45:53.985 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:53.982+0000 7f4c4d32c640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4c4806bf20 0x7f4c481eae20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:53.986 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:53.982+0000 7f4c4d32c640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4c4806e060 0x7f4c4813aa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:53.986 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:53.982+0000 7f4c4d32c640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4c480722c0 0x7f4c48070150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:53.986 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:53.982+0000 7f4c4d32c640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c4806fcc0 con 0x7f4c4806e060 2023-12-12T09:45:53.986 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:53.982+0000 7f4c4d32c640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c481e9460 con 0x7f4c480722c0 2023-12-12T09:45:53.986 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:53.982+0000 7f4c4d32c640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c480aa890 con 0x7f4c4806bf20 2023-12-12T09:45:53.986 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:53.983+0000 7f4c467fc640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4c4806e060 0x7f4c4813aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:53.986 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:53.983+0000 7f4c467fc640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4c4806e060 0x7f4c4813aa30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:48802/0 (socket says 172.21.15.73:48802) 2023-12-12T09:45:53.986 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:53.983+0000 7f4c467fc640 1 -- 172.21.15.73:0/49802844 learned_addr learned my addr 172.21.15.73:0/49802844 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:45:53.986 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:53.983+0000 7f4c477fe640 1 --2- 172.21.15.73:0/49802844 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4c480722c0 0x7f4c48070150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:53.986 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:53.983+0000 7f4c46ffd640 1 --2- 172.21.15.73:0/49802844 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4c4806bf20 0x7f4c481eae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:53.986 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:53.983+0000 7f4c467fc640 1 -- 172.21.15.73:0/49802844 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4c4806bf20 msgr2=0x7f4c481eae20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:53.986 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:53.983+0000 7f4c467fc640 1 --2- 172.21.15.73:0/49802844 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4c4806bf20 0x7f4c481eae20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:53.986 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:53.983+0000 7f4c467fc640 1 -- 172.21.15.73:0/49802844 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4c480722c0 msgr2=0x7f4c48070150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:53.987 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:53.983+0000 7f4c467fc640 1 --2- 172.21.15.73:0/49802844 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4c480722c0 0x7f4c48070150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:53.987 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:53.983+0000 7f4c467fc640 1 -- 172.21.15.73:0/49802844 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c3c0094d0 con 0x7f4c4806e060 2023-12-12T09:45:53.987 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:53.984+0000 7f4c467fc640 1 --2- 172.21.15.73:0/49802844 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4c4806e060 0x7f4c4813aa30 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f4c3c02b830 tx=0x7f4c3c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:45:53.987 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:53.984+0000 7f4c2f7fe640 1 -- 172.21.15.73:0/49802844 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c3c033c80 con 0x7f4c4806e060 2023-12-12T09:45:53.987 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:53.984+0000 7f4c2f7fe640 1 -- 172.21.15.73:0/49802844 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c3c033de0 con 0x7f4c4806e060 2023-12-12T09:45:53.987 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:53.984+0000 7f4c2f7fe640 1 -- 172.21.15.73:0/49802844 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c3c03c620 con 0x7f4c4806e060 2023-12-12T09:45:53.987 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:53.984+0000 7f4c4d32c640 1 -- 172.21.15.73:0/49802844 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c48071090 con 0x7f4c4806e060 2023-12-12T09:45:53.987 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:53.984+0000 7f4c4d32c640 1 -- 172.21.15.73:0/49802844 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c48071650 con 0x7f4c4806e060 2023-12-12T09:45:53.988 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:53.985+0000 7f4c4d32c640 1 -- 172.21.15.73:0/49802844 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c4806b400 con 0x7f4c4806e060 2023-12-12T09:45:53.988 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:53.986+0000 7f4c2f7fe640 1 -- 172.21.15.73:0/49802844 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f4c3c03a040 con 0x7f4c4806e060 2023-12-12T09:45:53.988 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:53.987+0000 7f4c2f7fe640 1 --2- 172.21.15.73:0/49802844 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f4c3406ae40 0x7f4c3406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:53.988 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:53.987+0000 7f4c2f7fe640 1 -- 172.21.15.73:0/49802844 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f4c3c0ab5f0 con 0x7f4c4806e060 2023-12-12T09:45:53.989 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:53.987+0000 7f4c46ffd640 1 --2- 172.21.15.73:0/49802844 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f4c3406ae40 0x7f4c3406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:53.989 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:53.988+0000 7f4c46ffd640 1 --2- 172.21.15.73:0/49802844 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f4c3406ae40 0x7f4c3406d300 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f4c3800a750 tx=0x7f4c38008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:45:53.993 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:53.992+0000 7f4c2f7fe640 1 -- 172.21.15.73:0/49802844 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f4c3c076330 con 0x7f4c4806e060 2023-12-12T09:45:54.221 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:54.220+0000 7f4c4d32c640 1 -- 172.21.15.73:0/49802844 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f4c4814ee50 con 0x7f4c4806e060 2023-12-12T09:45:54.222 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:54.220+0000 7f4c2f7fe640 1 -- 172.21.15.73:0/49802844 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v35) v1 ==== 53+0+149 (secure 0 0 0) 0x7f4c3c079950 con 0x7f4c4806e060 2023-12-12T09:45:54.222 INFO:teuthology.orchestra.run.smithi073.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-12-12T09:45:54.222 INFO:teuthology.orchestra.run.smithi073.stdout:name: cephfs2, metadata pool: cephfs2_metadata, data pools: [cephfs2_data ] 2023-12-12T09:45:54.225 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:54.224+0000 7f4c4d32c640 1 -- 172.21.15.73:0/49802844 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f4c3406ae40 msgr2=0x7f4c3406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:54.226 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:54.224+0000 7f4c4d32c640 1 --2- 172.21.15.73:0/49802844 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f4c3406ae40 0x7f4c3406d300 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f4c3800a750 tx=0x7f4c38008040 comp rx=0 tx=0).stop 2023-12-12T09:45:54.226 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:54.224+0000 7f4c4d32c640 1 -- 172.21.15.73:0/49802844 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4c4806e060 msgr2=0x7f4c4813aa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:54.226 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:54.224+0000 7f4c4d32c640 1 --2- 172.21.15.73:0/49802844 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4c4806e060 0x7f4c4813aa30 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f4c3c02b830 tx=0x7f4c3c0046c0 comp rx=0 tx=0).stop 2023-12-12T09:45:54.226 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:54.224+0000 7f4c4d32c640 1 -- 172.21.15.73:0/49802844 shutdown_connections 2023-12-12T09:45:54.226 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:54.224+0000 7f4c4d32c640 1 --2- 172.21.15.73:0/49802844 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f4c3406ae40 0x7f4c3406d300 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:54.226 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:54.224+0000 7f4c4d32c640 1 --2- 172.21.15.73:0/49802844 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4c480722c0 0x7f4c48070150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:54.226 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:54.224+0000 7f4c4d32c640 1 --2- 172.21.15.73:0/49802844 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4c4806e060 0x7f4c4813aa30 unknown :-1 s=CLOSED pgs=724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:54.226 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:54.224+0000 7f4c4d32c640 1 --2- 172.21.15.73:0/49802844 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4c4806bf20 0x7f4c481eae20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:54.226 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:54.224+0000 7f4c4d32c640 1 -- 172.21.15.73:0/49802844 >> 172.21.15.73:0/49802844 conn(0x7f4c480a8130 msgr2=0x7f4c480c35a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:45:54.226 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:54.224+0000 7f4c4d32c640 1 -- 172.21.15.73:0/49802844 shutdown_connections 2023-12-12T09:45:54.226 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:54.224+0000 7f4c4d32c640 1 -- 172.21.15.73:0/49802844 wait complete. 2023-12-12T09:45:54.245 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs2; just confirmed its presence on cluster 2023-12-12T09:45:54.245 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-12T09:45:54.245 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi073.front.sepia.ceph.com 2023-12-12T09:45:54.245 INFO:tasks.cephfs.mount:self.client.name = client.testuser 2023-12-12T09:45:54.245 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-12-12T09:45:54.245 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs2 2023-12-12T09:45:54.245 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-12-12T09:45:54.245 INFO:tasks.cephfs.mount:self.client_keyring_path = /tmp/tmp.EPLJclYIHE 2023-12-12T09:45:54.246 DEBUG:teuthology.orchestra.run.smithi073:> mktemp 2023-12-12T09:45:54.297 INFO:teuthology.orchestra.run.smithi073.stdout:/tmp/tmp.uigWm4P824 2023-12-12T09:45:54.297 DEBUG:teuthology.orchestra.run.smithi073:> sudo cp /tmp/tmp.EPLJclYIHE /tmp/tmp.uigWm4P824 2023-12-12T09:45:54.394 DEBUG:teuthology.orchestra.run.smithi073:> sudo chmod 0666 /tmp/tmp.uigWm4P824 2023-12-12T09:45:54.553 DEBUG:teuthology.orchestra.remote:smithi073:/tmp/tmp.uigWm4P824 is 245B 2023-12-12T09:45:54.612 DEBUG:teuthology.orchestra.run.smithi073:> rm -fr /tmp/tmp.uigWm4P824 2023-12-12T09:45:54.661 INFO:tasks.cephfs.mount:keyring content - [client.testuser] key = AQDNK3hlCS/mJhAAS/jvgI5UicsVLO+EaGuuUQ== caps mds = "allow rw fsname=cephfs" caps mon = "allow rw fsname=cephfs, allow rw fsname=cephfs2" caps osd = "allow rw tag cephfs data=cephfs, allow rw tag cephfs data=cephfs2" 2023-12-12T09:45:54.661 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-12-12T09:45:54.661 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T09:45:54.661 DEBUG:teuthology.orchestra.run.smithi073:> ip addr 2023-12-12T09:45:54.707 INFO:teuthology.orchestra.run.smithi073.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-12T09:45:54.707 INFO:teuthology.orchestra.run.smithi073.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-12T09:45:54.707 INFO:teuthology.orchestra.run.smithi073.stdout: inet 127.0.0.1/8 scope host lo 2023-12-12T09:45:54.707 INFO:teuthology.orchestra.run.smithi073.stdout: valid_lft forever preferred_lft forever 2023-12-12T09:45:54.707 INFO:teuthology.orchestra.run.smithi073.stdout: inet6 ::1/128 scope host 2023-12-12T09:45:54.707 INFO:teuthology.orchestra.run.smithi073.stdout: valid_lft forever preferred_lft forever 2023-12-12T09:45:54.707 INFO:teuthology.orchestra.run.smithi073.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-12T09:45:54.707 INFO:teuthology.orchestra.run.smithi073.stdout: link/ether 0c:c4:7a:d8:d9:ea brd ff:ff:ff:ff:ff:ff 2023-12-12T09:45:54.707 INFO:teuthology.orchestra.run.smithi073.stdout: altname enp7s0f0 2023-12-12T09:45:54.707 INFO:teuthology.orchestra.run.smithi073.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-12T09:45:54.707 INFO:teuthology.orchestra.run.smithi073.stdout: link/ether 0c:c4:7a:d8:d9:eb brd ff:ff:ff:ff:ff:ff 2023-12-12T09:45:54.708 INFO:teuthology.orchestra.run.smithi073.stdout: altname enp7s0f1 2023-12-12T09:45:54.708 INFO:teuthology.orchestra.run.smithi073.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-12T09:45:54.708 INFO:teuthology.orchestra.run.smithi073.stdout: link/ether 0c:c4:7a:8f:ce:7c brd ff:ff:ff:ff:ff:ff 2023-12-12T09:45:54.708 INFO:teuthology.orchestra.run.smithi073.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-12T09:45:54.708 INFO:teuthology.orchestra.run.smithi073.stdout: link/ether 0c:c4:7a:8f:ce:7d brd ff:ff:ff:ff:ff:ff 2023-12-12T09:45:54.708 INFO:teuthology.orchestra.run.smithi073.stdout: inet 172.21.15.73/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-12-12T09:45:54.708 INFO:teuthology.orchestra.run.smithi073.stdout: valid_lft 42244sec preferred_lft 42244sec 2023-12-12T09:45:54.708 INFO:teuthology.orchestra.run.smithi073.stdout: inet6 fe80::ec4:7aff:fe8f:ce7d/64 scope link 2023-12-12T09:45:54.708 INFO:teuthology.orchestra.run.smithi073.stdout: valid_lft forever preferred_lft forever 2023-12-12T09:45:54.708 INFO:teuthology.orchestra.run.smithi073.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-12-12T09:45:54.708 INFO:teuthology.orchestra.run.smithi073.stdout: link/ether ae:cf:b6:bf:45:8d brd ff:ff:ff:ff:ff:ff 2023-12-12T09:45:54.708 INFO:teuthology.orchestra.run.smithi073.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-12-12T09:45:54.708 INFO:teuthology.orchestra.run.smithi073.stdout: valid_lft forever preferred_lft forever 2023-12-12T09:45:54.708 INFO:teuthology.orchestra.run.smithi073.stdout: inet6 fe80::f4:a9ff:febd:c3fb/64 scope link 2023-12-12T09:45:54.709 INFO:teuthology.orchestra.run.smithi073.stdout: valid_lft forever preferred_lft forever 2023-12-12T09:45:54.709 INFO:teuthology.orchestra.run.smithi073.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-12T09:45:54.709 INFO:teuthology.orchestra.run.smithi073.stdout: link/ether ae:cf:b6:bf:45:8d brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-12T09:45:54.709 INFO:teuthology.orchestra.run.smithi073.stdout: inet6 fe80::accf:b6ff:febf:458d/64 scope link 2023-12-12T09:45:54.709 INFO:teuthology.orchestra.run.smithi073.stdout: valid_lft forever preferred_lft forever 2023-12-12T09:45:54.710 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T09:45:54.710 DEBUG:teuthology.orchestra.run.smithi073:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-12T09:45:54.842 INFO:teuthology.orchestra.run.smithi073.stdout:1 2023-12-12T09:45:54.845 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T09:45:54.845 DEBUG:teuthology.orchestra.run.smithi073:> route 2023-12-12T09:45:54.896 INFO:teuthology.orchestra.run.smithi073.stdout:Kernel IP routing table 2023-12-12T09:45:54.897 INFO:teuthology.orchestra.run.smithi073.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-12T09:45:54.897 INFO:teuthology.orchestra.run.smithi073.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-12-12T09:45:54.897 INFO:teuthology.orchestra.run.smithi073.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-12-12T09:45:54.897 INFO:teuthology.orchestra.run.smithi073.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-12T09:45:54.897 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T09:45:54.897 DEBUG:teuthology.orchestra.run.smithi073:> (cd / && exec bash -c ' 2023-12-12T09:45:54.897 DEBUG:teuthology.orchestra.run.smithi073:> set -e 2023-12-12T09:45:54.897 DEBUG:teuthology.orchestra.run.smithi073:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-12-12T09:45:54.897 DEBUG:teuthology.orchestra.run.smithi073:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-12-12T09:45:54.897 DEBUG:teuthology.orchestra.run.smithi073:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-12-12T09:45:54.897 DEBUG:teuthology.orchestra.run.smithi073:> ') 2023-12-12T09:45:55.074 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T09:45:55.074 DEBUG:teuthology.orchestra.run.smithi073:> ip netns list 2023-12-12T09:45:55.122 INFO:teuthology.orchestra.run.smithi073.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-12-12T09:45:55.123 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-12-12T09:45:55.123 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T09:45:55.123 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip link set brx.0 up 2023-12-12T09:45:55.216 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-12T09:45:55.217 DEBUG:teuthology.orchestra.run.smithi073:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-12-12T09:45:55.273 INFO:teuthology.orchestra.run.smithi073.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-12-12T09:45:55.273 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-12T09:45:55.273 DEBUG:teuthology.orchestra.run.smithi073:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-12-12T09:45:55.322 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2023-12-12T09:45:55.322 DEBUG:teuthology.orchestra.run.smithi073:> dd if=/tmp/tmp.EPLJclYIHE of=/dev/stdout 2023-12-12T09:45:55.371 INFO:tasks.cephfs.kernel_mount:mounting using device: testuser@.cephfs2=/ 2023-12-12T09:45:55.371 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T09:45:55.371 DEBUG:teuthology.orchestra.run.smithi073:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph testuser@.cephfs2=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,secret=AQDNK3hlCS/mJhAAS/jvgI5UicsVLO+EaGuuUQ==,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-12T09:45:55.567 INFO:teuthology.orchestra.run.smithi073.stdout:parsing options: rw,norequire_active_mds,secret=AQDNK3hlCS/mJhAAS/jvgI5UicsVLO+EaGuuUQ==,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-12T09:45:55.567 INFO:teuthology.orchestra.run.smithi073.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-12T09:45:55.567 INFO:teuthology.orchestra.run.smithi073.stdout:keyring.get_secret failed 2023-12-12T09:45:55.605 INFO:teuthology.orchestra.run.smithi073.stderr:mount.ceph: kernel BUG! 2023-12-12T09:45:55.605 INFO:teuthology.orchestra.run.smithi073.stderr:mount error 13 = Permission denied 2023-12-12T09:45:55.606 INFO:teuthology.orchestra.run.smithi073.stdout:parsing options: rw,norequire_active_mds,secret=AQDNK3hlCS/mJhAAS/jvgI5UicsVLO+EaGuuUQ==,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-12T09:45:55.606 INFO:teuthology.orchestra.run.smithi073.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-12T09:45:55.606 INFO:teuthology.orchestra.run.smithi073.stdout:mount.ceph: resolved to: "172.21.15.73:3300,172.21.15.142:3300,172.21.15.142:3301" 2023-12-12T09:45:55.606 INFO:teuthology.orchestra.run.smithi073.stdout:mount.ceph: trying mount with new device syntax: testuser@ba240992-02b8-4c7e-92f2-27eb29ac433b.cephfs2=/ 2023-12-12T09:45:55.606 INFO:teuthology.orchestra.run.smithi073.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=testuser,ms_mode=prefer-crc,key=testuser,mon_addr=172.21.15.73:3300/172.21.15.142:3300/172.21.15.142:3301" will pass to kernel 2023-12-12T09:45:55.610 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-12-12T09:45:55.611 INFO:tasks.cephfs.kernel_mount:mount command failed 2023-12-12T09:45:55.611 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-12-12T09:45:55.611 DEBUG:teuthology.orchestra.run.smithi073:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-12T09:45:55.720 DEBUG:teuthology.orchestra.run.smithi142:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-12T09:45:55.848 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-12-12T09:45:55.849 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2023-12-12T09:45:55.849 DEBUG:teuthology.orchestra.run.smithi073:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-12T09:45:55.907 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054284,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498800k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249396k,nr_inodes=812349,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498800k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 2023-12-12T09:45:55.907 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2023-12-12T09:45:55.907 DEBUG:teuthology.orchestra.run.smithi142:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-12T09:45:55.967 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2023-12-12T09:45:55.967 DEBUG:teuthology.orchestra.run.smithi142:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-12T09:45:56.022 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-12T09:45:56.243 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:56.242+0000 7f46d23c9640 1 Processor -- start 2023-12-12T09:45:56.244 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:56.242+0000 7f46d23c9640 1 -- start start 2023-12-12T09:45:56.245 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:56.243+0000 7f46d23c9640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f46cc06db70 0x7f46cc0c39b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:56.245 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:56.243+0000 7f46d23c9640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f46cc0c5070 0x7f46cc0c3ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:56.245 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:56.243+0000 7f46d23c9640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46cc152610 con 0x7f46cc14fa40 2023-12-12T09:45:56.245 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:56.243+0000 7f46d23c9640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46cc1528f0 con 0x7f46cc06db70 2023-12-12T09:45:56.245 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:56.244+0000 7f46d23c9640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46cc152bd0 con 0x7f46cc0c5070 2023-12-12T09:45:56.245 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:56.244+0000 7f46cb7fe640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f46cc06db70 0x7f46cc0c39b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:56.246 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:56.244+0000 7f46cb7fe640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f46cc06db70 0x7f46cc0c39b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:48810/0 (socket says 172.21.15.73:48810) 2023-12-12T09:45:56.246 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:56.244+0000 7f46cb7fe640 1 -- 172.21.15.73:0/3253242596 learned_addr learned my addr 172.21.15.73:0/3253242596 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:45:56.246 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:56.244+0000 7f46cb7fe640 1 -- 172.21.15.73:0/3253242596 >> v2:172.21.15.142:3300/0 conn(0x7f46cc0c5070 msgr2=0x7f46cc0c3ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:45:56.246 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:56.244+0000 7f46cb7fe640 1 --2- 172.21.15.73:0/3253242596 >> v2:172.21.15.142:3300/0 conn(0x7f46cc0c5070 0x7f46cc0c3ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:56.246 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:56.244+0000 7f46cb7fe640 1 -- 172.21.15.73:0/3253242596 >> v1:172.21.15.142:6789/0 conn(0x7f46cc14fa40 legacy=0x7f46cc06a4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:45:56.247 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:56.244+0000 7f46cb7fe640 1 -- 172.21.15.73:0/3253242596 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46cc152eb0 con 0x7f46cc06db70 2023-12-12T09:45:56.247 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:56.245+0000 7f46cb7fe640 1 --2- 172.21.15.73:0/3253242596 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f46cc06db70 0x7f46cc0c39b0 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f46cc06fc50 tx=0x7f46c002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31621d4afb5a8ea2 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:45:56.248 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:56.246+0000 7f46caffd640 1 -- 172.21.15.73:0/3253242596 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46c0031870 con 0x7f46cc06db70 2023-12-12T09:45:56.248 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:56.246+0000 7f46caffd640 1 -- 172.21.15.73:0/3253242596 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46c00319d0 con 0x7f46cc06db70 2023-12-12T09:45:56.248 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:56.246+0000 7f46caffd640 1 -- 172.21.15.73:0/3253242596 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46c0031d60 con 0x7f46cc06db70 2023-12-12T09:45:56.248 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:56.246+0000 7f46d23c9640 1 -- 172.21.15.73:0/3253242596 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f46cc06db70 msgr2=0x7f46cc0c39b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:56.248 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:56.246+0000 7f46d23c9640 1 --2- 172.21.15.73:0/3253242596 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f46cc06db70 0x7f46cc0c39b0 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f46cc06fc50 tx=0x7f46c002b910 comp rx=0 tx=0).stop 2023-12-12T09:45:56.248 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:56.246+0000 7f46d23c9640 1 -- 172.21.15.73:0/3253242596 shutdown_connections 2023-12-12T09:45:56.248 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:56.246+0000 7f46d23c9640 1 --2- 172.21.15.73:0/3253242596 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f46cc06db70 0x7f46cc0c39b0 unknown :-1 s=CLOSED pgs=725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:56.248 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:56.246+0000 7f46d23c9640 1 --2- 172.21.15.73:0/3253242596 >> v2:172.21.15.142:3300/0 conn(0x7f46cc0c5070 0x7f46cc0c3ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:56.248 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:56.246+0000 7f46d23c9640 1 -- 172.21.15.73:0/3253242596 >> 172.21.15.73:0/3253242596 conn(0x7f46cc0a8130 msgr2=0x7f46cc0c24b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:45:56.248 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:56.246+0000 7f46d23c9640 1 -- 172.21.15.73:0/3253242596 shutdown_connections 2023-12-12T09:45:56.248 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:56.246+0000 7f46d23c9640 1 -- 172.21.15.73:0/3253242596 wait complete. 2023-12-12T09:45:56.249 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:56.248+0000 7f46d23c9640 1 Processor -- start 2023-12-12T09:45:56.249 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:56.248+0000 7f46d23c9640 1 -- start start 2023-12-12T09:45:56.251 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:56.249+0000 7f46d23c9640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f46cc06db70 0x7f46cc1edcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:56.251 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:56.249+0000 7f46d23c9640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f46cc0c5070 0x7f46cc070d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:56.251 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:56.249+0000 7f46d23c9640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f46cc14fa40 0x7f46cc150580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:56.251 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:56.249+0000 7f46d23c9640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46cc071790 con 0x7f46cc06db70 2023-12-12T09:45:56.251 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:56.249+0000 7f46d23c9640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46cc1ea0c0 con 0x7f46cc14fa40 2023-12-12T09:45:56.251 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:56.249+0000 7f46d23c9640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46cc1ea3a0 con 0x7f46cc0c5070 2023-12-12T09:45:56.251 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:56.249+0000 7f46cbfff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f46cc06db70 0x7f46cc1edcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:56.251 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:56.249+0000 7f46cbfff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f46cc06db70 0x7f46cc1edcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:48816/0 (socket says 172.21.15.73:48816) 2023-12-12T09:45:56.251 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:56.249+0000 7f46cbfff640 1 -- 172.21.15.73:0/1802815018 learned_addr learned my addr 172.21.15.73:0/1802815018 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:45:56.252 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:56.250+0000 7f46cb7fe640 1 --2- 172.21.15.73:0/1802815018 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f46cc0c5070 0x7f46cc070d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:56.252 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:56.250+0000 7f46cbfff640 1 -- 172.21.15.73:0/1802815018 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f46cc0c5070 msgr2=0x7f46cc070d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:56.252 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:56.250+0000 7f46cbfff640 1 --2- 172.21.15.73:0/1802815018 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f46cc0c5070 0x7f46cc070d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:56.252 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:56.250+0000 7f46d0966640 1 --2- 172.21.15.73:0/1802815018 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f46cc14fa40 0x7f46cc150580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:56.252 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:56.250+0000 7f46cbfff640 1 -- 172.21.15.73:0/1802815018 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f46cc14fa40 msgr2=0x7f46cc150580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:56.252 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:56.250+0000 7f46cbfff640 1 --2- 172.21.15.73:0/1802815018 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f46cc14fa40 0x7f46cc150580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:56.252 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:56.250+0000 7f46cbfff640 1 -- 172.21.15.73:0/1802815018 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46c00094d0 con 0x7f46cc06db70 2023-12-12T09:45:56.253 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:56.250+0000 7f46cbfff640 1 --2- 172.21.15.73:0/1802815018 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f46cc06db70 0x7f46cc1edcf0 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f46bc00c410 tx=0x7f46bc00c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:45:56.253 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:56.250+0000 7f46c8ff9640 1 -- 172.21.15.73:0/1802815018 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46bc0035f0 con 0x7f46cc06db70 2023-12-12T09:45:56.253 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:56.250+0000 7f46c8ff9640 1 -- 172.21.15.73:0/1802815018 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46bc003750 con 0x7f46cc06db70 2023-12-12T09:45:56.253 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:56.250+0000 7f46c8ff9640 1 -- 172.21.15.73:0/1802815018 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46bc003b40 con 0x7f46cc06db70 2023-12-12T09:45:56.253 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:56.250+0000 7f46d23c9640 1 -- 172.21.15.73:0/1802815018 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46cc1ea680 con 0x7f46cc06db70 2023-12-12T09:45:56.253 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:56.251+0000 7f46d23c9640 1 -- 172.21.15.73:0/1802815018 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46cc1e9d70 con 0x7f46cc06db70 2023-12-12T09:45:56.253 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:56.252+0000 7f46d23c9640 1 -- 172.21.15.73:0/1802815018 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46cc067580 con 0x7f46cc06db70 2023-12-12T09:45:56.254 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:56.253+0000 7f46c8ff9640 1 -- 172.21.15.73:0/1802815018 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f46bc003ca0 con 0x7f46cc06db70 2023-12-12T09:45:56.255 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:56.254+0000 7f46c8ff9640 1 --2- 172.21.15.73:0/1802815018 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f46b806ae40 0x7f46b806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:56.255 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:56.254+0000 7f46c8ff9640 1 -- 172.21.15.73:0/1802815018 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f46bc088bc0 con 0x7f46cc06db70 2023-12-12T09:45:56.255 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:56.254+0000 7f46cb7fe640 1 --2- 172.21.15.73:0/1802815018 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f46b806ae40 0x7f46b806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:56.256 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:56.255+0000 7f46cb7fe640 1 --2- 172.21.15.73:0/1802815018 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f46b806ae40 0x7f46b806d300 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f46c0036000 tx=0x7f46c003c040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:45:56.260 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:56.258+0000 7f46c8ff9640 1 -- 172.21.15.73:0/1802815018 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f46bc053900 con 0x7f46cc06db70 2023-12-12T09:45:56.450 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:56.448+0000 7f46d23c9640 1 -- 172.21.15.73:0/1802815018 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f46cc0724d0 con 0x7f46cc06db70 2023-12-12T09:45:56.452 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:56.451+0000 7f46c8ff9640 1 -- 172.21.15.73:0/1802815018 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v58) v1 ==== 74+0+20292 (secure 0 0 0) 0x7f46bc056f20 con 0x7f46cc06db70 2023-12-12T09:45:56.453 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-12T09:45:56.453 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":58,"fsid":"ba240992-02b8-4c7e-92f2-27eb29ac433b","created":"2023-12-12T09:43:02.454719+0000","modified":"2023-12-12T09:45:39.273967+0000","last_up_change":"2023-12-12T09:43:13.913440+0000","last_in_change":"2023-12-12T09:43:05.925348+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-12T09:43:15.525508+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-12-12T09:45:21.264815+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"53","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-12-12T09:45:21.981834+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"54","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs2_metadata","create_time":"2023-12-12T09:45:36.388393+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"57","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs2_data","create_time":"2023-12-12T09:45:37.109653+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"58","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"dd9074be-dbe2-4c34-9896-a4223d8d3940","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":4047810203},{"type":"v1","addr":"172.21.15.73:6801","nonce":4047810203}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":4047810203},{"type":"v1","addr":"172.21.15.73:6803","nonce":4047810203}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":4047810203},{"type":"v1","addr":"172.21.15.73:6807","nonce":4047810203}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":4047810203},{"type":"v1","addr":"172.21.15.73:6805","nonce":4047810203}]},"public_addr":"172.21.15.73:6801/4047810203","cluster_addr":"172.21.15.73:6803/4047810203","heartbeat_back_addr":"172.21.15.73:6807/4047810203","heartbeat_front_addr":"172.21.15.73:6805/4047810203","state":["exists","up"]},{"osd":1,"uuid":"c4a05052-96d4-4758-a4e1-1a37f1e07fed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":1356058331},{"type":"v1","addr":"172.21.15.73:6824","nonce":1356058331}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":1356058331},{"type":"v1","addr":"172.21.15.73:6827","nonce":1356058331}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":1356058331},{"type":"v1","addr":"172.21.15.73:6831","nonce":1356058331}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":1356058331},{"type":"v1","addr":"172.21.15.73:6829","nonce":1356058331}]},"public_addr":"172.21.15.73:6824/1356058331","cluster_addr":"172.21.15.73:6827/1356058331","heartbeat_back_addr":"172.21.15.73:6831/1356058331","heartbeat_front_addr":"172.21.15.73:6829/1356058331","state":["exists","up"]},{"osd":2,"uuid":"512bc8ac-72c2-40d4-b3d2-d867a92c5213","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":1228903316},{"type":"v1","addr":"172.21.15.73:6817","nonce":1228903316}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":1228903316},{"type":"v1","addr":"172.21.15.73:6819","nonce":1228903316}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6823","nonce":1228903316},{"type":"v1","addr":"172.21.15.73:6825","nonce":1228903316}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":1228903316},{"type":"v1","addr":"172.21.15.73:6821","nonce":1228903316}]},"public_addr":"172.21.15.73:6817/1228903316","cluster_addr":"172.21.15.73:6819/1228903316","heartbeat_back_addr":"172.21.15.73:6825/1228903316","heartbeat_front_addr":"172.21.15.73:6821/1228903316","state":["exists","up"]},{"osd":3,"uuid":"3d1a91e0-42bf-437a-8eae-8d357c8f63a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":1293329670},{"type":"v1","addr":"172.21.15.73:6809","nonce":1293329670}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6810","nonce":1293329670},{"type":"v1","addr":"172.21.15.73:6811","nonce":1293329670}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":1293329670},{"type":"v1","addr":"172.21.15.73:6815","nonce":1293329670}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":1293329670},{"type":"v1","addr":"172.21.15.73:6813","nonce":1293329670}]},"public_addr":"172.21.15.73:6809/1293329670","cluster_addr":"172.21.15.73:6811/1293329670","heartbeat_back_addr":"172.21.15.73:6815/1293329670","heartbeat_front_addr":"172.21.15.73:6813/1293329670","state":["exists","up"]},{"osd":4,"uuid":"4b302fff-834c-4069-ac19-00e46f6c87b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":3727975702},{"type":"v1","addr":"172.21.15.142:6801","nonce":3727975702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":3727975702},{"type":"v1","addr":"172.21.15.142:6803","nonce":3727975702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6809","nonce":3727975702},{"type":"v1","addr":"172.21.15.142:6811","nonce":3727975702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6805","nonce":3727975702},{"type":"v1","addr":"172.21.15.142:6807","nonce":3727975702}]},"public_addr":"172.21.15.142:6801/3727975702","cluster_addr":"172.21.15.142:6803/3727975702","heartbeat_back_addr":"172.21.15.142:6811/3727975702","heartbeat_front_addr":"172.21.15.142:6807/3727975702","state":["exists","up"]},{"osd":5,"uuid":"d7cdace2-67d0-45cc-95f2-515cf6ef1b82","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6817","nonce":2353193632},{"type":"v1","addr":"172.21.15.142:6819","nonce":2353193632}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6821","nonce":2353193632},{"type":"v1","addr":"172.21.15.142:6823","nonce":2353193632}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6829","nonce":2353193632},{"type":"v1","addr":"172.21.15.142:6831","nonce":2353193632}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6825","nonce":2353193632},{"type":"v1","addr":"172.21.15.142:6827","nonce":2353193632}]},"public_addr":"172.21.15.142:6819/2353193632","cluster_addr":"172.21.15.142:6823/2353193632","heartbeat_back_addr":"172.21.15.142:6831/2353193632","heartbeat_front_addr":"172.21.15.142:6827/2353193632","state":["exists","up"]},{"osd":6,"uuid":"649ce78a-5626-445c-aedc-a651ed05a6f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":2006111986},{"type":"v1","addr":"172.21.15.142:6806","nonce":2006111986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":2006111986},{"type":"v1","addr":"172.21.15.142:6810","nonce":2006111986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":2006111986},{"type":"v1","addr":"172.21.15.142:6815","nonce":2006111986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":2006111986},{"type":"v1","addr":"172.21.15.142:6813","nonce":2006111986}]},"public_addr":"172.21.15.142:6806/2006111986","cluster_addr":"172.21.15.142:6810/2006111986","heartbeat_back_addr":"172.21.15.142:6815/2006111986","heartbeat_front_addr":"172.21.15.142:6813/2006111986","state":["exists","up"]},{"osd":7,"uuid":"af15ae3b-c1d0-4acf-92db-8a1805494d13","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":2573794341},{"type":"v1","addr":"172.21.15.142:6818","nonce":2573794341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":2573794341},{"type":"v1","addr":"172.21.15.142:6822","nonce":2573794341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":2573794341},{"type":"v1","addr":"172.21.15.142:6830","nonce":2573794341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":2573794341},{"type":"v1","addr":"172.21.15.142:6826","nonce":2573794341}]},"public_addr":"172.21.15.142:6818/2573794341","cluster_addr":"172.21.15.142:6822/2573794341","heartbeat_back_addr":"172.21.15.142:6830/2573794341","heartbeat_front_addr":"172.21.15.142:6826/2573794341","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.185824+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.262103+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.225556+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:10.523459+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:10.706035+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.257339+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.301776+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.051960+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-12T09:45:56.455 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:56.453+0000 7f46d23c9640 1 -- 172.21.15.73:0/1802815018 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f46b806ae40 msgr2=0x7f46b806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:56.455 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:56.453+0000 7f46d23c9640 1 --2- 172.21.15.73:0/1802815018 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f46b806ae40 0x7f46b806d300 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f46c0036000 tx=0x7f46c003c040 comp rx=0 tx=0).stop 2023-12-12T09:45:56.455 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:56.453+0000 7f46d23c9640 1 -- 172.21.15.73:0/1802815018 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f46cc06db70 msgr2=0x7f46cc1edcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:56.455 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:56.453+0000 7f46d23c9640 1 --2- 172.21.15.73:0/1802815018 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f46cc06db70 0x7f46cc1edcf0 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f46bc00c410 tx=0x7f46bc00c8d0 comp rx=0 tx=0).stop 2023-12-12T09:45:56.456 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:56.454+0000 7f46d23c9640 1 -- 172.21.15.73:0/1802815018 shutdown_connections 2023-12-12T09:45:56.456 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:56.454+0000 7f46d23c9640 1 --2- 172.21.15.73:0/1802815018 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f46b806ae40 0x7f46b806d300 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:56.456 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:56.454+0000 7f46d23c9640 1 --2- 172.21.15.73:0/1802815018 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f46cc14fa40 0x7f46cc150580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:56.456 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:56.454+0000 7f46d23c9640 1 --2- 172.21.15.73:0/1802815018 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f46cc0c5070 0x7f46cc070d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:56.456 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:56.454+0000 7f46d23c9640 1 --2- 172.21.15.73:0/1802815018 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f46cc06db70 0x7f46cc1edcf0 unknown :-1 s=CLOSED pgs=726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:56.456 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:56.454+0000 7f46d23c9640 1 -- 172.21.15.73:0/1802815018 >> 172.21.15.73:0/1802815018 conn(0x7f46cc0a8130 msgr2=0x7f46cc06a4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:45:56.456 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:56.454+0000 7f46d23c9640 1 -- 172.21.15.73:0/1802815018 shutdown_connections 2023-12-12T09:45:56.456 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:56.454+0000 7f46d23c9640 1 -- 172.21.15.73:0/1802815018 wait complete. 2023-12-12T09:45:56.474 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-12T09:43:15.525508+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 8, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-12T09:45:21.264815+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '53', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 9, 'pool_name': 'cephfs_data', 'create_time': '2023-12-12T09:45:21.981834+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '54', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 10, 'pool_name': 'cephfs2_metadata', 'create_time': '2023-12-12T09:45:36.388393+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '57', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs2'}}, 'read_balance': {'score_acting': 2.5, 'score_stable': 2.5, 'optimal_score': 1, 'raw_score_acting': 2.5, 'raw_score_stable': 2.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 11, 'pool_name': 'cephfs2_data', 'create_time': '2023-12-12T09:45:37.109653+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '58', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs2'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-12T09:45:56.475 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-12T09:45:56.679 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:56.678+0000 7f0995c6d640 1 Processor -- start 2023-12-12T09:45:56.680 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:56.678+0000 7f0995c6d640 1 -- start start 2023-12-12T09:45:56.681 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:56.679+0000 7f0995c6d640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f099014c190 0x7f09900c0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:56.681 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:56.679+0000 7f0995c6d640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09901521e0 con 0x7f09900a4d00 2023-12-12T09:45:56.681 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:56.679+0000 7f0995c6d640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09900c1aa0 con 0x7f09901529a0 2023-12-12T09:45:56.681 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:56.679+0000 7f0995c6d640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09900c1890 con 0x7f099014c190 2023-12-12T09:45:56.681 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:56.680+0000 7f0994c6b640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f099014c190 0x7f09900c0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:56.681 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:56.680+0000 7f0987fff640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f09900a4d00 0x7f09901555c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:55832/0 (socket says 172.21.15.73:55832) 2023-12-12T09:45:56.682 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:56.680+0000 7f0987fff640 1 -- 172.21.15.73:0/1419464492 learned_addr learned my addr 172.21.15.73:0/1419464492 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-12T09:45:56.682 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:56.680+0000 7f0994c6b640 1 -- 172.21.15.73:0/1419464492 >> v1:172.21.15.142:6789/0 conn(0x7f09901529a0 legacy=0x7f09900a8880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:45:56.682 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:56.680+0000 7f0994c6b640 1 -- 172.21.15.73:0/1419464492 >> v1:172.21.15.73:6789/0 conn(0x7f09900a4d00 legacy=0x7f09901555c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:56.682 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:56.680+0000 7f0994c6b640 1 -- 172.21.15.73:0/1419464492 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09900c1d80 con 0x7f099014c190 2023-12-12T09:45:56.683 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:56.680+0000 7f09877fe640 1 -- 172.21.15.73:0/1419464492 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2271208568 0 0) 0x7f09901521e0 con 0x7f09900a4d00 2023-12-12T09:45:56.683 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:56.681+0000 7f0994c6b640 1 --2- 172.21.15.73:0/1419464492 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f099014c190 0x7f09900c0e00 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f098c0097a0 tx=0x7f098c02b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4303471e0c89709 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:45:56.684 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:56.682+0000 7f09877fe640 1 -- 172.21.15.73:0/1419464492 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f098c02e070 con 0x7f099014c190 2023-12-12T09:45:56.684 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:56.682+0000 7f09877fe640 1 -- 172.21.15.73:0/1419464492 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f098c0315a0 con 0x7f099014c190 2023-12-12T09:45:56.684 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:56.682+0000 7f09877fe640 1 -- 172.21.15.73:0/1419464492 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f098c031930 con 0x7f099014c190 2023-12-12T09:45:56.684 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:56.682+0000 7f0995c6d640 1 -- 172.21.15.73:0/1419464492 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f099014c190 msgr2=0x7f09900c0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:56.685 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:56.682+0000 7f0995c6d640 1 --2- 172.21.15.73:0/1419464492 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f099014c190 0x7f09900c0e00 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f098c0097a0 tx=0x7f098c02b840 comp rx=0 tx=0).stop 2023-12-12T09:45:56.685 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:56.682+0000 7f0995c6d640 1 -- 172.21.15.73:0/1419464492 shutdown_connections 2023-12-12T09:45:56.685 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:56.682+0000 7f0995c6d640 1 --2- 172.21.15.73:0/1419464492 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f099014c190 0x7f09900c0e00 unknown :-1 s=CLOSED pgs=728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:56.685 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:56.682+0000 7f0995c6d640 1 -- 172.21.15.73:0/1419464492 >> 172.21.15.73:0/1419464492 conn(0x7f099006a4e0 msgr2=0x7f099006a8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:45:56.685 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:56.682+0000 7f0995c6d640 1 -- 172.21.15.73:0/1419464492 shutdown_connections 2023-12-12T09:45:56.685 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:56.682+0000 7f0995c6d640 1 -- 172.21.15.73:0/1419464492 wait complete. 2023-12-12T09:45:56.686 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:56.684+0000 7f0995c6d640 1 Processor -- start 2023-12-12T09:45:56.686 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:56.684+0000 7f0995c6d640 1 -- start start 2023-12-12T09:45:56.688 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:56.685+0000 7f0995c6d640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f09900a4d00 0x7f09900c5050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:56.688 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:56.685+0000 7f0995c6d640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f099014c190 0x7f09900c35d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:56.688 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:56.685+0000 7f0995c6d640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f09901529a0 0x7f099006cf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:56.689 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:56.685+0000 7f0995c6d640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09901477d0 con 0x7f09900a4d00 2023-12-12T09:45:56.689 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:56.685+0000 7f0995c6d640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09900c4340 con 0x7f09901529a0 2023-12-12T09:45:56.689 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:56.685+0000 7f0995c6d640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09900c4620 con 0x7f099014c190 2023-12-12T09:45:56.689 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:56.685+0000 7f0994c6b640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f09900a4d00 0x7f09900c5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:56.689 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:56.685+0000 7f0994c6b640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f09900a4d00 0x7f09900c5050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:48830/0 (socket says 172.21.15.73:48830) 2023-12-12T09:45:56.689 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:56.685+0000 7f0994c6b640 1 -- 172.21.15.73:0/3339880818 learned_addr learned my addr 172.21.15.73:0/3339880818 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:45:56.689 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:56.686+0000 7f0987fff640 1 --2- 172.21.15.73:0/3339880818 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f099014c190 0x7f09900c35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:56.690 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:56.686+0000 7f099546c640 1 --2- 172.21.15.73:0/3339880818 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f09901529a0 0x7f099006cf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:56.690 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:56.686+0000 7f0994c6b640 1 -- 172.21.15.73:0/3339880818 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f099014c190 msgr2=0x7f09900c35d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:56.690 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:56.686+0000 7f0994c6b640 1 --2- 172.21.15.73:0/3339880818 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f099014c190 0x7f09900c35d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:56.690 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:56.686+0000 7f0994c6b640 1 -- 172.21.15.73:0/3339880818 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f09901529a0 msgr2=0x7f099006cf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:56.690 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:56.686+0000 7f0994c6b640 1 --2- 172.21.15.73:0/3339880818 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f09901529a0 0x7f099006cf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:56.690 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:56.686+0000 7f0994c6b640 1 -- 172.21.15.73:0/3339880818 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f098c009400 con 0x7f09900a4d00 2023-12-12T09:45:56.690 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:56.686+0000 7f099546c640 1 --2- 172.21.15.73:0/3339880818 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f09901529a0 0x7f099006cf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:45:56.690 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:56.686+0000 7f0994c6b640 1 --2- 172.21.15.73:0/3339880818 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f09900a4d00 0x7f09900c5050 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f098c0097a0 tx=0x7f098c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:45:56.690 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:56.687+0000 7f09857fa640 1 -- 172.21.15.73:0/3339880818 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f098c032900 con 0x7f09900a4d00 2023-12-12T09:45:56.691 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:56.687+0000 7f09857fa640 1 -- 172.21.15.73:0/3339880818 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f098c032a60 con 0x7f09900a4d00 2023-12-12T09:45:56.691 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:56.687+0000 7f09857fa640 1 -- 172.21.15.73:0/3339880818 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f098c032e10 con 0x7f09900a4d00 2023-12-12T09:45:56.691 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:56.687+0000 7f0995c6d640 1 -- 172.21.15.73:0/3339880818 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09900c5590 con 0x7f09900a4d00 2023-12-12T09:45:56.691 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:56.687+0000 7f0995c6d640 1 -- 172.21.15.73:0/3339880818 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09901479e0 con 0x7f09900a4d00 2023-12-12T09:45:56.692 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:56.688+0000 7f0995c6d640 1 -- 172.21.15.73:0/3339880818 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f09900c2060 con 0x7f09900a4d00 2023-12-12T09:45:56.692 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:56.689+0000 7f09857fa640 1 -- 172.21.15.73:0/3339880818 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f098c03b3f0 con 0x7f09900a4d00 2023-12-12T09:45:56.692 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:56.689+0000 7f09857fa640 1 --2- 172.21.15.73:0/3339880818 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f097c06ae40 0x7f097c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:56.692 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:56.690+0000 7f09857fa640 1 -- 172.21.15.73:0/3339880818 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f098c0abaa0 con 0x7f09900a4d00 2023-12-12T09:45:56.692 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:56.690+0000 7f0987fff640 1 --2- 172.21.15.73:0/3339880818 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f097c06ae40 0x7f097c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:56.692 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:56.690+0000 7f0987fff640 1 --2- 172.21.15.73:0/3339880818 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f097c06ae40 0x7f097c06d300 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f09900aa2c0 tx=0x7f0980007c00 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:45:56.695 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:56.694+0000 7f09857fa640 1 -- 172.21.15.73:0/3339880818 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f098c0767e0 con 0x7f09900a4d00 2023-12-12T09:45:56.885 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:56.884+0000 7f0995c6d640 1 -- 172.21.15.73:0/3339880818 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f0990067400 con 0x7f09900a4d00 2023-12-12T09:45:56.886 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:56.885+0000 7f09857fa640 1 -- 172.21.15.73:0/3339880818 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v58) v1 ==== 93+0+10 (secure 0 0 0) 0x7f098c079e00 con 0x7f09900a4d00 2023-12-12T09:45:56.886 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 1 2023-12-12T09:45:56.889 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:56.887+0000 7f0995c6d640 1 -- 172.21.15.73:0/3339880818 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f097c06ae40 msgr2=0x7f097c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:56.889 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:56.887+0000 7f0995c6d640 1 --2- 172.21.15.73:0/3339880818 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f097c06ae40 0x7f097c06d300 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f09900aa2c0 tx=0x7f0980007c00 comp rx=0 tx=0).stop 2023-12-12T09:45:56.889 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:56.887+0000 7f0995c6d640 1 -- 172.21.15.73:0/3339880818 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f09900a4d00 msgr2=0x7f09900c5050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:56.889 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:56.887+0000 7f0995c6d640 1 --2- 172.21.15.73:0/3339880818 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f09900a4d00 0x7f09900c5050 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f098c0097a0 tx=0x7f098c0046c0 comp rx=0 tx=0).stop 2023-12-12T09:45:56.889 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:56.887+0000 7f0995c6d640 1 -- 172.21.15.73:0/3339880818 shutdown_connections 2023-12-12T09:45:56.890 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:56.887+0000 7f0995c6d640 1 --2- 172.21.15.73:0/3339880818 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f097c06ae40 0x7f097c06d300 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:56.890 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:56.887+0000 7f0995c6d640 1 --2- 172.21.15.73:0/3339880818 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f09901529a0 0x7f099006cf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:56.890 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:56.887+0000 7f0995c6d640 1 --2- 172.21.15.73:0/3339880818 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f099014c190 0x7f09900c35d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:56.890 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:56.887+0000 7f0995c6d640 1 --2- 172.21.15.73:0/3339880818 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f09900a4d00 0x7f09900c5050 unknown :-1 s=CLOSED pgs=729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:56.890 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:56.887+0000 7f0995c6d640 1 -- 172.21.15.73:0/3339880818 >> 172.21.15.73:0/3339880818 conn(0x7f099006a4e0 msgr2=0x7f0990148f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:45:56.890 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:56.888+0000 7f0995c6d640 1 -- 172.21.15.73:0/3339880818 shutdown_connections 2023-12-12T09:45:56.890 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:56.888+0000 7f0995c6d640 1 -- 172.21.15.73:0/3339880818 wait complete. 2023-12-12T09:45:56.908 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-12T09:45:57.123 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:57.122+0000 7f6c3432c640 1 Processor -- start 2023-12-12T09:45:57.124 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:57.122+0000 7f6c3432c640 1 -- start start 2023-12-12T09:45:57.126 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:57.124+0000 7f6c3432c640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f6c2c0a4c90 0x7f6c2c0c5420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:57.126 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:57.124+0000 7f6c3432c640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f6c2c0c0320 0x7f6c2c0c20b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:57.126 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:57.124+0000 7f6c3432c640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c2c0c3390 con 0x7f6c2c14ea60 2023-12-12T09:45:57.126 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:57.124+0000 7f6c3432c640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c2c0c0750 con 0x7f6c2c0a4c90 2023-12-12T09:45:57.126 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:57.124+0000 7f6c3432c640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c2c0c4b30 con 0x7f6c2c0c0320 2023-12-12T09:45:57.126 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:57.124+0000 7f6c318c7640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f6c2c0a4c90 0x7f6c2c0c5420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:57.126 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:57.124+0000 7f6c318c7640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f6c2c0a4c90 0x7f6c2c0c5420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:48842/0 (socket says 172.21.15.73:48842) 2023-12-12T09:45:57.126 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:57.124+0000 7f6c318c7640 1 -- 172.21.15.73:0/3030323949 learned_addr learned my addr 172.21.15.73:0/3030323949 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:45:57.126 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:57.124+0000 7f6c328c9640 1 --2- 172.21.15.73:0/3030323949 >> v2:172.21.15.142:3300/0 conn(0x7f6c2c0c0320 0x7f6c2c0c20b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:57.127 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:57.125+0000 7f6c318c7640 1 -- 172.21.15.73:0/3030323949 >> v2:172.21.15.142:3300/0 conn(0x7f6c2c0c0320 msgr2=0x7f6c2c0c20b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:45:57.127 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:57.125+0000 7f6c318c7640 1 --2- 172.21.15.73:0/3030323949 >> v2:172.21.15.142:3300/0 conn(0x7f6c2c0c0320 0x7f6c2c0c20b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:57.127 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:57.125+0000 7f6c318c7640 1 -- 172.21.15.73:0/3030323949 >> v1:172.21.15.142:6789/0 conn(0x7f6c2c14ea60 legacy=0x7f6c2c0c4420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:57.127 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:57.125+0000 7f6c318c7640 1 -- 172.21.15.73:0/3030323949 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c2c151e60 con 0x7f6c2c0a4c90 2023-12-12T09:45:57.128 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:57.126+0000 7f6c318c7640 1 --2- 172.21.15.73:0/3030323949 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6c2c0a4c90 0x7f6c2c0c5420 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7f6c2c1557f0 tx=0x7f6c2002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=771c3225dbd171d server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:45:57.128 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:57.126+0000 7f6c310c6640 1 -- 172.21.15.73:0/3030323949 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c20031870 con 0x7f6c2c0a4c90 2023-12-12T09:45:57.128 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:57.126+0000 7f6c310c6640 1 -- 172.21.15.73:0/3030323949 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c200319d0 con 0x7f6c2c0a4c90 2023-12-12T09:45:57.128 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:57.126+0000 7f6c310c6640 1 -- 172.21.15.73:0/3030323949 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c20031d60 con 0x7f6c2c0a4c90 2023-12-12T09:45:57.129 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:57.127+0000 7f6c3432c640 1 -- 172.21.15.73:0/3030323949 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6c2c0a4c90 msgr2=0x7f6c2c0c5420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:57.129 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:57.127+0000 7f6c3432c640 1 --2- 172.21.15.73:0/3030323949 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6c2c0a4c90 0x7f6c2c0c5420 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7f6c2c1557f0 tx=0x7f6c2002b910 comp rx=0 tx=0).stop 2023-12-12T09:45:57.129 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:57.127+0000 7f6c3432c640 1 -- 172.21.15.73:0/3030323949 shutdown_connections 2023-12-12T09:45:57.129 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:57.127+0000 7f6c3432c640 1 --2- 172.21.15.73:0/3030323949 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6c2c0a4c90 0x7f6c2c0c5420 unknown :-1 s=CLOSED pgs=730 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:57.129 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:57.127+0000 7f6c3432c640 1 --2- 172.21.15.73:0/3030323949 >> v2:172.21.15.142:3300/0 conn(0x7f6c2c0c0320 0x7f6c2c0c20b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:57.129 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:57.127+0000 7f6c3432c640 1 -- 172.21.15.73:0/3030323949 >> 172.21.15.73:0/3030323949 conn(0x7f6c2c06a4e0 msgr2=0x7f6c2c06a8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:45:57.129 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:57.127+0000 7f6c3432c640 1 -- 172.21.15.73:0/3030323949 shutdown_connections 2023-12-12T09:45:57.129 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:57.127+0000 7f6c3432c640 1 -- 172.21.15.73:0/3030323949 wait complete. 2023-12-12T09:45:57.130 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:57.129+0000 7f6c3432c640 1 Processor -- start 2023-12-12T09:45:57.130 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:57.129+0000 7f6c3432c640 1 -- start start 2023-12-12T09:45:57.132 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:57.130+0000 7f6c3432c640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6c2c0a4c90 0x7f6c2c1da390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:57.132 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:57.130+0000 7f6c3432c640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6c2c0c0320 0x7f6c2c1440e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:57.132 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:57.130+0000 7f6c3432c640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6c2c14ea60 0x7f6c2c144c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:57.132 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:57.130+0000 7f6c3432c640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c2c1eb5b0 con 0x7f6c2c0c0320 2023-12-12T09:45:57.132 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:57.130+0000 7f6c3432c640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c2c1ebae0 con 0x7f6c2c14ea60 2023-12-12T09:45:57.132 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:57.130+0000 7f6c3432c640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c2c1d9dd0 con 0x7f6c2c0a4c90 2023-12-12T09:45:57.133 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:57.130+0000 7f6c318c7640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6c2c0c0320 0x7f6c2c1440e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:57.133 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:57.130+0000 7f6c318c7640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6c2c0c0320 0x7f6c2c1440e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:48850/0 (socket says 172.21.15.73:48850) 2023-12-12T09:45:57.133 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:57.130+0000 7f6c318c7640 1 -- 172.21.15.73:0/1085318061 learned_addr learned my addr 172.21.15.73:0/1085318061 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:45:57.133 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:57.130+0000 7f6c320c8640 1 --2- 172.21.15.73:0/1085318061 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6c2c0a4c90 0x7f6c2c1da390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:57.133 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:57.131+0000 7f6c318c7640 1 -- 172.21.15.73:0/1085318061 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6c2c0a4c90 msgr2=0x7f6c2c1da390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:57.133 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:57.131+0000 7f6c328c9640 1 --2- 172.21.15.73:0/1085318061 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6c2c14ea60 0x7f6c2c144c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:57.133 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:57.131+0000 7f6c318c7640 1 --2- 172.21.15.73:0/1085318061 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6c2c0a4c90 0x7f6c2c1da390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:57.133 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:57.131+0000 7f6c318c7640 1 -- 172.21.15.73:0/1085318061 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6c2c14ea60 msgr2=0x7f6c2c144c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:57.133 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:57.131+0000 7f6c318c7640 1 --2- 172.21.15.73:0/1085318061 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6c2c14ea60 0x7f6c2c144c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:57.133 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:57.131+0000 7f6c318c7640 1 -- 172.21.15.73:0/1085318061 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c200094d0 con 0x7f6c2c0c0320 2023-12-12T09:45:57.133 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:57.131+0000 7f6c320c8640 1 --2- 172.21.15.73:0/1085318061 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6c2c0a4c90 0x7f6c2c1da390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:45:57.133 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:57.131+0000 7f6c328c9640 1 --2- 172.21.15.73:0/1085318061 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6c2c14ea60 0x7f6c2c144c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:45:57.133 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:57.131+0000 7f6c318c7640 1 --2- 172.21.15.73:0/1085318061 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6c2c0c0320 0x7f6c2c1440e0 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f6c2002b950 tx=0x7f6c200046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:45:57.134 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:57.131+0000 7f6c2affd640 1 -- 172.21.15.73:0/1085318061 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c2003abe0 con 0x7f6c2c0c0320 2023-12-12T09:45:57.134 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:57.131+0000 7f6c2affd640 1 -- 172.21.15.73:0/1085318061 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c2003ad60 con 0x7f6c2c0c0320 2023-12-12T09:45:57.134 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:57.131+0000 7f6c2affd640 1 -- 172.21.15.73:0/1085318061 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c20044630 con 0x7f6c2c0c0320 2023-12-12T09:45:57.134 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:57.131+0000 7f6c3432c640 1 -- 172.21.15.73:0/1085318061 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c2c1da0b0 con 0x7f6c2c0c0320 2023-12-12T09:45:57.135 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:57.132+0000 7f6c3432c640 1 -- 172.21.15.73:0/1085318061 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c2c1dad70 con 0x7f6c2c0c0320 2023-12-12T09:45:57.135 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:57.133+0000 7f6c3432c640 1 -- 172.21.15.73:0/1085318061 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c2c067070 con 0x7f6c2c0c0320 2023-12-12T09:45:57.135 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:57.134+0000 7f6c2affd640 1 -- 172.21.15.73:0/1085318061 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f6c2004d450 con 0x7f6c2c0c0320 2023-12-12T09:45:57.136 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:57.134+0000 7f6c2affd640 1 --2- 172.21.15.73:0/1085318061 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f6c1806ae40 0x7f6c1806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:57.136 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:57.135+0000 7f6c2affd640 1 -- 172.21.15.73:0/1085318061 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f6c2002d040 con 0x7f6c2c0c0320 2023-12-12T09:45:57.136 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:57.135+0000 7f6c320c8640 1 --2- 172.21.15.73:0/1085318061 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f6c1806ae40 0x7f6c1806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:57.136 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:57.136+0000 7f6c320c8640 1 --2- 172.21.15.73:0/1085318061 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f6c1806ae40 0x7f6c1806d300 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f6c1c0012e0 tx=0x7f6c1c009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:45:57.140 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:57.139+0000 7f6c2affd640 1 -- 172.21.15.73:0/1085318061 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f6c20076c40 con 0x7f6c2c0c0320 2023-12-12T09:45:57.329 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:57.328+0000 7f6c3432c640 1 -- 172.21.15.73:0/1085318061 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f6c2c1daf60 con 0x7f6c2c0c0320 2023-12-12T09:45:57.330 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:57.329+0000 7f6c2affd640 1 -- 172.21.15.73:0/1085318061 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v58) v1 ==== 104+0+11 (secure 0 0 0) 0x7f6c200350a0 con 0x7f6c2c0c0320 2023-12-12T09:45:57.330 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 32 2023-12-12T09:45:57.333 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:57.332+0000 7f6c3432c640 1 -- 172.21.15.73:0/1085318061 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f6c1806ae40 msgr2=0x7f6c1806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:57.334 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:57.332+0000 7f6c3432c640 1 --2- 172.21.15.73:0/1085318061 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f6c1806ae40 0x7f6c1806d300 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f6c1c0012e0 tx=0x7f6c1c009040 comp rx=0 tx=0).stop 2023-12-12T09:45:57.334 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:57.332+0000 7f6c3432c640 1 -- 172.21.15.73:0/1085318061 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6c2c0c0320 msgr2=0x7f6c2c1440e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:57.334 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:57.332+0000 7f6c3432c640 1 --2- 172.21.15.73:0/1085318061 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6c2c0c0320 0x7f6c2c1440e0 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f6c2002b950 tx=0x7f6c200046c0 comp rx=0 tx=0).stop 2023-12-12T09:45:57.334 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:57.332+0000 7f6c3432c640 1 -- 172.21.15.73:0/1085318061 shutdown_connections 2023-12-12T09:45:57.334 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:57.332+0000 7f6c3432c640 1 --2- 172.21.15.73:0/1085318061 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f6c1806ae40 0x7f6c1806d300 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:57.334 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:57.332+0000 7f6c3432c640 1 --2- 172.21.15.73:0/1085318061 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6c2c14ea60 0x7f6c2c144c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:57.334 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:57.332+0000 7f6c3432c640 1 --2- 172.21.15.73:0/1085318061 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6c2c0c0320 0x7f6c2c1440e0 unknown :-1 s=CLOSED pgs=731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:57.334 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:57.332+0000 7f6c3432c640 1 --2- 172.21.15.73:0/1085318061 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6c2c0a4c90 0x7f6c2c1da390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:57.334 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:57.332+0000 7f6c3432c640 1 -- 172.21.15.73:0/1085318061 >> 172.21.15.73:0/1085318061 conn(0x7f6c2c06a4e0 msgr2=0x7f6c2c1dd590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:45:57.334 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:57.332+0000 7f6c3432c640 1 -- 172.21.15.73:0/1085318061 shutdown_connections 2023-12-12T09:45:57.334 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:57.332+0000 7f6c3432c640 1 -- 172.21.15.73:0/1085318061 wait complete. 2023-12-12T09:45:57.352 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-12T09:45:57.572 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:57.570+0000 7fbaa12bb640 1 Processor -- start 2023-12-12T09:45:57.572 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:57.571+0000 7fbaa12bb640 1 -- start start 2023-12-12T09:45:57.573 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:57.572+0000 7fbaa12bb640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fba9c0c6590 0x7fba9c0c6970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:57.573 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:57.572+0000 7fbaa12bb640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba9c0c4540 con 0x7fba9c0c81e0 2023-12-12T09:45:57.574 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:57.572+0000 7fbaa12bb640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba9c0c5030 con 0x7fba9c06c0f0 2023-12-12T09:45:57.574 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:57.572+0000 7fbaa12bb640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba9c154430 con 0x7fba9c0c6590 2023-12-12T09:45:57.574 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:57.572+0000 7fba9b7fe640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7fba9c0c81e0 0x7fba9c154b40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:55842/0 (socket says 172.21.15.73:55842) 2023-12-12T09:45:57.574 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:57.572+0000 7fba9b7fe640 1 -- 172.21.15.73:0/3569481100 learned_addr learned my addr 172.21.15.73:0/3569481100 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-12T09:45:57.576 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:57.573+0000 7fba9bfff640 1 --2- 172.21.15.73:0/3569481100 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fba9c0c6590 0x7fba9c0c6970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:57.576 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:57.573+0000 7fba9affd640 1 -- 172.21.15.73:0/3569481100 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3552116226 0 0) 0x7fba9c0c4540 con 0x7fba9c0c81e0 2023-12-12T09:45:57.576 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:57.573+0000 7fba9affd640 1 -- 172.21.15.73:0/3569481100 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fba88003520 con 0x7fba9c0c81e0 2023-12-12T09:45:57.576 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:57.573+0000 7fba9affd640 1 -- 172.21.15.73:0/3569481100 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1738360512 0 0) 0x7fba88003520 con 0x7fba9c0c81e0 2023-12-12T09:45:57.576 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:57.573+0000 7fba9affd640 1 -- 172.21.15.73:0/3569481100 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fba9c0c6590 msgr2=0x7fba9c0c6970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:45:57.576 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:57.573+0000 7fba9affd640 1 --2- 172.21.15.73:0/3569481100 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fba9c0c6590 0x7fba9c0c6970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:57.576 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:57.573+0000 7fba9affd640 1 -- 172.21.15.73:0/3569481100 >> v1:172.21.15.142:6789/0 conn(0x7fba9c06c0f0 legacy=0x7fba9c15ed50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:45:57.576 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:57.573+0000 7fba9affd640 1 -- 172.21.15.73:0/3569481100 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba9c0c7e00 con 0x7fba9c0c81e0 2023-12-12T09:45:57.576 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:57.573+0000 7fba9affd640 1 -- 172.21.15.73:0/3569481100 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3186547832 0 0) 0x7fba8c001b70 con 0x7fba9c0c81e0 2023-12-12T09:45:57.576 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:57.573+0000 7fba9affd640 1 -- 172.21.15.73:0/3569481100 >> v1:172.21.15.73:6789/0 conn(0x7fba9c0c81e0 legacy=0x7fba9c154b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:57.576 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:57.573+0000 7fba9affd640 1 --2- 172.21.15.73:0/3569481100 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fba9c0c6590 0x7fba880039a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:57.577 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:57.573+0000 7fba9affd640 1 --2- 172.21.15.73:0/3569481100 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fba88003f00 0x7fba880047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:57.577 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:57.573+0000 7fba9affd640 1 --2- 172.21.15.73:0/3569481100 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fba88004d00 0x7fba88005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:57.577 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:57.573+0000 7fba9affd640 1 -- 172.21.15.73:0/3569481100 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba8800ba30 con 0x7fba88004d00 2023-12-12T09:45:57.577 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:57.573+0000 7fba9affd640 1 -- 172.21.15.73:0/3569481100 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba8800bba0 con 0x7fba88003f00 2023-12-12T09:45:57.577 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:57.573+0000 7fba9affd640 1 -- 172.21.15.73:0/3569481100 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba8800bd60 con 0x7fba9c0c6590 2023-12-12T09:45:57.577 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:57.574+0000 7fbaa0aba640 1 --2- 172.21.15.73:0/3569481100 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fba88004d00 0x7fba88005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:57.577 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:57.574+0000 7fba9bfff640 1 --2- 172.21.15.73:0/3569481100 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fba9c0c6590 0x7fba880039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:57.577 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:57.574+0000 7fba9b7fe640 1 --2- 172.21.15.73:0/3569481100 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fba88003f00 0x7fba880047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:57.577 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:57.574+0000 7fbaa0aba640 1 -- 172.21.15.73:0/3569481100 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fba9c0c6590 msgr2=0x7fba880039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:45:57.577 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:57.574+0000 7fbaa0aba640 1 --2- 172.21.15.73:0/3569481100 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fba9c0c6590 0x7fba880039a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:57.577 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:57.574+0000 7fbaa0aba640 1 -- 172.21.15.73:0/3569481100 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fba88003f00 msgr2=0x7fba880047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:45:57.577 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:57.574+0000 7fbaa0aba640 1 --2- 172.21.15.73:0/3569481100 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fba88003f00 0x7fba880047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:57.577 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:57.574+0000 7fbaa0aba640 1 -- 172.21.15.73:0/3569481100 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba88003520 con 0x7fba88004d00 2023-12-12T09:45:57.579 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:57.576+0000 7fbaa0aba640 1 --2- 172.21.15.73:0/3569481100 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fba88004d00 0x7fba88005180 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7fba94003db0 tx=0x7fba880057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a46da8e7a52c75b server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:45:57.579 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:57.576+0000 7fba9affd640 1 -- 172.21.15.73:0/3569481100 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba94032600 con 0x7fba88004d00 2023-12-12T09:45:57.579 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:57.576+0000 7fba9affd640 1 -- 172.21.15.73:0/3569481100 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba9402e050 con 0x7fba88004d00 2023-12-12T09:45:57.579 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:57.576+0000 7fba9affd640 1 -- 172.21.15.73:0/3569481100 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba940329e0 con 0x7fba88004d00 2023-12-12T09:45:57.579 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:57.577+0000 7fbaa12bb640 1 -- 172.21.15.73:0/3569481100 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fba88004d00 msgr2=0x7fba88005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:57.579 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:57.577+0000 7fbaa12bb640 1 --2- 172.21.15.73:0/3569481100 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fba88004d00 0x7fba88005180 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7fba94003db0 tx=0x7fba880057f0 comp rx=0 tx=0).stop 2023-12-12T09:45:57.579 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:57.577+0000 7fbaa0aba640 1 -- 172.21.15.73:0/3569481100 reap_dead start 2023-12-12T09:45:57.579 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:57.577+0000 7fbaa12bb640 1 -- 172.21.15.73:0/3569481100 shutdown_connections 2023-12-12T09:45:57.579 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:57.577+0000 7fbaa12bb640 1 -- 172.21.15.73:0/3569481100 >> 172.21.15.73:0/3569481100 conn(0x7fba9c0ab770 msgr2=0x7fba9c0abb80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:45:57.580 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:57.577+0000 7fbaa12bb640 1 -- 172.21.15.73:0/3569481100 shutdown_connections 2023-12-12T09:45:57.580 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:57.577+0000 7fbaa12bb640 1 -- 172.21.15.73:0/3569481100 wait complete. 2023-12-12T09:45:57.580 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:57.579+0000 7fbaa12bb640 1 Processor -- start 2023-12-12T09:45:57.580 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:57.579+0000 7fbaa12bb640 1 -- start start 2023-12-12T09:45:57.583 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:57.580+0000 7fbaa12bb640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fba88004d00 0x7fba9c0bf500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:57.583 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:57.580+0000 7fbaa12bb640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fba9c0c02b0 0x7fba9c1539f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:57.583 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:57.580+0000 7fbaa12bb640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fba9c1e99c0 0x7fba9c1e9e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:57.583 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:57.580+0000 7fbaa12bb640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba9c1ecf30 con 0x7fba9c1e99c0 2023-12-12T09:45:57.583 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:57.580+0000 7fbaa12bb640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba9c1ea360 con 0x7fba88004d00 2023-12-12T09:45:57.583 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:57.580+0000 7fbaa12bb640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba9c0bfa40 con 0x7fba9c0c02b0 2023-12-12T09:45:57.583 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:57.580+0000 7fbaa0aba640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fba9c1e99c0 0x7fba9c1e9e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:57.583 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:57.580+0000 7fbaa0aba640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fba9c1e99c0 0x7fba9c1e9e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:48872/0 (socket says 172.21.15.73:48872) 2023-12-12T09:45:57.583 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:57.580+0000 7fbaa0aba640 1 -- 172.21.15.73:0/2364271447 learned_addr learned my addr 172.21.15.73:0/2364271447 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:45:57.583 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:57.580+0000 7fba9bfff640 1 --2- 172.21.15.73:0/2364271447 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fba88004d00 0x7fba9c0bf500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:57.583 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:57.580+0000 7fba9b7fe640 1 --2- 172.21.15.73:0/2364271447 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fba9c0c02b0 0x7fba9c1539f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:57.583 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:57.580+0000 7fbaa0aba640 1 -- 172.21.15.73:0/2364271447 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fba9c0c02b0 msgr2=0x7fba9c1539f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:57.584 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:57.580+0000 7fbaa0aba640 1 --2- 172.21.15.73:0/2364271447 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fba9c0c02b0 0x7fba9c1539f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:57.584 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:57.580+0000 7fbaa0aba640 1 -- 172.21.15.73:0/2364271447 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fba88004d00 msgr2=0x7fba9c0bf500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:57.584 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:57.580+0000 7fbaa0aba640 1 --2- 172.21.15.73:0/2364271447 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fba88004d00 0x7fba9c0bf500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:57.584 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:57.580+0000 7fbaa0aba640 1 -- 172.21.15.73:0/2364271447 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba9c0bfd10 con 0x7fba9c1e99c0 2023-12-12T09:45:57.584 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:57.580+0000 7fba9b7fe640 1 --2- 172.21.15.73:0/2364271447 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fba9c0c02b0 0x7fba9c1539f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:45:57.584 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:57.581+0000 7fbaa0aba640 1 --2- 172.21.15.73:0/2364271447 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fba9c1e99c0 0x7fba9c1e9e20 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7fba94003ed0 tx=0x7fba940036f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:45:57.584 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:57.581+0000 7fba98ff9640 1 -- 172.21.15.73:0/2364271447 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba9403d890 con 0x7fba9c1e99c0 2023-12-12T09:45:57.584 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:57.581+0000 7fba98ff9640 1 -- 172.21.15.73:0/2364271447 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba9403da10 con 0x7fba9c1e99c0 2023-12-12T09:45:57.584 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:57.581+0000 7fba98ff9640 1 -- 172.21.15.73:0/2364271447 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba9403ddc0 con 0x7fba9c1e99c0 2023-12-12T09:45:57.584 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:57.581+0000 7fbaa12bb640 1 -- 172.21.15.73:0/2364271447 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba9c1ed140 con 0x7fba9c1e99c0 2023-12-12T09:45:57.584 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:57.581+0000 7fbaa12bb640 1 -- 172.21.15.73:0/2364271447 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba9c1ed700 con 0x7fba9c1e99c0 2023-12-12T09:45:57.585 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:57.583+0000 7fbaa12bb640 1 -- 172.21.15.73:0/2364271447 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba9c067400 con 0x7fba9c1e99c0 2023-12-12T09:45:57.585 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:57.583+0000 7fba98ff9640 1 -- 172.21.15.73:0/2364271447 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fba94039040 con 0x7fba9c1e99c0 2023-12-12T09:45:57.585 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:57.584+0000 7fba98ff9640 1 --2- 172.21.15.73:0/2364271447 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fba7c06ae40 0x7fba7c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:57.586 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:57.584+0000 7fba98ff9640 1 -- 172.21.15.73:0/2364271447 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fba940aaef0 con 0x7fba9c1e99c0 2023-12-12T09:45:57.586 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:57.584+0000 7fba9bfff640 1 --2- 172.21.15.73:0/2364271447 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fba7c06ae40 0x7fba7c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:57.586 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:57.585+0000 7fba9bfff640 1 --2- 172.21.15.73:0/2364271447 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fba7c06ae40 0x7fba7c06d300 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fba840099e0 tx=0x7fba84008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:45:57.590 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:57.589+0000 7fba98ff9640 1 -- 172.21.15.73:0/2364271447 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fba94075c40 con 0x7fba9c1e99c0 2023-12-12T09:45:57.778 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:57.777+0000 7fbaa12bb640 1 -- 172.21.15.73:0/2364271447 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fba9c0c73b0 con 0x7fba9c1e99c0 2023-12-12T09:45:57.779 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:57.778+0000 7fba98ff9640 1 -- 172.21.15.73:0/2364271447 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v58) v1 ==== 100+0+11 (secure 0 0 0) 0x7fba94037070 con 0x7fba9c1e99c0 2023-12-12T09:45:57.779 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 64 2023-12-12T09:45:57.782 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:57.780+0000 7fbaa12bb640 1 -- 172.21.15.73:0/2364271447 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fba7c06ae40 msgr2=0x7fba7c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:57.782 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:57.780+0000 7fbaa12bb640 1 --2- 172.21.15.73:0/2364271447 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fba7c06ae40 0x7fba7c06d300 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fba840099e0 tx=0x7fba84008040 comp rx=0 tx=0).stop 2023-12-12T09:45:57.782 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:57.780+0000 7fbaa12bb640 1 -- 172.21.15.73:0/2364271447 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fba9c1e99c0 msgr2=0x7fba9c1e9e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:57.782 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:57.780+0000 7fbaa12bb640 1 --2- 172.21.15.73:0/2364271447 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fba9c1e99c0 0x7fba9c1e9e20 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7fba94003ed0 tx=0x7fba940036f0 comp rx=0 tx=0).stop 2023-12-12T09:45:57.782 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:57.781+0000 7fbaa12bb640 1 -- 172.21.15.73:0/2364271447 shutdown_connections 2023-12-12T09:45:57.782 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:57.781+0000 7fbaa12bb640 1 --2- 172.21.15.73:0/2364271447 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fba7c06ae40 0x7fba7c06d300 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:57.782 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:57.781+0000 7fbaa12bb640 1 --2- 172.21.15.73:0/2364271447 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fba9c1e99c0 0x7fba9c1e9e20 unknown :-1 s=CLOSED pgs=734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:57.783 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:57.781+0000 7fbaa12bb640 1 --2- 172.21.15.73:0/2364271447 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fba9c0c02b0 0x7fba9c1539f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:57.783 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:57.781+0000 7fbaa12bb640 1 --2- 172.21.15.73:0/2364271447 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fba88004d00 0x7fba9c0bf500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:57.783 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:57.781+0000 7fbaa12bb640 1 -- 172.21.15.73:0/2364271447 >> 172.21.15.73:0/2364271447 conn(0x7fba9c0ab770 msgr2=0x7fba9c154b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:45:57.783 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:57.781+0000 7fbaa12bb640 1 -- 172.21.15.73:0/2364271447 shutdown_connections 2023-12-12T09:45:57.783 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:57.781+0000 7fbaa12bb640 1 -- 172.21.15.73:0/2364271447 wait complete. 2023-12-12T09:45:57.800 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_metadata pg_num 2023-12-12T09:45:58.018 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:58.017+0000 7f58be51d640 1 Processor -- start 2023-12-12T09:45:58.019 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:58.017+0000 7f58be51d640 1 -- start start 2023-12-12T09:45:58.020 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:58.018+0000 7f58be51d640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f58b814ea60 0x7f58b80c5420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:58.020 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:58.019+0000 7f58be51d640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f58b80a4c90 0x7f58b80c0320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:58.020 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:58.019+0000 7f58be51d640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58b80c3390 con 0x7f58b80c4420 2023-12-12T09:45:58.020 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:58.019+0000 7f58be51d640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58b8151e60 con 0x7f58b814ea60 2023-12-12T09:45:58.020 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:58.019+0000 7f58be51d640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58b8152140 con 0x7f58b80a4c90 2023-12-12T09:45:58.020 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:58.019+0000 7f58bcaba640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f58b80c4420 0x7f58b80c20b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:55844/0 (socket says 172.21.15.73:55844) 2023-12-12T09:45:58.020 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:58.019+0000 7f58bcaba640 1 -- 172.21.15.73:0/365272525 learned_addr learned my addr 172.21.15.73:0/365272525 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-12T09:45:58.022 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:58.019+0000 7f58b6ffd640 1 -- 172.21.15.73:0/365272525 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 954971735 0 0) 0x7f58b80c3390 con 0x7f58b80c4420 2023-12-12T09:45:58.022 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:58.019+0000 7f58b6ffd640 1 -- 172.21.15.73:0/365272525 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f58a4005730 con 0x7f58b80c4420 2023-12-12T09:45:58.022 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:58.019+0000 7f58b77fe640 1 --2- 172.21.15.73:0/365272525 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f58b80a4c90 0x7f58b80c0320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:58.022 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:58.019+0000 7f58b7fff640 1 --2- 172.21.15.73:0/365272525 >> v2:172.21.15.142:3300/0 conn(0x7f58b814ea60 0x7f58b80c5420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:58.022 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:58.020+0000 7f58b6ffd640 1 -- 172.21.15.73:0/365272525 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2803203636 0 0) 0x7f58a4005730 con 0x7f58b80c4420 2023-12-12T09:45:58.022 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:58.020+0000 7f58b6ffd640 1 -- 172.21.15.73:0/365272525 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f58b80a4c90 msgr2=0x7f58b80c0320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:45:58.023 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:58.020+0000 7f58b6ffd640 1 --2- 172.21.15.73:0/365272525 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f58b80a4c90 0x7f58b80c0320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:58.023 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:58.020+0000 7f58b6ffd640 1 -- 172.21.15.73:0/365272525 >> v2:172.21.15.142:3300/0 conn(0x7f58b814ea60 msgr2=0x7f58b80c5420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:45:58.023 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:58.020+0000 7f58b6ffd640 1 --2- 172.21.15.73:0/365272525 >> v2:172.21.15.142:3300/0 conn(0x7f58b814ea60 0x7f58b80c5420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:58.023 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:58.020+0000 7f58b6ffd640 1 -- 172.21.15.73:0/365272525 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58b80c3940 con 0x7f58b80c4420 2023-12-12T09:45:58.023 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:58.020+0000 7f58b6ffd640 1 -- 172.21.15.73:0/365272525 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3186547832 0 0) 0x7f58b0001670 con 0x7f58b80c4420 2023-12-12T09:45:58.023 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:58.020+0000 7f58b6ffd640 1 -- 172.21.15.73:0/365272525 >> v1:172.21.15.73:6789/0 conn(0x7f58b80c4420 legacy=0x7f58b80c20b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:58.023 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:58.020+0000 7f58b6ffd640 1 --2- 172.21.15.73:0/365272525 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f58b80a4c90 0x7f58a4005b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:58.023 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:58.020+0000 7f58b6ffd640 1 --2- 172.21.15.73:0/365272525 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f58a40061b0 0x7f58a40069d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:58.023 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:58.020+0000 7f58b6ffd640 1 --2- 172.21.15.73:0/365272525 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f58a4006f10 0x7f58a4007390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:58.023 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:58.020+0000 7f58b6ffd640 1 -- 172.21.15.73:0/365272525 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58b8151e60 con 0x7f58a40061b0 2023-12-12T09:45:58.023 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:58.020+0000 7f58b6ffd640 1 -- 172.21.15.73:0/365272525 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58b8152140 con 0x7f58a4006f10 2023-12-12T09:45:58.023 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:58.020+0000 7f58b6ffd640 1 -- 172.21.15.73:0/365272525 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58a400dd50 con 0x7f58b80a4c90 2023-12-12T09:45:58.023 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:58.020+0000 7f58b77fe640 1 --2- 172.21.15.73:0/365272525 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f58a40061b0 0x7f58a40069d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:58.024 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:58.020+0000 7f58b7fff640 1 --2- 172.21.15.73:0/365272525 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f58b80a4c90 0x7f58a4005b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:58.024 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:58.020+0000 7f58bcaba640 1 --2- 172.21.15.73:0/365272525 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f58a4006f10 0x7f58a4007390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:58.024 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:58.020+0000 7f58b77fe640 1 -- 172.21.15.73:0/365272525 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f58b80a4c90 msgr2=0x7f58a4005b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:45:58.024 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:58.020+0000 7f58b77fe640 1 --2- 172.21.15.73:0/365272525 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f58b80a4c90 0x7f58a4005b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:58.024 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:58.020+0000 7f58b77fe640 1 -- 172.21.15.73:0/365272525 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f58a4006f10 msgr2=0x7f58a4007390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:45:58.024 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:58.020+0000 7f58b77fe640 1 --2- 172.21.15.73:0/365272525 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f58a4006f10 0x7f58a4007390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:58.024 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:58.021+0000 7f58b77fe640 1 -- 172.21.15.73:0/365272525 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58a4005730 con 0x7f58a40061b0 2023-12-12T09:45:58.026 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:58.022+0000 7f58b77fe640 1 --2- 172.21.15.73:0/365272525 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f58a40061b0 0x7f58a40069d0 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f58a000ba30 tx=0x7f58a4007a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=421869eb19432953 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:45:58.026 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:58.022+0000 7f58b6ffd640 1 -- 172.21.15.73:0/365272525 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58a0032640 con 0x7f58a40061b0 2023-12-12T09:45:58.026 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:58.022+0000 7f58b6ffd640 1 -- 172.21.15.73:0/365272525 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58a00327a0 con 0x7f58a40061b0 2023-12-12T09:45:58.026 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:58.022+0000 7f58b6ffd640 1 -- 172.21.15.73:0/365272525 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58a0032b30 con 0x7f58a40061b0 2023-12-12T09:45:58.026 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:58.022+0000 7f58be51d640 1 -- 172.21.15.73:0/365272525 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f58a40061b0 msgr2=0x7f58a40069d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:58.026 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:58.022+0000 7f58be51d640 1 --2- 172.21.15.73:0/365272525 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f58a40061b0 0x7f58a40069d0 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f58a000ba30 tx=0x7f58a4007a00 comp rx=0 tx=0).stop 2023-12-12T09:45:58.026 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:58.022+0000 7f58bcaba640 1 -- 172.21.15.73:0/365272525 reap_dead start 2023-12-12T09:45:58.026 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:58.022+0000 7f58be51d640 1 -- 172.21.15.73:0/365272525 shutdown_connections 2023-12-12T09:45:58.026 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:58.022+0000 7f58be51d640 1 -- 172.21.15.73:0/365272525 >> 172.21.15.73:0/365272525 conn(0x7f58b806a4e0 msgr2=0x7f58b806a8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:45:58.026 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:58.023+0000 7f58be51d640 1 -- 172.21.15.73:0/365272525 shutdown_connections 2023-12-12T09:45:58.027 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:58.023+0000 7f58be51d640 1 -- 172.21.15.73:0/365272525 wait complete. 2023-12-12T09:45:58.027 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:58.024+0000 7f58be51d640 1 Processor -- start 2023-12-12T09:45:58.027 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:58.024+0000 7f58be51d640 1 -- start start 2023-12-12T09:45:58.029 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:58.025+0000 7f58be51d640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f58a40061b0 0x7f58b814ab20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:58.029 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:58.025+0000 7f58be51d640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f58b8148200 0x7f58b81475d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:58.029 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:58.025+0000 7f58be51d640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f58b8147b10 0x7f58b814f770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:58.029 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:58.025+0000 7f58be51d640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58b8147fc0 con 0x7f58a40061b0 2023-12-12T09:45:58.029 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:58.025+0000 7f58be51d640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58b80a7380 con 0x7f58b8147b10 2023-12-12T09:45:58.029 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:58.025+0000 7f58be51d640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58b81513f0 con 0x7f58b8148200 2023-12-12T09:45:58.029 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:58.026+0000 7f58b7fff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f58a40061b0 0x7f58b814ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:58.029 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:58.026+0000 7f58b7fff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f58a40061b0 0x7f58b814ab20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:48884/0 (socket says 172.21.15.73:48884) 2023-12-12T09:45:58.029 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:58.026+0000 7f58b7fff640 1 -- 172.21.15.73:0/827994776 learned_addr learned my addr 172.21.15.73:0/827994776 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:45:58.029 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:58.026+0000 7f58b7fff640 1 -- 172.21.15.73:0/827994776 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f58b8148200 msgr2=0x7f58b81475d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:58.030 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:58.026+0000 7f58b7fff640 1 --2- 172.21.15.73:0/827994776 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f58b8148200 0x7f58b81475d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:58.030 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:58.026+0000 7f58b7fff640 1 -- 172.21.15.73:0/827994776 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f58b8147b10 msgr2=0x7f58b814f770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:58.030 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:58.026+0000 7f58b7fff640 1 --2- 172.21.15.73:0/827994776 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f58b8147b10 0x7f58b814f770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:58.030 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:58.026+0000 7f58b7fff640 1 -- 172.21.15.73:0/827994776 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58b81ea9d0 con 0x7f58a40061b0 2023-12-12T09:45:58.030 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:58.026+0000 7f58b7fff640 1 --2- 172.21.15.73:0/827994776 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f58a40061b0 0x7f58b814ab20 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f58a8009cb0 tx=0x7f58a8007700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:45:58.030 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:58.027+0000 7f58b4ff9640 1 -- 172.21.15.73:0/827994776 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58a8014610 con 0x7f58a40061b0 2023-12-12T09:45:58.030 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:58.027+0000 7f58b4ff9640 1 -- 172.21.15.73:0/827994776 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58a800f050 con 0x7f58a40061b0 2023-12-12T09:45:58.030 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:58.027+0000 7f58b4ff9640 1 -- 172.21.15.73:0/827994776 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58a80149d0 con 0x7f58a40061b0 2023-12-12T09:45:58.030 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:58.027+0000 7f58be51d640 1 -- 172.21.15.73:0/827994776 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58b8150e30 con 0x7f58a40061b0 2023-12-12T09:45:58.030 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:58.027+0000 7f58be51d640 1 -- 172.21.15.73:0/827994776 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58b814f250 con 0x7f58a40061b0 2023-12-12T09:45:58.031 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:58.028+0000 7f58be51d640 1 -- 172.21.15.73:0/827994776 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f58b814f0b0 con 0x7f58a40061b0 2023-12-12T09:45:58.031 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:58.029+0000 7f58b4ff9640 1 -- 172.21.15.73:0/827994776 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f58a8014b30 con 0x7f58a40061b0 2023-12-12T09:45:58.031 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:58.030+0000 7f58b4ff9640 1 --2- 172.21.15.73:0/827994776 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f589806ae70 0x7f589806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:58.031 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:58.030+0000 7f58b4ff9640 1 -- 172.21.15.73:0/827994776 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f58a808a260 con 0x7f58a40061b0 2023-12-12T09:45:58.032 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:58.030+0000 7f58b77fe640 1 --2- 172.21.15.73:0/827994776 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f589806ae70 0x7f589806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:58.032 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:58.031+0000 7f58b77fe640 1 --2- 172.21.15.73:0/827994776 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f589806ae70 0x7f589806d330 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f58a000ba00 tx=0x7f58a0032000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:45:58.035 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:58.034+0000 7f58b4ff9640 1 -- 172.21.15.73:0/827994776 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f58b814f0b0 con 0x7f58a40061b0 2023-12-12T09:45:58.227 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:58.225+0000 7f58be51d640 1 -- 172.21.15.73:0/827994776 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"} v 0) v1 -- 0x7f58b814f0b0 con 0x7f58a40061b0 2023-12-12T09:45:58.228 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:58.226+0000 7f58b4ff9640 1 -- 172.21.15.73:0/827994776 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"}]=0 v58) v1 ==== 105+0+11 (secure 0 0 0) 0x7f58b814f0b0 con 0x7f58a40061b0 2023-12-12T09:45:58.228 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 32 2023-12-12T09:45:58.230 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:58.229+0000 7f58be51d640 1 -- 172.21.15.73:0/827994776 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f589806ae70 msgr2=0x7f589806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:58.230 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:58.229+0000 7f58be51d640 1 --2- 172.21.15.73:0/827994776 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f589806ae70 0x7f589806d330 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f58a000ba00 tx=0x7f58a0032000 comp rx=0 tx=0).stop 2023-12-12T09:45:58.231 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:58.229+0000 7f58be51d640 1 -- 172.21.15.73:0/827994776 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f58a40061b0 msgr2=0x7f58b814ab20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:58.231 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:58.229+0000 7f58be51d640 1 --2- 172.21.15.73:0/827994776 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f58a40061b0 0x7f58b814ab20 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f58a8009cb0 tx=0x7f58a8007700 comp rx=0 tx=0).stop 2023-12-12T09:45:58.231 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:58.229+0000 7f58be51d640 1 -- 172.21.15.73:0/827994776 shutdown_connections 2023-12-12T09:45:58.231 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:58.229+0000 7f58be51d640 1 --2- 172.21.15.73:0/827994776 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f589806ae70 0x7f589806d330 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:58.231 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:58.229+0000 7f58be51d640 1 --2- 172.21.15.73:0/827994776 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f58b8147b10 0x7f58b814f770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:58.232 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:58.229+0000 7f58be51d640 1 --2- 172.21.15.73:0/827994776 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f58b8148200 0x7f58b81475d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:58.232 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:58.229+0000 7f58be51d640 1 --2- 172.21.15.73:0/827994776 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f58a40061b0 0x7f58b814ab20 unknown :-1 s=CLOSED pgs=737 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:58.232 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:58.229+0000 7f58be51d640 1 -- 172.21.15.73:0/827994776 >> 172.21.15.73:0/827994776 conn(0x7f58b806a4e0 msgr2=0x7f58b8070d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:45:58.232 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:58.230+0000 7f58be51d640 1 -- 172.21.15.73:0/827994776 shutdown_connections 2023-12-12T09:45:58.232 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:58.230+0000 7f58be51d640 1 -- 172.21.15.73:0/827994776 wait complete. 2023-12-12T09:45:58.251 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_data pg_num 2023-12-12T09:45:58.470 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:58.468+0000 7f55d779e640 1 Processor -- start 2023-12-12T09:45:58.470 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:58.468+0000 7f55d779e640 1 -- start start 2023-12-12T09:45:58.471 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:58.470+0000 7f55d779e640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f55d014f8c0 0x7f55d006dc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:58.471 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:58.470+0000 7f55d779e640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55d00c16c0 con 0x7f55d0152500 2023-12-12T09:45:58.471 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:58.470+0000 7f55d779e640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55d00c19a0 con 0x7f55d006d350 2023-12-12T09:45:58.471 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:58.470+0000 7f55d779e640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55d00c1090 con 0x7f55d014f8c0 2023-12-12T09:45:58.472 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:58.470+0000 7f55d5d3b640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f55d0152500 0x7f55d0152990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:55852/0 (socket says 172.21.15.73:55852) 2023-12-12T09:45:58.472 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:58.470+0000 7f55d5d3b640 1 -- 172.21.15.73:0/1344063562 learned_addr learned my addr 172.21.15.73:0/1344063562 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-12T09:45:58.473 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:58.470+0000 7f55c7fff640 1 -- 172.21.15.73:0/1344063562 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 433676042 0 0) 0x7f55d00c16c0 con 0x7f55d0152500 2023-12-12T09:45:58.474 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:58.471+0000 7f55d553a640 1 --2- 172.21.15.73:0/1344063562 >> v2:172.21.15.142:3300/0 conn(0x7f55d014f8c0 0x7f55d006dc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:58.474 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:58.471+0000 7f55c7fff640 1 -- 172.21.15.73:0/1344063562 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f55bc003520 con 0x7f55d0152500 2023-12-12T09:45:58.474 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:58.471+0000 7f55c7fff640 1 -- 172.21.15.73:0/1344063562 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3014159362 0 0) 0x7f55bc003520 con 0x7f55d0152500 2023-12-12T09:45:58.474 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:58.471+0000 7f55c7fff640 1 -- 172.21.15.73:0/1344063562 >> v2:172.21.15.142:3300/0 conn(0x7f55d014f8c0 msgr2=0x7f55d006dc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:45:58.474 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:58.471+0000 7f55c7fff640 1 --2- 172.21.15.73:0/1344063562 >> v2:172.21.15.142:3300/0 conn(0x7f55d014f8c0 0x7f55d006dc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:58.474 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:58.471+0000 7f55c7fff640 1 -- 172.21.15.73:0/1344063562 >> v1:172.21.15.142:6789/0 conn(0x7f55d006d350 legacy=0x7f55d0071e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:58.474 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:58.471+0000 7f55c7fff640 1 -- 172.21.15.73:0/1344063562 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55d00c1c80 con 0x7f55d0152500 2023-12-12T09:45:58.474 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:58.471+0000 7f55c7fff640 1 -- 172.21.15.73:0/1344063562 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3186547832 0 0) 0x7f55c80019f0 con 0x7f55d0152500 2023-12-12T09:45:58.474 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:58.471+0000 7f55c7fff640 1 -- 172.21.15.73:0/1344063562 >> v1:172.21.15.73:6789/0 conn(0x7f55d0152500 legacy=0x7f55d0152990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:58.474 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:58.471+0000 7f55c7fff640 1 --2- 172.21.15.73:0/1344063562 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f55bc0039c0 0x7f55bc003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:58.474 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:58.471+0000 7f55c7fff640 1 --2- 172.21.15.73:0/1344063562 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f55bc0047c0 0x7f55bc004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:58.474 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:58.471+0000 7f55c7fff640 1 --2- 172.21.15.73:0/1344063562 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f55bc005180 0x7f55bc00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:58.475 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:58.471+0000 7f55c7fff640 1 -- 172.21.15.73:0/1344063562 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55bc00c050 con 0x7f55bc0039c0 2023-12-12T09:45:58.475 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:58.471+0000 7f55c7fff640 1 -- 172.21.15.73:0/1344063562 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55bc00c1c0 con 0x7f55bc005180 2023-12-12T09:45:58.475 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:58.471+0000 7f55c7fff640 1 -- 172.21.15.73:0/1344063562 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55bc00c380 con 0x7f55bc0047c0 2023-12-12T09:45:58.475 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:58.472+0000 7f55d553a640 1 --2- 172.21.15.73:0/1344063562 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f55bc0039c0 0x7f55bc003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:58.475 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:58.472+0000 7f55d553a640 1 -- 172.21.15.73:0/1344063562 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f55bc0047c0 msgr2=0x7f55bc004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:45:58.475 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:58.472+0000 7f55d553a640 1 --2- 172.21.15.73:0/1344063562 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f55bc0047c0 0x7f55bc004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:58.475 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:58.472+0000 7f55d553a640 1 -- 172.21.15.73:0/1344063562 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f55bc005180 msgr2=0x7f55bc00b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:45:58.475 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:58.472+0000 7f55d5d3b640 1 --2- 172.21.15.73:0/1344063562 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f55bc005180 0x7f55bc00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:58.475 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:58.472+0000 7f55d553a640 1 --2- 172.21.15.73:0/1344063562 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f55bc005180 0x7f55bc00b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:58.475 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:58.472+0000 7f55d553a640 1 -- 172.21.15.73:0/1344063562 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55bc003520 con 0x7f55bc0039c0 2023-12-12T09:45:58.475 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:58.472+0000 7f55d5d3b640 1 --2- 172.21.15.73:0/1344063562 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f55bc005180 0x7f55bc00b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:45:58.475 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:58.472+0000 7f55d5d3b640 1 -- 172.21.15.73:0/1344063562 reap_dead start 2023-12-12T09:45:58.476 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:58.473+0000 7f55d553a640 1 --2- 172.21.15.73:0/1344063562 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f55bc0039c0 0x7f55bc003de0 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f55cc009ac0 tx=0x7f55bc0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e8deaa1b4177c4b server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:45:58.476 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:58.473+0000 7f55c7fff640 1 -- 172.21.15.73:0/1344063562 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55cc02c6b0 con 0x7f55bc0039c0 2023-12-12T09:45:58.476 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:58.473+0000 7f55c7fff640 1 -- 172.21.15.73:0/1344063562 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55cc02c810 con 0x7f55bc0039c0 2023-12-12T09:45:58.477 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:58.473+0000 7f55c7fff640 1 -- 172.21.15.73:0/1344063562 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55cc02cba0 con 0x7f55bc0039c0 2023-12-12T09:45:58.477 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:58.474+0000 7f55d779e640 1 -- 172.21.15.73:0/1344063562 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f55bc0039c0 msgr2=0x7f55bc003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:58.477 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:58.474+0000 7f55d779e640 1 --2- 172.21.15.73:0/1344063562 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f55bc0039c0 0x7f55bc003de0 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f55cc009ac0 tx=0x7f55bc0057f0 comp rx=0 tx=0).stop 2023-12-12T09:45:58.477 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:58.474+0000 7f55d779e640 1 -- 172.21.15.73:0/1344063562 shutdown_connections 2023-12-12T09:45:58.477 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:58.474+0000 7f55d779e640 1 --2- 172.21.15.73:0/1344063562 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f55bc0039c0 0x7f55bc003de0 unknown :-1 s=CLOSED pgs=739 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:58.477 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:58.474+0000 7f55d779e640 1 -- 172.21.15.73:0/1344063562 >> 172.21.15.73:0/1344063562 conn(0x7f55d006a4e0 msgr2=0x7f55d006a8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:45:58.477 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:58.474+0000 7f55d779e640 1 -- 172.21.15.73:0/1344063562 shutdown_connections 2023-12-12T09:45:58.477 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:58.474+0000 7f55d779e640 1 -- 172.21.15.73:0/1344063562 wait complete. 2023-12-12T09:45:58.477 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:58.476+0000 7f55d779e640 1 Processor -- start 2023-12-12T09:45:58.478 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:58.476+0000 7f55d779e640 1 -- start start 2023-12-12T09:45:58.480 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:58.477+0000 7f55d779e640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f55bc0039c0 0x7f55d0150350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:58.480 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:58.477+0000 7f55d779e640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f55d0154000 0x7f55d01ea780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:58.480 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:58.477+0000 7f55d779e640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f55d01513c0 0x7f55d0155970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:58.480 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:58.477+0000 7f55d779e640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55d0148a50 con 0x7f55d0154000 2023-12-12T09:45:58.480 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:58.477+0000 7f55d779e640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55d0150890 con 0x7f55d01513c0 2023-12-12T09:45:58.481 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:58.477+0000 7f55d779e640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55d0152120 con 0x7f55bc0039c0 2023-12-12T09:45:58.481 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:58.477+0000 7f55d4d39640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f55d0154000 0x7f55d01ea780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:58.481 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:58.477+0000 7f55d4d39640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f55d0154000 0x7f55d01ea780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:48910/0 (socket says 172.21.15.73:48910) 2023-12-12T09:45:58.481 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:58.477+0000 7f55d4d39640 1 -- 172.21.15.73:0/3181570442 learned_addr learned my addr 172.21.15.73:0/3181570442 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:45:58.481 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:58.477+0000 7f55d5d3b640 1 --2- 172.21.15.73:0/3181570442 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f55d01513c0 0x7f55d0155970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:58.481 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:58.477+0000 7f55d553a640 1 --2- 172.21.15.73:0/3181570442 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f55bc0039c0 0x7f55d0150350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:58.481 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:58.478+0000 7f55d4d39640 1 -- 172.21.15.73:0/3181570442 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f55bc0039c0 msgr2=0x7f55d0150350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:58.481 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:58.478+0000 7f55d4d39640 1 --2- 172.21.15.73:0/3181570442 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f55bc0039c0 0x7f55d0150350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:58.481 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:58.478+0000 7f55d4d39640 1 -- 172.21.15.73:0/3181570442 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f55d01513c0 msgr2=0x7f55d0155970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:58.481 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:58.478+0000 7f55d4d39640 1 --2- 172.21.15.73:0/3181570442 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f55d01513c0 0x7f55d0155970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:58.481 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:58.478+0000 7f55d4d39640 1 -- 172.21.15.73:0/3181570442 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55d0150ae0 con 0x7f55d0154000 2023-12-12T09:45:58.481 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:58.478+0000 7f55d553a640 1 --2- 172.21.15.73:0/3181570442 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f55bc0039c0 0x7f55d0150350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:45:58.481 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:58.478+0000 7f55d4d39640 1 --2- 172.21.15.73:0/3181570442 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f55d0154000 0x7f55d01ea780 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f55c000c560 tx=0x7f55c000ca20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:45:58.481 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:58.478+0000 7f55c5ffb640 1 -- 172.21.15.73:0/3181570442 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55c00052d0 con 0x7f55d0154000 2023-12-12T09:45:58.482 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:58.478+0000 7f55c5ffb640 1 -- 172.21.15.73:0/3181570442 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55c0005470 con 0x7f55d0154000 2023-12-12T09:45:58.482 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:58.478+0000 7f55c5ffb640 1 -- 172.21.15.73:0/3181570442 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55c0012870 con 0x7f55d0154000 2023-12-12T09:45:58.482 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:58.478+0000 7f55d779e640 1 -- 172.21.15.73:0/3181570442 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55d0150dc0 con 0x7f55d0154000 2023-12-12T09:45:58.482 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:58.478+0000 7f55d779e640 1 -- 172.21.15.73:0/3181570442 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55d00a6dd0 con 0x7f55d0154000 2023-12-12T09:45:58.482 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:58.479+0000 7f55d779e640 1 -- 172.21.15.73:0/3181570442 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f55d0067070 con 0x7f55d0154000 2023-12-12T09:45:58.482 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:58.480+0000 7f55c5ffb640 1 -- 172.21.15.73:0/3181570442 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f55c00129d0 con 0x7f55d0154000 2023-12-12T09:45:58.483 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:58.482+0000 7f55c5ffb640 1 --2- 172.21.15.73:0/3181570442 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f55b406ae70 0x7f55b406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:58.483 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:58.482+0000 7f55c5ffb640 1 -- 172.21.15.73:0/3181570442 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f55c0089440 con 0x7f55d0154000 2023-12-12T09:45:58.483 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:58.482+0000 7f55d553a640 1 --2- 172.21.15.73:0/3181570442 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f55b406ae70 0x7f55b406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:58.484 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:58.483+0000 7f55d553a640 1 --2- 172.21.15.73:0/3181570442 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f55b406ae70 0x7f55b406d330 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f55cc036000 tx=0x7f55cc030000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:45:58.490 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:58.487+0000 7f55c5ffb640 1 -- 172.21.15.73:0/3181570442 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f55c0054180 con 0x7f55d0154000 2023-12-12T09:45:58.677 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:58.676+0000 7f55d779e640 1 -- 172.21.15.73:0/3181570442 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"} v 0) v1 -- 0x7f55d00c16c0 con 0x7f55d0154000 2023-12-12T09:45:58.678 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:58.677+0000 7f55c5ffb640 1 -- 172.21.15.73:0/3181570442 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"}]=0 v58) v1 ==== 101+0+11 (secure 0 0 0) 0x7f55c00577a0 con 0x7f55d0154000 2023-12-12T09:45:58.678 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 64 2023-12-12T09:45:58.681 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:58.679+0000 7f55d779e640 1 -- 172.21.15.73:0/3181570442 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f55b406ae70 msgr2=0x7f55b406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:58.681 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:58.679+0000 7f55d779e640 1 --2- 172.21.15.73:0/3181570442 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f55b406ae70 0x7f55b406d330 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f55cc036000 tx=0x7f55cc030000 comp rx=0 tx=0).stop 2023-12-12T09:45:58.681 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:58.680+0000 7f55d779e640 1 -- 172.21.15.73:0/3181570442 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f55d0154000 msgr2=0x7f55d01ea780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:58.681 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:58.680+0000 7f55d779e640 1 --2- 172.21.15.73:0/3181570442 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f55d0154000 0x7f55d01ea780 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f55c000c560 tx=0x7f55c000ca20 comp rx=0 tx=0).stop 2023-12-12T09:45:58.682 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:58.680+0000 7f55d779e640 1 -- 172.21.15.73:0/3181570442 shutdown_connections 2023-12-12T09:45:58.682 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:58.680+0000 7f55d779e640 1 --2- 172.21.15.73:0/3181570442 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f55b406ae70 0x7f55b406d330 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:58.682 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:58.680+0000 7f55d779e640 1 --2- 172.21.15.73:0/3181570442 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f55d01513c0 0x7f55d0155970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:58.682 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:58.680+0000 7f55d779e640 1 --2- 172.21.15.73:0/3181570442 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f55d0154000 0x7f55d01ea780 unknown :-1 s=CLOSED pgs=740 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:58.682 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:58.680+0000 7f55d779e640 1 --2- 172.21.15.73:0/3181570442 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f55bc0039c0 0x7f55d0150350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:58.682 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:58.680+0000 7f55d779e640 1 -- 172.21.15.73:0/3181570442 >> 172.21.15.73:0/3181570442 conn(0x7f55d006a4e0 msgr2=0x7f55d00bfa90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:45:58.682 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:58.680+0000 7f55d779e640 1 -- 172.21.15.73:0/3181570442 shutdown_connections 2023-12-12T09:45:58.682 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:58.680+0000 7f55d779e640 1 -- 172.21.15.73:0/3181570442 wait complete. 2023-12-12T09:45:58.702 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-12T09:45:58.911 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:58.910+0000 7fef5c1d7640 1 Processor -- start 2023-12-12T09:45:58.911 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:58.910+0000 7fef5c1d7640 1 -- start start 2023-12-12T09:45:58.913 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:58.911+0000 7fef5c1d7640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fef540c1a60 0x7fef54151b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:58.913 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:58.911+0000 7fef5c1d7640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fef540a4f40 0x7fef54154860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:58.913 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:58.911+0000 7fef5c1d7640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef541589a0 con 0x7fef540c4c10 2023-12-12T09:45:58.913 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:58.911+0000 7fef5c1d7640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef5406c120 con 0x7fef540a4f40 2023-12-12T09:45:58.913 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:58.911+0000 7fef5c1d7640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef54157d90 con 0x7fef540c1a60 2023-12-12T09:45:58.913 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:58.912+0000 7fef59772640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fef540a4f40 0x7fef54154860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:58.914 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:58.912+0000 7fef5a774640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7fef540c4c10 0x7fef54154da0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:55738/0 (socket says 172.21.15.73:55738) 2023-12-12T09:45:58.914 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:58.912+0000 7fef5a774640 1 -- 172.21.15.73:0/3042123753 learned_addr learned my addr 172.21.15.73:0/3042123753 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-12T09:45:58.914 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:58.912+0000 7fef59f73640 1 --2- 172.21.15.73:0/3042123753 >> v2:172.21.15.142:3300/0 conn(0x7fef540c1a60 0x7fef54151b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:58.914 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:58.912+0000 7fef59772640 1 -- 172.21.15.73:0/3042123753 >> v2:172.21.15.142:3300/0 conn(0x7fef540c1a60 msgr2=0x7fef54151b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:45:58.914 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:58.912+0000 7fef59772640 1 --2- 172.21.15.73:0/3042123753 >> v2:172.21.15.142:3300/0 conn(0x7fef540c1a60 0x7fef54151b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:58.915 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:58.912+0000 7fef59772640 1 -- 172.21.15.73:0/3042123753 >> v1:172.21.15.73:6789/0 conn(0x7fef540c4c10 legacy=0x7fef54154da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:58.915 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:58.912+0000 7fef59772640 1 -- 172.21.15.73:0/3042123753 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef54158070 con 0x7fef540a4f40 2023-12-12T09:45:58.915 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:58.912+0000 7fef58f71640 1 -- 172.21.15.73:0/3042123753 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1961072703 0 0) 0x7fef541589a0 con 0x7fef540c4c10 2023-12-12T09:45:58.915 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:58.913+0000 7fef59772640 1 --2- 172.21.15.73:0/3042123753 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fef540a4f40 0x7fef54154860 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7fef54072c40 tx=0x7fef4802b7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac221863b458b504 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:45:58.916 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:58.914+0000 7fef58f71640 1 -- 172.21.15.73:0/3042123753 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef48031710 con 0x7fef540a4f40 2023-12-12T09:45:58.916 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:58.914+0000 7fef58f71640 1 -- 172.21.15.73:0/3042123753 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef4802f050 con 0x7fef540a4f40 2023-12-12T09:45:58.916 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:58.914+0000 7fef58f71640 1 -- 172.21.15.73:0/3042123753 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef48031a90 con 0x7fef540a4f40 2023-12-12T09:45:58.916 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:58.914+0000 7fef5c1d7640 1 -- 172.21.15.73:0/3042123753 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fef540a4f40 msgr2=0x7fef54154860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:58.916 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:58.914+0000 7fef5c1d7640 1 --2- 172.21.15.73:0/3042123753 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fef540a4f40 0x7fef54154860 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7fef54072c40 tx=0x7fef4802b7b0 comp rx=0 tx=0).stop 2023-12-12T09:45:58.916 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:58.914+0000 7fef5c1d7640 1 -- 172.21.15.73:0/3042123753 shutdown_connections 2023-12-12T09:45:58.916 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:58.914+0000 7fef5c1d7640 1 --2- 172.21.15.73:0/3042123753 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fef540a4f40 0x7fef54154860 unknown :-1 s=CLOSED pgs=742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:58.916 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:58.914+0000 7fef5c1d7640 1 --2- 172.21.15.73:0/3042123753 >> v2:172.21.15.142:3300/0 conn(0x7fef540c1a60 0x7fef54151b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:58.916 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:58.914+0000 7fef5c1d7640 1 -- 172.21.15.73:0/3042123753 >> 172.21.15.73:0/3042123753 conn(0x7fef540a77d0 msgr2=0x7fef540a7bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:45:58.916 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:58.915+0000 7fef5c1d7640 1 -- 172.21.15.73:0/3042123753 shutdown_connections 2023-12-12T09:45:58.917 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:58.915+0000 7fef5c1d7640 1 -- 172.21.15.73:0/3042123753 wait complete. 2023-12-12T09:45:58.917 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:58.916+0000 7fef5c1d7640 1 Processor -- start 2023-12-12T09:45:58.917 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:58.916+0000 7fef5c1d7640 1 -- start start 2023-12-12T09:45:58.919 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:58.917+0000 7fef5c1d7640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fef540a4f40 0x7fef540c0890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:58.919 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:58.917+0000 7fef5c1d7640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fef540c1a60 0x7fef541ecc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:58.919 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:58.917+0000 7fef5c1d7640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fef540c4c10 0x7fef541ed140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:58.919 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:58.917+0000 7fef5c1d7640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef54152fe0 con 0x7fef540a4f40 2023-12-12T09:45:58.919 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:58.917+0000 7fef5c1d7640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef541ed680 con 0x7fef540c1a60 2023-12-12T09:45:58.919 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:58.917+0000 7fef5c1d7640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef540c3440 con 0x7fef540c4c10 2023-12-12T09:45:58.920 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:58.917+0000 7fef59f73640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fef540a4f40 0x7fef540c0890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:58.920 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:58.917+0000 7fef59f73640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fef540a4f40 0x7fef540c0890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:44474/0 (socket says 172.21.15.73:44474) 2023-12-12T09:45:58.920 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:58.917+0000 7fef59f73640 1 -- 172.21.15.73:0/592518045 learned_addr learned my addr 172.21.15.73:0/592518045 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:45:58.920 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:58.918+0000 7fef59f73640 1 -- 172.21.15.73:0/592518045 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fef540c4c10 msgr2=0x7fef541ed140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:58.920 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:58.918+0000 7fef59f73640 1 --2- 172.21.15.73:0/592518045 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fef540c4c10 0x7fef541ed140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:58.920 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:58.918+0000 7fef59f73640 1 -- 172.21.15.73:0/592518045 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fef540c1a60 msgr2=0x7fef541ecc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:58.920 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:58.918+0000 7fef59f73640 1 --2- 172.21.15.73:0/592518045 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fef540c1a60 0x7fef541ecc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:58.920 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:58.918+0000 7fef59f73640 1 -- 172.21.15.73:0/592518045 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef48009400 con 0x7fef540a4f40 2023-12-12T09:45:58.921 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:58.918+0000 7fef59f73640 1 --2- 172.21.15.73:0/592518045 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fef540a4f40 0x7fef540c0890 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7fef5000d620 tx=0x7fef5000dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:45:58.921 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:58.918+0000 7fef467fc640 1 -- 172.21.15.73:0/592518045 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef5000b620 con 0x7fef540a4f40 2023-12-12T09:45:58.921 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:58.918+0000 7fef467fc640 1 -- 172.21.15.73:0/592518045 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef5000b780 con 0x7fef540a4f40 2023-12-12T09:45:58.921 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:58.918+0000 7fef467fc640 1 -- 172.21.15.73:0/592518045 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef5000bb10 con 0x7fef540a4f40 2023-12-12T09:45:58.921 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:58.918+0000 7fef5c1d7640 1 -- 172.21.15.73:0/592518045 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef541ea580 con 0x7fef540a4f40 2023-12-12T09:45:58.921 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:58.919+0000 7fef5c1d7640 1 -- 172.21.15.73:0/592518045 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef54154320 con 0x7fef540a4f40 2023-12-12T09:45:58.921 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:58.920+0000 7fef5c1d7640 1 -- 172.21.15.73:0/592518045 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef541544b0 con 0x7fef540a4f40 2023-12-12T09:45:58.922 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:58.920+0000 7fef467fc640 1 -- 172.21.15.73:0/592518045 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fef5000bc70 con 0x7fef540a4f40 2023-12-12T09:45:58.922 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:58.921+0000 7fef467fc640 1 --2- 172.21.15.73:0/592518045 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fef3806ae40 0x7fef3806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:58.922 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:58.921+0000 7fef467fc640 1 -- 172.21.15.73:0/592518045 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fef50089f50 con 0x7fef540a4f40 2023-12-12T09:45:58.923 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:58.922+0000 7fef59772640 1 --2- 172.21.15.73:0/592518045 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fef3806ae40 0x7fef3806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:58.923 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:58.922+0000 7fef59772640 1 --2- 172.21.15.73:0/592518045 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fef3806ae40 0x7fef3806d300 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fef48035000 tx=0x7fef48030000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:45:58.927 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:58.926+0000 7fef467fc640 1 -- 172.21.15.73:0/592518045 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fef50054c00 con 0x7fef540a4f40 2023-12-12T09:45:59.128 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:59.127+0000 7fef5c1d7640 1 -- 172.21.15.73:0/592518045 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fef54067580 con 0x7fef540a4f40 2023-12-12T09:45:59.129 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:59.128+0000 7fef467fc640 1 -- 172.21.15.73:0/592518045 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v58) v1 ==== 80+0+0 (secure 0 0 0) 0x7fef50058220 con 0x7fef540a4f40 2023-12-12T09:45:59.129 INFO:teuthology.orchestra.run.smithi073.stderr:listed 0 entries 2023-12-12T09:45:59.132 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:59.130+0000 7fef5c1d7640 1 -- 172.21.15.73:0/592518045 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fef3806ae40 msgr2=0x7fef3806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:59.132 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:59.130+0000 7fef5c1d7640 1 --2- 172.21.15.73:0/592518045 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fef3806ae40 0x7fef3806d300 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fef48035000 tx=0x7fef48030000 comp rx=0 tx=0).stop 2023-12-12T09:45:59.132 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:59.130+0000 7fef5c1d7640 1 -- 172.21.15.73:0/592518045 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fef540a4f40 msgr2=0x7fef540c0890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:59.133 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:59.130+0000 7fef5c1d7640 1 --2- 172.21.15.73:0/592518045 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fef540a4f40 0x7fef540c0890 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7fef5000d620 tx=0x7fef5000dae0 comp rx=0 tx=0).stop 2023-12-12T09:45:59.133 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:59.131+0000 7fef5c1d7640 1 -- 172.21.15.73:0/592518045 shutdown_connections 2023-12-12T09:45:59.133 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:59.131+0000 7fef5c1d7640 1 --2- 172.21.15.73:0/592518045 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fef3806ae40 0x7fef3806d300 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:59.133 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:59.131+0000 7fef5c1d7640 1 --2- 172.21.15.73:0/592518045 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fef540c4c10 0x7fef541ed140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:59.133 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:59.131+0000 7fef5c1d7640 1 --2- 172.21.15.73:0/592518045 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fef540c1a60 0x7fef541ecc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:59.133 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:59.131+0000 7fef5c1d7640 1 --2- 172.21.15.73:0/592518045 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fef540a4f40 0x7fef540c0890 unknown :-1 s=CLOSED pgs=743 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:59.133 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:59.131+0000 7fef5c1d7640 1 -- 172.21.15.73:0/592518045 >> 172.21.15.73:0/592518045 conn(0x7fef540a77d0 msgr2=0x7fef541518f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:45:59.133 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:59.131+0000 7fef5c1d7640 1 -- 172.21.15.73:0/592518045 shutdown_connections 2023-12-12T09:45:59.133 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:59.131+0000 7fef5c1d7640 1 -- 172.21.15.73:0/592518045 wait complete. 2023-12-12T09:45:59.152 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-12-12T09:45:59.152 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T09:45:59.152 DEBUG:teuthology.orchestra.run.smithi142:> sudo umount /home/ubuntu/cephtest/mnt.1 2023-12-12T09:45:59.274 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi142.front.sepia.ceph.com 2023-12-12T09:45:59.275 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T09:45:59.275 DEBUG:teuthology.orchestra.run.smithi142:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-12-12T09:45:59.327 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-12T09:45:59.545 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:59.543+0000 7f8f6eaf3640 1 Processor -- start 2023-12-12T09:45:59.545 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:59.544+0000 7f8f6eaf3640 1 -- start start 2023-12-12T09:45:59.546 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:59.545+0000 7f8f6eaf3640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f8f6814fa40 0x7f8f6806a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:59.546 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:59.545+0000 7f8f6eaf3640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8f680c5070 0x7f8f680c40c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:59.547 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:59.545+0000 7f8f6eaf3640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f68152610 con 0x7f8f6806db70 2023-12-12T09:45:59.547 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:59.545+0000 7f8f6eaf3640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f681528f0 con 0x7f8f6814fa40 2023-12-12T09:45:59.547 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:59.545+0000 7f8f6eaf3640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f68152bd0 con 0x7f8f680c5070 2023-12-12T09:45:59.547 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:59.545+0000 7f8f6c88f640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f8f6814fa40 0x7f8f6806a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:59.547 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:59.545+0000 7f8f67fff640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f8f6806db70 0x7f8f680c39b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:55740/0 (socket says 172.21.15.73:55740) 2023-12-12T09:45:59.547 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:59.545+0000 7f8f67fff640 1 -- 172.21.15.73:0/35174155 learned_addr learned my addr 172.21.15.73:0/35174155 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-12T09:45:59.547 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:59.546+0000 7f8f6c88f640 1 -- 172.21.15.73:0/35174155 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8f680c5070 msgr2=0x7f8f680c40c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:45:59.548 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:59.546+0000 7f8f6c88f640 1 --2- 172.21.15.73:0/35174155 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8f680c5070 0x7f8f680c40c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:59.548 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:59.546+0000 7f8f6c88f640 1 -- 172.21.15.73:0/35174155 >> v1:172.21.15.73:6789/0 conn(0x7f8f6806db70 legacy=0x7f8f680c39b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:59.548 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:59.546+0000 7f8f6c88f640 1 -- 172.21.15.73:0/35174155 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f68152eb0 con 0x7f8f6814fa40 2023-12-12T09:45:59.548 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:59.546+0000 7f8f677fe640 1 -- 172.21.15.73:0/35174155 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2994356015 0 0) 0x7f8f68152610 con 0x7f8f6806db70 2023-12-12T09:45:59.549 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:59.547+0000 7f8f6c88f640 1 --2- 172.21.15.73:0/35174155 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8f6814fa40 0x7f8f6806a4e0 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f8f5c0097a0 tx=0x7f8f5c02b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cdb249f331641cb9 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:45:59.549 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:59.547+0000 7f8f677fe640 1 -- 172.21.15.73:0/35174155 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f5c02d040 con 0x7f8f6814fa40 2023-12-12T09:45:59.549 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:59.547+0000 7f8f677fe640 1 -- 172.21.15.73:0/35174155 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f5c031810 con 0x7f8f6814fa40 2023-12-12T09:45:59.549 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:59.547+0000 7f8f677fe640 1 -- 172.21.15.73:0/35174155 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f5c031ba0 con 0x7f8f6814fa40 2023-12-12T09:45:59.549 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:59.548+0000 7f8f6eaf3640 1 -- 172.21.15.73:0/35174155 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8f6814fa40 msgr2=0x7f8f6806a4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:59.549 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:59.548+0000 7f8f6eaf3640 1 --2- 172.21.15.73:0/35174155 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8f6814fa40 0x7f8f6806a4e0 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f8f5c0097a0 tx=0x7f8f5c02b8b0 comp rx=0 tx=0).stop 2023-12-12T09:45:59.549 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:59.548+0000 7f8f6eaf3640 1 -- 172.21.15.73:0/35174155 shutdown_connections 2023-12-12T09:45:59.550 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:59.548+0000 7f8f6eaf3640 1 --2- 172.21.15.73:0/35174155 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8f680c5070 0x7f8f680c40c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:59.550 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:59.548+0000 7f8f6eaf3640 1 --2- 172.21.15.73:0/35174155 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8f6814fa40 0x7f8f6806a4e0 unknown :-1 s=CLOSED pgs=745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:59.550 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:59.548+0000 7f8f6eaf3640 1 -- 172.21.15.73:0/35174155 >> 172.21.15.73:0/35174155 conn(0x7f8f680a8130 msgr2=0x7f8f680c24b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:45:59.550 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:59.548+0000 7f8f6eaf3640 1 -- 172.21.15.73:0/35174155 shutdown_connections 2023-12-12T09:45:59.550 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:59.548+0000 7f8f6eaf3640 1 -- 172.21.15.73:0/35174155 wait complete. 2023-12-12T09:45:59.551 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:59.550+0000 7f8f6eaf3640 1 Processor -- start 2023-12-12T09:45:59.551 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:59.550+0000 7f8f6eaf3640 1 -- start start 2023-12-12T09:45:59.553 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:59.551+0000 7f8f6eaf3640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8f6806db70 0x7f8f680c0ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:59.553 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:59.551+0000 7f8f6eaf3640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8f680c5070 0x7f8f68147c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:59.553 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:59.551+0000 7f8f6eaf3640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8f6814fa40 0x7f8f68148190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:59.553 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:59.551+0000 7f8f6eaf3640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f6814a650 con 0x7f8f6814fa40 2023-12-12T09:45:59.553 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:59.551+0000 7f8f6eaf3640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f680aa710 con 0x7f8f6806db70 2023-12-12T09:45:59.553 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:59.551+0000 7f8f6eaf3640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f681edb60 con 0x7f8f680c5070 2023-12-12T09:45:59.553 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:59.551+0000 7f8f6d090640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8f6814fa40 0x7f8f68148190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:59.554 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:59.551+0000 7f8f6d090640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8f6814fa40 0x7f8f68148190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:44500/0 (socket says 172.21.15.73:44500) 2023-12-12T09:45:59.554 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:59.551+0000 7f8f6d090640 1 -- 172.21.15.73:0/307602407 learned_addr learned my addr 172.21.15.73:0/307602407 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:45:59.554 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:59.551+0000 7f8f67fff640 1 --2- 172.21.15.73:0/307602407 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8f680c5070 0x7f8f68147c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:59.554 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:59.552+0000 7f8f6c88f640 1 --2- 172.21.15.73:0/307602407 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8f6806db70 0x7f8f680c0ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:59.554 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:59.552+0000 7f8f6d090640 1 -- 172.21.15.73:0/307602407 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8f680c5070 msgr2=0x7f8f68147c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:59.554 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:59.552+0000 7f8f6d090640 1 --2- 172.21.15.73:0/307602407 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8f680c5070 0x7f8f68147c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:59.554 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:59.552+0000 7f8f6d090640 1 -- 172.21.15.73:0/307602407 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8f6806db70 msgr2=0x7f8f680c0ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:59.554 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:59.552+0000 7f8f6d090640 1 --2- 172.21.15.73:0/307602407 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8f6806db70 0x7f8f680c0ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:59.554 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:59.552+0000 7f8f6d090640 1 -- 172.21.15.73:0/307602407 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f5c009400 con 0x7f8f6814fa40 2023-12-12T09:45:59.554 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:59.552+0000 7f8f6c88f640 1 --2- 172.21.15.73:0/307602407 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8f6806db70 0x7f8f680c0ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:45:59.554 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:59.552+0000 7f8f6d090640 1 --2- 172.21.15.73:0/307602407 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8f6814fa40 0x7f8f68148190 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f8f6000b970 tx=0x7f8f6000be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:45:59.555 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:59.552+0000 7f8f657fa640 1 -- 172.21.15.73:0/307602407 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f6000cae0 con 0x7f8f6814fa40 2023-12-12T09:45:59.555 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:59.552+0000 7f8f657fa640 1 -- 172.21.15.73:0/307602407 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f6000cc60 con 0x7f8f6814fa40 2023-12-12T09:45:59.555 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:59.552+0000 7f8f6eaf3640 1 -- 172.21.15.73:0/307602407 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f681ede40 con 0x7f8f6814fa40 2023-12-12T09:45:59.555 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:59.552+0000 7f8f657fa640 1 -- 172.21.15.73:0/307602407 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f60014440 con 0x7f8f6814fa40 2023-12-12T09:45:59.555 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:59.552+0000 7f8f6eaf3640 1 -- 172.21.15.73:0/307602407 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f680c1220 con 0x7f8f6814fa40 2023-12-12T09:45:59.555 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:59.554+0000 7f8f6eaf3640 1 -- 172.21.15.73:0/307602407 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f6814b010 con 0x7f8f6814fa40 2023-12-12T09:45:59.556 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:59.555+0000 7f8f657fa640 1 -- 172.21.15.73:0/307602407 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f8f6001d3b0 con 0x7f8f6814fa40 2023-12-12T09:45:59.557 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:59.555+0000 7f8f657fa640 1 --2- 172.21.15.73:0/307602407 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f8f4c06ae40 0x7f8f4c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:45:59.557 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:59.556+0000 7f8f657fa640 1 -- 172.21.15.73:0/307602407 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f8f600897f0 con 0x7f8f6814fa40 2023-12-12T09:45:59.557 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:59.556+0000 7f8f6c88f640 1 --2- 172.21.15.73:0/307602407 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f8f4c06ae40 0x7f8f4c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:45:59.557 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:59.556+0000 7f8f6c88f640 1 --2- 172.21.15.73:0/307602407 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f8f4c06ae40 0x7f8f4c06d300 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f8f5c036000 tx=0x7f8f5c008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:45:59.561 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:59.560+0000 7f8f657fa640 1 -- 172.21.15.73:0/307602407 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f8f6814b010 con 0x7f8f6814fa40 2023-12-12T09:45:59.786 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:59.785+0000 7f8f6eaf3640 1 -- 172.21.15.73:0/307602407 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8f6814b010 con 0x7f8f6814fa40 2023-12-12T09:45:59.787 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:59.786+0000 7f8f657fa640 1 -- 172.21.15.73:0/307602407 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 35 v35) v1 ==== 94+0+6135 (secure 0 0 0) 0x7f8f6814b010 con 0x7f8f6814fa40 2023-12-12T09:45:59.788 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-12T09:45:59.788 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":35,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4736,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6834/2964437845","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6832","nonce":2964437845},{"type":"v1","addr":"172.21.15.142:6834","nonce":2964437845}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":25},{"gid":5044,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6837/3698725764","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6836","nonce":3698725764},{"type":"v1","addr":"172.21.15.73:6837","nonce":3698725764}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":25}],"filesystems":[{"mdsmap":{"epoch":30,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-12T09:45:22.971300+0000","modified":"2023-12-12T09:45:26.028731+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5703},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5703":{"gid":5703,"name":"a","rank":0,"incarnation":26,"state":"up:active","state_seq":3,"addr":"172.21.15.73:6835/744058726","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":744058726},{"type":"v1","addr":"172.21.15.73:6835","nonce":744058726}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4},{"mdsmap":{"epoch":35,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-12T09:45:38.103609+0000","modified":"2023-12-12T09:45:41.148650+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5059},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5059":{"gid":5059,"name":"d","rank":0,"incarnation":31,"state":"up:active","state_seq":7,"addr":"172.21.15.142:6835/2931058847","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6833","nonce":2931058847},{"type":"v1","addr":"172.21.15.142:6835","nonce":2931058847}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2023-12-12T09:45:59.788 INFO:teuthology.orchestra.run.smithi073.stderr:dumped fsmap epoch 35 2023-12-12T09:45:59.791 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:59.789+0000 7f8f6eaf3640 1 -- 172.21.15.73:0/307602407 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f8f4c06ae40 msgr2=0x7f8f4c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:59.791 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:59.789+0000 7f8f6eaf3640 1 --2- 172.21.15.73:0/307602407 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f8f4c06ae40 0x7f8f4c06d300 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f8f5c036000 tx=0x7f8f5c008030 comp rx=0 tx=0).stop 2023-12-12T09:45:59.791 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:59.789+0000 7f8f6eaf3640 1 -- 172.21.15.73:0/307602407 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8f6814fa40 msgr2=0x7f8f68148190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:45:59.791 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:59.789+0000 7f8f6eaf3640 1 --2- 172.21.15.73:0/307602407 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8f6814fa40 0x7f8f68148190 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f8f6000b970 tx=0x7f8f6000be30 comp rx=0 tx=0).stop 2023-12-12T09:45:59.791 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:59.789+0000 7f8f6eaf3640 1 -- 172.21.15.73:0/307602407 shutdown_connections 2023-12-12T09:45:59.791 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:59.789+0000 7f8f6eaf3640 1 --2- 172.21.15.73:0/307602407 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f8f4c06ae40 0x7f8f4c06d300 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:59.791 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:59.789+0000 7f8f6eaf3640 1 --2- 172.21.15.73:0/307602407 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8f6814fa40 0x7f8f68148190 unknown :-1 s=CLOSED pgs=746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:59.791 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:59.789+0000 7f8f6eaf3640 1 --2- 172.21.15.73:0/307602407 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8f680c5070 0x7f8f68147c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:59.791 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:59.789+0000 7f8f6eaf3640 1 --2- 172.21.15.73:0/307602407 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8f6806db70 0x7f8f680c0ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:45:59.791 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:59.789+0000 7f8f6eaf3640 1 -- 172.21.15.73:0/307602407 >> 172.21.15.73:0/307602407 conn(0x7f8f680a8130 msgr2=0x7f8f680a6810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:45:59.791 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:59.789+0000 7f8f6eaf3640 1 -- 172.21.15.73:0/307602407 shutdown_connections 2023-12-12T09:45:59.791 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:45:59.789+0000 7f8f6eaf3640 1 -- 172.21.15.73:0/307602407 wait complete. 2023-12-12T09:45:59.811 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-12T09:46:00.024 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:00.022+0000 7f385b01a640 1 Processor -- start 2023-12-12T09:46:00.024 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:00.022+0000 7f385b01a640 1 -- start start 2023-12-12T09:46:00.025 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:00.024+0000 7f385b01a640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f38540c5160 0x7f3854151680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:00.025 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:00.024+0000 7f385b01a640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3854151bc0 0x7f38540c37b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:00.025 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:00.024+0000 7f385b01a640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f385406d8d0 con 0x7f38540bef50 2023-12-12T09:46:00.025 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:00.024+0000 7f385b01a640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3854152050 con 0x7f38540c5160 2023-12-12T09:46:00.025 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:00.024+0000 7f385b01a640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38540c4d70 con 0x7f3854151bc0 2023-12-12T09:46:00.026 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:00.024+0000 7f385a819640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3854151bc0 0x7f38540c37b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:00.026 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:00.025+0000 7f3859817640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f38540c5160 0x7f3854151680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:00.026 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:00.025+0000 7f3859817640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f38540c5160 0x7f3854151680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.73:45694/0 (socket says 172.21.15.73:45694) 2023-12-12T09:46:00.026 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:00.025+0000 7f3859817640 1 -- 172.21.15.73:0/2416440779 learned_addr learned my addr 172.21.15.73:0/2416440779 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:46:00.027 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:00.025+0000 7f3859817640 1 -- 172.21.15.73:0/2416440779 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3854151bc0 msgr2=0x7f38540c37b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:46:00.027 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:00.025+0000 7f3859817640 1 --2- 172.21.15.73:0/2416440779 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3854151bc0 0x7f38540c37b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:00.027 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:00.025+0000 7f3859817640 1 -- 172.21.15.73:0/2416440779 >> v1:172.21.15.142:6789/0 conn(0x7f38540bef50 legacy=0x7f3854158270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:46:00.027 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:00.025+0000 7f3859817640 1 -- 172.21.15.73:0/2416440779 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f385406ccc0 con 0x7f38540c5160 2023-12-12T09:46:00.027 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:00.025+0000 7f385a819640 1 --2- 172.21.15.73:0/2416440779 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3854151bc0 0x7f38540c37b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-12T09:46:00.028 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:00.027+0000 7f3859817640 1 --2- 172.21.15.73:0/2416440779 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f38540c5160 0x7f3854151680 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f3844009870 tx=0x7f384402b860 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8465e796eaf9485a server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:46:00.028 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:00.027+0000 7f3859016640 1 -- 172.21.15.73:0/2416440779 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38440317c0 con 0x7f38540c5160 2023-12-12T09:46:00.028 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:00.027+0000 7f3859016640 1 -- 172.21.15.73:0/2416440779 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3844031920 con 0x7f38540c5160 2023-12-12T09:46:00.029 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:00.027+0000 7f3859016640 1 -- 172.21.15.73:0/2416440779 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3844031cb0 con 0x7f38540c5160 2023-12-12T09:46:00.029 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:00.028+0000 7f385b01a640 1 -- 172.21.15.73:0/2416440779 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f38540c5160 msgr2=0x7f3854151680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:00.029 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:00.028+0000 7f385b01a640 1 --2- 172.21.15.73:0/2416440779 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f38540c5160 0x7f3854151680 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f3844009870 tx=0x7f384402b860 comp rx=0 tx=0).stop 2023-12-12T09:46:00.029 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:00.028+0000 7f385b01a640 1 -- 172.21.15.73:0/2416440779 shutdown_connections 2023-12-12T09:46:00.029 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:00.028+0000 7f385b01a640 1 --2- 172.21.15.73:0/2416440779 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3854151bc0 0x7f38540c37b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:00.030 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:00.028+0000 7f385b01a640 1 --2- 172.21.15.73:0/2416440779 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f38540c5160 0x7f3854151680 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:00.030 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:00.028+0000 7f385b01a640 1 -- 172.21.15.73:0/2416440779 >> 172.21.15.73:0/2416440779 conn(0x7f38540c23b0 msgr2=0x7f38540c2790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:46:00.030 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:00.028+0000 7f385b01a640 1 -- 172.21.15.73:0/2416440779 shutdown_connections 2023-12-12T09:46:00.030 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:00.028+0000 7f385b01a640 1 -- 172.21.15.73:0/2416440779 wait complete. 2023-12-12T09:46:00.031 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:00.030+0000 7f385b01a640 1 Processor -- start 2023-12-12T09:46:00.032 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:00.030+0000 7f385b01a640 1 -- start start 2023-12-12T09:46:00.035 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:00.032+0000 7f385b01a640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f38540bef50 0x7f3854152910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:00.035 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:00.032+0000 7f385b01a640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f38540c5160 0x7f38540ab2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:00.035 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:00.032+0000 7f385b01a640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3854151bc0 0x7f38540ab830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:00.035 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:00.032+0000 7f385b01a640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38540a8960 con 0x7f3854151bc0 2023-12-12T09:46:00.035 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:00.032+0000 7f385b01a640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38540a8bb0 con 0x7f38540c5160 2023-12-12T09:46:00.035 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:00.032+0000 7f385b01a640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38541eaaf0 con 0x7f38540bef50 2023-12-12T09:46:00.035 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:00.032+0000 7f385a819640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3854151bc0 0x7f38540ab830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:00.035 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:00.032+0000 7f385a819640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3854151bc0 0x7f38540ab830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:44516/0 (socket says 172.21.15.73:44516) 2023-12-12T09:46:00.035 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:00.032+0000 7f385a819640 1 -- 172.21.15.73:0/3734901009 learned_addr learned my addr 172.21.15.73:0/3734901009 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:46:00.035 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:00.032+0000 7f3859817640 1 --2- 172.21.15.73:0/3734901009 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f38540c5160 0x7f38540ab2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:00.035 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:00.032+0000 7f385a018640 1 --2- 172.21.15.73:0/3734901009 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f38540bef50 0x7f3854152910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:00.035 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:00.033+0000 7f385a819640 1 -- 172.21.15.73:0/3734901009 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f38540bef50 msgr2=0x7f3854152910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:00.035 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:00.033+0000 7f385a819640 1 --2- 172.21.15.73:0/3734901009 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f38540bef50 0x7f3854152910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:00.035 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:00.033+0000 7f385a819640 1 -- 172.21.15.73:0/3734901009 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f38540c5160 msgr2=0x7f38540ab2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:00.036 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:00.033+0000 7f385a819640 1 --2- 172.21.15.73:0/3734901009 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f38540c5160 0x7f38540ab2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:00.036 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:00.033+0000 7f385a819640 1 -- 172.21.15.73:0/3734901009 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f384c009a70 con 0x7f3854151bc0 2023-12-12T09:46:00.036 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:00.033+0000 7f385a819640 1 --2- 172.21.15.73:0/3734901009 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3854151bc0 0x7f38540ab830 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f384c00efc0 tx=0x7f384c009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:46:00.036 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:00.033+0000 7f384affd640 1 -- 172.21.15.73:0/3734901009 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f384c009d70 con 0x7f3854151bc0 2023-12-12T09:46:00.036 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:00.033+0000 7f384affd640 1 -- 172.21.15.73:0/3734901009 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f384c00f040 con 0x7f3854151bc0 2023-12-12T09:46:00.036 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:00.033+0000 7f385b01a640 1 -- 172.21.15.73:0/3734901009 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38440094d0 con 0x7f3854151bc0 2023-12-12T09:46:00.036 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:00.033+0000 7f384affd640 1 -- 172.21.15.73:0/3734901009 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f384c003990 con 0x7f3854151bc0 2023-12-12T09:46:00.036 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:00.033+0000 7f385b01a640 1 -- 172.21.15.73:0/3734901009 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3854072620 con 0x7f3854151bc0 2023-12-12T09:46:00.036 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:00.034+0000 7f385b01a640 1 -- 172.21.15.73:0/3734901009 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f38541540c0 con 0x7f3854151bc0 2023-12-12T09:46:00.037 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:00.036+0000 7f384affd640 1 -- 172.21.15.73:0/3734901009 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f384c0144a0 con 0x7f3854151bc0 2023-12-12T09:46:00.038 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:00.037+0000 7f384affd640 1 --2- 172.21.15.73:0/3734901009 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f383806ae40 0x7f383806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:00.038 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:00.037+0000 7f384affd640 1 -- 172.21.15.73:0/3734901009 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f384c08a6a0 con 0x7f3854151bc0 2023-12-12T09:46:00.038 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:00.037+0000 7f385a018640 1 --2- 172.21.15.73:0/3734901009 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f383806ae40 0x7f383806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:00.039 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:00.038+0000 7f385a018640 1 --2- 172.21.15.73:0/3734901009 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f383806ae40 0x7f383806d300 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f3850006fd0 tx=0x7f3850008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:46:00.042 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:00.041+0000 7f384affd640 1 -- 172.21.15.73:0/3734901009 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f384c0553e0 con 0x7f3854151bc0 2023-12-12T09:46:00.235 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:00.233+0000 7f385b01a640 1 -- 172.21.15.73:0/3734901009 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f38540c2030 con 0x7f3854151bc0 2023-12-12T09:46:00.238 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:00.237+0000 7f384affd640 1 -- 172.21.15.73:0/3734901009 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v58) v1 ==== 74+0+20292 (secure 0 0 0) 0x7f384c058a00 con 0x7f3854151bc0 2023-12-12T09:46:00.239 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-12T09:46:00.240 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":58,"fsid":"ba240992-02b8-4c7e-92f2-27eb29ac433b","created":"2023-12-12T09:43:02.454719+0000","modified":"2023-12-12T09:45:39.273967+0000","last_up_change":"2023-12-12T09:43:13.913440+0000","last_in_change":"2023-12-12T09:43:05.925348+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-12T09:43:15.525508+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-12-12T09:45:21.264815+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"53","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-12-12T09:45:21.981834+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"54","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs2_metadata","create_time":"2023-12-12T09:45:36.388393+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"57","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs2_data","create_time":"2023-12-12T09:45:37.109653+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"58","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"dd9074be-dbe2-4c34-9896-a4223d8d3940","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":4047810203},{"type":"v1","addr":"172.21.15.73:6801","nonce":4047810203}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":4047810203},{"type":"v1","addr":"172.21.15.73:6803","nonce":4047810203}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":4047810203},{"type":"v1","addr":"172.21.15.73:6807","nonce":4047810203}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":4047810203},{"type":"v1","addr":"172.21.15.73:6805","nonce":4047810203}]},"public_addr":"172.21.15.73:6801/4047810203","cluster_addr":"172.21.15.73:6803/4047810203","heartbeat_back_addr":"172.21.15.73:6807/4047810203","heartbeat_front_addr":"172.21.15.73:6805/4047810203","state":["exists","up"]},{"osd":1,"uuid":"c4a05052-96d4-4758-a4e1-1a37f1e07fed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":1356058331},{"type":"v1","addr":"172.21.15.73:6824","nonce":1356058331}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":1356058331},{"type":"v1","addr":"172.21.15.73:6827","nonce":1356058331}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":1356058331},{"type":"v1","addr":"172.21.15.73:6831","nonce":1356058331}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":1356058331},{"type":"v1","addr":"172.21.15.73:6829","nonce":1356058331}]},"public_addr":"172.21.15.73:6824/1356058331","cluster_addr":"172.21.15.73:6827/1356058331","heartbeat_back_addr":"172.21.15.73:6831/1356058331","heartbeat_front_addr":"172.21.15.73:6829/1356058331","state":["exists","up"]},{"osd":2,"uuid":"512bc8ac-72c2-40d4-b3d2-d867a92c5213","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":1228903316},{"type":"v1","addr":"172.21.15.73:6817","nonce":1228903316}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":1228903316},{"type":"v1","addr":"172.21.15.73:6819","nonce":1228903316}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6823","nonce":1228903316},{"type":"v1","addr":"172.21.15.73:6825","nonce":1228903316}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":1228903316},{"type":"v1","addr":"172.21.15.73:6821","nonce":1228903316}]},"public_addr":"172.21.15.73:6817/1228903316","cluster_addr":"172.21.15.73:6819/1228903316","heartbeat_back_addr":"172.21.15.73:6825/1228903316","heartbeat_front_addr":"172.21.15.73:6821/1228903316","state":["exists","up"]},{"osd":3,"uuid":"3d1a91e0-42bf-437a-8eae-8d357c8f63a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":1293329670},{"type":"v1","addr":"172.21.15.73:6809","nonce":1293329670}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6810","nonce":1293329670},{"type":"v1","addr":"172.21.15.73:6811","nonce":1293329670}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":1293329670},{"type":"v1","addr":"172.21.15.73:6815","nonce":1293329670}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":1293329670},{"type":"v1","addr":"172.21.15.73:6813","nonce":1293329670}]},"public_addr":"172.21.15.73:6809/1293329670","cluster_addr":"172.21.15.73:6811/1293329670","heartbeat_back_addr":"172.21.15.73:6815/1293329670","heartbeat_front_addr":"172.21.15.73:6813/1293329670","state":["exists","up"]},{"osd":4,"uuid":"4b302fff-834c-4069-ac19-00e46f6c87b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":3727975702},{"type":"v1","addr":"172.21.15.142:6801","nonce":3727975702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":3727975702},{"type":"v1","addr":"172.21.15.142:6803","nonce":3727975702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6809","nonce":3727975702},{"type":"v1","addr":"172.21.15.142:6811","nonce":3727975702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6805","nonce":3727975702},{"type":"v1","addr":"172.21.15.142:6807","nonce":3727975702}]},"public_addr":"172.21.15.142:6801/3727975702","cluster_addr":"172.21.15.142:6803/3727975702","heartbeat_back_addr":"172.21.15.142:6811/3727975702","heartbeat_front_addr":"172.21.15.142:6807/3727975702","state":["exists","up"]},{"osd":5,"uuid":"d7cdace2-67d0-45cc-95f2-515cf6ef1b82","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6817","nonce":2353193632},{"type":"v1","addr":"172.21.15.142:6819","nonce":2353193632}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6821","nonce":2353193632},{"type":"v1","addr":"172.21.15.142:6823","nonce":2353193632}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6829","nonce":2353193632},{"type":"v1","addr":"172.21.15.142:6831","nonce":2353193632}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6825","nonce":2353193632},{"type":"v1","addr":"172.21.15.142:6827","nonce":2353193632}]},"public_addr":"172.21.15.142:6819/2353193632","cluster_addr":"172.21.15.142:6823/2353193632","heartbeat_back_addr":"172.21.15.142:6831/2353193632","heartbeat_front_addr":"172.21.15.142:6827/2353193632","state":["exists","up"]},{"osd":6,"uuid":"649ce78a-5626-445c-aedc-a651ed05a6f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":2006111986},{"type":"v1","addr":"172.21.15.142:6806","nonce":2006111986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":2006111986},{"type":"v1","addr":"172.21.15.142:6810","nonce":2006111986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":2006111986},{"type":"v1","addr":"172.21.15.142:6815","nonce":2006111986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":2006111986},{"type":"v1","addr":"172.21.15.142:6813","nonce":2006111986}]},"public_addr":"172.21.15.142:6806/2006111986","cluster_addr":"172.21.15.142:6810/2006111986","heartbeat_back_addr":"172.21.15.142:6815/2006111986","heartbeat_front_addr":"172.21.15.142:6813/2006111986","state":["exists","up"]},{"osd":7,"uuid":"af15ae3b-c1d0-4acf-92db-8a1805494d13","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":2573794341},{"type":"v1","addr":"172.21.15.142:6818","nonce":2573794341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":2573794341},{"type":"v1","addr":"172.21.15.142:6822","nonce":2573794341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":2573794341},{"type":"v1","addr":"172.21.15.142:6830","nonce":2573794341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":2573794341},{"type":"v1","addr":"172.21.15.142:6826","nonce":2573794341}]},"public_addr":"172.21.15.142:6818/2573794341","cluster_addr":"172.21.15.142:6822/2573794341","heartbeat_back_addr":"172.21.15.142:6830/2573794341","heartbeat_front_addr":"172.21.15.142:6826/2573794341","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.185824+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.262103+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.225556+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:10.523459+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:10.706035+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.257339+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.301776+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.051960+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-12T09:46:00.242 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:00.240+0000 7f385b01a640 1 -- 172.21.15.73:0/3734901009 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f383806ae40 msgr2=0x7f383806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:00.242 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:00.240+0000 7f385b01a640 1 --2- 172.21.15.73:0/3734901009 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f383806ae40 0x7f383806d300 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f3850006fd0 tx=0x7f3850008040 comp rx=0 tx=0).stop 2023-12-12T09:46:00.242 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:00.240+0000 7f385b01a640 1 -- 172.21.15.73:0/3734901009 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3854151bc0 msgr2=0x7f38540ab830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:00.242 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:00.240+0000 7f385b01a640 1 --2- 172.21.15.73:0/3734901009 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3854151bc0 0x7f38540ab830 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f384c00efc0 tx=0x7f384c009f90 comp rx=0 tx=0).stop 2023-12-12T09:46:00.242 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:00.240+0000 7f385b01a640 1 -- 172.21.15.73:0/3734901009 shutdown_connections 2023-12-12T09:46:00.242 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:00.240+0000 7f385b01a640 1 --2- 172.21.15.73:0/3734901009 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f383806ae40 0x7f383806d300 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:00.242 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:00.240+0000 7f385b01a640 1 --2- 172.21.15.73:0/3734901009 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3854151bc0 0x7f38540ab830 unknown :-1 s=CLOSED pgs=747 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:00.243 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:00.240+0000 7f385b01a640 1 --2- 172.21.15.73:0/3734901009 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f38540c5160 0x7f38540ab2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:00.243 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:00.240+0000 7f385b01a640 1 --2- 172.21.15.73:0/3734901009 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f38540bef50 0x7f3854152910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:00.243 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:00.240+0000 7f385b01a640 1 -- 172.21.15.73:0/3734901009 >> 172.21.15.73:0/3734901009 conn(0x7f38540c23b0 msgr2=0x7f38540c0170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:46:00.243 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:00.240+0000 7f385b01a640 1 -- 172.21.15.73:0/3734901009 shutdown_connections 2023-12-12T09:46:00.243 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:00.241+0000 7f385b01a640 1 -- 172.21.15.73:0/3734901009 wait complete. 2023-12-12T09:46:00.261 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-12T09:43:15.525508+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 8, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-12T09:45:21.264815+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '53', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 9, 'pool_name': 'cephfs_data', 'create_time': '2023-12-12T09:45:21.981834+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '54', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 10, 'pool_name': 'cephfs2_metadata', 'create_time': '2023-12-12T09:45:36.388393+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '57', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs2'}}, 'read_balance': {'score_acting': 2.5, 'score_stable': 2.5, 'optimal_score': 1, 'raw_score_acting': 2.5, 'raw_score_stable': 2.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 11, 'pool_name': 'cephfs2_data', 'create_time': '2023-12-12T09:45:37.109653+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '58', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs2'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-12T09:46:00.262 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-12T09:46:00.477 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:00.475+0000 7fa5caee7640 1 Processor -- start 2023-12-12T09:46:00.477 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:00.476+0000 7fa5caee7640 1 -- start start 2023-12-12T09:46:00.479 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:00.477+0000 7fa5caee7640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fa5c414f8c0 0x7fa5c406dc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:00.479 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:00.477+0000 7fa5caee7640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fa5c406d350 0x7fa5c4071e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:00.479 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:00.477+0000 7fa5caee7640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5c40c16c0 con 0x7fa5c40723a0 2023-12-12T09:46:00.479 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:00.477+0000 7fa5caee7640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5c40c1090 con 0x7fa5c414f8c0 2023-12-12T09:46:00.479 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:00.477+0000 7fa5caee7640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5c40c14b0 con 0x7fa5c406d350 2023-12-12T09:46:00.479 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:00.477+0000 7fa5c8c83640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fa5c414f8c0 0x7fa5c406dc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:00.479 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:00.477+0000 7fa5c9484640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7fa5c40723a0 0x7fa5c4152500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:55742/0 (socket says 172.21.15.73:55742) 2023-12-12T09:46:00.479 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:00.477+0000 7fa5c8c83640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fa5c414f8c0 0x7fa5c406dc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:44522/0 (socket says 172.21.15.73:44522) 2023-12-12T09:46:00.479 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:00.477+0000 7fa5c9484640 1 -- 172.21.15.73:0/3884876737 learned_addr learned my addr 172.21.15.73:0/3884876737 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-12T09:46:00.480 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:00.478+0000 7fa5c8c83640 1 -- 172.21.15.73:0/3884876737 >> v2:172.21.15.142:3300/0 conn(0x7fa5c406d350 msgr2=0x7fa5c4071e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:46:00.481 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:00.478+0000 7fa5c3fff640 1 --2- 172.21.15.73:0/3884876737 >> v2:172.21.15.142:3300/0 conn(0x7fa5c406d350 0x7fa5c4071e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:00.481 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:00.478+0000 7fa5c37fe640 1 -- 172.21.15.73:0/3884876737 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4224565762 0 0) 0x7fa5c40c16c0 con 0x7fa5c40723a0 2023-12-12T09:46:00.481 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:00.478+0000 7fa5c8c83640 1 --2- 172.21.15.73:0/3884876737 >> v2:172.21.15.142:3300/0 conn(0x7fa5c406d350 0x7fa5c4071e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:00.481 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:00.478+0000 7fa5c8c83640 1 -- 172.21.15.73:0/3884876737 >> v1:172.21.15.73:6789/0 conn(0x7fa5c40723a0 legacy=0x7fa5c4152500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:00.481 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:00.478+0000 7fa5c8c83640 1 -- 172.21.15.73:0/3884876737 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5c40c19a0 con 0x7fa5c414f8c0 2023-12-12T09:46:00.481 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:00.478+0000 7fa5c3fff640 1 --2- 172.21.15.73:0/3884876737 >> v2:172.21.15.142:3300/0 conn(0x7fa5c406d350 0x7fa5c4071e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:46:00.481 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:00.479+0000 7fa5c8c83640 1 --2- 172.21.15.73:0/3884876737 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa5c414f8c0 0x7fa5c406dc40 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7fa5c40c3430 tx=0x7fa5ac02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df1a1f335b87d4b9 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:46:00.481 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:00.479+0000 7fa5c37fe640 1 -- 172.21.15.73:0/3884876737 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5ac031830 con 0x7fa5c414f8c0 2023-12-12T09:46:00.481 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:00.479+0000 7fa5c37fe640 1 -- 172.21.15.73:0/3884876737 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5ac031990 con 0x7fa5c414f8c0 2023-12-12T09:46:00.481 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:00.479+0000 7fa5c37fe640 1 -- 172.21.15.73:0/3884876737 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5ac031d20 con 0x7fa5c414f8c0 2023-12-12T09:46:00.482 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:00.480+0000 7fa5caee7640 1 -- 172.21.15.73:0/3884876737 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa5c414f8c0 msgr2=0x7fa5c406dc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:00.482 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:00.480+0000 7fa5caee7640 1 --2- 172.21.15.73:0/3884876737 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa5c414f8c0 0x7fa5c406dc40 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7fa5c40c3430 tx=0x7fa5ac02b8d0 comp rx=0 tx=0).stop 2023-12-12T09:46:00.482 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:00.480+0000 7fa5caee7640 1 -- 172.21.15.73:0/3884876737 shutdown_connections 2023-12-12T09:46:00.482 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:00.480+0000 7fa5caee7640 1 --2- 172.21.15.73:0/3884876737 >> v2:172.21.15.142:3300/0 conn(0x7fa5c406d350 0x7fa5c4071e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:00.482 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:00.480+0000 7fa5caee7640 1 --2- 172.21.15.73:0/3884876737 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa5c414f8c0 0x7fa5c406dc40 unknown :-1 s=CLOSED pgs=749 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:00.482 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:00.480+0000 7fa5caee7640 1 -- 172.21.15.73:0/3884876737 >> 172.21.15.73:0/3884876737 conn(0x7fa5c406a4e0 msgr2=0x7fa5c406a8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:46:00.482 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:00.480+0000 7fa5caee7640 1 -- 172.21.15.73:0/3884876737 shutdown_connections 2023-12-12T09:46:00.483 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:00.480+0000 7fa5caee7640 1 -- 172.21.15.73:0/3884876737 wait complete. 2023-12-12T09:46:00.483 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:00.482+0000 7fa5caee7640 1 Processor -- start 2023-12-12T09:46:00.483 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:00.482+0000 7fa5caee7640 1 -- start start 2023-12-12T09:46:00.485 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:00.483+0000 7fa5caee7640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa5c406d350 0x7fa5c4151b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:00.485 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:00.483+0000 7fa5caee7640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa5c40723a0 0x7fa5c4145760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:00.485 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:00.483+0000 7fa5caee7640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa5c414f8c0 0x7fa5c4145ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:00.486 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:00.483+0000 7fa5caee7640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5c41540b0 con 0x7fa5c406d350 2023-12-12T09:46:00.486 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:00.483+0000 7fa5caee7640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5c4071cf0 con 0x7fa5c40723a0 2023-12-12T09:46:00.486 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:00.483+0000 7fa5caee7640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5c41ea0a0 con 0x7fa5c414f8c0 2023-12-12T09:46:00.486 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:00.483+0000 7fa5c8c83640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa5c406d350 0x7fa5c4151b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:00.486 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:00.483+0000 7fa5c8c83640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa5c406d350 0x7fa5c4151b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:44536/0 (socket says 172.21.15.73:44536) 2023-12-12T09:46:00.486 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:00.483+0000 7fa5c8c83640 1 -- 172.21.15.73:0/3229883667 learned_addr learned my addr 172.21.15.73:0/3229883667 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:46:00.486 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:00.483+0000 7fa5c8c83640 1 -- 172.21.15.73:0/3229883667 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa5c414f8c0 msgr2=0x7fa5c4145ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:00.486 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:00.483+0000 7fa5c8c83640 1 --2- 172.21.15.73:0/3229883667 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa5c414f8c0 0x7fa5c4145ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:00.486 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:00.483+0000 7fa5c8c83640 1 -- 172.21.15.73:0/3229883667 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa5c40723a0 msgr2=0x7fa5c4145760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:00.486 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:00.483+0000 7fa5c8c83640 1 --2- 172.21.15.73:0/3229883667 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa5c40723a0 0x7fa5c4145760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:00.486 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:00.483+0000 7fa5c8c83640 1 -- 172.21.15.73:0/3229883667 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5ac009400 con 0x7fa5c406d350 2023-12-12T09:46:00.486 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:00.484+0000 7fa5c8c83640 1 --2- 172.21.15.73:0/3229883667 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa5c406d350 0x7fa5c4151b70 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7fa5ac000c00 tx=0x7fa5ac0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:46:00.486 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:00.484+0000 7fa5c17fa640 1 -- 172.21.15.73:0/3229883667 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5ac03aa60 con 0x7fa5c406d350 2023-12-12T09:46:00.487 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:00.484+0000 7fa5c17fa640 1 -- 172.21.15.73:0/3229883667 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5ac03abe0 con 0x7fa5c406d350 2023-12-12T09:46:00.487 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:00.484+0000 7fa5c17fa640 1 -- 172.21.15.73:0/3229883667 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5ac0443f0 con 0x7fa5c406d350 2023-12-12T09:46:00.487 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:00.484+0000 7fa5caee7640 1 -- 172.21.15.73:0/3229883667 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5c41ea360 con 0x7fa5c406d350 2023-12-12T09:46:00.487 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:00.484+0000 7fa5caee7640 1 -- 172.21.15.73:0/3229883667 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5c41ea920 con 0x7fa5c406d350 2023-12-12T09:46:00.487 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:00.485+0000 7fa5caee7640 1 -- 172.21.15.73:0/3229883667 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa5c4067070 con 0x7fa5c406d350 2023-12-12T09:46:00.487 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:00.486+0000 7fa5c17fa640 1 -- 172.21.15.73:0/3229883667 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fa5ac04d450 con 0x7fa5c406d350 2023-12-12T09:46:00.488 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:00.487+0000 7fa5c17fa640 1 --2- 172.21.15.73:0/3229883667 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fa5a406ae40 0x7fa5a406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:00.488 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:00.487+0000 7fa5c17fa640 1 -- 172.21.15.73:0/3229883667 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fa5ac0abc40 con 0x7fa5c406d350 2023-12-12T09:46:00.489 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:00.487+0000 7fa5c3fff640 1 --2- 172.21.15.73:0/3229883667 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fa5a406ae40 0x7fa5a406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:00.489 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:00.488+0000 7fa5c3fff640 1 --2- 172.21.15.73:0/3229883667 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fa5a406ae40 0x7fa5a406d300 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fa5c41569d0 tx=0x7fa5b40083f0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:46:00.493 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:00.492+0000 7fa5c17fa640 1 -- 172.21.15.73:0/3229883667 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fa5ac076980 con 0x7fa5c406d350 2023-12-12T09:46:00.682 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:00.681+0000 7fa5caee7640 1 -- 172.21.15.73:0/3229883667 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fa5c4067580 con 0x7fa5c406d350 2023-12-12T09:46:00.683 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:00.682+0000 7fa5c17fa640 1 -- 172.21.15.73:0/3229883667 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v58) v1 ==== 93+0+10 (secure 0 0 0) 0x7fa5ac079fa0 con 0x7fa5c406d350 2023-12-12T09:46:00.683 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 1 2023-12-12T09:46:00.686 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:00.684+0000 7fa5caee7640 1 -- 172.21.15.73:0/3229883667 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fa5a406ae40 msgr2=0x7fa5a406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:00.686 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:00.684+0000 7fa5caee7640 1 --2- 172.21.15.73:0/3229883667 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fa5a406ae40 0x7fa5a406d300 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fa5c41569d0 tx=0x7fa5b40083f0 comp rx=0 tx=0).stop 2023-12-12T09:46:00.686 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:00.684+0000 7fa5caee7640 1 -- 172.21.15.73:0/3229883667 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa5c406d350 msgr2=0x7fa5c4151b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:00.686 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:00.684+0000 7fa5caee7640 1 --2- 172.21.15.73:0/3229883667 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa5c406d350 0x7fa5c4151b70 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7fa5ac000c00 tx=0x7fa5ac0046c0 comp rx=0 tx=0).stop 2023-12-12T09:46:00.686 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:00.684+0000 7fa5caee7640 1 -- 172.21.15.73:0/3229883667 shutdown_connections 2023-12-12T09:46:00.686 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:00.684+0000 7fa5caee7640 1 --2- 172.21.15.73:0/3229883667 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fa5a406ae40 0x7fa5a406d300 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:00.686 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:00.684+0000 7fa5caee7640 1 --2- 172.21.15.73:0/3229883667 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa5c414f8c0 0x7fa5c4145ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:00.686 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:00.684+0000 7fa5caee7640 1 --2- 172.21.15.73:0/3229883667 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa5c40723a0 0x7fa5c4145760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:00.686 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:00.684+0000 7fa5caee7640 1 --2- 172.21.15.73:0/3229883667 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa5c406d350 0x7fa5c4151b70 unknown :-1 s=CLOSED pgs=750 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:00.686 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:00.684+0000 7fa5caee7640 1 -- 172.21.15.73:0/3229883667 >> 172.21.15.73:0/3229883667 conn(0x7fa5c406a4e0 msgr2=0x7fa5c4152500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:46:00.686 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:00.684+0000 7fa5caee7640 1 -- 172.21.15.73:0/3229883667 shutdown_connections 2023-12-12T09:46:00.686 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:00.685+0000 7fa5caee7640 1 -- 172.21.15.73:0/3229883667 wait complete. 2023-12-12T09:46:00.706 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-12T09:46:00.916 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:00.914+0000 7f428df41640 1 Processor -- start 2023-12-12T09:46:00.916 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:00.914+0000 7f428df41640 1 -- start start 2023-12-12T09:46:00.917 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:00.915+0000 7f428df41640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f428806d350 0x7f428806dc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:00.917 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:00.915+0000 7f428df41640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42880c16c0 con 0x7f428814f8c0 2023-12-12T09:46:00.917 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:00.916+0000 7f428df41640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42880c19a0 con 0x7f4288152500 2023-12-12T09:46:00.918 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:00.916+0000 7f428df41640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42880c1090 con 0x7f428806d350 2023-12-12T09:46:00.918 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:00.916+0000 7f42877fe640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f428814f8c0 0x7f4288071e60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:55744/0 (socket says 172.21.15.73:55744) 2023-12-12T09:46:00.918 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:00.916+0000 7f42877fe640 1 -- 172.21.15.73:0/3501218246 learned_addr learned my addr 172.21.15.73:0/3501218246 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-12T09:46:00.925 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:00.916+0000 7f42867fc640 1 -- 172.21.15.73:0/3501218246 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 228659532 0 0) 0x7f42880c16c0 con 0x7f428814f8c0 2023-12-12T09:46:00.926 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:00.916+0000 7f4286ffd640 1 --2- 172.21.15.73:0/3501218246 >> v2:172.21.15.142:3300/0 conn(0x7f428806d350 0x7f428806dc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:00.926 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:00.916+0000 7f42867fc640 1 -- 172.21.15.73:0/3501218246 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4270003520 con 0x7f428814f8c0 2023-12-12T09:46:00.926 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:00.917+0000 7f42867fc640 1 -- 172.21.15.73:0/3501218246 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3047766437 0 0) 0x7f4270003520 con 0x7f428814f8c0 2023-12-12T09:46:00.926 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:00.917+0000 7f42867fc640 1 -- 172.21.15.73:0/3501218246 >> v2:172.21.15.142:3300/0 conn(0x7f428806d350 msgr2=0x7f428806dc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:46:00.927 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:00.917+0000 7f42867fc640 1 --2- 172.21.15.73:0/3501218246 >> v2:172.21.15.142:3300/0 conn(0x7f428806d350 0x7f428806dc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:00.927 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:00.917+0000 7f42867fc640 1 -- 172.21.15.73:0/3501218246 >> v1:172.21.15.142:6789/0 conn(0x7f4288152500 legacy=0x7f4288152990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:00.927 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:00.917+0000 7f42867fc640 1 -- 172.21.15.73:0/3501218246 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42880c1c80 con 0x7f428814f8c0 2023-12-12T09:46:00.927 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:00.917+0000 7f42867fc640 1 -- 172.21.15.73:0/3501218246 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3186547832 0 0) 0x7f4278001670 con 0x7f428814f8c0 2023-12-12T09:46:00.927 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:00.917+0000 7f42867fc640 1 -- 172.21.15.73:0/3501218246 >> v1:172.21.15.73:6789/0 conn(0x7f428814f8c0 legacy=0x7f4288071e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:00.927 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:00.917+0000 7f42867fc640 1 --2- 172.21.15.73:0/3501218246 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4270003970 0x7f4270003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:00.927 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:00.917+0000 7f42867fc640 1 --2- 172.21.15.73:0/3501218246 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f42700047c0 0x7f4270004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:00.927 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:00.917+0000 7f42867fc640 1 --2- 172.21.15.73:0/3501218246 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4270005180 0x7f427000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:00.927 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:00.917+0000 7f42867fc640 1 -- 172.21.15.73:0/3501218246 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f427000bff0 con 0x7f42700047c0 2023-12-12T09:46:00.927 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:00.917+0000 7f42867fc640 1 -- 172.21.15.73:0/3501218246 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f427000c160 con 0x7f4270003970 2023-12-12T09:46:00.927 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:00.917+0000 7f42867fc640 1 -- 172.21.15.73:0/3501218246 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f427000c320 con 0x7f4270005180 2023-12-12T09:46:00.927 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:00.917+0000 7f4286ffd640 1 --2- 172.21.15.73:0/3501218246 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f42700047c0 0x7f4270004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:00.928 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:00.917+0000 7f42877fe640 1 --2- 172.21.15.73:0/3501218246 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4270003970 0x7f4270003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:00.928 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:00.918+0000 7f4286ffd640 1 -- 172.21.15.73:0/3501218246 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4270005180 msgr2=0x7f427000b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:46:00.928 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:00.918+0000 7f4286ffd640 1 --2- 172.21.15.73:0/3501218246 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4270005180 0x7f427000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:00.928 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:00.918+0000 7f4286ffd640 1 -- 172.21.15.73:0/3501218246 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4270003970 msgr2=0x7f4270003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:46:00.928 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:00.918+0000 7f4286ffd640 1 --2- 172.21.15.73:0/3501218246 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4270003970 0x7f4270003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:00.928 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:00.918+0000 7f4286ffd640 1 -- 172.21.15.73:0/3501218246 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4270003520 con 0x7f42700047c0 2023-12-12T09:46:00.928 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:00.918+0000 7f42877fe640 1 --2- 172.21.15.73:0/3501218246 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4270003970 0x7f4270003d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:46:00.928 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:00.918+0000 7f4287fff640 1 -- 172.21.15.73:0/3501218246 reap_dead start 2023-12-12T09:46:00.928 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:00.919+0000 7f4286ffd640 1 --2- 172.21.15.73:0/3501218246 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f42700047c0 0x7f4270004c40 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f427c009ac0 tx=0x7f42700057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8478694a68b1a0d0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:46:00.928 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:00.919+0000 7f42867fc640 1 -- 172.21.15.73:0/3501218246 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f427c02c6b0 con 0x7f42700047c0 2023-12-12T09:46:00.928 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:00.919+0000 7f42867fc640 1 -- 172.21.15.73:0/3501218246 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f427c02c810 con 0x7f42700047c0 2023-12-12T09:46:00.928 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:00.919+0000 7f42867fc640 1 -- 172.21.15.73:0/3501218246 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f427c02cba0 con 0x7f42700047c0 2023-12-12T09:46:00.928 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:00.919+0000 7f428df41640 1 -- 172.21.15.73:0/3501218246 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f42700047c0 msgr2=0x7f4270004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:00.928 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:00.919+0000 7f428df41640 1 --2- 172.21.15.73:0/3501218246 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f42700047c0 0x7f4270004c40 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f427c009ac0 tx=0x7f42700057f0 comp rx=0 tx=0).stop 2023-12-12T09:46:00.928 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:00.919+0000 7f428df41640 1 -- 172.21.15.73:0/3501218246 shutdown_connections 2023-12-12T09:46:00.929 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:00.919+0000 7f428df41640 1 --2- 172.21.15.73:0/3501218246 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f42700047c0 0x7f4270004c40 unknown :-1 s=CLOSED pgs=752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:00.929 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:00.919+0000 7f428df41640 1 -- 172.21.15.73:0/3501218246 >> 172.21.15.73:0/3501218246 conn(0x7f428806a4e0 msgr2=0x7f428806a8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:46:00.929 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:00.920+0000 7f428df41640 1 -- 172.21.15.73:0/3501218246 shutdown_connections 2023-12-12T09:46:00.929 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:00.920+0000 7f428df41640 1 -- 172.21.15.73:0/3501218246 wait complete. 2023-12-12T09:46:00.929 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:00.921+0000 7f428df41640 1 Processor -- start 2023-12-12T09:46:00.929 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:00.921+0000 7f428df41640 1 -- start start 2023-12-12T09:46:00.929 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:00.922+0000 7f428df41640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f42700047c0 0x7f42881426f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:00.929 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:00.922+0000 7f428df41640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4288149b60 0x7f4288150510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:00.929 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:00.922+0000 7f428df41640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4288150a50 0x7f428814c240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:00.929 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:00.922+0000 7f428df41640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4288151970 con 0x7f42700047c0 2023-12-12T09:46:00.929 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:00.922+0000 7f428df41640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4288151bc0 con 0x7f4288149b60 2023-12-12T09:46:00.929 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:00.922+0000 7f428df41640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f428814a8a0 con 0x7f4288150a50 2023-12-12T09:46:00.929 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:00.923+0000 7f42877fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f42700047c0 0x7f42881426f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:00.930 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:00.923+0000 7f42877fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f42700047c0 0x7f42881426f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:44550/0 (socket says 172.21.15.73:44550) 2023-12-12T09:46:00.930 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:00.923+0000 7f42877fe640 1 -- 172.21.15.73:0/3242441054 learned_addr learned my addr 172.21.15.73:0/3242441054 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:46:00.930 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:00.923+0000 7f42877fe640 1 -- 172.21.15.73:0/3242441054 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4288150a50 msgr2=0x7f428814c240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:00.930 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:00.923+0000 7f42877fe640 1 --2- 172.21.15.73:0/3242441054 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4288150a50 0x7f428814c240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:00.930 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:00.923+0000 7f42877fe640 1 -- 172.21.15.73:0/3242441054 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4288149b60 msgr2=0x7f4288150510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:00.930 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:00.923+0000 7f42877fe640 1 --2- 172.21.15.73:0/3242441054 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4288149b60 0x7f4288150510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:00.930 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:00.923+0000 7f42877fe640 1 -- 172.21.15.73:0/3242441054 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f428814ad30 con 0x7f42700047c0 2023-12-12T09:46:00.930 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:00.923+0000 7f42877fe640 1 --2- 172.21.15.73:0/3242441054 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f42700047c0 0x7f42881426f0 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7f427800dae0 tx=0x7f4278007e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:46:00.930 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:00.924+0000 7f426ffff640 1 -- 172.21.15.73:0/3242441054 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42780075a0 con 0x7f42700047c0 2023-12-12T09:46:00.930 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:00.924+0000 7f426ffff640 1 -- 172.21.15.73:0/3242441054 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4278007700 con 0x7f42700047c0 2023-12-12T09:46:00.930 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:00.924+0000 7f426ffff640 1 -- 172.21.15.73:0/3242441054 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42780049e0 con 0x7f42700047c0 2023-12-12T09:46:00.930 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:00.924+0000 7f428df41640 1 -- 172.21.15.73:0/3242441054 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4288151ef0 con 0x7f42700047c0 2023-12-12T09:46:00.930 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:00.924+0000 7f428df41640 1 -- 172.21.15.73:0/3242441054 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f428814bb40 con 0x7f42700047c0 2023-12-12T09:46:00.931 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:00.925+0000 7f428df41640 1 -- 172.21.15.73:0/3242441054 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4288067070 con 0x7f42700047c0 2023-12-12T09:46:00.931 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:00.926+0000 7f426ffff640 1 -- 172.21.15.73:0/3242441054 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f4278004b40 con 0x7f42700047c0 2023-12-12T09:46:00.931 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:00.926+0000 7f426ffff640 1 --2- 172.21.15.73:0/3242441054 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f427406ae40 0x7f427406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:00.932 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:00.927+0000 7f426ffff640 1 -- 172.21.15.73:0/3242441054 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f4278089520 con 0x7f42700047c0 2023-12-12T09:46:00.932 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:00.927+0000 7f4286ffd640 1 --2- 172.21.15.73:0/3242441054 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f427406ae40 0x7f427406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:00.932 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:00.927+0000 7f4286ffd640 1 --2- 172.21.15.73:0/3242441054 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f427406ae40 0x7f427406d300 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f427c036000 tx=0x7f427c02e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:46:00.932 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:00.931+0000 7f426ffff640 1 -- 172.21.15.73:0/3242441054 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f4278057cf0 con 0x7f42700047c0 2023-12-12T09:46:01.120 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:01.119+0000 7f428df41640 1 -- 172.21.15.73:0/3242441054 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f42881520e0 con 0x7f42700047c0 2023-12-12T09:46:01.121 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:01.120+0000 7f426ffff640 1 -- 172.21.15.73:0/3242441054 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v58) v1 ==== 104+0+11 (secure 0 0 0) 0x7f4278057880 con 0x7f42700047c0 2023-12-12T09:46:01.121 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 32 2023-12-12T09:46:01.124 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:01.122+0000 7f428df41640 1 -- 172.21.15.73:0/3242441054 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f427406ae40 msgr2=0x7f427406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:01.124 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:01.122+0000 7f428df41640 1 --2- 172.21.15.73:0/3242441054 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f427406ae40 0x7f427406d300 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f427c036000 tx=0x7f427c02e000 comp rx=0 tx=0).stop 2023-12-12T09:46:01.124 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:01.122+0000 7f428df41640 1 -- 172.21.15.73:0/3242441054 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f42700047c0 msgr2=0x7f42881426f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:01.124 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:01.122+0000 7f428df41640 1 --2- 172.21.15.73:0/3242441054 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f42700047c0 0x7f42881426f0 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7f427800dae0 tx=0x7f4278007e50 comp rx=0 tx=0).stop 2023-12-12T09:46:01.124 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:01.122+0000 7f428df41640 1 -- 172.21.15.73:0/3242441054 shutdown_connections 2023-12-12T09:46:01.124 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:01.122+0000 7f428df41640 1 --2- 172.21.15.73:0/3242441054 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f427406ae40 0x7f427406d300 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:01.124 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:01.122+0000 7f428df41640 1 --2- 172.21.15.73:0/3242441054 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4288150a50 0x7f428814c240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:01.124 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:01.122+0000 7f428df41640 1 --2- 172.21.15.73:0/3242441054 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4288149b60 0x7f4288150510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:01.124 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:01.122+0000 7f428df41640 1 --2- 172.21.15.73:0/3242441054 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f42700047c0 0x7f42881426f0 unknown :-1 s=CLOSED pgs=753 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:01.124 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:01.122+0000 7f428df41640 1 -- 172.21.15.73:0/3242441054 >> 172.21.15.73:0/3242441054 conn(0x7f428806a4e0 msgr2=0x7f42881493d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:46:01.125 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:01.122+0000 7f428df41640 1 -- 172.21.15.73:0/3242441054 shutdown_connections 2023-12-12T09:46:01.125 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:01.122+0000 7f428df41640 1 -- 172.21.15.73:0/3242441054 wait complete. 2023-12-12T09:46:01.141 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-12T09:46:01.358 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:01.356+0000 7ff66bfff640 1 Processor -- start 2023-12-12T09:46:01.358 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:01.356+0000 7ff66bfff640 1 -- start start 2023-12-12T09:46:01.359 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:01.357+0000 7ff66bfff640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7ff66c14c190 0x7ff66c0c0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:01.359 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:01.357+0000 7ff66bfff640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7ff66c0a4d00 0x7ff66c1555c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:01.359 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:01.358+0000 7ff66bfff640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff66c155b00 con 0x7ff66c1529a0 2023-12-12T09:46:01.359 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:01.358+0000 7ff66bfff640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff66c0c1890 con 0x7ff66c0a4d00 2023-12-12T09:46:01.359 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:01.358+0000 7ff66bfff640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff66c151fd0 con 0x7ff66c14c190 2023-12-12T09:46:01.359 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:01.358+0000 7ff66a7fc640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7ff66c0a4d00 0x7ff66c1555c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:01.360 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:01.358+0000 7ff66a7fc640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7ff66c0a4d00 0x7ff66c1555c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:44560/0 (socket says 172.21.15.73:44560) 2023-12-12T09:46:01.360 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:01.358+0000 7ff66a7fc640 1 -- 172.21.15.73:0/1215027430 learned_addr learned my addr 172.21.15.73:0/1215027430 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:46:01.360 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:01.358+0000 7ff66affd640 1 --2- 172.21.15.73:0/1215027430 >> v2:172.21.15.142:3300/0 conn(0x7ff66c14c190 0x7ff66c0c0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:01.360 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:01.358+0000 7ff66a7fc640 1 -- 172.21.15.73:0/1215027430 >> v2:172.21.15.142:3300/0 conn(0x7ff66c14c190 msgr2=0x7ff66c0c0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:46:01.360 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:01.358+0000 7ff66a7fc640 1 --2- 172.21.15.73:0/1215027430 >> v2:172.21.15.142:3300/0 conn(0x7ff66c14c190 0x7ff66c0c0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:01.361 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:01.358+0000 7ff66a7fc640 1 -- 172.21.15.73:0/1215027430 >> v1:172.21.15.73:6789/0 conn(0x7ff66c1529a0 legacy=0x7ff66c0a8880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:01.361 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:01.358+0000 7ff66a7fc640 1 -- 172.21.15.73:0/1215027430 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff66c1521e0 con 0x7ff66c0a4d00 2023-12-12T09:46:01.362 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:01.360+0000 7ff66a7fc640 1 --2- 172.21.15.73:0/1215027430 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff66c0a4d00 0x7ff66c1555c0 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7ff66c06b2b0 tx=0x7ff66002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1bb247b7bc3c4140 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:46:01.362 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:01.360+0000 7ff669ffb640 1 -- 172.21.15.73:0/1215027430 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff660031870 con 0x7ff66c0a4d00 2023-12-12T09:46:01.362 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:01.360+0000 7ff669ffb640 1 -- 172.21.15.73:0/1215027430 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6600319d0 con 0x7ff66c0a4d00 2023-12-12T09:46:01.362 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:01.360+0000 7ff669ffb640 1 -- 172.21.15.73:0/1215027430 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff660031d60 con 0x7ff66c0a4d00 2023-12-12T09:46:01.362 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:01.360+0000 7ff66bfff640 1 -- 172.21.15.73:0/1215027430 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff66c0a4d00 msgr2=0x7ff66c1555c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:01.362 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:01.360+0000 7ff66bfff640 1 --2- 172.21.15.73:0/1215027430 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff66c0a4d00 0x7ff66c1555c0 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7ff66c06b2b0 tx=0x7ff66002b910 comp rx=0 tx=0).stop 2023-12-12T09:46:01.362 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:01.361+0000 7ff66bfff640 1 -- 172.21.15.73:0/1215027430 shutdown_connections 2023-12-12T09:46:01.363 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:01.361+0000 7ff66bfff640 1 --2- 172.21.15.73:0/1215027430 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff66c0a4d00 0x7ff66c1555c0 unknown :-1 s=CLOSED pgs=755 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:01.363 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:01.361+0000 7ff66bfff640 1 --2- 172.21.15.73:0/1215027430 >> v2:172.21.15.142:3300/0 conn(0x7ff66c14c190 0x7ff66c0c0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:01.363 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:01.361+0000 7ff66bfff640 1 -- 172.21.15.73:0/1215027430 >> 172.21.15.73:0/1215027430 conn(0x7ff66c06a4e0 msgr2=0x7ff66c06a8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:46:01.363 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:01.361+0000 7ff66bfff640 1 -- 172.21.15.73:0/1215027430 shutdown_connections 2023-12-12T09:46:01.363 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:01.361+0000 7ff66bfff640 1 -- 172.21.15.73:0/1215027430 wait complete. 2023-12-12T09:46:01.363 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:01.362+0000 7ff66bfff640 1 Processor -- start 2023-12-12T09:46:01.363 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:01.362+0000 7ff66bfff640 1 -- start start 2023-12-12T09:46:01.365 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:01.363+0000 7ff66bfff640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff66c0a4d00 0x7ff66c0c5a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:01.365 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:01.363+0000 7ff66bfff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff66c14c190 0x7ff66c1eb010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:01.365 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:01.363+0000 7ff66bfff640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff66c1529a0 0x7ff66c1eb550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:01.365 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:01.363+0000 7ff66bfff640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff66c14d230 con 0x7ff66c14c190 2023-12-12T09:46:01.365 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:01.363+0000 7ff66bfff640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff66c149190 con 0x7ff66c1529a0 2023-12-12T09:46:01.365 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:01.363+0000 7ff66bfff640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff66c070ca0 con 0x7ff66c0a4d00 2023-12-12T09:46:01.365 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:01.363+0000 7ff66a7fc640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff66c14c190 0x7ff66c1eb010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:01.365 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:01.363+0000 7ff66a7fc640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff66c14c190 0x7ff66c1eb010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:44562/0 (socket says 172.21.15.73:44562) 2023-12-12T09:46:01.365 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:01.364+0000 7ff66a7fc640 1 -- 172.21.15.73:0/450418669 learned_addr learned my addr 172.21.15.73:0/450418669 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:46:01.366 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:01.364+0000 7ff66a7fc640 1 -- 172.21.15.73:0/450418669 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff66c0a4d00 msgr2=0x7ff66c0c5a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:01.366 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:01.364+0000 7ff66affd640 1 --2- 172.21.15.73:0/450418669 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff66c0a4d00 0x7ff66c0c5a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:01.367 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:01.364+0000 7ff66a7fc640 1 --2- 172.21.15.73:0/450418669 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff66c0a4d00 0x7ff66c0c5a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:01.367 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:01.364+0000 7ff66a7fc640 1 -- 172.21.15.73:0/450418669 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff66c1529a0 msgr2=0x7ff66c1eb550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:01.367 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:01.364+0000 7ff66a7fc640 1 --2- 172.21.15.73:0/450418669 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff66c1529a0 0x7ff66c1eb550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:01.367 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:01.364+0000 7ff66a7fc640 1 -- 172.21.15.73:0/450418669 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6600094d0 con 0x7ff66c14c190 2023-12-12T09:46:01.367 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:01.364+0000 7ff66a7fc640 1 --2- 172.21.15.73:0/450418669 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff66c14c190 0x7ff66c1eb010 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7ff66002b950 tx=0x7ff6600046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:46:01.367 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:01.364+0000 7ff653fff640 1 -- 172.21.15.73:0/450418669 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff660031860 con 0x7ff66c14c190 2023-12-12T09:46:01.367 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:01.365+0000 7ff653fff640 1 -- 172.21.15.73:0/450418669 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6600443f0 con 0x7ff66c14c190 2023-12-12T09:46:01.367 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:01.365+0000 7ff653fff640 1 -- 172.21.15.73:0/450418669 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6600447a0 con 0x7ff66c14c190 2023-12-12T09:46:01.367 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:01.365+0000 7ff66bfff640 1 -- 172.21.15.73:0/450418669 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff66c070f80 con 0x7ff66c14c190 2023-12-12T09:46:01.367 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:01.365+0000 7ff66bfff640 1 -- 172.21.15.73:0/450418669 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff66c0728c0 con 0x7ff66c14c190 2023-12-12T09:46:01.367 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:01.366+0000 7ff66bfff640 1 -- 172.21.15.73:0/450418669 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff66c071170 con 0x7ff66c14c190 2023-12-12T09:46:01.368 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:01.367+0000 7ff653fff640 1 -- 172.21.15.73:0/450418669 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7ff66004d450 con 0x7ff66c14c190 2023-12-12T09:46:01.369 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:01.368+0000 7ff653fff640 1 --2- 172.21.15.73:0/450418669 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7ff65806ae40 0x7ff65806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:01.369 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:01.368+0000 7ff653fff640 1 -- 172.21.15.73:0/450418669 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 6565+0+0 (secure 0 0 0) 0x7ff66002d040 con 0x7ff66c14c190 2023-12-12T09:46:01.369 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:01.368+0000 7ff66affd640 1 --2- 172.21.15.73:0/450418669 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7ff65806ae40 0x7ff65806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:01.369 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:01.368+0000 7ff66affd640 1 --2- 172.21.15.73:0/450418669 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7ff65806ae40 0x7ff65806d300 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7ff66c1ec0f0 tx=0x7ff65c008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:46:01.373 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:01.372+0000 7ff653fff640 1 -- 172.21.15.73:0/450418669 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7ff660076e30 con 0x7ff66c14c190 2023-12-12T09:46:01.564 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:01.562+0000 7ff66bfff640 1 -- 172.21.15.73:0/450418669 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7ff66c0c2060 con 0x7ff66c14c190 2023-12-12T09:46:01.564 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:01.563+0000 7ff653fff640 1 -- 172.21.15.73:0/450418669 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v58) v1 ==== 100+0+11 (secure 0 0 0) 0x7ff660035070 con 0x7ff66c14c190 2023-12-12T09:46:01.565 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 64 2023-12-12T09:46:01.568 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:01.566+0000 7ff66bfff640 1 -- 172.21.15.73:0/450418669 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7ff65806ae40 msgr2=0x7ff65806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:01.568 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:01.566+0000 7ff66bfff640 1 --2- 172.21.15.73:0/450418669 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7ff65806ae40 0x7ff65806d300 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7ff66c1ec0f0 tx=0x7ff65c008040 comp rx=0 tx=0).stop 2023-12-12T09:46:01.568 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:01.566+0000 7ff66bfff640 1 -- 172.21.15.73:0/450418669 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff66c14c190 msgr2=0x7ff66c1eb010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:01.568 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:01.566+0000 7ff66bfff640 1 --2- 172.21.15.73:0/450418669 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff66c14c190 0x7ff66c1eb010 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7ff66002b950 tx=0x7ff6600046c0 comp rx=0 tx=0).stop 2023-12-12T09:46:01.568 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:01.566+0000 7ff66bfff640 1 -- 172.21.15.73:0/450418669 shutdown_connections 2023-12-12T09:46:01.568 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:01.566+0000 7ff66bfff640 1 --2- 172.21.15.73:0/450418669 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7ff65806ae40 0x7ff65806d300 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:01.568 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:01.566+0000 7ff66bfff640 1 --2- 172.21.15.73:0/450418669 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff66c1529a0 0x7ff66c1eb550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:01.568 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:01.566+0000 7ff66bfff640 1 --2- 172.21.15.73:0/450418669 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff66c14c190 0x7ff66c1eb010 unknown :-1 s=CLOSED pgs=756 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:01.568 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:01.566+0000 7ff66bfff640 1 --2- 172.21.15.73:0/450418669 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff66c0a4d00 0x7ff66c0c5a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:01.568 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:01.566+0000 7ff66bfff640 1 -- 172.21.15.73:0/450418669 >> 172.21.15.73:0/450418669 conn(0x7ff66c06a4e0 msgr2=0x7ff66c0aaa10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:46:01.568 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:01.566+0000 7ff66bfff640 1 -- 172.21.15.73:0/450418669 shutdown_connections 2023-12-12T09:46:01.568 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:01.566+0000 7ff66bfff640 1 -- 172.21.15.73:0/450418669 wait complete. 2023-12-12T09:46:01.585 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_metadata pg_num 2023-12-12T09:46:01.799 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:01.798+0000 7fa89246b640 1 Processor -- start 2023-12-12T09:46:01.800 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:01.798+0000 7fa89246b640 1 -- start start 2023-12-12T09:46:01.801 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:01.800+0000 7fa89246b640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fa88c151c30 0x7fa88c06d440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:01.801 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:01.800+0000 7fa89246b640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa88c0bed50 0x7fa88c0bf1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:01.801 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:01.800+0000 7fa89246b640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa88c1582e0 con 0x7fa88c0c3930 2023-12-12T09:46:01.801 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:01.800+0000 7fa89246b640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa88c0a54d0 con 0x7fa88c151c30 2023-12-12T09:46:01.801 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:01.800+0000 7fa89246b640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa88c0a4f50 con 0x7fa88c0bed50 2023-12-12T09:46:01.802 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:01.800+0000 7fa88bfff640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fa88c151c30 0x7fa88c06d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:01.802 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:01.800+0000 7fa883fff640 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7fa88c0c3930 0x7fa88c157bd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.73:37564/0 (socket says 172.21.15.73:37564) 2023-12-12T09:46:01.802 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:01.800+0000 7fa883fff640 1 -- 172.21.15.73:0/3549132767 learned_addr learned my addr 172.21.15.73:0/3549132767 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-12T09:46:01.802 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:01.800+0000 7fa890a08640 1 --2- 172.21.15.73:0/3549132767 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa88c0bed50 0x7fa88c0bf1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:01.803 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:01.801+0000 7fa88bfff640 1 -- 172.21.15.73:0/3549132767 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa88c0bed50 msgr2=0x7fa88c0bf1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:46:01.803 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:01.801+0000 7fa88bfff640 1 --2- 172.21.15.73:0/3549132767 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa88c0bed50 0x7fa88c0bf1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:01.803 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:01.801+0000 7fa88bfff640 1 -- 172.21.15.73:0/3549132767 >> v1:172.21.15.142:6789/0 conn(0x7fa88c0c3930 legacy=0x7fa88c157bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:01.803 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:01.801+0000 7fa88bfff640 1 -- 172.21.15.73:0/3549132767 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa88c155260 con 0x7fa88c151c30 2023-12-12T09:46:01.804 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:01.803+0000 7fa88bfff640 1 --2- 172.21.15.73:0/3549132767 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa88c151c30 0x7fa88c06d440 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fa87c0097a0 tx=0x7fa87c02b840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8587104bb663acd5 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:46:01.804 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:01.803+0000 7fa88b7fe640 1 -- 172.21.15.73:0/3549132767 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa87c02e070 con 0x7fa88c151c30 2023-12-12T09:46:01.805 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:01.803+0000 7fa88b7fe640 1 -- 172.21.15.73:0/3549132767 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa87c0315a0 con 0x7fa88c151c30 2023-12-12T09:46:01.805 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:01.803+0000 7fa88b7fe640 1 -- 172.21.15.73:0/3549132767 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa87c031930 con 0x7fa88c151c30 2023-12-12T09:46:01.806 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:01.804+0000 7fa89246b640 1 -- 172.21.15.73:0/3549132767 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa88c151c30 msgr2=0x7fa88c06d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:01.806 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:01.804+0000 7fa89246b640 1 --2- 172.21.15.73:0/3549132767 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa88c151c30 0x7fa88c06d440 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fa87c0097a0 tx=0x7fa87c02b840 comp rx=0 tx=0).stop 2023-12-12T09:46:01.806 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:01.804+0000 7fa89246b640 1 -- 172.21.15.73:0/3549132767 shutdown_connections 2023-12-12T09:46:01.806 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:01.804+0000 7fa89246b640 1 --2- 172.21.15.73:0/3549132767 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa88c0bed50 0x7fa88c0bf1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:01.806 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:01.804+0000 7fa89246b640 1 --2- 172.21.15.73:0/3549132767 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa88c151c30 0x7fa88c06d440 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:01.806 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:01.804+0000 7fa89246b640 1 -- 172.21.15.73:0/3549132767 >> 172.21.15.73:0/3549132767 conn(0x7fa88c06a4e0 msgr2=0x7fa88c06a8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:46:01.806 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:01.804+0000 7fa89246b640 1 -- 172.21.15.73:0/3549132767 shutdown_connections 2023-12-12T09:46:01.806 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:01.804+0000 7fa89246b640 1 -- 172.21.15.73:0/3549132767 wait complete. 2023-12-12T09:46:01.808 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:01.806+0000 7fa89246b640 1 Processor -- start 2023-12-12T09:46:01.808 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:01.806+0000 7fa89246b640 1 -- start start 2023-12-12T09:46:01.810 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:01.807+0000 7fa89246b640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa88c0bed50 0x7fa88c14b280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:01.810 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:01.808+0000 7fa89246b640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa88c0c3930 0x7fa88c0705b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:01.811 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:01.808+0000 7fa89246b640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa88c151c30 0x7fa88c1ed940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:01.811 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:01.808+0000 7fa89246b640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa88c1575d0 con 0x7fa88c151c30 2023-12-12T09:46:01.811 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:01.808+0000 7fa89246b640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa88c14afa0 con 0x7fa88c0c3930 2023-12-12T09:46:01.811 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:01.808+0000 7fa89246b640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa88c1577e0 con 0x7fa88c0bed50 2023-12-12T09:46:01.811 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:01.808+0000 7fa890a08640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa88c151c30 0x7fa88c1ed940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:01.811 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:01.808+0000 7fa890a08640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa88c151c30 0x7fa88c1ed940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:44568/0 (socket says 172.21.15.73:44568) 2023-12-12T09:46:01.811 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:01.808+0000 7fa890a08640 1 -- 172.21.15.73:0/3029614424 learned_addr learned my addr 172.21.15.73:0/3029614424 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:46:01.811 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:01.808+0000 7fa88bfff640 1 --2- 172.21.15.73:0/3029614424 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa88c0bed50 0x7fa88c14b280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:01.811 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:01.808+0000 7fa883fff640 1 --2- 172.21.15.73:0/3029614424 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa88c0c3930 0x7fa88c0705b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:01.811 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:01.808+0000 7fa890a08640 1 -- 172.21.15.73:0/3029614424 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa88c0bed50 msgr2=0x7fa88c14b280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:01.811 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:01.808+0000 7fa890a08640 1 --2- 172.21.15.73:0/3029614424 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa88c0bed50 0x7fa88c14b280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:01.811 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:01.808+0000 7fa890a08640 1 -- 172.21.15.73:0/3029614424 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa88c0c3930 msgr2=0x7fa88c0705b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:01.812 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:01.808+0000 7fa890a08640 1 --2- 172.21.15.73:0/3029614424 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa88c0c3930 0x7fa88c0705b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:01.812 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:01.808+0000 7fa890a08640 1 -- 172.21.15.73:0/3029614424 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa87c009400 con 0x7fa88c151c30 2023-12-12T09:46:01.812 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:01.808+0000 7fa88bfff640 1 --2- 172.21.15.73:0/3029614424 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa88c0bed50 0x7fa88c14b280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:46:01.812 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:01.809+0000 7fa890a08640 1 --2- 172.21.15.73:0/3029614424 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa88c151c30 0x7fa88c1ed940 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7fa88400efc0 tx=0x7fa88400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:46:01.812 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:01.809+0000 7fa8897fa640 1 -- 172.21.15.73:0/3029614424 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa884014480 con 0x7fa88c151c30 2023-12-12T09:46:01.812 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:01.809+0000 7fa8897fa640 1 -- 172.21.15.73:0/3029614424 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa88400f040 con 0x7fa88c151c30 2023-12-12T09:46:01.812 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:01.809+0000 7fa89246b640 1 -- 172.21.15.73:0/3029614424 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa88c1ee570 con 0x7fa88c151c30 2023-12-12T09:46:01.812 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:01.809+0000 7fa8897fa640 1 -- 172.21.15.73:0/3029614424 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa884014820 con 0x7fa88c151c30 2023-12-12T09:46:01.812 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:01.809+0000 7fa89246b640 1 -- 172.21.15.73:0/3029614424 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa88c0722b0 con 0x7fa88c151c30 2023-12-12T09:46:01.813 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:01.810+0000 7fa89246b640 1 -- 172.21.15.73:0/3029614424 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa88c067070 con 0x7fa88c151c30 2023-12-12T09:46:01.813 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:01.811+0000 7fa8897fa640 1 -- 172.21.15.73:0/3029614424 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fa884014980 con 0x7fa88c151c30 2023-12-12T09:46:01.814 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:01.813+0000 7fa8897fa640 1 --2- 172.21.15.73:0/3029614424 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fa86c06ae40 0x7fa86c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:01.814 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:01.813+0000 7fa8897fa640 1 -- 172.21.15.73:0/3029614424 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fa88408a5e0 con 0x7fa88c151c30 2023-12-12T09:46:01.814 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:01.813+0000 7fa88bfff640 1 --2- 172.21.15.73:0/3029614424 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fa86c06ae40 0x7fa86c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:01.815 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:01.814+0000 7fa88bfff640 1 --2- 172.21.15.73:0/3029614424 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fa86c06ae40 0x7fa86c06d300 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fa87c036000 tx=0x7fa87c03d040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:46:01.821 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:01.820+0000 7fa8897fa640 1 -- 172.21.15.73:0/3029614424 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fa884055290 con 0x7fa88c151c30 2023-12-12T09:46:02.010 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:02.008+0000 7fa89246b640 1 -- 172.21.15.73:0/3029614424 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"} v 0) v1 -- 0x7fa88c157950 con 0x7fa88c151c30 2023-12-12T09:46:02.010 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:02.009+0000 7fa8897fa640 1 -- 172.21.15.73:0/3029614424 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"}]=0 v58) v1 ==== 105+0+11 (secure 0 0 0) 0x7fa8840588b0 con 0x7fa88c151c30 2023-12-12T09:46:02.011 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 32 2023-12-12T09:46:02.013 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:02.011+0000 7fa89246b640 1 -- 172.21.15.73:0/3029614424 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fa86c06ae40 msgr2=0x7fa86c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:02.013 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:02.011+0000 7fa89246b640 1 --2- 172.21.15.73:0/3029614424 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fa86c06ae40 0x7fa86c06d300 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fa87c036000 tx=0x7fa87c03d040 comp rx=0 tx=0).stop 2023-12-12T09:46:02.013 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:02.011+0000 7fa89246b640 1 -- 172.21.15.73:0/3029614424 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa88c151c30 msgr2=0x7fa88c1ed940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:02.013 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:02.011+0000 7fa89246b640 1 --2- 172.21.15.73:0/3029614424 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa88c151c30 0x7fa88c1ed940 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7fa88400efc0 tx=0x7fa88400c490 comp rx=0 tx=0).stop 2023-12-12T09:46:02.013 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:02.012+0000 7fa89246b640 1 -- 172.21.15.73:0/3029614424 shutdown_connections 2023-12-12T09:46:02.014 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:02.012+0000 7fa89246b640 1 --2- 172.21.15.73:0/3029614424 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fa86c06ae40 0x7fa86c06d300 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:02.014 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:02.012+0000 7fa89246b640 1 --2- 172.21.15.73:0/3029614424 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa88c151c30 0x7fa88c1ed940 unknown :-1 s=CLOSED pgs=757 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:02.014 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:02.012+0000 7fa89246b640 1 --2- 172.21.15.73:0/3029614424 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa88c0c3930 0x7fa88c0705b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:02.014 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:02.012+0000 7fa89246b640 1 --2- 172.21.15.73:0/3029614424 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa88c0bed50 0x7fa88c14b280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:02.014 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:02.012+0000 7fa89246b640 1 -- 172.21.15.73:0/3029614424 >> 172.21.15.73:0/3029614424 conn(0x7fa88c06a4e0 msgr2=0x7fa88c0c43b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:46:02.014 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:02.012+0000 7fa89246b640 1 -- 172.21.15.73:0/3029614424 shutdown_connections 2023-12-12T09:46:02.014 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:02.012+0000 7fa89246b640 1 -- 172.21.15.73:0/3029614424 wait complete. 2023-12-12T09:46:02.034 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_data pg_num 2023-12-12T09:46:02.251 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:02.249+0000 7f78126da640 1 Processor -- start 2023-12-12T09:46:02.251 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:02.250+0000 7f78126da640 1 -- start start 2023-12-12T09:46:02.252 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:02.251+0000 7f78126da640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f780c14f8c0 0x7f780c06dc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:02.253 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:02.251+0000 7f78126da640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f780c0c16c0 con 0x7f780c152500 2023-12-12T09:46:02.253 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:02.251+0000 7f78126da640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f780c0c19a0 con 0x7f780c06d350 2023-12-12T09:46:02.253 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:02.251+0000 7f78126da640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f780c0c1090 con 0x7f780c14f8c0 2023-12-12T09:46:02.253 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:02.251+0000 7f780bfff640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f780c14f8c0 0x7f780c06dc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:02.253 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:02.251+0000 7f780bfff640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f780c14f8c0 0x7f780c06dc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:44582/0 (socket says 172.21.15.73:44582) 2023-12-12T09:46:02.253 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:02.251+0000 7f780bfff640 1 -- 172.21.15.73:0/1451117915 learned_addr learned my addr 172.21.15.73:0/1451117915 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:46:02.253 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:02.251+0000 7f7810c77640 1 --1- 172.21.15.73:0/1451117915 >> v1:172.21.15.73:6789/0 conn(0x7f780c152500 0x7f780c152990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:55760/0 (socket says 172.21.15.73:55760) 2023-12-12T09:46:02.254 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:02.252+0000 7f780bfff640 1 -- 172.21.15.73:0/1451117915 >> v1:172.21.15.142:6789/0 conn(0x7f780c06d350 legacy=0x7f780c071e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:46:02.254 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:02.252+0000 7f780bfff640 1 -- 172.21.15.73:0/1451117915 >> v1:172.21.15.73:6789/0 conn(0x7f780c152500 legacy=0x7f780c152990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:02.254 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:02.252+0000 7f780bfff640 1 -- 172.21.15.73:0/1451117915 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f780c0c1c80 con 0x7f780c14f8c0 2023-12-12T09:46:02.254 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:02.253+0000 7f780bfff640 1 --2- 172.21.15.73:0/1451117915 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f780c14f8c0 0x7f780c06dc40 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f77fc009870 tx=0x7f77fc02b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10a23c49d3bf9e1b server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:46:02.255 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:02.253+0000 7f780b7fe640 1 -- 172.21.15.73:0/1451117915 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77fc030860 con 0x7f780c14f8c0 2023-12-12T09:46:02.255 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:02.253+0000 7f780b7fe640 1 -- 172.21.15.73:0/1451117915 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77fc0309c0 con 0x7f780c14f8c0 2023-12-12T09:46:02.255 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:02.253+0000 7f780b7fe640 1 -- 172.21.15.73:0/1451117915 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77fc030d50 con 0x7f780c14f8c0 2023-12-12T09:46:02.256 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:02.254+0000 7f78126da640 1 -- 172.21.15.73:0/1451117915 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f780c14f8c0 msgr2=0x7f780c06dc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:02.256 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:02.254+0000 7f78126da640 1 --2- 172.21.15.73:0/1451117915 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f780c14f8c0 0x7f780c06dc40 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f77fc009870 tx=0x7f77fc02b9a0 comp rx=0 tx=0).stop 2023-12-12T09:46:02.256 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:02.254+0000 7f78126da640 1 -- 172.21.15.73:0/1451117915 shutdown_connections 2023-12-12T09:46:02.256 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:02.254+0000 7f78126da640 1 --2- 172.21.15.73:0/1451117915 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f780c14f8c0 0x7f780c06dc40 unknown :-1 s=CLOSED pgs=759 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:02.256 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:02.254+0000 7f78126da640 1 -- 172.21.15.73:0/1451117915 >> 172.21.15.73:0/1451117915 conn(0x7f780c06a4e0 msgr2=0x7f780c06a8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:46:02.256 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:02.254+0000 7f78126da640 1 -- 172.21.15.73:0/1451117915 shutdown_connections 2023-12-12T09:46:02.256 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:02.254+0000 7f78126da640 1 -- 172.21.15.73:0/1451117915 wait complete. 2023-12-12T09:46:02.257 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:02.256+0000 7f78126da640 1 Processor -- start 2023-12-12T09:46:02.257 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:02.256+0000 7f78126da640 1 -- start start 2023-12-12T09:46:02.259 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:02.257+0000 7f78126da640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f780c06d350 0x7f780c1ee2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:02.259 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:02.257+0000 7f78126da640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f780c14f8c0 0x7f780c0a8ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:02.259 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:02.257+0000 7f78126da640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f780c152500 0x7f780c147f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:02.260 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:02.257+0000 7f78126da640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f780c1ee7e0 con 0x7f780c06d350 2023-12-12T09:46:02.260 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:02.257+0000 7f78126da640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f780c0a5700 con 0x7f780c14f8c0 2023-12-12T09:46:02.260 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:02.257+0000 7f78126da640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f780c0a5140 con 0x7f780c152500 2023-12-12T09:46:02.260 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:02.257+0000 7f780bfff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f780c06d350 0x7f780c1ee2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:02.260 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:02.257+0000 7f780bfff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f780c06d350 0x7f780c1ee2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:44598/0 (socket says 172.21.15.73:44598) 2023-12-12T09:46:02.260 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:02.257+0000 7f780bfff640 1 -- 172.21.15.73:0/799894725 learned_addr learned my addr 172.21.15.73:0/799894725 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:46:02.260 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:02.257+0000 7f780bfff640 1 -- 172.21.15.73:0/799894725 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f780c152500 msgr2=0x7f780c147f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:02.260 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:02.257+0000 7f780bfff640 1 --2- 172.21.15.73:0/799894725 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f780c152500 0x7f780c147f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:02.260 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:02.257+0000 7f780bfff640 1 -- 172.21.15.73:0/799894725 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f780c14f8c0 msgr2=0x7f780c0a8ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:02.260 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:02.257+0000 7f780bfff640 1 --2- 172.21.15.73:0/799894725 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f780c14f8c0 0x7f780c0a8ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:02.260 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:02.257+0000 7f780bfff640 1 -- 172.21.15.73:0/799894725 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77fc0094d0 con 0x7f780c06d350 2023-12-12T09:46:02.260 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:02.258+0000 7f780bfff640 1 --2- 172.21.15.73:0/799894725 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f780c06d350 0x7f780c1ee2a0 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7f77fc009870 tx=0x7f77fc004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:46:02.260 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:02.258+0000 7f78097fa640 1 -- 172.21.15.73:0/799894725 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77fc030810 con 0x7f780c06d350 2023-12-12T09:46:02.260 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:02.258+0000 7f78097fa640 1 -- 172.21.15.73:0/799894725 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77fc043400 con 0x7f780c06d350 2023-12-12T09:46:02.261 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:02.258+0000 7f78097fa640 1 -- 172.21.15.73:0/799894725 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77fc0437b0 con 0x7f780c06d350 2023-12-12T09:46:02.261 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:02.258+0000 7f78126da640 1 -- 172.21.15.73:0/799894725 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f780c0a5420 con 0x7f780c06d350 2023-12-12T09:46:02.261 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:02.258+0000 7f78126da640 1 -- 172.21.15.73:0/799894725 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f780c0a5ec0 con 0x7f780c06d350 2023-12-12T09:46:02.261 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:02.259+0000 7f78126da640 1 -- 172.21.15.73:0/799894725 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f780c067070 con 0x7f780c06d350 2023-12-12T09:46:02.261 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:02.260+0000 7f78097fa640 1 -- 172.21.15.73:0/799894725 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f77fc043910 con 0x7f780c06d350 2023-12-12T09:46:02.262 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:02.261+0000 7f78097fa640 1 --2- 172.21.15.73:0/799894725 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f77ec06ae40 0x7f77ec06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:02.262 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:02.261+0000 7f78097fa640 1 -- 172.21.15.73:0/799894725 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f77fc03e070 con 0x7f780c06d350 2023-12-12T09:46:02.263 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:02.261+0000 7f7803fff640 1 --2- 172.21.15.73:0/799894725 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f77ec06ae40 0x7f77ec06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:02.263 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:02.262+0000 7f7803fff640 1 --2- 172.21.15.73:0/799894725 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f77ec06ae40 0x7f77ec06d300 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f780c0a8840 tx=0x7f77f4007990 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:46:02.267 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:02.265+0000 7f78097fa640 1 -- 172.21.15.73:0/799894725 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f77fc077b20 con 0x7f780c06d350 2023-12-12T09:46:02.462 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:02.461+0000 7f78126da640 1 -- 172.21.15.73:0/799894725 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"} v 0) v1 -- 0x7f780c067580 con 0x7f780c06d350 2023-12-12T09:46:02.463 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:02.462+0000 7f78097fa640 1 -- 172.21.15.73:0/799894725 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"}]=0 v58) v1 ==== 101+0+11 (secure 0 0 0) 0x7f77fc034020 con 0x7f780c06d350 2023-12-12T09:46:02.463 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 64 2023-12-12T09:46:02.466 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:02.464+0000 7f78126da640 1 -- 172.21.15.73:0/799894725 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f77ec06ae40 msgr2=0x7f77ec06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:02.466 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:02.464+0000 7f78126da640 1 --2- 172.21.15.73:0/799894725 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f77ec06ae40 0x7f77ec06d300 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f780c0a8840 tx=0x7f77f4007990 comp rx=0 tx=0).stop 2023-12-12T09:46:02.466 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:02.464+0000 7f78126da640 1 -- 172.21.15.73:0/799894725 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f780c06d350 msgr2=0x7f780c1ee2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:02.466 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:02.464+0000 7f78126da640 1 --2- 172.21.15.73:0/799894725 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f780c06d350 0x7f780c1ee2a0 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7f77fc009870 tx=0x7f77fc004730 comp rx=0 tx=0).stop 2023-12-12T09:46:02.466 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:02.464+0000 7f78126da640 1 -- 172.21.15.73:0/799894725 shutdown_connections 2023-12-12T09:46:02.466 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:02.464+0000 7f78126da640 1 --2- 172.21.15.73:0/799894725 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f77ec06ae40 0x7f77ec06d300 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:02.466 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:02.464+0000 7f78126da640 1 --2- 172.21.15.73:0/799894725 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f780c152500 0x7f780c147f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:02.466 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:02.464+0000 7f78126da640 1 --2- 172.21.15.73:0/799894725 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f780c14f8c0 0x7f780c0a8ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:02.467 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:02.464+0000 7f78126da640 1 --2- 172.21.15.73:0/799894725 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f780c06d350 0x7f780c1ee2a0 unknown :-1 s=CLOSED pgs=760 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:02.467 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:02.464+0000 7f78126da640 1 -- 172.21.15.73:0/799894725 >> 172.21.15.73:0/799894725 conn(0x7f780c06a4e0 msgr2=0x7f780c0bf5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:46:02.467 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:02.465+0000 7f78126da640 1 -- 172.21.15.73:0/799894725 shutdown_connections 2023-12-12T09:46:02.467 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:02.465+0000 7f78126da640 1 -- 172.21.15.73:0/799894725 wait complete. 2023-12-12T09:46:02.484 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-12T09:46:02.697 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:02.695+0000 7fb80a1ec640 1 Processor -- start 2023-12-12T09:46:02.697 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:02.695+0000 7fb80a1ec640 1 -- start start 2023-12-12T09:46:02.701 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:02.697+0000 7fb80a1ec640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb8041552e0 0x7fb8040c49c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:02.701 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:02.697+0000 7fb80a1ec640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8040c0b50 con 0x7fb80406bf20 2023-12-12T09:46:02.701 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:02.697+0000 7fb80a1ec640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb80406c880 con 0x7fb8040a50f0 2023-12-12T09:46:02.701 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:02.697+0000 7fb80a1ec640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8040c04d0 con 0x7fb8041552e0 2023-12-12T09:46:02.701 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:02.697+0000 7fb803fff640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7fb80406bf20 0x7fb80415bb90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:55766/0 (socket says 172.21.15.73:55766) 2023-12-12T09:46:02.701 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:02.697+0000 7fb803fff640 1 -- 172.21.15.73:0/3004401486 learned_addr learned my addr 172.21.15.73:0/3004401486 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-12T09:46:02.701 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:02.697+0000 7fb8037fe640 1 --2- 172.21.15.73:0/3004401486 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb8041552e0 0x7fb8040c49c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:02.701 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:02.698+0000 7fb802ffd640 1 -- 172.21.15.73:0/3004401486 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2197151254 0 0) 0x7fb8040c0b50 con 0x7fb80406bf20 2023-12-12T09:46:02.702 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:02.698+0000 7fb802ffd640 1 -- 172.21.15.73:0/3004401486 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb7f0003520 con 0x7fb80406bf20 2023-12-12T09:46:02.702 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:02.698+0000 7fb802ffd640 1 -- 172.21.15.73:0/3004401486 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4143110935 0 0) 0x7fb7f0003520 con 0x7fb80406bf20 2023-12-12T09:46:02.702 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:02.698+0000 7fb802ffd640 1 -- 172.21.15.73:0/3004401486 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb8041552e0 msgr2=0x7fb8040c49c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:46:02.702 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:02.698+0000 7fb802ffd640 1 --2- 172.21.15.73:0/3004401486 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb8041552e0 0x7fb8040c49c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:02.702 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:02.698+0000 7fb802ffd640 1 -- 172.21.15.73:0/3004401486 >> v1:172.21.15.142:6789/0 conn(0x7fb8040a50f0 legacy=0x7fb8040a9050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:02.702 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:02.698+0000 7fb802ffd640 1 -- 172.21.15.73:0/3004401486 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb80406cb60 con 0x7fb80406bf20 2023-12-12T09:46:02.702 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:02.698+0000 7fb802ffd640 1 -- 172.21.15.73:0/3004401486 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3186547832 0 0) 0x7fb7fc0019f0 con 0x7fb80406bf20 2023-12-12T09:46:02.702 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:02.698+0000 7fb802ffd640 1 -- 172.21.15.73:0/3004401486 >> v1:172.21.15.73:6789/0 conn(0x7fb80406bf20 legacy=0x7fb80415bb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:02.702 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:02.698+0000 7fb802ffd640 1 --2- 172.21.15.73:0/3004401486 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb8041552e0 0x7fb7f00039a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:02.702 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:02.698+0000 7fb802ffd640 1 --2- 172.21.15.73:0/3004401486 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb7f0003f20 0x7fb7f00047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:02.702 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:02.698+0000 7fb802ffd640 1 --2- 172.21.15.73:0/3004401486 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb7f0004d00 0x7fb7f0005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:02.702 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:02.698+0000 7fb802ffd640 1 -- 172.21.15.73:0/3004401486 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8040c04d0 con 0x7fb7f0004d00 2023-12-12T09:46:02.702 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:02.698+0000 7fb802ffd640 1 -- 172.21.15.73:0/3004401486 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7f000bb10 con 0x7fb7f0003f20 2023-12-12T09:46:02.702 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:02.698+0000 7fb802ffd640 1 -- 172.21.15.73:0/3004401486 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7f000dee0 con 0x7fb8041552e0 2023-12-12T09:46:02.703 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:02.698+0000 7fb803fff640 1 --2- 172.21.15.73:0/3004401486 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb7f0004d00 0x7fb7f0005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:02.703 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:02.699+0000 7fb7fbfff640 1 --2- 172.21.15.73:0/3004401486 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb7f0003f20 0x7fb7f00047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:02.703 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:02.699+0000 7fb803fff640 1 -- 172.21.15.73:0/3004401486 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb8041552e0 msgr2=0x7fb7f00039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:46:02.703 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:02.699+0000 7fb8037fe640 1 --2- 172.21.15.73:0/3004401486 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb8041552e0 0x7fb7f00039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:02.703 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:02.699+0000 7fb803fff640 1 --2- 172.21.15.73:0/3004401486 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb8041552e0 0x7fb7f00039a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:02.703 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:02.699+0000 7fb803fff640 1 -- 172.21.15.73:0/3004401486 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb7f0003f20 msgr2=0x7fb7f00047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:46:02.703 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:02.699+0000 7fb803fff640 1 --2- 172.21.15.73:0/3004401486 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb7f0003f20 0x7fb7f00047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:02.703 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:02.699+0000 7fb803fff640 1 -- 172.21.15.73:0/3004401486 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7f0003520 con 0x7fb7f0004d00 2023-12-12T09:46:02.705 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:02.700+0000 7fb803fff640 1 --2- 172.21.15.73:0/3004401486 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb7f0004d00 0x7fb7f0005180 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7fb7fc00a820 tx=0x7fb7f00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4c65cd682dc043f server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:46:02.705 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:02.700+0000 7fb802ffd640 1 -- 172.21.15.73:0/3004401486 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7fc0072d0 con 0x7fb7f0004d00 2023-12-12T09:46:02.706 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:02.700+0000 7fb802ffd640 1 -- 172.21.15.73:0/3004401486 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7fc02f070 con 0x7fb7f0004d00 2023-12-12T09:46:02.706 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:02.700+0000 7fb802ffd640 1 -- 172.21.15.73:0/3004401486 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7fc0076b0 con 0x7fb7f0004d00 2023-12-12T09:46:02.706 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:02.701+0000 7fb80a1ec640 1 -- 172.21.15.73:0/3004401486 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb7f0004d00 msgr2=0x7fb7f0005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:02.706 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:02.701+0000 7fb80a1ec640 1 --2- 172.21.15.73:0/3004401486 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb7f0004d00 0x7fb7f0005180 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7fb7fc00a820 tx=0x7fb7f00057f0 comp rx=0 tx=0).stop 2023-12-12T09:46:02.706 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:02.701+0000 7fb803fff640 1 -- 172.21.15.73:0/3004401486 reap_dead start 2023-12-12T09:46:02.706 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:02.701+0000 7fb80a1ec640 1 -- 172.21.15.73:0/3004401486 shutdown_connections 2023-12-12T09:46:02.706 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:02.701+0000 7fb80a1ec640 1 -- 172.21.15.73:0/3004401486 >> 172.21.15.73:0/3004401486 conn(0x7fb8040a8130 msgr2=0x7fb8040c24b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:46:02.707 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:02.701+0000 7fb80a1ec640 1 -- 172.21.15.73:0/3004401486 shutdown_connections 2023-12-12T09:46:02.707 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:02.701+0000 7fb80a1ec640 1 -- 172.21.15.73:0/3004401486 wait complete. 2023-12-12T09:46:02.707 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:02.703+0000 7fb80a1ec640 1 Processor -- start 2023-12-12T09:46:02.707 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:02.703+0000 7fb80a1ec640 1 -- start start 2023-12-12T09:46:02.707 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:02.704+0000 7fb80a1ec640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb7f0004d00 0x7fb8040a68e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:02.707 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:02.704+0000 7fb80a1ec640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb80406fcc0 0x7fb8041469b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:02.707 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:02.704+0000 7fb80a1ec640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb8040bf6c0 0x7fb804146ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:02.708 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:02.704+0000 7fb80a1ec640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb80409a080 con 0x7fb8040bf6c0 2023-12-12T09:46:02.708 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:02.704+0000 7fb80a1ec640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8040bf070 con 0x7fb80406fcc0 2023-12-12T09:46:02.708 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:02.704+0000 7fb80a1ec640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb804147430 con 0x7fb7f0004d00 2023-12-12T09:46:02.708 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:02.704+0000 7fb803fff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb8040bf6c0 0x7fb804146ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:02.708 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:02.704+0000 7fb803fff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb8040bf6c0 0x7fb804146ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:44614/0 (socket says 172.21.15.73:44614) 2023-12-12T09:46:02.708 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:02.704+0000 7fb803fff640 1 -- 172.21.15.73:0/2963590047 learned_addr learned my addr 172.21.15.73:0/2963590047 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:46:02.708 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:02.704+0000 7fb8037fe640 1 --2- 172.21.15.73:0/2963590047 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb7f0004d00 0x7fb8040a68e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:02.708 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:02.704+0000 7fb7fbfff640 1 --2- 172.21.15.73:0/2963590047 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb80406fcc0 0x7fb8041469b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:02.711 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:02.705+0000 7fb803fff640 1 -- 172.21.15.73:0/2963590047 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb7f0004d00 msgr2=0x7fb8040a68e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:02.711 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:02.705+0000 7fb803fff640 1 --2- 172.21.15.73:0/2963590047 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb7f0004d00 0x7fb8040a68e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:02.711 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:02.705+0000 7fb803fff640 1 -- 172.21.15.73:0/2963590047 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb80406fcc0 msgr2=0x7fb8041469b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:02.711 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:02.705+0000 7fb803fff640 1 --2- 172.21.15.73:0/2963590047 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb80406fcc0 0x7fb8041469b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:02.711 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:02.705+0000 7fb803fff640 1 -- 172.21.15.73:0/2963590047 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb804099a70 con 0x7fb8040bf6c0 2023-12-12T09:46:02.711 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:02.705+0000 7fb803fff640 1 --2- 172.21.15.73:0/2963590047 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb8040bf6c0 0x7fb804146ef0 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7fb7fc001580 tx=0x7fb804072600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:46:02.711 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:02.705+0000 7fb800ff9640 1 -- 172.21.15.73:0/2963590047 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7fc0074e0 con 0x7fb8040bf6c0 2023-12-12T09:46:02.711 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:02.705+0000 7fb800ff9640 1 -- 172.21.15.73:0/2963590047 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7fc007640 con 0x7fb8040bf6c0 2023-12-12T09:46:02.711 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:02.705+0000 7fb800ff9640 1 -- 172.21.15.73:0/2963590047 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7fc0079b0 con 0x7fb8040bf6c0 2023-12-12T09:46:02.711 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:02.705+0000 7fb80a1ec640 1 -- 172.21.15.73:0/2963590047 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8041ea5f0 con 0x7fb8040bf6c0 2023-12-12T09:46:02.711 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:02.705+0000 7fb80a1ec640 1 -- 172.21.15.73:0/2963590047 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8041ea8d0 con 0x7fb8040bf6c0 2023-12-12T09:46:02.712 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:02.706+0000 7fb80a1ec640 1 -- 172.21.15.73:0/2963590047 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb804067580 con 0x7fb8040bf6c0 2023-12-12T09:46:02.712 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:02.707+0000 7fb800ff9640 1 -- 172.21.15.73:0/2963590047 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fb7fc031030 con 0x7fb8040bf6c0 2023-12-12T09:46:02.712 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:02.708+0000 7fb800ff9640 1 --2- 172.21.15.73:0/2963590047 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fb7e406ae70 0x7fb7e406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:02.712 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:02.708+0000 7fb800ff9640 1 -- 172.21.15.73:0/2963590047 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fb7fc0ab4f0 con 0x7fb8040bf6c0 2023-12-12T09:46:02.712 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:02.709+0000 7fb8037fe640 1 --2- 172.21.15.73:0/2963590047 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fb7e406ae70 0x7fb7e406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:02.712 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:02.709+0000 7fb8037fe640 1 --2- 172.21.15.73:0/2963590047 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fb7e406ae70 0x7fb7e406d330 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fb7f4009a10 tx=0x7fb7f4008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:46:02.714 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:02.713+0000 7fb800ff9640 1 -- 172.21.15.73:0/2963590047 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fb7fc0762d0 con 0x7fb8040bf6c0 2023-12-12T09:46:02.946 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:02.944+0000 7fb80a1ec640 1 -- 172.21.15.73:0/2963590047 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb80406ddd0 con 0x7fb8040bf6c0 2023-12-12T09:46:02.947 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:02.945+0000 7fb800ff9640 1 -- 172.21.15.73:0/2963590047 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 35 v35) v1 ==== 94+0+6135 (secure 0 0 0) 0x7fb7fc0798f0 con 0x7fb8040bf6c0 2023-12-12T09:46:02.947 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-12T09:46:02.947 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":35,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4736,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6834/2964437845","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6832","nonce":2964437845},{"type":"v1","addr":"172.21.15.142:6834","nonce":2964437845}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":25},{"gid":5044,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6837/3698725764","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6836","nonce":3698725764},{"type":"v1","addr":"172.21.15.73:6837","nonce":3698725764}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":25}],"filesystems":[{"mdsmap":{"epoch":30,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-12T09:45:22.971300+0000","modified":"2023-12-12T09:45:26.028731+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5703},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5703":{"gid":5703,"name":"a","rank":0,"incarnation":26,"state":"up:active","state_seq":3,"addr":"172.21.15.73:6835/744058726","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":744058726},{"type":"v1","addr":"172.21.15.73:6835","nonce":744058726}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4},{"mdsmap":{"epoch":35,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-12T09:45:38.103609+0000","modified":"2023-12-12T09:45:41.148650+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5059},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5059":{"gid":5059,"name":"d","rank":0,"incarnation":31,"state":"up:active","state_seq":7,"addr":"172.21.15.142:6835/2931058847","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6833","nonce":2931058847},{"type":"v1","addr":"172.21.15.142:6835","nonce":2931058847}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2023-12-12T09:46:02.947 INFO:teuthology.orchestra.run.smithi073.stderr:dumped fsmap epoch 35 2023-12-12T09:46:02.950 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:02.948+0000 7fb80a1ec640 1 -- 172.21.15.73:0/2963590047 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fb7e406ae70 msgr2=0x7fb7e406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:02.950 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:02.948+0000 7fb80a1ec640 1 --2- 172.21.15.73:0/2963590047 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fb7e406ae70 0x7fb7e406d330 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fb7f4009a10 tx=0x7fb7f4008040 comp rx=0 tx=0).stop 2023-12-12T09:46:02.950 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:02.948+0000 7fb80a1ec640 1 -- 172.21.15.73:0/2963590047 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb8040bf6c0 msgr2=0x7fb804146ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:02.950 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:02.948+0000 7fb80a1ec640 1 --2- 172.21.15.73:0/2963590047 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb8040bf6c0 0x7fb804146ef0 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7fb7fc001580 tx=0x7fb804072600 comp rx=0 tx=0).stop 2023-12-12T09:46:02.950 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:02.948+0000 7fb80a1ec640 1 -- 172.21.15.73:0/2963590047 shutdown_connections 2023-12-12T09:46:02.950 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:02.948+0000 7fb80a1ec640 1 --2- 172.21.15.73:0/2963590047 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fb7e406ae70 0x7fb7e406d330 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:02.950 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:02.948+0000 7fb80a1ec640 1 --2- 172.21.15.73:0/2963590047 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb8040bf6c0 0x7fb804146ef0 unknown :-1 s=CLOSED pgs=763 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:02.950 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:02.948+0000 7fb80a1ec640 1 --2- 172.21.15.73:0/2963590047 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb80406fcc0 0x7fb8041469b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:02.950 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:02.948+0000 7fb80a1ec640 1 --2- 172.21.15.73:0/2963590047 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb7f0004d00 0x7fb8040a68e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:02.950 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:02.948+0000 7fb80a1ec640 1 -- 172.21.15.73:0/2963590047 >> 172.21.15.73:0/2963590047 conn(0x7fb8040a8130 msgr2=0x7fb804153650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:46:02.950 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:02.948+0000 7fb80a1ec640 1 -- 172.21.15.73:0/2963590047 shutdown_connections 2023-12-12T09:46:02.950 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:02.948+0000 7fb80a1ec640 1 -- 172.21.15.73:0/2963590047 wait complete. 2023-12-12T09:46:02.969 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-12T09:46:03.181 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:03.179+0000 7f23140ec640 1 Processor -- start 2023-12-12T09:46:03.181 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:03.180+0000 7f23140ec640 1 -- start start 2023-12-12T09:46:03.183 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:03.181+0000 7f23140ec640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f230c14fa40 0x7f230c06a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:03.183 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:03.181+0000 7f23140ec640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f230c06db70 0x7f230c0c39b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:03.183 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:03.181+0000 7f23140ec640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f230c152610 con 0x7f230c0c5070 2023-12-12T09:46:03.183 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:03.181+0000 7f23140ec640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f230c1528f0 con 0x7f230c14fa40 2023-12-12T09:46:03.183 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:03.181+0000 7f23140ec640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f230c152bd0 con 0x7f230c06db70 2023-12-12T09:46:03.183 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:03.181+0000 7f2311e88640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f230c14fa40 0x7f230c06a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:03.183 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:03.182+0000 7f2311e88640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f230c14fa40 0x7f230c06a4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:44630/0 (socket says 172.21.15.73:44630) 2023-12-12T09:46:03.183 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:03.182+0000 7f2311e88640 1 -- 172.21.15.73:0/264415996 learned_addr learned my addr 172.21.15.73:0/264415996 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:46:03.183 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:03.182+0000 7f2312689640 1 --1- 172.21.15.73:0/264415996 >> v1:172.21.15.73:6789/0 conn(0x7f230c0c5070 0x7f230c0c3ef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:55772/0 (socket says 172.21.15.73:55772) 2023-12-12T09:46:03.184 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:03.182+0000 7f2311e88640 1 -- 172.21.15.73:0/264415996 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f230c06db70 msgr2=0x7f230c0c39b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:46:03.184 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:03.182+0000 7f2311e88640 1 --2- 172.21.15.73:0/264415996 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f230c06db70 0x7f230c0c39b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:03.184 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:03.182+0000 7f2311e88640 1 -- 172.21.15.73:0/264415996 >> v1:172.21.15.73:6789/0 conn(0x7f230c0c5070 legacy=0x7f230c0c3ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:03.184 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:03.182+0000 7f2311e88640 1 -- 172.21.15.73:0/264415996 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f230c152eb0 con 0x7f230c14fa40 2023-12-12T09:46:03.184 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:03.182+0000 7f2310e86640 1 -- 172.21.15.73:0/264415996 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1894048270 0 0) 0x7f230c152610 con 0x7f230c0c5070 2023-12-12T09:46:03.185 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:03.183+0000 7f2311e88640 1 --2- 172.21.15.73:0/264415996 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f230c14fa40 0x7f230c06a4e0 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7f2308009870 tx=0x7f230802b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83e1219e5349e47d server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:46:03.185 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:03.183+0000 7f2310e86640 1 -- 172.21.15.73:0/264415996 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2308030840 con 0x7f230c14fa40 2023-12-12T09:46:03.185 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:03.183+0000 7f2310e86640 1 -- 172.21.15.73:0/264415996 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23080309a0 con 0x7f230c14fa40 2023-12-12T09:46:03.185 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:03.183+0000 7f2310e86640 1 -- 172.21.15.73:0/264415996 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2308030d30 con 0x7f230c14fa40 2023-12-12T09:46:03.185 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:03.184+0000 7f23140ec640 1 -- 172.21.15.73:0/264415996 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f230c14fa40 msgr2=0x7f230c06a4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:03.185 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:03.184+0000 7f23140ec640 1 --2- 172.21.15.73:0/264415996 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f230c14fa40 0x7f230c06a4e0 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7f2308009870 tx=0x7f230802b980 comp rx=0 tx=0).stop 2023-12-12T09:46:03.186 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:03.184+0000 7f23140ec640 1 -- 172.21.15.73:0/264415996 shutdown_connections 2023-12-12T09:46:03.186 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:03.184+0000 7f23140ec640 1 --2- 172.21.15.73:0/264415996 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f230c06db70 0x7f230c0c39b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:03.186 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:03.184+0000 7f23140ec640 1 --2- 172.21.15.73:0/264415996 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f230c14fa40 0x7f230c06a4e0 unknown :-1 s=CLOSED pgs=765 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:03.186 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:03.184+0000 7f23140ec640 1 -- 172.21.15.73:0/264415996 >> 172.21.15.73:0/264415996 conn(0x7f230c0a8130 msgr2=0x7f230c0c24b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:46:03.186 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:03.184+0000 7f23140ec640 1 -- 172.21.15.73:0/264415996 shutdown_connections 2023-12-12T09:46:03.186 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:03.184+0000 7f23140ec640 1 -- 172.21.15.73:0/264415996 wait complete. 2023-12-12T09:46:03.187 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:03.186+0000 7f23140ec640 1 Processor -- start 2023-12-12T09:46:03.187 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:03.186+0000 7f23140ec640 1 -- start start 2023-12-12T09:46:03.188 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:03.187+0000 7f23140ec640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f230c06db70 0x7f230c0bf050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:03.188 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:03.187+0000 7f23140ec640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f230c0c5070 0x7f230c1d8e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:03.189 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:03.187+0000 7f23140ec640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f230c14fa40 0x7f230c14ca10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:03.189 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:03.187+0000 7f23140ec640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f230c1db460 con 0x7f230c0c5070 2023-12-12T09:46:03.189 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:03.187+0000 7f23140ec640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f230c0a8b60 con 0x7f230c14fa40 2023-12-12T09:46:03.189 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:03.187+0000 7f23140ec640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f230c1d8800 con 0x7f230c06db70 2023-12-12T09:46:03.189 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:03.187+0000 7f2311687640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f230c0c5070 0x7f230c1d8e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:03.189 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:03.187+0000 7f2311687640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f230c0c5070 0x7f230c1d8e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:44634/0 (socket says 172.21.15.73:44634) 2023-12-12T09:46:03.189 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:03.187+0000 7f2311687640 1 -- 172.21.15.73:0/60626536 learned_addr learned my addr 172.21.15.73:0/60626536 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:46:03.190 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:03.188+0000 7f2311e88640 1 --2- 172.21.15.73:0/60626536 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f230c06db70 0x7f230c0bf050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:03.190 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:03.188+0000 7f2312689640 1 --2- 172.21.15.73:0/60626536 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f230c14fa40 0x7f230c14ca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:03.190 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:03.188+0000 7f2311687640 1 -- 172.21.15.73:0/60626536 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f230c06db70 msgr2=0x7f230c0bf050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:03.191 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:03.188+0000 7f2311687640 1 --2- 172.21.15.73:0/60626536 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f230c06db70 0x7f230c0bf050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:03.191 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:03.188+0000 7f2311687640 1 -- 172.21.15.73:0/60626536 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f230c14fa40 msgr2=0x7f230c14ca10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:03.191 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:03.188+0000 7f2311687640 1 --2- 172.21.15.73:0/60626536 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f230c14fa40 0x7f230c14ca10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:03.191 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:03.188+0000 7f2311687640 1 -- 172.21.15.73:0/60626536 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23080094d0 con 0x7f230c0c5070 2023-12-12T09:46:03.191 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:03.188+0000 7f2311e88640 1 --2- 172.21.15.73:0/60626536 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f230c06db70 0x7f230c0bf050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:46:03.191 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:03.188+0000 7f2312689640 1 --2- 172.21.15.73:0/60626536 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f230c14fa40 0x7f230c14ca10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:46:03.191 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:03.188+0000 7f2311687640 1 --2- 172.21.15.73:0/60626536 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f230c0c5070 0x7f230c1d8e50 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7f22fc00b440 tx=0x7f22fc00b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:46:03.191 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:03.188+0000 7f23027fc640 1 -- 172.21.15.73:0/60626536 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22fc011890 con 0x7f230c0c5070 2023-12-12T09:46:03.191 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:03.188+0000 7f23027fc640 1 -- 172.21.15.73:0/60626536 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22fc011a10 con 0x7f230c0c5070 2023-12-12T09:46:03.191 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:03.188+0000 7f23027fc640 1 -- 172.21.15.73:0/60626536 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22fc011dc0 con 0x7f230c0c5070 2023-12-12T09:46:03.191 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:03.188+0000 7f23140ec640 1 -- 172.21.15.73:0/60626536 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f230c1d8ae0 con 0x7f230c0c5070 2023-12-12T09:46:03.191 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:03.188+0000 7f23140ec640 1 -- 172.21.15.73:0/60626536 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f230c0a9090 con 0x7f230c0c5070 2023-12-12T09:46:03.192 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:03.189+0000 7f23140ec640 1 -- 172.21.15.73:0/60626536 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f230c067580 con 0x7f230c0c5070 2023-12-12T09:46:03.192 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:03.191+0000 7f23027fc640 1 -- 172.21.15.73:0/60626536 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f22fc01a400 con 0x7f230c0c5070 2023-12-12T09:46:03.193 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:03.191+0000 7f23027fc640 1 --2- 172.21.15.73:0/60626536 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f22f006ae70 0x7f22f006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:03.193 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:03.192+0000 7f23027fc640 1 -- 172.21.15.73:0/60626536 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f22fc089d20 con 0x7f230c0c5070 2023-12-12T09:46:03.193 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:03.192+0000 7f2311e88640 1 --2- 172.21.15.73:0/60626536 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f22f006ae70 0x7f22f006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:03.194 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:03.193+0000 7f2311e88640 1 --2- 172.21.15.73:0/60626536 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f22f006ae70 0x7f22f006d330 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f2308036000 tx=0x7f230803b040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:46:03.197 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:03.196+0000 7f23027fc640 1 -- 172.21.15.73:0/60626536 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f22fc0549e0 con 0x7f230c0c5070 2023-12-12T09:46:03.387 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:03.386+0000 7f23140ec640 1 -- 172.21.15.73:0/60626536 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f230c0a62d0 con 0x7f230c0c5070 2023-12-12T09:46:03.391 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:03.390+0000 7f23027fc640 1 -- 172.21.15.73:0/60626536 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v58) v1 ==== 74+0+20292 (secure 0 0 0) 0x7f22fc015070 con 0x7f230c0c5070 2023-12-12T09:46:03.392 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-12T09:46:03.392 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":58,"fsid":"ba240992-02b8-4c7e-92f2-27eb29ac433b","created":"2023-12-12T09:43:02.454719+0000","modified":"2023-12-12T09:45:39.273967+0000","last_up_change":"2023-12-12T09:43:13.913440+0000","last_in_change":"2023-12-12T09:43:05.925348+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-12T09:43:15.525508+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-12-12T09:45:21.264815+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"53","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-12-12T09:45:21.981834+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"54","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs2_metadata","create_time":"2023-12-12T09:45:36.388393+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"57","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs2_data","create_time":"2023-12-12T09:45:37.109653+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"58","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"dd9074be-dbe2-4c34-9896-a4223d8d3940","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":4047810203},{"type":"v1","addr":"172.21.15.73:6801","nonce":4047810203}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":4047810203},{"type":"v1","addr":"172.21.15.73:6803","nonce":4047810203}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":4047810203},{"type":"v1","addr":"172.21.15.73:6807","nonce":4047810203}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":4047810203},{"type":"v1","addr":"172.21.15.73:6805","nonce":4047810203}]},"public_addr":"172.21.15.73:6801/4047810203","cluster_addr":"172.21.15.73:6803/4047810203","heartbeat_back_addr":"172.21.15.73:6807/4047810203","heartbeat_front_addr":"172.21.15.73:6805/4047810203","state":["exists","up"]},{"osd":1,"uuid":"c4a05052-96d4-4758-a4e1-1a37f1e07fed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":1356058331},{"type":"v1","addr":"172.21.15.73:6824","nonce":1356058331}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":1356058331},{"type":"v1","addr":"172.21.15.73:6827","nonce":1356058331}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":1356058331},{"type":"v1","addr":"172.21.15.73:6831","nonce":1356058331}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":1356058331},{"type":"v1","addr":"172.21.15.73:6829","nonce":1356058331}]},"public_addr":"172.21.15.73:6824/1356058331","cluster_addr":"172.21.15.73:6827/1356058331","heartbeat_back_addr":"172.21.15.73:6831/1356058331","heartbeat_front_addr":"172.21.15.73:6829/1356058331","state":["exists","up"]},{"osd":2,"uuid":"512bc8ac-72c2-40d4-b3d2-d867a92c5213","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":1228903316},{"type":"v1","addr":"172.21.15.73:6817","nonce":1228903316}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":1228903316},{"type":"v1","addr":"172.21.15.73:6819","nonce":1228903316}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6823","nonce":1228903316},{"type":"v1","addr":"172.21.15.73:6825","nonce":1228903316}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":1228903316},{"type":"v1","addr":"172.21.15.73:6821","nonce":1228903316}]},"public_addr":"172.21.15.73:6817/1228903316","cluster_addr":"172.21.15.73:6819/1228903316","heartbeat_back_addr":"172.21.15.73:6825/1228903316","heartbeat_front_addr":"172.21.15.73:6821/1228903316","state":["exists","up"]},{"osd":3,"uuid":"3d1a91e0-42bf-437a-8eae-8d357c8f63a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":1293329670},{"type":"v1","addr":"172.21.15.73:6809","nonce":1293329670}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6810","nonce":1293329670},{"type":"v1","addr":"172.21.15.73:6811","nonce":1293329670}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":1293329670},{"type":"v1","addr":"172.21.15.73:6815","nonce":1293329670}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":1293329670},{"type":"v1","addr":"172.21.15.73:6813","nonce":1293329670}]},"public_addr":"172.21.15.73:6809/1293329670","cluster_addr":"172.21.15.73:6811/1293329670","heartbeat_back_addr":"172.21.15.73:6815/1293329670","heartbeat_front_addr":"172.21.15.73:6813/1293329670","state":["exists","up"]},{"osd":4,"uuid":"4b302fff-834c-4069-ac19-00e46f6c87b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":3727975702},{"type":"v1","addr":"172.21.15.142:6801","nonce":3727975702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":3727975702},{"type":"v1","addr":"172.21.15.142:6803","nonce":3727975702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6809","nonce":3727975702},{"type":"v1","addr":"172.21.15.142:6811","nonce":3727975702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6805","nonce":3727975702},{"type":"v1","addr":"172.21.15.142:6807","nonce":3727975702}]},"public_addr":"172.21.15.142:6801/3727975702","cluster_addr":"172.21.15.142:6803/3727975702","heartbeat_back_addr":"172.21.15.142:6811/3727975702","heartbeat_front_addr":"172.21.15.142:6807/3727975702","state":["exists","up"]},{"osd":5,"uuid":"d7cdace2-67d0-45cc-95f2-515cf6ef1b82","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6817","nonce":2353193632},{"type":"v1","addr":"172.21.15.142:6819","nonce":2353193632}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6821","nonce":2353193632},{"type":"v1","addr":"172.21.15.142:6823","nonce":2353193632}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6829","nonce":2353193632},{"type":"v1","addr":"172.21.15.142:6831","nonce":2353193632}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6825","nonce":2353193632},{"type":"v1","addr":"172.21.15.142:6827","nonce":2353193632}]},"public_addr":"172.21.15.142:6819/2353193632","cluster_addr":"172.21.15.142:6823/2353193632","heartbeat_back_addr":"172.21.15.142:6831/2353193632","heartbeat_front_addr":"172.21.15.142:6827/2353193632","state":["exists","up"]},{"osd":6,"uuid":"649ce78a-5626-445c-aedc-a651ed05a6f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":2006111986},{"type":"v1","addr":"172.21.15.142:6806","nonce":2006111986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":2006111986},{"type":"v1","addr":"172.21.15.142:6810","nonce":2006111986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":2006111986},{"type":"v1","addr":"172.21.15.142:6815","nonce":2006111986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":2006111986},{"type":"v1","addr":"172.21.15.142:6813","nonce":2006111986}]},"public_addr":"172.21.15.142:6806/2006111986","cluster_addr":"172.21.15.142:6810/2006111986","heartbeat_back_addr":"172.21.15.142:6815/2006111986","heartbeat_front_addr":"172.21.15.142:6813/2006111986","state":["exists","up"]},{"osd":7,"uuid":"af15ae3b-c1d0-4acf-92db-8a1805494d13","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":2573794341},{"type":"v1","addr":"172.21.15.142:6818","nonce":2573794341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":2573794341},{"type":"v1","addr":"172.21.15.142:6822","nonce":2573794341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":2573794341},{"type":"v1","addr":"172.21.15.142:6830","nonce":2573794341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":2573794341},{"type":"v1","addr":"172.21.15.142:6826","nonce":2573794341}]},"public_addr":"172.21.15.142:6818/2573794341","cluster_addr":"172.21.15.142:6822/2573794341","heartbeat_back_addr":"172.21.15.142:6830/2573794341","heartbeat_front_addr":"172.21.15.142:6826/2573794341","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.185824+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.262103+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.225556+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:10.523459+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:10.706035+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.257339+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.301776+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.051960+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-12T09:46:03.394 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:03.393+0000 7f23140ec640 1 -- 172.21.15.73:0/60626536 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f22f006ae70 msgr2=0x7f22f006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:03.394 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:03.393+0000 7f23140ec640 1 --2- 172.21.15.73:0/60626536 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f22f006ae70 0x7f22f006d330 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f2308036000 tx=0x7f230803b040 comp rx=0 tx=0).stop 2023-12-12T09:46:03.395 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:03.393+0000 7f23140ec640 1 -- 172.21.15.73:0/60626536 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f230c0c5070 msgr2=0x7f230c1d8e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:03.395 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:03.393+0000 7f23140ec640 1 --2- 172.21.15.73:0/60626536 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f230c0c5070 0x7f230c1d8e50 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7f22fc00b440 tx=0x7f22fc00b900 comp rx=0 tx=0).stop 2023-12-12T09:46:03.395 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:03.393+0000 7f23140ec640 1 -- 172.21.15.73:0/60626536 shutdown_connections 2023-12-12T09:46:03.395 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:03.393+0000 7f23140ec640 1 --2- 172.21.15.73:0/60626536 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f22f006ae70 0x7f22f006d330 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:03.395 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:03.393+0000 7f23140ec640 1 --2- 172.21.15.73:0/60626536 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f230c14fa40 0x7f230c14ca10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:03.395 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:03.393+0000 7f23140ec640 1 --2- 172.21.15.73:0/60626536 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f230c0c5070 0x7f230c1d8e50 unknown :-1 s=CLOSED pgs=766 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:03.395 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:03.393+0000 7f23140ec640 1 --2- 172.21.15.73:0/60626536 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f230c06db70 0x7f230c0bf050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:03.395 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:03.393+0000 7f23140ec640 1 -- 172.21.15.73:0/60626536 >> 172.21.15.73:0/60626536 conn(0x7f230c0a8130 msgr2=0x7f230c0a5bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:46:03.395 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:03.393+0000 7f23140ec640 1 -- 172.21.15.73:0/60626536 shutdown_connections 2023-12-12T09:46:03.395 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:03.393+0000 7f23140ec640 1 -- 172.21.15.73:0/60626536 wait complete. 2023-12-12T09:46:03.413 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-12-12T09:46:03.413 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-12T09:46:03.622 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:03.621+0000 7faa397b0640 1 Processor -- start 2023-12-12T09:46:03.623 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:03.621+0000 7faa397b0640 1 -- start start 2023-12-12T09:46:03.624 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:03.623+0000 7faa397b0640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7faa3406db70 0x7faa340c39b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:03.624 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:03.623+0000 7faa397b0640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7faa340c5070 0x7faa340c3ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:03.625 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:03.623+0000 7faa397b0640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa34152610 con 0x7faa3414fa40 2023-12-12T09:46:03.625 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:03.623+0000 7faa397b0640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa341528f0 con 0x7faa340c5070 2023-12-12T09:46:03.625 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:03.623+0000 7faa397b0640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa34152bd0 con 0x7faa3406db70 2023-12-12T09:46:03.625 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:03.623+0000 7faa337fe640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7faa340c5070 0x7faa340c3ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:03.625 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:03.623+0000 7faa32ffd640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7faa3414fa40 0x7faa3406a4e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:55774/0 (socket says 172.21.15.73:55774) 2023-12-12T09:46:03.625 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:03.623+0000 7faa32ffd640 1 -- 172.21.15.73:0/1018777945 learned_addr learned my addr 172.21.15.73:0/1018777945 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-12T09:46:03.625 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:03.623+0000 7faa327fc640 1 --2- 172.21.15.73:0/1018777945 >> v2:172.21.15.142:3300/0 conn(0x7faa3406db70 0x7faa340c39b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:03.625 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:03.624+0000 7faa337fe640 1 -- 172.21.15.73:0/1018777945 >> v2:172.21.15.142:3300/0 conn(0x7faa3406db70 msgr2=0x7faa340c39b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:46:03.626 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:03.624+0000 7faa337fe640 1 --2- 172.21.15.73:0/1018777945 >> v2:172.21.15.142:3300/0 conn(0x7faa3406db70 0x7faa340c39b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:03.626 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:03.624+0000 7faa337fe640 1 -- 172.21.15.73:0/1018777945 >> v1:172.21.15.73:6789/0 conn(0x7faa3414fa40 legacy=0x7faa3406a4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:03.626 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:03.624+0000 7faa337fe640 1 -- 172.21.15.73:0/1018777945 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa34152eb0 con 0x7faa340c5070 2023-12-12T09:46:03.626 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:03.624+0000 7faa31ffb640 1 -- 172.21.15.73:0/1018777945 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 426218832 0 0) 0x7faa34152610 con 0x7faa3414fa40 2023-12-12T09:46:03.626 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:03.624+0000 7faa327fc640 1 --2- 172.21.15.73:0/1018777945 >> v2:172.21.15.142:3300/0 conn(0x7faa3406db70 0x7faa340c39b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-12T09:46:03.627 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:03.625+0000 7faa337fe640 1 --2- 172.21.15.73:0/1018777945 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7faa340c5070 0x7faa340c3ef0 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7faa340aaf60 tx=0x7faa2c02bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3120fdd995706310 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:46:03.627 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:03.625+0000 7faa31ffb640 1 -- 172.21.15.73:0/1018777945 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa2c02cc80 con 0x7faa340c5070 2023-12-12T09:46:03.627 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:03.625+0000 7faa31ffb640 1 -- 172.21.15.73:0/1018777945 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa2c02cde0 con 0x7faa340c5070 2023-12-12T09:46:03.627 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:03.625+0000 7faa31ffb640 1 -- 172.21.15.73:0/1018777945 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa2c034660 con 0x7faa340c5070 2023-12-12T09:46:03.627 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:03.626+0000 7faa397b0640 1 -- 172.21.15.73:0/1018777945 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7faa340c5070 msgr2=0x7faa340c3ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:03.628 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:03.626+0000 7faa397b0640 1 --2- 172.21.15.73:0/1018777945 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7faa340c5070 0x7faa340c3ef0 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7faa340aaf60 tx=0x7faa2c02bed0 comp rx=0 tx=0).stop 2023-12-12T09:46:03.628 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:03.626+0000 7faa397b0640 1 -- 172.21.15.73:0/1018777945 shutdown_connections 2023-12-12T09:46:03.628 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:03.626+0000 7faa397b0640 1 --2- 172.21.15.73:0/1018777945 >> v2:172.21.15.142:3300/0 conn(0x7faa3406db70 0x7faa340c39b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:03.628 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:03.626+0000 7faa397b0640 1 --2- 172.21.15.73:0/1018777945 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7faa340c5070 0x7faa340c3ef0 unknown :-1 s=CLOSED pgs=768 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:03.628 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:03.626+0000 7faa397b0640 1 -- 172.21.15.73:0/1018777945 >> 172.21.15.73:0/1018777945 conn(0x7faa340a8130 msgr2=0x7faa340c24b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:46:03.628 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:03.626+0000 7faa397b0640 1 -- 172.21.15.73:0/1018777945 shutdown_connections 2023-12-12T09:46:03.628 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:03.626+0000 7faa397b0640 1 -- 172.21.15.73:0/1018777945 wait complete. 2023-12-12T09:46:03.629 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:03.628+0000 7faa397b0640 1 Processor -- start 2023-12-12T09:46:03.629 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:03.628+0000 7faa397b0640 1 -- start start 2023-12-12T09:46:03.630 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:03.629+0000 7faa397b0640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7faa3406db70 0x7faa3414a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:03.630 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:03.629+0000 7faa397b0640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7faa340c5070 0x7faa3414bf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:03.631 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:03.629+0000 7faa397b0640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7faa3414fa40 0x7faa341ed190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:03.631 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:03.629+0000 7faa397b0640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa341e9c20 con 0x7faa340c5070 2023-12-12T09:46:03.631 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:03.629+0000 7faa397b0640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa341eabf0 con 0x7faa3406db70 2023-12-12T09:46:03.631 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:03.629+0000 7faa397b0640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa341568e0 con 0x7faa3414fa40 2023-12-12T09:46:03.631 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:03.629+0000 7faa327fc640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7faa340c5070 0x7faa3414bf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:03.631 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:03.629+0000 7faa327fc640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7faa340c5070 0x7faa3414bf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:44660/0 (socket says 172.21.15.73:44660) 2023-12-12T09:46:03.631 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:03.629+0000 7faa327fc640 1 -- 172.21.15.73:0/1762795502 learned_addr learned my addr 172.21.15.73:0/1762795502 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:46:03.632 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:03.630+0000 7faa32ffd640 1 --2- 172.21.15.73:0/1762795502 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7faa3406db70 0x7faa3414a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:03.632 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:03.630+0000 7faa337fe640 1 --2- 172.21.15.73:0/1762795502 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7faa3414fa40 0x7faa341ed190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:03.633 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:03.630+0000 7faa327fc640 1 -- 172.21.15.73:0/1762795502 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7faa3414fa40 msgr2=0x7faa341ed190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:03.633 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:03.630+0000 7faa327fc640 1 --2- 172.21.15.73:0/1762795502 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7faa3414fa40 0x7faa341ed190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:03.633 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:03.630+0000 7faa327fc640 1 -- 172.21.15.73:0/1762795502 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7faa3406db70 msgr2=0x7faa3414a430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:03.633 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:03.630+0000 7faa327fc640 1 --2- 172.21.15.73:0/1762795502 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7faa3406db70 0x7faa3414a430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:03.633 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:03.630+0000 7faa327fc640 1 -- 172.21.15.73:0/1762795502 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa2c009a70 con 0x7faa340c5070 2023-12-12T09:46:03.633 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:03.630+0000 7faa32ffd640 1 --2- 172.21.15.73:0/1762795502 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7faa3406db70 0x7faa3414a430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:46:03.633 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:03.630+0000 7faa327fc640 1 --2- 172.21.15.73:0/1762795502 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7faa340c5070 0x7faa3414bf50 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7faa2800d800 tx=0x7faa2800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:46:03.633 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:03.630+0000 7faa1b7fe640 1 -- 172.21.15.73:0/1762795502 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa28004030 con 0x7faa340c5070 2023-12-12T09:46:03.633 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:03.630+0000 7faa1b7fe640 1 -- 172.21.15.73:0/1762795502 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa28004190 con 0x7faa340c5070 2023-12-12T09:46:03.633 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:03.630+0000 7faa397b0640 1 -- 172.21.15.73:0/1762795502 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa341ea760 con 0x7faa340c5070 2023-12-12T09:46:03.633 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:03.630+0000 7faa1b7fe640 1 -- 172.21.15.73:0/1762795502 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa28004520 con 0x7faa340c5070 2023-12-12T09:46:03.633 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:03.630+0000 7faa397b0640 1 -- 172.21.15.73:0/1762795502 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa341ea110 con 0x7faa340c5070 2023-12-12T09:46:03.634 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:03.632+0000 7faa397b0640 1 -- 172.21.15.73:0/1762795502 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa340c13b0 con 0x7faa340c5070 2023-12-12T09:46:03.634 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:03.632+0000 7faa1b7fe640 1 -- 172.21.15.73:0/1762795502 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7faa2800b660 con 0x7faa340c5070 2023-12-12T09:46:03.634 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:03.633+0000 7faa1b7fe640 1 --2- 172.21.15.73:0/1762795502 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7faa2006ae40 0x7faa2006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:03.635 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:03.633+0000 7faa1b7fe640 1 -- 172.21.15.73:0/1762795502 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 6565+0+0 (secure 0 0 0) 0x7faa28089a00 con 0x7faa340c5070 2023-12-12T09:46:03.635 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:03.634+0000 7faa32ffd640 1 --2- 172.21.15.73:0/1762795502 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7faa2006ae40 0x7faa2006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:03.635 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:03.634+0000 7faa32ffd640 1 --2- 172.21.15.73:0/1762795502 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7faa2006ae40 0x7faa2006d300 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7faa24000f60 tx=0x7faa24009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:46:03.639 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:03.638+0000 7faa1b7fe640 1 -- 172.21.15.73:0/1762795502 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7faa280547e0 con 0x7faa340c5070 2023-12-12T09:46:03.868 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:03.867+0000 7faa397b0640 1 -- 172.21.15.73:0/1762795502 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7faa34067560 con 0x7faa340c5070 2023-12-12T09:46:03.869 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:03.868+0000 7faa1b7fe640 1 -- 172.21.15.73:0/1762795502 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 35 v35) v1 ==== 94+0+6135 (secure 0 0 0) 0x7faa28057e00 con 0x7faa340c5070 2023-12-12T09:46:03.870 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-12T09:46:03.870 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":35,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4736,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6834/2964437845","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6832","nonce":2964437845},{"type":"v1","addr":"172.21.15.142:6834","nonce":2964437845}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":25},{"gid":5044,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6837/3698725764","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6836","nonce":3698725764},{"type":"v1","addr":"172.21.15.73:6837","nonce":3698725764}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":25}],"filesystems":[{"mdsmap":{"epoch":30,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-12T09:45:22.971300+0000","modified":"2023-12-12T09:45:26.028731+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5703},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5703":{"gid":5703,"name":"a","rank":0,"incarnation":26,"state":"up:active","state_seq":3,"addr":"172.21.15.73:6835/744058726","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":744058726},{"type":"v1","addr":"172.21.15.73:6835","nonce":744058726}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4},{"mdsmap":{"epoch":35,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-12T09:45:38.103609+0000","modified":"2023-12-12T09:45:41.148650+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5059},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5059":{"gid":5059,"name":"d","rank":0,"incarnation":31,"state":"up:active","state_seq":7,"addr":"172.21.15.142:6835/2931058847","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6833","nonce":2931058847},{"type":"v1","addr":"172.21.15.142:6835","nonce":2931058847}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2023-12-12T09:46:03.870 INFO:teuthology.orchestra.run.smithi073.stderr:dumped fsmap epoch 35 2023-12-12T09:46:03.873 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:03.871+0000 7faa397b0640 1 -- 172.21.15.73:0/1762795502 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7faa2006ae40 msgr2=0x7faa2006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:03.873 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:03.871+0000 7faa397b0640 1 --2- 172.21.15.73:0/1762795502 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7faa2006ae40 0x7faa2006d300 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7faa24000f60 tx=0x7faa24009040 comp rx=0 tx=0).stop 2023-12-12T09:46:03.873 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:03.871+0000 7faa397b0640 1 -- 172.21.15.73:0/1762795502 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7faa340c5070 msgr2=0x7faa3414bf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:03.873 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:03.871+0000 7faa397b0640 1 --2- 172.21.15.73:0/1762795502 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7faa340c5070 0x7faa3414bf50 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7faa2800d800 tx=0x7faa2800dcc0 comp rx=0 tx=0).stop 2023-12-12T09:46:03.873 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:03.871+0000 7faa397b0640 1 -- 172.21.15.73:0/1762795502 shutdown_connections 2023-12-12T09:46:03.873 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:03.871+0000 7faa397b0640 1 --2- 172.21.15.73:0/1762795502 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7faa2006ae40 0x7faa2006d300 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:03.873 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:03.871+0000 7faa397b0640 1 --2- 172.21.15.73:0/1762795502 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7faa3414fa40 0x7faa341ed190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:03.873 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:03.871+0000 7faa397b0640 1 --2- 172.21.15.73:0/1762795502 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7faa340c5070 0x7faa3414bf50 unknown :-1 s=CLOSED pgs=769 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:03.873 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:03.871+0000 7faa397b0640 1 --2- 172.21.15.73:0/1762795502 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7faa3406db70 0x7faa3414a430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:03.873 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:03.871+0000 7faa397b0640 1 -- 172.21.15.73:0/1762795502 >> 172.21.15.73:0/1762795502 conn(0x7faa340a8130 msgr2=0x7faa340c2440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:46:03.873 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:03.871+0000 7faa397b0640 1 -- 172.21.15.73:0/1762795502 shutdown_connections 2023-12-12T09:46:03.873 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:03.871+0000 7faa397b0640 1 -- 172.21.15.73:0/1762795502 wait complete. 2023-12-12T09:46:03.891 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-12T09:46:04.093 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:04.091+0000 7fd9f9901640 1 Processor -- start 2023-12-12T09:46:04.093 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:04.092+0000 7fd9f9901640 1 -- start start 2023-12-12T09:46:04.095 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:04.093+0000 7fd9f9901640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fd9f406db70 0x7fd9f40c39b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:04.095 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:04.093+0000 7fd9f9901640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd9f40c5070 0x7fd9f40c3ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:04.095 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:04.093+0000 7fd9f9901640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9f4152610 con 0x7fd9f414fa40 2023-12-12T09:46:04.095 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:04.093+0000 7fd9f9901640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9f41528f0 con 0x7fd9f406db70 2023-12-12T09:46:04.095 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:04.093+0000 7fd9f9901640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9f4152bd0 con 0x7fd9f40c5070 2023-12-12T09:46:04.095 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:04.093+0000 7fd9ea7fc640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fd9f406db70 0x7fd9f40c39b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:04.095 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:04.093+0000 7fd9ea7fc640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fd9f406db70 0x7fd9f40c39b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:44664/0 (socket says 172.21.15.73:44664) 2023-12-12T09:46:04.095 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:04.093+0000 7fd9ea7fc640 1 -- 172.21.15.73:0/948837432 learned_addr learned my addr 172.21.15.73:0/948837432 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:46:04.095 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:04.094+0000 7fd9f37fe640 1 --2- 172.21.15.73:0/948837432 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd9f40c5070 0x7fd9f40c3ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:04.096 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:04.094+0000 7fd9ea7fc640 1 -- 172.21.15.73:0/948837432 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd9f40c5070 msgr2=0x7fd9f40c3ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:46:04.096 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:04.094+0000 7fd9ea7fc640 1 --2- 172.21.15.73:0/948837432 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd9f40c5070 0x7fd9f40c3ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:04.096 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:04.094+0000 7fd9ea7fc640 1 -- 172.21.15.73:0/948837432 >> v1:172.21.15.142:6789/0 conn(0x7fd9f414fa40 legacy=0x7fd9f406a4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:46:04.096 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:04.094+0000 7fd9ea7fc640 1 -- 172.21.15.73:0/948837432 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9f4152eb0 con 0x7fd9f406db70 2023-12-12T09:46:04.096 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:04.095+0000 7fd9ea7fc640 1 --2- 172.21.15.73:0/948837432 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd9f406db70 0x7fd9f40c39b0 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7fd9dc009870 tx=0x7fd9dc02b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3c7950e78fa36e1 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:46:04.097 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:04.095+0000 7fd9f27fc640 1 -- 172.21.15.73:0/948837432 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9dc031640 con 0x7fd9f406db70 2023-12-12T09:46:04.097 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:04.095+0000 7fd9f27fc640 1 -- 172.21.15.73:0/948837432 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9dc0317a0 con 0x7fd9f406db70 2023-12-12T09:46:04.097 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:04.095+0000 7fd9f27fc640 1 -- 172.21.15.73:0/948837432 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9dc031b30 con 0x7fd9f406db70 2023-12-12T09:46:04.097 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:04.096+0000 7fd9f9901640 1 -- 172.21.15.73:0/948837432 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd9f406db70 msgr2=0x7fd9f40c39b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:04.098 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:04.096+0000 7fd9f9901640 1 --2- 172.21.15.73:0/948837432 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd9f406db70 0x7fd9f40c39b0 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7fd9dc009870 tx=0x7fd9dc02b8f0 comp rx=0 tx=0).stop 2023-12-12T09:46:04.098 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:04.096+0000 7fd9f9901640 1 -- 172.21.15.73:0/948837432 shutdown_connections 2023-12-12T09:46:04.098 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:04.096+0000 7fd9f9901640 1 --2- 172.21.15.73:0/948837432 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd9f40c5070 0x7fd9f40c3ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:04.098 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:04.096+0000 7fd9f9901640 1 --2- 172.21.15.73:0/948837432 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd9f406db70 0x7fd9f40c39b0 unknown :-1 s=CLOSED pgs=770 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:04.098 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:04.096+0000 7fd9f9901640 1 -- 172.21.15.73:0/948837432 >> 172.21.15.73:0/948837432 conn(0x7fd9f40a8130 msgr2=0x7fd9f40c24b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:46:04.098 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:04.096+0000 7fd9f9901640 1 -- 172.21.15.73:0/948837432 shutdown_connections 2023-12-12T09:46:04.098 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:04.096+0000 7fd9f9901640 1 -- 172.21.15.73:0/948837432 wait complete. 2023-12-12T09:46:04.099 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:04.098+0000 7fd9f9901640 1 Processor -- start 2023-12-12T09:46:04.099 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:04.098+0000 7fd9f9901640 1 -- start start 2023-12-12T09:46:04.101 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:04.099+0000 7fd9f9901640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd9f406db70 0x7fd9f4148110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:04.101 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:04.099+0000 7fd9f9901640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd9f40c5070 0x7fd9f40bf050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:04.101 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:04.099+0000 7fd9f9901640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd9f414fa40 0x7fd9f4147090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:04.101 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:04.099+0000 7fd9f9901640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9f40aa480 con 0x7fd9f40c5070 2023-12-12T09:46:04.101 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:04.099+0000 7fd9f9901640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9f414c3c0 con 0x7fd9f414fa40 2023-12-12T09:46:04.101 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:04.099+0000 7fd9f9901640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9f40a9cc0 con 0x7fd9f406db70 2023-12-12T09:46:04.101 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:04.099+0000 7fd9ea7fc640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd9f40c5070 0x7fd9f40bf050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:04.101 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:04.099+0000 7fd9ea7fc640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd9f40c5070 0x7fd9f40bf050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:44670/0 (socket says 172.21.15.73:44670) 2023-12-12T09:46:04.101 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:04.099+0000 7fd9ea7fc640 1 -- 172.21.15.73:0/1299210073 learned_addr learned my addr 172.21.15.73:0/1299210073 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:46:04.102 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:04.099+0000 7fd9ea7fc640 1 -- 172.21.15.73:0/1299210073 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd9f406db70 msgr2=0x7fd9f4148110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:04.102 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:04.099+0000 7fd9ea7fc640 1 --2- 172.21.15.73:0/1299210073 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd9f406db70 0x7fd9f4148110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:04.102 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:04.099+0000 7fd9ea7fc640 1 -- 172.21.15.73:0/1299210073 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd9f414fa40 msgr2=0x7fd9f4147090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:04.102 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:04.099+0000 7fd9ea7fc640 1 --2- 172.21.15.73:0/1299210073 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd9f414fa40 0x7fd9f4147090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:04.102 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:04.099+0000 7fd9ea7fc640 1 -- 172.21.15.73:0/1299210073 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9dc0094d0 con 0x7fd9f40c5070 2023-12-12T09:46:04.103 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:04.100+0000 7fd9ea7fc640 1 --2- 172.21.15.73:0/1299210073 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd9f40c5070 0x7fd9f40bf050 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7fd9dc009870 tx=0x7fd9dc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:46:04.103 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:04.100+0000 7fd9f0ff9640 1 -- 172.21.15.73:0/1299210073 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9dc03ac60 con 0x7fd9f40c5070 2023-12-12T09:46:04.104 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:04.100+0000 7fd9f0ff9640 1 -- 172.21.15.73:0/1299210073 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9dc03adc0 con 0x7fd9f40c5070 2023-12-12T09:46:04.104 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:04.100+0000 7fd9f9901640 1 -- 172.21.15.73:0/1299210073 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9f41ede20 con 0x7fd9f40c5070 2023-12-12T09:46:04.104 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:04.100+0000 7fd9f0ff9640 1 -- 172.21.15.73:0/1299210073 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9dc044630 con 0x7fd9f40c5070 2023-12-12T09:46:04.104 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:04.100+0000 7fd9f9901640 1 -- 172.21.15.73:0/1299210073 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9f41ee100 con 0x7fd9f40c5070 2023-12-12T09:46:04.104 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:04.101+0000 7fd9f9901640 1 -- 172.21.15.73:0/1299210073 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd9f40aa1a0 con 0x7fd9f40c5070 2023-12-12T09:46:04.104 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:04.102+0000 7fd9f0ff9640 1 -- 172.21.15.73:0/1299210073 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fd9dc02f050 con 0x7fd9f40c5070 2023-12-12T09:46:04.105 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:04.103+0000 7fd9f0ff9640 1 --2- 172.21.15.73:0/1299210073 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fd9d406ae70 0x7fd9d406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:04.105 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:04.103+0000 7fd9f0ff9640 1 -- 172.21.15.73:0/1299210073 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fd9dc0ab7f0 con 0x7fd9f40c5070 2023-12-12T09:46:04.105 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:04.103+0000 7fd9f2ffd640 1 --2- 172.21.15.73:0/1299210073 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fd9d406ae70 0x7fd9d406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:04.105 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:04.104+0000 7fd9f2ffd640 1 --2- 172.21.15.73:0/1299210073 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fd9d406ae70 0x7fd9d406d330 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fd9e40043c0 tx=0x7fd9e4007d30 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:46:04.109 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:04.108+0000 7fd9f0ff9640 1 -- 172.21.15.73:0/1299210073 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fd9f40aa1a0 con 0x7fd9f40c5070 2023-12-12T09:46:04.338 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:04.336+0000 7fd9f9901640 1 -- 172.21.15.73:0/1299210073 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd9f40aa1a0 con 0x7fd9f40c5070 2023-12-12T09:46:04.339 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:04.338+0000 7fd9f0ff9640 1 -- 172.21.15.73:0/1299210073 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 35 v35) v1 ==== 94+0+6135 (secure 0 0 0) 0x7fd9f40aa1a0 con 0x7fd9f40c5070 2023-12-12T09:46:04.339 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-12T09:46:04.340 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":35,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4736,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6834/2964437845","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6832","nonce":2964437845},{"type":"v1","addr":"172.21.15.142:6834","nonce":2964437845}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":25},{"gid":5044,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6837/3698725764","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6836","nonce":3698725764},{"type":"v1","addr":"172.21.15.73:6837","nonce":3698725764}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":25}],"filesystems":[{"mdsmap":{"epoch":30,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-12T09:45:22.971300+0000","modified":"2023-12-12T09:45:26.028731+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5703},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5703":{"gid":5703,"name":"a","rank":0,"incarnation":26,"state":"up:active","state_seq":3,"addr":"172.21.15.73:6835/744058726","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":744058726},{"type":"v1","addr":"172.21.15.73:6835","nonce":744058726}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4},{"mdsmap":{"epoch":35,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-12T09:45:38.103609+0000","modified":"2023-12-12T09:45:41.148650+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5059},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5059":{"gid":5059,"name":"d","rank":0,"incarnation":31,"state":"up:active","state_seq":7,"addr":"172.21.15.142:6835/2931058847","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6833","nonce":2931058847},{"type":"v1","addr":"172.21.15.142:6835","nonce":2931058847}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2023-12-12T09:46:04.340 INFO:teuthology.orchestra.run.smithi073.stderr:dumped fsmap epoch 35 2023-12-12T09:46:04.342 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:04.340+0000 7fd9f9901640 1 -- 172.21.15.73:0/1299210073 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fd9d406ae70 msgr2=0x7fd9d406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:04.342 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:04.340+0000 7fd9f9901640 1 --2- 172.21.15.73:0/1299210073 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fd9d406ae70 0x7fd9d406d330 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fd9e40043c0 tx=0x7fd9e4007d30 comp rx=0 tx=0).stop 2023-12-12T09:46:04.342 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:04.340+0000 7fd9f9901640 1 -- 172.21.15.73:0/1299210073 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd9f40c5070 msgr2=0x7fd9f40bf050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:04.342 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:04.340+0000 7fd9f9901640 1 --2- 172.21.15.73:0/1299210073 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd9f40c5070 0x7fd9f40bf050 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7fd9dc009870 tx=0x7fd9dc0046c0 comp rx=0 tx=0).stop 2023-12-12T09:46:04.343 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:04.341+0000 7fd9f9901640 1 -- 172.21.15.73:0/1299210073 shutdown_connections 2023-12-12T09:46:04.343 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:04.341+0000 7fd9f9901640 1 --2- 172.21.15.73:0/1299210073 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fd9d406ae70 0x7fd9d406d330 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:04.343 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:04.341+0000 7fd9f9901640 1 --2- 172.21.15.73:0/1299210073 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd9f414fa40 0x7fd9f4147090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:04.343 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:04.341+0000 7fd9f9901640 1 --2- 172.21.15.73:0/1299210073 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd9f40c5070 0x7fd9f40bf050 unknown :-1 s=CLOSED pgs=771 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:04.343 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:04.341+0000 7fd9f9901640 1 --2- 172.21.15.73:0/1299210073 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd9f406db70 0x7fd9f4148110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:04.343 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:04.341+0000 7fd9f9901640 1 -- 172.21.15.73:0/1299210073 >> 172.21.15.73:0/1299210073 conn(0x7fd9f40a8130 msgr2=0x7fd9f40c2440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:46:04.343 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:04.341+0000 7fd9f9901640 1 -- 172.21.15.73:0/1299210073 shutdown_connections 2023-12-12T09:46:04.343 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:04.341+0000 7fd9f9901640 1 -- 172.21.15.73:0/1299210073 wait complete. 2023-12-12T09:46:04.360 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-12T09:46:04.576 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:04.575+0000 7fb957a1e640 1 Processor -- start 2023-12-12T09:46:04.577 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:04.575+0000 7fb957a1e640 1 -- start start 2023-12-12T09:46:04.578 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:04.576+0000 7fb957a1e640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fb95014fa40 0x7fb95006a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:04.578 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:04.576+0000 7fb957a1e640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb95006db70 0x7fb9500c39b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:04.578 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:04.576+0000 7fb957a1e640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb950152610 con 0x7fb9500c5070 2023-12-12T09:46:04.578 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:04.577+0000 7fb957a1e640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9501528f0 con 0x7fb95014fa40 2023-12-12T09:46:04.578 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:04.577+0000 7fb957a1e640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb950152bd0 con 0x7fb95006db70 2023-12-12T09:46:04.580 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:04.577+0000 7fb954fb9640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb95006db70 0x7fb9500c39b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:04.580 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:04.577+0000 7fb9557ba640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fb95014fa40 0x7fb95006a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:04.580 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:04.577+0000 7fb9557ba640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fb95014fa40 0x7fb95006a4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.73:45856/0 (socket says 172.21.15.73:45856) 2023-12-12T09:46:04.580 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:04.577+0000 7fb9557ba640 1 -- 172.21.15.73:0/1194811934 learned_addr learned my addr 172.21.15.73:0/1194811934 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:46:04.580 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:04.578+0000 7fb9557ba640 1 -- 172.21.15.73:0/1194811934 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb95006db70 msgr2=0x7fb9500c39b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:46:04.581 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:04.578+0000 7fb9557ba640 1 --2- 172.21.15.73:0/1194811934 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb95006db70 0x7fb9500c39b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:04.581 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:04.578+0000 7fb9557ba640 1 -- 172.21.15.73:0/1194811934 >> v1:172.21.15.142:6789/0 conn(0x7fb9500c5070 legacy=0x7fb9500c3ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:04.581 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:04.578+0000 7fb9557ba640 1 -- 172.21.15.73:0/1194811934 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb950152eb0 con 0x7fb95014fa40 2023-12-12T09:46:04.581 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:04.580+0000 7fb9557ba640 1 --2- 172.21.15.73:0/1194811934 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb95014fa40 0x7fb95006a4e0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fb94c009870 tx=0x7fb94c02b980 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9c93c58b60cfe8fa server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:46:04.582 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:04.580+0000 7fb947fff640 1 -- 172.21.15.73:0/1194811934 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb94c030840 con 0x7fb95014fa40 2023-12-12T09:46:04.582 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:04.581+0000 7fb947fff640 1 -- 172.21.15.73:0/1194811934 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb94c0309a0 con 0x7fb95014fa40 2023-12-12T09:46:04.582 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:04.581+0000 7fb947fff640 1 -- 172.21.15.73:0/1194811934 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb94c030d30 con 0x7fb95014fa40 2023-12-12T09:46:04.583 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:04.581+0000 7fb957a1e640 1 -- 172.21.15.73:0/1194811934 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb95014fa40 msgr2=0x7fb95006a4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:04.583 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:04.581+0000 7fb957a1e640 1 --2- 172.21.15.73:0/1194811934 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb95014fa40 0x7fb95006a4e0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fb94c009870 tx=0x7fb94c02b980 comp rx=0 tx=0).stop 2023-12-12T09:46:04.583 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:04.581+0000 7fb957a1e640 1 -- 172.21.15.73:0/1194811934 shutdown_connections 2023-12-12T09:46:04.583 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:04.581+0000 7fb957a1e640 1 --2- 172.21.15.73:0/1194811934 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb95006db70 0x7fb9500c39b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:04.583 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:04.581+0000 7fb957a1e640 1 --2- 172.21.15.73:0/1194811934 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb95014fa40 0x7fb95006a4e0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:04.583 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:04.581+0000 7fb957a1e640 1 -- 172.21.15.73:0/1194811934 >> 172.21.15.73:0/1194811934 conn(0x7fb9500a8130 msgr2=0x7fb9500c24b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:46:04.583 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:04.582+0000 7fb957a1e640 1 -- 172.21.15.73:0/1194811934 shutdown_connections 2023-12-12T09:46:04.583 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:04.582+0000 7fb957a1e640 1 -- 172.21.15.73:0/1194811934 wait complete. 2023-12-12T09:46:04.585 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:04.584+0000 7fb957a1e640 1 Processor -- start 2023-12-12T09:46:04.585 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:04.584+0000 7fb957a1e640 1 -- start start 2023-12-12T09:46:04.588 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:04.585+0000 7fb957a1e640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb95006db70 0x7fb9500a9ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:04.588 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:04.585+0000 7fb957a1e640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb9500c5070 0x7fb9500bf050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:04.588 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:04.585+0000 7fb957a1e640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb95014fa40 0x7fb9501ed240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:04.588 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:04.585+0000 7fb957a1e640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9500aa970 con 0x7fb9500c5070 2023-12-12T09:46:04.588 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:04.585+0000 7fb957a1e640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9500aa410 con 0x7fb95006db70 2023-12-12T09:46:04.588 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:04.585+0000 7fb957a1e640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9500aa690 con 0x7fb95014fa40 2023-12-12T09:46:04.588 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:04.585+0000 7fb954fb9640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb9500c5070 0x7fb9500bf050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:04.588 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:04.585+0000 7fb954fb9640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb9500c5070 0x7fb9500bf050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:44676/0 (socket says 172.21.15.73:44676) 2023-12-12T09:46:04.588 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:04.585+0000 7fb954fb9640 1 -- 172.21.15.73:0/1710443999 learned_addr learned my addr 172.21.15.73:0/1710443999 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:46:04.588 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:04.586+0000 7fb9557ba640 1 --2- 172.21.15.73:0/1710443999 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb95006db70 0x7fb9500a9ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:04.589 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:04.586+0000 7fb955fbb640 1 --2- 172.21.15.73:0/1710443999 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb95014fa40 0x7fb9501ed240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:04.589 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:04.586+0000 7fb954fb9640 1 -- 172.21.15.73:0/1710443999 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb95014fa40 msgr2=0x7fb9501ed240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:04.589 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:04.586+0000 7fb954fb9640 1 --2- 172.21.15.73:0/1710443999 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb95014fa40 0x7fb9501ed240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:04.589 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:04.586+0000 7fb954fb9640 1 -- 172.21.15.73:0/1710443999 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb95006db70 msgr2=0x7fb9500a9ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:04.589 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:04.586+0000 7fb954fb9640 1 --2- 172.21.15.73:0/1710443999 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb95006db70 0x7fb9500a9ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:04.589 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:04.586+0000 7fb954fb9640 1 -- 172.21.15.73:0/1710443999 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb94c0094d0 con 0x7fb9500c5070 2023-12-12T09:46:04.589 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:04.586+0000 7fb9557ba640 1 --2- 172.21.15.73:0/1710443999 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb95006db70 0x7fb9500a9ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:46:04.589 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:04.586+0000 7fb955fbb640 1 --2- 172.21.15.73:0/1710443999 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb95014fa40 0x7fb9501ed240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:46:04.589 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:04.586+0000 7fb954fb9640 1 --2- 172.21.15.73:0/1710443999 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb9500c5070 0x7fb9500bf050 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7fb94000e870 tx=0x7fb94000ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:46:04.589 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:04.586+0000 7fb945ffb640 1 -- 172.21.15.73:0/1710443999 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9400094f0 con 0x7fb9500c5070 2023-12-12T09:46:04.589 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:04.586+0000 7fb945ffb640 1 -- 172.21.15.73:0/1710443999 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb94000c940 con 0x7fb9500c5070 2023-12-12T09:46:04.589 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:04.586+0000 7fb945ffb640 1 -- 172.21.15.73:0/1710443999 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb94000ccd0 con 0x7fb9500c5070 2023-12-12T09:46:04.589 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:04.586+0000 7fb957a1e640 1 -- 172.21.15.73:0/1710443999 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9501deab0 con 0x7fb9500c5070 2023-12-12T09:46:04.589 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:04.586+0000 7fb957a1e640 1 -- 172.21.15.73:0/1710443999 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9501df070 con 0x7fb9500c5070 2023-12-12T09:46:04.590 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:04.588+0000 7fb957a1e640 1 -- 172.21.15.73:0/1710443999 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb950067580 con 0x7fb9500c5070 2023-12-12T09:46:04.590 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:04.588+0000 7fb945ffb640 1 -- 172.21.15.73:0/1710443999 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fb940013470 con 0x7fb9500c5070 2023-12-12T09:46:04.591 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:04.590+0000 7fb945ffb640 1 --2- 172.21.15.73:0/1710443999 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fb93406ae40 0x7fb93406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:04.591 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:04.590+0000 7fb945ffb640 1 -- 172.21.15.73:0/1710443999 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fb940089b00 con 0x7fb9500c5070 2023-12-12T09:46:04.591 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:04.590+0000 7fb9557ba640 1 --2- 172.21.15.73:0/1710443999 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fb93406ae40 0x7fb93406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:04.592 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:04.591+0000 7fb9557ba640 1 --2- 172.21.15.73:0/1710443999 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fb93406ae40 0x7fb93406d300 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fb94c036000 tx=0x7fb94c03b040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:46:04.595 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:04.594+0000 7fb945ffb640 1 -- 172.21.15.73:0/1710443999 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fb9400547c0 con 0x7fb9500c5070 2023-12-12T09:46:04.788 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:04.786+0000 7fb957a1e640 1 -- 172.21.15.73:0/1710443999 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb9500c1e50 con 0x7fb9500c5070 2023-12-12T09:46:04.792 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:04.790+0000 7fb945ffb640 1 -- 172.21.15.73:0/1710443999 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v58) v1 ==== 74+0+20292 (secure 0 0 0) 0x7fb940021020 con 0x7fb9500c5070 2023-12-12T09:46:04.792 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-12T09:46:04.792 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":58,"fsid":"ba240992-02b8-4c7e-92f2-27eb29ac433b","created":"2023-12-12T09:43:02.454719+0000","modified":"2023-12-12T09:45:39.273967+0000","last_up_change":"2023-12-12T09:43:13.913440+0000","last_in_change":"2023-12-12T09:43:05.925348+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-12T09:43:15.525508+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-12-12T09:45:21.264815+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"53","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-12-12T09:45:21.981834+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"54","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs2_metadata","create_time":"2023-12-12T09:45:36.388393+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"57","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs2_data","create_time":"2023-12-12T09:45:37.109653+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"58","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"dd9074be-dbe2-4c34-9896-a4223d8d3940","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":4047810203},{"type":"v1","addr":"172.21.15.73:6801","nonce":4047810203}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":4047810203},{"type":"v1","addr":"172.21.15.73:6803","nonce":4047810203}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":4047810203},{"type":"v1","addr":"172.21.15.73:6807","nonce":4047810203}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":4047810203},{"type":"v1","addr":"172.21.15.73:6805","nonce":4047810203}]},"public_addr":"172.21.15.73:6801/4047810203","cluster_addr":"172.21.15.73:6803/4047810203","heartbeat_back_addr":"172.21.15.73:6807/4047810203","heartbeat_front_addr":"172.21.15.73:6805/4047810203","state":["exists","up"]},{"osd":1,"uuid":"c4a05052-96d4-4758-a4e1-1a37f1e07fed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":1356058331},{"type":"v1","addr":"172.21.15.73:6824","nonce":1356058331}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":1356058331},{"type":"v1","addr":"172.21.15.73:6827","nonce":1356058331}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":1356058331},{"type":"v1","addr":"172.21.15.73:6831","nonce":1356058331}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":1356058331},{"type":"v1","addr":"172.21.15.73:6829","nonce":1356058331}]},"public_addr":"172.21.15.73:6824/1356058331","cluster_addr":"172.21.15.73:6827/1356058331","heartbeat_back_addr":"172.21.15.73:6831/1356058331","heartbeat_front_addr":"172.21.15.73:6829/1356058331","state":["exists","up"]},{"osd":2,"uuid":"512bc8ac-72c2-40d4-b3d2-d867a92c5213","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":1228903316},{"type":"v1","addr":"172.21.15.73:6817","nonce":1228903316}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":1228903316},{"type":"v1","addr":"172.21.15.73:6819","nonce":1228903316}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6823","nonce":1228903316},{"type":"v1","addr":"172.21.15.73:6825","nonce":1228903316}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":1228903316},{"type":"v1","addr":"172.21.15.73:6821","nonce":1228903316}]},"public_addr":"172.21.15.73:6817/1228903316","cluster_addr":"172.21.15.73:6819/1228903316","heartbeat_back_addr":"172.21.15.73:6825/1228903316","heartbeat_front_addr":"172.21.15.73:6821/1228903316","state":["exists","up"]},{"osd":3,"uuid":"3d1a91e0-42bf-437a-8eae-8d357c8f63a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":1293329670},{"type":"v1","addr":"172.21.15.73:6809","nonce":1293329670}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6810","nonce":1293329670},{"type":"v1","addr":"172.21.15.73:6811","nonce":1293329670}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":1293329670},{"type":"v1","addr":"172.21.15.73:6815","nonce":1293329670}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":1293329670},{"type":"v1","addr":"172.21.15.73:6813","nonce":1293329670}]},"public_addr":"172.21.15.73:6809/1293329670","cluster_addr":"172.21.15.73:6811/1293329670","heartbeat_back_addr":"172.21.15.73:6815/1293329670","heartbeat_front_addr":"172.21.15.73:6813/1293329670","state":["exists","up"]},{"osd":4,"uuid":"4b302fff-834c-4069-ac19-00e46f6c87b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":3727975702},{"type":"v1","addr":"172.21.15.142:6801","nonce":3727975702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":3727975702},{"type":"v1","addr":"172.21.15.142:6803","nonce":3727975702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6809","nonce":3727975702},{"type":"v1","addr":"172.21.15.142:6811","nonce":3727975702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6805","nonce":3727975702},{"type":"v1","addr":"172.21.15.142:6807","nonce":3727975702}]},"public_addr":"172.21.15.142:6801/3727975702","cluster_addr":"172.21.15.142:6803/3727975702","heartbeat_back_addr":"172.21.15.142:6811/3727975702","heartbeat_front_addr":"172.21.15.142:6807/3727975702","state":["exists","up"]},{"osd":5,"uuid":"d7cdace2-67d0-45cc-95f2-515cf6ef1b82","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6817","nonce":2353193632},{"type":"v1","addr":"172.21.15.142:6819","nonce":2353193632}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6821","nonce":2353193632},{"type":"v1","addr":"172.21.15.142:6823","nonce":2353193632}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6829","nonce":2353193632},{"type":"v1","addr":"172.21.15.142:6831","nonce":2353193632}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6825","nonce":2353193632},{"type":"v1","addr":"172.21.15.142:6827","nonce":2353193632}]},"public_addr":"172.21.15.142:6819/2353193632","cluster_addr":"172.21.15.142:6823/2353193632","heartbeat_back_addr":"172.21.15.142:6831/2353193632","heartbeat_front_addr":"172.21.15.142:6827/2353193632","state":["exists","up"]},{"osd":6,"uuid":"649ce78a-5626-445c-aedc-a651ed05a6f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":2006111986},{"type":"v1","addr":"172.21.15.142:6806","nonce":2006111986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":2006111986},{"type":"v1","addr":"172.21.15.142:6810","nonce":2006111986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":2006111986},{"type":"v1","addr":"172.21.15.142:6815","nonce":2006111986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":2006111986},{"type":"v1","addr":"172.21.15.142:6813","nonce":2006111986}]},"public_addr":"172.21.15.142:6806/2006111986","cluster_addr":"172.21.15.142:6810/2006111986","heartbeat_back_addr":"172.21.15.142:6815/2006111986","heartbeat_front_addr":"172.21.15.142:6813/2006111986","state":["exists","up"]},{"osd":7,"uuid":"af15ae3b-c1d0-4acf-92db-8a1805494d13","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":2573794341},{"type":"v1","addr":"172.21.15.142:6818","nonce":2573794341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":2573794341},{"type":"v1","addr":"172.21.15.142:6822","nonce":2573794341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":2573794341},{"type":"v1","addr":"172.21.15.142:6830","nonce":2573794341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":2573794341},{"type":"v1","addr":"172.21.15.142:6826","nonce":2573794341}]},"public_addr":"172.21.15.142:6818/2573794341","cluster_addr":"172.21.15.142:6822/2573794341","heartbeat_back_addr":"172.21.15.142:6830/2573794341","heartbeat_front_addr":"172.21.15.142:6826/2573794341","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.185824+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.262103+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.225556+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:10.523459+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:10.706035+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.257339+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.301776+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.051960+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-12T09:46:04.795 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:04.793+0000 7fb957a1e640 1 -- 172.21.15.73:0/1710443999 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fb93406ae40 msgr2=0x7fb93406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:04.795 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:04.793+0000 7fb957a1e640 1 --2- 172.21.15.73:0/1710443999 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fb93406ae40 0x7fb93406d300 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fb94c036000 tx=0x7fb94c03b040 comp rx=0 tx=0).stop 2023-12-12T09:46:04.795 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:04.793+0000 7fb957a1e640 1 -- 172.21.15.73:0/1710443999 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb9500c5070 msgr2=0x7fb9500bf050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:04.795 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:04.793+0000 7fb957a1e640 1 --2- 172.21.15.73:0/1710443999 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb9500c5070 0x7fb9500bf050 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7fb94000e870 tx=0x7fb94000ed30 comp rx=0 tx=0).stop 2023-12-12T09:46:04.795 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:04.793+0000 7fb957a1e640 1 -- 172.21.15.73:0/1710443999 shutdown_connections 2023-12-12T09:46:04.795 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:04.793+0000 7fb957a1e640 1 --2- 172.21.15.73:0/1710443999 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fb93406ae40 0x7fb93406d300 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:04.795 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:04.793+0000 7fb957a1e640 1 --2- 172.21.15.73:0/1710443999 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb95014fa40 0x7fb9501ed240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:04.795 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:04.793+0000 7fb957a1e640 1 --2- 172.21.15.73:0/1710443999 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb9500c5070 0x7fb9500bf050 unknown :-1 s=CLOSED pgs=772 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:04.795 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:04.793+0000 7fb957a1e640 1 --2- 172.21.15.73:0/1710443999 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb95006db70 0x7fb9500a9ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:04.795 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:04.793+0000 7fb957a1e640 1 -- 172.21.15.73:0/1710443999 >> 172.21.15.73:0/1710443999 conn(0x7fb9500a8130 msgr2=0x7fb9500c2440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:46:04.795 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:04.794+0000 7fb957a1e640 1 -- 172.21.15.73:0/1710443999 shutdown_connections 2023-12-12T09:46:04.796 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:04.794+0000 7fb957a1e640 1 -- 172.21.15.73:0/1710443999 wait complete. 2023-12-12T09:46:04.815 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-12-12T09:46:05.029 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:05.027+0000 7efc1df68640 1 Processor -- start 2023-12-12T09:46:05.029 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:05.028+0000 7efc1df68640 1 -- start start 2023-12-12T09:46:05.030 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:05.029+0000 7efc1df68640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7efc180a4f00 0x7efc18151ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:05.031 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:05.029+0000 7efc1df68640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7efc180c3920 0x7efc1814e480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:05.031 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:05.029+0000 7efc1df68640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efc1814e9c0 0x7efc180c14f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:05.031 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:05.029+0000 7efc1df68640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc180c58c0 con 0x7efc180c3920 2023-12-12T09:46:05.031 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:05.029+0000 7efc1df68640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc180c04c0 con 0x7efc180a4f00 2023-12-12T09:46:05.031 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:05.029+0000 7efc1df68640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc18152220 con 0x7efc1814e9c0 2023-12-12T09:46:05.031 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:05.029+0000 7efc16ffd640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7efc180c3920 0x7efc1814e480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:05.031 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:05.029+0000 7efc16ffd640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7efc180c3920 0x7efc1814e480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:44690/0 (socket says 172.21.15.73:44690) 2023-12-12T09:46:05.031 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:05.029+0000 7efc16ffd640 1 -- 172.21.15.73:0/2054497672 learned_addr learned my addr 172.21.15.73:0/2054497672 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:46:05.032 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:05.030+0000 7efc177fe640 1 --2- 172.21.15.73:0/2054497672 >> v2:172.21.15.142:3300/0 conn(0x7efc180a4f00 0x7efc18151ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:05.032 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:05.030+0000 7efc17fff640 1 --2- 172.21.15.73:0/2054497672 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efc1814e9c0 0x7efc180c14f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:05.032 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:05.030+0000 7efc16ffd640 1 -- 172.21.15.73:0/2054497672 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efc1814e9c0 msgr2=0x7efc180c14f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:46:05.032 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:05.030+0000 7efc16ffd640 1 --2- 172.21.15.73:0/2054497672 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efc1814e9c0 0x7efc180c14f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:05.032 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:05.030+0000 7efc16ffd640 1 -- 172.21.15.73:0/2054497672 >> v2:172.21.15.142:3300/0 conn(0x7efc180a4f00 msgr2=0x7efc18151ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:46:05.032 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:05.030+0000 7efc16ffd640 1 --2- 172.21.15.73:0/2054497672 >> v2:172.21.15.142:3300/0 conn(0x7efc180a4f00 0x7efc18151ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:05.032 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:05.030+0000 7efc16ffd640 1 -- 172.21.15.73:0/2054497672 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc180c0730 con 0x7efc180c3920 2023-12-12T09:46:05.033 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:05.030+0000 7efc17fff640 1 --2- 172.21.15.73:0/2054497672 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efc1814e9c0 0x7efc180c14f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:46:05.033 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:05.031+0000 7efc16ffd640 1 --2- 172.21.15.73:0/2054497672 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efc180c3920 0x7efc1814e480 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7efc180a5710 tx=0x7efc0002be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a1f6a7f40947437 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:46:05.034 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:05.031+0000 7efc167fc640 1 -- 172.21.15.73:0/2054497672 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc0002c9f0 con 0x7efc180c3920 2023-12-12T09:46:05.034 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:05.031+0000 7efc167fc640 1 -- 172.21.15.73:0/2054497672 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc0002cb50 con 0x7efc180c3920 2023-12-12T09:46:05.034 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:05.031+0000 7efc167fc640 1 -- 172.21.15.73:0/2054497672 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc000343f0 con 0x7efc180c3920 2023-12-12T09:46:05.034 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:05.032+0000 7efc1df68640 1 -- 172.21.15.73:0/2054497672 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efc180c3920 msgr2=0x7efc1814e480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:05.034 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:05.032+0000 7efc1df68640 1 --2- 172.21.15.73:0/2054497672 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efc180c3920 0x7efc1814e480 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7efc180a5710 tx=0x7efc0002be50 comp rx=0 tx=0).stop 2023-12-12T09:46:05.034 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:05.032+0000 7efc1df68640 1 -- 172.21.15.73:0/2054497672 shutdown_connections 2023-12-12T09:46:05.034 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:05.032+0000 7efc1df68640 1 --2- 172.21.15.73:0/2054497672 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efc1814e9c0 0x7efc180c14f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:05.034 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:05.032+0000 7efc1df68640 1 --2- 172.21.15.73:0/2054497672 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efc180c3920 0x7efc1814e480 unknown :-1 s=CLOSED pgs=773 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:05.034 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:05.032+0000 7efc1df68640 1 --2- 172.21.15.73:0/2054497672 >> v2:172.21.15.142:3300/0 conn(0x7efc180a4f00 0x7efc18151ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:05.034 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:05.032+0000 7efc1df68640 1 -- 172.21.15.73:0/2054497672 >> 172.21.15.73:0/2054497672 conn(0x7efc180a77d0 msgr2=0x7efc180a7bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:46:05.034 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:05.032+0000 7efc1df68640 1 -- 172.21.15.73:0/2054497672 shutdown_connections 2023-12-12T09:46:05.034 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:05.032+0000 7efc1df68640 1 -- 172.21.15.73:0/2054497672 wait complete. 2023-12-12T09:46:05.035 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:05.034+0000 7efc1df68640 1 Processor -- start 2023-12-12T09:46:05.035 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:05.034+0000 7efc1df68640 1 -- start start 2023-12-12T09:46:05.038 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:05.035+0000 7efc1df68640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efc180a4f00 0x7efc180a62a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:05.038 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:05.035+0000 7efc1df68640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efc180c3920 0x7efc181ed300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:05.038 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:05.035+0000 7efc1df68640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efc1814e9c0 0x7efc181ed840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:05.038 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:05.035+0000 7efc1df68640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc181ea950 con 0x7efc180c3920 2023-12-12T09:46:05.039 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:05.035+0000 7efc1df68640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc181ecee0 con 0x7efc1814e9c0 2023-12-12T09:46:05.039 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:05.035+0000 7efc1df68640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc1814d2b0 con 0x7efc180a4f00 2023-12-12T09:46:05.039 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:05.035+0000 7efc16ffd640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efc180c3920 0x7efc181ed300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:05.039 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:05.035+0000 7efc16ffd640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efc180c3920 0x7efc181ed300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:44702/0 (socket says 172.21.15.73:44702) 2023-12-12T09:46:05.039 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:05.035+0000 7efc16ffd640 1 -- 172.21.15.73:0/4009080882 learned_addr learned my addr 172.21.15.73:0/4009080882 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:46:05.039 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:05.036+0000 7efc177fe640 1 --2- 172.21.15.73:0/4009080882 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efc180a4f00 0x7efc180a62a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:05.040 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:05.036+0000 7efc17fff640 1 --2- 172.21.15.73:0/4009080882 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efc1814e9c0 0x7efc181ed840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:05.040 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:05.036+0000 7efc16ffd640 1 -- 172.21.15.73:0/4009080882 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efc180a4f00 msgr2=0x7efc180a62a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:05.040 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:05.036+0000 7efc16ffd640 1 --2- 172.21.15.73:0/4009080882 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efc180a4f00 0x7efc180a62a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:05.040 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:05.036+0000 7efc16ffd640 1 -- 172.21.15.73:0/4009080882 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efc1814e9c0 msgr2=0x7efc181ed840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:05.040 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:05.036+0000 7efc16ffd640 1 --2- 172.21.15.73:0/4009080882 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efc1814e9c0 0x7efc181ed840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:05.040 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:05.036+0000 7efc16ffd640 1 -- 172.21.15.73:0/4009080882 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc00009b30 con 0x7efc180c3920 2023-12-12T09:46:05.040 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:05.036+0000 7efc17fff640 1 --2- 172.21.15.73:0/4009080882 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efc1814e9c0 0x7efc181ed840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:46:05.041 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:05.036+0000 7efc16ffd640 1 --2- 172.21.15.73:0/4009080882 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efc180c3920 0x7efc181ed300 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7efc00000f80 tx=0x7efc00004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:46:05.041 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:05.036+0000 7efc0ffff640 1 -- 172.21.15.73:0/4009080882 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc00009510 con 0x7efc180c3920 2023-12-12T09:46:05.041 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:05.036+0000 7efc0ffff640 1 -- 172.21.15.73:0/4009080882 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc0003e450 con 0x7efc180c3920 2023-12-12T09:46:05.041 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:05.036+0000 7efc1df68640 1 -- 172.21.15.73:0/4009080882 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc1814b5a0 con 0x7efc180c3920 2023-12-12T09:46:05.041 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:05.036+0000 7efc0ffff640 1 -- 172.21.15.73:0/4009080882 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc0003e800 con 0x7efc180c3920 2023-12-12T09:46:05.041 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:05.037+0000 7efc1df68640 1 -- 172.21.15.73:0/4009080882 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc181470d0 con 0x7efc180c3920 2023-12-12T09:46:05.042 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:05.038+0000 7efc1df68640 1 -- 172.21.15.73:0/4009080882 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc181ed020 con 0x7efc180c3920 2023-12-12T09:46:05.043 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:05.038+0000 7efc0ffff640 1 -- 172.21.15.73:0/4009080882 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7efc0003e960 con 0x7efc180c3920 2023-12-12T09:46:05.043 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:05.039+0000 7efc0ffff640 1 --2- 172.21.15.73:0/4009080882 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7efbf806ae40 0x7efbf806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:05.043 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:05.039+0000 7efc0ffff640 1 -- 172.21.15.73:0/4009080882 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 6565+0+0 (secure 0 0 0) 0x7efc000ac7e0 con 0x7efc180c3920 2023-12-12T09:46:05.043 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:05.040+0000 7efc177fe640 1 --2- 172.21.15.73:0/4009080882 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7efbf806ae40 0x7efbf806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:05.043 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:05.040+0000 7efc177fe640 1 --2- 172.21.15.73:0/4009080882 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7efbf806ae40 0x7efbf806d300 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7efc08006fd0 tx=0x7efc08008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:46:05.045 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:05.044+0000 7efc0ffff640 1 -- 172.21.15.73:0/4009080882 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7efc181ed020 con 0x7efc180c3920 2023-12-12T09:46:05.273 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:05.272+0000 7efc1df68640 1 -- 172.21.15.73:0/4009080882 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7efc181ed020 con 0x7efc180c3920 2023-12-12T09:46:05.274 INFO:tasks.ceph.mon.a.smithi073.stderr:2023-12-12T09:46:05.273+0000 7f81027f3640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-12-12T09:46:05.278 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:05.277+0000 7efc0ffff640 1 -- 172.21.15.73:0/4009080882 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v36) v1 ==== 161+0+0 (secure 0 0 0) 0x7efc181ed020 con 0x7efc180c3920 2023-12-12T09:46:05.278 INFO:teuthology.orchestra.run.smithi073.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-12-12T09:46:05.281 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:05.279+0000 7efc1df68640 1 -- 172.21.15.73:0/4009080882 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7efbf806ae40 msgr2=0x7efbf806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:05.281 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:05.279+0000 7efc1df68640 1 --2- 172.21.15.73:0/4009080882 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7efbf806ae40 0x7efbf806d300 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7efc08006fd0 tx=0x7efc08008040 comp rx=0 tx=0).stop 2023-12-12T09:46:05.281 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:05.279+0000 7efc1df68640 1 -- 172.21.15.73:0/4009080882 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efc180c3920 msgr2=0x7efc181ed300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:05.281 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:05.279+0000 7efc1df68640 1 --2- 172.21.15.73:0/4009080882 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efc180c3920 0x7efc181ed300 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7efc00000f80 tx=0x7efc00004a40 comp rx=0 tx=0).stop 2023-12-12T09:46:05.282 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:05.280+0000 7efc1df68640 1 -- 172.21.15.73:0/4009080882 shutdown_connections 2023-12-12T09:46:05.282 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:05.280+0000 7efc1df68640 1 --2- 172.21.15.73:0/4009080882 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7efbf806ae40 0x7efbf806d300 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:05.282 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:05.280+0000 7efc1df68640 1 --2- 172.21.15.73:0/4009080882 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efc1814e9c0 0x7efc181ed840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:05.282 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:05.280+0000 7efc1df68640 1 --2- 172.21.15.73:0/4009080882 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efc180c3920 0x7efc181ed300 unknown :-1 s=CLOSED pgs=774 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:05.282 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:05.280+0000 7efc1df68640 1 --2- 172.21.15.73:0/4009080882 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efc180a4f00 0x7efc180a62a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:05.282 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:05.280+0000 7efc1df68640 1 -- 172.21.15.73:0/4009080882 >> 172.21.15.73:0/4009080882 conn(0x7efc180a77d0 msgr2=0x7efc1814a370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:46:05.282 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:05.280+0000 7efc1df68640 1 -- 172.21.15.73:0/4009080882 shutdown_connections 2023-12-12T09:46:05.282 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:05.280+0000 7efc1df68640 1 -- 172.21.15.73:0/4009080882 wait complete. 2023-12-12T09:46:05.297 INFO:tasks.ceph.mds.a.smithi073.stderr: -2955> 2023-12-12T09:45:28.467+0000 7f97317fa640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-12-12T09:46:05.301 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-12-12T09:46:05.359 INFO:tasks.ceph.mds.a.smithi073.stdout:starting mds.a at 2023-12-12T09:46:05.492 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:05.490+0000 7fb1b2ad3640 1 Processor -- start 2023-12-12T09:46:05.492 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:05.491+0000 7fb1b2ad3640 1 -- start start 2023-12-12T09:46:05.494 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:05.492+0000 7fb1b2ad3640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fb1ac151c30 0x7fb1ac06d440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:05.495 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:05.492+0000 7fb1b2ad3640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb1ac0c3930 0x7fb1ac157bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:05.495 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:05.492+0000 7fb1b2ad3640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1ac0a4f50 con 0x7fb1ac0bed50 2023-12-12T09:46:05.495 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:05.492+0000 7fb1b2ad3640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1ac0a54d0 con 0x7fb1ac151c30 2023-12-12T09:46:05.495 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:05.492+0000 7fb1b2ad3640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1ac155260 con 0x7fb1ac0c3930 2023-12-12T09:46:05.495 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:05.492+0000 7fb1b086f640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fb1ac151c30 0x7fb1ac06d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:05.495 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:05.492+0000 7fb1b086f640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fb1ac151c30 0x7fb1ac06d440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:44728/0 (socket says 172.21.15.73:44728) 2023-12-12T09:46:05.495 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:05.492+0000 7fb1b086f640 1 -- 172.21.15.73:0/1716618257 learned_addr learned my addr 172.21.15.73:0/1716618257 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:46:05.495 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:05.493+0000 7fb1abfff640 1 --2- 172.21.15.73:0/1716618257 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb1ac0c3930 0x7fb1ac157bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:05.495 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:05.493+0000 7fb1b086f640 1 -- 172.21.15.73:0/1716618257 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb1ac0c3930 msgr2=0x7fb1ac157bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:46:05.495 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:05.493+0000 7fb1b086f640 1 --2- 172.21.15.73:0/1716618257 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb1ac0c3930 0x7fb1ac157bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:05.495 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:05.493+0000 7fb1b086f640 1 -- 172.21.15.73:0/1716618257 >> v1:172.21.15.73:6789/0 conn(0x7fb1ac0bed50 legacy=0x7fb1ac0bf1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:05.496 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:05.493+0000 7fb1b086f640 1 -- 172.21.15.73:0/1716618257 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1ac0a51f0 con 0x7fb1ac151c30 2023-12-12T09:46:05.496 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:05.493+0000 7fb1ab7fe640 1 -- 172.21.15.73:0/1716618257 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3843802087 0 0) 0x7fb1ac0a4f50 con 0x7fb1ac0bed50 2023-12-12T09:46:05.497 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:05.494+0000 7fb1b086f640 1 --2- 172.21.15.73:0/1716618257 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb1ac151c30 0x7fb1ac06d440 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7fb1a0009870 tx=0x7fb1a002b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=541b466cc4ed7f61 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:46:05.497 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:05.494+0000 7fb1ab7fe640 1 -- 172.21.15.73:0/1716618257 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1a0031640 con 0x7fb1ac151c30 2023-12-12T09:46:05.497 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:05.494+0000 7fb1ab7fe640 1 -- 172.21.15.73:0/1716618257 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1a00317a0 con 0x7fb1ac151c30 2023-12-12T09:46:05.497 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:05.494+0000 7fb1ab7fe640 1 -- 172.21.15.73:0/1716618257 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1a0031b30 con 0x7fb1ac151c30 2023-12-12T09:46:05.497 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:05.495+0000 7fb1b2ad3640 1 -- 172.21.15.73:0/1716618257 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb1ac151c30 msgr2=0x7fb1ac06d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:05.497 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:05.495+0000 7fb1b2ad3640 1 --2- 172.21.15.73:0/1716618257 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb1ac151c30 0x7fb1ac06d440 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7fb1a0009870 tx=0x7fb1a002b8f0 comp rx=0 tx=0).stop 2023-12-12T09:46:05.497 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:05.495+0000 7fb1b2ad3640 1 -- 172.21.15.73:0/1716618257 shutdown_connections 2023-12-12T09:46:05.497 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:05.495+0000 7fb1b2ad3640 1 --2- 172.21.15.73:0/1716618257 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb1ac0c3930 0x7fb1ac157bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:05.497 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:05.495+0000 7fb1b2ad3640 1 --2- 172.21.15.73:0/1716618257 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb1ac151c30 0x7fb1ac06d440 unknown :-1 s=CLOSED pgs=779 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:05.497 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:05.495+0000 7fb1b2ad3640 1 -- 172.21.15.73:0/1716618257 >> 172.21.15.73:0/1716618257 conn(0x7fb1ac06a4e0 msgr2=0x7fb1ac06a8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:46:05.498 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:05.495+0000 7fb1b2ad3640 1 -- 172.21.15.73:0/1716618257 shutdown_connections 2023-12-12T09:46:05.498 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:05.495+0000 7fb1b2ad3640 1 -- 172.21.15.73:0/1716618257 wait complete. 2023-12-12T09:46:05.498 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:05.497+0000 7fb1b2ad3640 1 Processor -- start 2023-12-12T09:46:05.498 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:05.497+0000 7fb1b2ad3640 1 -- start start 2023-12-12T09:46:05.500 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:05.498+0000 7fb1b2ad3640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb1ac0bed50 0x7fb1ac0c2440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:05.500 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:05.498+0000 7fb1b2ad3640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb1ac0c3930 0x7fb1ac154150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:05.500 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:05.498+0000 7fb1b2ad3640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb1ac151c30 0x7fb1ac072140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:05.500 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:05.498+0000 7fb1b2ad3640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1ac070240 con 0x7fb1ac0bed50 2023-12-12T09:46:05.501 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:05.498+0000 7fb1b2ad3640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1ac1568d0 con 0x7fb1ac151c30 2023-12-12T09:46:05.501 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:05.498+0000 7fb1b2ad3640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1ac155d50 con 0x7fb1ac0c3930 2023-12-12T09:46:05.501 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:05.498+0000 7fb1b086f640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb1ac0bed50 0x7fb1ac0c2440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:05.501 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:05.498+0000 7fb1b086f640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb1ac0bed50 0x7fb1ac0c2440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:44732/0 (socket says 172.21.15.73:44732) 2023-12-12T09:46:05.501 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:05.498+0000 7fb1b086f640 1 -- 172.21.15.73:0/1358776092 learned_addr learned my addr 172.21.15.73:0/1358776092 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:46:05.501 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:05.498+0000 7fb1b086f640 1 -- 172.21.15.73:0/1358776092 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb1ac0c3930 msgr2=0x7fb1ac154150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:05.502 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:05.499+0000 7fb1b086f640 1 --2- 172.21.15.73:0/1358776092 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb1ac0c3930 0x7fb1ac154150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:05.502 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:05.499+0000 7fb1b086f640 1 -- 172.21.15.73:0/1358776092 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb1ac151c30 msgr2=0x7fb1ac072140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:05.502 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:05.499+0000 7fb1b086f640 1 --2- 172.21.15.73:0/1358776092 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb1ac151c30 0x7fb1ac072140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:05.502 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:05.499+0000 7fb1b086f640 1 -- 172.21.15.73:0/1358776092 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1a00094d0 con 0x7fb1ac0bed50 2023-12-12T09:46:05.502 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:05.499+0000 7fb1b086f640 1 --2- 172.21.15.73:0/1358776092 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb1ac0bed50 0x7fb1ac0c2440 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7fb1a0000c00 tx=0x7fb1a00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:46:05.504 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:05.499+0000 7fb1a97fa640 1 -- 172.21.15.73:0/1358776092 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1a003ac60 con 0x7fb1ac0bed50 2023-12-12T09:46:05.505 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:05.499+0000 7fb1a97fa640 1 -- 172.21.15.73:0/1358776092 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1a003adc0 con 0x7fb1ac0bed50 2023-12-12T09:46:05.505 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:05.499+0000 7fb1b2ad3640 1 -- 172.21.15.73:0/1358776092 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1ac156030 con 0x7fb1ac0bed50 2023-12-12T09:46:05.505 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:05.499+0000 7fb1a97fa640 1 -- 172.21.15.73:0/1358776092 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1a0044630 con 0x7fb1ac0bed50 2023-12-12T09:46:05.505 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:05.499+0000 7fb1b2ad3640 1 -- 172.21.15.73:0/1358776092 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1ac1565f0 con 0x7fb1ac0bed50 2023-12-12T09:46:05.505 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:05.500+0000 7fb1b2ad3640 1 -- 172.21.15.73:0/1358776092 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1ac152850 con 0x7fb1ac0bed50 2023-12-12T09:46:05.505 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:05.501+0000 7fb1a97fa640 1 -- 172.21.15.73:0/1358776092 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fb1a002f050 con 0x7fb1ac0bed50 2023-12-12T09:46:05.505 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:05.502+0000 7fb1a97fa640 1 --2- 172.21.15.73:0/1358776092 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fb19006ae40 0x7fb19006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:05.505 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:05.502+0000 7fb1a97fa640 1 -- 172.21.15.73:0/1358776092 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6651+0+0 (secure 0 0 0) 0x7fb1a00ab950 con 0x7fb1ac0bed50 2023-12-12T09:46:05.505 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:05.502+0000 7fb1abfff640 1 --2- 172.21.15.73:0/1358776092 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fb19006ae40 0x7fb19006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:05.505 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:05.503+0000 7fb1abfff640 1 --2- 172.21.15.73:0/1358776092 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fb19006ae40 0x7fb19006d300 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fb1ac1ee1e0 tx=0x7fb198008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:46:05.508 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:05.507+0000 7fb1a97fa640 1 -- 172.21.15.73:0/1358776092 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fb1ac152850 con 0x7fb1ac0bed50 2023-12-12T09:46:05.726 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:05.724+0000 7fb1b2ad3640 1 -- 172.21.15.73:0/1358776092 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fb1ac152850 con 0x7fb1ac0bed50 2023-12-12T09:46:06.282 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:06.280+0000 7fb1a97fa640 1 -- 172.21.15.73:0/1358776092 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v37) v1 ==== 104+0+0 (secure 0 0 0) 0x7fb1ac152850 con 0x7fb1ac0bed50 2023-12-12T09:46:06.285 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:06.284+0000 7fb1b2ad3640 1 -- 172.21.15.73:0/1358776092 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fb19006ae40 msgr2=0x7fb19006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:06.285 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:06.284+0000 7fb1b2ad3640 1 --2- 172.21.15.73:0/1358776092 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fb19006ae40 0x7fb19006d300 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fb1ac1ee1e0 tx=0x7fb198008040 comp rx=0 tx=0).stop 2023-12-12T09:46:06.285 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:06.284+0000 7fb1b2ad3640 1 -- 172.21.15.73:0/1358776092 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb1ac0bed50 msgr2=0x7fb1ac0c2440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:06.285 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:06.284+0000 7fb1b2ad3640 1 --2- 172.21.15.73:0/1358776092 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb1ac0bed50 0x7fb1ac0c2440 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7fb1a0000c00 tx=0x7fb1a00046c0 comp rx=0 tx=0).stop 2023-12-12T09:46:06.286 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:06.284+0000 7fb1b2ad3640 1 -- 172.21.15.73:0/1358776092 shutdown_connections 2023-12-12T09:46:06.286 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:06.284+0000 7fb1b2ad3640 1 --2- 172.21.15.73:0/1358776092 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fb19006ae40 0x7fb19006d300 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:06.286 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:06.284+0000 7fb1b2ad3640 1 --2- 172.21.15.73:0/1358776092 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb1ac151c30 0x7fb1ac072140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:06.286 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:06.284+0000 7fb1b2ad3640 1 --2- 172.21.15.73:0/1358776092 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb1ac0c3930 0x7fb1ac154150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:06.286 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:06.284+0000 7fb1b2ad3640 1 --2- 172.21.15.73:0/1358776092 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb1ac0bed50 0x7fb1ac0c2440 unknown :-1 s=CLOSED pgs=780 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:06.286 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:06.284+0000 7fb1b2ad3640 1 -- 172.21.15.73:0/1358776092 >> 172.21.15.73:0/1358776092 conn(0x7fb1ac06a4e0 msgr2=0x7fb1ac0bf1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:46:06.286 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:06.284+0000 7fb1b2ad3640 1 -- 172.21.15.73:0/1358776092 shutdown_connections 2023-12-12T09:46:06.286 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:06.284+0000 7fb1b2ad3640 1 -- 172.21.15.73:0/1358776092 wait complete. 2023-12-12T09:46:06.306 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-12-12T09:46:06.516 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:06.514+0000 7f584d116640 1 Processor -- start 2023-12-12T09:46:06.516 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:06.514+0000 7f584d116640 1 -- start start 2023-12-12T09:46:06.517 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:06.516+0000 7f584d116640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f58481545a0 0x7f58480c5e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:06.517 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:06.516+0000 7f584d116640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58480c4e20 con 0x7f5848151dd0 2023-12-12T09:46:06.517 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:06.516+0000 7f584d116640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58480c59a0 con 0x7f58480c4750 2023-12-12T09:46:06.517 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:06.516+0000 7f584d116640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58480c5070 con 0x7f58481545a0 2023-12-12T09:46:06.518 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:06.516+0000 7f5846d9d640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f5848151dd0 0x7f584806ab70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:55808/0 (socket says 172.21.15.73:55808) 2023-12-12T09:46:06.518 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:06.516+0000 7f5846d9d640 1 -- 172.21.15.73:0/1553896748 learned_addr learned my addr 172.21.15.73:0/1553896748 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-12T09:46:06.519 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:06.517+0000 7f5845d9b640 1 -- 172.21.15.73:0/1553896748 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 416775129 0 0) 0x7f58480c4e20 con 0x7f5848151dd0 2023-12-12T09:46:06.520 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:06.517+0000 7f584659c640 1 --2- 172.21.15.73:0/1553896748 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f58481545a0 0x7f58480c5e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:06.520 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:06.517+0000 7f5845d9b640 1 -- 172.21.15.73:0/1553896748 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5834003520 con 0x7f5848151dd0 2023-12-12T09:46:06.520 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:06.517+0000 7f5845d9b640 1 -- 172.21.15.73:0/1553896748 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2030447878 0 0) 0x7f5834003520 con 0x7f5848151dd0 2023-12-12T09:46:06.520 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:06.517+0000 7f5845d9b640 1 -- 172.21.15.73:0/1553896748 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f58481545a0 msgr2=0x7f58480c5e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:46:06.520 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:06.517+0000 7f5845d9b640 1 --2- 172.21.15.73:0/1553896748 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f58481545a0 0x7f58480c5e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:06.520 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:06.517+0000 7f5845d9b640 1 -- 172.21.15.73:0/1553896748 >> v1:172.21.15.142:6789/0 conn(0x7f58480c4750 legacy=0x7f584815ef20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:06.520 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:06.517+0000 7f5845d9b640 1 -- 172.21.15.73:0/1553896748 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58480c5350 con 0x7f5848151dd0 2023-12-12T09:46:06.520 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:06.517+0000 7f5845d9b640 1 -- 172.21.15.73:0/1553896748 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3186547832 0 0) 0x7f58380019f0 con 0x7f5848151dd0 2023-12-12T09:46:06.520 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:06.517+0000 7f5845d9b640 1 -- 172.21.15.73:0/1553896748 >> v1:172.21.15.73:6789/0 conn(0x7f5848151dd0 legacy=0x7f584806ab70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:06.520 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:06.517+0000 7f5845d9b640 1 --2- 172.21.15.73:0/1553896748 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f58340039a0 0x7f5834003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:06.520 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:06.517+0000 7f5845d9b640 1 --2- 172.21.15.73:0/1553896748 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f58481545a0 0x7f58340047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:06.520 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:06.517+0000 7f5845d9b640 1 --2- 172.21.15.73:0/1553896748 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5834004d00 0x7f5834005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:06.521 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:06.517+0000 7f5845d9b640 1 -- 172.21.15.73:0/1553896748 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58480c5070 con 0x7f5834004d00 2023-12-12T09:46:06.521 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:06.517+0000 7f5845d9b640 1 -- 172.21.15.73:0/1553896748 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f583400bab0 con 0x7f58340039a0 2023-12-12T09:46:06.521 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:06.517+0000 7f5845d9b640 1 -- 172.21.15.73:0/1553896748 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f583400bc70 con 0x7f58481545a0 2023-12-12T09:46:06.521 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:06.517+0000 7f584759e640 1 --2- 172.21.15.73:0/1553896748 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5834004d00 0x7f5834005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:06.521 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:06.518+0000 7f584759e640 1 -- 172.21.15.73:0/1553896748 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f58481545a0 msgr2=0x7f58340047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:46:06.521 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:06.518+0000 7f584759e640 1 --2- 172.21.15.73:0/1553896748 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f58481545a0 0x7f58340047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:06.521 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:06.518+0000 7f584759e640 1 -- 172.21.15.73:0/1553896748 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f58340039a0 msgr2=0x7f5834003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:46:06.521 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:06.518+0000 7f584759e640 1 --2- 172.21.15.73:0/1553896748 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f58340039a0 0x7f5834003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:06.521 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:06.518+0000 7f584759e640 1 -- 172.21.15.73:0/1553896748 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5834003520 con 0x7f5834004d00 2023-12-12T09:46:06.522 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:06.519+0000 7f584759e640 1 --2- 172.21.15.73:0/1553896748 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5834004d00 0x7f5834005180 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7f5840001720 tx=0x7f58340057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca9f9db83fdc1f84 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:46:06.523 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:06.519+0000 7f5845d9b640 1 -- 172.21.15.73:0/1553896748 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58400052d0 con 0x7f5834004d00 2023-12-12T09:46:06.523 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:06.519+0000 7f5845d9b640 1 -- 172.21.15.73:0/1553896748 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f584002e050 con 0x7f5834004d00 2023-12-12T09:46:06.523 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:06.519+0000 7f5845d9b640 1 -- 172.21.15.73:0/1553896748 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58400035f0 con 0x7f5834004d00 2023-12-12T09:46:06.523 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:06.520+0000 7f584d116640 1 -- 172.21.15.73:0/1553896748 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5834004d00 msgr2=0x7f5834005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:06.523 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:06.520+0000 7f584d116640 1 --2- 172.21.15.73:0/1553896748 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5834004d00 0x7f5834005180 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7f5840001720 tx=0x7f58340057f0 comp rx=0 tx=0).stop 2023-12-12T09:46:06.523 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:06.520+0000 7f584759e640 1 -- 172.21.15.73:0/1553896748 reap_dead start 2023-12-12T09:46:06.523 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:06.520+0000 7f584d116640 1 -- 172.21.15.73:0/1553896748 shutdown_connections 2023-12-12T09:46:06.523 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:06.520+0000 7f584d116640 1 -- 172.21.15.73:0/1553896748 >> 172.21.15.73:0/1553896748 conn(0x7f58480ab8c0 msgr2=0x7f58480abcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:46:06.523 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:06.520+0000 7f584d116640 1 -- 172.21.15.73:0/1553896748 shutdown_connections 2023-12-12T09:46:06.524 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:06.520+0000 7f584d116640 1 -- 172.21.15.73:0/1553896748 wait complete. 2023-12-12T09:46:06.524 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:06.522+0000 7f584d116640 1 Processor -- start 2023-12-12T09:46:06.525 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:06.522+0000 7f584d116640 1 -- start start 2023-12-12T09:46:06.526 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:06.523+0000 7f584d116640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5834004d00 0x7f5848150e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:06.526 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:06.523+0000 7f584d116640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f58481583a0 0x7f58480c1790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:06.526 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:06.523+0000 7f584d116640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5848147150 0x7f58481475d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:06.526 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:06.523+0000 7f584d116640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58480c0fe0 con 0x7f5848147150 2023-12-12T09:46:06.526 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:06.523+0000 7f584d116640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f584814d390 con 0x7f58481583a0 2023-12-12T09:46:06.526 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:06.523+0000 7f584d116640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f584814d670 con 0x7f5834004d00 2023-12-12T09:46:06.526 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:06.523+0000 7f584759e640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5848147150 0x7f58481475d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:06.526 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:06.523+0000 7f584759e640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5848147150 0x7f58481475d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:44756/0 (socket says 172.21.15.73:44756) 2023-12-12T09:46:06.526 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:06.523+0000 7f584759e640 1 -- 172.21.15.73:0/1424937838 learned_addr learned my addr 172.21.15.73:0/1424937838 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:46:06.526 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:06.523+0000 7f584659c640 1 --2- 172.21.15.73:0/1424937838 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f58481583a0 0x7f58480c1790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:06.526 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:06.523+0000 7f584759e640 1 -- 172.21.15.73:0/1424937838 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5834004d00 msgr2=0x7f5848150e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:06.526 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:06.523+0000 7f5846d9d640 1 --2- 172.21.15.73:0/1424937838 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5834004d00 0x7f5848150e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:06.526 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:06.523+0000 7f584759e640 1 --2- 172.21.15.73:0/1424937838 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5834004d00 0x7f5848150e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:06.526 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:06.523+0000 7f584759e640 1 -- 172.21.15.73:0/1424937838 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f58481583a0 msgr2=0x7f58480c1790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:06.527 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:06.523+0000 7f584759e640 1 --2- 172.21.15.73:0/1424937838 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f58481583a0 0x7f58480c1790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:06.527 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:06.523+0000 7f584759e640 1 -- 172.21.15.73:0/1424937838 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f584814d950 con 0x7f5848147150 2023-12-12T09:46:06.527 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:06.523+0000 7f584659c640 1 --2- 172.21.15.73:0/1424937838 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f58481583a0 0x7f58480c1790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:46:06.527 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:06.524+0000 7f584759e640 1 --2- 172.21.15.73:0/1424937838 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5848147150 0x7f58481475d0 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7f5840005040 tx=0x7f5840001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:46:06.527 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:06.524+0000 7f583f7fe640 1 -- 172.21.15.73:0/1424937838 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5840043070 con 0x7f5848147150 2023-12-12T09:46:06.527 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:06.524+0000 7f583f7fe640 1 -- 172.21.15.73:0/1424937838 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5840007a30 con 0x7f5848147150 2023-12-12T09:46:06.527 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:06.524+0000 7f584d116640 1 -- 172.21.15.73:0/1424937838 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f584814dc30 con 0x7f5848147150 2023-12-12T09:46:06.527 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:06.524+0000 7f583f7fe640 1 -- 172.21.15.73:0/1424937838 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58400067d0 con 0x7f5848147150 2023-12-12T09:46:06.527 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:06.524+0000 7f584d116640 1 -- 172.21.15.73:0/1424937838 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5848151550 con 0x7f5848147150 2023-12-12T09:46:06.528 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:06.525+0000 7f584d116640 1 -- 172.21.15.73:0/1424937838 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f58481ed230 con 0x7f5848147150 2023-12-12T09:46:06.528 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:06.526+0000 7f583f7fe640 1 -- 172.21.15.73:0/1424937838 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f5840006930 con 0x7f5848147150 2023-12-12T09:46:06.528 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:06.527+0000 7f583f7fe640 1 --2- 172.21.15.73:0/1424937838 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f582806ae40 0x7f582806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:06.528 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:06.527+0000 7f583f7fe640 1 -- 172.21.15.73:0/1424937838 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6651+0+0 (secure 0 0 0) 0x7f58400aa5f0 con 0x7f5848147150 2023-12-12T09:46:06.528 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:06.527+0000 7f5846d9d640 1 --2- 172.21.15.73:0/1424937838 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f582806ae40 0x7f582806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:06.529 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:06.528+0000 7f5846d9d640 1 --2- 172.21.15.73:0/1424937838 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f582806ae40 0x7f582806d300 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f5838001350 tx=0x7f5838009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:46:06.533 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:06.531+0000 7f583f7fe640 1 -- 172.21.15.73:0/1424937838 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f58481ed230 con 0x7f5848147150 2023-12-12T09:46:06.726 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:06.724+0000 7f584d116640 1 -- 172.21.15.73:0/1424937838 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f58481ed230 con 0x7f5848147150 2023-12-12T09:46:07.294 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:07.293+0000 7f583f7fe640 1 -- 172.21.15.73:0/1424937838 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v60) v1 ==== 181+0+0 (secure 0 0 0) 0x7f58481ed230 con 0x7f5848147150 2023-12-12T09:46:07.295 INFO:teuthology.orchestra.run.smithi073.stderr:pool 'cephfs_metadata' removed 2023-12-12T09:46:07.300 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:07.298+0000 7f584d116640 1 -- 172.21.15.73:0/1424937838 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f582806ae40 msgr2=0x7f582806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:07.300 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:07.298+0000 7f584d116640 1 --2- 172.21.15.73:0/1424937838 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f582806ae40 0x7f582806d300 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f5838001350 tx=0x7f5838009040 comp rx=0 tx=0).stop 2023-12-12T09:46:07.300 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:07.298+0000 7f584d116640 1 -- 172.21.15.73:0/1424937838 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5848147150 msgr2=0x7f58481475d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:07.300 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:07.298+0000 7f584d116640 1 --2- 172.21.15.73:0/1424937838 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5848147150 0x7f58481475d0 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7f5840005040 tx=0x7f5840001120 comp rx=0 tx=0).stop 2023-12-12T09:46:07.301 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:07.299+0000 7f584d116640 1 -- 172.21.15.73:0/1424937838 shutdown_connections 2023-12-12T09:46:07.301 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:07.299+0000 7f584d116640 1 --2- 172.21.15.73:0/1424937838 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f582806ae40 0x7f582806d300 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:07.301 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:07.299+0000 7f584d116640 1 --2- 172.21.15.73:0/1424937838 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5848147150 0x7f58481475d0 unknown :-1 s=CLOSED pgs=783 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:07.301 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:07.299+0000 7f584d116640 1 --2- 172.21.15.73:0/1424937838 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f58481583a0 0x7f58480c1790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:07.302 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:07.299+0000 7f584d116640 1 --2- 172.21.15.73:0/1424937838 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5834004d00 0x7f5848150e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:07.302 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:07.299+0000 7f584d116640 1 -- 172.21.15.73:0/1424937838 >> 172.21.15.73:0/1424937838 conn(0x7f58480ab8c0 msgr2=0x7f58480c7bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:46:07.302 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:07.300+0000 7f584d116640 1 -- 172.21.15.73:0/1424937838 shutdown_connections 2023-12-12T09:46:07.302 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:07.300+0000 7f584d116640 1 -- 172.21.15.73:0/1424937838 wait complete. 2023-12-12T09:46:07.324 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-12-12T09:46:07.532 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:07.530+0000 7f80bf7a5640 1 Processor -- start 2023-12-12T09:46:07.532 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:07.530+0000 7f80bf7a5640 1 -- start start 2023-12-12T09:46:07.533 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:07.531+0000 7f80bf7a5640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f80b80a4c90 0x7f80b80c5420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:07.534 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:07.531+0000 7f80bf7a5640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f80b80c0320 0x7f80b80c20b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:07.534 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:07.531+0000 7f80bf7a5640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80b80c3390 con 0x7f80b814ea60 2023-12-12T09:46:07.534 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:07.531+0000 7f80bf7a5640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80b80c4b30 con 0x7f80b80a4c90 2023-12-12T09:46:07.534 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:07.531+0000 7f80bf7a5640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80b8151e60 con 0x7f80b80c0320 2023-12-12T09:46:07.534 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:07.532+0000 7f80bcd40640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f80b80a4c90 0x7f80b80c5420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:07.534 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:07.532+0000 7f80bcd40640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f80b80a4c90 0x7f80b80c5420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:44758/0 (socket says 172.21.15.73:44758) 2023-12-12T09:46:07.534 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:07.532+0000 7f80bcd40640 1 -- 172.21.15.73:0/1657671172 learned_addr learned my addr 172.21.15.73:0/1657671172 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:46:07.534 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:07.532+0000 7f80bdd42640 1 --2- 172.21.15.73:0/1657671172 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f80b80c0320 0x7f80b80c20b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:07.534 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:07.532+0000 7f80bcd40640 1 -- 172.21.15.73:0/1657671172 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f80b80c0320 msgr2=0x7f80b80c20b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:46:07.534 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:07.532+0000 7f80bcd40640 1 --2- 172.21.15.73:0/1657671172 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f80b80c0320 0x7f80b80c20b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:07.534 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:07.532+0000 7f80bcd40640 1 -- 172.21.15.73:0/1657671172 >> v1:172.21.15.142:6789/0 conn(0x7f80b814ea60 legacy=0x7f80b80c4420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:46:07.535 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:07.532+0000 7f80bcd40640 1 -- 172.21.15.73:0/1657671172 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80b8152140 con 0x7f80b80a4c90 2023-12-12T09:46:07.536 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:07.533+0000 7f80bcd40640 1 --2- 172.21.15.73:0/1657671172 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f80b80a4c90 0x7f80b80c5420 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7f80a8009870 tx=0x7f80a802b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3121014917336fcb server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:46:07.536 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:07.534+0000 7f80affff640 1 -- 172.21.15.73:0/1657671172 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80a80317c0 con 0x7f80b80a4c90 2023-12-12T09:46:07.536 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:07.534+0000 7f80affff640 1 -- 172.21.15.73:0/1657671172 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80a8031920 con 0x7f80b80a4c90 2023-12-12T09:46:07.536 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:07.534+0000 7f80affff640 1 -- 172.21.15.73:0/1657671172 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80a8031cb0 con 0x7f80b80a4c90 2023-12-12T09:46:07.536 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:07.534+0000 7f80bf7a5640 1 -- 172.21.15.73:0/1657671172 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f80b80a4c90 msgr2=0x7f80b80c5420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:07.536 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:07.534+0000 7f80bf7a5640 1 --2- 172.21.15.73:0/1657671172 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f80b80a4c90 0x7f80b80c5420 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7f80a8009870 tx=0x7f80a802b860 comp rx=0 tx=0).stop 2023-12-12T09:46:07.536 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:07.534+0000 7f80bf7a5640 1 -- 172.21.15.73:0/1657671172 shutdown_connections 2023-12-12T09:46:07.536 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:07.534+0000 7f80bf7a5640 1 --2- 172.21.15.73:0/1657671172 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f80b80c0320 0x7f80b80c20b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:07.537 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:07.534+0000 7f80bf7a5640 1 --2- 172.21.15.73:0/1657671172 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f80b80a4c90 0x7f80b80c5420 unknown :-1 s=CLOSED pgs=784 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:07.537 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:07.534+0000 7f80bf7a5640 1 -- 172.21.15.73:0/1657671172 >> 172.21.15.73:0/1657671172 conn(0x7f80b806a4e0 msgr2=0x7f80b806a8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:46:07.537 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:07.534+0000 7f80bf7a5640 1 -- 172.21.15.73:0/1657671172 shutdown_connections 2023-12-12T09:46:07.537 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:07.534+0000 7f80bf7a5640 1 -- 172.21.15.73:0/1657671172 wait complete. 2023-12-12T09:46:07.537 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:07.536+0000 7f80bf7a5640 1 Processor -- start 2023-12-12T09:46:07.537 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:07.536+0000 7f80bf7a5640 1 -- start start 2023-12-12T09:46:07.540 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:07.537+0000 7f80bf7a5640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f80b80a4c90 0x7f80b8150c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:07.540 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:07.537+0000 7f80bf7a5640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f80b80c0320 0x7f80b814bc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:07.540 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:07.537+0000 7f80bf7a5640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f80b814ea60 0x7f80b81497a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:07.540 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:07.537+0000 7f80bf7a5640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80b814ff80 con 0x7f80b80c0320 2023-12-12T09:46:07.540 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:07.537+0000 7f80bf7a5640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80b81507e0 con 0x7f80b80a4c90 2023-12-12T09:46:07.540 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:07.537+0000 7f80bf7a5640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80b81ea270 con 0x7f80b814ea60 2023-12-12T09:46:07.540 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:07.537+0000 7f80bcd40640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f80b80c0320 0x7f80b814bc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:07.540 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:07.537+0000 7f80bcd40640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f80b80c0320 0x7f80b814bc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:44768/0 (socket says 172.21.15.73:44768) 2023-12-12T09:46:07.540 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:07.537+0000 7f80bcd40640 1 -- 172.21.15.73:0/1076464185 learned_addr learned my addr 172.21.15.73:0/1076464185 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:46:07.541 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:07.538+0000 7f80bd541640 1 --2- 172.21.15.73:0/1076464185 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f80b80a4c90 0x7f80b8150c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:07.541 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:07.538+0000 7f80bdd42640 1 --2- 172.21.15.73:0/1076464185 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f80b814ea60 0x7f80b81497a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:07.541 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:07.538+0000 7f80bcd40640 1 -- 172.21.15.73:0/1076464185 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f80b814ea60 msgr2=0x7f80b81497a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:07.541 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:07.538+0000 7f80bcd40640 1 --2- 172.21.15.73:0/1076464185 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f80b814ea60 0x7f80b81497a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:07.541 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:07.538+0000 7f80bcd40640 1 -- 172.21.15.73:0/1076464185 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f80b80a4c90 msgr2=0x7f80b8150c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:07.541 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:07.538+0000 7f80bcd40640 1 --2- 172.21.15.73:0/1076464185 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f80b80a4c90 0x7f80b8150c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:07.541 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:07.538+0000 7f80bcd40640 1 -- 172.21.15.73:0/1076464185 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80a80094d0 con 0x7f80b80c0320 2023-12-12T09:46:07.541 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:07.538+0000 7f80bdd42640 1 --2- 172.21.15.73:0/1076464185 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f80b814ea60 0x7f80b81497a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:46:07.541 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:07.538+0000 7f80bcd40640 1 --2- 172.21.15.73:0/1076464185 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f80b80c0320 0x7f80b814bc80 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7f80a8000c00 tx=0x7f80a80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:46:07.541 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:07.538+0000 7f80adffb640 1 -- 172.21.15.73:0/1076464185 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80a80329a0 con 0x7f80b80c0320 2023-12-12T09:46:07.541 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:07.538+0000 7f80adffb640 1 -- 172.21.15.73:0/1076464185 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80a8032b20 con 0x7f80b80c0320 2023-12-12T09:46:07.541 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:07.539+0000 7f80bf7a5640 1 -- 172.21.15.73:0/1076464185 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80b8150190 con 0x7f80b80c0320 2023-12-12T09:46:07.542 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:07.539+0000 7f80adffb640 1 -- 172.21.15.73:0/1076464185 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80a80453f0 con 0x7f80b80c0320 2023-12-12T09:46:07.542 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:07.539+0000 7f80bf7a5640 1 -- 172.21.15.73:0/1076464185 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80b814f8a0 con 0x7f80b80c0320 2023-12-12T09:46:07.542 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:07.540+0000 7f80bf7a5640 1 -- 172.21.15.73:0/1076464185 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f80b8067070 con 0x7f80b80c0320 2023-12-12T09:46:07.542 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:07.541+0000 7f80adffb640 1 -- 172.21.15.73:0/1076464185 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f80a804d3f0 con 0x7f80b80c0320 2023-12-12T09:46:07.543 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:07.542+0000 7f80adffb640 1 --2- 172.21.15.73:0/1076464185 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f809c06ae70 0x7f809c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:07.544 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:07.542+0000 7f80adffb640 1 -- 172.21.15.73:0/1076464185 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 6213+0+0 (secure 0 0 0) 0x7f80a80ab7a0 con 0x7f80b80c0320 2023-12-12T09:46:07.544 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:07.542+0000 7f80bd541640 1 --2- 172.21.15.73:0/1076464185 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f809c06ae70 0x7f809c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:07.544 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:07.543+0000 7f80bd541640 1 --2- 172.21.15.73:0/1076464185 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f809c06ae70 0x7f809c06d330 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f80b4006fd0 tx=0x7f80b4008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:46:07.548 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:07.547+0000 7f80adffb640 1 -- 172.21.15.73:0/1076464185 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f80a8076650 con 0x7f80b80c0320 2023-12-12T09:46:07.739 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:07.737+0000 7f80bf7a5640 1 -- 172.21.15.73:0/1076464185 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f80b8150950 con 0x7f80b80c0320 2023-12-12T09:46:08.306 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:08.305+0000 7f80adffb640 1 -- 172.21.15.73:0/1076464185 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v61) v1 ==== 169+0+0 (secure 0 0 0) 0x7f80a8079c70 con 0x7f80b80c0320 2023-12-12T09:46:08.306 INFO:teuthology.orchestra.run.smithi073.stderr:pool 'cephfs_data' removed 2023-12-12T09:46:08.310 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:08.308+0000 7f80bf7a5640 1 -- 172.21.15.73:0/1076464185 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f809c06ae70 msgr2=0x7f809c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:08.310 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:08.308+0000 7f80bf7a5640 1 --2- 172.21.15.73:0/1076464185 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f809c06ae70 0x7f809c06d330 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f80b4006fd0 tx=0x7f80b4008040 comp rx=0 tx=0).stop 2023-12-12T09:46:08.310 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:08.308+0000 7f80bf7a5640 1 -- 172.21.15.73:0/1076464185 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f80b80c0320 msgr2=0x7f80b814bc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:08.310 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:08.308+0000 7f80bf7a5640 1 --2- 172.21.15.73:0/1076464185 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f80b80c0320 0x7f80b814bc80 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7f80a8000c00 tx=0x7f80a80046c0 comp rx=0 tx=0).stop 2023-12-12T09:46:08.310 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:08.309+0000 7f80bf7a5640 1 -- 172.21.15.73:0/1076464185 shutdown_connections 2023-12-12T09:46:08.311 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:08.309+0000 7f80bf7a5640 1 --2- 172.21.15.73:0/1076464185 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f809c06ae70 0x7f809c06d330 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:08.311 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:08.309+0000 7f80bf7a5640 1 --2- 172.21.15.73:0/1076464185 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f80b814ea60 0x7f80b81497a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:08.311 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:08.309+0000 7f80bf7a5640 1 --2- 172.21.15.73:0/1076464185 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f80b80c0320 0x7f80b814bc80 unknown :-1 s=CLOSED pgs=785 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:08.311 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:08.309+0000 7f80bf7a5640 1 --2- 172.21.15.73:0/1076464185 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f80b80a4c90 0x7f80b8150c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:08.311 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:08.309+0000 7f80bf7a5640 1 -- 172.21.15.73:0/1076464185 >> 172.21.15.73:0/1076464185 conn(0x7f80b806a4e0 msgr2=0x7f80b8070d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:46:08.311 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:08.309+0000 7f80bf7a5640 1 -- 172.21.15.73:0/1076464185 shutdown_connections 2023-12-12T09:46:08.311 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:08.309+0000 7f80bf7a5640 1 -- 172.21.15.73:0/1076464185 wait complete. 2023-12-12T09:46:08.337 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-12T09:46:08.538 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:08.536+0000 7fa997bce640 1 Processor -- start 2023-12-12T09:46:08.538 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:08.537+0000 7fa997bce640 1 -- start start 2023-12-12T09:46:08.539 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:08.538+0000 7fa997bce640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa99006bf20 0x7fa9900a9760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:08.539 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:08.538+0000 7fa997bce640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9900c0b50 con 0x7fa9900a50f0 2023-12-12T09:46:08.539 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:08.538+0000 7fa997bce640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa99006c880 con 0x7fa9901552e0 2023-12-12T09:46:08.539 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:08.538+0000 7fa997bce640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9900c04d0 con 0x7fa99006bf20 2023-12-12T09:46:08.541 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:08.538+0000 7fa995169640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7fa9900a50f0 0x7fa9900a9050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:55824/0 (socket says 172.21.15.73:55824) 2023-12-12T09:46:08.541 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:08.538+0000 7fa995169640 1 -- 172.21.15.73:0/23971838 learned_addr learned my addr 172.21.15.73:0/23971838 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-12T09:46:08.541 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:08.538+0000 7fa99616b640 1 --2- 172.21.15.73:0/23971838 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa99006bf20 0x7fa9900a9760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:08.541 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:08.539+0000 7fa994968640 1 -- 172.21.15.73:0/23971838 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 323517281 0 0) 0x7fa9900c0b50 con 0x7fa9900a50f0 2023-12-12T09:46:08.541 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:08.539+0000 7fa994968640 1 -- 172.21.15.73:0/23971838 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa97c003520 con 0x7fa9900a50f0 2023-12-12T09:46:08.542 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:08.539+0000 7fa994968640 1 -- 172.21.15.73:0/23971838 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2244211824 0 0) 0x7fa97c003520 con 0x7fa9900a50f0 2023-12-12T09:46:08.542 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:08.539+0000 7fa994968640 1 -- 172.21.15.73:0/23971838 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa99006bf20 msgr2=0x7fa9900a9760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:46:08.542 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:08.539+0000 7fa994968640 1 --2- 172.21.15.73:0/23971838 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa99006bf20 0x7fa9900a9760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:08.542 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:08.539+0000 7fa994968640 1 -- 172.21.15.73:0/23971838 >> v1:172.21.15.142:6789/0 conn(0x7fa9901552e0 legacy=0x7fa9900c49c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:08.542 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:08.539+0000 7fa994968640 1 -- 172.21.15.73:0/23971838 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa99006cb60 con 0x7fa9900a50f0 2023-12-12T09:46:08.542 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:08.539+0000 7fa994968640 1 -- 172.21.15.73:0/23971838 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3186547832 0 0) 0x7fa980001670 con 0x7fa9900a50f0 2023-12-12T09:46:08.542 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:08.539+0000 7fa994968640 1 -- 172.21.15.73:0/23971838 >> v1:172.21.15.73:6789/0 conn(0x7fa9900a50f0 legacy=0x7fa9900a9050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:08.542 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:08.539+0000 7fa994968640 1 --2- 172.21.15.73:0/23971838 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa99006bf20 0x7fa97c0039a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:08.542 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:08.539+0000 7fa994968640 1 --2- 172.21.15.73:0/23971838 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa97c003fd0 0x7fa97c0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:08.542 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:08.539+0000 7fa994968640 1 --2- 172.21.15.73:0/23971838 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa97c004d00 0x7fa97c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:08.542 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:08.539+0000 7fa994968640 1 -- 172.21.15.73:0/23971838 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9900c04d0 con 0x7fa97c003fd0 2023-12-12T09:46:08.542 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:08.539+0000 7fa994968640 1 -- 172.21.15.73:0/23971838 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa97c00bbc0 con 0x7fa97c004d00 2023-12-12T09:46:08.542 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:08.539+0000 7fa994968640 1 -- 172.21.15.73:0/23971838 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa97c00bd80 con 0x7fa99006bf20 2023-12-12T09:46:08.543 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:08.539+0000 7fa995169640 1 --2- 172.21.15.73:0/23971838 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa97c003fd0 0x7fa97c0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:08.543 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:08.540+0000 7fa99596a640 1 --2- 172.21.15.73:0/23971838 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa99006bf20 0x7fa97c0039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:08.543 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:08.540+0000 7fa99616b640 1 --2- 172.21.15.73:0/23971838 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa97c004d00 0x7fa97c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:08.543 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:08.540+0000 7fa995169640 1 -- 172.21.15.73:0/23971838 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa99006bf20 msgr2=0x7fa97c0039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:46:08.543 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:08.540+0000 7fa995169640 1 --2- 172.21.15.73:0/23971838 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa99006bf20 0x7fa97c0039a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:08.543 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:08.540+0000 7fa995169640 1 -- 172.21.15.73:0/23971838 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa97c004d00 msgr2=0x7fa97c005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:46:08.543 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:08.540+0000 7fa995169640 1 --2- 172.21.15.73:0/23971838 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa97c004d00 0x7fa97c005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:08.543 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:08.540+0000 7fa995169640 1 -- 172.21.15.73:0/23971838 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa97c003520 con 0x7fa97c003fd0 2023-12-12T09:46:08.543 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:08.540+0000 7fa99616b640 1 --2- 172.21.15.73:0/23971838 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa97c004d00 0x7fa97c005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:46:08.544 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:08.541+0000 7fa995169640 1 --2- 172.21.15.73:0/23971838 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa97c003fd0 0x7fa97c0047c0 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7fa980007fd0 tx=0x7fa97c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b714296a3d24b84 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:46:08.544 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:08.541+0000 7fa994968640 1 -- 172.21.15.73:0/23971838 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa980005ad0 con 0x7fa97c003fd0 2023-12-12T09:46:08.544 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:08.541+0000 7fa994968640 1 -- 172.21.15.73:0/23971838 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa980005c30 con 0x7fa97c003fd0 2023-12-12T09:46:08.544 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:08.541+0000 7fa994968640 1 -- 172.21.15.73:0/23971838 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa98002cab0 con 0x7fa97c003fd0 2023-12-12T09:46:08.545 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:08.542+0000 7fa997bce640 1 -- 172.21.15.73:0/23971838 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa97c003fd0 msgr2=0x7fa97c0047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:08.545 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:08.542+0000 7fa997bce640 1 --2- 172.21.15.73:0/23971838 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa97c003fd0 0x7fa97c0047c0 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7fa980007fd0 tx=0x7fa97c0057f0 comp rx=0 tx=0).stop 2023-12-12T09:46:08.545 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:08.542+0000 7fa99616b640 1 -- 172.21.15.73:0/23971838 reap_dead start 2023-12-12T09:46:08.545 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:08.542+0000 7fa997bce640 1 -- 172.21.15.73:0/23971838 shutdown_connections 2023-12-12T09:46:08.545 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:08.542+0000 7fa997bce640 1 -- 172.21.15.73:0/23971838 >> 172.21.15.73:0/23971838 conn(0x7fa9900a8130 msgr2=0x7fa9900c24b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:46:08.545 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:08.542+0000 7fa997bce640 1 -- 172.21.15.73:0/23971838 shutdown_connections 2023-12-12T09:46:08.545 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:08.542+0000 7fa997bce640 1 -- 172.21.15.73:0/23971838 wait complete. 2023-12-12T09:46:08.545 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:08.544+0000 7fa997bce640 1 Processor -- start 2023-12-12T09:46:08.546 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:08.544+0000 7fa997bce640 1 -- start start 2023-12-12T09:46:08.546 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:08.545+0000 7fa997bce640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa97c003fd0 0x7fa9901ea300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:08.547 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:08.545+0000 7fa997bce640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa990071930 0x7fa9901ee030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:08.547 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:08.545+0000 7fa997bce640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa9901ee570 0x7fa9900a3e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:08.547 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:08.545+0000 7fa997bce640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9900a68b0 con 0x7fa97c003fd0 2023-12-12T09:46:08.547 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:08.545+0000 7fa997bce640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9901edba0 con 0x7fa990071930 2023-12-12T09:46:08.547 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:08.545+0000 7fa997bce640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9901ed870 con 0x7fa9901ee570 2023-12-12T09:46:08.547 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:08.545+0000 7fa99596a640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa97c003fd0 0x7fa9901ea300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:08.547 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:08.545+0000 7fa99596a640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa97c003fd0 0x7fa9901ea300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:44792/0 (socket says 172.21.15.73:44792) 2023-12-12T09:46:08.547 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:08.545+0000 7fa99596a640 1 -- 172.21.15.73:0/4003739524 learned_addr learned my addr 172.21.15.73:0/4003739524 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:46:08.552 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:08.546+0000 7fa99596a640 1 -- 172.21.15.73:0/4003739524 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa9901ee570 msgr2=0x7fa9900a3e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:08.552 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:08.546+0000 7fa99596a640 1 --2- 172.21.15.73:0/4003739524 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa9901ee570 0x7fa9900a3e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:08.552 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:08.546+0000 7fa99596a640 1 -- 172.21.15.73:0/4003739524 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa990071930 msgr2=0x7fa9901ee030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:08.552 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:08.546+0000 7fa99596a640 1 --2- 172.21.15.73:0/4003739524 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa990071930 0x7fa9901ee030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:08.552 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:08.546+0000 7fa99596a640 1 -- 172.21.15.73:0/4003739524 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa990070430 con 0x7fa97c003fd0 2023-12-12T09:46:08.552 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:08.546+0000 7fa99596a640 1 --2- 172.21.15.73:0/4003739524 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa97c003fd0 0x7fa9901ea300 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7fa98c00e550 tx=0x7fa98c00ea10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:46:08.552 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:08.546+0000 7fa9867fc640 1 -- 172.21.15.73:0/4003739524 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa98c0052e0 con 0x7fa97c003fd0 2023-12-12T09:46:08.552 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:08.546+0000 7fa9867fc640 1 -- 172.21.15.73:0/4003739524 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa98c005440 con 0x7fa97c003fd0 2023-12-12T09:46:08.553 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:08.546+0000 7fa9867fc640 1 -- 172.21.15.73:0/4003739524 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa98c003810 con 0x7fa97c003fd0 2023-12-12T09:46:08.553 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:08.546+0000 7fa997bce640 1 -- 172.21.15.73:0/4003739524 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa990070710 con 0x7fa97c003fd0 2023-12-12T09:46:08.553 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:08.546+0000 7fa997bce640 1 -- 172.21.15.73:0/4003739524 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9900a4c00 con 0x7fa97c003fd0 2023-12-12T09:46:08.553 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:08.548+0000 7fa997bce640 1 -- 172.21.15.73:0/4003739524 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa990067580 con 0x7fa97c003fd0 2023-12-12T09:46:08.553 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:08.548+0000 7fa9867fc640 1 -- 172.21.15.73:0/4003739524 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fa98c003970 con 0x7fa97c003fd0 2023-12-12T09:46:08.553 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:08.549+0000 7fa9867fc640 1 --2- 172.21.15.73:0/4003739524 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fa97406ae40 0x7fa97406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:08.553 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:08.549+0000 7fa9867fc640 1 -- 172.21.15.73:0/4003739524 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5799+0+0 (secure 0 0 0) 0x7fa98c0893f0 con 0x7fa97c003fd0 2023-12-12T09:46:08.553 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:08.550+0000 7fa995169640 1 --2- 172.21.15.73:0/4003739524 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fa97406ae40 0x7fa97406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:08.553 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:08.550+0000 7fa995169640 1 --2- 172.21.15.73:0/4003739524 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fa97406ae40 0x7fa97406d300 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fa980034000 tx=0x7fa980039040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:46:08.556 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:08.554+0000 7fa9867fc640 1 -- 172.21.15.73:0/4003739524 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fa98c054440 con 0x7fa97c003fd0 2023-12-12T09:46:08.746 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:08.744+0000 7fa997bce640 1 -- 172.21.15.73:0/4003739524 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa99006ddd0 con 0x7fa97c003fd0 2023-12-12T09:46:08.748 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:08.747+0000 7fa9867fc640 1 -- 172.21.15.73:0/4003739524 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v61) v1 ==== 74+0+16711 (secure 0 0 0) 0x7fa98c057a60 con 0x7fa97c003fd0 2023-12-12T09:46:08.749 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-12T09:46:08.749 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":61,"fsid":"ba240992-02b8-4c7e-92f2-27eb29ac433b","created":"2023-12-12T09:43:02.454719+0000","modified":"2023-12-12T09:46:08.294831+0000","last_up_change":"2023-12-12T09:43:13.913440+0000","last_in_change":"2023-12-12T09:43:05.925348+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-12T09:43:15.525508+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs2_metadata","create_time":"2023-12-12T09:45:36.388393+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"57","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs2_data","create_time":"2023-12-12T09:45:37.109653+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"58","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"dd9074be-dbe2-4c34-9896-a4223d8d3940","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":4047810203},{"type":"v1","addr":"172.21.15.73:6801","nonce":4047810203}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":4047810203},{"type":"v1","addr":"172.21.15.73:6803","nonce":4047810203}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":4047810203},{"type":"v1","addr":"172.21.15.73:6807","nonce":4047810203}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":4047810203},{"type":"v1","addr":"172.21.15.73:6805","nonce":4047810203}]},"public_addr":"172.21.15.73:6801/4047810203","cluster_addr":"172.21.15.73:6803/4047810203","heartbeat_back_addr":"172.21.15.73:6807/4047810203","heartbeat_front_addr":"172.21.15.73:6805/4047810203","state":["exists","up"]},{"osd":1,"uuid":"c4a05052-96d4-4758-a4e1-1a37f1e07fed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":1356058331},{"type":"v1","addr":"172.21.15.73:6824","nonce":1356058331}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":1356058331},{"type":"v1","addr":"172.21.15.73:6827","nonce":1356058331}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":1356058331},{"type":"v1","addr":"172.21.15.73:6831","nonce":1356058331}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":1356058331},{"type":"v1","addr":"172.21.15.73:6829","nonce":1356058331}]},"public_addr":"172.21.15.73:6824/1356058331","cluster_addr":"172.21.15.73:6827/1356058331","heartbeat_back_addr":"172.21.15.73:6831/1356058331","heartbeat_front_addr":"172.21.15.73:6829/1356058331","state":["exists","up"]},{"osd":2,"uuid":"512bc8ac-72c2-40d4-b3d2-d867a92c5213","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":1228903316},{"type":"v1","addr":"172.21.15.73:6817","nonce":1228903316}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":1228903316},{"type":"v1","addr":"172.21.15.73:6819","nonce":1228903316}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6823","nonce":1228903316},{"type":"v1","addr":"172.21.15.73:6825","nonce":1228903316}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":1228903316},{"type":"v1","addr":"172.21.15.73:6821","nonce":1228903316}]},"public_addr":"172.21.15.73:6817/1228903316","cluster_addr":"172.21.15.73:6819/1228903316","heartbeat_back_addr":"172.21.15.73:6825/1228903316","heartbeat_front_addr":"172.21.15.73:6821/1228903316","state":["exists","up"]},{"osd":3,"uuid":"3d1a91e0-42bf-437a-8eae-8d357c8f63a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":1293329670},{"type":"v1","addr":"172.21.15.73:6809","nonce":1293329670}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6810","nonce":1293329670},{"type":"v1","addr":"172.21.15.73:6811","nonce":1293329670}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":1293329670},{"type":"v1","addr":"172.21.15.73:6815","nonce":1293329670}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":1293329670},{"type":"v1","addr":"172.21.15.73:6813","nonce":1293329670}]},"public_addr":"172.21.15.73:6809/1293329670","cluster_addr":"172.21.15.73:6811/1293329670","heartbeat_back_addr":"172.21.15.73:6815/1293329670","heartbeat_front_addr":"172.21.15.73:6813/1293329670","state":["exists","up"]},{"osd":4,"uuid":"4b302fff-834c-4069-ac19-00e46f6c87b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":3727975702},{"type":"v1","addr":"172.21.15.142:6801","nonce":3727975702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":3727975702},{"type":"v1","addr":"172.21.15.142:6803","nonce":3727975702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6809","nonce":3727975702},{"type":"v1","addr":"172.21.15.142:6811","nonce":3727975702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6805","nonce":3727975702},{"type":"v1","addr":"172.21.15.142:6807","nonce":3727975702}]},"public_addr":"172.21.15.142:6801/3727975702","cluster_addr":"172.21.15.142:6803/3727975702","heartbeat_back_addr":"172.21.15.142:6811/3727975702","heartbeat_front_addr":"172.21.15.142:6807/3727975702","state":["exists","up"]},{"osd":5,"uuid":"d7cdace2-67d0-45cc-95f2-515cf6ef1b82","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6817","nonce":2353193632},{"type":"v1","addr":"172.21.15.142:6819","nonce":2353193632}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6821","nonce":2353193632},{"type":"v1","addr":"172.21.15.142:6823","nonce":2353193632}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6829","nonce":2353193632},{"type":"v1","addr":"172.21.15.142:6831","nonce":2353193632}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6825","nonce":2353193632},{"type":"v1","addr":"172.21.15.142:6827","nonce":2353193632}]},"public_addr":"172.21.15.142:6819/2353193632","cluster_addr":"172.21.15.142:6823/2353193632","heartbeat_back_addr":"172.21.15.142:6831/2353193632","heartbeat_front_addr":"172.21.15.142:6827/2353193632","state":["exists","up"]},{"osd":6,"uuid":"649ce78a-5626-445c-aedc-a651ed05a6f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":2006111986},{"type":"v1","addr":"172.21.15.142:6806","nonce":2006111986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":2006111986},{"type":"v1","addr":"172.21.15.142:6810","nonce":2006111986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":2006111986},{"type":"v1","addr":"172.21.15.142:6815","nonce":2006111986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":2006111986},{"type":"v1","addr":"172.21.15.142:6813","nonce":2006111986}]},"public_addr":"172.21.15.142:6806/2006111986","cluster_addr":"172.21.15.142:6810/2006111986","heartbeat_back_addr":"172.21.15.142:6815/2006111986","heartbeat_front_addr":"172.21.15.142:6813/2006111986","state":["exists","up"]},{"osd":7,"uuid":"af15ae3b-c1d0-4acf-92db-8a1805494d13","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":2573794341},{"type":"v1","addr":"172.21.15.142:6818","nonce":2573794341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":2573794341},{"type":"v1","addr":"172.21.15.142:6822","nonce":2573794341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":2573794341},{"type":"v1","addr":"172.21.15.142:6830","nonce":2573794341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":2573794341},{"type":"v1","addr":"172.21.15.142:6826","nonce":2573794341}]},"public_addr":"172.21.15.142:6818/2573794341","cluster_addr":"172.21.15.142:6822/2573794341","heartbeat_back_addr":"172.21.15.142:6830/2573794341","heartbeat_front_addr":"172.21.15.142:6826/2573794341","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.185824+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.262103+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.225556+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:10.523459+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:10.706035+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.257339+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.301776+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.051960+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.73:6835/744058726":"2023-12-13T09:46:05.274143+0000","172.21.15.73:6834/744058726":"2023-12-13T09:46:05.274143+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-12T09:46:08.754 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:08.750+0000 7fa997bce640 1 -- 172.21.15.73:0/4003739524 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fa97406ae40 msgr2=0x7fa97406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:08.754 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:08.750+0000 7fa997bce640 1 --2- 172.21.15.73:0/4003739524 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fa97406ae40 0x7fa97406d300 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fa980034000 tx=0x7fa980039040 comp rx=0 tx=0).stop 2023-12-12T09:46:08.755 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:08.750+0000 7fa997bce640 1 -- 172.21.15.73:0/4003739524 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa97c003fd0 msgr2=0x7fa9901ea300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:08.755 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:08.750+0000 7fa997bce640 1 --2- 172.21.15.73:0/4003739524 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa97c003fd0 0x7fa9901ea300 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7fa98c00e550 tx=0x7fa98c00ea10 comp rx=0 tx=0).stop 2023-12-12T09:46:08.755 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:08.750+0000 7fa997bce640 1 -- 172.21.15.73:0/4003739524 shutdown_connections 2023-12-12T09:46:08.755 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:08.750+0000 7fa997bce640 1 --2- 172.21.15.73:0/4003739524 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fa97406ae40 0x7fa97406d300 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:08.755 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:08.750+0000 7fa997bce640 1 --2- 172.21.15.73:0/4003739524 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa9901ee570 0x7fa9900a3e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:08.755 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:08.750+0000 7fa997bce640 1 --2- 172.21.15.73:0/4003739524 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa990071930 0x7fa9901ee030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:08.755 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:08.750+0000 7fa997bce640 1 --2- 172.21.15.73:0/4003739524 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa97c003fd0 0x7fa9901ea300 unknown :-1 s=CLOSED pgs=788 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:08.755 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:08.750+0000 7fa997bce640 1 -- 172.21.15.73:0/4003739524 >> 172.21.15.73:0/4003739524 conn(0x7fa9900a8130 msgr2=0x7fa9900c38b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:46:08.755 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:08.750+0000 7fa997bce640 1 -- 172.21.15.73:0/4003739524 shutdown_connections 2023-12-12T09:46:08.755 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:08.750+0000 7fa997bce640 1 -- 172.21.15.73:0/4003739524 wait complete. 2023-12-12T09:46:08.771 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-12T09:43:15.525508+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 10, 'pool_name': 'cephfs2_metadata', 'create_time': '2023-12-12T09:45:36.388393+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '57', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs2'}}, 'read_balance': {'score_acting': 2.5, 'score_stable': 2.5, 'optimal_score': 1, 'raw_score_acting': 2.5, 'raw_score_stable': 2.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 11, 'pool_name': 'cephfs2_data', 'create_time': '2023-12-12T09:45:37.109653+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '58', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs2'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-12T09:46:08.771 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-12T09:46:08.980 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:08.979+0000 7fd02b0da640 1 Processor -- start 2023-12-12T09:46:08.981 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:08.979+0000 7fd02b0da640 1 -- start start 2023-12-12T09:46:08.982 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:08.980+0000 7fd02b0da640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fd0240c3930 0x7fd02406d440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:08.982 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:08.980+0000 7fd02b0da640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0241582e0 con 0x7fd024151c30 2023-12-12T09:46:08.982 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:08.980+0000 7fd02b0da640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0240a4f50 con 0x7fd0240bed50 2023-12-12T09:46:08.982 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:08.980+0000 7fd02b0da640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0240a54d0 con 0x7fd0240c3930 2023-12-12T09:46:08.982 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:08.981+0000 7fd023fff640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fd0240c3930 0x7fd02406d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:08.982 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:08.981+0000 7fd028e76640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7fd024151c30 0x7fd024157bd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:52514/0 (socket says 172.21.15.73:52514) 2023-12-12T09:46:08.983 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:08.981+0000 7fd028e76640 1 -- 172.21.15.73:0/2024368712 learned_addr learned my addr 172.21.15.73:0/2024368712 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-12T09:46:08.983 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:08.981+0000 7fd023fff640 1 -- 172.21.15.73:0/2024368712 >> v1:172.21.15.142:6789/0 conn(0x7fd0240bed50 legacy=0x7fd0240bf160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:46:08.983 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:08.981+0000 7fd023fff640 1 -- 172.21.15.73:0/2024368712 >> v1:172.21.15.73:6789/0 conn(0x7fd024151c30 legacy=0x7fd024157bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:08.983 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:08.981+0000 7fd0237fe640 1 -- 172.21.15.73:0/2024368712 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4076154120 0 0) 0x7fd0241582e0 con 0x7fd024151c30 2023-12-12T09:46:08.983 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:08.981+0000 7fd023fff640 1 -- 172.21.15.73:0/2024368712 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd024155260 con 0x7fd0240c3930 2023-12-12T09:46:08.984 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:08.983+0000 7fd023fff640 1 --2- 172.21.15.73:0/2024368712 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd0240c3930 0x7fd02406d440 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7fd0100097a0 tx=0x7fd01002b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68f7843500350a3c server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:46:08.984 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:08.983+0000 7fd0237fe640 1 -- 172.21.15.73:0/2024368712 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd01002e070 con 0x7fd0240c3930 2023-12-12T09:46:08.984 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:08.983+0000 7fd0237fe640 1 -- 172.21.15.73:0/2024368712 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0100315a0 con 0x7fd0240c3930 2023-12-12T09:46:08.984 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:08.983+0000 7fd0237fe640 1 -- 172.21.15.73:0/2024368712 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd010031930 con 0x7fd0240c3930 2023-12-12T09:46:08.985 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:08.983+0000 7fd02b0da640 1 -- 172.21.15.73:0/2024368712 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd0240c3930 msgr2=0x7fd02406d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:08.985 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:08.983+0000 7fd02b0da640 1 --2- 172.21.15.73:0/2024368712 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd0240c3930 0x7fd02406d440 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7fd0100097a0 tx=0x7fd01002b840 comp rx=0 tx=0).stop 2023-12-12T09:46:08.985 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:08.984+0000 7fd02b0da640 1 -- 172.21.15.73:0/2024368712 shutdown_connections 2023-12-12T09:46:08.985 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:08.984+0000 7fd02b0da640 1 --2- 172.21.15.73:0/2024368712 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd0240c3930 0x7fd02406d440 unknown :-1 s=CLOSED pgs=790 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:08.985 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:08.984+0000 7fd02b0da640 1 -- 172.21.15.73:0/2024368712 >> 172.21.15.73:0/2024368712 conn(0x7fd02406a4e0 msgr2=0x7fd02406a8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:46:08.985 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:08.984+0000 7fd02b0da640 1 -- 172.21.15.73:0/2024368712 shutdown_connections 2023-12-12T09:46:08.985 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:08.984+0000 7fd02b0da640 1 -- 172.21.15.73:0/2024368712 wait complete. 2023-12-12T09:46:08.987 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:08.985+0000 7fd02b0da640 1 Processor -- start 2023-12-12T09:46:08.987 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:08.986+0000 7fd02b0da640 1 -- start start 2023-12-12T09:46:08.989 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:08.987+0000 7fd02b0da640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd0240bed50 0x7fd02414df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:08.989 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:08.987+0000 7fd02b0da640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd0240c3930 0x7fd0241ed2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:08.989 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:08.987+0000 7fd02b0da640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd024151c30 0x7fd0241ed800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:08.989 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:08.987+0000 7fd02b0da640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd02406ff00 con 0x7fd0240c3930 2023-12-12T09:46:08.989 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:08.987+0000 7fd02b0da640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd024152930 con 0x7fd0240bed50 2023-12-12T09:46:08.989 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:08.987+0000 7fd02b0da640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0240726d0 con 0x7fd024151c30 2023-12-12T09:46:08.989 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:08.987+0000 7fd023fff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd0240c3930 0x7fd0241ed2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:08.989 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:08.987+0000 7fd023fff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd0240c3930 0x7fd0241ed2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:55380/0 (socket says 172.21.15.73:55380) 2023-12-12T09:46:08.989 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:08.987+0000 7fd023fff640 1 -- 172.21.15.73:0/3399610877 learned_addr learned my addr 172.21.15.73:0/3399610877 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:46:08.989 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:08.987+0000 7fd023fff640 1 -- 172.21.15.73:0/3399610877 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd024151c30 msgr2=0x7fd0241ed800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:08.989 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:08.987+0000 7fd023fff640 1 --2- 172.21.15.73:0/3399610877 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd024151c30 0x7fd0241ed800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:08.989 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:08.987+0000 7fd023fff640 1 -- 172.21.15.73:0/3399610877 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd0240bed50 msgr2=0x7fd02414df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:08.990 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:08.987+0000 7fd023fff640 1 --2- 172.21.15.73:0/3399610877 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd0240bed50 0x7fd02414df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:08.990 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:08.987+0000 7fd023fff640 1 -- 172.21.15.73:0/3399610877 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd010009400 con 0x7fd0240c3930 2023-12-12T09:46:08.990 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:08.988+0000 7fd023fff640 1 --2- 172.21.15.73:0/3399610877 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd0240c3930 0x7fd0241ed2c0 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7fd0100097a0 tx=0x7fd0100046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:46:08.990 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:08.988+0000 7fd0217fa640 1 -- 172.21.15.73:0/3399610877 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd010004230 con 0x7fd0240c3930 2023-12-12T09:46:08.991 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:08.988+0000 7fd0217fa640 1 -- 172.21.15.73:0/3399610877 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0100043b0 con 0x7fd0240c3930 2023-12-12T09:46:08.991 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:08.988+0000 7fd02b0da640 1 -- 172.21.15.73:0/3399610877 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd024152650 con 0x7fd0240c3930 2023-12-12T09:46:08.991 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:08.988+0000 7fd0217fa640 1 -- 172.21.15.73:0/3399610877 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd010004520 con 0x7fd0240c3930 2023-12-12T09:46:08.991 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:08.988+0000 7fd02b0da640 1 -- 172.21.15.73:0/3399610877 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd02414e4c0 con 0x7fd0240c3930 2023-12-12T09:46:08.991 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:08.989+0000 7fd02b0da640 1 -- 172.21.15.73:0/3399610877 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd024072530 con 0x7fd0240c3930 2023-12-12T09:46:08.991 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:08.990+0000 7fd0217fa640 1 -- 172.21.15.73:0/3399610877 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fd010032880 con 0x7fd0240c3930 2023-12-12T09:46:08.992 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:08.991+0000 7fd0217fa640 1 --2- 172.21.15.73:0/3399610877 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fd00806ae70 0x7fd00806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:08.992 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:08.991+0000 7fd0217fa640 1 -- 172.21.15.73:0/3399610877 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5799+0+0 (secure 0 0 0) 0x7fd0100ab820 con 0x7fd0240c3930 2023-12-12T09:46:08.992 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:08.991+0000 7fd028e76640 1 --2- 172.21.15.73:0/3399610877 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fd00806ae70 0x7fd00806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:08.993 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:08.992+0000 7fd028e76640 1 --2- 172.21.15.73:0/3399610877 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fd00806ae70 0x7fd00806d330 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fd018007fd0 tx=0x7fd018007960 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:46:08.996 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:08.995+0000 7fd0217fa640 1 -- 172.21.15.73:0/3399610877 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fd024072530 con 0x7fd0240c3930 2023-12-12T09:46:09.188 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:09.186+0000 7fd02b0da640 1 -- 172.21.15.73:0/3399610877 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fd024072530 con 0x7fd0240c3930 2023-12-12T09:46:09.188 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:09.187+0000 7fd0217fa640 1 -- 172.21.15.73:0/3399610877 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v61) v1 ==== 93+0+10 (secure 0 0 0) 0x7fd024072530 con 0x7fd0240c3930 2023-12-12T09:46:09.189 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 1 2023-12-12T09:46:09.191 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:09.189+0000 7fd02b0da640 1 -- 172.21.15.73:0/3399610877 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fd00806ae70 msgr2=0x7fd00806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:09.191 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:09.189+0000 7fd02b0da640 1 --2- 172.21.15.73:0/3399610877 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fd00806ae70 0x7fd00806d330 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fd018007fd0 tx=0x7fd018007960 comp rx=0 tx=0).stop 2023-12-12T09:46:09.191 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:09.189+0000 7fd02b0da640 1 -- 172.21.15.73:0/3399610877 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd0240c3930 msgr2=0x7fd0241ed2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:09.191 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:09.189+0000 7fd02b0da640 1 --2- 172.21.15.73:0/3399610877 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd0240c3930 0x7fd0241ed2c0 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7fd0100097a0 tx=0x7fd0100046c0 comp rx=0 tx=0).stop 2023-12-12T09:46:09.191 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:09.190+0000 7fd02b0da640 1 -- 172.21.15.73:0/3399610877 shutdown_connections 2023-12-12T09:46:09.192 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:09.190+0000 7fd02b0da640 1 --2- 172.21.15.73:0/3399610877 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fd00806ae70 0x7fd00806d330 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:09.192 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:09.190+0000 7fd02b0da640 1 --2- 172.21.15.73:0/3399610877 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd024151c30 0x7fd0241ed800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:09.192 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:09.190+0000 7fd02b0da640 1 --2- 172.21.15.73:0/3399610877 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd0240c3930 0x7fd0241ed2c0 unknown :-1 s=CLOSED pgs=791 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:09.192 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:09.190+0000 7fd02b0da640 1 --2- 172.21.15.73:0/3399610877 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd0240bed50 0x7fd02414df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:09.192 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:09.190+0000 7fd02b0da640 1 -- 172.21.15.73:0/3399610877 >> 172.21.15.73:0/3399610877 conn(0x7fd02406a4e0 msgr2=0x7fd0240c4c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:46:09.192 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:09.190+0000 7fd02b0da640 1 -- 172.21.15.73:0/3399610877 shutdown_connections 2023-12-12T09:46:09.192 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:09.190+0000 7fd02b0da640 1 -- 172.21.15.73:0/3399610877 wait complete. 2023-12-12T09:46:09.211 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_metadata pg_num 2023-12-12T09:46:09.427 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:09.426+0000 7f0f4ae02640 1 Processor -- start 2023-12-12T09:46:09.427 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:09.426+0000 7f0f4ae02640 1 -- start start 2023-12-12T09:46:09.429 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:09.427+0000 7f0f4ae02640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0f440a4c90 0x7f0f440c5420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:09.429 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:09.427+0000 7f0f4ae02640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f0f440c0320 0x7f0f440c20b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:09.430 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:09.427+0000 7f0f4ae02640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f440c3390 con 0x7f0f4414ea60 2023-12-12T09:46:09.430 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:09.427+0000 7f0f4ae02640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f440c4b30 con 0x7f0f440c0320 2023-12-12T09:46:09.430 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:09.427+0000 7f0f4ae02640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f44151e60 con 0x7f0f440a4c90 2023-12-12T09:46:09.430 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:09.428+0000 7f0f4939f640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f0f440c0320 0x7f0f440c20b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:09.430 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:09.428+0000 7f0f4939f640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f0f440c0320 0x7f0f440c20b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:55388/0 (socket says 172.21.15.73:55388) 2023-12-12T09:46:09.430 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:09.428+0000 7f0f4939f640 1 -- 172.21.15.73:0/3148986839 learned_addr learned my addr 172.21.15.73:0/3148986839 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:46:09.430 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:09.428+0000 7f0f4939f640 1 -- 172.21.15.73:0/3148986839 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0f440a4c90 msgr2=0x7f0f440c5420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:46:09.430 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:09.428+0000 7f0f4939f640 1 --2- 172.21.15.73:0/3148986839 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0f440a4c90 0x7f0f440c5420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:09.430 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:09.428+0000 7f0f4939f640 1 -- 172.21.15.73:0/3148986839 >> v1:172.21.15.142:6789/0 conn(0x7f0f4414ea60 legacy=0x7f0f440c4420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:46:09.430 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:09.428+0000 7f0f4939f640 1 -- 172.21.15.73:0/3148986839 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f44152140 con 0x7f0f440c0320 2023-12-12T09:46:09.431 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:09.429+0000 7f0f4939f640 1 --2- 172.21.15.73:0/3148986839 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0f440c0320 0x7f0f440c20b0 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7f0f3c009e50 tx=0x7f0f3c02be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f8b7091d8eb9efd server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:46:09.431 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:09.430+0000 7f0f437fe640 1 -- 172.21.15.73:0/3148986839 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f3c02c9e0 con 0x7f0f440c0320 2023-12-12T09:46:09.431 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:09.430+0000 7f0f437fe640 1 -- 172.21.15.73:0/3148986839 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f3c02cb40 con 0x7f0f440c0320 2023-12-12T09:46:09.431 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:09.430+0000 7f0f437fe640 1 -- 172.21.15.73:0/3148986839 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f3c0343f0 con 0x7f0f440c0320 2023-12-12T09:46:09.432 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:09.430+0000 7f0f4ae02640 1 -- 172.21.15.73:0/3148986839 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0f440c0320 msgr2=0x7f0f440c20b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:09.432 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:09.430+0000 7f0f4ae02640 1 --2- 172.21.15.73:0/3148986839 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0f440c0320 0x7f0f440c20b0 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7f0f3c009e50 tx=0x7f0f3c02be40 comp rx=0 tx=0).stop 2023-12-12T09:46:09.432 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:09.430+0000 7f0f4ae02640 1 -- 172.21.15.73:0/3148986839 shutdown_connections 2023-12-12T09:46:09.432 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:09.430+0000 7f0f4ae02640 1 --2- 172.21.15.73:0/3148986839 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0f440c0320 0x7f0f440c20b0 unknown :-1 s=CLOSED pgs=792 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:09.432 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:09.430+0000 7f0f4ae02640 1 --2- 172.21.15.73:0/3148986839 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0f440a4c90 0x7f0f440c5420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:09.432 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:09.430+0000 7f0f4ae02640 1 -- 172.21.15.73:0/3148986839 >> 172.21.15.73:0/3148986839 conn(0x7f0f4406a4e0 msgr2=0x7f0f4406a8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:46:09.432 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:09.431+0000 7f0f4ae02640 1 -- 172.21.15.73:0/3148986839 shutdown_connections 2023-12-12T09:46:09.432 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:09.431+0000 7f0f4ae02640 1 -- 172.21.15.73:0/3148986839 wait complete. 2023-12-12T09:46:09.433 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:09.432+0000 7f0f4ae02640 1 Processor -- start 2023-12-12T09:46:09.434 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:09.432+0000 7f0f4ae02640 1 -- start start 2023-12-12T09:46:09.435 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:09.433+0000 7f0f4ae02640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0f440a4c90 0x7f0f440a5eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:09.436 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:09.433+0000 7f0f4ae02640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0f440c0320 0x7f0f441eb2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:09.436 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:09.433+0000 7f0f4ae02640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0f4414ea60 0x7f0f441dda60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:09.436 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:09.433+0000 7f0f4ae02640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f4414dbf0 con 0x7f0f440a4c90 2023-12-12T09:46:09.436 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:09.433+0000 7f0f4ae02640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f441eb7f0 con 0x7f0f440c0320 2023-12-12T09:46:09.436 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:09.433+0000 7f0f4ae02640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f441500c0 con 0x7f0f4414ea60 2023-12-12T09:46:09.436 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:09.433+0000 7f0f48b9e640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0f440a4c90 0x7f0f440a5eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:09.436 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:09.434+0000 7f0f48b9e640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0f440a4c90 0x7f0f440a5eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:55398/0 (socket says 172.21.15.73:55398) 2023-12-12T09:46:09.436 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:09.434+0000 7f0f48b9e640 1 -- 172.21.15.73:0/2712288134 learned_addr learned my addr 172.21.15.73:0/2712288134 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:46:09.436 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:09.434+0000 7f0f4939f640 1 --2- 172.21.15.73:0/2712288134 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0f4414ea60 0x7f0f441dda60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:09.436 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:09.434+0000 7f0f48b9e640 1 -- 172.21.15.73:0/2712288134 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0f4414ea60 msgr2=0x7f0f441dda60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:09.436 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:09.434+0000 7f0f48b9e640 1 --2- 172.21.15.73:0/2712288134 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0f4414ea60 0x7f0f441dda60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:09.436 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:09.434+0000 7f0f48b9e640 1 -- 172.21.15.73:0/2712288134 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0f440c0320 msgr2=0x7f0f441eb2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:09.436 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:09.434+0000 7f0f43fff640 1 --2- 172.21.15.73:0/2712288134 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0f440c0320 0x7f0f441eb2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:09.436 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:09.434+0000 7f0f48b9e640 1 --2- 172.21.15.73:0/2712288134 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0f440c0320 0x7f0f441eb2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:09.437 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:09.434+0000 7f0f48b9e640 1 -- 172.21.15.73:0/2712288134 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f3c009b30 con 0x7f0f440a4c90 2023-12-12T09:46:09.437 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:09.434+0000 7f0f4939f640 1 --2- 172.21.15.73:0/2712288134 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0f4414ea60 0x7f0f441dda60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:46:09.437 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:09.434+0000 7f0f48b9e640 1 --2- 172.21.15.73:0/2712288134 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0f440a4c90 0x7f0f440a5eb0 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7f0f3800b3e0 tx=0x7f0f3800b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:46:09.438 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:09.435+0000 7f0f417fa640 1 -- 172.21.15.73:0/2712288134 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f38011830 con 0x7f0f440a4c90 2023-12-12T09:46:09.438 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:09.435+0000 7f0f417fa640 1 -- 172.21.15.73:0/2712288134 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f380119b0 con 0x7f0f440a4c90 2023-12-12T09:46:09.438 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:09.435+0000 7f0f417fa640 1 -- 172.21.15.73:0/2712288134 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f38011d60 con 0x7f0f440a4c90 2023-12-12T09:46:09.438 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:09.435+0000 7f0f4ae02640 1 -- 172.21.15.73:0/2712288134 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f4414bd40 con 0x7f0f440a4c90 2023-12-12T09:46:09.438 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:09.435+0000 7f0f4ae02640 1 -- 172.21.15.73:0/2712288134 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f4414c300 con 0x7f0f440a4c90 2023-12-12T09:46:09.438 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:09.436+0000 7f0f4ae02640 1 -- 172.21.15.73:0/2712288134 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f44067070 con 0x7f0f440a4c90 2023-12-12T09:46:09.438 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:09.437+0000 7f0f417fa640 1 -- 172.21.15.73:0/2712288134 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f0f3801a410 con 0x7f0f440a4c90 2023-12-12T09:46:09.439 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:09.438+0000 7f0f417fa640 1 --2- 172.21.15.73:0/2712288134 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f0f2806aec0 0x7f0f2806d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:09.439 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:09.438+0000 7f0f417fa640 1 -- 172.21.15.73:0/2712288134 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 5857+0+0 (secure 0 0 0) 0x7f0f38089110 con 0x7f0f440a4c90 2023-12-12T09:46:09.439 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:09.438+0000 7f0f43fff640 1 --2- 172.21.15.73:0/2712288134 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f0f2806aec0 0x7f0f2806d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:09.440 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:09.439+0000 7f0f43fff640 1 --2- 172.21.15.73:0/2712288134 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f0f2806aec0 0x7f0f2806d380 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f0f4404f290 tx=0x7f0f30008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:46:09.443 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:09.442+0000 7f0f417fa640 1 -- 172.21.15.73:0/2712288134 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f0f38054290 con 0x7f0f440a4c90 2023-12-12T09:46:09.637 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:09.635+0000 7f0f4ae02640 1 -- 172.21.15.73:0/2712288134 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"} v 0) v1 -- 0x7f0f44067580 con 0x7f0f440a4c90 2023-12-12T09:46:09.637 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:09.636+0000 7f0f417fa640 1 -- 172.21.15.73:0/2712288134 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"}]=0 v62) v1 ==== 105+0+11 (secure 0 0 0) 0x7f0f380578b0 con 0x7f0f440a4c90 2023-12-12T09:46:09.638 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 32 2023-12-12T09:46:09.640 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:09.639+0000 7f0f4ae02640 1 -- 172.21.15.73:0/2712288134 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f0f2806aec0 msgr2=0x7f0f2806d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:09.640 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:09.639+0000 7f0f4ae02640 1 --2- 172.21.15.73:0/2712288134 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f0f2806aec0 0x7f0f2806d380 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f0f4404f290 tx=0x7f0f30008040 comp rx=0 tx=0).stop 2023-12-12T09:46:09.640 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:09.639+0000 7f0f4ae02640 1 -- 172.21.15.73:0/2712288134 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0f440a4c90 msgr2=0x7f0f440a5eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:09.640 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:09.639+0000 7f0f4ae02640 1 --2- 172.21.15.73:0/2712288134 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0f440a4c90 0x7f0f440a5eb0 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7f0f3800b3e0 tx=0x7f0f3800b8a0 comp rx=0 tx=0).stop 2023-12-12T09:46:09.640 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:09.639+0000 7f0f4ae02640 1 -- 172.21.15.73:0/2712288134 shutdown_connections 2023-12-12T09:46:09.640 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:09.639+0000 7f0f4ae02640 1 --2- 172.21.15.73:0/2712288134 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f0f2806aec0 0x7f0f2806d380 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:09.641 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:09.639+0000 7f0f4ae02640 1 --2- 172.21.15.73:0/2712288134 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0f4414ea60 0x7f0f441dda60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:09.641 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:09.639+0000 7f0f4ae02640 1 --2- 172.21.15.73:0/2712288134 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0f440c0320 0x7f0f441eb2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:09.641 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:09.639+0000 7f0f4ae02640 1 --2- 172.21.15.73:0/2712288134 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0f440a4c90 0x7f0f440a5eb0 unknown :-1 s=CLOSED pgs=793 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:09.641 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:09.639+0000 7f0f4ae02640 1 -- 172.21.15.73:0/2712288134 >> 172.21.15.73:0/2712288134 conn(0x7f0f4406a4e0 msgr2=0x7f0f4406a8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:46:09.641 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:09.639+0000 7f0f4ae02640 1 -- 172.21.15.73:0/2712288134 shutdown_connections 2023-12-12T09:46:09.641 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:09.639+0000 7f0f4ae02640 1 -- 172.21.15.73:0/2712288134 wait complete. 2023-12-12T09:46:09.660 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_data pg_num 2023-12-12T09:46:09.873 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:09.871+0000 7f478026b640 1 Processor -- start 2023-12-12T09:46:09.873 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:09.871+0000 7f478026b640 1 -- start start 2023-12-12T09:46:09.875 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:09.873+0000 7f478026b640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f477814ea60 0x7f47780c5420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:09.875 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:09.873+0000 7f478026b640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f47780a4c90 0x7f47780c0320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:09.875 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:09.873+0000 7f478026b640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47780c3390 con 0x7f47780c4420 2023-12-12T09:46:09.875 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:09.873+0000 7f478026b640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4778151e60 con 0x7f477814ea60 2023-12-12T09:46:09.875 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:09.873+0000 7f478026b640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4778152140 con 0x7f47780a4c90 2023-12-12T09:46:09.875 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:09.873+0000 7f477e808640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f47780c4420 0x7f47780c20b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:52516/0 (socket says 172.21.15.73:52516) 2023-12-12T09:46:09.875 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:09.873+0000 7f477e808640 1 -- 172.21.15.73:0/3066776975 learned_addr learned my addr 172.21.15.73:0/3066776975 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-12T09:46:09.875 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:09.873+0000 7f477e007640 1 --2- 172.21.15.73:0/3066776975 >> v2:172.21.15.142:3300/0 conn(0x7f477814ea60 0x7f47780c5420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:09.875 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:09.873+0000 7f477d806640 1 --2- 172.21.15.73:0/3066776975 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f47780a4c90 0x7f47780c0320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:09.876 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:09.874+0000 7f477d005640 1 -- 172.21.15.73:0/3066776975 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2047101277 0 0) 0x7f47780c3390 con 0x7f47780c4420 2023-12-12T09:46:09.876 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:09.874+0000 7f477d005640 1 -- 172.21.15.73:0/3066776975 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4764005730 con 0x7f47780c4420 2023-12-12T09:46:09.878 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:09.874+0000 7f477d005640 1 -- 172.21.15.73:0/3066776975 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4043933468 0 0) 0x7f4764005730 con 0x7f47780c4420 2023-12-12T09:46:09.878 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:09.874+0000 7f477d005640 1 -- 172.21.15.73:0/3066776975 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f47780a4c90 msgr2=0x7f47780c0320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:46:09.878 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:09.874+0000 7f477d005640 1 --2- 172.21.15.73:0/3066776975 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f47780a4c90 0x7f47780c0320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:09.878 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:09.874+0000 7f477d005640 1 -- 172.21.15.73:0/3066776975 >> v2:172.21.15.142:3300/0 conn(0x7f477814ea60 msgr2=0x7f47780c5420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:46:09.878 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:09.874+0000 7f477d005640 1 --2- 172.21.15.73:0/3066776975 >> v2:172.21.15.142:3300/0 conn(0x7f477814ea60 0x7f47780c5420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:09.878 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:09.874+0000 7f477d005640 1 -- 172.21.15.73:0/3066776975 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47780c3940 con 0x7f47780c4420 2023-12-12T09:46:09.878 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:09.874+0000 7f477d005640 1 -- 172.21.15.73:0/3066776975 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3186547832 0 0) 0x7f47700019f0 con 0x7f47780c4420 2023-12-12T09:46:09.879 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:09.874+0000 7f477d005640 1 -- 172.21.15.73:0/3066776975 >> v1:172.21.15.73:6789/0 conn(0x7f47780c4420 legacy=0x7f47780c20b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:09.879 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:09.874+0000 7f477d005640 1 --2- 172.21.15.73:0/3066776975 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4764005b80 0x7f4764005fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:09.879 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:09.874+0000 7f477d005640 1 --2- 172.21.15.73:0/3066776975 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f47780a4c90 0x7f47640069d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:09.879 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:09.874+0000 7f477d005640 1 --2- 172.21.15.73:0/3066776975 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4764006f10 0x7f4764007390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:09.879 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:09.874+0000 7f477d005640 1 -- 172.21.15.73:0/3066776975 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4778151e60 con 0x7f4764006f10 2023-12-12T09:46:09.879 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:09.874+0000 7f477d005640 1 -- 172.21.15.73:0/3066776975 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4778152140 con 0x7f4764005b80 2023-12-12T09:46:09.879 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:09.874+0000 7f477d005640 1 -- 172.21.15.73:0/3066776975 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f476400db90 con 0x7f47780a4c90 2023-12-12T09:46:09.879 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:09.874+0000 7f477e808640 1 --2- 172.21.15.73:0/3066776975 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4764006f10 0x7f4764007390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:09.879 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:09.875+0000 7f477e007640 1 --2- 172.21.15.73:0/3066776975 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4764005b80 0x7f4764005fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:09.879 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:09.875+0000 7f477d806640 1 --2- 172.21.15.73:0/3066776975 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f47780a4c90 0x7f47640069d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:09.879 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:09.875+0000 7f477e808640 1 -- 172.21.15.73:0/3066776975 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f47780a4c90 msgr2=0x7f47640069d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:46:09.879 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:09.875+0000 7f477e808640 1 --2- 172.21.15.73:0/3066776975 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f47780a4c90 0x7f47640069d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:09.879 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:09.875+0000 7f477e808640 1 -- 172.21.15.73:0/3066776975 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4764005b80 msgr2=0x7f4764005fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:46:09.880 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:09.875+0000 7f477e808640 1 --2- 172.21.15.73:0/3066776975 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4764005b80 0x7f4764005fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:09.880 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:09.875+0000 7f477e808640 1 -- 172.21.15.73:0/3066776975 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4764005730 con 0x7f4764006f10 2023-12-12T09:46:09.880 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:09.875+0000 7f477e007640 1 --2- 172.21.15.73:0/3066776975 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4764005b80 0x7f4764005fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:46:09.880 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:09.876+0000 7f477e808640 1 --2- 172.21.15.73:0/3066776975 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4764006f10 0x7f4764007390 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7f477000a860 tx=0x7f4764007a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e6c9e262058cbb server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:46:09.880 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:09.876+0000 7f477d005640 1 -- 172.21.15.73:0/3066776975 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4770034630 con 0x7f4764006f10 2023-12-12T09:46:09.880 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:09.876+0000 7f477d005640 1 -- 172.21.15.73:0/3066776975 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f477002f070 con 0x7f4764006f10 2023-12-12T09:46:09.880 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:09.876+0000 7f477d005640 1 -- 172.21.15.73:0/3066776975 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47700349f0 con 0x7f4764006f10 2023-12-12T09:46:09.880 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:09.877+0000 7f478026b640 1 -- 172.21.15.73:0/3066776975 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4764006f10 msgr2=0x7f4764007390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:09.881 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:09.877+0000 7f478026b640 1 --2- 172.21.15.73:0/3066776975 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4764006f10 0x7f4764007390 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7f477000a860 tx=0x7f4764007a00 comp rx=0 tx=0).stop 2023-12-12T09:46:09.881 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:09.877+0000 7f477e808640 1 -- 172.21.15.73:0/3066776975 reap_dead start 2023-12-12T09:46:09.881 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:09.877+0000 7f478026b640 1 -- 172.21.15.73:0/3066776975 shutdown_connections 2023-12-12T09:46:09.881 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:09.877+0000 7f478026b640 1 -- 172.21.15.73:0/3066776975 >> 172.21.15.73:0/3066776975 conn(0x7f477806a4e0 msgr2=0x7f477806a8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:46:09.881 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:09.877+0000 7f478026b640 1 -- 172.21.15.73:0/3066776975 shutdown_connections 2023-12-12T09:46:09.881 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:09.877+0000 7f478026b640 1 -- 172.21.15.73:0/3066776975 wait complete. 2023-12-12T09:46:09.883 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:09.879+0000 7f478026b640 1 Processor -- start 2023-12-12T09:46:09.883 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:09.879+0000 7f478026b640 1 -- start start 2023-12-12T09:46:09.883 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:09.880+0000 7f478026b640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4764006f10 0x7f4778149fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:09.884 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:09.880+0000 7f478026b640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f47780a89d0 0x7f47781ed2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:09.884 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:09.880+0000 7f478026b640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f47780aaaa0 0x7f47780aaf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:09.884 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:09.880+0000 7f478026b640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47781513d0 con 0x7f4764006f10 2023-12-12T09:46:09.884 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:09.880+0000 7f478026b640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f477814a4f0 con 0x7f47780aaaa0 2023-12-12T09:46:09.884 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:09.880+0000 7f478026b640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47780ab460 con 0x7f47780a89d0 2023-12-12T09:46:09.884 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:09.880+0000 7f477e007640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4764006f10 0x7f4778149fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:09.884 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:09.880+0000 7f477e007640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4764006f10 0x7f4778149fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:55418/0 (socket says 172.21.15.73:55418) 2023-12-12T09:46:09.884 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:09.880+0000 7f477e007640 1 -- 172.21.15.73:0/1683570746 learned_addr learned my addr 172.21.15.73:0/1683570746 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:46:09.884 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:09.880+0000 7f477e808640 1 --2- 172.21.15.73:0/1683570746 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f47780aaaa0 0x7f47780aaf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:09.884 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:09.880+0000 7f477e007640 1 -- 172.21.15.73:0/1683570746 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f47780a89d0 msgr2=0x7f47781ed2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:09.884 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:09.880+0000 7f477e007640 1 --2- 172.21.15.73:0/1683570746 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f47780a89d0 0x7f47781ed2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:09.884 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:09.880+0000 7f477e007640 1 -- 172.21.15.73:0/1683570746 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f47780aaaa0 msgr2=0x7f47780aaf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:09.885 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:09.880+0000 7f477e007640 1 --2- 172.21.15.73:0/1683570746 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f47780aaaa0 0x7f47780aaf20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:09.885 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:09.880+0000 7f477e007640 1 -- 172.21.15.73:0/1683570746 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4778149cd0 con 0x7f4764006f10 2023-12-12T09:46:09.885 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:09.881+0000 7f477e007640 1 --2- 172.21.15.73:0/1683570746 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4764006f10 0x7f4778149fb0 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7f47740109d0 tx=0x7f4774010e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:46:09.885 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:09.881+0000 7f476effd640 1 -- 172.21.15.73:0/1683570746 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f477400ec20 con 0x7f4764006f10 2023-12-12T09:46:09.885 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:09.881+0000 7f476effd640 1 -- 172.21.15.73:0/1683570746 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f477400ed80 con 0x7f4764006f10 2023-12-12T09:46:09.885 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:09.881+0000 7f478026b640 1 -- 172.21.15.73:0/1683570746 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47781edb90 con 0x7f4764006f10 2023-12-12T09:46:09.885 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:09.881+0000 7f476effd640 1 -- 172.21.15.73:0/1683570746 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f477401c620 con 0x7f4764006f10 2023-12-12T09:46:09.885 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:09.881+0000 7f478026b640 1 -- 172.21.15.73:0/1683570746 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f477806dea0 con 0x7f4764006f10 2023-12-12T09:46:09.885 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:09.882+0000 7f478026b640 1 -- 172.21.15.73:0/1683570746 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4778067920 con 0x7f4764006f10 2023-12-12T09:46:09.886 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:09.883+0000 7f476effd640 1 -- 172.21.15.73:0/1683570746 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f477401c780 con 0x7f4764006f10 2023-12-12T09:46:09.886 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:09.884+0000 7f476effd640 1 --2- 172.21.15.73:0/1683570746 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f475c06ae40 0x7f475c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:09.886 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:09.884+0000 7f476effd640 1 -- 172.21.15.73:0/1683570746 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 5857+0+0 (secure 0 0 0) 0x7f4774089e30 con 0x7f4764006f10 2023-12-12T09:46:09.886 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:09.884+0000 7f477d806640 1 --2- 172.21.15.73:0/1683570746 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f475c06ae40 0x7f475c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:09.886 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:09.885+0000 7f477d806640 1 --2- 172.21.15.73:0/1683570746 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f475c06ae40 0x7f475c06d300 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f47780a7420 tx=0x7f4768008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:46:09.890 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:09.889+0000 7f476effd640 1 -- 172.21.15.73:0/1683570746 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f4774054ee0 con 0x7f4764006f10 2023-12-12T09:46:10.083 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:10.081+0000 7f478026b640 1 -- 172.21.15.73:0/1683570746 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"} v 0) v1 -- 0x7f4778067070 con 0x7f4764006f10 2023-12-12T09:46:10.084 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:10.083+0000 7f476effd640 1 -- 172.21.15.73:0/1683570746 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"}]=0 v62) v1 ==== 101+0+11 (secure 0 0 0) 0x7f4774058500 con 0x7f4764006f10 2023-12-12T09:46:10.084 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 64 2023-12-12T09:46:10.086 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:10.085+0000 7f478026b640 1 -- 172.21.15.73:0/1683570746 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f475c06ae40 msgr2=0x7f475c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:10.086 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:10.085+0000 7f478026b640 1 --2- 172.21.15.73:0/1683570746 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f475c06ae40 0x7f475c06d300 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f47780a7420 tx=0x7f4768008040 comp rx=0 tx=0).stop 2023-12-12T09:46:10.087 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:10.085+0000 7f478026b640 1 -- 172.21.15.73:0/1683570746 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4764006f10 msgr2=0x7f4778149fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:10.087 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:10.085+0000 7f478026b640 1 --2- 172.21.15.73:0/1683570746 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4764006f10 0x7f4778149fb0 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7f47740109d0 tx=0x7f4774010e90 comp rx=0 tx=0).stop 2023-12-12T09:46:10.087 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:10.085+0000 7f478026b640 1 -- 172.21.15.73:0/1683570746 shutdown_connections 2023-12-12T09:46:10.087 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:10.085+0000 7f478026b640 1 --2- 172.21.15.73:0/1683570746 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f475c06ae40 0x7f475c06d300 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:10.087 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:10.085+0000 7f478026b640 1 --2- 172.21.15.73:0/1683570746 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f47780aaaa0 0x7f47780aaf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:10.087 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:10.085+0000 7f478026b640 1 --2- 172.21.15.73:0/1683570746 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f47780a89d0 0x7f47781ed2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:10.087 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:10.085+0000 7f478026b640 1 --2- 172.21.15.73:0/1683570746 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4764006f10 0x7f4778149fb0 unknown :-1 s=CLOSED pgs=796 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:10.088 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:10.085+0000 7f478026b640 1 -- 172.21.15.73:0/1683570746 >> 172.21.15.73:0/1683570746 conn(0x7f477806a4e0 msgr2=0x7f47780c1b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:46:10.088 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:10.086+0000 7f478026b640 1 -- 172.21.15.73:0/1683570746 shutdown_connections 2023-12-12T09:46:10.088 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:10.086+0000 7f478026b640 1 -- 172.21.15.73:0/1683570746 wait complete. 2023-12-12T09:46:10.104 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-12T09:46:10.313 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:10.311+0000 7f24127a5640 1 Processor -- start 2023-12-12T09:46:10.313 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:10.311+0000 7f24127a5640 1 -- start start 2023-12-12T09:46:10.314 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:10.313+0000 7f24127a5640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f240c0c0240 0x7f240c151080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:10.315 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:10.313+0000 7f24127a5640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f240c0a5040 0x7f240c0c4e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:10.315 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:10.313+0000 7f24127a5640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f240c154880 con 0x7f240c14b150 2023-12-12T09:46:10.315 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:10.313+0000 7f24127a5640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f240c0a8f70 con 0x7f240c0a5040 2023-12-12T09:46:10.315 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:10.313+0000 7f24127a5640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f240c14b530 con 0x7f240c0c0240 2023-12-12T09:46:10.315 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:10.314+0000 7f24117a3640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f240c14b150 0x7f240c154d10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:52530/0 (socket says 172.21.15.73:52530) 2023-12-12T09:46:10.315 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:10.314+0000 7f24117a3640 1 -- 172.21.15.73:0/2000645521 learned_addr learned my addr 172.21.15.73:0/2000645521 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-12T09:46:10.315 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:10.314+0000 7f2411fa4640 1 --2- 172.21.15.73:0/2000645521 >> v2:172.21.15.73:3300/0 conn(0x7f240c0a5040 0x7f240c0c4e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:10.316 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:10.314+0000 7f2410fa2640 1 --2- 172.21.15.73:0/2000645521 >> v2:172.21.15.142:3300/0 conn(0x7f240c0c0240 0x7f240c151080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:10.316 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:10.315+0000 7f2411fa4640 1 -- 172.21.15.73:0/2000645521 >> v2:172.21.15.142:3300/0 conn(0x7f240c0c0240 msgr2=0x7f240c151080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:46:10.316 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:10.315+0000 7f2411fa4640 1 --2- 172.21.15.73:0/2000645521 >> v2:172.21.15.142:3300/0 conn(0x7f240c0c0240 0x7f240c151080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:10.316 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:10.315+0000 7f2411fa4640 1 -- 172.21.15.73:0/2000645521 >> v1:172.21.15.73:6789/0 conn(0x7f240c14b150 legacy=0x7f240c154d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:10.316 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:10.315+0000 7f2411fa4640 1 -- 172.21.15.73:0/2000645521 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f240c0c4a60 con 0x7f240c0a5040 2023-12-12T09:46:10.316 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:10.315+0000 7f2403fff640 1 -- 172.21.15.73:0/2000645521 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 213300534 0 0) 0x7f240c154880 con 0x7f240c14b150 2023-12-12T09:46:10.317 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:10.316+0000 7f2411fa4640 1 --2- 172.21.15.73:0/2000645521 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f240c0a5040 0x7f240c0c4e60 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7f240c0a91e0 tx=0x7f240402beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63b43d8c0d9a1cfc server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:46:10.318 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:10.317+0000 7f2403fff640 1 -- 172.21.15.73:0/2000645521 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f240402cc60 con 0x7f240c0a5040 2023-12-12T09:46:10.318 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:10.317+0000 7f2403fff640 1 -- 172.21.15.73:0/2000645521 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f240402cdc0 con 0x7f240c0a5040 2023-12-12T09:46:10.318 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:10.317+0000 7f2403fff640 1 -- 172.21.15.73:0/2000645521 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2404034660 con 0x7f240c0a5040 2023-12-12T09:46:10.319 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:10.318+0000 7f24127a5640 1 -- 172.21.15.73:0/2000645521 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f240c0a5040 msgr2=0x7f240c0c4e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:10.320 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:10.318+0000 7f24127a5640 1 --2- 172.21.15.73:0/2000645521 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f240c0a5040 0x7f240c0c4e60 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7f240c0a91e0 tx=0x7f240402beb0 comp rx=0 tx=0).stop 2023-12-12T09:46:10.320 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:10.318+0000 7f24127a5640 1 -- 172.21.15.73:0/2000645521 shutdown_connections 2023-12-12T09:46:10.320 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:10.318+0000 7f24127a5640 1 --2- 172.21.15.73:0/2000645521 >> v2:172.21.15.142:3300/0 conn(0x7f240c0c0240 0x7f240c151080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:10.320 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:10.318+0000 7f24127a5640 1 --2- 172.21.15.73:0/2000645521 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f240c0a5040 0x7f240c0c4e60 unknown :-1 s=CLOSED pgs=798 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:10.320 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:10.318+0000 7f24127a5640 1 -- 172.21.15.73:0/2000645521 >> 172.21.15.73:0/2000645521 conn(0x7f240c06a4e0 msgr2=0x7f240c06a8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:46:10.320 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:10.318+0000 7f24127a5640 1 -- 172.21.15.73:0/2000645521 shutdown_connections 2023-12-12T09:46:10.320 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:10.318+0000 7f24127a5640 1 -- 172.21.15.73:0/2000645521 wait complete. 2023-12-12T09:46:10.321 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:10.320+0000 7f24127a5640 1 Processor -- start 2023-12-12T09:46:10.321 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:10.320+0000 7f24127a5640 1 -- start start 2023-12-12T09:46:10.323 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:10.321+0000 7f24127a5640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f240c0a5040 0x7f240c1539e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:10.323 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:10.321+0000 7f24127a5640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f240c0c0240 0x7f240c14ce00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:10.323 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:10.321+0000 7f24127a5640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f240c14b150 0x7f240c14ba70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:10.323 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:10.321+0000 7f24127a5640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f240c1ee010 con 0x7f240c0a5040 2023-12-12T09:46:10.323 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:10.321+0000 7f24127a5640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f240c071900 con 0x7f240c0c0240 2023-12-12T09:46:10.323 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:10.321+0000 7f24127a5640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f240c071be0 con 0x7f240c14b150 2023-12-12T09:46:10.323 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:10.321+0000 7f24117a3640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f240c0a5040 0x7f240c1539e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:10.323 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:10.321+0000 7f24117a3640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f240c0a5040 0x7f240c1539e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:55438/0 (socket says 172.21.15.73:55438) 2023-12-12T09:46:10.323 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:10.321+0000 7f24117a3640 1 -- 172.21.15.73:0/2633758025 learned_addr learned my addr 172.21.15.73:0/2633758025 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:46:10.323 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:10.321+0000 7f24117a3640 1 -- 172.21.15.73:0/2633758025 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f240c14b150 msgr2=0x7f240c14ba70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:10.323 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:10.322+0000 7f24117a3640 1 --2- 172.21.15.73:0/2633758025 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f240c14b150 0x7f240c14ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:10.323 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:10.322+0000 7f24117a3640 1 -- 172.21.15.73:0/2633758025 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f240c0c0240 msgr2=0x7f240c14ce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:10.323 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:10.322+0000 7f24117a3640 1 --2- 172.21.15.73:0/2633758025 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f240c0c0240 0x7f240c14ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:10.324 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:10.322+0000 7f24117a3640 1 -- 172.21.15.73:0/2633758025 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2404009a70 con 0x7f240c0a5040 2023-12-12T09:46:10.324 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:10.322+0000 7f24117a3640 1 --2- 172.21.15.73:0/2633758025 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f240c0a5040 0x7f240c1539e0 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f240800c4d0 tx=0x7f240800c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:46:10.324 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:10.322+0000 7f2401ffb640 1 -- 172.21.15.73:0/2633758025 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24080074e0 con 0x7f240c0a5040 2023-12-12T09:46:10.324 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:10.322+0000 7f2401ffb640 1 -- 172.21.15.73:0/2633758025 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2408007640 con 0x7f240c0a5040 2023-12-12T09:46:10.325 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:10.322+0000 7f2401ffb640 1 -- 172.21.15.73:0/2633758025 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2408004a20 con 0x7f240c0a5040 2023-12-12T09:46:10.325 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:10.322+0000 7f24127a5640 1 -- 172.21.15.73:0/2633758025 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f240c071ec0 con 0x7f240c0a5040 2023-12-12T09:46:10.325 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:10.322+0000 7f24127a5640 1 -- 172.21.15.73:0/2633758025 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f240c070c70 con 0x7f240c0a5040 2023-12-12T09:46:10.325 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:10.324+0000 7f24127a5640 1 -- 172.21.15.73:0/2633758025 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f240c14c770 con 0x7f240c0a5040 2023-12-12T09:46:10.326 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:10.325+0000 7f2401ffb640 1 -- 172.21.15.73:0/2633758025 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f2408004b80 con 0x7f240c0a5040 2023-12-12T09:46:10.327 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:10.325+0000 7f2401ffb640 1 --2- 172.21.15.73:0/2633758025 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f23f006ae40 0x7f23f006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:10.327 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:10.326+0000 7f2401ffb640 1 -- 172.21.15.73:0/2633758025 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 5857+0+0 (secure 0 0 0) 0x7f2408088900 con 0x7f240c0a5040 2023-12-12T09:46:10.327 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:10.326+0000 7f2410fa2640 1 --2- 172.21.15.73:0/2633758025 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f23f006ae40 0x7f23f006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:10.328 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:10.326+0000 7f2410fa2640 1 --2- 172.21.15.73:0/2633758025 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f23f006ae40 0x7f23f006d300 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f23fc006fd0 tx=0x7f23fc008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:46:10.333 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:10.331+0000 7f2401ffb640 1 -- 172.21.15.73:0/2633758025 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f2408053870 con 0x7f240c0a5040 2023-12-12T09:46:10.562 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:10.560+0000 7f24127a5640 1 -- 172.21.15.73:0/2633758025 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f240c0720b0 con 0x7f240c0a5040 2023-12-12T09:46:10.563 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:10.562+0000 7f2401ffb640 1 -- 172.21.15.73:0/2633758025 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 37 v37) v1 ==== 94+0+4920 (secure 0 0 0) 0x7f2408018020 con 0x7f240c0a5040 2023-12-12T09:46:10.563 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-12T09:46:10.563 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":37,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4736,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6834/2964437845","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6832","nonce":2964437845},{"type":"v1","addr":"172.21.15.142:6834","nonce":2964437845}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":25},{"gid":5044,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6837/3698725764","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6836","nonce":3698725764},{"type":"v1","addr":"172.21.15.73:6837","nonce":3698725764}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":25},{"gid":6255,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6835/706333502","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":706333502},{"type":"v1","addr":"172.21.15.73:6835","nonce":706333502}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":37}],"filesystems":[{"mdsmap":{"epoch":35,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-12T09:45:38.103609+0000","modified":"2023-12-12T09:45:41.148650+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5059},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5059":{"gid":5059,"name":"d","rank":0,"incarnation":31,"state":"up:active","state_seq":7,"addr":"172.21.15.142:6835/2931058847","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6833","nonce":2931058847},{"type":"v1","addr":"172.21.15.142:6835","nonce":2931058847}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2023-12-12T09:46:10.564 INFO:teuthology.orchestra.run.smithi073.stderr:dumped fsmap epoch 37 2023-12-12T09:46:10.566 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:10.564+0000 7f24127a5640 1 -- 172.21.15.73:0/2633758025 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f23f006ae40 msgr2=0x7f23f006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:10.566 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:10.564+0000 7f24127a5640 1 --2- 172.21.15.73:0/2633758025 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f23f006ae40 0x7f23f006d300 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f23fc006fd0 tx=0x7f23fc008040 comp rx=0 tx=0).stop 2023-12-12T09:46:10.566 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:10.564+0000 7f24127a5640 1 -- 172.21.15.73:0/2633758025 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f240c0a5040 msgr2=0x7f240c1539e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:10.566 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:10.564+0000 7f24127a5640 1 --2- 172.21.15.73:0/2633758025 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f240c0a5040 0x7f240c1539e0 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f240800c4d0 tx=0x7f240800c990 comp rx=0 tx=0).stop 2023-12-12T09:46:10.566 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:10.564+0000 7f24127a5640 1 -- 172.21.15.73:0/2633758025 shutdown_connections 2023-12-12T09:46:10.566 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:10.564+0000 7f24127a5640 1 --2- 172.21.15.73:0/2633758025 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f23f006ae40 0x7f23f006d300 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:10.566 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:10.564+0000 7f24127a5640 1 --2- 172.21.15.73:0/2633758025 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f240c14b150 0x7f240c14ba70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:10.566 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:10.564+0000 7f24127a5640 1 --2- 172.21.15.73:0/2633758025 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f240c0c0240 0x7f240c14ce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:10.566 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:10.564+0000 7f24127a5640 1 --2- 172.21.15.73:0/2633758025 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f240c0a5040 0x7f240c1539e0 unknown :-1 s=CLOSED pgs=799 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:10.566 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:10.564+0000 7f24127a5640 1 -- 172.21.15.73:0/2633758025 >> 172.21.15.73:0/2633758025 conn(0x7f240c06a4e0 msgr2=0x7f240c0c4c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:46:10.566 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:10.565+0000 7f24127a5640 1 -- 172.21.15.73:0/2633758025 shutdown_connections 2023-12-12T09:46:10.567 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:10.565+0000 7f24127a5640 1 -- 172.21.15.73:0/2633758025 wait complete. 2023-12-12T09:46:10.584 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-12T09:46:10.790 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:10.788+0000 7f6b6b9b6640 1 Processor -- start 2023-12-12T09:46:10.790 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:10.788+0000 7f6b6b9b6640 1 -- start start 2023-12-12T09:46:10.791 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:10.789+0000 7f6b6b9b6640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f6b641552e0 0x7f6b640c49c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:10.791 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:10.789+0000 7f6b6b9b6640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6b640a50f0 0x7f6b640a9050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:10.792 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:10.789+0000 7f6b6b9b6640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b640c0b50 con 0x7f6b6406bf20 2023-12-12T09:46:10.792 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:10.789+0000 7f6b6b9b6640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b640c04d0 con 0x7f6b641552e0 2023-12-12T09:46:10.792 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:10.789+0000 7f6b6b9b6640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b6406c880 con 0x7f6b640a50f0 2023-12-12T09:46:10.792 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:10.790+0000 7f6b69752640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f6b641552e0 0x7f6b640c49c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:10.792 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:10.790+0000 7f6b69752640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f6b641552e0 0x7f6b640c49c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:55444/0 (socket says 172.21.15.73:55444) 2023-12-12T09:46:10.792 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:10.790+0000 7f6b69752640 1 -- 172.21.15.73:0/1134427460 learned_addr learned my addr 172.21.15.73:0/1134427460 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:46:10.792 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:10.790+0000 7f6b69752640 1 -- 172.21.15.73:0/1134427460 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6b640a50f0 msgr2=0x7f6b640a9050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:46:10.792 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:10.790+0000 7f6b69752640 1 --2- 172.21.15.73:0/1134427460 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6b640a50f0 0x7f6b640a9050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:10.792 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:10.790+0000 7f6b69752640 1 -- 172.21.15.73:0/1134427460 >> v1:172.21.15.142:6789/0 conn(0x7f6b6406bf20 legacy=0x7f6b640a9590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:46:10.792 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:10.790+0000 7f6b69752640 1 -- 172.21.15.73:0/1134427460 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b6406cb60 con 0x7f6b641552e0 2023-12-12T09:46:10.793 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:10.791+0000 7f6b69752640 1 --2- 172.21.15.73:0/1134427460 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6b641552e0 0x7f6b640c49c0 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7f6b60009870 tx=0x7f6b6002b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1005215341c3200 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:46:10.794 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:10.791+0000 7f6b5bfff640 1 -- 172.21.15.73:0/1134427460 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b600317c0 con 0x7f6b641552e0 2023-12-12T09:46:10.794 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:10.791+0000 7f6b5bfff640 1 -- 172.21.15.73:0/1134427460 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b60031920 con 0x7f6b641552e0 2023-12-12T09:46:10.794 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:10.791+0000 7f6b5bfff640 1 -- 172.21.15.73:0/1134427460 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b60031cb0 con 0x7f6b641552e0 2023-12-12T09:46:10.794 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:10.792+0000 7f6b6b9b6640 1 -- 172.21.15.73:0/1134427460 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6b641552e0 msgr2=0x7f6b640c49c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:10.794 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:10.792+0000 7f6b6b9b6640 1 --2- 172.21.15.73:0/1134427460 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6b641552e0 0x7f6b640c49c0 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7f6b60009870 tx=0x7f6b6002b860 comp rx=0 tx=0).stop 2023-12-12T09:46:10.794 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:10.792+0000 7f6b6b9b6640 1 -- 172.21.15.73:0/1134427460 shutdown_connections 2023-12-12T09:46:10.794 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:10.792+0000 7f6b6b9b6640 1 --2- 172.21.15.73:0/1134427460 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6b640a50f0 0x7f6b640a9050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:10.794 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:10.792+0000 7f6b6b9b6640 1 --2- 172.21.15.73:0/1134427460 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6b641552e0 0x7f6b640c49c0 unknown :-1 s=CLOSED pgs=800 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:10.794 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:10.792+0000 7f6b6b9b6640 1 -- 172.21.15.73:0/1134427460 >> 172.21.15.73:0/1134427460 conn(0x7f6b640a8130 msgr2=0x7f6b640c24b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:46:10.794 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:10.792+0000 7f6b6b9b6640 1 -- 172.21.15.73:0/1134427460 shutdown_connections 2023-12-12T09:46:10.794 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:10.792+0000 7f6b6b9b6640 1 -- 172.21.15.73:0/1134427460 wait complete. 2023-12-12T09:46:10.799 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:10.794+0000 7f6b6b9b6640 1 Processor -- start 2023-12-12T09:46:10.799 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:10.794+0000 7f6b6b9b6640 1 -- start start 2023-12-12T09:46:10.799 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:10.795+0000 7f6b6b9b6640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6b6406bf20 0x7f6b641eacc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:10.799 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:10.795+0000 7f6b6b9b6640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6b640a50f0 0x7f6b640bf050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:10.799 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:10.795+0000 7f6b6b9b6640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6b641552e0 0x7f6b64147ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:10.799 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:10.795+0000 7f6b6b9b6640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b641eb200 con 0x7f6b6406bf20 2023-12-12T09:46:10.799 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:10.795+0000 7f6b6b9b6640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b6406fe80 con 0x7f6b640a50f0 2023-12-12T09:46:10.799 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:10.795+0000 7f6b6b9b6640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b64071ae0 con 0x7f6b641552e0 2023-12-12T09:46:10.800 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:10.795+0000 7f6b69752640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6b6406bf20 0x7f6b641eacc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:10.800 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:10.795+0000 7f6b69752640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6b6406bf20 0x7f6b641eacc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:55450/0 (socket says 172.21.15.73:55450) 2023-12-12T09:46:10.800 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:10.795+0000 7f6b69752640 1 -- 172.21.15.73:0/1807577060 learned_addr learned my addr 172.21.15.73:0/1807577060 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:46:10.800 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:10.796+0000 7f6b69f53640 1 --2- 172.21.15.73:0/1807577060 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6b641552e0 0x7f6b64147ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:10.800 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:10.796+0000 7f6b68f51640 1 --2- 172.21.15.73:0/1807577060 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6b640a50f0 0x7f6b640bf050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:10.800 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:10.796+0000 7f6b69752640 1 -- 172.21.15.73:0/1807577060 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6b641552e0 msgr2=0x7f6b64147ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:10.800 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:10.796+0000 7f6b69752640 1 --2- 172.21.15.73:0/1807577060 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6b641552e0 0x7f6b64147ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:10.800 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:10.796+0000 7f6b69752640 1 -- 172.21.15.73:0/1807577060 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6b640a50f0 msgr2=0x7f6b640bf050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:10.800 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:10.796+0000 7f6b69752640 1 --2- 172.21.15.73:0/1807577060 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6b640a50f0 0x7f6b640bf050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:10.800 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:10.796+0000 7f6b69752640 1 -- 172.21.15.73:0/1807577060 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b600094d0 con 0x7f6b6406bf20 2023-12-12T09:46:10.800 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:10.796+0000 7f6b68f51640 1 --2- 172.21.15.73:0/1807577060 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6b640a50f0 0x7f6b640bf050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:46:10.801 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:10.796+0000 7f6b69752640 1 --2- 172.21.15.73:0/1807577060 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6b6406bf20 0x7f6b641eacc0 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7f6b60009870 tx=0x7f6b600046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:46:10.801 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:10.796+0000 7f6b59ffb640 1 -- 172.21.15.73:0/1807577060 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b60032860 con 0x7f6b6406bf20 2023-12-12T09:46:10.801 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:10.796+0000 7f6b59ffb640 1 -- 172.21.15.73:0/1807577060 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b600329c0 con 0x7f6b6406bf20 2023-12-12T09:46:10.801 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:10.796+0000 7f6b59ffb640 1 -- 172.21.15.73:0/1807577060 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b60032d50 con 0x7f6b6406bf20 2023-12-12T09:46:10.801 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:10.796+0000 7f6b6b9b6640 1 -- 172.21.15.73:0/1807577060 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b640bfa70 con 0x7f6b6406bf20 2023-12-12T09:46:10.801 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:10.796+0000 7f6b6b9b6640 1 -- 172.21.15.73:0/1807577060 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b64071520 con 0x7f6b6406bf20 2023-12-12T09:46:10.801 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:10.797+0000 7f6b6b9b6640 1 -- 172.21.15.73:0/1807577060 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b64067580 con 0x7f6b6406bf20 2023-12-12T09:46:10.802 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:10.798+0000 7f6b59ffb640 1 -- 172.21.15.73:0/1807577060 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f6b6004d3f0 con 0x7f6b6406bf20 2023-12-12T09:46:10.802 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:10.799+0000 7f6b59ffb640 1 --2- 172.21.15.73:0/1807577060 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f6b4806ae40 0x7f6b4806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:10.802 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:10.799+0000 7f6b59ffb640 1 -- 172.21.15.73:0/1807577060 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 5857+0+0 (secure 0 0 0) 0x7f6b600ab5f0 con 0x7f6b6406bf20 2023-12-12T09:46:10.802 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:10.800+0000 7f6b68f51640 1 --2- 172.21.15.73:0/1807577060 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f6b4806ae40 0x7f6b4806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:10.802 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:10.800+0000 7f6b68f51640 1 --2- 172.21.15.73:0/1807577060 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f6b4806ae40 0x7f6b4806d300 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f6b54006fd0 tx=0x7f6b54008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:46:10.805 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:10.804+0000 7f6b59ffb640 1 -- 172.21.15.73:0/1807577060 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f6b600765f0 con 0x7f6b6406bf20 2023-12-12T09:46:10.999 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:10.997+0000 7f6b6b9b6640 1 -- 172.21.15.73:0/1807577060 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6b640c0650 con 0x7f6b6406bf20 2023-12-12T09:46:11.002 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:10.999+0000 7f6b59ffb640 1 -- 172.21.15.73:0/1807577060 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v63) v1 ==== 74+0+16808 (secure 0 0 0) 0x7f6b60079c10 con 0x7f6b6406bf20 2023-12-12T09:46:11.003 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-12T09:46:11.003 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":63,"fsid":"ba240992-02b8-4c7e-92f2-27eb29ac433b","created":"2023-12-12T09:43:02.454719+0000","modified":"2023-12-12T09:46:10.308407+0000","last_up_change":"2023-12-12T09:43:13.913440+0000","last_in_change":"2023-12-12T09:43:05.925348+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-12T09:43:15.525508+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs2_metadata","create_time":"2023-12-12T09:45:36.388393+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"57","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs2_data","create_time":"2023-12-12T09:45:37.109653+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"58","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"dd9074be-dbe2-4c34-9896-a4223d8d3940","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":4047810203},{"type":"v1","addr":"172.21.15.73:6801","nonce":4047810203}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":4047810203},{"type":"v1","addr":"172.21.15.73:6803","nonce":4047810203}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":4047810203},{"type":"v1","addr":"172.21.15.73:6807","nonce":4047810203}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":4047810203},{"type":"v1","addr":"172.21.15.73:6805","nonce":4047810203}]},"public_addr":"172.21.15.73:6801/4047810203","cluster_addr":"172.21.15.73:6803/4047810203","heartbeat_back_addr":"172.21.15.73:6807/4047810203","heartbeat_front_addr":"172.21.15.73:6805/4047810203","state":["exists","up"]},{"osd":1,"uuid":"c4a05052-96d4-4758-a4e1-1a37f1e07fed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":1356058331},{"type":"v1","addr":"172.21.15.73:6824","nonce":1356058331}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":1356058331},{"type":"v1","addr":"172.21.15.73:6827","nonce":1356058331}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":1356058331},{"type":"v1","addr":"172.21.15.73:6831","nonce":1356058331}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":1356058331},{"type":"v1","addr":"172.21.15.73:6829","nonce":1356058331}]},"public_addr":"172.21.15.73:6824/1356058331","cluster_addr":"172.21.15.73:6827/1356058331","heartbeat_back_addr":"172.21.15.73:6831/1356058331","heartbeat_front_addr":"172.21.15.73:6829/1356058331","state":["exists","up"]},{"osd":2,"uuid":"512bc8ac-72c2-40d4-b3d2-d867a92c5213","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":1228903316},{"type":"v1","addr":"172.21.15.73:6817","nonce":1228903316}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":1228903316},{"type":"v1","addr":"172.21.15.73:6819","nonce":1228903316}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6823","nonce":1228903316},{"type":"v1","addr":"172.21.15.73:6825","nonce":1228903316}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":1228903316},{"type":"v1","addr":"172.21.15.73:6821","nonce":1228903316}]},"public_addr":"172.21.15.73:6817/1228903316","cluster_addr":"172.21.15.73:6819/1228903316","heartbeat_back_addr":"172.21.15.73:6825/1228903316","heartbeat_front_addr":"172.21.15.73:6821/1228903316","state":["exists","up"]},{"osd":3,"uuid":"3d1a91e0-42bf-437a-8eae-8d357c8f63a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":1293329670},{"type":"v1","addr":"172.21.15.73:6809","nonce":1293329670}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6810","nonce":1293329670},{"type":"v1","addr":"172.21.15.73:6811","nonce":1293329670}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":1293329670},{"type":"v1","addr":"172.21.15.73:6815","nonce":1293329670}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":1293329670},{"type":"v1","addr":"172.21.15.73:6813","nonce":1293329670}]},"public_addr":"172.21.15.73:6809/1293329670","cluster_addr":"172.21.15.73:6811/1293329670","heartbeat_back_addr":"172.21.15.73:6815/1293329670","heartbeat_front_addr":"172.21.15.73:6813/1293329670","state":["exists","up"]},{"osd":4,"uuid":"4b302fff-834c-4069-ac19-00e46f6c87b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":3727975702},{"type":"v1","addr":"172.21.15.142:6801","nonce":3727975702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":3727975702},{"type":"v1","addr":"172.21.15.142:6803","nonce":3727975702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6809","nonce":3727975702},{"type":"v1","addr":"172.21.15.142:6811","nonce":3727975702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6805","nonce":3727975702},{"type":"v1","addr":"172.21.15.142:6807","nonce":3727975702}]},"public_addr":"172.21.15.142:6801/3727975702","cluster_addr":"172.21.15.142:6803/3727975702","heartbeat_back_addr":"172.21.15.142:6811/3727975702","heartbeat_front_addr":"172.21.15.142:6807/3727975702","state":["exists","up"]},{"osd":5,"uuid":"d7cdace2-67d0-45cc-95f2-515cf6ef1b82","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6817","nonce":2353193632},{"type":"v1","addr":"172.21.15.142:6819","nonce":2353193632}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6821","nonce":2353193632},{"type":"v1","addr":"172.21.15.142:6823","nonce":2353193632}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6829","nonce":2353193632},{"type":"v1","addr":"172.21.15.142:6831","nonce":2353193632}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6825","nonce":2353193632},{"type":"v1","addr":"172.21.15.142:6827","nonce":2353193632}]},"public_addr":"172.21.15.142:6819/2353193632","cluster_addr":"172.21.15.142:6823/2353193632","heartbeat_back_addr":"172.21.15.142:6831/2353193632","heartbeat_front_addr":"172.21.15.142:6827/2353193632","state":["exists","up"]},{"osd":6,"uuid":"649ce78a-5626-445c-aedc-a651ed05a6f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":2006111986},{"type":"v1","addr":"172.21.15.142:6806","nonce":2006111986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":2006111986},{"type":"v1","addr":"172.21.15.142:6810","nonce":2006111986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":2006111986},{"type":"v1","addr":"172.21.15.142:6815","nonce":2006111986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":2006111986},{"type":"v1","addr":"172.21.15.142:6813","nonce":2006111986}]},"public_addr":"172.21.15.142:6806/2006111986","cluster_addr":"172.21.15.142:6810/2006111986","heartbeat_back_addr":"172.21.15.142:6815/2006111986","heartbeat_front_addr":"172.21.15.142:6813/2006111986","state":["exists","up"]},{"osd":7,"uuid":"af15ae3b-c1d0-4acf-92db-8a1805494d13","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":2573794341},{"type":"v1","addr":"172.21.15.142:6818","nonce":2573794341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":2573794341},{"type":"v1","addr":"172.21.15.142:6822","nonce":2573794341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":2573794341},{"type":"v1","addr":"172.21.15.142:6830","nonce":2573794341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":2573794341},{"type":"v1","addr":"172.21.15.142:6826","nonce":2573794341}]},"public_addr":"172.21.15.142:6818/2573794341","cluster_addr":"172.21.15.142:6822/2573794341","heartbeat_back_addr":"172.21.15.142:6830/2573794341","heartbeat_front_addr":"172.21.15.142:6826/2573794341","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.185824+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.262103+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.225556+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:10.523459+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:10.706035+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.257339+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.301776+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.051960+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"11.1","mappings":[{"from":6,"to":0}]},{"pgid":"11.38","mappings":[{"from":6,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.73:6835/744058726":"2023-12-13T09:46:05.274143+0000","172.21.15.73:6834/744058726":"2023-12-13T09:46:05.274143+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-12T09:46:11.004 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:11.002+0000 7f6b6b9b6640 1 -- 172.21.15.73:0/1807577060 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f6b4806ae40 msgr2=0x7f6b4806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:11.004 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:11.002+0000 7f6b6b9b6640 1 --2- 172.21.15.73:0/1807577060 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f6b4806ae40 0x7f6b4806d300 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f6b54006fd0 tx=0x7f6b54008040 comp rx=0 tx=0).stop 2023-12-12T09:46:11.005 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:11.002+0000 7f6b6b9b6640 1 -- 172.21.15.73:0/1807577060 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6b6406bf20 msgr2=0x7f6b641eacc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:11.005 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:11.002+0000 7f6b6b9b6640 1 --2- 172.21.15.73:0/1807577060 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6b6406bf20 0x7f6b641eacc0 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7f6b60009870 tx=0x7f6b600046c0 comp rx=0 tx=0).stop 2023-12-12T09:46:11.005 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:11.002+0000 7f6b6b9b6640 1 -- 172.21.15.73:0/1807577060 shutdown_connections 2023-12-12T09:46:11.005 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:11.002+0000 7f6b6b9b6640 1 --2- 172.21.15.73:0/1807577060 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f6b4806ae40 0x7f6b4806d300 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:11.006 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:11.002+0000 7f6b6b9b6640 1 --2- 172.21.15.73:0/1807577060 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6b641552e0 0x7f6b64147ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:11.006 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:11.002+0000 7f6b6b9b6640 1 --2- 172.21.15.73:0/1807577060 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6b640a50f0 0x7f6b640bf050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:11.006 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:11.002+0000 7f6b6b9b6640 1 --2- 172.21.15.73:0/1807577060 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6b6406bf20 0x7f6b641eacc0 unknown :-1 s=CLOSED pgs=801 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:11.006 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:11.002+0000 7f6b6b9b6640 1 -- 172.21.15.73:0/1807577060 >> 172.21.15.73:0/1807577060 conn(0x7f6b640a8130 msgr2=0x7f6b640c0d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:46:11.007 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:11.002+0000 7f6b6b9b6640 1 -- 172.21.15.73:0/1807577060 shutdown_connections 2023-12-12T09:46:11.007 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:11.002+0000 7f6b6b9b6640 1 -- 172.21.15.73:0/1807577060 wait complete. 2023-12-12T09:46:11.021 INFO:tasks.cephfs.filesystem:Destroying file system cephfs2 and related pools 2023-12-12T09:46:11.021 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-12T09:46:11.224 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:11.222+0000 7fc398b7c640 1 Processor -- start 2023-12-12T09:46:11.224 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:11.223+0000 7fc398b7c640 1 -- start start 2023-12-12T09:46:11.226 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:11.224+0000 7fc398b7c640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fc3941552e0 0x7fc3940c49c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:11.226 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:11.224+0000 7fc398b7c640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc3940a50f0 0x7fc3940a9050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:11.226 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:11.224+0000 7fc398b7c640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3940c0b50 con 0x7fc39406bf20 2023-12-12T09:46:11.226 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:11.224+0000 7fc398b7c640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3940c04d0 con 0x7fc3941552e0 2023-12-12T09:46:11.226 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:11.224+0000 7fc398b7c640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc39406c880 con 0x7fc3940a50f0 2023-12-12T09:46:11.226 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:11.224+0000 7fc39259c640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fc3941552e0 0x7fc3940c49c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:11.226 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:11.224+0000 7fc39259c640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fc3941552e0 0x7fc3940c49c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:55456/0 (socket says 172.21.15.73:55456) 2023-12-12T09:46:11.226 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:11.224+0000 7fc392d9d640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7fc39406bf20 0x7fc3940a9590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:52538/0 (socket says 172.21.15.73:52538) 2023-12-12T09:46:11.226 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:11.224+0000 7fc39259c640 1 -- 172.21.15.73:0/2306235481 learned_addr learned my addr 172.21.15.73:0/2306235481 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:46:11.227 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:11.225+0000 7fc389d9b640 1 --2- 172.21.15.73:0/2306235481 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc3940a50f0 0x7fc3940a9050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:11.227 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:11.225+0000 7fc391d9b640 1 -- 172.21.15.73:0/2306235481 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2203577781 0 0) 0x7fc3940c0b50 con 0x7fc39406bf20 2023-12-12T09:46:11.227 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:11.225+0000 7fc391d9b640 1 -- 172.21.15.73:0/2306235481 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc380003520 con 0x7fc39406bf20 2023-12-12T09:46:11.227 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:11.225+0000 7fc39259c640 1 -- 172.21.15.73:0/2306235481 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc3940a50f0 msgr2=0x7fc3940a9050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:46:11.227 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:11.225+0000 7fc39259c640 1 --2- 172.21.15.73:0/2306235481 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc3940a50f0 0x7fc3940a9050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:11.228 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:11.225+0000 7fc39259c640 1 -- 172.21.15.73:0/2306235481 >> v1:172.21.15.73:6789/0 conn(0x7fc39406bf20 legacy=0x7fc3940a9590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:11.228 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:11.225+0000 7fc39259c640 1 -- 172.21.15.73:0/2306235481 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc39406cb60 con 0x7fc3941552e0 2023-12-12T09:46:11.228 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:11.226+0000 7fc39259c640 1 --2- 172.21.15.73:0/2306235481 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc3941552e0 0x7fc3940c49c0 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7fc384009870 tx=0x7fc38402b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49b06fbb162e4f3d server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:46:11.229 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:11.226+0000 7fc391d9b640 1 -- 172.21.15.73:0/2306235481 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc384031640 con 0x7fc3941552e0 2023-12-12T09:46:11.229 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:11.226+0000 7fc391d9b640 1 -- 172.21.15.73:0/2306235481 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3840317a0 con 0x7fc3941552e0 2023-12-12T09:46:11.229 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:11.226+0000 7fc391d9b640 1 -- 172.21.15.73:0/2306235481 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc384031b30 con 0x7fc3941552e0 2023-12-12T09:46:11.229 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:11.227+0000 7fc398b7c640 1 -- 172.21.15.73:0/2306235481 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc3941552e0 msgr2=0x7fc3940c49c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:11.229 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:11.227+0000 7fc398b7c640 1 --2- 172.21.15.73:0/2306235481 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc3941552e0 0x7fc3940c49c0 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7fc384009870 tx=0x7fc38402b8f0 comp rx=0 tx=0).stop 2023-12-12T09:46:11.229 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:11.227+0000 7fc398b7c640 1 -- 172.21.15.73:0/2306235481 shutdown_connections 2023-12-12T09:46:11.229 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:11.227+0000 7fc398b7c640 1 --2- 172.21.15.73:0/2306235481 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc3940a50f0 0x7fc3940a9050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:11.229 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:11.227+0000 7fc398b7c640 1 --2- 172.21.15.73:0/2306235481 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc3941552e0 0x7fc3940c49c0 unknown :-1 s=CLOSED pgs=803 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:11.229 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:11.227+0000 7fc398b7c640 1 -- 172.21.15.73:0/2306235481 >> 172.21.15.73:0/2306235481 conn(0x7fc3940a8130 msgr2=0x7fc3940c24b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:46:11.229 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:11.227+0000 7fc398b7c640 1 -- 172.21.15.73:0/2306235481 shutdown_connections 2023-12-12T09:46:11.229 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:11.227+0000 7fc398b7c640 1 -- 172.21.15.73:0/2306235481 wait complete. 2023-12-12T09:46:11.230 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:11.229+0000 7fc398b7c640 1 Processor -- start 2023-12-12T09:46:11.230 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:11.229+0000 7fc398b7c640 1 -- start start 2023-12-12T09:46:11.232 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:11.230+0000 7fc398b7c640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc39406bf20 0x7fc3941e9d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:11.233 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:11.230+0000 7fc398b7c640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc3940a50f0 0x7fc3940bf280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:11.233 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:11.230+0000 7fc398b7c640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc3941552e0 0x7fc394143b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:11.233 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:11.230+0000 7fc398b7c640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3940be430 con 0x7fc3941552e0 2023-12-12T09:46:11.233 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:11.230+0000 7fc398b7c640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3941ea3d0 con 0x7fc3940a50f0 2023-12-12T09:46:11.233 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:11.230+0000 7fc398b7c640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3941ea6b0 con 0x7fc39406bf20 2023-12-12T09:46:11.233 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:11.230+0000 7fc392d9d640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc3941552e0 0x7fc394143b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:11.233 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:11.230+0000 7fc392d9d640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc3941552e0 0x7fc394143b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:55460/0 (socket says 172.21.15.73:55460) 2023-12-12T09:46:11.233 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:11.230+0000 7fc392d9d640 1 -- 172.21.15.73:0/884347653 learned_addr learned my addr 172.21.15.73:0/884347653 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:46:11.233 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:11.231+0000 7fc39259c640 1 --2- 172.21.15.73:0/884347653 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc39406bf20 0x7fc3941e9d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:11.233 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:11.231+0000 7fc389d9b640 1 --2- 172.21.15.73:0/884347653 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc3940a50f0 0x7fc3940bf280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:11.233 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:11.231+0000 7fc392d9d640 1 -- 172.21.15.73:0/884347653 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc39406bf20 msgr2=0x7fc3941e9d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:11.233 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:11.231+0000 7fc392d9d640 1 --2- 172.21.15.73:0/884347653 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc39406bf20 0x7fc3941e9d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:11.233 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:11.231+0000 7fc392d9d640 1 -- 172.21.15.73:0/884347653 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc3940a50f0 msgr2=0x7fc3940bf280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:11.234 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:11.231+0000 7fc392d9d640 1 --2- 172.21.15.73:0/884347653 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc3940a50f0 0x7fc3940bf280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:11.234 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:11.231+0000 7fc392d9d640 1 -- 172.21.15.73:0/884347653 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3840094d0 con 0x7fc3941552e0 2023-12-12T09:46:11.234 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:11.231+0000 7fc39259c640 1 --2- 172.21.15.73:0/884347653 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc39406bf20 0x7fc3941e9d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:46:11.234 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:11.231+0000 7fc392d9d640 1 --2- 172.21.15.73:0/884347653 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc3941552e0 0x7fc394143b10 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7fc38c00c7c0 tx=0x7fc38c00cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:46:11.234 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:11.231+0000 7fc38b7fe640 1 -- 172.21.15.73:0/884347653 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc38c00a640 con 0x7fc3941552e0 2023-12-12T09:46:11.234 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:11.231+0000 7fc38b7fe640 1 -- 172.21.15.73:0/884347653 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc38c00a7a0 con 0x7fc3941552e0 2023-12-12T09:46:11.234 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:11.231+0000 7fc38b7fe640 1 -- 172.21.15.73:0/884347653 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc38c00ab30 con 0x7fc3941552e0 2023-12-12T09:46:11.234 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:11.231+0000 7fc398b7c640 1 -- 172.21.15.73:0/884347653 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3941ea990 con 0x7fc3941552e0 2023-12-12T09:46:11.234 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:11.231+0000 7fc398b7c640 1 -- 172.21.15.73:0/884347653 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc39406fd60 con 0x7fc3941552e0 2023-12-12T09:46:11.235 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:11.233+0000 7fc398b7c640 1 -- 172.21.15.73:0/884347653 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc39406cfd0 con 0x7fc3941552e0 2023-12-12T09:46:11.235 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:11.234+0000 7fc38b7fe640 1 -- 172.21.15.73:0/884347653 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fc38c00ac90 con 0x7fc3941552e0 2023-12-12T09:46:11.236 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:11.234+0000 7fc38b7fe640 1 --2- 172.21.15.73:0/884347653 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fc37406ae40 0x7fc37406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:11.236 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:11.235+0000 7fc38b7fe640 1 -- 172.21.15.73:0/884347653 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 5857+0+0 (secure 0 0 0) 0x7fc38c088fe0 con 0x7fc3941552e0 2023-12-12T09:46:11.236 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:11.235+0000 7fc39259c640 1 --2- 172.21.15.73:0/884347653 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fc37406ae40 0x7fc37406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:11.236 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:11.235+0000 7fc39259c640 1 --2- 172.21.15.73:0/884347653 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fc37406ae40 0x7fc37406d300 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fc384036000 tx=0x7fc38403c040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:46:11.240 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:11.239+0000 7fc38b7fe640 1 -- 172.21.15.73:0/884347653 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fc39406cfd0 con 0x7fc3941552e0 2023-12-12T09:46:11.470 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:11.468+0000 7fc398b7c640 1 -- 172.21.15.73:0/884347653 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc39406cfd0 con 0x7fc3941552e0 2023-12-12T09:46:11.471 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:11.470+0000 7fc38b7fe640 1 -- 172.21.15.73:0/884347653 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 37 v37) v1 ==== 94+0+4920 (secure 0 0 0) 0x7fc39406cfd0 con 0x7fc3941552e0 2023-12-12T09:46:11.471 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-12T09:46:11.472 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":37,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4736,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6834/2964437845","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6832","nonce":2964437845},{"type":"v1","addr":"172.21.15.142:6834","nonce":2964437845}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":25},{"gid":5044,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6837/3698725764","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6836","nonce":3698725764},{"type":"v1","addr":"172.21.15.73:6837","nonce":3698725764}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":25},{"gid":6255,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6835/706333502","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":706333502},{"type":"v1","addr":"172.21.15.73:6835","nonce":706333502}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":37}],"filesystems":[{"mdsmap":{"epoch":35,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-12T09:45:38.103609+0000","modified":"2023-12-12T09:45:41.148650+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5059},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5059":{"gid":5059,"name":"d","rank":0,"incarnation":31,"state":"up:active","state_seq":7,"addr":"172.21.15.142:6835/2931058847","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6833","nonce":2931058847},{"type":"v1","addr":"172.21.15.142:6835","nonce":2931058847}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2023-12-12T09:46:11.472 INFO:teuthology.orchestra.run.smithi073.stderr:dumped fsmap epoch 37 2023-12-12T09:46:11.474 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:11.472+0000 7fc398b7c640 1 -- 172.21.15.73:0/884347653 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fc37406ae40 msgr2=0x7fc37406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:11.474 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:11.472+0000 7fc398b7c640 1 --2- 172.21.15.73:0/884347653 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fc37406ae40 0x7fc37406d300 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fc384036000 tx=0x7fc38403c040 comp rx=0 tx=0).stop 2023-12-12T09:46:11.474 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:11.472+0000 7fc398b7c640 1 -- 172.21.15.73:0/884347653 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc3941552e0 msgr2=0x7fc394143b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:11.474 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:11.472+0000 7fc398b7c640 1 --2- 172.21.15.73:0/884347653 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc3941552e0 0x7fc394143b10 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7fc38c00c7c0 tx=0x7fc38c00cc80 comp rx=0 tx=0).stop 2023-12-12T09:46:11.474 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:11.472+0000 7fc398b7c640 1 -- 172.21.15.73:0/884347653 shutdown_connections 2023-12-12T09:46:11.474 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:11.472+0000 7fc398b7c640 1 --2- 172.21.15.73:0/884347653 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fc37406ae40 0x7fc37406d300 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:11.475 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:11.472+0000 7fc398b7c640 1 --2- 172.21.15.73:0/884347653 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc3941552e0 0x7fc394143b10 unknown :-1 s=CLOSED pgs=804 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:11.475 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:11.472+0000 7fc398b7c640 1 --2- 172.21.15.73:0/884347653 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc3940a50f0 0x7fc3940bf280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:11.475 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:11.472+0000 7fc398b7c640 1 --2- 172.21.15.73:0/884347653 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc39406bf20 0x7fc3941e9d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:11.475 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:11.472+0000 7fc398b7c640 1 -- 172.21.15.73:0/884347653 >> 172.21.15.73:0/884347653 conn(0x7fc3940a8130 msgr2=0x7fc3940c59b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:46:11.475 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:11.473+0000 7fc398b7c640 1 -- 172.21.15.73:0/884347653 shutdown_connections 2023-12-12T09:46:11.475 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:11.473+0000 7fc398b7c640 1 -- 172.21.15.73:0/884347653 wait complete. 2023-12-12T09:46:11.492 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-12T09:46:11.699 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:11.697+0000 7fb375925640 1 Processor -- start 2023-12-12T09:46:11.699 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:11.698+0000 7fb375925640 1 -- start start 2023-12-12T09:46:11.701 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:11.699+0000 7fb375925640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fb37006bf90 0x7fb3701584f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:11.701 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:11.699+0000 7fb375925640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3700c4d00 con 0x7fb3700a5040 2023-12-12T09:46:11.701 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:11.699+0000 7fb375925640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb37006c400 con 0x7fb37006a4e0 2023-12-12T09:46:11.701 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:11.699+0000 7fb375925640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3700c5100 con 0x7fb37006bf90 2023-12-12T09:46:11.701 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:11.700+0000 7fb36effd640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7fb3700a5040 0x7fb3700c3ad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:52554/0 (socket says 172.21.15.73:52554) 2023-12-12T09:46:11.701 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:11.700+0000 7fb36effd640 1 -- 172.21.15.73:0/3827410667 learned_addr learned my addr 172.21.15.73:0/3827410667 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-12T09:46:11.701 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:11.700+0000 7fb3667fc640 1 --2- 172.21.15.73:0/3827410667 >> v2:172.21.15.73:3300/0 conn(0x7fb37006bf90 0x7fb3701584f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:11.702 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:11.700+0000 7fb36e7fc640 1 -- 172.21.15.73:0/3827410667 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2424190755 0 0) 0x7fb3700c4d00 con 0x7fb3700a5040 2023-12-12T09:46:11.702 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:11.700+0000 7fb36e7fc640 1 -- 172.21.15.73:0/3827410667 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb35c003520 con 0x7fb3700a5040 2023-12-12T09:46:11.702 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:11.700+0000 7fb3667fc640 1 -- 172.21.15.73:0/3827410667 >> v1:172.21.15.142:6789/0 conn(0x7fb37006a4e0 legacy=0x7fb37015f020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:46:11.702 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:11.700+0000 7fb3667fc640 1 -- 172.21.15.73:0/3827410667 >> v1:172.21.15.73:6789/0 conn(0x7fb3700a5040 legacy=0x7fb3700c3ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:11.702 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:11.700+0000 7fb3667fc640 1 -- 172.21.15.73:0/3827410667 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3700c53e0 con 0x7fb37006bf90 2023-12-12T09:46:11.703 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:11.701+0000 7fb3667fc640 1 --2- 172.21.15.73:0/3827410667 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb37006bf90 0x7fb3701584f0 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7fb3580097a0 tx=0x7fb35802b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9f32b0c6f55472a server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:46:11.703 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:11.702+0000 7fb36e7fc640 1 -- 172.21.15.73:0/3827410667 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb358030610 con 0x7fb37006bf90 2023-12-12T09:46:11.703 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:11.702+0000 7fb36e7fc640 1 -- 172.21.15.73:0/3827410667 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb358030770 con 0x7fb37006bf90 2023-12-12T09:46:11.703 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:11.702+0000 7fb36e7fc640 1 -- 172.21.15.73:0/3827410667 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb358030b00 con 0x7fb37006bf90 2023-12-12T09:46:11.704 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:11.702+0000 7fb375925640 1 -- 172.21.15.73:0/3827410667 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb37006bf90 msgr2=0x7fb3701584f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:11.704 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:11.702+0000 7fb375925640 1 --2- 172.21.15.73:0/3827410667 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb37006bf90 0x7fb3701584f0 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7fb3580097a0 tx=0x7fb35802b960 comp rx=0 tx=0).stop 2023-12-12T09:46:11.704 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:11.702+0000 7fb375925640 1 -- 172.21.15.73:0/3827410667 shutdown_connections 2023-12-12T09:46:11.704 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:11.702+0000 7fb375925640 1 --2- 172.21.15.73:0/3827410667 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb37006bf90 0x7fb3701584f0 unknown :-1 s=CLOSED pgs=806 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:11.704 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:11.702+0000 7fb375925640 1 -- 172.21.15.73:0/3827410667 >> 172.21.15.73:0/3827410667 conn(0x7fb3700a8130 msgr2=0x7fb3700c24b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:46:11.704 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:11.702+0000 7fb375925640 1 -- 172.21.15.73:0/3827410667 shutdown_connections 2023-12-12T09:46:11.704 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:11.703+0000 7fb375925640 1 -- 172.21.15.73:0/3827410667 wait complete. 2023-12-12T09:46:11.705 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:11.704+0000 7fb375925640 1 Processor -- start 2023-12-12T09:46:11.705 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:11.704+0000 7fb375925640 1 -- start start 2023-12-12T09:46:11.707 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:11.705+0000 7fb375925640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb37006a4e0 0x7fb370070f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:11.707 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:11.705+0000 7fb375925640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb37006bf90 0x7fb3700a8cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:11.707 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:11.705+0000 7fb375925640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb3700a5040 0x7fb3700a9200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:11.707 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:11.705+0000 7fb375925640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb37014b170 con 0x7fb37006bf90 2023-12-12T09:46:11.708 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:11.705+0000 7fb375925640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb370151140 con 0x7fb37006a4e0 2023-12-12T09:46:11.708 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:11.705+0000 7fb375925640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb370150e80 con 0x7fb3700a5040 2023-12-12T09:46:11.708 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:11.705+0000 7fb3667fc640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb37006bf90 0x7fb3700a8cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:11.708 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:11.705+0000 7fb3667fc640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb37006bf90 0x7fb3700a8cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:55474/0 (socket says 172.21.15.73:55474) 2023-12-12T09:46:11.708 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:11.705+0000 7fb3667fc640 1 -- 172.21.15.73:0/3829202815 learned_addr learned my addr 172.21.15.73:0/3829202815 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:46:11.708 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:11.706+0000 7fb36effd640 1 --2- 172.21.15.73:0/3829202815 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb37006a4e0 0x7fb370070f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:11.708 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:11.706+0000 7fb36f7fe640 1 --2- 172.21.15.73:0/3829202815 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb3700a5040 0x7fb3700a9200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:11.708 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:11.706+0000 7fb3667fc640 1 -- 172.21.15.73:0/3829202815 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb3700a5040 msgr2=0x7fb3700a9200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:11.708 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:11.706+0000 7fb3667fc640 1 --2- 172.21.15.73:0/3829202815 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb3700a5040 0x7fb3700a9200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:11.708 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:11.706+0000 7fb3667fc640 1 -- 172.21.15.73:0/3829202815 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb37006a4e0 msgr2=0x7fb370070f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:11.708 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:11.706+0000 7fb3667fc640 1 --2- 172.21.15.73:0/3829202815 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb37006a4e0 0x7fb370070f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:11.708 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:11.706+0000 7fb3667fc640 1 -- 172.21.15.73:0/3829202815 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb358009400 con 0x7fb37006bf90 2023-12-12T09:46:11.708 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:11.706+0000 7fb36effd640 1 --2- 172.21.15.73:0/3829202815 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb37006a4e0 0x7fb370070f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:46:11.708 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:11.706+0000 7fb3667fc640 1 --2- 172.21.15.73:0/3829202815 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb37006bf90 0x7fb3700a8cc0 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7fb3580098c0 tx=0x7fb358004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:46:11.709 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:11.706+0000 7fb36cff9640 1 -- 172.21.15.73:0/3829202815 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb35803e040 con 0x7fb37006bf90 2023-12-12T09:46:11.709 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:11.706+0000 7fb36cff9640 1 -- 172.21.15.73:0/3829202815 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb358039cb0 con 0x7fb37006bf90 2023-12-12T09:46:11.709 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:11.706+0000 7fb36cff9640 1 -- 172.21.15.73:0/3829202815 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb358044630 con 0x7fb37006bf90 2023-12-12T09:46:11.710 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:11.706+0000 7fb375925640 1 -- 172.21.15.73:0/3829202815 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb37014a9f0 con 0x7fb37006bf90 2023-12-12T09:46:11.710 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:11.707+0000 7fb375925640 1 -- 172.21.15.73:0/3829202815 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3701ee100 con 0x7fb37006bf90 2023-12-12T09:46:11.710 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:11.708+0000 7fb375925640 1 -- 172.21.15.73:0/3829202815 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb370067580 con 0x7fb37006bf90 2023-12-12T09:46:11.710 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:11.709+0000 7fb36cff9640 1 -- 172.21.15.73:0/3829202815 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fb358043390 con 0x7fb37006bf90 2023-12-12T09:46:11.711 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:11.710+0000 7fb36cff9640 1 --2- 172.21.15.73:0/3829202815 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fb35006ae40 0x7fb35006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:11.711 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:11.710+0000 7fb36cff9640 1 -- 172.21.15.73:0/3829202815 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 5857+0+0 (secure 0 0 0) 0x7fb3580ab7b0 con 0x7fb37006bf90 2023-12-12T09:46:11.711 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:11.710+0000 7fb36effd640 1 --2- 172.21.15.73:0/3829202815 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fb35006ae40 0x7fb35006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:11.712 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:11.710+0000 7fb36effd640 1 --2- 172.21.15.73:0/3829202815 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fb35006ae40 0x7fb35006d300 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fb360007fd0 tx=0x7fb360009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:46:11.715 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:11.714+0000 7fb36cff9640 1 -- 172.21.15.73:0/3829202815 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fb358076850 con 0x7fb37006bf90 2023-12-12T09:46:11.941 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:11.940+0000 7fb375925640 1 -- 172.21.15.73:0/3829202815 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb3700c32a0 con 0x7fb37006bf90 2023-12-12T09:46:11.942 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:11.941+0000 7fb36cff9640 1 -- 172.21.15.73:0/3829202815 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 37 v37) v1 ==== 94+0+4920 (secure 0 0 0) 0x7fb358079e70 con 0x7fb37006bf90 2023-12-12T09:46:11.943 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-12T09:46:11.943 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":37,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4736,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6834/2964437845","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6832","nonce":2964437845},{"type":"v1","addr":"172.21.15.142:6834","nonce":2964437845}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":25},{"gid":5044,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6837/3698725764","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6836","nonce":3698725764},{"type":"v1","addr":"172.21.15.73:6837","nonce":3698725764}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":25},{"gid":6255,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6835/706333502","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":706333502},{"type":"v1","addr":"172.21.15.73:6835","nonce":706333502}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":37}],"filesystems":[{"mdsmap":{"epoch":35,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-12T09:45:38.103609+0000","modified":"2023-12-12T09:45:41.148650+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5059},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5059":{"gid":5059,"name":"d","rank":0,"incarnation":31,"state":"up:active","state_seq":7,"addr":"172.21.15.142:6835/2931058847","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6833","nonce":2931058847},{"type":"v1","addr":"172.21.15.142:6835","nonce":2931058847}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2023-12-12T09:46:11.943 INFO:teuthology.orchestra.run.smithi073.stderr:dumped fsmap epoch 37 2023-12-12T09:46:11.945 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:11.944+0000 7fb375925640 1 -- 172.21.15.73:0/3829202815 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fb35006ae40 msgr2=0x7fb35006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:11.945 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:11.944+0000 7fb375925640 1 --2- 172.21.15.73:0/3829202815 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fb35006ae40 0x7fb35006d300 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fb360007fd0 tx=0x7fb360009040 comp rx=0 tx=0).stop 2023-12-12T09:46:11.945 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:11.944+0000 7fb375925640 1 -- 172.21.15.73:0/3829202815 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb37006bf90 msgr2=0x7fb3700a8cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:11.945 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:11.944+0000 7fb375925640 1 --2- 172.21.15.73:0/3829202815 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb37006bf90 0x7fb3700a8cc0 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7fb3580098c0 tx=0x7fb358004730 comp rx=0 tx=0).stop 2023-12-12T09:46:11.946 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:11.944+0000 7fb375925640 1 -- 172.21.15.73:0/3829202815 shutdown_connections 2023-12-12T09:46:11.946 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:11.944+0000 7fb375925640 1 --2- 172.21.15.73:0/3829202815 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fb35006ae40 0x7fb35006d300 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:11.946 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:11.944+0000 7fb375925640 1 --2- 172.21.15.73:0/3829202815 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb3700a5040 0x7fb3700a9200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:11.946 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:11.944+0000 7fb375925640 1 --2- 172.21.15.73:0/3829202815 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb37006bf90 0x7fb3700a8cc0 unknown :-1 s=CLOSED pgs=807 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:11.946 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:11.944+0000 7fb375925640 1 --2- 172.21.15.73:0/3829202815 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb37006a4e0 0x7fb370070f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:11.946 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:11.944+0000 7fb375925640 1 -- 172.21.15.73:0/3829202815 >> 172.21.15.73:0/3829202815 conn(0x7fb3700a8130 msgr2=0x7fb3700c3ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:46:11.946 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:11.944+0000 7fb375925640 1 -- 172.21.15.73:0/3829202815 shutdown_connections 2023-12-12T09:46:11.946 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:11.944+0000 7fb375925640 1 -- 172.21.15.73:0/3829202815 wait complete. 2023-12-12T09:46:11.964 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-12T09:46:12.163 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:12.161+0000 7f0cdf4e0640 1 Processor -- start 2023-12-12T09:46:12.163 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:12.161+0000 7f0cdf4e0640 1 -- start start 2023-12-12T09:46:12.164 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:12.163+0000 7f0cdf4e0640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0cd806bf20 0x7f0cd80a9760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:12.164 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:12.163+0000 7f0cdf4e0640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0cd80c0b50 con 0x7f0cd81552e0 2023-12-12T09:46:12.164 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:12.163+0000 7f0cdf4e0640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0cd806c880 con 0x7f0cd80a50f0 2023-12-12T09:46:12.164 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:12.163+0000 7f0cdf4e0640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0cd80c04d0 con 0x7f0cd806bf20 2023-12-12T09:46:12.164 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:12.163+0000 7f0cdd27c640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f0cd81552e0 0x7f0cd80c49c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:52568/0 (socket says 172.21.15.73:52568) 2023-12-12T09:46:12.165 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:12.163+0000 7f0cdd27c640 1 -- 172.21.15.73:0/3138134688 learned_addr learned my addr 172.21.15.73:0/3138134688 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-12T09:46:12.166 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:12.163+0000 7f0cdda7d640 1 --2- 172.21.15.73:0/3138134688 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0cd806bf20 0x7f0cd80a9760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:12.166 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:12.163+0000 7f0ccffff640 1 -- 172.21.15.73:0/3138134688 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 472142379 0 0) 0x7f0cd80c0b50 con 0x7f0cd81552e0 2023-12-12T09:46:12.166 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:12.164+0000 7f0ccffff640 1 -- 172.21.15.73:0/3138134688 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0cc4003520 con 0x7f0cd81552e0 2023-12-12T09:46:12.167 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:12.164+0000 7f0ccffff640 1 -- 172.21.15.73:0/3138134688 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2722527211 0 0) 0x7f0cc4003520 con 0x7f0cd81552e0 2023-12-12T09:46:12.167 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:12.164+0000 7f0ccffff640 1 -- 172.21.15.73:0/3138134688 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0cd806bf20 msgr2=0x7f0cd80a9760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:46:12.167 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:12.164+0000 7f0ccffff640 1 --2- 172.21.15.73:0/3138134688 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0cd806bf20 0x7f0cd80a9760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:12.167 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:12.164+0000 7f0ccffff640 1 -- 172.21.15.73:0/3138134688 >> v1:172.21.15.142:6789/0 conn(0x7f0cd80a50f0 legacy=0x7f0cd80a9050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:12.167 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:12.164+0000 7f0ccffff640 1 -- 172.21.15.73:0/3138134688 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cd806cb60 con 0x7f0cd81552e0 2023-12-12T09:46:12.167 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:12.164+0000 7f0ccffff640 1 -- 172.21.15.73:0/3138134688 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3186547832 0 0) 0x7f0cd4001670 con 0x7f0cd81552e0 2023-12-12T09:46:12.167 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:12.164+0000 7f0ccffff640 1 -- 172.21.15.73:0/3138134688 >> v1:172.21.15.73:6789/0 conn(0x7f0cd81552e0 legacy=0x7f0cd80c49c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:12.167 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:12.164+0000 7f0ccffff640 1 --2- 172.21.15.73:0/3138134688 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0cd806bf20 0x7f0cc40039a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:12.167 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:12.164+0000 7f0ccffff640 1 --2- 172.21.15.73:0/3138134688 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0cc4003f20 0x7f0cc40047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:12.167 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:12.164+0000 7f0ccffff640 1 --2- 172.21.15.73:0/3138134688 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0cc4004d00 0x7f0cc4005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:12.167 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:12.164+0000 7f0ccffff640 1 -- 172.21.15.73:0/3138134688 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cd80c04d0 con 0x7f0cc4003f20 2023-12-12T09:46:12.167 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:12.164+0000 7f0ccffff640 1 -- 172.21.15.73:0/3138134688 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cc400bb10 con 0x7f0cc4004d00 2023-12-12T09:46:12.167 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:12.164+0000 7f0ccffff640 1 -- 172.21.15.73:0/3138134688 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0cc400bcd0 con 0x7f0cd806bf20 2023-12-12T09:46:12.167 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:12.164+0000 7f0cdca7b640 1 --2- 172.21.15.73:0/3138134688 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0cc4003f20 0x7f0cc40047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:12.168 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:12.165+0000 7f0cdda7d640 1 --2- 172.21.15.73:0/3138134688 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0cc4004d00 0x7f0cc4005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:12.168 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:12.165+0000 7f0cdd27c640 1 --2- 172.21.15.73:0/3138134688 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0cd806bf20 0x7f0cc40039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:12.168 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:12.165+0000 7f0cdca7b640 1 -- 172.21.15.73:0/3138134688 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0cd806bf20 msgr2=0x7f0cc40039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:46:12.168 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:12.165+0000 7f0cdca7b640 1 --2- 172.21.15.73:0/3138134688 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0cd806bf20 0x7f0cc40039a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:12.168 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:12.165+0000 7f0cdca7b640 1 -- 172.21.15.73:0/3138134688 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0cc4004d00 msgr2=0x7f0cc4005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:46:12.168 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:12.165+0000 7f0cdca7b640 1 --2- 172.21.15.73:0/3138134688 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0cc4004d00 0x7f0cc4005180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:12.168 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:12.165+0000 7f0cdca7b640 1 -- 172.21.15.73:0/3138134688 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cc4003520 con 0x7f0cc4003f20 2023-12-12T09:46:12.168 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:12.165+0000 7f0cdd27c640 1 --2- 172.21.15.73:0/3138134688 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0cd806bf20 0x7f0cc40039a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:46:12.170 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:12.166+0000 7f0cdca7b640 1 --2- 172.21.15.73:0/3138134688 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0cc4003f20 0x7f0cc40047c0 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7f0cc8001330 tx=0x7f0cc40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ef2f456e543d99b server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:46:12.171 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:12.166+0000 7f0ccffff640 1 -- 172.21.15.73:0/3138134688 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cc802f040 con 0x7f0cc4003f20 2023-12-12T09:46:12.171 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:12.166+0000 7f0ccffff640 1 -- 172.21.15.73:0/3138134688 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0cc80052d0 con 0x7f0cc4003f20 2023-12-12T09:46:12.171 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:12.166+0000 7f0ccffff640 1 -- 172.21.15.73:0/3138134688 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cc80035f0 con 0x7f0cc4003f20 2023-12-12T09:46:12.171 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:12.167+0000 7f0cdf4e0640 1 -- 172.21.15.73:0/3138134688 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0cc4003f20 msgr2=0x7f0cc40047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:12.171 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:12.167+0000 7f0cdf4e0640 1 --2- 172.21.15.73:0/3138134688 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0cc4003f20 0x7f0cc40047c0 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7f0cc8001330 tx=0x7f0cc40057f0 comp rx=0 tx=0).stop 2023-12-12T09:46:12.171 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:12.167+0000 7f0cdda7d640 1 -- 172.21.15.73:0/3138134688 reap_dead start 2023-12-12T09:46:12.171 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:12.167+0000 7f0cdf4e0640 1 -- 172.21.15.73:0/3138134688 shutdown_connections 2023-12-12T09:46:12.171 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:12.167+0000 7f0cdf4e0640 1 -- 172.21.15.73:0/3138134688 >> 172.21.15.73:0/3138134688 conn(0x7f0cd80a8130 msgr2=0x7f0cd80c24b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:46:12.171 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:12.167+0000 7f0cdf4e0640 1 -- 172.21.15.73:0/3138134688 shutdown_connections 2023-12-12T09:46:12.171 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:12.167+0000 7f0cdf4e0640 1 -- 172.21.15.73:0/3138134688 wait complete. 2023-12-12T09:46:12.171 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:12.169+0000 7f0cdf4e0640 1 Processor -- start 2023-12-12T09:46:12.171 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:12.169+0000 7f0cdf4e0640 1 -- start start 2023-12-12T09:46:12.173 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:12.170+0000 7f0cdf4e0640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0cc4003f20 0x7f0cd806ffa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:12.173 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:12.170+0000 7f0cdf4e0640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0cd80706b0 0x7f0cd81ed620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:12.173 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:12.170+0000 7f0cdf4e0640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0cd8148960 0x7f0cd8145090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:12.173 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:12.170+0000 7f0cdf4e0640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cd80704e0 con 0x7f0cc4003f20 2023-12-12T09:46:12.173 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:12.170+0000 7f0cdf4e0640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cd8154af0 con 0x7f0cd8148960 2023-12-12T09:46:12.173 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:12.170+0000 7f0cdf4e0640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0cd81edb60 con 0x7f0cd80706b0 2023-12-12T09:46:12.173 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:12.170+0000 7f0cdd27c640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0cc4003f20 0x7f0cd806ffa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:12.173 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:12.170+0000 7f0cdd27c640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0cc4003f20 0x7f0cd806ffa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:55490/0 (socket says 172.21.15.73:55490) 2023-12-12T09:46:12.173 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:12.170+0000 7f0cdd27c640 1 -- 172.21.15.73:0/3186904687 learned_addr learned my addr 172.21.15.73:0/3186904687 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:46:12.173 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:12.170+0000 7f0cdd27c640 1 -- 172.21.15.73:0/3186904687 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0cd80706b0 msgr2=0x7f0cd81ed620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:12.174 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:12.170+0000 7f0cdd27c640 1 --2- 172.21.15.73:0/3186904687 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0cd80706b0 0x7f0cd81ed620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:12.174 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:12.170+0000 7f0cdd27c640 1 -- 172.21.15.73:0/3186904687 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0cd8148960 msgr2=0x7f0cd8145090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:12.174 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:12.170+0000 7f0cdd27c640 1 --2- 172.21.15.73:0/3186904687 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0cd8148960 0x7f0cd8145090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:12.174 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:12.170+0000 7f0cdd27c640 1 -- 172.21.15.73:0/3186904687 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cd80aa210 con 0x7f0cc4003f20 2023-12-12T09:46:12.174 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:12.171+0000 7f0cdd27c640 1 --2- 172.21.15.73:0/3186904687 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0cc4003f20 0x7f0cd806ffa0 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7f0cd400d7e0 tx=0x7f0cd400dca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:46:12.174 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:12.171+0000 7f0ccdffb640 1 -- 172.21.15.73:0/3186904687 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cd40074e0 con 0x7f0cc4003f20 2023-12-12T09:46:12.174 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:12.171+0000 7f0ccdffb640 1 -- 172.21.15.73:0/3186904687 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0cd4007640 con 0x7f0cc4003f20 2023-12-12T09:46:12.174 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:12.171+0000 7f0ccdffb640 1 -- 172.21.15.73:0/3186904687 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cd40049e0 con 0x7f0cc4003f20 2023-12-12T09:46:12.174 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:12.171+0000 7f0cdf4e0640 1 -- 172.21.15.73:0/3186904687 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0cd81eac60 con 0x7f0cc4003f20 2023-12-12T09:46:12.174 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:12.171+0000 7f0cdf4e0640 1 -- 172.21.15.73:0/3186904687 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0cd8154780 con 0x7f0cc4003f20 2023-12-12T09:46:12.175 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:12.172+0000 7f0cdf4e0640 1 -- 172.21.15.73:0/3186904687 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0cd81556c0 con 0x7f0cc4003f20 2023-12-12T09:46:12.175 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:12.173+0000 7f0ccdffb640 1 -- 172.21.15.73:0/3186904687 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f0cd4004b40 con 0x7f0cc4003f20 2023-12-12T09:46:12.175 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:12.174+0000 7f0ccdffb640 1 --2- 172.21.15.73:0/3186904687 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f0cbc06ae70 0x7f0cbc06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:12.175 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:12.174+0000 7f0ccdffb640 1 -- 172.21.15.73:0/3186904687 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 5857+0+0 (secure 0 0 0) 0x7f0cd4088ee0 con 0x7f0cc4003f20 2023-12-12T09:46:12.175 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:12.174+0000 7f0cdca7b640 1 --2- 172.21.15.73:0/3186904687 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f0cbc06ae70 0x7f0cbc06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:12.176 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:12.175+0000 7f0cdca7b640 1 --2- 172.21.15.73:0/3186904687 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f0cbc06ae70 0x7f0cbc06d330 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f0cd814e6b0 tx=0x7f0cc8032000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:46:12.179 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:12.178+0000 7f0ccdffb640 1 -- 172.21.15.73:0/3186904687 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f0cd4053ee0 con 0x7f0cc4003f20 2023-12-12T09:46:12.374 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:12.372+0000 7f0cdf4e0640 1 -- 172.21.15.73:0/3186904687 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0cd8067580 con 0x7f0cc4003f20 2023-12-12T09:46:12.376 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:12.374+0000 7f0ccdffb640 1 -- 172.21.15.73:0/3186904687 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v63) v1 ==== 74+0+16808 (secure 0 0 0) 0x7f0cd4019020 con 0x7f0cc4003f20 2023-12-12T09:46:12.377 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-12T09:46:12.377 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":63,"fsid":"ba240992-02b8-4c7e-92f2-27eb29ac433b","created":"2023-12-12T09:43:02.454719+0000","modified":"2023-12-12T09:46:10.308407+0000","last_up_change":"2023-12-12T09:43:13.913440+0000","last_in_change":"2023-12-12T09:43:05.925348+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-12T09:43:15.525508+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs2_metadata","create_time":"2023-12-12T09:45:36.388393+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"57","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs2_data","create_time":"2023-12-12T09:45:37.109653+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"58","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"dd9074be-dbe2-4c34-9896-a4223d8d3940","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":4047810203},{"type":"v1","addr":"172.21.15.73:6801","nonce":4047810203}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":4047810203},{"type":"v1","addr":"172.21.15.73:6803","nonce":4047810203}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":4047810203},{"type":"v1","addr":"172.21.15.73:6807","nonce":4047810203}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":4047810203},{"type":"v1","addr":"172.21.15.73:6805","nonce":4047810203}]},"public_addr":"172.21.15.73:6801/4047810203","cluster_addr":"172.21.15.73:6803/4047810203","heartbeat_back_addr":"172.21.15.73:6807/4047810203","heartbeat_front_addr":"172.21.15.73:6805/4047810203","state":["exists","up"]},{"osd":1,"uuid":"c4a05052-96d4-4758-a4e1-1a37f1e07fed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":1356058331},{"type":"v1","addr":"172.21.15.73:6824","nonce":1356058331}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":1356058331},{"type":"v1","addr":"172.21.15.73:6827","nonce":1356058331}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":1356058331},{"type":"v1","addr":"172.21.15.73:6831","nonce":1356058331}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":1356058331},{"type":"v1","addr":"172.21.15.73:6829","nonce":1356058331}]},"public_addr":"172.21.15.73:6824/1356058331","cluster_addr":"172.21.15.73:6827/1356058331","heartbeat_back_addr":"172.21.15.73:6831/1356058331","heartbeat_front_addr":"172.21.15.73:6829/1356058331","state":["exists","up"]},{"osd":2,"uuid":"512bc8ac-72c2-40d4-b3d2-d867a92c5213","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":1228903316},{"type":"v1","addr":"172.21.15.73:6817","nonce":1228903316}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":1228903316},{"type":"v1","addr":"172.21.15.73:6819","nonce":1228903316}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6823","nonce":1228903316},{"type":"v1","addr":"172.21.15.73:6825","nonce":1228903316}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":1228903316},{"type":"v1","addr":"172.21.15.73:6821","nonce":1228903316}]},"public_addr":"172.21.15.73:6817/1228903316","cluster_addr":"172.21.15.73:6819/1228903316","heartbeat_back_addr":"172.21.15.73:6825/1228903316","heartbeat_front_addr":"172.21.15.73:6821/1228903316","state":["exists","up"]},{"osd":3,"uuid":"3d1a91e0-42bf-437a-8eae-8d357c8f63a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":1293329670},{"type":"v1","addr":"172.21.15.73:6809","nonce":1293329670}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6810","nonce":1293329670},{"type":"v1","addr":"172.21.15.73:6811","nonce":1293329670}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":1293329670},{"type":"v1","addr":"172.21.15.73:6815","nonce":1293329670}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":1293329670},{"type":"v1","addr":"172.21.15.73:6813","nonce":1293329670}]},"public_addr":"172.21.15.73:6809/1293329670","cluster_addr":"172.21.15.73:6811/1293329670","heartbeat_back_addr":"172.21.15.73:6815/1293329670","heartbeat_front_addr":"172.21.15.73:6813/1293329670","state":["exists","up"]},{"osd":4,"uuid":"4b302fff-834c-4069-ac19-00e46f6c87b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":3727975702},{"type":"v1","addr":"172.21.15.142:6801","nonce":3727975702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":3727975702},{"type":"v1","addr":"172.21.15.142:6803","nonce":3727975702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6809","nonce":3727975702},{"type":"v1","addr":"172.21.15.142:6811","nonce":3727975702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6805","nonce":3727975702},{"type":"v1","addr":"172.21.15.142:6807","nonce":3727975702}]},"public_addr":"172.21.15.142:6801/3727975702","cluster_addr":"172.21.15.142:6803/3727975702","heartbeat_back_addr":"172.21.15.142:6811/3727975702","heartbeat_front_addr":"172.21.15.142:6807/3727975702","state":["exists","up"]},{"osd":5,"uuid":"d7cdace2-67d0-45cc-95f2-515cf6ef1b82","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6817","nonce":2353193632},{"type":"v1","addr":"172.21.15.142:6819","nonce":2353193632}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6821","nonce":2353193632},{"type":"v1","addr":"172.21.15.142:6823","nonce":2353193632}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6829","nonce":2353193632},{"type":"v1","addr":"172.21.15.142:6831","nonce":2353193632}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6825","nonce":2353193632},{"type":"v1","addr":"172.21.15.142:6827","nonce":2353193632}]},"public_addr":"172.21.15.142:6819/2353193632","cluster_addr":"172.21.15.142:6823/2353193632","heartbeat_back_addr":"172.21.15.142:6831/2353193632","heartbeat_front_addr":"172.21.15.142:6827/2353193632","state":["exists","up"]},{"osd":6,"uuid":"649ce78a-5626-445c-aedc-a651ed05a6f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":2006111986},{"type":"v1","addr":"172.21.15.142:6806","nonce":2006111986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":2006111986},{"type":"v1","addr":"172.21.15.142:6810","nonce":2006111986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":2006111986},{"type":"v1","addr":"172.21.15.142:6815","nonce":2006111986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":2006111986},{"type":"v1","addr":"172.21.15.142:6813","nonce":2006111986}]},"public_addr":"172.21.15.142:6806/2006111986","cluster_addr":"172.21.15.142:6810/2006111986","heartbeat_back_addr":"172.21.15.142:6815/2006111986","heartbeat_front_addr":"172.21.15.142:6813/2006111986","state":["exists","up"]},{"osd":7,"uuid":"af15ae3b-c1d0-4acf-92db-8a1805494d13","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":2573794341},{"type":"v1","addr":"172.21.15.142:6818","nonce":2573794341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":2573794341},{"type":"v1","addr":"172.21.15.142:6822","nonce":2573794341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":2573794341},{"type":"v1","addr":"172.21.15.142:6830","nonce":2573794341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":2573794341},{"type":"v1","addr":"172.21.15.142:6826","nonce":2573794341}]},"public_addr":"172.21.15.142:6818/2573794341","cluster_addr":"172.21.15.142:6822/2573794341","heartbeat_back_addr":"172.21.15.142:6830/2573794341","heartbeat_front_addr":"172.21.15.142:6826/2573794341","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.185824+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.262103+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.225556+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:10.523459+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:10.706035+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.257339+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.301776+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.051960+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"11.1","mappings":[{"from":6,"to":0}]},{"pgid":"11.38","mappings":[{"from":6,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.73:6835/744058726":"2023-12-13T09:46:05.274143+0000","172.21.15.73:6834/744058726":"2023-12-13T09:46:05.274143+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-12T09:46:12.380 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:12.377+0000 7f0cdf4e0640 1 -- 172.21.15.73:0/3186904687 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f0cbc06ae70 msgr2=0x7f0cbc06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:12.380 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:12.377+0000 7f0cdf4e0640 1 --2- 172.21.15.73:0/3186904687 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f0cbc06ae70 0x7f0cbc06d330 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f0cd814e6b0 tx=0x7f0cc8032000 comp rx=0 tx=0).stop 2023-12-12T09:46:12.380 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:12.377+0000 7f0cdf4e0640 1 -- 172.21.15.73:0/3186904687 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0cc4003f20 msgr2=0x7f0cd806ffa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:12.380 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:12.377+0000 7f0cdf4e0640 1 --2- 172.21.15.73:0/3186904687 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0cc4003f20 0x7f0cd806ffa0 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7f0cd400d7e0 tx=0x7f0cd400dca0 comp rx=0 tx=0).stop 2023-12-12T09:46:12.380 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:12.377+0000 7f0cdf4e0640 1 -- 172.21.15.73:0/3186904687 shutdown_connections 2023-12-12T09:46:12.381 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:12.377+0000 7f0cdf4e0640 1 --2- 172.21.15.73:0/3186904687 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f0cbc06ae70 0x7f0cbc06d330 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:12.381 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:12.377+0000 7f0cdf4e0640 1 --2- 172.21.15.73:0/3186904687 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0cd8148960 0x7f0cd8145090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:12.381 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:12.377+0000 7f0cdf4e0640 1 --2- 172.21.15.73:0/3186904687 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0cd80706b0 0x7f0cd81ed620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:12.381 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:12.377+0000 7f0cdf4e0640 1 --2- 172.21.15.73:0/3186904687 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0cc4003f20 0x7f0cd806ffa0 unknown :-1 s=CLOSED pgs=810 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:12.381 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:12.377+0000 7f0cdf4e0640 1 -- 172.21.15.73:0/3186904687 >> 172.21.15.73:0/3186904687 conn(0x7f0cd80a8130 msgr2=0x7f0cd814aad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:46:12.381 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:12.378+0000 7f0cdf4e0640 1 -- 172.21.15.73:0/3186904687 shutdown_connections 2023-12-12T09:46:12.381 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:12.378+0000 7f0cdf4e0640 1 -- 172.21.15.73:0/3186904687 wait complete. 2023-12-12T09:46:12.398 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs2 2023-12-12T09:46:12.606 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:12.605+0000 7f2b29013640 1 Processor -- start 2023-12-12T09:46:12.607 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:12.605+0000 7f2b29013640 1 -- start start 2023-12-12T09:46:12.608 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:12.606+0000 7f2b29013640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2b240aae70 0x7f2b2414f2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:12.608 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:12.606+0000 7f2b29013640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f2b2414f7f0 0x7f2b240c3e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:12.608 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:12.606+0000 7f2b29013640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b24152240 con 0x7f2b240a4c90 2023-12-12T09:46:12.608 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:12.607+0000 7f2b29013640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b2406c3f0 con 0x7f2b2414f7f0 2023-12-12T09:46:12.608 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:12.607+0000 7f2b29013640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b24152520 con 0x7f2b240aae70 2023-12-12T09:46:12.608 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:12.607+0000 7f2b28812640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f2b2414f7f0 0x7f2b240c3e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:12.609 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:12.607+0000 7f2b28812640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f2b2414f7f0 0x7f2b240c3e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:55492/0 (socket says 172.21.15.73:55492) 2023-12-12T09:46:12.609 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:12.607+0000 7f2b28812640 1 -- 172.21.15.73:0/543920719 learned_addr learned my addr 172.21.15.73:0/543920719 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:46:12.609 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:12.607+0000 7f2b23fff640 1 --2- 172.21.15.73:0/543920719 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2b240aae70 0x7f2b2414f2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:12.609 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:12.607+0000 7f2b28812640 1 -- 172.21.15.73:0/543920719 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2b240aae70 msgr2=0x7f2b2414f2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:46:12.609 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:12.607+0000 7f2b28812640 1 --2- 172.21.15.73:0/543920719 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2b240aae70 0x7f2b2414f2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:12.610 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:12.607+0000 7f2b28812640 1 -- 172.21.15.73:0/543920719 >> v1:172.21.15.142:6789/0 conn(0x7f2b240a4c90 legacy=0x7f2b240c3740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:46:12.610 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:12.607+0000 7f2b28812640 1 -- 172.21.15.73:0/543920719 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b24152800 con 0x7f2b2414f7f0 2023-12-12T09:46:12.610 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:12.607+0000 7f2b23fff640 1 --2- 172.21.15.73:0/543920719 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2b240aae70 0x7f2b2414f2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:46:12.611 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:12.608+0000 7f2b28812640 1 --2- 172.21.15.73:0/543920719 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2b2414f7f0 0x7f2b240c3e50 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7f2b1c009e50 tx=0x7f2b1c02bdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d5a4f9f12dbbd7f server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:46:12.611 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:12.609+0000 7f2b237fe640 1 -- 172.21.15.73:0/543920719 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b1c02c950 con 0x7f2b2414f7f0 2023-12-12T09:46:12.611 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:12.609+0000 7f2b237fe640 1 -- 172.21.15.73:0/543920719 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b1c02cab0 con 0x7f2b2414f7f0 2023-12-12T09:46:12.611 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:12.609+0000 7f2b237fe640 1 -- 172.21.15.73:0/543920719 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b1c02ce40 con 0x7f2b2414f7f0 2023-12-12T09:46:12.611 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:12.609+0000 7f2b29013640 1 -- 172.21.15.73:0/543920719 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2b2414f7f0 msgr2=0x7f2b240c3e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:12.611 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:12.609+0000 7f2b29013640 1 --2- 172.21.15.73:0/543920719 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2b2414f7f0 0x7f2b240c3e50 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7f2b1c009e50 tx=0x7f2b1c02bdb0 comp rx=0 tx=0).stop 2023-12-12T09:46:12.611 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:12.609+0000 7f2b29013640 1 -- 172.21.15.73:0/543920719 shutdown_connections 2023-12-12T09:46:12.611 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:12.609+0000 7f2b29013640 1 --2- 172.21.15.73:0/543920719 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2b2414f7f0 0x7f2b240c3e50 unknown :-1 s=CLOSED pgs=811 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:12.611 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:12.609+0000 7f2b29013640 1 --2- 172.21.15.73:0/543920719 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2b240aae70 0x7f2b2414f2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:12.611 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:12.609+0000 7f2b29013640 1 -- 172.21.15.73:0/543920719 >> 172.21.15.73:0/543920719 conn(0x7f2b240a75f0 msgr2=0x7f2b240a7a00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:46:12.612 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:12.610+0000 7f2b29013640 1 -- 172.21.15.73:0/543920719 shutdown_connections 2023-12-12T09:46:12.612 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:12.610+0000 7f2b29013640 1 -- 172.21.15.73:0/543920719 wait complete. 2023-12-12T09:46:12.612 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:12.611+0000 7f2b29013640 1 Processor -- start 2023-12-12T09:46:12.613 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:12.612+0000 7f2b29013640 1 -- start start 2023-12-12T09:46:12.618 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:12.612+0000 7f2b29013640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2b240a4c90 0x7f2b241ea460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:12.618 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:12.612+0000 7f2b29013640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2b240aae70 0x7f2b241dce90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:12.619 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:12.612+0000 7f2b29013640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2b2414f7f0 0x7f2b2406fc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:12.619 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:12.612+0000 7f2b29013640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b241539e0 con 0x7f2b240aae70 2023-12-12T09:46:12.619 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:12.612+0000 7f2b29013640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b241dca00 con 0x7f2b240a4c90 2023-12-12T09:46:12.619 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:12.612+0000 7f2b29013640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b241dd3d0 con 0x7f2b2414f7f0 2023-12-12T09:46:12.619 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:12.613+0000 7f2b1bfff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2b240aae70 0x7f2b241dce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:12.619 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:12.613+0000 7f2b1bfff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2b240aae70 0x7f2b241dce90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:55500/0 (socket says 172.21.15.73:55500) 2023-12-12T09:46:12.619 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:12.613+0000 7f2b1bfff640 1 -- 172.21.15.73:0/800890740 learned_addr learned my addr 172.21.15.73:0/800890740 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:46:12.619 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:12.613+0000 7f2b1bfff640 1 -- 172.21.15.73:0/800890740 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2b2414f7f0 msgr2=0x7f2b2406fc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:12.619 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:12.613+0000 7f2b28812640 1 --2- 172.21.15.73:0/800890740 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2b2414f7f0 0x7f2b2406fc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:12.619 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:12.613+0000 7f2b1bfff640 1 --2- 172.21.15.73:0/800890740 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2b2414f7f0 0x7f2b2406fc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:12.619 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:12.613+0000 7f2b23fff640 1 --2- 172.21.15.73:0/800890740 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2b240a4c90 0x7f2b241ea460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:12.619 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:12.613+0000 7f2b1bfff640 1 -- 172.21.15.73:0/800890740 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2b240a4c90 msgr2=0x7f2b241ea460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:12.619 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:12.613+0000 7f2b1bfff640 1 --2- 172.21.15.73:0/800890740 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2b240a4c90 0x7f2b241ea460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:12.619 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:12.613+0000 7f2b1bfff640 1 -- 172.21.15.73:0/800890740 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b1c009b30 con 0x7f2b240aae70 2023-12-12T09:46:12.620 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:12.614+0000 7f2b1bfff640 1 --2- 172.21.15.73:0/800890740 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2b240aae70 0x7f2b241dce90 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7f2b0c00b3f0 tx=0x7f2b0c00b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:46:12.620 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:12.614+0000 7f2b217fa640 1 -- 172.21.15.73:0/800890740 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b0c011830 con 0x7f2b240aae70 2023-12-12T09:46:12.620 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:12.614+0000 7f2b217fa640 1 -- 172.21.15.73:0/800890740 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b0c011990 con 0x7f2b240aae70 2023-12-12T09:46:12.620 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:12.614+0000 7f2b29013640 1 -- 172.21.15.73:0/800890740 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b241dbdf0 con 0x7f2b240aae70 2023-12-12T09:46:12.620 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:12.614+0000 7f2b217fa640 1 -- 172.21.15.73:0/800890740 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b0c011d40 con 0x7f2b240aae70 2023-12-12T09:46:12.620 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:12.614+0000 7f2b29013640 1 -- 172.21.15.73:0/800890740 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b241dc3b0 con 0x7f2b240aae70 2023-12-12T09:46:12.620 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:12.615+0000 7f2b29013640 1 -- 172.21.15.73:0/800890740 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b2406c030 con 0x7f2b240aae70 2023-12-12T09:46:12.620 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:12.616+0000 7f2b217fa640 1 -- 172.21.15.73:0/800890740 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f2b0c01a400 con 0x7f2b240aae70 2023-12-12T09:46:12.620 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:12.617+0000 7f2b217fa640 1 --2- 172.21.15.73:0/800890740 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f2b0406ae40 0x7f2b0406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:12.620 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:12.617+0000 7f2b217fa640 1 -- 172.21.15.73:0/800890740 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 5857+0+0 (secure 0 0 0) 0x7f2b0c089690 con 0x7f2b240aae70 2023-12-12T09:46:12.620 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:12.617+0000 7f2b23fff640 1 --2- 172.21.15.73:0/800890740 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f2b0406ae40 0x7f2b0406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:12.621 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:12.617+0000 7f2b23fff640 1 --2- 172.21.15.73:0/800890740 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f2b0406ae40 0x7f2b0406d300 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f2b1400b840 tx=0x7f2b14008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:46:12.622 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:12.621+0000 7f2b217fa640 1 -- 172.21.15.73:0/800890740 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f2b0c054570 con 0x7f2b240aae70 2023-12-12T09:46:12.834 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:12.832+0000 7f2b29013640 1 -- 172.21.15.73:0/800890740 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs2"} v 0) v1 -- 0x7f2b2406da00 con 0x7f2b240aae70 2023-12-12T09:46:12.835 INFO:tasks.ceph.mon.a.smithi073.stderr:2023-12-12T09:46:12.834+0000 7f81027f3640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-12-12T09:46:12.838 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:12.837+0000 7f2b217fa640 1 -- 172.21.15.73:0/800890740 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs2"}]=0 cephfs2 marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v38) v1 ==== 163+0+0 (secure 0 0 0) 0x7f2b0c057b90 con 0x7f2b240aae70 2023-12-12T09:46:12.838 INFO:teuthology.orchestra.run.smithi073.stderr:cephfs2 marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-12-12T09:46:12.842 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:12.840+0000 7f2b29013640 1 -- 172.21.15.73:0/800890740 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f2b0406ae40 msgr2=0x7f2b0406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:12.842 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:12.840+0000 7f2b29013640 1 --2- 172.21.15.73:0/800890740 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f2b0406ae40 0x7f2b0406d300 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f2b1400b840 tx=0x7f2b14008040 comp rx=0 tx=0).stop 2023-12-12T09:46:12.842 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:12.840+0000 7f2b29013640 1 -- 172.21.15.73:0/800890740 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2b240aae70 msgr2=0x7f2b241dce90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:12.842 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:12.840+0000 7f2b29013640 1 --2- 172.21.15.73:0/800890740 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2b240aae70 0x7f2b241dce90 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7f2b0c00b3f0 tx=0x7f2b0c00b8b0 comp rx=0 tx=0).stop 2023-12-12T09:46:12.842 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:12.840+0000 7f2b29013640 1 -- 172.21.15.73:0/800890740 shutdown_connections 2023-12-12T09:46:12.842 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:12.840+0000 7f2b29013640 1 --2- 172.21.15.73:0/800890740 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f2b0406ae40 0x7f2b0406d300 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:12.842 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:12.840+0000 7f2b29013640 1 --2- 172.21.15.73:0/800890740 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2b2414f7f0 0x7f2b2406fc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:12.842 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:12.840+0000 7f2b29013640 1 --2- 172.21.15.73:0/800890740 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2b240aae70 0x7f2b241dce90 unknown :-1 s=CLOSED pgs=812 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:12.842 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:12.840+0000 7f2b29013640 1 --2- 172.21.15.73:0/800890740 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2b240a4c90 0x7f2b241ea460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:12.842 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:12.840+0000 7f2b29013640 1 -- 172.21.15.73:0/800890740 >> 172.21.15.73:0/800890740 conn(0x7f2b240a75f0 msgr2=0x7f2b240a5c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:46:12.843 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:12.841+0000 7f2b29013640 1 -- 172.21.15.73:0/800890740 shutdown_connections 2023-12-12T09:46:12.843 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:12.841+0000 7f2b29013640 1 -- 172.21.15.73:0/800890740 wait complete. 2023-12-12T09:46:12.860 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs2 --yes-i-really-mean-it 2023-12-12T09:46:12.866 INFO:tasks.ceph.mds.d.smithi142.stderr: -2187> 2023-12-12T09:45:44.477+0000 7f7282b7d640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-12-12T09:46:12.957 INFO:tasks.ceph.mds.d.smithi142.stdout:starting mds.d at 2023-12-12T09:46:13.065 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:13.063+0000 7f5d5b52c640 1 Processor -- start 2023-12-12T09:46:13.065 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:13.063+0000 7f5d5b52c640 1 -- start start 2023-12-12T09:46:13.066 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:13.065+0000 7f5d5b52c640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f5d5414f8c0 0x7f5d5406dc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:13.066 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:13.065+0000 7f5d5b52c640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d540c16c0 con 0x7f5d5406d350 2023-12-12T09:46:13.066 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:13.065+0000 7f5d5b52c640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d540c19a0 con 0x7f5d54152500 2023-12-12T09:46:13.066 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:13.065+0000 7f5d5b52c640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d540c1090 con 0x7f5d5414f8c0 2023-12-12T09:46:13.068 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:13.065+0000 7f5d58ac7640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f5d5406d350 0x7f5d54071e60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:52584/0 (socket says 172.21.15.73:52584) 2023-12-12T09:46:13.068 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:13.065+0000 7f5d58ac7640 1 -- 172.21.15.73:0/708820364 learned_addr learned my addr 172.21.15.73:0/708820364 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-12T09:46:13.068 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:13.065+0000 7f5d592c8640 1 --2- 172.21.15.73:0/708820364 >> v2:172.21.15.142:3300/0 conn(0x7f5d5414f8c0 0x7f5d5406dc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:13.068 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:13.066+0000 7f5d4bfff640 1 -- 172.21.15.73:0/708820364 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2793999358 0 0) 0x7f5d540c16c0 con 0x7f5d5406d350 2023-12-12T09:46:13.069 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:13.066+0000 7f5d4bfff640 1 -- 172.21.15.73:0/708820364 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5d40003520 con 0x7f5d5406d350 2023-12-12T09:46:13.069 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:13.066+0000 7f5d4bfff640 1 -- 172.21.15.73:0/708820364 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3303577774 0 0) 0x7f5d40003520 con 0x7f5d5406d350 2023-12-12T09:46:13.069 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:13.066+0000 7f5d4bfff640 1 -- 172.21.15.73:0/708820364 >> v2:172.21.15.142:3300/0 conn(0x7f5d5414f8c0 msgr2=0x7f5d5406dc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:46:13.069 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:13.066+0000 7f5d4bfff640 1 --2- 172.21.15.73:0/708820364 >> v2:172.21.15.142:3300/0 conn(0x7f5d5414f8c0 0x7f5d5406dc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:13.069 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:13.066+0000 7f5d4bfff640 1 -- 172.21.15.73:0/708820364 >> v1:172.21.15.142:6789/0 conn(0x7f5d54152500 legacy=0x7f5d54152990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:13.069 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:13.066+0000 7f5d4bfff640 1 -- 172.21.15.73:0/708820364 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d540c1c80 con 0x7f5d5406d350 2023-12-12T09:46:13.069 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:13.066+0000 7f5d4bfff640 1 -- 172.21.15.73:0/708820364 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3186547832 0 0) 0x7f5d44001670 con 0x7f5d5406d350 2023-12-12T09:46:13.069 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:13.066+0000 7f5d4bfff640 1 -- 172.21.15.73:0/708820364 >> v1:172.21.15.73:6789/0 conn(0x7f5d5406d350 legacy=0x7f5d54071e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:13.069 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:13.066+0000 7f5d4bfff640 1 --2- 172.21.15.73:0/708820364 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5d40003970 0x7f5d40003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:13.069 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:13.066+0000 7f5d4bfff640 1 --2- 172.21.15.73:0/708820364 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5d400047c0 0x7f5d40004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:13.069 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:13.066+0000 7f5d4bfff640 1 --2- 172.21.15.73:0/708820364 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5d40005180 0x7f5d4000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:13.069 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:13.066+0000 7f5d4bfff640 1 -- 172.21.15.73:0/708820364 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d4000bff0 con 0x7f5d40003970 2023-12-12T09:46:13.069 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:13.066+0000 7f5d4bfff640 1 -- 172.21.15.73:0/708820364 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d4000c160 con 0x7f5d400047c0 2023-12-12T09:46:13.069 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:13.066+0000 7f5d4bfff640 1 -- 172.21.15.73:0/708820364 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d4000c320 con 0x7f5d40005180 2023-12-12T09:46:13.070 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:13.066+0000 7f5d592c8640 1 --2- 172.21.15.73:0/708820364 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5d40003970 0x7f5d40003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:13.070 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:13.067+0000 7f5d592c8640 1 -- 172.21.15.73:0/708820364 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5d40005180 msgr2=0x7f5d4000b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:46:13.070 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:13.067+0000 7f5d592c8640 1 --2- 172.21.15.73:0/708820364 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5d40005180 0x7f5d4000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:13.070 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:13.067+0000 7f5d592c8640 1 -- 172.21.15.73:0/708820364 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5d400047c0 msgr2=0x7f5d40004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:46:13.070 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:13.067+0000 7f5d592c8640 1 --2- 172.21.15.73:0/708820364 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5d400047c0 0x7f5d40004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:13.070 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:13.067+0000 7f5d592c8640 1 -- 172.21.15.73:0/708820364 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d40003520 con 0x7f5d40003970 2023-12-12T09:46:13.070 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:13.067+0000 7f5d59ac9640 1 -- 172.21.15.73:0/708820364 reap_dead start 2023-12-12T09:46:13.071 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:13.068+0000 7f5d592c8640 1 --2- 172.21.15.73:0/708820364 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5d40003970 0x7f5d40003d90 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7f5d50009fc0 tx=0x7f5d400057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8730a5d678ef09b8 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:46:13.071 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:13.068+0000 7f5d4bfff640 1 -- 172.21.15.73:0/708820364 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d5002cc20 con 0x7f5d40003970 2023-12-12T09:46:13.071 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:13.068+0000 7f5d4bfff640 1 -- 172.21.15.73:0/708820364 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d5000f040 con 0x7f5d40003970 2023-12-12T09:46:13.071 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:13.068+0000 7f5d4bfff640 1 -- 172.21.15.73:0/708820364 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d50034440 con 0x7f5d40003970 2023-12-12T09:46:13.071 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:13.069+0000 7f5d5b52c640 1 -- 172.21.15.73:0/708820364 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5d40003970 msgr2=0x7f5d40003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:13.072 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:13.069+0000 7f5d5b52c640 1 --2- 172.21.15.73:0/708820364 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5d40003970 0x7f5d40003d90 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7f5d50009fc0 tx=0x7f5d400057f0 comp rx=0 tx=0).stop 2023-12-12T09:46:13.072 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:13.069+0000 7f5d5b52c640 1 -- 172.21.15.73:0/708820364 shutdown_connections 2023-12-12T09:46:13.072 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:13.069+0000 7f5d5b52c640 1 --2- 172.21.15.73:0/708820364 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5d40003970 0x7f5d40003d90 unknown :-1 s=CLOSED pgs=816 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:13.072 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:13.069+0000 7f5d5b52c640 1 -- 172.21.15.73:0/708820364 >> 172.21.15.73:0/708820364 conn(0x7f5d5406a4e0 msgr2=0x7f5d5406a8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:46:13.072 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:13.069+0000 7f5d5b52c640 1 -- 172.21.15.73:0/708820364 shutdown_connections 2023-12-12T09:46:13.072 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:13.069+0000 7f5d5b52c640 1 -- 172.21.15.73:0/708820364 wait complete. 2023-12-12T09:46:13.073 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:13.070+0000 7f5d5b52c640 1 Processor -- start 2023-12-12T09:46:13.073 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:13.071+0000 7f5d5b52c640 1 -- start start 2023-12-12T09:46:13.073 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:13.071+0000 7f5d5b52c640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5d40003970 0x7f5d540a6dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:13.073 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:13.071+0000 7f5d5b52c640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5d540717b0 0x7f5d54151370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:13.073 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:13.072+0000 7f5d5b52c640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5d5414c050 0x7f5d541518b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:13.073 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:13.072+0000 7f5d5b52c640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d54151df0 con 0x7f5d40003970 2023-12-12T09:46:13.073 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:13.072+0000 7f5d5b52c640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d5414a410 con 0x7f5d5414c050 2023-12-12T09:46:13.073 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:13.072+0000 7f5d5b52c640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d541ed830 con 0x7f5d540717b0 2023-12-12T09:46:13.073 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:13.072+0000 7f5d592c8640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5d40003970 0x7f5d540a6dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:13.073 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:13.072+0000 7f5d592c8640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5d40003970 0x7f5d540a6dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:55518/0 (socket says 172.21.15.73:55518) 2023-12-12T09:46:13.074 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:13.072+0000 7f5d592c8640 1 -- 172.21.15.73:0/4194389430 learned_addr learned my addr 172.21.15.73:0/4194389430 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:46:13.074 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:13.072+0000 7f5d592c8640 1 -- 172.21.15.73:0/4194389430 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5d540717b0 msgr2=0x7f5d54151370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:13.075 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:13.072+0000 7f5d592c8640 1 --2- 172.21.15.73:0/4194389430 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5d540717b0 0x7f5d54151370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:13.075 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:13.072+0000 7f5d592c8640 1 -- 172.21.15.73:0/4194389430 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5d5414c050 msgr2=0x7f5d541518b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:13.075 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:13.072+0000 7f5d592c8640 1 --2- 172.21.15.73:0/4194389430 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5d5414c050 0x7f5d541518b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:13.075 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:13.072+0000 7f5d592c8640 1 -- 172.21.15.73:0/4194389430 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d54071c90 con 0x7f5d40003970 2023-12-12T09:46:13.075 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:13.073+0000 7f5d592c8640 1 --2- 172.21.15.73:0/4194389430 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5d40003970 0x7f5d540a6dd0 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7f5d5002c690 tx=0x7f5d50009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:46:13.075 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:13.073+0000 7f5d49ffb640 1 -- 172.21.15.73:0/4194389430 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d50034c50 con 0x7f5d40003970 2023-12-12T09:46:13.075 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:13.073+0000 7f5d49ffb640 1 -- 172.21.15.73:0/4194389430 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d50034db0 con 0x7f5d40003970 2023-12-12T09:46:13.075 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:13.073+0000 7f5d5b52c640 1 -- 172.21.15.73:0/4194389430 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d541edcc0 con 0x7f5d40003970 2023-12-12T09:46:13.075 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:13.073+0000 7f5d49ffb640 1 -- 172.21.15.73:0/4194389430 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d50003bd0 con 0x7f5d40003970 2023-12-12T09:46:13.075 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:13.073+0000 7f5d5b52c640 1 -- 172.21.15.73:0/4194389430 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d541ed1e0 con 0x7f5d40003970 2023-12-12T09:46:13.076 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:13.074+0000 7f5d5b52c640 1 -- 172.21.15.73:0/4194389430 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d5414fca0 con 0x7f5d40003970 2023-12-12T09:46:13.076 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:13.075+0000 7f5d49ffb640 1 -- 172.21.15.73:0/4194389430 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f5d50040450 con 0x7f5d40003970 2023-12-12T09:46:13.077 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:13.076+0000 7f5d49ffb640 1 --2- 172.21.15.73:0/4194389430 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f5d3806ae70 0x7f5d3806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:13.077 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:13.076+0000 7f5d49ffb640 1 -- 172.21.15.73:0/4194389430 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 5943+0+0 (secure 0 0 0) 0x7f5d500abde0 con 0x7f5d40003970 2023-12-12T09:46:13.077 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:13.076+0000 7f5d58ac7640 1 --2- 172.21.15.73:0/4194389430 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f5d3806ae70 0x7f5d3806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:13.078 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:13.077+0000 7f5d58ac7640 1 --2- 172.21.15.73:0/4194389430 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f5d3806ae70 0x7f5d3806d330 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f5d440011e0 tx=0x7f5d44001590 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:46:13.082 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:13.080+0000 7f5d49ffb640 1 -- 172.21.15.73:0/4194389430 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f5d5414fca0 con 0x7f5d40003970 2023-12-12T09:46:13.308 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:13.306+0000 7f5d5b52c640 1 -- 172.21.15.73:0/4194389430 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs2", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f5d5414fca0 con 0x7f5d40003970 2023-12-12T09:46:13.842 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:13.840+0000 7f5d49ffb640 1 -- 172.21.15.73:0/4194389430 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs2", "yes_i_really_mean_it": true}]=0 v39) v1 ==== 105+0+0 (secure 0 0 0) 0x7f5d5414fca0 con 0x7f5d40003970 2023-12-12T09:46:13.846 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:13.844+0000 7f5d5b52c640 1 -- 172.21.15.73:0/4194389430 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f5d3806ae70 msgr2=0x7f5d3806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:13.846 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:13.844+0000 7f5d5b52c640 1 --2- 172.21.15.73:0/4194389430 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f5d3806ae70 0x7f5d3806d330 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f5d440011e0 tx=0x7f5d44001590 comp rx=0 tx=0).stop 2023-12-12T09:46:13.846 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:13.844+0000 7f5d5b52c640 1 -- 172.21.15.73:0/4194389430 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5d40003970 msgr2=0x7f5d540a6dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:13.846 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:13.844+0000 7f5d5b52c640 1 --2- 172.21.15.73:0/4194389430 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5d40003970 0x7f5d540a6dd0 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7f5d5002c690 tx=0x7f5d50009750 comp rx=0 tx=0).stop 2023-12-12T09:46:13.846 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:13.844+0000 7f5d5b52c640 1 -- 172.21.15.73:0/4194389430 shutdown_connections 2023-12-12T09:46:13.846 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:13.844+0000 7f5d5b52c640 1 --2- 172.21.15.73:0/4194389430 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f5d3806ae70 0x7f5d3806d330 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:13.846 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:13.844+0000 7f5d5b52c640 1 --2- 172.21.15.73:0/4194389430 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5d5414c050 0x7f5d541518b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:13.847 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:13.844+0000 7f5d5b52c640 1 --2- 172.21.15.73:0/4194389430 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5d540717b0 0x7f5d54151370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:13.847 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:13.844+0000 7f5d5b52c640 1 --2- 172.21.15.73:0/4194389430 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5d40003970 0x7f5d540a6dd0 unknown :-1 s=CLOSED pgs=817 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:13.847 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:13.844+0000 7f5d5b52c640 1 -- 172.21.15.73:0/4194389430 >> 172.21.15.73:0/4194389430 conn(0x7f5d5406a4e0 msgr2=0x7f5d5406a8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:46:13.847 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:13.845+0000 7f5d5b52c640 1 -- 172.21.15.73:0/4194389430 shutdown_connections 2023-12-12T09:46:13.847 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:13.845+0000 7f5d5b52c640 1 -- 172.21.15.73:0/4194389430 wait complete. 2023-12-12T09:46:13.867 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs2_metadata cephfs2_metadata --yes-i-really-really-mean-it 2023-12-12T09:46:14.083 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:14.082+0000 7fc0371cf640 1 Processor -- start 2023-12-12T09:46:14.084 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:14.082+0000 7fc0371cf640 1 -- start start 2023-12-12T09:46:14.085 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:14.083+0000 7fc0371cf640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fc0301550a0 0x7fc0301514d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:14.085 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:14.083+0000 7fc0371cf640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc0300a5ca0 0x7fc030151a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:14.085 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:14.083+0000 7fc0371cf640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0300c6730 con 0x7fc03006a750 2023-12-12T09:46:14.085 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:14.083+0000 7fc0371cf640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0300a6500 con 0x7fc0301550a0 2023-12-12T09:46:14.085 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:14.083+0000 7fc0371cf640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0301543d0 con 0x7fc0300a5ca0 2023-12-12T09:46:14.085 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:14.083+0000 7fc0361cd640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7fc03006a750 0x7fc030157980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:52600/0 (socket says 172.21.15.73:52600) 2023-12-12T09:46:14.085 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:14.083+0000 7fc0361cd640 1 -- 172.21.15.73:0/2210872564 learned_addr learned my addr 172.21.15.73:0/2210872564 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-12T09:46:14.087 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:14.084+0000 7fc0351cb640 1 -- 172.21.15.73:0/2210872564 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 640789401 0 0) 0x7fc0300c6730 con 0x7fc03006a750 2023-12-12T09:46:14.087 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:14.084+0000 7fc0369ce640 1 --2- 172.21.15.73:0/2210872564 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc0300a5ca0 0x7fc030151a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:14.087 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:14.084+0000 7fc0359cc640 1 --2- 172.21.15.73:0/2210872564 >> v2:172.21.15.142:3300/0 conn(0x7fc0301550a0 0x7fc0301514d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:14.087 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:14.084+0000 7fc0351cb640 1 -- 172.21.15.73:0/2210872564 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc018003520 con 0x7fc03006a750 2023-12-12T09:46:14.087 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:14.084+0000 7fc0351cb640 1 -- 172.21.15.73:0/2210872564 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2642647782 0 0) 0x7fc018003520 con 0x7fc03006a750 2023-12-12T09:46:14.088 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:14.084+0000 7fc0351cb640 1 -- 172.21.15.73:0/2210872564 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc0300a5ca0 msgr2=0x7fc030151a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:46:14.088 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:14.084+0000 7fc0351cb640 1 --2- 172.21.15.73:0/2210872564 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc0300a5ca0 0x7fc030151a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:14.088 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:14.084+0000 7fc0351cb640 1 -- 172.21.15.73:0/2210872564 >> v2:172.21.15.142:3300/0 conn(0x7fc0301550a0 msgr2=0x7fc0301514d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:46:14.088 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:14.084+0000 7fc0351cb640 1 --2- 172.21.15.73:0/2210872564 >> v2:172.21.15.142:3300/0 conn(0x7fc0301550a0 0x7fc0301514d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:14.088 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:14.084+0000 7fc0351cb640 1 -- 172.21.15.73:0/2210872564 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0300a6220 con 0x7fc03006a750 2023-12-12T09:46:14.088 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:14.084+0000 7fc0351cb640 1 -- 172.21.15.73:0/2210872564 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3186547832 0 0) 0x7fc0200019f0 con 0x7fc03006a750 2023-12-12T09:46:14.088 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:14.084+0000 7fc0351cb640 1 -- 172.21.15.73:0/2210872564 >> v1:172.21.15.73:6789/0 conn(0x7fc03006a750 legacy=0x7fc030157980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:14.088 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:14.085+0000 7fc0351cb640 1 --2- 172.21.15.73:0/2210872564 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc018003970 0x7fc018003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:14.088 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:14.085+0000 7fc0351cb640 1 --2- 172.21.15.73:0/2210872564 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc0300a5ca0 0x7fc0180047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:14.088 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:14.085+0000 7fc0351cb640 1 --2- 172.21.15.73:0/2210872564 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc018004d00 0x7fc018005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:14.088 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:14.085+0000 7fc0351cb640 1 -- 172.21.15.73:0/2210872564 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0301543d0 con 0x7fc018004d00 2023-12-12T09:46:14.088 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:14.085+0000 7fc0351cb640 1 -- 172.21.15.73:0/2210872564 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc01800ba90 con 0x7fc018003970 2023-12-12T09:46:14.088 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:14.085+0000 7fc0351cb640 1 -- 172.21.15.73:0/2210872564 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc01800bc50 con 0x7fc0300a5ca0 2023-12-12T09:46:14.088 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:14.085+0000 7fc0369ce640 1 --2- 172.21.15.73:0/2210872564 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc018004d00 0x7fc018005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:14.089 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:14.085+0000 7fc0359cc640 1 --2- 172.21.15.73:0/2210872564 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc0300a5ca0 0x7fc0180047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:14.089 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:14.085+0000 7fc0361cd640 1 --2- 172.21.15.73:0/2210872564 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc018003970 0x7fc018003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:14.089 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:14.085+0000 7fc0369ce640 1 -- 172.21.15.73:0/2210872564 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc0300a5ca0 msgr2=0x7fc0180047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:46:14.089 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:14.085+0000 7fc0369ce640 1 --2- 172.21.15.73:0/2210872564 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc0300a5ca0 0x7fc0180047c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:14.089 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:14.085+0000 7fc0369ce640 1 -- 172.21.15.73:0/2210872564 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc018003970 msgr2=0x7fc018003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:46:14.089 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:14.085+0000 7fc0369ce640 1 --2- 172.21.15.73:0/2210872564 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc018003970 0x7fc018003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:14.089 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:14.085+0000 7fc0369ce640 1 -- 172.21.15.73:0/2210872564 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc018003520 con 0x7fc018004d00 2023-12-12T09:46:14.089 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:14.085+0000 7fc0361cd640 1 --2- 172.21.15.73:0/2210872564 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc018003970 0x7fc018003d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:46:14.091 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:14.086+0000 7fc0369ce640 1 --2- 172.21.15.73:0/2210872564 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc018004d00 0x7fc018005180 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7fc02800ba30 tx=0x7fc0180057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a58243bf805ec7d server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:46:14.091 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:14.087+0000 7fc0351cb640 1 -- 172.21.15.73:0/2210872564 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc028032640 con 0x7fc018004d00 2023-12-12T09:46:14.091 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:14.087+0000 7fc0351cb640 1 -- 172.21.15.73:0/2210872564 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0280327a0 con 0x7fc018004d00 2023-12-12T09:46:14.091 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:14.087+0000 7fc0351cb640 1 -- 172.21.15.73:0/2210872564 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc028032b30 con 0x7fc018004d00 2023-12-12T09:46:14.091 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:14.087+0000 7fc0371cf640 1 -- 172.21.15.73:0/2210872564 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc018004d00 msgr2=0x7fc018005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:14.091 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:14.087+0000 7fc0371cf640 1 --2- 172.21.15.73:0/2210872564 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc018004d00 0x7fc018005180 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7fc02800ba30 tx=0x7fc0180057f0 comp rx=0 tx=0).stop 2023-12-12T09:46:14.091 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:14.087+0000 7fc0369ce640 1 -- 172.21.15.73:0/2210872564 reap_dead start 2023-12-12T09:46:14.091 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:14.087+0000 7fc0371cf640 1 -- 172.21.15.73:0/2210872564 shutdown_connections 2023-12-12T09:46:14.091 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:14.087+0000 7fc0371cf640 1 -- 172.21.15.73:0/2210872564 >> 172.21.15.73:0/2210872564 conn(0x7fc03006b5f0 msgr2=0x7fc03006ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:46:14.091 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:14.087+0000 7fc0371cf640 1 -- 172.21.15.73:0/2210872564 shutdown_connections 2023-12-12T09:46:14.092 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:14.088+0000 7fc0371cf640 1 -- 172.21.15.73:0/2210872564 wait complete. 2023-12-12T09:46:14.092 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:14.089+0000 7fc0371cf640 1 Processor -- start 2023-12-12T09:46:14.092 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:14.089+0000 7fc0371cf640 1 -- start start 2023-12-12T09:46:14.093 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:14.090+0000 7fc0371cf640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc018004d00 0x7fc030072490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:14.093 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:14.090+0000 7fc0371cf640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc030157670 0x7fc0300a77c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:14.093 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:14.090+0000 7fc0371cf640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc030147de0 0x7fc030148260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:14.093 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:14.090+0000 7fc0371cf640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc030155dc0 con 0x7fc030157670 2023-12-12T09:46:14.094 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:14.090+0000 7fc0371cf640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc030070bb0 con 0x7fc018004d00 2023-12-12T09:46:14.094 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:14.090+0000 7fc0371cf640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc030071bc0 con 0x7fc030147de0 2023-12-12T09:46:14.094 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:14.091+0000 7fc0359cc640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc030157670 0x7fc0300a77c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:14.094 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:14.091+0000 7fc0359cc640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc030157670 0x7fc0300a77c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:55530/0 (socket says 172.21.15.73:55530) 2023-12-12T09:46:14.094 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:14.091+0000 7fc0359cc640 1 -- 172.21.15.73:0/431924959 learned_addr learned my addr 172.21.15.73:0/431924959 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:46:14.094 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:14.091+0000 7fc0359cc640 1 -- 172.21.15.73:0/431924959 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc030147de0 msgr2=0x7fc030148260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:14.094 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:14.091+0000 7fc0359cc640 1 --2- 172.21.15.73:0/431924959 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc030147de0 0x7fc030148260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:14.094 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:14.091+0000 7fc0359cc640 1 -- 172.21.15.73:0/431924959 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc018004d00 msgr2=0x7fc030072490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:14.094 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:14.091+0000 7fc0359cc640 1 --2- 172.21.15.73:0/431924959 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc018004d00 0x7fc030072490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:14.094 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:14.091+0000 7fc0359cc640 1 -- 172.21.15.73:0/431924959 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0300729d0 con 0x7fc030157670 2023-12-12T09:46:14.094 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:14.091+0000 7fc0359cc640 1 --2- 172.21.15.73:0/431924959 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc030157670 0x7fc0300a77c0 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7fc02400e7e0 tx=0x7fc02400eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:46:14.094 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:14.091+0000 7fc02effd640 1 -- 172.21.15.73:0/431924959 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc02400c650 con 0x7fc030157670 2023-12-12T09:46:14.094 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:14.091+0000 7fc02effd640 1 -- 172.21.15.73:0/431924959 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc02400c7b0 con 0x7fc030157670 2023-12-12T09:46:14.095 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:14.091+0000 7fc02effd640 1 -- 172.21.15.73:0/431924959 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc02400cb20 con 0x7fc030157670 2023-12-12T09:46:14.095 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:14.091+0000 7fc0371cf640 1 -- 172.21.15.73:0/431924959 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0301487a0 con 0x7fc030157670 2023-12-12T09:46:14.095 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:14.092+0000 7fc0371cf640 1 -- 172.21.15.73:0/431924959 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc030070e00 con 0x7fc030157670 2023-12-12T09:46:14.095 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:14.093+0000 7fc0371cf640 1 -- 172.21.15.73:0/431924959 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc030067b10 con 0x7fc030157670 2023-12-12T09:46:14.095 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:14.094+0000 7fc02effd640 1 -- 172.21.15.73:0/431924959 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fc02400cc80 con 0x7fc030157670 2023-12-12T09:46:14.096 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:14.095+0000 7fc02effd640 1 --2- 172.21.15.73:0/431924959 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fc01c06ae70 0x7fc01c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:14.096 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:14.095+0000 7fc02effd640 1 -- 172.21.15.73:0/431924959 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 5943+0+0 (secure 0 0 0) 0x7fc024089500 con 0x7fc030157670 2023-12-12T09:46:14.097 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:14.095+0000 7fc0361cd640 1 --2- 172.21.15.73:0/431924959 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fc01c06ae70 0x7fc01c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:14.097 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:14.096+0000 7fc0361cd640 1 --2- 172.21.15.73:0/431924959 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fc01c06ae70 0x7fc01c06d330 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fc020001b20 tx=0x7fc020009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:46:14.100 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:14.099+0000 7fc02effd640 1 -- 172.21.15.73:0/431924959 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fc024054420 con 0x7fc030157670 2023-12-12T09:46:14.290 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:14.289+0000 7fc0371cf640 1 -- 172.21.15.73:0/431924959 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs2_metadata", "pool2": "cephfs2_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fc0300c0000 con 0x7fc030157670 2023-12-12T09:46:14.846 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:14.844+0000 7fc02effd640 1 -- 172.21.15.73:0/431924959 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs2_metadata", "pool2": "cephfs2_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs2_metadata' removed v65) v1 ==== 184+0+0 (secure 0 0 0) 0x7fc024057a40 con 0x7fc030157670 2023-12-12T09:46:14.846 INFO:teuthology.orchestra.run.smithi073.stderr:pool 'cephfs2_metadata' removed 2023-12-12T09:46:14.850 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:14.848+0000 7fc0371cf640 1 -- 172.21.15.73:0/431924959 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fc01c06ae70 msgr2=0x7fc01c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:14.850 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:14.848+0000 7fc0371cf640 1 --2- 172.21.15.73:0/431924959 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fc01c06ae70 0x7fc01c06d330 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fc020001b20 tx=0x7fc020009040 comp rx=0 tx=0).stop 2023-12-12T09:46:14.850 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:14.848+0000 7fc0371cf640 1 -- 172.21.15.73:0/431924959 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc030157670 msgr2=0x7fc0300a77c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:14.850 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:14.848+0000 7fc0371cf640 1 --2- 172.21.15.73:0/431924959 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc030157670 0x7fc0300a77c0 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7fc02400e7e0 tx=0x7fc02400eca0 comp rx=0 tx=0).stop 2023-12-12T09:46:14.850 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:14.848+0000 7fc0371cf640 1 -- 172.21.15.73:0/431924959 shutdown_connections 2023-12-12T09:46:14.850 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:14.848+0000 7fc0371cf640 1 --2- 172.21.15.73:0/431924959 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fc01c06ae70 0x7fc01c06d330 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:14.850 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:14.848+0000 7fc0371cf640 1 --2- 172.21.15.73:0/431924959 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc030147de0 0x7fc030148260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:14.850 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:14.848+0000 7fc0371cf640 1 --2- 172.21.15.73:0/431924959 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc030157670 0x7fc0300a77c0 unknown :-1 s=CLOSED pgs=820 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:14.851 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:14.848+0000 7fc0371cf640 1 --2- 172.21.15.73:0/431924959 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc018004d00 0x7fc030072490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:14.851 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:14.848+0000 7fc0371cf640 1 -- 172.21.15.73:0/431924959 >> 172.21.15.73:0/431924959 conn(0x7fc03006b5f0 msgr2=0x7fc03006ab30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:46:14.851 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:14.848+0000 7fc0371cf640 1 -- 172.21.15.73:0/431924959 shutdown_connections 2023-12-12T09:46:14.851 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:14.849+0000 7fc0371cf640 1 -- 172.21.15.73:0/431924959 wait complete. 2023-12-12T09:46:14.875 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs2_data cephfs2_data --yes-i-really-really-mean-it 2023-12-12T09:46:15.091 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:15.090+0000 7f6f2d789640 1 Processor -- start 2023-12-12T09:46:15.091 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:15.090+0000 7f6f2d789640 1 -- start start 2023-12-12T09:46:15.094 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:15.091+0000 7f6f2d789640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f6f280c23b0 0x7f6f280c0320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:15.094 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:15.091+0000 7f6f2d789640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f6f2806cc90 0x7f6f280c2790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:15.094 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:15.091+0000 7f6f2d789640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f280c1520 con 0x7f6f28159410 2023-12-12T09:46:15.094 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:15.091+0000 7f6f2d789640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f280c46f0 con 0x7f6f2806cc90 2023-12-12T09:46:15.094 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:15.092+0000 7f6f2d789640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f2806d0d0 con 0x7f6f280c23b0 2023-12-12T09:46:15.094 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:15.092+0000 7f6f267fc640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f6f2806cc90 0x7f6f280c2790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:15.094 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:15.092+0000 7f6f267fc640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f6f2806cc90 0x7f6f280c2790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:55534/0 (socket says 172.21.15.73:55534) 2023-12-12T09:46:15.094 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:15.092+0000 7f6f267fc640 1 -- 172.21.15.73:0/1978339894 learned_addr learned my addr 172.21.15.73:0/1978339894 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:46:15.095 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:15.092+0000 7f6f267fc640 1 -- 172.21.15.73:0/1978339894 >> v2:172.21.15.142:3300/0 conn(0x7f6f280c23b0 msgr2=0x7f6f280c0320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:46:15.095 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:15.092+0000 7f6f267fc640 1 --2- 172.21.15.73:0/1978339894 >> v2:172.21.15.142:3300/0 conn(0x7f6f280c23b0 0x7f6f280c0320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:15.095 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:15.092+0000 7f6f267fc640 1 -- 172.21.15.73:0/1978339894 >> v1:172.21.15.142:6789/0 conn(0x7f6f28159410 legacy=0x7f6f280c50d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:46:15.095 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:15.092+0000 7f6f267fc640 1 -- 172.21.15.73:0/1978339894 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f280c57e0 con 0x7f6f2806cc90 2023-12-12T09:46:15.096 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:15.093+0000 7f6f267fc640 1 --2- 172.21.15.73:0/1978339894 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6f2806cc90 0x7f6f280c2790 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7f6f280c34a0 tx=0x7f6f1c02b7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f214c7ce9c6717e server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:46:15.096 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:15.093+0000 7f6f25ffb640 1 -- 172.21.15.73:0/1978339894 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f1c031750 con 0x7f6f2806cc90 2023-12-12T09:46:15.097 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:15.094+0000 7f6f25ffb640 1 -- 172.21.15.73:0/1978339894 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f1c0318b0 con 0x7f6f2806cc90 2023-12-12T09:46:15.097 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:15.094+0000 7f6f25ffb640 1 -- 172.21.15.73:0/1978339894 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f1c031c40 con 0x7f6f2806cc90 2023-12-12T09:46:15.097 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:15.094+0000 7f6f2d789640 1 -- 172.21.15.73:0/1978339894 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6f2806cc90 msgr2=0x7f6f280c2790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:15.097 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:15.094+0000 7f6f2d789640 1 --2- 172.21.15.73:0/1978339894 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6f2806cc90 0x7f6f280c2790 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7f6f280c34a0 tx=0x7f6f1c02b7f0 comp rx=0 tx=0).stop 2023-12-12T09:46:15.097 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:15.094+0000 7f6f2d789640 1 -- 172.21.15.73:0/1978339894 shutdown_connections 2023-12-12T09:46:15.097 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:15.094+0000 7f6f2d789640 1 --2- 172.21.15.73:0/1978339894 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6f2806cc90 0x7f6f280c2790 unknown :-1 s=CLOSED pgs=821 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:15.097 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:15.094+0000 7f6f2d789640 1 --2- 172.21.15.73:0/1978339894 >> v2:172.21.15.142:3300/0 conn(0x7f6f280c23b0 0x7f6f280c0320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:15.097 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:15.094+0000 7f6f2d789640 1 -- 172.21.15.73:0/1978339894 >> 172.21.15.73:0/1978339894 conn(0x7f6f2806a4e0 msgr2=0x7f6f2806a8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:46:15.097 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:15.094+0000 7f6f2d789640 1 -- 172.21.15.73:0/1978339894 shutdown_connections 2023-12-12T09:46:15.097 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:15.094+0000 7f6f2d789640 1 -- 172.21.15.73:0/1978339894 wait complete. 2023-12-12T09:46:15.098 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:15.096+0000 7f6f2d789640 1 Processor -- start 2023-12-12T09:46:15.098 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:15.096+0000 7f6f2d789640 1 -- start start 2023-12-12T09:46:15.100 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:15.097+0000 7f6f2d789640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6f2806cc90 0x7f6f281528a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:15.101 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:15.097+0000 7f6f2d789640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6f280c23b0 0x7f6f28159d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:15.101 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:15.097+0000 7f6f2d789640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6f28159410 0x7f6f2815a270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:15.101 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:15.097+0000 7f6f2d789640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f281f1d70 con 0x7f6f28159410 2023-12-12T09:46:15.101 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:15.097+0000 7f6f2d789640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f280720b0 con 0x7f6f2806cc90 2023-12-12T09:46:15.101 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:15.097+0000 7f6f2d789640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f2815a7b0 con 0x7f6f280c23b0 2023-12-12T09:46:15.101 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:15.097+0000 7f6f277fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6f28159410 0x7f6f2815a270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:15.101 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:15.097+0000 7f6f277fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6f28159410 0x7f6f2815a270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:55548/0 (socket says 172.21.15.73:55548) 2023-12-12T09:46:15.101 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:15.097+0000 7f6f277fe640 1 -- 172.21.15.73:0/1515048294 learned_addr learned my addr 172.21.15.73:0/1515048294 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:46:15.101 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:15.098+0000 7f6f267fc640 1 --2- 172.21.15.73:0/1515048294 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6f280c23b0 0x7f6f28159d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:15.101 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:15.098+0000 7f6f26ffd640 1 --2- 172.21.15.73:0/1515048294 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6f2806cc90 0x7f6f281528a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:15.101 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:15.098+0000 7f6f277fe640 1 -- 172.21.15.73:0/1515048294 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6f280c23b0 msgr2=0x7f6f28159d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:15.102 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:15.098+0000 7f6f277fe640 1 --2- 172.21.15.73:0/1515048294 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6f280c23b0 0x7f6f28159d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:15.102 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:15.098+0000 7f6f277fe640 1 -- 172.21.15.73:0/1515048294 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6f2806cc90 msgr2=0x7f6f281528a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:15.102 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:15.098+0000 7f6f277fe640 1 --2- 172.21.15.73:0/1515048294 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6f2806cc90 0x7f6f281528a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:15.102 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:15.098+0000 7f6f277fe640 1 -- 172.21.15.73:0/1515048294 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f1c0094d0 con 0x7f6f28159410 2023-12-12T09:46:15.102 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:15.098+0000 7f6f277fe640 1 --2- 172.21.15.73:0/1515048294 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6f28159410 0x7f6f2815a270 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7f6f2000c390 tx=0x7f6f2000c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:46:15.102 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:15.098+0000 7f6f0f7fe640 1 -- 172.21.15.73:0/1515048294 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f200035f0 con 0x7f6f28159410 2023-12-12T09:46:15.102 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:15.098+0000 7f6f0f7fe640 1 -- 172.21.15.73:0/1515048294 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f20003750 con 0x7f6f28159410 2023-12-12T09:46:15.102 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:15.098+0000 7f6f0f7fe640 1 -- 172.21.15.73:0/1515048294 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f20003b00 con 0x7f6f28159410 2023-12-12T09:46:15.103 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:15.098+0000 7f6f2d789640 1 -- 172.21.15.73:0/1515048294 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f280712f0 con 0x7f6f28159410 2023-12-12T09:46:15.103 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:15.099+0000 7f6f2d789640 1 -- 172.21.15.73:0/1515048294 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f280718b0 con 0x7f6f28159410 2023-12-12T09:46:15.105 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:15.100+0000 7f6f2d789640 1 -- 172.21.15.73:0/1515048294 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f28067070 con 0x7f6f28159410 2023-12-12T09:46:15.105 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:15.100+0000 7f6f0f7fe640 1 -- 172.21.15.73:0/1515048294 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f6f20003c60 con 0x7f6f28159410 2023-12-12T09:46:15.105 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:15.102+0000 7f6f0f7fe640 1 --2- 172.21.15.73:0/1515048294 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f6f1406ae40 0x7f6f1406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:15.105 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:15.102+0000 7f6f0f7fe640 1 -- 172.21.15.73:0/1515048294 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 5503+0+0 (secure 0 0 0) 0x7f6f200887a0 con 0x7f6f28159410 2023-12-12T09:46:15.105 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:15.102+0000 7f6f26ffd640 1 --2- 172.21.15.73:0/1515048294 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f6f1406ae40 0x7f6f1406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:15.105 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:15.103+0000 7f6f26ffd640 1 --2- 172.21.15.73:0/1515048294 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f6f1406ae40 0x7f6f1406d300 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f6f18007dc0 tx=0x7f6f180072f0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:46:15.107 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:15.106+0000 7f6f0f7fe640 1 -- 172.21.15.73:0/1515048294 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f6f20053910 con 0x7f6f28159410 2023-12-12T09:46:15.297 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:15.296+0000 7f6f2d789640 1 -- 172.21.15.73:0/1515048294 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs2_data", "pool2": "cephfs2_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f6f28067580 con 0x7f6f28159410 2023-12-12T09:46:15.856 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:15.855+0000 7f6f0f7fe640 1 -- 172.21.15.73:0/1515048294 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs2_data", "pool2": "cephfs2_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs2_data' removed v66) v1 ==== 172+0+0 (secure 0 0 0) 0x7f6f20056f30 con 0x7f6f28159410 2023-12-12T09:46:15.857 INFO:teuthology.orchestra.run.smithi073.stderr:pool 'cephfs2_data' removed 2023-12-12T09:46:15.860 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:15.859+0000 7f6f2d789640 1 -- 172.21.15.73:0/1515048294 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f6f1406ae40 msgr2=0x7f6f1406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:15.860 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:15.859+0000 7f6f2d789640 1 --2- 172.21.15.73:0/1515048294 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f6f1406ae40 0x7f6f1406d300 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f6f18007dc0 tx=0x7f6f180072f0 comp rx=0 tx=0).stop 2023-12-12T09:46:15.860 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:15.859+0000 7f6f2d789640 1 -- 172.21.15.73:0/1515048294 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6f28159410 msgr2=0x7f6f2815a270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:15.860 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:15.859+0000 7f6f2d789640 1 --2- 172.21.15.73:0/1515048294 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6f28159410 0x7f6f2815a270 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7f6f2000c390 tx=0x7f6f2000c850 comp rx=0 tx=0).stop 2023-12-12T09:46:15.861 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:15.859+0000 7f6f2d789640 1 -- 172.21.15.73:0/1515048294 shutdown_connections 2023-12-12T09:46:15.861 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:15.859+0000 7f6f2d789640 1 --2- 172.21.15.73:0/1515048294 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f6f1406ae40 0x7f6f1406d300 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:15.861 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:15.859+0000 7f6f2d789640 1 --2- 172.21.15.73:0/1515048294 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6f28159410 0x7f6f2815a270 unknown :-1 s=CLOSED pgs=822 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:15.861 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:15.859+0000 7f6f2d789640 1 --2- 172.21.15.73:0/1515048294 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6f280c23b0 0x7f6f28159d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:15.861 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:15.859+0000 7f6f2d789640 1 --2- 172.21.15.73:0/1515048294 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6f2806cc90 0x7f6f281528a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:15.861 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:15.859+0000 7f6f2d789640 1 -- 172.21.15.73:0/1515048294 >> 172.21.15.73:0/1515048294 conn(0x7f6f2806a4e0 msgr2=0x7f6f280c50d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:46:15.863 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:15.861+0000 7f6f2d789640 1 -- 172.21.15.73:0/1515048294 shutdown_connections 2023-12-12T09:46:15.863 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:15.861+0000 7f6f2d789640 1 -- 172.21.15.73:0/1515048294 wait complete. 2023-12-12T09:46:15.885 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-12-12T09:46:16.099 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:16.097+0000 7faa6ae56640 1 Processor -- start 2023-12-12T09:46:16.099 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:16.097+0000 7faa6ae56640 1 -- start start 2023-12-12T09:46:16.100 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:16.098+0000 7faa6ae56640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7faa640c7ed0 0x7faa640c6ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:16.100 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:16.098+0000 7faa6ae56640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7faa641550a0 0x7faa6415efa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:16.100 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:16.098+0000 7faa6ae56640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa640c8330 con 0x7faa640c67c0 2023-12-12T09:46:16.100 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:16.098+0000 7faa6ae56640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa6406c890 con 0x7faa641550a0 2023-12-12T09:46:16.100 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:16.098+0000 7faa6ae56640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa640c4af0 con 0x7faa640c7ed0 2023-12-12T09:46:16.100 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:16.099+0000 7faa68bf2640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7faa640c67c0 0x7faa6406c180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:52614/0 (socket says 172.21.15.73:52614) 2023-12-12T09:46:16.100 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:16.099+0000 7faa68bf2640 1 -- 172.21.15.73:0/470841491 learned_addr learned my addr 172.21.15.73:0/470841491 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-12T09:46:16.100 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:16.099+0000 7faa693f3640 1 --2- 172.21.15.73:0/470841491 >> v2:172.21.15.73:3300/0 conn(0x7faa641550a0 0x7faa6415efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:16.101 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:16.099+0000 7faa693f3640 1 -- 172.21.15.73:0/470841491 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7faa640c7ed0 msgr2=0x7faa640c6ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:46:16.101 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:16.099+0000 7faa5bfff640 1 --2- 172.21.15.73:0/470841491 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7faa640c7ed0 0x7faa640c6ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:16.101 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:16.099+0000 7faa693f3640 1 --2- 172.21.15.73:0/470841491 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7faa640c7ed0 0x7faa640c6ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:16.101 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:16.099+0000 7faa693f3640 1 -- 172.21.15.73:0/470841491 >> v1:172.21.15.73:6789/0 conn(0x7faa640c67c0 legacy=0x7faa6406c180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:16.101 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:16.099+0000 7faa5b7fe640 1 -- 172.21.15.73:0/470841491 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1532991825 0 0) 0x7faa640c8330 con 0x7faa640c67c0 2023-12-12T09:46:16.101 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:16.099+0000 7faa693f3640 1 -- 172.21.15.73:0/470841491 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa640c4dd0 con 0x7faa641550a0 2023-12-12T09:46:16.102 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:16.100+0000 7faa693f3640 1 --2- 172.21.15.73:0/470841491 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7faa641550a0 0x7faa6415efa0 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7faa5c009d90 tx=0x7faa5c02bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b66e48e82b32d507 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:46:16.102 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:16.101+0000 7faa5b7fe640 1 -- 172.21.15.73:0/470841491 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa5c02cc50 con 0x7faa641550a0 2023-12-12T09:46:16.102 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:16.101+0000 7faa5b7fe640 1 -- 172.21.15.73:0/470841491 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa5c02cdb0 con 0x7faa641550a0 2023-12-12T09:46:16.102 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:16.101+0000 7faa5b7fe640 1 -- 172.21.15.73:0/470841491 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa5c034660 con 0x7faa641550a0 2023-12-12T09:46:16.102 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:16.101+0000 7faa6ae56640 1 -- 172.21.15.73:0/470841491 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7faa641550a0 msgr2=0x7faa6415efa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:16.103 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:16.101+0000 7faa6ae56640 1 --2- 172.21.15.73:0/470841491 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7faa641550a0 0x7faa6415efa0 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7faa5c009d90 tx=0x7faa5c02bea0 comp rx=0 tx=0).stop 2023-12-12T09:46:16.103 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:16.101+0000 7faa6ae56640 1 -- 172.21.15.73:0/470841491 shutdown_connections 2023-12-12T09:46:16.103 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:16.101+0000 7faa6ae56640 1 --2- 172.21.15.73:0/470841491 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7faa640c7ed0 0x7faa640c6ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:16.103 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:16.101+0000 7faa6ae56640 1 --2- 172.21.15.73:0/470841491 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7faa641550a0 0x7faa6415efa0 unknown :-1 s=CLOSED pgs=824 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:16.103 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:16.101+0000 7faa6ae56640 1 -- 172.21.15.73:0/470841491 >> 172.21.15.73:0/470841491 conn(0x7faa640abb20 msgr2=0x7faa640abf30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:46:16.104 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:16.101+0000 7faa6ae56640 1 -- 172.21.15.73:0/470841491 shutdown_connections 2023-12-12T09:46:16.104 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:16.101+0000 7faa6ae56640 1 -- 172.21.15.73:0/470841491 wait complete. 2023-12-12T09:46:16.104 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:16.103+0000 7faa6ae56640 1 Processor -- start 2023-12-12T09:46:16.104 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:16.103+0000 7faa6ae56640 1 -- start start 2023-12-12T09:46:16.107 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:16.104+0000 7faa6ae56640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7faa640c67c0 0x7faa640aee70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:16.107 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:16.104+0000 7faa6ae56640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7faa640c7ed0 0x7faa640bd8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:16.107 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:16.104+0000 7faa6ae56640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7faa641550a0 0x7faa640bde20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:16.107 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:16.104+0000 7faa6ae56640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa641ea710 con 0x7faa640c67c0 2023-12-12T09:46:16.107 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:16.104+0000 7faa6ae56640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa641e9e40 con 0x7faa641550a0 2023-12-12T09:46:16.107 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:16.104+0000 7faa6ae56640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa640c4220 con 0x7faa640c7ed0 2023-12-12T09:46:16.107 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:16.104+0000 7faa68bf2640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7faa640c67c0 0x7faa640aee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:16.107 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:16.104+0000 7faa68bf2640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7faa640c67c0 0x7faa640aee70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:55560/0 (socket says 172.21.15.73:55560) 2023-12-12T09:46:16.107 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:16.104+0000 7faa68bf2640 1 -- 172.21.15.73:0/3767200683 learned_addr learned my addr 172.21.15.73:0/3767200683 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:46:16.107 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:16.105+0000 7faa5bfff640 1 --2- 172.21.15.73:0/3767200683 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7faa640c7ed0 0x7faa640bd8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:16.107 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:16.105+0000 7faa68bf2640 1 -- 172.21.15.73:0/3767200683 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7faa640c7ed0 msgr2=0x7faa640bd8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:16.107 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:16.105+0000 7faa68bf2640 1 --2- 172.21.15.73:0/3767200683 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7faa640c7ed0 0x7faa640bd8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:16.107 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:16.105+0000 7faa68bf2640 1 -- 172.21.15.73:0/3767200683 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7faa641550a0 msgr2=0x7faa640bde20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:16.108 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:16.105+0000 7faa693f3640 1 --2- 172.21.15.73:0/3767200683 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7faa641550a0 0x7faa640bde20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:16.108 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:16.105+0000 7faa68bf2640 1 --2- 172.21.15.73:0/3767200683 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7faa641550a0 0x7faa640bde20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:16.108 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:16.105+0000 7faa68bf2640 1 -- 172.21.15.73:0/3767200683 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa5c009a70 con 0x7faa640c67c0 2023-12-12T09:46:16.108 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:16.105+0000 7faa5bfff640 1 --2- 172.21.15.73:0/3767200683 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7faa640c7ed0 0x7faa640bd8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:46:16.108 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:16.105+0000 7faa68bf2640 1 --2- 172.21.15.73:0/3767200683 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7faa640c67c0 0x7faa640aee70 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7faa6000c4d0 tx=0x7faa6000c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:46:16.108 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:16.105+0000 7faa597fa640 1 -- 172.21.15.73:0/3767200683 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa600074e0 con 0x7faa640c67c0 2023-12-12T09:46:16.108 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:16.105+0000 7faa597fa640 1 -- 172.21.15.73:0/3767200683 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa60007660 con 0x7faa640c67c0 2023-12-12T09:46:16.108 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:16.105+0000 7faa597fa640 1 -- 172.21.15.73:0/3767200683 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa60004a20 con 0x7faa640c67c0 2023-12-12T09:46:16.108 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:16.105+0000 7faa6ae56640 1 -- 172.21.15.73:0/3767200683 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa640c3f40 con 0x7faa640c67c0 2023-12-12T09:46:16.109 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:16.106+0000 7faa6ae56640 1 -- 172.21.15.73:0/3767200683 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa641ea330 con 0x7faa640c67c0 2023-12-12T09:46:16.109 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:16.107+0000 7faa6ae56640 1 -- 172.21.15.73:0/3767200683 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa64067580 con 0x7faa640c67c0 2023-12-12T09:46:16.109 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:16.108+0000 7faa597fa640 1 -- 172.21.15.73:0/3767200683 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7faa60004b80 con 0x7faa640c67c0 2023-12-12T09:46:16.110 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:16.109+0000 7faa597fa640 1 --2- 172.21.15.73:0/3767200683 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7faa5006ae40 0x7faa5006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:16.110 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:16.109+0000 7faa597fa640 1 -- 172.21.15.73:0/3767200683 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 5029+0+0 (secure 0 0 0) 0x7faa60088510 con 0x7faa640c67c0 2023-12-12T09:46:16.110 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:16.109+0000 7faa5bfff640 1 --2- 172.21.15.73:0/3767200683 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7faa5006ae40 0x7faa5006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:16.111 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:16.110+0000 7faa5bfff640 1 --2- 172.21.15.73:0/3767200683 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7faa5006ae40 0x7faa5006d300 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7faa641ee470 tx=0x7faa54008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:46:16.115 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:16.114+0000 7faa597fa640 1 -- 172.21.15.73:0/3767200683 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7faa60053860 con 0x7faa640c67c0 2023-12-12T09:46:16.306 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:16.304+0000 7faa6ae56640 1 -- 172.21.15.73:0/3767200683 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7faa640c0bc0 con 0x7faa640c67c0 2023-12-12T09:46:16.311 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:16.310+0000 7faa597fa640 1 -- 172.21.15.73:0/3767200683 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v13) v1 ==== 104+0+0 (secure 0 0 0) 0x7faa60056e80 con 0x7faa640c67c0 2023-12-12T09:46:16.315 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:16.313+0000 7faa6ae56640 1 -- 172.21.15.73:0/3767200683 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7faa5006ae40 msgr2=0x7faa5006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:16.315 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:16.313+0000 7faa6ae56640 1 --2- 172.21.15.73:0/3767200683 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7faa5006ae40 0x7faa5006d300 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7faa641ee470 tx=0x7faa54008040 comp rx=0 tx=0).stop 2023-12-12T09:46:16.315 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:16.313+0000 7faa6ae56640 1 -- 172.21.15.73:0/3767200683 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7faa640c67c0 msgr2=0x7faa640aee70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:16.315 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:16.313+0000 7faa6ae56640 1 --2- 172.21.15.73:0/3767200683 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7faa640c67c0 0x7faa640aee70 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7faa6000c4d0 tx=0x7faa6000c990 comp rx=0 tx=0).stop 2023-12-12T09:46:16.315 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:16.313+0000 7faa6ae56640 1 -- 172.21.15.73:0/3767200683 shutdown_connections 2023-12-12T09:46:16.315 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:16.313+0000 7faa6ae56640 1 --2- 172.21.15.73:0/3767200683 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7faa5006ae40 0x7faa5006d300 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:16.315 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:16.313+0000 7faa6ae56640 1 --2- 172.21.15.73:0/3767200683 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7faa641550a0 0x7faa640bde20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:16.315 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:16.313+0000 7faa6ae56640 1 --2- 172.21.15.73:0/3767200683 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7faa640c7ed0 0x7faa640bd8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:16.315 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:16.313+0000 7faa6ae56640 1 --2- 172.21.15.73:0/3767200683 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7faa640c67c0 0x7faa640aee70 unknown :-1 s=CLOSED pgs=825 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:16.315 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:16.313+0000 7faa6ae56640 1 -- 172.21.15.73:0/3767200683 >> 172.21.15.73:0/3767200683 conn(0x7faa640abb20 msgr2=0x7faa640abf00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:46:16.315 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:16.313+0000 7faa6ae56640 1 -- 172.21.15.73:0/3767200683 shutdown_connections 2023-12-12T09:46:16.315 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:16.313+0000 7faa6ae56640 1 -- 172.21.15.73:0/3767200683 wait complete. 2023-12-12T09:46:16.335 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_multifs_auth.TestClientsWithoutAuth.test_mount_mon_and_osd_caps_present_mds_caps_absent' 2023-12-12T09:46:16.547 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:16.546+0000 7fdd4b59e640 1 Processor -- start 2023-12-12T09:46:16.549 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:16.547+0000 7fdd4b59e640 1 -- start start 2023-12-12T09:46:16.551 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:16.550+0000 7fdd4b59e640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdd4c14fbb0 0x7fdd4c0aadd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:16.552 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:16.550+0000 7fdd4b59e640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fdd4c0c1cf0 0x7fdd4c0ab310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:16.552 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:16.550+0000 7fdd4b59e640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd4c0a90a0 con 0x7fdd4c152cc0 2023-12-12T09:46:16.552 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:16.550+0000 7fdd4b59e640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd4c153230 con 0x7fdd4c0c1cf0 2023-12-12T09:46:16.552 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:16.550+0000 7fdd4b59e640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd4c0bfb50 con 0x7fdd4c14fbb0 2023-12-12T09:46:16.552 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:16.551+0000 7fdd4a59c640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdd4c14fbb0 0x7fdd4c0aadd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:16.552 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:16.551+0000 7fdd4a59c640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdd4c14fbb0 0x7fdd4c0aadd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.73:58818/0 (socket says 172.21.15.73:58818) 2023-12-12T09:46:16.552 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:16.551+0000 7fdd4a59c640 1 -- 172.21.15.73:0/3269555251 learned_addr learned my addr 172.21.15.73:0/3269555251 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:46:16.552 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:16.551+0000 7fdd4ad9d640 1 --2- 172.21.15.73:0/3269555251 >> v2:172.21.15.73:3300/0 conn(0x7fdd4c0c1cf0 0x7fdd4c0ab310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:16.553 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:16.551+0000 7fdd4ad9d640 1 -- 172.21.15.73:0/3269555251 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdd4c14fbb0 msgr2=0x7fdd4c0aadd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:46:16.553 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:16.552+0000 7fdd4ad9d640 1 --2- 172.21.15.73:0/3269555251 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdd4c14fbb0 0x7fdd4c0aadd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:16.553 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:16.552+0000 7fdd4ad9d640 1 -- 172.21.15.73:0/3269555251 >> v1:172.21.15.142:6789/0 conn(0x7fdd4c152cc0 legacy=0x7fdd4c0c05d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:46:16.553 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:16.552+0000 7fdd4ad9d640 1 -- 172.21.15.73:0/3269555251 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd4c0bfe30 con 0x7fdd4c0c1cf0 2023-12-12T09:46:16.555 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:16.554+0000 7fdd4ad9d640 1 --2- 172.21.15.73:0/3269555251 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdd4c0c1cf0 0x7fdd4c0ab310 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7fdd44009d90 tx=0x7fdd4402bd80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e08d9bd35fb49bd server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:46:16.556 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:16.554+0000 7fdd4959a640 1 -- 172.21.15.73:0/3269555251 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd4402cb30 con 0x7fdd4c0c1cf0 2023-12-12T09:46:16.556 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:16.554+0000 7fdd4959a640 1 -- 172.21.15.73:0/3269555251 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd4402cc90 con 0x7fdd4c0c1cf0 2023-12-12T09:46:16.556 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:16.555+0000 7fdd4959a640 1 -- 172.21.15.73:0/3269555251 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd44034440 con 0x7fdd4c0c1cf0 2023-12-12T09:46:16.557 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:16.556+0000 7fdd4b59e640 1 -- 172.21.15.73:0/3269555251 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdd4c0c1cf0 msgr2=0x7fdd4c0ab310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:16.557 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:16.556+0000 7fdd4b59e640 1 --2- 172.21.15.73:0/3269555251 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdd4c0c1cf0 0x7fdd4c0ab310 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7fdd44009d90 tx=0x7fdd4402bd80 comp rx=0 tx=0).stop 2023-12-12T09:46:16.557 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:16.556+0000 7fdd4b59e640 1 -- 172.21.15.73:0/3269555251 shutdown_connections 2023-12-12T09:46:16.557 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:16.556+0000 7fdd4b59e640 1 --2- 172.21.15.73:0/3269555251 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdd4c0c1cf0 0x7fdd4c0ab310 unknown :-1 s=CLOSED pgs=826 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:16.558 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:16.556+0000 7fdd4b59e640 1 --2- 172.21.15.73:0/3269555251 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdd4c14fbb0 0x7fdd4c0aadd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:16.558 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:16.556+0000 7fdd4b59e640 1 -- 172.21.15.73:0/3269555251 >> 172.21.15.73:0/3269555251 conn(0x7fdd4c0c23b0 msgr2=0x7fdd4c0c27c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:46:16.558 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:16.556+0000 7fdd4b59e640 1 -- 172.21.15.73:0/3269555251 shutdown_connections 2023-12-12T09:46:16.558 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:16.556+0000 7fdd4b59e640 1 -- 172.21.15.73:0/3269555251 wait complete. 2023-12-12T09:46:16.559 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:16.558+0000 7fdd4b59e640 1 Processor -- start 2023-12-12T09:46:16.559 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:16.558+0000 7fdd4b59e640 1 -- start start 2023-12-12T09:46:16.562 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:16.559+0000 7fdd4b59e640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdd4c0c1cf0 0x7fdd4c147a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:16.562 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:16.559+0000 7fdd4b59e640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdd4c14fbb0 0x7fdd4c1514a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:16.562 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:16.559+0000 7fdd4b59e640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdd4c152cc0 0x7fdd4c145ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:16.562 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:16.559+0000 7fdd4b59e640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd4c071af0 con 0x7fdd4c152cc0 2023-12-12T09:46:16.562 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:16.559+0000 7fdd4b59e640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd4c147fd0 con 0x7fdd4c0c1cf0 2023-12-12T09:46:16.562 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:16.559+0000 7fdd4b59e640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd4c148510 con 0x7fdd4c14fbb0 2023-12-12T09:46:16.562 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:16.559+0000 7fdd4ad9d640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdd4c152cc0 0x7fdd4c145ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:16.562 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:16.559+0000 7fdd4ad9d640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdd4c152cc0 0x7fdd4c145ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:55578/0 (socket says 172.21.15.73:55578) 2023-12-12T09:46:16.562 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:16.559+0000 7fdd4ad9d640 1 -- 172.21.15.73:0/3815289424 learned_addr learned my addr 172.21.15.73:0/3815289424 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:46:16.563 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:16.559+0000 7fdd49d9b640 1 --2- 172.21.15.73:0/3815289424 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdd4c14fbb0 0x7fdd4c1514a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:16.563 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:16.559+0000 7fdd4ad9d640 1 -- 172.21.15.73:0/3815289424 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdd4c14fbb0 msgr2=0x7fdd4c1514a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:16.563 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:16.559+0000 7fdd4ad9d640 1 --2- 172.21.15.73:0/3815289424 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdd4c14fbb0 0x7fdd4c1514a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:16.563 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:16.559+0000 7fdd4ad9d640 1 -- 172.21.15.73:0/3815289424 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdd4c0c1cf0 msgr2=0x7fdd4c147a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:16.563 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:16.559+0000 7fdd4ad9d640 1 --2- 172.21.15.73:0/3815289424 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdd4c0c1cf0 0x7fdd4c147a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:16.563 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:16.559+0000 7fdd4ad9d640 1 -- 172.21.15.73:0/3815289424 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd44009a70 con 0x7fdd4c152cc0 2023-12-12T09:46:16.563 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:16.560+0000 7fdd4ad9d640 1 --2- 172.21.15.73:0/3815289424 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdd4c152cc0 0x7fdd4c145ba0 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7fdd44009eb0 tx=0x7fdd44004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:46:16.563 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:16.560+0000 7fdd3affd640 1 -- 172.21.15.73:0/3815289424 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd44009450 con 0x7fdd4c152cc0 2023-12-12T09:46:16.563 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:16.560+0000 7fdd3affd640 1 -- 172.21.15.73:0/3815289424 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd4403e410 con 0x7fdd4c152cc0 2023-12-12T09:46:16.563 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:16.560+0000 7fdd4b59e640 1 -- 172.21.15.73:0/3815289424 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd4c1487f0 con 0x7fdd4c152cc0 2023-12-12T09:46:16.563 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:16.560+0000 7fdd3affd640 1 -- 172.21.15.73:0/3815289424 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd4403e7c0 con 0x7fdd4c152cc0 2023-12-12T09:46:16.564 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:16.560+0000 7fdd4b59e640 1 -- 172.21.15.73:0/3815289424 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd4c1519e0 con 0x7fdd4c152cc0 2023-12-12T09:46:16.565 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:16.561+0000 7fdd4b59e640 1 -- 172.21.15.73:0/3815289424 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd4c067400 con 0x7fdd4c152cc0 2023-12-12T09:46:16.565 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:16.562+0000 7fdd3affd640 1 -- 172.21.15.73:0/3815289424 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fdd4403b050 con 0x7fdd4c152cc0 2023-12-12T09:46:16.565 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:16.563+0000 7fdd3affd640 1 --2- 172.21.15.73:0/3815289424 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fdd2c06ae40 0x7fdd2c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:16.565 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:16.563+0000 7fdd3affd640 1 -- 172.21.15.73:0/3815289424 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 5029+0+0 (secure 0 0 0) 0x7fdd440aba70 con 0x7fdd4c152cc0 2023-12-12T09:46:16.565 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:16.564+0000 7fdd4a59c640 1 --2- 172.21.15.73:0/3815289424 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fdd2c06ae40 0x7fdd2c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:16.566 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:16.564+0000 7fdd4a59c640 1 --2- 172.21.15.73:0/3815289424 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fdd2c06ae40 0x7fdd2c06d300 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fdd3c0094a0 tx=0x7fdd3c0093f0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:46:16.569 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:16.568+0000 7fdd3affd640 1 -- 172.21.15.73:0/3815289424 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fdd44076d30 con 0x7fdd4c152cc0 2023-12-12T09:46:16.830 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:16.828+0000 7fdd4b59e640 1 -- 172.21.15.73:0/3815289424 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_multifs_auth.TestClientsWithoutAuth.test_mount_mon_and_osd_caps_present_mds_caps_absent"]} v 0) v1 -- 0x7fdd4c071c30 con 0x7fdd4c152cc0 2023-12-12T09:46:16.859 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:16.858+0000 7fdd3affd640 1 -- 172.21.15.73:0/3815289424 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_multifs_auth.TestClientsWithoutAuth.test_mount_mon_and_osd_caps_present_mds_caps_absent"]}]=0 v183) v1 ==== 184+0+0 (secure 0 0 0) 0x7fdd4407a350 con 0x7fdd4c152cc0 2023-12-12T09:46:16.862 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:16.860+0000 7fdd4b59e640 1 -- 172.21.15.73:0/3815289424 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fdd2c06ae40 msgr2=0x7fdd2c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:16.862 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:16.860+0000 7fdd4b59e640 1 --2- 172.21.15.73:0/3815289424 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fdd2c06ae40 0x7fdd2c06d300 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fdd3c0094a0 tx=0x7fdd3c0093f0 comp rx=0 tx=0).stop 2023-12-12T09:46:16.863 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:16.860+0000 7fdd4b59e640 1 -- 172.21.15.73:0/3815289424 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdd4c152cc0 msgr2=0x7fdd4c145ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:16.863 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:16.860+0000 7fdd4b59e640 1 --2- 172.21.15.73:0/3815289424 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdd4c152cc0 0x7fdd4c145ba0 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7fdd44009eb0 tx=0x7fdd44004a40 comp rx=0 tx=0).stop 2023-12-12T09:46:16.863 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:16.861+0000 7fdd4b59e640 1 -- 172.21.15.73:0/3815289424 shutdown_connections 2023-12-12T09:46:16.863 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:16.861+0000 7fdd4b59e640 1 --2- 172.21.15.73:0/3815289424 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fdd2c06ae40 0x7fdd2c06d300 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:16.863 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:16.861+0000 7fdd4b59e640 1 --2- 172.21.15.73:0/3815289424 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdd4c152cc0 0x7fdd4c145ba0 unknown :-1 s=CLOSED pgs=827 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:16.863 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:16.861+0000 7fdd4b59e640 1 --2- 172.21.15.73:0/3815289424 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdd4c14fbb0 0x7fdd4c1514a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:16.863 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:16.861+0000 7fdd4b59e640 1 --2- 172.21.15.73:0/3815289424 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdd4c0c1cf0 0x7fdd4c147a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:16.863 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:16.861+0000 7fdd4b59e640 1 -- 172.21.15.73:0/3815289424 >> 172.21.15.73:0/3815289424 conn(0x7fdd4c0c23b0 msgr2=0x7fdd4c0a6bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:46:16.863 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:16.861+0000 7fdd4b59e640 1 -- 172.21.15.73:0/3815289424 shutdown_connections 2023-12-12T09:46:16.863 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:16.861+0000 7fdd4b59e640 1 -- 172.21.15.73:0/3815289424 wait complete. 2023-12-12T09:46:16.882 INFO:tasks.cephfs_test_runner:test_mount_mon_and_osd_caps_present_mds_caps_absent (tasks.cephfs.test_multifs_auth.TestClientsWithoutAuth) ... ok 2023-12-12T09:46:16.882 INFO:tasks.cephfs_test_runner:Starting test: test_r_with_fsname_and_no_path_in_cap (tasks.cephfs.test_multifs_auth.TestMDSCaps) 2023-12-12T09:46:16.883 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-12T09:46:17.100 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:17.099+0000 7fd43f052640 1 Processor -- start 2023-12-12T09:46:17.101 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:17.099+0000 7fd43f052640 1 -- start start 2023-12-12T09:46:17.102 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:17.101+0000 7fd43f052640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fd4380a5040 0x7fd43806bf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:17.102 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:17.101+0000 7fd43f052640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd4380c3ad0 0x7fd4381584f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:17.102 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:17.101+0000 7fd43f052640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4380c4d00 con 0x7fd43806a4e0 2023-12-12T09:46:17.102 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:17.101+0000 7fd43f052640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd43806c4d0 con 0x7fd4380a5040 2023-12-12T09:46:17.102 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:17.101+0000 7fd43f052640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4380c5100 con 0x7fd4380c3ad0 2023-12-12T09:46:17.103 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:17.101+0000 7fd437fff640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd4380c3ad0 0x7fd4381584f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:17.103 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:17.101+0000 7fd43cdee640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fd4380a5040 0x7fd43806bf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:17.103 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:17.101+0000 7fd437fff640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd4380c3ad0 0x7fd4381584f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.73:58830/0 (socket says 172.21.15.73:58830) 2023-12-12T09:46:17.103 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:17.102+0000 7fd437fff640 1 -- 172.21.15.73:0/3852256976 learned_addr learned my addr 172.21.15.73:0/3852256976 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:46:17.103 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:17.102+0000 7fd43d5ef640 1 --1- 172.21.15.73:0/3852256976 >> v1:172.21.15.142:6789/0 conn(0x7fd43806a4e0 0x7fd4380bede0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.73:33440/0 (socket says 172.21.15.73:33440) 2023-12-12T09:46:17.104 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:17.102+0000 7fd437fff640 1 -- 172.21.15.73:0/3852256976 >> v2:172.21.15.142:3300/0 conn(0x7fd4380a5040 msgr2=0x7fd43806bf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:46:17.104 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:17.102+0000 7fd437fff640 1 --2- 172.21.15.73:0/3852256976 >> v2:172.21.15.142:3300/0 conn(0x7fd4380a5040 0x7fd43806bf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:17.104 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:17.102+0000 7fd437fff640 1 -- 172.21.15.73:0/3852256976 >> v1:172.21.15.142:6789/0 conn(0x7fd43806a4e0 legacy=0x7fd4380bede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:17.104 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:17.102+0000 7fd437fff640 1 -- 172.21.15.73:0/3852256976 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4380c53e0 con 0x7fd4380c3ad0 2023-12-12T09:46:17.105 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:17.104+0000 7fd437fff640 1 --2- 172.21.15.73:0/3852256976 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd4380c3ad0 0x7fd4381584f0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fd424009870 tx=0x7fd42402ba20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a24c73ae894e6f9c server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:46:17.106 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:17.105+0000 7fd4377fe640 1 -- 172.21.15.73:0/3852256976 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd42402f840 con 0x7fd4380c3ad0 2023-12-12T09:46:17.106 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:17.105+0000 7fd4377fe640 1 -- 172.21.15.73:0/3852256976 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd42402f9a0 con 0x7fd4380c3ad0 2023-12-12T09:46:17.106 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:17.105+0000 7fd4377fe640 1 -- 172.21.15.73:0/3852256976 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd42402fd30 con 0x7fd4380c3ad0 2023-12-12T09:46:17.107 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:17.106+0000 7fd43f052640 1 -- 172.21.15.73:0/3852256976 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd4380c3ad0 msgr2=0x7fd4381584f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:17.107 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:17.106+0000 7fd43f052640 1 --2- 172.21.15.73:0/3852256976 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd4380c3ad0 0x7fd4381584f0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fd424009870 tx=0x7fd42402ba20 comp rx=0 tx=0).stop 2023-12-12T09:46:17.107 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:17.106+0000 7fd43f052640 1 -- 172.21.15.73:0/3852256976 shutdown_connections 2023-12-12T09:46:17.107 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:17.106+0000 7fd43f052640 1 --2- 172.21.15.73:0/3852256976 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd4380c3ad0 0x7fd4381584f0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:17.107 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:17.106+0000 7fd43f052640 1 --2- 172.21.15.73:0/3852256976 >> v2:172.21.15.142:3300/0 conn(0x7fd4380a5040 0x7fd43806bf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:17.107 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:17.106+0000 7fd43f052640 1 -- 172.21.15.73:0/3852256976 >> 172.21.15.73:0/3852256976 conn(0x7fd4380a8130 msgr2=0x7fd4380c24b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:46:17.108 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:17.106+0000 7fd43f052640 1 -- 172.21.15.73:0/3852256976 shutdown_connections 2023-12-12T09:46:17.108 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:17.106+0000 7fd43f052640 1 -- 172.21.15.73:0/3852256976 wait complete. 2023-12-12T09:46:17.109 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:17.108+0000 7fd43f052640 1 Processor -- start 2023-12-12T09:46:17.110 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:17.108+0000 7fd43f052640 1 -- start start 2023-12-12T09:46:17.111 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:17.109+0000 7fd43f052640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd43806a4e0 0x7fd4380a9610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:17.111 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:17.110+0000 7fd43f052640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd4380a5040 0x7fd4380a9b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:17.111 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:17.110+0000 7fd43f052640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd4380c3ad0 0x7fd4381548e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:17.112 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:17.110+0000 7fd43f052640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4380aa090 con 0x7fd4380c3ad0 2023-12-12T09:46:17.112 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:17.110+0000 7fd43f052640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4381ee970 con 0x7fd4380a5040 2023-12-12T09:46:17.112 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:17.110+0000 7fd43f052640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd43809a0c0 con 0x7fd43806a4e0 2023-12-12T09:46:17.112 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:17.110+0000 7fd43d5ef640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd4380c3ad0 0x7fd4381548e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:17.112 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:17.110+0000 7fd43d5ef640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd4380c3ad0 0x7fd4381548e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:55582/0 (socket says 172.21.15.73:55582) 2023-12-12T09:46:17.112 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:17.110+0000 7fd43d5ef640 1 -- 172.21.15.73:0/2769883783 learned_addr learned my addr 172.21.15.73:0/2769883783 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:46:17.112 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:17.110+0000 7fd437fff640 1 --2- 172.21.15.73:0/2769883783 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd4380a5040 0x7fd4380a9b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:17.112 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:17.110+0000 7fd43cdee640 1 --2- 172.21.15.73:0/2769883783 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd43806a4e0 0x7fd4380a9610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:17.113 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:17.110+0000 7fd43d5ef640 1 -- 172.21.15.73:0/2769883783 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd43806a4e0 msgr2=0x7fd4380a9610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:17.113 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:17.110+0000 7fd43d5ef640 1 --2- 172.21.15.73:0/2769883783 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd43806a4e0 0x7fd4380a9610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:17.113 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:17.111+0000 7fd43d5ef640 1 -- 172.21.15.73:0/2769883783 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd4380a5040 msgr2=0x7fd4380a9b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:17.113 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:17.111+0000 7fd43d5ef640 1 --2- 172.21.15.73:0/2769883783 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd4380a5040 0x7fd4380a9b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:17.113 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:17.111+0000 7fd43d5ef640 1 -- 172.21.15.73:0/2769883783 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4240094d0 con 0x7fd4380c3ad0 2023-12-12T09:46:17.113 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:17.111+0000 7fd43d5ef640 1 --2- 172.21.15.73:0/2769883783 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd4380c3ad0 0x7fd4381548e0 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7fd43000c730 tx=0x7fd43000cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:46:17.113 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:17.111+0000 7fd4357fa640 1 -- 172.21.15.73:0/2769883783 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd43000ce40 con 0x7fd4380c3ad0 2023-12-12T09:46:17.114 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:17.111+0000 7fd4357fa640 1 -- 172.21.15.73:0/2769883783 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd43000a640 con 0x7fd4380c3ad0 2023-12-12T09:46:17.114 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:17.111+0000 7fd4357fa640 1 -- 172.21.15.73:0/2769883783 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd43000a9f0 con 0x7fd4380c3ad0 2023-12-12T09:46:17.114 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:17.111+0000 7fd43f052640 1 -- 172.21.15.73:0/2769883783 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd438099b00 con 0x7fd4380c3ad0 2023-12-12T09:46:17.114 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:17.111+0000 7fd43f052640 1 -- 172.21.15.73:0/2769883783 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4380aab90 con 0x7fd4380c3ad0 2023-12-12T09:46:17.114 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:17.113+0000 7fd43f052640 1 -- 172.21.15.73:0/2769883783 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd4381de430 con 0x7fd4380c3ad0 2023-12-12T09:46:17.114 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:17.113+0000 7fd4357fa640 1 -- 172.21.15.73:0/2769883783 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fd43000ab50 con 0x7fd4380c3ad0 2023-12-12T09:46:17.116 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:17.114+0000 7fd4357fa640 1 --2- 172.21.15.73:0/2769883783 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fd41c06ae40 0x7fd41c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:17.116 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:17.114+0000 7fd4357fa640 1 -- 172.21.15.73:0/2769883783 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 5029+0+0 (secure 0 0 0) 0x7fd430088940 con 0x7fd4380c3ad0 2023-12-12T09:46:17.116 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:17.115+0000 7fd43cdee640 1 --2- 172.21.15.73:0/2769883783 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fd41c06ae40 0x7fd41c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:17.116 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:17.115+0000 7fd43cdee640 1 --2- 172.21.15.73:0/2769883783 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fd41c06ae40 0x7fd41c06d300 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fd42c009ad0 tx=0x7fd42c008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:46:17.120 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:17.119+0000 7fd4357fa640 1 -- 172.21.15.73:0/2769883783 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fd4381de430 con 0x7fd4380c3ad0 2023-12-12T09:46:17.314 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:17.313+0000 7fd43f052640 1 -- 172.21.15.73:0/2769883783 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd4381de430 con 0x7fd4380c3ad0 2023-12-12T09:46:17.316 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:17.314+0000 7fd4357fa640 1 -- 172.21.15.73:0/2769883783 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v66) v1 ==== 74+0+13129 (secure 0 0 0) 0x7fd4381de430 con 0x7fd4380c3ad0 2023-12-12T09:46:17.316 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-12T09:46:17.316 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":66,"fsid":"ba240992-02b8-4c7e-92f2-27eb29ac433b","created":"2023-12-12T09:43:02.454719+0000","modified":"2023-12-12T09:46:15.846167+0000","last_up_change":"2023-12-12T09:43:13.913440+0000","last_in_change":"2023-12-12T09:43:05.925348+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-12T09:43:15.525508+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"dd9074be-dbe2-4c34-9896-a4223d8d3940","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":4047810203},{"type":"v1","addr":"172.21.15.73:6801","nonce":4047810203}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":4047810203},{"type":"v1","addr":"172.21.15.73:6803","nonce":4047810203}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":4047810203},{"type":"v1","addr":"172.21.15.73:6807","nonce":4047810203}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":4047810203},{"type":"v1","addr":"172.21.15.73:6805","nonce":4047810203}]},"public_addr":"172.21.15.73:6801/4047810203","cluster_addr":"172.21.15.73:6803/4047810203","heartbeat_back_addr":"172.21.15.73:6807/4047810203","heartbeat_front_addr":"172.21.15.73:6805/4047810203","state":["exists","up"]},{"osd":1,"uuid":"c4a05052-96d4-4758-a4e1-1a37f1e07fed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":1356058331},{"type":"v1","addr":"172.21.15.73:6824","nonce":1356058331}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":1356058331},{"type":"v1","addr":"172.21.15.73:6827","nonce":1356058331}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":1356058331},{"type":"v1","addr":"172.21.15.73:6831","nonce":1356058331}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":1356058331},{"type":"v1","addr":"172.21.15.73:6829","nonce":1356058331}]},"public_addr":"172.21.15.73:6824/1356058331","cluster_addr":"172.21.15.73:6827/1356058331","heartbeat_back_addr":"172.21.15.73:6831/1356058331","heartbeat_front_addr":"172.21.15.73:6829/1356058331","state":["exists","up"]},{"osd":2,"uuid":"512bc8ac-72c2-40d4-b3d2-d867a92c5213","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":1228903316},{"type":"v1","addr":"172.21.15.73:6817","nonce":1228903316}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":1228903316},{"type":"v1","addr":"172.21.15.73:6819","nonce":1228903316}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6823","nonce":1228903316},{"type":"v1","addr":"172.21.15.73:6825","nonce":1228903316}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":1228903316},{"type":"v1","addr":"172.21.15.73:6821","nonce":1228903316}]},"public_addr":"172.21.15.73:6817/1228903316","cluster_addr":"172.21.15.73:6819/1228903316","heartbeat_back_addr":"172.21.15.73:6825/1228903316","heartbeat_front_addr":"172.21.15.73:6821/1228903316","state":["exists","up"]},{"osd":3,"uuid":"3d1a91e0-42bf-437a-8eae-8d357c8f63a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":1293329670},{"type":"v1","addr":"172.21.15.73:6809","nonce":1293329670}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6810","nonce":1293329670},{"type":"v1","addr":"172.21.15.73:6811","nonce":1293329670}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":1293329670},{"type":"v1","addr":"172.21.15.73:6815","nonce":1293329670}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":1293329670},{"type":"v1","addr":"172.21.15.73:6813","nonce":1293329670}]},"public_addr":"172.21.15.73:6809/1293329670","cluster_addr":"172.21.15.73:6811/1293329670","heartbeat_back_addr":"172.21.15.73:6815/1293329670","heartbeat_front_addr":"172.21.15.73:6813/1293329670","state":["exists","up"]},{"osd":4,"uuid":"4b302fff-834c-4069-ac19-00e46f6c87b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":3727975702},{"type":"v1","addr":"172.21.15.142:6801","nonce":3727975702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":3727975702},{"type":"v1","addr":"172.21.15.142:6803","nonce":3727975702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6809","nonce":3727975702},{"type":"v1","addr":"172.21.15.142:6811","nonce":3727975702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6805","nonce":3727975702},{"type":"v1","addr":"172.21.15.142:6807","nonce":3727975702}]},"public_addr":"172.21.15.142:6801/3727975702","cluster_addr":"172.21.15.142:6803/3727975702","heartbeat_back_addr":"172.21.15.142:6811/3727975702","heartbeat_front_addr":"172.21.15.142:6807/3727975702","state":["exists","up"]},{"osd":5,"uuid":"d7cdace2-67d0-45cc-95f2-515cf6ef1b82","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6817","nonce":2353193632},{"type":"v1","addr":"172.21.15.142:6819","nonce":2353193632}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6821","nonce":2353193632},{"type":"v1","addr":"172.21.15.142:6823","nonce":2353193632}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6829","nonce":2353193632},{"type":"v1","addr":"172.21.15.142:6831","nonce":2353193632}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6825","nonce":2353193632},{"type":"v1","addr":"172.21.15.142:6827","nonce":2353193632}]},"public_addr":"172.21.15.142:6819/2353193632","cluster_addr":"172.21.15.142:6823/2353193632","heartbeat_back_addr":"172.21.15.142:6831/2353193632","heartbeat_front_addr":"172.21.15.142:6827/2353193632","state":["exists","up"]},{"osd":6,"uuid":"649ce78a-5626-445c-aedc-a651ed05a6f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":2006111986},{"type":"v1","addr":"172.21.15.142:6806","nonce":2006111986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":2006111986},{"type":"v1","addr":"172.21.15.142:6810","nonce":2006111986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":2006111986},{"type":"v1","addr":"172.21.15.142:6815","nonce":2006111986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":2006111986},{"type":"v1","addr":"172.21.15.142:6813","nonce":2006111986}]},"public_addr":"172.21.15.142:6806/2006111986","cluster_addr":"172.21.15.142:6810/2006111986","heartbeat_back_addr":"172.21.15.142:6815/2006111986","heartbeat_front_addr":"172.21.15.142:6813/2006111986","state":["exists","up"]},{"osd":7,"uuid":"af15ae3b-c1d0-4acf-92db-8a1805494d13","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":2573794341},{"type":"v1","addr":"172.21.15.142:6818","nonce":2573794341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":2573794341},{"type":"v1","addr":"172.21.15.142:6822","nonce":2573794341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":2573794341},{"type":"v1","addr":"172.21.15.142:6830","nonce":2573794341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":2573794341},{"type":"v1","addr":"172.21.15.142:6826","nonce":2573794341}]},"public_addr":"172.21.15.142:6818/2573794341","cluster_addr":"172.21.15.142:6822/2573794341","heartbeat_back_addr":"172.21.15.142:6830/2573794341","heartbeat_front_addr":"172.21.15.142:6826/2573794341","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.185824+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.262103+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.225556+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:10.523459+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:10.706035+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.257339+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.301776+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.051960+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.142:6835/2931058847":"2023-12-13T09:46:12.834877+0000","172.21.15.142:6833/2931058847":"2023-12-13T09:46:12.834877+0000","172.21.15.73:6835/744058726":"2023-12-13T09:46:05.274143+0000","172.21.15.73:6834/744058726":"2023-12-13T09:46:05.274143+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-12T09:46:17.319 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:17.317+0000 7fd43f052640 1 -- 172.21.15.73:0/2769883783 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fd41c06ae40 msgr2=0x7fd41c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:17.319 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:17.317+0000 7fd43f052640 1 --2- 172.21.15.73:0/2769883783 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fd41c06ae40 0x7fd41c06d300 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fd42c009ad0 tx=0x7fd42c008040 comp rx=0 tx=0).stop 2023-12-12T09:46:17.319 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:17.317+0000 7fd43f052640 1 -- 172.21.15.73:0/2769883783 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd4380c3ad0 msgr2=0x7fd4381548e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:17.319 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:17.317+0000 7fd43f052640 1 --2- 172.21.15.73:0/2769883783 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd4380c3ad0 0x7fd4381548e0 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7fd43000c730 tx=0x7fd43000cbf0 comp rx=0 tx=0).stop 2023-12-12T09:46:17.319 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:17.317+0000 7fd43f052640 1 -- 172.21.15.73:0/2769883783 shutdown_connections 2023-12-12T09:46:17.319 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:17.317+0000 7fd43f052640 1 --2- 172.21.15.73:0/2769883783 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fd41c06ae40 0x7fd41c06d300 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:17.319 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:17.317+0000 7fd43f052640 1 --2- 172.21.15.73:0/2769883783 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd4380c3ad0 0x7fd4381548e0 unknown :-1 s=CLOSED pgs=828 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:17.319 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:17.317+0000 7fd43f052640 1 --2- 172.21.15.73:0/2769883783 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd4380a5040 0x7fd4380a9b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:17.319 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:17.317+0000 7fd43f052640 1 --2- 172.21.15.73:0/2769883783 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd43806a4e0 0x7fd4380a9610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:17.319 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:17.317+0000 7fd43f052640 1 -- 172.21.15.73:0/2769883783 >> 172.21.15.73:0/2769883783 conn(0x7fd4380a8130 msgr2=0x7fd4381e0e10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:46:17.319 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:17.317+0000 7fd43f052640 1 -- 172.21.15.73:0/2769883783 shutdown_connections 2023-12-12T09:46:17.319 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:17.317+0000 7fd43f052640 1 -- 172.21.15.73:0/2769883783 wait complete. 2023-12-12T09:46:17.337 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-12T09:43:15.525508+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-12T09:46:17.338 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-12T09:46:17.553 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:17.552+0000 7f92a3741640 1 Processor -- start 2023-12-12T09:46:17.553 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:17.552+0000 7f92a3741640 1 -- start start 2023-12-12T09:46:17.554 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:17.553+0000 7f92a3741640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f929c06dc40 0x7f929c152c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:17.554 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:17.553+0000 7f92a3741640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f929c0c16c0 con 0x7f929c06d350 2023-12-12T09:46:17.554 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:17.553+0000 7f92a3741640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f929c0c19a0 con 0x7f929c14f8c0 2023-12-12T09:46:17.554 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:17.553+0000 7f92a3741640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f929c0c1090 con 0x7f929c06dc40 2023-12-12T09:46:17.555 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:17.553+0000 7f92a0cdc640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f929c06d350 0x7f929c152500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:52620/0 (socket says 172.21.15.73:52620) 2023-12-12T09:46:17.555 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:17.553+0000 7f92a0cdc640 1 -- 172.21.15.73:0/307727309 learned_addr learned my addr 172.21.15.73:0/307727309 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-12T09:46:17.557 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:17.553+0000 7f92a1cde640 1 --2- 172.21.15.73:0/307727309 >> v2:172.21.15.142:3300/0 conn(0x7f929c06dc40 0x7f929c152c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:17.557 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:17.553+0000 7f9293fff640 1 -- 172.21.15.73:0/307727309 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 739419785 0 0) 0x7f929c0c16c0 con 0x7f929c06d350 2023-12-12T09:46:17.557 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:17.553+0000 7f9293fff640 1 -- 172.21.15.73:0/307727309 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9288003520 con 0x7f929c06d350 2023-12-12T09:46:17.557 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:17.554+0000 7f9293fff640 1 -- 172.21.15.73:0/307727309 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 210222757 0 0) 0x7f9288003520 con 0x7f929c06d350 2023-12-12T09:46:17.557 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:17.554+0000 7f9293fff640 1 -- 172.21.15.73:0/307727309 >> v2:172.21.15.142:3300/0 conn(0x7f929c06dc40 msgr2=0x7f929c152c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:46:17.557 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:17.554+0000 7f9293fff640 1 --2- 172.21.15.73:0/307727309 >> v2:172.21.15.142:3300/0 conn(0x7f929c06dc40 0x7f929c152c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:17.557 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:17.554+0000 7f9293fff640 1 -- 172.21.15.73:0/307727309 >> v1:172.21.15.142:6789/0 conn(0x7f929c14f8c0 legacy=0x7f929c071e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:46:17.557 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:17.554+0000 7f9293fff640 1 -- 172.21.15.73:0/307727309 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f929c0c1c80 con 0x7f929c06d350 2023-12-12T09:46:17.557 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:17.554+0000 7f9293fff640 1 -- 172.21.15.73:0/307727309 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3186547832 0 0) 0x7f928c001670 con 0x7f929c06d350 2023-12-12T09:46:17.557 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:17.554+0000 7f92a1cde640 1 --2- 172.21.15.73:0/307727309 >> v2:172.21.15.142:3300/0 conn(0x7f929c06dc40 0x7f929c152c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-12T09:46:17.557 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:17.554+0000 7f9293fff640 1 -- 172.21.15.73:0/307727309 >> v1:172.21.15.73:6789/0 conn(0x7f929c06d350 legacy=0x7f929c152500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:17.557 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:17.554+0000 7f9293fff640 1 --2- 172.21.15.73:0/307727309 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f92880039c0 0x7f9288003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:17.558 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:17.554+0000 7f9293fff640 1 --2- 172.21.15.73:0/307727309 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f92880047c0 0x7f9288004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:17.558 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:17.554+0000 7f9293fff640 1 --2- 172.21.15.73:0/307727309 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f92880051d0 0x7f928800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:17.558 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:17.554+0000 7f9293fff640 1 -- 172.21.15.73:0/307727309 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f928800c0d0 con 0x7f92880051d0 2023-12-12T09:46:17.558 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:17.554+0000 7f9293fff640 1 -- 172.21.15.73:0/307727309 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f928800c240 con 0x7f92880039c0 2023-12-12T09:46:17.558 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:17.554+0000 7f9293fff640 1 -- 172.21.15.73:0/307727309 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f928800c400 con 0x7f92880047c0 2023-12-12T09:46:17.558 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:17.554+0000 7f92a1cde640 1 --2- 172.21.15.73:0/307727309 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f92880051d0 0x7f928800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:17.558 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:17.554+0000 7f92a14dd640 1 --2- 172.21.15.73:0/307727309 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f92880039c0 0x7f9288003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:17.558 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:17.555+0000 7f92a1cde640 1 -- 172.21.15.73:0/307727309 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f92880047c0 msgr2=0x7f9288004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:46:17.558 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:17.555+0000 7f92a0cdc640 1 --2- 172.21.15.73:0/307727309 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f92880047c0 0x7f9288004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:17.558 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:17.555+0000 7f92a1cde640 1 --2- 172.21.15.73:0/307727309 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f92880047c0 0x7f9288004c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:17.558 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:17.555+0000 7f92a1cde640 1 -- 172.21.15.73:0/307727309 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f92880039c0 msgr2=0x7f9288003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:46:17.558 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:17.555+0000 7f92a1cde640 1 --2- 172.21.15.73:0/307727309 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f92880039c0 0x7f9288003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:17.558 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:17.555+0000 7f92a1cde640 1 -- 172.21.15.73:0/307727309 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9288003520 con 0x7f92880051d0 2023-12-12T09:46:17.559 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:17.555+0000 7f92a14dd640 1 --2- 172.21.15.73:0/307727309 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f92880039c0 0x7f9288003dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:46:17.559 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:17.556+0000 7f92a1cde640 1 -- 172.21.15.73:0/307727309 reap_dead start 2023-12-12T09:46:17.559 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:17.556+0000 7f92a1cde640 1 --2- 172.21.15.73:0/307727309 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f92880051d0 0x7f928800b980 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7f9294006fd0 tx=0x7f92880057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c41765d0a7e1c1b server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:46:17.560 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:17.556+0000 7f9293fff640 1 -- 172.21.15.73:0/307727309 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9294004220 con 0x7f92880051d0 2023-12-12T09:46:17.560 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:17.556+0000 7f9293fff640 1 -- 172.21.15.73:0/307727309 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9294004380 con 0x7f92880051d0 2023-12-12T09:46:17.560 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:17.556+0000 7f9293fff640 1 -- 172.21.15.73:0/307727309 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9294003850 con 0x7f92880051d0 2023-12-12T09:46:17.560 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:17.556+0000 7f92a3741640 1 -- 172.21.15.73:0/307727309 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f92880051d0 msgr2=0x7f928800b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:17.560 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:17.556+0000 7f92a3741640 1 --2- 172.21.15.73:0/307727309 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f92880051d0 0x7f928800b980 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7f9294006fd0 tx=0x7f92880057f0 comp rx=0 tx=0).stop 2023-12-12T09:46:17.560 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:17.557+0000 7f92a3741640 1 -- 172.21.15.73:0/307727309 shutdown_connections 2023-12-12T09:46:17.560 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:17.557+0000 7f92a3741640 1 --2- 172.21.15.73:0/307727309 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f92880051d0 0x7f928800b980 unknown :-1 s=CLOSED pgs=830 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:17.560 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:17.557+0000 7f92a3741640 1 -- 172.21.15.73:0/307727309 >> 172.21.15.73:0/307727309 conn(0x7f929c06a4e0 msgr2=0x7f929c06a8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:46:17.561 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:17.557+0000 7f92a3741640 1 -- 172.21.15.73:0/307727309 shutdown_connections 2023-12-12T09:46:17.561 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:17.557+0000 7f92a3741640 1 -- 172.21.15.73:0/307727309 wait complete. 2023-12-12T09:46:17.561 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:17.558+0000 7f92a3741640 1 Processor -- start 2023-12-12T09:46:17.561 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:17.558+0000 7f92a3741640 1 -- start start 2023-12-12T09:46:17.563 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:17.559+0000 7f92a3741640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f92880051d0 0x7f929c1e6d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:17.563 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:17.559+0000 7f92a3741640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f929c1ea660 0x7f929c1e72a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:17.563 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:17.559+0000 7f92a3741640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f929c0a94b0 0x7f929c0a5620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:17.563 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:17.559+0000 7f92a3741640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f929c0aa7e0 con 0x7f929c0a94b0 2023-12-12T09:46:17.563 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:17.559+0000 7f92a3741640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f929c0a9060 con 0x7f92880051d0 2023-12-12T09:46:17.563 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:17.559+0000 7f92a3741640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f929c0a73d0 con 0x7f929c1ea660 2023-12-12T09:46:17.563 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:17.560+0000 7f92a1cde640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f929c0a94b0 0x7f929c0a5620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:17.563 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:17.560+0000 7f92a1cde640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f929c0a94b0 0x7f929c0a5620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:55602/0 (socket says 172.21.15.73:55602) 2023-12-12T09:46:17.563 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:17.560+0000 7f92a1cde640 1 -- 172.21.15.73:0/3671231170 learned_addr learned my addr 172.21.15.73:0/3671231170 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:46:17.563 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:17.560+0000 7f92a14dd640 1 --2- 172.21.15.73:0/3671231170 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f92880051d0 0x7f929c1e6d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:17.563 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:17.560+0000 7f92a0cdc640 1 --2- 172.21.15.73:0/3671231170 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f929c1ea660 0x7f929c1e72a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:17.563 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:17.560+0000 7f92a1cde640 1 -- 172.21.15.73:0/3671231170 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f929c1ea660 msgr2=0x7f929c1e72a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:17.564 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:17.560+0000 7f92a1cde640 1 --2- 172.21.15.73:0/3671231170 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f929c1ea660 0x7f929c1e72a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:17.564 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:17.560+0000 7f92a1cde640 1 -- 172.21.15.73:0/3671231170 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f92880051d0 msgr2=0x7f929c1e6d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:17.564 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:17.560+0000 7f92a1cde640 1 --2- 172.21.15.73:0/3671231170 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f92880051d0 0x7f929c1e6d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:17.564 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:17.560+0000 7f92a1cde640 1 -- 172.21.15.73:0/3671231170 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f929c1eab60 con 0x7f929c0a94b0 2023-12-12T09:46:17.564 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:17.560+0000 7f92a1cde640 1 --2- 172.21.15.73:0/3671231170 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f929c0a94b0 0x7f929c0a5620 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7f929402bfc0 tx=0x7f9294004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:46:17.564 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:17.561+0000 7f9291ffb640 1 -- 172.21.15.73:0/3671231170 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f929403f070 con 0x7f929c0a94b0 2023-12-12T09:46:17.564 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:17.561+0000 7f9291ffb640 1 -- 172.21.15.73:0/3671231170 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9294006dd0 con 0x7f929c0a94b0 2023-12-12T09:46:17.564 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:17.561+0000 7f9291ffb640 1 -- 172.21.15.73:0/3671231170 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9294030680 con 0x7f929c0a94b0 2023-12-12T09:46:17.564 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:17.561+0000 7f92a3741640 1 -- 172.21.15.73:0/3671231170 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f929c0a6e10 con 0x7f929c0a94b0 2023-12-12T09:46:17.564 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:17.561+0000 7f92a3741640 1 -- 172.21.15.73:0/3671231170 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f929c151d50 con 0x7f929c0a94b0 2023-12-12T09:46:17.565 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:17.562+0000 7f92a3741640 1 -- 172.21.15.73:0/3671231170 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f929c0a91d0 con 0x7f929c0a94b0 2023-12-12T09:46:17.565 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:17.563+0000 7f9291ffb640 1 -- 172.21.15.73:0/3671231170 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f92940307e0 con 0x7f929c0a94b0 2023-12-12T09:46:17.565 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:17.564+0000 7f9291ffb640 1 --2- 172.21.15.73:0/3671231170 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f928006ae40 0x7f928006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:17.565 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:17.564+0000 7f9291ffb640 1 -- 172.21.15.73:0/3671231170 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f92940aa4e0 con 0x7f929c0a94b0 2023-12-12T09:46:17.565 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:17.564+0000 7f92a14dd640 1 --2- 172.21.15.73:0/3671231170 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f928006ae40 0x7f928006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:17.566 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:17.565+0000 7f92a14dd640 1 --2- 172.21.15.73:0/3671231170 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f928006ae40 0x7f928006d300 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f9298005570 tx=0x7f9298009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:46:17.570 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:17.569+0000 7f9291ffb640 1 -- 172.21.15.73:0/3671231170 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f929c0a91d0 con 0x7f929c0a94b0 2023-12-12T09:46:17.760 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:17.758+0000 7f92a3741640 1 -- 172.21.15.73:0/3671231170 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f929c0a91d0 con 0x7f929c0a94b0 2023-12-12T09:46:17.761 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:17.760+0000 7f9291ffb640 1 -- 172.21.15.73:0/3671231170 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v66) v1 ==== 93+0+10 (secure 0 0 0) 0x7f929c0a91d0 con 0x7f929c0a94b0 2023-12-12T09:46:17.761 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 1 2023-12-12T09:46:17.764 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:17.762+0000 7f92a3741640 1 -- 172.21.15.73:0/3671231170 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f928006ae40 msgr2=0x7f928006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:17.765 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:17.762+0000 7f92a3741640 1 --2- 172.21.15.73:0/3671231170 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f928006ae40 0x7f928006d300 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f9298005570 tx=0x7f9298009040 comp rx=0 tx=0).stop 2023-12-12T09:46:17.765 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:17.762+0000 7f92a3741640 1 -- 172.21.15.73:0/3671231170 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f929c0a94b0 msgr2=0x7f929c0a5620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:17.765 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:17.762+0000 7f92a3741640 1 --2- 172.21.15.73:0/3671231170 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f929c0a94b0 0x7f929c0a5620 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7f929402bfc0 tx=0x7f9294004730 comp rx=0 tx=0).stop 2023-12-12T09:46:17.765 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:17.763+0000 7f92a3741640 1 -- 172.21.15.73:0/3671231170 shutdown_connections 2023-12-12T09:46:17.765 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:17.763+0000 7f92a3741640 1 --2- 172.21.15.73:0/3671231170 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f928006ae40 0x7f928006d300 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:17.765 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:17.763+0000 7f92a3741640 1 --2- 172.21.15.73:0/3671231170 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f929c0a94b0 0x7f929c0a5620 unknown :-1 s=CLOSED pgs=831 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:17.765 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:17.763+0000 7f92a3741640 1 --2- 172.21.15.73:0/3671231170 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f929c1ea660 0x7f929c1e72a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:17.765 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:17.763+0000 7f92a3741640 1 --2- 172.21.15.73:0/3671231170 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f92880051d0 0x7f929c1e6d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:17.765 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:17.763+0000 7f92a3741640 1 -- 172.21.15.73:0/3671231170 >> 172.21.15.73:0/3671231170 conn(0x7f929c06a4e0 msgr2=0x7f929c0c3780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:46:17.765 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:17.763+0000 7f92a3741640 1 -- 172.21.15.73:0/3671231170 shutdown_connections 2023-12-12T09:46:17.765 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:17.763+0000 7f92a3741640 1 -- 172.21.15.73:0/3671231170 wait complete. 2023-12-12T09:46:17.783 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_multifs_auth.TestMDSCaps.test_r_with_fsname_and_no_path_in_cap' 2023-12-12T09:46:17.985 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:17.984+0000 7f0e34f97640 1 Processor -- start 2023-12-12T09:46:17.985 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:17.984+0000 7f0e34f97640 1 -- start start 2023-12-12T09:46:17.986 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:17.985+0000 7f0e34f97640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f0e3014fa40 0x7f0e3006a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:17.987 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:17.985+0000 7f0e34f97640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e30152610 con 0x7f0e300c5070 2023-12-12T09:46:17.987 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:17.985+0000 7f0e34f97640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e301528f0 con 0x7f0e3006db70 2023-12-12T09:46:17.987 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:17.985+0000 7f0e34f97640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e30152bd0 con 0x7f0e3014fa40 2023-12-12T09:46:17.987 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:17.985+0000 7f0e2e59c640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f0e3014fa40 0x7f0e3006a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:17.987 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:17.985+0000 7f0e2ed9d640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f0e300c5070 0x7f0e300c40c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:52622/0 (socket says 172.21.15.73:52622) 2023-12-12T09:46:17.987 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:17.985+0000 7f0e2ed9d640 1 -- 172.21.15.73:0/1693787880 learned_addr learned my addr 172.21.15.73:0/1693787880 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-12T09:46:17.988 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:17.986+0000 7f0e2e59c640 1 -- 172.21.15.73:0/1693787880 >> v1:172.21.15.142:6789/0 conn(0x7f0e3006db70 legacy=0x7f0e300c39b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:46:17.988 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:17.986+0000 7f0e2e59c640 1 -- 172.21.15.73:0/1693787880 >> v1:172.21.15.73:6789/0 conn(0x7f0e300c5070 legacy=0x7f0e300c40c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:17.988 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:17.986+0000 7f0e2e59c640 1 -- 172.21.15.73:0/1693787880 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e30152eb0 con 0x7f0e3014fa40 2023-12-12T09:46:17.988 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:17.986+0000 7f0e2dd9b640 1 -- 172.21.15.73:0/1693787880 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3886094899 0 0) 0x7f0e30152610 con 0x7f0e300c5070 2023-12-12T09:46:17.988 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:17.987+0000 7f0e2e59c640 1 --2- 172.21.15.73:0/1693787880 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0e3014fa40 0x7f0e3006a4e0 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7f0e200097a0 tx=0x7f0e2002b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0935f02543a2e7a server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:46:17.989 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:17.987+0000 7f0e2dd9b640 1 -- 172.21.15.73:0/1693787880 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e2002e070 con 0x7f0e3014fa40 2023-12-12T09:46:17.989 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:17.987+0000 7f0e2dd9b640 1 -- 172.21.15.73:0/1693787880 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e200315a0 con 0x7f0e3014fa40 2023-12-12T09:46:17.989 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:17.987+0000 7f0e2dd9b640 1 -- 172.21.15.73:0/1693787880 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e20031930 con 0x7f0e3014fa40 2023-12-12T09:46:17.989 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:17.988+0000 7f0e34f97640 1 -- 172.21.15.73:0/1693787880 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0e3014fa40 msgr2=0x7f0e3006a4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:17.990 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:17.988+0000 7f0e34f97640 1 --2- 172.21.15.73:0/1693787880 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0e3014fa40 0x7f0e3006a4e0 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7f0e200097a0 tx=0x7f0e2002b840 comp rx=0 tx=0).stop 2023-12-12T09:46:17.990 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:17.988+0000 7f0e34f97640 1 -- 172.21.15.73:0/1693787880 shutdown_connections 2023-12-12T09:46:17.990 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:17.988+0000 7f0e34f97640 1 --2- 172.21.15.73:0/1693787880 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0e3014fa40 0x7f0e3006a4e0 unknown :-1 s=CLOSED pgs=833 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:17.990 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:17.988+0000 7f0e34f97640 1 -- 172.21.15.73:0/1693787880 >> 172.21.15.73:0/1693787880 conn(0x7f0e300a8130 msgr2=0x7f0e300c24b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:46:17.990 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:17.988+0000 7f0e34f97640 1 -- 172.21.15.73:0/1693787880 shutdown_connections 2023-12-12T09:46:17.990 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:17.988+0000 7f0e34f97640 1 -- 172.21.15.73:0/1693787880 wait complete. 2023-12-12T09:46:17.991 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:17.990+0000 7f0e34f97640 1 Processor -- start 2023-12-12T09:46:17.991 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:17.990+0000 7f0e34f97640 1 -- start start 2023-12-12T09:46:17.994 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:17.991+0000 7f0e34f97640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0e3006db70 0x7f0e300bddb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:17.994 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:17.991+0000 7f0e34f97640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0e300c5070 0x7f0e300bbe30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:17.994 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:17.991+0000 7f0e34f97640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0e3014fa40 0x7f0e300bcc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:17.994 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:17.991+0000 7f0e34f97640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e300bb3e0 con 0x7f0e3014fa40 2023-12-12T09:46:17.994 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:17.991+0000 7f0e34f97640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e300bb9a0 con 0x7f0e3006db70 2023-12-12T09:46:17.994 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:17.991+0000 7f0e34f97640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e301df090 con 0x7f0e300c5070 2023-12-12T09:46:17.995 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:17.991+0000 7f0e2ed9d640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0e3014fa40 0x7f0e300bcc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:17.995 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:17.991+0000 7f0e2ed9d640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0e3014fa40 0x7f0e300bcc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:55628/0 (socket says 172.21.15.73:55628) 2023-12-12T09:46:17.995 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:17.991+0000 7f0e2ed9d640 1 -- 172.21.15.73:0/995063275 learned_addr learned my addr 172.21.15.73:0/995063275 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:46:17.995 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:17.991+0000 7f0e2e59c640 1 --2- 172.21.15.73:0/995063275 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0e3006db70 0x7f0e300bddb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:17.995 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:17.991+0000 7f0e2ed9d640 1 -- 172.21.15.73:0/995063275 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0e300c5070 msgr2=0x7f0e300bbe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:17.995 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:17.991+0000 7f0e25d9b640 1 --2- 172.21.15.73:0/995063275 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0e300c5070 0x7f0e300bbe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:17.995 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:17.992+0000 7f0e2ed9d640 1 --2- 172.21.15.73:0/995063275 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0e300c5070 0x7f0e300bbe30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:17.995 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:17.992+0000 7f0e2ed9d640 1 -- 172.21.15.73:0/995063275 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0e3006db70 msgr2=0x7f0e300bddb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:17.995 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:17.992+0000 7f0e2ed9d640 1 --2- 172.21.15.73:0/995063275 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0e3006db70 0x7f0e300bddb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:17.995 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:17.992+0000 7f0e2ed9d640 1 -- 172.21.15.73:0/995063275 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e20009400 con 0x7f0e3014fa40 2023-12-12T09:46:17.995 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:17.992+0000 7f0e2e59c640 1 --2- 172.21.15.73:0/995063275 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0e3006db70 0x7f0e300bddb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:46:17.995 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:17.992+0000 7f0e25d9b640 1 --2- 172.21.15.73:0/995063275 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0e300c5070 0x7f0e300bbe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:46:17.995 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:17.992+0000 7f0e2ed9d640 1 --2- 172.21.15.73:0/995063275 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0e3014fa40 0x7f0e300bcc60 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7f0e2800c810 tx=0x7f0e2800ccd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:46:17.995 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:17.992+0000 7f0e277fe640 1 -- 172.21.15.73:0/995063275 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e2800a640 con 0x7f0e3014fa40 2023-12-12T09:46:17.995 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:17.992+0000 7f0e277fe640 1 -- 172.21.15.73:0/995063275 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e2800a7c0 con 0x7f0e3014fa40 2023-12-12T09:46:17.996 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:17.992+0000 7f0e34f97640 1 -- 172.21.15.73:0/995063275 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e301df370 con 0x7f0e3014fa40 2023-12-12T09:46:17.996 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:17.992+0000 7f0e277fe640 1 -- 172.21.15.73:0/995063275 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e2800ab70 con 0x7f0e3014fa40 2023-12-12T09:46:17.996 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:17.992+0000 7f0e34f97640 1 -- 172.21.15.73:0/995063275 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e301ded20 con 0x7f0e3014fa40 2023-12-12T09:46:17.996 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:17.993+0000 7f0e34f97640 1 -- 172.21.15.73:0/995063275 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e300bbb30 con 0x7f0e3014fa40 2023-12-12T09:46:17.997 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:17.994+0000 7f0e277fe640 1 -- 172.21.15.73:0/995063275 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f0e2800acd0 con 0x7f0e3014fa40 2023-12-12T09:46:17.997 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:17.995+0000 7f0e277fe640 1 --2- 172.21.15.73:0/995063275 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f0e1006ae40 0x7f0e1006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:17.997 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:17.995+0000 7f0e277fe640 1 -- 172.21.15.73:0/995063275 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f0e28088b90 con 0x7f0e3014fa40 2023-12-12T09:46:17.997 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:17.995+0000 7f0e2e59c640 1 --2- 172.21.15.73:0/995063275 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f0e1006ae40 0x7f0e1006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:17.997 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:17.996+0000 7f0e2e59c640 1 --2- 172.21.15.73:0/995063275 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f0e1006ae40 0x7f0e1006d300 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f0e20036000 tx=0x7f0e2003d040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:46:18.001 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:18.001+0000 7f0e277fe640 1 -- 172.21.15.73:0/995063275 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f0e28053ed0 con 0x7f0e3014fa40 2023-12-12T09:46:18.254 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:18.254+0000 7f0e34f97640 1 -- 172.21.15.73:0/995063275 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_multifs_auth.TestMDSCaps.test_r_with_fsname_and_no_path_in_cap"]} v 0) v1 -- 0x7f0e30067580 con 0x7f0e3014fa40 2023-12-12T09:46:18.865 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:18.865+0000 7f0e277fe640 1 -- 172.21.15.73:0/995063275 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_multifs_auth.TestMDSCaps.test_r_with_fsname_and_no_path_in_cap"]}]=0 v185) v1 ==== 162+0+0 (secure 0 0 0) 0x7f0e28018020 con 0x7f0e3014fa40 2023-12-12T09:46:18.870 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:18.869+0000 7f0e34f97640 1 -- 172.21.15.73:0/995063275 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f0e1006ae40 msgr2=0x7f0e1006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:18.870 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:18.869+0000 7f0e34f97640 1 --2- 172.21.15.73:0/995063275 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f0e1006ae40 0x7f0e1006d300 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f0e20036000 tx=0x7f0e2003d040 comp rx=0 tx=0).stop 2023-12-12T09:46:18.870 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:18.869+0000 7f0e34f97640 1 -- 172.21.15.73:0/995063275 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0e3014fa40 msgr2=0x7f0e300bcc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:18.870 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:18.869+0000 7f0e34f97640 1 --2- 172.21.15.73:0/995063275 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0e3014fa40 0x7f0e300bcc60 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7f0e2800c810 tx=0x7f0e2800ccd0 comp rx=0 tx=0).stop 2023-12-12T09:46:18.870 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:18.869+0000 7f0e34f97640 1 -- 172.21.15.73:0/995063275 shutdown_connections 2023-12-12T09:46:18.870 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:18.869+0000 7f0e34f97640 1 --2- 172.21.15.73:0/995063275 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f0e1006ae40 0x7f0e1006d300 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:18.870 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:18.869+0000 7f0e34f97640 1 --2- 172.21.15.73:0/995063275 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0e3014fa40 0x7f0e300bcc60 unknown :-1 s=CLOSED pgs=834 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:18.870 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:18.869+0000 7f0e34f97640 1 --2- 172.21.15.73:0/995063275 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0e300c5070 0x7f0e300bbe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:18.870 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:18.869+0000 7f0e34f97640 1 --2- 172.21.15.73:0/995063275 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0e3006db70 0x7f0e300bddb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:18.870 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:18.869+0000 7f0e34f97640 1 -- 172.21.15.73:0/995063275 >> 172.21.15.73:0/995063275 conn(0x7f0e300a8130 msgr2=0x7f0e300c21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:46:18.870 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:18.869+0000 7f0e34f97640 1 -- 172.21.15.73:0/995063275 shutdown_connections 2023-12-12T09:46:18.871 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:18.870+0000 7f0e34f97640 1 -- 172.21.15.73:0/995063275 wait complete. 2023-12-12T09:46:18.891 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-12-12T09:46:18.933 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T09:46:18.943 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T09:46:19.094 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:19.094+0000 7f0236a3d640 1 Processor -- start 2023-12-12T09:46:19.095 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:19.094+0000 7f0236a3d640 1 -- start start 2023-12-12T09:46:19.096 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:19.095+0000 7f0236a3d640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f023006dc40 0x7f0230152c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:19.096 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:19.095+0000 7f0236a3d640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02300c16c0 con 0x7f023014f8c0 2023-12-12T09:46:19.096 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:19.095+0000 7f0236a3d640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02300c19a0 con 0x7f023006d350 2023-12-12T09:46:19.096 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:19.095+0000 7f0236a3d640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02300c1090 con 0x7f023006dc40 2023-12-12T09:46:19.096 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:19.096+0000 7f022ffff640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f023014f8c0 0x7f0230071e60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:53754/0 (socket says 172.21.15.73:53754) 2023-12-12T09:46:19.096 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:19.096+0000 7f022ffff640 1 -- 172.21.15.73:0/96987493 learned_addr learned my addr 172.21.15.73:0/96987493 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-12T09:46:19.100 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:19.096+0000 7f0234fda640 1 --2- 172.21.15.73:0/96987493 >> v2:172.21.15.142:3300/0 conn(0x7f023006dc40 0x7f0230152c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:19.100 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:19.096+0000 7f022effd640 1 -- 172.21.15.73:0/96987493 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 952291572 0 0) 0x7f02300c16c0 con 0x7f023014f8c0 2023-12-12T09:46:19.100 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:19.096+0000 7f022effd640 1 -- 172.21.15.73:0/96987493 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0218003520 con 0x7f023014f8c0 2023-12-12T09:46:19.100 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:19.097+0000 7f022effd640 1 -- 172.21.15.73:0/96987493 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1254337983 0 0) 0x7f0218003520 con 0x7f023014f8c0 2023-12-12T09:46:19.100 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:19.097+0000 7f022effd640 1 -- 172.21.15.73:0/96987493 >> v2:172.21.15.142:3300/0 conn(0x7f023006dc40 msgr2=0x7f0230152c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:46:19.100 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:19.097+0000 7f022effd640 1 --2- 172.21.15.73:0/96987493 >> v2:172.21.15.142:3300/0 conn(0x7f023006dc40 0x7f0230152c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:19.100 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:19.097+0000 7f022effd640 1 -- 172.21.15.73:0/96987493 >> v1:172.21.15.142:6789/0 conn(0x7f023006d350 legacy=0x7f0230152500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:19.100 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:19.097+0000 7f022effd640 1 -- 172.21.15.73:0/96987493 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02300c1c80 con 0x7f023014f8c0 2023-12-12T09:46:19.101 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:19.097+0000 7f022effd640 1 -- 172.21.15.73:0/96987493 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3186547832 0 0) 0x7f0220001670 con 0x7f023014f8c0 2023-12-12T09:46:19.101 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:19.097+0000 7f022effd640 1 -- 172.21.15.73:0/96987493 >> v1:172.21.15.73:6789/0 conn(0x7f023014f8c0 legacy=0x7f0230071e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:19.101 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:19.097+0000 7f022effd640 1 --2- 172.21.15.73:0/96987493 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0218003970 0x7f0218003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:19.101 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:19.097+0000 7f022effd640 1 --2- 172.21.15.73:0/96987493 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f02180047c0 0x7f0218004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:19.101 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:19.097+0000 7f022effd640 1 --2- 172.21.15.73:0/96987493 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0218005180 0x7f021800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:19.101 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:19.097+0000 7f022effd640 1 -- 172.21.15.73:0/96987493 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f021800bff0 con 0x7f0218005180 2023-12-12T09:46:19.101 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:19.097+0000 7f022effd640 1 -- 172.21.15.73:0/96987493 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f021800c160 con 0x7f0218003970 2023-12-12T09:46:19.101 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:19.097+0000 7f022effd640 1 -- 172.21.15.73:0/96987493 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f021800c320 con 0x7f02180047c0 2023-12-12T09:46:19.101 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:19.097+0000 7f0234fda640 1 --2- 172.21.15.73:0/96987493 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0218005180 0x7f021800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:19.101 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:19.097+0000 7f022f7fe640 1 --2- 172.21.15.73:0/96987493 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f02180047c0 0x7f0218004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:19.101 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:19.097+0000 7f022ffff640 1 --2- 172.21.15.73:0/96987493 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0218003970 0x7f0218003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:19.101 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:19.097+0000 7f0234fda640 1 -- 172.21.15.73:0/96987493 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f02180047c0 msgr2=0x7f0218004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:46:19.101 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:19.097+0000 7f0234fda640 1 --2- 172.21.15.73:0/96987493 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f02180047c0 0x7f0218004c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:19.101 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:19.097+0000 7f0234fda640 1 -- 172.21.15.73:0/96987493 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0218003970 msgr2=0x7f0218003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:46:19.102 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:19.097+0000 7f0234fda640 1 --2- 172.21.15.73:0/96987493 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0218003970 0x7f0218003d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:19.102 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:19.098+0000 7f0234fda640 1 -- 172.21.15.73:0/96987493 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0218003520 con 0x7f0218005180 2023-12-12T09:46:19.102 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:19.098+0000 7f0234fda640 1 -- 172.21.15.73:0/96987493 reap_dead start 2023-12-12T09:46:19.102 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:19.099+0000 7f0234fda640 1 --2- 172.21.15.73:0/96987493 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0218005180 0x7f021800b980 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7f0228009fc0 tx=0x7f02180057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b560c818746127d2 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:46:19.102 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:19.099+0000 7f022effd640 1 -- 172.21.15.73:0/96987493 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f022802cc60 con 0x7f0218005180 2023-12-12T09:46:19.102 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:19.099+0000 7f022effd640 1 -- 172.21.15.73:0/96987493 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f022800f040 con 0x7f0218005180 2023-12-12T09:46:19.102 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:19.099+0000 7f022effd640 1 -- 172.21.15.73:0/96987493 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0228003990 con 0x7f0218005180 2023-12-12T09:46:19.102 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:19.099+0000 7f0236a3d640 1 -- 172.21.15.73:0/96987493 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0218005180 msgr2=0x7f021800b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:19.102 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:19.099+0000 7f0236a3d640 1 --2- 172.21.15.73:0/96987493 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0218005180 0x7f021800b980 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7f0228009fc0 tx=0x7f02180057f0 comp rx=0 tx=0).stop 2023-12-12T09:46:19.102 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:19.100+0000 7f0236a3d640 1 -- 172.21.15.73:0/96987493 shutdown_connections 2023-12-12T09:46:19.102 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:19.100+0000 7f0236a3d640 1 --2- 172.21.15.73:0/96987493 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0218005180 0x7f021800b980 unknown :-1 s=CLOSED pgs=836 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:19.102 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:19.100+0000 7f0236a3d640 1 -- 172.21.15.73:0/96987493 >> 172.21.15.73:0/96987493 conn(0x7f023006a4e0 msgr2=0x7f023006a8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:46:19.102 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:19.100+0000 7f0236a3d640 1 -- 172.21.15.73:0/96987493 shutdown_connections 2023-12-12T09:46:19.102 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:19.100+0000 7f0236a3d640 1 -- 172.21.15.73:0/96987493 wait complete. 2023-12-12T09:46:19.104 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:19.101+0000 7f0236a3d640 1 Processor -- start 2023-12-12T09:46:19.105 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:19.101+0000 7f0236a3d640 1 -- start start 2023-12-12T09:46:19.105 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:19.102+0000 7f0236a3d640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0218005180 0x7f02301ea1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:19.105 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:19.102+0000 7f0236a3d640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f02300a6f00 0x7f02301470d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:19.105 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:19.102+0000 7f0236a3d640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f02301e12e0 0x7f0230151170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:19.105 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:19.102+0000 7f0236a3d640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02300a9c90 con 0x7f02300a6f00 2023-12-12T09:46:19.105 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:19.102+0000 7f0236a3d640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02300a9260 con 0x7f0218005180 2023-12-12T09:46:19.105 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:19.102+0000 7f0236a3d640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02300a8950 con 0x7f02301e12e0 2023-12-12T09:46:19.105 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:19.103+0000 7f022f7fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f02300a6f00 0x7f02301470d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:19.105 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:19.103+0000 7f022f7fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f02300a6f00 0x7f02301470d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:54758/0 (socket says 172.21.15.73:54758) 2023-12-12T09:46:19.106 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:19.103+0000 7f022f7fe640 1 -- 172.21.15.73:0/2976289689 learned_addr learned my addr 172.21.15.73:0/2976289689 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:46:19.106 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:19.103+0000 7f0234fda640 1 --2- 172.21.15.73:0/2976289689 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f02301e12e0 0x7f0230151170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:19.106 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:19.103+0000 7f022ffff640 1 --2- 172.21.15.73:0/2976289689 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0218005180 0x7f02301ea1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:19.106 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:19.103+0000 7f022f7fe640 1 -- 172.21.15.73:0/2976289689 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f02301e12e0 msgr2=0x7f0230151170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:19.106 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:19.103+0000 7f022f7fe640 1 --2- 172.21.15.73:0/2976289689 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f02301e12e0 0x7f0230151170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:19.106 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:19.103+0000 7f022f7fe640 1 -- 172.21.15.73:0/2976289689 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0218005180 msgr2=0x7f02301ea1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:19.106 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:19.103+0000 7f022f7fe640 1 --2- 172.21.15.73:0/2976289689 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0218005180 0x7f02301ea1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:19.106 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:19.103+0000 7f022f7fe640 1 -- 172.21.15.73:0/2976289689 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0230147610 con 0x7f02300a6f00 2023-12-12T09:46:19.107 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:19.104+0000 7f022f7fe640 1 --2- 172.21.15.73:0/2976289689 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f02300a6f00 0x7f02301470d0 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7f022400d570 tx=0x7f022400da30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:46:19.107 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:19.104+0000 7f022cff9640 1 -- 172.21.15.73:0/2976289689 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0224003610 con 0x7f02300a6f00 2023-12-12T09:46:19.107 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:19.104+0000 7f022cff9640 1 -- 172.21.15.73:0/2976289689 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0224003770 con 0x7f02300a6f00 2023-12-12T09:46:19.107 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:19.104+0000 7f022cff9640 1 -- 172.21.15.73:0/2976289689 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0224003ae0 con 0x7f02300a6f00 2023-12-12T09:46:19.107 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:19.104+0000 7f0236a3d640 1 -- 172.21.15.73:0/2976289689 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02300a6830 con 0x7f02300a6f00 2023-12-12T09:46:19.107 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:19.104+0000 7f0236a3d640 1 -- 172.21.15.73:0/2976289689 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02300a8ba0 con 0x7f02300a6f00 2023-12-12T09:46:19.108 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:19.105+0000 7f0236a3d640 1 -- 172.21.15.73:0/2976289689 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0230067070 con 0x7f02300a6f00 2023-12-12T09:46:19.108 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:19.106+0000 7f022cff9640 1 -- 172.21.15.73:0/2976289689 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f0224003c40 con 0x7f02300a6f00 2023-12-12T09:46:19.108 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:19.107+0000 7f022cff9640 1 --2- 172.21.15.73:0/2976289689 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f021c06ae40 0x7f021c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:19.108 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:19.107+0000 7f022cff9640 1 -- 172.21.15.73:0/2976289689 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f02240892b0 con 0x7f02300a6f00 2023-12-12T09:46:19.108 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:19.107+0000 7f022ffff640 1 --2- 172.21.15.73:0/2976289689 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f021c06ae40 0x7f021c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:19.109 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:19.108+0000 7f022ffff640 1 --2- 172.21.15.73:0/2976289689 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f021c06ae40 0x7f021c06d300 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f02200018e0 tx=0x7f0220009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:46:19.112 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:19.111+0000 7f022cff9640 1 -- 172.21.15.73:0/2976289689 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f02240546b0 con 0x7f02300a6f00 2023-12-12T09:46:19.289 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:19.289+0000 7f0236a3d640 1 -- 172.21.15.73:0/2976289689 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f02300c4b80 con 0x7f02300a6f00 2023-12-12T09:46:19.294 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:19.293+0000 7f022cff9640 1 -- 172.21.15.73:0/2976289689 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v14)=0 v14) v1 ==== 122+0+0 (secure 0 0 0) 0x7f0224057cd0 con 0x7f02300a6f00 2023-12-12T09:46:19.297 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:19.296+0000 7f0236a3d640 1 -- 172.21.15.73:0/2976289689 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f021c06ae40 msgr2=0x7f021c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:19.298 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:19.296+0000 7f0236a3d640 1 --2- 172.21.15.73:0/2976289689 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f021c06ae40 0x7f021c06d300 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f02200018e0 tx=0x7f0220009040 comp rx=0 tx=0).stop 2023-12-12T09:46:19.298 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:19.296+0000 7f0236a3d640 1 -- 172.21.15.73:0/2976289689 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f02300a6f00 msgr2=0x7f02301470d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:19.298 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:19.297+0000 7f0236a3d640 1 --2- 172.21.15.73:0/2976289689 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f02300a6f00 0x7f02301470d0 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7f022400d570 tx=0x7f022400da30 comp rx=0 tx=0).stop 2023-12-12T09:46:19.298 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:19.297+0000 7f0236a3d640 1 -- 172.21.15.73:0/2976289689 shutdown_connections 2023-12-12T09:46:19.298 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:19.297+0000 7f0236a3d640 1 --2- 172.21.15.73:0/2976289689 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f021c06ae40 0x7f021c06d300 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:19.298 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:19.297+0000 7f0236a3d640 1 --2- 172.21.15.73:0/2976289689 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f02301e12e0 0x7f0230151170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:19.298 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:19.297+0000 7f0236a3d640 1 --2- 172.21.15.73:0/2976289689 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f02300a6f00 0x7f02301470d0 unknown :-1 s=CLOSED pgs=837 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:19.298 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:19.297+0000 7f0236a3d640 1 --2- 172.21.15.73:0/2976289689 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0218005180 0x7f02301ea1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:19.298 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:19.297+0000 7f0236a3d640 1 -- 172.21.15.73:0/2976289689 >> 172.21.15.73:0/2976289689 conn(0x7f023006a4e0 msgr2=0x7f02300bf680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:46:19.298 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:19.297+0000 7f0236a3d640 1 -- 172.21.15.73:0/2976289689 shutdown_connections 2023-12-12T09:46:19.298 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:19.297+0000 7f0236a3d640 1 -- 172.21.15.73:0/2976289689 wait complete. 2023-12-12T09:46:19.316 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-12-12T09:46:19.316 DEBUG:teuthology.orchestra.run.smithi073:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-12T09:46:19.469 DEBUG:teuthology.orchestra.run.smithi142:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-12T09:46:19.595 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-12-12T09:46:19.595 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2023-12-12T09:46:19.595 DEBUG:teuthology.orchestra.run.smithi073:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-12T09:46:19.649 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054284,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498800k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249396k,nr_inodes=812349,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498800k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 2023-12-12T09:46:19.650 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2023-12-12T09:46:19.650 DEBUG:teuthology.orchestra.run.smithi142:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-12T09:46:19.711 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054289,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498808k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249400k,nr_inodes=812350,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498808k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 2023-12-12T09:46:19.711 INFO:tasks.cephfs.cephfs_test_case:[, ] 2023-12-12T09:46:19.711 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-12T09:46:19.935 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:19.934+0000 7f3e294ea640 1 Processor -- start 2023-12-12T09:46:19.935 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:19.935+0000 7f3e294ea640 1 -- start start 2023-12-12T09:46:19.938 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:19.936+0000 7f3e294ea640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3e240bef50 0x7f3e24158270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:19.938 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:19.936+0000 7f3e294ea640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f3e240c5160 0x7f3e24151680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:19.938 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:19.936+0000 7f3e294ea640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f3e24151bc0 0x7f3e240c37b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:19.938 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:19.936+0000 7f3e294ea640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e24152050 con 0x7f3e24151bc0 2023-12-12T09:46:19.938 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:19.936+0000 7f3e294ea640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e2406d8d0 con 0x7f3e240c5160 2023-12-12T09:46:19.938 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:19.936+0000 7f3e294ea640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e240c4d70 con 0x7f3e240bef50 2023-12-12T09:46:19.938 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:19.936+0000 7f3e28ce9640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f3e24151bc0 0x7f3e240c37b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:19.938 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:19.937+0000 7f3e28ce9640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f3e24151bc0 0x7f3e240c37b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:54774/0 (socket says 172.21.15.73:54774) 2023-12-12T09:46:19.938 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:19.937+0000 7f3e28ce9640 1 -- 172.21.15.73:0/1387840363 learned_addr learned my addr 172.21.15.73:0/1387840363 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:46:19.938 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:19.937+0000 7f3e23fff640 1 --2- 172.21.15.73:0/1387840363 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3e240bef50 0x7f3e24158270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:19.938 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:19.937+0000 7f3e237fe640 1 --2- 172.21.15.73:0/1387840363 >> v2:172.21.15.142:3300/0 conn(0x7f3e240c5160 0x7f3e24151680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:19.939 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:19.937+0000 7f3e28ce9640 1 -- 172.21.15.73:0/1387840363 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3e240bef50 msgr2=0x7f3e24158270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:46:19.939 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:19.937+0000 7f3e28ce9640 1 --2- 172.21.15.73:0/1387840363 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3e240bef50 0x7f3e24158270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:19.939 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:19.937+0000 7f3e28ce9640 1 -- 172.21.15.73:0/1387840363 >> v2:172.21.15.142:3300/0 conn(0x7f3e240c5160 msgr2=0x7f3e24151680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:46:19.939 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:19.937+0000 7f3e28ce9640 1 --2- 172.21.15.73:0/1387840363 >> v2:172.21.15.142:3300/0 conn(0x7f3e240c5160 0x7f3e24151680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:19.939 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:19.937+0000 7f3e28ce9640 1 -- 172.21.15.73:0/1387840363 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e241587b0 con 0x7f3e24151bc0 2023-12-12T09:46:19.939 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:19.937+0000 7f3e237fe640 1 --2- 172.21.15.73:0/1387840363 >> v2:172.21.15.142:3300/0 conn(0x7f3e240c5160 0x7f3e24151680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:46:19.939 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:19.937+0000 7f3e23fff640 1 --2- 172.21.15.73:0/1387840363 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3e240bef50 0x7f3e24158270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:46:19.941 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:19.938+0000 7f3e28ce9640 1 --2- 172.21.15.73:0/1387840363 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3e24151bc0 0x7f3e240c37b0 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7f3e240c5810 tx=0x7f3e1c02b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9d3001cb010b1c7 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:46:19.941 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:19.938+0000 7f3e22ffd640 1 -- 172.21.15.73:0/1387840363 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e1c0317e0 con 0x7f3e24151bc0 2023-12-12T09:46:19.941 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:19.938+0000 7f3e22ffd640 1 -- 172.21.15.73:0/1387840363 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e1c031940 con 0x7f3e24151bc0 2023-12-12T09:46:19.941 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:19.938+0000 7f3e22ffd640 1 -- 172.21.15.73:0/1387840363 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e1c031cd0 con 0x7f3e24151bc0 2023-12-12T09:46:19.941 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:19.939+0000 7f3e294ea640 1 -- 172.21.15.73:0/1387840363 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3e24151bc0 msgr2=0x7f3e240c37b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:19.941 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:19.939+0000 7f3e294ea640 1 --2- 172.21.15.73:0/1387840363 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3e24151bc0 0x7f3e240c37b0 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7f3e240c5810 tx=0x7f3e1c02b880 comp rx=0 tx=0).stop 2023-12-12T09:46:19.941 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:19.939+0000 7f3e294ea640 1 -- 172.21.15.73:0/1387840363 shutdown_connections 2023-12-12T09:46:19.942 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:19.939+0000 7f3e294ea640 1 --2- 172.21.15.73:0/1387840363 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3e24151bc0 0x7f3e240c37b0 unknown :-1 s=CLOSED pgs=838 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:19.942 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:19.939+0000 7f3e294ea640 1 --2- 172.21.15.73:0/1387840363 >> v2:172.21.15.142:3300/0 conn(0x7f3e240c5160 0x7f3e24151680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:19.942 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:19.939+0000 7f3e294ea640 1 --2- 172.21.15.73:0/1387840363 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3e240bef50 0x7f3e24158270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:19.942 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:19.939+0000 7f3e294ea640 1 -- 172.21.15.73:0/1387840363 >> 172.21.15.73:0/1387840363 conn(0x7f3e240c23b0 msgr2=0x7f3e240c2790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:46:19.942 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:19.939+0000 7f3e294ea640 1 -- 172.21.15.73:0/1387840363 shutdown_connections 2023-12-12T09:46:19.942 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:19.939+0000 7f3e294ea640 1 -- 172.21.15.73:0/1387840363 wait complete. 2023-12-12T09:46:19.944 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:19.941+0000 7f3e294ea640 1 Processor -- start 2023-12-12T09:46:19.944 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:19.941+0000 7f3e294ea640 1 -- start start 2023-12-12T09:46:19.944 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:19.942+0000 7f3e294ea640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3e240bef50 0x7f3e240a6950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:19.945 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:19.942+0000 7f3e294ea640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3e240c5160 0x7f3e2414acb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:19.945 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:19.942+0000 7f3e294ea640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3e24151bc0 0x7f3e2414b1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:19.945 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:19.942+0000 7f3e294ea640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e240a99d0 con 0x7f3e240c5160 2023-12-12T09:46:19.945 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:19.942+0000 7f3e294ea640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e240a9410 con 0x7f3e24151bc0 2023-12-12T09:46:19.945 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:19.942+0000 7f3e294ea640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e240a96f0 con 0x7f3e240bef50 2023-12-12T09:46:19.945 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:19.942+0000 7f3e237fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3e240c5160 0x7f3e2414acb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:19.945 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:19.942+0000 7f3e237fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3e240c5160 0x7f3e2414acb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:54790/0 (socket says 172.21.15.73:54790) 2023-12-12T09:46:19.945 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:19.942+0000 7f3e237fe640 1 -- 172.21.15.73:0/228180751 learned_addr learned my addr 172.21.15.73:0/228180751 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:46:19.945 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:19.942+0000 7f3e23fff640 1 --2- 172.21.15.73:0/228180751 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3e240bef50 0x7f3e240a6950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:19.945 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:19.943+0000 7f3e28ce9640 1 --2- 172.21.15.73:0/228180751 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3e24151bc0 0x7f3e2414b1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:19.945 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:19.943+0000 7f3e237fe640 1 -- 172.21.15.73:0/228180751 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3e240bef50 msgr2=0x7f3e240a6950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:19.945 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:19.943+0000 7f3e237fe640 1 --2- 172.21.15.73:0/228180751 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3e240bef50 0x7f3e240a6950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:19.945 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:19.943+0000 7f3e237fe640 1 -- 172.21.15.73:0/228180751 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3e24151bc0 msgr2=0x7f3e2414b1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:19.946 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:19.943+0000 7f3e237fe640 1 --2- 172.21.15.73:0/228180751 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3e24151bc0 0x7f3e2414b1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:19.946 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:19.943+0000 7f3e237fe640 1 -- 172.21.15.73:0/228180751 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e1c0094d0 con 0x7f3e240c5160 2023-12-12T09:46:19.946 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:19.943+0000 7f3e28ce9640 1 --2- 172.21.15.73:0/228180751 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3e24151bc0 0x7f3e2414b1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:46:19.946 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:19.943+0000 7f3e237fe640 1 --2- 172.21.15.73:0/228180751 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3e240c5160 0x7f3e2414acb0 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7f3e1400cf60 tx=0x7f3e1400cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:46:19.946 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:19.943+0000 7f3e20ff9640 1 -- 172.21.15.73:0/228180751 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e1400d840 con 0x7f3e240c5160 2023-12-12T09:46:19.946 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:19.943+0000 7f3e20ff9640 1 -- 172.21.15.73:0/228180751 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e1400d9a0 con 0x7f3e240c5160 2023-12-12T09:46:19.946 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:19.943+0000 7f3e20ff9640 1 -- 172.21.15.73:0/228180751 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e1400dd30 con 0x7f3e240c5160 2023-12-12T09:46:19.946 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:19.943+0000 7f3e294ea640 1 -- 172.21.15.73:0/228180751 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e24070e20 con 0x7f3e240c5160 2023-12-12T09:46:19.946 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:19.943+0000 7f3e294ea640 1 -- 172.21.15.73:0/228180751 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e240a6e90 con 0x7f3e240c5160 2023-12-12T09:46:19.947 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:19.945+0000 7f3e294ea640 1 -- 172.21.15.73:0/228180751 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e24070c80 con 0x7f3e240c5160 2023-12-12T09:46:19.947 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:19.945+0000 7f3e20ff9640 1 -- 172.21.15.73:0/228180751 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f3e14015440 con 0x7f3e240c5160 2023-12-12T09:46:19.947 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:19.946+0000 7f3e20ff9640 1 --2- 172.21.15.73:0/228180751 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f3e0406ae40 0x7f3e0406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:19.947 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:19.947+0000 7f3e20ff9640 1 -- 172.21.15.73:0/228180751 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f3e14089d00 con 0x7f3e240c5160 2023-12-12T09:46:19.947 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:19.947+0000 7f3e23fff640 1 --2- 172.21.15.73:0/228180751 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f3e0406ae40 0x7f3e0406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:19.948 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:19.948+0000 7f3e23fff640 1 --2- 172.21.15.73:0/228180751 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f3e0406ae40 0x7f3e0406d300 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f3e240c2910 tx=0x7f3e0c008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:46:19.952 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:19.951+0000 7f3e20ff9640 1 -- 172.21.15.73:0/228180751 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f3e24070c80 con 0x7f3e240c5160 2023-12-12T09:46:20.180 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:20.180+0000 7f3e294ea640 1 -- 172.21.15.73:0/228180751 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3e24071340 con 0x7f3e240c5160 2023-12-12T09:46:20.182 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:20.181+0000 7f3e20ff9640 1 -- 172.21.15.73:0/228180751 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 39 v39) v1 ==== 94+0+3702 (secure 0 0 0) 0x7f3e24071340 con 0x7f3e240c5160 2023-12-12T09:46:20.182 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-12T09:46:20.182 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":39,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4736,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6834/2964437845","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6832","nonce":2964437845},{"type":"v1","addr":"172.21.15.142:6834","nonce":2964437845}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":25},{"gid":5044,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6837/3698725764","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6836","nonce":3698725764},{"type":"v1","addr":"172.21.15.73:6837","nonce":3698725764}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":25},{"gid":5314,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6835/1615925620","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6833","nonce":1615925620},{"type":"v1","addr":"172.21.15.142:6835","nonce":1615925620}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":39},{"gid":6255,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6835/706333502","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":706333502},{"type":"v1","addr":"172.21.15.73:6835","nonce":706333502}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":37}],"filesystems":[]} 2023-12-12T09:46:20.183 INFO:teuthology.orchestra.run.smithi073.stderr:dumped fsmap epoch 39 2023-12-12T09:46:20.185 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:20.184+0000 7f3e294ea640 1 -- 172.21.15.73:0/228180751 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f3e0406ae40 msgr2=0x7f3e0406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:20.186 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:20.184+0000 7f3e294ea640 1 --2- 172.21.15.73:0/228180751 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f3e0406ae40 0x7f3e0406d300 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f3e240c2910 tx=0x7f3e0c008040 comp rx=0 tx=0).stop 2023-12-12T09:46:20.186 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:20.184+0000 7f3e294ea640 1 -- 172.21.15.73:0/228180751 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3e240c5160 msgr2=0x7f3e2414acb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:20.186 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:20.184+0000 7f3e294ea640 1 --2- 172.21.15.73:0/228180751 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3e240c5160 0x7f3e2414acb0 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7f3e1400cf60 tx=0x7f3e1400cf90 comp rx=0 tx=0).stop 2023-12-12T09:46:20.186 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:20.184+0000 7f3e294ea640 1 -- 172.21.15.73:0/228180751 shutdown_connections 2023-12-12T09:46:20.186 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:20.184+0000 7f3e294ea640 1 --2- 172.21.15.73:0/228180751 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f3e0406ae40 0x7f3e0406d300 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:20.186 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:20.184+0000 7f3e294ea640 1 --2- 172.21.15.73:0/228180751 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3e24151bc0 0x7f3e2414b1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:20.187 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:20.184+0000 7f3e294ea640 1 --2- 172.21.15.73:0/228180751 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3e240c5160 0x7f3e2414acb0 unknown :-1 s=CLOSED pgs=839 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:20.187 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:20.184+0000 7f3e294ea640 1 --2- 172.21.15.73:0/228180751 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3e240bef50 0x7f3e240a6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:20.187 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:20.184+0000 7f3e294ea640 1 -- 172.21.15.73:0/228180751 >> 172.21.15.73:0/228180751 conn(0x7f3e240c23b0 msgr2=0x7f3e2414d100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:46:20.187 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:20.184+0000 7f3e294ea640 1 -- 172.21.15.73:0/228180751 shutdown_connections 2023-12-12T09:46:20.187 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:20.184+0000 7f3e294ea640 1 -- 172.21.15.73:0/228180751 wait complete. 2023-12-12T09:46:20.203 INFO:tasks.ceph.mds.a:Restarting daemon 2023-12-12T09:46:20.204 INFO:tasks.ceph.mds.a:Stopping old one... 2023-12-12T09:46:20.204 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-12-12T09:46:20.204 INFO:teuthology.orchestra.run:waiting for 300 2023-12-12T09:46:20.204 INFO:tasks.ceph.mds.c:Restarting daemon 2023-12-12T09:46:20.204 INFO:tasks.ceph.mds.c:Stopping old one... 2023-12-12T09:46:20.204 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-12-12T09:46:20.204 INFO:teuthology.orchestra.run:waiting for 300 2023-12-12T09:46:20.205 INFO:tasks.ceph.mds.b:Restarting daemon 2023-12-12T09:46:20.205 INFO:tasks.ceph.mds.b:Stopping old one... 2023-12-12T09:46:20.205 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-12-12T09:46:20.205 INFO:teuthology.orchestra.run:waiting for 300 2023-12-12T09:46:20.205 INFO:tasks.ceph.mds.d:Restarting daemon 2023-12-12T09:46:20.205 INFO:tasks.ceph.mds.d:Stopping old one... 2023-12-12T09:46:20.205 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-12-12T09:46:20.205 INFO:teuthology.orchestra.run:waiting for 300 2023-12-12T09:46:20.223 INFO:tasks.ceph.mds.a:Stopped 2023-12-12T09:46:20.223 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-12-12T09:46:20.224 INFO:tasks.ceph.mds.c:Stopped 2023-12-12T09:46:20.225 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-12-12T09:46:20.229 INFO:tasks.ceph.mds.b:Stopped 2023-12-12T09:46:20.229 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-12-12T09:46:20.234 INFO:tasks.ceph.mds.d:Stopped 2023-12-12T09:46:20.234 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-12-12T09:46:20.274 INFO:tasks.ceph.mds.a:Started 2023-12-12T09:46:20.274 DEBUG:teuthology.parallel:result is None 2023-12-12T09:46:20.281 INFO:tasks.ceph.mds.c:Started 2023-12-12T09:46:20.281 DEBUG:teuthology.parallel:result is None 2023-12-12T09:46:20.282 INFO:tasks.ceph.mds.b:Started 2023-12-12T09:46:20.282 DEBUG:teuthology.parallel:result is None 2023-12-12T09:46:20.289 INFO:tasks.ceph.mds.d:Started 2023-12-12T09:46:20.290 DEBUG:teuthology.parallel:result is None 2023-12-12T09:46:20.290 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-12-12T09:46:20.433 INFO:tasks.ceph.mds.a.smithi073.stdout:starting mds.a at 2023-12-12T09:46:20.434 INFO:tasks.ceph.mds.c.smithi073.stdout:starting mds.c at 2023-12-12T09:46:20.445 INFO:tasks.ceph.mds.b.smithi142.stdout:starting mds.b at 2023-12-12T09:46:20.446 INFO:tasks.ceph.mds.d.smithi142.stdout:starting mds.d at 2023-12-12T09:46:20.476 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:20.475+0000 7f7400c56640 1 Processor -- start 2023-12-12T09:46:20.476 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:20.476+0000 7f7400c56640 1 -- start start 2023-12-12T09:46:20.478 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:20.477+0000 7f7400c56640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f73fc0c0420 0x7f73fc0c17e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:20.479 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:20.477+0000 7f7400c56640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f73fc072700 0x7f73fc070080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:20.479 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:20.477+0000 7f7400c56640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73fc152560 con 0x7f73fc06fca0 2023-12-12T09:46:20.479 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:20.477+0000 7f7400c56640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73fc152ec0 con 0x7f73fc072700 2023-12-12T09:46:20.479 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:20.477+0000 7f7400c56640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73fc0c53d0 con 0x7f73fc0c0420 2023-12-12T09:46:20.479 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:20.477+0000 7f73fa59c640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f73fc06fca0 0x7f73fc0c10d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:53758/0 (socket says 172.21.15.73:53758) 2023-12-12T09:46:20.479 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:20.477+0000 7f73fa59c640 1 -- 172.21.15.73:0/601148068 learned_addr learned my addr 172.21.15.73:0/601148068 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-12T09:46:20.479 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:20.477+0000 7f73f1d9b640 1 --2- 172.21.15.73:0/601148068 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f73fc0c0420 0x7f73fc0c17e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:20.479 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:20.477+0000 7f73fad9d640 1 --2- 172.21.15.73:0/601148068 >> v2:172.21.15.142:3300/0 conn(0x7f73fc072700 0x7f73fc070080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:20.479 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:20.478+0000 7f73f9d9b640 1 -- 172.21.15.73:0/601148068 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 56671835 0 0) 0x7f73fc152560 con 0x7f73fc06fca0 2023-12-12T09:46:20.479 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:20.478+0000 7f73f9d9b640 1 -- 172.21.15.73:0/601148068 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f73e8003520 con 0x7f73fc06fca0 2023-12-12T09:46:20.479 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:20.478+0000 7f73fad9d640 1 -- 172.21.15.73:0/601148068 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f73fc0c0420 msgr2=0x7f73fc0c17e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:46:20.479 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:20.478+0000 7f73fad9d640 1 --2- 172.21.15.73:0/601148068 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f73fc0c0420 0x7f73fc0c17e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:20.479 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:20.478+0000 7f73fad9d640 1 -- 172.21.15.73:0/601148068 >> v1:172.21.15.73:6789/0 conn(0x7f73fc06fca0 legacy=0x7f73fc0c10d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:20.480 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:20.478+0000 7f73fad9d640 1 -- 172.21.15.73:0/601148068 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73fc1532e0 con 0x7f73fc072700 2023-12-12T09:46:20.480 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:20.478+0000 7f73f1d9b640 1 --2- 172.21.15.73:0/601148068 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f73fc0c0420 0x7f73fc0c17e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-12T09:46:20.481 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:20.479+0000 7f73fad9d640 1 --2- 172.21.15.73:0/601148068 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f73fc072700 0x7f73fc070080 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f73f4009d90 tx=0x7f73f402be10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5e29e192a68c5ea server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:46:20.481 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:20.480+0000 7f73f9d9b640 1 -- 172.21.15.73:0/601148068 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73f402cbc0 con 0x7f73fc072700 2023-12-12T09:46:20.481 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:20.480+0000 7f73f9d9b640 1 -- 172.21.15.73:0/601148068 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73f402cd20 con 0x7f73fc072700 2023-12-12T09:46:20.481 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:20.480+0000 7f73f9d9b640 1 -- 172.21.15.73:0/601148068 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73f4034640 con 0x7f73fc072700 2023-12-12T09:46:20.482 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:20.480+0000 7f7400c56640 1 -- 172.21.15.73:0/601148068 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f73fc072700 msgr2=0x7f73fc070080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:20.482 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:20.480+0000 7f7400c56640 1 --2- 172.21.15.73:0/601148068 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f73fc072700 0x7f73fc070080 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f73f4009d90 tx=0x7f73f402be10 comp rx=0 tx=0).stop 2023-12-12T09:46:20.482 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:20.480+0000 7f7400c56640 1 -- 172.21.15.73:0/601148068 shutdown_connections 2023-12-12T09:46:20.482 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:20.480+0000 7f7400c56640 1 --2- 172.21.15.73:0/601148068 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f73fc072700 0x7f73fc070080 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:20.482 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:20.480+0000 7f7400c56640 1 --2- 172.21.15.73:0/601148068 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f73fc0c0420 0x7f73fc0c17e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:20.482 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:20.480+0000 7f7400c56640 1 -- 172.21.15.73:0/601148068 >> 172.21.15.73:0/601148068 conn(0x7f73fc0a77d0 msgr2=0x7f73fc0a7bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:46:20.482 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:20.480+0000 7f7400c56640 1 -- 172.21.15.73:0/601148068 shutdown_connections 2023-12-12T09:46:20.482 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:20.480+0000 7f7400c56640 1 -- 172.21.15.73:0/601148068 wait complete. 2023-12-12T09:46:20.483 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:20.482+0000 7f7400c56640 1 Processor -- start 2023-12-12T09:46:20.483 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:20.482+0000 7f7400c56640 1 -- start start 2023-12-12T09:46:20.484 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:20.483+0000 7f7400c56640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f73fc06fca0 0x7f73fc0aa7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:20.484 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:20.483+0000 7f7400c56640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f73fc072700 0x7f73fc148d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:20.484 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:20.483+0000 7f7400c56640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f73fc0c0420 0x7f73fc1492d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:20.484 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:20.483+0000 7f7400c56640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73fc0aa140 con 0x7f73fc072700 2023-12-12T09:46:20.484 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:20.483+0000 7f7400c56640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73fc0a88c0 con 0x7f73fc06fca0 2023-12-12T09:46:20.484 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:20.483+0000 7f7400c56640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73fc0a9030 con 0x7f73fc0c0420 2023-12-12T09:46:20.485 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:20.483+0000 7f73f1d9b640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f73fc072700 0x7f73fc148d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:20.485 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:20.483+0000 7f73f1d9b640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f73fc072700 0x7f73fc148d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:54836/0 (socket says 172.21.15.73:54836) 2023-12-12T09:46:20.485 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:20.483+0000 7f73f1d9b640 1 -- 172.21.15.73:0/111687456 learned_addr learned my addr 172.21.15.73:0/111687456 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:46:20.485 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:20.483+0000 7f73fa59c640 1 --2- 172.21.15.73:0/111687456 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f73fc06fca0 0x7f73fc0aa7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:20.485 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:20.483+0000 7f73fad9d640 1 --2- 172.21.15.73:0/111687456 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f73fc0c0420 0x7f73fc1492d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:20.485 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:20.484+0000 7f73f1d9b640 1 -- 172.21.15.73:0/111687456 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f73fc0c0420 msgr2=0x7f73fc1492d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:20.485 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:20.484+0000 7f73f1d9b640 1 --2- 172.21.15.73:0/111687456 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f73fc0c0420 0x7f73fc1492d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:20.485 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:20.484+0000 7f73f1d9b640 1 -- 172.21.15.73:0/111687456 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f73fc06fca0 msgr2=0x7f73fc0aa7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:20.485 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:20.484+0000 7f73f1d9b640 1 --2- 172.21.15.73:0/111687456 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f73fc06fca0 0x7f73fc0aa7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:20.485 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:20.484+0000 7f73f1d9b640 1 -- 172.21.15.73:0/111687456 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73ec009400 con 0x7f73fc072700 2023-12-12T09:46:20.485 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:20.484+0000 7f73f1d9b640 1 --2- 172.21.15.73:0/111687456 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f73fc072700 0x7f73fc148d90 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7f73ec00ebb0 tx=0x7f73ec00c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:46:20.486 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:20.484+0000 7f73f37fe640 1 -- 172.21.15.73:0/111687456 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73ec00eeb0 con 0x7f73fc072700 2023-12-12T09:46:20.486 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:20.484+0000 7f73f37fe640 1 -- 172.21.15.73:0/111687456 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73ec00cc30 con 0x7f73fc072700 2023-12-12T09:46:20.486 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:20.484+0000 7f7400c56640 1 -- 172.21.15.73:0/111687456 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73f4009a70 con 0x7f73fc072700 2023-12-12T09:46:20.486 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:20.484+0000 7f73f37fe640 1 -- 172.21.15.73:0/111687456 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73ec013470 con 0x7f73fc072700 2023-12-12T09:46:20.486 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:20.485+0000 7f7400c56640 1 -- 172.21.15.73:0/111687456 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73fc1e8a60 con 0x7f73fc072700 2023-12-12T09:46:20.486 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:20.486+0000 7f7400c56640 1 -- 172.21.15.73:0/111687456 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f73fc067580 con 0x7f73fc072700 2023-12-12T09:46:20.487 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:20.487+0000 7f73f37fe640 1 -- 172.21.15.73:0/111687456 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f73ec0135d0 con 0x7f73fc072700 2023-12-12T09:46:20.488 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:20.488+0000 7f73f37fe640 1 --2- 172.21.15.73:0/111687456 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f73dc06ae70 0x7f73dc06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:20.488 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:20.488+0000 7f73f37fe640 1 -- 172.21.15.73:0/111687456 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f73ec0894d0 con 0x7f73fc072700 2023-12-12T09:46:20.488 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:20.488+0000 7f73fa59c640 1 --2- 172.21.15.73:0/111687456 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f73dc06ae70 0x7f73dc06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:20.489 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:20.489+0000 7f73fa59c640 1 --2- 172.21.15.73:0/111687456 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f73dc06ae70 0x7f73dc06d330 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f73e4005880 tx=0x7f73e4009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:46:20.492 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:20.492+0000 7f73f37fe640 1 -- 172.21.15.73:0/111687456 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f73ec054960 con 0x7f73fc072700 2023-12-12T09:46:20.691 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:20.690+0000 7f7400c56640 1 -- 172.21.15.73:0/111687456 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f73fc0c5520 con 0x7f73fc072700 2023-12-12T09:46:21.910 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:21.909+0000 7f73f37fe640 1 -- 172.21.15.73:0/111687456 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v71) v1 ==== 97+0+0 (secure 0 0 0) 0x7f73ec004640 con 0x7f73fc072700 2023-12-12T09:46:21.911 INFO:teuthology.orchestra.run.smithi073.stderr: removed all blocklist entries 2023-12-12T09:46:21.915 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:21.914+0000 7f7400c56640 1 -- 172.21.15.73:0/111687456 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f73dc06ae70 msgr2=0x7f73dc06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:21.915 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:21.914+0000 7f7400c56640 1 --2- 172.21.15.73:0/111687456 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f73dc06ae70 0x7f73dc06d330 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f73e4005880 tx=0x7f73e4009040 comp rx=0 tx=0).stop 2023-12-12T09:46:21.915 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:21.914+0000 7f7400c56640 1 -- 172.21.15.73:0/111687456 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f73fc072700 msgr2=0x7f73fc148d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:21.915 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:21.914+0000 7f7400c56640 1 --2- 172.21.15.73:0/111687456 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f73fc072700 0x7f73fc148d90 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7f73ec00ebb0 tx=0x7f73ec00c520 comp rx=0 tx=0).stop 2023-12-12T09:46:21.915 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:21.914+0000 7f7400c56640 1 -- 172.21.15.73:0/111687456 shutdown_connections 2023-12-12T09:46:21.915 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:21.914+0000 7f7400c56640 1 --2- 172.21.15.73:0/111687456 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f73dc06ae70 0x7f73dc06d330 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:21.915 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:21.914+0000 7f7400c56640 1 --2- 172.21.15.73:0/111687456 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f73fc0c0420 0x7f73fc1492d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:21.915 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:21.914+0000 7f7400c56640 1 --2- 172.21.15.73:0/111687456 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f73fc072700 0x7f73fc148d90 secure :-1 s=CLOSED pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7f73ec00ebb0 tx=0x7f73ec00c520 comp rx=0 tx=0).stop 2023-12-12T09:46:21.915 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:21.914+0000 7f7400c56640 1 --2- 172.21.15.73:0/111687456 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f73fc06fca0 0x7f73fc0aa7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:21.915 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:21.914+0000 7f7400c56640 1 -- 172.21.15.73:0/111687456 >> 172.21.15.73:0/111687456 conn(0x7f73fc0a77d0 msgr2=0x7f73fc0a6bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:46:21.915 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:21.914+0000 7f7400c56640 1 -- 172.21.15.73:0/111687456 shutdown_connections 2023-12-12T09:46:21.916 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:21.914+0000 7f7400c56640 1 -- 172.21.15.73:0/111687456 wait complete. 2023-12-12T09:46:21.934 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-12-12T09:46:22.129 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:22.128+0000 7efcfa375640 1 Processor -- start 2023-12-12T09:46:22.129 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:22.129+0000 7efcfa375640 1 -- start start 2023-12-12T09:46:22.130 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:22.130+0000 7efcfa375640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7efcf414fbb0 0x7efcf40c09e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:22.130 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:22.130+0000 7efcfa375640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7efcf40a9470 0x7efcf40ab510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:22.130 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:22.130+0000 7efcfa375640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efcf4153300 con 0x7efcf40c0f20 2023-12-12T09:46:22.130 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:22.130+0000 7efcfa375640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efcf40aa000 con 0x7efcf40a9470 2023-12-12T09:46:22.131 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:22.130+0000 7efcfa375640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efcf40c1d40 con 0x7efcf414fbb0 2023-12-12T09:46:22.131 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:22.130+0000 7efcf9b74640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7efcf40a9470 0x7efcf40ab510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:22.131 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:22.130+0000 7efcf9b74640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7efcf40a9470 0x7efcf40ab510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:54846/0 (socket says 172.21.15.73:54846) 2023-12-12T09:46:22.131 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:22.130+0000 7efcf9b74640 1 -- 172.21.15.73:0/492582320 learned_addr learned my addr 172.21.15.73:0/492582320 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:46:22.132 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:22.130+0000 7efcf9373640 1 --2- 172.21.15.73:0/492582320 >> v2:172.21.15.142:3300/0 conn(0x7efcf414fbb0 0x7efcf40c09e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:22.132 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:22.131+0000 7efcf9b74640 1 -- 172.21.15.73:0/492582320 >> v2:172.21.15.142:3300/0 conn(0x7efcf414fbb0 msgr2=0x7efcf40c09e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:46:22.132 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:22.131+0000 7efcf9b74640 1 --2- 172.21.15.73:0/492582320 >> v2:172.21.15.142:3300/0 conn(0x7efcf414fbb0 0x7efcf40c09e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:22.132 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:22.131+0000 7efcf9b74640 1 -- 172.21.15.73:0/492582320 >> v1:172.21.15.142:6789/0 conn(0x7efcf40c0f20 legacy=0x7efcf40aae00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:46:22.132 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:22.131+0000 7efcf9b74640 1 -- 172.21.15.73:0/492582320 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcf40c2160 con 0x7efcf40a9470 2023-12-12T09:46:22.133 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:22.132+0000 7efcf9b74640 1 --2- 172.21.15.73:0/492582320 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efcf40a9470 0x7efcf40ab510 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7efcf40a9330 tx=0x7efcec02be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf8cec2cfb9a1dae server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:46:22.134 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:22.132+0000 7efcebfff640 1 -- 172.21.15.73:0/492582320 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcec02c9f0 con 0x7efcf40a9470 2023-12-12T09:46:22.134 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:22.132+0000 7efcebfff640 1 -- 172.21.15.73:0/492582320 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efcec02cb50 con 0x7efcf40a9470 2023-12-12T09:46:22.134 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:22.132+0000 7efcebfff640 1 -- 172.21.15.73:0/492582320 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcec0343f0 con 0x7efcf40a9470 2023-12-12T09:46:22.134 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:22.133+0000 7efcfa375640 1 -- 172.21.15.73:0/492582320 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efcf40a9470 msgr2=0x7efcf40ab510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:22.134 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:22.133+0000 7efcfa375640 1 --2- 172.21.15.73:0/492582320 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efcf40a9470 0x7efcf40ab510 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7efcf40a9330 tx=0x7efcec02be50 comp rx=0 tx=0).stop 2023-12-12T09:46:22.134 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:22.133+0000 7efcfa375640 1 -- 172.21.15.73:0/492582320 shutdown_connections 2023-12-12T09:46:22.134 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:22.133+0000 7efcfa375640 1 --2- 172.21.15.73:0/492582320 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efcf40a9470 0x7efcf40ab510 unknown :-1 s=CLOSED pgs=846 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:22.134 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:22.133+0000 7efcfa375640 1 --2- 172.21.15.73:0/492582320 >> v2:172.21.15.142:3300/0 conn(0x7efcf414fbb0 0x7efcf40c09e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:22.134 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:22.133+0000 7efcfa375640 1 -- 172.21.15.73:0/492582320 >> 172.21.15.73:0/492582320 conn(0x7efcf40c23b0 msgr2=0x7efcf40c2790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:46:22.134 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:22.133+0000 7efcfa375640 1 -- 172.21.15.73:0/492582320 shutdown_connections 2023-12-12T09:46:22.134 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:22.133+0000 7efcfa375640 1 -- 172.21.15.73:0/492582320 wait complete. 2023-12-12T09:46:22.135 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:22.134+0000 7efcfa375640 1 Processor -- start 2023-12-12T09:46:22.135 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:22.135+0000 7efcfa375640 1 -- start start 2023-12-12T09:46:22.136 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:22.135+0000 7efcfa375640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efcf40a9470 0x7efcf406f9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:22.136 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:22.135+0000 7efcfa375640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efcf40c0f20 0x7efcf4155b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:22.136 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:22.135+0000 7efcfa375640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efcf414fbb0 0x7efcf40bb030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:22.136 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:22.135+0000 7efcfa375640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcf4072410 con 0x7efcf40a9470 2023-12-12T09:46:22.136 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:22.135+0000 7efcfa375640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcf41eb7c0 con 0x7efcf414fbb0 2023-12-12T09:46:22.136 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:22.135+0000 7efcfa375640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efcf41ebaa0 con 0x7efcf40c0f20 2023-12-12T09:46:22.136 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:22.136+0000 7efcf9373640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efcf40a9470 0x7efcf406f9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:22.137 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:22.136+0000 7efcf9373640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efcf40a9470 0x7efcf406f9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:54856/0 (socket says 172.21.15.73:54856) 2023-12-12T09:46:22.137 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:22.136+0000 7efcf9373640 1 -- 172.21.15.73:0/1789176756 learned_addr learned my addr 172.21.15.73:0/1789176756 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:46:22.138 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:22.136+0000 7efcf9373640 1 -- 172.21.15.73:0/1789176756 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efcf40c0f20 msgr2=0x7efcf4155b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:22.138 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:22.136+0000 7efcf9373640 1 --2- 172.21.15.73:0/1789176756 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efcf40c0f20 0x7efcf4155b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:22.138 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:22.136+0000 7efcf9373640 1 -- 172.21.15.73:0/1789176756 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efcf414fbb0 msgr2=0x7efcf40bb030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:22.138 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:22.136+0000 7efcf9373640 1 --2- 172.21.15.73:0/1789176756 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efcf414fbb0 0x7efcf40bb030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:22.138 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:22.136+0000 7efcf9373640 1 -- 172.21.15.73:0/1789176756 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcec009b30 con 0x7efcf40a9470 2023-12-12T09:46:22.138 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:22.136+0000 7efcf9373640 1 --2- 172.21.15.73:0/1789176756 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efcf40a9470 0x7efcf406f9a0 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7efcf000d5f0 tx=0x7efcf000dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:46:22.139 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:22.136+0000 7efce9ffb640 1 -- 172.21.15.73:0/1789176756 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcf00125f0 con 0x7efcf40a9470 2023-12-12T09:46:22.139 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:22.137+0000 7efce9ffb640 1 -- 172.21.15.73:0/1789176756 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efcf0012750 con 0x7efcf40a9470 2023-12-12T09:46:22.139 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:22.137+0000 7efce9ffb640 1 -- 172.21.15.73:0/1789176756 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcf0012b00 con 0x7efcf40a9470 2023-12-12T09:46:22.139 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:22.137+0000 7efcfa375640 1 -- 172.21.15.73:0/1789176756 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efcf4071670 con 0x7efcf40a9470 2023-12-12T09:46:22.139 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:22.137+0000 7efcfa375640 1 -- 172.21.15.73:0/1789176756 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efcf4156040 con 0x7efcf40a9470 2023-12-12T09:46:22.139 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:22.138+0000 7efcfa375640 1 -- 172.21.15.73:0/1789176756 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efcf4152090 con 0x7efcf40a9470 2023-12-12T09:46:22.140 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:22.139+0000 7efce9ffb640 1 -- 172.21.15.73:0/1789176756 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7efcf0012c60 con 0x7efcf40a9470 2023-12-12T09:46:22.141 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:22.140+0000 7efce9ffb640 1 --2- 172.21.15.73:0/1789176756 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7efcd806ae70 0x7efcd806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:22.141 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:22.140+0000 7efce9ffb640 1 -- 172.21.15.73:0/1789176756 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 4857+0+0 (secure 0 0 0) 0x7efcf0089760 con 0x7efcf40a9470 2023-12-12T09:46:22.141 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:22.140+0000 7efcf8b72640 1 --2- 172.21.15.73:0/1789176756 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7efcd806ae70 0x7efcd806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:22.141 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:22.141+0000 7efcf8b72640 1 --2- 172.21.15.73:0/1789176756 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7efcd806ae70 0x7efcd806d330 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7efcf40c1300 tx=0x7efce40079b0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:46:22.144 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:22.144+0000 7efce9ffb640 1 -- 172.21.15.73:0/1789176756 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7efcf0054b50 con 0x7efcf40a9470 2023-12-12T09:46:22.406 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:22.405+0000 7efcfa375640 1 -- 172.21.15.73:0/1789176756 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7efcf4067400 con 0x7efcf40a9470 2023-12-12T09:46:22.407 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:22.407+0000 7efce9ffb640 1 -- 172.21.15.73:0/1789176756 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v17) v1 ==== 80+0+5081 (secure 0 0 0) 0x7efcf0058170 con 0x7efcf40a9470 2023-12-12T09:46:22.407 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-12T09:46:22.407 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2023-12-12T09:46:22.407 INFO:teuthology.orchestra.run.smithi073.stdout: "auth_dump": [ 2023-12-12T09:46:22.408 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-12-12T09:46:22.408 INFO:teuthology.orchestra.run.smithi073.stdout: "entity": "mds.a", 2023-12-12T09:46:22.408 INFO:teuthology.orchestra.run.smithi073.stdout: "key": "AQD+KnhltpiJCBAAkARF8P9XMNmVBOclyUE0FQ==", 2023-12-12T09:46:22.408 INFO:teuthology.orchestra.run.smithi073.stdout: "caps": { 2023-12-12T09:46:22.408 INFO:teuthology.orchestra.run.smithi073.stdout: "mds": "allow", 2023-12-12T09:46:22.408 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr": "allow *", 2023-12-12T09:46:22.408 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": "allow *", 2023-12-12T09:46:22.408 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": "allow *" 2023-12-12T09:46:22.408 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-12-12T09:46:22.408 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-12-12T09:46:22.408 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-12-12T09:46:22.408 INFO:teuthology.orchestra.run.smithi073.stdout: "entity": "mds.b", 2023-12-12T09:46:22.408 INFO:teuthology.orchestra.run.smithi073.stdout: "key": "AQD+KnhlmYRlKBAAVfJyNKwqFR1brRr+uFNhPA==", 2023-12-12T09:46:22.408 INFO:teuthology.orchestra.run.smithi073.stdout: "caps": { 2023-12-12T09:46:22.409 INFO:teuthology.orchestra.run.smithi073.stdout: "mds": "allow", 2023-12-12T09:46:22.409 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr": "allow *", 2023-12-12T09:46:22.409 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": "allow *", 2023-12-12T09:46:22.409 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": "allow *" 2023-12-12T09:46:22.409 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-12-12T09:46:22.409 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-12-12T09:46:22.409 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-12-12T09:46:22.409 INFO:teuthology.orchestra.run.smithi073.stdout: "entity": "mds.c", 2023-12-12T09:46:22.409 INFO:teuthology.orchestra.run.smithi073.stdout: "key": "AQD+KnhlmFweGRAAOp4JMzmBBBakD0PZJ+h3kA==", 2023-12-12T09:46:22.409 INFO:teuthology.orchestra.run.smithi073.stdout: "caps": { 2023-12-12T09:46:22.409 INFO:teuthology.orchestra.run.smithi073.stdout: "mds": "allow", 2023-12-12T09:46:22.409 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr": "allow *", 2023-12-12T09:46:22.409 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": "allow *", 2023-12-12T09:46:22.409 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": "allow *" 2023-12-12T09:46:22.410 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-12-12T09:46:22.410 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-12-12T09:46:22.410 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-12-12T09:46:22.410 INFO:teuthology.orchestra.run.smithi073.stdout: "entity": "mds.d", 2023-12-12T09:46:22.410 INFO:teuthology.orchestra.run.smithi073.stdout: "key": "AQD+Knhl2IWUNhAA0/c8VA4L8iJXGUmjQ0Y6Tw==", 2023-12-12T09:46:22.410 INFO:teuthology.orchestra.run.smithi073.stdout: "caps": { 2023-12-12T09:46:22.410 INFO:teuthology.orchestra.run.smithi073.stdout: "mds": "allow", 2023-12-12T09:46:22.410 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr": "allow *", 2023-12-12T09:46:22.410 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": "allow *", 2023-12-12T09:46:22.410 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": "allow *" 2023-12-12T09:46:22.410 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-12-12T09:46:22.410 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-12-12T09:46:22.410 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-12-12T09:46:22.411 INFO:teuthology.orchestra.run.smithi073.stdout: "entity": "osd.0", 2023-12-12T09:46:22.411 INFO:teuthology.orchestra.run.smithi073.stdout: "key": "AQADK3hlOX7MFBAAOOzt4ZXOGwlGwyySWJgz4Q==", 2023-12-12T09:46:22.411 INFO:teuthology.orchestra.run.smithi073.stdout: "caps": { 2023-12-12T09:46:22.411 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr": "allow profile osd", 2023-12-12T09:46:22.411 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": "allow profile osd", 2023-12-12T09:46:22.411 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": "allow *" 2023-12-12T09:46:22.411 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-12-12T09:46:22.411 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-12-12T09:46:22.411 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-12-12T09:46:22.411 INFO:teuthology.orchestra.run.smithi073.stdout: "entity": "osd.1", 2023-12-12T09:46:22.411 INFO:teuthology.orchestra.run.smithi073.stdout: "key": "AQAGK3hl+zgiLhAAO2mzDGz2F88weMdDaHYN9w==", 2023-12-12T09:46:22.411 INFO:teuthology.orchestra.run.smithi073.stdout: "caps": { 2023-12-12T09:46:22.411 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr": "allow profile osd", 2023-12-12T09:46:22.411 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": "allow profile osd", 2023-12-12T09:46:22.411 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": "allow *" 2023-12-12T09:46:22.412 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-12-12T09:46:22.412 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-12-12T09:46:22.412 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-12-12T09:46:22.412 INFO:teuthology.orchestra.run.smithi073.stdout: "entity": "osd.2", 2023-12-12T09:46:22.412 INFO:teuthology.orchestra.run.smithi073.stdout: "key": "AQAJK3hlRjtuOBAAmRB8r8bmB4W8yfGT+XaT8A==", 2023-12-12T09:46:22.412 INFO:teuthology.orchestra.run.smithi073.stdout: "caps": { 2023-12-12T09:46:22.412 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr": "allow profile osd", 2023-12-12T09:46:22.412 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": "allow profile osd", 2023-12-12T09:46:22.412 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": "allow *" 2023-12-12T09:46:22.412 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-12-12T09:46:22.412 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-12-12T09:46:22.413 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-12-12T09:46:22.413 INFO:teuthology.orchestra.run.smithi073.stdout: "entity": "osd.3", 2023-12-12T09:46:22.413 INFO:teuthology.orchestra.run.smithi073.stdout: "key": "AQANK3hlmDDlBhAAGk3Yf40DqtpTTcDlbCsnCg==", 2023-12-12T09:46:22.413 INFO:teuthology.orchestra.run.smithi073.stdout: "caps": { 2023-12-12T09:46:22.413 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr": "allow profile osd", 2023-12-12T09:46:22.413 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": "allow profile osd", 2023-12-12T09:46:22.413 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": "allow *" 2023-12-12T09:46:22.413 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-12-12T09:46:22.413 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-12-12T09:46:22.413 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-12-12T09:46:22.413 INFO:teuthology.orchestra.run.smithi073.stdout: "entity": "osd.4", 2023-12-12T09:46:22.413 INFO:teuthology.orchestra.run.smithi073.stdout: "key": "AQAUK3hlQqQlBBAALgzKsaHojYauYpl7vx86uQ==", 2023-12-12T09:46:22.413 INFO:teuthology.orchestra.run.smithi073.stdout: "caps": { 2023-12-12T09:46:22.413 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr": "allow profile osd", 2023-12-12T09:46:22.413 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": "allow profile osd", 2023-12-12T09:46:22.414 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": "allow *" 2023-12-12T09:46:22.414 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-12-12T09:46:22.414 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-12-12T09:46:22.414 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-12-12T09:46:22.414 INFO:teuthology.orchestra.run.smithi073.stdout: "entity": "osd.5", 2023-12-12T09:46:22.414 INFO:teuthology.orchestra.run.smithi073.stdout: "key": "AQAXK3hl2/oEHRAAQKg28eQUCVyqKo7+mE1mpA==", 2023-12-12T09:46:22.414 INFO:teuthology.orchestra.run.smithi073.stdout: "caps": { 2023-12-12T09:46:22.414 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr": "allow profile osd", 2023-12-12T09:46:22.414 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": "allow profile osd", 2023-12-12T09:46:22.414 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": "allow *" 2023-12-12T09:46:22.415 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-12-12T09:46:22.415 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-12-12T09:46:22.415 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-12-12T09:46:22.415 INFO:teuthology.orchestra.run.smithi073.stdout: "entity": "osd.6", 2023-12-12T09:46:22.415 INFO:teuthology.orchestra.run.smithi073.stdout: "key": "AQAaK3hleownKBAADG0Bq08cGxCwBfMPkR30pg==", 2023-12-12T09:46:22.415 INFO:teuthology.orchestra.run.smithi073.stdout: "caps": { 2023-12-12T09:46:22.415 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr": "allow profile osd", 2023-12-12T09:46:22.415 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": "allow profile osd", 2023-12-12T09:46:22.415 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": "allow *" 2023-12-12T09:46:22.415 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-12-12T09:46:22.415 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-12-12T09:46:22.415 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-12-12T09:46:22.415 INFO:teuthology.orchestra.run.smithi073.stdout: "entity": "osd.7", 2023-12-12T09:46:22.415 INFO:teuthology.orchestra.run.smithi073.stdout: "key": "AQAdK3hlqOPJMhAAF/cz3Xce+skpwDFCsb+8BQ==", 2023-12-12T09:46:22.416 INFO:teuthology.orchestra.run.smithi073.stdout: "caps": { 2023-12-12T09:46:22.416 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr": "allow profile osd", 2023-12-12T09:46:22.416 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": "allow profile osd", 2023-12-12T09:46:22.416 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": "allow *" 2023-12-12T09:46:22.416 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-12-12T09:46:22.416 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-12-12T09:46:22.416 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-12-12T09:46:22.417 INFO:teuthology.orchestra.run.smithi073.stdout: "entity": "client.0", 2023-12-12T09:46:22.417 INFO:teuthology.orchestra.run.smithi073.stdout: "key": "AQD/Knhl/4KuBxAAdAlGb7dYkXXlgPJp0Qcecg==", 2023-12-12T09:46:22.417 INFO:teuthology.orchestra.run.smithi073.stdout: "caps": { 2023-12-12T09:46:22.417 INFO:teuthology.orchestra.run.smithi073.stdout: "mds": "allow", 2023-12-12T09:46:22.417 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": "allow r", 2023-12-12T09:46:22.417 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-12-12T09:46:22.417 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-12-12T09:46:22.417 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-12-12T09:46:22.417 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-12-12T09:46:22.418 INFO:teuthology.orchestra.run.smithi073.stdout: "entity": "client.1", 2023-12-12T09:46:22.418 INFO:teuthology.orchestra.run.smithi073.stdout: "key": "AQD/KnhlLq6aERAAgTQwqvltAggkGpb77Zngsg==", 2023-12-12T09:46:22.418 INFO:teuthology.orchestra.run.smithi073.stdout: "caps": { 2023-12-12T09:46:22.418 INFO:teuthology.orchestra.run.smithi073.stdout: "mds": "allow", 2023-12-12T09:46:22.418 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": "allow r", 2023-12-12T09:46:22.418 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": "allow rw pool=cephfs2_data" 2023-12-12T09:46:22.418 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-12-12T09:46:22.418 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-12-12T09:46:22.418 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-12-12T09:46:22.418 INFO:teuthology.orchestra.run.smithi073.stdout: "entity": "client.admin", 2023-12-12T09:46:22.418 INFO:teuthology.orchestra.run.smithi073.stdout: "key": "AQD8KnhlpfsBOBAAE2SZE5bav1875HDrdGXBDQ==", 2023-12-12T09:46:22.419 INFO:teuthology.orchestra.run.smithi073.stdout: "caps": { 2023-12-12T09:46:22.419 INFO:teuthology.orchestra.run.smithi073.stdout: "mds": "allow *", 2023-12-12T09:46:22.419 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr": "allow *", 2023-12-12T09:46:22.419 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": "allow *", 2023-12-12T09:46:22.419 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": "allow *" 2023-12-12T09:46:22.419 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-12-12T09:46:22.419 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-12-12T09:46:22.419 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-12-12T09:46:22.419 INFO:teuthology.orchestra.run.smithi073.stdout: "entity": "client.testuser", 2023-12-12T09:46:22.419 INFO:teuthology.orchestra.run.smithi073.stdout: "key": "AQDNK3hlCS/mJhAAS/jvgI5UicsVLO+EaGuuUQ==", 2023-12-12T09:46:22.419 INFO:teuthology.orchestra.run.smithi073.stdout: "caps": { 2023-12-12T09:46:22.419 INFO:teuthology.orchestra.run.smithi073.stdout: "mds": "allow rw fsname=cephfs", 2023-12-12T09:46:22.419 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": "allow rw fsname=cephfs, allow rw fsname=cephfs2", 2023-12-12T09:46:22.419 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": "allow rw tag cephfs data=cephfs, allow rw tag cephfs data=cephfs2" 2023-12-12T09:46:22.420 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-12-12T09:46:22.420 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-12-12T09:46:22.420 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-12-12T09:46:22.420 INFO:teuthology.orchestra.run.smithi073.stdout: "entity": "mgr.x", 2023-12-12T09:46:22.420 INFO:teuthology.orchestra.run.smithi073.stdout: "key": "AQD9Knhls5L9NxAAQ8z4BOLLDQvKzZhSGc7oCg==", 2023-12-12T09:46:22.420 INFO:teuthology.orchestra.run.smithi073.stdout: "caps": { 2023-12-12T09:46:22.420 INFO:teuthology.orchestra.run.smithi073.stdout: "mds": "allow *", 2023-12-12T09:46:22.420 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": "allow profile mgr", 2023-12-12T09:46:22.420 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": "allow *" 2023-12-12T09:46:22.420 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-12-12T09:46:22.420 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-12-12T09:46:22.420 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-12-12T09:46:22.420 INFO:teuthology.orchestra.run.smithi073.stdout: "entity": "mgr.y", 2023-12-12T09:46:22.421 INFO:teuthology.orchestra.run.smithi073.stdout: "key": "AQD9KnhlWTNgKxAAmpMhLYOvVwJkRPAEtHSQAg==", 2023-12-12T09:46:22.421 INFO:teuthology.orchestra.run.smithi073.stdout: "caps": { 2023-12-12T09:46:22.421 INFO:teuthology.orchestra.run.smithi073.stdout: "mds": "allow *", 2023-12-12T09:46:22.421 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": "allow profile mgr", 2023-12-12T09:46:22.421 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": "allow *" 2023-12-12T09:46:22.421 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-12-12T09:46:22.421 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-12-12T09:46:22.421 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-12-12T09:46:22.421 INFO:teuthology.orchestra.run.smithi073.stdout:} 2023-12-12T09:46:22.422 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:22.409+0000 7efcfa375640 1 -- 172.21.15.73:0/1789176756 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7efcd806ae70 msgr2=0x7efcd806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:22.422 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:22.409+0000 7efcfa375640 1 --2- 172.21.15.73:0/1789176756 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7efcd806ae70 0x7efcd806d330 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7efcf40c1300 tx=0x7efce40079b0 comp rx=0 tx=0).stop 2023-12-12T09:46:22.422 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:22.409+0000 7efcfa375640 1 -- 172.21.15.73:0/1789176756 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efcf40a9470 msgr2=0x7efcf406f9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:22.422 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:22.409+0000 7efcfa375640 1 --2- 172.21.15.73:0/1789176756 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efcf40a9470 0x7efcf406f9a0 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7efcf000d5f0 tx=0x7efcf000dab0 comp rx=0 tx=0).stop 2023-12-12T09:46:22.422 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:22.409+0000 7efcfa375640 1 -- 172.21.15.73:0/1789176756 shutdown_connections 2023-12-12T09:46:22.422 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:22.409+0000 7efcfa375640 1 --2- 172.21.15.73:0/1789176756 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7efcd806ae70 0x7efcd806d330 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:22.422 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:22.409+0000 7efcfa375640 1 --2- 172.21.15.73:0/1789176756 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efcf414fbb0 0x7efcf40bb030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:22.422 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:22.409+0000 7efcfa375640 1 --2- 172.21.15.73:0/1789176756 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efcf40c0f20 0x7efcf4155b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:22.422 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:22.409+0000 7efcfa375640 1 --2- 172.21.15.73:0/1789176756 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efcf40a9470 0x7efcf406f9a0 unknown :-1 s=CLOSED pgs=847 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:22.422 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:22.410+0000 7efcfa375640 1 -- 172.21.15.73:0/1789176756 >> 172.21.15.73:0/1789176756 conn(0x7efcf40c23b0 msgr2=0x7efcf40c2790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:46:22.423 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:22.410+0000 7efcfa375640 1 -- 172.21.15.73:0/1789176756 shutdown_connections 2023-12-12T09:46:22.423 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:22.410+0000 7efcfa375640 1 -- 172.21.15.73:0/1789176756 wait complete. 2023-12-12T09:46:22.428 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.testuser 2023-12-12T09:46:22.647 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:22.647+0000 7f8b9759e640 1 Processor -- start 2023-12-12T09:46:22.647 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:22.647+0000 7f8b9759e640 1 -- start start 2023-12-12T09:46:22.649 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:22.648+0000 7f8b9759e640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8b98151a50 0x7f8b980c7b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:22.649 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:22.648+0000 7f8b9759e640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f8b9806bf80 0x7f8b980ca7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:22.649 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:22.648+0000 7f8b9759e640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b98158360 con 0x7f8b980ca360 2023-12-12T09:46:22.649 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:22.648+0000 7f8b9759e640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b980c5350 con 0x7f8b9806bf80 2023-12-12T09:46:22.649 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:22.648+0000 7f8b9759e640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b98151e30 con 0x7f8b98151a50 2023-12-12T09:46:22.651 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:22.649+0000 7f8b95d9b640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f8b980ca360 0x7f8b9806b870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:53774/0 (socket says 172.21.15.73:53774) 2023-12-12T09:46:22.651 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:22.649+0000 7f8b95d9b640 1 -- 172.21.15.73:0/1923281708 learned_addr learned my addr 172.21.15.73:0/1923281708 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-12T09:46:22.652 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:22.649+0000 7f8b9559a640 1 -- 172.21.15.73:0/1923281708 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 198210498 0 0) 0x7f8b98158360 con 0x7f8b980ca360 2023-12-12T09:46:22.652 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:22.649+0000 7f8b9659c640 1 --2- 172.21.15.73:0/1923281708 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8b98151a50 0x7f8b980c7b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:22.652 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:22.649+0000 7f8b96d9d640 1 --2- 172.21.15.73:0/1923281708 >> v2:172.21.15.142:3300/0 conn(0x7f8b9806bf80 0x7f8b980ca7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:22.652 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:22.649+0000 7f8b9559a640 1 -- 172.21.15.73:0/1923281708 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8b84003520 con 0x7f8b980ca360 2023-12-12T09:46:22.652 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:22.650+0000 7f8b9559a640 1 -- 172.21.15.73:0/1923281708 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 444380006 0 0) 0x7f8b84003520 con 0x7f8b980ca360 2023-12-12T09:46:22.652 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:22.650+0000 7f8b9559a640 1 -- 172.21.15.73:0/1923281708 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8b98151a50 msgr2=0x7f8b980c7b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:46:22.652 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:22.650+0000 7f8b9559a640 1 --2- 172.21.15.73:0/1923281708 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8b98151a50 0x7f8b980c7b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:22.652 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:22.650+0000 7f8b9559a640 1 -- 172.21.15.73:0/1923281708 >> v2:172.21.15.142:3300/0 conn(0x7f8b9806bf80 msgr2=0x7f8b980ca7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:46:22.652 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:22.650+0000 7f8b9559a640 1 --2- 172.21.15.73:0/1923281708 >> v2:172.21.15.142:3300/0 conn(0x7f8b9806bf80 0x7f8b980ca7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:22.652 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:22.650+0000 7f8b9559a640 1 -- 172.21.15.73:0/1923281708 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b980c8330 con 0x7f8b980ca360 2023-12-12T09:46:22.652 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:22.650+0000 7f8b9559a640 1 -- 172.21.15.73:0/1923281708 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3186547832 0 0) 0x7f8b80001670 con 0x7f8b980ca360 2023-12-12T09:46:22.652 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:22.650+0000 7f8b9559a640 1 -- 172.21.15.73:0/1923281708 >> v1:172.21.15.73:6789/0 conn(0x7f8b980ca360 legacy=0x7f8b9806b870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:22.652 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:22.650+0000 7f8b9559a640 1 --2- 172.21.15.73:0/1923281708 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8b84003970 0x7f8b84003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:22.652 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:22.650+0000 7f8b9559a640 1 --2- 172.21.15.73:0/1923281708 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8b840047c0 0x7f8b84004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:22.653 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:22.650+0000 7f8b9559a640 1 --2- 172.21.15.73:0/1923281708 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8b98151a50 0x7f8b84005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:22.653 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:22.650+0000 7f8b9559a640 1 -- 172.21.15.73:0/1923281708 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b98151e30 con 0x7f8b84003970 2023-12-12T09:46:22.653 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:22.650+0000 7f8b9559a640 1 -- 172.21.15.73:0/1923281708 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b8400b980 con 0x7f8b840047c0 2023-12-12T09:46:22.653 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:22.650+0000 7f8b9559a640 1 -- 172.21.15.73:0/1923281708 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b8400bb40 con 0x7f8b98151a50 2023-12-12T09:46:22.653 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:22.650+0000 7f8b9659c640 1 --2- 172.21.15.73:0/1923281708 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8b84003970 0x7f8b84003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:22.653 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:22.651+0000 7f8b95d9b640 1 --2- 172.21.15.73:0/1923281708 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8b840047c0 0x7f8b84004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:22.653 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:22.651+0000 7f8b96d9d640 1 --2- 172.21.15.73:0/1923281708 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8b98151a50 0x7f8b84005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:22.653 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:22.651+0000 7f8b9659c640 1 -- 172.21.15.73:0/1923281708 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8b98151a50 msgr2=0x7f8b84005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:46:22.653 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:22.651+0000 7f8b9659c640 1 --2- 172.21.15.73:0/1923281708 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8b98151a50 0x7f8b84005180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:22.653 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:22.651+0000 7f8b9659c640 1 -- 172.21.15.73:0/1923281708 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8b840047c0 msgr2=0x7f8b84004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:46:22.653 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:22.651+0000 7f8b9659c640 1 --2- 172.21.15.73:0/1923281708 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8b840047c0 0x7f8b84004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:22.653 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:22.651+0000 7f8b9659c640 1 -- 172.21.15.73:0/1923281708 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b84003520 con 0x7f8b84003970 2023-12-12T09:46:22.655 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:22.652+0000 7f8b9659c640 1 --2- 172.21.15.73:0/1923281708 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8b84003970 0x7f8b84003d90 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7f8b88009fc0 tx=0x7f8b840057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1a4cf922fdf8034 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:46:22.655 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:22.652+0000 7f8b9559a640 1 -- 172.21.15.73:0/1923281708 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b8802cc20 con 0x7f8b84003970 2023-12-12T09:46:22.655 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:22.652+0000 7f8b9559a640 1 -- 172.21.15.73:0/1923281708 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b8800f040 con 0x7f8b84003970 2023-12-12T09:46:22.655 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:22.652+0000 7f8b9559a640 1 -- 172.21.15.73:0/1923281708 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b88034440 con 0x7f8b84003970 2023-12-12T09:46:22.655 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:22.652+0000 7f8b9759e640 1 -- 172.21.15.73:0/1923281708 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8b84003970 msgr2=0x7f8b84003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:22.655 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:22.652+0000 7f8b9759e640 1 --2- 172.21.15.73:0/1923281708 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8b84003970 0x7f8b84003d90 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7f8b88009fc0 tx=0x7f8b840057f0 comp rx=0 tx=0).stop 2023-12-12T09:46:22.655 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:22.653+0000 7f8b96d9d640 1 -- 172.21.15.73:0/1923281708 reap_dead start 2023-12-12T09:46:22.655 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:22.653+0000 7f8b9759e640 1 -- 172.21.15.73:0/1923281708 shutdown_connections 2023-12-12T09:46:22.655 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:22.653+0000 7f8b9759e640 1 -- 172.21.15.73:0/1923281708 >> 172.21.15.73:0/1923281708 conn(0x7f8b980abe10 msgr2=0x7f8b980c9c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:46:22.655 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:22.653+0000 7f8b9759e640 1 -- 172.21.15.73:0/1923281708 shutdown_connections 2023-12-12T09:46:22.656 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:22.653+0000 7f8b9759e640 1 -- 172.21.15.73:0/1923281708 wait complete. 2023-12-12T09:46:22.656 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:22.654+0000 7f8b9759e640 1 Processor -- start 2023-12-12T09:46:22.656 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:22.655+0000 7f8b9759e640 1 -- start start 2023-12-12T09:46:22.657 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:22.655+0000 7f8b9759e640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8b84003970 0x7f8b980aa3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:22.657 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:22.655+0000 7f8b9759e640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8b98153fd0 0x7f8b9814acc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:22.657 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:22.656+0000 7f8b9759e640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8b98154430 0x7f8b9814b200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:22.657 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:22.656+0000 7f8b9759e640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b981ed4b0 con 0x7f8b98154430 2023-12-12T09:46:22.657 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:22.656+0000 7f8b9759e640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b981ed790 con 0x7f8b84003970 2023-12-12T09:46:22.657 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:22.656+0000 7f8b9759e640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b981eda70 con 0x7f8b98153fd0 2023-12-12T09:46:22.657 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:22.656+0000 7f8b96d9d640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8b98154430 0x7f8b9814b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:22.657 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:22.656+0000 7f8b96d9d640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8b98154430 0x7f8b9814b200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:54868/0 (socket says 172.21.15.73:54868) 2023-12-12T09:46:22.657 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:22.656+0000 7f8b96d9d640 1 -- 172.21.15.73:0/2386975077 learned_addr learned my addr 172.21.15.73:0/2386975077 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:46:22.657 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:22.656+0000 7f8b9659c640 1 --2- 172.21.15.73:0/2386975077 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8b84003970 0x7f8b980aa3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:22.658 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:22.656+0000 7f8b95d9b640 1 --2- 172.21.15.73:0/2386975077 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8b98153fd0 0x7f8b9814acc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:22.658 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:22.656+0000 7f8b96d9d640 1 -- 172.21.15.73:0/2386975077 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8b98153fd0 msgr2=0x7f8b9814acc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:22.658 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:22.656+0000 7f8b96d9d640 1 --2- 172.21.15.73:0/2386975077 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8b98153fd0 0x7f8b9814acc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:22.658 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:22.656+0000 7f8b96d9d640 1 -- 172.21.15.73:0/2386975077 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8b84003970 msgr2=0x7f8b980aa3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:22.658 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:22.656+0000 7f8b96d9d640 1 --2- 172.21.15.73:0/2386975077 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8b84003970 0x7f8b980aa3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:22.658 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:22.656+0000 7f8b96d9d640 1 -- 172.21.15.73:0/2386975077 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b981edd50 con 0x7f8b98154430 2023-12-12T09:46:22.658 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:22.657+0000 7f8b96d9d640 1 --2- 172.21.15.73:0/2386975077 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8b98154430 0x7f8b9814b200 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7f8b98074a50 tx=0x7f8b90010c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:46:22.659 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:22.657+0000 7f8b8effd640 1 -- 172.21.15.73:0/2386975077 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b9000e8a0 con 0x7f8b98154430 2023-12-12T09:46:22.659 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:22.657+0000 7f8b8effd640 1 -- 172.21.15.73:0/2386975077 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b9000ea20 con 0x7f8b98154430 2023-12-12T09:46:22.659 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:22.657+0000 7f8b8effd640 1 -- 172.21.15.73:0/2386975077 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b9000edd0 con 0x7f8b98154430 2023-12-12T09:46:22.659 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:22.657+0000 7f8b9759e640 1 -- 172.21.15.73:0/2386975077 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b981ee030 con 0x7f8b98154430 2023-12-12T09:46:22.659 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:22.657+0000 7f8b9759e640 1 -- 172.21.15.73:0/2386975077 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b980aa900 con 0x7f8b98154430 2023-12-12T09:46:22.659 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:22.658+0000 7f8b9759e640 1 -- 172.21.15.73:0/2386975077 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b980c0d20 con 0x7f8b98154430 2023-12-12T09:46:22.659 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:22.659+0000 7f8b8effd640 1 -- 172.21.15.73:0/2386975077 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f8b90021460 con 0x7f8b98154430 2023-12-12T09:46:22.661 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:22.660+0000 7f8b8effd640 1 --2- 172.21.15.73:0/2386975077 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f8b7806ae70 0x7f8b7806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:22.661 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:22.660+0000 7f8b8effd640 1 -- 172.21.15.73:0/2386975077 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f8b90088ee0 con 0x7f8b98154430 2023-12-12T09:46:22.661 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:22.661+0000 7f8b9659c640 1 --2- 172.21.15.73:0/2386975077 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f8b7806ae70 0x7f8b7806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:22.661 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:22.661+0000 7f8b9659c640 1 --2- 172.21.15.73:0/2386975077 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f8b7806ae70 0x7f8b7806d330 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f8b88036000 tx=0x7f8b8802e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:46:22.665 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:22.665+0000 7f8b8effd640 1 -- 172.21.15.73:0/2386975077 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f8b980c0d20 con 0x7f8b98154430 2023-12-12T09:46:22.917 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:22.916+0000 7f8b9759e640 1 -- 172.21.15.73:0/2386975077 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.testuser"} v 0) v1 -- 0x7f8b980c0d20 con 0x7f8b98154430 2023-12-12T09:46:22.920 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:22.920+0000 7f8b8effd640 1 -- 172.21.15.73:0/2386975077 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.testuser"}]=0 v18) v1 ==== 85+0+0 (secure 0 0 0) 0x7f8b980c0d20 con 0x7f8b98154430 2023-12-12T09:46:22.923 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:22.922+0000 7f8b9759e640 1 -- 172.21.15.73:0/2386975077 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f8b7806ae70 msgr2=0x7f8b7806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:22.923 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:22.922+0000 7f8b9759e640 1 --2- 172.21.15.73:0/2386975077 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f8b7806ae70 0x7f8b7806d330 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f8b88036000 tx=0x7f8b8802e000 comp rx=0 tx=0).stop 2023-12-12T09:46:22.923 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:22.922+0000 7f8b9759e640 1 -- 172.21.15.73:0/2386975077 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8b98154430 msgr2=0x7f8b9814b200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:22.923 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:22.922+0000 7f8b9759e640 1 --2- 172.21.15.73:0/2386975077 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8b98154430 0x7f8b9814b200 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7f8b98074a50 tx=0x7f8b90010c20 comp rx=0 tx=0).stop 2023-12-12T09:46:22.923 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:22.922+0000 7f8b9759e640 1 -- 172.21.15.73:0/2386975077 shutdown_connections 2023-12-12T09:46:22.923 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:22.922+0000 7f8b9759e640 1 --2- 172.21.15.73:0/2386975077 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f8b7806ae70 0x7f8b7806d330 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:22.924 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:22.922+0000 7f8b9759e640 1 --2- 172.21.15.73:0/2386975077 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8b98154430 0x7f8b9814b200 unknown :-1 s=CLOSED pgs=850 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:22.924 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:22.922+0000 7f8b9759e640 1 --2- 172.21.15.73:0/2386975077 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8b98153fd0 0x7f8b9814acc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:22.924 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:22.922+0000 7f8b9759e640 1 --2- 172.21.15.73:0/2386975077 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8b84003970 0x7f8b980aa3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:22.924 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:22.922+0000 7f8b9759e640 1 -- 172.21.15.73:0/2386975077 >> 172.21.15.73:0/2386975077 conn(0x7f8b980abe10 msgr2=0x7f8b980c85b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:46:22.924 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:22.922+0000 7f8b9759e640 1 -- 172.21.15.73:0/2386975077 shutdown_connections 2023-12-12T09:46:22.924 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:22.922+0000 7f8b9759e640 1 -- 172.21.15.73:0/2386975077 wait complete. 2023-12-12T09:46:22.940 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-12T09:46:23.144 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:23.143+0000 7fced53a7640 1 Processor -- start 2023-12-12T09:46:23.144 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:23.144+0000 7fced53a7640 1 -- start start 2023-12-12T09:46:23.145 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:23.145+0000 7fced53a7640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fced00a9470 0x7fced00aae00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:23.145 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:23.145+0000 7fced53a7640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fced00ab340 0x7fced015cbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:23.145 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:23.145+0000 7fced53a7640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fced0153300 con 0x7fced014fbb0 2023-12-12T09:46:23.146 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:23.145+0000 7fced53a7640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fced00aa000 con 0x7fced00ab340 2023-12-12T09:46:23.146 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:23.145+0000 7fced53a7640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fced00c1d40 con 0x7fced00a9470 2023-12-12T09:46:23.147 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:23.145+0000 7fcecffff640 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7fced014fbb0 0x7fced00c09e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.73:48088/0 (socket says 172.21.15.73:48088) 2023-12-12T09:46:23.147 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:23.146+0000 7fcecffff640 1 -- 172.21.15.73:0/3173963383 learned_addr learned my addr 172.21.15.73:0/3173963383 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-12T09:46:23.147 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:23.146+0000 7fcec7fff640 1 --2- 172.21.15.73:0/3173963383 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fced00a9470 0x7fced00aae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:23.147 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:23.146+0000 7fced4ba6640 1 --2- 172.21.15.73:0/3173963383 >> v2:172.21.15.142:3300/0 conn(0x7fced00ab340 0x7fced015cbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:23.147 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:23.146+0000 7fcecf7fe640 1 -- 172.21.15.73:0/3173963383 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3237454045 0 0) 0x7fced0153300 con 0x7fced014fbb0 2023-12-12T09:46:23.147 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:23.146+0000 7fcecf7fe640 1 -- 172.21.15.73:0/3173963383 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcebc003520 con 0x7fced014fbb0 2023-12-12T09:46:23.147 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:23.146+0000 7fcec7fff640 1 -- 172.21.15.73:0/3173963383 >> v2:172.21.15.142:3300/0 conn(0x7fced00ab340 msgr2=0x7fced015cbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:46:23.147 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:23.146+0000 7fcec7fff640 1 --2- 172.21.15.73:0/3173963383 >> v2:172.21.15.142:3300/0 conn(0x7fced00ab340 0x7fced015cbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:23.147 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:23.146+0000 7fcec7fff640 1 -- 172.21.15.73:0/3173963383 >> v1:172.21.15.142:6789/0 conn(0x7fced014fbb0 legacy=0x7fced00c09e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:23.148 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:23.146+0000 7fcec7fff640 1 -- 172.21.15.73:0/3173963383 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fced00c2160 con 0x7fced00a9470 2023-12-12T09:46:23.148 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:23.148+0000 7fcec7fff640 1 --2- 172.21.15.73:0/3173963383 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fced00a9470 0x7fced00aae00 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fceb80097a0 tx=0x7fceb802b820 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8970f28486c2406 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:46:23.149 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:23.148+0000 7fcecf7fe640 1 -- 172.21.15.73:0/3173963383 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fceb8031780 con 0x7fced00a9470 2023-12-12T09:46:23.149 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:23.148+0000 7fcecf7fe640 1 -- 172.21.15.73:0/3173963383 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fceb80318e0 con 0x7fced00a9470 2023-12-12T09:46:23.149 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:23.148+0000 7fcecf7fe640 1 -- 172.21.15.73:0/3173963383 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fceb8031c70 con 0x7fced00a9470 2023-12-12T09:46:23.150 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:23.149+0000 7fced53a7640 1 -- 172.21.15.73:0/3173963383 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fced00a9470 msgr2=0x7fced00aae00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:23.150 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:23.149+0000 7fced53a7640 1 --2- 172.21.15.73:0/3173963383 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fced00a9470 0x7fced00aae00 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fceb80097a0 tx=0x7fceb802b820 comp rx=0 tx=0).stop 2023-12-12T09:46:23.150 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:23.149+0000 7fced53a7640 1 -- 172.21.15.73:0/3173963383 shutdown_connections 2023-12-12T09:46:23.150 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:23.149+0000 7fced53a7640 1 --2- 172.21.15.73:0/3173963383 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fced00a9470 0x7fced00aae00 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:23.150 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:23.149+0000 7fced53a7640 1 --2- 172.21.15.73:0/3173963383 >> v2:172.21.15.142:3300/0 conn(0x7fced00ab340 0x7fced015cbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:23.150 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:23.149+0000 7fced53a7640 1 -- 172.21.15.73:0/3173963383 >> 172.21.15.73:0/3173963383 conn(0x7fced00c23b0 msgr2=0x7fced00c2790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:46:23.150 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:23.149+0000 7fced53a7640 1 -- 172.21.15.73:0/3173963383 shutdown_connections 2023-12-12T09:46:23.150 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:23.149+0000 7fced53a7640 1 -- 172.21.15.73:0/3173963383 wait complete. 2023-12-12T09:46:23.151 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:23.151+0000 7fced53a7640 1 Processor -- start 2023-12-12T09:46:23.151 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:23.151+0000 7fced53a7640 1 -- start start 2023-12-12T09:46:23.152 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:23.152+0000 7fced53a7640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fced00a9470 0x7fced0153a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:23.152 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:23.152+0000 7fced53a7640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fced00ab340 0x7fced014dde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:23.152 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:23.152+0000 7fced53a7640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fced014fbb0 0x7fced014e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:23.152 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:23.152+0000 7fced53a7640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fced01549b0 con 0x7fced00a9470 2023-12-12T09:46:23.152 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:23.152+0000 7fced53a7640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fced01dc3e0 con 0x7fced00ab340 2023-12-12T09:46:23.153 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:23.152+0000 7fced53a7640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fced0071f60 con 0x7fced014fbb0 2023-12-12T09:46:23.153 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:23.152+0000 7fcecffff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fced00a9470 0x7fced0153a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:23.153 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:23.152+0000 7fcecffff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fced00a9470 0x7fced0153a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:54884/0 (socket says 172.21.15.73:54884) 2023-12-12T09:46:23.153 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:23.152+0000 7fcecffff640 1 -- 172.21.15.73:0/243354395 learned_addr learned my addr 172.21.15.73:0/243354395 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:46:23.154 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:23.152+0000 7fcec7fff640 1 --2- 172.21.15.73:0/243354395 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fced00ab340 0x7fced014dde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:23.155 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:23.152+0000 7fced4ba6640 1 --2- 172.21.15.73:0/243354395 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fced014fbb0 0x7fced014e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:23.155 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:23.152+0000 7fcecffff640 1 -- 172.21.15.73:0/243354395 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fced014fbb0 msgr2=0x7fced014e320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:23.155 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:23.152+0000 7fcecffff640 1 --2- 172.21.15.73:0/243354395 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fced014fbb0 0x7fced014e320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:23.155 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:23.152+0000 7fcecffff640 1 -- 172.21.15.73:0/243354395 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fced00ab340 msgr2=0x7fced014dde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:23.155 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:23.153+0000 7fcecffff640 1 --2- 172.21.15.73:0/243354395 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fced00ab340 0x7fced014dde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:23.155 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:23.153+0000 7fcecffff640 1 -- 172.21.15.73:0/243354395 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fceb8009400 con 0x7fced00a9470 2023-12-12T09:46:23.155 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:23.153+0000 7fcecffff640 1 --2- 172.21.15.73:0/243354395 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fced00a9470 0x7fced0153a30 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7fcec000c530 tx=0x7fcec000c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:46:23.155 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:23.153+0000 7fcecd7fa640 1 -- 172.21.15.73:0/243354395 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcec0005ce0 con 0x7fced00a9470 2023-12-12T09:46:23.155 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:23.153+0000 7fcecd7fa640 1 -- 172.21.15.73:0/243354395 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcec0005e40 con 0x7fced00a9470 2023-12-12T09:46:23.156 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:23.153+0000 7fced53a7640 1 -- 172.21.15.73:0/243354395 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fced0072240 con 0x7fced00a9470 2023-12-12T09:46:23.156 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:23.153+0000 7fcecd7fa640 1 -- 172.21.15.73:0/243354395 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcec00072b0 con 0x7fced00a9470 2023-12-12T09:46:23.156 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:23.153+0000 7fced53a7640 1 -- 172.21.15.73:0/243354395 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fced0154ea0 con 0x7fced00a9470 2023-12-12T09:46:23.156 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:23.154+0000 7fced53a7640 1 -- 172.21.15.73:0/243354395 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fced00723d0 con 0x7fced00a9470 2023-12-12T09:46:23.156 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:23.155+0000 7fcecd7fa640 1 -- 172.21.15.73:0/243354395 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fcec0007410 con 0x7fced00a9470 2023-12-12T09:46:23.157 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:23.156+0000 7fcecd7fa640 1 --2- 172.21.15.73:0/243354395 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fceb006ae40 0x7fceb006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:23.157 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:23.156+0000 7fcecd7fa640 1 -- 172.21.15.73:0/243354395 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fcec0088980 con 0x7fced00a9470 2023-12-12T09:46:23.157 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:23.156+0000 7fcec7fff640 1 --2- 172.21.15.73:0/243354395 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fceb006ae40 0x7fceb006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:23.157 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:23.157+0000 7fcec7fff640 1 --2- 172.21.15.73:0/243354395 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fceb006ae40 0x7fceb006d300 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fceb8036000 tx=0x7fceb803d040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:46:23.161 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:23.160+0000 7fcecd7fa640 1 -- 172.21.15.73:0/243354395 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fcec0053da0 con 0x7fced00a9470 2023-12-12T09:46:23.350 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:23.350+0000 7fced53a7640 1 -- 172.21.15.73:0/243354395 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fced0067400 con 0x7fced00a9470 2023-12-12T09:46:23.351 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:23.351+0000 7fcecd7fa640 1 -- 172.21.15.73:0/243354395 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v71) v1 ==== 74+0+12870 (secure 0 0 0) 0x7fcec0017020 con 0x7fced00a9470 2023-12-12T09:46:23.352 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-12T09:46:23.352 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":71,"fsid":"ba240992-02b8-4c7e-92f2-27eb29ac433b","created":"2023-12-12T09:43:02.454719+0000","modified":"2023-12-12T09:46:21.906590+0000","last_up_change":"2023-12-12T09:43:13.913440+0000","last_in_change":"2023-12-12T09:43:05.925348+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-12T09:43:15.525508+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"dd9074be-dbe2-4c34-9896-a4223d8d3940","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":4047810203},{"type":"v1","addr":"172.21.15.73:6801","nonce":4047810203}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":4047810203},{"type":"v1","addr":"172.21.15.73:6803","nonce":4047810203}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":4047810203},{"type":"v1","addr":"172.21.15.73:6807","nonce":4047810203}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":4047810203},{"type":"v1","addr":"172.21.15.73:6805","nonce":4047810203}]},"public_addr":"172.21.15.73:6801/4047810203","cluster_addr":"172.21.15.73:6803/4047810203","heartbeat_back_addr":"172.21.15.73:6807/4047810203","heartbeat_front_addr":"172.21.15.73:6805/4047810203","state":["exists","up"]},{"osd":1,"uuid":"c4a05052-96d4-4758-a4e1-1a37f1e07fed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":1356058331},{"type":"v1","addr":"172.21.15.73:6824","nonce":1356058331}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":1356058331},{"type":"v1","addr":"172.21.15.73:6827","nonce":1356058331}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":1356058331},{"type":"v1","addr":"172.21.15.73:6831","nonce":1356058331}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":1356058331},{"type":"v1","addr":"172.21.15.73:6829","nonce":1356058331}]},"public_addr":"172.21.15.73:6824/1356058331","cluster_addr":"172.21.15.73:6827/1356058331","heartbeat_back_addr":"172.21.15.73:6831/1356058331","heartbeat_front_addr":"172.21.15.73:6829/1356058331","state":["exists","up"]},{"osd":2,"uuid":"512bc8ac-72c2-40d4-b3d2-d867a92c5213","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":1228903316},{"type":"v1","addr":"172.21.15.73:6817","nonce":1228903316}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":1228903316},{"type":"v1","addr":"172.21.15.73:6819","nonce":1228903316}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6823","nonce":1228903316},{"type":"v1","addr":"172.21.15.73:6825","nonce":1228903316}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":1228903316},{"type":"v1","addr":"172.21.15.73:6821","nonce":1228903316}]},"public_addr":"172.21.15.73:6817/1228903316","cluster_addr":"172.21.15.73:6819/1228903316","heartbeat_back_addr":"172.21.15.73:6825/1228903316","heartbeat_front_addr":"172.21.15.73:6821/1228903316","state":["exists","up"]},{"osd":3,"uuid":"3d1a91e0-42bf-437a-8eae-8d357c8f63a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":1293329670},{"type":"v1","addr":"172.21.15.73:6809","nonce":1293329670}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6810","nonce":1293329670},{"type":"v1","addr":"172.21.15.73:6811","nonce":1293329670}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":1293329670},{"type":"v1","addr":"172.21.15.73:6815","nonce":1293329670}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":1293329670},{"type":"v1","addr":"172.21.15.73:6813","nonce":1293329670}]},"public_addr":"172.21.15.73:6809/1293329670","cluster_addr":"172.21.15.73:6811/1293329670","heartbeat_back_addr":"172.21.15.73:6815/1293329670","heartbeat_front_addr":"172.21.15.73:6813/1293329670","state":["exists","up"]},{"osd":4,"uuid":"4b302fff-834c-4069-ac19-00e46f6c87b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":3727975702},{"type":"v1","addr":"172.21.15.142:6801","nonce":3727975702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":3727975702},{"type":"v1","addr":"172.21.15.142:6803","nonce":3727975702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6809","nonce":3727975702},{"type":"v1","addr":"172.21.15.142:6811","nonce":3727975702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6805","nonce":3727975702},{"type":"v1","addr":"172.21.15.142:6807","nonce":3727975702}]},"public_addr":"172.21.15.142:6801/3727975702","cluster_addr":"172.21.15.142:6803/3727975702","heartbeat_back_addr":"172.21.15.142:6811/3727975702","heartbeat_front_addr":"172.21.15.142:6807/3727975702","state":["exists","up"]},{"osd":5,"uuid":"d7cdace2-67d0-45cc-95f2-515cf6ef1b82","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6817","nonce":2353193632},{"type":"v1","addr":"172.21.15.142:6819","nonce":2353193632}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6821","nonce":2353193632},{"type":"v1","addr":"172.21.15.142:6823","nonce":2353193632}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6829","nonce":2353193632},{"type":"v1","addr":"172.21.15.142:6831","nonce":2353193632}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6825","nonce":2353193632},{"type":"v1","addr":"172.21.15.142:6827","nonce":2353193632}]},"public_addr":"172.21.15.142:6819/2353193632","cluster_addr":"172.21.15.142:6823/2353193632","heartbeat_back_addr":"172.21.15.142:6831/2353193632","heartbeat_front_addr":"172.21.15.142:6827/2353193632","state":["exists","up"]},{"osd":6,"uuid":"649ce78a-5626-445c-aedc-a651ed05a6f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":2006111986},{"type":"v1","addr":"172.21.15.142:6806","nonce":2006111986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":2006111986},{"type":"v1","addr":"172.21.15.142:6810","nonce":2006111986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":2006111986},{"type":"v1","addr":"172.21.15.142:6815","nonce":2006111986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":2006111986},{"type":"v1","addr":"172.21.15.142:6813","nonce":2006111986}]},"public_addr":"172.21.15.142:6806/2006111986","cluster_addr":"172.21.15.142:6810/2006111986","heartbeat_back_addr":"172.21.15.142:6815/2006111986","heartbeat_front_addr":"172.21.15.142:6813/2006111986","state":["exists","up"]},{"osd":7,"uuid":"af15ae3b-c1d0-4acf-92db-8a1805494d13","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":2573794341},{"type":"v1","addr":"172.21.15.142:6818","nonce":2573794341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":2573794341},{"type":"v1","addr":"172.21.15.142:6822","nonce":2573794341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":2573794341},{"type":"v1","addr":"172.21.15.142:6830","nonce":2573794341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":2573794341},{"type":"v1","addr":"172.21.15.142:6826","nonce":2573794341}]},"public_addr":"172.21.15.142:6818/2573794341","cluster_addr":"172.21.15.142:6822/2573794341","heartbeat_back_addr":"172.21.15.142:6830/2573794341","heartbeat_front_addr":"172.21.15.142:6826/2573794341","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.185824+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.262103+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.225556+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:10.523459+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:10.706035+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.257339+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.301776+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.051960+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-12T09:46:23.355 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:23.354+0000 7fced53a7640 1 -- 172.21.15.73:0/243354395 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fceb006ae40 msgr2=0x7fceb006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:23.355 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:23.354+0000 7fced53a7640 1 --2- 172.21.15.73:0/243354395 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fceb006ae40 0x7fceb006d300 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fceb8036000 tx=0x7fceb803d040 comp rx=0 tx=0).stop 2023-12-12T09:46:23.355 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:23.354+0000 7fced53a7640 1 -- 172.21.15.73:0/243354395 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fced00a9470 msgr2=0x7fced0153a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:23.355 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:23.354+0000 7fced53a7640 1 --2- 172.21.15.73:0/243354395 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fced00a9470 0x7fced0153a30 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7fcec000c530 tx=0x7fcec000c9f0 comp rx=0 tx=0).stop 2023-12-12T09:46:23.355 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:23.354+0000 7fced53a7640 1 -- 172.21.15.73:0/243354395 shutdown_connections 2023-12-12T09:46:23.355 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:23.354+0000 7fced53a7640 1 --2- 172.21.15.73:0/243354395 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fceb006ae40 0x7fceb006d300 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:23.355 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:23.354+0000 7fced53a7640 1 --2- 172.21.15.73:0/243354395 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fced014fbb0 0x7fced014e320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:23.355 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:23.354+0000 7fced53a7640 1 --2- 172.21.15.73:0/243354395 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fced00ab340 0x7fced014dde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:23.355 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:23.354+0000 7fced53a7640 1 --2- 172.21.15.73:0/243354395 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fced00a9470 0x7fced0153a30 unknown :-1 s=CLOSED pgs=851 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:23.355 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:23.354+0000 7fced53a7640 1 -- 172.21.15.73:0/243354395 >> 172.21.15.73:0/243354395 conn(0x7fced00c23b0 msgr2=0x7fced00a5940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:46:23.355 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:23.354+0000 7fced53a7640 1 -- 172.21.15.73:0/243354395 shutdown_connections 2023-12-12T09:46:23.355 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:23.354+0000 7fced53a7640 1 -- 172.21.15.73:0/243354395 wait complete. 2023-12-12T09:46:23.373 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-12T09:43:15.525508+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-12T09:46:23.373 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-12T09:46:23.592 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:23.592+0000 7f61781e5640 1 Processor -- start 2023-12-12T09:46:23.592 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:23.592+0000 7f61781e5640 1 -- start start 2023-12-12T09:46:23.594 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:23.593+0000 7f61781e5640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f617006d350 0x7f617006dc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:23.594 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:23.593+0000 7f61781e5640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61700c16c0 con 0x7f6170152500 2023-12-12T09:46:23.594 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:23.593+0000 7f61781e5640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61700c19a0 con 0x7f617014f8c0 2023-12-12T09:46:23.594 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:23.593+0000 7f61781e5640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61700c1090 con 0x7f617006d350 2023-12-12T09:46:23.594 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:23.594+0000 7f6175780640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f617006d350 0x7f617006dc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:23.594 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:23.594+0000 7f6175780640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f617006d350 0x7f617006dc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:54892/0 (socket says 172.21.15.73:54892) 2023-12-12T09:46:23.594 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:23.594+0000 7f6175780640 1 -- 172.21.15.73:0/1279443756 learned_addr learned my addr 172.21.15.73:0/1279443756 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:46:23.595 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:23.594+0000 7f6175780640 1 -- 172.21.15.73:0/1279443756 >> v1:172.21.15.142:6789/0 conn(0x7f617014f8c0 legacy=0x7f6170071e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:46:23.595 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:23.594+0000 7f6175780640 1 -- 172.21.15.73:0/1279443756 >> v1:172.21.15.73:6789/0 conn(0x7f6170152500 legacy=0x7f6170152990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:23.595 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:23.594+0000 7f6175780640 1 -- 172.21.15.73:0/1279443756 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61700c1c80 con 0x7f617006d350 2023-12-12T09:46:23.595 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:23.595+0000 7f6175780640 1 --2- 172.21.15.73:0/1279443756 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f617006d350 0x7f617006dc40 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7f6164009870 tx=0x7f616402b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9d6cb306213fd75 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:46:23.596 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:23.596+0000 7f6174f7f640 1 -- 172.21.15.73:0/1279443756 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6164030860 con 0x7f617006d350 2023-12-12T09:46:23.596 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:23.596+0000 7f6174f7f640 1 -- 172.21.15.73:0/1279443756 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61640309c0 con 0x7f617006d350 2023-12-12T09:46:23.596 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:23.596+0000 7f6174f7f640 1 -- 172.21.15.73:0/1279443756 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6164030d50 con 0x7f617006d350 2023-12-12T09:46:23.597 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:23.596+0000 7f61781e5640 1 -- 172.21.15.73:0/1279443756 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f617006d350 msgr2=0x7f617006dc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:23.597 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:23.596+0000 7f61781e5640 1 --2- 172.21.15.73:0/1279443756 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f617006d350 0x7f617006dc40 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7f6164009870 tx=0x7f616402b9a0 comp rx=0 tx=0).stop 2023-12-12T09:46:23.597 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:23.596+0000 7f61781e5640 1 -- 172.21.15.73:0/1279443756 shutdown_connections 2023-12-12T09:46:23.597 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:23.596+0000 7f61781e5640 1 --2- 172.21.15.73:0/1279443756 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f617006d350 0x7f617006dc40 unknown :-1 s=CLOSED pgs=853 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:23.597 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:23.596+0000 7f61781e5640 1 -- 172.21.15.73:0/1279443756 >> 172.21.15.73:0/1279443756 conn(0x7f617006a4e0 msgr2=0x7f617006a8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:46:23.597 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:23.596+0000 7f61781e5640 1 -- 172.21.15.73:0/1279443756 shutdown_connections 2023-12-12T09:46:23.597 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:23.596+0000 7f61781e5640 1 -- 172.21.15.73:0/1279443756 wait complete. 2023-12-12T09:46:23.598 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:23.598+0000 7f61781e5640 1 Processor -- start 2023-12-12T09:46:23.598 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:23.598+0000 7f61781e5640 1 -- start start 2023-12-12T09:46:23.600 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:23.599+0000 7f61781e5640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f617006d350 0x7f6170149b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:23.600 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:23.599+0000 7f61781e5640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f617014f8c0 0x7f61701dd680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:23.600 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:23.599+0000 7f61781e5640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6170152500 0x7f61701515f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:23.600 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:23.599+0000 7f61781e5640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f617014b850 con 0x7f617014f8c0 2023-12-12T09:46:23.600 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:23.599+0000 7f61781e5640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f617014a1b0 con 0x7f617006d350 2023-12-12T09:46:23.600 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:23.599+0000 7f61781e5640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f617014a490 con 0x7f6170152500 2023-12-12T09:46:23.600 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:23.599+0000 7f6175780640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f617014f8c0 0x7f61701dd680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:23.600 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:23.599+0000 7f6175780640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f617014f8c0 0x7f61701dd680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:54900/0 (socket says 172.21.15.73:54900) 2023-12-12T09:46:23.600 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:23.599+0000 7f6175780640 1 -- 172.21.15.73:0/3813076842 learned_addr learned my addr 172.21.15.73:0/3813076842 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:46:23.600 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:23.599+0000 7f6175780640 1 -- 172.21.15.73:0/3813076842 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6170152500 msgr2=0x7f61701515f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:23.600 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:23.599+0000 7f6175780640 1 --2- 172.21.15.73:0/3813076842 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6170152500 0x7f61701515f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:23.600 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:23.600+0000 7f6175780640 1 -- 172.21.15.73:0/3813076842 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f617006d350 msgr2=0x7f6170149b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:23.600 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:23.600+0000 7f6175780640 1 --2- 172.21.15.73:0/3813076842 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f617006d350 0x7f6170149b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:23.601 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:23.600+0000 7f6175780640 1 -- 172.21.15.73:0/3813076842 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61640094d0 con 0x7f617014f8c0 2023-12-12T09:46:23.601 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:23.600+0000 7f6175780640 1 --2- 172.21.15.73:0/3813076842 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f617014f8c0 0x7f61701dd680 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7f6164009870 tx=0x7f6164004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:46:23.602 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:23.600+0000 7f61627fc640 1 -- 172.21.15.73:0/3813076842 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6164030810 con 0x7f617014f8c0 2023-12-12T09:46:23.602 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:23.600+0000 7f61627fc640 1 -- 172.21.15.73:0/3813076842 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6164043400 con 0x7f617014f8c0 2023-12-12T09:46:23.602 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:23.600+0000 7f61627fc640 1 -- 172.21.15.73:0/3813076842 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61640437b0 con 0x7f617014f8c0 2023-12-12T09:46:23.602 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:23.600+0000 7f61781e5640 1 -- 172.21.15.73:0/3813076842 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61701dcba0 con 0x7f617014f8c0 2023-12-12T09:46:23.602 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:23.600+0000 7f61781e5640 1 -- 172.21.15.73:0/3813076842 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61701dd160 con 0x7f617014f8c0 2023-12-12T09:46:23.602 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:23.602+0000 7f61781e5640 1 -- 172.21.15.73:0/3813076842 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6170067070 con 0x7f617014f8c0 2023-12-12T09:46:23.603 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:23.602+0000 7f61627fc640 1 -- 172.21.15.73:0/3813076842 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f6164043910 con 0x7f617014f8c0 2023-12-12T09:46:23.604 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:23.603+0000 7f61627fc640 1 --2- 172.21.15.73:0/3813076842 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f615406ae40 0x7f615406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:23.604 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:23.603+0000 7f61627fc640 1 -- 172.21.15.73:0/3813076842 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f616403e070 con 0x7f617014f8c0 2023-12-12T09:46:23.604 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:23.603+0000 7f6175f81640 1 --2- 172.21.15.73:0/3813076842 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f615406ae40 0x7f615406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:23.604 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:23.604+0000 7f6175f81640 1 --2- 172.21.15.73:0/3813076842 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f615406ae40 0x7f615406d300 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f616c001560 tx=0x7f616c007990 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:46:23.608 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:23.608+0000 7f61627fc640 1 -- 172.21.15.73:0/3813076842 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f6164077ac0 con 0x7f617014f8c0 2023-12-12T09:46:23.799 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:23.798+0000 7f61781e5640 1 -- 172.21.15.73:0/3813076842 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f6170067580 con 0x7f617014f8c0 2023-12-12T09:46:23.799 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:23.799+0000 7f61627fc640 1 -- 172.21.15.73:0/3813076842 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v71) v1 ==== 93+0+10 (secure 0 0 0) 0x7f616407b0e0 con 0x7f617014f8c0 2023-12-12T09:46:23.800 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 1 2023-12-12T09:46:23.802 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:23.801+0000 7f61781e5640 1 -- 172.21.15.73:0/3813076842 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f615406ae40 msgr2=0x7f615406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:23.802 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:23.801+0000 7f61781e5640 1 --2- 172.21.15.73:0/3813076842 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f615406ae40 0x7f615406d300 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f616c001560 tx=0x7f616c007990 comp rx=0 tx=0).stop 2023-12-12T09:46:23.802 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:23.802+0000 7f61781e5640 1 -- 172.21.15.73:0/3813076842 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f617014f8c0 msgr2=0x7f61701dd680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:23.802 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:23.802+0000 7f61781e5640 1 --2- 172.21.15.73:0/3813076842 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f617014f8c0 0x7f61701dd680 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7f6164009870 tx=0x7f6164004730 comp rx=0 tx=0).stop 2023-12-12T09:46:23.802 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:23.802+0000 7f61781e5640 1 -- 172.21.15.73:0/3813076842 shutdown_connections 2023-12-12T09:46:23.803 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:23.802+0000 7f61781e5640 1 --2- 172.21.15.73:0/3813076842 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f615406ae40 0x7f615406d300 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:23.803 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:23.802+0000 7f61781e5640 1 --2- 172.21.15.73:0/3813076842 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6170152500 0x7f61701515f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:23.803 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:23.802+0000 7f61781e5640 1 --2- 172.21.15.73:0/3813076842 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f617014f8c0 0x7f61701dd680 unknown :-1 s=CLOSED pgs=854 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:23.803 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:23.802+0000 7f61781e5640 1 --2- 172.21.15.73:0/3813076842 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f617006d350 0x7f6170149b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:23.803 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:23.802+0000 7f61781e5640 1 -- 172.21.15.73:0/3813076842 >> 172.21.15.73:0/3813076842 conn(0x7f617006a4e0 msgr2=0x7f61700c59a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:46:23.803 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:23.802+0000 7f61781e5640 1 -- 172.21.15.73:0/3813076842 shutdown_connections 2023-12-12T09:46:23.803 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:23.802+0000 7f61781e5640 1 -- 172.21.15.73:0/3813076842 wait complete. 2023-12-12T09:46:23.819 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-12-12T09:46:24.030 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:24.029+0000 7ff4b3c7c640 1 Processor -- start 2023-12-12T09:46:24.030 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:24.029+0000 7ff4b3c7c640 1 -- start start 2023-12-12T09:46:24.031 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:24.030+0000 7ff4b3c7c640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7ff4ac1552e0 0x7ff4ac0c49c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:24.032 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:24.030+0000 7ff4b3c7c640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7ff4ac0a50f0 0x7ff4ac0a9050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:24.032 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:24.031+0000 7ff4b3c7c640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff4ac06bf20 0x7ff4ac0a9590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:24.032 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:24.031+0000 7ff4b3c7c640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4ac0c04d0 con 0x7ff4ac1552e0 2023-12-12T09:46:24.032 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:24.031+0000 7ff4b3c7c640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4ac0c0b50 con 0x7ff4ac0a50f0 2023-12-12T09:46:24.032 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:24.031+0000 7ff4b3c7c640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4ac06c880 con 0x7ff4ac06bf20 2023-12-12T09:46:24.032 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:24.031+0000 7ff4b1a18640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7ff4ac1552e0 0x7ff4ac0c49c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:24.032 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:24.031+0000 7ff4b1a18640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7ff4ac1552e0 0x7ff4ac0c49c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:54910/0 (socket says 172.21.15.73:54910) 2023-12-12T09:46:24.032 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:24.031+0000 7ff4b1a18640 1 -- 172.21.15.73:0/3033978151 learned_addr learned my addr 172.21.15.73:0/3033978151 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:46:24.032 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:24.031+0000 7ff4b1a18640 1 -- 172.21.15.73:0/3033978151 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff4ac06bf20 msgr2=0x7ff4ac0a9590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:46:24.032 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:24.031+0000 7ff4b1a18640 1 --2- 172.21.15.73:0/3033978151 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff4ac06bf20 0x7ff4ac0a9590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:24.032 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:24.031+0000 7ff4b1a18640 1 -- 172.21.15.73:0/3033978151 >> v2:172.21.15.142:3300/0 conn(0x7ff4ac0a50f0 msgr2=0x7ff4ac0a9050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:46:24.032 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:24.031+0000 7ff4b1a18640 1 --2- 172.21.15.73:0/3033978151 >> v2:172.21.15.142:3300/0 conn(0x7ff4ac0a50f0 0x7ff4ac0a9050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:24.032 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:24.031+0000 7ff4b1a18640 1 -- 172.21.15.73:0/3033978151 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4ac06cb60 con 0x7ff4ac1552e0 2023-12-12T09:46:24.033 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:24.032+0000 7ff4b1a18640 1 --2- 172.21.15.73:0/3033978151 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff4ac1552e0 0x7ff4ac0c49c0 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7ff4ac072230 tx=0x7ff4a802e050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82e249fd21482bee server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:46:24.033 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:24.033+0000 7ff4b0a16640 1 -- 172.21.15.73:0/3033978151 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4a802e9f0 con 0x7ff4ac1552e0 2023-12-12T09:46:24.033 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:24.033+0000 7ff4b0a16640 1 -- 172.21.15.73:0/3033978151 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4a802eb50 con 0x7ff4ac1552e0 2023-12-12T09:46:24.033 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:24.033+0000 7ff4b0a16640 1 -- 172.21.15.73:0/3033978151 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4a8009600 con 0x7ff4ac1552e0 2023-12-12T09:46:24.034 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:24.033+0000 7ff4b3c7c640 1 -- 172.21.15.73:0/3033978151 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff4ac1552e0 msgr2=0x7ff4ac0c49c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:24.034 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:24.033+0000 7ff4b3c7c640 1 --2- 172.21.15.73:0/3033978151 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff4ac1552e0 0x7ff4ac0c49c0 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7ff4ac072230 tx=0x7ff4a802e050 comp rx=0 tx=0).stop 2023-12-12T09:46:24.035 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:24.034+0000 7ff4b3c7c640 1 -- 172.21.15.73:0/3033978151 shutdown_connections 2023-12-12T09:46:24.035 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:24.034+0000 7ff4b3c7c640 1 --2- 172.21.15.73:0/3033978151 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff4ac06bf20 0x7ff4ac0a9590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:24.035 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:24.034+0000 7ff4b3c7c640 1 --2- 172.21.15.73:0/3033978151 >> v2:172.21.15.142:3300/0 conn(0x7ff4ac0a50f0 0x7ff4ac0a9050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:24.035 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:24.034+0000 7ff4b3c7c640 1 --2- 172.21.15.73:0/3033978151 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff4ac1552e0 0x7ff4ac0c49c0 unknown :-1 s=CLOSED pgs=855 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:24.035 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:24.034+0000 7ff4b3c7c640 1 -- 172.21.15.73:0/3033978151 >> 172.21.15.73:0/3033978151 conn(0x7ff4ac0a8130 msgr2=0x7ff4ac0c24b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:46:24.035 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:24.034+0000 7ff4b3c7c640 1 -- 172.21.15.73:0/3033978151 shutdown_connections 2023-12-12T09:46:24.035 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:24.034+0000 7ff4b3c7c640 1 -- 172.21.15.73:0/3033978151 wait complete. 2023-12-12T09:46:24.036 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:24.035+0000 7ff4b3c7c640 1 Processor -- start 2023-12-12T09:46:24.036 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:24.035+0000 7ff4b3c7c640 1 -- start start 2023-12-12T09:46:24.038 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:24.036+0000 7ff4b3c7c640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff4ac06bf20 0x7ff4ac1ed480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:24.038 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:24.036+0000 7ff4b3c7c640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff4ac0a50f0 0x7ff4ac1eb110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:24.038 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:24.036+0000 7ff4b3c7c640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff4ac1552e0 0x7ff4ac1eb650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:24.038 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:24.036+0000 7ff4b3c7c640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4ac14dcb0 con 0x7ff4ac1552e0 2023-12-12T09:46:24.038 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:24.036+0000 7ff4b3c7c640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4ac14df70 con 0x7ff4ac06bf20 2023-12-12T09:46:24.038 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:24.036+0000 7ff4b3c7c640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4ac071790 con 0x7ff4ac0a50f0 2023-12-12T09:46:24.038 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:24.037+0000 7ff4b2219640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff4ac1552e0 0x7ff4ac1eb650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:24.039 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:24.037+0000 7ff4b2219640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff4ac1552e0 0x7ff4ac1eb650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:54926/0 (socket says 172.21.15.73:54926) 2023-12-12T09:46:24.039 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:24.037+0000 7ff4b2219640 1 -- 172.21.15.73:0/3327480444 learned_addr learned my addr 172.21.15.73:0/3327480444 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:46:24.039 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:24.037+0000 7ff4b2219640 1 -- 172.21.15.73:0/3327480444 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff4ac0a50f0 msgr2=0x7ff4ac1eb110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:24.039 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:24.037+0000 7ff4b2219640 1 --2- 172.21.15.73:0/3327480444 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff4ac0a50f0 0x7ff4ac1eb110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:24.039 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:24.037+0000 7ff4b1a18640 1 --2- 172.21.15.73:0/3327480444 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff4ac06bf20 0x7ff4ac1ed480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:24.039 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:24.037+0000 7ff4b2219640 1 -- 172.21.15.73:0/3327480444 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff4ac06bf20 msgr2=0x7ff4ac1ed480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:24.039 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:24.037+0000 7ff4b2219640 1 --2- 172.21.15.73:0/3327480444 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff4ac06bf20 0x7ff4ac1ed480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:24.039 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:24.037+0000 7ff4b2219640 1 -- 172.21.15.73:0/3327480444 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4a800bd40 con 0x7ff4ac1552e0 2023-12-12T09:46:24.039 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:24.037+0000 7ff4b2219640 1 --2- 172.21.15.73:0/3327480444 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff4ac1552e0 0x7ff4ac1eb650 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7ff4a4009fd0 tx=0x7ff4a400b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:46:24.039 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:24.038+0000 7ff4a27fc640 1 -- 172.21.15.73:0/3327480444 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4a4011830 con 0x7ff4ac1552e0 2023-12-12T09:46:24.039 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:24.038+0000 7ff4a27fc640 1 -- 172.21.15.73:0/3327480444 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4a4011990 con 0x7ff4ac1552e0 2023-12-12T09:46:24.040 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:24.038+0000 7ff4a27fc640 1 -- 172.21.15.73:0/3327480444 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4a4011d20 con 0x7ff4ac1552e0 2023-12-12T09:46:24.040 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:24.038+0000 7ff4b3c7c640 1 -- 172.21.15.73:0/3327480444 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4ac071a70 con 0x7ff4ac1552e0 2023-12-12T09:46:24.040 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:24.038+0000 7ff4b3c7c640 1 -- 172.21.15.73:0/3327480444 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4ac1ed9c0 con 0x7ff4ac1552e0 2023-12-12T09:46:24.041 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:24.039+0000 7ff4b3c7c640 1 -- 172.21.15.73:0/3327480444 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4ac06cfd0 con 0x7ff4ac1552e0 2023-12-12T09:46:24.041 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:24.040+0000 7ff4a27fc640 1 -- 172.21.15.73:0/3327480444 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7ff4a401b460 con 0x7ff4ac1552e0 2023-12-12T09:46:24.042 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:24.040+0000 7ff4a27fc640 1 --2- 172.21.15.73:0/3327480444 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7ff49006ae40 0x7ff49006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:24.042 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:24.041+0000 7ff4a27fc640 1 -- 172.21.15.73:0/3327480444 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 4857+0+0 (secure 0 0 0) 0x7ff4a4089100 con 0x7ff4ac1552e0 2023-12-12T09:46:24.042 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:24.041+0000 7ff4b1a18640 1 --2- 172.21.15.73:0/3327480444 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7ff49006ae40 0x7ff49006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:24.043 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:24.041+0000 7ff4b1a18640 1 --2- 172.21.15.73:0/3327480444 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7ff49006ae40 0x7ff49006d300 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7ff4a8037000 tx=0x7ff4a8032000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:46:24.045 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:24.045+0000 7ff4a27fc640 1 -- 172.21.15.73:0/3327480444 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7ff4ac06cfd0 con 0x7ff4ac1552e0 2023-12-12T09:46:24.223 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:24.223+0000 7ff4b3c7c640 1 -- 172.21.15.73:0/3327480444 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7ff4ac0c1fd0 con 0x7ff4ac1552e0 2023-12-12T09:46:24.224 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:24.224+0000 7ff4a27fc640 1 -- 172.21.15.73:0/3327480444 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v71) v1 ==== 84+0+65 (secure 0 0 0) 0x7ff4ac0c1fd0 con 0x7ff4ac1552e0 2023-12-12T09:46:24.224 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-12T09:46:24.224 INFO:teuthology.orchestra.run.smithi073.stdout:[ 2023-12-12T09:46:24.224 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-12-12T09:46:24.225 INFO:teuthology.orchestra.run.smithi073.stdout: "poolnum": 1, 2023-12-12T09:46:24.225 INFO:teuthology.orchestra.run.smithi073.stdout: "poolname": ".mgr" 2023-12-12T09:46:24.225 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-12-12T09:46:24.225 INFO:teuthology.orchestra.run.smithi073.stdout:] 2023-12-12T09:46:24.227 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:24.226+0000 7ff4b3c7c640 1 -- 172.21.15.73:0/3327480444 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7ff49006ae40 msgr2=0x7ff49006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:24.227 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:24.226+0000 7ff4b3c7c640 1 --2- 172.21.15.73:0/3327480444 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7ff49006ae40 0x7ff49006d300 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7ff4a8037000 tx=0x7ff4a8032000 comp rx=0 tx=0).stop 2023-12-12T09:46:24.227 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:24.226+0000 7ff4b3c7c640 1 -- 172.21.15.73:0/3327480444 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff4ac1552e0 msgr2=0x7ff4ac1eb650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:24.227 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:24.226+0000 7ff4b3c7c640 1 --2- 172.21.15.73:0/3327480444 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff4ac1552e0 0x7ff4ac1eb650 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7ff4a4009fd0 tx=0x7ff4a400b8e0 comp rx=0 tx=0).stop 2023-12-12T09:46:24.227 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:24.226+0000 7ff4b3c7c640 1 -- 172.21.15.73:0/3327480444 shutdown_connections 2023-12-12T09:46:24.227 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:24.226+0000 7ff4b3c7c640 1 --2- 172.21.15.73:0/3327480444 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7ff49006ae40 0x7ff49006d300 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:24.228 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:24.226+0000 7ff4b3c7c640 1 --2- 172.21.15.73:0/3327480444 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff4ac1552e0 0x7ff4ac1eb650 unknown :-1 s=CLOSED pgs=856 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:24.228 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:24.226+0000 7ff4b3c7c640 1 --2- 172.21.15.73:0/3327480444 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff4ac0a50f0 0x7ff4ac1eb110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:24.228 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:24.226+0000 7ff4b3c7c640 1 --2- 172.21.15.73:0/3327480444 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff4ac06bf20 0x7ff4ac1ed480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:24.228 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:24.226+0000 7ff4b3c7c640 1 -- 172.21.15.73:0/3327480444 >> 172.21.15.73:0/3327480444 conn(0x7ff4ac0a8130 msgr2=0x7ff4ac0a6ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:46:24.228 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:24.226+0000 7ff4b3c7c640 1 -- 172.21.15.73:0/3327480444 shutdown_connections 2023-12-12T09:46:24.228 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:24.226+0000 7ff4b3c7c640 1 -- 172.21.15.73:0/3327480444 wait complete. 2023-12-12T09:46:24.246 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-12-12T09:46:24.246 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-12-12T09:46:24.458 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:24.458+0000 7f7edf1e5640 1 Processor -- start 2023-12-12T09:46:24.458 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:24.458+0000 7f7edf1e5640 1 -- start start 2023-12-12T09:46:24.460 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:24.459+0000 7f7edf1e5640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f7ed81553d0 0x7f7ed8157c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:24.460 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:24.459+0000 7f7edf1e5640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f7ed80c4d50 0x7f7ed806a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:24.460 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:24.459+0000 7f7edf1e5640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ed81557b0 con 0x7f7ed806aa20 2023-12-12T09:46:24.460 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:24.459+0000 7f7edf1e5640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ed8158b30 con 0x7f7ed81553d0 2023-12-12T09:46:24.460 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:24.459+0000 7f7edf1e5640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ed80c60d0 con 0x7f7ed80c4d50 2023-12-12T09:46:24.461 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:24.459+0000 7f7edcf81640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f7ed81553d0 0x7f7ed8157c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:24.461 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:24.459+0000 7f7edd782640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f7ed806aa20 0x7f7ed80c2320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:53792/0 (socket says 172.21.15.73:53792) 2023-12-12T09:46:24.461 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:24.459+0000 7f7edd782640 1 -- 172.21.15.73:0/1936671666 learned_addr learned my addr 172.21.15.73:0/1936671666 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-12T09:46:24.461 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:24.460+0000 7f7ed7fff640 1 --2- 172.21.15.73:0/1936671666 >> v2:172.21.15.142:3300/0 conn(0x7f7ed80c4d50 0x7f7ed806a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:24.461 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:24.460+0000 7f7edcf81640 1 -- 172.21.15.73:0/1936671666 >> v2:172.21.15.142:3300/0 conn(0x7f7ed80c4d50 msgr2=0x7f7ed806a4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:46:24.461 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:24.460+0000 7f7edcf81640 1 --2- 172.21.15.73:0/1936671666 >> v2:172.21.15.142:3300/0 conn(0x7f7ed80c4d50 0x7f7ed806a4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:24.461 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:24.460+0000 7f7edcf81640 1 -- 172.21.15.73:0/1936671666 >> v1:172.21.15.73:6789/0 conn(0x7f7ed806aa20 legacy=0x7f7ed80c2320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:24.461 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:24.460+0000 7f7edcf81640 1 -- 172.21.15.73:0/1936671666 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ed80c1e90 con 0x7f7ed81553d0 2023-12-12T09:46:24.461 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:24.460+0000 7f7ed77fe640 1 -- 172.21.15.73:0/1936671666 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3677528693 0 0) 0x7f7ed81557b0 con 0x7f7ed806aa20 2023-12-12T09:46:24.461 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:24.460+0000 7f7ed7fff640 1 --2- 172.21.15.73:0/1936671666 >> v2:172.21.15.142:3300/0 conn(0x7f7ed80c4d50 0x7f7ed806a4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:46:24.462 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:24.461+0000 7f7edcf81640 1 --2- 172.21.15.73:0/1936671666 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7ed81553d0 0x7f7ed8157c00 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7f7ed8070e10 tx=0x7f7ec802bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e424222aeff19d95 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:46:24.463 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:24.461+0000 7f7ed77fe640 1 -- 172.21.15.73:0/1936671666 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ec802cc80 con 0x7f7ed81553d0 2023-12-12T09:46:24.463 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:24.461+0000 7f7ed77fe640 1 -- 172.21.15.73:0/1936671666 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ec802cde0 con 0x7f7ed81553d0 2023-12-12T09:46:24.463 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:24.461+0000 7f7ed77fe640 1 -- 172.21.15.73:0/1936671666 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ec8034660 con 0x7f7ed81553d0 2023-12-12T09:46:24.463 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:24.462+0000 7f7edf1e5640 1 -- 172.21.15.73:0/1936671666 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7ed81553d0 msgr2=0x7f7ed8157c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:24.463 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:24.462+0000 7f7edf1e5640 1 --2- 172.21.15.73:0/1936671666 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7ed81553d0 0x7f7ed8157c00 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7f7ed8070e10 tx=0x7f7ec802bed0 comp rx=0 tx=0).stop 2023-12-12T09:46:24.463 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:24.462+0000 7f7edf1e5640 1 -- 172.21.15.73:0/1936671666 shutdown_connections 2023-12-12T09:46:24.463 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:24.462+0000 7f7edf1e5640 1 --2- 172.21.15.73:0/1936671666 >> v2:172.21.15.142:3300/0 conn(0x7f7ed80c4d50 0x7f7ed806a4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:24.463 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:24.462+0000 7f7edf1e5640 1 --2- 172.21.15.73:0/1936671666 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7ed81553d0 0x7f7ed8157c00 unknown :-1 s=CLOSED pgs=858 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:24.463 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:24.462+0000 7f7edf1e5640 1 -- 172.21.15.73:0/1936671666 >> 172.21.15.73:0/1936671666 conn(0x7f7ed80c6ab0 msgr2=0x7f7ed80c6e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:46:24.463 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:24.462+0000 7f7edf1e5640 1 -- 172.21.15.73:0/1936671666 shutdown_connections 2023-12-12T09:46:24.463 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:24.462+0000 7f7edf1e5640 1 -- 172.21.15.73:0/1936671666 wait complete. 2023-12-12T09:46:24.464 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:24.464+0000 7f7edf1e5640 1 Processor -- start 2023-12-12T09:46:24.464 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:24.464+0000 7f7edf1e5640 1 -- start start 2023-12-12T09:46:24.466 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:24.464+0000 7f7edf1e5640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7ed806aa20 0x7f7ed8157820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:24.466 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:24.465+0000 7f7edf1e5640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7ed80c4d50 0x7f7ed814eb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:24.467 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:24.465+0000 7f7edf1e5640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7ed81553d0 0x7f7ed814f060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:24.467 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:24.465+0000 7f7edf1e5640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ed81ea850 con 0x7f7ed806aa20 2023-12-12T09:46:24.467 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:24.465+0000 7f7edf1e5640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ed809acc0 con 0x7f7ed81553d0 2023-12-12T09:46:24.467 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:24.465+0000 7f7edf1e5640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ed81e9bd0 con 0x7f7ed80c4d50 2023-12-12T09:46:24.467 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:24.465+0000 7f7edcf81640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7ed806aa20 0x7f7ed8157820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:24.467 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:24.465+0000 7f7edcf81640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7ed806aa20 0x7f7ed8157820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:54938/0 (socket says 172.21.15.73:54938) 2023-12-12T09:46:24.467 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:24.465+0000 7f7edcf81640 1 -- 172.21.15.73:0/1851696206 learned_addr learned my addr 172.21.15.73:0/1851696206 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:46:24.467 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:24.465+0000 7f7edcf81640 1 -- 172.21.15.73:0/1851696206 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7ed80c4d50 msgr2=0x7f7ed814eb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:24.467 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:24.465+0000 7f7edcf81640 1 --2- 172.21.15.73:0/1851696206 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7ed80c4d50 0x7f7ed814eb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:24.467 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:24.465+0000 7f7edcf81640 1 -- 172.21.15.73:0/1851696206 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7ed81553d0 msgr2=0x7f7ed814f060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:24.467 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:24.465+0000 7f7edcf81640 1 --2- 172.21.15.73:0/1851696206 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7ed81553d0 0x7f7ed814f060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:24.467 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:24.465+0000 7f7edcf81640 1 -- 172.21.15.73:0/1851696206 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ec8009a70 con 0x7f7ed806aa20 2023-12-12T09:46:24.467 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:24.466+0000 7f7edcf81640 1 --2- 172.21.15.73:0/1851696206 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7ed806aa20 0x7f7ed8157820 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7f7ec8009e80 tx=0x7f7ec8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:46:24.467 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:24.466+0000 7f7ed57fa640 1 -- 172.21.15.73:0/1851696206 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ec8003b90 con 0x7f7ed806aa20 2023-12-12T09:46:24.468 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:24.466+0000 7f7ed57fa640 1 -- 172.21.15.73:0/1851696206 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ec8003cf0 con 0x7f7ed806aa20 2023-12-12T09:46:24.468 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:24.466+0000 7f7edf1e5640 1 -- 172.21.15.73:0/1851696206 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ed81e9eb0 con 0x7f7ed806aa20 2023-12-12T09:46:24.468 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:24.466+0000 7f7ed57fa640 1 -- 172.21.15.73:0/1851696206 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ec8004260 con 0x7f7ed806aa20 2023-12-12T09:46:24.468 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:24.466+0000 7f7edf1e5640 1 -- 172.21.15.73:0/1851696206 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ed81ea470 con 0x7f7ed806aa20 2023-12-12T09:46:24.468 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:24.467+0000 7f7edf1e5640 1 -- 172.21.15.73:0/1851696206 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ed8072a90 con 0x7f7ed806aa20 2023-12-12T09:46:24.468 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:24.468+0000 7f7ed57fa640 1 -- 172.21.15.73:0/1851696206 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f7ec803b050 con 0x7f7ed806aa20 2023-12-12T09:46:24.470 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:24.469+0000 7f7ed57fa640 1 --2- 172.21.15.73:0/1851696206 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f7eb806ae40 0x7f7eb806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:24.470 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:24.469+0000 7f7ed57fa640 1 -- 172.21.15.73:0/1851696206 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f7ec80ab9d0 con 0x7f7ed806aa20 2023-12-12T09:46:24.470 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:24.469+0000 7f7ed7fff640 1 --2- 172.21.15.73:0/1851696206 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f7eb806ae40 0x7f7eb806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:24.470 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:24.470+0000 7f7ed7fff640 1 --2- 172.21.15.73:0/1851696206 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f7eb806ae40 0x7f7eb806d300 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f7ec0006fd0 tx=0x7f7ec0008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:46:24.473 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:24.473+0000 7f7ed57fa640 1 -- 172.21.15.73:0/1851696206 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f7ec8076dc0 con 0x7f7ed806aa20 2023-12-12T09:46:24.663 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:24.662+0000 7f7edf1e5640 1 -- 172.21.15.73:0/1851696206 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f7ed81ea990 con 0x7f7ed806aa20 2023-12-12T09:46:24.941 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:24.940+0000 7f7ed57fa640 1 -- 172.21.15.73:0/1851696206 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v72) v1 ==== 138+0+0 (secure 0 0 0) 0x7f7ed81ea990 con 0x7f7ed806aa20 2023-12-12T09:46:24.941 INFO:teuthology.orchestra.run.smithi073.stderr:pool 'cephfs_metadata' created 2023-12-12T09:46:24.945 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:24.944+0000 7f7edf1e5640 1 -- 172.21.15.73:0/1851696206 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f7eb806ae40 msgr2=0x7f7eb806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:24.945 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:24.944+0000 7f7edf1e5640 1 --2- 172.21.15.73:0/1851696206 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f7eb806ae40 0x7f7eb806d300 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f7ec0006fd0 tx=0x7f7ec0008040 comp rx=0 tx=0).stop 2023-12-12T09:46:24.945 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:24.944+0000 7f7edf1e5640 1 -- 172.21.15.73:0/1851696206 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7ed806aa20 msgr2=0x7f7ed8157820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:24.945 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:24.944+0000 7f7edf1e5640 1 --2- 172.21.15.73:0/1851696206 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7ed806aa20 0x7f7ed8157820 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7f7ec8009e80 tx=0x7f7ec8004a40 comp rx=0 tx=0).stop 2023-12-12T09:46:24.945 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:24.945+0000 7f7edf1e5640 1 -- 172.21.15.73:0/1851696206 shutdown_connections 2023-12-12T09:46:24.946 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:24.945+0000 7f7edf1e5640 1 --2- 172.21.15.73:0/1851696206 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f7eb806ae40 0x7f7eb806d300 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:24.946 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:24.945+0000 7f7edf1e5640 1 --2- 172.21.15.73:0/1851696206 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7ed81553d0 0x7f7ed814f060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:24.946 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:24.945+0000 7f7edf1e5640 1 --2- 172.21.15.73:0/1851696206 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7ed80c4d50 0x7f7ed814eb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:24.946 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:24.945+0000 7f7edf1e5640 1 --2- 172.21.15.73:0/1851696206 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7ed806aa20 0x7f7ed8157820 unknown :-1 s=CLOSED pgs=859 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:24.946 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:24.945+0000 7f7edf1e5640 1 -- 172.21.15.73:0/1851696206 >> 172.21.15.73:0/1851696206 conn(0x7f7ed80c6ab0 msgr2=0x7f7ed80c2320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:46:24.946 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:24.945+0000 7f7edf1e5640 1 -- 172.21.15.73:0/1851696206 shutdown_connections 2023-12-12T09:46:24.946 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:24.945+0000 7f7edf1e5640 1 -- 172.21.15.73:0/1851696206 wait complete. 2023-12-12T09:46:24.972 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-12-12T09:46:25.175 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:25.174+0000 7f679fcbb640 1 Processor -- start 2023-12-12T09:46:25.175 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:25.174+0000 7f679fcbb640 1 -- start start 2023-12-12T09:46:25.176 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:25.176+0000 7f679fcbb640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f67980a4c90 0x7f67980c5420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:25.176 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:25.176+0000 7f679fcbb640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67980c3390 con 0x7f679814ea60 2023-12-12T09:46:25.176 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:25.176+0000 7f679fcbb640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67980c4b30 con 0x7f67980c0320 2023-12-12T09:46:25.176 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:25.176+0000 7f679fcbb640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67980c0750 con 0x7f67980a4c90 2023-12-12T09:46:25.177 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:25.176+0000 7f679da57640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f679814ea60 0x7f67980c4420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:53802/0 (socket says 172.21.15.73:53802) 2023-12-12T09:46:25.177 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:25.176+0000 7f679da57640 1 -- 172.21.15.73:0/4180295535 learned_addr learned my addr 172.21.15.73:0/4180295535 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-12T09:46:25.179 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:25.176+0000 7f679ca55640 1 -- 172.21.15.73:0/4180295535 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1188034909 0 0) 0x7f67980c3390 con 0x7f679814ea60 2023-12-12T09:46:25.179 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:25.177+0000 7f679d256640 1 --2- 172.21.15.73:0/4180295535 >> v2:172.21.15.142:3300/0 conn(0x7f67980a4c90 0x7f67980c5420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:25.179 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:25.177+0000 7f679ca55640 1 -- 172.21.15.73:0/4180295535 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6784003520 con 0x7f679814ea60 2023-12-12T09:46:25.179 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:25.177+0000 7f679ca55640 1 -- 172.21.15.73:0/4180295535 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1735134044 0 0) 0x7f6784003520 con 0x7f679814ea60 2023-12-12T09:46:25.179 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:25.177+0000 7f679ca55640 1 -- 172.21.15.73:0/4180295535 >> v2:172.21.15.142:3300/0 conn(0x7f67980a4c90 msgr2=0x7f67980c5420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:46:25.179 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:25.177+0000 7f679ca55640 1 --2- 172.21.15.73:0/4180295535 >> v2:172.21.15.142:3300/0 conn(0x7f67980a4c90 0x7f67980c5420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:25.179 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:25.177+0000 7f679ca55640 1 -- 172.21.15.73:0/4180295535 >> v1:172.21.15.142:6789/0 conn(0x7f67980c0320 legacy=0x7f67980c20b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:46:25.179 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:25.177+0000 7f679ca55640 1 -- 172.21.15.73:0/4180295535 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6798151e60 con 0x7f679814ea60 2023-12-12T09:46:25.179 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:25.177+0000 7f679ca55640 1 -- 172.21.15.73:0/4180295535 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3186547832 0 0) 0x7f6794001670 con 0x7f679814ea60 2023-12-12T09:46:25.179 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:25.177+0000 7f679ca55640 1 -- 172.21.15.73:0/4180295535 >> v1:172.21.15.73:6789/0 conn(0x7f679814ea60 legacy=0x7f67980c4420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:25.179 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:25.177+0000 7f679ca55640 1 --2- 172.21.15.73:0/4180295535 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6784003970 0x7f6784003d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:25.179 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:25.177+0000 7f679ca55640 1 --2- 172.21.15.73:0/4180295535 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f67840047c0 0x7f6784004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:25.179 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:25.177+0000 7f679ca55640 1 --2- 172.21.15.73:0/4180295535 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6784005180 0x7f678400db90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:25.180 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:25.177+0000 7f679ca55640 1 -- 172.21.15.73:0/4180295535 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f678400e290 con 0x7f67840047c0 2023-12-12T09:46:25.180 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:25.177+0000 7f679ca55640 1 -- 172.21.15.73:0/4180295535 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f678400e400 con 0x7f6784003970 2023-12-12T09:46:25.180 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:25.177+0000 7f679ca55640 1 -- 172.21.15.73:0/4180295535 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f678400e5c0 con 0x7f6784005180 2023-12-12T09:46:25.180 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:25.177+0000 7f679d256640 1 --2- 172.21.15.73:0/4180295535 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f67840047c0 0x7f6784004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:25.180 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:25.178+0000 7f679da57640 1 --2- 172.21.15.73:0/4180295535 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6784003970 0x7f6784003d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:25.180 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:25.178+0000 7f679d256640 1 -- 172.21.15.73:0/4180295535 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6784005180 msgr2=0x7f678400db90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:46:25.180 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:25.178+0000 7f679d256640 1 --2- 172.21.15.73:0/4180295535 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6784005180 0x7f678400db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:25.180 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:25.178+0000 7f679d256640 1 -- 172.21.15.73:0/4180295535 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6784003970 msgr2=0x7f6784003d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:46:25.180 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:25.178+0000 7f679d256640 1 --2- 172.21.15.73:0/4180295535 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6784003970 0x7f6784003d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:25.180 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:25.178+0000 7f679d256640 1 -- 172.21.15.73:0/4180295535 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6784003520 con 0x7f67840047c0 2023-12-12T09:46:25.180 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:25.178+0000 7f679e258640 1 -- 172.21.15.73:0/4180295535 reap_dead start 2023-12-12T09:46:25.181 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:25.179+0000 7f679d256640 1 --2- 172.21.15.73:0/4180295535 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f67840047c0 0x7f6784004c40 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7f6788009ac0 tx=0x7f67840057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16e7947e9fee0136 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:46:25.182 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:25.179+0000 7f679ca55640 1 -- 172.21.15.73:0/4180295535 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f678802c6b0 con 0x7f67840047c0 2023-12-12T09:46:25.182 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:25.179+0000 7f679ca55640 1 -- 172.21.15.73:0/4180295535 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f678802c810 con 0x7f67840047c0 2023-12-12T09:46:25.182 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:25.179+0000 7f679ca55640 1 -- 172.21.15.73:0/4180295535 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f678802cba0 con 0x7f67840047c0 2023-12-12T09:46:25.182 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:25.180+0000 7f679fcbb640 1 -- 172.21.15.73:0/4180295535 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f67840047c0 msgr2=0x7f6784004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:25.182 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:25.180+0000 7f679fcbb640 1 --2- 172.21.15.73:0/4180295535 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f67840047c0 0x7f6784004c40 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7f6788009ac0 tx=0x7f67840057f0 comp rx=0 tx=0).stop 2023-12-12T09:46:25.182 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:25.180+0000 7f679fcbb640 1 -- 172.21.15.73:0/4180295535 shutdown_connections 2023-12-12T09:46:25.182 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:25.180+0000 7f679fcbb640 1 --2- 172.21.15.73:0/4180295535 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f67840047c0 0x7f6784004c40 unknown :-1 s=CLOSED pgs=861 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:25.182 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:25.180+0000 7f679fcbb640 1 -- 172.21.15.73:0/4180295535 >> 172.21.15.73:0/4180295535 conn(0x7f679806a4e0 msgr2=0x7f679806a8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:46:25.182 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:25.180+0000 7f679fcbb640 1 -- 172.21.15.73:0/4180295535 shutdown_connections 2023-12-12T09:46:25.182 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:25.180+0000 7f679fcbb640 1 -- 172.21.15.73:0/4180295535 wait complete. 2023-12-12T09:46:25.184 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:25.182+0000 7f679fcbb640 1 Processor -- start 2023-12-12T09:46:25.184 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:25.182+0000 7f679fcbb640 1 -- start start 2023-12-12T09:46:25.185 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:25.183+0000 7f679fcbb640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f67840047c0 0x7f679806cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:25.185 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:25.183+0000 7f679fcbb640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f679814a160 0x7f6798150230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:25.185 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:25.183+0000 7f679fcbb640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6798150770 0x7f6798148aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:25.185 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:25.183+0000 7f679fcbb640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f679814ce40 con 0x7f679814a160 2023-12-12T09:46:25.185 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:25.183+0000 7f679fcbb640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6798149f10 con 0x7f67840047c0 2023-12-12T09:46:25.185 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:25.183+0000 7f679fcbb640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6798149c30 con 0x7f6798150770 2023-12-12T09:46:25.185 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:25.183+0000 7f679d256640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f679814a160 0x7f6798150230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:25.185 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:25.183+0000 7f679d256640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f679814a160 0x7f6798150230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:54964/0 (socket says 172.21.15.73:54964) 2023-12-12T09:46:25.185 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:25.183+0000 7f679d256640 1 -- 172.21.15.73:0/1131444573 learned_addr learned my addr 172.21.15.73:0/1131444573 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:46:25.185 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:25.183+0000 7f679e258640 1 --2- 172.21.15.73:0/1131444573 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6798150770 0x7f6798148aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:25.185 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:25.183+0000 7f679d256640 1 -- 172.21.15.73:0/1131444573 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6798150770 msgr2=0x7f6798148aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:25.185 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:25.183+0000 7f679da57640 1 --2- 172.21.15.73:0/1131444573 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f67840047c0 0x7f679806cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:25.185 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:25.183+0000 7f679d256640 1 --2- 172.21.15.73:0/1131444573 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6798150770 0x7f6798148aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:25.185 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:25.183+0000 7f679d256640 1 -- 172.21.15.73:0/1131444573 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f67840047c0 msgr2=0x7f679806cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:25.186 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:25.183+0000 7f679d256640 1 --2- 172.21.15.73:0/1131444573 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f67840047c0 0x7f679806cf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:25.186 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:25.183+0000 7f679d256640 1 -- 172.21.15.73:0/1131444573 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f679814cb60 con 0x7f679814a160 2023-12-12T09:46:25.186 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:25.183+0000 7f679da57640 1 --2- 172.21.15.73:0/1131444573 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f67840047c0 0x7f679806cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:46:25.186 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:25.184+0000 7f679d256640 1 --2- 172.21.15.73:0/1131444573 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f679814a160 0x7f6798150230 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7f678802c250 tx=0x7f6788004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:46:25.186 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:25.184+0000 7f678e7fc640 1 -- 172.21.15.73:0/1131444573 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6788003810 con 0x7f679814a160 2023-12-12T09:46:25.186 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:25.184+0000 7f678e7fc640 1 -- 172.21.15.73:0/1131444573 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6788003970 con 0x7f679814a160 2023-12-12T09:46:25.186 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:25.184+0000 7f679fcbb640 1 -- 172.21.15.73:0/1131444573 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f67980a9b40 con 0x7f679814a160 2023-12-12T09:46:25.186 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:25.184+0000 7f678e7fc640 1 -- 172.21.15.73:0/1131444573 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6788003d00 con 0x7f679814a160 2023-12-12T09:46:25.186 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:25.184+0000 7f679fcbb640 1 -- 172.21.15.73:0/1131444573 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f679806d440 con 0x7f679814a160 2023-12-12T09:46:25.186 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:25.185+0000 7f679fcbb640 1 -- 172.21.15.73:0/1131444573 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6798067070 con 0x7f679814a160 2023-12-12T09:46:25.187 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:25.187+0000 7f678e7fc640 1 -- 172.21.15.73:0/1131444573 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f6788047450 con 0x7f679814a160 2023-12-12T09:46:25.188 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:25.188+0000 7f678e7fc640 1 --2- 172.21.15.73:0/1131444573 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f677c06ae40 0x7f677c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:25.188 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:25.188+0000 7f678e7fc640 1 -- 172.21.15.73:0/1131444573 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 5227+0+0 (secure 0 0 0) 0x7f67880ab7f0 con 0x7f679814a160 2023-12-12T09:46:25.188 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:25.188+0000 7f679da57640 1 --2- 172.21.15.73:0/1131444573 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f677c06ae40 0x7f677c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:25.189 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:25.189+0000 7f679da57640 1 --2- 172.21.15.73:0/1131444573 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f677c06ae40 0x7f677c06d300 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f6798069160 tx=0x7f6794009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:46:25.193 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:25.193+0000 7f678e7fc640 1 -- 172.21.15.73:0/1131444573 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f6788076bb0 con 0x7f679814a160 2023-12-12T09:46:25.386 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:25.385+0000 7f679fcbb640 1 -- 172.21.15.73:0/1131444573 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f6798067580 con 0x7f679814a160 2023-12-12T09:46:25.959 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:25.958+0000 7f678e7fc640 1 -- 172.21.15.73:0/1131444573 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v73) v1 ==== 170+0+0 (secure 0 0 0) 0x7f6788003e60 con 0x7f679814a160 2023-12-12T09:46:25.959 INFO:teuthology.orchestra.run.smithi073.stderr:pool 'cephfs_data' created 2023-12-12T09:46:25.962 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:25.962+0000 7f679fcbb640 1 -- 172.21.15.73:0/1131444573 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f677c06ae40 msgr2=0x7f677c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:25.963 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:25.962+0000 7f679fcbb640 1 --2- 172.21.15.73:0/1131444573 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f677c06ae40 0x7f677c06d300 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f6798069160 tx=0x7f6794009040 comp rx=0 tx=0).stop 2023-12-12T09:46:25.963 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:25.962+0000 7f679fcbb640 1 -- 172.21.15.73:0/1131444573 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f679814a160 msgr2=0x7f6798150230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:25.963 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:25.962+0000 7f679fcbb640 1 --2- 172.21.15.73:0/1131444573 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f679814a160 0x7f6798150230 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7f678802c250 tx=0x7f6788004730 comp rx=0 tx=0).stop 2023-12-12T09:46:25.963 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:25.962+0000 7f679fcbb640 1 -- 172.21.15.73:0/1131444573 shutdown_connections 2023-12-12T09:46:25.963 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:25.962+0000 7f679fcbb640 1 --2- 172.21.15.73:0/1131444573 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f677c06ae40 0x7f677c06d300 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:25.963 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:25.962+0000 7f679fcbb640 1 --2- 172.21.15.73:0/1131444573 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6798150770 0x7f6798148aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:25.963 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:25.962+0000 7f679fcbb640 1 --2- 172.21.15.73:0/1131444573 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f679814a160 0x7f6798150230 unknown :-1 s=CLOSED pgs=862 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:25.964 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:25.962+0000 7f679fcbb640 1 --2- 172.21.15.73:0/1131444573 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f67840047c0 0x7f679806cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:25.964 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:25.962+0000 7f679fcbb640 1 -- 172.21.15.73:0/1131444573 >> 172.21.15.73:0/1131444573 conn(0x7f679806a4e0 msgr2=0x7f67980c0750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:46:25.964 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:25.963+0000 7f679fcbb640 1 -- 172.21.15.73:0/1131444573 shutdown_connections 2023-12-12T09:46:25.964 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:25.963+0000 7f679fcbb640 1 -- 172.21.15.73:0/1131444573 wait complete. 2023-12-12T09:46:25.997 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-12-12T09:46:26.181 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:26.180+0000 7f4105bdc640 1 Processor -- start 2023-12-12T09:46:26.181 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:26.180+0000 7f4105bdc640 1 -- start start 2023-12-12T09:46:26.182 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:26.181+0000 7f4105bdc640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f410014f8c0 0x7f410006dc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:26.182 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:26.181+0000 7f4105bdc640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f410006d350 0x7f4100071e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:26.182 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:26.181+0000 7f4105bdc640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f41000723a0 0x7f4100152500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:26.182 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:26.181+0000 7f4105bdc640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41000c1090 con 0x7f410006d350 2023-12-12T09:46:26.182 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:26.181+0000 7f4105bdc640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41000c14b0 con 0x7f41000723a0 2023-12-12T09:46:26.182 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:26.181+0000 7f4105bdc640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41000c16c0 con 0x7f410014f8c0 2023-12-12T09:46:26.182 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:26.182+0000 7f40feffd640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f410006d350 0x7f4100071e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:26.182 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:26.182+0000 7f40feffd640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f410006d350 0x7f4100071e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:54970/0 (socket says 172.21.15.73:54970) 2023-12-12T09:46:26.183 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:26.182+0000 7f40feffd640 1 -- 172.21.15.73:0/973105855 learned_addr learned my addr 172.21.15.73:0/973105855 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:46:26.183 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:26.182+0000 7f40ff7fe640 1 --2- 172.21.15.73:0/973105855 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f410014f8c0 0x7f410006dc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:26.183 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:26.182+0000 7f40fffff640 1 --2- 172.21.15.73:0/973105855 >> v2:172.21.15.142:3300/0 conn(0x7f41000723a0 0x7f4100152500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:26.183 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:26.182+0000 7f40feffd640 1 -- 172.21.15.73:0/973105855 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f410014f8c0 msgr2=0x7f410006dc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:46:26.183 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:26.182+0000 7f40feffd640 1 --2- 172.21.15.73:0/973105855 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f410014f8c0 0x7f410006dc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:26.184 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:26.182+0000 7f40feffd640 1 -- 172.21.15.73:0/973105855 >> v2:172.21.15.142:3300/0 conn(0x7f41000723a0 msgr2=0x7f4100152500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:46:26.184 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:26.182+0000 7f40feffd640 1 --2- 172.21.15.73:0/973105855 >> v2:172.21.15.142:3300/0 conn(0x7f41000723a0 0x7f4100152500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:26.184 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:26.182+0000 7f40feffd640 1 -- 172.21.15.73:0/973105855 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41000c19a0 con 0x7f410006d350 2023-12-12T09:46:26.184 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:26.183+0000 7f40feffd640 1 --2- 172.21.15.73:0/973105855 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f410006d350 0x7f4100071e60 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7f40f4009870 tx=0x7f40f402b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53b4e291423b4f05 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:46:26.185 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:26.183+0000 7f40fe7fc640 1 -- 172.21.15.73:0/973105855 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40f4031640 con 0x7f410006d350 2023-12-12T09:46:26.185 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:26.184+0000 7f40fe7fc640 1 -- 172.21.15.73:0/973105855 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40f40317a0 con 0x7f410006d350 2023-12-12T09:46:26.185 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:26.184+0000 7f40fe7fc640 1 -- 172.21.15.73:0/973105855 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40f4031b30 con 0x7f410006d350 2023-12-12T09:46:26.185 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:26.184+0000 7f4105bdc640 1 -- 172.21.15.73:0/973105855 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f410006d350 msgr2=0x7f4100071e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:26.185 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:26.184+0000 7f4105bdc640 1 --2- 172.21.15.73:0/973105855 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f410006d350 0x7f4100071e60 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7f40f4009870 tx=0x7f40f402b8f0 comp rx=0 tx=0).stop 2023-12-12T09:46:26.185 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:26.184+0000 7f4105bdc640 1 -- 172.21.15.73:0/973105855 shutdown_connections 2023-12-12T09:46:26.185 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:26.184+0000 7f4105bdc640 1 --2- 172.21.15.73:0/973105855 >> v2:172.21.15.142:3300/0 conn(0x7f41000723a0 0x7f4100152500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:26.186 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:26.184+0000 7f4105bdc640 1 --2- 172.21.15.73:0/973105855 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f410006d350 0x7f4100071e60 unknown :-1 s=CLOSED pgs=863 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:26.186 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:26.184+0000 7f4105bdc640 1 --2- 172.21.15.73:0/973105855 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f410014f8c0 0x7f410006dc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:26.186 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:26.184+0000 7f4105bdc640 1 -- 172.21.15.73:0/973105855 >> 172.21.15.73:0/973105855 conn(0x7f410006a4e0 msgr2=0x7f410006a8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:46:26.186 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:26.184+0000 7f4105bdc640 1 -- 172.21.15.73:0/973105855 shutdown_connections 2023-12-12T09:46:26.186 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:26.184+0000 7f4105bdc640 1 -- 172.21.15.73:0/973105855 wait complete. 2023-12-12T09:46:26.187 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:26.186+0000 7f4105bdc640 1 Processor -- start 2023-12-12T09:46:26.187 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:26.186+0000 7f4105bdc640 1 -- start start 2023-12-12T09:46:26.187 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:26.187+0000 7f4105bdc640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f410006d350 0x7f410014acb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:26.188 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:26.187+0000 7f4105bdc640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f41000723a0 0x7f4100148c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:26.188 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:26.187+0000 7f4105bdc640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f410014f8c0 0x7f41001473b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:26.188 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:26.187+0000 7f4105bdc640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41000a96d0 con 0x7f410006d350 2023-12-12T09:46:26.188 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:26.187+0000 7f4105bdc640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41000abcf0 con 0x7f41000723a0 2023-12-12T09:46:26.188 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:26.187+0000 7f4105bdc640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41000c00f0 con 0x7f410014f8c0 2023-12-12T09:46:26.188 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:26.187+0000 7f40ff7fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f410006d350 0x7f410014acb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:26.188 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:26.187+0000 7f40ff7fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f410006d350 0x7f410014acb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:54982/0 (socket says 172.21.15.73:54982) 2023-12-12T09:46:26.188 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:26.187+0000 7f40ff7fe640 1 -- 172.21.15.73:0/3357625800 learned_addr learned my addr 172.21.15.73:0/3357625800 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:46:26.189 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:26.188+0000 7f40feffd640 1 --2- 172.21.15.73:0/3357625800 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f41000723a0 0x7f4100148c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:26.190 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:26.188+0000 7f40fffff640 1 --2- 172.21.15.73:0/3357625800 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f410014f8c0 0x7f41001473b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:26.190 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:26.188+0000 7f40ff7fe640 1 -- 172.21.15.73:0/3357625800 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f410014f8c0 msgr2=0x7f41001473b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:26.190 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:26.188+0000 7f40ff7fe640 1 --2- 172.21.15.73:0/3357625800 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f410014f8c0 0x7f41001473b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:26.190 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:26.188+0000 7f40ff7fe640 1 -- 172.21.15.73:0/3357625800 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f41000723a0 msgr2=0x7f4100148c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:26.190 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:26.188+0000 7f40ff7fe640 1 --2- 172.21.15.73:0/3357625800 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f41000723a0 0x7f4100148c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:26.190 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:26.188+0000 7f40ff7fe640 1 -- 172.21.15.73:0/3357625800 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40f40094d0 con 0x7f410006d350 2023-12-12T09:46:26.190 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:26.188+0000 7f40feffd640 1 --2- 172.21.15.73:0/3357625800 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f41000723a0 0x7f4100148c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:46:26.190 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:26.188+0000 7f40ff7fe640 1 --2- 172.21.15.73:0/3357625800 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f410006d350 0x7f410014acb0 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7f40f000c7f0 tx=0x7f40f000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:46:26.190 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:26.188+0000 7f40e7fff640 1 -- 172.21.15.73:0/3357625800 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40f0004220 con 0x7f410006d350 2023-12-12T09:46:26.190 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:26.188+0000 7f40e7fff640 1 -- 172.21.15.73:0/3357625800 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40f0004380 con 0x7f410006d350 2023-12-12T09:46:26.190 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:26.188+0000 7f40e7fff640 1 -- 172.21.15.73:0/3357625800 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40f0007840 con 0x7f410006d350 2023-12-12T09:46:26.190 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:26.188+0000 7f4105bdc640 1 -- 172.21.15.73:0/3357625800 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41000aba10 con 0x7f410006d350 2023-12-12T09:46:26.190 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:26.188+0000 7f4105bdc640 1 -- 172.21.15.73:0/3357625800 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41000a8ba0 con 0x7f410006d350 2023-12-12T09:46:26.191 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:26.190+0000 7f4105bdc640 1 -- 172.21.15.73:0/3357625800 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4100148950 con 0x7f410006d350 2023-12-12T09:46:26.191 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:26.191+0000 7f40e7fff640 1 -- 172.21.15.73:0/3357625800 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f40f0007bb0 con 0x7f410006d350 2023-12-12T09:46:26.194 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:26.191+0000 7f40e7fff640 1 --2- 172.21.15.73:0/3357625800 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f40ec06ae40 0x7f40ec06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:26.194 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:26.192+0000 7f40e7fff640 1 -- 172.21.15.73:0/3357625800 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 5609+0+0 (secure 0 0 0) 0x7f40f0089490 con 0x7f410006d350 2023-12-12T09:46:26.194 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:26.192+0000 7f40feffd640 1 --2- 172.21.15.73:0/3357625800 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f40ec06ae40 0x7f40ec06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:26.194 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:26.193+0000 7f40feffd640 1 --2- 172.21.15.73:0/3357625800 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f40ec06ae40 0x7f40ec06d300 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f40f4036000 tx=0x7f40f403c040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:46:26.197 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:26.197+0000 7f40e7fff640 1 -- 172.21.15.73:0/3357625800 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f40f0054590 con 0x7f410006d350 2023-12-12T09:46:26.428 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:26.427+0000 7f4105bdc640 1 -- 172.21.15.73:0/3357625800 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f4100067070 con 0x7f410006d350 2023-12-12T09:46:26.982 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:26.980+0000 7f40e7fff640 1 -- 172.21.15.73:0/3357625800 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 12 and data pool 13 v41) v1 ==== 174+0+0 (secure 0 0 0) 0x7f40f0007e60 con 0x7f410006d350 2023-12-12T09:46:26.982 INFO:teuthology.orchestra.run.smithi073.stderr:new fs with metadata pool 12 and data pool 13 2023-12-12T09:46:26.987 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:26.986+0000 7f4105bdc640 1 -- 172.21.15.73:0/3357625800 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f40ec06ae40 msgr2=0x7f40ec06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:26.987 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:26.986+0000 7f4105bdc640 1 --2- 172.21.15.73:0/3357625800 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f40ec06ae40 0x7f40ec06d300 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f40f4036000 tx=0x7f40f403c040 comp rx=0 tx=0).stop 2023-12-12T09:46:26.987 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:26.986+0000 7f4105bdc640 1 -- 172.21.15.73:0/3357625800 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f410006d350 msgr2=0x7f410014acb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:26.987 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:26.986+0000 7f4105bdc640 1 --2- 172.21.15.73:0/3357625800 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f410006d350 0x7f410014acb0 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7f40f000c7f0 tx=0x7f40f000ccb0 comp rx=0 tx=0).stop 2023-12-12T09:46:26.989 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:26.988+0000 7f4105bdc640 1 -- 172.21.15.73:0/3357625800 shutdown_connections 2023-12-12T09:46:26.989 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:26.988+0000 7f4105bdc640 1 --2- 172.21.15.73:0/3357625800 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f40ec06ae40 0x7f40ec06d300 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:26.989 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:26.988+0000 7f4105bdc640 1 --2- 172.21.15.73:0/3357625800 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f410014f8c0 0x7f41001473b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:26.989 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:26.988+0000 7f4105bdc640 1 --2- 172.21.15.73:0/3357625800 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f41000723a0 0x7f4100148c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:26.989 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:26.988+0000 7f4105bdc640 1 --2- 172.21.15.73:0/3357625800 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f410006d350 0x7f410014acb0 unknown :-1 s=CLOSED pgs=864 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:26.989 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:26.988+0000 7f4105bdc640 1 -- 172.21.15.73:0/3357625800 >> 172.21.15.73:0/3357625800 conn(0x7f410006a4e0 msgr2=0x7f410014e320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:46:26.990 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:26.989+0000 7f4105bdc640 1 -- 172.21.15.73:0/3357625800 shutdown_connections 2023-12-12T09:46:26.990 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:26.989+0000 7f4105bdc640 1 -- 172.21.15.73:0/3357625800 wait complete. 2023-12-12T09:46:27.020 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-12T09:46:27.202 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:27.201+0000 7f458f7ec640 1 Processor -- start 2023-12-12T09:46:27.202 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:27.201+0000 7f458f7ec640 1 -- start start 2023-12-12T09:46:27.203 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:27.202+0000 7f458f7ec640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f458814fa40 0x7f458806a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:27.203 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:27.202+0000 7f458f7ec640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f458806db70 0x7f45880c39b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:27.203 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:27.202+0000 7f458f7ec640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f45880c5070 0x7f45880c3ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:27.203 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:27.202+0000 7f458f7ec640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4588152610 con 0x7f458806db70 2023-12-12T09:46:27.203 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:27.203+0000 7f458f7ec640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45881528f0 con 0x7f45880c5070 2023-12-12T09:46:27.203 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:27.203+0000 7f458f7ec640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4588152bd0 con 0x7f458814fa40 2023-12-12T09:46:27.204 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:27.203+0000 7f458cd87640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f458806db70 0x7f45880c39b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:27.204 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:27.203+0000 7f458cd87640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f458806db70 0x7f45880c39b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:54986/0 (socket says 172.21.15.73:54986) 2023-12-12T09:46:27.204 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:27.203+0000 7f458cd87640 1 -- 172.21.15.73:0/1143457943 learned_addr learned my addr 172.21.15.73:0/1143457943 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:46:27.204 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:27.203+0000 7f458dd89640 1 --2- 172.21.15.73:0/1143457943 >> v2:172.21.15.142:3300/0 conn(0x7f45880c5070 0x7f45880c3ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:27.205 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:27.203+0000 7f458d588640 1 --2- 172.21.15.73:0/1143457943 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f458814fa40 0x7f458806a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:27.205 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:27.203+0000 7f458cd87640 1 -- 172.21.15.73:0/1143457943 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f458814fa40 msgr2=0x7f458806a4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:46:27.205 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:27.203+0000 7f458cd87640 1 --2- 172.21.15.73:0/1143457943 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f458814fa40 0x7f458806a4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:27.205 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:27.203+0000 7f458cd87640 1 -- 172.21.15.73:0/1143457943 >> v2:172.21.15.142:3300/0 conn(0x7f45880c5070 msgr2=0x7f45880c3ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:46:27.205 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:27.203+0000 7f458cd87640 1 --2- 172.21.15.73:0/1143457943 >> v2:172.21.15.142:3300/0 conn(0x7f45880c5070 0x7f45880c3ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:27.205 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:27.203+0000 7f458cd87640 1 -- 172.21.15.73:0/1143457943 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4588152eb0 con 0x7f458806db70 2023-12-12T09:46:27.205 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:27.203+0000 7f458d588640 1 --2- 172.21.15.73:0/1143457943 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f458814fa40 0x7f458806a4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:46:27.206 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:27.205+0000 7f458cd87640 1 --2- 172.21.15.73:0/1143457943 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f458806db70 0x7f45880c39b0 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7f4588153570 tx=0x7f457802b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b231ed710efaf1b server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:46:27.206 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:27.205+0000 7f457ffff640 1 -- 172.21.15.73:0/1143457943 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4578031870 con 0x7f458806db70 2023-12-12T09:46:27.206 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:27.205+0000 7f457ffff640 1 -- 172.21.15.73:0/1143457943 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45780319d0 con 0x7f458806db70 2023-12-12T09:46:27.206 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:27.205+0000 7f457ffff640 1 -- 172.21.15.73:0/1143457943 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4578031d60 con 0x7f458806db70 2023-12-12T09:46:27.206 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:27.205+0000 7f458f7ec640 1 -- 172.21.15.73:0/1143457943 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f458806db70 msgr2=0x7f45880c39b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:27.207 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:27.205+0000 7f458f7ec640 1 --2- 172.21.15.73:0/1143457943 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f458806db70 0x7f45880c39b0 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7f4588153570 tx=0x7f457802b910 comp rx=0 tx=0).stop 2023-12-12T09:46:27.207 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:27.206+0000 7f458f7ec640 1 -- 172.21.15.73:0/1143457943 shutdown_connections 2023-12-12T09:46:27.207 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:27.206+0000 7f458f7ec640 1 --2- 172.21.15.73:0/1143457943 >> v2:172.21.15.142:3300/0 conn(0x7f45880c5070 0x7f45880c3ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:27.207 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:27.206+0000 7f458f7ec640 1 --2- 172.21.15.73:0/1143457943 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f458806db70 0x7f45880c39b0 unknown :-1 s=CLOSED pgs=865 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:27.207 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:27.206+0000 7f458f7ec640 1 --2- 172.21.15.73:0/1143457943 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f458814fa40 0x7f458806a4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:27.207 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:27.206+0000 7f458f7ec640 1 -- 172.21.15.73:0/1143457943 >> 172.21.15.73:0/1143457943 conn(0x7f45880a8130 msgr2=0x7f45880c24b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:46:27.207 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:27.206+0000 7f458f7ec640 1 -- 172.21.15.73:0/1143457943 shutdown_connections 2023-12-12T09:46:27.207 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:27.206+0000 7f458f7ec640 1 -- 172.21.15.73:0/1143457943 wait complete. 2023-12-12T09:46:27.208 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:27.207+0000 7f458f7ec640 1 Processor -- start 2023-12-12T09:46:27.208 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:27.207+0000 7f458f7ec640 1 -- start start 2023-12-12T09:46:27.209 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:27.208+0000 7f458f7ec640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f458806db70 0x7f4588070690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:27.209 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:27.208+0000 7f458f7ec640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f45880c5070 0x7f458814a250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:27.210 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:27.208+0000 7f458f7ec640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f458814fa40 0x7f458814a790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:27.210 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:27.208+0000 7f458f7ec640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4588071040 con 0x7f458814fa40 2023-12-12T09:46:27.210 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:27.208+0000 7f458f7ec640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45880a8eb0 con 0x7f458806db70 2023-12-12T09:46:27.210 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:27.208+0000 7f458f7ec640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45880aa9d0 con 0x7f45880c5070 2023-12-12T09:46:27.210 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:27.209+0000 7f458dd89640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f458814fa40 0x7f458814a790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:27.210 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:27.209+0000 7f458dd89640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f458814fa40 0x7f458814a790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:54994/0 (socket says 172.21.15.73:54994) 2023-12-12T09:46:27.210 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:27.209+0000 7f458dd89640 1 -- 172.21.15.73:0/4039270114 learned_addr learned my addr 172.21.15.73:0/4039270114 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:46:27.210 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:27.209+0000 7f458cd87640 1 --2- 172.21.15.73:0/4039270114 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f45880c5070 0x7f458814a250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:27.210 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:27.209+0000 7f458d588640 1 --2- 172.21.15.73:0/4039270114 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f458806db70 0x7f4588070690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:27.210 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:27.209+0000 7f458dd89640 1 -- 172.21.15.73:0/4039270114 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f45880c5070 msgr2=0x7f458814a250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:27.210 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:27.209+0000 7f458dd89640 1 --2- 172.21.15.73:0/4039270114 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f45880c5070 0x7f458814a250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:27.210 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:27.209+0000 7f458dd89640 1 -- 172.21.15.73:0/4039270114 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f458806db70 msgr2=0x7f4588070690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:27.211 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:27.209+0000 7f458dd89640 1 --2- 172.21.15.73:0/4039270114 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f458806db70 0x7f4588070690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:27.211 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:27.209+0000 7f458dd89640 1 -- 172.21.15.73:0/4039270114 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45780094d0 con 0x7f458814fa40 2023-12-12T09:46:27.212 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:27.209+0000 7f458dd89640 1 --2- 172.21.15.73:0/4039270114 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f458814fa40 0x7f458814a790 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7f4580007e40 tx=0x7f458000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:46:27.212 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:27.210+0000 7f457dffb640 1 -- 172.21.15.73:0/4039270114 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4580014620 con 0x7f458814fa40 2023-12-12T09:46:27.212 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:27.210+0000 7f457dffb640 1 -- 172.21.15.73:0/4039270114 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45800147a0 con 0x7f458814fa40 2023-12-12T09:46:27.212 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:27.210+0000 7f457dffb640 1 -- 172.21.15.73:0/4039270114 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4580014b50 con 0x7f458814fa40 2023-12-12T09:46:27.212 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:27.210+0000 7f458f7ec640 1 -- 172.21.15.73:0/4039270114 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45880a8b60 con 0x7f458814fa40 2023-12-12T09:46:27.212 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:27.210+0000 7f458f7ec640 1 -- 172.21.15.73:0/4039270114 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4588151910 con 0x7f458814fa40 2023-12-12T09:46:27.212 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:27.211+0000 7f458f7ec640 1 -- 172.21.15.73:0/4039270114 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4588067580 con 0x7f458814fa40 2023-12-12T09:46:27.213 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:27.212+0000 7f457dffb640 1 -- 172.21.15.73:0/4039270114 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f4580014cb0 con 0x7f458814fa40 2023-12-12T09:46:27.213 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:27.213+0000 7f457dffb640 1 --2- 172.21.15.73:0/4039270114 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f456c06ae40 0x7f456c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:27.213 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:27.213+0000 7f457dffb640 1 -- 172.21.15.73:0/4039270114 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4580089ff0 con 0x7f458814fa40 2023-12-12T09:46:27.214 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:27.213+0000 7f458d588640 1 --2- 172.21.15.73:0/4039270114 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f456c06ae40 0x7f456c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:27.214 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:27.214+0000 7f458d588640 1 --2- 172.21.15.73:0/4039270114 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f456c06ae40 0x7f456c06d300 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f458400a910 tx=0x7f4584008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:46:27.218 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:27.218+0000 7f457dffb640 1 -- 172.21.15.73:0/4039270114 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f45800bce90 con 0x7f458814fa40 2023-12-12T09:46:27.410 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:27.410+0000 7f458f7ec640 1 -- 172.21.15.73:0/4039270114 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f45880a8ff0 con 0x7f458814fa40 2023-12-12T09:46:27.413 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:27.413+0000 7f457dffb640 1 -- 172.21.15.73:0/4039270114 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v74) v1 ==== 74+0+16585 (secure 0 0 0) 0x7f4580055020 con 0x7f458814fa40 2023-12-12T09:46:27.414 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-12T09:46:27.414 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":74,"fsid":"ba240992-02b8-4c7e-92f2-27eb29ac433b","created":"2023-12-12T09:43:02.454719+0000","modified":"2023-12-12T09:46:26.428814+0000","last_up_change":"2023-12-12T09:43:13.913440+0000","last_in_change":"2023-12-12T09:43:05.925348+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-12T09:43:15.525508+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2023-12-12T09:46:24.716544+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2023-12-12T09:46:25.435954+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"dd9074be-dbe2-4c34-9896-a4223d8d3940","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":4047810203},{"type":"v1","addr":"172.21.15.73:6801","nonce":4047810203}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":4047810203},{"type":"v1","addr":"172.21.15.73:6803","nonce":4047810203}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":4047810203},{"type":"v1","addr":"172.21.15.73:6807","nonce":4047810203}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":4047810203},{"type":"v1","addr":"172.21.15.73:6805","nonce":4047810203}]},"public_addr":"172.21.15.73:6801/4047810203","cluster_addr":"172.21.15.73:6803/4047810203","heartbeat_back_addr":"172.21.15.73:6807/4047810203","heartbeat_front_addr":"172.21.15.73:6805/4047810203","state":["exists","up"]},{"osd":1,"uuid":"c4a05052-96d4-4758-a4e1-1a37f1e07fed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":1356058331},{"type":"v1","addr":"172.21.15.73:6824","nonce":1356058331}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":1356058331},{"type":"v1","addr":"172.21.15.73:6827","nonce":1356058331}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":1356058331},{"type":"v1","addr":"172.21.15.73:6831","nonce":1356058331}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":1356058331},{"type":"v1","addr":"172.21.15.73:6829","nonce":1356058331}]},"public_addr":"172.21.15.73:6824/1356058331","cluster_addr":"172.21.15.73:6827/1356058331","heartbeat_back_addr":"172.21.15.73:6831/1356058331","heartbeat_front_addr":"172.21.15.73:6829/1356058331","state":["exists","up"]},{"osd":2,"uuid":"512bc8ac-72c2-40d4-b3d2-d867a92c5213","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":1228903316},{"type":"v1","addr":"172.21.15.73:6817","nonce":1228903316}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":1228903316},{"type":"v1","addr":"172.21.15.73:6819","nonce":1228903316}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6823","nonce":1228903316},{"type":"v1","addr":"172.21.15.73:6825","nonce":1228903316}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":1228903316},{"type":"v1","addr":"172.21.15.73:6821","nonce":1228903316}]},"public_addr":"172.21.15.73:6817/1228903316","cluster_addr":"172.21.15.73:6819/1228903316","heartbeat_back_addr":"172.21.15.73:6825/1228903316","heartbeat_front_addr":"172.21.15.73:6821/1228903316","state":["exists","up"]},{"osd":3,"uuid":"3d1a91e0-42bf-437a-8eae-8d357c8f63a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":1293329670},{"type":"v1","addr":"172.21.15.73:6809","nonce":1293329670}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6810","nonce":1293329670},{"type":"v1","addr":"172.21.15.73:6811","nonce":1293329670}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":1293329670},{"type":"v1","addr":"172.21.15.73:6815","nonce":1293329670}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":1293329670},{"type":"v1","addr":"172.21.15.73:6813","nonce":1293329670}]},"public_addr":"172.21.15.73:6809/1293329670","cluster_addr":"172.21.15.73:6811/1293329670","heartbeat_back_addr":"172.21.15.73:6815/1293329670","heartbeat_front_addr":"172.21.15.73:6813/1293329670","state":["exists","up"]},{"osd":4,"uuid":"4b302fff-834c-4069-ac19-00e46f6c87b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":3727975702},{"type":"v1","addr":"172.21.15.142:6801","nonce":3727975702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":3727975702},{"type":"v1","addr":"172.21.15.142:6803","nonce":3727975702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6809","nonce":3727975702},{"type":"v1","addr":"172.21.15.142:6811","nonce":3727975702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6805","nonce":3727975702},{"type":"v1","addr":"172.21.15.142:6807","nonce":3727975702}]},"public_addr":"172.21.15.142:6801/3727975702","cluster_addr":"172.21.15.142:6803/3727975702","heartbeat_back_addr":"172.21.15.142:6811/3727975702","heartbeat_front_addr":"172.21.15.142:6807/3727975702","state":["exists","up"]},{"osd":5,"uuid":"d7cdace2-67d0-45cc-95f2-515cf6ef1b82","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6817","nonce":2353193632},{"type":"v1","addr":"172.21.15.142:6819","nonce":2353193632}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6821","nonce":2353193632},{"type":"v1","addr":"172.21.15.142:6823","nonce":2353193632}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6829","nonce":2353193632},{"type":"v1","addr":"172.21.15.142:6831","nonce":2353193632}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6825","nonce":2353193632},{"type":"v1","addr":"172.21.15.142:6827","nonce":2353193632}]},"public_addr":"172.21.15.142:6819/2353193632","cluster_addr":"172.21.15.142:6823/2353193632","heartbeat_back_addr":"172.21.15.142:6831/2353193632","heartbeat_front_addr":"172.21.15.142:6827/2353193632","state":["exists","up"]},{"osd":6,"uuid":"649ce78a-5626-445c-aedc-a651ed05a6f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":2006111986},{"type":"v1","addr":"172.21.15.142:6806","nonce":2006111986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":2006111986},{"type":"v1","addr":"172.21.15.142:6810","nonce":2006111986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":2006111986},{"type":"v1","addr":"172.21.15.142:6815","nonce":2006111986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":2006111986},{"type":"v1","addr":"172.21.15.142:6813","nonce":2006111986}]},"public_addr":"172.21.15.142:6806/2006111986","cluster_addr":"172.21.15.142:6810/2006111986","heartbeat_back_addr":"172.21.15.142:6815/2006111986","heartbeat_front_addr":"172.21.15.142:6813/2006111986","state":["exists","up"]},{"osd":7,"uuid":"af15ae3b-c1d0-4acf-92db-8a1805494d13","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":2573794341},{"type":"v1","addr":"172.21.15.142:6818","nonce":2573794341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":2573794341},{"type":"v1","addr":"172.21.15.142:6822","nonce":2573794341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":2573794341},{"type":"v1","addr":"172.21.15.142:6830","nonce":2573794341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":2573794341},{"type":"v1","addr":"172.21.15.142:6826","nonce":2573794341}]},"public_addr":"172.21.15.142:6818/2573794341","cluster_addr":"172.21.15.142:6822/2573794341","heartbeat_back_addr":"172.21.15.142:6830/2573794341","heartbeat_front_addr":"172.21.15.142:6826/2573794341","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.185824+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.262103+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.225556+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:10.523459+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:10.706035+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.257339+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.301776+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.051960+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-12T09:46:27.416 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:27.416+0000 7f458f7ec640 1 -- 172.21.15.73:0/4039270114 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f456c06ae40 msgr2=0x7f456c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:27.416 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:27.416+0000 7f458f7ec640 1 --2- 172.21.15.73:0/4039270114 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f456c06ae40 0x7f456c06d300 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f458400a910 tx=0x7f4584008040 comp rx=0 tx=0).stop 2023-12-12T09:46:27.417 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:27.416+0000 7f458f7ec640 1 -- 172.21.15.73:0/4039270114 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f458814fa40 msgr2=0x7f458814a790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:27.417 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:27.416+0000 7f458f7ec640 1 --2- 172.21.15.73:0/4039270114 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f458814fa40 0x7f458814a790 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7f4580007e40 tx=0x7f458000e4b0 comp rx=0 tx=0).stop 2023-12-12T09:46:27.417 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:27.416+0000 7f458f7ec640 1 -- 172.21.15.73:0/4039270114 shutdown_connections 2023-12-12T09:46:27.417 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:27.416+0000 7f458f7ec640 1 --2- 172.21.15.73:0/4039270114 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f456c06ae40 0x7f456c06d300 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:27.417 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:27.416+0000 7f458f7ec640 1 --2- 172.21.15.73:0/4039270114 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f458814fa40 0x7f458814a790 unknown :-1 s=CLOSED pgs=866 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:27.417 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:27.416+0000 7f458f7ec640 1 --2- 172.21.15.73:0/4039270114 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f45880c5070 0x7f458814a250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:27.417 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:27.416+0000 7f458f7ec640 1 --2- 172.21.15.73:0/4039270114 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f458806db70 0x7f4588070690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:27.417 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:27.416+0000 7f458f7ec640 1 -- 172.21.15.73:0/4039270114 >> 172.21.15.73:0/4039270114 conn(0x7f45880a8130 msgr2=0x7f45880c63b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:46:27.417 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:27.416+0000 7f458f7ec640 1 -- 172.21.15.73:0/4039270114 shutdown_connections 2023-12-12T09:46:27.417 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:27.416+0000 7f458f7ec640 1 -- 172.21.15.73:0/4039270114 wait complete. 2023-12-12T09:46:27.434 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-12T09:46:27.632 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:27.631+0000 7fca1d5bb640 1 Processor -- start 2023-12-12T09:46:27.632 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:27.631+0000 7fca1d5bb640 1 -- start start 2023-12-12T09:46:27.633 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:27.632+0000 7fca1d5bb640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fca180c7f30 0x7fca1806fcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:27.633 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:27.633+0000 7fca1d5bb640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fca1806f320 0x7fca180c3320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:27.633 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:27.633+0000 7fca1d5bb640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca1806e8f0 con 0x7fca180c66f0 2023-12-12T09:46:27.633 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:27.633+0000 7fca1d5bb640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca180c3a20 con 0x7fca1806f320 2023-12-12T09:46:27.633 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:27.633+0000 7fca1d5bb640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca180c3d00 con 0x7fca180c7f30 2023-12-12T09:46:27.634 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:27.633+0000 7fca0ffff640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fca1806f320 0x7fca180c3320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:27.634 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:27.633+0000 7fca177fe640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7fca180c66f0 0x7fca18156030 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:53816/0 (socket says 172.21.15.73:53816) 2023-12-12T09:46:27.634 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:27.633+0000 7fca177fe640 1 -- 172.21.15.73:0/3026406973 learned_addr learned my addr 172.21.15.73:0/3026406973 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-12T09:46:27.634 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:27.633+0000 7fca16ffd640 1 --2- 172.21.15.73:0/3026406973 >> v2:172.21.15.142:3300/0 conn(0x7fca180c7f30 0x7fca1806fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:27.635 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:27.633+0000 7fca0ffff640 1 -- 172.21.15.73:0/3026406973 >> v2:172.21.15.142:3300/0 conn(0x7fca180c7f30 msgr2=0x7fca1806fcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:46:27.635 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:27.633+0000 7fca0ffff640 1 --2- 172.21.15.73:0/3026406973 >> v2:172.21.15.142:3300/0 conn(0x7fca180c7f30 0x7fca1806fcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:27.635 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:27.633+0000 7fca0ffff640 1 -- 172.21.15.73:0/3026406973 >> v1:172.21.15.73:6789/0 conn(0x7fca180c66f0 legacy=0x7fca18156030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:27.635 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:27.633+0000 7fca0ffff640 1 -- 172.21.15.73:0/3026406973 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca1806eb20 con 0x7fca1806f320 2023-12-12T09:46:27.635 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:27.634+0000 7fca16ffd640 1 --2- 172.21.15.73:0/3026406973 >> v2:172.21.15.142:3300/0 conn(0x7fca180c7f30 0x7fca1806fcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:46:27.635 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:27.633+0000 7fca167fc640 1 -- 172.21.15.73:0/3026406973 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3055817774 0 0) 0x7fca1806e8f0 con 0x7fca180c66f0 2023-12-12T09:46:27.636 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:27.635+0000 7fca0ffff640 1 --2- 172.21.15.73:0/3026406973 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fca1806f320 0x7fca180c3320 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7fca18067070 tx=0x7fca0002b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71ba60633f34842a server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:46:27.636 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:27.635+0000 7fca167fc640 1 -- 172.21.15.73:0/3026406973 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca0002e070 con 0x7fca1806f320 2023-12-12T09:46:27.636 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:27.635+0000 7fca167fc640 1 -- 172.21.15.73:0/3026406973 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca000315a0 con 0x7fca1806f320 2023-12-12T09:46:27.636 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:27.635+0000 7fca167fc640 1 -- 172.21.15.73:0/3026406973 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca00031930 con 0x7fca1806f320 2023-12-12T09:46:27.637 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:27.636+0000 7fca1d5bb640 1 -- 172.21.15.73:0/3026406973 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fca1806f320 msgr2=0x7fca180c3320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:27.637 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:27.636+0000 7fca1d5bb640 1 --2- 172.21.15.73:0/3026406973 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fca1806f320 0x7fca180c3320 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7fca18067070 tx=0x7fca0002b840 comp rx=0 tx=0).stop 2023-12-12T09:46:27.637 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:27.636+0000 7fca1d5bb640 1 -- 172.21.15.73:0/3026406973 shutdown_connections 2023-12-12T09:46:27.637 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:27.636+0000 7fca1d5bb640 1 --2- 172.21.15.73:0/3026406973 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fca1806f320 0x7fca180c3320 unknown :-1 s=CLOSED pgs=868 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:27.637 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:27.636+0000 7fca1d5bb640 1 --2- 172.21.15.73:0/3026406973 >> v2:172.21.15.142:3300/0 conn(0x7fca180c7f30 0x7fca1806fcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:27.637 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:27.636+0000 7fca1d5bb640 1 -- 172.21.15.73:0/3026406973 >> 172.21.15.73:0/3026406973 conn(0x7fca180661f0 msgr2=0x7fca180665d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:46:27.637 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:27.636+0000 7fca1d5bb640 1 -- 172.21.15.73:0/3026406973 shutdown_connections 2023-12-12T09:46:27.637 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:27.636+0000 7fca1d5bb640 1 -- 172.21.15.73:0/3026406973 wait complete. 2023-12-12T09:46:27.638 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:27.638+0000 7fca1d5bb640 1 Processor -- start 2023-12-12T09:46:27.639 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:27.638+0000 7fca1d5bb640 1 -- start start 2023-12-12T09:46:27.641 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:27.639+0000 7fca1d5bb640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fca1806f320 0x7fca1806fa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:27.641 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:27.639+0000 7fca1d5bb640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fca180c66f0 0x7fca181ed040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:27.641 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:27.639+0000 7fca1d5bb640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fca180c7f30 0x7fca181ed580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:27.641 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:27.639+0000 7fca1d5bb640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca1814d3a0 con 0x7fca180c7f30 2023-12-12T09:46:27.642 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:27.639+0000 7fca1d5bb640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca181507e0 con 0x7fca1806f320 2023-12-12T09:46:27.642 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:27.639+0000 7fca1d5bb640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca181edac0 con 0x7fca180c66f0 2023-12-12T09:46:27.642 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:27.640+0000 7fca177fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fca180c7f30 0x7fca181ed580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:27.642 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:27.640+0000 7fca177fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fca180c7f30 0x7fca181ed580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:55004/0 (socket says 172.21.15.73:55004) 2023-12-12T09:46:27.642 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:27.640+0000 7fca177fe640 1 -- 172.21.15.73:0/1321350303 learned_addr learned my addr 172.21.15.73:0/1321350303 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:46:27.642 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:27.640+0000 7fca16ffd640 1 --2- 172.21.15.73:0/1321350303 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fca1806f320 0x7fca1806fa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:27.642 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:27.640+0000 7fca0ffff640 1 --2- 172.21.15.73:0/1321350303 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fca180c66f0 0x7fca181ed040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:27.642 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:27.640+0000 7fca177fe640 1 -- 172.21.15.73:0/1321350303 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fca180c66f0 msgr2=0x7fca181ed040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:27.642 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:27.640+0000 7fca177fe640 1 --2- 172.21.15.73:0/1321350303 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fca180c66f0 0x7fca181ed040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:27.642 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:27.640+0000 7fca177fe640 1 -- 172.21.15.73:0/1321350303 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fca1806f320 msgr2=0x7fca1806fa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:27.642 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:27.640+0000 7fca177fe640 1 --2- 172.21.15.73:0/1321350303 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fca1806f320 0x7fca1806fa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:27.642 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:27.640+0000 7fca177fe640 1 -- 172.21.15.73:0/1321350303 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca00009400 con 0x7fca180c7f30 2023-12-12T09:46:27.642 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:27.640+0000 7fca16ffd640 1 --2- 172.21.15.73:0/1321350303 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fca1806f320 0x7fca1806fa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:46:27.643 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:27.641+0000 7fca177fe640 1 --2- 172.21.15.73:0/1321350303 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fca180c7f30 0x7fca181ed580 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7fca1000c7d0 tx=0x7fca1000cc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:46:27.643 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:27.641+0000 7fca0f7fe640 1 -- 172.21.15.73:0/1321350303 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca1000a640 con 0x7fca180c7f30 2023-12-12T09:46:27.643 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:27.641+0000 7fca0f7fe640 1 -- 172.21.15.73:0/1321350303 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca1000a7a0 con 0x7fca180c7f30 2023-12-12T09:46:27.643 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:27.641+0000 7fca0f7fe640 1 -- 172.21.15.73:0/1321350303 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca1000ab90 con 0x7fca180c7f30 2023-12-12T09:46:27.643 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:27.641+0000 7fca1d5bb640 1 -- 172.21.15.73:0/1321350303 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca18150fd0 con 0x7fca180c7f30 2023-12-12T09:46:27.643 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:27.641+0000 7fca1d5bb640 1 -- 172.21.15.73:0/1321350303 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca18150cf0 con 0x7fca180c7f30 2023-12-12T09:46:27.643 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:27.642+0000 7fca1d5bb640 1 -- 172.21.15.73:0/1321350303 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca18067580 con 0x7fca180c7f30 2023-12-12T09:46:27.644 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:27.643+0000 7fca0f7fe640 1 -- 172.21.15.73:0/1321350303 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fca1000acf0 con 0x7fca180c7f30 2023-12-12T09:46:27.645 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:27.645+0000 7fca0f7fe640 1 --2- 172.21.15.73:0/1321350303 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fc9f806ae40 0x7fc9f806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:27.645 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:27.645+0000 7fca0f7fe640 1 -- 172.21.15.73:0/1321350303 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fca10088940 con 0x7fca180c7f30 2023-12-12T09:46:27.645 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:27.645+0000 7fca16ffd640 1 --2- 172.21.15.73:0/1321350303 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fc9f806ae40 0x7fc9f806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:27.646 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:27.646+0000 7fca16ffd640 1 --2- 172.21.15.73:0/1321350303 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fc9f806ae40 0x7fc9f806d300 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fca08006fd0 tx=0x7fca08008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:46:27.650 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:27.650+0000 7fca0f7fe640 1 -- 172.21.15.73:0/1321350303 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fca10053a80 con 0x7fca180c7f30 2023-12-12T09:46:27.840 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:27.840+0000 7fca1d5bb640 1 -- 172.21.15.73:0/1321350303 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fca18150f70 con 0x7fca180c7f30 2023-12-12T09:46:27.842 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:27.841+0000 7fca0f7fe640 1 -- 172.21.15.73:0/1321350303 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v74) v1 ==== 74+0+16585 (secure 0 0 0) 0x7fca10018070 con 0x7fca180c7f30 2023-12-12T09:46:27.842 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-12T09:46:27.842 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":74,"fsid":"ba240992-02b8-4c7e-92f2-27eb29ac433b","created":"2023-12-12T09:43:02.454719+0000","modified":"2023-12-12T09:46:26.428814+0000","last_up_change":"2023-12-12T09:43:13.913440+0000","last_in_change":"2023-12-12T09:43:05.925348+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-12T09:43:15.525508+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2023-12-12T09:46:24.716544+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2023-12-12T09:46:25.435954+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"dd9074be-dbe2-4c34-9896-a4223d8d3940","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":4047810203},{"type":"v1","addr":"172.21.15.73:6801","nonce":4047810203}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":4047810203},{"type":"v1","addr":"172.21.15.73:6803","nonce":4047810203}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":4047810203},{"type":"v1","addr":"172.21.15.73:6807","nonce":4047810203}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":4047810203},{"type":"v1","addr":"172.21.15.73:6805","nonce":4047810203}]},"public_addr":"172.21.15.73:6801/4047810203","cluster_addr":"172.21.15.73:6803/4047810203","heartbeat_back_addr":"172.21.15.73:6807/4047810203","heartbeat_front_addr":"172.21.15.73:6805/4047810203","state":["exists","up"]},{"osd":1,"uuid":"c4a05052-96d4-4758-a4e1-1a37f1e07fed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":1356058331},{"type":"v1","addr":"172.21.15.73:6824","nonce":1356058331}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":1356058331},{"type":"v1","addr":"172.21.15.73:6827","nonce":1356058331}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":1356058331},{"type":"v1","addr":"172.21.15.73:6831","nonce":1356058331}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":1356058331},{"type":"v1","addr":"172.21.15.73:6829","nonce":1356058331}]},"public_addr":"172.21.15.73:6824/1356058331","cluster_addr":"172.21.15.73:6827/1356058331","heartbeat_back_addr":"172.21.15.73:6831/1356058331","heartbeat_front_addr":"172.21.15.73:6829/1356058331","state":["exists","up"]},{"osd":2,"uuid":"512bc8ac-72c2-40d4-b3d2-d867a92c5213","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":1228903316},{"type":"v1","addr":"172.21.15.73:6817","nonce":1228903316}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":1228903316},{"type":"v1","addr":"172.21.15.73:6819","nonce":1228903316}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6823","nonce":1228903316},{"type":"v1","addr":"172.21.15.73:6825","nonce":1228903316}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":1228903316},{"type":"v1","addr":"172.21.15.73:6821","nonce":1228903316}]},"public_addr":"172.21.15.73:6817/1228903316","cluster_addr":"172.21.15.73:6819/1228903316","heartbeat_back_addr":"172.21.15.73:6825/1228903316","heartbeat_front_addr":"172.21.15.73:6821/1228903316","state":["exists","up"]},{"osd":3,"uuid":"3d1a91e0-42bf-437a-8eae-8d357c8f63a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":1293329670},{"type":"v1","addr":"172.21.15.73:6809","nonce":1293329670}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6810","nonce":1293329670},{"type":"v1","addr":"172.21.15.73:6811","nonce":1293329670}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":1293329670},{"type":"v1","addr":"172.21.15.73:6815","nonce":1293329670}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":1293329670},{"type":"v1","addr":"172.21.15.73:6813","nonce":1293329670}]},"public_addr":"172.21.15.73:6809/1293329670","cluster_addr":"172.21.15.73:6811/1293329670","heartbeat_back_addr":"172.21.15.73:6815/1293329670","heartbeat_front_addr":"172.21.15.73:6813/1293329670","state":["exists","up"]},{"osd":4,"uuid":"4b302fff-834c-4069-ac19-00e46f6c87b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":3727975702},{"type":"v1","addr":"172.21.15.142:6801","nonce":3727975702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":3727975702},{"type":"v1","addr":"172.21.15.142:6803","nonce":3727975702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6809","nonce":3727975702},{"type":"v1","addr":"172.21.15.142:6811","nonce":3727975702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6805","nonce":3727975702},{"type":"v1","addr":"172.21.15.142:6807","nonce":3727975702}]},"public_addr":"172.21.15.142:6801/3727975702","cluster_addr":"172.21.15.142:6803/3727975702","heartbeat_back_addr":"172.21.15.142:6811/3727975702","heartbeat_front_addr":"172.21.15.142:6807/3727975702","state":["exists","up"]},{"osd":5,"uuid":"d7cdace2-67d0-45cc-95f2-515cf6ef1b82","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6817","nonce":2353193632},{"type":"v1","addr":"172.21.15.142:6819","nonce":2353193632}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6821","nonce":2353193632},{"type":"v1","addr":"172.21.15.142:6823","nonce":2353193632}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6829","nonce":2353193632},{"type":"v1","addr":"172.21.15.142:6831","nonce":2353193632}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6825","nonce":2353193632},{"type":"v1","addr":"172.21.15.142:6827","nonce":2353193632}]},"public_addr":"172.21.15.142:6819/2353193632","cluster_addr":"172.21.15.142:6823/2353193632","heartbeat_back_addr":"172.21.15.142:6831/2353193632","heartbeat_front_addr":"172.21.15.142:6827/2353193632","state":["exists","up"]},{"osd":6,"uuid":"649ce78a-5626-445c-aedc-a651ed05a6f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":2006111986},{"type":"v1","addr":"172.21.15.142:6806","nonce":2006111986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":2006111986},{"type":"v1","addr":"172.21.15.142:6810","nonce":2006111986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":2006111986},{"type":"v1","addr":"172.21.15.142:6815","nonce":2006111986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":2006111986},{"type":"v1","addr":"172.21.15.142:6813","nonce":2006111986}]},"public_addr":"172.21.15.142:6806/2006111986","cluster_addr":"172.21.15.142:6810/2006111986","heartbeat_back_addr":"172.21.15.142:6815/2006111986","heartbeat_front_addr":"172.21.15.142:6813/2006111986","state":["exists","up"]},{"osd":7,"uuid":"af15ae3b-c1d0-4acf-92db-8a1805494d13","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":2573794341},{"type":"v1","addr":"172.21.15.142:6818","nonce":2573794341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":2573794341},{"type":"v1","addr":"172.21.15.142:6822","nonce":2573794341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":2573794341},{"type":"v1","addr":"172.21.15.142:6830","nonce":2573794341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":2573794341},{"type":"v1","addr":"172.21.15.142:6826","nonce":2573794341}]},"public_addr":"172.21.15.142:6818/2573794341","cluster_addr":"172.21.15.142:6822/2573794341","heartbeat_back_addr":"172.21.15.142:6830/2573794341","heartbeat_front_addr":"172.21.15.142:6826/2573794341","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.185824+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.262103+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.225556+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:10.523459+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:10.706035+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.257339+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.301776+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.051960+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-12T09:46:27.845 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:27.844+0000 7fca1d5bb640 1 -- 172.21.15.73:0/1321350303 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fc9f806ae40 msgr2=0x7fc9f806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:27.845 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:27.844+0000 7fca1d5bb640 1 --2- 172.21.15.73:0/1321350303 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fc9f806ae40 0x7fc9f806d300 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fca08006fd0 tx=0x7fca08008040 comp rx=0 tx=0).stop 2023-12-12T09:46:27.845 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:27.844+0000 7fca1d5bb640 1 -- 172.21.15.73:0/1321350303 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fca180c7f30 msgr2=0x7fca181ed580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:27.845 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:27.844+0000 7fca1d5bb640 1 --2- 172.21.15.73:0/1321350303 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fca180c7f30 0x7fca181ed580 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7fca1000c7d0 tx=0x7fca1000cc90 comp rx=0 tx=0).stop 2023-12-12T09:46:27.845 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:27.844+0000 7fca1d5bb640 1 -- 172.21.15.73:0/1321350303 shutdown_connections 2023-12-12T09:46:27.845 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:27.844+0000 7fca1d5bb640 1 --2- 172.21.15.73:0/1321350303 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fc9f806ae40 0x7fc9f806d300 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:27.845 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:27.844+0000 7fca1d5bb640 1 --2- 172.21.15.73:0/1321350303 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fca180c7f30 0x7fca181ed580 unknown :-1 s=CLOSED pgs=869 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:27.845 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:27.844+0000 7fca1d5bb640 1 --2- 172.21.15.73:0/1321350303 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fca180c66f0 0x7fca181ed040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:27.845 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:27.844+0000 7fca1d5bb640 1 --2- 172.21.15.73:0/1321350303 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fca1806f320 0x7fca1806fa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:27.845 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:27.844+0000 7fca1d5bb640 1 -- 172.21.15.73:0/1321350303 >> 172.21.15.73:0/1321350303 conn(0x7fca180661f0 msgr2=0x7fca18153780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:46:27.845 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:27.844+0000 7fca1d5bb640 1 -- 172.21.15.73:0/1321350303 shutdown_connections 2023-12-12T09:46:27.845 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:27.844+0000 7fca1d5bb640 1 -- 172.21.15.73:0/1321350303 wait complete. 2023-12-12T09:46:27.863 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-12-12T09:46:28.066 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:28.066+0000 7f1f04607640 1 Processor -- start 2023-12-12T09:46:28.067 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:28.066+0000 7f1f04607640 1 -- start start 2023-12-12T09:46:28.068 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:28.067+0000 7f1f04607640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1efc14ea60 0x7f1efc0c5420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:28.068 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:28.067+0000 7f1f04607640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f1efc0a4c90 0x7f1efc0c0320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:28.068 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:28.067+0000 7f1f04607640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f1efc0c4420 0x7f1efc0c20b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:28.068 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:28.067+0000 7f1f04607640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1efc0c3390 con 0x7f1efc0a4c90 2023-12-12T09:46:28.068 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:28.067+0000 7f1f04607640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1efc151e60 con 0x7f1efc0c4420 2023-12-12T09:46:28.068 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:28.067+0000 7f1f04607640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1efc152140 con 0x7f1efc14ea60 2023-12-12T09:46:28.069 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:28.068+0000 7f1f01ba2640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f1efc0a4c90 0x7f1efc0c0320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:28.069 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:28.068+0000 7f1f01ba2640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f1efc0a4c90 0x7f1efc0c0320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:55012/0 (socket says 172.21.15.73:55012) 2023-12-12T09:46:28.069 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:28.068+0000 7f1f01ba2640 1 -- 172.21.15.73:0/1850847480 learned_addr learned my addr 172.21.15.73:0/1850847480 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:46:28.069 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:28.068+0000 7f1f01ba2640 1 -- 172.21.15.73:0/1850847480 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1efc14ea60 msgr2=0x7f1efc0c5420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:46:28.069 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:28.068+0000 7f1f01ba2640 1 --2- 172.21.15.73:0/1850847480 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1efc14ea60 0x7f1efc0c5420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:28.069 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:28.068+0000 7f1f01ba2640 1 -- 172.21.15.73:0/1850847480 >> v2:172.21.15.142:3300/0 conn(0x7f1efc0c4420 msgr2=0x7f1efc0c20b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:46:28.069 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:28.068+0000 7f1f01ba2640 1 --2- 172.21.15.73:0/1850847480 >> v2:172.21.15.142:3300/0 conn(0x7f1efc0c4420 0x7f1efc0c20b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:28.069 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:28.068+0000 7f1f01ba2640 1 -- 172.21.15.73:0/1850847480 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1efc0c3940 con 0x7f1efc0a4c90 2023-12-12T09:46:28.070 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:28.069+0000 7f1f01ba2640 1 --2- 172.21.15.73:0/1850847480 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1efc0a4c90 0x7f1efc0c0320 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7f1efc06b5a0 tx=0x7f1eec02b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c4c16d71db14ca9 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:46:28.070 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:28.070+0000 7f1f013a1640 1 -- 172.21.15.73:0/1850847480 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1eec0317e0 con 0x7f1efc0a4c90 2023-12-12T09:46:28.070 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:28.070+0000 7f1f013a1640 1 -- 172.21.15.73:0/1850847480 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1eec031940 con 0x7f1efc0a4c90 2023-12-12T09:46:28.070 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:28.070+0000 7f1f013a1640 1 -- 172.21.15.73:0/1850847480 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1eec031cd0 con 0x7f1efc0a4c90 2023-12-12T09:46:28.071 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:28.070+0000 7f1f04607640 1 -- 172.21.15.73:0/1850847480 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1efc0a4c90 msgr2=0x7f1efc0c0320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:28.071 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:28.070+0000 7f1f04607640 1 --2- 172.21.15.73:0/1850847480 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1efc0a4c90 0x7f1efc0c0320 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7f1efc06b5a0 tx=0x7f1eec02b880 comp rx=0 tx=0).stop 2023-12-12T09:46:28.071 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:28.071+0000 7f1f04607640 1 -- 172.21.15.73:0/1850847480 shutdown_connections 2023-12-12T09:46:28.071 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:28.071+0000 7f1f04607640 1 --2- 172.21.15.73:0/1850847480 >> v2:172.21.15.142:3300/0 conn(0x7f1efc0c4420 0x7f1efc0c20b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:28.072 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:28.071+0000 7f1f04607640 1 --2- 172.21.15.73:0/1850847480 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1efc0a4c90 0x7f1efc0c0320 unknown :-1 s=CLOSED pgs=870 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:28.072 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:28.071+0000 7f1f04607640 1 --2- 172.21.15.73:0/1850847480 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1efc14ea60 0x7f1efc0c5420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:28.072 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:28.071+0000 7f1f04607640 1 -- 172.21.15.73:0/1850847480 >> 172.21.15.73:0/1850847480 conn(0x7f1efc06a4e0 msgr2=0x7f1efc06a8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:46:28.072 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:28.071+0000 7f1f04607640 1 -- 172.21.15.73:0/1850847480 shutdown_connections 2023-12-12T09:46:28.072 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:28.071+0000 7f1f04607640 1 -- 172.21.15.73:0/1850847480 wait complete. 2023-12-12T09:46:28.073 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:28.072+0000 7f1f04607640 1 Processor -- start 2023-12-12T09:46:28.073 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:28.073+0000 7f1f04607640 1 -- start start 2023-12-12T09:46:28.075 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:28.074+0000 7f1f04607640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1efc0a4c90 0x7f1efc145a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:28.076 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:28.074+0000 7f1f04607640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1efc0c4420 0x7f1efc14f5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:28.076 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:28.074+0000 7f1f04607640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1efc14ea60 0x7f1efc1edcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:28.076 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:28.074+0000 7f1f04607640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1efc14cbd0 con 0x7f1efc0a4c90 2023-12-12T09:46:28.076 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:28.074+0000 7f1f04607640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1efc1508e0 con 0x7f1efc0c4420 2023-12-12T09:46:28.076 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:28.074+0000 7f1f04607640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1efc14fb00 con 0x7f1efc14ea60 2023-12-12T09:46:28.076 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:28.074+0000 7f1f023a3640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1efc0a4c90 0x7f1efc145a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:28.076 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:28.074+0000 7f1f023a3640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1efc0a4c90 0x7f1efc145a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:55014/0 (socket says 172.21.15.73:55014) 2023-12-12T09:46:28.076 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:28.074+0000 7f1f023a3640 1 -- 172.21.15.73:0/2560765495 learned_addr learned my addr 172.21.15.73:0/2560765495 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:46:28.076 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:28.074+0000 7f1f023a3640 1 -- 172.21.15.73:0/2560765495 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1efc14ea60 msgr2=0x7f1efc1edcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:28.076 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:28.074+0000 7f1f023a3640 1 --2- 172.21.15.73:0/2560765495 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1efc14ea60 0x7f1efc1edcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:28.076 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:28.074+0000 7f1f023a3640 1 -- 172.21.15.73:0/2560765495 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1efc0c4420 msgr2=0x7f1efc14f5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:28.076 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:28.074+0000 7f1f023a3640 1 --2- 172.21.15.73:0/2560765495 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1efc0c4420 0x7f1efc14f5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:28.076 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:28.074+0000 7f1f023a3640 1 -- 172.21.15.73:0/2560765495 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1eec0094d0 con 0x7f1efc0a4c90 2023-12-12T09:46:28.076 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:28.075+0000 7f1f023a3640 1 --2- 172.21.15.73:0/2560765495 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1efc0a4c90 0x7f1efc145a90 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7f1ef800b440 tx=0x7f1ef800b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:46:28.077 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:28.075+0000 7f1ef2ffd640 1 -- 172.21.15.73:0/2560765495 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ef8011890 con 0x7f1efc0a4c90 2023-12-12T09:46:28.077 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:28.075+0000 7f1ef2ffd640 1 -- 172.21.15.73:0/2560765495 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ef80119f0 con 0x7f1efc0a4c90 2023-12-12T09:46:28.077 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:28.075+0000 7f1f04607640 1 -- 172.21.15.73:0/2560765495 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1efc1ee5a0 con 0x7f1efc0a4c90 2023-12-12T09:46:28.077 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:28.075+0000 7f1ef2ffd640 1 -- 172.21.15.73:0/2560765495 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ef8011da0 con 0x7f1efc0a4c90 2023-12-12T09:46:28.077 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:28.075+0000 7f1f04607640 1 -- 172.21.15.73:0/2560765495 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1efc14c510 con 0x7f1efc0a4c90 2023-12-12T09:46:28.077 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:28.076+0000 7f1f04607640 1 -- 172.21.15.73:0/2560765495 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1efc067070 con 0x7f1efc0a4c90 2023-12-12T09:46:28.078 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:28.077+0000 7f1ef2ffd640 1 -- 172.21.15.73:0/2560765495 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f1ef801a400 con 0x7f1efc0a4c90 2023-12-12T09:46:28.079 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:28.079+0000 7f1ef2ffd640 1 --2- 172.21.15.73:0/2560765495 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f1ee006ae40 0x7f1ee006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:28.079 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:28.079+0000 7f1ef2ffd640 1 -- 172.21.15.73:0/2560765495 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1ef8089950 con 0x7f1efc0a4c90 2023-12-12T09:46:28.079 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:28.079+0000 7f1f01ba2640 1 --2- 172.21.15.73:0/2560765495 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f1ee006ae40 0x7f1ee006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:28.080 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:28.080+0000 7f1f01ba2640 1 --2- 172.21.15.73:0/2560765495 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f1ee006ae40 0x7f1ee006d300 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f1eec036000 tx=0x7f1eec030000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:46:28.084 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:28.084+0000 7f1ef2ffd640 1 -- 172.21.15.73:0/2560765495 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f1ef80549f0 con 0x7f1efc0a4c90 2023-12-12T09:46:28.317 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:28.316+0000 7f1f04607640 1 -- 172.21.15.73:0/2560765495 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f1efc152400 con 0x7f1efc0a4c90 2023-12-12T09:46:29.302 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:29.301+0000 7f1ef2ffd640 1 -- 172.21.15.73:0/2560765495 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v43) v1 ==== 118+0+0 (secure 0 0 0) 0x7f1ef8015020 con 0x7f1efc0a4c90 2023-12-12T09:46:29.306 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:29.304+0000 7f1f04607640 1 -- 172.21.15.73:0/2560765495 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f1ee006ae40 msgr2=0x7f1ee006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:29.306 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:29.304+0000 7f1f04607640 1 --2- 172.21.15.73:0/2560765495 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f1ee006ae40 0x7f1ee006d300 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f1eec036000 tx=0x7f1eec030000 comp rx=0 tx=0).stop 2023-12-12T09:46:29.306 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:29.304+0000 7f1f04607640 1 -- 172.21.15.73:0/2560765495 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1efc0a4c90 msgr2=0x7f1efc145a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:29.306 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:29.304+0000 7f1f04607640 1 --2- 172.21.15.73:0/2560765495 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1efc0a4c90 0x7f1efc145a90 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7f1ef800b440 tx=0x7f1ef800b900 comp rx=0 tx=0).stop 2023-12-12T09:46:29.306 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:29.304+0000 7f1f04607640 1 -- 172.21.15.73:0/2560765495 shutdown_connections 2023-12-12T09:46:29.306 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:29.304+0000 7f1f04607640 1 --2- 172.21.15.73:0/2560765495 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f1ee006ae40 0x7f1ee006d300 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:29.306 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:29.304+0000 7f1f04607640 1 --2- 172.21.15.73:0/2560765495 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1efc14ea60 0x7f1efc1edcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:29.307 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:29.304+0000 7f1f04607640 1 --2- 172.21.15.73:0/2560765495 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1efc0c4420 0x7f1efc14f5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:29.307 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:29.304+0000 7f1f04607640 1 --2- 172.21.15.73:0/2560765495 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1efc0a4c90 0x7f1efc145a90 unknown :-1 s=CLOSED pgs=871 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:29.307 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:29.304+0000 7f1f04607640 1 -- 172.21.15.73:0/2560765495 >> 172.21.15.73:0/2560765495 conn(0x7f1efc06a4e0 msgr2=0x7f1efc0c0010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:46:29.307 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:29.305+0000 7f1f04607640 1 -- 172.21.15.73:0/2560765495 shutdown_connections 2023-12-12T09:46:29.307 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:29.305+0000 7f1f04607640 1 -- 172.21.15.73:0/2560765495 wait complete. 2023-12-12T09:46:29.326 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-12-12T09:46:29.326 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-12-12T09:46:29.542 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:29.540+0000 7fe183fff640 1 Processor -- start 2023-12-12T09:46:29.542 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:29.540+0000 7fe183fff640 1 -- start start 2023-12-12T09:46:29.544 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:29.542+0000 7fe183fff640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fe184151ac0 0x7fe1840c7b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:29.544 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:29.542+0000 7fe183fff640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe184157a70 con 0x7fe1840c4cc0 2023-12-12T09:46:29.544 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:29.542+0000 7fe183fff640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe184157d50 con 0x7fe1840c8070 2023-12-12T09:46:29.544 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:29.542+0000 7fe183fff640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1840c71e0 con 0x7fe184151ac0 2023-12-12T09:46:29.544 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:29.542+0000 7fe1837fe640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7fe1840c4cc0 0x7fe18406b590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:55654/0 (socket says 172.21.15.73:55654) 2023-12-12T09:46:29.544 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:29.542+0000 7fe1837fe640 1 -- 172.21.15.73:0/609566495 learned_addr learned my addr 172.21.15.73:0/609566495 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-12T09:46:29.546 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:29.543+0000 7fe182ffd640 1 --2- 172.21.15.73:0/609566495 >> v2:172.21.15.142:3300/0 conn(0x7fe184151ac0 0x7fe1840c7b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:29.546 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:29.543+0000 7fe181ffb640 1 -- 172.21.15.73:0/609566495 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1280226860 0 0) 0x7fe184157a70 con 0x7fe1840c4cc0 2023-12-12T09:46:29.546 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:29.543+0000 7fe181ffb640 1 -- 172.21.15.73:0/609566495 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe170003520 con 0x7fe1840c4cc0 2023-12-12T09:46:29.546 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:29.543+0000 7fe181ffb640 1 -- 172.21.15.73:0/609566495 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2124715179 0 0) 0x7fe170003520 con 0x7fe1840c4cc0 2023-12-12T09:46:29.546 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:29.543+0000 7fe181ffb640 1 -- 172.21.15.73:0/609566495 >> v2:172.21.15.142:3300/0 conn(0x7fe184151ac0 msgr2=0x7fe1840c7b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:46:29.546 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:29.543+0000 7fe181ffb640 1 --2- 172.21.15.73:0/609566495 >> v2:172.21.15.142:3300/0 conn(0x7fe184151ac0 0x7fe1840c7b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:29.546 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:29.543+0000 7fe181ffb640 1 -- 172.21.15.73:0/609566495 >> v1:172.21.15.142:6789/0 conn(0x7fe1840c8070 legacy=0x7fe1840c45b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:29.546 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:29.543+0000 7fe181ffb640 1 -- 172.21.15.73:0/609566495 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe184158030 con 0x7fe1840c4cc0 2023-12-12T09:46:29.547 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:29.543+0000 7fe181ffb640 1 -- 172.21.15.73:0/609566495 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3186547832 0 0) 0x7fe174001670 con 0x7fe1840c4cc0 2023-12-12T09:46:29.547 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:29.544+0000 7fe181ffb640 1 -- 172.21.15.73:0/609566495 >> v1:172.21.15.73:6789/0 conn(0x7fe1840c4cc0 legacy=0x7fe18406b590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:29.547 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:29.544+0000 7fe181ffb640 1 --2- 172.21.15.73:0/609566495 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe170003970 0x7fe170003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:29.547 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:29.544+0000 7fe181ffb640 1 --2- 172.21.15.73:0/609566495 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe1700047c0 0x7fe170004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:29.547 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:29.544+0000 7fe181ffb640 1 --2- 172.21.15.73:0/609566495 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe1700052a0 0x7fe17000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:29.547 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:29.544+0000 7fe181ffb640 1 -- 172.21.15.73:0/609566495 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1840c71e0 con 0x7fe1700047c0 2023-12-12T09:46:29.547 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:29.544+0000 7fe181ffb640 1 -- 172.21.15.73:0/609566495 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe17000c170 con 0x7fe1700052a0 2023-12-12T09:46:29.547 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:29.544+0000 7fe181ffb640 1 -- 172.21.15.73:0/609566495 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe17000c330 con 0x7fe170003970 2023-12-12T09:46:29.547 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:29.544+0000 7fe1827fc640 1 --2- 172.21.15.73:0/609566495 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe1700047c0 0x7fe170004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:29.547 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:29.544+0000 7fe1837fe640 1 --2- 172.21.15.73:0/609566495 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe1700052a0 0x7fe17000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:29.547 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:29.544+0000 7fe182ffd640 1 --2- 172.21.15.73:0/609566495 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe170003970 0x7fe170003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:29.547 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:29.544+0000 7fe1827fc640 1 -- 172.21.15.73:0/609566495 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe170003970 msgr2=0x7fe170003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:46:29.547 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:29.544+0000 7fe1827fc640 1 --2- 172.21.15.73:0/609566495 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe170003970 0x7fe170003d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:29.547 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:29.544+0000 7fe1827fc640 1 -- 172.21.15.73:0/609566495 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe1700052a0 msgr2=0x7fe17000b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:46:29.548 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:29.544+0000 7fe1827fc640 1 --2- 172.21.15.73:0/609566495 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe1700052a0 0x7fe17000b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:29.548 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:29.544+0000 7fe1827fc640 1 -- 172.21.15.73:0/609566495 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe170003520 con 0x7fe1700047c0 2023-12-12T09:46:29.548 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:29.544+0000 7fe1837fe640 1 --2- 172.21.15.73:0/609566495 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe1700052a0 0x7fe17000b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:46:29.548 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:29.544+0000 7fe1837fe640 1 -- 172.21.15.73:0/609566495 reap_dead start 2023-12-12T09:46:29.549 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:29.545+0000 7fe1827fc640 1 --2- 172.21.15.73:0/609566495 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe1700047c0 0x7fe170004c40 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7fe1840cad30 tx=0x7fe1700057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31d31ccf6ec538e3 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:46:29.549 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:29.546+0000 7fe181ffb640 1 -- 172.21.15.73:0/609566495 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe16c003b70 con 0x7fe1700047c0 2023-12-12T09:46:29.549 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:29.546+0000 7fe181ffb640 1 -- 172.21.15.73:0/609566495 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe16c003cd0 con 0x7fe1700047c0 2023-12-12T09:46:29.549 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:29.546+0000 7fe181ffb640 1 -- 172.21.15.73:0/609566495 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe16c005310 con 0x7fe1700047c0 2023-12-12T09:46:29.549 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:29.546+0000 7fe183fff640 1 -- 172.21.15.73:0/609566495 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe1700047c0 msgr2=0x7fe170004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:29.549 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:29.546+0000 7fe183fff640 1 --2- 172.21.15.73:0/609566495 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe1700047c0 0x7fe170004c40 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7fe1840cad30 tx=0x7fe1700057f0 comp rx=0 tx=0).stop 2023-12-12T09:46:29.549 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:29.546+0000 7fe183fff640 1 -- 172.21.15.73:0/609566495 shutdown_connections 2023-12-12T09:46:29.549 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:29.546+0000 7fe183fff640 1 --2- 172.21.15.73:0/609566495 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe1700047c0 0x7fe170004c40 unknown :-1 s=CLOSED pgs=873 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:29.550 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:29.546+0000 7fe183fff640 1 -- 172.21.15.73:0/609566495 >> 172.21.15.73:0/609566495 conn(0x7fe1840ab7e0 msgr2=0x7fe1840abbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:46:29.550 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:29.546+0000 7fe183fff640 1 -- 172.21.15.73:0/609566495 shutdown_connections 2023-12-12T09:46:29.550 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:29.546+0000 7fe183fff640 1 -- 172.21.15.73:0/609566495 wait complete. 2023-12-12T09:46:29.551 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:29.548+0000 7fe183fff640 1 Processor -- start 2023-12-12T09:46:29.551 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:29.548+0000 7fe183fff640 1 -- start start 2023-12-12T09:46:29.551 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:29.549+0000 7fe183fff640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe1700047c0 0x7fe184155860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:29.551 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:29.549+0000 7fe183fff640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe1840af9c0 0x7fe1840c33a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:29.551 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:29.549+0000 7fe183fff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe1841574a0 0x7fe1840c14f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:29.551 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:29.549+0000 7fe183fff640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1841586f0 con 0x7fe1841574a0 2023-12-12T09:46:29.551 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:29.549+0000 7fe183fff640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1841eb3b0 con 0x7fe1840af9c0 2023-12-12T09:46:29.551 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:29.549+0000 7fe183fff640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1841eb0c0 con 0x7fe1700047c0 2023-12-12T09:46:29.551 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:29.549+0000 7fe1837fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe1841574a0 0x7fe1840c14f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:29.551 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:29.550+0000 7fe1837fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe1841574a0 0x7fe1840c14f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:55758/0 (socket says 172.21.15.73:55758) 2023-12-12T09:46:29.552 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:29.550+0000 7fe1837fe640 1 -- 172.21.15.73:0/2213847174 learned_addr learned my addr 172.21.15.73:0/2213847174 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:46:29.552 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:29.550+0000 7fe182ffd640 1 --2- 172.21.15.73:0/2213847174 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe1700047c0 0x7fe184155860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:29.553 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:29.550+0000 7fe1827fc640 1 --2- 172.21.15.73:0/2213847174 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe1840af9c0 0x7fe1840c33a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:29.553 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:29.550+0000 7fe1837fe640 1 -- 172.21.15.73:0/2213847174 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe1700047c0 msgr2=0x7fe184155860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:29.553 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:29.550+0000 7fe1837fe640 1 --2- 172.21.15.73:0/2213847174 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe1700047c0 0x7fe184155860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:29.553 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:29.550+0000 7fe1837fe640 1 -- 172.21.15.73:0/2213847174 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe1840af9c0 msgr2=0x7fe1840c33a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:29.553 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:29.550+0000 7fe1837fe640 1 --2- 172.21.15.73:0/2213847174 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe1840af9c0 0x7fe1840c33a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:29.553 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:29.550+0000 7fe1837fe640 1 -- 172.21.15.73:0/2213847174 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1840c1040 con 0x7fe1841574a0 2023-12-12T09:46:29.553 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:29.550+0000 7fe1827fc640 1 --2- 172.21.15.73:0/2213847174 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe1840af9c0 0x7fe1840c33a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:46:29.553 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:29.550+0000 7fe1837fe640 1 --2- 172.21.15.73:0/2213847174 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe1841574a0 0x7fe1840c14f0 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7fe18408b5b0 tx=0x7fe17400d950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:46:29.553 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:29.550+0000 7fe17bfff640 1 -- 172.21.15.73:0/2213847174 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe174007440 con 0x7fe1841574a0 2023-12-12T09:46:29.553 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:29.551+0000 7fe17bfff640 1 -- 172.21.15.73:0/2213847174 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1740075c0 con 0x7fe1841574a0 2023-12-12T09:46:29.554 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:29.551+0000 7fe183fff640 1 -- 172.21.15.73:0/2213847174 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1841570f0 con 0x7fe1841574a0 2023-12-12T09:46:29.554 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:29.551+0000 7fe17bfff640 1 -- 172.21.15.73:0/2213847174 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe174004a20 con 0x7fe1841574a0 2023-12-12T09:46:29.554 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:29.551+0000 7fe183fff640 1 -- 172.21.15.73:0/2213847174 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1840c1a30 con 0x7fe1841574a0 2023-12-12T09:46:29.554 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:29.552+0000 7fe183fff640 1 -- 172.21.15.73:0/2213847174 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe184156f50 con 0x7fe1841574a0 2023-12-12T09:46:29.554 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:29.553+0000 7fe17bfff640 1 -- 172.21.15.73:0/2213847174 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fe174004b80 con 0x7fe1841574a0 2023-12-12T09:46:29.555 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:29.554+0000 7fe17bfff640 1 --2- 172.21.15.73:0/2213847174 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fe16406ae70 0x7fe16406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:29.555 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:29.554+0000 7fe17bfff640 1 -- 172.21.15.73:0/2213847174 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe174089050 con 0x7fe1841574a0 2023-12-12T09:46:29.556 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:29.554+0000 7fe182ffd640 1 --2- 172.21.15.73:0/2213847174 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fe16406ae70 0x7fe16406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:29.556 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:29.555+0000 7fe182ffd640 1 --2- 172.21.15.73:0/2213847174 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fe16406ae70 0x7fe16406d330 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fe17c009a90 tx=0x7fe17c008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:46:29.560 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:29.559+0000 7fe17bfff640 1 -- 172.21.15.73:0/2213847174 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fe184156f50 con 0x7fe1841574a0 2023-12-12T09:46:29.787 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:29.786+0000 7fe183fff640 1 -- 172.21.15.73:0/2213847174 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fe184156f50 con 0x7fe1841574a0 2023-12-12T09:46:30.312 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:30.311+0000 7fe17bfff640 1 -- 172.21.15.73:0/2213847174 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v44) v1 ==== 122+0+0 (secure 0 0 0) 0x7fe184156f50 con 0x7fe1841574a0 2023-12-12T09:46:30.316 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:30.314+0000 7fe183fff640 1 -- 172.21.15.73:0/2213847174 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fe16406ae70 msgr2=0x7fe16406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:30.316 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:30.314+0000 7fe183fff640 1 --2- 172.21.15.73:0/2213847174 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fe16406ae70 0x7fe16406d330 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fe17c009a90 tx=0x7fe17c008040 comp rx=0 tx=0).stop 2023-12-12T09:46:30.316 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:30.314+0000 7fe183fff640 1 -- 172.21.15.73:0/2213847174 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe1841574a0 msgr2=0x7fe1840c14f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:30.316 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:30.314+0000 7fe183fff640 1 --2- 172.21.15.73:0/2213847174 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe1841574a0 0x7fe1840c14f0 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7fe18408b5b0 tx=0x7fe17400d950 comp rx=0 tx=0).stop 2023-12-12T09:46:30.316 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:30.314+0000 7fe183fff640 1 -- 172.21.15.73:0/2213847174 shutdown_connections 2023-12-12T09:46:30.316 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:30.314+0000 7fe183fff640 1 --2- 172.21.15.73:0/2213847174 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fe16406ae70 0x7fe16406d330 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:30.316 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:30.314+0000 7fe183fff640 1 --2- 172.21.15.73:0/2213847174 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe1841574a0 0x7fe1840c14f0 unknown :-1 s=CLOSED pgs=874 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:30.316 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:30.314+0000 7fe183fff640 1 --2- 172.21.15.73:0/2213847174 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe1840af9c0 0x7fe1840c33a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:30.317 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:30.314+0000 7fe183fff640 1 --2- 172.21.15.73:0/2213847174 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe1700047c0 0x7fe184155860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:30.317 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:30.314+0000 7fe183fff640 1 -- 172.21.15.73:0/2213847174 >> 172.21.15.73:0/2213847174 conn(0x7fe1840ab7e0 msgr2=0x7fe1840abbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:46:30.317 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:30.315+0000 7fe183fff640 1 -- 172.21.15.73:0/2213847174 shutdown_connections 2023-12-12T09:46:30.317 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:30.315+0000 7fe183fff640 1 -- 172.21.15.73:0/2213847174 wait complete. 2023-12-12T09:46:30.337 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-12-12T09:46:30.337 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-12T09:46:30.553 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:30.551+0000 7f2b942d3640 1 Processor -- start 2023-12-12T09:46:30.553 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:30.552+0000 7f2b942d3640 1 -- start start 2023-12-12T09:46:30.555 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:30.553+0000 7f2b942d3640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f2b8c0a50f0 0x7f2b8c0a9050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:30.555 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:30.553+0000 7f2b942d3640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f2b8c06bf20 0x7f2b8c0a9590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:30.555 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:30.553+0000 7f2b942d3640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b8c0c0b50 con 0x7f2b8c1552e0 2023-12-12T09:46:30.555 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:30.553+0000 7f2b942d3640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b8c0c04d0 con 0x7f2b8c06bf20 2023-12-12T09:46:30.555 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:30.553+0000 7f2b942d3640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b8c06c880 con 0x7f2b8c0a50f0 2023-12-12T09:46:30.555 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:30.553+0000 7f2b92870640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f2b8c06bf20 0x7f2b8c0a9590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:30.555 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:30.553+0000 7f2b9206f640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f2b8c1552e0 0x7f2b8c0c49c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:55662/0 (socket says 172.21.15.73:55662) 2023-12-12T09:46:30.555 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:30.553+0000 7f2b9206f640 1 -- 172.21.15.73:0/3362178360 learned_addr learned my addr 172.21.15.73:0/3362178360 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-12T09:46:30.556 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:30.554+0000 7f2b9186e640 1 --2- 172.21.15.73:0/3362178360 >> v2:172.21.15.142:3300/0 conn(0x7f2b8c0a50f0 0x7f2b8c0a9050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:30.556 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:30.554+0000 7f2b92870640 1 -- 172.21.15.73:0/3362178360 >> v2:172.21.15.142:3300/0 conn(0x7f2b8c0a50f0 msgr2=0x7f2b8c0a9050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:46:30.556 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:30.554+0000 7f2b92870640 1 --2- 172.21.15.73:0/3362178360 >> v2:172.21.15.142:3300/0 conn(0x7f2b8c0a50f0 0x7f2b8c0a9050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:30.556 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:30.554+0000 7f2b92870640 1 -- 172.21.15.73:0/3362178360 >> v1:172.21.15.73:6789/0 conn(0x7f2b8c1552e0 legacy=0x7f2b8c0c49c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:30.556 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:30.554+0000 7f2b92870640 1 -- 172.21.15.73:0/3362178360 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b8c06cb60 con 0x7f2b8c06bf20 2023-12-12T09:46:30.557 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:30.555+0000 7f2b92870640 1 --2- 172.21.15.73:0/3362178360 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2b8c06bf20 0x7f2b8c0a9590 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7f2b8c072230 tx=0x7f2b8402be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3f0f2f0cffb5906 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:46:30.557 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:30.555+0000 7f2b9106d640 1 -- 172.21.15.73:0/3362178360 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b8402cbf0 con 0x7f2b8c06bf20 2023-12-12T09:46:30.557 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:30.555+0000 7f2b9106d640 1 -- 172.21.15.73:0/3362178360 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b8402cd50 con 0x7f2b8c06bf20 2023-12-12T09:46:30.557 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:30.555+0000 7f2b9106d640 1 -- 172.21.15.73:0/3362178360 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b84034660 con 0x7f2b8c06bf20 2023-12-12T09:46:30.558 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:30.556+0000 7f2b942d3640 1 -- 172.21.15.73:0/3362178360 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2b8c06bf20 msgr2=0x7f2b8c0a9590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:30.558 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:30.556+0000 7f2b942d3640 1 --2- 172.21.15.73:0/3362178360 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2b8c06bf20 0x7f2b8c0a9590 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7f2b8c072230 tx=0x7f2b8402be40 comp rx=0 tx=0).stop 2023-12-12T09:46:30.558 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:30.556+0000 7f2b942d3640 1 -- 172.21.15.73:0/3362178360 shutdown_connections 2023-12-12T09:46:30.558 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:30.556+0000 7f2b942d3640 1 --2- 172.21.15.73:0/3362178360 >> v2:172.21.15.142:3300/0 conn(0x7f2b8c0a50f0 0x7f2b8c0a9050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:30.558 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:30.556+0000 7f2b942d3640 1 --2- 172.21.15.73:0/3362178360 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2b8c06bf20 0x7f2b8c0a9590 unknown :-1 s=CLOSED pgs=876 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:30.558 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:30.556+0000 7f2b942d3640 1 -- 172.21.15.73:0/3362178360 >> 172.21.15.73:0/3362178360 conn(0x7f2b8c0a8130 msgr2=0x7f2b8c0c24b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:46:30.558 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:30.556+0000 7f2b942d3640 1 -- 172.21.15.73:0/3362178360 shutdown_connections 2023-12-12T09:46:30.558 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:30.556+0000 7f2b942d3640 1 -- 172.21.15.73:0/3362178360 wait complete. 2023-12-12T09:46:30.559 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:30.558+0000 7f2b942d3640 1 Processor -- start 2023-12-12T09:46:30.559 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:30.558+0000 7f2b942d3640 1 -- start start 2023-12-12T09:46:30.562 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:30.559+0000 7f2b942d3640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2b8c06bf20 0x7f2b8c1deef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:30.562 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:30.559+0000 7f2b942d3640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2b8c0a50f0 0x7f2b8c1ea340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:30.562 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:30.559+0000 7f2b942d3640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2b8c1552e0 0x7f2b8c1ea880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:30.562 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:30.559+0000 7f2b942d3640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b8c1ee0a0 con 0x7f2b8c1552e0 2023-12-12T09:46:30.562 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:30.559+0000 7f2b942d3640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b8c1ee5d0 con 0x7f2b8c06bf20 2023-12-12T09:46:30.562 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:30.559+0000 7f2b942d3640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b8c1549e0 con 0x7f2b8c0a50f0 2023-12-12T09:46:30.563 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:30.559+0000 7f2b92870640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2b8c1552e0 0x7f2b8c1ea880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:30.563 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:30.559+0000 7f2b92870640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2b8c1552e0 0x7f2b8c1ea880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:55784/0 (socket says 172.21.15.73:55784) 2023-12-12T09:46:30.563 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:30.559+0000 7f2b92870640 1 -- 172.21.15.73:0/3116721375 learned_addr learned my addr 172.21.15.73:0/3116721375 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:46:30.563 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:30.560+0000 7f2b9206f640 1 --2- 172.21.15.73:0/3116721375 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2b8c06bf20 0x7f2b8c1deef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:30.563 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:30.560+0000 7f2b9186e640 1 --2- 172.21.15.73:0/3116721375 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2b8c0a50f0 0x7f2b8c1ea340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:30.563 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:30.560+0000 7f2b92870640 1 -- 172.21.15.73:0/3116721375 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2b8c0a50f0 msgr2=0x7f2b8c1ea340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:30.563 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:30.560+0000 7f2b92870640 1 --2- 172.21.15.73:0/3116721375 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2b8c0a50f0 0x7f2b8c1ea340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:30.563 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:30.560+0000 7f2b92870640 1 -- 172.21.15.73:0/3116721375 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2b8c06bf20 msgr2=0x7f2b8c1deef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:30.563 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:30.560+0000 7f2b92870640 1 --2- 172.21.15.73:0/3116721375 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2b8c06bf20 0x7f2b8c1deef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:30.563 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:30.560+0000 7f2b92870640 1 -- 172.21.15.73:0/3116721375 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b84009a70 con 0x7f2b8c1552e0 2023-12-12T09:46:30.563 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:30.560+0000 7f2b92870640 1 --2- 172.21.15.73:0/3116721375 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2b8c1552e0 0x7f2b8c1ea880 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7f2b84009e50 tx=0x7f2b84004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:46:30.563 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:30.560+0000 7f2b82ffd640 1 -- 172.21.15.73:0/3116721375 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b84040650 con 0x7f2b8c1552e0 2023-12-12T09:46:30.563 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:30.560+0000 7f2b82ffd640 1 -- 172.21.15.73:0/3116721375 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b840407d0 con 0x7f2b8c1552e0 2023-12-12T09:46:30.563 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:30.560+0000 7f2b82ffd640 1 -- 172.21.15.73:0/3116721375 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b84040b80 con 0x7f2b8c1552e0 2023-12-12T09:46:30.564 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:30.561+0000 7f2b942d3640 1 -- 172.21.15.73:0/3116721375 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b8c071000 con 0x7f2b8c1552e0 2023-12-12T09:46:30.564 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:30.561+0000 7f2b942d3640 1 -- 172.21.15.73:0/3116721375 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b8c154670 con 0x7f2b8c1552e0 2023-12-12T09:46:30.564 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:30.562+0000 7f2b942d3640 1 -- 172.21.15.73:0/3116721375 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b8c154b20 con 0x7f2b8c1552e0 2023-12-12T09:46:30.564 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:30.563+0000 7f2b82ffd640 1 -- 172.21.15.73:0/3116721375 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f2b84040ce0 con 0x7f2b8c1552e0 2023-12-12T09:46:30.565 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:30.564+0000 7f2b82ffd640 1 --2- 172.21.15.73:0/3116721375 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f2b7006ae40 0x7f2b7006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:30.565 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:30.564+0000 7f2b82ffd640 1 -- 172.21.15.73:0/3116721375 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2b840ac750 con 0x7f2b8c1552e0 2023-12-12T09:46:30.566 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:30.564+0000 7f2b9206f640 1 --2- 172.21.15.73:0/3116721375 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f2b7006ae40 0x7f2b7006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:30.566 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:30.565+0000 7f2b9206f640 1 --2- 172.21.15.73:0/3116721375 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f2b7006ae40 0x7f2b7006d300 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f2b88005880 tx=0x7f2b88009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:46:30.570 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:30.569+0000 7f2b82ffd640 1 -- 172.21.15.73:0/3116721375 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f2b8c154b20 con 0x7f2b8c1552e0 2023-12-12T09:46:30.797 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:30.796+0000 7f2b942d3640 1 -- 172.21.15.73:0/3116721375 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2b8c154b20 con 0x7f2b8c1552e0 2023-12-12T09:46:30.798 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:30.797+0000 7f2b82ffd640 1 -- 172.21.15.73:0/3116721375 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 44 v44) v1 ==== 94+0+4918 (secure 0 0 0) 0x7f2b8c154b20 con 0x7f2b8c1552e0 2023-12-12T09:46:30.799 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-12T09:46:30.799 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":44,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4943,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6835/3004685650","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6833","nonce":3004685650},{"type":"v1","addr":"172.21.15.142:6835","nonce":3004685650}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40},{"gid":5365,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6834/3290362874","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6832","nonce":3290362874},{"type":"v1","addr":"172.21.15.142:6834","nonce":3290362874}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40},{"gid":6426,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6836/340095591","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":340095591},{"type":"v1","addr":"172.21.15.73:6836","nonce":340095591}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40}],"filesystems":[{"mdsmap":{"epoch":44,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-12T09:46:26.429627+0000","modified":"2023-12-12T09:46:29.788335+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6429},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6429":{"gid":6429,"name":"c","rank":0,"incarnation":41,"state":"up:active","state_seq":3,"addr":"172.21.15.73:6837/2352791649","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6835","nonce":2352791649},{"type":"v1","addr":"172.21.15.73:6837","nonce":2352791649}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-12-12T09:46:30.799 INFO:teuthology.orchestra.run.smithi073.stderr:dumped fsmap epoch 44 2023-12-12T09:46:30.801 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:30.799+0000 7f2b942d3640 1 -- 172.21.15.73:0/3116721375 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f2b7006ae40 msgr2=0x7f2b7006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:30.801 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:30.800+0000 7f2b942d3640 1 --2- 172.21.15.73:0/3116721375 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f2b7006ae40 0x7f2b7006d300 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f2b88005880 tx=0x7f2b88009040 comp rx=0 tx=0).stop 2023-12-12T09:46:30.801 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:30.800+0000 7f2b942d3640 1 -- 172.21.15.73:0/3116721375 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2b8c1552e0 msgr2=0x7f2b8c1ea880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:30.801 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:30.800+0000 7f2b942d3640 1 --2- 172.21.15.73:0/3116721375 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2b8c1552e0 0x7f2b8c1ea880 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7f2b84009e50 tx=0x7f2b84004a40 comp rx=0 tx=0).stop 2023-12-12T09:46:30.801 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:30.800+0000 7f2b942d3640 1 -- 172.21.15.73:0/3116721375 shutdown_connections 2023-12-12T09:46:30.802 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:30.800+0000 7f2b942d3640 1 --2- 172.21.15.73:0/3116721375 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f2b7006ae40 0x7f2b7006d300 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:30.802 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:30.800+0000 7f2b942d3640 1 --2- 172.21.15.73:0/3116721375 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2b8c1552e0 0x7f2b8c1ea880 unknown :-1 s=CLOSED pgs=877 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:30.802 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:30.800+0000 7f2b942d3640 1 --2- 172.21.15.73:0/3116721375 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2b8c0a50f0 0x7f2b8c1ea340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:30.802 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:30.800+0000 7f2b942d3640 1 --2- 172.21.15.73:0/3116721375 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2b8c06bf20 0x7f2b8c1deef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:30.802 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:30.800+0000 7f2b942d3640 1 -- 172.21.15.73:0/3116721375 >> 172.21.15.73:0/3116721375 conn(0x7f2b8c0a8130 msgr2=0x7f2b8c0a6940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:46:30.802 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:30.800+0000 7f2b942d3640 1 -- 172.21.15.73:0/3116721375 shutdown_connections 2023-12-12T09:46:30.802 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:30.800+0000 7f2b942d3640 1 -- 172.21.15.73:0/3116721375 wait complete. 2023-12-12T09:46:30.821 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-12T09:46:31.023 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:31.021+0000 7f6788d25640 1 Processor -- start 2023-12-12T09:46:31.023 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:31.021+0000 7f6788d25640 1 -- start start 2023-12-12T09:46:31.025 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:31.023+0000 7f6788d25640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f678414fa40 0x7f678406a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:31.025 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:31.023+0000 7f6788d25640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f67840c5070 0x7f67840c40c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:31.025 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:31.023+0000 7f6788d25640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6784152610 con 0x7f678406db70 2023-12-12T09:46:31.025 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:31.023+0000 7f6788d25640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67841528f0 con 0x7f678414fa40 2023-12-12T09:46:31.025 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:31.023+0000 7f6788d25640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6784152bd0 con 0x7f67840c5070 2023-12-12T09:46:31.025 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:31.023+0000 7f678259c640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f678414fa40 0x7f678406a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:31.025 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:31.023+0000 7f678259c640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f678414fa40 0x7f678406a4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:55792/0 (socket says 172.21.15.73:55792) 2023-12-12T09:46:31.025 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:31.023+0000 7f678259c640 1 -- 172.21.15.73:0/3274039157 learned_addr learned my addr 172.21.15.73:0/3274039157 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:46:31.025 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:31.023+0000 7f678259c640 1 -- 172.21.15.73:0/3274039157 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f67840c5070 msgr2=0x7f67840c40c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:46:31.025 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:31.023+0000 7f678259c640 1 --2- 172.21.15.73:0/3274039157 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f67840c5070 0x7f67840c40c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:31.025 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:31.023+0000 7f678259c640 1 -- 172.21.15.73:0/3274039157 >> v1:172.21.15.142:6789/0 conn(0x7f678406db70 legacy=0x7f67840c39b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:46:31.025 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:31.023+0000 7f678259c640 1 -- 172.21.15.73:0/3274039157 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6784152eb0 con 0x7f678414fa40 2023-12-12T09:46:31.026 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:31.025+0000 7f678259c640 1 --2- 172.21.15.73:0/3274039157 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f678414fa40 0x7f678406a4e0 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7f6774009870 tx=0x7f677402b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f6df4f43a23029a server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:46:31.026 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:31.025+0000 7f678159a640 1 -- 172.21.15.73:0/3274039157 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6774031640 con 0x7f678414fa40 2023-12-12T09:46:31.026 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:31.025+0000 7f678159a640 1 -- 172.21.15.73:0/3274039157 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67740317a0 con 0x7f678414fa40 2023-12-12T09:46:31.026 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:31.025+0000 7f678159a640 1 -- 172.21.15.73:0/3274039157 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6774031b30 con 0x7f678414fa40 2023-12-12T09:46:31.027 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:31.026+0000 7f6788d25640 1 -- 172.21.15.73:0/3274039157 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f678414fa40 msgr2=0x7f678406a4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:31.027 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:31.026+0000 7f6788d25640 1 --2- 172.21.15.73:0/3274039157 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f678414fa40 0x7f678406a4e0 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7f6774009870 tx=0x7f677402b8f0 comp rx=0 tx=0).stop 2023-12-12T09:46:31.027 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:31.026+0000 7f6788d25640 1 -- 172.21.15.73:0/3274039157 shutdown_connections 2023-12-12T09:46:31.027 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:31.026+0000 7f6788d25640 1 --2- 172.21.15.73:0/3274039157 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f67840c5070 0x7f67840c40c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:31.028 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:31.026+0000 7f6788d25640 1 --2- 172.21.15.73:0/3274039157 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f678414fa40 0x7f678406a4e0 unknown :-1 s=CLOSED pgs=878 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:31.028 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:31.026+0000 7f6788d25640 1 -- 172.21.15.73:0/3274039157 >> 172.21.15.73:0/3274039157 conn(0x7f67840a8130 msgr2=0x7f67840c24b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:46:31.028 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:31.026+0000 7f6788d25640 1 -- 172.21.15.73:0/3274039157 shutdown_connections 2023-12-12T09:46:31.028 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:31.026+0000 7f6788d25640 1 -- 172.21.15.73:0/3274039157 wait complete. 2023-12-12T09:46:31.029 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:31.027+0000 7f6788d25640 1 Processor -- start 2023-12-12T09:46:31.029 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:31.027+0000 7f6788d25640 1 -- start start 2023-12-12T09:46:31.030 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:31.028+0000 7f6788d25640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f678406db70 0x7f67840a9210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:31.030 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:31.028+0000 7f6788d25640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f67840c5070 0x7f67840bf050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:31.031 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:31.028+0000 7f6788d25640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f678414fa40 0x7f67841480a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:31.031 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:31.028+0000 7f6788d25640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6784151a00 con 0x7f678414fa40 2023-12-12T09:46:31.031 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:31.028+0000 7f6788d25640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6784150df0 con 0x7f678406db70 2023-12-12T09:46:31.031 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:31.028+0000 7f6788d25640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67840a9750 con 0x7f67840c5070 2023-12-12T09:46:31.031 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:31.029+0000 7f6782d9d640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f678414fa40 0x7f67841480a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:31.031 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:31.029+0000 7f6782d9d640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f678414fa40 0x7f67841480a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:55800/0 (socket says 172.21.15.73:55800) 2023-12-12T09:46:31.031 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:31.029+0000 7f6782d9d640 1 -- 172.21.15.73:0/1177007354 learned_addr learned my addr 172.21.15.73:0/1177007354 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:46:31.031 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:31.029+0000 7f6782d9d640 1 -- 172.21.15.73:0/1177007354 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f67840c5070 msgr2=0x7f67840bf050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:31.031 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:31.029+0000 7f6782d9d640 1 --2- 172.21.15.73:0/1177007354 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f67840c5070 0x7f67840bf050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:31.031 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:31.029+0000 7f6782d9d640 1 -- 172.21.15.73:0/1177007354 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f678406db70 msgr2=0x7f67840a9210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:31.031 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:31.029+0000 7f6782d9d640 1 --2- 172.21.15.73:0/1177007354 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f678406db70 0x7f67840a9210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:31.031 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:31.029+0000 7f6782d9d640 1 -- 172.21.15.73:0/1177007354 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67740094d0 con 0x7f678414fa40 2023-12-12T09:46:31.032 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:31.029+0000 7f6782d9d640 1 --2- 172.21.15.73:0/1177007354 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f678414fa40 0x7f67841480a0 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7f677c00b9a0 tx=0x7f677c00be60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:46:31.032 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:31.030+0000 7f6772ffd640 1 -- 172.21.15.73:0/1177007354 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f677c00cba0 con 0x7f678414fa40 2023-12-12T09:46:31.032 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:31.030+0000 7f6772ffd640 1 -- 172.21.15.73:0/1177007354 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f677c00cd20 con 0x7f678414fa40 2023-12-12T09:46:31.033 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:31.030+0000 7f6788d25640 1 -- 172.21.15.73:0/1177007354 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f67840a99f0 con 0x7f678414fa40 2023-12-12T09:46:31.033 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:31.030+0000 7f6772ffd640 1 -- 172.21.15.73:0/1177007354 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f677c014680 con 0x7f678414fa40 2023-12-12T09:46:31.033 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:31.030+0000 7f6788d25640 1 -- 172.21.15.73:0/1177007354 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6784151340 con 0x7f678414fa40 2023-12-12T09:46:31.033 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:31.031+0000 7f6788d25640 1 -- 172.21.15.73:0/1177007354 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6784067580 con 0x7f678414fa40 2023-12-12T09:46:31.033 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:31.032+0000 7f6772ffd640 1 -- 172.21.15.73:0/1177007354 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f677c01d3b0 con 0x7f678414fa40 2023-12-12T09:46:31.034 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:31.033+0000 7f6772ffd640 1 --2- 172.21.15.73:0/1177007354 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f676406ae40 0x7f676406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:31.034 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:31.033+0000 7f6772ffd640 1 -- 172.21.15.73:0/1177007354 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f677c0895c0 con 0x7f678414fa40 2023-12-12T09:46:31.034 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:31.033+0000 7f678259c640 1 --2- 172.21.15.73:0/1177007354 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f676406ae40 0x7f676406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:31.035 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:31.034+0000 7f678259c640 1 --2- 172.21.15.73:0/1177007354 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f676406ae40 0x7f676406d300 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f6774036000 tx=0x7f6774030000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:46:31.038 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:31.037+0000 7f6772ffd640 1 -- 172.21.15.73:0/1177007354 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f677c054660 con 0x7f678414fa40 2023-12-12T09:46:31.230 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:31.228+0000 7f6788d25640 1 -- 172.21.15.73:0/1177007354 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f67840c4280 con 0x7f678414fa40 2023-12-12T09:46:31.232 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:31.230+0000 7f6772ffd640 1 -- 172.21.15.73:0/1177007354 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v75) v1 ==== 74+0+16572 (secure 0 0 0) 0x7f677c057c80 con 0x7f678414fa40 2023-12-12T09:46:31.232 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-12T09:46:31.232 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":75,"fsid":"ba240992-02b8-4c7e-92f2-27eb29ac433b","created":"2023-12-12T09:43:02.454719+0000","modified":"2023-12-12T09:46:27.973444+0000","last_up_change":"2023-12-12T09:43:13.913440+0000","last_in_change":"2023-12-12T09:43:05.925348+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-12T09:43:15.525508+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2023-12-12T09:46:24.716544+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2023-12-12T09:46:25.435954+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"dd9074be-dbe2-4c34-9896-a4223d8d3940","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":4047810203},{"type":"v1","addr":"172.21.15.73:6801","nonce":4047810203}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":4047810203},{"type":"v1","addr":"172.21.15.73:6803","nonce":4047810203}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":4047810203},{"type":"v1","addr":"172.21.15.73:6807","nonce":4047810203}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":4047810203},{"type":"v1","addr":"172.21.15.73:6805","nonce":4047810203}]},"public_addr":"172.21.15.73:6801/4047810203","cluster_addr":"172.21.15.73:6803/4047810203","heartbeat_back_addr":"172.21.15.73:6807/4047810203","heartbeat_front_addr":"172.21.15.73:6805/4047810203","state":["exists","up"]},{"osd":1,"uuid":"c4a05052-96d4-4758-a4e1-1a37f1e07fed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":1356058331},{"type":"v1","addr":"172.21.15.73:6824","nonce":1356058331}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":1356058331},{"type":"v1","addr":"172.21.15.73:6827","nonce":1356058331}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":1356058331},{"type":"v1","addr":"172.21.15.73:6831","nonce":1356058331}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":1356058331},{"type":"v1","addr":"172.21.15.73:6829","nonce":1356058331}]},"public_addr":"172.21.15.73:6824/1356058331","cluster_addr":"172.21.15.73:6827/1356058331","heartbeat_back_addr":"172.21.15.73:6831/1356058331","heartbeat_front_addr":"172.21.15.73:6829/1356058331","state":["exists","up"]},{"osd":2,"uuid":"512bc8ac-72c2-40d4-b3d2-d867a92c5213","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":1228903316},{"type":"v1","addr":"172.21.15.73:6817","nonce":1228903316}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":1228903316},{"type":"v1","addr":"172.21.15.73:6819","nonce":1228903316}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6823","nonce":1228903316},{"type":"v1","addr":"172.21.15.73:6825","nonce":1228903316}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":1228903316},{"type":"v1","addr":"172.21.15.73:6821","nonce":1228903316}]},"public_addr":"172.21.15.73:6817/1228903316","cluster_addr":"172.21.15.73:6819/1228903316","heartbeat_back_addr":"172.21.15.73:6825/1228903316","heartbeat_front_addr":"172.21.15.73:6821/1228903316","state":["exists","up"]},{"osd":3,"uuid":"3d1a91e0-42bf-437a-8eae-8d357c8f63a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":1293329670},{"type":"v1","addr":"172.21.15.73:6809","nonce":1293329670}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6810","nonce":1293329670},{"type":"v1","addr":"172.21.15.73:6811","nonce":1293329670}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":1293329670},{"type":"v1","addr":"172.21.15.73:6815","nonce":1293329670}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":1293329670},{"type":"v1","addr":"172.21.15.73:6813","nonce":1293329670}]},"public_addr":"172.21.15.73:6809/1293329670","cluster_addr":"172.21.15.73:6811/1293329670","heartbeat_back_addr":"172.21.15.73:6815/1293329670","heartbeat_front_addr":"172.21.15.73:6813/1293329670","state":["exists","up"]},{"osd":4,"uuid":"4b302fff-834c-4069-ac19-00e46f6c87b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":3727975702},{"type":"v1","addr":"172.21.15.142:6801","nonce":3727975702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":3727975702},{"type":"v1","addr":"172.21.15.142:6803","nonce":3727975702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6809","nonce":3727975702},{"type":"v1","addr":"172.21.15.142:6811","nonce":3727975702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6805","nonce":3727975702},{"type":"v1","addr":"172.21.15.142:6807","nonce":3727975702}]},"public_addr":"172.21.15.142:6801/3727975702","cluster_addr":"172.21.15.142:6803/3727975702","heartbeat_back_addr":"172.21.15.142:6811/3727975702","heartbeat_front_addr":"172.21.15.142:6807/3727975702","state":["exists","up"]},{"osd":5,"uuid":"d7cdace2-67d0-45cc-95f2-515cf6ef1b82","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6817","nonce":2353193632},{"type":"v1","addr":"172.21.15.142:6819","nonce":2353193632}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6821","nonce":2353193632},{"type":"v1","addr":"172.21.15.142:6823","nonce":2353193632}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6829","nonce":2353193632},{"type":"v1","addr":"172.21.15.142:6831","nonce":2353193632}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6825","nonce":2353193632},{"type":"v1","addr":"172.21.15.142:6827","nonce":2353193632}]},"public_addr":"172.21.15.142:6819/2353193632","cluster_addr":"172.21.15.142:6823/2353193632","heartbeat_back_addr":"172.21.15.142:6831/2353193632","heartbeat_front_addr":"172.21.15.142:6827/2353193632","state":["exists","up"]},{"osd":6,"uuid":"649ce78a-5626-445c-aedc-a651ed05a6f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":2006111986},{"type":"v1","addr":"172.21.15.142:6806","nonce":2006111986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":2006111986},{"type":"v1","addr":"172.21.15.142:6810","nonce":2006111986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":2006111986},{"type":"v1","addr":"172.21.15.142:6815","nonce":2006111986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":2006111986},{"type":"v1","addr":"172.21.15.142:6813","nonce":2006111986}]},"public_addr":"172.21.15.142:6806/2006111986","cluster_addr":"172.21.15.142:6810/2006111986","heartbeat_back_addr":"172.21.15.142:6815/2006111986","heartbeat_front_addr":"172.21.15.142:6813/2006111986","state":["exists","up"]},{"osd":7,"uuid":"af15ae3b-c1d0-4acf-92db-8a1805494d13","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":2573794341},{"type":"v1","addr":"172.21.15.142:6818","nonce":2573794341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":2573794341},{"type":"v1","addr":"172.21.15.142:6822","nonce":2573794341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":2573794341},{"type":"v1","addr":"172.21.15.142:6830","nonce":2573794341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":2573794341},{"type":"v1","addr":"172.21.15.142:6826","nonce":2573794341}]},"public_addr":"172.21.15.142:6818/2573794341","cluster_addr":"172.21.15.142:6822/2573794341","heartbeat_back_addr":"172.21.15.142:6830/2573794341","heartbeat_front_addr":"172.21.15.142:6826/2573794341","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.185824+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.262103+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.225556+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:10.523459+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:10.706035+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.257339+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.301776+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.051960+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-12T09:46:31.234 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:31.233+0000 7f6788d25640 1 -- 172.21.15.73:0/1177007354 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f676406ae40 msgr2=0x7f676406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:31.234 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:31.233+0000 7f6788d25640 1 --2- 172.21.15.73:0/1177007354 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f676406ae40 0x7f676406d300 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f6774036000 tx=0x7f6774030000 comp rx=0 tx=0).stop 2023-12-12T09:46:31.235 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:31.233+0000 7f6788d25640 1 -- 172.21.15.73:0/1177007354 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f678414fa40 msgr2=0x7f67841480a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:31.235 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:31.233+0000 7f6788d25640 1 --2- 172.21.15.73:0/1177007354 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f678414fa40 0x7f67841480a0 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7f677c00b9a0 tx=0x7f677c00be60 comp rx=0 tx=0).stop 2023-12-12T09:46:31.235 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:31.233+0000 7f6788d25640 1 -- 172.21.15.73:0/1177007354 shutdown_connections 2023-12-12T09:46:31.235 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:31.233+0000 7f6788d25640 1 --2- 172.21.15.73:0/1177007354 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f676406ae40 0x7f676406d300 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:31.235 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:31.233+0000 7f6788d25640 1 --2- 172.21.15.73:0/1177007354 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f678414fa40 0x7f67841480a0 unknown :-1 s=CLOSED pgs=879 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:31.235 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:31.233+0000 7f6788d25640 1 --2- 172.21.15.73:0/1177007354 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f67840c5070 0x7f67840bf050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:31.235 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:31.233+0000 7f6788d25640 1 --2- 172.21.15.73:0/1177007354 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f678406db70 0x7f67840a9210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:31.235 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:31.233+0000 7f6788d25640 1 -- 172.21.15.73:0/1177007354 >> 172.21.15.73:0/1177007354 conn(0x7f67840a8130 msgr2=0x7f67840c63b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:46:31.235 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:31.233+0000 7f6788d25640 1 -- 172.21.15.73:0/1177007354 shutdown_connections 2023-12-12T09:46:31.235 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:31.233+0000 7f6788d25640 1 -- 172.21.15.73:0/1177007354 wait complete. 2023-12-12T09:46:31.253 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-12-12T09:46:31.253 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-12T09:46:31.312 INFO:tasks.ceph.mds.c.smithi073.stderr:2023-12-12T09:46:31.310+0000 7f2c93227640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-12-12T09:46:31.459 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:31.457+0000 7fcb7dc78640 1 Processor -- start 2023-12-12T09:46:31.459 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:31.457+0000 7fcb7dc78640 1 -- start start 2023-12-12T09:46:31.460 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:31.459+0000 7fcb7dc78640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fcb780a9470 0x7fcb780aae00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:31.460 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:31.459+0000 7fcb7dc78640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb78153300 con 0x7fcb7814fbb0 2023-12-12T09:46:31.461 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:31.459+0000 7fcb7dc78640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb780c2160 con 0x7fcb780ab340 2023-12-12T09:46:31.461 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:31.459+0000 7fcb7dc78640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb780aa000 con 0x7fcb780a9470 2023-12-12T09:46:31.461 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:31.459+0000 7fcb7cc76640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7fcb7814fbb0 0x7fcb780c09e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:55672/0 (socket says 172.21.15.73:55672) 2023-12-12T09:46:31.461 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:31.459+0000 7fcb7cc76640 1 -- 172.21.15.73:0/1701585171 learned_addr learned my addr 172.21.15.73:0/1701585171 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-12T09:46:31.463 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:31.460+0000 7fcb77fff640 1 --2- 172.21.15.73:0/1701585171 >> v2:172.21.15.142:3300/0 conn(0x7fcb780a9470 0x7fcb780aae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:31.463 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:31.460+0000 7fcb777fe640 1 -- 172.21.15.73:0/1701585171 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1682189393 0 0) 0x7fcb78153300 con 0x7fcb7814fbb0 2023-12-12T09:46:31.463 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:31.460+0000 7fcb777fe640 1 -- 172.21.15.73:0/1701585171 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcb68003520 con 0x7fcb7814fbb0 2023-12-12T09:46:31.463 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:31.460+0000 7fcb777fe640 1 -- 172.21.15.73:0/1701585171 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1871124947 0 0) 0x7fcb68003520 con 0x7fcb7814fbb0 2023-12-12T09:46:31.463 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:31.460+0000 7fcb777fe640 1 -- 172.21.15.73:0/1701585171 >> v2:172.21.15.142:3300/0 conn(0x7fcb780a9470 msgr2=0x7fcb780aae00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:46:31.463 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:31.460+0000 7fcb777fe640 1 --2- 172.21.15.73:0/1701585171 >> v2:172.21.15.142:3300/0 conn(0x7fcb780a9470 0x7fcb780aae00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:31.463 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:31.460+0000 7fcb777fe640 1 -- 172.21.15.73:0/1701585171 >> v1:172.21.15.142:6789/0 conn(0x7fcb780ab340 legacy=0x7fcb7815cbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:31.463 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:31.460+0000 7fcb777fe640 1 -- 172.21.15.73:0/1701585171 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb78153020 con 0x7fcb7814fbb0 2023-12-12T09:46:31.463 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:31.460+0000 7fcb777fe640 1 -- 172.21.15.73:0/1701585171 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3186547832 0 0) 0x7fcb6c001670 con 0x7fcb7814fbb0 2023-12-12T09:46:31.464 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:31.460+0000 7fcb777fe640 1 -- 172.21.15.73:0/1701585171 >> v1:172.21.15.73:6789/0 conn(0x7fcb7814fbb0 legacy=0x7fcb780c09e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:31.464 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:31.460+0000 7fcb777fe640 1 --2- 172.21.15.73:0/1701585171 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcb680039c0 0x7fcb68003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:31.464 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:31.460+0000 7fcb777fe640 1 --2- 172.21.15.73:0/1701585171 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcb680047c0 0x7fcb68004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:31.464 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:31.460+0000 7fcb777fe640 1 --2- 172.21.15.73:0/1701585171 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcb680051d0 0x7fcb6800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:31.464 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:31.460+0000 7fcb777fe640 1 -- 172.21.15.73:0/1701585171 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb780aa000 con 0x7fcb680039c0 2023-12-12T09:46:31.464 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:31.460+0000 7fcb777fe640 1 -- 172.21.15.73:0/1701585171 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb6800c120 con 0x7fcb680051d0 2023-12-12T09:46:31.464 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:31.460+0000 7fcb777fe640 1 -- 172.21.15.73:0/1701585171 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb6800c2e0 con 0x7fcb680047c0 2023-12-12T09:46:31.464 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:31.460+0000 7fcb7cc76640 1 --2- 172.21.15.73:0/1701585171 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcb680039c0 0x7fcb68003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:31.464 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:31.461+0000 7fcb77fff640 1 --2- 172.21.15.73:0/1701585171 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcb680047c0 0x7fcb68004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:31.464 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:31.461+0000 7fcb7cc76640 1 -- 172.21.15.73:0/1701585171 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcb680047c0 msgr2=0x7fcb68004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:46:31.464 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:31.461+0000 7fcb7cc76640 1 --2- 172.21.15.73:0/1701585171 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcb680047c0 0x7fcb68004c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:31.464 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:31.461+0000 7fcb7cc76640 1 -- 172.21.15.73:0/1701585171 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcb680051d0 msgr2=0x7fcb6800b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:46:31.464 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:31.461+0000 7fcb7d477640 1 --2- 172.21.15.73:0/1701585171 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcb680051d0 0x7fcb6800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:31.464 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:31.461+0000 7fcb7cc76640 1 --2- 172.21.15.73:0/1701585171 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcb680051d0 0x7fcb6800b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:31.465 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:31.461+0000 7fcb7cc76640 1 -- 172.21.15.73:0/1701585171 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb68003520 con 0x7fcb680039c0 2023-12-12T09:46:31.465 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:31.461+0000 7fcb7d477640 1 --2- 172.21.15.73:0/1701585171 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcb680051d0 0x7fcb6800b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:46:31.465 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:31.461+0000 7fcb7d477640 1 -- 172.21.15.73:0/1701585171 reap_dead start 2023-12-12T09:46:31.466 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:31.462+0000 7fcb7cc76640 1 --2- 172.21.15.73:0/1701585171 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcb680039c0 0x7fcb68003de0 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7fcb6c001eb0 tx=0x7fcb680057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a961e9c010f0a04 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:46:31.466 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:31.462+0000 7fcb777fe640 1 -- 172.21.15.73:0/1701585171 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb6c005ad0 con 0x7fcb680039c0 2023-12-12T09:46:31.466 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:31.462+0000 7fcb777fe640 1 -- 172.21.15.73:0/1701585171 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb6c005c30 con 0x7fcb680039c0 2023-12-12T09:46:31.466 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:31.462+0000 7fcb777fe640 1 -- 172.21.15.73:0/1701585171 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb6c02ca00 con 0x7fcb680039c0 2023-12-12T09:46:31.467 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:31.463+0000 7fcb7dc78640 1 -- 172.21.15.73:0/1701585171 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcb680039c0 msgr2=0x7fcb68003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:31.467 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:31.463+0000 7fcb7dc78640 1 --2- 172.21.15.73:0/1701585171 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcb680039c0 0x7fcb68003de0 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7fcb6c001eb0 tx=0x7fcb680057f0 comp rx=0 tx=0).stop 2023-12-12T09:46:31.467 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:31.463+0000 7fcb7dc78640 1 -- 172.21.15.73:0/1701585171 shutdown_connections 2023-12-12T09:46:31.467 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:31.463+0000 7fcb7dc78640 1 --2- 172.21.15.73:0/1701585171 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcb680039c0 0x7fcb68003de0 unknown :-1 s=CLOSED pgs=881 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:31.467 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:31.463+0000 7fcb7dc78640 1 -- 172.21.15.73:0/1701585171 >> 172.21.15.73:0/1701585171 conn(0x7fcb780c23b0 msgr2=0x7fcb780c2790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:46:31.467 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:31.463+0000 7fcb7dc78640 1 -- 172.21.15.73:0/1701585171 shutdown_connections 2023-12-12T09:46:31.467 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:31.463+0000 7fcb7dc78640 1 -- 172.21.15.73:0/1701585171 wait complete. 2023-12-12T09:46:31.467 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:31.464+0000 7fcb7dc78640 1 Processor -- start 2023-12-12T09:46:31.467 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:31.465+0000 7fcb7dc78640 1 -- start start 2023-12-12T09:46:31.469 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:31.465+0000 7fcb7dc78640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcb680039c0 0x7fcb7806fa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:31.469 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:31.465+0000 7fcb7dc78640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcb78155f80 0x7fcb7814cb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:31.469 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:31.465+0000 7fcb7dc78640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcb7814d0c0 0x7fcb781ed4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:31.469 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:31.465+0000 7fcb7dc78640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb780c1d40 con 0x7fcb7814d0c0 2023-12-12T09:46:31.470 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:31.465+0000 7fcb7dc78640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb7814baa0 con 0x7fcb78155f80 2023-12-12T09:46:31.470 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:31.465+0000 7fcb7dc78640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb78155af0 con 0x7fcb680039c0 2023-12-12T09:46:31.470 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:31.466+0000 7fcb7d477640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcb7814d0c0 0x7fcb781ed4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:31.470 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:31.466+0000 7fcb7d477640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcb7814d0c0 0x7fcb781ed4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:55820/0 (socket says 172.21.15.73:55820) 2023-12-12T09:46:31.470 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:31.466+0000 7fcb7d477640 1 -- 172.21.15.73:0/137626148 learned_addr learned my addr 172.21.15.73:0/137626148 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:46:31.470 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:31.466+0000 7fcb7cc76640 1 --2- 172.21.15.73:0/137626148 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcb680039c0 0x7fcb7806fa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:31.470 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:31.466+0000 7fcb7d477640 1 -- 172.21.15.73:0/137626148 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcb680039c0 msgr2=0x7fcb7806fa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:31.470 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:31.466+0000 7fcb7d477640 1 --2- 172.21.15.73:0/137626148 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcb680039c0 0x7fcb7806fa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:31.470 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:31.466+0000 7fcb7d477640 1 -- 172.21.15.73:0/137626148 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcb78155f80 msgr2=0x7fcb7814cb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:31.470 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:31.466+0000 7fcb7d477640 1 --2- 172.21.15.73:0/137626148 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcb78155f80 0x7fcb7814cb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:31.470 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:31.466+0000 7fcb7d477640 1 -- 172.21.15.73:0/137626148 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb781551c0 con 0x7fcb7814d0c0 2023-12-12T09:46:31.470 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:31.466+0000 7fcb7cc76640 1 --2- 172.21.15.73:0/137626148 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcb680039c0 0x7fcb7806fa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:46:31.470 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:31.467+0000 7fcb7d477640 1 --2- 172.21.15.73:0/137626148 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcb7814d0c0 0x7fcb781ed4a0 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7fcb780a8ef0 tx=0x7fcb7000d9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:46:31.471 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:31.467+0000 7fcb757fa640 1 -- 172.21.15.73:0/137626148 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb70003d80 con 0x7fcb7814d0c0 2023-12-12T09:46:31.471 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:31.467+0000 7fcb757fa640 1 -- 172.21.15.73:0/137626148 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb70006b50 con 0x7fcb7814d0c0 2023-12-12T09:46:31.471 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:31.467+0000 7fcb757fa640 1 -- 172.21.15.73:0/137626148 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb70005070 con 0x7fcb7814d0c0 2023-12-12T09:46:31.471 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:31.467+0000 7fcb7dc78640 1 -- 172.21.15.73:0/137626148 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb781554a0 con 0x7fcb7814d0c0 2023-12-12T09:46:31.471 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:31.467+0000 7fcb7dc78640 1 -- 172.21.15.73:0/137626148 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb780a6280 con 0x7fcb7814d0c0 2023-12-12T09:46:31.471 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:31.468+0000 7fcb7dc78640 1 -- 172.21.15.73:0/137626148 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb78155c30 con 0x7fcb7814d0c0 2023-12-12T09:46:31.472 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:31.469+0000 7fcb757fa640 1 -- 172.21.15.73:0/137626148 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fcb700051d0 con 0x7fcb7814d0c0 2023-12-12T09:46:31.472 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:31.470+0000 7fcb757fa640 1 --2- 172.21.15.73:0/137626148 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fcb5c06ae70 0x7fcb5c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:31.472 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:31.470+0000 7fcb757fa640 1 -- 172.21.15.73:0/137626148 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fcb700887c0 con 0x7fcb7814d0c0 2023-12-12T09:46:31.472 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:31.470+0000 7fcb7cc76640 1 --2- 172.21.15.73:0/137626148 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fcb5c06ae70 0x7fcb5c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:31.472 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:31.471+0000 7fcb7cc76640 1 --2- 172.21.15.73:0/137626148 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fcb5c06ae70 0x7fcb5c06d330 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fcb6c034000 tx=0x7fcb6c009030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:46:31.475 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:31.474+0000 7fcb757fa640 1 -- 172.21.15.73:0/137626148 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fcb70053860 con 0x7fcb7814d0c0 2023-12-12T09:46:31.665 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:31.664+0000 7fcb7dc78640 1 -- 172.21.15.73:0/137626148 --> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fcb780c5610 con 0x7fcb5c06ae70 2023-12-12T09:46:31.675 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:31.673+0000 7fcb757fa640 1 -- 172.21.15.73:0/137626148 <== mgr.4110 v2:172.21.15.73:6832/779985841 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+287204 (secure 0 0 0) 0x7fcb6c005a60 con 0x7fcb5c06ae70 2023-12-12T09:46:31.679 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-12T09:46:31.681 INFO:teuthology.orchestra.run.smithi073.stderr:dumped all 2023-12-12T09:46:31.682 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:31.679+0000 7fcb7dc78640 1 -- 172.21.15.73:0/137626148 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fcb5c06ae70 msgr2=0x7fcb5c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:31.682 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:31.679+0000 7fcb7dc78640 1 --2- 172.21.15.73:0/137626148 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fcb5c06ae70 0x7fcb5c06d330 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fcb6c034000 tx=0x7fcb6c009030 comp rx=0 tx=0).stop 2023-12-12T09:46:31.683 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:31.679+0000 7fcb7dc78640 1 -- 172.21.15.73:0/137626148 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcb7814d0c0 msgr2=0x7fcb781ed4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:31.683 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:31.679+0000 7fcb7dc78640 1 --2- 172.21.15.73:0/137626148 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcb7814d0c0 0x7fcb781ed4a0 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7fcb780a8ef0 tx=0x7fcb7000d9d0 comp rx=0 tx=0).stop 2023-12-12T09:46:31.683 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:31.679+0000 7fcb7dc78640 1 -- 172.21.15.73:0/137626148 shutdown_connections 2023-12-12T09:46:31.683 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:31.679+0000 7fcb7dc78640 1 --2- 172.21.15.73:0/137626148 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fcb5c06ae70 0x7fcb5c06d330 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:31.683 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:31.679+0000 7fcb7dc78640 1 --2- 172.21.15.73:0/137626148 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcb7814d0c0 0x7fcb781ed4a0 unknown :-1 s=CLOSED pgs=882 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:31.683 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:31.679+0000 7fcb7dc78640 1 --2- 172.21.15.73:0/137626148 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcb78155f80 0x7fcb7814cb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:31.683 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:31.679+0000 7fcb7dc78640 1 --2- 172.21.15.73:0/137626148 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcb680039c0 0x7fcb7806fa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:31.683 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:31.679+0000 7fcb7dc78640 1 -- 172.21.15.73:0/137626148 >> 172.21.15.73:0/137626148 conn(0x7fcb780c23b0 msgr2=0x7fcb780c2790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:46:31.683 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:31.679+0000 7fcb7dc78640 1 -- 172.21.15.73:0/137626148 shutdown_connections 2023-12-12T09:46:31.683 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:31.679+0000 7fcb7dc78640 1 -- 172.21.15.73:0/137626148 wait complete. 2023-12-12T09:46:31.700 INFO:teuthology.orchestra.run.smithi073.stdout:{"pg_ready":true,"pg_map":{"version":167,"stamp":"2023-12-12T09:46:31.519217+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":177,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":252676,"kb_used_data":7380,"kb_used_omap":12,"kb_used_meta":245171,"kb_avail":754722044,"statfs":{"total":773094113280,"available":772835373056,"internally_reserved":0,"allocated":7557120,"data_stored":4426144,"data_compressed":64844,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":12752,"internal_metadata":251055664},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":44,"apply_latency_ms":44,"commit_latency_ns":44000000,"apply_latency_ns":44000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001688"},"pg_stats":[{"pgid":"13.3f","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-12-12T09:46:28.819619+0000","last_change":"2023-12-12T09:46:26.986790+0000","last_active":"2023-12-12T09:46:28.819619+0000","last_peered":"2023-12-12T09:46:28.819619+0000","last_clean":"2023-12-12T09:46:28.819619+0000","last_became_active":"2023-12-12T09:46:26.986521+0000","last_became_peered":"2023-12-12T09:46:26.986521+0000","last_unstale":"2023-12-12T09:46:28.819619+0000","last_undegraded":"2023-12-12T09:46:28.819619+0000","last_fullsized":"2023-12-12T09:46:28.819619+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_clean_scrub_stamp":"2023-12-12T09:46:25.941843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T20:26:07.352366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.3e","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-12-12T09:46:28.951015+0000","last_change":"2023-12-12T09:46:26.994586+0000","last_active":"2023-12-12T09:46:28.951015+0000","last_peered":"2023-12-12T09:46:28.951015+0000","last_clean":"2023-12-12T09:46:28.951015+0000","last_became_active":"2023-12-12T09:46:26.992156+0000","last_became_peered":"2023-12-12T09:46:26.992156+0000","last_unstale":"2023-12-12T09:46:28.951015+0000","last_undegraded":"2023-12-12T09:46:28.951015+0000","last_fullsized":"2023-12-12T09:46:28.951015+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_clean_scrub_stamp":"2023-12-12T09:46:25.941843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T12:32:03.730411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.3d","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-12-12T09:46:27.987092+0000","last_change":"2023-12-12T09:46:26.991707+0000","last_active":"2023-12-12T09:46:27.987092+0000","last_peered":"2023-12-12T09:46:27.987092+0000","last_clean":"2023-12-12T09:46:27.987092+0000","last_became_active":"2023-12-12T09:46:26.991218+0000","last_became_peered":"2023-12-12T09:46:26.991218+0000","last_unstale":"2023-12-12T09:46:27.987092+0000","last_undegraded":"2023-12-12T09:46:27.987092+0000","last_fullsized":"2023-12-12T09:46:27.987092+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_clean_scrub_stamp":"2023-12-12T09:46:25.941843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T18:32:42.868149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.3c","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-12-12T09:46:28.952675+0000","last_change":"2023-12-12T09:46:26.999270+0000","last_active":"2023-12-12T09:46:28.952675+0000","last_peered":"2023-12-12T09:46:28.952675+0000","last_clean":"2023-12-12T09:46:28.952675+0000","last_became_active":"2023-12-12T09:46:26.998982+0000","last_became_peered":"2023-12-12T09:46:26.998982+0000","last_unstale":"2023-12-12T09:46:28.952675+0000","last_undegraded":"2023-12-12T09:46:28.952675+0000","last_fullsized":"2023-12-12T09:46:28.952675+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_clean_scrub_stamp":"2023-12-12T09:46:25.941843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T19:41:17.087778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3b","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-12-12T09:46:28.184622+0000","last_change":"2023-12-12T09:46:26.990528+0000","last_active":"2023-12-12T09:46:28.184622+0000","last_peered":"2023-12-12T09:46:28.184622+0000","last_clean":"2023-12-12T09:46:28.184622+0000","last_became_active":"2023-12-12T09:46:26.990258+0000","last_became_peered":"2023-12-12T09:46:26.990258+0000","last_unstale":"2023-12-12T09:46:28.184622+0000","last_undegraded":"2023-12-12T09:46:28.184622+0000","last_fullsized":"2023-12-12T09:46:28.184622+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_clean_scrub_stamp":"2023-12-12T09:46:25.941843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T17:36:25.591354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.3a","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-12-12T09:46:27.986095+0000","last_change":"2023-12-12T09:46:26.981697+0000","last_active":"2023-12-12T09:46:27.986095+0000","last_peered":"2023-12-12T09:46:27.986095+0000","last_clean":"2023-12-12T09:46:27.986095+0000","last_became_active":"2023-12-12T09:46:26.981332+0000","last_became_peered":"2023-12-12T09:46:26.981332+0000","last_unstale":"2023-12-12T09:46:27.986095+0000","last_undegraded":"2023-12-12T09:46:27.986095+0000","last_fullsized":"2023-12-12T09:46:27.986095+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_clean_scrub_stamp":"2023-12-12T09:46:25.941843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T12:20:23.121255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.39","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-12-12T09:46:28.951436+0000","last_change":"2023-12-12T09:46:26.979578+0000","last_active":"2023-12-12T09:46:28.951436+0000","last_peered":"2023-12-12T09:46:28.951436+0000","last_clean":"2023-12-12T09:46:28.951436+0000","last_became_active":"2023-12-12T09:46:26.978875+0000","last_became_peered":"2023-12-12T09:46:26.978875+0000","last_unstale":"2023-12-12T09:46:28.951436+0000","last_undegraded":"2023-12-12T09:46:28.951436+0000","last_fullsized":"2023-12-12T09:46:28.951436+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_clean_scrub_stamp":"2023-12-12T09:46:25.941843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T21:36:15.290518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.38","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-12-12T09:46:27.986223+0000","last_change":"2023-12-12T09:46:26.984339+0000","last_active":"2023-12-12T09:46:27.986223+0000","last_peered":"2023-12-12T09:46:27.986223+0000","last_clean":"2023-12-12T09:46:27.986223+0000","last_became_active":"2023-12-12T09:46:26.984045+0000","last_became_peered":"2023-12-12T09:46:26.984045+0000","last_unstale":"2023-12-12T09:46:27.986223+0000","last_undegraded":"2023-12-12T09:46:27.986223+0000","last_fullsized":"2023-12-12T09:46:27.986223+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_clean_scrub_stamp":"2023-12-12T09:46:25.941843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T12:26:40.737272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.37","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-12-12T09:46:27.987506+0000","last_change":"2023-12-12T09:46:26.974651+0000","last_active":"2023-12-12T09:46:27.987506+0000","last_peered":"2023-12-12T09:46:27.987506+0000","last_clean":"2023-12-12T09:46:27.987506+0000","last_became_active":"2023-12-12T09:46:26.968979+0000","last_became_peered":"2023-12-12T09:46:26.968979+0000","last_unstale":"2023-12-12T09:46:27.987506+0000","last_undegraded":"2023-12-12T09:46:27.987506+0000","last_fullsized":"2023-12-12T09:46:27.987506+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_clean_scrub_stamp":"2023-12-12T09:46:25.941843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T20:02:31.855316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.36","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-12-12T09:46:28.819780+0000","last_change":"2023-12-12T09:46:26.987761+0000","last_active":"2023-12-12T09:46:28.819780+0000","last_peered":"2023-12-12T09:46:28.819780+0000","last_clean":"2023-12-12T09:46:28.819780+0000","last_became_active":"2023-12-12T09:46:26.987451+0000","last_became_peered":"2023-12-12T09:46:26.987451+0000","last_unstale":"2023-12-12T09:46:28.819780+0000","last_undegraded":"2023-12-12T09:46:28.819780+0000","last_fullsized":"2023-12-12T09:46:28.819780+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_clean_scrub_stamp":"2023-12-12T09:46:25.941843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T20:38:58.730158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.35","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-12-12T09:46:28.950230+0000","last_change":"2023-12-12T09:46:26.988570+0000","last_active":"2023-12-12T09:46:28.950230+0000","last_peered":"2023-12-12T09:46:28.950230+0000","last_clean":"2023-12-12T09:46:28.950230+0000","last_became_active":"2023-12-12T09:46:26.987191+0000","last_became_peered":"2023-12-12T09:46:26.987191+0000","last_unstale":"2023-12-12T09:46:28.950230+0000","last_undegraded":"2023-12-12T09:46:28.950230+0000","last_fullsized":"2023-12-12T09:46:28.950230+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_clean_scrub_stamp":"2023-12-12T09:46:25.941843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T10:13:37.646793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.34","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-12-12T09:46:28.818916+0000","last_change":"2023-12-12T09:46:26.986289+0000","last_active":"2023-12-12T09:46:28.818916+0000","last_peered":"2023-12-12T09:46:28.818916+0000","last_clean":"2023-12-12T09:46:28.818916+0000","last_became_active":"2023-12-12T09:46:26.986031+0000","last_became_peered":"2023-12-12T09:46:26.986031+0000","last_unstale":"2023-12-12T09:46:28.818916+0000","last_undegraded":"2023-12-12T09:46:28.818916+0000","last_fullsized":"2023-12-12T09:46:28.818916+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_clean_scrub_stamp":"2023-12-12T09:46:25.941843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T18:11:05.080156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.33","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-12-12T09:46:27.987395+0000","last_change":"2023-12-12T09:46:26.985914+0000","last_active":"2023-12-12T09:46:27.987395+0000","last_peered":"2023-12-12T09:46:27.987395+0000","last_clean":"2023-12-12T09:46:27.987395+0000","last_became_active":"2023-12-12T09:46:26.985636+0000","last_became_peered":"2023-12-12T09:46:26.985636+0000","last_unstale":"2023-12-12T09:46:27.987395+0000","last_undegraded":"2023-12-12T09:46:27.987395+0000","last_fullsized":"2023-12-12T09:46:27.987395+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_clean_scrub_stamp":"2023-12-12T09:46:25.941843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T15:01:39.944049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.32","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-12-12T09:46:28.951654+0000","last_change":"2023-12-12T09:46:26.998495+0000","last_active":"2023-12-12T09:46:28.951654+0000","last_peered":"2023-12-12T09:46:28.951654+0000","last_clean":"2023-12-12T09:46:28.951654+0000","last_became_active":"2023-12-12T09:46:26.997702+0000","last_became_peered":"2023-12-12T09:46:26.997702+0000","last_unstale":"2023-12-12T09:46:28.951654+0000","last_undegraded":"2023-12-12T09:46:28.951654+0000","last_fullsized":"2023-12-12T09:46:28.951654+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_clean_scrub_stamp":"2023-12-12T09:46:25.941843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T21:12:40.750775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.31","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-12-12T09:46:27.980965+0000","last_change":"2023-12-12T09:46:26.987237+0000","last_active":"2023-12-12T09:46:27.980965+0000","last_peered":"2023-12-12T09:46:27.980965+0000","last_clean":"2023-12-12T09:46:27.980965+0000","last_became_active":"2023-12-12T09:46:26.985751+0000","last_became_peered":"2023-12-12T09:46:26.985751+0000","last_unstale":"2023-12-12T09:46:27.980965+0000","last_undegraded":"2023-12-12T09:46:27.980965+0000","last_fullsized":"2023-12-12T09:46:27.980965+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_clean_scrub_stamp":"2023-12-12T09:46:25.941843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T11:42:15.823462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.30","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-12-12T09:46:28.184207+0000","last_change":"2023-12-12T09:46:26.984939+0000","last_active":"2023-12-12T09:46:28.184207+0000","last_peered":"2023-12-12T09:46:28.184207+0000","last_clean":"2023-12-12T09:46:28.184207+0000","last_became_active":"2023-12-12T09:46:26.984654+0000","last_became_peered":"2023-12-12T09:46:26.984654+0000","last_unstale":"2023-12-12T09:46:28.184207+0000","last_undegraded":"2023-12-12T09:46:28.184207+0000","last_fullsized":"2023-12-12T09:46:28.184207+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_clean_scrub_stamp":"2023-12-12T09:46:25.941843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T20:27:55.483605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2f","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-12-12T09:46:28.185212+0000","last_change":"2023-12-12T09:46:26.986814+0000","last_active":"2023-12-12T09:46:28.185212+0000","last_peered":"2023-12-12T09:46:28.185212+0000","last_clean":"2023-12-12T09:46:28.185212+0000","last_became_active":"2023-12-12T09:46:26.985778+0000","last_became_peered":"2023-12-12T09:46:26.985778+0000","last_unstale":"2023-12-12T09:46:28.185212+0000","last_undegraded":"2023-12-12T09:46:28.185212+0000","last_fullsized":"2023-12-12T09:46:28.185212+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_clean_scrub_stamp":"2023-12-12T09:46:25.941843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T18:32:42.868149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2e","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-12-12T09:46:28.952492+0000","last_change":"2023-12-12T09:46:26.990577+0000","last_active":"2023-12-12T09:46:28.952492+0000","last_peered":"2023-12-12T09:46:28.952492+0000","last_clean":"2023-12-12T09:46:28.952492+0000","last_became_active":"2023-12-12T09:46:26.990043+0000","last_became_peered":"2023-12-12T09:46:26.990043+0000","last_unstale":"2023-12-12T09:46:28.952492+0000","last_undegraded":"2023-12-12T09:46:28.952492+0000","last_fullsized":"2023-12-12T09:46:28.952492+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_clean_scrub_stamp":"2023-12-12T09:46:25.941843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T15:36:13.603009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2d","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-12-12T09:46:28.152305+0000","last_change":"2023-12-12T09:46:26.981798+0000","last_active":"2023-12-12T09:46:28.152305+0000","last_peered":"2023-12-12T09:46:28.152305+0000","last_clean":"2023-12-12T09:46:28.152305+0000","last_became_active":"2023-12-12T09:46:26.981531+0000","last_became_peered":"2023-12-12T09:46:26.981531+0000","last_unstale":"2023-12-12T09:46:28.152305+0000","last_undegraded":"2023-12-12T09:46:28.152305+0000","last_fullsized":"2023-12-12T09:46:28.152305+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_clean_scrub_stamp":"2023-12-12T09:46:25.941843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T16:03:22.088223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.2c","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-12-12T09:46:28.952674+0000","last_change":"2023-12-12T09:46:26.992419+0000","last_active":"2023-12-12T09:46:28.952674+0000","last_peered":"2023-12-12T09:46:28.952674+0000","last_clean":"2023-12-12T09:46:28.952674+0000","last_became_active":"2023-12-12T09:46:26.992204+0000","last_became_peered":"2023-12-12T09:46:26.992204+0000","last_unstale":"2023-12-12T09:46:28.952674+0000","last_undegraded":"2023-12-12T09:46:28.952674+0000","last_fullsized":"2023-12-12T09:46:28.952674+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_clean_scrub_stamp":"2023-12-12T09:46:25.941843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T20:27:08.735156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2b","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-12-12T09:46:28.952291+0000","last_change":"2023-12-12T09:46:26.994981+0000","last_active":"2023-12-12T09:46:28.952291+0000","last_peered":"2023-12-12T09:46:28.952291+0000","last_clean":"2023-12-12T09:46:28.952291+0000","last_became_active":"2023-12-12T09:46:26.993637+0000","last_became_peered":"2023-12-12T09:46:26.993637+0000","last_unstale":"2023-12-12T09:46:28.952291+0000","last_undegraded":"2023-12-12T09:46:28.952291+0000","last_fullsized":"2023-12-12T09:46:28.952291+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_clean_scrub_stamp":"2023-12-12T09:46:25.941843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T17:22:17.059887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2a","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-12-12T09:46:28.950589+0000","last_change":"2023-12-12T09:46:27.001420+0000","last_active":"2023-12-12T09:46:28.950589+0000","last_peered":"2023-12-12T09:46:28.950589+0000","last_clean":"2023-12-12T09:46:28.950589+0000","last_became_active":"2023-12-12T09:46:27.001157+0000","last_became_peered":"2023-12-12T09:46:27.001157+0000","last_unstale":"2023-12-12T09:46:28.950589+0000","last_undegraded":"2023-12-12T09:46:28.950589+0000","last_fullsized":"2023-12-12T09:46:28.950589+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_clean_scrub_stamp":"2023-12-12T09:46:25.941843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T18:47:51.982188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.29","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-12-12T09:46:28.818890+0000","last_change":"2023-12-12T09:46:26.998244+0000","last_active":"2023-12-12T09:46:28.818890+0000","last_peered":"2023-12-12T09:46:28.818890+0000","last_clean":"2023-12-12T09:46:28.818890+0000","last_became_active":"2023-12-12T09:46:26.997924+0000","last_became_peered":"2023-12-12T09:46:26.997924+0000","last_unstale":"2023-12-12T09:46:28.818890+0000","last_undegraded":"2023-12-12T09:46:28.818890+0000","last_fullsized":"2023-12-12T09:46:28.818890+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_clean_scrub_stamp":"2023-12-12T09:46:25.941843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T18:32:42.868149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.28","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-12-12T09:46:28.950361+0000","last_change":"2023-12-12T09:46:26.995855+0000","last_active":"2023-12-12T09:46:28.950361+0000","last_peered":"2023-12-12T09:46:28.950361+0000","last_clean":"2023-12-12T09:46:28.950361+0000","last_became_active":"2023-12-12T09:46:26.995600+0000","last_became_peered":"2023-12-12T09:46:26.995600+0000","last_unstale":"2023-12-12T09:46:28.950361+0000","last_undegraded":"2023-12-12T09:46:28.950361+0000","last_fullsized":"2023-12-12T09:46:28.950361+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_clean_scrub_stamp":"2023-12-12T09:46:25.941843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T21:34:45.332708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.27","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-12-12T09:46:28.950637+0000","last_change":"2023-12-12T09:46:26.991438+0000","last_active":"2023-12-12T09:46:28.950637+0000","last_peered":"2023-12-12T09:46:28.950637+0000","last_clean":"2023-12-12T09:46:28.950637+0000","last_became_active":"2023-12-12T09:46:26.991186+0000","last_became_peered":"2023-12-12T09:46:26.991186+0000","last_unstale":"2023-12-12T09:46:28.950637+0000","last_undegraded":"2023-12-12T09:46:28.950637+0000","last_fullsized":"2023-12-12T09:46:28.950637+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_clean_scrub_stamp":"2023-12-12T09:46:25.941843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T10:00:12.368441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.26","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-12-12T09:46:27.987098+0000","last_change":"2023-12-12T09:46:26.993487+0000","last_active":"2023-12-12T09:46:27.987098+0000","last_peered":"2023-12-12T09:46:27.987098+0000","last_clean":"2023-12-12T09:46:27.987098+0000","last_became_active":"2023-12-12T09:46:26.991132+0000","last_became_peered":"2023-12-12T09:46:26.991132+0000","last_unstale":"2023-12-12T09:46:27.987098+0000","last_undegraded":"2023-12-12T09:46:27.987098+0000","last_fullsized":"2023-12-12T09:46:27.987098+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_clean_scrub_stamp":"2023-12-12T09:46:25.941843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T18:11:05.080156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.25","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-12-12T09:46:28.185327+0000","last_change":"2023-12-12T09:46:26.980520+0000","last_active":"2023-12-12T09:46:28.185327+0000","last_peered":"2023-12-12T09:46:28.185327+0000","last_clean":"2023-12-12T09:46:28.185327+0000","last_became_active":"2023-12-12T09:46:26.980218+0000","last_became_peered":"2023-12-12T09:46:26.980218+0000","last_unstale":"2023-12-12T09:46:28.185327+0000","last_undegraded":"2023-12-12T09:46:28.185327+0000","last_fullsized":"2023-12-12T09:46:28.185327+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_clean_scrub_stamp":"2023-12-12T09:46:25.941843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T18:11:05.080156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.24","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-12-12T09:46:28.819183+0000","last_change":"2023-12-12T09:46:26.982794+0000","last_active":"2023-12-12T09:46:28.819183+0000","last_peered":"2023-12-12T09:46:28.819183+0000","last_clean":"2023-12-12T09:46:28.819183+0000","last_became_active":"2023-12-12T09:46:26.981602+0000","last_became_peered":"2023-12-12T09:46:26.981602+0000","last_unstale":"2023-12-12T09:46:28.819183+0000","last_undegraded":"2023-12-12T09:46:28.819183+0000","last_fullsized":"2023-12-12T09:46:28.819183+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_clean_scrub_stamp":"2023-12-12T09:46:25.941843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T10:55:01.026545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.23","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-12-12T09:46:28.950224+0000","last_change":"2023-12-12T09:46:26.986416+0000","last_active":"2023-12-12T09:46:28.950224+0000","last_peered":"2023-12-12T09:46:28.950224+0000","last_clean":"2023-12-12T09:46:28.950224+0000","last_became_active":"2023-12-12T09:46:26.986101+0000","last_became_peered":"2023-12-12T09:46:26.986101+0000","last_unstale":"2023-12-12T09:46:28.950224+0000","last_undegraded":"2023-12-12T09:46:28.950224+0000","last_fullsized":"2023-12-12T09:46:28.950224+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_clean_scrub_stamp":"2023-12-12T09:46:25.941843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T13:32:14.660495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.22","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-12-12T09:46:28.950650+0000","last_change":"2023-12-12T09:46:26.991481+0000","last_active":"2023-12-12T09:46:28.950650+0000","last_peered":"2023-12-12T09:46:28.950650+0000","last_clean":"2023-12-12T09:46:28.950650+0000","last_became_active":"2023-12-12T09:46:26.990749+0000","last_became_peered":"2023-12-12T09:46:26.990749+0000","last_unstale":"2023-12-12T09:46:28.950650+0000","last_undegraded":"2023-12-12T09:46:28.950650+0000","last_fullsized":"2023-12-12T09:46:28.950650+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_clean_scrub_stamp":"2023-12-12T09:46:25.941843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T12:43:20.320606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.21","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-12-12T09:46:28.184329+0000","last_change":"2023-12-12T09:46:26.989100+0000","last_active":"2023-12-12T09:46:28.184329+0000","last_peered":"2023-12-12T09:46:28.184329+0000","last_clean":"2023-12-12T09:46:28.184329+0000","last_became_active":"2023-12-12T09:46:26.988781+0000","last_became_peered":"2023-12-12T09:46:26.988781+0000","last_unstale":"2023-12-12T09:46:28.184329+0000","last_undegraded":"2023-12-12T09:46:28.184329+0000","last_fullsized":"2023-12-12T09:46:28.184329+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_clean_scrub_stamp":"2023-12-12T09:46:25.941843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T20:02:31.855316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.20","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-12-12T09:46:28.818892+0000","last_change":"2023-12-12T09:46:27.003364+0000","last_active":"2023-12-12T09:46:28.818892+0000","last_peered":"2023-12-12T09:46:28.818892+0000","last_clean":"2023-12-12T09:46:28.818892+0000","last_became_active":"2023-12-12T09:46:27.002978+0000","last_became_peered":"2023-12-12T09:46:27.002978+0000","last_unstale":"2023-12-12T09:46:28.818892+0000","last_undegraded":"2023-12-12T09:46:28.818892+0000","last_fullsized":"2023-12-12T09:46:28.818892+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_clean_scrub_stamp":"2023-12-12T09:46:25.941843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T18:26:29.446839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-12-12T09:46:28.184678+0000","last_change":"2023-12-12T09:46:26.993790+0000","last_active":"2023-12-12T09:46:28.184678+0000","last_peered":"2023-12-12T09:46:28.184678+0000","last_clean":"2023-12-12T09:46:28.184678+0000","last_became_active":"2023-12-12T09:46:26.992397+0000","last_became_peered":"2023-12-12T09:46:26.992397+0000","last_unstale":"2023-12-12T09:46:28.184678+0000","last_undegraded":"2023-12-12T09:46:28.184678+0000","last_fullsized":"2023-12-12T09:46:28.184678+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_clean_scrub_stamp":"2023-12-12T09:46:25.941843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T19:08:38.276897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1f","version":"74'4","reported_seq":16,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-12-12T09:46:28.819844+0000","last_change":"2023-12-12T09:46:25.995978+0000","last_active":"2023-12-12T09:46:28.819844+0000","last_peered":"2023-12-12T09:46:28.819844+0000","last_clean":"2023-12-12T09:46:28.819844+0000","last_became_active":"2023-12-12T09:46:25.995655+0000","last_became_peered":"2023-12-12T09:46:25.995655+0000","last_unstale":"2023-12-12T09:46:28.819844+0000","last_undegraded":"2023-12-12T09:46:28.819844+0000","last_fullsized":"2023-12-12T09:46:28.819844+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:24.925008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:24.925008+0000","last_clean_scrub_stamp":"2023-12-12T09:46:24.925008+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T17:36:24.574519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-12-12T09:46:28.819669+0000","last_change":"2023-12-12T09:46:27.003828+0000","last_active":"2023-12-12T09:46:28.819669+0000","last_peered":"2023-12-12T09:46:28.819669+0000","last_clean":"2023-12-12T09:46:28.819669+0000","last_became_active":"2023-12-12T09:46:27.003445+0000","last_became_peered":"2023-12-12T09:46:27.003445+0000","last_unstale":"2023-12-12T09:46:28.819669+0000","last_undegraded":"2023-12-12T09:46:28.819669+0000","last_fullsized":"2023-12-12T09:46:28.819669+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_clean_scrub_stamp":"2023-12-12T09:46:25.941843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T11:42:15.823462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1e","version":"74'1","reported_seq":13,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-12-12T09:46:28.185108+0000","last_change":"2023-12-12T09:46:25.991554+0000","last_active":"2023-12-12T09:46:28.185108+0000","last_peered":"2023-12-12T09:46:28.185108+0000","last_clean":"2023-12-12T09:46:28.185108+0000","last_became_active":"2023-12-12T09:46:25.991083+0000","last_became_peered":"2023-12-12T09:46:25.991083+0000","last_unstale":"2023-12-12T09:46:28.185108+0000","last_undegraded":"2023-12-12T09:46:28.185108+0000","last_fullsized":"2023-12-12T09:46:28.185108+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:24.925008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:24.925008+0000","last_clean_scrub_stamp":"2023-12-12T09:46:24.925008+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T12:36:50.371782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-12-12T09:46:28.819254+0000","last_change":"2023-12-12T09:46:27.003290+0000","last_active":"2023-12-12T09:46:28.819254+0000","last_peered":"2023-12-12T09:46:28.819254+0000","last_clean":"2023-12-12T09:46:28.819254+0000","last_became_active":"2023-12-12T09:46:27.002983+0000","last_became_peered":"2023-12-12T09:46:27.002983+0000","last_unstale":"2023-12-12T09:46:28.819254+0000","last_undegraded":"2023-12-12T09:46:28.819254+0000","last_fullsized":"2023-12-12T09:46:28.819254+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_clean_scrub_stamp":"2023-12-12T09:46:25.941843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T10:54:08.858049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1d","version":"74'2","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-12-12T09:46:28.152169+0000","last_change":"2023-12-12T09:46:25.986094+0000","last_active":"2023-12-12T09:46:28.152169+0000","last_peered":"2023-12-12T09:46:28.152169+0000","last_clean":"2023-12-12T09:46:28.152169+0000","last_became_active":"2023-12-12T09:46:25.985751+0000","last_became_peered":"2023-12-12T09:46:25.985751+0000","last_unstale":"2023-12-12T09:46:28.152169+0000","last_undegraded":"2023-12-12T09:46:28.152169+0000","last_fullsized":"2023-12-12T09:46:28.152169+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:24.925008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:24.925008+0000","last_clean_scrub_stamp":"2023-12-12T09:46:24.925008+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T18:26:28.430003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-12-12T09:46:27.987426+0000","last_change":"2023-12-12T09:46:26.991745+0000","last_active":"2023-12-12T09:46:27.987426+0000","last_peered":"2023-12-12T09:46:27.987426+0000","last_clean":"2023-12-12T09:46:27.987426+0000","last_became_active":"2023-12-12T09:46:26.991433+0000","last_became_peered":"2023-12-12T09:46:26.991433+0000","last_unstale":"2023-12-12T09:46:27.987426+0000","last_undegraded":"2023-12-12T09:46:27.987426+0000","last_fullsized":"2023-12-12T09:46:27.987426+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_clean_scrub_stamp":"2023-12-12T09:46:25.941843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T10:54:08.858049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1c","version":"74'2","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-12-12T09:46:28.151829+0000","last_change":"2023-12-12T09:46:25.990718+0000","last_active":"2023-12-12T09:46:28.151829+0000","last_peered":"2023-12-12T09:46:28.151829+0000","last_clean":"2023-12-12T09:46:28.151829+0000","last_became_active":"2023-12-12T09:46:25.990422+0000","last_became_peered":"2023-12-12T09:46:25.990422+0000","last_unstale":"2023-12-12T09:46:28.151829+0000","last_undegraded":"2023-12-12T09:46:28.151829+0000","last_fullsized":"2023-12-12T09:46:28.151829+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:24.925008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:24.925008+0000","last_clean_scrub_stamp":"2023-12-12T09:46:24.925008+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T20:27:54.466769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-12-12T09:46:28.950913+0000","last_change":"2023-12-12T09:46:26.991755+0000","last_active":"2023-12-12T09:46:28.950913+0000","last_peered":"2023-12-12T09:46:28.950913+0000","last_clean":"2023-12-12T09:46:28.950913+0000","last_became_active":"2023-12-12T09:46:26.991128+0000","last_became_peered":"2023-12-12T09:46:26.991128+0000","last_unstale":"2023-12-12T09:46:28.950913+0000","last_undegraded":"2023-12-12T09:46:28.950913+0000","last_fullsized":"2023-12-12T09:46:28.950913+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_clean_scrub_stamp":"2023-12-12T09:46:25.941843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T10:21:27.951163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1b","version":"74'1","reported_seq":13,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-12-12T09:46:28.185044+0000","last_change":"2023-12-12T09:46:25.996637+0000","last_active":"2023-12-12T09:46:28.185044+0000","last_peered":"2023-12-12T09:46:28.185044+0000","last_clean":"2023-12-12T09:46:28.185044+0000","last_became_active":"2023-12-12T09:46:25.994964+0000","last_became_peered":"2023-12-12T09:46:25.994964+0000","last_unstale":"2023-12-12T09:46:28.185044+0000","last_undegraded":"2023-12-12T09:46:28.185044+0000","last_fullsized":"2023-12-12T09:46:28.185044+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:24.925008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:24.925008+0000","last_clean_scrub_stamp":"2023-12-12T09:46:24.925008+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T10:00:11.351606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-12-12T09:46:28.184728+0000","last_change":"2023-12-12T09:46:26.992932+0000","last_active":"2023-12-12T09:46:28.184728+0000","last_peered":"2023-12-12T09:46:28.184728+0000","last_clean":"2023-12-12T09:46:28.184728+0000","last_became_active":"2023-12-12T09:46:26.992439+0000","last_became_peered":"2023-12-12T09:46:26.992439+0000","last_unstale":"2023-12-12T09:46:28.184728+0000","last_undegraded":"2023-12-12T09:46:28.184728+0000","last_fullsized":"2023-12-12T09:46:28.184728+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_clean_scrub_stamp":"2023-12-12T09:46:25.941843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T17:57:23.001231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1a","version":"74'1","reported_seq":13,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-12-12T09:46:28.184810+0000","last_change":"2023-12-12T09:46:25.997561+0000","last_active":"2023-12-12T09:46:28.184810+0000","last_peered":"2023-12-12T09:46:28.184810+0000","last_clean":"2023-12-12T09:46:28.184810+0000","last_became_active":"2023-12-12T09:46:25.997251+0000","last_became_peered":"2023-12-12T09:46:25.997251+0000","last_unstale":"2023-12-12T09:46:28.184810+0000","last_undegraded":"2023-12-12T09:46:28.184810+0000","last_fullsized":"2023-12-12T09:46:28.184810+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:24.925008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:24.925008+0000","last_clean_scrub_stamp":"2023-12-12T09:46:24.925008+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T19:17:31.250809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-12-12T09:46:27.987652+0000","last_change":"2023-12-12T09:46:26.992538+0000","last_active":"2023-12-12T09:46:27.987652+0000","last_peered":"2023-12-12T09:46:27.987652+0000","last_clean":"2023-12-12T09:46:27.987652+0000","last_became_active":"2023-12-12T09:46:26.992224+0000","last_became_peered":"2023-12-12T09:46:26.992224+0000","last_unstale":"2023-12-12T09:46:27.987652+0000","last_undegraded":"2023-12-12T09:46:27.987652+0000","last_fullsized":"2023-12-12T09:46:27.987652+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_clean_scrub_stamp":"2023-12-12T09:46:25.941843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T20:26:07.352366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-12-12T09:46:28.151286+0000","last_change":"2023-12-12T09:46:25.986629+0000","last_active":"2023-12-12T09:46:28.151286+0000","last_peered":"2023-12-12T09:46:28.151286+0000","last_clean":"2023-12-12T09:46:28.151286+0000","last_became_active":"2023-12-12T09:46:25.986351+0000","last_became_peered":"2023-12-12T09:46:25.986351+0000","last_unstale":"2023-12-12T09:46:28.151286+0000","last_undegraded":"2023-12-12T09:46:28.151286+0000","last_fullsized":"2023-12-12T09:46:28.151286+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:24.925008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:24.925008+0000","last_clean_scrub_stamp":"2023-12-12T09:46:24.925008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T11:46:36.913352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-12-12T09:46:27.981139+0000","last_change":"2023-12-12T09:46:26.993474+0000","last_active":"2023-12-12T09:46:27.981139+0000","last_peered":"2023-12-12T09:46:27.981139+0000","last_clean":"2023-12-12T09:46:27.981139+0000","last_became_active":"2023-12-12T09:46:26.993192+0000","last_became_peered":"2023-12-12T09:46:26.993192+0000","last_unstale":"2023-12-12T09:46:27.981139+0000","last_undegraded":"2023-12-12T09:46:27.981139+0000","last_fullsized":"2023-12-12T09:46:27.981139+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_clean_scrub_stamp":"2023-12-12T09:46:25.941843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T20:38:58.730158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-12-12T09:46:28.950092+0000","last_change":"2023-12-12T09:46:25.998271+0000","last_active":"2023-12-12T09:46:28.950092+0000","last_peered":"2023-12-12T09:46:28.950092+0000","last_clean":"2023-12-12T09:46:28.950092+0000","last_became_active":"2023-12-12T09:46:25.997900+0000","last_became_peered":"2023-12-12T09:46:25.997900+0000","last_unstale":"2023-12-12T09:46:28.950092+0000","last_undegraded":"2023-12-12T09:46:28.950092+0000","last_fullsized":"2023-12-12T09:46:28.950092+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:24.925008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:24.925008+0000","last_clean_scrub_stamp":"2023-12-12T09:46:24.925008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T14:29:28.702921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-12-12T09:46:27.981836+0000","last_change":"2023-12-12T09:46:26.991874+0000","last_active":"2023-12-12T09:46:27.981836+0000","last_peered":"2023-12-12T09:46:27.981836+0000","last_clean":"2023-12-12T09:46:27.981836+0000","last_became_active":"2023-12-12T09:46:26.991425+0000","last_became_peered":"2023-12-12T09:46:26.991425+0000","last_unstale":"2023-12-12T09:46:27.981836+0000","last_undegraded":"2023-12-12T09:46:27.981836+0000","last_fullsized":"2023-12-12T09:46:27.981836+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_clean_scrub_stamp":"2023-12-12T09:46:25.941843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T14:49:18.138939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-12-12T09:46:28.819995+0000","last_change":"2023-12-12T09:46:25.994140+0000","last_active":"2023-12-12T09:46:28.819995+0000","last_peered":"2023-12-12T09:46:28.819995+0000","last_clean":"2023-12-12T09:46:28.819995+0000","last_became_active":"2023-12-12T09:46:25.993784+0000","last_became_peered":"2023-12-12T09:46:25.993784+0000","last_unstale":"2023-12-12T09:46:28.819995+0000","last_undegraded":"2023-12-12T09:46:28.819995+0000","last_fullsized":"2023-12-12T09:46:28.819995+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:24.925008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:24.925008+0000","last_clean_scrub_stamp":"2023-12-12T09:46:24.925008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T19:08:37.260062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-12-12T09:46:27.987844+0000","last_change":"2023-12-12T09:46:26.981920+0000","last_active":"2023-12-12T09:46:27.987844+0000","last_peered":"2023-12-12T09:46:27.987844+0000","last_clean":"2023-12-12T09:46:27.987844+0000","last_became_active":"2023-12-12T09:46:26.981149+0000","last_became_peered":"2023-12-12T09:46:26.981149+0000","last_unstale":"2023-12-12T09:46:27.987844+0000","last_undegraded":"2023-12-12T09:46:27.987844+0000","last_fullsized":"2023-12-12T09:46:27.987844+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_clean_scrub_stamp":"2023-12-12T09:46:25.941843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T17:36:25.591354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-12-12T09:46:28.819794+0000","last_change":"2023-12-12T09:46:25.994337+0000","last_active":"2023-12-12T09:46:28.819794+0000","last_peered":"2023-12-12T09:46:28.819794+0000","last_clean":"2023-12-12T09:46:28.819794+0000","last_became_active":"2023-12-12T09:46:25.993988+0000","last_became_peered":"2023-12-12T09:46:25.993988+0000","last_unstale":"2023-12-12T09:46:28.819794+0000","last_undegraded":"2023-12-12T09:46:28.819794+0000","last_fullsized":"2023-12-12T09:46:28.819794+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:24.925008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:24.925008+0000","last_clean_scrub_stamp":"2023-12-12T09:46:24.925008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T14:33:58.248291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-12-12T09:46:28.151682+0000","last_change":"2023-12-12T09:46:26.983752+0000","last_active":"2023-12-12T09:46:28.151682+0000","last_peered":"2023-12-12T09:46:28.151682+0000","last_clean":"2023-12-12T09:46:28.151682+0000","last_became_active":"2023-12-12T09:46:26.983381+0000","last_became_peered":"2023-12-12T09:46:26.983381+0000","last_unstale":"2023-12-12T09:46:28.151682+0000","last_undegraded":"2023-12-12T09:46:28.151682+0000","last_fullsized":"2023-12-12T09:46:28.151682+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_clean_scrub_stamp":"2023-12-12T09:46:25.941843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T15:01:39.944049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.15","version":"74'3","reported_seq":15,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-12-12T09:46:28.818999+0000","last_change":"2023-12-12T09:46:25.985458+0000","last_active":"2023-12-12T09:46:28.818999+0000","last_peered":"2023-12-12T09:46:28.818999+0000","last_clean":"2023-12-12T09:46:28.818999+0000","last_became_active":"2023-12-12T09:46:25.985147+0000","last_became_peered":"2023-12-12T09:46:25.985147+0000","last_unstale":"2023-12-12T09:46:28.818999+0000","last_undegraded":"2023-12-12T09:46:28.818999+0000","last_fullsized":"2023-12-12T09:46:28.818999+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:24.925008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:24.925008+0000","last_clean_scrub_stamp":"2023-12-12T09:46:24.925008+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T12:43:19.303770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-12-12T09:46:28.184825+0000","last_change":"2023-12-12T09:46:26.997513+0000","last_active":"2023-12-12T09:46:28.184825+0000","last_peered":"2023-12-12T09:46:28.184825+0000","last_clean":"2023-12-12T09:46:28.184825+0000","last_became_active":"2023-12-12T09:46:26.997102+0000","last_became_peered":"2023-12-12T09:46:26.997102+0000","last_unstale":"2023-12-12T09:46:28.184825+0000","last_undegraded":"2023-12-12T09:46:28.184825+0000","last_fullsized":"2023-12-12T09:46:28.184825+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_clean_scrub_stamp":"2023-12-12T09:46:25.941843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T10:24:08.528546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.14","version":"74'6","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-12-12T09:46:27.987151+0000","last_change":"2023-12-12T09:46:25.982724+0000","last_active":"2023-12-12T09:46:27.987151+0000","last_peered":"2023-12-12T09:46:27.987151+0000","last_clean":"2023-12-12T09:46:27.987151+0000","last_became_active":"2023-12-12T09:46:25.982370+0000","last_became_peered":"2023-12-12T09:46:25.982370+0000","last_unstale":"2023-12-12T09:46:27.987151+0000","last_undegraded":"2023-12-12T09:46:27.987151+0000","last_fullsized":"2023-12-12T09:46:27.987151+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:24.925008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:24.925008+0000","last_clean_scrub_stamp":"2023-12-12T09:46:24.925008+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T12:43:19.303770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-12-12T09:46:28.151867+0000","last_change":"2023-12-12T09:46:26.979828+0000","last_active":"2023-12-12T09:46:28.151867+0000","last_peered":"2023-12-12T09:46:28.151867+0000","last_clean":"2023-12-12T09:46:28.151867+0000","last_became_active":"2023-12-12T09:46:26.979516+0000","last_became_peered":"2023-12-12T09:46:26.979516+0000","last_unstale":"2023-12-12T09:46:28.151867+0000","last_undegraded":"2023-12-12T09:46:28.151867+0000","last_fullsized":"2023-12-12T09:46:28.151867+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_clean_scrub_stamp":"2023-12-12T09:46:25.941843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T10:54:08.858049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.13","version":"74'2","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-12-12T09:46:28.950378+0000","last_change":"2023-12-12T09:46:25.987283+0000","last_active":"2023-12-12T09:46:28.950378+0000","last_peered":"2023-12-12T09:46:28.950378+0000","last_clean":"2023-12-12T09:46:28.950378+0000","last_became_active":"2023-12-12T09:46:25.986974+0000","last_became_peered":"2023-12-12T09:46:25.986974+0000","last_unstale":"2023-12-12T09:46:28.950378+0000","last_undegraded":"2023-12-12T09:46:28.950378+0000","last_fullsized":"2023-12-12T09:46:28.950378+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:24.925008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:24.925008+0000","last_clean_scrub_stamp":"2023-12-12T09:46:24.925008+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T17:33:21.476618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-12-12T09:46:27.987935+0000","last_change":"2023-12-12T09:46:26.991122+0000","last_active":"2023-12-12T09:46:27.987935+0000","last_peered":"2023-12-12T09:46:27.987935+0000","last_clean":"2023-12-12T09:46:27.987935+0000","last_became_active":"2023-12-12T09:46:26.990778+0000","last_became_peered":"2023-12-12T09:46:26.990778+0000","last_unstale":"2023-12-12T09:46:27.987935+0000","last_undegraded":"2023-12-12T09:46:27.987935+0000","last_fullsized":"2023-12-12T09:46:27.987935+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_clean_scrub_stamp":"2023-12-12T09:46:25.941843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T11:42:15.823462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-12-12T09:46:27.981094+0000","last_change":"2023-12-12T09:46:25.982578+0000","last_active":"2023-12-12T09:46:27.981094+0000","last_peered":"2023-12-12T09:46:27.981094+0000","last_clean":"2023-12-12T09:46:27.981094+0000","last_became_active":"2023-12-12T09:46:25.982307+0000","last_became_peered":"2023-12-12T09:46:25.982307+0000","last_unstale":"2023-12-12T09:46:27.981094+0000","last_undegraded":"2023-12-12T09:46:27.981094+0000","last_fullsized":"2023-12-12T09:46:27.981094+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:24.925008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:24.925008+0000","last_clean_scrub_stamp":"2023-12-12T09:46:24.925008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T10:54:07.841214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-12-12T09:46:28.949818+0000","last_change":"2023-12-12T09:46:26.990991+0000","last_active":"2023-12-12T09:46:28.949818+0000","last_peered":"2023-12-12T09:46:28.949818+0000","last_clean":"2023-12-12T09:46:28.949818+0000","last_became_active":"2023-12-12T09:46:26.990702+0000","last_became_peered":"2023-12-12T09:46:26.990702+0000","last_unstale":"2023-12-12T09:46:28.949818+0000","last_undegraded":"2023-12-12T09:46:28.949818+0000","last_fullsized":"2023-12-12T09:46:28.949818+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_clean_scrub_stamp":"2023-12-12T09:46:25.941843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T14:22:02.583778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-12-12T09:46:27.986405+0000","last_change":"2023-12-12T09:46:26.002159+0000","last_active":"2023-12-12T09:46:27.986405+0000","last_peered":"2023-12-12T09:46:27.986405+0000","last_clean":"2023-12-12T09:46:27.986405+0000","last_became_active":"2023-12-12T09:46:26.001847+0000","last_became_peered":"2023-12-12T09:46:26.001847+0000","last_unstale":"2023-12-12T09:46:27.986405+0000","last_undegraded":"2023-12-12T09:46:27.986405+0000","last_fullsized":"2023-12-12T09:46:27.986405+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:24.925008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:24.925008+0000","last_clean_scrub_stamp":"2023-12-12T09:46:24.925008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T10:21:26.934327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-12-12T09:46:28.949578+0000","last_change":"2023-12-12T09:46:26.988682+0000","last_active":"2023-12-12T09:46:28.949578+0000","last_peered":"2023-12-12T09:46:28.949578+0000","last_clean":"2023-12-12T09:46:28.949578+0000","last_became_active":"2023-12-12T09:46:26.988391+0000","last_became_peered":"2023-12-12T09:46:26.988391+0000","last_unstale":"2023-12-12T09:46:28.949578+0000","last_undegraded":"2023-12-12T09:46:28.949578+0000","last_fullsized":"2023-12-12T09:46:28.949578+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_clean_scrub_stamp":"2023-12-12T09:46:25.941843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T10:34:32.907255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.10","version":"74'8","reported_seq":20,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-12-12T09:46:28.151288+0000","last_change":"2023-12-12T09:46:25.990213+0000","last_active":"2023-12-12T09:46:28.151288+0000","last_peered":"2023-12-12T09:46:28.151288+0000","last_clean":"2023-12-12T09:46:28.151288+0000","last_became_active":"2023-12-12T09:46:25.989960+0000","last_became_peered":"2023-12-12T09:46:25.989960+0000","last_unstale":"2023-12-12T09:46:28.151288+0000","last_undegraded":"2023-12-12T09:46:28.151288+0000","last_fullsized":"2023-12-12T09:46:28.151288+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:24.925008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:24.925008+0000","last_clean_scrub_stamp":"2023-12-12T09:46:24.925008+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T12:26:39.720437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-12-12T09:46:27.987425+0000","last_change":"2023-12-12T09:46:26.983398+0000","last_active":"2023-12-12T09:46:27.987425+0000","last_peered":"2023-12-12T09:46:27.987425+0000","last_clean":"2023-12-12T09:46:27.987425+0000","last_became_active":"2023-12-12T09:46:26.983101+0000","last_became_peered":"2023-12-12T09:46:26.983101+0000","last_unstale":"2023-12-12T09:46:27.987425+0000","last_undegraded":"2023-12-12T09:46:27.987425+0000","last_fullsized":"2023-12-12T09:46:27.987425+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_clean_scrub_stamp":"2023-12-12T09:46:25.941843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T10:55:01.026545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.f","version":"74'1","reported_seq":13,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-12-12T09:46:28.820096+0000","last_change":"2023-12-12T09:46:25.988523+0000","last_active":"2023-12-12T09:46:28.820096+0000","last_peered":"2023-12-12T09:46:28.820096+0000","last_clean":"2023-12-12T09:46:28.820096+0000","last_became_active":"2023-12-12T09:46:25.988129+0000","last_became_peered":"2023-12-12T09:46:25.988129+0000","last_unstale":"2023-12-12T09:46:28.820096+0000","last_undegraded":"2023-12-12T09:46:28.820096+0000","last_fullsized":"2023-12-12T09:46:28.820096+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:24.925008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:24.925008+0000","last_clean_scrub_stamp":"2023-12-12T09:46:24.925008+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T17:57:21.984396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-12-12T09:46:28.819857+0000","last_change":"2023-12-12T09:46:26.985248+0000","last_active":"2023-12-12T09:46:28.819857+0000","last_peered":"2023-12-12T09:46:28.819857+0000","last_clean":"2023-12-12T09:46:28.819857+0000","last_became_active":"2023-12-12T09:46:26.984986+0000","last_became_peered":"2023-12-12T09:46:26.984986+0000","last_unstale":"2023-12-12T09:46:28.819857+0000","last_undegraded":"2023-12-12T09:46:28.819857+0000","last_fullsized":"2023-12-12T09:46:28.819857+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_clean_scrub_stamp":"2023-12-12T09:46:25.941843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T14:49:18.138939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.e","version":"74'2","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-12-12T09:46:28.151968+0000","last_change":"2023-12-12T09:46:25.991479+0000","last_active":"2023-12-12T09:46:28.151968+0000","last_peered":"2023-12-12T09:46:28.151968+0000","last_clean":"2023-12-12T09:46:28.151968+0000","last_became_active":"2023-12-12T09:46:25.991205+0000","last_became_peered":"2023-12-12T09:46:25.991205+0000","last_unstale":"2023-12-12T09:46:28.151968+0000","last_undegraded":"2023-12-12T09:46:28.151968+0000","last_fullsized":"2023-12-12T09:46:28.151968+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:24.925008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:24.925008+0000","last_clean_scrub_stamp":"2023-12-12T09:46:24.925008+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T18:32:41.851313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-12-12T09:46:28.185133+0000","last_change":"2023-12-12T09:46:26.987944+0000","last_active":"2023-12-12T09:46:28.185133+0000","last_peered":"2023-12-12T09:46:28.185133+0000","last_clean":"2023-12-12T09:46:28.185133+0000","last_became_active":"2023-12-12T09:46:26.987624+0000","last_became_peered":"2023-12-12T09:46:26.987624+0000","last_unstale":"2023-12-12T09:46:28.185133+0000","last_undegraded":"2023-12-12T09:46:28.185133+0000","last_fullsized":"2023-12-12T09:46:28.185133+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_clean_scrub_stamp":"2023-12-12T09:46:25.941843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T18:26:29.446839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-12-12T09:46:28.151778+0000","last_change":"2023-12-12T09:46:25.987255+0000","last_active":"2023-12-12T09:46:28.151778+0000","last_peered":"2023-12-12T09:46:28.151778+0000","last_clean":"2023-12-12T09:46:28.151778+0000","last_became_active":"2023-12-12T09:46:25.986994+0000","last_became_peered":"2023-12-12T09:46:25.986994+0000","last_unstale":"2023-12-12T09:46:28.151778+0000","last_undegraded":"2023-12-12T09:46:28.151778+0000","last_fullsized":"2023-12-12T09:46:28.151778+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:24.925008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:24.925008+0000","last_clean_scrub_stamp":"2023-12-12T09:46:24.925008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T17:57:21.984396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-12-12T09:46:28.951810+0000","last_change":"2023-12-12T09:46:26.998275+0000","last_active":"2023-12-12T09:46:28.951810+0000","last_peered":"2023-12-12T09:46:28.951810+0000","last_clean":"2023-12-12T09:46:28.951810+0000","last_became_active":"2023-12-12T09:46:26.997250+0000","last_became_peered":"2023-12-12T09:46:26.997250+0000","last_unstale":"2023-12-12T09:46:28.951810+0000","last_undegraded":"2023-12-12T09:46:28.951810+0000","last_fullsized":"2023-12-12T09:46:28.951810+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_clean_scrub_stamp":"2023-12-12T09:46:25.941843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T09:58:10.574493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.b","version":"74'2","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-12-12T09:46:27.981034+0000","last_change":"2023-12-12T09:46:25.981571+0000","last_active":"2023-12-12T09:46:27.981034+0000","last_peered":"2023-12-12T09:46:27.981034+0000","last_clean":"2023-12-12T09:46:27.981034+0000","last_became_active":"2023-12-12T09:46:25.981285+0000","last_became_peered":"2023-12-12T09:46:25.981285+0000","last_unstale":"2023-12-12T09:46:27.981034+0000","last_undegraded":"2023-12-12T09:46:27.981034+0000","last_fullsized":"2023-12-12T09:46:27.981034+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:24.925008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:24.925008+0000","last_clean_scrub_stamp":"2023-12-12T09:46:24.925008+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T16:03:21.071388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-12-12T09:46:27.986214+0000","last_change":"2023-12-12T09:46:26.979623+0000","last_active":"2023-12-12T09:46:27.986214+0000","last_peered":"2023-12-12T09:46:27.986214+0000","last_clean":"2023-12-12T09:46:27.986214+0000","last_became_active":"2023-12-12T09:46:26.979271+0000","last_became_peered":"2023-12-12T09:46:26.979271+0000","last_unstale":"2023-12-12T09:46:27.986214+0000","last_undegraded":"2023-12-12T09:46:27.986214+0000","last_fullsized":"2023-12-12T09:46:27.986214+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_clean_scrub_stamp":"2023-12-12T09:46:25.941843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T20:16:10.850955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-12-12T09:46:28.951780+0000","last_change":"2023-12-12T09:46:25.986608+0000","last_active":"2023-12-12T09:46:28.951780+0000","last_peered":"2023-12-12T09:46:28.951780+0000","last_clean":"2023-12-12T09:46:28.951780+0000","last_became_active":"2023-12-12T09:46:25.986236+0000","last_became_peered":"2023-12-12T09:46:25.986236+0000","last_unstale":"2023-12-12T09:46:28.951780+0000","last_undegraded":"2023-12-12T09:46:28.951780+0000","last_fullsized":"2023-12-12T09:46:28.951780+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:24.925008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:24.925008+0000","last_clean_scrub_stamp":"2023-12-12T09:46:24.925008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T20:29:16.623938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-12-12T09:46:28.950889+0000","last_change":"2023-12-12T09:46:26.987145+0000","last_active":"2023-12-12T09:46:28.950889+0000","last_peered":"2023-12-12T09:46:28.950889+0000","last_clean":"2023-12-12T09:46:28.950889+0000","last_became_active":"2023-12-12T09:46:26.986503+0000","last_became_peered":"2023-12-12T09:46:26.986503+0000","last_unstale":"2023-12-12T09:46:28.950889+0000","last_undegraded":"2023-12-12T09:46:28.950889+0000","last_fullsized":"2023-12-12T09:46:28.950889+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_clean_scrub_stamp":"2023-12-12T09:46:25.941843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T18:36:24.773262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-12-12T09:46:28.951433+0000","last_change":"2023-12-12T09:46:25.988222+0000","last_active":"2023-12-12T09:46:28.951433+0000","last_peered":"2023-12-12T09:46:28.951433+0000","last_clean":"2023-12-12T09:46:28.951433+0000","last_became_active":"2023-12-12T09:46:25.987972+0000","last_became_peered":"2023-12-12T09:46:25.987972+0000","last_unstale":"2023-12-12T09:46:28.951433+0000","last_undegraded":"2023-12-12T09:46:28.951433+0000","last_fullsized":"2023-12-12T09:46:28.951433+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:24.925008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:24.925008+0000","last_clean_scrub_stamp":"2023-12-12T09:46:24.925008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T12:18:16.286957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-12-12T09:46:27.986341+0000","last_change":"2023-12-12T09:46:26.968398+0000","last_active":"2023-12-12T09:46:27.986341+0000","last_peered":"2023-12-12T09:46:27.986341+0000","last_clean":"2023-12-12T09:46:27.986341+0000","last_became_active":"2023-12-12T09:46:26.967774+0000","last_became_peered":"2023-12-12T09:46:26.967774+0000","last_unstale":"2023-12-12T09:46:27.986341+0000","last_undegraded":"2023-12-12T09:46:27.986341+0000","last_fullsized":"2023-12-12T09:46:27.986341+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_clean_scrub_stamp":"2023-12-12T09:46:25.941843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T11:46:37.930187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-12-12T09:46:27.980655+0000","last_change":"2023-12-12T09:46:25.983579+0000","last_active":"2023-12-12T09:46:27.980655+0000","last_peered":"2023-12-12T09:46:27.980655+0000","last_clean":"2023-12-12T09:46:27.980655+0000","last_became_active":"2023-12-12T09:46:25.983172+0000","last_became_peered":"2023-12-12T09:46:25.983172+0000","last_unstale":"2023-12-12T09:46:27.980655+0000","last_undegraded":"2023-12-12T09:46:27.980655+0000","last_fullsized":"2023-12-12T09:46:27.980655+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:24.925008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:24.925008+0000","last_clean_scrub_stamp":"2023-12-12T09:46:24.925008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T10:55:00.009710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-12-12T09:46:28.184802+0000","last_change":"2023-12-12T09:46:26.974656+0000","last_active":"2023-12-12T09:46:28.184802+0000","last_peered":"2023-12-12T09:46:28.184802+0000","last_clean":"2023-12-12T09:46:28.184802+0000","last_became_active":"2023-12-12T09:46:26.974051+0000","last_became_peered":"2023-12-12T09:46:26.974051+0000","last_unstale":"2023-12-12T09:46:28.184802+0000","last_undegraded":"2023-12-12T09:46:28.184802+0000","last_fullsized":"2023-12-12T09:46:28.184802+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_clean_scrub_stamp":"2023-12-12T09:46:25.941843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T14:33:59.265126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.7","version":"74'2","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-12-12T09:46:28.950867+0000","last_change":"2023-12-12T09:46:25.989868+0000","last_active":"2023-12-12T09:46:28.950867+0000","last_peered":"2023-12-12T09:46:28.950867+0000","last_clean":"2023-12-12T09:46:28.950867+0000","last_became_active":"2023-12-12T09:46:25.989577+0000","last_became_peered":"2023-12-12T09:46:25.989577+0000","last_unstale":"2023-12-12T09:46:28.950867+0000","last_undegraded":"2023-12-12T09:46:28.950867+0000","last_fullsized":"2023-12-12T09:46:28.950867+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:24.925008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:24.925008+0000","last_clean_scrub_stamp":"2023-12-12T09:46:24.925008+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T19:17:31.250809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-12-12T09:46:27.987621+0000","last_change":"2023-12-12T09:46:26.994090+0000","last_active":"2023-12-12T09:46:27.987621+0000","last_peered":"2023-12-12T09:46:27.987621+0000","last_clean":"2023-12-12T09:46:27.987621+0000","last_became_active":"2023-12-12T09:46:26.992152+0000","last_became_peered":"2023-12-12T09:46:26.992152+0000","last_unstale":"2023-12-12T09:46:27.987621+0000","last_undegraded":"2023-12-12T09:46:27.987621+0000","last_fullsized":"2023-12-12T09:46:27.987621+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_clean_scrub_stamp":"2023-12-12T09:46:25.941843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T16:03:22.088223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-12-12T09:46:28.951090+0000","last_change":"2023-12-12T09:46:25.986713+0000","last_active":"2023-12-12T09:46:28.951090+0000","last_peered":"2023-12-12T09:46:28.951090+0000","last_clean":"2023-12-12T09:46:28.951090+0000","last_became_active":"2023-12-12T09:46:25.986422+0000","last_became_peered":"2023-12-12T09:46:25.986422+0000","last_unstale":"2023-12-12T09:46:28.951090+0000","last_undegraded":"2023-12-12T09:46:28.951090+0000","last_fullsized":"2023-12-12T09:46:28.951090+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:24.925008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:24.925008+0000","last_clean_scrub_stamp":"2023-12-12T09:46:24.925008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T10:48:07.069161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-12-12T09:46:28.819541+0000","last_change":"2023-12-12T09:46:26.989385+0000","last_active":"2023-12-12T09:46:28.819541+0000","last_peered":"2023-12-12T09:46:28.819541+0000","last_clean":"2023-12-12T09:46:28.819541+0000","last_became_active":"2023-12-12T09:46:26.989099+0000","last_became_peered":"2023-12-12T09:46:26.989099+0000","last_unstale":"2023-12-12T09:46:28.819541+0000","last_undegraded":"2023-12-12T09:46:28.819541+0000","last_fullsized":"2023-12-12T09:46:28.819541+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_clean_scrub_stamp":"2023-12-12T09:46:25.941843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T16:03:22.088223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-12-12T09:46:28.819333+0000","last_change":"2023-12-12T09:46:25.988958+0000","last_active":"2023-12-12T09:46:28.819333+0000","last_peered":"2023-12-12T09:46:28.819333+0000","last_clean":"2023-12-12T09:46:28.819333+0000","last_became_active":"2023-12-12T09:46:25.988383+0000","last_became_peered":"2023-12-12T09:46:25.988383+0000","last_unstale":"2023-12-12T09:46:28.819333+0000","last_undegraded":"2023-12-12T09:46:28.819333+0000","last_fullsized":"2023-12-12T09:46:28.819333+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:24.925008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:24.925008+0000","last_clean_scrub_stamp":"2023-12-12T09:46:24.925008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T12:32:02.713576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-12-12T09:46:28.185352+0000","last_change":"2023-12-12T09:46:26.989882+0000","last_active":"2023-12-12T09:46:28.185352+0000","last_peered":"2023-12-12T09:46:28.185352+0000","last_clean":"2023-12-12T09:46:28.185352+0000","last_became_active":"2023-12-12T09:46:26.989558+0000","last_became_peered":"2023-12-12T09:46:26.989558+0000","last_unstale":"2023-12-12T09:46:28.185352+0000","last_undegraded":"2023-12-12T09:46:28.185352+0000","last_fullsized":"2023-12-12T09:46:28.185352+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_clean_scrub_stamp":"2023-12-12T09:46:25.941843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T15:01:39.944049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-12-12T09:46:28.819476+0000","last_change":"2023-12-12T09:46:25.985790+0000","last_active":"2023-12-12T09:46:28.819476+0000","last_peered":"2023-12-12T09:46:28.819476+0000","last_clean":"2023-12-12T09:46:28.819476+0000","last_became_active":"2023-12-12T09:46:25.985297+0000","last_became_peered":"2023-12-12T09:46:25.985297+0000","last_unstale":"2023-12-12T09:46:28.819476+0000","last_undegraded":"2023-12-12T09:46:28.819476+0000","last_fullsized":"2023-12-12T09:46:28.819476+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:24.925008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:24.925008+0000","last_clean_scrub_stamp":"2023-12-12T09:46:24.925008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T20:16:09.834119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-12-12T09:46:27.986367+0000","last_change":"2023-12-12T09:46:26.978093+0000","last_active":"2023-12-12T09:46:27.986367+0000","last_peered":"2023-12-12T09:46:27.986367+0000","last_clean":"2023-12-12T09:46:27.986367+0000","last_became_active":"2023-12-12T09:46:26.977782+0000","last_became_peered":"2023-12-12T09:46:26.977782+0000","last_unstale":"2023-12-12T09:46:27.986367+0000","last_undegraded":"2023-12-12T09:46:27.986367+0000","last_fullsized":"2023-12-12T09:46:27.986367+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_clean_scrub_stamp":"2023-12-12T09:46:25.941843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T20:27:55.483605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-12-12T09:46:28.151995+0000","last_change":"2023-12-12T09:46:25.989940+0000","last_active":"2023-12-12T09:46:28.151995+0000","last_peered":"2023-12-12T09:46:28.151995+0000","last_clean":"2023-12-12T09:46:28.151995+0000","last_became_active":"2023-12-12T09:46:25.989572+0000","last_became_peered":"2023-12-12T09:46:25.989572+0000","last_unstale":"2023-12-12T09:46:28.151995+0000","last_undegraded":"2023-12-12T09:46:28.151995+0000","last_fullsized":"2023-12-12T09:46:28.151995+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:24.925008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:24.925008+0000","last_clean_scrub_stamp":"2023-12-12T09:46:24.925008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T10:24:07.511710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-12-12T09:46:28.151846+0000","last_change":"2023-12-12T09:46:26.980504+0000","last_active":"2023-12-12T09:46:28.151846+0000","last_peered":"2023-12-12T09:46:28.151846+0000","last_clean":"2023-12-12T09:46:28.151846+0000","last_became_active":"2023-12-12T09:46:26.980219+0000","last_became_peered":"2023-12-12T09:46:26.980219+0000","last_unstale":"2023-12-12T09:46:28.151846+0000","last_undegraded":"2023-12-12T09:46:28.151846+0000","last_fullsized":"2023-12-12T09:46:28.151846+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_clean_scrub_stamp":"2023-12-12T09:46:25.941843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T10:55:01.026545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-12-12T09:46:28.185040+0000","last_change":"2023-12-12T09:46:25.997435+0000","last_active":"2023-12-12T09:46:28.185040+0000","last_peered":"2023-12-12T09:46:28.185040+0000","last_clean":"2023-12-12T09:46:28.185040+0000","last_became_active":"2023-12-12T09:46:25.997139+0000","last_became_peered":"2023-12-12T09:46:25.997139+0000","last_unstale":"2023-12-12T09:46:28.185040+0000","last_undegraded":"2023-12-12T09:46:28.185040+0000","last_fullsized":"2023-12-12T09:46:28.185040+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:24.925008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:24.925008+0000","last_clean_scrub_stamp":"2023-12-12T09:46:24.925008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T10:34:31.890420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-12-12T09:46:27.986035+0000","last_change":"2023-12-12T09:46:26.992722+0000","last_active":"2023-12-12T09:46:27.986035+0000","last_peered":"2023-12-12T09:46:27.986035+0000","last_clean":"2023-12-12T09:46:27.986035+0000","last_became_active":"2023-12-12T09:46:26.990039+0000","last_became_peered":"2023-12-12T09:46:26.990039+0000","last_unstale":"2023-12-12T09:46:27.986035+0000","last_undegraded":"2023-12-12T09:46:27.986035+0000","last_fullsized":"2023-12-12T09:46:27.986035+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_clean_scrub_stamp":"2023-12-12T09:46:25.941843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T18:26:29.446839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-12-12T09:46:28.819131+0000","last_change":"2023-12-12T09:46:25.982419+0000","last_active":"2023-12-12T09:46:28.819131+0000","last_peered":"2023-12-12T09:46:28.819131+0000","last_clean":"2023-12-12T09:46:28.819131+0000","last_became_active":"2023-12-12T09:46:25.981873+0000","last_became_peered":"2023-12-12T09:46:25.981873+0000","last_unstale":"2023-12-12T09:46:28.819131+0000","last_undegraded":"2023-12-12T09:46:28.819131+0000","last_fullsized":"2023-12-12T09:46:28.819131+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:24.925008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:24.925008+0000","last_clean_scrub_stamp":"2023-12-12T09:46:24.925008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T12:20:22.104420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-12-12T09:46:28.819107+0000","last_change":"2023-12-12T09:46:26.995503+0000","last_active":"2023-12-12T09:46:28.819107+0000","last_peered":"2023-12-12T09:46:28.819107+0000","last_clean":"2023-12-12T09:46:28.819107+0000","last_became_active":"2023-12-12T09:46:26.995090+0000","last_became_peered":"2023-12-12T09:46:26.995090+0000","last_unstale":"2023-12-12T09:46:28.819107+0000","last_undegraded":"2023-12-12T09:46:28.819107+0000","last_fullsized":"2023-12-12T09:46:28.819107+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_clean_scrub_stamp":"2023-12-12T09:46:25.941843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T15:01:39.944049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-12-12T09:46:28.184291+0000","last_change":"2023-12-12T09:46:25.997135+0000","last_active":"2023-12-12T09:46:28.184291+0000","last_peered":"2023-12-12T09:46:28.184291+0000","last_clean":"2023-12-12T09:46:28.184291+0000","last_became_active":"2023-12-12T09:46:25.996777+0000","last_became_peered":"2023-12-12T09:46:25.996777+0000","last_unstale":"2023-12-12T09:46:28.184291+0000","last_undegraded":"2023-12-12T09:46:28.184291+0000","last_fullsized":"2023-12-12T09:46:28.184291+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:24.925008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:24.925008+0000","last_clean_scrub_stamp":"2023-12-12T09:46:24.925008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T16:09:35.711601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-12-12T09:46:28.950223+0000","last_change":"2023-12-12T09:46:26.994842+0000","last_active":"2023-12-12T09:46:28.950223+0000","last_peered":"2023-12-12T09:46:28.950223+0000","last_clean":"2023-12-12T09:46:28.950223+0000","last_became_active":"2023-12-12T09:46:26.986721+0000","last_became_peered":"2023-12-12T09:46:26.986721+0000","last_unstale":"2023-12-12T09:46:28.950223+0000","last_undegraded":"2023-12-12T09:46:28.950223+0000","last_fullsized":"2023-12-12T09:46:28.950223+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_clean_scrub_stamp":"2023-12-12T09:46:25.941843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T16:09:36.728436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"74'1","reported_seq":13,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-12-12T09:46:27.987759+0000","last_change":"2023-12-12T09:46:25.996699+0000","last_active":"2023-12-12T09:46:27.987759+0000","last_peered":"2023-12-12T09:46:27.987759+0000","last_clean":"2023-12-12T09:46:27.987759+0000","last_became_active":"2023-12-12T09:46:25.995486+0000","last_became_peered":"2023-12-12T09:46:25.995486+0000","last_unstale":"2023-12-12T09:46:27.987759+0000","last_undegraded":"2023-12-12T09:46:27.987759+0000","last_fullsized":"2023-12-12T09:46:27.987759+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:24.925008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:24.925008+0000","last_clean_scrub_stamp":"2023-12-12T09:46:24.925008+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T10:24:07.511710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":211,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-12-12T09:46:26.972059+0000","last_change":"2023-12-12T09:43:17.203315+0000","last_active":"2023-12-12T09:46:26.972059+0000","last_peered":"2023-12-12T09:46:26.972059+0000","last_clean":"2023-12-12T09:46:26.972059+0000","last_became_active":"2023-12-12T09:43:17.200779+0000","last_became_peered":"2023-12-12T09:43:17.200779+0000","last_unstale":"2023-12-12T09:46:26.972059+0000","last_undegraded":"2023-12-12T09:46:26.972059+0000","last_fullsized":"2023-12-12T09:46:26.972059+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:43:15.931922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:43:15.931922+0000","last_clean_scrub_stamp":"2023-12-12T09:43:15.931922+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T21:42:10.929640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":64844,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574891,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32148,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339692,"statfs":{"total":96636764160,"available":96603844608,"internally_reserved":0,"allocated":991232,"data_stored":996299,"data_compressed":32422,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 12 09:46:16 2023","interfaces":[{"interface":"back","average":{"1min":1.163,"5min":1.046,"15min":1.014},"min":{"1min":0.66300000000000003,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.677,"5min":1.8089999999999999,"15min":1.8089999999999999},"last":1.129},{"interface":"front","average":{"1min":1.143,"5min":1.0309999999999999,"15min":0.98299999999999998},"min":{"1min":0.67700000000000005,"5min":0.66300000000000003,"15min":0.66300000000000003},"max":{"1min":1.71,"5min":1.71,"15min":1.71},"last":1.544}]},{"osd":1,"last update":"Tue Dec 12 09:46:16 2023","interfaces":[{"interface":"back","average":{"1min":1.3089999999999999,"5min":1.21,"15min":1.202},"min":{"1min":0.79300000000000004,"5min":0.72099999999999997,"15min":0.72099999999999997},"max":{"1min":1.897,"5min":1.897,"15min":1.897},"last":1.3200000000000001},{"interface":"front","average":{"1min":1.1279999999999999,"5min":1.1830000000000001,"15min":1.2050000000000001},"min":{"1min":0.76300000000000001,"5min":0.71499999999999997,"15min":0.71499999999999997},"max":{"1min":1.4730000000000001,"5min":3.1150000000000002,"15min":3.1150000000000002},"last":1.585}]},{"osd":2,"last update":"Tue Dec 12 09:46:16 2023","interfaces":[{"interface":"back","average":{"1min":1.252,"5min":1.2350000000000001,"15min":1.2529999999999999},"min":{"1min":0.89500000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"max":{"1min":1.8129999999999999,"5min":2.2050000000000001,"15min":2.2050000000000001},"last":1.0309999999999999},{"interface":"front","average":{"1min":1.139,"5min":1.2030000000000001,"15min":1.2310000000000001},"min":{"1min":0.72999999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":2.0329999999999999,"5min":3.2759999999999998,"15min":3.2759999999999998},"last":1.4810000000000001}]},{"osd":3,"last update":"Tue Dec 12 09:46:16 2023","interfaces":[{"interface":"back","average":{"1min":1.095,"5min":1.2470000000000001,"15min":1.2929999999999999},"min":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"max":{"1min":1.5900000000000001,"5min":3.1819999999999999,"15min":3.1819999999999999},"last":1.2170000000000001},{"interface":"front","average":{"1min":1.367,"5min":1.294,"15min":1.294},"min":{"1min":0.88200000000000001,"5min":0.72799999999999998,"15min":0.72799999999999998},"max":{"1min":1.845,"5min":1.8740000000000001,"15min":1.8740000000000001},"last":1.641}]},{"osd":4,"last update":"Tue Dec 12 09:46:16 2023","interfaces":[{"interface":"back","average":{"1min":1.274,"5min":1.3149999999999999,"15min":1.339},"min":{"1min":0.68799999999999994,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.974,"5min":2.5529999999999999,"15min":2.5529999999999999},"last":1.4139999999999999},{"interface":"front","average":{"1min":1.383,"5min":1.395,"15min":1.4350000000000001},"min":{"1min":0.94399999999999995,"5min":0.66000000000000003,"15min":0.66000000000000003},"max":{"1min":2.3759999999999999,"5min":2.3759999999999999,"15min":2.3759999999999999},"last":1.369}]},{"osd":5,"last update":"Tue Dec 12 09:46:16 2023","interfaces":[{"interface":"back","average":{"1min":1.4379999999999999,"5min":1.347,"15min":1.339},"min":{"1min":0.622,"5min":0.622,"15min":0.622},"max":{"1min":1.9890000000000001,"5min":1.9890000000000001,"15min":1.9890000000000001},"last":1.1699999999999999},{"interface":"front","average":{"1min":1.498,"5min":1.4990000000000001,"15min":1.524},"min":{"1min":1.0529999999999999,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":2.0259999999999998,"5min":2.4159999999999999,"15min":2.4159999999999999},"last":1.2609999999999999}]},{"osd":6,"last update":"Tue Dec 12 09:46:16 2023","interfaces":[{"interface":"back","average":{"1min":1.4019999999999999,"5min":1.4159999999999999,"15min":1.4159999999999999},"min":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"max":{"1min":1.9970000000000001,"5min":2.0510000000000002,"15min":2.0510000000000002},"last":1.456},{"interface":"front","average":{"1min":1.5649999999999999,"5min":1.591,"15min":1.6200000000000001},"min":{"1min":1.1970000000000001,"5min":0.71899999999999997,"15min":0.71899999999999997},"max":{"1min":2.0899999999999999,"5min":2.5800000000000001,"15min":2.5800000000000001},"last":1.4990000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574889,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32088,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339752,"statfs":{"total":96636764160,"available":96603906048,"internally_reserved":0,"allocated":921600,"data_stored":400255,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 12 09:46:17 2023","interfaces":[{"interface":"back","average":{"1min":0.995,"5min":1.1080000000000001,"15min":1.1639999999999999},"min":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.4390000000000001,"5min":3.6429999999999998,"15min":3.6429999999999998},"last":1.153},{"interface":"front","average":{"1min":0.99299999999999999,"5min":1.0640000000000001,"15min":1.0680000000000001},"min":{"1min":0.60099999999999998,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.546,"5min":2.6059999999999999,"15min":2.6059999999999999},"last":1.7729999999999999}]},{"osd":1,"last update":"Tue Dec 12 09:46:17 2023","interfaces":[{"interface":"back","average":{"1min":1.0589999999999999,"5min":1.081,"15min":1.0680000000000001},"min":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"max":{"1min":1.5069999999999999,"5min":2.0169999999999999,"15min":2.0169999999999999},"last":1.3839999999999999},{"interface":"front","average":{"1min":1.1359999999999999,"5min":1.1819999999999999,"15min":1.194},"min":{"1min":0.82399999999999995,"5min":0.72899999999999998,"15min":0.72899999999999998},"max":{"1min":1.4810000000000001,"5min":1.7,"15min":1.7},"last":1.71}]},{"osd":2,"last update":"Tue Dec 12 09:46:17 2023","interfaces":[{"interface":"back","average":{"1min":1.218,"5min":1.2150000000000001,"15min":1.2290000000000001},"min":{"1min":0.87,"5min":0.71199999999999997,"15min":0.71199999999999997},"max":{"1min":1.5309999999999999,"5min":1.804,"15min":1.804},"last":1.3380000000000001},{"interface":"front","average":{"1min":1.2050000000000001,"5min":1.258,"15min":1.294},"min":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":1.6799999999999999,"5min":2.2160000000000002,"15min":2.2160000000000002},"last":1.679}]},{"osd":3,"last update":"Tue Dec 12 09:46:17 2023","interfaces":[{"interface":"back","average":{"1min":1.196,"5min":1.2110000000000001,"15min":1.2150000000000001},"min":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"max":{"1min":1.4339999999999999,"5min":2.665,"15min":2.665},"last":1.278},{"interface":"front","average":{"1min":1.149,"5min":1.1899999999999999,"15min":1.2170000000000001},"min":{"1min":0.75700000000000001,"5min":0.65700000000000003,"15min":0.65700000000000003},"max":{"1min":1.5760000000000001,"5min":1.8620000000000001,"15min":1.8620000000000001},"last":1.4630000000000001}]},{"osd":4,"last update":"Tue Dec 12 09:46:17 2023","interfaces":[{"interface":"back","average":{"1min":1.3220000000000001,"5min":1.284,"15min":1.278},"min":{"1min":0.98199999999999998,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":1.631,"5min":2.0310000000000001,"15min":2.0310000000000001},"last":1.518},{"interface":"front","average":{"1min":1.4279999999999999,"5min":1.4079999999999999,"15min":1.407},"min":{"1min":0.95199999999999996,"5min":0.66200000000000003,"15min":0.66200000000000003},"max":{"1min":1.657,"5min":2.2799999999999998,"15min":2.2799999999999998},"last":1.853}]},{"osd":5,"last update":"Tue Dec 12 09:46:17 2023","interfaces":[{"interface":"back","average":{"1min":1.266,"5min":1.377,"15min":1.419},"min":{"1min":0.90700000000000003,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.7030000000000001,"5min":2.1739999999999999,"15min":2.1739999999999999},"last":1.224},{"interface":"front","average":{"1min":1.494,"5min":1.4790000000000001,"15min":1.4770000000000001},"min":{"1min":1.175,"5min":0.80100000000000005,"15min":0.80100000000000005},"max":{"1min":1.76,"5min":1.929,"15min":1.929},"last":1.8009999999999999}]},{"osd":7,"last update":"Tue Dec 12 09:46:17 2023","interfaces":[{"interface":"back","average":{"1min":1.448,"5min":1.476,"15min":1.498},"min":{"1min":1.03,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.8759999999999999,"5min":1.994,"15min":1.994},"last":1.4199999999999999},{"interface":"front","average":{"1min":1.4139999999999999,"5min":1.4810000000000001,"15min":1.5189999999999999},"min":{"1min":1.0389999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"max":{"1min":1.792,"5min":2.0800000000000001,"15min":2.0800000000000001},"last":1.3169999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574889,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32096,"kb_used_data":916,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339744,"statfs":{"total":96636764160,"available":96603897856,"internally_reserved":0,"allocated":937984,"data_stored":407495,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 12 09:46:17 2023","interfaces":[{"interface":"back","average":{"1min":1.0509999999999999,"5min":1.026,"15min":1.022},"min":{"1min":0.73799999999999999,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.5089999999999999,"5min":1.7310000000000001,"15min":1.7310000000000001},"last":1.1819999999999999},{"interface":"front","average":{"1min":1.077,"5min":1.101,"15min":1.1200000000000001},"min":{"1min":0.69899999999999995,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.4219999999999999,"5min":1.595,"15min":1.595},"last":1.248}]},{"osd":1,"last update":"Tue Dec 12 09:46:17 2023","interfaces":[{"interface":"back","average":{"1min":1.075,"5min":1.1499999999999999,"15min":1.2},"min":{"1min":0.86699999999999999,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.343,"5min":1.756,"15min":1.756},"last":1.0069999999999999},{"interface":"front","average":{"1min":1.052,"5min":1.079,"15min":1.087},"min":{"1min":0.752,"5min":0.66400000000000003,"15min":0.66400000000000003},"max":{"1min":1.5129999999999999,"5min":1.5840000000000001,"15min":1.5840000000000001},"last":0.83199999999999996}]},{"osd":2,"last update":"Tue Dec 12 09:46:17 2023","interfaces":[{"interface":"back","average":{"1min":1.1579999999999999,"5min":1.254,"15min":1.296},"min":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"max":{"1min":1.744,"5min":1.7889999999999999,"15min":1.7889999999999999},"last":1.4199999999999999},{"interface":"front","average":{"1min":1.089,"5min":1.3009999999999999,"15min":1.381},"min":{"1min":0.77000000000000002,"5min":0.72899999999999998,"15min":0.72899999999999998},"max":{"1min":1.556,"5min":2.1600000000000001,"15min":2.1600000000000001},"last":1.1359999999999999}]},{"osd":3,"last update":"Tue Dec 12 09:46:17 2023","interfaces":[{"interface":"back","average":{"1min":1.1659999999999999,"5min":1.296,"15min":1.3460000000000001},"min":{"1min":0.90100000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"max":{"1min":1.627,"5min":2.1499999999999999,"15min":2.1499999999999999},"last":1.0700000000000001},{"interface":"front","average":{"1min":1.3540000000000001,"5min":1.413,"15min":1.4650000000000001},"min":{"1min":1.038,"5min":0.75800000000000001,"15min":0.75800000000000001},"max":{"1min":2.0249999999999999,"5min":2.0249999999999999,"15min":2.0249999999999999},"last":1.589}]},{"osd":4,"last update":"Tue Dec 12 09:46:17 2023","interfaces":[{"interface":"back","average":{"1min":1.2310000000000001,"5min":1.4019999999999999,"15min":1.4610000000000001},"min":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":1.9790000000000001,"5min":2.391,"15min":2.391},"last":1.3700000000000001},{"interface":"front","average":{"1min":1.4419999999999999,"5min":1.53,"15min":1.5680000000000001},"min":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"max":{"1min":2.6040000000000001,"5min":2.6040000000000001,"15min":2.6040000000000001},"last":1.282}]},{"osd":6,"last update":"Tue Dec 12 09:46:17 2023","interfaces":[{"interface":"back","average":{"1min":1.4390000000000001,"5min":1.5109999999999999,"15min":1.5669999999999999},"min":{"1min":0.74099999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":2.1179999999999999,"5min":2.1179999999999999,"15min":2.1179999999999999},"last":1.4990000000000001},{"interface":"front","average":{"1min":1.2829999999999999,"5min":1.5089999999999999,"15min":1.5900000000000001},"min":{"1min":0.80700000000000005,"5min":0.627,"15min":0.627},"max":{"1min":1.7849999999999999,"5min":2.306,"15min":2.306},"last":1.343}]},{"osd":7,"last update":"Tue Dec 12 09:46:17 2023","interfaces":[{"interface":"back","average":{"1min":1.546,"5min":1.6870000000000001,"15min":1.752},"min":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"max":{"1min":2.2200000000000002,"5min":2.6880000000000002,"15min":2.6880000000000002},"last":1.55},{"interface":"front","average":{"1min":1.605,"5min":1.6599999999999999,"15min":1.718},"min":{"1min":1.1479999999999999,"5min":0.88600000000000001,"15min":0.88600000000000001},"max":{"1min":2.4910000000000001,"5min":2.4910000000000001,"15min":2.4910000000000001},"last":1.6519999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574891,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32080,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339760,"statfs":{"total":96636764160,"available":96603914240,"internally_reserved":0,"allocated":921600,"data_stored":405861,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 12 09:46:19 2023","interfaces":[{"interface":"back","average":{"1min":1.0980000000000001,"5min":1.0549999999999999,"15min":1.0549999999999999},"min":{"1min":0.67400000000000004,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":1.5880000000000001,"5min":1.7010000000000001,"15min":1.7010000000000001},"last":1.212},{"interface":"front","average":{"1min":1.145,"5min":1.0589999999999999,"15min":1.056},"min":{"1min":0.75800000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":1.5449999999999999,"5min":1.5449999999999999,"15min":1.5449999999999999},"last":1.403}]},{"osd":1,"last update":"Tue Dec 12 09:46:19 2023","interfaces":[{"interface":"back","average":{"1min":1.0529999999999999,"5min":1.048,"15min":1.0449999999999999},"min":{"1min":0.748,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":1.496,"5min":1.496,"15min":1.496},"last":1.458},{"interface":"front","average":{"1min":1.133,"5min":1.163,"15min":1.175},"min":{"1min":0.75900000000000001,"5min":0.73699999999999999,"15min":0.73699999999999999},"max":{"1min":1.6140000000000001,"5min":1.8720000000000001,"15min":1.8720000000000001},"last":1.3200000000000001}]},{"osd":2,"last update":"Tue Dec 12 09:46:19 2023","interfaces":[{"interface":"back","average":{"1min":1.181,"5min":1.1359999999999999,"15min":1.1240000000000001},"min":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"max":{"1min":1.585,"5min":1.585,"15min":1.585},"last":1.0389999999999999},{"interface":"front","average":{"1min":1.226,"5min":1.2689999999999999,"15min":1.2849999999999999},"min":{"1min":0.80800000000000005,"5min":0.75600000000000001,"15min":0.75600000000000001},"max":{"1min":1.554,"5min":2.1640000000000001,"15min":2.1640000000000001},"last":1.1020000000000001}]},{"osd":3,"last update":"Tue Dec 12 09:46:19 2023","interfaces":[{"interface":"back","average":{"1min":1.3620000000000001,"5min":1.2450000000000001,"15min":1.2170000000000001},"min":{"1min":1.03,"5min":0.83399999999999996,"15min":0.83399999999999996},"max":{"1min":1.7010000000000001,"5min":1.7010000000000001,"15min":1.7010000000000001},"last":0.874},{"interface":"front","average":{"1min":1.24,"5min":1.2350000000000001,"15min":1.2370000000000001},"min":{"1min":0.86099999999999999,"5min":0.70599999999999996,"15min":0.70599999999999996},"max":{"1min":1.506,"5min":2.0499999999999998,"15min":2.0499999999999998},"last":1.355}]},{"osd":5,"last update":"Tue Dec 12 09:46:19 2023","interfaces":[{"interface":"back","average":{"1min":1.4139999999999999,"5min":1.4179999999999999,"15min":1.4510000000000001},"min":{"1min":1.026,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.7350000000000001,"5min":2.3159999999999998,"15min":2.3159999999999998},"last":1.73},{"interface":"front","average":{"1min":1.4890000000000001,"5min":1.3799999999999999,"15min":1.3600000000000001},"min":{"1min":1.2509999999999999,"5min":0.71199999999999997,"15min":0.71199999999999997},"max":{"1min":1.8160000000000001,"5min":2.117,"15min":2.117},"last":1.6839999999999999}]},{"osd":6,"last update":"Tue Dec 12 09:46:19 2023","interfaces":[{"interface":"back","average":{"1min":1.3799999999999999,"5min":1.381,"15min":1.395},"min":{"1min":0.98099999999999998,"5min":0.81200000000000006,"15min":0.81200000000000006},"max":{"1min":1.7090000000000001,"5min":2.246,"15min":2.246},"last":1.2569999999999999},{"interface":"front","average":{"1min":1.5609999999999999,"5min":1.5329999999999999,"15min":1.5429999999999999},"min":{"1min":1.0700000000000001,"5min":0.65600000000000003,"15min":0.65600000000000003},"max":{"1min":1.7949999999999999,"5min":2.5099999999999998,"15min":2.5099999999999998},"last":1.5069999999999999}]},{"osd":7,"last update":"Tue Dec 12 09:46:19 2023","interfaces":[{"interface":"back","average":{"1min":1.5720000000000001,"5min":1.51,"15min":1.506},"min":{"1min":1.1970000000000001,"5min":0.77500000000000002,"15min":0.77500000000000002},"max":{"1min":1.9099999999999999,"5min":2.5710000000000002,"15min":2.5710000000000002},"last":1.7809999999999999},{"interface":"front","average":{"1min":1.5640000000000001,"5min":1.522,"15min":1.516},"min":{"1min":1.2490000000000001,"5min":1.0600000000000001,"15min":1.0600000000000001},"max":{"1min":2.016,"5min":2.3919999999999999,"15min":2.3919999999999999},"last":1.6259999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574889,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32100,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339740,"statfs":{"total":96636764160,"available":96603893760,"internally_reserved":0,"allocated":933888,"data_stored":407473,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 12 09:46:19 2023","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.84599999999999997,"15min":0.89000000000000001},"min":{"1min":0.35099999999999998,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":1.2350000000000001,"5min":1.4830000000000001,"15min":1.4830000000000001},"last":0.79500000000000004},{"interface":"front","average":{"1min":0.93600000000000005,"5min":1.012,"15min":1.095},"min":{"1min":0.47699999999999998,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":1.839,"5min":3.3370000000000002,"15min":3.3370000000000002},"last":0.64000000000000001}]},{"osd":1,"last update":"Tue Dec 12 09:46:19 2023","interfaces":[{"interface":"back","average":{"1min":0.88100000000000001,"5min":0.875,"15min":0.90500000000000003},"min":{"1min":0.52200000000000002,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":1.4870000000000001,"5min":1.4870000000000001,"15min":1.4870000000000001},"last":0.74299999999999999},{"interface":"front","average":{"1min":1.0580000000000001,"5min":1.0209999999999999,"15min":1.0529999999999999},"min":{"1min":0.58399999999999996,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.542,"5min":2.9409999999999998,"15min":2.9409999999999998},"last":0.72199999999999998}]},{"osd":2,"last update":"Tue Dec 12 09:46:19 2023","interfaces":[{"interface":"back","average":{"1min":0.94599999999999995,"5min":1.0760000000000001,"15min":1.1499999999999999},"min":{"1min":0.56100000000000005,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.6899999999999999,"5min":2.613,"15min":2.613},"last":0.83599999999999997},{"interface":"front","average":{"1min":1.0489999999999999,"5min":1.1000000000000001,"15min":1.1559999999999999},"min":{"1min":0.53600000000000003,"5min":0.437,"15min":0.437},"max":{"1min":1.53,"5min":3.0430000000000001,"15min":3.0430000000000001},"last":0.86399999999999999}]},{"osd":4,"last update":"Tue Dec 12 09:46:19 2023","interfaces":[{"interface":"back","average":{"1min":1.129,"5min":1.2989999999999999,"15min":1.355},"min":{"1min":0.77200000000000002,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.7410000000000001,"5min":3.5019999999999998,"15min":3.5019999999999998},"last":1.0289999999999999},{"interface":"front","average":{"1min":1.1850000000000001,"5min":1.355,"15min":1.4399999999999999},"min":{"1min":0.93500000000000005,"5min":0.755,"15min":0.755},"max":{"1min":1.528,"5min":2.9889999999999999,"15min":2.9889999999999999},"last":1.159}]},{"osd":5,"last update":"Tue Dec 12 09:46:19 2023","interfaces":[{"interface":"back","average":{"1min":1.306,"5min":1.4119999999999999,"15min":1.47},"min":{"1min":0.876,"5min":0.68000000000000005,"15min":0.68000000000000005},"max":{"1min":1.7370000000000001,"5min":4.2480000000000002,"15min":4.2480000000000002},"last":1.365},{"interface":"front","average":{"1min":1.2430000000000001,"5min":1.4450000000000001,"15min":1.5429999999999999},"min":{"1min":0.746,"5min":0.72999999999999998,"15min":0.72999999999999998},"max":{"1min":1.609,"5min":5.5060000000000002,"15min":5.5060000000000002},"last":0.96999999999999997}]},{"osd":6,"last update":"Tue Dec 12 09:46:19 2023","interfaces":[{"interface":"back","average":{"1min":1.2669999999999999,"5min":1.353,"15min":1.423},"min":{"1min":0.77700000000000002,"5min":0.76500000000000001,"15min":0.76500000000000001},"max":{"1min":1.6799999999999999,"5min":3.1400000000000001,"15min":3.1400000000000001},"last":1.302},{"interface":"front","average":{"1min":1.3540000000000001,"5min":1.456,"15min":1.516},"min":{"1min":0.92200000000000004,"5min":0.627,"15min":0.627},"max":{"1min":1.677,"5min":4.3179999999999996,"15min":4.3179999999999996},"last":1.4299999999999999}]},{"osd":7,"last update":"Tue Dec 12 09:46:19 2023","interfaces":[{"interface":"back","average":{"1min":1.3069999999999999,"5min":1.4630000000000001,"15min":1.5489999999999999},"min":{"1min":0.78100000000000003,"5min":0.77400000000000002,"15min":0.77400000000000002},"max":{"1min":1.627,"5min":5.3979999999999997,"15min":5.3979999999999997},"last":1.3939999999999999},{"interface":"front","average":{"1min":1.371,"5min":1.452,"15min":1.52},"min":{"1min":0.83799999999999997,"5min":0.74299999999999999,"15min":0.74299999999999999},"max":{"1min":1.7769999999999999,"5min":3.4129999999999998,"15min":3.4129999999999998},"last":1.22}]}]},{"osd":2,"up_from":13,"seq":55834574889,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27924,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343916,"statfs":{"total":96636764160,"available":96608169984,"internally_reserved":0,"allocated":925696,"data_stored":406443,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 12 09:46:17 2023","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":0.80400000000000005,"15min":0.81399999999999995},"min":{"1min":0.37,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":1.431,"5min":1.458,"15min":1.458},"last":0.40000000000000002},{"interface":"front","average":{"1min":0.88500000000000001,"5min":0.89400000000000002,"15min":0.90600000000000003},"min":{"1min":0.36099999999999999,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":2.4129999999999998,"5min":2.4129999999999998,"15min":2.4129999999999998},"last":0.502}]},{"osd":1,"last update":"Tue Dec 12 09:46:17 2023","interfaces":[{"interface":"back","average":{"1min":0.81299999999999994,"5min":0.84699999999999998,"15min":0.85799999999999998},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":1.2450000000000001,"5min":1.593,"15min":1.593},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.98399999999999999,"5min":0.89700000000000002,"15min":0.89000000000000001},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.514,"5min":1.758,"15min":1.758},"last":0.55200000000000005}]},{"osd":3,"last update":"Tue Dec 12 09:46:17 2023","interfaces":[{"interface":"back","average":{"1min":1.0589999999999999,"5min":1.034,"15min":1.0489999999999999},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":1.889,"5min":1.889,"15min":1.889},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.91300000000000003,"5min":0.96099999999999997,"15min":0.99299999999999999},"min":{"1min":0.442,"5min":0.432,"15min":0.432},"max":{"1min":1.472,"5min":1.8120000000000001,"15min":1.8120000000000001},"last":0.48499999999999999}]},{"osd":4,"last update":"Tue Dec 12 09:46:17 2023","interfaces":[{"interface":"back","average":{"1min":1.1359999999999999,"5min":1.1910000000000001,"15min":1.2150000000000001},"min":{"1min":0.753,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.8300000000000001,"5min":2.5760000000000001,"15min":2.5760000000000001},"last":1.0449999999999999},{"interface":"front","average":{"1min":1.175,"5min":1.3080000000000001,"15min":1.365},"min":{"1min":0.747,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.6259999999999999,"5min":2.8069999999999999,"15min":2.8069999999999999},"last":0.86199999999999999}]},{"osd":5,"last update":"Tue Dec 12 09:46:17 2023","interfaces":[{"interface":"back","average":{"1min":1.2210000000000001,"5min":1.3360000000000001,"15min":1.3640000000000001},"min":{"1min":0.81699999999999995,"5min":0.80500000000000005,"15min":0.80500000000000005},"max":{"1min":1.7150000000000001,"5min":2.3109999999999999,"15min":2.3109999999999999},"last":0.89500000000000002},{"interface":"front","average":{"1min":1.159,"5min":1.2809999999999999,"15min":1.327},"min":{"1min":0.79400000000000004,"5min":0.627,"15min":0.627},"max":{"1min":1.5660000000000001,"5min":2.5110000000000001,"15min":2.5110000000000001},"last":0.998}]},{"osd":6,"last update":"Tue Dec 12 09:46:17 2023","interfaces":[{"interface":"back","average":{"1min":1.2589999999999999,"5min":1.379,"15min":1.417},"min":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":1.77,"5min":2.907,"15min":2.907},"last":0.98499999999999999},{"interface":"front","average":{"1min":1.3120000000000001,"5min":1.3999999999999999,"15min":1.419},"min":{"1min":0.83899999999999997,"5min":0.82799999999999996,"15min":0.82799999999999996},"max":{"1min":1.7809999999999999,"5min":2.6000000000000001,"15min":2.6000000000000001},"last":0.82799999999999996}]},{"osd":7,"last update":"Tue Dec 12 09:46:17 2023","interfaces":[{"interface":"back","average":{"1min":1.333,"5min":1.401,"15min":1.4379999999999999},"min":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"max":{"1min":1.7669999999999999,"5min":2.3370000000000002,"15min":2.3370000000000002},"last":0.91400000000000003},{"interface":"front","average":{"1min":1.3779999999999999,"5min":1.466,"15min":1.4970000000000001},"min":{"1min":0.96499999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"max":{"1min":1.95,"5min":2.488,"15min":2.488},"last":1.131}]}]},{"osd":1,"up_from":13,"seq":55834574889,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32092,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339748,"statfs":{"total":96636764160,"available":96603901952,"internally_reserved":0,"allocated":933888,"data_stored":406055,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 12 09:46:17 2023","interfaces":[{"interface":"back","average":{"1min":0.82599999999999996,"5min":0.83699999999999997,"15min":0.84899999999999998},"min":{"1min":0.56299999999999994,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":1.427,"5min":2.794,"15min":2.794},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.749,"5min":0.82599999999999996,"15min":0.85199999999999998},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":1.5,"5min":2.1379999999999999,"15min":2.1379999999999999},"last":0.69999999999999996}]},{"osd":2,"last update":"Tue Dec 12 09:46:17 2023","interfaces":[{"interface":"back","average":{"1min":0.82899999999999996,"5min":0.93500000000000005,"15min":0.96899999999999997},"min":{"1min":0.59099999999999997,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":1.4450000000000001,"5min":6.3390000000000004,"15min":6.3390000000000004},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.89100000000000001,"5min":0.94699999999999995,"15min":0.95999999999999996},"min":{"1min":0.56799999999999995,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.1830000000000001,"5min":2.823,"15min":2.823},"last":0.72199999999999998}]},{"osd":3,"last update":"Tue Dec 12 09:46:17 2023","interfaces":[{"interface":"back","average":{"1min":0.94999999999999996,"5min":1.0329999999999999,"15min":1.0449999999999999},"min":{"1min":0.53200000000000003,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":1.5549999999999999,"5min":2.7519999999999998,"15min":2.7519999999999998},"last":0.79100000000000004},{"interface":"front","average":{"1min":0.88200000000000001,"5min":0.98399999999999999,"15min":1},"min":{"1min":0.498,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":1.212,"5min":2.2559999999999998,"15min":2.2559999999999998},"last":0.622}]},{"osd":4,"last update":"Tue Dec 12 09:46:17 2023","interfaces":[{"interface":"back","average":{"1min":1.159,"5min":1.2929999999999999,"15min":1.363},"min":{"1min":0.78700000000000003,"5min":0.68400000000000005,"15min":0.68400000000000005},"max":{"1min":1.484,"5min":6.423,"15min":6.423},"last":1.0900000000000001},{"interface":"front","average":{"1min":1.1799999999999999,"5min":1.1899999999999999,"15min":1.1919999999999999},"min":{"1min":0.84499999999999997,"5min":0.80000000000000004,"15min":0.80000000000000004},"max":{"1min":1.474,"5min":2.2309999999999999,"15min":2.2309999999999999},"last":0.93999999999999995}]},{"osd":5,"last update":"Tue Dec 12 09:46:17 2023","interfaces":[{"interface":"back","average":{"1min":1.145,"5min":1.353,"15min":1.429},"min":{"1min":0.93799999999999994,"5min":0.80200000000000005,"15min":0.80200000000000005},"max":{"1min":1.4970000000000001,"5min":6.2830000000000004,"15min":6.2830000000000004},"last":0.85199999999999998},{"interface":"front","average":{"1min":1.2310000000000001,"5min":1.325,"15min":1.3580000000000001},"min":{"1min":0.88900000000000001,"5min":0.83499999999999996,"15min":0.83499999999999996},"max":{"1min":1.4390000000000001,"5min":2.73,"15min":2.73},"last":0.98399999999999999}]},{"osd":6,"last update":"Tue Dec 12 09:46:17 2023","interfaces":[{"interface":"back","average":{"1min":1.236,"5min":1.446,"15min":1.522},"min":{"1min":0.84499999999999997,"5min":0.751,"15min":0.751},"max":{"1min":1.7210000000000001,"5min":6.468,"15min":6.468},"last":1.117},{"interface":"front","average":{"1min":1.2430000000000001,"5min":1.4470000000000001,"15min":1.5349999999999999},"min":{"1min":0.90400000000000003,"5min":0.84699999999999998,"15min":0.84699999999999998},"max":{"1min":1.585,"5min":6.3129999999999997,"15min":6.3129999999999997},"last":0.96399999999999997}]},{"osd":7,"last update":"Tue Dec 12 09:46:17 2023","interfaces":[{"interface":"back","average":{"1min":1.3300000000000001,"5min":1.3759999999999999,"15min":1.3959999999999999},"min":{"1min":0.99099999999999999,"5min":0.82999999999999996,"15min":0.82999999999999996},"max":{"1min":1.5980000000000001,"5min":2.9009999999999998,"15min":2.9009999999999998},"last":1.0089999999999999},{"interface":"front","average":{"1min":1.2529999999999999,"5min":1.4530000000000001,"15min":1.5209999999999999},"min":{"1min":0.92400000000000004,"5min":0.752,"15min":0.752},"max":{"1min":1.6379999999999999,"5min":6.242,"15min":6.242},"last":0.89500000000000002}]}]},{"osd":0,"up_from":13,"seq":55834574891,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32148,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339692,"statfs":{"total":96636764160,"available":96603844608,"internally_reserved":0,"allocated":991232,"data_stored":996263,"data_compressed":32422,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Dec 12 09:46:19 2023","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.78000000000000003,"15min":0.77400000000000002},"min":{"1min":0.40699999999999997,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":1.3600000000000001,"5min":1.639,"15min":1.639},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.82999999999999996,"15min":0.82099999999999995},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":1.5509999999999999,"5min":1.5680000000000001,"15min":1.5680000000000001},"last":0.65300000000000002}]},{"osd":2,"last update":"Tue Dec 12 09:46:19 2023","interfaces":[{"interface":"back","average":{"1min":0.86399999999999999,"5min":0.88,"15min":0.86799999999999999},"min":{"1min":0.47299999999999998,"5min":0.316,"15min":0.316},"max":{"1min":1.466,"5min":1.748,"15min":1.748},"last":1.073},{"interface":"front","average":{"1min":0.84299999999999997,"5min":0.97499999999999998,"15min":0.98799999999999999},"min":{"1min":0.48399999999999999,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":1.26,"5min":1.649,"15min":1.649},"last":1.347}]},{"osd":3,"last update":"Tue Dec 12 09:46:19 2023","interfaces":[{"interface":"back","average":{"1min":0.83499999999999996,"5min":0.84099999999999997,"15min":0.84899999999999998},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":1.901,"5min":1.901,"15min":1.901},"last":1.1539999999999999},{"interface":"front","average":{"1min":1.002,"5min":1.0129999999999999,"15min":1.0069999999999999},"min":{"1min":0.50700000000000001,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":2.3210000000000002,"5min":2.3210000000000002,"15min":2.3210000000000002},"last":1.1779999999999999}]},{"osd":4,"last update":"Tue Dec 12 09:46:19 2023","interfaces":[{"interface":"back","average":{"1min":1.2250000000000001,"5min":1.284,"15min":1.286},"min":{"1min":0.81399999999999995,"5min":0.80400000000000005,"15min":0.80400000000000005},"max":{"1min":1.5660000000000001,"5min":2.073,"15min":2.073},"last":0.86199999999999999},{"interface":"front","average":{"1min":1.248,"5min":1.2649999999999999,"15min":1.2829999999999999},"min":{"1min":0.85899999999999999,"5min":0.64400000000000002,"15min":0.64400000000000002},"max":{"1min":1.714,"5min":3.0699999999999998,"15min":3.0699999999999998},"last":1.2410000000000001}]},{"osd":5,"last update":"Tue Dec 12 09:46:19 2023","interfaces":[{"interface":"back","average":{"1min":1.177,"5min":1.2090000000000001,"15min":1.2250000000000001},"min":{"1min":0.68600000000000005,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.698,"5min":3.1909999999999998,"15min":3.1909999999999998},"last":1.107},{"interface":"front","average":{"1min":1.266,"5min":1.292,"15min":1.302},"min":{"1min":0.89700000000000002,"5min":0.67300000000000004,"15min":0.67300000000000004},"max":{"1min":2.2120000000000002,"5min":2.2120000000000002,"15min":2.2120000000000002},"last":1.3089999999999999}]},{"osd":6,"last update":"Tue Dec 12 09:46:19 2023","interfaces":[{"interface":"back","average":{"1min":1.3260000000000001,"5min":1.3340000000000001,"15min":1.3360000000000001},"min":{"1min":0.84999999999999998,"5min":0.67500000000000004,"15min":0.67500000000000004},"max":{"1min":1.643,"5min":2.04,"15min":2.04},"last":1.4370000000000001},{"interface":"front","average":{"1min":1.296,"5min":1.3660000000000001,"15min":1.383},"min":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"max":{"1min":2.3500000000000001,"5min":2.9100000000000001,"15min":2.9100000000000001},"last":1.466}]},{"osd":7,"last update":"Tue Dec 12 09:46:19 2023","interfaces":[{"interface":"back","average":{"1min":1.3280000000000001,"5min":1.4119999999999999,"15min":1.4339999999999999},"min":{"1min":0.78100000000000003,"5min":0.66800000000000004,"15min":0.66800000000000004},"max":{"1min":1.7929999999999999,"5min":2.992,"15min":2.992},"last":1.556},{"interface":"front","average":{"1min":1.3280000000000001,"5min":1.327,"15min":1.329},"min":{"1min":0.93500000000000005,"5min":0.79500000000000004,"15min":0.79500000000000004},"max":{"1min":2.1440000000000001,"5min":2.7690000000000001,"15min":2.7690000000000001},"last":1.409}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32422,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32422,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-12T09:46:31.706 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-12T09:46:31.956 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:31.955+0000 7f714ace0640 1 Processor -- start 2023-12-12T09:46:31.957 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:31.955+0000 7f714ace0640 1 -- start start 2023-12-12T09:46:31.959 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:31.956+0000 7f714ace0640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f714406bf90 0x7f71441584f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:31.960 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:31.956+0000 7f714ace0640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f714406a4e0 0x7f714406a930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:31.960 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:31.956+0000 7f714ace0640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71440c4d00 con 0x7f71440a5040 2023-12-12T09:46:31.960 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:31.956+0000 7f714ace0640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f714406c400 con 0x7f714406bf90 2023-12-12T09:46:31.960 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:31.956+0000 7f714ace0640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71440c5100 con 0x7f714406a4e0 2023-12-12T09:46:31.960 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:31.957+0000 7f714927d640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f714406a4e0 0x7f714406a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:31.961 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:31.957+0000 7f714927d640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f714406a4e0 0x7f714406a930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.73:44778/0 (socket says 172.21.15.73:44778) 2023-12-12T09:46:31.961 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:31.957+0000 7f714927d640 1 -- 172.21.15.73:0/2408001898 learned_addr learned my addr 172.21.15.73:0/2408001898 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:46:31.961 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:31.957+0000 7f7143fff640 1 --2- 172.21.15.73:0/2408001898 >> v2:172.21.15.142:3300/0 conn(0x7f714406bf90 0x7f71441584f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:31.961 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:31.958+0000 7f714927d640 1 -- 172.21.15.73:0/2408001898 >> v2:172.21.15.142:3300/0 conn(0x7f714406bf90 msgr2=0x7f71441584f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:46:31.961 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:31.958+0000 7f714927d640 1 --2- 172.21.15.73:0/2408001898 >> v2:172.21.15.142:3300/0 conn(0x7f714406bf90 0x7f71441584f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:31.962 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:31.958+0000 7f714927d640 1 -- 172.21.15.73:0/2408001898 >> v1:172.21.15.142:6789/0 conn(0x7f71440a5040 legacy=0x7f71440c3ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:46:31.962 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:31.958+0000 7f714927d640 1 -- 172.21.15.73:0/2408001898 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71440c53e0 con 0x7f714406a4e0 2023-12-12T09:46:31.964 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:31.959+0000 7f714927d640 1 --2- 172.21.15.73:0/2408001898 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f714406a4e0 0x7f714406a930 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f714406b770 tx=0x7f713c02b960 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ab0599804d2d9b9d server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:46:31.964 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:31.959+0000 7f71437fe640 1 -- 172.21.15.73:0/2408001898 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f713c030610 con 0x7f714406a4e0 2023-12-12T09:46:31.964 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:31.960+0000 7f71437fe640 1 -- 172.21.15.73:0/2408001898 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f713c030770 con 0x7f714406a4e0 2023-12-12T09:46:31.965 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:31.960+0000 7f71437fe640 1 -- 172.21.15.73:0/2408001898 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f713c030b00 con 0x7f714406a4e0 2023-12-12T09:46:31.965 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:31.960+0000 7f714ace0640 1 -- 172.21.15.73:0/2408001898 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f714406a4e0 msgr2=0x7f714406a930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:31.965 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:31.960+0000 7f714ace0640 1 --2- 172.21.15.73:0/2408001898 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f714406a4e0 0x7f714406a930 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f714406b770 tx=0x7f713c02b960 comp rx=0 tx=0).stop 2023-12-12T09:46:31.965 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:31.960+0000 7f714ace0640 1 -- 172.21.15.73:0/2408001898 shutdown_connections 2023-12-12T09:46:31.965 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:31.960+0000 7f714ace0640 1 --2- 172.21.15.73:0/2408001898 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f714406a4e0 0x7f714406a930 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:31.965 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:31.960+0000 7f714ace0640 1 --2- 172.21.15.73:0/2408001898 >> v2:172.21.15.142:3300/0 conn(0x7f714406bf90 0x7f71441584f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:31.965 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:31.960+0000 7f714ace0640 1 -- 172.21.15.73:0/2408001898 >> 172.21.15.73:0/2408001898 conn(0x7f71440a8130 msgr2=0x7f71440c24b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:46:31.966 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:31.960+0000 7f714ace0640 1 -- 172.21.15.73:0/2408001898 shutdown_connections 2023-12-12T09:46:31.966 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:31.960+0000 7f714ace0640 1 -- 172.21.15.73:0/2408001898 wait complete. 2023-12-12T09:46:31.966 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:31.962+0000 7f714ace0640 1 Processor -- start 2023-12-12T09:46:31.966 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:31.962+0000 7f714ace0640 1 -- start start 2023-12-12T09:46:31.971 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:31.963+0000 7f714ace0640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f714406a4e0 0x7f7144071840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:31.971 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:31.963+0000 7f714ace0640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f714406bf90 0x7f7144070880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:31.971 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:31.963+0000 7f714ace0640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f71440a5040 0x7f714414a7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:31.971 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:31.963+0000 7f714ace0640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71441eafc0 con 0x7f71440a5040 2023-12-12T09:46:31.971 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:31.963+0000 7f714ace0640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f714406fd70 con 0x7f714406a4e0 2023-12-12T09:46:31.972 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:31.963+0000 7f714ace0640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71441eb260 con 0x7f714406bf90 2023-12-12T09:46:31.972 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:31.964+0000 7f714927d640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f71440a5040 0x7f714414a7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:31.972 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:31.964+0000 7f714927d640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f71440a5040 0x7f714414a7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:55824/0 (socket says 172.21.15.73:55824) 2023-12-12T09:46:31.972 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:31.964+0000 7f714927d640 1 -- 172.21.15.73:0/2191035649 learned_addr learned my addr 172.21.15.73:0/2191035649 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:46:31.972 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:31.964+0000 7f7148a7c640 1 --2- 172.21.15.73:0/2191035649 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f714406a4e0 0x7f7144071840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:31.972 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:31.964+0000 7f7143fff640 1 --2- 172.21.15.73:0/2191035649 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f714406bf90 0x7f7144070880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:31.972 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:31.964+0000 7f714927d640 1 -- 172.21.15.73:0/2191035649 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f714406bf90 msgr2=0x7f7144070880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:31.973 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:31.964+0000 7f714927d640 1 --2- 172.21.15.73:0/2191035649 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f714406bf90 0x7f7144070880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:31.973 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:31.964+0000 7f714927d640 1 -- 172.21.15.73:0/2191035649 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f714406a4e0 msgr2=0x7f7144071840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:31.973 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:31.964+0000 7f714927d640 1 --2- 172.21.15.73:0/2191035649 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f714406a4e0 0x7f7144071840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:31.973 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:31.964+0000 7f714927d640 1 -- 172.21.15.73:0/2191035649 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f713c0094d0 con 0x7f71440a5040 2023-12-12T09:46:31.973 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:31.964+0000 7f714927d640 1 --2- 172.21.15.73:0/2191035649 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f71440a5040 0x7f714414a7c0 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7f713c0090b0 tx=0x7f713c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:46:31.973 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:31.965+0000 7f71417fa640 1 -- 172.21.15.73:0/2191035649 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f713c039960 con 0x7f71440a5040 2023-12-12T09:46:31.974 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:31.965+0000 7f71417fa640 1 -- 172.21.15.73:0/2191035649 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f713c039ac0 con 0x7f71440a5040 2023-12-12T09:46:31.974 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:31.965+0000 7f71417fa640 1 -- 172.21.15.73:0/2191035649 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f713c039e70 con 0x7f71440a5040 2023-12-12T09:46:31.974 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:31.965+0000 7f714ace0640 1 -- 172.21.15.73:0/2191035649 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f714414f460 con 0x7f71440a5040 2023-12-12T09:46:31.974 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:31.965+0000 7f714ace0640 1 -- 172.21.15.73:0/2191035649 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f714414fa20 con 0x7f71440a5040 2023-12-12T09:46:31.974 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:31.966+0000 7f714ace0640 1 -- 172.21.15.73:0/2191035649 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7144067580 con 0x7f71440a5040 2023-12-12T09:46:31.974 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:31.967+0000 7f71417fa640 1 -- 172.21.15.73:0/2191035649 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f713c04d460 con 0x7f71440a5040 2023-12-12T09:46:31.975 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:31.968+0000 7f71417fa640 1 --2- 172.21.15.73:0/2191035649 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f713006ae40 0x7f713006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:31.975 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:31.968+0000 7f71417fa640 1 -- 172.21.15.73:0/2191035649 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f713c03e070 con 0x7f71440a5040 2023-12-12T09:46:31.975 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:31.968+0000 7f7148a7c640 1 --2- 172.21.15.73:0/2191035649 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f713006ae40 0x7f713006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:31.975 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:31.969+0000 7f7148a7c640 1 --2- 172.21.15.73:0/2191035649 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f713006ae40 0x7f713006d300 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f7134009f20 tx=0x7f71340094d0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:46:31.976 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:31.972+0000 7f71417fa640 1 -- 172.21.15.73:0/2191035649 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f713c077590 con 0x7f71440a5040 2023-12-12T09:46:32.159 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:32.157+0000 7f714ace0640 1 -- 172.21.15.73:0/2191035649 --> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f7144067b10 con 0x7f713006ae40 2023-12-12T09:46:32.173 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:32.171+0000 7f71417fa640 1 -- 172.21.15.73:0/2191035649 <== mgr.4110 v2:172.21.15.73:6832/779985841 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+287204 (secure 0 0 0) 0x7f7144067b10 con 0x7f713006ae40 2023-12-12T09:46:32.179 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-12T09:46:32.181 INFO:teuthology.orchestra.run.smithi073.stderr:dumped all 2023-12-12T09:46:32.184 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:32.177+0000 7f714ace0640 1 -- 172.21.15.73:0/2191035649 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f713006ae40 msgr2=0x7f713006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:32.185 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:32.177+0000 7f714ace0640 1 --2- 172.21.15.73:0/2191035649 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f713006ae40 0x7f713006d300 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f7134009f20 tx=0x7f71340094d0 comp rx=0 tx=0).stop 2023-12-12T09:46:32.185 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:32.177+0000 7f714ace0640 1 -- 172.21.15.73:0/2191035649 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f71440a5040 msgr2=0x7f714414a7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:32.185 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:32.177+0000 7f714ace0640 1 --2- 172.21.15.73:0/2191035649 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f71440a5040 0x7f714414a7c0 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7f713c0090b0 tx=0x7f713c004730 comp rx=0 tx=0).stop 2023-12-12T09:46:32.185 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:32.177+0000 7f714ace0640 1 -- 172.21.15.73:0/2191035649 shutdown_connections 2023-12-12T09:46:32.185 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:32.177+0000 7f714ace0640 1 --2- 172.21.15.73:0/2191035649 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f713006ae40 0x7f713006d300 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:32.185 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:32.177+0000 7f714ace0640 1 --2- 172.21.15.73:0/2191035649 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f71440a5040 0x7f714414a7c0 unknown :-1 s=CLOSED pgs=883 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:32.186 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:32.177+0000 7f714ace0640 1 --2- 172.21.15.73:0/2191035649 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f714406bf90 0x7f7144070880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:32.186 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:32.177+0000 7f714ace0640 1 --2- 172.21.15.73:0/2191035649 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f714406a4e0 0x7f7144071840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:32.186 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:32.177+0000 7f714ace0640 1 -- 172.21.15.73:0/2191035649 >> 172.21.15.73:0/2191035649 conn(0x7f71440a8130 msgr2=0x7f71440a6d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:46:32.186 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:32.177+0000 7f714ace0640 1 -- 172.21.15.73:0/2191035649 shutdown_connections 2023-12-12T09:46:32.186 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:32.177+0000 7f714ace0640 1 -- 172.21.15.73:0/2191035649 wait complete. 2023-12-12T09:46:32.199 INFO:teuthology.orchestra.run.smithi073.stdout:{"pg_ready":true,"pg_map":{"version":167,"stamp":"2023-12-12T09:46:31.519217+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":177,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":252676,"kb_used_data":7380,"kb_used_omap":12,"kb_used_meta":245171,"kb_avail":754722044,"statfs":{"total":773094113280,"available":772835373056,"internally_reserved":0,"allocated":7557120,"data_stored":4426144,"data_compressed":64844,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":12752,"internal_metadata":251055664},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":44,"apply_latency_ms":44,"commit_latency_ns":44000000,"apply_latency_ns":44000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001688"},"pg_stats":[{"pgid":"13.3f","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-12-12T09:46:28.819619+0000","last_change":"2023-12-12T09:46:26.986790+0000","last_active":"2023-12-12T09:46:28.819619+0000","last_peered":"2023-12-12T09:46:28.819619+0000","last_clean":"2023-12-12T09:46:28.819619+0000","last_became_active":"2023-12-12T09:46:26.986521+0000","last_became_peered":"2023-12-12T09:46:26.986521+0000","last_unstale":"2023-12-12T09:46:28.819619+0000","last_undegraded":"2023-12-12T09:46:28.819619+0000","last_fullsized":"2023-12-12T09:46:28.819619+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_clean_scrub_stamp":"2023-12-12T09:46:25.941843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T20:26:07.352366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.3e","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-12-12T09:46:28.951015+0000","last_change":"2023-12-12T09:46:26.994586+0000","last_active":"2023-12-12T09:46:28.951015+0000","last_peered":"2023-12-12T09:46:28.951015+0000","last_clean":"2023-12-12T09:46:28.951015+0000","last_became_active":"2023-12-12T09:46:26.992156+0000","last_became_peered":"2023-12-12T09:46:26.992156+0000","last_unstale":"2023-12-12T09:46:28.951015+0000","last_undegraded":"2023-12-12T09:46:28.951015+0000","last_fullsized":"2023-12-12T09:46:28.951015+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_clean_scrub_stamp":"2023-12-12T09:46:25.941843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T12:32:03.730411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.3d","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-12-12T09:46:27.987092+0000","last_change":"2023-12-12T09:46:26.991707+0000","last_active":"2023-12-12T09:46:27.987092+0000","last_peered":"2023-12-12T09:46:27.987092+0000","last_clean":"2023-12-12T09:46:27.987092+0000","last_became_active":"2023-12-12T09:46:26.991218+0000","last_became_peered":"2023-12-12T09:46:26.991218+0000","last_unstale":"2023-12-12T09:46:27.987092+0000","last_undegraded":"2023-12-12T09:46:27.987092+0000","last_fullsized":"2023-12-12T09:46:27.987092+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_clean_scrub_stamp":"2023-12-12T09:46:25.941843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T18:32:42.868149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.3c","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-12-12T09:46:28.952675+0000","last_change":"2023-12-12T09:46:26.999270+0000","last_active":"2023-12-12T09:46:28.952675+0000","last_peered":"2023-12-12T09:46:28.952675+0000","last_clean":"2023-12-12T09:46:28.952675+0000","last_became_active":"2023-12-12T09:46:26.998982+0000","last_became_peered":"2023-12-12T09:46:26.998982+0000","last_unstale":"2023-12-12T09:46:28.952675+0000","last_undegraded":"2023-12-12T09:46:28.952675+0000","last_fullsized":"2023-12-12T09:46:28.952675+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_clean_scrub_stamp":"2023-12-12T09:46:25.941843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T19:41:17.087778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3b","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-12-12T09:46:28.184622+0000","last_change":"2023-12-12T09:46:26.990528+0000","last_active":"2023-12-12T09:46:28.184622+0000","last_peered":"2023-12-12T09:46:28.184622+0000","last_clean":"2023-12-12T09:46:28.184622+0000","last_became_active":"2023-12-12T09:46:26.990258+0000","last_became_peered":"2023-12-12T09:46:26.990258+0000","last_unstale":"2023-12-12T09:46:28.184622+0000","last_undegraded":"2023-12-12T09:46:28.184622+0000","last_fullsized":"2023-12-12T09:46:28.184622+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_clean_scrub_stamp":"2023-12-12T09:46:25.941843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T17:36:25.591354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.3a","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-12-12T09:46:27.986095+0000","last_change":"2023-12-12T09:46:26.981697+0000","last_active":"2023-12-12T09:46:27.986095+0000","last_peered":"2023-12-12T09:46:27.986095+0000","last_clean":"2023-12-12T09:46:27.986095+0000","last_became_active":"2023-12-12T09:46:26.981332+0000","last_became_peered":"2023-12-12T09:46:26.981332+0000","last_unstale":"2023-12-12T09:46:27.986095+0000","last_undegraded":"2023-12-12T09:46:27.986095+0000","last_fullsized":"2023-12-12T09:46:27.986095+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_clean_scrub_stamp":"2023-12-12T09:46:25.941843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T12:20:23.121255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.39","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-12-12T09:46:28.951436+0000","last_change":"2023-12-12T09:46:26.979578+0000","last_active":"2023-12-12T09:46:28.951436+0000","last_peered":"2023-12-12T09:46:28.951436+0000","last_clean":"2023-12-12T09:46:28.951436+0000","last_became_active":"2023-12-12T09:46:26.978875+0000","last_became_peered":"2023-12-12T09:46:26.978875+0000","last_unstale":"2023-12-12T09:46:28.951436+0000","last_undegraded":"2023-12-12T09:46:28.951436+0000","last_fullsized":"2023-12-12T09:46:28.951436+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_clean_scrub_stamp":"2023-12-12T09:46:25.941843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T21:36:15.290518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.38","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-12-12T09:46:27.986223+0000","last_change":"2023-12-12T09:46:26.984339+0000","last_active":"2023-12-12T09:46:27.986223+0000","last_peered":"2023-12-12T09:46:27.986223+0000","last_clean":"2023-12-12T09:46:27.986223+0000","last_became_active":"2023-12-12T09:46:26.984045+0000","last_became_peered":"2023-12-12T09:46:26.984045+0000","last_unstale":"2023-12-12T09:46:27.986223+0000","last_undegraded":"2023-12-12T09:46:27.986223+0000","last_fullsized":"2023-12-12T09:46:27.986223+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_clean_scrub_stamp":"2023-12-12T09:46:25.941843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T12:26:40.737272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.37","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-12-12T09:46:27.987506+0000","last_change":"2023-12-12T09:46:26.974651+0000","last_active":"2023-12-12T09:46:27.987506+0000","last_peered":"2023-12-12T09:46:27.987506+0000","last_clean":"2023-12-12T09:46:27.987506+0000","last_became_active":"2023-12-12T09:46:26.968979+0000","last_became_peered":"2023-12-12T09:46:26.968979+0000","last_unstale":"2023-12-12T09:46:27.987506+0000","last_undegraded":"2023-12-12T09:46:27.987506+0000","last_fullsized":"2023-12-12T09:46:27.987506+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_clean_scrub_stamp":"2023-12-12T09:46:25.941843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T20:02:31.855316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.36","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-12-12T09:46:28.819780+0000","last_change":"2023-12-12T09:46:26.987761+0000","last_active":"2023-12-12T09:46:28.819780+0000","last_peered":"2023-12-12T09:46:28.819780+0000","last_clean":"2023-12-12T09:46:28.819780+0000","last_became_active":"2023-12-12T09:46:26.987451+0000","last_became_peered":"2023-12-12T09:46:26.987451+0000","last_unstale":"2023-12-12T09:46:28.819780+0000","last_undegraded":"2023-12-12T09:46:28.819780+0000","last_fullsized":"2023-12-12T09:46:28.819780+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_clean_scrub_stamp":"2023-12-12T09:46:25.941843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T20:38:58.730158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.35","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-12-12T09:46:28.950230+0000","last_change":"2023-12-12T09:46:26.988570+0000","last_active":"2023-12-12T09:46:28.950230+0000","last_peered":"2023-12-12T09:46:28.950230+0000","last_clean":"2023-12-12T09:46:28.950230+0000","last_became_active":"2023-12-12T09:46:26.987191+0000","last_became_peered":"2023-12-12T09:46:26.987191+0000","last_unstale":"2023-12-12T09:46:28.950230+0000","last_undegraded":"2023-12-12T09:46:28.950230+0000","last_fullsized":"2023-12-12T09:46:28.950230+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_clean_scrub_stamp":"2023-12-12T09:46:25.941843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T10:13:37.646793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.34","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-12-12T09:46:28.818916+0000","last_change":"2023-12-12T09:46:26.986289+0000","last_active":"2023-12-12T09:46:28.818916+0000","last_peered":"2023-12-12T09:46:28.818916+0000","last_clean":"2023-12-12T09:46:28.818916+0000","last_became_active":"2023-12-12T09:46:26.986031+0000","last_became_peered":"2023-12-12T09:46:26.986031+0000","last_unstale":"2023-12-12T09:46:28.818916+0000","last_undegraded":"2023-12-12T09:46:28.818916+0000","last_fullsized":"2023-12-12T09:46:28.818916+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_clean_scrub_stamp":"2023-12-12T09:46:25.941843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T18:11:05.080156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.33","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-12-12T09:46:27.987395+0000","last_change":"2023-12-12T09:46:26.985914+0000","last_active":"2023-12-12T09:46:27.987395+0000","last_peered":"2023-12-12T09:46:27.987395+0000","last_clean":"2023-12-12T09:46:27.987395+0000","last_became_active":"2023-12-12T09:46:26.985636+0000","last_became_peered":"2023-12-12T09:46:26.985636+0000","last_unstale":"2023-12-12T09:46:27.987395+0000","last_undegraded":"2023-12-12T09:46:27.987395+0000","last_fullsized":"2023-12-12T09:46:27.987395+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_clean_scrub_stamp":"2023-12-12T09:46:25.941843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T15:01:39.944049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.32","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-12-12T09:46:28.951654+0000","last_change":"2023-12-12T09:46:26.998495+0000","last_active":"2023-12-12T09:46:28.951654+0000","last_peered":"2023-12-12T09:46:28.951654+0000","last_clean":"2023-12-12T09:46:28.951654+0000","last_became_active":"2023-12-12T09:46:26.997702+0000","last_became_peered":"2023-12-12T09:46:26.997702+0000","last_unstale":"2023-12-12T09:46:28.951654+0000","last_undegraded":"2023-12-12T09:46:28.951654+0000","last_fullsized":"2023-12-12T09:46:28.951654+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_clean_scrub_stamp":"2023-12-12T09:46:25.941843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T21:12:40.750775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.31","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-12-12T09:46:27.980965+0000","last_change":"2023-12-12T09:46:26.987237+0000","last_active":"2023-12-12T09:46:27.980965+0000","last_peered":"2023-12-12T09:46:27.980965+0000","last_clean":"2023-12-12T09:46:27.980965+0000","last_became_active":"2023-12-12T09:46:26.985751+0000","last_became_peered":"2023-12-12T09:46:26.985751+0000","last_unstale":"2023-12-12T09:46:27.980965+0000","last_undegraded":"2023-12-12T09:46:27.980965+0000","last_fullsized":"2023-12-12T09:46:27.980965+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_clean_scrub_stamp":"2023-12-12T09:46:25.941843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T11:42:15.823462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.30","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-12-12T09:46:28.184207+0000","last_change":"2023-12-12T09:46:26.984939+0000","last_active":"2023-12-12T09:46:28.184207+0000","last_peered":"2023-12-12T09:46:28.184207+0000","last_clean":"2023-12-12T09:46:28.184207+0000","last_became_active":"2023-12-12T09:46:26.984654+0000","last_became_peered":"2023-12-12T09:46:26.984654+0000","last_unstale":"2023-12-12T09:46:28.184207+0000","last_undegraded":"2023-12-12T09:46:28.184207+0000","last_fullsized":"2023-12-12T09:46:28.184207+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_clean_scrub_stamp":"2023-12-12T09:46:25.941843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T20:27:55.483605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2f","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-12-12T09:46:28.185212+0000","last_change":"2023-12-12T09:46:26.986814+0000","last_active":"2023-12-12T09:46:28.185212+0000","last_peered":"2023-12-12T09:46:28.185212+0000","last_clean":"2023-12-12T09:46:28.185212+0000","last_became_active":"2023-12-12T09:46:26.985778+0000","last_became_peered":"2023-12-12T09:46:26.985778+0000","last_unstale":"2023-12-12T09:46:28.185212+0000","last_undegraded":"2023-12-12T09:46:28.185212+0000","last_fullsized":"2023-12-12T09:46:28.185212+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_clean_scrub_stamp":"2023-12-12T09:46:25.941843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T18:32:42.868149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2e","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-12-12T09:46:28.952492+0000","last_change":"2023-12-12T09:46:26.990577+0000","last_active":"2023-12-12T09:46:28.952492+0000","last_peered":"2023-12-12T09:46:28.952492+0000","last_clean":"2023-12-12T09:46:28.952492+0000","last_became_active":"2023-12-12T09:46:26.990043+0000","last_became_peered":"2023-12-12T09:46:26.990043+0000","last_unstale":"2023-12-12T09:46:28.952492+0000","last_undegraded":"2023-12-12T09:46:28.952492+0000","last_fullsized":"2023-12-12T09:46:28.952492+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_clean_scrub_stamp":"2023-12-12T09:46:25.941843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T15:36:13.603009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2d","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-12-12T09:46:28.152305+0000","last_change":"2023-12-12T09:46:26.981798+0000","last_active":"2023-12-12T09:46:28.152305+0000","last_peered":"2023-12-12T09:46:28.152305+0000","last_clean":"2023-12-12T09:46:28.152305+0000","last_became_active":"2023-12-12T09:46:26.981531+0000","last_became_peered":"2023-12-12T09:46:26.981531+0000","last_unstale":"2023-12-12T09:46:28.152305+0000","last_undegraded":"2023-12-12T09:46:28.152305+0000","last_fullsized":"2023-12-12T09:46:28.152305+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_clean_scrub_stamp":"2023-12-12T09:46:25.941843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T16:03:22.088223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.2c","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-12-12T09:46:28.952674+0000","last_change":"2023-12-12T09:46:26.992419+0000","last_active":"2023-12-12T09:46:28.952674+0000","last_peered":"2023-12-12T09:46:28.952674+0000","last_clean":"2023-12-12T09:46:28.952674+0000","last_became_active":"2023-12-12T09:46:26.992204+0000","last_became_peered":"2023-12-12T09:46:26.992204+0000","last_unstale":"2023-12-12T09:46:28.952674+0000","last_undegraded":"2023-12-12T09:46:28.952674+0000","last_fullsized":"2023-12-12T09:46:28.952674+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_clean_scrub_stamp":"2023-12-12T09:46:25.941843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T20:27:08.735156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2b","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-12-12T09:46:28.952291+0000","last_change":"2023-12-12T09:46:26.994981+0000","last_active":"2023-12-12T09:46:28.952291+0000","last_peered":"2023-12-12T09:46:28.952291+0000","last_clean":"2023-12-12T09:46:28.952291+0000","last_became_active":"2023-12-12T09:46:26.993637+0000","last_became_peered":"2023-12-12T09:46:26.993637+0000","last_unstale":"2023-12-12T09:46:28.952291+0000","last_undegraded":"2023-12-12T09:46:28.952291+0000","last_fullsized":"2023-12-12T09:46:28.952291+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_clean_scrub_stamp":"2023-12-12T09:46:25.941843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T17:22:17.059887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2a","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-12-12T09:46:28.950589+0000","last_change":"2023-12-12T09:46:27.001420+0000","last_active":"2023-12-12T09:46:28.950589+0000","last_peered":"2023-12-12T09:46:28.950589+0000","last_clean":"2023-12-12T09:46:28.950589+0000","last_became_active":"2023-12-12T09:46:27.001157+0000","last_became_peered":"2023-12-12T09:46:27.001157+0000","last_unstale":"2023-12-12T09:46:28.950589+0000","last_undegraded":"2023-12-12T09:46:28.950589+0000","last_fullsized":"2023-12-12T09:46:28.950589+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_clean_scrub_stamp":"2023-12-12T09:46:25.941843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T18:47:51.982188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.29","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-12-12T09:46:28.818890+0000","last_change":"2023-12-12T09:46:26.998244+0000","last_active":"2023-12-12T09:46:28.818890+0000","last_peered":"2023-12-12T09:46:28.818890+0000","last_clean":"2023-12-12T09:46:28.818890+0000","last_became_active":"2023-12-12T09:46:26.997924+0000","last_became_peered":"2023-12-12T09:46:26.997924+0000","last_unstale":"2023-12-12T09:46:28.818890+0000","last_undegraded":"2023-12-12T09:46:28.818890+0000","last_fullsized":"2023-12-12T09:46:28.818890+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_clean_scrub_stamp":"2023-12-12T09:46:25.941843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T18:32:42.868149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.28","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-12-12T09:46:28.950361+0000","last_change":"2023-12-12T09:46:26.995855+0000","last_active":"2023-12-12T09:46:28.950361+0000","last_peered":"2023-12-12T09:46:28.950361+0000","last_clean":"2023-12-12T09:46:28.950361+0000","last_became_active":"2023-12-12T09:46:26.995600+0000","last_became_peered":"2023-12-12T09:46:26.995600+0000","last_unstale":"2023-12-12T09:46:28.950361+0000","last_undegraded":"2023-12-12T09:46:28.950361+0000","last_fullsized":"2023-12-12T09:46:28.950361+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_clean_scrub_stamp":"2023-12-12T09:46:25.941843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T21:34:45.332708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.27","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-12-12T09:46:28.950637+0000","last_change":"2023-12-12T09:46:26.991438+0000","last_active":"2023-12-12T09:46:28.950637+0000","last_peered":"2023-12-12T09:46:28.950637+0000","last_clean":"2023-12-12T09:46:28.950637+0000","last_became_active":"2023-12-12T09:46:26.991186+0000","last_became_peered":"2023-12-12T09:46:26.991186+0000","last_unstale":"2023-12-12T09:46:28.950637+0000","last_undegraded":"2023-12-12T09:46:28.950637+0000","last_fullsized":"2023-12-12T09:46:28.950637+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_clean_scrub_stamp":"2023-12-12T09:46:25.941843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T10:00:12.368441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.26","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-12-12T09:46:27.987098+0000","last_change":"2023-12-12T09:46:26.993487+0000","last_active":"2023-12-12T09:46:27.987098+0000","last_peered":"2023-12-12T09:46:27.987098+0000","last_clean":"2023-12-12T09:46:27.987098+0000","last_became_active":"2023-12-12T09:46:26.991132+0000","last_became_peered":"2023-12-12T09:46:26.991132+0000","last_unstale":"2023-12-12T09:46:27.987098+0000","last_undegraded":"2023-12-12T09:46:27.987098+0000","last_fullsized":"2023-12-12T09:46:27.987098+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_clean_scrub_stamp":"2023-12-12T09:46:25.941843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T18:11:05.080156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.25","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-12-12T09:46:28.185327+0000","last_change":"2023-12-12T09:46:26.980520+0000","last_active":"2023-12-12T09:46:28.185327+0000","last_peered":"2023-12-12T09:46:28.185327+0000","last_clean":"2023-12-12T09:46:28.185327+0000","last_became_active":"2023-12-12T09:46:26.980218+0000","last_became_peered":"2023-12-12T09:46:26.980218+0000","last_unstale":"2023-12-12T09:46:28.185327+0000","last_undegraded":"2023-12-12T09:46:28.185327+0000","last_fullsized":"2023-12-12T09:46:28.185327+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_clean_scrub_stamp":"2023-12-12T09:46:25.941843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T18:11:05.080156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.24","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-12-12T09:46:28.819183+0000","last_change":"2023-12-12T09:46:26.982794+0000","last_active":"2023-12-12T09:46:28.819183+0000","last_peered":"2023-12-12T09:46:28.819183+0000","last_clean":"2023-12-12T09:46:28.819183+0000","last_became_active":"2023-12-12T09:46:26.981602+0000","last_became_peered":"2023-12-12T09:46:26.981602+0000","last_unstale":"2023-12-12T09:46:28.819183+0000","last_undegraded":"2023-12-12T09:46:28.819183+0000","last_fullsized":"2023-12-12T09:46:28.819183+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_clean_scrub_stamp":"2023-12-12T09:46:25.941843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T10:55:01.026545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.23","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-12-12T09:46:28.950224+0000","last_change":"2023-12-12T09:46:26.986416+0000","last_active":"2023-12-12T09:46:28.950224+0000","last_peered":"2023-12-12T09:46:28.950224+0000","last_clean":"2023-12-12T09:46:28.950224+0000","last_became_active":"2023-12-12T09:46:26.986101+0000","last_became_peered":"2023-12-12T09:46:26.986101+0000","last_unstale":"2023-12-12T09:46:28.950224+0000","last_undegraded":"2023-12-12T09:46:28.950224+0000","last_fullsized":"2023-12-12T09:46:28.950224+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_clean_scrub_stamp":"2023-12-12T09:46:25.941843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T13:32:14.660495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.22","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-12-12T09:46:28.950650+0000","last_change":"2023-12-12T09:46:26.991481+0000","last_active":"2023-12-12T09:46:28.950650+0000","last_peered":"2023-12-12T09:46:28.950650+0000","last_clean":"2023-12-12T09:46:28.950650+0000","last_became_active":"2023-12-12T09:46:26.990749+0000","last_became_peered":"2023-12-12T09:46:26.990749+0000","last_unstale":"2023-12-12T09:46:28.950650+0000","last_undegraded":"2023-12-12T09:46:28.950650+0000","last_fullsized":"2023-12-12T09:46:28.950650+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_clean_scrub_stamp":"2023-12-12T09:46:25.941843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T12:43:20.320606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.21","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-12-12T09:46:28.184329+0000","last_change":"2023-12-12T09:46:26.989100+0000","last_active":"2023-12-12T09:46:28.184329+0000","last_peered":"2023-12-12T09:46:28.184329+0000","last_clean":"2023-12-12T09:46:28.184329+0000","last_became_active":"2023-12-12T09:46:26.988781+0000","last_became_peered":"2023-12-12T09:46:26.988781+0000","last_unstale":"2023-12-12T09:46:28.184329+0000","last_undegraded":"2023-12-12T09:46:28.184329+0000","last_fullsized":"2023-12-12T09:46:28.184329+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_clean_scrub_stamp":"2023-12-12T09:46:25.941843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T20:02:31.855316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.20","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-12-12T09:46:28.818892+0000","last_change":"2023-12-12T09:46:27.003364+0000","last_active":"2023-12-12T09:46:28.818892+0000","last_peered":"2023-12-12T09:46:28.818892+0000","last_clean":"2023-12-12T09:46:28.818892+0000","last_became_active":"2023-12-12T09:46:27.002978+0000","last_became_peered":"2023-12-12T09:46:27.002978+0000","last_unstale":"2023-12-12T09:46:28.818892+0000","last_undegraded":"2023-12-12T09:46:28.818892+0000","last_fullsized":"2023-12-12T09:46:28.818892+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_clean_scrub_stamp":"2023-12-12T09:46:25.941843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T18:26:29.446839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-12-12T09:46:28.184678+0000","last_change":"2023-12-12T09:46:26.993790+0000","last_active":"2023-12-12T09:46:28.184678+0000","last_peered":"2023-12-12T09:46:28.184678+0000","last_clean":"2023-12-12T09:46:28.184678+0000","last_became_active":"2023-12-12T09:46:26.992397+0000","last_became_peered":"2023-12-12T09:46:26.992397+0000","last_unstale":"2023-12-12T09:46:28.184678+0000","last_undegraded":"2023-12-12T09:46:28.184678+0000","last_fullsized":"2023-12-12T09:46:28.184678+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_clean_scrub_stamp":"2023-12-12T09:46:25.941843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T19:08:38.276897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1f","version":"74'4","reported_seq":16,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-12-12T09:46:28.819844+0000","last_change":"2023-12-12T09:46:25.995978+0000","last_active":"2023-12-12T09:46:28.819844+0000","last_peered":"2023-12-12T09:46:28.819844+0000","last_clean":"2023-12-12T09:46:28.819844+0000","last_became_active":"2023-12-12T09:46:25.995655+0000","last_became_peered":"2023-12-12T09:46:25.995655+0000","last_unstale":"2023-12-12T09:46:28.819844+0000","last_undegraded":"2023-12-12T09:46:28.819844+0000","last_fullsized":"2023-12-12T09:46:28.819844+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:24.925008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:24.925008+0000","last_clean_scrub_stamp":"2023-12-12T09:46:24.925008+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T17:36:24.574519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-12-12T09:46:28.819669+0000","last_change":"2023-12-12T09:46:27.003828+0000","last_active":"2023-12-12T09:46:28.819669+0000","last_peered":"2023-12-12T09:46:28.819669+0000","last_clean":"2023-12-12T09:46:28.819669+0000","last_became_active":"2023-12-12T09:46:27.003445+0000","last_became_peered":"2023-12-12T09:46:27.003445+0000","last_unstale":"2023-12-12T09:46:28.819669+0000","last_undegraded":"2023-12-12T09:46:28.819669+0000","last_fullsized":"2023-12-12T09:46:28.819669+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_clean_scrub_stamp":"2023-12-12T09:46:25.941843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T11:42:15.823462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1e","version":"74'1","reported_seq":13,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-12-12T09:46:28.185108+0000","last_change":"2023-12-12T09:46:25.991554+0000","last_active":"2023-12-12T09:46:28.185108+0000","last_peered":"2023-12-12T09:46:28.185108+0000","last_clean":"2023-12-12T09:46:28.185108+0000","last_became_active":"2023-12-12T09:46:25.991083+0000","last_became_peered":"2023-12-12T09:46:25.991083+0000","last_unstale":"2023-12-12T09:46:28.185108+0000","last_undegraded":"2023-12-12T09:46:28.185108+0000","last_fullsized":"2023-12-12T09:46:28.185108+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:24.925008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:24.925008+0000","last_clean_scrub_stamp":"2023-12-12T09:46:24.925008+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T12:36:50.371782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-12-12T09:46:28.819254+0000","last_change":"2023-12-12T09:46:27.003290+0000","last_active":"2023-12-12T09:46:28.819254+0000","last_peered":"2023-12-12T09:46:28.819254+0000","last_clean":"2023-12-12T09:46:28.819254+0000","last_became_active":"2023-12-12T09:46:27.002983+0000","last_became_peered":"2023-12-12T09:46:27.002983+0000","last_unstale":"2023-12-12T09:46:28.819254+0000","last_undegraded":"2023-12-12T09:46:28.819254+0000","last_fullsized":"2023-12-12T09:46:28.819254+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_clean_scrub_stamp":"2023-12-12T09:46:25.941843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T10:54:08.858049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1d","version":"74'2","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-12-12T09:46:28.152169+0000","last_change":"2023-12-12T09:46:25.986094+0000","last_active":"2023-12-12T09:46:28.152169+0000","last_peered":"2023-12-12T09:46:28.152169+0000","last_clean":"2023-12-12T09:46:28.152169+0000","last_became_active":"2023-12-12T09:46:25.985751+0000","last_became_peered":"2023-12-12T09:46:25.985751+0000","last_unstale":"2023-12-12T09:46:28.152169+0000","last_undegraded":"2023-12-12T09:46:28.152169+0000","last_fullsized":"2023-12-12T09:46:28.152169+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:24.925008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:24.925008+0000","last_clean_scrub_stamp":"2023-12-12T09:46:24.925008+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T18:26:28.430003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-12-12T09:46:27.987426+0000","last_change":"2023-12-12T09:46:26.991745+0000","last_active":"2023-12-12T09:46:27.987426+0000","last_peered":"2023-12-12T09:46:27.987426+0000","last_clean":"2023-12-12T09:46:27.987426+0000","last_became_active":"2023-12-12T09:46:26.991433+0000","last_became_peered":"2023-12-12T09:46:26.991433+0000","last_unstale":"2023-12-12T09:46:27.987426+0000","last_undegraded":"2023-12-12T09:46:27.987426+0000","last_fullsized":"2023-12-12T09:46:27.987426+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_clean_scrub_stamp":"2023-12-12T09:46:25.941843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T10:54:08.858049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1c","version":"74'2","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-12-12T09:46:28.151829+0000","last_change":"2023-12-12T09:46:25.990718+0000","last_active":"2023-12-12T09:46:28.151829+0000","last_peered":"2023-12-12T09:46:28.151829+0000","last_clean":"2023-12-12T09:46:28.151829+0000","last_became_active":"2023-12-12T09:46:25.990422+0000","last_became_peered":"2023-12-12T09:46:25.990422+0000","last_unstale":"2023-12-12T09:46:28.151829+0000","last_undegraded":"2023-12-12T09:46:28.151829+0000","last_fullsized":"2023-12-12T09:46:28.151829+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:24.925008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:24.925008+0000","last_clean_scrub_stamp":"2023-12-12T09:46:24.925008+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T20:27:54.466769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-12-12T09:46:28.950913+0000","last_change":"2023-12-12T09:46:26.991755+0000","last_active":"2023-12-12T09:46:28.950913+0000","last_peered":"2023-12-12T09:46:28.950913+0000","last_clean":"2023-12-12T09:46:28.950913+0000","last_became_active":"2023-12-12T09:46:26.991128+0000","last_became_peered":"2023-12-12T09:46:26.991128+0000","last_unstale":"2023-12-12T09:46:28.950913+0000","last_undegraded":"2023-12-12T09:46:28.950913+0000","last_fullsized":"2023-12-12T09:46:28.950913+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_clean_scrub_stamp":"2023-12-12T09:46:25.941843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T10:21:27.951163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1b","version":"74'1","reported_seq":13,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-12-12T09:46:28.185044+0000","last_change":"2023-12-12T09:46:25.996637+0000","last_active":"2023-12-12T09:46:28.185044+0000","last_peered":"2023-12-12T09:46:28.185044+0000","last_clean":"2023-12-12T09:46:28.185044+0000","last_became_active":"2023-12-12T09:46:25.994964+0000","last_became_peered":"2023-12-12T09:46:25.994964+0000","last_unstale":"2023-12-12T09:46:28.185044+0000","last_undegraded":"2023-12-12T09:46:28.185044+0000","last_fullsized":"2023-12-12T09:46:28.185044+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:24.925008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:24.925008+0000","last_clean_scrub_stamp":"2023-12-12T09:46:24.925008+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T10:00:11.351606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-12-12T09:46:28.184728+0000","last_change":"2023-12-12T09:46:26.992932+0000","last_active":"2023-12-12T09:46:28.184728+0000","last_peered":"2023-12-12T09:46:28.184728+0000","last_clean":"2023-12-12T09:46:28.184728+0000","last_became_active":"2023-12-12T09:46:26.992439+0000","last_became_peered":"2023-12-12T09:46:26.992439+0000","last_unstale":"2023-12-12T09:46:28.184728+0000","last_undegraded":"2023-12-12T09:46:28.184728+0000","last_fullsized":"2023-12-12T09:46:28.184728+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_clean_scrub_stamp":"2023-12-12T09:46:25.941843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T17:57:23.001231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1a","version":"74'1","reported_seq":13,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-12-12T09:46:28.184810+0000","last_change":"2023-12-12T09:46:25.997561+0000","last_active":"2023-12-12T09:46:28.184810+0000","last_peered":"2023-12-12T09:46:28.184810+0000","last_clean":"2023-12-12T09:46:28.184810+0000","last_became_active":"2023-12-12T09:46:25.997251+0000","last_became_peered":"2023-12-12T09:46:25.997251+0000","last_unstale":"2023-12-12T09:46:28.184810+0000","last_undegraded":"2023-12-12T09:46:28.184810+0000","last_fullsized":"2023-12-12T09:46:28.184810+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:24.925008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:24.925008+0000","last_clean_scrub_stamp":"2023-12-12T09:46:24.925008+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T19:17:31.250809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-12-12T09:46:27.987652+0000","last_change":"2023-12-12T09:46:26.992538+0000","last_active":"2023-12-12T09:46:27.987652+0000","last_peered":"2023-12-12T09:46:27.987652+0000","last_clean":"2023-12-12T09:46:27.987652+0000","last_became_active":"2023-12-12T09:46:26.992224+0000","last_became_peered":"2023-12-12T09:46:26.992224+0000","last_unstale":"2023-12-12T09:46:27.987652+0000","last_undegraded":"2023-12-12T09:46:27.987652+0000","last_fullsized":"2023-12-12T09:46:27.987652+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_clean_scrub_stamp":"2023-12-12T09:46:25.941843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T20:26:07.352366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-12-12T09:46:28.151286+0000","last_change":"2023-12-12T09:46:25.986629+0000","last_active":"2023-12-12T09:46:28.151286+0000","last_peered":"2023-12-12T09:46:28.151286+0000","last_clean":"2023-12-12T09:46:28.151286+0000","last_became_active":"2023-12-12T09:46:25.986351+0000","last_became_peered":"2023-12-12T09:46:25.986351+0000","last_unstale":"2023-12-12T09:46:28.151286+0000","last_undegraded":"2023-12-12T09:46:28.151286+0000","last_fullsized":"2023-12-12T09:46:28.151286+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:24.925008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:24.925008+0000","last_clean_scrub_stamp":"2023-12-12T09:46:24.925008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T11:46:36.913352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-12-12T09:46:27.981139+0000","last_change":"2023-12-12T09:46:26.993474+0000","last_active":"2023-12-12T09:46:27.981139+0000","last_peered":"2023-12-12T09:46:27.981139+0000","last_clean":"2023-12-12T09:46:27.981139+0000","last_became_active":"2023-12-12T09:46:26.993192+0000","last_became_peered":"2023-12-12T09:46:26.993192+0000","last_unstale":"2023-12-12T09:46:27.981139+0000","last_undegraded":"2023-12-12T09:46:27.981139+0000","last_fullsized":"2023-12-12T09:46:27.981139+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_clean_scrub_stamp":"2023-12-12T09:46:25.941843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T20:38:58.730158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-12-12T09:46:28.950092+0000","last_change":"2023-12-12T09:46:25.998271+0000","last_active":"2023-12-12T09:46:28.950092+0000","last_peered":"2023-12-12T09:46:28.950092+0000","last_clean":"2023-12-12T09:46:28.950092+0000","last_became_active":"2023-12-12T09:46:25.997900+0000","last_became_peered":"2023-12-12T09:46:25.997900+0000","last_unstale":"2023-12-12T09:46:28.950092+0000","last_undegraded":"2023-12-12T09:46:28.950092+0000","last_fullsized":"2023-12-12T09:46:28.950092+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:24.925008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:24.925008+0000","last_clean_scrub_stamp":"2023-12-12T09:46:24.925008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T14:29:28.702921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-12-12T09:46:27.981836+0000","last_change":"2023-12-12T09:46:26.991874+0000","last_active":"2023-12-12T09:46:27.981836+0000","last_peered":"2023-12-12T09:46:27.981836+0000","last_clean":"2023-12-12T09:46:27.981836+0000","last_became_active":"2023-12-12T09:46:26.991425+0000","last_became_peered":"2023-12-12T09:46:26.991425+0000","last_unstale":"2023-12-12T09:46:27.981836+0000","last_undegraded":"2023-12-12T09:46:27.981836+0000","last_fullsized":"2023-12-12T09:46:27.981836+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_clean_scrub_stamp":"2023-12-12T09:46:25.941843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T14:49:18.138939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-12-12T09:46:28.819995+0000","last_change":"2023-12-12T09:46:25.994140+0000","last_active":"2023-12-12T09:46:28.819995+0000","last_peered":"2023-12-12T09:46:28.819995+0000","last_clean":"2023-12-12T09:46:28.819995+0000","last_became_active":"2023-12-12T09:46:25.993784+0000","last_became_peered":"2023-12-12T09:46:25.993784+0000","last_unstale":"2023-12-12T09:46:28.819995+0000","last_undegraded":"2023-12-12T09:46:28.819995+0000","last_fullsized":"2023-12-12T09:46:28.819995+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:24.925008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:24.925008+0000","last_clean_scrub_stamp":"2023-12-12T09:46:24.925008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T19:08:37.260062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-12-12T09:46:27.987844+0000","last_change":"2023-12-12T09:46:26.981920+0000","last_active":"2023-12-12T09:46:27.987844+0000","last_peered":"2023-12-12T09:46:27.987844+0000","last_clean":"2023-12-12T09:46:27.987844+0000","last_became_active":"2023-12-12T09:46:26.981149+0000","last_became_peered":"2023-12-12T09:46:26.981149+0000","last_unstale":"2023-12-12T09:46:27.987844+0000","last_undegraded":"2023-12-12T09:46:27.987844+0000","last_fullsized":"2023-12-12T09:46:27.987844+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_clean_scrub_stamp":"2023-12-12T09:46:25.941843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T17:36:25.591354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-12-12T09:46:28.819794+0000","last_change":"2023-12-12T09:46:25.994337+0000","last_active":"2023-12-12T09:46:28.819794+0000","last_peered":"2023-12-12T09:46:28.819794+0000","last_clean":"2023-12-12T09:46:28.819794+0000","last_became_active":"2023-12-12T09:46:25.993988+0000","last_became_peered":"2023-12-12T09:46:25.993988+0000","last_unstale":"2023-12-12T09:46:28.819794+0000","last_undegraded":"2023-12-12T09:46:28.819794+0000","last_fullsized":"2023-12-12T09:46:28.819794+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:24.925008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:24.925008+0000","last_clean_scrub_stamp":"2023-12-12T09:46:24.925008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T14:33:58.248291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-12-12T09:46:28.151682+0000","last_change":"2023-12-12T09:46:26.983752+0000","last_active":"2023-12-12T09:46:28.151682+0000","last_peered":"2023-12-12T09:46:28.151682+0000","last_clean":"2023-12-12T09:46:28.151682+0000","last_became_active":"2023-12-12T09:46:26.983381+0000","last_became_peered":"2023-12-12T09:46:26.983381+0000","last_unstale":"2023-12-12T09:46:28.151682+0000","last_undegraded":"2023-12-12T09:46:28.151682+0000","last_fullsized":"2023-12-12T09:46:28.151682+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_clean_scrub_stamp":"2023-12-12T09:46:25.941843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T15:01:39.944049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.15","version":"74'3","reported_seq":15,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-12-12T09:46:28.818999+0000","last_change":"2023-12-12T09:46:25.985458+0000","last_active":"2023-12-12T09:46:28.818999+0000","last_peered":"2023-12-12T09:46:28.818999+0000","last_clean":"2023-12-12T09:46:28.818999+0000","last_became_active":"2023-12-12T09:46:25.985147+0000","last_became_peered":"2023-12-12T09:46:25.985147+0000","last_unstale":"2023-12-12T09:46:28.818999+0000","last_undegraded":"2023-12-12T09:46:28.818999+0000","last_fullsized":"2023-12-12T09:46:28.818999+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:24.925008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:24.925008+0000","last_clean_scrub_stamp":"2023-12-12T09:46:24.925008+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T12:43:19.303770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-12-12T09:46:28.184825+0000","last_change":"2023-12-12T09:46:26.997513+0000","last_active":"2023-12-12T09:46:28.184825+0000","last_peered":"2023-12-12T09:46:28.184825+0000","last_clean":"2023-12-12T09:46:28.184825+0000","last_became_active":"2023-12-12T09:46:26.997102+0000","last_became_peered":"2023-12-12T09:46:26.997102+0000","last_unstale":"2023-12-12T09:46:28.184825+0000","last_undegraded":"2023-12-12T09:46:28.184825+0000","last_fullsized":"2023-12-12T09:46:28.184825+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_clean_scrub_stamp":"2023-12-12T09:46:25.941843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T10:24:08.528546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.14","version":"74'6","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-12-12T09:46:27.987151+0000","last_change":"2023-12-12T09:46:25.982724+0000","last_active":"2023-12-12T09:46:27.987151+0000","last_peered":"2023-12-12T09:46:27.987151+0000","last_clean":"2023-12-12T09:46:27.987151+0000","last_became_active":"2023-12-12T09:46:25.982370+0000","last_became_peered":"2023-12-12T09:46:25.982370+0000","last_unstale":"2023-12-12T09:46:27.987151+0000","last_undegraded":"2023-12-12T09:46:27.987151+0000","last_fullsized":"2023-12-12T09:46:27.987151+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:24.925008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:24.925008+0000","last_clean_scrub_stamp":"2023-12-12T09:46:24.925008+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T12:43:19.303770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-12-12T09:46:28.151867+0000","last_change":"2023-12-12T09:46:26.979828+0000","last_active":"2023-12-12T09:46:28.151867+0000","last_peered":"2023-12-12T09:46:28.151867+0000","last_clean":"2023-12-12T09:46:28.151867+0000","last_became_active":"2023-12-12T09:46:26.979516+0000","last_became_peered":"2023-12-12T09:46:26.979516+0000","last_unstale":"2023-12-12T09:46:28.151867+0000","last_undegraded":"2023-12-12T09:46:28.151867+0000","last_fullsized":"2023-12-12T09:46:28.151867+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_clean_scrub_stamp":"2023-12-12T09:46:25.941843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T10:54:08.858049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.13","version":"74'2","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-12-12T09:46:28.950378+0000","last_change":"2023-12-12T09:46:25.987283+0000","last_active":"2023-12-12T09:46:28.950378+0000","last_peered":"2023-12-12T09:46:28.950378+0000","last_clean":"2023-12-12T09:46:28.950378+0000","last_became_active":"2023-12-12T09:46:25.986974+0000","last_became_peered":"2023-12-12T09:46:25.986974+0000","last_unstale":"2023-12-12T09:46:28.950378+0000","last_undegraded":"2023-12-12T09:46:28.950378+0000","last_fullsized":"2023-12-12T09:46:28.950378+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:24.925008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:24.925008+0000","last_clean_scrub_stamp":"2023-12-12T09:46:24.925008+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T17:33:21.476618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-12-12T09:46:27.987935+0000","last_change":"2023-12-12T09:46:26.991122+0000","last_active":"2023-12-12T09:46:27.987935+0000","last_peered":"2023-12-12T09:46:27.987935+0000","last_clean":"2023-12-12T09:46:27.987935+0000","last_became_active":"2023-12-12T09:46:26.990778+0000","last_became_peered":"2023-12-12T09:46:26.990778+0000","last_unstale":"2023-12-12T09:46:27.987935+0000","last_undegraded":"2023-12-12T09:46:27.987935+0000","last_fullsized":"2023-12-12T09:46:27.987935+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_clean_scrub_stamp":"2023-12-12T09:46:25.941843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T11:42:15.823462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-12-12T09:46:27.981094+0000","last_change":"2023-12-12T09:46:25.982578+0000","last_active":"2023-12-12T09:46:27.981094+0000","last_peered":"2023-12-12T09:46:27.981094+0000","last_clean":"2023-12-12T09:46:27.981094+0000","last_became_active":"2023-12-12T09:46:25.982307+0000","last_became_peered":"2023-12-12T09:46:25.982307+0000","last_unstale":"2023-12-12T09:46:27.981094+0000","last_undegraded":"2023-12-12T09:46:27.981094+0000","last_fullsized":"2023-12-12T09:46:27.981094+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:24.925008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:24.925008+0000","last_clean_scrub_stamp":"2023-12-12T09:46:24.925008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T10:54:07.841214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-12-12T09:46:28.949818+0000","last_change":"2023-12-12T09:46:26.990991+0000","last_active":"2023-12-12T09:46:28.949818+0000","last_peered":"2023-12-12T09:46:28.949818+0000","last_clean":"2023-12-12T09:46:28.949818+0000","last_became_active":"2023-12-12T09:46:26.990702+0000","last_became_peered":"2023-12-12T09:46:26.990702+0000","last_unstale":"2023-12-12T09:46:28.949818+0000","last_undegraded":"2023-12-12T09:46:28.949818+0000","last_fullsized":"2023-12-12T09:46:28.949818+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_clean_scrub_stamp":"2023-12-12T09:46:25.941843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T14:22:02.583778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-12-12T09:46:27.986405+0000","last_change":"2023-12-12T09:46:26.002159+0000","last_active":"2023-12-12T09:46:27.986405+0000","last_peered":"2023-12-12T09:46:27.986405+0000","last_clean":"2023-12-12T09:46:27.986405+0000","last_became_active":"2023-12-12T09:46:26.001847+0000","last_became_peered":"2023-12-12T09:46:26.001847+0000","last_unstale":"2023-12-12T09:46:27.986405+0000","last_undegraded":"2023-12-12T09:46:27.986405+0000","last_fullsized":"2023-12-12T09:46:27.986405+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:24.925008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:24.925008+0000","last_clean_scrub_stamp":"2023-12-12T09:46:24.925008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T10:21:26.934327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-12-12T09:46:28.949578+0000","last_change":"2023-12-12T09:46:26.988682+0000","last_active":"2023-12-12T09:46:28.949578+0000","last_peered":"2023-12-12T09:46:28.949578+0000","last_clean":"2023-12-12T09:46:28.949578+0000","last_became_active":"2023-12-12T09:46:26.988391+0000","last_became_peered":"2023-12-12T09:46:26.988391+0000","last_unstale":"2023-12-12T09:46:28.949578+0000","last_undegraded":"2023-12-12T09:46:28.949578+0000","last_fullsized":"2023-12-12T09:46:28.949578+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_clean_scrub_stamp":"2023-12-12T09:46:25.941843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T10:34:32.907255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.10","version":"74'8","reported_seq":20,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-12-12T09:46:28.151288+0000","last_change":"2023-12-12T09:46:25.990213+0000","last_active":"2023-12-12T09:46:28.151288+0000","last_peered":"2023-12-12T09:46:28.151288+0000","last_clean":"2023-12-12T09:46:28.151288+0000","last_became_active":"2023-12-12T09:46:25.989960+0000","last_became_peered":"2023-12-12T09:46:25.989960+0000","last_unstale":"2023-12-12T09:46:28.151288+0000","last_undegraded":"2023-12-12T09:46:28.151288+0000","last_fullsized":"2023-12-12T09:46:28.151288+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:24.925008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:24.925008+0000","last_clean_scrub_stamp":"2023-12-12T09:46:24.925008+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T12:26:39.720437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-12-12T09:46:27.987425+0000","last_change":"2023-12-12T09:46:26.983398+0000","last_active":"2023-12-12T09:46:27.987425+0000","last_peered":"2023-12-12T09:46:27.987425+0000","last_clean":"2023-12-12T09:46:27.987425+0000","last_became_active":"2023-12-12T09:46:26.983101+0000","last_became_peered":"2023-12-12T09:46:26.983101+0000","last_unstale":"2023-12-12T09:46:27.987425+0000","last_undegraded":"2023-12-12T09:46:27.987425+0000","last_fullsized":"2023-12-12T09:46:27.987425+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_clean_scrub_stamp":"2023-12-12T09:46:25.941843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T10:55:01.026545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.f","version":"74'1","reported_seq":13,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-12-12T09:46:28.820096+0000","last_change":"2023-12-12T09:46:25.988523+0000","last_active":"2023-12-12T09:46:28.820096+0000","last_peered":"2023-12-12T09:46:28.820096+0000","last_clean":"2023-12-12T09:46:28.820096+0000","last_became_active":"2023-12-12T09:46:25.988129+0000","last_became_peered":"2023-12-12T09:46:25.988129+0000","last_unstale":"2023-12-12T09:46:28.820096+0000","last_undegraded":"2023-12-12T09:46:28.820096+0000","last_fullsized":"2023-12-12T09:46:28.820096+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:24.925008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:24.925008+0000","last_clean_scrub_stamp":"2023-12-12T09:46:24.925008+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T17:57:21.984396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-12-12T09:46:28.819857+0000","last_change":"2023-12-12T09:46:26.985248+0000","last_active":"2023-12-12T09:46:28.819857+0000","last_peered":"2023-12-12T09:46:28.819857+0000","last_clean":"2023-12-12T09:46:28.819857+0000","last_became_active":"2023-12-12T09:46:26.984986+0000","last_became_peered":"2023-12-12T09:46:26.984986+0000","last_unstale":"2023-12-12T09:46:28.819857+0000","last_undegraded":"2023-12-12T09:46:28.819857+0000","last_fullsized":"2023-12-12T09:46:28.819857+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_clean_scrub_stamp":"2023-12-12T09:46:25.941843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T14:49:18.138939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.e","version":"74'2","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-12-12T09:46:28.151968+0000","last_change":"2023-12-12T09:46:25.991479+0000","last_active":"2023-12-12T09:46:28.151968+0000","last_peered":"2023-12-12T09:46:28.151968+0000","last_clean":"2023-12-12T09:46:28.151968+0000","last_became_active":"2023-12-12T09:46:25.991205+0000","last_became_peered":"2023-12-12T09:46:25.991205+0000","last_unstale":"2023-12-12T09:46:28.151968+0000","last_undegraded":"2023-12-12T09:46:28.151968+0000","last_fullsized":"2023-12-12T09:46:28.151968+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:24.925008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:24.925008+0000","last_clean_scrub_stamp":"2023-12-12T09:46:24.925008+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T18:32:41.851313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-12-12T09:46:28.185133+0000","last_change":"2023-12-12T09:46:26.987944+0000","last_active":"2023-12-12T09:46:28.185133+0000","last_peered":"2023-12-12T09:46:28.185133+0000","last_clean":"2023-12-12T09:46:28.185133+0000","last_became_active":"2023-12-12T09:46:26.987624+0000","last_became_peered":"2023-12-12T09:46:26.987624+0000","last_unstale":"2023-12-12T09:46:28.185133+0000","last_undegraded":"2023-12-12T09:46:28.185133+0000","last_fullsized":"2023-12-12T09:46:28.185133+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_clean_scrub_stamp":"2023-12-12T09:46:25.941843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T18:26:29.446839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-12-12T09:46:28.151778+0000","last_change":"2023-12-12T09:46:25.987255+0000","last_active":"2023-12-12T09:46:28.151778+0000","last_peered":"2023-12-12T09:46:28.151778+0000","last_clean":"2023-12-12T09:46:28.151778+0000","last_became_active":"2023-12-12T09:46:25.986994+0000","last_became_peered":"2023-12-12T09:46:25.986994+0000","last_unstale":"2023-12-12T09:46:28.151778+0000","last_undegraded":"2023-12-12T09:46:28.151778+0000","last_fullsized":"2023-12-12T09:46:28.151778+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:24.925008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:24.925008+0000","last_clean_scrub_stamp":"2023-12-12T09:46:24.925008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T17:57:21.984396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-12-12T09:46:28.951810+0000","last_change":"2023-12-12T09:46:26.998275+0000","last_active":"2023-12-12T09:46:28.951810+0000","last_peered":"2023-12-12T09:46:28.951810+0000","last_clean":"2023-12-12T09:46:28.951810+0000","last_became_active":"2023-12-12T09:46:26.997250+0000","last_became_peered":"2023-12-12T09:46:26.997250+0000","last_unstale":"2023-12-12T09:46:28.951810+0000","last_undegraded":"2023-12-12T09:46:28.951810+0000","last_fullsized":"2023-12-12T09:46:28.951810+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_clean_scrub_stamp":"2023-12-12T09:46:25.941843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T09:58:10.574493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.b","version":"74'2","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-12-12T09:46:27.981034+0000","last_change":"2023-12-12T09:46:25.981571+0000","last_active":"2023-12-12T09:46:27.981034+0000","last_peered":"2023-12-12T09:46:27.981034+0000","last_clean":"2023-12-12T09:46:27.981034+0000","last_became_active":"2023-12-12T09:46:25.981285+0000","last_became_peered":"2023-12-12T09:46:25.981285+0000","last_unstale":"2023-12-12T09:46:27.981034+0000","last_undegraded":"2023-12-12T09:46:27.981034+0000","last_fullsized":"2023-12-12T09:46:27.981034+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:24.925008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:24.925008+0000","last_clean_scrub_stamp":"2023-12-12T09:46:24.925008+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T16:03:21.071388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-12-12T09:46:27.986214+0000","last_change":"2023-12-12T09:46:26.979623+0000","last_active":"2023-12-12T09:46:27.986214+0000","last_peered":"2023-12-12T09:46:27.986214+0000","last_clean":"2023-12-12T09:46:27.986214+0000","last_became_active":"2023-12-12T09:46:26.979271+0000","last_became_peered":"2023-12-12T09:46:26.979271+0000","last_unstale":"2023-12-12T09:46:27.986214+0000","last_undegraded":"2023-12-12T09:46:27.986214+0000","last_fullsized":"2023-12-12T09:46:27.986214+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_clean_scrub_stamp":"2023-12-12T09:46:25.941843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T20:16:10.850955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-12-12T09:46:28.951780+0000","last_change":"2023-12-12T09:46:25.986608+0000","last_active":"2023-12-12T09:46:28.951780+0000","last_peered":"2023-12-12T09:46:28.951780+0000","last_clean":"2023-12-12T09:46:28.951780+0000","last_became_active":"2023-12-12T09:46:25.986236+0000","last_became_peered":"2023-12-12T09:46:25.986236+0000","last_unstale":"2023-12-12T09:46:28.951780+0000","last_undegraded":"2023-12-12T09:46:28.951780+0000","last_fullsized":"2023-12-12T09:46:28.951780+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:24.925008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:24.925008+0000","last_clean_scrub_stamp":"2023-12-12T09:46:24.925008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T20:29:16.623938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-12-12T09:46:28.950889+0000","last_change":"2023-12-12T09:46:26.987145+0000","last_active":"2023-12-12T09:46:28.950889+0000","last_peered":"2023-12-12T09:46:28.950889+0000","last_clean":"2023-12-12T09:46:28.950889+0000","last_became_active":"2023-12-12T09:46:26.986503+0000","last_became_peered":"2023-12-12T09:46:26.986503+0000","last_unstale":"2023-12-12T09:46:28.950889+0000","last_undegraded":"2023-12-12T09:46:28.950889+0000","last_fullsized":"2023-12-12T09:46:28.950889+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_clean_scrub_stamp":"2023-12-12T09:46:25.941843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T18:36:24.773262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-12-12T09:46:28.951433+0000","last_change":"2023-12-12T09:46:25.988222+0000","last_active":"2023-12-12T09:46:28.951433+0000","last_peered":"2023-12-12T09:46:28.951433+0000","last_clean":"2023-12-12T09:46:28.951433+0000","last_became_active":"2023-12-12T09:46:25.987972+0000","last_became_peered":"2023-12-12T09:46:25.987972+0000","last_unstale":"2023-12-12T09:46:28.951433+0000","last_undegraded":"2023-12-12T09:46:28.951433+0000","last_fullsized":"2023-12-12T09:46:28.951433+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:24.925008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:24.925008+0000","last_clean_scrub_stamp":"2023-12-12T09:46:24.925008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T12:18:16.286957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-12-12T09:46:27.986341+0000","last_change":"2023-12-12T09:46:26.968398+0000","last_active":"2023-12-12T09:46:27.986341+0000","last_peered":"2023-12-12T09:46:27.986341+0000","last_clean":"2023-12-12T09:46:27.986341+0000","last_became_active":"2023-12-12T09:46:26.967774+0000","last_became_peered":"2023-12-12T09:46:26.967774+0000","last_unstale":"2023-12-12T09:46:27.986341+0000","last_undegraded":"2023-12-12T09:46:27.986341+0000","last_fullsized":"2023-12-12T09:46:27.986341+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_clean_scrub_stamp":"2023-12-12T09:46:25.941843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T11:46:37.930187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-12-12T09:46:27.980655+0000","last_change":"2023-12-12T09:46:25.983579+0000","last_active":"2023-12-12T09:46:27.980655+0000","last_peered":"2023-12-12T09:46:27.980655+0000","last_clean":"2023-12-12T09:46:27.980655+0000","last_became_active":"2023-12-12T09:46:25.983172+0000","last_became_peered":"2023-12-12T09:46:25.983172+0000","last_unstale":"2023-12-12T09:46:27.980655+0000","last_undegraded":"2023-12-12T09:46:27.980655+0000","last_fullsized":"2023-12-12T09:46:27.980655+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:24.925008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:24.925008+0000","last_clean_scrub_stamp":"2023-12-12T09:46:24.925008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T10:55:00.009710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-12-12T09:46:28.184802+0000","last_change":"2023-12-12T09:46:26.974656+0000","last_active":"2023-12-12T09:46:28.184802+0000","last_peered":"2023-12-12T09:46:28.184802+0000","last_clean":"2023-12-12T09:46:28.184802+0000","last_became_active":"2023-12-12T09:46:26.974051+0000","last_became_peered":"2023-12-12T09:46:26.974051+0000","last_unstale":"2023-12-12T09:46:28.184802+0000","last_undegraded":"2023-12-12T09:46:28.184802+0000","last_fullsized":"2023-12-12T09:46:28.184802+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_clean_scrub_stamp":"2023-12-12T09:46:25.941843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T14:33:59.265126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.7","version":"74'2","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-12-12T09:46:28.950867+0000","last_change":"2023-12-12T09:46:25.989868+0000","last_active":"2023-12-12T09:46:28.950867+0000","last_peered":"2023-12-12T09:46:28.950867+0000","last_clean":"2023-12-12T09:46:28.950867+0000","last_became_active":"2023-12-12T09:46:25.989577+0000","last_became_peered":"2023-12-12T09:46:25.989577+0000","last_unstale":"2023-12-12T09:46:28.950867+0000","last_undegraded":"2023-12-12T09:46:28.950867+0000","last_fullsized":"2023-12-12T09:46:28.950867+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:24.925008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:24.925008+0000","last_clean_scrub_stamp":"2023-12-12T09:46:24.925008+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T19:17:31.250809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-12-12T09:46:27.987621+0000","last_change":"2023-12-12T09:46:26.994090+0000","last_active":"2023-12-12T09:46:27.987621+0000","last_peered":"2023-12-12T09:46:27.987621+0000","last_clean":"2023-12-12T09:46:27.987621+0000","last_became_active":"2023-12-12T09:46:26.992152+0000","last_became_peered":"2023-12-12T09:46:26.992152+0000","last_unstale":"2023-12-12T09:46:27.987621+0000","last_undegraded":"2023-12-12T09:46:27.987621+0000","last_fullsized":"2023-12-12T09:46:27.987621+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_clean_scrub_stamp":"2023-12-12T09:46:25.941843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T16:03:22.088223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-12-12T09:46:28.951090+0000","last_change":"2023-12-12T09:46:25.986713+0000","last_active":"2023-12-12T09:46:28.951090+0000","last_peered":"2023-12-12T09:46:28.951090+0000","last_clean":"2023-12-12T09:46:28.951090+0000","last_became_active":"2023-12-12T09:46:25.986422+0000","last_became_peered":"2023-12-12T09:46:25.986422+0000","last_unstale":"2023-12-12T09:46:28.951090+0000","last_undegraded":"2023-12-12T09:46:28.951090+0000","last_fullsized":"2023-12-12T09:46:28.951090+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:24.925008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:24.925008+0000","last_clean_scrub_stamp":"2023-12-12T09:46:24.925008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T10:48:07.069161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-12-12T09:46:28.819541+0000","last_change":"2023-12-12T09:46:26.989385+0000","last_active":"2023-12-12T09:46:28.819541+0000","last_peered":"2023-12-12T09:46:28.819541+0000","last_clean":"2023-12-12T09:46:28.819541+0000","last_became_active":"2023-12-12T09:46:26.989099+0000","last_became_peered":"2023-12-12T09:46:26.989099+0000","last_unstale":"2023-12-12T09:46:28.819541+0000","last_undegraded":"2023-12-12T09:46:28.819541+0000","last_fullsized":"2023-12-12T09:46:28.819541+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_clean_scrub_stamp":"2023-12-12T09:46:25.941843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T16:03:22.088223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-12-12T09:46:28.819333+0000","last_change":"2023-12-12T09:46:25.988958+0000","last_active":"2023-12-12T09:46:28.819333+0000","last_peered":"2023-12-12T09:46:28.819333+0000","last_clean":"2023-12-12T09:46:28.819333+0000","last_became_active":"2023-12-12T09:46:25.988383+0000","last_became_peered":"2023-12-12T09:46:25.988383+0000","last_unstale":"2023-12-12T09:46:28.819333+0000","last_undegraded":"2023-12-12T09:46:28.819333+0000","last_fullsized":"2023-12-12T09:46:28.819333+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:24.925008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:24.925008+0000","last_clean_scrub_stamp":"2023-12-12T09:46:24.925008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T12:32:02.713576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-12-12T09:46:28.185352+0000","last_change":"2023-12-12T09:46:26.989882+0000","last_active":"2023-12-12T09:46:28.185352+0000","last_peered":"2023-12-12T09:46:28.185352+0000","last_clean":"2023-12-12T09:46:28.185352+0000","last_became_active":"2023-12-12T09:46:26.989558+0000","last_became_peered":"2023-12-12T09:46:26.989558+0000","last_unstale":"2023-12-12T09:46:28.185352+0000","last_undegraded":"2023-12-12T09:46:28.185352+0000","last_fullsized":"2023-12-12T09:46:28.185352+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_clean_scrub_stamp":"2023-12-12T09:46:25.941843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T15:01:39.944049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-12-12T09:46:28.819476+0000","last_change":"2023-12-12T09:46:25.985790+0000","last_active":"2023-12-12T09:46:28.819476+0000","last_peered":"2023-12-12T09:46:28.819476+0000","last_clean":"2023-12-12T09:46:28.819476+0000","last_became_active":"2023-12-12T09:46:25.985297+0000","last_became_peered":"2023-12-12T09:46:25.985297+0000","last_unstale":"2023-12-12T09:46:28.819476+0000","last_undegraded":"2023-12-12T09:46:28.819476+0000","last_fullsized":"2023-12-12T09:46:28.819476+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:24.925008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:24.925008+0000","last_clean_scrub_stamp":"2023-12-12T09:46:24.925008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T20:16:09.834119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-12-12T09:46:27.986367+0000","last_change":"2023-12-12T09:46:26.978093+0000","last_active":"2023-12-12T09:46:27.986367+0000","last_peered":"2023-12-12T09:46:27.986367+0000","last_clean":"2023-12-12T09:46:27.986367+0000","last_became_active":"2023-12-12T09:46:26.977782+0000","last_became_peered":"2023-12-12T09:46:26.977782+0000","last_unstale":"2023-12-12T09:46:27.986367+0000","last_undegraded":"2023-12-12T09:46:27.986367+0000","last_fullsized":"2023-12-12T09:46:27.986367+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_clean_scrub_stamp":"2023-12-12T09:46:25.941843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T20:27:55.483605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-12-12T09:46:28.151995+0000","last_change":"2023-12-12T09:46:25.989940+0000","last_active":"2023-12-12T09:46:28.151995+0000","last_peered":"2023-12-12T09:46:28.151995+0000","last_clean":"2023-12-12T09:46:28.151995+0000","last_became_active":"2023-12-12T09:46:25.989572+0000","last_became_peered":"2023-12-12T09:46:25.989572+0000","last_unstale":"2023-12-12T09:46:28.151995+0000","last_undegraded":"2023-12-12T09:46:28.151995+0000","last_fullsized":"2023-12-12T09:46:28.151995+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:24.925008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:24.925008+0000","last_clean_scrub_stamp":"2023-12-12T09:46:24.925008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T10:24:07.511710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-12-12T09:46:28.151846+0000","last_change":"2023-12-12T09:46:26.980504+0000","last_active":"2023-12-12T09:46:28.151846+0000","last_peered":"2023-12-12T09:46:28.151846+0000","last_clean":"2023-12-12T09:46:28.151846+0000","last_became_active":"2023-12-12T09:46:26.980219+0000","last_became_peered":"2023-12-12T09:46:26.980219+0000","last_unstale":"2023-12-12T09:46:28.151846+0000","last_undegraded":"2023-12-12T09:46:28.151846+0000","last_fullsized":"2023-12-12T09:46:28.151846+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_clean_scrub_stamp":"2023-12-12T09:46:25.941843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T10:55:01.026545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-12-12T09:46:28.185040+0000","last_change":"2023-12-12T09:46:25.997435+0000","last_active":"2023-12-12T09:46:28.185040+0000","last_peered":"2023-12-12T09:46:28.185040+0000","last_clean":"2023-12-12T09:46:28.185040+0000","last_became_active":"2023-12-12T09:46:25.997139+0000","last_became_peered":"2023-12-12T09:46:25.997139+0000","last_unstale":"2023-12-12T09:46:28.185040+0000","last_undegraded":"2023-12-12T09:46:28.185040+0000","last_fullsized":"2023-12-12T09:46:28.185040+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:24.925008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:24.925008+0000","last_clean_scrub_stamp":"2023-12-12T09:46:24.925008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T10:34:31.890420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-12-12T09:46:27.986035+0000","last_change":"2023-12-12T09:46:26.992722+0000","last_active":"2023-12-12T09:46:27.986035+0000","last_peered":"2023-12-12T09:46:27.986035+0000","last_clean":"2023-12-12T09:46:27.986035+0000","last_became_active":"2023-12-12T09:46:26.990039+0000","last_became_peered":"2023-12-12T09:46:26.990039+0000","last_unstale":"2023-12-12T09:46:27.986035+0000","last_undegraded":"2023-12-12T09:46:27.986035+0000","last_fullsized":"2023-12-12T09:46:27.986035+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_clean_scrub_stamp":"2023-12-12T09:46:25.941843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T18:26:29.446839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-12-12T09:46:28.819131+0000","last_change":"2023-12-12T09:46:25.982419+0000","last_active":"2023-12-12T09:46:28.819131+0000","last_peered":"2023-12-12T09:46:28.819131+0000","last_clean":"2023-12-12T09:46:28.819131+0000","last_became_active":"2023-12-12T09:46:25.981873+0000","last_became_peered":"2023-12-12T09:46:25.981873+0000","last_unstale":"2023-12-12T09:46:28.819131+0000","last_undegraded":"2023-12-12T09:46:28.819131+0000","last_fullsized":"2023-12-12T09:46:28.819131+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:24.925008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:24.925008+0000","last_clean_scrub_stamp":"2023-12-12T09:46:24.925008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T12:20:22.104420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-12-12T09:46:28.819107+0000","last_change":"2023-12-12T09:46:26.995503+0000","last_active":"2023-12-12T09:46:28.819107+0000","last_peered":"2023-12-12T09:46:28.819107+0000","last_clean":"2023-12-12T09:46:28.819107+0000","last_became_active":"2023-12-12T09:46:26.995090+0000","last_became_peered":"2023-12-12T09:46:26.995090+0000","last_unstale":"2023-12-12T09:46:28.819107+0000","last_undegraded":"2023-12-12T09:46:28.819107+0000","last_fullsized":"2023-12-12T09:46:28.819107+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_clean_scrub_stamp":"2023-12-12T09:46:25.941843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T15:01:39.944049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-12-12T09:46:28.184291+0000","last_change":"2023-12-12T09:46:25.997135+0000","last_active":"2023-12-12T09:46:28.184291+0000","last_peered":"2023-12-12T09:46:28.184291+0000","last_clean":"2023-12-12T09:46:28.184291+0000","last_became_active":"2023-12-12T09:46:25.996777+0000","last_became_peered":"2023-12-12T09:46:25.996777+0000","last_unstale":"2023-12-12T09:46:28.184291+0000","last_undegraded":"2023-12-12T09:46:28.184291+0000","last_fullsized":"2023-12-12T09:46:28.184291+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:24.925008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:24.925008+0000","last_clean_scrub_stamp":"2023-12-12T09:46:24.925008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T16:09:35.711601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-12-12T09:46:28.950223+0000","last_change":"2023-12-12T09:46:26.994842+0000","last_active":"2023-12-12T09:46:28.950223+0000","last_peered":"2023-12-12T09:46:28.950223+0000","last_clean":"2023-12-12T09:46:28.950223+0000","last_became_active":"2023-12-12T09:46:26.986721+0000","last_became_peered":"2023-12-12T09:46:26.986721+0000","last_unstale":"2023-12-12T09:46:28.950223+0000","last_undegraded":"2023-12-12T09:46:28.950223+0000","last_fullsized":"2023-12-12T09:46:28.950223+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_clean_scrub_stamp":"2023-12-12T09:46:25.941843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T16:09:36.728436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"74'1","reported_seq":13,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-12-12T09:46:27.987759+0000","last_change":"2023-12-12T09:46:25.996699+0000","last_active":"2023-12-12T09:46:27.987759+0000","last_peered":"2023-12-12T09:46:27.987759+0000","last_clean":"2023-12-12T09:46:27.987759+0000","last_became_active":"2023-12-12T09:46:25.995486+0000","last_became_peered":"2023-12-12T09:46:25.995486+0000","last_unstale":"2023-12-12T09:46:27.987759+0000","last_undegraded":"2023-12-12T09:46:27.987759+0000","last_fullsized":"2023-12-12T09:46:27.987759+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:24.925008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:24.925008+0000","last_clean_scrub_stamp":"2023-12-12T09:46:24.925008+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T10:24:07.511710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":211,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-12-12T09:46:26.972059+0000","last_change":"2023-12-12T09:43:17.203315+0000","last_active":"2023-12-12T09:46:26.972059+0000","last_peered":"2023-12-12T09:46:26.972059+0000","last_clean":"2023-12-12T09:46:26.972059+0000","last_became_active":"2023-12-12T09:43:17.200779+0000","last_became_peered":"2023-12-12T09:43:17.200779+0000","last_unstale":"2023-12-12T09:46:26.972059+0000","last_undegraded":"2023-12-12T09:46:26.972059+0000","last_fullsized":"2023-12-12T09:46:26.972059+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:43:15.931922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:43:15.931922+0000","last_clean_scrub_stamp":"2023-12-12T09:43:15.931922+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T21:42:10.929640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":64844,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574891,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32148,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339692,"statfs":{"total":96636764160,"available":96603844608,"internally_reserved":0,"allocated":991232,"data_stored":996299,"data_compressed":32422,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 12 09:46:16 2023","interfaces":[{"interface":"back","average":{"1min":1.163,"5min":1.046,"15min":1.014},"min":{"1min":0.66300000000000003,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.677,"5min":1.8089999999999999,"15min":1.8089999999999999},"last":1.129},{"interface":"front","average":{"1min":1.143,"5min":1.0309999999999999,"15min":0.98299999999999998},"min":{"1min":0.67700000000000005,"5min":0.66300000000000003,"15min":0.66300000000000003},"max":{"1min":1.71,"5min":1.71,"15min":1.71},"last":1.544}]},{"osd":1,"last update":"Tue Dec 12 09:46:16 2023","interfaces":[{"interface":"back","average":{"1min":1.3089999999999999,"5min":1.21,"15min":1.202},"min":{"1min":0.79300000000000004,"5min":0.72099999999999997,"15min":0.72099999999999997},"max":{"1min":1.897,"5min":1.897,"15min":1.897},"last":1.3200000000000001},{"interface":"front","average":{"1min":1.1279999999999999,"5min":1.1830000000000001,"15min":1.2050000000000001},"min":{"1min":0.76300000000000001,"5min":0.71499999999999997,"15min":0.71499999999999997},"max":{"1min":1.4730000000000001,"5min":3.1150000000000002,"15min":3.1150000000000002},"last":1.585}]},{"osd":2,"last update":"Tue Dec 12 09:46:16 2023","interfaces":[{"interface":"back","average":{"1min":1.252,"5min":1.2350000000000001,"15min":1.2529999999999999},"min":{"1min":0.89500000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"max":{"1min":1.8129999999999999,"5min":2.2050000000000001,"15min":2.2050000000000001},"last":1.0309999999999999},{"interface":"front","average":{"1min":1.139,"5min":1.2030000000000001,"15min":1.2310000000000001},"min":{"1min":0.72999999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":2.0329999999999999,"5min":3.2759999999999998,"15min":3.2759999999999998},"last":1.4810000000000001}]},{"osd":3,"last update":"Tue Dec 12 09:46:16 2023","interfaces":[{"interface":"back","average":{"1min":1.095,"5min":1.2470000000000001,"15min":1.2929999999999999},"min":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"max":{"1min":1.5900000000000001,"5min":3.1819999999999999,"15min":3.1819999999999999},"last":1.2170000000000001},{"interface":"front","average":{"1min":1.367,"5min":1.294,"15min":1.294},"min":{"1min":0.88200000000000001,"5min":0.72799999999999998,"15min":0.72799999999999998},"max":{"1min":1.845,"5min":1.8740000000000001,"15min":1.8740000000000001},"last":1.641}]},{"osd":4,"last update":"Tue Dec 12 09:46:16 2023","interfaces":[{"interface":"back","average":{"1min":1.274,"5min":1.3149999999999999,"15min":1.339},"min":{"1min":0.68799999999999994,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.974,"5min":2.5529999999999999,"15min":2.5529999999999999},"last":1.4139999999999999},{"interface":"front","average":{"1min":1.383,"5min":1.395,"15min":1.4350000000000001},"min":{"1min":0.94399999999999995,"5min":0.66000000000000003,"15min":0.66000000000000003},"max":{"1min":2.3759999999999999,"5min":2.3759999999999999,"15min":2.3759999999999999},"last":1.369}]},{"osd":5,"last update":"Tue Dec 12 09:46:16 2023","interfaces":[{"interface":"back","average":{"1min":1.4379999999999999,"5min":1.347,"15min":1.339},"min":{"1min":0.622,"5min":0.622,"15min":0.622},"max":{"1min":1.9890000000000001,"5min":1.9890000000000001,"15min":1.9890000000000001},"last":1.1699999999999999},{"interface":"front","average":{"1min":1.498,"5min":1.4990000000000001,"15min":1.524},"min":{"1min":1.0529999999999999,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":2.0259999999999998,"5min":2.4159999999999999,"15min":2.4159999999999999},"last":1.2609999999999999}]},{"osd":6,"last update":"Tue Dec 12 09:46:16 2023","interfaces":[{"interface":"back","average":{"1min":1.4019999999999999,"5min":1.4159999999999999,"15min":1.4159999999999999},"min":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"max":{"1min":1.9970000000000001,"5min":2.0510000000000002,"15min":2.0510000000000002},"last":1.456},{"interface":"front","average":{"1min":1.5649999999999999,"5min":1.591,"15min":1.6200000000000001},"min":{"1min":1.1970000000000001,"5min":0.71899999999999997,"15min":0.71899999999999997},"max":{"1min":2.0899999999999999,"5min":2.5800000000000001,"15min":2.5800000000000001},"last":1.4990000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574889,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32088,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339752,"statfs":{"total":96636764160,"available":96603906048,"internally_reserved":0,"allocated":921600,"data_stored":400255,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 12 09:46:17 2023","interfaces":[{"interface":"back","average":{"1min":0.995,"5min":1.1080000000000001,"15min":1.1639999999999999},"min":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.4390000000000001,"5min":3.6429999999999998,"15min":3.6429999999999998},"last":1.153},{"interface":"front","average":{"1min":0.99299999999999999,"5min":1.0640000000000001,"15min":1.0680000000000001},"min":{"1min":0.60099999999999998,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.546,"5min":2.6059999999999999,"15min":2.6059999999999999},"last":1.7729999999999999}]},{"osd":1,"last update":"Tue Dec 12 09:46:17 2023","interfaces":[{"interface":"back","average":{"1min":1.0589999999999999,"5min":1.081,"15min":1.0680000000000001},"min":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"max":{"1min":1.5069999999999999,"5min":2.0169999999999999,"15min":2.0169999999999999},"last":1.3839999999999999},{"interface":"front","average":{"1min":1.1359999999999999,"5min":1.1819999999999999,"15min":1.194},"min":{"1min":0.82399999999999995,"5min":0.72899999999999998,"15min":0.72899999999999998},"max":{"1min":1.4810000000000001,"5min":1.7,"15min":1.7},"last":1.71}]},{"osd":2,"last update":"Tue Dec 12 09:46:17 2023","interfaces":[{"interface":"back","average":{"1min":1.218,"5min":1.2150000000000001,"15min":1.2290000000000001},"min":{"1min":0.87,"5min":0.71199999999999997,"15min":0.71199999999999997},"max":{"1min":1.5309999999999999,"5min":1.804,"15min":1.804},"last":1.3380000000000001},{"interface":"front","average":{"1min":1.2050000000000001,"5min":1.258,"15min":1.294},"min":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":1.6799999999999999,"5min":2.2160000000000002,"15min":2.2160000000000002},"last":1.679}]},{"osd":3,"last update":"Tue Dec 12 09:46:17 2023","interfaces":[{"interface":"back","average":{"1min":1.196,"5min":1.2110000000000001,"15min":1.2150000000000001},"min":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"max":{"1min":1.4339999999999999,"5min":2.665,"15min":2.665},"last":1.278},{"interface":"front","average":{"1min":1.149,"5min":1.1899999999999999,"15min":1.2170000000000001},"min":{"1min":0.75700000000000001,"5min":0.65700000000000003,"15min":0.65700000000000003},"max":{"1min":1.5760000000000001,"5min":1.8620000000000001,"15min":1.8620000000000001},"last":1.4630000000000001}]},{"osd":4,"last update":"Tue Dec 12 09:46:17 2023","interfaces":[{"interface":"back","average":{"1min":1.3220000000000001,"5min":1.284,"15min":1.278},"min":{"1min":0.98199999999999998,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":1.631,"5min":2.0310000000000001,"15min":2.0310000000000001},"last":1.518},{"interface":"front","average":{"1min":1.4279999999999999,"5min":1.4079999999999999,"15min":1.407},"min":{"1min":0.95199999999999996,"5min":0.66200000000000003,"15min":0.66200000000000003},"max":{"1min":1.657,"5min":2.2799999999999998,"15min":2.2799999999999998},"last":1.853}]},{"osd":5,"last update":"Tue Dec 12 09:46:17 2023","interfaces":[{"interface":"back","average":{"1min":1.266,"5min":1.377,"15min":1.419},"min":{"1min":0.90700000000000003,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.7030000000000001,"5min":2.1739999999999999,"15min":2.1739999999999999},"last":1.224},{"interface":"front","average":{"1min":1.494,"5min":1.4790000000000001,"15min":1.4770000000000001},"min":{"1min":1.175,"5min":0.80100000000000005,"15min":0.80100000000000005},"max":{"1min":1.76,"5min":1.929,"15min":1.929},"last":1.8009999999999999}]},{"osd":7,"last update":"Tue Dec 12 09:46:17 2023","interfaces":[{"interface":"back","average":{"1min":1.448,"5min":1.476,"15min":1.498},"min":{"1min":1.03,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.8759999999999999,"5min":1.994,"15min":1.994},"last":1.4199999999999999},{"interface":"front","average":{"1min":1.4139999999999999,"5min":1.4810000000000001,"15min":1.5189999999999999},"min":{"1min":1.0389999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"max":{"1min":1.792,"5min":2.0800000000000001,"15min":2.0800000000000001},"last":1.3169999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574889,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32096,"kb_used_data":916,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339744,"statfs":{"total":96636764160,"available":96603897856,"internally_reserved":0,"allocated":937984,"data_stored":407495,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 12 09:46:17 2023","interfaces":[{"interface":"back","average":{"1min":1.0509999999999999,"5min":1.026,"15min":1.022},"min":{"1min":0.73799999999999999,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.5089999999999999,"5min":1.7310000000000001,"15min":1.7310000000000001},"last":1.1819999999999999},{"interface":"front","average":{"1min":1.077,"5min":1.101,"15min":1.1200000000000001},"min":{"1min":0.69899999999999995,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.4219999999999999,"5min":1.595,"15min":1.595},"last":1.248}]},{"osd":1,"last update":"Tue Dec 12 09:46:17 2023","interfaces":[{"interface":"back","average":{"1min":1.075,"5min":1.1499999999999999,"15min":1.2},"min":{"1min":0.86699999999999999,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.343,"5min":1.756,"15min":1.756},"last":1.0069999999999999},{"interface":"front","average":{"1min":1.052,"5min":1.079,"15min":1.087},"min":{"1min":0.752,"5min":0.66400000000000003,"15min":0.66400000000000003},"max":{"1min":1.5129999999999999,"5min":1.5840000000000001,"15min":1.5840000000000001},"last":0.83199999999999996}]},{"osd":2,"last update":"Tue Dec 12 09:46:17 2023","interfaces":[{"interface":"back","average":{"1min":1.1579999999999999,"5min":1.254,"15min":1.296},"min":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"max":{"1min":1.744,"5min":1.7889999999999999,"15min":1.7889999999999999},"last":1.4199999999999999},{"interface":"front","average":{"1min":1.089,"5min":1.3009999999999999,"15min":1.381},"min":{"1min":0.77000000000000002,"5min":0.72899999999999998,"15min":0.72899999999999998},"max":{"1min":1.556,"5min":2.1600000000000001,"15min":2.1600000000000001},"last":1.1359999999999999}]},{"osd":3,"last update":"Tue Dec 12 09:46:17 2023","interfaces":[{"interface":"back","average":{"1min":1.1659999999999999,"5min":1.296,"15min":1.3460000000000001},"min":{"1min":0.90100000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"max":{"1min":1.627,"5min":2.1499999999999999,"15min":2.1499999999999999},"last":1.0700000000000001},{"interface":"front","average":{"1min":1.3540000000000001,"5min":1.413,"15min":1.4650000000000001},"min":{"1min":1.038,"5min":0.75800000000000001,"15min":0.75800000000000001},"max":{"1min":2.0249999999999999,"5min":2.0249999999999999,"15min":2.0249999999999999},"last":1.589}]},{"osd":4,"last update":"Tue Dec 12 09:46:17 2023","interfaces":[{"interface":"back","average":{"1min":1.2310000000000001,"5min":1.4019999999999999,"15min":1.4610000000000001},"min":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":1.9790000000000001,"5min":2.391,"15min":2.391},"last":1.3700000000000001},{"interface":"front","average":{"1min":1.4419999999999999,"5min":1.53,"15min":1.5680000000000001},"min":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"max":{"1min":2.6040000000000001,"5min":2.6040000000000001,"15min":2.6040000000000001},"last":1.282}]},{"osd":6,"last update":"Tue Dec 12 09:46:17 2023","interfaces":[{"interface":"back","average":{"1min":1.4390000000000001,"5min":1.5109999999999999,"15min":1.5669999999999999},"min":{"1min":0.74099999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":2.1179999999999999,"5min":2.1179999999999999,"15min":2.1179999999999999},"last":1.4990000000000001},{"interface":"front","average":{"1min":1.2829999999999999,"5min":1.5089999999999999,"15min":1.5900000000000001},"min":{"1min":0.80700000000000005,"5min":0.627,"15min":0.627},"max":{"1min":1.7849999999999999,"5min":2.306,"15min":2.306},"last":1.343}]},{"osd":7,"last update":"Tue Dec 12 09:46:17 2023","interfaces":[{"interface":"back","average":{"1min":1.546,"5min":1.6870000000000001,"15min":1.752},"min":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"max":{"1min":2.2200000000000002,"5min":2.6880000000000002,"15min":2.6880000000000002},"last":1.55},{"interface":"front","average":{"1min":1.605,"5min":1.6599999999999999,"15min":1.718},"min":{"1min":1.1479999999999999,"5min":0.88600000000000001,"15min":0.88600000000000001},"max":{"1min":2.4910000000000001,"5min":2.4910000000000001,"15min":2.4910000000000001},"last":1.6519999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574891,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32080,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339760,"statfs":{"total":96636764160,"available":96603914240,"internally_reserved":0,"allocated":921600,"data_stored":405861,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 12 09:46:19 2023","interfaces":[{"interface":"back","average":{"1min":1.0980000000000001,"5min":1.0549999999999999,"15min":1.0549999999999999},"min":{"1min":0.67400000000000004,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":1.5880000000000001,"5min":1.7010000000000001,"15min":1.7010000000000001},"last":1.212},{"interface":"front","average":{"1min":1.145,"5min":1.0589999999999999,"15min":1.056},"min":{"1min":0.75800000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":1.5449999999999999,"5min":1.5449999999999999,"15min":1.5449999999999999},"last":1.403}]},{"osd":1,"last update":"Tue Dec 12 09:46:19 2023","interfaces":[{"interface":"back","average":{"1min":1.0529999999999999,"5min":1.048,"15min":1.0449999999999999},"min":{"1min":0.748,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":1.496,"5min":1.496,"15min":1.496},"last":1.458},{"interface":"front","average":{"1min":1.133,"5min":1.163,"15min":1.175},"min":{"1min":0.75900000000000001,"5min":0.73699999999999999,"15min":0.73699999999999999},"max":{"1min":1.6140000000000001,"5min":1.8720000000000001,"15min":1.8720000000000001},"last":1.3200000000000001}]},{"osd":2,"last update":"Tue Dec 12 09:46:19 2023","interfaces":[{"interface":"back","average":{"1min":1.181,"5min":1.1359999999999999,"15min":1.1240000000000001},"min":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"max":{"1min":1.585,"5min":1.585,"15min":1.585},"last":1.0389999999999999},{"interface":"front","average":{"1min":1.226,"5min":1.2689999999999999,"15min":1.2849999999999999},"min":{"1min":0.80800000000000005,"5min":0.75600000000000001,"15min":0.75600000000000001},"max":{"1min":1.554,"5min":2.1640000000000001,"15min":2.1640000000000001},"last":1.1020000000000001}]},{"osd":3,"last update":"Tue Dec 12 09:46:19 2023","interfaces":[{"interface":"back","average":{"1min":1.3620000000000001,"5min":1.2450000000000001,"15min":1.2170000000000001},"min":{"1min":1.03,"5min":0.83399999999999996,"15min":0.83399999999999996},"max":{"1min":1.7010000000000001,"5min":1.7010000000000001,"15min":1.7010000000000001},"last":0.874},{"interface":"front","average":{"1min":1.24,"5min":1.2350000000000001,"15min":1.2370000000000001},"min":{"1min":0.86099999999999999,"5min":0.70599999999999996,"15min":0.70599999999999996},"max":{"1min":1.506,"5min":2.0499999999999998,"15min":2.0499999999999998},"last":1.355}]},{"osd":5,"last update":"Tue Dec 12 09:46:19 2023","interfaces":[{"interface":"back","average":{"1min":1.4139999999999999,"5min":1.4179999999999999,"15min":1.4510000000000001},"min":{"1min":1.026,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.7350000000000001,"5min":2.3159999999999998,"15min":2.3159999999999998},"last":1.73},{"interface":"front","average":{"1min":1.4890000000000001,"5min":1.3799999999999999,"15min":1.3600000000000001},"min":{"1min":1.2509999999999999,"5min":0.71199999999999997,"15min":0.71199999999999997},"max":{"1min":1.8160000000000001,"5min":2.117,"15min":2.117},"last":1.6839999999999999}]},{"osd":6,"last update":"Tue Dec 12 09:46:19 2023","interfaces":[{"interface":"back","average":{"1min":1.3799999999999999,"5min":1.381,"15min":1.395},"min":{"1min":0.98099999999999998,"5min":0.81200000000000006,"15min":0.81200000000000006},"max":{"1min":1.7090000000000001,"5min":2.246,"15min":2.246},"last":1.2569999999999999},{"interface":"front","average":{"1min":1.5609999999999999,"5min":1.5329999999999999,"15min":1.5429999999999999},"min":{"1min":1.0700000000000001,"5min":0.65600000000000003,"15min":0.65600000000000003},"max":{"1min":1.7949999999999999,"5min":2.5099999999999998,"15min":2.5099999999999998},"last":1.5069999999999999}]},{"osd":7,"last update":"Tue Dec 12 09:46:19 2023","interfaces":[{"interface":"back","average":{"1min":1.5720000000000001,"5min":1.51,"15min":1.506},"min":{"1min":1.1970000000000001,"5min":0.77500000000000002,"15min":0.77500000000000002},"max":{"1min":1.9099999999999999,"5min":2.5710000000000002,"15min":2.5710000000000002},"last":1.7809999999999999},{"interface":"front","average":{"1min":1.5640000000000001,"5min":1.522,"15min":1.516},"min":{"1min":1.2490000000000001,"5min":1.0600000000000001,"15min":1.0600000000000001},"max":{"1min":2.016,"5min":2.3919999999999999,"15min":2.3919999999999999},"last":1.6259999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574889,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32100,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339740,"statfs":{"total":96636764160,"available":96603893760,"internally_reserved":0,"allocated":933888,"data_stored":407473,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 12 09:46:19 2023","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.84599999999999997,"15min":0.89000000000000001},"min":{"1min":0.35099999999999998,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":1.2350000000000001,"5min":1.4830000000000001,"15min":1.4830000000000001},"last":0.79500000000000004},{"interface":"front","average":{"1min":0.93600000000000005,"5min":1.012,"15min":1.095},"min":{"1min":0.47699999999999998,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":1.839,"5min":3.3370000000000002,"15min":3.3370000000000002},"last":0.64000000000000001}]},{"osd":1,"last update":"Tue Dec 12 09:46:19 2023","interfaces":[{"interface":"back","average":{"1min":0.88100000000000001,"5min":0.875,"15min":0.90500000000000003},"min":{"1min":0.52200000000000002,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":1.4870000000000001,"5min":1.4870000000000001,"15min":1.4870000000000001},"last":0.74299999999999999},{"interface":"front","average":{"1min":1.0580000000000001,"5min":1.0209999999999999,"15min":1.0529999999999999},"min":{"1min":0.58399999999999996,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.542,"5min":2.9409999999999998,"15min":2.9409999999999998},"last":0.72199999999999998}]},{"osd":2,"last update":"Tue Dec 12 09:46:19 2023","interfaces":[{"interface":"back","average":{"1min":0.94599999999999995,"5min":1.0760000000000001,"15min":1.1499999999999999},"min":{"1min":0.56100000000000005,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.6899999999999999,"5min":2.613,"15min":2.613},"last":0.83599999999999997},{"interface":"front","average":{"1min":1.0489999999999999,"5min":1.1000000000000001,"15min":1.1559999999999999},"min":{"1min":0.53600000000000003,"5min":0.437,"15min":0.437},"max":{"1min":1.53,"5min":3.0430000000000001,"15min":3.0430000000000001},"last":0.86399999999999999}]},{"osd":4,"last update":"Tue Dec 12 09:46:19 2023","interfaces":[{"interface":"back","average":{"1min":1.129,"5min":1.2989999999999999,"15min":1.355},"min":{"1min":0.77200000000000002,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.7410000000000001,"5min":3.5019999999999998,"15min":3.5019999999999998},"last":1.0289999999999999},{"interface":"front","average":{"1min":1.1850000000000001,"5min":1.355,"15min":1.4399999999999999},"min":{"1min":0.93500000000000005,"5min":0.755,"15min":0.755},"max":{"1min":1.528,"5min":2.9889999999999999,"15min":2.9889999999999999},"last":1.159}]},{"osd":5,"last update":"Tue Dec 12 09:46:19 2023","interfaces":[{"interface":"back","average":{"1min":1.306,"5min":1.4119999999999999,"15min":1.47},"min":{"1min":0.876,"5min":0.68000000000000005,"15min":0.68000000000000005},"max":{"1min":1.7370000000000001,"5min":4.2480000000000002,"15min":4.2480000000000002},"last":1.365},{"interface":"front","average":{"1min":1.2430000000000001,"5min":1.4450000000000001,"15min":1.5429999999999999},"min":{"1min":0.746,"5min":0.72999999999999998,"15min":0.72999999999999998},"max":{"1min":1.609,"5min":5.5060000000000002,"15min":5.5060000000000002},"last":0.96999999999999997}]},{"osd":6,"last update":"Tue Dec 12 09:46:19 2023","interfaces":[{"interface":"back","average":{"1min":1.2669999999999999,"5min":1.353,"15min":1.423},"min":{"1min":0.77700000000000002,"5min":0.76500000000000001,"15min":0.76500000000000001},"max":{"1min":1.6799999999999999,"5min":3.1400000000000001,"15min":3.1400000000000001},"last":1.302},{"interface":"front","average":{"1min":1.3540000000000001,"5min":1.456,"15min":1.516},"min":{"1min":0.92200000000000004,"5min":0.627,"15min":0.627},"max":{"1min":1.677,"5min":4.3179999999999996,"15min":4.3179999999999996},"last":1.4299999999999999}]},{"osd":7,"last update":"Tue Dec 12 09:46:19 2023","interfaces":[{"interface":"back","average":{"1min":1.3069999999999999,"5min":1.4630000000000001,"15min":1.5489999999999999},"min":{"1min":0.78100000000000003,"5min":0.77400000000000002,"15min":0.77400000000000002},"max":{"1min":1.627,"5min":5.3979999999999997,"15min":5.3979999999999997},"last":1.3939999999999999},{"interface":"front","average":{"1min":1.371,"5min":1.452,"15min":1.52},"min":{"1min":0.83799999999999997,"5min":0.74299999999999999,"15min":0.74299999999999999},"max":{"1min":1.7769999999999999,"5min":3.4129999999999998,"15min":3.4129999999999998},"last":1.22}]}]},{"osd":2,"up_from":13,"seq":55834574889,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27924,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343916,"statfs":{"total":96636764160,"available":96608169984,"internally_reserved":0,"allocated":925696,"data_stored":406443,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 12 09:46:17 2023","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":0.80400000000000005,"15min":0.81399999999999995},"min":{"1min":0.37,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":1.431,"5min":1.458,"15min":1.458},"last":0.40000000000000002},{"interface":"front","average":{"1min":0.88500000000000001,"5min":0.89400000000000002,"15min":0.90600000000000003},"min":{"1min":0.36099999999999999,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":2.4129999999999998,"5min":2.4129999999999998,"15min":2.4129999999999998},"last":0.502}]},{"osd":1,"last update":"Tue Dec 12 09:46:17 2023","interfaces":[{"interface":"back","average":{"1min":0.81299999999999994,"5min":0.84699999999999998,"15min":0.85799999999999998},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":1.2450000000000001,"5min":1.593,"15min":1.593},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.98399999999999999,"5min":0.89700000000000002,"15min":0.89000000000000001},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.514,"5min":1.758,"15min":1.758},"last":0.55200000000000005}]},{"osd":3,"last update":"Tue Dec 12 09:46:17 2023","interfaces":[{"interface":"back","average":{"1min":1.0589999999999999,"5min":1.034,"15min":1.0489999999999999},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":1.889,"5min":1.889,"15min":1.889},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.91300000000000003,"5min":0.96099999999999997,"15min":0.99299999999999999},"min":{"1min":0.442,"5min":0.432,"15min":0.432},"max":{"1min":1.472,"5min":1.8120000000000001,"15min":1.8120000000000001},"last":0.48499999999999999}]},{"osd":4,"last update":"Tue Dec 12 09:46:17 2023","interfaces":[{"interface":"back","average":{"1min":1.1359999999999999,"5min":1.1910000000000001,"15min":1.2150000000000001},"min":{"1min":0.753,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.8300000000000001,"5min":2.5760000000000001,"15min":2.5760000000000001},"last":1.0449999999999999},{"interface":"front","average":{"1min":1.175,"5min":1.3080000000000001,"15min":1.365},"min":{"1min":0.747,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.6259999999999999,"5min":2.8069999999999999,"15min":2.8069999999999999},"last":0.86199999999999999}]},{"osd":5,"last update":"Tue Dec 12 09:46:17 2023","interfaces":[{"interface":"back","average":{"1min":1.2210000000000001,"5min":1.3360000000000001,"15min":1.3640000000000001},"min":{"1min":0.81699999999999995,"5min":0.80500000000000005,"15min":0.80500000000000005},"max":{"1min":1.7150000000000001,"5min":2.3109999999999999,"15min":2.3109999999999999},"last":0.89500000000000002},{"interface":"front","average":{"1min":1.159,"5min":1.2809999999999999,"15min":1.327},"min":{"1min":0.79400000000000004,"5min":0.627,"15min":0.627},"max":{"1min":1.5660000000000001,"5min":2.5110000000000001,"15min":2.5110000000000001},"last":0.998}]},{"osd":6,"last update":"Tue Dec 12 09:46:17 2023","interfaces":[{"interface":"back","average":{"1min":1.2589999999999999,"5min":1.379,"15min":1.417},"min":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":1.77,"5min":2.907,"15min":2.907},"last":0.98499999999999999},{"interface":"front","average":{"1min":1.3120000000000001,"5min":1.3999999999999999,"15min":1.419},"min":{"1min":0.83899999999999997,"5min":0.82799999999999996,"15min":0.82799999999999996},"max":{"1min":1.7809999999999999,"5min":2.6000000000000001,"15min":2.6000000000000001},"last":0.82799999999999996}]},{"osd":7,"last update":"Tue Dec 12 09:46:17 2023","interfaces":[{"interface":"back","average":{"1min":1.333,"5min":1.401,"15min":1.4379999999999999},"min":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"max":{"1min":1.7669999999999999,"5min":2.3370000000000002,"15min":2.3370000000000002},"last":0.91400000000000003},{"interface":"front","average":{"1min":1.3779999999999999,"5min":1.466,"15min":1.4970000000000001},"min":{"1min":0.96499999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"max":{"1min":1.95,"5min":2.488,"15min":2.488},"last":1.131}]}]},{"osd":1,"up_from":13,"seq":55834574889,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32092,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339748,"statfs":{"total":96636764160,"available":96603901952,"internally_reserved":0,"allocated":933888,"data_stored":406055,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 12 09:46:17 2023","interfaces":[{"interface":"back","average":{"1min":0.82599999999999996,"5min":0.83699999999999997,"15min":0.84899999999999998},"min":{"1min":0.56299999999999994,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":1.427,"5min":2.794,"15min":2.794},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.749,"5min":0.82599999999999996,"15min":0.85199999999999998},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":1.5,"5min":2.1379999999999999,"15min":2.1379999999999999},"last":0.69999999999999996}]},{"osd":2,"last update":"Tue Dec 12 09:46:17 2023","interfaces":[{"interface":"back","average":{"1min":0.82899999999999996,"5min":0.93500000000000005,"15min":0.96899999999999997},"min":{"1min":0.59099999999999997,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":1.4450000000000001,"5min":6.3390000000000004,"15min":6.3390000000000004},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.89100000000000001,"5min":0.94699999999999995,"15min":0.95999999999999996},"min":{"1min":0.56799999999999995,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.1830000000000001,"5min":2.823,"15min":2.823},"last":0.72199999999999998}]},{"osd":3,"last update":"Tue Dec 12 09:46:17 2023","interfaces":[{"interface":"back","average":{"1min":0.94999999999999996,"5min":1.0329999999999999,"15min":1.0449999999999999},"min":{"1min":0.53200000000000003,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":1.5549999999999999,"5min":2.7519999999999998,"15min":2.7519999999999998},"last":0.79100000000000004},{"interface":"front","average":{"1min":0.88200000000000001,"5min":0.98399999999999999,"15min":1},"min":{"1min":0.498,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":1.212,"5min":2.2559999999999998,"15min":2.2559999999999998},"last":0.622}]},{"osd":4,"last update":"Tue Dec 12 09:46:17 2023","interfaces":[{"interface":"back","average":{"1min":1.159,"5min":1.2929999999999999,"15min":1.363},"min":{"1min":0.78700000000000003,"5min":0.68400000000000005,"15min":0.68400000000000005},"max":{"1min":1.484,"5min":6.423,"15min":6.423},"last":1.0900000000000001},{"interface":"front","average":{"1min":1.1799999999999999,"5min":1.1899999999999999,"15min":1.1919999999999999},"min":{"1min":0.84499999999999997,"5min":0.80000000000000004,"15min":0.80000000000000004},"max":{"1min":1.474,"5min":2.2309999999999999,"15min":2.2309999999999999},"last":0.93999999999999995}]},{"osd":5,"last update":"Tue Dec 12 09:46:17 2023","interfaces":[{"interface":"back","average":{"1min":1.145,"5min":1.353,"15min":1.429},"min":{"1min":0.93799999999999994,"5min":0.80200000000000005,"15min":0.80200000000000005},"max":{"1min":1.4970000000000001,"5min":6.2830000000000004,"15min":6.2830000000000004},"last":0.85199999999999998},{"interface":"front","average":{"1min":1.2310000000000001,"5min":1.325,"15min":1.3580000000000001},"min":{"1min":0.88900000000000001,"5min":0.83499999999999996,"15min":0.83499999999999996},"max":{"1min":1.4390000000000001,"5min":2.73,"15min":2.73},"last":0.98399999999999999}]},{"osd":6,"last update":"Tue Dec 12 09:46:17 2023","interfaces":[{"interface":"back","average":{"1min":1.236,"5min":1.446,"15min":1.522},"min":{"1min":0.84499999999999997,"5min":0.751,"15min":0.751},"max":{"1min":1.7210000000000001,"5min":6.468,"15min":6.468},"last":1.117},{"interface":"front","average":{"1min":1.2430000000000001,"5min":1.4470000000000001,"15min":1.5349999999999999},"min":{"1min":0.90400000000000003,"5min":0.84699999999999998,"15min":0.84699999999999998},"max":{"1min":1.585,"5min":6.3129999999999997,"15min":6.3129999999999997},"last":0.96399999999999997}]},{"osd":7,"last update":"Tue Dec 12 09:46:17 2023","interfaces":[{"interface":"back","average":{"1min":1.3300000000000001,"5min":1.3759999999999999,"15min":1.3959999999999999},"min":{"1min":0.99099999999999999,"5min":0.82999999999999996,"15min":0.82999999999999996},"max":{"1min":1.5980000000000001,"5min":2.9009999999999998,"15min":2.9009999999999998},"last":1.0089999999999999},{"interface":"front","average":{"1min":1.2529999999999999,"5min":1.4530000000000001,"15min":1.5209999999999999},"min":{"1min":0.92400000000000004,"5min":0.752,"15min":0.752},"max":{"1min":1.6379999999999999,"5min":6.242,"15min":6.242},"last":0.89500000000000002}]}]},{"osd":0,"up_from":13,"seq":55834574891,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32148,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339692,"statfs":{"total":96636764160,"available":96603844608,"internally_reserved":0,"allocated":991232,"data_stored":996263,"data_compressed":32422,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Dec 12 09:46:19 2023","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.78000000000000003,"15min":0.77400000000000002},"min":{"1min":0.40699999999999997,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":1.3600000000000001,"5min":1.639,"15min":1.639},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.82999999999999996,"15min":0.82099999999999995},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":1.5509999999999999,"5min":1.5680000000000001,"15min":1.5680000000000001},"last":0.65300000000000002}]},{"osd":2,"last update":"Tue Dec 12 09:46:19 2023","interfaces":[{"interface":"back","average":{"1min":0.86399999999999999,"5min":0.88,"15min":0.86799999999999999},"min":{"1min":0.47299999999999998,"5min":0.316,"15min":0.316},"max":{"1min":1.466,"5min":1.748,"15min":1.748},"last":1.073},{"interface":"front","average":{"1min":0.84299999999999997,"5min":0.97499999999999998,"15min":0.98799999999999999},"min":{"1min":0.48399999999999999,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":1.26,"5min":1.649,"15min":1.649},"last":1.347}]},{"osd":3,"last update":"Tue Dec 12 09:46:19 2023","interfaces":[{"interface":"back","average":{"1min":0.83499999999999996,"5min":0.84099999999999997,"15min":0.84899999999999998},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":1.901,"5min":1.901,"15min":1.901},"last":1.1539999999999999},{"interface":"front","average":{"1min":1.002,"5min":1.0129999999999999,"15min":1.0069999999999999},"min":{"1min":0.50700000000000001,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":2.3210000000000002,"5min":2.3210000000000002,"15min":2.3210000000000002},"last":1.1779999999999999}]},{"osd":4,"last update":"Tue Dec 12 09:46:19 2023","interfaces":[{"interface":"back","average":{"1min":1.2250000000000001,"5min":1.284,"15min":1.286},"min":{"1min":0.81399999999999995,"5min":0.80400000000000005,"15min":0.80400000000000005},"max":{"1min":1.5660000000000001,"5min":2.073,"15min":2.073},"last":0.86199999999999999},{"interface":"front","average":{"1min":1.248,"5min":1.2649999999999999,"15min":1.2829999999999999},"min":{"1min":0.85899999999999999,"5min":0.64400000000000002,"15min":0.64400000000000002},"max":{"1min":1.714,"5min":3.0699999999999998,"15min":3.0699999999999998},"last":1.2410000000000001}]},{"osd":5,"last update":"Tue Dec 12 09:46:19 2023","interfaces":[{"interface":"back","average":{"1min":1.177,"5min":1.2090000000000001,"15min":1.2250000000000001},"min":{"1min":0.68600000000000005,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.698,"5min":3.1909999999999998,"15min":3.1909999999999998},"last":1.107},{"interface":"front","average":{"1min":1.266,"5min":1.292,"15min":1.302},"min":{"1min":0.89700000000000002,"5min":0.67300000000000004,"15min":0.67300000000000004},"max":{"1min":2.2120000000000002,"5min":2.2120000000000002,"15min":2.2120000000000002},"last":1.3089999999999999}]},{"osd":6,"last update":"Tue Dec 12 09:46:19 2023","interfaces":[{"interface":"back","average":{"1min":1.3260000000000001,"5min":1.3340000000000001,"15min":1.3360000000000001},"min":{"1min":0.84999999999999998,"5min":0.67500000000000004,"15min":0.67500000000000004},"max":{"1min":1.643,"5min":2.04,"15min":2.04},"last":1.4370000000000001},{"interface":"front","average":{"1min":1.296,"5min":1.3660000000000001,"15min":1.383},"min":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"max":{"1min":2.3500000000000001,"5min":2.9100000000000001,"15min":2.9100000000000001},"last":1.466}]},{"osd":7,"last update":"Tue Dec 12 09:46:19 2023","interfaces":[{"interface":"back","average":{"1min":1.3280000000000001,"5min":1.4119999999999999,"15min":1.4339999999999999},"min":{"1min":0.78100000000000003,"5min":0.66800000000000004,"15min":0.66800000000000004},"max":{"1min":1.7929999999999999,"5min":2.992,"15min":2.992},"last":1.556},{"interface":"front","average":{"1min":1.3280000000000001,"5min":1.327,"15min":1.329},"min":{"1min":0.93500000000000005,"5min":0.79500000000000004,"15min":0.79500000000000004},"max":{"1min":2.1440000000000001,"5min":2.7690000000000001,"15min":2.7690000000000001},"last":1.409}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32422,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32422,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-12T09:46:32.206 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-12-12T09:46:32.206 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-12-12T09:46:32.470 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:32.468+0000 7fae7cfa9640 1 Processor -- start 2023-12-12T09:46:32.470 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:32.469+0000 7fae7cfa9640 1 -- start start 2023-12-12T09:46:32.472 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:32.470+0000 7fae7cfa9640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fae780ab3f0 0x7fae780bfec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:32.472 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:32.470+0000 7fae7cfa9640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fae78157ab0 0x7fae78157f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:32.472 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:32.471+0000 7fae7cfa9640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae7806b090 con 0x7fae780aab10 2023-12-12T09:46:32.472 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:32.471+0000 7fae7cfa9640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae780ab940 con 0x7fae78157ab0 2023-12-12T09:46:32.472 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:32.471+0000 7fae7cfa9640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae780c0400 con 0x7fae780ab3f0 2023-12-12T09:46:32.473 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:32.471+0000 7fae76d9d640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fae78157ab0 0x7fae78157f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:32.473 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:32.471+0000 7fae7659c640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7fae780aab10 0x7fae780bf7b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:55682/0 (socket says 172.21.15.73:55682) 2023-12-12T09:46:32.473 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:32.471+0000 7fae7659c640 1 -- 172.21.15.73:0/400700506 learned_addr learned my addr 172.21.15.73:0/400700506 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-12T09:46:32.474 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:32.471+0000 7fae75d9b640 1 --2- 172.21.15.73:0/400700506 >> v2:172.21.15.142:3300/0 conn(0x7fae780ab3f0 0x7fae780bfec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:32.474 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:32.471+0000 7fae76d9d640 1 -- 172.21.15.73:0/400700506 >> v2:172.21.15.142:3300/0 conn(0x7fae780ab3f0 msgr2=0x7fae780bfec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:46:32.474 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:32.471+0000 7fae76d9d640 1 --2- 172.21.15.73:0/400700506 >> v2:172.21.15.142:3300/0 conn(0x7fae780ab3f0 0x7fae780bfec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:32.474 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:32.471+0000 7fae76d9d640 1 -- 172.21.15.73:0/400700506 >> v1:172.21.15.73:6789/0 conn(0x7fae780aab10 legacy=0x7fae780bf7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:32.474 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:32.471+0000 7fae76d9d640 1 -- 172.21.15.73:0/400700506 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae780c0e20 con 0x7fae78157ab0 2023-12-12T09:46:32.474 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:32.471+0000 7fae7559a640 1 -- 172.21.15.73:0/400700506 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2170674916 0 0) 0x7fae7806b090 con 0x7fae780aab10 2023-12-12T09:46:32.474 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:32.471+0000 7fae75d9b640 1 --2- 172.21.15.73:0/400700506 >> v2:172.21.15.142:3300/0 conn(0x7fae780ab3f0 0x7fae780bfec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:46:32.475 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:32.473+0000 7fae76d9d640 1 --2- 172.21.15.73:0/400700506 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fae78157ab0 0x7fae78157f20 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7fae780c7360 tx=0x7fae7002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2726aa141a68d7b server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:46:32.476 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:32.473+0000 7fae7559a640 1 -- 172.21.15.73:0/400700506 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae70031830 con 0x7fae78157ab0 2023-12-12T09:46:32.476 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:32.473+0000 7fae7559a640 1 -- 172.21.15.73:0/400700506 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae70031990 con 0x7fae78157ab0 2023-12-12T09:46:32.476 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:32.473+0000 7fae7559a640 1 -- 172.21.15.73:0/400700506 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae70031d20 con 0x7fae78157ab0 2023-12-12T09:46:32.476 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:32.473+0000 7fae7cfa9640 1 -- 172.21.15.73:0/400700506 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fae78157ab0 msgr2=0x7fae78157f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:32.476 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:32.473+0000 7fae7cfa9640 1 --2- 172.21.15.73:0/400700506 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fae78157ab0 0x7fae78157f20 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7fae780c7360 tx=0x7fae7002b8d0 comp rx=0 tx=0).stop 2023-12-12T09:46:32.476 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:32.474+0000 7fae7cfa9640 1 -- 172.21.15.73:0/400700506 shutdown_connections 2023-12-12T09:46:32.476 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:32.474+0000 7fae7cfa9640 1 --2- 172.21.15.73:0/400700506 >> v2:172.21.15.142:3300/0 conn(0x7fae780ab3f0 0x7fae780bfec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:32.476 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:32.474+0000 7fae7cfa9640 1 --2- 172.21.15.73:0/400700506 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fae78157ab0 0x7fae78157f20 unknown :-1 s=CLOSED pgs=885 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:32.476 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:32.474+0000 7fae7cfa9640 1 -- 172.21.15.73:0/400700506 >> 172.21.15.73:0/400700506 conn(0x7fae780c6380 msgr2=0x7fae780c6760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:46:32.477 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:32.474+0000 7fae7cfa9640 1 -- 172.21.15.73:0/400700506 shutdown_connections 2023-12-12T09:46:32.477 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:32.474+0000 7fae7cfa9640 1 -- 172.21.15.73:0/400700506 wait complete. 2023-12-12T09:46:32.479 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:32.475+0000 7fae7cfa9640 1 Processor -- start 2023-12-12T09:46:32.479 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:32.475+0000 7fae7cfa9640 1 -- start start 2023-12-12T09:46:32.479 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:32.476+0000 7fae7cfa9640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fae780aab10 0x7fae7814dd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:32.479 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:32.476+0000 7fae7cfa9640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fae780ab3f0 0x7fae7814b680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:32.479 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:32.476+0000 7fae7cfa9640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fae78157ab0 0x7fae7814bbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:32.479 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:32.476+0000 7fae7cfa9640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae7814c100 con 0x7fae780aab10 2023-12-12T09:46:32.480 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:32.476+0000 7fae7cfa9640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae781dfef0 con 0x7fae780ab3f0 2023-12-12T09:46:32.480 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:32.476+0000 7fae7cfa9640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae781df120 con 0x7fae78157ab0 2023-12-12T09:46:32.480 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:32.476+0000 7fae7659c640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fae780aab10 0x7fae7814dd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:32.480 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:32.477+0000 7fae7659c640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fae780aab10 0x7fae7814dd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:55848/0 (socket says 172.21.15.73:55848) 2023-12-12T09:46:32.480 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:32.477+0000 7fae7659c640 1 -- 172.21.15.73:0/3068849059 learned_addr learned my addr 172.21.15.73:0/3068849059 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:46:32.480 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:32.477+0000 7fae75d9b640 1 --2- 172.21.15.73:0/3068849059 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fae780ab3f0 0x7fae7814b680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:32.480 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:32.477+0000 7fae76d9d640 1 --2- 172.21.15.73:0/3068849059 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fae78157ab0 0x7fae7814bbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:32.480 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:32.477+0000 7fae7659c640 1 -- 172.21.15.73:0/3068849059 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fae78157ab0 msgr2=0x7fae7814bbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:32.480 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:32.477+0000 7fae7659c640 1 --2- 172.21.15.73:0/3068849059 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fae78157ab0 0x7fae7814bbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:32.480 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:32.477+0000 7fae7659c640 1 -- 172.21.15.73:0/3068849059 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fae780ab3f0 msgr2=0x7fae7814b680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:32.480 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:32.477+0000 7fae7659c640 1 --2- 172.21.15.73:0/3068849059 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fae780ab3f0 0x7fae7814b680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:32.480 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:32.477+0000 7fae7659c640 1 -- 172.21.15.73:0/3068849059 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae70009400 con 0x7fae780aab10 2023-12-12T09:46:32.480 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:32.477+0000 7fae7659c640 1 --2- 172.21.15.73:0/3068849059 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fae780aab10 0x7fae7814dd10 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7fae6800c7c0 tx=0x7fae6800cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:46:32.480 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:32.478+0000 7fae6effd640 1 -- 172.21.15.73:0/3068849059 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae6800a640 con 0x7fae780aab10 2023-12-12T09:46:32.481 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:32.478+0000 7fae6effd640 1 -- 172.21.15.73:0/3068849059 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae6800a7c0 con 0x7fae780aab10 2023-12-12T09:46:32.481 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:32.478+0000 7fae6effd640 1 -- 172.21.15.73:0/3068849059 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae6800ab70 con 0x7fae780aab10 2023-12-12T09:46:32.481 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:32.478+0000 7fae7cfa9640 1 -- 172.21.15.73:0/3068849059 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae781dfc10 con 0x7fae780aab10 2023-12-12T09:46:32.481 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:32.478+0000 7fae7cfa9640 1 -- 172.21.15.73:0/3068849059 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae781dedb0 con 0x7fae780aab10 2023-12-12T09:46:32.481 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:32.479+0000 7fae7cfa9640 1 -- 172.21.15.73:0/3068849059 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae78067580 con 0x7fae780aab10 2023-12-12T09:46:32.481 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:32.480+0000 7fae6effd640 1 -- 172.21.15.73:0/3068849059 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fae6800acd0 con 0x7fae780aab10 2023-12-12T09:46:32.482 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:32.481+0000 7fae6effd640 1 --2- 172.21.15.73:0/3068849059 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fae5806ae70 0x7fae5806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:32.482 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:32.481+0000 7fae6effd640 1 -- 172.21.15.73:0/3068849059 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fae680889c0 con 0x7fae780aab10 2023-12-12T09:46:32.482 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:32.481+0000 7fae75d9b640 1 --2- 172.21.15.73:0/3068849059 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fae5806ae70 0x7fae5806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:32.483 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:32.482+0000 7fae75d9b640 1 --2- 172.21.15.73:0/3068849059 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fae5806ae70 0x7fae5806d330 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fae780c5ac0 tx=0x7fae60008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:46:32.487 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:32.486+0000 7fae6effd640 1 -- 172.21.15.73:0/3068849059 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fae68053b00 con 0x7fae780aab10 2023-12-12T09:46:32.746 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:32.745+0000 7fae7cfa9640 1 -- 172.21.15.73:0/3068849059 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7fae78151e50 con 0x7fae780aab10 2023-12-12T09:46:32.750 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:32.748+0000 7fae6effd640 1 -- 172.21.15.73:0/3068849059 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v19) v1 ==== 190+0+147 (secure 0 0 0) 0x7fae68018020 con 0x7fae780aab10 2023-12-12T09:46:32.751 INFO:teuthology.orchestra.run.smithi073.stdout:[client.0] 2023-12-12T09:46:32.751 INFO:teuthology.orchestra.run.smithi073.stdout: key = AQD/Knhl/4KuBxAAdAlGb7dYkXXlgPJp0Qcecg== 2023-12-12T09:46:32.751 INFO:teuthology.orchestra.run.smithi073.stdout: caps mds = "allow" 2023-12-12T09:46:32.751 INFO:teuthology.orchestra.run.smithi073.stdout: caps mon = "allow r" 2023-12-12T09:46:32.751 INFO:teuthology.orchestra.run.smithi073.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2023-12-12T09:46:32.751 INFO:teuthology.orchestra.run.smithi073.stderr:updated caps for client.0 2023-12-12T09:46:32.753 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:32.752+0000 7fae7cfa9640 1 -- 172.21.15.73:0/3068849059 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fae5806ae70 msgr2=0x7fae5806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:32.754 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:32.752+0000 7fae7cfa9640 1 --2- 172.21.15.73:0/3068849059 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fae5806ae70 0x7fae5806d330 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fae780c5ac0 tx=0x7fae60008040 comp rx=0 tx=0).stop 2023-12-12T09:46:32.754 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:32.752+0000 7fae7cfa9640 1 -- 172.21.15.73:0/3068849059 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fae780aab10 msgr2=0x7fae7814dd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:32.754 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:32.752+0000 7fae7cfa9640 1 --2- 172.21.15.73:0/3068849059 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fae780aab10 0x7fae7814dd10 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7fae6800c7c0 tx=0x7fae6800cc80 comp rx=0 tx=0).stop 2023-12-12T09:46:32.754 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:32.752+0000 7fae7cfa9640 1 -- 172.21.15.73:0/3068849059 shutdown_connections 2023-12-12T09:46:32.754 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:32.752+0000 7fae7cfa9640 1 --2- 172.21.15.73:0/3068849059 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fae5806ae70 0x7fae5806d330 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:32.754 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:32.752+0000 7fae7cfa9640 1 --2- 172.21.15.73:0/3068849059 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fae78157ab0 0x7fae7814bbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:32.754 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:32.752+0000 7fae7cfa9640 1 --2- 172.21.15.73:0/3068849059 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fae780ab3f0 0x7fae7814b680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:32.754 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:32.752+0000 7fae7cfa9640 1 --2- 172.21.15.73:0/3068849059 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fae780aab10 0x7fae7814dd10 unknown :-1 s=CLOSED pgs=886 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:32.754 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:32.752+0000 7fae7cfa9640 1 -- 172.21.15.73:0/3068849059 >> 172.21.15.73:0/3068849059 conn(0x7fae780c6380 msgr2=0x7fae780c6760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:46:32.754 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:32.752+0000 7fae7cfa9640 1 -- 172.21.15.73:0/3068849059 shutdown_connections 2023-12-12T09:46:32.755 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:32.752+0000 7fae7cfa9640 1 -- 172.21.15.73:0/3068849059 wait complete. 2023-12-12T09:46:32.772 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-12T09:46:32.983 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:32.981+0000 7f0e3b59e640 1 Processor -- start 2023-12-12T09:46:32.983 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:32.982+0000 7f0e3b59e640 1 -- start start 2023-12-12T09:46:32.985 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:32.983+0000 7f0e3b59e640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f0e3c14fbb0 0x7f0e3c0c09e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:32.985 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:32.983+0000 7f0e3b59e640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f0e3c0c0f20 0x7f0e3c0aae00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:32.985 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:32.983+0000 7f0e3b59e640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0e3c0a9470 0x7f0e3c0ab340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:32.985 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:32.983+0000 7f0e3b59e640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e3c0aa000 con 0x7f0e3c0c0f20 2023-12-12T09:46:32.985 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:32.983+0000 7f0e3b59e640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e3c0c1d40 con 0x7f0e3c14fbb0 2023-12-12T09:46:32.985 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:32.983+0000 7f0e3b59e640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e3c153300 con 0x7f0e3c0a9470 2023-12-12T09:46:32.985 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:32.983+0000 7f0e33fff640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f0e3c0c0f20 0x7f0e3c0aae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:32.985 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:32.983+0000 7f0e33fff640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f0e3c0c0f20 0x7f0e3c0aae00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:55860/0 (socket says 172.21.15.73:55860) 2023-12-12T09:46:32.985 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:32.983+0000 7f0e33fff640 1 -- 172.21.15.73:0/3942809528 learned_addr learned my addr 172.21.15.73:0/3942809528 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:46:32.987 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:32.984+0000 7f0e33fff640 1 -- 172.21.15.73:0/3942809528 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0e3c0a9470 msgr2=0x7f0e3c0ab340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:46:32.987 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:32.984+0000 7f0e3ad9d640 1 --2- 172.21.15.73:0/3942809528 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0e3c0a9470 0x7f0e3c0ab340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:32.987 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:32.984+0000 7f0e3a59c640 1 --2- 172.21.15.73:0/3942809528 >> v2:172.21.15.142:3300/0 conn(0x7f0e3c14fbb0 0x7f0e3c0c09e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:32.987 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:32.984+0000 7f0e33fff640 1 --2- 172.21.15.73:0/3942809528 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0e3c0a9470 0x7f0e3c0ab340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:32.987 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:32.984+0000 7f0e33fff640 1 -- 172.21.15.73:0/3942809528 >> v2:172.21.15.142:3300/0 conn(0x7f0e3c14fbb0 msgr2=0x7f0e3c0c09e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:46:32.987 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:32.984+0000 7f0e33fff640 1 --2- 172.21.15.73:0/3942809528 >> v2:172.21.15.142:3300/0 conn(0x7f0e3c14fbb0 0x7f0e3c0c09e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:32.987 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:32.984+0000 7f0e33fff640 1 -- 172.21.15.73:0/3942809528 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e3c0c2160 con 0x7f0e3c0c0f20 2023-12-12T09:46:32.987 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:32.984+0000 7f0e3a59c640 1 --2- 172.21.15.73:0/3942809528 >> v2:172.21.15.142:3300/0 conn(0x7f0e3c14fbb0 0x7f0e3c0c09e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:46:32.987 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:32.985+0000 7f0e33fff640 1 --2- 172.21.15.73:0/3942809528 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0e3c0c0f20 0x7f0e3c0aae00 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7f0e3c0a9330 tx=0x7f0e2402b890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3622b37067db2ad9 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:46:32.987 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:32.985+0000 7f0e39d9b640 1 -- 172.21.15.73:0/3942809528 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e240317f0 con 0x7f0e3c0c0f20 2023-12-12T09:46:32.987 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:32.985+0000 7f0e39d9b640 1 -- 172.21.15.73:0/3942809528 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e24031950 con 0x7f0e3c0c0f20 2023-12-12T09:46:32.988 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:32.985+0000 7f0e39d9b640 1 -- 172.21.15.73:0/3942809528 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e24031ce0 con 0x7f0e3c0c0f20 2023-12-12T09:46:32.988 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:32.986+0000 7f0e3b59e640 1 -- 172.21.15.73:0/3942809528 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0e3c0c0f20 msgr2=0x7f0e3c0aae00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:32.988 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:32.986+0000 7f0e3b59e640 1 --2- 172.21.15.73:0/3942809528 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0e3c0c0f20 0x7f0e3c0aae00 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7f0e3c0a9330 tx=0x7f0e2402b890 comp rx=0 tx=0).stop 2023-12-12T09:46:32.988 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:32.986+0000 7f0e3b59e640 1 -- 172.21.15.73:0/3942809528 shutdown_connections 2023-12-12T09:46:32.989 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:32.986+0000 7f0e3b59e640 1 --2- 172.21.15.73:0/3942809528 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0e3c0a9470 0x7f0e3c0ab340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:32.989 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:32.986+0000 7f0e3b59e640 1 --2- 172.21.15.73:0/3942809528 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0e3c0c0f20 0x7f0e3c0aae00 unknown :-1 s=CLOSED pgs=887 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:32.989 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:32.986+0000 7f0e3b59e640 1 --2- 172.21.15.73:0/3942809528 >> v2:172.21.15.142:3300/0 conn(0x7f0e3c14fbb0 0x7f0e3c0c09e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:32.989 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:32.986+0000 7f0e3b59e640 1 -- 172.21.15.73:0/3942809528 >> 172.21.15.73:0/3942809528 conn(0x7f0e3c0c23b0 msgr2=0x7f0e3c0c2790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:46:32.989 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:32.986+0000 7f0e3b59e640 1 -- 172.21.15.73:0/3942809528 shutdown_connections 2023-12-12T09:46:32.989 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:32.986+0000 7f0e3b59e640 1 -- 172.21.15.73:0/3942809528 wait complete. 2023-12-12T09:46:32.989 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:32.988+0000 7f0e3b59e640 1 Processor -- start 2023-12-12T09:46:32.990 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:32.988+0000 7f0e3b59e640 1 -- start start 2023-12-12T09:46:32.992 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:32.989+0000 7f0e3b59e640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0e3c0a9470 0x7f0e3c1e7530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:32.992 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:32.989+0000 7f0e3b59e640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0e3c0c0f20 0x7f0e3c155b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:32.992 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:32.989+0000 7f0e3b59e640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0e3c14fbb0 0x7f0e3c14bdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:32.992 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:32.989+0000 7f0e3b59e640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e3c0bcb50 con 0x7f0e3c14fbb0 2023-12-12T09:46:32.992 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:32.989+0000 7f0e3b59e640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e3c06fc20 con 0x7f0e3c0c0f20 2023-12-12T09:46:32.992 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:32.989+0000 7f0e3b59e640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e3c06ff00 con 0x7f0e3c0a9470 2023-12-12T09:46:32.992 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:32.989+0000 7f0e3ad9d640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0e3c14fbb0 0x7f0e3c14bdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:32.993 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:32.989+0000 7f0e3ad9d640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0e3c14fbb0 0x7f0e3c14bdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:55872/0 (socket says 172.21.15.73:55872) 2023-12-12T09:46:32.993 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:32.989+0000 7f0e3ad9d640 1 -- 172.21.15.73:0/482013343 learned_addr learned my addr 172.21.15.73:0/482013343 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:46:32.993 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:32.989+0000 7f0e3a59c640 1 --2- 172.21.15.73:0/482013343 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0e3c0a9470 0x7f0e3c1e7530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:32.993 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:32.989+0000 7f0e3ad9d640 1 -- 172.21.15.73:0/482013343 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0e3c0a9470 msgr2=0x7f0e3c1e7530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:32.993 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:32.989+0000 7f0e3ad9d640 1 --2- 172.21.15.73:0/482013343 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0e3c0a9470 0x7f0e3c1e7530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:32.993 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:32.989+0000 7f0e3ad9d640 1 -- 172.21.15.73:0/482013343 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0e3c0c0f20 msgr2=0x7f0e3c155b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:32.993 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:32.989+0000 7f0e33fff640 1 --2- 172.21.15.73:0/482013343 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0e3c0c0f20 0x7f0e3c155b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:32.993 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:32.989+0000 7f0e3ad9d640 1 --2- 172.21.15.73:0/482013343 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0e3c0c0f20 0x7f0e3c155b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:32.993 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:32.989+0000 7f0e3ad9d640 1 -- 172.21.15.73:0/482013343 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e240094d0 con 0x7f0e3c14fbb0 2023-12-12T09:46:32.993 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:32.990+0000 7f0e3ad9d640 1 --2- 172.21.15.73:0/482013343 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0e3c14fbb0 0x7f0e3c14bdc0 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7f0e3400cb80 tx=0x7f0e3400a4c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:46:32.993 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:32.990+0000 7f0e32ffd640 1 -- 172.21.15.73:0/482013343 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e3400ce70 con 0x7f0e3c14fbb0 2023-12-12T09:46:32.994 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:32.990+0000 7f0e32ffd640 1 -- 172.21.15.73:0/482013343 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e3400abd0 con 0x7f0e3c14fbb0 2023-12-12T09:46:32.994 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:32.990+0000 7f0e32ffd640 1 -- 172.21.15.73:0/482013343 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e34011410 con 0x7f0e3c14fbb0 2023-12-12T09:46:32.994 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:32.990+0000 7f0e3b59e640 1 -- 172.21.15.73:0/482013343 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e3c0701e0 con 0x7f0e3c14fbb0 2023-12-12T09:46:32.994 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:32.990+0000 7f0e3b59e640 1 -- 172.21.15.73:0/482013343 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e3c0707a0 con 0x7f0e3c14fbb0 2023-12-12T09:46:32.995 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:32.991+0000 7f0e3b59e640 1 -- 172.21.15.73:0/482013343 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e3c070990 con 0x7f0e3c14fbb0 2023-12-12T09:46:32.995 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:32.992+0000 7f0e32ffd640 1 -- 172.21.15.73:0/482013343 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f0e34011570 con 0x7f0e3c14fbb0 2023-12-12T09:46:32.995 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:32.993+0000 7f0e32ffd640 1 --2- 172.21.15.73:0/482013343 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f0e1c06f250 0x7f0e1c071710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:32.995 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:32.993+0000 7f0e32ffd640 1 -- 172.21.15.73:0/482013343 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0e34089490 con 0x7f0e3c14fbb0 2023-12-12T09:46:32.995 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:32.993+0000 7f0e3a59c640 1 --2- 172.21.15.73:0/482013343 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f0e1c06f250 0x7f0e1c071710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:32.996 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:32.994+0000 7f0e3a59c640 1 --2- 172.21.15.73:0/482013343 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f0e1c06f250 0x7f0e1c071710 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f0e2c008850 tx=0x7f0e2c008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:46:32.999 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:32.997+0000 7f0e32ffd640 1 -- 172.21.15.73:0/482013343 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f0e34054540 con 0x7f0e3c14fbb0 2023-12-12T09:46:33.223 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:33.221+0000 7f0e3b59e640 1 -- 172.21.15.73:0/482013343 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0e3c067400 con 0x7f0e3c14fbb0 2023-12-12T09:46:33.223 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:33.222+0000 7f0e32ffd640 1 -- 172.21.15.73:0/482013343 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 44 v44) v1 ==== 94+0+4918 (secure 0 0 0) 0x7f0e34057b60 con 0x7f0e3c14fbb0 2023-12-12T09:46:33.224 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-12T09:46:33.224 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":44,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4943,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6835/3004685650","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6833","nonce":3004685650},{"type":"v1","addr":"172.21.15.142:6835","nonce":3004685650}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40},{"gid":5365,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6834/3290362874","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6832","nonce":3290362874},{"type":"v1","addr":"172.21.15.142:6834","nonce":3290362874}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40},{"gid":6426,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6836/340095591","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":340095591},{"type":"v1","addr":"172.21.15.73:6836","nonce":340095591}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40}],"filesystems":[{"mdsmap":{"epoch":44,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-12T09:46:26.429627+0000","modified":"2023-12-12T09:46:29.788335+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6429},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6429":{"gid":6429,"name":"c","rank":0,"incarnation":41,"state":"up:active","state_seq":3,"addr":"172.21.15.73:6837/2352791649","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6835","nonce":2352791649},{"type":"v1","addr":"172.21.15.73:6837","nonce":2352791649}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-12-12T09:46:33.224 INFO:teuthology.orchestra.run.smithi073.stderr:dumped fsmap epoch 44 2023-12-12T09:46:33.226 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:33.224+0000 7f0e3b59e640 1 -- 172.21.15.73:0/482013343 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f0e1c06f250 msgr2=0x7f0e1c071710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:33.226 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:33.224+0000 7f0e3b59e640 1 --2- 172.21.15.73:0/482013343 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f0e1c06f250 0x7f0e1c071710 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f0e2c008850 tx=0x7f0e2c008040 comp rx=0 tx=0).stop 2023-12-12T09:46:33.226 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:33.224+0000 7f0e3b59e640 1 -- 172.21.15.73:0/482013343 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0e3c14fbb0 msgr2=0x7f0e3c14bdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:33.227 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:33.224+0000 7f0e3b59e640 1 --2- 172.21.15.73:0/482013343 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0e3c14fbb0 0x7f0e3c14bdc0 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7f0e3400cb80 tx=0x7f0e3400a4c0 comp rx=0 tx=0).stop 2023-12-12T09:46:33.227 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:33.225+0000 7f0e3b59e640 1 -- 172.21.15.73:0/482013343 shutdown_connections 2023-12-12T09:46:33.227 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:33.225+0000 7f0e3b59e640 1 --2- 172.21.15.73:0/482013343 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f0e1c06f250 0x7f0e1c071710 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:33.227 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:33.225+0000 7f0e3b59e640 1 --2- 172.21.15.73:0/482013343 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0e3c14fbb0 0x7f0e3c14bdc0 unknown :-1 s=CLOSED pgs=888 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:33.227 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:33.225+0000 7f0e3b59e640 1 --2- 172.21.15.73:0/482013343 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0e3c0c0f20 0x7f0e3c155b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:33.227 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:33.225+0000 7f0e3b59e640 1 --2- 172.21.15.73:0/482013343 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0e3c0a9470 0x7f0e3c1e7530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:33.227 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:33.225+0000 7f0e3b59e640 1 -- 172.21.15.73:0/482013343 >> 172.21.15.73:0/482013343 conn(0x7f0e3c0c23b0 msgr2=0x7f0e3c0a6f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:46:33.227 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:33.225+0000 7f0e3b59e640 1 -- 172.21.15.73:0/482013343 shutdown_connections 2023-12-12T09:46:33.227 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:33.225+0000 7f0e3b59e640 1 -- 172.21.15.73:0/482013343 wait complete. 2023-12-12T09:46:33.648 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 44, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-12-12T09:46:26.429627+0000', 'modified': '2023-12-12T09:46:29.788335+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6429}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6429': {'gid': 6429, 'name': 'c', 'rank': 0, 'incarnation': 41, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.73:6837/2352791649', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.73:6835', 'nonce': 2352791649}, {'type': 'v1', 'addr': '172.21.15.73:6837', 'nonce': 2352791649}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [13], 'metadata_pool': 12, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-12-12T09:46:33.649 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-12-12T09:46:33.649 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-12-12T09:46:33.870 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:33.869+0000 7fd1d6a9b640 1 Processor -- start 2023-12-12T09:46:33.871 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:33.869+0000 7fd1d6a9b640 1 -- start start 2023-12-12T09:46:33.872 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:33.871+0000 7fd1d6a9b640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fd1d00c17e0 0x7fd1d0072700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:33.872 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:33.871+0000 7fd1d6a9b640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1d0152560 con 0x7fd1d006fca0 2023-12-12T09:46:33.872 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:33.871+0000 7fd1d6a9b640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1d01532e0 con 0x7fd1d00c0420 2023-12-12T09:46:33.872 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:33.871+0000 7fd1d6a9b640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1d0152ec0 con 0x7fd1d00c17e0 2023-12-12T09:46:33.872 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:33.871+0000 7fd1d4837640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7fd1d006fca0 0x7fd1d00c10d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:55692/0 (socket says 172.21.15.73:55692) 2023-12-12T09:46:33.872 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:33.871+0000 7fd1d4837640 1 -- 172.21.15.73:0/87785181 learned_addr learned my addr 172.21.15.73:0/87785181 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-12T09:46:33.875 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:33.871+0000 7fd1d5038640 1 --2- 172.21.15.73:0/87785181 >> v2:172.21.15.142:3300/0 conn(0x7fd1d00c17e0 0x7fd1d0072700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:33.875 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:33.871+0000 7fd1cf7fe640 1 -- 172.21.15.73:0/87785181 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1383371311 0 0) 0x7fd1d0152560 con 0x7fd1d006fca0 2023-12-12T09:46:33.875 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:33.871+0000 7fd1cf7fe640 1 -- 172.21.15.73:0/87785181 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd1c0003520 con 0x7fd1d006fca0 2023-12-12T09:46:33.875 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:33.872+0000 7fd1cf7fe640 1 -- 172.21.15.73:0/87785181 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 803800654 0 0) 0x7fd1c0003520 con 0x7fd1d006fca0 2023-12-12T09:46:33.875 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:33.872+0000 7fd1cf7fe640 1 -- 172.21.15.73:0/87785181 >> v2:172.21.15.142:3300/0 conn(0x7fd1d00c17e0 msgr2=0x7fd1d0072700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:46:33.875 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:33.872+0000 7fd1cf7fe640 1 --2- 172.21.15.73:0/87785181 >> v2:172.21.15.142:3300/0 conn(0x7fd1d00c17e0 0x7fd1d0072700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:33.875 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:33.872+0000 7fd1cf7fe640 1 -- 172.21.15.73:0/87785181 >> v1:172.21.15.142:6789/0 conn(0x7fd1d00c0420 legacy=0x7fd1d015acc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:33.875 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:33.872+0000 7fd1cf7fe640 1 -- 172.21.15.73:0/87785181 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1d0152800 con 0x7fd1d006fca0 2023-12-12T09:46:33.875 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:33.872+0000 7fd1cf7fe640 1 -- 172.21.15.73:0/87785181 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3186547832 0 0) 0x7fd1c4001670 con 0x7fd1d006fca0 2023-12-12T09:46:33.875 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:33.872+0000 7fd1cf7fe640 1 -- 172.21.15.73:0/87785181 >> v1:172.21.15.73:6789/0 conn(0x7fd1d006fca0 legacy=0x7fd1d00c10d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:33.875 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:33.872+0000 7fd1cf7fe640 1 --2- 172.21.15.73:0/87785181 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd1c00039c0 0x7fd1c0003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:33.875 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:33.872+0000 7fd1cf7fe640 1 --2- 172.21.15.73:0/87785181 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd1c00047c0 0x7fd1c0004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:33.876 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:33.872+0000 7fd1cf7fe640 1 --2- 172.21.15.73:0/87785181 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd1c00051d0 0x7fd1c000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:33.876 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:33.872+0000 7fd1cf7fe640 1 -- 172.21.15.73:0/87785181 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1d0152ec0 con 0x7fd1c00047c0 2023-12-12T09:46:33.876 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:33.872+0000 7fd1cf7fe640 1 -- 172.21.15.73:0/87785181 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1c000c120 con 0x7fd1c00039c0 2023-12-12T09:46:33.876 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:33.872+0000 7fd1cf7fe640 1 -- 172.21.15.73:0/87785181 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1c000c2e0 con 0x7fd1c00051d0 2023-12-12T09:46:33.876 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:33.872+0000 7fd1cffff640 1 --2- 172.21.15.73:0/87785181 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd1c00047c0 0x7fd1c0004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:33.876 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:33.873+0000 7fd1cffff640 1 -- 172.21.15.73:0/87785181 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd1c00051d0 msgr2=0x7fd1c000b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:46:33.876 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:33.873+0000 7fd1cffff640 1 --2- 172.21.15.73:0/87785181 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd1c00051d0 0x7fd1c000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:33.876 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:33.873+0000 7fd1cffff640 1 -- 172.21.15.73:0/87785181 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd1c00039c0 msgr2=0x7fd1c0003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:46:33.876 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:33.873+0000 7fd1cffff640 1 --2- 172.21.15.73:0/87785181 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd1c00039c0 0x7fd1c0003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:33.876 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:33.873+0000 7fd1cffff640 1 -- 172.21.15.73:0/87785181 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1c0003520 con 0x7fd1c00047c0 2023-12-12T09:46:33.876 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:33.873+0000 7fd1d5038640 1 -- 172.21.15.73:0/87785181 reap_dead start 2023-12-12T09:46:33.877 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:33.874+0000 7fd1cffff640 1 --2- 172.21.15.73:0/87785181 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd1c00047c0 0x7fd1c0004c40 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7fd1bc001720 tx=0x7fd1c00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3748447175ea9950 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:46:33.877 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:33.874+0000 7fd1cf7fe640 1 -- 172.21.15.73:0/87785181 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1bc0052d0 con 0x7fd1c00047c0 2023-12-12T09:46:33.877 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:33.874+0000 7fd1cf7fe640 1 -- 172.21.15.73:0/87785181 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1bc02e050 con 0x7fd1c00047c0 2023-12-12T09:46:33.878 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:33.874+0000 7fd1cf7fe640 1 -- 172.21.15.73:0/87785181 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1bc003830 con 0x7fd1c00047c0 2023-12-12T09:46:33.878 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:33.875+0000 7fd1d6a9b640 1 -- 172.21.15.73:0/87785181 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd1c00047c0 msgr2=0x7fd1c0004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:33.878 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:33.875+0000 7fd1d6a9b640 1 --2- 172.21.15.73:0/87785181 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd1c00047c0 0x7fd1c0004c40 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7fd1bc001720 tx=0x7fd1c00057f0 comp rx=0 tx=0).stop 2023-12-12T09:46:33.878 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:33.875+0000 7fd1d6a9b640 1 -- 172.21.15.73:0/87785181 shutdown_connections 2023-12-12T09:46:33.878 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:33.875+0000 7fd1d6a9b640 1 --2- 172.21.15.73:0/87785181 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd1c00047c0 0x7fd1c0004c40 unknown :-1 s=CLOSED pgs=890 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:33.878 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:33.875+0000 7fd1d6a9b640 1 -- 172.21.15.73:0/87785181 >> 172.21.15.73:0/87785181 conn(0x7fd1d00a77d0 msgr2=0x7fd1d00a7bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:46:33.878 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:33.875+0000 7fd1d6a9b640 1 -- 172.21.15.73:0/87785181 shutdown_connections 2023-12-12T09:46:33.878 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:33.875+0000 7fd1d6a9b640 1 -- 172.21.15.73:0/87785181 wait complete. 2023-12-12T09:46:33.879 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:33.877+0000 7fd1d6a9b640 1 Processor -- start 2023-12-12T09:46:33.879 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:33.877+0000 7fd1d6a9b640 1 -- start start 2023-12-12T09:46:33.881 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:33.878+0000 7fd1d6a9b640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd1c00047c0 0x7fd1d0071f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:33.881 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:33.878+0000 7fd1d6a9b640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd1d00ab720 0x7fd1d01ed1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:33.881 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:33.878+0000 7fd1d6a9b640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd1d00a5ec0 0x7fd1d01ed6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:33.881 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:33.878+0000 7fd1d6a9b640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1d0154f10 con 0x7fd1d00a5ec0 2023-12-12T09:46:33.881 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:33.878+0000 7fd1d6a9b640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1d014cc60 con 0x7fd1d00ab720 2023-12-12T09:46:33.881 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:33.878+0000 7fd1d6a9b640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1d01562f0 con 0x7fd1c00047c0 2023-12-12T09:46:33.881 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:33.878+0000 7fd1d5038640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd1d00a5ec0 0x7fd1d01ed6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:33.882 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:33.878+0000 7fd1d5038640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd1d00a5ec0 0x7fd1d01ed6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:55890/0 (socket says 172.21.15.73:55890) 2023-12-12T09:46:33.882 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:33.878+0000 7fd1d5038640 1 -- 172.21.15.73:0/371528449 learned_addr learned my addr 172.21.15.73:0/371528449 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:46:33.882 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:33.878+0000 7fd1cffff640 1 --2- 172.21.15.73:0/371528449 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd1d00ab720 0x7fd1d01ed1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:33.882 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:33.879+0000 7fd1d4837640 1 --2- 172.21.15.73:0/371528449 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd1c00047c0 0x7fd1d0071f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:33.882 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:33.879+0000 7fd1d5038640 1 -- 172.21.15.73:0/371528449 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd1c00047c0 msgr2=0x7fd1d0071f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:33.882 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:33.879+0000 7fd1d5038640 1 --2- 172.21.15.73:0/371528449 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd1c00047c0 0x7fd1d0071f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:33.882 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:33.879+0000 7fd1d5038640 1 -- 172.21.15.73:0/371528449 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd1d00ab720 msgr2=0x7fd1d01ed1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:33.882 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:33.879+0000 7fd1d5038640 1 --2- 172.21.15.73:0/371528449 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd1d00ab720 0x7fd1d01ed1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:33.882 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:33.879+0000 7fd1d5038640 1 -- 172.21.15.73:0/371528449 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1d00aaf60 con 0x7fd1d00a5ec0 2023-12-12T09:46:33.882 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:33.879+0000 7fd1cffff640 1 --2- 172.21.15.73:0/371528449 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd1d00ab720 0x7fd1d01ed1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:46:33.882 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:33.879+0000 7fd1d4837640 1 --2- 172.21.15.73:0/371528449 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd1c00047c0 0x7fd1d0071f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:46:33.882 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:33.879+0000 7fd1d5038640 1 --2- 172.21.15.73:0/371528449 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd1d00a5ec0 0x7fd1d01ed6e0 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7fd1d00c69f0 tx=0x7fd1c800b480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:46:33.883 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:33.879+0000 7fd1cd7fa640 1 -- 172.21.15.73:0/371528449 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1c8010040 con 0x7fd1d00a5ec0 2023-12-12T09:46:33.883 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:33.879+0000 7fd1cd7fa640 1 -- 172.21.15.73:0/371528449 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1c800bc80 con 0x7fd1d00a5ec0 2023-12-12T09:46:33.883 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:33.879+0000 7fd1d6a9b640 1 -- 172.21.15.73:0/371528449 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1d0156520 con 0x7fd1d00a5ec0 2023-12-12T09:46:33.883 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:33.879+0000 7fd1cd7fa640 1 -- 172.21.15.73:0/371528449 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1c8014400 con 0x7fd1d00a5ec0 2023-12-12T09:46:33.883 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:33.880+0000 7fd1d6a9b640 1 -- 172.21.15.73:0/371528449 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1d0156800 con 0x7fd1d00a5ec0 2023-12-12T09:46:33.883 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:33.882+0000 7fd1cd7fa640 1 -- 172.21.15.73:0/371528449 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fd1c8014560 con 0x7fd1d00a5ec0 2023-12-12T09:46:33.884 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:33.883+0000 7fd1cd7fa640 1 --2- 172.21.15.73:0/371528449 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fd1b406ae40 0x7fd1b406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:33.885 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:33.883+0000 7fd1cd7fa640 1 -- 172.21.15.73:0/371528449 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd1c8089c70 con 0x7fd1d00a5ec0 2023-12-12T09:46:33.885 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:33.883+0000 7fd1d4837640 1 --2- 172.21.15.73:0/371528449 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fd1b406ae40 0x7fd1b406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:33.885 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:33.884+0000 7fd1d9632740 1 Processor -- start 2023-12-12T09:46:33.885 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:33.884+0000 7fd1d9632740 1 -- start start 2023-12-12T09:46:33.885 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:33.884+0000 7fd1d4837640 1 --2- 172.21.15.73:0/371528449 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fd1b406ae40 0x7fd1b406d300 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fd1d0067ab0 tx=0x7fd1c4009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:46:33.887 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:33.885+0000 7fd1d9632740 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55b1d871aab0 0x55b1d87553a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:33.887 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:33.885+0000 7fd1d9632740 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b1d871ae90 0x55b1d87558e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:33.887 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:33.885+0000 7fd1d9632740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b1d871bb40 0x55b1d8756910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:33.887 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:33.885+0000 7fd1d9632740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b1d8687f40 con 0x55b1d871bb40 2023-12-12T09:46:33.888 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:33.885+0000 7fd1d9632740 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b1d8685630 con 0x55b1d871ae90 2023-12-12T09:46:33.888 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:33.885+0000 7fd1d9632740 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x55b1d8680f20 con 0x55b1d871aab0 2023-12-12T09:46:33.888 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:33.885+0000 7fd1d5038640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b1d871bb40 0x55b1d8756910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:33.888 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:33.885+0000 7fd1d5038640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b1d871bb40 0x55b1d8756910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:55894/0 (socket says 172.21.15.73:55894) 2023-12-12T09:46:33.888 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:33.885+0000 7fd1d5038640 1 -- 172.21.15.73:0/2215519966 learned_addr learned my addr 172.21.15.73:0/2215519966 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:46:33.888 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:33.885+0000 7fd1cffff640 1 --2- 172.21.15.73:0/2215519966 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b1d871ae90 0x55b1d87558e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:33.888 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:33.885+0000 7fd1d4837640 1 --2- 172.21.15.73:0/2215519966 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55b1d871aab0 0x55b1d87553a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:33.888 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:33.886+0000 7fd1d5038640 1 -- 172.21.15.73:0/2215519966 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55b1d871aab0 msgr2=0x55b1d87553a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:46:33.888 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:33.886+0000 7fd1d5038640 1 --2- 172.21.15.73:0/2215519966 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55b1d871aab0 0x55b1d87553a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:33.888 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:33.886+0000 7fd1d5038640 1 -- 172.21.15.73:0/2215519966 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b1d871ae90 msgr2=0x55b1d87558e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:46:33.888 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:33.886+0000 7fd1d5038640 1 --2- 172.21.15.73:0/2215519966 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b1d871ae90 0x55b1d87558e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:33.888 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:33.886+0000 7fd1d5038640 1 -- 172.21.15.73:0/2215519966 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b1d8643910 con 0x55b1d871bb40 2023-12-12T09:46:33.888 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:33.886+0000 7fd1cffff640 1 --2- 172.21.15.73:0/2215519966 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b1d871ae90 0x55b1d87558e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:46:33.888 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:33.886+0000 7fd1d5038640 1 --2- 172.21.15.73:0/2215519966 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b1d871bb40 0x55b1d8756910 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7fd1c8002230 tx=0x7fd1c8059100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf0682752ca6f9aa server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:46:33.889 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:33.886+0000 7fd1ba7fc640 1 -- 172.21.15.73:0/2215519966 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1c8060c40 con 0x55b1d871bb40 2023-12-12T09:46:33.889 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:33.886+0000 7fd1ba7fc640 1 -- 172.21.15.73:0/2215519966 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1c8056ce0 con 0x55b1d871bb40 2023-12-12T09:46:33.889 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:33.886+0000 7fd1ba7fc640 1 -- 172.21.15.73:0/2215519966 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1c8055050 con 0x55b1d871bb40 2023-12-12T09:46:33.890 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:33.887+0000 7fd1d9632740 1 -- 172.21.15.73:0/2215519966 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b1d871bb40 msgr2=0x55b1d8756910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:33.890 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:33.887+0000 7fd1d9632740 1 --2- 172.21.15.73:0/2215519966 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b1d871bb40 0x55b1d8756910 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7fd1c8002230 tx=0x7fd1c8059100 comp rx=0 tx=0).stop 2023-12-12T09:46:33.890 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:33.887+0000 7fd1d9632740 1 -- 172.21.15.73:0/2215519966 shutdown_connections 2023-12-12T09:46:33.890 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:33.887+0000 7fd1d9632740 1 --2- 172.21.15.73:0/2215519966 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b1d871bb40 0x55b1d8756910 unknown :-1 s=CLOSED pgs=892 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:33.890 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:33.887+0000 7fd1d9632740 1 --2- 172.21.15.73:0/2215519966 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b1d871ae90 0x55b1d87558e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:33.890 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:33.887+0000 7fd1d9632740 1 --2- 172.21.15.73:0/2215519966 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55b1d871aab0 0x55b1d87553a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:33.890 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:33.887+0000 7fd1d9632740 1 -- 172.21.15.73:0/2215519966 >> 172.21.15.73:0/2215519966 conn(0x55b1d8717410 msgr2=0x55b1d873bb90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:46:33.890 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:33.887+0000 7fd1d9632740 1 -- 172.21.15.73:0/2215519966 shutdown_connections 2023-12-12T09:46:33.890 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:33.887+0000 7fd1d9632740 1 -- 172.21.15.73:0/2215519966 wait complete. 2023-12-12T09:46:33.890 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:33.888+0000 7fd1d9632740 1 -- start start 2023-12-12T09:46:33.890 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:33.888+0000 7fd1d9632740 1 Processor -- start 2023-12-12T09:46:33.893 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:33.889+0000 7fd1d9632740 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b1d871ae90 0x55b1d873a1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:33.894 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:33.889+0000 7fd1d9632740 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55b1d871bb40 0x55b1d873aa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:33.894 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:33.889+0000 7fd1d9632740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b1d873d4b0 0x55b1d873f170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:33.894 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:33.889+0000 7fd1d9632740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b1d861d2f0 con 0x55b1d873d4b0 2023-12-12T09:46:33.894 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:33.889+0000 7fd1d9632740 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b1d863ac70 con 0x55b1d871ae90 2023-12-12T09:46:33.894 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:33.889+0000 7fd1d9632740 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x55b1d83e3f20 con 0x55b1d871bb40 2023-12-12T09:46:33.894 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:33.889+0000 7fd1d9632740 10 client.0 _ll_register_callbacks cb 0x55b1d863f3b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-12T09:46:33.894 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:33.889+0000 7fd1d5038640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b1d873d4b0 0x55b1d873f170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:33.894 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:33.889+0000 7fd1d5038640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b1d873d4b0 0x55b1d873f170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:55898/0 (socket says 172.21.15.73:55898) 2023-12-12T09:46:33.894 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:33.889+0000 7fd1d5038640 1 -- 172.21.15.73:0/2636569653 learned_addr learned my addr 172.21.15.73:0/2636569653 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:46:33.894 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:33.889+0000 7fd1cffff640 1 --2- 172.21.15.73:0/2636569653 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55b1d871bb40 0x55b1d873aa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:33.894 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:33.889+0000 7fd1d5038640 1 -- 172.21.15.73:0/2636569653 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55b1d871bb40 msgr2=0x55b1d873aa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:46:33.894 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:33.889+0000 7fd1d4837640 1 --2- 172.21.15.73:0/2636569653 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b1d871ae90 0x55b1d873a1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:33.895 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:33.889+0000 7fd1d5038640 1 --2- 172.21.15.73:0/2636569653 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55b1d871bb40 0x55b1d873aa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:33.895 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:33.890+0000 7fd1d5038640 1 -- 172.21.15.73:0/2636569653 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b1d871ae90 msgr2=0x55b1d873a1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:46:33.895 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:33.890+0000 7fd1d5038640 1 --2- 172.21.15.73:0/2636569653 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b1d871ae90 0x55b1d873a1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:33.895 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:33.890+0000 7fd1d5038640 1 -- 172.21.15.73:0/2636569653 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1d0156800 con 0x55b1d873d4b0 2023-12-12T09:46:33.895 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:33.890+0000 7fd1cffff640 1 --2- 172.21.15.73:0/2636569653 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55b1d871bb40 0x55b1d873aa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:46:33.895 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:33.890+0000 7fd1d4837640 1 --2- 172.21.15.73:0/2636569653 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b1d871ae90 0x55b1d873a1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:46:33.895 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:33.890+0000 7fd1d5038640 1 --2- 172.21.15.73:0/2636569653 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b1d873d4b0 0x55b1d873f170 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7fd1c80591f0 tx=0x7fd1c8021040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c6256010670c4a6 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:46:33.895 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:33.890+0000 7fd1af7fe640 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2023-12-12T09:46:33.895 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:33.890+0000 7fd1af7fe640 1 -- 172.21.15.73:0/2636569653 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1c8058030 con 0x55b1d873d4b0 2023-12-12T09:46:33.895 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:33.890+0000 7fd1af7fe640 1 -- 172.21.15.73:0/2636569653 <== mon.0 v2:172.21.15.73:3300/0 2 ==== osd_map(75..75 src has 1..75) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd1c8076030 con 0x55b1d873d4b0 2023-12-12T09:46:33.895 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:33.890+0000 7fd1d9632740 1 -- 172.21.15.73:0/2636569653 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55b1d8679db0 con 0x55b1d873d4b0 2023-12-12T09:46:33.895 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:33.890+0000 7fd1af7fe640 1 -- 172.21.15.73:0/2636569653 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=44) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd1c8060c40 con 0x55b1d873d4b0 2023-12-12T09:46:33.895 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:33.890+0000 7fd1d9632740 10 client.6579 fetch_fsmap learned FSMap version 44 2023-12-12T09:46:33.895 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:33.890+0000 7fd1d9632740 1 -- 172.21.15.73:0/2636569653 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=44,monmap=2+}) v3 -- 0x55b1d867f5a0 con 0x55b1d873d4b0 2023-12-12T09:46:33.895 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:33.890+0000 7fd1af7fe640 1 -- 172.21.15.73:0/2636569653 <== mon.0 v2:172.21.15.73:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55b1d8679db0 con 0x55b1d873d4b0 2023-12-12T09:46:33.896 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:33.891+0000 7fd1af7fe640 1 -- 172.21.15.73:0/2636569653 <== mon.0 v2:172.21.15.73:3300/0 5 ==== fsmap(e 44) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fd1c80607b0 con 0x55b1d873d4b0 2023-12-12T09:46:33.896 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:33.891+0000 7fd1d9632740 10 client.6579 fetch_fsmap finished waiting for FSMap version 44 2023-12-12T09:46:33.896 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:33.891+0000 7fd1d9632740 10 client.6579 resolve_mds: resolved name 'c' to daemon mds.c 2023-12-12T09:46:33.896 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:33.891+0000 7fd1d9632740 20 client.6579 populate_metadata read hostname 'smithi073' 2023-12-12T09:46:33.896 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:33.891+0000 7fd1d9632740 1 --2- 172.21.15.73:0/2636569653 >> [v2:172.21.15.73:6835/2352791649,v1:172.21.15.73:6837/2352791649] conn(0x55b1d876a090 0x55b1d876a470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:33.896 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:33.891+0000 7fd1d9632740 4 client.6579 mds_command: new command op to 6429 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-12-12T09:46:33.896 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:33.891+0000 7fd1d9632740 1 -- 172.21.15.73:0/2636569653 --> [v2:172.21.15.73:6835/2352791649,v1:172.21.15.73:6837/2352791649] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55b1d8679ad0 con 0x55b1d876a090 2023-12-12T09:46:33.896 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:33.891+0000 7fd1d4837640 1 --2- 172.21.15.73:0/2636569653 >> [v2:172.21.15.73:6835/2352791649,v1:172.21.15.73:6837/2352791649] conn(0x55b1d876a090 0x55b1d876a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:33.896 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:33.891+0000 7fd1d4837640 1 --2- 172.21.15.73:0/2636569653 >> [v2:172.21.15.73:6835/2352791649,v1:172.21.15.73:6837/2352791649] conn(0x55b1d876a090 0x55b1d876a470 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=332c068452106797 server_cookie=3977626db3e17c0b in_seq=0 out_seq=0 2023-12-12T09:46:33.896 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:33.891+0000 7fd1af7fe640 10 client.6579 ms_handle_connect on v2:172.21.15.73:6835/2352791649 2023-12-12T09:46:33.896 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:33.892+0000 7fd1af7fe640 1 -- 172.21.15.73:0/2636569653 <== mds.0 v2:172.21.15.73:6835/2352791649 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55b1d8679ad0 con 0x55b1d876a090 2023-12-12T09:46:33.896 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:33.892+0000 7fd1af7fe640 10 client.6579 handle_command_reply: tid=0 2023-12-12T09:46:33.896 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:33.892+0000 7fd1d9632740 1 client.6579 shutdown 2023-12-12T09:46:33.897 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:33.892+0000 7fd1d9632740 1 -- 172.21.15.73:0/2636569653 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b1d873d4b0 msgr2=0x55b1d873f170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:33.897 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:33.892+0000 7fd1d9632740 1 --2- 172.21.15.73:0/2636569653 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b1d873d4b0 0x55b1d873f170 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7fd1c80591f0 tx=0x7fd1c8021040 comp rx=0 tx=0).stop 2023-12-12T09:46:33.897 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:33.893+0000 7fd1d9632740 1 -- 172.21.15.73:0/2636569653 shutdown_connections 2023-12-12T09:46:33.897 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:33.893+0000 7fd1d9632740 1 --2- 172.21.15.73:0/2636569653 >> [v2:172.21.15.73:6835/2352791649,v1:172.21.15.73:6837/2352791649] conn(0x55b1d876a090 0x55b1d876a470 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:33.898 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:33.893+0000 7fd1d9632740 1 --2- 172.21.15.73:0/2636569653 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b1d873d4b0 0x55b1d873f170 unknown :-1 s=CLOSED pgs=893 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:33.898 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:33.893+0000 7fd1d9632740 1 --2- 172.21.15.73:0/2636569653 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55b1d871bb40 0x55b1d873aa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:33.898 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:33.893+0000 7fd1d9632740 1 --2- 172.21.15.73:0/2636569653 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b1d871ae90 0x55b1d873a1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:33.898 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:33.893+0000 7fd1af7fe640 0 client.6579 ms_handle_reset on v2:172.21.15.73:6835/2352791649 2023-12-12T09:46:33.898 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:33.893+0000 7fd1d9632740 1 -- 172.21.15.73:0/2636569653 >> 172.21.15.73:0/2636569653 conn(0x55b1d871aab0 msgr2=0x55b1d87584d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:46:33.898 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:33.893+0000 7fd1d9632740 1 -- 172.21.15.73:0/2636569653 shutdown_connections 2023-12-12T09:46:33.898 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:33.893+0000 7fd1d9632740 1 -- 172.21.15.73:0/2636569653 wait complete. 2023-12-12T09:46:33.898 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:33.893+0000 7fd1d9632740 20 client.6579 trim_cache size 0 max 16384 2023-12-12T09:46:33.911 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:33.910+0000 7fd1d9632740 1 Processor -- start 2023-12-12T09:46:33.911 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:33.910+0000 7fd1d9632740 1 -- start start 2023-12-12T09:46:33.912 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:33.911+0000 7fd1d9632740 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55b1d871ae90 0x55b1d87796f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:33.912 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:33.911+0000 7fd1d9632740 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b1d871bb40 0x55b1d87550c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:33.912 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:33.911+0000 7fd1d9632740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b1d873d4b0 0x55b1d8755600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:33.912 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:33.911+0000 7fd1d9632740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b1d8754be0 con 0x55b1d873d4b0 2023-12-12T09:46:33.912 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:33.911+0000 7fd1d9632740 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b1d873a280 con 0x55b1d871bb40 2023-12-12T09:46:33.912 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:33.911+0000 7fd1d9632740 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x55b1d871a380 con 0x55b1d871ae90 2023-12-12T09:46:33.914 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:33.911+0000 7fd1d5038640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b1d873d4b0 0x55b1d8755600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:33.914 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:33.911+0000 7fd1d5038640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b1d873d4b0 0x55b1d8755600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:55902/0 (socket says 172.21.15.73:55902) 2023-12-12T09:46:33.914 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:33.911+0000 7fd1d5038640 1 -- 172.21.15.73:0/3459768010 learned_addr learned my addr 172.21.15.73:0/3459768010 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:46:33.914 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:33.911+0000 7fd1d4837640 1 --2- 172.21.15.73:0/3459768010 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55b1d871ae90 0x55b1d87796f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:33.914 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:33.911+0000 7fd1cffff640 1 --2- 172.21.15.73:0/3459768010 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b1d871bb40 0x55b1d87550c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:33.915 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:33.912+0000 7fd1d5038640 1 -- 172.21.15.73:0/3459768010 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55b1d871ae90 msgr2=0x55b1d87796f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:46:33.915 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:33.912+0000 7fd1d5038640 1 --2- 172.21.15.73:0/3459768010 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55b1d871ae90 0x55b1d87796f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:33.915 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:33.912+0000 7fd1d5038640 1 -- 172.21.15.73:0/3459768010 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b1d871bb40 msgr2=0x55b1d87550c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:46:33.915 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:33.912+0000 7fd1d5038640 1 --2- 172.21.15.73:0/3459768010 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b1d871bb40 0x55b1d87550c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:33.915 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:33.912+0000 7fd1d5038640 1 -- 172.21.15.73:0/3459768010 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b1d861cb80 con 0x55b1d873d4b0 2023-12-12T09:46:33.915 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:33.912+0000 7fd1d4837640 1 --2- 172.21.15.73:0/3459768010 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55b1d871ae90 0x55b1d87796f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:46:33.915 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:33.912+0000 7fd1cffff640 1 --2- 172.21.15.73:0/3459768010 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b1d871bb40 0x55b1d87550c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:46:33.915 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:33.912+0000 7fd1d5038640 1 --2- 172.21.15.73:0/3459768010 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b1d873d4b0 0x55b1d8755600 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7fd1c8060710 tx=0x7fd1c8087000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d65e35a5acb2e05d server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:46:33.915 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:33.912+0000 7fd1baffd640 1 -- 172.21.15.73:0/3459768010 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1c8060c40 con 0x55b1d873d4b0 2023-12-12T09:46:33.915 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:33.912+0000 7fd1baffd640 1 -- 172.21.15.73:0/3459768010 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1c8060e90 con 0x55b1d873d4b0 2023-12-12T09:46:33.915 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:33.912+0000 7fd1baffd640 1 -- 172.21.15.73:0/3459768010 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1c8057e30 con 0x55b1d873d4b0 2023-12-12T09:46:33.915 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:33.913+0000 7fd1d9632740 1 -- 172.21.15.73:0/3459768010 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b1d873d4b0 msgr2=0x55b1d8755600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:33.916 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:33.913+0000 7fd1d9632740 1 --2- 172.21.15.73:0/3459768010 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b1d873d4b0 0x55b1d8755600 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7fd1c8060710 tx=0x7fd1c8087000 comp rx=0 tx=0).stop 2023-12-12T09:46:33.916 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:33.913+0000 7fd1d9632740 1 -- 172.21.15.73:0/3459768010 shutdown_connections 2023-12-12T09:46:33.916 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:33.913+0000 7fd1d9632740 1 --2- 172.21.15.73:0/3459768010 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b1d873d4b0 0x55b1d8755600 unknown :-1 s=CLOSED pgs=894 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:33.916 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:33.913+0000 7fd1d9632740 1 --2- 172.21.15.73:0/3459768010 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b1d871bb40 0x55b1d87550c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:33.916 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:33.913+0000 7fd1d9632740 1 --2- 172.21.15.73:0/3459768010 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55b1d871ae90 0x55b1d87796f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:33.916 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:33.913+0000 7fd1d9632740 1 -- 172.21.15.73:0/3459768010 >> 172.21.15.73:0/3459768010 conn(0x55b1d871aab0 msgr2=0x55b1d875be00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:46:33.916 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:33.913+0000 7fd1d9632740 1 -- 172.21.15.73:0/3459768010 shutdown_connections 2023-12-12T09:46:33.916 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:33.913+0000 7fd1d9632740 1 -- 172.21.15.73:0/3459768010 wait complete. 2023-12-12T09:46:33.920 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:33.914+0000 7fd1d9632740 1 -- start start 2023-12-12T09:46:33.920 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:33.914+0000 7fd1d9632740 1 Processor -- start 2023-12-12T09:46:33.920 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:33.915+0000 7fd1d9632740 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55b1d871ae90 0x55b1d8755420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:33.920 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:33.915+0000 7fd1d9632740 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b1d871bb40 0x55b1d87bd940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:33.920 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:33.915+0000 7fd1d9632740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b1d873d4b0 0x55b1d87bde80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:33.920 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:33.915+0000 7fd1d9632740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b1d8716670 con 0x55b1d873d4b0 2023-12-12T09:46:33.920 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:33.915+0000 7fd1d9632740 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b1d87c47a0 con 0x55b1d871bb40 2023-12-12T09:46:33.920 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:33.915+0000 7fd1d9632740 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x55b1d875c720 con 0x55b1d871ae90 2023-12-12T09:46:33.920 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:33.915+0000 7fd1d9632740 10 client.0 _ll_register_callbacks cb 0x7fd1c8084070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-12T09:46:33.921 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:33.915+0000 7fd1d5038640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b1d873d4b0 0x55b1d87bde80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:33.921 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:33.915+0000 7fd1d5038640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b1d873d4b0 0x55b1d87bde80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:55918/0 (socket says 172.21.15.73:55918) 2023-12-12T09:46:33.921 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:33.915+0000 7fd1d5038640 1 -- 172.21.15.73:0/1298068823 learned_addr learned my addr 172.21.15.73:0/1298068823 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:46:33.921 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:33.915+0000 7fd1cffff640 1 --2- 172.21.15.73:0/1298068823 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b1d871bb40 0x55b1d87bd940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:33.921 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:33.915+0000 7fd1d4837640 1 --2- 172.21.15.73:0/1298068823 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55b1d871ae90 0x55b1d8755420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:33.921 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:33.916+0000 7fd1d5038640 1 -- 172.21.15.73:0/1298068823 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55b1d871ae90 msgr2=0x55b1d8755420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:46:33.921 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:33.916+0000 7fd1d5038640 1 --2- 172.21.15.73:0/1298068823 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55b1d871ae90 0x55b1d8755420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:33.921 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:33.916+0000 7fd1d5038640 1 -- 172.21.15.73:0/1298068823 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b1d871bb40 msgr2=0x55b1d87bd940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:46:33.921 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:33.916+0000 7fd1d5038640 1 --2- 172.21.15.73:0/1298068823 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b1d871bb40 0x55b1d87bd940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:33.921 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:33.916+0000 7fd1d5038640 1 -- 172.21.15.73:0/1298068823 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55b1d867f5a0 con 0x55b1d873d4b0 2023-12-12T09:46:33.921 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:33.916+0000 7fd1d5038640 1 --2- 172.21.15.73:0/1298068823 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b1d873d4b0 0x55b1d87bde80 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7fd1c8058640 tx=0x7fd1c8054db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=583fa225125f2ed0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:46:33.921 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:33.916+0000 7fd1af7fe640 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2023-12-12T09:46:33.921 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:33.916+0000 7fd1af7fe640 1 -- 172.21.15.73:0/1298068823 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1c8058030 con 0x55b1d873d4b0 2023-12-12T09:46:33.922 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:33.916+0000 7fd1af7fe640 1 -- 172.21.15.73:0/1298068823 <== mon.0 v2:172.21.15.73:3300/0 2 ==== osd_map(75..75 src has 1..75) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd1c8076040 con 0x55b1d873d4b0 2023-12-12T09:46:33.922 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:33.916+0000 7fd1d9632740 1 -- 172.21.15.73:0/1298068823 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fd1c8056ce0 con 0x55b1d873d4b0 2023-12-12T09:46:33.922 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:33.916+0000 7fd1af7fe640 1 -- 172.21.15.73:0/1298068823 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=44) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd1c8058710 con 0x55b1d873d4b0 2023-12-12T09:46:33.922 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:33.916+0000 7fd1d9632740 10 client.6585 fetch_fsmap learned FSMap version 44 2023-12-12T09:46:33.922 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:33.916+0000 7fd1d9632740 1 -- 172.21.15.73:0/1298068823 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=44,monmap=2+}) v3 -- 0x55b1d8642170 con 0x55b1d873d4b0 2023-12-12T09:46:33.922 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:33.917+0000 7fd1af7fe640 1 -- 172.21.15.73:0/1298068823 <== mon.0 v2:172.21.15.73:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1c8056ce0 con 0x55b1d873d4b0 2023-12-12T09:46:33.922 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:33.917+0000 7fd1af7fe640 1 -- 172.21.15.73:0/1298068823 <== mon.0 v2:172.21.15.73:3300/0 5 ==== fsmap(e 44) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fd1c8067070 con 0x55b1d873d4b0 2023-12-12T09:46:33.922 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:33.917+0000 7fd1d9632740 10 client.6585 fetch_fsmap finished waiting for FSMap version 44 2023-12-12T09:46:33.922 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:33.917+0000 7fd1d9632740 10 client.6585 resolve_mds: resolved name 'c' to daemon mds.c 2023-12-12T09:46:33.922 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:33.917+0000 7fd1d9632740 20 client.6585 populate_metadata read hostname 'smithi073' 2023-12-12T09:46:33.922 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:33.917+0000 7fd1d9632740 1 --2- 172.21.15.73:0/1298068823 >> [v2:172.21.15.73:6835/2352791649,v1:172.21.15.73:6837/2352791649] conn(0x55b1d87c3bb0 0x55b1d87c3f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:33.922 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:33.917+0000 7fd1d9632740 4 client.6585 mds_command: new command op to 6429 tid=0 multi_id=0 [{"prefix": "status"}] 2023-12-12T09:46:33.922 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:33.917+0000 7fd1d9632740 1 -- 172.21.15.73:0/1298068823 --> [v2:172.21.15.73:6835/2352791649,v1:172.21.15.73:6837/2352791649] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55b1d83816c0 con 0x55b1d87c3bb0 2023-12-12T09:46:33.922 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:33.917+0000 7fd1d4837640 1 --2- 172.21.15.73:0/1298068823 >> [v2:172.21.15.73:6835/2352791649,v1:172.21.15.73:6837/2352791649] conn(0x55b1d87c3bb0 0x55b1d87c3f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:33.923 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:33.917+0000 7fd1af7fe640 10 client.6585 ms_handle_connect on v2:172.21.15.73:6835/2352791649 2023-12-12T09:46:33.923 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:33.917+0000 7fd1d4837640 1 --2- 172.21.15.73:0/1298068823 >> [v2:172.21.15.73:6835/2352791649,v1:172.21.15.73:6837/2352791649] conn(0x55b1d87c3bb0 0x55b1d87c3f90 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c5d581f2f13a44a9 server_cookie=951a042e69ab656d in_seq=0 out_seq=0 2023-12-12T09:46:33.923 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:33.918+0000 7fd1af7fe640 1 -- 172.21.15.73:0/1298068823 <== mds.0 v2:172.21.15.73:6835/2352791649 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x55b1d83816c0 con 0x55b1d87c3bb0 2023-12-12T09:46:33.923 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:33.918+0000 7fd1af7fe640 10 client.6585 handle_command_reply: tid=0 2023-12-12T09:46:33.923 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:33.918+0000 7fd1d9632740 1 client.6585 shutdown 2023-12-12T09:46:33.923 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:33.918+0000 7fd1d9632740 1 -- 172.21.15.73:0/1298068823 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b1d873d4b0 msgr2=0x55b1d87bde80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:33.923 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:33.918+0000 7fd1d9632740 1 --2- 172.21.15.73:0/1298068823 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b1d873d4b0 0x55b1d87bde80 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7fd1c8058640 tx=0x7fd1c8054db0 comp rx=0 tx=0).stop 2023-12-12T09:46:33.923 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:33.918+0000 7fd1d9632740 1 -- 172.21.15.73:0/1298068823 shutdown_connections 2023-12-12T09:46:33.923 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:33.918+0000 7fd1d9632740 1 --2- 172.21.15.73:0/1298068823 >> [v2:172.21.15.73:6835/2352791649,v1:172.21.15.73:6837/2352791649] conn(0x55b1d87c3bb0 0x55b1d87c3f90 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:33.923 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:33.918+0000 7fd1d9632740 1 --2- 172.21.15.73:0/1298068823 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b1d873d4b0 0x55b1d87bde80 unknown :-1 s=CLOSED pgs=895 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:33.923 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:33.918+0000 7fd1d9632740 1 --2- 172.21.15.73:0/1298068823 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b1d871bb40 0x55b1d87bd940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:33.923 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:33.918+0000 7fd1d9632740 1 --2- 172.21.15.73:0/1298068823 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55b1d871ae90 0x55b1d8755420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:33.923 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:33.918+0000 7fd1af7fe640 0 client.6585 ms_handle_reset on v2:172.21.15.73:6835/2352791649 2023-12-12T09:46:33.923 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:33.918+0000 7fd1d9632740 1 -- 172.21.15.73:0/1298068823 >> 172.21.15.73:0/1298068823 conn(0x55b1d871aab0 msgr2=0x55b1d873a600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:46:33.924 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:33.918+0000 7fd1d9632740 1 -- 172.21.15.73:0/1298068823 shutdown_connections 2023-12-12T09:46:33.924 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:33.918+0000 7fd1d9632740 1 -- 172.21.15.73:0/1298068823 wait complete. 2023-12-12T09:46:33.924 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:33.918+0000 7fd1d9632740 20 client.6585 trim_cache size 0 max 16384 2023-12-12T09:46:33.924 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2023-12-12T09:46:33.924 INFO:teuthology.orchestra.run.smithi073.stdout: "cluster_fsid": "ba240992-02b8-4c7e-92f2-27eb29ac433b", 2023-12-12T09:46:33.924 INFO:teuthology.orchestra.run.smithi073.stdout: "whoami": 0, 2023-12-12T09:46:33.924 INFO:teuthology.orchestra.run.smithi073.stdout: "id": 6429, 2023-12-12T09:46:33.924 INFO:teuthology.orchestra.run.smithi073.stdout: "want_state": "up:active", 2023-12-12T09:46:33.924 INFO:teuthology.orchestra.run.smithi073.stdout: "state": "up:active", 2023-12-12T09:46:33.924 INFO:teuthology.orchestra.run.smithi073.stdout: "fs_name": "cephfs", 2023-12-12T09:46:33.925 INFO:teuthology.orchestra.run.smithi073.stdout: "rank_uptime": 6.9377211919999997, 2023-12-12T09:46:33.925 INFO:teuthology.orchestra.run.smithi073.stdout: "mdsmap_epoch": 44, 2023-12-12T09:46:33.925 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap_epoch": 75, 2023-12-12T09:46:33.925 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap_epoch_barrier": 75, 2023-12-12T09:46:33.925 INFO:teuthology.orchestra.run.smithi073.stdout: "uptime": 13.480703096999999 2023-12-12T09:46:33.925 INFO:teuthology.orchestra.run.smithi073.stdout:} 2023-12-12T09:46:33.926 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:33.919+0000 7fd1d6a9b640 1 -- 172.21.15.73:0/371528449 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fd1b406ae40 msgr2=0x7fd1b406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:33.926 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:33.919+0000 7fd1d6a9b640 1 --2- 172.21.15.73:0/371528449 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fd1b406ae40 0x7fd1b406d300 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fd1d0067ab0 tx=0x7fd1c4009040 comp rx=0 tx=0).stop 2023-12-12T09:46:33.926 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:33.919+0000 7fd1d6a9b640 1 -- 172.21.15.73:0/371528449 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd1d00a5ec0 msgr2=0x7fd1d01ed6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:33.926 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:33.919+0000 7fd1d6a9b640 1 --2- 172.21.15.73:0/371528449 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd1d00a5ec0 0x7fd1d01ed6e0 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7fd1d00c69f0 tx=0x7fd1c800b480 comp rx=0 tx=0).stop 2023-12-12T09:46:33.926 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:33.919+0000 7fd1d6a9b640 1 -- 172.21.15.73:0/371528449 shutdown_connections 2023-12-12T09:46:33.926 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:33.919+0000 7fd1d6a9b640 1 --2- 172.21.15.73:0/371528449 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fd1b406ae40 0x7fd1b406d300 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:33.926 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:33.919+0000 7fd1d6a9b640 1 --2- 172.21.15.73:0/371528449 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd1d00a5ec0 0x7fd1d01ed6e0 unknown :-1 s=CLOSED pgs=891 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:33.926 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:33.919+0000 7fd1d6a9b640 1 --2- 172.21.15.73:0/371528449 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd1d00ab720 0x7fd1d01ed1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:33.926 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:33.919+0000 7fd1d6a9b640 1 --2- 172.21.15.73:0/371528449 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd1c00047c0 0x7fd1d0071f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:33.926 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:33.919+0000 7fd1d6a9b640 1 -- 172.21.15.73:0/371528449 >> 172.21.15.73:0/371528449 conn(0x7fd1d00a77d0 msgr2=0x7fd1d006dce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:46:33.926 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:33.919+0000 7fd1d6a9b640 1 -- 172.21.15.73:0/371528449 shutdown_connections 2023-12-12T09:46:33.926 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:33.919+0000 7fd1d6a9b640 1 -- 172.21.15.73:0/371528449 wait complete. 2023-12-12T09:46:33.937 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-12-12T09:46:34.141 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:34.139+0000 7fb5a5b9e640 1 Processor -- start 2023-12-12T09:46:34.141 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:34.140+0000 7fb5a5b9e640 1 -- start start 2023-12-12T09:46:34.142 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:34.141+0000 7fb5a5b9e640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb5a00aa500 0x7fb5a0151cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:34.142 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:34.141+0000 7fb5a5b9e640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5a01521f0 con 0x7fb5a014e700 2023-12-12T09:46:34.142 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:34.141+0000 7fb5a5b9e640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5a00ab2d0 con 0x7fb5a00c37b0 2023-12-12T09:46:34.142 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:34.141+0000 7fb5a5b9e640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5a006bb10 con 0x7fb5a00aa500 2023-12-12T09:46:34.142 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:34.141+0000 7fb5a4b9c640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7fb5a014e700 0x7fb5a00c02b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:55706/0 (socket says 172.21.15.73:55706) 2023-12-12T09:46:34.143 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:34.141+0000 7fb5a4b9c640 1 -- 172.21.15.73:0/2828865461 learned_addr learned my addr 172.21.15.73:0/2828865461 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-12T09:46:34.144 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:34.141+0000 7fb59f7fe640 1 -- 172.21.15.73:0/2828865461 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2436473795 0 0) 0x7fb594001110 con 0x7fb5a014e700 2023-12-12T09:46:34.144 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:34.141+0000 7fb59f7fe640 1 -- 172.21.15.73:0/2828865461 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb590005730 con 0x7fb5a014e700 2023-12-12T09:46:34.145 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:34.141+0000 7fb5a539d640 1 --2- 172.21.15.73:0/2828865461 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb5a00aa500 0x7fb5a0151cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:34.145 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:34.142+0000 7fb59f7fe640 1 -- 172.21.15.73:0/2828865461 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2944726223 0 0) 0x7fb590005730 con 0x7fb5a014e700 2023-12-12T09:46:34.145 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:34.142+0000 7fb59f7fe640 1 -- 172.21.15.73:0/2828865461 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb5a00aa500 msgr2=0x7fb5a0151cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:46:34.145 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:34.142+0000 7fb59f7fe640 1 --2- 172.21.15.73:0/2828865461 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb5a00aa500 0x7fb5a0151cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:34.145 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:34.142+0000 7fb59f7fe640 1 -- 172.21.15.73:0/2828865461 >> v1:172.21.15.142:6789/0 conn(0x7fb5a00c37b0 legacy=0x7fb5a00a9df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:34.145 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:34.142+0000 7fb59f7fe640 1 -- 172.21.15.73:0/2828865461 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5a00aaff0 con 0x7fb5a014e700 2023-12-12T09:46:34.145 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:34.142+0000 7fb59f7fe640 1 -- 172.21.15.73:0/2828865461 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3186547832 0 0) 0x7fb594001800 con 0x7fb5a014e700 2023-12-12T09:46:34.145 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:34.142+0000 7fb59f7fe640 1 -- 172.21.15.73:0/2828865461 >> v1:172.21.15.73:6789/0 conn(0x7fb5a014e700 legacy=0x7fb5a00c02b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:34.145 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:34.142+0000 7fb59f7fe640 1 --2- 172.21.15.73:0/2828865461 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb5a00aa500 0x7fb590005bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:34.145 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:34.142+0000 7fb59f7fe640 1 --2- 172.21.15.73:0/2828865461 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb5900061e0 0x7fb5900069d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:34.145 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:34.142+0000 7fb59f7fe640 1 --2- 172.21.15.73:0/2828865461 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb590006f60 0x7fb5900073e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:34.145 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:34.142+0000 7fb59f7fe640 1 -- 172.21.15.73:0/2828865461 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5a006bb10 con 0x7fb5900061e0 2023-12-12T09:46:34.145 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:34.142+0000 7fb59f7fe640 1 -- 172.21.15.73:0/2828865461 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb59000de70 con 0x7fb590006f60 2023-12-12T09:46:34.146 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:34.142+0000 7fb59f7fe640 1 -- 172.21.15.73:0/2828865461 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb59000e030 con 0x7fb5a00aa500 2023-12-12T09:46:34.146 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:34.142+0000 7fb59ffff640 1 --2- 172.21.15.73:0/2828865461 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb5900061e0 0x7fb5900069d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:34.146 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:34.143+0000 7fb5a4b9c640 1 --2- 172.21.15.73:0/2828865461 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb5a00aa500 0x7fb590005bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:34.146 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:34.143+0000 7fb5a539d640 1 --2- 172.21.15.73:0/2828865461 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb590006f60 0x7fb5900073e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:34.146 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:34.143+0000 7fb59ffff640 1 -- 172.21.15.73:0/2828865461 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb5a00aa500 msgr2=0x7fb590005bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:46:34.146 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:34.143+0000 7fb59ffff640 1 --2- 172.21.15.73:0/2828865461 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb5a00aa500 0x7fb590005bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:34.146 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:34.143+0000 7fb59ffff640 1 -- 172.21.15.73:0/2828865461 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb590006f60 msgr2=0x7fb5900073e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:46:34.146 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:34.143+0000 7fb59ffff640 1 --2- 172.21.15.73:0/2828865461 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb590006f60 0x7fb5900073e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:34.146 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:34.143+0000 7fb59ffff640 1 -- 172.21.15.73:0/2828865461 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb590005730 con 0x7fb5900061e0 2023-12-12T09:46:34.147 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:34.144+0000 7fb59ffff640 1 --2- 172.21.15.73:0/2828865461 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb5900061e0 0x7fb5900069d0 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7fb58c001720 tx=0x7fb590007a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63e6d4d67fa4f839 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:46:34.147 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:34.144+0000 7fb59f7fe640 1 -- 172.21.15.73:0/2828865461 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb58c0052d0 con 0x7fb5900061e0 2023-12-12T09:46:34.147 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:34.144+0000 7fb59f7fe640 1 -- 172.21.15.73:0/2828865461 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb58c02e050 con 0x7fb5900061e0 2023-12-12T09:46:34.147 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:34.144+0000 7fb59f7fe640 1 -- 172.21.15.73:0/2828865461 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb58c003830 con 0x7fb5900061e0 2023-12-12T09:46:34.147 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:34.145+0000 7fb5a5b9e640 1 -- 172.21.15.73:0/2828865461 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb5900061e0 msgr2=0x7fb5900069d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:34.148 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:34.145+0000 7fb5a5b9e640 1 --2- 172.21.15.73:0/2828865461 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb5900061e0 0x7fb5900069d0 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7fb58c001720 tx=0x7fb590007a00 comp rx=0 tx=0).stop 2023-12-12T09:46:34.148 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:34.145+0000 7fb5a539d640 1 -- 172.21.15.73:0/2828865461 reap_dead start 2023-12-12T09:46:34.148 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:34.145+0000 7fb5a5b9e640 1 -- 172.21.15.73:0/2828865461 shutdown_connections 2023-12-12T09:46:34.148 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:34.145+0000 7fb5a5b9e640 1 -- 172.21.15.73:0/2828865461 >> 172.21.15.73:0/2828865461 conn(0x7fb5a00c23b0 msgr2=0x7fb5a00c2790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:46:34.148 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:34.145+0000 7fb5a5b9e640 1 -- 172.21.15.73:0/2828865461 shutdown_connections 2023-12-12T09:46:34.148 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:34.145+0000 7fb5a5b9e640 1 -- 172.21.15.73:0/2828865461 wait complete. 2023-12-12T09:46:34.148 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:34.147+0000 7fb5a5b9e640 1 Processor -- start 2023-12-12T09:46:34.148 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:34.147+0000 7fb5a5b9e640 1 -- start start 2023-12-12T09:46:34.149 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:34.148+0000 7fb5a5b9e640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb5900061e0 0x7fb5a01dc7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:34.149 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:34.148+0000 7fb5a5b9e640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb5a0071c10 0x7fb5a0153440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:34.149 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:34.148+0000 7fb5a5b9e640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb5a00bf420 0x7fb5a0071080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:34.149 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:34.148+0000 7fb5a5b9e640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5a0072110 con 0x7fb5900061e0 2023-12-12T09:46:34.149 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:34.148+0000 7fb5a5b9e640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5a0155250 con 0x7fb5a00bf420 2023-12-12T09:46:34.150 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:34.148+0000 7fb5a5b9e640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5a0155530 con 0x7fb5a0071c10 2023-12-12T09:46:34.150 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:34.148+0000 7fb5a4b9c640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb5900061e0 0x7fb5a01dc7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:34.150 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:34.148+0000 7fb5a4b9c640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb5900061e0 0x7fb5a01dc7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:55926/0 (socket says 172.21.15.73:55926) 2023-12-12T09:46:34.150 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:34.148+0000 7fb5a4b9c640 1 -- 172.21.15.73:0/2325477658 learned_addr learned my addr 172.21.15.73:0/2325477658 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:46:34.151 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:34.148+0000 7fb59ffff640 1 --2- 172.21.15.73:0/2325477658 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb5a0071c10 0x7fb5a0153440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:34.151 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:34.148+0000 7fb5a4b9c640 1 -- 172.21.15.73:0/2325477658 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb5a0071c10 msgr2=0x7fb5a0153440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:34.151 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:34.148+0000 7fb5a539d640 1 --2- 172.21.15.73:0/2325477658 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb5a00bf420 0x7fb5a0071080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:34.151 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:34.148+0000 7fb5a4b9c640 1 --2- 172.21.15.73:0/2325477658 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb5a0071c10 0x7fb5a0153440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:34.151 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:34.148+0000 7fb5a4b9c640 1 -- 172.21.15.73:0/2325477658 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb5a00bf420 msgr2=0x7fb5a0071080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:34.151 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:34.148+0000 7fb5a4b9c640 1 --2- 172.21.15.73:0/2325477658 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb5a00bf420 0x7fb5a0071080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:34.151 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:34.148+0000 7fb5a4b9c640 1 -- 172.21.15.73:0/2325477658 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5a00722f0 con 0x7fb5900061e0 2023-12-12T09:46:34.151 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:34.149+0000 7fb5a4b9c640 1 --2- 172.21.15.73:0/2325477658 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb5900061e0 0x7fb5a01dc7c0 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7fb59400d6f0 tx=0x7fb59400dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:46:34.151 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:34.149+0000 7fb59d7fa640 1 -- 172.21.15.73:0/2325477658 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5940072e0 con 0x7fb5900061e0 2023-12-12T09:46:34.152 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:34.149+0000 7fb59d7fa640 1 -- 172.21.15.73:0/2325477658 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb594007440 con 0x7fb5900061e0 2023-12-12T09:46:34.152 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:34.149+0000 7fb59d7fa640 1 -- 172.21.15.73:0/2325477658 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5940047e0 con 0x7fb5900061e0 2023-12-12T09:46:34.152 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:34.149+0000 7fb5a5b9e640 1 -- 172.21.15.73:0/2325477658 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5a00725d0 con 0x7fb5900061e0 2023-12-12T09:46:34.152 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:34.149+0000 7fb5a5b9e640 1 -- 172.21.15.73:0/2325477658 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5a00bf9e0 con 0x7fb5900061e0 2023-12-12T09:46:34.152 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:34.150+0000 7fb5a5b9e640 1 -- 172.21.15.73:0/2325477658 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb5a00727c0 con 0x7fb5900061e0 2023-12-12T09:46:34.152 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:34.151+0000 7fb59d7fa640 1 -- 172.21.15.73:0/2325477658 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fb594004940 con 0x7fb5900061e0 2023-12-12T09:46:34.153 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:34.152+0000 7fb59d7fa640 1 --2- 172.21.15.73:0/2325477658 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fb58406ae70 0x7fb58406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:34.153 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:34.152+0000 7fb59d7fa640 1 -- 172.21.15.73:0/2325477658 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb594088cb0 con 0x7fb5900061e0 2023-12-12T09:46:34.153 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:34.152+0000 7fb59ffff640 1 --2- 172.21.15.73:0/2325477658 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fb58406ae70 0x7fb58406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:34.154 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:34.153+0000 7fb59ffff640 1 --2- 172.21.15.73:0/2325477658 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fb58406ae70 0x7fb58406d330 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fb58c033000 tx=0x7fb58c009030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:46:34.157 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:34.156+0000 7fb59d7fa640 1 -- 172.21.15.73:0/2325477658 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fb594053d50 con 0x7fb5900061e0 2023-12-12T09:46:34.389 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:34.388+0000 7fb5a5b9e640 1 -- 172.21.15.73:0/2325477658 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fb5a01521f0 con 0x7fb5900061e0 2023-12-12T09:46:34.390 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:34.389+0000 7fb59d7fa640 1 -- 172.21.15.73:0/2325477658 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v44) v1 ==== 53+0+73 (secure 0 0 0) 0x7fb5a01521f0 con 0x7fb5900061e0 2023-12-12T09:46:34.390 INFO:teuthology.orchestra.run.smithi073.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-12-12T09:46:34.393 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:34.391+0000 7fb5a5b9e640 1 -- 172.21.15.73:0/2325477658 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fb58406ae70 msgr2=0x7fb58406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:34.393 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:34.391+0000 7fb5a5b9e640 1 --2- 172.21.15.73:0/2325477658 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fb58406ae70 0x7fb58406d330 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fb58c033000 tx=0x7fb58c009030 comp rx=0 tx=0).stop 2023-12-12T09:46:34.393 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:34.391+0000 7fb5a5b9e640 1 -- 172.21.15.73:0/2325477658 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb5900061e0 msgr2=0x7fb5a01dc7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:34.393 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:34.391+0000 7fb5a5b9e640 1 --2- 172.21.15.73:0/2325477658 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb5900061e0 0x7fb5a01dc7c0 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7fb59400d6f0 tx=0x7fb59400dbb0 comp rx=0 tx=0).stop 2023-12-12T09:46:34.393 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:34.391+0000 7fb5a5b9e640 1 -- 172.21.15.73:0/2325477658 shutdown_connections 2023-12-12T09:46:34.393 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:34.391+0000 7fb5a5b9e640 1 --2- 172.21.15.73:0/2325477658 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fb58406ae70 0x7fb58406d330 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:34.393 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:34.391+0000 7fb5a5b9e640 1 --2- 172.21.15.73:0/2325477658 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb5a00bf420 0x7fb5a0071080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:34.393 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:34.391+0000 7fb5a5b9e640 1 --2- 172.21.15.73:0/2325477658 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb5a0071c10 0x7fb5a0153440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:34.393 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:34.391+0000 7fb5a5b9e640 1 --2- 172.21.15.73:0/2325477658 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb5900061e0 0x7fb5a01dc7c0 unknown :-1 s=CLOSED pgs=898 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:34.393 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:34.391+0000 7fb5a5b9e640 1 -- 172.21.15.73:0/2325477658 >> 172.21.15.73:0/2325477658 conn(0x7fb5a00c23b0 msgr2=0x7fb5a00c15a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:46:34.393 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:34.391+0000 7fb5a5b9e640 1 -- 172.21.15.73:0/2325477658 shutdown_connections 2023-12-12T09:46:34.394 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:34.391+0000 7fb5a5b9e640 1 -- 172.21.15.73:0/2325477658 wait complete. 2023-12-12T09:46:34.411 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-12-12T09:46:34.411 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-12T09:46:34.411 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi073.front.sepia.ceph.com 2023-12-12T09:46:34.412 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-12-12T09:46:34.412 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-12-12T09:46:34.412 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-12-12T09:46:34.412 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-12-12T09:46:34.412 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-12-12T09:46:34.412 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-12-12T09:46:34.412 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T09:46:34.412 DEBUG:teuthology.orchestra.run.smithi073:> ip addr 2023-12-12T09:46:34.463 INFO:teuthology.orchestra.run.smithi073.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-12T09:46:34.463 INFO:teuthology.orchestra.run.smithi073.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-12T09:46:34.463 INFO:teuthology.orchestra.run.smithi073.stdout: inet 127.0.0.1/8 scope host lo 2023-12-12T09:46:34.463 INFO:teuthology.orchestra.run.smithi073.stdout: valid_lft forever preferred_lft forever 2023-12-12T09:46:34.463 INFO:teuthology.orchestra.run.smithi073.stdout: inet6 ::1/128 scope host 2023-12-12T09:46:34.464 INFO:teuthology.orchestra.run.smithi073.stdout: valid_lft forever preferred_lft forever 2023-12-12T09:46:34.464 INFO:teuthology.orchestra.run.smithi073.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-12T09:46:34.464 INFO:teuthology.orchestra.run.smithi073.stdout: link/ether 0c:c4:7a:d8:d9:ea brd ff:ff:ff:ff:ff:ff 2023-12-12T09:46:34.464 INFO:teuthology.orchestra.run.smithi073.stdout: altname enp7s0f0 2023-12-12T09:46:34.464 INFO:teuthology.orchestra.run.smithi073.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-12T09:46:34.464 INFO:teuthology.orchestra.run.smithi073.stdout: link/ether 0c:c4:7a:d8:d9:eb brd ff:ff:ff:ff:ff:ff 2023-12-12T09:46:34.464 INFO:teuthology.orchestra.run.smithi073.stdout: altname enp7s0f1 2023-12-12T09:46:34.464 INFO:teuthology.orchestra.run.smithi073.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-12T09:46:34.464 INFO:teuthology.orchestra.run.smithi073.stdout: link/ether 0c:c4:7a:8f:ce:7c brd ff:ff:ff:ff:ff:ff 2023-12-12T09:46:34.464 INFO:teuthology.orchestra.run.smithi073.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-12T09:46:34.464 INFO:teuthology.orchestra.run.smithi073.stdout: link/ether 0c:c4:7a:8f:ce:7d brd ff:ff:ff:ff:ff:ff 2023-12-12T09:46:34.464 INFO:teuthology.orchestra.run.smithi073.stdout: inet 172.21.15.73/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-12-12T09:46:34.464 INFO:teuthology.orchestra.run.smithi073.stdout: valid_lft 42205sec preferred_lft 42205sec 2023-12-12T09:46:34.465 INFO:teuthology.orchestra.run.smithi073.stdout: inet6 fe80::ec4:7aff:fe8f:ce7d/64 scope link 2023-12-12T09:46:34.465 INFO:teuthology.orchestra.run.smithi073.stdout: valid_lft forever preferred_lft forever 2023-12-12T09:46:34.465 INFO:teuthology.orchestra.run.smithi073.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-12-12T09:46:34.465 INFO:teuthology.orchestra.run.smithi073.stdout: link/ether ae:cf:b6:bf:45:8d brd ff:ff:ff:ff:ff:ff 2023-12-12T09:46:34.465 INFO:teuthology.orchestra.run.smithi073.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-12-12T09:46:34.465 INFO:teuthology.orchestra.run.smithi073.stdout: valid_lft forever preferred_lft forever 2023-12-12T09:46:34.465 INFO:teuthology.orchestra.run.smithi073.stdout: inet6 fe80::f4:a9ff:febd:c3fb/64 scope link 2023-12-12T09:46:34.465 INFO:teuthology.orchestra.run.smithi073.stdout: valid_lft forever preferred_lft forever 2023-12-12T09:46:34.465 INFO:teuthology.orchestra.run.smithi073.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-12T09:46:34.465 INFO:teuthology.orchestra.run.smithi073.stdout: link/ether ae:cf:b6:bf:45:8d brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-12T09:46:34.465 INFO:teuthology.orchestra.run.smithi073.stdout: inet6 fe80::accf:b6ff:febf:458d/64 scope link 2023-12-12T09:46:34.465 INFO:teuthology.orchestra.run.smithi073.stdout: valid_lft forever preferred_lft forever 2023-12-12T09:46:34.466 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T09:46:34.466 DEBUG:teuthology.orchestra.run.smithi073:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-12T09:46:34.557 INFO:teuthology.orchestra.run.smithi073.stdout:1 2023-12-12T09:46:34.561 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T09:46:34.561 DEBUG:teuthology.orchestra.run.smithi073:> route 2023-12-12T09:46:34.614 INFO:teuthology.orchestra.run.smithi073.stdout:Kernel IP routing table 2023-12-12T09:46:34.614 INFO:teuthology.orchestra.run.smithi073.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-12T09:46:34.614 INFO:teuthology.orchestra.run.smithi073.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-12-12T09:46:34.614 INFO:teuthology.orchestra.run.smithi073.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-12-12T09:46:34.614 INFO:teuthology.orchestra.run.smithi073.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-12T09:46:34.614 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T09:46:34.615 DEBUG:teuthology.orchestra.run.smithi073:> (cd / && exec bash -c ' 2023-12-12T09:46:34.615 DEBUG:teuthology.orchestra.run.smithi073:> set -e 2023-12-12T09:46:34.615 DEBUG:teuthology.orchestra.run.smithi073:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-12-12T09:46:34.615 DEBUG:teuthology.orchestra.run.smithi073:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-12-12T09:46:34.615 DEBUG:teuthology.orchestra.run.smithi073:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-12-12T09:46:34.615 DEBUG:teuthology.orchestra.run.smithi073:> ') 2023-12-12T09:46:34.797 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T09:46:34.797 DEBUG:teuthology.orchestra.run.smithi073:> ip netns list 2023-12-12T09:46:34.848 INFO:teuthology.orchestra.run.smithi073.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-12-12T09:46:34.849 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-12-12T09:46:34.849 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T09:46:34.849 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip link set brx.0 up 2023-12-12T09:46:34.940 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-12T09:46:34.940 DEBUG:teuthology.orchestra.run.smithi073:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-12-12T09:46:34.994 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-12T09:46:34.995 DEBUG:teuthology.orchestra.run.smithi073:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-12-12T09:46:35.043 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2023-12-12T09:46:35.043 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T09:46:35.043 DEBUG:teuthology.orchestra.run.smithi073:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-12T09:46:35.178 INFO:teuthology.orchestra.run.smithi073.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-12T09:46:35.178 INFO:teuthology.orchestra.run.smithi073.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-12T09:46:35.211 INFO:teuthology.orchestra.run.smithi073.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-12T09:46:35.211 INFO:teuthology.orchestra.run.smithi073.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-12T09:46:35.211 INFO:teuthology.orchestra.run.smithi073.stdout:mount.ceph: resolved to: "172.21.15.73:3300,172.21.15.142:3300,172.21.15.142:3301" 2023-12-12T09:46:35.211 INFO:teuthology.orchestra.run.smithi073.stdout:mount.ceph: trying mount with new device syntax: 0@ba240992-02b8-4c7e-92f2-27eb29ac433b.cephfs=/ 2023-12-12T09:46:35.211 INFO:teuthology.orchestra.run.smithi073.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.73:3300/172.21.15.142:3300/172.21.15.142:3301" will pass to kernel 2023-12-12T09:46:35.213 INFO:teuthology.orchestra.run.smithi073.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2023-12-12T09:46:35.213 INFO:teuthology.orchestra.run.smithi073.stdout: You just mounted a file system that supports labels which does not 2023-12-12T09:46:35.213 INFO:teuthology.orchestra.run.smithi073.stdout: contain labels, onto an SELinux box. It is likely that confined 2023-12-12T09:46:35.213 INFO:teuthology.orchestra.run.smithi073.stdout: applications will generate AVC messages and not be allowed access to 2023-12-12T09:46:35.213 INFO:teuthology.orchestra.run.smithi073.stdout: this file system. For more details see restorecon(8) and mount(8). 2023-12-12T09:46:35.220 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-12-12T09:46:35.220 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T09:46:35.220 DEBUG:teuthology.orchestra.run.smithi073:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-12-12T09:46:35.308 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T09:46:35.308 DEBUG:teuthology.orchestra.run.smithi073:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-12T09:46:35.375 INFO:teuthology.orchestra.run.smithi073.stdout:client5434 2023-12-12T09:46:35.375 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2023-12-12T09:46:35.375 DEBUG:teuthology.orchestra.run.smithi073:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-12T09:46:35.431 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-12-12T09:46:35.639 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:35.638+0000 7f9f09d0f640 1 Processor -- start 2023-12-12T09:46:35.640 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:35.638+0000 7f9f09d0f640 1 -- start start 2023-12-12T09:46:35.641 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:35.639+0000 7f9f09d0f640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9f0414fa40 0x7f9f0406a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:35.641 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:35.640+0000 7f9f09d0f640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f9f040c5070 0x7f9f040c40c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:35.641 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:35.640+0000 7f9f09d0f640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f04152610 con 0x7f9f0406db70 2023-12-12T09:46:35.642 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:35.640+0000 7f9f09d0f640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f041528f0 con 0x7f9f040c5070 2023-12-12T09:46:35.642 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:35.640+0000 7f9f09d0f640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f04152bd0 con 0x7f9f0414fa40 2023-12-12T09:46:35.642 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:35.640+0000 7f9efaffd640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f9f0406db70 0x7f9f040c39b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:55716/0 (socket says 172.21.15.73:55716) 2023-12-12T09:46:35.642 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:35.640+0000 7f9efaffd640 1 -- 172.21.15.73:0/236561200 learned_addr learned my addr 172.21.15.73:0/236561200 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-12T09:46:35.642 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:35.640+0000 7f9f03fff640 1 --2- 172.21.15.73:0/236561200 >> v2:172.21.15.73:3300/0 conn(0x7f9f040c5070 0x7f9f040c40c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:35.643 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:35.640+0000 7f9f037fe640 1 --2- 172.21.15.73:0/236561200 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9f0414fa40 0x7f9f0406a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:35.643 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:35.641+0000 7f9f02ffd640 1 -- 172.21.15.73:0/236561200 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 280739658 0 0) 0x7f9f04152610 con 0x7f9f0406db70 2023-12-12T09:46:35.643 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:35.641+0000 7f9f02ffd640 1 -- 172.21.15.73:0/236561200 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9ef0003520 con 0x7f9f0406db70 2023-12-12T09:46:35.643 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:35.641+0000 7f9f03fff640 1 -- 172.21.15.73:0/236561200 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9f0414fa40 msgr2=0x7f9f0406a4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:46:35.643 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:35.641+0000 7f9f03fff640 1 --2- 172.21.15.73:0/236561200 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9f0414fa40 0x7f9f0406a4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:35.643 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:35.641+0000 7f9f03fff640 1 -- 172.21.15.73:0/236561200 >> v1:172.21.15.73:6789/0 conn(0x7f9f0406db70 legacy=0x7f9f040c39b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:35.643 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:35.641+0000 7f9f03fff640 1 -- 172.21.15.73:0/236561200 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f04152eb0 con 0x7f9f040c5070 2023-12-12T09:46:35.643 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:35.642+0000 7f9f03fff640 1 --2- 172.21.15.73:0/236561200 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9f040c5070 0x7f9f040c40c0 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7f9efc009d90 tx=0x7f9efc02bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a615836f0490834 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:46:35.645 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:35.642+0000 7f9f02ffd640 1 -- 172.21.15.73:0/236561200 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9efc02cc50 con 0x7f9f040c5070 2023-12-12T09:46:35.645 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:35.642+0000 7f9f02ffd640 1 -- 172.21.15.73:0/236561200 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9efc02cdb0 con 0x7f9f040c5070 2023-12-12T09:46:35.645 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:35.642+0000 7f9f02ffd640 1 -- 172.21.15.73:0/236561200 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9efc034660 con 0x7f9f040c5070 2023-12-12T09:46:35.645 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:35.643+0000 7f9f09d0f640 1 -- 172.21.15.73:0/236561200 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9f040c5070 msgr2=0x7f9f040c40c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:35.645 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:35.643+0000 7f9f09d0f640 1 --2- 172.21.15.73:0/236561200 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9f040c5070 0x7f9f040c40c0 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7f9efc009d90 tx=0x7f9efc02bea0 comp rx=0 tx=0).stop 2023-12-12T09:46:35.645 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:35.643+0000 7f9f09d0f640 1 -- 172.21.15.73:0/236561200 shutdown_connections 2023-12-12T09:46:35.645 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:35.643+0000 7f9f09d0f640 1 --2- 172.21.15.73:0/236561200 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9f040c5070 0x7f9f040c40c0 unknown :-1 s=CLOSED pgs=900 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:35.645 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:35.643+0000 7f9f09d0f640 1 --2- 172.21.15.73:0/236561200 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9f0414fa40 0x7f9f0406a4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:35.645 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:35.643+0000 7f9f09d0f640 1 -- 172.21.15.73:0/236561200 >> 172.21.15.73:0/236561200 conn(0x7f9f040a8130 msgr2=0x7f9f040c24b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:46:35.645 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:35.643+0000 7f9f09d0f640 1 -- 172.21.15.73:0/236561200 shutdown_connections 2023-12-12T09:46:35.645 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:35.643+0000 7f9f09d0f640 1 -- 172.21.15.73:0/236561200 wait complete. 2023-12-12T09:46:35.646 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:35.645+0000 7f9f09d0f640 1 Processor -- start 2023-12-12T09:46:35.646 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:35.645+0000 7f9f09d0f640 1 -- start start 2023-12-12T09:46:35.647 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:35.646+0000 7f9f09d0f640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9f0406db70 0x7f9f041e4ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:35.647 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:35.646+0000 7f9f09d0f640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9f040c5070 0x7f9f041e89b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:35.647 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:35.646+0000 7f9f09d0f640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9f0414fa40 0x7f9f040bbfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:35.647 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:35.646+0000 7f9f09d0f640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f041e5220 con 0x7f9f040c5070 2023-12-12T09:46:35.647 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:35.646+0000 7f9f09d0f640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f041e8ef0 con 0x7f9f0406db70 2023-12-12T09:46:35.648 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:35.646+0000 7f9f09d0f640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f040baf40 con 0x7f9f0414fa40 2023-12-12T09:46:35.648 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:35.646+0000 7f9efaffd640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9f040c5070 0x7f9f041e89b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:35.648 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:35.646+0000 7f9efaffd640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9f040c5070 0x7f9f041e89b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:55948/0 (socket says 172.21.15.73:55948) 2023-12-12T09:46:35.648 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:35.646+0000 7f9efaffd640 1 -- 172.21.15.73:0/4127408829 learned_addr learned my addr 172.21.15.73:0/4127408829 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:46:35.649 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:35.646+0000 7f9efaffd640 1 -- 172.21.15.73:0/4127408829 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9f0414fa40 msgr2=0x7f9f040bbfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:35.649 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:35.646+0000 7f9efaffd640 1 --2- 172.21.15.73:0/4127408829 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9f0414fa40 0x7f9f040bbfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:35.649 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:35.646+0000 7f9efaffd640 1 -- 172.21.15.73:0/4127408829 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9f0406db70 msgr2=0x7f9f041e4ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:35.649 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:35.646+0000 7f9efaffd640 1 --2- 172.21.15.73:0/4127408829 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9f0406db70 0x7f9f041e4ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:35.649 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:35.646+0000 7f9efaffd640 1 -- 172.21.15.73:0/4127408829 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9efc009a70 con 0x7f9f040c5070 2023-12-12T09:46:35.649 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:35.647+0000 7f9efaffd640 1 --2- 172.21.15.73:0/4127408829 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9f040c5070 0x7f9f041e89b0 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7f9eec00c3e0 tx=0x7f9eec00c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:46:35.649 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:35.647+0000 7f9f00ff9640 1 -- 172.21.15.73:0/4127408829 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9eec005ce0 con 0x7f9f040c5070 2023-12-12T09:46:35.649 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:35.647+0000 7f9f00ff9640 1 -- 172.21.15.73:0/4127408829 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9eec005e40 con 0x7f9f040c5070 2023-12-12T09:46:35.649 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:35.647+0000 7f9f00ff9640 1 -- 172.21.15.73:0/4127408829 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9eec0072d0 con 0x7f9f040c5070 2023-12-12T09:46:35.649 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:35.647+0000 7f9f09d0f640 1 -- 172.21.15.73:0/4127408829 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f040bb220 con 0x7f9f040c5070 2023-12-12T09:46:35.649 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:35.647+0000 7f9f09d0f640 1 -- 172.21.15.73:0/4127408829 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f040bb7e0 con 0x7f9f040c5070 2023-12-12T09:46:35.650 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:35.648+0000 7f9f09d0f640 1 -- 172.21.15.73:0/4127408829 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f040c4580 con 0x7f9f040c5070 2023-12-12T09:46:35.650 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:35.649+0000 7f9f00ff9640 1 -- 172.21.15.73:0/4127408829 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f9eec0074f0 con 0x7f9f040c5070 2023-12-12T09:46:35.651 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:35.650+0000 7f9f00ff9640 1 --2- 172.21.15.73:0/4127408829 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f9ee406ae40 0x7f9ee406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:35.651 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:35.650+0000 7f9f00ff9640 1 -- 172.21.15.73:0/4127408829 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9eec088b20 con 0x7f9f040c5070 2023-12-12T09:46:35.651 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:35.650+0000 7f9f037fe640 1 --2- 172.21.15.73:0/4127408829 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f9ee406ae40 0x7f9ee406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:35.653 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:35.651+0000 7f9f037fe640 1 --2- 172.21.15.73:0/4127408829 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f9ee406ae40 0x7f9ee406d300 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f9ef40098f0 tx=0x7f9ef4008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:46:35.656 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:35.654+0000 7f9f00ff9640 1 -- 172.21.15.73:0/4127408829 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f9eec053c70 con 0x7f9f040c5070 2023-12-12T09:46:35.882 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:35.881+0000 7f9f09d0f640 1 -- 172.21.15.73:0/4127408829 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f9f04067580 con 0x7f9f040c5070 2023-12-12T09:46:35.883 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:35.882+0000 7f9f00ff9640 1 -- 172.21.15.73:0/4127408829 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v44) v1 ==== 53+0+73 (secure 0 0 0) 0x7f9eec017070 con 0x7f9f040c5070 2023-12-12T09:46:35.883 INFO:teuthology.orchestra.run.smithi073.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-12-12T09:46:35.886 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:35.884+0000 7f9f09d0f640 1 -- 172.21.15.73:0/4127408829 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f9ee406ae40 msgr2=0x7f9ee406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:35.886 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:35.884+0000 7f9f09d0f640 1 --2- 172.21.15.73:0/4127408829 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f9ee406ae40 0x7f9ee406d300 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f9ef40098f0 tx=0x7f9ef4008040 comp rx=0 tx=0).stop 2023-12-12T09:46:35.886 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:35.884+0000 7f9f09d0f640 1 -- 172.21.15.73:0/4127408829 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9f040c5070 msgr2=0x7f9f041e89b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:35.886 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:35.884+0000 7f9f09d0f640 1 --2- 172.21.15.73:0/4127408829 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9f040c5070 0x7f9f041e89b0 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7f9eec00c3e0 tx=0x7f9eec00c8a0 comp rx=0 tx=0).stop 2023-12-12T09:46:35.886 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:35.884+0000 7f9f09d0f640 1 -- 172.21.15.73:0/4127408829 shutdown_connections 2023-12-12T09:46:35.886 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:35.884+0000 7f9f09d0f640 1 --2- 172.21.15.73:0/4127408829 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f9ee406ae40 0x7f9ee406d300 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:35.886 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:35.884+0000 7f9f09d0f640 1 --2- 172.21.15.73:0/4127408829 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9f0414fa40 0x7f9f040bbfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:35.886 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:35.884+0000 7f9f09d0f640 1 --2- 172.21.15.73:0/4127408829 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9f040c5070 0x7f9f041e89b0 unknown :-1 s=CLOSED pgs=901 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:35.886 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:35.884+0000 7f9f09d0f640 1 --2- 172.21.15.73:0/4127408829 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9f0406db70 0x7f9f041e4ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:35.886 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:35.884+0000 7f9f09d0f640 1 -- 172.21.15.73:0/4127408829 >> 172.21.15.73:0/4127408829 conn(0x7f9f040a8130 msgr2=0x7f9f040c2440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:46:35.886 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:35.884+0000 7f9f09d0f640 1 -- 172.21.15.73:0/4127408829 shutdown_connections 2023-12-12T09:46:35.887 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:35.884+0000 7f9f09d0f640 1 -- 172.21.15.73:0/4127408829 wait complete. 2023-12-12T09:46:35.903 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-12-12T09:46:35.903 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-12T09:46:35.903 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi142.front.sepia.ceph.com 2023-12-12T09:46:35.903 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-12-12T09:46:35.903 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-12-12T09:46:35.903 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-12-12T09:46:35.903 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-12-12T09:46:35.903 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-12-12T09:46:35.904 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-12-12T09:46:35.904 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T09:46:35.904 DEBUG:teuthology.orchestra.run.smithi142:> ip addr 2023-12-12T09:46:35.966 INFO:teuthology.orchestra.run.smithi142.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-12T09:46:35.966 INFO:teuthology.orchestra.run.smithi142.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-12T09:46:35.966 INFO:teuthology.orchestra.run.smithi142.stdout: inet 127.0.0.1/8 scope host lo 2023-12-12T09:46:35.966 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2023-12-12T09:46:35.966 INFO:teuthology.orchestra.run.smithi142.stdout: inet6 ::1/128 scope host 2023-12-12T09:46:35.966 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2023-12-12T09:46:35.966 INFO:teuthology.orchestra.run.smithi142.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-12T09:46:35.966 INFO:teuthology.orchestra.run.smithi142.stdout: link/ether 0c:c4:7a:d9:36:3c brd ff:ff:ff:ff:ff:ff 2023-12-12T09:46:35.966 INFO:teuthology.orchestra.run.smithi142.stdout: altname enp7s0f0 2023-12-12T09:46:35.967 INFO:teuthology.orchestra.run.smithi142.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-12T09:46:35.967 INFO:teuthology.orchestra.run.smithi142.stdout: link/ether 0c:c4:7a:d9:36:3d brd ff:ff:ff:ff:ff:ff 2023-12-12T09:46:35.967 INFO:teuthology.orchestra.run.smithi142.stdout: altname enp7s0f1 2023-12-12T09:46:35.967 INFO:teuthology.orchestra.run.smithi142.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-12T09:46:35.967 INFO:teuthology.orchestra.run.smithi142.stdout: link/ether 0c:c4:7a:88:6e:0c brd ff:ff:ff:ff:ff:ff 2023-12-12T09:46:35.967 INFO:teuthology.orchestra.run.smithi142.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-12T09:46:35.967 INFO:teuthology.orchestra.run.smithi142.stdout: link/ether 0c:c4:7a:88:6e:0d brd ff:ff:ff:ff:ff:ff 2023-12-12T09:46:35.967 INFO:teuthology.orchestra.run.smithi142.stdout: inet 172.21.15.142/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-12-12T09:46:35.967 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft 42206sec preferred_lft 42206sec 2023-12-12T09:46:35.967 INFO:teuthology.orchestra.run.smithi142.stdout: inet6 fe80::ec4:7aff:fe88:6e0d/64 scope link 2023-12-12T09:46:35.967 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2023-12-12T09:46:35.967 INFO:teuthology.orchestra.run.smithi142.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-12-12T09:46:35.967 INFO:teuthology.orchestra.run.smithi142.stdout: link/ether de:1c:dd:95:c8:e6 brd ff:ff:ff:ff:ff:ff 2023-12-12T09:46:35.967 INFO:teuthology.orchestra.run.smithi142.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-12-12T09:46:35.968 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2023-12-12T09:46:35.968 INFO:teuthology.orchestra.run.smithi142.stdout: inet6 fe80::f8b8:b6ff:fe33:420d/64 scope link 2023-12-12T09:46:35.968 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2023-12-12T09:46:35.968 INFO:teuthology.orchestra.run.smithi142.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-12T09:46:35.968 INFO:teuthology.orchestra.run.smithi142.stdout: link/ether de:1c:dd:95:c8:e6 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-12-12T09:46:35.968 INFO:teuthology.orchestra.run.smithi142.stdout: inet6 fe80::dc1c:ddff:fe95:c8e6/64 scope link 2023-12-12T09:46:35.968 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2023-12-12T09:46:35.969 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T09:46:35.969 DEBUG:teuthology.orchestra.run.smithi142:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-12T09:46:36.060 INFO:teuthology.orchestra.run.smithi142.stdout:1 2023-12-12T09:46:36.064 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T09:46:36.064 DEBUG:teuthology.orchestra.run.smithi142:> route 2023-12-12T09:46:36.115 INFO:teuthology.orchestra.run.smithi142.stdout:Kernel IP routing table 2023-12-12T09:46:36.115 INFO:teuthology.orchestra.run.smithi142.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-12T09:46:36.115 INFO:teuthology.orchestra.run.smithi142.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-12-12T09:46:36.115 INFO:teuthology.orchestra.run.smithi142.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-12-12T09:46:36.115 INFO:teuthology.orchestra.run.smithi142.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-12T09:46:36.116 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T09:46:36.116 DEBUG:teuthology.orchestra.run.smithi142:> (cd / && exec bash -c ' 2023-12-12T09:46:36.116 DEBUG:teuthology.orchestra.run.smithi142:> set -e 2023-12-12T09:46:36.117 DEBUG:teuthology.orchestra.run.smithi142:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-12-12T09:46:36.117 DEBUG:teuthology.orchestra.run.smithi142:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-12-12T09:46:36.117 DEBUG:teuthology.orchestra.run.smithi142:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-12-12T09:46:36.117 DEBUG:teuthology.orchestra.run.smithi142:> ') 2023-12-12T09:46:36.301 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T09:46:36.301 DEBUG:teuthology.orchestra.run.smithi142:> ip netns list 2023-12-12T09:46:36.354 INFO:teuthology.orchestra.run.smithi142.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-12-12T09:46:36.355 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-12-12T09:46:36.355 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T09:46:36.356 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip link set brx.0 up 2023-12-12T09:46:36.447 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-12T09:46:36.447 DEBUG:teuthology.orchestra.run.smithi142:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-12-12T09:46:36.501 INFO:teuthology.orchestra.run.smithi142.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-12-12T09:46:36.501 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-12T09:46:36.502 DEBUG:teuthology.orchestra.run.smithi142:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-12-12T09:46:36.551 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2023-12-12T09:46:36.551 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T09:46:36.551 DEBUG:teuthology.orchestra.run.smithi142:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-12T09:46:36.689 INFO:teuthology.orchestra.run.smithi142.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-12T09:46:36.689 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-12T09:46:36.723 INFO:teuthology.orchestra.run.smithi142.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-12T09:46:36.723 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-12T09:46:36.723 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: resolved to: "172.21.15.73:3300,172.21.15.142:3300,172.21.15.142:3301" 2023-12-12T09:46:36.723 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: trying mount with new device syntax: 1@ba240992-02b8-4c7e-92f2-27eb29ac433b.cephfs=/ 2023-12-12T09:46:36.723 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.73:3300/172.21.15.142:3300/172.21.15.142:3301" will pass to kernel 2023-12-12T09:46:36.724 INFO:teuthology.orchestra.run.smithi142.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2023-12-12T09:46:36.724 INFO:teuthology.orchestra.run.smithi142.stdout: You just mounted a file system that supports labels which does not 2023-12-12T09:46:36.725 INFO:teuthology.orchestra.run.smithi142.stdout: contain labels, onto an SELinux box. It is likely that confined 2023-12-12T09:46:36.725 INFO:teuthology.orchestra.run.smithi142.stdout: applications will generate AVC messages and not be allowed access to 2023-12-12T09:46:36.725 INFO:teuthology.orchestra.run.smithi142.stdout: this file system. For more details see restorecon(8) and mount(8). 2023-12-12T09:46:36.728 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-12-12T09:46:36.728 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T09:46:36.728 DEBUG:teuthology.orchestra.run.smithi142:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-12-12T09:46:36.807 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T09:46:36.807 DEBUG:teuthology.orchestra.run.smithi142:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-12T09:46:36.863 INFO:teuthology.orchestra.run.smithi142.stdout:client5437 2023-12-12T09:46:36.864 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2023-12-12T09:46:36.864 DEBUG:teuthology.orchestra.run.smithi142:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-12T09:46:36.912 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth rm client.testuser 2023-12-12T09:46:37.131 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:37.129+0000 7f684c916640 1 Processor -- start 2023-12-12T09:46:37.131 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:37.129+0000 7f684c916640 1 -- start start 2023-12-12T09:46:37.133 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:37.131+0000 7f684c916640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f68480ca000 0x7f68480ca3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:37.133 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:37.131+0000 7f684c916640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f6848154c40 0x7f684815ee10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:37.133 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:37.131+0000 7f684c916640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68480c7240 con 0x7f68480c81e0 2023-12-12T09:46:37.133 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:37.131+0000 7f684c916640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68480c5170 con 0x7f6848154c40 2023-12-12T09:46:37.133 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:37.131+0000 7f684c916640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f684806c480 con 0x7f68480ca000 2023-12-12T09:46:37.133 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:37.131+0000 7f683ffff640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f68480c81e0 0x7f6848154530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:55726/0 (socket says 172.21.15.73:55726) 2023-12-12T09:46:37.133 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:37.131+0000 7f683ffff640 1 -- 172.21.15.73:0/2439143754 learned_addr learned my addr 172.21.15.73:0/2439143754 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-12T09:46:37.133 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:37.131+0000 7f6847fff640 1 --2- 172.21.15.73:0/2439143754 >> v2:172.21.15.73:3300/0 conn(0x7f6848154c40 0x7f684815ee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:37.133 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:37.132+0000 7f68477fe640 1 --2- 172.21.15.73:0/2439143754 >> v2:172.21.15.142:3300/0 conn(0x7f68480ca000 0x7f68480ca3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:37.134 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:37.132+0000 7f6846ffd640 1 -- 172.21.15.73:0/2439143754 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 481504148 0 0) 0x7f68480c7240 con 0x7f68480c81e0 2023-12-12T09:46:37.134 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:37.132+0000 7f6846ffd640 1 -- 172.21.15.73:0/2439143754 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6834003520 con 0x7f68480c81e0 2023-12-12T09:46:37.134 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:37.132+0000 7f6847fff640 1 -- 172.21.15.73:0/2439143754 >> v2:172.21.15.142:3300/0 conn(0x7f68480ca000 msgr2=0x7f68480ca3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:46:37.134 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:37.132+0000 7f6847fff640 1 --2- 172.21.15.73:0/2439143754 >> v2:172.21.15.142:3300/0 conn(0x7f68480ca000 0x7f68480ca3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:37.134 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:37.132+0000 7f6847fff640 1 -- 172.21.15.73:0/2439143754 >> v1:172.21.15.73:6789/0 conn(0x7f68480c81e0 legacy=0x7f6848154530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:37.134 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:37.132+0000 7f6847fff640 1 -- 172.21.15.73:0/2439143754 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68480c6910 con 0x7f6848154c40 2023-12-12T09:46:37.136 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:37.133+0000 7f6847fff640 1 --2- 172.21.15.73:0/2439143754 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6848154c40 0x7f684815ee10 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7f68480c77a0 tx=0x7f684002bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=579e58e2db433b17 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:46:37.136 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:37.133+0000 7f6846ffd640 1 -- 172.21.15.73:0/2439143754 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f684002cc80 con 0x7f6848154c40 2023-12-12T09:46:37.136 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:37.133+0000 7f6846ffd640 1 -- 172.21.15.73:0/2439143754 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f684002cde0 con 0x7f6848154c40 2023-12-12T09:46:37.136 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:37.133+0000 7f6846ffd640 1 -- 172.21.15.73:0/2439143754 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6840034660 con 0x7f6848154c40 2023-12-12T09:46:37.136 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:37.134+0000 7f684c916640 1 -- 172.21.15.73:0/2439143754 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6848154c40 msgr2=0x7f684815ee10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:37.136 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:37.134+0000 7f684c916640 1 --2- 172.21.15.73:0/2439143754 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6848154c40 0x7f684815ee10 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7f68480c77a0 tx=0x7f684002bed0 comp rx=0 tx=0).stop 2023-12-12T09:46:37.136 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:37.134+0000 7f684c916640 1 -- 172.21.15.73:0/2439143754 shutdown_connections 2023-12-12T09:46:37.136 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:37.134+0000 7f684c916640 1 --2- 172.21.15.73:0/2439143754 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6848154c40 0x7f684815ee10 unknown :-1 s=CLOSED pgs=903 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:37.136 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:37.134+0000 7f684c916640 1 --2- 172.21.15.73:0/2439143754 >> v2:172.21.15.142:3300/0 conn(0x7f68480ca000 0x7f68480ca3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:37.136 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:37.134+0000 7f684c916640 1 -- 172.21.15.73:0/2439143754 >> 172.21.15.73:0/2439143754 conn(0x7f6848071df0 msgr2=0x7f6848072200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:46:37.136 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:37.134+0000 7f684c916640 1 -- 172.21.15.73:0/2439143754 shutdown_connections 2023-12-12T09:46:37.136 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:37.134+0000 7f684c916640 1 -- 172.21.15.73:0/2439143754 wait complete. 2023-12-12T09:46:37.137 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:37.136+0000 7f684c916640 1 Processor -- start 2023-12-12T09:46:37.137 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:37.136+0000 7f684c916640 1 -- start start 2023-12-12T09:46:37.139 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:37.137+0000 7f684c916640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f68480c81e0 0x7f68481ed450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:37.139 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:37.137+0000 7f684c916640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f68480ca000 0x7f68481eb1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:37.139 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:37.137+0000 7f684c916640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6848154c40 0x7f68481eb700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:37.139 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:37.137+0000 7f684c916640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68481eded0 con 0x7f6848154c40 2023-12-12T09:46:37.140 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:37.137+0000 7f684c916640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68480c3740 con 0x7f68480ca000 2023-12-12T09:46:37.140 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:37.137+0000 7f684c916640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68480c3a20 con 0x7f68480c81e0 2023-12-12T09:46:37.140 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:37.137+0000 7f6847fff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6848154c40 0x7f68481eb700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:37.140 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:37.137+0000 7f6847fff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6848154c40 0x7f68481eb700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:55964/0 (socket says 172.21.15.73:55964) 2023-12-12T09:46:37.140 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:37.137+0000 7f6847fff640 1 -- 172.21.15.73:0/3312919494 learned_addr learned my addr 172.21.15.73:0/3312919494 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:46:37.140 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:37.137+0000 7f68477fe640 1 --2- 172.21.15.73:0/3312919494 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f68480c81e0 0x7f68481ed450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:37.140 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:37.138+0000 7f6847fff640 1 -- 172.21.15.73:0/3312919494 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f68480c81e0 msgr2=0x7f68481ed450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:37.140 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:37.138+0000 7f6847fff640 1 --2- 172.21.15.73:0/3312919494 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f68480c81e0 0x7f68481ed450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:37.140 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:37.138+0000 7f683ffff640 1 --2- 172.21.15.73:0/3312919494 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f68480ca000 0x7f68481eb1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:37.140 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:37.138+0000 7f6847fff640 1 -- 172.21.15.73:0/3312919494 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f68480ca000 msgr2=0x7f68481eb1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:37.140 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:37.138+0000 7f6847fff640 1 --2- 172.21.15.73:0/3312919494 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f68480ca000 0x7f68481eb1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:37.141 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:37.138+0000 7f6847fff640 1 -- 172.21.15.73:0/3312919494 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6840009a70 con 0x7f6848154c40 2023-12-12T09:46:37.141 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:37.138+0000 7f6847fff640 1 --2- 172.21.15.73:0/3312919494 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6848154c40 0x7f68481eb700 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 crypto rx=0x7f6840009e80 tx=0x7f6840004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:46:37.142 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:37.138+0000 7f6844ff9640 1 -- 172.21.15.73:0/3312919494 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6840040650 con 0x7f6848154c40 2023-12-12T09:46:37.142 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:37.138+0000 7f6844ff9640 1 -- 172.21.15.73:0/3312919494 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68400407b0 con 0x7f6848154c40 2023-12-12T09:46:37.142 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:37.138+0000 7f684c916640 1 -- 172.21.15.73:0/3312919494 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68480bd3a0 con 0x7f6848154c40 2023-12-12T09:46:37.142 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:37.138+0000 7f6844ff9640 1 -- 172.21.15.73:0/3312919494 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6840040b60 con 0x7f6848154c40 2023-12-12T09:46:37.142 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:37.138+0000 7f684c916640 1 -- 172.21.15.73:0/3312919494 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68481ebc40 con 0x7f6848154c40 2023-12-12T09:46:37.142 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:37.140+0000 7f684c916640 1 -- 172.21.15.73:0/3312919494 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f68480c3c60 con 0x7f6848154c40 2023-12-12T09:46:37.142 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:37.140+0000 7f6844ff9640 1 -- 172.21.15.73:0/3312919494 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f6840040cc0 con 0x7f6848154c40 2023-12-12T09:46:37.143 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:37.141+0000 7f6844ff9640 1 --2- 172.21.15.73:0/3312919494 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f682806ae40 0x7f682806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:37.143 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:37.141+0000 7f6844ff9640 1 -- 172.21.15.73:0/3312919494 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f68400ac1c0 con 0x7f6848154c40 2023-12-12T09:46:37.143 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:37.142+0000 7f68477fe640 1 --2- 172.21.15.73:0/3312919494 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f682806ae40 0x7f682806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:37.144 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:37.142+0000 7f68477fe640 1 --2- 172.21.15.73:0/3312919494 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f682806ae40 0x7f682806d300 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f6838009a10 tx=0x7f6838008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:46:37.147 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:37.146+0000 7f6844ff9640 1 -- 172.21.15.73:0/3312919494 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f68480c3c60 con 0x7f6848154c40 2023-12-12T09:46:37.408 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:37.406+0000 7f684c916640 1 -- 172.21.15.73:0/3312919494 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "auth rm", "entity": "client.testuser"} v 0) v1 -- 0x7f68480c3c60 con 0x7f6848154c40 2023-12-12T09:46:37.409 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:37.407+0000 7f6844ff9640 1 -- 172.21.15.73:0/3312919494 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "auth rm", "entity": "client.testuser"}]=0 v19) v1 ==== 84+0+0 (secure 0 0 0) 0x7f68480c3c60 con 0x7f6848154c40 2023-12-12T09:46:37.412 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:37.410+0000 7f684c916640 1 -- 172.21.15.73:0/3312919494 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f682806ae40 msgr2=0x7f682806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:37.412 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:37.410+0000 7f684c916640 1 --2- 172.21.15.73:0/3312919494 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f682806ae40 0x7f682806d300 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f6838009a10 tx=0x7f6838008040 comp rx=0 tx=0).stop 2023-12-12T09:46:37.412 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:37.410+0000 7f684c916640 1 -- 172.21.15.73:0/3312919494 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6848154c40 msgr2=0x7f68481eb700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:37.412 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:37.410+0000 7f684c916640 1 --2- 172.21.15.73:0/3312919494 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6848154c40 0x7f68481eb700 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 crypto rx=0x7f6840009e80 tx=0x7f6840004a40 comp rx=0 tx=0).stop 2023-12-12T09:46:37.412 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:37.410+0000 7f684c916640 1 -- 172.21.15.73:0/3312919494 shutdown_connections 2023-12-12T09:46:37.412 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:37.410+0000 7f684c916640 1 --2- 172.21.15.73:0/3312919494 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f682806ae40 0x7f682806d300 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:37.412 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:37.410+0000 7f684c916640 1 --2- 172.21.15.73:0/3312919494 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6848154c40 0x7f68481eb700 unknown :-1 s=CLOSED pgs=904 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:37.412 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:37.410+0000 7f684c916640 1 --2- 172.21.15.73:0/3312919494 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f68480ca000 0x7f68481eb1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:37.413 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:37.410+0000 7f684c916640 1 --2- 172.21.15.73:0/3312919494 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f68480c81e0 0x7f68481ed450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:37.413 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:37.410+0000 7f684c916640 1 -- 172.21.15.73:0/3312919494 >> 172.21.15.73:0/3312919494 conn(0x7f6848071df0 msgr2=0x7f684814ca40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:46:37.413 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:37.411+0000 7f684c916640 1 -- 172.21.15.73:0/3312919494 shutdown_connections 2023-12-12T09:46:37.413 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:37.411+0000 7f684c916640 1 -- 172.21.15.73:0/3312919494 wait complete. 2023-12-12T09:46:37.430 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-12T09:46:37.646 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:37.644+0000 7fc51ec90640 1 Processor -- start 2023-12-12T09:46:37.646 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:37.645+0000 7fc51ec90640 1 -- start start 2023-12-12T09:46:37.647 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:37.646+0000 7fc51ec90640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fc518151b90 0x7fc5180c7c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:37.648 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:37.646+0000 7fc51ec90640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fc5180c5930 0x7fc5180c4710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:37.648 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:37.646+0000 7fc51ec90640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc518157f00 con 0x7fc51806b580 2023-12-12T09:46:37.648 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:37.646+0000 7fc51ec90640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5180c61f0 con 0x7fc518151b90 2023-12-12T09:46:37.648 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:37.646+0000 7fc51ec90640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5180c64d0 con 0x7fc5180c5930 2023-12-12T09:46:37.648 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:37.646+0000 7fc51ca2c640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fc518151b90 0x7fc5180c7c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:37.648 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:37.646+0000 7fc517fff640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7fc51806b580 0x7fc518158390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:55728/0 (socket says 172.21.15.73:55728) 2023-12-12T09:46:37.648 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:37.646+0000 7fc517fff640 1 -- 172.21.15.73:0/3507877143 learned_addr learned my addr 172.21.15.73:0/3507877143 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-12T09:46:37.649 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:37.647+0000 7fc51d22d640 1 --2- 172.21.15.73:0/3507877143 >> v2:172.21.15.142:3300/0 conn(0x7fc5180c5930 0x7fc5180c4710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:37.649 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:37.647+0000 7fc5177fe640 1 -- 172.21.15.73:0/3507877143 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2717244568 0 0) 0x7fc518157f00 con 0x7fc51806b580 2023-12-12T09:46:37.649 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:37.647+0000 7fc5177fe640 1 -- 172.21.15.73:0/3507877143 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc500003520 con 0x7fc51806b580 2023-12-12T09:46:37.649 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:37.647+0000 7fc51ca2c640 1 -- 172.21.15.73:0/3507877143 >> v2:172.21.15.142:3300/0 conn(0x7fc5180c5930 msgr2=0x7fc5180c4710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:46:37.649 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:37.647+0000 7fc51ca2c640 1 --2- 172.21.15.73:0/3507877143 >> v2:172.21.15.142:3300/0 conn(0x7fc5180c5930 0x7fc5180c4710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:37.649 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:37.647+0000 7fc51ca2c640 1 -- 172.21.15.73:0/3507877143 >> v1:172.21.15.73:6789/0 conn(0x7fc51806b580 legacy=0x7fc518158390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:37.649 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:37.647+0000 7fc51ca2c640 1 -- 172.21.15.73:0/3507877143 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc518157b90 con 0x7fc518151b90 2023-12-12T09:46:37.651 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:37.648+0000 7fc51ca2c640 1 --2- 172.21.15.73:0/3507877143 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc518151b90 0x7fc5180c7c90 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 crypto rx=0x7fc51806b9b0 tx=0x7fc50c02b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1832f369114cc75 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:46:37.651 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:37.648+0000 7fc5177fe640 1 -- 172.21.15.73:0/3507877143 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc50c02e070 con 0x7fc518151b90 2023-12-12T09:46:37.651 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:37.648+0000 7fc5177fe640 1 -- 172.21.15.73:0/3507877143 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc50c0315a0 con 0x7fc518151b90 2023-12-12T09:46:37.651 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:37.648+0000 7fc5177fe640 1 -- 172.21.15.73:0/3507877143 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc50c031930 con 0x7fc518151b90 2023-12-12T09:46:37.651 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:37.649+0000 7fc51ec90640 1 -- 172.21.15.73:0/3507877143 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc518151b90 msgr2=0x7fc5180c7c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:37.651 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:37.649+0000 7fc51ec90640 1 --2- 172.21.15.73:0/3507877143 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc518151b90 0x7fc5180c7c90 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 crypto rx=0x7fc51806b9b0 tx=0x7fc50c02b840 comp rx=0 tx=0).stop 2023-12-12T09:46:37.651 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:37.649+0000 7fc51ec90640 1 -- 172.21.15.73:0/3507877143 shutdown_connections 2023-12-12T09:46:37.652 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:37.649+0000 7fc51ec90640 1 --2- 172.21.15.73:0/3507877143 >> v2:172.21.15.142:3300/0 conn(0x7fc5180c5930 0x7fc5180c4710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:37.652 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:37.649+0000 7fc51ec90640 1 --2- 172.21.15.73:0/3507877143 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc518151b90 0x7fc5180c7c90 unknown :-1 s=CLOSED pgs=906 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:37.652 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:37.649+0000 7fc51ec90640 1 -- 172.21.15.73:0/3507877143 >> 172.21.15.73:0/3507877143 conn(0x7fc5180ab880 msgr2=0x7fc5180abc90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:46:37.652 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:37.649+0000 7fc51ec90640 1 -- 172.21.15.73:0/3507877143 shutdown_connections 2023-12-12T09:46:37.652 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:37.649+0000 7fc51ec90640 1 -- 172.21.15.73:0/3507877143 wait complete. 2023-12-12T09:46:37.652 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:37.651+0000 7fc51ec90640 1 Processor -- start 2023-12-12T09:46:37.652 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:37.651+0000 7fc51ec90640 1 -- start start 2023-12-12T09:46:37.655 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:37.652+0000 7fc51ec90640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc51806b580 0x7fc5180bff70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:37.655 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:37.652+0000 7fc51ec90640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc5180c5930 0x7fc518156c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:37.655 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:37.652+0000 7fc51ec90640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc518151b90 0x7fc51814e960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:37.655 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:37.652+0000 7fc51ec90640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5180c05c0 con 0x7fc51806b580 2023-12-12T09:46:37.655 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:37.652+0000 7fc51ec90640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5181e9f40 con 0x7fc518151b90 2023-12-12T09:46:37.655 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:37.652+0000 7fc51ec90640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5181ea220 con 0x7fc5180c5930 2023-12-12T09:46:37.655 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:37.652+0000 7fc51ca2c640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc51806b580 0x7fc5180bff70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:37.655 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:37.652+0000 7fc51ca2c640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc51806b580 0x7fc5180bff70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:55982/0 (socket says 172.21.15.73:55982) 2023-12-12T09:46:37.655 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:37.652+0000 7fc51ca2c640 1 -- 172.21.15.73:0/1219492383 learned_addr learned my addr 172.21.15.73:0/1219492383 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:46:37.655 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:37.653+0000 7fc51d22d640 1 --2- 172.21.15.73:0/1219492383 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc518151b90 0x7fc51814e960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:37.655 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:37.653+0000 7fc517fff640 1 --2- 172.21.15.73:0/1219492383 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc5180c5930 0x7fc518156c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:37.655 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:37.653+0000 7fc51ca2c640 1 -- 172.21.15.73:0/1219492383 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc5180c5930 msgr2=0x7fc518156c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:37.656 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:37.653+0000 7fc51ca2c640 1 --2- 172.21.15.73:0/1219492383 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc5180c5930 0x7fc518156c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:37.656 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:37.653+0000 7fc51ca2c640 1 -- 172.21.15.73:0/1219492383 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc518151b90 msgr2=0x7fc51814e960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:37.656 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:37.653+0000 7fc51ca2c640 1 --2- 172.21.15.73:0/1219492383 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc518151b90 0x7fc51814e960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:37.656 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:37.653+0000 7fc51ca2c640 1 -- 172.21.15.73:0/1219492383 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc50c009400 con 0x7fc51806b580 2023-12-12T09:46:37.656 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:37.653+0000 7fc51ca2c640 1 --2- 172.21.15.73:0/1219492383 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc51806b580 0x7fc5180bff70 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 crypto rx=0x7fc50c009890 tx=0x7fc50c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:46:37.656 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:37.653+0000 7fc5157fa640 1 -- 172.21.15.73:0/1219492383 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc50c032840 con 0x7fc51806b580 2023-12-12T09:46:37.656 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:37.653+0000 7fc5157fa640 1 -- 172.21.15.73:0/1219492383 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc50c031f00 con 0x7fc51806b580 2023-12-12T09:46:37.656 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:37.653+0000 7fc51ec90640 1 -- 172.21.15.73:0/1219492383 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5181ea500 con 0x7fc51806b580 2023-12-12T09:46:37.656 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:37.653+0000 7fc5157fa640 1 -- 172.21.15.73:0/1219492383 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc50c032be0 con 0x7fc51806b580 2023-12-12T09:46:37.657 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:37.654+0000 7fc51ec90640 1 -- 172.21.15.73:0/1219492383 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc518157170 con 0x7fc51806b580 2023-12-12T09:46:37.657 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:37.655+0000 7fc51ec90640 1 -- 172.21.15.73:0/1219492383 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc5181eaa20 con 0x7fc51806b580 2023-12-12T09:46:37.657 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:37.656+0000 7fc5157fa640 1 -- 172.21.15.73:0/1219492383 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fc50c032d40 con 0x7fc51806b580 2023-12-12T09:46:37.658 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:37.656+0000 7fc5157fa640 1 --2- 172.21.15.73:0/1219492383 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fc50406ae70 0x7fc50406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:37.658 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:37.657+0000 7fc5157fa640 1 -- 172.21.15.73:0/1219492383 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc50c0ab550 con 0x7fc51806b580 2023-12-12T09:46:37.661 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:37.657+0000 7fc517fff640 1 --2- 172.21.15.73:0/1219492383 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fc50406ae70 0x7fc50406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:37.662 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:37.657+0000 7fc517fff640 1 --2- 172.21.15.73:0/1219492383 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fc50406ae70 0x7fc50406d330 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fc51806bf60 tx=0x7fc508009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:46:37.664 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:37.663+0000 7fc5157fa640 1 -- 172.21.15.73:0/1219492383 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fc5181eaa20 con 0x7fc51806b580 2023-12-12T09:46:37.861 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:37.860+0000 7fc51ec90640 1 -- 172.21.15.73:0/1219492383 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc5181eaa20 con 0x7fc51806b580 2023-12-12T09:46:37.862 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:37.861+0000 7fc5157fa640 1 -- 172.21.15.73:0/1219492383 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v75) v1 ==== 74+0+16572 (secure 0 0 0) 0x7fc5181eaa20 con 0x7fc51806b580 2023-12-12T09:46:37.863 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-12T09:46:37.863 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":75,"fsid":"ba240992-02b8-4c7e-92f2-27eb29ac433b","created":"2023-12-12T09:43:02.454719+0000","modified":"2023-12-12T09:46:27.973444+0000","last_up_change":"2023-12-12T09:43:13.913440+0000","last_in_change":"2023-12-12T09:43:05.925348+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-12T09:43:15.525508+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2023-12-12T09:46:24.716544+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2023-12-12T09:46:25.435954+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"dd9074be-dbe2-4c34-9896-a4223d8d3940","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":4047810203},{"type":"v1","addr":"172.21.15.73:6801","nonce":4047810203}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":4047810203},{"type":"v1","addr":"172.21.15.73:6803","nonce":4047810203}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":4047810203},{"type":"v1","addr":"172.21.15.73:6807","nonce":4047810203}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":4047810203},{"type":"v1","addr":"172.21.15.73:6805","nonce":4047810203}]},"public_addr":"172.21.15.73:6801/4047810203","cluster_addr":"172.21.15.73:6803/4047810203","heartbeat_back_addr":"172.21.15.73:6807/4047810203","heartbeat_front_addr":"172.21.15.73:6805/4047810203","state":["exists","up"]},{"osd":1,"uuid":"c4a05052-96d4-4758-a4e1-1a37f1e07fed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":1356058331},{"type":"v1","addr":"172.21.15.73:6824","nonce":1356058331}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":1356058331},{"type":"v1","addr":"172.21.15.73:6827","nonce":1356058331}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":1356058331},{"type":"v1","addr":"172.21.15.73:6831","nonce":1356058331}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":1356058331},{"type":"v1","addr":"172.21.15.73:6829","nonce":1356058331}]},"public_addr":"172.21.15.73:6824/1356058331","cluster_addr":"172.21.15.73:6827/1356058331","heartbeat_back_addr":"172.21.15.73:6831/1356058331","heartbeat_front_addr":"172.21.15.73:6829/1356058331","state":["exists","up"]},{"osd":2,"uuid":"512bc8ac-72c2-40d4-b3d2-d867a92c5213","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":1228903316},{"type":"v1","addr":"172.21.15.73:6817","nonce":1228903316}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":1228903316},{"type":"v1","addr":"172.21.15.73:6819","nonce":1228903316}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6823","nonce":1228903316},{"type":"v1","addr":"172.21.15.73:6825","nonce":1228903316}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":1228903316},{"type":"v1","addr":"172.21.15.73:6821","nonce":1228903316}]},"public_addr":"172.21.15.73:6817/1228903316","cluster_addr":"172.21.15.73:6819/1228903316","heartbeat_back_addr":"172.21.15.73:6825/1228903316","heartbeat_front_addr":"172.21.15.73:6821/1228903316","state":["exists","up"]},{"osd":3,"uuid":"3d1a91e0-42bf-437a-8eae-8d357c8f63a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":1293329670},{"type":"v1","addr":"172.21.15.73:6809","nonce":1293329670}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6810","nonce":1293329670},{"type":"v1","addr":"172.21.15.73:6811","nonce":1293329670}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":1293329670},{"type":"v1","addr":"172.21.15.73:6815","nonce":1293329670}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":1293329670},{"type":"v1","addr":"172.21.15.73:6813","nonce":1293329670}]},"public_addr":"172.21.15.73:6809/1293329670","cluster_addr":"172.21.15.73:6811/1293329670","heartbeat_back_addr":"172.21.15.73:6815/1293329670","heartbeat_front_addr":"172.21.15.73:6813/1293329670","state":["exists","up"]},{"osd":4,"uuid":"4b302fff-834c-4069-ac19-00e46f6c87b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":3727975702},{"type":"v1","addr":"172.21.15.142:6801","nonce":3727975702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":3727975702},{"type":"v1","addr":"172.21.15.142:6803","nonce":3727975702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6809","nonce":3727975702},{"type":"v1","addr":"172.21.15.142:6811","nonce":3727975702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6805","nonce":3727975702},{"type":"v1","addr":"172.21.15.142:6807","nonce":3727975702}]},"public_addr":"172.21.15.142:6801/3727975702","cluster_addr":"172.21.15.142:6803/3727975702","heartbeat_back_addr":"172.21.15.142:6811/3727975702","heartbeat_front_addr":"172.21.15.142:6807/3727975702","state":["exists","up"]},{"osd":5,"uuid":"d7cdace2-67d0-45cc-95f2-515cf6ef1b82","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6817","nonce":2353193632},{"type":"v1","addr":"172.21.15.142:6819","nonce":2353193632}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6821","nonce":2353193632},{"type":"v1","addr":"172.21.15.142:6823","nonce":2353193632}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6829","nonce":2353193632},{"type":"v1","addr":"172.21.15.142:6831","nonce":2353193632}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6825","nonce":2353193632},{"type":"v1","addr":"172.21.15.142:6827","nonce":2353193632}]},"public_addr":"172.21.15.142:6819/2353193632","cluster_addr":"172.21.15.142:6823/2353193632","heartbeat_back_addr":"172.21.15.142:6831/2353193632","heartbeat_front_addr":"172.21.15.142:6827/2353193632","state":["exists","up"]},{"osd":6,"uuid":"649ce78a-5626-445c-aedc-a651ed05a6f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":2006111986},{"type":"v1","addr":"172.21.15.142:6806","nonce":2006111986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":2006111986},{"type":"v1","addr":"172.21.15.142:6810","nonce":2006111986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":2006111986},{"type":"v1","addr":"172.21.15.142:6815","nonce":2006111986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":2006111986},{"type":"v1","addr":"172.21.15.142:6813","nonce":2006111986}]},"public_addr":"172.21.15.142:6806/2006111986","cluster_addr":"172.21.15.142:6810/2006111986","heartbeat_back_addr":"172.21.15.142:6815/2006111986","heartbeat_front_addr":"172.21.15.142:6813/2006111986","state":["exists","up"]},{"osd":7,"uuid":"af15ae3b-c1d0-4acf-92db-8a1805494d13","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":2573794341},{"type":"v1","addr":"172.21.15.142:6818","nonce":2573794341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":2573794341},{"type":"v1","addr":"172.21.15.142:6822","nonce":2573794341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":2573794341},{"type":"v1","addr":"172.21.15.142:6830","nonce":2573794341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":2573794341},{"type":"v1","addr":"172.21.15.142:6826","nonce":2573794341}]},"public_addr":"172.21.15.142:6818/2573794341","cluster_addr":"172.21.15.142:6822/2573794341","heartbeat_back_addr":"172.21.15.142:6830/2573794341","heartbeat_front_addr":"172.21.15.142:6826/2573794341","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.185824+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.262103+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.225556+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:10.523459+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:10.706035+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.257339+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.301776+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.051960+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-12T09:46:37.866 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:37.864+0000 7fc51ec90640 1 -- 172.21.15.73:0/1219492383 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fc50406ae70 msgr2=0x7fc50406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:37.866 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:37.864+0000 7fc51ec90640 1 --2- 172.21.15.73:0/1219492383 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fc50406ae70 0x7fc50406d330 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fc51806bf60 tx=0x7fc508009040 comp rx=0 tx=0).stop 2023-12-12T09:46:37.866 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:37.864+0000 7fc51ec90640 1 -- 172.21.15.73:0/1219492383 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc51806b580 msgr2=0x7fc5180bff70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:37.866 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:37.864+0000 7fc51ec90640 1 --2- 172.21.15.73:0/1219492383 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc51806b580 0x7fc5180bff70 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 crypto rx=0x7fc50c009890 tx=0x7fc50c0046c0 comp rx=0 tx=0).stop 2023-12-12T09:46:37.866 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:37.864+0000 7fc51ec90640 1 -- 172.21.15.73:0/1219492383 shutdown_connections 2023-12-12T09:46:37.866 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:37.864+0000 7fc51ec90640 1 --2- 172.21.15.73:0/1219492383 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fc50406ae70 0x7fc50406d330 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:37.866 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:37.864+0000 7fc51ec90640 1 --2- 172.21.15.73:0/1219492383 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc518151b90 0x7fc51814e960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:37.866 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:37.864+0000 7fc51ec90640 1 --2- 172.21.15.73:0/1219492383 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc5180c5930 0x7fc518156c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:37.866 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:37.864+0000 7fc51ec90640 1 --2- 172.21.15.73:0/1219492383 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc51806b580 0x7fc5180bff70 unknown :-1 s=CLOSED pgs=907 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:37.866 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:37.864+0000 7fc51ec90640 1 -- 172.21.15.73:0/1219492383 >> 172.21.15.73:0/1219492383 conn(0x7fc5180ab880 msgr2=0x7fc5180a9c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:46:37.866 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:37.864+0000 7fc51ec90640 1 -- 172.21.15.73:0/1219492383 shutdown_connections 2023-12-12T09:46:37.866 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:37.864+0000 7fc51ec90640 1 -- 172.21.15.73:0/1219492383 wait complete. 2023-12-12T09:46:37.884 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-12T09:43:15.525508+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 12, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-12T09:46:24.716544+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '74', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 13, 'pool_name': 'cephfs_data', 'create_time': '2023-12-12T09:46:25.435954+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '75', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-12T09:46:37.885 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-12T09:46:38.098 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:38.097+0000 7f14b072c640 1 Processor -- start 2023-12-12T09:46:38.098 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:38.097+0000 7f14b072c640 1 -- start start 2023-12-12T09:46:38.099 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:38.098+0000 7f14b072c640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f14a814f8c0 0x7f14a806dc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:38.100 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:38.098+0000 7f14b072c640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14a80c16c0 con 0x7f14a8152500 2023-12-12T09:46:38.100 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:38.098+0000 7f14b072c640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14a80c19a0 con 0x7f14a806d350 2023-12-12T09:46:38.100 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:38.098+0000 7f14b072c640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14a80c1090 con 0x7f14a814f8c0 2023-12-12T09:46:38.100 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:38.099+0000 7f14aecc9640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f14a8152500 0x7f14a8152990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:55734/0 (socket says 172.21.15.73:55734) 2023-12-12T09:46:38.101 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:38.099+0000 7f14aecc9640 1 -- 172.21.15.73:0/3801355088 learned_addr learned my addr 172.21.15.73:0/3801355088 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-12T09:46:38.101 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:38.099+0000 7f14ae4c8640 1 --2- 172.21.15.73:0/3801355088 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f14a814f8c0 0x7f14a806dc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:38.101 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:38.099+0000 7f14ad4c6640 1 -- 172.21.15.73:0/3801355088 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4196093008 0 0) 0x7f14a80c16c0 con 0x7f14a8152500 2023-12-12T09:46:38.101 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:38.099+0000 7f14ad4c6640 1 -- 172.21.15.73:0/3801355088 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1494003520 con 0x7f14a8152500 2023-12-12T09:46:38.102 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:38.100+0000 7f14ad4c6640 1 -- 172.21.15.73:0/3801355088 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 128721463 0 0) 0x7f1494003520 con 0x7f14a8152500 2023-12-12T09:46:38.102 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:38.100+0000 7f14ad4c6640 1 -- 172.21.15.73:0/3801355088 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f14a814f8c0 msgr2=0x7f14a806dc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:46:38.103 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:38.100+0000 7f14ad4c6640 1 --2- 172.21.15.73:0/3801355088 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f14a814f8c0 0x7f14a806dc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:38.103 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:38.100+0000 7f14ad4c6640 1 -- 172.21.15.73:0/3801355088 >> v1:172.21.15.142:6789/0 conn(0x7f14a806d350 legacy=0x7f14a8071e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:38.103 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:38.100+0000 7f14ad4c6640 1 -- 172.21.15.73:0/3801355088 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14a80c1c80 con 0x7f14a8152500 2023-12-12T09:46:38.103 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:38.100+0000 7f14ad4c6640 1 -- 172.21.15.73:0/3801355088 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3186547832 0 0) 0x7f14a00019f0 con 0x7f14a8152500 2023-12-12T09:46:38.103 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:38.100+0000 7f14ad4c6640 1 -- 172.21.15.73:0/3801355088 >> v1:172.21.15.73:6789/0 conn(0x7f14a8152500 legacy=0x7f14a8152990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:38.103 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:38.100+0000 7f14ad4c6640 1 --2- 172.21.15.73:0/3801355088 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f14a814f8c0 0x7f14940039a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:38.103 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:38.100+0000 7f14ad4c6640 1 --2- 172.21.15.73:0/3801355088 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1494003ee0 0x7f14940047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:38.103 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:38.100+0000 7f14ad4c6640 1 --2- 172.21.15.73:0/3801355088 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1494004d00 0x7f1494005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:38.103 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:38.100+0000 7f14ad4c6640 1 -- 172.21.15.73:0/3801355088 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f149400b9b0 con 0x7f1494004d00 2023-12-12T09:46:38.103 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:38.100+0000 7f14ad4c6640 1 -- 172.21.15.73:0/3801355088 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f149400bb20 con 0x7f1494003ee0 2023-12-12T09:46:38.103 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:38.100+0000 7f14ad4c6640 1 -- 172.21.15.73:0/3801355088 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f149400bce0 con 0x7f14a814f8c0 2023-12-12T09:46:38.103 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:38.100+0000 7f14aecc9640 1 --2- 172.21.15.73:0/3801355088 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1494004d00 0x7f1494005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:38.103 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:38.100+0000 7f14ae4c8640 1 --2- 172.21.15.73:0/3801355088 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f14a814f8c0 0x7f14940039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:38.104 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:38.100+0000 7f14aecc9640 1 -- 172.21.15.73:0/3801355088 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f14a814f8c0 msgr2=0x7f14940039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:46:38.104 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:38.100+0000 7f14aecc9640 1 --2- 172.21.15.73:0/3801355088 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f14a814f8c0 0x7f14940039a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:38.104 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:38.101+0000 7f14aecc9640 1 -- 172.21.15.73:0/3801355088 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1494003ee0 msgr2=0x7f14940047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:46:38.104 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:38.100+0000 7f14adcc7640 1 --2- 172.21.15.73:0/3801355088 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1494003ee0 0x7f14940047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:38.104 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:38.101+0000 7f14aecc9640 1 --2- 172.21.15.73:0/3801355088 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1494003ee0 0x7f14940047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:38.104 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:38.101+0000 7f14aecc9640 1 -- 172.21.15.73:0/3801355088 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1494003520 con 0x7f1494004d00 2023-12-12T09:46:38.104 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:38.101+0000 7f14adcc7640 1 --2- 172.21.15.73:0/3801355088 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1494003ee0 0x7f14940047c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:46:38.105 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:38.102+0000 7f14aecc9640 1 --2- 172.21.15.73:0/3801355088 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1494004d00 0x7f1494005180 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 crypto rx=0x7f14a000a7d0 tx=0x7f14940057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0cfeb064161aa0f server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:46:38.105 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:38.102+0000 7f14ad4c6640 1 -- 172.21.15.73:0/3801355088 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14a0034630 con 0x7f1494004d00 2023-12-12T09:46:38.105 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:38.102+0000 7f14ad4c6640 1 -- 172.21.15.73:0/3801355088 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14a002f070 con 0x7f1494004d00 2023-12-12T09:46:38.105 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:38.102+0000 7f14ad4c6640 1 -- 172.21.15.73:0/3801355088 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14a0034a30 con 0x7f1494004d00 2023-12-12T09:46:38.106 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:38.103+0000 7f14b072c640 1 -- 172.21.15.73:0/3801355088 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1494004d00 msgr2=0x7f1494005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:38.106 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:38.103+0000 7f14b072c640 1 --2- 172.21.15.73:0/3801355088 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1494004d00 0x7f1494005180 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 crypto rx=0x7f14a000a7d0 tx=0x7f14940057f0 comp rx=0 tx=0).stop 2023-12-12T09:46:38.106 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:38.103+0000 7f14aecc9640 1 -- 172.21.15.73:0/3801355088 reap_dead start 2023-12-12T09:46:38.106 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:38.103+0000 7f14b072c640 1 -- 172.21.15.73:0/3801355088 shutdown_connections 2023-12-12T09:46:38.106 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:38.103+0000 7f14b072c640 1 -- 172.21.15.73:0/3801355088 >> 172.21.15.73:0/3801355088 conn(0x7f14a806a4e0 msgr2=0x7f14a806a8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:46:38.106 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:38.103+0000 7f14b072c640 1 -- 172.21.15.73:0/3801355088 shutdown_connections 2023-12-12T09:46:38.106 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:38.103+0000 7f14b072c640 1 -- 172.21.15.73:0/3801355088 wait complete. 2023-12-12T09:46:38.106 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:38.105+0000 7f14b072c640 1 Processor -- start 2023-12-12T09:46:38.106 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:38.105+0000 7f14b072c640 1 -- start start 2023-12-12T09:46:38.107 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:38.106+0000 7f14b072c640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f14a80beff0 0x7f14a8144070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:38.107 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:38.106+0000 7f14b072c640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f14a8145280 0x7f14a81445b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:38.107 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:38.106+0000 7f14b072c640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f14a81ea5b0 0x7f14a81eaa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:38.108 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:38.106+0000 7f14b072c640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14a8149990 con 0x7f14a8145280 2023-12-12T09:46:38.108 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:38.106+0000 7f14b072c640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14a814b3a0 con 0x7f14a81ea5b0 2023-12-12T09:46:38.108 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:38.106+0000 7f14b072c640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14a8144af0 con 0x7f14a80beff0 2023-12-12T09:46:38.108 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:38.106+0000 7f14adcc7640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f14a8145280 0x7f14a81445b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:38.108 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:38.106+0000 7f14adcc7640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f14a8145280 0x7f14a81445b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:56002/0 (socket says 172.21.15.73:56002) 2023-12-12T09:46:38.108 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:38.106+0000 7f14adcc7640 1 -- 172.21.15.73:0/2295252612 learned_addr learned my addr 172.21.15.73:0/2295252612 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:46:38.109 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:38.106+0000 7f14adcc7640 1 -- 172.21.15.73:0/2295252612 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f14a80beff0 msgr2=0x7f14a8144070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:38.109 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:38.106+0000 7f14adcc7640 1 --2- 172.21.15.73:0/2295252612 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f14a80beff0 0x7f14a8144070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:38.109 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:38.106+0000 7f14adcc7640 1 -- 172.21.15.73:0/2295252612 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f14a81ea5b0 msgr2=0x7f14a81eaa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:38.109 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:38.106+0000 7f14adcc7640 1 --2- 172.21.15.73:0/2295252612 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f14a81ea5b0 0x7f14a81eaa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:38.109 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:38.106+0000 7f14adcc7640 1 -- 172.21.15.73:0/2295252612 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14a814a790 con 0x7f14a8145280 2023-12-12T09:46:38.109 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:38.107+0000 7f14adcc7640 1 --2- 172.21.15.73:0/2295252612 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f14a8145280 0x7f14a81445b0 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 crypto rx=0x7f149800d7f0 tx=0x7f149800dcb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:46:38.110 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:38.107+0000 7f149effd640 1 -- 172.21.15.73:0/2295252612 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f149800dea0 con 0x7f14a8145280 2023-12-12T09:46:38.110 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:38.107+0000 7f149effd640 1 -- 172.21.15.73:0/2295252612 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1498005480 con 0x7f14a8145280 2023-12-12T09:46:38.110 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:38.107+0000 7f149effd640 1 -- 172.21.15.73:0/2295252612 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f149800b830 con 0x7f14a8145280 2023-12-12T09:46:38.110 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:38.107+0000 7f14b072c640 1 -- 172.21.15.73:0/2295252612 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14a814aa70 con 0x7f14a8145280 2023-12-12T09:46:38.110 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:38.107+0000 7f14b072c640 1 -- 172.21.15.73:0/2295252612 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14a814b030 con 0x7f14a8145280 2023-12-12T09:46:38.110 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:38.109+0000 7f14b072c640 1 -- 172.21.15.73:0/2295252612 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f14a814b1f0 con 0x7f14a8145280 2023-12-12T09:46:38.110 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:38.109+0000 7f149effd640 1 -- 172.21.15.73:0/2295252612 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f149800b990 con 0x7f14a8145280 2023-12-12T09:46:38.112 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:38.110+0000 7f149effd640 1 --2- 172.21.15.73:0/2295252612 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f148c06ae70 0x7f148c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:38.112 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:38.110+0000 7f149effd640 1 -- 172.21.15.73:0/2295252612 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f14980895f0 con 0x7f14a8145280 2023-12-12T09:46:38.112 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:38.110+0000 7f14ae4c8640 1 --2- 172.21.15.73:0/2295252612 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f148c06ae70 0x7f148c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:38.112 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:38.111+0000 7f14ae4c8640 1 --2- 172.21.15.73:0/2295252612 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f148c06ae70 0x7f148c06d330 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f14a4009910 tx=0x7f14a4008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:46:38.116 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:38.115+0000 7f149effd640 1 -- 172.21.15.73:0/2295252612 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f1498054680 con 0x7f14a8145280 2023-12-12T09:46:38.306 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:38.304+0000 7f14b072c640 1 -- 172.21.15.73:0/2295252612 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f14a8067070 con 0x7f14a8145280 2023-12-12T09:46:38.306 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:38.305+0000 7f149effd640 1 -- 172.21.15.73:0/2295252612 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v75) v1 ==== 93+0+10 (secure 0 0 0) 0x7f1498019310 con 0x7f14a8145280 2023-12-12T09:46:38.306 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 1 2023-12-12T09:46:38.309 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:38.307+0000 7f14b072c640 1 -- 172.21.15.73:0/2295252612 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f148c06ae70 msgr2=0x7f148c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:38.309 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:38.307+0000 7f14b072c640 1 --2- 172.21.15.73:0/2295252612 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f148c06ae70 0x7f148c06d330 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f14a4009910 tx=0x7f14a4008040 comp rx=0 tx=0).stop 2023-12-12T09:46:38.309 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:38.308+0000 7f14b072c640 1 -- 172.21.15.73:0/2295252612 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f14a8145280 msgr2=0x7f14a81445b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:38.309 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:38.308+0000 7f14b072c640 1 --2- 172.21.15.73:0/2295252612 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f14a8145280 0x7f14a81445b0 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 crypto rx=0x7f149800d7f0 tx=0x7f149800dcb0 comp rx=0 tx=0).stop 2023-12-12T09:46:38.310 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:38.308+0000 7f14b072c640 1 -- 172.21.15.73:0/2295252612 shutdown_connections 2023-12-12T09:46:38.310 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:38.308+0000 7f14b072c640 1 --2- 172.21.15.73:0/2295252612 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f148c06ae70 0x7f148c06d330 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:38.310 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:38.308+0000 7f14b072c640 1 --2- 172.21.15.73:0/2295252612 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f14a81ea5b0 0x7f14a81eaa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:38.310 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:38.308+0000 7f14b072c640 1 --2- 172.21.15.73:0/2295252612 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f14a8145280 0x7f14a81445b0 unknown :-1 s=CLOSED pgs=910 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:38.310 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:38.308+0000 7f14b072c640 1 --2- 172.21.15.73:0/2295252612 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f14a80beff0 0x7f14a8144070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:38.310 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:38.308+0000 7f14b072c640 1 -- 172.21.15.73:0/2295252612 >> 172.21.15.73:0/2295252612 conn(0x7f14a806a4e0 msgr2=0x7f14a814c0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:46:38.310 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:38.308+0000 7f14b072c640 1 -- 172.21.15.73:0/2295252612 shutdown_connections 2023-12-12T09:46:38.310 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:38.308+0000 7f14b072c640 1 -- 172.21.15.73:0/2295252612 wait complete. 2023-12-12T09:46:38.328 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-12T09:46:38.548 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:38.546+0000 7f244b87c640 1 Processor -- start 2023-12-12T09:46:38.548 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:38.546+0000 7f244b87c640 1 -- start start 2023-12-12T09:46:38.550 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:38.548+0000 7f244b87c640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f2444070340 0x7f24440c32f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:38.550 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:38.548+0000 7f244b87c640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f24441588a0 0x7f24440c0f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:38.550 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:38.548+0000 7f244b87c640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24440c7510 con 0x7f24440c3830 2023-12-12T09:46:38.550 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:38.548+0000 7f244b87c640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2444158410 con 0x7f2444070340 2023-12-12T09:46:38.550 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:38.548+0000 7f244b87c640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f244406ce90 con 0x7f24441588a0 2023-12-12T09:46:38.551 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:38.549+0000 7f2448e17640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f24441588a0 0x7f24440c0f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:38.551 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:38.549+0000 7f2448e17640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f24441588a0 0x7f24440c0f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.73:44976/0 (socket says 172.21.15.73:44976) 2023-12-12T09:46:38.551 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:38.549+0000 7f2448e17640 1 -- 172.21.15.73:0/3250364604 learned_addr learned my addr 172.21.15.73:0/3250364604 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:46:38.551 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:38.549+0000 7f2449618640 1 --2- 172.21.15.73:0/3250364604 >> v2:172.21.15.142:3300/0 conn(0x7f2444070340 0x7f24440c32f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:38.551 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:38.550+0000 7f2448e17640 1 -- 172.21.15.73:0/3250364604 >> v2:172.21.15.142:3300/0 conn(0x7f2444070340 msgr2=0x7f24440c32f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:46:38.551 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:38.550+0000 7f2448e17640 1 --2- 172.21.15.73:0/3250364604 >> v2:172.21.15.142:3300/0 conn(0x7f2444070340 0x7f24440c32f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:38.552 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:38.550+0000 7f2448e17640 1 -- 172.21.15.73:0/3250364604 >> v1:172.21.15.142:6789/0 conn(0x7f24440c3830 legacy=0x7f24440c5aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:38.552 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:38.550+0000 7f2448e17640 1 -- 172.21.15.73:0/3250364604 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24440c7760 con 0x7f24441588a0 2023-12-12T09:46:38.552 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:38.550+0000 7f243bfff640 1 -- 172.21.15.73:0/3250364604 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1955341239 0 0) 0x7f24440c7510 con 0x7f24440c3830 2023-12-12T09:46:38.552 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:38.551+0000 7f2448e17640 1 --2- 172.21.15.73:0/3250364604 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f24441588a0 0x7f24440c0f10 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f24340098a0 tx=0x7f243402b8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=24e3b5472f9664a9 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:46:38.553 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:38.551+0000 7f243bfff640 1 -- 172.21.15.73:0/3250364604 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2434031640 con 0x7f24441588a0 2023-12-12T09:46:38.553 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:38.552+0000 7f243bfff640 1 -- 172.21.15.73:0/3250364604 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24340317a0 con 0x7f24441588a0 2023-12-12T09:46:38.553 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:38.552+0000 7f243bfff640 1 -- 172.21.15.73:0/3250364604 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2434031b30 con 0x7f24441588a0 2023-12-12T09:46:38.554 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:38.552+0000 7f244b87c640 1 -- 172.21.15.73:0/3250364604 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f24441588a0 msgr2=0x7f24440c0f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:38.554 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:38.552+0000 7f244b87c640 1 --2- 172.21.15.73:0/3250364604 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f24441588a0 0x7f24440c0f10 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f24340098a0 tx=0x7f243402b8f0 comp rx=0 tx=0).stop 2023-12-12T09:46:38.554 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:38.552+0000 7f244b87c640 1 -- 172.21.15.73:0/3250364604 shutdown_connections 2023-12-12T09:46:38.554 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:38.552+0000 7f244b87c640 1 --2- 172.21.15.73:0/3250364604 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f24441588a0 0x7f24440c0f10 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:38.554 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:38.552+0000 7f244b87c640 1 --2- 172.21.15.73:0/3250364604 >> v2:172.21.15.142:3300/0 conn(0x7f2444070340 0x7f24440c32f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:38.554 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:38.552+0000 7f244b87c640 1 -- 172.21.15.73:0/3250364604 >> 172.21.15.73:0/3250364604 conn(0x7f24440c7ba0 msgr2=0x7f24440c7fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:46:38.554 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:38.552+0000 7f244b87c640 1 -- 172.21.15.73:0/3250364604 shutdown_connections 2023-12-12T09:46:38.554 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:38.553+0000 7f244b87c640 1 -- 172.21.15.73:0/3250364604 wait complete. 2023-12-12T09:46:38.555 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:38.554+0000 7f244b87c640 1 Processor -- start 2023-12-12T09:46:38.556 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:38.554+0000 7f244b87c640 1 -- start start 2023-12-12T09:46:38.557 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:38.555+0000 7f244b87c640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2444070340 0x7f244409ac30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:38.557 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:38.555+0000 7f244b87c640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f24440c3830 0x7f2444156350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:38.557 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:38.555+0000 7f244b87c640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f24441588a0 0x7f2444151070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:38.557 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:38.555+0000 7f244b87c640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24440999d0 con 0x7f24441588a0 2023-12-12T09:46:38.557 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:38.555+0000 7f244b87c640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24441ea7f0 con 0x7f2444070340 2023-12-12T09:46:38.557 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:38.555+0000 7f244b87c640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2444099be0 con 0x7f24440c3830 2023-12-12T09:46:38.557 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:38.556+0000 7f2449e19640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f24441588a0 0x7f2444151070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:38.557 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:38.556+0000 7f2449e19640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f24441588a0 0x7f2444151070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:56010/0 (socket says 172.21.15.73:56010) 2023-12-12T09:46:38.557 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:38.556+0000 7f2449e19640 1 -- 172.21.15.73:0/3318062049 learned_addr learned my addr 172.21.15.73:0/3318062049 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:46:38.559 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:38.556+0000 7f2448e17640 1 --2- 172.21.15.73:0/3318062049 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f24440c3830 0x7f2444156350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:38.559 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:38.556+0000 7f2449618640 1 --2- 172.21.15.73:0/3318062049 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2444070340 0x7f244409ac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:38.559 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:38.556+0000 7f2449e19640 1 -- 172.21.15.73:0/3318062049 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f24440c3830 msgr2=0x7f2444156350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:38.559 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:38.556+0000 7f2449e19640 1 --2- 172.21.15.73:0/3318062049 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f24440c3830 0x7f2444156350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:38.559 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:38.556+0000 7f2449e19640 1 -- 172.21.15.73:0/3318062049 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2444070340 msgr2=0x7f244409ac30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:38.559 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:38.556+0000 7f2449e19640 1 --2- 172.21.15.73:0/3318062049 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2444070340 0x7f244409ac30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:38.560 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:38.556+0000 7f2449e19640 1 -- 172.21.15.73:0/3318062049 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24340094d0 con 0x7f24441588a0 2023-12-12T09:46:38.561 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:38.556+0000 7f2449e19640 1 --2- 172.21.15.73:0/3318062049 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f24441588a0 0x7f2444151070 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7f243c001560 tx=0x7f243c00cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:46:38.561 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:38.557+0000 7f2439ffb640 1 -- 172.21.15.73:0/3318062049 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f243c003da0 con 0x7f24441588a0 2023-12-12T09:46:38.561 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:38.557+0000 7f2439ffb640 1 -- 172.21.15.73:0/3318062049 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f243c005070 con 0x7f24441588a0 2023-12-12T09:46:38.561 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:38.557+0000 7f244b87c640 1 -- 172.21.15.73:0/3318062049 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2444099ec0 con 0x7f24441588a0 2023-12-12T09:46:38.561 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:38.557+0000 7f2439ffb640 1 -- 172.21.15.73:0/3318062049 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f243c005420 con 0x7f24441588a0 2023-12-12T09:46:38.561 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:38.557+0000 7f244b87c640 1 -- 172.21.15.73:0/3318062049 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2444156890 con 0x7f24441588a0 2023-12-12T09:46:38.562 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:38.558+0000 7f244b87c640 1 -- 172.21.15.73:0/3318062049 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2444067ef0 con 0x7f24441588a0 2023-12-12T09:46:38.562 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:38.559+0000 7f2439ffb640 1 -- 172.21.15.73:0/3318062049 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f243c005580 con 0x7f24441588a0 2023-12-12T09:46:38.562 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:38.560+0000 7f2439ffb640 1 --2- 172.21.15.73:0/3318062049 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f242806ae40 0x7f242806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:38.562 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:38.560+0000 7f2439ffb640 1 -- 172.21.15.73:0/3318062049 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f243c088ec0 con 0x7f24441588a0 2023-12-12T09:46:38.562 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:38.561+0000 7f2449618640 1 --2- 172.21.15.73:0/3318062049 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f242806ae40 0x7f242806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:38.562 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:38.561+0000 7f2449618640 1 --2- 172.21.15.73:0/3318062049 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f242806ae40 0x7f242806d300 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f2440009ad0 tx=0x7f2440008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:46:38.566 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:38.565+0000 7f2439ffb640 1 -- 172.21.15.73:0/3318062049 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f243c053f60 con 0x7f24441588a0 2023-12-12T09:46:38.753 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:38.752+0000 7f244b87c640 1 -- 172.21.15.73:0/3318062049 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f24440aac60 con 0x7f24441588a0 2023-12-12T09:46:38.754 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:38.752+0000 7f2439ffb640 1 -- 172.21.15.73:0/3318062049 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v75) v1 ==== 104+0+11 (secure 0 0 0) 0x7f24440aac60 con 0x7f24441588a0 2023-12-12T09:46:38.754 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 32 2023-12-12T09:46:38.757 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:38.755+0000 7f244b87c640 1 -- 172.21.15.73:0/3318062049 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f242806ae40 msgr2=0x7f242806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:38.757 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:38.755+0000 7f244b87c640 1 --2- 172.21.15.73:0/3318062049 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f242806ae40 0x7f242806d300 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f2440009ad0 tx=0x7f2440008040 comp rx=0 tx=0).stop 2023-12-12T09:46:38.757 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:38.755+0000 7f244b87c640 1 -- 172.21.15.73:0/3318062049 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f24441588a0 msgr2=0x7f2444151070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:38.757 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:38.755+0000 7f244b87c640 1 --2- 172.21.15.73:0/3318062049 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f24441588a0 0x7f2444151070 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7f243c001560 tx=0x7f243c00cc70 comp rx=0 tx=0).stop 2023-12-12T09:46:38.757 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:38.755+0000 7f244b87c640 1 -- 172.21.15.73:0/3318062049 shutdown_connections 2023-12-12T09:46:38.757 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:38.755+0000 7f244b87c640 1 --2- 172.21.15.73:0/3318062049 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f242806ae40 0x7f242806d300 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:38.757 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:38.755+0000 7f244b87c640 1 --2- 172.21.15.73:0/3318062049 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f24441588a0 0x7f2444151070 unknown :-1 s=CLOSED pgs=911 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:38.757 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:38.755+0000 7f244b87c640 1 --2- 172.21.15.73:0/3318062049 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f24440c3830 0x7f2444156350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:38.757 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:38.755+0000 7f244b87c640 1 --2- 172.21.15.73:0/3318062049 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2444070340 0x7f244409ac30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:38.757 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:38.755+0000 7f244b87c640 1 -- 172.21.15.73:0/3318062049 >> 172.21.15.73:0/3318062049 conn(0x7f24440c7ba0 msgr2=0x7f2444157340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:46:38.758 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:38.755+0000 7f244b87c640 1 -- 172.21.15.73:0/3318062049 shutdown_connections 2023-12-12T09:46:38.758 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:38.755+0000 7f244b87c640 1 -- 172.21.15.73:0/3318062049 wait complete. 2023-12-12T09:46:38.774 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-12T09:46:38.988 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:38.986+0000 7efcfecc9640 1 Processor -- start 2023-12-12T09:46:38.988 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:38.987+0000 7efcfecc9640 1 -- start start 2023-12-12T09:46:38.989 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:38.988+0000 7efcfecc9640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efcf806d350 0x7efcf806dc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:38.990 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:38.988+0000 7efcfecc9640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efcf80c16c0 con 0x7efcf8152500 2023-12-12T09:46:38.990 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:38.988+0000 7efcfecc9640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efcf80c19a0 con 0x7efcf814f8c0 2023-12-12T09:46:38.990 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:38.988+0000 7efcfecc9640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efcf80c1090 con 0x7efcf806d350 2023-12-12T09:46:38.990 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:38.988+0000 7efcfd266640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7efcf8152500 0x7efcf8152990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:50812/0 (socket says 172.21.15.73:50812) 2023-12-12T09:46:38.990 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:38.988+0000 7efcfd266640 1 -- 172.21.15.73:0/15363178 learned_addr learned my addr 172.21.15.73:0/15363178 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-12T09:46:38.992 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:38.989+0000 7efcf7fff640 1 --2- 172.21.15.73:0/15363178 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efcf806d350 0x7efcf806dc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:38.992 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:38.989+0000 7efcf77fe640 1 -- 172.21.15.73:0/15363178 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2228422608 0 0) 0x7efcf80c16c0 con 0x7efcf8152500 2023-12-12T09:46:38.992 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:38.989+0000 7efcf77fe640 1 -- 172.21.15.73:0/15363178 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efce0003520 con 0x7efcf8152500 2023-12-12T09:46:38.992 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:38.989+0000 7efcf77fe640 1 -- 172.21.15.73:0/15363178 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3104138504 0 0) 0x7efce0003520 con 0x7efcf8152500 2023-12-12T09:46:38.992 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:38.989+0000 7efcf77fe640 1 -- 172.21.15.73:0/15363178 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efcf806d350 msgr2=0x7efcf806dc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:46:38.992 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:38.989+0000 7efcf77fe640 1 --2- 172.21.15.73:0/15363178 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efcf806d350 0x7efcf806dc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:38.992 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:38.989+0000 7efcf77fe640 1 -- 172.21.15.73:0/15363178 >> v1:172.21.15.142:6789/0 conn(0x7efcf814f8c0 legacy=0x7efcf8071e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:38.992 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:38.989+0000 7efcf77fe640 1 -- 172.21.15.73:0/15363178 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcf80c1c80 con 0x7efcf8152500 2023-12-12T09:46:38.993 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:38.989+0000 7efcf77fe640 1 -- 172.21.15.73:0/15363178 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3186547832 0 0) 0x7efcf00019f0 con 0x7efcf8152500 2023-12-12T09:46:38.993 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:38.989+0000 7efcf77fe640 1 -- 172.21.15.73:0/15363178 >> v1:172.21.15.73:6789/0 conn(0x7efcf8152500 legacy=0x7efcf8152990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:38.993 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:38.989+0000 7efcf77fe640 1 --2- 172.21.15.73:0/15363178 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efce00039a0 0x7efce0003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:38.993 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:38.989+0000 7efcf77fe640 1 --2- 172.21.15.73:0/15363178 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efce00047c0 0x7efce0004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:38.993 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:38.989+0000 7efcf77fe640 1 --2- 172.21.15.73:0/15363178 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efcf806d350 0x7efce00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:38.993 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:38.989+0000 7efcf77fe640 1 -- 172.21.15.73:0/15363178 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efce000ba80 con 0x7efce00039a0 2023-12-12T09:46:38.993 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:38.989+0000 7efcf77fe640 1 -- 172.21.15.73:0/15363178 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efce000bbf0 con 0x7efce00047c0 2023-12-12T09:46:38.993 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:38.989+0000 7efcf77fe640 1 -- 172.21.15.73:0/15363178 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efce000bdb0 con 0x7efcf806d350 2023-12-12T09:46:38.993 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:38.990+0000 7efcfca65640 1 --2- 172.21.15.73:0/15363178 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efce00039a0 0x7efce0003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:38.993 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:38.990+0000 7efcfd266640 1 --2- 172.21.15.73:0/15363178 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efcf806d350 0x7efce00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:38.993 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:38.990+0000 7efcf7fff640 1 --2- 172.21.15.73:0/15363178 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efce00047c0 0x7efce0004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:38.993 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:38.990+0000 7efcfca65640 1 -- 172.21.15.73:0/15363178 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efcf806d350 msgr2=0x7efce00051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:46:38.993 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:38.990+0000 7efcfca65640 1 --2- 172.21.15.73:0/15363178 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efcf806d350 0x7efce00051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:38.993 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:38.990+0000 7efcfca65640 1 -- 172.21.15.73:0/15363178 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efce00047c0 msgr2=0x7efce0004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:46:38.993 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:38.990+0000 7efcfca65640 1 --2- 172.21.15.73:0/15363178 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efce00047c0 0x7efce0004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:38.994 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:38.990+0000 7efcfca65640 1 -- 172.21.15.73:0/15363178 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efce0003520 con 0x7efce00039a0 2023-12-12T09:46:38.994 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:38.990+0000 7efcf7fff640 1 --2- 172.21.15.73:0/15363178 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efce00047c0 0x7efce0004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:46:38.994 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:38.990+0000 7efcfd266640 1 --2- 172.21.15.73:0/15363178 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efcf806d350 0x7efce00051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:46:38.995 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:38.991+0000 7efcfca65640 1 --2- 172.21.15.73:0/15363178 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efce00039a0 0x7efce0003dc0 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 crypto rx=0x7efce8001750 tx=0x7efce00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a042a9c97029a0ad server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:46:38.995 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:38.992+0000 7efcf77fe640 1 -- 172.21.15.73:0/15363178 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efce80052d0 con 0x7efce00039a0 2023-12-12T09:46:38.995 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:38.992+0000 7efcf77fe640 1 -- 172.21.15.73:0/15363178 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efce802e050 con 0x7efce00039a0 2023-12-12T09:46:38.995 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:38.992+0000 7efcf77fe640 1 -- 172.21.15.73:0/15363178 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efce80035f0 con 0x7efce00039a0 2023-12-12T09:46:38.995 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:38.992+0000 7efcfecc9640 1 -- 172.21.15.73:0/15363178 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efce00039a0 msgr2=0x7efce0003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:38.995 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:38.992+0000 7efcfecc9640 1 --2- 172.21.15.73:0/15363178 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efce00039a0 0x7efce0003dc0 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 crypto rx=0x7efce8001750 tx=0x7efce00057f0 comp rx=0 tx=0).stop 2023-12-12T09:46:38.995 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:38.992+0000 7efcfd266640 1 -- 172.21.15.73:0/15363178 reap_dead start 2023-12-12T09:46:38.995 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:38.992+0000 7efcfecc9640 1 -- 172.21.15.73:0/15363178 shutdown_connections 2023-12-12T09:46:38.995 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:38.992+0000 7efcfecc9640 1 -- 172.21.15.73:0/15363178 >> 172.21.15.73:0/15363178 conn(0x7efcf806a4e0 msgr2=0x7efcf806a8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:46:38.995 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:38.992+0000 7efcfecc9640 1 -- 172.21.15.73:0/15363178 shutdown_connections 2023-12-12T09:46:38.995 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:38.992+0000 7efcfecc9640 1 -- 172.21.15.73:0/15363178 wait complete. 2023-12-12T09:46:38.997 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:38.994+0000 7efcfecc9640 1 Processor -- start 2023-12-12T09:46:38.997 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:38.994+0000 7efcfecc9640 1 -- start start 2023-12-12T09:46:38.997 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:38.995+0000 7efcfecc9640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efce00039a0 0x7efcf80a8730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:38.997 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:38.995+0000 7efcfecc9640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efcf80a6070 0x7efcf81eb560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:38.997 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:38.995+0000 7efcfecc9640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efcf80a9a80 0x7efcf80bf990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:38.997 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:38.995+0000 7efcfecc9640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcf80aa290 con 0x7efcf80a6070 2023-12-12T09:46:38.997 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:38.995+0000 7efcfecc9640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcf80a6ee0 con 0x7efce00039a0 2023-12-12T09:46:38.998 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:38.995+0000 7efcfecc9640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efcf80a7130 con 0x7efcf80a9a80 2023-12-12T09:46:38.998 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:38.995+0000 7efcf7fff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efcf80a6070 0x7efcf81eb560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:38.998 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:38.995+0000 7efcf7fff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efcf80a6070 0x7efcf81eb560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:53808/0 (socket says 172.21.15.73:53808) 2023-12-12T09:46:38.998 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:38.995+0000 7efcf7fff640 1 -- 172.21.15.73:0/3941484922 learned_addr learned my addr 172.21.15.73:0/3941484922 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:46:38.998 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:38.996+0000 7efcfca65640 1 --2- 172.21.15.73:0/3941484922 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efce00039a0 0x7efcf80a8730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:38.998 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:38.996+0000 7efcf7fff640 1 -- 172.21.15.73:0/3941484922 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efcf80a9a80 msgr2=0x7efcf80bf990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:38.998 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:38.996+0000 7efcf7fff640 1 --2- 172.21.15.73:0/3941484922 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efcf80a9a80 0x7efcf80bf990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:38.998 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:38.996+0000 7efcf7fff640 1 -- 172.21.15.73:0/3941484922 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efce00039a0 msgr2=0x7efcf80a8730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:38.998 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:38.996+0000 7efcf7fff640 1 --2- 172.21.15.73:0/3941484922 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efce00039a0 0x7efcf80a8730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:38.998 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:38.996+0000 7efcf7fff640 1 -- 172.21.15.73:0/3941484922 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcf81ead60 con 0x7efcf80a6070 2023-12-12T09:46:38.998 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:38.996+0000 7efcfca65640 1 --2- 172.21.15.73:0/3941484922 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efce00039a0 0x7efcf80a8730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:46:38.998 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:38.996+0000 7efcf7fff640 1 --2- 172.21.15.73:0/3941484922 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efcf80a6070 0x7efcf81eb560 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7efcec00e7e0 tx=0x7efcec00eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:46:38.999 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:38.996+0000 7efcf57fa640 1 -- 172.21.15.73:0/3941484922 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcec00c6d0 con 0x7efcf80a6070 2023-12-12T09:46:38.999 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:38.996+0000 7efcf57fa640 1 -- 172.21.15.73:0/3941484922 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efcec00c830 con 0x7efcf80a6070 2023-12-12T09:46:38.999 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:38.996+0000 7efcf57fa640 1 -- 172.21.15.73:0/3941484922 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcec00cba0 con 0x7efcf80a6070 2023-12-12T09:46:38.999 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:38.996+0000 7efcfecc9640 1 -- 172.21.15.73:0/3941484922 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efcf81eb040 con 0x7efcf80a6070 2023-12-12T09:46:38.999 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:38.997+0000 7efcfecc9640 1 -- 172.21.15.73:0/3941484922 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efcf80a7410 con 0x7efcf80a6070 2023-12-12T09:46:38.999 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:38.998+0000 7efcfecc9640 1 -- 172.21.15.73:0/3941484922 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efcf8067070 con 0x7efcf80a6070 2023-12-12T09:46:39.000 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:38.999+0000 7efcf57fa640 1 -- 172.21.15.73:0/3941484922 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7efcec00cd00 con 0x7efcf80a6070 2023-12-12T09:46:39.002 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:39.001+0000 7efcf57fa640 1 --2- 172.21.15.73:0/3941484922 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7efce406ae40 0x7efce406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:39.002 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:39.001+0000 7efcf57fa640 1 -- 172.21.15.73:0/3941484922 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 5709+0+0 (secure 0 0 0) 0x7efcec089370 con 0x7efcf80a6070 2023-12-12T09:46:39.002 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:39.001+0000 7efcfca65640 1 --2- 172.21.15.73:0/3941484922 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7efce406ae40 0x7efce406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:39.003 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:39.002+0000 7efcfca65640 1 --2- 172.21.15.73:0/3941484922 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7efce406ae40 0x7efce406d300 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7efce8033000 tx=0x7efce8009030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:46:39.006 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:39.005+0000 7efcf57fa640 1 -- 172.21.15.73:0/3941484922 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7efcec054380 con 0x7efcf80a6070 2023-12-12T09:46:39.196 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:39.194+0000 7efcfecc9640 1 -- 172.21.15.73:0/3941484922 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7efcf8067580 con 0x7efcf80a6070 2023-12-12T09:46:39.197 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:39.195+0000 7efcf57fa640 1 -- 172.21.15.73:0/3941484922 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v75) v1 ==== 100+0+11 (secure 0 0 0) 0x7efcec0579a0 con 0x7efcf80a6070 2023-12-12T09:46:39.197 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 64 2023-12-12T09:46:39.199 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:39.197+0000 7efcfecc9640 1 -- 172.21.15.73:0/3941484922 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7efce406ae40 msgr2=0x7efce406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:39.199 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:39.197+0000 7efcfecc9640 1 --2- 172.21.15.73:0/3941484922 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7efce406ae40 0x7efce406d300 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7efce8033000 tx=0x7efce8009030 comp rx=0 tx=0).stop 2023-12-12T09:46:39.199 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:39.197+0000 7efcfecc9640 1 -- 172.21.15.73:0/3941484922 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efcf80a6070 msgr2=0x7efcf81eb560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:39.200 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:39.197+0000 7efcfecc9640 1 --2- 172.21.15.73:0/3941484922 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efcf80a6070 0x7efcf81eb560 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7efcec00e7e0 tx=0x7efcec00eca0 comp rx=0 tx=0).stop 2023-12-12T09:46:39.200 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:39.198+0000 7efcfecc9640 1 -- 172.21.15.73:0/3941484922 shutdown_connections 2023-12-12T09:46:39.200 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:39.198+0000 7efcfecc9640 1 --2- 172.21.15.73:0/3941484922 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7efce406ae40 0x7efce406d300 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:39.200 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:39.198+0000 7efcfecc9640 1 --2- 172.21.15.73:0/3941484922 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efcf80a9a80 0x7efcf80bf990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:39.200 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:39.198+0000 7efcfecc9640 1 --2- 172.21.15.73:0/3941484922 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efcf80a6070 0x7efcf81eb560 unknown :-1 s=CLOSED pgs=914 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:39.200 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:39.198+0000 7efcfecc9640 1 --2- 172.21.15.73:0/3941484922 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efce00039a0 0x7efcf80a8730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:39.200 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:39.198+0000 7efcfecc9640 1 -- 172.21.15.73:0/3941484922 >> 172.21.15.73:0/3941484922 conn(0x7efcf806a4e0 msgr2=0x7efcf80c4e10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:46:39.200 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:39.198+0000 7efcfecc9640 1 -- 172.21.15.73:0/3941484922 shutdown_connections 2023-12-12T09:46:39.200 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:39.198+0000 7efcfecc9640 1 -- 172.21.15.73:0/3941484922 wait complete. 2023-12-12T09:46:39.218 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-12-12T09:46:39.426 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:39.425+0000 7f2ab307e640 1 Processor -- start 2023-12-12T09:46:39.426 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:39.425+0000 7f2ab307e640 1 -- start start 2023-12-12T09:46:39.428 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:39.426+0000 7f2ab307e640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2aac0c5160 0x7f2aac151680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:39.428 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:39.426+0000 7f2ab307e640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f2aac151bc0 0x7f2aac0c37b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:39.428 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:39.426+0000 7f2ab307e640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2aac06d8d0 con 0x7f2aac0bef50 2023-12-12T09:46:39.428 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:39.426+0000 7f2ab307e640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2aac152050 con 0x7f2aac151bc0 2023-12-12T09:46:39.428 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:39.426+0000 7f2ab307e640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2aac0c4d70 con 0x7f2aac0c5160 2023-12-12T09:46:39.429 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:39.427+0000 7f2ab187b640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2aac0c5160 0x7f2aac151680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:39.429 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:39.427+0000 7f2ab207c640 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f2aac0bef50 0x7f2aac158270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.73:56236/0 (socket says 172.21.15.73:56236) 2023-12-12T09:46:39.429 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:39.427+0000 7f2ab207c640 1 -- 172.21.15.73:0/152733259 learned_addr learned my addr 172.21.15.73:0/152733259 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-12T09:46:39.429 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:39.427+0000 7f2ab287d640 1 --2- 172.21.15.73:0/152733259 >> v2:172.21.15.142:3300/0 conn(0x7f2aac151bc0 0x7f2aac0c37b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:39.430 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:39.428+0000 7f2ab187b640 1 -- 172.21.15.73:0/152733259 >> v2:172.21.15.142:3300/0 conn(0x7f2aac151bc0 msgr2=0x7f2aac0c37b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:46:39.430 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:39.428+0000 7f2ab187b640 1 --2- 172.21.15.73:0/152733259 >> v2:172.21.15.142:3300/0 conn(0x7f2aac151bc0 0x7f2aac0c37b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:39.430 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:39.428+0000 7f2ab187b640 1 -- 172.21.15.73:0/152733259 >> v1:172.21.15.142:6789/0 conn(0x7f2aac0bef50 legacy=0x7f2aac158270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:39.430 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:39.428+0000 7f2ab187b640 1 -- 172.21.15.73:0/152733259 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2aac06ccc0 con 0x7f2aac0c5160 2023-12-12T09:46:39.431 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:39.429+0000 7f2ab187b640 1 --2- 172.21.15.73:0/152733259 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2aac0c5160 0x7f2aac151680 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f2aa00097a0 tx=0x7f2aa002b820 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b8f054caf0df2e92 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:46:39.432 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:39.430+0000 7f2ab107a640 1 -- 172.21.15.73:0/152733259 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2aa0031780 con 0x7f2aac0c5160 2023-12-12T09:46:39.432 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:39.430+0000 7f2ab107a640 1 -- 172.21.15.73:0/152733259 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2aa00318e0 con 0x7f2aac0c5160 2023-12-12T09:46:39.432 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:39.430+0000 7f2ab107a640 1 -- 172.21.15.73:0/152733259 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2aa0031c70 con 0x7f2aac0c5160 2023-12-12T09:46:39.433 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:39.431+0000 7f2ab307e640 1 -- 172.21.15.73:0/152733259 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2aac0c5160 msgr2=0x7f2aac151680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:39.433 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:39.431+0000 7f2ab307e640 1 --2- 172.21.15.73:0/152733259 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2aac0c5160 0x7f2aac151680 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f2aa00097a0 tx=0x7f2aa002b820 comp rx=0 tx=0).stop 2023-12-12T09:46:39.433 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:39.431+0000 7f2ab307e640 1 -- 172.21.15.73:0/152733259 shutdown_connections 2023-12-12T09:46:39.433 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:39.431+0000 7f2ab307e640 1 --2- 172.21.15.73:0/152733259 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2aac0c5160 0x7f2aac151680 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:39.433 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:39.431+0000 7f2ab307e640 1 --2- 172.21.15.73:0/152733259 >> v2:172.21.15.142:3300/0 conn(0x7f2aac151bc0 0x7f2aac0c37b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:39.433 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:39.431+0000 7f2ab307e640 1 -- 172.21.15.73:0/152733259 >> 172.21.15.73:0/152733259 conn(0x7f2aac0c23b0 msgr2=0x7f2aac0c2790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:46:39.433 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:39.431+0000 7f2ab307e640 1 -- 172.21.15.73:0/152733259 shutdown_connections 2023-12-12T09:46:39.433 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:39.431+0000 7f2ab307e640 1 -- 172.21.15.73:0/152733259 wait complete. 2023-12-12T09:46:39.434 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:39.433+0000 7f2ab307e640 1 Processor -- start 2023-12-12T09:46:39.435 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:39.433+0000 7f2ab307e640 1 -- start start 2023-12-12T09:46:39.436 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:39.434+0000 7f2ab307e640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2aac0bef50 0x7f2aac0a6b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:39.436 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:39.434+0000 7f2ab307e640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2aac0c5160 0x7f2aac1524f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:39.436 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:39.434+0000 7f2ab307e640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2aac151bc0 0x7f2aac152a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:39.436 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:39.434+0000 7f2ab307e640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2aac152f70 con 0x7f2aac151bc0 2023-12-12T09:46:39.436 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:39.434+0000 7f2ab307e640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2aac1551c0 con 0x7f2aac0c5160 2023-12-12T09:46:39.436 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:39.434+0000 7f2ab307e640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2aac071b20 con 0x7f2aac0bef50 2023-12-12T09:46:39.437 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:39.435+0000 7f2ab287d640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2aac151bc0 0x7f2aac152a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:39.437 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:39.435+0000 7f2ab287d640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2aac151bc0 0x7f2aac152a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:53822/0 (socket says 172.21.15.73:53822) 2023-12-12T09:46:39.437 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:39.435+0000 7f2ab287d640 1 -- 172.21.15.73:0/1333559721 learned_addr learned my addr 172.21.15.73:0/1333559721 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:46:39.438 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:39.435+0000 7f2ab187b640 1 --2- 172.21.15.73:0/1333559721 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2aac0c5160 0x7f2aac1524f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:39.438 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:39.435+0000 7f2ab207c640 1 --2- 172.21.15.73:0/1333559721 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2aac0bef50 0x7f2aac0a6b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:39.438 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:39.435+0000 7f2ab287d640 1 -- 172.21.15.73:0/1333559721 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2aac0bef50 msgr2=0x7f2aac0a6b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:39.438 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:39.435+0000 7f2ab287d640 1 --2- 172.21.15.73:0/1333559721 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2aac0bef50 0x7f2aac0a6b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:39.438 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:39.435+0000 7f2ab287d640 1 -- 172.21.15.73:0/1333559721 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2aac0c5160 msgr2=0x7f2aac1524f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:39.438 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:39.435+0000 7f2ab287d640 1 --2- 172.21.15.73:0/1333559721 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2aac0c5160 0x7f2aac1524f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:39.438 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:39.435+0000 7f2ab287d640 1 -- 172.21.15.73:0/1333559721 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2aa0009400 con 0x7f2aac151bc0 2023-12-12T09:46:39.438 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:39.435+0000 7f2ab207c640 1 --2- 172.21.15.73:0/1333559721 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2aac0bef50 0x7f2aac0a6b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:46:39.439 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:39.436+0000 7f2ab287d640 1 --2- 172.21.15.73:0/1333559721 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2aac151bc0 0x7f2aac152a30 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 crypto rx=0x7f2aa400efc0 tx=0x7f2aa400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:46:39.439 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:39.436+0000 7f2a9effd640 1 -- 172.21.15.73:0/1333559721 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2aa4014480 con 0x7f2aac151bc0 2023-12-12T09:46:39.439 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:39.436+0000 7f2a9effd640 1 -- 172.21.15.73:0/1333559721 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2aa400f040 con 0x7f2aac151bc0 2023-12-12T09:46:39.439 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:39.436+0000 7f2ab307e640 1 -- 172.21.15.73:0/1333559721 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2aac072500 con 0x7f2aac151bc0 2023-12-12T09:46:39.439 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:39.436+0000 7f2a9effd640 1 -- 172.21.15.73:0/1333559721 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2aa4014820 con 0x7f2aac151bc0 2023-12-12T09:46:39.439 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:39.436+0000 7f2ab307e640 1 -- 172.21.15.73:0/1333559721 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2aac1ed930 con 0x7f2aac151bc0 2023-12-12T09:46:39.439 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:39.437+0000 7f2ab307e640 1 -- 172.21.15.73:0/1333559721 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2aac071d10 con 0x7f2aac151bc0 2023-12-12T09:46:39.439 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:39.438+0000 7f2a9effd640 1 -- 172.21.15.73:0/1333559721 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f2aa4014980 con 0x7f2aac151bc0 2023-12-12T09:46:39.441 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:39.439+0000 7f2a9effd640 1 --2- 172.21.15.73:0/1333559721 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f2a9006ae70 0x7f2a9006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:39.441 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:39.439+0000 7f2a9effd640 1 -- 172.21.15.73:0/1333559721 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2aa408a180 con 0x7f2aac151bc0 2023-12-12T09:46:39.441 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:39.440+0000 7f2ab207c640 1 --2- 172.21.15.73:0/1333559721 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f2a9006ae70 0x7f2a9006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:39.442 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:39.440+0000 7f2ab207c640 1 --2- 172.21.15.73:0/1333559721 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f2a9006ae70 0x7f2a9006d330 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f2aa8005880 tx=0x7f2aa8009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:46:39.446 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:39.444+0000 7f2a9effd640 1 -- 172.21.15.73:0/1333559721 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f2aac071d10 con 0x7f2aac151bc0 2023-12-12T09:46:39.627 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:39.626+0000 7f2ab307e640 1 -- 172.21.15.73:0/1333559721 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f2aac071d10 con 0x7f2aac151bc0 2023-12-12T09:46:39.628 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:39.626+0000 7f2a9effd640 1 -- 172.21.15.73:0/1333559721 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v75) v1 ==== 84+0+209 (secure 0 0 0) 0x7f2aac071d10 con 0x7f2aac151bc0 2023-12-12T09:46:39.628 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-12T09:46:39.628 INFO:teuthology.orchestra.run.smithi073.stdout:[ 2023-12-12T09:46:39.628 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-12-12T09:46:39.629 INFO:teuthology.orchestra.run.smithi073.stdout: "poolnum": 1, 2023-12-12T09:46:39.629 INFO:teuthology.orchestra.run.smithi073.stdout: "poolname": ".mgr" 2023-12-12T09:46:39.629 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-12-12T09:46:39.629 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-12-12T09:46:39.629 INFO:teuthology.orchestra.run.smithi073.stdout: "poolnum": 12, 2023-12-12T09:46:39.629 INFO:teuthology.orchestra.run.smithi073.stdout: "poolname": "cephfs_metadata" 2023-12-12T09:46:39.629 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-12-12T09:46:39.629 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-12-12T09:46:39.629 INFO:teuthology.orchestra.run.smithi073.stdout: "poolnum": 13, 2023-12-12T09:46:39.629 INFO:teuthology.orchestra.run.smithi073.stdout: "poolname": "cephfs_data" 2023-12-12T09:46:39.629 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-12-12T09:46:39.629 INFO:teuthology.orchestra.run.smithi073.stdout:] 2023-12-12T09:46:39.631 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:39.629+0000 7f2ab307e640 1 -- 172.21.15.73:0/1333559721 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f2a9006ae70 msgr2=0x7f2a9006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:39.631 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:39.629+0000 7f2ab307e640 1 --2- 172.21.15.73:0/1333559721 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f2a9006ae70 0x7f2a9006d330 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f2aa8005880 tx=0x7f2aa8009040 comp rx=0 tx=0).stop 2023-12-12T09:46:39.631 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:39.629+0000 7f2ab307e640 1 -- 172.21.15.73:0/1333559721 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2aac151bc0 msgr2=0x7f2aac152a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:39.631 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:39.629+0000 7f2ab307e640 1 --2- 172.21.15.73:0/1333559721 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2aac151bc0 0x7f2aac152a30 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 crypto rx=0x7f2aa400efc0 tx=0x7f2aa400c490 comp rx=0 tx=0).stop 2023-12-12T09:46:39.631 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:39.629+0000 7f2ab307e640 1 -- 172.21.15.73:0/1333559721 shutdown_connections 2023-12-12T09:46:39.631 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:39.629+0000 7f2ab307e640 1 --2- 172.21.15.73:0/1333559721 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f2a9006ae70 0x7f2a9006d330 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:39.631 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:39.629+0000 7f2ab307e640 1 --2- 172.21.15.73:0/1333559721 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2aac151bc0 0x7f2aac152a30 unknown :-1 s=CLOSED pgs=915 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:39.631 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:39.629+0000 7f2ab307e640 1 --2- 172.21.15.73:0/1333559721 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2aac0c5160 0x7f2aac1524f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:39.631 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:39.629+0000 7f2ab307e640 1 --2- 172.21.15.73:0/1333559721 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2aac0bef50 0x7f2aac0a6b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:39.632 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:39.629+0000 7f2ab307e640 1 -- 172.21.15.73:0/1333559721 >> 172.21.15.73:0/1333559721 conn(0x7f2aac0c23b0 msgr2=0x7f2aac14bc90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:46:39.632 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:39.629+0000 7f2ab307e640 1 -- 172.21.15.73:0/1333559721 shutdown_connections 2023-12-12T09:46:39.632 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:39.629+0000 7f2ab307e640 1 -- 172.21.15.73:0/1333559721 wait complete. 2023-12-12T09:46:39.647 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs2' 2023-12-12T09:46:39.648 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs2_metadata --pg_num_min 64 2023-12-12T09:46:39.860 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:39.857+0000 7f1d3e009640 1 Processor -- start 2023-12-12T09:46:39.860 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:39.857+0000 7f1d3e009640 1 -- start start 2023-12-12T09:46:39.860 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:39.858+0000 7f1d3e009640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f1d38152000 0x7f1d381551e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:39.860 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:39.858+0000 7f1d3e009640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1d380c84d0 0x7f1d3806c340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:39.860 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:39.859+0000 7f1d3e009640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d38155720 con 0x7f1d3806c880 2023-12-12T09:46:39.861 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:39.859+0000 7f1d3e009640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d3806bb80 con 0x7f1d38152000 2023-12-12T09:46:39.861 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:39.859+0000 7f1d3e009640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d380c4830 con 0x7f1d380c84d0 2023-12-12T09:46:39.861 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:39.859+0000 7f1d37fff640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f1d3806c880 0x7f1d380c68c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:50820/0 (socket says 172.21.15.73:50820) 2023-12-12T09:46:39.861 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:39.859+0000 7f1d37fff640 1 -- 172.21.15.73:0/3087992230 learned_addr learned my addr 172.21.15.73:0/3087992230 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-12T09:46:39.864 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:39.859+0000 7f1d367fc640 1 -- 172.21.15.73:0/3087992230 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 12357126 0 0) 0x7f1d38155720 con 0x7f1d3806c880 2023-12-12T09:46:39.864 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:39.859+0000 7f1d367fc640 1 -- 172.21.15.73:0/3087992230 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1d24003520 con 0x7f1d3806c880 2023-12-12T09:46:39.864 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:39.859+0000 7f1d377fe640 1 --2- 172.21.15.73:0/3087992230 >> v2:172.21.15.142:3300/0 conn(0x7f1d38152000 0x7f1d381551e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:39.864 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:39.859+0000 7f1d36ffd640 1 --2- 172.21.15.73:0/3087992230 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1d380c84d0 0x7f1d3806c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:39.864 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:39.860+0000 7f1d367fc640 1 -- 172.21.15.73:0/3087992230 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2953675474 0 0) 0x7f1d24003520 con 0x7f1d3806c880 2023-12-12T09:46:39.864 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:39.860+0000 7f1d367fc640 1 -- 172.21.15.73:0/3087992230 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1d380c84d0 msgr2=0x7f1d3806c340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:46:39.864 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:39.860+0000 7f1d367fc640 1 --2- 172.21.15.73:0/3087992230 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1d380c84d0 0x7f1d3806c340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:39.864 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:39.860+0000 7f1d367fc640 1 -- 172.21.15.73:0/3087992230 >> v2:172.21.15.142:3300/0 conn(0x7f1d38152000 msgr2=0x7f1d381551e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:46:39.864 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:39.860+0000 7f1d367fc640 1 --2- 172.21.15.73:0/3087992230 >> v2:172.21.15.142:3300/0 conn(0x7f1d38152000 0x7f1d381551e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:39.864 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:39.860+0000 7f1d367fc640 1 -- 172.21.15.73:0/3087992230 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d380c4b10 con 0x7f1d3806c880 2023-12-12T09:46:39.865 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:39.860+0000 7f1d367fc640 1 -- 172.21.15.73:0/3087992230 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3186547832 0 0) 0x7f1d30001670 con 0x7f1d3806c880 2023-12-12T09:46:39.865 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:39.860+0000 7f1d367fc640 1 -- 172.21.15.73:0/3087992230 >> v1:172.21.15.73:6789/0 conn(0x7f1d3806c880 legacy=0x7f1d380c68c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:39.865 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:39.860+0000 7f1d367fc640 1 --2- 172.21.15.73:0/3087992230 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1d24003970 0x7f1d24003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:39.865 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:39.860+0000 7f1d367fc640 1 --2- 172.21.15.73:0/3087992230 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1d380c84d0 0x7f1d240047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:39.865 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:39.860+0000 7f1d367fc640 1 --2- 172.21.15.73:0/3087992230 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1d24004d00 0x7f1d24005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:39.865 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:39.860+0000 7f1d367fc640 1 -- 172.21.15.73:0/3087992230 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d3806bb80 con 0x7f1d24004d00 2023-12-12T09:46:39.865 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:39.860+0000 7f1d367fc640 1 -- 172.21.15.73:0/3087992230 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d380c4830 con 0x7f1d24003970 2023-12-12T09:46:39.865 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:39.860+0000 7f1d367fc640 1 -- 172.21.15.73:0/3087992230 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d2400ba60 con 0x7f1d380c84d0 2023-12-12T09:46:39.865 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:39.860+0000 7f1d37fff640 1 --2- 172.21.15.73:0/3087992230 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1d24004d00 0x7f1d24005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:39.865 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:39.860+0000 7f1d36ffd640 1 --2- 172.21.15.73:0/3087992230 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1d380c84d0 0x7f1d240047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:39.865 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:39.860+0000 7f1d377fe640 1 --2- 172.21.15.73:0/3087992230 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1d24003970 0x7f1d24003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:39.865 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:39.860+0000 7f1d37fff640 1 -- 172.21.15.73:0/3087992230 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1d380c84d0 msgr2=0x7f1d240047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:46:39.865 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:39.860+0000 7f1d37fff640 1 --2- 172.21.15.73:0/3087992230 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1d380c84d0 0x7f1d240047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:39.865 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:39.860+0000 7f1d37fff640 1 -- 172.21.15.73:0/3087992230 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1d24003970 msgr2=0x7f1d24003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:46:39.866 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:39.861+0000 7f1d37fff640 1 --2- 172.21.15.73:0/3087992230 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1d24003970 0x7f1d24003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:39.866 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:39.861+0000 7f1d37fff640 1 -- 172.21.15.73:0/3087992230 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d24003520 con 0x7f1d24004d00 2023-12-12T09:46:39.866 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:39.861+0000 7f1d36ffd640 1 --2- 172.21.15.73:0/3087992230 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1d380c84d0 0x7f1d240047c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:46:39.866 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:39.862+0000 7f1d37fff640 1 --2- 172.21.15.73:0/3087992230 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1d24004d00 0x7f1d24005180 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 crypto rx=0x7f1d3000c240 tx=0x7f1d240057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4153b50bb7d8816e server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:46:39.866 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:39.862+0000 7f1d367fc640 1 -- 172.21.15.73:0/3087992230 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d3002cb00 con 0x7f1d24004d00 2023-12-12T09:46:39.866 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:39.862+0000 7f1d367fc640 1 -- 172.21.15.73:0/3087992230 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d3002cc60 con 0x7f1d24004d00 2023-12-12T09:46:39.866 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:39.862+0000 7f1d367fc640 1 -- 172.21.15.73:0/3087992230 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d30005af0 con 0x7f1d24004d00 2023-12-12T09:46:39.866 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:39.862+0000 7f1d3e009640 1 -- 172.21.15.73:0/3087992230 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1d24004d00 msgr2=0x7f1d24005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:39.866 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:39.862+0000 7f1d3e009640 1 --2- 172.21.15.73:0/3087992230 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1d24004d00 0x7f1d24005180 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 crypto rx=0x7f1d3000c240 tx=0x7f1d240057f0 comp rx=0 tx=0).stop 2023-12-12T09:46:39.866 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:39.862+0000 7f1d37fff640 1 -- 172.21.15.73:0/3087992230 reap_dead start 2023-12-12T09:46:39.866 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:39.862+0000 7f1d3e009640 1 -- 172.21.15.73:0/3087992230 shutdown_connections 2023-12-12T09:46:39.866 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:39.862+0000 7f1d3e009640 1 -- 172.21.15.73:0/3087992230 >> 172.21.15.73:0/3087992230 conn(0x7f1d380ab9e0 msgr2=0x7f1d380abdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:46:39.866 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:39.862+0000 7f1d3e009640 1 -- 172.21.15.73:0/3087992230 shutdown_connections 2023-12-12T09:46:39.867 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:39.862+0000 7f1d3e009640 1 -- 172.21.15.73:0/3087992230 wait complete. 2023-12-12T09:46:39.869 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:39.864+0000 7f1d3e009640 1 Processor -- start 2023-12-12T09:46:39.869 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:39.864+0000 7f1d3e009640 1 -- start start 2023-12-12T09:46:39.869 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:39.865+0000 7f1d3e009640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1d24004d00 0x7f1d38156fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:39.869 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:39.865+0000 7f1d3e009640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1d381ed480 0x7f1d381eb110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:39.869 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:39.865+0000 7f1d3e009640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1d381eb650 0x7f1d381e6dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:39.869 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:39.865+0000 7f1d3e009640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d380c3840 con 0x7f1d24004d00 2023-12-12T09:46:39.869 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:39.865+0000 7f1d3e009640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d38156510 con 0x7f1d381eb650 2023-12-12T09:46:39.869 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:39.865+0000 7f1d3e009640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d381ede30 con 0x7f1d381ed480 2023-12-12T09:46:39.869 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:39.865+0000 7f1d377fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1d24004d00 0x7f1d38156fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:39.869 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:39.866+0000 7f1d377fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1d24004d00 0x7f1d38156fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:53830/0 (socket says 172.21.15.73:53830) 2023-12-12T09:46:39.869 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:39.866+0000 7f1d377fe640 1 -- 172.21.15.73:0/3426679312 learned_addr learned my addr 172.21.15.73:0/3426679312 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:46:39.869 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:39.866+0000 7f1d377fe640 1 -- 172.21.15.73:0/3426679312 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1d381ed480 msgr2=0x7f1d381eb110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:39.870 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:39.866+0000 7f1d37fff640 1 --2- 172.21.15.73:0/3426679312 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1d381eb650 0x7f1d381e6dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:39.870 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:39.866+0000 7f1d36ffd640 1 --2- 172.21.15.73:0/3426679312 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1d381ed480 0x7f1d381eb110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:39.870 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:39.866+0000 7f1d377fe640 1 --2- 172.21.15.73:0/3426679312 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1d381ed480 0x7f1d381eb110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:39.870 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:39.866+0000 7f1d377fe640 1 -- 172.21.15.73:0/3426679312 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1d381eb650 msgr2=0x7f1d381e6dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:39.870 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:39.866+0000 7f1d377fe640 1 --2- 172.21.15.73:0/3426679312 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1d381eb650 0x7f1d381e6dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:39.870 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:39.866+0000 7f1d377fe640 1 -- 172.21.15.73:0/3426679312 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d381567d0 con 0x7f1d24004d00 2023-12-12T09:46:39.870 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:39.866+0000 7f1d37fff640 1 --2- 172.21.15.73:0/3426679312 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1d381eb650 0x7f1d381e6dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:46:39.870 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:39.866+0000 7f1d377fe640 1 --2- 172.21.15.73:0/3426679312 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1d24004d00 0x7f1d38156fd0 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 crypto rx=0x7f1d28009fb0 tx=0x7f1d280115a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:46:39.870 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:39.866+0000 7f1d2ffff640 1 -- 172.21.15.73:0/3426679312 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d2800e030 con 0x7f1d24004d00 2023-12-12T09:46:39.870 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:39.866+0000 7f1d2ffff640 1 -- 172.21.15.73:0/3426679312 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d28016470 con 0x7f1d24004d00 2023-12-12T09:46:39.870 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:39.867+0000 7f1d3e009640 1 -- 172.21.15.73:0/3426679312 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d38156ab0 con 0x7f1d24004d00 2023-12-12T09:46:39.870 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:39.867+0000 7f1d2ffff640 1 -- 172.21.15.73:0/3426679312 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d28016820 con 0x7f1d24004d00 2023-12-12T09:46:39.870 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:39.867+0000 7f1d3e009640 1 -- 172.21.15.73:0/3426679312 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d381575b0 con 0x7f1d24004d00 2023-12-12T09:46:39.871 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:39.868+0000 7f1d3e009640 1 -- 172.21.15.73:0/3426679312 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d38156c40 con 0x7f1d24004d00 2023-12-12T09:46:39.871 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:39.869+0000 7f1d2ffff640 1 -- 172.21.15.73:0/3426679312 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f1d28016980 con 0x7f1d24004d00 2023-12-12T09:46:39.871 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:39.870+0000 7f1d2ffff640 1 --2- 172.21.15.73:0/3426679312 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f1d1806ae40 0x7f1d1806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:39.872 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:39.870+0000 7f1d2ffff640 1 -- 172.21.15.73:0/3426679312 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1d2800f070 con 0x7f1d24004d00 2023-12-12T09:46:39.872 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:39.870+0000 7f1d36ffd640 1 --2- 172.21.15.73:0/3426679312 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f1d1806ae40 0x7f1d1806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:39.872 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:39.871+0000 7f1d36ffd640 1 --2- 172.21.15.73:0/3426679312 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f1d1806ae40 0x7f1d1806d300 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f1d381ed170 tx=0x7f1d20008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:46:39.876 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:39.875+0000 7f1d2ffff640 1 -- 172.21.15.73:0/3426679312 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f1d280556a0 con 0x7f1d24004d00 2023-12-12T09:46:40.063 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:40.062+0000 7f1d3e009640 1 -- 172.21.15.73:0/3426679312 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs2_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f1d38067580 con 0x7f1d24004d00 2023-12-12T09:46:40.319 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:40.317+0000 7f1d2ffff640 1 -- 172.21.15.73:0/3426679312 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs2_metadata", "pg_num_min": 64}]=0 pool 'cephfs2_metadata' created v76) v1 ==== 140+0+0 (secure 0 0 0) 0x7f1d28058cc0 con 0x7f1d24004d00 2023-12-12T09:46:40.319 INFO:teuthology.orchestra.run.smithi073.stderr:pool 'cephfs2_metadata' created 2023-12-12T09:46:40.322 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:40.320+0000 7f1d3e009640 1 -- 172.21.15.73:0/3426679312 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f1d1806ae40 msgr2=0x7f1d1806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:40.322 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:40.320+0000 7f1d3e009640 1 --2- 172.21.15.73:0/3426679312 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f1d1806ae40 0x7f1d1806d300 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f1d381ed170 tx=0x7f1d20008040 comp rx=0 tx=0).stop 2023-12-12T09:46:40.322 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:40.320+0000 7f1d3e009640 1 -- 172.21.15.73:0/3426679312 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1d24004d00 msgr2=0x7f1d38156fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:40.322 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:40.320+0000 7f1d3e009640 1 --2- 172.21.15.73:0/3426679312 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1d24004d00 0x7f1d38156fd0 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 crypto rx=0x7f1d28009fb0 tx=0x7f1d280115a0 comp rx=0 tx=0).stop 2023-12-12T09:46:40.323 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:40.321+0000 7f1d3e009640 1 -- 172.21.15.73:0/3426679312 shutdown_connections 2023-12-12T09:46:40.323 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:40.321+0000 7f1d3e009640 1 --2- 172.21.15.73:0/3426679312 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f1d1806ae40 0x7f1d1806d300 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:40.323 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:40.321+0000 7f1d3e009640 1 --2- 172.21.15.73:0/3426679312 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1d381eb650 0x7f1d381e6dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:40.323 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:40.321+0000 7f1d3e009640 1 --2- 172.21.15.73:0/3426679312 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1d381ed480 0x7f1d381eb110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:40.323 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:40.321+0000 7f1d3e009640 1 --2- 172.21.15.73:0/3426679312 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1d24004d00 0x7f1d38156fd0 unknown :-1 s=CLOSED pgs=918 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:40.323 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:40.321+0000 7f1d3e009640 1 -- 172.21.15.73:0/3426679312 >> 172.21.15.73:0/3426679312 conn(0x7f1d380ab9e0 msgr2=0x7f1d3814fff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:46:40.323 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:40.321+0000 7f1d3e009640 1 -- 172.21.15.73:0/3426679312 shutdown_connections 2023-12-12T09:46:40.323 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:40.321+0000 7f1d3e009640 1 -- 172.21.15.73:0/3426679312 wait complete. 2023-12-12T09:46:40.349 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs2_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-12-12T09:46:40.539 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:40.538+0000 7f84f9705640 1 Processor -- start 2023-12-12T09:46:40.540 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:40.538+0000 7f84f9705640 1 -- start start 2023-12-12T09:46:40.541 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:40.539+0000 7f84f9705640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f84f414ea60 0x7f84f40c5420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:40.541 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:40.539+0000 7f84f9705640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f84f40c0320 0x7f84f40c20b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:40.541 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:40.539+0000 7f84f9705640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84f40c3390 con 0x7f84f40a4c90 2023-12-12T09:46:40.541 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:40.539+0000 7f84f9705640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84f40c4b30 con 0x7f84f414ea60 2023-12-12T09:46:40.542 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:40.539+0000 7f84f9705640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84f4151e60 con 0x7f84f40c0320 2023-12-12T09:46:40.542 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:40.539+0000 7f84f2ffd640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f84f414ea60 0x7f84f40c5420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:40.542 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:40.540+0000 7f84f2ffd640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f84f414ea60 0x7f84f40c5420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:53840/0 (socket says 172.21.15.73:53840) 2023-12-12T09:46:40.542 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:40.540+0000 7f84f2ffd640 1 -- 172.21.15.73:0/4146010790 learned_addr learned my addr 172.21.15.73:0/4146010790 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:46:40.542 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:40.540+0000 7f84f2ffd640 1 -- 172.21.15.73:0/4146010790 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f84f40c0320 msgr2=0x7f84f40c20b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:46:40.542 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:40.540+0000 7f84f2ffd640 1 --2- 172.21.15.73:0/4146010790 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f84f40c0320 0x7f84f40c20b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:40.542 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:40.540+0000 7f84f2ffd640 1 -- 172.21.15.73:0/4146010790 >> v1:172.21.15.142:6789/0 conn(0x7f84f40a4c90 legacy=0x7f84f40c4420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:46:40.542 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:40.540+0000 7f84f2ffd640 1 -- 172.21.15.73:0/4146010790 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84f4152140 con 0x7f84f414ea60 2023-12-12T09:46:40.543 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:40.541+0000 7f84f2ffd640 1 --2- 172.21.15.73:0/4146010790 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f84f414ea60 0x7f84f40c5420 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7f84e4009870 tx=0x7f84e402b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d04918019c6d1b12 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:46:40.543 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:40.541+0000 7f84f1ffb640 1 -- 172.21.15.73:0/4146010790 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84e40317c0 con 0x7f84f414ea60 2023-12-12T09:46:40.543 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:40.541+0000 7f84f1ffb640 1 -- 172.21.15.73:0/4146010790 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84e4031920 con 0x7f84f414ea60 2023-12-12T09:46:40.543 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:40.541+0000 7f84f1ffb640 1 -- 172.21.15.73:0/4146010790 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84e4031cb0 con 0x7f84f414ea60 2023-12-12T09:46:40.544 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:40.542+0000 7f84f9705640 1 -- 172.21.15.73:0/4146010790 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f84f414ea60 msgr2=0x7f84f40c5420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:40.544 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:40.542+0000 7f84f9705640 1 --2- 172.21.15.73:0/4146010790 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f84f414ea60 0x7f84f40c5420 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7f84e4009870 tx=0x7f84e402b860 comp rx=0 tx=0).stop 2023-12-12T09:46:40.544 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:40.542+0000 7f84f9705640 1 -- 172.21.15.73:0/4146010790 shutdown_connections 2023-12-12T09:46:40.544 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:40.542+0000 7f84f9705640 1 --2- 172.21.15.73:0/4146010790 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f84f40c0320 0x7f84f40c20b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:40.544 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:40.542+0000 7f84f9705640 1 --2- 172.21.15.73:0/4146010790 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f84f414ea60 0x7f84f40c5420 unknown :-1 s=CLOSED pgs=919 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:40.544 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:40.542+0000 7f84f9705640 1 -- 172.21.15.73:0/4146010790 >> 172.21.15.73:0/4146010790 conn(0x7f84f406a4e0 msgr2=0x7f84f406a8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:46:40.544 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:40.542+0000 7f84f9705640 1 -- 172.21.15.73:0/4146010790 shutdown_connections 2023-12-12T09:46:40.544 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:40.542+0000 7f84f9705640 1 -- 172.21.15.73:0/4146010790 wait complete. 2023-12-12T09:46:40.545 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:40.544+0000 7f84f9705640 1 Processor -- start 2023-12-12T09:46:40.545 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:40.544+0000 7f84f9705640 1 -- start start 2023-12-12T09:46:40.548 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:40.545+0000 7f84f9705640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f84f40a4c90 0x7f84f41512b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:40.548 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:40.545+0000 7f84f9705640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f84f40c0320 0x7f84f41eac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:40.548 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:40.545+0000 7f84f9705640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f84f414ea60 0x7f84f41ed760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:40.548 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:40.545+0000 7f84f9705640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84f41ea1f0 con 0x7f84f414ea60 2023-12-12T09:46:40.548 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:40.545+0000 7f84f9705640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84f41eb140 con 0x7f84f40a4c90 2023-12-12T09:46:40.548 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:40.545+0000 7f84f9705640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84f41edca0 con 0x7f84f40c0320 2023-12-12T09:46:40.548 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:40.545+0000 7f84f37fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f84f414ea60 0x7f84f41ed760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:40.548 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:40.545+0000 7f84f37fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f84f414ea60 0x7f84f41ed760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:53844/0 (socket says 172.21.15.73:53844) 2023-12-12T09:46:40.548 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:40.545+0000 7f84f37fe640 1 -- 172.21.15.73:0/480090873 learned_addr learned my addr 172.21.15.73:0/480090873 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:46:40.548 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:40.546+0000 7f84f2ffd640 1 --2- 172.21.15.73:0/480090873 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f84f40a4c90 0x7f84f41512b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:40.548 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:40.546+0000 7f84f37fe640 1 -- 172.21.15.73:0/480090873 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f84f40c0320 msgr2=0x7f84f41eac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:40.548 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:40.546+0000 7f84f37fe640 1 --2- 172.21.15.73:0/480090873 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f84f40c0320 0x7f84f41eac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:40.548 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:40.546+0000 7f84f37fe640 1 -- 172.21.15.73:0/480090873 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f84f40a4c90 msgr2=0x7f84f41512b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:40.549 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:40.546+0000 7f84f37fe640 1 --2- 172.21.15.73:0/480090873 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f84f40a4c90 0x7f84f41512b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:40.549 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:40.546+0000 7f84f37fe640 1 -- 172.21.15.73:0/480090873 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84e40094d0 con 0x7f84f414ea60 2023-12-12T09:46:40.549 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:40.546+0000 7f84f2ffd640 1 --2- 172.21.15.73:0/480090873 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f84f40a4c90 0x7f84f41512b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:46:40.549 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:40.546+0000 7f84f37fe640 1 --2- 172.21.15.73:0/480090873 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f84f414ea60 0x7f84f41ed760 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 crypto rx=0x7f84ec00b970 tx=0x7f84ec00be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:46:40.549 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:40.546+0000 7f84db7fe640 1 -- 172.21.15.73:0/480090873 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84ec00cb40 con 0x7f84f414ea60 2023-12-12T09:46:40.549 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:40.546+0000 7f84db7fe640 1 -- 172.21.15.73:0/480090873 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84ec00ccc0 con 0x7f84f414ea60 2023-12-12T09:46:40.549 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:40.546+0000 7f84db7fe640 1 -- 172.21.15.73:0/480090873 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84ec014680 con 0x7f84f414ea60 2023-12-12T09:46:40.549 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:40.546+0000 7f84f9705640 1 -- 172.21.15.73:0/480090873 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84f414d230 con 0x7f84f414ea60 2023-12-12T09:46:40.549 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:40.546+0000 7f84f9705640 1 -- 172.21.15.73:0/480090873 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84f41ea400 con 0x7f84f414ea60 2023-12-12T09:46:40.549 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:40.547+0000 7f84f9705640 1 -- 172.21.15.73:0/480090873 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f84f4074890 con 0x7f84f414ea60 2023-12-12T09:46:40.551 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:40.549+0000 7f84db7fe640 1 -- 172.21.15.73:0/480090873 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f84ec01d3b0 con 0x7f84f414ea60 2023-12-12T09:46:40.551 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:40.550+0000 7f84db7fe640 1 --2- 172.21.15.73:0/480090873 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f84e006ae40 0x7f84e006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:40.551 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:40.550+0000 7f84db7fe640 1 -- 172.21.15.73:0/480090873 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 6080+0+0 (secure 0 0 0) 0x7f84ec089a80 con 0x7f84f414ea60 2023-12-12T09:46:40.552 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:40.550+0000 7f84f2ffd640 1 --2- 172.21.15.73:0/480090873 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f84e006ae40 0x7f84e006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:40.552 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:40.551+0000 7f84f2ffd640 1 --2- 172.21.15.73:0/480090873 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f84e006ae40 0x7f84e006d300 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f84e4036000 tx=0x7f84e403d040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:46:40.555 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:40.554+0000 7f84db7fe640 1 -- 172.21.15.73:0/480090873 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f84ec054ad0 con 0x7f84f414ea60 2023-12-12T09:46:40.745 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:40.743+0000 7f84f9705640 1 -- 172.21.15.73:0/480090873 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs2_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f84f40c3c00 con 0x7f84f414ea60 2023-12-12T09:46:41.326 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:41.324+0000 7f84db7fe640 1 -- 172.21.15.73:0/480090873 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs2_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs2_data' created v77) v1 ==== 172+0+0 (secure 0 0 0) 0x7f84f40c3c00 con 0x7f84f414ea60 2023-12-12T09:46:41.327 INFO:teuthology.orchestra.run.smithi073.stderr:pool 'cephfs2_data' created 2023-12-12T09:46:41.330 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:41.328+0000 7f84f9705640 1 -- 172.21.15.73:0/480090873 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f84e006ae40 msgr2=0x7f84e006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:41.330 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:41.328+0000 7f84f9705640 1 --2- 172.21.15.73:0/480090873 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f84e006ae40 0x7f84e006d300 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f84e4036000 tx=0x7f84e403d040 comp rx=0 tx=0).stop 2023-12-12T09:46:41.330 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:41.328+0000 7f84f9705640 1 -- 172.21.15.73:0/480090873 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f84f414ea60 msgr2=0x7f84f41ed760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:41.330 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:41.328+0000 7f84f9705640 1 --2- 172.21.15.73:0/480090873 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f84f414ea60 0x7f84f41ed760 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 crypto rx=0x7f84ec00b970 tx=0x7f84ec00be30 comp rx=0 tx=0).stop 2023-12-12T09:46:41.330 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:41.329+0000 7f84f9705640 1 -- 172.21.15.73:0/480090873 shutdown_connections 2023-12-12T09:46:41.331 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:41.329+0000 7f84f9705640 1 --2- 172.21.15.73:0/480090873 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f84e006ae40 0x7f84e006d300 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:41.331 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:41.329+0000 7f84f9705640 1 --2- 172.21.15.73:0/480090873 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f84f414ea60 0x7f84f41ed760 unknown :-1 s=CLOSED pgs=920 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:41.331 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:41.329+0000 7f84f9705640 1 --2- 172.21.15.73:0/480090873 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f84f40c0320 0x7f84f41eac00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:41.331 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:41.329+0000 7f84f9705640 1 --2- 172.21.15.73:0/480090873 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f84f40a4c90 0x7f84f41512b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:41.331 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:41.329+0000 7f84f9705640 1 -- 172.21.15.73:0/480090873 >> 172.21.15.73:0/480090873 conn(0x7f84f406a4e0 msgr2=0x7f84f40c4420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:46:41.332 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:41.330+0000 7f84f9705640 1 -- 172.21.15.73:0/480090873 shutdown_connections 2023-12-12T09:46:41.332 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:41.331+0000 7f84f9705640 1 -- 172.21.15.73:0/480090873 wait complete. 2023-12-12T09:46:41.371 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs2 cephfs2_metadata cephfs2_data 2023-12-12T09:46:41.555 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:41.553+0000 7f1ddb2ad640 1 Processor -- start 2023-12-12T09:46:41.555 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:41.553+0000 7f1ddb2ad640 1 -- start start 2023-12-12T09:46:41.556 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:41.554+0000 7f1ddb2ad640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f1dd414f8c0 0x7f1dd406dc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:41.556 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:41.555+0000 7f1ddb2ad640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f1dd4152500 0x7f1dd4152990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:41.556 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:41.555+0000 7f1ddb2ad640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1dd40c16c0 con 0x7f1dd406d350 2023-12-12T09:46:41.556 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:41.555+0000 7f1ddb2ad640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1dd40c1090 con 0x7f1dd4152500 2023-12-12T09:46:41.556 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:41.555+0000 7f1ddb2ad640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1dd40c14b0 con 0x7f1dd414f8c0 2023-12-12T09:46:41.557 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:41.555+0000 7f1dd984a640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f1dd4152500 0x7f1dd4152990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:41.557 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:41.555+0000 7f1dd984a640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f1dd4152500 0x7f1dd4152990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:53846/0 (socket says 172.21.15.73:53846) 2023-12-12T09:46:41.557 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:41.555+0000 7f1dd984a640 1 -- 172.21.15.73:0/4005814680 learned_addr learned my addr 172.21.15.73:0/4005814680 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:46:41.558 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:41.555+0000 7f1dd9049640 1 --2- 172.21.15.73:0/4005814680 >> v2:172.21.15.142:3300/0 conn(0x7f1dd414f8c0 0x7f1dd406dc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:41.558 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:41.556+0000 7f1dd984a640 1 -- 172.21.15.73:0/4005814680 >> v2:172.21.15.142:3300/0 conn(0x7f1dd414f8c0 msgr2=0x7f1dd406dc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:46:41.558 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:41.556+0000 7f1dd984a640 1 --2- 172.21.15.73:0/4005814680 >> v2:172.21.15.142:3300/0 conn(0x7f1dd414f8c0 0x7f1dd406dc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:41.558 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:41.556+0000 7f1dd984a640 1 -- 172.21.15.73:0/4005814680 >> v1:172.21.15.142:6789/0 conn(0x7f1dd406d350 legacy=0x7f1dd4071e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:41.558 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:41.556+0000 7f1dd984a640 1 -- 172.21.15.73:0/4005814680 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1dd40c19a0 con 0x7f1dd4152500 2023-12-12T09:46:41.558 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:41.557+0000 7f1dd984a640 1 --2- 172.21.15.73:0/4005814680 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1dd4152500 0x7f1dd4152990 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 crypto rx=0x7f1dd40c34b0 tx=0x7f1dcc02b9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bca79f404ef4d8d9 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:46:41.559 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:41.557+0000 7f1dcbfff640 1 -- 172.21.15.73:0/4005814680 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dcc030870 con 0x7f1dd4152500 2023-12-12T09:46:41.559 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:41.557+0000 7f1dcbfff640 1 -- 172.21.15.73:0/4005814680 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1dcc0309d0 con 0x7f1dd4152500 2023-12-12T09:46:41.559 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:41.557+0000 7f1dcbfff640 1 -- 172.21.15.73:0/4005814680 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dcc030d60 con 0x7f1dd4152500 2023-12-12T09:46:41.560 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:41.558+0000 7f1ddb2ad640 1 -- 172.21.15.73:0/4005814680 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1dd4152500 msgr2=0x7f1dd4152990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:41.560 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:41.558+0000 7f1ddb2ad640 1 --2- 172.21.15.73:0/4005814680 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1dd4152500 0x7f1dd4152990 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 crypto rx=0x7f1dd40c34b0 tx=0x7f1dcc02b9b0 comp rx=0 tx=0).stop 2023-12-12T09:46:41.560 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:41.558+0000 7f1ddb2ad640 1 -- 172.21.15.73:0/4005814680 shutdown_connections 2023-12-12T09:46:41.560 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:41.558+0000 7f1ddb2ad640 1 --2- 172.21.15.73:0/4005814680 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1dd4152500 0x7f1dd4152990 unknown :-1 s=CLOSED pgs=921 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:41.560 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:41.558+0000 7f1ddb2ad640 1 --2- 172.21.15.73:0/4005814680 >> v2:172.21.15.142:3300/0 conn(0x7f1dd414f8c0 0x7f1dd406dc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:41.560 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:41.558+0000 7f1ddb2ad640 1 -- 172.21.15.73:0/4005814680 >> 172.21.15.73:0/4005814680 conn(0x7f1dd406a4e0 msgr2=0x7f1dd406a8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:46:41.560 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:41.558+0000 7f1ddb2ad640 1 -- 172.21.15.73:0/4005814680 shutdown_connections 2023-12-12T09:46:41.560 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:41.558+0000 7f1ddb2ad640 1 -- 172.21.15.73:0/4005814680 wait complete. 2023-12-12T09:46:41.561 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:41.560+0000 7f1ddb2ad640 1 Processor -- start 2023-12-12T09:46:41.561 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:41.560+0000 7f1ddb2ad640 1 -- start start 2023-12-12T09:46:41.562 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:41.561+0000 7f1ddb2ad640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1dd406d350 0x7f1dd41edad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:41.562 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:41.561+0000 7f1ddb2ad640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1dd414f8c0 0x7f1dd41ea3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:41.562 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:41.561+0000 7f1ddb2ad640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1dd4152500 0x7f1dd4153960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:41.563 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:41.561+0000 7f1ddb2ad640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1dd41e7650 con 0x7f1dd4152500 2023-12-12T09:46:41.563 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:41.561+0000 7f1ddb2ad640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1dd41ea8f0 con 0x7f1dd414f8c0 2023-12-12T09:46:41.563 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:41.561+0000 7f1ddb2ad640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1dd4070680 con 0x7f1dd406d350 2023-12-12T09:46:41.563 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:41.561+0000 7f1dd984a640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1dd4152500 0x7f1dd4153960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:41.563 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:41.561+0000 7f1dd984a640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1dd4152500 0x7f1dd4153960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:53856/0 (socket says 172.21.15.73:53856) 2023-12-12T09:46:41.563 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:41.561+0000 7f1dd984a640 1 -- 172.21.15.73:0/1863436117 learned_addr learned my addr 172.21.15.73:0/1863436117 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:46:41.564 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:41.561+0000 7f1dd9049640 1 --2- 172.21.15.73:0/1863436117 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1dd406d350 0x7f1dd41edad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:41.564 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:41.562+0000 7f1dd984a640 1 -- 172.21.15.73:0/1863436117 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1dd406d350 msgr2=0x7f1dd41edad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:41.564 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:41.562+0000 7f1dd984a640 1 --2- 172.21.15.73:0/1863436117 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1dd406d350 0x7f1dd41edad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:41.564 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:41.562+0000 7f1dd984a640 1 -- 172.21.15.73:0/1863436117 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1dd414f8c0 msgr2=0x7f1dd41ea3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:41.564 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:41.562+0000 7f1dd8848640 1 --2- 172.21.15.73:0/1863436117 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1dd414f8c0 0x7f1dd41ea3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:41.565 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:41.562+0000 7f1dd984a640 1 --2- 172.21.15.73:0/1863436117 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1dd414f8c0 0x7f1dd41ea3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:41.565 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:41.562+0000 7f1dd984a640 1 -- 172.21.15.73:0/1863436117 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1dcc0094d0 con 0x7f1dd4152500 2023-12-12T09:46:41.565 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:41.562+0000 7f1dd8848640 1 --2- 172.21.15.73:0/1863436117 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1dd414f8c0 0x7f1dd41ea3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:46:41.565 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:41.562+0000 7f1dd984a640 1 --2- 172.21.15.73:0/1863436117 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1dd4152500 0x7f1dd4153960 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 crypto rx=0x7f1dcc02bfc0 tx=0x7f1dcc004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:46:41.565 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:41.562+0000 7f1dc9ffb640 1 -- 172.21.15.73:0/1863436117 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dcc039ce0 con 0x7f1dd4152500 2023-12-12T09:46:41.565 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:41.562+0000 7f1dc9ffb640 1 -- 172.21.15.73:0/1863436117 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1dcc039e40 con 0x7f1dd4152500 2023-12-12T09:46:41.565 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:41.562+0000 7f1dc9ffb640 1 -- 172.21.15.73:0/1863436117 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dcc043620 con 0x7f1dd4152500 2023-12-12T09:46:41.565 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:41.562+0000 7f1ddb2ad640 1 -- 172.21.15.73:0/1863436117 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1dd41ed640 con 0x7f1dd4152500 2023-12-12T09:46:41.565 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:41.563+0000 7f1ddb2ad640 1 -- 172.21.15.73:0/1863436117 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1dd40703a0 con 0x7f1dd4152500 2023-12-12T09:46:41.565 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:41.564+0000 7f1ddb2ad640 1 -- 172.21.15.73:0/1863436117 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1dd41ed7d0 con 0x7f1dd4152500 2023-12-12T09:46:41.566 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:41.565+0000 7f1dc9ffb640 1 -- 172.21.15.73:0/1863436117 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f1dcc043780 con 0x7f1dd4152500 2023-12-12T09:46:41.567 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:41.566+0000 7f1dc9ffb640 1 --2- 172.21.15.73:0/1863436117 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f1db806ae40 0x7f1db806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:41.567 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:41.566+0000 7f1dc9ffb640 1 -- 172.21.15.73:0/1863436117 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6463+0+0 (secure 0 0 0) 0x7f1dcc03e070 con 0x7f1dd4152500 2023-12-12T09:46:41.567 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:41.566+0000 7f1dd9049640 1 --2- 172.21.15.73:0/1863436117 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f1db806ae40 0x7f1db806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:41.568 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:41.566+0000 7f1dd9049640 1 --2- 172.21.15.73:0/1863436117 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f1db806ae40 0x7f1db806d300 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f1dd0009f30 tx=0x7f1dd000b040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:46:41.572 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:41.571+0000 7f1dc9ffb640 1 -- 172.21.15.73:0/1863436117 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f1dcc077880 con 0x7f1dd4152500 2023-12-12T09:46:41.790 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:41.788+0000 7f1ddb2ad640 1 -- 172.21.15.73:0/1863436117 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs2", "metadata": "cephfs2_metadata", "data": "cephfs2_data"} v 0) v1 -- 0x7f1dd4067070 con 0x7f1dd4152500 2023-12-12T09:46:42.350 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:42.348+0000 7f1dc9ffb640 1 -- 172.21.15.73:0/1863436117 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs2", "metadata": "cephfs2_metadata", "data": "cephfs2_data"}]=0 new fs with metadata pool 14 and data pool 15 v45) v1 ==== 177+0+0 (secure 0 0 0) 0x7f1dcc07aea0 con 0x7f1dd4152500 2023-12-12T09:46:42.350 INFO:teuthology.orchestra.run.smithi073.stderr:new fs with metadata pool 14 and data pool 15 2023-12-12T09:46:42.353 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:42.351+0000 7f1ddb2ad640 1 -- 172.21.15.73:0/1863436117 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f1db806ae40 msgr2=0x7f1db806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:42.353 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:42.351+0000 7f1ddb2ad640 1 --2- 172.21.15.73:0/1863436117 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f1db806ae40 0x7f1db806d300 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f1dd0009f30 tx=0x7f1dd000b040 comp rx=0 tx=0).stop 2023-12-12T09:46:42.353 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:42.351+0000 7f1ddb2ad640 1 -- 172.21.15.73:0/1863436117 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1dd4152500 msgr2=0x7f1dd4153960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:42.353 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:42.351+0000 7f1ddb2ad640 1 --2- 172.21.15.73:0/1863436117 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1dd4152500 0x7f1dd4153960 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 crypto rx=0x7f1dcc02bfc0 tx=0x7f1dcc004730 comp rx=0 tx=0).stop 2023-12-12T09:46:42.354 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:42.352+0000 7f1ddb2ad640 1 -- 172.21.15.73:0/1863436117 shutdown_connections 2023-12-12T09:46:42.354 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:42.352+0000 7f1ddb2ad640 1 --2- 172.21.15.73:0/1863436117 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f1db806ae40 0x7f1db806d300 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:42.354 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:42.352+0000 7f1ddb2ad640 1 --2- 172.21.15.73:0/1863436117 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1dd4152500 0x7f1dd4153960 unknown :-1 s=CLOSED pgs=922 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:42.354 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:42.352+0000 7f1ddb2ad640 1 --2- 172.21.15.73:0/1863436117 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1dd414f8c0 0x7f1dd41ea3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:42.354 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:42.352+0000 7f1ddb2ad640 1 --2- 172.21.15.73:0/1863436117 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1dd406d350 0x7f1dd41edad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:42.354 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:42.352+0000 7f1ddb2ad640 1 -- 172.21.15.73:0/1863436117 >> 172.21.15.73:0/1863436117 conn(0x7f1dd406a4e0 msgr2=0x7f1dd40c59a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:46:42.354 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:42.352+0000 7f1ddb2ad640 1 -- 172.21.15.73:0/1863436117 shutdown_connections 2023-12-12T09:46:42.354 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:42.352+0000 7f1ddb2ad640 1 -- 172.21.15.73:0/1863436117 wait complete. 2023-12-12T09:46:42.378 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-12T09:46:42.558 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:42.556+0000 7fc9942bb640 1 Processor -- start 2023-12-12T09:46:42.558 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:42.557+0000 7fc9942bb640 1 -- start start 2023-12-12T09:46:42.559 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:42.558+0000 7fc9942bb640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fc98c14fa40 0x7fc98c06a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:42.559 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:42.558+0000 7fc9942bb640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc98c152610 con 0x7fc98c0c5070 2023-12-12T09:46:42.559 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:42.558+0000 7fc9942bb640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc98c1528f0 con 0x7fc98c06db70 2023-12-12T09:46:42.559 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:42.558+0000 7fc9942bb640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc98c152bd0 con 0x7fc98c14fa40 2023-12-12T09:46:42.560 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:42.558+0000 7fc992858640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7fc98c0c5070 0x7fc98c0c40c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:50826/0 (socket says 172.21.15.73:50826) 2023-12-12T09:46:42.560 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:42.558+0000 7fc992858640 1 -- 172.21.15.73:0/1399600031 learned_addr learned my addr 172.21.15.73:0/1399600031 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-12T09:46:42.562 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:42.558+0000 7fc991055640 1 -- 172.21.15.73:0/1399600031 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3078474582 0 0) 0x7fc98c152610 con 0x7fc98c0c5070 2023-12-12T09:46:42.562 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:42.559+0000 7fc991055640 1 -- 172.21.15.73:0/1399600031 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc978003520 con 0x7fc98c0c5070 2023-12-12T09:46:42.562 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:42.559+0000 7fc992057640 1 --2- 172.21.15.73:0/1399600031 >> v2:172.21.15.142:3300/0 conn(0x7fc98c14fa40 0x7fc98c06a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:42.562 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:42.559+0000 7fc991055640 1 -- 172.21.15.73:0/1399600031 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 675310632 0 0) 0x7fc978003520 con 0x7fc98c0c5070 2023-12-12T09:46:42.562 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:42.559+0000 7fc991055640 1 -- 172.21.15.73:0/1399600031 >> v2:172.21.15.142:3300/0 conn(0x7fc98c14fa40 msgr2=0x7fc98c06a4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:46:42.562 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:42.559+0000 7fc991055640 1 --2- 172.21.15.73:0/1399600031 >> v2:172.21.15.142:3300/0 conn(0x7fc98c14fa40 0x7fc98c06a4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:42.562 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:42.559+0000 7fc991055640 1 -- 172.21.15.73:0/1399600031 >> v1:172.21.15.142:6789/0 conn(0x7fc98c06db70 legacy=0x7fc98c0c39b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:46:42.562 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:42.559+0000 7fc991055640 1 -- 172.21.15.73:0/1399600031 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc98c152eb0 con 0x7fc98c0c5070 2023-12-12T09:46:42.562 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:42.559+0000 7fc991055640 1 -- 172.21.15.73:0/1399600031 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3186547832 0 0) 0x7fc9840019f0 con 0x7fc98c0c5070 2023-12-12T09:46:42.562 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:42.559+0000 7fc991055640 1 -- 172.21.15.73:0/1399600031 >> v1:172.21.15.73:6789/0 conn(0x7fc98c0c5070 legacy=0x7fc98c0c40c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:42.563 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:42.559+0000 7fc991055640 1 --2- 172.21.15.73:0/1399600031 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc978003970 0x7fc978003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:42.563 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:42.559+0000 7fc991055640 1 --2- 172.21.15.73:0/1399600031 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc9780047c0 0x7fc978004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:42.563 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:42.559+0000 7fc991055640 1 --2- 172.21.15.73:0/1399600031 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc9780052a0 0x7fc97800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:42.563 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:42.559+0000 7fc991055640 1 -- 172.21.15.73:0/1399600031 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc98c152bd0 con 0x7fc978003970 2023-12-12T09:46:42.563 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:42.559+0000 7fc991055640 1 -- 172.21.15.73:0/1399600031 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc97800c170 con 0x7fc9780047c0 2023-12-12T09:46:42.563 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:42.559+0000 7fc991055640 1 -- 172.21.15.73:0/1399600031 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc97800c330 con 0x7fc9780052a0 2023-12-12T09:46:42.563 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:42.559+0000 7fc992057640 1 --2- 172.21.15.73:0/1399600031 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc978003970 0x7fc978003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:42.563 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:42.560+0000 7fc992057640 1 -- 172.21.15.73:0/1399600031 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc9780052a0 msgr2=0x7fc97800b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:46:42.563 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:42.560+0000 7fc992057640 1 --2- 172.21.15.73:0/1399600031 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc9780052a0 0x7fc97800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:42.563 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:42.560+0000 7fc992057640 1 -- 172.21.15.73:0/1399600031 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc9780047c0 msgr2=0x7fc978004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:46:42.563 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:42.560+0000 7fc991856640 1 --2- 172.21.15.73:0/1399600031 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc9780047c0 0x7fc978004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:42.563 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:42.560+0000 7fc992057640 1 --2- 172.21.15.73:0/1399600031 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc9780047c0 0x7fc978004c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:42.563 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:42.560+0000 7fc992057640 1 -- 172.21.15.73:0/1399600031 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc978003520 con 0x7fc978003970 2023-12-12T09:46:42.563 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:42.560+0000 7fc992858640 1 -- 172.21.15.73:0/1399600031 reap_dead start 2023-12-12T09:46:42.564 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:42.561+0000 7fc992057640 1 --2- 172.21.15.73:0/1399600031 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc978003970 0x7fc978003d90 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 crypto rx=0x7fc98800ba00 tx=0x7fc9780057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da78508237fd7dcf server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:46:42.565 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:42.561+0000 7fc991055640 1 -- 172.21.15.73:0/1399600031 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc988032620 con 0x7fc978003970 2023-12-12T09:46:42.565 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:42.561+0000 7fc991055640 1 -- 172.21.15.73:0/1399600031 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc988032780 con 0x7fc978003970 2023-12-12T09:46:42.565 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:42.561+0000 7fc991055640 1 -- 172.21.15.73:0/1399600031 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc988032b10 con 0x7fc978003970 2023-12-12T09:46:42.565 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:42.561+0000 7fc9942bb640 1 -- 172.21.15.73:0/1399600031 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc978003970 msgr2=0x7fc978003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:42.565 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:42.561+0000 7fc9942bb640 1 --2- 172.21.15.73:0/1399600031 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc978003970 0x7fc978003d90 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 crypto rx=0x7fc98800ba00 tx=0x7fc9780057f0 comp rx=0 tx=0).stop 2023-12-12T09:46:42.565 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:42.562+0000 7fc9942bb640 1 -- 172.21.15.73:0/1399600031 shutdown_connections 2023-12-12T09:46:42.565 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:42.562+0000 7fc9942bb640 1 --2- 172.21.15.73:0/1399600031 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc978003970 0x7fc978003d90 unknown :-1 s=CLOSED pgs=924 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:42.565 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:42.562+0000 7fc9942bb640 1 -- 172.21.15.73:0/1399600031 >> 172.21.15.73:0/1399600031 conn(0x7fc98c0a8130 msgr2=0x7fc98c0c24b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:46:42.565 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:42.562+0000 7fc9942bb640 1 -- 172.21.15.73:0/1399600031 shutdown_connections 2023-12-12T09:46:42.565 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:42.562+0000 7fc9942bb640 1 -- 172.21.15.73:0/1399600031 wait complete. 2023-12-12T09:46:42.565 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:42.563+0000 7fc9942bb640 1 Processor -- start 2023-12-12T09:46:42.565 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:42.563+0000 7fc9942bb640 1 -- start start 2023-12-12T09:46:42.567 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:42.564+0000 7fc9942bb640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc978003970 0x7fc98c1edf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:42.567 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:42.564+0000 7fc9942bb640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc98c0a91b0 0x7fc98c1eaa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:42.567 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:42.564+0000 7fc9942bb640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc98c151790 0x7fc98c0700d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:42.567 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:42.564+0000 7fc9942bb640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc98c1ee460 con 0x7fc98c0a91b0 2023-12-12T09:46:42.567 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:42.564+0000 7fc9942bb640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc98c1eaf60 con 0x7fc98c151790 2023-12-12T09:46:42.568 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:42.564+0000 7fc9942bb640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc98c1ea590 con 0x7fc978003970 2023-12-12T09:46:42.568 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:42.564+0000 7fc991856640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc98c0a91b0 0x7fc98c1eaa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:42.568 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:42.564+0000 7fc991856640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc98c0a91b0 0x7fc98c1eaa20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:53872/0 (socket says 172.21.15.73:53872) 2023-12-12T09:46:42.568 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:42.564+0000 7fc991856640 1 -- 172.21.15.73:0/1218666038 learned_addr learned my addr 172.21.15.73:0/1218666038 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:46:42.568 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:42.565+0000 7fc992057640 1 --2- 172.21.15.73:0/1218666038 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc978003970 0x7fc98c1edf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:42.568 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:42.565+0000 7fc991856640 1 -- 172.21.15.73:0/1218666038 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc978003970 msgr2=0x7fc98c1edf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:42.568 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:42.565+0000 7fc991856640 1 --2- 172.21.15.73:0/1218666038 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc978003970 0x7fc98c1edf20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:42.568 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:42.565+0000 7fc992858640 1 --2- 172.21.15.73:0/1218666038 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc98c151790 0x7fc98c0700d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:42.568 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:42.565+0000 7fc991856640 1 -- 172.21.15.73:0/1218666038 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc98c151790 msgr2=0x7fc98c0700d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:42.568 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:42.565+0000 7fc991856640 1 --2- 172.21.15.73:0/1218666038 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc98c151790 0x7fc98c0700d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:42.568 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:42.565+0000 7fc991856640 1 -- 172.21.15.73:0/1218666038 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc98c1e9fa0 con 0x7fc98c0a91b0 2023-12-12T09:46:42.568 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:42.565+0000 7fc991856640 1 --2- 172.21.15.73:0/1218666038 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc98c0a91b0 0x7fc98c1eaa20 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 crypto rx=0x7fc97c00d400 tx=0x7fc97c00d8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:46:42.568 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:42.565+0000 7fc982ffd640 1 -- 172.21.15.73:0/1218666038 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc97c00b070 con 0x7fc98c0a91b0 2023-12-12T09:46:42.568 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:42.565+0000 7fc982ffd640 1 -- 172.21.15.73:0/1218666038 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc97c0054e0 con 0x7fc98c0a91b0 2023-12-12T09:46:42.569 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:42.565+0000 7fc9942bb640 1 -- 172.21.15.73:0/1218666038 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc98c0a9640 con 0x7fc98c0a91b0 2023-12-12T09:46:42.569 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:42.565+0000 7fc982ffd640 1 -- 172.21.15.73:0/1218666038 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc97c003810 con 0x7fc98c0a91b0 2023-12-12T09:46:42.569 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:42.566+0000 7fc9942bb640 1 -- 172.21.15.73:0/1218666038 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc98c1ea220 con 0x7fc98c0a91b0 2023-12-12T09:46:42.569 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:42.567+0000 7fc9942bb640 1 -- 172.21.15.73:0/1218666038 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc98c067580 con 0x7fc98c0a91b0 2023-12-12T09:46:42.569 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:42.568+0000 7fc982ffd640 1 -- 172.21.15.73:0/1218666038 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fc97c003970 con 0x7fc98c0a91b0 2023-12-12T09:46:42.570 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:42.569+0000 7fc982ffd640 1 --2- 172.21.15.73:0/1218666038 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fc97006ae40 0x7fc97006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:42.570 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:42.569+0000 7fc982ffd640 1 -- 172.21.15.73:0/1218666038 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fc97c0891a0 con 0x7fc98c0a91b0 2023-12-12T09:46:42.570 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:42.569+0000 7fc992057640 1 --2- 172.21.15.73:0/1218666038 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fc97006ae40 0x7fc97006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:42.571 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:42.570+0000 7fc992057640 1 --2- 172.21.15.73:0/1218666038 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fc97006ae40 0x7fc97006d300 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fc978004740 tx=0x7fc988030000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:46:42.574 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:42.573+0000 7fc982ffd640 1 -- 172.21.15.73:0/1218666038 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fc97c053f00 con 0x7fc98c0a91b0 2023-12-12T09:46:42.760 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:42.759+0000 7fc9942bb640 1 -- 172.21.15.73:0/1218666038 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc98c1ea6d0 con 0x7fc98c0a91b0 2023-12-12T09:46:42.764 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:42.763+0000 7fc982ffd640 1 -- 172.21.15.73:0/1218666038 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v78) v1 ==== 74+0+20239 (secure 0 0 0) 0x7fc97c018090 con 0x7fc98c0a91b0 2023-12-12T09:46:42.764 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-12T09:46:42.765 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":78,"fsid":"ba240992-02b8-4c7e-92f2-27eb29ac433b","created":"2023-12-12T09:43:02.454719+0000","modified":"2023-12-12T09:46:41.790951+0000","last_up_change":"2023-12-12T09:43:13.913440+0000","last_in_change":"2023-12-12T09:43:05.925348+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-12T09:43:15.525508+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2023-12-12T09:46:24.716544+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2023-12-12T09:46:25.435954+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs2_metadata","create_time":"2023-12-12T09:46:40.116878+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs2_data","create_time":"2023-12-12T09:46:40.798840+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"dd9074be-dbe2-4c34-9896-a4223d8d3940","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":4047810203},{"type":"v1","addr":"172.21.15.73:6801","nonce":4047810203}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":4047810203},{"type":"v1","addr":"172.21.15.73:6803","nonce":4047810203}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":4047810203},{"type":"v1","addr":"172.21.15.73:6807","nonce":4047810203}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":4047810203},{"type":"v1","addr":"172.21.15.73:6805","nonce":4047810203}]},"public_addr":"172.21.15.73:6801/4047810203","cluster_addr":"172.21.15.73:6803/4047810203","heartbeat_back_addr":"172.21.15.73:6807/4047810203","heartbeat_front_addr":"172.21.15.73:6805/4047810203","state":["exists","up"]},{"osd":1,"uuid":"c4a05052-96d4-4758-a4e1-1a37f1e07fed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":1356058331},{"type":"v1","addr":"172.21.15.73:6824","nonce":1356058331}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":1356058331},{"type":"v1","addr":"172.21.15.73:6827","nonce":1356058331}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":1356058331},{"type":"v1","addr":"172.21.15.73:6831","nonce":1356058331}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":1356058331},{"type":"v1","addr":"172.21.15.73:6829","nonce":1356058331}]},"public_addr":"172.21.15.73:6824/1356058331","cluster_addr":"172.21.15.73:6827/1356058331","heartbeat_back_addr":"172.21.15.73:6831/1356058331","heartbeat_front_addr":"172.21.15.73:6829/1356058331","state":["exists","up"]},{"osd":2,"uuid":"512bc8ac-72c2-40d4-b3d2-d867a92c5213","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":1228903316},{"type":"v1","addr":"172.21.15.73:6817","nonce":1228903316}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":1228903316},{"type":"v1","addr":"172.21.15.73:6819","nonce":1228903316}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6823","nonce":1228903316},{"type":"v1","addr":"172.21.15.73:6825","nonce":1228903316}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":1228903316},{"type":"v1","addr":"172.21.15.73:6821","nonce":1228903316}]},"public_addr":"172.21.15.73:6817/1228903316","cluster_addr":"172.21.15.73:6819/1228903316","heartbeat_back_addr":"172.21.15.73:6825/1228903316","heartbeat_front_addr":"172.21.15.73:6821/1228903316","state":["exists","up"]},{"osd":3,"uuid":"3d1a91e0-42bf-437a-8eae-8d357c8f63a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":1293329670},{"type":"v1","addr":"172.21.15.73:6809","nonce":1293329670}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6810","nonce":1293329670},{"type":"v1","addr":"172.21.15.73:6811","nonce":1293329670}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":1293329670},{"type":"v1","addr":"172.21.15.73:6815","nonce":1293329670}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":1293329670},{"type":"v1","addr":"172.21.15.73:6813","nonce":1293329670}]},"public_addr":"172.21.15.73:6809/1293329670","cluster_addr":"172.21.15.73:6811/1293329670","heartbeat_back_addr":"172.21.15.73:6815/1293329670","heartbeat_front_addr":"172.21.15.73:6813/1293329670","state":["exists","up"]},{"osd":4,"uuid":"4b302fff-834c-4069-ac19-00e46f6c87b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":3727975702},{"type":"v1","addr":"172.21.15.142:6801","nonce":3727975702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":3727975702},{"type":"v1","addr":"172.21.15.142:6803","nonce":3727975702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6809","nonce":3727975702},{"type":"v1","addr":"172.21.15.142:6811","nonce":3727975702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6805","nonce":3727975702},{"type":"v1","addr":"172.21.15.142:6807","nonce":3727975702}]},"public_addr":"172.21.15.142:6801/3727975702","cluster_addr":"172.21.15.142:6803/3727975702","heartbeat_back_addr":"172.21.15.142:6811/3727975702","heartbeat_front_addr":"172.21.15.142:6807/3727975702","state":["exists","up"]},{"osd":5,"uuid":"d7cdace2-67d0-45cc-95f2-515cf6ef1b82","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6817","nonce":2353193632},{"type":"v1","addr":"172.21.15.142:6819","nonce":2353193632}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6821","nonce":2353193632},{"type":"v1","addr":"172.21.15.142:6823","nonce":2353193632}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6829","nonce":2353193632},{"type":"v1","addr":"172.21.15.142:6831","nonce":2353193632}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6825","nonce":2353193632},{"type":"v1","addr":"172.21.15.142:6827","nonce":2353193632}]},"public_addr":"172.21.15.142:6819/2353193632","cluster_addr":"172.21.15.142:6823/2353193632","heartbeat_back_addr":"172.21.15.142:6831/2353193632","heartbeat_front_addr":"172.21.15.142:6827/2353193632","state":["exists","up"]},{"osd":6,"uuid":"649ce78a-5626-445c-aedc-a651ed05a6f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":2006111986},{"type":"v1","addr":"172.21.15.142:6806","nonce":2006111986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":2006111986},{"type":"v1","addr":"172.21.15.142:6810","nonce":2006111986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":2006111986},{"type":"v1","addr":"172.21.15.142:6815","nonce":2006111986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":2006111986},{"type":"v1","addr":"172.21.15.142:6813","nonce":2006111986}]},"public_addr":"172.21.15.142:6806/2006111986","cluster_addr":"172.21.15.142:6810/2006111986","heartbeat_back_addr":"172.21.15.142:6815/2006111986","heartbeat_front_addr":"172.21.15.142:6813/2006111986","state":["exists","up"]},{"osd":7,"uuid":"af15ae3b-c1d0-4acf-92db-8a1805494d13","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":2573794341},{"type":"v1","addr":"172.21.15.142:6818","nonce":2573794341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":2573794341},{"type":"v1","addr":"172.21.15.142:6822","nonce":2573794341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":2573794341},{"type":"v1","addr":"172.21.15.142:6830","nonce":2573794341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":2573794341},{"type":"v1","addr":"172.21.15.142:6826","nonce":2573794341}]},"public_addr":"172.21.15.142:6818/2573794341","cluster_addr":"172.21.15.142:6822/2573794341","heartbeat_back_addr":"172.21.15.142:6830/2573794341","heartbeat_front_addr":"172.21.15.142:6826/2573794341","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.185824+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.262103+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.225556+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:10.523459+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:10.706035+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.257339+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.301776+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.051960+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-12T09:46:42.767 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:42.765+0000 7fc9942bb640 1 -- 172.21.15.73:0/1218666038 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fc97006ae40 msgr2=0x7fc97006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:42.767 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:42.765+0000 7fc9942bb640 1 --2- 172.21.15.73:0/1218666038 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fc97006ae40 0x7fc97006d300 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fc978004740 tx=0x7fc988030000 comp rx=0 tx=0).stop 2023-12-12T09:46:42.767 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:42.765+0000 7fc9942bb640 1 -- 172.21.15.73:0/1218666038 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc98c0a91b0 msgr2=0x7fc98c1eaa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:42.767 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:42.765+0000 7fc9942bb640 1 --2- 172.21.15.73:0/1218666038 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc98c0a91b0 0x7fc98c1eaa20 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 crypto rx=0x7fc97c00d400 tx=0x7fc97c00d8c0 comp rx=0 tx=0).stop 2023-12-12T09:46:42.767 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:42.765+0000 7fc9942bb640 1 -- 172.21.15.73:0/1218666038 shutdown_connections 2023-12-12T09:46:42.767 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:42.765+0000 7fc9942bb640 1 --2- 172.21.15.73:0/1218666038 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fc97006ae40 0x7fc97006d300 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:42.767 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:42.765+0000 7fc9942bb640 1 --2- 172.21.15.73:0/1218666038 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc98c151790 0x7fc98c0700d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:42.767 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:42.765+0000 7fc9942bb640 1 --2- 172.21.15.73:0/1218666038 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc98c0a91b0 0x7fc98c1eaa20 unknown :-1 s=CLOSED pgs=925 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:42.767 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:42.765+0000 7fc9942bb640 1 --2- 172.21.15.73:0/1218666038 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc978003970 0x7fc98c1edf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:42.767 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:42.765+0000 7fc9942bb640 1 -- 172.21.15.73:0/1218666038 >> 172.21.15.73:0/1218666038 conn(0x7fc98c0a8130 msgr2=0x7fc98c14dc90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:46:42.767 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:42.765+0000 7fc9942bb640 1 -- 172.21.15.73:0/1218666038 shutdown_connections 2023-12-12T09:46:42.767 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:42.765+0000 7fc9942bb640 1 -- 172.21.15.73:0/1218666038 wait complete. 2023-12-12T09:46:42.786 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-12T09:46:42.990 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:42.988+0000 7fda65eca640 1 Processor -- start 2023-12-12T09:46:42.990 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:42.989+0000 7fda65eca640 1 -- start start 2023-12-12T09:46:42.992 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:42.990+0000 7fda65eca640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fda60158450 0x7fda60155940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:42.992 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:42.990+0000 7fda65eca640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fda600c4580 0x7fda600c49b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:42.992 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:42.990+0000 7fda65eca640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda60154a40 con 0x7fda60151a90 2023-12-12T09:46:42.992 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:42.990+0000 7fda65eca640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda60154450 con 0x7fda60158450 2023-12-12T09:46:42.992 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:42.990+0000 7fda65eca640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda6006c740 con 0x7fda600c4580 2023-12-12T09:46:42.992 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:42.991+0000 7fda64ec8640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7fda60151a90 0x7fda60154ed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:50832/0 (socket says 172.21.15.73:50832) 2023-12-12T09:46:42.993 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:42.991+0000 7fda64ec8640 1 -- 172.21.15.73:0/4009234640 learned_addr learned my addr 172.21.15.73:0/4009234640 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-12T09:46:42.993 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:42.991+0000 7fda5ffff640 1 --2- 172.21.15.73:0/4009234640 >> v2:172.21.15.73:3300/0 conn(0x7fda60158450 0x7fda60155940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:42.993 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:42.991+0000 7fda656c9640 1 --2- 172.21.15.73:0/4009234640 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fda600c4580 0x7fda600c49b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:42.993 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:42.992+0000 7fda5ffff640 1 -- 172.21.15.73:0/4009234640 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fda600c4580 msgr2=0x7fda600c49b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:46:42.993 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:42.992+0000 7fda5ffff640 1 --2- 172.21.15.73:0/4009234640 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fda600c4580 0x7fda600c49b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:42.993 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:42.992+0000 7fda5ffff640 1 -- 172.21.15.73:0/4009234640 >> v1:172.21.15.73:6789/0 conn(0x7fda60151a90 legacy=0x7fda60154ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:42.994 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:42.992+0000 7fda5ffff640 1 -- 172.21.15.73:0/4009234640 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda60151e70 con 0x7fda60158450 2023-12-12T09:46:42.994 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:42.993+0000 7fda5ffff640 1 --2- 172.21.15.73:0/4009234640 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fda60158450 0x7fda60155940 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 crypto rx=0x7fda4c0097a0 tx=0x7fda4c02b820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b8c455dfe0be78d server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:46:42.995 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:42.993+0000 7fda5f7fe640 1 -- 172.21.15.73:0/4009234640 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda4c031780 con 0x7fda60158450 2023-12-12T09:46:42.995 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:42.993+0000 7fda5f7fe640 1 -- 172.21.15.73:0/4009234640 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda4c0318e0 con 0x7fda60158450 2023-12-12T09:46:42.995 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:42.993+0000 7fda5f7fe640 1 -- 172.21.15.73:0/4009234640 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda4c031c70 con 0x7fda60158450 2023-12-12T09:46:42.995 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:42.994+0000 7fda65eca640 1 -- 172.21.15.73:0/4009234640 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fda60158450 msgr2=0x7fda60155940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:42.995 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:42.994+0000 7fda65eca640 1 --2- 172.21.15.73:0/4009234640 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fda60158450 0x7fda60155940 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 crypto rx=0x7fda4c0097a0 tx=0x7fda4c02b820 comp rx=0 tx=0).stop 2023-12-12T09:46:42.996 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:42.994+0000 7fda65eca640 1 -- 172.21.15.73:0/4009234640 shutdown_connections 2023-12-12T09:46:42.996 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:42.994+0000 7fda65eca640 1 --2- 172.21.15.73:0/4009234640 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fda600c4580 0x7fda600c49b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:42.996 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:42.994+0000 7fda65eca640 1 --2- 172.21.15.73:0/4009234640 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fda60158450 0x7fda60155940 unknown :-1 s=CLOSED pgs=927 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:42.996 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:42.994+0000 7fda65eca640 1 -- 172.21.15.73:0/4009234640 >> 172.21.15.73:0/4009234640 conn(0x7fda60071c10 msgr2=0x7fda60072020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:46:42.996 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:42.994+0000 7fda65eca640 1 -- 172.21.15.73:0/4009234640 shutdown_connections 2023-12-12T09:46:42.996 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:42.994+0000 7fda65eca640 1 -- 172.21.15.73:0/4009234640 wait complete. 2023-12-12T09:46:42.997 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:42.996+0000 7fda65eca640 1 Processor -- start 2023-12-12T09:46:42.998 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:42.996+0000 7fda65eca640 1 -- start start 2023-12-12T09:46:43.000 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:42.997+0000 7fda65eca640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fda600c4580 0x7fda6014bd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:43.000 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:42.997+0000 7fda65eca640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fda60151a90 0x7fda600a98b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:43.000 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:42.997+0000 7fda65eca640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fda60158450 0x7fda600ab840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:43.000 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:42.997+0000 7fda65eca640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda6014e680 con 0x7fda60158450 2023-12-12T09:46:43.000 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:42.997+0000 7fda65eca640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda601ea8a0 con 0x7fda600c4580 2023-12-12T09:46:43.000 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:42.997+0000 7fda65eca640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda601eab40 con 0x7fda60151a90 2023-12-12T09:46:43.000 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:42.998+0000 7fda656c9640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fda60158450 0x7fda600ab840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:43.001 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:42.998+0000 7fda656c9640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fda60158450 0x7fda600ab840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:53894/0 (socket says 172.21.15.73:53894) 2023-12-12T09:46:43.001 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:42.998+0000 7fda656c9640 1 -- 172.21.15.73:0/1242551688 learned_addr learned my addr 172.21.15.73:0/1242551688 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:46:43.001 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:42.998+0000 7fda64ec8640 1 --2- 172.21.15.73:0/1242551688 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fda600c4580 0x7fda6014bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:43.001 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:42.998+0000 7fda5ffff640 1 --2- 172.21.15.73:0/1242551688 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fda60151a90 0x7fda600a98b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:43.001 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:42.998+0000 7fda656c9640 1 -- 172.21.15.73:0/1242551688 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fda60151a90 msgr2=0x7fda600a98b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:43.001 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:42.998+0000 7fda656c9640 1 --2- 172.21.15.73:0/1242551688 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fda60151a90 0x7fda600a98b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:43.001 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:42.998+0000 7fda656c9640 1 -- 172.21.15.73:0/1242551688 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fda600c4580 msgr2=0x7fda6014bd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:43.001 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:42.998+0000 7fda656c9640 1 --2- 172.21.15.73:0/1242551688 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fda600c4580 0x7fda6014bd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:43.001 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:42.998+0000 7fda656c9640 1 -- 172.21.15.73:0/1242551688 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda4c009400 con 0x7fda60158450 2023-12-12T09:46:43.001 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:42.998+0000 7fda64ec8640 1 --2- 172.21.15.73:0/1242551688 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fda600c4580 0x7fda6014bd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:46:43.001 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:42.998+0000 7fda656c9640 1 --2- 172.21.15.73:0/1242551688 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fda60158450 0x7fda600ab840 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x7fda58007e60 tx=0x7fda5800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:46:43.001 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:42.999+0000 7fda5d7fa640 1 -- 172.21.15.73:0/1242551688 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda58014420 con 0x7fda60158450 2023-12-12T09:46:43.001 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:42.999+0000 7fda5d7fa640 1 -- 172.21.15.73:0/1242551688 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda580145a0 con 0x7fda60158450 2023-12-12T09:46:43.001 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:42.999+0000 7fda5d7fa640 1 -- 172.21.15.73:0/1242551688 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda58014950 con 0x7fda60158450 2023-12-12T09:46:43.002 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:42.999+0000 7fda65eca640 1 -- 172.21.15.73:0/1242551688 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda6014e8d0 con 0x7fda60158450 2023-12-12T09:46:43.002 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:42.999+0000 7fda65eca640 1 -- 172.21.15.73:0/1242551688 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda600a9df0 con 0x7fda60158450 2023-12-12T09:46:43.002 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:43.000+0000 7fda65eca640 1 -- 172.21.15.73:0/1242551688 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda60067b10 con 0x7fda60158450 2023-12-12T09:46:43.002 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:43.001+0000 7fda5d7fa640 1 -- 172.21.15.73:0/1242551688 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fda58014ab0 con 0x7fda60158450 2023-12-12T09:46:43.003 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:43.002+0000 7fda5d7fa640 1 --2- 172.21.15.73:0/1242551688 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fda4406ae40 0x7fda4406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:43.004 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:43.002+0000 7fda5d7fa640 1 -- 172.21.15.73:0/1242551688 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fda5808a230 con 0x7fda60158450 2023-12-12T09:46:43.004 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:43.002+0000 7fda64ec8640 1 --2- 172.21.15.73:0/1242551688 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fda4406ae40 0x7fda4406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:43.004 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:43.003+0000 7fda64ec8640 1 --2- 172.21.15.73:0/1242551688 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fda4406ae40 0x7fda4406d300 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fda54005880 tx=0x7fda54009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:46:43.008 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:43.007+0000 7fda5d7fa640 1 -- 172.21.15.73:0/1242551688 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fda58055010 con 0x7fda60158450 2023-12-12T09:46:43.186 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:43.184+0000 7fda65eca640 1 -- 172.21.15.73:0/1242551688 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fda601546a0 con 0x7fda60158450 2023-12-12T09:46:43.188 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:43.187+0000 7fda5d7fa640 1 -- 172.21.15.73:0/1242551688 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v78) v1 ==== 74+0+20239 (secure 0 0 0) 0x7fda58058630 con 0x7fda60158450 2023-12-12T09:46:43.189 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-12T09:46:43.189 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":78,"fsid":"ba240992-02b8-4c7e-92f2-27eb29ac433b","created":"2023-12-12T09:43:02.454719+0000","modified":"2023-12-12T09:46:41.790951+0000","last_up_change":"2023-12-12T09:43:13.913440+0000","last_in_change":"2023-12-12T09:43:05.925348+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-12T09:43:15.525508+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2023-12-12T09:46:24.716544+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2023-12-12T09:46:25.435954+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs2_metadata","create_time":"2023-12-12T09:46:40.116878+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs2_data","create_time":"2023-12-12T09:46:40.798840+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"dd9074be-dbe2-4c34-9896-a4223d8d3940","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":4047810203},{"type":"v1","addr":"172.21.15.73:6801","nonce":4047810203}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":4047810203},{"type":"v1","addr":"172.21.15.73:6803","nonce":4047810203}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":4047810203},{"type":"v1","addr":"172.21.15.73:6807","nonce":4047810203}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":4047810203},{"type":"v1","addr":"172.21.15.73:6805","nonce":4047810203}]},"public_addr":"172.21.15.73:6801/4047810203","cluster_addr":"172.21.15.73:6803/4047810203","heartbeat_back_addr":"172.21.15.73:6807/4047810203","heartbeat_front_addr":"172.21.15.73:6805/4047810203","state":["exists","up"]},{"osd":1,"uuid":"c4a05052-96d4-4758-a4e1-1a37f1e07fed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":1356058331},{"type":"v1","addr":"172.21.15.73:6824","nonce":1356058331}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":1356058331},{"type":"v1","addr":"172.21.15.73:6827","nonce":1356058331}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":1356058331},{"type":"v1","addr":"172.21.15.73:6831","nonce":1356058331}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":1356058331},{"type":"v1","addr":"172.21.15.73:6829","nonce":1356058331}]},"public_addr":"172.21.15.73:6824/1356058331","cluster_addr":"172.21.15.73:6827/1356058331","heartbeat_back_addr":"172.21.15.73:6831/1356058331","heartbeat_front_addr":"172.21.15.73:6829/1356058331","state":["exists","up"]},{"osd":2,"uuid":"512bc8ac-72c2-40d4-b3d2-d867a92c5213","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":1228903316},{"type":"v1","addr":"172.21.15.73:6817","nonce":1228903316}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":1228903316},{"type":"v1","addr":"172.21.15.73:6819","nonce":1228903316}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6823","nonce":1228903316},{"type":"v1","addr":"172.21.15.73:6825","nonce":1228903316}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":1228903316},{"type":"v1","addr":"172.21.15.73:6821","nonce":1228903316}]},"public_addr":"172.21.15.73:6817/1228903316","cluster_addr":"172.21.15.73:6819/1228903316","heartbeat_back_addr":"172.21.15.73:6825/1228903316","heartbeat_front_addr":"172.21.15.73:6821/1228903316","state":["exists","up"]},{"osd":3,"uuid":"3d1a91e0-42bf-437a-8eae-8d357c8f63a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":1293329670},{"type":"v1","addr":"172.21.15.73:6809","nonce":1293329670}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6810","nonce":1293329670},{"type":"v1","addr":"172.21.15.73:6811","nonce":1293329670}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":1293329670},{"type":"v1","addr":"172.21.15.73:6815","nonce":1293329670}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":1293329670},{"type":"v1","addr":"172.21.15.73:6813","nonce":1293329670}]},"public_addr":"172.21.15.73:6809/1293329670","cluster_addr":"172.21.15.73:6811/1293329670","heartbeat_back_addr":"172.21.15.73:6815/1293329670","heartbeat_front_addr":"172.21.15.73:6813/1293329670","state":["exists","up"]},{"osd":4,"uuid":"4b302fff-834c-4069-ac19-00e46f6c87b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":3727975702},{"type":"v1","addr":"172.21.15.142:6801","nonce":3727975702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":3727975702},{"type":"v1","addr":"172.21.15.142:6803","nonce":3727975702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6809","nonce":3727975702},{"type":"v1","addr":"172.21.15.142:6811","nonce":3727975702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6805","nonce":3727975702},{"type":"v1","addr":"172.21.15.142:6807","nonce":3727975702}]},"public_addr":"172.21.15.142:6801/3727975702","cluster_addr":"172.21.15.142:6803/3727975702","heartbeat_back_addr":"172.21.15.142:6811/3727975702","heartbeat_front_addr":"172.21.15.142:6807/3727975702","state":["exists","up"]},{"osd":5,"uuid":"d7cdace2-67d0-45cc-95f2-515cf6ef1b82","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6817","nonce":2353193632},{"type":"v1","addr":"172.21.15.142:6819","nonce":2353193632}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6821","nonce":2353193632},{"type":"v1","addr":"172.21.15.142:6823","nonce":2353193632}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6829","nonce":2353193632},{"type":"v1","addr":"172.21.15.142:6831","nonce":2353193632}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6825","nonce":2353193632},{"type":"v1","addr":"172.21.15.142:6827","nonce":2353193632}]},"public_addr":"172.21.15.142:6819/2353193632","cluster_addr":"172.21.15.142:6823/2353193632","heartbeat_back_addr":"172.21.15.142:6831/2353193632","heartbeat_front_addr":"172.21.15.142:6827/2353193632","state":["exists","up"]},{"osd":6,"uuid":"649ce78a-5626-445c-aedc-a651ed05a6f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":2006111986},{"type":"v1","addr":"172.21.15.142:6806","nonce":2006111986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":2006111986},{"type":"v1","addr":"172.21.15.142:6810","nonce":2006111986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":2006111986},{"type":"v1","addr":"172.21.15.142:6815","nonce":2006111986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":2006111986},{"type":"v1","addr":"172.21.15.142:6813","nonce":2006111986}]},"public_addr":"172.21.15.142:6806/2006111986","cluster_addr":"172.21.15.142:6810/2006111986","heartbeat_back_addr":"172.21.15.142:6815/2006111986","heartbeat_front_addr":"172.21.15.142:6813/2006111986","state":["exists","up"]},{"osd":7,"uuid":"af15ae3b-c1d0-4acf-92db-8a1805494d13","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":2573794341},{"type":"v1","addr":"172.21.15.142:6818","nonce":2573794341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":2573794341},{"type":"v1","addr":"172.21.15.142:6822","nonce":2573794341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":2573794341},{"type":"v1","addr":"172.21.15.142:6830","nonce":2573794341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":2573794341},{"type":"v1","addr":"172.21.15.142:6826","nonce":2573794341}]},"public_addr":"172.21.15.142:6818/2573794341","cluster_addr":"172.21.15.142:6822/2573794341","heartbeat_back_addr":"172.21.15.142:6830/2573794341","heartbeat_front_addr":"172.21.15.142:6826/2573794341","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.185824+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.262103+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.225556+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:10.523459+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:10.706035+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.257339+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.301776+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.051960+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-12T09:46:43.191 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:43.189+0000 7fda65eca640 1 -- 172.21.15.73:0/1242551688 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fda4406ae40 msgr2=0x7fda4406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:43.191 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:43.189+0000 7fda65eca640 1 --2- 172.21.15.73:0/1242551688 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fda4406ae40 0x7fda4406d300 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fda54005880 tx=0x7fda54009040 comp rx=0 tx=0).stop 2023-12-12T09:46:43.191 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:43.189+0000 7fda65eca640 1 -- 172.21.15.73:0/1242551688 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fda60158450 msgr2=0x7fda600ab840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:43.191 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:43.189+0000 7fda65eca640 1 --2- 172.21.15.73:0/1242551688 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fda60158450 0x7fda600ab840 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x7fda58007e60 tx=0x7fda5800e4b0 comp rx=0 tx=0).stop 2023-12-12T09:46:43.191 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:43.189+0000 7fda65eca640 1 -- 172.21.15.73:0/1242551688 shutdown_connections 2023-12-12T09:46:43.191 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:43.189+0000 7fda65eca640 1 --2- 172.21.15.73:0/1242551688 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fda4406ae40 0x7fda4406d300 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:43.191 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:43.189+0000 7fda65eca640 1 --2- 172.21.15.73:0/1242551688 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fda60158450 0x7fda600ab840 unknown :-1 s=CLOSED pgs=928 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:43.191 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:43.189+0000 7fda65eca640 1 --2- 172.21.15.73:0/1242551688 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fda60151a90 0x7fda600a98b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:43.192 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:43.189+0000 7fda65eca640 1 --2- 172.21.15.73:0/1242551688 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fda600c4580 0x7fda6014bd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:43.192 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:43.189+0000 7fda65eca640 1 -- 172.21.15.73:0/1242551688 >> 172.21.15.73:0/1242551688 conn(0x7fda60071c10 msgr2=0x7fda6014b580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:46:43.192 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:43.190+0000 7fda65eca640 1 -- 172.21.15.73:0/1242551688 shutdown_connections 2023-12-12T09:46:43.192 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:43.190+0000 7fda65eca640 1 -- 172.21.15.73:0/1242551688 wait complete. 2023-12-12T09:46:43.210 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs2 standby_count_wanted 0 2023-12-12T09:46:43.419 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:43.417+0000 7fb257b61640 1 Processor -- start 2023-12-12T09:46:43.419 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:43.417+0000 7fb257b61640 1 -- start start 2023-12-12T09:46:43.420 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:43.418+0000 7fb257b61640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb2500c5aa0 0x7fb2501550c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:43.420 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:43.419+0000 7fb257b61640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fb2500c4640 0x7fb2500c4a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:43.420 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:43.419+0000 7fb257b61640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb250157ce0 con 0x7fb2500c2790 2023-12-12T09:46:43.420 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:43.419+0000 7fb257b61640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb250158960 con 0x7fb2500c4640 2023-12-12T09:46:43.420 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:43.419+0000 7fb257b61640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb250155600 con 0x7fb2500c5aa0 2023-12-12T09:46:43.421 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:43.419+0000 7fb2550fc640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb2500c5aa0 0x7fb2501550c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:43.421 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:43.420+0000 7fb2550fc640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb2500c5aa0 0x7fb2501550c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.73:51446/0 (socket says 172.21.15.73:51446) 2023-12-12T09:46:43.421 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:43.420+0000 7fb2550fc640 1 -- 172.21.15.73:0/2608064633 learned_addr learned my addr 172.21.15.73:0/2608064633 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:46:43.421 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:43.420+0000 7fb2558fd640 1 --1- 172.21.15.73:0/2608064633 >> v1:172.21.15.142:6789/0 conn(0x7fb2500c2790 0x7fb250151a00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.73:56270/0 (socket says 172.21.15.73:56270) 2023-12-12T09:46:43.421 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:43.420+0000 7fb2560fe640 1 --2- 172.21.15.73:0/2608064633 >> v2:172.21.15.142:3300/0 conn(0x7fb2500c4640 0x7fb2500c4a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:43.422 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:43.420+0000 7fb2560fe640 1 -- 172.21.15.73:0/2608064633 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb2500c5aa0 msgr2=0x7fb2501550c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:46:43.422 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:43.420+0000 7fb2560fe640 1 --2- 172.21.15.73:0/2608064633 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb2500c5aa0 0x7fb2501550c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:43.422 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:43.420+0000 7fb2560fe640 1 -- 172.21.15.73:0/2608064633 >> v1:172.21.15.142:6789/0 conn(0x7fb2500c2790 legacy=0x7fb250151a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:43.422 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:43.420+0000 7fb2560fe640 1 -- 172.21.15.73:0/2608064633 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb250157fc0 con 0x7fb2500c4640 2023-12-12T09:46:43.422 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:43.420+0000 7fb2550fc640 1 --2- 172.21.15.73:0/2608064633 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb2500c5aa0 0x7fb2501550c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-12T09:46:43.423 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:43.422+0000 7fb2560fe640 1 --2- 172.21.15.73:0/2608064633 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb2500c4640 0x7fb2500c4a70 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fb248009d90 tx=0x7fb24802bd90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=66fe893f85d0dcbf server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:46:43.423 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:43.422+0000 7fb2548fb640 1 -- 172.21.15.73:0/2608064633 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb24802cb40 con 0x7fb2500c4640 2023-12-12T09:46:43.424 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:43.422+0000 7fb2548fb640 1 -- 172.21.15.73:0/2608064633 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb24802cca0 con 0x7fb2500c4640 2023-12-12T09:46:43.424 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:43.422+0000 7fb2548fb640 1 -- 172.21.15.73:0/2608064633 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb248034660 con 0x7fb2500c4640 2023-12-12T09:46:43.425 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:43.423+0000 7fb257b61640 1 -- 172.21.15.73:0/2608064633 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb2500c4640 msgr2=0x7fb2500c4a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:43.425 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:43.423+0000 7fb257b61640 1 --2- 172.21.15.73:0/2608064633 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb2500c4640 0x7fb2500c4a70 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fb248009d90 tx=0x7fb24802bd90 comp rx=0 tx=0).stop 2023-12-12T09:46:43.425 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:43.423+0000 7fb257b61640 1 -- 172.21.15.73:0/2608064633 shutdown_connections 2023-12-12T09:46:43.425 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:43.423+0000 7fb257b61640 1 --2- 172.21.15.73:0/2608064633 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb2500c5aa0 0x7fb2501550c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:43.425 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:43.423+0000 7fb257b61640 1 --2- 172.21.15.73:0/2608064633 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb2500c4640 0x7fb2500c4a70 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:43.425 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:43.423+0000 7fb257b61640 1 -- 172.21.15.73:0/2608064633 >> 172.21.15.73:0/2608064633 conn(0x7fb2500a9890 msgr2=0x7fb2500a9ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:46:43.425 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:43.423+0000 7fb257b61640 1 -- 172.21.15.73:0/2608064633 shutdown_connections 2023-12-12T09:46:43.425 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:43.423+0000 7fb257b61640 1 -- 172.21.15.73:0/2608064633 wait complete. 2023-12-12T09:46:43.426 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:43.425+0000 7fb257b61640 1 Processor -- start 2023-12-12T09:46:43.426 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:43.425+0000 7fb257b61640 1 -- start start 2023-12-12T09:46:43.428 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:43.426+0000 7fb257b61640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb2500c2790 0x7fb2501e9970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:43.428 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:43.426+0000 7fb257b61640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb2500c4640 0x7fb2500c80d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:43.428 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:43.426+0000 7fb257b61640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb2500c5aa0 0x7fb2500a8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:43.428 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:43.426+0000 7fb257b61640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2501ed110 con 0x7fb2500c4640 2023-12-12T09:46:43.428 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:43.426+0000 7fb257b61640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2500aac20 con 0x7fb2500c2790 2023-12-12T09:46:43.428 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:43.426+0000 7fb257b61640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb25006f0e0 con 0x7fb2500c5aa0 2023-12-12T09:46:43.428 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:43.426+0000 7fb2550fc640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb2500c4640 0x7fb2500c80d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:43.428 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:43.426+0000 7fb2550fc640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb2500c4640 0x7fb2500c80d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:53900/0 (socket says 172.21.15.73:53900) 2023-12-12T09:46:43.428 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:43.426+0000 7fb2550fc640 1 -- 172.21.15.73:0/1647942163 learned_addr learned my addr 172.21.15.73:0/1647942163 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:46:43.430 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:43.427+0000 7fb2560fe640 1 --2- 172.21.15.73:0/1647942163 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb2500c5aa0 0x7fb2500a8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:43.430 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:43.427+0000 7fb2558fd640 1 --2- 172.21.15.73:0/1647942163 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb2500c2790 0x7fb2501e9970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:43.430 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:43.427+0000 7fb2550fc640 1 -- 172.21.15.73:0/1647942163 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb2500c5aa0 msgr2=0x7fb2500a8aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:43.430 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:43.427+0000 7fb2550fc640 1 --2- 172.21.15.73:0/1647942163 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb2500c5aa0 0x7fb2500a8aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:43.430 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:43.427+0000 7fb2550fc640 1 -- 172.21.15.73:0/1647942163 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb2500c2790 msgr2=0x7fb2501e9970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:43.430 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:43.427+0000 7fb2550fc640 1 --2- 172.21.15.73:0/1647942163 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb2500c2790 0x7fb2501e9970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:43.430 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:43.427+0000 7fb2550fc640 1 -- 172.21.15.73:0/1647942163 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2400094d0 con 0x7fb2500c4640 2023-12-12T09:46:43.430 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:43.427+0000 7fb2558fd640 1 --2- 172.21.15.73:0/1647942163 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb2500c2790 0x7fb2501e9970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:46:43.430 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:43.427+0000 7fb2550fc640 1 --2- 172.21.15.73:0/1647942163 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb2500c4640 0x7fb2500c80d0 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 crypto rx=0x7fb24000e9b0 tx=0x7fb24000ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:46:43.430 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:43.428+0000 7fb2467fc640 1 -- 172.21.15.73:0/1647942163 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb24000c9a0 con 0x7fb2500c4640 2023-12-12T09:46:43.430 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:43.428+0000 7fb2467fc640 1 -- 172.21.15.73:0/1647942163 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb24000cb00 con 0x7fb2500c4640 2023-12-12T09:46:43.430 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:43.428+0000 7fb257b61640 1 -- 172.21.15.73:0/1647942163 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb248009a70 con 0x7fb2500c4640 2023-12-12T09:46:43.431 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:43.428+0000 7fb2467fc640 1 -- 172.21.15.73:0/1647942163 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb24000ce70 con 0x7fb2500c4640 2023-12-12T09:46:43.431 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:43.428+0000 7fb257b61640 1 -- 172.21.15.73:0/1647942163 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb25006f6a0 con 0x7fb2500c4640 2023-12-12T09:46:43.431 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:43.429+0000 7fb257b61640 1 -- 172.21.15.73:0/1647942163 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2500c8610 con 0x7fb2500c4640 2023-12-12T09:46:43.431 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:43.430+0000 7fb2467fc640 1 -- 172.21.15.73:0/1647942163 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fb240013470 con 0x7fb2500c4640 2023-12-12T09:46:43.432 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:43.431+0000 7fb2467fc640 1 --2- 172.21.15.73:0/1647942163 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fb23406ae40 0x7fb23406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:43.433 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:43.431+0000 7fb2467fc640 1 -- 172.21.15.73:0/1647942163 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fb240089f30 con 0x7fb2500c4640 2023-12-12T09:46:43.433 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:43.431+0000 7fb2558fd640 1 --2- 172.21.15.73:0/1647942163 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fb23406ae40 0x7fb23406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:43.433 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:43.432+0000 7fb2558fd640 1 --2- 172.21.15.73:0/1647942163 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fb23406ae40 0x7fb23406d300 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fb24c000f60 tx=0x7fb24c009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:46:43.437 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:43.435+0000 7fb2467fc640 1 -- 172.21.15.73:0/1647942163 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fb240054c70 con 0x7fb2500c4640 2023-12-12T09:46:43.666 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:43.665+0000 7fb257b61640 1 -- 172.21.15.73:0/1647942163 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs2", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fb2501549e0 con 0x7fb2500c4640 2023-12-12T09:46:44.376 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:44.374+0000 7fb2467fc640 1 -- 172.21.15.73:0/1647942163 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs2", "var": "standby_count_wanted", "val": "0"}]=0 v48) v1 ==== 119+0+0 (secure 0 0 0) 0x7fb2400170b0 con 0x7fb2500c4640 2023-12-12T09:46:44.380 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:44.378+0000 7fb257b61640 1 -- 172.21.15.73:0/1647942163 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fb23406ae40 msgr2=0x7fb23406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:44.380 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:44.378+0000 7fb257b61640 1 --2- 172.21.15.73:0/1647942163 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fb23406ae40 0x7fb23406d300 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fb24c000f60 tx=0x7fb24c009040 comp rx=0 tx=0).stop 2023-12-12T09:46:44.381 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:44.378+0000 7fb257b61640 1 -- 172.21.15.73:0/1647942163 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb2500c4640 msgr2=0x7fb2500c80d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:44.381 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:44.378+0000 7fb257b61640 1 --2- 172.21.15.73:0/1647942163 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb2500c4640 0x7fb2500c80d0 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 crypto rx=0x7fb24000e9b0 tx=0x7fb24000ee70 comp rx=0 tx=0).stop 2023-12-12T09:46:44.381 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:44.379+0000 7fb257b61640 1 -- 172.21.15.73:0/1647942163 shutdown_connections 2023-12-12T09:46:44.381 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:44.379+0000 7fb257b61640 1 --2- 172.21.15.73:0/1647942163 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fb23406ae40 0x7fb23406d300 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:44.381 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:44.379+0000 7fb257b61640 1 --2- 172.21.15.73:0/1647942163 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb2500c5aa0 0x7fb2500a8aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:44.381 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:44.379+0000 7fb257b61640 1 --2- 172.21.15.73:0/1647942163 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb2500c4640 0x7fb2500c80d0 unknown :-1 s=CLOSED pgs=929 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:44.381 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:44.379+0000 7fb257b61640 1 --2- 172.21.15.73:0/1647942163 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb2500c2790 0x7fb2501e9970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:44.381 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:44.379+0000 7fb257b61640 1 -- 172.21.15.73:0/1647942163 >> 172.21.15.73:0/1647942163 conn(0x7fb2500a9890 msgr2=0x7fb25006c130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:46:44.381 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:44.379+0000 7fb257b61640 1 -- 172.21.15.73:0/1647942163 shutdown_connections 2023-12-12T09:46:44.381 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:44.379+0000 7fb257b61640 1 -- 172.21.15.73:0/1647942163 wait complete. 2023-12-12T09:46:44.401 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-12-12T09:46:44.402 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs2 allow_standby_replay false 2023-12-12T09:46:44.617 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:44.615+0000 7fc8fe610640 1 Processor -- start 2023-12-12T09:46:44.617 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:44.615+0000 7fc8fe610640 1 -- start start 2023-12-12T09:46:44.618 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:44.617+0000 7fc8fe610640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fc8f80c0320 0x7fc8f806cc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:44.618 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:44.617+0000 7fc8fe610640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fc8f80c2790 0x7fc8f80c50d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:44.618 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:44.617+0000 7fc8fe610640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8f80c1520 con 0x7fc8f80c23b0 2023-12-12T09:46:44.618 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:44.617+0000 7fc8fe610640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8f80c46f0 con 0x7fc8f80c2790 2023-12-12T09:46:44.619 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:44.617+0000 7fc8fe610640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8f80c2c20 con 0x7fc8f80c0320 2023-12-12T09:46:44.619 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:44.617+0000 7fc8fcbad640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fc8f80c2790 0x7fc8f80c50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:44.619 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:44.617+0000 7fc8fcbad640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fc8f80c2790 0x7fc8f80c50d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:53912/0 (socket says 172.21.15.73:53912) 2023-12-12T09:46:44.620 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:44.617+0000 7fc8fcbad640 1 -- 172.21.15.73:0/919980913 learned_addr learned my addr 172.21.15.73:0/919980913 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:46:44.620 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:44.618+0000 7fc8fcbad640 1 -- 172.21.15.73:0/919980913 >> v2:172.21.15.142:3300/0 conn(0x7fc8f80c0320 msgr2=0x7fc8f806cc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:46:44.620 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:44.618+0000 7fc8fcbad640 1 --2- 172.21.15.73:0/919980913 >> v2:172.21.15.142:3300/0 conn(0x7fc8f80c0320 0x7fc8f806cc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:44.620 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:44.618+0000 7fc8fcbad640 1 -- 172.21.15.73:0/919980913 >> v1:172.21.15.142:6789/0 conn(0x7fc8f80c23b0 legacy=0x7fc8f8159410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:46:44.620 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:44.618+0000 7fc8fcbad640 1 -- 172.21.15.73:0/919980913 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8f80c0920 con 0x7fc8f80c2790 2023-12-12T09:46:44.620 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:44.619+0000 7fc8fcbad640 1 --2- 172.21.15.73:0/919980913 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc8f80c2790 0x7fc8f80c50d0 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 crypto rx=0x7fc8f80c3c70 tx=0x7fc8f002bdc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30c6fe4deda821e1 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:46:44.620 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:44.619+0000 7fc8f77fe640 1 -- 172.21.15.73:0/919980913 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8f002c960 con 0x7fc8f80c2790 2023-12-12T09:46:44.621 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:44.619+0000 7fc8f77fe640 1 -- 172.21.15.73:0/919980913 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8f002cac0 con 0x7fc8f80c2790 2023-12-12T09:46:44.621 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:44.619+0000 7fc8f77fe640 1 -- 172.21.15.73:0/919980913 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8f002ce50 con 0x7fc8f80c2790 2023-12-12T09:46:44.621 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:44.620+0000 7fc8fe610640 1 -- 172.21.15.73:0/919980913 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc8f80c2790 msgr2=0x7fc8f80c50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:44.622 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:44.620+0000 7fc8fe610640 1 --2- 172.21.15.73:0/919980913 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc8f80c2790 0x7fc8f80c50d0 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 crypto rx=0x7fc8f80c3c70 tx=0x7fc8f002bdc0 comp rx=0 tx=0).stop 2023-12-12T09:46:44.622 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:44.620+0000 7fc8fe610640 1 -- 172.21.15.73:0/919980913 shutdown_connections 2023-12-12T09:46:44.622 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:44.620+0000 7fc8fe610640 1 --2- 172.21.15.73:0/919980913 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc8f80c2790 0x7fc8f80c50d0 unknown :-1 s=CLOSED pgs=930 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:44.622 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:44.620+0000 7fc8fe610640 1 --2- 172.21.15.73:0/919980913 >> v2:172.21.15.142:3300/0 conn(0x7fc8f80c0320 0x7fc8f806cc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:44.622 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:44.620+0000 7fc8fe610640 1 -- 172.21.15.73:0/919980913 >> 172.21.15.73:0/919980913 conn(0x7fc8f806a4e0 msgr2=0x7fc8f806a8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:46:44.622 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:44.620+0000 7fc8fe610640 1 -- 172.21.15.73:0/919980913 shutdown_connections 2023-12-12T09:46:44.622 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:44.620+0000 7fc8fe610640 1 -- 172.21.15.73:0/919980913 wait complete. 2023-12-12T09:46:44.623 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:44.622+0000 7fc8fe610640 1 Processor -- start 2023-12-12T09:46:44.623 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:44.622+0000 7fc8fe610640 1 -- start start 2023-12-12T09:46:44.625 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:44.623+0000 7fc8fe610640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc8f80c0320 0x7fc8f815b570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:44.625 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:44.623+0000 7fc8fe610640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc8f80c23b0 0x7fc8f81e5590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:44.625 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:44.623+0000 7fc8fe610640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc8f80c2790 0x7fc8f81efd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:44.625 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:44.623+0000 7fc8fe610640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8f8150bd0 con 0x7fc8f80c0320 2023-12-12T09:46:44.625 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:44.623+0000 7fc8fe610640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8f815b0e0 con 0x7fc8f80c2790 2023-12-12T09:46:44.625 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:44.623+0000 7fc8fe610640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8f81e5ad0 con 0x7fc8f80c23b0 2023-12-12T09:46:44.625 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:44.623+0000 7fc8f7fff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc8f80c0320 0x7fc8f815b570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:44.625 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:44.623+0000 7fc8f7fff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc8f80c0320 0x7fc8f815b570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:53922/0 (socket says 172.21.15.73:53922) 2023-12-12T09:46:44.625 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:44.623+0000 7fc8f7fff640 1 -- 172.21.15.73:0/1437601133 learned_addr learned my addr 172.21.15.73:0/1437601133 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:46:44.625 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:44.624+0000 7fc8effff640 1 --2- 172.21.15.73:0/1437601133 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc8f80c23b0 0x7fc8f81e5590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:44.630 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:44.624+0000 7fc8fcbad640 1 --2- 172.21.15.73:0/1437601133 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc8f80c2790 0x7fc8f81efd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:44.630 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:44.624+0000 7fc8f7fff640 1 -- 172.21.15.73:0/1437601133 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc8f80c23b0 msgr2=0x7fc8f81e5590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:44.630 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:44.624+0000 7fc8f7fff640 1 --2- 172.21.15.73:0/1437601133 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc8f80c23b0 0x7fc8f81e5590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:44.630 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:44.624+0000 7fc8f7fff640 1 -- 172.21.15.73:0/1437601133 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc8f80c2790 msgr2=0x7fc8f81efd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:44.630 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:44.624+0000 7fc8f7fff640 1 --2- 172.21.15.73:0/1437601133 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc8f80c2790 0x7fc8f81efd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:44.630 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:44.624+0000 7fc8f7fff640 1 -- 172.21.15.73:0/1437601133 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8f0009b30 con 0x7fc8f80c0320 2023-12-12T09:46:44.630 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:44.624+0000 7fc8fcbad640 1 --2- 172.21.15.73:0/1437601133 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc8f80c2790 0x7fc8f81efd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:46:44.630 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:44.624+0000 7fc8f7fff640 1 --2- 172.21.15.73:0/1437601133 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc8f80c0320 0x7fc8f815b570 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 crypto rx=0x7fc8e800b3e0 tx=0x7fc8e800b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:46:44.630 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:44.624+0000 7fc8f57fa640 1 -- 172.21.15.73:0/1437601133 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8e8011830 con 0x7fc8f80c0320 2023-12-12T09:46:44.631 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:44.624+0000 7fc8f57fa640 1 -- 172.21.15.73:0/1437601133 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8e80119b0 con 0x7fc8f80c0320 2023-12-12T09:46:44.631 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:44.624+0000 7fc8fe610640 1 -- 172.21.15.73:0/1437601133 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8f81f2940 con 0x7fc8f80c0320 2023-12-12T09:46:44.631 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:44.624+0000 7fc8f57fa640 1 -- 172.21.15.73:0/1437601133 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8e8011d60 con 0x7fc8f80c0320 2023-12-12T09:46:44.631 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:44.625+0000 7fc8fe610640 1 -- 172.21.15.73:0/1437601133 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8f815ad70 con 0x7fc8f80c0320 2023-12-12T09:46:44.631 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:44.626+0000 7fc8fe610640 1 -- 172.21.15.73:0/1437601133 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc8f8067070 con 0x7fc8f80c0320 2023-12-12T09:46:44.632 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:44.627+0000 7fc8f57fa640 1 -- 172.21.15.73:0/1437601133 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fc8e801a400 con 0x7fc8f80c0320 2023-12-12T09:46:44.632 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:44.627+0000 7fc8f57fa640 1 --2- 172.21.15.73:0/1437601133 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fc8d806ae70 0x7fc8d806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:44.632 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:44.628+0000 7fc8f57fa640 1 -- 172.21.15.73:0/1437601133 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fc8e8089a10 con 0x7fc8f80c0320 2023-12-12T09:46:44.632 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:44.628+0000 7fc8effff640 1 --2- 172.21.15.73:0/1437601133 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fc8d806ae70 0x7fc8d806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:44.632 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:44.628+0000 7fc8effff640 1 --2- 172.21.15.73:0/1437601133 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fc8d806ae70 0x7fc8d806d330 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fc8f80c6460 tx=0x7fc8e0008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:46:44.633 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:44.632+0000 7fc8f57fa640 1 -- 172.21.15.73:0/1437601133 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fc8e80547f0 con 0x7fc8f80c0320 2023-12-12T09:46:44.861 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:44.859+0000 7fc8fe610640 1 -- 172.21.15.73:0/1437601133 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs2", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fc8f8067580 con 0x7fc8f80c0320 2023-12-12T09:46:45.386 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:45.385+0000 7fc8f57fa640 1 -- 172.21.15.73:0/1437601133 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs2", "var": "allow_standby_replay", "val": "false"}]=0 v49) v1 ==== 123+0+0 (secure 0 0 0) 0x7fc8e80150c0 con 0x7fc8f80c0320 2023-12-12T09:46:45.390 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:45.388+0000 7fc8fe610640 1 -- 172.21.15.73:0/1437601133 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fc8d806ae70 msgr2=0x7fc8d806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:45.390 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:45.388+0000 7fc8fe610640 1 --2- 172.21.15.73:0/1437601133 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fc8d806ae70 0x7fc8d806d330 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fc8f80c6460 tx=0x7fc8e0008040 comp rx=0 tx=0).stop 2023-12-12T09:46:45.391 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:45.388+0000 7fc8fe610640 1 -- 172.21.15.73:0/1437601133 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc8f80c0320 msgr2=0x7fc8f815b570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:45.391 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:45.388+0000 7fc8fe610640 1 --2- 172.21.15.73:0/1437601133 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc8f80c0320 0x7fc8f815b570 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 crypto rx=0x7fc8e800b3e0 tx=0x7fc8e800b8a0 comp rx=0 tx=0).stop 2023-12-12T09:46:45.391 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:45.389+0000 7fc8fe610640 1 -- 172.21.15.73:0/1437601133 shutdown_connections 2023-12-12T09:46:45.391 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:45.389+0000 7fc8fe610640 1 --2- 172.21.15.73:0/1437601133 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fc8d806ae70 0x7fc8d806d330 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:45.391 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:45.389+0000 7fc8fe610640 1 --2- 172.21.15.73:0/1437601133 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc8f80c2790 0x7fc8f81efd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:45.391 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:45.389+0000 7fc8fe610640 1 --2- 172.21.15.73:0/1437601133 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc8f80c23b0 0x7fc8f81e5590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:45.391 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:45.389+0000 7fc8fe610640 1 --2- 172.21.15.73:0/1437601133 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc8f80c0320 0x7fc8f815b570 unknown :-1 s=CLOSED pgs=931 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:45.391 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:45.389+0000 7fc8fe610640 1 -- 172.21.15.73:0/1437601133 >> 172.21.15.73:0/1437601133 conn(0x7fc8f806a4e0 msgr2=0x7fc8f806a8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:46:45.391 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:45.389+0000 7fc8fe610640 1 -- 172.21.15.73:0/1437601133 shutdown_connections 2023-12-12T09:46:45.391 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:45.389+0000 7fc8fe610640 1 -- 172.21.15.73:0/1437601133 wait complete. 2023-12-12T09:46:45.411 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs2' 2023-12-12T09:46:45.411 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-12T09:46:45.622 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:45.620+0000 7f8c9bbbe640 1 Processor -- start 2023-12-12T09:46:45.622 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:45.620+0000 7f8c9bbbe640 1 -- start start 2023-12-12T09:46:45.624 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:45.622+0000 7f8c9bbbe640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f8c9406a750 0x7f8c94159020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:45.624 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:45.622+0000 7f8c9bbbe640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f8c94071f00 0x7f8c94155aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:45.624 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:45.622+0000 7f8c9bbbe640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8c940bfdc0 0x7f8c9415bec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:45.624 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:45.622+0000 7f8c9bbbe640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c940727c0 con 0x7f8c94071f00 2023-12-12T09:46:45.624 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:45.622+0000 7f8c9bbbe640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c941588f0 con 0x7f8c9406a750 2023-12-12T09:46:45.624 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:45.622+0000 7f8c9bbbe640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c94158b90 con 0x7f8c940bfdc0 2023-12-12T09:46:45.624 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:45.622+0000 7f8c99159640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f8c94071f00 0x7f8c94155aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:45.624 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:45.622+0000 7f8c99159640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f8c94071f00 0x7f8c94155aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:53926/0 (socket says 172.21.15.73:53926) 2023-12-12T09:46:45.624 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:45.622+0000 7f8c99159640 1 -- 172.21.15.73:0/3226890858 learned_addr learned my addr 172.21.15.73:0/3226890858 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:46:45.624 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:45.622+0000 7f8c99159640 1 -- 172.21.15.73:0/3226890858 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8c940bfdc0 msgr2=0x7f8c9415bec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:46:45.625 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:45.622+0000 7f8c99159640 1 --2- 172.21.15.73:0/3226890858 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8c940bfdc0 0x7f8c9415bec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:45.625 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:45.623+0000 7f8c99159640 1 -- 172.21.15.73:0/3226890858 >> v2:172.21.15.142:3300/0 conn(0x7f8c9406a750 msgr2=0x7f8c94159020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:46:45.625 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:45.623+0000 7f8c99159640 1 --2- 172.21.15.73:0/3226890858 >> v2:172.21.15.142:3300/0 conn(0x7f8c9406a750 0x7f8c94159020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:45.625 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:45.623+0000 7f8c99159640 1 -- 172.21.15.73:0/3226890858 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c940c4e30 con 0x7f8c94071f00 2023-12-12T09:46:45.625 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:45.624+0000 7f8c99159640 1 --2- 172.21.15.73:0/3226890858 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8c94071f00 0x7f8c94155aa0 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 crypto rx=0x7f8c9406e3c0 tx=0x7f8c8402b7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5de1bc4da69dbf8 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:46:45.625 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:45.624+0000 7f8c98958640 1 -- 172.21.15.73:0/3226890858 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c84031740 con 0x7f8c94071f00 2023-12-12T09:46:45.625 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:45.624+0000 7f8c98958640 1 -- 172.21.15.73:0/3226890858 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c840318a0 con 0x7f8c94071f00 2023-12-12T09:46:45.626 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:45.624+0000 7f8c98958640 1 -- 172.21.15.73:0/3226890858 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c84031c30 con 0x7f8c94071f00 2023-12-12T09:46:45.626 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:45.625+0000 7f8c9bbbe640 1 -- 172.21.15.73:0/3226890858 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8c94071f00 msgr2=0x7f8c94155aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:45.627 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:45.625+0000 7f8c9bbbe640 1 --2- 172.21.15.73:0/3226890858 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8c94071f00 0x7f8c94155aa0 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 crypto rx=0x7f8c9406e3c0 tx=0x7f8c8402b7e0 comp rx=0 tx=0).stop 2023-12-12T09:46:45.627 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:45.625+0000 7f8c9bbbe640 1 -- 172.21.15.73:0/3226890858 shutdown_connections 2023-12-12T09:46:45.627 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:45.625+0000 7f8c9bbbe640 1 --2- 172.21.15.73:0/3226890858 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8c940bfdc0 0x7f8c9415bec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:45.627 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:45.625+0000 7f8c9bbbe640 1 --2- 172.21.15.73:0/3226890858 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8c94071f00 0x7f8c94155aa0 unknown :-1 s=CLOSED pgs=932 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:45.627 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:45.625+0000 7f8c9bbbe640 1 --2- 172.21.15.73:0/3226890858 >> v2:172.21.15.142:3300/0 conn(0x7f8c9406a750 0x7f8c94159020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:45.627 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:45.625+0000 7f8c9bbbe640 1 -- 172.21.15.73:0/3226890858 >> 172.21.15.73:0/3226890858 conn(0x7f8c940a8130 msgr2=0x7f8c940c24b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:46:45.627 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:45.625+0000 7f8c9bbbe640 1 -- 172.21.15.73:0/3226890858 shutdown_connections 2023-12-12T09:46:45.627 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:45.625+0000 7f8c9bbbe640 1 -- 172.21.15.73:0/3226890858 wait complete. 2023-12-12T09:46:45.628 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:45.627+0000 7f8c9bbbe640 1 Processor -- start 2023-12-12T09:46:45.628 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:45.627+0000 7f8c9bbbe640 1 -- start start 2023-12-12T09:46:45.629 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:45.628+0000 7f8c9bbbe640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8c9406a750 0x7f8c941f2640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:45.630 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:45.628+0000 7f8c9bbbe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8c94071f00 0x7f8c94151ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:45.630 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:45.628+0000 7f8c9bbbe640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8c940bfdc0 0x7f8c940c3810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:45.630 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:45.628+0000 7f8c9bbbe640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c94159ff0 con 0x7f8c94071f00 2023-12-12T09:46:45.630 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:45.628+0000 7f8c9bbbe640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c941523e0 con 0x7f8c9406a750 2023-12-12T09:46:45.630 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:45.628+0000 7f8c9bbbe640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c94154740 con 0x7f8c940bfdc0 2023-12-12T09:46:45.630 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:45.628+0000 7f8c99159640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8c94071f00 0x7f8c94151ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:45.630 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:45.628+0000 7f8c99159640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8c94071f00 0x7f8c94151ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:53940/0 (socket says 172.21.15.73:53940) 2023-12-12T09:46:45.630 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:45.628+0000 7f8c99159640 1 -- 172.21.15.73:0/2400615663 learned_addr learned my addr 172.21.15.73:0/2400615663 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:46:45.632 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:45.629+0000 7f8c9995a640 1 --2- 172.21.15.73:0/2400615663 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8c9406a750 0x7f8c941f2640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:45.632 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:45.629+0000 7f8c9a15b640 1 --2- 172.21.15.73:0/2400615663 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8c940bfdc0 0x7f8c940c3810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:45.632 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:45.629+0000 7f8c99159640 1 -- 172.21.15.73:0/2400615663 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8c940bfdc0 msgr2=0x7f8c940c3810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:45.632 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:45.629+0000 7f8c99159640 1 --2- 172.21.15.73:0/2400615663 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8c940bfdc0 0x7f8c940c3810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:45.632 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:45.629+0000 7f8c99159640 1 -- 172.21.15.73:0/2400615663 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8c9406a750 msgr2=0x7f8c941f2640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:45.632 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:45.629+0000 7f8c99159640 1 --2- 172.21.15.73:0/2400615663 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8c9406a750 0x7f8c941f2640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:45.632 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:45.629+0000 7f8c99159640 1 -- 172.21.15.73:0/2400615663 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c840094d0 con 0x7f8c94071f00 2023-12-12T09:46:45.632 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:45.629+0000 7f8c9a15b640 1 --2- 172.21.15.73:0/2400615663 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8c940bfdc0 0x7f8c940c3810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:46:45.632 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:45.629+0000 7f8c99159640 1 --2- 172.21.15.73:0/2400615663 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8c94071f00 0x7f8c94151ea0 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 crypto rx=0x7f8c8402b820 tx=0x7f8c840046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:46:45.632 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:45.629+0000 7f8c8a7fc640 1 -- 172.21.15.73:0/2400615663 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c84033c70 con 0x7f8c94071f00 2023-12-12T09:46:45.632 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:45.629+0000 7f8c8a7fc640 1 -- 172.21.15.73:0/2400615663 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c84033dd0 con 0x7f8c94071f00 2023-12-12T09:46:45.632 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:45.629+0000 7f8c8a7fc640 1 -- 172.21.15.73:0/2400615663 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c8403d6b0 con 0x7f8c94071f00 2023-12-12T09:46:45.633 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:45.629+0000 7f8c9bbbe640 1 -- 172.21.15.73:0/2400615663 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c940c4200 con 0x7f8c94071f00 2023-12-12T09:46:45.633 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:45.630+0000 7f8c9bbbe640 1 -- 172.21.15.73:0/2400615663 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c940a88f0 con 0x7f8c94071f00 2023-12-12T09:46:45.633 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:45.631+0000 7f8c9bbbe640 1 -- 172.21.15.73:0/2400615663 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c9406cac0 con 0x7f8c94071f00 2023-12-12T09:46:45.633 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:45.632+0000 7f8c8a7fc640 1 -- 172.21.15.73:0/2400615663 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f8c8403a040 con 0x7f8c94071f00 2023-12-12T09:46:45.634 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:45.633+0000 7f8c8a7fc640 1 --2- 172.21.15.73:0/2400615663 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f8c7806ae70 0x7f8c7806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:45.635 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:45.633+0000 7f8c8a7fc640 1 -- 172.21.15.73:0/2400615663 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f8c840abc10 con 0x7f8c94071f00 2023-12-12T09:46:45.635 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:45.633+0000 7f8c9995a640 1 --2- 172.21.15.73:0/2400615663 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f8c7806ae70 0x7f8c7806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:45.635 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:45.634+0000 7f8c9995a640 1 --2- 172.21.15.73:0/2400615663 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f8c7806ae70 0x7f8c7806d330 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f8c94154230 tx=0x7f8c90008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:46:45.639 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:45.638+0000 7f8c8a7fc640 1 -- 172.21.15.73:0/2400615663 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f8c840769f0 con 0x7f8c94071f00 2023-12-12T09:46:45.867 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:45.866+0000 7f8c9bbbe640 1 -- 172.21.15.73:0/2400615663 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8c940c1960 con 0x7f8c94071f00 2023-12-12T09:46:45.869 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:45.867+0000 7f8c8a7fc640 1 -- 172.21.15.73:0/2400615663 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 49 v49) v1 ==== 94+0+6137 (secure 0 0 0) 0x7f8c84038090 con 0x7f8c94071f00 2023-12-12T09:46:45.869 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-12T09:46:45.869 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":49,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4943,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6835/3004685650","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6833","nonce":3004685650},{"type":"v1","addr":"172.21.15.142:6835","nonce":3004685650}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40},{"gid":5365,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6834/3290362874","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6832","nonce":3290362874},{"type":"v1","addr":"172.21.15.142:6834","nonce":3290362874}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40}],"filesystems":[{"mdsmap":{"epoch":44,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-12T09:46:26.429627+0000","modified":"2023-12-12T09:46:29.788335+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6429},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6429":{"gid":6429,"name":"c","rank":0,"incarnation":41,"state":"up:active","state_seq":3,"addr":"172.21.15.73:6837/2352791649","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6835","nonce":2352791649},{"type":"v1","addr":"172.21.15.73:6837","nonce":2352791649}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6},{"mdsmap":{"epoch":49,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-12T09:46:41.791760+0000","modified":"2023-12-12T09:46:44.861785+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6426},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6426":{"gid":6426,"name":"a","rank":0,"incarnation":45,"state":"up:active","state_seq":7,"addr":"172.21.15.73:6836/340095591","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":340095591},{"type":"v1","addr":"172.21.15.73:6836","nonce":340095591}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2023-12-12T09:46:45.870 INFO:teuthology.orchestra.run.smithi073.stderr:dumped fsmap epoch 49 2023-12-12T09:46:45.871 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:45.869+0000 7f8c9bbbe640 1 -- 172.21.15.73:0/2400615663 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f8c7806ae70 msgr2=0x7f8c7806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:45.871 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:45.869+0000 7f8c9bbbe640 1 --2- 172.21.15.73:0/2400615663 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f8c7806ae70 0x7f8c7806d330 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f8c94154230 tx=0x7f8c90008040 comp rx=0 tx=0).stop 2023-12-12T09:46:45.871 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:45.869+0000 7f8c9bbbe640 1 -- 172.21.15.73:0/2400615663 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8c94071f00 msgr2=0x7f8c94151ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:45.871 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:45.869+0000 7f8c9bbbe640 1 --2- 172.21.15.73:0/2400615663 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8c94071f00 0x7f8c94151ea0 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 crypto rx=0x7f8c8402b820 tx=0x7f8c840046c0 comp rx=0 tx=0).stop 2023-12-12T09:46:45.871 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:45.870+0000 7f8c9bbbe640 1 -- 172.21.15.73:0/2400615663 shutdown_connections 2023-12-12T09:46:45.871 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:45.870+0000 7f8c9bbbe640 1 --2- 172.21.15.73:0/2400615663 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f8c7806ae70 0x7f8c7806d330 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:45.872 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:45.870+0000 7f8c9bbbe640 1 --2- 172.21.15.73:0/2400615663 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8c940bfdc0 0x7f8c940c3810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:45.872 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:45.870+0000 7f8c9bbbe640 1 --2- 172.21.15.73:0/2400615663 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8c94071f00 0x7f8c94151ea0 unknown :-1 s=CLOSED pgs=933 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:45.872 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:45.870+0000 7f8c9bbbe640 1 --2- 172.21.15.73:0/2400615663 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8c9406a750 0x7f8c941f2640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:45.872 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:45.870+0000 7f8c9bbbe640 1 -- 172.21.15.73:0/2400615663 >> 172.21.15.73:0/2400615663 conn(0x7f8c940a8130 msgr2=0x7f8c940712a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:46:45.872 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:45.870+0000 7f8c9bbbe640 1 -- 172.21.15.73:0/2400615663 shutdown_connections 2023-12-12T09:46:45.872 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:45.870+0000 7f8c9bbbe640 1 -- 172.21.15.73:0/2400615663 wait complete. 2023-12-12T09:46:45.891 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-12T09:46:46.098 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:46.096+0000 7f99f5de3640 1 Processor -- start 2023-12-12T09:46:46.098 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:46.096+0000 7f99f5de3640 1 -- start start 2023-12-12T09:46:46.099 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:46.098+0000 7f99f5de3640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f99f00a50f0 0x7f99f00a9050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:46.099 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:46.098+0000 7f99f5de3640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f99f006bf20 0x7f99f00a9590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:46.099 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:46.098+0000 7f99f5de3640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99f00c0b50 con 0x7f99f01552e0 2023-12-12T09:46:46.100 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:46.098+0000 7f99f5de3640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99f00c04d0 con 0x7f99f00a50f0 2023-12-12T09:46:46.100 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:46.098+0000 7f99f5de3640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99f006c880 con 0x7f99f006bf20 2023-12-12T09:46:46.100 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:46.098+0000 7f99ef7fe640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f99f01552e0 0x7f99f00c49c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:50840/0 (socket says 172.21.15.73:50840) 2023-12-12T09:46:46.100 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:46.098+0000 7f99ef7fe640 1 -- 172.21.15.73:0/1796987247 learned_addr learned my addr 172.21.15.73:0/1796987247 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-12T09:46:46.102 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:46.098+0000 7f99eeffd640 1 -- 172.21.15.73:0/1796987247 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1954839590 0 0) 0x7f99f00c0b50 con 0x7f99f01552e0 2023-12-12T09:46:46.102 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:46.098+0000 7f99effff640 1 --2- 172.21.15.73:0/1796987247 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f99f006bf20 0x7f99f00a9590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:46.102 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:46.098+0000 7f99eeffd640 1 -- 172.21.15.73:0/1796987247 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f99dc005730 con 0x7f99f01552e0 2023-12-12T09:46:46.102 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:46.099+0000 7f99e6ffd640 1 --2- 172.21.15.73:0/1796987247 >> v2:172.21.15.142:3300/0 conn(0x7f99f00a50f0 0x7f99f00a9050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:46.102 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:46.099+0000 7f99eeffd640 1 -- 172.21.15.73:0/1796987247 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 872437818 0 0) 0x7f99dc005730 con 0x7f99f01552e0 2023-12-12T09:46:46.102 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:46.099+0000 7f99eeffd640 1 -- 172.21.15.73:0/1796987247 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f99f006bf20 msgr2=0x7f99f00a9590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:46:46.102 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:46.099+0000 7f99eeffd640 1 --2- 172.21.15.73:0/1796987247 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f99f006bf20 0x7f99f00a9590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:46.102 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:46.099+0000 7f99eeffd640 1 -- 172.21.15.73:0/1796987247 >> v2:172.21.15.142:3300/0 conn(0x7f99f00a50f0 msgr2=0x7f99f00a9050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:46:46.102 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:46.099+0000 7f99eeffd640 1 --2- 172.21.15.73:0/1796987247 >> v2:172.21.15.142:3300/0 conn(0x7f99f00a50f0 0x7f99f00a9050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:46.102 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:46.099+0000 7f99eeffd640 1 -- 172.21.15.73:0/1796987247 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99f006cb60 con 0x7f99f01552e0 2023-12-12T09:46:46.102 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:46.099+0000 7f99eeffd640 1 -- 172.21.15.73:0/1796987247 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3186547832 0 0) 0x7f99e0001670 con 0x7f99f01552e0 2023-12-12T09:46:46.103 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:46.099+0000 7f99e6ffd640 1 --2- 172.21.15.73:0/1796987247 >> v2:172.21.15.142:3300/0 conn(0x7f99f00a50f0 0x7f99f00a9050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-12T09:46:46.103 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:46.099+0000 7f99eeffd640 1 -- 172.21.15.73:0/1796987247 >> v1:172.21.15.73:6789/0 conn(0x7f99f01552e0 legacy=0x7f99f00c49c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:46.103 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:46.099+0000 7f99eeffd640 1 --2- 172.21.15.73:0/1796987247 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f99dc005b80 0x7f99dc005fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:46.103 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:46.099+0000 7f99eeffd640 1 --2- 172.21.15.73:0/1796987247 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f99dc0069d0 0x7f99dc006e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:46.103 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:46.099+0000 7f99eeffd640 1 --2- 172.21.15.73:0/1796987247 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f99f006bf20 0x7f99dc007390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:46.103 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:46.099+0000 7f99eeffd640 1 -- 172.21.15.73:0/1796987247 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99f00c04d0 con 0x7f99dc005b80 2023-12-12T09:46:46.103 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:46.099+0000 7f99eeffd640 1 -- 172.21.15.73:0/1796987247 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99f006c880 con 0x7f99dc0069d0 2023-12-12T09:46:46.103 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:46.099+0000 7f99eeffd640 1 -- 172.21.15.73:0/1796987247 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99dc00dc40 con 0x7f99f006bf20 2023-12-12T09:46:46.103 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:46.099+0000 7f99ef7fe640 1 --2- 172.21.15.73:0/1796987247 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f99dc005b80 0x7f99dc005fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:46.103 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:46.100+0000 7f99e6ffd640 1 --2- 172.21.15.73:0/1796987247 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f99dc0069d0 0x7f99dc006e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:46.103 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:46.100+0000 7f99effff640 1 --2- 172.21.15.73:0/1796987247 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f99f006bf20 0x7f99dc007390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:46.103 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:46.100+0000 7f99ef7fe640 1 -- 172.21.15.73:0/1796987247 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f99f006bf20 msgr2=0x7f99dc007390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:46:46.103 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:46.100+0000 7f99ef7fe640 1 --2- 172.21.15.73:0/1796987247 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f99f006bf20 0x7f99dc007390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:46.103 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:46.100+0000 7f99ef7fe640 1 -- 172.21.15.73:0/1796987247 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f99dc0069d0 msgr2=0x7f99dc006e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:46:46.103 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:46.100+0000 7f99ef7fe640 1 --2- 172.21.15.73:0/1796987247 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f99dc0069d0 0x7f99dc006e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:46.103 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:46.100+0000 7f99ef7fe640 1 -- 172.21.15.73:0/1796987247 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99dc005730 con 0x7f99dc005b80 2023-12-12T09:46:46.104 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:46.101+0000 7f99ef7fe640 1 --2- 172.21.15.73:0/1796987247 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f99dc005b80 0x7f99dc005fa0 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 crypto rx=0x7f99e000c210 tx=0x7f99dc007a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7126f0d5a2809a86 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:46:46.105 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:46.101+0000 7f99eeffd640 1 -- 172.21.15.73:0/1796987247 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99e0005ad0 con 0x7f99dc005b80 2023-12-12T09:46:46.105 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:46.101+0000 7f99eeffd640 1 -- 172.21.15.73:0/1796987247 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99e0005c30 con 0x7f99dc005b80 2023-12-12T09:46:46.105 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:46.101+0000 7f99eeffd640 1 -- 172.21.15.73:0/1796987247 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99e002c7e0 con 0x7f99dc005b80 2023-12-12T09:46:46.105 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:46.102+0000 7f99f5de3640 1 -- 172.21.15.73:0/1796987247 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f99dc005b80 msgr2=0x7f99dc005fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:46.105 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:46.102+0000 7f99f5de3640 1 --2- 172.21.15.73:0/1796987247 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f99dc005b80 0x7f99dc005fa0 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 crypto rx=0x7f99e000c210 tx=0x7f99dc007a00 comp rx=0 tx=0).stop 2023-12-12T09:46:46.105 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:46.102+0000 7f99effff640 1 -- 172.21.15.73:0/1796987247 reap_dead start 2023-12-12T09:46:46.105 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:46.102+0000 7f99f5de3640 1 -- 172.21.15.73:0/1796987247 shutdown_connections 2023-12-12T09:46:46.105 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:46.102+0000 7f99f5de3640 1 -- 172.21.15.73:0/1796987247 >> 172.21.15.73:0/1796987247 conn(0x7f99f00a8130 msgr2=0x7f99f00c24b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:46:46.105 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:46.102+0000 7f99f5de3640 1 -- 172.21.15.73:0/1796987247 shutdown_connections 2023-12-12T09:46:46.105 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:46.102+0000 7f99f5de3640 1 -- 172.21.15.73:0/1796987247 wait complete. 2023-12-12T09:46:46.106 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:46.104+0000 7f99f5de3640 1 Processor -- start 2023-12-12T09:46:46.106 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:46.104+0000 7f99f5de3640 1 -- start start 2023-12-12T09:46:46.108 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:46.105+0000 7f99f5de3640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f99dc005b80 0x7f99f01da870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:46.108 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:46.105+0000 7f99f5de3640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f99f00aacb0 0x7f99f00a9c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:46.108 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:46.105+0000 7f99f5de3640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f99f00bf050 0x7f99f014ee60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:46.108 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:46.105+0000 7f99f5de3640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99f014eab0 con 0x7f99f00bf050 2023-12-12T09:46:46.108 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:46.105+0000 7f99f5de3640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99f00a91b0 con 0x7f99f00aacb0 2023-12-12T09:46:46.108 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:46.105+0000 7f99f5de3640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99f00a9770 con 0x7f99dc005b80 2023-12-12T09:46:46.108 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:46.105+0000 7f99effff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f99f00bf050 0x7f99f014ee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:46.108 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:46.105+0000 7f99effff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f99f00bf050 0x7f99f014ee60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:53964/0 (socket says 172.21.15.73:53964) 2023-12-12T09:46:46.108 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:46.105+0000 7f99effff640 1 -- 172.21.15.73:0/464219025 learned_addr learned my addr 172.21.15.73:0/464219025 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:46:46.108 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:46.106+0000 7f99ef7fe640 1 --2- 172.21.15.73:0/464219025 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f99dc005b80 0x7f99f01da870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:46.108 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:46.106+0000 7f99e6ffd640 1 --2- 172.21.15.73:0/464219025 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f99f00aacb0 0x7f99f00a9c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:46.108 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:46.106+0000 7f99effff640 1 -- 172.21.15.73:0/464219025 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f99dc005b80 msgr2=0x7f99f01da870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:46.108 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:46.106+0000 7f99effff640 1 --2- 172.21.15.73:0/464219025 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f99dc005b80 0x7f99f01da870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:46.109 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:46.106+0000 7f99effff640 1 -- 172.21.15.73:0/464219025 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f99f00aacb0 msgr2=0x7f99f00a9c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:46.109 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:46.106+0000 7f99effff640 1 --2- 172.21.15.73:0/464219025 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f99f00aacb0 0x7f99f00a9c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:46.109 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:46.106+0000 7f99effff640 1 -- 172.21.15.73:0/464219025 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99f00aa140 con 0x7f99f00bf050 2023-12-12T09:46:46.109 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:46.106+0000 7f99ef7fe640 1 --2- 172.21.15.73:0/464219025 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f99dc005b80 0x7f99f01da870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:46:46.109 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:46.106+0000 7f99effff640 1 --2- 172.21.15.73:0/464219025 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f99f00bf050 0x7f99f014ee60 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 crypto rx=0x7f99f006dc80 tx=0x7f99e80115a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:46:46.109 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:46.106+0000 7f99ecff9640 1 -- 172.21.15.73:0/464219025 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99e800e070 con 0x7f99f00bf050 2023-12-12T09:46:46.109 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:46.106+0000 7f99ecff9640 1 -- 172.21.15.73:0/464219025 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99e8011de0 con 0x7f99f00bf050 2023-12-12T09:46:46.109 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:46.106+0000 7f99ecff9640 1 -- 172.21.15.73:0/464219025 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99e8003990 con 0x7f99f00bf050 2023-12-12T09:46:46.109 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:46.106+0000 7f99f5de3640 1 -- 172.21.15.73:0/464219025 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99f01ea6c0 con 0x7f99f00bf050 2023-12-12T09:46:46.109 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:46.106+0000 7f99f5de3640 1 -- 172.21.15.73:0/464219025 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99f00a9400 con 0x7f99f00bf050 2023-12-12T09:46:46.109 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:46.108+0000 7f99f5de3640 1 -- 172.21.15.73:0/464219025 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99f0067580 con 0x7f99f00bf050 2023-12-12T09:46:46.110 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:46.109+0000 7f99ecff9640 1 -- 172.21.15.73:0/464219025 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f99e8003af0 con 0x7f99f00bf050 2023-12-12T09:46:46.111 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:46.109+0000 7f99ecff9640 1 --2- 172.21.15.73:0/464219025 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f99d006ae40 0x7f99d006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:46.111 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:46.110+0000 7f99ecff9640 1 -- 172.21.15.73:0/464219025 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f99e808a1c0 con 0x7f99f00bf050 2023-12-12T09:46:46.111 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:46.110+0000 7f99ef7fe640 1 --2- 172.21.15.73:0/464219025 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f99d006ae40 0x7f99d006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:46.112 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:46.110+0000 7f99ef7fe640 1 --2- 172.21.15.73:0/464219025 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f99d006ae40 0x7f99d006d300 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f99e0034000 tx=0x7f99e0007000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:46:46.115 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:46.114+0000 7f99ecff9640 1 -- 172.21.15.73:0/464219025 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f99e8054f00 con 0x7f99f00bf050 2023-12-12T09:46:46.305 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:46.304+0000 7f99f5de3640 1 -- 172.21.15.73:0/464219025 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f99f00a98b0 con 0x7f99f00bf050 2023-12-12T09:46:46.307 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:46.306+0000 7f99ecff9640 1 -- 172.21.15.73:0/464219025 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v79) v1 ==== 74+0+20226 (secure 0 0 0) 0x7f99e8058520 con 0x7f99f00bf050 2023-12-12T09:46:46.308 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-12T09:46:46.308 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":79,"fsid":"ba240992-02b8-4c7e-92f2-27eb29ac433b","created":"2023-12-12T09:43:02.454719+0000","modified":"2023-12-12T09:46:43.294476+0000","last_up_change":"2023-12-12T09:43:13.913440+0000","last_in_change":"2023-12-12T09:43:05.925348+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-12T09:43:15.525508+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2023-12-12T09:46:24.716544+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2023-12-12T09:46:25.435954+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs2_metadata","create_time":"2023-12-12T09:46:40.116878+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs2_data","create_time":"2023-12-12T09:46:40.798840+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"dd9074be-dbe2-4c34-9896-a4223d8d3940","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":4047810203},{"type":"v1","addr":"172.21.15.73:6801","nonce":4047810203}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":4047810203},{"type":"v1","addr":"172.21.15.73:6803","nonce":4047810203}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":4047810203},{"type":"v1","addr":"172.21.15.73:6807","nonce":4047810203}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":4047810203},{"type":"v1","addr":"172.21.15.73:6805","nonce":4047810203}]},"public_addr":"172.21.15.73:6801/4047810203","cluster_addr":"172.21.15.73:6803/4047810203","heartbeat_back_addr":"172.21.15.73:6807/4047810203","heartbeat_front_addr":"172.21.15.73:6805/4047810203","state":["exists","up"]},{"osd":1,"uuid":"c4a05052-96d4-4758-a4e1-1a37f1e07fed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":1356058331},{"type":"v1","addr":"172.21.15.73:6824","nonce":1356058331}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":1356058331},{"type":"v1","addr":"172.21.15.73:6827","nonce":1356058331}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":1356058331},{"type":"v1","addr":"172.21.15.73:6831","nonce":1356058331}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":1356058331},{"type":"v1","addr":"172.21.15.73:6829","nonce":1356058331}]},"public_addr":"172.21.15.73:6824/1356058331","cluster_addr":"172.21.15.73:6827/1356058331","heartbeat_back_addr":"172.21.15.73:6831/1356058331","heartbeat_front_addr":"172.21.15.73:6829/1356058331","state":["exists","up"]},{"osd":2,"uuid":"512bc8ac-72c2-40d4-b3d2-d867a92c5213","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":1228903316},{"type":"v1","addr":"172.21.15.73:6817","nonce":1228903316}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":1228903316},{"type":"v1","addr":"172.21.15.73:6819","nonce":1228903316}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6823","nonce":1228903316},{"type":"v1","addr":"172.21.15.73:6825","nonce":1228903316}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":1228903316},{"type":"v1","addr":"172.21.15.73:6821","nonce":1228903316}]},"public_addr":"172.21.15.73:6817/1228903316","cluster_addr":"172.21.15.73:6819/1228903316","heartbeat_back_addr":"172.21.15.73:6825/1228903316","heartbeat_front_addr":"172.21.15.73:6821/1228903316","state":["exists","up"]},{"osd":3,"uuid":"3d1a91e0-42bf-437a-8eae-8d357c8f63a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":1293329670},{"type":"v1","addr":"172.21.15.73:6809","nonce":1293329670}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6810","nonce":1293329670},{"type":"v1","addr":"172.21.15.73:6811","nonce":1293329670}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":1293329670},{"type":"v1","addr":"172.21.15.73:6815","nonce":1293329670}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":1293329670},{"type":"v1","addr":"172.21.15.73:6813","nonce":1293329670}]},"public_addr":"172.21.15.73:6809/1293329670","cluster_addr":"172.21.15.73:6811/1293329670","heartbeat_back_addr":"172.21.15.73:6815/1293329670","heartbeat_front_addr":"172.21.15.73:6813/1293329670","state":["exists","up"]},{"osd":4,"uuid":"4b302fff-834c-4069-ac19-00e46f6c87b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":3727975702},{"type":"v1","addr":"172.21.15.142:6801","nonce":3727975702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":3727975702},{"type":"v1","addr":"172.21.15.142:6803","nonce":3727975702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6809","nonce":3727975702},{"type":"v1","addr":"172.21.15.142:6811","nonce":3727975702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6805","nonce":3727975702},{"type":"v1","addr":"172.21.15.142:6807","nonce":3727975702}]},"public_addr":"172.21.15.142:6801/3727975702","cluster_addr":"172.21.15.142:6803/3727975702","heartbeat_back_addr":"172.21.15.142:6811/3727975702","heartbeat_front_addr":"172.21.15.142:6807/3727975702","state":["exists","up"]},{"osd":5,"uuid":"d7cdace2-67d0-45cc-95f2-515cf6ef1b82","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6817","nonce":2353193632},{"type":"v1","addr":"172.21.15.142:6819","nonce":2353193632}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6821","nonce":2353193632},{"type":"v1","addr":"172.21.15.142:6823","nonce":2353193632}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6829","nonce":2353193632},{"type":"v1","addr":"172.21.15.142:6831","nonce":2353193632}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6825","nonce":2353193632},{"type":"v1","addr":"172.21.15.142:6827","nonce":2353193632}]},"public_addr":"172.21.15.142:6819/2353193632","cluster_addr":"172.21.15.142:6823/2353193632","heartbeat_back_addr":"172.21.15.142:6831/2353193632","heartbeat_front_addr":"172.21.15.142:6827/2353193632","state":["exists","up"]},{"osd":6,"uuid":"649ce78a-5626-445c-aedc-a651ed05a6f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":2006111986},{"type":"v1","addr":"172.21.15.142:6806","nonce":2006111986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":2006111986},{"type":"v1","addr":"172.21.15.142:6810","nonce":2006111986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":2006111986},{"type":"v1","addr":"172.21.15.142:6815","nonce":2006111986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":2006111986},{"type":"v1","addr":"172.21.15.142:6813","nonce":2006111986}]},"public_addr":"172.21.15.142:6806/2006111986","cluster_addr":"172.21.15.142:6810/2006111986","heartbeat_back_addr":"172.21.15.142:6815/2006111986","heartbeat_front_addr":"172.21.15.142:6813/2006111986","state":["exists","up"]},{"osd":7,"uuid":"af15ae3b-c1d0-4acf-92db-8a1805494d13","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":2573794341},{"type":"v1","addr":"172.21.15.142:6818","nonce":2573794341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":2573794341},{"type":"v1","addr":"172.21.15.142:6822","nonce":2573794341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":2573794341},{"type":"v1","addr":"172.21.15.142:6830","nonce":2573794341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":2573794341},{"type":"v1","addr":"172.21.15.142:6826","nonce":2573794341}]},"public_addr":"172.21.15.142:6818/2573794341","cluster_addr":"172.21.15.142:6822/2573794341","heartbeat_back_addr":"172.21.15.142:6830/2573794341","heartbeat_front_addr":"172.21.15.142:6826/2573794341","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.185824+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.262103+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.225556+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:10.523459+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:10.706035+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.257339+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.301776+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.051960+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-12T09:46:46.310 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:46.308+0000 7f99f5de3640 1 -- 172.21.15.73:0/464219025 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f99d006ae40 msgr2=0x7f99d006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:46.310 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:46.308+0000 7f99f5de3640 1 --2- 172.21.15.73:0/464219025 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f99d006ae40 0x7f99d006d300 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f99e0034000 tx=0x7f99e0007000 comp rx=0 tx=0).stop 2023-12-12T09:46:46.310 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:46.308+0000 7f99f5de3640 1 -- 172.21.15.73:0/464219025 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f99f00bf050 msgr2=0x7f99f014ee60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:46.311 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:46.308+0000 7f99f5de3640 1 --2- 172.21.15.73:0/464219025 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f99f00bf050 0x7f99f014ee60 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 crypto rx=0x7f99f006dc80 tx=0x7f99e80115a0 comp rx=0 tx=0).stop 2023-12-12T09:46:46.311 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:46.308+0000 7f99f5de3640 1 -- 172.21.15.73:0/464219025 shutdown_connections 2023-12-12T09:46:46.311 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:46.308+0000 7f99f5de3640 1 --2- 172.21.15.73:0/464219025 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f99d006ae40 0x7f99d006d300 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:46.311 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:46.308+0000 7f99f5de3640 1 --2- 172.21.15.73:0/464219025 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f99f00bf050 0x7f99f014ee60 unknown :-1 s=CLOSED pgs=936 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:46.311 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:46.308+0000 7f99f5de3640 1 --2- 172.21.15.73:0/464219025 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f99f00aacb0 0x7f99f00a9c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:46.311 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:46.308+0000 7f99f5de3640 1 --2- 172.21.15.73:0/464219025 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f99dc005b80 0x7f99f01da870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:46.311 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:46.308+0000 7f99f5de3640 1 -- 172.21.15.73:0/464219025 >> 172.21.15.73:0/464219025 conn(0x7f99f00a8130 msgr2=0x7f99f006a4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:46:46.311 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:46.309+0000 7f99f5de3640 1 -- 172.21.15.73:0/464219025 shutdown_connections 2023-12-12T09:46:46.311 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:46.309+0000 7f99f5de3640 1 -- 172.21.15.73:0/464219025 wait complete. 2023-12-12T09:46:46.328 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-12-12T09:46:46.328 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-12T09:46:46.540 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:46.539+0000 7f2113997640 1 Processor -- start 2023-12-12T09:46:46.540 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:46.539+0000 7f2113997640 1 -- start start 2023-12-12T09:46:46.542 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:46.540+0000 7f2113997640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f210c14fa40 0x7f210c06a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:46.542 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:46.540+0000 7f2113997640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f210c06db70 0x7f210c0c39b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:46.542 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:46.540+0000 7f2113997640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f210c152610 con 0x7f210c0c5070 2023-12-12T09:46:46.542 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:46.540+0000 7f2113997640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f210c1528f0 con 0x7f210c14fa40 2023-12-12T09:46:46.542 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:46.540+0000 7f2113997640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f210c152bd0 con 0x7f210c06db70 2023-12-12T09:46:46.542 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:46.541+0000 7f2111733640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f210c14fa40 0x7f210c06a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:46.543 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:46.541+0000 7f2111f34640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f210c0c5070 0x7f210c0c3ef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:50842/0 (socket says 172.21.15.73:50842) 2023-12-12T09:46:46.543 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:46.541+0000 7f2111f34640 1 -- 172.21.15.73:0/1475352318 learned_addr learned my addr 172.21.15.73:0/1475352318 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-12T09:46:46.543 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:46.541+0000 7f2110f32640 1 --2- 172.21.15.73:0/1475352318 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f210c06db70 0x7f210c0c39b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:46.543 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:46.541+0000 7f2111733640 1 -- 172.21.15.73:0/1475352318 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f210c06db70 msgr2=0x7f210c0c39b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:46:46.543 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:46.541+0000 7f2111733640 1 --2- 172.21.15.73:0/1475352318 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f210c06db70 0x7f210c0c39b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:46.543 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:46.541+0000 7f2111733640 1 -- 172.21.15.73:0/1475352318 >> v1:172.21.15.73:6789/0 conn(0x7f210c0c5070 legacy=0x7f210c0c3ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:46.544 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:46.541+0000 7f2111733640 1 -- 172.21.15.73:0/1475352318 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f210c152eb0 con 0x7f210c14fa40 2023-12-12T09:46:46.544 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:46.542+0000 7f2111733640 1 --2- 172.21.15.73:0/1475352318 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f210c14fa40 0x7f210c06a4e0 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 crypto rx=0x7f21080097a0 tx=0x7f210802b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eaae777b1d95fbd server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:46:46.544 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:46.543+0000 7f20fffff640 1 -- 172.21.15.73:0/1475352318 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f210802d040 con 0x7f210c14fa40 2023-12-12T09:46:46.544 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:46.543+0000 7f20fffff640 1 -- 172.21.15.73:0/1475352318 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2108031810 con 0x7f210c14fa40 2023-12-12T09:46:46.544 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:46.543+0000 7f20fffff640 1 -- 172.21.15.73:0/1475352318 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2108031ba0 con 0x7f210c14fa40 2023-12-12T09:46:46.545 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:46.543+0000 7f2113997640 1 -- 172.21.15.73:0/1475352318 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f210c14fa40 msgr2=0x7f210c06a4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:46.545 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:46.543+0000 7f2113997640 1 --2- 172.21.15.73:0/1475352318 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f210c14fa40 0x7f210c06a4e0 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 crypto rx=0x7f21080097a0 tx=0x7f210802b8b0 comp rx=0 tx=0).stop 2023-12-12T09:46:46.545 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:46.543+0000 7f2113997640 1 -- 172.21.15.73:0/1475352318 shutdown_connections 2023-12-12T09:46:46.545 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:46.543+0000 7f2113997640 1 --2- 172.21.15.73:0/1475352318 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f210c06db70 0x7f210c0c39b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:46.545 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:46.543+0000 7f2113997640 1 --2- 172.21.15.73:0/1475352318 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f210c14fa40 0x7f210c06a4e0 unknown :-1 s=CLOSED pgs=938 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:46.546 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:46.543+0000 7f2113997640 1 -- 172.21.15.73:0/1475352318 >> 172.21.15.73:0/1475352318 conn(0x7f210c0a8130 msgr2=0x7f210c0c24b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:46:46.546 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:46.543+0000 7f2113997640 1 -- 172.21.15.73:0/1475352318 shutdown_connections 2023-12-12T09:46:46.546 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:46.543+0000 7f2113997640 1 -- 172.21.15.73:0/1475352318 wait complete. 2023-12-12T09:46:46.546 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:46.545+0000 7f2113997640 1 Processor -- start 2023-12-12T09:46:46.546 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:46.545+0000 7f2113997640 1 -- start start 2023-12-12T09:46:46.549 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:46.546+0000 7f2113997640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f210c06db70 0x7f210c14baf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:46.549 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:46.546+0000 7f2113997640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f210c0c5070 0x7f210c1eba80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:46.549 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:46.546+0000 7f2113997640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f210c14fa40 0x7f210c0bb140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:46.549 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:46.546+0000 7f2113997640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f210c0bdcb0 con 0x7f210c14fa40 2023-12-12T09:46:46.549 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:46.546+0000 7f2113997640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f210c1ebfc0 con 0x7f210c06db70 2023-12-12T09:46:46.549 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:46.546+0000 7f2113997640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f210c0bc1e0 con 0x7f210c0c5070 2023-12-12T09:46:46.549 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:46.546+0000 7f2111f34640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f210c14fa40 0x7f210c0bb140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:46.550 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:46.546+0000 7f2111f34640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f210c14fa40 0x7f210c0bb140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:53974/0 (socket says 172.21.15.73:53974) 2023-12-12T09:46:46.550 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:46.546+0000 7f2111f34640 1 -- 172.21.15.73:0/2228069909 learned_addr learned my addr 172.21.15.73:0/2228069909 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:46:46.550 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:46.547+0000 7f2111733640 1 --2- 172.21.15.73:0/2228069909 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f210c06db70 0x7f210c14baf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:46.550 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:46.547+0000 7f2110f32640 1 --2- 172.21.15.73:0/2228069909 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f210c0c5070 0x7f210c1eba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:46.550 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:46.547+0000 7f2111f34640 1 -- 172.21.15.73:0/2228069909 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f210c0c5070 msgr2=0x7f210c1eba80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:46.550 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:46.547+0000 7f2111f34640 1 --2- 172.21.15.73:0/2228069909 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f210c0c5070 0x7f210c1eba80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:46.550 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:46.547+0000 7f2111f34640 1 -- 172.21.15.73:0/2228069909 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f210c06db70 msgr2=0x7f210c14baf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:46.550 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:46.547+0000 7f2111f34640 1 --2- 172.21.15.73:0/2228069909 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f210c06db70 0x7f210c14baf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:46.550 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:46.547+0000 7f2111f34640 1 -- 172.21.15.73:0/2228069909 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2108009400 con 0x7f210c14fa40 2023-12-12T09:46:46.550 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:46.547+0000 7f2111f34640 1 --2- 172.21.15.73:0/2228069909 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f210c14fa40 0x7f210c0bb140 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 crypto rx=0x7f210400cbc0 tx=0x7f210400a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:46:46.550 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:46.547+0000 7f20fdffb640 1 -- 172.21.15.73:0/2228069909 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f210400ad40 con 0x7f210c14fa40 2023-12-12T09:46:46.550 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:46.547+0000 7f20fdffb640 1 -- 172.21.15.73:0/2228069909 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2104012400 con 0x7f210c14fa40 2023-12-12T09:46:46.551 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:46.547+0000 7f2113997640 1 -- 172.21.15.73:0/2228069909 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f210c0bd6f0 con 0x7f210c14fa40 2023-12-12T09:46:46.551 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:46.547+0000 7f20fdffb640 1 -- 172.21.15.73:0/2228069909 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f210400aea0 con 0x7f210c14fa40 2023-12-12T09:46:46.551 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:46.547+0000 7f2113997640 1 -- 172.21.15.73:0/2228069909 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f210c0bc4a0 con 0x7f210c14fa40 2023-12-12T09:46:46.551 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:46.549+0000 7f2113997640 1 -- 172.21.15.73:0/2228069909 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f210c0bc690 con 0x7f210c14fa40 2023-12-12T09:46:46.551 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:46.549+0000 7f20fdffb640 1 -- 172.21.15.73:0/2228069909 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f2104007070 con 0x7f210c14fa40 2023-12-12T09:46:46.552 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:46.550+0000 7f20fdffb640 1 --2- 172.21.15.73:0/2228069909 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f20f006ae70 0x7f20f006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:46.552 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:46.551+0000 7f20fdffb640 1 -- 172.21.15.73:0/2228069909 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f2104089880 con 0x7f210c14fa40 2023-12-12T09:46:46.552 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:46.551+0000 7f2111733640 1 --2- 172.21.15.73:0/2228069909 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f20f006ae70 0x7f20f006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:46.552 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:46.551+0000 7f2111733640 1 --2- 172.21.15.73:0/2228069909 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f20f006ae70 0x7f20f006d330 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f2108036000 tx=0x7f210803c040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:46:46.556 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:46.555+0000 7f20fdffb640 1 -- 172.21.15.73:0/2228069909 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f21040545e0 con 0x7f210c14fa40 2023-12-12T09:46:46.744 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:46.742+0000 7f2113997640 1 -- 172.21.15.73:0/2228069909 --> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f210c06c6a0 con 0x7f20f006ae70 2023-12-12T09:46:46.786 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:46.785+0000 7f20fdffb640 1 -- 172.21.15.73:0/2228069909 <== mgr.4110 v2:172.21.15.73:6832/779985841 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+525809 (secure 0 0 0) 0x7f210c06c6a0 con 0x7f20f006ae70 2023-12-12T09:46:46.793 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-12T09:46:46.797 INFO:teuthology.orchestra.run.smithi073.stderr:dumped all 2023-12-12T09:46:46.799 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:46.792+0000 7f2113997640 1 -- 172.21.15.73:0/2228069909 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f20f006ae70 msgr2=0x7f20f006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:46.799 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:46.792+0000 7f2113997640 1 --2- 172.21.15.73:0/2228069909 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f20f006ae70 0x7f20f006d330 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f2108036000 tx=0x7f210803c040 comp rx=0 tx=0).stop 2023-12-12T09:46:46.799 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:46.792+0000 7f2113997640 1 -- 172.21.15.73:0/2228069909 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f210c14fa40 msgr2=0x7f210c0bb140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:46.799 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:46.792+0000 7f2113997640 1 --2- 172.21.15.73:0/2228069909 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f210c14fa40 0x7f210c0bb140 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 crypto rx=0x7f210400cbc0 tx=0x7f210400a430 comp rx=0 tx=0).stop 2023-12-12T09:46:46.799 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:46.793+0000 7f2113997640 1 -- 172.21.15.73:0/2228069909 shutdown_connections 2023-12-12T09:46:46.799 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:46.793+0000 7f2113997640 1 --2- 172.21.15.73:0/2228069909 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f20f006ae70 0x7f20f006d330 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:46.799 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:46.793+0000 7f2113997640 1 --2- 172.21.15.73:0/2228069909 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f210c14fa40 0x7f210c0bb140 unknown :-1 s=CLOSED pgs=939 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:46.800 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:46.793+0000 7f2113997640 1 --2- 172.21.15.73:0/2228069909 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f210c0c5070 0x7f210c1eba80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:46.800 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:46.793+0000 7f2113997640 1 --2- 172.21.15.73:0/2228069909 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f210c06db70 0x7f210c14baf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:46.800 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:46.793+0000 7f2113997640 1 -- 172.21.15.73:0/2228069909 >> 172.21.15.73:0/2228069909 conn(0x7f210c0a8130 msgr2=0x7f210c0c2440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:46:46.800 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:46.793+0000 7f2113997640 1 -- 172.21.15.73:0/2228069909 shutdown_connections 2023-12-12T09:46:46.800 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:46.793+0000 7f2113997640 1 -- 172.21.15.73:0/2228069909 wait complete. 2023-12-12T09:46:46.816 INFO:teuthology.orchestra.run.smithi073.stdout:{"pg_ready":true,"pg_map":{"version":178,"stamp":"2023-12-12T09:46:45.523091+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":596683,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":251,"num_write_kb":2447,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":27,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":197,"ondisk_log_size":197,"up":386,"acting":386,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":301,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":257280,"kb_used_data":7840,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754717440,"statfs":{"total":773094113280,"available":772830658560,"internally_reserved":0,"allocated":8028160,"data_stored":4668982,"data_compressed":64844,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":12752,"internal_metadata":255315504},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":40,"apply_latency_ms":40,"commit_latency_ns":40000000,"apply_latency_ns":40000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.202197"},"pg_stats":[{"pgid":"15.3d","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-12T09:46:43.304227+0000","last_change":"2023-12-12T09:46:42.333998+0000","last_active":"2023-12-12T09:46:43.304227+0000","last_peered":"2023-12-12T09:46:43.304227+0000","last_clean":"2023-12-12T09:46:43.304227+0000","last_became_active":"2023-12-12T09:46:42.333731+0000","last_became_peered":"2023-12-12T09:46:42.333731+0000","last_unstale":"2023-12-12T09:46:43.304227+0000","last_undegraded":"2023-12-12T09:46:43.304227+0000","last_fullsized":"2023-12-12T09:46:43.304227+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:41.318400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:41.318400+0000","last_clean_scrub_stamp":"2023-12-12T09:46:41.318400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T20:26:22.728923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.3f","version":"0'0","reported_seq":15,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-12-12T09:46:42.309684+0000","last_change":"2023-12-12T09:46:26.986790+0000","last_active":"2023-12-12T09:46:42.309684+0000","last_peered":"2023-12-12T09:46:42.309684+0000","last_clean":"2023-12-12T09:46:42.309684+0000","last_became_active":"2023-12-12T09:46:26.986521+0000","last_became_peered":"2023-12-12T09:46:26.986521+0000","last_unstale":"2023-12-12T09:46:42.309684+0000","last_undegraded":"2023-12-12T09:46:42.309684+0000","last_fullsized":"2023-12-12T09:46:42.309684+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_clean_scrub_stamp":"2023-12-12T09:46:25.941843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T20:26:07.352366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.3c","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-12T09:46:43.363905+0000","last_change":"2023-12-12T09:46:42.328664+0000","last_active":"2023-12-12T09:46:43.363905+0000","last_peered":"2023-12-12T09:46:43.363905+0000","last_clean":"2023-12-12T09:46:43.363905+0000","last_became_active":"2023-12-12T09:46:42.327737+0000","last_became_peered":"2023-12-12T09:46:42.327737+0000","last_unstale":"2023-12-12T09:46:43.363905+0000","last_undegraded":"2023-12-12T09:46:43.363905+0000","last_fullsized":"2023-12-12T09:46:43.363905+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:41.318400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:41.318400+0000","last_clean_scrub_stamp":"2023-12-12T09:46:41.318400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T21:03:48.285201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.3e","version":"0'0","reported_seq":15,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-12-12T09:46:42.325093+0000","last_change":"2023-12-12T09:46:26.994586+0000","last_active":"2023-12-12T09:46:42.325093+0000","last_peered":"2023-12-12T09:46:42.325093+0000","last_clean":"2023-12-12T09:46:42.325093+0000","last_became_active":"2023-12-12T09:46:26.992156+0000","last_became_peered":"2023-12-12T09:46:26.992156+0000","last_unstale":"2023-12-12T09:46:42.325093+0000","last_undegraded":"2023-12-12T09:46:42.325093+0000","last_fullsized":"2023-12-12T09:46:42.325093+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_clean_scrub_stamp":"2023-12-12T09:46:25.941843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T12:32:03.730411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.3f","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-12T09:46:43.305940+0000","last_change":"2023-12-12T09:46:42.332796+0000","last_active":"2023-12-12T09:46:43.305940+0000","last_peered":"2023-12-12T09:46:43.305940+0000","last_clean":"2023-12-12T09:46:43.305940+0000","last_became_active":"2023-12-12T09:46:42.332507+0000","last_became_peered":"2023-12-12T09:46:42.332507+0000","last_unstale":"2023-12-12T09:46:43.305940+0000","last_undegraded":"2023-12-12T09:46:43.305940+0000","last_fullsized":"2023-12-12T09:46:43.305940+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:41.318400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:41.318400+0000","last_clean_scrub_stamp":"2023-12-12T09:46:41.318400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T15:28:19.918670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.3d","version":"0'0","reported_seq":15,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-12-12T09:46:42.315636+0000","last_change":"2023-12-12T09:46:26.991707+0000","last_active":"2023-12-12T09:46:42.315636+0000","last_peered":"2023-12-12T09:46:42.315636+0000","last_clean":"2023-12-12T09:46:42.315636+0000","last_became_active":"2023-12-12T09:46:26.991218+0000","last_became_peered":"2023-12-12T09:46:26.991218+0000","last_unstale":"2023-12-12T09:46:42.315636+0000","last_undegraded":"2023-12-12T09:46:42.315636+0000","last_fullsized":"2023-12-12T09:46:42.315636+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_clean_scrub_stamp":"2023-12-12T09:46:25.941843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T18:32:42.868149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.3e","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-12T09:46:43.360721+0000","last_change":"2023-12-12T09:46:42.335789+0000","last_active":"2023-12-12T09:46:43.360721+0000","last_peered":"2023-12-12T09:46:43.360721+0000","last_clean":"2023-12-12T09:46:43.360721+0000","last_became_active":"2023-12-12T09:46:42.334735+0000","last_became_peered":"2023-12-12T09:46:42.334735+0000","last_unstale":"2023-12-12T09:46:43.360721+0000","last_undegraded":"2023-12-12T09:46:43.360721+0000","last_fullsized":"2023-12-12T09:46:43.360721+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:41.318400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:41.318400+0000","last_clean_scrub_stamp":"2023-12-12T09:46:41.318400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T15:21:10.130436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.3c","version":"0'0","reported_seq":15,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-12-12T09:46:42.302064+0000","last_change":"2023-12-12T09:46:26.999270+0000","last_active":"2023-12-12T09:46:42.302064+0000","last_peered":"2023-12-12T09:46:42.302064+0000","last_clean":"2023-12-12T09:46:42.302064+0000","last_became_active":"2023-12-12T09:46:26.998982+0000","last_became_peered":"2023-12-12T09:46:26.998982+0000","last_unstale":"2023-12-12T09:46:42.302064+0000","last_undegraded":"2023-12-12T09:46:42.302064+0000","last_fullsized":"2023-12-12T09:46:42.302064+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_clean_scrub_stamp":"2023-12-12T09:46:25.941843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T19:41:17.087778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.39","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-12T09:46:43.355365+0000","last_change":"2023-12-12T09:46:42.333969+0000","last_active":"2023-12-12T09:46:43.355365+0000","last_peered":"2023-12-12T09:46:43.355365+0000","last_clean":"2023-12-12T09:46:43.355365+0000","last_became_active":"2023-12-12T09:46:42.333674+0000","last_became_peered":"2023-12-12T09:46:42.333674+0000","last_unstale":"2023-12-12T09:46:43.355365+0000","last_undegraded":"2023-12-12T09:46:43.355365+0000","last_fullsized":"2023-12-12T09:46:43.355365+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:41.318400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:41.318400+0000","last_clean_scrub_stamp":"2023-12-12T09:46:41.318400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T12:23:44.780206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.3b","version":"0'0","reported_seq":15,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-12-12T09:46:42.318602+0000","last_change":"2023-12-12T09:46:26.990528+0000","last_active":"2023-12-12T09:46:42.318602+0000","last_peered":"2023-12-12T09:46:42.318602+0000","last_clean":"2023-12-12T09:46:42.318602+0000","last_became_active":"2023-12-12T09:46:26.990258+0000","last_became_peered":"2023-12-12T09:46:26.990258+0000","last_unstale":"2023-12-12T09:46:42.318602+0000","last_undegraded":"2023-12-12T09:46:42.318602+0000","last_fullsized":"2023-12-12T09:46:42.318602+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_clean_scrub_stamp":"2023-12-12T09:46:25.941843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T17:36:25.591354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.38","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-12T09:46:43.357062+0000","last_change":"2023-12-12T09:46:42.328639+0000","last_active":"2023-12-12T09:46:43.357062+0000","last_peered":"2023-12-12T09:46:43.357062+0000","last_clean":"2023-12-12T09:46:43.357062+0000","last_became_active":"2023-12-12T09:46:42.327817+0000","last_became_peered":"2023-12-12T09:46:42.327817+0000","last_unstale":"2023-12-12T09:46:43.357062+0000","last_undegraded":"2023-12-12T09:46:43.357062+0000","last_fullsized":"2023-12-12T09:46:43.357062+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:41.318400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:41.318400+0000","last_clean_scrub_stamp":"2023-12-12T09:46:41.318400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T20:13:59.695918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.3a","version":"0'0","reported_seq":15,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-12-12T09:46:42.307396+0000","last_change":"2023-12-12T09:46:26.981697+0000","last_active":"2023-12-12T09:46:42.307396+0000","last_peered":"2023-12-12T09:46:42.307396+0000","last_clean":"2023-12-12T09:46:42.307396+0000","last_became_active":"2023-12-12T09:46:26.981332+0000","last_became_peered":"2023-12-12T09:46:26.981332+0000","last_unstale":"2023-12-12T09:46:42.307396+0000","last_undegraded":"2023-12-12T09:46:42.307396+0000","last_fullsized":"2023-12-12T09:46:42.307396+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_clean_scrub_stamp":"2023-12-12T09:46:25.941843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T12:20:23.121255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.3b","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-12T09:46:43.356095+0000","last_change":"2023-12-12T09:46:42.323995+0000","last_active":"2023-12-12T09:46:43.356095+0000","last_peered":"2023-12-12T09:46:43.356095+0000","last_clean":"2023-12-12T09:46:43.356095+0000","last_became_active":"2023-12-12T09:46:42.323658+0000","last_became_peered":"2023-12-12T09:46:42.323658+0000","last_unstale":"2023-12-12T09:46:43.356095+0000","last_undegraded":"2023-12-12T09:46:43.356095+0000","last_fullsized":"2023-12-12T09:46:43.356095+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:41.318400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:41.318400+0000","last_clean_scrub_stamp":"2023-12-12T09:46:41.318400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T14:19:02.287407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.39","version":"0'0","reported_seq":15,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-12-12T09:46:42.301512+0000","last_change":"2023-12-12T09:46:26.979578+0000","last_active":"2023-12-12T09:46:42.301512+0000","last_peered":"2023-12-12T09:46:42.301512+0000","last_clean":"2023-12-12T09:46:42.301512+0000","last_became_active":"2023-12-12T09:46:26.978875+0000","last_became_peered":"2023-12-12T09:46:26.978875+0000","last_unstale":"2023-12-12T09:46:42.301512+0000","last_undegraded":"2023-12-12T09:46:42.301512+0000","last_fullsized":"2023-12-12T09:46:42.301512+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_clean_scrub_stamp":"2023-12-12T09:46:25.941843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T21:36:15.290518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.3a","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-12T09:46:43.360616+0000","last_change":"2023-12-12T09:46:42.333037+0000","last_active":"2023-12-12T09:46:43.360616+0000","last_peered":"2023-12-12T09:46:43.360616+0000","last_clean":"2023-12-12T09:46:43.360616+0000","last_became_active":"2023-12-12T09:46:42.332743+0000","last_became_peered":"2023-12-12T09:46:42.332743+0000","last_unstale":"2023-12-12T09:46:43.360616+0000","last_undegraded":"2023-12-12T09:46:43.360616+0000","last_fullsized":"2023-12-12T09:46:43.360616+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:41.318400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:41.318400+0000","last_clean_scrub_stamp":"2023-12-12T09:46:41.318400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T21:03:48.285201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.38","version":"0'0","reported_seq":15,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-12-12T09:46:42.303896+0000","last_change":"2023-12-12T09:46:26.984339+0000","last_active":"2023-12-12T09:46:42.303896+0000","last_peered":"2023-12-12T09:46:42.303896+0000","last_clean":"2023-12-12T09:46:42.303896+0000","last_became_active":"2023-12-12T09:46:26.984045+0000","last_became_peered":"2023-12-12T09:46:26.984045+0000","last_unstale":"2023-12-12T09:46:42.303896+0000","last_undegraded":"2023-12-12T09:46:42.303896+0000","last_fullsized":"2023-12-12T09:46:42.303896+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_clean_scrub_stamp":"2023-12-12T09:46:25.941843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T12:26:40.737272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.35","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-12T09:46:43.360813+0000","last_change":"2023-12-12T09:46:42.338016+0000","last_active":"2023-12-12T09:46:43.360813+0000","last_peered":"2023-12-12T09:46:43.360813+0000","last_clean":"2023-12-12T09:46:43.360813+0000","last_became_active":"2023-12-12T09:46:42.335842+0000","last_became_peered":"2023-12-12T09:46:42.335842+0000","last_unstale":"2023-12-12T09:46:43.360813+0000","last_undegraded":"2023-12-12T09:46:43.360813+0000","last_fullsized":"2023-12-12T09:46:43.360813+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:41.318400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:41.318400+0000","last_clean_scrub_stamp":"2023-12-12T09:46:41.318400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T20:25:43.200693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.37","version":"0'0","reported_seq":15,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-12-12T09:46:42.310414+0000","last_change":"2023-12-12T09:46:26.974651+0000","last_active":"2023-12-12T09:46:42.310414+0000","last_peered":"2023-12-12T09:46:42.310414+0000","last_clean":"2023-12-12T09:46:42.310414+0000","last_became_active":"2023-12-12T09:46:26.968979+0000","last_became_peered":"2023-12-12T09:46:26.968979+0000","last_unstale":"2023-12-12T09:46:42.310414+0000","last_undegraded":"2023-12-12T09:46:42.310414+0000","last_fullsized":"2023-12-12T09:46:42.310414+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_clean_scrub_stamp":"2023-12-12T09:46:25.941843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T20:02:31.855316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.34","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-12T09:46:43.307933+0000","last_change":"2023-12-12T09:46:42.339487+0000","last_active":"2023-12-12T09:46:43.307933+0000","last_peered":"2023-12-12T09:46:43.307933+0000","last_clean":"2023-12-12T09:46:43.307933+0000","last_became_active":"2023-12-12T09:46:42.339175+0000","last_became_peered":"2023-12-12T09:46:42.339175+0000","last_unstale":"2023-12-12T09:46:43.307933+0000","last_undegraded":"2023-12-12T09:46:43.307933+0000","last_fullsized":"2023-12-12T09:46:43.307933+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:41.318400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:41.318400+0000","last_clean_scrub_stamp":"2023-12-12T09:46:41.318400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T20:16:33.054008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.36","version":"0'0","reported_seq":15,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-12-12T09:46:42.307045+0000","last_change":"2023-12-12T09:46:26.987761+0000","last_active":"2023-12-12T09:46:42.307045+0000","last_peered":"2023-12-12T09:46:42.307045+0000","last_clean":"2023-12-12T09:46:42.307045+0000","last_became_active":"2023-12-12T09:46:26.987451+0000","last_became_peered":"2023-12-12T09:46:26.987451+0000","last_unstale":"2023-12-12T09:46:42.307045+0000","last_undegraded":"2023-12-12T09:46:42.307045+0000","last_fullsized":"2023-12-12T09:46:42.307045+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_clean_scrub_stamp":"2023-12-12T09:46:25.941843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T20:38:58.730158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.37","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-12T09:46:43.308606+0000","last_change":"2023-12-12T09:46:42.336324+0000","last_active":"2023-12-12T09:46:43.308606+0000","last_peered":"2023-12-12T09:46:43.308606+0000","last_clean":"2023-12-12T09:46:43.308606+0000","last_became_active":"2023-12-12T09:46:42.335756+0000","last_became_peered":"2023-12-12T09:46:42.335756+0000","last_unstale":"2023-12-12T09:46:43.308606+0000","last_undegraded":"2023-12-12T09:46:43.308606+0000","last_fullsized":"2023-12-12T09:46:43.308606+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:41.318400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:41.318400+0000","last_clean_scrub_stamp":"2023-12-12T09:46:41.318400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T11:39:26.274387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.35","version":"0'0","reported_seq":15,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-12-12T09:46:42.326411+0000","last_change":"2023-12-12T09:46:26.988570+0000","last_active":"2023-12-12T09:46:42.326411+0000","last_peered":"2023-12-12T09:46:42.326411+0000","last_clean":"2023-12-12T09:46:42.326411+0000","last_became_active":"2023-12-12T09:46:26.987191+0000","last_became_peered":"2023-12-12T09:46:26.987191+0000","last_unstale":"2023-12-12T09:46:42.326411+0000","last_undegraded":"2023-12-12T09:46:42.326411+0000","last_fullsized":"2023-12-12T09:46:42.326411+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_clean_scrub_stamp":"2023-12-12T09:46:25.941843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T10:13:37.646793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.36","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-12T09:46:43.358948+0000","last_change":"2023-12-12T09:46:42.333600+0000","last_active":"2023-12-12T09:46:43.358948+0000","last_peered":"2023-12-12T09:46:43.358948+0000","last_clean":"2023-12-12T09:46:43.358948+0000","last_became_active":"2023-12-12T09:46:42.333341+0000","last_became_peered":"2023-12-12T09:46:42.333341+0000","last_unstale":"2023-12-12T09:46:43.358948+0000","last_undegraded":"2023-12-12T09:46:43.358948+0000","last_fullsized":"2023-12-12T09:46:43.358948+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:41.318400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:41.318400+0000","last_clean_scrub_stamp":"2023-12-12T09:46:41.318400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T20:13:59.695918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.34","version":"0'0","reported_seq":15,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-12-12T09:46:42.306844+0000","last_change":"2023-12-12T09:46:26.986289+0000","last_active":"2023-12-12T09:46:42.306844+0000","last_peered":"2023-12-12T09:46:42.306844+0000","last_clean":"2023-12-12T09:46:42.306844+0000","last_became_active":"2023-12-12T09:46:26.986031+0000","last_became_peered":"2023-12-12T09:46:26.986031+0000","last_unstale":"2023-12-12T09:46:42.306844+0000","last_undegraded":"2023-12-12T09:46:42.306844+0000","last_fullsized":"2023-12-12T09:46:42.306844+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_clean_scrub_stamp":"2023-12-12T09:46:25.941843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T18:11:05.080156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.31","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-12T09:46:43.359593+0000","last_change":"2023-12-12T09:46:42.339307+0000","last_active":"2023-12-12T09:46:43.359593+0000","last_peered":"2023-12-12T09:46:43.359593+0000","last_clean":"2023-12-12T09:46:43.359593+0000","last_became_active":"2023-12-12T09:46:42.338365+0000","last_became_peered":"2023-12-12T09:46:42.338365+0000","last_unstale":"2023-12-12T09:46:43.359593+0000","last_undegraded":"2023-12-12T09:46:43.359593+0000","last_fullsized":"2023-12-12T09:46:43.359593+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:41.318400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:41.318400+0000","last_clean_scrub_stamp":"2023-12-12T09:46:41.318400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T12:23:44.780206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.33","version":"0'0","reported_seq":15,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-12-12T09:46:42.312709+0000","last_change":"2023-12-12T09:46:26.985914+0000","last_active":"2023-12-12T09:46:42.312709+0000","last_peered":"2023-12-12T09:46:42.312709+0000","last_clean":"2023-12-12T09:46:42.312709+0000","last_became_active":"2023-12-12T09:46:26.985636+0000","last_became_peered":"2023-12-12T09:46:26.985636+0000","last_unstale":"2023-12-12T09:46:42.312709+0000","last_undegraded":"2023-12-12T09:46:42.312709+0000","last_fullsized":"2023-12-12T09:46:42.312709+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_clean_scrub_stamp":"2023-12-12T09:46:25.941843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T15:01:39.944049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.30","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-12T09:46:43.357410+0000","last_change":"2023-12-12T09:46:42.330278+0000","last_active":"2023-12-12T09:46:43.357410+0000","last_peered":"2023-12-12T09:46:43.357410+0000","last_clean":"2023-12-12T09:46:43.357410+0000","last_became_active":"2023-12-12T09:46:42.329590+0000","last_became_peered":"2023-12-12T09:46:42.329590+0000","last_unstale":"2023-12-12T09:46:43.357410+0000","last_undegraded":"2023-12-12T09:46:43.357410+0000","last_fullsized":"2023-12-12T09:46:43.357410+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:41.318400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:41.318400+0000","last_clean_scrub_stamp":"2023-12-12T09:46:41.318400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T11:39:26.274387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.32","version":"0'0","reported_seq":15,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-12-12T09:46:42.308058+0000","last_change":"2023-12-12T09:46:26.998495+0000","last_active":"2023-12-12T09:46:42.308058+0000","last_peered":"2023-12-12T09:46:42.308058+0000","last_clean":"2023-12-12T09:46:42.308058+0000","last_became_active":"2023-12-12T09:46:26.997702+0000","last_became_peered":"2023-12-12T09:46:26.997702+0000","last_unstale":"2023-12-12T09:46:42.308058+0000","last_undegraded":"2023-12-12T09:46:42.308058+0000","last_fullsized":"2023-12-12T09:46:42.308058+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_clean_scrub_stamp":"2023-12-12T09:46:25.941843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T21:12:40.750775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.33","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-12T09:46:43.364885+0000","last_change":"2023-12-12T09:46:42.329894+0000","last_active":"2023-12-12T09:46:43.364885+0000","last_peered":"2023-12-12T09:46:43.364885+0000","last_clean":"2023-12-12T09:46:43.364885+0000","last_became_active":"2023-12-12T09:46:42.329613+0000","last_became_peered":"2023-12-12T09:46:42.329613+0000","last_unstale":"2023-12-12T09:46:43.364885+0000","last_undegraded":"2023-12-12T09:46:43.364885+0000","last_fullsized":"2023-12-12T09:46:43.364885+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:41.318400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:41.318400+0000","last_clean_scrub_stamp":"2023-12-12T09:46:41.318400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T17:18:54.779024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.31","version":"0'0","reported_seq":15,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-12-12T09:46:42.316240+0000","last_change":"2023-12-12T09:46:26.987237+0000","last_active":"2023-12-12T09:46:42.316240+0000","last_peered":"2023-12-12T09:46:42.316240+0000","last_clean":"2023-12-12T09:46:42.316240+0000","last_became_active":"2023-12-12T09:46:26.985751+0000","last_became_peered":"2023-12-12T09:46:26.985751+0000","last_unstale":"2023-12-12T09:46:42.316240+0000","last_undegraded":"2023-12-12T09:46:42.316240+0000","last_fullsized":"2023-12-12T09:46:42.316240+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_clean_scrub_stamp":"2023-12-12T09:46:25.941843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T11:42:15.823462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.32","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-12T09:46:43.357934+0000","last_change":"2023-12-12T09:46:42.315983+0000","last_active":"2023-12-12T09:46:43.357934+0000","last_peered":"2023-12-12T09:46:43.357934+0000","last_clean":"2023-12-12T09:46:43.357934+0000","last_became_active":"2023-12-12T09:46:42.315596+0000","last_became_peered":"2023-12-12T09:46:42.315596+0000","last_unstale":"2023-12-12T09:46:43.357934+0000","last_undegraded":"2023-12-12T09:46:43.357934+0000","last_fullsized":"2023-12-12T09:46:43.357934+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:41.318400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:41.318400+0000","last_clean_scrub_stamp":"2023-12-12T09:46:41.318400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T17:36:40.967911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.30","version":"0'0","reported_seq":15,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-12-12T09:46:42.317815+0000","last_change":"2023-12-12T09:46:26.984939+0000","last_active":"2023-12-12T09:46:42.317815+0000","last_peered":"2023-12-12T09:46:42.317815+0000","last_clean":"2023-12-12T09:46:42.317815+0000","last_became_active":"2023-12-12T09:46:26.984654+0000","last_became_peered":"2023-12-12T09:46:26.984654+0000","last_unstale":"2023-12-12T09:46:42.317815+0000","last_undegraded":"2023-12-12T09:46:42.317815+0000","last_fullsized":"2023-12-12T09:46:42.317815+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_clean_scrub_stamp":"2023-12-12T09:46:25.941843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T20:27:55.483605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.2d","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-12T09:46:43.361736+0000","last_change":"2023-12-12T09:46:42.333163+0000","last_active":"2023-12-12T09:46:43.361736+0000","last_peered":"2023-12-12T09:46:43.361736+0000","last_clean":"2023-12-12T09:46:43.361736+0000","last_became_active":"2023-12-12T09:46:42.332832+0000","last_became_peered":"2023-12-12T09:46:42.332832+0000","last_unstale":"2023-12-12T09:46:43.361736+0000","last_undegraded":"2023-12-12T09:46:43.361736+0000","last_fullsized":"2023-12-12T09:46:43.361736+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:41.318400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:41.318400+0000","last_clean_scrub_stamp":"2023-12-12T09:46:41.318400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T14:34:14.641683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2f","version":"0'0","reported_seq":15,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-12-12T09:46:42.326424+0000","last_change":"2023-12-12T09:46:26.986814+0000","last_active":"2023-12-12T09:46:42.326424+0000","last_peered":"2023-12-12T09:46:42.326424+0000","last_clean":"2023-12-12T09:46:42.326424+0000","last_became_active":"2023-12-12T09:46:26.985778+0000","last_became_peered":"2023-12-12T09:46:26.985778+0000","last_unstale":"2023-12-12T09:46:42.326424+0000","last_undegraded":"2023-12-12T09:46:42.326424+0000","last_fullsized":"2023-12-12T09:46:42.326424+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_clean_scrub_stamp":"2023-12-12T09:46:25.941843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T18:32:42.868149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.2c","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-12T09:46:43.307876+0000","last_change":"2023-12-12T09:46:42.337803+0000","last_active":"2023-12-12T09:46:43.307876+0000","last_peered":"2023-12-12T09:46:43.307876+0000","last_clean":"2023-12-12T09:46:43.307876+0000","last_became_active":"2023-12-12T09:46:42.335727+0000","last_became_peered":"2023-12-12T09:46:42.335727+0000","last_unstale":"2023-12-12T09:46:43.307876+0000","last_undegraded":"2023-12-12T09:46:43.307876+0000","last_fullsized":"2023-12-12T09:46:43.307876+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:41.318400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:41.318400+0000","last_clean_scrub_stamp":"2023-12-12T09:46:41.318400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T18:51:52.951124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2e","version":"0'0","reported_seq":15,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-12-12T09:46:42.303852+0000","last_change":"2023-12-12T09:46:26.990577+0000","last_active":"2023-12-12T09:46:42.303852+0000","last_peered":"2023-12-12T09:46:42.303852+0000","last_clean":"2023-12-12T09:46:42.303852+0000","last_became_active":"2023-12-12T09:46:26.990043+0000","last_became_peered":"2023-12-12T09:46:26.990043+0000","last_unstale":"2023-12-12T09:46:42.303852+0000","last_undegraded":"2023-12-12T09:46:42.303852+0000","last_fullsized":"2023-12-12T09:46:42.303852+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_clean_scrub_stamp":"2023-12-12T09:46:25.941843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T15:36:13.603009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2f","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-12T09:46:43.360804+0000","last_change":"2023-12-12T09:46:42.328847+0000","last_active":"2023-12-12T09:46:43.360804+0000","last_peered":"2023-12-12T09:46:43.360804+0000","last_clean":"2023-12-12T09:46:43.360804+0000","last_became_active":"2023-12-12T09:46:42.328551+0000","last_became_peered":"2023-12-12T09:46:42.328551+0000","last_unstale":"2023-12-12T09:46:43.360804+0000","last_undegraded":"2023-12-12T09:46:43.360804+0000","last_fullsized":"2023-12-12T09:46:43.360804+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:41.318400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:41.318400+0000","last_clean_scrub_stamp":"2023-12-12T09:46:41.318400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T19:59:31.204008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.2d","version":"0'0","reported_seq":15,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-12-12T09:46:42.323513+0000","last_change":"2023-12-12T09:46:26.981798+0000","last_active":"2023-12-12T09:46:42.323513+0000","last_peered":"2023-12-12T09:46:42.323513+0000","last_clean":"2023-12-12T09:46:42.323513+0000","last_became_active":"2023-12-12T09:46:26.981531+0000","last_became_peered":"2023-12-12T09:46:26.981531+0000","last_unstale":"2023-12-12T09:46:42.323513+0000","last_undegraded":"2023-12-12T09:46:42.323513+0000","last_fullsized":"2023-12-12T09:46:42.323513+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_clean_scrub_stamp":"2023-12-12T09:46:25.941843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T16:03:22.088223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.2e","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-12T09:46:43.364698+0000","last_change":"2023-12-12T09:46:42.320222+0000","last_active":"2023-12-12T09:46:43.364698+0000","last_peered":"2023-12-12T09:46:43.364698+0000","last_clean":"2023-12-12T09:46:43.364698+0000","last_became_active":"2023-12-12T09:46:42.319940+0000","last_became_peered":"2023-12-12T09:46:42.319940+0000","last_unstale":"2023-12-12T09:46:43.364698+0000","last_undegraded":"2023-12-12T09:46:43.364698+0000","last_fullsized":"2023-12-12T09:46:43.364698+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:41.318400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:41.318400+0000","last_clean_scrub_stamp":"2023-12-12T09:46:41.318400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T20:25:43.200693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.2c","version":"0'0","reported_seq":15,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-12-12T09:46:42.302105+0000","last_change":"2023-12-12T09:46:26.992419+0000","last_active":"2023-12-12T09:46:42.302105+0000","last_peered":"2023-12-12T09:46:42.302105+0000","last_clean":"2023-12-12T09:46:42.302105+0000","last_became_active":"2023-12-12T09:46:26.992204+0000","last_became_peered":"2023-12-12T09:46:26.992204+0000","last_unstale":"2023-12-12T09:46:42.302105+0000","last_undegraded":"2023-12-12T09:46:42.302105+0000","last_fullsized":"2023-12-12T09:46:42.302105+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_clean_scrub_stamp":"2023-12-12T09:46:25.941843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T20:27:08.735156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.29","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-12T09:46:43.357722+0000","last_change":"2023-12-12T09:46:42.333995+0000","last_active":"2023-12-12T09:46:43.357722+0000","last_peered":"2023-12-12T09:46:43.357722+0000","last_clean":"2023-12-12T09:46:43.357722+0000","last_became_active":"2023-12-12T09:46:42.333677+0000","last_became_peered":"2023-12-12T09:46:42.333677+0000","last_unstale":"2023-12-12T09:46:43.357722+0000","last_undegraded":"2023-12-12T09:46:43.357722+0000","last_fullsized":"2023-12-12T09:46:43.357722+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:41.318400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:41.318400+0000","last_clean_scrub_stamp":"2023-12-12T09:46:41.318400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T20:22:27.576869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.2b","version":"0'0","reported_seq":15,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-12-12T09:46:42.301901+0000","last_change":"2023-12-12T09:46:26.994981+0000","last_active":"2023-12-12T09:46:42.301901+0000","last_peered":"2023-12-12T09:46:42.301901+0000","last_clean":"2023-12-12T09:46:42.301901+0000","last_became_active":"2023-12-12T09:46:26.993637+0000","last_became_peered":"2023-12-12T09:46:26.993637+0000","last_unstale":"2023-12-12T09:46:42.301901+0000","last_undegraded":"2023-12-12T09:46:42.301901+0000","last_fullsized":"2023-12-12T09:46:42.301901+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_clean_scrub_stamp":"2023-12-12T09:46:25.941843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T17:22:17.059887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.28","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-12T09:46:43.358178+0000","last_change":"2023-12-12T09:46:42.330453+0000","last_active":"2023-12-12T09:46:43.358178+0000","last_peered":"2023-12-12T09:46:43.358178+0000","last_clean":"2023-12-12T09:46:43.358178+0000","last_became_active":"2023-12-12T09:46:42.329978+0000","last_became_peered":"2023-12-12T09:46:42.329978+0000","last_unstale":"2023-12-12T09:46:43.358178+0000","last_undegraded":"2023-12-12T09:46:43.358178+0000","last_fullsized":"2023-12-12T09:46:43.358178+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:41.318400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:41.318400+0000","last_clean_scrub_stamp":"2023-12-12T09:46:41.318400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T20:54:15.640711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.2a","version":"0'0","reported_seq":15,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-12-12T09:46:42.331726+0000","last_change":"2023-12-12T09:46:27.001420+0000","last_active":"2023-12-12T09:46:42.331726+0000","last_peered":"2023-12-12T09:46:42.331726+0000","last_clean":"2023-12-12T09:46:42.331726+0000","last_became_active":"2023-12-12T09:46:27.001157+0000","last_became_peered":"2023-12-12T09:46:27.001157+0000","last_unstale":"2023-12-12T09:46:42.331726+0000","last_undegraded":"2023-12-12T09:46:42.331726+0000","last_fullsized":"2023-12-12T09:46:42.331726+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_clean_scrub_stamp":"2023-12-12T09:46:25.941843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T18:47:51.982188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.2b","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-12T09:46:43.357971+0000","last_change":"2023-12-12T09:46:42.332324+0000","last_active":"2023-12-12T09:46:43.357971+0000","last_peered":"2023-12-12T09:46:43.357971+0000","last_clean":"2023-12-12T09:46:43.357971+0000","last_became_active":"2023-12-12T09:46:42.325055+0000","last_became_peered":"2023-12-12T09:46:42.325055+0000","last_unstale":"2023-12-12T09:46:43.357971+0000","last_undegraded":"2023-12-12T09:46:43.357971+0000","last_fullsized":"2023-12-12T09:46:43.357971+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:41.318400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:41.318400+0000","last_clean_scrub_stamp":"2023-12-12T09:46:41.318400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T11:46:53.306744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.29","version":"0'0","reported_seq":15,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-12-12T09:46:42.305255+0000","last_change":"2023-12-12T09:46:26.998244+0000","last_active":"2023-12-12T09:46:42.305255+0000","last_peered":"2023-12-12T09:46:42.305255+0000","last_clean":"2023-12-12T09:46:42.305255+0000","last_became_active":"2023-12-12T09:46:26.997924+0000","last_became_peered":"2023-12-12T09:46:26.997924+0000","last_unstale":"2023-12-12T09:46:42.305255+0000","last_undegraded":"2023-12-12T09:46:42.305255+0000","last_fullsized":"2023-12-12T09:46:42.305255+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_clean_scrub_stamp":"2023-12-12T09:46:25.941843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T18:32:42.868149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.2a","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-12T09:46:43.358006+0000","last_change":"2023-12-12T09:46:42.333161+0000","last_active":"2023-12-12T09:46:43.358006+0000","last_peered":"2023-12-12T09:46:43.358006+0000","last_clean":"2023-12-12T09:46:43.358006+0000","last_became_active":"2023-12-12T09:46:42.332858+0000","last_became_peered":"2023-12-12T09:46:42.332858+0000","last_unstale":"2023-12-12T09:46:43.358006+0000","last_undegraded":"2023-12-12T09:46:43.358006+0000","last_fullsized":"2023-12-12T09:46:43.358006+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:41.318400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:41.318400+0000","last_clean_scrub_stamp":"2023-12-12T09:46:41.318400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T19:28:31.222082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.28","version":"0'0","reported_seq":15,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-12-12T09:46:42.301049+0000","last_change":"2023-12-12T09:46:26.995855+0000","last_active":"2023-12-12T09:46:42.301049+0000","last_peered":"2023-12-12T09:46:42.301049+0000","last_clean":"2023-12-12T09:46:42.301049+0000","last_became_active":"2023-12-12T09:46:26.995600+0000","last_became_peered":"2023-12-12T09:46:26.995600+0000","last_unstale":"2023-12-12T09:46:42.301049+0000","last_undegraded":"2023-12-12T09:46:42.301049+0000","last_fullsized":"2023-12-12T09:46:42.301049+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_clean_scrub_stamp":"2023-12-12T09:46:25.941843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T21:34:45.332708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.25","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-12T09:46:43.361612+0000","last_change":"2023-12-12T09:46:42.324822+0000","last_active":"2023-12-12T09:46:43.361612+0000","last_peered":"2023-12-12T09:46:43.361612+0000","last_clean":"2023-12-12T09:46:43.361612+0000","last_became_active":"2023-12-12T09:46:42.324186+0000","last_became_peered":"2023-12-12T09:46:42.324186+0000","last_unstale":"2023-12-12T09:46:43.361612+0000","last_undegraded":"2023-12-12T09:46:43.361612+0000","last_fullsized":"2023-12-12T09:46:43.361612+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:41.318400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:41.318400+0000","last_clean_scrub_stamp":"2023-12-12T09:46:41.318400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T18:26:37.695231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.27","version":"0'0","reported_seq":15,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-12-12T09:46:42.326276+0000","last_change":"2023-12-12T09:46:26.991438+0000","last_active":"2023-12-12T09:46:42.326276+0000","last_peered":"2023-12-12T09:46:42.326276+0000","last_clean":"2023-12-12T09:46:42.326276+0000","last_became_active":"2023-12-12T09:46:26.991186+0000","last_became_peered":"2023-12-12T09:46:26.991186+0000","last_unstale":"2023-12-12T09:46:42.326276+0000","last_undegraded":"2023-12-12T09:46:42.326276+0000","last_fullsized":"2023-12-12T09:46:42.326276+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_clean_scrub_stamp":"2023-12-12T09:46:25.941843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T10:00:12.368441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.24","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-12T09:46:43.358361+0000","last_change":"2023-12-12T09:46:42.322633+0000","last_active":"2023-12-12T09:46:43.358361+0000","last_peered":"2023-12-12T09:46:43.358361+0000","last_clean":"2023-12-12T09:46:43.358361+0000","last_became_active":"2023-12-12T09:46:42.321638+0000","last_became_peered":"2023-12-12T09:46:42.321638+0000","last_unstale":"2023-12-12T09:46:43.358361+0000","last_undegraded":"2023-12-12T09:46:43.358361+0000","last_fullsized":"2023-12-12T09:46:43.358361+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:41.318400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:41.318400+0000","last_clean_scrub_stamp":"2023-12-12T09:46:41.318400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T18:26:37.695231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.26","version":"0'0","reported_seq":15,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-12-12T09:46:42.314097+0000","last_change":"2023-12-12T09:46:26.993487+0000","last_active":"2023-12-12T09:46:42.314097+0000","last_peered":"2023-12-12T09:46:42.314097+0000","last_clean":"2023-12-12T09:46:42.314097+0000","last_became_active":"2023-12-12T09:46:26.991132+0000","last_became_peered":"2023-12-12T09:46:26.991132+0000","last_unstale":"2023-12-12T09:46:42.314097+0000","last_undegraded":"2023-12-12T09:46:42.314097+0000","last_fullsized":"2023-12-12T09:46:42.314097+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_clean_scrub_stamp":"2023-12-12T09:46:25.941843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T18:11:05.080156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.27","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-12T09:46:43.359993+0000","last_change":"2023-12-12T09:46:42.331284+0000","last_active":"2023-12-12T09:46:43.359993+0000","last_peered":"2023-12-12T09:46:43.359993+0000","last_clean":"2023-12-12T09:46:43.359993+0000","last_became_active":"2023-12-12T09:46:42.330881+0000","last_became_peered":"2023-12-12T09:46:42.330881+0000","last_unstale":"2023-12-12T09:46:43.359993+0000","last_undegraded":"2023-12-12T09:46:43.359993+0000","last_fullsized":"2023-12-12T09:46:43.359993+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:41.318400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:41.318400+0000","last_clean_scrub_stamp":"2023-12-12T09:46:41.318400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T19:28:31.222082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.25","version":"0'0","reported_seq":15,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-12-12T09:46:42.327720+0000","last_change":"2023-12-12T09:46:26.980520+0000","last_active":"2023-12-12T09:46:42.327720+0000","last_peered":"2023-12-12T09:46:42.327720+0000","last_clean":"2023-12-12T09:46:42.327720+0000","last_became_active":"2023-12-12T09:46:26.980218+0000","last_became_peered":"2023-12-12T09:46:26.980218+0000","last_unstale":"2023-12-12T09:46:42.327720+0000","last_undegraded":"2023-12-12T09:46:42.327720+0000","last_fullsized":"2023-12-12T09:46:42.327720+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_clean_scrub_stamp":"2023-12-12T09:46:25.941843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T18:11:05.080156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.26","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-12T09:46:43.361232+0000","last_change":"2023-12-12T09:46:42.330594+0000","last_active":"2023-12-12T09:46:43.361232+0000","last_peered":"2023-12-12T09:46:43.361232+0000","last_clean":"2023-12-12T09:46:43.361232+0000","last_became_active":"2023-12-12T09:46:42.329787+0000","last_became_peered":"2023-12-12T09:46:42.329787+0000","last_unstale":"2023-12-12T09:46:43.361232+0000","last_undegraded":"2023-12-12T09:46:43.361232+0000","last_fullsized":"2023-12-12T09:46:43.361232+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:41.318400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:41.318400+0000","last_clean_scrub_stamp":"2023-12-12T09:46:41.318400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T21:04:54.587356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.24","version":"0'0","reported_seq":15,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-12-12T09:46:42.307075+0000","last_change":"2023-12-12T09:46:26.982794+0000","last_active":"2023-12-12T09:46:42.307075+0000","last_peered":"2023-12-12T09:46:42.307075+0000","last_clean":"2023-12-12T09:46:42.307075+0000","last_became_active":"2023-12-12T09:46:26.981602+0000","last_became_peered":"2023-12-12T09:46:26.981602+0000","last_unstale":"2023-12-12T09:46:42.307075+0000","last_undegraded":"2023-12-12T09:46:42.307075+0000","last_fullsized":"2023-12-12T09:46:42.307075+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_clean_scrub_stamp":"2023-12-12T09:46:25.941843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T10:55:01.026545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.21","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-12T09:46:43.359927+0000","last_change":"2023-12-12T09:46:42.328711+0000","last_active":"2023-12-12T09:46:43.359927+0000","last_peered":"2023-12-12T09:46:43.359927+0000","last_clean":"2023-12-12T09:46:43.359927+0000","last_became_active":"2023-12-12T09:46:42.328182+0000","last_became_peered":"2023-12-12T09:46:42.328182+0000","last_unstale":"2023-12-12T09:46:43.359927+0000","last_undegraded":"2023-12-12T09:46:43.359927+0000","last_fullsized":"2023-12-12T09:46:43.359927+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:41.318400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:41.318400+0000","last_clean_scrub_stamp":"2023-12-12T09:46:41.318400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T11:39:26.274387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.23","version":"0'0","reported_seq":15,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-12-12T09:46:42.324517+0000","last_change":"2023-12-12T09:46:26.986416+0000","last_active":"2023-12-12T09:46:42.324517+0000","last_peered":"2023-12-12T09:46:42.324517+0000","last_clean":"2023-12-12T09:46:42.324517+0000","last_became_active":"2023-12-12T09:46:26.986101+0000","last_became_peered":"2023-12-12T09:46:26.986101+0000","last_unstale":"2023-12-12T09:46:42.324517+0000","last_undegraded":"2023-12-12T09:46:42.324517+0000","last_fullsized":"2023-12-12T09:46:42.324517+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_clean_scrub_stamp":"2023-12-12T09:46:25.941843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T13:32:14.660495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.20","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-12T09:46:43.303973+0000","last_change":"2023-12-12T09:46:42.338857+0000","last_active":"2023-12-12T09:46:43.303973+0000","last_peered":"2023-12-12T09:46:43.303973+0000","last_clean":"2023-12-12T09:46:43.303973+0000","last_became_active":"2023-12-12T09:46:42.338593+0000","last_became_peered":"2023-12-12T09:46:42.338593+0000","last_unstale":"2023-12-12T09:46:43.303973+0000","last_undegraded":"2023-12-12T09:46:43.303973+0000","last_fullsized":"2023-12-12T09:46:43.303973+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:41.318400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:41.318400+0000","last_clean_scrub_stamp":"2023-12-12T09:46:41.318400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T16:03:37.464780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.22","version":"0'0","reported_seq":15,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-12-12T09:46:42.331807+0000","last_change":"2023-12-12T09:46:26.991481+0000","last_active":"2023-12-12T09:46:42.331807+0000","last_peered":"2023-12-12T09:46:42.331807+0000","last_clean":"2023-12-12T09:46:42.331807+0000","last_became_active":"2023-12-12T09:46:26.990749+0000","last_became_peered":"2023-12-12T09:46:26.990749+0000","last_unstale":"2023-12-12T09:46:42.331807+0000","last_undegraded":"2023-12-12T09:46:42.331807+0000","last_fullsized":"2023-12-12T09:46:42.331807+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_clean_scrub_stamp":"2023-12-12T09:46:25.941843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T12:43:20.320606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.23","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-12T09:46:43.358416+0000","last_change":"2023-12-12T09:46:42.330092+0000","last_active":"2023-12-12T09:46:43.358416+0000","last_peered":"2023-12-12T09:46:43.358416+0000","last_clean":"2023-12-12T09:46:43.358416+0000","last_became_active":"2023-12-12T09:46:42.329781+0000","last_became_peered":"2023-12-12T09:46:42.329781+0000","last_unstale":"2023-12-12T09:46:43.358416+0000","last_undegraded":"2023-12-12T09:46:43.358416+0000","last_fullsized":"2023-12-12T09:46:43.358416+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:41.318400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:41.318400+0000","last_clean_scrub_stamp":"2023-12-12T09:46:41.318400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T13:16:51.892995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.21","version":"0'0","reported_seq":15,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-12-12T09:46:42.318572+0000","last_change":"2023-12-12T09:46:26.989100+0000","last_active":"2023-12-12T09:46:42.318572+0000","last_peered":"2023-12-12T09:46:42.318572+0000","last_clean":"2023-12-12T09:46:42.318572+0000","last_became_active":"2023-12-12T09:46:26.988781+0000","last_became_peered":"2023-12-12T09:46:26.988781+0000","last_unstale":"2023-12-12T09:46:42.318572+0000","last_undegraded":"2023-12-12T09:46:42.318572+0000","last_fullsized":"2023-12-12T09:46:42.318572+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_clean_scrub_stamp":"2023-12-12T09:46:25.941843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T20:02:31.855316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.22","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-12T09:46:43.358986+0000","last_change":"2023-12-12T09:46:42.333493+0000","last_active":"2023-12-12T09:46:43.358986+0000","last_peered":"2023-12-12T09:46:43.358986+0000","last_clean":"2023-12-12T09:46:43.358986+0000","last_became_active":"2023-12-12T09:46:42.333185+0000","last_became_peered":"2023-12-12T09:46:42.333185+0000","last_unstale":"2023-12-12T09:46:43.358986+0000","last_undegraded":"2023-12-12T09:46:43.358986+0000","last_fullsized":"2023-12-12T09:46:43.358986+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:41.318400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:41.318400+0000","last_clean_scrub_stamp":"2023-12-12T09:46:41.318400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T17:57:38.377788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.20","version":"0'0","reported_seq":15,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-12-12T09:46:42.303035+0000","last_change":"2023-12-12T09:46:27.003364+0000","last_active":"2023-12-12T09:46:42.303035+0000","last_peered":"2023-12-12T09:46:42.303035+0000","last_clean":"2023-12-12T09:46:42.303035+0000","last_became_active":"2023-12-12T09:46:27.002978+0000","last_became_peered":"2023-12-12T09:46:27.002978+0000","last_unstale":"2023-12-12T09:46:42.303035+0000","last_undegraded":"2023-12-12T09:46:42.303035+0000","last_fullsized":"2023-12-12T09:46:42.303035+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_clean_scrub_stamp":"2023-12-12T09:46:25.941843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T18:26:29.446839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.1c","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-12T09:46:43.305412+0000","last_change":"2023-12-12T09:46:42.341021+0000","last_active":"2023-12-12T09:46:43.305412+0000","last_peered":"2023-12-12T09:46:43.305412+0000","last_clean":"2023-12-12T09:46:43.305412+0000","last_became_active":"2023-12-12T09:46:42.340614+0000","last_became_peered":"2023-12-12T09:46:42.340614+0000","last_unstale":"2023-12-12T09:46:43.305412+0000","last_undegraded":"2023-12-12T09:46:43.305412+0000","last_fullsized":"2023-12-12T09:46:43.305412+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:41.318400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:41.318400+0000","last_clean_scrub_stamp":"2023-12-12T09:46:41.318400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T20:39:14.106715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1d","version":"78'2","reported_seq":14,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-12T09:46:43.360863+0000","last_change":"2023-12-12T09:46:41.365475+0000","last_active":"2023-12-12T09:46:43.360863+0000","last_peered":"2023-12-12T09:46:43.360863+0000","last_clean":"2023-12-12T09:46:43.360863+0000","last_became_active":"2023-12-12T09:46:41.362053+0000","last_became_peered":"2023-12-12T09:46:41.362053+0000","last_unstale":"2023-12-12T09:46:43.360863+0000","last_undegraded":"2023-12-12T09:46:43.360863+0000","last_fullsized":"2023-12-12T09:46:43.360863+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:40.305028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:40.305028+0000","last_clean_scrub_stamp":"2023-12-12T09:46:40.305028+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T21:34:17.272043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":15,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-12-12T09:46:42.318122+0000","last_change":"2023-12-12T09:46:26.993790+0000","last_active":"2023-12-12T09:46:42.318122+0000","last_peered":"2023-12-12T09:46:42.318122+0000","last_clean":"2023-12-12T09:46:42.318122+0000","last_became_active":"2023-12-12T09:46:26.992397+0000","last_became_peered":"2023-12-12T09:46:26.992397+0000","last_unstale":"2023-12-12T09:46:42.318122+0000","last_undegraded":"2023-12-12T09:46:42.318122+0000","last_fullsized":"2023-12-12T09:46:42.318122+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_clean_scrub_stamp":"2023-12-12T09:46:25.941843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T19:08:38.276897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1f","version":"74'4","reported_seq":20,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-12-12T09:46:42.310027+0000","last_change":"2023-12-12T09:46:25.995978+0000","last_active":"2023-12-12T09:46:42.310027+0000","last_peered":"2023-12-12T09:46:42.310027+0000","last_clean":"2023-12-12T09:46:42.310027+0000","last_became_active":"2023-12-12T09:46:25.995655+0000","last_became_peered":"2023-12-12T09:46:25.995655+0000","last_unstale":"2023-12-12T09:46:42.310027+0000","last_undegraded":"2023-12-12T09:46:42.310027+0000","last_fullsized":"2023-12-12T09:46:42.310027+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:24.925008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:24.925008+0000","last_clean_scrub_stamp":"2023-12-12T09:46:24.925008+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T17:36:24.574519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.1d","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-12T09:46:43.308226+0000","last_change":"2023-12-12T09:46:42.336097+0000","last_active":"2023-12-12T09:46:43.308226+0000","last_peered":"2023-12-12T09:46:43.308226+0000","last_clean":"2023-12-12T09:46:43.308226+0000","last_became_active":"2023-12-12T09:46:42.335764+0000","last_became_peered":"2023-12-12T09:46:42.335764+0000","last_unstale":"2023-12-12T09:46:43.308226+0000","last_undegraded":"2023-12-12T09:46:43.308226+0000","last_fullsized":"2023-12-12T09:46:43.308226+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:41.318400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:41.318400+0000","last_clean_scrub_stamp":"2023-12-12T09:46:41.318400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T12:23:44.780206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1c","version":"78'2","reported_seq":14,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-12T09:46:43.360053+0000","last_change":"2023-12-12T09:46:41.361444+0000","last_active":"2023-12-12T09:46:43.360053+0000","last_peered":"2023-12-12T09:46:43.360053+0000","last_clean":"2023-12-12T09:46:43.360053+0000","last_became_active":"2023-12-12T09:46:41.361110+0000","last_became_peered":"2023-12-12T09:46:41.361110+0000","last_unstale":"2023-12-12T09:46:43.360053+0000","last_undegraded":"2023-12-12T09:46:43.360053+0000","last_fullsized":"2023-12-12T09:46:43.360053+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:40.305028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:40.305028+0000","last_clean_scrub_stamp":"2023-12-12T09:46:40.305028+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T12:23:43.766834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":15,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-12-12T09:46:42.309807+0000","last_change":"2023-12-12T09:46:27.003828+0000","last_active":"2023-12-12T09:46:42.309807+0000","last_peered":"2023-12-12T09:46:42.309807+0000","last_clean":"2023-12-12T09:46:42.309807+0000","last_became_active":"2023-12-12T09:46:27.003445+0000","last_became_peered":"2023-12-12T09:46:27.003445+0000","last_unstale":"2023-12-12T09:46:42.309807+0000","last_undegraded":"2023-12-12T09:46:42.309807+0000","last_fullsized":"2023-12-12T09:46:42.309807+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_clean_scrub_stamp":"2023-12-12T09:46:25.941843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T11:42:15.823462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1e","version":"74'1","reported_seq":17,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-12-12T09:46:42.322994+0000","last_change":"2023-12-12T09:46:25.991554+0000","last_active":"2023-12-12T09:46:42.322994+0000","last_peered":"2023-12-12T09:46:42.322994+0000","last_clean":"2023-12-12T09:46:42.322994+0000","last_became_active":"2023-12-12T09:46:25.991083+0000","last_became_peered":"2023-12-12T09:46:25.991083+0000","last_unstale":"2023-12-12T09:46:42.322994+0000","last_undegraded":"2023-12-12T09:46:42.322994+0000","last_fullsized":"2023-12-12T09:46:42.322994+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:24.925008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:24.925008+0000","last_clean_scrub_stamp":"2023-12-12T09:46:24.925008+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T12:36:50.371782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.1e","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-12T09:46:43.362256+0000","last_change":"2023-12-12T09:46:42.321866+0000","last_active":"2023-12-12T09:46:43.362256+0000","last_peered":"2023-12-12T09:46:43.362256+0000","last_clean":"2023-12-12T09:46:43.362256+0000","last_became_active":"2023-12-12T09:46:42.321606+0000","last_became_peered":"2023-12-12T09:46:42.321606+0000","last_unstale":"2023-12-12T09:46:43.362256+0000","last_undegraded":"2023-12-12T09:46:43.362256+0000","last_fullsized":"2023-12-12T09:46:43.362256+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:41.318400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:41.318400+0000","last_clean_scrub_stamp":"2023-12-12T09:46:41.318400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T18:26:44.823395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1f","version":"78'4","reported_seq":16,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-12T09:46:43.360645+0000","last_change":"2023-12-12T09:46:41.364881+0000","last_active":"2023-12-12T09:46:43.360645+0000","last_peered":"2023-12-12T09:46:43.360645+0000","last_clean":"2023-12-12T09:46:43.360645+0000","last_became_active":"2023-12-12T09:46:41.364582+0000","last_became_peered":"2023-12-12T09:46:41.364582+0000","last_unstale":"2023-12-12T09:46:43.360645+0000","last_undegraded":"2023-12-12T09:46:43.360645+0000","last_fullsized":"2023-12-12T09:46:43.360645+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:40.305028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:40.305028+0000","last_clean_scrub_stamp":"2023-12-12T09:46:40.305028+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T18:26:36.681859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":15,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-12-12T09:46:42.307334+0000","last_change":"2023-12-12T09:46:27.003290+0000","last_active":"2023-12-12T09:46:42.307334+0000","last_peered":"2023-12-12T09:46:42.307334+0000","last_clean":"2023-12-12T09:46:42.307334+0000","last_became_active":"2023-12-12T09:46:27.002983+0000","last_became_peered":"2023-12-12T09:46:27.002983+0000","last_unstale":"2023-12-12T09:46:42.307334+0000","last_undegraded":"2023-12-12T09:46:42.307334+0000","last_fullsized":"2023-12-12T09:46:42.307334+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_clean_scrub_stamp":"2023-12-12T09:46:25.941843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T10:54:08.858049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1d","version":"74'2","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-12-12T09:46:42.323604+0000","last_change":"2023-12-12T09:46:25.986094+0000","last_active":"2023-12-12T09:46:42.323604+0000","last_peered":"2023-12-12T09:46:42.323604+0000","last_clean":"2023-12-12T09:46:42.323604+0000","last_became_active":"2023-12-12T09:46:25.985751+0000","last_became_peered":"2023-12-12T09:46:25.985751+0000","last_unstale":"2023-12-12T09:46:42.323604+0000","last_undegraded":"2023-12-12T09:46:42.323604+0000","last_fullsized":"2023-12-12T09:46:42.323604+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:24.925008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:24.925008+0000","last_clean_scrub_stamp":"2023-12-12T09:46:24.925008+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T18:26:28.430003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1f","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-12T09:46:43.365291+0000","last_change":"2023-12-12T09:46:42.329665+0000","last_active":"2023-12-12T09:46:43.365291+0000","last_peered":"2023-12-12T09:46:43.365291+0000","last_clean":"2023-12-12T09:46:43.365291+0000","last_became_active":"2023-12-12T09:46:42.328451+0000","last_became_peered":"2023-12-12T09:46:42.328451+0000","last_unstale":"2023-12-12T09:46:43.365291+0000","last_undegraded":"2023-12-12T09:46:43.365291+0000","last_fullsized":"2023-12-12T09:46:43.365291+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:41.318400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:41.318400+0000","last_clean_scrub_stamp":"2023-12-12T09:46:41.318400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T14:19:02.287407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1e","version":"78'1","reported_seq":13,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-12T09:46:43.361077+0000","last_change":"2023-12-12T09:46:41.369061+0000","last_active":"2023-12-12T09:46:43.361077+0000","last_peered":"2023-12-12T09:46:43.361077+0000","last_clean":"2023-12-12T09:46:43.361077+0000","last_became_active":"2023-12-12T09:46:41.368775+0000","last_became_peered":"2023-12-12T09:46:41.368775+0000","last_unstale":"2023-12-12T09:46:43.361077+0000","last_undegraded":"2023-12-12T09:46:43.361077+0000","last_fullsized":"2023-12-12T09:46:43.361077+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:40.305028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:40.305028+0000","last_clean_scrub_stamp":"2023-12-12T09:46:40.305028+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T12:12:50.163821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":15,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-12-12T09:46:42.316754+0000","last_change":"2023-12-12T09:46:26.991745+0000","last_active":"2023-12-12T09:46:42.316754+0000","last_peered":"2023-12-12T09:46:42.316754+0000","last_clean":"2023-12-12T09:46:42.316754+0000","last_became_active":"2023-12-12T09:46:26.991433+0000","last_became_peered":"2023-12-12T09:46:26.991433+0000","last_unstale":"2023-12-12T09:46:42.316754+0000","last_undegraded":"2023-12-12T09:46:42.316754+0000","last_fullsized":"2023-12-12T09:46:42.316754+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_clean_scrub_stamp":"2023-12-12T09:46:25.941843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T10:54:08.858049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1c","version":"74'2","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-12-12T09:46:42.317150+0000","last_change":"2023-12-12T09:46:25.990718+0000","last_active":"2023-12-12T09:46:42.317150+0000","last_peered":"2023-12-12T09:46:42.317150+0000","last_clean":"2023-12-12T09:46:42.317150+0000","last_became_active":"2023-12-12T09:46:25.990422+0000","last_became_peered":"2023-12-12T09:46:25.990422+0000","last_unstale":"2023-12-12T09:46:42.317150+0000","last_undegraded":"2023-12-12T09:46:42.317150+0000","last_fullsized":"2023-12-12T09:46:42.317150+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:24.925008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:24.925008+0000","last_clean_scrub_stamp":"2023-12-12T09:46:24.925008+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T20:27:54.466769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-12T09:46:43.359031+0000","last_change":"2023-12-12T09:46:42.337971+0000","last_active":"2023-12-12T09:46:43.359031+0000","last_peered":"2023-12-12T09:46:43.359031+0000","last_clean":"2023-12-12T09:46:43.359031+0000","last_became_active":"2023-12-12T09:46:42.337704+0000","last_became_peered":"2023-12-12T09:46:42.337704+0000","last_unstale":"2023-12-12T09:46:43.359031+0000","last_undegraded":"2023-12-12T09:46:43.359031+0000","last_fullsized":"2023-12-12T09:46:43.359031+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:41.318400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:41.318400+0000","last_clean_scrub_stamp":"2023-12-12T09:46:41.318400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T20:16:33.054008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-12T09:46:43.356505+0000","last_change":"2023-12-12T09:46:41.366746+0000","last_active":"2023-12-12T09:46:43.356505+0000","last_peered":"2023-12-12T09:46:43.356505+0000","last_clean":"2023-12-12T09:46:43.356505+0000","last_became_active":"2023-12-12T09:46:41.366388+0000","last_became_peered":"2023-12-12T09:46:41.366388+0000","last_unstale":"2023-12-12T09:46:43.356505+0000","last_undegraded":"2023-12-12T09:46:43.356505+0000","last_fullsized":"2023-12-12T09:46:43.356505+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:40.305028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:40.305028+0000","last_clean_scrub_stamp":"2023-12-12T09:46:40.305028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T11:01:52.288221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":15,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-12-12T09:46:42.331885+0000","last_change":"2023-12-12T09:46:26.991755+0000","last_active":"2023-12-12T09:46:42.331885+0000","last_peered":"2023-12-12T09:46:42.331885+0000","last_clean":"2023-12-12T09:46:42.331885+0000","last_became_active":"2023-12-12T09:46:26.991128+0000","last_became_peered":"2023-12-12T09:46:26.991128+0000","last_unstale":"2023-12-12T09:46:42.331885+0000","last_undegraded":"2023-12-12T09:46:42.331885+0000","last_fullsized":"2023-12-12T09:46:42.331885+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_clean_scrub_stamp":"2023-12-12T09:46:25.941843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T10:21:27.951163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1b","version":"74'1","reported_seq":17,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-12-12T09:46:42.319189+0000","last_change":"2023-12-12T09:46:25.996637+0000","last_active":"2023-12-12T09:46:42.319189+0000","last_peered":"2023-12-12T09:46:42.319189+0000","last_clean":"2023-12-12T09:46:42.319189+0000","last_became_active":"2023-12-12T09:46:25.994964+0000","last_became_peered":"2023-12-12T09:46:25.994964+0000","last_unstale":"2023-12-12T09:46:42.319189+0000","last_undegraded":"2023-12-12T09:46:42.319189+0000","last_fullsized":"2023-12-12T09:46:42.319189+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:24.925008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:24.925008+0000","last_clean_scrub_stamp":"2023-12-12T09:46:24.925008+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T10:00:11.351606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-12T09:46:43.305253+0000","last_change":"2023-12-12T09:46:42.333105+0000","last_active":"2023-12-12T09:46:43.305253+0000","last_peered":"2023-12-12T09:46:43.305253+0000","last_clean":"2023-12-12T09:46:43.305253+0000","last_became_active":"2023-12-12T09:46:42.332807+0000","last_became_peered":"2023-12-12T09:46:42.332807+0000","last_unstale":"2023-12-12T09:46:43.305253+0000","last_undegraded":"2023-12-12T09:46:43.305253+0000","last_fullsized":"2023-12-12T09:46:43.305253+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:41.318400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:41.318400+0000","last_clean_scrub_stamp":"2023-12-12T09:46:41.318400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T10:54:20.718934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-12T09:46:43.303762+0000","last_change":"2023-12-12T09:46:41.353916+0000","last_active":"2023-12-12T09:46:43.303762+0000","last_peered":"2023-12-12T09:46:43.303762+0000","last_clean":"2023-12-12T09:46:43.303762+0000","last_became_active":"2023-12-12T09:46:41.353658+0000","last_became_peered":"2023-12-12T09:46:41.353658+0000","last_unstale":"2023-12-12T09:46:43.303762+0000","last_undegraded":"2023-12-12T09:46:43.303762+0000","last_fullsized":"2023-12-12T09:46:43.303762+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:40.305028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:40.305028+0000","last_clean_scrub_stamp":"2023-12-12T09:46:40.305028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T14:34:13.628311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":15,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-12-12T09:46:42.318883+0000","last_change":"2023-12-12T09:46:26.992932+0000","last_active":"2023-12-12T09:46:42.318883+0000","last_peered":"2023-12-12T09:46:42.318883+0000","last_clean":"2023-12-12T09:46:42.318883+0000","last_became_active":"2023-12-12T09:46:26.992439+0000","last_became_peered":"2023-12-12T09:46:26.992439+0000","last_unstale":"2023-12-12T09:46:42.318883+0000","last_undegraded":"2023-12-12T09:46:42.318883+0000","last_fullsized":"2023-12-12T09:46:42.318883+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_clean_scrub_stamp":"2023-12-12T09:46:25.941843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T17:57:23.001231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1a","version":"74'1","reported_seq":17,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-12-12T09:46:42.318405+0000","last_change":"2023-12-12T09:46:25.997561+0000","last_active":"2023-12-12T09:46:42.318405+0000","last_peered":"2023-12-12T09:46:42.318405+0000","last_clean":"2023-12-12T09:46:42.318405+0000","last_became_active":"2023-12-12T09:46:25.997251+0000","last_became_peered":"2023-12-12T09:46:25.997251+0000","last_unstale":"2023-12-12T09:46:42.318405+0000","last_undegraded":"2023-12-12T09:46:42.318405+0000","last_fullsized":"2023-12-12T09:46:42.318405+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:24.925008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:24.925008+0000","last_clean_scrub_stamp":"2023-12-12T09:46:24.925008+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T19:17:31.250809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.1a","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-12T09:46:43.306495+0000","last_change":"2023-12-12T09:46:42.329080+0000","last_active":"2023-12-12T09:46:43.306495+0000","last_peered":"2023-12-12T09:46:43.306495+0000","last_clean":"2023-12-12T09:46:43.306495+0000","last_became_active":"2023-12-12T09:46:42.328806+0000","last_became_peered":"2023-12-12T09:46:42.328806+0000","last_unstale":"2023-12-12T09:46:43.306495+0000","last_undegraded":"2023-12-12T09:46:43.306495+0000","last_fullsized":"2023-12-12T09:46:43.306495+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:41.318400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:41.318400+0000","last_clean_scrub_stamp":"2023-12-12T09:46:41.318400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T21:06:25.811665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.1b","version":"78'1","reported_seq":13,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-12T09:46:43.304666+0000","last_change":"2023-12-12T09:46:41.365750+0000","last_active":"2023-12-12T09:46:43.304666+0000","last_peered":"2023-12-12T09:46:43.304666+0000","last_clean":"2023-12-12T09:46:43.304666+0000","last_became_active":"2023-12-12T09:46:41.365494+0000","last_became_peered":"2023-12-12T09:46:41.365494+0000","last_unstale":"2023-12-12T09:46:43.304666+0000","last_undegraded":"2023-12-12T09:46:43.304666+0000","last_fullsized":"2023-12-12T09:46:43.304666+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:40.305028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:40.305028+0000","last_clean_scrub_stamp":"2023-12-12T09:46:40.305028+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T15:01:54.307234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":15,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-12-12T09:46:42.309632+0000","last_change":"2023-12-12T09:46:26.992538+0000","last_active":"2023-12-12T09:46:42.309632+0000","last_peered":"2023-12-12T09:46:42.309632+0000","last_clean":"2023-12-12T09:46:42.309632+0000","last_became_active":"2023-12-12T09:46:26.992224+0000","last_became_peered":"2023-12-12T09:46:26.992224+0000","last_unstale":"2023-12-12T09:46:42.309632+0000","last_undegraded":"2023-12-12T09:46:42.309632+0000","last_fullsized":"2023-12-12T09:46:42.309632+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_clean_scrub_stamp":"2023-12-12T09:46:25.941843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T20:26:07.352366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":16,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-12-12T09:46:42.310716+0000","last_change":"2023-12-12T09:46:25.986629+0000","last_active":"2023-12-12T09:46:42.310716+0000","last_peered":"2023-12-12T09:46:42.310716+0000","last_clean":"2023-12-12T09:46:42.310716+0000","last_became_active":"2023-12-12T09:46:25.986351+0000","last_became_peered":"2023-12-12T09:46:25.986351+0000","last_unstale":"2023-12-12T09:46:42.310716+0000","last_undegraded":"2023-12-12T09:46:42.310716+0000","last_fullsized":"2023-12-12T09:46:42.310716+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:24.925008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:24.925008+0000","last_clean_scrub_stamp":"2023-12-12T09:46:24.925008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T11:46:36.913352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1b","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-12T09:46:43.361029+0000","last_change":"2023-12-12T09:46:42.323860+0000","last_active":"2023-12-12T09:46:43.361029+0000","last_peered":"2023-12-12T09:46:43.361029+0000","last_clean":"2023-12-12T09:46:43.361029+0000","last_became_active":"2023-12-12T09:46:42.323531+0000","last_became_peered":"2023-12-12T09:46:42.323531+0000","last_unstale":"2023-12-12T09:46:43.361029+0000","last_undegraded":"2023-12-12T09:46:43.361029+0000","last_fullsized":"2023-12-12T09:46:43.361029+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:41.318400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:41.318400+0000","last_clean_scrub_stamp":"2023-12-12T09:46:41.318400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T17:18:54.779024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.1a","version":"78'1","reported_seq":13,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-12T09:46:43.358220+0000","last_change":"2023-12-12T09:46:41.365744+0000","last_active":"2023-12-12T09:46:43.358220+0000","last_peered":"2023-12-12T09:46:43.358220+0000","last_clean":"2023-12-12T09:46:43.358220+0000","last_became_active":"2023-12-12T09:46:41.365483+0000","last_became_peered":"2023-12-12T09:46:41.365483+0000","last_unstale":"2023-12-12T09:46:43.358220+0000","last_undegraded":"2023-12-12T09:46:43.358220+0000","last_fullsized":"2023-12-12T09:46:43.358220+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:40.305028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:40.305028+0000","last_clean_scrub_stamp":"2023-12-12T09:46:40.305028+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T12:12:50.163821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":15,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-12-12T09:46:42.318695+0000","last_change":"2023-12-12T09:46:26.993474+0000","last_active":"2023-12-12T09:46:42.318695+0000","last_peered":"2023-12-12T09:46:42.318695+0000","last_clean":"2023-12-12T09:46:42.318695+0000","last_became_active":"2023-12-12T09:46:26.993192+0000","last_became_peered":"2023-12-12T09:46:26.993192+0000","last_unstale":"2023-12-12T09:46:42.318695+0000","last_undegraded":"2023-12-12T09:46:42.318695+0000","last_fullsized":"2023-12-12T09:46:42.318695+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_clean_scrub_stamp":"2023-12-12T09:46:25.941843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T20:38:58.730158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":16,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-12-12T09:46:42.321045+0000","last_change":"2023-12-12T09:46:25.998271+0000","last_active":"2023-12-12T09:46:42.321045+0000","last_peered":"2023-12-12T09:46:42.321045+0000","last_clean":"2023-12-12T09:46:42.321045+0000","last_became_active":"2023-12-12T09:46:25.997900+0000","last_became_peered":"2023-12-12T09:46:25.997900+0000","last_unstale":"2023-12-12T09:46:42.321045+0000","last_undegraded":"2023-12-12T09:46:42.321045+0000","last_fullsized":"2023-12-12T09:46:42.321045+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:24.925008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:24.925008+0000","last_clean_scrub_stamp":"2023-12-12T09:46:24.925008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T14:29:28.702921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.14","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-12T09:46:43.357451+0000","last_change":"2023-12-12T09:46:42.330297+0000","last_active":"2023-12-12T09:46:43.357451+0000","last_peered":"2023-12-12T09:46:43.357451+0000","last_clean":"2023-12-12T09:46:43.357451+0000","last_became_active":"2023-12-12T09:46:42.329318+0000","last_became_peered":"2023-12-12T09:46:42.329318+0000","last_unstale":"2023-12-12T09:46:43.357451+0000","last_undegraded":"2023-12-12T09:46:43.357451+0000","last_fullsized":"2023-12-12T09:46:43.357451+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:41.318400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:41.318400+0000","last_clean_scrub_stamp":"2023-12-12T09:46:41.318400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T21:34:18.285415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.15","version":"78'3","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-12T09:46:43.361682+0000","last_change":"2023-12-12T09:46:41.370324+0000","last_active":"2023-12-12T09:46:43.361682+0000","last_peered":"2023-12-12T09:46:43.361682+0000","last_clean":"2023-12-12T09:46:43.361682+0000","last_became_active":"2023-12-12T09:46:41.370030+0000","last_became_peered":"2023-12-12T09:46:41.370030+0000","last_unstale":"2023-12-12T09:46:43.361682+0000","last_undegraded":"2023-12-12T09:46:43.361682+0000","last_fullsized":"2023-12-12T09:46:43.361682+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:40.305028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:40.305028+0000","last_clean_scrub_stamp":"2023-12-12T09:46:40.305028+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T20:16:32.040636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":15,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-12-12T09:46:42.319737+0000","last_change":"2023-12-12T09:46:26.991874+0000","last_active":"2023-12-12T09:46:42.319737+0000","last_peered":"2023-12-12T09:46:42.319737+0000","last_clean":"2023-12-12T09:46:42.319737+0000","last_became_active":"2023-12-12T09:46:26.991425+0000","last_became_peered":"2023-12-12T09:46:26.991425+0000","last_unstale":"2023-12-12T09:46:42.319737+0000","last_undegraded":"2023-12-12T09:46:42.319737+0000","last_fullsized":"2023-12-12T09:46:42.319737+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_clean_scrub_stamp":"2023-12-12T09:46:25.941843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T14:49:18.138939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":16,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-12-12T09:46:42.310149+0000","last_change":"2023-12-12T09:46:25.994140+0000","last_active":"2023-12-12T09:46:42.310149+0000","last_peered":"2023-12-12T09:46:42.310149+0000","last_clean":"2023-12-12T09:46:42.310149+0000","last_became_active":"2023-12-12T09:46:25.993784+0000","last_became_peered":"2023-12-12T09:46:25.993784+0000","last_unstale":"2023-12-12T09:46:42.310149+0000","last_undegraded":"2023-12-12T09:46:42.310149+0000","last_fullsized":"2023-12-12T09:46:42.310149+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:24.925008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:24.925008+0000","last_clean_scrub_stamp":"2023-12-12T09:46:24.925008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T19:08:37.260062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.15","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-12T09:46:43.361179+0000","last_change":"2023-12-12T09:46:42.333798+0000","last_active":"2023-12-12T09:46:43.361179+0000","last_peered":"2023-12-12T09:46:43.361179+0000","last_clean":"2023-12-12T09:46:43.361179+0000","last_became_active":"2023-12-12T09:46:42.332488+0000","last_became_peered":"2023-12-12T09:46:42.332488+0000","last_unstale":"2023-12-12T09:46:43.361179+0000","last_undegraded":"2023-12-12T09:46:43.361179+0000","last_fullsized":"2023-12-12T09:46:43.361179+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:41.318400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:41.318400+0000","last_clean_scrub_stamp":"2023-12-12T09:46:41.318400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T14:19:02.287407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.14","version":"78'6","reported_seq":18,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-12T09:46:43.308121+0000","last_change":"2023-12-12T09:46:41.358678+0000","last_active":"2023-12-12T09:46:43.308121+0000","last_peered":"2023-12-12T09:46:43.308121+0000","last_clean":"2023-12-12T09:46:43.308121+0000","last_became_active":"2023-12-12T09:46:41.358382+0000","last_became_peered":"2023-12-12T09:46:41.358382+0000","last_unstale":"2023-12-12T09:46:43.308121+0000","last_undegraded":"2023-12-12T09:46:43.308121+0000","last_fullsized":"2023-12-12T09:46:43.308121+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:40.305028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:40.305028+0000","last_clean_scrub_stamp":"2023-12-12T09:46:40.305028+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T21:01:40.299897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":15,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-12-12T09:46:42.310523+0000","last_change":"2023-12-12T09:46:26.981920+0000","last_active":"2023-12-12T09:46:42.310523+0000","last_peered":"2023-12-12T09:46:42.310523+0000","last_clean":"2023-12-12T09:46:42.310523+0000","last_became_active":"2023-12-12T09:46:26.981149+0000","last_became_peered":"2023-12-12T09:46:26.981149+0000","last_unstale":"2023-12-12T09:46:42.310523+0000","last_undegraded":"2023-12-12T09:46:42.310523+0000","last_fullsized":"2023-12-12T09:46:42.310523+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_clean_scrub_stamp":"2023-12-12T09:46:25.941843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T17:36:25.591354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":16,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-12-12T09:46:42.307252+0000","last_change":"2023-12-12T09:46:25.994337+0000","last_active":"2023-12-12T09:46:42.307252+0000","last_peered":"2023-12-12T09:46:42.307252+0000","last_clean":"2023-12-12T09:46:42.307252+0000","last_became_active":"2023-12-12T09:46:25.993988+0000","last_became_peered":"2023-12-12T09:46:25.993988+0000","last_unstale":"2023-12-12T09:46:42.307252+0000","last_undegraded":"2023-12-12T09:46:42.307252+0000","last_fullsized":"2023-12-12T09:46:42.307252+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:24.925008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:24.925008+0000","last_clean_scrub_stamp":"2023-12-12T09:46:24.925008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T14:33:58.248291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-12T09:46:43.359984+0000","last_change":"2023-12-12T09:46:42.339053+0000","last_active":"2023-12-12T09:46:43.359984+0000","last_peered":"2023-12-12T09:46:43.359984+0000","last_clean":"2023-12-12T09:46:43.359984+0000","last_became_active":"2023-12-12T09:46:42.338740+0000","last_became_peered":"2023-12-12T09:46:42.338740+0000","last_unstale":"2023-12-12T09:46:43.359984+0000","last_undegraded":"2023-12-12T09:46:43.359984+0000","last_fullsized":"2023-12-12T09:46:43.359984+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:41.318400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:41.318400+0000","last_clean_scrub_stamp":"2023-12-12T09:46:41.318400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T14:04:06.177120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-12T09:46:43.306048+0000","last_change":"2023-12-12T09:46:41.351750+0000","last_active":"2023-12-12T09:46:43.306048+0000","last_peered":"2023-12-12T09:46:43.306048+0000","last_clean":"2023-12-12T09:46:43.306048+0000","last_became_active":"2023-12-12T09:46:41.351476+0000","last_became_peered":"2023-12-12T09:46:41.351476+0000","last_unstale":"2023-12-12T09:46:43.306048+0000","last_undegraded":"2023-12-12T09:46:43.306048+0000","last_fullsized":"2023-12-12T09:46:43.306048+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:40.305028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:40.305028+0000","last_clean_scrub_stamp":"2023-12-12T09:46:40.305028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T10:55:15.389730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":15,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-12-12T09:46:42.315000+0000","last_change":"2023-12-12T09:46:26.983752+0000","last_active":"2023-12-12T09:46:42.315000+0000","last_peered":"2023-12-12T09:46:42.315000+0000","last_clean":"2023-12-12T09:46:42.315000+0000","last_became_active":"2023-12-12T09:46:26.983381+0000","last_became_peered":"2023-12-12T09:46:26.983381+0000","last_unstale":"2023-12-12T09:46:42.315000+0000","last_undegraded":"2023-12-12T09:46:42.315000+0000","last_fullsized":"2023-12-12T09:46:42.315000+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_clean_scrub_stamp":"2023-12-12T09:46:25.941843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T15:01:39.944049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.15","version":"74'3","reported_seq":19,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-12-12T09:46:42.307564+0000","last_change":"2023-12-12T09:46:25.985458+0000","last_active":"2023-12-12T09:46:42.307564+0000","last_peered":"2023-12-12T09:46:42.307564+0000","last_clean":"2023-12-12T09:46:42.307564+0000","last_became_active":"2023-12-12T09:46:25.985147+0000","last_became_peered":"2023-12-12T09:46:25.985147+0000","last_unstale":"2023-12-12T09:46:42.307564+0000","last_undegraded":"2023-12-12T09:46:42.307564+0000","last_fullsized":"2023-12-12T09:46:42.307564+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:24.925008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:24.925008+0000","last_clean_scrub_stamp":"2023-12-12T09:46:24.925008+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T12:43:19.303770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-12T09:46:43.308693+0000","last_change":"2023-12-12T09:46:42.332276+0000","last_active":"2023-12-12T09:46:43.308693+0000","last_peered":"2023-12-12T09:46:43.308693+0000","last_clean":"2023-12-12T09:46:43.308693+0000","last_became_active":"2023-12-12T09:46:42.331931+0000","last_became_peered":"2023-12-12T09:46:42.331931+0000","last_unstale":"2023-12-12T09:46:43.308693+0000","last_undegraded":"2023-12-12T09:46:43.308693+0000","last_fullsized":"2023-12-12T09:46:43.308693+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:41.318400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:41.318400+0000","last_clean_scrub_stamp":"2023-12-12T09:46:41.318400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T20:54:15.640711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-12T09:46:43.364380+0000","last_change":"2023-12-12T09:46:41.363852+0000","last_active":"2023-12-12T09:46:43.364380+0000","last_peered":"2023-12-12T09:46:43.364380+0000","last_clean":"2023-12-12T09:46:43.364380+0000","last_became_active":"2023-12-12T09:46:41.363055+0000","last_became_peered":"2023-12-12T09:46:41.363055+0000","last_unstale":"2023-12-12T09:46:43.364380+0000","last_undegraded":"2023-12-12T09:46:43.364380+0000","last_fullsized":"2023-12-12T09:46:43.364380+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:40.305028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:40.305028+0000","last_clean_scrub_stamp":"2023-12-12T09:46:40.305028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T18:51:51.937752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":15,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-12-12T09:46:42.327900+0000","last_change":"2023-12-12T09:46:26.997513+0000","last_active":"2023-12-12T09:46:42.327900+0000","last_peered":"2023-12-12T09:46:42.327900+0000","last_clean":"2023-12-12T09:46:42.327900+0000","last_became_active":"2023-12-12T09:46:26.997102+0000","last_became_peered":"2023-12-12T09:46:26.997102+0000","last_unstale":"2023-12-12T09:46:42.327900+0000","last_undegraded":"2023-12-12T09:46:42.327900+0000","last_fullsized":"2023-12-12T09:46:42.327900+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_clean_scrub_stamp":"2023-12-12T09:46:25.941843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T10:24:08.528546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.14","version":"75'9","reported_seq":25,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-12-12T09:46:42.311021+0000","last_change":"2023-12-12T09:46:25.982724+0000","last_active":"2023-12-12T09:46:42.311021+0000","last_peered":"2023-12-12T09:46:42.311021+0000","last_clean":"2023-12-12T09:46:42.311021+0000","last_became_active":"2023-12-12T09:46:25.982370+0000","last_became_peered":"2023-12-12T09:46:25.982370+0000","last_unstale":"2023-12-12T09:46:42.311021+0000","last_undegraded":"2023-12-12T09:46:42.311021+0000","last_fullsized":"2023-12-12T09:46:42.311021+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:24.925008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:24.925008+0000","last_clean_scrub_stamp":"2023-12-12T09:46:24.925008+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T12:43:19.303770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3107,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.10","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-12T09:46:43.305107+0000","last_change":"2023-12-12T09:46:42.332984+0000","last_active":"2023-12-12T09:46:43.305107+0000","last_peered":"2023-12-12T09:46:43.305107+0000","last_clean":"2023-12-12T09:46:43.305107+0000","last_became_active":"2023-12-12T09:46:42.331626+0000","last_became_peered":"2023-12-12T09:46:42.331626+0000","last_unstale":"2023-12-12T09:46:43.305107+0000","last_undegraded":"2023-12-12T09:46:43.305107+0000","last_fullsized":"2023-12-12T09:46:43.305107+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:41.318400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:41.318400+0000","last_clean_scrub_stamp":"2023-12-12T09:46:41.318400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T11:01:53.301593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-12T09:46:43.305448+0000","last_change":"2023-12-12T09:46:41.362613+0000","last_active":"2023-12-12T09:46:43.305448+0000","last_peered":"2023-12-12T09:46:43.305448+0000","last_clean":"2023-12-12T09:46:43.305448+0000","last_became_active":"2023-12-12T09:46:41.361862+0000","last_became_peered":"2023-12-12T09:46:41.361862+0000","last_unstale":"2023-12-12T09:46:43.305448+0000","last_undegraded":"2023-12-12T09:46:43.305448+0000","last_fullsized":"2023-12-12T09:46:43.305448+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:40.305028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:40.305028+0000","last_clean_scrub_stamp":"2023-12-12T09:46:40.305028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T13:43:05.254729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":15,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-12-12T09:46:42.309891+0000","last_change":"2023-12-12T09:46:26.979828+0000","last_active":"2023-12-12T09:46:42.309891+0000","last_peered":"2023-12-12T09:46:42.309891+0000","last_clean":"2023-12-12T09:46:42.309891+0000","last_became_active":"2023-12-12T09:46:26.979516+0000","last_became_peered":"2023-12-12T09:46:26.979516+0000","last_unstale":"2023-12-12T09:46:42.309891+0000","last_undegraded":"2023-12-12T09:46:42.309891+0000","last_fullsized":"2023-12-12T09:46:42.309891+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_clean_scrub_stamp":"2023-12-12T09:46:25.941843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T10:54:08.858049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.13","version":"74'2","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-12-12T09:46:42.324649+0000","last_change":"2023-12-12T09:46:25.987283+0000","last_active":"2023-12-12T09:46:42.324649+0000","last_peered":"2023-12-12T09:46:42.324649+0000","last_clean":"2023-12-12T09:46:42.324649+0000","last_became_active":"2023-12-12T09:46:25.986974+0000","last_became_peered":"2023-12-12T09:46:25.986974+0000","last_unstale":"2023-12-12T09:46:42.324649+0000","last_undegraded":"2023-12-12T09:46:42.324649+0000","last_fullsized":"2023-12-12T09:46:42.324649+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:24.925008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:24.925008+0000","last_clean_scrub_stamp":"2023-12-12T09:46:24.925008+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T17:33:21.476618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-12T09:46:43.355953+0000","last_change":"2023-12-12T09:46:42.327080+0000","last_active":"2023-12-12T09:46:43.355953+0000","last_peered":"2023-12-12T09:46:43.355953+0000","last_clean":"2023-12-12T09:46:43.355953+0000","last_became_active":"2023-12-12T09:46:42.326759+0000","last_became_peered":"2023-12-12T09:46:42.326759+0000","last_unstale":"2023-12-12T09:46:43.355953+0000","last_undegraded":"2023-12-12T09:46:43.355953+0000","last_fullsized":"2023-12-12T09:46:43.355953+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:41.318400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:41.318400+0000","last_clean_scrub_stamp":"2023-12-12T09:46:41.318400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T12:26:56.113829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.10","version":"78'8","reported_seq":20,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-12T09:46:43.303882+0000","last_change":"2023-12-12T09:46:41.360488+0000","last_active":"2023-12-12T09:46:43.303882+0000","last_peered":"2023-12-12T09:46:43.303882+0000","last_clean":"2023-12-12T09:46:43.303882+0000","last_became_active":"2023-12-12T09:46:41.360210+0000","last_became_peered":"2023-12-12T09:46:41.360210+0000","last_unstale":"2023-12-12T09:46:43.303882+0000","last_undegraded":"2023-12-12T09:46:43.303882+0000","last_fullsized":"2023-12-12T09:46:43.303882+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:40.305028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:40.305028+0000","last_clean_scrub_stamp":"2023-12-12T09:46:40.305028+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T18:11:19.443341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":15,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-12-12T09:46:42.312962+0000","last_change":"2023-12-12T09:46:26.991122+0000","last_active":"2023-12-12T09:46:42.312962+0000","last_peered":"2023-12-12T09:46:42.312962+0000","last_clean":"2023-12-12T09:46:42.312962+0000","last_became_active":"2023-12-12T09:46:26.990778+0000","last_became_peered":"2023-12-12T09:46:26.990778+0000","last_unstale":"2023-12-12T09:46:42.312962+0000","last_undegraded":"2023-12-12T09:46:42.312962+0000","last_fullsized":"2023-12-12T09:46:42.312962+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_clean_scrub_stamp":"2023-12-12T09:46:25.941843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T11:42:15.823462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":16,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-12-12T09:46:42.317566+0000","last_change":"2023-12-12T09:46:25.982578+0000","last_active":"2023-12-12T09:46:42.317566+0000","last_peered":"2023-12-12T09:46:42.317566+0000","last_clean":"2023-12-12T09:46:42.317566+0000","last_became_active":"2023-12-12T09:46:25.982307+0000","last_became_peered":"2023-12-12T09:46:25.982307+0000","last_unstale":"2023-12-12T09:46:42.317566+0000","last_undegraded":"2023-12-12T09:46:42.317566+0000","last_fullsized":"2023-12-12T09:46:42.317566+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:24.925008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:24.925008+0000","last_clean_scrub_stamp":"2023-12-12T09:46:24.925008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T10:54:07.841214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-12T09:46:43.359985+0000","last_change":"2023-12-12T09:46:42.326432+0000","last_active":"2023-12-12T09:46:43.359985+0000","last_peered":"2023-12-12T09:46:43.359985+0000","last_clean":"2023-12-12T09:46:43.359985+0000","last_became_active":"2023-12-12T09:46:42.326112+0000","last_became_peered":"2023-12-12T09:46:42.326112+0000","last_unstale":"2023-12-12T09:46:43.359985+0000","last_undegraded":"2023-12-12T09:46:43.359985+0000","last_fullsized":"2023-12-12T09:46:43.359985+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:41.318400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:41.318400+0000","last_clean_scrub_stamp":"2023-12-12T09:46:41.318400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T20:54:15.640711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.13","version":"78'2","reported_seq":14,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-12T09:46:43.357895+0000","last_change":"2023-12-12T09:46:41.358830+0000","last_active":"2023-12-12T09:46:43.357895+0000","last_peered":"2023-12-12T09:46:43.357895+0000","last_clean":"2023-12-12T09:46:43.357895+0000","last_became_active":"2023-12-12T09:46:41.357323+0000","last_became_peered":"2023-12-12T09:46:41.357323+0000","last_unstale":"2023-12-12T09:46:43.357895+0000","last_undegraded":"2023-12-12T09:46:43.357895+0000","last_fullsized":"2023-12-12T09:46:43.357895+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:40.305028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:40.305028+0000","last_clean_scrub_stamp":"2023-12-12T09:46:40.305028+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T10:13:52.009978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":15,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-12-12T09:46:42.319383+0000","last_change":"2023-12-12T09:46:26.990991+0000","last_active":"2023-12-12T09:46:42.319383+0000","last_peered":"2023-12-12T09:46:42.319383+0000","last_clean":"2023-12-12T09:46:42.319383+0000","last_became_active":"2023-12-12T09:46:26.990702+0000","last_became_peered":"2023-12-12T09:46:26.990702+0000","last_unstale":"2023-12-12T09:46:42.319383+0000","last_undegraded":"2023-12-12T09:46:42.319383+0000","last_fullsized":"2023-12-12T09:46:42.319383+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_clean_scrub_stamp":"2023-12-12T09:46:25.941843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T14:22:02.583778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":16,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-12-12T09:46:42.304912+0000","last_change":"2023-12-12T09:46:26.002159+0000","last_active":"2023-12-12T09:46:42.304912+0000","last_peered":"2023-12-12T09:46:42.304912+0000","last_clean":"2023-12-12T09:46:42.304912+0000","last_became_active":"2023-12-12T09:46:26.001847+0000","last_became_peered":"2023-12-12T09:46:26.001847+0000","last_unstale":"2023-12-12T09:46:42.304912+0000","last_undegraded":"2023-12-12T09:46:42.304912+0000","last_fullsized":"2023-12-12T09:46:42.304912+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:24.925008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:24.925008+0000","last_clean_scrub_stamp":"2023-12-12T09:46:24.925008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T10:21:26.934327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.13","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-12T09:46:43.304827+0000","last_change":"2023-12-12T09:46:42.336342+0000","last_active":"2023-12-12T09:46:43.304827+0000","last_peered":"2023-12-12T09:46:43.304827+0000","last_clean":"2023-12-12T09:46:43.304827+0000","last_became_active":"2023-12-12T09:46:42.336050+0000","last_became_peered":"2023-12-12T09:46:42.336050+0000","last_unstale":"2023-12-12T09:46:43.304827+0000","last_undegraded":"2023-12-12T09:46:43.304827+0000","last_fullsized":"2023-12-12T09:46:43.304827+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:41.318400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:41.318400+0000","last_clean_scrub_stamp":"2023-12-12T09:46:41.318400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T11:42:31.200019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-12T09:46:43.358677+0000","last_change":"2023-12-12T09:46:41.358371+0000","last_active":"2023-12-12T09:46:43.358677+0000","last_peered":"2023-12-12T09:46:43.358677+0000","last_clean":"2023-12-12T09:46:43.358677+0000","last_became_active":"2023-12-12T09:46:41.358084+0000","last_became_peered":"2023-12-12T09:46:41.358084+0000","last_unstale":"2023-12-12T09:46:43.358677+0000","last_undegraded":"2023-12-12T09:46:43.358677+0000","last_fullsized":"2023-12-12T09:46:43.358677+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:40.305028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:40.305028+0000","last_clean_scrub_stamp":"2023-12-12T09:46:40.305028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T11:26:26.382701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":15,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-12-12T09:46:42.323986+0000","last_change":"2023-12-12T09:46:26.988682+0000","last_active":"2023-12-12T09:46:42.323986+0000","last_peered":"2023-12-12T09:46:42.323986+0000","last_clean":"2023-12-12T09:46:42.323986+0000","last_became_active":"2023-12-12T09:46:26.988391+0000","last_became_peered":"2023-12-12T09:46:26.988391+0000","last_unstale":"2023-12-12T09:46:42.323986+0000","last_undegraded":"2023-12-12T09:46:42.323986+0000","last_fullsized":"2023-12-12T09:46:42.323986+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_clean_scrub_stamp":"2023-12-12T09:46:25.941843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T10:34:32.907255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.10","version":"74'8","reported_seq":24,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-12-12T09:46:42.311617+0000","last_change":"2023-12-12T09:46:25.990213+0000","last_active":"2023-12-12T09:46:42.311617+0000","last_peered":"2023-12-12T09:46:42.311617+0000","last_clean":"2023-12-12T09:46:42.311617+0000","last_became_active":"2023-12-12T09:46:25.989960+0000","last_became_peered":"2023-12-12T09:46:25.989960+0000","last_unstale":"2023-12-12T09:46:42.311617+0000","last_undegraded":"2023-12-12T09:46:42.311617+0000","last_fullsized":"2023-12-12T09:46:42.311617+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:24.925008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:24.925008+0000","last_clean_scrub_stamp":"2023-12-12T09:46:24.925008+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T12:26:39.720437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-12T09:46:43.307180+0000","last_change":"2023-12-12T09:46:42.314405+0000","last_active":"2023-12-12T09:46:43.307180+0000","last_peered":"2023-12-12T09:46:43.307180+0000","last_clean":"2023-12-12T09:46:43.307180+0000","last_became_active":"2023-12-12T09:46:42.314121+0000","last_became_peered":"2023-12-12T09:46:42.314121+0000","last_unstale":"2023-12-12T09:46:43.307180+0000","last_undegraded":"2023-12-12T09:46:43.307180+0000","last_fullsized":"2023-12-12T09:46:43.307180+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:41.318400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:41.318400+0000","last_clean_scrub_stamp":"2023-12-12T09:46:41.318400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T11:50:59.555821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.d","version":"78'1","reported_seq":13,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-12T09:46:43.358933+0000","last_change":"2023-12-12T09:46:41.363501+0000","last_active":"2023-12-12T09:46:43.358933+0000","last_peered":"2023-12-12T09:46:43.358933+0000","last_clean":"2023-12-12T09:46:43.358933+0000","last_became_active":"2023-12-12T09:46:41.363280+0000","last_became_peered":"2023-12-12T09:46:41.363280+0000","last_unstale":"2023-12-12T09:46:43.358933+0000","last_undegraded":"2023-12-12T09:46:43.358933+0000","last_fullsized":"2023-12-12T09:46:43.358933+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:40.305028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:40.305028+0000","last_clean_scrub_stamp":"2023-12-12T09:46:40.305028+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T20:54:14.627339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":15,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-12-12T09:46:42.314644+0000","last_change":"2023-12-12T09:46:26.983398+0000","last_active":"2023-12-12T09:46:42.314644+0000","last_peered":"2023-12-12T09:46:42.314644+0000","last_clean":"2023-12-12T09:46:42.314644+0000","last_became_active":"2023-12-12T09:46:26.983101+0000","last_became_peered":"2023-12-12T09:46:26.983101+0000","last_unstale":"2023-12-12T09:46:42.314644+0000","last_undegraded":"2023-12-12T09:46:42.314644+0000","last_fullsized":"2023-12-12T09:46:42.314644+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_clean_scrub_stamp":"2023-12-12T09:46:25.941843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T10:55:01.026545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.f","version":"74'1","reported_seq":17,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-12-12T09:46:42.310333+0000","last_change":"2023-12-12T09:46:25.988523+0000","last_active":"2023-12-12T09:46:42.310333+0000","last_peered":"2023-12-12T09:46:42.310333+0000","last_clean":"2023-12-12T09:46:42.310333+0000","last_became_active":"2023-12-12T09:46:25.988129+0000","last_became_peered":"2023-12-12T09:46:25.988129+0000","last_unstale":"2023-12-12T09:46:42.310333+0000","last_undegraded":"2023-12-12T09:46:42.310333+0000","last_fullsized":"2023-12-12T09:46:42.310333+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:24.925008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:24.925008+0000","last_clean_scrub_stamp":"2023-12-12T09:46:24.925008+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T17:57:21.984396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.d","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-12T09:46:43.361174+0000","last_change":"2023-12-12T09:46:42.338571+0000","last_active":"2023-12-12T09:46:43.361174+0000","last_peered":"2023-12-12T09:46:43.361174+0000","last_clean":"2023-12-12T09:46:43.361174+0000","last_became_active":"2023-12-12T09:46:42.338297+0000","last_became_peered":"2023-12-12T09:46:42.338297+0000","last_unstale":"2023-12-12T09:46:43.361174+0000","last_undegraded":"2023-12-12T09:46:43.361174+0000","last_fullsized":"2023-12-12T09:46:43.361174+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:41.318400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:41.318400+0000","last_clean_scrub_stamp":"2023-12-12T09:46:41.318400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T21:34:18.285415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-12T09:46:43.360197+0000","last_change":"2023-12-12T09:46:41.355747+0000","last_active":"2023-12-12T09:46:43.360197+0000","last_peered":"2023-12-12T09:46:43.360197+0000","last_clean":"2023-12-12T09:46:43.360197+0000","last_became_active":"2023-12-12T09:46:41.355232+0000","last_became_peered":"2023-12-12T09:46:41.355232+0000","last_unstale":"2023-12-12T09:46:43.360197+0000","last_undegraded":"2023-12-12T09:46:43.360197+0000","last_fullsized":"2023-12-12T09:46:43.360197+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:40.305028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:40.305028+0000","last_clean_scrub_stamp":"2023-12-12T09:46:40.305028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T11:39:25.261015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":15,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-12-12T09:46:42.309910+0000","last_change":"2023-12-12T09:46:26.985248+0000","last_active":"2023-12-12T09:46:42.309910+0000","last_peered":"2023-12-12T09:46:42.309910+0000","last_clean":"2023-12-12T09:46:42.309910+0000","last_became_active":"2023-12-12T09:46:26.984986+0000","last_became_peered":"2023-12-12T09:46:26.984986+0000","last_unstale":"2023-12-12T09:46:42.309910+0000","last_undegraded":"2023-12-12T09:46:42.309910+0000","last_fullsized":"2023-12-12T09:46:42.309910+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_clean_scrub_stamp":"2023-12-12T09:46:25.941843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T14:49:18.138939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.e","version":"74'2","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-12-12T09:46:42.325711+0000","last_change":"2023-12-12T09:46:25.991479+0000","last_active":"2023-12-12T09:46:42.325711+0000","last_peered":"2023-12-12T09:46:42.325711+0000","last_clean":"2023-12-12T09:46:42.325711+0000","last_became_active":"2023-12-12T09:46:25.991205+0000","last_became_peered":"2023-12-12T09:46:25.991205+0000","last_unstale":"2023-12-12T09:46:42.325711+0000","last_undegraded":"2023-12-12T09:46:42.325711+0000","last_fullsized":"2023-12-12T09:46:42.325711+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:24.925008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:24.925008+0000","last_clean_scrub_stamp":"2023-12-12T09:46:24.925008+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T18:32:41.851313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.f","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-12T09:46:43.359514+0000","last_change":"2023-12-12T09:46:42.336350+0000","last_active":"2023-12-12T09:46:43.359514+0000","last_peered":"2023-12-12T09:46:43.359514+0000","last_clean":"2023-12-12T09:46:43.359514+0000","last_became_active":"2023-12-12T09:46:42.336062+0000","last_became_peered":"2023-12-12T09:46:42.336062+0000","last_unstale":"2023-12-12T09:46:43.359514+0000","last_undegraded":"2023-12-12T09:46:43.359514+0000","last_fullsized":"2023-12-12T09:46:43.359514+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:41.318400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:41.318400+0000","last_clean_scrub_stamp":"2023-12-12T09:46:41.318400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T20:22:27.576869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.e","version":"78'2","reported_seq":14,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-12T09:46:43.307781+0000","last_change":"2023-12-12T09:46:41.358666+0000","last_active":"2023-12-12T09:46:43.307781+0000","last_peered":"2023-12-12T09:46:43.307781+0000","last_clean":"2023-12-12T09:46:43.307781+0000","last_became_active":"2023-12-12T09:46:41.358359+0000","last_became_peered":"2023-12-12T09:46:41.358359+0000","last_unstale":"2023-12-12T09:46:43.307781+0000","last_undegraded":"2023-12-12T09:46:43.307781+0000","last_fullsized":"2023-12-12T09:46:43.307781+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:40.305028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:40.305028+0000","last_clean_scrub_stamp":"2023-12-12T09:46:40.305028+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T12:03:19.177036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":15,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-12-12T09:46:42.327992+0000","last_change":"2023-12-12T09:46:26.987944+0000","last_active":"2023-12-12T09:46:42.327992+0000","last_peered":"2023-12-12T09:46:42.327992+0000","last_clean":"2023-12-12T09:46:42.327992+0000","last_became_active":"2023-12-12T09:46:26.987624+0000","last_became_peered":"2023-12-12T09:46:26.987624+0000","last_unstale":"2023-12-12T09:46:42.327992+0000","last_undegraded":"2023-12-12T09:46:42.327992+0000","last_fullsized":"2023-12-12T09:46:42.327992+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_clean_scrub_stamp":"2023-12-12T09:46:25.941843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T18:26:29.446839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":16,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-12-12T09:46:42.317269+0000","last_change":"2023-12-12T09:46:25.987255+0000","last_active":"2023-12-12T09:46:42.317269+0000","last_peered":"2023-12-12T09:46:42.317269+0000","last_clean":"2023-12-12T09:46:42.317269+0000","last_became_active":"2023-12-12T09:46:25.986994+0000","last_became_peered":"2023-12-12T09:46:25.986994+0000","last_unstale":"2023-12-12T09:46:42.317269+0000","last_undegraded":"2023-12-12T09:46:42.317269+0000","last_fullsized":"2023-12-12T09:46:42.317269+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:24.925008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:24.925008+0000","last_clean_scrub_stamp":"2023-12-12T09:46:24.925008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T17:57:21.984396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-12T09:46:43.355867+0000","last_change":"2023-12-12T09:46:42.320811+0000","last_active":"2023-12-12T09:46:43.355867+0000","last_peered":"2023-12-12T09:46:43.355867+0000","last_clean":"2023-12-12T09:46:43.355867+0000","last_became_active":"2023-12-12T09:46:42.320529+0000","last_became_peered":"2023-12-12T09:46:42.320529+0000","last_unstale":"2023-12-12T09:46:43.355867+0000","last_undegraded":"2023-12-12T09:46:43.355867+0000","last_fullsized":"2023-12-12T09:46:43.355867+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:41.318400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:41.318400+0000","last_clean_scrub_stamp":"2023-12-12T09:46:41.318400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T12:20:38.497812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-12T09:46:43.306821+0000","last_change":"2023-12-12T09:46:41.357120+0000","last_active":"2023-12-12T09:46:43.306821+0000","last_peered":"2023-12-12T09:46:43.306821+0000","last_clean":"2023-12-12T09:46:43.306821+0000","last_became_active":"2023-12-12T09:46:41.356245+0000","last_became_peered":"2023-12-12T09:46:41.356245+0000","last_unstale":"2023-12-12T09:46:43.306821+0000","last_undegraded":"2023-12-12T09:46:43.306821+0000","last_fullsized":"2023-12-12T09:46:43.306821+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:40.305028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:40.305028+0000","last_clean_scrub_stamp":"2023-12-12T09:46:40.305028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T20:26:21.715551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":15,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-12-12T09:46:42.308165+0000","last_change":"2023-12-12T09:46:26.998275+0000","last_active":"2023-12-12T09:46:42.308165+0000","last_peered":"2023-12-12T09:46:42.308165+0000","last_clean":"2023-12-12T09:46:42.308165+0000","last_became_active":"2023-12-12T09:46:26.997250+0000","last_became_peered":"2023-12-12T09:46:26.997250+0000","last_unstale":"2023-12-12T09:46:42.308165+0000","last_undegraded":"2023-12-12T09:46:42.308165+0000","last_fullsized":"2023-12-12T09:46:42.308165+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_clean_scrub_stamp":"2023-12-12T09:46:25.941843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T09:58:10.574493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.b","version":"74'2","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-12-12T09:46:42.318395+0000","last_change":"2023-12-12T09:46:25.981571+0000","last_active":"2023-12-12T09:46:42.318395+0000","last_peered":"2023-12-12T09:46:42.318395+0000","last_clean":"2023-12-12T09:46:42.318395+0000","last_became_active":"2023-12-12T09:46:25.981285+0000","last_became_peered":"2023-12-12T09:46:25.981285+0000","last_unstale":"2023-12-12T09:46:42.318395+0000","last_undegraded":"2023-12-12T09:46:42.318395+0000","last_fullsized":"2023-12-12T09:46:42.318395+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:24.925008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:24.925008+0000","last_clean_scrub_stamp":"2023-12-12T09:46:24.925008+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T16:03:21.071388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-12T09:46:43.355605+0000","last_change":"2023-12-12T09:46:42.333274+0000","last_active":"2023-12-12T09:46:43.355605+0000","last_peered":"2023-12-12T09:46:43.355605+0000","last_clean":"2023-12-12T09:46:43.355605+0000","last_became_active":"2023-12-12T09:46:42.332973+0000","last_became_peered":"2023-12-12T09:46:42.332973+0000","last_unstale":"2023-12-12T09:46:43.355605+0000","last_undegraded":"2023-12-12T09:46:43.355605+0000","last_fullsized":"2023-12-12T09:46:43.355605+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:41.318400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:41.318400+0000","last_clean_scrub_stamp":"2023-12-12T09:46:41.318400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T20:25:43.200693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-12T09:46:43.356943+0000","last_change":"2023-12-12T09:46:41.356747+0000","last_active":"2023-12-12T09:46:43.356943+0000","last_peered":"2023-12-12T09:46:43.356943+0000","last_clean":"2023-12-12T09:46:43.356943+0000","last_became_active":"2023-12-12T09:46:41.356279+0000","last_became_peered":"2023-12-12T09:46:41.356279+0000","last_unstale":"2023-12-12T09:46:43.356943+0000","last_undegraded":"2023-12-12T09:46:43.356943+0000","last_fullsized":"2023-12-12T09:46:43.356943+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:40.305028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:40.305028+0000","last_clean_scrub_stamp":"2023-12-12T09:46:40.305028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T10:54:19.705562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":15,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-12-12T09:46:42.309457+0000","last_change":"2023-12-12T09:46:26.979623+0000","last_active":"2023-12-12T09:46:42.309457+0000","last_peered":"2023-12-12T09:46:42.309457+0000","last_clean":"2023-12-12T09:46:42.309457+0000","last_became_active":"2023-12-12T09:46:26.979271+0000","last_became_peered":"2023-12-12T09:46:26.979271+0000","last_unstale":"2023-12-12T09:46:42.309457+0000","last_undegraded":"2023-12-12T09:46:42.309457+0000","last_fullsized":"2023-12-12T09:46:42.309457+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_clean_scrub_stamp":"2023-12-12T09:46:25.941843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T20:16:10.850955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":16,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-12-12T09:46:42.308403+0000","last_change":"2023-12-12T09:46:25.986608+0000","last_active":"2023-12-12T09:46:42.308403+0000","last_peered":"2023-12-12T09:46:42.308403+0000","last_clean":"2023-12-12T09:46:42.308403+0000","last_became_active":"2023-12-12T09:46:25.986236+0000","last_became_peered":"2023-12-12T09:46:25.986236+0000","last_unstale":"2023-12-12T09:46:42.308403+0000","last_undegraded":"2023-12-12T09:46:42.308403+0000","last_fullsized":"2023-12-12T09:46:42.308403+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:24.925008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:24.925008+0000","last_clean_scrub_stamp":"2023-12-12T09:46:24.925008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T20:29:16.623938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-12T09:46:43.357672+0000","last_change":"2023-12-12T09:46:42.319756+0000","last_active":"2023-12-12T09:46:43.357672+0000","last_peered":"2023-12-12T09:46:43.357672+0000","last_clean":"2023-12-12T09:46:43.357672+0000","last_became_active":"2023-12-12T09:46:42.319478+0000","last_became_peered":"2023-12-12T09:46:42.319478+0000","last_unstale":"2023-12-12T09:46:43.357672+0000","last_undegraded":"2023-12-12T09:46:43.357672+0000","last_fullsized":"2023-12-12T09:46:43.357672+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:41.318400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:41.318400+0000","last_clean_scrub_stamp":"2023-12-12T09:46:41.318400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T20:28:10.860161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.b","version":"78'2","reported_seq":14,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-12T09:46:43.358574+0000","last_change":"2023-12-12T09:46:41.364803+0000","last_active":"2023-12-12T09:46:43.358574+0000","last_peered":"2023-12-12T09:46:43.358574+0000","last_clean":"2023-12-12T09:46:43.358574+0000","last_became_active":"2023-12-12T09:46:41.363054+0000","last_became_peered":"2023-12-12T09:46:41.363054+0000","last_unstale":"2023-12-12T09:46:43.358574+0000","last_undegraded":"2023-12-12T09:46:43.358574+0000","last_fullsized":"2023-12-12T09:46:43.358574+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:40.305028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:40.305028+0000","last_clean_scrub_stamp":"2023-12-12T09:46:40.305028+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T21:03:47.271829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":15,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-12-12T09:46:42.301307+0000","last_change":"2023-12-12T09:46:26.987145+0000","last_active":"2023-12-12T09:46:42.301307+0000","last_peered":"2023-12-12T09:46:42.301307+0000","last_clean":"2023-12-12T09:46:42.301307+0000","last_became_active":"2023-12-12T09:46:26.986503+0000","last_became_peered":"2023-12-12T09:46:26.986503+0000","last_unstale":"2023-12-12T09:46:42.301307+0000","last_undegraded":"2023-12-12T09:46:42.301307+0000","last_fullsized":"2023-12-12T09:46:42.301307+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_clean_scrub_stamp":"2023-12-12T09:46:25.941843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T18:36:24.773262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":16,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-12-12T09:46:42.302047+0000","last_change":"2023-12-12T09:46:25.988222+0000","last_active":"2023-12-12T09:46:42.302047+0000","last_peered":"2023-12-12T09:46:42.302047+0000","last_clean":"2023-12-12T09:46:42.302047+0000","last_became_active":"2023-12-12T09:46:25.987972+0000","last_became_peered":"2023-12-12T09:46:25.987972+0000","last_unstale":"2023-12-12T09:46:42.302047+0000","last_undegraded":"2023-12-12T09:46:42.302047+0000","last_fullsized":"2023-12-12T09:46:42.302047+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:24.925008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:24.925008+0000","last_clean_scrub_stamp":"2023-12-12T09:46:24.925008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T12:18:16.286957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.b","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-12T09:46:43.357671+0000","last_change":"2023-12-12T09:46:42.336575+0000","last_active":"2023-12-12T09:46:43.357671+0000","last_peered":"2023-12-12T09:46:43.357671+0000","last_clean":"2023-12-12T09:46:43.357671+0000","last_became_active":"2023-12-12T09:46:42.336245+0000","last_became_peered":"2023-12-12T09:46:42.336245+0000","last_unstale":"2023-12-12T09:46:43.357671+0000","last_undegraded":"2023-12-12T09:46:43.357671+0000","last_fullsized":"2023-12-12T09:46:43.357671+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:41.318400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:41.318400+0000","last_clean_scrub_stamp":"2023-12-12T09:46:41.318400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T20:02:47.231873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-12T09:46:43.306516+0000","last_change":"2023-12-12T09:46:41.354326+0000","last_active":"2023-12-12T09:46:43.306516+0000","last_peered":"2023-12-12T09:46:43.306516+0000","last_clean":"2023-12-12T09:46:43.306516+0000","last_became_active":"2023-12-12T09:46:41.353949+0000","last_became_peered":"2023-12-12T09:46:41.353949+0000","last_unstale":"2023-12-12T09:46:43.306516+0000","last_undegraded":"2023-12-12T09:46:43.306516+0000","last_fullsized":"2023-12-12T09:46:43.306516+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:40.305028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:40.305028+0000","last_clean_scrub_stamp":"2023-12-12T09:46:40.305028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T20:39:13.093343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":15,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-12-12T09:46:42.304676+0000","last_change":"2023-12-12T09:46:26.968398+0000","last_active":"2023-12-12T09:46:42.304676+0000","last_peered":"2023-12-12T09:46:42.304676+0000","last_clean":"2023-12-12T09:46:42.304676+0000","last_became_active":"2023-12-12T09:46:26.967774+0000","last_became_peered":"2023-12-12T09:46:26.967774+0000","last_unstale":"2023-12-12T09:46:42.304676+0000","last_undegraded":"2023-12-12T09:46:42.304676+0000","last_fullsized":"2023-12-12T09:46:42.304676+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_clean_scrub_stamp":"2023-12-12T09:46:25.941843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T11:46:37.930187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":16,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-12-12T09:46:42.315234+0000","last_change":"2023-12-12T09:46:25.983579+0000","last_active":"2023-12-12T09:46:42.315234+0000","last_peered":"2023-12-12T09:46:42.315234+0000","last_clean":"2023-12-12T09:46:42.315234+0000","last_became_active":"2023-12-12T09:46:25.983172+0000","last_became_peered":"2023-12-12T09:46:25.983172+0000","last_unstale":"2023-12-12T09:46:42.315234+0000","last_undegraded":"2023-12-12T09:46:42.315234+0000","last_fullsized":"2023-12-12T09:46:42.315234+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:24.925008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:24.925008+0000","last_clean_scrub_stamp":"2023-12-12T09:46:24.925008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T10:55:00.009710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-12T09:46:43.305562+0000","last_change":"2023-12-12T09:46:42.327284+0000","last_active":"2023-12-12T09:46:43.305562+0000","last_peered":"2023-12-12T09:46:43.305562+0000","last_clean":"2023-12-12T09:46:43.305562+0000","last_became_active":"2023-12-12T09:46:42.326998+0000","last_became_peered":"2023-12-12T09:46:42.326998+0000","last_unstale":"2023-12-12T09:46:43.305562+0000","last_undegraded":"2023-12-12T09:46:43.305562+0000","last_fullsized":"2023-12-12T09:46:43.305562+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:41.318400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:41.318400+0000","last_clean_scrub_stamp":"2023-12-12T09:46:41.318400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T14:49:33.515496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-12T09:46:43.360356+0000","last_change":"2023-12-12T09:46:41.365162+0000","last_active":"2023-12-12T09:46:43.360356+0000","last_peered":"2023-12-12T09:46:43.360356+0000","last_clean":"2023-12-12T09:46:43.360356+0000","last_became_active":"2023-12-12T09:46:41.364902+0000","last_became_peered":"2023-12-12T09:46:41.364902+0000","last_unstale":"2023-12-12T09:46:43.360356+0000","last_undegraded":"2023-12-12T09:46:43.360356+0000","last_fullsized":"2023-12-12T09:46:43.360356+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:40.305028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:40.305028+0000","last_clean_scrub_stamp":"2023-12-12T09:46:40.305028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T21:01:40.299897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":15,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-12-12T09:46:42.318212+0000","last_change":"2023-12-12T09:46:26.974656+0000","last_active":"2023-12-12T09:46:42.318212+0000","last_peered":"2023-12-12T09:46:42.318212+0000","last_clean":"2023-12-12T09:46:42.318212+0000","last_became_active":"2023-12-12T09:46:26.974051+0000","last_became_peered":"2023-12-12T09:46:26.974051+0000","last_unstale":"2023-12-12T09:46:42.318212+0000","last_undegraded":"2023-12-12T09:46:42.318212+0000","last_fullsized":"2023-12-12T09:46:42.318212+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_clean_scrub_stamp":"2023-12-12T09:46:25.941843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T14:33:59.265126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.7","version":"74'2","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-12-12T09:46:42.327696+0000","last_change":"2023-12-12T09:46:25.989868+0000","last_active":"2023-12-12T09:46:42.327696+0000","last_peered":"2023-12-12T09:46:42.327696+0000","last_clean":"2023-12-12T09:46:42.327696+0000","last_became_active":"2023-12-12T09:46:25.989577+0000","last_became_peered":"2023-12-12T09:46:25.989577+0000","last_unstale":"2023-12-12T09:46:42.327696+0000","last_undegraded":"2023-12-12T09:46:42.327696+0000","last_fullsized":"2023-12-12T09:46:42.327696+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:24.925008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:24.925008+0000","last_clean_scrub_stamp":"2023-12-12T09:46:24.925008+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T19:17:31.250809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-12T09:46:43.358688+0000","last_change":"2023-12-12T09:46:42.332229+0000","last_active":"2023-12-12T09:46:43.358688+0000","last_peered":"2023-12-12T09:46:43.358688+0000","last_clean":"2023-12-12T09:46:43.358688+0000","last_became_active":"2023-12-12T09:46:42.329624+0000","last_became_peered":"2023-12-12T09:46:42.329624+0000","last_unstale":"2023-12-12T09:46:43.358688+0000","last_undegraded":"2023-12-12T09:46:43.358688+0000","last_fullsized":"2023-12-12T09:46:43.358688+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:41.318400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:41.318400+0000","last_clean_scrub_stamp":"2023-12-12T09:46:41.318400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T20:35:58.433787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-12T09:46:43.357662+0000","last_change":"2023-12-12T09:46:41.369495+0000","last_active":"2023-12-12T09:46:43.357662+0000","last_peered":"2023-12-12T09:46:43.357662+0000","last_clean":"2023-12-12T09:46:43.357662+0000","last_became_active":"2023-12-12T09:46:41.369121+0000","last_became_peered":"2023-12-12T09:46:41.369121+0000","last_unstale":"2023-12-12T09:46:43.357662+0000","last_undegraded":"2023-12-12T09:46:43.357662+0000","last_fullsized":"2023-12-12T09:46:43.357662+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:40.305028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:40.305028+0000","last_clean_scrub_stamp":"2023-12-12T09:46:40.305028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T20:16:32.040636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":15,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-12-12T09:46:42.315631+0000","last_change":"2023-12-12T09:46:26.994090+0000","last_active":"2023-12-12T09:46:42.315631+0000","last_peered":"2023-12-12T09:46:42.315631+0000","last_clean":"2023-12-12T09:46:42.315631+0000","last_became_active":"2023-12-12T09:46:26.992152+0000","last_became_peered":"2023-12-12T09:46:26.992152+0000","last_unstale":"2023-12-12T09:46:42.315631+0000","last_undegraded":"2023-12-12T09:46:42.315631+0000","last_fullsized":"2023-12-12T09:46:42.315631+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_clean_scrub_stamp":"2023-12-12T09:46:25.941843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T16:03:22.088223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.6","version":"75'1","reported_seq":17,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-12-12T09:46:42.325186+0000","last_change":"2023-12-12T09:46:25.986713+0000","last_active":"2023-12-12T09:46:42.325186+0000","last_peered":"2023-12-12T09:46:42.325186+0000","last_clean":"2023-12-12T09:46:42.325186+0000","last_became_active":"2023-12-12T09:46:25.986422+0000","last_became_peered":"2023-12-12T09:46:25.986422+0000","last_unstale":"2023-12-12T09:46:42.325186+0000","last_undegraded":"2023-12-12T09:46:42.325186+0000","last_fullsized":"2023-12-12T09:46:42.325186+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:24.925008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:24.925008+0000","last_clean_scrub_stamp":"2023-12-12T09:46:24.925008+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T10:48:07.069161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-12T09:46:43.360345+0000","last_change":"2023-12-12T09:46:42.336110+0000","last_active":"2023-12-12T09:46:43.360345+0000","last_peered":"2023-12-12T09:46:43.360345+0000","last_clean":"2023-12-12T09:46:43.360345+0000","last_became_active":"2023-12-12T09:46:42.334158+0000","last_became_peered":"2023-12-12T09:46:42.334158+0000","last_unstale":"2023-12-12T09:46:43.360345+0000","last_undegraded":"2023-12-12T09:46:43.360345+0000","last_fullsized":"2023-12-12T09:46:43.360345+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:41.318400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:41.318400+0000","last_clean_scrub_stamp":"2023-12-12T09:46:41.318400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T18:48:15.715348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.7","version":"78'2","reported_seq":14,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-12T09:46:43.309517+0000","last_change":"2023-12-12T09:46:41.356170+0000","last_active":"2023-12-12T09:46:43.309517+0000","last_peered":"2023-12-12T09:46:43.309517+0000","last_clean":"2023-12-12T09:46:43.309517+0000","last_became_active":"2023-12-12T09:46:41.355834+0000","last_became_peered":"2023-12-12T09:46:41.355834+0000","last_unstale":"2023-12-12T09:46:43.309517+0000","last_undegraded":"2023-12-12T09:46:43.309517+0000","last_fullsized":"2023-12-12T09:46:43.309517+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:40.305028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:40.305028+0000","last_clean_scrub_stamp":"2023-12-12T09:46:40.305028+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T14:49:32.502124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":15,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-12-12T09:46:42.307545+0000","last_change":"2023-12-12T09:46:26.989385+0000","last_active":"2023-12-12T09:46:42.307545+0000","last_peered":"2023-12-12T09:46:42.307545+0000","last_clean":"2023-12-12T09:46:42.307545+0000","last_became_active":"2023-12-12T09:46:26.989099+0000","last_became_peered":"2023-12-12T09:46:26.989099+0000","last_unstale":"2023-12-12T09:46:42.307545+0000","last_undegraded":"2023-12-12T09:46:42.307545+0000","last_fullsized":"2023-12-12T09:46:42.307545+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_clean_scrub_stamp":"2023-12-12T09:46:25.941843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T16:03:22.088223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":16,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-12-12T09:46:42.307981+0000","last_change":"2023-12-12T09:46:25.988958+0000","last_active":"2023-12-12T09:46:42.307981+0000","last_peered":"2023-12-12T09:46:42.307981+0000","last_clean":"2023-12-12T09:46:42.307981+0000","last_became_active":"2023-12-12T09:46:25.988383+0000","last_became_peered":"2023-12-12T09:46:25.988383+0000","last_unstale":"2023-12-12T09:46:42.307981+0000","last_undegraded":"2023-12-12T09:46:42.307981+0000","last_fullsized":"2023-12-12T09:46:42.307981+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:24.925008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:24.925008+0000","last_clean_scrub_stamp":"2023-12-12T09:46:24.925008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T12:32:02.713576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.7","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-12T09:46:43.305996+0000","last_change":"2023-12-12T09:46:42.338236+0000","last_active":"2023-12-12T09:46:43.305996+0000","last_peered":"2023-12-12T09:46:43.305996+0000","last_clean":"2023-12-12T09:46:43.305996+0000","last_became_active":"2023-12-12T09:46:42.337756+0000","last_became_peered":"2023-12-12T09:46:42.337756+0000","last_unstale":"2023-12-12T09:46:43.305996+0000","last_undegraded":"2023-12-12T09:46:43.305996+0000","last_fullsized":"2023-12-12T09:46:43.305996+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:41.318400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:41.318400+0000","last_clean_scrub_stamp":"2023-12-12T09:46:41.318400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T21:06:25.811665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.6","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-12T09:46:43.360354+0000","last_change":"2023-12-12T09:46:41.362160+0000","last_active":"2023-12-12T09:46:43.360354+0000","last_peered":"2023-12-12T09:46:43.360354+0000","last_clean":"2023-12-12T09:46:43.360354+0000","last_became_active":"2023-12-12T09:46:41.361692+0000","last_became_peered":"2023-12-12T09:46:41.361692+0000","last_unstale":"2023-12-12T09:46:43.360354+0000","last_undegraded":"2023-12-12T09:46:43.360354+0000","last_fullsized":"2023-12-12T09:46:43.360354+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:40.305028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:40.305028+0000","last_clean_scrub_stamp":"2023-12-12T09:46:40.305028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T20:35:57.420415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":15,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-12-12T09:46:42.328085+0000","last_change":"2023-12-12T09:46:26.989882+0000","last_active":"2023-12-12T09:46:42.328085+0000","last_peered":"2023-12-12T09:46:42.328085+0000","last_clean":"2023-12-12T09:46:42.328085+0000","last_became_active":"2023-12-12T09:46:26.989558+0000","last_became_peered":"2023-12-12T09:46:26.989558+0000","last_unstale":"2023-12-12T09:46:42.328085+0000","last_undegraded":"2023-12-12T09:46:42.328085+0000","last_fullsized":"2023-12-12T09:46:42.328085+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_clean_scrub_stamp":"2023-12-12T09:46:25.941843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T15:01:39.944049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":16,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-12-12T09:46:42.311795+0000","last_change":"2023-12-12T09:46:25.985790+0000","last_active":"2023-12-12T09:46:42.311795+0000","last_peered":"2023-12-12T09:46:42.311795+0000","last_clean":"2023-12-12T09:46:42.311795+0000","last_became_active":"2023-12-12T09:46:25.985297+0000","last_became_peered":"2023-12-12T09:46:25.985297+0000","last_unstale":"2023-12-12T09:46:42.311795+0000","last_undegraded":"2023-12-12T09:46:42.311795+0000","last_fullsized":"2023-12-12T09:46:42.311795+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:24.925008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:24.925008+0000","last_clean_scrub_stamp":"2023-12-12T09:46:24.925008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T20:16:09.834119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-12T09:46:43.355905+0000","last_change":"2023-12-12T09:46:42.328622+0000","last_active":"2023-12-12T09:46:43.355905+0000","last_peered":"2023-12-12T09:46:43.355905+0000","last_clean":"2023-12-12T09:46:43.355905+0000","last_became_active":"2023-12-12T09:46:42.328351+0000","last_became_peered":"2023-12-12T09:46:42.328351+0000","last_unstale":"2023-12-12T09:46:43.355905+0000","last_undegraded":"2023-12-12T09:46:43.355905+0000","last_fullsized":"2023-12-12T09:46:43.355905+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:41.318400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:41.318400+0000","last_clean_scrub_stamp":"2023-12-12T09:46:41.318400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T20:16:26.227512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-12T09:46:43.359668+0000","last_change":"2023-12-12T09:46:41.353657+0000","last_active":"2023-12-12T09:46:43.359668+0000","last_peered":"2023-12-12T09:46:43.359668+0000","last_clean":"2023-12-12T09:46:43.359668+0000","last_became_active":"2023-12-12T09:46:41.353312+0000","last_became_peered":"2023-12-12T09:46:41.353312+0000","last_unstale":"2023-12-12T09:46:43.359668+0000","last_undegraded":"2023-12-12T09:46:43.359668+0000","last_fullsized":"2023-12-12T09:46:43.359668+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:40.305028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:40.305028+0000","last_clean_scrub_stamp":"2023-12-12T09:46:40.305028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T10:54:19.705562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":15,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-12-12T09:46:42.307625+0000","last_change":"2023-12-12T09:46:26.978093+0000","last_active":"2023-12-12T09:46:42.307625+0000","last_peered":"2023-12-12T09:46:42.307625+0000","last_clean":"2023-12-12T09:46:42.307625+0000","last_became_active":"2023-12-12T09:46:26.977782+0000","last_became_peered":"2023-12-12T09:46:26.977782+0000","last_unstale":"2023-12-12T09:46:42.307625+0000","last_undegraded":"2023-12-12T09:46:42.307625+0000","last_fullsized":"2023-12-12T09:46:42.307625+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_clean_scrub_stamp":"2023-12-12T09:46:25.941843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T20:27:55.483605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":16,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-12-12T09:46:42.316294+0000","last_change":"2023-12-12T09:46:25.989940+0000","last_active":"2023-12-12T09:46:42.316294+0000","last_peered":"2023-12-12T09:46:42.316294+0000","last_clean":"2023-12-12T09:46:42.316294+0000","last_became_active":"2023-12-12T09:46:25.989572+0000","last_became_peered":"2023-12-12T09:46:25.989572+0000","last_unstale":"2023-12-12T09:46:42.316294+0000","last_undegraded":"2023-12-12T09:46:42.316294+0000","last_fullsized":"2023-12-12T09:46:42.316294+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:24.925008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:24.925008+0000","last_clean_scrub_stamp":"2023-12-12T09:46:24.925008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T10:24:07.511710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-12T09:46:43.355964+0000","last_change":"2023-12-12T09:46:42.324752+0000","last_active":"2023-12-12T09:46:43.355964+0000","last_peered":"2023-12-12T09:46:43.355964+0000","last_clean":"2023-12-12T09:46:43.355964+0000","last_became_active":"2023-12-12T09:46:42.323984+0000","last_became_peered":"2023-12-12T09:46:42.323984+0000","last_unstale":"2023-12-12T09:46:43.355964+0000","last_undegraded":"2023-12-12T09:46:43.355964+0000","last_fullsized":"2023-12-12T09:46:43.355964+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:41.318400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:41.318400+0000","last_clean_scrub_stamp":"2023-12-12T09:46:41.318400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T17:18:54.779024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-12T09:46:43.356149+0000","last_change":"2023-12-12T09:46:41.364555+0000","last_active":"2023-12-12T09:46:43.356149+0000","last_peered":"2023-12-12T09:46:43.356149+0000","last_clean":"2023-12-12T09:46:43.356149+0000","last_became_active":"2023-12-12T09:46:41.361705+0000","last_became_peered":"2023-12-12T09:46:41.361705+0000","last_unstale":"2023-12-12T09:46:43.356149+0000","last_undegraded":"2023-12-12T09:46:43.356149+0000","last_fullsized":"2023-12-12T09:46:43.356149+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:40.305028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:40.305028+0000","last_clean_scrub_stamp":"2023-12-12T09:46:40.305028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T10:34:47.270440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":15,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-12-12T09:46:42.314030+0000","last_change":"2023-12-12T09:46:26.980504+0000","last_active":"2023-12-12T09:46:42.314030+0000","last_peered":"2023-12-12T09:46:42.314030+0000","last_clean":"2023-12-12T09:46:42.314030+0000","last_became_active":"2023-12-12T09:46:26.980219+0000","last_became_peered":"2023-12-12T09:46:26.980219+0000","last_unstale":"2023-12-12T09:46:42.314030+0000","last_undegraded":"2023-12-12T09:46:42.314030+0000","last_fullsized":"2023-12-12T09:46:42.314030+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_clean_scrub_stamp":"2023-12-12T09:46:25.941843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T10:55:01.026545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":16,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-12-12T09:46:42.318376+0000","last_change":"2023-12-12T09:46:25.997435+0000","last_active":"2023-12-12T09:46:42.318376+0000","last_peered":"2023-12-12T09:46:42.318376+0000","last_clean":"2023-12-12T09:46:42.318376+0000","last_became_active":"2023-12-12T09:46:25.997139+0000","last_became_peered":"2023-12-12T09:46:25.997139+0000","last_unstale":"2023-12-12T09:46:42.318376+0000","last_undegraded":"2023-12-12T09:46:42.318376+0000","last_fullsized":"2023-12-12T09:46:42.318376+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:24.925008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:24.925008+0000","last_clean_scrub_stamp":"2023-12-12T09:46:24.925008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T10:34:31.890420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-12T09:46:43.357987+0000","last_change":"2023-12-12T09:46:42.330064+0000","last_active":"2023-12-12T09:46:43.357987+0000","last_peered":"2023-12-12T09:46:43.357987+0000","last_clean":"2023-12-12T09:46:43.357987+0000","last_became_active":"2023-12-12T09:46:42.329120+0000","last_became_peered":"2023-12-12T09:46:42.329120+0000","last_unstale":"2023-12-12T09:46:43.357987+0000","last_undegraded":"2023-12-12T09:46:43.357987+0000","last_fullsized":"2023-12-12T09:46:43.357987+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:41.318400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:41.318400+0000","last_clean_scrub_stamp":"2023-12-12T09:46:41.318400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T19:08:53.653454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-12T09:46:43.356951+0000","last_change":"2023-12-12T09:46:41.361488+0000","last_active":"2023-12-12T09:46:43.356951+0000","last_peered":"2023-12-12T09:46:43.356951+0000","last_clean":"2023-12-12T09:46:43.356951+0000","last_became_active":"2023-12-12T09:46:41.361214+0000","last_became_peered":"2023-12-12T09:46:41.361214+0000","last_unstale":"2023-12-12T09:46:43.356951+0000","last_undegraded":"2023-12-12T09:46:43.356951+0000","last_fullsized":"2023-12-12T09:46:43.356951+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:40.305028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:40.305028+0000","last_clean_scrub_stamp":"2023-12-12T09:46:40.305028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T18:51:51.937752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":15,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-12-12T09:46:42.310429+0000","last_change":"2023-12-12T09:46:26.992722+0000","last_active":"2023-12-12T09:46:42.310429+0000","last_peered":"2023-12-12T09:46:42.310429+0000","last_clean":"2023-12-12T09:46:42.310429+0000","last_became_active":"2023-12-12T09:46:26.990039+0000","last_became_peered":"2023-12-12T09:46:26.990039+0000","last_unstale":"2023-12-12T09:46:42.310429+0000","last_undegraded":"2023-12-12T09:46:42.310429+0000","last_fullsized":"2023-12-12T09:46:42.310429+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_clean_scrub_stamp":"2023-12-12T09:46:25.941843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T18:26:29.446839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":16,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-12-12T09:46:42.305669+0000","last_change":"2023-12-12T09:46:25.982419+0000","last_active":"2023-12-12T09:46:42.305669+0000","last_peered":"2023-12-12T09:46:42.305669+0000","last_clean":"2023-12-12T09:46:42.305669+0000","last_became_active":"2023-12-12T09:46:25.981873+0000","last_became_peered":"2023-12-12T09:46:25.981873+0000","last_unstale":"2023-12-12T09:46:42.305669+0000","last_undegraded":"2023-12-12T09:46:42.305669+0000","last_fullsized":"2023-12-12T09:46:42.305669+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:24.925008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:24.925008+0000","last_clean_scrub_stamp":"2023-12-12T09:46:24.925008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T12:20:22.104420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-12T09:46:43.307157+0000","last_change":"2023-12-12T09:46:42.328881+0000","last_active":"2023-12-12T09:46:43.307157+0000","last_peered":"2023-12-12T09:46:43.307157+0000","last_clean":"2023-12-12T09:46:43.307157+0000","last_became_active":"2023-12-12T09:46:42.328582+0000","last_became_peered":"2023-12-12T09:46:42.328582+0000","last_unstale":"2023-12-12T09:46:43.307157+0000","last_undegraded":"2023-12-12T09:46:43.307157+0000","last_fullsized":"2023-12-12T09:46:43.307157+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:41.318400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:41.318400+0000","last_clean_scrub_stamp":"2023-12-12T09:46:41.318400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T16:12:47.720838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-12T09:46:43.355586+0000","last_change":"2023-12-12T09:46:41.369558+0000","last_active":"2023-12-12T09:46:43.355586+0000","last_peered":"2023-12-12T09:46:43.355586+0000","last_clean":"2023-12-12T09:46:43.355586+0000","last_became_active":"2023-12-12T09:46:41.368871+0000","last_became_peered":"2023-12-12T09:46:41.368871+0000","last_unstale":"2023-12-12T09:46:43.355586+0000","last_undegraded":"2023-12-12T09:46:43.355586+0000","last_fullsized":"2023-12-12T09:46:43.355586+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:40.305028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:40.305028+0000","last_clean_scrub_stamp":"2023-12-12T09:46:40.305028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T15:16:25.998563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":15,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-12-12T09:46:42.305473+0000","last_change":"2023-12-12T09:46:26.995503+0000","last_active":"2023-12-12T09:46:42.305473+0000","last_peered":"2023-12-12T09:46:42.305473+0000","last_clean":"2023-12-12T09:46:42.305473+0000","last_became_active":"2023-12-12T09:46:26.995090+0000","last_became_peered":"2023-12-12T09:46:26.995090+0000","last_unstale":"2023-12-12T09:46:42.305473+0000","last_undegraded":"2023-12-12T09:46:42.305473+0000","last_fullsized":"2023-12-12T09:46:42.305473+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_clean_scrub_stamp":"2023-12-12T09:46:25.941843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T15:01:39.944049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":16,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-12-12T09:46:42.317939+0000","last_change":"2023-12-12T09:46:25.997135+0000","last_active":"2023-12-12T09:46:42.317939+0000","last_peered":"2023-12-12T09:46:42.317939+0000","last_clean":"2023-12-12T09:46:42.317939+0000","last_became_active":"2023-12-12T09:46:25.996777+0000","last_became_peered":"2023-12-12T09:46:25.996777+0000","last_unstale":"2023-12-12T09:46:42.317939+0000","last_undegraded":"2023-12-12T09:46:42.317939+0000","last_fullsized":"2023-12-12T09:46:42.317939+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:24.925008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:24.925008+0000","last_clean_scrub_stamp":"2023-12-12T09:46:24.925008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T16:09:35.711601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.e","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-12T09:46:43.362255+0000","last_change":"2023-12-12T09:46:42.321343+0000","last_active":"2023-12-12T09:46:43.362255+0000","last_peered":"2023-12-12T09:46:43.362255+0000","last_clean":"2023-12-12T09:46:43.362255+0000","last_became_active":"2023-12-12T09:46:42.319789+0000","last_became_peered":"2023-12-12T09:46:42.319789+0000","last_unstale":"2023-12-12T09:46:43.362255+0000","last_undegraded":"2023-12-12T09:46:43.362255+0000","last_fullsized":"2023-12-12T09:46:43.362255+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:41.318400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:41.318400+0000","last_clean_scrub_stamp":"2023-12-12T09:46:41.318400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T10:24:23.905103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.f","version":"78'1","reported_seq":13,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-12T09:46:43.360913+0000","last_change":"2023-12-12T09:46:41.368426+0000","last_active":"2023-12-12T09:46:43.360913+0000","last_peered":"2023-12-12T09:46:43.360913+0000","last_clean":"2023-12-12T09:46:43.360913+0000","last_became_active":"2023-12-12T09:46:41.368094+0000","last_became_peered":"2023-12-12T09:46:41.368094+0000","last_unstale":"2023-12-12T09:46:43.360913+0000","last_undegraded":"2023-12-12T09:46:43.360913+0000","last_fullsized":"2023-12-12T09:46:43.360913+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:40.305028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:40.305028+0000","last_clean_scrub_stamp":"2023-12-12T09:46:40.305028+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T11:01:52.288221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":15,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-12-12T09:46:42.325295+0000","last_change":"2023-12-12T09:46:26.994842+0000","last_active":"2023-12-12T09:46:42.325295+0000","last_peered":"2023-12-12T09:46:42.325295+0000","last_clean":"2023-12-12T09:46:42.325295+0000","last_became_active":"2023-12-12T09:46:26.986721+0000","last_became_peered":"2023-12-12T09:46:26.986721+0000","last_unstale":"2023-12-12T09:46:42.325295+0000","last_undegraded":"2023-12-12T09:46:42.325295+0000","last_fullsized":"2023-12-12T09:46:42.325295+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_clean_scrub_stamp":"2023-12-12T09:46:25.941843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T16:09:36.728436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"74'1","reported_seq":17,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-12-12T09:46:42.317529+0000","last_change":"2023-12-12T09:46:25.996699+0000","last_active":"2023-12-12T09:46:42.317529+0000","last_peered":"2023-12-12T09:46:42.317529+0000","last_clean":"2023-12-12T09:46:42.317529+0000","last_became_active":"2023-12-12T09:46:25.995486+0000","last_became_peered":"2023-12-12T09:46:25.995486+0000","last_unstale":"2023-12-12T09:46:42.317529+0000","last_undegraded":"2023-12-12T09:46:42.317529+0000","last_fullsized":"2023-12-12T09:46:42.317529+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:24.925008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:24.925008+0000","last_clean_scrub_stamp":"2023-12-12T09:46:24.925008+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T10:24:07.511710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":215,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-12-12T09:46:42.310841+0000","last_change":"2023-12-12T09:43:17.203315+0000","last_active":"2023-12-12T09:46:42.310841+0000","last_peered":"2023-12-12T09:46:42.310841+0000","last_clean":"2023-12-12T09:46:42.310841+0000","last_became_active":"2023-12-12T09:43:17.200779+0000","last_became_peered":"2023-12-12T09:43:17.200779+0000","last_unstale":"2023-12-12T09:46:42.310841+0000","last_undegraded":"2023-12-12T09:46:42.310841+0000","last_fullsized":"2023-12-12T09:46:42.310841+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:43:15.931922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:43:15.931922+0000","last_clean_scrub_stamp":"2023-12-12T09:43:15.931922+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T21:42:10.929640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":15,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":13,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":3905,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":7810,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":14,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":64844,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574894,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32204,"kb_used_data":1024,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339636,"statfs":{"total":96636764160,"available":96603787264,"internally_reserved":0,"allocated":1048576,"data_stored":1025002,"data_compressed":32422,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 12 09:46:16 2023","interfaces":[{"interface":"back","average":{"1min":1.163,"5min":1.046,"15min":1.014},"min":{"1min":0.66300000000000003,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.677,"5min":1.8089999999999999,"15min":1.8089999999999999},"last":1.4890000000000001},{"interface":"front","average":{"1min":1.143,"5min":1.0309999999999999,"15min":0.98299999999999998},"min":{"1min":0.67700000000000005,"5min":0.66300000000000003,"15min":0.66300000000000003},"max":{"1min":1.71,"5min":1.71,"15min":1.71},"last":0.96099999999999997}]},{"osd":1,"last update":"Tue Dec 12 09:46:16 2023","interfaces":[{"interface":"back","average":{"1min":1.3089999999999999,"5min":1.21,"15min":1.202},"min":{"1min":0.79300000000000004,"5min":0.72099999999999997,"15min":0.72099999999999997},"max":{"1min":1.897,"5min":1.897,"15min":1.897},"last":1.403},{"interface":"front","average":{"1min":1.1279999999999999,"5min":1.1830000000000001,"15min":1.2050000000000001},"min":{"1min":0.76300000000000001,"5min":0.71499999999999997,"15min":0.71499999999999997},"max":{"1min":1.4730000000000001,"5min":3.1150000000000002,"15min":3.1150000000000002},"last":1.2749999999999999}]},{"osd":2,"last update":"Tue Dec 12 09:46:16 2023","interfaces":[{"interface":"back","average":{"1min":1.252,"5min":1.2350000000000001,"15min":1.2529999999999999},"min":{"1min":0.89500000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"max":{"1min":1.8129999999999999,"5min":2.2050000000000001,"15min":2.2050000000000001},"last":1.4510000000000001},{"interface":"front","average":{"1min":1.139,"5min":1.2030000000000001,"15min":1.2310000000000001},"min":{"1min":0.72999999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":2.0329999999999999,"5min":3.2759999999999998,"15min":3.2759999999999998},"last":1.0669999999999999}]},{"osd":3,"last update":"Tue Dec 12 09:46:16 2023","interfaces":[{"interface":"back","average":{"1min":1.095,"5min":1.2470000000000001,"15min":1.2929999999999999},"min":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"max":{"1min":1.5900000000000001,"5min":3.1819999999999999,"15min":3.1819999999999999},"last":1.177},{"interface":"front","average":{"1min":1.367,"5min":1.294,"15min":1.294},"min":{"1min":0.88200000000000001,"5min":0.72799999999999998,"15min":0.72799999999999998},"max":{"1min":1.845,"5min":1.8740000000000001,"15min":1.8740000000000001},"last":1.127}]},{"osd":4,"last update":"Tue Dec 12 09:46:16 2023","interfaces":[{"interface":"back","average":{"1min":1.274,"5min":1.3149999999999999,"15min":1.339},"min":{"1min":0.68799999999999994,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.974,"5min":2.5529999999999999,"15min":2.5529999999999999},"last":1.3620000000000001},{"interface":"front","average":{"1min":1.383,"5min":1.395,"15min":1.4350000000000001},"min":{"1min":0.94399999999999995,"5min":0.66000000000000003,"15min":0.66000000000000003},"max":{"1min":2.3759999999999999,"5min":2.3759999999999999,"15min":2.3759999999999999},"last":1.5840000000000001}]},{"osd":5,"last update":"Tue Dec 12 09:46:16 2023","interfaces":[{"interface":"back","average":{"1min":1.4379999999999999,"5min":1.347,"15min":1.339},"min":{"1min":0.622,"5min":0.622,"15min":0.622},"max":{"1min":1.9890000000000001,"5min":1.9890000000000001,"15min":1.9890000000000001},"last":1.3200000000000001},{"interface":"front","average":{"1min":1.498,"5min":1.4990000000000001,"15min":1.524},"min":{"1min":1.0529999999999999,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":2.0259999999999998,"5min":2.4159999999999999,"15min":2.4159999999999999},"last":1.5249999999999999}]},{"osd":6,"last update":"Tue Dec 12 09:46:16 2023","interfaces":[{"interface":"back","average":{"1min":1.4019999999999999,"5min":1.4159999999999999,"15min":1.4159999999999999},"min":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"max":{"1min":1.9970000000000001,"5min":2.0510000000000002,"15min":2.0510000000000002},"last":1.232},{"interface":"front","average":{"1min":1.5649999999999999,"5min":1.591,"15min":1.6200000000000001},"min":{"1min":1.1970000000000001,"5min":0.71899999999999997,"15min":0.71899999999999997},"max":{"1min":2.0899999999999999,"5min":2.5800000000000001,"15min":2.5800000000000001},"last":1.635}]}]},{"osd":6,"up_from":13,"seq":55834574892,"num_pgs":53,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32148,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339692,"statfs":{"total":96636764160,"available":96603844608,"internally_reserved":0,"allocated":991232,"data_stored":435798,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 12 09:46:17 2023","interfaces":[{"interface":"back","average":{"1min":0.995,"5min":1.1080000000000001,"15min":1.1639999999999999},"min":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.4390000000000001,"5min":3.6429999999999998,"15min":3.6429999999999998},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.99299999999999999,"5min":1.0640000000000001,"15min":1.0680000000000001},"min":{"1min":0.60099999999999998,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.546,"5min":2.6059999999999999,"15min":2.6059999999999999},"last":0.748}]},{"osd":1,"last update":"Tue Dec 12 09:46:17 2023","interfaces":[{"interface":"back","average":{"1min":1.0589999999999999,"5min":1.081,"15min":1.0680000000000001},"min":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"max":{"1min":1.5069999999999999,"5min":2.0169999999999999,"15min":2.0169999999999999},"last":0.71399999999999997},{"interface":"front","average":{"1min":1.1359999999999999,"5min":1.1819999999999999,"15min":1.194},"min":{"1min":0.82399999999999995,"5min":0.72899999999999998,"15min":0.72899999999999998},"max":{"1min":1.4810000000000001,"5min":1.7,"15min":1.7},"last":0.94499999999999995}]},{"osd":2,"last update":"Tue Dec 12 09:46:17 2023","interfaces":[{"interface":"back","average":{"1min":1.218,"5min":1.2150000000000001,"15min":1.2290000000000001},"min":{"1min":0.87,"5min":0.71199999999999997,"15min":0.71199999999999997},"max":{"1min":1.5309999999999999,"5min":1.804,"15min":1.804},"last":1.131},{"interface":"front","average":{"1min":1.2050000000000001,"5min":1.258,"15min":1.294},"min":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":1.6799999999999999,"5min":2.2160000000000002,"15min":2.2160000000000002},"last":0.88600000000000001}]},{"osd":3,"last update":"Tue Dec 12 09:46:17 2023","interfaces":[{"interface":"back","average":{"1min":1.196,"5min":1.2110000000000001,"15min":1.2150000000000001},"min":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"max":{"1min":1.4339999999999999,"5min":2.665,"15min":2.665},"last":1.0269999999999999},{"interface":"front","average":{"1min":1.149,"5min":1.1899999999999999,"15min":1.2170000000000001},"min":{"1min":0.75700000000000001,"5min":0.65700000000000003,"15min":0.65700000000000003},"max":{"1min":1.5760000000000001,"5min":1.8620000000000001,"15min":1.8620000000000001},"last":0.80400000000000005}]},{"osd":4,"last update":"Tue Dec 12 09:46:17 2023","interfaces":[{"interface":"back","average":{"1min":1.3220000000000001,"5min":1.284,"15min":1.278},"min":{"1min":0.98199999999999998,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":1.631,"5min":2.0310000000000001,"15min":2.0310000000000001},"last":1.248},{"interface":"front","average":{"1min":1.4279999999999999,"5min":1.4079999999999999,"15min":1.407},"min":{"1min":0.95199999999999996,"5min":0.66200000000000003,"15min":0.66200000000000003},"max":{"1min":1.657,"5min":2.2799999999999998,"15min":2.2799999999999998},"last":1.296}]},{"osd":5,"last update":"Tue Dec 12 09:46:17 2023","interfaces":[{"interface":"back","average":{"1min":1.266,"5min":1.377,"15min":1.419},"min":{"1min":0.90700000000000003,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.7030000000000001,"5min":2.1739999999999999,"15min":2.1739999999999999},"last":1.1819999999999999},{"interface":"front","average":{"1min":1.494,"5min":1.4790000000000001,"15min":1.4770000000000001},"min":{"1min":1.175,"5min":0.80100000000000005,"15min":0.80100000000000005},"max":{"1min":1.76,"5min":1.929,"15min":1.929},"last":1.351}]},{"osd":7,"last update":"Tue Dec 12 09:46:17 2023","interfaces":[{"interface":"back","average":{"1min":1.448,"5min":1.476,"15min":1.498},"min":{"1min":1.03,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.8759999999999999,"5min":1.994,"15min":1.994},"last":1.2230000000000001},{"interface":"front","average":{"1min":1.4139999999999999,"5min":1.4810000000000001,"15min":1.5189999999999999},"min":{"1min":1.0389999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"max":{"1min":1.792,"5min":2.0800000000000001,"15min":2.0800000000000001},"last":1.073}]}]},{"osd":5,"up_from":13,"seq":55834574892,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32148,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339692,"statfs":{"total":96636764160,"available":96603844608,"internally_reserved":0,"allocated":991232,"data_stored":437651,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 12 09:46:17 2023","interfaces":[{"interface":"back","average":{"1min":1.0509999999999999,"5min":1.026,"15min":1.022},"min":{"1min":0.73799999999999999,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.5089999999999999,"5min":1.7310000000000001,"15min":1.7310000000000001},"last":0.90700000000000003},{"interface":"front","average":{"1min":1.077,"5min":1.101,"15min":1.1200000000000001},"min":{"1min":0.69899999999999995,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.4219999999999999,"5min":1.595,"15min":1.595},"last":0.68500000000000005}]},{"osd":1,"last update":"Tue Dec 12 09:46:17 2023","interfaces":[{"interface":"back","average":{"1min":1.075,"5min":1.1499999999999999,"15min":1.2},"min":{"1min":0.86699999999999999,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.343,"5min":1.756,"15min":1.756},"last":1.48},{"interface":"front","average":{"1min":1.052,"5min":1.079,"15min":1.087},"min":{"1min":0.752,"5min":0.66400000000000003,"15min":0.66400000000000003},"max":{"1min":1.5129999999999999,"5min":1.5840000000000001,"15min":1.5840000000000001},"last":0.97299999999999998}]},{"osd":2,"last update":"Tue Dec 12 09:46:17 2023","interfaces":[{"interface":"back","average":{"1min":1.1579999999999999,"5min":1.254,"15min":1.296},"min":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"max":{"1min":1.744,"5min":1.7889999999999999,"15min":1.7889999999999999},"last":1.1220000000000001},{"interface":"front","average":{"1min":1.089,"5min":1.3009999999999999,"15min":1.381},"min":{"1min":0.77000000000000002,"5min":0.72899999999999998,"15min":0.72899999999999998},"max":{"1min":1.556,"5min":2.1600000000000001,"15min":2.1600000000000001},"last":1.0429999999999999}]},{"osd":3,"last update":"Tue Dec 12 09:46:17 2023","interfaces":[{"interface":"back","average":{"1min":1.1659999999999999,"5min":1.296,"15min":1.3460000000000001},"min":{"1min":0.90100000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"max":{"1min":1.627,"5min":2.1499999999999999,"15min":2.1499999999999999},"last":1.5189999999999999},{"interface":"front","average":{"1min":1.3540000000000001,"5min":1.413,"15min":1.4650000000000001},"min":{"1min":1.038,"5min":0.75800000000000001,"15min":0.75800000000000001},"max":{"1min":2.0249999999999999,"5min":2.0249999999999999,"15min":2.0249999999999999},"last":1.222}]},{"osd":4,"last update":"Tue Dec 12 09:46:17 2023","interfaces":[{"interface":"back","average":{"1min":1.2310000000000001,"5min":1.4019999999999999,"15min":1.4610000000000001},"min":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":1.9790000000000001,"5min":2.391,"15min":2.391},"last":1.1719999999999999},{"interface":"front","average":{"1min":1.4419999999999999,"5min":1.53,"15min":1.5680000000000001},"min":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"max":{"1min":2.6040000000000001,"5min":2.6040000000000001,"15min":2.6040000000000001},"last":1.3640000000000001}]},{"osd":6,"last update":"Tue Dec 12 09:46:17 2023","interfaces":[{"interface":"back","average":{"1min":1.4390000000000001,"5min":1.5109999999999999,"15min":1.5669999999999999},"min":{"1min":0.74099999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":2.1179999999999999,"5min":2.1179999999999999,"15min":2.1179999999999999},"last":1.3200000000000001},{"interface":"front","average":{"1min":1.2829999999999999,"5min":1.5089999999999999,"15min":1.5900000000000001},"min":{"1min":0.80700000000000005,"5min":0.627,"15min":0.627},"max":{"1min":1.7849999999999999,"5min":2.306,"15min":2.306},"last":1.2669999999999999}]},{"osd":7,"last update":"Tue Dec 12 09:46:17 2023","interfaces":[{"interface":"back","average":{"1min":1.546,"5min":1.6870000000000001,"15min":1.752},"min":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"max":{"1min":2.2200000000000002,"5min":2.6880000000000002,"15min":2.6880000000000002},"last":1.6140000000000001},{"interface":"front","average":{"1min":1.605,"5min":1.6599999999999999,"15min":1.718},"min":{"1min":1.1479999999999999,"5min":0.88600000000000001,"15min":0.88600000000000001},"max":{"1min":2.4910000000000001,"5min":2.4910000000000001,"15min":2.4910000000000001},"last":1.5600000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574894,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32148,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339692,"statfs":{"total":96636764160,"available":96603844608,"internally_reserved":0,"allocated":991232,"data_stored":436188,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 12 09:46:19 2023","interfaces":[{"interface":"back","average":{"1min":1.0980000000000001,"5min":1.0549999999999999,"15min":1.0549999999999999},"min":{"1min":0.67400000000000004,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":1.5880000000000001,"5min":1.7010000000000001,"15min":1.7010000000000001},"last":1.2470000000000001},{"interface":"front","average":{"1min":1.145,"5min":1.0589999999999999,"15min":1.056},"min":{"1min":0.75800000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":1.5449999999999999,"5min":1.5449999999999999,"15min":1.5449999999999999},"last":1.1879999999999999}]},{"osd":1,"last update":"Tue Dec 12 09:46:19 2023","interfaces":[{"interface":"back","average":{"1min":1.0529999999999999,"5min":1.048,"15min":1.0449999999999999},"min":{"1min":0.748,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":1.496,"5min":1.496,"15min":1.496},"last":0.93000000000000005},{"interface":"front","average":{"1min":1.133,"5min":1.163,"15min":1.175},"min":{"1min":0.75900000000000001,"5min":0.73699999999999999,"15min":0.73699999999999999},"max":{"1min":1.6140000000000001,"5min":1.8720000000000001,"15min":1.8720000000000001},"last":1.389}]},{"osd":2,"last update":"Tue Dec 12 09:46:19 2023","interfaces":[{"interface":"back","average":{"1min":1.181,"5min":1.1359999999999999,"15min":1.1240000000000001},"min":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"max":{"1min":1.585,"5min":1.585,"15min":1.585},"last":0.96299999999999997},{"interface":"front","average":{"1min":1.226,"5min":1.2689999999999999,"15min":1.2849999999999999},"min":{"1min":0.80800000000000005,"5min":0.75600000000000001,"15min":0.75600000000000001},"max":{"1min":1.554,"5min":2.1640000000000001,"15min":2.1640000000000001},"last":1.611}]},{"osd":3,"last update":"Tue Dec 12 09:46:19 2023","interfaces":[{"interface":"back","average":{"1min":1.3620000000000001,"5min":1.2450000000000001,"15min":1.2170000000000001},"min":{"1min":1.03,"5min":0.83399999999999996,"15min":0.83399999999999996},"max":{"1min":1.7010000000000001,"5min":1.7010000000000001,"15min":1.7010000000000001},"last":1.0700000000000001},{"interface":"front","average":{"1min":1.24,"5min":1.2350000000000001,"15min":1.2370000000000001},"min":{"1min":0.86099999999999999,"5min":0.70599999999999996,"15min":0.70599999999999996},"max":{"1min":1.506,"5min":2.0499999999999998,"15min":2.0499999999999998},"last":0.80600000000000005}]},{"osd":5,"last update":"Tue Dec 12 09:46:19 2023","interfaces":[{"interface":"back","average":{"1min":1.4139999999999999,"5min":1.4179999999999999,"15min":1.4510000000000001},"min":{"1min":1.026,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.7350000000000001,"5min":2.3159999999999998,"15min":2.3159999999999998},"last":1.694},{"interface":"front","average":{"1min":1.4890000000000001,"5min":1.3799999999999999,"15min":1.3600000000000001},"min":{"1min":1.2509999999999999,"5min":0.71199999999999997,"15min":0.71199999999999997},"max":{"1min":1.8160000000000001,"5min":2.117,"15min":2.117},"last":1.4339999999999999}]},{"osd":6,"last update":"Tue Dec 12 09:46:19 2023","interfaces":[{"interface":"back","average":{"1min":1.3799999999999999,"5min":1.381,"15min":1.395},"min":{"1min":0.98099999999999998,"5min":0.81200000000000006,"15min":0.81200000000000006},"max":{"1min":1.7090000000000001,"5min":2.246,"15min":2.246},"last":1.139},{"interface":"front","average":{"1min":1.5609999999999999,"5min":1.5329999999999999,"15min":1.5429999999999999},"min":{"1min":1.0700000000000001,"5min":0.65600000000000003,"15min":0.65600000000000003},"max":{"1min":1.7949999999999999,"5min":2.5099999999999998,"15min":2.5099999999999998},"last":1.522}]},{"osd":7,"last update":"Tue Dec 12 09:46:19 2023","interfaces":[{"interface":"back","average":{"1min":1.5720000000000001,"5min":1.51,"15min":1.506},"min":{"1min":1.1970000000000001,"5min":0.77500000000000002,"15min":0.77500000000000002},"max":{"1min":1.9099999999999999,"5min":2.5710000000000002,"15min":2.5710000000000002},"last":1.3220000000000001},{"interface":"front","average":{"1min":1.5640000000000001,"5min":1.522,"15min":1.516},"min":{"1min":1.2490000000000001,"5min":1.0600000000000001,"15min":1.0600000000000001},"max":{"1min":2.016,"5min":2.3919999999999999,"15min":2.3919999999999999},"last":1.0349999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574892,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32156,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339684,"statfs":{"total":96636764160,"available":96603836416,"internally_reserved":0,"allocated":999424,"data_stored":439193,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 12 09:46:19 2023","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.84599999999999997,"15min":0.89000000000000001},"min":{"1min":0.35099999999999998,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":1.2350000000000001,"5min":1.4830000000000001,"15min":1.4830000000000001},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.93600000000000005,"5min":1.012,"15min":1.095},"min":{"1min":0.47699999999999998,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":1.839,"5min":3.3370000000000002,"15min":3.3370000000000002},"last":0.92300000000000004}]},{"osd":1,"last update":"Tue Dec 12 09:46:19 2023","interfaces":[{"interface":"back","average":{"1min":0.88100000000000001,"5min":0.875,"15min":0.90500000000000003},"min":{"1min":0.52200000000000002,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":1.4870000000000001,"5min":1.4870000000000001,"15min":1.4870000000000001},"last":0.78900000000000003},{"interface":"front","average":{"1min":1.0580000000000001,"5min":1.0209999999999999,"15min":1.0529999999999999},"min":{"1min":0.58399999999999996,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.542,"5min":2.9409999999999998,"15min":2.9409999999999998},"last":1.226}]},{"osd":2,"last update":"Tue Dec 12 09:46:19 2023","interfaces":[{"interface":"back","average":{"1min":0.94599999999999995,"5min":1.0760000000000001,"15min":1.1499999999999999},"min":{"1min":0.56100000000000005,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.6899999999999999,"5min":2.613,"15min":2.613},"last":1.048},{"interface":"front","average":{"1min":1.0489999999999999,"5min":1.1000000000000001,"15min":1.1559999999999999},"min":{"1min":0.53600000000000003,"5min":0.437,"15min":0.437},"max":{"1min":1.53,"5min":3.0430000000000001,"15min":3.0430000000000001},"last":0.89300000000000002}]},{"osd":4,"last update":"Tue Dec 12 09:46:19 2023","interfaces":[{"interface":"back","average":{"1min":1.129,"5min":1.2989999999999999,"15min":1.355},"min":{"1min":0.77200000000000002,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.7410000000000001,"5min":3.5019999999999998,"15min":3.5019999999999998},"last":1.407},{"interface":"front","average":{"1min":1.1850000000000001,"5min":1.355,"15min":1.4399999999999999},"min":{"1min":0.93500000000000005,"5min":0.755,"15min":0.755},"max":{"1min":1.528,"5min":2.9889999999999999,"15min":2.9889999999999999},"last":1.536}]},{"osd":5,"last update":"Tue Dec 12 09:46:19 2023","interfaces":[{"interface":"back","average":{"1min":1.306,"5min":1.4119999999999999,"15min":1.47},"min":{"1min":0.876,"5min":0.68000000000000005,"15min":0.68000000000000005},"max":{"1min":1.7370000000000001,"5min":4.2480000000000002,"15min":4.2480000000000002},"last":1.4770000000000001},{"interface":"front","average":{"1min":1.2430000000000001,"5min":1.4450000000000001,"15min":1.5429999999999999},"min":{"1min":0.746,"5min":0.72999999999999998,"15min":0.72999999999999998},"max":{"1min":1.609,"5min":5.5060000000000002,"15min":5.5060000000000002},"last":1.1850000000000001}]},{"osd":6,"last update":"Tue Dec 12 09:46:19 2023","interfaces":[{"interface":"back","average":{"1min":1.2669999999999999,"5min":1.353,"15min":1.423},"min":{"1min":0.77700000000000002,"5min":0.76500000000000001,"15min":0.76500000000000001},"max":{"1min":1.6799999999999999,"5min":3.1400000000000001,"15min":3.1400000000000001},"last":1.4279999999999999},{"interface":"front","average":{"1min":1.3540000000000001,"5min":1.456,"15min":1.516},"min":{"1min":0.92200000000000004,"5min":0.627,"15min":0.627},"max":{"1min":1.677,"5min":4.3179999999999996,"15min":4.3179999999999996},"last":1.3740000000000001}]},{"osd":7,"last update":"Tue Dec 12 09:46:19 2023","interfaces":[{"interface":"back","average":{"1min":1.3069999999999999,"5min":1.4630000000000001,"15min":1.5489999999999999},"min":{"1min":0.78100000000000003,"5min":0.77400000000000002,"15min":0.77400000000000002},"max":{"1min":1.627,"5min":5.3979999999999997,"15min":5.3979999999999997},"last":1.0069999999999999},{"interface":"front","average":{"1min":1.371,"5min":1.452,"15min":1.52},"min":{"1min":0.83799999999999997,"5min":0.74299999999999999,"15min":0.74299999999999999},"max":{"1min":1.7769999999999999,"5min":3.4129999999999998,"15min":3.4129999999999998},"last":1.3220000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574892,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32136,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339704,"statfs":{"total":96636764160,"available":96603856896,"internally_reserved":0,"allocated":978944,"data_stored":435068,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 12 09:46:17 2023","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":0.80400000000000005,"15min":0.81399999999999995},"min":{"1min":0.37,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":1.431,"5min":1.458,"15min":1.458},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.88500000000000001,"5min":0.89400000000000002,"15min":0.90600000000000003},"min":{"1min":0.36099999999999999,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":2.4129999999999998,"5min":2.4129999999999998,"15min":2.4129999999999998},"last":0.86799999999999999}]},{"osd":1,"last update":"Tue Dec 12 09:46:17 2023","interfaces":[{"interface":"back","average":{"1min":0.81299999999999994,"5min":0.84699999999999998,"15min":0.85799999999999998},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":1.2450000000000001,"5min":1.593,"15min":1.593},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.98399999999999999,"5min":0.89700000000000002,"15min":0.89000000000000001},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.514,"5min":1.758,"15min":1.758},"last":1.169}]},{"osd":3,"last update":"Tue Dec 12 09:46:17 2023","interfaces":[{"interface":"back","average":{"1min":1.0589999999999999,"5min":1.034,"15min":1.0489999999999999},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":1.889,"5min":1.889,"15min":1.889},"last":0.93400000000000005},{"interface":"front","average":{"1min":0.91300000000000003,"5min":0.96099999999999997,"15min":0.99299999999999999},"min":{"1min":0.442,"5min":0.432,"15min":0.432},"max":{"1min":1.472,"5min":1.8120000000000001,"15min":1.8120000000000001},"last":0.56499999999999995}]},{"osd":4,"last update":"Tue Dec 12 09:46:17 2023","interfaces":[{"interface":"back","average":{"1min":1.1359999999999999,"5min":1.1910000000000001,"15min":1.2150000000000001},"min":{"1min":0.753,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.8300000000000001,"5min":2.5760000000000001,"15min":2.5760000000000001},"last":0.83799999999999997},{"interface":"front","average":{"1min":1.175,"5min":1.3080000000000001,"15min":1.365},"min":{"1min":0.747,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.6259999999999999,"5min":2.8069999999999999,"15min":2.8069999999999999},"last":1.613}]},{"osd":5,"last update":"Tue Dec 12 09:46:17 2023","interfaces":[{"interface":"back","average":{"1min":1.2210000000000001,"5min":1.3360000000000001,"15min":1.3640000000000001},"min":{"1min":0.81699999999999995,"5min":0.80500000000000005,"15min":0.80500000000000005},"max":{"1min":1.7150000000000001,"5min":2.3109999999999999,"15min":2.3109999999999999},"last":1.121},{"interface":"front","average":{"1min":1.159,"5min":1.2809999999999999,"15min":1.327},"min":{"1min":0.79400000000000004,"5min":0.627,"15min":0.627},"max":{"1min":1.5660000000000001,"5min":2.5110000000000001,"15min":2.5110000000000001},"last":1.008}]},{"osd":6,"last update":"Tue Dec 12 09:46:17 2023","interfaces":[{"interface":"back","average":{"1min":1.2589999999999999,"5min":1.379,"15min":1.417},"min":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":1.77,"5min":2.907,"15min":2.907},"last":1.5549999999999999},{"interface":"front","average":{"1min":1.3120000000000001,"5min":1.3999999999999999,"15min":1.419},"min":{"1min":0.83899999999999997,"5min":0.82799999999999996,"15min":0.82799999999999996},"max":{"1min":1.7809999999999999,"5min":2.6000000000000001,"15min":2.6000000000000001},"last":0.99199999999999999}]},{"osd":7,"last update":"Tue Dec 12 09:46:17 2023","interfaces":[{"interface":"back","average":{"1min":1.333,"5min":1.401,"15min":1.4379999999999999},"min":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"max":{"1min":1.7669999999999999,"5min":2.3370000000000002,"15min":2.3370000000000002},"last":1.48},{"interface":"front","average":{"1min":1.3779999999999999,"5min":1.466,"15min":1.4970000000000001},"min":{"1min":0.96499999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"max":{"1min":1.95,"5min":2.488,"15min":2.488},"last":1.03}]}]},{"osd":1,"up_from":13,"seq":55834574892,"num_pgs":57,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32140,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339700,"statfs":{"total":96636764160,"available":96603852800,"internally_reserved":0,"allocated":983040,"data_stored":434646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 12 09:46:17 2023","interfaces":[{"interface":"back","average":{"1min":0.82599999999999996,"5min":0.83699999999999997,"15min":0.84899999999999998},"min":{"1min":0.56299999999999994,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":1.427,"5min":2.794,"15min":2.794},"last":1.4039999999999999},{"interface":"front","average":{"1min":0.749,"5min":0.82599999999999996,"15min":0.85199999999999998},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":1.5,"5min":2.1379999999999999,"15min":2.1379999999999999},"last":0.66900000000000004}]},{"osd":2,"last update":"Tue Dec 12 09:46:17 2023","interfaces":[{"interface":"back","average":{"1min":0.82899999999999996,"5min":0.93500000000000005,"15min":0.96899999999999997},"min":{"1min":0.59099999999999997,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":1.4450000000000001,"5min":6.3390000000000004,"15min":6.3390000000000004},"last":0.93200000000000005},{"interface":"front","average":{"1min":0.89100000000000001,"5min":0.94699999999999995,"15min":0.95999999999999996},"min":{"1min":0.56799999999999995,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.1830000000000001,"5min":2.823,"15min":2.823},"last":1.2}]},{"osd":3,"last update":"Tue Dec 12 09:46:17 2023","interfaces":[{"interface":"back","average":{"1min":0.94999999999999996,"5min":1.0329999999999999,"15min":1.0449999999999999},"min":{"1min":0.53200000000000003,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":1.5549999999999999,"5min":2.7519999999999998,"15min":2.7519999999999998},"last":1.919},{"interface":"front","average":{"1min":0.88200000000000001,"5min":0.98399999999999999,"15min":1},"min":{"1min":0.498,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":1.212,"5min":2.2559999999999998,"15min":2.2559999999999998},"last":1.0860000000000001}]},{"osd":4,"last update":"Tue Dec 12 09:46:17 2023","interfaces":[{"interface":"back","average":{"1min":1.159,"5min":1.2929999999999999,"15min":1.363},"min":{"1min":0.78700000000000003,"5min":0.68400000000000005,"15min":0.68400000000000005},"max":{"1min":1.484,"5min":6.423,"15min":6.423},"last":1.1499999999999999},{"interface":"front","average":{"1min":1.1799999999999999,"5min":1.1899999999999999,"15min":1.1919999999999999},"min":{"1min":0.84499999999999997,"5min":0.80000000000000004,"15min":0.80000000000000004},"max":{"1min":1.474,"5min":2.2309999999999999,"15min":2.2309999999999999},"last":1.615}]},{"osd":5,"last update":"Tue Dec 12 09:46:17 2023","interfaces":[{"interface":"back","average":{"1min":1.145,"5min":1.353,"15min":1.429},"min":{"1min":0.93799999999999994,"5min":0.80200000000000005,"15min":0.80200000000000005},"max":{"1min":1.4970000000000001,"5min":6.2830000000000004,"15min":6.2830000000000004},"last":1.4350000000000001},{"interface":"front","average":{"1min":1.2310000000000001,"5min":1.325,"15min":1.3580000000000001},"min":{"1min":0.88900000000000001,"5min":0.83499999999999996,"15min":0.83499999999999996},"max":{"1min":1.4390000000000001,"5min":2.73,"15min":2.73},"last":1.367}]},{"osd":6,"last update":"Tue Dec 12 09:46:17 2023","interfaces":[{"interface":"back","average":{"1min":1.236,"5min":1.446,"15min":1.522},"min":{"1min":0.84499999999999997,"5min":0.751,"15min":0.751},"max":{"1min":1.7210000000000001,"5min":6.468,"15min":6.468},"last":1.8520000000000001},{"interface":"front","average":{"1min":1.2430000000000001,"5min":1.4470000000000001,"15min":1.5349999999999999},"min":{"1min":0.90400000000000003,"5min":0.84699999999999998,"15min":0.84699999999999998},"max":{"1min":1.585,"5min":6.3129999999999997,"15min":6.3129999999999997},"last":1.522}]},{"osd":7,"last update":"Tue Dec 12 09:46:17 2023","interfaces":[{"interface":"back","average":{"1min":1.3300000000000001,"5min":1.3759999999999999,"15min":1.3959999999999999},"min":{"1min":0.99099999999999999,"5min":0.82999999999999996,"15min":0.82999999999999996},"max":{"1min":1.5980000000000001,"5min":2.9009999999999998,"15min":2.9009999999999998},"last":1.732},{"interface":"front","average":{"1min":1.2529999999999999,"5min":1.4530000000000001,"15min":1.5209999999999999},"min":{"1min":0.92400000000000004,"5min":0.752,"15min":0.752},"max":{"1min":1.6379999999999999,"5min":6.242,"15min":6.242},"last":1.2589999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574894,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32200,"kb_used_data":1020,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339640,"statfs":{"total":96636764160,"available":96603791360,"internally_reserved":0,"allocated":1044480,"data_stored":1025436,"data_compressed":32422,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Dec 12 09:46:19 2023","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.78000000000000003,"15min":0.77400000000000002},"min":{"1min":0.40699999999999997,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":1.3600000000000001,"5min":1.639,"15min":1.639},"last":0.93899999999999995},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.82999999999999996,"15min":0.82099999999999995},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":1.5509999999999999,"5min":1.5680000000000001,"15min":1.5680000000000001},"last":1.2070000000000001}]},{"osd":2,"last update":"Tue Dec 12 09:46:19 2023","interfaces":[{"interface":"back","average":{"1min":0.86399999999999999,"5min":0.88,"15min":0.86799999999999999},"min":{"1min":0.47299999999999998,"5min":0.316,"15min":0.316},"max":{"1min":1.466,"5min":1.748,"15min":1.748},"last":1.042},{"interface":"front","average":{"1min":0.84299999999999997,"5min":0.97499999999999998,"15min":0.98799999999999999},"min":{"1min":0.48399999999999999,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":1.26,"5min":1.649,"15min":1.649},"last":1.0920000000000001}]},{"osd":3,"last update":"Tue Dec 12 09:46:19 2023","interfaces":[{"interface":"back","average":{"1min":0.83499999999999996,"5min":0.84099999999999997,"15min":0.84899999999999998},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":1.901,"5min":1.901,"15min":1.901},"last":1.3939999999999999},{"interface":"front","average":{"1min":1.002,"5min":1.0129999999999999,"15min":1.0069999999999999},"min":{"1min":0.50700000000000001,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":2.3210000000000002,"5min":2.3210000000000002,"15min":2.3210000000000002},"last":1.2969999999999999}]},{"osd":4,"last update":"Tue Dec 12 09:46:19 2023","interfaces":[{"interface":"back","average":{"1min":1.2250000000000001,"5min":1.284,"15min":1.286},"min":{"1min":0.81399999999999995,"5min":0.80400000000000005,"15min":0.80400000000000005},"max":{"1min":1.5660000000000001,"5min":2.073,"15min":2.073},"last":1.4359999999999999},{"interface":"front","average":{"1min":1.248,"5min":1.2649999999999999,"15min":1.2829999999999999},"min":{"1min":0.85899999999999999,"5min":0.64400000000000002,"15min":0.64400000000000002},"max":{"1min":1.714,"5min":3.0699999999999998,"15min":3.0699999999999998},"last":1.708}]},{"osd":5,"last update":"Tue Dec 12 09:46:19 2023","interfaces":[{"interface":"back","average":{"1min":1.177,"5min":1.2090000000000001,"15min":1.2250000000000001},"min":{"1min":0.68600000000000005,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.698,"5min":3.1909999999999998,"15min":3.1909999999999998},"last":1.5660000000000001},{"interface":"front","average":{"1min":1.266,"5min":1.292,"15min":1.302},"min":{"1min":0.89700000000000002,"5min":0.67300000000000004,"15min":0.67300000000000004},"max":{"1min":2.2120000000000002,"5min":2.2120000000000002,"15min":2.2120000000000002},"last":1.4810000000000001}]},{"osd":6,"last update":"Tue Dec 12 09:46:19 2023","interfaces":[{"interface":"back","average":{"1min":1.3260000000000001,"5min":1.3340000000000001,"15min":1.3360000000000001},"min":{"1min":0.84999999999999998,"5min":0.67500000000000004,"15min":0.67500000000000004},"max":{"1min":1.643,"5min":2.04,"15min":2.04},"last":1.6180000000000001},{"interface":"front","average":{"1min":1.296,"5min":1.3660000000000001,"15min":1.383},"min":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"max":{"1min":2.3500000000000001,"5min":2.9100000000000001,"15min":2.9100000000000001},"last":1.3400000000000001}]},{"osd":7,"last update":"Tue Dec 12 09:46:19 2023","interfaces":[{"interface":"back","average":{"1min":1.3280000000000001,"5min":1.4119999999999999,"15min":1.4339999999999999},"min":{"1min":0.78100000000000003,"5min":0.66800000000000004,"15min":0.66800000000000004},"max":{"1min":1.7929999999999999,"5min":2.992,"15min":2.992},"last":1.6599999999999999},{"interface":"front","average":{"1min":1.3280000000000001,"5min":1.327,"15min":1.329},"min":{"1min":0.93500000000000005,"5min":0.79500000000000004,"15min":0.79500000000000004},"max":{"1min":2.1440000000000001,"5min":2.7690000000000001,"15min":2.7690000000000001},"last":1.24}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32422,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32422,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3107,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":3129,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-12T09:46:46.825 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-12T09:46:47.074 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:47.073+0000 7fcce25a9640 1 Processor -- start 2023-12-12T09:46:47.075 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:47.073+0000 7fcce25a9640 1 -- start start 2023-12-12T09:46:47.076 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:47.074+0000 7fcce25a9640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fccdc06bf20 0x7fccdc0a9760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:47.076 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:47.074+0000 7fcce25a9640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fccdc0c0b50 con 0x7fccdc1552e0 2023-12-12T09:46:47.076 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:47.074+0000 7fcce25a9640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fccdc06c880 con 0x7fccdc0a50f0 2023-12-12T09:46:47.076 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:47.074+0000 7fcce25a9640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fccdc0c04d0 con 0x7fccdc06bf20 2023-12-12T09:46:47.076 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:47.075+0000 7fccdbfff640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7fccdc1552e0 0x7fccdc0c49c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:50852/0 (socket says 172.21.15.73:50852) 2023-12-12T09:46:47.076 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:47.075+0000 7fccdbfff640 1 -- 172.21.15.73:0/3619937471 learned_addr learned my addr 172.21.15.73:0/3619937471 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-12T09:46:47.078 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:47.075+0000 7fccdb7fe640 1 -- 172.21.15.73:0/3619937471 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4004780806 0 0) 0x7fccdc0c0b50 con 0x7fccdc1552e0 2023-12-12T09:46:47.078 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:47.075+0000 7fccdb7fe640 1 -- 172.21.15.73:0/3619937471 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fccc8003520 con 0x7fccdc1552e0 2023-12-12T09:46:47.078 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:47.075+0000 7fcce0b46640 1 --2- 172.21.15.73:0/3619937471 >> v2:172.21.15.142:3300/0 conn(0x7fccdc06bf20 0x7fccdc0a9760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:47.078 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:47.075+0000 7fccdb7fe640 1 -- 172.21.15.73:0/3619937471 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 882813034 0 0) 0x7fccc8003520 con 0x7fccdc1552e0 2023-12-12T09:46:47.079 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:47.075+0000 7fccdb7fe640 1 -- 172.21.15.73:0/3619937471 >> v2:172.21.15.142:3300/0 conn(0x7fccdc06bf20 msgr2=0x7fccdc0a9760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:46:47.079 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:47.075+0000 7fccdb7fe640 1 --2- 172.21.15.73:0/3619937471 >> v2:172.21.15.142:3300/0 conn(0x7fccdc06bf20 0x7fccdc0a9760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:47.079 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:47.075+0000 7fccdb7fe640 1 -- 172.21.15.73:0/3619937471 >> v1:172.21.15.142:6789/0 conn(0x7fccdc0a50f0 legacy=0x7fccdc0a9050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:46:47.079 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:47.075+0000 7fccdb7fe640 1 -- 172.21.15.73:0/3619937471 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccdc06cb60 con 0x7fccdc1552e0 2023-12-12T09:46:47.079 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:47.075+0000 7fccdb7fe640 1 -- 172.21.15.73:0/3619937471 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3186547832 0 0) 0x7fcccc001670 con 0x7fccdc1552e0 2023-12-12T09:46:47.079 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:47.075+0000 7fccdb7fe640 1 -- 172.21.15.73:0/3619937471 >> v1:172.21.15.73:6789/0 conn(0x7fccdc1552e0 legacy=0x7fccdc0c49c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:47.079 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:47.075+0000 7fccdb7fe640 1 --2- 172.21.15.73:0/3619937471 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fccc80039c0 0x7fccc8003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:47.079 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:47.076+0000 7fccdb7fe640 1 --2- 172.21.15.73:0/3619937471 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fccc80047c0 0x7fccc8004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:47.079 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:47.076+0000 7fccdb7fe640 1 --2- 172.21.15.73:0/3619937471 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fccc8005250 0x7fccc800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:47.079 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:47.076+0000 7fccdb7fe640 1 -- 172.21.15.73:0/3619937471 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccdc0c04d0 con 0x7fccc8005250 2023-12-12T09:46:47.079 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:47.076+0000 7fccdb7fe640 1 -- 172.21.15.73:0/3619937471 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccc800c1a0 con 0x7fccc80039c0 2023-12-12T09:46:47.079 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:47.076+0000 7fccdb7fe640 1 -- 172.21.15.73:0/3619937471 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fccc800c360 con 0x7fccc80047c0 2023-12-12T09:46:47.079 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:47.076+0000 7fcce0b46640 1 --2- 172.21.15.73:0/3619937471 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fccc8005250 0x7fccc800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:47.079 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:47.076+0000 7fccdbfff640 1 --2- 172.21.15.73:0/3619937471 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fccc80039c0 0x7fccc8003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:47.080 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:47.076+0000 7fccd3fff640 1 --2- 172.21.15.73:0/3619937471 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fccc80047c0 0x7fccc8004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:47.080 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:47.076+0000 7fcce0b46640 1 -- 172.21.15.73:0/3619937471 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fccc80047c0 msgr2=0x7fccc8004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:46:47.080 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:47.076+0000 7fcce0b46640 1 --2- 172.21.15.73:0/3619937471 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fccc80047c0 0x7fccc8004c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:47.080 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:47.076+0000 7fcce0b46640 1 -- 172.21.15.73:0/3619937471 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fccc80039c0 msgr2=0x7fccc8003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:46:47.080 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:47.076+0000 7fcce0b46640 1 --2- 172.21.15.73:0/3619937471 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fccc80039c0 0x7fccc8003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:47.080 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:47.076+0000 7fcce0b46640 1 -- 172.21.15.73:0/3619937471 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccc8003520 con 0x7fccc8005250 2023-12-12T09:46:47.080 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:47.077+0000 7fcce0b46640 1 -- 172.21.15.73:0/3619937471 reap_dead start 2023-12-12T09:46:47.081 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:47.077+0000 7fcce0b46640 1 --2- 172.21.15.73:0/3619937471 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fccc8005250 0x7fccc800b980 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 crypto rx=0x7fccd4007360 tx=0x7fccc80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f82d8d070c7bc85 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:46:47.081 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:47.078+0000 7fccdb7fe640 1 -- 172.21.15.73:0/3619937471 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccd402ccf0 con 0x7fccc8005250 2023-12-12T09:46:47.082 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:47.078+0000 7fccdb7fe640 1 -- 172.21.15.73:0/3619937471 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fccd402ce90 con 0x7fccc8005250 2023-12-12T09:46:47.082 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:47.078+0000 7fccdb7fe640 1 -- 172.21.15.73:0/3619937471 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccd4003bd0 con 0x7fccc8005250 2023-12-12T09:46:47.082 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:47.078+0000 7fcce25a9640 1 -- 172.21.15.73:0/3619937471 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fccc8005250 msgr2=0x7fccc800b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:47.082 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:47.078+0000 7fcce25a9640 1 --2- 172.21.15.73:0/3619937471 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fccc8005250 0x7fccc800b980 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 crypto rx=0x7fccd4007360 tx=0x7fccc80057f0 comp rx=0 tx=0).stop 2023-12-12T09:46:47.082 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:47.078+0000 7fcce25a9640 1 -- 172.21.15.73:0/3619937471 shutdown_connections 2023-12-12T09:46:47.082 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:47.078+0000 7fcce25a9640 1 --2- 172.21.15.73:0/3619937471 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fccc8005250 0x7fccc800b980 unknown :-1 s=CLOSED pgs=941 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:47.082 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:47.078+0000 7fcce25a9640 1 -- 172.21.15.73:0/3619937471 >> 172.21.15.73:0/3619937471 conn(0x7fccdc0a8130 msgr2=0x7fccdc0c24b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:46:47.082 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:47.078+0000 7fcce25a9640 1 -- 172.21.15.73:0/3619937471 shutdown_connections 2023-12-12T09:46:47.082 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:47.078+0000 7fcce25a9640 1 -- 172.21.15.73:0/3619937471 wait complete. 2023-12-12T09:46:47.085 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:47.080+0000 7fcce25a9640 1 Processor -- start 2023-12-12T09:46:47.085 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:47.080+0000 7fcce25a9640 1 -- start start 2023-12-12T09:46:47.085 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:47.081+0000 7fcce25a9640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fccc8005250 0x7fccdc0a6b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:47.085 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:47.081+0000 7fcce25a9640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fccdc150e70 0x7fccdc070160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:47.085 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:47.081+0000 7fcce25a9640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fccdc0a9d60 0x7fccdc1ed2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:47.085 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:47.081+0000 7fcce25a9640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccdc0a98d0 con 0x7fccc8005250 2023-12-12T09:46:47.085 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:47.081+0000 7fcce25a9640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccdc151300 con 0x7fccdc150e70 2023-12-12T09:46:47.085 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:47.081+0000 7fcce25a9640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fccdc0a8fa0 con 0x7fccdc0a9d60 2023-12-12T09:46:47.085 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:47.081+0000 7fccdbfff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fccc8005250 0x7fccdc0a6b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:47.085 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:47.081+0000 7fccdbfff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fccc8005250 0x7fccdc0a6b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:53984/0 (socket says 172.21.15.73:53984) 2023-12-12T09:46:47.085 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:47.081+0000 7fccdbfff640 1 -- 172.21.15.73:0/1266195249 learned_addr learned my addr 172.21.15.73:0/1266195249 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:46:47.085 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:47.082+0000 7fccdbfff640 1 -- 172.21.15.73:0/1266195249 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fccdc0a9d60 msgr2=0x7fccdc1ed2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:47.085 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:47.082+0000 7fccdbfff640 1 --2- 172.21.15.73:0/1266195249 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fccdc0a9d60 0x7fccdc1ed2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:47.086 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:47.082+0000 7fccdbfff640 1 -- 172.21.15.73:0/1266195249 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fccdc150e70 msgr2=0x7fccdc070160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:47.086 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:47.082+0000 7fccdbfff640 1 --2- 172.21.15.73:0/1266195249 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fccdc150e70 0x7fccdc070160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:47.086 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:47.082+0000 7fccdbfff640 1 -- 172.21.15.73:0/1266195249 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccdc0a9280 con 0x7fccc8005250 2023-12-12T09:46:47.086 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:47.082+0000 7fccdbfff640 1 --2- 172.21.15.73:0/1266195249 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fccc8005250 0x7fccdc0a6b40 secure :-1 s=READY pgs=942 cs=0 l=1 rev1=1 crypto rx=0x7fcccc00e730 tx=0x7fcccc00ebf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:46:47.086 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:47.082+0000 7fccd97fa640 1 -- 172.21.15.73:0/1266195249 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcccc00c6c0 con 0x7fccc8005250 2023-12-12T09:46:47.086 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:47.082+0000 7fccd97fa640 1 -- 172.21.15.73:0/1266195249 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcccc00c820 con 0x7fccc8005250 2023-12-12T09:46:47.086 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:47.082+0000 7fcce25a9640 1 -- 172.21.15.73:0/1266195249 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fccdc0a9560 con 0x7fccc8005250 2023-12-12T09:46:47.086 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:47.082+0000 7fccd97fa640 1 -- 172.21.15.73:0/1266195249 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcccc00cbd0 con 0x7fccc8005250 2023-12-12T09:46:47.086 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:47.082+0000 7fcce25a9640 1 -- 172.21.15.73:0/1266195249 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fccdc154090 con 0x7fccc8005250 2023-12-12T09:46:47.086 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:47.083+0000 7fcce25a9640 1 -- 172.21.15.73:0/1266195249 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fccdc0bf5a0 con 0x7fccc8005250 2023-12-12T09:46:47.087 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:47.084+0000 7fccd97fa640 1 -- 172.21.15.73:0/1266195249 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fcccc00cd30 con 0x7fccc8005250 2023-12-12T09:46:47.087 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:47.085+0000 7fccd97fa640 1 --2- 172.21.15.73:0/1266195249 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fccbc06ae40 0x7fccbc06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:47.087 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:47.085+0000 7fccd97fa640 1 -- 172.21.15.73:0/1266195249 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fcccc089830 con 0x7fccc8005250 2023-12-12T09:46:47.087 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:47.086+0000 7fccd3fff640 1 --2- 172.21.15.73:0/1266195249 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fccbc06ae40 0x7fccbc06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:47.087 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:47.086+0000 7fccd3fff640 1 --2- 172.21.15.73:0/1266195249 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fccbc06ae40 0x7fccbc06d300 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fccdc1524d0 tx=0x7fccc4009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:46:47.091 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:47.090+0000 7fccd97fa640 1 -- 172.21.15.73:0/1266195249 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fcccc054570 con 0x7fccc8005250 2023-12-12T09:46:47.278 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:47.276+0000 7fcce25a9640 1 -- 172.21.15.73:0/1266195249 --> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fccdc0c1ff0 con 0x7fccbc06ae40 2023-12-12T09:46:47.320 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:47.318+0000 7fccd97fa640 1 -- 172.21.15.73:0/1266195249 <== mgr.4110 v2:172.21.15.73:6832/779985841 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+525809 (secure 0 0 0) 0x7fccc400d440 con 0x7fccbc06ae40 2023-12-12T09:46:47.327 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-12T09:46:47.331 INFO:teuthology.orchestra.run.smithi073.stderr:dumped all 2023-12-12T09:46:47.332 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:47.326+0000 7fcce25a9640 1 -- 172.21.15.73:0/1266195249 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fccbc06ae40 msgr2=0x7fccbc06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:47.333 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:47.326+0000 7fcce25a9640 1 --2- 172.21.15.73:0/1266195249 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fccbc06ae40 0x7fccbc06d300 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fccdc1524d0 tx=0x7fccc4009040 comp rx=0 tx=0).stop 2023-12-12T09:46:47.333 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:47.326+0000 7fcce25a9640 1 -- 172.21.15.73:0/1266195249 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fccc8005250 msgr2=0x7fccdc0a6b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:47.333 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:47.326+0000 7fcce25a9640 1 --2- 172.21.15.73:0/1266195249 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fccc8005250 0x7fccdc0a6b40 secure :-1 s=READY pgs=942 cs=0 l=1 rev1=1 crypto rx=0x7fcccc00e730 tx=0x7fcccc00ebf0 comp rx=0 tx=0).stop 2023-12-12T09:46:47.333 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:47.326+0000 7fcce25a9640 1 -- 172.21.15.73:0/1266195249 shutdown_connections 2023-12-12T09:46:47.333 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:47.326+0000 7fcce25a9640 1 --2- 172.21.15.73:0/1266195249 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fccbc06ae40 0x7fccbc06d300 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:47.333 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:47.326+0000 7fcce25a9640 1 --2- 172.21.15.73:0/1266195249 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fccdc0a9d60 0x7fccdc1ed2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:47.333 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:47.326+0000 7fcce25a9640 1 --2- 172.21.15.73:0/1266195249 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fccdc150e70 0x7fccdc070160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:47.333 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:47.326+0000 7fcce25a9640 1 --2- 172.21.15.73:0/1266195249 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fccc8005250 0x7fccdc0a6b40 unknown :-1 s=CLOSED pgs=942 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:47.333 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:47.326+0000 7fcce25a9640 1 -- 172.21.15.73:0/1266195249 >> 172.21.15.73:0/1266195249 conn(0x7fccdc0a8130 msgr2=0x7fccdc0c4980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:46:47.333 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:47.327+0000 7fcce25a9640 1 -- 172.21.15.73:0/1266195249 shutdown_connections 2023-12-12T09:46:47.333 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:47.327+0000 7fcce25a9640 1 -- 172.21.15.73:0/1266195249 wait complete. 2023-12-12T09:46:47.349 INFO:teuthology.orchestra.run.smithi073.stdout:{"pg_ready":true,"pg_map":{"version":178,"stamp":"2023-12-12T09:46:45.523091+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":596683,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":251,"num_write_kb":2447,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":27,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":197,"ondisk_log_size":197,"up":386,"acting":386,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":301,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":257280,"kb_used_data":7840,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754717440,"statfs":{"total":773094113280,"available":772830658560,"internally_reserved":0,"allocated":8028160,"data_stored":4668982,"data_compressed":64844,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":12752,"internal_metadata":255315504},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":40,"apply_latency_ms":40,"commit_latency_ns":40000000,"apply_latency_ns":40000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.202197"},"pg_stats":[{"pgid":"15.3d","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-12T09:46:43.304227+0000","last_change":"2023-12-12T09:46:42.333998+0000","last_active":"2023-12-12T09:46:43.304227+0000","last_peered":"2023-12-12T09:46:43.304227+0000","last_clean":"2023-12-12T09:46:43.304227+0000","last_became_active":"2023-12-12T09:46:42.333731+0000","last_became_peered":"2023-12-12T09:46:42.333731+0000","last_unstale":"2023-12-12T09:46:43.304227+0000","last_undegraded":"2023-12-12T09:46:43.304227+0000","last_fullsized":"2023-12-12T09:46:43.304227+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:41.318400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:41.318400+0000","last_clean_scrub_stamp":"2023-12-12T09:46:41.318400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T20:26:22.728923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.3f","version":"0'0","reported_seq":15,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-12-12T09:46:42.309684+0000","last_change":"2023-12-12T09:46:26.986790+0000","last_active":"2023-12-12T09:46:42.309684+0000","last_peered":"2023-12-12T09:46:42.309684+0000","last_clean":"2023-12-12T09:46:42.309684+0000","last_became_active":"2023-12-12T09:46:26.986521+0000","last_became_peered":"2023-12-12T09:46:26.986521+0000","last_unstale":"2023-12-12T09:46:42.309684+0000","last_undegraded":"2023-12-12T09:46:42.309684+0000","last_fullsized":"2023-12-12T09:46:42.309684+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_clean_scrub_stamp":"2023-12-12T09:46:25.941843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T20:26:07.352366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.3c","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-12T09:46:43.363905+0000","last_change":"2023-12-12T09:46:42.328664+0000","last_active":"2023-12-12T09:46:43.363905+0000","last_peered":"2023-12-12T09:46:43.363905+0000","last_clean":"2023-12-12T09:46:43.363905+0000","last_became_active":"2023-12-12T09:46:42.327737+0000","last_became_peered":"2023-12-12T09:46:42.327737+0000","last_unstale":"2023-12-12T09:46:43.363905+0000","last_undegraded":"2023-12-12T09:46:43.363905+0000","last_fullsized":"2023-12-12T09:46:43.363905+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:41.318400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:41.318400+0000","last_clean_scrub_stamp":"2023-12-12T09:46:41.318400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T21:03:48.285201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.3e","version":"0'0","reported_seq":15,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-12-12T09:46:42.325093+0000","last_change":"2023-12-12T09:46:26.994586+0000","last_active":"2023-12-12T09:46:42.325093+0000","last_peered":"2023-12-12T09:46:42.325093+0000","last_clean":"2023-12-12T09:46:42.325093+0000","last_became_active":"2023-12-12T09:46:26.992156+0000","last_became_peered":"2023-12-12T09:46:26.992156+0000","last_unstale":"2023-12-12T09:46:42.325093+0000","last_undegraded":"2023-12-12T09:46:42.325093+0000","last_fullsized":"2023-12-12T09:46:42.325093+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_clean_scrub_stamp":"2023-12-12T09:46:25.941843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T12:32:03.730411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.3f","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-12T09:46:43.305940+0000","last_change":"2023-12-12T09:46:42.332796+0000","last_active":"2023-12-12T09:46:43.305940+0000","last_peered":"2023-12-12T09:46:43.305940+0000","last_clean":"2023-12-12T09:46:43.305940+0000","last_became_active":"2023-12-12T09:46:42.332507+0000","last_became_peered":"2023-12-12T09:46:42.332507+0000","last_unstale":"2023-12-12T09:46:43.305940+0000","last_undegraded":"2023-12-12T09:46:43.305940+0000","last_fullsized":"2023-12-12T09:46:43.305940+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:41.318400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:41.318400+0000","last_clean_scrub_stamp":"2023-12-12T09:46:41.318400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T15:28:19.918670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.3d","version":"0'0","reported_seq":15,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-12-12T09:46:42.315636+0000","last_change":"2023-12-12T09:46:26.991707+0000","last_active":"2023-12-12T09:46:42.315636+0000","last_peered":"2023-12-12T09:46:42.315636+0000","last_clean":"2023-12-12T09:46:42.315636+0000","last_became_active":"2023-12-12T09:46:26.991218+0000","last_became_peered":"2023-12-12T09:46:26.991218+0000","last_unstale":"2023-12-12T09:46:42.315636+0000","last_undegraded":"2023-12-12T09:46:42.315636+0000","last_fullsized":"2023-12-12T09:46:42.315636+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_clean_scrub_stamp":"2023-12-12T09:46:25.941843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T18:32:42.868149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.3e","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-12T09:46:43.360721+0000","last_change":"2023-12-12T09:46:42.335789+0000","last_active":"2023-12-12T09:46:43.360721+0000","last_peered":"2023-12-12T09:46:43.360721+0000","last_clean":"2023-12-12T09:46:43.360721+0000","last_became_active":"2023-12-12T09:46:42.334735+0000","last_became_peered":"2023-12-12T09:46:42.334735+0000","last_unstale":"2023-12-12T09:46:43.360721+0000","last_undegraded":"2023-12-12T09:46:43.360721+0000","last_fullsized":"2023-12-12T09:46:43.360721+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:41.318400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:41.318400+0000","last_clean_scrub_stamp":"2023-12-12T09:46:41.318400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T15:21:10.130436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.3c","version":"0'0","reported_seq":15,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-12-12T09:46:42.302064+0000","last_change":"2023-12-12T09:46:26.999270+0000","last_active":"2023-12-12T09:46:42.302064+0000","last_peered":"2023-12-12T09:46:42.302064+0000","last_clean":"2023-12-12T09:46:42.302064+0000","last_became_active":"2023-12-12T09:46:26.998982+0000","last_became_peered":"2023-12-12T09:46:26.998982+0000","last_unstale":"2023-12-12T09:46:42.302064+0000","last_undegraded":"2023-12-12T09:46:42.302064+0000","last_fullsized":"2023-12-12T09:46:42.302064+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_clean_scrub_stamp":"2023-12-12T09:46:25.941843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T19:41:17.087778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.39","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-12T09:46:43.355365+0000","last_change":"2023-12-12T09:46:42.333969+0000","last_active":"2023-12-12T09:46:43.355365+0000","last_peered":"2023-12-12T09:46:43.355365+0000","last_clean":"2023-12-12T09:46:43.355365+0000","last_became_active":"2023-12-12T09:46:42.333674+0000","last_became_peered":"2023-12-12T09:46:42.333674+0000","last_unstale":"2023-12-12T09:46:43.355365+0000","last_undegraded":"2023-12-12T09:46:43.355365+0000","last_fullsized":"2023-12-12T09:46:43.355365+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:41.318400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:41.318400+0000","last_clean_scrub_stamp":"2023-12-12T09:46:41.318400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T12:23:44.780206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.3b","version":"0'0","reported_seq":15,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-12-12T09:46:42.318602+0000","last_change":"2023-12-12T09:46:26.990528+0000","last_active":"2023-12-12T09:46:42.318602+0000","last_peered":"2023-12-12T09:46:42.318602+0000","last_clean":"2023-12-12T09:46:42.318602+0000","last_became_active":"2023-12-12T09:46:26.990258+0000","last_became_peered":"2023-12-12T09:46:26.990258+0000","last_unstale":"2023-12-12T09:46:42.318602+0000","last_undegraded":"2023-12-12T09:46:42.318602+0000","last_fullsized":"2023-12-12T09:46:42.318602+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_clean_scrub_stamp":"2023-12-12T09:46:25.941843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T17:36:25.591354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.38","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-12T09:46:43.357062+0000","last_change":"2023-12-12T09:46:42.328639+0000","last_active":"2023-12-12T09:46:43.357062+0000","last_peered":"2023-12-12T09:46:43.357062+0000","last_clean":"2023-12-12T09:46:43.357062+0000","last_became_active":"2023-12-12T09:46:42.327817+0000","last_became_peered":"2023-12-12T09:46:42.327817+0000","last_unstale":"2023-12-12T09:46:43.357062+0000","last_undegraded":"2023-12-12T09:46:43.357062+0000","last_fullsized":"2023-12-12T09:46:43.357062+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:41.318400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:41.318400+0000","last_clean_scrub_stamp":"2023-12-12T09:46:41.318400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T20:13:59.695918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.3a","version":"0'0","reported_seq":15,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-12-12T09:46:42.307396+0000","last_change":"2023-12-12T09:46:26.981697+0000","last_active":"2023-12-12T09:46:42.307396+0000","last_peered":"2023-12-12T09:46:42.307396+0000","last_clean":"2023-12-12T09:46:42.307396+0000","last_became_active":"2023-12-12T09:46:26.981332+0000","last_became_peered":"2023-12-12T09:46:26.981332+0000","last_unstale":"2023-12-12T09:46:42.307396+0000","last_undegraded":"2023-12-12T09:46:42.307396+0000","last_fullsized":"2023-12-12T09:46:42.307396+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_clean_scrub_stamp":"2023-12-12T09:46:25.941843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T12:20:23.121255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.3b","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-12T09:46:43.356095+0000","last_change":"2023-12-12T09:46:42.323995+0000","last_active":"2023-12-12T09:46:43.356095+0000","last_peered":"2023-12-12T09:46:43.356095+0000","last_clean":"2023-12-12T09:46:43.356095+0000","last_became_active":"2023-12-12T09:46:42.323658+0000","last_became_peered":"2023-12-12T09:46:42.323658+0000","last_unstale":"2023-12-12T09:46:43.356095+0000","last_undegraded":"2023-12-12T09:46:43.356095+0000","last_fullsized":"2023-12-12T09:46:43.356095+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:41.318400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:41.318400+0000","last_clean_scrub_stamp":"2023-12-12T09:46:41.318400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T14:19:02.287407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.39","version":"0'0","reported_seq":15,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-12-12T09:46:42.301512+0000","last_change":"2023-12-12T09:46:26.979578+0000","last_active":"2023-12-12T09:46:42.301512+0000","last_peered":"2023-12-12T09:46:42.301512+0000","last_clean":"2023-12-12T09:46:42.301512+0000","last_became_active":"2023-12-12T09:46:26.978875+0000","last_became_peered":"2023-12-12T09:46:26.978875+0000","last_unstale":"2023-12-12T09:46:42.301512+0000","last_undegraded":"2023-12-12T09:46:42.301512+0000","last_fullsized":"2023-12-12T09:46:42.301512+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_clean_scrub_stamp":"2023-12-12T09:46:25.941843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T21:36:15.290518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.3a","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-12T09:46:43.360616+0000","last_change":"2023-12-12T09:46:42.333037+0000","last_active":"2023-12-12T09:46:43.360616+0000","last_peered":"2023-12-12T09:46:43.360616+0000","last_clean":"2023-12-12T09:46:43.360616+0000","last_became_active":"2023-12-12T09:46:42.332743+0000","last_became_peered":"2023-12-12T09:46:42.332743+0000","last_unstale":"2023-12-12T09:46:43.360616+0000","last_undegraded":"2023-12-12T09:46:43.360616+0000","last_fullsized":"2023-12-12T09:46:43.360616+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:41.318400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:41.318400+0000","last_clean_scrub_stamp":"2023-12-12T09:46:41.318400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T21:03:48.285201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.38","version":"0'0","reported_seq":15,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-12-12T09:46:42.303896+0000","last_change":"2023-12-12T09:46:26.984339+0000","last_active":"2023-12-12T09:46:42.303896+0000","last_peered":"2023-12-12T09:46:42.303896+0000","last_clean":"2023-12-12T09:46:42.303896+0000","last_became_active":"2023-12-12T09:46:26.984045+0000","last_became_peered":"2023-12-12T09:46:26.984045+0000","last_unstale":"2023-12-12T09:46:42.303896+0000","last_undegraded":"2023-12-12T09:46:42.303896+0000","last_fullsized":"2023-12-12T09:46:42.303896+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_clean_scrub_stamp":"2023-12-12T09:46:25.941843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T12:26:40.737272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.35","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-12T09:46:43.360813+0000","last_change":"2023-12-12T09:46:42.338016+0000","last_active":"2023-12-12T09:46:43.360813+0000","last_peered":"2023-12-12T09:46:43.360813+0000","last_clean":"2023-12-12T09:46:43.360813+0000","last_became_active":"2023-12-12T09:46:42.335842+0000","last_became_peered":"2023-12-12T09:46:42.335842+0000","last_unstale":"2023-12-12T09:46:43.360813+0000","last_undegraded":"2023-12-12T09:46:43.360813+0000","last_fullsized":"2023-12-12T09:46:43.360813+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:41.318400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:41.318400+0000","last_clean_scrub_stamp":"2023-12-12T09:46:41.318400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T20:25:43.200693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.37","version":"0'0","reported_seq":15,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-12-12T09:46:42.310414+0000","last_change":"2023-12-12T09:46:26.974651+0000","last_active":"2023-12-12T09:46:42.310414+0000","last_peered":"2023-12-12T09:46:42.310414+0000","last_clean":"2023-12-12T09:46:42.310414+0000","last_became_active":"2023-12-12T09:46:26.968979+0000","last_became_peered":"2023-12-12T09:46:26.968979+0000","last_unstale":"2023-12-12T09:46:42.310414+0000","last_undegraded":"2023-12-12T09:46:42.310414+0000","last_fullsized":"2023-12-12T09:46:42.310414+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_clean_scrub_stamp":"2023-12-12T09:46:25.941843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T20:02:31.855316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.34","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-12T09:46:43.307933+0000","last_change":"2023-12-12T09:46:42.339487+0000","last_active":"2023-12-12T09:46:43.307933+0000","last_peered":"2023-12-12T09:46:43.307933+0000","last_clean":"2023-12-12T09:46:43.307933+0000","last_became_active":"2023-12-12T09:46:42.339175+0000","last_became_peered":"2023-12-12T09:46:42.339175+0000","last_unstale":"2023-12-12T09:46:43.307933+0000","last_undegraded":"2023-12-12T09:46:43.307933+0000","last_fullsized":"2023-12-12T09:46:43.307933+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:41.318400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:41.318400+0000","last_clean_scrub_stamp":"2023-12-12T09:46:41.318400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T20:16:33.054008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.36","version":"0'0","reported_seq":15,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-12-12T09:46:42.307045+0000","last_change":"2023-12-12T09:46:26.987761+0000","last_active":"2023-12-12T09:46:42.307045+0000","last_peered":"2023-12-12T09:46:42.307045+0000","last_clean":"2023-12-12T09:46:42.307045+0000","last_became_active":"2023-12-12T09:46:26.987451+0000","last_became_peered":"2023-12-12T09:46:26.987451+0000","last_unstale":"2023-12-12T09:46:42.307045+0000","last_undegraded":"2023-12-12T09:46:42.307045+0000","last_fullsized":"2023-12-12T09:46:42.307045+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_clean_scrub_stamp":"2023-12-12T09:46:25.941843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T20:38:58.730158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.37","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-12T09:46:43.308606+0000","last_change":"2023-12-12T09:46:42.336324+0000","last_active":"2023-12-12T09:46:43.308606+0000","last_peered":"2023-12-12T09:46:43.308606+0000","last_clean":"2023-12-12T09:46:43.308606+0000","last_became_active":"2023-12-12T09:46:42.335756+0000","last_became_peered":"2023-12-12T09:46:42.335756+0000","last_unstale":"2023-12-12T09:46:43.308606+0000","last_undegraded":"2023-12-12T09:46:43.308606+0000","last_fullsized":"2023-12-12T09:46:43.308606+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:41.318400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:41.318400+0000","last_clean_scrub_stamp":"2023-12-12T09:46:41.318400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T11:39:26.274387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.35","version":"0'0","reported_seq":15,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-12-12T09:46:42.326411+0000","last_change":"2023-12-12T09:46:26.988570+0000","last_active":"2023-12-12T09:46:42.326411+0000","last_peered":"2023-12-12T09:46:42.326411+0000","last_clean":"2023-12-12T09:46:42.326411+0000","last_became_active":"2023-12-12T09:46:26.987191+0000","last_became_peered":"2023-12-12T09:46:26.987191+0000","last_unstale":"2023-12-12T09:46:42.326411+0000","last_undegraded":"2023-12-12T09:46:42.326411+0000","last_fullsized":"2023-12-12T09:46:42.326411+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_clean_scrub_stamp":"2023-12-12T09:46:25.941843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T10:13:37.646793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.36","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-12T09:46:43.358948+0000","last_change":"2023-12-12T09:46:42.333600+0000","last_active":"2023-12-12T09:46:43.358948+0000","last_peered":"2023-12-12T09:46:43.358948+0000","last_clean":"2023-12-12T09:46:43.358948+0000","last_became_active":"2023-12-12T09:46:42.333341+0000","last_became_peered":"2023-12-12T09:46:42.333341+0000","last_unstale":"2023-12-12T09:46:43.358948+0000","last_undegraded":"2023-12-12T09:46:43.358948+0000","last_fullsized":"2023-12-12T09:46:43.358948+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:41.318400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:41.318400+0000","last_clean_scrub_stamp":"2023-12-12T09:46:41.318400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T20:13:59.695918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.34","version":"0'0","reported_seq":15,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-12-12T09:46:42.306844+0000","last_change":"2023-12-12T09:46:26.986289+0000","last_active":"2023-12-12T09:46:42.306844+0000","last_peered":"2023-12-12T09:46:42.306844+0000","last_clean":"2023-12-12T09:46:42.306844+0000","last_became_active":"2023-12-12T09:46:26.986031+0000","last_became_peered":"2023-12-12T09:46:26.986031+0000","last_unstale":"2023-12-12T09:46:42.306844+0000","last_undegraded":"2023-12-12T09:46:42.306844+0000","last_fullsized":"2023-12-12T09:46:42.306844+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_clean_scrub_stamp":"2023-12-12T09:46:25.941843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T18:11:05.080156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.31","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-12T09:46:43.359593+0000","last_change":"2023-12-12T09:46:42.339307+0000","last_active":"2023-12-12T09:46:43.359593+0000","last_peered":"2023-12-12T09:46:43.359593+0000","last_clean":"2023-12-12T09:46:43.359593+0000","last_became_active":"2023-12-12T09:46:42.338365+0000","last_became_peered":"2023-12-12T09:46:42.338365+0000","last_unstale":"2023-12-12T09:46:43.359593+0000","last_undegraded":"2023-12-12T09:46:43.359593+0000","last_fullsized":"2023-12-12T09:46:43.359593+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:41.318400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:41.318400+0000","last_clean_scrub_stamp":"2023-12-12T09:46:41.318400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T12:23:44.780206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.33","version":"0'0","reported_seq":15,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-12-12T09:46:42.312709+0000","last_change":"2023-12-12T09:46:26.985914+0000","last_active":"2023-12-12T09:46:42.312709+0000","last_peered":"2023-12-12T09:46:42.312709+0000","last_clean":"2023-12-12T09:46:42.312709+0000","last_became_active":"2023-12-12T09:46:26.985636+0000","last_became_peered":"2023-12-12T09:46:26.985636+0000","last_unstale":"2023-12-12T09:46:42.312709+0000","last_undegraded":"2023-12-12T09:46:42.312709+0000","last_fullsized":"2023-12-12T09:46:42.312709+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_clean_scrub_stamp":"2023-12-12T09:46:25.941843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T15:01:39.944049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.30","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-12T09:46:43.357410+0000","last_change":"2023-12-12T09:46:42.330278+0000","last_active":"2023-12-12T09:46:43.357410+0000","last_peered":"2023-12-12T09:46:43.357410+0000","last_clean":"2023-12-12T09:46:43.357410+0000","last_became_active":"2023-12-12T09:46:42.329590+0000","last_became_peered":"2023-12-12T09:46:42.329590+0000","last_unstale":"2023-12-12T09:46:43.357410+0000","last_undegraded":"2023-12-12T09:46:43.357410+0000","last_fullsized":"2023-12-12T09:46:43.357410+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:41.318400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:41.318400+0000","last_clean_scrub_stamp":"2023-12-12T09:46:41.318400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T11:39:26.274387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.32","version":"0'0","reported_seq":15,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-12-12T09:46:42.308058+0000","last_change":"2023-12-12T09:46:26.998495+0000","last_active":"2023-12-12T09:46:42.308058+0000","last_peered":"2023-12-12T09:46:42.308058+0000","last_clean":"2023-12-12T09:46:42.308058+0000","last_became_active":"2023-12-12T09:46:26.997702+0000","last_became_peered":"2023-12-12T09:46:26.997702+0000","last_unstale":"2023-12-12T09:46:42.308058+0000","last_undegraded":"2023-12-12T09:46:42.308058+0000","last_fullsized":"2023-12-12T09:46:42.308058+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_clean_scrub_stamp":"2023-12-12T09:46:25.941843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T21:12:40.750775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.33","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-12T09:46:43.364885+0000","last_change":"2023-12-12T09:46:42.329894+0000","last_active":"2023-12-12T09:46:43.364885+0000","last_peered":"2023-12-12T09:46:43.364885+0000","last_clean":"2023-12-12T09:46:43.364885+0000","last_became_active":"2023-12-12T09:46:42.329613+0000","last_became_peered":"2023-12-12T09:46:42.329613+0000","last_unstale":"2023-12-12T09:46:43.364885+0000","last_undegraded":"2023-12-12T09:46:43.364885+0000","last_fullsized":"2023-12-12T09:46:43.364885+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:41.318400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:41.318400+0000","last_clean_scrub_stamp":"2023-12-12T09:46:41.318400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T17:18:54.779024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.31","version":"0'0","reported_seq":15,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-12-12T09:46:42.316240+0000","last_change":"2023-12-12T09:46:26.987237+0000","last_active":"2023-12-12T09:46:42.316240+0000","last_peered":"2023-12-12T09:46:42.316240+0000","last_clean":"2023-12-12T09:46:42.316240+0000","last_became_active":"2023-12-12T09:46:26.985751+0000","last_became_peered":"2023-12-12T09:46:26.985751+0000","last_unstale":"2023-12-12T09:46:42.316240+0000","last_undegraded":"2023-12-12T09:46:42.316240+0000","last_fullsized":"2023-12-12T09:46:42.316240+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_clean_scrub_stamp":"2023-12-12T09:46:25.941843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T11:42:15.823462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.32","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-12T09:46:43.357934+0000","last_change":"2023-12-12T09:46:42.315983+0000","last_active":"2023-12-12T09:46:43.357934+0000","last_peered":"2023-12-12T09:46:43.357934+0000","last_clean":"2023-12-12T09:46:43.357934+0000","last_became_active":"2023-12-12T09:46:42.315596+0000","last_became_peered":"2023-12-12T09:46:42.315596+0000","last_unstale":"2023-12-12T09:46:43.357934+0000","last_undegraded":"2023-12-12T09:46:43.357934+0000","last_fullsized":"2023-12-12T09:46:43.357934+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:41.318400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:41.318400+0000","last_clean_scrub_stamp":"2023-12-12T09:46:41.318400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T17:36:40.967911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.30","version":"0'0","reported_seq":15,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-12-12T09:46:42.317815+0000","last_change":"2023-12-12T09:46:26.984939+0000","last_active":"2023-12-12T09:46:42.317815+0000","last_peered":"2023-12-12T09:46:42.317815+0000","last_clean":"2023-12-12T09:46:42.317815+0000","last_became_active":"2023-12-12T09:46:26.984654+0000","last_became_peered":"2023-12-12T09:46:26.984654+0000","last_unstale":"2023-12-12T09:46:42.317815+0000","last_undegraded":"2023-12-12T09:46:42.317815+0000","last_fullsized":"2023-12-12T09:46:42.317815+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_clean_scrub_stamp":"2023-12-12T09:46:25.941843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T20:27:55.483605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.2d","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-12T09:46:43.361736+0000","last_change":"2023-12-12T09:46:42.333163+0000","last_active":"2023-12-12T09:46:43.361736+0000","last_peered":"2023-12-12T09:46:43.361736+0000","last_clean":"2023-12-12T09:46:43.361736+0000","last_became_active":"2023-12-12T09:46:42.332832+0000","last_became_peered":"2023-12-12T09:46:42.332832+0000","last_unstale":"2023-12-12T09:46:43.361736+0000","last_undegraded":"2023-12-12T09:46:43.361736+0000","last_fullsized":"2023-12-12T09:46:43.361736+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:41.318400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:41.318400+0000","last_clean_scrub_stamp":"2023-12-12T09:46:41.318400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T14:34:14.641683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2f","version":"0'0","reported_seq":15,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-12-12T09:46:42.326424+0000","last_change":"2023-12-12T09:46:26.986814+0000","last_active":"2023-12-12T09:46:42.326424+0000","last_peered":"2023-12-12T09:46:42.326424+0000","last_clean":"2023-12-12T09:46:42.326424+0000","last_became_active":"2023-12-12T09:46:26.985778+0000","last_became_peered":"2023-12-12T09:46:26.985778+0000","last_unstale":"2023-12-12T09:46:42.326424+0000","last_undegraded":"2023-12-12T09:46:42.326424+0000","last_fullsized":"2023-12-12T09:46:42.326424+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_clean_scrub_stamp":"2023-12-12T09:46:25.941843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T18:32:42.868149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.2c","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-12T09:46:43.307876+0000","last_change":"2023-12-12T09:46:42.337803+0000","last_active":"2023-12-12T09:46:43.307876+0000","last_peered":"2023-12-12T09:46:43.307876+0000","last_clean":"2023-12-12T09:46:43.307876+0000","last_became_active":"2023-12-12T09:46:42.335727+0000","last_became_peered":"2023-12-12T09:46:42.335727+0000","last_unstale":"2023-12-12T09:46:43.307876+0000","last_undegraded":"2023-12-12T09:46:43.307876+0000","last_fullsized":"2023-12-12T09:46:43.307876+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:41.318400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:41.318400+0000","last_clean_scrub_stamp":"2023-12-12T09:46:41.318400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T18:51:52.951124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2e","version":"0'0","reported_seq":15,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-12-12T09:46:42.303852+0000","last_change":"2023-12-12T09:46:26.990577+0000","last_active":"2023-12-12T09:46:42.303852+0000","last_peered":"2023-12-12T09:46:42.303852+0000","last_clean":"2023-12-12T09:46:42.303852+0000","last_became_active":"2023-12-12T09:46:26.990043+0000","last_became_peered":"2023-12-12T09:46:26.990043+0000","last_unstale":"2023-12-12T09:46:42.303852+0000","last_undegraded":"2023-12-12T09:46:42.303852+0000","last_fullsized":"2023-12-12T09:46:42.303852+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_clean_scrub_stamp":"2023-12-12T09:46:25.941843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T15:36:13.603009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2f","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-12T09:46:43.360804+0000","last_change":"2023-12-12T09:46:42.328847+0000","last_active":"2023-12-12T09:46:43.360804+0000","last_peered":"2023-12-12T09:46:43.360804+0000","last_clean":"2023-12-12T09:46:43.360804+0000","last_became_active":"2023-12-12T09:46:42.328551+0000","last_became_peered":"2023-12-12T09:46:42.328551+0000","last_unstale":"2023-12-12T09:46:43.360804+0000","last_undegraded":"2023-12-12T09:46:43.360804+0000","last_fullsized":"2023-12-12T09:46:43.360804+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:41.318400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:41.318400+0000","last_clean_scrub_stamp":"2023-12-12T09:46:41.318400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T19:59:31.204008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.2d","version":"0'0","reported_seq":15,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-12-12T09:46:42.323513+0000","last_change":"2023-12-12T09:46:26.981798+0000","last_active":"2023-12-12T09:46:42.323513+0000","last_peered":"2023-12-12T09:46:42.323513+0000","last_clean":"2023-12-12T09:46:42.323513+0000","last_became_active":"2023-12-12T09:46:26.981531+0000","last_became_peered":"2023-12-12T09:46:26.981531+0000","last_unstale":"2023-12-12T09:46:42.323513+0000","last_undegraded":"2023-12-12T09:46:42.323513+0000","last_fullsized":"2023-12-12T09:46:42.323513+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_clean_scrub_stamp":"2023-12-12T09:46:25.941843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T16:03:22.088223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.2e","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-12T09:46:43.364698+0000","last_change":"2023-12-12T09:46:42.320222+0000","last_active":"2023-12-12T09:46:43.364698+0000","last_peered":"2023-12-12T09:46:43.364698+0000","last_clean":"2023-12-12T09:46:43.364698+0000","last_became_active":"2023-12-12T09:46:42.319940+0000","last_became_peered":"2023-12-12T09:46:42.319940+0000","last_unstale":"2023-12-12T09:46:43.364698+0000","last_undegraded":"2023-12-12T09:46:43.364698+0000","last_fullsized":"2023-12-12T09:46:43.364698+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:41.318400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:41.318400+0000","last_clean_scrub_stamp":"2023-12-12T09:46:41.318400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T20:25:43.200693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.2c","version":"0'0","reported_seq":15,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-12-12T09:46:42.302105+0000","last_change":"2023-12-12T09:46:26.992419+0000","last_active":"2023-12-12T09:46:42.302105+0000","last_peered":"2023-12-12T09:46:42.302105+0000","last_clean":"2023-12-12T09:46:42.302105+0000","last_became_active":"2023-12-12T09:46:26.992204+0000","last_became_peered":"2023-12-12T09:46:26.992204+0000","last_unstale":"2023-12-12T09:46:42.302105+0000","last_undegraded":"2023-12-12T09:46:42.302105+0000","last_fullsized":"2023-12-12T09:46:42.302105+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_clean_scrub_stamp":"2023-12-12T09:46:25.941843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T20:27:08.735156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.29","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-12T09:46:43.357722+0000","last_change":"2023-12-12T09:46:42.333995+0000","last_active":"2023-12-12T09:46:43.357722+0000","last_peered":"2023-12-12T09:46:43.357722+0000","last_clean":"2023-12-12T09:46:43.357722+0000","last_became_active":"2023-12-12T09:46:42.333677+0000","last_became_peered":"2023-12-12T09:46:42.333677+0000","last_unstale":"2023-12-12T09:46:43.357722+0000","last_undegraded":"2023-12-12T09:46:43.357722+0000","last_fullsized":"2023-12-12T09:46:43.357722+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:41.318400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:41.318400+0000","last_clean_scrub_stamp":"2023-12-12T09:46:41.318400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T20:22:27.576869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.2b","version":"0'0","reported_seq":15,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-12-12T09:46:42.301901+0000","last_change":"2023-12-12T09:46:26.994981+0000","last_active":"2023-12-12T09:46:42.301901+0000","last_peered":"2023-12-12T09:46:42.301901+0000","last_clean":"2023-12-12T09:46:42.301901+0000","last_became_active":"2023-12-12T09:46:26.993637+0000","last_became_peered":"2023-12-12T09:46:26.993637+0000","last_unstale":"2023-12-12T09:46:42.301901+0000","last_undegraded":"2023-12-12T09:46:42.301901+0000","last_fullsized":"2023-12-12T09:46:42.301901+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_clean_scrub_stamp":"2023-12-12T09:46:25.941843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T17:22:17.059887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.28","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-12T09:46:43.358178+0000","last_change":"2023-12-12T09:46:42.330453+0000","last_active":"2023-12-12T09:46:43.358178+0000","last_peered":"2023-12-12T09:46:43.358178+0000","last_clean":"2023-12-12T09:46:43.358178+0000","last_became_active":"2023-12-12T09:46:42.329978+0000","last_became_peered":"2023-12-12T09:46:42.329978+0000","last_unstale":"2023-12-12T09:46:43.358178+0000","last_undegraded":"2023-12-12T09:46:43.358178+0000","last_fullsized":"2023-12-12T09:46:43.358178+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:41.318400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:41.318400+0000","last_clean_scrub_stamp":"2023-12-12T09:46:41.318400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T20:54:15.640711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.2a","version":"0'0","reported_seq":15,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-12-12T09:46:42.331726+0000","last_change":"2023-12-12T09:46:27.001420+0000","last_active":"2023-12-12T09:46:42.331726+0000","last_peered":"2023-12-12T09:46:42.331726+0000","last_clean":"2023-12-12T09:46:42.331726+0000","last_became_active":"2023-12-12T09:46:27.001157+0000","last_became_peered":"2023-12-12T09:46:27.001157+0000","last_unstale":"2023-12-12T09:46:42.331726+0000","last_undegraded":"2023-12-12T09:46:42.331726+0000","last_fullsized":"2023-12-12T09:46:42.331726+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_clean_scrub_stamp":"2023-12-12T09:46:25.941843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T18:47:51.982188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.2b","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-12T09:46:43.357971+0000","last_change":"2023-12-12T09:46:42.332324+0000","last_active":"2023-12-12T09:46:43.357971+0000","last_peered":"2023-12-12T09:46:43.357971+0000","last_clean":"2023-12-12T09:46:43.357971+0000","last_became_active":"2023-12-12T09:46:42.325055+0000","last_became_peered":"2023-12-12T09:46:42.325055+0000","last_unstale":"2023-12-12T09:46:43.357971+0000","last_undegraded":"2023-12-12T09:46:43.357971+0000","last_fullsized":"2023-12-12T09:46:43.357971+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:41.318400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:41.318400+0000","last_clean_scrub_stamp":"2023-12-12T09:46:41.318400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T11:46:53.306744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.29","version":"0'0","reported_seq":15,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-12-12T09:46:42.305255+0000","last_change":"2023-12-12T09:46:26.998244+0000","last_active":"2023-12-12T09:46:42.305255+0000","last_peered":"2023-12-12T09:46:42.305255+0000","last_clean":"2023-12-12T09:46:42.305255+0000","last_became_active":"2023-12-12T09:46:26.997924+0000","last_became_peered":"2023-12-12T09:46:26.997924+0000","last_unstale":"2023-12-12T09:46:42.305255+0000","last_undegraded":"2023-12-12T09:46:42.305255+0000","last_fullsized":"2023-12-12T09:46:42.305255+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_clean_scrub_stamp":"2023-12-12T09:46:25.941843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T18:32:42.868149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.2a","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-12T09:46:43.358006+0000","last_change":"2023-12-12T09:46:42.333161+0000","last_active":"2023-12-12T09:46:43.358006+0000","last_peered":"2023-12-12T09:46:43.358006+0000","last_clean":"2023-12-12T09:46:43.358006+0000","last_became_active":"2023-12-12T09:46:42.332858+0000","last_became_peered":"2023-12-12T09:46:42.332858+0000","last_unstale":"2023-12-12T09:46:43.358006+0000","last_undegraded":"2023-12-12T09:46:43.358006+0000","last_fullsized":"2023-12-12T09:46:43.358006+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:41.318400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:41.318400+0000","last_clean_scrub_stamp":"2023-12-12T09:46:41.318400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T19:28:31.222082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.28","version":"0'0","reported_seq":15,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-12-12T09:46:42.301049+0000","last_change":"2023-12-12T09:46:26.995855+0000","last_active":"2023-12-12T09:46:42.301049+0000","last_peered":"2023-12-12T09:46:42.301049+0000","last_clean":"2023-12-12T09:46:42.301049+0000","last_became_active":"2023-12-12T09:46:26.995600+0000","last_became_peered":"2023-12-12T09:46:26.995600+0000","last_unstale":"2023-12-12T09:46:42.301049+0000","last_undegraded":"2023-12-12T09:46:42.301049+0000","last_fullsized":"2023-12-12T09:46:42.301049+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_clean_scrub_stamp":"2023-12-12T09:46:25.941843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T21:34:45.332708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.25","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-12T09:46:43.361612+0000","last_change":"2023-12-12T09:46:42.324822+0000","last_active":"2023-12-12T09:46:43.361612+0000","last_peered":"2023-12-12T09:46:43.361612+0000","last_clean":"2023-12-12T09:46:43.361612+0000","last_became_active":"2023-12-12T09:46:42.324186+0000","last_became_peered":"2023-12-12T09:46:42.324186+0000","last_unstale":"2023-12-12T09:46:43.361612+0000","last_undegraded":"2023-12-12T09:46:43.361612+0000","last_fullsized":"2023-12-12T09:46:43.361612+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:41.318400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:41.318400+0000","last_clean_scrub_stamp":"2023-12-12T09:46:41.318400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T18:26:37.695231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.27","version":"0'0","reported_seq":15,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-12-12T09:46:42.326276+0000","last_change":"2023-12-12T09:46:26.991438+0000","last_active":"2023-12-12T09:46:42.326276+0000","last_peered":"2023-12-12T09:46:42.326276+0000","last_clean":"2023-12-12T09:46:42.326276+0000","last_became_active":"2023-12-12T09:46:26.991186+0000","last_became_peered":"2023-12-12T09:46:26.991186+0000","last_unstale":"2023-12-12T09:46:42.326276+0000","last_undegraded":"2023-12-12T09:46:42.326276+0000","last_fullsized":"2023-12-12T09:46:42.326276+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_clean_scrub_stamp":"2023-12-12T09:46:25.941843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T10:00:12.368441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.24","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-12T09:46:43.358361+0000","last_change":"2023-12-12T09:46:42.322633+0000","last_active":"2023-12-12T09:46:43.358361+0000","last_peered":"2023-12-12T09:46:43.358361+0000","last_clean":"2023-12-12T09:46:43.358361+0000","last_became_active":"2023-12-12T09:46:42.321638+0000","last_became_peered":"2023-12-12T09:46:42.321638+0000","last_unstale":"2023-12-12T09:46:43.358361+0000","last_undegraded":"2023-12-12T09:46:43.358361+0000","last_fullsized":"2023-12-12T09:46:43.358361+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:41.318400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:41.318400+0000","last_clean_scrub_stamp":"2023-12-12T09:46:41.318400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T18:26:37.695231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.26","version":"0'0","reported_seq":15,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-12-12T09:46:42.314097+0000","last_change":"2023-12-12T09:46:26.993487+0000","last_active":"2023-12-12T09:46:42.314097+0000","last_peered":"2023-12-12T09:46:42.314097+0000","last_clean":"2023-12-12T09:46:42.314097+0000","last_became_active":"2023-12-12T09:46:26.991132+0000","last_became_peered":"2023-12-12T09:46:26.991132+0000","last_unstale":"2023-12-12T09:46:42.314097+0000","last_undegraded":"2023-12-12T09:46:42.314097+0000","last_fullsized":"2023-12-12T09:46:42.314097+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_clean_scrub_stamp":"2023-12-12T09:46:25.941843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T18:11:05.080156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.27","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-12T09:46:43.359993+0000","last_change":"2023-12-12T09:46:42.331284+0000","last_active":"2023-12-12T09:46:43.359993+0000","last_peered":"2023-12-12T09:46:43.359993+0000","last_clean":"2023-12-12T09:46:43.359993+0000","last_became_active":"2023-12-12T09:46:42.330881+0000","last_became_peered":"2023-12-12T09:46:42.330881+0000","last_unstale":"2023-12-12T09:46:43.359993+0000","last_undegraded":"2023-12-12T09:46:43.359993+0000","last_fullsized":"2023-12-12T09:46:43.359993+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:41.318400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:41.318400+0000","last_clean_scrub_stamp":"2023-12-12T09:46:41.318400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T19:28:31.222082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.25","version":"0'0","reported_seq":15,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-12-12T09:46:42.327720+0000","last_change":"2023-12-12T09:46:26.980520+0000","last_active":"2023-12-12T09:46:42.327720+0000","last_peered":"2023-12-12T09:46:42.327720+0000","last_clean":"2023-12-12T09:46:42.327720+0000","last_became_active":"2023-12-12T09:46:26.980218+0000","last_became_peered":"2023-12-12T09:46:26.980218+0000","last_unstale":"2023-12-12T09:46:42.327720+0000","last_undegraded":"2023-12-12T09:46:42.327720+0000","last_fullsized":"2023-12-12T09:46:42.327720+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_clean_scrub_stamp":"2023-12-12T09:46:25.941843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T18:11:05.080156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.26","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-12T09:46:43.361232+0000","last_change":"2023-12-12T09:46:42.330594+0000","last_active":"2023-12-12T09:46:43.361232+0000","last_peered":"2023-12-12T09:46:43.361232+0000","last_clean":"2023-12-12T09:46:43.361232+0000","last_became_active":"2023-12-12T09:46:42.329787+0000","last_became_peered":"2023-12-12T09:46:42.329787+0000","last_unstale":"2023-12-12T09:46:43.361232+0000","last_undegraded":"2023-12-12T09:46:43.361232+0000","last_fullsized":"2023-12-12T09:46:43.361232+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:41.318400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:41.318400+0000","last_clean_scrub_stamp":"2023-12-12T09:46:41.318400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T21:04:54.587356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.24","version":"0'0","reported_seq":15,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-12-12T09:46:42.307075+0000","last_change":"2023-12-12T09:46:26.982794+0000","last_active":"2023-12-12T09:46:42.307075+0000","last_peered":"2023-12-12T09:46:42.307075+0000","last_clean":"2023-12-12T09:46:42.307075+0000","last_became_active":"2023-12-12T09:46:26.981602+0000","last_became_peered":"2023-12-12T09:46:26.981602+0000","last_unstale":"2023-12-12T09:46:42.307075+0000","last_undegraded":"2023-12-12T09:46:42.307075+0000","last_fullsized":"2023-12-12T09:46:42.307075+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_clean_scrub_stamp":"2023-12-12T09:46:25.941843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T10:55:01.026545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.21","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-12T09:46:43.359927+0000","last_change":"2023-12-12T09:46:42.328711+0000","last_active":"2023-12-12T09:46:43.359927+0000","last_peered":"2023-12-12T09:46:43.359927+0000","last_clean":"2023-12-12T09:46:43.359927+0000","last_became_active":"2023-12-12T09:46:42.328182+0000","last_became_peered":"2023-12-12T09:46:42.328182+0000","last_unstale":"2023-12-12T09:46:43.359927+0000","last_undegraded":"2023-12-12T09:46:43.359927+0000","last_fullsized":"2023-12-12T09:46:43.359927+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:41.318400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:41.318400+0000","last_clean_scrub_stamp":"2023-12-12T09:46:41.318400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T11:39:26.274387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.23","version":"0'0","reported_seq":15,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-12-12T09:46:42.324517+0000","last_change":"2023-12-12T09:46:26.986416+0000","last_active":"2023-12-12T09:46:42.324517+0000","last_peered":"2023-12-12T09:46:42.324517+0000","last_clean":"2023-12-12T09:46:42.324517+0000","last_became_active":"2023-12-12T09:46:26.986101+0000","last_became_peered":"2023-12-12T09:46:26.986101+0000","last_unstale":"2023-12-12T09:46:42.324517+0000","last_undegraded":"2023-12-12T09:46:42.324517+0000","last_fullsized":"2023-12-12T09:46:42.324517+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_clean_scrub_stamp":"2023-12-12T09:46:25.941843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T13:32:14.660495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.20","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-12T09:46:43.303973+0000","last_change":"2023-12-12T09:46:42.338857+0000","last_active":"2023-12-12T09:46:43.303973+0000","last_peered":"2023-12-12T09:46:43.303973+0000","last_clean":"2023-12-12T09:46:43.303973+0000","last_became_active":"2023-12-12T09:46:42.338593+0000","last_became_peered":"2023-12-12T09:46:42.338593+0000","last_unstale":"2023-12-12T09:46:43.303973+0000","last_undegraded":"2023-12-12T09:46:43.303973+0000","last_fullsized":"2023-12-12T09:46:43.303973+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:41.318400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:41.318400+0000","last_clean_scrub_stamp":"2023-12-12T09:46:41.318400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T16:03:37.464780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.22","version":"0'0","reported_seq":15,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-12-12T09:46:42.331807+0000","last_change":"2023-12-12T09:46:26.991481+0000","last_active":"2023-12-12T09:46:42.331807+0000","last_peered":"2023-12-12T09:46:42.331807+0000","last_clean":"2023-12-12T09:46:42.331807+0000","last_became_active":"2023-12-12T09:46:26.990749+0000","last_became_peered":"2023-12-12T09:46:26.990749+0000","last_unstale":"2023-12-12T09:46:42.331807+0000","last_undegraded":"2023-12-12T09:46:42.331807+0000","last_fullsized":"2023-12-12T09:46:42.331807+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_clean_scrub_stamp":"2023-12-12T09:46:25.941843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T12:43:20.320606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.23","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-12T09:46:43.358416+0000","last_change":"2023-12-12T09:46:42.330092+0000","last_active":"2023-12-12T09:46:43.358416+0000","last_peered":"2023-12-12T09:46:43.358416+0000","last_clean":"2023-12-12T09:46:43.358416+0000","last_became_active":"2023-12-12T09:46:42.329781+0000","last_became_peered":"2023-12-12T09:46:42.329781+0000","last_unstale":"2023-12-12T09:46:43.358416+0000","last_undegraded":"2023-12-12T09:46:43.358416+0000","last_fullsized":"2023-12-12T09:46:43.358416+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:41.318400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:41.318400+0000","last_clean_scrub_stamp":"2023-12-12T09:46:41.318400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T13:16:51.892995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.21","version":"0'0","reported_seq":15,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-12-12T09:46:42.318572+0000","last_change":"2023-12-12T09:46:26.989100+0000","last_active":"2023-12-12T09:46:42.318572+0000","last_peered":"2023-12-12T09:46:42.318572+0000","last_clean":"2023-12-12T09:46:42.318572+0000","last_became_active":"2023-12-12T09:46:26.988781+0000","last_became_peered":"2023-12-12T09:46:26.988781+0000","last_unstale":"2023-12-12T09:46:42.318572+0000","last_undegraded":"2023-12-12T09:46:42.318572+0000","last_fullsized":"2023-12-12T09:46:42.318572+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_clean_scrub_stamp":"2023-12-12T09:46:25.941843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T20:02:31.855316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.22","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-12T09:46:43.358986+0000","last_change":"2023-12-12T09:46:42.333493+0000","last_active":"2023-12-12T09:46:43.358986+0000","last_peered":"2023-12-12T09:46:43.358986+0000","last_clean":"2023-12-12T09:46:43.358986+0000","last_became_active":"2023-12-12T09:46:42.333185+0000","last_became_peered":"2023-12-12T09:46:42.333185+0000","last_unstale":"2023-12-12T09:46:43.358986+0000","last_undegraded":"2023-12-12T09:46:43.358986+0000","last_fullsized":"2023-12-12T09:46:43.358986+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:41.318400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:41.318400+0000","last_clean_scrub_stamp":"2023-12-12T09:46:41.318400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T17:57:38.377788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.20","version":"0'0","reported_seq":15,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-12-12T09:46:42.303035+0000","last_change":"2023-12-12T09:46:27.003364+0000","last_active":"2023-12-12T09:46:42.303035+0000","last_peered":"2023-12-12T09:46:42.303035+0000","last_clean":"2023-12-12T09:46:42.303035+0000","last_became_active":"2023-12-12T09:46:27.002978+0000","last_became_peered":"2023-12-12T09:46:27.002978+0000","last_unstale":"2023-12-12T09:46:42.303035+0000","last_undegraded":"2023-12-12T09:46:42.303035+0000","last_fullsized":"2023-12-12T09:46:42.303035+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_clean_scrub_stamp":"2023-12-12T09:46:25.941843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T18:26:29.446839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.1c","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-12T09:46:43.305412+0000","last_change":"2023-12-12T09:46:42.341021+0000","last_active":"2023-12-12T09:46:43.305412+0000","last_peered":"2023-12-12T09:46:43.305412+0000","last_clean":"2023-12-12T09:46:43.305412+0000","last_became_active":"2023-12-12T09:46:42.340614+0000","last_became_peered":"2023-12-12T09:46:42.340614+0000","last_unstale":"2023-12-12T09:46:43.305412+0000","last_undegraded":"2023-12-12T09:46:43.305412+0000","last_fullsized":"2023-12-12T09:46:43.305412+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:41.318400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:41.318400+0000","last_clean_scrub_stamp":"2023-12-12T09:46:41.318400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T20:39:14.106715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1d","version":"78'2","reported_seq":14,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-12T09:46:43.360863+0000","last_change":"2023-12-12T09:46:41.365475+0000","last_active":"2023-12-12T09:46:43.360863+0000","last_peered":"2023-12-12T09:46:43.360863+0000","last_clean":"2023-12-12T09:46:43.360863+0000","last_became_active":"2023-12-12T09:46:41.362053+0000","last_became_peered":"2023-12-12T09:46:41.362053+0000","last_unstale":"2023-12-12T09:46:43.360863+0000","last_undegraded":"2023-12-12T09:46:43.360863+0000","last_fullsized":"2023-12-12T09:46:43.360863+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:40.305028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:40.305028+0000","last_clean_scrub_stamp":"2023-12-12T09:46:40.305028+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T21:34:17.272043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":15,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-12-12T09:46:42.318122+0000","last_change":"2023-12-12T09:46:26.993790+0000","last_active":"2023-12-12T09:46:42.318122+0000","last_peered":"2023-12-12T09:46:42.318122+0000","last_clean":"2023-12-12T09:46:42.318122+0000","last_became_active":"2023-12-12T09:46:26.992397+0000","last_became_peered":"2023-12-12T09:46:26.992397+0000","last_unstale":"2023-12-12T09:46:42.318122+0000","last_undegraded":"2023-12-12T09:46:42.318122+0000","last_fullsized":"2023-12-12T09:46:42.318122+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_clean_scrub_stamp":"2023-12-12T09:46:25.941843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T19:08:38.276897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1f","version":"74'4","reported_seq":20,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-12-12T09:46:42.310027+0000","last_change":"2023-12-12T09:46:25.995978+0000","last_active":"2023-12-12T09:46:42.310027+0000","last_peered":"2023-12-12T09:46:42.310027+0000","last_clean":"2023-12-12T09:46:42.310027+0000","last_became_active":"2023-12-12T09:46:25.995655+0000","last_became_peered":"2023-12-12T09:46:25.995655+0000","last_unstale":"2023-12-12T09:46:42.310027+0000","last_undegraded":"2023-12-12T09:46:42.310027+0000","last_fullsized":"2023-12-12T09:46:42.310027+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:24.925008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:24.925008+0000","last_clean_scrub_stamp":"2023-12-12T09:46:24.925008+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T17:36:24.574519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.1d","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-12T09:46:43.308226+0000","last_change":"2023-12-12T09:46:42.336097+0000","last_active":"2023-12-12T09:46:43.308226+0000","last_peered":"2023-12-12T09:46:43.308226+0000","last_clean":"2023-12-12T09:46:43.308226+0000","last_became_active":"2023-12-12T09:46:42.335764+0000","last_became_peered":"2023-12-12T09:46:42.335764+0000","last_unstale":"2023-12-12T09:46:43.308226+0000","last_undegraded":"2023-12-12T09:46:43.308226+0000","last_fullsized":"2023-12-12T09:46:43.308226+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:41.318400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:41.318400+0000","last_clean_scrub_stamp":"2023-12-12T09:46:41.318400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T12:23:44.780206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1c","version":"78'2","reported_seq":14,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-12T09:46:43.360053+0000","last_change":"2023-12-12T09:46:41.361444+0000","last_active":"2023-12-12T09:46:43.360053+0000","last_peered":"2023-12-12T09:46:43.360053+0000","last_clean":"2023-12-12T09:46:43.360053+0000","last_became_active":"2023-12-12T09:46:41.361110+0000","last_became_peered":"2023-12-12T09:46:41.361110+0000","last_unstale":"2023-12-12T09:46:43.360053+0000","last_undegraded":"2023-12-12T09:46:43.360053+0000","last_fullsized":"2023-12-12T09:46:43.360053+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:40.305028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:40.305028+0000","last_clean_scrub_stamp":"2023-12-12T09:46:40.305028+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T12:23:43.766834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":15,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-12-12T09:46:42.309807+0000","last_change":"2023-12-12T09:46:27.003828+0000","last_active":"2023-12-12T09:46:42.309807+0000","last_peered":"2023-12-12T09:46:42.309807+0000","last_clean":"2023-12-12T09:46:42.309807+0000","last_became_active":"2023-12-12T09:46:27.003445+0000","last_became_peered":"2023-12-12T09:46:27.003445+0000","last_unstale":"2023-12-12T09:46:42.309807+0000","last_undegraded":"2023-12-12T09:46:42.309807+0000","last_fullsized":"2023-12-12T09:46:42.309807+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_clean_scrub_stamp":"2023-12-12T09:46:25.941843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T11:42:15.823462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1e","version":"74'1","reported_seq":17,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-12-12T09:46:42.322994+0000","last_change":"2023-12-12T09:46:25.991554+0000","last_active":"2023-12-12T09:46:42.322994+0000","last_peered":"2023-12-12T09:46:42.322994+0000","last_clean":"2023-12-12T09:46:42.322994+0000","last_became_active":"2023-12-12T09:46:25.991083+0000","last_became_peered":"2023-12-12T09:46:25.991083+0000","last_unstale":"2023-12-12T09:46:42.322994+0000","last_undegraded":"2023-12-12T09:46:42.322994+0000","last_fullsized":"2023-12-12T09:46:42.322994+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:24.925008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:24.925008+0000","last_clean_scrub_stamp":"2023-12-12T09:46:24.925008+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T12:36:50.371782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.1e","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-12T09:46:43.362256+0000","last_change":"2023-12-12T09:46:42.321866+0000","last_active":"2023-12-12T09:46:43.362256+0000","last_peered":"2023-12-12T09:46:43.362256+0000","last_clean":"2023-12-12T09:46:43.362256+0000","last_became_active":"2023-12-12T09:46:42.321606+0000","last_became_peered":"2023-12-12T09:46:42.321606+0000","last_unstale":"2023-12-12T09:46:43.362256+0000","last_undegraded":"2023-12-12T09:46:43.362256+0000","last_fullsized":"2023-12-12T09:46:43.362256+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:41.318400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:41.318400+0000","last_clean_scrub_stamp":"2023-12-12T09:46:41.318400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T18:26:44.823395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1f","version":"78'4","reported_seq":16,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-12T09:46:43.360645+0000","last_change":"2023-12-12T09:46:41.364881+0000","last_active":"2023-12-12T09:46:43.360645+0000","last_peered":"2023-12-12T09:46:43.360645+0000","last_clean":"2023-12-12T09:46:43.360645+0000","last_became_active":"2023-12-12T09:46:41.364582+0000","last_became_peered":"2023-12-12T09:46:41.364582+0000","last_unstale":"2023-12-12T09:46:43.360645+0000","last_undegraded":"2023-12-12T09:46:43.360645+0000","last_fullsized":"2023-12-12T09:46:43.360645+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:40.305028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:40.305028+0000","last_clean_scrub_stamp":"2023-12-12T09:46:40.305028+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T18:26:36.681859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":15,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-12-12T09:46:42.307334+0000","last_change":"2023-12-12T09:46:27.003290+0000","last_active":"2023-12-12T09:46:42.307334+0000","last_peered":"2023-12-12T09:46:42.307334+0000","last_clean":"2023-12-12T09:46:42.307334+0000","last_became_active":"2023-12-12T09:46:27.002983+0000","last_became_peered":"2023-12-12T09:46:27.002983+0000","last_unstale":"2023-12-12T09:46:42.307334+0000","last_undegraded":"2023-12-12T09:46:42.307334+0000","last_fullsized":"2023-12-12T09:46:42.307334+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_clean_scrub_stamp":"2023-12-12T09:46:25.941843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T10:54:08.858049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1d","version":"74'2","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-12-12T09:46:42.323604+0000","last_change":"2023-12-12T09:46:25.986094+0000","last_active":"2023-12-12T09:46:42.323604+0000","last_peered":"2023-12-12T09:46:42.323604+0000","last_clean":"2023-12-12T09:46:42.323604+0000","last_became_active":"2023-12-12T09:46:25.985751+0000","last_became_peered":"2023-12-12T09:46:25.985751+0000","last_unstale":"2023-12-12T09:46:42.323604+0000","last_undegraded":"2023-12-12T09:46:42.323604+0000","last_fullsized":"2023-12-12T09:46:42.323604+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:24.925008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:24.925008+0000","last_clean_scrub_stamp":"2023-12-12T09:46:24.925008+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T18:26:28.430003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1f","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-12T09:46:43.365291+0000","last_change":"2023-12-12T09:46:42.329665+0000","last_active":"2023-12-12T09:46:43.365291+0000","last_peered":"2023-12-12T09:46:43.365291+0000","last_clean":"2023-12-12T09:46:43.365291+0000","last_became_active":"2023-12-12T09:46:42.328451+0000","last_became_peered":"2023-12-12T09:46:42.328451+0000","last_unstale":"2023-12-12T09:46:43.365291+0000","last_undegraded":"2023-12-12T09:46:43.365291+0000","last_fullsized":"2023-12-12T09:46:43.365291+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:41.318400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:41.318400+0000","last_clean_scrub_stamp":"2023-12-12T09:46:41.318400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T14:19:02.287407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1e","version":"78'1","reported_seq":13,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-12T09:46:43.361077+0000","last_change":"2023-12-12T09:46:41.369061+0000","last_active":"2023-12-12T09:46:43.361077+0000","last_peered":"2023-12-12T09:46:43.361077+0000","last_clean":"2023-12-12T09:46:43.361077+0000","last_became_active":"2023-12-12T09:46:41.368775+0000","last_became_peered":"2023-12-12T09:46:41.368775+0000","last_unstale":"2023-12-12T09:46:43.361077+0000","last_undegraded":"2023-12-12T09:46:43.361077+0000","last_fullsized":"2023-12-12T09:46:43.361077+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:40.305028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:40.305028+0000","last_clean_scrub_stamp":"2023-12-12T09:46:40.305028+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T12:12:50.163821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":15,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-12-12T09:46:42.316754+0000","last_change":"2023-12-12T09:46:26.991745+0000","last_active":"2023-12-12T09:46:42.316754+0000","last_peered":"2023-12-12T09:46:42.316754+0000","last_clean":"2023-12-12T09:46:42.316754+0000","last_became_active":"2023-12-12T09:46:26.991433+0000","last_became_peered":"2023-12-12T09:46:26.991433+0000","last_unstale":"2023-12-12T09:46:42.316754+0000","last_undegraded":"2023-12-12T09:46:42.316754+0000","last_fullsized":"2023-12-12T09:46:42.316754+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_clean_scrub_stamp":"2023-12-12T09:46:25.941843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T10:54:08.858049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1c","version":"74'2","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-12-12T09:46:42.317150+0000","last_change":"2023-12-12T09:46:25.990718+0000","last_active":"2023-12-12T09:46:42.317150+0000","last_peered":"2023-12-12T09:46:42.317150+0000","last_clean":"2023-12-12T09:46:42.317150+0000","last_became_active":"2023-12-12T09:46:25.990422+0000","last_became_peered":"2023-12-12T09:46:25.990422+0000","last_unstale":"2023-12-12T09:46:42.317150+0000","last_undegraded":"2023-12-12T09:46:42.317150+0000","last_fullsized":"2023-12-12T09:46:42.317150+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:24.925008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:24.925008+0000","last_clean_scrub_stamp":"2023-12-12T09:46:24.925008+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T20:27:54.466769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-12T09:46:43.359031+0000","last_change":"2023-12-12T09:46:42.337971+0000","last_active":"2023-12-12T09:46:43.359031+0000","last_peered":"2023-12-12T09:46:43.359031+0000","last_clean":"2023-12-12T09:46:43.359031+0000","last_became_active":"2023-12-12T09:46:42.337704+0000","last_became_peered":"2023-12-12T09:46:42.337704+0000","last_unstale":"2023-12-12T09:46:43.359031+0000","last_undegraded":"2023-12-12T09:46:43.359031+0000","last_fullsized":"2023-12-12T09:46:43.359031+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:41.318400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:41.318400+0000","last_clean_scrub_stamp":"2023-12-12T09:46:41.318400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T20:16:33.054008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-12T09:46:43.356505+0000","last_change":"2023-12-12T09:46:41.366746+0000","last_active":"2023-12-12T09:46:43.356505+0000","last_peered":"2023-12-12T09:46:43.356505+0000","last_clean":"2023-12-12T09:46:43.356505+0000","last_became_active":"2023-12-12T09:46:41.366388+0000","last_became_peered":"2023-12-12T09:46:41.366388+0000","last_unstale":"2023-12-12T09:46:43.356505+0000","last_undegraded":"2023-12-12T09:46:43.356505+0000","last_fullsized":"2023-12-12T09:46:43.356505+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:40.305028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:40.305028+0000","last_clean_scrub_stamp":"2023-12-12T09:46:40.305028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T11:01:52.288221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":15,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-12-12T09:46:42.331885+0000","last_change":"2023-12-12T09:46:26.991755+0000","last_active":"2023-12-12T09:46:42.331885+0000","last_peered":"2023-12-12T09:46:42.331885+0000","last_clean":"2023-12-12T09:46:42.331885+0000","last_became_active":"2023-12-12T09:46:26.991128+0000","last_became_peered":"2023-12-12T09:46:26.991128+0000","last_unstale":"2023-12-12T09:46:42.331885+0000","last_undegraded":"2023-12-12T09:46:42.331885+0000","last_fullsized":"2023-12-12T09:46:42.331885+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_clean_scrub_stamp":"2023-12-12T09:46:25.941843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T10:21:27.951163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1b","version":"74'1","reported_seq":17,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-12-12T09:46:42.319189+0000","last_change":"2023-12-12T09:46:25.996637+0000","last_active":"2023-12-12T09:46:42.319189+0000","last_peered":"2023-12-12T09:46:42.319189+0000","last_clean":"2023-12-12T09:46:42.319189+0000","last_became_active":"2023-12-12T09:46:25.994964+0000","last_became_peered":"2023-12-12T09:46:25.994964+0000","last_unstale":"2023-12-12T09:46:42.319189+0000","last_undegraded":"2023-12-12T09:46:42.319189+0000","last_fullsized":"2023-12-12T09:46:42.319189+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:24.925008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:24.925008+0000","last_clean_scrub_stamp":"2023-12-12T09:46:24.925008+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T10:00:11.351606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-12T09:46:43.305253+0000","last_change":"2023-12-12T09:46:42.333105+0000","last_active":"2023-12-12T09:46:43.305253+0000","last_peered":"2023-12-12T09:46:43.305253+0000","last_clean":"2023-12-12T09:46:43.305253+0000","last_became_active":"2023-12-12T09:46:42.332807+0000","last_became_peered":"2023-12-12T09:46:42.332807+0000","last_unstale":"2023-12-12T09:46:43.305253+0000","last_undegraded":"2023-12-12T09:46:43.305253+0000","last_fullsized":"2023-12-12T09:46:43.305253+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:41.318400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:41.318400+0000","last_clean_scrub_stamp":"2023-12-12T09:46:41.318400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T10:54:20.718934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-12T09:46:43.303762+0000","last_change":"2023-12-12T09:46:41.353916+0000","last_active":"2023-12-12T09:46:43.303762+0000","last_peered":"2023-12-12T09:46:43.303762+0000","last_clean":"2023-12-12T09:46:43.303762+0000","last_became_active":"2023-12-12T09:46:41.353658+0000","last_became_peered":"2023-12-12T09:46:41.353658+0000","last_unstale":"2023-12-12T09:46:43.303762+0000","last_undegraded":"2023-12-12T09:46:43.303762+0000","last_fullsized":"2023-12-12T09:46:43.303762+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:40.305028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:40.305028+0000","last_clean_scrub_stamp":"2023-12-12T09:46:40.305028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T14:34:13.628311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":15,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-12-12T09:46:42.318883+0000","last_change":"2023-12-12T09:46:26.992932+0000","last_active":"2023-12-12T09:46:42.318883+0000","last_peered":"2023-12-12T09:46:42.318883+0000","last_clean":"2023-12-12T09:46:42.318883+0000","last_became_active":"2023-12-12T09:46:26.992439+0000","last_became_peered":"2023-12-12T09:46:26.992439+0000","last_unstale":"2023-12-12T09:46:42.318883+0000","last_undegraded":"2023-12-12T09:46:42.318883+0000","last_fullsized":"2023-12-12T09:46:42.318883+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_clean_scrub_stamp":"2023-12-12T09:46:25.941843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T17:57:23.001231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1a","version":"74'1","reported_seq":17,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-12-12T09:46:42.318405+0000","last_change":"2023-12-12T09:46:25.997561+0000","last_active":"2023-12-12T09:46:42.318405+0000","last_peered":"2023-12-12T09:46:42.318405+0000","last_clean":"2023-12-12T09:46:42.318405+0000","last_became_active":"2023-12-12T09:46:25.997251+0000","last_became_peered":"2023-12-12T09:46:25.997251+0000","last_unstale":"2023-12-12T09:46:42.318405+0000","last_undegraded":"2023-12-12T09:46:42.318405+0000","last_fullsized":"2023-12-12T09:46:42.318405+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:24.925008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:24.925008+0000","last_clean_scrub_stamp":"2023-12-12T09:46:24.925008+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T19:17:31.250809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.1a","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-12T09:46:43.306495+0000","last_change":"2023-12-12T09:46:42.329080+0000","last_active":"2023-12-12T09:46:43.306495+0000","last_peered":"2023-12-12T09:46:43.306495+0000","last_clean":"2023-12-12T09:46:43.306495+0000","last_became_active":"2023-12-12T09:46:42.328806+0000","last_became_peered":"2023-12-12T09:46:42.328806+0000","last_unstale":"2023-12-12T09:46:43.306495+0000","last_undegraded":"2023-12-12T09:46:43.306495+0000","last_fullsized":"2023-12-12T09:46:43.306495+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:41.318400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:41.318400+0000","last_clean_scrub_stamp":"2023-12-12T09:46:41.318400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T21:06:25.811665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.1b","version":"78'1","reported_seq":13,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-12T09:46:43.304666+0000","last_change":"2023-12-12T09:46:41.365750+0000","last_active":"2023-12-12T09:46:43.304666+0000","last_peered":"2023-12-12T09:46:43.304666+0000","last_clean":"2023-12-12T09:46:43.304666+0000","last_became_active":"2023-12-12T09:46:41.365494+0000","last_became_peered":"2023-12-12T09:46:41.365494+0000","last_unstale":"2023-12-12T09:46:43.304666+0000","last_undegraded":"2023-12-12T09:46:43.304666+0000","last_fullsized":"2023-12-12T09:46:43.304666+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:40.305028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:40.305028+0000","last_clean_scrub_stamp":"2023-12-12T09:46:40.305028+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T15:01:54.307234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":15,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-12-12T09:46:42.309632+0000","last_change":"2023-12-12T09:46:26.992538+0000","last_active":"2023-12-12T09:46:42.309632+0000","last_peered":"2023-12-12T09:46:42.309632+0000","last_clean":"2023-12-12T09:46:42.309632+0000","last_became_active":"2023-12-12T09:46:26.992224+0000","last_became_peered":"2023-12-12T09:46:26.992224+0000","last_unstale":"2023-12-12T09:46:42.309632+0000","last_undegraded":"2023-12-12T09:46:42.309632+0000","last_fullsized":"2023-12-12T09:46:42.309632+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_clean_scrub_stamp":"2023-12-12T09:46:25.941843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T20:26:07.352366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":16,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-12-12T09:46:42.310716+0000","last_change":"2023-12-12T09:46:25.986629+0000","last_active":"2023-12-12T09:46:42.310716+0000","last_peered":"2023-12-12T09:46:42.310716+0000","last_clean":"2023-12-12T09:46:42.310716+0000","last_became_active":"2023-12-12T09:46:25.986351+0000","last_became_peered":"2023-12-12T09:46:25.986351+0000","last_unstale":"2023-12-12T09:46:42.310716+0000","last_undegraded":"2023-12-12T09:46:42.310716+0000","last_fullsized":"2023-12-12T09:46:42.310716+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:24.925008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:24.925008+0000","last_clean_scrub_stamp":"2023-12-12T09:46:24.925008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T11:46:36.913352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1b","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-12T09:46:43.361029+0000","last_change":"2023-12-12T09:46:42.323860+0000","last_active":"2023-12-12T09:46:43.361029+0000","last_peered":"2023-12-12T09:46:43.361029+0000","last_clean":"2023-12-12T09:46:43.361029+0000","last_became_active":"2023-12-12T09:46:42.323531+0000","last_became_peered":"2023-12-12T09:46:42.323531+0000","last_unstale":"2023-12-12T09:46:43.361029+0000","last_undegraded":"2023-12-12T09:46:43.361029+0000","last_fullsized":"2023-12-12T09:46:43.361029+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:41.318400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:41.318400+0000","last_clean_scrub_stamp":"2023-12-12T09:46:41.318400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T17:18:54.779024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.1a","version":"78'1","reported_seq":13,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-12T09:46:43.358220+0000","last_change":"2023-12-12T09:46:41.365744+0000","last_active":"2023-12-12T09:46:43.358220+0000","last_peered":"2023-12-12T09:46:43.358220+0000","last_clean":"2023-12-12T09:46:43.358220+0000","last_became_active":"2023-12-12T09:46:41.365483+0000","last_became_peered":"2023-12-12T09:46:41.365483+0000","last_unstale":"2023-12-12T09:46:43.358220+0000","last_undegraded":"2023-12-12T09:46:43.358220+0000","last_fullsized":"2023-12-12T09:46:43.358220+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:40.305028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:40.305028+0000","last_clean_scrub_stamp":"2023-12-12T09:46:40.305028+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T12:12:50.163821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":15,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-12-12T09:46:42.318695+0000","last_change":"2023-12-12T09:46:26.993474+0000","last_active":"2023-12-12T09:46:42.318695+0000","last_peered":"2023-12-12T09:46:42.318695+0000","last_clean":"2023-12-12T09:46:42.318695+0000","last_became_active":"2023-12-12T09:46:26.993192+0000","last_became_peered":"2023-12-12T09:46:26.993192+0000","last_unstale":"2023-12-12T09:46:42.318695+0000","last_undegraded":"2023-12-12T09:46:42.318695+0000","last_fullsized":"2023-12-12T09:46:42.318695+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_clean_scrub_stamp":"2023-12-12T09:46:25.941843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T20:38:58.730158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":16,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-12-12T09:46:42.321045+0000","last_change":"2023-12-12T09:46:25.998271+0000","last_active":"2023-12-12T09:46:42.321045+0000","last_peered":"2023-12-12T09:46:42.321045+0000","last_clean":"2023-12-12T09:46:42.321045+0000","last_became_active":"2023-12-12T09:46:25.997900+0000","last_became_peered":"2023-12-12T09:46:25.997900+0000","last_unstale":"2023-12-12T09:46:42.321045+0000","last_undegraded":"2023-12-12T09:46:42.321045+0000","last_fullsized":"2023-12-12T09:46:42.321045+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:24.925008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:24.925008+0000","last_clean_scrub_stamp":"2023-12-12T09:46:24.925008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T14:29:28.702921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.14","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-12T09:46:43.357451+0000","last_change":"2023-12-12T09:46:42.330297+0000","last_active":"2023-12-12T09:46:43.357451+0000","last_peered":"2023-12-12T09:46:43.357451+0000","last_clean":"2023-12-12T09:46:43.357451+0000","last_became_active":"2023-12-12T09:46:42.329318+0000","last_became_peered":"2023-12-12T09:46:42.329318+0000","last_unstale":"2023-12-12T09:46:43.357451+0000","last_undegraded":"2023-12-12T09:46:43.357451+0000","last_fullsized":"2023-12-12T09:46:43.357451+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:41.318400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:41.318400+0000","last_clean_scrub_stamp":"2023-12-12T09:46:41.318400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T21:34:18.285415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.15","version":"78'3","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-12T09:46:43.361682+0000","last_change":"2023-12-12T09:46:41.370324+0000","last_active":"2023-12-12T09:46:43.361682+0000","last_peered":"2023-12-12T09:46:43.361682+0000","last_clean":"2023-12-12T09:46:43.361682+0000","last_became_active":"2023-12-12T09:46:41.370030+0000","last_became_peered":"2023-12-12T09:46:41.370030+0000","last_unstale":"2023-12-12T09:46:43.361682+0000","last_undegraded":"2023-12-12T09:46:43.361682+0000","last_fullsized":"2023-12-12T09:46:43.361682+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:40.305028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:40.305028+0000","last_clean_scrub_stamp":"2023-12-12T09:46:40.305028+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T20:16:32.040636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":15,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-12-12T09:46:42.319737+0000","last_change":"2023-12-12T09:46:26.991874+0000","last_active":"2023-12-12T09:46:42.319737+0000","last_peered":"2023-12-12T09:46:42.319737+0000","last_clean":"2023-12-12T09:46:42.319737+0000","last_became_active":"2023-12-12T09:46:26.991425+0000","last_became_peered":"2023-12-12T09:46:26.991425+0000","last_unstale":"2023-12-12T09:46:42.319737+0000","last_undegraded":"2023-12-12T09:46:42.319737+0000","last_fullsized":"2023-12-12T09:46:42.319737+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_clean_scrub_stamp":"2023-12-12T09:46:25.941843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T14:49:18.138939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":16,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-12-12T09:46:42.310149+0000","last_change":"2023-12-12T09:46:25.994140+0000","last_active":"2023-12-12T09:46:42.310149+0000","last_peered":"2023-12-12T09:46:42.310149+0000","last_clean":"2023-12-12T09:46:42.310149+0000","last_became_active":"2023-12-12T09:46:25.993784+0000","last_became_peered":"2023-12-12T09:46:25.993784+0000","last_unstale":"2023-12-12T09:46:42.310149+0000","last_undegraded":"2023-12-12T09:46:42.310149+0000","last_fullsized":"2023-12-12T09:46:42.310149+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:24.925008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:24.925008+0000","last_clean_scrub_stamp":"2023-12-12T09:46:24.925008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T19:08:37.260062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.15","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-12T09:46:43.361179+0000","last_change":"2023-12-12T09:46:42.333798+0000","last_active":"2023-12-12T09:46:43.361179+0000","last_peered":"2023-12-12T09:46:43.361179+0000","last_clean":"2023-12-12T09:46:43.361179+0000","last_became_active":"2023-12-12T09:46:42.332488+0000","last_became_peered":"2023-12-12T09:46:42.332488+0000","last_unstale":"2023-12-12T09:46:43.361179+0000","last_undegraded":"2023-12-12T09:46:43.361179+0000","last_fullsized":"2023-12-12T09:46:43.361179+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:41.318400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:41.318400+0000","last_clean_scrub_stamp":"2023-12-12T09:46:41.318400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T14:19:02.287407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.14","version":"78'6","reported_seq":18,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-12T09:46:43.308121+0000","last_change":"2023-12-12T09:46:41.358678+0000","last_active":"2023-12-12T09:46:43.308121+0000","last_peered":"2023-12-12T09:46:43.308121+0000","last_clean":"2023-12-12T09:46:43.308121+0000","last_became_active":"2023-12-12T09:46:41.358382+0000","last_became_peered":"2023-12-12T09:46:41.358382+0000","last_unstale":"2023-12-12T09:46:43.308121+0000","last_undegraded":"2023-12-12T09:46:43.308121+0000","last_fullsized":"2023-12-12T09:46:43.308121+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:40.305028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:40.305028+0000","last_clean_scrub_stamp":"2023-12-12T09:46:40.305028+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T21:01:40.299897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":15,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-12-12T09:46:42.310523+0000","last_change":"2023-12-12T09:46:26.981920+0000","last_active":"2023-12-12T09:46:42.310523+0000","last_peered":"2023-12-12T09:46:42.310523+0000","last_clean":"2023-12-12T09:46:42.310523+0000","last_became_active":"2023-12-12T09:46:26.981149+0000","last_became_peered":"2023-12-12T09:46:26.981149+0000","last_unstale":"2023-12-12T09:46:42.310523+0000","last_undegraded":"2023-12-12T09:46:42.310523+0000","last_fullsized":"2023-12-12T09:46:42.310523+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_clean_scrub_stamp":"2023-12-12T09:46:25.941843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T17:36:25.591354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":16,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-12-12T09:46:42.307252+0000","last_change":"2023-12-12T09:46:25.994337+0000","last_active":"2023-12-12T09:46:42.307252+0000","last_peered":"2023-12-12T09:46:42.307252+0000","last_clean":"2023-12-12T09:46:42.307252+0000","last_became_active":"2023-12-12T09:46:25.993988+0000","last_became_peered":"2023-12-12T09:46:25.993988+0000","last_unstale":"2023-12-12T09:46:42.307252+0000","last_undegraded":"2023-12-12T09:46:42.307252+0000","last_fullsized":"2023-12-12T09:46:42.307252+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:24.925008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:24.925008+0000","last_clean_scrub_stamp":"2023-12-12T09:46:24.925008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T14:33:58.248291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-12T09:46:43.359984+0000","last_change":"2023-12-12T09:46:42.339053+0000","last_active":"2023-12-12T09:46:43.359984+0000","last_peered":"2023-12-12T09:46:43.359984+0000","last_clean":"2023-12-12T09:46:43.359984+0000","last_became_active":"2023-12-12T09:46:42.338740+0000","last_became_peered":"2023-12-12T09:46:42.338740+0000","last_unstale":"2023-12-12T09:46:43.359984+0000","last_undegraded":"2023-12-12T09:46:43.359984+0000","last_fullsized":"2023-12-12T09:46:43.359984+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:41.318400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:41.318400+0000","last_clean_scrub_stamp":"2023-12-12T09:46:41.318400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T14:04:06.177120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-12T09:46:43.306048+0000","last_change":"2023-12-12T09:46:41.351750+0000","last_active":"2023-12-12T09:46:43.306048+0000","last_peered":"2023-12-12T09:46:43.306048+0000","last_clean":"2023-12-12T09:46:43.306048+0000","last_became_active":"2023-12-12T09:46:41.351476+0000","last_became_peered":"2023-12-12T09:46:41.351476+0000","last_unstale":"2023-12-12T09:46:43.306048+0000","last_undegraded":"2023-12-12T09:46:43.306048+0000","last_fullsized":"2023-12-12T09:46:43.306048+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:40.305028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:40.305028+0000","last_clean_scrub_stamp":"2023-12-12T09:46:40.305028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T10:55:15.389730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":15,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-12-12T09:46:42.315000+0000","last_change":"2023-12-12T09:46:26.983752+0000","last_active":"2023-12-12T09:46:42.315000+0000","last_peered":"2023-12-12T09:46:42.315000+0000","last_clean":"2023-12-12T09:46:42.315000+0000","last_became_active":"2023-12-12T09:46:26.983381+0000","last_became_peered":"2023-12-12T09:46:26.983381+0000","last_unstale":"2023-12-12T09:46:42.315000+0000","last_undegraded":"2023-12-12T09:46:42.315000+0000","last_fullsized":"2023-12-12T09:46:42.315000+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_clean_scrub_stamp":"2023-12-12T09:46:25.941843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T15:01:39.944049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.15","version":"74'3","reported_seq":19,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-12-12T09:46:42.307564+0000","last_change":"2023-12-12T09:46:25.985458+0000","last_active":"2023-12-12T09:46:42.307564+0000","last_peered":"2023-12-12T09:46:42.307564+0000","last_clean":"2023-12-12T09:46:42.307564+0000","last_became_active":"2023-12-12T09:46:25.985147+0000","last_became_peered":"2023-12-12T09:46:25.985147+0000","last_unstale":"2023-12-12T09:46:42.307564+0000","last_undegraded":"2023-12-12T09:46:42.307564+0000","last_fullsized":"2023-12-12T09:46:42.307564+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:24.925008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:24.925008+0000","last_clean_scrub_stamp":"2023-12-12T09:46:24.925008+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T12:43:19.303770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-12T09:46:43.308693+0000","last_change":"2023-12-12T09:46:42.332276+0000","last_active":"2023-12-12T09:46:43.308693+0000","last_peered":"2023-12-12T09:46:43.308693+0000","last_clean":"2023-12-12T09:46:43.308693+0000","last_became_active":"2023-12-12T09:46:42.331931+0000","last_became_peered":"2023-12-12T09:46:42.331931+0000","last_unstale":"2023-12-12T09:46:43.308693+0000","last_undegraded":"2023-12-12T09:46:43.308693+0000","last_fullsized":"2023-12-12T09:46:43.308693+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:41.318400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:41.318400+0000","last_clean_scrub_stamp":"2023-12-12T09:46:41.318400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T20:54:15.640711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-12T09:46:43.364380+0000","last_change":"2023-12-12T09:46:41.363852+0000","last_active":"2023-12-12T09:46:43.364380+0000","last_peered":"2023-12-12T09:46:43.364380+0000","last_clean":"2023-12-12T09:46:43.364380+0000","last_became_active":"2023-12-12T09:46:41.363055+0000","last_became_peered":"2023-12-12T09:46:41.363055+0000","last_unstale":"2023-12-12T09:46:43.364380+0000","last_undegraded":"2023-12-12T09:46:43.364380+0000","last_fullsized":"2023-12-12T09:46:43.364380+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:40.305028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:40.305028+0000","last_clean_scrub_stamp":"2023-12-12T09:46:40.305028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T18:51:51.937752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":15,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-12-12T09:46:42.327900+0000","last_change":"2023-12-12T09:46:26.997513+0000","last_active":"2023-12-12T09:46:42.327900+0000","last_peered":"2023-12-12T09:46:42.327900+0000","last_clean":"2023-12-12T09:46:42.327900+0000","last_became_active":"2023-12-12T09:46:26.997102+0000","last_became_peered":"2023-12-12T09:46:26.997102+0000","last_unstale":"2023-12-12T09:46:42.327900+0000","last_undegraded":"2023-12-12T09:46:42.327900+0000","last_fullsized":"2023-12-12T09:46:42.327900+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_clean_scrub_stamp":"2023-12-12T09:46:25.941843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T10:24:08.528546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.14","version":"75'9","reported_seq":25,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-12-12T09:46:42.311021+0000","last_change":"2023-12-12T09:46:25.982724+0000","last_active":"2023-12-12T09:46:42.311021+0000","last_peered":"2023-12-12T09:46:42.311021+0000","last_clean":"2023-12-12T09:46:42.311021+0000","last_became_active":"2023-12-12T09:46:25.982370+0000","last_became_peered":"2023-12-12T09:46:25.982370+0000","last_unstale":"2023-12-12T09:46:42.311021+0000","last_undegraded":"2023-12-12T09:46:42.311021+0000","last_fullsized":"2023-12-12T09:46:42.311021+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:24.925008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:24.925008+0000","last_clean_scrub_stamp":"2023-12-12T09:46:24.925008+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T12:43:19.303770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3107,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.10","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-12T09:46:43.305107+0000","last_change":"2023-12-12T09:46:42.332984+0000","last_active":"2023-12-12T09:46:43.305107+0000","last_peered":"2023-12-12T09:46:43.305107+0000","last_clean":"2023-12-12T09:46:43.305107+0000","last_became_active":"2023-12-12T09:46:42.331626+0000","last_became_peered":"2023-12-12T09:46:42.331626+0000","last_unstale":"2023-12-12T09:46:43.305107+0000","last_undegraded":"2023-12-12T09:46:43.305107+0000","last_fullsized":"2023-12-12T09:46:43.305107+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:41.318400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:41.318400+0000","last_clean_scrub_stamp":"2023-12-12T09:46:41.318400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T11:01:53.301593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-12T09:46:43.305448+0000","last_change":"2023-12-12T09:46:41.362613+0000","last_active":"2023-12-12T09:46:43.305448+0000","last_peered":"2023-12-12T09:46:43.305448+0000","last_clean":"2023-12-12T09:46:43.305448+0000","last_became_active":"2023-12-12T09:46:41.361862+0000","last_became_peered":"2023-12-12T09:46:41.361862+0000","last_unstale":"2023-12-12T09:46:43.305448+0000","last_undegraded":"2023-12-12T09:46:43.305448+0000","last_fullsized":"2023-12-12T09:46:43.305448+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:40.305028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:40.305028+0000","last_clean_scrub_stamp":"2023-12-12T09:46:40.305028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T13:43:05.254729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":15,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-12-12T09:46:42.309891+0000","last_change":"2023-12-12T09:46:26.979828+0000","last_active":"2023-12-12T09:46:42.309891+0000","last_peered":"2023-12-12T09:46:42.309891+0000","last_clean":"2023-12-12T09:46:42.309891+0000","last_became_active":"2023-12-12T09:46:26.979516+0000","last_became_peered":"2023-12-12T09:46:26.979516+0000","last_unstale":"2023-12-12T09:46:42.309891+0000","last_undegraded":"2023-12-12T09:46:42.309891+0000","last_fullsized":"2023-12-12T09:46:42.309891+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_clean_scrub_stamp":"2023-12-12T09:46:25.941843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T10:54:08.858049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.13","version":"74'2","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-12-12T09:46:42.324649+0000","last_change":"2023-12-12T09:46:25.987283+0000","last_active":"2023-12-12T09:46:42.324649+0000","last_peered":"2023-12-12T09:46:42.324649+0000","last_clean":"2023-12-12T09:46:42.324649+0000","last_became_active":"2023-12-12T09:46:25.986974+0000","last_became_peered":"2023-12-12T09:46:25.986974+0000","last_unstale":"2023-12-12T09:46:42.324649+0000","last_undegraded":"2023-12-12T09:46:42.324649+0000","last_fullsized":"2023-12-12T09:46:42.324649+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:24.925008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:24.925008+0000","last_clean_scrub_stamp":"2023-12-12T09:46:24.925008+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T17:33:21.476618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-12T09:46:43.355953+0000","last_change":"2023-12-12T09:46:42.327080+0000","last_active":"2023-12-12T09:46:43.355953+0000","last_peered":"2023-12-12T09:46:43.355953+0000","last_clean":"2023-12-12T09:46:43.355953+0000","last_became_active":"2023-12-12T09:46:42.326759+0000","last_became_peered":"2023-12-12T09:46:42.326759+0000","last_unstale":"2023-12-12T09:46:43.355953+0000","last_undegraded":"2023-12-12T09:46:43.355953+0000","last_fullsized":"2023-12-12T09:46:43.355953+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:41.318400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:41.318400+0000","last_clean_scrub_stamp":"2023-12-12T09:46:41.318400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T12:26:56.113829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.10","version":"78'8","reported_seq":20,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-12T09:46:43.303882+0000","last_change":"2023-12-12T09:46:41.360488+0000","last_active":"2023-12-12T09:46:43.303882+0000","last_peered":"2023-12-12T09:46:43.303882+0000","last_clean":"2023-12-12T09:46:43.303882+0000","last_became_active":"2023-12-12T09:46:41.360210+0000","last_became_peered":"2023-12-12T09:46:41.360210+0000","last_unstale":"2023-12-12T09:46:43.303882+0000","last_undegraded":"2023-12-12T09:46:43.303882+0000","last_fullsized":"2023-12-12T09:46:43.303882+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:40.305028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:40.305028+0000","last_clean_scrub_stamp":"2023-12-12T09:46:40.305028+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T18:11:19.443341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":15,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-12-12T09:46:42.312962+0000","last_change":"2023-12-12T09:46:26.991122+0000","last_active":"2023-12-12T09:46:42.312962+0000","last_peered":"2023-12-12T09:46:42.312962+0000","last_clean":"2023-12-12T09:46:42.312962+0000","last_became_active":"2023-12-12T09:46:26.990778+0000","last_became_peered":"2023-12-12T09:46:26.990778+0000","last_unstale":"2023-12-12T09:46:42.312962+0000","last_undegraded":"2023-12-12T09:46:42.312962+0000","last_fullsized":"2023-12-12T09:46:42.312962+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_clean_scrub_stamp":"2023-12-12T09:46:25.941843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T11:42:15.823462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":16,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-12-12T09:46:42.317566+0000","last_change":"2023-12-12T09:46:25.982578+0000","last_active":"2023-12-12T09:46:42.317566+0000","last_peered":"2023-12-12T09:46:42.317566+0000","last_clean":"2023-12-12T09:46:42.317566+0000","last_became_active":"2023-12-12T09:46:25.982307+0000","last_became_peered":"2023-12-12T09:46:25.982307+0000","last_unstale":"2023-12-12T09:46:42.317566+0000","last_undegraded":"2023-12-12T09:46:42.317566+0000","last_fullsized":"2023-12-12T09:46:42.317566+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:24.925008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:24.925008+0000","last_clean_scrub_stamp":"2023-12-12T09:46:24.925008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T10:54:07.841214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-12T09:46:43.359985+0000","last_change":"2023-12-12T09:46:42.326432+0000","last_active":"2023-12-12T09:46:43.359985+0000","last_peered":"2023-12-12T09:46:43.359985+0000","last_clean":"2023-12-12T09:46:43.359985+0000","last_became_active":"2023-12-12T09:46:42.326112+0000","last_became_peered":"2023-12-12T09:46:42.326112+0000","last_unstale":"2023-12-12T09:46:43.359985+0000","last_undegraded":"2023-12-12T09:46:43.359985+0000","last_fullsized":"2023-12-12T09:46:43.359985+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:41.318400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:41.318400+0000","last_clean_scrub_stamp":"2023-12-12T09:46:41.318400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T20:54:15.640711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.13","version":"78'2","reported_seq":14,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-12T09:46:43.357895+0000","last_change":"2023-12-12T09:46:41.358830+0000","last_active":"2023-12-12T09:46:43.357895+0000","last_peered":"2023-12-12T09:46:43.357895+0000","last_clean":"2023-12-12T09:46:43.357895+0000","last_became_active":"2023-12-12T09:46:41.357323+0000","last_became_peered":"2023-12-12T09:46:41.357323+0000","last_unstale":"2023-12-12T09:46:43.357895+0000","last_undegraded":"2023-12-12T09:46:43.357895+0000","last_fullsized":"2023-12-12T09:46:43.357895+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:40.305028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:40.305028+0000","last_clean_scrub_stamp":"2023-12-12T09:46:40.305028+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T10:13:52.009978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":15,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-12-12T09:46:42.319383+0000","last_change":"2023-12-12T09:46:26.990991+0000","last_active":"2023-12-12T09:46:42.319383+0000","last_peered":"2023-12-12T09:46:42.319383+0000","last_clean":"2023-12-12T09:46:42.319383+0000","last_became_active":"2023-12-12T09:46:26.990702+0000","last_became_peered":"2023-12-12T09:46:26.990702+0000","last_unstale":"2023-12-12T09:46:42.319383+0000","last_undegraded":"2023-12-12T09:46:42.319383+0000","last_fullsized":"2023-12-12T09:46:42.319383+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_clean_scrub_stamp":"2023-12-12T09:46:25.941843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T14:22:02.583778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":16,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-12-12T09:46:42.304912+0000","last_change":"2023-12-12T09:46:26.002159+0000","last_active":"2023-12-12T09:46:42.304912+0000","last_peered":"2023-12-12T09:46:42.304912+0000","last_clean":"2023-12-12T09:46:42.304912+0000","last_became_active":"2023-12-12T09:46:26.001847+0000","last_became_peered":"2023-12-12T09:46:26.001847+0000","last_unstale":"2023-12-12T09:46:42.304912+0000","last_undegraded":"2023-12-12T09:46:42.304912+0000","last_fullsized":"2023-12-12T09:46:42.304912+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:24.925008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:24.925008+0000","last_clean_scrub_stamp":"2023-12-12T09:46:24.925008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T10:21:26.934327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.13","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-12T09:46:43.304827+0000","last_change":"2023-12-12T09:46:42.336342+0000","last_active":"2023-12-12T09:46:43.304827+0000","last_peered":"2023-12-12T09:46:43.304827+0000","last_clean":"2023-12-12T09:46:43.304827+0000","last_became_active":"2023-12-12T09:46:42.336050+0000","last_became_peered":"2023-12-12T09:46:42.336050+0000","last_unstale":"2023-12-12T09:46:43.304827+0000","last_undegraded":"2023-12-12T09:46:43.304827+0000","last_fullsized":"2023-12-12T09:46:43.304827+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:41.318400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:41.318400+0000","last_clean_scrub_stamp":"2023-12-12T09:46:41.318400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T11:42:31.200019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-12T09:46:43.358677+0000","last_change":"2023-12-12T09:46:41.358371+0000","last_active":"2023-12-12T09:46:43.358677+0000","last_peered":"2023-12-12T09:46:43.358677+0000","last_clean":"2023-12-12T09:46:43.358677+0000","last_became_active":"2023-12-12T09:46:41.358084+0000","last_became_peered":"2023-12-12T09:46:41.358084+0000","last_unstale":"2023-12-12T09:46:43.358677+0000","last_undegraded":"2023-12-12T09:46:43.358677+0000","last_fullsized":"2023-12-12T09:46:43.358677+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:40.305028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:40.305028+0000","last_clean_scrub_stamp":"2023-12-12T09:46:40.305028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T11:26:26.382701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":15,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-12-12T09:46:42.323986+0000","last_change":"2023-12-12T09:46:26.988682+0000","last_active":"2023-12-12T09:46:42.323986+0000","last_peered":"2023-12-12T09:46:42.323986+0000","last_clean":"2023-12-12T09:46:42.323986+0000","last_became_active":"2023-12-12T09:46:26.988391+0000","last_became_peered":"2023-12-12T09:46:26.988391+0000","last_unstale":"2023-12-12T09:46:42.323986+0000","last_undegraded":"2023-12-12T09:46:42.323986+0000","last_fullsized":"2023-12-12T09:46:42.323986+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_clean_scrub_stamp":"2023-12-12T09:46:25.941843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T10:34:32.907255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.10","version":"74'8","reported_seq":24,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-12-12T09:46:42.311617+0000","last_change":"2023-12-12T09:46:25.990213+0000","last_active":"2023-12-12T09:46:42.311617+0000","last_peered":"2023-12-12T09:46:42.311617+0000","last_clean":"2023-12-12T09:46:42.311617+0000","last_became_active":"2023-12-12T09:46:25.989960+0000","last_became_peered":"2023-12-12T09:46:25.989960+0000","last_unstale":"2023-12-12T09:46:42.311617+0000","last_undegraded":"2023-12-12T09:46:42.311617+0000","last_fullsized":"2023-12-12T09:46:42.311617+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:24.925008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:24.925008+0000","last_clean_scrub_stamp":"2023-12-12T09:46:24.925008+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T12:26:39.720437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-12T09:46:43.307180+0000","last_change":"2023-12-12T09:46:42.314405+0000","last_active":"2023-12-12T09:46:43.307180+0000","last_peered":"2023-12-12T09:46:43.307180+0000","last_clean":"2023-12-12T09:46:43.307180+0000","last_became_active":"2023-12-12T09:46:42.314121+0000","last_became_peered":"2023-12-12T09:46:42.314121+0000","last_unstale":"2023-12-12T09:46:43.307180+0000","last_undegraded":"2023-12-12T09:46:43.307180+0000","last_fullsized":"2023-12-12T09:46:43.307180+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:41.318400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:41.318400+0000","last_clean_scrub_stamp":"2023-12-12T09:46:41.318400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T11:50:59.555821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.d","version":"78'1","reported_seq":13,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-12T09:46:43.358933+0000","last_change":"2023-12-12T09:46:41.363501+0000","last_active":"2023-12-12T09:46:43.358933+0000","last_peered":"2023-12-12T09:46:43.358933+0000","last_clean":"2023-12-12T09:46:43.358933+0000","last_became_active":"2023-12-12T09:46:41.363280+0000","last_became_peered":"2023-12-12T09:46:41.363280+0000","last_unstale":"2023-12-12T09:46:43.358933+0000","last_undegraded":"2023-12-12T09:46:43.358933+0000","last_fullsized":"2023-12-12T09:46:43.358933+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:40.305028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:40.305028+0000","last_clean_scrub_stamp":"2023-12-12T09:46:40.305028+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T20:54:14.627339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":15,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-12-12T09:46:42.314644+0000","last_change":"2023-12-12T09:46:26.983398+0000","last_active":"2023-12-12T09:46:42.314644+0000","last_peered":"2023-12-12T09:46:42.314644+0000","last_clean":"2023-12-12T09:46:42.314644+0000","last_became_active":"2023-12-12T09:46:26.983101+0000","last_became_peered":"2023-12-12T09:46:26.983101+0000","last_unstale":"2023-12-12T09:46:42.314644+0000","last_undegraded":"2023-12-12T09:46:42.314644+0000","last_fullsized":"2023-12-12T09:46:42.314644+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_clean_scrub_stamp":"2023-12-12T09:46:25.941843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T10:55:01.026545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.f","version":"74'1","reported_seq":17,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-12-12T09:46:42.310333+0000","last_change":"2023-12-12T09:46:25.988523+0000","last_active":"2023-12-12T09:46:42.310333+0000","last_peered":"2023-12-12T09:46:42.310333+0000","last_clean":"2023-12-12T09:46:42.310333+0000","last_became_active":"2023-12-12T09:46:25.988129+0000","last_became_peered":"2023-12-12T09:46:25.988129+0000","last_unstale":"2023-12-12T09:46:42.310333+0000","last_undegraded":"2023-12-12T09:46:42.310333+0000","last_fullsized":"2023-12-12T09:46:42.310333+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:24.925008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:24.925008+0000","last_clean_scrub_stamp":"2023-12-12T09:46:24.925008+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T17:57:21.984396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.d","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-12T09:46:43.361174+0000","last_change":"2023-12-12T09:46:42.338571+0000","last_active":"2023-12-12T09:46:43.361174+0000","last_peered":"2023-12-12T09:46:43.361174+0000","last_clean":"2023-12-12T09:46:43.361174+0000","last_became_active":"2023-12-12T09:46:42.338297+0000","last_became_peered":"2023-12-12T09:46:42.338297+0000","last_unstale":"2023-12-12T09:46:43.361174+0000","last_undegraded":"2023-12-12T09:46:43.361174+0000","last_fullsized":"2023-12-12T09:46:43.361174+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:41.318400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:41.318400+0000","last_clean_scrub_stamp":"2023-12-12T09:46:41.318400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T21:34:18.285415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-12T09:46:43.360197+0000","last_change":"2023-12-12T09:46:41.355747+0000","last_active":"2023-12-12T09:46:43.360197+0000","last_peered":"2023-12-12T09:46:43.360197+0000","last_clean":"2023-12-12T09:46:43.360197+0000","last_became_active":"2023-12-12T09:46:41.355232+0000","last_became_peered":"2023-12-12T09:46:41.355232+0000","last_unstale":"2023-12-12T09:46:43.360197+0000","last_undegraded":"2023-12-12T09:46:43.360197+0000","last_fullsized":"2023-12-12T09:46:43.360197+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:40.305028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:40.305028+0000","last_clean_scrub_stamp":"2023-12-12T09:46:40.305028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T11:39:25.261015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":15,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-12-12T09:46:42.309910+0000","last_change":"2023-12-12T09:46:26.985248+0000","last_active":"2023-12-12T09:46:42.309910+0000","last_peered":"2023-12-12T09:46:42.309910+0000","last_clean":"2023-12-12T09:46:42.309910+0000","last_became_active":"2023-12-12T09:46:26.984986+0000","last_became_peered":"2023-12-12T09:46:26.984986+0000","last_unstale":"2023-12-12T09:46:42.309910+0000","last_undegraded":"2023-12-12T09:46:42.309910+0000","last_fullsized":"2023-12-12T09:46:42.309910+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_clean_scrub_stamp":"2023-12-12T09:46:25.941843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T14:49:18.138939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.e","version":"74'2","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-12-12T09:46:42.325711+0000","last_change":"2023-12-12T09:46:25.991479+0000","last_active":"2023-12-12T09:46:42.325711+0000","last_peered":"2023-12-12T09:46:42.325711+0000","last_clean":"2023-12-12T09:46:42.325711+0000","last_became_active":"2023-12-12T09:46:25.991205+0000","last_became_peered":"2023-12-12T09:46:25.991205+0000","last_unstale":"2023-12-12T09:46:42.325711+0000","last_undegraded":"2023-12-12T09:46:42.325711+0000","last_fullsized":"2023-12-12T09:46:42.325711+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:24.925008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:24.925008+0000","last_clean_scrub_stamp":"2023-12-12T09:46:24.925008+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T18:32:41.851313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.f","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-12T09:46:43.359514+0000","last_change":"2023-12-12T09:46:42.336350+0000","last_active":"2023-12-12T09:46:43.359514+0000","last_peered":"2023-12-12T09:46:43.359514+0000","last_clean":"2023-12-12T09:46:43.359514+0000","last_became_active":"2023-12-12T09:46:42.336062+0000","last_became_peered":"2023-12-12T09:46:42.336062+0000","last_unstale":"2023-12-12T09:46:43.359514+0000","last_undegraded":"2023-12-12T09:46:43.359514+0000","last_fullsized":"2023-12-12T09:46:43.359514+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:41.318400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:41.318400+0000","last_clean_scrub_stamp":"2023-12-12T09:46:41.318400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T20:22:27.576869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.e","version":"78'2","reported_seq":14,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-12T09:46:43.307781+0000","last_change":"2023-12-12T09:46:41.358666+0000","last_active":"2023-12-12T09:46:43.307781+0000","last_peered":"2023-12-12T09:46:43.307781+0000","last_clean":"2023-12-12T09:46:43.307781+0000","last_became_active":"2023-12-12T09:46:41.358359+0000","last_became_peered":"2023-12-12T09:46:41.358359+0000","last_unstale":"2023-12-12T09:46:43.307781+0000","last_undegraded":"2023-12-12T09:46:43.307781+0000","last_fullsized":"2023-12-12T09:46:43.307781+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:40.305028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:40.305028+0000","last_clean_scrub_stamp":"2023-12-12T09:46:40.305028+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T12:03:19.177036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":15,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-12-12T09:46:42.327992+0000","last_change":"2023-12-12T09:46:26.987944+0000","last_active":"2023-12-12T09:46:42.327992+0000","last_peered":"2023-12-12T09:46:42.327992+0000","last_clean":"2023-12-12T09:46:42.327992+0000","last_became_active":"2023-12-12T09:46:26.987624+0000","last_became_peered":"2023-12-12T09:46:26.987624+0000","last_unstale":"2023-12-12T09:46:42.327992+0000","last_undegraded":"2023-12-12T09:46:42.327992+0000","last_fullsized":"2023-12-12T09:46:42.327992+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_clean_scrub_stamp":"2023-12-12T09:46:25.941843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T18:26:29.446839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":16,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-12-12T09:46:42.317269+0000","last_change":"2023-12-12T09:46:25.987255+0000","last_active":"2023-12-12T09:46:42.317269+0000","last_peered":"2023-12-12T09:46:42.317269+0000","last_clean":"2023-12-12T09:46:42.317269+0000","last_became_active":"2023-12-12T09:46:25.986994+0000","last_became_peered":"2023-12-12T09:46:25.986994+0000","last_unstale":"2023-12-12T09:46:42.317269+0000","last_undegraded":"2023-12-12T09:46:42.317269+0000","last_fullsized":"2023-12-12T09:46:42.317269+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:24.925008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:24.925008+0000","last_clean_scrub_stamp":"2023-12-12T09:46:24.925008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T17:57:21.984396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-12T09:46:43.355867+0000","last_change":"2023-12-12T09:46:42.320811+0000","last_active":"2023-12-12T09:46:43.355867+0000","last_peered":"2023-12-12T09:46:43.355867+0000","last_clean":"2023-12-12T09:46:43.355867+0000","last_became_active":"2023-12-12T09:46:42.320529+0000","last_became_peered":"2023-12-12T09:46:42.320529+0000","last_unstale":"2023-12-12T09:46:43.355867+0000","last_undegraded":"2023-12-12T09:46:43.355867+0000","last_fullsized":"2023-12-12T09:46:43.355867+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:41.318400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:41.318400+0000","last_clean_scrub_stamp":"2023-12-12T09:46:41.318400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T12:20:38.497812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-12T09:46:43.306821+0000","last_change":"2023-12-12T09:46:41.357120+0000","last_active":"2023-12-12T09:46:43.306821+0000","last_peered":"2023-12-12T09:46:43.306821+0000","last_clean":"2023-12-12T09:46:43.306821+0000","last_became_active":"2023-12-12T09:46:41.356245+0000","last_became_peered":"2023-12-12T09:46:41.356245+0000","last_unstale":"2023-12-12T09:46:43.306821+0000","last_undegraded":"2023-12-12T09:46:43.306821+0000","last_fullsized":"2023-12-12T09:46:43.306821+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:40.305028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:40.305028+0000","last_clean_scrub_stamp":"2023-12-12T09:46:40.305028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T20:26:21.715551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":15,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-12-12T09:46:42.308165+0000","last_change":"2023-12-12T09:46:26.998275+0000","last_active":"2023-12-12T09:46:42.308165+0000","last_peered":"2023-12-12T09:46:42.308165+0000","last_clean":"2023-12-12T09:46:42.308165+0000","last_became_active":"2023-12-12T09:46:26.997250+0000","last_became_peered":"2023-12-12T09:46:26.997250+0000","last_unstale":"2023-12-12T09:46:42.308165+0000","last_undegraded":"2023-12-12T09:46:42.308165+0000","last_fullsized":"2023-12-12T09:46:42.308165+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_clean_scrub_stamp":"2023-12-12T09:46:25.941843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T09:58:10.574493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.b","version":"74'2","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-12-12T09:46:42.318395+0000","last_change":"2023-12-12T09:46:25.981571+0000","last_active":"2023-12-12T09:46:42.318395+0000","last_peered":"2023-12-12T09:46:42.318395+0000","last_clean":"2023-12-12T09:46:42.318395+0000","last_became_active":"2023-12-12T09:46:25.981285+0000","last_became_peered":"2023-12-12T09:46:25.981285+0000","last_unstale":"2023-12-12T09:46:42.318395+0000","last_undegraded":"2023-12-12T09:46:42.318395+0000","last_fullsized":"2023-12-12T09:46:42.318395+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:24.925008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:24.925008+0000","last_clean_scrub_stamp":"2023-12-12T09:46:24.925008+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T16:03:21.071388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-12T09:46:43.355605+0000","last_change":"2023-12-12T09:46:42.333274+0000","last_active":"2023-12-12T09:46:43.355605+0000","last_peered":"2023-12-12T09:46:43.355605+0000","last_clean":"2023-12-12T09:46:43.355605+0000","last_became_active":"2023-12-12T09:46:42.332973+0000","last_became_peered":"2023-12-12T09:46:42.332973+0000","last_unstale":"2023-12-12T09:46:43.355605+0000","last_undegraded":"2023-12-12T09:46:43.355605+0000","last_fullsized":"2023-12-12T09:46:43.355605+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:41.318400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:41.318400+0000","last_clean_scrub_stamp":"2023-12-12T09:46:41.318400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T20:25:43.200693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-12T09:46:43.356943+0000","last_change":"2023-12-12T09:46:41.356747+0000","last_active":"2023-12-12T09:46:43.356943+0000","last_peered":"2023-12-12T09:46:43.356943+0000","last_clean":"2023-12-12T09:46:43.356943+0000","last_became_active":"2023-12-12T09:46:41.356279+0000","last_became_peered":"2023-12-12T09:46:41.356279+0000","last_unstale":"2023-12-12T09:46:43.356943+0000","last_undegraded":"2023-12-12T09:46:43.356943+0000","last_fullsized":"2023-12-12T09:46:43.356943+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:40.305028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:40.305028+0000","last_clean_scrub_stamp":"2023-12-12T09:46:40.305028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T10:54:19.705562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":15,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-12-12T09:46:42.309457+0000","last_change":"2023-12-12T09:46:26.979623+0000","last_active":"2023-12-12T09:46:42.309457+0000","last_peered":"2023-12-12T09:46:42.309457+0000","last_clean":"2023-12-12T09:46:42.309457+0000","last_became_active":"2023-12-12T09:46:26.979271+0000","last_became_peered":"2023-12-12T09:46:26.979271+0000","last_unstale":"2023-12-12T09:46:42.309457+0000","last_undegraded":"2023-12-12T09:46:42.309457+0000","last_fullsized":"2023-12-12T09:46:42.309457+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_clean_scrub_stamp":"2023-12-12T09:46:25.941843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T20:16:10.850955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":16,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-12-12T09:46:42.308403+0000","last_change":"2023-12-12T09:46:25.986608+0000","last_active":"2023-12-12T09:46:42.308403+0000","last_peered":"2023-12-12T09:46:42.308403+0000","last_clean":"2023-12-12T09:46:42.308403+0000","last_became_active":"2023-12-12T09:46:25.986236+0000","last_became_peered":"2023-12-12T09:46:25.986236+0000","last_unstale":"2023-12-12T09:46:42.308403+0000","last_undegraded":"2023-12-12T09:46:42.308403+0000","last_fullsized":"2023-12-12T09:46:42.308403+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:24.925008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:24.925008+0000","last_clean_scrub_stamp":"2023-12-12T09:46:24.925008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T20:29:16.623938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-12T09:46:43.357672+0000","last_change":"2023-12-12T09:46:42.319756+0000","last_active":"2023-12-12T09:46:43.357672+0000","last_peered":"2023-12-12T09:46:43.357672+0000","last_clean":"2023-12-12T09:46:43.357672+0000","last_became_active":"2023-12-12T09:46:42.319478+0000","last_became_peered":"2023-12-12T09:46:42.319478+0000","last_unstale":"2023-12-12T09:46:43.357672+0000","last_undegraded":"2023-12-12T09:46:43.357672+0000","last_fullsized":"2023-12-12T09:46:43.357672+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:41.318400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:41.318400+0000","last_clean_scrub_stamp":"2023-12-12T09:46:41.318400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T20:28:10.860161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.b","version":"78'2","reported_seq":14,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-12T09:46:43.358574+0000","last_change":"2023-12-12T09:46:41.364803+0000","last_active":"2023-12-12T09:46:43.358574+0000","last_peered":"2023-12-12T09:46:43.358574+0000","last_clean":"2023-12-12T09:46:43.358574+0000","last_became_active":"2023-12-12T09:46:41.363054+0000","last_became_peered":"2023-12-12T09:46:41.363054+0000","last_unstale":"2023-12-12T09:46:43.358574+0000","last_undegraded":"2023-12-12T09:46:43.358574+0000","last_fullsized":"2023-12-12T09:46:43.358574+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:40.305028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:40.305028+0000","last_clean_scrub_stamp":"2023-12-12T09:46:40.305028+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T21:03:47.271829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":15,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-12-12T09:46:42.301307+0000","last_change":"2023-12-12T09:46:26.987145+0000","last_active":"2023-12-12T09:46:42.301307+0000","last_peered":"2023-12-12T09:46:42.301307+0000","last_clean":"2023-12-12T09:46:42.301307+0000","last_became_active":"2023-12-12T09:46:26.986503+0000","last_became_peered":"2023-12-12T09:46:26.986503+0000","last_unstale":"2023-12-12T09:46:42.301307+0000","last_undegraded":"2023-12-12T09:46:42.301307+0000","last_fullsized":"2023-12-12T09:46:42.301307+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_clean_scrub_stamp":"2023-12-12T09:46:25.941843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T18:36:24.773262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":16,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-12-12T09:46:42.302047+0000","last_change":"2023-12-12T09:46:25.988222+0000","last_active":"2023-12-12T09:46:42.302047+0000","last_peered":"2023-12-12T09:46:42.302047+0000","last_clean":"2023-12-12T09:46:42.302047+0000","last_became_active":"2023-12-12T09:46:25.987972+0000","last_became_peered":"2023-12-12T09:46:25.987972+0000","last_unstale":"2023-12-12T09:46:42.302047+0000","last_undegraded":"2023-12-12T09:46:42.302047+0000","last_fullsized":"2023-12-12T09:46:42.302047+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:24.925008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:24.925008+0000","last_clean_scrub_stamp":"2023-12-12T09:46:24.925008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T12:18:16.286957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.b","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-12T09:46:43.357671+0000","last_change":"2023-12-12T09:46:42.336575+0000","last_active":"2023-12-12T09:46:43.357671+0000","last_peered":"2023-12-12T09:46:43.357671+0000","last_clean":"2023-12-12T09:46:43.357671+0000","last_became_active":"2023-12-12T09:46:42.336245+0000","last_became_peered":"2023-12-12T09:46:42.336245+0000","last_unstale":"2023-12-12T09:46:43.357671+0000","last_undegraded":"2023-12-12T09:46:43.357671+0000","last_fullsized":"2023-12-12T09:46:43.357671+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:41.318400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:41.318400+0000","last_clean_scrub_stamp":"2023-12-12T09:46:41.318400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T20:02:47.231873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-12T09:46:43.306516+0000","last_change":"2023-12-12T09:46:41.354326+0000","last_active":"2023-12-12T09:46:43.306516+0000","last_peered":"2023-12-12T09:46:43.306516+0000","last_clean":"2023-12-12T09:46:43.306516+0000","last_became_active":"2023-12-12T09:46:41.353949+0000","last_became_peered":"2023-12-12T09:46:41.353949+0000","last_unstale":"2023-12-12T09:46:43.306516+0000","last_undegraded":"2023-12-12T09:46:43.306516+0000","last_fullsized":"2023-12-12T09:46:43.306516+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:40.305028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:40.305028+0000","last_clean_scrub_stamp":"2023-12-12T09:46:40.305028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T20:39:13.093343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":15,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-12-12T09:46:42.304676+0000","last_change":"2023-12-12T09:46:26.968398+0000","last_active":"2023-12-12T09:46:42.304676+0000","last_peered":"2023-12-12T09:46:42.304676+0000","last_clean":"2023-12-12T09:46:42.304676+0000","last_became_active":"2023-12-12T09:46:26.967774+0000","last_became_peered":"2023-12-12T09:46:26.967774+0000","last_unstale":"2023-12-12T09:46:42.304676+0000","last_undegraded":"2023-12-12T09:46:42.304676+0000","last_fullsized":"2023-12-12T09:46:42.304676+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_clean_scrub_stamp":"2023-12-12T09:46:25.941843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T11:46:37.930187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":16,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-12-12T09:46:42.315234+0000","last_change":"2023-12-12T09:46:25.983579+0000","last_active":"2023-12-12T09:46:42.315234+0000","last_peered":"2023-12-12T09:46:42.315234+0000","last_clean":"2023-12-12T09:46:42.315234+0000","last_became_active":"2023-12-12T09:46:25.983172+0000","last_became_peered":"2023-12-12T09:46:25.983172+0000","last_unstale":"2023-12-12T09:46:42.315234+0000","last_undegraded":"2023-12-12T09:46:42.315234+0000","last_fullsized":"2023-12-12T09:46:42.315234+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:24.925008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:24.925008+0000","last_clean_scrub_stamp":"2023-12-12T09:46:24.925008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T10:55:00.009710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-12T09:46:43.305562+0000","last_change":"2023-12-12T09:46:42.327284+0000","last_active":"2023-12-12T09:46:43.305562+0000","last_peered":"2023-12-12T09:46:43.305562+0000","last_clean":"2023-12-12T09:46:43.305562+0000","last_became_active":"2023-12-12T09:46:42.326998+0000","last_became_peered":"2023-12-12T09:46:42.326998+0000","last_unstale":"2023-12-12T09:46:43.305562+0000","last_undegraded":"2023-12-12T09:46:43.305562+0000","last_fullsized":"2023-12-12T09:46:43.305562+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:41.318400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:41.318400+0000","last_clean_scrub_stamp":"2023-12-12T09:46:41.318400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T14:49:33.515496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-12T09:46:43.360356+0000","last_change":"2023-12-12T09:46:41.365162+0000","last_active":"2023-12-12T09:46:43.360356+0000","last_peered":"2023-12-12T09:46:43.360356+0000","last_clean":"2023-12-12T09:46:43.360356+0000","last_became_active":"2023-12-12T09:46:41.364902+0000","last_became_peered":"2023-12-12T09:46:41.364902+0000","last_unstale":"2023-12-12T09:46:43.360356+0000","last_undegraded":"2023-12-12T09:46:43.360356+0000","last_fullsized":"2023-12-12T09:46:43.360356+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:40.305028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:40.305028+0000","last_clean_scrub_stamp":"2023-12-12T09:46:40.305028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T21:01:40.299897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":15,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-12-12T09:46:42.318212+0000","last_change":"2023-12-12T09:46:26.974656+0000","last_active":"2023-12-12T09:46:42.318212+0000","last_peered":"2023-12-12T09:46:42.318212+0000","last_clean":"2023-12-12T09:46:42.318212+0000","last_became_active":"2023-12-12T09:46:26.974051+0000","last_became_peered":"2023-12-12T09:46:26.974051+0000","last_unstale":"2023-12-12T09:46:42.318212+0000","last_undegraded":"2023-12-12T09:46:42.318212+0000","last_fullsized":"2023-12-12T09:46:42.318212+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_clean_scrub_stamp":"2023-12-12T09:46:25.941843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T14:33:59.265126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.7","version":"74'2","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-12-12T09:46:42.327696+0000","last_change":"2023-12-12T09:46:25.989868+0000","last_active":"2023-12-12T09:46:42.327696+0000","last_peered":"2023-12-12T09:46:42.327696+0000","last_clean":"2023-12-12T09:46:42.327696+0000","last_became_active":"2023-12-12T09:46:25.989577+0000","last_became_peered":"2023-12-12T09:46:25.989577+0000","last_unstale":"2023-12-12T09:46:42.327696+0000","last_undegraded":"2023-12-12T09:46:42.327696+0000","last_fullsized":"2023-12-12T09:46:42.327696+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:24.925008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:24.925008+0000","last_clean_scrub_stamp":"2023-12-12T09:46:24.925008+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T19:17:31.250809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-12T09:46:43.358688+0000","last_change":"2023-12-12T09:46:42.332229+0000","last_active":"2023-12-12T09:46:43.358688+0000","last_peered":"2023-12-12T09:46:43.358688+0000","last_clean":"2023-12-12T09:46:43.358688+0000","last_became_active":"2023-12-12T09:46:42.329624+0000","last_became_peered":"2023-12-12T09:46:42.329624+0000","last_unstale":"2023-12-12T09:46:43.358688+0000","last_undegraded":"2023-12-12T09:46:43.358688+0000","last_fullsized":"2023-12-12T09:46:43.358688+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:41.318400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:41.318400+0000","last_clean_scrub_stamp":"2023-12-12T09:46:41.318400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T20:35:58.433787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-12T09:46:43.357662+0000","last_change":"2023-12-12T09:46:41.369495+0000","last_active":"2023-12-12T09:46:43.357662+0000","last_peered":"2023-12-12T09:46:43.357662+0000","last_clean":"2023-12-12T09:46:43.357662+0000","last_became_active":"2023-12-12T09:46:41.369121+0000","last_became_peered":"2023-12-12T09:46:41.369121+0000","last_unstale":"2023-12-12T09:46:43.357662+0000","last_undegraded":"2023-12-12T09:46:43.357662+0000","last_fullsized":"2023-12-12T09:46:43.357662+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:40.305028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:40.305028+0000","last_clean_scrub_stamp":"2023-12-12T09:46:40.305028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T20:16:32.040636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":15,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-12-12T09:46:42.315631+0000","last_change":"2023-12-12T09:46:26.994090+0000","last_active":"2023-12-12T09:46:42.315631+0000","last_peered":"2023-12-12T09:46:42.315631+0000","last_clean":"2023-12-12T09:46:42.315631+0000","last_became_active":"2023-12-12T09:46:26.992152+0000","last_became_peered":"2023-12-12T09:46:26.992152+0000","last_unstale":"2023-12-12T09:46:42.315631+0000","last_undegraded":"2023-12-12T09:46:42.315631+0000","last_fullsized":"2023-12-12T09:46:42.315631+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_clean_scrub_stamp":"2023-12-12T09:46:25.941843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T16:03:22.088223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.6","version":"75'1","reported_seq":17,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-12-12T09:46:42.325186+0000","last_change":"2023-12-12T09:46:25.986713+0000","last_active":"2023-12-12T09:46:42.325186+0000","last_peered":"2023-12-12T09:46:42.325186+0000","last_clean":"2023-12-12T09:46:42.325186+0000","last_became_active":"2023-12-12T09:46:25.986422+0000","last_became_peered":"2023-12-12T09:46:25.986422+0000","last_unstale":"2023-12-12T09:46:42.325186+0000","last_undegraded":"2023-12-12T09:46:42.325186+0000","last_fullsized":"2023-12-12T09:46:42.325186+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:24.925008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:24.925008+0000","last_clean_scrub_stamp":"2023-12-12T09:46:24.925008+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T10:48:07.069161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-12T09:46:43.360345+0000","last_change":"2023-12-12T09:46:42.336110+0000","last_active":"2023-12-12T09:46:43.360345+0000","last_peered":"2023-12-12T09:46:43.360345+0000","last_clean":"2023-12-12T09:46:43.360345+0000","last_became_active":"2023-12-12T09:46:42.334158+0000","last_became_peered":"2023-12-12T09:46:42.334158+0000","last_unstale":"2023-12-12T09:46:43.360345+0000","last_undegraded":"2023-12-12T09:46:43.360345+0000","last_fullsized":"2023-12-12T09:46:43.360345+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:41.318400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:41.318400+0000","last_clean_scrub_stamp":"2023-12-12T09:46:41.318400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T18:48:15.715348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.7","version":"78'2","reported_seq":14,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-12T09:46:43.309517+0000","last_change":"2023-12-12T09:46:41.356170+0000","last_active":"2023-12-12T09:46:43.309517+0000","last_peered":"2023-12-12T09:46:43.309517+0000","last_clean":"2023-12-12T09:46:43.309517+0000","last_became_active":"2023-12-12T09:46:41.355834+0000","last_became_peered":"2023-12-12T09:46:41.355834+0000","last_unstale":"2023-12-12T09:46:43.309517+0000","last_undegraded":"2023-12-12T09:46:43.309517+0000","last_fullsized":"2023-12-12T09:46:43.309517+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:40.305028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:40.305028+0000","last_clean_scrub_stamp":"2023-12-12T09:46:40.305028+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T14:49:32.502124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":15,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-12-12T09:46:42.307545+0000","last_change":"2023-12-12T09:46:26.989385+0000","last_active":"2023-12-12T09:46:42.307545+0000","last_peered":"2023-12-12T09:46:42.307545+0000","last_clean":"2023-12-12T09:46:42.307545+0000","last_became_active":"2023-12-12T09:46:26.989099+0000","last_became_peered":"2023-12-12T09:46:26.989099+0000","last_unstale":"2023-12-12T09:46:42.307545+0000","last_undegraded":"2023-12-12T09:46:42.307545+0000","last_fullsized":"2023-12-12T09:46:42.307545+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_clean_scrub_stamp":"2023-12-12T09:46:25.941843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T16:03:22.088223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":16,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-12-12T09:46:42.307981+0000","last_change":"2023-12-12T09:46:25.988958+0000","last_active":"2023-12-12T09:46:42.307981+0000","last_peered":"2023-12-12T09:46:42.307981+0000","last_clean":"2023-12-12T09:46:42.307981+0000","last_became_active":"2023-12-12T09:46:25.988383+0000","last_became_peered":"2023-12-12T09:46:25.988383+0000","last_unstale":"2023-12-12T09:46:42.307981+0000","last_undegraded":"2023-12-12T09:46:42.307981+0000","last_fullsized":"2023-12-12T09:46:42.307981+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:24.925008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:24.925008+0000","last_clean_scrub_stamp":"2023-12-12T09:46:24.925008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T12:32:02.713576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.7","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-12T09:46:43.305996+0000","last_change":"2023-12-12T09:46:42.338236+0000","last_active":"2023-12-12T09:46:43.305996+0000","last_peered":"2023-12-12T09:46:43.305996+0000","last_clean":"2023-12-12T09:46:43.305996+0000","last_became_active":"2023-12-12T09:46:42.337756+0000","last_became_peered":"2023-12-12T09:46:42.337756+0000","last_unstale":"2023-12-12T09:46:43.305996+0000","last_undegraded":"2023-12-12T09:46:43.305996+0000","last_fullsized":"2023-12-12T09:46:43.305996+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:41.318400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:41.318400+0000","last_clean_scrub_stamp":"2023-12-12T09:46:41.318400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T21:06:25.811665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.6","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-12T09:46:43.360354+0000","last_change":"2023-12-12T09:46:41.362160+0000","last_active":"2023-12-12T09:46:43.360354+0000","last_peered":"2023-12-12T09:46:43.360354+0000","last_clean":"2023-12-12T09:46:43.360354+0000","last_became_active":"2023-12-12T09:46:41.361692+0000","last_became_peered":"2023-12-12T09:46:41.361692+0000","last_unstale":"2023-12-12T09:46:43.360354+0000","last_undegraded":"2023-12-12T09:46:43.360354+0000","last_fullsized":"2023-12-12T09:46:43.360354+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:40.305028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:40.305028+0000","last_clean_scrub_stamp":"2023-12-12T09:46:40.305028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T20:35:57.420415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":15,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-12-12T09:46:42.328085+0000","last_change":"2023-12-12T09:46:26.989882+0000","last_active":"2023-12-12T09:46:42.328085+0000","last_peered":"2023-12-12T09:46:42.328085+0000","last_clean":"2023-12-12T09:46:42.328085+0000","last_became_active":"2023-12-12T09:46:26.989558+0000","last_became_peered":"2023-12-12T09:46:26.989558+0000","last_unstale":"2023-12-12T09:46:42.328085+0000","last_undegraded":"2023-12-12T09:46:42.328085+0000","last_fullsized":"2023-12-12T09:46:42.328085+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_clean_scrub_stamp":"2023-12-12T09:46:25.941843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T15:01:39.944049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":16,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-12-12T09:46:42.311795+0000","last_change":"2023-12-12T09:46:25.985790+0000","last_active":"2023-12-12T09:46:42.311795+0000","last_peered":"2023-12-12T09:46:42.311795+0000","last_clean":"2023-12-12T09:46:42.311795+0000","last_became_active":"2023-12-12T09:46:25.985297+0000","last_became_peered":"2023-12-12T09:46:25.985297+0000","last_unstale":"2023-12-12T09:46:42.311795+0000","last_undegraded":"2023-12-12T09:46:42.311795+0000","last_fullsized":"2023-12-12T09:46:42.311795+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:24.925008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:24.925008+0000","last_clean_scrub_stamp":"2023-12-12T09:46:24.925008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T20:16:09.834119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-12T09:46:43.355905+0000","last_change":"2023-12-12T09:46:42.328622+0000","last_active":"2023-12-12T09:46:43.355905+0000","last_peered":"2023-12-12T09:46:43.355905+0000","last_clean":"2023-12-12T09:46:43.355905+0000","last_became_active":"2023-12-12T09:46:42.328351+0000","last_became_peered":"2023-12-12T09:46:42.328351+0000","last_unstale":"2023-12-12T09:46:43.355905+0000","last_undegraded":"2023-12-12T09:46:43.355905+0000","last_fullsized":"2023-12-12T09:46:43.355905+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:41.318400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:41.318400+0000","last_clean_scrub_stamp":"2023-12-12T09:46:41.318400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T20:16:26.227512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-12T09:46:43.359668+0000","last_change":"2023-12-12T09:46:41.353657+0000","last_active":"2023-12-12T09:46:43.359668+0000","last_peered":"2023-12-12T09:46:43.359668+0000","last_clean":"2023-12-12T09:46:43.359668+0000","last_became_active":"2023-12-12T09:46:41.353312+0000","last_became_peered":"2023-12-12T09:46:41.353312+0000","last_unstale":"2023-12-12T09:46:43.359668+0000","last_undegraded":"2023-12-12T09:46:43.359668+0000","last_fullsized":"2023-12-12T09:46:43.359668+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:40.305028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:40.305028+0000","last_clean_scrub_stamp":"2023-12-12T09:46:40.305028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T10:54:19.705562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":15,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-12-12T09:46:42.307625+0000","last_change":"2023-12-12T09:46:26.978093+0000","last_active":"2023-12-12T09:46:42.307625+0000","last_peered":"2023-12-12T09:46:42.307625+0000","last_clean":"2023-12-12T09:46:42.307625+0000","last_became_active":"2023-12-12T09:46:26.977782+0000","last_became_peered":"2023-12-12T09:46:26.977782+0000","last_unstale":"2023-12-12T09:46:42.307625+0000","last_undegraded":"2023-12-12T09:46:42.307625+0000","last_fullsized":"2023-12-12T09:46:42.307625+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_clean_scrub_stamp":"2023-12-12T09:46:25.941843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T20:27:55.483605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":16,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-12-12T09:46:42.316294+0000","last_change":"2023-12-12T09:46:25.989940+0000","last_active":"2023-12-12T09:46:42.316294+0000","last_peered":"2023-12-12T09:46:42.316294+0000","last_clean":"2023-12-12T09:46:42.316294+0000","last_became_active":"2023-12-12T09:46:25.989572+0000","last_became_peered":"2023-12-12T09:46:25.989572+0000","last_unstale":"2023-12-12T09:46:42.316294+0000","last_undegraded":"2023-12-12T09:46:42.316294+0000","last_fullsized":"2023-12-12T09:46:42.316294+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:24.925008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:24.925008+0000","last_clean_scrub_stamp":"2023-12-12T09:46:24.925008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T10:24:07.511710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-12T09:46:43.355964+0000","last_change":"2023-12-12T09:46:42.324752+0000","last_active":"2023-12-12T09:46:43.355964+0000","last_peered":"2023-12-12T09:46:43.355964+0000","last_clean":"2023-12-12T09:46:43.355964+0000","last_became_active":"2023-12-12T09:46:42.323984+0000","last_became_peered":"2023-12-12T09:46:42.323984+0000","last_unstale":"2023-12-12T09:46:43.355964+0000","last_undegraded":"2023-12-12T09:46:43.355964+0000","last_fullsized":"2023-12-12T09:46:43.355964+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:41.318400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:41.318400+0000","last_clean_scrub_stamp":"2023-12-12T09:46:41.318400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T17:18:54.779024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-12T09:46:43.356149+0000","last_change":"2023-12-12T09:46:41.364555+0000","last_active":"2023-12-12T09:46:43.356149+0000","last_peered":"2023-12-12T09:46:43.356149+0000","last_clean":"2023-12-12T09:46:43.356149+0000","last_became_active":"2023-12-12T09:46:41.361705+0000","last_became_peered":"2023-12-12T09:46:41.361705+0000","last_unstale":"2023-12-12T09:46:43.356149+0000","last_undegraded":"2023-12-12T09:46:43.356149+0000","last_fullsized":"2023-12-12T09:46:43.356149+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:40.305028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:40.305028+0000","last_clean_scrub_stamp":"2023-12-12T09:46:40.305028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T10:34:47.270440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":15,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-12-12T09:46:42.314030+0000","last_change":"2023-12-12T09:46:26.980504+0000","last_active":"2023-12-12T09:46:42.314030+0000","last_peered":"2023-12-12T09:46:42.314030+0000","last_clean":"2023-12-12T09:46:42.314030+0000","last_became_active":"2023-12-12T09:46:26.980219+0000","last_became_peered":"2023-12-12T09:46:26.980219+0000","last_unstale":"2023-12-12T09:46:42.314030+0000","last_undegraded":"2023-12-12T09:46:42.314030+0000","last_fullsized":"2023-12-12T09:46:42.314030+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_clean_scrub_stamp":"2023-12-12T09:46:25.941843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T10:55:01.026545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":16,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-12-12T09:46:42.318376+0000","last_change":"2023-12-12T09:46:25.997435+0000","last_active":"2023-12-12T09:46:42.318376+0000","last_peered":"2023-12-12T09:46:42.318376+0000","last_clean":"2023-12-12T09:46:42.318376+0000","last_became_active":"2023-12-12T09:46:25.997139+0000","last_became_peered":"2023-12-12T09:46:25.997139+0000","last_unstale":"2023-12-12T09:46:42.318376+0000","last_undegraded":"2023-12-12T09:46:42.318376+0000","last_fullsized":"2023-12-12T09:46:42.318376+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:24.925008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:24.925008+0000","last_clean_scrub_stamp":"2023-12-12T09:46:24.925008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T10:34:31.890420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-12T09:46:43.357987+0000","last_change":"2023-12-12T09:46:42.330064+0000","last_active":"2023-12-12T09:46:43.357987+0000","last_peered":"2023-12-12T09:46:43.357987+0000","last_clean":"2023-12-12T09:46:43.357987+0000","last_became_active":"2023-12-12T09:46:42.329120+0000","last_became_peered":"2023-12-12T09:46:42.329120+0000","last_unstale":"2023-12-12T09:46:43.357987+0000","last_undegraded":"2023-12-12T09:46:43.357987+0000","last_fullsized":"2023-12-12T09:46:43.357987+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:41.318400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:41.318400+0000","last_clean_scrub_stamp":"2023-12-12T09:46:41.318400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T19:08:53.653454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-12T09:46:43.356951+0000","last_change":"2023-12-12T09:46:41.361488+0000","last_active":"2023-12-12T09:46:43.356951+0000","last_peered":"2023-12-12T09:46:43.356951+0000","last_clean":"2023-12-12T09:46:43.356951+0000","last_became_active":"2023-12-12T09:46:41.361214+0000","last_became_peered":"2023-12-12T09:46:41.361214+0000","last_unstale":"2023-12-12T09:46:43.356951+0000","last_undegraded":"2023-12-12T09:46:43.356951+0000","last_fullsized":"2023-12-12T09:46:43.356951+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:40.305028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:40.305028+0000","last_clean_scrub_stamp":"2023-12-12T09:46:40.305028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T18:51:51.937752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":15,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-12-12T09:46:42.310429+0000","last_change":"2023-12-12T09:46:26.992722+0000","last_active":"2023-12-12T09:46:42.310429+0000","last_peered":"2023-12-12T09:46:42.310429+0000","last_clean":"2023-12-12T09:46:42.310429+0000","last_became_active":"2023-12-12T09:46:26.990039+0000","last_became_peered":"2023-12-12T09:46:26.990039+0000","last_unstale":"2023-12-12T09:46:42.310429+0000","last_undegraded":"2023-12-12T09:46:42.310429+0000","last_fullsized":"2023-12-12T09:46:42.310429+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_clean_scrub_stamp":"2023-12-12T09:46:25.941843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T18:26:29.446839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":16,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-12-12T09:46:42.305669+0000","last_change":"2023-12-12T09:46:25.982419+0000","last_active":"2023-12-12T09:46:42.305669+0000","last_peered":"2023-12-12T09:46:42.305669+0000","last_clean":"2023-12-12T09:46:42.305669+0000","last_became_active":"2023-12-12T09:46:25.981873+0000","last_became_peered":"2023-12-12T09:46:25.981873+0000","last_unstale":"2023-12-12T09:46:42.305669+0000","last_undegraded":"2023-12-12T09:46:42.305669+0000","last_fullsized":"2023-12-12T09:46:42.305669+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:24.925008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:24.925008+0000","last_clean_scrub_stamp":"2023-12-12T09:46:24.925008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T12:20:22.104420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-12T09:46:43.307157+0000","last_change":"2023-12-12T09:46:42.328881+0000","last_active":"2023-12-12T09:46:43.307157+0000","last_peered":"2023-12-12T09:46:43.307157+0000","last_clean":"2023-12-12T09:46:43.307157+0000","last_became_active":"2023-12-12T09:46:42.328582+0000","last_became_peered":"2023-12-12T09:46:42.328582+0000","last_unstale":"2023-12-12T09:46:43.307157+0000","last_undegraded":"2023-12-12T09:46:43.307157+0000","last_fullsized":"2023-12-12T09:46:43.307157+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:41.318400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:41.318400+0000","last_clean_scrub_stamp":"2023-12-12T09:46:41.318400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T16:12:47.720838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-12T09:46:43.355586+0000","last_change":"2023-12-12T09:46:41.369558+0000","last_active":"2023-12-12T09:46:43.355586+0000","last_peered":"2023-12-12T09:46:43.355586+0000","last_clean":"2023-12-12T09:46:43.355586+0000","last_became_active":"2023-12-12T09:46:41.368871+0000","last_became_peered":"2023-12-12T09:46:41.368871+0000","last_unstale":"2023-12-12T09:46:43.355586+0000","last_undegraded":"2023-12-12T09:46:43.355586+0000","last_fullsized":"2023-12-12T09:46:43.355586+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:40.305028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:40.305028+0000","last_clean_scrub_stamp":"2023-12-12T09:46:40.305028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T15:16:25.998563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":15,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-12-12T09:46:42.305473+0000","last_change":"2023-12-12T09:46:26.995503+0000","last_active":"2023-12-12T09:46:42.305473+0000","last_peered":"2023-12-12T09:46:42.305473+0000","last_clean":"2023-12-12T09:46:42.305473+0000","last_became_active":"2023-12-12T09:46:26.995090+0000","last_became_peered":"2023-12-12T09:46:26.995090+0000","last_unstale":"2023-12-12T09:46:42.305473+0000","last_undegraded":"2023-12-12T09:46:42.305473+0000","last_fullsized":"2023-12-12T09:46:42.305473+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_clean_scrub_stamp":"2023-12-12T09:46:25.941843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T15:01:39.944049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":16,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-12-12T09:46:42.317939+0000","last_change":"2023-12-12T09:46:25.997135+0000","last_active":"2023-12-12T09:46:42.317939+0000","last_peered":"2023-12-12T09:46:42.317939+0000","last_clean":"2023-12-12T09:46:42.317939+0000","last_became_active":"2023-12-12T09:46:25.996777+0000","last_became_peered":"2023-12-12T09:46:25.996777+0000","last_unstale":"2023-12-12T09:46:42.317939+0000","last_undegraded":"2023-12-12T09:46:42.317939+0000","last_fullsized":"2023-12-12T09:46:42.317939+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:24.925008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:24.925008+0000","last_clean_scrub_stamp":"2023-12-12T09:46:24.925008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T16:09:35.711601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.e","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-12T09:46:43.362255+0000","last_change":"2023-12-12T09:46:42.321343+0000","last_active":"2023-12-12T09:46:43.362255+0000","last_peered":"2023-12-12T09:46:43.362255+0000","last_clean":"2023-12-12T09:46:43.362255+0000","last_became_active":"2023-12-12T09:46:42.319789+0000","last_became_peered":"2023-12-12T09:46:42.319789+0000","last_unstale":"2023-12-12T09:46:43.362255+0000","last_undegraded":"2023-12-12T09:46:43.362255+0000","last_fullsized":"2023-12-12T09:46:43.362255+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:41.318400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:41.318400+0000","last_clean_scrub_stamp":"2023-12-12T09:46:41.318400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T10:24:23.905103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.f","version":"78'1","reported_seq":13,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-12T09:46:43.360913+0000","last_change":"2023-12-12T09:46:41.368426+0000","last_active":"2023-12-12T09:46:43.360913+0000","last_peered":"2023-12-12T09:46:43.360913+0000","last_clean":"2023-12-12T09:46:43.360913+0000","last_became_active":"2023-12-12T09:46:41.368094+0000","last_became_peered":"2023-12-12T09:46:41.368094+0000","last_unstale":"2023-12-12T09:46:43.360913+0000","last_undegraded":"2023-12-12T09:46:43.360913+0000","last_fullsized":"2023-12-12T09:46:43.360913+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:40.305028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:40.305028+0000","last_clean_scrub_stamp":"2023-12-12T09:46:40.305028+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T11:01:52.288221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":15,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-12-12T09:46:42.325295+0000","last_change":"2023-12-12T09:46:26.994842+0000","last_active":"2023-12-12T09:46:42.325295+0000","last_peered":"2023-12-12T09:46:42.325295+0000","last_clean":"2023-12-12T09:46:42.325295+0000","last_became_active":"2023-12-12T09:46:26.986721+0000","last_became_peered":"2023-12-12T09:46:26.986721+0000","last_unstale":"2023-12-12T09:46:42.325295+0000","last_undegraded":"2023-12-12T09:46:42.325295+0000","last_fullsized":"2023-12-12T09:46:42.325295+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:25.941843+0000","last_clean_scrub_stamp":"2023-12-12T09:46:25.941843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T16:09:36.728436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"74'1","reported_seq":17,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-12-12T09:46:42.317529+0000","last_change":"2023-12-12T09:46:25.996699+0000","last_active":"2023-12-12T09:46:42.317529+0000","last_peered":"2023-12-12T09:46:42.317529+0000","last_clean":"2023-12-12T09:46:42.317529+0000","last_became_active":"2023-12-12T09:46:25.995486+0000","last_became_peered":"2023-12-12T09:46:25.995486+0000","last_unstale":"2023-12-12T09:46:42.317529+0000","last_undegraded":"2023-12-12T09:46:42.317529+0000","last_fullsized":"2023-12-12T09:46:42.317529+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:46:24.925008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:46:24.925008+0000","last_clean_scrub_stamp":"2023-12-12T09:46:24.925008+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T10:24:07.511710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":215,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-12-12T09:46:42.310841+0000","last_change":"2023-12-12T09:43:17.203315+0000","last_active":"2023-12-12T09:46:42.310841+0000","last_peered":"2023-12-12T09:46:42.310841+0000","last_clean":"2023-12-12T09:46:42.310841+0000","last_became_active":"2023-12-12T09:43:17.200779+0000","last_became_peered":"2023-12-12T09:43:17.200779+0000","last_unstale":"2023-12-12T09:46:42.310841+0000","last_undegraded":"2023-12-12T09:46:42.310841+0000","last_fullsized":"2023-12-12T09:46:42.310841+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:43:15.931922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:43:15.931922+0000","last_clean_scrub_stamp":"2023-12-12T09:43:15.931922+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T21:42:10.929640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":15,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":13,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":3905,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":7810,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":14,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":64844,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574894,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32204,"kb_used_data":1024,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339636,"statfs":{"total":96636764160,"available":96603787264,"internally_reserved":0,"allocated":1048576,"data_stored":1025002,"data_compressed":32422,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 12 09:46:16 2023","interfaces":[{"interface":"back","average":{"1min":1.163,"5min":1.046,"15min":1.014},"min":{"1min":0.66300000000000003,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.677,"5min":1.8089999999999999,"15min":1.8089999999999999},"last":1.4890000000000001},{"interface":"front","average":{"1min":1.143,"5min":1.0309999999999999,"15min":0.98299999999999998},"min":{"1min":0.67700000000000005,"5min":0.66300000000000003,"15min":0.66300000000000003},"max":{"1min":1.71,"5min":1.71,"15min":1.71},"last":0.96099999999999997}]},{"osd":1,"last update":"Tue Dec 12 09:46:16 2023","interfaces":[{"interface":"back","average":{"1min":1.3089999999999999,"5min":1.21,"15min":1.202},"min":{"1min":0.79300000000000004,"5min":0.72099999999999997,"15min":0.72099999999999997},"max":{"1min":1.897,"5min":1.897,"15min":1.897},"last":1.403},{"interface":"front","average":{"1min":1.1279999999999999,"5min":1.1830000000000001,"15min":1.2050000000000001},"min":{"1min":0.76300000000000001,"5min":0.71499999999999997,"15min":0.71499999999999997},"max":{"1min":1.4730000000000001,"5min":3.1150000000000002,"15min":3.1150000000000002},"last":1.2749999999999999}]},{"osd":2,"last update":"Tue Dec 12 09:46:16 2023","interfaces":[{"interface":"back","average":{"1min":1.252,"5min":1.2350000000000001,"15min":1.2529999999999999},"min":{"1min":0.89500000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"max":{"1min":1.8129999999999999,"5min":2.2050000000000001,"15min":2.2050000000000001},"last":1.4510000000000001},{"interface":"front","average":{"1min":1.139,"5min":1.2030000000000001,"15min":1.2310000000000001},"min":{"1min":0.72999999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":2.0329999999999999,"5min":3.2759999999999998,"15min":3.2759999999999998},"last":1.0669999999999999}]},{"osd":3,"last update":"Tue Dec 12 09:46:16 2023","interfaces":[{"interface":"back","average":{"1min":1.095,"5min":1.2470000000000001,"15min":1.2929999999999999},"min":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"max":{"1min":1.5900000000000001,"5min":3.1819999999999999,"15min":3.1819999999999999},"last":1.177},{"interface":"front","average":{"1min":1.367,"5min":1.294,"15min":1.294},"min":{"1min":0.88200000000000001,"5min":0.72799999999999998,"15min":0.72799999999999998},"max":{"1min":1.845,"5min":1.8740000000000001,"15min":1.8740000000000001},"last":1.127}]},{"osd":4,"last update":"Tue Dec 12 09:46:16 2023","interfaces":[{"interface":"back","average":{"1min":1.274,"5min":1.3149999999999999,"15min":1.339},"min":{"1min":0.68799999999999994,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.974,"5min":2.5529999999999999,"15min":2.5529999999999999},"last":1.3620000000000001},{"interface":"front","average":{"1min":1.383,"5min":1.395,"15min":1.4350000000000001},"min":{"1min":0.94399999999999995,"5min":0.66000000000000003,"15min":0.66000000000000003},"max":{"1min":2.3759999999999999,"5min":2.3759999999999999,"15min":2.3759999999999999},"last":1.5840000000000001}]},{"osd":5,"last update":"Tue Dec 12 09:46:16 2023","interfaces":[{"interface":"back","average":{"1min":1.4379999999999999,"5min":1.347,"15min":1.339},"min":{"1min":0.622,"5min":0.622,"15min":0.622},"max":{"1min":1.9890000000000001,"5min":1.9890000000000001,"15min":1.9890000000000001},"last":1.3200000000000001},{"interface":"front","average":{"1min":1.498,"5min":1.4990000000000001,"15min":1.524},"min":{"1min":1.0529999999999999,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":2.0259999999999998,"5min":2.4159999999999999,"15min":2.4159999999999999},"last":1.5249999999999999}]},{"osd":6,"last update":"Tue Dec 12 09:46:16 2023","interfaces":[{"interface":"back","average":{"1min":1.4019999999999999,"5min":1.4159999999999999,"15min":1.4159999999999999},"min":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"max":{"1min":1.9970000000000001,"5min":2.0510000000000002,"15min":2.0510000000000002},"last":1.232},{"interface":"front","average":{"1min":1.5649999999999999,"5min":1.591,"15min":1.6200000000000001},"min":{"1min":1.1970000000000001,"5min":0.71899999999999997,"15min":0.71899999999999997},"max":{"1min":2.0899999999999999,"5min":2.5800000000000001,"15min":2.5800000000000001},"last":1.635}]}]},{"osd":6,"up_from":13,"seq":55834574892,"num_pgs":53,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32148,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339692,"statfs":{"total":96636764160,"available":96603844608,"internally_reserved":0,"allocated":991232,"data_stored":435798,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 12 09:46:17 2023","interfaces":[{"interface":"back","average":{"1min":0.995,"5min":1.1080000000000001,"15min":1.1639999999999999},"min":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.4390000000000001,"5min":3.6429999999999998,"15min":3.6429999999999998},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.99299999999999999,"5min":1.0640000000000001,"15min":1.0680000000000001},"min":{"1min":0.60099999999999998,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.546,"5min":2.6059999999999999,"15min":2.6059999999999999},"last":0.748}]},{"osd":1,"last update":"Tue Dec 12 09:46:17 2023","interfaces":[{"interface":"back","average":{"1min":1.0589999999999999,"5min":1.081,"15min":1.0680000000000001},"min":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"max":{"1min":1.5069999999999999,"5min":2.0169999999999999,"15min":2.0169999999999999},"last":0.71399999999999997},{"interface":"front","average":{"1min":1.1359999999999999,"5min":1.1819999999999999,"15min":1.194},"min":{"1min":0.82399999999999995,"5min":0.72899999999999998,"15min":0.72899999999999998},"max":{"1min":1.4810000000000001,"5min":1.7,"15min":1.7},"last":0.94499999999999995}]},{"osd":2,"last update":"Tue Dec 12 09:46:17 2023","interfaces":[{"interface":"back","average":{"1min":1.218,"5min":1.2150000000000001,"15min":1.2290000000000001},"min":{"1min":0.87,"5min":0.71199999999999997,"15min":0.71199999999999997},"max":{"1min":1.5309999999999999,"5min":1.804,"15min":1.804},"last":1.131},{"interface":"front","average":{"1min":1.2050000000000001,"5min":1.258,"15min":1.294},"min":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":1.6799999999999999,"5min":2.2160000000000002,"15min":2.2160000000000002},"last":0.88600000000000001}]},{"osd":3,"last update":"Tue Dec 12 09:46:17 2023","interfaces":[{"interface":"back","average":{"1min":1.196,"5min":1.2110000000000001,"15min":1.2150000000000001},"min":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"max":{"1min":1.4339999999999999,"5min":2.665,"15min":2.665},"last":1.0269999999999999},{"interface":"front","average":{"1min":1.149,"5min":1.1899999999999999,"15min":1.2170000000000001},"min":{"1min":0.75700000000000001,"5min":0.65700000000000003,"15min":0.65700000000000003},"max":{"1min":1.5760000000000001,"5min":1.8620000000000001,"15min":1.8620000000000001},"last":0.80400000000000005}]},{"osd":4,"last update":"Tue Dec 12 09:46:17 2023","interfaces":[{"interface":"back","average":{"1min":1.3220000000000001,"5min":1.284,"15min":1.278},"min":{"1min":0.98199999999999998,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":1.631,"5min":2.0310000000000001,"15min":2.0310000000000001},"last":1.248},{"interface":"front","average":{"1min":1.4279999999999999,"5min":1.4079999999999999,"15min":1.407},"min":{"1min":0.95199999999999996,"5min":0.66200000000000003,"15min":0.66200000000000003},"max":{"1min":1.657,"5min":2.2799999999999998,"15min":2.2799999999999998},"last":1.296}]},{"osd":5,"last update":"Tue Dec 12 09:46:17 2023","interfaces":[{"interface":"back","average":{"1min":1.266,"5min":1.377,"15min":1.419},"min":{"1min":0.90700000000000003,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.7030000000000001,"5min":2.1739999999999999,"15min":2.1739999999999999},"last":1.1819999999999999},{"interface":"front","average":{"1min":1.494,"5min":1.4790000000000001,"15min":1.4770000000000001},"min":{"1min":1.175,"5min":0.80100000000000005,"15min":0.80100000000000005},"max":{"1min":1.76,"5min":1.929,"15min":1.929},"last":1.351}]},{"osd":7,"last update":"Tue Dec 12 09:46:17 2023","interfaces":[{"interface":"back","average":{"1min":1.448,"5min":1.476,"15min":1.498},"min":{"1min":1.03,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.8759999999999999,"5min":1.994,"15min":1.994},"last":1.2230000000000001},{"interface":"front","average":{"1min":1.4139999999999999,"5min":1.4810000000000001,"15min":1.5189999999999999},"min":{"1min":1.0389999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"max":{"1min":1.792,"5min":2.0800000000000001,"15min":2.0800000000000001},"last":1.073}]}]},{"osd":5,"up_from":13,"seq":55834574892,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32148,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339692,"statfs":{"total":96636764160,"available":96603844608,"internally_reserved":0,"allocated":991232,"data_stored":437651,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 12 09:46:17 2023","interfaces":[{"interface":"back","average":{"1min":1.0509999999999999,"5min":1.026,"15min":1.022},"min":{"1min":0.73799999999999999,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.5089999999999999,"5min":1.7310000000000001,"15min":1.7310000000000001},"last":0.90700000000000003},{"interface":"front","average":{"1min":1.077,"5min":1.101,"15min":1.1200000000000001},"min":{"1min":0.69899999999999995,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.4219999999999999,"5min":1.595,"15min":1.595},"last":0.68500000000000005}]},{"osd":1,"last update":"Tue Dec 12 09:46:17 2023","interfaces":[{"interface":"back","average":{"1min":1.075,"5min":1.1499999999999999,"15min":1.2},"min":{"1min":0.86699999999999999,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.343,"5min":1.756,"15min":1.756},"last":1.48},{"interface":"front","average":{"1min":1.052,"5min":1.079,"15min":1.087},"min":{"1min":0.752,"5min":0.66400000000000003,"15min":0.66400000000000003},"max":{"1min":1.5129999999999999,"5min":1.5840000000000001,"15min":1.5840000000000001},"last":0.97299999999999998}]},{"osd":2,"last update":"Tue Dec 12 09:46:17 2023","interfaces":[{"interface":"back","average":{"1min":1.1579999999999999,"5min":1.254,"15min":1.296},"min":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"max":{"1min":1.744,"5min":1.7889999999999999,"15min":1.7889999999999999},"last":1.1220000000000001},{"interface":"front","average":{"1min":1.089,"5min":1.3009999999999999,"15min":1.381},"min":{"1min":0.77000000000000002,"5min":0.72899999999999998,"15min":0.72899999999999998},"max":{"1min":1.556,"5min":2.1600000000000001,"15min":2.1600000000000001},"last":1.0429999999999999}]},{"osd":3,"last update":"Tue Dec 12 09:46:17 2023","interfaces":[{"interface":"back","average":{"1min":1.1659999999999999,"5min":1.296,"15min":1.3460000000000001},"min":{"1min":0.90100000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"max":{"1min":1.627,"5min":2.1499999999999999,"15min":2.1499999999999999},"last":1.5189999999999999},{"interface":"front","average":{"1min":1.3540000000000001,"5min":1.413,"15min":1.4650000000000001},"min":{"1min":1.038,"5min":0.75800000000000001,"15min":0.75800000000000001},"max":{"1min":2.0249999999999999,"5min":2.0249999999999999,"15min":2.0249999999999999},"last":1.222}]},{"osd":4,"last update":"Tue Dec 12 09:46:17 2023","interfaces":[{"interface":"back","average":{"1min":1.2310000000000001,"5min":1.4019999999999999,"15min":1.4610000000000001},"min":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":1.9790000000000001,"5min":2.391,"15min":2.391},"last":1.1719999999999999},{"interface":"front","average":{"1min":1.4419999999999999,"5min":1.53,"15min":1.5680000000000001},"min":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"max":{"1min":2.6040000000000001,"5min":2.6040000000000001,"15min":2.6040000000000001},"last":1.3640000000000001}]},{"osd":6,"last update":"Tue Dec 12 09:46:17 2023","interfaces":[{"interface":"back","average":{"1min":1.4390000000000001,"5min":1.5109999999999999,"15min":1.5669999999999999},"min":{"1min":0.74099999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":2.1179999999999999,"5min":2.1179999999999999,"15min":2.1179999999999999},"last":1.3200000000000001},{"interface":"front","average":{"1min":1.2829999999999999,"5min":1.5089999999999999,"15min":1.5900000000000001},"min":{"1min":0.80700000000000005,"5min":0.627,"15min":0.627},"max":{"1min":1.7849999999999999,"5min":2.306,"15min":2.306},"last":1.2669999999999999}]},{"osd":7,"last update":"Tue Dec 12 09:46:17 2023","interfaces":[{"interface":"back","average":{"1min":1.546,"5min":1.6870000000000001,"15min":1.752},"min":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"max":{"1min":2.2200000000000002,"5min":2.6880000000000002,"15min":2.6880000000000002},"last":1.6140000000000001},{"interface":"front","average":{"1min":1.605,"5min":1.6599999999999999,"15min":1.718},"min":{"1min":1.1479999999999999,"5min":0.88600000000000001,"15min":0.88600000000000001},"max":{"1min":2.4910000000000001,"5min":2.4910000000000001,"15min":2.4910000000000001},"last":1.5600000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574894,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32148,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339692,"statfs":{"total":96636764160,"available":96603844608,"internally_reserved":0,"allocated":991232,"data_stored":436188,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 12 09:46:19 2023","interfaces":[{"interface":"back","average":{"1min":1.0980000000000001,"5min":1.0549999999999999,"15min":1.0549999999999999},"min":{"1min":0.67400000000000004,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":1.5880000000000001,"5min":1.7010000000000001,"15min":1.7010000000000001},"last":1.2470000000000001},{"interface":"front","average":{"1min":1.145,"5min":1.0589999999999999,"15min":1.056},"min":{"1min":0.75800000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":1.5449999999999999,"5min":1.5449999999999999,"15min":1.5449999999999999},"last":1.1879999999999999}]},{"osd":1,"last update":"Tue Dec 12 09:46:19 2023","interfaces":[{"interface":"back","average":{"1min":1.0529999999999999,"5min":1.048,"15min":1.0449999999999999},"min":{"1min":0.748,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":1.496,"5min":1.496,"15min":1.496},"last":0.93000000000000005},{"interface":"front","average":{"1min":1.133,"5min":1.163,"15min":1.175},"min":{"1min":0.75900000000000001,"5min":0.73699999999999999,"15min":0.73699999999999999},"max":{"1min":1.6140000000000001,"5min":1.8720000000000001,"15min":1.8720000000000001},"last":1.389}]},{"osd":2,"last update":"Tue Dec 12 09:46:19 2023","interfaces":[{"interface":"back","average":{"1min":1.181,"5min":1.1359999999999999,"15min":1.1240000000000001},"min":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"max":{"1min":1.585,"5min":1.585,"15min":1.585},"last":0.96299999999999997},{"interface":"front","average":{"1min":1.226,"5min":1.2689999999999999,"15min":1.2849999999999999},"min":{"1min":0.80800000000000005,"5min":0.75600000000000001,"15min":0.75600000000000001},"max":{"1min":1.554,"5min":2.1640000000000001,"15min":2.1640000000000001},"last":1.611}]},{"osd":3,"last update":"Tue Dec 12 09:46:19 2023","interfaces":[{"interface":"back","average":{"1min":1.3620000000000001,"5min":1.2450000000000001,"15min":1.2170000000000001},"min":{"1min":1.03,"5min":0.83399999999999996,"15min":0.83399999999999996},"max":{"1min":1.7010000000000001,"5min":1.7010000000000001,"15min":1.7010000000000001},"last":1.0700000000000001},{"interface":"front","average":{"1min":1.24,"5min":1.2350000000000001,"15min":1.2370000000000001},"min":{"1min":0.86099999999999999,"5min":0.70599999999999996,"15min":0.70599999999999996},"max":{"1min":1.506,"5min":2.0499999999999998,"15min":2.0499999999999998},"last":0.80600000000000005}]},{"osd":5,"last update":"Tue Dec 12 09:46:19 2023","interfaces":[{"interface":"back","average":{"1min":1.4139999999999999,"5min":1.4179999999999999,"15min":1.4510000000000001},"min":{"1min":1.026,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.7350000000000001,"5min":2.3159999999999998,"15min":2.3159999999999998},"last":1.694},{"interface":"front","average":{"1min":1.4890000000000001,"5min":1.3799999999999999,"15min":1.3600000000000001},"min":{"1min":1.2509999999999999,"5min":0.71199999999999997,"15min":0.71199999999999997},"max":{"1min":1.8160000000000001,"5min":2.117,"15min":2.117},"last":1.4339999999999999}]},{"osd":6,"last update":"Tue Dec 12 09:46:19 2023","interfaces":[{"interface":"back","average":{"1min":1.3799999999999999,"5min":1.381,"15min":1.395},"min":{"1min":0.98099999999999998,"5min":0.81200000000000006,"15min":0.81200000000000006},"max":{"1min":1.7090000000000001,"5min":2.246,"15min":2.246},"last":1.139},{"interface":"front","average":{"1min":1.5609999999999999,"5min":1.5329999999999999,"15min":1.5429999999999999},"min":{"1min":1.0700000000000001,"5min":0.65600000000000003,"15min":0.65600000000000003},"max":{"1min":1.7949999999999999,"5min":2.5099999999999998,"15min":2.5099999999999998},"last":1.522}]},{"osd":7,"last update":"Tue Dec 12 09:46:19 2023","interfaces":[{"interface":"back","average":{"1min":1.5720000000000001,"5min":1.51,"15min":1.506},"min":{"1min":1.1970000000000001,"5min":0.77500000000000002,"15min":0.77500000000000002},"max":{"1min":1.9099999999999999,"5min":2.5710000000000002,"15min":2.5710000000000002},"last":1.3220000000000001},{"interface":"front","average":{"1min":1.5640000000000001,"5min":1.522,"15min":1.516},"min":{"1min":1.2490000000000001,"5min":1.0600000000000001,"15min":1.0600000000000001},"max":{"1min":2.016,"5min":2.3919999999999999,"15min":2.3919999999999999},"last":1.0349999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574892,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32156,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339684,"statfs":{"total":96636764160,"available":96603836416,"internally_reserved":0,"allocated":999424,"data_stored":439193,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 12 09:46:19 2023","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.84599999999999997,"15min":0.89000000000000001},"min":{"1min":0.35099999999999998,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":1.2350000000000001,"5min":1.4830000000000001,"15min":1.4830000000000001},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.93600000000000005,"5min":1.012,"15min":1.095},"min":{"1min":0.47699999999999998,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":1.839,"5min":3.3370000000000002,"15min":3.3370000000000002},"last":0.92300000000000004}]},{"osd":1,"last update":"Tue Dec 12 09:46:19 2023","interfaces":[{"interface":"back","average":{"1min":0.88100000000000001,"5min":0.875,"15min":0.90500000000000003},"min":{"1min":0.52200000000000002,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":1.4870000000000001,"5min":1.4870000000000001,"15min":1.4870000000000001},"last":0.78900000000000003},{"interface":"front","average":{"1min":1.0580000000000001,"5min":1.0209999999999999,"15min":1.0529999999999999},"min":{"1min":0.58399999999999996,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.542,"5min":2.9409999999999998,"15min":2.9409999999999998},"last":1.226}]},{"osd":2,"last update":"Tue Dec 12 09:46:19 2023","interfaces":[{"interface":"back","average":{"1min":0.94599999999999995,"5min":1.0760000000000001,"15min":1.1499999999999999},"min":{"1min":0.56100000000000005,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.6899999999999999,"5min":2.613,"15min":2.613},"last":1.048},{"interface":"front","average":{"1min":1.0489999999999999,"5min":1.1000000000000001,"15min":1.1559999999999999},"min":{"1min":0.53600000000000003,"5min":0.437,"15min":0.437},"max":{"1min":1.53,"5min":3.0430000000000001,"15min":3.0430000000000001},"last":0.89300000000000002}]},{"osd":4,"last update":"Tue Dec 12 09:46:19 2023","interfaces":[{"interface":"back","average":{"1min":1.129,"5min":1.2989999999999999,"15min":1.355},"min":{"1min":0.77200000000000002,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.7410000000000001,"5min":3.5019999999999998,"15min":3.5019999999999998},"last":1.407},{"interface":"front","average":{"1min":1.1850000000000001,"5min":1.355,"15min":1.4399999999999999},"min":{"1min":0.93500000000000005,"5min":0.755,"15min":0.755},"max":{"1min":1.528,"5min":2.9889999999999999,"15min":2.9889999999999999},"last":1.536}]},{"osd":5,"last update":"Tue Dec 12 09:46:19 2023","interfaces":[{"interface":"back","average":{"1min":1.306,"5min":1.4119999999999999,"15min":1.47},"min":{"1min":0.876,"5min":0.68000000000000005,"15min":0.68000000000000005},"max":{"1min":1.7370000000000001,"5min":4.2480000000000002,"15min":4.2480000000000002},"last":1.4770000000000001},{"interface":"front","average":{"1min":1.2430000000000001,"5min":1.4450000000000001,"15min":1.5429999999999999},"min":{"1min":0.746,"5min":0.72999999999999998,"15min":0.72999999999999998},"max":{"1min":1.609,"5min":5.5060000000000002,"15min":5.5060000000000002},"last":1.1850000000000001}]},{"osd":6,"last update":"Tue Dec 12 09:46:19 2023","interfaces":[{"interface":"back","average":{"1min":1.2669999999999999,"5min":1.353,"15min":1.423},"min":{"1min":0.77700000000000002,"5min":0.76500000000000001,"15min":0.76500000000000001},"max":{"1min":1.6799999999999999,"5min":3.1400000000000001,"15min":3.1400000000000001},"last":1.4279999999999999},{"interface":"front","average":{"1min":1.3540000000000001,"5min":1.456,"15min":1.516},"min":{"1min":0.92200000000000004,"5min":0.627,"15min":0.627},"max":{"1min":1.677,"5min":4.3179999999999996,"15min":4.3179999999999996},"last":1.3740000000000001}]},{"osd":7,"last update":"Tue Dec 12 09:46:19 2023","interfaces":[{"interface":"back","average":{"1min":1.3069999999999999,"5min":1.4630000000000001,"15min":1.5489999999999999},"min":{"1min":0.78100000000000003,"5min":0.77400000000000002,"15min":0.77400000000000002},"max":{"1min":1.627,"5min":5.3979999999999997,"15min":5.3979999999999997},"last":1.0069999999999999},{"interface":"front","average":{"1min":1.371,"5min":1.452,"15min":1.52},"min":{"1min":0.83799999999999997,"5min":0.74299999999999999,"15min":0.74299999999999999},"max":{"1min":1.7769999999999999,"5min":3.4129999999999998,"15min":3.4129999999999998},"last":1.3220000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574892,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32136,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339704,"statfs":{"total":96636764160,"available":96603856896,"internally_reserved":0,"allocated":978944,"data_stored":435068,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 12 09:46:17 2023","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":0.80400000000000005,"15min":0.81399999999999995},"min":{"1min":0.37,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":1.431,"5min":1.458,"15min":1.458},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.88500000000000001,"5min":0.89400000000000002,"15min":0.90600000000000003},"min":{"1min":0.36099999999999999,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":2.4129999999999998,"5min":2.4129999999999998,"15min":2.4129999999999998},"last":0.86799999999999999}]},{"osd":1,"last update":"Tue Dec 12 09:46:17 2023","interfaces":[{"interface":"back","average":{"1min":0.81299999999999994,"5min":0.84699999999999998,"15min":0.85799999999999998},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":1.2450000000000001,"5min":1.593,"15min":1.593},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.98399999999999999,"5min":0.89700000000000002,"15min":0.89000000000000001},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.514,"5min":1.758,"15min":1.758},"last":1.169}]},{"osd":3,"last update":"Tue Dec 12 09:46:17 2023","interfaces":[{"interface":"back","average":{"1min":1.0589999999999999,"5min":1.034,"15min":1.0489999999999999},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":1.889,"5min":1.889,"15min":1.889},"last":0.93400000000000005},{"interface":"front","average":{"1min":0.91300000000000003,"5min":0.96099999999999997,"15min":0.99299999999999999},"min":{"1min":0.442,"5min":0.432,"15min":0.432},"max":{"1min":1.472,"5min":1.8120000000000001,"15min":1.8120000000000001},"last":0.56499999999999995}]},{"osd":4,"last update":"Tue Dec 12 09:46:17 2023","interfaces":[{"interface":"back","average":{"1min":1.1359999999999999,"5min":1.1910000000000001,"15min":1.2150000000000001},"min":{"1min":0.753,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.8300000000000001,"5min":2.5760000000000001,"15min":2.5760000000000001},"last":0.83799999999999997},{"interface":"front","average":{"1min":1.175,"5min":1.3080000000000001,"15min":1.365},"min":{"1min":0.747,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.6259999999999999,"5min":2.8069999999999999,"15min":2.8069999999999999},"last":1.613}]},{"osd":5,"last update":"Tue Dec 12 09:46:17 2023","interfaces":[{"interface":"back","average":{"1min":1.2210000000000001,"5min":1.3360000000000001,"15min":1.3640000000000001},"min":{"1min":0.81699999999999995,"5min":0.80500000000000005,"15min":0.80500000000000005},"max":{"1min":1.7150000000000001,"5min":2.3109999999999999,"15min":2.3109999999999999},"last":1.121},{"interface":"front","average":{"1min":1.159,"5min":1.2809999999999999,"15min":1.327},"min":{"1min":0.79400000000000004,"5min":0.627,"15min":0.627},"max":{"1min":1.5660000000000001,"5min":2.5110000000000001,"15min":2.5110000000000001},"last":1.008}]},{"osd":6,"last update":"Tue Dec 12 09:46:17 2023","interfaces":[{"interface":"back","average":{"1min":1.2589999999999999,"5min":1.379,"15min":1.417},"min":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":1.77,"5min":2.907,"15min":2.907},"last":1.5549999999999999},{"interface":"front","average":{"1min":1.3120000000000001,"5min":1.3999999999999999,"15min":1.419},"min":{"1min":0.83899999999999997,"5min":0.82799999999999996,"15min":0.82799999999999996},"max":{"1min":1.7809999999999999,"5min":2.6000000000000001,"15min":2.6000000000000001},"last":0.99199999999999999}]},{"osd":7,"last update":"Tue Dec 12 09:46:17 2023","interfaces":[{"interface":"back","average":{"1min":1.333,"5min":1.401,"15min":1.4379999999999999},"min":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"max":{"1min":1.7669999999999999,"5min":2.3370000000000002,"15min":2.3370000000000002},"last":1.48},{"interface":"front","average":{"1min":1.3779999999999999,"5min":1.466,"15min":1.4970000000000001},"min":{"1min":0.96499999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"max":{"1min":1.95,"5min":2.488,"15min":2.488},"last":1.03}]}]},{"osd":1,"up_from":13,"seq":55834574892,"num_pgs":57,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32140,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339700,"statfs":{"total":96636764160,"available":96603852800,"internally_reserved":0,"allocated":983040,"data_stored":434646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 12 09:46:17 2023","interfaces":[{"interface":"back","average":{"1min":0.82599999999999996,"5min":0.83699999999999997,"15min":0.84899999999999998},"min":{"1min":0.56299999999999994,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":1.427,"5min":2.794,"15min":2.794},"last":1.4039999999999999},{"interface":"front","average":{"1min":0.749,"5min":0.82599999999999996,"15min":0.85199999999999998},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":1.5,"5min":2.1379999999999999,"15min":2.1379999999999999},"last":0.66900000000000004}]},{"osd":2,"last update":"Tue Dec 12 09:46:17 2023","interfaces":[{"interface":"back","average":{"1min":0.82899999999999996,"5min":0.93500000000000005,"15min":0.96899999999999997},"min":{"1min":0.59099999999999997,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":1.4450000000000001,"5min":6.3390000000000004,"15min":6.3390000000000004},"last":0.93200000000000005},{"interface":"front","average":{"1min":0.89100000000000001,"5min":0.94699999999999995,"15min":0.95999999999999996},"min":{"1min":0.56799999999999995,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.1830000000000001,"5min":2.823,"15min":2.823},"last":1.2}]},{"osd":3,"last update":"Tue Dec 12 09:46:17 2023","interfaces":[{"interface":"back","average":{"1min":0.94999999999999996,"5min":1.0329999999999999,"15min":1.0449999999999999},"min":{"1min":0.53200000000000003,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":1.5549999999999999,"5min":2.7519999999999998,"15min":2.7519999999999998},"last":1.919},{"interface":"front","average":{"1min":0.88200000000000001,"5min":0.98399999999999999,"15min":1},"min":{"1min":0.498,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":1.212,"5min":2.2559999999999998,"15min":2.2559999999999998},"last":1.0860000000000001}]},{"osd":4,"last update":"Tue Dec 12 09:46:17 2023","interfaces":[{"interface":"back","average":{"1min":1.159,"5min":1.2929999999999999,"15min":1.363},"min":{"1min":0.78700000000000003,"5min":0.68400000000000005,"15min":0.68400000000000005},"max":{"1min":1.484,"5min":6.423,"15min":6.423},"last":1.1499999999999999},{"interface":"front","average":{"1min":1.1799999999999999,"5min":1.1899999999999999,"15min":1.1919999999999999},"min":{"1min":0.84499999999999997,"5min":0.80000000000000004,"15min":0.80000000000000004},"max":{"1min":1.474,"5min":2.2309999999999999,"15min":2.2309999999999999},"last":1.615}]},{"osd":5,"last update":"Tue Dec 12 09:46:17 2023","interfaces":[{"interface":"back","average":{"1min":1.145,"5min":1.353,"15min":1.429},"min":{"1min":0.93799999999999994,"5min":0.80200000000000005,"15min":0.80200000000000005},"max":{"1min":1.4970000000000001,"5min":6.2830000000000004,"15min":6.2830000000000004},"last":1.4350000000000001},{"interface":"front","average":{"1min":1.2310000000000001,"5min":1.325,"15min":1.3580000000000001},"min":{"1min":0.88900000000000001,"5min":0.83499999999999996,"15min":0.83499999999999996},"max":{"1min":1.4390000000000001,"5min":2.73,"15min":2.73},"last":1.367}]},{"osd":6,"last update":"Tue Dec 12 09:46:17 2023","interfaces":[{"interface":"back","average":{"1min":1.236,"5min":1.446,"15min":1.522},"min":{"1min":0.84499999999999997,"5min":0.751,"15min":0.751},"max":{"1min":1.7210000000000001,"5min":6.468,"15min":6.468},"last":1.8520000000000001},{"interface":"front","average":{"1min":1.2430000000000001,"5min":1.4470000000000001,"15min":1.5349999999999999},"min":{"1min":0.90400000000000003,"5min":0.84699999999999998,"15min":0.84699999999999998},"max":{"1min":1.585,"5min":6.3129999999999997,"15min":6.3129999999999997},"last":1.522}]},{"osd":7,"last update":"Tue Dec 12 09:46:17 2023","interfaces":[{"interface":"back","average":{"1min":1.3300000000000001,"5min":1.3759999999999999,"15min":1.3959999999999999},"min":{"1min":0.99099999999999999,"5min":0.82999999999999996,"15min":0.82999999999999996},"max":{"1min":1.5980000000000001,"5min":2.9009999999999998,"15min":2.9009999999999998},"last":1.732},{"interface":"front","average":{"1min":1.2529999999999999,"5min":1.4530000000000001,"15min":1.5209999999999999},"min":{"1min":0.92400000000000004,"5min":0.752,"15min":0.752},"max":{"1min":1.6379999999999999,"5min":6.242,"15min":6.242},"last":1.2589999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574894,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32200,"kb_used_data":1020,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339640,"statfs":{"total":96636764160,"available":96603791360,"internally_reserved":0,"allocated":1044480,"data_stored":1025436,"data_compressed":32422,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Dec 12 09:46:19 2023","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.78000000000000003,"15min":0.77400000000000002},"min":{"1min":0.40699999999999997,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":1.3600000000000001,"5min":1.639,"15min":1.639},"last":0.93899999999999995},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.82999999999999996,"15min":0.82099999999999995},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":1.5509999999999999,"5min":1.5680000000000001,"15min":1.5680000000000001},"last":1.2070000000000001}]},{"osd":2,"last update":"Tue Dec 12 09:46:19 2023","interfaces":[{"interface":"back","average":{"1min":0.86399999999999999,"5min":0.88,"15min":0.86799999999999999},"min":{"1min":0.47299999999999998,"5min":0.316,"15min":0.316},"max":{"1min":1.466,"5min":1.748,"15min":1.748},"last":1.042},{"interface":"front","average":{"1min":0.84299999999999997,"5min":0.97499999999999998,"15min":0.98799999999999999},"min":{"1min":0.48399999999999999,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":1.26,"5min":1.649,"15min":1.649},"last":1.0920000000000001}]},{"osd":3,"last update":"Tue Dec 12 09:46:19 2023","interfaces":[{"interface":"back","average":{"1min":0.83499999999999996,"5min":0.84099999999999997,"15min":0.84899999999999998},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":1.901,"5min":1.901,"15min":1.901},"last":1.3939999999999999},{"interface":"front","average":{"1min":1.002,"5min":1.0129999999999999,"15min":1.0069999999999999},"min":{"1min":0.50700000000000001,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":2.3210000000000002,"5min":2.3210000000000002,"15min":2.3210000000000002},"last":1.2969999999999999}]},{"osd":4,"last update":"Tue Dec 12 09:46:19 2023","interfaces":[{"interface":"back","average":{"1min":1.2250000000000001,"5min":1.284,"15min":1.286},"min":{"1min":0.81399999999999995,"5min":0.80400000000000005,"15min":0.80400000000000005},"max":{"1min":1.5660000000000001,"5min":2.073,"15min":2.073},"last":1.4359999999999999},{"interface":"front","average":{"1min":1.248,"5min":1.2649999999999999,"15min":1.2829999999999999},"min":{"1min":0.85899999999999999,"5min":0.64400000000000002,"15min":0.64400000000000002},"max":{"1min":1.714,"5min":3.0699999999999998,"15min":3.0699999999999998},"last":1.708}]},{"osd":5,"last update":"Tue Dec 12 09:46:19 2023","interfaces":[{"interface":"back","average":{"1min":1.177,"5min":1.2090000000000001,"15min":1.2250000000000001},"min":{"1min":0.68600000000000005,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.698,"5min":3.1909999999999998,"15min":3.1909999999999998},"last":1.5660000000000001},{"interface":"front","average":{"1min":1.266,"5min":1.292,"15min":1.302},"min":{"1min":0.89700000000000002,"5min":0.67300000000000004,"15min":0.67300000000000004},"max":{"1min":2.2120000000000002,"5min":2.2120000000000002,"15min":2.2120000000000002},"last":1.4810000000000001}]},{"osd":6,"last update":"Tue Dec 12 09:46:19 2023","interfaces":[{"interface":"back","average":{"1min":1.3260000000000001,"5min":1.3340000000000001,"15min":1.3360000000000001},"min":{"1min":0.84999999999999998,"5min":0.67500000000000004,"15min":0.67500000000000004},"max":{"1min":1.643,"5min":2.04,"15min":2.04},"last":1.6180000000000001},{"interface":"front","average":{"1min":1.296,"5min":1.3660000000000001,"15min":1.383},"min":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"max":{"1min":2.3500000000000001,"5min":2.9100000000000001,"15min":2.9100000000000001},"last":1.3400000000000001}]},{"osd":7,"last update":"Tue Dec 12 09:46:19 2023","interfaces":[{"interface":"back","average":{"1min":1.3280000000000001,"5min":1.4119999999999999,"15min":1.4339999999999999},"min":{"1min":0.78100000000000003,"5min":0.66800000000000004,"15min":0.66800000000000004},"max":{"1min":1.7929999999999999,"5min":2.992,"15min":2.992},"last":1.6599999999999999},{"interface":"front","average":{"1min":1.3280000000000001,"5min":1.327,"15min":1.329},"min":{"1min":0.93500000000000005,"5min":0.79500000000000004,"15min":0.79500000000000004},"max":{"1min":2.1440000000000001,"5min":2.7690000000000001,"15min":2.7690000000000001},"last":1.24}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32422,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32422,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3107,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":3129,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-12T09:46:47.357 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-12-12T09:46:47.358 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.1 mon 'allow r' osd 'allow rw pool=cephfs2_data' mds allow 2023-12-12T09:46:47.619 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:47.617+0000 7f17f4b7c640 1 Processor -- start 2023-12-12T09:46:47.619 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:47.617+0000 7f17f4b7c640 1 -- start start 2023-12-12T09:46:47.620 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:47.618+0000 7f17f4b7c640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f17f014f8c0 0x7f17f006dc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:47.620 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:47.619+0000 7f17f4b7c640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f17f006d350 0x7f17f0071e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:47.620 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:47.619+0000 7f17f4b7c640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17f00c16c0 con 0x7f17f00723a0 2023-12-12T09:46:47.620 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:47.619+0000 7f17f4b7c640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17f00c1090 con 0x7f17f006d350 2023-12-12T09:46:47.621 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:47.619+0000 7f17f4b7c640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17f00c14b0 con 0x7f17f014f8c0 2023-12-12T09:46:47.621 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:47.619+0000 7f17edd9b640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f17f006d350 0x7f17f0071e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:47.621 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:47.619+0000 7f17edd9b640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f17f006d350 0x7f17f0071e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:53998/0 (socket says 172.21.15.73:53998) 2023-12-12T09:46:47.621 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:47.619+0000 7f17edd9b640 1 -- 172.21.15.73:0/692361358 learned_addr learned my addr 172.21.15.73:0/692361358 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:46:47.621 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:47.619+0000 7f17edd9b640 1 -- 172.21.15.73:0/692361358 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f17f014f8c0 msgr2=0x7f17f006dc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:46:47.621 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:47.619+0000 7f17edd9b640 1 --2- 172.21.15.73:0/692361358 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f17f014f8c0 0x7f17f006dc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:47.621 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:47.619+0000 7f17edd9b640 1 -- 172.21.15.73:0/692361358 >> v1:172.21.15.142:6789/0 conn(0x7f17f00723a0 legacy=0x7f17f0152500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:46:47.622 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:47.619+0000 7f17edd9b640 1 -- 172.21.15.73:0/692361358 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17f00c19a0 con 0x7f17f006d350 2023-12-12T09:46:47.622 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:47.621+0000 7f17edd9b640 1 --2- 172.21.15.73:0/692361358 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f17f006d350 0x7f17f0071e60 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 crypto rx=0x7f17e40098a0 tx=0x7f17e402b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b186d7f2d17e8888 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:46:47.622 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:47.621+0000 7f17ed59a640 1 -- 172.21.15.73:0/692361358 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17e4031640 con 0x7f17f006d350 2023-12-12T09:46:47.622 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:47.621+0000 7f17ed59a640 1 -- 172.21.15.73:0/692361358 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17e40317a0 con 0x7f17f006d350 2023-12-12T09:46:47.623 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:47.621+0000 7f17ed59a640 1 -- 172.21.15.73:0/692361358 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17e4031b30 con 0x7f17f006d350 2023-12-12T09:46:47.623 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:47.622+0000 7f17f4b7c640 1 -- 172.21.15.73:0/692361358 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f17f006d350 msgr2=0x7f17f0071e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:47.624 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:47.622+0000 7f17f4b7c640 1 --2- 172.21.15.73:0/692361358 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f17f006d350 0x7f17f0071e60 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 crypto rx=0x7f17e40098a0 tx=0x7f17e402b8f0 comp rx=0 tx=0).stop 2023-12-12T09:46:47.624 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:47.622+0000 7f17f4b7c640 1 -- 172.21.15.73:0/692361358 shutdown_connections 2023-12-12T09:46:47.624 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:47.622+0000 7f17f4b7c640 1 --2- 172.21.15.73:0/692361358 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f17f006d350 0x7f17f0071e60 unknown :-1 s=CLOSED pgs=943 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:47.624 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:47.622+0000 7f17f4b7c640 1 --2- 172.21.15.73:0/692361358 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f17f014f8c0 0x7f17f006dc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:47.624 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:47.622+0000 7f17f4b7c640 1 -- 172.21.15.73:0/692361358 >> 172.21.15.73:0/692361358 conn(0x7f17f006a4e0 msgr2=0x7f17f006a8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:46:47.624 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:47.622+0000 7f17f4b7c640 1 -- 172.21.15.73:0/692361358 shutdown_connections 2023-12-12T09:46:47.624 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:47.622+0000 7f17f4b7c640 1 -- 172.21.15.73:0/692361358 wait complete. 2023-12-12T09:46:47.625 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:47.624+0000 7f17f4b7c640 1 Processor -- start 2023-12-12T09:46:47.625 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:47.624+0000 7f17f4b7c640 1 -- start start 2023-12-12T09:46:47.626 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:47.625+0000 7f17f4b7c640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f17f006d350 0x7f17f0071ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:47.627 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:47.625+0000 7f17f4b7c640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f17f00723a0 0x7f17f00aa540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:47.627 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:47.625+0000 7f17f4b7c640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f17f014f8c0 0x7f17f01ea580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:47.627 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:47.625+0000 7f17f4b7c640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17f01e9e90 con 0x7f17f00723a0 2023-12-12T09:46:47.627 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:47.625+0000 7f17f4b7c640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17f0156830 con 0x7f17f014f8c0 2023-12-12T09:46:47.627 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:47.625+0000 7f17f4b7c640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17f0070da0 con 0x7f17f006d350 2023-12-12T09:46:47.627 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:47.625+0000 7f17edd9b640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f17f00723a0 0x7f17f00aa540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:47.627 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:47.625+0000 7f17edd9b640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f17f00723a0 0x7f17f00aa540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:54008/0 (socket says 172.21.15.73:54008) 2023-12-12T09:46:47.627 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:47.625+0000 7f17edd9b640 1 -- 172.21.15.73:0/3856868755 learned_addr learned my addr 172.21.15.73:0/3856868755 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:46:47.628 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:47.625+0000 7f17eed9d640 1 --2- 172.21.15.73:0/3856868755 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f17f014f8c0 0x7f17f01ea580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:47.628 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:47.625+0000 7f17ee59c640 1 --2- 172.21.15.73:0/3856868755 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f17f006d350 0x7f17f0071ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:47.628 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:47.626+0000 7f17edd9b640 1 -- 172.21.15.73:0/3856868755 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f17f006d350 msgr2=0x7f17f0071ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:47.629 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:47.626+0000 7f17edd9b640 1 --2- 172.21.15.73:0/3856868755 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f17f006d350 0x7f17f0071ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:47.629 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:47.626+0000 7f17edd9b640 1 -- 172.21.15.73:0/3856868755 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f17f014f8c0 msgr2=0x7f17f01ea580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:47.629 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:47.626+0000 7f17edd9b640 1 --2- 172.21.15.73:0/3856868755 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f17f014f8c0 0x7f17f01ea580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:47.629 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:47.626+0000 7f17edd9b640 1 -- 172.21.15.73:0/3856868755 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17e40094d0 con 0x7f17f00723a0 2023-12-12T09:46:47.629 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:47.626+0000 7f17edd9b640 1 --2- 172.21.15.73:0/3856868755 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f17f00723a0 0x7f17f00aa540 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 crypto rx=0x7f17e40098a0 tx=0x7f17e40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:46:47.629 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:47.626+0000 7f17deffd640 1 -- 172.21.15.73:0/3856868755 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17e403ac60 con 0x7f17f00723a0 2023-12-12T09:46:47.629 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:47.626+0000 7f17deffd640 1 -- 172.21.15.73:0/3856868755 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17e403adc0 con 0x7f17f00723a0 2023-12-12T09:46:47.629 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:47.626+0000 7f17deffd640 1 -- 172.21.15.73:0/3856868755 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17e4044630 con 0x7f17f00723a0 2023-12-12T09:46:47.629 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:47.626+0000 7f17f4b7c640 1 -- 172.21.15.73:0/3856868755 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17f01ea0a0 con 0x7f17f00723a0 2023-12-12T09:46:47.629 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:47.627+0000 7f17f4b7c640 1 -- 172.21.15.73:0/3856868755 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17f0156270 con 0x7f17f00723a0 2023-12-12T09:46:47.630 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:47.628+0000 7f17f4b7c640 1 -- 172.21.15.73:0/3856868755 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f17f0067070 con 0x7f17f00723a0 2023-12-12T09:46:47.630 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:47.629+0000 7f17deffd640 1 -- 172.21.15.73:0/3856868755 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f17e402f050 con 0x7f17f00723a0 2023-12-12T09:46:47.631 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:47.630+0000 7f17deffd640 1 --2- 172.21.15.73:0/3856868755 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f17d006ae40 0x7f17d006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:47.631 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:47.630+0000 7f17deffd640 1 -- 172.21.15.73:0/3856868755 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f17e40ab990 con 0x7f17f00723a0 2023-12-12T09:46:47.632 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:47.630+0000 7f17ee59c640 1 --2- 172.21.15.73:0/3856868755 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f17d006ae40 0x7f17d006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:47.632 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:47.631+0000 7f17ee59c640 1 --2- 172.21.15.73:0/3856868755 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f17d006ae40 0x7f17d006d300 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f17f0152090 tx=0x7f17e0008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:46:47.636 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:47.635+0000 7f17deffd640 1 -- 172.21.15.73:0/3856868755 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f17e40766d0 con 0x7f17f00723a0 2023-12-12T09:46:47.896 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:47.895+0000 7f17f4b7c640 1 -- 172.21.15.73:0/3856868755 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.1", "caps": ["mon", "allow r", "osd", "allow rw pool=cephfs2_data", "mds", "allow"]} v 0) v1 -- 0x7f17f0152b90 con 0x7f17f00723a0 2023-12-12T09:46:47.901 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:47.900+0000 7f17deffd640 1 -- 172.21.15.73:0/3856868755 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.1", "caps": ["mon", "allow r", "osd", "allow rw pool=cephfs2_data", "mds", "allow"]}]=0 updated caps for client.1 v20) v1 ==== 185+0+142 (secure 0 0 0) 0x7f17e4079cf0 con 0x7f17f00723a0 2023-12-12T09:46:47.901 INFO:teuthology.orchestra.run.smithi073.stdout:[client.1] 2023-12-12T09:46:47.902 INFO:teuthology.orchestra.run.smithi073.stdout: key = AQD/KnhlLq6aERAAgTQwqvltAggkGpb77Zngsg== 2023-12-12T09:46:47.902 INFO:teuthology.orchestra.run.smithi073.stdout: caps mds = "allow" 2023-12-12T09:46:47.902 INFO:teuthology.orchestra.run.smithi073.stdout: caps mon = "allow r" 2023-12-12T09:46:47.902 INFO:teuthology.orchestra.run.smithi073.stdout: caps osd = "allow rw pool=cephfs2_data" 2023-12-12T09:46:47.902 INFO:teuthology.orchestra.run.smithi073.stderr:updated caps for client.1 2023-12-12T09:46:47.905 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:47.903+0000 7f17f4b7c640 1 -- 172.21.15.73:0/3856868755 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f17d006ae40 msgr2=0x7f17d006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:47.905 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:47.903+0000 7f17f4b7c640 1 --2- 172.21.15.73:0/3856868755 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f17d006ae40 0x7f17d006d300 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f17f0152090 tx=0x7f17e0008040 comp rx=0 tx=0).stop 2023-12-12T09:46:47.905 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:47.903+0000 7f17f4b7c640 1 -- 172.21.15.73:0/3856868755 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f17f00723a0 msgr2=0x7f17f00aa540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:47.905 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:47.903+0000 7f17f4b7c640 1 --2- 172.21.15.73:0/3856868755 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f17f00723a0 0x7f17f00aa540 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 crypto rx=0x7f17e40098a0 tx=0x7f17e40046c0 comp rx=0 tx=0).stop 2023-12-12T09:46:47.905 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:47.903+0000 7f17f4b7c640 1 -- 172.21.15.73:0/3856868755 shutdown_connections 2023-12-12T09:46:47.905 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:47.903+0000 7f17f4b7c640 1 --2- 172.21.15.73:0/3856868755 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f17d006ae40 0x7f17d006d300 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:47.905 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:47.903+0000 7f17f4b7c640 1 --2- 172.21.15.73:0/3856868755 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f17f014f8c0 0x7f17f01ea580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:47.905 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:47.903+0000 7f17f4b7c640 1 --2- 172.21.15.73:0/3856868755 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f17f00723a0 0x7f17f00aa540 unknown :-1 s=CLOSED pgs=944 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:47.905 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:47.903+0000 7f17f4b7c640 1 --2- 172.21.15.73:0/3856868755 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f17f006d350 0x7f17f0071ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:47.905 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:47.903+0000 7f17f4b7c640 1 -- 172.21.15.73:0/3856868755 >> 172.21.15.73:0/3856868755 conn(0x7f17f006a4e0 msgr2=0x7f17f00c3780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:46:47.905 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:47.903+0000 7f17f4b7c640 1 -- 172.21.15.73:0/3856868755 shutdown_connections 2023-12-12T09:46:47.906 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:47.903+0000 7f17f4b7c640 1 -- 172.21.15.73:0/3856868755 wait complete. 2023-12-12T09:46:47.922 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2023-12-12T09:46:47.922 DEBUG:teuthology.orchestra.run.smithi142:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-12T09:46:47.982 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2023-12-12T09:46:47.982 DEBUG:teuthology.orchestra.run.smithi142:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-12T09:46:48.041 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-12T09:46:48.252 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:48.251+0000 7f70b9ddc640 1 Processor -- start 2023-12-12T09:46:48.253 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:48.251+0000 7f70b9ddc640 1 -- start start 2023-12-12T09:46:48.254 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:48.252+0000 7f70b9ddc640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f70b40c5070 0x7f70b40c40c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:48.254 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:48.252+0000 7f70b9ddc640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70b4152610 con 0x7f70b414fa40 2023-12-12T09:46:48.254 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:48.252+0000 7f70b9ddc640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70b41528f0 con 0x7f70b406db70 2023-12-12T09:46:48.254 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:48.252+0000 7f70b9ddc640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70b4152bd0 con 0x7f70b40c5070 2023-12-12T09:46:48.254 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:48.253+0000 7f70b3fff640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f70b40c5070 0x7f70b40c40c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:48.255 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:48.253+0000 7f70b37fe640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f70b414fa40 0x7f70b406a4e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:50860/0 (socket says 172.21.15.73:50860) 2023-12-12T09:46:48.255 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:48.253+0000 7f70b37fe640 1 -- 172.21.15.73:0/1125079301 learned_addr learned my addr 172.21.15.73:0/1125079301 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-12T09:46:48.255 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:48.253+0000 7f70b3fff640 1 -- 172.21.15.73:0/1125079301 >> v1:172.21.15.142:6789/0 conn(0x7f70b406db70 legacy=0x7f70b40c39b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:48.255 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:48.253+0000 7f70b3fff640 1 -- 172.21.15.73:0/1125079301 >> v1:172.21.15.73:6789/0 conn(0x7f70b414fa40 legacy=0x7f70b406a4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:48.255 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:48.253+0000 7f70b3fff640 1 -- 172.21.15.73:0/1125079301 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70b4152eb0 con 0x7f70b40c5070 2023-12-12T09:46:48.255 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:48.253+0000 7f70b27fc640 1 -- 172.21.15.73:0/1125079301 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 942695584 0 0) 0x7f70b4152610 con 0x7f70b414fa40 2023-12-12T09:46:48.256 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:48.255+0000 7f70b3fff640 1 --2- 172.21.15.73:0/1125079301 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f70b40c5070 0x7f70b40c40c0 secure :-1 s=READY pgs=946 cs=0 l=1 rev1=1 crypto rx=0x7f70ac009d90 tx=0x7f70ac02bf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f082c2a1ef68f1ab server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:46:48.256 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:48.255+0000 7f70b27fc640 1 -- 172.21.15.73:0/1125079301 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70ac02cd00 con 0x7f70b40c5070 2023-12-12T09:46:48.256 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:48.255+0000 7f70b27fc640 1 -- 172.21.15.73:0/1125079301 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70ac02ce60 con 0x7f70b40c5070 2023-12-12T09:46:48.256 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:48.255+0000 7f70b27fc640 1 -- 172.21.15.73:0/1125079301 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70ac034660 con 0x7f70b40c5070 2023-12-12T09:46:48.257 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:48.255+0000 7f70b9ddc640 1 -- 172.21.15.73:0/1125079301 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f70b40c5070 msgr2=0x7f70b40c40c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:48.257 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:48.255+0000 7f70b9ddc640 1 --2- 172.21.15.73:0/1125079301 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f70b40c5070 0x7f70b40c40c0 secure :-1 s=READY pgs=946 cs=0 l=1 rev1=1 crypto rx=0x7f70ac009d90 tx=0x7f70ac02bf50 comp rx=0 tx=0).stop 2023-12-12T09:46:48.257 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:48.256+0000 7f70b9ddc640 1 -- 172.21.15.73:0/1125079301 shutdown_connections 2023-12-12T09:46:48.257 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:48.256+0000 7f70b9ddc640 1 --2- 172.21.15.73:0/1125079301 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f70b40c5070 0x7f70b40c40c0 unknown :-1 s=CLOSED pgs=946 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:48.257 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:48.256+0000 7f70b9ddc640 1 -- 172.21.15.73:0/1125079301 >> 172.21.15.73:0/1125079301 conn(0x7f70b40a8130 msgr2=0x7f70b40c24b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:46:48.257 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:48.256+0000 7f70b9ddc640 1 -- 172.21.15.73:0/1125079301 shutdown_connections 2023-12-12T09:46:48.257 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:48.256+0000 7f70b9ddc640 1 -- 172.21.15.73:0/1125079301 wait complete. 2023-12-12T09:46:48.259 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:48.258+0000 7f70b9ddc640 1 Processor -- start 2023-12-12T09:46:48.259 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:48.258+0000 7f70b9ddc640 1 -- start start 2023-12-12T09:46:48.262 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:48.259+0000 7f70b9ddc640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f70b406db70 0x7f70b40bd260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:48.262 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:48.259+0000 7f70b9ddc640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f70b40c5070 0x7f70b4149df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:48.262 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:48.259+0000 7f70b9ddc640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f70b414fa40 0x7f70b40bc0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:48.262 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:48.259+0000 7f70b9ddc640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70b414a330 con 0x7f70b40c5070 2023-12-12T09:46:48.262 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:48.259+0000 7f70b9ddc640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70b41eaf40 con 0x7f70b406db70 2023-12-12T09:46:48.263 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:48.259+0000 7f70b9ddc640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70b4149b10 con 0x7f70b414fa40 2023-12-12T09:46:48.263 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:48.259+0000 7f70b2ffd640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f70b40c5070 0x7f70b4149df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:48.263 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:48.259+0000 7f70b2ffd640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f70b40c5070 0x7f70b4149df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:54028/0 (socket says 172.21.15.73:54028) 2023-12-12T09:46:48.263 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:48.259+0000 7f70b2ffd640 1 -- 172.21.15.73:0/2562883951 learned_addr learned my addr 172.21.15.73:0/2562883951 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:46:48.263 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:48.260+0000 7f70b37fe640 1 --2- 172.21.15.73:0/2562883951 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f70b406db70 0x7f70b40bd260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:48.263 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:48.260+0000 7f70b3fff640 1 --2- 172.21.15.73:0/2562883951 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f70b414fa40 0x7f70b40bc0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:48.263 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:48.260+0000 7f70b2ffd640 1 -- 172.21.15.73:0/2562883951 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f70b414fa40 msgr2=0x7f70b40bc0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:48.264 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:48.260+0000 7f70b2ffd640 1 --2- 172.21.15.73:0/2562883951 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f70b414fa40 0x7f70b40bc0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:48.264 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:48.260+0000 7f70b2ffd640 1 -- 172.21.15.73:0/2562883951 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f70b406db70 msgr2=0x7f70b40bd260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:48.264 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:48.260+0000 7f70b2ffd640 1 --2- 172.21.15.73:0/2562883951 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f70b406db70 0x7f70b40bd260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:48.264 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:48.260+0000 7f70b2ffd640 1 -- 172.21.15.73:0/2562883951 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70ac009a70 con 0x7f70b40c5070 2023-12-12T09:46:48.264 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:48.260+0000 7f70b2ffd640 1 --2- 172.21.15.73:0/2562883951 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f70b40c5070 0x7f70b4149df0 secure :-1 s=READY pgs=947 cs=0 l=1 rev1=1 crypto rx=0x7f70a800c400 tx=0x7f70a800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:46:48.264 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:48.260+0000 7f709bfff640 1 -- 172.21.15.73:0/2562883951 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70a80052d0 con 0x7f70b40c5070 2023-12-12T09:46:48.265 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:48.260+0000 7f709bfff640 1 -- 172.21.15.73:0/2562883951 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70a8005430 con 0x7f70b40c5070 2023-12-12T09:46:48.265 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:48.260+0000 7f709bfff640 1 -- 172.21.15.73:0/2562883951 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70a8003830 con 0x7f70b40c5070 2023-12-12T09:46:48.265 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:48.260+0000 7f70b9ddc640 1 -- 172.21.15.73:0/2562883951 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70b414be60 con 0x7f70b40c5070 2023-12-12T09:46:48.265 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:48.261+0000 7f70b9ddc640 1 -- 172.21.15.73:0/2562883951 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70b40bab60 con 0x7f70b40c5070 2023-12-12T09:46:48.267 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:48.262+0000 7f70b9ddc640 1 -- 172.21.15.73:0/2562883951 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f70b41eb0b0 con 0x7f70b40c5070 2023-12-12T09:46:48.267 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:48.263+0000 7f709bfff640 1 -- 172.21.15.73:0/2562883951 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f70a8003990 con 0x7f70b40c5070 2023-12-12T09:46:48.267 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:48.263+0000 7f709bfff640 1 --2- 172.21.15.73:0/2562883951 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f70a006ae40 0x7f70a006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:48.267 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:48.264+0000 7f709bfff640 1 -- 172.21.15.73:0/2562883951 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f70a8088f00 con 0x7f70b40c5070 2023-12-12T09:46:48.267 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:48.264+0000 7f70b37fe640 1 --2- 172.21.15.73:0/2562883951 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f70a006ae40 0x7f70a006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:48.267 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:48.264+0000 7f70b37fe640 1 --2- 172.21.15.73:0/2562883951 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f70a006ae40 0x7f70a006d300 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f70a4000f60 tx=0x7f70a4007b90 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:46:48.269 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:48.268+0000 7f709bfff640 1 -- 172.21.15.73:0/2562883951 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f70a8053c40 con 0x7f70b40c5070 2023-12-12T09:46:48.451 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:48.450+0000 7f70b9ddc640 1 -- 172.21.15.73:0/2562883951 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f70b4153640 con 0x7f70b40c5070 2023-12-12T09:46:48.455 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:48.454+0000 7f709bfff640 1 -- 172.21.15.73:0/2562883951 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v79) v1 ==== 74+0+20226 (secure 0 0 0) 0x7f70b4153640 con 0x7f70b40c5070 2023-12-12T09:46:48.456 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-12T09:46:48.456 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":79,"fsid":"ba240992-02b8-4c7e-92f2-27eb29ac433b","created":"2023-12-12T09:43:02.454719+0000","modified":"2023-12-12T09:46:43.294476+0000","last_up_change":"2023-12-12T09:43:13.913440+0000","last_in_change":"2023-12-12T09:43:05.925348+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-12T09:43:15.525508+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2023-12-12T09:46:24.716544+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2023-12-12T09:46:25.435954+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs2_metadata","create_time":"2023-12-12T09:46:40.116878+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs2_data","create_time":"2023-12-12T09:46:40.798840+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"dd9074be-dbe2-4c34-9896-a4223d8d3940","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":4047810203},{"type":"v1","addr":"172.21.15.73:6801","nonce":4047810203}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":4047810203},{"type":"v1","addr":"172.21.15.73:6803","nonce":4047810203}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":4047810203},{"type":"v1","addr":"172.21.15.73:6807","nonce":4047810203}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":4047810203},{"type":"v1","addr":"172.21.15.73:6805","nonce":4047810203}]},"public_addr":"172.21.15.73:6801/4047810203","cluster_addr":"172.21.15.73:6803/4047810203","heartbeat_back_addr":"172.21.15.73:6807/4047810203","heartbeat_front_addr":"172.21.15.73:6805/4047810203","state":["exists","up"]},{"osd":1,"uuid":"c4a05052-96d4-4758-a4e1-1a37f1e07fed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":1356058331},{"type":"v1","addr":"172.21.15.73:6824","nonce":1356058331}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":1356058331},{"type":"v1","addr":"172.21.15.73:6827","nonce":1356058331}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":1356058331},{"type":"v1","addr":"172.21.15.73:6831","nonce":1356058331}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":1356058331},{"type":"v1","addr":"172.21.15.73:6829","nonce":1356058331}]},"public_addr":"172.21.15.73:6824/1356058331","cluster_addr":"172.21.15.73:6827/1356058331","heartbeat_back_addr":"172.21.15.73:6831/1356058331","heartbeat_front_addr":"172.21.15.73:6829/1356058331","state":["exists","up"]},{"osd":2,"uuid":"512bc8ac-72c2-40d4-b3d2-d867a92c5213","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":1228903316},{"type":"v1","addr":"172.21.15.73:6817","nonce":1228903316}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":1228903316},{"type":"v1","addr":"172.21.15.73:6819","nonce":1228903316}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6823","nonce":1228903316},{"type":"v1","addr":"172.21.15.73:6825","nonce":1228903316}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":1228903316},{"type":"v1","addr":"172.21.15.73:6821","nonce":1228903316}]},"public_addr":"172.21.15.73:6817/1228903316","cluster_addr":"172.21.15.73:6819/1228903316","heartbeat_back_addr":"172.21.15.73:6825/1228903316","heartbeat_front_addr":"172.21.15.73:6821/1228903316","state":["exists","up"]},{"osd":3,"uuid":"3d1a91e0-42bf-437a-8eae-8d357c8f63a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":1293329670},{"type":"v1","addr":"172.21.15.73:6809","nonce":1293329670}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6810","nonce":1293329670},{"type":"v1","addr":"172.21.15.73:6811","nonce":1293329670}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":1293329670},{"type":"v1","addr":"172.21.15.73:6815","nonce":1293329670}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":1293329670},{"type":"v1","addr":"172.21.15.73:6813","nonce":1293329670}]},"public_addr":"172.21.15.73:6809/1293329670","cluster_addr":"172.21.15.73:6811/1293329670","heartbeat_back_addr":"172.21.15.73:6815/1293329670","heartbeat_front_addr":"172.21.15.73:6813/1293329670","state":["exists","up"]},{"osd":4,"uuid":"4b302fff-834c-4069-ac19-00e46f6c87b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":3727975702},{"type":"v1","addr":"172.21.15.142:6801","nonce":3727975702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":3727975702},{"type":"v1","addr":"172.21.15.142:6803","nonce":3727975702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6809","nonce":3727975702},{"type":"v1","addr":"172.21.15.142:6811","nonce":3727975702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6805","nonce":3727975702},{"type":"v1","addr":"172.21.15.142:6807","nonce":3727975702}]},"public_addr":"172.21.15.142:6801/3727975702","cluster_addr":"172.21.15.142:6803/3727975702","heartbeat_back_addr":"172.21.15.142:6811/3727975702","heartbeat_front_addr":"172.21.15.142:6807/3727975702","state":["exists","up"]},{"osd":5,"uuid":"d7cdace2-67d0-45cc-95f2-515cf6ef1b82","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6817","nonce":2353193632},{"type":"v1","addr":"172.21.15.142:6819","nonce":2353193632}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6821","nonce":2353193632},{"type":"v1","addr":"172.21.15.142:6823","nonce":2353193632}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6829","nonce":2353193632},{"type":"v1","addr":"172.21.15.142:6831","nonce":2353193632}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6825","nonce":2353193632},{"type":"v1","addr":"172.21.15.142:6827","nonce":2353193632}]},"public_addr":"172.21.15.142:6819/2353193632","cluster_addr":"172.21.15.142:6823/2353193632","heartbeat_back_addr":"172.21.15.142:6831/2353193632","heartbeat_front_addr":"172.21.15.142:6827/2353193632","state":["exists","up"]},{"osd":6,"uuid":"649ce78a-5626-445c-aedc-a651ed05a6f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":2006111986},{"type":"v1","addr":"172.21.15.142:6806","nonce":2006111986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":2006111986},{"type":"v1","addr":"172.21.15.142:6810","nonce":2006111986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":2006111986},{"type":"v1","addr":"172.21.15.142:6815","nonce":2006111986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":2006111986},{"type":"v1","addr":"172.21.15.142:6813","nonce":2006111986}]},"public_addr":"172.21.15.142:6806/2006111986","cluster_addr":"172.21.15.142:6810/2006111986","heartbeat_back_addr":"172.21.15.142:6815/2006111986","heartbeat_front_addr":"172.21.15.142:6813/2006111986","state":["exists","up"]},{"osd":7,"uuid":"af15ae3b-c1d0-4acf-92db-8a1805494d13","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":2573794341},{"type":"v1","addr":"172.21.15.142:6818","nonce":2573794341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":2573794341},{"type":"v1","addr":"172.21.15.142:6822","nonce":2573794341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":2573794341},{"type":"v1","addr":"172.21.15.142:6830","nonce":2573794341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":2573794341},{"type":"v1","addr":"172.21.15.142:6826","nonce":2573794341}]},"public_addr":"172.21.15.142:6818/2573794341","cluster_addr":"172.21.15.142:6822/2573794341","heartbeat_back_addr":"172.21.15.142:6830/2573794341","heartbeat_front_addr":"172.21.15.142:6826/2573794341","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.185824+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.262103+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.225556+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:10.523459+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:10.706035+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.257339+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.301776+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.051960+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-12T09:46:48.458 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:48.456+0000 7f70b9ddc640 1 -- 172.21.15.73:0/2562883951 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f70a006ae40 msgr2=0x7f70a006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:48.458 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:48.456+0000 7f70b9ddc640 1 --2- 172.21.15.73:0/2562883951 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f70a006ae40 0x7f70a006d300 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f70a4000f60 tx=0x7f70a4007b90 comp rx=0 tx=0).stop 2023-12-12T09:46:48.458 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:48.456+0000 7f70b9ddc640 1 -- 172.21.15.73:0/2562883951 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f70b40c5070 msgr2=0x7f70b4149df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:48.458 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:48.456+0000 7f70b9ddc640 1 --2- 172.21.15.73:0/2562883951 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f70b40c5070 0x7f70b4149df0 secure :-1 s=READY pgs=947 cs=0 l=1 rev1=1 crypto rx=0x7f70a800c400 tx=0x7f70a800c8c0 comp rx=0 tx=0).stop 2023-12-12T09:46:48.458 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:48.457+0000 7f70b9ddc640 1 -- 172.21.15.73:0/2562883951 shutdown_connections 2023-12-12T09:46:48.459 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:48.457+0000 7f70b9ddc640 1 --2- 172.21.15.73:0/2562883951 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f70a006ae40 0x7f70a006d300 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:48.459 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:48.457+0000 7f70b9ddc640 1 --2- 172.21.15.73:0/2562883951 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f70b414fa40 0x7f70b40bc0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:48.459 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:48.457+0000 7f70b9ddc640 1 --2- 172.21.15.73:0/2562883951 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f70b40c5070 0x7f70b4149df0 unknown :-1 s=CLOSED pgs=947 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:48.459 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:48.457+0000 7f70b9ddc640 1 --2- 172.21.15.73:0/2562883951 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f70b406db70 0x7f70b40bd260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:48.459 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:48.457+0000 7f70b9ddc640 1 -- 172.21.15.73:0/2562883951 >> 172.21.15.73:0/2562883951 conn(0x7f70b40a8130 msgr2=0x7f70b40c23d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:46:48.459 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:48.457+0000 7f70b9ddc640 1 -- 172.21.15.73:0/2562883951 shutdown_connections 2023-12-12T09:46:48.459 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:48.457+0000 7f70b9ddc640 1 -- 172.21.15.73:0/2562883951 wait complete. 2023-12-12T09:46:48.475 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-12T09:43:15.525508+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 12, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-12T09:46:24.716544+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '74', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 13, 'pool_name': 'cephfs_data', 'create_time': '2023-12-12T09:46:25.435954+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '75', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 14, 'pool_name': 'cephfs2_metadata', 'create_time': '2023-12-12T09:46:40.116878+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '78', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs2'}}, 'read_balance': {'score_acting': 2.5, 'score_stable': 2.5, 'optimal_score': 1, 'raw_score_acting': 2.5, 'raw_score_stable': 2.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 15, 'pool_name': 'cephfs2_data', 'create_time': '2023-12-12T09:46:40.798840+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '79', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs2'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-12T09:46:48.476 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-12T09:46:48.687 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:48.686+0000 7f92dc333640 1 Processor -- start 2023-12-12T09:46:48.688 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:48.686+0000 7f92dc333640 1 -- start start 2023-12-12T09:46:48.688 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:48.687+0000 7f92dc333640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f92d414f8c0 0x7f92d406dc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:48.689 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:48.687+0000 7f92dc333640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f92d406d350 0x7f92d4071e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:48.689 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:48.687+0000 7f92dc333640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92d40c16c0 con 0x7f92d40723a0 2023-12-12T09:46:48.689 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:48.687+0000 7f92dc333640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92d40c1090 con 0x7f92d406d350 2023-12-12T09:46:48.689 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:48.687+0000 7f92dc333640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92d40c14b0 con 0x7f92d414f8c0 2023-12-12T09:46:48.690 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:48.688+0000 7f92d98ce640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f92d406d350 0x7f92d4071e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:48.690 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:48.688+0000 7f92da8d0640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f92d40723a0 0x7f92d4152500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:50862/0 (socket says 172.21.15.73:50862) 2023-12-12T09:46:48.690 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:48.688+0000 7f92da8d0640 1 -- 172.21.15.73:0/644928367 learned_addr learned my addr 172.21.15.73:0/644928367 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-12T09:46:48.690 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:48.688+0000 7f92da0cf640 1 --2- 172.21.15.73:0/644928367 >> v2:172.21.15.142:3300/0 conn(0x7f92d414f8c0 0x7f92d406dc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:48.690 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:48.688+0000 7f92d90cd640 1 -- 172.21.15.73:0/644928367 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3281430712 0 0) 0x7f92d40c16c0 con 0x7f92d40723a0 2023-12-12T09:46:48.690 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:48.688+0000 7f92d98ce640 1 -- 172.21.15.73:0/644928367 >> v2:172.21.15.142:3300/0 conn(0x7f92d414f8c0 msgr2=0x7f92d406dc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:46:48.690 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:48.688+0000 7f92d98ce640 1 --2- 172.21.15.73:0/644928367 >> v2:172.21.15.142:3300/0 conn(0x7f92d414f8c0 0x7f92d406dc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:48.690 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:48.688+0000 7f92d98ce640 1 -- 172.21.15.73:0/644928367 >> v1:172.21.15.73:6789/0 conn(0x7f92d40723a0 legacy=0x7f92d4152500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:48.690 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:48.688+0000 7f92d98ce640 1 -- 172.21.15.73:0/644928367 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92d40c19a0 con 0x7f92d406d350 2023-12-12T09:46:48.691 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:48.689+0000 7f92d98ce640 1 --2- 172.21.15.73:0/644928367 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f92d406d350 0x7f92d4071e60 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 crypto rx=0x7f92d40c34b0 tx=0x7f92c402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab80ddcc04c23e14 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:46:48.691 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:48.690+0000 7f92d90cd640 1 -- 172.21.15.73:0/644928367 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92c4031830 con 0x7f92d406d350 2023-12-12T09:46:48.691 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:48.690+0000 7f92d90cd640 1 -- 172.21.15.73:0/644928367 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92c4031990 con 0x7f92d406d350 2023-12-12T09:46:48.691 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:48.690+0000 7f92d90cd640 1 -- 172.21.15.73:0/644928367 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92c4031d20 con 0x7f92d406d350 2023-12-12T09:46:48.692 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:48.690+0000 7f92dc333640 1 -- 172.21.15.73:0/644928367 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f92d406d350 msgr2=0x7f92d4071e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:48.692 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:48.690+0000 7f92dc333640 1 --2- 172.21.15.73:0/644928367 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f92d406d350 0x7f92d4071e60 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 crypto rx=0x7f92d40c34b0 tx=0x7f92c402b8d0 comp rx=0 tx=0).stop 2023-12-12T09:46:48.692 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:48.690+0000 7f92dc333640 1 -- 172.21.15.73:0/644928367 shutdown_connections 2023-12-12T09:46:48.692 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:48.690+0000 7f92dc333640 1 --2- 172.21.15.73:0/644928367 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f92d406d350 0x7f92d4071e60 unknown :-1 s=CLOSED pgs=949 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:48.692 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:48.690+0000 7f92dc333640 1 --2- 172.21.15.73:0/644928367 >> v2:172.21.15.142:3300/0 conn(0x7f92d414f8c0 0x7f92d406dc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:48.692 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:48.690+0000 7f92dc333640 1 -- 172.21.15.73:0/644928367 >> 172.21.15.73:0/644928367 conn(0x7f92d406a4e0 msgr2=0x7f92d406a8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:46:48.692 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:48.690+0000 7f92dc333640 1 -- 172.21.15.73:0/644928367 shutdown_connections 2023-12-12T09:46:48.692 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:48.690+0000 7f92dc333640 1 -- 172.21.15.73:0/644928367 wait complete. 2023-12-12T09:46:48.693 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:48.692+0000 7f92dc333640 1 Processor -- start 2023-12-12T09:46:48.693 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:48.692+0000 7f92dc333640 1 -- start start 2023-12-12T09:46:48.694 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:48.693+0000 7f92dc333640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f92d406d350 0x7f92d40ab710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:48.694 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:48.693+0000 7f92dc333640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f92d40723a0 0x7f92d4148c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:48.694 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:48.693+0000 7f92dc333640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f92d414f8c0 0x7f92d41491b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:48.695 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:48.693+0000 7f92dc333640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92d40ab080 con 0x7f92d406d350 2023-12-12T09:46:48.695 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:48.693+0000 7f92dc333640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92d41e7a80 con 0x7f92d414f8c0 2023-12-12T09:46:48.695 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:48.693+0000 7f92dc333640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92d4155140 con 0x7f92d40723a0 2023-12-12T09:46:48.696 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:48.693+0000 7f92da0cf640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f92d406d350 0x7f92d40ab710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:48.696 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:48.693+0000 7f92da0cf640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f92d406d350 0x7f92d40ab710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:54056/0 (socket says 172.21.15.73:54056) 2023-12-12T09:46:48.696 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:48.693+0000 7f92da0cf640 1 -- 172.21.15.73:0/2208774963 learned_addr learned my addr 172.21.15.73:0/2208774963 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:46:48.696 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:48.694+0000 7f92d98ce640 1 --2- 172.21.15.73:0/2208774963 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f92d40723a0 0x7f92d4148c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:48.696 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:48.694+0000 7f92da8d0640 1 --2- 172.21.15.73:0/2208774963 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f92d414f8c0 0x7f92d41491b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:48.696 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:48.694+0000 7f92da0cf640 1 -- 172.21.15.73:0/2208774963 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f92d40723a0 msgr2=0x7f92d4148c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:48.697 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:48.694+0000 7f92da0cf640 1 --2- 172.21.15.73:0/2208774963 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f92d40723a0 0x7f92d4148c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:48.697 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:48.694+0000 7f92da0cf640 1 -- 172.21.15.73:0/2208774963 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f92d414f8c0 msgr2=0x7f92d41491b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:48.697 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:48.694+0000 7f92da0cf640 1 --2- 172.21.15.73:0/2208774963 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f92d414f8c0 0x7f92d41491b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:48.697 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:48.694+0000 7f92da0cf640 1 -- 172.21.15.73:0/2208774963 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92c4009400 con 0x7f92d406d350 2023-12-12T09:46:48.697 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:48.694+0000 7f92da0cf640 1 --2- 172.21.15.73:0/2208774963 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f92d406d350 0x7f92d40ab710 secure :-1 s=READY pgs=950 cs=0 l=1 rev1=1 crypto rx=0x7f92d000d5f0 tx=0x7f92d000dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:46:48.697 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:48.694+0000 7f92caffd640 1 -- 172.21.15.73:0/2208774963 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92d00125f0 con 0x7f92d406d350 2023-12-12T09:46:48.697 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:48.695+0000 7f92caffd640 1 -- 172.21.15.73:0/2208774963 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92d0012750 con 0x7f92d406d350 2023-12-12T09:46:48.697 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:48.695+0000 7f92caffd640 1 -- 172.21.15.73:0/2208774963 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92d0012b00 con 0x7f92d406d350 2023-12-12T09:46:48.697 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:48.695+0000 7f92dc333640 1 -- 172.21.15.73:0/2208774963 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92d4155420 con 0x7f92d406d350 2023-12-12T09:46:48.697 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:48.695+0000 7f92dc333640 1 -- 172.21.15.73:0/2208774963 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92d40a8a70 con 0x7f92d406d350 2023-12-12T09:46:48.698 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:48.696+0000 7f92dc333640 1 -- 172.21.15.73:0/2208774963 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f92d4067070 con 0x7f92d406d350 2023-12-12T09:46:48.698 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:48.697+0000 7f92caffd640 1 -- 172.21.15.73:0/2208774963 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f92d0012c60 con 0x7f92d406d350 2023-12-12T09:46:48.699 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:48.698+0000 7f92caffd640 1 --2- 172.21.15.73:0/2208774963 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f92b806ae40 0x7f92b806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:48.700 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:48.698+0000 7f92caffd640 1 -- 172.21.15.73:0/2208774963 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f92d0089e70 con 0x7f92d406d350 2023-12-12T09:46:48.700 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:48.698+0000 7f92d98ce640 1 --2- 172.21.15.73:0/2208774963 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f92b806ae40 0x7f92b806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:48.700 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:48.699+0000 7f92d98ce640 1 --2- 172.21.15.73:0/2208774963 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f92b806ae40 0x7f92b806d300 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f92c4036000 tx=0x7f92c403c040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:46:48.704 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:48.703+0000 7f92caffd640 1 -- 172.21.15.73:0/2208774963 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f92d0054bb0 con 0x7f92d406d350 2023-12-12T09:46:48.894 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:48.892+0000 7f92dc333640 1 -- 172.21.15.73:0/2208774963 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f92d4074700 con 0x7f92d406d350 2023-12-12T09:46:48.894 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:48.893+0000 7f92caffd640 1 -- 172.21.15.73:0/2208774963 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v79) v1 ==== 93+0+10 (secure 0 0 0) 0x7f92d00581d0 con 0x7f92d406d350 2023-12-12T09:46:48.895 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 1 2023-12-12T09:46:48.897 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:48.895+0000 7f92dc333640 1 -- 172.21.15.73:0/2208774963 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f92b806ae40 msgr2=0x7f92b806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:48.897 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:48.895+0000 7f92dc333640 1 --2- 172.21.15.73:0/2208774963 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f92b806ae40 0x7f92b806d300 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f92c4036000 tx=0x7f92c403c040 comp rx=0 tx=0).stop 2023-12-12T09:46:48.897 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:48.896+0000 7f92dc333640 1 -- 172.21.15.73:0/2208774963 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f92d406d350 msgr2=0x7f92d40ab710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:48.897 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:48.896+0000 7f92dc333640 1 --2- 172.21.15.73:0/2208774963 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f92d406d350 0x7f92d40ab710 secure :-1 s=READY pgs=950 cs=0 l=1 rev1=1 crypto rx=0x7f92d000d5f0 tx=0x7f92d000dab0 comp rx=0 tx=0).stop 2023-12-12T09:46:48.898 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:48.896+0000 7f92dc333640 1 -- 172.21.15.73:0/2208774963 shutdown_connections 2023-12-12T09:46:48.898 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:48.896+0000 7f92dc333640 1 --2- 172.21.15.73:0/2208774963 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f92b806ae40 0x7f92b806d300 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:48.898 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:48.896+0000 7f92dc333640 1 --2- 172.21.15.73:0/2208774963 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f92d414f8c0 0x7f92d41491b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:48.898 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:48.896+0000 7f92dc333640 1 --2- 172.21.15.73:0/2208774963 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f92d40723a0 0x7f92d4148c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:48.898 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:48.896+0000 7f92dc333640 1 --2- 172.21.15.73:0/2208774963 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f92d406d350 0x7f92d40ab710 unknown :-1 s=CLOSED pgs=950 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:48.898 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:48.896+0000 7f92dc333640 1 -- 172.21.15.73:0/2208774963 >> 172.21.15.73:0/2208774963 conn(0x7f92d406a4e0 msgr2=0x7f92d414e510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:46:48.898 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:48.896+0000 7f92dc333640 1 -- 172.21.15.73:0/2208774963 shutdown_connections 2023-12-12T09:46:48.898 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:48.896+0000 7f92dc333640 1 -- 172.21.15.73:0/2208774963 wait complete. 2023-12-12T09:46:48.917 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-12T09:46:49.116 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T09:46:49.121 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T09:46:49.129 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:49.128+0000 7f57bcbfb640 1 Processor -- start 2023-12-12T09:46:49.130 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:49.128+0000 7f57bcbfb640 1 -- start start 2023-12-12T09:46:49.132 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:49.129+0000 7f57bcbfb640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f57b806d350 0x7f57b806dc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:49.132 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:49.129+0000 7f57bcbfb640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f57b8152500 0x7f57b8152990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:49.132 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:49.129+0000 7f57bcbfb640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57b80c16c0 con 0x7f57b814f8c0 2023-12-12T09:46:49.132 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:49.129+0000 7f57bcbfb640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57b80c1090 con 0x7f57b8152500 2023-12-12T09:46:49.132 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:49.129+0000 7f57bcbfb640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57b80c14b0 con 0x7f57b806d350 2023-12-12T09:46:49.132 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:49.129+0000 7f57b6d9d640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f57b8152500 0x7f57b8152990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:49.132 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:49.129+0000 7f57b659c640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f57b814f8c0 0x7f57b8071e60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:51618/0 (socket says 172.21.15.73:51618) 2023-12-12T09:46:49.132 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:49.129+0000 7f57b659c640 1 -- 172.21.15.73:0/3010230841 learned_addr learned my addr 172.21.15.73:0/3010230841 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-12T09:46:49.132 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:49.130+0000 7f57b5d9b640 1 --2- 172.21.15.73:0/3010230841 >> v2:172.21.15.142:3300/0 conn(0x7f57b806d350 0x7f57b806dc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:49.132 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:49.130+0000 7f57b6d9d640 1 -- 172.21.15.73:0/3010230841 >> v2:172.21.15.142:3300/0 conn(0x7f57b806d350 msgr2=0x7f57b806dc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:46:49.132 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:49.130+0000 7f57b6d9d640 1 --2- 172.21.15.73:0/3010230841 >> v2:172.21.15.142:3300/0 conn(0x7f57b806d350 0x7f57b806dc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:49.133 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:49.130+0000 7f57b6d9d640 1 -- 172.21.15.73:0/3010230841 >> v1:172.21.15.73:6789/0 conn(0x7f57b814f8c0 legacy=0x7f57b8071e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:49.133 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:49.130+0000 7f57b6d9d640 1 -- 172.21.15.73:0/3010230841 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57b80c19a0 con 0x7f57b8152500 2023-12-12T09:46:49.133 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:49.130+0000 7f57b559a640 1 -- 172.21.15.73:0/3010230841 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1005913905 0 0) 0x7f57b80c16c0 con 0x7f57b814f8c0 2023-12-12T09:46:49.134 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:49.131+0000 7f57b6d9d640 1 --2- 172.21.15.73:0/3010230841 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f57b8152500 0x7f57b8152990 secure :-1 s=READY pgs=952 cs=0 l=1 rev1=1 crypto rx=0x7f57b80c3430 tx=0x7f57b002bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2159bc608f567ae7 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:46:49.134 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:49.131+0000 7f57b559a640 1 -- 172.21.15.73:0/3010230841 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57b002cc80 con 0x7f57b8152500 2023-12-12T09:46:49.134 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:49.131+0000 7f57b559a640 1 -- 172.21.15.73:0/3010230841 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57b002cde0 con 0x7f57b8152500 2023-12-12T09:46:49.134 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:49.131+0000 7f57b559a640 1 -- 172.21.15.73:0/3010230841 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57b0034660 con 0x7f57b8152500 2023-12-12T09:46:49.135 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:49.132+0000 7f57bcbfb640 1 -- 172.21.15.73:0/3010230841 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f57b8152500 msgr2=0x7f57b8152990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:49.135 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:49.132+0000 7f57bcbfb640 1 --2- 172.21.15.73:0/3010230841 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f57b8152500 0x7f57b8152990 secure :-1 s=READY pgs=952 cs=0 l=1 rev1=1 crypto rx=0x7f57b80c3430 tx=0x7f57b002bed0 comp rx=0 tx=0).stop 2023-12-12T09:46:49.135 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:49.132+0000 7f57bcbfb640 1 -- 172.21.15.73:0/3010230841 shutdown_connections 2023-12-12T09:46:49.135 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:49.132+0000 7f57bcbfb640 1 --2- 172.21.15.73:0/3010230841 >> v2:172.21.15.142:3300/0 conn(0x7f57b806d350 0x7f57b806dc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:49.135 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:49.132+0000 7f57bcbfb640 1 --2- 172.21.15.73:0/3010230841 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f57b8152500 0x7f57b8152990 unknown :-1 s=CLOSED pgs=952 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:49.135 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:49.132+0000 7f57bcbfb640 1 -- 172.21.15.73:0/3010230841 >> 172.21.15.73:0/3010230841 conn(0x7f57b806a4e0 msgr2=0x7f57b806a8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:46:49.135 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:49.132+0000 7f57bcbfb640 1 -- 172.21.15.73:0/3010230841 shutdown_connections 2023-12-12T09:46:49.135 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:49.132+0000 7f57bcbfb640 1 -- 172.21.15.73:0/3010230841 wait complete. 2023-12-12T09:46:49.136 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:49.134+0000 7f57bcbfb640 1 Processor -- start 2023-12-12T09:46:49.136 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:49.134+0000 7f57bcbfb640 1 -- start start 2023-12-12T09:46:49.138 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:49.135+0000 7f57bcbfb640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f57b806d350 0x7f57b80ab920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:49.138 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:49.135+0000 7f57bcbfb640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f57b814f8c0 0x7f57b8071350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:49.138 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:49.135+0000 7f57bcbfb640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f57b8152500 0x7f57b814b3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:49.138 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:49.135+0000 7f57bcbfb640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57b81561f0 con 0x7f57b814f8c0 2023-12-12T09:46:49.138 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:49.135+0000 7f57bcbfb640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57b81ea8d0 con 0x7f57b8152500 2023-12-12T09:46:49.138 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:49.135+0000 7f57bcbfb640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57b81eabb0 con 0x7f57b806d350 2023-12-12T09:46:49.138 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:49.135+0000 7f57b5d9b640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f57b814f8c0 0x7f57b8071350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:49.138 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:49.135+0000 7f57b5d9b640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f57b814f8c0 0x7f57b8071350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:39924/0 (socket says 172.21.15.73:39924) 2023-12-12T09:46:49.138 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:49.135+0000 7f57b5d9b640 1 -- 172.21.15.73:0/3018386384 learned_addr learned my addr 172.21.15.73:0/3018386384 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:46:49.139 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:49.136+0000 7f57b659c640 1 --2- 172.21.15.73:0/3018386384 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f57b806d350 0x7f57b80ab920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:49.139 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:49.136+0000 7f57b6d9d640 1 --2- 172.21.15.73:0/3018386384 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f57b8152500 0x7f57b814b3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:49.139 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:49.136+0000 7f57b5d9b640 1 -- 172.21.15.73:0/3018386384 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f57b806d350 msgr2=0x7f57b80ab920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:49.139 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:49.136+0000 7f57b5d9b640 1 --2- 172.21.15.73:0/3018386384 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f57b806d350 0x7f57b80ab920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:49.139 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:49.136+0000 7f57b5d9b640 1 -- 172.21.15.73:0/3018386384 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f57b8152500 msgr2=0x7f57b814b3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:49.139 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:49.136+0000 7f57b5d9b640 1 --2- 172.21.15.73:0/3018386384 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f57b8152500 0x7f57b814b3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:49.139 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:49.136+0000 7f57b5d9b640 1 -- 172.21.15.73:0/3018386384 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57b0009a70 con 0x7f57b814f8c0 2023-12-12T09:46:49.139 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:49.136+0000 7f57b6d9d640 1 --2- 172.21.15.73:0/3018386384 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f57b8152500 0x7f57b814b3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:46:49.139 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:49.136+0000 7f57b5d9b640 1 --2- 172.21.15.73:0/3018386384 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f57b814f8c0 0x7f57b8071350 secure :-1 s=READY pgs=953 cs=0 l=1 rev1=1 crypto rx=0x7f57ac00d5d0 tx=0x7f57ac00da90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:46:49.139 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:49.136+0000 7f57a6ffd640 1 -- 172.21.15.73:0/3018386384 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57ac0125f0 con 0x7f57b814f8c0 2023-12-12T09:46:49.140 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:49.136+0000 7f57a6ffd640 1 -- 172.21.15.73:0/3018386384 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57ac012770 con 0x7f57b814f8c0 2023-12-12T09:46:49.141 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:49.136+0000 7f57a6ffd640 1 -- 172.21.15.73:0/3018386384 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57ac012b20 con 0x7f57b814f8c0 2023-12-12T09:46:49.141 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:49.136+0000 7f57bcbfb640 1 -- 172.21.15.73:0/3018386384 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57b8156400 con 0x7f57b814f8c0 2023-12-12T09:46:49.141 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:49.137+0000 7f57bcbfb640 1 -- 172.21.15.73:0/3018386384 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57b814c490 con 0x7f57b814f8c0 2023-12-12T09:46:49.143 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:49.138+0000 7f57bcbfb640 1 -- 172.21.15.73:0/3018386384 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f57b8067070 con 0x7f57b814f8c0 2023-12-12T09:46:49.143 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:49.140+0000 7f57a6ffd640 1 -- 172.21.15.73:0/3018386384 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f57ac012c80 con 0x7f57b814f8c0 2023-12-12T09:46:49.143 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:49.141+0000 7f57a6ffd640 1 --2- 172.21.15.73:0/3018386384 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f579806ae40 0x7f579806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:49.143 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:49.141+0000 7f57a6ffd640 1 -- 172.21.15.73:0/3018386384 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f57ac089ef0 con 0x7f57b814f8c0 2023-12-12T09:46:49.143 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:49.141+0000 7f57b659c640 1 --2- 172.21.15.73:0/3018386384 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f579806ae40 0x7f579806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:49.143 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:49.142+0000 7f57b659c640 1 --2- 172.21.15.73:0/3018386384 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f579806ae40 0x7f579806d300 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f57a8000f60 tx=0x7f57a8007b70 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:46:49.147 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:49.146+0000 7f57a6ffd640 1 -- 172.21.15.73:0/3018386384 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f57ac054c40 con 0x7f57b814f8c0 2023-12-12T09:46:49.340 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:49.339+0000 7f57bcbfb640 1 -- 172.21.15.73:0/3018386384 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f57b814c680 con 0x7f57b814f8c0 2023-12-12T09:46:49.341 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:49.339+0000 7f57a6ffd640 1 -- 172.21.15.73:0/3018386384 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v79) v1 ==== 104+0+11 (secure 0 0 0) 0x7f57ac058260 con 0x7f57b814f8c0 2023-12-12T09:46:49.342 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 32 2023-12-12T09:46:49.346 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:49.342+0000 7f57bcbfb640 1 -- 172.21.15.73:0/3018386384 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f579806ae40 msgr2=0x7f579806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:49.346 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:49.342+0000 7f57bcbfb640 1 --2- 172.21.15.73:0/3018386384 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f579806ae40 0x7f579806d300 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f57a8000f60 tx=0x7f57a8007b70 comp rx=0 tx=0).stop 2023-12-12T09:46:49.346 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:49.342+0000 7f57bcbfb640 1 -- 172.21.15.73:0/3018386384 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f57b814f8c0 msgr2=0x7f57b8071350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:49.346 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:49.342+0000 7f57bcbfb640 1 --2- 172.21.15.73:0/3018386384 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f57b814f8c0 0x7f57b8071350 secure :-1 s=READY pgs=953 cs=0 l=1 rev1=1 crypto rx=0x7f57ac00d5d0 tx=0x7f57ac00da90 comp rx=0 tx=0).stop 2023-12-12T09:46:49.346 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:49.342+0000 7f57bcbfb640 1 -- 172.21.15.73:0/3018386384 shutdown_connections 2023-12-12T09:46:49.346 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:49.342+0000 7f57bcbfb640 1 --2- 172.21.15.73:0/3018386384 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f579806ae40 0x7f579806d300 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:49.347 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:49.342+0000 7f57bcbfb640 1 --2- 172.21.15.73:0/3018386384 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f57b8152500 0x7f57b814b3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:49.347 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:49.342+0000 7f57bcbfb640 1 --2- 172.21.15.73:0/3018386384 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f57b814f8c0 0x7f57b8071350 unknown :-1 s=CLOSED pgs=953 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:49.347 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:49.342+0000 7f57bcbfb640 1 --2- 172.21.15.73:0/3018386384 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f57b806d350 0x7f57b80ab920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:49.347 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:49.342+0000 7f57bcbfb640 1 -- 172.21.15.73:0/3018386384 >> 172.21.15.73:0/3018386384 conn(0x7f57b806a4e0 msgr2=0x7f57b806a8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:46:49.347 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:49.342+0000 7f57bcbfb640 1 -- 172.21.15.73:0/3018386384 shutdown_connections 2023-12-12T09:46:49.347 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:49.342+0000 7f57bcbfb640 1 -- 172.21.15.73:0/3018386384 wait complete. 2023-12-12T09:46:49.365 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-12T09:46:49.574 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:49.573+0000 7f9d496e0640 1 Processor -- start 2023-12-12T09:46:49.574 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:49.573+0000 7f9d496e0640 1 -- start start 2023-12-12T09:46:49.576 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:49.574+0000 7f9d496e0640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f9d440c67c0 0x7f9d440c7ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:49.576 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:49.574+0000 7f9d496e0640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d440c7030 con 0x7f9d441550a0 2023-12-12T09:46:49.576 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:49.574+0000 7f9d496e0640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d4406c890 con 0x7f9d440c6ba0 2023-12-12T09:46:49.576 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:49.574+0000 7f9d496e0640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d440c4af0 con 0x7f9d440c67c0 2023-12-12T09:46:49.576 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:49.575+0000 7f9d42ffd640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f9d440c67c0 0x7f9d440c7ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:49.576 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:49.575+0000 7f9d437fe640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f9d441550a0 0x7f9d4415efa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:51622/0 (socket says 172.21.15.73:51622) 2023-12-12T09:46:49.576 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:49.575+0000 7f9d437fe640 1 -- 172.21.15.73:0/2931327905 learned_addr learned my addr 172.21.15.73:0/2931327905 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-12T09:46:49.577 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:49.575+0000 7f9d42ffd640 1 -- 172.21.15.73:0/2931327905 >> v1:172.21.15.142:6789/0 conn(0x7f9d440c6ba0 legacy=0x7f9d4406c180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:46:49.577 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:49.575+0000 7f9d42ffd640 1 -- 172.21.15.73:0/2931327905 >> v1:172.21.15.73:6789/0 conn(0x7f9d441550a0 legacy=0x7f9d4415efa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:49.577 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:49.575+0000 7f9d42ffd640 1 -- 172.21.15.73:0/2931327905 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d440c4dd0 con 0x7f9d440c67c0 2023-12-12T09:46:49.577 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:49.575+0000 7f9d41ffb640 1 -- 172.21.15.73:0/2931327905 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1515687692 0 0) 0x7f9d3c001490 con 0x7f9d441550a0 2023-12-12T09:46:49.578 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:49.576+0000 7f9d42ffd640 1 --2- 172.21.15.73:0/2931327905 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9d440c67c0 0x7f9d440c7ed0 secure :-1 s=READY pgs=955 cs=0 l=1 rev1=1 crypto rx=0x7f9d340097a0 tx=0x7f9d3402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57355c7903c00607 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:46:49.578 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:49.576+0000 7f9d41ffb640 1 -- 172.21.15.73:0/2931327905 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d34031830 con 0x7f9d440c67c0 2023-12-12T09:46:49.578 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:49.576+0000 7f9d41ffb640 1 -- 172.21.15.73:0/2931327905 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d34031990 con 0x7f9d440c67c0 2023-12-12T09:46:49.578 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:49.577+0000 7f9d41ffb640 1 -- 172.21.15.73:0/2931327905 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d34031d20 con 0x7f9d440c67c0 2023-12-12T09:46:49.579 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:49.577+0000 7f9d496e0640 1 -- 172.21.15.73:0/2931327905 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9d440c67c0 msgr2=0x7f9d440c7ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:49.579 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:49.577+0000 7f9d496e0640 1 --2- 172.21.15.73:0/2931327905 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9d440c67c0 0x7f9d440c7ed0 secure :-1 s=READY pgs=955 cs=0 l=1 rev1=1 crypto rx=0x7f9d340097a0 tx=0x7f9d3402b8d0 comp rx=0 tx=0).stop 2023-12-12T09:46:49.579 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:49.577+0000 7f9d496e0640 1 -- 172.21.15.73:0/2931327905 shutdown_connections 2023-12-12T09:46:49.579 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:49.577+0000 7f9d496e0640 1 --2- 172.21.15.73:0/2931327905 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9d440c67c0 0x7f9d440c7ed0 unknown :-1 s=CLOSED pgs=955 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:49.579 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:49.577+0000 7f9d496e0640 1 -- 172.21.15.73:0/2931327905 >> 172.21.15.73:0/2931327905 conn(0x7f9d440abb20 msgr2=0x7f9d440abf30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:46:49.579 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:49.577+0000 7f9d496e0640 1 -- 172.21.15.73:0/2931327905 shutdown_connections 2023-12-12T09:46:49.579 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:49.577+0000 7f9d496e0640 1 -- 172.21.15.73:0/2931327905 wait complete. 2023-12-12T09:46:49.580 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:49.579+0000 7f9d496e0640 1 Processor -- start 2023-12-12T09:46:49.580 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:49.579+0000 7f9d496e0640 1 -- start start 2023-12-12T09:46:49.582 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:49.580+0000 7f9d496e0640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9d440c67c0 0x7f9d441494e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:49.582 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:49.580+0000 7f9d496e0640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9d440c6ba0 0x7f9d441eab50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:49.582 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:49.580+0000 7f9d496e0640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9d441550a0 0x7f9d440c3650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:49.582 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:49.580+0000 7f9d496e0640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d441e1570 con 0x7f9d440c6ba0 2023-12-12T09:46:49.582 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:49.580+0000 7f9d496e0640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d441ea420 con 0x7f9d441550a0 2023-12-12T09:46:49.582 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:49.580+0000 7f9d496e0640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d441ea6c0 con 0x7f9d440c67c0 2023-12-12T09:46:49.582 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:49.580+0000 7f9d427fc640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9d440c6ba0 0x7f9d441eab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:49.583 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:49.580+0000 7f9d427fc640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9d440c6ba0 0x7f9d441eab50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:39952/0 (socket says 172.21.15.73:39952) 2023-12-12T09:46:49.583 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:49.580+0000 7f9d427fc640 1 -- 172.21.15.73:0/3448012870 learned_addr learned my addr 172.21.15.73:0/3448012870 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:46:49.583 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:49.581+0000 7f9d427fc640 1 -- 172.21.15.73:0/3448012870 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9d440c67c0 msgr2=0x7f9d441494e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:49.583 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:49.581+0000 7f9d427fc640 1 --2- 172.21.15.73:0/3448012870 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9d440c67c0 0x7f9d441494e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:49.583 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:49.581+0000 7f9d427fc640 1 -- 172.21.15.73:0/3448012870 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9d441550a0 msgr2=0x7f9d440c3650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:49.583 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:49.581+0000 7f9d427fc640 1 --2- 172.21.15.73:0/3448012870 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9d441550a0 0x7f9d440c3650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:49.583 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:49.581+0000 7f9d427fc640 1 -- 172.21.15.73:0/3448012870 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d34009400 con 0x7f9d440c6ba0 2023-12-12T09:46:49.585 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:49.581+0000 7f9d427fc640 1 --2- 172.21.15.73:0/3448012870 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9d440c6ba0 0x7f9d441eab50 secure :-1 s=READY pgs=956 cs=0 l=1 rev1=1 crypto rx=0x7f9d3800c410 tx=0x7f9d3800c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:46:49.585 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:49.581+0000 7f9d2b7fe640 1 -- 172.21.15.73:0/3448012870 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d380035f0 con 0x7f9d440c6ba0 2023-12-12T09:46:49.585 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:49.581+0000 7f9d2b7fe640 1 -- 172.21.15.73:0/3448012870 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d38003750 con 0x7f9d440c6ba0 2023-12-12T09:46:49.585 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:49.581+0000 7f9d2b7fe640 1 -- 172.21.15.73:0/3448012870 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d38003b00 con 0x7f9d440c6ba0 2023-12-12T09:46:49.585 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:49.581+0000 7f9d496e0640 1 -- 172.21.15.73:0/3448012870 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d44149a20 con 0x7f9d440c6ba0 2023-12-12T09:46:49.585 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:49.581+0000 7f9d496e0640 1 -- 172.21.15.73:0/3448012870 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d441e1290 con 0x7f9d440c6ba0 2023-12-12T09:46:49.585 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:49.582+0000 7f9d496e0640 1 -- 172.21.15.73:0/3448012870 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d440c0bc0 con 0x7f9d440c6ba0 2023-12-12T09:46:49.586 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:49.583+0000 7f9d2b7fe640 1 -- 172.21.15.73:0/3448012870 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f9d38003c60 con 0x7f9d440c6ba0 2023-12-12T09:46:49.586 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:49.584+0000 7f9d2b7fe640 1 --2- 172.21.15.73:0/3448012870 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f9d3006ae40 0x7f9d3006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:49.587 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:49.584+0000 7f9d2b7fe640 1 -- 172.21.15.73:0/3448012870 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f9d38088bc0 con 0x7f9d440c6ba0 2023-12-12T09:46:49.587 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:49.585+0000 7f9d42ffd640 1 --2- 172.21.15.73:0/3448012870 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f9d3006ae40 0x7f9d3006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:49.587 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:49.585+0000 7f9d42ffd640 1 --2- 172.21.15.73:0/3448012870 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f9d3006ae40 0x7f9d3006d300 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f9d34036000 tx=0x7f9d34030000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:46:49.590 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:49.589+0000 7f9d2b7fe640 1 -- 172.21.15.73:0/3448012870 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f9d38053900 con 0x7f9d440c6ba0 2023-12-12T09:46:49.778 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:49.777+0000 7f9d496e0640 1 -- 172.21.15.73:0/3448012870 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f9d4406d140 con 0x7f9d440c6ba0 2023-12-12T09:46:49.779 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:49.778+0000 7f9d2b7fe640 1 -- 172.21.15.73:0/3448012870 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v79) v1 ==== 100+0+11 (secure 0 0 0) 0x7f9d38056f20 con 0x7f9d440c6ba0 2023-12-12T09:46:49.779 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 64 2023-12-12T09:46:49.782 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:49.780+0000 7f9d496e0640 1 -- 172.21.15.73:0/3448012870 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f9d3006ae40 msgr2=0x7f9d3006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:49.782 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:49.780+0000 7f9d496e0640 1 --2- 172.21.15.73:0/3448012870 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f9d3006ae40 0x7f9d3006d300 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f9d34036000 tx=0x7f9d34030000 comp rx=0 tx=0).stop 2023-12-12T09:46:49.782 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:49.780+0000 7f9d496e0640 1 -- 172.21.15.73:0/3448012870 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9d440c6ba0 msgr2=0x7f9d441eab50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:49.782 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:49.780+0000 7f9d496e0640 1 --2- 172.21.15.73:0/3448012870 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9d440c6ba0 0x7f9d441eab50 secure :-1 s=READY pgs=956 cs=0 l=1 rev1=1 crypto rx=0x7f9d3800c410 tx=0x7f9d3800c8d0 comp rx=0 tx=0).stop 2023-12-12T09:46:49.782 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:49.780+0000 7f9d496e0640 1 -- 172.21.15.73:0/3448012870 shutdown_connections 2023-12-12T09:46:49.782 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:49.780+0000 7f9d496e0640 1 --2- 172.21.15.73:0/3448012870 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f9d3006ae40 0x7f9d3006d300 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:49.783 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:49.780+0000 7f9d496e0640 1 --2- 172.21.15.73:0/3448012870 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9d441550a0 0x7f9d440c3650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:49.783 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:49.780+0000 7f9d496e0640 1 --2- 172.21.15.73:0/3448012870 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9d440c6ba0 0x7f9d441eab50 unknown :-1 s=CLOSED pgs=956 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:49.783 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:49.780+0000 7f9d496e0640 1 --2- 172.21.15.73:0/3448012870 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9d440c67c0 0x7f9d441494e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:49.783 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:49.780+0000 7f9d496e0640 1 -- 172.21.15.73:0/3448012870 >> 172.21.15.73:0/3448012870 conn(0x7f9d440abb20 msgr2=0x7f9d44152e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:46:49.783 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:49.781+0000 7f9d496e0640 1 -- 172.21.15.73:0/3448012870 shutdown_connections 2023-12-12T09:46:49.783 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:49.781+0000 7f9d496e0640 1 -- 172.21.15.73:0/3448012870 wait complete. 2023-12-12T09:46:49.801 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_metadata pg_num 2023-12-12T09:46:50.005 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:50.003+0000 7fa814c02640 1 Processor -- start 2023-12-12T09:46:50.005 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:50.004+0000 7fa814c02640 1 -- start start 2023-12-12T09:46:50.007 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:50.005+0000 7fa814c02640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fa81014fa70 0x7fa81006def0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:50.007 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:50.005+0000 7fa814c02640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa810071dd0 0x7fa8100c0d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:50.007 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:50.005+0000 7fa814c02640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fa8100c12c0 0x7fa8100c1a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:50.007 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:50.005+0000 7fa814c02640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa81014fe50 con 0x7fa8100c12c0 2023-12-12T09:46:50.008 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:50.005+0000 7fa814c02640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa81006ef90 con 0x7fa81014fa70 2023-12-12T09:46:50.008 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:50.005+0000 7fa814c02640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa810152300 con 0x7fa810071dd0 2023-12-12T09:46:50.008 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:50.005+0000 7fa80ed9d640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fa8100c12c0 0x7fa8100c1a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:50.008 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:50.006+0000 7fa80ed9d640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fa8100c12c0 0x7fa8100c1a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:39962/0 (socket says 172.21.15.73:39962) 2023-12-12T09:46:50.008 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:50.006+0000 7fa80ed9d640 1 -- 172.21.15.73:0/2637172448 learned_addr learned my addr 172.21.15.73:0/2637172448 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:46:50.008 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:50.006+0000 7fa80e59c640 1 --2- 172.21.15.73:0/2637172448 >> v2:172.21.15.142:3300/0 conn(0x7fa81014fa70 0x7fa81006def0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:50.008 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:50.006+0000 7fa80dd9b640 1 --2- 172.21.15.73:0/2637172448 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa810071dd0 0x7fa8100c0d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:50.008 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:50.006+0000 7fa80ed9d640 1 -- 172.21.15.73:0/2637172448 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa810071dd0 msgr2=0x7fa8100c0d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:46:50.008 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:50.006+0000 7fa80ed9d640 1 --2- 172.21.15.73:0/2637172448 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa810071dd0 0x7fa8100c0d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:50.008 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:50.006+0000 7fa80ed9d640 1 -- 172.21.15.73:0/2637172448 >> v2:172.21.15.142:3300/0 conn(0x7fa81014fa70 msgr2=0x7fa81006def0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:46:50.008 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:50.006+0000 7fa80ed9d640 1 --2- 172.21.15.73:0/2637172448 >> v2:172.21.15.142:3300/0 conn(0x7fa81014fa70 0x7fa81006def0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:50.008 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:50.006+0000 7fa80ed9d640 1 -- 172.21.15.73:0/2637172448 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa810072b00 con 0x7fa8100c12c0 2023-12-12T09:46:50.010 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:50.007+0000 7fa80ed9d640 1 --2- 172.21.15.73:0/2637172448 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa8100c12c0 0x7fa8100c1a70 secure :-1 s=READY pgs=957 cs=0 l=1 rev1=1 crypto rx=0x7fa810066860 tx=0x7fa80802b7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae03eaf34e5f4493 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:46:50.010 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:50.007+0000 7fa80d59a640 1 -- 172.21.15.73:0/2637172448 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa808031750 con 0x7fa8100c12c0 2023-12-12T09:46:50.010 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:50.007+0000 7fa80d59a640 1 -- 172.21.15.73:0/2637172448 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8080318b0 con 0x7fa8100c12c0 2023-12-12T09:46:50.010 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:50.007+0000 7fa80d59a640 1 -- 172.21.15.73:0/2637172448 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa808031c40 con 0x7fa8100c12c0 2023-12-12T09:46:50.011 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:50.008+0000 7fa814c02640 1 -- 172.21.15.73:0/2637172448 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa8100c12c0 msgr2=0x7fa8100c1a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:50.011 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:50.008+0000 7fa814c02640 1 --2- 172.21.15.73:0/2637172448 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa8100c12c0 0x7fa8100c1a70 secure :-1 s=READY pgs=957 cs=0 l=1 rev1=1 crypto rx=0x7fa810066860 tx=0x7fa80802b7f0 comp rx=0 tx=0).stop 2023-12-12T09:46:50.011 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:50.008+0000 7fa814c02640 1 -- 172.21.15.73:0/2637172448 shutdown_connections 2023-12-12T09:46:50.011 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:50.008+0000 7fa814c02640 1 --2- 172.21.15.73:0/2637172448 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa8100c12c0 0x7fa8100c1a70 unknown :-1 s=CLOSED pgs=957 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:50.011 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:50.008+0000 7fa814c02640 1 --2- 172.21.15.73:0/2637172448 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa810071dd0 0x7fa8100c0d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:50.011 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:50.008+0000 7fa814c02640 1 --2- 172.21.15.73:0/2637172448 >> v2:172.21.15.142:3300/0 conn(0x7fa81014fa70 0x7fa81006def0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:50.011 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:50.008+0000 7fa814c02640 1 -- 172.21.15.73:0/2637172448 >> 172.21.15.73:0/2637172448 conn(0x7fa8100c6380 msgr2=0x7fa8100c6760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:46:50.011 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:50.008+0000 7fa814c02640 1 -- 172.21.15.73:0/2637172448 shutdown_connections 2023-12-12T09:46:50.011 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:50.008+0000 7fa814c02640 1 -- 172.21.15.73:0/2637172448 wait complete. 2023-12-12T09:46:50.012 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:50.010+0000 7fa814c02640 1 Processor -- start 2023-12-12T09:46:50.012 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:50.010+0000 7fa814c02640 1 -- start start 2023-12-12T09:46:50.014 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:50.012+0000 7fa814c02640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa810071dd0 0x7fa81014a500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:50.014 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:50.012+0000 7fa814c02640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa8100c12c0 0x7fa8101e8530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:50.014 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:50.012+0000 7fa814c02640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa81014fa70 0x7fa810147820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:50.014 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:50.012+0000 7fa814c02640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa810154320 con 0x7fa8100c12c0 2023-12-12T09:46:50.014 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:50.012+0000 7fa814c02640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8101e8110 con 0x7fa810071dd0 2023-12-12T09:46:50.014 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:50.012+0000 7fa814c02640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8101e7e00 con 0x7fa81014fa70 2023-12-12T09:46:50.014 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:50.012+0000 7fa80dd9b640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa8100c12c0 0x7fa8101e8530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:50.015 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:50.012+0000 7fa80dd9b640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa8100c12c0 0x7fa8101e8530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:39968/0 (socket says 172.21.15.73:39968) 2023-12-12T09:46:50.015 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:50.012+0000 7fa80dd9b640 1 -- 172.21.15.73:0/1977455940 learned_addr learned my addr 172.21.15.73:0/1977455940 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:46:50.015 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:50.012+0000 7fa80dd9b640 1 -- 172.21.15.73:0/1977455940 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa81014fa70 msgr2=0x7fa810147820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:50.015 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:50.012+0000 7fa80dd9b640 1 --2- 172.21.15.73:0/1977455940 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa81014fa70 0x7fa810147820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:50.015 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:50.012+0000 7fa80dd9b640 1 -- 172.21.15.73:0/1977455940 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa810071dd0 msgr2=0x7fa81014a500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:50.015 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:50.012+0000 7fa80dd9b640 1 --2- 172.21.15.73:0/1977455940 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa810071dd0 0x7fa81014a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:50.015 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:50.012+0000 7fa80dd9b640 1 -- 172.21.15.73:0/1977455940 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8080094d0 con 0x7fa8100c12c0 2023-12-12T09:46:50.015 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:50.013+0000 7fa80dd9b640 1 --2- 172.21.15.73:0/1977455940 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa8100c12c0 0x7fa8101e8530 secure :-1 s=READY pgs=958 cs=0 l=1 rev1=1 crypto rx=0x7fa7f8007e30 tx=0x7fa7f800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:46:50.016 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:50.013+0000 7fa806ffd640 1 -- 172.21.15.73:0/1977455940 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7f8014620 con 0x7fa8100c12c0 2023-12-12T09:46:50.017 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:50.013+0000 7fa806ffd640 1 -- 172.21.15.73:0/1977455940 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7f800ee90 con 0x7fa8100c12c0 2023-12-12T09:46:50.017 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:50.013+0000 7fa806ffd640 1 -- 172.21.15.73:0/1977455940 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7f80149c0 con 0x7fa8100c12c0 2023-12-12T09:46:50.017 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:50.013+0000 7fa814c02640 1 -- 172.21.15.73:0/1977455940 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa810153a80 con 0x7fa8100c12c0 2023-12-12T09:46:50.017 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:50.013+0000 7fa814c02640 1 -- 172.21.15.73:0/1977455940 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa810154040 con 0x7fa8100c12c0 2023-12-12T09:46:50.017 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:50.014+0000 7fa814c02640 1 -- 172.21.15.73:0/1977455940 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8100c0890 con 0x7fa8100c12c0 2023-12-12T09:46:50.017 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:50.015+0000 7fa806ffd640 1 -- 172.21.15.73:0/1977455940 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fa7f8014b20 con 0x7fa8100c12c0 2023-12-12T09:46:50.017 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:50.016+0000 7fa806ffd640 1 --2- 172.21.15.73:0/1977455940 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fa7f406ae40 0x7fa7f406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:50.018 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:50.016+0000 7fa806ffd640 1 -- 172.21.15.73:0/1977455940 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fa7f808a390 con 0x7fa8100c12c0 2023-12-12T09:46:50.018 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:50.016+0000 7fa80e59c640 1 --2- 172.21.15.73:0/1977455940 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fa7f406ae40 0x7fa7f406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:50.018 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:50.017+0000 7fa80e59c640 1 --2- 172.21.15.73:0/1977455940 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fa7f406ae40 0x7fa7f406d300 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fa800009870 tx=0x7fa800008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:46:50.021 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:50.020+0000 7fa806ffd640 1 -- 172.21.15.73:0/1977455940 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fa7f8055040 con 0x7fa8100c12c0 2023-12-12T09:46:50.211 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:50.209+0000 7fa814c02640 1 -- 172.21.15.73:0/1977455940 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"} v 0) v1 -- 0x7fa8101e8250 con 0x7fa8100c12c0 2023-12-12T09:46:50.212 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:50.210+0000 7fa806ffd640 1 -- 172.21.15.73:0/1977455940 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"}]=0 v79) v1 ==== 105+0+11 (secure 0 0 0) 0x7fa8101e8250 con 0x7fa8100c12c0 2023-12-12T09:46:50.212 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 32 2023-12-12T09:46:50.214 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:50.213+0000 7fa814c02640 1 -- 172.21.15.73:0/1977455940 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fa7f406ae40 msgr2=0x7fa7f406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:50.215 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:50.213+0000 7fa814c02640 1 --2- 172.21.15.73:0/1977455940 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fa7f406ae40 0x7fa7f406d300 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fa800009870 tx=0x7fa800008040 comp rx=0 tx=0).stop 2023-12-12T09:46:50.215 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:50.213+0000 7fa814c02640 1 -- 172.21.15.73:0/1977455940 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa8100c12c0 msgr2=0x7fa8101e8530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:50.215 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:50.213+0000 7fa814c02640 1 --2- 172.21.15.73:0/1977455940 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa8100c12c0 0x7fa8101e8530 secure :-1 s=READY pgs=958 cs=0 l=1 rev1=1 crypto rx=0x7fa7f8007e30 tx=0x7fa7f800e4b0 comp rx=0 tx=0).stop 2023-12-12T09:46:50.215 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:50.213+0000 7fa814c02640 1 -- 172.21.15.73:0/1977455940 shutdown_connections 2023-12-12T09:46:50.215 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:50.213+0000 7fa814c02640 1 --2- 172.21.15.73:0/1977455940 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fa7f406ae40 0x7fa7f406d300 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:50.215 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:50.213+0000 7fa814c02640 1 --2- 172.21.15.73:0/1977455940 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa81014fa70 0x7fa810147820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:50.215 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:50.213+0000 7fa814c02640 1 --2- 172.21.15.73:0/1977455940 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa8100c12c0 0x7fa8101e8530 unknown :-1 s=CLOSED pgs=958 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:50.215 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:50.213+0000 7fa814c02640 1 --2- 172.21.15.73:0/1977455940 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa810071dd0 0x7fa81014a500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:50.215 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:50.213+0000 7fa814c02640 1 -- 172.21.15.73:0/1977455940 >> 172.21.15.73:0/1977455940 conn(0x7fa8100c6380 msgr2=0x7fa8100c6760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:46:50.215 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:50.213+0000 7fa814c02640 1 -- 172.21.15.73:0/1977455940 shutdown_connections 2023-12-12T09:46:50.215 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:50.213+0000 7fa814c02640 1 -- 172.21.15.73:0/1977455940 wait complete. 2023-12-12T09:46:50.234 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_data pg_num 2023-12-12T09:46:50.449 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:50.447+0000 7f79f6c7c640 1 Processor -- start 2023-12-12T09:46:50.449 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:50.448+0000 7f79f6c7c640 1 -- start start 2023-12-12T09:46:50.451 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:50.449+0000 7f79f6c7c640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f79f014ea60 0x7f79f00c5420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:50.451 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:50.449+0000 7f79f6c7c640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f79f00a4c90 0x7f79f00c0320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:50.451 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:50.449+0000 7f79f6c7c640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79f00c3390 con 0x7f79f00c4420 2023-12-12T09:46:50.451 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:50.449+0000 7f79f6c7c640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79f0151e60 con 0x7f79f00a4c90 2023-12-12T09:46:50.451 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:50.449+0000 7f79f6c7c640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79f0152140 con 0x7f79f014ea60 2023-12-12T09:46:50.451 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:50.450+0000 7f79effff640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f79f00a4c90 0x7f79f00c0320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:50.451 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:50.450+0000 7f79effff640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f79f00a4c90 0x7f79f00c0320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:39972/0 (socket says 172.21.15.73:39972) 2023-12-12T09:46:50.451 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:50.450+0000 7f79effff640 1 -- 172.21.15.73:0/2001890221 learned_addr learned my addr 172.21.15.73:0/2001890221 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:46:50.452 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:50.450+0000 7f79f4a18640 1 --2- 172.21.15.73:0/2001890221 >> v2:172.21.15.142:3300/0 conn(0x7f79f014ea60 0x7f79f00c5420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:50.452 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:50.450+0000 7f79effff640 1 -- 172.21.15.73:0/2001890221 >> v2:172.21.15.142:3300/0 conn(0x7f79f014ea60 msgr2=0x7f79f00c5420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:46:50.452 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:50.450+0000 7f79effff640 1 --2- 172.21.15.73:0/2001890221 >> v2:172.21.15.142:3300/0 conn(0x7f79f014ea60 0x7f79f00c5420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:50.452 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:50.450+0000 7f79effff640 1 -- 172.21.15.73:0/2001890221 >> v1:172.21.15.142:6789/0 conn(0x7f79f00c4420 legacy=0x7f79f00c20b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:46:50.452 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:50.450+0000 7f79effff640 1 -- 172.21.15.73:0/2001890221 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79f00c3940 con 0x7f79f00a4c90 2023-12-12T09:46:50.453 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:50.452+0000 7f79effff640 1 --2- 172.21.15.73:0/2001890221 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f79f00a4c90 0x7f79f00c0320 secure :-1 s=READY pgs=959 cs=0 l=1 rev1=1 crypto rx=0x7f79f006b490 tx=0x7f79dc02b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd936e833e2e0c29 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:46:50.453 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:50.452+0000 7f79ef7fe640 1 -- 172.21.15.73:0/2001890221 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79dc031870 con 0x7f79f00a4c90 2023-12-12T09:46:50.454 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:50.452+0000 7f79ef7fe640 1 -- 172.21.15.73:0/2001890221 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79dc0319d0 con 0x7f79f00a4c90 2023-12-12T09:46:50.454 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:50.452+0000 7f79ef7fe640 1 -- 172.21.15.73:0/2001890221 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79dc031d60 con 0x7f79f00a4c90 2023-12-12T09:46:50.454 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:50.453+0000 7f79f6c7c640 1 -- 172.21.15.73:0/2001890221 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f79f00a4c90 msgr2=0x7f79f00c0320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:50.455 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:50.453+0000 7f79f6c7c640 1 --2- 172.21.15.73:0/2001890221 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f79f00a4c90 0x7f79f00c0320 secure :-1 s=READY pgs=959 cs=0 l=1 rev1=1 crypto rx=0x7f79f006b490 tx=0x7f79dc02b910 comp rx=0 tx=0).stop 2023-12-12T09:46:50.455 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:50.453+0000 7f79f6c7c640 1 -- 172.21.15.73:0/2001890221 shutdown_connections 2023-12-12T09:46:50.455 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:50.453+0000 7f79f6c7c640 1 --2- 172.21.15.73:0/2001890221 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f79f00a4c90 0x7f79f00c0320 unknown :-1 s=CLOSED pgs=959 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:50.455 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:50.453+0000 7f79f6c7c640 1 --2- 172.21.15.73:0/2001890221 >> v2:172.21.15.142:3300/0 conn(0x7f79f014ea60 0x7f79f00c5420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:50.455 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:50.453+0000 7f79f6c7c640 1 -- 172.21.15.73:0/2001890221 >> 172.21.15.73:0/2001890221 conn(0x7f79f006a4e0 msgr2=0x7f79f006a8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:46:50.455 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:50.453+0000 7f79f6c7c640 1 -- 172.21.15.73:0/2001890221 shutdown_connections 2023-12-12T09:46:50.455 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:50.453+0000 7f79f6c7c640 1 -- 172.21.15.73:0/2001890221 wait complete. 2023-12-12T09:46:50.456 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:50.455+0000 7f79f6c7c640 1 Processor -- start 2023-12-12T09:46:50.456 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:50.455+0000 7f79f6c7c640 1 -- start start 2023-12-12T09:46:50.457 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:50.456+0000 7f79f6c7c640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f79f00a4c90 0x7f79f014be60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:50.457 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:50.456+0000 7f79f6c7c640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f79f00c4420 0x7f79f01e5c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:50.458 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:50.456+0000 7f79f6c7c640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f79f014ea60 0x7f79f014a2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:50.458 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:50.456+0000 7f79f6c7c640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79f0149e40 con 0x7f79f014ea60 2023-12-12T09:46:50.458 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:50.456+0000 7f79f6c7c640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79f01e6530 con 0x7f79f00a4c90 2023-12-12T09:46:50.458 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:50.456+0000 7f79f6c7c640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79f01e6810 con 0x7f79f00c4420 2023-12-12T09:46:50.458 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:50.456+0000 7f79f5219640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f79f014ea60 0x7f79f014a2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:50.458 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:50.456+0000 7f79f5219640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f79f014ea60 0x7f79f014a2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:39978/0 (socket says 172.21.15.73:39978) 2023-12-12T09:46:50.458 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:50.456+0000 7f79f5219640 1 -- 172.21.15.73:0/99439662 learned_addr learned my addr 172.21.15.73:0/99439662 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:46:50.459 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:50.456+0000 7f79f4a18640 1 --2- 172.21.15.73:0/99439662 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f79f00a4c90 0x7f79f014be60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:50.459 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:50.456+0000 7f79effff640 1 --2- 172.21.15.73:0/99439662 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f79f00c4420 0x7f79f01e5c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:50.459 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:50.457+0000 7f79f5219640 1 -- 172.21.15.73:0/99439662 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f79f00c4420 msgr2=0x7f79f01e5c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:50.459 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:50.457+0000 7f79f5219640 1 --2- 172.21.15.73:0/99439662 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f79f00c4420 0x7f79f01e5c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:50.459 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:50.457+0000 7f79f5219640 1 -- 172.21.15.73:0/99439662 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f79f00a4c90 msgr2=0x7f79f014be60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:50.460 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:50.457+0000 7f79f5219640 1 --2- 172.21.15.73:0/99439662 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f79f00a4c90 0x7f79f014be60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:50.460 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:50.457+0000 7f79f5219640 1 -- 172.21.15.73:0/99439662 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79dc0094d0 con 0x7f79f014ea60 2023-12-12T09:46:50.460 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:50.457+0000 7f79f5219640 1 --2- 172.21.15.73:0/99439662 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f79f014ea60 0x7f79f014a2d0 secure :-1 s=READY pgs=960 cs=0 l=1 rev1=1 crypto rx=0x7f79e800c7a0 tx=0x7f79e800cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:46:50.460 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:50.457+0000 7f79ed7fa640 1 -- 172.21.15.73:0/99439662 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79e8003b70 con 0x7f79f014ea60 2023-12-12T09:46:50.460 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:50.457+0000 7f79ed7fa640 1 -- 172.21.15.73:0/99439662 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79e8003cf0 con 0x7f79f014ea60 2023-12-12T09:46:50.460 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:50.457+0000 7f79ed7fa640 1 -- 172.21.15.73:0/99439662 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79e8003ea0 con 0x7f79f014ea60 2023-12-12T09:46:50.460 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:50.457+0000 7f79f6c7c640 1 -- 172.21.15.73:0/99439662 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79f01e6af0 con 0x7f79f014ea60 2023-12-12T09:46:50.460 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:50.457+0000 7f79f6c7c640 1 -- 172.21.15.73:0/99439662 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79f014c3a0 con 0x7f79f014ea60 2023-12-12T09:46:50.460 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:50.459+0000 7f79f6c7c640 1 -- 172.21.15.73:0/99439662 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79f00c3200 con 0x7f79f014ea60 2023-12-12T09:46:50.461 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:50.460+0000 7f79ed7fa640 1 -- 172.21.15.73:0/99439662 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f79e800aa90 con 0x7f79f014ea60 2023-12-12T09:46:50.462 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:50.460+0000 7f79ed7fa640 1 --2- 172.21.15.73:0/99439662 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f79d406ae40 0x7f79d406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:50.462 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:50.461+0000 7f79ed7fa640 1 -- 172.21.15.73:0/99439662 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f79e8089740 con 0x7f79f014ea60 2023-12-12T09:46:50.462 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:50.461+0000 7f79f4a18640 1 --2- 172.21.15.73:0/99439662 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f79d406ae40 0x7f79d406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:50.462 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:50.461+0000 7f79f4a18640 1 --2- 172.21.15.73:0/99439662 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f79d406ae40 0x7f79d406d300 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f79e4006fd0 tx=0x7f79e4008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:46:50.466 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:50.465+0000 7f79ed7fa640 1 -- 172.21.15.73:0/99439662 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f79e8054520 con 0x7f79f014ea60 2023-12-12T09:46:50.660 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:50.659+0000 7f79f6c7c640 1 -- 172.21.15.73:0/99439662 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"} v 0) v1 -- 0x7f79f0149ff0 con 0x7f79f014ea60 2023-12-12T09:46:50.661 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:50.660+0000 7f79ed7fa640 1 -- 172.21.15.73:0/99439662 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"}]=0 v79) v1 ==== 101+0+11 (secure 0 0 0) 0x7f79f0149ff0 con 0x7f79f014ea60 2023-12-12T09:46:50.661 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 64 2023-12-12T09:46:50.664 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:50.662+0000 7f79f6c7c640 1 -- 172.21.15.73:0/99439662 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f79d406ae40 msgr2=0x7f79d406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:50.664 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:50.662+0000 7f79f6c7c640 1 --2- 172.21.15.73:0/99439662 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f79d406ae40 0x7f79d406d300 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f79e4006fd0 tx=0x7f79e4008040 comp rx=0 tx=0).stop 2023-12-12T09:46:50.664 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:50.662+0000 7f79f6c7c640 1 -- 172.21.15.73:0/99439662 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f79f014ea60 msgr2=0x7f79f014a2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:50.664 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:50.662+0000 7f79f6c7c640 1 --2- 172.21.15.73:0/99439662 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f79f014ea60 0x7f79f014a2d0 secure :-1 s=READY pgs=960 cs=0 l=1 rev1=1 crypto rx=0x7f79e800c7a0 tx=0x7f79e800cc60 comp rx=0 tx=0).stop 2023-12-12T09:46:50.664 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:50.662+0000 7f79f6c7c640 1 -- 172.21.15.73:0/99439662 shutdown_connections 2023-12-12T09:46:50.664 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:50.662+0000 7f79f6c7c640 1 --2- 172.21.15.73:0/99439662 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f79d406ae40 0x7f79d406d300 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:50.664 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:50.662+0000 7f79f6c7c640 1 --2- 172.21.15.73:0/99439662 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f79f014ea60 0x7f79f014a2d0 unknown :-1 s=CLOSED pgs=960 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:50.664 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:50.662+0000 7f79f6c7c640 1 --2- 172.21.15.73:0/99439662 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f79f00c4420 0x7f79f01e5c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:50.664 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:50.662+0000 7f79f6c7c640 1 --2- 172.21.15.73:0/99439662 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f79f00a4c90 0x7f79f014be60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:50.664 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:50.662+0000 7f79f6c7c640 1 -- 172.21.15.73:0/99439662 >> 172.21.15.73:0/99439662 conn(0x7f79f006a4e0 msgr2=0x7f79f006a8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:46:50.664 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:50.662+0000 7f79f6c7c640 1 -- 172.21.15.73:0/99439662 shutdown_connections 2023-12-12T09:46:50.665 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:50.662+0000 7f79f6c7c640 1 -- 172.21.15.73:0/99439662 wait complete. 2023-12-12T09:46:50.682 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-12T09:46:50.893 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:50.891+0000 7f7359c87640 1 Processor -- start 2023-12-12T09:46:50.893 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:50.892+0000 7f7359c87640 1 -- start start 2023-12-12T09:46:50.895 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:50.893+0000 7f7359c87640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f735406fca0 0x7f7354072700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:50.895 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:50.893+0000 7f7359c87640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7354152560 con 0x7f73540c17e0 2023-12-12T09:46:50.895 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:50.893+0000 7f7359c87640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73541532e0 con 0x7f73540c0420 2023-12-12T09:46:50.895 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:50.893+0000 7f7359c87640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7354152ec0 con 0x7f735406fca0 2023-12-12T09:46:50.895 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:50.893+0000 7f73537fe640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f735406fca0 0x7f7354072700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:50.895 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:50.893+0000 7f7353fff640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f73540c17e0 0x7f735415ccd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:51636/0 (socket says 172.21.15.73:51636) 2023-12-12T09:46:50.895 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:50.893+0000 7f7353fff640 1 -- 172.21.15.73:0/2909592700 learned_addr learned my addr 172.21.15.73:0/2909592700 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-12T09:46:50.896 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:50.894+0000 7f73537fe640 1 -- 172.21.15.73:0/2909592700 >> v1:172.21.15.142:6789/0 conn(0x7f73540c0420 legacy=0x7f73540c10d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:46:50.896 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:50.894+0000 7f73537fe640 1 -- 172.21.15.73:0/2909592700 >> v1:172.21.15.73:6789/0 conn(0x7f73540c17e0 legacy=0x7f735415ccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:50.896 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:50.894+0000 7f73537fe640 1 -- 172.21.15.73:0/2909592700 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7354152800 con 0x7f735406fca0 2023-12-12T09:46:50.896 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:50.894+0000 7f7352ffd640 1 -- 172.21.15.73:0/2909592700 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3428412012 0 0) 0x7f7354152560 con 0x7f73540c17e0 2023-12-12T09:46:50.897 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:50.895+0000 7f73537fe640 1 --2- 172.21.15.73:0/2909592700 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f735406fca0 0x7f7354072700 secure :-1 s=READY pgs=962 cs=0 l=1 rev1=1 crypto rx=0x7f73440097a0 tx=0x7f734402b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d493d6fd19e6ed8 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:46:50.897 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:50.895+0000 7f7352ffd640 1 -- 172.21.15.73:0/2909592700 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f734402e070 con 0x7f735406fca0 2023-12-12T09:46:50.897 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:50.895+0000 7f7352ffd640 1 -- 172.21.15.73:0/2909592700 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73440315a0 con 0x7f735406fca0 2023-12-12T09:46:50.897 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:50.895+0000 7f7352ffd640 1 -- 172.21.15.73:0/2909592700 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7344031930 con 0x7f735406fca0 2023-12-12T09:46:50.897 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:50.896+0000 7f7359c87640 1 -- 172.21.15.73:0/2909592700 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f735406fca0 msgr2=0x7f7354072700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:50.898 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:50.896+0000 7f7359c87640 1 --2- 172.21.15.73:0/2909592700 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f735406fca0 0x7f7354072700 secure :-1 s=READY pgs=962 cs=0 l=1 rev1=1 crypto rx=0x7f73440097a0 tx=0x7f734402b840 comp rx=0 tx=0).stop 2023-12-12T09:46:50.898 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:50.896+0000 7f7359c87640 1 -- 172.21.15.73:0/2909592700 shutdown_connections 2023-12-12T09:46:50.898 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:50.896+0000 7f7359c87640 1 --2- 172.21.15.73:0/2909592700 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f735406fca0 0x7f7354072700 unknown :-1 s=CLOSED pgs=962 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:50.898 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:50.896+0000 7f7359c87640 1 -- 172.21.15.73:0/2909592700 >> 172.21.15.73:0/2909592700 conn(0x7f73540a77d0 msgr2=0x7f73540a7bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:46:50.898 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:50.896+0000 7f7359c87640 1 -- 172.21.15.73:0/2909592700 shutdown_connections 2023-12-12T09:46:50.898 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:50.896+0000 7f7359c87640 1 -- 172.21.15.73:0/2909592700 wait complete. 2023-12-12T09:46:50.899 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:50.898+0000 7f7359c87640 1 Processor -- start 2023-12-12T09:46:50.899 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:50.898+0000 7f7359c87640 1 -- start start 2023-12-12T09:46:50.900 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:50.899+0000 7f7359c87640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f735406fca0 0x7f735414a3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:50.900 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:50.899+0000 7f7359c87640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f73540c0420 0x7f7354155b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:50.900 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:50.899+0000 7f7359c87640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f73540c17e0 0x7f73541489e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:50.900 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:50.899+0000 7f7359c87640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73540a93e0 con 0x7f735406fca0 2023-12-12T09:46:50.901 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:50.899+0000 7f7359c87640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f735414c9a0 con 0x7f73540c0420 2023-12-12T09:46:50.901 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:50.899+0000 7f7359c87640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f735414c3e0 con 0x7f73540c17e0 2023-12-12T09:46:50.901 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:50.899+0000 7f73537fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f735406fca0 0x7f735414a3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:50.901 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:50.899+0000 7f73537fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f735406fca0 0x7f735414a3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:39996/0 (socket says 172.21.15.73:39996) 2023-12-12T09:46:50.901 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:50.899+0000 7f73537fe640 1 -- 172.21.15.73:0/2112615894 learned_addr learned my addr 172.21.15.73:0/2112615894 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:46:50.902 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:50.899+0000 7f73537fe640 1 -- 172.21.15.73:0/2112615894 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f73540c17e0 msgr2=0x7f73541489e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:50.902 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:50.899+0000 7f73537fe640 1 --2- 172.21.15.73:0/2112615894 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f73540c17e0 0x7f73541489e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:50.902 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:50.899+0000 7f73537fe640 1 -- 172.21.15.73:0/2112615894 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f73540c0420 msgr2=0x7f7354155b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:50.902 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:50.899+0000 7f73537fe640 1 --2- 172.21.15.73:0/2112615894 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f73540c0420 0x7f7354155b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:50.902 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:50.899+0000 7f73537fe640 1 -- 172.21.15.73:0/2112615894 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7344009400 con 0x7f735406fca0 2023-12-12T09:46:50.902 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:50.900+0000 7f73537fe640 1 --2- 172.21.15.73:0/2112615894 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f735406fca0 0x7f735414a3a0 secure :-1 s=READY pgs=963 cs=0 l=1 rev1=1 crypto rx=0x7f73440097a0 tx=0x7f73440046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:46:50.902 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:50.900+0000 7f7350ff9640 1 -- 172.21.15.73:0/2112615894 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7344004230 con 0x7f735406fca0 2023-12-12T09:46:50.902 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:50.900+0000 7f7350ff9640 1 -- 172.21.15.73:0/2112615894 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73440043b0 con 0x7f735406fca0 2023-12-12T09:46:50.902 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:50.900+0000 7f7350ff9640 1 -- 172.21.15.73:0/2112615894 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7344004520 con 0x7f735406fca0 2023-12-12T09:46:50.902 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:50.900+0000 7f7359c87640 1 -- 172.21.15.73:0/2112615894 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f735414c6c0 con 0x7f735406fca0 2023-12-12T09:46:50.902 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:50.900+0000 7f7359c87640 1 -- 172.21.15.73:0/2112615894 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73541560a0 con 0x7f735406fca0 2023-12-12T09:46:50.903 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:50.901+0000 7f7359c87640 1 -- 172.21.15.73:0/2112615894 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7354067580 con 0x7f735406fca0 2023-12-12T09:46:50.903 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:50.902+0000 7f7350ff9640 1 -- 172.21.15.73:0/2112615894 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f7344032880 con 0x7f735406fca0 2023-12-12T09:46:50.904 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:50.903+0000 7f7350ff9640 1 --2- 172.21.15.73:0/2112615894 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f733406ae90 0x7f733406d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:50.904 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:50.903+0000 7f7350ff9640 1 -- 172.21.15.73:0/2112615894 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f73440abab0 con 0x7f735406fca0 2023-12-12T09:46:50.905 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:50.903+0000 7f734affd640 1 --2- 172.21.15.73:0/2112615894 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f733406ae90 0x7f733406d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:50.905 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:50.904+0000 7f734affd640 1 --2- 172.21.15.73:0/2112615894 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f733406ae90 0x7f733406d350 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f733c006fd0 tx=0x7f733c006bc0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:46:50.909 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:50.907+0000 7f7350ff9640 1 -- 172.21.15.73:0/2112615894 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f7344076870 con 0x7f735406fca0 2023-12-12T09:46:51.117 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:51.116+0000 7f7359c87640 1 -- 172.21.15.73:0/2112615894 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f7354067580 con 0x7f735406fca0 2023-12-12T09:46:51.118 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:51.116+0000 7f7350ff9640 1 -- 172.21.15.73:0/2112615894 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v79) v1 ==== 80+0+0 (secure 0 0 0) 0x7f7344079e90 con 0x7f735406fca0 2023-12-12T09:46:51.118 INFO:teuthology.orchestra.run.smithi073.stderr:listed 0 entries 2023-12-12T09:46:51.121 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:51.119+0000 7f7359c87640 1 -- 172.21.15.73:0/2112615894 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f733406ae90 msgr2=0x7f733406d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:51.121 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:51.119+0000 7f7359c87640 1 --2- 172.21.15.73:0/2112615894 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f733406ae90 0x7f733406d350 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f733c006fd0 tx=0x7f733c006bc0 comp rx=0 tx=0).stop 2023-12-12T09:46:51.121 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:51.119+0000 7f7359c87640 1 -- 172.21.15.73:0/2112615894 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f735406fca0 msgr2=0x7f735414a3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:51.121 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:51.119+0000 7f7359c87640 1 --2- 172.21.15.73:0/2112615894 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f735406fca0 0x7f735414a3a0 secure :-1 s=READY pgs=963 cs=0 l=1 rev1=1 crypto rx=0x7f73440097a0 tx=0x7f73440046c0 comp rx=0 tx=0).stop 2023-12-12T09:46:51.121 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:51.119+0000 7f7359c87640 1 -- 172.21.15.73:0/2112615894 shutdown_connections 2023-12-12T09:46:51.121 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:51.119+0000 7f7359c87640 1 --2- 172.21.15.73:0/2112615894 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f733406ae90 0x7f733406d350 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:51.121 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:51.119+0000 7f7359c87640 1 --2- 172.21.15.73:0/2112615894 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f73540c17e0 0x7f73541489e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:51.121 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:51.119+0000 7f7359c87640 1 --2- 172.21.15.73:0/2112615894 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f73540c0420 0x7f7354155b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:51.121 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:51.119+0000 7f7359c87640 1 --2- 172.21.15.73:0/2112615894 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f735406fca0 0x7f735414a3a0 unknown :-1 s=CLOSED pgs=963 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:51.121 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:51.119+0000 7f7359c87640 1 -- 172.21.15.73:0/2112615894 >> 172.21.15.73:0/2112615894 conn(0x7f73540a77d0 msgr2=0x7f73540c1060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:46:51.121 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:51.119+0000 7f7359c87640 1 -- 172.21.15.73:0/2112615894 shutdown_connections 2023-12-12T09:46:51.121 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:51.119+0000 7f7359c87640 1 -- 172.21.15.73:0/2112615894 wait complete. 2023-12-12T09:46:51.140 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-12-12T09:46:51.140 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T09:46:51.140 DEBUG:teuthology.orchestra.run.smithi142:> sudo umount /home/ubuntu/cephtest/mnt.1 2023-12-12T09:46:51.254 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi142.front.sepia.ceph.com 2023-12-12T09:46:51.254 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T09:46:51.255 DEBUG:teuthology.orchestra.run.smithi142:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-12-12T09:46:51.307 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2023-12-12T09:46:51.307 DEBUG:teuthology.orchestra.run.smithi142:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-12T09:46:51.356 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054289,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498808k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249400k,nr_inodes=812350,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498808k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 2023-12-12T09:46:51.357 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-12-12T09:46:51.580 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:51.578+0000 7ff93da7e640 1 Processor -- start 2023-12-12T09:46:51.580 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:51.578+0000 7ff93da7e640 1 -- start start 2023-12-12T09:46:51.581 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:51.580+0000 7ff93da7e640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff938151d90 0x7ff9380c37b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:51.581 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:51.580+0000 7ff93da7e640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff93806d8d0 con 0x7ff9380bef50 2023-12-12T09:46:51.581 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:51.580+0000 7ff93da7e640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9380c4d70 con 0x7ff9380c5160 2023-12-12T09:46:51.581 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:51.580+0000 7ff93da7e640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff93806ccc0 con 0x7ff938151d90 2023-12-12T09:46:51.581 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:51.580+0000 7ff93ca7c640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7ff9380bef50 0x7ff938158270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:51638/0 (socket says 172.21.15.73:51638) 2023-12-12T09:46:51.582 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:51.580+0000 7ff93ca7c640 1 -- 172.21.15.73:0/957463019 learned_addr learned my addr 172.21.15.73:0/957463019 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-12T09:46:51.583 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:51.580+0000 7ff93d27d640 1 --2- 172.21.15.73:0/957463019 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff938151d90 0x7ff9380c37b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:51.583 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:51.580+0000 7ff9377fe640 1 -- 172.21.15.73:0/957463019 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3970133013 0 0) 0x7ff93806d8d0 con 0x7ff9380bef50 2023-12-12T09:46:51.583 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:51.580+0000 7ff9377fe640 1 -- 172.21.15.73:0/957463019 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff928003520 con 0x7ff9380bef50 2023-12-12T09:46:51.584 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:51.581+0000 7ff9377fe640 1 -- 172.21.15.73:0/957463019 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1751586352 0 0) 0x7ff928003520 con 0x7ff9380bef50 2023-12-12T09:46:51.584 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:51.581+0000 7ff9377fe640 1 -- 172.21.15.73:0/957463019 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff938151d90 msgr2=0x7ff9380c37b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:46:51.584 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:51.581+0000 7ff9377fe640 1 --2- 172.21.15.73:0/957463019 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff938151d90 0x7ff9380c37b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:51.584 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:51.581+0000 7ff9377fe640 1 -- 172.21.15.73:0/957463019 >> v1:172.21.15.142:6789/0 conn(0x7ff9380c5160 legacy=0x7ff938151680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:51.584 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:51.581+0000 7ff9377fe640 1 -- 172.21.15.73:0/957463019 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff93806cfa0 con 0x7ff9380bef50 2023-12-12T09:46:51.584 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:51.581+0000 7ff9377fe640 1 -- 172.21.15.73:0/957463019 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3186547832 0 0) 0x7ff92c001670 con 0x7ff9380bef50 2023-12-12T09:46:51.584 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:51.581+0000 7ff9377fe640 1 -- 172.21.15.73:0/957463019 >> v1:172.21.15.73:6789/0 conn(0x7ff9380bef50 legacy=0x7ff938158270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:51.584 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:51.581+0000 7ff9377fe640 1 --2- 172.21.15.73:0/957463019 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff9280039a0 0x7ff928003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:51.584 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:51.581+0000 7ff9377fe640 1 --2- 172.21.15.73:0/957463019 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff9280047c0 0x7ff928004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:51.584 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:51.581+0000 7ff9377fe640 1 --2- 172.21.15.73:0/957463019 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff9280051d0 0x7ff92800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:51.584 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:51.581+0000 7ff9377fe640 1 -- 172.21.15.73:0/957463019 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff93806ccc0 con 0x7ff9280039a0 2023-12-12T09:46:51.584 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:51.581+0000 7ff9377fe640 1 -- 172.21.15.73:0/957463019 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff92800c0d0 con 0x7ff9280051d0 2023-12-12T09:46:51.584 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:51.581+0000 7ff9377fe640 1 -- 172.21.15.73:0/957463019 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff92800c290 con 0x7ff9280047c0 2023-12-12T09:46:51.584 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:51.581+0000 7ff93d27d640 1 --2- 172.21.15.73:0/957463019 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff938151d90 0x7ff9380c37b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-12T09:46:51.585 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:51.581+0000 7ff93ca7c640 1 --2- 172.21.15.73:0/957463019 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff9280039a0 0x7ff928003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:51.585 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:51.582+0000 7ff93ca7c640 1 -- 172.21.15.73:0/957463019 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff9280047c0 msgr2=0x7ff928004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:46:51.585 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:51.582+0000 7ff937fff640 1 --2- 172.21.15.73:0/957463019 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff9280047c0 0x7ff928004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:51.585 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:51.582+0000 7ff93d27d640 1 --2- 172.21.15.73:0/957463019 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff9280051d0 0x7ff92800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:51.585 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:51.582+0000 7ff93ca7c640 1 --2- 172.21.15.73:0/957463019 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff9280047c0 0x7ff928004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:51.585 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:51.582+0000 7ff93ca7c640 1 -- 172.21.15.73:0/957463019 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff9280051d0 msgr2=0x7ff92800b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:46:51.585 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:51.582+0000 7ff93ca7c640 1 --2- 172.21.15.73:0/957463019 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff9280051d0 0x7ff92800b980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:51.585 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:51.582+0000 7ff93ca7c640 1 -- 172.21.15.73:0/957463019 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff928003520 con 0x7ff9280039a0 2023-12-12T09:46:51.585 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:51.582+0000 7ff937fff640 1 --2- 172.21.15.73:0/957463019 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff9280047c0 0x7ff928004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:46:51.586 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:51.583+0000 7ff93ca7c640 1 --2- 172.21.15.73:0/957463019 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff9280039a0 0x7ff928003dc0 secure :-1 s=READY pgs=965 cs=0 l=1 rev1=1 crypto rx=0x7ff92c00c240 tx=0x7ff9280057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c07380abbc3e49f8 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:46:51.586 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:51.583+0000 7ff9377fe640 1 -- 172.21.15.73:0/957463019 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff92c005ad0 con 0x7ff9280039a0 2023-12-12T09:46:51.586 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:51.583+0000 7ff9377fe640 1 -- 172.21.15.73:0/957463019 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff92c005c30 con 0x7ff9280039a0 2023-12-12T09:46:51.586 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:51.583+0000 7ff9377fe640 1 -- 172.21.15.73:0/957463019 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff92c02c8b0 con 0x7ff9280039a0 2023-12-12T09:46:51.586 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:51.584+0000 7ff93da7e640 1 -- 172.21.15.73:0/957463019 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff9280039a0 msgr2=0x7ff928003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:51.586 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:51.584+0000 7ff93da7e640 1 --2- 172.21.15.73:0/957463019 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff9280039a0 0x7ff928003dc0 secure :-1 s=READY pgs=965 cs=0 l=1 rev1=1 crypto rx=0x7ff92c00c240 tx=0x7ff9280057f0 comp rx=0 tx=0).stop 2023-12-12T09:46:51.587 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:51.584+0000 7ff93d27d640 1 -- 172.21.15.73:0/957463019 reap_dead start 2023-12-12T09:46:51.587 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:51.584+0000 7ff93da7e640 1 -- 172.21.15.73:0/957463019 shutdown_connections 2023-12-12T09:46:51.587 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:51.584+0000 7ff93da7e640 1 -- 172.21.15.73:0/957463019 >> 172.21.15.73:0/957463019 conn(0x7ff9380c23b0 msgr2=0x7ff9380c2790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:46:51.587 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:51.584+0000 7ff93da7e640 1 -- 172.21.15.73:0/957463019 shutdown_connections 2023-12-12T09:46:51.587 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:51.584+0000 7ff93da7e640 1 -- 172.21.15.73:0/957463019 wait complete. 2023-12-12T09:46:51.587 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:51.585+0000 7ff93da7e640 1 Processor -- start 2023-12-12T09:46:51.587 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:51.586+0000 7ff93da7e640 1 -- start start 2023-12-12T09:46:51.589 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:51.586+0000 7ff93da7e640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff9280039a0 0x7ff9380aa050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:51.589 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:51.586+0000 7ff93da7e640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff938148f60 0x7ff9380a8b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:51.589 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:51.586+0000 7ff93da7e640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff9380ab2c0 0x7ff9380a9070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:51.589 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:51.587+0000 7ff93da7e640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9380a95b0 con 0x7ff9280039a0 2023-12-12T09:46:51.589 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:51.587+0000 7ff93da7e640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff938148a30 con 0x7ff938148f60 2023-12-12T09:46:51.589 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:51.587+0000 7ff93da7e640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff938071a30 con 0x7ff9380ab2c0 2023-12-12T09:46:51.589 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:51.587+0000 7ff93ca7c640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff9280039a0 0x7ff9380aa050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:51.589 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:51.587+0000 7ff93ca7c640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff9280039a0 0x7ff9380aa050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:40014/0 (socket says 172.21.15.73:40014) 2023-12-12T09:46:51.589 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:51.587+0000 7ff93ca7c640 1 -- 172.21.15.73:0/3590779418 learned_addr learned my addr 172.21.15.73:0/3590779418 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:46:51.589 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:51.587+0000 7ff93ca7c640 1 -- 172.21.15.73:0/3590779418 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff9380ab2c0 msgr2=0x7ff9380a9070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:51.589 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:51.587+0000 7ff93ca7c640 1 --2- 172.21.15.73:0/3590779418 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff9380ab2c0 0x7ff9380a9070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:51.589 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:51.587+0000 7ff93ca7c640 1 -- 172.21.15.73:0/3590779418 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff938148f60 msgr2=0x7ff9380a8b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:51.589 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:51.587+0000 7ff93ca7c640 1 --2- 172.21.15.73:0/3590779418 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff938148f60 0x7ff9380a8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:51.590 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:51.587+0000 7ff93ca7c640 1 -- 172.21.15.73:0/3590779418 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff938148c80 con 0x7ff9280039a0 2023-12-12T09:46:51.590 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:51.587+0000 7ff93ca7c640 1 --2- 172.21.15.73:0/3590779418 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff9280039a0 0x7ff9380aa050 secure :-1 s=READY pgs=966 cs=0 l=1 rev1=1 crypto rx=0x7ff92c000c00 tx=0x7ff92c001a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:46:51.590 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:51.588+0000 7ff9357fa640 1 -- 172.21.15.73:0/3590779418 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff92c03c040 con 0x7ff9280039a0 2023-12-12T09:46:51.590 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:51.588+0000 7ff9357fa640 1 -- 172.21.15.73:0/3590779418 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff92c02cce0 con 0x7ff9280039a0 2023-12-12T09:46:51.591 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:51.588+0000 7ff9357fa640 1 -- 172.21.15.73:0/3590779418 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff92c0072b0 con 0x7ff9280039a0 2023-12-12T09:46:51.591 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:51.588+0000 7ff93da7e640 1 -- 172.21.15.73:0/3590779418 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9381ea240 con 0x7ff9280039a0 2023-12-12T09:46:51.591 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:51.588+0000 7ff93da7e640 1 -- 172.21.15.73:0/3590779418 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9380aa590 con 0x7ff9280039a0 2023-12-12T09:46:51.591 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:51.589+0000 7ff93da7e640 1 -- 172.21.15.73:0/3590779418 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9381ea760 con 0x7ff9280039a0 2023-12-12T09:46:51.591 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:51.590+0000 7ff9357fa640 1 -- 172.21.15.73:0/3590779418 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7ff92c032070 con 0x7ff9280039a0 2023-12-12T09:46:51.592 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:51.591+0000 7ff9357fa640 1 --2- 172.21.15.73:0/3590779418 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7ff91c06ae70 0x7ff91c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:51.592 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:51.591+0000 7ff9357fa640 1 -- 172.21.15.73:0/3590779418 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6565+0+0 (secure 0 0 0) 0x7ff92c0aa9d0 con 0x7ff9280039a0 2023-12-12T09:46:51.592 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:51.591+0000 7ff937fff640 1 --2- 172.21.15.73:0/3590779418 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7ff91c06ae70 0x7ff91c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:51.593 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:51.592+0000 7ff937fff640 1 --2- 172.21.15.73:0/3590779418 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7ff91c06ae70 0x7ff91c06d330 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7ff9380c68e0 tx=0x7ff924009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:46:51.596 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:51.595+0000 7ff9357fa640 1 -- 172.21.15.73:0/3590779418 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7ff92c075710 con 0x7ff9280039a0 2023-12-12T09:46:51.825 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:51.824+0000 7ff93da7e640 1 -- 172.21.15.73:0/3590779418 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7ff93806d520 con 0x7ff9280039a0 2023-12-12T09:46:51.826 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:51.824+0000 7ff9357fa640 1 -- 172.21.15.73:0/3590779418 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v49) v1 ==== 53+0+149 (secure 0 0 0) 0x7ff92c046020 con 0x7ff9280039a0 2023-12-12T09:46:51.826 INFO:teuthology.orchestra.run.smithi073.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-12-12T09:46:51.826 INFO:teuthology.orchestra.run.smithi073.stdout:name: cephfs2, metadata pool: cephfs2_metadata, data pools: [cephfs2_data ] 2023-12-12T09:46:51.828 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:51.827+0000 7ff93da7e640 1 -- 172.21.15.73:0/3590779418 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7ff91c06ae70 msgr2=0x7ff91c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:51.828 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:51.827+0000 7ff93da7e640 1 --2- 172.21.15.73:0/3590779418 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7ff91c06ae70 0x7ff91c06d330 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7ff9380c68e0 tx=0x7ff924009040 comp rx=0 tx=0).stop 2023-12-12T09:46:51.828 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:51.827+0000 7ff93da7e640 1 -- 172.21.15.73:0/3590779418 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff9280039a0 msgr2=0x7ff9380aa050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:51.828 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:51.827+0000 7ff93da7e640 1 --2- 172.21.15.73:0/3590779418 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff9280039a0 0x7ff9380aa050 secure :-1 s=READY pgs=966 cs=0 l=1 rev1=1 crypto rx=0x7ff92c000c00 tx=0x7ff92c001a00 comp rx=0 tx=0).stop 2023-12-12T09:46:51.829 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:51.827+0000 7ff93da7e640 1 -- 172.21.15.73:0/3590779418 shutdown_connections 2023-12-12T09:46:51.829 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:51.827+0000 7ff93da7e640 1 --2- 172.21.15.73:0/3590779418 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7ff91c06ae70 0x7ff91c06d330 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:51.829 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:51.827+0000 7ff93da7e640 1 --2- 172.21.15.73:0/3590779418 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff9380ab2c0 0x7ff9380a9070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:51.829 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:51.827+0000 7ff93da7e640 1 --2- 172.21.15.73:0/3590779418 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff938148f60 0x7ff9380a8b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:51.829 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:51.827+0000 7ff93da7e640 1 --2- 172.21.15.73:0/3590779418 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff9280039a0 0x7ff9380aa050 unknown :-1 s=CLOSED pgs=966 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:51.829 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:51.827+0000 7ff93da7e640 1 -- 172.21.15.73:0/3590779418 >> 172.21.15.73:0/3590779418 conn(0x7ff9380c23b0 msgr2=0x7ff93814d470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:46:51.829 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:51.827+0000 7ff93da7e640 1 -- 172.21.15.73:0/3590779418 shutdown_connections 2023-12-12T09:46:51.829 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:51.827+0000 7ff93da7e640 1 -- 172.21.15.73:0/3590779418 wait complete. 2023-12-12T09:46:51.848 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs2; just confirmed its presence on cluster 2023-12-12T09:46:51.848 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-12T09:46:51.848 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi142.front.sepia.ceph.com 2023-12-12T09:46:51.848 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-12-12T09:46:51.848 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-12-12T09:46:51.848 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs2 2023-12-12T09:46:51.848 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-12-12T09:46:51.849 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-12-12T09:46:51.849 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-12-12T09:46:51.849 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T09:46:51.849 DEBUG:teuthology.orchestra.run.smithi142:> ip addr 2023-12-12T09:46:51.910 INFO:teuthology.orchestra.run.smithi142.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-12T09:46:51.910 INFO:teuthology.orchestra.run.smithi142.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-12T09:46:51.910 INFO:teuthology.orchestra.run.smithi142.stdout: inet 127.0.0.1/8 scope host lo 2023-12-12T09:46:51.910 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2023-12-12T09:46:51.910 INFO:teuthology.orchestra.run.smithi142.stdout: inet6 ::1/128 scope host 2023-12-12T09:46:51.910 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2023-12-12T09:46:51.910 INFO:teuthology.orchestra.run.smithi142.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-12T09:46:51.910 INFO:teuthology.orchestra.run.smithi142.stdout: link/ether 0c:c4:7a:d9:36:3c brd ff:ff:ff:ff:ff:ff 2023-12-12T09:46:51.910 INFO:teuthology.orchestra.run.smithi142.stdout: altname enp7s0f0 2023-12-12T09:46:51.910 INFO:teuthology.orchestra.run.smithi142.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-12T09:46:51.911 INFO:teuthology.orchestra.run.smithi142.stdout: link/ether 0c:c4:7a:d9:36:3d brd ff:ff:ff:ff:ff:ff 2023-12-12T09:46:51.911 INFO:teuthology.orchestra.run.smithi142.stdout: altname enp7s0f1 2023-12-12T09:46:51.911 INFO:teuthology.orchestra.run.smithi142.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-12T09:46:51.911 INFO:teuthology.orchestra.run.smithi142.stdout: link/ether 0c:c4:7a:88:6e:0c brd ff:ff:ff:ff:ff:ff 2023-12-12T09:46:51.911 INFO:teuthology.orchestra.run.smithi142.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-12T09:46:51.911 INFO:teuthology.orchestra.run.smithi142.stdout: link/ether 0c:c4:7a:88:6e:0d brd ff:ff:ff:ff:ff:ff 2023-12-12T09:46:51.911 INFO:teuthology.orchestra.run.smithi142.stdout: inet 172.21.15.142/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-12-12T09:46:51.911 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft 42190sec preferred_lft 42190sec 2023-12-12T09:46:51.911 INFO:teuthology.orchestra.run.smithi142.stdout: inet6 fe80::ec4:7aff:fe88:6e0d/64 scope link 2023-12-12T09:46:51.911 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2023-12-12T09:46:51.911 INFO:teuthology.orchestra.run.smithi142.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-12-12T09:46:51.911 INFO:teuthology.orchestra.run.smithi142.stdout: link/ether de:1c:dd:95:c8:e6 brd ff:ff:ff:ff:ff:ff 2023-12-12T09:46:51.911 INFO:teuthology.orchestra.run.smithi142.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-12-12T09:46:51.911 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2023-12-12T09:46:51.912 INFO:teuthology.orchestra.run.smithi142.stdout: inet6 fe80::f8b8:b6ff:fe33:420d/64 scope link 2023-12-12T09:46:51.912 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2023-12-12T09:46:51.912 INFO:teuthology.orchestra.run.smithi142.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-12T09:46:51.912 INFO:teuthology.orchestra.run.smithi142.stdout: link/ether de:1c:dd:95:c8:e6 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-12-12T09:46:51.912 INFO:teuthology.orchestra.run.smithi142.stdout: inet6 fe80::dc1c:ddff:fe95:c8e6/64 scope link 2023-12-12T09:46:51.912 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2023-12-12T09:46:51.913 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T09:46:51.913 DEBUG:teuthology.orchestra.run.smithi142:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-12T09:46:51.991 INFO:teuthology.orchestra.run.smithi142.stdout:1 2023-12-12T09:46:51.995 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T09:46:51.995 DEBUG:teuthology.orchestra.run.smithi142:> route 2023-12-12T09:46:52.038 INFO:teuthology.orchestra.run.smithi142.stdout:Kernel IP routing table 2023-12-12T09:46:52.038 INFO:teuthology.orchestra.run.smithi142.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-12T09:46:52.038 INFO:teuthology.orchestra.run.smithi142.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-12-12T09:46:52.038 INFO:teuthology.orchestra.run.smithi142.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-12-12T09:46:52.038 INFO:teuthology.orchestra.run.smithi142.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-12T09:46:52.039 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T09:46:52.039 DEBUG:teuthology.orchestra.run.smithi142:> (cd / && exec bash -c ' 2023-12-12T09:46:52.039 DEBUG:teuthology.orchestra.run.smithi142:> set -e 2023-12-12T09:46:52.039 DEBUG:teuthology.orchestra.run.smithi142:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-12-12T09:46:52.039 DEBUG:teuthology.orchestra.run.smithi142:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-12-12T09:46:52.039 DEBUG:teuthology.orchestra.run.smithi142:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-12-12T09:46:52.039 DEBUG:teuthology.orchestra.run.smithi142:> ') 2023-12-12T09:46:52.256 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T09:46:52.256 DEBUG:teuthology.orchestra.run.smithi142:> ip netns list 2023-12-12T09:46:52.305 INFO:teuthology.orchestra.run.smithi142.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-12-12T09:46:52.306 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-12-12T09:46:52.306 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T09:46:52.306 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip link set brx.0 up 2023-12-12T09:46:52.399 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-12T09:46:52.399 DEBUG:teuthology.orchestra.run.smithi142:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-12-12T09:46:52.452 INFO:teuthology.orchestra.run.smithi142.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-12-12T09:46:52.452 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-12T09:46:52.452 DEBUG:teuthology.orchestra.run.smithi142:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-12-12T09:46:52.502 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs2=/ 2023-12-12T09:46:52.502 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T09:46:52.503 DEBUG:teuthology.orchestra.run.smithi142:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs2=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-12T09:46:52.642 INFO:teuthology.orchestra.run.smithi142.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-12T09:46:52.642 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-12T09:46:52.677 INFO:teuthology.orchestra.run.smithi142.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-12T09:46:52.677 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-12T09:46:52.677 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: resolved to: "172.21.15.73:3300,172.21.15.142:3300,172.21.15.142:3301" 2023-12-12T09:46:52.677 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: trying mount with new device syntax: 1@ba240992-02b8-4c7e-92f2-27eb29ac433b.cephfs2=/ 2023-12-12T09:46:52.678 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.73:3300/172.21.15.142:3300/172.21.15.142:3301" will pass to kernel 2023-12-12T09:46:52.680 INFO:teuthology.orchestra.run.smithi142.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2023-12-12T09:46:52.680 INFO:teuthology.orchestra.run.smithi142.stdout: You just mounted a file system that supports labels which does not 2023-12-12T09:46:52.680 INFO:teuthology.orchestra.run.smithi142.stdout: contain labels, onto an SELinux box. It is likely that confined 2023-12-12T09:46:52.680 INFO:teuthology.orchestra.run.smithi142.stdout: applications will generate AVC messages and not be allowed access to 2023-12-12T09:46:52.680 INFO:teuthology.orchestra.run.smithi142.stdout: this file system. For more details see restorecon(8) and mount(8). 2023-12-12T09:46:52.685 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-12-12T09:46:52.685 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T09:46:52.685 DEBUG:teuthology.orchestra.run.smithi142:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-12-12T09:46:52.770 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T09:46:52.770 DEBUG:teuthology.orchestra.run.smithi142:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-12T09:46:52.843 INFO:teuthology.orchestra.run.smithi142.stdout:client5524 2023-12-12T09:46:52.844 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2023-12-12T09:46:52.844 DEBUG:teuthology.orchestra.run.smithi142:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-12T09:46:52.897 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T09:46:52.897 DEBUG:teuthology.orchestra.run.smithi073:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir /home/ubuntu/cephtest/mnt.0/testdir) 2023-12-12T09:46:52.967 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2023-12-12T09:46:52.967 DEBUG:teuthology.orchestra.run.smithi073:> dd of=/home/ubuntu/cephtest/mnt.0/testdir/testfile 2023-12-12T09:46:53.030 INFO:tasks.cephfs.caps_helper:Test file has been created on FS "cephfs" at path "/home/ubuntu/cephtest/mnt.0/testdir/testfile" with the following data - self.path = /home/ubuntu/cephtest/mnt.0/testdir/testfile cephfs_name = cephfs cephfs_mntpt = / hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-12-12T09:46:53.031 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T09:46:53.031 DEBUG:teuthology.orchestra.run.smithi142:> (cd /home/ubuntu/cephtest/mnt.1 && exec mkdir /home/ubuntu/cephtest/mnt.1/testdir) 2023-12-12T09:46:53.108 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2023-12-12T09:46:53.108 DEBUG:teuthology.orchestra.run.smithi142:> dd of=/home/ubuntu/cephtest/mnt.1/testdir/testfile 2023-12-12T09:46:53.172 INFO:tasks.cephfs.caps_helper:Test file has been created on FS "cephfs2" at path "/home/ubuntu/cephtest/mnt.1/testdir/testfile" with the following data - self.path = /home/ubuntu/cephtest/mnt.1/testdir/testfile cephfs_name = cephfs2 cephfs_mntpt = / hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-12-12T09:46:53.172 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth add client.testuser mon 'allow r' osd 'allow r tag cephfs data=cephfs, allow r tag cephfs data=cephfs2' mds 'allow r fsname=cephfs, allow r fsname=cephfs2' 2023-12-12T09:46:53.399 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:53.397+0000 7fe4f051d640 1 Processor -- start 2023-12-12T09:46:53.399 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:53.397+0000 7fe4f051d640 1 -- start start 2023-12-12T09:46:53.400 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:53.399+0000 7fe4f051d640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fe4e80c23b0 0x7fe4e80c0320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:53.400 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:53.399+0000 7fe4f051d640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fe4e806cc90 0x7fe4e80c2790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:53.400 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:53.399+0000 7fe4f051d640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4e80c1520 con 0x7fe4e8159410 2023-12-12T09:46:53.400 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:53.399+0000 7fe4f051d640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4e80c46f0 con 0x7fe4e80c23b0 2023-12-12T09:46:53.401 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:53.399+0000 7fe4f051d640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4e806d0d0 con 0x7fe4e806cc90 2023-12-12T09:46:53.401 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:53.399+0000 7fe4ee2b9640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fe4e80c23b0 0x7fe4e80c0320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:53.402 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:53.399+0000 7fe4ee2b9640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fe4e80c23b0 0x7fe4e80c0320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:40028/0 (socket says 172.21.15.73:40028) 2023-12-12T09:46:53.402 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:53.399+0000 7fe4ee2b9640 1 -- 172.21.15.73:0/3282302025 learned_addr learned my addr 172.21.15.73:0/3282302025 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:46:53.402 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:53.400+0000 7fe4ee2b9640 1 -- 172.21.15.73:0/3282302025 >> v2:172.21.15.142:3300/0 conn(0x7fe4e806cc90 msgr2=0x7fe4e80c2790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:46:53.402 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:53.400+0000 7fe4edab8640 1 --2- 172.21.15.73:0/3282302025 >> v2:172.21.15.142:3300/0 conn(0x7fe4e806cc90 0x7fe4e80c2790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:53.402 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:53.400+0000 7fe4ee2b9640 1 --2- 172.21.15.73:0/3282302025 >> v2:172.21.15.142:3300/0 conn(0x7fe4e806cc90 0x7fe4e80c2790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:53.402 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:53.400+0000 7fe4ee2b9640 1 -- 172.21.15.73:0/3282302025 >> v1:172.21.15.142:6789/0 conn(0x7fe4e8159410 legacy=0x7fe4e80c50d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:46:53.402 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:53.400+0000 7fe4ee2b9640 1 -- 172.21.15.73:0/3282302025 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4e80c57e0 con 0x7fe4e80c23b0 2023-12-12T09:46:53.402 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:53.400+0000 7fe4edab8640 1 --2- 172.21.15.73:0/3282302025 >> v2:172.21.15.142:3300/0 conn(0x7fe4e806cc90 0x7fe4e80c2790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:46:53.403 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:53.401+0000 7fe4ee2b9640 1 --2- 172.21.15.73:0/3282302025 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe4e80c23b0 0x7fe4e80c0320 secure :-1 s=READY pgs=967 cs=0 l=1 rev1=1 crypto rx=0x7fe4e80c3c70 tx=0x7fe4d802bdc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8df8f1856dbb168 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:46:53.403 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:53.401+0000 7fe4ed2b7640 1 -- 172.21.15.73:0/3282302025 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4d802c960 con 0x7fe4e80c23b0 2023-12-12T09:46:53.403 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:53.401+0000 7fe4ed2b7640 1 -- 172.21.15.73:0/3282302025 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4d802cac0 con 0x7fe4e80c23b0 2023-12-12T09:46:53.403 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:53.401+0000 7fe4ed2b7640 1 -- 172.21.15.73:0/3282302025 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4d802ce50 con 0x7fe4e80c23b0 2023-12-12T09:46:53.404 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:53.402+0000 7fe4f051d640 1 -- 172.21.15.73:0/3282302025 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe4e80c23b0 msgr2=0x7fe4e80c0320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:53.404 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:53.402+0000 7fe4f051d640 1 --2- 172.21.15.73:0/3282302025 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe4e80c23b0 0x7fe4e80c0320 secure :-1 s=READY pgs=967 cs=0 l=1 rev1=1 crypto rx=0x7fe4e80c3c70 tx=0x7fe4d802bdc0 comp rx=0 tx=0).stop 2023-12-12T09:46:53.404 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:53.402+0000 7fe4f051d640 1 -- 172.21.15.73:0/3282302025 shutdown_connections 2023-12-12T09:46:53.404 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:53.402+0000 7fe4f051d640 1 --2- 172.21.15.73:0/3282302025 >> v2:172.21.15.142:3300/0 conn(0x7fe4e806cc90 0x7fe4e80c2790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:53.404 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:53.402+0000 7fe4f051d640 1 --2- 172.21.15.73:0/3282302025 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe4e80c23b0 0x7fe4e80c0320 unknown :-1 s=CLOSED pgs=967 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:53.404 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:53.402+0000 7fe4f051d640 1 -- 172.21.15.73:0/3282302025 >> 172.21.15.73:0/3282302025 conn(0x7fe4e806a4e0 msgr2=0x7fe4e806a8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:46:53.404 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:53.402+0000 7fe4f051d640 1 -- 172.21.15.73:0/3282302025 shutdown_connections 2023-12-12T09:46:53.404 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:53.402+0000 7fe4f051d640 1 -- 172.21.15.73:0/3282302025 wait complete. 2023-12-12T09:46:53.405 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:53.404+0000 7fe4f051d640 1 Processor -- start 2023-12-12T09:46:53.406 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:53.405+0000 7fe4f051d640 1 -- start start 2023-12-12T09:46:53.407 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:53.406+0000 7fe4f051d640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe4e806cc90 0x7fe4e80a9a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:53.407 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:53.406+0000 7fe4f051d640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe4e80c23b0 0x7fe4e81f1c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:53.407 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:53.406+0000 7fe4f051d640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe4e8159410 0x7fe4e8151970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:53.408 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:53.406+0000 7fe4f051d640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4e80ab7d0 con 0x7fe4e80c23b0 2023-12-12T09:46:53.408 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:53.406+0000 7fe4f051d640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4e80a95b0 con 0x7fe4e8159410 2023-12-12T09:46:53.408 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:53.406+0000 7fe4f051d640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4e81f2580 con 0x7fe4e806cc90 2023-12-12T09:46:53.408 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:53.406+0000 7fe4edab8640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe4e80c23b0 0x7fe4e81f1c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:53.408 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:53.406+0000 7fe4edab8640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe4e80c23b0 0x7fe4e81f1c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:40034/0 (socket says 172.21.15.73:40034) 2023-12-12T09:46:53.408 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:53.406+0000 7fe4edab8640 1 -- 172.21.15.73:0/1035619977 learned_addr learned my addr 172.21.15.73:0/1035619977 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:46:53.409 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:53.406+0000 7fe4ee2b9640 1 --2- 172.21.15.73:0/1035619977 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe4e806cc90 0x7fe4e80a9a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:53.409 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:53.406+0000 7fe4edab8640 1 -- 172.21.15.73:0/1035619977 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe4e806cc90 msgr2=0x7fe4e80a9a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:53.409 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:53.407+0000 7fe4edab8640 1 --2- 172.21.15.73:0/1035619977 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe4e806cc90 0x7fe4e80a9a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:53.409 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:53.407+0000 7fe4edab8640 1 -- 172.21.15.73:0/1035619977 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe4e8159410 msgr2=0x7fe4e8151970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:53.409 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:53.407+0000 7fe4edab8640 1 --2- 172.21.15.73:0/1035619977 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe4e8159410 0x7fe4e8151970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:53.409 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:53.407+0000 7fe4edab8640 1 -- 172.21.15.73:0/1035619977 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4d8009b30 con 0x7fe4e80c23b0 2023-12-12T09:46:53.409 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:53.407+0000 7fe4edab8640 1 --2- 172.21.15.73:0/1035619977 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe4e80c23b0 0x7fe4e81f1c40 secure :-1 s=READY pgs=968 cs=0 l=1 rev1=1 crypto rx=0x7fe4dc00c7f0 tx=0x7fe4dc00ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:46:53.410 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:53.407+0000 7fe4e6ffd640 1 -- 172.21.15.73:0/1035619977 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4dc007820 con 0x7fe4e80c23b0 2023-12-12T09:46:53.410 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:53.407+0000 7fe4e6ffd640 1 -- 172.21.15.73:0/1035619977 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4dc007980 con 0x7fe4e80c23b0 2023-12-12T09:46:53.410 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:53.407+0000 7fe4f051d640 1 -- 172.21.15.73:0/1035619977 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4e80a9240 con 0x7fe4e80c23b0 2023-12-12T09:46:53.410 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:53.407+0000 7fe4e6ffd640 1 -- 172.21.15.73:0/1035619977 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4dc007cf0 con 0x7fe4e80c23b0 2023-12-12T09:46:53.410 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:53.407+0000 7fe4f051d640 1 -- 172.21.15.73:0/1035619977 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4e81f2820 con 0x7fe4e80c23b0 2023-12-12T09:46:53.410 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:53.409+0000 7fe4f051d640 1 -- 172.21.15.73:0/1035619977 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe4e80a9740 con 0x7fe4e80c23b0 2023-12-12T09:46:53.411 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:53.409+0000 7fe4e6ffd640 1 -- 172.21.15.73:0/1035619977 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fe4dc0113f0 con 0x7fe4e80c23b0 2023-12-12T09:46:53.411 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:53.410+0000 7fe4e6ffd640 1 --2- 172.21.15.73:0/1035619977 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fe4d406ae40 0x7fe4d406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:53.412 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:53.411+0000 7fe4e6ffd640 1 -- 172.21.15.73:0/1035619977 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fe4dc089cc0 con 0x7fe4e80c23b0 2023-12-12T09:46:53.412 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:53.411+0000 7fe4ee2b9640 1 --2- 172.21.15.73:0/1035619977 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fe4d406ae40 0x7fe4d406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:53.413 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:53.412+0000 7fe4ee2b9640 1 --2- 172.21.15.73:0/1035619977 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fe4d406ae40 0x7fe4d406d300 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7fe4d8035000 tx=0x7fe4d8030000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:46:53.417 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:53.415+0000 7fe4e6ffd640 1 -- 172.21.15.73:0/1035619977 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fe4dc090080 con 0x7fe4e80c23b0 2023-12-12T09:46:53.677 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:53.675+0000 7fe4f051d640 1 -- 172.21.15.73:0/1035619977 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "auth add", "entity": "client.testuser", "caps": ["mon", "allow r", "osd", "allow r tag cephfs data=cephfs, allow r tag cephfs data=cephfs2", "mds", "allow r fsname=cephfs, allow r fsname=cephfs2"]} v 0) v1 -- 0x7fe4e8067070 con 0x7fe4e80c23b0 2023-12-12T09:46:53.682 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:53.681+0000 7fe4e6ffd640 1 -- 172.21.15.73:0/1035619977 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "auth add", "entity": "client.testuser", "caps": ["mon", "allow r", "osd", "allow r tag cephfs data=cephfs, allow r tag cephfs data=cephfs2", "mds", "allow r fsname=cephfs, allow r fsname=cephfs2"]}]=0 added key for client.testuser v21) v1 ==== 272+0+0 (secure 0 0 0) 0x7fe4dc01f130 con 0x7fe4e80c23b0 2023-12-12T09:46:53.682 INFO:teuthology.orchestra.run.smithi073.stderr:added key for client.testuser 2023-12-12T09:46:53.685 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:53.683+0000 7fe4f051d640 1 -- 172.21.15.73:0/1035619977 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fe4d406ae40 msgr2=0x7fe4d406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:53.685 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:53.683+0000 7fe4f051d640 1 --2- 172.21.15.73:0/1035619977 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fe4d406ae40 0x7fe4d406d300 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7fe4d8035000 tx=0x7fe4d8030000 comp rx=0 tx=0).stop 2023-12-12T09:46:53.686 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:53.683+0000 7fe4f051d640 1 -- 172.21.15.73:0/1035619977 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe4e80c23b0 msgr2=0x7fe4e81f1c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:53.686 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:53.683+0000 7fe4f051d640 1 --2- 172.21.15.73:0/1035619977 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe4e80c23b0 0x7fe4e81f1c40 secure :-1 s=READY pgs=968 cs=0 l=1 rev1=1 crypto rx=0x7fe4dc00c7f0 tx=0x7fe4dc00ccb0 comp rx=0 tx=0).stop 2023-12-12T09:46:53.686 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:53.684+0000 7fe4f051d640 1 -- 172.21.15.73:0/1035619977 shutdown_connections 2023-12-12T09:46:53.686 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:53.684+0000 7fe4f051d640 1 --2- 172.21.15.73:0/1035619977 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fe4d406ae40 0x7fe4d406d300 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:53.686 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:53.684+0000 7fe4f051d640 1 --2- 172.21.15.73:0/1035619977 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe4e8159410 0x7fe4e8151970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:53.686 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:53.684+0000 7fe4f051d640 1 --2- 172.21.15.73:0/1035619977 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe4e80c23b0 0x7fe4e81f1c40 unknown :-1 s=CLOSED pgs=968 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:53.686 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:53.684+0000 7fe4f051d640 1 --2- 172.21.15.73:0/1035619977 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe4e806cc90 0x7fe4e80a9a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:53.686 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:53.684+0000 7fe4f051d640 1 -- 172.21.15.73:0/1035619977 >> 172.21.15.73:0/1035619977 conn(0x7fe4e806a4e0 msgr2=0x7fe4e806a8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:46:53.687 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:53.684+0000 7fe4f051d640 1 -- 172.21.15.73:0/1035619977 shutdown_connections 2023-12-12T09:46:53.687 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:53.684+0000 7fe4f051d640 1 -- 172.21.15.73:0/1035619977 wait complete. 2023-12-12T09:46:53.705 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth get client.testuser 2023-12-12T09:46:53.916 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:53.914+0000 7f3599ebb640 1 Processor -- start 2023-12-12T09:46:53.916 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:53.914+0000 7f3599ebb640 1 -- start start 2023-12-12T09:46:53.918 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:53.916+0000 7f3599ebb640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3594155560 0x7f35941587c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:53.918 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:53.916+0000 7f3599ebb640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f35940c49d0 0x7f35940c29e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:53.918 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:53.916+0000 7f3599ebb640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3594158d00 con 0x7f35940c2f20 2023-12-12T09:46:53.918 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:53.916+0000 7f3599ebb640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35940c25c0 con 0x7f35940c49d0 2023-12-12T09:46:53.918 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:53.916+0000 7f3599ebb640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3594072680 con 0x7f3594155560 2023-12-12T09:46:53.918 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:53.916+0000 7f3592ffd640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f35940c49d0 0x7f35940c29e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:53.918 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:53.916+0000 7f3592ffd640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f35940c49d0 0x7f35940c29e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:40042/0 (socket says 172.21.15.73:40042) 2023-12-12T09:46:53.918 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:53.916+0000 7f3592ffd640 1 -- 172.21.15.73:0/3982735405 learned_addr learned my addr 172.21.15.73:0/3982735405 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:46:53.918 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:53.917+0000 7f35937fe640 1 --2- 172.21.15.73:0/3982735405 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3594155560 0x7f35941587c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:53.919 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:53.917+0000 7f3592ffd640 1 -- 172.21.15.73:0/3982735405 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3594155560 msgr2=0x7f35941587c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:46:53.919 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:53.917+0000 7f3592ffd640 1 --2- 172.21.15.73:0/3982735405 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3594155560 0x7f35941587c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:53.919 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:53.917+0000 7f3592ffd640 1 -- 172.21.15.73:0/3982735405 >> v1:172.21.15.142:6789/0 conn(0x7f35940c2f20 legacy=0x7f359406a4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:46:53.919 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:53.917+0000 7f3592ffd640 1 -- 172.21.15.73:0/3982735405 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3594072960 con 0x7f35940c49d0 2023-12-12T09:46:53.920 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:53.918+0000 7f3592ffd640 1 --2- 172.21.15.73:0/3982735405 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f35940c49d0 0x7f35940c29e0 secure :-1 s=READY pgs=969 cs=0 l=1 rev1=1 crypto rx=0x7f357c009870 tx=0x7f357c02b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=618a44d973349e05 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:46:53.920 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:53.918+0000 7f35927fc640 1 -- 172.21.15.73:0/3982735405 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f357c0317c0 con 0x7f35940c49d0 2023-12-12T09:46:53.920 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:53.918+0000 7f35927fc640 1 -- 172.21.15.73:0/3982735405 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f357c031920 con 0x7f35940c49d0 2023-12-12T09:46:53.920 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:53.918+0000 7f35927fc640 1 -- 172.21.15.73:0/3982735405 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f357c031cb0 con 0x7f35940c49d0 2023-12-12T09:46:53.921 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:53.919+0000 7f3599ebb640 1 -- 172.21.15.73:0/3982735405 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f35940c49d0 msgr2=0x7f35940c29e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:53.921 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:53.919+0000 7f3599ebb640 1 --2- 172.21.15.73:0/3982735405 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f35940c49d0 0x7f35940c29e0 secure :-1 s=READY pgs=969 cs=0 l=1 rev1=1 crypto rx=0x7f357c009870 tx=0x7f357c02b860 comp rx=0 tx=0).stop 2023-12-12T09:46:53.921 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:53.919+0000 7f3599ebb640 1 -- 172.21.15.73:0/3982735405 shutdown_connections 2023-12-12T09:46:53.921 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:53.919+0000 7f3599ebb640 1 --2- 172.21.15.73:0/3982735405 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f35940c49d0 0x7f35940c29e0 unknown :-1 s=CLOSED pgs=969 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:53.921 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:53.919+0000 7f3599ebb640 1 --2- 172.21.15.73:0/3982735405 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3594155560 0x7f35941587c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:53.921 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:53.919+0000 7f3599ebb640 1 -- 172.21.15.73:0/3982735405 >> 172.21.15.73:0/3982735405 conn(0x7f35940c35d0 msgr2=0x7f35940c39b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:46:53.921 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:53.919+0000 7f3599ebb640 1 -- 172.21.15.73:0/3982735405 shutdown_connections 2023-12-12T09:46:53.921 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:53.919+0000 7f3599ebb640 1 -- 172.21.15.73:0/3982735405 wait complete. 2023-12-12T09:46:53.922 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:53.921+0000 7f3599ebb640 1 Processor -- start 2023-12-12T09:46:53.922 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:53.921+0000 7f3599ebb640 1 -- start start 2023-12-12T09:46:53.924 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:53.922+0000 7f3599ebb640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f35940c2f20 0x7f35941de820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:53.924 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:53.922+0000 7f3599ebb640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f35940c49d0 0x7f35941ed7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:53.924 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:53.922+0000 7f3599ebb640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3594155560 0x7f35941edd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:53.925 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:53.922+0000 7f3599ebb640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35940ab750 con 0x7f35940c2f20 2023-12-12T09:46:53.925 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:53.922+0000 7f3599ebb640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35941e0550 con 0x7f3594155560 2023-12-12T09:46:53.925 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:53.922+0000 7f3599ebb640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35941ee410 con 0x7f35940c49d0 2023-12-12T09:46:53.925 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:53.922+0000 7f35937fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f35940c2f20 0x7f35941de820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:53.925 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:53.922+0000 7f35937fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f35940c2f20 0x7f35941de820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:40054/0 (socket says 172.21.15.73:40054) 2023-12-12T09:46:53.925 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:53.922+0000 7f35937fe640 1 -- 172.21.15.73:0/1911625220 learned_addr learned my addr 172.21.15.73:0/1911625220 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:46:53.925 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:53.922+0000 7f35937fe640 1 -- 172.21.15.73:0/1911625220 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f35940c49d0 msgr2=0x7f35941ed7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:53.925 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:53.922+0000 7f35937fe640 1 --2- 172.21.15.73:0/1911625220 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f35940c49d0 0x7f35941ed7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:53.925 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:53.922+0000 7f35937fe640 1 -- 172.21.15.73:0/1911625220 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3594155560 msgr2=0x7f35941edd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:53.925 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:53.922+0000 7f35937fe640 1 --2- 172.21.15.73:0/1911625220 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3594155560 0x7f35941edd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:53.925 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:53.922+0000 7f35937fe640 1 -- 172.21.15.73:0/1911625220 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f357c0094d0 con 0x7f35940c2f20 2023-12-12T09:46:53.925 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:53.923+0000 7f35937fe640 1 --2- 172.21.15.73:0/1911625220 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f35940c2f20 0x7f35941de820 secure :-1 s=READY pgs=970 cs=0 l=1 rev1=1 crypto rx=0x7f3584007e40 tx=0x7f358400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:46:53.925 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:53.923+0000 7f358bfff640 1 -- 172.21.15.73:0/1911625220 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3584014620 con 0x7f35940c2f20 2023-12-12T09:46:53.926 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:53.923+0000 7f358bfff640 1 -- 172.21.15.73:0/1911625220 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f358400ee90 con 0x7f35940c2f20 2023-12-12T09:46:53.926 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:53.923+0000 7f358bfff640 1 -- 172.21.15.73:0/1911625220 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35840149c0 con 0x7f35940c2f20 2023-12-12T09:46:53.926 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:53.923+0000 7f3599ebb640 1 -- 172.21.15.73:0/1911625220 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35940ac580 con 0x7f35940c2f20 2023-12-12T09:46:53.926 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:53.923+0000 7f3599ebb640 1 -- 172.21.15.73:0/1911625220 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35940acb40 con 0x7f35940c2f20 2023-12-12T09:46:53.926 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:53.924+0000 7f3599ebb640 1 -- 172.21.15.73:0/1911625220 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3594067580 con 0x7f35940c2f20 2023-12-12T09:46:53.926 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:53.925+0000 7f358bfff640 1 -- 172.21.15.73:0/1911625220 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f3584014b20 con 0x7f35940c2f20 2023-12-12T09:46:53.928 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:53.926+0000 7f358bfff640 1 --2- 172.21.15.73:0/1911625220 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f357406ae70 0x7f357406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:53.928 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:53.926+0000 7f358bfff640 1 -- 172.21.15.73:0/1911625220 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f358408a340 con 0x7f35940c2f20 2023-12-12T09:46:53.928 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:53.927+0000 7f3592ffd640 1 --2- 172.21.15.73:0/1911625220 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f357406ae70 0x7f357406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:53.928 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:53.927+0000 7f3592ffd640 1 --2- 172.21.15.73:0/1911625220 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f357406ae70 0x7f357406d330 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f357c036000 tx=0x7f357c030000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:46:53.932 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:53.931+0000 7f358bfff640 1 -- 172.21.15.73:0/1911625220 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f3584054ff0 con 0x7f35940c2f20 2023-12-12T09:46:54.193 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:54.191+0000 7f3599ebb640 1 -- 172.21.15.73:0/1911625220 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "auth get", "entity": "client.testuser"} v 0) v1 -- 0x7f359406a4e0 con 0x7f35940c2f20 2023-12-12T09:46:54.194 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:54.192+0000 7f358bfff640 1 -- 172.21.15.73:0/1911625220 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "auth get", "entity": "client.testuser"}]=0 v21) v1 ==== 85+0+226 (secure 0 0 0) 0x7f3584058610 con 0x7f35940c2f20 2023-12-12T09:46:54.194 INFO:teuthology.orchestra.run.smithi073.stdout:[client.testuser] 2023-12-12T09:46:54.194 INFO:teuthology.orchestra.run.smithi073.stdout: key = AQANLHhl8zZpKBAAe+ZOAx3IIF0HjcTJIGufUA== 2023-12-12T09:46:54.194 INFO:teuthology.orchestra.run.smithi073.stdout: caps mds = "allow r fsname=cephfs, allow r fsname=cephfs2" 2023-12-12T09:46:54.194 INFO:teuthology.orchestra.run.smithi073.stdout: caps mon = "allow r" 2023-12-12T09:46:54.194 INFO:teuthology.orchestra.run.smithi073.stdout: caps osd = "allow r tag cephfs data=cephfs, allow r tag cephfs data=cephfs2" 2023-12-12T09:46:54.196 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:54.195+0000 7f3599ebb640 1 -- 172.21.15.73:0/1911625220 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f357406ae70 msgr2=0x7f357406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:54.196 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:54.195+0000 7f3599ebb640 1 --2- 172.21.15.73:0/1911625220 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f357406ae70 0x7f357406d330 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f357c036000 tx=0x7f357c030000 comp rx=0 tx=0).stop 2023-12-12T09:46:54.196 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:54.195+0000 7f3599ebb640 1 -- 172.21.15.73:0/1911625220 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f35940c2f20 msgr2=0x7f35941de820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:54.197 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:54.195+0000 7f3599ebb640 1 --2- 172.21.15.73:0/1911625220 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f35940c2f20 0x7f35941de820 secure :-1 s=READY pgs=970 cs=0 l=1 rev1=1 crypto rx=0x7f3584007e40 tx=0x7f358400e4b0 comp rx=0 tx=0).stop 2023-12-12T09:46:54.197 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:54.195+0000 7f3599ebb640 1 -- 172.21.15.73:0/1911625220 shutdown_connections 2023-12-12T09:46:54.197 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:54.195+0000 7f3599ebb640 1 --2- 172.21.15.73:0/1911625220 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f357406ae70 0x7f357406d330 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:54.197 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:54.195+0000 7f3599ebb640 1 --2- 172.21.15.73:0/1911625220 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3594155560 0x7f35941edd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:54.197 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:54.195+0000 7f3599ebb640 1 --2- 172.21.15.73:0/1911625220 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f35940c49d0 0x7f35941ed7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:54.197 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:54.195+0000 7f3599ebb640 1 --2- 172.21.15.73:0/1911625220 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f35940c2f20 0x7f35941de820 unknown :-1 s=CLOSED pgs=970 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:54.198 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:54.195+0000 7f3599ebb640 1 -- 172.21.15.73:0/1911625220 >> 172.21.15.73:0/1911625220 conn(0x7f35940c35d0 msgr2=0x7f35940c6ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:46:54.198 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:54.195+0000 7f3599ebb640 1 -- 172.21.15.73:0/1911625220 shutdown_connections 2023-12-12T09:46:54.198 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:54.195+0000 7f3599ebb640 1 -- 172.21.15.73:0/1911625220 wait complete. 2023-12-12T09:46:54.216 INFO:tasks.cephfs.test_multifs_auth:keyring generated for testing is - [client.testuser] key = AQANLHhl8zZpKBAAe+ZOAx3IIF0HjcTJIGufUA== caps mds = "allow r fsname=cephfs, allow r fsname=cephfs2" caps mon = "allow r" caps osd = "allow r tag cephfs data=cephfs, allow r tag cephfs data=cephfs2" 2023-12-12T09:46:54.216 DEBUG:teuthology.orchestra.run.smithi073:> mktemp 2023-12-12T09:46:54.269 INFO:teuthology.orchestra.run.smithi073.stdout:/tmp/tmp.AfDKDSl9kb 2023-12-12T09:46:54.269 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2023-12-12T09:46:54.269 DEBUG:teuthology.orchestra.run.smithi073:> dd of=/tmp/tmp.AfDKDSl9kb 2023-12-12T09:46:54.321 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2023-12-12T09:46:54.322 DEBUG:teuthology.orchestra.run.smithi073:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-12T09:46:54.422 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2023-12-12T09:46:54.422 DEBUG:teuthology.orchestra.run.smithi073:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-12T09:46:54.477 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-12T09:46:54.695 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:54.694+0000 7f2a4359e640 1 Processor -- start 2023-12-12T09:46:54.695 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:54.694+0000 7f2a4359e640 1 -- start start 2023-12-12T09:46:54.697 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:54.695+0000 7f2a4359e640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2a440a9470 0x7f2a440aae00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:54.697 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:54.695+0000 7f2a4359e640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a44153300 con 0x7f2a440ab340 2023-12-12T09:46:54.697 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:54.695+0000 7f2a4359e640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a440c2160 con 0x7f2a4414fbb0 2023-12-12T09:46:54.697 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:54.695+0000 7f2a4359e640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a440aa000 con 0x7f2a440a9470 2023-12-12T09:46:54.697 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:54.695+0000 7f2a42d9d640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f2a440ab340 0x7f2a4415cbf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:51644/0 (socket says 172.21.15.73:51644) 2023-12-12T09:46:54.697 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:54.695+0000 7f2a42d9d640 1 -- 172.21.15.73:0/1795040149 learned_addr learned my addr 172.21.15.73:0/1795040149 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-12T09:46:54.699 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:54.696+0000 7f2a3bfff640 1 --2- 172.21.15.73:0/1795040149 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2a440a9470 0x7f2a440aae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:54.700 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:54.696+0000 7f2a41d9b640 1 -- 172.21.15.73:0/1795040149 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4134905749 0 0) 0x7f2a44153300 con 0x7f2a440ab340 2023-12-12T09:46:54.700 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:54.696+0000 7f2a41d9b640 1 -- 172.21.15.73:0/1795040149 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2a30003520 con 0x7f2a440ab340 2023-12-12T09:46:54.700 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:54.696+0000 7f2a41d9b640 1 -- 172.21.15.73:0/1795040149 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 9880099 0 0) 0x7f2a30003520 con 0x7f2a440ab340 2023-12-12T09:46:54.700 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:54.696+0000 7f2a41d9b640 1 -- 172.21.15.73:0/1795040149 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2a440a9470 msgr2=0x7f2a440aae00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:46:54.700 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:54.696+0000 7f2a41d9b640 1 --2- 172.21.15.73:0/1795040149 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2a440a9470 0x7f2a440aae00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:54.700 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:54.696+0000 7f2a41d9b640 1 -- 172.21.15.73:0/1795040149 >> v1:172.21.15.142:6789/0 conn(0x7f2a4414fbb0 legacy=0x7f2a440c09e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:54.700 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:54.696+0000 7f2a41d9b640 1 -- 172.21.15.73:0/1795040149 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a44153020 con 0x7f2a440ab340 2023-12-12T09:46:54.700 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:54.696+0000 7f2a41d9b640 1 -- 172.21.15.73:0/1795040149 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3186547832 0 0) 0x7f2a3c0019f0 con 0x7f2a440ab340 2023-12-12T09:46:54.700 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:54.696+0000 7f2a41d9b640 1 -- 172.21.15.73:0/1795040149 >> v1:172.21.15.73:6789/0 conn(0x7f2a440ab340 legacy=0x7f2a4415cbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:54.700 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:54.696+0000 7f2a41d9b640 1 --2- 172.21.15.73:0/1795040149 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2a300039a0 0x7f2a30003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:54.700 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:54.696+0000 7f2a41d9b640 1 --2- 172.21.15.73:0/1795040149 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2a440a9470 0x7f2a300047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:54.700 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:54.696+0000 7f2a41d9b640 1 --2- 172.21.15.73:0/1795040149 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2a30004d00 0x7f2a30005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:54.701 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:54.696+0000 7f2a41d9b640 1 -- 172.21.15.73:0/1795040149 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a440aa000 con 0x7f2a300039a0 2023-12-12T09:46:54.701 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:54.696+0000 7f2a41d9b640 1 -- 172.21.15.73:0/1795040149 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a3000bab0 con 0x7f2a30004d00 2023-12-12T09:46:54.701 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:54.696+0000 7f2a41d9b640 1 -- 172.21.15.73:0/1795040149 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a3000bc70 con 0x7f2a440a9470 2023-12-12T09:46:54.701 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:54.697+0000 7f2a4259c640 1 --2- 172.21.15.73:0/1795040149 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2a300039a0 0x7f2a30003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:54.701 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:54.697+0000 7f2a3bfff640 1 --2- 172.21.15.73:0/1795040149 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2a440a9470 0x7f2a300047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:54.701 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:54.697+0000 7f2a42d9d640 1 --2- 172.21.15.73:0/1795040149 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2a30004d00 0x7f2a30005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:54.701 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:54.697+0000 7f2a4259c640 1 -- 172.21.15.73:0/1795040149 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2a440a9470 msgr2=0x7f2a300047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:46:54.701 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:54.697+0000 7f2a4259c640 1 --2- 172.21.15.73:0/1795040149 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2a440a9470 0x7f2a300047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:54.701 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:54.697+0000 7f2a4259c640 1 -- 172.21.15.73:0/1795040149 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2a30004d00 msgr2=0x7f2a30005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:46:54.701 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:54.697+0000 7f2a4259c640 1 --2- 172.21.15.73:0/1795040149 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2a30004d00 0x7f2a30005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:54.701 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:54.697+0000 7f2a4259c640 1 -- 172.21.15.73:0/1795040149 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a30003520 con 0x7f2a300039a0 2023-12-12T09:46:54.701 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:54.697+0000 7f2a3bfff640 1 --2- 172.21.15.73:0/1795040149 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2a440a9470 0x7f2a300047c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-12T09:46:54.701 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:54.697+0000 7f2a42d9d640 1 --2- 172.21.15.73:0/1795040149 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2a30004d00 0x7f2a30005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:46:54.703 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:54.699+0000 7f2a4259c640 1 --2- 172.21.15.73:0/1795040149 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2a300039a0 0x7f2a30003dc0 secure :-1 s=READY pgs=972 cs=0 l=1 rev1=1 crypto rx=0x7f2a34001750 tx=0x7f2a300057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5367f65c4f5d326 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:46:54.703 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:54.699+0000 7f2a41d9b640 1 -- 172.21.15.73:0/1795040149 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a340052d0 con 0x7f2a300039a0 2023-12-12T09:46:54.703 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:54.699+0000 7f2a41d9b640 1 -- 172.21.15.73:0/1795040149 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a3402e050 con 0x7f2a300039a0 2023-12-12T09:46:54.703 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:54.699+0000 7f2a41d9b640 1 -- 172.21.15.73:0/1795040149 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a340035f0 con 0x7f2a300039a0 2023-12-12T09:46:54.703 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:54.699+0000 7f2a4359e640 1 -- 172.21.15.73:0/1795040149 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2a300039a0 msgr2=0x7f2a30003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:54.703 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:54.699+0000 7f2a4359e640 1 --2- 172.21.15.73:0/1795040149 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2a300039a0 0x7f2a30003dc0 secure :-1 s=READY pgs=972 cs=0 l=1 rev1=1 crypto rx=0x7f2a34001750 tx=0x7f2a300057f0 comp rx=0 tx=0).stop 2023-12-12T09:46:54.703 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:54.699+0000 7f2a42d9d640 1 -- 172.21.15.73:0/1795040149 reap_dead start 2023-12-12T09:46:54.703 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:54.699+0000 7f2a4359e640 1 -- 172.21.15.73:0/1795040149 shutdown_connections 2023-12-12T09:46:54.704 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:54.699+0000 7f2a4359e640 1 -- 172.21.15.73:0/1795040149 >> 172.21.15.73:0/1795040149 conn(0x7f2a440c23b0 msgr2=0x7f2a440c2790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:46:54.704 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:54.699+0000 7f2a4359e640 1 -- 172.21.15.73:0/1795040149 shutdown_connections 2023-12-12T09:46:54.704 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:54.700+0000 7f2a4359e640 1 -- 172.21.15.73:0/1795040149 wait complete. 2023-12-12T09:46:54.704 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:54.701+0000 7f2a4359e640 1 Processor -- start 2023-12-12T09:46:54.704 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:54.701+0000 7f2a4359e640 1 -- start start 2023-12-12T09:46:54.706 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:54.702+0000 7f2a4359e640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2a300039a0 0x7f2a4414eba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:54.706 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:54.702+0000 7f2a4359e640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2a44072040 0x7f2a441dcc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:54.706 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:54.702+0000 7f2a4359e640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2a441542b0 0x7f2a44154db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:54.706 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:54.702+0000 7f2a4359e640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a440c1d40 con 0x7f2a44072040 2023-12-12T09:46:54.706 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:54.702+0000 7f2a4359e640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a44071c20 con 0x7f2a300039a0 2023-12-12T09:46:54.706 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:54.702+0000 7f2a4359e640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a441dbc40 con 0x7f2a441542b0 2023-12-12T09:46:54.706 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:54.703+0000 7f2a3bfff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2a44072040 0x7f2a441dcc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:54.706 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:54.703+0000 7f2a3bfff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2a44072040 0x7f2a441dcc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:40072/0 (socket says 172.21.15.73:40072) 2023-12-12T09:46:54.706 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:54.703+0000 7f2a3bfff640 1 -- 172.21.15.73:0/3796573473 learned_addr learned my addr 172.21.15.73:0/3796573473 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:46:54.706 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:54.703+0000 7f2a3bfff640 1 -- 172.21.15.73:0/3796573473 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2a441542b0 msgr2=0x7f2a44154db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:54.706 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:54.703+0000 7f2a3bfff640 1 --2- 172.21.15.73:0/3796573473 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2a441542b0 0x7f2a44154db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:54.707 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:54.703+0000 7f2a3bfff640 1 -- 172.21.15.73:0/3796573473 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2a300039a0 msgr2=0x7f2a4414eba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:54.707 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:54.703+0000 7f2a4259c640 1 --2- 172.21.15.73:0/3796573473 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2a300039a0 0x7f2a4414eba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:54.707 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:54.703+0000 7f2a3bfff640 1 --2- 172.21.15.73:0/3796573473 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2a300039a0 0x7f2a4414eba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:54.707 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:54.703+0000 7f2a3bfff640 1 -- 172.21.15.73:0/3796573473 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a441dbf20 con 0x7f2a44072040 2023-12-12T09:46:54.707 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:54.703+0000 7f2a3bfff640 1 --2- 172.21.15.73:0/3796573473 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2a44072040 0x7f2a441dcc80 secure :-1 s=READY pgs=973 cs=0 l=1 rev1=1 crypto rx=0x7f2a2c0116d0 tx=0x7f2a2c011b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:46:54.707 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:54.704+0000 7f2a3affd640 1 -- 172.21.15.73:0/3796573473 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a2c00f9c0 con 0x7f2a44072040 2023-12-12T09:46:54.707 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:54.704+0000 7f2a3affd640 1 -- 172.21.15.73:0/3796573473 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a2c00fb20 con 0x7f2a44072040 2023-12-12T09:46:54.707 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:54.704+0000 7f2a4359e640 1 -- 172.21.15.73:0/3796573473 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a44071560 con 0x7f2a44072040 2023-12-12T09:46:54.707 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:54.704+0000 7f2a3affd640 1 -- 172.21.15.73:0/3796573473 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a2c00fed0 con 0x7f2a44072040 2023-12-12T09:46:54.707 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:54.704+0000 7f2a4359e640 1 -- 172.21.15.73:0/3796573473 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a441db8d0 con 0x7f2a44072040 2023-12-12T09:46:54.708 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:54.705+0000 7f2a4359e640 1 -- 172.21.15.73:0/3796573473 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a44071d60 con 0x7f2a44072040 2023-12-12T09:46:54.708 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:54.706+0000 7f2a3affd640 1 -- 172.21.15.73:0/3796573473 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f2a2c015460 con 0x7f2a44072040 2023-12-12T09:46:54.708 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:54.707+0000 7f2a3affd640 1 --2- 172.21.15.73:0/3796573473 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f2a2406ae40 0x7f2a2406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:54.708 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:54.707+0000 7f2a3affd640 1 -- 172.21.15.73:0/3796573473 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f2a2c08a240 con 0x7f2a44072040 2023-12-12T09:46:54.709 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:54.707+0000 7f2a4259c640 1 --2- 172.21.15.73:0/3796573473 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f2a2406ae40 0x7f2a2406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:54.709 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:54.708+0000 7f2a4259c640 1 --2- 172.21.15.73:0/3796573473 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f2a2406ae40 0x7f2a2406d300 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f2a34033000 tx=0x7f2a34009030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:46:54.713 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:54.712+0000 7f2a3affd640 1 -- 172.21.15.73:0/3796573473 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f2a44071d60 con 0x7f2a44072040 2023-12-12T09:46:54.902 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:54.901+0000 7f2a4359e640 1 -- 172.21.15.73:0/3796573473 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2a44071d60 con 0x7f2a44072040 2023-12-12T09:46:54.905 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:54.904+0000 7f2a3affd640 1 -- 172.21.15.73:0/3796573473 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v79) v1 ==== 74+0+20226 (secure 0 0 0) 0x7f2a44071d60 con 0x7f2a44072040 2023-12-12T09:46:54.906 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-12T09:46:54.906 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":79,"fsid":"ba240992-02b8-4c7e-92f2-27eb29ac433b","created":"2023-12-12T09:43:02.454719+0000","modified":"2023-12-12T09:46:43.294476+0000","last_up_change":"2023-12-12T09:43:13.913440+0000","last_in_change":"2023-12-12T09:43:05.925348+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-12T09:43:15.525508+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2023-12-12T09:46:24.716544+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2023-12-12T09:46:25.435954+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs2_metadata","create_time":"2023-12-12T09:46:40.116878+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs2_data","create_time":"2023-12-12T09:46:40.798840+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"dd9074be-dbe2-4c34-9896-a4223d8d3940","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":4047810203},{"type":"v1","addr":"172.21.15.73:6801","nonce":4047810203}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":4047810203},{"type":"v1","addr":"172.21.15.73:6803","nonce":4047810203}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":4047810203},{"type":"v1","addr":"172.21.15.73:6807","nonce":4047810203}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":4047810203},{"type":"v1","addr":"172.21.15.73:6805","nonce":4047810203}]},"public_addr":"172.21.15.73:6801/4047810203","cluster_addr":"172.21.15.73:6803/4047810203","heartbeat_back_addr":"172.21.15.73:6807/4047810203","heartbeat_front_addr":"172.21.15.73:6805/4047810203","state":["exists","up"]},{"osd":1,"uuid":"c4a05052-96d4-4758-a4e1-1a37f1e07fed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":1356058331},{"type":"v1","addr":"172.21.15.73:6824","nonce":1356058331}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":1356058331},{"type":"v1","addr":"172.21.15.73:6827","nonce":1356058331}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":1356058331},{"type":"v1","addr":"172.21.15.73:6831","nonce":1356058331}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":1356058331},{"type":"v1","addr":"172.21.15.73:6829","nonce":1356058331}]},"public_addr":"172.21.15.73:6824/1356058331","cluster_addr":"172.21.15.73:6827/1356058331","heartbeat_back_addr":"172.21.15.73:6831/1356058331","heartbeat_front_addr":"172.21.15.73:6829/1356058331","state":["exists","up"]},{"osd":2,"uuid":"512bc8ac-72c2-40d4-b3d2-d867a92c5213","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":1228903316},{"type":"v1","addr":"172.21.15.73:6817","nonce":1228903316}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":1228903316},{"type":"v1","addr":"172.21.15.73:6819","nonce":1228903316}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6823","nonce":1228903316},{"type":"v1","addr":"172.21.15.73:6825","nonce":1228903316}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":1228903316},{"type":"v1","addr":"172.21.15.73:6821","nonce":1228903316}]},"public_addr":"172.21.15.73:6817/1228903316","cluster_addr":"172.21.15.73:6819/1228903316","heartbeat_back_addr":"172.21.15.73:6825/1228903316","heartbeat_front_addr":"172.21.15.73:6821/1228903316","state":["exists","up"]},{"osd":3,"uuid":"3d1a91e0-42bf-437a-8eae-8d357c8f63a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":1293329670},{"type":"v1","addr":"172.21.15.73:6809","nonce":1293329670}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6810","nonce":1293329670},{"type":"v1","addr":"172.21.15.73:6811","nonce":1293329670}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":1293329670},{"type":"v1","addr":"172.21.15.73:6815","nonce":1293329670}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":1293329670},{"type":"v1","addr":"172.21.15.73:6813","nonce":1293329670}]},"public_addr":"172.21.15.73:6809/1293329670","cluster_addr":"172.21.15.73:6811/1293329670","heartbeat_back_addr":"172.21.15.73:6815/1293329670","heartbeat_front_addr":"172.21.15.73:6813/1293329670","state":["exists","up"]},{"osd":4,"uuid":"4b302fff-834c-4069-ac19-00e46f6c87b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":3727975702},{"type":"v1","addr":"172.21.15.142:6801","nonce":3727975702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":3727975702},{"type":"v1","addr":"172.21.15.142:6803","nonce":3727975702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6809","nonce":3727975702},{"type":"v1","addr":"172.21.15.142:6811","nonce":3727975702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6805","nonce":3727975702},{"type":"v1","addr":"172.21.15.142:6807","nonce":3727975702}]},"public_addr":"172.21.15.142:6801/3727975702","cluster_addr":"172.21.15.142:6803/3727975702","heartbeat_back_addr":"172.21.15.142:6811/3727975702","heartbeat_front_addr":"172.21.15.142:6807/3727975702","state":["exists","up"]},{"osd":5,"uuid":"d7cdace2-67d0-45cc-95f2-515cf6ef1b82","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6817","nonce":2353193632},{"type":"v1","addr":"172.21.15.142:6819","nonce":2353193632}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6821","nonce":2353193632},{"type":"v1","addr":"172.21.15.142:6823","nonce":2353193632}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6829","nonce":2353193632},{"type":"v1","addr":"172.21.15.142:6831","nonce":2353193632}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6825","nonce":2353193632},{"type":"v1","addr":"172.21.15.142:6827","nonce":2353193632}]},"public_addr":"172.21.15.142:6819/2353193632","cluster_addr":"172.21.15.142:6823/2353193632","heartbeat_back_addr":"172.21.15.142:6831/2353193632","heartbeat_front_addr":"172.21.15.142:6827/2353193632","state":["exists","up"]},{"osd":6,"uuid":"649ce78a-5626-445c-aedc-a651ed05a6f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":2006111986},{"type":"v1","addr":"172.21.15.142:6806","nonce":2006111986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":2006111986},{"type":"v1","addr":"172.21.15.142:6810","nonce":2006111986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":2006111986},{"type":"v1","addr":"172.21.15.142:6815","nonce":2006111986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":2006111986},{"type":"v1","addr":"172.21.15.142:6813","nonce":2006111986}]},"public_addr":"172.21.15.142:6806/2006111986","cluster_addr":"172.21.15.142:6810/2006111986","heartbeat_back_addr":"172.21.15.142:6815/2006111986","heartbeat_front_addr":"172.21.15.142:6813/2006111986","state":["exists","up"]},{"osd":7,"uuid":"af15ae3b-c1d0-4acf-92db-8a1805494d13","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":2573794341},{"type":"v1","addr":"172.21.15.142:6818","nonce":2573794341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":2573794341},{"type":"v1","addr":"172.21.15.142:6822","nonce":2573794341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":2573794341},{"type":"v1","addr":"172.21.15.142:6830","nonce":2573794341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":2573794341},{"type":"v1","addr":"172.21.15.142:6826","nonce":2573794341}]},"public_addr":"172.21.15.142:6818/2573794341","cluster_addr":"172.21.15.142:6822/2573794341","heartbeat_back_addr":"172.21.15.142:6830/2573794341","heartbeat_front_addr":"172.21.15.142:6826/2573794341","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.185824+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.262103+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.225556+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:10.523459+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:10.706035+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.257339+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.301776+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.051960+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-12T09:46:54.908 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:54.907+0000 7f2a4359e640 1 -- 172.21.15.73:0/3796573473 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f2a2406ae40 msgr2=0x7f2a2406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:54.908 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:54.907+0000 7f2a4359e640 1 --2- 172.21.15.73:0/3796573473 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f2a2406ae40 0x7f2a2406d300 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f2a34033000 tx=0x7f2a34009030 comp rx=0 tx=0).stop 2023-12-12T09:46:54.909 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:54.907+0000 7f2a4359e640 1 -- 172.21.15.73:0/3796573473 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2a44072040 msgr2=0x7f2a441dcc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:54.909 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:54.907+0000 7f2a4359e640 1 --2- 172.21.15.73:0/3796573473 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2a44072040 0x7f2a441dcc80 secure :-1 s=READY pgs=973 cs=0 l=1 rev1=1 crypto rx=0x7f2a2c0116d0 tx=0x7f2a2c011b90 comp rx=0 tx=0).stop 2023-12-12T09:46:54.909 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:54.907+0000 7f2a4359e640 1 -- 172.21.15.73:0/3796573473 shutdown_connections 2023-12-12T09:46:54.909 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:54.907+0000 7f2a4359e640 1 --2- 172.21.15.73:0/3796573473 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f2a2406ae40 0x7f2a2406d300 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:54.909 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:54.907+0000 7f2a4359e640 1 --2- 172.21.15.73:0/3796573473 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2a441542b0 0x7f2a44154db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:54.909 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:54.907+0000 7f2a4359e640 1 --2- 172.21.15.73:0/3796573473 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2a44072040 0x7f2a441dcc80 unknown :-1 s=CLOSED pgs=973 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:54.909 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:54.907+0000 7f2a4359e640 1 --2- 172.21.15.73:0/3796573473 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2a300039a0 0x7f2a4414eba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:54.909 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:54.907+0000 7f2a4359e640 1 -- 172.21.15.73:0/3796573473 >> 172.21.15.73:0/3796573473 conn(0x7f2a440c23b0 msgr2=0x7f2a440a6f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:46:54.909 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:54.907+0000 7f2a4359e640 1 -- 172.21.15.73:0/3796573473 shutdown_connections 2023-12-12T09:46:54.909 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:54.907+0000 7f2a4359e640 1 -- 172.21.15.73:0/3796573473 wait complete. 2023-12-12T09:46:54.928 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-12T09:43:15.525508+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 12, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-12T09:46:24.716544+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '74', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 13, 'pool_name': 'cephfs_data', 'create_time': '2023-12-12T09:46:25.435954+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '75', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 14, 'pool_name': 'cephfs2_metadata', 'create_time': '2023-12-12T09:46:40.116878+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '78', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs2'}}, 'read_balance': {'score_acting': 2.5, 'score_stable': 2.5, 'optimal_score': 1, 'raw_score_acting': 2.5, 'raw_score_stable': 2.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 15, 'pool_name': 'cephfs2_data', 'create_time': '2023-12-12T09:46:40.798840+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '79', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs2'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-12T09:46:54.928 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-12T09:46:55.150 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:55.148+0000 7f4be2a39640 1 Processor -- start 2023-12-12T09:46:55.150 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:55.149+0000 7f4be2a39640 1 -- start start 2023-12-12T09:46:55.152 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:55.150+0000 7f4be2a39640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f4bdc0c6590 0x7f4bdc0c6970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:55.152 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:55.150+0000 7f4be2a39640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f4bdc06c0f0 0x7f4bdc15ed50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:55.152 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:55.150+0000 7f4be2a39640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4bdc0c4540 con 0x7f4bdc0c81e0 2023-12-12T09:46:55.152 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:55.150+0000 7f4be2a39640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4bdc154430 con 0x7f4bdc0c6590 2023-12-12T09:46:55.152 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:55.150+0000 7f4be2a39640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4bdc0c5030 con 0x7f4bdc06c0f0 2023-12-12T09:46:55.152 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:55.150+0000 7f4be1236640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f4bdc0c81e0 0x7f4bdc154b40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:51658/0 (socket says 172.21.15.73:51658) 2023-12-12T09:46:55.152 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:55.150+0000 7f4be1236640 1 -- 172.21.15.73:0/1354604145 learned_addr learned my addr 172.21.15.73:0/1354604145 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-12T09:46:55.152 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:55.150+0000 7f4be1a37640 1 --2- 172.21.15.73:0/1354604145 >> v2:172.21.15.73:3300/0 conn(0x7f4bdc0c6590 0x7f4bdc0c6970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:55.152 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:55.151+0000 7f4be2238640 1 --2- 172.21.15.73:0/1354604145 >> v2:172.21.15.142:3300/0 conn(0x7f4bdc06c0f0 0x7f4bdc15ed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:55.153 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:55.151+0000 7f4be0a35640 1 -- 172.21.15.73:0/1354604145 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 488157094 0 0) 0x7f4bdc0c4540 con 0x7f4bdc0c81e0 2023-12-12T09:46:55.153 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:55.151+0000 7f4be0a35640 1 -- 172.21.15.73:0/1354604145 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4bcc003520 con 0x7f4bdc0c81e0 2023-12-12T09:46:55.153 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:55.151+0000 7f4be1a37640 1 -- 172.21.15.73:0/1354604145 >> v2:172.21.15.142:3300/0 conn(0x7f4bdc06c0f0 msgr2=0x7f4bdc15ed50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:46:55.153 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:55.151+0000 7f4be1a37640 1 --2- 172.21.15.73:0/1354604145 >> v2:172.21.15.142:3300/0 conn(0x7f4bdc06c0f0 0x7f4bdc15ed50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:55.153 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:55.151+0000 7f4be1a37640 1 -- 172.21.15.73:0/1354604145 >> v1:172.21.15.73:6789/0 conn(0x7f4bdc0c81e0 legacy=0x7f4bdc154b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:55.153 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:55.151+0000 7f4be1a37640 1 -- 172.21.15.73:0/1354604145 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bdc0c7e00 con 0x7f4bdc0c6590 2023-12-12T09:46:55.154 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:55.152+0000 7f4be1a37640 1 --2- 172.21.15.73:0/1354604145 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4bdc0c6590 0x7f4bdc0c6970 secure :-1 s=READY pgs=975 cs=0 l=1 rev1=1 crypto rx=0x7f4bdc08bdb0 tx=0x7f4bd002bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59912a45ac996cb5 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:46:55.154 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:55.153+0000 7f4be0a35640 1 -- 172.21.15.73:0/1354604145 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bd002cc80 con 0x7f4bdc0c6590 2023-12-12T09:46:55.154 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:55.153+0000 7f4be0a35640 1 -- 172.21.15.73:0/1354604145 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4bd002cde0 con 0x7f4bdc0c6590 2023-12-12T09:46:55.154 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:55.153+0000 7f4be0a35640 1 -- 172.21.15.73:0/1354604145 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bd0034660 con 0x7f4bdc0c6590 2023-12-12T09:46:55.155 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:55.153+0000 7f4be2a39640 1 -- 172.21.15.73:0/1354604145 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4bdc0c6590 msgr2=0x7f4bdc0c6970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:55.155 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:55.153+0000 7f4be2a39640 1 --2- 172.21.15.73:0/1354604145 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4bdc0c6590 0x7f4bdc0c6970 secure :-1 s=READY pgs=975 cs=0 l=1 rev1=1 crypto rx=0x7f4bdc08bdb0 tx=0x7f4bd002bed0 comp rx=0 tx=0).stop 2023-12-12T09:46:55.155 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:55.153+0000 7f4be2a39640 1 -- 172.21.15.73:0/1354604145 shutdown_connections 2023-12-12T09:46:55.155 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:55.153+0000 7f4be2a39640 1 --2- 172.21.15.73:0/1354604145 >> v2:172.21.15.142:3300/0 conn(0x7f4bdc06c0f0 0x7f4bdc15ed50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:55.155 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:55.153+0000 7f4be2a39640 1 --2- 172.21.15.73:0/1354604145 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4bdc0c6590 0x7f4bdc0c6970 unknown :-1 s=CLOSED pgs=975 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:55.155 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:55.153+0000 7f4be2a39640 1 -- 172.21.15.73:0/1354604145 >> 172.21.15.73:0/1354604145 conn(0x7f4bdc0ab770 msgr2=0x7f4bdc0abb80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:46:55.155 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:55.154+0000 7f4be2a39640 1 -- 172.21.15.73:0/1354604145 shutdown_connections 2023-12-12T09:46:55.156 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:55.154+0000 7f4be2a39640 1 -- 172.21.15.73:0/1354604145 wait complete. 2023-12-12T09:46:55.157 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:55.155+0000 7f4be2a39640 1 Processor -- start 2023-12-12T09:46:55.157 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:55.155+0000 7f4be2a39640 1 -- start start 2023-12-12T09:46:55.158 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:55.156+0000 7f4be2a39640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4bdc06c0f0 0x7f4bdc0ae610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:55.159 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:55.156+0000 7f4be2a39640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4bdc0c6590 0x7f4bdc0aeb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:55.159 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:55.156+0000 7f4be2a39640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4bdc0c81e0 0x7f4bdc0c1ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:55.159 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:55.156+0000 7f4be2a39640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bdc0ad220 con 0x7f4bdc06c0f0 2023-12-12T09:46:55.159 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:55.156+0000 7f4be2a39640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bdc1487c0 con 0x7f4bdc0c6590 2023-12-12T09:46:55.159 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:55.156+0000 7f4be2a39640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4bdc0c3620 con 0x7f4bdc0c81e0 2023-12-12T09:46:55.159 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:55.157+0000 7f4be1a37640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4bdc06c0f0 0x7f4bdc0ae610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:55.159 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:55.157+0000 7f4be1a37640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4bdc06c0f0 0x7f4bdc0ae610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:40084/0 (socket says 172.21.15.73:40084) 2023-12-12T09:46:55.159 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:55.157+0000 7f4be1a37640 1 -- 172.21.15.73:0/4023094338 learned_addr learned my addr 172.21.15.73:0/4023094338 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:46:55.159 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:55.157+0000 7f4be1a37640 1 -- 172.21.15.73:0/4023094338 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4bdc0c81e0 msgr2=0x7f4bdc0c1ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:55.159 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:55.157+0000 7f4be1a37640 1 --2- 172.21.15.73:0/4023094338 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4bdc0c81e0 0x7f4bdc0c1ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:55.159 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:55.157+0000 7f4be1a37640 1 -- 172.21.15.73:0/4023094338 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4bdc0c6590 msgr2=0x7f4bdc0aeb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:55.159 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:55.157+0000 7f4be1a37640 1 --2- 172.21.15.73:0/4023094338 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4bdc0c6590 0x7f4bdc0aeb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:55.159 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:55.157+0000 7f4be1a37640 1 -- 172.21.15.73:0/4023094338 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bd0009a70 con 0x7f4bdc06c0f0 2023-12-12T09:46:55.160 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:55.157+0000 7f4be1a37640 1 --2- 172.21.15.73:0/4023094338 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4bdc06c0f0 0x7f4bdc0ae610 secure :-1 s=READY pgs=976 cs=0 l=1 rev1=1 crypto rx=0x7f4bd0037040 tx=0x7f4bd0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:46:55.160 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:55.158+0000 7f4bda7fc640 1 -- 172.21.15.73:0/4023094338 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bd0040650 con 0x7f4bdc06c0f0 2023-12-12T09:46:55.160 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:55.158+0000 7f4bda7fc640 1 -- 172.21.15.73:0/4023094338 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4bd00407b0 con 0x7f4bdc06c0f0 2023-12-12T09:46:55.160 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:55.158+0000 7f4be2a39640 1 -- 172.21.15.73:0/4023094338 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4bdc0c3dc0 con 0x7f4bdc06c0f0 2023-12-12T09:46:55.160 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:55.158+0000 7f4bda7fc640 1 -- 172.21.15.73:0/4023094338 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bd0040b60 con 0x7f4bdc06c0f0 2023-12-12T09:46:55.161 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:55.158+0000 7f4be2a39640 1 -- 172.21.15.73:0/4023094338 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4bdc0ac820 con 0x7f4bdc06c0f0 2023-12-12T09:46:55.161 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:55.159+0000 7f4be2a39640 1 -- 172.21.15.73:0/4023094338 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4bdc148950 con 0x7f4bdc06c0f0 2023-12-12T09:46:55.161 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:55.160+0000 7f4bda7fc640 1 -- 172.21.15.73:0/4023094338 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f4bd0040cc0 con 0x7f4bdc06c0f0 2023-12-12T09:46:55.163 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:55.162+0000 7f4bda7fc640 1 --2- 172.21.15.73:0/4023094338 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f4bc006ae40 0x7f4bc006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:55.163 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:55.162+0000 7f4bda7fc640 1 -- 172.21.15.73:0/4023094338 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f4bd00ac630 con 0x7f4bdc06c0f0 2023-12-12T09:46:55.163 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:55.162+0000 7f4be1236640 1 --2- 172.21.15.73:0/4023094338 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f4bc006ae40 0x7f4bc006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:55.164 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:55.163+0000 7f4be1236640 1 --2- 172.21.15.73:0/4023094338 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f4bc006ae40 0x7f4bc006d300 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f4bc8001360 tx=0x7f4bc80077c0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:46:55.167 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:55.166+0000 7f4bda7fc640 1 -- 172.21.15.73:0/4023094338 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f4bd0077430 con 0x7f4bdc06c0f0 2023-12-12T09:46:55.352 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:55.350+0000 7f4be2a39640 1 -- 172.21.15.73:0/4023094338 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f4bdc067400 con 0x7f4bdc06c0f0 2023-12-12T09:46:55.352 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:55.351+0000 7f4bda7fc640 1 -- 172.21.15.73:0/4023094338 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v79) v1 ==== 93+0+10 (secure 0 0 0) 0x7f4bd0009450 con 0x7f4bdc06c0f0 2023-12-12T09:46:55.353 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 1 2023-12-12T09:46:55.355 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:55.353+0000 7f4be2a39640 1 -- 172.21.15.73:0/4023094338 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f4bc006ae40 msgr2=0x7f4bc006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:55.355 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:55.353+0000 7f4be2a39640 1 --2- 172.21.15.73:0/4023094338 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f4bc006ae40 0x7f4bc006d300 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f4bc8001360 tx=0x7f4bc80077c0 comp rx=0 tx=0).stop 2023-12-12T09:46:55.355 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:55.353+0000 7f4be2a39640 1 -- 172.21.15.73:0/4023094338 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4bdc06c0f0 msgr2=0x7f4bdc0ae610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:55.355 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:55.353+0000 7f4be2a39640 1 --2- 172.21.15.73:0/4023094338 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4bdc06c0f0 0x7f4bdc0ae610 secure :-1 s=READY pgs=976 cs=0 l=1 rev1=1 crypto rx=0x7f4bd0037040 tx=0x7f4bd0004a40 comp rx=0 tx=0).stop 2023-12-12T09:46:55.355 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:55.354+0000 7f4be2a39640 1 -- 172.21.15.73:0/4023094338 shutdown_connections 2023-12-12T09:46:55.356 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:55.354+0000 7f4be2a39640 1 --2- 172.21.15.73:0/4023094338 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f4bc006ae40 0x7f4bc006d300 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:55.356 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:55.354+0000 7f4be2a39640 1 --2- 172.21.15.73:0/4023094338 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4bdc0c81e0 0x7f4bdc0c1ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:55.356 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:55.354+0000 7f4be2a39640 1 --2- 172.21.15.73:0/4023094338 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4bdc0c6590 0x7f4bdc0aeb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:55.356 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:55.354+0000 7f4be2a39640 1 --2- 172.21.15.73:0/4023094338 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4bdc06c0f0 0x7f4bdc0ae610 unknown :-1 s=CLOSED pgs=976 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:55.356 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:55.354+0000 7f4be2a39640 1 -- 172.21.15.73:0/4023094338 >> 172.21.15.73:0/4023094338 conn(0x7f4bdc0ab770 msgr2=0x7f4bdc06b410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:46:55.356 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:55.354+0000 7f4be2a39640 1 -- 172.21.15.73:0/4023094338 shutdown_connections 2023-12-12T09:46:55.356 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:55.354+0000 7f4be2a39640 1 -- 172.21.15.73:0/4023094338 wait complete. 2023-12-12T09:46:55.374 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-12T09:46:55.591 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:55.589+0000 7fbba2d4c640 1 Processor -- start 2023-12-12T09:46:55.591 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:55.589+0000 7fbba2d4c640 1 -- start start 2023-12-12T09:46:55.592 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:55.591+0000 7fbba2d4c640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbb9c0abf90 0x7fbb9c0ac370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:55.592 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:55.591+0000 7fbba2d4c640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb9c0716e0 con 0x7fbb9c155a80 2023-12-12T09:46:55.593 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:55.591+0000 7fbba2d4c640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb9c1527e0 con 0x7fbb9c06d420 2023-12-12T09:46:55.593 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:55.591+0000 7fbba2d4c640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb9c0714c0 con 0x7fbb9c0abf90 2023-12-12T09:46:55.593 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:55.591+0000 7fbba12e9640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7fbb9c155a80 0x7fbb9c155f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:51674/0 (socket says 172.21.15.73:51674) 2023-12-12T09:46:55.593 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:55.591+0000 7fbba12e9640 1 -- 172.21.15.73:0/2317686102 learned_addr learned my addr 172.21.15.73:0/2317686102 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-12T09:46:55.594 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:55.591+0000 7fbba0ae8640 1 --2- 172.21.15.73:0/2317686102 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbb9c0abf90 0x7fbb9c0ac370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:55.594 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:55.592+0000 7fbb937fe640 1 -- 172.21.15.73:0/2317686102 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 405167573 0 0) 0x7fbb9c0716e0 con 0x7fbb9c155a80 2023-12-12T09:46:55.595 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:55.592+0000 7fbb937fe640 1 -- 172.21.15.73:0/2317686102 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbb84003520 con 0x7fbb9c155a80 2023-12-12T09:46:55.595 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:55.592+0000 7fbb937fe640 1 -- 172.21.15.73:0/2317686102 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3807520469 0 0) 0x7fbb84003520 con 0x7fbb9c155a80 2023-12-12T09:46:55.595 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:55.592+0000 7fbb937fe640 1 -- 172.21.15.73:0/2317686102 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbb9c0abf90 msgr2=0x7fbb9c0ac370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:46:55.595 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:55.592+0000 7fbb937fe640 1 --2- 172.21.15.73:0/2317686102 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbb9c0abf90 0x7fbb9c0ac370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:55.595 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:55.592+0000 7fbb937fe640 1 -- 172.21.15.73:0/2317686102 >> v1:172.21.15.142:6789/0 conn(0x7fbb9c06d420 legacy=0x7fbb9c070db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:55.595 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:55.592+0000 7fbb937fe640 1 -- 172.21.15.73:0/2317686102 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb9c152ac0 con 0x7fbb9c155a80 2023-12-12T09:46:55.595 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:55.592+0000 7fbb937fe640 1 -- 172.21.15.73:0/2317686102 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3186547832 0 0) 0x7fbb94001670 con 0x7fbb9c155a80 2023-12-12T09:46:55.595 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:55.592+0000 7fbb937fe640 1 -- 172.21.15.73:0/2317686102 >> v1:172.21.15.73:6789/0 conn(0x7fbb9c155a80 legacy=0x7fbb9c155f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:55.595 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:55.592+0000 7fbb937fe640 1 --2- 172.21.15.73:0/2317686102 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbb840039a0 0x7fbb84003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:55.595 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:55.592+0000 7fbb937fe640 1 --2- 172.21.15.73:0/2317686102 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbb9c0abf90 0x7fbb840047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:55.595 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:55.592+0000 7fbb937fe640 1 --2- 172.21.15.73:0/2317686102 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbb84004d00 0x7fbb84005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:55.595 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:55.592+0000 7fbb937fe640 1 -- 172.21.15.73:0/2317686102 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb9c0714c0 con 0x7fbb840039a0 2023-12-12T09:46:55.596 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:55.592+0000 7fbb937fe640 1 -- 172.21.15.73:0/2317686102 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb8400bab0 con 0x7fbb84004d00 2023-12-12T09:46:55.596 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:55.592+0000 7fbb937fe640 1 -- 172.21.15.73:0/2317686102 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb8400bc70 con 0x7fbb9c0abf90 2023-12-12T09:46:55.596 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:55.592+0000 7fbba0ae8640 1 --2- 172.21.15.73:0/2317686102 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbb840039a0 0x7fbb84003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:55.596 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:55.593+0000 7fbba0ae8640 1 -- 172.21.15.73:0/2317686102 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbb9c0abf90 msgr2=0x7fbb840047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:46:55.596 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:55.593+0000 7fbba0ae8640 1 --2- 172.21.15.73:0/2317686102 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbb9c0abf90 0x7fbb840047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:55.596 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:55.593+0000 7fbba0ae8640 1 -- 172.21.15.73:0/2317686102 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbb84004d00 msgr2=0x7fbb84005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:46:55.596 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:55.593+0000 7fbba0ae8640 1 --2- 172.21.15.73:0/2317686102 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbb84004d00 0x7fbb84005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:55.596 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:55.593+0000 7fbba0ae8640 1 -- 172.21.15.73:0/2317686102 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb84003520 con 0x7fbb840039a0 2023-12-12T09:46:55.597 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:55.594+0000 7fbba0ae8640 1 --2- 172.21.15.73:0/2317686102 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbb840039a0 0x7fbb84003dc0 secure :-1 s=READY pgs=978 cs=0 l=1 rev1=1 crypto rx=0x7fbb98009fc0 tx=0x7fbb840057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fef1b30c6080fec2 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:46:55.597 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:55.594+0000 7fbb937fe640 1 -- 172.21.15.73:0/2317686102 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb9802cb90 con 0x7fbb840039a0 2023-12-12T09:46:55.597 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:55.594+0000 7fbb937fe640 1 -- 172.21.15.73:0/2317686102 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb9800f040 con 0x7fbb840039a0 2023-12-12T09:46:55.597 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:55.594+0000 7fbb937fe640 1 -- 172.21.15.73:0/2317686102 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb98034440 con 0x7fbb840039a0 2023-12-12T09:46:55.597 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:55.595+0000 7fbba2d4c640 1 -- 172.21.15.73:0/2317686102 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbb840039a0 msgr2=0x7fbb84003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:55.598 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:55.595+0000 7fbba2d4c640 1 --2- 172.21.15.73:0/2317686102 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbb840039a0 0x7fbb84003dc0 secure :-1 s=READY pgs=978 cs=0 l=1 rev1=1 crypto rx=0x7fbb98009fc0 tx=0x7fbb840057f0 comp rx=0 tx=0).stop 2023-12-12T09:46:55.598 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:55.595+0000 7fbba12e9640 1 -- 172.21.15.73:0/2317686102 reap_dead start 2023-12-12T09:46:55.598 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:55.595+0000 7fbba2d4c640 1 -- 172.21.15.73:0/2317686102 shutdown_connections 2023-12-12T09:46:55.598 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:55.595+0000 7fbba2d4c640 1 -- 172.21.15.73:0/2317686102 >> 172.21.15.73:0/2317686102 conn(0x7fbb9c0c36d0 msgr2=0x7fbb9c0c3ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:46:55.598 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:55.595+0000 7fbba2d4c640 1 -- 172.21.15.73:0/2317686102 shutdown_connections 2023-12-12T09:46:55.598 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:55.595+0000 7fbba2d4c640 1 -- 172.21.15.73:0/2317686102 wait complete. 2023-12-12T09:46:55.599 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:55.596+0000 7fbba2d4c640 1 Processor -- start 2023-12-12T09:46:55.599 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:55.597+0000 7fbba2d4c640 1 -- start start 2023-12-12T09:46:55.599 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:55.597+0000 7fbba2d4c640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbb840039a0 0x7fbb9c1e8fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:55.599 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:55.598+0000 7fbba2d4c640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbb9c0ab740 0x7fbb9c0aa220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:55.599 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:55.598+0000 7fbba2d4c640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbb9c0aa760 0x7fbb9c1473e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:55.599 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:55.598+0000 7fbba2d4c640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb9c0c5ae0 con 0x7fbb9c0ab740 2023-12-12T09:46:55.599 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:55.598+0000 7fbba2d4c640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb9c1e9f50 con 0x7fbb840039a0 2023-12-12T09:46:55.599 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:55.598+0000 7fbba2d4c640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb9c0a9d90 con 0x7fbb9c0aa760 2023-12-12T09:46:55.601 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:55.598+0000 7fbb93fff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbb9c0ab740 0x7fbb9c0aa220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:55.601 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:55.598+0000 7fbb93fff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbb9c0ab740 0x7fbb9c0aa220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:40102/0 (socket says 172.21.15.73:40102) 2023-12-12T09:46:55.601 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:55.598+0000 7fbb93fff640 1 -- 172.21.15.73:0/3300686885 learned_addr learned my addr 172.21.15.73:0/3300686885 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:46:55.601 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:55.598+0000 7fbba12e9640 1 --2- 172.21.15.73:0/3300686885 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbb9c0aa760 0x7fbb9c1473e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:55.601 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:55.598+0000 7fbb93fff640 1 -- 172.21.15.73:0/3300686885 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbb9c0aa760 msgr2=0x7fbb9c1473e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:55.601 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:55.598+0000 7fbb93fff640 1 --2- 172.21.15.73:0/3300686885 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbb9c0aa760 0x7fbb9c1473e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:55.601 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:55.598+0000 7fbb93fff640 1 -- 172.21.15.73:0/3300686885 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbb840039a0 msgr2=0x7fbb9c1e8fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:55.601 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:55.598+0000 7fbb93fff640 1 --2- 172.21.15.73:0/3300686885 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbb840039a0 0x7fbb9c1e8fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:55.601 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:55.598+0000 7fbb93fff640 1 -- 172.21.15.73:0/3300686885 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb9c0aabe0 con 0x7fbb9c0ab740 2023-12-12T09:46:55.601 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:55.599+0000 7fbb93fff640 1 --2- 172.21.15.73:0/3300686885 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbb9c0ab740 0x7fbb9c0aa220 secure :-1 s=READY pgs=979 cs=0 l=1 rev1=1 crypto rx=0x7fbb8c00c500 tx=0x7fbb8c00c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:46:55.601 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:55.599+0000 7fbb917fa640 1 -- 172.21.15.73:0/3300686885 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb8c0052d0 con 0x7fbb9c0ab740 2023-12-12T09:46:55.602 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:55.599+0000 7fbb917fa640 1 -- 172.21.15.73:0/3300686885 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb8c005430 con 0x7fbb9c0ab740 2023-12-12T09:46:55.602 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:55.599+0000 7fbb917fa640 1 -- 172.21.15.73:0/3300686885 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb8c012850 con 0x7fbb9c0ab740 2023-12-12T09:46:55.602 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:55.599+0000 7fbba2d4c640 1 -- 172.21.15.73:0/3300686885 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb9c1e96b0 con 0x7fbb9c0ab740 2023-12-12T09:46:55.602 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:55.599+0000 7fbba2d4c640 1 -- 172.21.15.73:0/3300686885 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb9c1e9c70 con 0x7fbb9c0ab740 2023-12-12T09:46:55.602 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:55.600+0000 7fbba2d4c640 1 -- 172.21.15.73:0/3300686885 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb9c067580 con 0x7fbb9c0ab740 2023-12-12T09:46:55.602 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:55.601+0000 7fbb917fa640 1 -- 172.21.15.73:0/3300686885 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fbb8c0129b0 con 0x7fbb9c0ab740 2023-12-12T09:46:55.603 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:55.602+0000 7fbb917fa640 1 --2- 172.21.15.73:0/3300686885 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fbb8806ae70 0x7fbb8806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:55.603 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:55.602+0000 7fbb917fa640 1 -- 172.21.15.73:0/3300686885 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fbb8c089480 con 0x7fbb9c0ab740 2023-12-12T09:46:55.604 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:55.602+0000 7fbba0ae8640 1 --2- 172.21.15.73:0/3300686885 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fbb8806ae70 0x7fbb8806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:55.604 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:55.603+0000 7fbba0ae8640 1 --2- 172.21.15.73:0/3300686885 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fbb8806ae70 0x7fbb8806d330 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fbb98036000 tx=0x7fbb9802e070 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:46:55.608 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:55.606+0000 7fbb917fa640 1 -- 172.21.15.73:0/3300686885 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fbb8c054260 con 0x7fbb9c0ab740 2023-12-12T09:46:55.799 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:55.797+0000 7fbba2d4c640 1 -- 172.21.15.73:0/3300686885 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fbb9c0a9b60 con 0x7fbb9c0ab740 2023-12-12T09:46:55.800 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:55.798+0000 7fbb917fa640 1 -- 172.21.15.73:0/3300686885 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v79) v1 ==== 104+0+11 (secure 0 0 0) 0x7fbb8c057880 con 0x7fbb9c0ab740 2023-12-12T09:46:55.800 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 32 2023-12-12T09:46:55.803 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:55.801+0000 7fbba2d4c640 1 -- 172.21.15.73:0/3300686885 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fbb8806ae70 msgr2=0x7fbb8806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:55.803 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:55.801+0000 7fbba2d4c640 1 --2- 172.21.15.73:0/3300686885 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fbb8806ae70 0x7fbb8806d330 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fbb98036000 tx=0x7fbb9802e070 comp rx=0 tx=0).stop 2023-12-12T09:46:55.803 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:55.801+0000 7fbba2d4c640 1 -- 172.21.15.73:0/3300686885 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbb9c0ab740 msgr2=0x7fbb9c0aa220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:55.803 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:55.801+0000 7fbba2d4c640 1 --2- 172.21.15.73:0/3300686885 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbb9c0ab740 0x7fbb9c0aa220 secure :-1 s=READY pgs=979 cs=0 l=1 rev1=1 crypto rx=0x7fbb8c00c500 tx=0x7fbb8c00c9c0 comp rx=0 tx=0).stop 2023-12-12T09:46:55.803 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:55.801+0000 7fbba2d4c640 1 -- 172.21.15.73:0/3300686885 shutdown_connections 2023-12-12T09:46:55.803 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:55.801+0000 7fbba2d4c640 1 --2- 172.21.15.73:0/3300686885 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fbb8806ae70 0x7fbb8806d330 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:55.803 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:55.801+0000 7fbba2d4c640 1 --2- 172.21.15.73:0/3300686885 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbb9c0aa760 0x7fbb9c1473e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:55.803 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:55.801+0000 7fbba2d4c640 1 --2- 172.21.15.73:0/3300686885 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbb9c0ab740 0x7fbb9c0aa220 unknown :-1 s=CLOSED pgs=979 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:55.803 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:55.801+0000 7fbba2d4c640 1 --2- 172.21.15.73:0/3300686885 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbb840039a0 0x7fbb9c1e8fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:55.803 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:55.801+0000 7fbba2d4c640 1 -- 172.21.15.73:0/3300686885 >> 172.21.15.73:0/3300686885 conn(0x7fbb9c0c36d0 msgr2=0x7fbb9c150bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:46:55.803 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:55.801+0000 7fbba2d4c640 1 -- 172.21.15.73:0/3300686885 shutdown_connections 2023-12-12T09:46:55.804 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:55.801+0000 7fbba2d4c640 1 -- 172.21.15.73:0/3300686885 wait complete. 2023-12-12T09:46:55.820 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-12T09:46:56.027 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:56.025+0000 7f760e07c640 1 Processor -- start 2023-12-12T09:46:56.027 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:56.025+0000 7f760e07c640 1 -- start start 2023-12-12T09:46:56.028 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:56.027+0000 7f760e07c640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f76080a4c90 0x7f76080c5420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:56.028 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:56.027+0000 7f760e07c640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f76080c0320 0x7f76080c20b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:56.028 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:56.027+0000 7f760e07c640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76080c3390 con 0x7f760814ea60 2023-12-12T09:46:56.028 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:56.027+0000 7f760e07c640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76080c4b30 con 0x7f76080c0320 2023-12-12T09:46:56.028 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:56.027+0000 7f760e07c640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7608151e60 con 0x7f76080a4c90 2023-12-12T09:46:56.029 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:56.027+0000 7f75fffff640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f76080a4c90 0x7f76080c5420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:56.029 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:56.027+0000 7f75fffff640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f76080a4c90 0x7f76080c5420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.73:43306/0 (socket says 172.21.15.73:43306) 2023-12-12T09:46:56.029 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:56.027+0000 7f75fffff640 1 -- 172.21.15.73:0/2970345879 learned_addr learned my addr 172.21.15.73:0/2970345879 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:46:56.029 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:56.028+0000 7f7607fff640 1 --2- 172.21.15.73:0/2970345879 >> v2:172.21.15.142:3300/0 conn(0x7f76080c0320 0x7f76080c20b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:56.030 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:56.028+0000 7f7607fff640 1 -- 172.21.15.73:0/2970345879 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f76080a4c90 msgr2=0x7f76080c5420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:46:56.030 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:56.028+0000 7f7607fff640 1 --2- 172.21.15.73:0/2970345879 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f76080a4c90 0x7f76080c5420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:56.030 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:56.028+0000 7f7607fff640 1 -- 172.21.15.73:0/2970345879 >> v1:172.21.15.142:6789/0 conn(0x7f760814ea60 legacy=0x7f76080c4420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:56.030 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:56.028+0000 7f7607fff640 1 -- 172.21.15.73:0/2970345879 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7608152140 con 0x7f76080c0320 2023-12-12T09:46:56.030 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:56.028+0000 7f75fffff640 1 --2- 172.21.15.73:0/2970345879 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f76080a4c90 0x7f76080c5420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-12T09:46:56.031 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:56.030+0000 7f7607fff640 1 --2- 172.21.15.73:0/2970345879 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f76080c0320 0x7f76080c20b0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f7600009d90 tx=0x7f760002be10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=73329c55b2a2af9f server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:46:56.032 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:56.031+0000 7f7606ffd640 1 -- 172.21.15.73:0/2970345879 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f760002cbc0 con 0x7f76080c0320 2023-12-12T09:46:56.032 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:56.031+0000 7f7606ffd640 1 -- 172.21.15.73:0/2970345879 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f760002cd20 con 0x7f76080c0320 2023-12-12T09:46:56.032 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:56.031+0000 7f7606ffd640 1 -- 172.21.15.73:0/2970345879 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7600034660 con 0x7f76080c0320 2023-12-12T09:46:56.033 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:56.031+0000 7f760e07c640 1 -- 172.21.15.73:0/2970345879 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f76080c0320 msgr2=0x7f76080c20b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:56.033 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:56.031+0000 7f760e07c640 1 --2- 172.21.15.73:0/2970345879 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f76080c0320 0x7f76080c20b0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f7600009d90 tx=0x7f760002be10 comp rx=0 tx=0).stop 2023-12-12T09:46:56.033 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:56.031+0000 7f760e07c640 1 -- 172.21.15.73:0/2970345879 shutdown_connections 2023-12-12T09:46:56.033 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:56.031+0000 7f760e07c640 1 --2- 172.21.15.73:0/2970345879 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f76080a4c90 0x7f76080c5420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:56.033 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:56.031+0000 7f760e07c640 1 --2- 172.21.15.73:0/2970345879 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f76080c0320 0x7f76080c20b0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:56.033 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:56.031+0000 7f760e07c640 1 -- 172.21.15.73:0/2970345879 >> 172.21.15.73:0/2970345879 conn(0x7f760806a4e0 msgr2=0x7f760806a8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:46:56.033 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:56.032+0000 7f760e07c640 1 -- 172.21.15.73:0/2970345879 shutdown_connections 2023-12-12T09:46:56.033 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:56.032+0000 7f760e07c640 1 -- 172.21.15.73:0/2970345879 wait complete. 2023-12-12T09:46:56.035 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:56.033+0000 7f760e07c640 1 Processor -- start 2023-12-12T09:46:56.035 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:56.033+0000 7f760e07c640 1 -- start start 2023-12-12T09:46:56.038 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:56.034+0000 7f760e07c640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f76080a4c90 0x7f760814d650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:56.038 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:56.034+0000 7f760e07c640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f76080c0320 0x7f76081ea4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:56.038 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:56.034+0000 7f760e07c640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f760814ea60 0x7f76081da550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:56.038 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:56.034+0000 7f760e07c640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f760814c570 con 0x7f760814ea60 2023-12-12T09:46:56.038 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:56.034+0000 7f760e07c640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76081e9aa0 con 0x7f76080c0320 2023-12-12T09:46:56.038 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:56.034+0000 7f760e07c640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f760814c1c0 con 0x7f76080a4c90 2023-12-12T09:46:56.038 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:56.034+0000 7f7607fff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f760814ea60 0x7f76081da550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:56.038 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:56.035+0000 7f7607fff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f760814ea60 0x7f76081da550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:40106/0 (socket says 172.21.15.73:40106) 2023-12-12T09:46:56.038 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:56.035+0000 7f7607fff640 1 -- 172.21.15.73:0/3553462980 learned_addr learned my addr 172.21.15.73:0/3553462980 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:46:56.038 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:56.035+0000 7f75fffff640 1 --2- 172.21.15.73:0/3553462980 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f76080c0320 0x7f76081ea4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:56.039 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:56.035+0000 7f76077fe640 1 --2- 172.21.15.73:0/3553462980 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f76080a4c90 0x7f760814d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:56.039 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:56.035+0000 7f7607fff640 1 -- 172.21.15.73:0/3553462980 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f76080a4c90 msgr2=0x7f760814d650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:56.039 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:56.035+0000 7f7607fff640 1 --2- 172.21.15.73:0/3553462980 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f76080a4c90 0x7f760814d650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:56.039 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:56.035+0000 7f7607fff640 1 -- 172.21.15.73:0/3553462980 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f76080c0320 msgr2=0x7f76081ea4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:56.039 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:56.035+0000 7f7607fff640 1 --2- 172.21.15.73:0/3553462980 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f76080c0320 0x7f76081ea4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:56.039 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:56.035+0000 7f7607fff640 1 -- 172.21.15.73:0/3553462980 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75f00094d0 con 0x7f760814ea60 2023-12-12T09:46:56.039 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:56.035+0000 7f75fffff640 1 --2- 172.21.15.73:0/3553462980 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f76080c0320 0x7f76081ea4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:46:56.039 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:56.035+0000 7f7607fff640 1 --2- 172.21.15.73:0/3553462980 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f760814ea60 0x7f76081da550 secure :-1 s=READY pgs=980 cs=0 l=1 rev1=1 crypto rx=0x7f7600009d90 tx=0x7f7600004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:46:56.039 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:56.036+0000 7f7604ff9640 1 -- 172.21.15.73:0/3553462980 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7600040650 con 0x7f760814ea60 2023-12-12T09:46:56.039 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:56.036+0000 7f7604ff9640 1 -- 172.21.15.73:0/3553462980 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f760002ce90 con 0x7f760814ea60 2023-12-12T09:46:56.039 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:56.036+0000 7f7604ff9640 1 -- 172.21.15.73:0/3553462980 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76000409f0 con 0x7f760814ea60 2023-12-12T09:46:56.039 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:56.036+0000 7f760e07c640 1 -- 172.21.15.73:0/3553462980 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7600009a70 con 0x7f760814ea60 2023-12-12T09:46:56.039 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:56.036+0000 7f760e07c640 1 -- 172.21.15.73:0/3553462980 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f760814bc00 con 0x7f760814ea60 2023-12-12T09:46:56.040 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:56.037+0000 7f760e07c640 1 -- 172.21.15.73:0/3553462980 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7608067050 con 0x7f760814ea60 2023-12-12T09:46:56.040 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:56.038+0000 7f7604ff9640 1 -- 172.21.15.73:0/3553462980 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f7600040b50 con 0x7f760814ea60 2023-12-12T09:46:56.041 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:56.039+0000 7f7604ff9640 1 --2- 172.21.15.73:0/3553462980 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f75e806ae40 0x7f75e806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:56.041 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:56.039+0000 7f7604ff9640 1 -- 172.21.15.73:0/3553462980 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f76000ac5d0 con 0x7f760814ea60 2023-12-12T09:46:56.041 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:56.039+0000 7f76077fe640 1 --2- 172.21.15.73:0/3553462980 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f75e806ae40 0x7f75e806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:56.041 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:56.040+0000 7f76077fe640 1 --2- 172.21.15.73:0/3553462980 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f75e806ae40 0x7f75e806d300 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f75f8000f60 tx=0x7f75f8009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:46:56.045 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:56.044+0000 7f7604ff9640 1 -- 172.21.15.73:0/3553462980 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f7600077310 con 0x7f760814ea60 2023-12-12T09:46:56.231 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:56.230+0000 7f760e07c640 1 -- 172.21.15.73:0/3553462980 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f7608067580 con 0x7f760814ea60 2023-12-12T09:46:56.232 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:56.230+0000 7f7604ff9640 1 -- 172.21.15.73:0/3553462980 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v79) v1 ==== 100+0+11 (secure 0 0 0) 0x7f760007fe60 con 0x7f760814ea60 2023-12-12T09:46:56.232 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 64 2023-12-12T09:46:56.234 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:56.232+0000 7f760e07c640 1 -- 172.21.15.73:0/3553462980 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f75e806ae40 msgr2=0x7f75e806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:56.235 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:56.232+0000 7f760e07c640 1 --2- 172.21.15.73:0/3553462980 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f75e806ae40 0x7f75e806d300 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f75f8000f60 tx=0x7f75f8009040 comp rx=0 tx=0).stop 2023-12-12T09:46:56.235 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:56.232+0000 7f760e07c640 1 -- 172.21.15.73:0/3553462980 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f760814ea60 msgr2=0x7f76081da550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:56.235 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:56.232+0000 7f760e07c640 1 --2- 172.21.15.73:0/3553462980 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f760814ea60 0x7f76081da550 secure :-1 s=READY pgs=980 cs=0 l=1 rev1=1 crypto rx=0x7f7600009d90 tx=0x7f7600004a40 comp rx=0 tx=0).stop 2023-12-12T09:46:56.235 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:56.233+0000 7f760e07c640 1 -- 172.21.15.73:0/3553462980 shutdown_connections 2023-12-12T09:46:56.235 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:56.233+0000 7f760e07c640 1 --2- 172.21.15.73:0/3553462980 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f75e806ae40 0x7f75e806d300 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:56.235 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:56.233+0000 7f760e07c640 1 --2- 172.21.15.73:0/3553462980 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f760814ea60 0x7f76081da550 unknown :-1 s=CLOSED pgs=980 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:56.235 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:56.233+0000 7f760e07c640 1 --2- 172.21.15.73:0/3553462980 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f76080c0320 0x7f76081ea4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:56.235 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:56.233+0000 7f760e07c640 1 --2- 172.21.15.73:0/3553462980 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f76080a4c90 0x7f760814d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:56.235 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:56.233+0000 7f760e07c640 1 -- 172.21.15.73:0/3553462980 >> 172.21.15.73:0/3553462980 conn(0x7f760806a4e0 msgr2=0x7f760806a8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:46:56.235 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:56.233+0000 7f760e07c640 1 -- 172.21.15.73:0/3553462980 shutdown_connections 2023-12-12T09:46:56.236 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:56.233+0000 7f760e07c640 1 -- 172.21.15.73:0/3553462980 wait complete. 2023-12-12T09:46:56.252 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_metadata pg_num 2023-12-12T09:46:56.458 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:56.456+0000 7fa8562cf640 1 Processor -- start 2023-12-12T09:46:56.458 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:56.457+0000 7fa8562cf640 1 -- start start 2023-12-12T09:46:56.460 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:56.458+0000 7fa8562cf640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa8500c7ed0 0x7fa8500c6ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:56.460 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:56.458+0000 7fa8562cf640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fa8501550a0 0x7fa85015efa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:56.460 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:56.458+0000 7fa8562cf640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8500c8330 con 0x7fa8500c67c0 2023-12-12T09:46:56.460 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:56.458+0000 7fa8562cf640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa85006c890 con 0x7fa8501550a0 2023-12-12T09:46:56.460 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:56.458+0000 7fa8562cf640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8500c4af0 con 0x7fa8500c7ed0 2023-12-12T09:46:56.461 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:56.458+0000 7fa85486c640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fa8501550a0 0x7fa85015efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:56.461 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:56.458+0000 7fa85486c640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fa8501550a0 0x7fa85015efa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:40108/0 (socket says 172.21.15.73:40108) 2023-12-12T09:46:56.461 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:56.458+0000 7fa85486c640 1 -- 172.21.15.73:0/1946399954 learned_addr learned my addr 172.21.15.73:0/1946399954 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:46:56.461 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:56.459+0000 7fa84f7fe640 1 --2- 172.21.15.73:0/1946399954 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa8500c7ed0 0x7fa8500c6ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:56.461 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:56.459+0000 7fa85486c640 1 -- 172.21.15.73:0/1946399954 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa8500c7ed0 msgr2=0x7fa8500c6ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:46:56.461 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:56.459+0000 7fa85486c640 1 --2- 172.21.15.73:0/1946399954 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa8500c7ed0 0x7fa8500c6ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:56.461 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:56.459+0000 7fa85486c640 1 -- 172.21.15.73:0/1946399954 >> v1:172.21.15.142:6789/0 conn(0x7fa8500c67c0 legacy=0x7fa85006c180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:46:56.461 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:56.459+0000 7fa85486c640 1 -- 172.21.15.73:0/1946399954 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8500c4dd0 con 0x7fa8501550a0 2023-12-12T09:46:56.462 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:56.460+0000 7fa85486c640 1 --2- 172.21.15.73:0/1946399954 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa8501550a0 0x7fa85015efa0 secure :-1 s=READY pgs=981 cs=0 l=1 rev1=1 crypto rx=0x7fa848009870 tx=0x7fa84802b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4ca38685d54e068 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:46:56.462 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:56.460+0000 7fa84effd640 1 -- 172.21.15.73:0/1946399954 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa848031640 con 0x7fa8501550a0 2023-12-12T09:46:56.462 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:56.460+0000 7fa84effd640 1 -- 172.21.15.73:0/1946399954 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8480317a0 con 0x7fa8501550a0 2023-12-12T09:46:56.462 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:56.460+0000 7fa84effd640 1 -- 172.21.15.73:0/1946399954 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa848031b30 con 0x7fa8501550a0 2023-12-12T09:46:56.463 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:56.461+0000 7fa8562cf640 1 -- 172.21.15.73:0/1946399954 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa8501550a0 msgr2=0x7fa85015efa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:56.463 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:56.461+0000 7fa8562cf640 1 --2- 172.21.15.73:0/1946399954 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa8501550a0 0x7fa85015efa0 secure :-1 s=READY pgs=981 cs=0 l=1 rev1=1 crypto rx=0x7fa848009870 tx=0x7fa84802b8f0 comp rx=0 tx=0).stop 2023-12-12T09:46:56.463 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:56.461+0000 7fa8562cf640 1 -- 172.21.15.73:0/1946399954 shutdown_connections 2023-12-12T09:46:56.463 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:56.461+0000 7fa8562cf640 1 --2- 172.21.15.73:0/1946399954 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa8501550a0 0x7fa85015efa0 unknown :-1 s=CLOSED pgs=981 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:56.463 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:56.461+0000 7fa8562cf640 1 --2- 172.21.15.73:0/1946399954 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa8500c7ed0 0x7fa8500c6ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:56.463 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:56.461+0000 7fa8562cf640 1 -- 172.21.15.73:0/1946399954 >> 172.21.15.73:0/1946399954 conn(0x7fa8500abb20 msgr2=0x7fa8500abf30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:46:56.463 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:56.461+0000 7fa8562cf640 1 -- 172.21.15.73:0/1946399954 shutdown_connections 2023-12-12T09:46:56.463 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:56.461+0000 7fa8562cf640 1 -- 172.21.15.73:0/1946399954 wait complete. 2023-12-12T09:46:56.464 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:56.463+0000 7fa8562cf640 1 Processor -- start 2023-12-12T09:46:56.464 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:56.463+0000 7fa8562cf640 1 -- start start 2023-12-12T09:46:56.466 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:56.464+0000 7fa8562cf640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa8500c67c0 0x7fa850145320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:56.466 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:56.464+0000 7fa8562cf640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa8500c7ed0 0x7fa8501ed360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:56.466 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:56.464+0000 7fa8562cf640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa8501550a0 0x7fa8500ad4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:56.466 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:56.464+0000 7fa8562cf640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa850145860 con 0x7fa8501550a0 2023-12-12T09:46:56.466 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:56.464+0000 7fa8562cf640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa850145080 con 0x7fa8500c7ed0 2023-12-12T09:46:56.466 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:56.464+0000 7fa8562cf640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8501edc30 con 0x7fa8500c67c0 2023-12-12T09:46:56.466 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:56.464+0000 7fa85486c640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa8501550a0 0x7fa8500ad4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:56.467 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:56.464+0000 7fa85486c640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa8501550a0 0x7fa8500ad4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:40110/0 (socket says 172.21.15.73:40110) 2023-12-12T09:46:56.467 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:56.464+0000 7fa85486c640 1 -- 172.21.15.73:0/157476263 learned_addr learned my addr 172.21.15.73:0/157476263 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:46:56.467 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:56.464+0000 7fa85486c640 1 -- 172.21.15.73:0/157476263 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa8500c67c0 msgr2=0x7fa850145320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:56.467 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:56.464+0000 7fa84ffff640 1 --2- 172.21.15.73:0/157476263 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa8500c67c0 0x7fa850145320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:56.467 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:56.464+0000 7fa85486c640 1 --2- 172.21.15.73:0/157476263 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa8500c67c0 0x7fa850145320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:56.467 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:56.464+0000 7fa84f7fe640 1 --2- 172.21.15.73:0/157476263 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa8500c7ed0 0x7fa8501ed360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:56.467 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:56.464+0000 7fa85486c640 1 -- 172.21.15.73:0/157476263 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa8500c7ed0 msgr2=0x7fa8501ed360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:56.467 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:56.464+0000 7fa85486c640 1 --2- 172.21.15.73:0/157476263 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa8500c7ed0 0x7fa8501ed360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:56.467 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:56.465+0000 7fa85486c640 1 -- 172.21.15.73:0/157476263 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8480094d0 con 0x7fa8501550a0 2023-12-12T09:46:56.467 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:56.465+0000 7fa84ffff640 1 --2- 172.21.15.73:0/157476263 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa8500c67c0 0x7fa850145320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:46:56.467 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:56.465+0000 7fa85486c640 1 --2- 172.21.15.73:0/157476263 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa8501550a0 0x7fa8500ad4e0 secure :-1 s=READY pgs=982 cs=0 l=1 rev1=1 crypto rx=0x7fa848009870 tx=0x7fa8480046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:46:56.468 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:56.465+0000 7fa84cff9640 1 -- 172.21.15.73:0/157476263 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa84803ac60 con 0x7fa8501550a0 2023-12-12T09:46:56.468 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:56.465+0000 7fa84cff9640 1 -- 172.21.15.73:0/157476263 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa84803ade0 con 0x7fa8501550a0 2023-12-12T09:46:56.468 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:56.465+0000 7fa84cff9640 1 -- 172.21.15.73:0/157476263 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa848044630 con 0x7fa8501550a0 2023-12-12T09:46:56.468 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:56.465+0000 7fa8562cf640 1 -- 172.21.15.73:0/157476263 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8501eded0 con 0x7fa8501550a0 2023-12-12T09:46:56.468 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:56.465+0000 7fa8562cf640 1 -- 172.21.15.73:0/157476263 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8501ed8a0 con 0x7fa8501550a0 2023-12-12T09:46:56.468 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:56.466+0000 7fa8562cf640 1 -- 172.21.15.73:0/157476263 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8501eda30 con 0x7fa8501550a0 2023-12-12T09:46:56.469 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:56.467+0000 7fa84cff9640 1 -- 172.21.15.73:0/157476263 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fa84802f050 con 0x7fa8501550a0 2023-12-12T09:46:56.469 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:56.468+0000 7fa84cff9640 1 --2- 172.21.15.73:0/157476263 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fa83006ae70 0x7fa83006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:56.469 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:56.468+0000 7fa84cff9640 1 -- 172.21.15.73:0/157476263 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fa8480ab820 con 0x7fa8501550a0 2023-12-12T09:46:56.470 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:56.468+0000 7fa84ffff640 1 --2- 172.21.15.73:0/157476263 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fa83006ae70 0x7fa83006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:56.470 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:56.469+0000 7fa84ffff640 1 --2- 172.21.15.73:0/157476263 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fa83006ae70 0x7fa83006d330 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fa8500c4190 tx=0x7fa838009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:46:56.474 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:56.473+0000 7fa84cff9640 1 -- 172.21.15.73:0/157476263 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fa8480764d0 con 0x7fa8501550a0 2023-12-12T09:46:56.663 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:56.661+0000 7fa8562cf640 1 -- 172.21.15.73:0/157476263 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"} v 0) v1 -- 0x7fa8500be0a0 con 0x7fa8501550a0 2023-12-12T09:46:56.664 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:56.662+0000 7fa84cff9640 1 -- 172.21.15.73:0/157476263 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"}]=0 v79) v1 ==== 105+0+11 (secure 0 0 0) 0x7fa8500be0a0 con 0x7fa8501550a0 2023-12-12T09:46:56.664 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 32 2023-12-12T09:46:56.666 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:56.665+0000 7fa8562cf640 1 -- 172.21.15.73:0/157476263 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fa83006ae70 msgr2=0x7fa83006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:56.666 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:56.665+0000 7fa8562cf640 1 --2- 172.21.15.73:0/157476263 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fa83006ae70 0x7fa83006d330 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fa8500c4190 tx=0x7fa838009040 comp rx=0 tx=0).stop 2023-12-12T09:46:56.666 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:56.665+0000 7fa8562cf640 1 -- 172.21.15.73:0/157476263 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa8501550a0 msgr2=0x7fa8500ad4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:56.667 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:56.665+0000 7fa8562cf640 1 --2- 172.21.15.73:0/157476263 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa8501550a0 0x7fa8500ad4e0 secure :-1 s=READY pgs=982 cs=0 l=1 rev1=1 crypto rx=0x7fa848009870 tx=0x7fa8480046c0 comp rx=0 tx=0).stop 2023-12-12T09:46:56.667 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:56.665+0000 7fa8562cf640 1 -- 172.21.15.73:0/157476263 shutdown_connections 2023-12-12T09:46:56.667 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:56.665+0000 7fa8562cf640 1 --2- 172.21.15.73:0/157476263 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fa83006ae70 0x7fa83006d330 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:56.667 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:56.665+0000 7fa8562cf640 1 --2- 172.21.15.73:0/157476263 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa8501550a0 0x7fa8500ad4e0 unknown :-1 s=CLOSED pgs=982 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:56.667 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:56.665+0000 7fa8562cf640 1 --2- 172.21.15.73:0/157476263 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa8500c7ed0 0x7fa8501ed360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:56.667 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:56.665+0000 7fa8562cf640 1 --2- 172.21.15.73:0/157476263 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa8500c67c0 0x7fa850145320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:56.667 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:56.665+0000 7fa8562cf640 1 -- 172.21.15.73:0/157476263 >> 172.21.15.73:0/157476263 conn(0x7fa8500abb20 msgr2=0x7fa8500aa060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:46:56.668 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:56.665+0000 7fa8562cf640 1 -- 172.21.15.73:0/157476263 shutdown_connections 2023-12-12T09:46:56.668 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:56.665+0000 7fa8562cf640 1 -- 172.21.15.73:0/157476263 wait complete. 2023-12-12T09:46:56.684 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_data pg_num 2023-12-12T09:46:56.898 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:56.896+0000 7f3b40b2c640 1 Processor -- start 2023-12-12T09:46:56.898 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:56.896+0000 7f3b40b2c640 1 -- start start 2023-12-12T09:46:56.903 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:56.897+0000 7f3b40b2c640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f3b3c0c3930 0x7f3b3c06d440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:56.903 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:56.898+0000 7f3b40b2c640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b3c1582e0 con 0x7f3b3c151c30 2023-12-12T09:46:56.903 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:56.898+0000 7f3b40b2c640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b3c0a4f50 con 0x7f3b3c0bed50 2023-12-12T09:46:56.903 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:56.898+0000 7f3b40b2c640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b3c0a54d0 con 0x7f3b3c0c3930 2023-12-12T09:46:56.904 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:56.898+0000 7f3b3a59c640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f3b3c151c30 0x7f3b3c157bd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:51676/0 (socket says 172.21.15.73:51676) 2023-12-12T09:46:56.904 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:56.898+0000 7f3b3a59c640 1 -- 172.21.15.73:0/2175905079 learned_addr learned my addr 172.21.15.73:0/2175905079 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-12T09:46:56.904 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:56.898+0000 7f3b3959a640 1 -- 172.21.15.73:0/2175905079 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4143815668 0 0) 0x7f3b3c1582e0 con 0x7f3b3c151c30 2023-12-12T09:46:56.904 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:56.898+0000 7f3b3959a640 1 -- 172.21.15.73:0/2175905079 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3b24003520 con 0x7f3b3c151c30 2023-12-12T09:46:56.904 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:56.898+0000 7f3b39d9b640 1 --2- 172.21.15.73:0/2175905079 >> v2:172.21.15.142:3300/0 conn(0x7f3b3c0c3930 0x7f3b3c06d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:56.904 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:56.899+0000 7f3b3959a640 1 -- 172.21.15.73:0/2175905079 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3574489784 0 0) 0x7f3b24003520 con 0x7f3b3c151c30 2023-12-12T09:46:56.904 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:56.899+0000 7f3b3959a640 1 -- 172.21.15.73:0/2175905079 >> v2:172.21.15.142:3300/0 conn(0x7f3b3c0c3930 msgr2=0x7f3b3c06d440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:46:56.904 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:56.899+0000 7f3b3959a640 1 --2- 172.21.15.73:0/2175905079 >> v2:172.21.15.142:3300/0 conn(0x7f3b3c0c3930 0x7f3b3c06d440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:56.904 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:56.899+0000 7f3b3959a640 1 -- 172.21.15.73:0/2175905079 >> v1:172.21.15.142:6789/0 conn(0x7f3b3c0bed50 legacy=0x7f3b3c0bf160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:56.904 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:56.899+0000 7f3b3959a640 1 -- 172.21.15.73:0/2175905079 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b3c155260 con 0x7f3b3c151c30 2023-12-12T09:46:56.904 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:56.899+0000 7f3b3959a640 1 -- 172.21.15.73:0/2175905079 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3186547832 0 0) 0x7f3b2c001670 con 0x7f3b3c151c30 2023-12-12T09:46:56.904 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:56.899+0000 7f3b3959a640 1 -- 172.21.15.73:0/2175905079 >> v1:172.21.15.73:6789/0 conn(0x7f3b3c151c30 legacy=0x7f3b3c157bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:56.904 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:56.899+0000 7f3b3959a640 1 --2- 172.21.15.73:0/2175905079 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3b24003970 0x7f3b24003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:56.904 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:56.899+0000 7f3b3959a640 1 --2- 172.21.15.73:0/2175905079 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3b240047c0 0x7f3b24004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:56.905 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:56.899+0000 7f3b3959a640 1 --2- 172.21.15.73:0/2175905079 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3b240052a0 0x7f3b2400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:56.905 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:56.899+0000 7f3b3959a640 1 -- 172.21.15.73:0/2175905079 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b3c0a54d0 con 0x7f3b24003970 2023-12-12T09:46:56.905 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:56.899+0000 7f3b3959a640 1 -- 172.21.15.73:0/2175905079 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b2400c170 con 0x7f3b240052a0 2023-12-12T09:46:56.905 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:56.899+0000 7f3b3959a640 1 -- 172.21.15.73:0/2175905079 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b2400c330 con 0x7f3b240047c0 2023-12-12T09:46:56.905 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:56.899+0000 7f3b3a59c640 1 --2- 172.21.15.73:0/2175905079 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3b24003970 0x7f3b24003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:56.905 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:56.900+0000 7f3b39d9b640 1 --2- 172.21.15.73:0/2175905079 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3b240047c0 0x7f3b24004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:56.905 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:56.900+0000 7f3b3a59c640 1 -- 172.21.15.73:0/2175905079 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3b240047c0 msgr2=0x7f3b24004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:46:56.905 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:56.900+0000 7f3b3a59c640 1 --2- 172.21.15.73:0/2175905079 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3b240047c0 0x7f3b24004c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:56.905 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:56.900+0000 7f3b3a59c640 1 -- 172.21.15.73:0/2175905079 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3b240052a0 msgr2=0x7f3b2400b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:46:56.905 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:56.900+0000 7f3b3ad9d640 1 --2- 172.21.15.73:0/2175905079 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3b240052a0 0x7f3b2400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:56.905 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:56.900+0000 7f3b3a59c640 1 --2- 172.21.15.73:0/2175905079 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3b240052a0 0x7f3b2400b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:56.905 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:56.900+0000 7f3b3a59c640 1 -- 172.21.15.73:0/2175905079 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b24003520 con 0x7f3b24003970 2023-12-12T09:46:56.905 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:56.900+0000 7f3b3ad9d640 1 --2- 172.21.15.73:0/2175905079 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3b240052a0 0x7f3b2400b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:46:56.906 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:56.900+0000 7f3b3ad9d640 1 -- 172.21.15.73:0/2175905079 reap_dead start 2023-12-12T09:46:56.906 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:56.901+0000 7f3b3a59c640 1 --2- 172.21.15.73:0/2175905079 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3b24003970 0x7f3b24003d90 secure :-1 s=READY pgs=984 cs=0 l=1 rev1=1 crypto rx=0x7f3b2c00c210 tx=0x7f3b240057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=252fd675ba92c7e8 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:46:56.906 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:56.901+0000 7f3b3959a640 1 -- 172.21.15.73:0/2175905079 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b2c005ad0 con 0x7f3b24003970 2023-12-12T09:46:56.906 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:56.901+0000 7f3b3959a640 1 -- 172.21.15.73:0/2175905079 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b2c005c30 con 0x7f3b24003970 2023-12-12T09:46:56.906 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:56.901+0000 7f3b3959a640 1 -- 172.21.15.73:0/2175905079 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b2c02cad0 con 0x7f3b24003970 2023-12-12T09:46:56.906 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:56.902+0000 7f3b40b2c640 1 -- 172.21.15.73:0/2175905079 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3b24003970 msgr2=0x7f3b24003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:56.906 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:56.902+0000 7f3b40b2c640 1 --2- 172.21.15.73:0/2175905079 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3b24003970 0x7f3b24003d90 secure :-1 s=READY pgs=984 cs=0 l=1 rev1=1 crypto rx=0x7f3b2c00c210 tx=0x7f3b240057f0 comp rx=0 tx=0).stop 2023-12-12T09:46:56.906 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:56.902+0000 7f3b40b2c640 1 -- 172.21.15.73:0/2175905079 shutdown_connections 2023-12-12T09:46:56.906 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:56.902+0000 7f3b40b2c640 1 --2- 172.21.15.73:0/2175905079 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3b24003970 0x7f3b24003d90 unknown :-1 s=CLOSED pgs=984 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:56.906 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:56.902+0000 7f3b40b2c640 1 -- 172.21.15.73:0/2175905079 >> 172.21.15.73:0/2175905079 conn(0x7f3b3c06a4e0 msgr2=0x7f3b3c06a8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:46:56.906 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:56.902+0000 7f3b40b2c640 1 -- 172.21.15.73:0/2175905079 shutdown_connections 2023-12-12T09:46:56.906 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:56.902+0000 7f3b40b2c640 1 -- 172.21.15.73:0/2175905079 wait complete. 2023-12-12T09:46:56.908 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:56.904+0000 7f3b40b2c640 1 Processor -- start 2023-12-12T09:46:56.908 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:56.904+0000 7f3b40b2c640 1 -- start start 2023-12-12T09:46:56.908 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:56.904+0000 7f3b40b2c640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3b24003970 0x7f3b3c14a640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:56.908 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:56.905+0000 7f3b40b2c640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3b3c157140 0x7f3b3c147e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:56.908 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:56.905+0000 7f3b40b2c640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3b3c1483d0 0x7f3b3c14d460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:56.909 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:56.905+0000 7f3b40b2c640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b3c1579f0 con 0x7f3b24003970 2023-12-12T09:46:56.909 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:56.905+0000 7f3b40b2c640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b3c1ede70 con 0x7f3b3c157140 2023-12-12T09:46:56.909 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:56.905+0000 7f3b40b2c640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b3c1ed0b0 con 0x7f3b3c1483d0 2023-12-12T09:46:56.909 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:56.905+0000 7f3b3a59c640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3b24003970 0x7f3b3c14a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:56.909 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:56.905+0000 7f3b3a59c640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3b24003970 0x7f3b3c14a640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:40116/0 (socket says 172.21.15.73:40116) 2023-12-12T09:46:56.909 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:56.905+0000 7f3b3a59c640 1 -- 172.21.15.73:0/4234721116 learned_addr learned my addr 172.21.15.73:0/4234721116 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:46:56.909 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:56.905+0000 7f3b3a59c640 1 -- 172.21.15.73:0/4234721116 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3b3c1483d0 msgr2=0x7f3b3c14d460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:56.909 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:56.905+0000 7f3b3a59c640 1 --2- 172.21.15.73:0/4234721116 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3b3c1483d0 0x7f3b3c14d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:56.909 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:56.905+0000 7f3b3a59c640 1 -- 172.21.15.73:0/4234721116 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3b3c157140 msgr2=0x7f3b3c147e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:56.909 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:56.905+0000 7f3b3a59c640 1 --2- 172.21.15.73:0/4234721116 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3b3c157140 0x7f3b3c147e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:56.909 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:56.905+0000 7f3b3a59c640 1 -- 172.21.15.73:0/4234721116 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b3c1ed390 con 0x7f3b24003970 2023-12-12T09:46:56.909 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:56.906+0000 7f3b3a59c640 1 --2- 172.21.15.73:0/4234721116 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3b24003970 0x7f3b3c14a640 secure :-1 s=READY pgs=985 cs=0 l=1 rev1=1 crypto rx=0x7f3b2c001930 tx=0x7f3b2c02e070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:46:56.909 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:56.906+0000 7f3b2affd640 1 -- 172.21.15.73:0/4234721116 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b2c03c040 con 0x7f3b24003970 2023-12-12T09:46:56.909 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:56.906+0000 7f3b2affd640 1 -- 172.21.15.73:0/4234721116 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b2c02cd60 con 0x7f3b24003970 2023-12-12T09:46:56.909 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:56.906+0000 7f3b40b2c640 1 -- 172.21.15.73:0/4234721116 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b3c1ed670 con 0x7f3b24003970 2023-12-12T09:46:56.910 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:56.906+0000 7f3b2affd640 1 -- 172.21.15.73:0/4234721116 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b2c0072b0 con 0x7f3b24003970 2023-12-12T09:46:56.910 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:56.906+0000 7f3b40b2c640 1 -- 172.21.15.73:0/4234721116 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b3c148850 con 0x7f3b24003970 2023-12-12T09:46:56.912 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:56.907+0000 7f3b40b2c640 1 -- 172.21.15.73:0/4234721116 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b3c067070 con 0x7f3b24003970 2023-12-12T09:46:56.912 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:56.908+0000 7f3b2affd640 1 -- 172.21.15.73:0/4234721116 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f3b2c032070 con 0x7f3b24003970 2023-12-12T09:46:56.912 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:56.909+0000 7f3b2affd640 1 --2- 172.21.15.73:0/4234721116 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f3b1c06ae70 0x7f3b1c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:56.912 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:56.910+0000 7f3b2affd640 1 -- 172.21.15.73:0/4234721116 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f3b2c0aaf00 con 0x7f3b24003970 2023-12-12T09:46:56.912 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:56.910+0000 7f3b39d9b640 1 --2- 172.21.15.73:0/4234721116 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f3b1c06ae70 0x7f3b1c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:56.912 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:56.910+0000 7f3b39d9b640 1 --2- 172.21.15.73:0/4234721116 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f3b1c06ae70 0x7f3b1c06d330 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f3b30006a90 tx=0x7f3b30006a20 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:46:56.915 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:56.914+0000 7f3b2affd640 1 -- 172.21.15.73:0/4234721116 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f3b2c075c40 con 0x7f3b24003970 2023-12-12T09:46:57.105 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:57.103+0000 7f3b40b2c640 1 -- 172.21.15.73:0/4234721116 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"} v 0) v1 -- 0x7f3b3c155540 con 0x7f3b24003970 2023-12-12T09:46:57.105 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:57.104+0000 7f3b2affd640 1 -- 172.21.15.73:0/4234721116 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"}]=0 v79) v1 ==== 101+0+11 (secure 0 0 0) 0x7f3b2c079260 con 0x7f3b24003970 2023-12-12T09:46:57.106 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 64 2023-12-12T09:46:57.108 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:57.106+0000 7f3b40b2c640 1 -- 172.21.15.73:0/4234721116 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f3b1c06ae70 msgr2=0x7f3b1c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:57.109 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:57.106+0000 7f3b40b2c640 1 --2- 172.21.15.73:0/4234721116 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f3b1c06ae70 0x7f3b1c06d330 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f3b30006a90 tx=0x7f3b30006a20 comp rx=0 tx=0).stop 2023-12-12T09:46:57.109 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:57.107+0000 7f3b40b2c640 1 -- 172.21.15.73:0/4234721116 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3b24003970 msgr2=0x7f3b3c14a640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:57.109 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:57.107+0000 7f3b40b2c640 1 --2- 172.21.15.73:0/4234721116 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3b24003970 0x7f3b3c14a640 secure :-1 s=READY pgs=985 cs=0 l=1 rev1=1 crypto rx=0x7f3b2c001930 tx=0x7f3b2c02e070 comp rx=0 tx=0).stop 2023-12-12T09:46:57.109 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:57.107+0000 7f3b40b2c640 1 -- 172.21.15.73:0/4234721116 shutdown_connections 2023-12-12T09:46:57.109 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:57.107+0000 7f3b40b2c640 1 --2- 172.21.15.73:0/4234721116 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f3b1c06ae70 0x7f3b1c06d330 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:57.109 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:57.107+0000 7f3b40b2c640 1 --2- 172.21.15.73:0/4234721116 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3b3c1483d0 0x7f3b3c14d460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:57.109 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:57.107+0000 7f3b40b2c640 1 --2- 172.21.15.73:0/4234721116 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3b3c157140 0x7f3b3c147e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:57.109 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:57.107+0000 7f3b40b2c640 1 --2- 172.21.15.73:0/4234721116 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3b24003970 0x7f3b3c14a640 unknown :-1 s=CLOSED pgs=985 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:57.109 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:57.107+0000 7f3b40b2c640 1 -- 172.21.15.73:0/4234721116 >> 172.21.15.73:0/4234721116 conn(0x7f3b3c06a4e0 msgr2=0x7f3b3c14eb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:46:57.109 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:57.107+0000 7f3b40b2c640 1 -- 172.21.15.73:0/4234721116 shutdown_connections 2023-12-12T09:46:57.109 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:57.107+0000 7f3b40b2c640 1 -- 172.21.15.73:0/4234721116 wait complete. 2023-12-12T09:46:57.127 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-12T09:46:57.327 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:57.325+0000 7f317349b640 1 Processor -- start 2023-12-12T09:46:57.327 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:57.326+0000 7f317349b640 1 -- start start 2023-12-12T09:46:57.328 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:57.327+0000 7f317349b640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f316c0bd470 0x7f316c06ba90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:57.328 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:57.327+0000 7f317349b640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f316c154650 con 0x7f316c0c7cc0 2023-12-12T09:46:57.328 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:57.327+0000 7f317349b640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f316c154930 con 0x7f316c151ce0 2023-12-12T09:46:57.328 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:57.327+0000 7f317349b640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f316c0c57b0 con 0x7f316c0bd470 2023-12-12T09:46:57.328 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:57.327+0000 7f3171a38640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f316c0c7cc0 0x7f316c06bfd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:51686/0 (socket says 172.21.15.73:51686) 2023-12-12T09:46:57.329 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:57.327+0000 7f3171a38640 1 -- 172.21.15.73:0/1004847393 learned_addr learned my addr 172.21.15.73:0/1004847393 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-12T09:46:57.330 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:57.327+0000 7f316bfff640 1 -- 172.21.15.73:0/1004847393 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4187330901 0 0) 0x7f316c154650 con 0x7f316c0c7cc0 2023-12-12T09:46:57.331 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:57.327+0000 7f316bfff640 1 -- 172.21.15.73:0/1004847393 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f315c003520 con 0x7f316c0c7cc0 2023-12-12T09:46:57.331 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:57.327+0000 7f3170a36640 1 --2- 172.21.15.73:0/1004847393 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f316c0bd470 0x7f316c06ba90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:57.331 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:57.328+0000 7f316bfff640 1 -- 172.21.15.73:0/1004847393 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 644978527 0 0) 0x7f315c003520 con 0x7f316c0c7cc0 2023-12-12T09:46:57.331 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:57.328+0000 7f316bfff640 1 -- 172.21.15.73:0/1004847393 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f316c0bd470 msgr2=0x7f316c06ba90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:46:57.331 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:57.328+0000 7f316bfff640 1 --2- 172.21.15.73:0/1004847393 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f316c0bd470 0x7f316c06ba90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:57.331 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:57.328+0000 7f316bfff640 1 -- 172.21.15.73:0/1004847393 >> v1:172.21.15.142:6789/0 conn(0x7f316c151ce0 legacy=0x7f316c0c67d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:57.331 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:57.328+0000 7f316bfff640 1 -- 172.21.15.73:0/1004847393 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f316c154c10 con 0x7f316c0c7cc0 2023-12-12T09:46:57.331 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:57.328+0000 7f316bfff640 1 -- 172.21.15.73:0/1004847393 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3186547832 0 0) 0x7f3164001670 con 0x7f316c0c7cc0 2023-12-12T09:46:57.331 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:57.328+0000 7f316bfff640 1 -- 172.21.15.73:0/1004847393 >> v1:172.21.15.73:6789/0 conn(0x7f316c0c7cc0 legacy=0x7f316c06bfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:57.331 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:57.328+0000 7f316bfff640 1 --2- 172.21.15.73:0/1004847393 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f315c0039a0 0x7f315c003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:57.331 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:57.328+0000 7f316bfff640 1 --2- 172.21.15.73:0/1004847393 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f315c0047c0 0x7f315c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:57.331 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:57.328+0000 7f316bfff640 1 --2- 172.21.15.73:0/1004847393 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f316c0bd470 0x7f315c00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:57.332 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:57.328+0000 7f316bfff640 1 -- 172.21.15.73:0/1004847393 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f316c0c57b0 con 0x7f315c0047c0 2023-12-12T09:46:57.332 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:57.328+0000 7f316bfff640 1 -- 172.21.15.73:0/1004847393 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f315c0054e0 con 0x7f315c0039a0 2023-12-12T09:46:57.332 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:57.328+0000 7f316bfff640 1 -- 172.21.15.73:0/1004847393 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f315c00bec0 con 0x7f316c0bd470 2023-12-12T09:46:57.332 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:57.328+0000 7f3170a36640 1 --2- 172.21.15.73:0/1004847393 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f315c0047c0 0x7f315c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:57.332 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:57.329+0000 7f3171a38640 1 --2- 172.21.15.73:0/1004847393 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f316c0bd470 0x7f315c00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:57.332 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:57.329+0000 7f3171237640 1 --2- 172.21.15.73:0/1004847393 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f315c0039a0 0x7f315c003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:57.332 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:57.329+0000 7f3170a36640 1 -- 172.21.15.73:0/1004847393 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f316c0bd470 msgr2=0x7f315c00b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:46:57.332 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:57.329+0000 7f3170a36640 1 --2- 172.21.15.73:0/1004847393 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f316c0bd470 0x7f315c00b980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:57.332 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:57.329+0000 7f3170a36640 1 -- 172.21.15.73:0/1004847393 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f315c0039a0 msgr2=0x7f315c003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:46:57.332 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:57.329+0000 7f3170a36640 1 --2- 172.21.15.73:0/1004847393 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f315c0039a0 0x7f315c003dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:57.332 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:57.329+0000 7f3170a36640 1 -- 172.21.15.73:0/1004847393 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f315c003520 con 0x7f315c0047c0 2023-12-12T09:46:57.334 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:57.330+0000 7f3170a36640 1 --2- 172.21.15.73:0/1004847393 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f315c0047c0 0x7f315c004c40 secure :-1 s=READY pgs=987 cs=0 l=1 rev1=1 crypto rx=0x7f316c0c0bd0 tx=0x7f315c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d63637cb2a3caf8b server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:46:57.334 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:57.330+0000 7f316bfff640 1 -- 172.21.15.73:0/1004847393 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3158033680 con 0x7f315c0047c0 2023-12-12T09:46:57.334 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:57.330+0000 7f316bfff640 1 -- 172.21.15.73:0/1004847393 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31580337e0 con 0x7f315c0047c0 2023-12-12T09:46:57.334 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:57.330+0000 7f316bfff640 1 -- 172.21.15.73:0/1004847393 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3158033b70 con 0x7f315c0047c0 2023-12-12T09:46:57.334 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:57.330+0000 7f317349b640 1 -- 172.21.15.73:0/1004847393 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f315c0047c0 msgr2=0x7f315c004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:57.334 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:57.330+0000 7f317349b640 1 --2- 172.21.15.73:0/1004847393 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f315c0047c0 0x7f315c004c40 secure :-1 s=READY pgs=987 cs=0 l=1 rev1=1 crypto rx=0x7f316c0c0bd0 tx=0x7f315c0057f0 comp rx=0 tx=0).stop 2023-12-12T09:46:57.334 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:57.331+0000 7f3171a38640 1 -- 172.21.15.73:0/1004847393 reap_dead start 2023-12-12T09:46:57.337 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:57.331+0000 7f317349b640 1 -- 172.21.15.73:0/1004847393 shutdown_connections 2023-12-12T09:46:57.337 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:57.331+0000 7f317349b640 1 -- 172.21.15.73:0/1004847393 >> 172.21.15.73:0/1004847393 conn(0x7f316c0ab950 msgr2=0x7f316c0abd30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:46:57.337 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:57.331+0000 7f317349b640 1 -- 172.21.15.73:0/1004847393 shutdown_connections 2023-12-12T09:46:57.337 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:57.331+0000 7f317349b640 1 -- 172.21.15.73:0/1004847393 wait complete. 2023-12-12T09:46:57.337 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:57.332+0000 7f317349b640 1 Processor -- start 2023-12-12T09:46:57.340 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:57.333+0000 7f317349b640 1 -- start start 2023-12-12T09:46:57.340 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:57.333+0000 7f317349b640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f315c0047c0 0x7f316c14b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:57.340 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:57.333+0000 7f317349b640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f316c157c70 0x7f316c1580f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:57.341 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:57.334+0000 7f317349b640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f316c149fd0 0x7f316c14a450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:57.341 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:57.334+0000 7f317349b640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f316c0c3460 con 0x7f316c149fd0 2023-12-12T09:46:57.341 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:57.334+0000 7f317349b640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f316c0bce50 con 0x7f316c157c70 2023-12-12T09:46:57.341 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:57.334+0000 7f317349b640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f316c1eaa70 con 0x7f315c0047c0 2023-12-12T09:46:57.341 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:57.334+0000 7f3171a38640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f316c149fd0 0x7f316c14a450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:57.341 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:57.334+0000 7f3171a38640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f316c149fd0 0x7f316c14a450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:40144/0 (socket says 172.21.15.73:40144) 2023-12-12T09:46:57.341 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:57.334+0000 7f3171a38640 1 -- 172.21.15.73:0/3272541392 learned_addr learned my addr 172.21.15.73:0/3272541392 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:46:57.341 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:57.334+0000 7f3171237640 1 --2- 172.21.15.73:0/3272541392 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f315c0047c0 0x7f316c14b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:57.341 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:57.334+0000 7f3170a36640 1 --2- 172.21.15.73:0/3272541392 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f316c157c70 0x7f316c1580f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:57.341 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:57.334+0000 7f3171a38640 1 -- 172.21.15.73:0/3272541392 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f315c0047c0 msgr2=0x7f316c14b1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:57.341 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:57.334+0000 7f3171a38640 1 --2- 172.21.15.73:0/3272541392 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f315c0047c0 0x7f316c14b1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:57.341 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:57.334+0000 7f3171a38640 1 -- 172.21.15.73:0/3272541392 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f316c157c70 msgr2=0x7f316c1580f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:57.341 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:57.334+0000 7f3171a38640 1 --2- 172.21.15.73:0/3272541392 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f316c157c70 0x7f316c1580f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:57.341 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:57.334+0000 7f3171a38640 1 -- 172.21.15.73:0/3272541392 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f316c14aec0 con 0x7f316c149fd0 2023-12-12T09:46:57.342 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:57.335+0000 7f3171a38640 1 --2- 172.21.15.73:0/3272541392 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f316c149fd0 0x7f316c14a450 secure :-1 s=READY pgs=988 cs=0 l=1 rev1=1 crypto rx=0x7f316c0c74e0 tx=0x7f316400dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:46:57.342 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:57.335+0000 7f3169ffb640 1 -- 172.21.15.73:0/3272541392 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3164007230 con 0x7f316c149fd0 2023-12-12T09:46:57.342 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:57.335+0000 7f3169ffb640 1 -- 172.21.15.73:0/3272541392 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3164007390 con 0x7f316c149fd0 2023-12-12T09:46:57.342 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:57.335+0000 7f3169ffb640 1 -- 172.21.15.73:0/3272541392 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31640047e0 con 0x7f316c149fd0 2023-12-12T09:46:57.342 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:57.335+0000 7f317349b640 1 -- 172.21.15.73:0/3272541392 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f316c0bd060 con 0x7f316c149fd0 2023-12-12T09:46:57.342 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:57.335+0000 7f317349b640 1 -- 172.21.15.73:0/3272541392 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f316c14a990 con 0x7f316c149fd0 2023-12-12T09:46:57.342 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:57.336+0000 7f317349b640 1 -- 172.21.15.73:0/3272541392 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f316c0bd250 con 0x7f316c149fd0 2023-12-12T09:46:57.342 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:57.337+0000 7f3169ffb640 1 -- 172.21.15.73:0/3272541392 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f3164004940 con 0x7f316c149fd0 2023-12-12T09:46:57.342 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:57.338+0000 7f3169ffb640 1 --2- 172.21.15.73:0/3272541392 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f315006ae40 0x7f315006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:57.342 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:57.338+0000 7f3169ffb640 1 -- 172.21.15.73:0/3272541392 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f31640896c0 con 0x7f316c149fd0 2023-12-12T09:46:57.342 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:57.338+0000 7f3171237640 1 --2- 172.21.15.73:0/3272541392 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f315006ae40 0x7f315006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:57.342 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:57.339+0000 7f3171237640 1 --2- 172.21.15.73:0/3272541392 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f315006ae40 0x7f315006d300 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f3160007fd0 tx=0x7f3160009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:46:57.344 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:57.343+0000 7f3169ffb640 1 -- 172.21.15.73:0/3272541392 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f3164054400 con 0x7f316c149fd0 2023-12-12T09:46:57.551 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:57.549+0000 7f317349b640 1 -- 172.21.15.73:0/3272541392 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f316c067580 con 0x7f316c149fd0 2023-12-12T09:46:57.551 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:57.550+0000 7f3169ffb640 1 -- 172.21.15.73:0/3272541392 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v79) v1 ==== 80+0+0 (secure 0 0 0) 0x7f3164057a20 con 0x7f316c149fd0 2023-12-12T09:46:57.551 INFO:teuthology.orchestra.run.smithi073.stderr:listed 0 entries 2023-12-12T09:46:57.554 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:57.552+0000 7f317349b640 1 -- 172.21.15.73:0/3272541392 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f315006ae40 msgr2=0x7f315006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:57.554 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:57.552+0000 7f317349b640 1 --2- 172.21.15.73:0/3272541392 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f315006ae40 0x7f315006d300 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f3160007fd0 tx=0x7f3160009040 comp rx=0 tx=0).stop 2023-12-12T09:46:57.554 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:57.552+0000 7f317349b640 1 -- 172.21.15.73:0/3272541392 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f316c149fd0 msgr2=0x7f316c14a450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:57.554 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:57.552+0000 7f317349b640 1 --2- 172.21.15.73:0/3272541392 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f316c149fd0 0x7f316c14a450 secure :-1 s=READY pgs=988 cs=0 l=1 rev1=1 crypto rx=0x7f316c0c74e0 tx=0x7f316400dc00 comp rx=0 tx=0).stop 2023-12-12T09:46:57.555 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:57.552+0000 7f317349b640 1 -- 172.21.15.73:0/3272541392 shutdown_connections 2023-12-12T09:46:57.555 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:57.552+0000 7f317349b640 1 --2- 172.21.15.73:0/3272541392 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f315006ae40 0x7f315006d300 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:57.555 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:57.552+0000 7f317349b640 1 --2- 172.21.15.73:0/3272541392 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f316c149fd0 0x7f316c14a450 unknown :-1 s=CLOSED pgs=988 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:57.555 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:57.552+0000 7f317349b640 1 --2- 172.21.15.73:0/3272541392 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f316c157c70 0x7f316c1580f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:57.555 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:57.552+0000 7f317349b640 1 --2- 172.21.15.73:0/3272541392 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f315c0047c0 0x7f316c14b1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:57.555 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:57.552+0000 7f317349b640 1 -- 172.21.15.73:0/3272541392 >> 172.21.15.73:0/3272541392 conn(0x7f316c0ab950 msgr2=0x7f316c14f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:46:57.555 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:57.552+0000 7f317349b640 1 -- 172.21.15.73:0/3272541392 shutdown_connections 2023-12-12T09:46:57.555 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:57.552+0000 7f317349b640 1 -- 172.21.15.73:0/3272541392 wait complete. 2023-12-12T09:46:57.573 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-12-12T09:46:57.573 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T09:46:57.573 DEBUG:teuthology.orchestra.run.smithi073:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-12-12T09:46:57.706 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi073.front.sepia.ceph.com 2023-12-12T09:46:57.707 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T09:46:57.707 DEBUG:teuthology.orchestra.run.smithi073:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-12-12T09:46:57.769 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2023-12-12T09:46:57.769 DEBUG:teuthology.orchestra.run.smithi073:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-12T09:46:57.808 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054284,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498800k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249396k,nr_inodes=812349,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498800k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 2023-12-12T09:46:57.808 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-12-12T09:46:58.048 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:58.047+0000 7f433e5a9640 1 Processor -- start 2023-12-12T09:46:58.049 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:58.047+0000 7f433e5a9640 1 -- start start 2023-12-12T09:46:58.050 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:58.048+0000 7f433e5a9640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f43380a5040 0x7f433806bf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:58.050 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:58.048+0000 7f433e5a9640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f43380c3ad0 0x7f43381584f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:58.050 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:58.048+0000 7f433e5a9640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f433806a4e0 0x7f433806a950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:58.050 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:58.048+0000 7f433e5a9640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f433806c4d0 con 0x7f43380a5040 2023-12-12T09:46:58.050 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:58.048+0000 7f433e5a9640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43380c4d00 con 0x7f433806a4e0 2023-12-12T09:46:58.050 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:58.048+0000 7f433e5a9640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43380c5100 con 0x7f43380c3ad0 2023-12-12T09:46:58.051 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:58.049+0000 7f4337fff640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f43380a5040 0x7f433806bf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:58.051 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:58.049+0000 7f4337fff640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f43380a5040 0x7f433806bf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:40154/0 (socket says 172.21.15.73:40154) 2023-12-12T09:46:58.051 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:58.049+0000 7f4337fff640 1 -- 172.21.15.73:0/1954204965 learned_addr learned my addr 172.21.15.73:0/1954204965 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:46:58.052 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:58.049+0000 7f433cb46640 1 --2- 172.21.15.73:0/1954204965 >> v2:172.21.15.142:3300/0 conn(0x7f433806a4e0 0x7f433806a950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:58.052 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:58.049+0000 7f4337fff640 1 -- 172.21.15.73:0/1954204965 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f43380c3ad0 msgr2=0x7f43381584f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:46:58.052 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:58.049+0000 7f43377fe640 1 --2- 172.21.15.73:0/1954204965 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f43380c3ad0 0x7f43381584f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:58.052 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:58.049+0000 7f4337fff640 1 --2- 172.21.15.73:0/1954204965 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f43380c3ad0 0x7f43381584f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:58.052 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:58.049+0000 7f4337fff640 1 -- 172.21.15.73:0/1954204965 >> v2:172.21.15.142:3300/0 conn(0x7f433806a4e0 msgr2=0x7f433806a950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:46:58.052 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:58.049+0000 7f4337fff640 1 --2- 172.21.15.73:0/1954204965 >> v2:172.21.15.142:3300/0 conn(0x7f433806a4e0 0x7f433806a950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:58.052 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:58.049+0000 7f4337fff640 1 -- 172.21.15.73:0/1954204965 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43380c53e0 con 0x7f43380a5040 2023-12-12T09:46:58.052 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:58.049+0000 7f433cb46640 1 --2- 172.21.15.73:0/1954204965 >> v2:172.21.15.142:3300/0 conn(0x7f433806a4e0 0x7f433806a950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:46:58.052 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:58.049+0000 7f43377fe640 1 --2- 172.21.15.73:0/1954204965 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f43380c3ad0 0x7f43381584f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:46:58.052 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:58.050+0000 7f4337fff640 1 --2- 172.21.15.73:0/1954204965 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f43380a5040 0x7f433806bf90 secure :-1 s=READY pgs=989 cs=0 l=1 rev1=1 crypto rx=0x7f433806af80 tx=0x7f432802b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d758019c485cc64 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:46:58.053 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:58.051+0000 7f4336ffd640 1 -- 172.21.15.73:0/1954204965 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4328030860 con 0x7f43380a5040 2023-12-12T09:46:58.054 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:58.051+0000 7f4336ffd640 1 -- 172.21.15.73:0/1954204965 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43280309c0 con 0x7f43380a5040 2023-12-12T09:46:58.054 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:58.051+0000 7f4336ffd640 1 -- 172.21.15.73:0/1954204965 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4328030d50 con 0x7f43380a5040 2023-12-12T09:46:58.054 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:58.051+0000 7f433e5a9640 1 -- 172.21.15.73:0/1954204965 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f43380a5040 msgr2=0x7f433806bf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:58.054 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:58.051+0000 7f433e5a9640 1 --2- 172.21.15.73:0/1954204965 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f43380a5040 0x7f433806bf90 secure :-1 s=READY pgs=989 cs=0 l=1 rev1=1 crypto rx=0x7f433806af80 tx=0x7f432802b9a0 comp rx=0 tx=0).stop 2023-12-12T09:46:58.054 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:58.052+0000 7f433e5a9640 1 -- 172.21.15.73:0/1954204965 shutdown_connections 2023-12-12T09:46:58.054 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:58.052+0000 7f433e5a9640 1 --2- 172.21.15.73:0/1954204965 >> v2:172.21.15.142:3300/0 conn(0x7f433806a4e0 0x7f433806a950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:58.054 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:58.052+0000 7f433e5a9640 1 --2- 172.21.15.73:0/1954204965 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f43380c3ad0 0x7f43381584f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:58.054 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:58.052+0000 7f433e5a9640 1 --2- 172.21.15.73:0/1954204965 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f43380a5040 0x7f433806bf90 unknown :-1 s=CLOSED pgs=989 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:58.054 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:58.052+0000 7f433e5a9640 1 -- 172.21.15.73:0/1954204965 >> 172.21.15.73:0/1954204965 conn(0x7f43380a8130 msgr2=0x7f43380c24b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:46:58.054 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:58.052+0000 7f433e5a9640 1 -- 172.21.15.73:0/1954204965 shutdown_connections 2023-12-12T09:46:58.054 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:58.052+0000 7f433e5a9640 1 -- 172.21.15.73:0/1954204965 wait complete. 2023-12-12T09:46:58.055 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:58.053+0000 7f433e5a9640 1 Processor -- start 2023-12-12T09:46:58.055 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:58.054+0000 7f433e5a9640 1 -- start start 2023-12-12T09:46:58.056 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:58.054+0000 7f433e5a9640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f433806a4e0 0x7f433814e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:58.056 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:58.055+0000 7f433e5a9640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f43380a5040 0x7f4338150300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:58.056 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:58.055+0000 7f433e5a9640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f43380c3ad0 0x7f4338070d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:58.056 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:58.055+0000 7f433e5a9640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43381eb050 con 0x7f43380c3ad0 2023-12-12T09:46:58.056 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:58.055+0000 7f433e5a9640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43380a89a0 con 0x7f433806a4e0 2023-12-12T09:46:58.057 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:58.055+0000 7f433e5a9640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43381522e0 con 0x7f43380a5040 2023-12-12T09:46:58.057 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:58.055+0000 7f433cb46640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f43380c3ad0 0x7f4338070d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:58.057 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:58.055+0000 7f433cb46640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f43380c3ad0 0x7f4338070d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:40162/0 (socket says 172.21.15.73:40162) 2023-12-12T09:46:58.057 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:58.055+0000 7f433cb46640 1 -- 172.21.15.73:0/3656623462 learned_addr learned my addr 172.21.15.73:0/3656623462 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:46:58.058 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:58.055+0000 7f433cb46640 1 -- 172.21.15.73:0/3656623462 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f43380a5040 msgr2=0x7f4338150300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:58.058 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:58.055+0000 7f43377fe640 1 --2- 172.21.15.73:0/3656623462 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f43380a5040 0x7f4338150300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:58.058 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:58.055+0000 7f4337fff640 1 --2- 172.21.15.73:0/3656623462 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f433806a4e0 0x7f433814e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:58.058 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:58.055+0000 7f433cb46640 1 --2- 172.21.15.73:0/3656623462 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f43380a5040 0x7f4338150300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:58.058 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:58.055+0000 7f433cb46640 1 -- 172.21.15.73:0/3656623462 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f433806a4e0 msgr2=0x7f433814e320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:58.058 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:58.055+0000 7f433cb46640 1 --2- 172.21.15.73:0/3656623462 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f433806a4e0 0x7f433814e320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:58.058 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:58.055+0000 7f433cb46640 1 -- 172.21.15.73:0/3656623462 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43280094d0 con 0x7f43380c3ad0 2023-12-12T09:46:58.058 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:58.056+0000 7f433cb46640 1 --2- 172.21.15.73:0/3656623462 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f43380c3ad0 0x7f4338070d10 secure :-1 s=READY pgs=990 cs=0 l=1 rev1=1 crypto rx=0x7f433000cef0 tx=0x7f433000a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:46:58.058 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:58.056+0000 7f4334ff9640 1 -- 172.21.15.73:0/3656623462 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f433000d840 con 0x7f43380c3ad0 2023-12-12T09:46:58.059 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:58.056+0000 7f4334ff9640 1 -- 172.21.15.73:0/3656623462 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f433000d9c0 con 0x7f43380c3ad0 2023-12-12T09:46:58.059 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:58.056+0000 7f4334ff9640 1 -- 172.21.15.73:0/3656623462 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f433000dd70 con 0x7f43380c3ad0 2023-12-12T09:46:58.059 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:58.056+0000 7f433e5a9640 1 -- 172.21.15.73:0/3656623462 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4338151d20 con 0x7f43380c3ad0 2023-12-12T09:46:58.059 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:58.056+0000 7f433e5a9640 1 -- 172.21.15.73:0/3656623462 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4338150840 con 0x7f43380c3ad0 2023-12-12T09:46:58.059 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:58.057+0000 7f433e5a9640 1 -- 172.21.15.73:0/3656623462 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f43380a8800 con 0x7f43380c3ad0 2023-12-12T09:46:58.059 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:58.058+0000 7f4334ff9640 1 -- 172.21.15.73:0/3656623462 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f433001e3b0 con 0x7f43380c3ad0 2023-12-12T09:46:58.060 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:58.059+0000 7f4334ff9640 1 --2- 172.21.15.73:0/3656623462 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f432406ae70 0x7f432406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:46:58.061 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:58.059+0000 7f4334ff9640 1 -- 172.21.15.73:0/3656623462 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f433008a420 con 0x7f43380c3ad0 2023-12-12T09:46:58.061 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:58.059+0000 7f4337fff640 1 --2- 172.21.15.73:0/3656623462 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f432406ae70 0x7f432406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:46:58.061 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:58.060+0000 7f4337fff640 1 --2- 172.21.15.73:0/3656623462 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f432406ae70 0x7f432406d330 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f4328036000 tx=0x7f432803b040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:46:58.065 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:58.063+0000 7f4334ff9640 1 -- 172.21.15.73:0/3656623462 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f43380a8800 con 0x7f43380c3ad0 2023-12-12T09:46:58.297 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:58.295+0000 7f433e5a9640 1 -- 172.21.15.73:0/3656623462 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f43380a8800 con 0x7f43380c3ad0 2023-12-12T09:46:58.298 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:58.296+0000 7f4334ff9640 1 -- 172.21.15.73:0/3656623462 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v49) v1 ==== 53+0+149 (secure 0 0 0) 0x7f43380a8800 con 0x7f43380c3ad0 2023-12-12T09:46:58.298 INFO:teuthology.orchestra.run.smithi073.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-12-12T09:46:58.298 INFO:teuthology.orchestra.run.smithi073.stdout:name: cephfs2, metadata pool: cephfs2_metadata, data pools: [cephfs2_data ] 2023-12-12T09:46:58.301 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:58.299+0000 7f433e5a9640 1 -- 172.21.15.73:0/3656623462 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f432406ae70 msgr2=0x7f432406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:58.301 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:58.299+0000 7f433e5a9640 1 --2- 172.21.15.73:0/3656623462 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f432406ae70 0x7f432406d330 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f4328036000 tx=0x7f432803b040 comp rx=0 tx=0).stop 2023-12-12T09:46:58.301 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:58.299+0000 7f433e5a9640 1 -- 172.21.15.73:0/3656623462 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f43380c3ad0 msgr2=0x7f4338070d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:46:58.301 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:58.299+0000 7f433e5a9640 1 --2- 172.21.15.73:0/3656623462 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f43380c3ad0 0x7f4338070d10 secure :-1 s=READY pgs=990 cs=0 l=1 rev1=1 crypto rx=0x7f433000cef0 tx=0x7f433000a710 comp rx=0 tx=0).stop 2023-12-12T09:46:58.301 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:58.299+0000 7f433e5a9640 1 -- 172.21.15.73:0/3656623462 shutdown_connections 2023-12-12T09:46:58.301 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:58.299+0000 7f433e5a9640 1 --2- 172.21.15.73:0/3656623462 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f432406ae70 0x7f432406d330 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:58.301 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:58.299+0000 7f433e5a9640 1 --2- 172.21.15.73:0/3656623462 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f43380c3ad0 0x7f4338070d10 unknown :-1 s=CLOSED pgs=990 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:58.301 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:58.299+0000 7f433e5a9640 1 --2- 172.21.15.73:0/3656623462 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f43380a5040 0x7f4338150300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:58.302 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:58.299+0000 7f433e5a9640 1 --2- 172.21.15.73:0/3656623462 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f433806a4e0 0x7f433814e320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:46:58.302 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:58.299+0000 7f433e5a9640 1 -- 172.21.15.73:0/3656623462 >> 172.21.15.73:0/3656623462 conn(0x7f43380a8130 msgr2=0x7f4338158340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:46:58.302 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:58.300+0000 7f433e5a9640 1 -- 172.21.15.73:0/3656623462 shutdown_connections 2023-12-12T09:46:58.302 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:46:58.300+0000 7f433e5a9640 1 -- 172.21.15.73:0/3656623462 wait complete. 2023-12-12T09:46:58.320 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-12-12T09:46:58.320 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-12T09:46:58.320 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi073.front.sepia.ceph.com 2023-12-12T09:46:58.320 INFO:tasks.cephfs.mount:self.client.name = client.testuser 2023-12-12T09:46:58.320 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-12-12T09:46:58.320 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-12-12T09:46:58.320 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-12-12T09:46:58.320 INFO:tasks.cephfs.mount:self.client_keyring_path = /tmp/tmp.AfDKDSl9kb 2023-12-12T09:46:58.320 DEBUG:teuthology.orchestra.run.smithi073:> mktemp 2023-12-12T09:46:58.369 INFO:teuthology.orchestra.run.smithi073.stdout:/tmp/tmp.rjuBA3rxYb 2023-12-12T09:46:58.369 DEBUG:teuthology.orchestra.run.smithi073:> sudo cp /tmp/tmp.AfDKDSl9kb /tmp/tmp.rjuBA3rxYb 2023-12-12T09:46:58.510 DEBUG:teuthology.orchestra.run.smithi073:> sudo chmod 0666 /tmp/tmp.rjuBA3rxYb 2023-12-12T09:46:58.666 DEBUG:teuthology.orchestra.remote:smithi073:/tmp/tmp.rjuBA3rxYb is 226B 2023-12-12T09:46:58.726 DEBUG:teuthology.orchestra.run.smithi073:> rm -fr /tmp/tmp.rjuBA3rxYb 2023-12-12T09:46:58.778 INFO:tasks.cephfs.mount:keyring content - [client.testuser] key = AQANLHhl8zZpKBAAe+ZOAx3IIF0HjcTJIGufUA== caps mds = "allow r fsname=cephfs, allow r fsname=cephfs2" caps mon = "allow r" caps osd = "allow r tag cephfs data=cephfs, allow r tag cephfs data=cephfs2" 2023-12-12T09:46:58.779 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-12-12T09:46:58.779 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T09:46:58.779 DEBUG:teuthology.orchestra.run.smithi073:> ip addr 2023-12-12T09:46:58.831 INFO:teuthology.orchestra.run.smithi073.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-12T09:46:58.831 INFO:teuthology.orchestra.run.smithi073.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-12T09:46:58.831 INFO:teuthology.orchestra.run.smithi073.stdout: inet 127.0.0.1/8 scope host lo 2023-12-12T09:46:58.831 INFO:teuthology.orchestra.run.smithi073.stdout: valid_lft forever preferred_lft forever 2023-12-12T09:46:58.831 INFO:teuthology.orchestra.run.smithi073.stdout: inet6 ::1/128 scope host 2023-12-12T09:46:58.831 INFO:teuthology.orchestra.run.smithi073.stdout: valid_lft forever preferred_lft forever 2023-12-12T09:46:58.831 INFO:teuthology.orchestra.run.smithi073.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-12T09:46:58.831 INFO:teuthology.orchestra.run.smithi073.stdout: link/ether 0c:c4:7a:d8:d9:ea brd ff:ff:ff:ff:ff:ff 2023-12-12T09:46:58.832 INFO:teuthology.orchestra.run.smithi073.stdout: altname enp7s0f0 2023-12-12T09:46:58.832 INFO:teuthology.orchestra.run.smithi073.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-12T09:46:58.832 INFO:teuthology.orchestra.run.smithi073.stdout: link/ether 0c:c4:7a:d8:d9:eb brd ff:ff:ff:ff:ff:ff 2023-12-12T09:46:58.832 INFO:teuthology.orchestra.run.smithi073.stdout: altname enp7s0f1 2023-12-12T09:46:58.832 INFO:teuthology.orchestra.run.smithi073.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-12T09:46:58.832 INFO:teuthology.orchestra.run.smithi073.stdout: link/ether 0c:c4:7a:8f:ce:7c brd ff:ff:ff:ff:ff:ff 2023-12-12T09:46:58.832 INFO:teuthology.orchestra.run.smithi073.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-12T09:46:58.832 INFO:teuthology.orchestra.run.smithi073.stdout: link/ether 0c:c4:7a:8f:ce:7d brd ff:ff:ff:ff:ff:ff 2023-12-12T09:46:58.832 INFO:teuthology.orchestra.run.smithi073.stdout: inet 172.21.15.73/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-12-12T09:46:58.832 INFO:teuthology.orchestra.run.smithi073.stdout: valid_lft 42180sec preferred_lft 42180sec 2023-12-12T09:46:58.832 INFO:teuthology.orchestra.run.smithi073.stdout: inet6 fe80::ec4:7aff:fe8f:ce7d/64 scope link 2023-12-12T09:46:58.832 INFO:teuthology.orchestra.run.smithi073.stdout: valid_lft forever preferred_lft forever 2023-12-12T09:46:58.832 INFO:teuthology.orchestra.run.smithi073.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-12-12T09:46:58.833 INFO:teuthology.orchestra.run.smithi073.stdout: link/ether ae:cf:b6:bf:45:8d brd ff:ff:ff:ff:ff:ff 2023-12-12T09:46:58.833 INFO:teuthology.orchestra.run.smithi073.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-12-12T09:46:58.833 INFO:teuthology.orchestra.run.smithi073.stdout: valid_lft forever preferred_lft forever 2023-12-12T09:46:58.833 INFO:teuthology.orchestra.run.smithi073.stdout: inet6 fe80::f4:a9ff:febd:c3fb/64 scope link 2023-12-12T09:46:58.833 INFO:teuthology.orchestra.run.smithi073.stdout: valid_lft forever preferred_lft forever 2023-12-12T09:46:58.833 INFO:teuthology.orchestra.run.smithi073.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-12T09:46:58.834 INFO:teuthology.orchestra.run.smithi073.stdout: link/ether ae:cf:b6:bf:45:8d brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-12T09:46:58.834 INFO:teuthology.orchestra.run.smithi073.stdout: inet6 fe80::accf:b6ff:febf:458d/64 scope link 2023-12-12T09:46:58.834 INFO:teuthology.orchestra.run.smithi073.stdout: valid_lft forever preferred_lft forever 2023-12-12T09:46:58.834 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T09:46:58.835 DEBUG:teuthology.orchestra.run.smithi073:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-12T09:46:58.920 INFO:teuthology.orchestra.run.smithi073.stdout:1 2023-12-12T09:46:58.924 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T09:46:58.924 DEBUG:teuthology.orchestra.run.smithi073:> route 2023-12-12T09:46:58.977 INFO:teuthology.orchestra.run.smithi073.stdout:Kernel IP routing table 2023-12-12T09:46:58.977 INFO:teuthology.orchestra.run.smithi073.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-12T09:46:58.977 INFO:teuthology.orchestra.run.smithi073.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-12-12T09:46:58.977 INFO:teuthology.orchestra.run.smithi073.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-12-12T09:46:58.977 INFO:teuthology.orchestra.run.smithi073.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-12T09:46:58.978 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T09:46:58.978 DEBUG:teuthology.orchestra.run.smithi073:> (cd / && exec bash -c ' 2023-12-12T09:46:58.978 DEBUG:teuthology.orchestra.run.smithi073:> set -e 2023-12-12T09:46:58.978 DEBUG:teuthology.orchestra.run.smithi073:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-12-12T09:46:58.978 DEBUG:teuthology.orchestra.run.smithi073:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-12-12T09:46:58.978 DEBUG:teuthology.orchestra.run.smithi073:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-12-12T09:46:58.978 DEBUG:teuthology.orchestra.run.smithi073:> ') 2023-12-12T09:46:59.154 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T09:46:59.154 DEBUG:teuthology.orchestra.run.smithi073:> ip netns list 2023-12-12T09:46:59.204 INFO:teuthology.orchestra.run.smithi073.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-12-12T09:46:59.204 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-12-12T09:46:59.205 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T09:46:59.205 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip link set brx.0 up 2023-12-12T09:46:59.299 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-12T09:46:59.299 DEBUG:teuthology.orchestra.run.smithi073:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-12-12T09:46:59.355 INFO:teuthology.orchestra.run.smithi073.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-12-12T09:46:59.355 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-12T09:46:59.355 DEBUG:teuthology.orchestra.run.smithi073:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-12-12T09:46:59.406 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2023-12-12T09:46:59.406 DEBUG:teuthology.orchestra.run.smithi073:> dd if=/tmp/tmp.AfDKDSl9kb of=/dev/stdout 2023-12-12T09:46:59.458 INFO:tasks.cephfs.kernel_mount:mounting using device: testuser@.cephfs=/ 2023-12-12T09:46:59.458 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T09:46:59.458 DEBUG:teuthology.orchestra.run.smithi073:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph testuser@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,secret=AQANLHhl8zZpKBAAe+ZOAx3IIF0HjcTJIGufUA==,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-12T09:46:59.602 INFO:teuthology.orchestra.run.smithi073.stdout:parsing options: rw,norequire_active_mds,secret=AQANLHhl8zZpKBAAe+ZOAx3IIF0HjcTJIGufUA==,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-12T09:46:59.602 INFO:teuthology.orchestra.run.smithi073.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-12T09:46:59.602 INFO:teuthology.orchestra.run.smithi073.stdout:keyring.get_secret failed 2023-12-12T09:46:59.636 INFO:teuthology.orchestra.run.smithi073.stdout:parsing options: rw,norequire_active_mds,secret=AQANLHhl8zZpKBAAe+ZOAx3IIF0HjcTJIGufUA==,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-12T09:46:59.636 INFO:teuthology.orchestra.run.smithi073.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-12T09:46:59.636 INFO:teuthology.orchestra.run.smithi073.stdout:mount.ceph: resolved to: "172.21.15.73:3300,172.21.15.142:3300,172.21.15.142:3301" 2023-12-12T09:46:59.636 INFO:teuthology.orchestra.run.smithi073.stdout:mount.ceph: trying mount with new device syntax: testuser@ba240992-02b8-4c7e-92f2-27eb29ac433b.cephfs=/ 2023-12-12T09:46:59.636 INFO:teuthology.orchestra.run.smithi073.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=testuser,ms_mode=prefer-crc,key=testuser,mon_addr=172.21.15.73:3300/172.21.15.142:3300/172.21.15.142:3301" will pass to kernel 2023-12-12T09:46:59.638 INFO:teuthology.orchestra.run.smithi073.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2023-12-12T09:46:59.638 INFO:teuthology.orchestra.run.smithi073.stdout: You just mounted a file system that supports labels which does not 2023-12-12T09:46:59.638 INFO:teuthology.orchestra.run.smithi073.stdout: contain labels, onto an SELinux box. It is likely that confined 2023-12-12T09:46:59.638 INFO:teuthology.orchestra.run.smithi073.stdout: applications will generate AVC messages and not be allowed access to 2023-12-12T09:46:59.638 INFO:teuthology.orchestra.run.smithi073.stdout: this file system. For more details see restorecon(8) and mount(8). 2023-12-12T09:46:59.641 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-12-12T09:46:59.641 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T09:46:59.642 DEBUG:teuthology.orchestra.run.smithi073:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-12-12T09:46:59.720 INFO:teuthology.orchestra.run.smithi073.stderr:chmod: changing permissions of '/home/ubuntu/cephtest/mnt.0': Permission denied 2023-12-12T09:46:59.723 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-12T09:46:59.724 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T09:46:59.724 DEBUG:teuthology.orchestra.run.smithi073:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-12T09:46:59.782 INFO:teuthology.orchestra.run.smithi073.stdout:client5548 2023-12-12T09:46:59.782 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2023-12-12T09:46:59.783 DEBUG:teuthology.orchestra.run.smithi073:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-12T09:46:59.833 DEBUG:teuthology.orchestra.run.smithi142:> mktemp 2023-12-12T09:46:59.894 INFO:teuthology.orchestra.run.smithi142.stdout:/tmp/tmp.jDMAxErb9f 2023-12-12T09:46:59.895 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2023-12-12T09:46:59.895 DEBUG:teuthology.orchestra.run.smithi142:> dd of=/tmp/tmp.jDMAxErb9f 2023-12-12T09:46:59.950 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2023-12-12T09:46:59.950 DEBUG:teuthology.orchestra.run.smithi142:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-12T09:47:00.049 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2023-12-12T09:47:00.049 DEBUG:teuthology.orchestra.run.smithi142:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-12T09:47:00.102 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-12T09:47:00.323 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:00.322+0000 7fd439e10640 1 Processor -- start 2023-12-12T09:47:00.324 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:00.323+0000 7fd439e10640 1 -- start start 2023-12-12T09:47:00.325 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:00.324+0000 7fd439e10640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fd43406db70 0x7fd4340c39b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:00.325 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:00.324+0000 7fd439e10640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fd4340c5070 0x7fd4340c3ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:00.325 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:00.324+0000 7fd439e10640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd434152610 con 0x7fd43414fa40 2023-12-12T09:47:00.325 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:00.324+0000 7fd439e10640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4341528f0 con 0x7fd4340c5070 2023-12-12T09:47:00.325 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:00.324+0000 7fd439e10640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd434152bd0 con 0x7fd43406db70 2023-12-12T09:47:00.325 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:00.325+0000 7fd433fff640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fd4340c5070 0x7fd4340c3ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:00.325 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:00.325+0000 7fd433fff640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fd4340c5070 0x7fd4340c3ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:55972/0 (socket says 172.21.15.73:55972) 2023-12-12T09:47:00.326 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:00.325+0000 7fd433fff640 1 -- 172.21.15.73:0/3105428489 learned_addr learned my addr 172.21.15.73:0/3105428489 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:47:00.326 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:00.325+0000 7fd433fff640 1 -- 172.21.15.73:0/3105428489 >> v2:172.21.15.142:3300/0 conn(0x7fd43406db70 msgr2=0x7fd4340c39b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:47:00.326 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:00.325+0000 7fd433fff640 1 --2- 172.21.15.73:0/3105428489 >> v2:172.21.15.142:3300/0 conn(0x7fd43406db70 0x7fd4340c39b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:00.326 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:00.325+0000 7fd433fff640 1 -- 172.21.15.73:0/3105428489 >> v1:172.21.15.142:6789/0 conn(0x7fd43414fa40 legacy=0x7fd43406a4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:47:00.326 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:00.325+0000 7fd433fff640 1 -- 172.21.15.73:0/3105428489 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd434152eb0 con 0x7fd4340c5070 2023-12-12T09:47:00.327 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:00.326+0000 7fd433fff640 1 --2- 172.21.15.73:0/3105428489 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd4340c5070 0x7fd4340c3ef0 secure :-1 s=READY pgs=991 cs=0 l=1 rev1=1 crypto rx=0x7fd4340aaf60 tx=0x7fd42c02bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d99d5420698a629a server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:47:00.327 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:00.326+0000 7fd432ffd640 1 -- 172.21.15.73:0/3105428489 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd42c02ca80 con 0x7fd4340c5070 2023-12-12T09:47:00.327 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:00.327+0000 7fd432ffd640 1 -- 172.21.15.73:0/3105428489 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd42c02cbe0 con 0x7fd4340c5070 2023-12-12T09:47:00.327 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:00.327+0000 7fd432ffd640 1 -- 172.21.15.73:0/3105428489 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd42c0343f0 con 0x7fd4340c5070 2023-12-12T09:47:00.328 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:00.327+0000 7fd439e10640 1 -- 172.21.15.73:0/3105428489 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd4340c5070 msgr2=0x7fd4340c3ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:00.329 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:00.327+0000 7fd439e10640 1 --2- 172.21.15.73:0/3105428489 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd4340c5070 0x7fd4340c3ef0 secure :-1 s=READY pgs=991 cs=0 l=1 rev1=1 crypto rx=0x7fd4340aaf60 tx=0x7fd42c02bee0 comp rx=0 tx=0).stop 2023-12-12T09:47:00.329 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:00.327+0000 7fd439e10640 1 -- 172.21.15.73:0/3105428489 shutdown_connections 2023-12-12T09:47:00.329 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:00.327+0000 7fd439e10640 1 --2- 172.21.15.73:0/3105428489 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd4340c5070 0x7fd4340c3ef0 unknown :-1 s=CLOSED pgs=991 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:00.330 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:00.327+0000 7fd439e10640 1 --2- 172.21.15.73:0/3105428489 >> v2:172.21.15.142:3300/0 conn(0x7fd43406db70 0x7fd4340c39b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:00.330 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:00.327+0000 7fd439e10640 1 -- 172.21.15.73:0/3105428489 >> 172.21.15.73:0/3105428489 conn(0x7fd4340a8130 msgr2=0x7fd4340c24b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:47:00.330 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:00.327+0000 7fd439e10640 1 -- 172.21.15.73:0/3105428489 shutdown_connections 2023-12-12T09:47:00.330 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:00.327+0000 7fd439e10640 1 -- 172.21.15.73:0/3105428489 wait complete. 2023-12-12T09:47:00.332 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:00.329+0000 7fd439e10640 1 Processor -- start 2023-12-12T09:47:00.332 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:00.329+0000 7fd439e10640 1 -- start start 2023-12-12T09:47:00.332 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:00.330+0000 7fd439e10640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd43406db70 0x7fd434070b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:00.332 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:00.330+0000 7fd439e10640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd4340c5070 0x7fd43414a600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:00.333 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:00.330+0000 7fd439e10640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd43414fa40 0x7fd43414ab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:00.333 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:00.330+0000 7fd439e10640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4340aa840 con 0x7fd4340c5070 2023-12-12T09:47:00.333 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:00.330+0000 7fd439e10640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd434071580 con 0x7fd43406db70 2023-12-12T09:47:00.333 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:00.330+0000 7fd439e10640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4340706c0 con 0x7fd43414fa40 2023-12-12T09:47:00.333 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:00.330+0000 7fd42bfff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd4340c5070 0x7fd43414a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:00.333 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:00.330+0000 7fd42bfff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd4340c5070 0x7fd43414a600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:55988/0 (socket says 172.21.15.73:55988) 2023-12-12T09:47:00.333 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:00.330+0000 7fd42bfff640 1 -- 172.21.15.73:0/1493022856 learned_addr learned my addr 172.21.15.73:0/1493022856 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:47:00.333 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:00.331+0000 7fd4337fe640 1 --2- 172.21.15.73:0/1493022856 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd43406db70 0x7fd434070b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:00.333 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:00.331+0000 7fd42bfff640 1 -- 172.21.15.73:0/1493022856 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd43414fa40 msgr2=0x7fd43414ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:00.333 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:00.331+0000 7fd42bfff640 1 --2- 172.21.15.73:0/1493022856 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd43414fa40 0x7fd43414ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:00.333 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:00.331+0000 7fd42bfff640 1 -- 172.21.15.73:0/1493022856 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd43406db70 msgr2=0x7fd434070b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:00.333 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:00.331+0000 7fd42bfff640 1 --2- 172.21.15.73:0/1493022856 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd43406db70 0x7fd434070b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:00.334 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:00.331+0000 7fd42bfff640 1 -- 172.21.15.73:0/1493022856 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd42c009b30 con 0x7fd4340c5070 2023-12-12T09:47:00.334 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:00.331+0000 7fd4337fe640 1 --2- 172.21.15.73:0/1493022856 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd43406db70 0x7fd434070b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:47:00.334 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:00.331+0000 7fd42bfff640 1 --2- 172.21.15.73:0/1493022856 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd4340c5070 0x7fd43414a600 secure :-1 s=READY pgs=992 cs=0 l=1 rev1=1 crypto rx=0x7fd41c00b440 tx=0x7fd41c00b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:47:00.334 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:00.331+0000 7fd430ff9640 1 -- 172.21.15.73:0/1493022856 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd41c011890 con 0x7fd4340c5070 2023-12-12T09:47:00.334 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:00.331+0000 7fd430ff9640 1 -- 172.21.15.73:0/1493022856 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd41c0119f0 con 0x7fd4340c5070 2023-12-12T09:47:00.334 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:00.331+0000 7fd439e10640 1 -- 172.21.15.73:0/1493022856 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd43414b080 con 0x7fd4340c5070 2023-12-12T09:47:00.334 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:00.332+0000 7fd430ff9640 1 -- 172.21.15.73:0/1493022856 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd41c011da0 con 0x7fd4340c5070 2023-12-12T09:47:00.335 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:00.332+0000 7fd439e10640 1 -- 172.21.15.73:0/1493022856 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd434151aa0 con 0x7fd4340c5070 2023-12-12T09:47:00.336 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:00.333+0000 7fd439e10640 1 -- 172.21.15.73:0/1493022856 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd434067580 con 0x7fd4340c5070 2023-12-12T09:47:00.336 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:00.334+0000 7fd430ff9640 1 -- 172.21.15.73:0/1493022856 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fd41c01a400 con 0x7fd4340c5070 2023-12-12T09:47:00.337 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:00.335+0000 7fd430ff9640 1 --2- 172.21.15.73:0/1493022856 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fd41406ae40 0x7fd41406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:00.337 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:00.335+0000 7fd430ff9640 1 -- 172.21.15.73:0/1493022856 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fd41c089cb0 con 0x7fd4340c5070 2023-12-12T09:47:00.337 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:00.335+0000 7fd4337fe640 1 --2- 172.21.15.73:0/1493022856 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fd41406ae40 0x7fd41406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:00.337 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:00.336+0000 7fd4337fe640 1 --2- 172.21.15.73:0/1493022856 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fd41406ae40 0x7fd41406d300 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fd434070240 tx=0x7fd424009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:47:00.340 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:00.340+0000 7fd430ff9640 1 -- 172.21.15.73:0/1493022856 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fd41c0549f0 con 0x7fd4340c5070 2023-12-12T09:47:00.535 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:00.534+0000 7fd439e10640 1 -- 172.21.15.73:0/1493022856 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd434070800 con 0x7fd4340c5070 2023-12-12T09:47:00.538 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:00.538+0000 7fd430ff9640 1 -- 172.21.15.73:0/1493022856 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v79) v1 ==== 74+0+20226 (secure 0 0 0) 0x7fd41c015020 con 0x7fd4340c5070 2023-12-12T09:47:00.539 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-12T09:47:00.539 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":79,"fsid":"ba240992-02b8-4c7e-92f2-27eb29ac433b","created":"2023-12-12T09:43:02.454719+0000","modified":"2023-12-12T09:46:43.294476+0000","last_up_change":"2023-12-12T09:43:13.913440+0000","last_in_change":"2023-12-12T09:43:05.925348+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-12T09:43:15.525508+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2023-12-12T09:46:24.716544+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2023-12-12T09:46:25.435954+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs2_metadata","create_time":"2023-12-12T09:46:40.116878+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs2_data","create_time":"2023-12-12T09:46:40.798840+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"dd9074be-dbe2-4c34-9896-a4223d8d3940","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":4047810203},{"type":"v1","addr":"172.21.15.73:6801","nonce":4047810203}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":4047810203},{"type":"v1","addr":"172.21.15.73:6803","nonce":4047810203}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":4047810203},{"type":"v1","addr":"172.21.15.73:6807","nonce":4047810203}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":4047810203},{"type":"v1","addr":"172.21.15.73:6805","nonce":4047810203}]},"public_addr":"172.21.15.73:6801/4047810203","cluster_addr":"172.21.15.73:6803/4047810203","heartbeat_back_addr":"172.21.15.73:6807/4047810203","heartbeat_front_addr":"172.21.15.73:6805/4047810203","state":["exists","up"]},{"osd":1,"uuid":"c4a05052-96d4-4758-a4e1-1a37f1e07fed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":1356058331},{"type":"v1","addr":"172.21.15.73:6824","nonce":1356058331}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":1356058331},{"type":"v1","addr":"172.21.15.73:6827","nonce":1356058331}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":1356058331},{"type":"v1","addr":"172.21.15.73:6831","nonce":1356058331}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":1356058331},{"type":"v1","addr":"172.21.15.73:6829","nonce":1356058331}]},"public_addr":"172.21.15.73:6824/1356058331","cluster_addr":"172.21.15.73:6827/1356058331","heartbeat_back_addr":"172.21.15.73:6831/1356058331","heartbeat_front_addr":"172.21.15.73:6829/1356058331","state":["exists","up"]},{"osd":2,"uuid":"512bc8ac-72c2-40d4-b3d2-d867a92c5213","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":1228903316},{"type":"v1","addr":"172.21.15.73:6817","nonce":1228903316}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":1228903316},{"type":"v1","addr":"172.21.15.73:6819","nonce":1228903316}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6823","nonce":1228903316},{"type":"v1","addr":"172.21.15.73:6825","nonce":1228903316}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":1228903316},{"type":"v1","addr":"172.21.15.73:6821","nonce":1228903316}]},"public_addr":"172.21.15.73:6817/1228903316","cluster_addr":"172.21.15.73:6819/1228903316","heartbeat_back_addr":"172.21.15.73:6825/1228903316","heartbeat_front_addr":"172.21.15.73:6821/1228903316","state":["exists","up"]},{"osd":3,"uuid":"3d1a91e0-42bf-437a-8eae-8d357c8f63a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":1293329670},{"type":"v1","addr":"172.21.15.73:6809","nonce":1293329670}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6810","nonce":1293329670},{"type":"v1","addr":"172.21.15.73:6811","nonce":1293329670}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":1293329670},{"type":"v1","addr":"172.21.15.73:6815","nonce":1293329670}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":1293329670},{"type":"v1","addr":"172.21.15.73:6813","nonce":1293329670}]},"public_addr":"172.21.15.73:6809/1293329670","cluster_addr":"172.21.15.73:6811/1293329670","heartbeat_back_addr":"172.21.15.73:6815/1293329670","heartbeat_front_addr":"172.21.15.73:6813/1293329670","state":["exists","up"]},{"osd":4,"uuid":"4b302fff-834c-4069-ac19-00e46f6c87b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":3727975702},{"type":"v1","addr":"172.21.15.142:6801","nonce":3727975702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":3727975702},{"type":"v1","addr":"172.21.15.142:6803","nonce":3727975702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6809","nonce":3727975702},{"type":"v1","addr":"172.21.15.142:6811","nonce":3727975702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6805","nonce":3727975702},{"type":"v1","addr":"172.21.15.142:6807","nonce":3727975702}]},"public_addr":"172.21.15.142:6801/3727975702","cluster_addr":"172.21.15.142:6803/3727975702","heartbeat_back_addr":"172.21.15.142:6811/3727975702","heartbeat_front_addr":"172.21.15.142:6807/3727975702","state":["exists","up"]},{"osd":5,"uuid":"d7cdace2-67d0-45cc-95f2-515cf6ef1b82","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6817","nonce":2353193632},{"type":"v1","addr":"172.21.15.142:6819","nonce":2353193632}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6821","nonce":2353193632},{"type":"v1","addr":"172.21.15.142:6823","nonce":2353193632}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6829","nonce":2353193632},{"type":"v1","addr":"172.21.15.142:6831","nonce":2353193632}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6825","nonce":2353193632},{"type":"v1","addr":"172.21.15.142:6827","nonce":2353193632}]},"public_addr":"172.21.15.142:6819/2353193632","cluster_addr":"172.21.15.142:6823/2353193632","heartbeat_back_addr":"172.21.15.142:6831/2353193632","heartbeat_front_addr":"172.21.15.142:6827/2353193632","state":["exists","up"]},{"osd":6,"uuid":"649ce78a-5626-445c-aedc-a651ed05a6f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":2006111986},{"type":"v1","addr":"172.21.15.142:6806","nonce":2006111986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":2006111986},{"type":"v1","addr":"172.21.15.142:6810","nonce":2006111986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":2006111986},{"type":"v1","addr":"172.21.15.142:6815","nonce":2006111986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":2006111986},{"type":"v1","addr":"172.21.15.142:6813","nonce":2006111986}]},"public_addr":"172.21.15.142:6806/2006111986","cluster_addr":"172.21.15.142:6810/2006111986","heartbeat_back_addr":"172.21.15.142:6815/2006111986","heartbeat_front_addr":"172.21.15.142:6813/2006111986","state":["exists","up"]},{"osd":7,"uuid":"af15ae3b-c1d0-4acf-92db-8a1805494d13","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":2573794341},{"type":"v1","addr":"172.21.15.142:6818","nonce":2573794341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":2573794341},{"type":"v1","addr":"172.21.15.142:6822","nonce":2573794341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":2573794341},{"type":"v1","addr":"172.21.15.142:6830","nonce":2573794341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":2573794341},{"type":"v1","addr":"172.21.15.142:6826","nonce":2573794341}]},"public_addr":"172.21.15.142:6818/2573794341","cluster_addr":"172.21.15.142:6822/2573794341","heartbeat_back_addr":"172.21.15.142:6830/2573794341","heartbeat_front_addr":"172.21.15.142:6826/2573794341","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.185824+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.262103+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.225556+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:10.523459+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:10.706035+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.257339+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.301776+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.051960+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-12T09:47:00.542 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:00.541+0000 7fd439e10640 1 -- 172.21.15.73:0/1493022856 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fd41406ae40 msgr2=0x7fd41406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:00.542 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:00.541+0000 7fd439e10640 1 --2- 172.21.15.73:0/1493022856 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fd41406ae40 0x7fd41406d300 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fd434070240 tx=0x7fd424009040 comp rx=0 tx=0).stop 2023-12-12T09:47:00.542 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:00.541+0000 7fd439e10640 1 -- 172.21.15.73:0/1493022856 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd4340c5070 msgr2=0x7fd43414a600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:00.542 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:00.541+0000 7fd439e10640 1 --2- 172.21.15.73:0/1493022856 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd4340c5070 0x7fd43414a600 secure :-1 s=READY pgs=992 cs=0 l=1 rev1=1 crypto rx=0x7fd41c00b440 tx=0x7fd41c00b900 comp rx=0 tx=0).stop 2023-12-12T09:47:00.542 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:00.541+0000 7fd439e10640 1 -- 172.21.15.73:0/1493022856 shutdown_connections 2023-12-12T09:47:00.542 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:00.541+0000 7fd439e10640 1 --2- 172.21.15.73:0/1493022856 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fd41406ae40 0x7fd41406d300 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:00.542 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:00.541+0000 7fd439e10640 1 --2- 172.21.15.73:0/1493022856 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd43414fa40 0x7fd43414ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:00.542 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:00.541+0000 7fd439e10640 1 --2- 172.21.15.73:0/1493022856 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd4340c5070 0x7fd43414a600 unknown :-1 s=CLOSED pgs=992 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:00.542 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:00.541+0000 7fd439e10640 1 --2- 172.21.15.73:0/1493022856 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd43406db70 0x7fd434070b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:00.542 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:00.541+0000 7fd439e10640 1 -- 172.21.15.73:0/1493022856 >> 172.21.15.73:0/1493022856 conn(0x7fd4340a8130 msgr2=0x7fd4340a66c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:47:00.543 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:00.541+0000 7fd439e10640 1 -- 172.21.15.73:0/1493022856 shutdown_connections 2023-12-12T09:47:00.543 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:00.541+0000 7fd439e10640 1 -- 172.21.15.73:0/1493022856 wait complete. 2023-12-12T09:47:00.560 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-12T09:43:15.525508+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 12, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-12T09:46:24.716544+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '74', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 13, 'pool_name': 'cephfs_data', 'create_time': '2023-12-12T09:46:25.435954+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '75', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 14, 'pool_name': 'cephfs2_metadata', 'create_time': '2023-12-12T09:46:40.116878+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '78', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs2'}}, 'read_balance': {'score_acting': 2.5, 'score_stable': 2.5, 'optimal_score': 1, 'raw_score_acting': 2.5, 'raw_score_stable': 2.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 15, 'pool_name': 'cephfs2_data', 'create_time': '2023-12-12T09:46:40.798840+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '79', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs2'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-12T09:47:00.561 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-12T09:47:00.781 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:00.780+0000 7f7571e17640 1 Processor -- start 2023-12-12T09:47:00.781 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:00.780+0000 7f7571e17640 1 -- start start 2023-12-12T09:47:00.782 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:00.781+0000 7f7571e17640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f756c14f8c0 0x7f756c06dc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:00.782 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:00.781+0000 7f7571e17640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f756c0c16c0 con 0x7f756c06d350 2023-12-12T09:47:00.782 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:00.782+0000 7f7571e17640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f756c0c19a0 con 0x7f756c152500 2023-12-12T09:47:00.782 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:00.782+0000 7f7571e17640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f756c0c1090 con 0x7f756c14f8c0 2023-12-12T09:47:00.782 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:00.782+0000 7f756affd640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f756c06d350 0x7f756c071e60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:54276/0 (socket says 172.21.15.73:54276) 2023-12-12T09:47:00.783 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:00.782+0000 7f756affd640 1 -- 172.21.15.73:0/2050638936 learned_addr learned my addr 172.21.15.73:0/2050638936 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-12T09:47:00.783 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:00.782+0000 7f756b7fe640 1 --2- 172.21.15.73:0/2050638936 >> v2:172.21.15.73:3300/0 conn(0x7f756c14f8c0 0x7f756c06dc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:00.783 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:00.782+0000 7f756b7fe640 1 -- 172.21.15.73:0/2050638936 >> v1:172.21.15.142:6789/0 conn(0x7f756c152500 legacy=0x7f756c152990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:47:00.783 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:00.782+0000 7f756b7fe640 1 -- 172.21.15.73:0/2050638936 >> v1:172.21.15.73:6789/0 conn(0x7f756c06d350 legacy=0x7f756c071e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:00.783 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:00.782+0000 7f756b7fe640 1 -- 172.21.15.73:0/2050638936 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f756c0c1c80 con 0x7f756c14f8c0 2023-12-12T09:47:00.783 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:00.782+0000 7f756a7fc640 1 -- 172.21.15.73:0/2050638936 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2758753993 0 0) 0x7f756c0c16c0 con 0x7f756c06d350 2023-12-12T09:47:00.784 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:00.784+0000 7f756b7fe640 1 --2- 172.21.15.73:0/2050638936 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f756c14f8c0 0x7f756c06dc40 secure :-1 s=READY pgs=994 cs=0 l=1 rev1=1 crypto rx=0x7f755c0097a0 tx=0x7f755c02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=216f06337a44cafb server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:47:00.784 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:00.784+0000 7f756a7fc640 1 -- 172.21.15.73:0/2050638936 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f755c031830 con 0x7f756c14f8c0 2023-12-12T09:47:00.784 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:00.784+0000 7f756a7fc640 1 -- 172.21.15.73:0/2050638936 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f755c031990 con 0x7f756c14f8c0 2023-12-12T09:47:00.784 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:00.784+0000 7f756a7fc640 1 -- 172.21.15.73:0/2050638936 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f755c031d20 con 0x7f756c14f8c0 2023-12-12T09:47:00.785 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:00.784+0000 7f7571e17640 1 -- 172.21.15.73:0/2050638936 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f756c14f8c0 msgr2=0x7f756c06dc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:00.785 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:00.784+0000 7f7571e17640 1 --2- 172.21.15.73:0/2050638936 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f756c14f8c0 0x7f756c06dc40 secure :-1 s=READY pgs=994 cs=0 l=1 rev1=1 crypto rx=0x7f755c0097a0 tx=0x7f755c02b8d0 comp rx=0 tx=0).stop 2023-12-12T09:47:00.785 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:00.785+0000 7f7571e17640 1 -- 172.21.15.73:0/2050638936 shutdown_connections 2023-12-12T09:47:00.785 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:00.785+0000 7f7571e17640 1 --2- 172.21.15.73:0/2050638936 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f756c14f8c0 0x7f756c06dc40 unknown :-1 s=CLOSED pgs=994 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:00.785 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:00.785+0000 7f7571e17640 1 -- 172.21.15.73:0/2050638936 >> 172.21.15.73:0/2050638936 conn(0x7f756c06a4e0 msgr2=0x7f756c06a8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:47:00.786 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:00.785+0000 7f7571e17640 1 -- 172.21.15.73:0/2050638936 shutdown_connections 2023-12-12T09:47:00.786 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:00.785+0000 7f7571e17640 1 -- 172.21.15.73:0/2050638936 wait complete. 2023-12-12T09:47:00.787 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:00.786+0000 7f7571e17640 1 Processor -- start 2023-12-12T09:47:00.787 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:00.787+0000 7f7571e17640 1 -- start start 2023-12-12T09:47:00.788 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:00.787+0000 7f7571e17640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f756c06d350 0x7f756c071050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:00.789 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:00.787+0000 7f7571e17640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f756c14f8c0 0x7f756c0bf510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:00.789 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:00.787+0000 7f7571e17640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f756c152500 0x7f756c0bfa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:00.789 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:00.788+0000 7f7571e17640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f756c1ee0e0 con 0x7f756c06d350 2023-12-12T09:47:00.789 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:00.788+0000 7f7571e17640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f756c148dc0 con 0x7f756c152500 2023-12-12T09:47:00.789 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:00.788+0000 7f7571e17640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f756c0ab710 con 0x7f756c14f8c0 2023-12-12T09:47:00.789 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:00.788+0000 7f756b7fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f756c06d350 0x7f756c071050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:00.789 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:00.788+0000 7f756b7fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f756c06d350 0x7f756c071050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:56000/0 (socket says 172.21.15.73:56000) 2023-12-12T09:47:00.789 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:00.788+0000 7f756b7fe640 1 -- 172.21.15.73:0/2433484281 learned_addr learned my addr 172.21.15.73:0/2433484281 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:47:00.789 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:00.788+0000 7f756b7fe640 1 -- 172.21.15.73:0/2433484281 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f756c14f8c0 msgr2=0x7f756c0bf510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:00.789 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:00.788+0000 7f756b7fe640 1 --2- 172.21.15.73:0/2433484281 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f756c14f8c0 0x7f756c0bf510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:00.789 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:00.788+0000 7f756b7fe640 1 -- 172.21.15.73:0/2433484281 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f756c152500 msgr2=0x7f756c0bfa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:00.789 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:00.788+0000 7f756b7fe640 1 --2- 172.21.15.73:0/2433484281 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f756c152500 0x7f756c0bfa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:00.789 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:00.788+0000 7f756b7fe640 1 -- 172.21.15.73:0/2433484281 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f755c009400 con 0x7f756c06d350 2023-12-12T09:47:00.790 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:00.788+0000 7f756b7fe640 1 --2- 172.21.15.73:0/2433484281 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f756c06d350 0x7f756c071050 secure :-1 s=READY pgs=995 cs=0 l=1 rev1=1 crypto rx=0x7f755c0098c0 tx=0x7f755c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:47:00.790 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:00.789+0000 7f7553fff640 1 -- 172.21.15.73:0/2433484281 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f755c03ba70 con 0x7f756c06d350 2023-12-12T09:47:00.790 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:00.789+0000 7f7553fff640 1 -- 172.21.15.73:0/2433484281 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f755c03bbf0 con 0x7f756c06d350 2023-12-12T09:47:00.790 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:00.789+0000 7f7553fff640 1 -- 172.21.15.73:0/2433484281 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f755c0453f0 con 0x7f756c06d350 2023-12-12T09:47:00.790 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:00.789+0000 7f7571e17640 1 -- 172.21.15.73:0/2433484281 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f756c1ed460 con 0x7f756c06d350 2023-12-12T09:47:00.791 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:00.789+0000 7f7571e17640 1 -- 172.21.15.73:0/2433484281 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f756c1eda20 con 0x7f756c06d350 2023-12-12T09:47:00.791 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:00.790+0000 7f7571e17640 1 -- 172.21.15.73:0/2433484281 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f756c067070 con 0x7f756c06d350 2023-12-12T09:47:00.791 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:00.791+0000 7f7553fff640 1 -- 172.21.15.73:0/2433484281 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f755c045550 con 0x7f756c06d350 2023-12-12T09:47:00.792 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:00.792+0000 7f7553fff640 1 --2- 172.21.15.73:0/2433484281 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f755806ae40 0x7f755806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:00.792 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:00.792+0000 7f7553fff640 1 -- 172.21.15.73:0/2433484281 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f755c0abd30 con 0x7f756c06d350 2023-12-12T09:47:00.792 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:00.792+0000 7f756affd640 1 --2- 172.21.15.73:0/2433484281 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f755806ae40 0x7f755806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:00.793 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:00.793+0000 7f756affd640 1 --2- 172.21.15.73:0/2433484281 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f755806ae40 0x7f755806d300 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f7560007fd0 tx=0x7f7560007920 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:47:00.796 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:00.796+0000 7f7553fff640 1 -- 172.21.15.73:0/2433484281 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f755c076ba0 con 0x7f756c06d350 2023-12-12T09:47:00.985 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:00.985+0000 7f7571e17640 1 -- 172.21.15.73:0/2433484281 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f756c067580 con 0x7f756c06d350 2023-12-12T09:47:00.986 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:00.986+0000 7f7553fff640 1 -- 172.21.15.73:0/2433484281 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v79) v1 ==== 93+0+10 (secure 0 0 0) 0x7f755c035020 con 0x7f756c06d350 2023-12-12T09:47:00.986 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 1 2023-12-12T09:47:00.989 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:00.988+0000 7f7571e17640 1 -- 172.21.15.73:0/2433484281 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f755806ae40 msgr2=0x7f755806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:00.989 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:00.988+0000 7f7571e17640 1 --2- 172.21.15.73:0/2433484281 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f755806ae40 0x7f755806d300 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f7560007fd0 tx=0x7f7560007920 comp rx=0 tx=0).stop 2023-12-12T09:47:00.989 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:00.988+0000 7f7571e17640 1 -- 172.21.15.73:0/2433484281 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f756c06d350 msgr2=0x7f756c071050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:00.989 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:00.988+0000 7f7571e17640 1 --2- 172.21.15.73:0/2433484281 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f756c06d350 0x7f756c071050 secure :-1 s=READY pgs=995 cs=0 l=1 rev1=1 crypto rx=0x7f755c0098c0 tx=0x7f755c0046c0 comp rx=0 tx=0).stop 2023-12-12T09:47:00.989 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:00.988+0000 7f7571e17640 1 -- 172.21.15.73:0/2433484281 shutdown_connections 2023-12-12T09:47:00.990 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:00.988+0000 7f7571e17640 1 --2- 172.21.15.73:0/2433484281 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f755806ae40 0x7f755806d300 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:00.990 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:00.988+0000 7f7571e17640 1 --2- 172.21.15.73:0/2433484281 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f756c152500 0x7f756c0bfa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:00.990 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:00.988+0000 7f7571e17640 1 --2- 172.21.15.73:0/2433484281 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f756c14f8c0 0x7f756c0bf510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:00.990 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:00.988+0000 7f7571e17640 1 --2- 172.21.15.73:0/2433484281 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f756c06d350 0x7f756c071050 unknown :-1 s=CLOSED pgs=995 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:00.990 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:00.988+0000 7f7571e17640 1 -- 172.21.15.73:0/2433484281 >> 172.21.15.73:0/2433484281 conn(0x7f756c06a4e0 msgr2=0x7f756c0c3780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:47:00.990 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:00.989+0000 7f7571e17640 1 -- 172.21.15.73:0/2433484281 shutdown_connections 2023-12-12T09:47:00.990 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:00.989+0000 7f7571e17640 1 -- 172.21.15.73:0/2433484281 wait complete. 2023-12-12T09:47:01.006 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-12T09:47:01.218 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:01.217+0000 7f13e59a9640 1 Processor -- start 2023-12-12T09:47:01.218 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:01.218+0000 7f13e59a9640 1 -- start start 2023-12-12T09:47:01.223 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:01.219+0000 7f13e59a9640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f13e00c6ba0 0x7f13e01550a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:01.223 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:01.219+0000 7f13e59a9640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13e006c890 con 0x7f13e00c7ed0 2023-12-12T09:47:01.223 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:01.219+0000 7f13e59a9640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13e00c6fd0 con 0x7f13e00c67c0 2023-12-12T09:47:01.223 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:01.219+0000 7f13e59a9640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13e00c8360 con 0x7f13e00c6ba0 2023-12-12T09:47:01.223 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:01.219+0000 7f13df7fe640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f13e00c6ba0 0x7f13e01550a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:01.223 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:01.219+0000 7f13de7fc640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f13e00c7ed0 0x7f13e015cf90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:54292/0 (socket says 172.21.15.73:54292) 2023-12-12T09:47:01.224 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:01.219+0000 7f13df7fe640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f13e00c6ba0 0x7f13e01550a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:56004/0 (socket says 172.21.15.73:56004) 2023-12-12T09:47:01.224 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:01.219+0000 7f13de7fc640 1 -- 172.21.15.73:0/686029065 learned_addr learned my addr 172.21.15.73:0/686029065 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-12T09:47:01.224 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:01.220+0000 7f13df7fe640 1 -- 172.21.15.73:0/686029065 >> v1:172.21.15.142:6789/0 conn(0x7f13e00c67c0 legacy=0x7f13e006c180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:47:01.224 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:01.220+0000 7f13df7fe640 1 -- 172.21.15.73:0/686029065 >> v1:172.21.15.73:6789/0 conn(0x7f13e00c7ed0 legacy=0x7f13e015cf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:01.224 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:01.220+0000 7f13df7fe640 1 -- 172.21.15.73:0/686029065 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13e00c4af0 con 0x7f13e00c6ba0 2023-12-12T09:47:01.224 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:01.221+0000 7f13df7fe640 1 --2- 172.21.15.73:0/686029065 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f13e00c6ba0 0x7f13e01550a0 secure :-1 s=READY pgs=997 cs=0 l=1 rev1=1 crypto rx=0x7f13d80097a0 tx=0x7f13d802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb1e7cf130c38608 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:47:01.224 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:01.221+0000 7f13ddffb640 1 -- 172.21.15.73:0/686029065 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13d8031830 con 0x7f13e00c6ba0 2023-12-12T09:47:01.224 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:01.221+0000 7f13ddffb640 1 -- 172.21.15.73:0/686029065 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13d8031990 con 0x7f13e00c6ba0 2023-12-12T09:47:01.224 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:01.221+0000 7f13ddffb640 1 -- 172.21.15.73:0/686029065 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13d8031d20 con 0x7f13e00c6ba0 2023-12-12T09:47:01.224 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:01.222+0000 7f13e59a9640 1 -- 172.21.15.73:0/686029065 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f13e00c6ba0 msgr2=0x7f13e01550a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:01.224 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:01.222+0000 7f13e59a9640 1 --2- 172.21.15.73:0/686029065 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f13e00c6ba0 0x7f13e01550a0 secure :-1 s=READY pgs=997 cs=0 l=1 rev1=1 crypto rx=0x7f13d80097a0 tx=0x7f13d802b8d0 comp rx=0 tx=0).stop 2023-12-12T09:47:01.224 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:01.222+0000 7f13e59a9640 1 -- 172.21.15.73:0/686029065 shutdown_connections 2023-12-12T09:47:01.224 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:01.222+0000 7f13e59a9640 1 --2- 172.21.15.73:0/686029065 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f13e00c6ba0 0x7f13e01550a0 unknown :-1 s=CLOSED pgs=997 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:01.224 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:01.222+0000 7f13e59a9640 1 -- 172.21.15.73:0/686029065 >> 172.21.15.73:0/686029065 conn(0x7f13e00abb20 msgr2=0x7f13e00abf30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:47:01.225 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:01.222+0000 7f13e59a9640 1 -- 172.21.15.73:0/686029065 shutdown_connections 2023-12-12T09:47:01.225 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:01.222+0000 7f13e59a9640 1 -- 172.21.15.73:0/686029065 wait complete. 2023-12-12T09:47:01.226 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:01.223+0000 7f13e59a9640 1 Processor -- start 2023-12-12T09:47:01.227 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:01.224+0000 7f13e59a9640 1 -- start start 2023-12-12T09:47:01.227 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:01.224+0000 7f13e59a9640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f13e00c67c0 0x7f13e00aee30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:01.227 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:01.224+0000 7f13e59a9640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f13e00c6ba0 0x7f13e0145ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:01.227 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:01.224+0000 7f13e59a9640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f13e00c7ed0 0x7f13e0146430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:01.227 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:01.224+0000 7f13e59a9640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13e01ebd30 con 0x7f13e00c67c0 2023-12-12T09:47:01.227 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:01.224+0000 7f13e59a9640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13e0156a60 con 0x7f13e00c6ba0 2023-12-12T09:47:01.227 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:01.224+0000 7f13e59a9640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13e0156cb0 con 0x7f13e00c7ed0 2023-12-12T09:47:01.227 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:01.225+0000 7f13deffd640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f13e00c67c0 0x7f13e00aee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:01.227 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:01.225+0000 7f13deffd640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f13e00c67c0 0x7f13e00aee30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:56012/0 (socket says 172.21.15.73:56012) 2023-12-12T09:47:01.227 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:01.225+0000 7f13deffd640 1 -- 172.21.15.73:0/3065890313 learned_addr learned my addr 172.21.15.73:0/3065890313 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:47:01.227 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:01.225+0000 7f13deffd640 1 -- 172.21.15.73:0/3065890313 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f13e00c7ed0 msgr2=0x7f13e0146430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:01.227 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:01.225+0000 7f13deffd640 1 --2- 172.21.15.73:0/3065890313 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f13e00c7ed0 0x7f13e0146430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:01.227 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:01.225+0000 7f13deffd640 1 -- 172.21.15.73:0/3065890313 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f13e00c6ba0 msgr2=0x7f13e0145ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:01.227 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:01.225+0000 7f13deffd640 1 --2- 172.21.15.73:0/3065890313 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f13e00c6ba0 0x7f13e0145ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:01.228 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:01.225+0000 7f13deffd640 1 -- 172.21.15.73:0/3065890313 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13d8009400 con 0x7f13e00c67c0 2023-12-12T09:47:01.228 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:01.225+0000 7f13deffd640 1 --2- 172.21.15.73:0/3065890313 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f13e00c67c0 0x7f13e00aee30 secure :-1 s=READY pgs=998 cs=0 l=1 rev1=1 crypto rx=0x7f13d000c7c0 tx=0x7f13d000cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:47:01.228 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:01.226+0000 7f13d7fff640 1 -- 172.21.15.73:0/3065890313 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13d000aa50 con 0x7f13e00c67c0 2023-12-12T09:47:01.228 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:01.226+0000 7f13d7fff640 1 -- 172.21.15.73:0/3065890313 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13d000abb0 con 0x7f13e00c67c0 2023-12-12T09:47:01.228 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:01.226+0000 7f13e59a9640 1 -- 172.21.15.73:0/3065890313 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13e01eb670 con 0x7f13e00c67c0 2023-12-12T09:47:01.228 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:01.226+0000 7f13d7fff640 1 -- 172.21.15.73:0/3065890313 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13d0012420 con 0x7f13e00c67c0 2023-12-12T09:47:01.228 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:01.226+0000 7f13e59a9640 1 -- 172.21.15.73:0/3065890313 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13e00c1290 con 0x7f13e00c67c0 2023-12-12T09:47:01.228 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:01.227+0000 7f13e59a9640 1 -- 172.21.15.73:0/3065890313 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f13e0067580 con 0x7f13e00c67c0 2023-12-12T09:47:01.229 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:01.228+0000 7f13d7fff640 1 -- 172.21.15.73:0/3065890313 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f13d0012580 con 0x7f13e00c67c0 2023-12-12T09:47:01.229 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:01.229+0000 7f13d7fff640 1 --2- 172.21.15.73:0/3065890313 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f13c006ae40 0x7f13c006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:01.229 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:01.229+0000 7f13d7fff640 1 -- 172.21.15.73:0/3065890313 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f13d0089ba0 con 0x7f13e00c67c0 2023-12-12T09:47:01.229 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:01.229+0000 7f13de7fc640 1 --2- 172.21.15.73:0/3065890313 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f13c006ae40 0x7f13c006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:01.230 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:01.230+0000 7f13de7fc640 1 --2- 172.21.15.73:0/3065890313 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f13c006ae40 0x7f13c006d300 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f13e00bd310 tx=0x7f13c8007a40 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:47:01.233 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:01.233+0000 7f13d7fff640 1 -- 172.21.15.73:0/3065890313 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f13d0054980 con 0x7f13e00c67c0 2023-12-12T09:47:01.426 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:01.425+0000 7f13e59a9640 1 -- 172.21.15.73:0/3065890313 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f13e006d140 con 0x7f13e00c67c0 2023-12-12T09:47:01.426 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:01.426+0000 7f13d7fff640 1 -- 172.21.15.73:0/3065890313 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v79) v1 ==== 104+0+11 (secure 0 0 0) 0x7f13d0057fa0 con 0x7f13e00c67c0 2023-12-12T09:47:01.427 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 32 2023-12-12T09:47:01.430 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:01.429+0000 7f13e59a9640 1 -- 172.21.15.73:0/3065890313 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f13c006ae40 msgr2=0x7f13c006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:01.430 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:01.429+0000 7f13e59a9640 1 --2- 172.21.15.73:0/3065890313 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f13c006ae40 0x7f13c006d300 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f13e00bd310 tx=0x7f13c8007a40 comp rx=0 tx=0).stop 2023-12-12T09:47:01.430 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:01.429+0000 7f13e59a9640 1 -- 172.21.15.73:0/3065890313 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f13e00c67c0 msgr2=0x7f13e00aee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:01.430 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:01.429+0000 7f13e59a9640 1 --2- 172.21.15.73:0/3065890313 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f13e00c67c0 0x7f13e00aee30 secure :-1 s=READY pgs=998 cs=0 l=1 rev1=1 crypto rx=0x7f13d000c7c0 tx=0x7f13d000cc80 comp rx=0 tx=0).stop 2023-12-12T09:47:01.430 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:01.429+0000 7f13e59a9640 1 -- 172.21.15.73:0/3065890313 shutdown_connections 2023-12-12T09:47:01.430 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:01.429+0000 7f13e59a9640 1 --2- 172.21.15.73:0/3065890313 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f13c006ae40 0x7f13c006d300 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:01.430 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:01.429+0000 7f13e59a9640 1 --2- 172.21.15.73:0/3065890313 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f13e00c7ed0 0x7f13e0146430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:01.430 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:01.429+0000 7f13e59a9640 1 --2- 172.21.15.73:0/3065890313 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f13e00c6ba0 0x7f13e0145ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:01.430 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:01.429+0000 7f13e59a9640 1 --2- 172.21.15.73:0/3065890313 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f13e00c67c0 0x7f13e00aee30 unknown :-1 s=CLOSED pgs=998 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:01.430 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:01.429+0000 7f13e59a9640 1 -- 172.21.15.73:0/3065890313 >> 172.21.15.73:0/3065890313 conn(0x7f13e00abb20 msgr2=0x7f13e00c8d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:47:01.430 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:01.429+0000 7f13e59a9640 1 -- 172.21.15.73:0/3065890313 shutdown_connections 2023-12-12T09:47:01.430 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:01.429+0000 7f13e59a9640 1 -- 172.21.15.73:0/3065890313 wait complete. 2023-12-12T09:47:01.448 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-12T09:47:01.663 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:01.663+0000 7f4a24790640 1 Processor -- start 2023-12-12T09:47:01.664 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:01.663+0000 7f4a24790640 1 -- start start 2023-12-12T09:47:01.665 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:01.664+0000 7f4a24790640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4a1c0c5420 0x7f4a1c0c0320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:01.665 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:01.664+0000 7f4a24790640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a1c0c3390 con 0x7f4a1c14ea60 2023-12-12T09:47:01.665 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:01.665+0000 7f4a24790640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a1c0c4b30 con 0x7f4a1c0a4c90 2023-12-12T09:47:01.665 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:01.665+0000 7f4a24790640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a1c151e60 con 0x7f4a1c0c5420 2023-12-12T09:47:01.665 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:01.665+0000 7f4a2252c640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f4a1c14ea60 0x7f4a1c0c4420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:54302/0 (socket says 172.21.15.73:54302) 2023-12-12T09:47:01.666 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:01.665+0000 7f4a2252c640 1 -- 172.21.15.73:0/19503897 learned_addr learned my addr 172.21.15.73:0/19503897 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-12T09:47:01.667 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:01.665+0000 7f4a2152a640 1 -- 172.21.15.73:0/19503897 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3020825862 0 0) 0x7f4a1c0c3390 con 0x7f4a1c14ea60 2023-12-12T09:47:01.668 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:01.665+0000 7f4a2152a640 1 -- 172.21.15.73:0/19503897 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4a08005730 con 0x7f4a1c14ea60 2023-12-12T09:47:01.668 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:01.665+0000 7f4a22d2d640 1 --2- 172.21.15.73:0/19503897 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4a1c0c5420 0x7f4a1c0c0320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:01.668 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:01.665+0000 7f4a2152a640 1 -- 172.21.15.73:0/19503897 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4132267344 0 0) 0x7f4a08005730 con 0x7f4a1c14ea60 2023-12-12T09:47:01.668 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:01.665+0000 7f4a2152a640 1 -- 172.21.15.73:0/19503897 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4a1c0c5420 msgr2=0x7f4a1c0c0320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:47:01.668 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:01.665+0000 7f4a2152a640 1 --2- 172.21.15.73:0/19503897 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4a1c0c5420 0x7f4a1c0c0320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:01.668 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:01.665+0000 7f4a2152a640 1 -- 172.21.15.73:0/19503897 >> v1:172.21.15.142:6789/0 conn(0x7f4a1c0a4c90 legacy=0x7f4a1c0c20b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:47:01.668 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:01.665+0000 7f4a2152a640 1 -- 172.21.15.73:0/19503897 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a1c152140 con 0x7f4a1c14ea60 2023-12-12T09:47:01.668 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:01.666+0000 7f4a2152a640 1 -- 172.21.15.73:0/19503897 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3186547832 0 0) 0x7f4a18001670 con 0x7f4a1c14ea60 2023-12-12T09:47:01.668 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:01.666+0000 7f4a2152a640 1 -- 172.21.15.73:0/19503897 >> v1:172.21.15.73:6789/0 conn(0x7f4a1c14ea60 legacy=0x7f4a1c0c4420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:01.668 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:01.666+0000 7f4a2152a640 1 --2- 172.21.15.73:0/19503897 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4a08005bb0 0x7f4a08005fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:01.668 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:01.666+0000 7f4a2152a640 1 --2- 172.21.15.73:0/19503897 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4a080069d0 0x7f4a08006e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:01.668 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:01.666+0000 7f4a2152a640 1 --2- 172.21.15.73:0/19503897 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4a1c0c5420 0x7f4a0800db90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:01.669 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:01.666+0000 7f4a2152a640 1 -- 172.21.15.73:0/19503897 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a1c151e60 con 0x7f4a080069d0 2023-12-12T09:47:01.669 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:01.666+0000 7f4a2152a640 1 -- 172.21.15.73:0/19503897 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a080076f0 con 0x7f4a08005bb0 2023-12-12T09:47:01.669 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:01.666+0000 7f4a2152a640 1 -- 172.21.15.73:0/19503897 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a08007860 con 0x7f4a1c0c5420 2023-12-12T09:47:01.669 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:01.666+0000 7f4a21d2b640 1 --2- 172.21.15.73:0/19503897 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4a080069d0 0x7f4a08006e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:01.669 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:01.666+0000 7f4a2252c640 1 --2- 172.21.15.73:0/19503897 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4a08005bb0 0x7f4a08005fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:01.669 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:01.666+0000 7f4a22d2d640 1 --2- 172.21.15.73:0/19503897 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4a1c0c5420 0x7f4a0800db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:01.669 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:01.666+0000 7f4a21d2b640 1 -- 172.21.15.73:0/19503897 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4a1c0c5420 msgr2=0x7f4a0800db90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:47:01.669 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:01.666+0000 7f4a21d2b640 1 --2- 172.21.15.73:0/19503897 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4a1c0c5420 0x7f4a0800db90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:01.669 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:01.666+0000 7f4a21d2b640 1 -- 172.21.15.73:0/19503897 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4a08005bb0 msgr2=0x7f4a08005fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:47:01.669 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:01.667+0000 7f4a21d2b640 1 --2- 172.21.15.73:0/19503897 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4a08005bb0 0x7f4a08005fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:01.669 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:01.667+0000 7f4a21d2b640 1 -- 172.21.15.73:0/19503897 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a08005730 con 0x7f4a080069d0 2023-12-12T09:47:01.670 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:01.668+0000 7f4a21d2b640 1 --2- 172.21.15.73:0/19503897 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4a080069d0 0x7f4a08006e50 secure :-1 s=READY pgs=1000 cs=0 l=1 rev1=1 crypto rx=0x7f4a0c003de0 tx=0x7f4a08007a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4451031333fee92a server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:47:01.671 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:01.668+0000 7f4a2152a640 1 -- 172.21.15.73:0/19503897 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a0c032600 con 0x7f4a080069d0 2023-12-12T09:47:01.671 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:01.668+0000 7f4a2152a640 1 -- 172.21.15.73:0/19503897 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a0c02e050 con 0x7f4a080069d0 2023-12-12T09:47:01.671 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:01.668+0000 7f4a2152a640 1 -- 172.21.15.73:0/19503897 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a0c0329a0 con 0x7f4a080069d0 2023-12-12T09:47:01.671 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:01.668+0000 7f4a24790640 1 -- 172.21.15.73:0/19503897 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4a080069d0 msgr2=0x7f4a08006e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:01.671 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:01.668+0000 7f4a24790640 1 --2- 172.21.15.73:0/19503897 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4a080069d0 0x7f4a08006e50 secure :-1 s=READY pgs=1000 cs=0 l=1 rev1=1 crypto rx=0x7f4a0c003de0 tx=0x7f4a08007a00 comp rx=0 tx=0).stop 2023-12-12T09:47:01.671 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:01.668+0000 7f4a22d2d640 1 -- 172.21.15.73:0/19503897 reap_dead start 2023-12-12T09:47:01.671 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:01.669+0000 7f4a24790640 1 -- 172.21.15.73:0/19503897 shutdown_connections 2023-12-12T09:47:01.671 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:01.669+0000 7f4a24790640 1 -- 172.21.15.73:0/19503897 >> 172.21.15.73:0/19503897 conn(0x7f4a1c06a4e0 msgr2=0x7f4a1c06a8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:47:01.671 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:01.669+0000 7f4a24790640 1 -- 172.21.15.73:0/19503897 shutdown_connections 2023-12-12T09:47:01.671 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:01.669+0000 7f4a24790640 1 -- 172.21.15.73:0/19503897 wait complete. 2023-12-12T09:47:01.671 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:01.670+0000 7f4a24790640 1 Processor -- start 2023-12-12T09:47:01.673 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:01.671+0000 7f4a24790640 1 -- start start 2023-12-12T09:47:01.673 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:01.671+0000 7f4a24790640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4a080069d0 0x7f4a1c14fac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:01.673 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:01.671+0000 7f4a24790640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4a1c0c0070 0x7f4a1c1420a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:01.673 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:01.671+0000 7f4a24790640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4a1c0a8a10 0x7f4a1c0a8e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:01.674 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:01.671+0000 7f4a24790640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a1c150940 con 0x7f4a1c0a8a10 2023-12-12T09:47:01.674 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:01.671+0000 7f4a24790640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a1c1527e0 con 0x7f4a080069d0 2023-12-12T09:47:01.674 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:01.671+0000 7f4a24790640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a1c150e00 con 0x7f4a1c0c0070 2023-12-12T09:47:01.674 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:01.672+0000 7f4a22d2d640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4a1c0a8a10 0x7f4a1c0a8e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:01.674 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:01.672+0000 7f4a22d2d640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4a1c0a8a10 0x7f4a1c0a8e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:56024/0 (socket says 172.21.15.73:56024) 2023-12-12T09:47:01.674 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:01.672+0000 7f4a22d2d640 1 -- 172.21.15.73:0/1333884613 learned_addr learned my addr 172.21.15.73:0/1333884613 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:47:01.674 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:01.672+0000 7f4a21d2b640 1 --2- 172.21.15.73:0/1333884613 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4a1c0c0070 0x7f4a1c1420a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:01.674 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:01.672+0000 7f4a2252c640 1 --2- 172.21.15.73:0/1333884613 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4a080069d0 0x7f4a1c14fac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:01.674 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:01.672+0000 7f4a22d2d640 1 -- 172.21.15.73:0/1333884613 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4a1c0c0070 msgr2=0x7f4a1c1420a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:01.674 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:01.672+0000 7f4a22d2d640 1 --2- 172.21.15.73:0/1333884613 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4a1c0c0070 0x7f4a1c1420a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:01.674 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:01.672+0000 7f4a22d2d640 1 -- 172.21.15.73:0/1333884613 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4a080069d0 msgr2=0x7f4a1c14fac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:01.674 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:01.672+0000 7f4a22d2d640 1 --2- 172.21.15.73:0/1333884613 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4a080069d0 0x7f4a1c14fac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:01.674 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:01.672+0000 7f4a22d2d640 1 -- 172.21.15.73:0/1333884613 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a1c1500a0 con 0x7f4a1c0a8a10 2023-12-12T09:47:01.674 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:01.672+0000 7f4a22d2d640 1 --2- 172.21.15.73:0/1333884613 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4a1c0a8a10 0x7f4a1c0a8e90 secure :-1 s=READY pgs=1001 cs=0 l=1 rev1=1 crypto rx=0x7f4a1c0a8680 tx=0x7f4a14009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:47:01.674 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:01.673+0000 7f4a12ffd640 1 -- 172.21.15.73:0/1333884613 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a14007db0 con 0x7f4a1c0a8a10 2023-12-12T09:47:01.675 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:01.673+0000 7f4a12ffd640 1 -- 172.21.15.73:0/1333884613 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a1400f050 con 0x7f4a1c0a8a10 2023-12-12T09:47:01.675 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:01.673+0000 7f4a12ffd640 1 -- 172.21.15.73:0/1333884613 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a14014650 con 0x7f4a1c0a8a10 2023-12-12T09:47:01.675 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:01.673+0000 7f4a24790640 1 -- 172.21.15.73:0/1333884613 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a1c150380 con 0x7f4a1c0a8a10 2023-12-12T09:47:01.675 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:01.673+0000 7f4a24790640 1 -- 172.21.15.73:0/1333884613 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a1c153df0 con 0x7f4a1c0a8a10 2023-12-12T09:47:01.675 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:01.674+0000 7f4a24790640 1 -- 172.21.15.73:0/1333884613 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a1c153c30 con 0x7f4a1c0a8a10 2023-12-12T09:47:01.675 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:01.675+0000 7f4a12ffd640 1 -- 172.21.15.73:0/1333884613 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f4a140147b0 con 0x7f4a1c0a8a10 2023-12-12T09:47:01.676 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:01.676+0000 7f4a12ffd640 1 --2- 172.21.15.73:0/1333884613 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f4a0006ae40 0x7f4a0006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:01.676 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:01.676+0000 7f4a12ffd640 1 -- 172.21.15.73:0/1333884613 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f4a1408a080 con 0x7f4a1c0a8a10 2023-12-12T09:47:01.676 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:01.676+0000 7f4a2252c640 1 --2- 172.21.15.73:0/1333884613 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f4a0006ae40 0x7f4a0006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:01.677 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:01.677+0000 7f4a2252c640 1 --2- 172.21.15.73:0/1333884613 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f4a0006ae40 0x7f4a0006d300 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f4a18001eb0 tx=0x7f4a18001b70 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:47:01.681 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:01.680+0000 7f4a12ffd640 1 -- 172.21.15.73:0/1333884613 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f4a14054d30 con 0x7f4a1c0a8a10 2023-12-12T09:47:01.873 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:01.873+0000 7f4a24790640 1 -- 172.21.15.73:0/1333884613 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f4a1c067070 con 0x7f4a1c0a8a10 2023-12-12T09:47:01.874 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:01.873+0000 7f4a12ffd640 1 -- 172.21.15.73:0/1333884613 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v79) v1 ==== 100+0+11 (secure 0 0 0) 0x7f4a14058350 con 0x7f4a1c0a8a10 2023-12-12T09:47:01.874 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 64 2023-12-12T09:47:01.877 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:01.876+0000 7f4a24790640 1 -- 172.21.15.73:0/1333884613 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f4a0006ae40 msgr2=0x7f4a0006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:01.877 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:01.876+0000 7f4a24790640 1 --2- 172.21.15.73:0/1333884613 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f4a0006ae40 0x7f4a0006d300 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f4a18001eb0 tx=0x7f4a18001b70 comp rx=0 tx=0).stop 2023-12-12T09:47:01.878 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:01.876+0000 7f4a24790640 1 -- 172.21.15.73:0/1333884613 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4a1c0a8a10 msgr2=0x7f4a1c0a8e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:01.878 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:01.876+0000 7f4a24790640 1 --2- 172.21.15.73:0/1333884613 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4a1c0a8a10 0x7f4a1c0a8e90 secure :-1 s=READY pgs=1001 cs=0 l=1 rev1=1 crypto rx=0x7f4a1c0a8680 tx=0x7f4a14009da0 comp rx=0 tx=0).stop 2023-12-12T09:47:01.878 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:01.877+0000 7f4a24790640 1 -- 172.21.15.73:0/1333884613 shutdown_connections 2023-12-12T09:47:01.878 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:01.877+0000 7f4a24790640 1 --2- 172.21.15.73:0/1333884613 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f4a0006ae40 0x7f4a0006d300 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:01.878 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:01.877+0000 7f4a24790640 1 --2- 172.21.15.73:0/1333884613 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4a1c0a8a10 0x7f4a1c0a8e90 unknown :-1 s=CLOSED pgs=1001 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:01.878 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:01.877+0000 7f4a24790640 1 --2- 172.21.15.73:0/1333884613 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4a1c0c0070 0x7f4a1c1420a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:01.878 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:01.877+0000 7f4a24790640 1 --2- 172.21.15.73:0/1333884613 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4a080069d0 0x7f4a1c14fac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:01.878 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:01.877+0000 7f4a24790640 1 -- 172.21.15.73:0/1333884613 >> 172.21.15.73:0/1333884613 conn(0x7f4a1c06a4e0 msgr2=0x7f4a1c0c08a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:47:01.878 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:01.877+0000 7f4a24790640 1 -- 172.21.15.73:0/1333884613 shutdown_connections 2023-12-12T09:47:01.878 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:01.877+0000 7f4a24790640 1 -- 172.21.15.73:0/1333884613 wait complete. 2023-12-12T09:47:01.897 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_metadata pg_num 2023-12-12T09:47:02.112 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:02.112+0000 7fc00f1e5640 1 Processor -- start 2023-12-12T09:47:02.112 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:02.112+0000 7fc00f1e5640 1 -- start start 2023-12-12T09:47:02.114 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:02.113+0000 7fc00f1e5640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fc00814f8c0 0x7fc00806dc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:02.114 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:02.113+0000 7fc00f1e5640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc008152500 0x7fc008152990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:02.114 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:02.113+0000 7fc00f1e5640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0080c16c0 con 0x7fc00806d350 2023-12-12T09:47:02.114 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:02.113+0000 7fc00f1e5640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0080c1090 con 0x7fc00814f8c0 2023-12-12T09:47:02.114 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:02.113+0000 7fc00f1e5640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0080c14b0 con 0x7fc008152500 2023-12-12T09:47:02.114 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:02.114+0000 7fc007fff640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7fc00806d350 0x7fc008071e60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:54304/0 (socket says 172.21.15.73:54304) 2023-12-12T09:47:02.114 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:02.114+0000 7fc007fff640 1 -- 172.21.15.73:0/1701958700 learned_addr learned my addr 172.21.15.73:0/1701958700 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-12T09:47:02.116 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:02.114+0000 7fc00d782640 1 --2- 172.21.15.73:0/1701958700 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc008152500 0x7fc008152990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:02.116 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:02.114+0000 7fc00cf81640 1 --2- 172.21.15.73:0/1701958700 >> v2:172.21.15.142:3300/0 conn(0x7fc00814f8c0 0x7fc00806dc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:02.117 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:02.114+0000 7fc0077fe640 1 -- 172.21.15.73:0/1701958700 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2865056816 0 0) 0x7fc0080c16c0 con 0x7fc00806d350 2023-12-12T09:47:02.117 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:02.114+0000 7fc0077fe640 1 -- 172.21.15.73:0/1701958700 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbff0003520 con 0x7fc00806d350 2023-12-12T09:47:02.117 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:02.115+0000 7fc0077fe640 1 -- 172.21.15.73:0/1701958700 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1193271550 0 0) 0x7fbff0003520 con 0x7fc00806d350 2023-12-12T09:47:02.117 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:02.115+0000 7fc0077fe640 1 -- 172.21.15.73:0/1701958700 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc008152500 msgr2=0x7fc008152990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:47:02.117 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:02.115+0000 7fc0077fe640 1 --2- 172.21.15.73:0/1701958700 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc008152500 0x7fc008152990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:02.117 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:02.115+0000 7fc0077fe640 1 -- 172.21.15.73:0/1701958700 >> v2:172.21.15.142:3300/0 conn(0x7fc00814f8c0 msgr2=0x7fc00806dc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:47:02.117 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:02.115+0000 7fc0077fe640 1 --2- 172.21.15.73:0/1701958700 >> v2:172.21.15.142:3300/0 conn(0x7fc00814f8c0 0x7fc00806dc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:02.117 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:02.115+0000 7fc0077fe640 1 -- 172.21.15.73:0/1701958700 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0080c19a0 con 0x7fc00806d350 2023-12-12T09:47:02.117 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:02.115+0000 7fc0077fe640 1 -- 172.21.15.73:0/1701958700 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3186547832 0 0) 0x7fbffc001670 con 0x7fc00806d350 2023-12-12T09:47:02.117 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:02.115+0000 7fc0077fe640 1 -- 172.21.15.73:0/1701958700 >> v1:172.21.15.73:6789/0 conn(0x7fc00806d350 legacy=0x7fc008071e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:02.117 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:02.115+0000 7fc0077fe640 1 --2- 172.21.15.73:0/1701958700 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc008152500 0x7fbff0003970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:02.117 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:02.115+0000 7fc0077fe640 1 --2- 172.21.15.73:0/1701958700 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbff0003ef0 0x7fbff00047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:02.117 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:02.115+0000 7fc0077fe640 1 --2- 172.21.15.73:0/1701958700 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbff0004d00 0x7fbff0005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:02.117 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:02.115+0000 7fc0077fe640 1 -- 172.21.15.73:0/1701958700 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0080c14b0 con 0x7fbff0003ef0 2023-12-12T09:47:02.118 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:02.115+0000 7fc0077fe640 1 -- 172.21.15.73:0/1701958700 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbff000b980 con 0x7fbff0004d00 2023-12-12T09:47:02.118 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:02.115+0000 7fc0077fe640 1 -- 172.21.15.73:0/1701958700 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbff000bac0 con 0x7fc008152500 2023-12-12T09:47:02.118 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:02.115+0000 7fc007fff640 1 --2- 172.21.15.73:0/1701958700 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbff0003ef0 0x7fbff00047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:02.118 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:02.115+0000 7fc00cf81640 1 --2- 172.21.15.73:0/1701958700 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc008152500 0x7fbff0003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:02.118 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:02.116+0000 7fc007fff640 1 -- 172.21.15.73:0/1701958700 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc008152500 msgr2=0x7fbff0003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:47:02.118 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:02.116+0000 7fc007fff640 1 --2- 172.21.15.73:0/1701958700 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc008152500 0x7fbff0003970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:02.118 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:02.116+0000 7fc007fff640 1 -- 172.21.15.73:0/1701958700 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbff0004d00 msgr2=0x7fbff0005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:47:02.118 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:02.116+0000 7fc007fff640 1 --2- 172.21.15.73:0/1701958700 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbff0004d00 0x7fbff0005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:02.118 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:02.116+0000 7fc007fff640 1 -- 172.21.15.73:0/1701958700 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbff0003520 con 0x7fbff0003ef0 2023-12-12T09:47:02.120 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:02.117+0000 7fc007fff640 1 --2- 172.21.15.73:0/1701958700 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbff0003ef0 0x7fbff00047c0 secure :-1 s=READY pgs=1003 cs=0 l=1 rev1=1 crypto rx=0x7fbffc00c240 tx=0x7fbff00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=254302240f793de server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:47:02.120 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:02.117+0000 7fc0077fe640 1 -- 172.21.15.73:0/1701958700 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbffc02cae0 con 0x7fbff0003ef0 2023-12-12T09:47:02.120 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:02.117+0000 7fc0077fe640 1 -- 172.21.15.73:0/1701958700 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbffc02cc40 con 0x7fbff0003ef0 2023-12-12T09:47:02.120 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:02.117+0000 7fc0077fe640 1 -- 172.21.15.73:0/1701958700 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbffc005af0 con 0x7fbff0003ef0 2023-12-12T09:47:02.120 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:02.117+0000 7fc00f1e5640 1 -- 172.21.15.73:0/1701958700 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbff0003ef0 msgr2=0x7fbff00047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:02.120 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:02.117+0000 7fc00f1e5640 1 --2- 172.21.15.73:0/1701958700 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbff0003ef0 0x7fbff00047c0 secure :-1 s=READY pgs=1003 cs=0 l=1 rev1=1 crypto rx=0x7fbffc00c240 tx=0x7fbff00057f0 comp rx=0 tx=0).stop 2023-12-12T09:47:02.120 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:02.117+0000 7fc00d782640 1 -- 172.21.15.73:0/1701958700 reap_dead start 2023-12-12T09:47:02.120 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:02.118+0000 7fc00f1e5640 1 -- 172.21.15.73:0/1701958700 shutdown_connections 2023-12-12T09:47:02.120 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:02.118+0000 7fc00f1e5640 1 -- 172.21.15.73:0/1701958700 >> 172.21.15.73:0/1701958700 conn(0x7fc00806a4e0 msgr2=0x7fc00806a8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:47:02.120 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:02.118+0000 7fc00f1e5640 1 -- 172.21.15.73:0/1701958700 shutdown_connections 2023-12-12T09:47:02.120 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:02.118+0000 7fc00f1e5640 1 -- 172.21.15.73:0/1701958700 wait complete. 2023-12-12T09:47:02.121 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:02.119+0000 7fc00f1e5640 1 Processor -- start 2023-12-12T09:47:02.121 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:02.120+0000 7fc00f1e5640 1 -- start start 2023-12-12T09:47:02.122 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:02.120+0000 7fc00f1e5640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbff0003ef0 0x7fc0080befc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:02.123 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:02.120+0000 7fc00f1e5640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc008156560 0x7fc0081e9a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:02.123 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:02.120+0000 7fc00f1e5640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc008150200 0x7fc0081e6df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:02.123 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:02.121+0000 7fc00f1e5640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc008153950 con 0x7fbff0003ef0 2023-12-12T09:47:02.123 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:02.121+0000 7fc00f1e5640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc008071e40 con 0x7fc008156560 2023-12-12T09:47:02.123 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:02.121+0000 7fc00f1e5640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc008071b60 con 0x7fc008150200 2023-12-12T09:47:02.123 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:02.121+0000 7fc00cf81640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbff0003ef0 0x7fc0080befc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:02.123 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:02.121+0000 7fc00cf81640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbff0003ef0 0x7fc0080befc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:56040/0 (socket says 172.21.15.73:56040) 2023-12-12T09:47:02.123 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:02.121+0000 7fc00cf81640 1 -- 172.21.15.73:0/1212214491 learned_addr learned my addr 172.21.15.73:0/1212214491 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:47:02.123 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:02.121+0000 7fc00cf81640 1 -- 172.21.15.73:0/1212214491 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc008150200 msgr2=0x7fc0081e6df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:02.123 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:02.121+0000 7fc00cf81640 1 --2- 172.21.15.73:0/1212214491 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc008150200 0x7fc0081e6df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:02.123 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:02.121+0000 7fc00cf81640 1 -- 172.21.15.73:0/1212214491 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc008156560 msgr2=0x7fc0081e9a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:02.123 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:02.121+0000 7fc00cf81640 1 --2- 172.21.15.73:0/1212214491 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc008156560 0x7fc0081e9a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:02.123 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:02.121+0000 7fc00cf81640 1 -- 172.21.15.73:0/1212214491 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0081ed060 con 0x7fbff0003ef0 2023-12-12T09:47:02.124 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:02.121+0000 7fc00cf81640 1 --2- 172.21.15.73:0/1212214491 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbff0003ef0 0x7fc0080befc0 secure :-1 s=READY pgs=1004 cs=0 l=1 rev1=1 crypto rx=0x7fbff8011540 tx=0x7fbff8011a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:47:02.124 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:02.122+0000 7fc0057fa640 1 -- 172.21.15.73:0/1212214491 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbff8015930 con 0x7fbff0003ef0 2023-12-12T09:47:02.124 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:02.122+0000 7fc0057fa640 1 -- 172.21.15.73:0/1212214491 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbff8015a90 con 0x7fbff0003ef0 2023-12-12T09:47:02.124 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:02.122+0000 7fc00f1e5640 1 -- 172.21.15.73:0/1212214491 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0081ed340 con 0x7fbff0003ef0 2023-12-12T09:47:02.124 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:02.122+0000 7fc0057fa640 1 -- 172.21.15.73:0/1212214491 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbff8015e60 con 0x7fbff0003ef0 2023-12-12T09:47:02.124 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:02.122+0000 7fc00f1e5640 1 -- 172.21.15.73:0/1212214491 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0080bf500 con 0x7fbff0003ef0 2023-12-12T09:47:02.124 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:02.123+0000 7fc00f1e5640 1 -- 172.21.15.73:0/1212214491 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc008067070 con 0x7fbff0003ef0 2023-12-12T09:47:02.124 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:02.124+0000 7fc0057fa640 1 -- 172.21.15.73:0/1212214491 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fbff801d400 con 0x7fbff0003ef0 2023-12-12T09:47:02.126 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:02.125+0000 7fc0057fa640 1 --2- 172.21.15.73:0/1212214491 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fbff406ae40 0x7fbff406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:02.126 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:02.125+0000 7fc0057fa640 1 -- 172.21.15.73:0/1212214491 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fbff808a040 con 0x7fbff0003ef0 2023-12-12T09:47:02.126 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:02.125+0000 7fc007fff640 1 --2- 172.21.15.73:0/1212214491 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fbff406ae40 0x7fbff406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:02.126 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:02.126+0000 7fc007fff640 1 --2- 172.21.15.73:0/1212214491 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fbff406ae40 0x7fbff406d300 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7fbffc034000 tx=0x7fbffc02e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:47:02.129 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:02.129+0000 7fc0057fa640 1 -- 172.21.15.73:0/1212214491 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fbff8054e20 con 0x7fbff0003ef0 2023-12-12T09:47:02.318 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:02.318+0000 7fc00f1e5640 1 -- 172.21.15.73:0/1212214491 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"} v 0) v1 -- 0x7fc0080724f0 con 0x7fbff0003ef0 2023-12-12T09:47:02.319 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:02.318+0000 7fc0057fa640 1 -- 172.21.15.73:0/1212214491 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"}]=0 v79) v1 ==== 105+0+11 (secure 0 0 0) 0x7fbff8058440 con 0x7fbff0003ef0 2023-12-12T09:47:02.319 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 32 2023-12-12T09:47:02.322 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:02.321+0000 7fc00f1e5640 1 -- 172.21.15.73:0/1212214491 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fbff406ae40 msgr2=0x7fbff406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:02.322 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:02.321+0000 7fc00f1e5640 1 --2- 172.21.15.73:0/1212214491 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fbff406ae40 0x7fbff406d300 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7fbffc034000 tx=0x7fbffc02e000 comp rx=0 tx=0).stop 2023-12-12T09:47:02.322 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:02.321+0000 7fc00f1e5640 1 -- 172.21.15.73:0/1212214491 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbff0003ef0 msgr2=0x7fc0080befc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:02.322 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:02.321+0000 7fc00f1e5640 1 --2- 172.21.15.73:0/1212214491 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbff0003ef0 0x7fc0080befc0 secure :-1 s=READY pgs=1004 cs=0 l=1 rev1=1 crypto rx=0x7fbff8011540 tx=0x7fbff8011a00 comp rx=0 tx=0).stop 2023-12-12T09:47:02.322 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:02.321+0000 7fc00f1e5640 1 -- 172.21.15.73:0/1212214491 shutdown_connections 2023-12-12T09:47:02.322 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:02.321+0000 7fc00f1e5640 1 --2- 172.21.15.73:0/1212214491 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fbff406ae40 0x7fbff406d300 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:02.322 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:02.321+0000 7fc00f1e5640 1 --2- 172.21.15.73:0/1212214491 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc008150200 0x7fc0081e6df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:02.322 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:02.321+0000 7fc00f1e5640 1 --2- 172.21.15.73:0/1212214491 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc008156560 0x7fc0081e9a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:02.322 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:02.321+0000 7fc00f1e5640 1 --2- 172.21.15.73:0/1212214491 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbff0003ef0 0x7fc0080befc0 unknown :-1 s=CLOSED pgs=1004 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:02.322 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:02.321+0000 7fc00f1e5640 1 -- 172.21.15.73:0/1212214491 >> 172.21.15.73:0/1212214491 conn(0x7fc00806a4e0 msgr2=0x7fc008152b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:47:02.322 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:02.321+0000 7fc00f1e5640 1 -- 172.21.15.73:0/1212214491 shutdown_connections 2023-12-12T09:47:02.323 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:02.321+0000 7fc00f1e5640 1 -- 172.21.15.73:0/1212214491 wait complete. 2023-12-12T09:47:02.339 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_data pg_num 2023-12-12T09:47:02.538 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:02.537+0000 7f5bbe200640 1 Processor -- start 2023-12-12T09:47:02.538 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:02.538+0000 7f5bbe200640 1 -- start start 2023-12-12T09:47:02.540 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:02.539+0000 7f5bbe200640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f5bb814ea60 0x7f5bb80c5420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:02.540 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:02.539+0000 7f5bbe200640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5bb80a4c90 0x7f5bb80c0320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:02.540 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:02.539+0000 7f5bbe200640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f5bb80c4420 0x7f5bb80c20b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:02.540 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:02.539+0000 7f5bbe200640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5bb80c3390 con 0x7f5bb80c4420 2023-12-12T09:47:02.540 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:02.539+0000 7f5bbe200640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5bb8151e60 con 0x7f5bb814ea60 2023-12-12T09:47:02.540 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:02.539+0000 7f5bbe200640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5bb8152140 con 0x7f5bb80a4c90 2023-12-12T09:47:02.540 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:02.539+0000 7f5bb7fff640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f5bb80c4420 0x7f5bb80c20b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:02.540 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:02.540+0000 7f5bb7fff640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f5bb80c4420 0x7f5bb80c20b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:56052/0 (socket says 172.21.15.73:56052) 2023-12-12T09:47:02.540 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:02.540+0000 7f5bb7fff640 1 -- 172.21.15.73:0/1748151811 learned_addr learned my addr 172.21.15.73:0/1748151811 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:47:02.541 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:02.540+0000 7f5bb77fe640 1 --2- 172.21.15.73:0/1748151811 >> v2:172.21.15.142:3300/0 conn(0x7f5bb814ea60 0x7f5bb80c5420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:02.541 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:02.540+0000 7f5baeffd640 1 --2- 172.21.15.73:0/1748151811 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5bb80a4c90 0x7f5bb80c0320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:02.541 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:02.540+0000 7f5bb7fff640 1 -- 172.21.15.73:0/1748151811 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5bb80a4c90 msgr2=0x7f5bb80c0320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:47:02.541 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:02.540+0000 7f5bb7fff640 1 --2- 172.21.15.73:0/1748151811 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5bb80a4c90 0x7f5bb80c0320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:02.541 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:02.540+0000 7f5bb7fff640 1 -- 172.21.15.73:0/1748151811 >> v2:172.21.15.142:3300/0 conn(0x7f5bb814ea60 msgr2=0x7f5bb80c5420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:47:02.541 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:02.540+0000 7f5bb7fff640 1 --2- 172.21.15.73:0/1748151811 >> v2:172.21.15.142:3300/0 conn(0x7f5bb814ea60 0x7f5bb80c5420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:02.541 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:02.540+0000 7f5bb7fff640 1 -- 172.21.15.73:0/1748151811 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bb80c3940 con 0x7f5bb80c4420 2023-12-12T09:47:02.542 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:02.541+0000 7f5bb7fff640 1 --2- 172.21.15.73:0/1748151811 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5bb80c4420 0x7f5bb80c20b0 secure :-1 s=READY pgs=1005 cs=0 l=1 rev1=1 crypto rx=0x7f5bb806b490 tx=0x7f5bb002b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=144252e34b96b6b2 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:47:02.542 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:02.542+0000 7f5bb6ffd640 1 -- 172.21.15.73:0/1748151811 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bb00317e0 con 0x7f5bb80c4420 2023-12-12T09:47:02.542 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:02.542+0000 7f5bb6ffd640 1 -- 172.21.15.73:0/1748151811 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5bb0031940 con 0x7f5bb80c4420 2023-12-12T09:47:02.542 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:02.542+0000 7f5bb6ffd640 1 -- 172.21.15.73:0/1748151811 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bb0031cd0 con 0x7f5bb80c4420 2023-12-12T09:47:02.543 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:02.542+0000 7f5bbe200640 1 -- 172.21.15.73:0/1748151811 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5bb80c4420 msgr2=0x7f5bb80c20b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:02.543 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:02.542+0000 7f5bbe200640 1 --2- 172.21.15.73:0/1748151811 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5bb80c4420 0x7f5bb80c20b0 secure :-1 s=READY pgs=1005 cs=0 l=1 rev1=1 crypto rx=0x7f5bb806b490 tx=0x7f5bb002b880 comp rx=0 tx=0).stop 2023-12-12T09:47:02.543 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:02.542+0000 7f5bbe200640 1 -- 172.21.15.73:0/1748151811 shutdown_connections 2023-12-12T09:47:02.543 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:02.542+0000 7f5bbe200640 1 --2- 172.21.15.73:0/1748151811 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5bb80c4420 0x7f5bb80c20b0 unknown :-1 s=CLOSED pgs=1005 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:02.543 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:02.542+0000 7f5bbe200640 1 --2- 172.21.15.73:0/1748151811 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5bb80a4c90 0x7f5bb80c0320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:02.544 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:02.542+0000 7f5bbe200640 1 --2- 172.21.15.73:0/1748151811 >> v2:172.21.15.142:3300/0 conn(0x7f5bb814ea60 0x7f5bb80c5420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:02.544 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:02.542+0000 7f5bbe200640 1 -- 172.21.15.73:0/1748151811 >> 172.21.15.73:0/1748151811 conn(0x7f5bb806a4e0 msgr2=0x7f5bb806a8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:47:02.544 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:02.543+0000 7f5bbe200640 1 -- 172.21.15.73:0/1748151811 shutdown_connections 2023-12-12T09:47:02.544 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:02.543+0000 7f5bbe200640 1 -- 172.21.15.73:0/1748151811 wait complete. 2023-12-12T09:47:02.544 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:02.544+0000 7f5bbe200640 1 Processor -- start 2023-12-12T09:47:02.545 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:02.544+0000 7f5bbe200640 1 -- start start 2023-12-12T09:47:02.546 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:02.545+0000 7f5bbe200640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5bb80a4c90 0x7f5bb80aad30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:02.547 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:02.545+0000 7f5bbe200640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5bb80c4420 0x7f5bb80ab270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:02.547 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:02.545+0000 7f5bbe200640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5bb814ea60 0x7f5bb813dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:02.547 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:02.545+0000 7f5bbe200640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bb80a6e10 con 0x7f5bb80a4c90 2023-12-12T09:47:02.547 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:02.545+0000 7f5bbe200640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bb80a6560 con 0x7f5bb80c4420 2023-12-12T09:47:02.547 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:02.545+0000 7f5bbe200640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5bb80a7060 con 0x7f5bb814ea60 2023-12-12T09:47:02.547 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:02.546+0000 7f5bb77fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5bb80a4c90 0x7f5bb80aad30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:02.547 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:02.546+0000 7f5bb77fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5bb80a4c90 0x7f5bb80aad30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:56066/0 (socket says 172.21.15.73:56066) 2023-12-12T09:47:02.547 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:02.546+0000 7f5bb77fe640 1 -- 172.21.15.73:0/3904149593 learned_addr learned my addr 172.21.15.73:0/3904149593 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:47:02.547 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:02.546+0000 7f5baeffd640 1 --2- 172.21.15.73:0/3904149593 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5bb80c4420 0x7f5bb80ab270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:02.547 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:02.546+0000 7f5bb7fff640 1 --2- 172.21.15.73:0/3904149593 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5bb814ea60 0x7f5bb813dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:02.547 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:02.546+0000 7f5bb77fe640 1 -- 172.21.15.73:0/3904149593 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5bb814ea60 msgr2=0x7f5bb813dcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:02.547 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:02.546+0000 7f5bb77fe640 1 --2- 172.21.15.73:0/3904149593 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5bb814ea60 0x7f5bb813dcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:02.547 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:02.546+0000 7f5bb77fe640 1 -- 172.21.15.73:0/3904149593 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5bb80c4420 msgr2=0x7f5bb80ab270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:02.547 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:02.546+0000 7f5bb77fe640 1 --2- 172.21.15.73:0/3904149593 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5bb80c4420 0x7f5bb80ab270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:02.548 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:02.546+0000 7f5bb77fe640 1 -- 172.21.15.73:0/3904149593 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bb00094d0 con 0x7f5bb80a4c90 2023-12-12T09:47:02.548 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:02.546+0000 7f5baeffd640 1 --2- 172.21.15.73:0/3904149593 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5bb80c4420 0x7f5bb80ab270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:47:02.548 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:02.546+0000 7f5bb77fe640 1 --2- 172.21.15.73:0/3904149593 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5bb80a4c90 0x7f5bb80aad30 secure :-1 s=READY pgs=1006 cs=0 l=1 rev1=1 crypto rx=0x7f5ba800efc0 tx=0x7f5ba800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:47:02.549 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:02.547+0000 7f5bb4ff9640 1 -- 172.21.15.73:0/3904149593 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ba8009b80 con 0x7f5bb80a4c90 2023-12-12T09:47:02.549 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:02.547+0000 7f5bb4ff9640 1 -- 172.21.15.73:0/3904149593 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ba800f040 con 0x7f5bb80a4c90 2023-12-12T09:47:02.549 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:02.547+0000 7f5bb4ff9640 1 -- 172.21.15.73:0/3904149593 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ba80146a0 con 0x7f5bb80a4c90 2023-12-12T09:47:02.549 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:02.547+0000 7f5bbe200640 1 -- 172.21.15.73:0/3904149593 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5bb80a6800 con 0x7f5bb80a4c90 2023-12-12T09:47:02.549 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:02.547+0000 7f5bbe200640 1 -- 172.21.15.73:0/3904149593 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5bb80a5190 con 0x7f5bb80a4c90 2023-12-12T09:47:02.549 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:02.548+0000 7f5bbe200640 1 -- 172.21.15.73:0/3904149593 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5bb8067070 con 0x7f5bb80a4c90 2023-12-12T09:47:02.550 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:02.549+0000 7f5bb4ff9640 1 -- 172.21.15.73:0/3904149593 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f5ba8014800 con 0x7f5bb80a4c90 2023-12-12T09:47:02.550 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:02.549+0000 7f5bb4ff9640 1 --2- 172.21.15.73:0/3904149593 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f5b9806ae40 0x7f5b9806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:02.550 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:02.550+0000 7f5bb4ff9640 1 -- 172.21.15.73:0/3904149593 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f5ba808a3f0 con 0x7f5bb80a4c90 2023-12-12T09:47:02.550 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:02.550+0000 7f5baeffd640 1 --2- 172.21.15.73:0/3904149593 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f5b9806ae40 0x7f5b9806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:02.551 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:02.550+0000 7f5baeffd640 1 --2- 172.21.15.73:0/3904149593 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f5b9806ae40 0x7f5b9806d300 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f5bb80c0360 tx=0x7f5ba0008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:47:02.555 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:02.554+0000 7f5bb4ff9640 1 -- 172.21.15.73:0/3904149593 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f5ba80551d0 con 0x7f5bb80a4c90 2023-12-12T09:47:02.746 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:02.745+0000 7f5bbe200640 1 -- 172.21.15.73:0/3904149593 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"} v 0) v1 -- 0x7f5bb814e610 con 0x7f5bb80a4c90 2023-12-12T09:47:02.746 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:02.746+0000 7f5bb4ff9640 1 -- 172.21.15.73:0/3904149593 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"}]=0 v79) v1 ==== 101+0+11 (secure 0 0 0) 0x7f5ba80587f0 con 0x7f5bb80a4c90 2023-12-12T09:47:02.747 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 64 2023-12-12T09:47:02.749 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:02.748+0000 7f5bbe200640 1 -- 172.21.15.73:0/3904149593 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f5b9806ae40 msgr2=0x7f5b9806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:02.749 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:02.748+0000 7f5bbe200640 1 --2- 172.21.15.73:0/3904149593 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f5b9806ae40 0x7f5b9806d300 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f5bb80c0360 tx=0x7f5ba0008040 comp rx=0 tx=0).stop 2023-12-12T09:47:02.749 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:02.748+0000 7f5bbe200640 1 -- 172.21.15.73:0/3904149593 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5bb80a4c90 msgr2=0x7f5bb80aad30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:02.750 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:02.748+0000 7f5bbe200640 1 --2- 172.21.15.73:0/3904149593 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5bb80a4c90 0x7f5bb80aad30 secure :-1 s=READY pgs=1006 cs=0 l=1 rev1=1 crypto rx=0x7f5ba800efc0 tx=0x7f5ba800c490 comp rx=0 tx=0).stop 2023-12-12T09:47:02.750 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:02.749+0000 7f5bbe200640 1 -- 172.21.15.73:0/3904149593 shutdown_connections 2023-12-12T09:47:02.750 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:02.749+0000 7f5bbe200640 1 --2- 172.21.15.73:0/3904149593 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f5b9806ae40 0x7f5b9806d300 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:02.750 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:02.749+0000 7f5bbe200640 1 --2- 172.21.15.73:0/3904149593 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5bb814ea60 0x7f5bb813dcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:02.750 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:02.749+0000 7f5bbe200640 1 --2- 172.21.15.73:0/3904149593 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5bb80c4420 0x7f5bb80ab270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:02.750 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:02.749+0000 7f5bbe200640 1 --2- 172.21.15.73:0/3904149593 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5bb80a4c90 0x7f5bb80aad30 unknown :-1 s=CLOSED pgs=1006 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:02.750 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:02.749+0000 7f5bbe200640 1 -- 172.21.15.73:0/3904149593 >> 172.21.15.73:0/3904149593 conn(0x7f5bb806a4e0 msgr2=0x7f5bb8147a00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:47:02.750 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:02.749+0000 7f5bbe200640 1 -- 172.21.15.73:0/3904149593 shutdown_connections 2023-12-12T09:47:02.750 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:02.749+0000 7f5bbe200640 1 -- 172.21.15.73:0/3904149593 wait complete. 2023-12-12T09:47:02.767 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-12T09:47:02.978 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:02.977+0000 7f2a4529b640 1 Processor -- start 2023-12-12T09:47:02.978 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:02.977+0000 7f2a4529b640 1 -- start start 2023-12-12T09:47:02.979 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:02.979+0000 7f2a4529b640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f2a400c17e0 0x7f2a40072700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:02.979 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:02.979+0000 7f2a4529b640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a40152560 con 0x7f2a400c0420 2023-12-12T09:47:02.979 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:02.979+0000 7f2a4529b640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a401532e0 con 0x7f2a4006fca0 2023-12-12T09:47:02.979 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:02.979+0000 7f2a4529b640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a40152ec0 con 0x7f2a400c17e0 2023-12-12T09:47:02.980 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:02.979+0000 7f2a3e7fc640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f2a400c0420 0x7f2a4015acc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:54310/0 (socket says 172.21.15.73:54310) 2023-12-12T09:47:02.980 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:02.979+0000 7f2a3e7fc640 1 -- 172.21.15.73:0/3835250879 learned_addr learned my addr 172.21.15.73:0/3835250879 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-12T09:47:02.982 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:02.979+0000 7f2a3f7fe640 1 --2- 172.21.15.73:0/3835250879 >> v2:172.21.15.142:3300/0 conn(0x7f2a400c17e0 0x7f2a40072700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:02.982 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:02.980+0000 7f2a3dffb640 1 -- 172.21.15.73:0/3835250879 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1703689351 0 0) 0x7f2a40152560 con 0x7f2a400c0420 2023-12-12T09:47:02.982 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:02.980+0000 7f2a3dffb640 1 -- 172.21.15.73:0/3835250879 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2a28003520 con 0x7f2a400c0420 2023-12-12T09:47:02.982 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:02.980+0000 7f2a3dffb640 1 -- 172.21.15.73:0/3835250879 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2320729269 0 0) 0x7f2a28003520 con 0x7f2a400c0420 2023-12-12T09:47:02.982 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:02.980+0000 7f2a3dffb640 1 -- 172.21.15.73:0/3835250879 >> v2:172.21.15.142:3300/0 conn(0x7f2a400c17e0 msgr2=0x7f2a40072700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:47:02.982 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:02.980+0000 7f2a3dffb640 1 --2- 172.21.15.73:0/3835250879 >> v2:172.21.15.142:3300/0 conn(0x7f2a400c17e0 0x7f2a40072700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:02.982 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:02.980+0000 7f2a3dffb640 1 -- 172.21.15.73:0/3835250879 >> v1:172.21.15.142:6789/0 conn(0x7f2a4006fca0 legacy=0x7f2a400c10d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:02.982 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:02.980+0000 7f2a3dffb640 1 -- 172.21.15.73:0/3835250879 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a40152800 con 0x7f2a400c0420 2023-12-12T09:47:02.982 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:02.980+0000 7f2a3dffb640 1 -- 172.21.15.73:0/3835250879 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3186547832 0 0) 0x7f2a34001670 con 0x7f2a400c0420 2023-12-12T09:47:02.982 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:02.980+0000 7f2a3dffb640 1 -- 172.21.15.73:0/3835250879 >> v1:172.21.15.73:6789/0 conn(0x7f2a400c0420 legacy=0x7f2a4015acc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:02.982 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:02.980+0000 7f2a3dffb640 1 --2- 172.21.15.73:0/3835250879 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2a28003970 0x7f2a28003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:02.982 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:02.980+0000 7f2a3dffb640 1 --2- 172.21.15.73:0/3835250879 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2a280047c0 0x7f2a28004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:02.983 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:02.980+0000 7f2a3dffb640 1 --2- 172.21.15.73:0/3835250879 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2a28005180 0x7f2a2800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:02.983 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:02.980+0000 7f2a3dffb640 1 -- 172.21.15.73:0/3835250879 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a40152ec0 con 0x7f2a280047c0 2023-12-12T09:47:02.983 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:02.980+0000 7f2a3dffb640 1 -- 172.21.15.73:0/3835250879 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a2800c120 con 0x7f2a28003970 2023-12-12T09:47:02.983 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:02.980+0000 7f2a3dffb640 1 -- 172.21.15.73:0/3835250879 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a2800c2e0 con 0x7f2a28005180 2023-12-12T09:47:02.983 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:02.980+0000 7f2a3e7fc640 1 --2- 172.21.15.73:0/3835250879 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2a280047c0 0x7f2a28004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:02.983 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:02.981+0000 7f2a3effd640 1 --2- 172.21.15.73:0/3835250879 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2a28003970 0x7f2a28003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:02.983 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:02.981+0000 7f2a3e7fc640 1 -- 172.21.15.73:0/3835250879 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2a28005180 msgr2=0x7f2a2800b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:47:02.983 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:02.981+0000 7f2a3f7fe640 1 --2- 172.21.15.73:0/3835250879 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2a28005180 0x7f2a2800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:02.983 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:02.981+0000 7f2a3e7fc640 1 --2- 172.21.15.73:0/3835250879 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2a28005180 0x7f2a2800b980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:02.983 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:02.981+0000 7f2a3e7fc640 1 -- 172.21.15.73:0/3835250879 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2a28003970 msgr2=0x7f2a28003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:47:02.983 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:02.981+0000 7f2a3e7fc640 1 --2- 172.21.15.73:0/3835250879 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2a28003970 0x7f2a28003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:02.983 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:02.981+0000 7f2a3e7fc640 1 -- 172.21.15.73:0/3835250879 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a28003520 con 0x7f2a280047c0 2023-12-12T09:47:02.983 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:02.981+0000 7f2a3f7fe640 1 -- 172.21.15.73:0/3835250879 reap_dead start 2023-12-12T09:47:02.983 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:02.981+0000 7f2a3effd640 1 --2- 172.21.15.73:0/3835250879 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2a28003970 0x7f2a28003d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:47:02.984 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:02.982+0000 7f2a3e7fc640 1 --2- 172.21.15.73:0/3835250879 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2a280047c0 0x7f2a28004c40 secure :-1 s=READY pgs=1008 cs=0 l=1 rev1=1 crypto rx=0x7f2a3400c240 tx=0x7f2a280057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6f535ac5d5c98d1 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:47:02.985 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:02.982+0000 7f2a3dffb640 1 -- 172.21.15.73:0/3835250879 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a34005ad0 con 0x7f2a280047c0 2023-12-12T09:47:02.985 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:02.982+0000 7f2a3dffb640 1 -- 172.21.15.73:0/3835250879 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a34005c30 con 0x7f2a280047c0 2023-12-12T09:47:02.985 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:02.982+0000 7f2a3dffb640 1 -- 172.21.15.73:0/3835250879 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a3402ca00 con 0x7f2a280047c0 2023-12-12T09:47:02.985 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:02.983+0000 7f2a4529b640 1 -- 172.21.15.73:0/3835250879 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2a280047c0 msgr2=0x7f2a28004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:02.985 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:02.983+0000 7f2a4529b640 1 --2- 172.21.15.73:0/3835250879 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2a280047c0 0x7f2a28004c40 secure :-1 s=READY pgs=1008 cs=0 l=1 rev1=1 crypto rx=0x7f2a3400c240 tx=0x7f2a280057f0 comp rx=0 tx=0).stop 2023-12-12T09:47:02.985 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:02.983+0000 7f2a4529b640 1 -- 172.21.15.73:0/3835250879 shutdown_connections 2023-12-12T09:47:02.985 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:02.983+0000 7f2a4529b640 1 --2- 172.21.15.73:0/3835250879 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2a280047c0 0x7f2a28004c40 unknown :-1 s=CLOSED pgs=1008 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:02.985 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:02.983+0000 7f2a4529b640 1 -- 172.21.15.73:0/3835250879 >> 172.21.15.73:0/3835250879 conn(0x7f2a400a77d0 msgr2=0x7f2a400a7bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:47:02.985 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:02.983+0000 7f2a4529b640 1 -- 172.21.15.73:0/3835250879 shutdown_connections 2023-12-12T09:47:02.985 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:02.983+0000 7f2a4529b640 1 -- 172.21.15.73:0/3835250879 wait complete. 2023-12-12T09:47:02.986 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:02.985+0000 7f2a4529b640 1 Processor -- start 2023-12-12T09:47:02.986 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:02.985+0000 7f2a4529b640 1 -- start start 2023-12-12T09:47:02.987 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:02.986+0000 7f2a4529b640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2a280047c0 0x7f2a400bf0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:02.987 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:02.986+0000 7f2a4529b640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2a400a9220 0x7f2a4006bdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:02.987 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:02.986+0000 7f2a4529b640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2a4006da60 0x7f2a4006c310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:02.987 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:02.986+0000 7f2a4529b640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a4006ceb0 con 0x7f2a400a9220 2023-12-12T09:47:02.987 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:02.986+0000 7f2a4529b640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a4006d470 con 0x7f2a4006da60 2023-12-12T09:47:02.987 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:02.986+0000 7f2a4529b640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a401ea830 con 0x7f2a280047c0 2023-12-12T09:47:02.987 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:02.986+0000 7f2a3e7fc640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2a400a9220 0x7f2a4006bdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:02.988 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:02.986+0000 7f2a3e7fc640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2a400a9220 0x7f2a4006bdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:56086/0 (socket says 172.21.15.73:56086) 2023-12-12T09:47:02.988 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:02.986+0000 7f2a3e7fc640 1 -- 172.21.15.73:0/1699732367 learned_addr learned my addr 172.21.15.73:0/1699732367 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:47:02.988 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:02.986+0000 7f2a3e7fc640 1 -- 172.21.15.73:0/1699732367 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2a280047c0 msgr2=0x7f2a400bf0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:02.988 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:02.986+0000 7f2a3e7fc640 1 --2- 172.21.15.73:0/1699732367 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2a280047c0 0x7f2a400bf0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:02.988 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:02.986+0000 7f2a3e7fc640 1 -- 172.21.15.73:0/1699732367 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2a4006da60 msgr2=0x7f2a4006c310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:02.988 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:02.986+0000 7f2a3e7fc640 1 --2- 172.21.15.73:0/1699732367 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2a4006da60 0x7f2a4006c310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:02.988 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:02.986+0000 7f2a3e7fc640 1 -- 172.21.15.73:0/1699732367 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a401eab10 con 0x7f2a400a9220 2023-12-12T09:47:02.988 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:02.987+0000 7f2a3e7fc640 1 --2- 172.21.15.73:0/1699732367 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2a400a9220 0x7f2a4006bdd0 secure :-1 s=READY pgs=1009 cs=0 l=1 rev1=1 crypto rx=0x7f2a34001930 tx=0x7f2a3402e070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:47:02.989 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:02.987+0000 7f2a277fe640 1 -- 172.21.15.73:0/1699732367 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a3403c040 con 0x7f2a400a9220 2023-12-12T09:47:02.989 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:02.987+0000 7f2a277fe640 1 -- 172.21.15.73:0/1699732367 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a3402cc90 con 0x7f2a400a9220 2023-12-12T09:47:02.989 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:02.987+0000 7f2a277fe640 1 -- 172.21.15.73:0/1699732367 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a34007070 con 0x7f2a400a9220 2023-12-12T09:47:02.989 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:02.987+0000 7f2a4529b640 1 -- 172.21.15.73:0/1699732367 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a4006d100 con 0x7f2a400a9220 2023-12-12T09:47:02.989 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:02.987+0000 7f2a4529b640 1 -- 172.21.15.73:0/1699732367 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a4006c850 con 0x7f2a400a9220 2023-12-12T09:47:02.989 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:02.989+0000 7f2a4529b640 1 -- 172.21.15.73:0/1699732367 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a401eaca0 con 0x7f2a400a9220 2023-12-12T09:47:02.990 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:02.989+0000 7f2a277fe640 1 -- 172.21.15.73:0/1699732367 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f2a34032070 con 0x7f2a400a9220 2023-12-12T09:47:02.991 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:02.990+0000 7f2a277fe640 1 --2- 172.21.15.73:0/1699732367 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f2a2c06ae40 0x7f2a2c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:02.991 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:02.991+0000 7f2a277fe640 1 -- 172.21.15.73:0/1699732367 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f2a340aace0 con 0x7f2a400a9220 2023-12-12T09:47:02.991 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:02.991+0000 7f2a3effd640 1 --2- 172.21.15.73:0/1699732367 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f2a2c06ae40 0x7f2a2c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:02.991 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:02.991+0000 7f2a3effd640 1 --2- 172.21.15.73:0/1699732367 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f2a2c06ae40 0x7f2a2c06d300 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f2a40067ab0 tx=0x7f2a30009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:47:02.995 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:02.995+0000 7f2a277fe640 1 -- 172.21.15.73:0/1699732367 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f2a34075ac0 con 0x7f2a400a9220 2023-12-12T09:47:03.199 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:03.198+0000 7f2a4529b640 1 -- 172.21.15.73:0/1699732367 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f2a40067580 con 0x7f2a400a9220 2023-12-12T09:47:03.199 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:03.199+0000 7f2a277fe640 1 -- 172.21.15.73:0/1699732367 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v79) v1 ==== 80+0+0 (secure 0 0 0) 0x7f2a340790e0 con 0x7f2a400a9220 2023-12-12T09:47:03.200 INFO:teuthology.orchestra.run.smithi073.stderr:listed 0 entries 2023-12-12T09:47:03.202 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:03.201+0000 7f2a4529b640 1 -- 172.21.15.73:0/1699732367 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f2a2c06ae40 msgr2=0x7f2a2c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:03.202 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:03.201+0000 7f2a4529b640 1 --2- 172.21.15.73:0/1699732367 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f2a2c06ae40 0x7f2a2c06d300 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f2a40067ab0 tx=0x7f2a30009040 comp rx=0 tx=0).stop 2023-12-12T09:47:03.202 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:03.201+0000 7f2a4529b640 1 -- 172.21.15.73:0/1699732367 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2a400a9220 msgr2=0x7f2a4006bdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:03.202 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:03.201+0000 7f2a4529b640 1 --2- 172.21.15.73:0/1699732367 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2a400a9220 0x7f2a4006bdd0 secure :-1 s=READY pgs=1009 cs=0 l=1 rev1=1 crypto rx=0x7f2a34001930 tx=0x7f2a3402e070 comp rx=0 tx=0).stop 2023-12-12T09:47:03.202 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:03.202+0000 7f2a4529b640 1 -- 172.21.15.73:0/1699732367 shutdown_connections 2023-12-12T09:47:03.202 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:03.202+0000 7f2a4529b640 1 --2- 172.21.15.73:0/1699732367 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f2a2c06ae40 0x7f2a2c06d300 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:03.203 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:03.202+0000 7f2a4529b640 1 --2- 172.21.15.73:0/1699732367 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2a4006da60 0x7f2a4006c310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:03.203 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:03.202+0000 7f2a4529b640 1 --2- 172.21.15.73:0/1699732367 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2a400a9220 0x7f2a4006bdd0 unknown :-1 s=CLOSED pgs=1009 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:03.203 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:03.202+0000 7f2a4529b640 1 --2- 172.21.15.73:0/1699732367 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2a280047c0 0x7f2a400bf0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:03.203 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:03.202+0000 7f2a4529b640 1 -- 172.21.15.73:0/1699732367 >> 172.21.15.73:0/1699732367 conn(0x7f2a400a77d0 msgr2=0x7f2a400c0d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:47:03.203 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:03.202+0000 7f2a4529b640 1 -- 172.21.15.73:0/1699732367 shutdown_connections 2023-12-12T09:47:03.203 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:03.202+0000 7f2a4529b640 1 -- 172.21.15.73:0/1699732367 wait complete. 2023-12-12T09:47:03.218 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-12-12T09:47:03.219 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T09:47:03.219 DEBUG:teuthology.orchestra.run.smithi142:> sudo umount /home/ubuntu/cephtest/mnt.1 2023-12-12T09:47:03.354 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi142.front.sepia.ceph.com 2023-12-12T09:47:03.355 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T09:47:03.355 DEBUG:teuthology.orchestra.run.smithi142:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-12-12T09:47:03.413 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2023-12-12T09:47:03.413 DEBUG:teuthology.orchestra.run.smithi142:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-12T09:47:03.452 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054289,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498808k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249400k,nr_inodes=812350,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498808k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 2023-12-12T09:47:03.452 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-12-12T09:47:03.634 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:03.633+0000 7f5d3446b640 1 Processor -- start 2023-12-12T09:47:03.634 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:03.633+0000 7f5d3446b640 1 -- start start 2023-12-12T09:47:03.635 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:03.634+0000 7f5d3446b640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5d2c06db70 0x7f5d2c0c39b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:03.635 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:03.634+0000 7f5d3446b640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d2c152610 con 0x7f5d2c14fa40 2023-12-12T09:47:03.635 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:03.634+0000 7f5d3446b640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d2c1528f0 con 0x7f5d2c0c5070 2023-12-12T09:47:03.635 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:03.634+0000 7f5d3446b640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d2c152bd0 con 0x7f5d2c06db70 2023-12-12T09:47:03.636 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:03.635+0000 7f5d32207640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f5d2c14fa40 0x7f5d2c06a4e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:54318/0 (socket says 172.21.15.73:54318) 2023-12-12T09:47:03.636 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:03.635+0000 7f5d32207640 1 -- 172.21.15.73:0/1916377682 learned_addr learned my addr 172.21.15.73:0/1916377682 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-12T09:47:03.636 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:03.635+0000 7f5d31a06640 1 --2- 172.21.15.73:0/1916377682 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5d2c06db70 0x7f5d2c0c39b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:03.636 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:03.635+0000 7f5d31205640 1 -- 172.21.15.73:0/1916377682 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3111093783 0 0) 0x7f5d2c152610 con 0x7f5d2c14fa40 2023-12-12T09:47:03.636 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:03.635+0000 7f5d31205640 1 -- 172.21.15.73:0/1916377682 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5d18003520 con 0x7f5d2c14fa40 2023-12-12T09:47:03.638 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:03.636+0000 7f5d31205640 1 -- 172.21.15.73:0/1916377682 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 588686327 0 0) 0x7f5d18003520 con 0x7f5d2c14fa40 2023-12-12T09:47:03.638 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:03.636+0000 7f5d31205640 1 -- 172.21.15.73:0/1916377682 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5d2c06db70 msgr2=0x7f5d2c0c39b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:47:03.638 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:03.636+0000 7f5d31205640 1 --2- 172.21.15.73:0/1916377682 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5d2c06db70 0x7f5d2c0c39b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:03.638 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:03.636+0000 7f5d31205640 1 -- 172.21.15.73:0/1916377682 >> v1:172.21.15.142:6789/0 conn(0x7f5d2c0c5070 legacy=0x7f5d2c0c3ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:03.638 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:03.636+0000 7f5d31205640 1 -- 172.21.15.73:0/1916377682 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d2c152eb0 con 0x7f5d2c14fa40 2023-12-12T09:47:03.638 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:03.636+0000 7f5d31205640 1 -- 172.21.15.73:0/1916377682 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3186547832 0 0) 0x7f5d28001670 con 0x7f5d2c14fa40 2023-12-12T09:47:03.638 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:03.636+0000 7f5d31205640 1 -- 172.21.15.73:0/1916377682 >> v1:172.21.15.73:6789/0 conn(0x7f5d2c14fa40 legacy=0x7f5d2c06a4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:03.639 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:03.636+0000 7f5d31205640 1 --2- 172.21.15.73:0/1916377682 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5d2c06db70 0x7f5d180039a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:03.639 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:03.636+0000 7f5d31205640 1 --2- 172.21.15.73:0/1916377682 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5d18003f70 0x7f5d180047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:03.639 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:03.636+0000 7f5d31205640 1 --2- 172.21.15.73:0/1916377682 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5d18004d00 0x7f5d18005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:03.639 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:03.636+0000 7f5d31205640 1 -- 172.21.15.73:0/1916377682 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d2c152bd0 con 0x7f5d18004d00 2023-12-12T09:47:03.639 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:03.636+0000 7f5d31205640 1 -- 172.21.15.73:0/1916377682 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d1800bac0 con 0x7f5d18003f70 2023-12-12T09:47:03.639 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:03.636+0000 7f5d31205640 1 -- 172.21.15.73:0/1916377682 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d1800bc80 con 0x7f5d2c06db70 2023-12-12T09:47:03.639 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:03.636+0000 7f5d32a08640 1 --2- 172.21.15.73:0/1916377682 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5d18004d00 0x7f5d18005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:03.639 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:03.637+0000 7f5d32207640 1 --2- 172.21.15.73:0/1916377682 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5d2c06db70 0x7f5d180039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:03.639 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:03.637+0000 7f5d31a06640 1 --2- 172.21.15.73:0/1916377682 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5d18003f70 0x7f5d180047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:03.639 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:03.637+0000 7f5d32a08640 1 -- 172.21.15.73:0/1916377682 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5d2c06db70 msgr2=0x7f5d180039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:47:03.640 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:03.637+0000 7f5d32a08640 1 --2- 172.21.15.73:0/1916377682 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5d2c06db70 0x7f5d180039a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:03.640 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:03.637+0000 7f5d32a08640 1 -- 172.21.15.73:0/1916377682 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5d18003f70 msgr2=0x7f5d180047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:47:03.640 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:03.637+0000 7f5d32a08640 1 --2- 172.21.15.73:0/1916377682 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5d18003f70 0x7f5d180047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:03.640 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:03.637+0000 7f5d32a08640 1 -- 172.21.15.73:0/1916377682 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d18003520 con 0x7f5d18004d00 2023-12-12T09:47:03.641 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:03.638+0000 7f5d32a08640 1 --2- 172.21.15.73:0/1916377682 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5d18004d00 0x7f5d18005180 secure :-1 s=READY pgs=1011 cs=0 l=1 rev1=1 crypto rx=0x7f5d24001e50 tx=0x7f5d180057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7da4b0b9980c0ce4 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:47:03.641 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:03.639+0000 7f5d31205640 1 -- 172.21.15.73:0/1916377682 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d24003b70 con 0x7f5d18004d00 2023-12-12T09:47:03.641 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:03.639+0000 7f5d31205640 1 -- 172.21.15.73:0/1916377682 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d24003cd0 con 0x7f5d18004d00 2023-12-12T09:47:03.641 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:03.639+0000 7f5d31205640 1 -- 172.21.15.73:0/1916377682 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d24005310 con 0x7f5d18004d00 2023-12-12T09:47:03.641 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:03.639+0000 7f5d3446b640 1 -- 172.21.15.73:0/1916377682 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5d18004d00 msgr2=0x7f5d18005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:03.641 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:03.639+0000 7f5d3446b640 1 --2- 172.21.15.73:0/1916377682 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5d18004d00 0x7f5d18005180 secure :-1 s=READY pgs=1011 cs=0 l=1 rev1=1 crypto rx=0x7f5d24001e50 tx=0x7f5d180057f0 comp rx=0 tx=0).stop 2023-12-12T09:47:03.641 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:03.639+0000 7f5d32a08640 1 -- 172.21.15.73:0/1916377682 reap_dead start 2023-12-12T09:47:03.641 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:03.639+0000 7f5d3446b640 1 -- 172.21.15.73:0/1916377682 shutdown_connections 2023-12-12T09:47:03.641 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:03.639+0000 7f5d3446b640 1 -- 172.21.15.73:0/1916377682 >> 172.21.15.73:0/1916377682 conn(0x7f5d2c0a8130 msgr2=0x7f5d2c0c24b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:47:03.642 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:03.639+0000 7f5d3446b640 1 -- 172.21.15.73:0/1916377682 shutdown_connections 2023-12-12T09:47:03.642 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:03.639+0000 7f5d3446b640 1 -- 172.21.15.73:0/1916377682 wait complete. 2023-12-12T09:47:03.644 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:03.641+0000 7f5d3446b640 1 Processor -- start 2023-12-12T09:47:03.644 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:03.641+0000 7f5d3446b640 1 -- start start 2023-12-12T09:47:03.644 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:03.642+0000 7f5d3446b640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5d18004d00 0x7f5d2c13eb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:03.644 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:03.642+0000 7f5d3446b640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5d2c13f090 0x7f5d2c1eae80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:03.644 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:03.642+0000 7f5d3446b640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5d2c1eb3c0 0x7f5d2c0bea10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:03.645 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:03.642+0000 7f5d3446b640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d2c0be580 con 0x7f5d2c13f090 2023-12-12T09:47:03.645 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:03.642+0000 7f5d3446b640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d2c0bc380 con 0x7f5d2c1eb3c0 2023-12-12T09:47:03.645 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:03.642+0000 7f5d3446b640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d2c0bbdc0 con 0x7f5d18004d00 2023-12-12T09:47:03.645 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:03.642+0000 7f5d31a06640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5d2c13f090 0x7f5d2c1eae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:03.645 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:03.643+0000 7f5d31a06640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5d2c13f090 0x7f5d2c1eae80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:56110/0 (socket says 172.21.15.73:56110) 2023-12-12T09:47:03.645 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:03.643+0000 7f5d31a06640 1 -- 172.21.15.73:0/2837575369 learned_addr learned my addr 172.21.15.73:0/2837575369 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:47:03.645 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:03.643+0000 7f5d32a08640 1 --2- 172.21.15.73:0/2837575369 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5d2c1eb3c0 0x7f5d2c0bea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:03.645 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:03.643+0000 7f5d32207640 1 --2- 172.21.15.73:0/2837575369 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5d18004d00 0x7f5d2c13eb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:03.645 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:03.643+0000 7f5d31a06640 1 -- 172.21.15.73:0/2837575369 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5d18004d00 msgr2=0x7f5d2c13eb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:03.645 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:03.643+0000 7f5d31a06640 1 --2- 172.21.15.73:0/2837575369 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5d18004d00 0x7f5d2c13eb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:03.645 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:03.643+0000 7f5d31a06640 1 -- 172.21.15.73:0/2837575369 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5d2c1eb3c0 msgr2=0x7f5d2c0bea10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:03.645 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:03.643+0000 7f5d31a06640 1 --2- 172.21.15.73:0/2837575369 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5d2c1eb3c0 0x7f5d2c0bea10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:03.645 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:03.643+0000 7f5d31a06640 1 -- 172.21.15.73:0/2837575369 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d2c0bc0a0 con 0x7f5d2c13f090 2023-12-12T09:47:03.645 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:03.643+0000 7f5d31a06640 1 --2- 172.21.15.73:0/2837575369 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5d2c13f090 0x7f5d2c1eae80 secure :-1 s=READY pgs=1012 cs=0 l=1 rev1=1 crypto rx=0x7f5d1c0115d0 tx=0x7f5d1c011a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:47:03.646 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:03.643+0000 7f5d22ffd640 1 -- 172.21.15.73:0/2837575369 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d1c015870 con 0x7f5d2c13f090 2023-12-12T09:47:03.646 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:03.644+0000 7f5d22ffd640 1 -- 172.21.15.73:0/2837575369 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d1c0159d0 con 0x7f5d2c13f090 2023-12-12T09:47:03.646 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:03.644+0000 7f5d3446b640 1 -- 172.21.15.73:0/2837575369 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d2c0be210 con 0x7f5d2c13f090 2023-12-12T09:47:03.646 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:03.644+0000 7f5d22ffd640 1 -- 172.21.15.73:0/2837575369 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d1c015d80 con 0x7f5d2c13f090 2023-12-12T09:47:03.646 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:03.644+0000 7f5d3446b640 1 -- 172.21.15.73:0/2837575369 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d2c13f4f0 con 0x7f5d2c13f090 2023-12-12T09:47:03.647 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:03.645+0000 7f5d3446b640 1 -- 172.21.15.73:0/2837575369 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d2c067580 con 0x7f5d2c13f090 2023-12-12T09:47:03.647 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:03.646+0000 7f5d22ffd640 1 -- 172.21.15.73:0/2837575369 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f5d1c00f480 con 0x7f5d2c13f090 2023-12-12T09:47:03.647 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:03.646+0000 7f5d22ffd640 1 --2- 172.21.15.73:0/2837575369 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f5d1006ae40 0x7f5d1006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:03.647 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:03.647+0000 7f5d22ffd640 1 -- 172.21.15.73:0/2837575369 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f5d1c08a1f0 con 0x7f5d2c13f090 2023-12-12T09:47:03.647 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:03.647+0000 7f5d32207640 1 --2- 172.21.15.73:0/2837575369 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f5d1006ae40 0x7f5d1006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:03.648 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:03.647+0000 7f5d32207640 1 --2- 172.21.15.73:0/2837575369 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f5d1006ae40 0x7f5d1006d300 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f5d28001eb0 tx=0x7f5d28000f50 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:47:03.651 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:03.651+0000 7f5d22ffd640 1 -- 172.21.15.73:0/2837575369 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f5d1c054fe0 con 0x7f5d2c13f090 2023-12-12T09:47:03.874 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:03.874+0000 7f5d3446b640 1 -- 172.21.15.73:0/2837575369 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f5d2c073f60 con 0x7f5d2c13f090 2023-12-12T09:47:03.875 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:03.875+0000 7f5d22ffd640 1 -- 172.21.15.73:0/2837575369 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v49) v1 ==== 53+0+149 (secure 0 0 0) 0x7f5d1c058600 con 0x7f5d2c13f090 2023-12-12T09:47:03.875 INFO:teuthology.orchestra.run.smithi073.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-12-12T09:47:03.875 INFO:teuthology.orchestra.run.smithi073.stdout:name: cephfs2, metadata pool: cephfs2_metadata, data pools: [cephfs2_data ] 2023-12-12T09:47:03.878 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:03.877+0000 7f5d3446b640 1 -- 172.21.15.73:0/2837575369 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f5d1006ae40 msgr2=0x7f5d1006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:03.878 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:03.877+0000 7f5d3446b640 1 --2- 172.21.15.73:0/2837575369 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f5d1006ae40 0x7f5d1006d300 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f5d28001eb0 tx=0x7f5d28000f50 comp rx=0 tx=0).stop 2023-12-12T09:47:03.878 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:03.877+0000 7f5d3446b640 1 -- 172.21.15.73:0/2837575369 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5d2c13f090 msgr2=0x7f5d2c1eae80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:03.878 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:03.877+0000 7f5d3446b640 1 --2- 172.21.15.73:0/2837575369 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5d2c13f090 0x7f5d2c1eae80 secure :-1 s=READY pgs=1012 cs=0 l=1 rev1=1 crypto rx=0x7f5d1c0115d0 tx=0x7f5d1c011a90 comp rx=0 tx=0).stop 2023-12-12T09:47:03.878 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:03.877+0000 7f5d3446b640 1 -- 172.21.15.73:0/2837575369 shutdown_connections 2023-12-12T09:47:03.878 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:03.877+0000 7f5d3446b640 1 --2- 172.21.15.73:0/2837575369 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f5d1006ae40 0x7f5d1006d300 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:03.878 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:03.877+0000 7f5d3446b640 1 --2- 172.21.15.73:0/2837575369 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5d2c1eb3c0 0x7f5d2c0bea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:03.878 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:03.877+0000 7f5d3446b640 1 --2- 172.21.15.73:0/2837575369 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5d2c13f090 0x7f5d2c1eae80 unknown :-1 s=CLOSED pgs=1012 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:03.878 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:03.877+0000 7f5d3446b640 1 --2- 172.21.15.73:0/2837575369 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5d18004d00 0x7f5d2c13eb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:03.879 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:03.877+0000 7f5d3446b640 1 -- 172.21.15.73:0/2837575369 >> 172.21.15.73:0/2837575369 conn(0x7f5d2c0a8130 msgr2=0x7f5d2c0a67a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:47:03.879 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:03.877+0000 7f5d3446b640 1 -- 172.21.15.73:0/2837575369 shutdown_connections 2023-12-12T09:47:03.879 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:03.877+0000 7f5d3446b640 1 -- 172.21.15.73:0/2837575369 wait complete. 2023-12-12T09:47:03.895 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs2; just confirmed its presence on cluster 2023-12-12T09:47:03.895 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-12T09:47:03.895 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi142.front.sepia.ceph.com 2023-12-12T09:47:03.895 INFO:tasks.cephfs.mount:self.client.name = client.testuser 2023-12-12T09:47:03.895 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-12-12T09:47:03.896 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs2 2023-12-12T09:47:03.896 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-12-12T09:47:03.896 INFO:tasks.cephfs.mount:self.client_keyring_path = /tmp/tmp.jDMAxErb9f 2023-12-12T09:47:03.896 DEBUG:teuthology.orchestra.run.smithi142:> mktemp 2023-12-12T09:47:03.956 INFO:teuthology.orchestra.run.smithi142.stdout:/tmp/tmp.udAxfjuNW4 2023-12-12T09:47:03.956 DEBUG:teuthology.orchestra.run.smithi142:> sudo cp /tmp/tmp.jDMAxErb9f /tmp/tmp.udAxfjuNW4 2023-12-12T09:47:04.051 DEBUG:teuthology.orchestra.run.smithi142:> sudo chmod 0666 /tmp/tmp.udAxfjuNW4 2023-12-12T09:47:04.202 DEBUG:teuthology.orchestra.remote:smithi142:/tmp/tmp.udAxfjuNW4 is 226B 2023-12-12T09:47:04.266 DEBUG:teuthology.orchestra.run.smithi142:> rm -fr /tmp/tmp.udAxfjuNW4 2023-12-12T09:47:04.319 INFO:tasks.cephfs.mount:keyring content - [client.testuser] key = AQANLHhl8zZpKBAAe+ZOAx3IIF0HjcTJIGufUA== caps mds = "allow r fsname=cephfs, allow r fsname=cephfs2" caps mon = "allow r" caps osd = "allow r tag cephfs data=cephfs, allow r tag cephfs data=cephfs2" 2023-12-12T09:47:04.319 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-12-12T09:47:04.320 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T09:47:04.320 DEBUG:teuthology.orchestra.run.smithi142:> ip addr 2023-12-12T09:47:04.371 INFO:teuthology.orchestra.run.smithi142.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-12T09:47:04.372 INFO:teuthology.orchestra.run.smithi142.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-12T09:47:04.372 INFO:teuthology.orchestra.run.smithi142.stdout: inet 127.0.0.1/8 scope host lo 2023-12-12T09:47:04.372 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2023-12-12T09:47:04.372 INFO:teuthology.orchestra.run.smithi142.stdout: inet6 ::1/128 scope host 2023-12-12T09:47:04.372 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2023-12-12T09:47:04.372 INFO:teuthology.orchestra.run.smithi142.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-12T09:47:04.372 INFO:teuthology.orchestra.run.smithi142.stdout: link/ether 0c:c4:7a:d9:36:3c brd ff:ff:ff:ff:ff:ff 2023-12-12T09:47:04.372 INFO:teuthology.orchestra.run.smithi142.stdout: altname enp7s0f0 2023-12-12T09:47:04.372 INFO:teuthology.orchestra.run.smithi142.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-12T09:47:04.372 INFO:teuthology.orchestra.run.smithi142.stdout: link/ether 0c:c4:7a:d9:36:3d brd ff:ff:ff:ff:ff:ff 2023-12-12T09:47:04.372 INFO:teuthology.orchestra.run.smithi142.stdout: altname enp7s0f1 2023-12-12T09:47:04.372 INFO:teuthology.orchestra.run.smithi142.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-12T09:47:04.372 INFO:teuthology.orchestra.run.smithi142.stdout: link/ether 0c:c4:7a:88:6e:0c brd ff:ff:ff:ff:ff:ff 2023-12-12T09:47:04.372 INFO:teuthology.orchestra.run.smithi142.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-12T09:47:04.373 INFO:teuthology.orchestra.run.smithi142.stdout: link/ether 0c:c4:7a:88:6e:0d brd ff:ff:ff:ff:ff:ff 2023-12-12T09:47:04.373 INFO:teuthology.orchestra.run.smithi142.stdout: inet 172.21.15.142/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-12-12T09:47:04.373 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft 42178sec preferred_lft 42178sec 2023-12-12T09:47:04.373 INFO:teuthology.orchestra.run.smithi142.stdout: inet6 fe80::ec4:7aff:fe88:6e0d/64 scope link 2023-12-12T09:47:04.373 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2023-12-12T09:47:04.373 INFO:teuthology.orchestra.run.smithi142.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-12-12T09:47:04.373 INFO:teuthology.orchestra.run.smithi142.stdout: link/ether de:1c:dd:95:c8:e6 brd ff:ff:ff:ff:ff:ff 2023-12-12T09:47:04.373 INFO:teuthology.orchestra.run.smithi142.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-12-12T09:47:04.373 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2023-12-12T09:47:04.373 INFO:teuthology.orchestra.run.smithi142.stdout: inet6 fe80::f8b8:b6ff:fe33:420d/64 scope link 2023-12-12T09:47:04.373 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2023-12-12T09:47:04.373 INFO:teuthology.orchestra.run.smithi142.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-12T09:47:04.374 INFO:teuthology.orchestra.run.smithi142.stdout: link/ether de:1c:dd:95:c8:e6 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-12-12T09:47:04.374 INFO:teuthology.orchestra.run.smithi142.stdout: inet6 fe80::dc1c:ddff:fe95:c8e6/64 scope link 2023-12-12T09:47:04.374 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2023-12-12T09:47:04.375 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T09:47:04.375 DEBUG:teuthology.orchestra.run.smithi142:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-12T09:47:04.464 INFO:teuthology.orchestra.run.smithi142.stdout:1 2023-12-12T09:47:04.468 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T09:47:04.468 DEBUG:teuthology.orchestra.run.smithi142:> route 2023-12-12T09:47:04.519 INFO:teuthology.orchestra.run.smithi142.stdout:Kernel IP routing table 2023-12-12T09:47:04.519 INFO:teuthology.orchestra.run.smithi142.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-12T09:47:04.519 INFO:teuthology.orchestra.run.smithi142.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-12-12T09:47:04.519 INFO:teuthology.orchestra.run.smithi142.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-12-12T09:47:04.519 INFO:teuthology.orchestra.run.smithi142.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-12T09:47:04.520 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T09:47:04.520 DEBUG:teuthology.orchestra.run.smithi142:> (cd / && exec bash -c ' 2023-12-12T09:47:04.520 DEBUG:teuthology.orchestra.run.smithi142:> set -e 2023-12-12T09:47:04.520 DEBUG:teuthology.orchestra.run.smithi142:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-12-12T09:47:04.521 DEBUG:teuthology.orchestra.run.smithi142:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-12-12T09:47:04.521 DEBUG:teuthology.orchestra.run.smithi142:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-12-12T09:47:04.521 DEBUG:teuthology.orchestra.run.smithi142:> ') 2023-12-12T09:47:04.696 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T09:47:04.696 DEBUG:teuthology.orchestra.run.smithi142:> ip netns list 2023-12-12T09:47:04.747 INFO:teuthology.orchestra.run.smithi142.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-12-12T09:47:04.748 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-12-12T09:47:04.748 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T09:47:04.748 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip link set brx.0 up 2023-12-12T09:47:04.839 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-12T09:47:04.839 DEBUG:teuthology.orchestra.run.smithi142:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-12-12T09:47:04.894 INFO:teuthology.orchestra.run.smithi142.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-12-12T09:47:04.894 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-12T09:47:04.894 DEBUG:teuthology.orchestra.run.smithi142:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-12-12T09:47:04.946 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2023-12-12T09:47:04.946 DEBUG:teuthology.orchestra.run.smithi142:> dd if=/tmp/tmp.jDMAxErb9f of=/dev/stdout 2023-12-12T09:47:04.995 INFO:tasks.cephfs.kernel_mount:mounting using device: testuser@.cephfs2=/ 2023-12-12T09:47:04.996 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T09:47:04.996 DEBUG:teuthology.orchestra.run.smithi142:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph testuser@.cephfs2=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,secret=AQANLHhl8zZpKBAAe+ZOAx3IIF0HjcTJIGufUA==,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-12T09:47:05.183 INFO:teuthology.orchestra.run.smithi142.stdout:parsing options: rw,norequire_active_mds,secret=AQANLHhl8zZpKBAAe+ZOAx3IIF0HjcTJIGufUA==,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-12T09:47:05.183 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-12T09:47:05.183 INFO:teuthology.orchestra.run.smithi142.stdout:keyring.get_secret failed 2023-12-12T09:47:05.218 INFO:teuthology.orchestra.run.smithi142.stdout:parsing options: rw,norequire_active_mds,secret=AQANLHhl8zZpKBAAe+ZOAx3IIF0HjcTJIGufUA==,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-12T09:47:05.218 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-12T09:47:05.218 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: resolved to: "172.21.15.73:3300,172.21.15.142:3300,172.21.15.142:3301" 2023-12-12T09:47:05.218 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: trying mount with new device syntax: testuser@ba240992-02b8-4c7e-92f2-27eb29ac433b.cephfs2=/ 2023-12-12T09:47:05.218 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=testuser,ms_mode=prefer-crc,key=testuser,mon_addr=172.21.15.73:3300/172.21.15.142:3300/172.21.15.142:3301" will pass to kernel 2023-12-12T09:47:05.220 INFO:teuthology.orchestra.run.smithi142.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2023-12-12T09:47:05.220 INFO:teuthology.orchestra.run.smithi142.stdout: You just mounted a file system that supports labels which does not 2023-12-12T09:47:05.220 INFO:teuthology.orchestra.run.smithi142.stdout: contain labels, onto an SELinux box. It is likely that confined 2023-12-12T09:47:05.220 INFO:teuthology.orchestra.run.smithi142.stdout: applications will generate AVC messages and not be allowed access to 2023-12-12T09:47:05.220 INFO:teuthology.orchestra.run.smithi142.stdout: this file system. For more details see restorecon(8) and mount(8). 2023-12-12T09:47:05.224 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-12-12T09:47:05.224 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T09:47:05.224 DEBUG:teuthology.orchestra.run.smithi142:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-12-12T09:47:05.299 INFO:teuthology.orchestra.run.smithi142.stderr:chmod: changing permissions of '/home/ubuntu/cephtest/mnt.1': Permission denied 2023-12-12T09:47:05.302 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-12T09:47:05.303 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T09:47:05.303 DEBUG:teuthology.orchestra.run.smithi142:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-12T09:47:05.360 INFO:teuthology.orchestra.run.smithi142.stdout:client5566 2023-12-12T09:47:05.361 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2023-12-12T09:47:05.361 DEBUG:teuthology.orchestra.run.smithi142:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-12T09:47:05.411 INFO:tasks.cephfs.caps_helper:test read perm: read file /home/ubuntu/cephtest/mnt.0/testdir/testfile and expect data "self.path = /home/ubuntu/cephtest/mnt.0/testdir/testfile cephfs_name = cephfs cephfs_mntpt = / hostfs_mntpt = /home/ubuntu/cephtest/mnt.0" 2023-12-12T09:47:05.412 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T09:47:05.412 DEBUG:teuthology.orchestra.run.smithi073:> (cd /home/ubuntu/cephtest/mnt.0 && exec cat /home/ubuntu/cephtest/mnt.0/testdir/testfile) 2023-12-12T09:47:05.474 INFO:teuthology.orchestra.run.smithi073.stderr:cat: /home/ubuntu/cephtest/mnt.0/testdir/testfile: Permission denied 2023-12-12T09:47:05.474 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-12T09:47:05.475 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2023-12-12T09:47:05.475 DEBUG:teuthology.orchestra.run.smithi073:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-12T09:47:05.538 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2023-12-12T09:47:05.538 DEBUG:teuthology.orchestra.run.smithi073:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-12T09:47:05.604 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-12T09:47:05.858 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:05.858+0000 7ff322ddb640 1 Processor -- start 2023-12-12T09:47:05.859 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:05.858+0000 7ff322ddb640 1 -- start start 2023-12-12T09:47:05.860 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:05.859+0000 7ff322ddb640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff31c14e700 0x7ff31c151cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:05.860 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:05.859+0000 7ff322ddb640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7ff31c0c37b0 0x7ff31c0c02b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:05.860 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:05.859+0000 7ff322ddb640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff31c1521f0 con 0x7ff31c0ab4a0 2023-12-12T09:47:05.860 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:05.859+0000 7ff322ddb640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff31c0ab2d0 con 0x7ff31c0c37b0 2023-12-12T09:47:05.860 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:05.860+0000 7ff322ddb640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff31c06bb10 con 0x7ff31c14e700 2023-12-12T09:47:05.861 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:05.860+0000 7ff3225da640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7ff31c0ab4a0 0x7ff31c0a9df0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:54330/0 (socket says 172.21.15.73:54330) 2023-12-12T09:47:05.861 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:05.860+0000 7ff3225da640 1 -- 172.21.15.73:0/1440970895 learned_addr learned my addr 172.21.15.73:0/1440970895 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-12T09:47:05.861 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:05.860+0000 7ff321dd9640 1 --2- 172.21.15.73:0/1440970895 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff31c14e700 0x7ff31c151cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:05.861 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:05.860+0000 7ff3215d8640 1 --2- 172.21.15.73:0/1440970895 >> v2:172.21.15.142:3300/0 conn(0x7ff31c0c37b0 0x7ff31c0c02b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:05.861 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:05.860+0000 7ff320dd7640 1 -- 172.21.15.73:0/1440970895 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4003663874 0 0) 0x7ff314001110 con 0x7ff31c0ab4a0 2023-12-12T09:47:05.861 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:05.860+0000 7ff320dd7640 1 -- 172.21.15.73:0/1440970895 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff308003520 con 0x7ff31c0ab4a0 2023-12-12T09:47:05.863 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:05.861+0000 7ff320dd7640 1 -- 172.21.15.73:0/1440970895 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 450462719 0 0) 0x7ff308003520 con 0x7ff31c0ab4a0 2023-12-12T09:47:05.863 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:05.861+0000 7ff320dd7640 1 -- 172.21.15.73:0/1440970895 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff31c14e700 msgr2=0x7ff31c151cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:47:05.863 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:05.861+0000 7ff320dd7640 1 --2- 172.21.15.73:0/1440970895 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff31c14e700 0x7ff31c151cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:05.864 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:05.861+0000 7ff320dd7640 1 -- 172.21.15.73:0/1440970895 >> v2:172.21.15.142:3300/0 conn(0x7ff31c0c37b0 msgr2=0x7ff31c0c02b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:47:05.864 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:05.861+0000 7ff320dd7640 1 --2- 172.21.15.73:0/1440970895 >> v2:172.21.15.142:3300/0 conn(0x7ff31c0c37b0 0x7ff31c0c02b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:05.864 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:05.861+0000 7ff320dd7640 1 -- 172.21.15.73:0/1440970895 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff31c0c07f0 con 0x7ff31c0ab4a0 2023-12-12T09:47:05.864 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:05.861+0000 7ff320dd7640 1 -- 172.21.15.73:0/1440970895 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3186547832 0 0) 0x7ff314001800 con 0x7ff31c0ab4a0 2023-12-12T09:47:05.864 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:05.861+0000 7ff320dd7640 1 -- 172.21.15.73:0/1440970895 >> v1:172.21.15.73:6789/0 conn(0x7ff31c0ab4a0 legacy=0x7ff31c0a9df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:05.864 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:05.861+0000 7ff320dd7640 1 --2- 172.21.15.73:0/1440970895 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff308003970 0x7ff308003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:05.864 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:05.861+0000 7ff320dd7640 1 --2- 172.21.15.73:0/1440970895 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff3080047c0 0x7ff308004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:05.864 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:05.861+0000 7ff320dd7640 1 --2- 172.21.15.73:0/1440970895 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff308005180 0x7ff30800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:05.864 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:05.861+0000 7ff320dd7640 1 -- 172.21.15.73:0/1440970895 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff31c0ab2d0 con 0x7ff308003970 2023-12-12T09:47:05.864 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:05.861+0000 7ff320dd7640 1 -- 172.21.15.73:0/1440970895 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff31c06bb10 con 0x7ff3080047c0 2023-12-12T09:47:05.864 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:05.861+0000 7ff320dd7640 1 -- 172.21.15.73:0/1440970895 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff30800bff0 con 0x7ff308005180 2023-12-12T09:47:05.864 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:05.861+0000 7ff321dd9640 1 --2- 172.21.15.73:0/1440970895 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff31c14e700 0x7ff31c151cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-12T09:47:05.864 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:05.861+0000 7ff321dd9640 1 --2- 172.21.15.73:0/1440970895 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff308003970 0x7ff308003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:05.864 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:05.862+0000 7ff3225da640 1 --2- 172.21.15.73:0/1440970895 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff308005180 0x7ff30800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:05.864 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:05.862+0000 7ff3215d8640 1 --2- 172.21.15.73:0/1440970895 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff3080047c0 0x7ff308004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:05.865 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:05.862+0000 7ff321dd9640 1 -- 172.21.15.73:0/1440970895 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff308005180 msgr2=0x7ff30800b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:47:05.865 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:05.862+0000 7ff321dd9640 1 --2- 172.21.15.73:0/1440970895 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff308005180 0x7ff30800b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:05.865 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:05.862+0000 7ff321dd9640 1 -- 172.21.15.73:0/1440970895 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff3080047c0 msgr2=0x7ff308004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:47:05.865 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:05.862+0000 7ff321dd9640 1 --2- 172.21.15.73:0/1440970895 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff3080047c0 0x7ff308004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:05.865 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:05.862+0000 7ff321dd9640 1 -- 172.21.15.73:0/1440970895 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff308003520 con 0x7ff308003970 2023-12-12T09:47:05.865 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:05.862+0000 7ff3215d8640 1 --2- 172.21.15.73:0/1440970895 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff3080047c0 0x7ff308004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:47:05.865 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:05.863+0000 7ff321dd9640 1 --2- 172.21.15.73:0/1440970895 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff308003970 0x7ff308003d90 secure :-1 s=READY pgs=1014 cs=0 l=1 rev1=1 crypto rx=0x7ff31c0a8660 tx=0x7ff3080057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3335b2b748251ab server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:47:05.865 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:05.863+0000 7ff320dd7640 1 -- 172.21.15.73:0/1440970895 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff310004030 con 0x7ff308003970 2023-12-12T09:47:05.865 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:05.863+0000 7ff320dd7640 1 -- 172.21.15.73:0/1440970895 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff310004190 con 0x7ff308003970 2023-12-12T09:47:05.865 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:05.863+0000 7ff320dd7640 1 -- 172.21.15.73:0/1440970895 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff310004520 con 0x7ff308003970 2023-12-12T09:47:05.866 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:05.864+0000 7ff322ddb640 1 -- 172.21.15.73:0/1440970895 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff308003970 msgr2=0x7ff308003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:05.866 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:05.864+0000 7ff322ddb640 1 --2- 172.21.15.73:0/1440970895 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff308003970 0x7ff308003d90 secure :-1 s=READY pgs=1014 cs=0 l=1 rev1=1 crypto rx=0x7ff31c0a8660 tx=0x7ff3080057f0 comp rx=0 tx=0).stop 2023-12-12T09:47:05.866 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:05.864+0000 7ff3225da640 1 -- 172.21.15.73:0/1440970895 reap_dead start 2023-12-12T09:47:05.866 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:05.864+0000 7ff322ddb640 1 -- 172.21.15.73:0/1440970895 shutdown_connections 2023-12-12T09:47:05.866 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:05.864+0000 7ff322ddb640 1 -- 172.21.15.73:0/1440970895 >> 172.21.15.73:0/1440970895 conn(0x7ff31c0c23b0 msgr2=0x7ff31c0c2790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:47:05.867 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:05.864+0000 7ff322ddb640 1 -- 172.21.15.73:0/1440970895 shutdown_connections 2023-12-12T09:47:05.867 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:05.864+0000 7ff322ddb640 1 -- 172.21.15.73:0/1440970895 wait complete. 2023-12-12T09:47:05.867 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:05.866+0000 7ff322ddb640 1 Processor -- start 2023-12-12T09:47:05.867 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:05.866+0000 7ff322ddb640 1 -- start start 2023-12-12T09:47:05.869 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:05.867+0000 7ff322ddb640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff308003970 0x7ff31c1e9650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:05.869 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:05.867+0000 7ff322ddb640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff31c14bb40 0x7ff31c147690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:05.869 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:05.867+0000 7ff322ddb640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff31c147bd0 0x7ff31c0be910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:05.869 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:05.867+0000 7ff322ddb640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff31c154e00 con 0x7ff31c147bd0 2023-12-12T09:47:05.869 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:05.867+0000 7ff322ddb640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff31c1e3390 con 0x7ff31c14bb40 2023-12-12T09:47:05.869 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:05.867+0000 7ff322ddb640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff31c1541e0 con 0x7ff308003970 2023-12-12T09:47:05.869 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:05.867+0000 7ff3225da640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff31c147bd0 0x7ff31c0be910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:05.869 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:05.867+0000 7ff3225da640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff31c147bd0 0x7ff31c0be910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:56128/0 (socket says 172.21.15.73:56128) 2023-12-12T09:47:05.869 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:05.867+0000 7ff3225da640 1 -- 172.21.15.73:0/691896163 learned_addr learned my addr 172.21.15.73:0/691896163 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:47:05.869 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:05.867+0000 7ff3225da640 1 -- 172.21.15.73:0/691896163 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff308003970 msgr2=0x7ff31c1e9650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:05.869 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:05.867+0000 7ff3225da640 1 --2- 172.21.15.73:0/691896163 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff308003970 0x7ff31c1e9650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:05.869 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:05.867+0000 7ff3225da640 1 -- 172.21.15.73:0/691896163 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff31c14bb40 msgr2=0x7ff31c147690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:05.870 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:05.867+0000 7ff3215d8640 1 --2- 172.21.15.73:0/691896163 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff31c14bb40 0x7ff31c147690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:05.870 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:05.867+0000 7ff3225da640 1 --2- 172.21.15.73:0/691896163 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff31c14bb40 0x7ff31c147690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:05.870 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:05.867+0000 7ff3225da640 1 -- 172.21.15.73:0/691896163 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff31c1e9b90 con 0x7ff31c147bd0 2023-12-12T09:47:05.870 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:05.868+0000 7ff3225da640 1 --2- 172.21.15.73:0/691896163 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff31c147bd0 0x7ff31c0be910 secure :-1 s=READY pgs=1015 cs=0 l=1 rev1=1 crypto rx=0x7ff31c0c68c0 tx=0x7ff31400e820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:47:05.870 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:05.868+0000 7ff30e7fc640 1 -- 172.21.15.73:0/691896163 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff314010510 con 0x7ff31c147bd0 2023-12-12T09:47:05.870 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:05.868+0000 7ff30e7fc640 1 -- 172.21.15.73:0/691896163 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff314010690 con 0x7ff31c147bd0 2023-12-12T09:47:05.870 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:05.868+0000 7ff322ddb640 1 -- 172.21.15.73:0/691896163 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff31c1544a0 con 0x7ff31c147bd0 2023-12-12T09:47:05.870 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:05.868+0000 7ff30e7fc640 1 -- 172.21.15.73:0/691896163 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff314010a40 con 0x7ff31c147bd0 2023-12-12T09:47:05.870 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:05.868+0000 7ff322ddb640 1 -- 172.21.15.73:0/691896163 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff31c1552f0 con 0x7ff31c147bd0 2023-12-12T09:47:05.871 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:05.869+0000 7ff322ddb640 1 -- 172.21.15.73:0/691896163 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff31c155510 con 0x7ff31c147bd0 2023-12-12T09:47:05.871 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:05.870+0000 7ff30e7fc640 1 -- 172.21.15.73:0/691896163 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7ff314010ba0 con 0x7ff31c147bd0 2023-12-12T09:47:05.871 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:05.871+0000 7ff30e7fc640 1 --2- 172.21.15.73:0/691896163 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7ff30006ae40 0x7ff30006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:05.871 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:05.871+0000 7ff30e7fc640 1 -- 172.21.15.73:0/691896163 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6565+0+0 (secure 0 0 0) 0x7ff314088e30 con 0x7ff31c147bd0 2023-12-12T09:47:05.871 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:05.871+0000 7ff321dd9640 1 --2- 172.21.15.73:0/691896163 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7ff30006ae40 0x7ff30006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:05.872 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:05.872+0000 7ff321dd9640 1 --2- 172.21.15.73:0/691896163 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7ff30006ae40 0x7ff30006d300 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7ff310035000 tx=0x7ff31002e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:47:05.876 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:05.875+0000 7ff30e7fc640 1 -- 172.21.15.73:0/691896163 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7ff314053b70 con 0x7ff31c147bd0 2023-12-12T09:47:06.070 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:06.069+0000 7ff322ddb640 1 -- 172.21.15.73:0/691896163 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff31c1521f0 con 0x7ff31c147bd0 2023-12-12T09:47:06.074 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:06.073+0000 7ff30e7fc640 1 -- 172.21.15.73:0/691896163 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v79) v1 ==== 74+0+20226 (secure 0 0 0) 0x7ff31c1521f0 con 0x7ff31c147bd0 2023-12-12T09:47:06.074 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-12T09:47:06.075 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":79,"fsid":"ba240992-02b8-4c7e-92f2-27eb29ac433b","created":"2023-12-12T09:43:02.454719+0000","modified":"2023-12-12T09:46:43.294476+0000","last_up_change":"2023-12-12T09:43:13.913440+0000","last_in_change":"2023-12-12T09:43:05.925348+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-12T09:43:15.525508+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2023-12-12T09:46:24.716544+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2023-12-12T09:46:25.435954+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs2_metadata","create_time":"2023-12-12T09:46:40.116878+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs2_data","create_time":"2023-12-12T09:46:40.798840+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"dd9074be-dbe2-4c34-9896-a4223d8d3940","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":4047810203},{"type":"v1","addr":"172.21.15.73:6801","nonce":4047810203}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":4047810203},{"type":"v1","addr":"172.21.15.73:6803","nonce":4047810203}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":4047810203},{"type":"v1","addr":"172.21.15.73:6807","nonce":4047810203}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":4047810203},{"type":"v1","addr":"172.21.15.73:6805","nonce":4047810203}]},"public_addr":"172.21.15.73:6801/4047810203","cluster_addr":"172.21.15.73:6803/4047810203","heartbeat_back_addr":"172.21.15.73:6807/4047810203","heartbeat_front_addr":"172.21.15.73:6805/4047810203","state":["exists","up"]},{"osd":1,"uuid":"c4a05052-96d4-4758-a4e1-1a37f1e07fed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":1356058331},{"type":"v1","addr":"172.21.15.73:6824","nonce":1356058331}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":1356058331},{"type":"v1","addr":"172.21.15.73:6827","nonce":1356058331}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":1356058331},{"type":"v1","addr":"172.21.15.73:6831","nonce":1356058331}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":1356058331},{"type":"v1","addr":"172.21.15.73:6829","nonce":1356058331}]},"public_addr":"172.21.15.73:6824/1356058331","cluster_addr":"172.21.15.73:6827/1356058331","heartbeat_back_addr":"172.21.15.73:6831/1356058331","heartbeat_front_addr":"172.21.15.73:6829/1356058331","state":["exists","up"]},{"osd":2,"uuid":"512bc8ac-72c2-40d4-b3d2-d867a92c5213","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":1228903316},{"type":"v1","addr":"172.21.15.73:6817","nonce":1228903316}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":1228903316},{"type":"v1","addr":"172.21.15.73:6819","nonce":1228903316}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6823","nonce":1228903316},{"type":"v1","addr":"172.21.15.73:6825","nonce":1228903316}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":1228903316},{"type":"v1","addr":"172.21.15.73:6821","nonce":1228903316}]},"public_addr":"172.21.15.73:6817/1228903316","cluster_addr":"172.21.15.73:6819/1228903316","heartbeat_back_addr":"172.21.15.73:6825/1228903316","heartbeat_front_addr":"172.21.15.73:6821/1228903316","state":["exists","up"]},{"osd":3,"uuid":"3d1a91e0-42bf-437a-8eae-8d357c8f63a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":1293329670},{"type":"v1","addr":"172.21.15.73:6809","nonce":1293329670}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6810","nonce":1293329670},{"type":"v1","addr":"172.21.15.73:6811","nonce":1293329670}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":1293329670},{"type":"v1","addr":"172.21.15.73:6815","nonce":1293329670}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":1293329670},{"type":"v1","addr":"172.21.15.73:6813","nonce":1293329670}]},"public_addr":"172.21.15.73:6809/1293329670","cluster_addr":"172.21.15.73:6811/1293329670","heartbeat_back_addr":"172.21.15.73:6815/1293329670","heartbeat_front_addr":"172.21.15.73:6813/1293329670","state":["exists","up"]},{"osd":4,"uuid":"4b302fff-834c-4069-ac19-00e46f6c87b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":3727975702},{"type":"v1","addr":"172.21.15.142:6801","nonce":3727975702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":3727975702},{"type":"v1","addr":"172.21.15.142:6803","nonce":3727975702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6809","nonce":3727975702},{"type":"v1","addr":"172.21.15.142:6811","nonce":3727975702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6805","nonce":3727975702},{"type":"v1","addr":"172.21.15.142:6807","nonce":3727975702}]},"public_addr":"172.21.15.142:6801/3727975702","cluster_addr":"172.21.15.142:6803/3727975702","heartbeat_back_addr":"172.21.15.142:6811/3727975702","heartbeat_front_addr":"172.21.15.142:6807/3727975702","state":["exists","up"]},{"osd":5,"uuid":"d7cdace2-67d0-45cc-95f2-515cf6ef1b82","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6817","nonce":2353193632},{"type":"v1","addr":"172.21.15.142:6819","nonce":2353193632}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6821","nonce":2353193632},{"type":"v1","addr":"172.21.15.142:6823","nonce":2353193632}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6829","nonce":2353193632},{"type":"v1","addr":"172.21.15.142:6831","nonce":2353193632}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6825","nonce":2353193632},{"type":"v1","addr":"172.21.15.142:6827","nonce":2353193632}]},"public_addr":"172.21.15.142:6819/2353193632","cluster_addr":"172.21.15.142:6823/2353193632","heartbeat_back_addr":"172.21.15.142:6831/2353193632","heartbeat_front_addr":"172.21.15.142:6827/2353193632","state":["exists","up"]},{"osd":6,"uuid":"649ce78a-5626-445c-aedc-a651ed05a6f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":2006111986},{"type":"v1","addr":"172.21.15.142:6806","nonce":2006111986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":2006111986},{"type":"v1","addr":"172.21.15.142:6810","nonce":2006111986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":2006111986},{"type":"v1","addr":"172.21.15.142:6815","nonce":2006111986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":2006111986},{"type":"v1","addr":"172.21.15.142:6813","nonce":2006111986}]},"public_addr":"172.21.15.142:6806/2006111986","cluster_addr":"172.21.15.142:6810/2006111986","heartbeat_back_addr":"172.21.15.142:6815/2006111986","heartbeat_front_addr":"172.21.15.142:6813/2006111986","state":["exists","up"]},{"osd":7,"uuid":"af15ae3b-c1d0-4acf-92db-8a1805494d13","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":2573794341},{"type":"v1","addr":"172.21.15.142:6818","nonce":2573794341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":2573794341},{"type":"v1","addr":"172.21.15.142:6822","nonce":2573794341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":2573794341},{"type":"v1","addr":"172.21.15.142:6830","nonce":2573794341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":2573794341},{"type":"v1","addr":"172.21.15.142:6826","nonce":2573794341}]},"public_addr":"172.21.15.142:6818/2573794341","cluster_addr":"172.21.15.142:6822/2573794341","heartbeat_back_addr":"172.21.15.142:6830/2573794341","heartbeat_front_addr":"172.21.15.142:6826/2573794341","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.185824+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.262103+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.225556+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:10.523459+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:10.706035+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.257339+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.301776+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.051960+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-12T09:47:06.076 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:06.076+0000 7ff322ddb640 1 -- 172.21.15.73:0/691896163 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7ff30006ae40 msgr2=0x7ff30006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:06.076 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:06.076+0000 7ff322ddb640 1 --2- 172.21.15.73:0/691896163 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7ff30006ae40 0x7ff30006d300 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7ff310035000 tx=0x7ff31002e000 comp rx=0 tx=0).stop 2023-12-12T09:47:06.077 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:06.076+0000 7ff322ddb640 1 -- 172.21.15.73:0/691896163 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff31c147bd0 msgr2=0x7ff31c0be910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:06.077 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:06.076+0000 7ff322ddb640 1 --2- 172.21.15.73:0/691896163 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff31c147bd0 0x7ff31c0be910 secure :-1 s=READY pgs=1015 cs=0 l=1 rev1=1 crypto rx=0x7ff31c0c68c0 tx=0x7ff31400e820 comp rx=0 tx=0).stop 2023-12-12T09:47:06.077 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:06.076+0000 7ff322ddb640 1 -- 172.21.15.73:0/691896163 shutdown_connections 2023-12-12T09:47:06.077 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:06.076+0000 7ff322ddb640 1 --2- 172.21.15.73:0/691896163 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7ff30006ae40 0x7ff30006d300 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:06.077 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:06.076+0000 7ff322ddb640 1 --2- 172.21.15.73:0/691896163 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff31c147bd0 0x7ff31c0be910 unknown :-1 s=CLOSED pgs=1015 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:06.077 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:06.076+0000 7ff322ddb640 1 --2- 172.21.15.73:0/691896163 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff31c14bb40 0x7ff31c147690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:06.078 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:06.076+0000 7ff322ddb640 1 --2- 172.21.15.73:0/691896163 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff308003970 0x7ff31c1e9650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:06.078 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:06.076+0000 7ff322ddb640 1 -- 172.21.15.73:0/691896163 >> 172.21.15.73:0/691896163 conn(0x7ff31c0c23b0 msgr2=0x7ff31c0c0ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:47:06.078 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:06.076+0000 7ff322ddb640 1 -- 172.21.15.73:0/691896163 shutdown_connections 2023-12-12T09:47:06.078 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:06.076+0000 7ff322ddb640 1 -- 172.21.15.73:0/691896163 wait complete. 2023-12-12T09:47:06.095 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-12T09:43:15.525508+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 12, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-12T09:46:24.716544+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '74', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 13, 'pool_name': 'cephfs_data', 'create_time': '2023-12-12T09:46:25.435954+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '75', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 14, 'pool_name': 'cephfs2_metadata', 'create_time': '2023-12-12T09:46:40.116878+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '78', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs2'}}, 'read_balance': {'score_acting': 2.5, 'score_stable': 2.5, 'optimal_score': 1, 'raw_score_acting': 2.5, 'raw_score_stable': 2.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 15, 'pool_name': 'cephfs2_data', 'create_time': '2023-12-12T09:46:40.798840+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '79', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs2'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-12T09:47:06.095 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-12T09:47:06.312 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:06.311+0000 7ff20010f640 1 Processor -- start 2023-12-12T09:47:06.312 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:06.311+0000 7ff20010f640 1 -- start start 2023-12-12T09:47:06.313 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:06.313+0000 7ff20010f640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7ff1f814f8c0 0x7ff1f806dc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:06.313 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:06.313+0000 7ff20010f640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff1f806d350 0x7ff1f8071e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:06.314 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:06.313+0000 7ff20010f640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1f80c16c0 con 0x7ff1f80723a0 2023-12-12T09:47:06.314 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:06.313+0000 7ff20010f640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1f80c1090 con 0x7ff1f814f8c0 2023-12-12T09:47:06.314 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:06.313+0000 7ff20010f640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1f80c14b0 con 0x7ff1f806d350 2023-12-12T09:47:06.314 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:06.313+0000 7ff1fe6ac640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7ff1f80723a0 0x7ff1f8152500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:54336/0 (socket says 172.21.15.73:54336) 2023-12-12T09:47:06.314 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:06.313+0000 7ff1fe6ac640 1 -- 172.21.15.73:0/2645634367 learned_addr learned my addr 172.21.15.73:0/2645634367 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-12T09:47:06.314 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:06.313+0000 7ff1fdeab640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7ff1f814f8c0 0x7ff1f806dc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:06.315 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:06.314+0000 7ff1fd6aa640 1 --2- 172.21.15.73:0/2645634367 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff1f806d350 0x7ff1f8071e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:06.315 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:06.314+0000 7ff1fcea9640 1 -- 172.21.15.73:0/2645634367 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2338421957 0 0) 0x7ff1f80c16c0 con 0x7ff1f80723a0 2023-12-12T09:47:06.315 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:06.314+0000 7ff1fcea9640 1 -- 172.21.15.73:0/2645634367 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff1e4003520 con 0x7ff1f80723a0 2023-12-12T09:47:06.315 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:06.314+0000 7ff1fdeab640 1 -- 172.21.15.73:0/2645634367 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff1f806d350 msgr2=0x7ff1f8071e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:47:06.315 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:06.314+0000 7ff1fdeab640 1 --2- 172.21.15.73:0/2645634367 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff1f806d350 0x7ff1f8071e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:06.315 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:06.314+0000 7ff1fdeab640 1 -- 172.21.15.73:0/2645634367 >> v1:172.21.15.73:6789/0 conn(0x7ff1f80723a0 legacy=0x7ff1f8152500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:06.315 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:06.314+0000 7ff1fdeab640 1 -- 172.21.15.73:0/2645634367 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1f80c19a0 con 0x7ff1f814f8c0 2023-12-12T09:47:06.316 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:06.315+0000 7ff1fdeab640 1 --2- 172.21.15.73:0/2645634367 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff1f814f8c0 0x7ff1f806dc40 secure :-1 s=READY pgs=1017 cs=0 l=1 rev1=1 crypto rx=0x7ff1f40097d0 tx=0x7ff1f402b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7374bb9f9bc29947 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:47:06.316 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:06.315+0000 7ff1fcea9640 1 -- 172.21.15.73:0/2645634367 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1f4031800 con 0x7ff1f814f8c0 2023-12-12T09:47:06.316 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:06.315+0000 7ff1fcea9640 1 -- 172.21.15.73:0/2645634367 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1f4031960 con 0x7ff1f814f8c0 2023-12-12T09:47:06.316 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:06.316+0000 7ff1fcea9640 1 -- 172.21.15.73:0/2645634367 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1f4031cd0 con 0x7ff1f814f8c0 2023-12-12T09:47:06.317 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:06.316+0000 7ff20010f640 1 -- 172.21.15.73:0/2645634367 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff1f814f8c0 msgr2=0x7ff1f806dc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:06.317 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:06.316+0000 7ff20010f640 1 --2- 172.21.15.73:0/2645634367 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff1f814f8c0 0x7ff1f806dc40 secure :-1 s=READY pgs=1017 cs=0 l=1 rev1=1 crypto rx=0x7ff1f40097d0 tx=0x7ff1f402b8a0 comp rx=0 tx=0).stop 2023-12-12T09:47:06.317 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:06.316+0000 7ff20010f640 1 -- 172.21.15.73:0/2645634367 shutdown_connections 2023-12-12T09:47:06.317 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:06.316+0000 7ff20010f640 1 --2- 172.21.15.73:0/2645634367 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff1f806d350 0x7ff1f8071e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:06.317 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:06.316+0000 7ff20010f640 1 --2- 172.21.15.73:0/2645634367 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff1f814f8c0 0x7ff1f806dc40 unknown :-1 s=CLOSED pgs=1017 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:06.317 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:06.316+0000 7ff20010f640 1 -- 172.21.15.73:0/2645634367 >> 172.21.15.73:0/2645634367 conn(0x7ff1f806a4e0 msgr2=0x7ff1f806a8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:47:06.317 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:06.316+0000 7ff20010f640 1 -- 172.21.15.73:0/2645634367 shutdown_connections 2023-12-12T09:47:06.317 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:06.316+0000 7ff20010f640 1 -- 172.21.15.73:0/2645634367 wait complete. 2023-12-12T09:47:06.318 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:06.318+0000 7ff20010f640 1 Processor -- start 2023-12-12T09:47:06.318 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:06.318+0000 7ff20010f640 1 -- start start 2023-12-12T09:47:06.320 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:06.319+0000 7ff20010f640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff1f806d350 0x7ff1f80befc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:06.320 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:06.319+0000 7ff20010f640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff1f80723a0 0x7ff1f81ea210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:06.320 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:06.319+0000 7ff20010f640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff1f814f8c0 0x7ff1f8070f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:06.320 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:06.319+0000 7ff20010f640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1f81e9d80 con 0x7ff1f806d350 2023-12-12T09:47:06.320 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:06.319+0000 7ff20010f640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1f814bb40 con 0x7ff1f814f8c0 2023-12-12T09:47:06.320 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:06.319+0000 7ff20010f640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1f814ade0 con 0x7ff1f80723a0 2023-12-12T09:47:06.320 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:06.319+0000 7ff1fdeab640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff1f806d350 0x7ff1f80befc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:06.320 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:06.319+0000 7ff1fdeab640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff1f806d350 0x7ff1f80befc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:56146/0 (socket says 172.21.15.73:56146) 2023-12-12T09:47:06.320 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:06.319+0000 7ff1fdeab640 1 -- 172.21.15.73:0/4194482134 learned_addr learned my addr 172.21.15.73:0/4194482134 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:47:06.322 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:06.320+0000 7ff1fd6aa640 1 --2- 172.21.15.73:0/4194482134 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff1f80723a0 0x7ff1f81ea210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:06.322 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:06.320+0000 7ff1fdeab640 1 -- 172.21.15.73:0/4194482134 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff1f80723a0 msgr2=0x7ff1f81ea210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:06.322 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:06.320+0000 7ff1fdeab640 1 --2- 172.21.15.73:0/4194482134 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff1f80723a0 0x7ff1f81ea210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:06.322 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:06.320+0000 7ff1fe6ac640 1 --2- 172.21.15.73:0/4194482134 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff1f814f8c0 0x7ff1f8070f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:06.322 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:06.320+0000 7ff1fdeab640 1 -- 172.21.15.73:0/4194482134 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff1f814f8c0 msgr2=0x7ff1f8070f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:06.322 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:06.320+0000 7ff1fdeab640 1 --2- 172.21.15.73:0/4194482134 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff1f814f8c0 0x7ff1f8070f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:06.322 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:06.320+0000 7ff1fdeab640 1 -- 172.21.15.73:0/4194482134 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1f4009400 con 0x7ff1f806d350 2023-12-12T09:47:06.322 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:06.320+0000 7ff1fd6aa640 1 --2- 172.21.15.73:0/4194482134 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff1f80723a0 0x7ff1f81ea210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:47:06.322 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:06.320+0000 7ff1fe6ac640 1 --2- 172.21.15.73:0/4194482134 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff1f814f8c0 0x7ff1f8070f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:47:06.322 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:06.320+0000 7ff1fdeab640 1 --2- 172.21.15.73:0/4194482134 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff1f806d350 0x7ff1f80befc0 secure :-1 s=READY pgs=1018 cs=0 l=1 rev1=1 crypto rx=0x7ff1f402b8e0 tx=0x7ff1f40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:47:06.322 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:06.321+0000 7ff1ee7fc640 1 -- 172.21.15.73:0/4194482134 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1f403ac60 con 0x7ff1f806d350 2023-12-12T09:47:06.322 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:06.321+0000 7ff1ee7fc640 1 -- 172.21.15.73:0/4194482134 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1f403ade0 con 0x7ff1f806d350 2023-12-12T09:47:06.323 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:06.321+0000 7ff20010f640 1 -- 172.21.15.73:0/4194482134 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1f81e9a30 con 0x7ff1f806d350 2023-12-12T09:47:06.323 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:06.321+0000 7ff1ee7fc640 1 -- 172.21.15.73:0/4194482134 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1f4044630 con 0x7ff1f806d350 2023-12-12T09:47:06.323 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:06.321+0000 7ff20010f640 1 -- 172.21.15.73:0/4194482134 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1f81eda50 con 0x7ff1f806d350 2023-12-12T09:47:06.323 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:06.322+0000 7ff20010f640 1 -- 172.21.15.73:0/4194482134 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff1f8067070 con 0x7ff1f806d350 2023-12-12T09:47:06.323 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:06.323+0000 7ff1ee7fc640 1 -- 172.21.15.73:0/4194482134 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7ff1f404d450 con 0x7ff1f806d350 2023-12-12T09:47:06.324 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:06.324+0000 7ff1ee7fc640 1 --2- 172.21.15.73:0/4194482134 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7ff1dc06ae40 0x7ff1dc06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:06.324 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:06.324+0000 7ff1ee7fc640 1 -- 172.21.15.73:0/4194482134 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6565+0+0 (secure 0 0 0) 0x7ff1f402e070 con 0x7ff1f806d350 2023-12-12T09:47:06.325 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:06.324+0000 7ff1fd6aa640 1 --2- 172.21.15.73:0/4194482134 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7ff1dc06ae40 0x7ff1dc06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:06.325 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:06.325+0000 7ff1fd6aa640 1 --2- 172.21.15.73:0/4194482134 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7ff1dc06ae40 0x7ff1dc06d300 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7ff1f80abd30 tx=0x7ff1e8008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:47:06.329 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:06.329+0000 7ff1ee7fc640 1 -- 172.21.15.73:0/4194482134 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7ff1f4076920 con 0x7ff1f806d350 2023-12-12T09:47:06.525 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:06.525+0000 7ff20010f640 1 -- 172.21.15.73:0/4194482134 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ff1f8067580 con 0x7ff1f806d350 2023-12-12T09:47:06.526 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:06.525+0000 7ff1ee7fc640 1 -- 172.21.15.73:0/4194482134 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v79) v1 ==== 93+0+10 (secure 0 0 0) 0x7ff1f4035020 con 0x7ff1f806d350 2023-12-12T09:47:06.526 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 1 2023-12-12T09:47:06.530 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:06.528+0000 7ff20010f640 1 -- 172.21.15.73:0/4194482134 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7ff1dc06ae40 msgr2=0x7ff1dc06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:06.530 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:06.528+0000 7ff20010f640 1 --2- 172.21.15.73:0/4194482134 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7ff1dc06ae40 0x7ff1dc06d300 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7ff1f80abd30 tx=0x7ff1e8008040 comp rx=0 tx=0).stop 2023-12-12T09:47:06.530 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:06.528+0000 7ff20010f640 1 -- 172.21.15.73:0/4194482134 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff1f806d350 msgr2=0x7ff1f80befc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:06.530 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:06.528+0000 7ff20010f640 1 --2- 172.21.15.73:0/4194482134 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff1f806d350 0x7ff1f80befc0 secure :-1 s=READY pgs=1018 cs=0 l=1 rev1=1 crypto rx=0x7ff1f402b8e0 tx=0x7ff1f40046c0 comp rx=0 tx=0).stop 2023-12-12T09:47:06.530 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:06.528+0000 7ff20010f640 1 -- 172.21.15.73:0/4194482134 shutdown_connections 2023-12-12T09:47:06.530 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:06.528+0000 7ff20010f640 1 --2- 172.21.15.73:0/4194482134 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7ff1dc06ae40 0x7ff1dc06d300 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:06.530 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:06.528+0000 7ff20010f640 1 --2- 172.21.15.73:0/4194482134 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff1f814f8c0 0x7ff1f8070f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:06.530 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:06.528+0000 7ff20010f640 1 --2- 172.21.15.73:0/4194482134 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff1f80723a0 0x7ff1f81ea210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:06.530 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:06.528+0000 7ff20010f640 1 --2- 172.21.15.73:0/4194482134 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff1f806d350 0x7ff1f80befc0 unknown :-1 s=CLOSED pgs=1018 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:06.530 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:06.528+0000 7ff20010f640 1 -- 172.21.15.73:0/4194482134 >> 172.21.15.73:0/4194482134 conn(0x7ff1f806a4e0 msgr2=0x7ff1f806a8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:47:06.530 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:06.529+0000 7ff20010f640 1 -- 172.21.15.73:0/4194482134 shutdown_connections 2023-12-12T09:47:06.530 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:06.529+0000 7ff20010f640 1 -- 172.21.15.73:0/4194482134 wait complete. 2023-12-12T09:47:06.548 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-12T09:47:06.763 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:06.760+0000 7f5cab01e640 1 Processor -- start 2023-12-12T09:47:06.763 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:06.760+0000 7f5cab01e640 1 -- start start 2023-12-12T09:47:06.763 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:06.762+0000 7f5cab01e640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5ca4152000 0x7f5ca41551e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:06.764 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:06.762+0000 7f5cab01e640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f5ca40c84d0 0x7f5ca406c340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:06.764 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:06.762+0000 7f5cab01e640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f5ca406c880 0x7f5ca40c68c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:06.764 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:06.762+0000 7f5cab01e640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ca4155720 con 0x7f5ca40c84d0 2023-12-12T09:47:06.764 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:06.762+0000 7f5cab01e640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ca406bb80 con 0x7f5ca406c880 2023-12-12T09:47:06.764 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:06.762+0000 7f5cab01e640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ca40c4830 con 0x7f5ca4152000 2023-12-12T09:47:06.764 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:06.762+0000 7f5c9bfff640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f5ca40c84d0 0x7f5ca406c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:06.764 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:06.762+0000 7f5c9bfff640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f5ca40c84d0 0x7f5ca406c340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:56150/0 (socket says 172.21.15.73:56150) 2023-12-12T09:47:06.764 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:06.762+0000 7f5c9bfff640 1 -- 172.21.15.73:0/476097545 learned_addr learned my addr 172.21.15.73:0/476097545 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:47:06.764 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:06.762+0000 7f5ca8dba640 1 --2- 172.21.15.73:0/476097545 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5ca4152000 0x7f5ca41551e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:06.764 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:06.762+0000 7f5ca95bb640 1 --2- 172.21.15.73:0/476097545 >> v2:172.21.15.142:3300/0 conn(0x7f5ca406c880 0x7f5ca40c68c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:06.766 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:06.763+0000 7f5c9bfff640 1 -- 172.21.15.73:0/476097545 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5ca4152000 msgr2=0x7f5ca41551e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:47:06.766 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:06.763+0000 7f5c9bfff640 1 --2- 172.21.15.73:0/476097545 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5ca4152000 0x7f5ca41551e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:06.766 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:06.763+0000 7f5c9bfff640 1 -- 172.21.15.73:0/476097545 >> v2:172.21.15.142:3300/0 conn(0x7f5ca406c880 msgr2=0x7f5ca40c68c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:47:06.766 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:06.763+0000 7f5c9bfff640 1 --2- 172.21.15.73:0/476097545 >> v2:172.21.15.142:3300/0 conn(0x7f5ca406c880 0x7f5ca40c68c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:06.766 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:06.763+0000 7f5c9bfff640 1 -- 172.21.15.73:0/476097545 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ca40c4b10 con 0x7f5ca40c84d0 2023-12-12T09:47:06.766 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:06.764+0000 7f5c9bfff640 1 --2- 172.21.15.73:0/476097545 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5ca40c84d0 0x7f5ca406c340 secure :-1 s=READY pgs=1019 cs=0 l=1 rev1=1 crypto rx=0x7f5ca40aca00 tx=0x7f5c9402b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a8d96ed812a7c39 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:47:06.766 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:06.764+0000 7f5c9b7fe640 1 -- 172.21.15.73:0/476097545 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c940317e0 con 0x7f5ca40c84d0 2023-12-12T09:47:06.766 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:06.764+0000 7f5c9b7fe640 1 -- 172.21.15.73:0/476097545 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c94031940 con 0x7f5ca40c84d0 2023-12-12T09:47:06.766 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:06.764+0000 7f5c9b7fe640 1 -- 172.21.15.73:0/476097545 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c94031cd0 con 0x7f5ca40c84d0 2023-12-12T09:47:06.766 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:06.765+0000 7f5cab01e640 1 -- 172.21.15.73:0/476097545 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5ca40c84d0 msgr2=0x7f5ca406c340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:06.766 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:06.765+0000 7f5cab01e640 1 --2- 172.21.15.73:0/476097545 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5ca40c84d0 0x7f5ca406c340 secure :-1 s=READY pgs=1019 cs=0 l=1 rev1=1 crypto rx=0x7f5ca40aca00 tx=0x7f5c9402b880 comp rx=0 tx=0).stop 2023-12-12T09:47:06.766 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:06.765+0000 7f5cab01e640 1 -- 172.21.15.73:0/476097545 shutdown_connections 2023-12-12T09:47:06.767 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:06.765+0000 7f5cab01e640 1 --2- 172.21.15.73:0/476097545 >> v2:172.21.15.142:3300/0 conn(0x7f5ca406c880 0x7f5ca40c68c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:06.767 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:06.765+0000 7f5cab01e640 1 --2- 172.21.15.73:0/476097545 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5ca40c84d0 0x7f5ca406c340 unknown :-1 s=CLOSED pgs=1019 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:06.767 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:06.765+0000 7f5cab01e640 1 --2- 172.21.15.73:0/476097545 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5ca4152000 0x7f5ca41551e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:06.767 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:06.765+0000 7f5cab01e640 1 -- 172.21.15.73:0/476097545 >> 172.21.15.73:0/476097545 conn(0x7f5ca40ab9e0 msgr2=0x7f5ca40abdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:47:06.767 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:06.765+0000 7f5cab01e640 1 -- 172.21.15.73:0/476097545 shutdown_connections 2023-12-12T09:47:06.767 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:06.765+0000 7f5cab01e640 1 -- 172.21.15.73:0/476097545 wait complete. 2023-12-12T09:47:06.767 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:06.767+0000 7f5cab01e640 1 Processor -- start 2023-12-12T09:47:06.767 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:06.767+0000 7f5cab01e640 1 -- start start 2023-12-12T09:47:06.769 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:06.768+0000 7f5cab01e640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5ca406c880 0x7f5ca414ec60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:06.769 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:06.768+0000 7f5cab01e640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5ca40c84d0 0x7f5ca4140fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:06.769 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:06.768+0000 7f5cab01e640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5ca414b350 0x7f5ca41414e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:06.769 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:06.768+0000 7f5cab01e640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ca4158aa0 con 0x7f5ca40c84d0 2023-12-12T09:47:06.769 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:06.768+0000 7f5cab01e640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ca40c3110 con 0x7f5ca406c880 2023-12-12T09:47:06.769 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:06.768+0000 7f5cab01e640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ca41ee3c0 con 0x7f5ca414b350 2023-12-12T09:47:06.769 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:06.768+0000 7f5c9bfff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5ca40c84d0 0x7f5ca4140fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:06.769 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:06.768+0000 7f5c9bfff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5ca40c84d0 0x7f5ca4140fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:56164/0 (socket says 172.21.15.73:56164) 2023-12-12T09:47:06.769 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:06.768+0000 7f5c9bfff640 1 -- 172.21.15.73:0/3493009751 learned_addr learned my addr 172.21.15.73:0/3493009751 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:47:06.769 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:06.768+0000 7f5c9bfff640 1 -- 172.21.15.73:0/3493009751 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5ca414b350 msgr2=0x7f5ca41414e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:06.769 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:06.768+0000 7f5c9bfff640 1 --2- 172.21.15.73:0/3493009751 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5ca414b350 0x7f5ca41414e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:06.770 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:06.768+0000 7f5c9bfff640 1 -- 172.21.15.73:0/3493009751 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5ca406c880 msgr2=0x7f5ca414ec60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:06.770 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:06.768+0000 7f5c9bfff640 1 --2- 172.21.15.73:0/3493009751 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5ca406c880 0x7f5ca414ec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:06.770 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:06.768+0000 7f5c9bfff640 1 -- 172.21.15.73:0/3493009751 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c940094d0 con 0x7f5ca40c84d0 2023-12-12T09:47:06.770 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:06.769+0000 7f5c9bfff640 1 --2- 172.21.15.73:0/3493009751 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5ca40c84d0 0x7f5ca4140fa0 secure :-1 s=READY pgs=1020 cs=0 l=1 rev1=1 crypto rx=0x7f5c9402b8c0 tx=0x7f5c940046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:47:06.771 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:06.769+0000 7f5c997fa640 1 -- 172.21.15.73:0/3493009751 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c94032880 con 0x7f5ca40c84d0 2023-12-12T09:47:06.771 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:06.769+0000 7f5c997fa640 1 -- 172.21.15.73:0/3493009751 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c940329e0 con 0x7f5ca40c84d0 2023-12-12T09:47:06.771 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:06.769+0000 7f5cab01e640 1 -- 172.21.15.73:0/3493009751 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ca40c33b0 con 0x7f5ca40c84d0 2023-12-12T09:47:06.771 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:06.769+0000 7f5c997fa640 1 -- 172.21.15.73:0/3493009751 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c94032d90 con 0x7f5ca40c84d0 2023-12-12T09:47:06.771 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:06.769+0000 7f5cab01e640 1 -- 172.21.15.73:0/3493009751 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ca41ee6a0 con 0x7f5ca40c84d0 2023-12-12T09:47:06.771 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:06.770+0000 7f5cab01e640 1 -- 172.21.15.73:0/3493009751 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ca4067580 con 0x7f5ca40c84d0 2023-12-12T09:47:06.771 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:06.771+0000 7f5c997fa640 1 -- 172.21.15.73:0/3493009751 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f5c9404e450 con 0x7f5ca40c84d0 2023-12-12T09:47:06.773 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:06.772+0000 7f5c997fa640 1 --2- 172.21.15.73:0/3493009751 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f5c9006ae70 0x7f5c9006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:06.773 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:06.772+0000 7f5c997fa640 1 -- 172.21.15.73:0/3493009751 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f5c940abae0 con 0x7f5ca40c84d0 2023-12-12T09:47:06.773 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:06.772+0000 7f5ca8dba640 1 --2- 172.21.15.73:0/3493009751 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f5c9006ae70 0x7f5c9006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:06.773 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:06.773+0000 7f5ca8dba640 1 --2- 172.21.15.73:0/3493009751 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f5c9006ae70 0x7f5c9006d330 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f5ca00070b0 tx=0x7f5ca0007040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:47:06.777 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:06.777+0000 7f5c997fa640 1 -- 172.21.15.73:0/3493009751 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f5c94076840 con 0x7f5ca40c84d0 2023-12-12T09:47:06.970 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:06.967+0000 7f5cab01e640 1 -- 172.21.15.73:0/3493009751 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f5ca40c75c0 con 0x7f5ca40c84d0 2023-12-12T09:47:06.970 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:06.968+0000 7f5c997fa640 1 -- 172.21.15.73:0/3493009751 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v79) v1 ==== 104+0+11 (secure 0 0 0) 0x7f5c94079e60 con 0x7f5ca40c84d0 2023-12-12T09:47:06.971 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 32 2023-12-12T09:47:06.972 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:06.970+0000 7f5cab01e640 1 -- 172.21.15.73:0/3493009751 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f5c9006ae70 msgr2=0x7f5c9006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:06.972 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:06.970+0000 7f5cab01e640 1 --2- 172.21.15.73:0/3493009751 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f5c9006ae70 0x7f5c9006d330 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f5ca00070b0 tx=0x7f5ca0007040 comp rx=0 tx=0).stop 2023-12-12T09:47:06.972 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:06.970+0000 7f5cab01e640 1 -- 172.21.15.73:0/3493009751 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5ca40c84d0 msgr2=0x7f5ca4140fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:06.972 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:06.970+0000 7f5cab01e640 1 --2- 172.21.15.73:0/3493009751 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5ca40c84d0 0x7f5ca4140fa0 secure :-1 s=READY pgs=1020 cs=0 l=1 rev1=1 crypto rx=0x7f5c9402b8c0 tx=0x7f5c940046c0 comp rx=0 tx=0).stop 2023-12-12T09:47:06.972 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:06.970+0000 7f5cab01e640 1 -- 172.21.15.73:0/3493009751 shutdown_connections 2023-12-12T09:47:06.972 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:06.970+0000 7f5cab01e640 1 --2- 172.21.15.73:0/3493009751 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f5c9006ae70 0x7f5c9006d330 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:06.972 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:06.970+0000 7f5cab01e640 1 --2- 172.21.15.73:0/3493009751 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5ca414b350 0x7f5ca41414e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:06.973 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:06.970+0000 7f5cab01e640 1 --2- 172.21.15.73:0/3493009751 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5ca40c84d0 0x7f5ca4140fa0 unknown :-1 s=CLOSED pgs=1020 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:06.973 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:06.970+0000 7f5cab01e640 1 --2- 172.21.15.73:0/3493009751 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5ca406c880 0x7f5ca414ec60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:06.973 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:06.970+0000 7f5cab01e640 1 -- 172.21.15.73:0/3493009751 >> 172.21.15.73:0/3493009751 conn(0x7f5ca40ab9e0 msgr2=0x7f5ca40abdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:47:06.973 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:06.970+0000 7f5cab01e640 1 -- 172.21.15.73:0/3493009751 shutdown_connections 2023-12-12T09:47:06.973 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:06.970+0000 7f5cab01e640 1 -- 172.21.15.73:0/3493009751 wait complete. 2023-12-12T09:47:06.990 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-12T09:47:07.204 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:07.203+0000 7fc7cf901640 1 Processor -- start 2023-12-12T09:47:07.204 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:07.203+0000 7fc7cf901640 1 -- start start 2023-12-12T09:47:07.205 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:07.205+0000 7fc7cf901640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc7c80c4d50 0x7fc7c8157c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:07.205 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:07.205+0000 7fc7cf901640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fc7c80c2320 0x7fc7c80c27b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:07.205 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:07.205+0000 7fc7cf901640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7c81557b0 con 0x7fc7c81553d0 2023-12-12T09:47:07.205 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:07.205+0000 7fc7cf901640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7c8158b30 con 0x7fc7c80c2320 2023-12-12T09:47:07.205 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:07.205+0000 7fc7cf901640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7c80c60d0 con 0x7fc7c80c4d50 2023-12-12T09:47:07.206 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:07.205+0000 7fc7cd69d640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7fc7c81553d0 0x7fc7c806a4e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:54342/0 (socket says 172.21.15.73:54342) 2023-12-12T09:47:07.206 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:07.205+0000 7fc7cd69d640 1 -- 172.21.15.73:0/736902142 learned_addr learned my addr 172.21.15.73:0/736902142 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-12T09:47:07.206 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:07.205+0000 7fc7cde9e640 1 --2- 172.21.15.73:0/736902142 >> v2:172.21.15.73:3300/0 conn(0x7fc7c80c2320 0x7fc7c80c27b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:07.206 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:07.205+0000 7fc7cce9c640 1 --2- 172.21.15.73:0/736902142 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc7c80c4d50 0x7fc7c8157c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:07.207 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:07.206+0000 7fc7bffff640 1 -- 172.21.15.73:0/736902142 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4008735808 0 0) 0x7fc7c81557b0 con 0x7fc7c81553d0 2023-12-12T09:47:07.207 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:07.206+0000 7fc7cde9e640 1 -- 172.21.15.73:0/736902142 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc7c80c4d50 msgr2=0x7fc7c8157c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:47:07.207 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:07.206+0000 7fc7cde9e640 1 --2- 172.21.15.73:0/736902142 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc7c80c4d50 0x7fc7c8157c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:07.207 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:07.206+0000 7fc7cde9e640 1 -- 172.21.15.73:0/736902142 >> v1:172.21.15.73:6789/0 conn(0x7fc7c81553d0 legacy=0x7fc7c806a4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:07.207 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:07.206+0000 7fc7cde9e640 1 -- 172.21.15.73:0/736902142 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7c80c1e90 con 0x7fc7c80c2320 2023-12-12T09:47:07.207 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:07.206+0000 7fc7cce9c640 1 --2- 172.21.15.73:0/736902142 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc7c80c4d50 0x7fc7c8157c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-12T09:47:07.207 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:07.207+0000 7fc7cde9e640 1 --2- 172.21.15.73:0/736902142 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc7c80c2320 0x7fc7c80c27b0 secure :-1 s=READY pgs=1022 cs=0 l=1 rev1=1 crypto rx=0x7fc7c0009dc0 tx=0x7fc7c002be90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a12e61cad375968e server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:47:07.208 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:07.207+0000 7fc7bffff640 1 -- 172.21.15.73:0/736902142 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7c002cc40 con 0x7fc7c80c2320 2023-12-12T09:47:07.208 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:07.208+0000 7fc7bffff640 1 -- 172.21.15.73:0/736902142 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7c002cda0 con 0x7fc7c80c2320 2023-12-12T09:47:07.208 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:07.208+0000 7fc7bffff640 1 -- 172.21.15.73:0/736902142 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7c0034660 con 0x7fc7c80c2320 2023-12-12T09:47:07.209 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:07.208+0000 7fc7cf901640 1 -- 172.21.15.73:0/736902142 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc7c80c2320 msgr2=0x7fc7c80c27b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:07.209 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:07.208+0000 7fc7cf901640 1 --2- 172.21.15.73:0/736902142 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc7c80c2320 0x7fc7c80c27b0 secure :-1 s=READY pgs=1022 cs=0 l=1 rev1=1 crypto rx=0x7fc7c0009dc0 tx=0x7fc7c002be90 comp rx=0 tx=0).stop 2023-12-12T09:47:07.209 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:07.208+0000 7fc7cf901640 1 -- 172.21.15.73:0/736902142 shutdown_connections 2023-12-12T09:47:07.209 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:07.208+0000 7fc7cf901640 1 --2- 172.21.15.73:0/736902142 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc7c80c4d50 0x7fc7c8157c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:07.209 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:07.208+0000 7fc7cf901640 1 --2- 172.21.15.73:0/736902142 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc7c80c2320 0x7fc7c80c27b0 unknown :-1 s=CLOSED pgs=1022 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:07.210 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:07.208+0000 7fc7cf901640 1 -- 172.21.15.73:0/736902142 >> 172.21.15.73:0/736902142 conn(0x7fc7c80c6ab0 msgr2=0x7fc7c80c6e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:47:07.210 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:07.208+0000 7fc7cf901640 1 -- 172.21.15.73:0/736902142 shutdown_connections 2023-12-12T09:47:07.210 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:07.208+0000 7fc7cf901640 1 -- 172.21.15.73:0/736902142 wait complete. 2023-12-12T09:47:07.211 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:07.211+0000 7fc7cf901640 1 Processor -- start 2023-12-12T09:47:07.211 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:07.211+0000 7fc7cf901640 1 -- start start 2023-12-12T09:47:07.213 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:07.212+0000 7fc7cf901640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc7c80c2320 0x7fc7c80a9b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:07.213 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:07.212+0000 7fc7cf901640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc7c80c4d50 0x7fc7c81e6ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:07.213 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:07.212+0000 7fc7cf901640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc7c81553d0 0x7fc7c81e7410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:07.214 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:07.212+0000 7fc7cf901640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7c81e9b30 con 0x7fc7c80c4d50 2023-12-12T09:47:07.214 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:07.212+0000 7fc7cf901640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7c81eab00 con 0x7fc7c81553d0 2023-12-12T09:47:07.214 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:07.212+0000 7fc7cf901640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7c81ea670 con 0x7fc7c80c2320 2023-12-12T09:47:07.215 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:07.212+0000 7fc7cce9c640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc7c80c4d50 0x7fc7c81e6ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:07.215 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:07.212+0000 7fc7cce9c640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc7c80c4d50 0x7fc7c81e6ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:56176/0 (socket says 172.21.15.73:56176) 2023-12-12T09:47:07.215 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:07.212+0000 7fc7cce9c640 1 -- 172.21.15.73:0/2358023586 learned_addr learned my addr 172.21.15.73:0/2358023586 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:47:07.215 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:07.213+0000 7fc7cce9c640 1 -- 172.21.15.73:0/2358023586 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc7c80c2320 msgr2=0x7fc7c80a9b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:07.216 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:07.213+0000 7fc7cce9c640 1 --2- 172.21.15.73:0/2358023586 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc7c80c2320 0x7fc7c80a9b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:07.216 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:07.213+0000 7fc7cce9c640 1 -- 172.21.15.73:0/2358023586 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc7c81553d0 msgr2=0x7fc7c81e7410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:07.216 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:07.213+0000 7fc7cde9e640 1 --2- 172.21.15.73:0/2358023586 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc7c81553d0 0x7fc7c81e7410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:07.216 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:07.213+0000 7fc7cce9c640 1 --2- 172.21.15.73:0/2358023586 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc7c81553d0 0x7fc7c81e7410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:07.216 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:07.213+0000 7fc7cce9c640 1 -- 172.21.15.73:0/2358023586 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7c0009a70 con 0x7fc7c80c4d50 2023-12-12T09:47:07.216 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:07.213+0000 7fc7cce9c640 1 --2- 172.21.15.73:0/2358023586 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc7c80c4d50 0x7fc7c81e6ed0 secure :-1 s=READY pgs=1023 cs=0 l=1 rev1=1 crypto rx=0x7fc7b800e790 tx=0x7fc7b800ec50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:47:07.217 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:07.213+0000 7fc7bdffb640 1 -- 172.21.15.73:0/2358023586 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7b8004230 con 0x7fc7c80c4d50 2023-12-12T09:47:07.217 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:07.213+0000 7fc7bdffb640 1 -- 172.21.15.73:0/2358023586 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7b8004390 con 0x7fc7c80c4d50 2023-12-12T09:47:07.217 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:07.213+0000 7fc7bdffb640 1 -- 172.21.15.73:0/2358023586 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7b800c8f0 con 0x7fc7c80c4d50 2023-12-12T09:47:07.217 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:07.213+0000 7fc7cf901640 1 -- 172.21.15.73:0/2358023586 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7c806e1d0 con 0x7fc7c80c4d50 2023-12-12T09:47:07.217 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:07.213+0000 7fc7cf901640 1 -- 172.21.15.73:0/2358023586 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7c81ea020 con 0x7fc7c80c4d50 2023-12-12T09:47:07.217 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:07.215+0000 7fc7cf901640 1 -- 172.21.15.73:0/2358023586 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc7c8072a90 con 0x7fc7c80c4d50 2023-12-12T09:47:07.217 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:07.215+0000 7fc7bdffb640 1 -- 172.21.15.73:0/2358023586 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fc7b800ca50 con 0x7fc7c80c4d50 2023-12-12T09:47:07.218 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:07.216+0000 7fc7bdffb640 1 --2- 172.21.15.73:0/2358023586 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fc7ac06ae40 0x7fc7ac06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:07.218 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:07.217+0000 7fc7bdffb640 1 -- 172.21.15.73:0/2358023586 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fc7b8089550 con 0x7fc7c80c4d50 2023-12-12T09:47:07.218 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:07.217+0000 7fc7cd69d640 1 --2- 172.21.15.73:0/2358023586 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fc7ac06ae40 0x7fc7ac06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:07.218 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:07.217+0000 7fc7cd69d640 1 --2- 172.21.15.73:0/2358023586 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fc7ac06ae40 0x7fc7ac06d300 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7fc7c4007fd0 tx=0x7fc7c4007960 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:47:07.224 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:07.223+0000 7fc7bdffb640 1 -- 172.21.15.73:0/2358023586 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fc7b8054330 con 0x7fc7c80c4d50 2023-12-12T09:47:07.416 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:07.416+0000 7fc7cf901640 1 -- 172.21.15.73:0/2358023586 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fc7c8067580 con 0x7fc7c80c4d50 2023-12-12T09:47:07.417 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:07.417+0000 7fc7bdffb640 1 -- 172.21.15.73:0/2358023586 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v79) v1 ==== 100+0+11 (secure 0 0 0) 0x7fc7b8057950 con 0x7fc7c80c4d50 2023-12-12T09:47:07.417 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 64 2023-12-12T09:47:07.420 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:07.419+0000 7fc7cf901640 1 -- 172.21.15.73:0/2358023586 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fc7ac06ae40 msgr2=0x7fc7ac06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:07.421 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:07.419+0000 7fc7cf901640 1 --2- 172.21.15.73:0/2358023586 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fc7ac06ae40 0x7fc7ac06d300 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7fc7c4007fd0 tx=0x7fc7c4007960 comp rx=0 tx=0).stop 2023-12-12T09:47:07.421 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:07.419+0000 7fc7cf901640 1 -- 172.21.15.73:0/2358023586 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc7c80c4d50 msgr2=0x7fc7c81e6ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:07.421 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:07.419+0000 7fc7cf901640 1 --2- 172.21.15.73:0/2358023586 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc7c80c4d50 0x7fc7c81e6ed0 secure :-1 s=READY pgs=1023 cs=0 l=1 rev1=1 crypto rx=0x7fc7b800e790 tx=0x7fc7b800ec50 comp rx=0 tx=0).stop 2023-12-12T09:47:07.421 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:07.420+0000 7fc7cf901640 1 -- 172.21.15.73:0/2358023586 shutdown_connections 2023-12-12T09:47:07.421 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:07.420+0000 7fc7cf901640 1 --2- 172.21.15.73:0/2358023586 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fc7ac06ae40 0x7fc7ac06d300 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:07.421 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:07.420+0000 7fc7cf901640 1 --2- 172.21.15.73:0/2358023586 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc7c81553d0 0x7fc7c81e7410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:07.421 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:07.420+0000 7fc7cf901640 1 --2- 172.21.15.73:0/2358023586 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc7c80c4d50 0x7fc7c81e6ed0 unknown :-1 s=CLOSED pgs=1023 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:07.421 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:07.420+0000 7fc7cf901640 1 --2- 172.21.15.73:0/2358023586 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc7c80c2320 0x7fc7c80a9b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:07.421 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:07.420+0000 7fc7cf901640 1 -- 172.21.15.73:0/2358023586 >> 172.21.15.73:0/2358023586 conn(0x7fc7c80c6ab0 msgr2=0x7fc7c8151770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:47:07.421 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:07.420+0000 7fc7cf901640 1 -- 172.21.15.73:0/2358023586 shutdown_connections 2023-12-12T09:47:07.421 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:07.420+0000 7fc7cf901640 1 -- 172.21.15.73:0/2358023586 wait complete. 2023-12-12T09:47:07.437 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_metadata pg_num 2023-12-12T09:47:07.644 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:07.643+0000 7f155750f640 1 Processor -- start 2023-12-12T09:47:07.644 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:07.644+0000 7f155750f640 1 -- start start 2023-12-12T09:47:07.646 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:07.645+0000 7f155750f640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1550152000 0x7f15501551e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:07.646 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:07.645+0000 7f155750f640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f15500c84d0 0x7f155006c340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:07.646 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:07.645+0000 7f155750f640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1550155720 con 0x7f155006c880 2023-12-12T09:47:07.646 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:07.645+0000 7f155750f640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f155006bb80 con 0x7f15500c84d0 2023-12-12T09:47:07.646 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:07.645+0000 7f155750f640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15500c4830 con 0x7f1550152000 2023-12-12T09:47:07.646 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:07.645+0000 7f1555aac640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f155006c880 0x7f15500c68c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:54348/0 (socket says 172.21.15.73:54348) 2023-12-12T09:47:07.646 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:07.645+0000 7f1555aac640 1 -- 172.21.15.73:0/3159356632 learned_addr learned my addr 172.21.15.73:0/3159356632 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-12T09:47:07.648 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:07.646+0000 7f15552ab640 1 --2- 172.21.15.73:0/3159356632 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1550152000 0x7f15501551e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:07.648 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:07.646+0000 7f154ffff640 1 -- 172.21.15.73:0/3159356632 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1720936105 0 0) 0x7f1550155720 con 0x7f155006c880 2023-12-12T09:47:07.648 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:07.646+0000 7f1554aaa640 1 --2- 172.21.15.73:0/3159356632 >> v2:172.21.15.142:3300/0 conn(0x7f15500c84d0 0x7f155006c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:07.648 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:07.646+0000 7f154ffff640 1 -- 172.21.15.73:0/3159356632 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1538003520 con 0x7f155006c880 2023-12-12T09:47:07.648 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:07.646+0000 7f154ffff640 1 -- 172.21.15.73:0/3159356632 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 590549995 0 0) 0x7f1538003520 con 0x7f155006c880 2023-12-12T09:47:07.648 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:07.646+0000 7f154ffff640 1 -- 172.21.15.73:0/3159356632 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1550152000 msgr2=0x7f15501551e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:47:07.648 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:07.646+0000 7f154ffff640 1 --2- 172.21.15.73:0/3159356632 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1550152000 0x7f15501551e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:07.648 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:07.646+0000 7f154ffff640 1 -- 172.21.15.73:0/3159356632 >> v2:172.21.15.142:3300/0 conn(0x7f15500c84d0 msgr2=0x7f155006c340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:47:07.648 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:07.646+0000 7f154ffff640 1 --2- 172.21.15.73:0/3159356632 >> v2:172.21.15.142:3300/0 conn(0x7f15500c84d0 0x7f155006c340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:07.648 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:07.646+0000 7f154ffff640 1 -- 172.21.15.73:0/3159356632 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15500c4b10 con 0x7f155006c880 2023-12-12T09:47:07.648 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:07.646+0000 7f154ffff640 1 -- 172.21.15.73:0/3159356632 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3186547832 0 0) 0x7f1548001670 con 0x7f155006c880 2023-12-12T09:47:07.648 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:07.646+0000 7f154ffff640 1 -- 172.21.15.73:0/3159356632 >> v1:172.21.15.73:6789/0 conn(0x7f155006c880 legacy=0x7f15500c68c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:07.649 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:07.646+0000 7f154ffff640 1 --2- 172.21.15.73:0/3159356632 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1538003970 0x7f1538003d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:07.649 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:07.646+0000 7f154ffff640 1 --2- 172.21.15.73:0/3159356632 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1538004380 0x7f1538004860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:07.649 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:07.646+0000 7f154ffff640 1 --2- 172.21.15.73:0/3159356632 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1538004f80 0x7f153800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:07.649 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:07.646+0000 7f154ffff640 1 -- 172.21.15.73:0/3159356632 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f155006bb80 con 0x7f1538004f80 2023-12-12T09:47:07.649 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:07.646+0000 7f154ffff640 1 -- 172.21.15.73:0/3159356632 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15500c4830 con 0x7f1538004380 2023-12-12T09:47:07.649 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:07.646+0000 7f154ffff640 1 -- 172.21.15.73:0/3159356632 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f153800bf10 con 0x7f1538003970 2023-12-12T09:47:07.650 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:07.647+0000 7f1555aac640 1 --2- 172.21.15.73:0/3159356632 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1538004f80 0x7f153800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:07.650 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:07.647+0000 7f15552ab640 1 --2- 172.21.15.73:0/3159356632 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1538003970 0x7f1538003d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:07.650 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:07.647+0000 7f1555aac640 1 -- 172.21.15.73:0/3159356632 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1538003970 msgr2=0x7f1538003d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:47:07.650 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:07.647+0000 7f1555aac640 1 --2- 172.21.15.73:0/3159356632 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1538003970 0x7f1538003d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:07.650 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:07.647+0000 7f1555aac640 1 -- 172.21.15.73:0/3159356632 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1538004380 msgr2=0x7f1538004860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:47:07.650 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:07.647+0000 7f1555aac640 1 --2- 172.21.15.73:0/3159356632 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1538004380 0x7f1538004860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:07.650 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:07.647+0000 7f1555aac640 1 -- 172.21.15.73:0/3159356632 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1538003520 con 0x7f1538004f80 2023-12-12T09:47:07.651 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:07.648+0000 7f1555aac640 1 --2- 172.21.15.73:0/3159356632 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1538004f80 0x7f153800b980 secure :-1 s=READY pgs=1025 cs=0 l=1 rev1=1 crypto rx=0x7f154800c240 tx=0x7f15380057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6b0ea0436e66954 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:47:07.652 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:07.648+0000 7f154ffff640 1 -- 172.21.15.73:0/3159356632 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f154802cb00 con 0x7f1538004f80 2023-12-12T09:47:07.652 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:07.648+0000 7f154ffff640 1 -- 172.21.15.73:0/3159356632 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f154802cc60 con 0x7f1538004f80 2023-12-12T09:47:07.652 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:07.648+0000 7f154ffff640 1 -- 172.21.15.73:0/3159356632 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1548005af0 con 0x7f1538004f80 2023-12-12T09:47:07.652 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:07.649+0000 7f155750f640 1 -- 172.21.15.73:0/3159356632 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1538004f80 msgr2=0x7f153800b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:07.652 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:07.649+0000 7f155750f640 1 --2- 172.21.15.73:0/3159356632 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1538004f80 0x7f153800b980 secure :-1 s=READY pgs=1025 cs=0 l=1 rev1=1 crypto rx=0x7f154800c240 tx=0x7f15380057f0 comp rx=0 tx=0).stop 2023-12-12T09:47:07.652 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:07.649+0000 7f1555aac640 1 -- 172.21.15.73:0/3159356632 reap_dead start 2023-12-12T09:47:07.652 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:07.649+0000 7f155750f640 1 -- 172.21.15.73:0/3159356632 shutdown_connections 2023-12-12T09:47:07.652 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:07.649+0000 7f155750f640 1 -- 172.21.15.73:0/3159356632 >> 172.21.15.73:0/3159356632 conn(0x7f15500ab9e0 msgr2=0x7f15500abdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:47:07.652 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:07.649+0000 7f155750f640 1 -- 172.21.15.73:0/3159356632 shutdown_connections 2023-12-12T09:47:07.652 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:07.649+0000 7f155750f640 1 -- 172.21.15.73:0/3159356632 wait complete. 2023-12-12T09:47:07.652 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:07.651+0000 7f155750f640 1 Processor -- start 2023-12-12T09:47:07.652 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:07.651+0000 7f155750f640 1 -- start start 2023-12-12T09:47:07.654 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:07.652+0000 7f155750f640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1538004f80 0x7f15500ad470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:07.654 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:07.652+0000 7f155750f640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f15500c2180 0x7f15501ecd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:07.654 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:07.652+0000 7f155750f640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f15501e97f0 0x7f15501e9c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:07.654 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:07.652+0000 7f155750f640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15500c2600 con 0x7f15501e97f0 2023-12-12T09:47:07.654 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:07.652+0000 7f155750f640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15501ea1b0 con 0x7f15500c2180 2023-12-12T09:47:07.655 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:07.652+0000 7f155750f640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15500c39b0 con 0x7f1538004f80 2023-12-12T09:47:07.655 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:07.652+0000 7f1555aac640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f15501e97f0 0x7f15501e9c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:07.655 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:07.652+0000 7f1555aac640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f15501e97f0 0x7f15501e9c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:56192/0 (socket says 172.21.15.73:56192) 2023-12-12T09:47:07.655 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:07.652+0000 7f1555aac640 1 -- 172.21.15.73:0/3783200187 learned_addr learned my addr 172.21.15.73:0/3783200187 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:47:07.655 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:07.653+0000 7f15552ab640 1 --2- 172.21.15.73:0/3783200187 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1538004f80 0x7f15500ad470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:07.655 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:07.653+0000 7f1555aac640 1 -- 172.21.15.73:0/3783200187 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1538004f80 msgr2=0x7f15500ad470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:07.655 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:07.653+0000 7f1555aac640 1 --2- 172.21.15.73:0/3783200187 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1538004f80 0x7f15500ad470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:07.656 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:07.653+0000 7f1555aac640 1 -- 172.21.15.73:0/3783200187 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f15500c2180 msgr2=0x7f15501ecd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:07.656 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:07.653+0000 7f1555aac640 1 --2- 172.21.15.73:0/3783200187 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f15500c2180 0x7f15501ecd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:07.656 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:07.653+0000 7f1555aac640 1 -- 172.21.15.73:0/3783200187 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15500c3f30 con 0x7f15501e97f0 2023-12-12T09:47:07.656 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:07.653+0000 7f15552ab640 1 --2- 172.21.15.73:0/3783200187 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1538004f80 0x7f15500ad470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:47:07.656 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:07.653+0000 7f1555aac640 1 --2- 172.21.15.73:0/3783200187 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f15501e97f0 0x7f15501e9c70 secure :-1 s=READY pgs=1026 cs=0 l=1 rev1=1 crypto rx=0x7f1548001930 tx=0x7f1548001a70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:47:07.656 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:07.653+0000 7f154dffb640 1 -- 172.21.15.73:0/3783200187 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f154803c040 con 0x7f15501e97f0 2023-12-12T09:47:07.656 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:07.653+0000 7f154dffb640 1 -- 172.21.15.73:0/3783200187 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1548001630 con 0x7f15501e97f0 2023-12-12T09:47:07.656 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:07.653+0000 7f154dffb640 1 -- 172.21.15.73:0/3783200187 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1548007270 con 0x7f15501e97f0 2023-12-12T09:47:07.656 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:07.653+0000 7f155750f640 1 -- 172.21.15.73:0/3783200187 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15501ea410 con 0x7f15501e97f0 2023-12-12T09:47:07.656 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:07.654+0000 7f155750f640 1 -- 172.21.15.73:0/3783200187 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15501ea6f0 con 0x7f15501e97f0 2023-12-12T09:47:07.657 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:07.655+0000 7f155750f640 1 -- 172.21.15.73:0/3783200187 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1550067580 con 0x7f15501e97f0 2023-12-12T09:47:07.657 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:07.655+0000 7f154dffb640 1 -- 172.21.15.73:0/3783200187 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f1548032070 con 0x7f15501e97f0 2023-12-12T09:47:07.657 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:07.656+0000 7f154dffb640 1 --2- 172.21.15.73:0/3783200187 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f153c06ae40 0x7f153c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:07.657 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:07.656+0000 7f154dffb640 1 -- 172.21.15.73:0/3783200187 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f15480aa4d0 con 0x7f15501e97f0 2023-12-12T09:47:07.657 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:07.657+0000 7f15552ab640 1 --2- 172.21.15.73:0/3783200187 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f153c06ae40 0x7f153c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:07.658 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:07.657+0000 7f15552ab640 1 --2- 172.21.15.73:0/3783200187 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f153c06ae40 0x7f153c06d300 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f1540009f10 tx=0x7f154000b040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:47:07.662 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:07.661+0000 7f154dffb640 1 -- 172.21.15.73:0/3783200187 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f1548075290 con 0x7f15501e97f0 2023-12-12T09:47:07.855 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:07.855+0000 7f155750f640 1 -- 172.21.15.73:0/3783200187 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"} v 0) v1 -- 0x7f15500c75c0 con 0x7f15501e97f0 2023-12-12T09:47:07.856 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:07.856+0000 7f154dffb640 1 -- 172.21.15.73:0/3783200187 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"}]=0 v79) v1 ==== 105+0+11 (secure 0 0 0) 0x7f15480788b0 con 0x7f15501e97f0 2023-12-12T09:47:07.857 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 32 2023-12-12T09:47:07.860 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:07.859+0000 7f155750f640 1 -- 172.21.15.73:0/3783200187 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f153c06ae40 msgr2=0x7f153c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:07.860 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:07.859+0000 7f155750f640 1 --2- 172.21.15.73:0/3783200187 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f153c06ae40 0x7f153c06d300 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f1540009f10 tx=0x7f154000b040 comp rx=0 tx=0).stop 2023-12-12T09:47:07.860 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:07.859+0000 7f155750f640 1 -- 172.21.15.73:0/3783200187 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f15501e97f0 msgr2=0x7f15501e9c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:07.860 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:07.859+0000 7f155750f640 1 --2- 172.21.15.73:0/3783200187 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f15501e97f0 0x7f15501e9c70 secure :-1 s=READY pgs=1026 cs=0 l=1 rev1=1 crypto rx=0x7f1548001930 tx=0x7f1548001a70 comp rx=0 tx=0).stop 2023-12-12T09:47:07.860 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:07.859+0000 7f155750f640 1 -- 172.21.15.73:0/3783200187 shutdown_connections 2023-12-12T09:47:07.860 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:07.859+0000 7f155750f640 1 --2- 172.21.15.73:0/3783200187 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f153c06ae40 0x7f153c06d300 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:07.860 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:07.859+0000 7f155750f640 1 --2- 172.21.15.73:0/3783200187 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f15501e97f0 0x7f15501e9c70 unknown :-1 s=CLOSED pgs=1026 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:07.860 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:07.859+0000 7f155750f640 1 --2- 172.21.15.73:0/3783200187 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f15500c2180 0x7f15501ecd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:07.860 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:07.859+0000 7f155750f640 1 --2- 172.21.15.73:0/3783200187 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1538004f80 0x7f15500ad470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:07.860 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:07.859+0000 7f155750f640 1 -- 172.21.15.73:0/3783200187 >> 172.21.15.73:0/3783200187 conn(0x7f15500ab9e0 msgr2=0x7f15501503c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:47:07.860 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:07.859+0000 7f155750f640 1 -- 172.21.15.73:0/3783200187 shutdown_connections 2023-12-12T09:47:07.861 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:07.859+0000 7f155750f640 1 -- 172.21.15.73:0/3783200187 wait complete. 2023-12-12T09:47:07.879 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_data pg_num 2023-12-12T09:47:08.095 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:08.094+0000 7f47f8bb6640 1 Processor -- start 2023-12-12T09:47:08.095 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:08.095+0000 7f47f8bb6640 1 -- start start 2023-12-12T09:47:08.103 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:08.096+0000 7f47f8bb6640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f47f4151d50 0x7f47f4155050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:08.103 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:08.096+0000 7f47f8bb6640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f47f406a4e0 0x7f47f406a940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:08.103 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:08.096+0000 7f47f8bb6640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47f40c12b0 con 0x7f47f406ae80 2023-12-12T09:47:08.103 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:08.096+0000 7f47f8bb6640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47f40c1e30 con 0x7f47f406a4e0 2023-12-12T09:47:08.103 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:08.096+0000 7f47f8bb6640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47f40c22c0 con 0x7f47f4151d50 2023-12-12T09:47:08.104 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:08.097+0000 7f47f2d9d640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f47f406ae80 0x7f47f40bf7b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:54356/0 (socket says 172.21.15.73:54356) 2023-12-12T09:47:08.104 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:08.097+0000 7f47f2d9d640 1 -- 172.21.15.73:0/1567255710 learned_addr learned my addr 172.21.15.73:0/1567255710 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-12T09:47:08.104 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:08.097+0000 7f47f259c640 1 --2- 172.21.15.73:0/1567255710 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f47f4151d50 0x7f47f4155050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:08.104 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:08.097+0000 7f47f1d9b640 1 --2- 172.21.15.73:0/1567255710 >> v2:172.21.15.142:3300/0 conn(0x7f47f406a4e0 0x7f47f406a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:08.104 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:08.097+0000 7f47f159a640 1 -- 172.21.15.73:0/1567255710 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2160587653 0 0) 0x7f47f40c12b0 con 0x7f47f406ae80 2023-12-12T09:47:08.104 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:08.097+0000 7f47f159a640 1 -- 172.21.15.73:0/1567255710 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f47e0003520 con 0x7f47f406ae80 2023-12-12T09:47:08.105 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:08.097+0000 7f47f159a640 1 -- 172.21.15.73:0/1567255710 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 877058909 0 0) 0x7f47e0003520 con 0x7f47f406ae80 2023-12-12T09:47:08.105 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:08.097+0000 7f47f159a640 1 -- 172.21.15.73:0/1567255710 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f47f4151d50 msgr2=0x7f47f4155050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:47:08.105 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:08.097+0000 7f47f159a640 1 --2- 172.21.15.73:0/1567255710 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f47f4151d50 0x7f47f4155050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:08.105 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:08.097+0000 7f47f159a640 1 -- 172.21.15.73:0/1567255710 >> v2:172.21.15.142:3300/0 conn(0x7f47f406a4e0 msgr2=0x7f47f406a940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:47:08.105 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:08.097+0000 7f47f159a640 1 --2- 172.21.15.73:0/1567255710 >> v2:172.21.15.142:3300/0 conn(0x7f47f406a4e0 0x7f47f406a940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:08.106 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:08.097+0000 7f47f159a640 1 -- 172.21.15.73:0/1567255710 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47f40c1500 con 0x7f47f406ae80 2023-12-12T09:47:08.106 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:08.097+0000 7f47f159a640 1 -- 172.21.15.73:0/1567255710 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3186547832 0 0) 0x7f47ec001670 con 0x7f47f406ae80 2023-12-12T09:47:08.106 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:08.098+0000 7f47f159a640 1 -- 172.21.15.73:0/1567255710 >> v1:172.21.15.73:6789/0 conn(0x7f47f406ae80 legacy=0x7f47f40bf7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:08.106 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:08.098+0000 7f47f159a640 1 --2- 172.21.15.73:0/1567255710 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f47e0003970 0x7f47e0003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:08.106 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:08.098+0000 7f47f159a640 1 --2- 172.21.15.73:0/1567255710 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f47e00047c0 0x7f47e0004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:08.106 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:08.098+0000 7f47f159a640 1 --2- 172.21.15.73:0/1567255710 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f47f4151d50 0x7f47e0005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:08.107 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:08.098+0000 7f47f159a640 1 -- 172.21.15.73:0/1567255710 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47f40c1e30 con 0x7f47e0003970 2023-12-12T09:47:08.107 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:08.098+0000 7f47f159a640 1 -- 172.21.15.73:0/1567255710 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47f40c22c0 con 0x7f47e00047c0 2023-12-12T09:47:08.107 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:08.098+0000 7f47f159a640 1 -- 172.21.15.73:0/1567255710 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47e000ba00 con 0x7f47f4151d50 2023-12-12T09:47:08.107 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:08.098+0000 7f47f259c640 1 --2- 172.21.15.73:0/1567255710 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f47e0003970 0x7f47e0003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:08.107 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:08.098+0000 7f47f259c640 1 -- 172.21.15.73:0/1567255710 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f47f4151d50 msgr2=0x7f47e0005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:47:08.107 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:08.098+0000 7f47f259c640 1 --2- 172.21.15.73:0/1567255710 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f47f4151d50 0x7f47e0005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:08.107 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:08.098+0000 7f47f259c640 1 -- 172.21.15.73:0/1567255710 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f47e00047c0 msgr2=0x7f47e0004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:47:08.107 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:08.098+0000 7f47f259c640 1 --2- 172.21.15.73:0/1567255710 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f47e00047c0 0x7f47e0004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:08.107 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:08.098+0000 7f47f259c640 1 -- 172.21.15.73:0/1567255710 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47e0003520 con 0x7f47e0003970 2023-12-12T09:47:08.107 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:08.099+0000 7f47f259c640 1 --2- 172.21.15.73:0/1567255710 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f47e0003970 0x7f47e0003d90 secure :-1 s=READY pgs=1028 cs=0 l=1 rev1=1 crypto rx=0x7f47e4009fc0 tx=0x7f47e00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ddbcdb41bccd9b04 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:47:08.107 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:08.100+0000 7f47f159a640 1 -- 172.21.15.73:0/1567255710 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47e402cc60 con 0x7f47e0003970 2023-12-12T09:47:08.108 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:08.100+0000 7f47f159a640 1 -- 172.21.15.73:0/1567255710 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47e400f040 con 0x7f47e0003970 2023-12-12T09:47:08.108 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:08.100+0000 7f47f159a640 1 -- 172.21.15.73:0/1567255710 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47e4034440 con 0x7f47e0003970 2023-12-12T09:47:08.108 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:08.100+0000 7f47f8bb6640 1 -- 172.21.15.73:0/1567255710 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f47e0003970 msgr2=0x7f47e0003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:08.108 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:08.100+0000 7f47f8bb6640 1 --2- 172.21.15.73:0/1567255710 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f47e0003970 0x7f47e0003d90 secure :-1 s=READY pgs=1028 cs=0 l=1 rev1=1 crypto rx=0x7f47e4009fc0 tx=0x7f47e00057f0 comp rx=0 tx=0).stop 2023-12-12T09:47:08.108 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:08.100+0000 7f47f2d9d640 1 -- 172.21.15.73:0/1567255710 reap_dead start 2023-12-12T09:47:08.108 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:08.100+0000 7f47f8bb6640 1 -- 172.21.15.73:0/1567255710 shutdown_connections 2023-12-12T09:47:08.108 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:08.100+0000 7f47f8bb6640 1 -- 172.21.15.73:0/1567255710 >> 172.21.15.73:0/1567255710 conn(0x7f47f40c2e80 msgr2=0x7f47f40c3290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:47:08.108 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:08.100+0000 7f47f8bb6640 1 -- 172.21.15.73:0/1567255710 shutdown_connections 2023-12-12T09:47:08.108 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:08.100+0000 7f47f8bb6640 1 -- 172.21.15.73:0/1567255710 wait complete. 2023-12-12T09:47:08.108 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:08.102+0000 7f47f8bb6640 1 Processor -- start 2023-12-12T09:47:08.108 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:08.102+0000 7f47f8bb6640 1 -- start start 2023-12-12T09:47:08.111 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:08.103+0000 7f47f8bb6640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f47e0003970 0x7f47f41ead90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:08.111 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:08.103+0000 7f47f8bb6640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f47f41585f0 0x7f47f40ab8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:08.111 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:08.103+0000 7f47f8bb6640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f47f413f880 0x7f47f413fd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:08.111 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:08.103+0000 7f47f8bb6640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47f40a9220 con 0x7f47f413f880 2023-12-12T09:47:08.111 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:08.103+0000 7f47f8bb6640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47f40a9ca0 con 0x7f47e0003970 2023-12-12T09:47:08.111 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:08.103+0000 7f47f8bb6640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47f41559b0 con 0x7f47f41585f0 2023-12-12T09:47:08.111 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:08.103+0000 7f47f2d9d640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f47f413f880 0x7f47f413fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:08.111 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:08.103+0000 7f47f2d9d640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f47f413f880 0x7f47f413fd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:56210/0 (socket says 172.21.15.73:56210) 2023-12-12T09:47:08.111 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:08.103+0000 7f47f2d9d640 1 -- 172.21.15.73:0/821360382 learned_addr learned my addr 172.21.15.73:0/821360382 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:47:08.112 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:08.104+0000 7f47f259c640 1 --2- 172.21.15.73:0/821360382 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f47e0003970 0x7f47f41ead90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:08.112 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:08.104+0000 7f47f2d9d640 1 -- 172.21.15.73:0/821360382 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f47f41585f0 msgr2=0x7f47f40ab8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:08.112 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:08.104+0000 7f47f2d9d640 1 --2- 172.21.15.73:0/821360382 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f47f41585f0 0x7f47f40ab8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:08.112 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:08.104+0000 7f47f2d9d640 1 -- 172.21.15.73:0/821360382 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f47e0003970 msgr2=0x7f47f41ead90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:08.112 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:08.104+0000 7f47f2d9d640 1 --2- 172.21.15.73:0/821360382 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f47e0003970 0x7f47f41ead90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:08.112 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:08.104+0000 7f47f2d9d640 1 -- 172.21.15.73:0/821360382 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47f41eb2d0 con 0x7f47f413f880 2023-12-12T09:47:08.112 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:08.104+0000 7f47f259c640 1 --2- 172.21.15.73:0/821360382 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f47e0003970 0x7f47f41ead90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:47:08.112 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:08.104+0000 7f47f2d9d640 1 --2- 172.21.15.73:0/821360382 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f47f413f880 0x7f47f413fd00 secure :-1 s=READY pgs=1029 cs=0 l=1 rev1=1 crypto rx=0x7f47f40c2c20 tx=0x7f47ec00cb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:47:08.112 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:08.104+0000 7f47eaffd640 1 -- 172.21.15.73:0/821360382 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47ec0072d0 con 0x7f47f413f880 2023-12-12T09:47:08.112 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:08.104+0000 7f47eaffd640 1 -- 172.21.15.73:0/821360382 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47ec00ced0 con 0x7f47f413f880 2023-12-12T09:47:08.112 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:08.104+0000 7f47f8bb6640 1 -- 172.21.15.73:0/821360382 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47f40a9400 con 0x7f47f413f880 2023-12-12T09:47:08.112 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:08.104+0000 7f47eaffd640 1 -- 172.21.15.73:0/821360382 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47ec007650 con 0x7f47f413f880 2023-12-12T09:47:08.112 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:08.104+0000 7f47f8bb6640 1 -- 172.21.15.73:0/821360382 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47f40a99c0 con 0x7f47f413f880 2023-12-12T09:47:08.112 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:08.106+0000 7f47f8bb6640 1 -- 172.21.15.73:0/821360382 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47f4067580 con 0x7f47f413f880 2023-12-12T09:47:08.113 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:08.106+0000 7f47eaffd640 1 -- 172.21.15.73:0/821360382 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f47ec0047e0 con 0x7f47f413f880 2023-12-12T09:47:08.113 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:08.107+0000 7f47eaffd640 1 --2- 172.21.15.73:0/821360382 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f47d406ae40 0x7f47d406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:08.113 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:08.108+0000 7f47eaffd640 1 -- 172.21.15.73:0/821360382 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f47ec089110 con 0x7f47f413f880 2023-12-12T09:47:08.113 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:08.108+0000 7f47f259c640 1 --2- 172.21.15.73:0/821360382 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f47d406ae40 0x7f47d406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:08.113 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:08.108+0000 7f47f259c640 1 --2- 172.21.15.73:0/821360382 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f47d406ae40 0x7f47d406d300 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f47e4036000 tx=0x7f47e402e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:47:08.114 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:08.112+0000 7f47eaffd640 1 -- 172.21.15.73:0/821360382 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f47ec053e50 con 0x7f47f413f880 2023-12-12T09:47:08.292 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:08.291+0000 7f47f8bb6640 1 -- 172.21.15.73:0/821360382 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"} v 0) v1 -- 0x7f47f41eb2d0 con 0x7f47f413f880 2023-12-12T09:47:08.292 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:08.292+0000 7f47eaffd640 1 -- 172.21.15.73:0/821360382 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"}]=0 v79) v1 ==== 101+0+11 (secure 0 0 0) 0x7f47f41eb2d0 con 0x7f47f413f880 2023-12-12T09:47:08.292 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 64 2023-12-12T09:47:08.295 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:08.294+0000 7f47f8bb6640 1 -- 172.21.15.73:0/821360382 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f47d406ae40 msgr2=0x7f47d406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:08.295 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:08.294+0000 7f47f8bb6640 1 --2- 172.21.15.73:0/821360382 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f47d406ae40 0x7f47d406d300 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f47e4036000 tx=0x7f47e402e000 comp rx=0 tx=0).stop 2023-12-12T09:47:08.295 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:08.294+0000 7f47f8bb6640 1 -- 172.21.15.73:0/821360382 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f47f413f880 msgr2=0x7f47f413fd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:08.295 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:08.294+0000 7f47f8bb6640 1 --2- 172.21.15.73:0/821360382 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f47f413f880 0x7f47f413fd00 secure :-1 s=READY pgs=1029 cs=0 l=1 rev1=1 crypto rx=0x7f47f40c2c20 tx=0x7f47ec00cb90 comp rx=0 tx=0).stop 2023-12-12T09:47:08.295 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:08.295+0000 7f47f8bb6640 1 -- 172.21.15.73:0/821360382 shutdown_connections 2023-12-12T09:47:08.296 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:08.295+0000 7f47f8bb6640 1 --2- 172.21.15.73:0/821360382 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f47d406ae40 0x7f47d406d300 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:08.296 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:08.295+0000 7f47f8bb6640 1 --2- 172.21.15.73:0/821360382 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f47f413f880 0x7f47f413fd00 unknown :-1 s=CLOSED pgs=1029 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:08.296 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:08.295+0000 7f47f8bb6640 1 --2- 172.21.15.73:0/821360382 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f47f41585f0 0x7f47f40ab8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:08.296 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:08.295+0000 7f47f8bb6640 1 --2- 172.21.15.73:0/821360382 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f47e0003970 0x7f47f41ead90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:08.296 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:08.295+0000 7f47f8bb6640 1 -- 172.21.15.73:0/821360382 >> 172.21.15.73:0/821360382 conn(0x7f47f40c2e80 msgr2=0x7f47f40c3f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:47:08.296 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:08.295+0000 7f47f8bb6640 1 -- 172.21.15.73:0/821360382 shutdown_connections 2023-12-12T09:47:08.296 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:08.295+0000 7f47f8bb6640 1 -- 172.21.15.73:0/821360382 wait complete. 2023-12-12T09:47:08.312 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-12T09:47:08.510 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:08.509+0000 7fa2205b6640 1 Processor -- start 2023-12-12T09:47:08.511 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:08.510+0000 7fa2205b6640 1 -- start start 2023-12-12T09:47:08.512 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:08.511+0000 7fa2205b6640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fa218151ce0 0x7fa2180c67d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:08.512 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:08.511+0000 7fa2205b6640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fa2180bd470 0x7fa21806ba90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:08.513 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:08.511+0000 7fa2205b6640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa218154650 con 0x7fa2180c7cc0 2023-12-12T09:47:08.513 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:08.511+0000 7fa2205b6640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2180c57b0 con 0x7fa218151ce0 2023-12-12T09:47:08.513 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:08.511+0000 7fa2205b6640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa218154930 con 0x7fa2180bd470 2023-12-12T09:47:08.513 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:08.511+0000 7fa21e352640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fa218151ce0 0x7fa2180c67d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:08.513 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:08.511+0000 7fa21e352640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fa218151ce0 0x7fa2180c67d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:56216/0 (socket says 172.21.15.73:56216) 2023-12-12T09:47:08.513 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:08.511+0000 7fa21e352640 1 -- 172.21.15.73:0/2984382697 learned_addr learned my addr 172.21.15.73:0/2984382697 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:47:08.513 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:08.512+0000 7fa21e352640 1 -- 172.21.15.73:0/2984382697 >> v2:172.21.15.142:3300/0 conn(0x7fa2180bd470 msgr2=0x7fa21806ba90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:47:08.514 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:08.512+0000 7fa21e352640 1 --2- 172.21.15.73:0/2984382697 >> v2:172.21.15.142:3300/0 conn(0x7fa2180bd470 0x7fa21806ba90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:08.514 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:08.512+0000 7fa21e352640 1 -- 172.21.15.73:0/2984382697 >> v1:172.21.15.142:6789/0 conn(0x7fa2180c7cc0 legacy=0x7fa21806bfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:47:08.514 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:08.512+0000 7fa21e352640 1 -- 172.21.15.73:0/2984382697 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa218154c10 con 0x7fa218151ce0 2023-12-12T09:47:08.516 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:08.513+0000 7fa21e352640 1 --2- 172.21.15.73:0/2984382697 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa218151ce0 0x7fa2180c67d0 secure :-1 s=READY pgs=1030 cs=0 l=1 rev1=1 crypto rx=0x7fa2180c0e20 tx=0x7fa20802be70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=880c024cf8a8685a server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:47:08.516 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:08.513+0000 7fa21d350640 1 -- 172.21.15.73:0/2984382697 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa20802ca10 con 0x7fa218151ce0 2023-12-12T09:47:08.517 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:08.513+0000 7fa21d350640 1 -- 172.21.15.73:0/2984382697 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa20802cb70 con 0x7fa218151ce0 2023-12-12T09:47:08.517 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:08.513+0000 7fa21d350640 1 -- 172.21.15.73:0/2984382697 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2080343f0 con 0x7fa218151ce0 2023-12-12T09:47:08.517 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:08.514+0000 7fa2205b6640 1 -- 172.21.15.73:0/2984382697 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa218151ce0 msgr2=0x7fa2180c67d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:08.517 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:08.514+0000 7fa2205b6640 1 --2- 172.21.15.73:0/2984382697 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa218151ce0 0x7fa2180c67d0 secure :-1 s=READY pgs=1030 cs=0 l=1 rev1=1 crypto rx=0x7fa2180c0e20 tx=0x7fa20802be70 comp rx=0 tx=0).stop 2023-12-12T09:47:08.517 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:08.514+0000 7fa2205b6640 1 -- 172.21.15.73:0/2984382697 shutdown_connections 2023-12-12T09:47:08.517 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:08.514+0000 7fa2205b6640 1 --2- 172.21.15.73:0/2984382697 >> v2:172.21.15.142:3300/0 conn(0x7fa2180bd470 0x7fa21806ba90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:08.517 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:08.514+0000 7fa2205b6640 1 --2- 172.21.15.73:0/2984382697 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa218151ce0 0x7fa2180c67d0 unknown :-1 s=CLOSED pgs=1030 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:08.517 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:08.514+0000 7fa2205b6640 1 -- 172.21.15.73:0/2984382697 >> 172.21.15.73:0/2984382697 conn(0x7fa2180ab950 msgr2=0x7fa2180abd30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:47:08.518 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:08.514+0000 7fa2205b6640 1 -- 172.21.15.73:0/2984382697 shutdown_connections 2023-12-12T09:47:08.518 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:08.514+0000 7fa2205b6640 1 -- 172.21.15.73:0/2984382697 wait complete. 2023-12-12T09:47:08.518 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:08.515+0000 7fa2205b6640 1 Processor -- start 2023-12-12T09:47:08.518 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:08.516+0000 7fa2205b6640 1 -- start start 2023-12-12T09:47:08.522 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:08.516+0000 7fa2205b6640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa2180bd470 0x7fa2180bff60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:08.522 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:08.516+0000 7fa2205b6640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa2180c7cc0 0x7fa2181edca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:08.522 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:08.516+0000 7fa2205b6640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa2180aab20 0x7fa2181ebdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:08.522 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:08.516+0000 7fa2205b6640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa218157f80 con 0x7fa2180c7cc0 2023-12-12T09:47:08.522 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:08.516+0000 7fa2205b6640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2180c0820 con 0x7fa2180bd470 2023-12-12T09:47:08.522 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:08.516+0000 7fa2205b6640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2181ee1e0 con 0x7fa2180aab20 2023-12-12T09:47:08.522 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:08.517+0000 7fa21db51640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa2180c7cc0 0x7fa2181edca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:08.523 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:08.517+0000 7fa21db51640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa2180c7cc0 0x7fa2181edca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:56222/0 (socket says 172.21.15.73:56222) 2023-12-12T09:47:08.523 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:08.517+0000 7fa21db51640 1 -- 172.21.15.73:0/17842765 learned_addr learned my addr 172.21.15.73:0/17842765 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:47:08.523 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:08.517+0000 7fa21db51640 1 -- 172.21.15.73:0/17842765 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa2180aab20 msgr2=0x7fa2181ebdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:08.523 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:08.517+0000 7fa21db51640 1 --2- 172.21.15.73:0/17842765 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa2180aab20 0x7fa2181ebdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:08.523 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:08.517+0000 7fa21e352640 1 --2- 172.21.15.73:0/17842765 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa2180bd470 0x7fa2180bff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:08.523 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:08.517+0000 7fa21db51640 1 -- 172.21.15.73:0/17842765 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa2180bd470 msgr2=0x7fa2180bff60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:08.523 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:08.517+0000 7fa21db51640 1 --2- 172.21.15.73:0/17842765 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa2180bd470 0x7fa2180bff60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:08.523 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:08.517+0000 7fa21db51640 1 -- 172.21.15.73:0/17842765 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa208009b30 con 0x7fa2180c7cc0 2023-12-12T09:47:08.523 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:08.517+0000 7fa21db51640 1 --2- 172.21.15.73:0/17842765 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa2180c7cc0 0x7fa2181edca0 secure :-1 s=READY pgs=1031 cs=0 l=1 rev1=1 crypto rx=0x7fa20c00b410 tx=0x7fa20c009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:47:08.523 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:08.518+0000 7fa216ffd640 1 -- 172.21.15.73:0/17842765 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa20c011830 con 0x7fa2180c7cc0 2023-12-12T09:47:08.523 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:08.518+0000 7fa216ffd640 1 -- 172.21.15.73:0/17842765 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa20c0119b0 con 0x7fa2180c7cc0 2023-12-12T09:47:08.523 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:08.518+0000 7fa216ffd640 1 -- 172.21.15.73:0/17842765 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa20c011d60 con 0x7fa2180c7cc0 2023-12-12T09:47:08.524 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:08.518+0000 7fa2205b6640 1 -- 172.21.15.73:0/17842765 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2180c0540 con 0x7fa2180c7cc0 2023-12-12T09:47:08.524 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:08.518+0000 7fa2205b6640 1 -- 172.21.15.73:0/17842765 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2181eb5f0 con 0x7fa2180c7cc0 2023-12-12T09:47:08.524 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:08.519+0000 7fa2205b6640 1 -- 172.21.15.73:0/17842765 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa218067580 con 0x7fa2180c7cc0 2023-12-12T09:47:08.524 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:08.520+0000 7fa216ffd640 1 -- 172.21.15.73:0/17842765 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fa20c0193b0 con 0x7fa2180c7cc0 2023-12-12T09:47:08.524 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:08.521+0000 7fa216ffd640 1 --2- 172.21.15.73:0/17842765 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fa20406ae40 0x7fa20406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:08.524 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:08.521+0000 7fa216ffd640 1 -- 172.21.15.73:0/17842765 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fa20c089660 con 0x7fa2180c7cc0 2023-12-12T09:47:08.524 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:08.521+0000 7fa21e352640 1 --2- 172.21.15.73:0/17842765 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fa20406ae40 0x7fa20406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:08.524 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:08.522+0000 7fa21e352640 1 --2- 172.21.15.73:0/17842765 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fa20406ae40 0x7fa20406d300 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7fa208035000 tx=0x7fa208030000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:47:08.525 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:08.525+0000 7fa216ffd640 1 -- 172.21.15.73:0/17842765 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fa20c054440 con 0x7fa2180c7cc0 2023-12-12T09:47:08.730 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:08.729+0000 7fa2205b6640 1 -- 172.21.15.73:0/17842765 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fa218073e50 con 0x7fa2180c7cc0 2023-12-12T09:47:08.731 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:08.730+0000 7fa216ffd640 1 -- 172.21.15.73:0/17842765 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v79) v1 ==== 80+0+0 (secure 0 0 0) 0x7fa20c057a60 con 0x7fa2180c7cc0 2023-12-12T09:47:08.731 INFO:teuthology.orchestra.run.smithi073.stderr:listed 0 entries 2023-12-12T09:47:08.734 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:08.733+0000 7fa2205b6640 1 -- 172.21.15.73:0/17842765 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fa20406ae40 msgr2=0x7fa20406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:08.734 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:08.733+0000 7fa2205b6640 1 --2- 172.21.15.73:0/17842765 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fa20406ae40 0x7fa20406d300 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7fa208035000 tx=0x7fa208030000 comp rx=0 tx=0).stop 2023-12-12T09:47:08.734 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:08.733+0000 7fa2205b6640 1 -- 172.21.15.73:0/17842765 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa2180c7cc0 msgr2=0x7fa2181edca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:08.734 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:08.733+0000 7fa2205b6640 1 --2- 172.21.15.73:0/17842765 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa2180c7cc0 0x7fa2181edca0 secure :-1 s=READY pgs=1031 cs=0 l=1 rev1=1 crypto rx=0x7fa20c00b410 tx=0x7fa20c009f90 comp rx=0 tx=0).stop 2023-12-12T09:47:08.734 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:08.733+0000 7fa2205b6640 1 -- 172.21.15.73:0/17842765 shutdown_connections 2023-12-12T09:47:08.734 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:08.733+0000 7fa2205b6640 1 --2- 172.21.15.73:0/17842765 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fa20406ae40 0x7fa20406d300 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:08.734 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:08.733+0000 7fa2205b6640 1 --2- 172.21.15.73:0/17842765 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa2180aab20 0x7fa2181ebdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:08.734 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:08.733+0000 7fa2205b6640 1 --2- 172.21.15.73:0/17842765 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa2180c7cc0 0x7fa2181edca0 unknown :-1 s=CLOSED pgs=1031 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:08.734 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:08.733+0000 7fa2205b6640 1 --2- 172.21.15.73:0/17842765 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa2180bd470 0x7fa2180bff60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:08.735 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:08.733+0000 7fa2205b6640 1 -- 172.21.15.73:0/17842765 >> 172.21.15.73:0/17842765 conn(0x7fa2180ab950 msgr2=0x7fa21806ba90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:47:08.735 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:08.733+0000 7fa2205b6640 1 -- 172.21.15.73:0/17842765 shutdown_connections 2023-12-12T09:47:08.735 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:08.733+0000 7fa2205b6640 1 -- 172.21.15.73:0/17842765 wait complete. 2023-12-12T09:47:08.752 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.testuser... 2023-12-12T09:47:08.752 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T09:47:08.752 DEBUG:teuthology.orchestra.run.smithi073:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-12-12T09:47:08.846 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi073.front.sepia.ceph.com 2023-12-12T09:47:08.846 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T09:47:08.846 DEBUG:teuthology.orchestra.run.smithi073:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-12-12T09:47:08.900 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2023-12-12T09:47:08.900 DEBUG:teuthology.orchestra.run.smithi142:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-12T09:47:08.960 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2023-12-12T09:47:08.960 DEBUG:teuthology.orchestra.run.smithi142:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-12T09:47:09.013 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-12T09:47:09.228 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:09.227+0000 7fa8f03dc640 1 Processor -- start 2023-12-12T09:47:09.228 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:09.227+0000 7fa8f03dc640 1 -- start start 2023-12-12T09:47:09.229 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:09.228+0000 7fa8f03dc640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fa8e81552e0 0x7fa8e80c49c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:09.230 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:09.229+0000 7fa8f03dc640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa8e80a50f0 0x7fa8e80a9050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:09.230 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:09.229+0000 7fa8f03dc640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fa8e806bf20 0x7fa8e80a9590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:09.230 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:09.229+0000 7fa8f03dc640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8e80c04d0 con 0x7fa8e81552e0 2023-12-12T09:47:09.230 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:09.229+0000 7fa8f03dc640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8e80c0b50 con 0x7fa8e806bf20 2023-12-12T09:47:09.230 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:09.229+0000 7fa8f03dc640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8e806c880 con 0x7fa8e80a50f0 2023-12-12T09:47:09.230 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:09.229+0000 7fa8ee178640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fa8e81552e0 0x7fa8e80c49c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:09.230 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:09.229+0000 7fa8ee178640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fa8e81552e0 0x7fa8e80c49c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:54036/0 (socket says 172.21.15.73:54036) 2023-12-12T09:47:09.230 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:09.229+0000 7fa8ee178640 1 -- 172.21.15.73:0/3629871967 learned_addr learned my addr 172.21.15.73:0/3629871967 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:47:09.230 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:09.229+0000 7fa8ed977640 1 --2- 172.21.15.73:0/3629871967 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa8e80a50f0 0x7fa8e80a9050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:09.230 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:09.229+0000 7fa8ee979640 1 --2- 172.21.15.73:0/3629871967 >> v2:172.21.15.142:3300/0 conn(0x7fa8e806bf20 0x7fa8e80a9590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:09.231 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:09.229+0000 7fa8ee178640 1 -- 172.21.15.73:0/3629871967 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa8e80a50f0 msgr2=0x7fa8e80a9050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:47:09.231 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:09.229+0000 7fa8ee178640 1 --2- 172.21.15.73:0/3629871967 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa8e80a50f0 0x7fa8e80a9050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:09.231 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:09.230+0000 7fa8ee178640 1 -- 172.21.15.73:0/3629871967 >> v2:172.21.15.142:3300/0 conn(0x7fa8e806bf20 msgr2=0x7fa8e80a9590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:47:09.231 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:09.230+0000 7fa8ee178640 1 --2- 172.21.15.73:0/3629871967 >> v2:172.21.15.142:3300/0 conn(0x7fa8e806bf20 0x7fa8e80a9590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:09.231 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:09.230+0000 7fa8ee178640 1 -- 172.21.15.73:0/3629871967 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8e806cb60 con 0x7fa8e81552e0 2023-12-12T09:47:09.231 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:09.231+0000 7fa8ee178640 1 --2- 172.21.15.73:0/3629871967 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa8e81552e0 0x7fa8e80c49c0 secure :-1 s=READY pgs=1032 cs=0 l=1 rev1=1 crypto rx=0x7fa8e80ab100 tx=0x7fa8e402e050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a5c6dfc0b02393 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:47:09.232 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:09.231+0000 7fa8ed176640 1 -- 172.21.15.73:0/3629871967 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8e402ee00 con 0x7fa8e81552e0 2023-12-12T09:47:09.232 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:09.231+0000 7fa8ed176640 1 -- 172.21.15.73:0/3629871967 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8e4036440 con 0x7fa8e81552e0 2023-12-12T09:47:09.232 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:09.231+0000 7fa8ed176640 1 -- 172.21.15.73:0/3629871967 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8e40367d0 con 0x7fa8e81552e0 2023-12-12T09:47:09.232 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:09.232+0000 7fa8f03dc640 1 -- 172.21.15.73:0/3629871967 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa8e81552e0 msgr2=0x7fa8e80c49c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:09.232 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:09.232+0000 7fa8f03dc640 1 --2- 172.21.15.73:0/3629871967 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa8e81552e0 0x7fa8e80c49c0 secure :-1 s=READY pgs=1032 cs=0 l=1 rev1=1 crypto rx=0x7fa8e80ab100 tx=0x7fa8e402e050 comp rx=0 tx=0).stop 2023-12-12T09:47:09.233 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:09.232+0000 7fa8f03dc640 1 -- 172.21.15.73:0/3629871967 shutdown_connections 2023-12-12T09:47:09.233 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:09.232+0000 7fa8f03dc640 1 --2- 172.21.15.73:0/3629871967 >> v2:172.21.15.142:3300/0 conn(0x7fa8e806bf20 0x7fa8e80a9590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:09.233 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:09.232+0000 7fa8f03dc640 1 --2- 172.21.15.73:0/3629871967 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa8e80a50f0 0x7fa8e80a9050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:09.233 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:09.232+0000 7fa8f03dc640 1 --2- 172.21.15.73:0/3629871967 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa8e81552e0 0x7fa8e80c49c0 unknown :-1 s=CLOSED pgs=1032 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:09.233 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:09.232+0000 7fa8f03dc640 1 -- 172.21.15.73:0/3629871967 >> 172.21.15.73:0/3629871967 conn(0x7fa8e80a8130 msgr2=0x7fa8e80c24b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:47:09.233 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:09.232+0000 7fa8f03dc640 1 -- 172.21.15.73:0/3629871967 shutdown_connections 2023-12-12T09:47:09.233 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:09.232+0000 7fa8f03dc640 1 -- 172.21.15.73:0/3629871967 wait complete. 2023-12-12T09:47:09.235 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:09.234+0000 7fa8f03dc640 1 Processor -- start 2023-12-12T09:47:09.235 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:09.234+0000 7fa8f03dc640 1 -- start start 2023-12-12T09:47:09.237 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:09.235+0000 7fa8f03dc640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa8e806bf20 0x7fa8e80bf050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:09.237 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:09.235+0000 7fa8f03dc640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa8e80a50f0 0x7fa8e81dce50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:09.237 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:09.235+0000 7fa8f03dc640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa8e81552e0 0x7fa8e81ed6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:09.237 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:09.235+0000 7fa8f03dc640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8e80a7580 con 0x7fa8e80a50f0 2023-12-12T09:47:09.237 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:09.235+0000 7fa8f03dc640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8e80bfcc0 con 0x7fa8e81552e0 2023-12-12T09:47:09.237 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:09.236+0000 7fa8f03dc640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8e814d440 con 0x7fa8e806bf20 2023-12-12T09:47:09.237 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:09.236+0000 7fa8ed977640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa8e80a50f0 0x7fa8e81dce50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:09.237 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:09.236+0000 7fa8ed977640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa8e80a50f0 0x7fa8e81dce50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:54046/0 (socket says 172.21.15.73:54046) 2023-12-12T09:47:09.237 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:09.236+0000 7fa8ed977640 1 -- 172.21.15.73:0/133291873 learned_addr learned my addr 172.21.15.73:0/133291873 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:47:09.237 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:09.236+0000 7fa8ed977640 1 -- 172.21.15.73:0/133291873 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa8e806bf20 msgr2=0x7fa8e80bf050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:09.238 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:09.236+0000 7fa8ed977640 1 --2- 172.21.15.73:0/133291873 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa8e806bf20 0x7fa8e80bf050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:09.238 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:09.236+0000 7fa8ed977640 1 -- 172.21.15.73:0/133291873 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa8e81552e0 msgr2=0x7fa8e81ed6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:09.238 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:09.236+0000 7fa8ed977640 1 --2- 172.21.15.73:0/133291873 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa8e81552e0 0x7fa8e81ed6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:09.238 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:09.236+0000 7fa8ed977640 1 -- 172.21.15.73:0/133291873 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8e400b770 con 0x7fa8e80a50f0 2023-12-12T09:47:09.238 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:09.236+0000 7fa8ed977640 1 --2- 172.21.15.73:0/133291873 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa8e80a50f0 0x7fa8e81dce50 secure :-1 s=READY pgs=1033 cs=0 l=1 rev1=1 crypto rx=0x7fa8d800d7d0 tx=0x7fa8d800dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:47:09.239 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:09.237+0000 7fa8deffd640 1 -- 172.21.15.73:0/133291873 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8d800b6c0 con 0x7fa8e80a50f0 2023-12-12T09:47:09.239 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:09.237+0000 7fa8deffd640 1 -- 172.21.15.73:0/133291873 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8d800b820 con 0x7fa8e80a50f0 2023-12-12T09:47:09.239 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:09.237+0000 7fa8deffd640 1 -- 172.21.15.73:0/133291873 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8d800bbb0 con 0x7fa8e80a50f0 2023-12-12T09:47:09.239 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:09.237+0000 7fa8f03dc640 1 -- 172.21.15.73:0/133291873 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8e80a6c50 con 0x7fa8e80a50f0 2023-12-12T09:47:09.239 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:09.237+0000 7fa8f03dc640 1 -- 172.21.15.73:0/133291873 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8e80a7210 con 0x7fa8e80a50f0 2023-12-12T09:47:09.239 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:09.238+0000 7fa8f03dc640 1 -- 172.21.15.73:0/133291873 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8e806cfd0 con 0x7fa8e80a50f0 2023-12-12T09:47:09.239 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:09.239+0000 7fa8deffd640 1 -- 172.21.15.73:0/133291873 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fa8d800bd10 con 0x7fa8e80a50f0 2023-12-12T09:47:09.240 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:09.240+0000 7fa8deffd640 1 --2- 172.21.15.73:0/133291873 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fa8cc06ae70 0x7fa8cc06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:09.240 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:09.240+0000 7fa8deffd640 1 -- 172.21.15.73:0/133291873 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fa8d8089e00 con 0x7fa8e80a50f0 2023-12-12T09:47:09.241 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:09.240+0000 7fa8ee178640 1 --2- 172.21.15.73:0/133291873 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fa8cc06ae70 0x7fa8cc06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:09.241 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:09.241+0000 7fa8ee178640 1 --2- 172.21.15.73:0/133291873 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fa8cc06ae70 0x7fa8cc06d330 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fa8e4038000 tx=0x7fa8e4030000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:47:09.246 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:09.246+0000 7fa8deffd640 1 -- 172.21.15.73:0/133291873 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fa8e806cfd0 con 0x7fa8e80a50f0 2023-12-12T09:47:09.439 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:09.438+0000 7fa8f03dc640 1 -- 172.21.15.73:0/133291873 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa8e806cfd0 con 0x7fa8e80a50f0 2023-12-12T09:47:09.441 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:09.440+0000 7fa8deffd640 1 -- 172.21.15.73:0/133291873 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v79) v1 ==== 74+0+20226 (secure 0 0 0) 0x7fa8e806cfd0 con 0x7fa8e80a50f0 2023-12-12T09:47:09.441 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-12T09:47:09.442 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":79,"fsid":"ba240992-02b8-4c7e-92f2-27eb29ac433b","created":"2023-12-12T09:43:02.454719+0000","modified":"2023-12-12T09:46:43.294476+0000","last_up_change":"2023-12-12T09:43:13.913440+0000","last_in_change":"2023-12-12T09:43:05.925348+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-12T09:43:15.525508+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2023-12-12T09:46:24.716544+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2023-12-12T09:46:25.435954+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs2_metadata","create_time":"2023-12-12T09:46:40.116878+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs2_data","create_time":"2023-12-12T09:46:40.798840+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"dd9074be-dbe2-4c34-9896-a4223d8d3940","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":4047810203},{"type":"v1","addr":"172.21.15.73:6801","nonce":4047810203}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":4047810203},{"type":"v1","addr":"172.21.15.73:6803","nonce":4047810203}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":4047810203},{"type":"v1","addr":"172.21.15.73:6807","nonce":4047810203}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":4047810203},{"type":"v1","addr":"172.21.15.73:6805","nonce":4047810203}]},"public_addr":"172.21.15.73:6801/4047810203","cluster_addr":"172.21.15.73:6803/4047810203","heartbeat_back_addr":"172.21.15.73:6807/4047810203","heartbeat_front_addr":"172.21.15.73:6805/4047810203","state":["exists","up"]},{"osd":1,"uuid":"c4a05052-96d4-4758-a4e1-1a37f1e07fed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":1356058331},{"type":"v1","addr":"172.21.15.73:6824","nonce":1356058331}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":1356058331},{"type":"v1","addr":"172.21.15.73:6827","nonce":1356058331}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":1356058331},{"type":"v1","addr":"172.21.15.73:6831","nonce":1356058331}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":1356058331},{"type":"v1","addr":"172.21.15.73:6829","nonce":1356058331}]},"public_addr":"172.21.15.73:6824/1356058331","cluster_addr":"172.21.15.73:6827/1356058331","heartbeat_back_addr":"172.21.15.73:6831/1356058331","heartbeat_front_addr":"172.21.15.73:6829/1356058331","state":["exists","up"]},{"osd":2,"uuid":"512bc8ac-72c2-40d4-b3d2-d867a92c5213","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":1228903316},{"type":"v1","addr":"172.21.15.73:6817","nonce":1228903316}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":1228903316},{"type":"v1","addr":"172.21.15.73:6819","nonce":1228903316}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6823","nonce":1228903316},{"type":"v1","addr":"172.21.15.73:6825","nonce":1228903316}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":1228903316},{"type":"v1","addr":"172.21.15.73:6821","nonce":1228903316}]},"public_addr":"172.21.15.73:6817/1228903316","cluster_addr":"172.21.15.73:6819/1228903316","heartbeat_back_addr":"172.21.15.73:6825/1228903316","heartbeat_front_addr":"172.21.15.73:6821/1228903316","state":["exists","up"]},{"osd":3,"uuid":"3d1a91e0-42bf-437a-8eae-8d357c8f63a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":1293329670},{"type":"v1","addr":"172.21.15.73:6809","nonce":1293329670}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6810","nonce":1293329670},{"type":"v1","addr":"172.21.15.73:6811","nonce":1293329670}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":1293329670},{"type":"v1","addr":"172.21.15.73:6815","nonce":1293329670}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":1293329670},{"type":"v1","addr":"172.21.15.73:6813","nonce":1293329670}]},"public_addr":"172.21.15.73:6809/1293329670","cluster_addr":"172.21.15.73:6811/1293329670","heartbeat_back_addr":"172.21.15.73:6815/1293329670","heartbeat_front_addr":"172.21.15.73:6813/1293329670","state":["exists","up"]},{"osd":4,"uuid":"4b302fff-834c-4069-ac19-00e46f6c87b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":3727975702},{"type":"v1","addr":"172.21.15.142:6801","nonce":3727975702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":3727975702},{"type":"v1","addr":"172.21.15.142:6803","nonce":3727975702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6809","nonce":3727975702},{"type":"v1","addr":"172.21.15.142:6811","nonce":3727975702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6805","nonce":3727975702},{"type":"v1","addr":"172.21.15.142:6807","nonce":3727975702}]},"public_addr":"172.21.15.142:6801/3727975702","cluster_addr":"172.21.15.142:6803/3727975702","heartbeat_back_addr":"172.21.15.142:6811/3727975702","heartbeat_front_addr":"172.21.15.142:6807/3727975702","state":["exists","up"]},{"osd":5,"uuid":"d7cdace2-67d0-45cc-95f2-515cf6ef1b82","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6817","nonce":2353193632},{"type":"v1","addr":"172.21.15.142:6819","nonce":2353193632}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6821","nonce":2353193632},{"type":"v1","addr":"172.21.15.142:6823","nonce":2353193632}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6829","nonce":2353193632},{"type":"v1","addr":"172.21.15.142:6831","nonce":2353193632}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6825","nonce":2353193632},{"type":"v1","addr":"172.21.15.142:6827","nonce":2353193632}]},"public_addr":"172.21.15.142:6819/2353193632","cluster_addr":"172.21.15.142:6823/2353193632","heartbeat_back_addr":"172.21.15.142:6831/2353193632","heartbeat_front_addr":"172.21.15.142:6827/2353193632","state":["exists","up"]},{"osd":6,"uuid":"649ce78a-5626-445c-aedc-a651ed05a6f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":2006111986},{"type":"v1","addr":"172.21.15.142:6806","nonce":2006111986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":2006111986},{"type":"v1","addr":"172.21.15.142:6810","nonce":2006111986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":2006111986},{"type":"v1","addr":"172.21.15.142:6815","nonce":2006111986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":2006111986},{"type":"v1","addr":"172.21.15.142:6813","nonce":2006111986}]},"public_addr":"172.21.15.142:6806/2006111986","cluster_addr":"172.21.15.142:6810/2006111986","heartbeat_back_addr":"172.21.15.142:6815/2006111986","heartbeat_front_addr":"172.21.15.142:6813/2006111986","state":["exists","up"]},{"osd":7,"uuid":"af15ae3b-c1d0-4acf-92db-8a1805494d13","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":2573794341},{"type":"v1","addr":"172.21.15.142:6818","nonce":2573794341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":2573794341},{"type":"v1","addr":"172.21.15.142:6822","nonce":2573794341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":2573794341},{"type":"v1","addr":"172.21.15.142:6830","nonce":2573794341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":2573794341},{"type":"v1","addr":"172.21.15.142:6826","nonce":2573794341}]},"public_addr":"172.21.15.142:6818/2573794341","cluster_addr":"172.21.15.142:6822/2573794341","heartbeat_back_addr":"172.21.15.142:6830/2573794341","heartbeat_front_addr":"172.21.15.142:6826/2573794341","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.185824+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.262103+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.225556+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:10.523459+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:10.706035+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.257339+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.301776+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.051960+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-12T09:47:09.445 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:09.443+0000 7fa8f03dc640 1 -- 172.21.15.73:0/133291873 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fa8cc06ae70 msgr2=0x7fa8cc06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:09.445 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:09.443+0000 7fa8f03dc640 1 --2- 172.21.15.73:0/133291873 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fa8cc06ae70 0x7fa8cc06d330 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fa8e4038000 tx=0x7fa8e4030000 comp rx=0 tx=0).stop 2023-12-12T09:47:09.445 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:09.443+0000 7fa8f03dc640 1 -- 172.21.15.73:0/133291873 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa8e80a50f0 msgr2=0x7fa8e81dce50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:09.445 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:09.443+0000 7fa8f03dc640 1 --2- 172.21.15.73:0/133291873 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa8e80a50f0 0x7fa8e81dce50 secure :-1 s=READY pgs=1033 cs=0 l=1 rev1=1 crypto rx=0x7fa8d800d7d0 tx=0x7fa8d800dc90 comp rx=0 tx=0).stop 2023-12-12T09:47:09.445 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:09.443+0000 7fa8f03dc640 1 -- 172.21.15.73:0/133291873 shutdown_connections 2023-12-12T09:47:09.445 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:09.443+0000 7fa8f03dc640 1 --2- 172.21.15.73:0/133291873 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fa8cc06ae70 0x7fa8cc06d330 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:09.445 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:09.443+0000 7fa8f03dc640 1 --2- 172.21.15.73:0/133291873 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa8e81552e0 0x7fa8e81ed6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:09.445 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:09.443+0000 7fa8f03dc640 1 --2- 172.21.15.73:0/133291873 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa8e80a50f0 0x7fa8e81dce50 unknown :-1 s=CLOSED pgs=1033 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:09.445 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:09.443+0000 7fa8f03dc640 1 --2- 172.21.15.73:0/133291873 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa8e806bf20 0x7fa8e80bf050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:09.446 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:09.443+0000 7fa8f03dc640 1 -- 172.21.15.73:0/133291873 >> 172.21.15.73:0/133291873 conn(0x7fa8e80a8130 msgr2=0x7fa8e80aa630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:47:09.446 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:09.444+0000 7fa8f03dc640 1 -- 172.21.15.73:0/133291873 shutdown_connections 2023-12-12T09:47:09.446 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:09.444+0000 7fa8f03dc640 1 -- 172.21.15.73:0/133291873 wait complete. 2023-12-12T09:47:09.463 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-12T09:43:15.525508+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 12, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-12T09:46:24.716544+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '74', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 13, 'pool_name': 'cephfs_data', 'create_time': '2023-12-12T09:46:25.435954+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '75', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 14, 'pool_name': 'cephfs2_metadata', 'create_time': '2023-12-12T09:46:40.116878+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '78', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs2'}}, 'read_balance': {'score_acting': 2.5, 'score_stable': 2.5, 'optimal_score': 1, 'raw_score_acting': 2.5, 'raw_score_stable': 2.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 15, 'pool_name': 'cephfs2_data', 'create_time': '2023-12-12T09:46:40.798840+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '79', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs2'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-12T09:47:09.463 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-12T09:47:09.679 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:09.679+0000 7f7d6b06b640 1 Processor -- start 2023-12-12T09:47:09.679 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:09.679+0000 7f7d6b06b640 1 -- start start 2023-12-12T09:47:09.681 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:09.680+0000 7f7d6b06b640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f7d6406d350 0x7f7d6406dc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:09.681 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:09.680+0000 7f7d6b06b640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d640c16c0 con 0x7f7d6414f8c0 2023-12-12T09:47:09.681 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:09.680+0000 7f7d6b06b640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d640c19a0 con 0x7f7d64152500 2023-12-12T09:47:09.681 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:09.680+0000 7f7d6b06b640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d640c1090 con 0x7f7d6406d350 2023-12-12T09:47:09.681 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:09.681+0000 7f7d68e07640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f7d6414f8c0 0x7f7d64071e60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:54616/0 (socket says 172.21.15.73:54616) 2023-12-12T09:47:09.681 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:09.681+0000 7f7d68e07640 1 -- 172.21.15.73:0/1880371382 learned_addr learned my addr 172.21.15.73:0/1880371382 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-12T09:47:09.683 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:09.681+0000 7f7d63fff640 1 --2- 172.21.15.73:0/1880371382 >> v2:172.21.15.142:3300/0 conn(0x7f7d6406d350 0x7f7d6406dc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:09.683 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:09.681+0000 7f7d637fe640 1 -- 172.21.15.73:0/1880371382 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1944963857 0 0) 0x7f7d640c16c0 con 0x7f7d6414f8c0 2023-12-12T09:47:09.683 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:09.681+0000 7f7d637fe640 1 -- 172.21.15.73:0/1880371382 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7d4c003520 con 0x7f7d6414f8c0 2023-12-12T09:47:09.683 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:09.681+0000 7f7d637fe640 1 -- 172.21.15.73:0/1880371382 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2826926870 0 0) 0x7f7d4c003520 con 0x7f7d6414f8c0 2023-12-12T09:47:09.683 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:09.681+0000 7f7d637fe640 1 -- 172.21.15.73:0/1880371382 >> v2:172.21.15.142:3300/0 conn(0x7f7d6406d350 msgr2=0x7f7d6406dc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:47:09.683 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:09.681+0000 7f7d637fe640 1 --2- 172.21.15.73:0/1880371382 >> v2:172.21.15.142:3300/0 conn(0x7f7d6406d350 0x7f7d6406dc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:09.683 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:09.681+0000 7f7d637fe640 1 -- 172.21.15.73:0/1880371382 >> v1:172.21.15.142:6789/0 conn(0x7f7d64152500 legacy=0x7f7d64152990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:09.683 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:09.681+0000 7f7d637fe640 1 -- 172.21.15.73:0/1880371382 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d640c1c80 con 0x7f7d6414f8c0 2023-12-12T09:47:09.683 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:09.681+0000 7f7d637fe640 1 -- 172.21.15.73:0/1880371382 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3186547832 0 0) 0x7f7d540019f0 con 0x7f7d6414f8c0 2023-12-12T09:47:09.683 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:09.682+0000 7f7d637fe640 1 -- 172.21.15.73:0/1880371382 >> v1:172.21.15.73:6789/0 conn(0x7f7d6414f8c0 legacy=0x7f7d64071e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:09.684 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:09.682+0000 7f7d637fe640 1 --2- 172.21.15.73:0/1880371382 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7d4c003970 0x7f7d4c003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:09.684 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:09.682+0000 7f7d637fe640 1 --2- 172.21.15.73:0/1880371382 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7d4c0047c0 0x7f7d4c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:09.684 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:09.682+0000 7f7d637fe640 1 --2- 172.21.15.73:0/1880371382 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7d4c005180 0x7f7d4c00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:09.684 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:09.682+0000 7f7d637fe640 1 -- 172.21.15.73:0/1880371382 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d4c00bff0 con 0x7f7d4c003970 2023-12-12T09:47:09.684 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:09.682+0000 7f7d637fe640 1 -- 172.21.15.73:0/1880371382 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d4c00c160 con 0x7f7d4c005180 2023-12-12T09:47:09.684 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:09.682+0000 7f7d637fe640 1 -- 172.21.15.73:0/1880371382 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d4c00c320 con 0x7f7d4c0047c0 2023-12-12T09:47:09.684 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:09.682+0000 7f7d68e07640 1 --2- 172.21.15.73:0/1880371382 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7d4c003970 0x7f7d4c003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:09.684 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:09.682+0000 7f7d68e07640 1 -- 172.21.15.73:0/1880371382 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7d4c0047c0 msgr2=0x7f7d4c004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:47:09.684 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:09.682+0000 7f7d68e07640 1 --2- 172.21.15.73:0/1880371382 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7d4c0047c0 0x7f7d4c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:09.684 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:09.682+0000 7f7d69608640 1 --2- 172.21.15.73:0/1880371382 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7d4c005180 0x7f7d4c00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:09.684 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:09.682+0000 7f7d68e07640 1 -- 172.21.15.73:0/1880371382 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7d4c005180 msgr2=0x7f7d4c00b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:47:09.684 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:09.682+0000 7f7d68e07640 1 --2- 172.21.15.73:0/1880371382 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7d4c005180 0x7f7d4c00b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:09.684 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:09.682+0000 7f7d68e07640 1 -- 172.21.15.73:0/1880371382 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d4c003520 con 0x7f7d4c003970 2023-12-12T09:47:09.684 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:09.682+0000 7f7d69608640 1 --2- 172.21.15.73:0/1880371382 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7d4c005180 0x7f7d4c00b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:47:09.684 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:09.682+0000 7f7d69608640 1 -- 172.21.15.73:0/1880371382 reap_dead start 2023-12-12T09:47:09.685 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:09.683+0000 7f7d68e07640 1 --2- 172.21.15.73:0/1880371382 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7d4c003970 0x7f7d4c003d90 secure :-1 s=READY pgs=1035 cs=0 l=1 rev1=1 crypto rx=0x7f7d5400a830 tx=0x7f7d4c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0d4a0a28bacecc2 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:47:09.686 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:09.684+0000 7f7d637fe640 1 -- 172.21.15.73:0/1880371382 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d540072d0 con 0x7f7d4c003970 2023-12-12T09:47:09.686 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:09.684+0000 7f7d637fe640 1 -- 172.21.15.73:0/1880371382 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d5402f070 con 0x7f7d4c003970 2023-12-12T09:47:09.686 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:09.684+0000 7f7d637fe640 1 -- 172.21.15.73:0/1880371382 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d540076f0 con 0x7f7d4c003970 2023-12-12T09:47:09.686 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:09.684+0000 7f7d6b06b640 1 -- 172.21.15.73:0/1880371382 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7d4c003970 msgr2=0x7f7d4c003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:09.686 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:09.684+0000 7f7d6b06b640 1 --2- 172.21.15.73:0/1880371382 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7d4c003970 0x7f7d4c003d90 secure :-1 s=READY pgs=1035 cs=0 l=1 rev1=1 crypto rx=0x7f7d5400a830 tx=0x7f7d4c0057f0 comp rx=0 tx=0).stop 2023-12-12T09:47:09.686 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:09.684+0000 7f7d6b06b640 1 -- 172.21.15.73:0/1880371382 shutdown_connections 2023-12-12T09:47:09.686 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:09.684+0000 7f7d6b06b640 1 --2- 172.21.15.73:0/1880371382 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7d4c003970 0x7f7d4c003d90 unknown :-1 s=CLOSED pgs=1035 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:09.686 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:09.684+0000 7f7d6b06b640 1 -- 172.21.15.73:0/1880371382 >> 172.21.15.73:0/1880371382 conn(0x7f7d6406a4e0 msgr2=0x7f7d6406a8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:47:09.686 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:09.684+0000 7f7d6b06b640 1 -- 172.21.15.73:0/1880371382 shutdown_connections 2023-12-12T09:47:09.686 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:09.685+0000 7f7d6b06b640 1 -- 172.21.15.73:0/1880371382 wait complete. 2023-12-12T09:47:09.687 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:09.686+0000 7f7d6b06b640 1 Processor -- start 2023-12-12T09:47:09.687 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:09.686+0000 7f7d6b06b640 1 -- start start 2023-12-12T09:47:09.689 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:09.688+0000 7f7d6b06b640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7d4c003970 0x7f7d640707c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:09.690 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:09.688+0000 7f7d6b06b640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7d64151f50 0x7f7d6414af90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:09.690 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:09.688+0000 7f7d6b06b640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7d64144980 0x7f7d64144e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:09.690 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:09.688+0000 7f7d6b06b640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d64150390 con 0x7f7d64144980 2023-12-12T09:47:09.690 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:09.688+0000 7f7d6b06b640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d64150d00 con 0x7f7d4c003970 2023-12-12T09:47:09.690 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:09.688+0000 7f7d6b06b640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d64071000 con 0x7f7d64151f50 2023-12-12T09:47:09.690 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:09.688+0000 7f7d69608640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7d64144980 0x7f7d64144e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:09.690 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:09.688+0000 7f7d69608640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7d64144980 0x7f7d64144e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:54064/0 (socket says 172.21.15.73:54064) 2023-12-12T09:47:09.690 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:09.688+0000 7f7d69608640 1 -- 172.21.15.73:0/2977221261 learned_addr learned my addr 172.21.15.73:0/2977221261 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:47:09.690 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:09.689+0000 7f7d63fff640 1 --2- 172.21.15.73:0/2977221261 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7d64151f50 0x7f7d6414af90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:09.690 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:09.689+0000 7f7d68e07640 1 --2- 172.21.15.73:0/2977221261 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7d4c003970 0x7f7d640707c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:09.690 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:09.689+0000 7f7d69608640 1 -- 172.21.15.73:0/2977221261 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7d64151f50 msgr2=0x7f7d6414af90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:09.690 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:09.689+0000 7f7d69608640 1 --2- 172.21.15.73:0/2977221261 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7d64151f50 0x7f7d6414af90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:09.690 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:09.689+0000 7f7d69608640 1 -- 172.21.15.73:0/2977221261 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7d4c003970 msgr2=0x7f7d640707c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:09.690 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:09.689+0000 7f7d69608640 1 --2- 172.21.15.73:0/2977221261 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7d4c003970 0x7f7d640707c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:09.691 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:09.689+0000 7f7d69608640 1 -- 172.21.15.73:0/2977221261 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d640712e0 con 0x7f7d64144980 2023-12-12T09:47:09.691 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:09.689+0000 7f7d63fff640 1 --2- 172.21.15.73:0/2977221261 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7d64151f50 0x7f7d6414af90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:47:09.691 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:09.689+0000 7f7d69608640 1 --2- 172.21.15.73:0/2977221261 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7d64144980 0x7f7d64144e30 secure :-1 s=READY pgs=1036 cs=0 l=1 rev1=1 crypto rx=0x7f7d64072d00 tx=0x7f7d5c00d5e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:47:09.691 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:09.690+0000 7f7d617fa640 1 -- 172.21.15.73:0/2977221261 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d5c00b070 con 0x7f7d64144980 2023-12-12T09:47:09.692 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:09.690+0000 7f7d617fa640 1 -- 172.21.15.73:0/2977221261 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d5c0052d0 con 0x7f7d64144980 2023-12-12T09:47:09.692 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:09.690+0000 7f7d6b06b640 1 -- 172.21.15.73:0/2977221261 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d640715c0 con 0x7f7d64144980 2023-12-12T09:47:09.692 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:09.690+0000 7f7d617fa640 1 -- 172.21.15.73:0/2977221261 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d5c0035f0 con 0x7f7d64144980 2023-12-12T09:47:09.692 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:09.690+0000 7f7d6b06b640 1 -- 172.21.15.73:0/2977221261 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d6414b4d0 con 0x7f7d64144980 2023-12-12T09:47:09.692 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:09.691+0000 7f7d6b06b640 1 -- 172.21.15.73:0/2977221261 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d64067070 con 0x7f7d64144980 2023-12-12T09:47:09.692 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:09.692+0000 7f7d617fa640 1 -- 172.21.15.73:0/2977221261 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f7d5c003750 con 0x7f7d64144980 2023-12-12T09:47:09.693 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:09.693+0000 7f7d617fa640 1 --2- 172.21.15.73:0/2977221261 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f7d5006ae70 0x7f7d5006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:09.693 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:09.693+0000 7f7d617fa640 1 -- 172.21.15.73:0/2977221261 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f7d5c088eb0 con 0x7f7d64144980 2023-12-12T09:47:09.693 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:09.693+0000 7f7d68e07640 1 --2- 172.21.15.73:0/2977221261 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f7d5006ae70 0x7f7d5006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:09.694 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:09.694+0000 7f7d68e07640 1 --2- 172.21.15.73:0/2977221261 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f7d5006ae70 0x7f7d5006d330 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f7d54034000 tx=0x7f7d54007000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:47:09.697 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:09.697+0000 7f7d617fa640 1 -- 172.21.15.73:0/2977221261 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f7d5c053b60 con 0x7f7d64144980 2023-12-12T09:47:09.894 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:09.893+0000 7f7d6b06b640 1 -- 172.21.15.73:0/2977221261 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f7d640c16c0 con 0x7f7d64144980 2023-12-12T09:47:09.894 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:09.894+0000 7f7d617fa640 1 -- 172.21.15.73:0/2977221261 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v80) v1 ==== 93+0+10 (secure 0 0 0) 0x7f7d5c018020 con 0x7f7d64144980 2023-12-12T09:47:09.895 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 1 2023-12-12T09:47:09.897 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:09.896+0000 7f7d6b06b640 1 -- 172.21.15.73:0/2977221261 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f7d5006ae70 msgr2=0x7f7d5006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:09.897 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:09.896+0000 7f7d6b06b640 1 --2- 172.21.15.73:0/2977221261 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f7d5006ae70 0x7f7d5006d330 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f7d54034000 tx=0x7f7d54007000 comp rx=0 tx=0).stop 2023-12-12T09:47:09.897 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:09.897+0000 7f7d6b06b640 1 -- 172.21.15.73:0/2977221261 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7d64144980 msgr2=0x7f7d64144e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:09.897 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:09.897+0000 7f7d6b06b640 1 --2- 172.21.15.73:0/2977221261 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7d64144980 0x7f7d64144e30 secure :-1 s=READY pgs=1036 cs=0 l=1 rev1=1 crypto rx=0x7f7d64072d00 tx=0x7f7d5c00d5e0 comp rx=0 tx=0).stop 2023-12-12T09:47:09.898 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:09.897+0000 7f7d6b06b640 1 -- 172.21.15.73:0/2977221261 shutdown_connections 2023-12-12T09:47:09.898 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:09.897+0000 7f7d6b06b640 1 --2- 172.21.15.73:0/2977221261 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f7d5006ae70 0x7f7d5006d330 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:09.898 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:09.897+0000 7f7d6b06b640 1 --2- 172.21.15.73:0/2977221261 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7d64144980 0x7f7d64144e30 unknown :-1 s=CLOSED pgs=1036 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:09.898 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:09.897+0000 7f7d6b06b640 1 --2- 172.21.15.73:0/2977221261 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7d64151f50 0x7f7d6414af90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:09.898 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:09.897+0000 7f7d6b06b640 1 --2- 172.21.15.73:0/2977221261 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7d4c003970 0x7f7d640707c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:09.898 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:09.897+0000 7f7d6b06b640 1 -- 172.21.15.73:0/2977221261 >> 172.21.15.73:0/2977221261 conn(0x7f7d6406a4e0 msgr2=0x7f7d640c4120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:47:09.898 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:09.897+0000 7f7d6b06b640 1 -- 172.21.15.73:0/2977221261 shutdown_connections 2023-12-12T09:47:09.898 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:09.897+0000 7f7d6b06b640 1 -- 172.21.15.73:0/2977221261 wait complete. 2023-12-12T09:47:09.917 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-12T09:47:10.131 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:10.130+0000 7f10f1694640 1 Processor -- start 2023-12-12T09:47:10.131 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:10.131+0000 7f10f1694640 1 -- start start 2023-12-12T09:47:10.133 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:10.132+0000 7f10f1694640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f10ec06d350 0x7f10ec06dc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:10.133 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:10.132+0000 7f10f1694640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10ec0c16c0 con 0x7f10ec152500 2023-12-12T09:47:10.133 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:10.132+0000 7f10f1694640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10ec0c19a0 con 0x7f10ec14f8c0 2023-12-12T09:47:10.133 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:10.132+0000 7f10f1694640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10ec0c1090 con 0x7f10ec06d350 2023-12-12T09:47:10.133 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:10.133+0000 7f10eb7fe640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f10ec152500 0x7f10ec152990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:54618/0 (socket says 172.21.15.73:54618) 2023-12-12T09:47:10.133 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:10.133+0000 7f10eb7fe640 1 -- 172.21.15.73:0/4046381679 learned_addr learned my addr 172.21.15.73:0/4046381679 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-12T09:47:10.135 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:10.133+0000 7f10e3fff640 1 --2- 172.21.15.73:0/4046381679 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f10ec06d350 0x7f10ec06dc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:10.136 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:10.133+0000 7f10ea7fc640 1 -- 172.21.15.73:0/4046381679 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3029423897 0 0) 0x7f10ec0c16c0 con 0x7f10ec152500 2023-12-12T09:47:10.136 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:10.133+0000 7f10ea7fc640 1 -- 172.21.15.73:0/4046381679 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f10d8003520 con 0x7f10ec152500 2023-12-12T09:47:10.136 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:10.134+0000 7f10ea7fc640 1 -- 172.21.15.73:0/4046381679 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1513626154 0 0) 0x7f10d8003520 con 0x7f10ec152500 2023-12-12T09:47:10.136 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:10.134+0000 7f10ea7fc640 1 -- 172.21.15.73:0/4046381679 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f10ec06d350 msgr2=0x7f10ec06dc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:47:10.136 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:10.134+0000 7f10ea7fc640 1 --2- 172.21.15.73:0/4046381679 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f10ec06d350 0x7f10ec06dc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:10.136 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:10.134+0000 7f10ea7fc640 1 -- 172.21.15.73:0/4046381679 >> v1:172.21.15.142:6789/0 conn(0x7f10ec14f8c0 legacy=0x7f10ec071e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:10.136 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:10.134+0000 7f10ea7fc640 1 -- 172.21.15.73:0/4046381679 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10ec0c1c80 con 0x7f10ec152500 2023-12-12T09:47:10.136 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:10.134+0000 7f10ea7fc640 1 -- 172.21.15.73:0/4046381679 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3186547832 0 0) 0x7f10e4001670 con 0x7f10ec152500 2023-12-12T09:47:10.136 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:10.134+0000 7f10ea7fc640 1 -- 172.21.15.73:0/4046381679 >> v1:172.21.15.73:6789/0 conn(0x7f10ec152500 legacy=0x7f10ec152990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:10.136 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:10.134+0000 7f10ea7fc640 1 --2- 172.21.15.73:0/4046381679 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f10ec06d350 0x7f10d80039a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:10.136 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:10.134+0000 7f10ea7fc640 1 --2- 172.21.15.73:0/4046381679 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f10d8003f20 0x7f10d80047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:10.136 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:10.134+0000 7f10ea7fc640 1 --2- 172.21.15.73:0/4046381679 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f10d8004d00 0x7f10d8005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:10.136 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:10.134+0000 7f10ea7fc640 1 -- 172.21.15.73:0/4046381679 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10d800ba30 con 0x7f10d8004d00 2023-12-12T09:47:10.137 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:10.134+0000 7f10ea7fc640 1 -- 172.21.15.73:0/4046381679 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10d800bba0 con 0x7f10d8003f20 2023-12-12T09:47:10.137 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:10.134+0000 7f10ea7fc640 1 -- 172.21.15.73:0/4046381679 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10d800bd60 con 0x7f10ec06d350 2023-12-12T09:47:10.137 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:10.134+0000 7f10eb7fe640 1 --2- 172.21.15.73:0/4046381679 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f10d8004d00 0x7f10d8005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:10.137 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:10.134+0000 7f10e3fff640 1 --2- 172.21.15.73:0/4046381679 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f10d8003f20 0x7f10d80047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:10.137 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:10.134+0000 7f10eaffd640 1 --2- 172.21.15.73:0/4046381679 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f10ec06d350 0x7f10d80039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:10.137 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:10.135+0000 7f10eb7fe640 1 -- 172.21.15.73:0/4046381679 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f10ec06d350 msgr2=0x7f10d80039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:47:10.137 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:10.135+0000 7f10eb7fe640 1 --2- 172.21.15.73:0/4046381679 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f10ec06d350 0x7f10d80039a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:10.137 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:10.135+0000 7f10eb7fe640 1 -- 172.21.15.73:0/4046381679 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f10d8003f20 msgr2=0x7f10d80047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:47:10.137 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:10.135+0000 7f10eb7fe640 1 --2- 172.21.15.73:0/4046381679 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f10d8003f20 0x7f10d80047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:10.137 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:10.135+0000 7f10eb7fe640 1 -- 172.21.15.73:0/4046381679 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10d8003520 con 0x7f10d8004d00 2023-12-12T09:47:10.137 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:10.135+0000 7f10eaffd640 1 --2- 172.21.15.73:0/4046381679 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f10ec06d350 0x7f10d80039a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:47:10.137 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:10.135+0000 7f10e3fff640 1 --2- 172.21.15.73:0/4046381679 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f10d8003f20 0x7f10d80047c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:47:10.138 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:10.136+0000 7f10eb7fe640 1 --2- 172.21.15.73:0/4046381679 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f10d8004d00 0x7f10d8005180 secure :-1 s=READY pgs=1038 cs=0 l=1 rev1=1 crypto rx=0x7f10e400c240 tx=0x7f10d80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1693a8be163f7c3 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:47:10.139 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:10.136+0000 7f10ea7fc640 1 -- 172.21.15.73:0/4046381679 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10e4005ad0 con 0x7f10d8004d00 2023-12-12T09:47:10.139 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:10.136+0000 7f10ea7fc640 1 -- 172.21.15.73:0/4046381679 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10e4005c30 con 0x7f10d8004d00 2023-12-12T09:47:10.139 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:10.136+0000 7f10ea7fc640 1 -- 172.21.15.73:0/4046381679 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10e402caf0 con 0x7f10d8004d00 2023-12-12T09:47:10.139 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:10.136+0000 7f10f1694640 1 -- 172.21.15.73:0/4046381679 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f10d8004d00 msgr2=0x7f10d8005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:10.139 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:10.136+0000 7f10f1694640 1 --2- 172.21.15.73:0/4046381679 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f10d8004d00 0x7f10d8005180 secure :-1 s=READY pgs=1038 cs=0 l=1 rev1=1 crypto rx=0x7f10e400c240 tx=0x7f10d80057f0 comp rx=0 tx=0).stop 2023-12-12T09:47:10.139 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:10.136+0000 7f10eb7fe640 1 -- 172.21.15.73:0/4046381679 reap_dead start 2023-12-12T09:47:10.139 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:10.137+0000 7f10f1694640 1 -- 172.21.15.73:0/4046381679 shutdown_connections 2023-12-12T09:47:10.139 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:10.137+0000 7f10f1694640 1 -- 172.21.15.73:0/4046381679 >> 172.21.15.73:0/4046381679 conn(0x7f10ec06a4e0 msgr2=0x7f10ec06a8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:47:10.139 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:10.137+0000 7f10f1694640 1 -- 172.21.15.73:0/4046381679 shutdown_connections 2023-12-12T09:47:10.139 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:10.137+0000 7f10f1694640 1 -- 172.21.15.73:0/4046381679 wait complete. 2023-12-12T09:47:10.139 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:10.138+0000 7f10f1694640 1 Processor -- start 2023-12-12T09:47:10.141 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:10.139+0000 7f10f1694640 1 -- start start 2023-12-12T09:47:10.141 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:10.139+0000 7f10f1694640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f10d8004d00 0x7f10ec156450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:10.141 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:10.139+0000 7f10f1694640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f10ec148f50 0x7f10ec154e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:10.141 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:10.139+0000 7f10f1694640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f10ec153a20 0x7f10ec153ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:10.142 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:10.139+0000 7f10f1694640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10ec155ba0 con 0x7f10ec153a20 2023-12-12T09:47:10.142 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:10.139+0000 7f10f1694640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10ec1e66b0 con 0x7f10ec148f50 2023-12-12T09:47:10.142 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:10.139+0000 7f10f1694640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10ec1512a0 con 0x7f10d8004d00 2023-12-12T09:47:10.142 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:10.140+0000 7f10eb7fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f10ec153a20 0x7f10ec153ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:10.142 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:10.140+0000 7f10eb7fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f10ec153a20 0x7f10ec153ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:54092/0 (socket says 172.21.15.73:54092) 2023-12-12T09:47:10.142 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:10.140+0000 7f10eb7fe640 1 -- 172.21.15.73:0/4237449034 learned_addr learned my addr 172.21.15.73:0/4237449034 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:47:10.142 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:10.140+0000 7f10e3fff640 1 --2- 172.21.15.73:0/4237449034 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f10ec148f50 0x7f10ec154e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:10.142 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:10.140+0000 7f10eaffd640 1 --2- 172.21.15.73:0/4237449034 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f10d8004d00 0x7f10ec156450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:10.142 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:10.140+0000 7f10eb7fe640 1 -- 172.21.15.73:0/4237449034 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f10d8004d00 msgr2=0x7f10ec156450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:10.142 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:10.140+0000 7f10eb7fe640 1 --2- 172.21.15.73:0/4237449034 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f10d8004d00 0x7f10ec156450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:10.142 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:10.140+0000 7f10eb7fe640 1 -- 172.21.15.73:0/4237449034 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f10ec148f50 msgr2=0x7f10ec154e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:10.142 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:10.140+0000 7f10eb7fe640 1 --2- 172.21.15.73:0/4237449034 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f10ec148f50 0x7f10ec154e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:10.142 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:10.140+0000 7f10eb7fe640 1 -- 172.21.15.73:0/4237449034 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10ec151580 con 0x7f10ec153a20 2023-12-12T09:47:10.142 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:10.140+0000 7f10e3fff640 1 --2- 172.21.15.73:0/4237449034 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f10ec148f50 0x7f10ec154e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:47:10.143 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:10.141+0000 7f10eb7fe640 1 --2- 172.21.15.73:0/4237449034 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f10ec153a20 0x7f10ec153ed0 secure :-1 s=READY pgs=1039 cs=0 l=1 rev1=1 crypto rx=0x7f10e400c360 tx=0x7f10e402e070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:47:10.143 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:10.141+0000 7f10e37fe640 1 -- 172.21.15.73:0/4237449034 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10e403c040 con 0x7f10ec153a20 2023-12-12T09:47:10.143 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:10.141+0000 7f10e37fe640 1 -- 172.21.15.73:0/4237449034 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10e402ccc0 con 0x7f10ec153a20 2023-12-12T09:47:10.143 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:10.141+0000 7f10e37fe640 1 -- 172.21.15.73:0/4237449034 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10e4007270 con 0x7f10ec153a20 2023-12-12T09:47:10.143 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:10.141+0000 7f10f1694640 1 -- 172.21.15.73:0/4237449034 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10ec155390 con 0x7f10ec153a20 2023-12-12T09:47:10.143 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:10.141+0000 7f10f1694640 1 -- 172.21.15.73:0/4237449034 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10ec152070 con 0x7f10ec153a20 2023-12-12T09:47:10.143 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:10.142+0000 7f10f1694640 1 -- 172.21.15.73:0/4237449034 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10ec153740 con 0x7f10ec153a20 2023-12-12T09:47:10.144 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:10.143+0000 7f10e37fe640 1 -- 172.21.15.73:0/4237449034 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f10e4032070 con 0x7f10ec153a20 2023-12-12T09:47:10.145 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:10.144+0000 7f10e37fe640 1 --2- 172.21.15.73:0/4237449034 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f10cc06ae40 0x7f10cc06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:10.145 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:10.144+0000 7f10e37fe640 1 -- 172.21.15.73:0/4237449034 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6623+0+0 (secure 0 0 0) 0x7f10e40aaa80 con 0x7f10ec153a20 2023-12-12T09:47:10.145 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:10.145+0000 7f10eaffd640 1 --2- 172.21.15.73:0/4237449034 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f10cc06ae40 0x7f10cc06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:10.145 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:10.145+0000 7f10eaffd640 1 --2- 172.21.15.73:0/4237449034 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f10cc06ae40 0x7f10cc06d300 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f10ec151000 tx=0x7f10dc009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:47:10.149 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:10.149+0000 7f10e37fe640 1 -- 172.21.15.73:0/4237449034 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f10ec153740 con 0x7f10ec153a20 2023-12-12T09:47:10.337 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:10.337+0000 7f10f1694640 1 -- 172.21.15.73:0/4237449034 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f10ec153740 con 0x7f10ec153a20 2023-12-12T09:47:10.338 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:10.338+0000 7f10e37fe640 1 -- 172.21.15.73:0/4237449034 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v80) v1 ==== 104+0+11 (secure 0 0 0) 0x7f10ec153740 con 0x7f10ec153a20 2023-12-12T09:47:10.338 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 32 2023-12-12T09:47:10.341 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:10.340+0000 7f10f1694640 1 -- 172.21.15.73:0/4237449034 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f10cc06ae40 msgr2=0x7f10cc06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:10.341 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:10.340+0000 7f10f1694640 1 --2- 172.21.15.73:0/4237449034 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f10cc06ae40 0x7f10cc06d300 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f10ec151000 tx=0x7f10dc009040 comp rx=0 tx=0).stop 2023-12-12T09:47:10.341 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:10.340+0000 7f10f1694640 1 -- 172.21.15.73:0/4237449034 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f10ec153a20 msgr2=0x7f10ec153ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:10.341 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:10.340+0000 7f10f1694640 1 --2- 172.21.15.73:0/4237449034 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f10ec153a20 0x7f10ec153ed0 secure :-1 s=READY pgs=1039 cs=0 l=1 rev1=1 crypto rx=0x7f10e400c360 tx=0x7f10e402e070 comp rx=0 tx=0).stop 2023-12-12T09:47:10.341 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:10.340+0000 7f10f1694640 1 -- 172.21.15.73:0/4237449034 shutdown_connections 2023-12-12T09:47:10.341 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:10.340+0000 7f10f1694640 1 --2- 172.21.15.73:0/4237449034 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f10cc06ae40 0x7f10cc06d300 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:10.341 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:10.340+0000 7f10f1694640 1 --2- 172.21.15.73:0/4237449034 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f10ec153a20 0x7f10ec153ed0 unknown :-1 s=CLOSED pgs=1039 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:10.341 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:10.340+0000 7f10f1694640 1 --2- 172.21.15.73:0/4237449034 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f10ec148f50 0x7f10ec154e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:10.341 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:10.340+0000 7f10f1694640 1 --2- 172.21.15.73:0/4237449034 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f10d8004d00 0x7f10ec156450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:10.341 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:10.340+0000 7f10f1694640 1 -- 172.21.15.73:0/4237449034 >> 172.21.15.73:0/4237449034 conn(0x7f10ec06a4e0 msgr2=0x7f10ec06d830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:47:10.341 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:10.340+0000 7f10f1694640 1 -- 172.21.15.73:0/4237449034 shutdown_connections 2023-12-12T09:47:10.342 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:10.340+0000 7f10f1694640 1 -- 172.21.15.73:0/4237449034 wait complete. 2023-12-12T09:47:10.360 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-12T09:47:10.579 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:10.578+0000 7fc5b0210640 1 Processor -- start 2023-12-12T09:47:10.725 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:10.578+0000 7fc5b0210640 1 -- start start 2023-12-12T09:47:10.729 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:10.579+0000 7fc5b0210640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fc5a80a4c90 0x7fc5a80c5420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:10.729 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:10.579+0000 7fc5b0210640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc5a80c0320 0x7fc5a80c20b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:10.730 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:10.579+0000 7fc5b0210640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5a80c3390 con 0x7fc5a814ea60 2023-12-12T09:47:10.730 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:10.579+0000 7fc5b0210640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5a80c4b30 con 0x7fc5a80a4c90 2023-12-12T09:47:10.730 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:10.579+0000 7fc5b0210640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5a8151e60 con 0x7fc5a80c0320 2023-12-12T09:47:10.730 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:10.580+0000 7fc5adfac640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7fc5a814ea60 0x7fc5a80c4420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:54628/0 (socket says 172.21.15.73:54628) 2023-12-12T09:47:10.730 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:10.580+0000 7fc5adfac640 1 -- 172.21.15.73:0/758981530 learned_addr learned my addr 172.21.15.73:0/758981530 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-12T09:47:10.730 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:10.580+0000 7fc5ad7ab640 1 --2- 172.21.15.73:0/758981530 >> v2:172.21.15.73:3300/0 conn(0x7fc5a80a4c90 0x7fc5a80c5420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:10.730 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:10.580+0000 7fc5acfaa640 1 -- 172.21.15.73:0/758981530 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1317733830 0 0) 0x7fc5a80c3390 con 0x7fc5a814ea60 2023-12-12T09:47:10.730 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:10.580+0000 7fc5acfaa640 1 -- 172.21.15.73:0/758981530 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc594003520 con 0x7fc5a814ea60 2023-12-12T09:47:10.730 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:10.580+0000 7fc5ae7ad640 1 --2- 172.21.15.73:0/758981530 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc5a80c0320 0x7fc5a80c20b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:10.730 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:10.580+0000 7fc5ad7ab640 1 -- 172.21.15.73:0/758981530 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc5a80c0320 msgr2=0x7fc5a80c20b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:47:10.730 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:10.580+0000 7fc5ad7ab640 1 --2- 172.21.15.73:0/758981530 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc5a80c0320 0x7fc5a80c20b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:10.730 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:10.580+0000 7fc5ad7ab640 1 -- 172.21.15.73:0/758981530 >> v1:172.21.15.73:6789/0 conn(0x7fc5a814ea60 legacy=0x7fc5a80c4420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:10.730 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:10.580+0000 7fc5ad7ab640 1 -- 172.21.15.73:0/758981530 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5a8152140 con 0x7fc5a80a4c90 2023-12-12T09:47:10.731 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:10.580+0000 7fc5ae7ad640 1 --2- 172.21.15.73:0/758981530 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc5a80c0320 0x7fc5a80c20b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:47:10.731 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:10.581+0000 7fc5ad7ab640 1 --2- 172.21.15.73:0/758981530 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc5a80a4c90 0x7fc5a80c5420 secure :-1 s=READY pgs=1041 cs=0 l=1 rev1=1 crypto rx=0x7fc5980097a0 tx=0x7fc59802b820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3ce5ec27428a788 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:47:10.731 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:10.582+0000 7fc5acfaa640 1 -- 172.21.15.73:0/758981530 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc598031780 con 0x7fc5a80a4c90 2023-12-12T09:47:10.731 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:10.582+0000 7fc5acfaa640 1 -- 172.21.15.73:0/758981530 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5980318e0 con 0x7fc5a80a4c90 2023-12-12T09:47:10.731 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:10.582+0000 7fc5acfaa640 1 -- 172.21.15.73:0/758981530 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc598031c70 con 0x7fc5a80a4c90 2023-12-12T09:47:10.731 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:10.582+0000 7fc5b0210640 1 -- 172.21.15.73:0/758981530 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc5a80a4c90 msgr2=0x7fc5a80c5420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:10.731 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:10.582+0000 7fc5b0210640 1 --2- 172.21.15.73:0/758981530 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc5a80a4c90 0x7fc5a80c5420 secure :-1 s=READY pgs=1041 cs=0 l=1 rev1=1 crypto rx=0x7fc5980097a0 tx=0x7fc59802b820 comp rx=0 tx=0).stop 2023-12-12T09:47:10.731 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:10.582+0000 7fc5b0210640 1 -- 172.21.15.73:0/758981530 shutdown_connections 2023-12-12T09:47:10.731 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:10.582+0000 7fc5b0210640 1 --2- 172.21.15.73:0/758981530 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc5a80c0320 0x7fc5a80c20b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:10.731 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:10.582+0000 7fc5b0210640 1 --2- 172.21.15.73:0/758981530 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc5a80a4c90 0x7fc5a80c5420 unknown :-1 s=CLOSED pgs=1041 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:10.731 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:10.582+0000 7fc5b0210640 1 -- 172.21.15.73:0/758981530 >> 172.21.15.73:0/758981530 conn(0x7fc5a806a4e0 msgr2=0x7fc5a806a8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:47:10.731 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:10.583+0000 7fc5b0210640 1 -- 172.21.15.73:0/758981530 shutdown_connections 2023-12-12T09:47:10.731 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:10.583+0000 7fc5b0210640 1 -- 172.21.15.73:0/758981530 wait complete. 2023-12-12T09:47:10.731 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:10.584+0000 7fc5b0210640 1 Processor -- start 2023-12-12T09:47:10.732 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:10.584+0000 7fc5b0210640 1 -- start start 2023-12-12T09:47:10.732 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:10.585+0000 7fc5b0210640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc5a80a4c90 0x7fc5a80a6250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:10.732 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:10.585+0000 7fc5b0210640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc5a80c0320 0x7fc5a813bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:10.732 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:10.585+0000 7fc5b0210640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc5a814ea60 0x7fc5a813f640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:10.732 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:10.585+0000 7fc5b0210640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5a80a5dc0 con 0x7fc5a80a4c90 2023-12-12T09:47:10.732 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:10.585+0000 7fc5b0210640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5a8144450 con 0x7fc5a814ea60 2023-12-12T09:47:10.732 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:10.585+0000 7fc5b0210640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5a813c490 con 0x7fc5a80c0320 2023-12-12T09:47:10.732 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:10.585+0000 7fc5adfac640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc5a80a4c90 0x7fc5a80a6250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:10.732 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:10.586+0000 7fc5adfac640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc5a80a4c90 0x7fc5a80a6250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:54100/0 (socket says 172.21.15.73:54100) 2023-12-12T09:47:10.732 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:10.586+0000 7fc5adfac640 1 -- 172.21.15.73:0/2109038000 learned_addr learned my addr 172.21.15.73:0/2109038000 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:47:10.732 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:10.586+0000 7fc5ad7ab640 1 --2- 172.21.15.73:0/2109038000 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc5a80c0320 0x7fc5a813bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:10.732 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:10.586+0000 7fc5ae7ad640 1 --2- 172.21.15.73:0/2109038000 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc5a814ea60 0x7fc5a813f640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:10.732 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:10.586+0000 7fc5adfac640 1 -- 172.21.15.73:0/2109038000 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc5a80c0320 msgr2=0x7fc5a813bdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:10.732 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:10.586+0000 7fc5adfac640 1 --2- 172.21.15.73:0/2109038000 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc5a80c0320 0x7fc5a813bdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:10.732 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:10.586+0000 7fc5adfac640 1 -- 172.21.15.73:0/2109038000 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc5a814ea60 msgr2=0x7fc5a813f640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:10.732 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:10.586+0000 7fc5adfac640 1 --2- 172.21.15.73:0/2109038000 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc5a814ea60 0x7fc5a813f640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:10.733 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:10.586+0000 7fc5adfac640 1 -- 172.21.15.73:0/2109038000 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc598009400 con 0x7fc5a80a4c90 2023-12-12T09:47:10.733 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:10.586+0000 7fc5ae7ad640 1 --2- 172.21.15.73:0/2109038000 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc5a814ea60 0x7fc5a813f640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:47:10.733 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:10.586+0000 7fc5adfac640 1 --2- 172.21.15.73:0/2109038000 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc5a80a4c90 0x7fc5a80a6250 secure :-1 s=READY pgs=1042 cs=0 l=1 rev1=1 crypto rx=0x7fc5a400c410 tx=0x7fc5a400c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:47:10.733 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:10.587+0000 7fc59e7fc640 1 -- 172.21.15.73:0/2109038000 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5a4005ce0 con 0x7fc5a80a4c90 2023-12-12T09:47:10.733 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:10.587+0000 7fc59e7fc640 1 -- 172.21.15.73:0/2109038000 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5a4005e40 con 0x7fc5a80a4c90 2023-12-12T09:47:10.733 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:10.587+0000 7fc5b0210640 1 -- 172.21.15.73:0/2109038000 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5a8140460 con 0x7fc5a80a4c90 2023-12-12T09:47:10.733 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:10.587+0000 7fc59e7fc640 1 -- 172.21.15.73:0/2109038000 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5a40072f0 con 0x7fc5a80a4c90 2023-12-12T09:47:10.733 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:10.587+0000 7fc5b0210640 1 -- 172.21.15.73:0/2109038000 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5a8140170 con 0x7fc5a80a4c90 2023-12-12T09:47:10.733 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:10.588+0000 7fc5b0210640 1 -- 172.21.15.73:0/2109038000 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc5a8067070 con 0x7fc5a80a4c90 2023-12-12T09:47:10.733 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:10.589+0000 7fc59e7fc640 1 -- 172.21.15.73:0/2109038000 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fc5a4007510 con 0x7fc5a80a4c90 2023-12-12T09:47:10.733 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:10.590+0000 7fc59e7fc640 1 --2- 172.21.15.73:0/2109038000 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fc58c06ae40 0x7fc58c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:10.733 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:10.590+0000 7fc59e7fc640 1 -- 172.21.15.73:0/2109038000 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6623+0+0 (secure 0 0 0) 0x7fc5a4089080 con 0x7fc5a80a4c90 2023-12-12T09:47:10.733 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:10.590+0000 7fc5ad7ab640 1 --2- 172.21.15.73:0/2109038000 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fc58c06ae40 0x7fc58c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:10.733 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:10.591+0000 7fc5ad7ab640 1 --2- 172.21.15.73:0/2109038000 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fc58c06ae40 0x7fc58c06d300 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fc598036000 tx=0x7fc59803d040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:47:10.733 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:10.594+0000 7fc59e7fc640 1 -- 172.21.15.73:0/2109038000 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fc5a40bbe90 con 0x7fc5a80a4c90 2023-12-12T09:47:10.796 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:10.795+0000 7fc5b0210640 1 -- 172.21.15.73:0/2109038000 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fc5a815ec00 con 0x7fc5a80a4c90 2023-12-12T09:47:10.797 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:10.796+0000 7fc59e7fc640 1 -- 172.21.15.73:0/2109038000 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v81) v1 ==== 100+0+11 (secure 0 0 0) 0x7fc5a40170a0 con 0x7fc5a80a4c90 2023-12-12T09:47:10.797 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 64 2023-12-12T09:47:10.800 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:10.799+0000 7fc5b0210640 1 -- 172.21.15.73:0/2109038000 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fc58c06ae40 msgr2=0x7fc58c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:10.800 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:10.799+0000 7fc5b0210640 1 --2- 172.21.15.73:0/2109038000 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fc58c06ae40 0x7fc58c06d300 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fc598036000 tx=0x7fc59803d040 comp rx=0 tx=0).stop 2023-12-12T09:47:10.800 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:10.799+0000 7fc5b0210640 1 -- 172.21.15.73:0/2109038000 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc5a80a4c90 msgr2=0x7fc5a80a6250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:10.800 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:10.799+0000 7fc5b0210640 1 --2- 172.21.15.73:0/2109038000 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc5a80a4c90 0x7fc5a80a6250 secure :-1 s=READY pgs=1042 cs=0 l=1 rev1=1 crypto rx=0x7fc5a400c410 tx=0x7fc5a400c8d0 comp rx=0 tx=0).stop 2023-12-12T09:47:10.800 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:10.799+0000 7fc5b0210640 1 -- 172.21.15.73:0/2109038000 shutdown_connections 2023-12-12T09:47:10.800 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:10.799+0000 7fc5b0210640 1 --2- 172.21.15.73:0/2109038000 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fc58c06ae40 0x7fc58c06d300 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:10.800 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:10.799+0000 7fc5b0210640 1 --2- 172.21.15.73:0/2109038000 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc5a814ea60 0x7fc5a813f640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:10.800 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:10.799+0000 7fc5b0210640 1 --2- 172.21.15.73:0/2109038000 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc5a80c0320 0x7fc5a813bdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:10.800 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:10.799+0000 7fc5b0210640 1 --2- 172.21.15.73:0/2109038000 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc5a80a4c90 0x7fc5a80a6250 unknown :-1 s=CLOSED pgs=1042 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:10.801 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:10.799+0000 7fc5b0210640 1 -- 172.21.15.73:0/2109038000 >> 172.21.15.73:0/2109038000 conn(0x7fc5a806a4e0 msgr2=0x7fc5a80c1030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:47:10.801 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:10.799+0000 7fc5b0210640 1 -- 172.21.15.73:0/2109038000 shutdown_connections 2023-12-12T09:47:10.801 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:10.799+0000 7fc5b0210640 1 -- 172.21.15.73:0/2109038000 wait complete. 2023-12-12T09:47:10.816 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_metadata pg_num 2023-12-12T09:47:11.024 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:11.024+0000 7f3a1af0f640 1 Processor -- start 2023-12-12T09:47:11.025 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:11.024+0000 7f3a1af0f640 1 -- start start 2023-12-12T09:47:11.026 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:11.025+0000 7f3a1af0f640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f3a1406d350 0x7f3a1406dc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:11.026 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:11.025+0000 7f3a1af0f640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a140c16c0 con 0x7f3a1414f8c0 2023-12-12T09:47:11.026 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:11.025+0000 7f3a1af0f640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a140c19a0 con 0x7f3a14152500 2023-12-12T09:47:11.026 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:11.025+0000 7f3a1af0f640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a140c1090 con 0x7f3a1406d350 2023-12-12T09:47:11.026 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:11.026+0000 7f3a13fff640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f3a1406d350 0x7f3a1406dc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:11.026 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:11.026+0000 7f3a18cab640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f3a1414f8c0 0x7f3a14071e60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:54634/0 (socket says 172.21.15.73:54634) 2023-12-12T09:47:11.026 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:11.026+0000 7f3a18cab640 1 -- 172.21.15.73:0/1123736309 learned_addr learned my addr 172.21.15.73:0/1123736309 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-12T09:47:11.027 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:11.026+0000 7f3a13fff640 1 -- 172.21.15.73:0/1123736309 >> v1:172.21.15.142:6789/0 conn(0x7f3a14152500 legacy=0x7f3a14152990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:47:11.027 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:11.026+0000 7f3a13fff640 1 -- 172.21.15.73:0/1123736309 >> v1:172.21.15.73:6789/0 conn(0x7f3a1414f8c0 legacy=0x7f3a14071e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:11.027 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:11.026+0000 7f3a13fff640 1 -- 172.21.15.73:0/1123736309 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a140c1c80 con 0x7f3a1406d350 2023-12-12T09:47:11.027 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:11.026+0000 7f3a137fe640 1 -- 172.21.15.73:0/1123736309 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4158677874 0 0) 0x7f3a140c16c0 con 0x7f3a1414f8c0 2023-12-12T09:47:11.028 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:11.028+0000 7f3a13fff640 1 --2- 172.21.15.73:0/1123736309 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3a1406d350 0x7f3a1406dc40 secure :-1 s=READY pgs=1044 cs=0 l=1 rev1=1 crypto rx=0x7f3a000097a0 tx=0x7f3a0002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d32e3725b1aac62 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:47:11.028 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:11.028+0000 7f3a137fe640 1 -- 172.21.15.73:0/1123736309 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a00031830 con 0x7f3a1406d350 2023-12-12T09:47:11.028 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:11.028+0000 7f3a137fe640 1 -- 172.21.15.73:0/1123736309 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a00031990 con 0x7f3a1406d350 2023-12-12T09:47:11.028 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:11.028+0000 7f3a137fe640 1 -- 172.21.15.73:0/1123736309 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a00031d20 con 0x7f3a1406d350 2023-12-12T09:47:11.029 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:11.028+0000 7f3a1af0f640 1 -- 172.21.15.73:0/1123736309 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3a1406d350 msgr2=0x7f3a1406dc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:11.029 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:11.028+0000 7f3a1af0f640 1 --2- 172.21.15.73:0/1123736309 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3a1406d350 0x7f3a1406dc40 secure :-1 s=READY pgs=1044 cs=0 l=1 rev1=1 crypto rx=0x7f3a000097a0 tx=0x7f3a0002b8d0 comp rx=0 tx=0).stop 2023-12-12T09:47:11.029 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:11.028+0000 7f3a1af0f640 1 -- 172.21.15.73:0/1123736309 shutdown_connections 2023-12-12T09:47:11.029 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:11.029+0000 7f3a1af0f640 1 --2- 172.21.15.73:0/1123736309 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3a1406d350 0x7f3a1406dc40 unknown :-1 s=CLOSED pgs=1044 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:11.030 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:11.029+0000 7f3a1af0f640 1 -- 172.21.15.73:0/1123736309 >> 172.21.15.73:0/1123736309 conn(0x7f3a1406a4e0 msgr2=0x7f3a1406a8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:47:11.030 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:11.029+0000 7f3a1af0f640 1 -- 172.21.15.73:0/1123736309 shutdown_connections 2023-12-12T09:47:11.030 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:11.029+0000 7f3a1af0f640 1 -- 172.21.15.73:0/1123736309 wait complete. 2023-12-12T09:47:11.031 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:11.030+0000 7f3a1af0f640 1 Processor -- start 2023-12-12T09:47:11.031 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:11.030+0000 7f3a1af0f640 1 -- start start 2023-12-12T09:47:11.032 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:11.031+0000 7f3a1af0f640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3a1406d350 0x7f3a1414c130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:11.032 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:11.031+0000 7f3a1af0f640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3a1414f8c0 0x7f3a1414c670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:11.032 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:11.031+0000 7f3a1af0f640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3a14152500 0x7f3a1414a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:11.032 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:11.031+0000 7f3a1af0f640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a1414cbb0 con 0x7f3a1414f8c0 2023-12-12T09:47:11.032 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:11.031+0000 7f3a1af0f640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a14149b60 con 0x7f3a14152500 2023-12-12T09:47:11.033 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:11.031+0000 7f3a1af0f640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a1414a400 con 0x7f3a1406d350 2023-12-12T09:47:11.033 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:11.031+0000 7f3a13fff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3a1414f8c0 0x7f3a1414c670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:11.033 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:11.032+0000 7f3a13fff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3a1414f8c0 0x7f3a1414c670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:54124/0 (socket says 172.21.15.73:54124) 2023-12-12T09:47:11.033 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:11.032+0000 7f3a13fff640 1 -- 172.21.15.73:0/672144720 learned_addr learned my addr 172.21.15.73:0/672144720 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:47:11.033 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:11.032+0000 7f3a13fff640 1 -- 172.21.15.73:0/672144720 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3a1406d350 msgr2=0x7f3a1414c130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:11.033 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:11.032+0000 7f3a13fff640 1 --2- 172.21.15.73:0/672144720 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3a1406d350 0x7f3a1414c130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:11.033 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:11.032+0000 7f3a194ac640 1 --2- 172.21.15.73:0/672144720 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3a14152500 0x7f3a1414a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:11.033 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:11.032+0000 7f3a13fff640 1 -- 172.21.15.73:0/672144720 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3a14152500 msgr2=0x7f3a1414a890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:11.033 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:11.032+0000 7f3a13fff640 1 --2- 172.21.15.73:0/672144720 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3a14152500 0x7f3a1414a890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:11.033 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:11.032+0000 7f3a13fff640 1 -- 172.21.15.73:0/672144720 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a00009400 con 0x7f3a1414f8c0 2023-12-12T09:47:11.034 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:11.032+0000 7f3a13fff640 1 --2- 172.21.15.73:0/672144720 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3a1414f8c0 0x7f3a1414c670 secure :-1 s=READY pgs=1045 cs=0 l=1 rev1=1 crypto rx=0x7f3a000098c0 tx=0x7f3a000046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:47:11.034 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:11.033+0000 7f3a117fa640 1 -- 172.21.15.73:0/672144720 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a0003ba70 con 0x7f3a1414f8c0 2023-12-12T09:47:11.034 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:11.033+0000 7f3a117fa640 1 -- 172.21.15.73:0/672144720 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a0003bbf0 con 0x7f3a1414f8c0 2023-12-12T09:47:11.034 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:11.033+0000 7f3a117fa640 1 -- 172.21.15.73:0/672144720 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a000453f0 con 0x7f3a1414f8c0 2023-12-12T09:47:11.034 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:11.033+0000 7f3a1af0f640 1 -- 172.21.15.73:0/672144720 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a141eac40 con 0x7f3a1414f8c0 2023-12-12T09:47:11.034 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:11.033+0000 7f3a1af0f640 1 -- 172.21.15.73:0/672144720 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a1414a090 con 0x7f3a1414f8c0 2023-12-12T09:47:11.035 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:11.034+0000 7f3a1af0f640 1 -- 172.21.15.73:0/672144720 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a14067070 con 0x7f3a1414f8c0 2023-12-12T09:47:11.035 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:11.035+0000 7f3a117fa640 1 -- 172.21.15.73:0/672144720 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f3a0004e450 con 0x7f3a1414f8c0 2023-12-12T09:47:11.036 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:11.036+0000 7f3a117fa640 1 --2- 172.21.15.73:0/672144720 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f39f806ae40 0x7f39f806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:11.036 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:11.036+0000 7f3a117fa640 1 -- 172.21.15.73:0/672144720 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6623+0+0 (secure 0 0 0) 0x7f3a000abc30 con 0x7f3a1414f8c0 2023-12-12T09:47:11.036 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:11.036+0000 7f3a18cab640 1 --2- 172.21.15.73:0/672144720 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f39f806ae40 0x7f39f806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:11.037 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:11.037+0000 7f3a18cab640 1 --2- 172.21.15.73:0/672144720 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f39f806ae40 0x7f39f806d300 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f3a08007fd0 tx=0x7f3a08007920 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:47:11.040 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:11.040+0000 7f3a117fa640 1 -- 172.21.15.73:0/672144720 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f3a00076940 con 0x7f3a1414f8c0 2023-12-12T09:47:11.234 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:11.233+0000 7f3a1af0f640 1 -- 172.21.15.73:0/672144720 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"} v 0) v1 -- 0x7f3a1414a540 con 0x7f3a1414f8c0 2023-12-12T09:47:11.235 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:11.234+0000 7f3a117fa640 1 -- 172.21.15.73:0/672144720 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"}]=0 v81) v1 ==== 105+0+11 (secure 0 0 0) 0x7f3a00079f60 con 0x7f3a1414f8c0 2023-12-12T09:47:11.236 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 32 2023-12-12T09:47:11.239 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:11.237+0000 7f3a1af0f640 1 -- 172.21.15.73:0/672144720 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f39f806ae40 msgr2=0x7f39f806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:11.239 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:11.237+0000 7f3a1af0f640 1 --2- 172.21.15.73:0/672144720 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f39f806ae40 0x7f39f806d300 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f3a08007fd0 tx=0x7f3a08007920 comp rx=0 tx=0).stop 2023-12-12T09:47:11.239 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:11.237+0000 7f3a1af0f640 1 -- 172.21.15.73:0/672144720 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3a1414f8c0 msgr2=0x7f3a1414c670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:11.239 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:11.237+0000 7f3a1af0f640 1 --2- 172.21.15.73:0/672144720 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3a1414f8c0 0x7f3a1414c670 secure :-1 s=READY pgs=1045 cs=0 l=1 rev1=1 crypto rx=0x7f3a000098c0 tx=0x7f3a000046c0 comp rx=0 tx=0).stop 2023-12-12T09:47:11.239 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:11.237+0000 7f3a1af0f640 1 -- 172.21.15.73:0/672144720 shutdown_connections 2023-12-12T09:47:11.239 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:11.237+0000 7f3a1af0f640 1 --2- 172.21.15.73:0/672144720 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f39f806ae40 0x7f39f806d300 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:11.239 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:11.237+0000 7f3a1af0f640 1 --2- 172.21.15.73:0/672144720 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3a14152500 0x7f3a1414a890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:11.239 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:11.237+0000 7f3a1af0f640 1 --2- 172.21.15.73:0/672144720 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3a1414f8c0 0x7f3a1414c670 unknown :-1 s=CLOSED pgs=1045 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:11.239 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:11.237+0000 7f3a1af0f640 1 --2- 172.21.15.73:0/672144720 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3a1406d350 0x7f3a1414c130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:11.239 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:11.237+0000 7f3a1af0f640 1 -- 172.21.15.73:0/672144720 >> 172.21.15.73:0/672144720 conn(0x7f3a1406a4e0 msgr2=0x7f3a140c59a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:47:11.239 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:11.237+0000 7f3a1af0f640 1 -- 172.21.15.73:0/672144720 shutdown_connections 2023-12-12T09:47:11.240 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:11.237+0000 7f3a1af0f640 1 -- 172.21.15.73:0/672144720 wait complete. 2023-12-12T09:47:11.257 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_data pg_num 2023-12-12T09:47:11.465 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:11.464+0000 7fac0bbde640 1 Processor -- start 2023-12-12T09:47:11.465 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:11.464+0000 7fac0bbde640 1 -- start start 2023-12-12T09:47:11.467 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:11.465+0000 7fac0bbde640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fac0414ea60 0x7fac040c5420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:11.467 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:11.465+0000 7fac0bbde640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fac040c0320 0x7fac040c20b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:11.467 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:11.465+0000 7fac0bbde640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac040c3390 con 0x7fac040a4c90 2023-12-12T09:47:11.467 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:11.465+0000 7fac0bbde640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac040c4b30 con 0x7fac040c0320 2023-12-12T09:47:11.467 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:11.465+0000 7fac0bbde640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac04151e60 con 0x7fac0414ea60 2023-12-12T09:47:11.467 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:11.466+0000 7fac09179640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7fac040a4c90 0x7fac040c4420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:54638/0 (socket says 172.21.15.73:54638) 2023-12-12T09:47:11.467 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:11.466+0000 7fac09179640 1 -- 172.21.15.73:0/400539447 learned_addr learned my addr 172.21.15.73:0/400539447 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-12T09:47:11.469 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:11.466+0000 7fac0997a640 1 --2- 172.21.15.73:0/400539447 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fac0414ea60 0x7fac040c5420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:11.469 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:11.466+0000 7fac08978640 1 -- 172.21.15.73:0/400539447 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 891357319 0 0) 0x7fac040c3390 con 0x7fac040a4c90 2023-12-12T09:47:11.469 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:11.466+0000 7fac0a17b640 1 --2- 172.21.15.73:0/400539447 >> v2:172.21.15.142:3300/0 conn(0x7fac040c0320 0x7fac040c20b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:11.469 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:11.466+0000 7fac08978640 1 -- 172.21.15.73:0/400539447 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fabf0003520 con 0x7fac040a4c90 2023-12-12T09:47:11.469 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:11.466+0000 7fac08978640 1 -- 172.21.15.73:0/400539447 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 166820822 0 0) 0x7fabf0003520 con 0x7fac040a4c90 2023-12-12T09:47:11.469 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:11.466+0000 7fac08978640 1 -- 172.21.15.73:0/400539447 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fac0414ea60 msgr2=0x7fac040c5420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:47:11.469 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:11.466+0000 7fac08978640 1 --2- 172.21.15.73:0/400539447 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fac0414ea60 0x7fac040c5420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:11.470 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:11.466+0000 7fac08978640 1 -- 172.21.15.73:0/400539447 >> v2:172.21.15.142:3300/0 conn(0x7fac040c0320 msgr2=0x7fac040c20b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:47:11.470 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:11.466+0000 7fac08978640 1 --2- 172.21.15.73:0/400539447 >> v2:172.21.15.142:3300/0 conn(0x7fac040c0320 0x7fac040c20b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:11.470 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:11.466+0000 7fac08978640 1 -- 172.21.15.73:0/400539447 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac04152140 con 0x7fac040a4c90 2023-12-12T09:47:11.470 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:11.466+0000 7fac08978640 1 -- 172.21.15.73:0/400539447 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3186547832 0 0) 0x7fabf4001670 con 0x7fac040a4c90 2023-12-12T09:47:11.470 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:11.466+0000 7fac08978640 1 -- 172.21.15.73:0/400539447 >> v1:172.21.15.73:6789/0 conn(0x7fac040a4c90 legacy=0x7fac040c4420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:11.470 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:11.466+0000 7fac08978640 1 --2- 172.21.15.73:0/400539447 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fabf0003970 0x7fabf0003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:11.470 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:11.466+0000 7fac08978640 1 --2- 172.21.15.73:0/400539447 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fac0414ea60 0x7fabf00047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:11.470 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:11.467+0000 7fac08978640 1 --2- 172.21.15.73:0/400539447 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fabf0004d00 0x7fabf0005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:11.470 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:11.467+0000 7fac08978640 1 -- 172.21.15.73:0/400539447 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac040c4b30 con 0x7fabf0004d00 2023-12-12T09:47:11.470 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:11.467+0000 7fac08978640 1 -- 172.21.15.73:0/400539447 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac04151e60 con 0x7fabf0003970 2023-12-12T09:47:11.470 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:11.467+0000 7fac08978640 1 -- 172.21.15.73:0/400539447 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fabf000dcf0 con 0x7fac0414ea60 2023-12-12T09:47:11.470 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:11.467+0000 7fac0a17b640 1 --2- 172.21.15.73:0/400539447 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fabf0004d00 0x7fabf0005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:11.470 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:11.467+0000 7fac0997a640 1 --2- 172.21.15.73:0/400539447 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fabf0003970 0x7fabf0003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:11.471 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:11.467+0000 7fac09179640 1 --2- 172.21.15.73:0/400539447 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fac0414ea60 0x7fabf00047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:11.471 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:11.467+0000 7fac0a17b640 1 -- 172.21.15.73:0/400539447 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fac0414ea60 msgr2=0x7fabf00047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:47:11.471 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:11.467+0000 7fac0a17b640 1 --2- 172.21.15.73:0/400539447 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fac0414ea60 0x7fabf00047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:11.471 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:11.467+0000 7fac0a17b640 1 -- 172.21.15.73:0/400539447 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fabf0003970 msgr2=0x7fabf0003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:47:11.471 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:11.467+0000 7fac0a17b640 1 --2- 172.21.15.73:0/400539447 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fabf0003970 0x7fabf0003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:11.471 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:11.467+0000 7fac0a17b640 1 -- 172.21.15.73:0/400539447 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabf0003520 con 0x7fabf0004d00 2023-12-12T09:47:11.472 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:11.469+0000 7fac0a17b640 1 --2- 172.21.15.73:0/400539447 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fabf0004d00 0x7fabf0005180 secure :-1 s=READY pgs=1047 cs=0 l=1 rev1=1 crypto rx=0x7fabfc007360 tx=0x7fabf00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b40fbc2299d4cf5c server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:47:11.472 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:11.469+0000 7fac08978640 1 -- 172.21.15.73:0/400539447 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabfc02ccf0 con 0x7fabf0004d00 2023-12-12T09:47:11.472 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:11.469+0000 7fac08978640 1 -- 172.21.15.73:0/400539447 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabfc02ce50 con 0x7fabf0004d00 2023-12-12T09:47:11.472 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:11.469+0000 7fac08978640 1 -- 172.21.15.73:0/400539447 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabfc034660 con 0x7fabf0004d00 2023-12-12T09:47:11.472 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:11.469+0000 7fac0bbde640 1 -- 172.21.15.73:0/400539447 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fabf0004d00 msgr2=0x7fabf0005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:11.472 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:11.469+0000 7fac0bbde640 1 --2- 172.21.15.73:0/400539447 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fabf0004d00 0x7fabf0005180 secure :-1 s=READY pgs=1047 cs=0 l=1 rev1=1 crypto rx=0x7fabfc007360 tx=0x7fabf00057f0 comp rx=0 tx=0).stop 2023-12-12T09:47:11.472 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:11.469+0000 7fac0a17b640 1 -- 172.21.15.73:0/400539447 reap_dead start 2023-12-12T09:47:11.473 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:11.469+0000 7fac0bbde640 1 -- 172.21.15.73:0/400539447 shutdown_connections 2023-12-12T09:47:11.473 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:11.469+0000 7fac0bbde640 1 -- 172.21.15.73:0/400539447 >> 172.21.15.73:0/400539447 conn(0x7fac0406a4e0 msgr2=0x7fac0406a8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:47:11.473 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:11.469+0000 7fac0bbde640 1 -- 172.21.15.73:0/400539447 shutdown_connections 2023-12-12T09:47:11.473 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:11.470+0000 7fac0bbde640 1 -- 172.21.15.73:0/400539447 wait complete. 2023-12-12T09:47:11.474 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:11.471+0000 7fac0bbde640 1 Processor -- start 2023-12-12T09:47:11.474 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:11.471+0000 7fac0bbde640 1 -- start start 2023-12-12T09:47:11.474 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:11.472+0000 7fac0bbde640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fabf0004d00 0x7fac04154f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:11.475 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:11.472+0000 7fac0bbde640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fac040a9a90 0x7fac040ab1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:11.475 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:11.472+0000 7fac0bbde640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fac041ed610 0x7fac041eda90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:11.475 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:11.472+0000 7fac0bbde640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac040c23c0 con 0x7fabf0004d00 2023-12-12T09:47:11.475 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:11.472+0000 7fac0bbde640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac041ed180 con 0x7fac040a9a90 2023-12-12T09:47:11.475 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:11.472+0000 7fac0bbde640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac040c1880 con 0x7fac041ed610 2023-12-12T09:47:11.475 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:11.472+0000 7fac0997a640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fabf0004d00 0x7fac04154f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:11.475 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:11.473+0000 7fac0997a640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fabf0004d00 0x7fac04154f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:54130/0 (socket says 172.21.15.73:54130) 2023-12-12T09:47:11.475 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:11.473+0000 7fac0997a640 1 -- 172.21.15.73:0/266779377 learned_addr learned my addr 172.21.15.73:0/266779377 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:47:11.475 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:11.473+0000 7fac0997a640 1 -- 172.21.15.73:0/266779377 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fac041ed610 msgr2=0x7fac041eda90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:11.475 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:11.473+0000 7fac0997a640 1 --2- 172.21.15.73:0/266779377 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fac041ed610 0x7fac041eda90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:11.475 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:11.473+0000 7fac0997a640 1 -- 172.21.15.73:0/266779377 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fac040a9a90 msgr2=0x7fac040ab1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:11.475 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:11.473+0000 7fac0997a640 1 --2- 172.21.15.73:0/266779377 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fac040a9a90 0x7fac040ab1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:11.475 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:11.473+0000 7fac0997a640 1 -- 172.21.15.73:0/266779377 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac040c1b20 con 0x7fabf0004d00 2023-12-12T09:47:11.475 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:11.473+0000 7fac0997a640 1 --2- 172.21.15.73:0/266779377 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fabf0004d00 0x7fac04154f90 secure :-1 s=READY pgs=1048 cs=0 l=1 rev1=1 crypto rx=0x7fac0000f580 tx=0x7fac0000fa40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:47:11.476 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:11.473+0000 7fabfa7fc640 1 -- 172.21.15.73:0/266779377 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac00013810 con 0x7fabf0004d00 2023-12-12T09:47:11.476 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:11.473+0000 7fabfa7fc640 1 -- 172.21.15.73:0/266779377 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac00013970 con 0x7fabf0004d00 2023-12-12T09:47:11.476 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:11.473+0000 7fabfa7fc640 1 -- 172.21.15.73:0/266779377 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac00013ce0 con 0x7fabf0004d00 2023-12-12T09:47:11.476 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:11.473+0000 7fac0bbde640 1 -- 172.21.15.73:0/266779377 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac040c1e00 con 0x7fabf0004d00 2023-12-12T09:47:11.476 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:11.474+0000 7fac0bbde640 1 -- 172.21.15.73:0/266779377 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac041554d0 con 0x7fabf0004d00 2023-12-12T09:47:11.477 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:11.475+0000 7fac0bbde640 1 -- 172.21.15.73:0/266779377 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac04067070 con 0x7fabf0004d00 2023-12-12T09:47:11.477 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:11.475+0000 7fabfa7fc640 1 -- 172.21.15.73:0/266779377 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fac0001f460 con 0x7fabf0004d00 2023-12-12T09:47:11.478 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:11.476+0000 7fabfa7fc640 1 --2- 172.21.15.73:0/266779377 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fabe806ae40 0x7fabe806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:11.478 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:11.476+0000 7fabfa7fc640 1 -- 172.21.15.73:0/266779377 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6623+0+0 (secure 0 0 0) 0x7fac00089cc0 con 0x7fabf0004d00 2023-12-12T09:47:11.478 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:11.477+0000 7fac09179640 1 --2- 172.21.15.73:0/266779377 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fabe806ae40 0x7fabe806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:11.478 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:11.477+0000 7fac09179640 1 --2- 172.21.15.73:0/266779377 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fabe806ae40 0x7fabe806d300 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fabf4001cf0 tx=0x7fabf4001c80 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:47:11.482 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:11.481+0000 7fabfa7fc640 1 -- 172.21.15.73:0/266779377 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fac000549f0 con 0x7fabf0004d00 2023-12-12T09:47:11.673 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:11.671+0000 7fac0bbde640 1 -- 172.21.15.73:0/266779377 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"} v 0) v1 -- 0x7fac041ecf50 con 0x7fabf0004d00 2023-12-12T09:47:11.674 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:11.672+0000 7fabfa7fc640 1 -- 172.21.15.73:0/266779377 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"}]=0 v81) v1 ==== 101+0+11 (secure 0 0 0) 0x7fac00058010 con 0x7fabf0004d00 2023-12-12T09:47:11.674 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 64 2023-12-12T09:47:11.677 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:11.675+0000 7fac0bbde640 1 -- 172.21.15.73:0/266779377 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fabe806ae40 msgr2=0x7fabe806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:11.677 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:11.675+0000 7fac0bbde640 1 --2- 172.21.15.73:0/266779377 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fabe806ae40 0x7fabe806d300 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fabf4001cf0 tx=0x7fabf4001c80 comp rx=0 tx=0).stop 2023-12-12T09:47:11.677 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:11.675+0000 7fac0bbde640 1 -- 172.21.15.73:0/266779377 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fabf0004d00 msgr2=0x7fac04154f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:11.677 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:11.675+0000 7fac0bbde640 1 --2- 172.21.15.73:0/266779377 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fabf0004d00 0x7fac04154f90 secure :-1 s=READY pgs=1048 cs=0 l=1 rev1=1 crypto rx=0x7fac0000f580 tx=0x7fac0000fa40 comp rx=0 tx=0).stop 2023-12-12T09:47:11.677 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:11.675+0000 7fac0bbde640 1 -- 172.21.15.73:0/266779377 shutdown_connections 2023-12-12T09:47:11.677 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:11.675+0000 7fac0bbde640 1 --2- 172.21.15.73:0/266779377 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fabe806ae40 0x7fabe806d300 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:11.677 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:11.675+0000 7fac0bbde640 1 --2- 172.21.15.73:0/266779377 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fac041ed610 0x7fac041eda90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:11.677 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:11.675+0000 7fac0bbde640 1 --2- 172.21.15.73:0/266779377 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fac040a9a90 0x7fac040ab1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:11.677 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:11.675+0000 7fac0bbde640 1 --2- 172.21.15.73:0/266779377 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fabf0004d00 0x7fac04154f90 unknown :-1 s=CLOSED pgs=1048 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:11.678 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:11.675+0000 7fac0bbde640 1 -- 172.21.15.73:0/266779377 >> 172.21.15.73:0/266779377 conn(0x7fac0406a4e0 msgr2=0x7fac0406d0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:47:11.678 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:11.676+0000 7fac0bbde640 1 -- 172.21.15.73:0/266779377 shutdown_connections 2023-12-12T09:47:11.678 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:11.676+0000 7fac0bbde640 1 -- 172.21.15.73:0/266779377 wait complete. 2023-12-12T09:47:11.696 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-12T09:47:11.910 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:11.908+0000 7f364a143640 1 Processor -- start 2023-12-12T09:47:11.910 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:11.908+0000 7f364a143640 1 -- start start 2023-12-12T09:47:11.912 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:11.910+0000 7f364a143640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f364406ee40 0x7f36441587a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:11.912 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:11.910+0000 7f364a143640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f36440c28c0 0x7f36440c2d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:11.912 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:11.910+0000 7f364a143640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36440c1e90 con 0x7f3644155480 2023-12-12T09:47:11.912 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:11.910+0000 7f364a143640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3644071180 con 0x7f36440c28c0 2023-12-12T09:47:11.912 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:11.910+0000 7f364a143640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3644158ce0 con 0x7f364406ee40 2023-12-12T09:47:11.912 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:11.910+0000 7f3643fff640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f36440c28c0 0x7f36440c2d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:11.912 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:11.910+0000 7f36437fe640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f3644155480 0x7f364406a4e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:54652/0 (socket says 172.21.15.73:54652) 2023-12-12T09:47:11.912 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:11.910+0000 7f36437fe640 1 -- 172.21.15.73:0/338159961 learned_addr learned my addr 172.21.15.73:0/338159961 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-12T09:47:11.913 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:11.911+0000 7f3643fff640 1 -- 172.21.15.73:0/338159961 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f364406ee40 msgr2=0x7f36441587a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:47:11.913 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:11.911+0000 7f3642ffd640 1 --2- 172.21.15.73:0/338159961 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f364406ee40 0x7f36441587a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:11.913 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:11.911+0000 7f3643fff640 1 --2- 172.21.15.73:0/338159961 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f364406ee40 0x7f36441587a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:11.913 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:11.911+0000 7f3643fff640 1 -- 172.21.15.73:0/338159961 >> v1:172.21.15.73:6789/0 conn(0x7f3644155480 legacy=0x7f364406a4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:11.913 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:11.911+0000 7f3643fff640 1 -- 172.21.15.73:0/338159961 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36440c2430 con 0x7f36440c28c0 2023-12-12T09:47:11.913 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:11.911+0000 7f36427fc640 1 -- 172.21.15.73:0/338159961 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4015366082 0 0) 0x7f36440c1e90 con 0x7f3644155480 2023-12-12T09:47:11.913 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:11.911+0000 7f3642ffd640 1 --2- 172.21.15.73:0/338159961 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f364406ee40 0x7f36441587a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:47:11.914 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:11.912+0000 7f3643fff640 1 --2- 172.21.15.73:0/338159961 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f36440c28c0 0x7f36440c2d50 secure :-1 s=READY pgs=1050 cs=0 l=1 rev1=1 crypto rx=0x7f363c009d90 tx=0x7f363c02bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bdce06e94b1a4be1 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:47:11.914 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:11.912+0000 7f36427fc640 1 -- 172.21.15.73:0/338159961 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f363c02cc50 con 0x7f36440c28c0 2023-12-12T09:47:11.914 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:11.912+0000 7f36427fc640 1 -- 172.21.15.73:0/338159961 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f363c02cdb0 con 0x7f36440c28c0 2023-12-12T09:47:11.915 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:11.912+0000 7f36427fc640 1 -- 172.21.15.73:0/338159961 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f363c034660 con 0x7f36440c28c0 2023-12-12T09:47:11.915 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:11.913+0000 7f364a143640 1 -- 172.21.15.73:0/338159961 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f36440c28c0 msgr2=0x7f36440c2d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:11.915 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:11.913+0000 7f364a143640 1 --2- 172.21.15.73:0/338159961 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f36440c28c0 0x7f36440c2d50 secure :-1 s=READY pgs=1050 cs=0 l=1 rev1=1 crypto rx=0x7f363c009d90 tx=0x7f363c02bea0 comp rx=0 tx=0).stop 2023-12-12T09:47:11.915 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:11.913+0000 7f364a143640 1 -- 172.21.15.73:0/338159961 shutdown_connections 2023-12-12T09:47:11.915 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:11.913+0000 7f364a143640 1 --2- 172.21.15.73:0/338159961 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f364406ee40 0x7f36441587a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:11.915 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:11.913+0000 7f364a143640 1 --2- 172.21.15.73:0/338159961 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f36440c28c0 0x7f36440c2d50 unknown :-1 s=CLOSED pgs=1050 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:11.915 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:11.913+0000 7f364a143640 1 -- 172.21.15.73:0/338159961 >> 172.21.15.73:0/338159961 conn(0x7f36440c35d0 msgr2=0x7f36440c39b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:47:11.915 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:11.913+0000 7f364a143640 1 -- 172.21.15.73:0/338159961 shutdown_connections 2023-12-12T09:47:11.915 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:11.913+0000 7f364a143640 1 -- 172.21.15.73:0/338159961 wait complete. 2023-12-12T09:47:11.916 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:11.914+0000 7f364a143640 1 Processor -- start 2023-12-12T09:47:11.916 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:11.915+0000 7f364a143640 1 -- start start 2023-12-12T09:47:11.918 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:11.915+0000 7f364a143640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f364406ee40 0x7f364406e2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:11.918 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:11.915+0000 7f364a143640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f36440c28c0 0x7f36441585a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:11.918 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:11.915+0000 7f364a143640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3644155480 0x7f36441edf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:11.918 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:11.915+0000 7f364a143640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3644158ae0 con 0x7f3644155480 2023-12-12T09:47:11.918 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:11.916+0000 7f364a143640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36441ee460 con 0x7f36440c28c0 2023-12-12T09:47:11.918 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:11.916+0000 7f364a143640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f364406e8f0 con 0x7f364406ee40 2023-12-12T09:47:11.918 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:11.916+0000 7f3643fff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3644155480 0x7f36441edf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:11.918 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:11.916+0000 7f3643fff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3644155480 0x7f36441edf20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:54158/0 (socket says 172.21.15.73:54158) 2023-12-12T09:47:11.918 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:11.916+0000 7f3643fff640 1 -- 172.21.15.73:0/3760744101 learned_addr learned my addr 172.21.15.73:0/3760744101 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:47:11.918 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:11.916+0000 7f3643fff640 1 -- 172.21.15.73:0/3760744101 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f364406ee40 msgr2=0x7f364406e2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:11.918 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:11.916+0000 7f3643fff640 1 --2- 172.21.15.73:0/3760744101 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f364406ee40 0x7f364406e2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:11.919 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:11.916+0000 7f3643fff640 1 -- 172.21.15.73:0/3760744101 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f36440c28c0 msgr2=0x7f36441585a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:11.919 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:11.916+0000 7f3643fff640 1 --2- 172.21.15.73:0/3760744101 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f36440c28c0 0x7f36441585a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:11.919 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:11.916+0000 7f3643fff640 1 -- 172.21.15.73:0/3760744101 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f363c009a70 con 0x7f3644155480 2023-12-12T09:47:11.919 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:11.917+0000 7f3643fff640 1 --2- 172.21.15.73:0/3760744101 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3644155480 0x7f36441edf20 secure :-1 s=READY pgs=1051 cs=0 l=1 rev1=1 crypto rx=0x7f363c009d90 tx=0x7f363c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:47:11.920 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:11.917+0000 7f362bfff640 1 -- 172.21.15.73:0/3760744101 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f363c040650 con 0x7f3644155480 2023-12-12T09:47:11.920 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:11.917+0000 7f362bfff640 1 -- 172.21.15.73:0/3760744101 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f363c0407b0 con 0x7f3644155480 2023-12-12T09:47:11.920 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:11.917+0000 7f362bfff640 1 -- 172.21.15.73:0/3760744101 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f363c040b60 con 0x7f3644155480 2023-12-12T09:47:11.920 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:11.917+0000 7f364a143640 1 -- 172.21.15.73:0/3760744101 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f364406ebd0 con 0x7f3644155480 2023-12-12T09:47:11.920 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:11.917+0000 7f364a143640 1 -- 172.21.15.73:0/3760744101 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3644157da0 con 0x7f3644155480 2023-12-12T09:47:11.920 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:11.918+0000 7f364a143640 1 -- 172.21.15.73:0/3760744101 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3644067580 con 0x7f3644155480 2023-12-12T09:47:11.920 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:11.919+0000 7f362bfff640 1 -- 172.21.15.73:0/3760744101 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f363c040cc0 con 0x7f3644155480 2023-12-12T09:47:11.921 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:11.920+0000 7f362bfff640 1 --2- 172.21.15.73:0/3760744101 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f363006ae40 0x7f363006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:11.922 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:11.920+0000 7f362bfff640 1 -- 172.21.15.73:0/3760744101 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6623+0+0 (secure 0 0 0) 0x7f363c0ac7a0 con 0x7f3644155480 2023-12-12T09:47:11.922 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:11.920+0000 7f36437fe640 1 --2- 172.21.15.73:0/3760744101 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f363006ae40 0x7f363006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:11.922 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:11.921+0000 7f36437fe640 1 --2- 172.21.15.73:0/3760744101 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f363006ae40 0x7f363006d300 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f3634007fd0 tx=0x7f3634007960 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:47:11.926 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:11.924+0000 7f362bfff640 1 -- 172.21.15.73:0/3760744101 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f363c0774b0 con 0x7f3644155480 2023-12-12T09:47:12.126 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:12.125+0000 7f364a143640 1 -- 172.21.15.73:0/3760744101 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f3644071350 con 0x7f3644155480 2023-12-12T09:47:12.127 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:12.126+0000 7f362bfff640 1 -- 172.21.15.73:0/3760744101 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v81) v1 ==== 80+0+0 (secure 0 0 0) 0x7f363c07aad0 con 0x7f3644155480 2023-12-12T09:47:12.127 INFO:teuthology.orchestra.run.smithi073.stderr:listed 0 entries 2023-12-12T09:47:12.131 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:12.128+0000 7f364a143640 1 -- 172.21.15.73:0/3760744101 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f363006ae40 msgr2=0x7f363006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:12.131 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:12.129+0000 7f364a143640 1 --2- 172.21.15.73:0/3760744101 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f363006ae40 0x7f363006d300 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f3634007fd0 tx=0x7f3634007960 comp rx=0 tx=0).stop 2023-12-12T09:47:12.131 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:12.129+0000 7f364a143640 1 -- 172.21.15.73:0/3760744101 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3644155480 msgr2=0x7f36441edf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:12.131 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:12.129+0000 7f364a143640 1 --2- 172.21.15.73:0/3760744101 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3644155480 0x7f36441edf20 secure :-1 s=READY pgs=1051 cs=0 l=1 rev1=1 crypto rx=0x7f363c009d90 tx=0x7f363c004a40 comp rx=0 tx=0).stop 2023-12-12T09:47:12.131 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:12.129+0000 7f364a143640 1 -- 172.21.15.73:0/3760744101 shutdown_connections 2023-12-12T09:47:12.131 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:12.129+0000 7f364a143640 1 --2- 172.21.15.73:0/3760744101 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f363006ae40 0x7f363006d300 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:12.131 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:12.129+0000 7f364a143640 1 --2- 172.21.15.73:0/3760744101 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3644155480 0x7f36441edf20 unknown :-1 s=CLOSED pgs=1051 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:12.131 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:12.129+0000 7f364a143640 1 --2- 172.21.15.73:0/3760744101 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f36440c28c0 0x7f36441585a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:12.131 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:12.129+0000 7f364a143640 1 --2- 172.21.15.73:0/3760744101 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f364406ee40 0x7f364406e2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:12.131 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:12.129+0000 7f364a143640 1 -- 172.21.15.73:0/3760744101 >> 172.21.15.73:0/3760744101 conn(0x7f36440c35d0 msgr2=0x7f36441547a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:47:12.131 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:12.129+0000 7f364a143640 1 -- 172.21.15.73:0/3760744101 shutdown_connections 2023-12-12T09:47:12.132 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:12.129+0000 7f364a143640 1 -- 172.21.15.73:0/3760744101 wait complete. 2023-12-12T09:47:12.148 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.testuser... 2023-12-12T09:47:12.148 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T09:47:12.149 DEBUG:teuthology.orchestra.run.smithi142:> sudo umount /home/ubuntu/cephtest/mnt.1 2023-12-12T09:47:12.260 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi142.front.sepia.ceph.com 2023-12-12T09:47:12.261 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T09:47:12.261 DEBUG:teuthology.orchestra.run.smithi142:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-12-12T09:47:12.313 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-12-12T09:47:12.313 DEBUG:teuthology.orchestra.run.smithi073:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-12T09:47:12.431 DEBUG:teuthology.orchestra.run.smithi142:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-12T09:47:12.550 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-12-12T09:47:12.551 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2023-12-12T09:47:12.551 DEBUG:teuthology.orchestra.run.smithi073:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-12T09:47:12.610 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054284,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498800k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249396k,nr_inodes=812349,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498800k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 2023-12-12T09:47:12.611 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2023-12-12T09:47:12.611 DEBUG:teuthology.orchestra.run.smithi142:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-12T09:47:12.669 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054289,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498808k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249400k,nr_inodes=812350,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498808k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 2023-12-12T09:47:12.669 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-12T09:47:12.890 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:12.888+0000 7f2253c23640 1 Processor -- start 2023-12-12T09:47:12.890 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:12.888+0000 7f2253c23640 1 -- start start 2023-12-12T09:47:12.891 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:12.890+0000 7f2253c23640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f224c06db70 0x7f224c0c39b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:12.892 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:12.890+0000 7f2253c23640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f224c0c5070 0x7f224c0c3ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:12.892 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:12.890+0000 7f2253c23640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f224c152610 con 0x7f224c14fa40 2023-12-12T09:47:12.892 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:12.890+0000 7f2253c23640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f224c1528f0 con 0x7f224c0c5070 2023-12-12T09:47:12.892 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:12.890+0000 7f2253c23640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f224c152bd0 con 0x7f224c06db70 2023-12-12T09:47:12.892 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:12.890+0000 7f22519bf640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f224c14fa40 0x7f224c06a4e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:54660/0 (socket says 172.21.15.73:54660) 2023-12-12T09:47:12.892 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:12.890+0000 7f22519bf640 1 -- 172.21.15.73:0/3771904572 learned_addr learned my addr 172.21.15.73:0/3771904572 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-12T09:47:12.892 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:12.890+0000 7f22521c0640 1 --2- 172.21.15.73:0/3771904572 >> v2:172.21.15.73:3300/0 conn(0x7f224c0c5070 0x7f224c0c3ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:12.893 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:12.891+0000 7f22511be640 1 --2- 172.21.15.73:0/3771904572 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f224c06db70 0x7f224c0c39b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:12.893 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:12.891+0000 7f22521c0640 1 -- 172.21.15.73:0/3771904572 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f224c06db70 msgr2=0x7f224c0c39b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:47:12.893 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:12.891+0000 7f22521c0640 1 --2- 172.21.15.73:0/3771904572 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f224c06db70 0x7f224c0c39b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:12.893 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:12.891+0000 7f22521c0640 1 -- 172.21.15.73:0/3771904572 >> v1:172.21.15.73:6789/0 conn(0x7f224c14fa40 legacy=0x7f224c06a4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:12.893 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:12.891+0000 7f22509bd640 1 -- 172.21.15.73:0/3771904572 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2710446949 0 0) 0x7f224c152610 con 0x7f224c14fa40 2023-12-12T09:47:12.893 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:12.891+0000 7f22521c0640 1 -- 172.21.15.73:0/3771904572 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f224c152eb0 con 0x7f224c0c5070 2023-12-12T09:47:12.893 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:12.892+0000 7f22521c0640 1 --2- 172.21.15.73:0/3771904572 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f224c0c5070 0x7f224c0c3ef0 secure :-1 s=READY pgs=1053 cs=0 l=1 rev1=1 crypto rx=0x7f2244009d90 tx=0x7f224402bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=236462f699a9a81 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:47:12.894 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:12.892+0000 7f22509bd640 1 -- 172.21.15.73:0/3771904572 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f224402cc50 con 0x7f224c0c5070 2023-12-12T09:47:12.894 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:12.893+0000 7f22509bd640 1 -- 172.21.15.73:0/3771904572 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f224402cdb0 con 0x7f224c0c5070 2023-12-12T09:47:12.894 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:12.893+0000 7f22509bd640 1 -- 172.21.15.73:0/3771904572 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2244034660 con 0x7f224c0c5070 2023-12-12T09:47:12.895 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:12.893+0000 7f2253c23640 1 -- 172.21.15.73:0/3771904572 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f224c0c5070 msgr2=0x7f224c0c3ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:12.895 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:12.893+0000 7f2253c23640 1 --2- 172.21.15.73:0/3771904572 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f224c0c5070 0x7f224c0c3ef0 secure :-1 s=READY pgs=1053 cs=0 l=1 rev1=1 crypto rx=0x7f2244009d90 tx=0x7f224402bea0 comp rx=0 tx=0).stop 2023-12-12T09:47:12.895 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:12.893+0000 7f2253c23640 1 -- 172.21.15.73:0/3771904572 shutdown_connections 2023-12-12T09:47:12.895 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:12.893+0000 7f2253c23640 1 --2- 172.21.15.73:0/3771904572 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f224c06db70 0x7f224c0c39b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:12.895 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:12.893+0000 7f2253c23640 1 --2- 172.21.15.73:0/3771904572 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f224c0c5070 0x7f224c0c3ef0 unknown :-1 s=CLOSED pgs=1053 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:12.895 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:12.893+0000 7f2253c23640 1 -- 172.21.15.73:0/3771904572 >> 172.21.15.73:0/3771904572 conn(0x7f224c0a8130 msgr2=0x7f224c0c24b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:47:12.895 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:12.893+0000 7f2253c23640 1 -- 172.21.15.73:0/3771904572 shutdown_connections 2023-12-12T09:47:12.895 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:12.893+0000 7f2253c23640 1 -- 172.21.15.73:0/3771904572 wait complete. 2023-12-12T09:47:12.897 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:12.896+0000 7f2253c23640 1 Processor -- start 2023-12-12T09:47:12.897 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:12.896+0000 7f2253c23640 1 -- start start 2023-12-12T09:47:12.899 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:12.897+0000 7f2253c23640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f224c06db70 0x7f224c0a9f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:12.899 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:12.897+0000 7f2253c23640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f224c0c5070 0x7f224c150440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:12.899 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:12.897+0000 7f2253c23640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f224c14fa40 0x7f224c14ce60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:12.899 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:12.897+0000 7f2253c23640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f224c1ed6f0 con 0x7f224c14fa40 2023-12-12T09:47:12.899 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:12.897+0000 7f2253c23640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f224c0aa9c0 con 0x7f224c0c5070 2023-12-12T09:47:12.899 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:12.897+0000 7f2253c23640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f224c1d85f0 con 0x7f224c06db70 2023-12-12T09:47:12.899 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:12.898+0000 7f22521c0640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f224c14fa40 0x7f224c14ce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:12.899 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:12.898+0000 7f22521c0640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f224c14fa40 0x7f224c14ce60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:54178/0 (socket says 172.21.15.73:54178) 2023-12-12T09:47:12.900 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:12.898+0000 7f22521c0640 1 -- 172.21.15.73:0/173729445 learned_addr learned my addr 172.21.15.73:0/173729445 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:47:12.901 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:12.898+0000 7f22511be640 1 --2- 172.21.15.73:0/173729445 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f224c0c5070 0x7f224c150440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:12.901 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:12.898+0000 7f22519bf640 1 --2- 172.21.15.73:0/173729445 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f224c06db70 0x7f224c0a9f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:12.901 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:12.898+0000 7f22521c0640 1 -- 172.21.15.73:0/173729445 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f224c06db70 msgr2=0x7f224c0a9f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:12.901 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:12.898+0000 7f22521c0640 1 --2- 172.21.15.73:0/173729445 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f224c06db70 0x7f224c0a9f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:12.901 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:12.898+0000 7f22521c0640 1 -- 172.21.15.73:0/173729445 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f224c0c5070 msgr2=0x7f224c150440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:12.901 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:12.898+0000 7f22521c0640 1 --2- 172.21.15.73:0/173729445 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f224c0c5070 0x7f224c150440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:12.901 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:12.898+0000 7f22521c0640 1 -- 172.21.15.73:0/173729445 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2244009a70 con 0x7f224c14fa40 2023-12-12T09:47:12.901 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:12.898+0000 7f22511be640 1 --2- 172.21.15.73:0/173729445 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f224c0c5070 0x7f224c150440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:47:12.901 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:12.898+0000 7f22521c0640 1 --2- 172.21.15.73:0/173729445 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f224c14fa40 0x7f224c14ce60 secure :-1 s=READY pgs=1054 cs=0 l=1 rev1=1 crypto rx=0x7f2244009d90 tx=0x7f2244004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:47:12.901 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:12.899+0000 7f22427fc640 1 -- 172.21.15.73:0/173729445 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2244040650 con 0x7f224c14fa40 2023-12-12T09:47:12.901 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:12.899+0000 7f22427fc640 1 -- 172.21.15.73:0/173729445 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22440407d0 con 0x7f224c14fa40 2023-12-12T09:47:12.902 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:12.899+0000 7f2253c23640 1 -- 172.21.15.73:0/173729445 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f224c1d88d0 con 0x7f224c14fa40 2023-12-12T09:47:12.902 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:12.899+0000 7f22427fc640 1 -- 172.21.15.73:0/173729445 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2244040b80 con 0x7f224c14fa40 2023-12-12T09:47:12.902 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:12.899+0000 7f2253c23640 1 -- 172.21.15.73:0/173729445 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f224c0aa490 con 0x7f224c14fa40 2023-12-12T09:47:12.902 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:12.900+0000 7f2253c23640 1 -- 172.21.15.73:0/173729445 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f224c1d9090 con 0x7f224c14fa40 2023-12-12T09:47:12.902 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:12.901+0000 7f22427fc640 1 -- 172.21.15.73:0/173729445 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f2244040ce0 con 0x7f224c14fa40 2023-12-12T09:47:12.903 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:12.902+0000 7f22427fc640 1 --2- 172.21.15.73:0/173729445 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f223006ae70 0x7f223006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:12.903 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:12.902+0000 7f22427fc640 1 -- 172.21.15.73:0/173729445 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6623+0+0 (secure 0 0 0) 0x7f22440ac6e0 con 0x7f224c14fa40 2023-12-12T09:47:12.903 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:12.902+0000 7f22519bf640 1 --2- 172.21.15.73:0/173729445 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f223006ae70 0x7f223006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:12.904 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:12.903+0000 7f22519bf640 1 --2- 172.21.15.73:0/173729445 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f223006ae70 0x7f223006d330 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f2248000f60 tx=0x7f2248009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:47:12.908 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:12.907+0000 7f22427fc640 1 -- 172.21.15.73:0/173729445 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f224c1d9090 con 0x7f224c14fa40 2023-12-12T09:47:13.134 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:13.133+0000 7f2253c23640 1 -- 172.21.15.73:0/173729445 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f224c1d9090 con 0x7f224c14fa40 2023-12-12T09:47:13.135 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:13.134+0000 7f22427fc640 1 -- 172.21.15.73:0/173729445 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 49 v49) v1 ==== 94+0+6137 (secure 0 0 0) 0x7f224c1d9090 con 0x7f224c14fa40 2023-12-12T09:47:13.136 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-12T09:47:13.136 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":49,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4943,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6835/3004685650","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6833","nonce":3004685650},{"type":"v1","addr":"172.21.15.142:6835","nonce":3004685650}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40},{"gid":5365,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6834/3290362874","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6832","nonce":3290362874},{"type":"v1","addr":"172.21.15.142:6834","nonce":3290362874}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40}],"filesystems":[{"mdsmap":{"epoch":44,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-12T09:46:26.429627+0000","modified":"2023-12-12T09:46:29.788335+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6429},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6429":{"gid":6429,"name":"c","rank":0,"incarnation":41,"state":"up:active","state_seq":3,"addr":"172.21.15.73:6837/2352791649","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6835","nonce":2352791649},{"type":"v1","addr":"172.21.15.73:6837","nonce":2352791649}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6},{"mdsmap":{"epoch":49,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-12T09:46:41.791760+0000","modified":"2023-12-12T09:46:44.861785+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6426},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6426":{"gid":6426,"name":"a","rank":0,"incarnation":45,"state":"up:active","state_seq":7,"addr":"172.21.15.73:6836/340095591","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":340095591},{"type":"v1","addr":"172.21.15.73:6836","nonce":340095591}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2023-12-12T09:47:13.136 INFO:teuthology.orchestra.run.smithi073.stderr:dumped fsmap epoch 49 2023-12-12T09:47:13.138 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:13.136+0000 7f2253c23640 1 -- 172.21.15.73:0/173729445 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f223006ae70 msgr2=0x7f223006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:13.138 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:13.136+0000 7f2253c23640 1 --2- 172.21.15.73:0/173729445 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f223006ae70 0x7f223006d330 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f2248000f60 tx=0x7f2248009040 comp rx=0 tx=0).stop 2023-12-12T09:47:13.138 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:13.136+0000 7f2253c23640 1 -- 172.21.15.73:0/173729445 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f224c14fa40 msgr2=0x7f224c14ce60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:13.138 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:13.136+0000 7f2253c23640 1 --2- 172.21.15.73:0/173729445 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f224c14fa40 0x7f224c14ce60 secure :-1 s=READY pgs=1054 cs=0 l=1 rev1=1 crypto rx=0x7f2244009d90 tx=0x7f2244004a40 comp rx=0 tx=0).stop 2023-12-12T09:47:13.138 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:13.136+0000 7f2253c23640 1 -- 172.21.15.73:0/173729445 shutdown_connections 2023-12-12T09:47:13.138 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:13.136+0000 7f2253c23640 1 --2- 172.21.15.73:0/173729445 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f223006ae70 0x7f223006d330 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:13.138 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:13.136+0000 7f2253c23640 1 --2- 172.21.15.73:0/173729445 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f224c14fa40 0x7f224c14ce60 unknown :-1 s=CLOSED pgs=1054 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:13.139 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:13.136+0000 7f2253c23640 1 --2- 172.21.15.73:0/173729445 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f224c0c5070 0x7f224c150440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:13.139 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:13.136+0000 7f2253c23640 1 --2- 172.21.15.73:0/173729445 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f224c06db70 0x7f224c0a9f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:13.139 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:13.136+0000 7f2253c23640 1 -- 172.21.15.73:0/173729445 >> 172.21.15.73:0/173729445 conn(0x7f224c0a8130 msgr2=0x7f224c0c1f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:47:13.139 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:13.136+0000 7f2253c23640 1 -- 172.21.15.73:0/173729445 shutdown_connections 2023-12-12T09:47:13.139 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:13.137+0000 7f2253c23640 1 -- 172.21.15.73:0/173729445 wait complete. 2023-12-12T09:47:13.158 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-12T09:47:13.368 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:13.366+0000 7f3dfb59e640 1 Processor -- start 2023-12-12T09:47:13.368 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:13.366+0000 7f3dfb59e640 1 -- start start 2023-12-12T09:47:13.369 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:13.368+0000 7f3dfb59e640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f3dfc0c37b0 0x7f3dfc151cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:13.370 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:13.368+0000 7f3dfb59e640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f3dfc0ab4a0 0x7f3dfc0a9df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:13.370 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:13.368+0000 7f3dfb59e640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3dfc1521f0 con 0x7f3dfc14e700 2023-12-12T09:47:13.370 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:13.368+0000 7f3dfb59e640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3dfc0ab2d0 con 0x7f3dfc0ab4a0 2023-12-12T09:47:13.370 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:13.368+0000 7f3dfb59e640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3dfc06bb10 con 0x7f3dfc0c37b0 2023-12-12T09:47:13.370 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:13.368+0000 7f3dfad9d640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f3dfc0ab4a0 0x7f3dfc0a9df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:13.370 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:13.368+0000 7f3dfad9d640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f3dfc0ab4a0 0x7f3dfc0a9df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:54180/0 (socket says 172.21.15.73:54180) 2023-12-12T09:47:13.370 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:13.368+0000 7f3dfad9d640 1 -- 172.21.15.73:0/1788430801 learned_addr learned my addr 172.21.15.73:0/1788430801 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:47:13.371 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:13.368+0000 7f3df9d9b640 1 --2- 172.21.15.73:0/1788430801 >> v2:172.21.15.142:3300/0 conn(0x7f3dfc0c37b0 0x7f3dfc151cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:13.371 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:13.369+0000 7f3dfad9d640 1 -- 172.21.15.73:0/1788430801 >> v2:172.21.15.142:3300/0 conn(0x7f3dfc0c37b0 msgr2=0x7f3dfc151cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:47:13.371 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:13.369+0000 7f3dfad9d640 1 --2- 172.21.15.73:0/1788430801 >> v2:172.21.15.142:3300/0 conn(0x7f3dfc0c37b0 0x7f3dfc151cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:13.371 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:13.369+0000 7f3dfad9d640 1 -- 172.21.15.73:0/1788430801 >> v1:172.21.15.142:6789/0 conn(0x7f3dfc14e700 legacy=0x7f3dfc0c02b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:47:13.371 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:13.369+0000 7f3dfad9d640 1 -- 172.21.15.73:0/1788430801 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3dfc0aaff0 con 0x7f3dfc0ab4a0 2023-12-12T09:47:13.372 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:13.370+0000 7f3dfad9d640 1 --2- 172.21.15.73:0/1788430801 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3dfc0ab4a0 0x7f3dfc0a9df0 secure :-1 s=READY pgs=1055 cs=0 l=1 rev1=1 crypto rx=0x7f3dfc06fa50 tx=0x7f3df402bdc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6272a24d1e637cb server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:47:13.372 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:13.370+0000 7f3df959a640 1 -- 172.21.15.73:0/1788430801 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3df402c960 con 0x7f3dfc0ab4a0 2023-12-12T09:47:13.372 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:13.370+0000 7f3df959a640 1 -- 172.21.15.73:0/1788430801 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3df402cac0 con 0x7f3dfc0ab4a0 2023-12-12T09:47:13.372 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:13.370+0000 7f3df959a640 1 -- 172.21.15.73:0/1788430801 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3df402ce50 con 0x7f3dfc0ab4a0 2023-12-12T09:47:13.372 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:13.371+0000 7f3dfb59e640 1 -- 172.21.15.73:0/1788430801 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3dfc0ab4a0 msgr2=0x7f3dfc0a9df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:13.373 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:13.371+0000 7f3dfb59e640 1 --2- 172.21.15.73:0/1788430801 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3dfc0ab4a0 0x7f3dfc0a9df0 secure :-1 s=READY pgs=1055 cs=0 l=1 rev1=1 crypto rx=0x7f3dfc06fa50 tx=0x7f3df402bdc0 comp rx=0 tx=0).stop 2023-12-12T09:47:13.373 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:13.371+0000 7f3dfb59e640 1 -- 172.21.15.73:0/1788430801 shutdown_connections 2023-12-12T09:47:13.373 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:13.371+0000 7f3dfb59e640 1 --2- 172.21.15.73:0/1788430801 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3dfc0ab4a0 0x7f3dfc0a9df0 unknown :-1 s=CLOSED pgs=1055 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:13.373 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:13.371+0000 7f3dfb59e640 1 --2- 172.21.15.73:0/1788430801 >> v2:172.21.15.142:3300/0 conn(0x7f3dfc0c37b0 0x7f3dfc151cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:13.373 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:13.371+0000 7f3dfb59e640 1 -- 172.21.15.73:0/1788430801 >> 172.21.15.73:0/1788430801 conn(0x7f3dfc0c23b0 msgr2=0x7f3dfc0c2790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:47:13.373 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:13.371+0000 7f3dfb59e640 1 -- 172.21.15.73:0/1788430801 shutdown_connections 2023-12-12T09:47:13.373 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:13.371+0000 7f3dfb59e640 1 -- 172.21.15.73:0/1788430801 wait complete. 2023-12-12T09:47:13.374 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:13.373+0000 7f3dfb59e640 1 Processor -- start 2023-12-12T09:47:13.374 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:13.373+0000 7f3dfb59e640 1 -- start start 2023-12-12T09:47:13.376 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:13.374+0000 7f3dfb59e640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3dfc0ab4a0 0x7f3dfc0bef50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:13.376 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:13.374+0000 7f3dfb59e640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3dfc0c37b0 0x7f3dfc071c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:13.376 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:13.374+0000 7f3dfb59e640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3dfc14e700 0x7f3dfc0721a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:13.376 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:13.374+0000 7f3dfb59e640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3dfc0c1360 con 0x7f3dfc0c37b0 2023-12-12T09:47:13.376 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:13.374+0000 7f3dfb59e640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3dfc0c1860 con 0x7f3dfc0ab4a0 2023-12-12T09:47:13.376 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:13.374+0000 7f3dfb59e640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3dfc0a67e0 con 0x7f3dfc14e700 2023-12-12T09:47:13.376 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:13.374+0000 7f3df9d9b640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3dfc0c37b0 0x7f3dfc071c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:13.376 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:13.374+0000 7f3df9d9b640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3dfc0c37b0 0x7f3dfc071c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:54192/0 (socket says 172.21.15.73:54192) 2023-12-12T09:47:13.377 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:13.374+0000 7f3df9d9b640 1 -- 172.21.15.73:0/2318196615 learned_addr learned my addr 172.21.15.73:0/2318196615 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:47:13.377 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:13.374+0000 7f3df9d9b640 1 -- 172.21.15.73:0/2318196615 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3dfc14e700 msgr2=0x7f3dfc0721a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:13.377 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:13.374+0000 7f3df9d9b640 1 --2- 172.21.15.73:0/2318196615 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3dfc14e700 0x7f3dfc0721a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:13.377 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:13.374+0000 7f3df9d9b640 1 -- 172.21.15.73:0/2318196615 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3dfc0ab4a0 msgr2=0x7f3dfc0bef50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:13.377 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:13.374+0000 7f3df9d9b640 1 --2- 172.21.15.73:0/2318196615 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3dfc0ab4a0 0x7f3dfc0bef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:13.377 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:13.374+0000 7f3df9d9b640 1 -- 172.21.15.73:0/2318196615 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3df4009b30 con 0x7f3dfc0c37b0 2023-12-12T09:47:13.377 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:13.375+0000 7f3df9d9b640 1 --2- 172.21.15.73:0/2318196615 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3dfc0c37b0 0x7f3dfc071c60 secure :-1 s=READY pgs=1056 cs=0 l=1 rev1=1 crypto rx=0x7f3df000d830 tx=0x7f3df000dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:47:13.378 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:13.375+0000 7f3deaffd640 1 -- 172.21.15.73:0/2318196615 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3df000b6c0 con 0x7f3dfc0c37b0 2023-12-12T09:47:13.378 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:13.375+0000 7f3deaffd640 1 -- 172.21.15.73:0/2318196615 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3df000b820 con 0x7f3dfc0c37b0 2023-12-12T09:47:13.378 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:13.375+0000 7f3deaffd640 1 -- 172.21.15.73:0/2318196615 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3df000bbb0 con 0x7f3dfc0c37b0 2023-12-12T09:47:13.378 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:13.375+0000 7f3dfb59e640 1 -- 172.21.15.73:0/2318196615 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3dfc0c1ab0 con 0x7f3dfc0c37b0 2023-12-12T09:47:13.378 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:13.375+0000 7f3dfb59e640 1 -- 172.21.15.73:0/2318196615 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3dfc150b40 con 0x7f3dfc0c37b0 2023-12-12T09:47:13.378 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:13.376+0000 7f3dfb59e640 1 -- 172.21.15.73:0/2318196615 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3dfc1509a0 con 0x7f3dfc0c37b0 2023-12-12T09:47:13.379 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:13.377+0000 7f3deaffd640 1 -- 172.21.15.73:0/2318196615 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f3df001e460 con 0x7f3dfc0c37b0 2023-12-12T09:47:13.379 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:13.378+0000 7f3deaffd640 1 --2- 172.21.15.73:0/2318196615 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f3ddc06ae40 0x7f3ddc06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:13.379 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:13.378+0000 7f3deaffd640 1 -- 172.21.15.73:0/2318196615 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6623+0+0 (secure 0 0 0) 0x7f3df008a1e0 con 0x7f3dfc0c37b0 2023-12-12T09:47:13.380 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:13.378+0000 7f3dfa59c640 1 --2- 172.21.15.73:0/2318196615 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f3ddc06ae40 0x7f3ddc06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:13.380 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:13.379+0000 7f3dfa59c640 1 --2- 172.21.15.73:0/2318196615 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f3ddc06ae40 0x7f3ddc06d300 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f3dec006fd0 tx=0x7f3dec006bc0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:47:13.384 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:13.382+0000 7f3deaffd640 1 -- 172.21.15.73:0/2318196615 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f3dfc1509a0 con 0x7f3dfc0c37b0 2023-12-12T09:47:13.579 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:13.577+0000 7f3dfb59e640 1 -- 172.21.15.73:0/2318196615 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3dfc1509a0 con 0x7f3dfc0c37b0 2023-12-12T09:47:13.580 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:13.579+0000 7f3deaffd640 1 -- 172.21.15.73:0/2318196615 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v81) v1 ==== 74+0+20323 (secure 0 0 0) 0x7f3dfc1509a0 con 0x7f3dfc0c37b0 2023-12-12T09:47:13.581 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-12T09:47:13.581 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":81,"fsid":"ba240992-02b8-4c7e-92f2-27eb29ac433b","created":"2023-12-12T09:43:02.454719+0000","modified":"2023-12-12T09:47:10.698166+0000","last_up_change":"2023-12-12T09:43:13.913440+0000","last_in_change":"2023-12-12T09:43:05.925348+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-12T09:43:15.525508+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2023-12-12T09:46:24.716544+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2023-12-12T09:46:25.435954+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs2_metadata","create_time":"2023-12-12T09:46:40.116878+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs2_data","create_time":"2023-12-12T09:46:40.798840+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"dd9074be-dbe2-4c34-9896-a4223d8d3940","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":4047810203},{"type":"v1","addr":"172.21.15.73:6801","nonce":4047810203}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":4047810203},{"type":"v1","addr":"172.21.15.73:6803","nonce":4047810203}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":4047810203},{"type":"v1","addr":"172.21.15.73:6807","nonce":4047810203}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":4047810203},{"type":"v1","addr":"172.21.15.73:6805","nonce":4047810203}]},"public_addr":"172.21.15.73:6801/4047810203","cluster_addr":"172.21.15.73:6803/4047810203","heartbeat_back_addr":"172.21.15.73:6807/4047810203","heartbeat_front_addr":"172.21.15.73:6805/4047810203","state":["exists","up"]},{"osd":1,"uuid":"c4a05052-96d4-4758-a4e1-1a37f1e07fed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":1356058331},{"type":"v1","addr":"172.21.15.73:6824","nonce":1356058331}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":1356058331},{"type":"v1","addr":"172.21.15.73:6827","nonce":1356058331}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":1356058331},{"type":"v1","addr":"172.21.15.73:6831","nonce":1356058331}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":1356058331},{"type":"v1","addr":"172.21.15.73:6829","nonce":1356058331}]},"public_addr":"172.21.15.73:6824/1356058331","cluster_addr":"172.21.15.73:6827/1356058331","heartbeat_back_addr":"172.21.15.73:6831/1356058331","heartbeat_front_addr":"172.21.15.73:6829/1356058331","state":["exists","up"]},{"osd":2,"uuid":"512bc8ac-72c2-40d4-b3d2-d867a92c5213","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":1228903316},{"type":"v1","addr":"172.21.15.73:6817","nonce":1228903316}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":1228903316},{"type":"v1","addr":"172.21.15.73:6819","nonce":1228903316}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6823","nonce":1228903316},{"type":"v1","addr":"172.21.15.73:6825","nonce":1228903316}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":1228903316},{"type":"v1","addr":"172.21.15.73:6821","nonce":1228903316}]},"public_addr":"172.21.15.73:6817/1228903316","cluster_addr":"172.21.15.73:6819/1228903316","heartbeat_back_addr":"172.21.15.73:6825/1228903316","heartbeat_front_addr":"172.21.15.73:6821/1228903316","state":["exists","up"]},{"osd":3,"uuid":"3d1a91e0-42bf-437a-8eae-8d357c8f63a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":1293329670},{"type":"v1","addr":"172.21.15.73:6809","nonce":1293329670}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6810","nonce":1293329670},{"type":"v1","addr":"172.21.15.73:6811","nonce":1293329670}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":1293329670},{"type":"v1","addr":"172.21.15.73:6815","nonce":1293329670}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":1293329670},{"type":"v1","addr":"172.21.15.73:6813","nonce":1293329670}]},"public_addr":"172.21.15.73:6809/1293329670","cluster_addr":"172.21.15.73:6811/1293329670","heartbeat_back_addr":"172.21.15.73:6815/1293329670","heartbeat_front_addr":"172.21.15.73:6813/1293329670","state":["exists","up"]},{"osd":4,"uuid":"4b302fff-834c-4069-ac19-00e46f6c87b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":3727975702},{"type":"v1","addr":"172.21.15.142:6801","nonce":3727975702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":3727975702},{"type":"v1","addr":"172.21.15.142:6803","nonce":3727975702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6809","nonce":3727975702},{"type":"v1","addr":"172.21.15.142:6811","nonce":3727975702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6805","nonce":3727975702},{"type":"v1","addr":"172.21.15.142:6807","nonce":3727975702}]},"public_addr":"172.21.15.142:6801/3727975702","cluster_addr":"172.21.15.142:6803/3727975702","heartbeat_back_addr":"172.21.15.142:6811/3727975702","heartbeat_front_addr":"172.21.15.142:6807/3727975702","state":["exists","up"]},{"osd":5,"uuid":"d7cdace2-67d0-45cc-95f2-515cf6ef1b82","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6817","nonce":2353193632},{"type":"v1","addr":"172.21.15.142:6819","nonce":2353193632}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6821","nonce":2353193632},{"type":"v1","addr":"172.21.15.142:6823","nonce":2353193632}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6829","nonce":2353193632},{"type":"v1","addr":"172.21.15.142:6831","nonce":2353193632}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6825","nonce":2353193632},{"type":"v1","addr":"172.21.15.142:6827","nonce":2353193632}]},"public_addr":"172.21.15.142:6819/2353193632","cluster_addr":"172.21.15.142:6823/2353193632","heartbeat_back_addr":"172.21.15.142:6831/2353193632","heartbeat_front_addr":"172.21.15.142:6827/2353193632","state":["exists","up"]},{"osd":6,"uuid":"649ce78a-5626-445c-aedc-a651ed05a6f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":2006111986},{"type":"v1","addr":"172.21.15.142:6806","nonce":2006111986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":2006111986},{"type":"v1","addr":"172.21.15.142:6810","nonce":2006111986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":2006111986},{"type":"v1","addr":"172.21.15.142:6815","nonce":2006111986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":2006111986},{"type":"v1","addr":"172.21.15.142:6813","nonce":2006111986}]},"public_addr":"172.21.15.142:6806/2006111986","cluster_addr":"172.21.15.142:6810/2006111986","heartbeat_back_addr":"172.21.15.142:6815/2006111986","heartbeat_front_addr":"172.21.15.142:6813/2006111986","state":["exists","up"]},{"osd":7,"uuid":"af15ae3b-c1d0-4acf-92db-8a1805494d13","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":2573794341},{"type":"v1","addr":"172.21.15.142:6818","nonce":2573794341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":2573794341},{"type":"v1","addr":"172.21.15.142:6822","nonce":2573794341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":2573794341},{"type":"v1","addr":"172.21.15.142:6830","nonce":2573794341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":2573794341},{"type":"v1","addr":"172.21.15.142:6826","nonce":2573794341}]},"public_addr":"172.21.15.142:6818/2573794341","cluster_addr":"172.21.15.142:6822/2573794341","heartbeat_back_addr":"172.21.15.142:6830/2573794341","heartbeat_front_addr":"172.21.15.142:6826/2573794341","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.185824+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.262103+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.225556+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:10.523459+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:10.706035+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.257339+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.301776+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.051960+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"13.a","mappings":[{"from":1,"to":5}]},{"pgid":"13.3f","mappings":[{"from":6,"to":3}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-12T09:47:13.584 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:13.582+0000 7f3dfb59e640 1 -- 172.21.15.73:0/2318196615 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f3ddc06ae40 msgr2=0x7f3ddc06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:13.584 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:13.582+0000 7f3dfb59e640 1 --2- 172.21.15.73:0/2318196615 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f3ddc06ae40 0x7f3ddc06d300 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f3dec006fd0 tx=0x7f3dec006bc0 comp rx=0 tx=0).stop 2023-12-12T09:47:13.584 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:13.582+0000 7f3dfb59e640 1 -- 172.21.15.73:0/2318196615 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3dfc0c37b0 msgr2=0x7f3dfc071c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:13.584 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:13.582+0000 7f3dfb59e640 1 --2- 172.21.15.73:0/2318196615 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3dfc0c37b0 0x7f3dfc071c60 secure :-1 s=READY pgs=1056 cs=0 l=1 rev1=1 crypto rx=0x7f3df000d830 tx=0x7f3df000dcf0 comp rx=0 tx=0).stop 2023-12-12T09:47:13.584 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:13.582+0000 7f3dfb59e640 1 -- 172.21.15.73:0/2318196615 shutdown_connections 2023-12-12T09:47:13.584 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:13.582+0000 7f3dfb59e640 1 --2- 172.21.15.73:0/2318196615 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f3ddc06ae40 0x7f3ddc06d300 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:13.584 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:13.582+0000 7f3dfb59e640 1 --2- 172.21.15.73:0/2318196615 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3dfc14e700 0x7f3dfc0721a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:13.584 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:13.582+0000 7f3dfb59e640 1 --2- 172.21.15.73:0/2318196615 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3dfc0c37b0 0x7f3dfc071c60 unknown :-1 s=CLOSED pgs=1056 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:13.584 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:13.582+0000 7f3dfb59e640 1 --2- 172.21.15.73:0/2318196615 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3dfc0ab4a0 0x7f3dfc0bef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:13.584 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:13.582+0000 7f3dfb59e640 1 -- 172.21.15.73:0/2318196615 >> 172.21.15.73:0/2318196615 conn(0x7f3dfc0c23b0 msgr2=0x7f3dfc0c2790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:47:13.584 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:13.582+0000 7f3dfb59e640 1 -- 172.21.15.73:0/2318196615 shutdown_connections 2023-12-12T09:47:13.585 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:13.582+0000 7f3dfb59e640 1 -- 172.21.15.73:0/2318196615 wait complete. 2023-12-12T09:47:13.601 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-12T09:43:15.525508+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 12, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-12T09:46:24.716544+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '74', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 13, 'pool_name': 'cephfs_data', 'create_time': '2023-12-12T09:46:25.435954+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '75', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 14, 'pool_name': 'cephfs2_metadata', 'create_time': '2023-12-12T09:46:40.116878+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '78', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs2'}}, 'read_balance': {'score_acting': 2.5, 'score_stable': 2.5, 'optimal_score': 1, 'raw_score_acting': 2.5, 'raw_score_stable': 2.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 15, 'pool_name': 'cephfs2_data', 'create_time': '2023-12-12T09:46:40.798840+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '79', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs2'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-12T09:47:13.602 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-12T09:47:13.817 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:13.815+0000 7fc50fb39640 1 Processor -- start 2023-12-12T09:47:13.817 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:13.816+0000 7fc50fb39640 1 -- start start 2023-12-12T09:47:13.819 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:13.817+0000 7fc50fb39640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fc50814ea60 0x7fc5080c5420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:13.819 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:13.817+0000 7fc50fb39640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fc5080c0320 0x7fc5080c20b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:13.819 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:13.817+0000 7fc50fb39640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5080c3390 con 0x7fc5080a4c90 2023-12-12T09:47:13.819 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:13.817+0000 7fc50fb39640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5080c0750 con 0x7fc5080c0320 2023-12-12T09:47:13.819 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:13.817+0000 7fc50fb39640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5080c4b30 con 0x7fc50814ea60 2023-12-12T09:47:13.819 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:13.817+0000 7fc50e0d6640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fc5080c0320 0x7fc5080c20b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:13.819 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:13.817+0000 7fc50d0d4640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7fc5080a4c90 0x7fc5080c4420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:54676/0 (socket says 172.21.15.73:54676) 2023-12-12T09:47:13.819 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:13.817+0000 7fc50d0d4640 1 -- 172.21.15.73:0/1124381371 learned_addr learned my addr 172.21.15.73:0/1124381371 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-12T09:47:13.819 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:13.818+0000 7fc50d8d5640 1 --2- 172.21.15.73:0/1124381371 >> v2:172.21.15.142:3300/0 conn(0x7fc50814ea60 0x7fc5080c5420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:13.820 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:13.818+0000 7fc50e0d6640 1 -- 172.21.15.73:0/1124381371 >> v2:172.21.15.142:3300/0 conn(0x7fc50814ea60 msgr2=0x7fc5080c5420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:47:13.820 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:13.818+0000 7fc50e0d6640 1 --2- 172.21.15.73:0/1124381371 >> v2:172.21.15.142:3300/0 conn(0x7fc50814ea60 0x7fc5080c5420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:13.820 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:13.818+0000 7fc50e0d6640 1 -- 172.21.15.73:0/1124381371 >> v1:172.21.15.73:6789/0 conn(0x7fc5080a4c90 legacy=0x7fc5080c4420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:13.820 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:13.818+0000 7fc50e0d6640 1 -- 172.21.15.73:0/1124381371 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc508151e60 con 0x7fc5080c0320 2023-12-12T09:47:13.820 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:13.818+0000 7fc50c8d3640 1 -- 172.21.15.73:0/1124381371 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2644605805 0 0) 0x7fc5080c3390 con 0x7fc5080a4c90 2023-12-12T09:47:13.821 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:13.819+0000 7fc50e0d6640 1 --2- 172.21.15.73:0/1124381371 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc5080c0320 0x7fc5080c20b0 secure :-1 s=READY pgs=1058 cs=0 l=1 rev1=1 crypto rx=0x7fc50806b490 tx=0x7fc50002be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9398abe94a1c90f0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:47:13.822 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:13.819+0000 7fc50c8d3640 1 -- 172.21.15.73:0/1124381371 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc50002cbf0 con 0x7fc5080c0320 2023-12-12T09:47:13.822 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:13.819+0000 7fc50c8d3640 1 -- 172.21.15.73:0/1124381371 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc50002cd50 con 0x7fc5080c0320 2023-12-12T09:47:13.822 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:13.819+0000 7fc50c8d3640 1 -- 172.21.15.73:0/1124381371 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc500034660 con 0x7fc5080c0320 2023-12-12T09:47:13.822 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:13.820+0000 7fc50fb39640 1 -- 172.21.15.73:0/1124381371 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc5080c0320 msgr2=0x7fc5080c20b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:13.822 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:13.820+0000 7fc50fb39640 1 --2- 172.21.15.73:0/1124381371 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc5080c0320 0x7fc5080c20b0 secure :-1 s=READY pgs=1058 cs=0 l=1 rev1=1 crypto rx=0x7fc50806b490 tx=0x7fc50002be40 comp rx=0 tx=0).stop 2023-12-12T09:47:13.822 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:13.820+0000 7fc50fb39640 1 -- 172.21.15.73:0/1124381371 shutdown_connections 2023-12-12T09:47:13.822 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:13.820+0000 7fc50fb39640 1 --2- 172.21.15.73:0/1124381371 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc5080c0320 0x7fc5080c20b0 unknown :-1 s=CLOSED pgs=1058 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:13.822 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:13.820+0000 7fc50fb39640 1 --2- 172.21.15.73:0/1124381371 >> v2:172.21.15.142:3300/0 conn(0x7fc50814ea60 0x7fc5080c5420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:13.822 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:13.820+0000 7fc50fb39640 1 -- 172.21.15.73:0/1124381371 >> 172.21.15.73:0/1124381371 conn(0x7fc50806a4e0 msgr2=0x7fc50806a8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:47:13.822 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:13.820+0000 7fc50fb39640 1 -- 172.21.15.73:0/1124381371 shutdown_connections 2023-12-12T09:47:13.822 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:13.820+0000 7fc50fb39640 1 -- 172.21.15.73:0/1124381371 wait complete. 2023-12-12T09:47:13.823 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:13.822+0000 7fc50fb39640 1 Processor -- start 2023-12-12T09:47:13.823 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:13.822+0000 7fc50fb39640 1 -- start start 2023-12-12T09:47:13.825 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:13.823+0000 7fc50fb39640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc5080a4c90 0x7fc5080a5f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:13.825 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:13.823+0000 7fc50fb39640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc5080c0320 0x7fc508147290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:13.825 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:13.823+0000 7fc50fb39640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc50814ea60 0x7fc508143c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:13.825 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:13.823+0000 7fc50fb39640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5081ed2e0 con 0x7fc5080c0320 2023-12-12T09:47:13.825 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:13.823+0000 7fc50fb39640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5081ed530 con 0x7fc50814ea60 2023-12-12T09:47:13.825 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:13.823+0000 7fc50fb39640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5081ed810 con 0x7fc5080a4c90 2023-12-12T09:47:13.825 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:13.823+0000 7fc50d0d4640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc5080c0320 0x7fc508147290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:13.826 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:13.823+0000 7fc50d0d4640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc5080c0320 0x7fc508147290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:54218/0 (socket says 172.21.15.73:54218) 2023-12-12T09:47:13.826 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:13.823+0000 7fc50d0d4640 1 -- 172.21.15.73:0/2212922178 learned_addr learned my addr 172.21.15.73:0/2212922178 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:47:13.826 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:13.823+0000 7fc50e0d6640 1 --2- 172.21.15.73:0/2212922178 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc50814ea60 0x7fc508143c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:13.826 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:13.823+0000 7fc50d8d5640 1 --2- 172.21.15.73:0/2212922178 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc5080a4c90 0x7fc5080a5f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:13.826 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:13.824+0000 7fc50d0d4640 1 -- 172.21.15.73:0/2212922178 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc5080a4c90 msgr2=0x7fc5080a5f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:13.826 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:13.824+0000 7fc50d0d4640 1 --2- 172.21.15.73:0/2212922178 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc5080a4c90 0x7fc5080a5f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:13.826 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:13.824+0000 7fc50d0d4640 1 -- 172.21.15.73:0/2212922178 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc50814ea60 msgr2=0x7fc508143c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:13.826 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:13.824+0000 7fc50d0d4640 1 --2- 172.21.15.73:0/2212922178 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc50814ea60 0x7fc508143c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:13.826 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:13.824+0000 7fc50d0d4640 1 -- 172.21.15.73:0/2212922178 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc500009a70 con 0x7fc5080c0320 2023-12-12T09:47:13.826 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:13.824+0000 7fc50d8d5640 1 --2- 172.21.15.73:0/2212922178 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc5080a4c90 0x7fc5080a5f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:47:13.826 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:13.824+0000 7fc50e0d6640 1 --2- 172.21.15.73:0/2212922178 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc50814ea60 0x7fc508143c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:47:13.826 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:13.824+0000 7fc50d0d4640 1 --2- 172.21.15.73:0/2212922178 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc5080c0320 0x7fc508147290 secure :-1 s=READY pgs=1059 cs=0 l=1 rev1=1 crypto rx=0x7fc4f800c4d0 tx=0x7fc4f800c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:47:13.827 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:13.824+0000 7fc4fe7fc640 1 -- 172.21.15.73:0/2212922178 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4f80074e0 con 0x7fc5080c0320 2023-12-12T09:47:13.827 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:13.824+0000 7fc4fe7fc640 1 -- 172.21.15.73:0/2212922178 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4f8007660 con 0x7fc5080c0320 2023-12-12T09:47:13.827 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:13.824+0000 7fc4fe7fc640 1 -- 172.21.15.73:0/2212922178 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4f8004a20 con 0x7fc5080c0320 2023-12-12T09:47:13.827 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:13.824+0000 7fc50fb39640 1 -- 172.21.15.73:0/2212922178 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5081edaf0 con 0x7fc5080c0320 2023-12-12T09:47:13.827 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:13.824+0000 7fc50fb39640 1 -- 172.21.15.73:0/2212922178 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5081ee0b0 con 0x7fc5080c0320 2023-12-12T09:47:13.827 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:13.825+0000 7fc50fb39640 1 -- 172.21.15.73:0/2212922178 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc508067920 con 0x7fc5080c0320 2023-12-12T09:47:13.828 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:13.826+0000 7fc4fe7fc640 1 -- 172.21.15.73:0/2212922178 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fc4f8004b80 con 0x7fc5080c0320 2023-12-12T09:47:13.828 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:13.827+0000 7fc4fe7fc640 1 --2- 172.21.15.73:0/2212922178 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fc4ec06ae70 0x7fc4ec06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:13.829 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:13.827+0000 7fc4fe7fc640 1 -- 172.21.15.73:0/2212922178 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6623+0+0 (secure 0 0 0) 0x7fc4f8088bf0 con 0x7fc5080c0320 2023-12-12T09:47:13.829 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:13.828+0000 7fc50d8d5640 1 --2- 172.21.15.73:0/2212922178 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fc4ec06ae70 0x7fc4ec06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:13.829 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:13.828+0000 7fc50d8d5640 1 --2- 172.21.15.73:0/2212922178 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fc4ec06ae70 0x7fc4ec06d330 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7fc504006fd0 tx=0x7fc504008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:47:13.833 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:13.832+0000 7fc4fe7fc640 1 -- 172.21.15.73:0/2212922178 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fc4f8053870 con 0x7fc5080c0320 2023-12-12T09:47:14.027 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:14.025+0000 7fc50fb39640 1 -- 172.21.15.73:0/2212922178 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fc508067070 con 0x7fc5080c0320 2023-12-12T09:47:14.028 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:14.027+0000 7fc4fe7fc640 1 -- 172.21.15.73:0/2212922178 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v81) v1 ==== 93+0+10 (secure 0 0 0) 0x7fc4f8018020 con 0x7fc5080c0320 2023-12-12T09:47:14.028 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 1 2023-12-12T09:47:14.032 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:14.029+0000 7fc50fb39640 1 -- 172.21.15.73:0/2212922178 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fc4ec06ae70 msgr2=0x7fc4ec06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:14.032 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:14.029+0000 7fc50fb39640 1 --2- 172.21.15.73:0/2212922178 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fc4ec06ae70 0x7fc4ec06d330 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7fc504006fd0 tx=0x7fc504008040 comp rx=0 tx=0).stop 2023-12-12T09:47:14.032 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:14.029+0000 7fc50fb39640 1 -- 172.21.15.73:0/2212922178 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc5080c0320 msgr2=0x7fc508147290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:14.032 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:14.029+0000 7fc50fb39640 1 --2- 172.21.15.73:0/2212922178 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc5080c0320 0x7fc508147290 secure :-1 s=READY pgs=1059 cs=0 l=1 rev1=1 crypto rx=0x7fc4f800c4d0 tx=0x7fc4f800c990 comp rx=0 tx=0).stop 2023-12-12T09:47:14.032 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:14.030+0000 7fc50fb39640 1 -- 172.21.15.73:0/2212922178 shutdown_connections 2023-12-12T09:47:14.032 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:14.030+0000 7fc50fb39640 1 --2- 172.21.15.73:0/2212922178 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fc4ec06ae70 0x7fc4ec06d330 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:14.032 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:14.030+0000 7fc50fb39640 1 --2- 172.21.15.73:0/2212922178 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc50814ea60 0x7fc508143c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:14.032 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:14.030+0000 7fc50fb39640 1 --2- 172.21.15.73:0/2212922178 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc5080c0320 0x7fc508147290 unknown :-1 s=CLOSED pgs=1059 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:14.032 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:14.030+0000 7fc50fb39640 1 --2- 172.21.15.73:0/2212922178 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc5080a4c90 0x7fc5080a5f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:14.032 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:14.030+0000 7fc50fb39640 1 -- 172.21.15.73:0/2212922178 >> 172.21.15.73:0/2212922178 conn(0x7fc50806a4e0 msgr2=0x7fc5080bed50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:47:14.032 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:14.030+0000 7fc50fb39640 1 -- 172.21.15.73:0/2212922178 shutdown_connections 2023-12-12T09:47:14.032 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:14.030+0000 7fc50fb39640 1 -- 172.21.15.73:0/2212922178 wait complete. 2023-12-12T09:47:14.049 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-12T09:47:14.254 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:14.253+0000 7f61f5190640 1 Processor -- start 2023-12-12T09:47:14.255 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:14.253+0000 7f61f5190640 1 -- start start 2023-12-12T09:47:14.257 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:14.254+0000 7f61f5190640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f61f014f8c0 0x7f61f006dc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:14.257 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:14.254+0000 7f61f5190640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f61f006d350 0x7f61f0071e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:14.257 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:14.254+0000 7f61f5190640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f61f00723a0 0x7f61f0152500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:14.257 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:14.254+0000 7f61f5190640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61f00c1090 con 0x7f61f014f8c0 2023-12-12T09:47:14.257 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:14.254+0000 7f61f5190640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61f00c14b0 con 0x7f61f006d350 2023-12-12T09:47:14.257 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:14.254+0000 7f61f5190640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61f00c16c0 con 0x7f61f00723a0 2023-12-12T09:47:14.257 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:14.255+0000 7f61eed9d640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f61f014f8c0 0x7f61f006dc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:14.257 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:14.255+0000 7f61eed9d640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f61f014f8c0 0x7f61f006dc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:54232/0 (socket says 172.21.15.73:54232) 2023-12-12T09:47:14.257 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:14.255+0000 7f61eed9d640 1 -- 172.21.15.73:0/721061054 learned_addr learned my addr 172.21.15.73:0/721061054 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:47:14.257 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:14.255+0000 7f61e7fff640 1 --2- 172.21.15.73:0/721061054 >> v2:172.21.15.142:3300/0 conn(0x7f61f006d350 0x7f61f0071e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:14.258 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:14.255+0000 7f61eed9d640 1 -- 172.21.15.73:0/721061054 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f61f00723a0 msgr2=0x7f61f0152500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:47:14.258 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:14.255+0000 7f61eed9d640 1 --2- 172.21.15.73:0/721061054 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f61f00723a0 0x7f61f0152500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:14.258 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:14.255+0000 7f61eed9d640 1 -- 172.21.15.73:0/721061054 >> v2:172.21.15.142:3300/0 conn(0x7f61f006d350 msgr2=0x7f61f0071e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:47:14.258 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:14.255+0000 7f61eed9d640 1 --2- 172.21.15.73:0/721061054 >> v2:172.21.15.142:3300/0 conn(0x7f61f006d350 0x7f61f0071e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:14.258 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:14.255+0000 7f61eed9d640 1 -- 172.21.15.73:0/721061054 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61f00c19a0 con 0x7f61f014f8c0 2023-12-12T09:47:14.259 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:14.256+0000 7f61eed9d640 1 --2- 172.21.15.73:0/721061054 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f61f014f8c0 0x7f61f006dc40 secure :-1 s=READY pgs=1060 cs=0 l=1 rev1=1 crypto rx=0x7f61f00c3430 tx=0x7f61e002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc2ba5617a422503 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:47:14.259 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:14.257+0000 7f61ee59c640 1 -- 172.21.15.73:0/721061054 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61e0031870 con 0x7f61f014f8c0 2023-12-12T09:47:14.259 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:14.257+0000 7f61ee59c640 1 -- 172.21.15.73:0/721061054 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61e00319d0 con 0x7f61f014f8c0 2023-12-12T09:47:14.259 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:14.257+0000 7f61ee59c640 1 -- 172.21.15.73:0/721061054 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61e0031d60 con 0x7f61f014f8c0 2023-12-12T09:47:14.259 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:14.257+0000 7f61f5190640 1 -- 172.21.15.73:0/721061054 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f61f014f8c0 msgr2=0x7f61f006dc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:14.259 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:14.257+0000 7f61f5190640 1 --2- 172.21.15.73:0/721061054 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f61f014f8c0 0x7f61f006dc40 secure :-1 s=READY pgs=1060 cs=0 l=1 rev1=1 crypto rx=0x7f61f00c3430 tx=0x7f61e002b910 comp rx=0 tx=0).stop 2023-12-12T09:47:14.260 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:14.258+0000 7f61f5190640 1 -- 172.21.15.73:0/721061054 shutdown_connections 2023-12-12T09:47:14.260 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:14.258+0000 7f61f5190640 1 --2- 172.21.15.73:0/721061054 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f61f00723a0 0x7f61f0152500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:14.260 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:14.258+0000 7f61f5190640 1 --2- 172.21.15.73:0/721061054 >> v2:172.21.15.142:3300/0 conn(0x7f61f006d350 0x7f61f0071e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:14.260 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:14.258+0000 7f61f5190640 1 --2- 172.21.15.73:0/721061054 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f61f014f8c0 0x7f61f006dc40 unknown :-1 s=CLOSED pgs=1060 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:14.260 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:14.258+0000 7f61f5190640 1 -- 172.21.15.73:0/721061054 >> 172.21.15.73:0/721061054 conn(0x7f61f006a4e0 msgr2=0x7f61f006a8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:47:14.260 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:14.258+0000 7f61f5190640 1 -- 172.21.15.73:0/721061054 shutdown_connections 2023-12-12T09:47:14.260 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:14.258+0000 7f61f5190640 1 -- 172.21.15.73:0/721061054 wait complete. 2023-12-12T09:47:14.261 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:14.259+0000 7f61f5190640 1 Processor -- start 2023-12-12T09:47:14.261 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:14.260+0000 7f61f5190640 1 -- start start 2023-12-12T09:47:14.263 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:14.260+0000 7f61f5190640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f61f006d350 0x7f61f0150c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:14.263 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:14.260+0000 7f61f5190640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f61f00723a0 0x7f61f014b5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:14.263 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:14.260+0000 7f61f5190640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f61f014f8c0 0x7f61f01ed350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:14.264 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:14.260+0000 7f61f5190640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61f01545c0 con 0x7f61f006d350 2023-12-12T09:47:14.264 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:14.260+0000 7f61f5190640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61f01515b0 con 0x7f61f014f8c0 2023-12-12T09:47:14.264 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:14.260+0000 7f61f5190640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61f0150200 con 0x7f61f00723a0 2023-12-12T09:47:14.264 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:14.261+0000 7f61eed9d640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f61f006d350 0x7f61f0150c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:14.264 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:14.261+0000 7f61eed9d640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f61f006d350 0x7f61f0150c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:54240/0 (socket says 172.21.15.73:54240) 2023-12-12T09:47:14.264 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:14.261+0000 7f61eed9d640 1 -- 172.21.15.73:0/3117041905 learned_addr learned my addr 172.21.15.73:0/3117041905 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:47:14.264 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:14.261+0000 7f61eed9d640 1 -- 172.21.15.73:0/3117041905 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f61f00723a0 msgr2=0x7f61f014b5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:14.264 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:14.261+0000 7f61e7fff640 1 --2- 172.21.15.73:0/3117041905 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f61f00723a0 0x7f61f014b5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:14.264 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:14.261+0000 7f61eed9d640 1 --2- 172.21.15.73:0/3117041905 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f61f00723a0 0x7f61f014b5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:14.264 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:14.261+0000 7f61eed9d640 1 -- 172.21.15.73:0/3117041905 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f61f014f8c0 msgr2=0x7f61f01ed350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:14.264 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:14.261+0000 7f61ef59e640 1 --2- 172.21.15.73:0/3117041905 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f61f014f8c0 0x7f61f01ed350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:14.264 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:14.261+0000 7f61eed9d640 1 --2- 172.21.15.73:0/3117041905 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f61f014f8c0 0x7f61f01ed350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:14.264 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:14.261+0000 7f61eed9d640 1 -- 172.21.15.73:0/3117041905 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61e00094d0 con 0x7f61f006d350 2023-12-12T09:47:14.264 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:14.261+0000 7f61ef59e640 1 --2- 172.21.15.73:0/3117041905 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f61f014f8c0 0x7f61f01ed350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:47:14.264 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:14.262+0000 7f61eed9d640 1 --2- 172.21.15.73:0/3117041905 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f61f006d350 0x7f61f0150c50 secure :-1 s=READY pgs=1061 cs=0 l=1 rev1=1 crypto rx=0x7f61e0000c00 tx=0x7f61e00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:47:14.265 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:14.262+0000 7f61e77fe640 1 -- 172.21.15.73:0/3117041905 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61e0031840 con 0x7f61f006d350 2023-12-12T09:47:14.265 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:14.262+0000 7f61e77fe640 1 -- 172.21.15.73:0/3117041905 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61e00443f0 con 0x7f61f006d350 2023-12-12T09:47:14.265 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:14.262+0000 7f61e77fe640 1 -- 172.21.15.73:0/3117041905 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61e00447a0 con 0x7f61f006d350 2023-12-12T09:47:14.265 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:14.262+0000 7f61f5190640 1 -- 172.21.15.73:0/3117041905 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61f01507c0 con 0x7f61f006d350 2023-12-12T09:47:14.265 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:14.262+0000 7f61f5190640 1 -- 172.21.15.73:0/3117041905 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61f0153f80 con 0x7f61f006d350 2023-12-12T09:47:14.265 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:14.263+0000 7f61f5190640 1 -- 172.21.15.73:0/3117041905 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61f0067070 con 0x7f61f006d350 2023-12-12T09:47:14.265 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:14.264+0000 7f61e77fe640 1 -- 172.21.15.73:0/3117041905 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f61e0044900 con 0x7f61f006d350 2023-12-12T09:47:14.267 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:14.265+0000 7f61e77fe640 1 --2- 172.21.15.73:0/3117041905 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f61d006ae40 0x7f61d006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:14.267 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:14.265+0000 7f61e77fe640 1 -- 172.21.15.73:0/3117041905 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6623+0+0 (secure 0 0 0) 0x7f61e002d040 con 0x7f61f006d350 2023-12-12T09:47:14.267 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:14.265+0000 7f61e7fff640 1 --2- 172.21.15.73:0/3117041905 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f61d006ae40 0x7f61d006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:14.267 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:14.266+0000 7f61e7fff640 1 --2- 172.21.15.73:0/3117041905 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f61d006ae40 0x7f61d006d300 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f61d8006fd0 tx=0x7f61d8008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:47:14.271 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:14.269+0000 7f61e77fe640 1 -- 172.21.15.73:0/3117041905 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f61e0076fc0 con 0x7f61f006d350 2023-12-12T09:47:14.466 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:14.465+0000 7f61f5190640 1 -- 172.21.15.73:0/3117041905 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f61f0067580 con 0x7f61f006d350 2023-12-12T09:47:14.467 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:14.466+0000 7f61e77fe640 1 -- 172.21.15.73:0/3117041905 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v81) v1 ==== 104+0+11 (secure 0 0 0) 0x7f61e0035020 con 0x7f61f006d350 2023-12-12T09:47:14.467 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 32 2023-12-12T09:47:14.470 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:14.469+0000 7f61f5190640 1 -- 172.21.15.73:0/3117041905 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f61d006ae40 msgr2=0x7f61d006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:14.471 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:14.469+0000 7f61f5190640 1 --2- 172.21.15.73:0/3117041905 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f61d006ae40 0x7f61d006d300 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f61d8006fd0 tx=0x7f61d8008040 comp rx=0 tx=0).stop 2023-12-12T09:47:14.471 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:14.469+0000 7f61f5190640 1 -- 172.21.15.73:0/3117041905 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f61f006d350 msgr2=0x7f61f0150c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:14.471 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:14.469+0000 7f61f5190640 1 --2- 172.21.15.73:0/3117041905 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f61f006d350 0x7f61f0150c50 secure :-1 s=READY pgs=1061 cs=0 l=1 rev1=1 crypto rx=0x7f61e0000c00 tx=0x7f61e00046c0 comp rx=0 tx=0).stop 2023-12-12T09:47:14.471 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:14.469+0000 7f61f5190640 1 -- 172.21.15.73:0/3117041905 shutdown_connections 2023-12-12T09:47:14.471 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:14.469+0000 7f61f5190640 1 --2- 172.21.15.73:0/3117041905 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f61d006ae40 0x7f61d006d300 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:14.471 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:14.469+0000 7f61f5190640 1 --2- 172.21.15.73:0/3117041905 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f61f014f8c0 0x7f61f01ed350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:14.471 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:14.469+0000 7f61f5190640 1 --2- 172.21.15.73:0/3117041905 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f61f00723a0 0x7f61f014b5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:14.471 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:14.469+0000 7f61f5190640 1 --2- 172.21.15.73:0/3117041905 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f61f006d350 0x7f61f0150c50 unknown :-1 s=CLOSED pgs=1061 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:14.471 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:14.469+0000 7f61f5190640 1 -- 172.21.15.73:0/3117041905 >> 172.21.15.73:0/3117041905 conn(0x7f61f006a4e0 msgr2=0x7f61f014be90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:47:14.471 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:14.469+0000 7f61f5190640 1 -- 172.21.15.73:0/3117041905 shutdown_connections 2023-12-12T09:47:14.471 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:14.469+0000 7f61f5190640 1 -- 172.21.15.73:0/3117041905 wait complete. 2023-12-12T09:47:14.489 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-12T09:47:14.695 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:14.693+0000 7f8e08c7c640 1 Processor -- start 2023-12-12T09:47:14.695 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:14.693+0000 7f8e08c7c640 1 -- start start 2023-12-12T09:47:14.696 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:14.694+0000 7f8e08c7c640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f8e0414f8c0 0x7f8e0406dc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:14.696 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:14.695+0000 7f8e08c7c640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f8e0406d350 0x7f8e04071e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:14.696 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:14.695+0000 7f8e08c7c640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e040c16c0 con 0x7f8e040723a0 2023-12-12T09:47:14.696 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:14.695+0000 7f8e08c7c640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e040c1090 con 0x7f8e0414f8c0 2023-12-12T09:47:14.696 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:14.695+0000 7f8e08c7c640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e040c14b0 con 0x7f8e0406d350 2023-12-12T09:47:14.697 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:14.695+0000 7f8e0259c640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f8e0414f8c0 0x7f8e0406dc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:14.697 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:14.695+0000 7f8e02d9d640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f8e040723a0 0x7f8e04152500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:54690/0 (socket says 172.21.15.73:54690) 2023-12-12T09:47:14.697 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:14.695+0000 7f8e02d9d640 1 -- 172.21.15.73:0/2256214917 learned_addr learned my addr 172.21.15.73:0/2256214917 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-12T09:47:14.697 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:14.695+0000 7f8dfbfff640 1 --2- 172.21.15.73:0/2256214917 >> v2:172.21.15.142:3300/0 conn(0x7f8e0406d350 0x7f8e04071e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:14.697 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:14.696+0000 7f8e0259c640 1 -- 172.21.15.73:0/2256214917 >> v2:172.21.15.142:3300/0 conn(0x7f8e0406d350 msgr2=0x7f8e04071e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:47:14.697 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:14.696+0000 7f8e0259c640 1 --2- 172.21.15.73:0/2256214917 >> v2:172.21.15.142:3300/0 conn(0x7f8e0406d350 0x7f8e04071e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:14.698 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:14.696+0000 7f8e0259c640 1 -- 172.21.15.73:0/2256214917 >> v1:172.21.15.73:6789/0 conn(0x7f8e040723a0 legacy=0x7f8e04152500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:14.698 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:14.696+0000 7f8e01d9b640 1 -- 172.21.15.73:0/2256214917 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2810961886 0 0) 0x7f8e040c16c0 con 0x7f8e040723a0 2023-12-12T09:47:14.698 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:14.696+0000 7f8e0259c640 1 -- 172.21.15.73:0/2256214917 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e040c19a0 con 0x7f8e0414f8c0 2023-12-12T09:47:14.698 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:14.697+0000 7f8e0259c640 1 --2- 172.21.15.73:0/2256214917 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8e0414f8c0 0x7f8e0406dc40 secure :-1 s=READY pgs=1063 cs=0 l=1 rev1=1 crypto rx=0x7f8e040c3430 tx=0x7f8df402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b35965bd16e9e4ca server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:47:14.699 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:14.697+0000 7f8e01d9b640 1 -- 172.21.15.73:0/2256214917 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8df4031830 con 0x7f8e0414f8c0 2023-12-12T09:47:14.699 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:14.697+0000 7f8e01d9b640 1 -- 172.21.15.73:0/2256214917 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8df4031990 con 0x7f8e0414f8c0 2023-12-12T09:47:14.699 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:14.697+0000 7f8e01d9b640 1 -- 172.21.15.73:0/2256214917 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8df4031d20 con 0x7f8e0414f8c0 2023-12-12T09:47:14.699 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:14.698+0000 7f8e08c7c640 1 -- 172.21.15.73:0/2256214917 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8e0414f8c0 msgr2=0x7f8e0406dc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:14.700 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:14.698+0000 7f8e08c7c640 1 --2- 172.21.15.73:0/2256214917 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8e0414f8c0 0x7f8e0406dc40 secure :-1 s=READY pgs=1063 cs=0 l=1 rev1=1 crypto rx=0x7f8e040c3430 tx=0x7f8df402b8d0 comp rx=0 tx=0).stop 2023-12-12T09:47:14.700 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:14.698+0000 7f8e08c7c640 1 -- 172.21.15.73:0/2256214917 shutdown_connections 2023-12-12T09:47:14.700 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:14.698+0000 7f8e08c7c640 1 --2- 172.21.15.73:0/2256214917 >> v2:172.21.15.142:3300/0 conn(0x7f8e0406d350 0x7f8e04071e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:14.700 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:14.698+0000 7f8e08c7c640 1 --2- 172.21.15.73:0/2256214917 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8e0414f8c0 0x7f8e0406dc40 unknown :-1 s=CLOSED pgs=1063 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:14.700 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:14.698+0000 7f8e08c7c640 1 -- 172.21.15.73:0/2256214917 >> 172.21.15.73:0/2256214917 conn(0x7f8e0406a4e0 msgr2=0x7f8e0406a8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:47:14.700 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:14.698+0000 7f8e08c7c640 1 -- 172.21.15.73:0/2256214917 shutdown_connections 2023-12-12T09:47:14.700 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:14.698+0000 7f8e08c7c640 1 -- 172.21.15.73:0/2256214917 wait complete. 2023-12-12T09:47:14.701 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:14.700+0000 7f8e08c7c640 1 Processor -- start 2023-12-12T09:47:14.701 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:14.700+0000 7f8e08c7c640 1 -- start start 2023-12-12T09:47:14.703 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:14.701+0000 7f8e08c7c640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8e0406d350 0x7f8e040a8a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:14.703 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:14.701+0000 7f8e08c7c640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8e040723a0 0x7f8e04145d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:14.703 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:14.701+0000 7f8e08c7c640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8e0414f8c0 0x7f8e04146290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:14.703 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:14.701+0000 7f8e08c7c640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e04150200 con 0x7f8e040723a0 2023-12-12T09:47:14.703 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:14.701+0000 7f8e08c7c640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e041467d0 con 0x7f8e0414f8c0 2023-12-12T09:47:14.703 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:14.701+0000 7f8e08c7c640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e040aa880 con 0x7f8e0406d350 2023-12-12T09:47:14.703 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:14.701+0000 7f8dfbfff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8e040723a0 0x7f8e04145d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:14.703 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:14.701+0000 7f8dfbfff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8e040723a0 0x7f8e04145d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:54268/0 (socket says 172.21.15.73:54268) 2023-12-12T09:47:14.703 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:14.701+0000 7f8dfbfff640 1 -- 172.21.15.73:0/3747298697 learned_addr learned my addr 172.21.15.73:0/3747298697 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:47:14.703 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:14.701+0000 7f8dfbfff640 1 -- 172.21.15.73:0/3747298697 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8e0406d350 msgr2=0x7f8e040a8a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:14.703 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:14.701+0000 7f8dfbfff640 1 --2- 172.21.15.73:0/3747298697 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8e0406d350 0x7f8e040a8a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:14.703 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:14.701+0000 7f8dfbfff640 1 -- 172.21.15.73:0/3747298697 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8e0414f8c0 msgr2=0x7f8e04146290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:14.704 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:14.701+0000 7f8dfbfff640 1 --2- 172.21.15.73:0/3747298697 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8e0414f8c0 0x7f8e04146290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:14.704 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:14.701+0000 7f8dfbfff640 1 -- 172.21.15.73:0/3747298697 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8df4009400 con 0x7f8e040723a0 2023-12-12T09:47:14.704 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:14.702+0000 7f8dfbfff640 1 --2- 172.21.15.73:0/3747298697 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8e040723a0 0x7f8e04145d50 secure :-1 s=READY pgs=1064 cs=0 l=1 rev1=1 crypto rx=0x7f8dec00d800 tx=0x7f8dec00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:47:14.704 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:14.702+0000 7f8dfaffd640 1 -- 172.21.15.73:0/3747298697 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8dec00b6c0 con 0x7f8e040723a0 2023-12-12T09:47:14.704 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:14.702+0000 7f8dfaffd640 1 -- 172.21.15.73:0/3747298697 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8dec00b820 con 0x7f8e040723a0 2023-12-12T09:47:14.705 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:14.702+0000 7f8dfaffd640 1 -- 172.21.15.73:0/3747298697 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8dec00bbb0 con 0x7f8e040723a0 2023-12-12T09:47:14.705 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:14.702+0000 7f8e08c7c640 1 -- 172.21.15.73:0/3747298697 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e04150410 con 0x7f8e040723a0 2023-12-12T09:47:14.705 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:14.702+0000 7f8e08c7c640 1 -- 172.21.15.73:0/3747298697 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e040a8f40 con 0x7f8e040723a0 2023-12-12T09:47:14.705 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:14.703+0000 7f8e08c7c640 1 -- 172.21.15.73:0/3747298697 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e040aaa50 con 0x7f8e040723a0 2023-12-12T09:47:14.705 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:14.704+0000 7f8dfaffd640 1 -- 172.21.15.73:0/3747298697 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f8dec00bd10 con 0x7f8e040723a0 2023-12-12T09:47:14.706 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:14.705+0000 7f8dfaffd640 1 --2- 172.21.15.73:0/3747298697 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f8de406ae40 0x7f8de406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:14.706 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:14.705+0000 7f8dfaffd640 1 -- 172.21.15.73:0/3747298697 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6623+0+0 (secure 0 0 0) 0x7f8dec089fe0 con 0x7f8e040723a0 2023-12-12T09:47:14.707 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:14.705+0000 7f8e0259c640 1 --2- 172.21.15.73:0/3747298697 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f8de406ae40 0x7f8de406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:14.707 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:14.706+0000 7f8e0259c640 1 --2- 172.21.15.73:0/3747298697 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f8de406ae40 0x7f8de406d300 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f8df4036000 tx=0x7f8df4030000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:47:14.711 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:14.709+0000 7f8dfaffd640 1 -- 172.21.15.73:0/3747298697 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f8dec054c60 con 0x7f8e040723a0 2023-12-12T09:47:14.901 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:14.899+0000 7f8e08c7c640 1 -- 172.21.15.73:0/3747298697 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f8e04067070 con 0x7f8e040723a0 2023-12-12T09:47:14.901 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:14.900+0000 7f8dfaffd640 1 -- 172.21.15.73:0/3747298697 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v81) v1 ==== 100+0+11 (secure 0 0 0) 0x7f8dec058280 con 0x7f8e040723a0 2023-12-12T09:47:14.901 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 64 2023-12-12T09:47:14.904 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:14.902+0000 7f8e08c7c640 1 -- 172.21.15.73:0/3747298697 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f8de406ae40 msgr2=0x7f8de406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:14.904 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:14.902+0000 7f8e08c7c640 1 --2- 172.21.15.73:0/3747298697 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f8de406ae40 0x7f8de406d300 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f8df4036000 tx=0x7f8df4030000 comp rx=0 tx=0).stop 2023-12-12T09:47:14.904 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:14.902+0000 7f8e08c7c640 1 -- 172.21.15.73:0/3747298697 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8e040723a0 msgr2=0x7f8e04145d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:14.904 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:14.902+0000 7f8e08c7c640 1 --2- 172.21.15.73:0/3747298697 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8e040723a0 0x7f8e04145d50 secure :-1 s=READY pgs=1064 cs=0 l=1 rev1=1 crypto rx=0x7f8dec00d800 tx=0x7f8dec00dcc0 comp rx=0 tx=0).stop 2023-12-12T09:47:14.904 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:14.902+0000 7f8e08c7c640 1 -- 172.21.15.73:0/3747298697 shutdown_connections 2023-12-12T09:47:14.904 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:14.902+0000 7f8e08c7c640 1 --2- 172.21.15.73:0/3747298697 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f8de406ae40 0x7f8de406d300 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:14.905 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:14.902+0000 7f8e08c7c640 1 --2- 172.21.15.73:0/3747298697 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8e0414f8c0 0x7f8e04146290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:14.905 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:14.902+0000 7f8e08c7c640 1 --2- 172.21.15.73:0/3747298697 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8e040723a0 0x7f8e04145d50 unknown :-1 s=CLOSED pgs=1064 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:14.905 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:14.902+0000 7f8e08c7c640 1 --2- 172.21.15.73:0/3747298697 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8e0406d350 0x7f8e040a8a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:14.905 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:14.902+0000 7f8e08c7c640 1 -- 172.21.15.73:0/3747298697 >> 172.21.15.73:0/3747298697 conn(0x7f8e0406a4e0 msgr2=0x7f8e04152500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:47:14.905 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:14.903+0000 7f8e08c7c640 1 -- 172.21.15.73:0/3747298697 shutdown_connections 2023-12-12T09:47:14.905 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:14.903+0000 7f8e08c7c640 1 -- 172.21.15.73:0/3747298697 wait complete. 2023-12-12T09:47:14.923 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_metadata pg_num 2023-12-12T09:47:15.135 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:15.133+0000 7f4b913be640 1 Processor -- start 2023-12-12T09:47:15.135 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:15.133+0000 7f4b913be640 1 -- start start 2023-12-12T09:47:15.137 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:15.135+0000 7f4b913be640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f4b8c0c23b0 0x7f4b8c0c0320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:15.137 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:15.135+0000 7f4b913be640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4b8c06cc90 0x7f4b8c0c2790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:15.137 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:15.135+0000 7f4b913be640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b8c0c1520 con 0x7f4b8c159410 2023-12-12T09:47:15.137 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:15.135+0000 7f4b913be640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b8c0c46f0 con 0x7f4b8c0c23b0 2023-12-12T09:47:15.137 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:15.135+0000 7f4b913be640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b8c06d0d0 con 0x7f4b8c06cc90 2023-12-12T09:47:15.138 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:15.135+0000 7f4b8affd640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f4b8c0c23b0 0x7f4b8c0c0320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:15.138 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:15.135+0000 7f4b8affd640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f4b8c0c23b0 0x7f4b8c0c0320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:54282/0 (socket says 172.21.15.73:54282) 2023-12-12T09:47:15.138 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:15.135+0000 7f4b8affd640 1 -- 172.21.15.73:0/3316370935 learned_addr learned my addr 172.21.15.73:0/3316370935 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:47:15.138 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:15.136+0000 7f4b8a7fc640 1 --2- 172.21.15.73:0/3316370935 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4b8c06cc90 0x7f4b8c0c2790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:15.138 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:15.136+0000 7f4b8affd640 1 -- 172.21.15.73:0/3316370935 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4b8c06cc90 msgr2=0x7f4b8c0c2790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:47:15.138 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:15.136+0000 7f4b8affd640 1 --2- 172.21.15.73:0/3316370935 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4b8c06cc90 0x7f4b8c0c2790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:15.138 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:15.136+0000 7f4b8affd640 1 -- 172.21.15.73:0/3316370935 >> v1:172.21.15.142:6789/0 conn(0x7f4b8c159410 legacy=0x7f4b8c0c50d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:47:15.138 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:15.136+0000 7f4b8affd640 1 -- 172.21.15.73:0/3316370935 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b8c0c57e0 con 0x7f4b8c0c23b0 2023-12-12T09:47:15.139 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:15.137+0000 7f4b8affd640 1 --2- 172.21.15.73:0/3316370935 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4b8c0c23b0 0x7f4b8c0c0320 secure :-1 s=READY pgs=1065 cs=0 l=1 rev1=1 crypto rx=0x7f4b7c009870 tx=0x7f4b7c02b7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37caba885e0e817c server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:47:15.139 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:15.137+0000 7f4b89ffb640 1 -- 172.21.15.73:0/3316370935 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b7c031740 con 0x7f4b8c0c23b0 2023-12-12T09:47:15.139 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:15.137+0000 7f4b89ffb640 1 -- 172.21.15.73:0/3316370935 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b7c0318a0 con 0x7f4b8c0c23b0 2023-12-12T09:47:15.139 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:15.137+0000 7f4b89ffb640 1 -- 172.21.15.73:0/3316370935 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b7c031c30 con 0x7f4b8c0c23b0 2023-12-12T09:47:15.140 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:15.138+0000 7f4b913be640 1 -- 172.21.15.73:0/3316370935 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4b8c0c23b0 msgr2=0x7f4b8c0c0320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:15.140 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:15.138+0000 7f4b913be640 1 --2- 172.21.15.73:0/3316370935 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4b8c0c23b0 0x7f4b8c0c0320 secure :-1 s=READY pgs=1065 cs=0 l=1 rev1=1 crypto rx=0x7f4b7c009870 tx=0x7f4b7c02b7e0 comp rx=0 tx=0).stop 2023-12-12T09:47:15.140 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:15.138+0000 7f4b913be640 1 -- 172.21.15.73:0/3316370935 shutdown_connections 2023-12-12T09:47:15.140 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:15.138+0000 7f4b913be640 1 --2- 172.21.15.73:0/3316370935 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4b8c06cc90 0x7f4b8c0c2790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:15.140 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:15.138+0000 7f4b913be640 1 --2- 172.21.15.73:0/3316370935 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4b8c0c23b0 0x7f4b8c0c0320 unknown :-1 s=CLOSED pgs=1065 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:15.140 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:15.138+0000 7f4b913be640 1 -- 172.21.15.73:0/3316370935 >> 172.21.15.73:0/3316370935 conn(0x7f4b8c06a4e0 msgr2=0x7f4b8c06a8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:47:15.140 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:15.138+0000 7f4b913be640 1 -- 172.21.15.73:0/3316370935 shutdown_connections 2023-12-12T09:47:15.140 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:15.138+0000 7f4b913be640 1 -- 172.21.15.73:0/3316370935 wait complete. 2023-12-12T09:47:15.142 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:15.140+0000 7f4b913be640 1 Processor -- start 2023-12-12T09:47:15.142 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:15.141+0000 7f4b913be640 1 -- start start 2023-12-12T09:47:15.145 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:15.142+0000 7f4b913be640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4b8c06cc90 0x7f4b8c15c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:15.145 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:15.142+0000 7f4b913be640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4b8c0c23b0 0x7f4b8c15b8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:15.145 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:15.142+0000 7f4b913be640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4b8c159410 0x7f4b8c14d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:15.145 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:15.142+0000 7f4b913be640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b8c15abe0 con 0x7f4b8c06cc90 2023-12-12T09:47:15.145 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:15.142+0000 7f4b913be640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b8c15ce30 con 0x7f4b8c159410 2023-12-12T09:47:15.145 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:15.142+0000 7f4b913be640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b8c159fd0 con 0x7f4b8c0c23b0 2023-12-12T09:47:15.145 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:15.142+0000 7f4b8affd640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4b8c06cc90 0x7f4b8c15c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:15.145 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:15.142+0000 7f4b8affd640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4b8c06cc90 0x7f4b8c15c8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:54294/0 (socket says 172.21.15.73:54294) 2023-12-12T09:47:15.145 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:15.142+0000 7f4b8affd640 1 -- 172.21.15.73:0/2894180802 learned_addr learned my addr 172.21.15.73:0/2894180802 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:47:15.146 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:15.142+0000 7f4b8b7fe640 1 --2- 172.21.15.73:0/2894180802 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4b8c159410 0x7f4b8c14d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:15.146 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:15.142+0000 7f4b8a7fc640 1 --2- 172.21.15.73:0/2894180802 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4b8c0c23b0 0x7f4b8c15b8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:15.146 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:15.142+0000 7f4b8affd640 1 -- 172.21.15.73:0/2894180802 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4b8c0c23b0 msgr2=0x7f4b8c15b8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:15.146 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:15.142+0000 7f4b8affd640 1 --2- 172.21.15.73:0/2894180802 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4b8c0c23b0 0x7f4b8c15b8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:15.146 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:15.142+0000 7f4b8affd640 1 -- 172.21.15.73:0/2894180802 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4b8c159410 msgr2=0x7f4b8c14d990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:15.146 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:15.142+0000 7f4b8affd640 1 --2- 172.21.15.73:0/2894180802 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4b8c159410 0x7f4b8c14d990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:15.146 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:15.143+0000 7f4b8affd640 1 -- 172.21.15.73:0/2894180802 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b7c0094d0 con 0x7f4b8c06cc90 2023-12-12T09:47:15.146 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:15.143+0000 7f4b8b7fe640 1 --2- 172.21.15.73:0/2894180802 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4b8c159410 0x7f4b8c14d990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:47:15.146 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:15.143+0000 7f4b8affd640 1 --2- 172.21.15.73:0/2894180802 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4b8c06cc90 0x7f4b8c15c8f0 secure :-1 s=READY pgs=1066 cs=0 l=1 rev1=1 crypto rx=0x7f4b7c009870 tx=0x7f4b7c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:47:15.146 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:15.143+0000 7f4b737fe640 1 -- 172.21.15.73:0/2894180802 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b7c033c70 con 0x7f4b8c06cc90 2023-12-12T09:47:15.146 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:15.143+0000 7f4b737fe640 1 -- 172.21.15.73:0/2894180802 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b7c033dd0 con 0x7f4b8c06cc90 2023-12-12T09:47:15.146 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:15.143+0000 7f4b737fe640 1 -- 172.21.15.73:0/2894180802 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b7c03c640 con 0x7f4b8c06cc90 2023-12-12T09:47:15.146 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:15.143+0000 7f4b913be640 1 -- 172.21.15.73:0/2894180802 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b8c15a2b0 con 0x7f4b8c06cc90 2023-12-12T09:47:15.146 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:15.143+0000 7f4b913be640 1 -- 172.21.15.73:0/2894180802 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b8c15a870 con 0x7f4b8c06cc90 2023-12-12T09:47:15.147 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:15.145+0000 7f4b913be640 1 -- 172.21.15.73:0/2894180802 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b8c15aa00 con 0x7f4b8c06cc90 2023-12-12T09:47:15.147 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:15.146+0000 7f4b737fe640 1 -- 172.21.15.73:0/2894180802 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f4b7c03a040 con 0x7f4b8c06cc90 2023-12-12T09:47:15.148 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:15.146+0000 7f4b737fe640 1 --2- 172.21.15.73:0/2894180802 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f4b7806ae70 0x7f4b7806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:15.148 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:15.146+0000 7f4b737fe640 1 -- 172.21.15.73:0/2894180802 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6623+0+0 (secure 0 0 0) 0x7f4b7c0ab2e0 con 0x7f4b8c06cc90 2023-12-12T09:47:15.148 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:15.147+0000 7f4b8a7fc640 1 --2- 172.21.15.73:0/2894180802 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f4b7806ae70 0x7f4b7806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:15.149 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:15.147+0000 7f4b8a7fc640 1 --2- 172.21.15.73:0/2894180802 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f4b7806ae70 0x7f4b7806d330 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f4b8c157a70 tx=0x7f4b80008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:47:15.152 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:15.151+0000 7f4b737fe640 1 -- 172.21.15.73:0/2894180802 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f4b7c076090 con 0x7f4b8c06cc90 2023-12-12T09:47:15.345 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:15.344+0000 7f4b913be640 1 -- 172.21.15.73:0/2894180802 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"} v 0) v1 -- 0x7f4b8c0c1520 con 0x7f4b8c06cc90 2023-12-12T09:47:15.346 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:15.344+0000 7f4b737fe640 1 -- 172.21.15.73:0/2894180802 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"}]=0 v81) v1 ==== 105+0+11 (secure 0 0 0) 0x7f4b8c0c1520 con 0x7f4b8c06cc90 2023-12-12T09:47:15.346 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 32 2023-12-12T09:47:15.349 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:15.347+0000 7f4b913be640 1 -- 172.21.15.73:0/2894180802 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f4b7806ae70 msgr2=0x7f4b7806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:15.349 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:15.347+0000 7f4b913be640 1 --2- 172.21.15.73:0/2894180802 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f4b7806ae70 0x7f4b7806d330 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f4b8c157a70 tx=0x7f4b80008040 comp rx=0 tx=0).stop 2023-12-12T09:47:15.349 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:15.347+0000 7f4b913be640 1 -- 172.21.15.73:0/2894180802 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4b8c06cc90 msgr2=0x7f4b8c15c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:15.349 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:15.347+0000 7f4b913be640 1 --2- 172.21.15.73:0/2894180802 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4b8c06cc90 0x7f4b8c15c8f0 secure :-1 s=READY pgs=1066 cs=0 l=1 rev1=1 crypto rx=0x7f4b7c009870 tx=0x7f4b7c0046c0 comp rx=0 tx=0).stop 2023-12-12T09:47:15.349 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:15.347+0000 7f4b913be640 1 -- 172.21.15.73:0/2894180802 shutdown_connections 2023-12-12T09:47:15.350 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:15.347+0000 7f4b913be640 1 --2- 172.21.15.73:0/2894180802 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f4b7806ae70 0x7f4b7806d330 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:15.350 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:15.347+0000 7f4b913be640 1 --2- 172.21.15.73:0/2894180802 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4b8c159410 0x7f4b8c14d990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:15.350 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:15.347+0000 7f4b913be640 1 --2- 172.21.15.73:0/2894180802 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4b8c0c23b0 0x7f4b8c15b8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:15.350 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:15.347+0000 7f4b913be640 1 --2- 172.21.15.73:0/2894180802 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4b8c06cc90 0x7f4b8c15c8f0 unknown :-1 s=CLOSED pgs=1066 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:15.350 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:15.348+0000 7f4b913be640 1 -- 172.21.15.73:0/2894180802 >> 172.21.15.73:0/2894180802 conn(0x7f4b8c06a4e0 msgr2=0x7f4b8c158c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:47:15.350 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:15.348+0000 7f4b913be640 1 -- 172.21.15.73:0/2894180802 shutdown_connections 2023-12-12T09:47:15.350 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:15.348+0000 7f4b913be640 1 -- 172.21.15.73:0/2894180802 wait complete. 2023-12-12T09:47:15.368 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_data pg_num 2023-12-12T09:47:15.586 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:15.584+0000 7f0f13a90640 1 Processor -- start 2023-12-12T09:47:15.586 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:15.585+0000 7f0f13a90640 1 -- start start 2023-12-12T09:47:15.588 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:15.586+0000 7f0f13a90640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f0f0c14f8c0 0x7f0f0c06dc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:15.588 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:15.586+0000 7f0f13a90640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f0f0c06d350 0x7f0f0c071e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:15.588 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:15.586+0000 7f0f13a90640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f0c0c16c0 con 0x7f0f0c0723a0 2023-12-12T09:47:15.588 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:15.586+0000 7f0f13a90640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f0c0c1090 con 0x7f0f0c14f8c0 2023-12-12T09:47:15.588 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:15.586+0000 7f0f13a90640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f0c0c14b0 con 0x7f0f0c06d350 2023-12-12T09:47:15.588 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:15.586+0000 7f0f1182c640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f0f0c14f8c0 0x7f0f0c06dc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:15.588 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:15.586+0000 7f0f1202d640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f0f0c0723a0 0x7f0f0c152500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:54692/0 (socket says 172.21.15.73:54692) 2023-12-12T09:47:15.588 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:15.586+0000 7f0f1202d640 1 -- 172.21.15.73:0/2078990532 learned_addr learned my addr 172.21.15.73:0/2078990532 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-12T09:47:15.589 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:15.587+0000 7f0f1102b640 1 --2- 172.21.15.73:0/2078990532 >> v2:172.21.15.142:3300/0 conn(0x7f0f0c06d350 0x7f0f0c071e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:15.589 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:15.587+0000 7f0f1182c640 1 -- 172.21.15.73:0/2078990532 >> v2:172.21.15.142:3300/0 conn(0x7f0f0c06d350 msgr2=0x7f0f0c071e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:47:15.589 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:15.587+0000 7f0f1182c640 1 --2- 172.21.15.73:0/2078990532 >> v2:172.21.15.142:3300/0 conn(0x7f0f0c06d350 0x7f0f0c071e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:15.589 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:15.587+0000 7f0f1182c640 1 -- 172.21.15.73:0/2078990532 >> v1:172.21.15.73:6789/0 conn(0x7f0f0c0723a0 legacy=0x7f0f0c152500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:15.589 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:15.587+0000 7f0f1182c640 1 -- 172.21.15.73:0/2078990532 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f0c0c19a0 con 0x7f0f0c14f8c0 2023-12-12T09:47:15.589 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:15.587+0000 7f0f1102b640 1 --2- 172.21.15.73:0/2078990532 >> v2:172.21.15.142:3300/0 conn(0x7f0f0c06d350 0x7f0f0c071e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:47:15.590 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:15.588+0000 7f0f1182c640 1 --2- 172.21.15.73:0/2078990532 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0f0c14f8c0 0x7f0f0c06dc40 secure :-1 s=READY pgs=1068 cs=0 l=1 rev1=1 crypto rx=0x7f0f0c0c3430 tx=0x7f0f0802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca848f6b5fb8d7cc server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:47:15.590 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:15.588+0000 7f0f1082a640 1 -- 172.21.15.73:0/2078990532 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f08031830 con 0x7f0f0c14f8c0 2023-12-12T09:47:15.590 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:15.588+0000 7f0f1082a640 1 -- 172.21.15.73:0/2078990532 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f08031990 con 0x7f0f0c14f8c0 2023-12-12T09:47:15.590 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:15.588+0000 7f0f1082a640 1 -- 172.21.15.73:0/2078990532 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f08031d20 con 0x7f0f0c14f8c0 2023-12-12T09:47:15.591 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:15.589+0000 7f0f13a90640 1 -- 172.21.15.73:0/2078990532 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0f0c14f8c0 msgr2=0x7f0f0c06dc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:15.591 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:15.589+0000 7f0f13a90640 1 --2- 172.21.15.73:0/2078990532 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0f0c14f8c0 0x7f0f0c06dc40 secure :-1 s=READY pgs=1068 cs=0 l=1 rev1=1 crypto rx=0x7f0f0c0c3430 tx=0x7f0f0802b8d0 comp rx=0 tx=0).stop 2023-12-12T09:47:15.591 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:15.589+0000 7f0f13a90640 1 -- 172.21.15.73:0/2078990532 shutdown_connections 2023-12-12T09:47:15.591 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:15.589+0000 7f0f13a90640 1 --2- 172.21.15.73:0/2078990532 >> v2:172.21.15.142:3300/0 conn(0x7f0f0c06d350 0x7f0f0c071e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:15.591 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:15.589+0000 7f0f13a90640 1 --2- 172.21.15.73:0/2078990532 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0f0c14f8c0 0x7f0f0c06dc40 unknown :-1 s=CLOSED pgs=1068 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:15.591 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:15.589+0000 7f0f13a90640 1 -- 172.21.15.73:0/2078990532 >> 172.21.15.73:0/2078990532 conn(0x7f0f0c06a4e0 msgr2=0x7f0f0c06a8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:47:15.591 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:15.589+0000 7f0f13a90640 1 -- 172.21.15.73:0/2078990532 shutdown_connections 2023-12-12T09:47:15.591 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:15.589+0000 7f0f13a90640 1 -- 172.21.15.73:0/2078990532 wait complete. 2023-12-12T09:47:15.592 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:15.591+0000 7f0f13a90640 1 Processor -- start 2023-12-12T09:47:15.592 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:15.591+0000 7f0f13a90640 1 -- start start 2023-12-12T09:47:15.593 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:15.592+0000 7f0f13a90640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0f0c06d350 0x7f0f0c0befc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:15.593 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:15.592+0000 7f0f13a90640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0f0c0723a0 0x7f0f0c14b110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:15.593 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:15.592+0000 7f0f13a90640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0f0c14f8c0 0x7f0f0c143b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:15.594 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:15.592+0000 7f0f13a90640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f0c071df0 con 0x7f0f0c06d350 2023-12-12T09:47:15.594 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:15.592+0000 7f0f13a90640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f0c1ed0b0 con 0x7f0f0c14f8c0 2023-12-12T09:47:15.594 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:15.592+0000 7f0f13a90640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f0c1ed390 con 0x7f0f0c0723a0 2023-12-12T09:47:15.594 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:15.592+0000 7f0f1182c640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0f0c06d350 0x7f0f0c0befc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:15.594 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:15.592+0000 7f0f1182c640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0f0c06d350 0x7f0f0c0befc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:54320/0 (socket says 172.21.15.73:54320) 2023-12-12T09:47:15.594 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:15.592+0000 7f0f1182c640 1 -- 172.21.15.73:0/2563685376 learned_addr learned my addr 172.21.15.73:0/2563685376 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:47:15.595 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:15.592+0000 7f0f1182c640 1 -- 172.21.15.73:0/2563685376 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0f0c0723a0 msgr2=0x7f0f0c14b110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:15.595 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:15.592+0000 7f0f1182c640 1 --2- 172.21.15.73:0/2563685376 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0f0c0723a0 0x7f0f0c14b110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:15.595 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:15.592+0000 7f0f1182c640 1 -- 172.21.15.73:0/2563685376 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0f0c14f8c0 msgr2=0x7f0f0c143b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:15.595 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:15.592+0000 7f0f1182c640 1 --2- 172.21.15.73:0/2563685376 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0f0c14f8c0 0x7f0f0c143b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:15.595 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:15.592+0000 7f0f1182c640 1 -- 172.21.15.73:0/2563685376 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f08009400 con 0x7f0f0c06d350 2023-12-12T09:47:15.595 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:15.593+0000 7f0f1182c640 1 --2- 172.21.15.73:0/2563685376 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0f0c06d350 0x7f0f0c0befc0 secure :-1 s=READY pgs=1069 cs=0 l=1 rev1=1 crypto rx=0x7f0f08000c00 tx=0x7f0f080046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:47:15.596 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:15.593+0000 7f0efe7fc640 1 -- 172.21.15.73:0/2563685376 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f0803aa60 con 0x7f0f0c06d350 2023-12-12T09:47:15.596 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:15.593+0000 7f0efe7fc640 1 -- 172.21.15.73:0/2563685376 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f0803abe0 con 0x7f0f0c06d350 2023-12-12T09:47:15.596 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:15.593+0000 7f0efe7fc640 1 -- 172.21.15.73:0/2563685376 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f080443f0 con 0x7f0f0c06d350 2023-12-12T09:47:15.596 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:15.593+0000 7f0f13a90640 1 -- 172.21.15.73:0/2563685376 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f0c1ed670 con 0x7f0f0c06d350 2023-12-12T09:47:15.596 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:15.593+0000 7f0f13a90640 1 -- 172.21.15.73:0/2563685376 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f0c1edc30 con 0x7f0f0c06d350 2023-12-12T09:47:15.596 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:15.594+0000 7f0f13a90640 1 -- 172.21.15.73:0/2563685376 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f0c067070 con 0x7f0f0c06d350 2023-12-12T09:47:15.596 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:15.595+0000 7f0efe7fc640 1 -- 172.21.15.73:0/2563685376 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f0f08044550 con 0x7f0f0c06d350 2023-12-12T09:47:15.597 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:15.596+0000 7f0efe7fc640 1 --2- 172.21.15.73:0/2563685376 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f0ef006ae40 0x7f0ef006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:15.597 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:15.596+0000 7f0efe7fc640 1 -- 172.21.15.73:0/2563685376 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6623+0+0 (secure 0 0 0) 0x7f0f080abc70 con 0x7f0f0c06d350 2023-12-12T09:47:15.597 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:15.596+0000 7f0f1102b640 1 --2- 172.21.15.73:0/2563685376 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f0ef006ae40 0x7f0ef006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:15.598 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:15.597+0000 7f0f1102b640 1 --2- 172.21.15.73:0/2563685376 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f0ef006ae40 0x7f0ef006d300 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f0f00006fd0 tx=0x7f0f00008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:47:15.601 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:15.600+0000 7f0efe7fc640 1 -- 172.21.15.73:0/2563685376 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f0f08076aa0 con 0x7f0f0c06d350 2023-12-12T09:47:15.792 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:15.790+0000 7f0f13a90640 1 -- 172.21.15.73:0/2563685376 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"} v 0) v1 -- 0x7f0f0c074700 con 0x7f0f0c06d350 2023-12-12T09:47:15.793 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:15.791+0000 7f0efe7fc640 1 -- 172.21.15.73:0/2563685376 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"}]=0 v81) v1 ==== 101+0+11 (secure 0 0 0) 0x7f0f0807a0c0 con 0x7f0f0c06d350 2023-12-12T09:47:15.793 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 64 2023-12-12T09:47:15.796 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:15.794+0000 7f0f13a90640 1 -- 172.21.15.73:0/2563685376 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f0ef006ae40 msgr2=0x7f0ef006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:15.796 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:15.794+0000 7f0f13a90640 1 --2- 172.21.15.73:0/2563685376 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f0ef006ae40 0x7f0ef006d300 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f0f00006fd0 tx=0x7f0f00008040 comp rx=0 tx=0).stop 2023-12-12T09:47:15.796 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:15.794+0000 7f0f13a90640 1 -- 172.21.15.73:0/2563685376 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0f0c06d350 msgr2=0x7f0f0c0befc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:15.796 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:15.794+0000 7f0f13a90640 1 --2- 172.21.15.73:0/2563685376 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0f0c06d350 0x7f0f0c0befc0 secure :-1 s=READY pgs=1069 cs=0 l=1 rev1=1 crypto rx=0x7f0f08000c00 tx=0x7f0f080046c0 comp rx=0 tx=0).stop 2023-12-12T09:47:15.796 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:15.794+0000 7f0f13a90640 1 -- 172.21.15.73:0/2563685376 shutdown_connections 2023-12-12T09:47:15.796 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:15.794+0000 7f0f13a90640 1 --2- 172.21.15.73:0/2563685376 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f0ef006ae40 0x7f0ef006d300 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:15.796 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:15.794+0000 7f0f13a90640 1 --2- 172.21.15.73:0/2563685376 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0f0c14f8c0 0x7f0f0c143b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:15.796 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:15.794+0000 7f0f13a90640 1 --2- 172.21.15.73:0/2563685376 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0f0c0723a0 0x7f0f0c14b110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:15.796 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:15.794+0000 7f0f13a90640 1 --2- 172.21.15.73:0/2563685376 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0f0c06d350 0x7f0f0c0befc0 unknown :-1 s=CLOSED pgs=1069 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:15.797 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:15.794+0000 7f0f13a90640 1 -- 172.21.15.73:0/2563685376 >> 172.21.15.73:0/2563685376 conn(0x7f0f0c06a4e0 msgr2=0x7f0f0c14c800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:47:15.797 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:15.794+0000 7f0f13a90640 1 -- 172.21.15.73:0/2563685376 shutdown_connections 2023-12-12T09:47:15.797 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:15.794+0000 7f0f13a90640 1 -- 172.21.15.73:0/2563685376 wait complete. 2023-12-12T09:47:15.814 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-12T09:47:16.030 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:16.028+0000 7fece01a9640 1 Processor -- start 2023-12-12T09:47:16.030 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:16.029+0000 7fece01a9640 1 -- start start 2023-12-12T09:47:16.032 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:16.030+0000 7fece01a9640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fecd806bf90 0x7fecd81584f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:16.032 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:16.030+0000 7fece01a9640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fecd806a4e0 0x7fecd806a930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:16.032 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:16.030+0000 7fece01a9640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fecd80c4d00 con 0x7fecd80a5040 2023-12-12T09:47:16.032 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:16.030+0000 7fece01a9640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fecd806c400 con 0x7fecd806bf90 2023-12-12T09:47:16.032 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:16.030+0000 7fece01a9640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fecd80c5100 con 0x7fecd806a4e0 2023-12-12T09:47:16.032 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:16.031+0000 7fecdd744640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fecd806bf90 0x7fecd81584f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:16.032 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:16.031+0000 7fecde746640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fecd806a4e0 0x7fecd806a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:16.033 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:16.031+0000 7fecddf45640 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7fecd80a5040 0x7fecd80c3ad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.73:34106/0 (socket says 172.21.15.73:34106) 2023-12-12T09:47:16.033 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:16.031+0000 7fecde746640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fecd806a4e0 0x7fecd806a930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.73:37336/0 (socket says 172.21.15.73:37336) 2023-12-12T09:47:16.033 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:16.031+0000 7fecdd744640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fecd806bf90 0x7fecd81584f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.73:37806/0 (socket says 172.21.15.73:37806) 2023-12-12T09:47:16.033 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:16.031+0000 7fecddf45640 1 -- 172.21.15.73:0/350231509 learned_addr learned my addr 172.21.15.73:0/350231509 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-12T09:47:16.033 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:16.032+0000 7fecdd744640 1 -- 172.21.15.73:0/350231509 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fecd806a4e0 msgr2=0x7fecd806a930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:47:16.033 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:16.032+0000 7fecdd744640 1 --2- 172.21.15.73:0/350231509 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fecd806a4e0 0x7fecd806a930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:16.034 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:16.032+0000 7fecdd744640 1 -- 172.21.15.73:0/350231509 >> v1:172.21.15.142:6789/0 conn(0x7fecd80a5040 legacy=0x7fecd80c3ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:16.034 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:16.032+0000 7fecdd744640 1 -- 172.21.15.73:0/350231509 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecd80c53e0 con 0x7fecd806bf90 2023-12-12T09:47:16.034 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:16.033+0000 7fecdd744640 1 --2- 172.21.15.73:0/350231509 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fecd806bf90 0x7fecd81584f0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fecc80097a0 tx=0x7fecc802b940 comp rx=0 tx=0).ready entity=mon.1 client_cookie=30209892177f84de server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:47:16.035 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:16.034+0000 7fecdcf43640 1 -- 172.21.15.73:0/350231509 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecc8030800 con 0x7fecd806bf90 2023-12-12T09:47:16.035 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:16.034+0000 7fecdcf43640 1 -- 172.21.15.73:0/350231509 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fecc8030960 con 0x7fecd806bf90 2023-12-12T09:47:16.035 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:16.034+0000 7fecdcf43640 1 -- 172.21.15.73:0/350231509 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecc8030cf0 con 0x7fecd806bf90 2023-12-12T09:47:16.036 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:16.034+0000 7fece01a9640 1 -- 172.21.15.73:0/350231509 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fecd806bf90 msgr2=0x7fecd81584f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:16.036 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:16.034+0000 7fece01a9640 1 --2- 172.21.15.73:0/350231509 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fecd806bf90 0x7fecd81584f0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fecc80097a0 tx=0x7fecc802b940 comp rx=0 tx=0).stop 2023-12-12T09:47:16.036 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:16.034+0000 7fece01a9640 1 -- 172.21.15.73:0/350231509 shutdown_connections 2023-12-12T09:47:16.036 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:16.034+0000 7fece01a9640 1 --2- 172.21.15.73:0/350231509 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fecd806a4e0 0x7fecd806a930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:16.036 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:16.034+0000 7fece01a9640 1 --2- 172.21.15.73:0/350231509 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fecd806bf90 0x7fecd81584f0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:16.037 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:16.034+0000 7fece01a9640 1 -- 172.21.15.73:0/350231509 >> 172.21.15.73:0/350231509 conn(0x7fecd80a8130 msgr2=0x7fecd80c24b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:47:16.037 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:16.034+0000 7fece01a9640 1 -- 172.21.15.73:0/350231509 shutdown_connections 2023-12-12T09:47:16.037 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:16.034+0000 7fece01a9640 1 -- 172.21.15.73:0/350231509 wait complete. 2023-12-12T09:47:16.037 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:16.036+0000 7fece01a9640 1 Processor -- start 2023-12-12T09:47:16.037 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:16.036+0000 7fece01a9640 1 -- start start 2023-12-12T09:47:16.039 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:16.037+0000 7fece01a9640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fecd806a4e0 0x7fecd81570b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:16.039 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:16.037+0000 7fece01a9640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fecd806bf90 0x7fecd8156250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:16.039 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:16.037+0000 7fece01a9640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fecd80a5040 0x7fecd8154110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:16.039 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:16.037+0000 7fece01a9640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecd80706d0 con 0x7fecd806a4e0 2023-12-12T09:47:16.039 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:16.037+0000 7fece01a9640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecd8153c20 con 0x7fecd80a5040 2023-12-12T09:47:16.039 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:16.037+0000 7fece01a9640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fecd80708e0 con 0x7fecd806bf90 2023-12-12T09:47:16.039 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:16.037+0000 7fecddf45640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fecd806a4e0 0x7fecd81570b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:16.039 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:16.037+0000 7fecddf45640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fecd806a4e0 0x7fecd81570b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:54326/0 (socket says 172.21.15.73:54326) 2023-12-12T09:47:16.040 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:16.037+0000 7fecddf45640 1 -- 172.21.15.73:0/1432727532 learned_addr learned my addr 172.21.15.73:0/1432727532 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:47:16.040 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:16.038+0000 7fecde746640 1 --2- 172.21.15.73:0/1432727532 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fecd80a5040 0x7fecd8154110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:16.040 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:16.038+0000 7fecdd744640 1 --2- 172.21.15.73:0/1432727532 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fecd806bf90 0x7fecd8156250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:16.041 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:16.038+0000 7fecddf45640 1 -- 172.21.15.73:0/1432727532 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fecd806bf90 msgr2=0x7fecd8156250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:16.041 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:16.038+0000 7fecddf45640 1 --2- 172.21.15.73:0/1432727532 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fecd806bf90 0x7fecd8156250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:16.041 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:16.038+0000 7fecddf45640 1 -- 172.21.15.73:0/1432727532 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fecd80a5040 msgr2=0x7fecd8154110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:16.041 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:16.038+0000 7fecddf45640 1 --2- 172.21.15.73:0/1432727532 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fecd80a5040 0x7fecd8154110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:16.041 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:16.038+0000 7fecddf45640 1 -- 172.21.15.73:0/1432727532 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecc8009400 con 0x7fecd806a4e0 2023-12-12T09:47:16.041 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:16.038+0000 7fecddf45640 1 --2- 172.21.15.73:0/1432727532 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fecd806a4e0 0x7fecd81570b0 secure :-1 s=READY pgs=1070 cs=0 l=1 rev1=1 crypto rx=0x7fecd400c430 tx=0x7fecd400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:47:16.041 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:16.038+0000 7fecce7fc640 1 -- 172.21.15.73:0/1432727532 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecd4005ce0 con 0x7fecd806a4e0 2023-12-12T09:47:16.041 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:16.039+0000 7fecce7fc640 1 -- 172.21.15.73:0/1432727532 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fecd4005e40 con 0x7fecd806a4e0 2023-12-12T09:47:16.041 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:16.039+0000 7fece01a9640 1 -- 172.21.15.73:0/1432727532 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fecd8070bc0 con 0x7fecd806a4e0 2023-12-12T09:47:16.041 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:16.039+0000 7fecce7fc640 1 -- 172.21.15.73:0/1432727532 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecd4007310 con 0x7fecd806a4e0 2023-12-12T09:47:16.041 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:16.039+0000 7fece01a9640 1 -- 172.21.15.73:0/1432727532 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fecd81538b0 con 0x7fecd806a4e0 2023-12-12T09:47:16.042 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:16.040+0000 7fece01a9640 1 -- 172.21.15.73:0/1432727532 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fecd81546b0 con 0x7fecd806a4e0 2023-12-12T09:47:16.042 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:16.041+0000 7fecce7fc640 1 -- 172.21.15.73:0/1432727532 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fecd4007470 con 0x7fecd806a4e0 2023-12-12T09:47:16.043 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:16.042+0000 7fecce7fc640 1 --2- 172.21.15.73:0/1432727532 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fecbc06ae40 0x7fecbc06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:16.043 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:16.042+0000 7fecce7fc640 1 -- 172.21.15.73:0/1432727532 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6623+0+0 (secure 0 0 0) 0x7fecd4088e80 con 0x7fecd806a4e0 2023-12-12T09:47:16.043 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:16.042+0000 7fecdd744640 1 --2- 172.21.15.73:0/1432727532 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fecbc06ae40 0x7fecbc06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:16.044 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:16.043+0000 7fecdd744640 1 --2- 172.21.15.73:0/1432727532 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fecbc06ae40 0x7fecbc06d300 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7fecc8036000 tx=0x7fecc8008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:47:16.047 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:16.046+0000 7fecce7fc640 1 -- 172.21.15.73:0/1432727532 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fecd4053c30 con 0x7fecd806a4e0 2023-12-12T09:47:16.275 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:16.274+0000 7fece01a9640 1 -- 172.21.15.73:0/1432727532 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fecd8067580 con 0x7fecd806a4e0 2023-12-12T09:47:16.277 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:16.275+0000 7fecce7fc640 1 -- 172.21.15.73:0/1432727532 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 49 v49) v1 ==== 94+0+6137 (secure 0 0 0) 0x7fecd4017090 con 0x7fecd806a4e0 2023-12-12T09:47:16.277 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-12T09:47:16.277 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":49,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4943,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6835/3004685650","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6833","nonce":3004685650},{"type":"v1","addr":"172.21.15.142:6835","nonce":3004685650}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40},{"gid":5365,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6834/3290362874","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6832","nonce":3290362874},{"type":"v1","addr":"172.21.15.142:6834","nonce":3290362874}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40}],"filesystems":[{"mdsmap":{"epoch":44,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-12T09:46:26.429627+0000","modified":"2023-12-12T09:46:29.788335+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6429},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6429":{"gid":6429,"name":"c","rank":0,"incarnation":41,"state":"up:active","state_seq":3,"addr":"172.21.15.73:6837/2352791649","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6835","nonce":2352791649},{"type":"v1","addr":"172.21.15.73:6837","nonce":2352791649}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6},{"mdsmap":{"epoch":49,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-12T09:46:41.791760+0000","modified":"2023-12-12T09:46:44.861785+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6426},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6426":{"gid":6426,"name":"a","rank":0,"incarnation":45,"state":"up:active","state_seq":7,"addr":"172.21.15.73:6836/340095591","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":340095591},{"type":"v1","addr":"172.21.15.73:6836","nonce":340095591}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2023-12-12T09:47:16.278 INFO:teuthology.orchestra.run.smithi073.stderr:dumped fsmap epoch 49 2023-12-12T09:47:16.280 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:16.278+0000 7fece01a9640 1 -- 172.21.15.73:0/1432727532 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fecbc06ae40 msgr2=0x7fecbc06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:16.280 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:16.278+0000 7fece01a9640 1 --2- 172.21.15.73:0/1432727532 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fecbc06ae40 0x7fecbc06d300 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7fecc8036000 tx=0x7fecc8008030 comp rx=0 tx=0).stop 2023-12-12T09:47:16.280 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:16.278+0000 7fece01a9640 1 -- 172.21.15.73:0/1432727532 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fecd806a4e0 msgr2=0x7fecd81570b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:16.280 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:16.278+0000 7fece01a9640 1 --2- 172.21.15.73:0/1432727532 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fecd806a4e0 0x7fecd81570b0 secure :-1 s=READY pgs=1070 cs=0 l=1 rev1=1 crypto rx=0x7fecd400c430 tx=0x7fecd400c8f0 comp rx=0 tx=0).stop 2023-12-12T09:47:16.280 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:16.278+0000 7fece01a9640 1 -- 172.21.15.73:0/1432727532 shutdown_connections 2023-12-12T09:47:16.280 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:16.278+0000 7fece01a9640 1 --2- 172.21.15.73:0/1432727532 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fecbc06ae40 0x7fecbc06d300 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:16.280 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:16.278+0000 7fece01a9640 1 --2- 172.21.15.73:0/1432727532 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fecd80a5040 0x7fecd8154110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:16.280 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:16.278+0000 7fece01a9640 1 --2- 172.21.15.73:0/1432727532 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fecd806bf90 0x7fecd8156250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:16.280 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:16.278+0000 7fece01a9640 1 --2- 172.21.15.73:0/1432727532 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fecd806a4e0 0x7fecd81570b0 unknown :-1 s=CLOSED pgs=1070 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:16.280 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:16.278+0000 7fece01a9640 1 -- 172.21.15.73:0/1432727532 >> 172.21.15.73:0/1432727532 conn(0x7fecd80a8130 msgr2=0x7fecd806c5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:47:16.280 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:16.278+0000 7fece01a9640 1 -- 172.21.15.73:0/1432727532 shutdown_connections 2023-12-12T09:47:16.280 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:16.278+0000 7fece01a9640 1 -- 172.21.15.73:0/1432727532 wait complete. 2023-12-12T09:47:16.298 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-12T09:47:16.503 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:16.501+0000 7f3f2647c640 1 Processor -- start 2023-12-12T09:47:16.503 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:16.502+0000 7f3f2647c640 1 -- start start 2023-12-12T09:47:16.508 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:16.503+0000 7f3f2647c640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3f200a50f0 0x7f3f200a9050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:16.508 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:16.503+0000 7f3f2647c640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f3f2006bf20 0x7f3f200a9590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:16.508 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:16.503+0000 7f3f2647c640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f200c0b50 con 0x7f3f201552e0 2023-12-12T09:47:16.508 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:16.503+0000 7f3f2647c640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f200c04d0 con 0x7f3f2006bf20 2023-12-12T09:47:16.508 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:16.503+0000 7f3f2647c640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f2006c880 con 0x7f3f200a50f0 2023-12-12T09:47:16.508 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:16.503+0000 7f3f1ffff640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f3f201552e0 0x7f3f200c49c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:54706/0 (socket says 172.21.15.73:54706) 2023-12-12T09:47:16.508 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:16.503+0000 7f3f1ffff640 1 -- 172.21.15.73:0/763179307 learned_addr learned my addr 172.21.15.73:0/763179307 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-12T09:47:16.508 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:16.504+0000 7f3f24a19640 1 --2- 172.21.15.73:0/763179307 >> v2:172.21.15.142:3300/0 conn(0x7f3f2006bf20 0x7f3f200a9590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:16.508 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:16.504+0000 7f3f1f7fe640 1 --2- 172.21.15.73:0/763179307 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3f200a50f0 0x7f3f200a9050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:16.509 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:16.504+0000 7f3f1effd640 1 -- 172.21.15.73:0/763179307 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 501521519 0 0) 0x7f3f200c0b50 con 0x7f3f201552e0 2023-12-12T09:47:16.509 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:16.504+0000 7f3f1effd640 1 -- 172.21.15.73:0/763179307 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3f0c003520 con 0x7f3f201552e0 2023-12-12T09:47:16.509 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:16.504+0000 7f3f1effd640 1 -- 172.21.15.73:0/763179307 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1172147725 0 0) 0x7f3f0c003520 con 0x7f3f201552e0 2023-12-12T09:47:16.509 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:16.504+0000 7f3f1effd640 1 -- 172.21.15.73:0/763179307 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3f200a50f0 msgr2=0x7f3f200a9050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:47:16.509 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:16.504+0000 7f3f1effd640 1 --2- 172.21.15.73:0/763179307 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3f200a50f0 0x7f3f200a9050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:16.509 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:16.504+0000 7f3f1effd640 1 -- 172.21.15.73:0/763179307 >> v2:172.21.15.142:3300/0 conn(0x7f3f2006bf20 msgr2=0x7f3f200a9590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:47:16.509 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:16.504+0000 7f3f1effd640 1 --2- 172.21.15.73:0/763179307 >> v2:172.21.15.142:3300/0 conn(0x7f3f2006bf20 0x7f3f200a9590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:16.509 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:16.504+0000 7f3f1effd640 1 -- 172.21.15.73:0/763179307 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f2006cb60 con 0x7f3f201552e0 2023-12-12T09:47:16.509 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:16.504+0000 7f3f1effd640 1 -- 172.21.15.73:0/763179307 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3186547832 0 0) 0x7f3f100019f0 con 0x7f3f201552e0 2023-12-12T09:47:16.509 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:16.504+0000 7f3f1effd640 1 -- 172.21.15.73:0/763179307 >> v1:172.21.15.73:6789/0 conn(0x7f3f201552e0 legacy=0x7f3f200c49c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:16.509 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:16.504+0000 7f3f1effd640 1 --2- 172.21.15.73:0/763179307 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3f0c003970 0x7f3f0c003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:16.509 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:16.504+0000 7f3f1effd640 1 --2- 172.21.15.73:0/763179307 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3f200a50f0 0x7f3f0c0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:16.509 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:16.504+0000 7f3f1effd640 1 --2- 172.21.15.73:0/763179307 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3f0c004d00 0x7f3f0c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:16.509 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:16.504+0000 7f3f1effd640 1 -- 172.21.15.73:0/763179307 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f200c04d0 con 0x7f3f0c004d00 2023-12-12T09:47:16.509 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:16.504+0000 7f3f1effd640 1 -- 172.21.15.73:0/763179307 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f2006c880 con 0x7f3f0c003970 2023-12-12T09:47:16.510 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:16.504+0000 7f3f1effd640 1 -- 172.21.15.73:0/763179307 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f0c00ba30 con 0x7f3f200a50f0 2023-12-12T09:47:16.510 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:16.505+0000 7f3f24a19640 1 --2- 172.21.15.73:0/763179307 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3f0c004d00 0x7f3f0c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:16.510 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:16.505+0000 7f3f1ffff640 1 --2- 172.21.15.73:0/763179307 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3f0c003970 0x7f3f0c003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:16.510 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:16.505+0000 7f3f24a19640 1 -- 172.21.15.73:0/763179307 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3f200a50f0 msgr2=0x7f3f0c0047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:47:16.510 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:16.505+0000 7f3f1f7fe640 1 --2- 172.21.15.73:0/763179307 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3f200a50f0 0x7f3f0c0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:16.510 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:16.505+0000 7f3f24a19640 1 --2- 172.21.15.73:0/763179307 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3f200a50f0 0x7f3f0c0047c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:16.510 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:16.505+0000 7f3f24a19640 1 -- 172.21.15.73:0/763179307 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3f0c003970 msgr2=0x7f3f0c003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:47:16.510 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:16.505+0000 7f3f24a19640 1 --2- 172.21.15.73:0/763179307 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3f0c003970 0x7f3f0c003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:16.510 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:16.505+0000 7f3f24a19640 1 -- 172.21.15.73:0/763179307 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f0c003520 con 0x7f3f0c004d00 2023-12-12T09:47:16.510 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:16.505+0000 7f3f1ffff640 1 --2- 172.21.15.73:0/763179307 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3f0c003970 0x7f3f0c003d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:47:16.510 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:16.506+0000 7f3f24a19640 1 --2- 172.21.15.73:0/763179307 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3f0c004d00 0x7f3f0c005180 secure :-1 s=READY pgs=1072 cs=0 l=1 rev1=1 crypto rx=0x7f3f18009ac0 tx=0x7f3f0c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c532f1c312740622 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:47:16.510 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:16.507+0000 7f3f1effd640 1 -- 172.21.15.73:0/763179307 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f1802c710 con 0x7f3f0c004d00 2023-12-12T09:47:16.510 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:16.507+0000 7f3f1effd640 1 -- 172.21.15.73:0/763179307 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f1802c870 con 0x7f3f0c004d00 2023-12-12T09:47:16.511 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:16.507+0000 7f3f1effd640 1 -- 172.21.15.73:0/763179307 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f1802cc00 con 0x7f3f0c004d00 2023-12-12T09:47:16.513 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:16.507+0000 7f3f2647c640 1 -- 172.21.15.73:0/763179307 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3f0c004d00 msgr2=0x7f3f0c005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:16.513 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:16.507+0000 7f3f2647c640 1 --2- 172.21.15.73:0/763179307 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3f0c004d00 0x7f3f0c005180 secure :-1 s=READY pgs=1072 cs=0 l=1 rev1=1 crypto rx=0x7f3f18009ac0 tx=0x7f3f0c0057f0 comp rx=0 tx=0).stop 2023-12-12T09:47:16.513 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:16.507+0000 7f3f24a19640 1 -- 172.21.15.73:0/763179307 reap_dead start 2023-12-12T09:47:16.513 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:16.507+0000 7f3f2647c640 1 -- 172.21.15.73:0/763179307 shutdown_connections 2023-12-12T09:47:16.513 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:16.507+0000 7f3f2647c640 1 -- 172.21.15.73:0/763179307 >> 172.21.15.73:0/763179307 conn(0x7f3f200a8130 msgr2=0x7f3f200c24b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:47:16.513 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:16.507+0000 7f3f2647c640 1 -- 172.21.15.73:0/763179307 shutdown_connections 2023-12-12T09:47:16.513 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:16.507+0000 7f3f2647c640 1 -- 172.21.15.73:0/763179307 wait complete. 2023-12-12T09:47:16.513 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:16.509+0000 7f3f2647c640 1 Processor -- start 2023-12-12T09:47:16.513 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:16.509+0000 7f3f2647c640 1 -- start start 2023-12-12T09:47:16.513 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:16.510+0000 7f3f2647c640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3f0c004d00 0x7f3f201eab70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:16.513 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:16.510+0000 7f3f2647c640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3f200aa2a0 0x7f3f2014dcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:16.514 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:16.510+0000 7f3f2647c640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3f2014e1f0 0x7f3f201ebb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:16.514 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:16.510+0000 7f3f2647c640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f201eb730 con 0x7f3f0c004d00 2023-12-12T09:47:16.514 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:16.510+0000 7f3f2647c640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f201eb0b0 con 0x7f3f2014e1f0 2023-12-12T09:47:16.514 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:16.510+0000 7f3f2647c640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f200aadb0 con 0x7f3f200aa2a0 2023-12-12T09:47:16.514 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:16.510+0000 7f3f1ffff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3f0c004d00 0x7f3f201eab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:16.514 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:16.510+0000 7f3f1ffff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3f0c004d00 0x7f3f201eab70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:54346/0 (socket says 172.21.15.73:54346) 2023-12-12T09:47:16.514 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:16.510+0000 7f3f1ffff640 1 -- 172.21.15.73:0/1090398880 learned_addr learned my addr 172.21.15.73:0/1090398880 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:47:16.514 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:16.511+0000 7f3f1ffff640 1 -- 172.21.15.73:0/1090398880 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3f200aa2a0 msgr2=0x7f3f2014dcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:16.514 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:16.511+0000 7f3f1ffff640 1 --2- 172.21.15.73:0/1090398880 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3f200aa2a0 0x7f3f2014dcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:16.514 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:16.511+0000 7f3f1ffff640 1 -- 172.21.15.73:0/1090398880 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3f2014e1f0 msgr2=0x7f3f201ebb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:16.514 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:16.511+0000 7f3f1ffff640 1 --2- 172.21.15.73:0/1090398880 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3f2014e1f0 0x7f3f201ebb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:16.515 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:16.511+0000 7f3f1ffff640 1 -- 172.21.15.73:0/1090398880 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f2014e670 con 0x7f3f0c004d00 2023-12-12T09:47:16.515 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:16.511+0000 7f3f1ffff640 1 --2- 172.21.15.73:0/1090398880 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3f0c004d00 0x7f3f201eab70 secure :-1 s=READY pgs=1073 cs=0 l=1 rev1=1 crypto rx=0x7f3f1000dfb0 tx=0x7f3f1000b560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:47:16.515 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:16.511+0000 7f3f1cff9640 1 -- 172.21.15.73:0/1090398880 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f10004d60 con 0x7f3f0c004d00 2023-12-12T09:47:16.515 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:16.511+0000 7f3f1cff9640 1 -- 172.21.15.73:0/1090398880 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f100070d0 con 0x7f3f0c004d00 2023-12-12T09:47:16.515 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:16.511+0000 7f3f2647c640 1 -- 172.21.15.73:0/1090398880 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f20151bc0 con 0x7f3f0c004d00 2023-12-12T09:47:16.515 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:16.511+0000 7f3f1cff9640 1 -- 172.21.15.73:0/1090398880 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f10007440 con 0x7f3f0c004d00 2023-12-12T09:47:16.515 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:16.511+0000 7f3f2647c640 1 -- 172.21.15.73:0/1090398880 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f20151600 con 0x7f3f0c004d00 2023-12-12T09:47:16.515 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:16.513+0000 7f3f2647c640 1 -- 172.21.15.73:0/1090398880 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f20067580 con 0x7f3f0c004d00 2023-12-12T09:47:16.515 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:16.514+0000 7f3f1cff9640 1 -- 172.21.15.73:0/1090398880 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f3f100075a0 con 0x7f3f0c004d00 2023-12-12T09:47:16.516 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:16.514+0000 7f3f1cff9640 1 --2- 172.21.15.73:0/1090398880 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f3f0006ae40 0x7f3f0006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:16.516 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:16.515+0000 7f3f1cff9640 1 -- 172.21.15.73:0/1090398880 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6623+0+0 (secure 0 0 0) 0x7f3f10089de0 con 0x7f3f0c004d00 2023-12-12T09:47:16.516 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:16.515+0000 7f3f1f7fe640 1 --2- 172.21.15.73:0/1090398880 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f3f0006ae40 0x7f3f0006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:16.516 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:16.515+0000 7f3f1f7fe640 1 --2- 172.21.15.73:0/1090398880 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f3f0006ae40 0x7f3f0006d300 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f3f08006a90 tx=0x7f3f08006a20 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:47:16.520 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:16.519+0000 7f3f1cff9640 1 -- 172.21.15.73:0/1090398880 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f3f10054af0 con 0x7f3f0c004d00 2023-12-12T09:47:16.715 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:16.713+0000 7f3f2647c640 1 -- 172.21.15.73:0/1090398880 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3f2006b460 con 0x7f3f0c004d00 2023-12-12T09:47:16.718 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:16.716+0000 7f3f1cff9640 1 -- 172.21.15.73:0/1090398880 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v81) v1 ==== 74+0+20323 (secure 0 0 0) 0x7f3f10019020 con 0x7f3f0c004d00 2023-12-12T09:47:16.719 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-12T09:47:16.719 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":81,"fsid":"ba240992-02b8-4c7e-92f2-27eb29ac433b","created":"2023-12-12T09:43:02.454719+0000","modified":"2023-12-12T09:47:10.698166+0000","last_up_change":"2023-12-12T09:43:13.913440+0000","last_in_change":"2023-12-12T09:43:05.925348+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-12T09:43:15.525508+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2023-12-12T09:46:24.716544+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2023-12-12T09:46:25.435954+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs2_metadata","create_time":"2023-12-12T09:46:40.116878+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs2_data","create_time":"2023-12-12T09:46:40.798840+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"dd9074be-dbe2-4c34-9896-a4223d8d3940","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":4047810203},{"type":"v1","addr":"172.21.15.73:6801","nonce":4047810203}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":4047810203},{"type":"v1","addr":"172.21.15.73:6803","nonce":4047810203}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":4047810203},{"type":"v1","addr":"172.21.15.73:6807","nonce":4047810203}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":4047810203},{"type":"v1","addr":"172.21.15.73:6805","nonce":4047810203}]},"public_addr":"172.21.15.73:6801/4047810203","cluster_addr":"172.21.15.73:6803/4047810203","heartbeat_back_addr":"172.21.15.73:6807/4047810203","heartbeat_front_addr":"172.21.15.73:6805/4047810203","state":["exists","up"]},{"osd":1,"uuid":"c4a05052-96d4-4758-a4e1-1a37f1e07fed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":1356058331},{"type":"v1","addr":"172.21.15.73:6824","nonce":1356058331}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":1356058331},{"type":"v1","addr":"172.21.15.73:6827","nonce":1356058331}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":1356058331},{"type":"v1","addr":"172.21.15.73:6831","nonce":1356058331}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":1356058331},{"type":"v1","addr":"172.21.15.73:6829","nonce":1356058331}]},"public_addr":"172.21.15.73:6824/1356058331","cluster_addr":"172.21.15.73:6827/1356058331","heartbeat_back_addr":"172.21.15.73:6831/1356058331","heartbeat_front_addr":"172.21.15.73:6829/1356058331","state":["exists","up"]},{"osd":2,"uuid":"512bc8ac-72c2-40d4-b3d2-d867a92c5213","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":1228903316},{"type":"v1","addr":"172.21.15.73:6817","nonce":1228903316}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":1228903316},{"type":"v1","addr":"172.21.15.73:6819","nonce":1228903316}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6823","nonce":1228903316},{"type":"v1","addr":"172.21.15.73:6825","nonce":1228903316}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":1228903316},{"type":"v1","addr":"172.21.15.73:6821","nonce":1228903316}]},"public_addr":"172.21.15.73:6817/1228903316","cluster_addr":"172.21.15.73:6819/1228903316","heartbeat_back_addr":"172.21.15.73:6825/1228903316","heartbeat_front_addr":"172.21.15.73:6821/1228903316","state":["exists","up"]},{"osd":3,"uuid":"3d1a91e0-42bf-437a-8eae-8d357c8f63a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":1293329670},{"type":"v1","addr":"172.21.15.73:6809","nonce":1293329670}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6810","nonce":1293329670},{"type":"v1","addr":"172.21.15.73:6811","nonce":1293329670}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":1293329670},{"type":"v1","addr":"172.21.15.73:6815","nonce":1293329670}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":1293329670},{"type":"v1","addr":"172.21.15.73:6813","nonce":1293329670}]},"public_addr":"172.21.15.73:6809/1293329670","cluster_addr":"172.21.15.73:6811/1293329670","heartbeat_back_addr":"172.21.15.73:6815/1293329670","heartbeat_front_addr":"172.21.15.73:6813/1293329670","state":["exists","up"]},{"osd":4,"uuid":"4b302fff-834c-4069-ac19-00e46f6c87b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":3727975702},{"type":"v1","addr":"172.21.15.142:6801","nonce":3727975702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":3727975702},{"type":"v1","addr":"172.21.15.142:6803","nonce":3727975702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6809","nonce":3727975702},{"type":"v1","addr":"172.21.15.142:6811","nonce":3727975702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6805","nonce":3727975702},{"type":"v1","addr":"172.21.15.142:6807","nonce":3727975702}]},"public_addr":"172.21.15.142:6801/3727975702","cluster_addr":"172.21.15.142:6803/3727975702","heartbeat_back_addr":"172.21.15.142:6811/3727975702","heartbeat_front_addr":"172.21.15.142:6807/3727975702","state":["exists","up"]},{"osd":5,"uuid":"d7cdace2-67d0-45cc-95f2-515cf6ef1b82","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6817","nonce":2353193632},{"type":"v1","addr":"172.21.15.142:6819","nonce":2353193632}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6821","nonce":2353193632},{"type":"v1","addr":"172.21.15.142:6823","nonce":2353193632}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6829","nonce":2353193632},{"type":"v1","addr":"172.21.15.142:6831","nonce":2353193632}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6825","nonce":2353193632},{"type":"v1","addr":"172.21.15.142:6827","nonce":2353193632}]},"public_addr":"172.21.15.142:6819/2353193632","cluster_addr":"172.21.15.142:6823/2353193632","heartbeat_back_addr":"172.21.15.142:6831/2353193632","heartbeat_front_addr":"172.21.15.142:6827/2353193632","state":["exists","up"]},{"osd":6,"uuid":"649ce78a-5626-445c-aedc-a651ed05a6f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":2006111986},{"type":"v1","addr":"172.21.15.142:6806","nonce":2006111986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":2006111986},{"type":"v1","addr":"172.21.15.142:6810","nonce":2006111986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":2006111986},{"type":"v1","addr":"172.21.15.142:6815","nonce":2006111986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":2006111986},{"type":"v1","addr":"172.21.15.142:6813","nonce":2006111986}]},"public_addr":"172.21.15.142:6806/2006111986","cluster_addr":"172.21.15.142:6810/2006111986","heartbeat_back_addr":"172.21.15.142:6815/2006111986","heartbeat_front_addr":"172.21.15.142:6813/2006111986","state":["exists","up"]},{"osd":7,"uuid":"af15ae3b-c1d0-4acf-92db-8a1805494d13","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":2573794341},{"type":"v1","addr":"172.21.15.142:6818","nonce":2573794341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":2573794341},{"type":"v1","addr":"172.21.15.142:6822","nonce":2573794341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":2573794341},{"type":"v1","addr":"172.21.15.142:6830","nonce":2573794341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":2573794341},{"type":"v1","addr":"172.21.15.142:6826","nonce":2573794341}]},"public_addr":"172.21.15.142:6818/2573794341","cluster_addr":"172.21.15.142:6822/2573794341","heartbeat_back_addr":"172.21.15.142:6830/2573794341","heartbeat_front_addr":"172.21.15.142:6826/2573794341","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.185824+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.262103+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.225556+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:10.523459+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:10.706035+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.257339+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.301776+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.051960+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"13.a","mappings":[{"from":1,"to":5}]},{"pgid":"13.3f","mappings":[{"from":6,"to":3}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-12T09:47:16.721 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:16.719+0000 7f3f2647c640 1 -- 172.21.15.73:0/1090398880 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f3f0006ae40 msgr2=0x7f3f0006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:16.721 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:16.719+0000 7f3f2647c640 1 --2- 172.21.15.73:0/1090398880 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f3f0006ae40 0x7f3f0006d300 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f3f08006a90 tx=0x7f3f08006a20 comp rx=0 tx=0).stop 2023-12-12T09:47:16.722 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:16.719+0000 7f3f2647c640 1 -- 172.21.15.73:0/1090398880 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3f0c004d00 msgr2=0x7f3f201eab70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:16.722 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:16.719+0000 7f3f2647c640 1 --2- 172.21.15.73:0/1090398880 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3f0c004d00 0x7f3f201eab70 secure :-1 s=READY pgs=1073 cs=0 l=1 rev1=1 crypto rx=0x7f3f1000dfb0 tx=0x7f3f1000b560 comp rx=0 tx=0).stop 2023-12-12T09:47:16.722 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:16.719+0000 7f3f2647c640 1 -- 172.21.15.73:0/1090398880 shutdown_connections 2023-12-12T09:47:16.722 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:16.719+0000 7f3f2647c640 1 --2- 172.21.15.73:0/1090398880 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f3f0006ae40 0x7f3f0006d300 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:16.722 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:16.719+0000 7f3f2647c640 1 --2- 172.21.15.73:0/1090398880 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3f2014e1f0 0x7f3f201ebb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:16.722 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:16.719+0000 7f3f2647c640 1 --2- 172.21.15.73:0/1090398880 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3f200aa2a0 0x7f3f2014dcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:16.722 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:16.719+0000 7f3f2647c640 1 --2- 172.21.15.73:0/1090398880 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3f0c004d00 0x7f3f201eab70 unknown :-1 s=CLOSED pgs=1073 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:16.722 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:16.719+0000 7f3f2647c640 1 -- 172.21.15.73:0/1090398880 >> 172.21.15.73:0/1090398880 conn(0x7f3f200a8130 msgr2=0x7f3f200bede0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:47:16.722 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:16.720+0000 7f3f2647c640 1 -- 172.21.15.73:0/1090398880 shutdown_connections 2023-12-12T09:47:16.722 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:16.720+0000 7f3f2647c640 1 -- 172.21.15.73:0/1090398880 wait complete. 2023-12-12T09:47:16.740 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-12-12T09:47:16.740 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-12T09:47:16.948 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:16.947+0000 7fe5b00ad640 1 Processor -- start 2023-12-12T09:47:16.949 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:16.947+0000 7fe5b00ad640 1 -- start start 2023-12-12T09:47:16.950 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:16.948+0000 7fe5b00ad640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fe5a806db70 0x7fe5a80c39b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:16.950 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:16.948+0000 7fe5b00ad640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fe5a80c5070 0x7fe5a80c3ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:16.950 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:16.949+0000 7fe5b00ad640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5a8152610 con 0x7fe5a814fa40 2023-12-12T09:47:16.950 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:16.949+0000 7fe5b00ad640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5a81528f0 con 0x7fe5a806db70 2023-12-12T09:47:16.950 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:16.949+0000 7fe5b00ad640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5a8152bd0 con 0x7fe5a80c5070 2023-12-12T09:47:16.951 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:16.949+0000 7fe5ade49640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7fe5a814fa40 0x7fe5a806a4e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:54708/0 (socket says 172.21.15.73:54708) 2023-12-12T09:47:16.951 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:16.949+0000 7fe5ade49640 1 -- 172.21.15.73:0/3445623890 learned_addr learned my addr 172.21.15.73:0/3445623890 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-12T09:47:16.952 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:16.949+0000 7fe5ad648640 1 --2- 172.21.15.73:0/3445623890 >> v2:172.21.15.73:3300/0 conn(0x7fe5a806db70 0x7fe5a80c39b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:16.952 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:16.949+0000 7fe5ae64a640 1 --2- 172.21.15.73:0/3445623890 >> v2:172.21.15.142:3300/0 conn(0x7fe5a80c5070 0x7fe5a80c3ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:16.952 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:16.950+0000 7fe5ace47640 1 -- 172.21.15.73:0/3445623890 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2212133862 0 0) 0x7fe5a8152610 con 0x7fe5a814fa40 2023-12-12T09:47:16.952 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:16.950+0000 7fe5ace47640 1 -- 172.21.15.73:0/3445623890 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe594003520 con 0x7fe5a814fa40 2023-12-12T09:47:16.952 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:16.950+0000 7fe5ad648640 1 -- 172.21.15.73:0/3445623890 >> v2:172.21.15.142:3300/0 conn(0x7fe5a80c5070 msgr2=0x7fe5a80c3ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:47:16.952 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:16.950+0000 7fe5ad648640 1 --2- 172.21.15.73:0/3445623890 >> v2:172.21.15.142:3300/0 conn(0x7fe5a80c5070 0x7fe5a80c3ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:16.952 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:16.950+0000 7fe5ad648640 1 -- 172.21.15.73:0/3445623890 >> v1:172.21.15.73:6789/0 conn(0x7fe5a814fa40 legacy=0x7fe5a806a4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:16.952 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:16.950+0000 7fe5ad648640 1 -- 172.21.15.73:0/3445623890 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5a8152eb0 con 0x7fe5a806db70 2023-12-12T09:47:16.952 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:16.950+0000 7fe5ae64a640 1 --2- 172.21.15.73:0/3445623890 >> v2:172.21.15.142:3300/0 conn(0x7fe5a80c5070 0x7fe5a80c3ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-12T09:47:16.953 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:16.951+0000 7fe5ad648640 1 --2- 172.21.15.73:0/3445623890 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe5a806db70 0x7fe5a80c39b0 secure :-1 s=READY pgs=1075 cs=0 l=1 rev1=1 crypto rx=0x7fe5a806fc50 tx=0x7fe59802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3de7f90f99b6c51 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:47:16.953 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:16.951+0000 7fe5ace47640 1 -- 172.21.15.73:0/3445623890 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe598031830 con 0x7fe5a806db70 2023-12-12T09:47:16.953 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:16.951+0000 7fe5ace47640 1 -- 172.21.15.73:0/3445623890 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe598031990 con 0x7fe5a806db70 2023-12-12T09:47:16.953 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:16.951+0000 7fe5ace47640 1 -- 172.21.15.73:0/3445623890 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe598031d20 con 0x7fe5a806db70 2023-12-12T09:47:16.954 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:16.952+0000 7fe5b00ad640 1 -- 172.21.15.73:0/3445623890 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe5a806db70 msgr2=0x7fe5a80c39b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:16.954 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:16.952+0000 7fe5b00ad640 1 --2- 172.21.15.73:0/3445623890 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe5a806db70 0x7fe5a80c39b0 secure :-1 s=READY pgs=1075 cs=0 l=1 rev1=1 crypto rx=0x7fe5a806fc50 tx=0x7fe59802b8d0 comp rx=0 tx=0).stop 2023-12-12T09:47:16.954 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:16.952+0000 7fe5b00ad640 1 -- 172.21.15.73:0/3445623890 shutdown_connections 2023-12-12T09:47:16.954 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:16.952+0000 7fe5b00ad640 1 --2- 172.21.15.73:0/3445623890 >> v2:172.21.15.142:3300/0 conn(0x7fe5a80c5070 0x7fe5a80c3ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:16.954 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:16.952+0000 7fe5b00ad640 1 --2- 172.21.15.73:0/3445623890 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe5a806db70 0x7fe5a80c39b0 unknown :-1 s=CLOSED pgs=1075 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:16.954 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:16.952+0000 7fe5b00ad640 1 -- 172.21.15.73:0/3445623890 >> 172.21.15.73:0/3445623890 conn(0x7fe5a80a8130 msgr2=0x7fe5a80c24b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:47:16.954 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:16.952+0000 7fe5b00ad640 1 -- 172.21.15.73:0/3445623890 shutdown_connections 2023-12-12T09:47:16.954 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:16.952+0000 7fe5b00ad640 1 -- 172.21.15.73:0/3445623890 wait complete. 2023-12-12T09:47:16.955 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:16.954+0000 7fe5b00ad640 1 Processor -- start 2023-12-12T09:47:16.955 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:16.954+0000 7fe5b00ad640 1 -- start start 2023-12-12T09:47:16.957 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:16.955+0000 7fe5b00ad640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe5a806db70 0x7fe5a8151b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:16.957 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:16.955+0000 7fe5b00ad640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe5a80c5070 0x7fe5a814a170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:16.957 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:16.955+0000 7fe5b00ad640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe5a814fa40 0x7fe5a8148230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:16.957 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:16.955+0000 7fe5b00ad640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5a814ad30 con 0x7fe5a806db70 2023-12-12T09:47:16.957 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:16.955+0000 7fe5b00ad640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5a80a96c0 con 0x7fe5a80c5070 2023-12-12T09:47:16.957 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:16.955+0000 7fe5b00ad640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5a81ed870 con 0x7fe5a814fa40 2023-12-12T09:47:16.957 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:16.955+0000 7fe5ade49640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe5a806db70 0x7fe5a8151b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:16.957 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:16.955+0000 7fe5ade49640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe5a806db70 0x7fe5a8151b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:54368/0 (socket says 172.21.15.73:54368) 2023-12-12T09:47:16.957 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:16.955+0000 7fe5ade49640 1 -- 172.21.15.73:0/22120176 learned_addr learned my addr 172.21.15.73:0/22120176 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:47:16.958 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:16.956+0000 7fe5ade49640 1 -- 172.21.15.73:0/22120176 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe5a814fa40 msgr2=0x7fe5a8148230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:16.958 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:16.956+0000 7fe5ade49640 1 --2- 172.21.15.73:0/22120176 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe5a814fa40 0x7fe5a8148230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:16.959 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:16.956+0000 7fe5ade49640 1 -- 172.21.15.73:0/22120176 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe5a80c5070 msgr2=0x7fe5a814a170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:16.959 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:16.956+0000 7fe5ade49640 1 --2- 172.21.15.73:0/22120176 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe5a80c5070 0x7fe5a814a170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:16.959 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:16.956+0000 7fe5ade49640 1 -- 172.21.15.73:0/22120176 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe598009400 con 0x7fe5a806db70 2023-12-12T09:47:16.959 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:16.956+0000 7fe5ade49640 1 --2- 172.21.15.73:0/22120176 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe5a806db70 0x7fe5a8151b70 secure :-1 s=READY pgs=1076 cs=0 l=1 rev1=1 crypto rx=0x7fe5a400c500 tx=0x7fe5a400c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:47:16.959 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:16.956+0000 7fe59e7fc640 1 -- 172.21.15.73:0/22120176 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5a4005ce0 con 0x7fe5a806db70 2023-12-12T09:47:16.959 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:16.956+0000 7fe59e7fc640 1 -- 172.21.15.73:0/22120176 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5a4005e40 con 0x7fe5a806db70 2023-12-12T09:47:16.959 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:16.956+0000 7fe59e7fc640 1 -- 172.21.15.73:0/22120176 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5a4007330 con 0x7fe5a806db70 2023-12-12T09:47:16.959 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:16.956+0000 7fe5b00ad640 1 -- 172.21.15.73:0/22120176 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5a81edb50 con 0x7fe5a806db70 2023-12-12T09:47:16.959 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:16.956+0000 7fe5b00ad640 1 -- 172.21.15.73:0/22120176 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5a8071b90 con 0x7fe5a806db70 2023-12-12T09:47:16.960 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:16.958+0000 7fe5b00ad640 1 -- 172.21.15.73:0/22120176 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5a81edce0 con 0x7fe5a806db70 2023-12-12T09:47:16.960 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:16.958+0000 7fe59e7fc640 1 -- 172.21.15.73:0/22120176 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fe5a4007490 con 0x7fe5a806db70 2023-12-12T09:47:16.961 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:16.959+0000 7fe59e7fc640 1 --2- 172.21.15.73:0/22120176 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fe58c06ae70 0x7fe58c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:16.961 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:16.959+0000 7fe59e7fc640 1 -- 172.21.15.73:0/22120176 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6623+0+0 (secure 0 0 0) 0x7fe5a4088f80 con 0x7fe5a806db70 2023-12-12T09:47:16.961 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:16.960+0000 7fe5ad648640 1 --2- 172.21.15.73:0/22120176 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fe58c06ae70 0x7fe58c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:16.962 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:16.960+0000 7fe5ad648640 1 --2- 172.21.15.73:0/22120176 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fe58c06ae70 0x7fe58c06d330 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7fe598036000 tx=0x7fe598030000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:47:16.966 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:16.964+0000 7fe59e7fc640 1 -- 172.21.15.73:0/22120176 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fe5a40bbe90 con 0x7fe5a806db70 2023-12-12T09:47:17.192 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:17.191+0000 7fe5b00ad640 1 -- 172.21.15.73:0/22120176 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe5a8067580 con 0x7fe5a806db70 2023-12-12T09:47:17.193 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:17.192+0000 7fe59e7fc640 1 -- 172.21.15.73:0/22120176 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 49 v49) v1 ==== 94+0+6137 (secure 0 0 0) 0x7fe5a4017020 con 0x7fe5a806db70 2023-12-12T09:47:17.194 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-12T09:47:17.194 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":49,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4943,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6835/3004685650","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6833","nonce":3004685650},{"type":"v1","addr":"172.21.15.142:6835","nonce":3004685650}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40},{"gid":5365,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6834/3290362874","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6832","nonce":3290362874},{"type":"v1","addr":"172.21.15.142:6834","nonce":3290362874}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40}],"filesystems":[{"mdsmap":{"epoch":44,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-12T09:46:26.429627+0000","modified":"2023-12-12T09:46:29.788335+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6429},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6429":{"gid":6429,"name":"c","rank":0,"incarnation":41,"state":"up:active","state_seq":3,"addr":"172.21.15.73:6837/2352791649","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6835","nonce":2352791649},{"type":"v1","addr":"172.21.15.73:6837","nonce":2352791649}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6},{"mdsmap":{"epoch":49,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-12T09:46:41.791760+0000","modified":"2023-12-12T09:46:44.861785+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6426},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6426":{"gid":6426,"name":"a","rank":0,"incarnation":45,"state":"up:active","state_seq":7,"addr":"172.21.15.73:6836/340095591","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":340095591},{"type":"v1","addr":"172.21.15.73:6836","nonce":340095591}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2023-12-12T09:47:17.194 INFO:teuthology.orchestra.run.smithi073.stderr:dumped fsmap epoch 49 2023-12-12T09:47:17.196 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:17.194+0000 7fe5b00ad640 1 -- 172.21.15.73:0/22120176 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fe58c06ae70 msgr2=0x7fe58c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:17.196 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:17.195+0000 7fe5b00ad640 1 --2- 172.21.15.73:0/22120176 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fe58c06ae70 0x7fe58c06d330 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7fe598036000 tx=0x7fe598030000 comp rx=0 tx=0).stop 2023-12-12T09:47:17.196 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:17.195+0000 7fe5b00ad640 1 -- 172.21.15.73:0/22120176 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe5a806db70 msgr2=0x7fe5a8151b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:17.196 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:17.195+0000 7fe5b00ad640 1 --2- 172.21.15.73:0/22120176 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe5a806db70 0x7fe5a8151b70 secure :-1 s=READY pgs=1076 cs=0 l=1 rev1=1 crypto rx=0x7fe5a400c500 tx=0x7fe5a400c9c0 comp rx=0 tx=0).stop 2023-12-12T09:47:17.197 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:17.195+0000 7fe5b00ad640 1 -- 172.21.15.73:0/22120176 shutdown_connections 2023-12-12T09:47:17.197 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:17.195+0000 7fe5b00ad640 1 --2- 172.21.15.73:0/22120176 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fe58c06ae70 0x7fe58c06d330 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:17.197 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:17.195+0000 7fe5b00ad640 1 --2- 172.21.15.73:0/22120176 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe5a814fa40 0x7fe5a8148230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:17.197 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:17.195+0000 7fe5b00ad640 1 --2- 172.21.15.73:0/22120176 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe5a80c5070 0x7fe5a814a170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:17.197 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:17.195+0000 7fe5b00ad640 1 --2- 172.21.15.73:0/22120176 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe5a806db70 0x7fe5a8151b70 unknown :-1 s=CLOSED pgs=1076 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:17.197 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:17.195+0000 7fe5b00ad640 1 -- 172.21.15.73:0/22120176 >> 172.21.15.73:0/22120176 conn(0x7fe5a80a8130 msgr2=0x7fe5a80c1cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:47:17.197 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:17.195+0000 7fe5b00ad640 1 -- 172.21.15.73:0/22120176 shutdown_connections 2023-12-12T09:47:17.197 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:17.195+0000 7fe5b00ad640 1 -- 172.21.15.73:0/22120176 wait complete. 2023-12-12T09:47:17.215 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-12T09:47:17.417 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:17.415+0000 7f08078b4640 1 Processor -- start 2023-12-12T09:47:17.417 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:17.416+0000 7f08078b4640 1 -- start start 2023-12-12T09:47:17.418 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:17.417+0000 7f08078b4640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f08000a50f0 0x7f08000a9050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:17.419 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:17.417+0000 7f08078b4640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08000c0b50 con 0x7f08001552e0 2023-12-12T09:47:17.419 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:17.417+0000 7f08078b4640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f080006c880 con 0x7f080006bf20 2023-12-12T09:47:17.419 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:17.417+0000 7f08078b4640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08000c04d0 con 0x7f08000a50f0 2023-12-12T09:47:17.419 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:17.417+0000 7f0805650640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f08001552e0 0x7f08000c49c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:54710/0 (socket says 172.21.15.73:54710) 2023-12-12T09:47:17.419 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:17.417+0000 7f0805650640 1 -- 172.21.15.73:0/3570856546 learned_addr learned my addr 172.21.15.73:0/3570856546 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-12T09:47:17.421 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:17.418+0000 7f07f7fff640 1 -- 172.21.15.73:0/3570856546 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2325926137 0 0) 0x7f08000c0b50 con 0x7f08001552e0 2023-12-12T09:47:17.421 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:17.418+0000 7f07f7fff640 1 -- 172.21.15.73:0/3570856546 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f07ec003520 con 0x7f08001552e0 2023-12-12T09:47:17.422 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:17.418+0000 7f0804e4f640 1 --2- 172.21.15.73:0/3570856546 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f08000a50f0 0x7f08000a9050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:17.422 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:17.418+0000 7f07f7fff640 1 -- 172.21.15.73:0/3570856546 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3852087396 0 0) 0x7f07ec003520 con 0x7f08001552e0 2023-12-12T09:47:17.422 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:17.418+0000 7f07f7fff640 1 -- 172.21.15.73:0/3570856546 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f08000a50f0 msgr2=0x7f08000a9050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:47:17.422 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:17.418+0000 7f07f7fff640 1 --2- 172.21.15.73:0/3570856546 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f08000a50f0 0x7f08000a9050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:17.422 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:17.418+0000 7f07f7fff640 1 -- 172.21.15.73:0/3570856546 >> v1:172.21.15.142:6789/0 conn(0x7f080006bf20 legacy=0x7f08000a9590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:17.422 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:17.418+0000 7f07f7fff640 1 -- 172.21.15.73:0/3570856546 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f080006cb60 con 0x7f08001552e0 2023-12-12T09:47:17.422 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:17.418+0000 7f07f7fff640 1 -- 172.21.15.73:0/3570856546 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3186547832 0 0) 0x7f07fc001670 con 0x7f08001552e0 2023-12-12T09:47:17.422 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:17.418+0000 7f07f7fff640 1 -- 172.21.15.73:0/3570856546 >> v1:172.21.15.73:6789/0 conn(0x7f08001552e0 legacy=0x7f08000c49c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:17.422 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:17.418+0000 7f07f7fff640 1 --2- 172.21.15.73:0/3570856546 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f07ec0039a0 0x7f07ec003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:17.422 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:17.418+0000 7f07f7fff640 1 --2- 172.21.15.73:0/3570856546 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f08000a50f0 0x7f07ec0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:17.423 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:17.418+0000 7f07f7fff640 1 --2- 172.21.15.73:0/3570856546 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f07ec004d00 0x7f07ec005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:17.423 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:17.418+0000 7f07f7fff640 1 -- 172.21.15.73:0/3570856546 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08000c04d0 con 0x7f07ec0039a0 2023-12-12T09:47:17.423 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:17.418+0000 7f07f7fff640 1 -- 172.21.15.73:0/3570856546 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07ec00bc00 con 0x7f07ec004d00 2023-12-12T09:47:17.423 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:17.418+0000 7f07f7fff640 1 -- 172.21.15.73:0/3570856546 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07ec00dfd0 con 0x7f08000a50f0 2023-12-12T09:47:17.423 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:17.418+0000 7f0805650640 1 --2- 172.21.15.73:0/3570856546 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f07ec0039a0 0x7f07ec003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:17.423 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:17.419+0000 7f0804e4f640 1 --2- 172.21.15.73:0/3570856546 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f08000a50f0 0x7f07ec0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:17.423 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:17.419+0000 7f0805650640 1 -- 172.21.15.73:0/3570856546 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f08000a50f0 msgr2=0x7f07ec0047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:47:17.423 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:17.419+0000 7f0805650640 1 --2- 172.21.15.73:0/3570856546 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f08000a50f0 0x7f07ec0047c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:17.423 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:17.419+0000 7f0805e51640 1 --2- 172.21.15.73:0/3570856546 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f07ec004d00 0x7f07ec005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:17.423 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:17.419+0000 7f0805650640 1 -- 172.21.15.73:0/3570856546 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f07ec004d00 msgr2=0x7f07ec005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:47:17.423 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:17.419+0000 7f0805650640 1 --2- 172.21.15.73:0/3570856546 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f07ec004d00 0x7f07ec005180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:17.423 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:17.419+0000 7f0805650640 1 -- 172.21.15.73:0/3570856546 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07ec003520 con 0x7f07ec0039a0 2023-12-12T09:47:17.423 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:17.420+0000 7f0805650640 1 --2- 172.21.15.73:0/3570856546 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f07ec0039a0 0x7f07ec003dc0 secure :-1 s=READY pgs=1078 cs=0 l=1 rev1=1 crypto rx=0x7f07fc00c0e0 tx=0x7f07ec0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ca7ac4575a0b1d1 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:47:17.423 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:17.420+0000 7f07f7fff640 1 -- 172.21.15.73:0/3570856546 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07fc005ad0 con 0x7f07ec0039a0 2023-12-12T09:47:17.424 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:17.420+0000 7f07f7fff640 1 -- 172.21.15.73:0/3570856546 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07fc005c30 con 0x7f07ec0039a0 2023-12-12T09:47:17.424 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:17.420+0000 7f07f7fff640 1 -- 172.21.15.73:0/3570856546 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07fc02c7d0 con 0x7f07ec0039a0 2023-12-12T09:47:17.425 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:17.421+0000 7f08078b4640 1 -- 172.21.15.73:0/3570856546 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f07ec0039a0 msgr2=0x7f07ec003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:17.426 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:17.421+0000 7f08078b4640 1 --2- 172.21.15.73:0/3570856546 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f07ec0039a0 0x7f07ec003dc0 secure :-1 s=READY pgs=1078 cs=0 l=1 rev1=1 crypto rx=0x7f07fc00c0e0 tx=0x7f07ec0057f0 comp rx=0 tx=0).stop 2023-12-12T09:47:17.426 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:17.421+0000 7f0805e51640 1 -- 172.21.15.73:0/3570856546 reap_dead start 2023-12-12T09:47:17.426 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:17.421+0000 7f08078b4640 1 -- 172.21.15.73:0/3570856546 shutdown_connections 2023-12-12T09:47:17.426 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:17.421+0000 7f08078b4640 1 -- 172.21.15.73:0/3570856546 >> 172.21.15.73:0/3570856546 conn(0x7f08000a8130 msgr2=0x7f08000c24b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:47:17.426 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:17.421+0000 7f08078b4640 1 -- 172.21.15.73:0/3570856546 shutdown_connections 2023-12-12T09:47:17.426 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:17.421+0000 7f08078b4640 1 -- 172.21.15.73:0/3570856546 wait complete. 2023-12-12T09:47:17.426 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:17.423+0000 7f08078b4640 1 Processor -- start 2023-12-12T09:47:17.426 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:17.423+0000 7f08078b4640 1 -- start start 2023-12-12T09:47:17.426 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:17.423+0000 7f08078b4640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f07ec0039a0 0x7f08000aa2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:17.426 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:17.423+0000 7f08078b4640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f080014e230 0x7f08001daef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:17.426 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:17.424+0000 7f08078b4640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f08001db430 0x7f08001e8fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:17.426 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:17.424+0000 7f08078b4640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08001dc9f0 con 0x7f080014e230 2023-12-12T09:47:17.426 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:17.424+0000 7f08078b4640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08000716b0 con 0x7f07ec0039a0 2023-12-12T09:47:17.427 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:17.424+0000 7f08078b4640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08000baae0 con 0x7f08001db430 2023-12-12T09:47:17.427 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:17.424+0000 7f0804e4f640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f080014e230 0x7f08001daef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:17.427 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:17.424+0000 7f0804e4f640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f080014e230 0x7f08001daef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:54380/0 (socket says 172.21.15.73:54380) 2023-12-12T09:47:17.427 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:17.424+0000 7f0804e4f640 1 -- 172.21.15.73:0/1424503718 learned_addr learned my addr 172.21.15.73:0/1424503718 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:47:17.427 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:17.424+0000 7f0804e4f640 1 -- 172.21.15.73:0/1424503718 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f08001db430 msgr2=0x7f08001e8fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:17.427 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:17.424+0000 7f0805650640 1 --2- 172.21.15.73:0/1424503718 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f07ec0039a0 0x7f08000aa2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:17.427 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:17.424+0000 7f0804e4f640 1 --2- 172.21.15.73:0/1424503718 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f08001db430 0x7f08001e8fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:17.427 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:17.424+0000 7f0804e4f640 1 -- 172.21.15.73:0/1424503718 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f07ec0039a0 msgr2=0x7f08000aa2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:17.427 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:17.424+0000 7f0804e4f640 1 --2- 172.21.15.73:0/1424503718 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f07ec0039a0 0x7f08000aa2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:17.427 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:17.424+0000 7f0804e4f640 1 -- 172.21.15.73:0/1424503718 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0800070ab0 con 0x7f080014e230 2023-12-12T09:47:17.430 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:17.425+0000 7f0804e4f640 1 --2- 172.21.15.73:0/1424503718 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f080014e230 0x7f08001daef0 secure :-1 s=READY pgs=1079 cs=0 l=1 rev1=1 crypto rx=0x7f07f000e600 tx=0x7f07f000eac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:47:17.430 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:17.425+0000 7f07f5ffb640 1 -- 172.21.15.73:0/1424503718 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07f0013610 con 0x7f080014e230 2023-12-12T09:47:17.431 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:17.425+0000 7f07f5ffb640 1 -- 172.21.15.73:0/1424503718 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07f0013770 con 0x7f080014e230 2023-12-12T09:47:17.431 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:17.425+0000 7f07f5ffb640 1 -- 172.21.15.73:0/1424503718 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07f0013b00 con 0x7f080014e230 2023-12-12T09:47:17.431 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:17.425+0000 7f08078b4640 1 -- 172.21.15.73:0/1424503718 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0800071060 con 0x7f080014e230 2023-12-12T09:47:17.431 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:17.425+0000 7f08078b4640 1 -- 172.21.15.73:0/1424503718 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08000aa7e0 con 0x7f080014e230 2023-12-12T09:47:17.431 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:17.426+0000 7f08078b4640 1 -- 172.21.15.73:0/1424503718 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f08001dac10 con 0x7f080014e230 2023-12-12T09:47:17.431 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:17.427+0000 7f07f5ffb640 1 -- 172.21.15.73:0/1424503718 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f07f0013c60 con 0x7f080014e230 2023-12-12T09:47:17.431 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:17.428+0000 7f07f5ffb640 1 --2- 172.21.15.73:0/1424503718 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f07e406ae70 0x7f07e406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:17.431 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:17.428+0000 7f07f5ffb640 1 -- 172.21.15.73:0/1424503718 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6623+0+0 (secure 0 0 0) 0x7f07f0089560 con 0x7f080014e230 2023-12-12T09:47:17.431 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:17.428+0000 7f0805650640 1 --2- 172.21.15.73:0/1424503718 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f07e406ae70 0x7f07e406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:17.431 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:17.429+0000 7f0805650640 1 --2- 172.21.15.73:0/1424503718 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f07e406ae70 0x7f07e406d330 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f07fc034000 tx=0x7f07fc037040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:47:17.434 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:17.432+0000 7f07f5ffb640 1 -- 172.21.15.73:0/1424503718 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f08001dac10 con 0x7f080014e230 2023-12-12T09:47:17.664 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:17.662+0000 7f08078b4640 1 -- 172.21.15.73:0/1424503718 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f08001dac10 con 0x7f080014e230 2023-12-12T09:47:17.665 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:17.663+0000 7f07f5ffb640 1 -- 172.21.15.73:0/1424503718 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 49 v49) v1 ==== 94+0+6137 (secure 0 0 0) 0x7f08001dac10 con 0x7f080014e230 2023-12-12T09:47:17.665 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-12T09:47:17.665 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":49,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4943,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6835/3004685650","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6833","nonce":3004685650},{"type":"v1","addr":"172.21.15.142:6835","nonce":3004685650}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40},{"gid":5365,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6834/3290362874","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6832","nonce":3290362874},{"type":"v1","addr":"172.21.15.142:6834","nonce":3290362874}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40}],"filesystems":[{"mdsmap":{"epoch":44,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-12T09:46:26.429627+0000","modified":"2023-12-12T09:46:29.788335+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6429},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6429":{"gid":6429,"name":"c","rank":0,"incarnation":41,"state":"up:active","state_seq":3,"addr":"172.21.15.73:6837/2352791649","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6835","nonce":2352791649},{"type":"v1","addr":"172.21.15.73:6837","nonce":2352791649}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6},{"mdsmap":{"epoch":49,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-12T09:46:41.791760+0000","modified":"2023-12-12T09:46:44.861785+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6426},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6426":{"gid":6426,"name":"a","rank":0,"incarnation":45,"state":"up:active","state_seq":7,"addr":"172.21.15.73:6836/340095591","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":340095591},{"type":"v1","addr":"172.21.15.73:6836","nonce":340095591}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2023-12-12T09:47:17.666 INFO:teuthology.orchestra.run.smithi073.stderr:dumped fsmap epoch 49 2023-12-12T09:47:17.667 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:17.666+0000 7f08078b4640 1 -- 172.21.15.73:0/1424503718 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f07e406ae70 msgr2=0x7f07e406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:17.667 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:17.666+0000 7f08078b4640 1 --2- 172.21.15.73:0/1424503718 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f07e406ae70 0x7f07e406d330 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f07fc034000 tx=0x7f07fc037040 comp rx=0 tx=0).stop 2023-12-12T09:47:17.667 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:17.666+0000 7f08078b4640 1 -- 172.21.15.73:0/1424503718 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f080014e230 msgr2=0x7f08001daef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:17.667 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:17.666+0000 7f08078b4640 1 --2- 172.21.15.73:0/1424503718 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f080014e230 0x7f08001daef0 secure :-1 s=READY pgs=1079 cs=0 l=1 rev1=1 crypto rx=0x7f07f000e600 tx=0x7f07f000eac0 comp rx=0 tx=0).stop 2023-12-12T09:47:17.668 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:17.666+0000 7f08078b4640 1 -- 172.21.15.73:0/1424503718 shutdown_connections 2023-12-12T09:47:17.668 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:17.666+0000 7f08078b4640 1 --2- 172.21.15.73:0/1424503718 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f07e406ae70 0x7f07e406d330 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:17.668 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:17.666+0000 7f08078b4640 1 --2- 172.21.15.73:0/1424503718 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f08001db430 0x7f08001e8fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:17.668 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:17.666+0000 7f08078b4640 1 --2- 172.21.15.73:0/1424503718 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f080014e230 0x7f08001daef0 unknown :-1 s=CLOSED pgs=1079 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:17.668 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:17.666+0000 7f08078b4640 1 --2- 172.21.15.73:0/1424503718 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f07ec0039a0 0x7f08000aa2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:17.669 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:17.666+0000 7f08078b4640 1 -- 172.21.15.73:0/1424503718 >> 172.21.15.73:0/1424503718 conn(0x7f08000a8130 msgr2=0x7f08000a5ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:47:17.669 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:17.666+0000 7f08078b4640 1 -- 172.21.15.73:0/1424503718 shutdown_connections 2023-12-12T09:47:17.669 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:17.666+0000 7f08078b4640 1 -- 172.21.15.73:0/1424503718 wait complete. 2023-12-12T09:47:17.686 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-12T09:47:17.897 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:17.895+0000 7ffa53061640 1 Processor -- start 2023-12-12T09:47:17.897 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:17.895+0000 7ffa53061640 1 -- start start 2023-12-12T09:47:17.898 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:17.896+0000 7ffa53061640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7ffa4c06a4e0 0x7ffa4c06a8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:17.898 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:17.896+0000 7ffa53061640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa4c158c00 con 0x7ffa4c0a5040 2023-12-12T09:47:17.898 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:17.896+0000 7ffa53061640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa4c0c4d00 con 0x7ffa4c06bf90 2023-12-12T09:47:17.898 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:17.896+0000 7ffa53061640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa4c06c400 con 0x7ffa4c06a4e0 2023-12-12T09:47:17.899 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:17.897+0000 7ffa515fe640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7ffa4c06a4e0 0x7ffa4c06a8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:17.899 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:17.897+0000 7ffa50dfd640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7ffa4c0a5040 0x7ffa4c0c3ad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:54718/0 (socket says 172.21.15.73:54718) 2023-12-12T09:47:17.899 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:17.897+0000 7ffa50dfd640 1 -- 172.21.15.73:0/3262466657 learned_addr learned my addr 172.21.15.73:0/3262466657 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-12T09:47:17.899 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:17.897+0000 7ffa515fe640 1 -- 172.21.15.73:0/3262466657 >> v1:172.21.15.142:6789/0 conn(0x7ffa4c06bf90 legacy=0x7ffa4c1584f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:47:17.899 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:17.897+0000 7ffa515fe640 1 -- 172.21.15.73:0/3262466657 >> v1:172.21.15.73:6789/0 conn(0x7ffa4c0a5040 legacy=0x7ffa4c0c3ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:17.899 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:17.897+0000 7ffa515fe640 1 -- 172.21.15.73:0/3262466657 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa4c0c5100 con 0x7ffa4c06a4e0 2023-12-12T09:47:17.900 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:17.897+0000 7ffa4b7fe640 1 -- 172.21.15.73:0/3262466657 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4193190738 0 0) 0x7ffa4c158c00 con 0x7ffa4c0a5040 2023-12-12T09:47:17.900 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:17.898+0000 7ffa515fe640 1 --2- 172.21.15.73:0/3262466657 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ffa4c06a4e0 0x7ffa4c06a8e0 secure :-1 s=READY pgs=1081 cs=0 l=1 rev1=1 crypto rx=0x7ffa44009d90 tx=0x7ffa4402bf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c59190801908a025 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:47:17.900 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:17.899+0000 7ffa4b7fe640 1 -- 172.21.15.73:0/3262466657 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa4402cd00 con 0x7ffa4c06a4e0 2023-12-12T09:47:17.900 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:17.899+0000 7ffa4b7fe640 1 -- 172.21.15.73:0/3262466657 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa4402ce60 con 0x7ffa4c06a4e0 2023-12-12T09:47:17.900 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:17.899+0000 7ffa4b7fe640 1 -- 172.21.15.73:0/3262466657 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa44034660 con 0x7ffa4c06a4e0 2023-12-12T09:47:17.901 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:17.899+0000 7ffa53061640 1 -- 172.21.15.73:0/3262466657 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ffa4c06a4e0 msgr2=0x7ffa4c06a8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:17.901 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:17.899+0000 7ffa53061640 1 --2- 172.21.15.73:0/3262466657 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ffa4c06a4e0 0x7ffa4c06a8e0 secure :-1 s=READY pgs=1081 cs=0 l=1 rev1=1 crypto rx=0x7ffa44009d90 tx=0x7ffa4402bf50 comp rx=0 tx=0).stop 2023-12-12T09:47:17.901 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:17.899+0000 7ffa53061640 1 -- 172.21.15.73:0/3262466657 shutdown_connections 2023-12-12T09:47:17.901 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:17.899+0000 7ffa53061640 1 --2- 172.21.15.73:0/3262466657 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ffa4c06a4e0 0x7ffa4c06a8e0 unknown :-1 s=CLOSED pgs=1081 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:17.901 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:17.899+0000 7ffa53061640 1 -- 172.21.15.73:0/3262466657 >> 172.21.15.73:0/3262466657 conn(0x7ffa4c0a8130 msgr2=0x7ffa4c0c24b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:47:17.901 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:17.900+0000 7ffa53061640 1 -- 172.21.15.73:0/3262466657 shutdown_connections 2023-12-12T09:47:17.902 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:17.900+0000 7ffa53061640 1 -- 172.21.15.73:0/3262466657 wait complete. 2023-12-12T09:47:17.902 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:17.901+0000 7ffa53061640 1 Processor -- start 2023-12-12T09:47:17.903 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:17.901+0000 7ffa53061640 1 -- start start 2023-12-12T09:47:17.904 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:17.902+0000 7ffa53061640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ffa4c06a4e0 0x7ffa4c0a87c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:17.904 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:17.902+0000 7ffa53061640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ffa4c06bf90 0x7ffa4c0a2500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:17.904 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:17.902+0000 7ffa53061640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ffa4c0a5040 0x7ffa4c150ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:17.904 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:17.902+0000 7ffa53061640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa4c0aa430 con 0x7ffa4c0a5040 2023-12-12T09:47:17.904 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:17.902+0000 7ffa53061640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa4c0a8d00 con 0x7ffa4c06bf90 2023-12-12T09:47:17.904 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:17.902+0000 7ffa53061640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa4c0a8f60 con 0x7ffa4c06a4e0 2023-12-12T09:47:17.904 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:17.902+0000 7ffa515fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ffa4c0a5040 0x7ffa4c150ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:17.904 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:17.902+0000 7ffa515fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ffa4c0a5040 0x7ffa4c150ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:54398/0 (socket says 172.21.15.73:54398) 2023-12-12T09:47:17.904 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:17.903+0000 7ffa515fe640 1 -- 172.21.15.73:0/2006959723 learned_addr learned my addr 172.21.15.73:0/2006959723 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:47:17.906 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:17.903+0000 7ffa4bfff640 1 --2- 172.21.15.73:0/2006959723 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ffa4c06bf90 0x7ffa4c0a2500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:17.906 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:17.903+0000 7ffa50dfd640 1 --2- 172.21.15.73:0/2006959723 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ffa4c06a4e0 0x7ffa4c0a87c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:17.906 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:17.903+0000 7ffa515fe640 1 -- 172.21.15.73:0/2006959723 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ffa4c06a4e0 msgr2=0x7ffa4c0a87c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:17.906 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:17.903+0000 7ffa515fe640 1 --2- 172.21.15.73:0/2006959723 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ffa4c06a4e0 0x7ffa4c0a87c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:17.906 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:17.903+0000 7ffa515fe640 1 -- 172.21.15.73:0/2006959723 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ffa4c06bf90 msgr2=0x7ffa4c0a2500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:17.906 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:17.903+0000 7ffa515fe640 1 --2- 172.21.15.73:0/2006959723 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ffa4c06bf90 0x7ffa4c0a2500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:17.906 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:17.903+0000 7ffa515fe640 1 -- 172.21.15.73:0/2006959723 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa44009a70 con 0x7ffa4c0a5040 2023-12-12T09:47:17.906 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:17.903+0000 7ffa515fe640 1 --2- 172.21.15.73:0/2006959723 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ffa4c0a5040 0x7ffa4c150ae0 secure :-1 s=READY pgs=1082 cs=0 l=1 rev1=1 crypto rx=0x7ffa44009d90 tx=0x7ffa44004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:47:17.906 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:17.904+0000 7ffa497fa640 1 -- 172.21.15.73:0/2006959723 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa4403e670 con 0x7ffa4c0a5040 2023-12-12T09:47:17.906 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:17.904+0000 7ffa497fa640 1 -- 172.21.15.73:0/2006959723 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa4403e7f0 con 0x7ffa4c0a5040 2023-12-12T09:47:17.906 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:17.904+0000 7ffa497fa640 1 -- 172.21.15.73:0/2006959723 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa4403eba0 con 0x7ffa4c0a5040 2023-12-12T09:47:17.907 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:17.904+0000 7ffa53061640 1 -- 172.21.15.73:0/2006959723 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa4c0aaf00 con 0x7ffa4c0a5040 2023-12-12T09:47:17.907 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:17.904+0000 7ffa53061640 1 -- 172.21.15.73:0/2006959723 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa4c0aa660 con 0x7ffa4c0a5040 2023-12-12T09:47:17.907 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:17.905+0000 7ffa53061640 1 -- 172.21.15.73:0/2006959723 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa4c1ee840 con 0x7ffa4c0a5040 2023-12-12T09:47:17.907 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:17.906+0000 7ffa497fa640 1 -- 172.21.15.73:0/2006959723 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7ffa4403b040 con 0x7ffa4c0a5040 2023-12-12T09:47:17.908 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:17.907+0000 7ffa497fa640 1 --2- 172.21.15.73:0/2006959723 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7ffa3006ae40 0x7ffa3006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:17.908 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:17.907+0000 7ffa497fa640 1 -- 172.21.15.73:0/2006959723 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6623+0+0 (secure 0 0 0) 0x7ffa440ac540 con 0x7ffa4c0a5040 2023-12-12T09:47:17.908 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:17.907+0000 7ffa50dfd640 1 --2- 172.21.15.73:0/2006959723 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7ffa3006ae40 0x7ffa3006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:17.909 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:17.907+0000 7ffa50dfd640 1 --2- 172.21.15.73:0/2006959723 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7ffa3006ae40 0x7ffa3006d300 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7ffa40000f60 tx=0x7ffa40009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:47:17.912 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:17.911+0000 7ffa497fa640 1 -- 172.21.15.73:0/2006959723 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7ffa4c1ee840 con 0x7ffa4c0a5040 2023-12-12T09:47:18.102 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:18.101+0000 7ffa53061640 1 -- 172.21.15.73:0/2006959723 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ffa4c1ee840 con 0x7ffa4c0a5040 2023-12-12T09:47:18.104 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:18.103+0000 7ffa497fa640 1 -- 172.21.15.73:0/2006959723 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v81) v1 ==== 74+0+20323 (secure 0 0 0) 0x7ffa4c1ee840 con 0x7ffa4c0a5040 2023-12-12T09:47:18.105 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-12T09:47:18.105 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":81,"fsid":"ba240992-02b8-4c7e-92f2-27eb29ac433b","created":"2023-12-12T09:43:02.454719+0000","modified":"2023-12-12T09:47:10.698166+0000","last_up_change":"2023-12-12T09:43:13.913440+0000","last_in_change":"2023-12-12T09:43:05.925348+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-12T09:43:15.525508+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2023-12-12T09:46:24.716544+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2023-12-12T09:46:25.435954+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs2_metadata","create_time":"2023-12-12T09:46:40.116878+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs2_data","create_time":"2023-12-12T09:46:40.798840+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"dd9074be-dbe2-4c34-9896-a4223d8d3940","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":4047810203},{"type":"v1","addr":"172.21.15.73:6801","nonce":4047810203}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":4047810203},{"type":"v1","addr":"172.21.15.73:6803","nonce":4047810203}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":4047810203},{"type":"v1","addr":"172.21.15.73:6807","nonce":4047810203}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":4047810203},{"type":"v1","addr":"172.21.15.73:6805","nonce":4047810203}]},"public_addr":"172.21.15.73:6801/4047810203","cluster_addr":"172.21.15.73:6803/4047810203","heartbeat_back_addr":"172.21.15.73:6807/4047810203","heartbeat_front_addr":"172.21.15.73:6805/4047810203","state":["exists","up"]},{"osd":1,"uuid":"c4a05052-96d4-4758-a4e1-1a37f1e07fed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":1356058331},{"type":"v1","addr":"172.21.15.73:6824","nonce":1356058331}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":1356058331},{"type":"v1","addr":"172.21.15.73:6827","nonce":1356058331}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":1356058331},{"type":"v1","addr":"172.21.15.73:6831","nonce":1356058331}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":1356058331},{"type":"v1","addr":"172.21.15.73:6829","nonce":1356058331}]},"public_addr":"172.21.15.73:6824/1356058331","cluster_addr":"172.21.15.73:6827/1356058331","heartbeat_back_addr":"172.21.15.73:6831/1356058331","heartbeat_front_addr":"172.21.15.73:6829/1356058331","state":["exists","up"]},{"osd":2,"uuid":"512bc8ac-72c2-40d4-b3d2-d867a92c5213","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":1228903316},{"type":"v1","addr":"172.21.15.73:6817","nonce":1228903316}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":1228903316},{"type":"v1","addr":"172.21.15.73:6819","nonce":1228903316}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6823","nonce":1228903316},{"type":"v1","addr":"172.21.15.73:6825","nonce":1228903316}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":1228903316},{"type":"v1","addr":"172.21.15.73:6821","nonce":1228903316}]},"public_addr":"172.21.15.73:6817/1228903316","cluster_addr":"172.21.15.73:6819/1228903316","heartbeat_back_addr":"172.21.15.73:6825/1228903316","heartbeat_front_addr":"172.21.15.73:6821/1228903316","state":["exists","up"]},{"osd":3,"uuid":"3d1a91e0-42bf-437a-8eae-8d357c8f63a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":1293329670},{"type":"v1","addr":"172.21.15.73:6809","nonce":1293329670}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6810","nonce":1293329670},{"type":"v1","addr":"172.21.15.73:6811","nonce":1293329670}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":1293329670},{"type":"v1","addr":"172.21.15.73:6815","nonce":1293329670}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":1293329670},{"type":"v1","addr":"172.21.15.73:6813","nonce":1293329670}]},"public_addr":"172.21.15.73:6809/1293329670","cluster_addr":"172.21.15.73:6811/1293329670","heartbeat_back_addr":"172.21.15.73:6815/1293329670","heartbeat_front_addr":"172.21.15.73:6813/1293329670","state":["exists","up"]},{"osd":4,"uuid":"4b302fff-834c-4069-ac19-00e46f6c87b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":3727975702},{"type":"v1","addr":"172.21.15.142:6801","nonce":3727975702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":3727975702},{"type":"v1","addr":"172.21.15.142:6803","nonce":3727975702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6809","nonce":3727975702},{"type":"v1","addr":"172.21.15.142:6811","nonce":3727975702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6805","nonce":3727975702},{"type":"v1","addr":"172.21.15.142:6807","nonce":3727975702}]},"public_addr":"172.21.15.142:6801/3727975702","cluster_addr":"172.21.15.142:6803/3727975702","heartbeat_back_addr":"172.21.15.142:6811/3727975702","heartbeat_front_addr":"172.21.15.142:6807/3727975702","state":["exists","up"]},{"osd":5,"uuid":"d7cdace2-67d0-45cc-95f2-515cf6ef1b82","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6817","nonce":2353193632},{"type":"v1","addr":"172.21.15.142:6819","nonce":2353193632}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6821","nonce":2353193632},{"type":"v1","addr":"172.21.15.142:6823","nonce":2353193632}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6829","nonce":2353193632},{"type":"v1","addr":"172.21.15.142:6831","nonce":2353193632}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6825","nonce":2353193632},{"type":"v1","addr":"172.21.15.142:6827","nonce":2353193632}]},"public_addr":"172.21.15.142:6819/2353193632","cluster_addr":"172.21.15.142:6823/2353193632","heartbeat_back_addr":"172.21.15.142:6831/2353193632","heartbeat_front_addr":"172.21.15.142:6827/2353193632","state":["exists","up"]},{"osd":6,"uuid":"649ce78a-5626-445c-aedc-a651ed05a6f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":2006111986},{"type":"v1","addr":"172.21.15.142:6806","nonce":2006111986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":2006111986},{"type":"v1","addr":"172.21.15.142:6810","nonce":2006111986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":2006111986},{"type":"v1","addr":"172.21.15.142:6815","nonce":2006111986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":2006111986},{"type":"v1","addr":"172.21.15.142:6813","nonce":2006111986}]},"public_addr":"172.21.15.142:6806/2006111986","cluster_addr":"172.21.15.142:6810/2006111986","heartbeat_back_addr":"172.21.15.142:6815/2006111986","heartbeat_front_addr":"172.21.15.142:6813/2006111986","state":["exists","up"]},{"osd":7,"uuid":"af15ae3b-c1d0-4acf-92db-8a1805494d13","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":2573794341},{"type":"v1","addr":"172.21.15.142:6818","nonce":2573794341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":2573794341},{"type":"v1","addr":"172.21.15.142:6822","nonce":2573794341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":2573794341},{"type":"v1","addr":"172.21.15.142:6830","nonce":2573794341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":2573794341},{"type":"v1","addr":"172.21.15.142:6826","nonce":2573794341}]},"public_addr":"172.21.15.142:6818/2573794341","cluster_addr":"172.21.15.142:6822/2573794341","heartbeat_back_addr":"172.21.15.142:6830/2573794341","heartbeat_front_addr":"172.21.15.142:6826/2573794341","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.185824+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.262103+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.225556+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:10.523459+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:10.706035+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.257339+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.301776+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.051960+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"13.a","mappings":[{"from":1,"to":5}]},{"pgid":"13.3f","mappings":[{"from":6,"to":3}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-12T09:47:18.107 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:18.105+0000 7ffa53061640 1 -- 172.21.15.73:0/2006959723 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7ffa3006ae40 msgr2=0x7ffa3006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:18.107 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:18.105+0000 7ffa53061640 1 --2- 172.21.15.73:0/2006959723 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7ffa3006ae40 0x7ffa3006d300 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7ffa40000f60 tx=0x7ffa40009040 comp rx=0 tx=0).stop 2023-12-12T09:47:18.108 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:18.105+0000 7ffa53061640 1 -- 172.21.15.73:0/2006959723 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ffa4c0a5040 msgr2=0x7ffa4c150ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:18.108 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:18.105+0000 7ffa53061640 1 --2- 172.21.15.73:0/2006959723 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ffa4c0a5040 0x7ffa4c150ae0 secure :-1 s=READY pgs=1082 cs=0 l=1 rev1=1 crypto rx=0x7ffa44009d90 tx=0x7ffa44004a40 comp rx=0 tx=0).stop 2023-12-12T09:47:18.108 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:18.105+0000 7ffa53061640 1 -- 172.21.15.73:0/2006959723 shutdown_connections 2023-12-12T09:47:18.108 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:18.105+0000 7ffa53061640 1 --2- 172.21.15.73:0/2006959723 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7ffa3006ae40 0x7ffa3006d300 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:18.108 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:18.105+0000 7ffa53061640 1 --2- 172.21.15.73:0/2006959723 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ffa4c0a5040 0x7ffa4c150ae0 unknown :-1 s=CLOSED pgs=1082 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:18.108 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:18.105+0000 7ffa53061640 1 --2- 172.21.15.73:0/2006959723 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ffa4c06bf90 0x7ffa4c0a2500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:18.108 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:18.105+0000 7ffa53061640 1 --2- 172.21.15.73:0/2006959723 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ffa4c06a4e0 0x7ffa4c0a87c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:18.108 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:18.105+0000 7ffa53061640 1 -- 172.21.15.73:0/2006959723 >> 172.21.15.73:0/2006959723 conn(0x7ffa4c0a8130 msgr2=0x7ffa4c0733a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:47:18.108 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:18.106+0000 7ffa53061640 1 -- 172.21.15.73:0/2006959723 shutdown_connections 2023-12-12T09:47:18.108 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:18.106+0000 7ffa53061640 1 -- 172.21.15.73:0/2006959723 wait complete. 2023-12-12T09:47:18.126 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-12-12T09:47:18.335 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:18.333+0000 7fd5d7e36640 1 Processor -- start 2023-12-12T09:47:18.335 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:18.333+0000 7fd5d7e36640 1 -- start start 2023-12-12T09:47:18.336 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:18.334+0000 7fd5d7e36640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd5d00c0420 0x7fd5d00c17e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:18.336 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:18.335+0000 7fd5d7e36640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5d0152560 con 0x7fd5d006fca0 2023-12-12T09:47:18.336 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:18.335+0000 7fd5d7e36640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5d01532e0 con 0x7fd5d0072700 2023-12-12T09:47:18.337 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:18.335+0000 7fd5d7e36640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5d0152ec0 con 0x7fd5d00c0420 2023-12-12T09:47:18.337 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:18.335+0000 7fd5d5bd2640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7fd5d006fca0 0x7fd5d00c10d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:54734/0 (socket says 172.21.15.73:54734) 2023-12-12T09:47:18.337 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:18.335+0000 7fd5d5bd2640 1 -- 172.21.15.73:0/743106801 learned_addr learned my addr 172.21.15.73:0/743106801 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-12T09:47:18.339 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:18.335+0000 7fd5d4bd0640 1 -- 172.21.15.73:0/743106801 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3499858396 0 0) 0x7fd5d0152560 con 0x7fd5d006fca0 2023-12-12T09:47:18.339 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:18.335+0000 7fd5d4bd0640 1 -- 172.21.15.73:0/743106801 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd5bc003520 con 0x7fd5d006fca0 2023-12-12T09:47:18.339 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:18.335+0000 7fd5d53d1640 1 --2- 172.21.15.73:0/743106801 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd5d00c0420 0x7fd5d00c17e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:18.339 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:18.336+0000 7fd5d4bd0640 1 -- 172.21.15.73:0/743106801 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3253707813 0 0) 0x7fd5bc003520 con 0x7fd5d006fca0 2023-12-12T09:47:18.339 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:18.336+0000 7fd5d4bd0640 1 -- 172.21.15.73:0/743106801 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd5d00c0420 msgr2=0x7fd5d00c17e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:47:18.340 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:18.336+0000 7fd5d4bd0640 1 --2- 172.21.15.73:0/743106801 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd5d00c0420 0x7fd5d00c17e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:18.340 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:18.336+0000 7fd5d4bd0640 1 -- 172.21.15.73:0/743106801 >> v1:172.21.15.142:6789/0 conn(0x7fd5d0072700 legacy=0x7fd5d015ccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:47:18.340 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:18.336+0000 7fd5d4bd0640 1 -- 172.21.15.73:0/743106801 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5d0152800 con 0x7fd5d006fca0 2023-12-12T09:47:18.340 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:18.336+0000 7fd5d4bd0640 1 -- 172.21.15.73:0/743106801 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3186547832 0 0) 0x7fd5cc001670 con 0x7fd5d006fca0 2023-12-12T09:47:18.340 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:18.336+0000 7fd5d4bd0640 1 -- 172.21.15.73:0/743106801 >> v1:172.21.15.73:6789/0 conn(0x7fd5d006fca0 legacy=0x7fd5d00c10d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:18.340 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:18.336+0000 7fd5d4bd0640 1 --2- 172.21.15.73:0/743106801 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd5bc0039a0 0x7fd5bc003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:18.340 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:18.336+0000 7fd5d4bd0640 1 --2- 172.21.15.73:0/743106801 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd5d00c0420 0x7fd5bc0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:18.340 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:18.336+0000 7fd5d4bd0640 1 --2- 172.21.15.73:0/743106801 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd5bc004d00 0x7fd5bc005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:18.340 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:18.336+0000 7fd5d4bd0640 1 -- 172.21.15.73:0/743106801 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5d0152ec0 con 0x7fd5bc0039a0 2023-12-12T09:47:18.340 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:18.336+0000 7fd5d4bd0640 1 -- 172.21.15.73:0/743106801 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5bc00bb40 con 0x7fd5bc004d00 2023-12-12T09:47:18.340 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:18.336+0000 7fd5d4bd0640 1 -- 172.21.15.73:0/743106801 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5bc00bd00 con 0x7fd5d00c0420 2023-12-12T09:47:18.340 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:18.336+0000 7fd5d5bd2640 1 --2- 172.21.15.73:0/743106801 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd5bc0039a0 0x7fd5bc003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:18.340 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:18.336+0000 7fd5d5bd2640 1 -- 172.21.15.73:0/743106801 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd5d00c0420 msgr2=0x7fd5bc0047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:47:18.341 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:18.336+0000 7fd5d53d1640 1 --2- 172.21.15.73:0/743106801 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd5d00c0420 0x7fd5bc0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:18.341 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:18.336+0000 7fd5d5bd2640 1 --2- 172.21.15.73:0/743106801 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd5d00c0420 0x7fd5bc0047c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:18.341 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:18.336+0000 7fd5d5bd2640 1 -- 172.21.15.73:0/743106801 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd5bc004d00 msgr2=0x7fd5bc005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:47:18.341 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:18.336+0000 7fd5d5bd2640 1 --2- 172.21.15.73:0/743106801 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd5bc004d00 0x7fd5bc005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:18.341 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:18.336+0000 7fd5d5bd2640 1 -- 172.21.15.73:0/743106801 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5bc003520 con 0x7fd5bc0039a0 2023-12-12T09:47:18.341 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:18.337+0000 7fd5d5bd2640 1 --2- 172.21.15.73:0/743106801 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd5bc0039a0 0x7fd5bc003da0 secure :-1 s=READY pgs=1084 cs=0 l=1 rev1=1 crypto rx=0x7fd5cc001eb0 tx=0x7fd5bc0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1305bc8f6f5260b server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:47:18.341 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:18.338+0000 7fd5d4bd0640 1 -- 172.21.15.73:0/743106801 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5cc005ad0 con 0x7fd5bc0039a0 2023-12-12T09:47:18.341 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:18.338+0000 7fd5d4bd0640 1 -- 172.21.15.73:0/743106801 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5cc005c50 con 0x7fd5bc0039a0 2023-12-12T09:47:18.341 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:18.338+0000 7fd5d4bd0640 1 -- 172.21.15.73:0/743106801 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5cc02c8b0 con 0x7fd5bc0039a0 2023-12-12T09:47:18.343 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:18.338+0000 7fd5d7e36640 1 -- 172.21.15.73:0/743106801 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd5bc0039a0 msgr2=0x7fd5bc003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:18.343 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:18.338+0000 7fd5d7e36640 1 --2- 172.21.15.73:0/743106801 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd5bc0039a0 0x7fd5bc003da0 secure :-1 s=READY pgs=1084 cs=0 l=1 rev1=1 crypto rx=0x7fd5cc001eb0 tx=0x7fd5bc0057f0 comp rx=0 tx=0).stop 2023-12-12T09:47:18.343 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:18.338+0000 7fd5d63d3640 1 -- 172.21.15.73:0/743106801 reap_dead start 2023-12-12T09:47:18.343 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:18.338+0000 7fd5d7e36640 1 -- 172.21.15.73:0/743106801 shutdown_connections 2023-12-12T09:47:18.343 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:18.338+0000 7fd5d7e36640 1 -- 172.21.15.73:0/743106801 >> 172.21.15.73:0/743106801 conn(0x7fd5d00a77d0 msgr2=0x7fd5d00a7bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:47:18.343 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:18.339+0000 7fd5d7e36640 1 -- 172.21.15.73:0/743106801 shutdown_connections 2023-12-12T09:47:18.343 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:18.339+0000 7fd5d7e36640 1 -- 172.21.15.73:0/743106801 wait complete. 2023-12-12T09:47:18.343 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:18.340+0000 7fd5d7e36640 1 Processor -- start 2023-12-12T09:47:18.344 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:18.340+0000 7fd5d7e36640 1 -- start start 2023-12-12T09:47:18.344 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:18.341+0000 7fd5d7e36640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd5bc0039a0 0x7fd5d006d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:18.344 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:18.341+0000 7fd5d7e36640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd5d01541e0 0x7fd5d01e6b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:18.344 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:18.341+0000 7fd5d7e36640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd5d00a8ce0 0x7fd5d01e8ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:18.344 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:18.341+0000 7fd5d7e36640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5d006cdd0 con 0x7fd5d00a8ce0 2023-12-12T09:47:18.344 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:18.341+0000 7fd5d7e36640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5d01e9810 con 0x7fd5d01541e0 2023-12-12T09:47:18.344 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:18.341+0000 7fd5d7e36640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5d01e9af0 con 0x7fd5bc0039a0 2023-12-12T09:47:18.344 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:18.341+0000 7fd5d63d3640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd5d00a8ce0 0x7fd5d01e8ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:18.344 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:18.342+0000 7fd5d63d3640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd5d00a8ce0 0x7fd5d01e8ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:54424/0 (socket says 172.21.15.73:54424) 2023-12-12T09:47:18.344 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:18.342+0000 7fd5d63d3640 1 -- 172.21.15.73:0/464824843 learned_addr learned my addr 172.21.15.73:0/464824843 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:47:18.346 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:18.342+0000 7fd5d53d1640 1 --2- 172.21.15.73:0/464824843 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd5d01541e0 0x7fd5d01e6b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:18.346 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:18.342+0000 7fd5d5bd2640 1 --2- 172.21.15.73:0/464824843 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd5bc0039a0 0x7fd5d006d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:18.346 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:18.342+0000 7fd5d63d3640 1 -- 172.21.15.73:0/464824843 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd5bc0039a0 msgr2=0x7fd5d006d260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:18.346 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:18.342+0000 7fd5d63d3640 1 --2- 172.21.15.73:0/464824843 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd5bc0039a0 0x7fd5d006d260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:18.346 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:18.342+0000 7fd5d63d3640 1 -- 172.21.15.73:0/464824843 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd5d01541e0 msgr2=0x7fd5d01e6b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:18.347 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:18.342+0000 7fd5d63d3640 1 --2- 172.21.15.73:0/464824843 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd5d01541e0 0x7fd5d01e6b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:18.347 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:18.342+0000 7fd5d63d3640 1 -- 172.21.15.73:0/464824843 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5d006c780 con 0x7fd5d00a8ce0 2023-12-12T09:47:18.347 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:18.342+0000 7fd5d53d1640 1 --2- 172.21.15.73:0/464824843 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd5d01541e0 0x7fd5d01e6b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:47:18.347 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:18.342+0000 7fd5d63d3640 1 --2- 172.21.15.73:0/464824843 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd5d00a8ce0 0x7fd5d01e8ed0 secure :-1 s=READY pgs=1085 cs=0 l=1 rev1=1 crypto rx=0x7fd5d006e430 tx=0x7fd5c800c980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:47:18.347 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:18.342+0000 7fd5c67fc640 1 -- 172.21.15.73:0/464824843 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5c8007070 con 0x7fd5d00a8ce0 2023-12-12T09:47:18.347 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:18.343+0000 7fd5c67fc640 1 -- 172.21.15.73:0/464824843 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5c80071f0 con 0x7fd5d00a8ce0 2023-12-12T09:47:18.347 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:18.343+0000 7fd5d7e36640 1 -- 172.21.15.73:0/464824843 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5d006ca60 con 0x7fd5d00a8ce0 2023-12-12T09:47:18.347 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:18.343+0000 7fd5c67fc640 1 -- 172.21.15.73:0/464824843 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5c80075a0 con 0x7fd5d00a8ce0 2023-12-12T09:47:18.347 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:18.343+0000 7fd5d7e36640 1 -- 172.21.15.73:0/464824843 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5d01e70a0 con 0x7fd5d00a8ce0 2023-12-12T09:47:18.347 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:18.344+0000 7fd5d7e36640 1 -- 172.21.15.73:0/464824843 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd5d006cc20 con 0x7fd5d00a8ce0 2023-12-12T09:47:18.347 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:18.345+0000 7fd5c67fc640 1 -- 172.21.15.73:0/464824843 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fd5c8007700 con 0x7fd5d00a8ce0 2023-12-12T09:47:18.348 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:18.345+0000 7fd5c67fc640 1 --2- 172.21.15.73:0/464824843 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fd5b406ae40 0x7fd5b406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:18.348 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:18.345+0000 7fd5c67fc640 1 -- 172.21.15.73:0/464824843 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6623+0+0 (secure 0 0 0) 0x7fd5c8088da0 con 0x7fd5d00a8ce0 2023-12-12T09:47:18.348 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:18.346+0000 7fd5d5bd2640 1 --2- 172.21.15.73:0/464824843 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fd5b406ae40 0x7fd5b406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:18.348 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:18.346+0000 7fd5d5bd2640 1 --2- 172.21.15.73:0/464824843 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fd5b406ae40 0x7fd5b406d300 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7fd5cc034000 tx=0x7fd5cc009030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:47:18.352 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:18.350+0000 7fd5c67fc640 1 -- 172.21.15.73:0/464824843 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fd5c8053b50 con 0x7fd5d00a8ce0 2023-12-12T09:47:18.581 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:18.579+0000 7fd5d7e36640 1 -- 172.21.15.73:0/464824843 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fd5d0067580 con 0x7fd5d00a8ce0 2023-12-12T09:47:18.582 INFO:tasks.ceph.mon.a.smithi073.stderr:2023-12-12T09:47:18.580+0000 7f81027f3640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-12-12T09:47:18.586 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:18.584+0000 7fd5c67fc640 1 -- 172.21.15.73:0/464824843 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v50) v1 ==== 161+0+0 (secure 0 0 0) 0x7fd5c8017020 con 0x7fd5d00a8ce0 2023-12-12T09:47:18.586 INFO:teuthology.orchestra.run.smithi073.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-12-12T09:47:18.590 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:18.589+0000 7fd5d7e36640 1 -- 172.21.15.73:0/464824843 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fd5b406ae40 msgr2=0x7fd5b406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:18.591 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:18.589+0000 7fd5d7e36640 1 --2- 172.21.15.73:0/464824843 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fd5b406ae40 0x7fd5b406d300 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7fd5cc034000 tx=0x7fd5cc009030 comp rx=0 tx=0).stop 2023-12-12T09:47:18.591 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:18.589+0000 7fd5d7e36640 1 -- 172.21.15.73:0/464824843 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd5d00a8ce0 msgr2=0x7fd5d01e8ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:18.591 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:18.589+0000 7fd5d7e36640 1 --2- 172.21.15.73:0/464824843 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd5d00a8ce0 0x7fd5d01e8ed0 secure :-1 s=READY pgs=1085 cs=0 l=1 rev1=1 crypto rx=0x7fd5d006e430 tx=0x7fd5c800c980 comp rx=0 tx=0).stop 2023-12-12T09:47:18.592 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:18.589+0000 7fd5d7e36640 1 -- 172.21.15.73:0/464824843 shutdown_connections 2023-12-12T09:47:18.593 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:18.589+0000 7fd5d7e36640 1 --2- 172.21.15.73:0/464824843 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fd5b406ae40 0x7fd5b406d300 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:18.593 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:18.589+0000 7fd5d7e36640 1 --2- 172.21.15.73:0/464824843 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd5d00a8ce0 0x7fd5d01e8ed0 unknown :-1 s=CLOSED pgs=1085 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:18.593 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:18.589+0000 7fd5d7e36640 1 --2- 172.21.15.73:0/464824843 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd5d01541e0 0x7fd5d01e6b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:18.593 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:18.589+0000 7fd5d7e36640 1 --2- 172.21.15.73:0/464824843 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd5bc0039a0 0x7fd5d006d260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:18.593 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:18.589+0000 7fd5d7e36640 1 -- 172.21.15.73:0/464824843 >> 172.21.15.73:0/464824843 conn(0x7fd5d00a77d0 msgr2=0x7fd5d00a67f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:47:18.594 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:18.590+0000 7fd5d7e36640 1 -- 172.21.15.73:0/464824843 shutdown_connections 2023-12-12T09:47:18.594 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:18.591+0000 7fd5d7e36640 1 -- 172.21.15.73:0/464824843 wait complete. 2023-12-12T09:47:18.601 INFO:tasks.ceph.mds.c.smithi073.stderr: -5550> 2023-12-12T09:46:31.310+0000 7f2c93227640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-12-12T09:47:18.612 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-12-12T09:47:18.656 INFO:tasks.ceph.mds.c.smithi073.stdout:starting mds.c at 2023-12-12T09:47:18.804 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:18.802+0000 7fc1b4248640 1 Processor -- start 2023-12-12T09:47:18.804 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:18.803+0000 7fc1b4248640 1 -- start start 2023-12-12T09:47:18.805 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:18.804+0000 7fc1b4248640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fc1ac0c3930 0x7fc1ac06d440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:18.805 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:18.804+0000 7fc1b4248640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1ac1582e0 con 0x7fc1ac151c30 2023-12-12T09:47:18.806 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:18.804+0000 7fc1b4248640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1ac0a4f50 con 0x7fc1ac0bed50 2023-12-12T09:47:18.806 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:18.804+0000 7fc1b4248640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1ac0a54d0 con 0x7fc1ac0c3930 2023-12-12T09:47:18.806 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:18.804+0000 7fc1b1fe4640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7fc1ac151c30 0x7fc1ac157bd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:54760/0 (socket says 172.21.15.73:54760) 2023-12-12T09:47:18.806 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:18.804+0000 7fc1b1fe4640 1 -- 172.21.15.73:0/3278756247 learned_addr learned my addr 172.21.15.73:0/3278756247 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-12T09:47:18.808 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:18.804+0000 7fc1b17e3640 1 --2- 172.21.15.73:0/3278756247 >> v2:172.21.15.142:3300/0 conn(0x7fc1ac0c3930 0x7fc1ac06d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:18.808 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:18.805+0000 7fc1b0fe2640 1 -- 172.21.15.73:0/3278756247 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 507925247 0 0) 0x7fc1ac1582e0 con 0x7fc1ac151c30 2023-12-12T09:47:18.808 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:18.805+0000 7fc1b0fe2640 1 -- 172.21.15.73:0/3278756247 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc198003520 con 0x7fc1ac151c30 2023-12-12T09:47:18.808 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:18.805+0000 7fc1b0fe2640 1 -- 172.21.15.73:0/3278756247 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4113956100 0 0) 0x7fc198003520 con 0x7fc1ac151c30 2023-12-12T09:47:18.808 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:18.805+0000 7fc1b0fe2640 1 -- 172.21.15.73:0/3278756247 >> v2:172.21.15.142:3300/0 conn(0x7fc1ac0c3930 msgr2=0x7fc1ac06d440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:47:18.808 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:18.805+0000 7fc1b0fe2640 1 --2- 172.21.15.73:0/3278756247 >> v2:172.21.15.142:3300/0 conn(0x7fc1ac0c3930 0x7fc1ac06d440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:18.808 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:18.805+0000 7fc1b0fe2640 1 -- 172.21.15.73:0/3278756247 >> v1:172.21.15.142:6789/0 conn(0x7fc1ac0bed50 legacy=0x7fc1ac0bf160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:18.808 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:18.805+0000 7fc1b0fe2640 1 -- 172.21.15.73:0/3278756247 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1ac155260 con 0x7fc1ac151c30 2023-12-12T09:47:18.808 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:18.805+0000 7fc1b0fe2640 1 -- 172.21.15.73:0/3278756247 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3186547832 0 0) 0x7fc1a8001670 con 0x7fc1ac151c30 2023-12-12T09:47:18.808 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:18.805+0000 7fc1b0fe2640 1 -- 172.21.15.73:0/3278756247 >> v1:172.21.15.73:6789/0 conn(0x7fc1ac151c30 legacy=0x7fc1ac157bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:18.809 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:18.805+0000 7fc1b0fe2640 1 --2- 172.21.15.73:0/3278756247 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc1980039c0 0x7fc198003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:18.809 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:18.805+0000 7fc1b0fe2640 1 --2- 172.21.15.73:0/3278756247 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc1980047c0 0x7fc198004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:18.809 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:18.805+0000 7fc1b0fe2640 1 --2- 172.21.15.73:0/3278756247 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc1980051d0 0x7fc19800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:18.809 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:18.805+0000 7fc1b0fe2640 1 -- 172.21.15.73:0/3278756247 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1ac0a54d0 con 0x7fc1980047c0 2023-12-12T09:47:18.809 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:18.805+0000 7fc1b0fe2640 1 -- 172.21.15.73:0/3278756247 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc19800c120 con 0x7fc1980039c0 2023-12-12T09:47:18.809 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:18.805+0000 7fc1b0fe2640 1 -- 172.21.15.73:0/3278756247 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc19800c2e0 con 0x7fc1980051d0 2023-12-12T09:47:18.810 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:18.805+0000 7fc1b17e3640 1 --2- 172.21.15.73:0/3278756247 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc1980047c0 0x7fc198004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:18.810 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:18.806+0000 7fc1b1fe4640 1 --2- 172.21.15.73:0/3278756247 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc1980039c0 0x7fc198003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:18.810 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:18.806+0000 7fc1b17e3640 1 -- 172.21.15.73:0/3278756247 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc1980051d0 msgr2=0x7fc19800b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:47:18.810 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:18.806+0000 7fc1b17e3640 1 --2- 172.21.15.73:0/3278756247 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc1980051d0 0x7fc19800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:18.810 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:18.806+0000 7fc1b17e3640 1 -- 172.21.15.73:0/3278756247 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc1980039c0 msgr2=0x7fc198003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:47:18.810 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:18.806+0000 7fc1b17e3640 1 --2- 172.21.15.73:0/3278756247 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc1980039c0 0x7fc198003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:18.810 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:18.806+0000 7fc1b17e3640 1 -- 172.21.15.73:0/3278756247 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc198003520 con 0x7fc1980047c0 2023-12-12T09:47:18.810 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:18.806+0000 7fc1b27e5640 1 -- 172.21.15.73:0/3278756247 reap_dead start 2023-12-12T09:47:18.812 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:18.807+0000 7fc1b17e3640 1 --2- 172.21.15.73:0/3278756247 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc1980047c0 0x7fc198004c40 secure :-1 s=READY pgs=1090 cs=0 l=1 rev1=1 crypto rx=0x7fc19c009a90 tx=0x7fc1980057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50e37a0dc937cb9e server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:47:18.812 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:18.807+0000 7fc1b0fe2640 1 -- 172.21.15.73:0/3278756247 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc19c02c680 con 0x7fc1980047c0 2023-12-12T09:47:18.812 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:18.807+0000 7fc1b0fe2640 1 -- 172.21.15.73:0/3278756247 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc19c02c7e0 con 0x7fc1980047c0 2023-12-12T09:47:18.813 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:18.807+0000 7fc1b0fe2640 1 -- 172.21.15.73:0/3278756247 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc19c02cb70 con 0x7fc1980047c0 2023-12-12T09:47:18.813 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:18.808+0000 7fc1b4248640 1 -- 172.21.15.73:0/3278756247 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc1980047c0 msgr2=0x7fc198004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:18.813 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:18.808+0000 7fc1b4248640 1 --2- 172.21.15.73:0/3278756247 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc1980047c0 0x7fc198004c40 secure :-1 s=READY pgs=1090 cs=0 l=1 rev1=1 crypto rx=0x7fc19c009a90 tx=0x7fc1980057f0 comp rx=0 tx=0).stop 2023-12-12T09:47:18.813 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:18.808+0000 7fc1b4248640 1 -- 172.21.15.73:0/3278756247 shutdown_connections 2023-12-12T09:47:18.813 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:18.808+0000 7fc1b4248640 1 --2- 172.21.15.73:0/3278756247 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc1980047c0 0x7fc198004c40 unknown :-1 s=CLOSED pgs=1090 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:18.813 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:18.808+0000 7fc1b4248640 1 -- 172.21.15.73:0/3278756247 >> 172.21.15.73:0/3278756247 conn(0x7fc1ac06a4e0 msgr2=0x7fc1ac06a8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:47:18.813 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:18.808+0000 7fc1b4248640 1 -- 172.21.15.73:0/3278756247 shutdown_connections 2023-12-12T09:47:18.813 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:18.808+0000 7fc1b4248640 1 -- 172.21.15.73:0/3278756247 wait complete. 2023-12-12T09:47:18.813 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:18.810+0000 7fc1b4248640 1 Processor -- start 2023-12-12T09:47:18.813 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:18.810+0000 7fc1b4248640 1 -- start start 2023-12-12T09:47:18.813 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:18.811+0000 7fc1b4248640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc1980047c0 0x7fc1ac0c1e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:18.814 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:18.811+0000 7fc1b4248640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc1ac1ea990 0x7fc1ac071f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:18.814 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:18.811+0000 7fc1b4248640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc1ac1559d0 0x7fc1ac072460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:18.814 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:18.811+0000 7fc1b4248640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1ac0729a0 con 0x7fc1ac1559d0 2023-12-12T09:47:18.814 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:18.811+0000 7fc1b4248640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1ac1eae90 con 0x7fc1ac1ea990 2023-12-12T09:47:18.814 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:18.811+0000 7fc1b4248640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1ac071a70 con 0x7fc1980047c0 2023-12-12T09:47:18.814 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:18.811+0000 7fc1b27e5640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc1ac1559d0 0x7fc1ac072460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:18.814 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:18.811+0000 7fc1b27e5640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc1ac1559d0 0x7fc1ac072460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:54462/0 (socket says 172.21.15.73:54462) 2023-12-12T09:47:18.814 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:18.811+0000 7fc1b27e5640 1 -- 172.21.15.73:0/958560662 learned_addr learned my addr 172.21.15.73:0/958560662 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:47:18.816 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:18.811+0000 7fc1b1fe4640 1 --2- 172.21.15.73:0/958560662 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc1980047c0 0x7fc1ac0c1e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:18.816 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:18.811+0000 7fc1b27e5640 1 -- 172.21.15.73:0/958560662 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc1980047c0 msgr2=0x7fc1ac0c1e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:18.816 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:18.811+0000 7fc1b27e5640 1 --2- 172.21.15.73:0/958560662 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc1980047c0 0x7fc1ac0c1e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:18.816 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:18.811+0000 7fc1b17e3640 1 --2- 172.21.15.73:0/958560662 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc1ac1ea990 0x7fc1ac071f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:18.816 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:18.811+0000 7fc1b27e5640 1 -- 172.21.15.73:0/958560662 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc1ac1ea990 msgr2=0x7fc1ac071f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:18.816 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:18.811+0000 7fc1b27e5640 1 --2- 172.21.15.73:0/958560662 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc1ac1ea990 0x7fc1ac071f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:18.816 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:18.811+0000 7fc1b27e5640 1 -- 172.21.15.73:0/958560662 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1ac06fd40 con 0x7fc1ac1559d0 2023-12-12T09:47:18.816 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:18.812+0000 7fc1b27e5640 1 --2- 172.21.15.73:0/958560662 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc1ac1559d0 0x7fc1ac072460 secure :-1 s=READY pgs=1091 cs=0 l=1 rev1=1 crypto rx=0x7fc1ac06fbe0 tx=0x7fc1a400c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:47:18.817 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:18.812+0000 7fc1a27fc640 1 -- 172.21.15.73:0/958560662 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1a4007070 con 0x7fc1ac1559d0 2023-12-12T09:47:18.817 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:18.812+0000 7fc1a27fc640 1 -- 172.21.15.73:0/958560662 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1a40071f0 con 0x7fc1ac1559d0 2023-12-12T09:47:18.817 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:18.812+0000 7fc1a27fc640 1 -- 172.21.15.73:0/958560662 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1a40075a0 con 0x7fc1ac1559d0 2023-12-12T09:47:18.817 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:18.812+0000 7fc1b4248640 1 -- 172.21.15.73:0/958560662 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1ac070020 con 0x7fc1ac1559d0 2023-12-12T09:47:18.817 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:18.812+0000 7fc1b4248640 1 -- 172.21.15.73:0/958560662 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1ac14be80 con 0x7fc1ac1559d0 2023-12-12T09:47:18.817 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:18.813+0000 7fc1b4248640 1 -- 172.21.15.73:0/958560662 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1ac071c40 con 0x7fc1ac1559d0 2023-12-12T09:47:18.818 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:18.814+0000 7fc1a27fc640 1 -- 172.21.15.73:0/958560662 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fc1a4007700 con 0x7fc1ac1559d0 2023-12-12T09:47:18.818 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:18.815+0000 7fc1a27fc640 1 --2- 172.21.15.73:0/958560662 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fc19006ae40 0x7fc19006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:18.818 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:18.815+0000 7fc1a27fc640 1 -- 172.21.15.73:0/958560662 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6709+0+0 (secure 0 0 0) 0x7fc1a4088800 con 0x7fc1ac1559d0 2023-12-12T09:47:18.818 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:18.815+0000 7fc1b1fe4640 1 --2- 172.21.15.73:0/958560662 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fc19006ae40 0x7fc19006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:18.818 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:18.816+0000 7fc1b1fe4640 1 --2- 172.21.15.73:0/958560662 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fc19006ae40 0x7fc19006d300 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7fc1a8001050 tx=0x7fc1a8001e10 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:47:18.821 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:18.820+0000 7fc1a27fc640 1 -- 172.21.15.73:0/958560662 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fc1ac071c40 con 0x7fc1ac1559d0 2023-12-12T09:47:19.048 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:19.047+0000 7fc1b4248640 1 -- 172.21.15.73:0/958560662 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fc1ac071c40 con 0x7fc1ac1559d0 2023-12-12T09:47:19.264 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T09:47:19.275 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T09:47:19.590 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:19.588+0000 7fc1a27fc640 1 -- 172.21.15.73:0/958560662 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v51) v1 ==== 104+0+0 (secure 0 0 0) 0x7fc1ac071c40 con 0x7fc1ac1559d0 2023-12-12T09:47:19.593 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:19.591+0000 7fc1b4248640 1 -- 172.21.15.73:0/958560662 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fc19006ae40 msgr2=0x7fc19006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:19.593 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:19.591+0000 7fc1b4248640 1 --2- 172.21.15.73:0/958560662 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fc19006ae40 0x7fc19006d300 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7fc1a8001050 tx=0x7fc1a8001e10 comp rx=0 tx=0).stop 2023-12-12T09:47:19.593 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:19.591+0000 7fc1b4248640 1 -- 172.21.15.73:0/958560662 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc1ac1559d0 msgr2=0x7fc1ac072460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:19.593 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:19.591+0000 7fc1b4248640 1 --2- 172.21.15.73:0/958560662 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc1ac1559d0 0x7fc1ac072460 secure :-1 s=READY pgs=1091 cs=0 l=1 rev1=1 crypto rx=0x7fc1ac06fbe0 tx=0x7fc1a400c960 comp rx=0 tx=0).stop 2023-12-12T09:47:19.594 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:19.592+0000 7fc1b4248640 1 -- 172.21.15.73:0/958560662 shutdown_connections 2023-12-12T09:47:19.594 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:19.592+0000 7fc1b4248640 1 --2- 172.21.15.73:0/958560662 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fc19006ae40 0x7fc19006d300 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:19.594 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:19.592+0000 7fc1b4248640 1 --2- 172.21.15.73:0/958560662 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc1ac1559d0 0x7fc1ac072460 unknown :-1 s=CLOSED pgs=1091 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:19.594 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:19.592+0000 7fc1b4248640 1 --2- 172.21.15.73:0/958560662 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc1ac1ea990 0x7fc1ac071f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:19.594 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:19.592+0000 7fc1b4248640 1 --2- 172.21.15.73:0/958560662 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc1980047c0 0x7fc1ac0c1e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:19.594 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:19.592+0000 7fc1b4248640 1 -- 172.21.15.73:0/958560662 >> 172.21.15.73:0/958560662 conn(0x7fc1ac06a4e0 msgr2=0x7fc1ac14f450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:47:19.594 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:19.592+0000 7fc1b4248640 1 -- 172.21.15.73:0/958560662 shutdown_connections 2023-12-12T09:47:19.594 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:19.592+0000 7fc1b4248640 1 -- 172.21.15.73:0/958560662 wait complete. 2023-12-12T09:47:19.614 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-12-12T09:47:19.830 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:19.828+0000 7f21cb7be640 1 Processor -- start 2023-12-12T09:47:19.830 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:19.829+0000 7f21cb7be640 1 -- start start 2023-12-12T09:47:19.831 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:19.830+0000 7f21cb7be640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f21c406dc40 0x7f21c4152c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:19.831 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:19.830+0000 7f21cb7be640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21c40c16c0 con 0x7f21c406d350 2023-12-12T09:47:19.832 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:19.830+0000 7f21cb7be640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21c40c19a0 con 0x7f21c414f8c0 2023-12-12T09:47:19.832 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:19.830+0000 7f21cb7be640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21c40c1090 con 0x7f21c406dc40 2023-12-12T09:47:19.832 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:19.830+0000 7f21c9d5b640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f21c406dc40 0x7f21c4152c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:19.832 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:19.830+0000 7f21c8d59640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f21c406d350 0x7f21c4152500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:48624/0 (socket says 172.21.15.73:48624) 2023-12-12T09:47:19.832 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:19.830+0000 7f21c8d59640 1 -- 172.21.15.73:0/3838495504 learned_addr learned my addr 172.21.15.73:0/3838495504 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-12T09:47:19.832 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:19.831+0000 7f21c9d5b640 1 -- 172.21.15.73:0/3838495504 >> v1:172.21.15.142:6789/0 conn(0x7f21c414f8c0 legacy=0x7f21c4071e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:47:19.833 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:19.831+0000 7f21c9d5b640 1 -- 172.21.15.73:0/3838495504 >> v1:172.21.15.73:6789/0 conn(0x7f21c406d350 legacy=0x7f21c4152500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:19.833 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:19.831+0000 7f21c9d5b640 1 -- 172.21.15.73:0/3838495504 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21c40c1c80 con 0x7f21c406dc40 2023-12-12T09:47:19.833 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:19.831+0000 7f21c3fff640 1 -- 172.21.15.73:0/3838495504 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2719176885 0 0) 0x7f21c40c16c0 con 0x7f21c406d350 2023-12-12T09:47:19.834 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:19.832+0000 7f21c9d5b640 1 --2- 172.21.15.73:0/3838495504 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f21c406dc40 0x7f21c4152c10 secure :-1 s=READY pgs=1093 cs=0 l=1 rev1=1 crypto rx=0x7f21bc0097a0 tx=0x7f21bc02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b30446f9ef913715 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:47:19.834 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:19.833+0000 7f21c3fff640 1 -- 172.21.15.73:0/3838495504 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21bc031830 con 0x7f21c406dc40 2023-12-12T09:47:19.834 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:19.833+0000 7f21c3fff640 1 -- 172.21.15.73:0/3838495504 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21bc031990 con 0x7f21c406dc40 2023-12-12T09:47:19.834 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:19.833+0000 7f21c3fff640 1 -- 172.21.15.73:0/3838495504 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21bc031d20 con 0x7f21c406dc40 2023-12-12T09:47:19.835 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:19.833+0000 7f21cb7be640 1 -- 172.21.15.73:0/3838495504 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f21c406dc40 msgr2=0x7f21c4152c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:19.835 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:19.833+0000 7f21cb7be640 1 --2- 172.21.15.73:0/3838495504 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f21c406dc40 0x7f21c4152c10 secure :-1 s=READY pgs=1093 cs=0 l=1 rev1=1 crypto rx=0x7f21bc0097a0 tx=0x7f21bc02b8d0 comp rx=0 tx=0).stop 2023-12-12T09:47:19.835 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:19.833+0000 7f21cb7be640 1 -- 172.21.15.73:0/3838495504 shutdown_connections 2023-12-12T09:47:19.835 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:19.833+0000 7f21cb7be640 1 --2- 172.21.15.73:0/3838495504 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f21c406dc40 0x7f21c4152c10 unknown :-1 s=CLOSED pgs=1093 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:19.835 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:19.834+0000 7f21cb7be640 1 -- 172.21.15.73:0/3838495504 >> 172.21.15.73:0/3838495504 conn(0x7f21c406a4e0 msgr2=0x7f21c406a8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:47:19.835 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:19.834+0000 7f21cb7be640 1 -- 172.21.15.73:0/3838495504 shutdown_connections 2023-12-12T09:47:19.836 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:19.834+0000 7f21cb7be640 1 -- 172.21.15.73:0/3838495504 wait complete. 2023-12-12T09:47:19.837 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:19.835+0000 7f21cb7be640 1 Processor -- start 2023-12-12T09:47:19.837 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:19.835+0000 7f21cb7be640 1 -- start start 2023-12-12T09:47:19.838 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:19.836+0000 7f21cb7be640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f21c406d350 0x7f21c414c660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:19.838 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:19.836+0000 7f21cb7be640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f21c406dc40 0x7f21c4149b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:19.838 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:19.836+0000 7f21cb7be640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f21c414f8c0 0x7f21c4071170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:19.838 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:19.836+0000 7f21cb7be640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21c41ea630 con 0x7f21c406d350 2023-12-12T09:47:19.838 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:19.836+0000 7f21cb7be640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21c41561b0 con 0x7f21c406dc40 2023-12-12T09:47:19.838 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:19.836+0000 7f21cb7be640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21c4156490 con 0x7f21c414f8c0 2023-12-12T09:47:19.838 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:19.836+0000 7f21c955a640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f21c406d350 0x7f21c414c660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:19.838 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:19.837+0000 7f21c955a640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f21c406d350 0x7f21c414c660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:42650/0 (socket says 172.21.15.73:42650) 2023-12-12T09:47:19.839 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:19.837+0000 7f21c955a640 1 -- 172.21.15.73:0/3720403570 learned_addr learned my addr 172.21.15.73:0/3720403570 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:47:19.840 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:19.837+0000 7f21c955a640 1 -- 172.21.15.73:0/3720403570 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f21c414f8c0 msgr2=0x7f21c4071170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:19.840 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:19.837+0000 7f21c9d5b640 1 --2- 172.21.15.73:0/3720403570 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f21c414f8c0 0x7f21c4071170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:19.840 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:19.837+0000 7f21c8d59640 1 --2- 172.21.15.73:0/3720403570 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f21c406dc40 0x7f21c4149b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:19.840 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:19.837+0000 7f21c955a640 1 --2- 172.21.15.73:0/3720403570 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f21c414f8c0 0x7f21c4071170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:19.840 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:19.837+0000 7f21c955a640 1 -- 172.21.15.73:0/3720403570 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f21c406dc40 msgr2=0x7f21c4149b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:19.840 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:19.837+0000 7f21c955a640 1 --2- 172.21.15.73:0/3720403570 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f21c406dc40 0x7f21c4149b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:19.840 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:19.837+0000 7f21c955a640 1 -- 172.21.15.73:0/3720403570 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21bc009400 con 0x7f21c406d350 2023-12-12T09:47:19.840 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:19.837+0000 7f21c955a640 1 --2- 172.21.15.73:0/3720403570 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f21c406d350 0x7f21c414c660 secure :-1 s=READY pgs=1094 cs=0 l=1 rev1=1 crypto rx=0x7f21b800c7c0 tx=0x7f21b800cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:47:19.840 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:19.838+0000 7f21c1ffb640 1 -- 172.21.15.73:0/3720403570 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21b800aa50 con 0x7f21c406d350 2023-12-12T09:47:19.840 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:19.838+0000 7f21c1ffb640 1 -- 172.21.15.73:0/3720403570 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21b800abb0 con 0x7f21c406d350 2023-12-12T09:47:19.841 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:19.838+0000 7f21c1ffb640 1 -- 172.21.15.73:0/3720403570 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21b8012420 con 0x7f21c406d350 2023-12-12T09:47:19.841 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:19.838+0000 7f21cb7be640 1 -- 172.21.15.73:0/3720403570 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21c4156770 con 0x7f21c406d350 2023-12-12T09:47:19.841 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:19.838+0000 7f21cb7be640 1 -- 172.21.15.73:0/3720403570 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21c40716b0 con 0x7f21c406d350 2023-12-12T09:47:19.841 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:19.839+0000 7f21cb7be640 1 -- 172.21.15.73:0/3720403570 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21c4067070 con 0x7f21c406d350 2023-12-12T09:47:19.841 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:19.840+0000 7f21c1ffb640 1 -- 172.21.15.73:0/3720403570 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f21b8012580 con 0x7f21c406d350 2023-12-12T09:47:19.842 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:19.840+0000 7f21c1ffb640 1 --2- 172.21.15.73:0/3720403570 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f21a806ae40 0x7f21a806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:19.842 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:19.841+0000 7f21c1ffb640 1 -- 172.21.15.73:0/3720403570 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6709+0+0 (secure 0 0 0) 0x7f21b8089980 con 0x7f21c406d350 2023-12-12T09:47:19.842 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:19.841+0000 7f21c8d59640 1 --2- 172.21.15.73:0/3720403570 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f21a806ae40 0x7f21a806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:19.843 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:19.842+0000 7f21c8d59640 1 --2- 172.21.15.73:0/3720403570 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f21a806ae40 0x7f21a806d300 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f21c414c070 tx=0x7f21b0009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:47:19.847 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:19.846+0000 7f21c1ffb640 1 -- 172.21.15.73:0/3720403570 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f21b8054630 con 0x7f21c406d350 2023-12-12T09:47:20.038 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:20.036+0000 7f21cb7be640 1 -- 172.21.15.73:0/3720403570 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f21c40724f0 con 0x7f21c406d350 2023-12-12T09:47:20.784 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:20.781+0000 7f21c1ffb640 1 -- 172.21.15.73:0/3720403570 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v83) v1 ==== 181+0+0 (secure 0 0 0) 0x7f21b8057c50 con 0x7f21c406d350 2023-12-12T09:47:20.784 INFO:teuthology.orchestra.run.smithi073.stderr:pool 'cephfs_metadata' removed 2023-12-12T09:47:20.789 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:20.787+0000 7f21cb7be640 1 -- 172.21.15.73:0/3720403570 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f21a806ae40 msgr2=0x7f21a806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:20.789 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:20.787+0000 7f21cb7be640 1 --2- 172.21.15.73:0/3720403570 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f21a806ae40 0x7f21a806d300 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f21c414c070 tx=0x7f21b0009040 comp rx=0 tx=0).stop 2023-12-12T09:47:20.789 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:20.787+0000 7f21cb7be640 1 -- 172.21.15.73:0/3720403570 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f21c406d350 msgr2=0x7f21c414c660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:20.789 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:20.787+0000 7f21cb7be640 1 --2- 172.21.15.73:0/3720403570 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f21c406d350 0x7f21c414c660 secure :-1 s=READY pgs=1094 cs=0 l=1 rev1=1 crypto rx=0x7f21b800c7c0 tx=0x7f21b800cc80 comp rx=0 tx=0).stop 2023-12-12T09:47:20.789 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:20.787+0000 7f21cb7be640 1 -- 172.21.15.73:0/3720403570 shutdown_connections 2023-12-12T09:47:20.789 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:20.787+0000 7f21cb7be640 1 --2- 172.21.15.73:0/3720403570 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f21a806ae40 0x7f21a806d300 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:20.789 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:20.787+0000 7f21cb7be640 1 --2- 172.21.15.73:0/3720403570 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f21c414f8c0 0x7f21c4071170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:20.790 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:20.787+0000 7f21cb7be640 1 --2- 172.21.15.73:0/3720403570 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f21c406dc40 0x7f21c4149b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:20.790 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:20.787+0000 7f21cb7be640 1 --2- 172.21.15.73:0/3720403570 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f21c406d350 0x7f21c414c660 secure :-1 s=CLOSED pgs=1094 cs=0 l=1 rev1=1 crypto rx=0x7f21b800c7c0 tx=0x7f21b800cc80 comp rx=0 tx=0).stop 2023-12-12T09:47:20.790 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:20.788+0000 7f21cb7be640 1 -- 172.21.15.73:0/3720403570 >> 172.21.15.73:0/3720403570 conn(0x7f21c406a4e0 msgr2=0x7f21c4152500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:47:20.790 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:20.789+0000 7f21cb7be640 1 -- 172.21.15.73:0/3720403570 shutdown_connections 2023-12-12T09:47:20.791 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:20.789+0000 7f21cb7be640 1 -- 172.21.15.73:0/3720403570 wait complete. 2023-12-12T09:47:20.813 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-12-12T09:47:21.019 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:21.018+0000 7fae573fb640 1 Processor -- start 2023-12-12T09:47:21.020 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:21.018+0000 7fae573fb640 1 -- start start 2023-12-12T09:47:21.021 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:21.019+0000 7fae573fb640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fae5014f8c0 0x7fae5006dc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:21.021 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:21.019+0000 7fae573fb640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fae5006d350 0x7fae50071e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:21.021 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:21.019+0000 7fae573fb640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fae500723a0 0x7fae50152500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:21.021 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:21.019+0000 7fae573fb640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae500c1090 con 0x7fae5014f8c0 2023-12-12T09:47:21.021 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:21.019+0000 7fae573fb640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae500c14b0 con 0x7fae5006d350 2023-12-12T09:47:21.021 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:21.019+0000 7fae573fb640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae500c16c0 con 0x7fae500723a0 2023-12-12T09:47:21.022 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:21.020+0000 7fae55197640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fae5014f8c0 0x7fae5006dc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:21.022 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:21.020+0000 7fae55197640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fae5014f8c0 0x7fae5006dc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:42652/0 (socket says 172.21.15.73:42652) 2023-12-12T09:47:21.022 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:21.020+0000 7fae55197640 1 -- 172.21.15.73:0/2426094306 learned_addr learned my addr 172.21.15.73:0/2426094306 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:47:21.022 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:21.020+0000 7fae54996640 1 --2- 172.21.15.73:0/2426094306 >> v2:172.21.15.142:3300/0 conn(0x7fae5006d350 0x7fae50071e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:21.022 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:21.020+0000 7fae55998640 1 --2- 172.21.15.73:0/2426094306 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fae500723a0 0x7fae50152500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:21.023 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:21.021+0000 7fae55197640 1 -- 172.21.15.73:0/2426094306 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fae500723a0 msgr2=0x7fae50152500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:47:21.023 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:21.021+0000 7fae55197640 1 --2- 172.21.15.73:0/2426094306 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fae500723a0 0x7fae50152500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:21.023 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:21.021+0000 7fae55197640 1 -- 172.21.15.73:0/2426094306 >> v2:172.21.15.142:3300/0 conn(0x7fae5006d350 msgr2=0x7fae50071e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:47:21.023 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:21.021+0000 7fae55197640 1 --2- 172.21.15.73:0/2426094306 >> v2:172.21.15.142:3300/0 conn(0x7fae5006d350 0x7fae50071e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:21.023 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:21.021+0000 7fae55197640 1 -- 172.21.15.73:0/2426094306 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae500c19a0 con 0x7fae5014f8c0 2023-12-12T09:47:21.023 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:21.022+0000 7fae55197640 1 --2- 172.21.15.73:0/2426094306 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fae5014f8c0 0x7fae5006dc40 secure :-1 s=READY pgs=1095 cs=0 l=1 rev1=1 crypto rx=0x7fae500c3430 tx=0x7fae4402bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=129ae730a514fa41 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:47:21.024 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:21.022+0000 7fae4ffff640 1 -- 172.21.15.73:0/2426094306 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae4402ca70 con 0x7fae5014f8c0 2023-12-12T09:47:21.024 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:21.022+0000 7fae4ffff640 1 -- 172.21.15.73:0/2426094306 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae4402cbd0 con 0x7fae5014f8c0 2023-12-12T09:47:21.024 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:21.022+0000 7fae4ffff640 1 -- 172.21.15.73:0/2426094306 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae440343f0 con 0x7fae5014f8c0 2023-12-12T09:47:21.025 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:21.023+0000 7fae573fb640 1 -- 172.21.15.73:0/2426094306 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fae5014f8c0 msgr2=0x7fae5006dc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:21.025 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:21.023+0000 7fae573fb640 1 --2- 172.21.15.73:0/2426094306 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fae5014f8c0 0x7fae5006dc40 secure :-1 s=READY pgs=1095 cs=0 l=1 rev1=1 crypto rx=0x7fae500c3430 tx=0x7fae4402bed0 comp rx=0 tx=0).stop 2023-12-12T09:47:21.025 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:21.023+0000 7fae573fb640 1 -- 172.21.15.73:0/2426094306 shutdown_connections 2023-12-12T09:47:21.025 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:21.023+0000 7fae573fb640 1 --2- 172.21.15.73:0/2426094306 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fae500723a0 0x7fae50152500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:21.025 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:21.023+0000 7fae573fb640 1 --2- 172.21.15.73:0/2426094306 >> v2:172.21.15.142:3300/0 conn(0x7fae5006d350 0x7fae50071e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:21.025 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:21.023+0000 7fae573fb640 1 --2- 172.21.15.73:0/2426094306 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fae5014f8c0 0x7fae5006dc40 unknown :-1 s=CLOSED pgs=1095 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:21.025 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:21.023+0000 7fae573fb640 1 -- 172.21.15.73:0/2426094306 >> 172.21.15.73:0/2426094306 conn(0x7fae5006a4e0 msgr2=0x7fae5006a8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:47:21.025 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:21.023+0000 7fae573fb640 1 -- 172.21.15.73:0/2426094306 shutdown_connections 2023-12-12T09:47:21.025 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:21.023+0000 7fae573fb640 1 -- 172.21.15.73:0/2426094306 wait complete. 2023-12-12T09:47:21.026 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:21.025+0000 7fae573fb640 1 Processor -- start 2023-12-12T09:47:21.026 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:21.025+0000 7fae573fb640 1 -- start start 2023-12-12T09:47:21.028 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:21.026+0000 7fae573fb640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fae5006d350 0x7fae501ebec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:21.028 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:21.026+0000 7fae573fb640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fae500723a0 0x7fae5014af20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:21.028 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:21.026+0000 7fae573fb640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fae5014f8c0 0x7fae500a6860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:21.028 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:21.026+0000 7fae573fb640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae50151b40 con 0x7fae5014f8c0 2023-12-12T09:47:21.028 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:21.026+0000 7fae573fb640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae500a70b0 con 0x7fae500723a0 2023-12-12T09:47:21.029 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:21.026+0000 7fae573fb640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae50151d20 con 0x7fae5006d350 2023-12-12T09:47:21.029 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:21.026+0000 7fae55998640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fae5014f8c0 0x7fae500a6860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:21.029 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:21.026+0000 7fae55998640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fae5014f8c0 0x7fae500a6860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:42660/0 (socket says 172.21.15.73:42660) 2023-12-12T09:47:21.029 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:21.026+0000 7fae55998640 1 -- 172.21.15.73:0/3159868176 learned_addr learned my addr 172.21.15.73:0/3159868176 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:47:21.029 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:21.026+0000 7fae55998640 1 -- 172.21.15.73:0/3159868176 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fae5006d350 msgr2=0x7fae501ebec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:21.029 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:21.026+0000 7fae55998640 1 --2- 172.21.15.73:0/3159868176 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fae5006d350 0x7fae501ebec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:21.029 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:21.027+0000 7fae55998640 1 -- 172.21.15.73:0/3159868176 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fae500723a0 msgr2=0x7fae5014af20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:21.029 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:21.027+0000 7fae55998640 1 --2- 172.21.15.73:0/3159868176 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fae500723a0 0x7fae5014af20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:21.029 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:21.027+0000 7fae55998640 1 -- 172.21.15.73:0/3159868176 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae44009b30 con 0x7fae5014f8c0 2023-12-12T09:47:21.029 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:21.027+0000 7fae55998640 1 --2- 172.21.15.73:0/3159868176 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fae5014f8c0 0x7fae500a6860 secure :-1 s=READY pgs=1096 cs=0 l=1 rev1=1 crypto rx=0x7fae4800e960 tx=0x7fae4800ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:47:21.030 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:21.027+0000 7fae4dffb640 1 -- 172.21.15.73:0/3159868176 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae48009690 con 0x7fae5014f8c0 2023-12-12T09:47:21.030 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:21.027+0000 7fae4dffb640 1 -- 172.21.15.73:0/3159868176 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae4800c980 con 0x7fae5014f8c0 2023-12-12T09:47:21.030 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:21.027+0000 7fae4dffb640 1 -- 172.21.15.73:0/3159868176 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae4800cd30 con 0x7fae5014f8c0 2023-12-12T09:47:21.030 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:21.027+0000 7fae573fb640 1 -- 172.21.15.73:0/3159868176 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae50151fc0 con 0x7fae5014f8c0 2023-12-12T09:47:21.030 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:21.027+0000 7fae573fb640 1 -- 172.21.15.73:0/3159868176 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae5014b460 con 0x7fae5014f8c0 2023-12-12T09:47:21.030 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:21.028+0000 7fae573fb640 1 -- 172.21.15.73:0/3159868176 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae50067070 con 0x7fae5014f8c0 2023-12-12T09:47:21.031 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:21.029+0000 7fae4dffb640 1 -- 172.21.15.73:0/3159868176 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fae48013470 con 0x7fae5014f8c0 2023-12-12T09:47:21.032 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:21.030+0000 7fae4dffb640 1 --2- 172.21.15.73:0/3159868176 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fae3406ae40 0x7fae3406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:21.032 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:21.030+0000 7fae4dffb640 1 -- 172.21.15.73:0/3159868176 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6271+0+0 (secure 0 0 0) 0x7fae48089900 con 0x7fae5014f8c0 2023-12-12T09:47:21.032 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:21.030+0000 7fae55197640 1 --2- 172.21.15.73:0/3159868176 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fae3406ae40 0x7fae3406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:21.032 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:21.031+0000 7fae55197640 1 --2- 172.21.15.73:0/3159868176 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fae3406ae40 0x7fae3406d300 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7fae44035000 tx=0x7fae4402e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:47:21.036 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:21.035+0000 7fae4dffb640 1 -- 172.21.15.73:0/3159868176 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fae48054810 con 0x7fae5014f8c0 2023-12-12T09:47:21.228 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:21.227+0000 7fae573fb640 1 -- 172.21.15.73:0/3159868176 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fae50074700 con 0x7fae5014f8c0 2023-12-12T09:47:21.795 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:21.793+0000 7fae4dffb640 1 -- 172.21.15.73:0/3159868176 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v84) v1 ==== 169+0+0 (secure 0 0 0) 0x7fae480170d0 con 0x7fae5014f8c0 2023-12-12T09:47:21.795 INFO:teuthology.orchestra.run.smithi073.stderr:pool 'cephfs_data' removed 2023-12-12T09:47:21.799 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:21.797+0000 7fae573fb640 1 -- 172.21.15.73:0/3159868176 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fae3406ae40 msgr2=0x7fae3406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:21.799 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:21.797+0000 7fae573fb640 1 --2- 172.21.15.73:0/3159868176 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fae3406ae40 0x7fae3406d300 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7fae44035000 tx=0x7fae4402e000 comp rx=0 tx=0).stop 2023-12-12T09:47:21.799 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:21.797+0000 7fae573fb640 1 -- 172.21.15.73:0/3159868176 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fae5014f8c0 msgr2=0x7fae500a6860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:21.799 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:21.797+0000 7fae573fb640 1 --2- 172.21.15.73:0/3159868176 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fae5014f8c0 0x7fae500a6860 secure :-1 s=READY pgs=1096 cs=0 l=1 rev1=1 crypto rx=0x7fae4800e960 tx=0x7fae4800ee20 comp rx=0 tx=0).stop 2023-12-12T09:47:21.799 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:21.798+0000 7fae573fb640 1 -- 172.21.15.73:0/3159868176 shutdown_connections 2023-12-12T09:47:21.800 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:21.798+0000 7fae573fb640 1 --2- 172.21.15.73:0/3159868176 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fae3406ae40 0x7fae3406d300 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:21.800 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:21.798+0000 7fae573fb640 1 --2- 172.21.15.73:0/3159868176 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fae5014f8c0 0x7fae500a6860 unknown :-1 s=CLOSED pgs=1096 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:21.800 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:21.798+0000 7fae573fb640 1 --2- 172.21.15.73:0/3159868176 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fae500723a0 0x7fae5014af20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:21.800 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:21.798+0000 7fae573fb640 1 --2- 172.21.15.73:0/3159868176 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fae5006d350 0x7fae501ebec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:21.800 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:21.798+0000 7fae573fb640 1 -- 172.21.15.73:0/3159868176 >> 172.21.15.73:0/3159868176 conn(0x7fae5006a4e0 msgr2=0x7fae5014bea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:47:21.801 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:21.799+0000 7fae573fb640 1 -- 172.21.15.73:0/3159868176 shutdown_connections 2023-12-12T09:47:21.801 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:21.800+0000 7fae573fb640 1 -- 172.21.15.73:0/3159868176 wait complete. 2023-12-12T09:47:21.825 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-12T09:47:22.030 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:22.028+0000 7f786c09b640 1 Processor -- start 2023-12-12T09:47:22.030 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:22.028+0000 7f786c09b640 1 -- start start 2023-12-12T09:47:22.031 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:22.030+0000 7f786c09b640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7864151690 0x7f78640c1d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:22.031 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:22.030+0000 7f786c09b640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78640aa6d0 con 0x7f78640aaa90 2023-12-12T09:47:22.031 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:22.030+0000 7f786c09b640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f786406b450 con 0x7f78640aa2f0 2023-12-12T09:47:22.031 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:22.030+0000 7f786c09b640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78640c0cf0 con 0x7f7864151690 2023-12-12T09:47:22.032 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:22.030+0000 7f7869636640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f78640aaa90 0x7f78640c1650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:48632/0 (socket says 172.21.15.73:48632) 2023-12-12T09:47:22.032 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:22.030+0000 7f7869636640 1 -- 172.21.15.73:0/3987321158 learned_addr learned my addr 172.21.15.73:0/3987321158 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-12T09:47:22.033 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:22.030+0000 7f7868e35640 1 -- 172.21.15.73:0/3987321158 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3780314851 0 0) 0x7f78640aa6d0 con 0x7f78640aaa90 2023-12-12T09:47:22.033 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:22.030+0000 7f786a638640 1 --2- 172.21.15.73:0/3987321158 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7864151690 0x7f78640c1d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:22.034 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:22.030+0000 7f7868e35640 1 -- 172.21.15.73:0/3987321158 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f784c003520 con 0x7f78640aaa90 2023-12-12T09:47:22.034 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:22.031+0000 7f7868e35640 1 -- 172.21.15.73:0/3987321158 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 157179902 0 0) 0x7f784c003520 con 0x7f78640aaa90 2023-12-12T09:47:22.034 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:22.031+0000 7f7868e35640 1 -- 172.21.15.73:0/3987321158 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7864151690 msgr2=0x7f78640c1d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:47:22.034 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:22.031+0000 7f7868e35640 1 --2- 172.21.15.73:0/3987321158 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7864151690 0x7f78640c1d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:22.034 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:22.031+0000 7f7868e35640 1 -- 172.21.15.73:0/3987321158 >> v1:172.21.15.142:6789/0 conn(0x7f78640aa2f0 legacy=0x7f786406bf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:22.034 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:22.031+0000 7f7868e35640 1 -- 172.21.15.73:0/3987321158 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78640c22a0 con 0x7f78640aaa90 2023-12-12T09:47:22.034 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:22.031+0000 7f7868e35640 1 -- 172.21.15.73:0/3987321158 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3186547832 0 0) 0x7f7858001670 con 0x7f78640aaa90 2023-12-12T09:47:22.034 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:22.031+0000 7f7868e35640 1 -- 172.21.15.73:0/3987321158 >> v1:172.21.15.73:6789/0 conn(0x7f78640aaa90 legacy=0x7f78640c1650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:22.034 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:22.031+0000 7f7868e35640 1 --2- 172.21.15.73:0/3987321158 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f784c0039a0 0x7f784c003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:22.034 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:22.031+0000 7f7868e35640 1 --2- 172.21.15.73:0/3987321158 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7864151690 0x7f784c0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:22.034 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:22.031+0000 7f7868e35640 1 --2- 172.21.15.73:0/3987321158 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f784c004d00 0x7f784c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:22.034 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:22.031+0000 7f7868e35640 1 -- 172.21.15.73:0/3987321158 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78640c0cf0 con 0x7f784c004d00 2023-12-12T09:47:22.034 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:22.031+0000 7f7868e35640 1 -- 172.21.15.73:0/3987321158 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f784c00ba60 con 0x7f784c0039a0 2023-12-12T09:47:22.035 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:22.031+0000 7f7868e35640 1 -- 172.21.15.73:0/3987321158 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f784c00bc20 con 0x7f7864151690 2023-12-12T09:47:22.035 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:22.031+0000 7f786a638640 1 --2- 172.21.15.73:0/3987321158 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f784c004d00 0x7f784c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:22.035 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:22.032+0000 7f7869636640 1 --2- 172.21.15.73:0/3987321158 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7864151690 0x7f784c0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:22.035 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:22.032+0000 7f7869e37640 1 --2- 172.21.15.73:0/3987321158 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f784c0039a0 0x7f784c003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:22.035 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:22.032+0000 7f786a638640 1 -- 172.21.15.73:0/3987321158 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7864151690 msgr2=0x7f784c0047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:47:22.035 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:22.032+0000 7f786a638640 1 --2- 172.21.15.73:0/3987321158 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7864151690 0x7f784c0047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:22.035 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:22.032+0000 7f786a638640 1 -- 172.21.15.73:0/3987321158 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f784c0039a0 msgr2=0x7f784c003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:47:22.035 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:22.032+0000 7f786a638640 1 --2- 172.21.15.73:0/3987321158 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f784c0039a0 0x7f784c003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:22.035 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:22.032+0000 7f786a638640 1 -- 172.21.15.73:0/3987321158 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f784c003520 con 0x7f784c004d00 2023-12-12T09:47:22.035 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:22.032+0000 7f7869e37640 1 --2- 172.21.15.73:0/3987321158 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f784c0039a0 0x7f784c003dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:47:22.037 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:22.033+0000 7f786a638640 1 --2- 172.21.15.73:0/3987321158 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f784c004d00 0x7f784c005180 secure :-1 s=READY pgs=1098 cs=0 l=1 rev1=1 crypto rx=0x7f785c00aa90 tx=0x7f784c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4bded964f7aada9e server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:47:22.037 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:22.033+0000 7f7868e35640 1 -- 172.21.15.73:0/3987321158 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f785c035440 con 0x7f784c004d00 2023-12-12T09:47:22.037 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:22.033+0000 7f7868e35640 1 -- 172.21.15.73:0/3987321158 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f785c0355a0 con 0x7f784c004d00 2023-12-12T09:47:22.037 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:22.033+0000 7f7868e35640 1 -- 172.21.15.73:0/3987321158 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f785c035930 con 0x7f784c004d00 2023-12-12T09:47:22.037 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:22.034+0000 7f786c09b640 1 -- 172.21.15.73:0/3987321158 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f784c004d00 msgr2=0x7f784c005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:22.037 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:22.034+0000 7f786c09b640 1 --2- 172.21.15.73:0/3987321158 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f784c004d00 0x7f784c005180 secure :-1 s=READY pgs=1098 cs=0 l=1 rev1=1 crypto rx=0x7f785c00aa90 tx=0x7f784c0057f0 comp rx=0 tx=0).stop 2023-12-12T09:47:22.037 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:22.034+0000 7f786a638640 1 -- 172.21.15.73:0/3987321158 reap_dead start 2023-12-12T09:47:22.037 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:22.034+0000 7f786c09b640 1 -- 172.21.15.73:0/3987321158 shutdown_connections 2023-12-12T09:47:22.037 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:22.034+0000 7f786c09b640 1 -- 172.21.15.73:0/3987321158 >> 172.21.15.73:0/3987321158 conn(0x7f78640a8130 msgr2=0x7f78640c24b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:47:22.037 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:22.034+0000 7f786c09b640 1 -- 172.21.15.73:0/3987321158 shutdown_connections 2023-12-12T09:47:22.037 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:22.034+0000 7f786c09b640 1 -- 172.21.15.73:0/3987321158 wait complete. 2023-12-12T09:47:22.039 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:22.036+0000 7f786c09b640 1 Processor -- start 2023-12-12T09:47:22.039 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:22.036+0000 7f786c09b640 1 -- start start 2023-12-12T09:47:22.039 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:22.037+0000 7f786c09b640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f784c004d00 0x7f78641ea6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:22.039 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:22.037+0000 7f786c09b640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7864153640 0x7f78640bf560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:22.039 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:22.037+0000 7f786c09b640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7864150240 0x7f78641506c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:22.039 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:22.037+0000 7f786c09b640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7864153290 con 0x7f784c004d00 2023-12-12T09:47:22.039 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:22.037+0000 7f786c09b640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7864072b90 con 0x7f7864153640 2023-12-12T09:47:22.040 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:22.037+0000 7f786c09b640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f786414fad0 con 0x7f7864150240 2023-12-12T09:47:22.040 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:22.037+0000 7f7869e37640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f784c004d00 0x7f78641ea6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:22.040 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:22.037+0000 7f7869e37640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f784c004d00 0x7f78641ea6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:42690/0 (socket says 172.21.15.73:42690) 2023-12-12T09:47:22.040 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:22.037+0000 7f7869e37640 1 -- 172.21.15.73:0/2091658632 learned_addr learned my addr 172.21.15.73:0/2091658632 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:47:22.040 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:22.037+0000 7f7869e37640 1 -- 172.21.15.73:0/2091658632 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7864150240 msgr2=0x7f78641506c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:22.040 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:22.037+0000 7f7869e37640 1 --2- 172.21.15.73:0/2091658632 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7864150240 0x7f78641506c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:22.040 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:22.037+0000 7f7869e37640 1 -- 172.21.15.73:0/2091658632 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7864153640 msgr2=0x7f78640bf560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:22.040 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:22.037+0000 7f7869e37640 1 --2- 172.21.15.73:0/2091658632 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7864153640 0x7f78640bf560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:22.040 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:22.037+0000 7f7869e37640 1 -- 172.21.15.73:0/2091658632 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f786406fde0 con 0x7f784c004d00 2023-12-12T09:47:22.041 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:22.038+0000 7f7869e37640 1 --2- 172.21.15.73:0/2091658632 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f784c004d00 0x7f78641ea6a0 secure :-1 s=READY pgs=1099 cs=0 l=1 rev1=1 crypto rx=0x7f785400db40 tx=0x7f78540020c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:47:22.041 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:22.038+0000 7f78627fc640 1 -- 172.21.15.73:0/2091658632 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7854003da0 con 0x7f784c004d00 2023-12-12T09:47:22.041 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:22.038+0000 7f78627fc640 1 -- 172.21.15.73:0/2091658632 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7854006b50 con 0x7f784c004d00 2023-12-12T09:47:22.041 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:22.038+0000 7f78627fc640 1 -- 172.21.15.73:0/2091658632 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f785400b6f0 con 0x7f784c004d00 2023-12-12T09:47:22.042 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:22.038+0000 7f786c09b640 1 -- 172.21.15.73:0/2091658632 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78640700c0 con 0x7f784c004d00 2023-12-12T09:47:22.042 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:22.038+0000 7f786c09b640 1 -- 172.21.15.73:0/2091658632 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f786414fd20 con 0x7f784c004d00 2023-12-12T09:47:22.042 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:22.040+0000 7f786c09b640 1 -- 172.21.15.73:0/2091658632 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f786414fee0 con 0x7f784c004d00 2023-12-12T09:47:22.042 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:22.040+0000 7f78627fc640 1 -- 172.21.15.73:0/2091658632 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f785400b850 con 0x7f784c004d00 2023-12-12T09:47:22.043 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:22.041+0000 7f78627fc640 1 --2- 172.21.15.73:0/2091658632 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f785006ae70 0x7f785006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:22.043 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:22.041+0000 7f78627fc640 1 -- 172.21.15.73:0/2091658632 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 5799+0+0 (secure 0 0 0) 0x7f7854088ea0 con 0x7f784c004d00 2023-12-12T09:47:22.043 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:22.041+0000 7f7869636640 1 --2- 172.21.15.73:0/2091658632 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f785006ae70 0x7f785006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:22.043 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:22.042+0000 7f7869636640 1 --2- 172.21.15.73:0/2091658632 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f785006ae70 0x7f785006d330 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f7858001eb0 tx=0x7f7858000ed0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:47:22.047 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:22.046+0000 7f78627fc640 1 -- 172.21.15.73:0/2091658632 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f7854054060 con 0x7f784c004d00 2023-12-12T09:47:22.237 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:22.236+0000 7f786c09b640 1 -- 172.21.15.73:0/2091658632 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f78640c2090 con 0x7f784c004d00 2023-12-12T09:47:22.241 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:22.239+0000 7f78627fc640 1 -- 172.21.15.73:0/2091658632 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v84) v1 ==== 74+0+16653 (secure 0 0 0) 0x7f7854057680 con 0x7f784c004d00 2023-12-12T09:47:22.241 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-12T09:47:22.241 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":84,"fsid":"ba240992-02b8-4c7e-92f2-27eb29ac433b","created":"2023-12-12T09:43:02.454719+0000","modified":"2023-12-12T09:47:21.783499+0000","last_up_change":"2023-12-12T09:43:13.913440+0000","last_in_change":"2023-12-12T09:43:05.925348+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-12T09:43:15.525508+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs2_metadata","create_time":"2023-12-12T09:46:40.116878+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs2_data","create_time":"2023-12-12T09:46:40.798840+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"dd9074be-dbe2-4c34-9896-a4223d8d3940","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":4047810203},{"type":"v1","addr":"172.21.15.73:6801","nonce":4047810203}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":4047810203},{"type":"v1","addr":"172.21.15.73:6803","nonce":4047810203}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":4047810203},{"type":"v1","addr":"172.21.15.73:6807","nonce":4047810203}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":4047810203},{"type":"v1","addr":"172.21.15.73:6805","nonce":4047810203}]},"public_addr":"172.21.15.73:6801/4047810203","cluster_addr":"172.21.15.73:6803/4047810203","heartbeat_back_addr":"172.21.15.73:6807/4047810203","heartbeat_front_addr":"172.21.15.73:6805/4047810203","state":["exists","up"]},{"osd":1,"uuid":"c4a05052-96d4-4758-a4e1-1a37f1e07fed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":1356058331},{"type":"v1","addr":"172.21.15.73:6824","nonce":1356058331}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":1356058331},{"type":"v1","addr":"172.21.15.73:6827","nonce":1356058331}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":1356058331},{"type":"v1","addr":"172.21.15.73:6831","nonce":1356058331}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":1356058331},{"type":"v1","addr":"172.21.15.73:6829","nonce":1356058331}]},"public_addr":"172.21.15.73:6824/1356058331","cluster_addr":"172.21.15.73:6827/1356058331","heartbeat_back_addr":"172.21.15.73:6831/1356058331","heartbeat_front_addr":"172.21.15.73:6829/1356058331","state":["exists","up"]},{"osd":2,"uuid":"512bc8ac-72c2-40d4-b3d2-d867a92c5213","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":1228903316},{"type":"v1","addr":"172.21.15.73:6817","nonce":1228903316}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":1228903316},{"type":"v1","addr":"172.21.15.73:6819","nonce":1228903316}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6823","nonce":1228903316},{"type":"v1","addr":"172.21.15.73:6825","nonce":1228903316}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":1228903316},{"type":"v1","addr":"172.21.15.73:6821","nonce":1228903316}]},"public_addr":"172.21.15.73:6817/1228903316","cluster_addr":"172.21.15.73:6819/1228903316","heartbeat_back_addr":"172.21.15.73:6825/1228903316","heartbeat_front_addr":"172.21.15.73:6821/1228903316","state":["exists","up"]},{"osd":3,"uuid":"3d1a91e0-42bf-437a-8eae-8d357c8f63a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":1293329670},{"type":"v1","addr":"172.21.15.73:6809","nonce":1293329670}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6810","nonce":1293329670},{"type":"v1","addr":"172.21.15.73:6811","nonce":1293329670}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":1293329670},{"type":"v1","addr":"172.21.15.73:6815","nonce":1293329670}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":1293329670},{"type":"v1","addr":"172.21.15.73:6813","nonce":1293329670}]},"public_addr":"172.21.15.73:6809/1293329670","cluster_addr":"172.21.15.73:6811/1293329670","heartbeat_back_addr":"172.21.15.73:6815/1293329670","heartbeat_front_addr":"172.21.15.73:6813/1293329670","state":["exists","up"]},{"osd":4,"uuid":"4b302fff-834c-4069-ac19-00e46f6c87b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":3727975702},{"type":"v1","addr":"172.21.15.142:6801","nonce":3727975702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":3727975702},{"type":"v1","addr":"172.21.15.142:6803","nonce":3727975702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6809","nonce":3727975702},{"type":"v1","addr":"172.21.15.142:6811","nonce":3727975702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6805","nonce":3727975702},{"type":"v1","addr":"172.21.15.142:6807","nonce":3727975702}]},"public_addr":"172.21.15.142:6801/3727975702","cluster_addr":"172.21.15.142:6803/3727975702","heartbeat_back_addr":"172.21.15.142:6811/3727975702","heartbeat_front_addr":"172.21.15.142:6807/3727975702","state":["exists","up"]},{"osd":5,"uuid":"d7cdace2-67d0-45cc-95f2-515cf6ef1b82","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6817","nonce":2353193632},{"type":"v1","addr":"172.21.15.142:6819","nonce":2353193632}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6821","nonce":2353193632},{"type":"v1","addr":"172.21.15.142:6823","nonce":2353193632}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6829","nonce":2353193632},{"type":"v1","addr":"172.21.15.142:6831","nonce":2353193632}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6825","nonce":2353193632},{"type":"v1","addr":"172.21.15.142:6827","nonce":2353193632}]},"public_addr":"172.21.15.142:6819/2353193632","cluster_addr":"172.21.15.142:6823/2353193632","heartbeat_back_addr":"172.21.15.142:6831/2353193632","heartbeat_front_addr":"172.21.15.142:6827/2353193632","state":["exists","up"]},{"osd":6,"uuid":"649ce78a-5626-445c-aedc-a651ed05a6f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":2006111986},{"type":"v1","addr":"172.21.15.142:6806","nonce":2006111986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":2006111986},{"type":"v1","addr":"172.21.15.142:6810","nonce":2006111986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":2006111986},{"type":"v1","addr":"172.21.15.142:6815","nonce":2006111986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":2006111986},{"type":"v1","addr":"172.21.15.142:6813","nonce":2006111986}]},"public_addr":"172.21.15.142:6806/2006111986","cluster_addr":"172.21.15.142:6810/2006111986","heartbeat_back_addr":"172.21.15.142:6815/2006111986","heartbeat_front_addr":"172.21.15.142:6813/2006111986","state":["exists","up"]},{"osd":7,"uuid":"af15ae3b-c1d0-4acf-92db-8a1805494d13","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":2573794341},{"type":"v1","addr":"172.21.15.142:6818","nonce":2573794341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":2573794341},{"type":"v1","addr":"172.21.15.142:6822","nonce":2573794341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":2573794341},{"type":"v1","addr":"172.21.15.142:6830","nonce":2573794341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":2573794341},{"type":"v1","addr":"172.21.15.142:6826","nonce":2573794341}]},"public_addr":"172.21.15.142:6818/2573794341","cluster_addr":"172.21.15.142:6822/2573794341","heartbeat_back_addr":"172.21.15.142:6830/2573794341","heartbeat_front_addr":"172.21.15.142:6826/2573794341","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.185824+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.262103+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.225556+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:10.523459+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:10.706035+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.257339+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.301776+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.051960+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.73:6837/2352791649":"2023-12-13T09:47:18.581724+0000","172.21.15.73:6835/2352791649":"2023-12-13T09:47:18.581724+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-12T09:47:22.243 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:22.241+0000 7f786c09b640 1 -- 172.21.15.73:0/2091658632 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f785006ae70 msgr2=0x7f785006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:22.244 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:22.241+0000 7f786c09b640 1 --2- 172.21.15.73:0/2091658632 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f785006ae70 0x7f785006d330 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f7858001eb0 tx=0x7f7858000ed0 comp rx=0 tx=0).stop 2023-12-12T09:47:22.244 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:22.241+0000 7f786c09b640 1 -- 172.21.15.73:0/2091658632 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f784c004d00 msgr2=0x7f78641ea6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:22.244 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:22.241+0000 7f786c09b640 1 --2- 172.21.15.73:0/2091658632 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f784c004d00 0x7f78641ea6a0 secure :-1 s=READY pgs=1099 cs=0 l=1 rev1=1 crypto rx=0x7f785400db40 tx=0x7f78540020c0 comp rx=0 tx=0).stop 2023-12-12T09:47:22.244 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:22.242+0000 7f786c09b640 1 -- 172.21.15.73:0/2091658632 shutdown_connections 2023-12-12T09:47:22.244 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:22.242+0000 7f786c09b640 1 --2- 172.21.15.73:0/2091658632 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f785006ae70 0x7f785006d330 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:22.244 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:22.242+0000 7f786c09b640 1 --2- 172.21.15.73:0/2091658632 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7864150240 0x7f78641506c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:22.244 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:22.242+0000 7f786c09b640 1 --2- 172.21.15.73:0/2091658632 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7864153640 0x7f78640bf560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:22.244 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:22.242+0000 7f786c09b640 1 --2- 172.21.15.73:0/2091658632 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f784c004d00 0x7f78641ea6a0 unknown :-1 s=CLOSED pgs=1099 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:22.244 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:22.242+0000 7f786c09b640 1 -- 172.21.15.73:0/2091658632 >> 172.21.15.73:0/2091658632 conn(0x7f78640a8130 msgr2=0x7f7864149ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:47:22.244 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:22.242+0000 7f786c09b640 1 -- 172.21.15.73:0/2091658632 shutdown_connections 2023-12-12T09:47:22.244 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:22.242+0000 7f786c09b640 1 -- 172.21.15.73:0/2091658632 wait complete. 2023-12-12T09:47:22.264 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-12T09:43:15.525508+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 14, 'pool_name': 'cephfs2_metadata', 'create_time': '2023-12-12T09:46:40.116878+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '78', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs2'}}, 'read_balance': {'score_acting': 2.5, 'score_stable': 2.5, 'optimal_score': 1, 'raw_score_acting': 2.5, 'raw_score_stable': 2.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 15, 'pool_name': 'cephfs2_data', 'create_time': '2023-12-12T09:46:40.798840+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '79', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs2'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-12T09:47:22.264 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-12T09:47:22.478 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:22.477+0000 7fba9704f640 1 Processor -- start 2023-12-12T09:47:22.479 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:22.477+0000 7fba9704f640 1 -- start start 2023-12-12T09:47:22.480 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:22.478+0000 7fba9704f640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fba9014ea60 0x7fba900c5420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:22.480 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:22.478+0000 7fba9704f640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fba900a4c90 0x7fba900c0320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:22.480 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:22.478+0000 7fba9704f640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fba900c4420 0x7fba900c20b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:22.480 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:22.478+0000 7fba9704f640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba900c3390 con 0x7fba900c4420 2023-12-12T09:47:22.480 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:22.478+0000 7fba9704f640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba90151e60 con 0x7fba9014ea60 2023-12-12T09:47:22.480 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:22.478+0000 7fba9704f640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba90152140 con 0x7fba900a4c90 2023-12-12T09:47:22.480 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:22.479+0000 7fba955ec640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fba900c4420 0x7fba900c20b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:22.480 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:22.479+0000 7fba955ec640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fba900c4420 0x7fba900c20b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:42698/0 (socket says 172.21.15.73:42698) 2023-12-12T09:47:22.481 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:22.479+0000 7fba955ec640 1 -- 172.21.15.73:0/1956234315 learned_addr learned my addr 172.21.15.73:0/1956234315 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:47:22.481 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:22.479+0000 7fba94deb640 1 --2- 172.21.15.73:0/1956234315 >> v2:172.21.15.142:3300/0 conn(0x7fba9014ea60 0x7fba900c5420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:22.482 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:22.479+0000 7fba955ec640 1 -- 172.21.15.73:0/1956234315 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fba900a4c90 msgr2=0x7fba900c0320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:47:22.482 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:22.479+0000 7fba8ffff640 1 --2- 172.21.15.73:0/1956234315 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fba900a4c90 0x7fba900c0320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:22.482 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:22.479+0000 7fba955ec640 1 --2- 172.21.15.73:0/1956234315 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fba900a4c90 0x7fba900c0320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:22.482 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:22.479+0000 7fba955ec640 1 -- 172.21.15.73:0/1956234315 >> v2:172.21.15.142:3300/0 conn(0x7fba9014ea60 msgr2=0x7fba900c5420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:47:22.482 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:22.479+0000 7fba955ec640 1 --2- 172.21.15.73:0/1956234315 >> v2:172.21.15.142:3300/0 conn(0x7fba9014ea60 0x7fba900c5420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:22.482 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:22.479+0000 7fba955ec640 1 -- 172.21.15.73:0/1956234315 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba900c3940 con 0x7fba900c4420 2023-12-12T09:47:22.482 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:22.479+0000 7fba94deb640 1 --2- 172.21.15.73:0/1956234315 >> v2:172.21.15.142:3300/0 conn(0x7fba9014ea60 0x7fba900c5420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:47:22.482 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:22.480+0000 7fba955ec640 1 --2- 172.21.15.73:0/1956234315 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fba900c4420 0x7fba900c20b0 secure :-1 s=READY pgs=1100 cs=0 l=1 rev1=1 crypto rx=0x7fba9006b490 tx=0x7fba8802e050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a22ea648c0ae3aa server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:47:22.483 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:22.481+0000 7fba8f7fe640 1 -- 172.21.15.73:0/1956234315 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba8802ebf0 con 0x7fba900c4420 2023-12-12T09:47:22.483 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:22.481+0000 7fba8f7fe640 1 -- 172.21.15.73:0/1956234315 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba8802ed50 con 0x7fba900c4420 2023-12-12T09:47:22.483 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:22.481+0000 7fba8f7fe640 1 -- 172.21.15.73:0/1956234315 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba88036610 con 0x7fba900c4420 2023-12-12T09:47:22.483 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:22.481+0000 7fba9704f640 1 -- 172.21.15.73:0/1956234315 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fba900c4420 msgr2=0x7fba900c20b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:22.483 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:22.481+0000 7fba9704f640 1 --2- 172.21.15.73:0/1956234315 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fba900c4420 0x7fba900c20b0 secure :-1 s=READY pgs=1100 cs=0 l=1 rev1=1 crypto rx=0x7fba9006b490 tx=0x7fba8802e050 comp rx=0 tx=0).stop 2023-12-12T09:47:22.483 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:22.481+0000 7fba9704f640 1 -- 172.21.15.73:0/1956234315 shutdown_connections 2023-12-12T09:47:22.484 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:22.481+0000 7fba9704f640 1 --2- 172.21.15.73:0/1956234315 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fba900c4420 0x7fba900c20b0 unknown :-1 s=CLOSED pgs=1100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:22.484 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:22.481+0000 7fba9704f640 1 --2- 172.21.15.73:0/1956234315 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fba900a4c90 0x7fba900c0320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:22.484 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:22.481+0000 7fba9704f640 1 --2- 172.21.15.73:0/1956234315 >> v2:172.21.15.142:3300/0 conn(0x7fba9014ea60 0x7fba900c5420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:22.484 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:22.481+0000 7fba9704f640 1 -- 172.21.15.73:0/1956234315 >> 172.21.15.73:0/1956234315 conn(0x7fba9006a4e0 msgr2=0x7fba9006a8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:47:22.484 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:22.481+0000 7fba9704f640 1 -- 172.21.15.73:0/1956234315 shutdown_connections 2023-12-12T09:47:22.484 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:22.481+0000 7fba9704f640 1 -- 172.21.15.73:0/1956234315 wait complete. 2023-12-12T09:47:22.484 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:22.483+0000 7fba9704f640 1 Processor -- start 2023-12-12T09:47:22.484 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:22.483+0000 7fba9704f640 1 -- start start 2023-12-12T09:47:22.487 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:22.484+0000 7fba9704f640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fba900a4c90 0x7fba90151320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:22.487 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:22.484+0000 7fba9704f640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fba900c4420 0x7fba900bf400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:22.487 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:22.484+0000 7fba9704f640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fba9014ea60 0x7fba9014b1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:22.487 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:22.484+0000 7fba9704f640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba900aa080 con 0x7fba900a4c90 2023-12-12T09:47:22.487 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:22.484+0000 7fba9704f640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba900ab0a0 con 0x7fba900c4420 2023-12-12T09:47:22.487 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:22.484+0000 7fba9704f640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba900ab450 con 0x7fba9014ea60 2023-12-12T09:47:22.487 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:22.484+0000 7fba94deb640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fba900a4c90 0x7fba90151320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:22.487 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:22.484+0000 7fba94deb640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fba900a4c90 0x7fba90151320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:42714/0 (socket says 172.21.15.73:42714) 2023-12-12T09:47:22.487 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:22.484+0000 7fba94deb640 1 -- 172.21.15.73:0/2831461279 learned_addr learned my addr 172.21.15.73:0/2831461279 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:47:22.487 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:22.485+0000 7fba8ffff640 1 --2- 172.21.15.73:0/2831461279 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fba900c4420 0x7fba900bf400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:22.487 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:22.485+0000 7fba94deb640 1 -- 172.21.15.73:0/2831461279 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fba9014ea60 msgr2=0x7fba9014b1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:22.488 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:22.485+0000 7fba94deb640 1 --2- 172.21.15.73:0/2831461279 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fba9014ea60 0x7fba9014b1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:22.488 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:22.485+0000 7fba94deb640 1 -- 172.21.15.73:0/2831461279 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fba900c4420 msgr2=0x7fba900bf400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:22.488 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:22.485+0000 7fba94deb640 1 --2- 172.21.15.73:0/2831461279 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fba900c4420 0x7fba900bf400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:22.488 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:22.485+0000 7fba94deb640 1 -- 172.21.15.73:0/2831461279 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba88009b30 con 0x7fba900a4c90 2023-12-12T09:47:22.488 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:22.485+0000 7fba94deb640 1 --2- 172.21.15.73:0/2831461279 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fba900a4c90 0x7fba90151320 secure :-1 s=READY pgs=1101 cs=0 l=1 rev1=1 crypto rx=0x7fba8400c820 tx=0x7fba8400cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:47:22.488 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:22.485+0000 7fba8d7fa640 1 -- 172.21.15.73:0/2831461279 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba84007a30 con 0x7fba900a4c90 2023-12-12T09:47:22.488 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:22.485+0000 7fba8d7fa640 1 -- 172.21.15.73:0/2831461279 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba84007b90 con 0x7fba900a4c90 2023-12-12T09:47:22.488 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:22.485+0000 7fba9704f640 1 -- 172.21.15.73:0/2831461279 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba90150300 con 0x7fba900a4c90 2023-12-12T09:47:22.488 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:22.485+0000 7fba8d7fa640 1 -- 172.21.15.73:0/2831461279 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba8400ce10 con 0x7fba900a4c90 2023-12-12T09:47:22.488 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:22.485+0000 7fba9704f640 1 -- 172.21.15.73:0/2831461279 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba900ab730 con 0x7fba900a4c90 2023-12-12T09:47:22.489 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:22.487+0000 7fba9704f640 1 -- 172.21.15.73:0/2831461279 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba90067070 con 0x7fba900a4c90 2023-12-12T09:47:22.489 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:22.487+0000 7fba8d7fa640 1 -- 172.21.15.73:0/2831461279 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fba840113f0 con 0x7fba900a4c90 2023-12-12T09:47:22.490 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:22.488+0000 7fba8d7fa640 1 --2- 172.21.15.73:0/2831461279 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fba7406ae70 0x7fba7406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:22.490 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:22.488+0000 7fba8d7fa640 1 -- 172.21.15.73:0/2831461279 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 5799+0+0 (secure 0 0 0) 0x7fba840895c0 con 0x7fba900a4c90 2023-12-12T09:47:22.490 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:22.489+0000 7fba8ffff640 1 --2- 172.21.15.73:0/2831461279 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fba7406ae70 0x7fba7406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:22.490 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:22.489+0000 7fba8ffff640 1 --2- 172.21.15.73:0/2831461279 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fba7406ae70 0x7fba7406d330 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7fba7c006fd0 tx=0x7fba7c008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:47:22.494 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:22.493+0000 7fba8d7fa640 1 -- 172.21.15.73:0/2831461279 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fba840546a0 con 0x7fba900a4c90 2023-12-12T09:47:22.694 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:22.692+0000 7fba9704f640 1 -- 172.21.15.73:0/2831461279 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fba90067580 con 0x7fba900a4c90 2023-12-12T09:47:22.695 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:22.693+0000 7fba8d7fa640 1 -- 172.21.15.73:0/2831461279 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v84) v1 ==== 93+0+10 (secure 0 0 0) 0x7fba84057cc0 con 0x7fba900a4c90 2023-12-12T09:47:22.695 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 1 2023-12-12T09:47:22.698 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:22.696+0000 7fba9704f640 1 -- 172.21.15.73:0/2831461279 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fba7406ae70 msgr2=0x7fba7406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:22.698 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:22.696+0000 7fba9704f640 1 --2- 172.21.15.73:0/2831461279 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fba7406ae70 0x7fba7406d330 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7fba7c006fd0 tx=0x7fba7c008040 comp rx=0 tx=0).stop 2023-12-12T09:47:22.698 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:22.696+0000 7fba9704f640 1 -- 172.21.15.73:0/2831461279 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fba900a4c90 msgr2=0x7fba90151320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:22.698 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:22.696+0000 7fba9704f640 1 --2- 172.21.15.73:0/2831461279 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fba900a4c90 0x7fba90151320 secure :-1 s=READY pgs=1101 cs=0 l=1 rev1=1 crypto rx=0x7fba8400c820 tx=0x7fba8400cce0 comp rx=0 tx=0).stop 2023-12-12T09:47:22.698 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:22.696+0000 7fba9704f640 1 -- 172.21.15.73:0/2831461279 shutdown_connections 2023-12-12T09:47:22.698 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:22.696+0000 7fba9704f640 1 --2- 172.21.15.73:0/2831461279 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fba7406ae70 0x7fba7406d330 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:22.698 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:22.696+0000 7fba9704f640 1 --2- 172.21.15.73:0/2831461279 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fba9014ea60 0x7fba9014b1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:22.698 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:22.696+0000 7fba9704f640 1 --2- 172.21.15.73:0/2831461279 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fba900c4420 0x7fba900bf400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:22.698 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:22.696+0000 7fba9704f640 1 --2- 172.21.15.73:0/2831461279 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fba900a4c90 0x7fba90151320 unknown :-1 s=CLOSED pgs=1101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:22.698 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:22.696+0000 7fba9704f640 1 -- 172.21.15.73:0/2831461279 >> 172.21.15.73:0/2831461279 conn(0x7fba9006a4e0 msgr2=0x7fba9006a8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:47:22.698 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:22.696+0000 7fba9704f640 1 -- 172.21.15.73:0/2831461279 shutdown_connections 2023-12-12T09:47:22.698 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:22.696+0000 7fba9704f640 1 -- 172.21.15.73:0/2831461279 wait complete. 2023-12-12T09:47:22.717 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_metadata pg_num 2023-12-12T09:47:22.916 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:22.914+0000 7f28048bb640 1 Processor -- start 2023-12-12T09:47:22.916 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:22.914+0000 7f28048bb640 1 -- start start 2023-12-12T09:47:22.917 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:22.916+0000 7f28048bb640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f28000c0320 0x7f280006cc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:22.917 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:22.916+0000 7f28048bb640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f28000c2790 0x7f28000c50d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:22.917 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:22.916+0000 7f28048bb640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28000c1520 con 0x7f28000c23b0 2023-12-12T09:47:22.917 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:22.916+0000 7f28048bb640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28000c46f0 con 0x7f28000c0320 2023-12-12T09:47:22.918 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:22.916+0000 7f28048bb640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28000c2c20 con 0x7f28000c2790 2023-12-12T09:47:22.918 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:22.916+0000 7f27f7fff640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f28000c0320 0x7f280006cc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:22.919 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:22.916+0000 7f27fe59c640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f28000c23b0 0x7f2800159410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:48634/0 (socket says 172.21.15.73:48634) 2023-12-12T09:47:22.919 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:22.916+0000 7f27fe59c640 1 -- 172.21.15.73:0/493534356 learned_addr learned my addr 172.21.15.73:0/493534356 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-12T09:47:22.919 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:22.917+0000 7f27fed9d640 1 --2- 172.21.15.73:0/493534356 >> v2:172.21.15.142:3300/0 conn(0x7f28000c2790 0x7f28000c50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:22.919 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:22.917+0000 7f27f7fff640 1 -- 172.21.15.73:0/493534356 >> v2:172.21.15.142:3300/0 conn(0x7f28000c2790 msgr2=0x7f28000c50d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:47:22.919 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:22.917+0000 7f27f7fff640 1 --2- 172.21.15.73:0/493534356 >> v2:172.21.15.142:3300/0 conn(0x7f28000c2790 0x7f28000c50d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:22.919 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:22.917+0000 7f27f7fff640 1 -- 172.21.15.73:0/493534356 >> v1:172.21.15.73:6789/0 conn(0x7f28000c23b0 legacy=0x7f2800159410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:22.919 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:22.917+0000 7f27fdd9b640 1 -- 172.21.15.73:0/493534356 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3276109534 0 0) 0x7f27f0001110 con 0x7f28000c23b0 2023-12-12T09:47:22.919 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:22.917+0000 7f27f7fff640 1 -- 172.21.15.73:0/493534356 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28000c0920 con 0x7f28000c0320 2023-12-12T09:47:22.920 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:22.918+0000 7f27f7fff640 1 --2- 172.21.15.73:0/493534356 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f28000c0320 0x7f280006cc90 secure :-1 s=READY pgs=1103 cs=0 l=1 rev1=1 crypto rx=0x7f280006fbe0 tx=0x7f27e802b7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25a15218eda53020 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:47:22.920 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:22.918+0000 7f27fdd9b640 1 -- 172.21.15.73:0/493534356 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27e8031710 con 0x7f28000c0320 2023-12-12T09:47:22.920 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:22.918+0000 7f27fdd9b640 1 -- 172.21.15.73:0/493534356 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27e802f050 con 0x7f28000c0320 2023-12-12T09:47:22.920 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:22.918+0000 7f27fdd9b640 1 -- 172.21.15.73:0/493534356 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27e8031a90 con 0x7f28000c0320 2023-12-12T09:47:22.921 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:22.919+0000 7f28048bb640 1 -- 172.21.15.73:0/493534356 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f28000c0320 msgr2=0x7f280006cc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:22.921 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:22.919+0000 7f28048bb640 1 --2- 172.21.15.73:0/493534356 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f28000c0320 0x7f280006cc90 secure :-1 s=READY pgs=1103 cs=0 l=1 rev1=1 crypto rx=0x7f280006fbe0 tx=0x7f27e802b7b0 comp rx=0 tx=0).stop 2023-12-12T09:47:22.921 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:22.919+0000 7f28048bb640 1 -- 172.21.15.73:0/493534356 shutdown_connections 2023-12-12T09:47:22.921 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:22.919+0000 7f28048bb640 1 --2- 172.21.15.73:0/493534356 >> v2:172.21.15.142:3300/0 conn(0x7f28000c2790 0x7f28000c50d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:22.921 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:22.919+0000 7f28048bb640 1 --2- 172.21.15.73:0/493534356 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f28000c0320 0x7f280006cc90 unknown :-1 s=CLOSED pgs=1103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:22.921 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:22.919+0000 7f28048bb640 1 -- 172.21.15.73:0/493534356 >> 172.21.15.73:0/493534356 conn(0x7f280006a4e0 msgr2=0x7f280006a8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:47:22.921 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:22.919+0000 7f28048bb640 1 -- 172.21.15.73:0/493534356 shutdown_connections 2023-12-12T09:47:22.921 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:22.919+0000 7f28048bb640 1 -- 172.21.15.73:0/493534356 wait complete. 2023-12-12T09:47:22.922 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:22.921+0000 7f28048bb640 1 Processor -- start 2023-12-12T09:47:22.922 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:22.921+0000 7f28048bb640 1 -- start start 2023-12-12T09:47:22.924 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:22.922+0000 7f28048bb640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f28000c0320 0x7f28001ee480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:22.924 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:22.922+0000 7f28048bb640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f28000c23b0 0x7f2800158af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:22.924 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:22.922+0000 7f28048bb640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f28000c2790 0x7f28001f2290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:22.924 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:22.922+0000 7f28048bb640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28000abcc0 con 0x7f28000c23b0 2023-12-12T09:47:22.925 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:22.922+0000 7f28048bb640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f280015bdc0 con 0x7f28000c0320 2023-12-12T09:47:22.925 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:22.922+0000 7f28048bb640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28001ee9c0 con 0x7f28000c2790 2023-12-12T09:47:22.925 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:22.922+0000 7f27f7fff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f28000c23b0 0x7f2800158af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:22.925 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:22.922+0000 7f27f7fff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f28000c23b0 0x7f2800158af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:42726/0 (socket says 172.21.15.73:42726) 2023-12-12T09:47:22.925 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:22.922+0000 7f27f7fff640 1 -- 172.21.15.73:0/3368301444 learned_addr learned my addr 172.21.15.73:0/3368301444 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:47:22.925 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:22.922+0000 7f27fed9d640 1 --2- 172.21.15.73:0/3368301444 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f28000c2790 0x7f28001f2290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:22.925 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:22.923+0000 7f27fe59c640 1 --2- 172.21.15.73:0/3368301444 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f28000c0320 0x7f28001ee480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:22.925 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:22.923+0000 7f27f7fff640 1 -- 172.21.15.73:0/3368301444 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f28000c2790 msgr2=0x7f28001f2290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:22.925 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:22.923+0000 7f27f7fff640 1 --2- 172.21.15.73:0/3368301444 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f28000c2790 0x7f28001f2290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:22.925 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:22.923+0000 7f27f7fff640 1 -- 172.21.15.73:0/3368301444 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f28000c0320 msgr2=0x7f28001ee480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:22.925 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:22.923+0000 7f27f7fff640 1 --2- 172.21.15.73:0/3368301444 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f28000c0320 0x7f28001ee480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:22.925 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:22.923+0000 7f27f7fff640 1 -- 172.21.15.73:0/3368301444 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27e8009400 con 0x7f28000c23b0 2023-12-12T09:47:22.925 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:22.923+0000 7f27f7fff640 1 --2- 172.21.15.73:0/3368301444 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f28000c23b0 0x7f2800158af0 secure :-1 s=READY pgs=1104 cs=0 l=1 rev1=1 crypto rx=0x7f27e8009890 tx=0x7f27e80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:47:22.926 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:22.923+0000 7f27f6ffd640 1 -- 172.21.15.73:0/3368301444 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27e803c8d0 con 0x7f28000c23b0 2023-12-12T09:47:22.926 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:22.923+0000 7f27f6ffd640 1 -- 172.21.15.73:0/3368301444 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27e803ca30 con 0x7f28000c23b0 2023-12-12T09:47:22.926 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:22.923+0000 7f27f6ffd640 1 -- 172.21.15.73:0/3368301444 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27e803cde0 con 0x7f28000c23b0 2023-12-12T09:47:22.926 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:22.923+0000 7f28048bb640 1 -- 172.21.15.73:0/3368301444 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28000bfd30 con 0x7f28000c23b0 2023-12-12T09:47:22.927 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:22.923+0000 7f28048bb640 1 -- 172.21.15.73:0/3368301444 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28001e4ae0 con 0x7f28000c23b0 2023-12-12T09:47:22.927 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:22.925+0000 7f28048bb640 1 -- 172.21.15.73:0/3368301444 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2800067070 con 0x7f28000c23b0 2023-12-12T09:47:22.927 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:22.925+0000 7f27f6ffd640 1 -- 172.21.15.73:0/3368301444 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f27e803a040 con 0x7f28000c23b0 2023-12-12T09:47:22.928 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:22.926+0000 7f27f6ffd640 1 --2- 172.21.15.73:0/3368301444 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f27e006ae40 0x7f27e006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:22.928 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:22.926+0000 7f27f6ffd640 1 -- 172.21.15.73:0/3368301444 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 5799+0+0 (secure 0 0 0) 0x7f27e80aabe0 con 0x7f28000c23b0 2023-12-12T09:47:22.928 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:22.927+0000 7f27fe59c640 1 --2- 172.21.15.73:0/3368301444 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f27e006ae40 0x7f27e006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:22.929 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:22.927+0000 7f27fe59c640 1 --2- 172.21.15.73:0/3368301444 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f27e006ae40 0x7f27e006d300 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f27f0000f60 tx=0x7f27f0009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:47:22.932 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:22.931+0000 7f27f6ffd640 1 -- 172.21.15.73:0/3368301444 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f27e8075c30 con 0x7f28000c23b0 2023-12-12T09:47:23.125 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:23.124+0000 7f28048bb640 1 -- 172.21.15.73:0/3368301444 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"} v 0) v1 -- 0x7f2800067580 con 0x7f28000c23b0 2023-12-12T09:47:23.126 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:23.124+0000 7f27f6ffd640 1 -- 172.21.15.73:0/3368301444 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"}]=0 v84) v1 ==== 105+0+11 (secure 0 0 0) 0x7f27e8079250 con 0x7f28000c23b0 2023-12-12T09:47:23.126 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 32 2023-12-12T09:47:23.129 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:23.127+0000 7f28048bb640 1 -- 172.21.15.73:0/3368301444 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f27e006ae40 msgr2=0x7f27e006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:23.130 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:23.127+0000 7f28048bb640 1 --2- 172.21.15.73:0/3368301444 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f27e006ae40 0x7f27e006d300 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f27f0000f60 tx=0x7f27f0009040 comp rx=0 tx=0).stop 2023-12-12T09:47:23.130 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:23.127+0000 7f28048bb640 1 -- 172.21.15.73:0/3368301444 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f28000c23b0 msgr2=0x7f2800158af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:23.130 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:23.127+0000 7f28048bb640 1 --2- 172.21.15.73:0/3368301444 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f28000c23b0 0x7f2800158af0 secure :-1 s=READY pgs=1104 cs=0 l=1 rev1=1 crypto rx=0x7f27e8009890 tx=0x7f27e80046c0 comp rx=0 tx=0).stop 2023-12-12T09:47:23.130 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:23.128+0000 7f28048bb640 1 -- 172.21.15.73:0/3368301444 shutdown_connections 2023-12-12T09:47:23.130 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:23.128+0000 7f28048bb640 1 --2- 172.21.15.73:0/3368301444 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f27e006ae40 0x7f27e006d300 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:23.130 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:23.128+0000 7f28048bb640 1 --2- 172.21.15.73:0/3368301444 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f28000c2790 0x7f28001f2290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:23.130 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:23.128+0000 7f28048bb640 1 --2- 172.21.15.73:0/3368301444 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f28000c23b0 0x7f2800158af0 unknown :-1 s=CLOSED pgs=1104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:23.130 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:23.128+0000 7f28048bb640 1 --2- 172.21.15.73:0/3368301444 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f28000c0320 0x7f28001ee480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:23.130 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:23.128+0000 7f28048bb640 1 -- 172.21.15.73:0/3368301444 >> 172.21.15.73:0/3368301444 conn(0x7f280006a4e0 msgr2=0x7f28000717e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:47:23.130 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:23.128+0000 7f28048bb640 1 -- 172.21.15.73:0/3368301444 shutdown_connections 2023-12-12T09:47:23.130 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:23.128+0000 7f28048bb640 1 -- 172.21.15.73:0/3368301444 wait complete. 2023-12-12T09:47:23.147 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_data pg_num 2023-12-12T09:47:23.366 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:23.364+0000 7f40db37c640 1 Processor -- start 2023-12-12T09:47:23.366 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:23.364+0000 7f40db37c640 1 -- start start 2023-12-12T09:47:23.367 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:23.366+0000 7f40db37c640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f40d40a4f00 0x7f40d40c38b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:23.367 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:23.366+0000 7f40db37c640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f40d40c3df0 0x7f40d415cbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:23.367 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:23.366+0000 7f40db37c640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40d406bf90 con 0x7f40d406b820 2023-12-12T09:47:23.367 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:23.366+0000 7f40db37c640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40d406bcb0 con 0x7f40d40a4f00 2023-12-12T09:47:23.367 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:23.366+0000 7f40db37c640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40d41523e0 con 0x7f40d40c3df0 2023-12-12T09:47:23.368 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:23.366+0000 7f40d9118640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f40d40a4f00 0x7f40d40c38b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:23.368 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:23.366+0000 7f40d9919640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f40d40c3df0 0x7f40d415cbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:23.368 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:23.366+0000 7f40d9118640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f40d40a4f00 0x7f40d40c38b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.73:51800/0 (socket says 172.21.15.73:51800) 2023-12-12T09:47:23.368 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:23.366+0000 7f40d9118640 1 -- 172.21.15.73:0/2229169352 learned_addr learned my addr 172.21.15.73:0/2229169352 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:47:23.369 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:23.367+0000 7f40d9919640 1 -- 172.21.15.73:0/2229169352 >> v2:172.21.15.142:3300/0 conn(0x7f40d40a4f00 msgr2=0x7f40d40c38b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:47:23.369 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:23.367+0000 7f40d9919640 1 --2- 172.21.15.73:0/2229169352 >> v2:172.21.15.142:3300/0 conn(0x7f40d40a4f00 0x7f40d40c38b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:23.369 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:23.367+0000 7f40d9919640 1 -- 172.21.15.73:0/2229169352 >> v1:172.21.15.142:6789/0 conn(0x7f40d406b820 legacy=0x7f40d414be60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:23.369 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:23.367+0000 7f40d9919640 1 -- 172.21.15.73:0/2229169352 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40d41526c0 con 0x7f40d40c3df0 2023-12-12T09:47:23.370 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:23.369+0000 7f40d9919640 1 --2- 172.21.15.73:0/2229169352 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f40d40c3df0 0x7f40d415cbc0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f40cc0097a0 tx=0x7f40cc02b840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=68d1b8b09e236848 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:47:23.370 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:23.369+0000 7f40cbfff640 1 -- 172.21.15.73:0/2229169352 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40cc02e070 con 0x7f40d40c3df0 2023-12-12T09:47:23.370 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:23.369+0000 7f40cbfff640 1 -- 172.21.15.73:0/2229169352 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40cc0315a0 con 0x7f40d40c3df0 2023-12-12T09:47:23.371 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:23.369+0000 7f40cbfff640 1 -- 172.21.15.73:0/2229169352 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40cc031930 con 0x7f40d40c3df0 2023-12-12T09:47:23.371 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:23.370+0000 7f40db37c640 1 -- 172.21.15.73:0/2229169352 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f40d40c3df0 msgr2=0x7f40d415cbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:23.372 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:23.370+0000 7f40db37c640 1 --2- 172.21.15.73:0/2229169352 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f40d40c3df0 0x7f40d415cbc0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f40cc0097a0 tx=0x7f40cc02b840 comp rx=0 tx=0).stop 2023-12-12T09:47:23.372 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:23.370+0000 7f40db37c640 1 -- 172.21.15.73:0/2229169352 shutdown_connections 2023-12-12T09:47:23.372 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:23.370+0000 7f40db37c640 1 --2- 172.21.15.73:0/2229169352 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f40d40c3df0 0x7f40d415cbc0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:23.372 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:23.370+0000 7f40db37c640 1 --2- 172.21.15.73:0/2229169352 >> v2:172.21.15.142:3300/0 conn(0x7f40d40a4f00 0x7f40d40c38b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:23.372 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:23.370+0000 7f40db37c640 1 -- 172.21.15.73:0/2229169352 >> 172.21.15.73:0/2229169352 conn(0x7f40d406a6c0 msgr2=0x7f40d406aaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:47:23.372 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:23.370+0000 7f40db37c640 1 -- 172.21.15.73:0/2229169352 shutdown_connections 2023-12-12T09:47:23.372 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:23.370+0000 7f40db37c640 1 -- 172.21.15.73:0/2229169352 wait complete. 2023-12-12T09:47:23.373 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:23.372+0000 7f40db37c640 1 Processor -- start 2023-12-12T09:47:23.373 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:23.372+0000 7f40db37c640 1 -- start start 2023-12-12T09:47:23.379 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:23.373+0000 7f40db37c640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f40d40a4f00 0x7f40d41e8960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:23.379 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:23.373+0000 7f40db37c640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f40d40c3df0 0x7f40d4155930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:23.379 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:23.373+0000 7f40db37c640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f40d41eacd0 0x7f40d41eb160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:23.379 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:23.373+0000 7f40db37c640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40d41e8ea0 con 0x7f40d40c3df0 2023-12-12T09:47:23.379 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:23.373+0000 7f40db37c640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40d41554a0 con 0x7f40d40a4f00 2023-12-12T09:47:23.379 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:23.373+0000 7f40db37c640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40d41dbad0 con 0x7f40d41eacd0 2023-12-12T09:47:23.379 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:23.374+0000 7f40d8917640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f40d40c3df0 0x7f40d4155930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:23.379 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:23.374+0000 7f40d8917640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f40d40c3df0 0x7f40d4155930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:42736/0 (socket says 172.21.15.73:42736) 2023-12-12T09:47:23.379 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:23.374+0000 7f40d8917640 1 -- 172.21.15.73:0/2560470520 learned_addr learned my addr 172.21.15.73:0/2560470520 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:47:23.379 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:23.374+0000 7f40d9118640 1 --2- 172.21.15.73:0/2560470520 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f40d40a4f00 0x7f40d41e8960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:23.379 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:23.374+0000 7f40d9919640 1 --2- 172.21.15.73:0/2560470520 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f40d41eacd0 0x7f40d41eb160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:23.380 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:23.374+0000 7f40d8917640 1 -- 172.21.15.73:0/2560470520 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f40d41eacd0 msgr2=0x7f40d41eb160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:23.380 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:23.374+0000 7f40d8917640 1 --2- 172.21.15.73:0/2560470520 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f40d41eacd0 0x7f40d41eb160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:23.380 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:23.374+0000 7f40d8917640 1 -- 172.21.15.73:0/2560470520 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f40d40a4f00 msgr2=0x7f40d41e8960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:23.380 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:23.374+0000 7f40d8917640 1 --2- 172.21.15.73:0/2560470520 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f40d40a4f00 0x7f40d41e8960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:23.380 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:23.374+0000 7f40d8917640 1 -- 172.21.15.73:0/2560470520 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40cc009400 con 0x7f40d40c3df0 2023-12-12T09:47:23.380 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:23.374+0000 7f40d8917640 1 --2- 172.21.15.73:0/2560470520 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f40d40c3df0 0x7f40d4155930 secure :-1 s=READY pgs=1105 cs=0 l=1 rev1=1 crypto rx=0x7f40c400c3a0 tx=0x7f40c400c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:47:23.380 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:23.375+0000 7f40c9ffb640 1 -- 172.21.15.73:0/2560470520 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40c40052d0 con 0x7f40d40c3df0 2023-12-12T09:47:23.380 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:23.375+0000 7f40c9ffb640 1 -- 172.21.15.73:0/2560470520 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40c4005450 con 0x7f40d40c3df0 2023-12-12T09:47:23.380 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:23.375+0000 7f40c9ffb640 1 -- 172.21.15.73:0/2560470520 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40c4007260 con 0x7f40d40c3df0 2023-12-12T09:47:23.380 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:23.375+0000 7f40db37c640 1 -- 172.21.15.73:0/2560470520 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40d41dbdb0 con 0x7f40d40c3df0 2023-12-12T09:47:23.380 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:23.375+0000 7f40db37c640 1 -- 172.21.15.73:0/2560470520 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40d4155130 con 0x7f40d40c3df0 2023-12-12T09:47:23.380 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:23.376+0000 7f40db37c640 1 -- 172.21.15.73:0/2560470520 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40d41552f0 con 0x7f40d40c3df0 2023-12-12T09:47:23.381 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:23.377+0000 7f40c9ffb640 1 -- 172.21.15.73:0/2560470520 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f40c40073c0 con 0x7f40d40c3df0 2023-12-12T09:47:23.381 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:23.378+0000 7f40c9ffb640 1 --2- 172.21.15.73:0/2560470520 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f40b806ae40 0x7f40b806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:23.381 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:23.378+0000 7f40c9ffb640 1 -- 172.21.15.73:0/2560470520 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 5799+0+0 (secure 0 0 0) 0x7f40c4088ab0 con 0x7f40d40c3df0 2023-12-12T09:47:23.381 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:23.378+0000 7f40d9118640 1 --2- 172.21.15.73:0/2560470520 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f40b806ae40 0x7f40b806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:23.382 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:23.379+0000 7f40d9118640 1 --2- 172.21.15.73:0/2560470520 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f40b806ae40 0x7f40b806d300 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f40d0009d80 tx=0x7f40d000b040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:47:23.383 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:23.382+0000 7f40c9ffb640 1 -- 172.21.15.73:0/2560470520 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f40c4053a70 con 0x7f40d40c3df0 2023-12-12T09:47:23.575 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:23.574+0000 7f40db37c640 1 -- 172.21.15.73:0/2560470520 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"} v 0) v1 -- 0x7f40d4155610 con 0x7f40d40c3df0 2023-12-12T09:47:23.576 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:23.574+0000 7f40c9ffb640 1 -- 172.21.15.73:0/2560470520 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"}]=0 v84) v1 ==== 101+0+11 (secure 0 0 0) 0x7f40c4057090 con 0x7f40d40c3df0 2023-12-12T09:47:23.576 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 64 2023-12-12T09:47:23.579 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:23.577+0000 7f40db37c640 1 -- 172.21.15.73:0/2560470520 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f40b806ae40 msgr2=0x7f40b806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:23.579 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:23.577+0000 7f40db37c640 1 --2- 172.21.15.73:0/2560470520 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f40b806ae40 0x7f40b806d300 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f40d0009d80 tx=0x7f40d000b040 comp rx=0 tx=0).stop 2023-12-12T09:47:23.579 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:23.577+0000 7f40db37c640 1 -- 172.21.15.73:0/2560470520 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f40d40c3df0 msgr2=0x7f40d4155930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:23.579 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:23.577+0000 7f40db37c640 1 --2- 172.21.15.73:0/2560470520 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f40d40c3df0 0x7f40d4155930 secure :-1 s=READY pgs=1105 cs=0 l=1 rev1=1 crypto rx=0x7f40c400c3a0 tx=0x7f40c400c860 comp rx=0 tx=0).stop 2023-12-12T09:47:23.579 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:23.577+0000 7f40db37c640 1 -- 172.21.15.73:0/2560470520 shutdown_connections 2023-12-12T09:47:23.581 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:23.577+0000 7f40db37c640 1 --2- 172.21.15.73:0/2560470520 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f40b806ae40 0x7f40b806d300 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:23.581 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:23.577+0000 7f40db37c640 1 --2- 172.21.15.73:0/2560470520 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f40d41eacd0 0x7f40d41eb160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:23.581 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:23.577+0000 7f40db37c640 1 --2- 172.21.15.73:0/2560470520 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f40d40c3df0 0x7f40d4155930 unknown :-1 s=CLOSED pgs=1105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:23.581 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:23.577+0000 7f40db37c640 1 --2- 172.21.15.73:0/2560470520 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f40d40a4f00 0x7f40d41e8960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:23.581 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:23.577+0000 7f40db37c640 1 -- 172.21.15.73:0/2560470520 >> 172.21.15.73:0/2560470520 conn(0x7f40d406a6c0 msgr2=0x7f40d40a5c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:47:23.581 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:23.577+0000 7f40db37c640 1 -- 172.21.15.73:0/2560470520 shutdown_connections 2023-12-12T09:47:23.582 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:23.577+0000 7f40db37c640 1 -- 172.21.15.73:0/2560470520 wait complete. 2023-12-12T09:47:23.596 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-12T09:47:23.807 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:23.806+0000 7f4a8f22e640 1 Processor -- start 2023-12-12T09:47:23.808 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:23.806+0000 7f4a8f22e640 1 -- start start 2023-12-12T09:47:23.810 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:23.808+0000 7f4a8f22e640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f4a8814e700 0x7f4a88151cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:23.811 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:23.808+0000 7f4a8f22e640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f4a880ab4a0 0x7f4a880a9df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:23.811 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:23.808+0000 7f4a8f22e640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a881521f0 con 0x7f4a880c37b0 2023-12-12T09:47:23.811 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:23.808+0000 7f4a8f22e640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a880ab2d0 con 0x7f4a880ab4a0 2023-12-12T09:47:23.811 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:23.808+0000 7f4a8f22e640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a8806bb10 con 0x7f4a8814e700 2023-12-12T09:47:23.811 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:23.808+0000 7f4a8ea2d640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f4a880ab4a0 0x7f4a880a9df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:23.811 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:23.808+0000 7f4a8ea2d640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f4a880ab4a0 0x7f4a880a9df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:42742/0 (socket says 172.21.15.73:42742) 2023-12-12T09:47:23.811 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:23.808+0000 7f4a8ea2d640 1 -- 172.21.15.73:0/3181402571 learned_addr learned my addr 172.21.15.73:0/3181402571 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:47:23.811 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:23.808+0000 7f4a8e22c640 1 --2- 172.21.15.73:0/3181402571 >> v2:172.21.15.142:3300/0 conn(0x7f4a8814e700 0x7f4a88151cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:23.811 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:23.808+0000 7f4a8ea2d640 1 -- 172.21.15.73:0/3181402571 >> v2:172.21.15.142:3300/0 conn(0x7f4a8814e700 msgr2=0x7f4a88151cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:47:23.811 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:23.808+0000 7f4a8ea2d640 1 --2- 172.21.15.73:0/3181402571 >> v2:172.21.15.142:3300/0 conn(0x7f4a8814e700 0x7f4a88151cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:23.811 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:23.808+0000 7f4a8ea2d640 1 -- 172.21.15.73:0/3181402571 >> v1:172.21.15.142:6789/0 conn(0x7f4a880c37b0 legacy=0x7f4a880c02b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:47:23.811 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:23.808+0000 7f4a8ea2d640 1 -- 172.21.15.73:0/3181402571 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a880aaff0 con 0x7f4a880ab4a0 2023-12-12T09:47:23.812 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:23.808+0000 7f4a8e22c640 1 --2- 172.21.15.73:0/3181402571 >> v2:172.21.15.142:3300/0 conn(0x7f4a8814e700 0x7f4a88151cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:47:23.813 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:23.810+0000 7f4a8ea2d640 1 --2- 172.21.15.73:0/3181402571 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4a880ab4a0 0x7f4a880a9df0 secure :-1 s=READY pgs=1106 cs=0 l=1 rev1=1 crypto rx=0x7f4a880a8630 tx=0x7f4a8002bdc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47b9045068b4932 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:47:23.813 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:23.810+0000 7f4a8d22a640 1 -- 172.21.15.73:0/3181402571 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a8002c960 con 0x7f4a880ab4a0 2023-12-12T09:47:23.813 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:23.810+0000 7f4a8d22a640 1 -- 172.21.15.73:0/3181402571 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a8002cac0 con 0x7f4a880ab4a0 2023-12-12T09:47:23.813 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:23.810+0000 7f4a8d22a640 1 -- 172.21.15.73:0/3181402571 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a8002ce50 con 0x7f4a880ab4a0 2023-12-12T09:47:23.813 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:23.811+0000 7f4a8f22e640 1 -- 172.21.15.73:0/3181402571 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4a880ab4a0 msgr2=0x7f4a880a9df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:23.813 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:23.811+0000 7f4a8f22e640 1 --2- 172.21.15.73:0/3181402571 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4a880ab4a0 0x7f4a880a9df0 secure :-1 s=READY pgs=1106 cs=0 l=1 rev1=1 crypto rx=0x7f4a880a8630 tx=0x7f4a8002bdc0 comp rx=0 tx=0).stop 2023-12-12T09:47:23.813 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:23.811+0000 7f4a8f22e640 1 -- 172.21.15.73:0/3181402571 shutdown_connections 2023-12-12T09:47:23.813 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:23.811+0000 7f4a8f22e640 1 --2- 172.21.15.73:0/3181402571 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4a880ab4a0 0x7f4a880a9df0 unknown :-1 s=CLOSED pgs=1106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:23.813 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:23.811+0000 7f4a8f22e640 1 --2- 172.21.15.73:0/3181402571 >> v2:172.21.15.142:3300/0 conn(0x7f4a8814e700 0x7f4a88151cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:23.813 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:23.811+0000 7f4a8f22e640 1 -- 172.21.15.73:0/3181402571 >> 172.21.15.73:0/3181402571 conn(0x7f4a880c23b0 msgr2=0x7f4a880c2790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:47:23.813 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:23.811+0000 7f4a8f22e640 1 -- 172.21.15.73:0/3181402571 shutdown_connections 2023-12-12T09:47:23.813 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:23.811+0000 7f4a8f22e640 1 -- 172.21.15.73:0/3181402571 wait complete. 2023-12-12T09:47:23.814 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:23.813+0000 7f4a8f22e640 1 Processor -- start 2023-12-12T09:47:23.815 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:23.813+0000 7f4a8f22e640 1 -- start start 2023-12-12T09:47:23.818 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:23.814+0000 7f4a8f22e640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4a880ab4a0 0x7f4a8809b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:23.818 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:23.814+0000 7f4a8f22e640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4a880c37b0 0x7f4a88153dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:23.818 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:23.814+0000 7f4a8f22e640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4a8814e700 0x7f4a881ed180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:23.818 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:23.814+0000 7f4a8f22e640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a88099e10 con 0x7f4a880c37b0 2023-12-12T09:47:23.818 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:23.814+0000 7f4a8f22e640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a88099a70 con 0x7f4a880ab4a0 2023-12-12T09:47:23.818 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:23.814+0000 7f4a8f22e640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a881ea840 con 0x7f4a8814e700 2023-12-12T09:47:23.818 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:23.814+0000 7f4a8da2b640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4a880c37b0 0x7f4a88153dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:23.818 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:23.814+0000 7f4a8da2b640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4a880c37b0 0x7f4a88153dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:42756/0 (socket says 172.21.15.73:42756) 2023-12-12T09:47:23.818 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:23.814+0000 7f4a8da2b640 1 -- 172.21.15.73:0/2392484831 learned_addr learned my addr 172.21.15.73:0/2392484831 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:47:23.819 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:23.815+0000 7f4a8e22c640 1 --2- 172.21.15.73:0/2392484831 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4a880ab4a0 0x7f4a8809b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:23.819 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:23.815+0000 7f4a8da2b640 1 -- 172.21.15.73:0/2392484831 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4a8814e700 msgr2=0x7f4a881ed180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:23.819 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:23.815+0000 7f4a8da2b640 1 --2- 172.21.15.73:0/2392484831 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4a8814e700 0x7f4a881ed180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:23.819 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:23.815+0000 7f4a8da2b640 1 -- 172.21.15.73:0/2392484831 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4a880ab4a0 msgr2=0x7f4a8809b420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:23.819 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:23.815+0000 7f4a8da2b640 1 --2- 172.21.15.73:0/2392484831 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4a880ab4a0 0x7f4a8809b420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:23.819 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:23.815+0000 7f4a8da2b640 1 -- 172.21.15.73:0/2392484831 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a80009b30 con 0x7f4a880c37b0 2023-12-12T09:47:23.819 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:23.815+0000 7f4a8da2b640 1 --2- 172.21.15.73:0/2392484831 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4a880c37b0 0x7f4a88153dd0 secure :-1 s=READY pgs=1107 cs=0 l=1 rev1=1 crypto rx=0x7f4a7800b3c0 tx=0x7f4a7800b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:47:23.819 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:23.815+0000 7f4a7effd640 1 -- 172.21.15.73:0/2392484831 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a78011830 con 0x7f4a880c37b0 2023-12-12T09:47:23.819 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:23.815+0000 7f4a7effd640 1 -- 172.21.15.73:0/2392484831 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a78011990 con 0x7f4a880c37b0 2023-12-12T09:47:23.819 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:23.815+0000 7f4a7effd640 1 -- 172.21.15.73:0/2392484831 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a78011d60 con 0x7f4a880c37b0 2023-12-12T09:47:23.819 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:23.815+0000 7f4a8f22e640 1 -- 172.21.15.73:0/2392484831 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a881eab20 con 0x7f4a880c37b0 2023-12-12T09:47:23.819 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:23.816+0000 7f4a8f22e640 1 -- 172.21.15.73:0/2392484831 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a88072900 con 0x7f4a880c37b0 2023-12-12T09:47:23.820 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:23.817+0000 7f4a8f22e640 1 -- 172.21.15.73:0/2392484831 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a88099f50 con 0x7f4a880c37b0 2023-12-12T09:47:23.820 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:23.818+0000 7f4a7effd640 1 -- 172.21.15.73:0/2392484831 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f4a7801b460 con 0x7f4a880c37b0 2023-12-12T09:47:23.820 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:23.819+0000 7f4a7effd640 1 --2- 172.21.15.73:0/2392484831 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f4a6c06ae40 0x7f4a6c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:23.821 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:23.819+0000 7f4a7effd640 1 -- 172.21.15.73:0/2392484831 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 5799+0+0 (secure 0 0 0) 0x7f4a780893d0 con 0x7f4a880c37b0 2023-12-12T09:47:23.821 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:23.819+0000 7f4a8e22c640 1 --2- 172.21.15.73:0/2392484831 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f4a6c06ae40 0x7f4a6c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:23.821 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:23.820+0000 7f4a8e22c640 1 --2- 172.21.15.73:0/2392484831 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f4a6c06ae40 0x7f4a6c06d300 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f4a84008850 tx=0x7f4a84008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:47:23.824 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:23.823+0000 7f4a7effd640 1 -- 172.21.15.73:0/2392484831 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f4a88099f50 con 0x7f4a880c37b0 2023-12-12T09:47:24.053 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:24.051+0000 7f4a8f22e640 1 -- 172.21.15.73:0/2392484831 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4a88099f50 con 0x7f4a880c37b0 2023-12-12T09:47:24.053 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:24.052+0000 7f4a7effd640 1 -- 172.21.15.73:0/2392484831 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 51 v51) v1 ==== 94+0+4920 (secure 0 0 0) 0x7f4a88099f50 con 0x7f4a880c37b0 2023-12-12T09:47:24.054 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-12T09:47:24.054 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":51,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4943,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6835/3004685650","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6833","nonce":3004685650},{"type":"v1","addr":"172.21.15.142:6835","nonce":3004685650}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40},{"gid":5365,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6834/3290362874","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6832","nonce":3290362874},{"type":"v1","addr":"172.21.15.142:6834","nonce":3290362874}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40},{"gid":7086,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6837/3803137802","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6835","nonce":3803137802},{"type":"v1","addr":"172.21.15.73:6837","nonce":3803137802}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":51}],"filesystems":[{"mdsmap":{"epoch":49,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-12T09:46:41.791760+0000","modified":"2023-12-12T09:46:44.861785+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6426},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6426":{"gid":6426,"name":"a","rank":0,"incarnation":45,"state":"up:active","state_seq":7,"addr":"172.21.15.73:6836/340095591","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":340095591},{"type":"v1","addr":"172.21.15.73:6836","nonce":340095591}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2023-12-12T09:47:24.054 INFO:teuthology.orchestra.run.smithi073.stderr:dumped fsmap epoch 51 2023-12-12T09:47:24.056 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:24.054+0000 7f4a8f22e640 1 -- 172.21.15.73:0/2392484831 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f4a6c06ae40 msgr2=0x7f4a6c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:24.056 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:24.054+0000 7f4a8f22e640 1 --2- 172.21.15.73:0/2392484831 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f4a6c06ae40 0x7f4a6c06d300 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f4a84008850 tx=0x7f4a84008040 comp rx=0 tx=0).stop 2023-12-12T09:47:24.057 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:24.055+0000 7f4a8f22e640 1 -- 172.21.15.73:0/2392484831 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4a880c37b0 msgr2=0x7f4a88153dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:24.057 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:24.055+0000 7f4a8f22e640 1 --2- 172.21.15.73:0/2392484831 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4a880c37b0 0x7f4a88153dd0 secure :-1 s=READY pgs=1107 cs=0 l=1 rev1=1 crypto rx=0x7f4a7800b3c0 tx=0x7f4a7800b880 comp rx=0 tx=0).stop 2023-12-12T09:47:24.057 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:24.055+0000 7f4a8f22e640 1 -- 172.21.15.73:0/2392484831 shutdown_connections 2023-12-12T09:47:24.057 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:24.055+0000 7f4a8f22e640 1 --2- 172.21.15.73:0/2392484831 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f4a6c06ae40 0x7f4a6c06d300 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:24.057 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:24.055+0000 7f4a8f22e640 1 --2- 172.21.15.73:0/2392484831 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4a8814e700 0x7f4a881ed180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:24.057 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:24.055+0000 7f4a8f22e640 1 --2- 172.21.15.73:0/2392484831 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4a880c37b0 0x7f4a88153dd0 unknown :-1 s=CLOSED pgs=1107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:24.057 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:24.055+0000 7f4a8f22e640 1 --2- 172.21.15.73:0/2392484831 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4a880ab4a0 0x7f4a8809b420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:24.057 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:24.055+0000 7f4a8f22e640 1 -- 172.21.15.73:0/2392484831 >> 172.21.15.73:0/2392484831 conn(0x7f4a880c23b0 msgr2=0x7f4a880c2790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:47:24.057 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:24.055+0000 7f4a8f22e640 1 -- 172.21.15.73:0/2392484831 shutdown_connections 2023-12-12T09:47:24.057 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:24.055+0000 7f4a8f22e640 1 -- 172.21.15.73:0/2392484831 wait complete. 2023-12-12T09:47:24.075 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-12T09:47:24.283 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:24.281+0000 7f9df8939640 1 Processor -- start 2023-12-12T09:47:24.283 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:24.281+0000 7f9df8939640 1 -- start start 2023-12-12T09:47:24.284 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:24.282+0000 7f9df8939640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f9df41552e0 0x7f9df40c49c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:24.284 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:24.282+0000 7f9df8939640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9df40a50f0 0x7f9df40a9050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:24.284 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:24.282+0000 7f9df8939640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f9df406bf20 0x7f9df40a9590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:24.284 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:24.282+0000 7f9df8939640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9df40c04d0 con 0x7f9df41552e0 2023-12-12T09:47:24.284 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:24.282+0000 7f9df8939640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9df40c0b50 con 0x7f9df406bf20 2023-12-12T09:47:24.284 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:24.282+0000 7f9df8939640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9df406c880 con 0x7f9df40a50f0 2023-12-12T09:47:24.284 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:24.283+0000 7f9df259c640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f9df41552e0 0x7f9df40c49c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:24.285 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:24.283+0000 7f9df259c640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f9df41552e0 0x7f9df40c49c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:42766/0 (socket says 172.21.15.73:42766) 2023-12-12T09:47:24.285 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:24.283+0000 7f9df259c640 1 -- 172.21.15.73:0/1142281746 learned_addr learned my addr 172.21.15.73:0/1142281746 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:47:24.285 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:24.283+0000 7f9debfff640 1 --2- 172.21.15.73:0/1142281746 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9df40a50f0 0x7f9df40a9050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:24.285 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:24.283+0000 7f9df2d9d640 1 --2- 172.21.15.73:0/1142281746 >> v2:172.21.15.142:3300/0 conn(0x7f9df406bf20 0x7f9df40a9590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:24.286 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:24.283+0000 7f9df259c640 1 -- 172.21.15.73:0/1142281746 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9df40a50f0 msgr2=0x7f9df40a9050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:47:24.286 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:24.283+0000 7f9df259c640 1 --2- 172.21.15.73:0/1142281746 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9df40a50f0 0x7f9df40a9050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:24.286 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:24.283+0000 7f9df259c640 1 -- 172.21.15.73:0/1142281746 >> v2:172.21.15.142:3300/0 conn(0x7f9df406bf20 msgr2=0x7f9df40a9590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:47:24.286 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:24.283+0000 7f9df259c640 1 --2- 172.21.15.73:0/1142281746 >> v2:172.21.15.142:3300/0 conn(0x7f9df406bf20 0x7f9df40a9590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:24.286 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:24.283+0000 7f9df259c640 1 -- 172.21.15.73:0/1142281746 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9df406cb60 con 0x7f9df41552e0 2023-12-12T09:47:24.286 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:24.283+0000 7f9df2d9d640 1 --2- 172.21.15.73:0/1142281746 >> v2:172.21.15.142:3300/0 conn(0x7f9df406bf20 0x7f9df40a9590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:47:24.286 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:24.283+0000 7f9debfff640 1 --2- 172.21.15.73:0/1142281746 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9df40a50f0 0x7f9df40a9050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:47:24.287 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:24.284+0000 7f9df259c640 1 --2- 172.21.15.73:0/1142281746 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9df41552e0 0x7f9df40c49c0 secure :-1 s=READY pgs=1108 cs=0 l=1 rev1=1 crypto rx=0x7f9df40ab100 tx=0x7f9de402b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6470fb9d596bc1a7 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:47:24.287 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:24.285+0000 7f9df1d9b640 1 -- 172.21.15.73:0/1142281746 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9de40317e0 con 0x7f9df41552e0 2023-12-12T09:47:24.287 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:24.285+0000 7f9df1d9b640 1 -- 172.21.15.73:0/1142281746 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9de4031940 con 0x7f9df41552e0 2023-12-12T09:47:24.287 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:24.285+0000 7f9df1d9b640 1 -- 172.21.15.73:0/1142281746 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9de4031cd0 con 0x7f9df41552e0 2023-12-12T09:47:24.288 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:24.285+0000 7f9df8939640 1 -- 172.21.15.73:0/1142281746 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9df41552e0 msgr2=0x7f9df40c49c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:24.288 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:24.285+0000 7f9df8939640 1 --2- 172.21.15.73:0/1142281746 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9df41552e0 0x7f9df40c49c0 secure :-1 s=READY pgs=1108 cs=0 l=1 rev1=1 crypto rx=0x7f9df40ab100 tx=0x7f9de402b880 comp rx=0 tx=0).stop 2023-12-12T09:47:24.288 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:24.286+0000 7f9df8939640 1 -- 172.21.15.73:0/1142281746 shutdown_connections 2023-12-12T09:47:24.288 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:24.286+0000 7f9df8939640 1 --2- 172.21.15.73:0/1142281746 >> v2:172.21.15.142:3300/0 conn(0x7f9df406bf20 0x7f9df40a9590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:24.288 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:24.286+0000 7f9df8939640 1 --2- 172.21.15.73:0/1142281746 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9df40a50f0 0x7f9df40a9050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:24.288 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:24.286+0000 7f9df8939640 1 --2- 172.21.15.73:0/1142281746 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9df41552e0 0x7f9df40c49c0 unknown :-1 s=CLOSED pgs=1108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:24.288 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:24.286+0000 7f9df8939640 1 -- 172.21.15.73:0/1142281746 >> 172.21.15.73:0/1142281746 conn(0x7f9df40a8130 msgr2=0x7f9df40c24b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:47:24.288 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:24.286+0000 7f9df8939640 1 -- 172.21.15.73:0/1142281746 shutdown_connections 2023-12-12T09:47:24.288 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:24.286+0000 7f9df8939640 1 -- 172.21.15.73:0/1142281746 wait complete. 2023-12-12T09:47:24.288 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:24.287+0000 7f9df8939640 1 Processor -- start 2023-12-12T09:47:24.289 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:24.288+0000 7f9df8939640 1 -- start start 2023-12-12T09:47:24.290 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:24.288+0000 7f9df8939640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9df406bf20 0x7f9df41df1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:24.290 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:24.288+0000 7f9df8939640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9df40a50f0 0x7f9df4152d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:24.290 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:24.288+0000 7f9df8939640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9df41552e0 0x7f9df41dbc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:24.290 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:24.288+0000 7f9df8939640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9df41e8cc0 con 0x7f9df41552e0 2023-12-12T09:47:24.290 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:24.288+0000 7f9df8939640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9df40bb720 con 0x7f9df40a50f0 2023-12-12T09:47:24.291 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:24.288+0000 7f9df8939640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9df40bc6f0 con 0x7f9df406bf20 2023-12-12T09:47:24.291 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:24.289+0000 7f9df2d9d640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9df41552e0 0x7f9df41dbc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:24.291 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:24.289+0000 7f9df2d9d640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9df41552e0 0x7f9df41dbc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:42770/0 (socket says 172.21.15.73:42770) 2023-12-12T09:47:24.291 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:24.289+0000 7f9df2d9d640 1 -- 172.21.15.73:0/2507792512 learned_addr learned my addr 172.21.15.73:0/2507792512 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:47:24.292 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:24.289+0000 7f9df259c640 1 --2- 172.21.15.73:0/2507792512 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9df406bf20 0x7f9df41df1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:24.292 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:24.289+0000 7f9debfff640 1 --2- 172.21.15.73:0/2507792512 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9df40a50f0 0x7f9df4152d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:24.292 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:24.289+0000 7f9df2d9d640 1 -- 172.21.15.73:0/2507792512 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9df406bf20 msgr2=0x7f9df41df1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:24.292 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:24.289+0000 7f9df2d9d640 1 --2- 172.21.15.73:0/2507792512 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9df406bf20 0x7f9df41df1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:24.292 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:24.289+0000 7f9df2d9d640 1 -- 172.21.15.73:0/2507792512 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9df40a50f0 msgr2=0x7f9df4152d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:24.292 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:24.289+0000 7f9df2d9d640 1 --2- 172.21.15.73:0/2507792512 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9df40a50f0 0x7f9df4152d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:24.292 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:24.289+0000 7f9df2d9d640 1 -- 172.21.15.73:0/2507792512 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9de40094d0 con 0x7f9df41552e0 2023-12-12T09:47:24.293 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:24.289+0000 7f9debfff640 1 --2- 172.21.15.73:0/2507792512 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9df40a50f0 0x7f9df4152d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:47:24.293 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:24.289+0000 7f9df259c640 1 --2- 172.21.15.73:0/2507792512 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9df406bf20 0x7f9df41df1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:47:24.293 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:24.290+0000 7f9df2d9d640 1 --2- 172.21.15.73:0/2507792512 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9df41552e0 0x7f9df41dbc30 secure :-1 s=READY pgs=1109 cs=0 l=1 rev1=1 crypto rx=0x7f9dec00cef0 tx=0x7f9dec00a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:47:24.293 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:24.290+0000 7f9deaffd640 1 -- 172.21.15.73:0/2507792512 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dec00d840 con 0x7f9df41552e0 2023-12-12T09:47:24.293 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:24.290+0000 7f9deaffd640 1 -- 172.21.15.73:0/2507792512 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9dec00d9a0 con 0x7f9df41552e0 2023-12-12T09:47:24.293 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:24.290+0000 7f9df8939640 1 -- 172.21.15.73:0/2507792512 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9df41e8740 con 0x7f9df41552e0 2023-12-12T09:47:24.293 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:24.290+0000 7f9deaffd640 1 -- 172.21.15.73:0/2507792512 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dec00dd50 con 0x7f9df41552e0 2023-12-12T09:47:24.293 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:24.290+0000 7f9df8939640 1 -- 172.21.15.73:0/2507792512 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9df40bb160 con 0x7f9df41552e0 2023-12-12T09:47:24.293 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:24.291+0000 7f9df8939640 1 -- 172.21.15.73:0/2507792512 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9df40bafc0 con 0x7f9df41552e0 2023-12-12T09:47:24.294 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:24.292+0000 7f9deaffd640 1 -- 172.21.15.73:0/2507792512 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f9dec01e3b0 con 0x7f9df41552e0 2023-12-12T09:47:24.294 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:24.293+0000 7f9deaffd640 1 --2- 172.21.15.73:0/2507792512 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f9dd406ae40 0x7f9dd406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:24.294 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:24.293+0000 7f9deaffd640 1 -- 172.21.15.73:0/2507792512 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 5799+0+0 (secure 0 0 0) 0x7f9dec089fe0 con 0x7f9df41552e0 2023-12-12T09:47:24.294 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:24.293+0000 7f9df259c640 1 --2- 172.21.15.73:0/2507792512 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f9dd406ae40 0x7f9dd406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:24.295 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:24.294+0000 7f9df259c640 1 --2- 172.21.15.73:0/2507792512 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f9dd406ae40 0x7f9dd406d300 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f9de4036000 tx=0x7f9de403d040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:47:24.299 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:24.297+0000 7f9deaffd640 1 -- 172.21.15.73:0/2507792512 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f9df40bafc0 con 0x7f9df41552e0 2023-12-12T09:47:24.493 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:24.492+0000 7f9df8939640 1 -- 172.21.15.73:0/2507792512 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9df406cfd0 con 0x7f9df41552e0 2023-12-12T09:47:24.495 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:24.494+0000 7f9deaffd640 1 -- 172.21.15.73:0/2507792512 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v84) v1 ==== 74+0+16653 (secure 0 0 0) 0x7f9df406cfd0 con 0x7f9df41552e0 2023-12-12T09:47:24.496 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-12T09:47:24.496 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":84,"fsid":"ba240992-02b8-4c7e-92f2-27eb29ac433b","created":"2023-12-12T09:43:02.454719+0000","modified":"2023-12-12T09:47:21.783499+0000","last_up_change":"2023-12-12T09:43:13.913440+0000","last_in_change":"2023-12-12T09:43:05.925348+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-12T09:43:15.525508+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs2_metadata","create_time":"2023-12-12T09:46:40.116878+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs2_data","create_time":"2023-12-12T09:46:40.798840+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"dd9074be-dbe2-4c34-9896-a4223d8d3940","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":4047810203},{"type":"v1","addr":"172.21.15.73:6801","nonce":4047810203}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":4047810203},{"type":"v1","addr":"172.21.15.73:6803","nonce":4047810203}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":4047810203},{"type":"v1","addr":"172.21.15.73:6807","nonce":4047810203}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":4047810203},{"type":"v1","addr":"172.21.15.73:6805","nonce":4047810203}]},"public_addr":"172.21.15.73:6801/4047810203","cluster_addr":"172.21.15.73:6803/4047810203","heartbeat_back_addr":"172.21.15.73:6807/4047810203","heartbeat_front_addr":"172.21.15.73:6805/4047810203","state":["exists","up"]},{"osd":1,"uuid":"c4a05052-96d4-4758-a4e1-1a37f1e07fed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":1356058331},{"type":"v1","addr":"172.21.15.73:6824","nonce":1356058331}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":1356058331},{"type":"v1","addr":"172.21.15.73:6827","nonce":1356058331}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":1356058331},{"type":"v1","addr":"172.21.15.73:6831","nonce":1356058331}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":1356058331},{"type":"v1","addr":"172.21.15.73:6829","nonce":1356058331}]},"public_addr":"172.21.15.73:6824/1356058331","cluster_addr":"172.21.15.73:6827/1356058331","heartbeat_back_addr":"172.21.15.73:6831/1356058331","heartbeat_front_addr":"172.21.15.73:6829/1356058331","state":["exists","up"]},{"osd":2,"uuid":"512bc8ac-72c2-40d4-b3d2-d867a92c5213","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":1228903316},{"type":"v1","addr":"172.21.15.73:6817","nonce":1228903316}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":1228903316},{"type":"v1","addr":"172.21.15.73:6819","nonce":1228903316}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6823","nonce":1228903316},{"type":"v1","addr":"172.21.15.73:6825","nonce":1228903316}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":1228903316},{"type":"v1","addr":"172.21.15.73:6821","nonce":1228903316}]},"public_addr":"172.21.15.73:6817/1228903316","cluster_addr":"172.21.15.73:6819/1228903316","heartbeat_back_addr":"172.21.15.73:6825/1228903316","heartbeat_front_addr":"172.21.15.73:6821/1228903316","state":["exists","up"]},{"osd":3,"uuid":"3d1a91e0-42bf-437a-8eae-8d357c8f63a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":1293329670},{"type":"v1","addr":"172.21.15.73:6809","nonce":1293329670}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6810","nonce":1293329670},{"type":"v1","addr":"172.21.15.73:6811","nonce":1293329670}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":1293329670},{"type":"v1","addr":"172.21.15.73:6815","nonce":1293329670}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":1293329670},{"type":"v1","addr":"172.21.15.73:6813","nonce":1293329670}]},"public_addr":"172.21.15.73:6809/1293329670","cluster_addr":"172.21.15.73:6811/1293329670","heartbeat_back_addr":"172.21.15.73:6815/1293329670","heartbeat_front_addr":"172.21.15.73:6813/1293329670","state":["exists","up"]},{"osd":4,"uuid":"4b302fff-834c-4069-ac19-00e46f6c87b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":3727975702},{"type":"v1","addr":"172.21.15.142:6801","nonce":3727975702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":3727975702},{"type":"v1","addr":"172.21.15.142:6803","nonce":3727975702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6809","nonce":3727975702},{"type":"v1","addr":"172.21.15.142:6811","nonce":3727975702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6805","nonce":3727975702},{"type":"v1","addr":"172.21.15.142:6807","nonce":3727975702}]},"public_addr":"172.21.15.142:6801/3727975702","cluster_addr":"172.21.15.142:6803/3727975702","heartbeat_back_addr":"172.21.15.142:6811/3727975702","heartbeat_front_addr":"172.21.15.142:6807/3727975702","state":["exists","up"]},{"osd":5,"uuid":"d7cdace2-67d0-45cc-95f2-515cf6ef1b82","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6817","nonce":2353193632},{"type":"v1","addr":"172.21.15.142:6819","nonce":2353193632}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6821","nonce":2353193632},{"type":"v1","addr":"172.21.15.142:6823","nonce":2353193632}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6829","nonce":2353193632},{"type":"v1","addr":"172.21.15.142:6831","nonce":2353193632}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6825","nonce":2353193632},{"type":"v1","addr":"172.21.15.142:6827","nonce":2353193632}]},"public_addr":"172.21.15.142:6819/2353193632","cluster_addr":"172.21.15.142:6823/2353193632","heartbeat_back_addr":"172.21.15.142:6831/2353193632","heartbeat_front_addr":"172.21.15.142:6827/2353193632","state":["exists","up"]},{"osd":6,"uuid":"649ce78a-5626-445c-aedc-a651ed05a6f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":2006111986},{"type":"v1","addr":"172.21.15.142:6806","nonce":2006111986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":2006111986},{"type":"v1","addr":"172.21.15.142:6810","nonce":2006111986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":2006111986},{"type":"v1","addr":"172.21.15.142:6815","nonce":2006111986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":2006111986},{"type":"v1","addr":"172.21.15.142:6813","nonce":2006111986}]},"public_addr":"172.21.15.142:6806/2006111986","cluster_addr":"172.21.15.142:6810/2006111986","heartbeat_back_addr":"172.21.15.142:6815/2006111986","heartbeat_front_addr":"172.21.15.142:6813/2006111986","state":["exists","up"]},{"osd":7,"uuid":"af15ae3b-c1d0-4acf-92db-8a1805494d13","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":2573794341},{"type":"v1","addr":"172.21.15.142:6818","nonce":2573794341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":2573794341},{"type":"v1","addr":"172.21.15.142:6822","nonce":2573794341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":2573794341},{"type":"v1","addr":"172.21.15.142:6830","nonce":2573794341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":2573794341},{"type":"v1","addr":"172.21.15.142:6826","nonce":2573794341}]},"public_addr":"172.21.15.142:6818/2573794341","cluster_addr":"172.21.15.142:6822/2573794341","heartbeat_back_addr":"172.21.15.142:6830/2573794341","heartbeat_front_addr":"172.21.15.142:6826/2573794341","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.185824+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.262103+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.225556+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:10.523459+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:10.706035+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.257339+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.301776+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.051960+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.73:6837/2352791649":"2023-12-13T09:47:18.581724+0000","172.21.15.73:6835/2352791649":"2023-12-13T09:47:18.581724+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-12T09:47:24.499 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:24.497+0000 7f9df8939640 1 -- 172.21.15.73:0/2507792512 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f9dd406ae40 msgr2=0x7f9dd406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:24.499 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:24.497+0000 7f9df8939640 1 --2- 172.21.15.73:0/2507792512 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f9dd406ae40 0x7f9dd406d300 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f9de4036000 tx=0x7f9de403d040 comp rx=0 tx=0).stop 2023-12-12T09:47:24.499 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:24.497+0000 7f9df8939640 1 -- 172.21.15.73:0/2507792512 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9df41552e0 msgr2=0x7f9df41dbc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:24.499 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:24.497+0000 7f9df8939640 1 --2- 172.21.15.73:0/2507792512 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9df41552e0 0x7f9df41dbc30 secure :-1 s=READY pgs=1109 cs=0 l=1 rev1=1 crypto rx=0x7f9dec00cef0 tx=0x7f9dec00a710 comp rx=0 tx=0).stop 2023-12-12T09:47:24.499 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:24.497+0000 7f9df8939640 1 -- 172.21.15.73:0/2507792512 shutdown_connections 2023-12-12T09:47:24.499 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:24.497+0000 7f9df8939640 1 --2- 172.21.15.73:0/2507792512 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f9dd406ae40 0x7f9dd406d300 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:24.499 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:24.497+0000 7f9df8939640 1 --2- 172.21.15.73:0/2507792512 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9df41552e0 0x7f9df41dbc30 unknown :-1 s=CLOSED pgs=1109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:24.499 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:24.497+0000 7f9df8939640 1 --2- 172.21.15.73:0/2507792512 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9df40a50f0 0x7f9df4152d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:24.500 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:24.497+0000 7f9df8939640 1 --2- 172.21.15.73:0/2507792512 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9df406bf20 0x7f9df41df1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:24.500 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:24.497+0000 7f9df8939640 1 -- 172.21.15.73:0/2507792512 >> 172.21.15.73:0/2507792512 conn(0x7f9df40a8130 msgr2=0x7f9df40c38b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:47:24.500 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:24.497+0000 7f9df8939640 1 -- 172.21.15.73:0/2507792512 shutdown_connections 2023-12-12T09:47:24.500 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:24.497+0000 7f9df8939640 1 -- 172.21.15.73:0/2507792512 wait complete. 2023-12-12T09:47:24.520 INFO:tasks.cephfs.filesystem:Destroying file system cephfs2 and related pools 2023-12-12T09:47:24.520 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-12T09:47:24.731 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:24.730+0000 7fea77fff640 1 Processor -- start 2023-12-12T09:47:24.732 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:24.730+0000 7fea77fff640 1 -- start start 2023-12-12T09:47:24.733 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:24.732+0000 7fea77fff640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fea780a9470 0x7fea780aae00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:24.733 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:24.732+0000 7fea77fff640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fea780ab340 0x7fea7815cbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:24.734 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:24.732+0000 7fea77fff640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea78153300 con 0x7fea7814fbb0 2023-12-12T09:47:24.734 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:24.732+0000 7fea77fff640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea780aa000 con 0x7fea780a9470 2023-12-12T09:47:24.734 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:24.732+0000 7fea77fff640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea780c1d40 con 0x7fea780ab340 2023-12-12T09:47:24.734 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:24.732+0000 7fea76ffd640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7fea7814fbb0 0x7fea780c09e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:48648/0 (socket says 172.21.15.73:48648) 2023-12-12T09:47:24.734 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:24.732+0000 7fea76ffd640 1 -- 172.21.15.73:0/3997357874 learned_addr learned my addr 172.21.15.73:0/3997357874 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-12T09:47:24.734 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:24.732+0000 7fea6e7fc640 1 --2- 172.21.15.73:0/3997357874 >> v2:172.21.15.73:3300/0 conn(0x7fea780a9470 0x7fea780aae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:24.735 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:24.732+0000 7fea767fc640 1 -- 172.21.15.73:0/3997357874 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2344203402 0 0) 0x7fea78153300 con 0x7fea7814fbb0 2023-12-12T09:47:24.735 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:24.732+0000 7fea767fc640 1 -- 172.21.15.73:0/3997357874 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fea58003520 con 0x7fea7814fbb0 2023-12-12T09:47:24.735 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:24.732+0000 7fea6e7fc640 1 -- 172.21.15.73:0/3997357874 >> v2:172.21.15.142:3300/0 conn(0x7fea780ab340 msgr2=0x7fea7815cbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:47:24.736 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:24.732+0000 7fea777fe640 1 --2- 172.21.15.73:0/3997357874 >> v2:172.21.15.142:3300/0 conn(0x7fea780ab340 0x7fea7815cbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:24.736 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:24.733+0000 7fea6e7fc640 1 --2- 172.21.15.73:0/3997357874 >> v2:172.21.15.142:3300/0 conn(0x7fea780ab340 0x7fea7815cbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:24.736 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:24.733+0000 7fea6e7fc640 1 -- 172.21.15.73:0/3997357874 >> v1:172.21.15.73:6789/0 conn(0x7fea7814fbb0 legacy=0x7fea780c09e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:24.736 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:24.733+0000 7fea6e7fc640 1 -- 172.21.15.73:0/3997357874 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea780c2160 con 0x7fea780a9470 2023-12-12T09:47:24.736 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:24.733+0000 7fea777fe640 1 --2- 172.21.15.73:0/3997357874 >> v2:172.21.15.142:3300/0 conn(0x7fea780ab340 0x7fea7815cbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:47:24.736 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:24.734+0000 7fea6e7fc640 1 --2- 172.21.15.73:0/3997357874 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fea780a9470 0x7fea780aae00 secure :-1 s=READY pgs=1111 cs=0 l=1 rev1=1 crypto rx=0x7fea78156960 tx=0x7fea6002b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff93e7fa907a57da server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:47:24.736 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:24.734+0000 7fea767fc640 1 -- 172.21.15.73:0/3997357874 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea6002e070 con 0x7fea780a9470 2023-12-12T09:47:24.736 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:24.734+0000 7fea767fc640 1 -- 172.21.15.73:0/3997357874 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea600315a0 con 0x7fea780a9470 2023-12-12T09:47:24.736 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:24.734+0000 7fea767fc640 1 -- 172.21.15.73:0/3997357874 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea60031930 con 0x7fea780a9470 2023-12-12T09:47:24.737 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:24.734+0000 7fea77fff640 1 -- 172.21.15.73:0/3997357874 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fea780a9470 msgr2=0x7fea780aae00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:24.737 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:24.734+0000 7fea77fff640 1 --2- 172.21.15.73:0/3997357874 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fea780a9470 0x7fea780aae00 secure :-1 s=READY pgs=1111 cs=0 l=1 rev1=1 crypto rx=0x7fea78156960 tx=0x7fea6002b840 comp rx=0 tx=0).stop 2023-12-12T09:47:24.737 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:24.735+0000 7fea77fff640 1 -- 172.21.15.73:0/3997357874 shutdown_connections 2023-12-12T09:47:24.737 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:24.735+0000 7fea77fff640 1 --2- 172.21.15.73:0/3997357874 >> v2:172.21.15.142:3300/0 conn(0x7fea780ab340 0x7fea7815cbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:24.737 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:24.735+0000 7fea77fff640 1 --2- 172.21.15.73:0/3997357874 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fea780a9470 0x7fea780aae00 unknown :-1 s=CLOSED pgs=1111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:24.737 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:24.735+0000 7fea77fff640 1 -- 172.21.15.73:0/3997357874 >> 172.21.15.73:0/3997357874 conn(0x7fea780c23b0 msgr2=0x7fea780c2790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:47:24.737 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:24.735+0000 7fea77fff640 1 -- 172.21.15.73:0/3997357874 shutdown_connections 2023-12-12T09:47:24.738 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:24.735+0000 7fea77fff640 1 -- 172.21.15.73:0/3997357874 wait complete. 2023-12-12T09:47:24.738 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:24.736+0000 7fea77fff640 1 Processor -- start 2023-12-12T09:47:24.738 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:24.737+0000 7fea77fff640 1 -- start start 2023-12-12T09:47:24.740 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:24.737+0000 7fea77fff640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fea780a9470 0x7fea781eaee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:24.740 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:24.737+0000 7fea77fff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fea780ab340 0x7fea780bef50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:24.740 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:24.737+0000 7fea77fff640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fea7814fbb0 0x7fea78153f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:24.740 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:24.737+0000 7fea77fff640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea780705c0 con 0x7fea780ab340 2023-12-12T09:47:24.741 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:24.737+0000 7fea77fff640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea78153760 con 0x7fea7814fbb0 2023-12-12T09:47:24.741 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:24.737+0000 7fea77fff640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea78153a40 con 0x7fea780a9470 2023-12-12T09:47:24.741 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:24.738+0000 7fea6e7fc640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fea780ab340 0x7fea780bef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:24.741 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:24.738+0000 7fea6e7fc640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fea780ab340 0x7fea780bef50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:42790/0 (socket says 172.21.15.73:42790) 2023-12-12T09:47:24.741 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:24.738+0000 7fea6e7fc640 1 -- 172.21.15.73:0/4248889181 learned_addr learned my addr 172.21.15.73:0/4248889181 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:47:24.741 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:24.738+0000 7fea76ffd640 1 --2- 172.21.15.73:0/4248889181 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fea780a9470 0x7fea781eaee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:24.741 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:24.738+0000 7fea6e7fc640 1 -- 172.21.15.73:0/4248889181 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fea780a9470 msgr2=0x7fea781eaee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:24.741 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:24.738+0000 7fea777fe640 1 --2- 172.21.15.73:0/4248889181 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fea7814fbb0 0x7fea78153f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:24.741 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:24.738+0000 7fea6e7fc640 1 --2- 172.21.15.73:0/4248889181 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fea780a9470 0x7fea781eaee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:24.741 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:24.738+0000 7fea6e7fc640 1 -- 172.21.15.73:0/4248889181 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fea7814fbb0 msgr2=0x7fea78153f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:24.741 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:24.738+0000 7fea6e7fc640 1 --2- 172.21.15.73:0/4248889181 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fea7814fbb0 0x7fea78153f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:24.741 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:24.738+0000 7fea6e7fc640 1 -- 172.21.15.73:0/4248889181 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea60009400 con 0x7fea780ab340 2023-12-12T09:47:24.741 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:24.738+0000 7fea76ffd640 1 --2- 172.21.15.73:0/4248889181 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fea780a9470 0x7fea781eaee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:47:24.741 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:24.739+0000 7fea6e7fc640 1 --2- 172.21.15.73:0/4248889181 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fea780ab340 0x7fea780bef50 secure :-1 s=READY pgs=1112 cs=0 l=1 rev1=1 crypto rx=0x7fea60034040 tx=0x7fea600046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:47:24.742 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:24.739+0000 7fea6ffff640 1 -- 172.21.15.73:0/4248889181 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea60032840 con 0x7fea780ab340 2023-12-12T09:47:24.742 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:24.739+0000 7fea6ffff640 1 -- 172.21.15.73:0/4248889181 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea600329c0 con 0x7fea780ab340 2023-12-12T09:47:24.742 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:24.739+0000 7fea77fff640 1 -- 172.21.15.73:0/4248889181 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea780bf490 con 0x7fea780ab340 2023-12-12T09:47:24.742 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:24.739+0000 7fea6ffff640 1 -- 172.21.15.73:0/4248889181 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea60032d70 con 0x7fea780ab340 2023-12-12T09:47:24.742 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:24.739+0000 7fea77fff640 1 -- 172.21.15.73:0/4248889181 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea780708a0 con 0x7fea780ab340 2023-12-12T09:47:24.742 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:24.740+0000 7fea77fff640 1 -- 172.21.15.73:0/4248889181 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea78153c60 con 0x7fea780ab340 2023-12-12T09:47:24.742 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:24.741+0000 7fea6ffff640 1 -- 172.21.15.73:0/4248889181 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fea6004e430 con 0x7fea780ab340 2023-12-12T09:47:24.743 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:24.742+0000 7fea6ffff640 1 --2- 172.21.15.73:0/4248889181 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fea5c06ae40 0x7fea5c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:24.743 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:24.742+0000 7fea6ffff640 1 -- 172.21.15.73:0/4248889181 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 5799+0+0 (secure 0 0 0) 0x7fea600ab640 con 0x7fea780ab340 2023-12-12T09:47:24.744 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:24.742+0000 7fea76ffd640 1 --2- 172.21.15.73:0/4248889181 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fea5c06ae40 0x7fea5c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:24.744 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:24.743+0000 7fea76ffd640 1 --2- 172.21.15.73:0/4248889181 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fea5c06ae40 0x7fea5c06d300 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7fea68007fd0 tx=0x7fea68009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:47:24.747 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:24.746+0000 7fea6ffff640 1 -- 172.21.15.73:0/4248889181 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fea60076680 con 0x7fea780ab340 2023-12-12T09:47:24.974 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:24.973+0000 7fea77fff640 1 -- 172.21.15.73:0/4248889181 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fea78070700 con 0x7fea780ab340 2023-12-12T09:47:24.975 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:24.974+0000 7fea6ffff640 1 -- 172.21.15.73:0/4248889181 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 51 v51) v1 ==== 94+0+4920 (secure 0 0 0) 0x7fea78070700 con 0x7fea780ab340 2023-12-12T09:47:24.975 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-12T09:47:24.976 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":51,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4943,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6835/3004685650","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6833","nonce":3004685650},{"type":"v1","addr":"172.21.15.142:6835","nonce":3004685650}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40},{"gid":5365,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6834/3290362874","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6832","nonce":3290362874},{"type":"v1","addr":"172.21.15.142:6834","nonce":3290362874}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40},{"gid":7086,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6837/3803137802","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6835","nonce":3803137802},{"type":"v1","addr":"172.21.15.73:6837","nonce":3803137802}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":51}],"filesystems":[{"mdsmap":{"epoch":49,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-12T09:46:41.791760+0000","modified":"2023-12-12T09:46:44.861785+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6426},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6426":{"gid":6426,"name":"a","rank":0,"incarnation":45,"state":"up:active","state_seq":7,"addr":"172.21.15.73:6836/340095591","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":340095591},{"type":"v1","addr":"172.21.15.73:6836","nonce":340095591}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2023-12-12T09:47:24.976 INFO:teuthology.orchestra.run.smithi073.stderr:dumped fsmap epoch 51 2023-12-12T09:47:24.978 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:24.976+0000 7fea77fff640 1 -- 172.21.15.73:0/4248889181 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fea5c06ae40 msgr2=0x7fea5c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:24.978 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:24.976+0000 7fea77fff640 1 --2- 172.21.15.73:0/4248889181 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fea5c06ae40 0x7fea5c06d300 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7fea68007fd0 tx=0x7fea68009040 comp rx=0 tx=0).stop 2023-12-12T09:47:24.978 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:24.976+0000 7fea77fff640 1 -- 172.21.15.73:0/4248889181 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fea780ab340 msgr2=0x7fea780bef50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:24.978 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:24.976+0000 7fea77fff640 1 --2- 172.21.15.73:0/4248889181 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fea780ab340 0x7fea780bef50 secure :-1 s=READY pgs=1112 cs=0 l=1 rev1=1 crypto rx=0x7fea60034040 tx=0x7fea600046c0 comp rx=0 tx=0).stop 2023-12-12T09:47:24.978 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:24.976+0000 7fea77fff640 1 -- 172.21.15.73:0/4248889181 shutdown_connections 2023-12-12T09:47:24.979 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:24.976+0000 7fea77fff640 1 --2- 172.21.15.73:0/4248889181 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fea5c06ae40 0x7fea5c06d300 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:24.979 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:24.976+0000 7fea77fff640 1 --2- 172.21.15.73:0/4248889181 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fea7814fbb0 0x7fea78153f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:24.979 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:24.976+0000 7fea77fff640 1 --2- 172.21.15.73:0/4248889181 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fea780ab340 0x7fea780bef50 unknown :-1 s=CLOSED pgs=1112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:24.979 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:24.976+0000 7fea77fff640 1 --2- 172.21.15.73:0/4248889181 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fea780a9470 0x7fea781eaee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:24.979 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:24.976+0000 7fea77fff640 1 -- 172.21.15.73:0/4248889181 >> 172.21.15.73:0/4248889181 conn(0x7fea780c23b0 msgr2=0x7fea780c09e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:47:24.979 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:24.977+0000 7fea77fff640 1 -- 172.21.15.73:0/4248889181 shutdown_connections 2023-12-12T09:47:24.979 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:24.977+0000 7fea77fff640 1 -- 172.21.15.73:0/4248889181 wait complete. 2023-12-12T09:47:24.997 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-12T09:47:25.204 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:25.202+0000 7f4bff59e640 1 Processor -- start 2023-12-12T09:47:25.204 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:25.202+0000 7f4bff59e640 1 -- start start 2023-12-12T09:47:25.205 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:25.203+0000 7f4bff59e640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4c0014fbb0 0x7f4c000c09e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:25.205 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:25.203+0000 7f4bff59e640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f4c000c0f20 0x7f4c000aae00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:25.205 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:25.203+0000 7f4bff59e640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f4c000a9470 0x7f4c000ab340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:25.205 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:25.203+0000 7f4bff59e640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c000aa000 con 0x7f4c000c0f20 2023-12-12T09:47:25.205 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:25.203+0000 7f4bff59e640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c000c1d40 con 0x7f4c000a9470 2023-12-12T09:47:25.205 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:25.203+0000 7f4bff59e640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c00153300 con 0x7f4c0014fbb0 2023-12-12T09:47:25.205 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:25.204+0000 7f4bf7fff640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f4c000c0f20 0x7f4c000aae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:25.206 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:25.204+0000 7f4bf7fff640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f4c000c0f20 0x7f4c000aae00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:42806/0 (socket says 172.21.15.73:42806) 2023-12-12T09:47:25.206 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:25.204+0000 7f4bf7fff640 1 -- 172.21.15.73:0/1946909067 learned_addr learned my addr 172.21.15.73:0/1946909067 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:47:25.206 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:25.204+0000 7f4bf7fff640 1 -- 172.21.15.73:0/1946909067 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4c0014fbb0 msgr2=0x7f4c000c09e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:47:25.206 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:25.204+0000 7f4bf7fff640 1 --2- 172.21.15.73:0/1946909067 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4c0014fbb0 0x7f4c000c09e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:25.206 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:25.204+0000 7f4bf7fff640 1 -- 172.21.15.73:0/1946909067 >> v2:172.21.15.142:3300/0 conn(0x7f4c000a9470 msgr2=0x7f4c000ab340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:47:25.206 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:25.204+0000 7f4bf7fff640 1 --2- 172.21.15.73:0/1946909067 >> v2:172.21.15.142:3300/0 conn(0x7f4c000a9470 0x7f4c000ab340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:25.207 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:25.204+0000 7f4bf7fff640 1 -- 172.21.15.73:0/1946909067 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c000c2160 con 0x7f4c000c0f20 2023-12-12T09:47:25.207 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:25.205+0000 7f4bf7fff640 1 --2- 172.21.15.73:0/1946909067 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4c000c0f20 0x7f4c000aae00 secure :-1 s=READY pgs=1113 cs=0 l=1 rev1=1 crypto rx=0x7f4c00073c50 tx=0x7f4be802b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eff5c3dda048becd server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:47:25.207 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:25.206+0000 7f4bfdd9b640 1 -- 172.21.15.73:0/1946909067 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4be80317c0 con 0x7f4c000c0f20 2023-12-12T09:47:25.207 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:25.206+0000 7f4bfdd9b640 1 -- 172.21.15.73:0/1946909067 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4be8031920 con 0x7f4c000c0f20 2023-12-12T09:47:25.207 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:25.206+0000 7f4bfdd9b640 1 -- 172.21.15.73:0/1946909067 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4be8031cb0 con 0x7f4c000c0f20 2023-12-12T09:47:25.210 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:25.206+0000 7f4bff59e640 1 -- 172.21.15.73:0/1946909067 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4c000c0f20 msgr2=0x7f4c000aae00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:25.210 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:25.206+0000 7f4bff59e640 1 --2- 172.21.15.73:0/1946909067 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4c000c0f20 0x7f4c000aae00 secure :-1 s=READY pgs=1113 cs=0 l=1 rev1=1 crypto rx=0x7f4c00073c50 tx=0x7f4be802b860 comp rx=0 tx=0).stop 2023-12-12T09:47:25.210 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:25.206+0000 7f4bff59e640 1 -- 172.21.15.73:0/1946909067 shutdown_connections 2023-12-12T09:47:25.210 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:25.206+0000 7f4bff59e640 1 --2- 172.21.15.73:0/1946909067 >> v2:172.21.15.142:3300/0 conn(0x7f4c000a9470 0x7f4c000ab340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:25.211 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:25.206+0000 7f4bff59e640 1 --2- 172.21.15.73:0/1946909067 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4c000c0f20 0x7f4c000aae00 unknown :-1 s=CLOSED pgs=1113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:25.211 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:25.206+0000 7f4bff59e640 1 --2- 172.21.15.73:0/1946909067 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4c0014fbb0 0x7f4c000c09e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:25.211 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:25.206+0000 7f4bff59e640 1 -- 172.21.15.73:0/1946909067 >> 172.21.15.73:0/1946909067 conn(0x7f4c000c23b0 msgr2=0x7f4c000c2790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:47:25.211 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:25.206+0000 7f4bff59e640 1 -- 172.21.15.73:0/1946909067 shutdown_connections 2023-12-12T09:47:25.211 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:25.206+0000 7f4bff59e640 1 -- 172.21.15.73:0/1946909067 wait complete. 2023-12-12T09:47:25.211 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:25.208+0000 7f4bff59e640 1 Processor -- start 2023-12-12T09:47:25.211 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:25.208+0000 7f4bff59e640 1 -- start start 2023-12-12T09:47:25.214 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:25.209+0000 7f4bff59e640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4c000a9470 0x7f4c000723d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:25.214 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:25.209+0000 7f4bff59e640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4c000c0f20 0x7f4c001edb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:25.214 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:25.209+0000 7f4bff59e640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4c0014fbb0 0x7f4c001ee0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:25.214 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:25.209+0000 7f4bff59e640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c00156520 con 0x7f4c000a9470 2023-12-12T09:47:25.214 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:25.209+0000 7f4bff59e640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c00153760 con 0x7f4c0014fbb0 2023-12-12T09:47:25.214 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:25.209+0000 7f4bff59e640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c00153a40 con 0x7f4c000c0f20 2023-12-12T09:47:25.214 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:25.209+0000 7f4bfe59c640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4c000a9470 0x7f4c000723d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:25.214 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:25.209+0000 7f4bfe59c640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4c000a9470 0x7f4c000723d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:42816/0 (socket says 172.21.15.73:42816) 2023-12-12T09:47:25.214 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:25.209+0000 7f4bfe59c640 1 -- 172.21.15.73:0/738210162 learned_addr learned my addr 172.21.15.73:0/738210162 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:47:25.214 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:25.210+0000 7f4bf7fff640 1 --2- 172.21.15.73:0/738210162 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4c000c0f20 0x7f4c001edb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:25.215 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:25.210+0000 7f4bfe59c640 1 -- 172.21.15.73:0/738210162 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4c000c0f20 msgr2=0x7f4c001edb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:25.215 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:25.210+0000 7f4bfe59c640 1 --2- 172.21.15.73:0/738210162 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4c000c0f20 0x7f4c001edb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:25.215 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:25.210+0000 7f4bfed9d640 1 --2- 172.21.15.73:0/738210162 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4c0014fbb0 0x7f4c001ee0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:25.215 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:25.210+0000 7f4bfe59c640 1 -- 172.21.15.73:0/738210162 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4c0014fbb0 msgr2=0x7f4c001ee0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:25.215 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:25.210+0000 7f4bfe59c640 1 --2- 172.21.15.73:0/738210162 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4c0014fbb0 0x7f4c001ee0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:25.215 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:25.210+0000 7f4bfe59c640 1 -- 172.21.15.73:0/738210162 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4be80094d0 con 0x7f4c000a9470 2023-12-12T09:47:25.215 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:25.210+0000 7f4bf7fff640 1 --2- 172.21.15.73:0/738210162 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4c000c0f20 0x7f4c001edb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:47:25.215 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:25.210+0000 7f4bfe59c640 1 --2- 172.21.15.73:0/738210162 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4c000a9470 0x7f4c000723d0 secure :-1 s=READY pgs=1114 cs=0 l=1 rev1=1 crypto rx=0x7f4bf000b410 tx=0x7f4bf000b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:47:25.215 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:25.210+0000 7f4bf6ffd640 1 -- 172.21.15.73:0/738210162 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bf0011830 con 0x7f4c000a9470 2023-12-12T09:47:25.215 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:25.210+0000 7f4bf6ffd640 1 -- 172.21.15.73:0/738210162 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4bf00119b0 con 0x7f4c000a9470 2023-12-12T09:47:25.215 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:25.210+0000 7f4bf6ffd640 1 -- 172.21.15.73:0/738210162 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bf0011d60 con 0x7f4c000a9470 2023-12-12T09:47:25.215 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:25.210+0000 7f4bff59e640 1 -- 172.21.15.73:0/738210162 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c00153d20 con 0x7f4c000a9470 2023-12-12T09:47:25.216 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:25.210+0000 7f4bff59e640 1 -- 172.21.15.73:0/738210162 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c00072910 con 0x7f4c000a9470 2023-12-12T09:47:25.216 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:25.211+0000 7f4bff59e640 1 -- 172.21.15.73:0/738210162 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c000c1ad0 con 0x7f4c000a9470 2023-12-12T09:47:25.216 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:25.212+0000 7f4bf6ffd640 1 -- 172.21.15.73:0/738210162 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f4bf001a400 con 0x7f4c000a9470 2023-12-12T09:47:25.216 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:25.213+0000 7f4bf6ffd640 1 --2- 172.21.15.73:0/738210162 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f4be006ae40 0x7f4be006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:25.217 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:25.213+0000 7f4bf6ffd640 1 -- 172.21.15.73:0/738210162 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 5799+0+0 (secure 0 0 0) 0x7f4bf00897f0 con 0x7f4c000a9470 2023-12-12T09:47:25.217 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:25.214+0000 7f4bf7fff640 1 --2- 172.21.15.73:0/738210162 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f4be006ae40 0x7f4be006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:25.217 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:25.214+0000 7f4bf7fff640 1 --2- 172.21.15.73:0/738210162 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f4be006ae40 0x7f4be006d300 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f4be8036000 tx=0x7f4be803d040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:47:25.219 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:25.218+0000 7f4bf6ffd640 1 -- 172.21.15.73:0/738210162 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f4bf0054840 con 0x7f4c000a9470 2023-12-12T09:47:25.446 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:25.445+0000 7f4bff59e640 1 -- 172.21.15.73:0/738210162 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4c00152cd0 con 0x7f4c000a9470 2023-12-12T09:47:25.448 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:25.446+0000 7f4bf6ffd640 1 -- 172.21.15.73:0/738210162 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 51 v51) v1 ==== 94+0+4920 (secure 0 0 0) 0x7f4bf0015020 con 0x7f4c000a9470 2023-12-12T09:47:25.448 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-12T09:47:25.448 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":51,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4943,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6835/3004685650","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6833","nonce":3004685650},{"type":"v1","addr":"172.21.15.142:6835","nonce":3004685650}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40},{"gid":5365,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6834/3290362874","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6832","nonce":3290362874},{"type":"v1","addr":"172.21.15.142:6834","nonce":3290362874}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40},{"gid":7086,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6837/3803137802","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6835","nonce":3803137802},{"type":"v1","addr":"172.21.15.73:6837","nonce":3803137802}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":51}],"filesystems":[{"mdsmap":{"epoch":49,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-12T09:46:41.791760+0000","modified":"2023-12-12T09:46:44.861785+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6426},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6426":{"gid":6426,"name":"a","rank":0,"incarnation":45,"state":"up:active","state_seq":7,"addr":"172.21.15.73:6836/340095591","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":340095591},{"type":"v1","addr":"172.21.15.73:6836","nonce":340095591}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2023-12-12T09:47:25.449 INFO:teuthology.orchestra.run.smithi073.stderr:dumped fsmap epoch 51 2023-12-12T09:47:25.451 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:25.449+0000 7f4bff59e640 1 -- 172.21.15.73:0/738210162 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f4be006ae40 msgr2=0x7f4be006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:25.451 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:25.449+0000 7f4bff59e640 1 --2- 172.21.15.73:0/738210162 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f4be006ae40 0x7f4be006d300 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f4be8036000 tx=0x7f4be803d040 comp rx=0 tx=0).stop 2023-12-12T09:47:25.451 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:25.449+0000 7f4bff59e640 1 -- 172.21.15.73:0/738210162 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4c000a9470 msgr2=0x7f4c000723d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:25.451 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:25.449+0000 7f4bff59e640 1 --2- 172.21.15.73:0/738210162 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4c000a9470 0x7f4c000723d0 secure :-1 s=READY pgs=1114 cs=0 l=1 rev1=1 crypto rx=0x7f4bf000b410 tx=0x7f4bf000b8d0 comp rx=0 tx=0).stop 2023-12-12T09:47:25.451 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:25.449+0000 7f4bff59e640 1 -- 172.21.15.73:0/738210162 shutdown_connections 2023-12-12T09:47:25.451 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:25.449+0000 7f4bff59e640 1 --2- 172.21.15.73:0/738210162 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f4be006ae40 0x7f4be006d300 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:25.451 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:25.449+0000 7f4bff59e640 1 --2- 172.21.15.73:0/738210162 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4c0014fbb0 0x7f4c001ee0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:25.451 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:25.449+0000 7f4bff59e640 1 --2- 172.21.15.73:0/738210162 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4c000c0f20 0x7f4c001edb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:25.452 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:25.449+0000 7f4bff59e640 1 --2- 172.21.15.73:0/738210162 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4c000a9470 0x7f4c000723d0 unknown :-1 s=CLOSED pgs=1114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:25.452 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:25.449+0000 7f4bff59e640 1 -- 172.21.15.73:0/738210162 >> 172.21.15.73:0/738210162 conn(0x7f4c000c23b0 msgr2=0x7f4c000a62a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:47:25.452 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:25.449+0000 7f4bff59e640 1 -- 172.21.15.73:0/738210162 shutdown_connections 2023-12-12T09:47:25.452 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:25.449+0000 7f4bff59e640 1 -- 172.21.15.73:0/738210162 wait complete. 2023-12-12T09:47:25.469 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-12T09:47:25.673 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:25.671+0000 7f3600d83640 1 Processor -- start 2023-12-12T09:47:25.673 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:25.671+0000 7f3600d83640 1 -- start start 2023-12-12T09:47:25.674 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:25.673+0000 7f3600d83640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f35fc06db70 0x7f35fc0c39b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:25.675 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:25.673+0000 7f3600d83640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f35fc0c5070 0x7f35fc0c3ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:25.675 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:25.673+0000 7f3600d83640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35fc152610 con 0x7f35fc14fa40 2023-12-12T09:47:25.675 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:25.673+0000 7f3600d83640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35fc1528f0 con 0x7f35fc0c5070 2023-12-12T09:47:25.675 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:25.673+0000 7f3600d83640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35fc152bd0 con 0x7f35fc06db70 2023-12-12T09:47:25.675 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:25.673+0000 7f35fa59c640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f35fc14fa40 0x7f35fc06a4e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:48660/0 (socket says 172.21.15.73:48660) 2023-12-12T09:47:25.675 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:25.673+0000 7f35fa59c640 1 -- 172.21.15.73:0/2762929808 learned_addr learned my addr 172.21.15.73:0/2762929808 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-12T09:47:25.677 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:25.674+0000 7f35f9d9b640 1 --2- 172.21.15.73:0/2762929808 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f35fc06db70 0x7f35fc0c39b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:25.677 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:25.674+0000 7f35fad9d640 1 --2- 172.21.15.73:0/2762929808 >> v2:172.21.15.142:3300/0 conn(0x7f35fc0c5070 0x7f35fc0c3ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:25.677 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:25.674+0000 7f35f959a640 1 -- 172.21.15.73:0/2762929808 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3671188419 0 0) 0x7f35fc152610 con 0x7f35fc14fa40 2023-12-12T09:47:25.677 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:25.674+0000 7f35f959a640 1 -- 172.21.15.73:0/2762929808 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f35e4003520 con 0x7f35fc14fa40 2023-12-12T09:47:25.677 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:25.674+0000 7f35f959a640 1 -- 172.21.15.73:0/2762929808 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3937555267 0 0) 0x7f35e4003520 con 0x7f35fc14fa40 2023-12-12T09:47:25.677 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:25.674+0000 7f35f959a640 1 -- 172.21.15.73:0/2762929808 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f35fc06db70 msgr2=0x7f35fc0c39b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:47:25.677 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:25.674+0000 7f35f959a640 1 --2- 172.21.15.73:0/2762929808 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f35fc06db70 0x7f35fc0c39b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:25.677 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:25.674+0000 7f35f959a640 1 -- 172.21.15.73:0/2762929808 >> v2:172.21.15.142:3300/0 conn(0x7f35fc0c5070 msgr2=0x7f35fc0c3ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:47:25.677 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:25.674+0000 7f35f959a640 1 --2- 172.21.15.73:0/2762929808 >> v2:172.21.15.142:3300/0 conn(0x7f35fc0c5070 0x7f35fc0c3ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:25.677 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:25.674+0000 7f35f959a640 1 -- 172.21.15.73:0/2762929808 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35fc152eb0 con 0x7f35fc14fa40 2023-12-12T09:47:25.677 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:25.674+0000 7f35f959a640 1 -- 172.21.15.73:0/2762929808 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3186547832 0 0) 0x7f35ec001670 con 0x7f35fc14fa40 2023-12-12T09:47:25.678 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:25.674+0000 7f35f959a640 1 -- 172.21.15.73:0/2762929808 >> v1:172.21.15.73:6789/0 conn(0x7f35fc14fa40 legacy=0x7f35fc06a4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:25.678 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:25.674+0000 7f35f959a640 1 --2- 172.21.15.73:0/2762929808 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f35e4003970 0x7f35e4003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:25.678 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:25.674+0000 7f35f959a640 1 --2- 172.21.15.73:0/2762929808 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f35fc06db70 0x7f35e40047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:25.678 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:25.674+0000 7f35f959a640 1 --2- 172.21.15.73:0/2762929808 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f35e4004d00 0x7f35e4005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:25.678 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:25.674+0000 7f35f959a640 1 -- 172.21.15.73:0/2762929808 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35fc1528f0 con 0x7f35e4004d00 2023-12-12T09:47:25.678 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:25.674+0000 7f35f959a640 1 -- 172.21.15.73:0/2762929808 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35fc152bd0 con 0x7f35e4003970 2023-12-12T09:47:25.678 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:25.674+0000 7f35f959a640 1 -- 172.21.15.73:0/2762929808 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35e400b980 con 0x7f35fc06db70 2023-12-12T09:47:25.678 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:25.675+0000 7f35fad9d640 1 --2- 172.21.15.73:0/2762929808 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f35e4004d00 0x7f35e4005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:25.678 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:25.675+0000 7f35fa59c640 1 --2- 172.21.15.73:0/2762929808 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f35e4003970 0x7f35e4003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:25.678 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:25.675+0000 7f35f9d9b640 1 --2- 172.21.15.73:0/2762929808 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f35fc06db70 0x7f35e40047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:25.678 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:25.675+0000 7f35fad9d640 1 -- 172.21.15.73:0/2762929808 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f35fc06db70 msgr2=0x7f35e40047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:47:25.678 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:25.675+0000 7f35fad9d640 1 --2- 172.21.15.73:0/2762929808 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f35fc06db70 0x7f35e40047c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:25.678 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:25.675+0000 7f35fad9d640 1 -- 172.21.15.73:0/2762929808 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f35e4003970 msgr2=0x7f35e4003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:47:25.679 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:25.675+0000 7f35fad9d640 1 --2- 172.21.15.73:0/2762929808 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f35e4003970 0x7f35e4003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:25.679 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:25.675+0000 7f35fad9d640 1 -- 172.21.15.73:0/2762929808 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35e4003520 con 0x7f35e4004d00 2023-12-12T09:47:25.680 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:25.676+0000 7f35fad9d640 1 --2- 172.21.15.73:0/2762929808 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f35e4004d00 0x7f35e4005180 secure :-1 s=READY pgs=1116 cs=0 l=1 rev1=1 crypto rx=0x7f35f4009fc0 tx=0x7f35e40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a662e1fb323b7b6a server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:47:25.680 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:25.677+0000 7f35f959a640 1 -- 172.21.15.73:0/2762929808 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35f402cc60 con 0x7f35e4004d00 2023-12-12T09:47:25.680 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:25.677+0000 7f35f959a640 1 -- 172.21.15.73:0/2762929808 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35f400f040 con 0x7f35e4004d00 2023-12-12T09:47:25.680 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:25.677+0000 7f35f959a640 1 -- 172.21.15.73:0/2762929808 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35f4034440 con 0x7f35e4004d00 2023-12-12T09:47:25.680 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:25.677+0000 7f3600d83640 1 -- 172.21.15.73:0/2762929808 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f35e4004d00 msgr2=0x7f35e4005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:25.680 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:25.677+0000 7f3600d83640 1 --2- 172.21.15.73:0/2762929808 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f35e4004d00 0x7f35e4005180 secure :-1 s=READY pgs=1116 cs=0 l=1 rev1=1 crypto rx=0x7f35f4009fc0 tx=0x7f35e40057f0 comp rx=0 tx=0).stop 2023-12-12T09:47:25.680 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:25.677+0000 7f35fad9d640 1 -- 172.21.15.73:0/2762929808 reap_dead start 2023-12-12T09:47:25.680 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:25.677+0000 7f3600d83640 1 -- 172.21.15.73:0/2762929808 shutdown_connections 2023-12-12T09:47:25.680 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:25.677+0000 7f3600d83640 1 -- 172.21.15.73:0/2762929808 >> 172.21.15.73:0/2762929808 conn(0x7f35fc0a8130 msgr2=0x7f35fc0c24b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:47:25.680 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:25.677+0000 7f3600d83640 1 -- 172.21.15.73:0/2762929808 shutdown_connections 2023-12-12T09:47:25.681 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:25.677+0000 7f3600d83640 1 -- 172.21.15.73:0/2762929808 wait complete. 2023-12-12T09:47:25.681 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:25.679+0000 7f3600d83640 1 Processor -- start 2023-12-12T09:47:25.681 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:25.679+0000 7f3600d83640 1 -- start start 2023-12-12T09:47:25.683 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:25.680+0000 7f3600d83640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f35e4004d00 0x7f35fc1515a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:25.683 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:25.680+0000 7f3600d83640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f35fc0aa970 0x7f35fc0a8b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:25.683 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:25.680+0000 7f3600d83640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f35fc0999d0 0x7f35fc14bb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:25.683 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:25.680+0000 7f3600d83640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35fc1ea5e0 con 0x7f35fc0aa970 2023-12-12T09:47:25.683 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:25.680+0000 7f3600d83640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35fc0a9480 con 0x7f35fc0999d0 2023-12-12T09:47:25.683 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:25.680+0000 7f3600d83640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35fc0a9a40 con 0x7f35e4004d00 2023-12-12T09:47:25.683 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:25.681+0000 7f35f9d9b640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f35fc0aa970 0x7f35fc0a8b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:25.683 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:25.681+0000 7f35f9d9b640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f35fc0aa970 0x7f35fc0a8b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:42832/0 (socket says 172.21.15.73:42832) 2023-12-12T09:47:25.683 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:25.681+0000 7f35f9d9b640 1 -- 172.21.15.73:0/2496785061 learned_addr learned my addr 172.21.15.73:0/2496785061 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:47:25.683 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:25.681+0000 7f35fa59c640 1 --2- 172.21.15.73:0/2496785061 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f35e4004d00 0x7f35fc1515a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:25.683 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:25.681+0000 7f35f9d9b640 1 -- 172.21.15.73:0/2496785061 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f35e4004d00 msgr2=0x7f35fc1515a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:25.683 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:25.681+0000 7f35f9d9b640 1 --2- 172.21.15.73:0/2496785061 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f35e4004d00 0x7f35fc1515a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:25.683 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:25.681+0000 7f35f9d9b640 1 -- 172.21.15.73:0/2496785061 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f35fc0999d0 msgr2=0x7f35fc14bb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:25.684 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:25.681+0000 7f35f9d9b640 1 --2- 172.21.15.73:0/2496785061 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f35fc0999d0 0x7f35fc14bb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:25.684 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:25.681+0000 7f35f9d9b640 1 -- 172.21.15.73:0/2496785061 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35fc1eaa00 con 0x7f35fc0aa970 2023-12-12T09:47:25.684 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:25.681+0000 7f35f9d9b640 1 --2- 172.21.15.73:0/2496785061 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f35fc0aa970 0x7f35fc0a8b60 secure :-1 s=READY pgs=1117 cs=0 l=1 rev1=1 crypto rx=0x7f35f00107f0 tx=0x7f35f0010cb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:47:25.684 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:25.682+0000 7f35eaffd640 1 -- 172.21.15.73:0/2496785061 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35f00095d0 con 0x7f35fc0aa970 2023-12-12T09:47:25.685 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:25.682+0000 7f35eaffd640 1 -- 172.21.15.73:0/2496785061 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35f000eae0 con 0x7f35fc0aa970 2023-12-12T09:47:25.685 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:25.682+0000 7f35eaffd640 1 -- 172.21.15.73:0/2496785061 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35f000ee70 con 0x7f35fc0aa970 2023-12-12T09:47:25.685 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:25.682+0000 7f3600d83640 1 -- 172.21.15.73:0/2496785061 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35fc0a96d0 con 0x7f35fc0aa970 2023-12-12T09:47:25.685 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:25.682+0000 7f3600d83640 1 -- 172.21.15.73:0/2496785061 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35fc151ae0 con 0x7f35fc0aa970 2023-12-12T09:47:25.685 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:25.683+0000 7f3600d83640 1 -- 172.21.15.73:0/2496785061 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35fc067580 con 0x7f35fc0aa970 2023-12-12T09:47:25.685 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:25.684+0000 7f35eaffd640 1 -- 172.21.15.73:0/2496785061 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f35f001c400 con 0x7f35fc0aa970 2023-12-12T09:47:25.686 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:25.685+0000 7f35eaffd640 1 --2- 172.21.15.73:0/2496785061 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f35dc06ae70 0x7f35dc06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:25.686 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:25.685+0000 7f35eaffd640 1 -- 172.21.15.73:0/2496785061 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 5799+0+0 (secure 0 0 0) 0x7f35f0089b20 con 0x7f35fc0aa970 2023-12-12T09:47:25.686 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:25.685+0000 7f35fa59c640 1 --2- 172.21.15.73:0/2496785061 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f35dc06ae70 0x7f35dc06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:25.687 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:25.686+0000 7f35fa59c640 1 --2- 172.21.15.73:0/2496785061 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f35dc06ae70 0x7f35dc06d330 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f35ec0057f0 tx=0x7f35ec000f90 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:47:25.691 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:25.689+0000 7f35eaffd640 1 -- 172.21.15.73:0/2496785061 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f35f0054b60 con 0x7f35fc0aa970 2023-12-12T09:47:25.882 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:25.880+0000 7f3600d83640 1 -- 172.21.15.73:0/2496785061 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f35fc0c1ef0 con 0x7f35fc0aa970 2023-12-12T09:47:25.885 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:25.883+0000 7f35eaffd640 1 -- 172.21.15.73:0/2496785061 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v84) v1 ==== 74+0+16653 (secure 0 0 0) 0x7f35f0058180 con 0x7f35fc0aa970 2023-12-12T09:47:25.885 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-12T09:47:25.886 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":84,"fsid":"ba240992-02b8-4c7e-92f2-27eb29ac433b","created":"2023-12-12T09:43:02.454719+0000","modified":"2023-12-12T09:47:21.783499+0000","last_up_change":"2023-12-12T09:43:13.913440+0000","last_in_change":"2023-12-12T09:43:05.925348+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-12T09:43:15.525508+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs2_metadata","create_time":"2023-12-12T09:46:40.116878+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs2_data","create_time":"2023-12-12T09:46:40.798840+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"dd9074be-dbe2-4c34-9896-a4223d8d3940","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":4047810203},{"type":"v1","addr":"172.21.15.73:6801","nonce":4047810203}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":4047810203},{"type":"v1","addr":"172.21.15.73:6803","nonce":4047810203}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":4047810203},{"type":"v1","addr":"172.21.15.73:6807","nonce":4047810203}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":4047810203},{"type":"v1","addr":"172.21.15.73:6805","nonce":4047810203}]},"public_addr":"172.21.15.73:6801/4047810203","cluster_addr":"172.21.15.73:6803/4047810203","heartbeat_back_addr":"172.21.15.73:6807/4047810203","heartbeat_front_addr":"172.21.15.73:6805/4047810203","state":["exists","up"]},{"osd":1,"uuid":"c4a05052-96d4-4758-a4e1-1a37f1e07fed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":1356058331},{"type":"v1","addr":"172.21.15.73:6824","nonce":1356058331}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":1356058331},{"type":"v1","addr":"172.21.15.73:6827","nonce":1356058331}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":1356058331},{"type":"v1","addr":"172.21.15.73:6831","nonce":1356058331}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":1356058331},{"type":"v1","addr":"172.21.15.73:6829","nonce":1356058331}]},"public_addr":"172.21.15.73:6824/1356058331","cluster_addr":"172.21.15.73:6827/1356058331","heartbeat_back_addr":"172.21.15.73:6831/1356058331","heartbeat_front_addr":"172.21.15.73:6829/1356058331","state":["exists","up"]},{"osd":2,"uuid":"512bc8ac-72c2-40d4-b3d2-d867a92c5213","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":1228903316},{"type":"v1","addr":"172.21.15.73:6817","nonce":1228903316}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":1228903316},{"type":"v1","addr":"172.21.15.73:6819","nonce":1228903316}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6823","nonce":1228903316},{"type":"v1","addr":"172.21.15.73:6825","nonce":1228903316}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":1228903316},{"type":"v1","addr":"172.21.15.73:6821","nonce":1228903316}]},"public_addr":"172.21.15.73:6817/1228903316","cluster_addr":"172.21.15.73:6819/1228903316","heartbeat_back_addr":"172.21.15.73:6825/1228903316","heartbeat_front_addr":"172.21.15.73:6821/1228903316","state":["exists","up"]},{"osd":3,"uuid":"3d1a91e0-42bf-437a-8eae-8d357c8f63a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":1293329670},{"type":"v1","addr":"172.21.15.73:6809","nonce":1293329670}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6810","nonce":1293329670},{"type":"v1","addr":"172.21.15.73:6811","nonce":1293329670}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":1293329670},{"type":"v1","addr":"172.21.15.73:6815","nonce":1293329670}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":1293329670},{"type":"v1","addr":"172.21.15.73:6813","nonce":1293329670}]},"public_addr":"172.21.15.73:6809/1293329670","cluster_addr":"172.21.15.73:6811/1293329670","heartbeat_back_addr":"172.21.15.73:6815/1293329670","heartbeat_front_addr":"172.21.15.73:6813/1293329670","state":["exists","up"]},{"osd":4,"uuid":"4b302fff-834c-4069-ac19-00e46f6c87b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":3727975702},{"type":"v1","addr":"172.21.15.142:6801","nonce":3727975702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":3727975702},{"type":"v1","addr":"172.21.15.142:6803","nonce":3727975702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6809","nonce":3727975702},{"type":"v1","addr":"172.21.15.142:6811","nonce":3727975702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6805","nonce":3727975702},{"type":"v1","addr":"172.21.15.142:6807","nonce":3727975702}]},"public_addr":"172.21.15.142:6801/3727975702","cluster_addr":"172.21.15.142:6803/3727975702","heartbeat_back_addr":"172.21.15.142:6811/3727975702","heartbeat_front_addr":"172.21.15.142:6807/3727975702","state":["exists","up"]},{"osd":5,"uuid":"d7cdace2-67d0-45cc-95f2-515cf6ef1b82","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6817","nonce":2353193632},{"type":"v1","addr":"172.21.15.142:6819","nonce":2353193632}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6821","nonce":2353193632},{"type":"v1","addr":"172.21.15.142:6823","nonce":2353193632}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6829","nonce":2353193632},{"type":"v1","addr":"172.21.15.142:6831","nonce":2353193632}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6825","nonce":2353193632},{"type":"v1","addr":"172.21.15.142:6827","nonce":2353193632}]},"public_addr":"172.21.15.142:6819/2353193632","cluster_addr":"172.21.15.142:6823/2353193632","heartbeat_back_addr":"172.21.15.142:6831/2353193632","heartbeat_front_addr":"172.21.15.142:6827/2353193632","state":["exists","up"]},{"osd":6,"uuid":"649ce78a-5626-445c-aedc-a651ed05a6f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":2006111986},{"type":"v1","addr":"172.21.15.142:6806","nonce":2006111986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":2006111986},{"type":"v1","addr":"172.21.15.142:6810","nonce":2006111986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":2006111986},{"type":"v1","addr":"172.21.15.142:6815","nonce":2006111986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":2006111986},{"type":"v1","addr":"172.21.15.142:6813","nonce":2006111986}]},"public_addr":"172.21.15.142:6806/2006111986","cluster_addr":"172.21.15.142:6810/2006111986","heartbeat_back_addr":"172.21.15.142:6815/2006111986","heartbeat_front_addr":"172.21.15.142:6813/2006111986","state":["exists","up"]},{"osd":7,"uuid":"af15ae3b-c1d0-4acf-92db-8a1805494d13","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":2573794341},{"type":"v1","addr":"172.21.15.142:6818","nonce":2573794341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":2573794341},{"type":"v1","addr":"172.21.15.142:6822","nonce":2573794341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":2573794341},{"type":"v1","addr":"172.21.15.142:6830","nonce":2573794341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":2573794341},{"type":"v1","addr":"172.21.15.142:6826","nonce":2573794341}]},"public_addr":"172.21.15.142:6818/2573794341","cluster_addr":"172.21.15.142:6822/2573794341","heartbeat_back_addr":"172.21.15.142:6830/2573794341","heartbeat_front_addr":"172.21.15.142:6826/2573794341","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.185824+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.262103+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.225556+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:10.523459+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:10.706035+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.257339+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.301776+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.051960+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.73:6837/2352791649":"2023-12-13T09:47:18.581724+0000","172.21.15.73:6835/2352791649":"2023-12-13T09:47:18.581724+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-12T09:47:25.888 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:25.886+0000 7f3600d83640 1 -- 172.21.15.73:0/2496785061 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f35dc06ae70 msgr2=0x7f35dc06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:25.888 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:25.886+0000 7f3600d83640 1 --2- 172.21.15.73:0/2496785061 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f35dc06ae70 0x7f35dc06d330 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f35ec0057f0 tx=0x7f35ec000f90 comp rx=0 tx=0).stop 2023-12-12T09:47:25.888 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:25.886+0000 7f3600d83640 1 -- 172.21.15.73:0/2496785061 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f35fc0aa970 msgr2=0x7f35fc0a8b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:25.888 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:25.886+0000 7f3600d83640 1 --2- 172.21.15.73:0/2496785061 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f35fc0aa970 0x7f35fc0a8b60 secure :-1 s=READY pgs=1117 cs=0 l=1 rev1=1 crypto rx=0x7f35f00107f0 tx=0x7f35f0010cb0 comp rx=0 tx=0).stop 2023-12-12T09:47:25.889 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:25.886+0000 7f3600d83640 1 -- 172.21.15.73:0/2496785061 shutdown_connections 2023-12-12T09:47:25.889 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:25.886+0000 7f3600d83640 1 --2- 172.21.15.73:0/2496785061 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f35dc06ae70 0x7f35dc06d330 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:25.889 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:25.886+0000 7f3600d83640 1 --2- 172.21.15.73:0/2496785061 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f35fc0999d0 0x7f35fc14bb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:25.889 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:25.886+0000 7f3600d83640 1 --2- 172.21.15.73:0/2496785061 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f35fc0aa970 0x7f35fc0a8b60 unknown :-1 s=CLOSED pgs=1117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:25.889 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:25.886+0000 7f3600d83640 1 --2- 172.21.15.73:0/2496785061 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f35e4004d00 0x7f35fc1515a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:25.889 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:25.886+0000 7f3600d83640 1 -- 172.21.15.73:0/2496785061 >> 172.21.15.73:0/2496785061 conn(0x7f35fc0a8130 msgr2=0x7f35fc0c2440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:47:25.889 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:25.886+0000 7f3600d83640 1 -- 172.21.15.73:0/2496785061 shutdown_connections 2023-12-12T09:47:25.889 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:25.887+0000 7f3600d83640 1 -- 172.21.15.73:0/2496785061 wait complete. 2023-12-12T09:47:25.907 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs2 2023-12-12T09:47:26.126 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:26.124+0000 7f2de14da640 1 Processor -- start 2023-12-12T09:47:26.126 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:26.125+0000 7f2de14da640 1 -- start start 2023-12-12T09:47:26.128 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:26.126+0000 7f2de14da640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f2ddc0a4f00 0x7f2ddc151ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:26.128 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:26.126+0000 7f2de14da640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f2ddc0c14f0 0x7f2ddc0c1920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:26.128 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:26.126+0000 7f2de14da640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ddc0c04c0 con 0x7f2ddc0c3920 2023-12-12T09:47:26.128 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:26.126+0000 7f2de14da640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ddc0c58c0 con 0x7f2ddc0c14f0 2023-12-12T09:47:26.128 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:26.126+0000 7f2de14da640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ddc152220 con 0x7f2ddc0a4f00 2023-12-12T09:47:26.128 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:26.126+0000 7f2ddb7fe640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f2ddc0c14f0 0x7f2ddc0c1920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:26.128 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:26.126+0000 7f2dda7fc640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f2ddc0c3920 0x7f2ddc14e480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:48674/0 (socket says 172.21.15.73:48674) 2023-12-12T09:47:26.128 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:26.126+0000 7f2dda7fc640 1 -- 172.21.15.73:0/420912916 learned_addr learned my addr 172.21.15.73:0/420912916 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-12T09:47:26.129 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:26.127+0000 7f2ddaffd640 1 --2- 172.21.15.73:0/420912916 >> v2:172.21.15.142:3300/0 conn(0x7f2ddc0a4f00 0x7f2ddc151ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:26.129 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:26.127+0000 7f2ddb7fe640 1 -- 172.21.15.73:0/420912916 >> v2:172.21.15.142:3300/0 conn(0x7f2ddc0a4f00 msgr2=0x7f2ddc151ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:47:26.129 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:26.127+0000 7f2ddb7fe640 1 --2- 172.21.15.73:0/420912916 >> v2:172.21.15.142:3300/0 conn(0x7f2ddc0a4f00 0x7f2ddc151ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:26.129 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:26.127+0000 7f2ddb7fe640 1 -- 172.21.15.73:0/420912916 >> v1:172.21.15.73:6789/0 conn(0x7f2ddc0c3920 legacy=0x7f2ddc14e480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:26.129 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:26.127+0000 7f2ddb7fe640 1 -- 172.21.15.73:0/420912916 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ddc0c0730 con 0x7f2ddc0c14f0 2023-12-12T09:47:26.129 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:26.127+0000 7f2dd9ffb640 1 -- 172.21.15.73:0/420912916 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1428014778 0 0) 0x7f2ddc0c04c0 con 0x7f2ddc0c3920 2023-12-12T09:47:26.129 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:26.127+0000 7f2ddaffd640 1 --2- 172.21.15.73:0/420912916 >> v2:172.21.15.142:3300/0 conn(0x7f2ddc0a4f00 0x7f2ddc151ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:47:26.130 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:26.128+0000 7f2ddb7fe640 1 --2- 172.21.15.73:0/420912916 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2ddc0c14f0 0x7f2ddc0c1920 secure :-1 s=READY pgs=1119 cs=0 l=1 rev1=1 crypto rx=0x7f2ddc0a5710 tx=0x7f2dd402b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f410f65c3afc58ba server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:47:26.130 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:26.128+0000 7f2dd9ffb640 1 -- 172.21.15.73:0/420912916 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dd402e070 con 0x7f2ddc0c14f0 2023-12-12T09:47:26.131 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:26.128+0000 7f2dd9ffb640 1 -- 172.21.15.73:0/420912916 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2dd40315a0 con 0x7f2ddc0c14f0 2023-12-12T09:47:26.131 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:26.128+0000 7f2dd9ffb640 1 -- 172.21.15.73:0/420912916 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dd4031930 con 0x7f2ddc0c14f0 2023-12-12T09:47:26.131 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:26.129+0000 7f2de14da640 1 -- 172.21.15.73:0/420912916 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2ddc0c14f0 msgr2=0x7f2ddc0c1920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:26.131 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:26.129+0000 7f2de14da640 1 --2- 172.21.15.73:0/420912916 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2ddc0c14f0 0x7f2ddc0c1920 secure :-1 s=READY pgs=1119 cs=0 l=1 rev1=1 crypto rx=0x7f2ddc0a5710 tx=0x7f2dd402b840 comp rx=0 tx=0).stop 2023-12-12T09:47:26.131 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:26.129+0000 7f2de14da640 1 -- 172.21.15.73:0/420912916 shutdown_connections 2023-12-12T09:47:26.131 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:26.129+0000 7f2de14da640 1 --2- 172.21.15.73:0/420912916 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2ddc0c14f0 0x7f2ddc0c1920 unknown :-1 s=CLOSED pgs=1119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:26.131 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:26.129+0000 7f2de14da640 1 --2- 172.21.15.73:0/420912916 >> v2:172.21.15.142:3300/0 conn(0x7f2ddc0a4f00 0x7f2ddc151ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:26.131 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:26.129+0000 7f2de14da640 1 -- 172.21.15.73:0/420912916 >> 172.21.15.73:0/420912916 conn(0x7f2ddc0a77d0 msgr2=0x7f2ddc0a7bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:47:26.131 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:26.129+0000 7f2de14da640 1 -- 172.21.15.73:0/420912916 shutdown_connections 2023-12-12T09:47:26.131 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:26.129+0000 7f2de14da640 1 -- 172.21.15.73:0/420912916 wait complete. 2023-12-12T09:47:26.132 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:26.131+0000 7f2de14da640 1 Processor -- start 2023-12-12T09:47:26.132 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:26.131+0000 7f2de14da640 1 -- start start 2023-12-12T09:47:26.133 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:26.132+0000 7f2de14da640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2ddc0a4f00 0x7f2ddc146c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:26.133 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:26.132+0000 7f2de14da640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2ddc0c14f0 0x7f2ddc142d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:26.133 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:26.132+0000 7f2de14da640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2ddc0c3920 0x7f2ddc1432a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:26.134 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:26.132+0000 7f2de14da640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ddc0a54f0 con 0x7f2ddc0a4f00 2023-12-12T09:47:26.134 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:26.132+0000 7f2de14da640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ddc0bf7b0 con 0x7f2ddc0c14f0 2023-12-12T09:47:26.134 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:26.132+0000 7f2de14da640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ddc1437e0 con 0x7f2ddc0c3920 2023-12-12T09:47:26.134 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:26.132+0000 7f2ddaffd640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2ddc0a4f00 0x7f2ddc146c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:26.134 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:26.132+0000 7f2ddaffd640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2ddc0a4f00 0x7f2ddc146c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:42852/0 (socket says 172.21.15.73:42852) 2023-12-12T09:47:26.134 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:26.132+0000 7f2ddaffd640 1 -- 172.21.15.73:0/1476098166 learned_addr learned my addr 172.21.15.73:0/1476098166 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:47:26.135 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:26.132+0000 7f2dda7fc640 1 --2- 172.21.15.73:0/1476098166 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2ddc0c14f0 0x7f2ddc142d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:26.135 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:26.132+0000 7f2ddaffd640 1 -- 172.21.15.73:0/1476098166 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2ddc0c3920 msgr2=0x7f2ddc1432a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:26.135 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:26.132+0000 7f2ddaffd640 1 --2- 172.21.15.73:0/1476098166 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2ddc0c3920 0x7f2ddc1432a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:26.135 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:26.132+0000 7f2ddaffd640 1 -- 172.21.15.73:0/1476098166 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2ddc0c14f0 msgr2=0x7f2ddc142d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:26.135 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:26.132+0000 7f2ddaffd640 1 --2- 172.21.15.73:0/1476098166 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2ddc0c14f0 0x7f2ddc142d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:26.136 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:26.132+0000 7f2ddaffd640 1 -- 172.21.15.73:0/1476098166 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2dd4009400 con 0x7f2ddc0a4f00 2023-12-12T09:47:26.136 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:26.133+0000 7f2ddaffd640 1 --2- 172.21.15.73:0/1476098166 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2ddc0a4f00 0x7f2ddc146c90 secure :-1 s=READY pgs=1120 cs=0 l=1 rev1=1 crypto rx=0x7f2dcc00cf60 tx=0x7f2dcc00cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:47:26.136 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:26.133+0000 7f2dd37fe640 1 -- 172.21.15.73:0/1476098166 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dcc00d840 con 0x7f2ddc0a4f00 2023-12-12T09:47:26.136 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:26.133+0000 7f2dd37fe640 1 -- 172.21.15.73:0/1476098166 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2dcc00d9a0 con 0x7f2ddc0a4f00 2023-12-12T09:47:26.136 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:26.133+0000 7f2dd37fe640 1 -- 172.21.15.73:0/1476098166 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dcc00dd30 con 0x7f2ddc0a4f00 2023-12-12T09:47:26.136 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:26.133+0000 7f2de14da640 1 -- 172.21.15.73:0/1476098166 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ddc1edd40 con 0x7f2ddc0a4f00 2023-12-12T09:47:26.136 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:26.133+0000 7f2de14da640 1 -- 172.21.15.73:0/1476098166 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ddc0bff60 con 0x7f2ddc0a4f00 2023-12-12T09:47:26.136 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:26.134+0000 7f2de14da640 1 -- 172.21.15.73:0/1476098166 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ddc070140 con 0x7f2ddc0a4f00 2023-12-12T09:47:26.137 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:26.135+0000 7f2dd37fe640 1 -- 172.21.15.73:0/1476098166 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f2dcc015440 con 0x7f2ddc0a4f00 2023-12-12T09:47:26.137 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:26.136+0000 7f2dd37fe640 1 --2- 172.21.15.73:0/1476098166 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f2dbc06ae40 0x7f2dbc06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:26.137 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:26.136+0000 7f2dd37fe640 1 -- 172.21.15.73:0/1476098166 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 5799+0+0 (secure 0 0 0) 0x7f2dcc089f40 con 0x7f2ddc0a4f00 2023-12-12T09:47:26.138 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:26.136+0000 7f2dda7fc640 1 --2- 172.21.15.73:0/1476098166 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f2dbc06ae40 0x7f2dbc06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:26.138 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:26.137+0000 7f2dda7fc640 1 --2- 172.21.15.73:0/1476098166 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f2dbc06ae40 0x7f2dbc06d300 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f2ddc1e7c50 tx=0x7f2dc4009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:47:26.142 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:26.141+0000 7f2dd37fe640 1 -- 172.21.15.73:0/1476098166 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f2dcc0550d0 con 0x7f2ddc0a4f00 2023-12-12T09:47:26.372 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:26.370+0000 7f2de14da640 1 -- 172.21.15.73:0/1476098166 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs2"} v 0) v1 -- 0x7f2ddc0ab8e0 con 0x7f2ddc0a4f00 2023-12-12T09:47:26.373 INFO:tasks.ceph.mon.a.smithi073.stderr:2023-12-12T09:47:26.372+0000 7f81027f3640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-12-12T09:47:26.378 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:26.375+0000 7f2dd37fe640 1 -- 172.21.15.73:0/1476098166 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs2"}]=0 cephfs2 marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v52) v1 ==== 163+0+0 (secure 0 0 0) 0x7f2dcc01a090 con 0x7f2ddc0a4f00 2023-12-12T09:47:26.378 INFO:teuthology.orchestra.run.smithi073.stderr:cephfs2 marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-12-12T09:47:26.380 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:26.378+0000 7f2de14da640 1 -- 172.21.15.73:0/1476098166 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f2dbc06ae40 msgr2=0x7f2dbc06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:26.381 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:26.378+0000 7f2de14da640 1 --2- 172.21.15.73:0/1476098166 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f2dbc06ae40 0x7f2dbc06d300 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f2ddc1e7c50 tx=0x7f2dc4009040 comp rx=0 tx=0).stop 2023-12-12T09:47:26.381 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:26.378+0000 7f2de14da640 1 -- 172.21.15.73:0/1476098166 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2ddc0a4f00 msgr2=0x7f2ddc146c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:26.381 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:26.378+0000 7f2de14da640 1 --2- 172.21.15.73:0/1476098166 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2ddc0a4f00 0x7f2ddc146c90 secure :-1 s=READY pgs=1120 cs=0 l=1 rev1=1 crypto rx=0x7f2dcc00cf60 tx=0x7f2dcc00cf90 comp rx=0 tx=0).stop 2023-12-12T09:47:26.381 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:26.378+0000 7f2de14da640 1 -- 172.21.15.73:0/1476098166 shutdown_connections 2023-12-12T09:47:26.381 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:26.378+0000 7f2de14da640 1 --2- 172.21.15.73:0/1476098166 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f2dbc06ae40 0x7f2dbc06d300 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:26.381 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:26.378+0000 7f2de14da640 1 --2- 172.21.15.73:0/1476098166 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2ddc0c3920 0x7f2ddc1432a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:26.382 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:26.378+0000 7f2de14da640 1 --2- 172.21.15.73:0/1476098166 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2ddc0c14f0 0x7f2ddc142d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:26.382 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:26.378+0000 7f2de14da640 1 --2- 172.21.15.73:0/1476098166 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2ddc0a4f00 0x7f2ddc146c90 secure :-1 s=CLOSED pgs=1120 cs=0 l=1 rev1=1 crypto rx=0x7f2dcc00cf60 tx=0x7f2dcc00cf90 comp rx=0 tx=0).stop 2023-12-12T09:47:26.382 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:26.378+0000 7f2de14da640 1 -- 172.21.15.73:0/1476098166 >> 172.21.15.73:0/1476098166 conn(0x7f2ddc0a77d0 msgr2=0x7f2ddc148240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:47:26.383 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:26.379+0000 7f2de14da640 1 -- 172.21.15.73:0/1476098166 shutdown_connections 2023-12-12T09:47:26.383 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:26.379+0000 7f2de14da640 1 -- 172.21.15.73:0/1476098166 wait complete. 2023-12-12T09:47:26.402 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs2 --yes-i-really-mean-it 2023-12-12T09:47:26.455 INFO:tasks.ceph.mds.a.smithi073.stdout:starting mds.a at 2023-12-12T09:47:26.592 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:26.590+0000 7f9baf4bb640 1 Processor -- start 2023-12-12T09:47:26.593 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:26.591+0000 7f9baf4bb640 1 -- start start 2023-12-12T09:47:26.594 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:26.592+0000 7f9baf4bb640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f9ba8151c30 0x7f9ba806d440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:26.594 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:26.592+0000 7f9baf4bb640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f9ba80c3930 0x7f9ba8157bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:26.594 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:26.592+0000 7f9baf4bb640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ba80a4f50 con 0x7f9ba80bed50 2023-12-12T09:47:26.594 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:26.592+0000 7f9baf4bb640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ba80a54d0 con 0x7f9ba8151c30 2023-12-12T09:47:26.594 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:26.592+0000 7f9baf4bb640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ba8155260 con 0x7f9ba80c3930 2023-12-12T09:47:26.594 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:26.592+0000 7f9bad257640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f9ba8151c30 0x7f9ba806d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:26.594 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:26.592+0000 7f9bad257640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f9ba8151c30 0x7f9ba806d440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:42886/0 (socket says 172.21.15.73:42886) 2023-12-12T09:47:26.594 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:26.592+0000 7f9bad257640 1 -- 172.21.15.73:0/3453905056 learned_addr learned my addr 172.21.15.73:0/3453905056 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:47:26.595 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:26.593+0000 7f9baca56640 1 --2- 172.21.15.73:0/3453905056 >> v2:172.21.15.142:3300/0 conn(0x7f9ba80c3930 0x7f9ba8157bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:26.595 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:26.593+0000 7f9bad257640 1 -- 172.21.15.73:0/3453905056 >> v2:172.21.15.142:3300/0 conn(0x7f9ba80c3930 msgr2=0x7f9ba8157bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:47:26.595 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:26.593+0000 7f9bad257640 1 --2- 172.21.15.73:0/3453905056 >> v2:172.21.15.142:3300/0 conn(0x7f9ba80c3930 0x7f9ba8157bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:26.595 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:26.593+0000 7f9bad257640 1 -- 172.21.15.73:0/3453905056 >> v1:172.21.15.142:6789/0 conn(0x7f9ba80bed50 legacy=0x7f9ba80bf160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:47:26.595 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:26.593+0000 7f9bad257640 1 -- 172.21.15.73:0/3453905056 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ba80a51f0 con 0x7f9ba8151c30 2023-12-12T09:47:26.596 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:26.594+0000 7f9bad257640 1 --2- 172.21.15.73:0/3453905056 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9ba8151c30 0x7f9ba806d440 secure :-1 s=READY pgs=1124 cs=0 l=1 rev1=1 crypto rx=0x7f9ba806f730 tx=0x7f9ba402b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93293b4223404992 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:47:26.596 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:26.595+0000 7f9b9ffff640 1 -- 172.21.15.73:0/3453905056 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ba40317e0 con 0x7f9ba8151c30 2023-12-12T09:47:26.596 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:26.595+0000 7f9b9ffff640 1 -- 172.21.15.73:0/3453905056 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ba4031940 con 0x7f9ba8151c30 2023-12-12T09:47:26.596 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:26.595+0000 7f9b9ffff640 1 -- 172.21.15.73:0/3453905056 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ba4031cd0 con 0x7f9ba8151c30 2023-12-12T09:47:26.597 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:26.595+0000 7f9baf4bb640 1 -- 172.21.15.73:0/3453905056 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9ba8151c30 msgr2=0x7f9ba806d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:26.597 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:26.595+0000 7f9baf4bb640 1 --2- 172.21.15.73:0/3453905056 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9ba8151c30 0x7f9ba806d440 secure :-1 s=READY pgs=1124 cs=0 l=1 rev1=1 crypto rx=0x7f9ba806f730 tx=0x7f9ba402b880 comp rx=0 tx=0).stop 2023-12-12T09:47:26.598 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:26.595+0000 7f9baf4bb640 1 -- 172.21.15.73:0/3453905056 shutdown_connections 2023-12-12T09:47:26.598 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:26.595+0000 7f9baf4bb640 1 --2- 172.21.15.73:0/3453905056 >> v2:172.21.15.142:3300/0 conn(0x7f9ba80c3930 0x7f9ba8157bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:26.598 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:26.595+0000 7f9baf4bb640 1 --2- 172.21.15.73:0/3453905056 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9ba8151c30 0x7f9ba806d440 unknown :-1 s=CLOSED pgs=1124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:26.598 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:26.595+0000 7f9baf4bb640 1 -- 172.21.15.73:0/3453905056 >> 172.21.15.73:0/3453905056 conn(0x7f9ba806a4e0 msgr2=0x7f9ba806a8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:47:26.598 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:26.595+0000 7f9baf4bb640 1 -- 172.21.15.73:0/3453905056 shutdown_connections 2023-12-12T09:47:26.598 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:26.596+0000 7f9baf4bb640 1 -- 172.21.15.73:0/3453905056 wait complete. 2023-12-12T09:47:26.599 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:26.597+0000 7f9baf4bb640 1 Processor -- start 2023-12-12T09:47:26.599 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:26.597+0000 7f9baf4bb640 1 -- start start 2023-12-12T09:47:26.601 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:26.598+0000 7f9baf4bb640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9ba80bed50 0x7f9ba8146b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:26.601 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:26.598+0000 7f9baf4bb640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9ba80c3930 0x7f9ba8144750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:26.601 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:26.598+0000 7f9baf4bb640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9ba8151c30 0x7f9ba81e9e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:26.601 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:26.598+0000 7f9baf4bb640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ba81503b0 con 0x7f9ba80c3930 2023-12-12T09:47:26.601 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:26.598+0000 7f9baf4bb640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ba814fcb0 con 0x7f9ba8151c30 2023-12-12T09:47:26.602 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:26.598+0000 7f9baf4bb640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ba81576f0 con 0x7f9ba80bed50 2023-12-12T09:47:26.602 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:26.599+0000 7f9baca56640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9ba80c3930 0x7f9ba8144750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:26.602 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:26.599+0000 7f9baca56640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9ba80c3930 0x7f9ba8144750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:42890/0 (socket says 172.21.15.73:42890) 2023-12-12T09:47:26.602 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:26.599+0000 7f9baca56640 1 -- 172.21.15.73:0/244557719 learned_addr learned my addr 172.21.15.73:0/244557719 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:47:26.602 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:26.599+0000 7f9bad257640 1 --2- 172.21.15.73:0/244557719 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9ba80bed50 0x7f9ba8146b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:26.602 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:26.599+0000 7f9baca56640 1 -- 172.21.15.73:0/244557719 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9ba80bed50 msgr2=0x7f9ba8146b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:26.602 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:26.599+0000 7f9baca56640 1 --2- 172.21.15.73:0/244557719 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9ba80bed50 0x7f9ba8146b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:26.602 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:26.599+0000 7f9bada58640 1 --2- 172.21.15.73:0/244557719 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9ba8151c30 0x7f9ba81e9e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:26.602 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:26.599+0000 7f9baca56640 1 -- 172.21.15.73:0/244557719 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9ba8151c30 msgr2=0x7f9ba81e9e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:26.602 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:26.599+0000 7f9baca56640 1 --2- 172.21.15.73:0/244557719 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9ba8151c30 0x7f9ba81e9e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:26.602 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:26.599+0000 7f9baca56640 1 -- 172.21.15.73:0/244557719 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ba40094d0 con 0x7f9ba80c3930 2023-12-12T09:47:26.602 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:26.599+0000 7f9bada58640 1 --2- 172.21.15.73:0/244557719 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9ba8151c30 0x7f9ba81e9e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:47:26.603 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:26.600+0000 7f9baca56640 1 --2- 172.21.15.73:0/244557719 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9ba80c3930 0x7f9ba8144750 secure :-1 s=READY pgs=1125 cs=0 l=1 rev1=1 crypto rx=0x7f9b9800d830 tx=0x7f9b9800dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:47:26.603 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:26.600+0000 7f9b9dffb640 1 -- 172.21.15.73:0/244557719 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b9800b6c0 con 0x7f9ba80c3930 2023-12-12T09:47:26.603 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:26.600+0000 7f9b9dffb640 1 -- 172.21.15.73:0/244557719 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b9800b820 con 0x7f9ba80c3930 2023-12-12T09:47:26.603 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:26.600+0000 7f9baf4bb640 1 -- 172.21.15.73:0/244557719 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ba814f450 con 0x7f9ba80c3930 2023-12-12T09:47:26.603 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:26.600+0000 7f9b9dffb640 1 -- 172.21.15.73:0/244557719 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b9800bbb0 con 0x7f9ba80c3930 2023-12-12T09:47:26.603 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:26.600+0000 7f9baf4bb640 1 -- 172.21.15.73:0/244557719 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ba81ee290 con 0x7f9ba80c3930 2023-12-12T09:47:26.604 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:26.601+0000 7f9baf4bb640 1 -- 172.21.15.73:0/244557719 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ba8067070 con 0x7f9ba80c3930 2023-12-12T09:47:26.604 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:26.602+0000 7f9b9dffb640 1 -- 172.21.15.73:0/244557719 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f9b9801e460 con 0x7f9ba80c3930 2023-12-12T09:47:26.605 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:26.603+0000 7f9b9dffb640 1 --2- 172.21.15.73:0/244557719 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f9b8c06ae40 0x7f9b8c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:26.605 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:26.603+0000 7f9b9dffb640 1 -- 172.21.15.73:0/244557719 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 5885+0+0 (secure 0 0 0) 0x7f9b98089dc0 con 0x7f9ba80c3930 2023-12-12T09:47:26.605 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:26.603+0000 7f9bad257640 1 --2- 172.21.15.73:0/244557719 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f9b8c06ae40 0x7f9b8c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:26.605 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:26.604+0000 7f9bad257640 1 --2- 172.21.15.73:0/244557719 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f9b8c06ae40 0x7f9b8c06d300 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f9ba4036000 tx=0x7f9ba403d040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:47:26.610 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:26.608+0000 7f9b9dffb640 1 -- 172.21.15.73:0/244557719 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f9b98054e50 con 0x7f9ba80c3930 2023-12-12T09:47:26.834 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:26.832+0000 7f9baf4bb640 1 -- 172.21.15.73:0/244557719 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs2", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f9ba8067580 con 0x7f9ba80c3930 2023-12-12T09:47:27.381 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:27.379+0000 7f9b9dffb640 1 -- 172.21.15.73:0/244557719 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs2", "yes_i_really_mean_it": true}]=0 v53) v1 ==== 105+0+0 (secure 0 0 0) 0x7f9b98058470 con 0x7f9ba80c3930 2023-12-12T09:47:27.385 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:27.383+0000 7f9baf4bb640 1 -- 172.21.15.73:0/244557719 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f9b8c06ae40 msgr2=0x7f9b8c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:27.385 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:27.383+0000 7f9baf4bb640 1 --2- 172.21.15.73:0/244557719 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f9b8c06ae40 0x7f9b8c06d300 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f9ba4036000 tx=0x7f9ba403d040 comp rx=0 tx=0).stop 2023-12-12T09:47:27.385 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:27.383+0000 7f9baf4bb640 1 -- 172.21.15.73:0/244557719 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9ba80c3930 msgr2=0x7f9ba8144750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:27.385 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:27.383+0000 7f9baf4bb640 1 --2- 172.21.15.73:0/244557719 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9ba80c3930 0x7f9ba8144750 secure :-1 s=READY pgs=1125 cs=0 l=1 rev1=1 crypto rx=0x7f9b9800d830 tx=0x7f9b9800dcf0 comp rx=0 tx=0).stop 2023-12-12T09:47:27.385 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:27.383+0000 7f9baf4bb640 1 -- 172.21.15.73:0/244557719 shutdown_connections 2023-12-12T09:47:27.385 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:27.383+0000 7f9baf4bb640 1 --2- 172.21.15.73:0/244557719 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f9b8c06ae40 0x7f9b8c06d300 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:27.385 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:27.383+0000 7f9baf4bb640 1 --2- 172.21.15.73:0/244557719 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9ba8151c30 0x7f9ba81e9e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:27.385 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:27.383+0000 7f9baf4bb640 1 --2- 172.21.15.73:0/244557719 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9ba80c3930 0x7f9ba8144750 unknown :-1 s=CLOSED pgs=1125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:27.385 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:27.383+0000 7f9baf4bb640 1 --2- 172.21.15.73:0/244557719 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9ba80bed50 0x7f9ba8146b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:27.386 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:27.383+0000 7f9baf4bb640 1 -- 172.21.15.73:0/244557719 >> 172.21.15.73:0/244557719 conn(0x7f9ba806a4e0 msgr2=0x7f9ba8154680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:47:27.386 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:27.383+0000 7f9baf4bb640 1 -- 172.21.15.73:0/244557719 shutdown_connections 2023-12-12T09:47:27.386 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:27.383+0000 7f9baf4bb640 1 -- 172.21.15.73:0/244557719 wait complete. 2023-12-12T09:47:27.405 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs2_metadata cephfs2_metadata --yes-i-really-really-mean-it 2023-12-12T09:47:27.624 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:27.622+0000 7f18a666b640 1 Processor -- start 2023-12-12T09:47:27.624 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:27.623+0000 7f18a666b640 1 -- start start 2023-12-12T09:47:27.630 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:27.624+0000 7f18a666b640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f18a014f8c0 0x7f18a006dc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:27.630 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:27.624+0000 7f18a666b640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18a00c16c0 con 0x7f18a0152500 2023-12-12T09:47:27.631 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:27.624+0000 7f18a666b640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18a00c19a0 con 0x7f18a006d350 2023-12-12T09:47:27.631 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:27.624+0000 7f18a666b640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18a00c1090 con 0x7f18a014f8c0 2023-12-12T09:47:27.631 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:27.624+0000 7f18a4c08640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f18a0152500 0x7f18a0152990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:48686/0 (socket says 172.21.15.73:48686) 2023-12-12T09:47:27.631 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:27.624+0000 7f18a4c08640 1 -- 172.21.15.73:0/3867968190 learned_addr learned my addr 172.21.15.73:0/3867968190 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-12T09:47:27.631 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:27.625+0000 7f189f7fe640 1 -- 172.21.15.73:0/3867968190 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4159329607 0 0) 0x7f18a00c16c0 con 0x7f18a0152500 2023-12-12T09:47:27.631 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:27.625+0000 7f189f7fe640 1 -- 172.21.15.73:0/3867968190 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f188c003520 con 0x7f18a0152500 2023-12-12T09:47:27.631 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:27.625+0000 7f189ffff640 1 --2- 172.21.15.73:0/3867968190 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f18a014f8c0 0x7f18a006dc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:27.631 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:27.625+0000 7f189f7fe640 1 -- 172.21.15.73:0/3867968190 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2842120549 0 0) 0x7f188c003520 con 0x7f18a0152500 2023-12-12T09:47:27.631 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:27.625+0000 7f189f7fe640 1 -- 172.21.15.73:0/3867968190 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f18a014f8c0 msgr2=0x7f18a006dc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:47:27.631 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:27.625+0000 7f189f7fe640 1 --2- 172.21.15.73:0/3867968190 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f18a014f8c0 0x7f18a006dc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:27.632 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:27.625+0000 7f189f7fe640 1 -- 172.21.15.73:0/3867968190 >> v1:172.21.15.142:6789/0 conn(0x7f18a006d350 legacy=0x7f18a0071e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:27.632 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:27.625+0000 7f189f7fe640 1 -- 172.21.15.73:0/3867968190 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18a00c1c80 con 0x7f18a0152500 2023-12-12T09:47:27.632 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:27.625+0000 7f189f7fe640 1 -- 172.21.15.73:0/3867968190 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3186547832 0 0) 0x7f18980019f0 con 0x7f18a0152500 2023-12-12T09:47:27.632 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:27.625+0000 7f189f7fe640 1 -- 172.21.15.73:0/3867968190 >> v1:172.21.15.73:6789/0 conn(0x7f18a0152500 legacy=0x7f18a0152990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:27.632 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:27.625+0000 7f189f7fe640 1 --2- 172.21.15.73:0/3867968190 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f188c0039a0 0x7f188c003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:27.632 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:27.625+0000 7f189f7fe640 1 --2- 172.21.15.73:0/3867968190 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f188c0047c0 0x7f188c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:27.632 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:27.625+0000 7f189f7fe640 1 --2- 172.21.15.73:0/3867968190 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f18a014f8c0 0x7f188c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:27.632 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:27.625+0000 7f189f7fe640 1 -- 172.21.15.73:0/3867968190 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f188c00ba80 con 0x7f188c0047c0 2023-12-12T09:47:27.632 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:27.625+0000 7f189f7fe640 1 -- 172.21.15.73:0/3867968190 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f188c00bbf0 con 0x7f188c0039a0 2023-12-12T09:47:27.632 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:27.625+0000 7f189f7fe640 1 -- 172.21.15.73:0/3867968190 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f188c00bdb0 con 0x7f18a014f8c0 2023-12-12T09:47:27.633 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:27.625+0000 7f1897fff640 1 --2- 172.21.15.73:0/3867968190 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f188c0047c0 0x7f188c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:27.633 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:27.626+0000 7f189ffff640 1 --2- 172.21.15.73:0/3867968190 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f188c0039a0 0x7f188c003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:27.633 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:27.626+0000 7f1897fff640 1 -- 172.21.15.73:0/3867968190 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f18a014f8c0 msgr2=0x7f188c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:47:27.633 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:27.626+0000 7f1897fff640 1 --2- 172.21.15.73:0/3867968190 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f18a014f8c0 0x7f188c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:27.633 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:27.626+0000 7f1897fff640 1 -- 172.21.15.73:0/3867968190 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f188c0039a0 msgr2=0x7f188c003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:47:27.633 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:27.626+0000 7f1897fff640 1 --2- 172.21.15.73:0/3867968190 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f188c0039a0 0x7f188c003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:27.633 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:27.626+0000 7f1897fff640 1 -- 172.21.15.73:0/3867968190 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f188c003520 con 0x7f188c0047c0 2023-12-12T09:47:27.633 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:27.627+0000 7f1897fff640 1 --2- 172.21.15.73:0/3867968190 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f188c0047c0 0x7f188c004c40 secure :-1 s=READY pgs=1127 cs=0 l=1 rev1=1 crypto rx=0x7f1888001750 tx=0x7f188c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e691e1f34cd44dd server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:47:27.633 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:27.627+0000 7f189f7fe640 1 -- 172.21.15.73:0/3867968190 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18880052d0 con 0x7f188c0047c0 2023-12-12T09:47:27.633 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:27.627+0000 7f189f7fe640 1 -- 172.21.15.73:0/3867968190 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f188802e050 con 0x7f188c0047c0 2023-12-12T09:47:27.634 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:27.627+0000 7f189f7fe640 1 -- 172.21.15.73:0/3867968190 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18880035f0 con 0x7f188c0047c0 2023-12-12T09:47:27.634 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:27.628+0000 7f18a666b640 1 -- 172.21.15.73:0/3867968190 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f188c0047c0 msgr2=0x7f188c004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:27.634 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:27.628+0000 7f18a666b640 1 --2- 172.21.15.73:0/3867968190 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f188c0047c0 0x7f188c004c40 secure :-1 s=READY pgs=1127 cs=0 l=1 rev1=1 crypto rx=0x7f1888001750 tx=0x7f188c0057f0 comp rx=0 tx=0).stop 2023-12-12T09:47:27.634 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:27.628+0000 7f18a4c08640 1 -- 172.21.15.73:0/3867968190 reap_dead start 2023-12-12T09:47:27.634 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:27.628+0000 7f18a666b640 1 -- 172.21.15.73:0/3867968190 shutdown_connections 2023-12-12T09:47:27.635 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:27.628+0000 7f18a666b640 1 -- 172.21.15.73:0/3867968190 >> 172.21.15.73:0/3867968190 conn(0x7f18a006a4e0 msgr2=0x7f18a006a8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:47:27.635 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:27.628+0000 7f18a666b640 1 -- 172.21.15.73:0/3867968190 shutdown_connections 2023-12-12T09:47:27.635 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:27.628+0000 7f18a666b640 1 -- 172.21.15.73:0/3867968190 wait complete. 2023-12-12T09:47:27.639 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:27.630+0000 7f18a666b640 1 Processor -- start 2023-12-12T09:47:27.639 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:27.630+0000 7f18a666b640 1 -- start start 2023-12-12T09:47:27.639 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:27.631+0000 7f18a666b640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f188c0047c0 0x7f18a00a5cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:27.639 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:27.631+0000 7f18a666b640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f18a00a6a20 0x7f18a01e8320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:27.639 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:27.631+0000 7f18a666b640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f18a014af20 0x7f18a0154970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:27.639 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:27.631+0000 7f18a666b640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18a00a5830 con 0x7f18a00a6a20 2023-12-12T09:47:27.639 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:27.631+0000 7f18a666b640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18a00a6ea0 con 0x7f18a014af20 2023-12-12T09:47:27.639 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:27.631+0000 7f18a666b640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18a00a7120 con 0x7f188c0047c0 2023-12-12T09:47:27.639 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:27.631+0000 7f1897fff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f18a00a6a20 0x7f18a01e8320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:27.639 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:27.631+0000 7f1897fff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f18a00a6a20 0x7f18a01e8320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:42908/0 (socket says 172.21.15.73:42908) 2023-12-12T09:47:27.640 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:27.631+0000 7f1897fff640 1 -- 172.21.15.73:0/859523725 learned_addr learned my addr 172.21.15.73:0/859523725 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:47:27.640 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:27.631+0000 7f189ffff640 1 --2- 172.21.15.73:0/859523725 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f188c0047c0 0x7f18a00a5cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:27.640 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:27.631+0000 7f1897fff640 1 -- 172.21.15.73:0/859523725 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f188c0047c0 msgr2=0x7f18a00a5cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:27.640 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:27.631+0000 7f1897fff640 1 --2- 172.21.15.73:0/859523725 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f188c0047c0 0x7f18a00a5cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:27.640 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:27.631+0000 7f1897fff640 1 -- 172.21.15.73:0/859523725 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f18a014af20 msgr2=0x7f18a0154970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:27.640 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:27.631+0000 7f18a4c08640 1 --2- 172.21.15.73:0/859523725 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f18a014af20 0x7f18a0154970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:27.640 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:27.631+0000 7f1897fff640 1 --2- 172.21.15.73:0/859523725 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f18a014af20 0x7f18a0154970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:27.640 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:27.631+0000 7f1897fff640 1 -- 172.21.15.73:0/859523725 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18a00a51e0 con 0x7f18a00a6a20 2023-12-12T09:47:27.641 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:27.632+0000 7f1897fff640 1 --2- 172.21.15.73:0/859523725 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f18a00a6a20 0x7f18a01e8320 secure :-1 s=READY pgs=1128 cs=0 l=1 rev1=1 crypto rx=0x7f1888005040 tx=0x7f1888001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:47:27.641 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:27.632+0000 7f189d7fa640 1 -- 172.21.15.73:0/859523725 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18880076c0 con 0x7f18a00a6a20 2023-12-12T09:47:27.641 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:27.632+0000 7f189d7fa640 1 -- 172.21.15.73:0/859523725 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1888007a30 con 0x7f18a00a6a20 2023-12-12T09:47:27.641 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:27.632+0000 7f189d7fa640 1 -- 172.21.15.73:0/859523725 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1888006be0 con 0x7f18a00a6a20 2023-12-12T09:47:27.641 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:27.632+0000 7f18a666b640 1 -- 172.21.15.73:0/859523725 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18a00a54c0 con 0x7f18a00a6a20 2023-12-12T09:47:27.641 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:27.632+0000 7f18a666b640 1 -- 172.21.15.73:0/859523725 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18a014b3a0 con 0x7f18a00a6a20 2023-12-12T09:47:27.641 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:27.633+0000 7f18a666b640 1 -- 172.21.15.73:0/859523725 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18a00a59e0 con 0x7f18a00a6a20 2023-12-12T09:47:27.642 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:27.634+0000 7f189d7fa640 1 -- 172.21.15.73:0/859523725 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f1888006d40 con 0x7f18a00a6a20 2023-12-12T09:47:27.642 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:27.635+0000 7f189d7fa640 1 --2- 172.21.15.73:0/859523725 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f188006ae70 0x7f188006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:27.642 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:27.635+0000 7f189d7fa640 1 -- 172.21.15.73:0/859523725 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 5885+0+0 (secure 0 0 0) 0x7f18880ab410 con 0x7f18a00a6a20 2023-12-12T09:47:27.642 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:27.635+0000 7f189ffff640 1 --2- 172.21.15.73:0/859523725 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f188006ae70 0x7f188006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:27.642 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:27.636+0000 7f189ffff640 1 --2- 172.21.15.73:0/859523725 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f188006ae70 0x7f188006d330 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f1890006fd0 tx=0x7f1890008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:47:27.643 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:27.640+0000 7f189d7fa640 1 -- 172.21.15.73:0/859523725 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f18a00a59e0 con 0x7f18a00a6a20 2023-12-12T09:47:27.838 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:27.837+0000 7f18a666b640 1 -- 172.21.15.73:0/859523725 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs2_metadata", "pool2": "cephfs2_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f18a00a59e0 con 0x7f18a00a6a20 2023-12-12T09:47:28.843 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:28.841+0000 7f189d7fa640 1 -- 172.21.15.73:0/859523725 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs2_metadata", "pool2": "cephfs2_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs2_metadata' removed v86) v1 ==== 184+0+0 (secure 0 0 0) 0x7f18a00a59e0 con 0x7f18a00a6a20 2023-12-12T09:47:28.843 INFO:teuthology.orchestra.run.smithi073.stderr:pool 'cephfs2_metadata' removed 2023-12-12T09:47:28.847 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:28.845+0000 7f18a666b640 1 -- 172.21.15.73:0/859523725 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f188006ae70 msgr2=0x7f188006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:28.848 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:28.845+0000 7f18a666b640 1 --2- 172.21.15.73:0/859523725 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f188006ae70 0x7f188006d330 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f1890006fd0 tx=0x7f1890008040 comp rx=0 tx=0).stop 2023-12-12T09:47:28.848 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:28.845+0000 7f18a666b640 1 -- 172.21.15.73:0/859523725 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f18a00a6a20 msgr2=0x7f18a01e8320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:28.848 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:28.845+0000 7f18a666b640 1 --2- 172.21.15.73:0/859523725 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f18a00a6a20 0x7f18a01e8320 secure :-1 s=READY pgs=1128 cs=0 l=1 rev1=1 crypto rx=0x7f1888005040 tx=0x7f1888001120 comp rx=0 tx=0).stop 2023-12-12T09:47:28.848 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:28.845+0000 7f18a666b640 1 -- 172.21.15.73:0/859523725 shutdown_connections 2023-12-12T09:47:28.848 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:28.845+0000 7f18a666b640 1 --2- 172.21.15.73:0/859523725 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f188006ae70 0x7f188006d330 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:28.848 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:28.845+0000 7f18a666b640 1 --2- 172.21.15.73:0/859523725 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f18a014af20 0x7f18a0154970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:28.848 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:28.845+0000 7f18a666b640 1 --2- 172.21.15.73:0/859523725 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f18a00a6a20 0x7f18a01e8320 unknown :-1 s=CLOSED pgs=1128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:28.849 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:28.845+0000 7f18a666b640 1 --2- 172.21.15.73:0/859523725 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f188c0047c0 0x7f18a00a5cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:28.849 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:28.845+0000 7f18a666b640 1 -- 172.21.15.73:0/859523725 >> 172.21.15.73:0/859523725 conn(0x7f18a006a4e0 msgr2=0x7f18a014c6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:47:28.849 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:28.846+0000 7f18a666b640 1 -- 172.21.15.73:0/859523725 shutdown_connections 2023-12-12T09:47:28.849 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:28.846+0000 7f18a666b640 1 -- 172.21.15.73:0/859523725 wait complete. 2023-12-12T09:47:28.868 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs2_data cephfs2_data --yes-i-really-really-mean-it 2023-12-12T09:47:29.076 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:29.074+0000 7fb6ab467640 1 Processor -- start 2023-12-12T09:47:29.076 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:29.074+0000 7fb6ab467640 1 -- start start 2023-12-12T09:47:29.077 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:29.075+0000 7fb6ab467640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb6a414c190 0x7fb6a40c0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:29.077 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:29.076+0000 7fb6ab467640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fb6a41529a0 0x7fb6a40a8880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:29.077 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:29.076+0000 7fb6ab467640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6a41521e0 con 0x7fb6a40a4d00 2023-12-12T09:47:29.078 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:29.076+0000 7fb6ab467640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6a40c1890 con 0x7fb6a41529a0 2023-12-12T09:47:29.078 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:29.076+0000 7fb6ab467640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6a4151fd0 con 0x7fb6a414c190 2023-12-12T09:47:29.078 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:29.076+0000 7fb6aac66640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fb6a41529a0 0x7fb6a40a8880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:29.078 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:29.076+0000 7fb6a9c64640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7fb6a40a4d00 0x7fb6a41555c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:54560/0 (socket says 172.21.15.73:54560) 2023-12-12T09:47:29.078 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:29.076+0000 7fb6a9c64640 1 -- 172.21.15.73:0/1641922637 learned_addr learned my addr 172.21.15.73:0/1641922637 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-12T09:47:29.079 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:29.076+0000 7fb6aa465640 1 --2- 172.21.15.73:0/1641922637 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb6a414c190 0x7fb6a40c0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:29.079 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:29.076+0000 7fb6aac66640 1 -- 172.21.15.73:0/1641922637 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb6a414c190 msgr2=0x7fb6a40c0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:47:29.079 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:29.077+0000 7fb6aac66640 1 --2- 172.21.15.73:0/1641922637 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb6a414c190 0x7fb6a40c0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:29.079 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:29.077+0000 7fb6aac66640 1 -- 172.21.15.73:0/1641922637 >> v1:172.21.15.73:6789/0 conn(0x7fb6a40a4d00 legacy=0x7fb6a41555c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:29.079 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:29.077+0000 7fb6aac66640 1 -- 172.21.15.73:0/1641922637 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6a40c1aa0 con 0x7fb6a41529a0 2023-12-12T09:47:29.080 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:29.078+0000 7fb6aac66640 1 --2- 172.21.15.73:0/1641922637 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb6a41529a0 0x7fb6a40a8880 secure :-1 s=READY pgs=1130 cs=0 l=1 rev1=1 crypto rx=0x7fb69c009d90 tx=0x7fb69c02be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb27083d12836c63 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:47:29.080 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:29.078+0000 7fb6a9463640 1 -- 172.21.15.73:0/1641922637 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb69c02cbd0 con 0x7fb6a41529a0 2023-12-12T09:47:29.080 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:29.078+0000 7fb6a9463640 1 -- 172.21.15.73:0/1641922637 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb69c02cd30 con 0x7fb6a41529a0 2023-12-12T09:47:29.080 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:29.078+0000 7fb6a9463640 1 -- 172.21.15.73:0/1641922637 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb69c02cea0 con 0x7fb6a41529a0 2023-12-12T09:47:29.080 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:29.078+0000 7fb6ab467640 1 -- 172.21.15.73:0/1641922637 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb6a41529a0 msgr2=0x7fb6a40a8880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:29.080 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:29.078+0000 7fb6ab467640 1 --2- 172.21.15.73:0/1641922637 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb6a41529a0 0x7fb6a40a8880 secure :-1 s=READY pgs=1130 cs=0 l=1 rev1=1 crypto rx=0x7fb69c009d90 tx=0x7fb69c02be20 comp rx=0 tx=0).stop 2023-12-12T09:47:29.081 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:29.079+0000 7fb6ab467640 1 -- 172.21.15.73:0/1641922637 shutdown_connections 2023-12-12T09:47:29.081 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:29.079+0000 7fb6ab467640 1 --2- 172.21.15.73:0/1641922637 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb6a41529a0 0x7fb6a40a8880 unknown :-1 s=CLOSED pgs=1130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:29.081 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:29.079+0000 7fb6ab467640 1 --2- 172.21.15.73:0/1641922637 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb6a414c190 0x7fb6a40c0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:29.081 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:29.079+0000 7fb6ab467640 1 -- 172.21.15.73:0/1641922637 >> 172.21.15.73:0/1641922637 conn(0x7fb6a406a4e0 msgr2=0x7fb6a406a8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:47:29.081 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:29.079+0000 7fb6ab467640 1 -- 172.21.15.73:0/1641922637 shutdown_connections 2023-12-12T09:47:29.081 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:29.079+0000 7fb6ab467640 1 -- 172.21.15.73:0/1641922637 wait complete. 2023-12-12T09:47:29.082 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:29.080+0000 7fb6ab467640 1 Processor -- start 2023-12-12T09:47:29.082 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:29.081+0000 7fb6ab467640 1 -- start start 2023-12-12T09:47:29.083 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:29.081+0000 7fb6ab467640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb6a40a4d00 0x7fb6a414aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:29.083 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:29.081+0000 7fb6ab467640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb6a414c190 0x7fb6a4148b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:29.083 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:29.081+0000 7fb6ab467640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb6a41529a0 0x7fb6a4149050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:29.083 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:29.081+0000 7fb6ab467640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6a414e130 con 0x7fb6a40a4d00 2023-12-12T09:47:29.083 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:29.081+0000 7fb6ab467640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6a414e5a0 con 0x7fb6a414c190 2023-12-12T09:47:29.083 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:29.081+0000 7fb6ab467640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6a414e880 con 0x7fb6a41529a0 2023-12-12T09:47:29.084 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:29.082+0000 7fb6aa465640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb6a40a4d00 0x7fb6a414aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:29.084 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:29.082+0000 7fb6aa465640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb6a40a4d00 0x7fb6a414aaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:60070/0 (socket says 172.21.15.73:60070) 2023-12-12T09:47:29.084 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:29.082+0000 7fb6aa465640 1 -- 172.21.15.73:0/2936652504 learned_addr learned my addr 172.21.15.73:0/2936652504 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:47:29.085 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:29.082+0000 7fb6a9c64640 1 --2- 172.21.15.73:0/2936652504 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb6a414c190 0x7fb6a4148b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:29.085 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:29.082+0000 7fb6aa465640 1 -- 172.21.15.73:0/2936652504 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb6a41529a0 msgr2=0x7fb6a4149050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:29.085 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:29.082+0000 7fb6aa465640 1 --2- 172.21.15.73:0/2936652504 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb6a41529a0 0x7fb6a4149050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:29.086 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:29.082+0000 7fb6aa465640 1 -- 172.21.15.73:0/2936652504 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb6a414c190 msgr2=0x7fb6a4148b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:29.086 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:29.082+0000 7fb6aa465640 1 --2- 172.21.15.73:0/2936652504 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb6a414c190 0x7fb6a4148b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:29.086 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:29.082+0000 7fb6aa465640 1 -- 172.21.15.73:0/2936652504 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb69c009a70 con 0x7fb6a40a4d00 2023-12-12T09:47:29.086 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:29.083+0000 7fb6aa465640 1 --2- 172.21.15.73:0/2936652504 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb6a40a4d00 0x7fb6a414aaa0 secure :-1 s=READY pgs=1131 cs=0 l=1 rev1=1 crypto rx=0x7fb6a000d5f0 tx=0x7fb6a000dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:47:29.086 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:29.083+0000 7fb69affd640 1 -- 172.21.15.73:0/2936652504 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6a00125f0 con 0x7fb6a40a4d00 2023-12-12T09:47:29.086 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:29.083+0000 7fb69affd640 1 -- 172.21.15.73:0/2936652504 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6a0012750 con 0x7fb6a40a4d00 2023-12-12T09:47:29.086 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:29.083+0000 7fb6ab467640 1 -- 172.21.15.73:0/2936652504 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6a414eb60 con 0x7fb6a40a4d00 2023-12-12T09:47:29.086 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:29.083+0000 7fb69affd640 1 -- 172.21.15.73:0/2936652504 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6a0012b00 con 0x7fb6a40a4d00 2023-12-12T09:47:29.086 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:29.083+0000 7fb6ab467640 1 -- 172.21.15.73:0/2936652504 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6a414afe0 con 0x7fb6a40a4d00 2023-12-12T09:47:29.086 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:29.084+0000 7fb6ab467640 1 -- 172.21.15.73:0/2936652504 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb6a406aba0 con 0x7fb6a40a4d00 2023-12-12T09:47:29.087 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:29.085+0000 7fb69affd640 1 -- 172.21.15.73:0/2936652504 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fb6a0012c60 con 0x7fb6a40a4d00 2023-12-12T09:47:29.088 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:29.086+0000 7fb69affd640 1 --2- 172.21.15.73:0/2936652504 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fb68806ae40 0x7fb68806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:29.088 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:29.087+0000 7fb69affd640 1 -- 172.21.15.73:0/2936652504 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 5445+0+0 (secure 0 0 0) 0x7fb6a0089970 con 0x7fb6a40a4d00 2023-12-12T09:47:29.088 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:29.087+0000 7fb6a9c64640 1 --2- 172.21.15.73:0/2936652504 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fb68806ae40 0x7fb68806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:29.088 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:29.087+0000 7fb6a9c64640 1 --2- 172.21.15.73:0/2936652504 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fb68806ae40 0x7fb68806d300 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7fb6a40677c0 tx=0x7fb694009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:47:29.093 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:29.091+0000 7fb69affd640 1 -- 172.21.15.73:0/2936652504 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fb6a0054b90 con 0x7fb6a40a4d00 2023-12-12T09:47:29.293 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:29.292+0000 7fb6ab467640 1 -- 172.21.15.73:0/2936652504 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs2_data", "pool2": "cephfs2_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fb6a40c2060 con 0x7fb6a40a4d00 2023-12-12T09:47:29.846 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:29.844+0000 7fb69affd640 1 -- 172.21.15.73:0/2936652504 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs2_data", "pool2": "cephfs2_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs2_data' removed v87) v1 ==== 172+0+0 (secure 0 0 0) 0x7fb6a00581b0 con 0x7fb6a40a4d00 2023-12-12T09:47:29.846 INFO:teuthology.orchestra.run.smithi073.stderr:pool 'cephfs2_data' removed 2023-12-12T09:47:29.850 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:29.848+0000 7fb6ab467640 1 -- 172.21.15.73:0/2936652504 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fb68806ae40 msgr2=0x7fb68806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:29.850 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:29.848+0000 7fb6ab467640 1 --2- 172.21.15.73:0/2936652504 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fb68806ae40 0x7fb68806d300 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7fb6a40677c0 tx=0x7fb694009040 comp rx=0 tx=0).stop 2023-12-12T09:47:29.850 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:29.848+0000 7fb6ab467640 1 -- 172.21.15.73:0/2936652504 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb6a40a4d00 msgr2=0x7fb6a414aaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:29.850 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:29.848+0000 7fb6ab467640 1 --2- 172.21.15.73:0/2936652504 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb6a40a4d00 0x7fb6a414aaa0 secure :-1 s=READY pgs=1131 cs=0 l=1 rev1=1 crypto rx=0x7fb6a000d5f0 tx=0x7fb6a000dab0 comp rx=0 tx=0).stop 2023-12-12T09:47:29.850 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:29.848+0000 7fb6ab467640 1 -- 172.21.15.73:0/2936652504 shutdown_connections 2023-12-12T09:47:29.850 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:29.848+0000 7fb6ab467640 1 --2- 172.21.15.73:0/2936652504 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fb68806ae40 0x7fb68806d300 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:29.850 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:29.848+0000 7fb6ab467640 1 --2- 172.21.15.73:0/2936652504 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb6a41529a0 0x7fb6a4149050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:29.850 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:29.848+0000 7fb6ab467640 1 --2- 172.21.15.73:0/2936652504 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb6a414c190 0x7fb6a4148b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:29.850 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:29.848+0000 7fb6ab467640 1 --2- 172.21.15.73:0/2936652504 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb6a40a4d00 0x7fb6a414aaa0 secure :-1 s=CLOSED pgs=1131 cs=0 l=1 rev1=1 crypto rx=0x7fb6a000d5f0 tx=0x7fb6a000dab0 comp rx=0 tx=0).stop 2023-12-12T09:47:29.851 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:29.848+0000 7fb6ab467640 1 -- 172.21.15.73:0/2936652504 >> 172.21.15.73:0/2936652504 conn(0x7fb6a406a4e0 msgr2=0x7fb6a40c57b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:47:29.851 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:29.848+0000 7fb6ab467640 1 -- 172.21.15.73:0/2936652504 shutdown_connections 2023-12-12T09:47:29.851 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:29.849+0000 7fb6ab467640 1 -- 172.21.15.73:0/2936652504 wait complete. 2023-12-12T09:47:29.875 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-12-12T09:47:30.078 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:30.076+0000 7f26f9305640 1 Processor -- start 2023-12-12T09:47:30.078 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:30.077+0000 7f26f9305640 1 -- start start 2023-12-12T09:47:30.079 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:30.078+0000 7f26f9305640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f26f414f8c0 0x7f26f406dc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:30.080 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:30.078+0000 7f26f9305640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26f40c16c0 con 0x7f26f4152500 2023-12-12T09:47:30.080 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:30.078+0000 7f26f9305640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26f40c19a0 con 0x7f26f406d350 2023-12-12T09:47:30.080 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:30.078+0000 7f26f9305640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26f40c1090 con 0x7f26f414f8c0 2023-12-12T09:47:30.081 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:30.078+0000 7f26f37fe640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f26f4152500 0x7f26f4152990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:54570/0 (socket says 172.21.15.73:54570) 2023-12-12T09:47:30.081 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:30.078+0000 7f26f37fe640 1 -- 172.21.15.73:0/2970299084 learned_addr learned my addr 172.21.15.73:0/2970299084 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-12T09:47:30.081 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:30.079+0000 7f26f2ffd640 1 --2- 172.21.15.73:0/2970299084 >> v2:172.21.15.142:3300/0 conn(0x7f26f414f8c0 0x7f26f406dc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:30.082 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:30.079+0000 7f26f1ffb640 1 -- 172.21.15.73:0/2970299084 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3630295325 0 0) 0x7f26f40c16c0 con 0x7f26f4152500 2023-12-12T09:47:30.082 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:30.079+0000 7f26f1ffb640 1 -- 172.21.15.73:0/2970299084 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f26e0003520 con 0x7f26f4152500 2023-12-12T09:47:30.082 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:30.079+0000 7f26f1ffb640 1 -- 172.21.15.73:0/2970299084 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 211964697 0 0) 0x7f26e0003520 con 0x7f26f4152500 2023-12-12T09:47:30.082 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:30.079+0000 7f26f1ffb640 1 -- 172.21.15.73:0/2970299084 >> v2:172.21.15.142:3300/0 conn(0x7f26f414f8c0 msgr2=0x7f26f406dc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:47:30.082 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:30.079+0000 7f26f1ffb640 1 --2- 172.21.15.73:0/2970299084 >> v2:172.21.15.142:3300/0 conn(0x7f26f414f8c0 0x7f26f406dc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:30.082 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:30.079+0000 7f26f1ffb640 1 -- 172.21.15.73:0/2970299084 >> v1:172.21.15.142:6789/0 conn(0x7f26f406d350 legacy=0x7f26f4071e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:30.082 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:30.079+0000 7f26f1ffb640 1 -- 172.21.15.73:0/2970299084 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26f40c1c80 con 0x7f26f4152500 2023-12-12T09:47:30.082 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:30.079+0000 7f26f1ffb640 1 -- 172.21.15.73:0/2970299084 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3186547832 0 0) 0x7f26ec001670 con 0x7f26f4152500 2023-12-12T09:47:30.082 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:30.079+0000 7f26f1ffb640 1 -- 172.21.15.73:0/2970299084 >> v1:172.21.15.73:6789/0 conn(0x7f26f4152500 legacy=0x7f26f4152990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:30.082 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:30.079+0000 7f26f1ffb640 1 --2- 172.21.15.73:0/2970299084 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f26e0003970 0x7f26e0003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:30.083 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:30.080+0000 7f26f1ffb640 1 --2- 172.21.15.73:0/2970299084 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f26e00047c0 0x7f26e0004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:30.083 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:30.080+0000 7f26f1ffb640 1 --2- 172.21.15.73:0/2970299084 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f26e0005180 0x7f26e000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:30.083 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:30.080+0000 7f26f1ffb640 1 -- 172.21.15.73:0/2970299084 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26e000bff0 con 0x7f26e00047c0 2023-12-12T09:47:30.083 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:30.080+0000 7f26f1ffb640 1 -- 172.21.15.73:0/2970299084 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26e000c160 con 0x7f26e0003970 2023-12-12T09:47:30.083 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:30.080+0000 7f26f1ffb640 1 -- 172.21.15.73:0/2970299084 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26e000c320 con 0x7f26e0005180 2023-12-12T09:47:30.083 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:30.080+0000 7f26f27fc640 1 --2- 172.21.15.73:0/2970299084 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f26e00047c0 0x7f26e0004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:30.084 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:30.080+0000 7f26f2ffd640 1 --2- 172.21.15.73:0/2970299084 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f26e0003970 0x7f26e0003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:30.084 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:30.080+0000 7f26f27fc640 1 -- 172.21.15.73:0/2970299084 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f26e0005180 msgr2=0x7f26e000b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:47:30.084 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:30.080+0000 7f26f27fc640 1 --2- 172.21.15.73:0/2970299084 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f26e0005180 0x7f26e000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:30.084 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:30.080+0000 7f26f27fc640 1 -- 172.21.15.73:0/2970299084 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f26e0003970 msgr2=0x7f26e0003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:47:30.084 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:30.080+0000 7f26f27fc640 1 --2- 172.21.15.73:0/2970299084 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f26e0003970 0x7f26e0003d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:30.084 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:30.080+0000 7f26f27fc640 1 -- 172.21.15.73:0/2970299084 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26e0003520 con 0x7f26e00047c0 2023-12-12T09:47:30.085 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:30.080+0000 7f26f37fe640 1 -- 172.21.15.73:0/2970299084 reap_dead start 2023-12-12T09:47:30.085 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:30.081+0000 7f26f27fc640 1 --2- 172.21.15.73:0/2970299084 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f26e00047c0 0x7f26e0004c40 secure :-1 s=READY pgs=1133 cs=0 l=1 rev1=1 crypto rx=0x7f26dc001750 tx=0x7f26e00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bba19cc1eff163bb server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:47:30.085 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:30.082+0000 7f26f1ffb640 1 -- 172.21.15.73:0/2970299084 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26dc0052d0 con 0x7f26e00047c0 2023-12-12T09:47:30.085 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:30.082+0000 7f26f1ffb640 1 -- 172.21.15.73:0/2970299084 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26dc02e050 con 0x7f26e00047c0 2023-12-12T09:47:30.085 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:30.082+0000 7f26f1ffb640 1 -- 172.21.15.73:0/2970299084 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26dc003830 con 0x7f26e00047c0 2023-12-12T09:47:30.085 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:30.082+0000 7f26f9305640 1 -- 172.21.15.73:0/2970299084 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f26e00047c0 msgr2=0x7f26e0004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:30.085 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:30.082+0000 7f26f9305640 1 --2- 172.21.15.73:0/2970299084 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f26e00047c0 0x7f26e0004c40 secure :-1 s=READY pgs=1133 cs=0 l=1 rev1=1 crypto rx=0x7f26dc001750 tx=0x7f26e00057f0 comp rx=0 tx=0).stop 2023-12-12T09:47:30.085 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:30.082+0000 7f26f9305640 1 -- 172.21.15.73:0/2970299084 shutdown_connections 2023-12-12T09:47:30.085 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:30.082+0000 7f26f9305640 1 --2- 172.21.15.73:0/2970299084 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f26e00047c0 0x7f26e0004c40 unknown :-1 s=CLOSED pgs=1133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:30.085 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:30.082+0000 7f26f9305640 1 -- 172.21.15.73:0/2970299084 >> 172.21.15.73:0/2970299084 conn(0x7f26f406a4e0 msgr2=0x7f26f406a8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:47:30.085 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:30.082+0000 7f26f9305640 1 -- 172.21.15.73:0/2970299084 shutdown_connections 2023-12-12T09:47:30.086 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:30.082+0000 7f26f9305640 1 -- 172.21.15.73:0/2970299084 wait complete. 2023-12-12T09:47:30.086 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:30.084+0000 7f26f9305640 1 Processor -- start 2023-12-12T09:47:30.086 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:30.084+0000 7f26f9305640 1 -- start start 2023-12-12T09:47:30.088 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:30.085+0000 7f26f9305640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f26e00047c0 0x7f26f4071180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:30.088 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:30.085+0000 7f26f9305640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f26f4156610 0x7f26f4147560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:30.088 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:30.085+0000 7f26f9305640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f26f4153ab0 0x7f26f4155230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:30.088 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:30.085+0000 7f26f9305640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26f40a6f90 con 0x7f26f4156610 2023-12-12T09:47:30.089 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:30.085+0000 7f26f9305640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26f41488c0 con 0x7f26f4153ab0 2023-12-12T09:47:30.089 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:30.085+0000 7f26f9305640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26f4154b70 con 0x7f26e00047c0 2023-12-12T09:47:30.089 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:30.086+0000 7f26f27fc640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f26f4156610 0x7f26f4147560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:30.089 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:30.086+0000 7f26f27fc640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f26f4156610 0x7f26f4147560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:60090/0 (socket says 172.21.15.73:60090) 2023-12-12T09:47:30.089 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:30.086+0000 7f26f27fc640 1 -- 172.21.15.73:0/101688144 learned_addr learned my addr 172.21.15.73:0/101688144 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:47:30.089 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:30.086+0000 7f26f2ffd640 1 --2- 172.21.15.73:0/101688144 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f26e00047c0 0x7f26f4071180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:30.089 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:30.086+0000 7f26f37fe640 1 --2- 172.21.15.73:0/101688144 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f26f4153ab0 0x7f26f4155230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:30.089 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:30.086+0000 7f26f27fc640 1 -- 172.21.15.73:0/101688144 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f26e00047c0 msgr2=0x7f26f4071180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:30.089 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:30.086+0000 7f26f27fc640 1 --2- 172.21.15.73:0/101688144 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f26e00047c0 0x7f26f4071180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:30.089 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:30.086+0000 7f26f27fc640 1 -- 172.21.15.73:0/101688144 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f26f4153ab0 msgr2=0x7f26f4155230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:30.089 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:30.086+0000 7f26f27fc640 1 --2- 172.21.15.73:0/101688144 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f26f4153ab0 0x7f26f4155230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:30.089 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:30.086+0000 7f26f27fc640 1 -- 172.21.15.73:0/101688144 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26f41485e0 con 0x7f26f4156610 2023-12-12T09:47:30.089 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:30.086+0000 7f26f37fe640 1 --2- 172.21.15.73:0/101688144 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f26f4153ab0 0x7f26f4155230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:47:30.089 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:30.086+0000 7f26f27fc640 1 --2- 172.21.15.73:0/101688144 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f26f4156610 0x7f26f4147560 secure :-1 s=READY pgs=1134 cs=0 l=1 rev1=1 crypto rx=0x7f26dc02bc00 tx=0x7f26dc001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:47:30.090 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:30.087+0000 7f26eb7fe640 1 -- 172.21.15.73:0/101688144 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26dc0076c0 con 0x7f26f4156610 2023-12-12T09:47:30.090 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:30.087+0000 7f26eb7fe640 1 -- 172.21.15.73:0/101688144 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26dc007a30 con 0x7f26f4156610 2023-12-12T09:47:30.090 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:30.087+0000 7f26eb7fe640 1 -- 172.21.15.73:0/101688144 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26dc006be0 con 0x7f26f4156610 2023-12-12T09:47:30.090 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:30.087+0000 7f26f9305640 1 -- 172.21.15.73:0/101688144 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26f4148090 con 0x7f26f4156610 2023-12-12T09:47:30.090 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:30.087+0000 7f26f9305640 1 -- 172.21.15.73:0/101688144 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26f40a71e0 con 0x7f26f4156610 2023-12-12T09:47:30.090 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:30.088+0000 7f26f9305640 1 -- 172.21.15.73:0/101688144 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f26f4067070 con 0x7f26f4156610 2023-12-12T09:47:30.090 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:30.089+0000 7f26eb7fe640 1 -- 172.21.15.73:0/101688144 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f26dc006d40 con 0x7f26f4156610 2023-12-12T09:47:30.091 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:30.090+0000 7f26eb7fe640 1 --2- 172.21.15.73:0/101688144 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f26d406ae40 0x7f26d406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:30.091 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:30.090+0000 7f26eb7fe640 1 -- 172.21.15.73:0/101688144 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f26dc0aafe0 con 0x7f26f4156610 2023-12-12T09:47:30.091 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:30.090+0000 7f26f2ffd640 1 --2- 172.21.15.73:0/101688144 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f26d406ae40 0x7f26d406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:30.092 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:30.091+0000 7f26f2ffd640 1 --2- 172.21.15.73:0/101688144 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f26d406ae40 0x7f26d406d300 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f26f4069160 tx=0x7f26e400b040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:47:30.095 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:30.094+0000 7f26eb7fe640 1 -- 172.21.15.73:0/101688144 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f26dc076320 con 0x7f26f4156610 2023-12-12T09:47:30.302 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:30.301+0000 7f26f9305640 1 -- 172.21.15.73:0/101688144 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f26f4067580 con 0x7f26f4156610 2023-12-12T09:47:30.307 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:30.305+0000 7f26eb7fe640 1 -- 172.21.15.73:0/101688144 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v15) v1 ==== 104+0+0 (secure 0 0 0) 0x7f26dc079940 con 0x7f26f4156610 2023-12-12T09:47:30.310 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:30.307+0000 7f26f9305640 1 -- 172.21.15.73:0/101688144 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f26d406ae40 msgr2=0x7f26d406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:30.310 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:30.307+0000 7f26f9305640 1 --2- 172.21.15.73:0/101688144 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f26d406ae40 0x7f26d406d300 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f26f4069160 tx=0x7f26e400b040 comp rx=0 tx=0).stop 2023-12-12T09:47:30.310 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:30.307+0000 7f26f9305640 1 -- 172.21.15.73:0/101688144 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f26f4156610 msgr2=0x7f26f4147560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:30.310 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:30.307+0000 7f26f9305640 1 --2- 172.21.15.73:0/101688144 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f26f4156610 0x7f26f4147560 secure :-1 s=READY pgs=1134 cs=0 l=1 rev1=1 crypto rx=0x7f26dc02bc00 tx=0x7f26dc001120 comp rx=0 tx=0).stop 2023-12-12T09:47:30.310 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:30.307+0000 7f26f9305640 1 -- 172.21.15.73:0/101688144 shutdown_connections 2023-12-12T09:47:30.310 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:30.307+0000 7f26f9305640 1 --2- 172.21.15.73:0/101688144 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f26d406ae40 0x7f26d406d300 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:30.310 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:30.307+0000 7f26f9305640 1 --2- 172.21.15.73:0/101688144 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f26f4153ab0 0x7f26f4155230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:30.311 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:30.307+0000 7f26f9305640 1 --2- 172.21.15.73:0/101688144 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f26f4156610 0x7f26f4147560 unknown :-1 s=CLOSED pgs=1134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:30.311 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:30.307+0000 7f26f9305640 1 --2- 172.21.15.73:0/101688144 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f26e00047c0 0x7f26f4071180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:30.311 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:30.307+0000 7f26f9305640 1 -- 172.21.15.73:0/101688144 >> 172.21.15.73:0/101688144 conn(0x7f26f406a4e0 msgr2=0x7f26f40bfb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:47:30.311 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:30.308+0000 7f26f9305640 1 -- 172.21.15.73:0/101688144 shutdown_connections 2023-12-12T09:47:30.311 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:30.308+0000 7f26f9305640 1 -- 172.21.15.73:0/101688144 wait complete. 2023-12-12T09:47:30.327 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_multifs_auth.TestMDSCaps.test_r_with_fsname_and_no_path_in_cap' 2023-12-12T09:47:30.517 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:30.516+0000 7f62bb1c5640 1 Processor -- start 2023-12-12T09:47:30.518 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:30.516+0000 7f62bb1c5640 1 -- start start 2023-12-12T09:47:30.523 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:30.517+0000 7f62bb1c5640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f62b40c5bc0 0x7f62b40c1180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:30.523 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:30.517+0000 7f62bb1c5640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f62b406fde0 0x7f62b40c16c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:30.523 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:30.517+0000 7f62bb1c5640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62b40c6050 con 0x7f62b406d160 2023-12-12T09:47:30.523 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:30.517+0000 7f62bb1c5640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62b40c7180 con 0x7f62b40c5bc0 2023-12-12T09:47:30.524 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:30.517+0000 7f62bb1c5640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62b40c3030 con 0x7f62b406fde0 2023-12-12T09:47:30.524 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:30.518+0000 7f62b3fff640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f62b40c5bc0 0x7f62b40c1180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:30.524 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:30.518+0000 7f62b8f61640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f62b406d160 0x7f62b40c62a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:54580/0 (socket says 172.21.15.73:54580) 2023-12-12T09:47:30.524 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:30.518+0000 7f62b8f61640 1 -- 172.21.15.73:0/4265161448 learned_addr learned my addr 172.21.15.73:0/4265161448 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-12T09:47:30.524 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:30.518+0000 7f62b9762640 1 --2- 172.21.15.73:0/4265161448 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f62b406fde0 0x7f62b40c16c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:30.524 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:30.518+0000 7f62b37fe640 1 -- 172.21.15.73:0/4265161448 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3222306606 0 0) 0x7f62b40c6050 con 0x7f62b406d160 2023-12-12T09:47:30.524 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:30.518+0000 7f62b37fe640 1 -- 172.21.15.73:0/4265161448 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f62a0003520 con 0x7f62b406d160 2023-12-12T09:47:30.525 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:30.518+0000 7f62b3fff640 1 -- 172.21.15.73:0/4265161448 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f62b406fde0 msgr2=0x7f62b40c16c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:47:30.525 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:30.518+0000 7f62b3fff640 1 --2- 172.21.15.73:0/4265161448 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f62b406fde0 0x7f62b40c16c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:30.525 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:30.518+0000 7f62b3fff640 1 -- 172.21.15.73:0/4265161448 >> v1:172.21.15.73:6789/0 conn(0x7f62b406d160 legacy=0x7f62b40c62a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:30.525 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:30.518+0000 7f62b3fff640 1 -- 172.21.15.73:0/4265161448 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62b40c3310 con 0x7f62b40c5bc0 2023-12-12T09:47:30.525 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:30.518+0000 7f62b9762640 1 --2- 172.21.15.73:0/4265161448 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f62b406fde0 0x7f62b40c16c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:47:30.525 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:30.519+0000 7f62b3fff640 1 --2- 172.21.15.73:0/4265161448 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f62b40c5bc0 0x7f62b40c1180 secure :-1 s=READY pgs=1136 cs=0 l=1 rev1=1 crypto rx=0x7f629c0097a0 tx=0x7f629c02b790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8fbb30ea564e837 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:47:30.525 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:30.519+0000 7f62b37fe640 1 -- 172.21.15.73:0/4265161448 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f629c0316f0 con 0x7f62b40c5bc0 2023-12-12T09:47:30.526 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:30.519+0000 7f62b37fe640 1 -- 172.21.15.73:0/4265161448 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f629c031850 con 0x7f62b40c5bc0 2023-12-12T09:47:30.526 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:30.519+0000 7f62b37fe640 1 -- 172.21.15.73:0/4265161448 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f629c031be0 con 0x7f62b40c5bc0 2023-12-12T09:47:30.526 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:30.520+0000 7f62bb1c5640 1 -- 172.21.15.73:0/4265161448 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f62b40c5bc0 msgr2=0x7f62b40c1180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:30.526 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:30.520+0000 7f62bb1c5640 1 --2- 172.21.15.73:0/4265161448 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f62b40c5bc0 0x7f62b40c1180 secure :-1 s=READY pgs=1136 cs=0 l=1 rev1=1 crypto rx=0x7f629c0097a0 tx=0x7f629c02b790 comp rx=0 tx=0).stop 2023-12-12T09:47:30.526 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:30.520+0000 7f62bb1c5640 1 -- 172.21.15.73:0/4265161448 shutdown_connections 2023-12-12T09:47:30.526 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:30.520+0000 7f62bb1c5640 1 --2- 172.21.15.73:0/4265161448 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f62b406fde0 0x7f62b40c16c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:30.526 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:30.520+0000 7f62bb1c5640 1 --2- 172.21.15.73:0/4265161448 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f62b40c5bc0 0x7f62b40c1180 unknown :-1 s=CLOSED pgs=1136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:30.526 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:30.520+0000 7f62bb1c5640 1 -- 172.21.15.73:0/4265161448 >> 172.21.15.73:0/4265161448 conn(0x7f62b40c7cc0 msgr2=0x7f62b40c80a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:47:30.526 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:30.520+0000 7f62bb1c5640 1 -- 172.21.15.73:0/4265161448 shutdown_connections 2023-12-12T09:47:30.526 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:30.520+0000 7f62bb1c5640 1 -- 172.21.15.73:0/4265161448 wait complete. 2023-12-12T09:47:30.529 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:30.522+0000 7f62bb1c5640 1 Processor -- start 2023-12-12T09:47:30.529 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:30.522+0000 7f62bb1c5640 1 -- start start 2023-12-12T09:47:30.529 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:30.523+0000 7f62bb1c5640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f62b406d160 0x7f62b414c220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:30.529 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:30.523+0000 7f62bb1c5640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f62b406fde0 0x7f62b41e9ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:30.529 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:30.523+0000 7f62bb1c5640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f62b4150380 0x7f62b41ed9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:30.529 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:30.523+0000 7f62bb1c5640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62b406c2d0 con 0x7f62b406d160 2023-12-12T09:47:30.529 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:30.523+0000 7f62bb1c5640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62b41ed210 con 0x7f62b406fde0 2023-12-12T09:47:30.529 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:30.523+0000 7f62bb1c5640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62b40aa1a0 con 0x7f62b4150380 2023-12-12T09:47:30.529 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:30.523+0000 7f62b8f61640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f62b406d160 0x7f62b414c220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:30.529 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:30.523+0000 7f62b8f61640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f62b406d160 0x7f62b414c220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:60108/0 (socket says 172.21.15.73:60108) 2023-12-12T09:47:30.529 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:30.523+0000 7f62b8f61640 1 -- 172.21.15.73:0/3904588955 learned_addr learned my addr 172.21.15.73:0/3904588955 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:47:30.529 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:30.523+0000 7f62b3fff640 1 --2- 172.21.15.73:0/3904588955 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f62b406fde0 0x7f62b41e9ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:30.529 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:30.524+0000 7f62b8f61640 1 -- 172.21.15.73:0/3904588955 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f62b4150380 msgr2=0x7f62b41ed9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:30.530 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:30.524+0000 7f62b9762640 1 --2- 172.21.15.73:0/3904588955 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f62b4150380 0x7f62b41ed9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:30.530 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:30.524+0000 7f62b8f61640 1 --2- 172.21.15.73:0/3904588955 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f62b4150380 0x7f62b41ed9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:30.530 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:30.524+0000 7f62b8f61640 1 -- 172.21.15.73:0/3904588955 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f62b406fde0 msgr2=0x7f62b41e9ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:30.530 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:30.524+0000 7f62b8f61640 1 --2- 172.21.15.73:0/3904588955 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f62b406fde0 0x7f62b41e9ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:30.530 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:30.524+0000 7f62b8f61640 1 -- 172.21.15.73:0/3904588955 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f629c009400 con 0x7f62b406d160 2023-12-12T09:47:30.530 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:30.524+0000 7f62b3fff640 1 --2- 172.21.15.73:0/3904588955 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f62b406fde0 0x7f62b41e9ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:47:30.530 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:30.524+0000 7f62b8f61640 1 --2- 172.21.15.73:0/3904588955 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f62b406d160 0x7f62b414c220 secure :-1 s=READY pgs=1137 cs=0 l=1 rev1=1 crypto rx=0x7f62a400cbc0 tx=0x7f62a400a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:47:30.530 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:30.524+0000 7f62b17fa640 1 -- 172.21.15.73:0/3904588955 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62a400ad40 con 0x7f62b406d160 2023-12-12T09:47:30.530 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:30.524+0000 7f62b17fa640 1 -- 172.21.15.73:0/3904588955 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62a4012400 con 0x7f62b406d160 2023-12-12T09:47:30.530 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:30.524+0000 7f62bb1c5640 1 -- 172.21.15.73:0/3904588955 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62b40aa480 con 0x7f62b406d160 2023-12-12T09:47:30.530 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:30.524+0000 7f62b17fa640 1 -- 172.21.15.73:0/3904588955 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62a400aea0 con 0x7f62b406d160 2023-12-12T09:47:30.530 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:30.524+0000 7f62bb1c5640 1 -- 172.21.15.73:0/3904588955 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62b41ed4b0 con 0x7f62b406d160 2023-12-12T09:47:30.530 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:30.525+0000 7f62bb1c5640 1 -- 172.21.15.73:0/3904588955 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f62b41ed6a0 con 0x7f62b406d160 2023-12-12T09:47:30.530 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:30.526+0000 7f62b17fa640 1 -- 172.21.15.73:0/3904588955 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f62a4007070 con 0x7f62b406d160 2023-12-12T09:47:30.530 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:30.527+0000 7f62b17fa640 1 --2- 172.21.15.73:0/3904588955 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f629406ae70 0x7f629406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:30.531 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:30.527+0000 7f62b17fa640 1 -- 172.21.15.73:0/3904588955 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f62a4089300 con 0x7f62b406d160 2023-12-12T09:47:30.531 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:30.528+0000 7f62b3fff640 1 --2- 172.21.15.73:0/3904588955 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f629406ae70 0x7f629406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:30.531 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:30.528+0000 7f62b3fff640 1 --2- 172.21.15.73:0/3904588955 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f629406ae70 0x7f629406d330 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f629c036000 tx=0x7f629c008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:47:30.533 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:30.532+0000 7f62b17fa640 1 -- 172.21.15.73:0/3904588955 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f62a40546e0 con 0x7f62b406d160 2023-12-12T09:47:30.784 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:30.782+0000 7f62bb1c5640 1 -- 172.21.15.73:0/3904588955 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_multifs_auth.TestMDSCaps.test_r_with_fsname_and_no_path_in_cap"]} v 0) v1 -- 0x7f62b4067580 con 0x7f62b406d160 2023-12-12T09:47:30.860 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:30.858+0000 7f62b17fa640 1 -- 172.21.15.73:0/3904588955 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_multifs_auth.TestMDSCaps.test_r_with_fsname_and_no_path_in_cap"]}]=0 v254) v1 ==== 159+0+0 (secure 0 0 0) 0x7f62a4057d00 con 0x7f62b406d160 2023-12-12T09:47:30.862 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:30.860+0000 7f62bb1c5640 1 -- 172.21.15.73:0/3904588955 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f629406ae70 msgr2=0x7f629406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:30.862 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:30.860+0000 7f62bb1c5640 1 --2- 172.21.15.73:0/3904588955 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f629406ae70 0x7f629406d330 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f629c036000 tx=0x7f629c008030 comp rx=0 tx=0).stop 2023-12-12T09:47:30.863 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:30.860+0000 7f62bb1c5640 1 -- 172.21.15.73:0/3904588955 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f62b406d160 msgr2=0x7f62b414c220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:30.863 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:30.860+0000 7f62bb1c5640 1 --2- 172.21.15.73:0/3904588955 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f62b406d160 0x7f62b414c220 secure :-1 s=READY pgs=1137 cs=0 l=1 rev1=1 crypto rx=0x7f62a400cbc0 tx=0x7f62a400a430 comp rx=0 tx=0).stop 2023-12-12T09:47:30.863 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:30.861+0000 7f62bb1c5640 1 -- 172.21.15.73:0/3904588955 shutdown_connections 2023-12-12T09:47:30.863 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:30.861+0000 7f62bb1c5640 1 --2- 172.21.15.73:0/3904588955 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f629406ae70 0x7f629406d330 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:30.863 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:30.861+0000 7f62bb1c5640 1 --2- 172.21.15.73:0/3904588955 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f62b4150380 0x7f62b41ed9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:30.863 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:30.861+0000 7f62bb1c5640 1 --2- 172.21.15.73:0/3904588955 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f62b406fde0 0x7f62b41e9ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:30.863 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:30.861+0000 7f62bb1c5640 1 --2- 172.21.15.73:0/3904588955 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f62b406d160 0x7f62b414c220 unknown :-1 s=CLOSED pgs=1137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:30.863 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:30.861+0000 7f62bb1c5640 1 -- 172.21.15.73:0/3904588955 >> 172.21.15.73:0/3904588955 conn(0x7f62b40c7cc0 msgr2=0x7f62b40c80a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:47:30.863 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:30.861+0000 7f62bb1c5640 1 -- 172.21.15.73:0/3904588955 shutdown_connections 2023-12-12T09:47:30.863 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:30.861+0000 7f62bb1c5640 1 -- 172.21.15.73:0/3904588955 wait complete. 2023-12-12T09:47:30.881 INFO:tasks.cephfs_test_runner:test_r_with_fsname_and_no_path_in_cap (tasks.cephfs.test_multifs_auth.TestMDSCaps) ... ERROR 2023-12-12T09:47:30.881 INFO:tasks.cephfs_test_runner: 2023-12-12T09:47:30.882 INFO:tasks.cephfs_test_runner:====================================================================== 2023-12-12T09:47:30.882 INFO:tasks.cephfs_test_runner:ERROR: test_r_with_fsname_and_no_path_in_cap (tasks.cephfs.test_multifs_auth.TestMDSCaps) 2023-12-12T09:47:30.882 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2023-12-12T09:47:30.882 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2023-12-12T09:47:30.882 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_f1fbf3c583d03e19f5e58eb618e78d8e10d075f9/qa/tasks/cephfs/test_multifs_auth.py", line 95, in test_r_with_fsname_and_no_path_in_cap 2023-12-12T09:47:30.882 INFO:tasks.cephfs_test_runner: self.captesters[0].run_mds_cap_tests(PERM) 2023-12-12T09:47:30.882 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_f1fbf3c583d03e19f5e58eb618e78d8e10d075f9/qa/tasks/cephfs/caps_helper.py", line 262, in run_mds_cap_tests 2023-12-12T09:47:30.882 INFO:tasks.cephfs_test_runner: self.conduct_pos_test_for_read_caps() 2023-12-12T09:47:30.882 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_f1fbf3c583d03e19f5e58eb618e78d8e10d075f9/qa/tasks/cephfs/caps_helper.py", line 274, in conduct_pos_test_for_read_caps 2023-12-12T09:47:30.882 INFO:tasks.cephfs_test_runner: contents = self.mount.read_file(self.path, sudo_read) 2023-12-12T09:47:30.882 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_f1fbf3c583d03e19f5e58eb618e78d8e10d075f9/qa/tasks/cephfs/mount.py", line 749, in read_file 2023-12-12T09:47:30.882 INFO:tasks.cephfs_test_runner: return self.run_shell(args=args, omit_sudo=False).stdout.getvalue().strip() 2023-12-12T09:47:30.882 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_f1fbf3c583d03e19f5e58eb618e78d8e10d075f9/qa/tasks/cephfs/mount.py", line 784, in run_shell 2023-12-12T09:47:30.882 INFO:tasks.cephfs_test_runner: return self.client_remote.run(args=args, cwd=cwd, timeout=timeout, 2023-12-12T09:47:30.883 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/orchestra/remote.py", line 523, in run 2023-12-12T09:47:30.883 INFO:tasks.cephfs_test_runner: r = self._runner(client=self.ssh, name=self.shortname, **kwargs) 2023-12-12T09:47:30.883 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/orchestra/run.py", line 455, in run 2023-12-12T09:47:30.883 INFO:tasks.cephfs_test_runner: r.wait() 2023-12-12T09:47:30.883 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/orchestra/run.py", line 161, in wait 2023-12-12T09:47:30.883 INFO:tasks.cephfs_test_runner: self._raise_for_status() 2023-12-12T09:47:30.883 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/orchestra/run.py", line 181, in _raise_for_status 2023-12-12T09:47:30.883 INFO:tasks.cephfs_test_runner: raise CommandFailedError( 2023-12-12T09:47:30.883 INFO:tasks.cephfs_test_runner:teuthology.exceptions.CommandFailedError: Command failed on smithi073 with status 1: '(cd /home/ubuntu/cephtest/mnt.0 && exec cat /home/ubuntu/cephtest/mnt.0/testdir/testfile)' 2023-12-12T09:47:30.883 INFO:tasks.cephfs_test_runner: 2023-12-12T09:47:30.883 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2023-12-12T09:47:30.883 INFO:tasks.cephfs_test_runner:Ran 3 tests in 216.479s 2023-12-12T09:47:30.883 INFO:tasks.cephfs_test_runner: 2023-12-12T09:47:30.883 INFO:tasks.cephfs_test_runner:FAILED (errors=1) 2023-12-12T09:47:30.883 INFO:tasks.cephfs_test_runner: 2023-12-12T09:47:30.883 INFO:tasks.cephfs_test_runner:====================================================================== 2023-12-12T09:47:30.883 INFO:tasks.cephfs_test_runner:ERROR: test_r_with_fsname_and_no_path_in_cap (tasks.cephfs.test_multifs_auth.TestMDSCaps) 2023-12-12T09:47:30.884 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2023-12-12T09:47:30.884 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2023-12-12T09:47:30.884 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_f1fbf3c583d03e19f5e58eb618e78d8e10d075f9/qa/tasks/cephfs/test_multifs_auth.py", line 95, in test_r_with_fsname_and_no_path_in_cap 2023-12-12T09:47:30.884 INFO:tasks.cephfs_test_runner: self.captesters[0].run_mds_cap_tests(PERM) 2023-12-12T09:47:30.884 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_f1fbf3c583d03e19f5e58eb618e78d8e10d075f9/qa/tasks/cephfs/caps_helper.py", line 262, in run_mds_cap_tests 2023-12-12T09:47:30.884 INFO:tasks.cephfs_test_runner: self.conduct_pos_test_for_read_caps() 2023-12-12T09:47:30.884 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_f1fbf3c583d03e19f5e58eb618e78d8e10d075f9/qa/tasks/cephfs/caps_helper.py", line 274, in conduct_pos_test_for_read_caps 2023-12-12T09:47:30.884 INFO:tasks.cephfs_test_runner: contents = self.mount.read_file(self.path, sudo_read) 2023-12-12T09:47:30.884 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_f1fbf3c583d03e19f5e58eb618e78d8e10d075f9/qa/tasks/cephfs/mount.py", line 749, in read_file 2023-12-12T09:47:30.884 INFO:tasks.cephfs_test_runner: return self.run_shell(args=args, omit_sudo=False).stdout.getvalue().strip() 2023-12-12T09:47:30.884 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_f1fbf3c583d03e19f5e58eb618e78d8e10d075f9/qa/tasks/cephfs/mount.py", line 784, in run_shell 2023-12-12T09:47:30.884 INFO:tasks.cephfs_test_runner: return self.client_remote.run(args=args, cwd=cwd, timeout=timeout, 2023-12-12T09:47:30.884 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/orchestra/remote.py", line 523, in run 2023-12-12T09:47:30.884 INFO:tasks.cephfs_test_runner: r = self._runner(client=self.ssh, name=self.shortname, **kwargs) 2023-12-12T09:47:30.884 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/orchestra/run.py", line 455, in run 2023-12-12T09:47:30.884 INFO:tasks.cephfs_test_runner: r.wait() 2023-12-12T09:47:30.884 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/orchestra/run.py", line 161, in wait 2023-12-12T09:47:30.884 INFO:tasks.cephfs_test_runner: self._raise_for_status() 2023-12-12T09:47:30.885 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/orchestra/run.py", line 181, in _raise_for_status 2023-12-12T09:47:30.885 INFO:tasks.cephfs_test_runner: raise CommandFailedError( 2023-12-12T09:47:30.885 INFO:tasks.cephfs_test_runner:teuthology.exceptions.CommandFailedError: Command failed on smithi073 with status 1: '(cd /home/ubuntu/cephtest/mnt.0 && exec cat /home/ubuntu/cephtest/mnt.0/testdir/testfile)' 2023-12-12T09:47:30.885 INFO:tasks.cephfs_test_runner: 2023-12-12T09:47:30.885 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_f1fbf3c583d03e19f5e58eb618e78d8e10d075f9/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_r_with_fsname_and_no_path_in_cap (tasks.cephfs.test_multifs_auth.TestMDSCaps) 2023-12-12T09:47:30.997 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=35a61c0c9f444b6fba08fb2a253f9da2 Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_f1fbf3c583d03e19f5e58eb618e78d8e10d075f9/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_r_with_fsname_and_no_path_in_cap (tasks.cephfs.test_multifs_auth.TestMDSCaps) 2023-12-12T09:47:30.998 DEBUG:teuthology.run_tasks:Unwinding manager cephfs_test_runner 2023-12-12T09:47:31.008 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2023-12-12T09:47:31.026 INFO:tasks.kclient:Unmounting kernel clients... 2023-12-12T09:47:31.026 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2023-12-12T09:47:31.026 DEBUG:teuthology.orchestra.run.smithi073:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-12T09:47:31.095 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054284,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498800k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249396k,nr_inodes=812349,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498800k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 2023-12-12T09:47:31.096 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2023-12-12T09:47:31.096 DEBUG:teuthology.orchestra.run.smithi142:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-12T09:47:31.159 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054289,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498808k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249400k,nr_inodes=812350,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498808k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 2023-12-12T09:47:31.160 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T09:47:31.160 DEBUG:teuthology.orchestra.run.smithi073:> ip netns list 2023-12-12T09:47:31.222 INFO:teuthology.orchestra.run.smithi073.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-12-12T09:47:31.222 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T09:47:31.222 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-12T09:47:31.321 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T09:47:31.321 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip link delete ceph-brx 2023-12-12T09:47:31.455 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T09:47:31.455 DEBUG:teuthology.orchestra.run.smithi142:> ip netns list 2023-12-12T09:47:31.515 INFO:teuthology.orchestra.run.smithi142.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-12-12T09:47:31.517 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T09:47:31.517 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2023-12-12T09:47:31.613 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T09:47:31.614 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip link delete ceph-brx 2023-12-12T09:47:31.756 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2023-12-12T09:47:31.766 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-12-12T09:47:31.766 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-12T09:47:31.990 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:31.988+0000 7fb332439640 1 Processor -- start 2023-12-12T09:47:31.990 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:31.988+0000 7fb332439640 1 -- start start 2023-12-12T09:47:31.991 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:31.990+0000 7fb332439640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fb32c14e700 0x7fb32c151cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:31.992 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:31.990+0000 7fb332439640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb32c0c37b0 0x7fb32c0c02b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:31.992 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:31.990+0000 7fb332439640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb32c1521f0 con 0x7fb32c0ab4a0 2023-12-12T09:47:31.992 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:31.990+0000 7fb332439640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb32c0ab2d0 con 0x7fb32c14e700 2023-12-12T09:47:31.992 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:31.990+0000 7fb332439640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb32c06bb10 con 0x7fb32c0c37b0 2023-12-12T09:47:31.992 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:31.990+0000 7fb331437640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fb32c14e700 0x7fb32c151cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:31.992 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:31.990+0000 7fb331437640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fb32c14e700 0x7fb32c151cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:60112/0 (socket says 172.21.15.73:60112) 2023-12-12T09:47:31.992 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:31.990+0000 7fb331437640 1 -- 172.21.15.73:0/3526339794 learned_addr learned my addr 172.21.15.73:0/3526339794 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:47:31.994 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:31.990+0000 7fb331437640 1 -- 172.21.15.73:0/3526339794 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb32c0c37b0 msgr2=0x7fb32c0c02b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:47:31.994 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:31.990+0000 7fb330c36640 1 --2- 172.21.15.73:0/3526339794 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb32c0c37b0 0x7fb32c0c02b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:31.994 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:31.991+0000 7fb331437640 1 --2- 172.21.15.73:0/3526339794 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb32c0c37b0 0x7fb32c0c02b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:31.994 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:31.991+0000 7fb331437640 1 -- 172.21.15.73:0/3526339794 >> v1:172.21.15.142:6789/0 conn(0x7fb32c0ab4a0 legacy=0x7fb32c0a9df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:47:31.994 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:31.991+0000 7fb331437640 1 -- 172.21.15.73:0/3526339794 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb32c0c07f0 con 0x7fb32c14e700 2023-12-12T09:47:31.994 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:31.991+0000 7fb330c36640 1 --2- 172.21.15.73:0/3526339794 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb32c0c37b0 0x7fb32c0c02b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:47:31.994 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:31.992+0000 7fb331437640 1 --2- 172.21.15.73:0/3526339794 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb32c14e700 0x7fb32c151cb0 secure :-1 s=READY pgs=1138 cs=0 l=1 rev1=1 crypto rx=0x7fb32800bb10 tx=0x7fb32802dfa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e53fc813e7da2b2 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:47:31.994 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:31.992+0000 7fb323fff640 1 -- 172.21.15.73:0/3526339794 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb32802ed50 con 0x7fb32c14e700 2023-12-12T09:47:31.995 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:31.992+0000 7fb323fff640 1 -- 172.21.15.73:0/3526339794 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb328036440 con 0x7fb32c14e700 2023-12-12T09:47:31.995 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:31.992+0000 7fb323fff640 1 -- 172.21.15.73:0/3526339794 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3280367d0 con 0x7fb32c14e700 2023-12-12T09:47:31.995 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:31.993+0000 7fb332439640 1 -- 172.21.15.73:0/3526339794 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb32c14e700 msgr2=0x7fb32c151cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:31.996 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:31.993+0000 7fb332439640 1 --2- 172.21.15.73:0/3526339794 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb32c14e700 0x7fb32c151cb0 secure :-1 s=READY pgs=1138 cs=0 l=1 rev1=1 crypto rx=0x7fb32800bb10 tx=0x7fb32802dfa0 comp rx=0 tx=0).stop 2023-12-12T09:47:31.996 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:31.993+0000 7fb332439640 1 -- 172.21.15.73:0/3526339794 shutdown_connections 2023-12-12T09:47:31.996 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:31.993+0000 7fb332439640 1 --2- 172.21.15.73:0/3526339794 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb32c0c37b0 0x7fb32c0c02b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:31.996 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:31.993+0000 7fb332439640 1 --2- 172.21.15.73:0/3526339794 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb32c14e700 0x7fb32c151cb0 unknown :-1 s=CLOSED pgs=1138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:31.996 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:31.993+0000 7fb332439640 1 -- 172.21.15.73:0/3526339794 >> 172.21.15.73:0/3526339794 conn(0x7fb32c0c23b0 msgr2=0x7fb32c0c2790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:47:31.996 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:31.993+0000 7fb332439640 1 -- 172.21.15.73:0/3526339794 shutdown_connections 2023-12-12T09:47:31.996 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:31.993+0000 7fb332439640 1 -- 172.21.15.73:0/3526339794 wait complete. 2023-12-12T09:47:31.998 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:31.995+0000 7fb332439640 1 Processor -- start 2023-12-12T09:47:31.998 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:31.995+0000 7fb332439640 1 -- start start 2023-12-12T09:47:31.998 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:31.996+0000 7fb332439640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb32c0ab4a0 0x7fb32c1529a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:31.998 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:31.996+0000 7fb332439640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb32c0c37b0 0x7fb32c144a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:31.998 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:31.996+0000 7fb332439640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb32c14e700 0x7fb32c14b8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:31.998 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:31.996+0000 7fb332439640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb32c146720 con 0x7fb32c14e700 2023-12-12T09:47:31.999 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:31.996+0000 7fb332439640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb32c146a00 con 0x7fb32c0c37b0 2023-12-12T09:47:31.999 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:31.996+0000 7fb332439640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb32c1477f0 con 0x7fb32c0ab4a0 2023-12-12T09:47:31.999 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:31.996+0000 7fb331c38640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb32c14e700 0x7fb32c14b8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:31.999 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:31.996+0000 7fb331c38640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb32c14e700 0x7fb32c14b8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:60114/0 (socket says 172.21.15.73:60114) 2023-12-12T09:47:31.999 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:31.996+0000 7fb331c38640 1 -- 172.21.15.73:0/1890767582 learned_addr learned my addr 172.21.15.73:0/1890767582 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:47:31.999 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:31.996+0000 7fb331437640 1 --2- 172.21.15.73:0/1890767582 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb32c0ab4a0 0x7fb32c1529a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:31.999 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:31.996+0000 7fb330c36640 1 --2- 172.21.15.73:0/1890767582 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb32c0c37b0 0x7fb32c144a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:31.999 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:31.996+0000 7fb331c38640 1 -- 172.21.15.73:0/1890767582 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb32c0ab4a0 msgr2=0x7fb32c1529a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:31.999 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:31.996+0000 7fb331c38640 1 --2- 172.21.15.73:0/1890767582 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb32c0ab4a0 0x7fb32c1529a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:32.000 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:31.996+0000 7fb331c38640 1 -- 172.21.15.73:0/1890767582 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb32c0c37b0 msgr2=0x7fb32c144a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:32.000 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:31.996+0000 7fb331c38640 1 --2- 172.21.15.73:0/1890767582 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb32c0c37b0 0x7fb32c144a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:32.000 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:31.996+0000 7fb331c38640 1 -- 172.21.15.73:0/1890767582 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb32800b770 con 0x7fb32c14e700 2023-12-12T09:47:32.000 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:31.996+0000 7fb330c36640 1 --2- 172.21.15.73:0/1890767582 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb32c0c37b0 0x7fb32c144a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:47:32.001 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:31.997+0000 7fb331c38640 1 --2- 172.21.15.73:0/1890767582 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb32c14e700 0x7fb32c14b8d0 secure :-1 s=READY pgs=1139 cs=0 l=1 rev1=1 crypto rx=0x7fb32400b970 tx=0x7fb32400be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:47:32.001 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:31.997+0000 7fb321ffb640 1 -- 172.21.15.73:0/1890767582 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb32400cb40 con 0x7fb32c14e700 2023-12-12T09:47:32.001 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:31.997+0000 7fb321ffb640 1 -- 172.21.15.73:0/1890767582 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb32400cca0 con 0x7fb32c14e700 2023-12-12T09:47:32.001 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:31.997+0000 7fb321ffb640 1 -- 172.21.15.73:0/1890767582 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb324014680 con 0x7fb32c14e700 2023-12-12T09:47:32.001 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:31.997+0000 7fb332439640 1 -- 172.21.15.73:0/1890767582 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb32c147510 con 0x7fb32c14e700 2023-12-12T09:47:32.002 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:31.997+0000 7fb332439640 1 -- 172.21.15.73:0/1890767582 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb32c1e6760 con 0x7fb32c14e700 2023-12-12T09:47:32.002 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:31.998+0000 7fb332439640 1 -- 172.21.15.73:0/1890767582 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb32c146b70 con 0x7fb32c14e700 2023-12-12T09:47:32.002 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:31.999+0000 7fb321ffb640 1 -- 172.21.15.73:0/1890767582 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fb32401d3b0 con 0x7fb32c14e700 2023-12-12T09:47:32.002 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:32.000+0000 7fb321ffb640 1 --2- 172.21.15.73:0/1890767582 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fb31006ae70 0x7fb31006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:32.003 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:32.000+0000 7fb321ffb640 1 -- 172.21.15.73:0/1890767582 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 5029+0+0 (secure 0 0 0) 0x7fb3240890a0 con 0x7fb32c14e700 2023-12-12T09:47:32.003 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:32.000+0000 7fb331437640 1 --2- 172.21.15.73:0/1890767582 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fb31006ae70 0x7fb31006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:32.003 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:32.001+0000 7fb331437640 1 --2- 172.21.15.73:0/1890767582 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fb31006ae70 0x7fb31006d330 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7fb328038000 tx=0x7fb328008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:47:32.006 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:32.005+0000 7fb321ffb640 1 -- 172.21.15.73:0/1890767582 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fb324054480 con 0x7fb32c14e700 2023-12-12T09:47:32.191 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:32.189+0000 7fb332439640 1 -- 172.21.15.73:0/1890767582 --> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fb32c1e6950 con 0x7fb31006ae70 2023-12-12T09:47:32.197 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:32.196+0000 7fb321ffb640 1 -- 172.21.15.73:0/1890767582 <== mgr.4110 v2:172.21.15.73:6832/779985841 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+48917 (secure 0 0 0) 0x7fb32c1e6950 con 0x7fb31006ae70 2023-12-12T09:47:32.198 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-12T09:47:32.198 INFO:teuthology.orchestra.run.smithi073.stderr:dumped all 2023-12-12T09:47:32.200 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:32.198+0000 7fb332439640 1 -- 172.21.15.73:0/1890767582 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fb31006ae70 msgr2=0x7fb31006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:32.200 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:32.198+0000 7fb332439640 1 --2- 172.21.15.73:0/1890767582 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fb31006ae70 0x7fb31006d330 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7fb328038000 tx=0x7fb328008040 comp rx=0 tx=0).stop 2023-12-12T09:47:32.200 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:32.198+0000 7fb332439640 1 -- 172.21.15.73:0/1890767582 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb32c14e700 msgr2=0x7fb32c14b8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:32.200 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:32.198+0000 7fb332439640 1 --2- 172.21.15.73:0/1890767582 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb32c14e700 0x7fb32c14b8d0 secure :-1 s=READY pgs=1139 cs=0 l=1 rev1=1 crypto rx=0x7fb32400b970 tx=0x7fb32400be30 comp rx=0 tx=0).stop 2023-12-12T09:47:32.201 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:32.198+0000 7fb332439640 1 -- 172.21.15.73:0/1890767582 shutdown_connections 2023-12-12T09:47:32.201 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:32.198+0000 7fb332439640 1 --2- 172.21.15.73:0/1890767582 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fb31006ae70 0x7fb31006d330 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:32.201 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:32.199+0000 7fb332439640 1 --2- 172.21.15.73:0/1890767582 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb32c14e700 0x7fb32c14b8d0 unknown :-1 s=CLOSED pgs=1139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:32.201 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:32.199+0000 7fb332439640 1 --2- 172.21.15.73:0/1890767582 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb32c0c37b0 0x7fb32c144a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:32.201 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:32.199+0000 7fb332439640 1 --2- 172.21.15.73:0/1890767582 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb32c0ab4a0 0x7fb32c1529a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:32.201 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:32.199+0000 7fb332439640 1 -- 172.21.15.73:0/1890767582 >> 172.21.15.73:0/1890767582 conn(0x7fb32c0c23b0 msgr2=0x7fb32c0c2790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:47:32.202 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:32.199+0000 7fb332439640 1 -- 172.21.15.73:0/1890767582 shutdown_connections 2023-12-12T09:47:32.202 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:32.199+0000 7fb332439640 1 -- 172.21.15.73:0/1890767582 wait complete. 2023-12-12T09:47:32.219 INFO:teuthology.orchestra.run.smithi073.stdout:{"pg_ready":true,"pg_map":{"version":209,"stamp":"2023-12-12T09:47:31.541643+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":257916,"kb_used_data":8472,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754716804,"statfs":{"total":773094113280,"available":772830007296,"internally_reserved":0,"allocated":8675328,"data_stored":5020707,"data_compressed":64844,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":12752,"internal_metadata":255315504},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":19,"apply_latency_ms":19,"commit_latency_ns":19000000,"apply_latency_ns":19000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-12384,"num_objects":-23,"num_object_clones":0,"num_object_copies":-46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-63,"num_write_kb":-34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.002463"},"pg_stats":[{"pgid":"1.0","version":"18'117","reported_seq":222,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-12T09:47:22.640586+0000","last_change":"2023-12-12T09:43:17.203315+0000","last_active":"2023-12-12T09:47:22.640586+0000","last_peered":"2023-12-12T09:47:22.640586+0000","last_clean":"2023-12-12T09:47:22.640586+0000","last_became_active":"2023-12-12T09:43:17.200779+0000","last_became_peered":"2023-12-12T09:43:17.200779+0000","last_unstale":"2023-12-12T09:47:22.640586+0000","last_undegraded":"2023-12-12T09:47:22.640586+0000","last_fullsized":"2023-12-12T09:47:22.640586+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:43:15.931922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:43:15.931922+0000","last_clean_scrub_stamp":"2023-12-12T09:43:15.931922+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T21:42:10.929640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":64844,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574903,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32280,"kb_used_data":1100,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339560,"statfs":{"total":96636764160,"available":96603709440,"internally_reserved":0,"allocated":1126400,"data_stored":1065190,"data_compressed":32422,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 12 09:47:18 2023","interfaces":[{"interface":"back","average":{"1min":1.0960000000000001,"5min":1.0649999999999999,"15min":1.0209999999999999},"min":{"1min":0.65700000000000003,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.534,"5min":1.8089999999999999,"15min":1.8089999999999999},"last":1.425},{"interface":"front","average":{"1min":1.1259999999999999,"5min":1.0640000000000001,"15min":0.99399999999999999},"min":{"1min":0.77700000000000002,"5min":0.66300000000000003,"15min":0.66300000000000003},"max":{"1min":1.544,"5min":1.71,"15min":1.71},"last":0.97299999999999998}]},{"osd":1,"last update":"Tue Dec 12 09:47:18 2023","interfaces":[{"interface":"back","average":{"1min":1.1519999999999999,"5min":1.2010000000000001,"15min":1.1990000000000001},"min":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"max":{"1min":1.5580000000000001,"5min":1.897,"15min":1.897},"last":1.1040000000000001},{"interface":"front","average":{"1min":1.1719999999999999,"5min":1.1739999999999999,"15min":1.202},"min":{"1min":0.80500000000000005,"5min":0.71499999999999997,"15min":0.71499999999999997},"max":{"1min":1.585,"5min":3.1150000000000002,"15min":3.1150000000000002},"last":1.78}]},{"osd":2,"last update":"Tue Dec 12 09:47:18 2023","interfaces":[{"interface":"back","average":{"1min":1.159,"5min":1.214,"15min":1.246},"min":{"1min":0.84499999999999997,"5min":0.77700000000000002,"15min":0.77700000000000002},"max":{"1min":1.544,"5min":2.2050000000000001,"15min":2.2050000000000001},"last":1.851},{"interface":"front","average":{"1min":1.075,"5min":1.169,"15min":1.2190000000000001},"min":{"1min":0.74199999999999999,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.4810000000000001,"5min":3.2759999999999998,"15min":3.2759999999999998},"last":1.2789999999999999}]},{"osd":3,"last update":"Tue Dec 12 09:47:18 2023","interfaces":[{"interface":"back","average":{"1min":1.133,"5min":1.2110000000000001,"15min":1.2809999999999999},"min":{"1min":0.80100000000000005,"5min":0.76700000000000002,"15min":0.76700000000000002},"max":{"1min":1.6830000000000001,"5min":3.1819999999999999,"15min":3.1819999999999999},"last":1.538},{"interface":"front","average":{"1min":1.3300000000000001,"5min":1.3009999999999999,"15min":1.2969999999999999},"min":{"1min":0.94399999999999995,"5min":0.72799999999999998,"15min":0.72799999999999998},"max":{"1min":1.641,"5min":1.8740000000000001,"15min":1.8740000000000001},"last":1.992}]},{"osd":4,"last update":"Tue Dec 12 09:47:18 2023","interfaces":[{"interface":"back","average":{"1min":1.3200000000000001,"5min":1.3080000000000001,"15min":1.337},"min":{"1min":0.65900000000000003,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.663,"5min":2.5529999999999999,"15min":2.5529999999999999},"last":1.6559999999999999},{"interface":"front","average":{"1min":1.3460000000000001,"5min":1.373,"15min":1.427},"min":{"1min":0.623,"5min":0.623,"15min":0.623},"max":{"1min":1.643,"5min":2.3759999999999999,"15min":2.3759999999999999},"last":1.341}]},{"osd":5,"last update":"Tue Dec 12 09:47:18 2023","interfaces":[{"interface":"back","average":{"1min":1.3480000000000001,"5min":1.3500000000000001,"15min":1.3400000000000001},"min":{"1min":0.78100000000000003,"5min":0.622,"15min":0.622},"max":{"1min":1.714,"5min":1.9890000000000001,"15min":1.9890000000000001},"last":1.714},{"interface":"front","average":{"1min":1.4510000000000001,"5min":1.482,"15min":1.518},"min":{"1min":0.68700000000000006,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":1.7270000000000001,"5min":2.4159999999999999,"15min":2.4159999999999999},"last":1.5900000000000001}]},{"osd":6,"last update":"Tue Dec 12 09:47:18 2023","interfaces":[{"interface":"back","average":{"1min":1.522,"5min":1.4370000000000001,"15min":1.423},"min":{"1min":0.83799999999999997,"5min":0.70799999999999996,"15min":0.70799999999999996},"max":{"1min":1.8,"5min":2.0510000000000002,"15min":2.0510000000000002},"last":1.4810000000000001},{"interface":"front","average":{"1min":1.5529999999999999,"5min":1.5740000000000001,"15min":1.6140000000000001},"min":{"1min":0.76000000000000001,"5min":0.71899999999999997,"15min":0.71899999999999997},"max":{"1min":1.865,"5min":2.5800000000000001,"15min":2.5800000000000001},"last":1.958}]}]},{"osd":6,"up_from":13,"seq":55834574901,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32228,"kb_used_data":1044,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339612,"statfs":{"total":96636764160,"available":96603762688,"internally_reserved":0,"allocated":1069056,"data_stored":480803,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 12 09:47:18 2023","interfaces":[{"interface":"back","average":{"1min":1.0149999999999999,"5min":1.0720000000000001,"15min":1.1519999999999999},"min":{"1min":0.65000000000000002,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.3859999999999999,"5min":3.6429999999999998,"15min":3.6429999999999998},"last":0.88300000000000001},{"interface":"front","average":{"1min":1.008,"5min":1.052,"15min":1.0640000000000001},"min":{"1min":0.627,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.7729999999999999,"5min":2.6059999999999999,"15min":2.6059999999999999},"last":0.79800000000000004}]},{"osd":1,"last update":"Tue Dec 12 09:47:18 2023","interfaces":[{"interface":"back","average":{"1min":1.196,"5min":1.1080000000000001,"15min":1.077},"min":{"1min":0.66400000000000003,"5min":0.64200000000000002,"15min":0.64200000000000002},"max":{"1min":1.5600000000000001,"5min":2.0169999999999999,"15min":2.0169999999999999},"last":0.96299999999999997},{"interface":"front","average":{"1min":1.163,"5min":1.1739999999999999,"15min":1.1919999999999999},"min":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"max":{"1min":1.71,"5min":1.71,"15min":1.71},"last":1.319}]},{"osd":2,"last update":"Tue Dec 12 09:47:18 2023","interfaces":[{"interface":"back","average":{"1min":1.0840000000000001,"5min":1.1839999999999999,"15min":1.218},"min":{"1min":0.77700000000000002,"5min":0.71199999999999997,"15min":0.71199999999999997},"max":{"1min":1.526,"5min":1.804,"15min":1.804},"last":1.2},{"interface":"front","average":{"1min":1.1240000000000001,"5min":1.22,"15min":1.282},"min":{"1min":0.72499999999999998,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":1.679,"5min":2.2160000000000002,"15min":2.2160000000000002},"last":1.258}]},{"osd":3,"last update":"Tue Dec 12 09:47:18 2023","interfaces":[{"interface":"back","average":{"1min":1.1140000000000001,"5min":1.1910000000000001,"15min":1.2090000000000001},"min":{"1min":0.73199999999999998,"5min":0.71899999999999997,"15min":0.71899999999999997},"max":{"1min":1.5309999999999999,"5min":2.665,"15min":2.665},"last":1.0880000000000001},{"interface":"front","average":{"1min":1.1180000000000001,"5min":1.1679999999999999,"15min":1.21},"min":{"1min":0.76700000000000002,"5min":0.65700000000000003,"15min":0.65700000000000003},"max":{"1min":1.4710000000000001,"5min":1.8620000000000001,"15min":1.8620000000000001},"last":1.153}]},{"osd":4,"last update":"Tue Dec 12 09:47:18 2023","interfaces":[{"interface":"back","average":{"1min":1.1870000000000001,"5min":1.2669999999999999,"15min":1.272},"min":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.696,"5min":2.0310000000000001,"15min":2.0310000000000001},"last":1.4079999999999999},{"interface":"front","average":{"1min":1.339,"5min":1.395,"15min":1.403},"min":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":1.853,"5min":2.2799999999999998,"15min":2.2799999999999998},"last":1.609}]},{"osd":5,"last update":"Tue Dec 12 09:47:18 2023","interfaces":[{"interface":"back","average":{"1min":1.2110000000000001,"5min":1.331,"15min":1.4039999999999999},"min":{"1min":0.55500000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":2.1419999999999999,"5min":2.1739999999999999,"15min":2.1739999999999999},"last":1.369},{"interface":"front","average":{"1min":1.3799999999999999,"5min":1.46,"15min":1.4710000000000001},"min":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"max":{"1min":2.2360000000000002,"5min":2.2360000000000002,"15min":2.2360000000000002},"last":1.556}]},{"osd":7,"last update":"Tue Dec 12 09:47:18 2023","interfaces":[{"interface":"back","average":{"1min":1.266,"5min":1.427,"15min":1.4810000000000001},"min":{"1min":0.67600000000000005,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.736,"5min":1.994,"15min":1.994},"last":1.712},{"interface":"front","average":{"1min":1.2689999999999999,"5min":1.427,"15min":1.5009999999999999},"min":{"1min":0.628,"5min":0.628,"15min":0.628},"max":{"1min":1.5820000000000001,"5min":2.0800000000000001,"15min":2.0800000000000001},"last":1.6619999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574901,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32224,"kb_used_data":1044,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339616,"statfs":{"total":96636764160,"available":96603766784,"internally_reserved":0,"allocated":1069056,"data_stored":480803,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 12 09:47:18 2023","interfaces":[{"interface":"back","average":{"1min":1.097,"5min":1.042,"15min":1.0269999999999999},"min":{"1min":0.84999999999999998,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.4890000000000001,"5min":1.7310000000000001,"15min":1.7310000000000001},"last":0.80800000000000005},{"interface":"front","average":{"1min":1.038,"5min":1.083,"15min":1.1140000000000001},"min":{"1min":0.68500000000000005,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.679,"5min":1.679,"15min":1.679},"last":0.78600000000000003}]},{"osd":1,"last update":"Tue Dec 12 09:47:18 2023","interfaces":[{"interface":"back","average":{"1min":1.266,"5min":1.1579999999999999,"15min":1.2030000000000001},"min":{"1min":0.77600000000000002,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":2.3359999999999999,"5min":2.3359999999999999,"15min":2.3359999999999999},"last":0.66700000000000004},{"interface":"front","average":{"1min":1.2230000000000001,"5min":1.1060000000000001,"15min":1.0960000000000001},"min":{"1min":0.71099999999999997,"5min":0.66400000000000003,"15min":0.66400000000000003},"max":{"1min":2.3780000000000001,"5min":2.3780000000000001,"15min":2.3780000000000001},"last":0.97299999999999998}]},{"osd":2,"last update":"Tue Dec 12 09:47:18 2023","interfaces":[{"interface":"back","average":{"1min":1.04,"5min":1.198,"15min":1.2769999999999999},"min":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"max":{"1min":1.4650000000000001,"5min":1.7889999999999999,"15min":1.7889999999999999},"last":0.72199999999999998},{"interface":"front","average":{"1min":1.1910000000000001,"5min":1.2549999999999999,"15min":1.365},"min":{"1min":0.82399999999999995,"5min":0.72899999999999998,"15min":0.72899999999999998},"max":{"1min":1.9950000000000001,"5min":2.1600000000000001,"15min":2.1600000000000001},"last":0.86099999999999999}]},{"osd":3,"last update":"Tue Dec 12 09:47:18 2023","interfaces":[{"interface":"back","average":{"1min":1.226,"5min":1.2669999999999999,"15min":1.3360000000000001},"min":{"1min":0.83399999999999996,"5min":0.77300000000000002,"15min":0.77300000000000002},"max":{"1min":1.831,"5min":2.1499999999999999,"15min":2.1499999999999999},"last":1.1890000000000001},{"interface":"front","average":{"1min":1.254,"5min":1.3660000000000001,"15min":1.45},"min":{"1min":0.879,"5min":0.75800000000000001,"15min":0.75800000000000001},"max":{"1min":1.7410000000000001,"5min":2.0249999999999999,"15min":2.0249999999999999},"last":0.91000000000000003}]},{"osd":4,"last update":"Tue Dec 12 09:47:18 2023","interfaces":[{"interface":"back","average":{"1min":1.361,"5min":1.3759999999999999,"15min":1.452},"min":{"1min":0.747,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":2.488,"5min":2.488,"15min":2.488},"last":1.0860000000000001},{"interface":"front","average":{"1min":1.4259999999999999,"5min":1.498,"15min":1.5580000000000001},"min":{"1min":0.71299999999999997,"5min":0.65300000000000002,"15min":0.65300000000000002},"max":{"1min":2.5870000000000002,"5min":2.6040000000000001,"15min":2.6040000000000001},"last":1.55}]},{"osd":6,"last update":"Tue Dec 12 09:47:18 2023","interfaces":[{"interface":"back","average":{"1min":1.28,"5min":1.448,"15min":1.546},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.9359999999999999,"5min":2.1179999999999999,"15min":2.1179999999999999},"last":1.1439999999999999},{"interface":"front","average":{"1min":1.345,"5min":1.452,"15min":1.571},"min":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":2.6589999999999998,"5min":2.6589999999999998,"15min":2.6589999999999998},"last":1.3069999999999999}]},{"osd":7,"last update":"Tue Dec 12 09:47:18 2023","interfaces":[{"interface":"back","average":{"1min":1.548,"5min":1.6399999999999999,"15min":1.736},"min":{"1min":0.90500000000000003,"5min":0.83699999999999997,"15min":0.83699999999999997},"max":{"1min":2.8519999999999999,"5min":2.8519999999999999,"15min":2.8519999999999999},"last":1.649},{"interface":"front","average":{"1min":1.4219999999999999,"5min":1.595,"15min":1.6970000000000001},"min":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"max":{"1min":2.0619999999999998,"5min":2.4910000000000001,"15min":2.4910000000000001},"last":1.0429999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574903,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32236,"kb_used_data":1056,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339604,"statfs":{"total":96636764160,"available":96603754496,"internally_reserved":0,"allocated":1081344,"data_stored":486282,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 12 09:47:20 2023","interfaces":[{"interface":"back","average":{"1min":1.107,"5min":1.0649999999999999,"15min":1.0580000000000001},"min":{"1min":0.70099999999999996,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":1.6579999999999999,"5min":1.7010000000000001,"15min":1.7010000000000001},"last":1.452},{"interface":"front","average":{"1min":1.266,"5min":1.1020000000000001,"15min":1.0700000000000001},"min":{"1min":0.90200000000000002,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":2.2010000000000001,"5min":2.2010000000000001,"15min":2.2010000000000001},"last":0.92000000000000004}]},{"osd":1,"last update":"Tue Dec 12 09:47:20 2023","interfaces":[{"interface":"back","average":{"1min":1.0229999999999999,"5min":1.044,"15min":1.044},"min":{"1min":0.69699999999999995,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":1.6180000000000001,"5min":1.6180000000000001,"15min":1.6180000000000001},"last":1.1870000000000001},{"interface":"front","average":{"1min":1.2330000000000001,"5min":1.1739999999999999,"15min":1.1779999999999999},"min":{"1min":0.76100000000000001,"5min":0.73699999999999999,"15min":0.73699999999999999},"max":{"1min":2.1600000000000001,"5min":2.1600000000000001,"15min":2.1600000000000001},"last":1.704}]},{"osd":2,"last update":"Tue Dec 12 09:47:20 2023","interfaces":[{"interface":"back","average":{"1min":1.131,"5min":1.139,"15min":1.125},"min":{"1min":0.82699999999999996,"5min":0.71299999999999997,"15min":0.71299999999999997},"max":{"1min":1.798,"5min":1.798,"15min":1.798},"last":1.1439999999999999},{"interface":"front","average":{"1min":1.3300000000000001,"5min":1.276,"15min":1.288},"min":{"1min":0.84499999999999997,"5min":0.75600000000000001,"15min":0.75600000000000001},"max":{"1min":2.2650000000000001,"5min":2.2650000000000001,"15min":2.2650000000000001},"last":1.5249999999999999}]},{"osd":3,"last update":"Tue Dec 12 09:47:20 2023","interfaces":[{"interface":"back","average":{"1min":1.2689999999999999,"5min":1.258,"15min":1.2210000000000001},"min":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"max":{"1min":1.948,"5min":1.948,"15min":1.948},"last":1.0369999999999999},{"interface":"front","average":{"1min":1.2050000000000001,"5min":1.228,"15min":1.234},"min":{"1min":0.80600000000000005,"5min":0.70599999999999996,"15min":0.70599999999999996},"max":{"1min":1.798,"5min":2.0499999999999998,"15min":2.0499999999999998},"last":1.3089999999999999}]},{"osd":5,"last update":"Tue Dec 12 09:47:20 2023","interfaces":[{"interface":"back","average":{"1min":1.399,"5min":1.4039999999999999,"15min":1.446},"min":{"1min":0.76800000000000002,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":2.0329999999999999,"5min":2.3159999999999998,"15min":2.3159999999999998},"last":1.258},{"interface":"front","average":{"1min":1.3959999999999999,"5min":1.389,"15min":1.363},"min":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"max":{"1min":2.0030000000000001,"5min":2.117,"15min":2.117},"last":1.2270000000000001}]},{"osd":6,"last update":"Tue Dec 12 09:47:20 2023","interfaces":[{"interface":"back","average":{"1min":1.3029999999999999,"5min":1.361,"15min":1.389},"min":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"max":{"1min":1.625,"5min":2.246,"15min":2.246},"last":1.387},{"interface":"front","average":{"1min":1.488,"5min":1.5209999999999999,"15min":1.5389999999999999},"min":{"1min":0.70899999999999996,"5min":0.65600000000000003,"15min":0.65600000000000003},"max":{"1min":2.093,"5min":2.5099999999999998,"15min":2.5099999999999998},"last":1.762}]},{"osd":7,"last update":"Tue Dec 12 09:47:20 2023","interfaces":[{"interface":"back","average":{"1min":1.484,"5min":1.5049999999999999,"15min":1.5049999999999999},"min":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"max":{"1min":2.0619999999999998,"5min":2.5710000000000002,"15min":2.5710000000000002},"last":1.3620000000000001},{"interface":"front","average":{"1min":1.464,"5min":1.512,"15min":1.512},"min":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"max":{"1min":1.994,"5min":2.3919999999999999,"15min":2.3919999999999999},"last":1.885}]}]},{"osd":3,"up_from":13,"seq":55834574901,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32232,"kb_used_data":1052,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339608,"statfs":{"total":96636764160,"available":96603758592,"internally_reserved":0,"allocated":1077248,"data_stored":486180,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 12 09:47:21 2023","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.80800000000000005,"15min":0.878},"min":{"1min":0.32300000000000001,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":1.1339999999999999,"5min":1.4830000000000001,"15min":1.4830000000000001},"last":0.80500000000000005},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.93400000000000005,"15min":1.069},"min":{"1min":0.48499999999999999,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":1.4730000000000001,"5min":3.3370000000000002,"15min":3.3370000000000002},"last":1.0009999999999999}]},{"osd":1,"last update":"Tue Dec 12 09:47:21 2023","interfaces":[{"interface":"back","average":{"1min":0.85199999999999998,"5min":0.86099999999999999,"15min":0.90000000000000002},"min":{"1min":0.38600000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":1.446,"5min":1.4870000000000001,"15min":1.4870000000000001},"last":1.4770000000000001},{"interface":"front","average":{"1min":0.96499999999999997,"5min":1,"15min":1.046},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.4970000000000001,"5min":2.9409999999999998,"15min":2.9409999999999998},"last":1.542}]},{"osd":2,"last update":"Tue Dec 12 09:47:21 2023","interfaces":[{"interface":"back","average":{"1min":0.92200000000000004,"5min":1.0229999999999999,"15min":1.1319999999999999},"min":{"1min":0.42399999999999999,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.345,"5min":2.613,"15min":2.613},"last":1.141},{"interface":"front","average":{"1min":0.92500000000000004,"5min":1.048,"15min":1.139},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":1.4179999999999999,"5min":3.0430000000000001,"15min":3.0430000000000001},"last":1.1739999999999999}]},{"osd":4,"last update":"Tue Dec 12 09:47:21 2023","interfaces":[{"interface":"back","average":{"1min":1.0409999999999999,"5min":1.2310000000000001,"15min":1.3320000000000001},"min":{"1min":0.64000000000000001,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.478,"5min":3.5019999999999998,"15min":3.5019999999999998},"last":1.216},{"interface":"front","average":{"1min":1.1910000000000001,"5min":1.2969999999999999,"15min":1.421},"min":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.8089999999999999,"5min":2.9889999999999999,"15min":2.9889999999999999},"last":1.2589999999999999}]},{"osd":5,"last update":"Tue Dec 12 09:47:21 2023","interfaces":[{"interface":"back","average":{"1min":1.149,"5min":1.341,"15min":1.4470000000000001},"min":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":1.542,"5min":4.2480000000000002,"15min":4.2480000000000002},"last":1.2989999999999999},{"interface":"front","average":{"1min":1.0880000000000001,"5min":1.3440000000000001,"15min":1.5089999999999999},"min":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.583,"5min":5.5060000000000002,"15min":5.5060000000000002},"last":1.5800000000000001}]},{"osd":6,"last update":"Tue Dec 12 09:47:21 2023","interfaces":[{"interface":"back","average":{"1min":1.238,"5min":1.3089999999999999,"15min":1.4079999999999999},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.714,"5min":3.1400000000000001,"15min":3.1400000000000001},"last":1.3320000000000001},{"interface":"front","average":{"1min":1.2490000000000001,"5min":1.397,"15min":1.4970000000000001},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.6120000000000001,"5min":4.3179999999999996,"15min":4.3179999999999996},"last":1.4179999999999999}]},{"osd":7,"last update":"Tue Dec 12 09:47:21 2023","interfaces":[{"interface":"back","average":{"1min":1.206,"5min":1.3859999999999999,"15min":1.5229999999999999},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.679,"5min":5.3979999999999997,"15min":5.3979999999999997},"last":1.514},{"interface":"front","average":{"1min":1.2929999999999999,"5min":1.3999999999999999,"15min":1.502},"min":{"1min":0.623,"5min":0.623,"15min":0.623},"max":{"1min":1.9690000000000001,"5min":3.4129999999999998,"15min":3.4129999999999998},"last":1.6120000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574901,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32228,"kb_used_data":1048,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339612,"statfs":{"total":96636764160,"available":96603762688,"internally_reserved":0,"allocated":1073152,"data_stored":480941,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 12 09:47:20 2023","interfaces":[{"interface":"back","average":{"1min":0.79200000000000004,"5min":0.79800000000000004,"15min":0.81200000000000006},"min":{"1min":0.40000000000000002,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":1.395,"5min":1.458,"15min":1.458},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.81499999999999995,"5min":0.875,"15min":0.90000000000000002},"min":{"1min":0.40100000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":1.28,"5min":2.4129999999999998,"15min":2.4129999999999998},"last":0.502}]},{"osd":1,"last update":"Tue Dec 12 09:47:20 2023","interfaces":[{"interface":"back","average":{"1min":0.91000000000000003,"5min":0.85599999999999998,"15min":0.86099999999999999},"min":{"1min":0.45800000000000002,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":1.5649999999999999,"5min":1.593,"15min":1.593},"last":0.746},{"interface":"front","average":{"1min":0.97699999999999998,"5min":0.91500000000000004,"15min":0.89600000000000002},"min":{"1min":0.55200000000000005,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.413,"5min":1.758,"15min":1.758},"last":0.68899999999999995}]},{"osd":3,"last update":"Tue Dec 12 09:47:20 2023","interfaces":[{"interface":"back","average":{"1min":0.98599999999999999,"5min":1.0189999999999999,"15min":1.044},"min":{"1min":0.60599999999999998,"5min":0.503,"15min":0.503},"max":{"1min":1.506,"5min":1.889,"15min":1.889},"last":0.79300000000000004},{"interface":"front","average":{"1min":0.875,"5min":0.93400000000000005,"15min":0.98399999999999999},"min":{"1min":0.48499999999999999,"5min":0.432,"15min":0.432},"max":{"1min":1.298,"5min":1.8120000000000001,"15min":1.8120000000000001},"last":0.84199999999999997}]},{"osd":4,"last update":"Tue Dec 12 09:47:20 2023","interfaces":[{"interface":"back","average":{"1min":1.157,"5min":1.177,"15min":1.21},"min":{"1min":0.83799999999999997,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.5409999999999999,"5min":2.5760000000000001,"15min":2.5760000000000001},"last":1.0409999999999999},{"interface":"front","average":{"1min":1.254,"5min":1.28,"15min":1.3560000000000001},"min":{"1min":0.84899999999999998,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.613,"5min":2.8069999999999999,"15min":2.8069999999999999},"last":1.365}]},{"osd":5,"last update":"Tue Dec 12 09:47:20 2023","interfaces":[{"interface":"back","average":{"1min":1.2470000000000001,"5min":1.3100000000000001,"15min":1.3560000000000001},"min":{"1min":0.89500000000000002,"5min":0.80500000000000005,"15min":0.80500000000000005},"max":{"1min":1.5720000000000001,"5min":2.3109999999999999,"15min":2.3109999999999999},"last":1.0740000000000001},{"interface":"front","average":{"1min":1.1950000000000001,"5min":1.25,"15min":1.3169999999999999},"min":{"1min":0.78400000000000003,"5min":0.627,"15min":0.627},"max":{"1min":1.7390000000000001,"5min":2.5110000000000001,"15min":2.5110000000000001},"last":1.1919999999999999}]},{"osd":6,"last update":"Tue Dec 12 09:47:20 2023","interfaces":[{"interface":"back","average":{"1min":1.3109999999999999,"5min":1.3540000000000001,"15min":1.409},"min":{"1min":0.92600000000000005,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":1.6319999999999999,"5min":2.907,"15min":2.907},"last":0.95299999999999996},{"interface":"front","average":{"1min":1.242,"5min":1.363,"15min":1.407},"min":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"max":{"1min":1.7509999999999999,"5min":2.6000000000000001,"15min":2.6000000000000001},"last":1.3420000000000001}]},{"osd":7,"last update":"Tue Dec 12 09:47:20 2023","interfaces":[{"interface":"back","average":{"1min":1.3220000000000001,"5min":1.3740000000000001,"15min":1.429},"min":{"1min":0.90900000000000003,"5min":0.70799999999999996,"15min":0.70799999999999996},"max":{"1min":1.577,"5min":2.3370000000000002,"15min":2.3370000000000002},"last":1.1060000000000001},{"interface":"front","average":{"1min":1.3480000000000001,"5min":1.4330000000000001,"15min":1.486},"min":{"1min":0.94699999999999995,"5min":0.84199999999999997,"15min":0.84199999999999997},"max":{"1min":1.8109999999999999,"5min":2.488,"15min":2.488},"last":1.446}]}]},{"osd":1,"up_from":13,"seq":55834574901,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32212,"kb_used_data":1032,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339628,"statfs":{"total":96636764160,"available":96603779072,"internally_reserved":0,"allocated":1056768,"data_stored":474848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 12 09:47:18 2023","interfaces":[{"interface":"back","average":{"1min":0.85799999999999998,"5min":0.83799999999999997,"15min":0.84999999999999998},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":1.46,"5min":2.794,"15min":2.794},"last":1.0009999999999999},{"interface":"front","average":{"1min":0.751,"5min":0.80300000000000005,"15min":0.84499999999999997},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":1.6359999999999999,"5min":2.1379999999999999,"15min":2.1379999999999999},"last":0.66100000000000003}]},{"osd":2,"last update":"Tue Dec 12 09:47:18 2023","interfaces":[{"interface":"back","average":{"1min":0.83399999999999996,"5min":0.90500000000000003,"15min":0.95899999999999996},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":1.2509999999999999,"5min":6.3390000000000004,"15min":6.3390000000000004},"last":1.0289999999999999},{"interface":"front","average":{"1min":0.90400000000000003,"5min":0.93400000000000005,"15min":0.95599999999999996},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.3400000000000001,"5min":2.823,"15min":2.823},"last":1.3460000000000001}]},{"osd":3,"last update":"Tue Dec 12 09:47:18 2023","interfaces":[{"interface":"back","average":{"1min":0.90900000000000003,"5min":1.004,"15min":1.0349999999999999},"min":{"1min":0.48999999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":1.919,"5min":2.7519999999999998,"15min":2.7519999999999998},"last":0.95299999999999996},{"interface":"front","average":{"1min":0.879,"5min":0.95899999999999996,"15min":0.99099999999999999},"min":{"1min":0.434,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":1.4430000000000001,"5min":2.2559999999999998,"15min":2.2559999999999998},"last":0.74399999999999999}]},{"osd":4,"last update":"Tue Dec 12 09:47:18 2023","interfaces":[{"interface":"back","average":{"1min":1.097,"5min":1.232,"15min":1.343},"min":{"1min":0.73499999999999999,"5min":0.68400000000000005,"15min":0.68400000000000005},"max":{"1min":1.883,"5min":6.423,"15min":6.423},"last":1.49},{"interface":"front","average":{"1min":1.1970000000000001,"5min":1.1910000000000001,"15min":1.1930000000000001},"min":{"1min":0.84299999999999997,"5min":0.80000000000000004,"15min":0.80000000000000004},"max":{"1min":1.9590000000000001,"5min":2.2309999999999999,"15min":2.2309999999999999},"last":1.0820000000000001}]},{"osd":5,"last update":"Tue Dec 12 09:47:18 2023","interfaces":[{"interface":"back","average":{"1min":1.236,"5min":1.3069999999999999,"15min":1.413},"min":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"max":{"1min":2.556,"5min":6.2830000000000004,"15min":6.2830000000000004},"last":1.583},{"interface":"front","average":{"1min":1.242,"5min":1.2989999999999999,"15min":1.349},"min":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"max":{"1min":2.3999999999999999,"5min":2.73,"15min":2.73},"last":1.2490000000000001}]},{"osd":6,"last update":"Tue Dec 12 09:47:18 2023","interfaces":[{"interface":"back","average":{"1min":1.2490000000000001,"5min":1.3839999999999999,"15min":1.5009999999999999},"min":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"max":{"1min":1.8520000000000001,"5min":6.468,"15min":6.468},"last":1.1990000000000001},{"interface":"front","average":{"1min":1.222,"5min":1.375,"15min":1.5109999999999999},"min":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"max":{"1min":1.978,"5min":6.3129999999999997,"15min":6.3129999999999997},"last":1.667}]},{"osd":7,"last update":"Tue Dec 12 09:47:18 2023","interfaces":[{"interface":"back","average":{"1min":1.1879999999999999,"5min":1.333,"15min":1.3819999999999999},"min":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"max":{"1min":1.8600000000000001,"5min":2.9009999999999998,"15min":2.9009999999999998},"last":1.3939999999999999},{"interface":"front","average":{"1min":1.1919999999999999,"5min":1.3799999999999999,"15min":1.4970000000000001},"min":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"max":{"1min":2.012,"5min":6.242,"15min":6.242},"last":1.29}]}]},{"osd":0,"up_from":13,"seq":55834574903,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32276,"kb_used_data":1096,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339564,"statfs":{"total":96636764160,"available":96603713536,"internally_reserved":0,"allocated":1122304,"data_stored":1065660,"data_compressed":32422,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Dec 12 09:47:21 2023","interfaces":[{"interface":"back","average":{"1min":0.82299999999999995,"5min":0.79000000000000004,"15min":0.77700000000000002},"min":{"1min":0.45600000000000002,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":1.446,"5min":1.639,"15min":1.639},"last":0.91400000000000003},{"interface":"front","average":{"1min":0.86799999999999999,"5min":0.83999999999999997,"15min":0.82399999999999995},"min":{"1min":0.39400000000000002,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":1.3979999999999999,"5min":1.5680000000000001,"15min":1.5680000000000001},"last":0.97899999999999998}]},{"osd":2,"last update":"Tue Dec 12 09:47:21 2023","interfaces":[{"interface":"back","average":{"1min":0.90100000000000002,"5min":0.88800000000000001,"15min":0.87},"min":{"1min":0.58699999999999997,"5min":0.316,"15min":0.316},"max":{"1min":1.4910000000000001,"5min":1.748,"15min":1.748},"last":1.2150000000000001},{"interface":"front","average":{"1min":0.94399999999999995,"5min":0.96399999999999997,"15min":0.98399999999999999},"min":{"1min":0.47299999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":1.4910000000000001,"5min":1.649,"15min":1.649},"last":1.4990000000000001}]},{"osd":3,"last update":"Tue Dec 12 09:47:21 2023","interfaces":[{"interface":"back","average":{"1min":0.96199999999999997,"5min":0.86299999999999999,"15min":0.85599999999999998},"min":{"1min":0.42999999999999999,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":2.1800000000000002,"5min":2.1800000000000002,"15min":2.1800000000000002},"last":1.0669999999999999},{"interface":"front","average":{"1min":1.034,"5min":1.0189999999999999,"15min":1.0089999999999999},"min":{"1min":0.55100000000000005,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":1.877,"5min":2.3210000000000002,"15min":2.3210000000000002},"last":1.3149999999999999}]},{"osd":4,"last update":"Tue Dec 12 09:47:21 2023","interfaces":[{"interface":"back","average":{"1min":1.2310000000000001,"5min":1.2729999999999999,"15min":1.282},"min":{"1min":0.86199999999999999,"5min":0.80400000000000005,"15min":0.80400000000000005},"max":{"1min":1.758,"5min":2.073,"15min":2.073},"last":1.589},{"interface":"front","average":{"1min":1.3460000000000001,"5min":1.276,"15min":1.2869999999999999},"min":{"1min":0.90500000000000003,"5min":0.64400000000000002,"15min":0.64400000000000002},"max":{"1min":2.0990000000000002,"5min":3.0699999999999998,"15min":3.0699999999999998},"last":1.7529999999999999}]},{"osd":5,"last update":"Tue Dec 12 09:47:21 2023","interfaces":[{"interface":"back","average":{"1min":1.2629999999999999,"5min":1.2150000000000001,"15min":1.2270000000000001},"min":{"1min":0.71199999999999997,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":2.2730000000000001,"5min":3.1909999999999998,"15min":3.1909999999999998},"last":1.4359999999999999},{"interface":"front","average":{"1min":1.3120000000000001,"5min":1.2929999999999999,"15min":1.302},"min":{"1min":0.88500000000000001,"5min":0.67300000000000004,"15min":0.67300000000000004},"max":{"1min":1.7110000000000001,"5min":2.2120000000000002,"15min":2.2120000000000002},"last":1.8080000000000001}]},{"osd":6,"last update":"Tue Dec 12 09:47:21 2023","interfaces":[{"interface":"back","average":{"1min":1.278,"5min":1.3220000000000001,"15min":1.3320000000000001},"min":{"1min":0.83199999999999996,"5min":0.67500000000000004,"15min":0.67500000000000004},"max":{"1min":1.6180000000000001,"5min":2.04,"15min":2.04},"last":1.625},{"interface":"front","average":{"1min":1.321,"5min":1.3520000000000001,"15min":1.3779999999999999},"min":{"1min":0.80900000000000005,"5min":0.67500000000000004,"15min":0.67500000000000004},"max":{"1min":2.0670000000000002,"5min":2.9100000000000001,"15min":2.9100000000000001},"last":1.2529999999999999}]},{"osd":7,"last update":"Tue Dec 12 09:47:21 2023","interfaces":[{"interface":"back","average":{"1min":1.423,"5min":1.4079999999999999,"15min":1.4319999999999999},"min":{"1min":0.999,"5min":0.66800000000000004,"15min":0.66800000000000004},"max":{"1min":1.8200000000000001,"5min":2.992,"15min":2.992},"last":1.153},{"interface":"front","average":{"1min":1.3879999999999999,"5min":1.3380000000000001,"15min":1.3320000000000001},"min":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"max":{"1min":1.9299999999999999,"5min":2.7690000000000001,"15min":2.7690000000000001},"last":1.5449999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32422,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32422,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-12T09:47:32.221 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-12T09:47:32.437 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:32.435+0000 7f130a3de640 1 Processor -- start 2023-12-12T09:47:32.437 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:32.435+0000 7f130a3de640 1 -- start start 2023-12-12T09:47:32.438 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:32.437+0000 7f130a3de640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f130406a4e0 0x7f1304154f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:32.439 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:32.437+0000 7f130a3de640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f130406ad50 con 0x7f130406a8c0 2023-12-12T09:47:32.439 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:32.437+0000 7f130a3de640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13040c0a60 con 0x7f13040c49d0 2023-12-12T09:47:32.439 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:32.437+0000 7f130a3de640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1304155570 con 0x7f130406a4e0 2023-12-12T09:47:32.441 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:32.437+0000 7f130897b640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f130406a8c0 0x7f13040c24e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:54586/0 (socket says 172.21.15.73:54586) 2023-12-12T09:47:32.441 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:32.437+0000 7f130897b640 1 -- 172.21.15.73:0/4007193699 learned_addr learned my addr 172.21.15.73:0/4007193699 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-12T09:47:32.441 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:32.438+0000 7f1303fff640 1 --2- 172.21.15.73:0/4007193699 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f130406a4e0 0x7f1304154f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:32.441 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:32.438+0000 7f13037fe640 1 -- 172.21.15.73:0/4007193699 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3656429660 0 0) 0x7f12fc001490 con 0x7f130406a8c0 2023-12-12T09:47:32.441 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:32.438+0000 7f13037fe640 1 -- 172.21.15.73:0/4007193699 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f12f0003520 con 0x7f130406a8c0 2023-12-12T09:47:32.441 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:32.438+0000 7f13037fe640 1 -- 172.21.15.73:0/4007193699 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1255980274 0 0) 0x7f12f0003520 con 0x7f130406a8c0 2023-12-12T09:47:32.441 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:32.438+0000 7f13037fe640 1 -- 172.21.15.73:0/4007193699 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f130406a4e0 msgr2=0x7f1304154f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:47:32.442 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:32.438+0000 7f13037fe640 1 --2- 172.21.15.73:0/4007193699 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f130406a4e0 0x7f1304154f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:32.442 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:32.438+0000 7f13037fe640 1 -- 172.21.15.73:0/4007193699 >> v1:172.21.15.142:6789/0 conn(0x7f13040c49d0 legacy=0x7f1304151940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:32.442 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:32.438+0000 7f13037fe640 1 -- 172.21.15.73:0/4007193699 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13040c6580 con 0x7f130406a8c0 2023-12-12T09:47:32.442 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:32.438+0000 7f13037fe640 1 -- 172.21.15.73:0/4007193699 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3186547832 0 0) 0x7f12fc001b80 con 0x7f130406a8c0 2023-12-12T09:47:32.442 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:32.438+0000 7f13037fe640 1 -- 172.21.15.73:0/4007193699 >> v1:172.21.15.73:6789/0 conn(0x7f130406a8c0 legacy=0x7f13040c24e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:32.442 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:32.438+0000 7f13037fe640 1 --2- 172.21.15.73:0/4007193699 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f130406a4e0 0x7f12f00039a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:32.442 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:32.438+0000 7f13037fe640 1 --2- 172.21.15.73:0/4007193699 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f12f0003f20 0x7f12f00047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:32.442 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:32.438+0000 7f13037fe640 1 --2- 172.21.15.73:0/4007193699 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f12f0004d00 0x7f12f0005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:32.443 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:32.438+0000 7f13037fe640 1 -- 172.21.15.73:0/4007193699 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1304155570 con 0x7f12f0003f20 2023-12-12T09:47:32.443 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:32.438+0000 7f13037fe640 1 -- 172.21.15.73:0/4007193699 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12f000bb10 con 0x7f12f0004d00 2023-12-12T09:47:32.443 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:32.438+0000 7f13037fe640 1 -- 172.21.15.73:0/4007193699 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12f000bcd0 con 0x7f130406a4e0 2023-12-12T09:47:32.443 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:32.439+0000 7f12fbfff640 1 --2- 172.21.15.73:0/4007193699 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f12f0003f20 0x7f12f00047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:32.443 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:32.439+0000 7f1303fff640 1 --2- 172.21.15.73:0/4007193699 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f130406a4e0 0x7f12f00039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:32.443 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:32.439+0000 7f12fbfff640 1 -- 172.21.15.73:0/4007193699 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f130406a4e0 msgr2=0x7f12f00039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:47:32.443 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:32.439+0000 7f12fbfff640 1 --2- 172.21.15.73:0/4007193699 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f130406a4e0 0x7f12f00039a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:32.443 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:32.439+0000 7f12fbfff640 1 -- 172.21.15.73:0/4007193699 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f12f0004d00 msgr2=0x7f12f0005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:47:32.443 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:32.439+0000 7f12fbfff640 1 --2- 172.21.15.73:0/4007193699 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f12f0004d00 0x7f12f0005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:32.444 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:32.439+0000 7f12fbfff640 1 -- 172.21.15.73:0/4007193699 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12f0003520 con 0x7f12f0003f20 2023-12-12T09:47:32.445 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:32.440+0000 7f12fbfff640 1 --2- 172.21.15.73:0/4007193699 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f12f0003f20 0x7f12f00047c0 secure :-1 s=READY pgs=1141 cs=0 l=1 rev1=1 crypto rx=0x7f12ec001750 tx=0x7f12f00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0581fdf71cb051f server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:47:32.445 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:32.441+0000 7f13037fe640 1 -- 172.21.15.73:0/4007193699 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12ec0052d0 con 0x7f12f0003f20 2023-12-12T09:47:32.445 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:32.441+0000 7f13037fe640 1 -- 172.21.15.73:0/4007193699 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12ec02e050 con 0x7f12f0003f20 2023-12-12T09:47:32.445 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:32.441+0000 7f13037fe640 1 -- 172.21.15.73:0/4007193699 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12ec0035f0 con 0x7f12f0003f20 2023-12-12T09:47:32.446 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:32.441+0000 7f130a3de640 1 -- 172.21.15.73:0/4007193699 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f12f0003f20 msgr2=0x7f12f00047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:32.446 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:32.441+0000 7f130a3de640 1 --2- 172.21.15.73:0/4007193699 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f12f0003f20 0x7f12f00047c0 secure :-1 s=READY pgs=1141 cs=0 l=1 rev1=1 crypto rx=0x7f12ec001750 tx=0x7f12f00057f0 comp rx=0 tx=0).stop 2023-12-12T09:47:32.446 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:32.441+0000 7f130897b640 1 -- 172.21.15.73:0/4007193699 reap_dead start 2023-12-12T09:47:32.446 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:32.442+0000 7f130a3de640 1 -- 172.21.15.73:0/4007193699 shutdown_connections 2023-12-12T09:47:32.446 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:32.442+0000 7f130a3de640 1 -- 172.21.15.73:0/4007193699 >> 172.21.15.73:0/4007193699 conn(0x7f13040c35d0 msgr2=0x7f13040c39e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:47:32.446 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:32.442+0000 7f130a3de640 1 -- 172.21.15.73:0/4007193699 shutdown_connections 2023-12-12T09:47:32.446 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:32.442+0000 7f130a3de640 1 -- 172.21.15.73:0/4007193699 wait complete. 2023-12-12T09:47:32.446 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:32.443+0000 7f130a3de640 1 Processor -- start 2023-12-12T09:47:32.447 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:32.444+0000 7f130a3de640 1 -- start start 2023-12-12T09:47:32.448 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:32.444+0000 7f130a3de640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f12f0003f20 0x7f1304150610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:32.448 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:32.444+0000 7f130a3de640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f13041ed600 0x7f13041eda80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:32.449 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:32.444+0000 7f130a3de640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f13041edfc0 0x7f13041533d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:32.449 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:32.445+0000 7f130a3de640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13041568e0 con 0x7f13041ed600 2023-12-12T09:47:32.449 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:32.445+0000 7f130a3de640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13040ac0a0 con 0x7f13041edfc0 2023-12-12T09:47:32.449 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:32.445+0000 7f130a3de640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13040abdc0 con 0x7f12f0003f20 2023-12-12T09:47:32.449 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:32.445+0000 7f12fbfff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f13041ed600 0x7f13041eda80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:32.449 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:32.445+0000 7f12fbfff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f13041ed600 0x7f13041eda80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:60134/0 (socket says 172.21.15.73:60134) 2023-12-12T09:47:32.449 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:32.445+0000 7f12fbfff640 1 -- 172.21.15.73:0/3691832463 learned_addr learned my addr 172.21.15.73:0/3691832463 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:47:32.449 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:32.445+0000 7f12fbfff640 1 -- 172.21.15.73:0/3691832463 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f12f0003f20 msgr2=0x7f1304150610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:32.450 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:32.445+0000 7f12fbfff640 1 --2- 172.21.15.73:0/3691832463 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f12f0003f20 0x7f1304150610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:32.450 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:32.445+0000 7f12fbfff640 1 -- 172.21.15.73:0/3691832463 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f13041edfc0 msgr2=0x7f13041533d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:32.450 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:32.445+0000 7f12fbfff640 1 --2- 172.21.15.73:0/3691832463 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f13041edfc0 0x7f13041533d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:32.450 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:32.445+0000 7f12fbfff640 1 -- 172.21.15.73:0/3691832463 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1304156290 con 0x7f13041ed600 2023-12-12T09:47:32.450 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:32.445+0000 7f12fbfff640 1 --2- 172.21.15.73:0/3691832463 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f13041ed600 0x7f13041eda80 secure :-1 s=READY pgs=1142 cs=0 l=1 rev1=1 crypto rx=0x7f12ec02bc30 tx=0x7f12ec001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:47:32.450 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:32.446+0000 7f13017fa640 1 -- 172.21.15.73:0/3691832463 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12ec0076c0 con 0x7f13041ed600 2023-12-12T09:47:32.450 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:32.446+0000 7f13017fa640 1 -- 172.21.15.73:0/3691832463 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12ec007a30 con 0x7f13041ed600 2023-12-12T09:47:32.450 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:32.446+0000 7f13017fa640 1 -- 172.21.15.73:0/3691832463 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12ec006be0 con 0x7f13041ed600 2023-12-12T09:47:32.450 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:32.446+0000 7f130a3de640 1 -- 172.21.15.73:0/3691832463 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1304156570 con 0x7f13041ed600 2023-12-12T09:47:32.451 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:32.446+0000 7f130a3de640 1 -- 172.21.15.73:0/3691832463 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13041558e0 con 0x7f13041ed600 2023-12-12T09:47:32.451 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:32.447+0000 7f130a3de640 1 -- 172.21.15.73:0/3691832463 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1304067580 con 0x7f13041ed600 2023-12-12T09:47:32.451 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:32.448+0000 7f13017fa640 1 -- 172.21.15.73:0/3691832463 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f12ec006d40 con 0x7f13041ed600 2023-12-12T09:47:32.452 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:32.449+0000 7f13017fa640 1 --2- 172.21.15.73:0/3691832463 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f12e406ae70 0x7f12e406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:32.452 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:32.449+0000 7f13017fa640 1 -- 172.21.15.73:0/3691832463 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f12ec0aafd0 con 0x7f13041ed600 2023-12-12T09:47:32.452 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:32.449+0000 7f1303fff640 1 --2- 172.21.15.73:0/3691832463 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f12e406ae70 0x7f12e406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:32.452 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:32.450+0000 7f1303fff640 1 --2- 172.21.15.73:0/3691832463 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f12e406ae70 0x7f12e406d330 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f1304154830 tx=0x7f12f4008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:47:32.455 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:32.453+0000 7f13017fa640 1 -- 172.21.15.73:0/3691832463 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f12ec076310 con 0x7f13041ed600 2023-12-12T09:47:32.641 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:32.639+0000 7f130a3de640 1 -- 172.21.15.73:0/3691832463 --> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f13040c0d40 con 0x7f12e406ae70 2023-12-12T09:47:32.645 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:32.643+0000 7f13017fa640 1 -- 172.21.15.73:0/3691832463 <== mgr.4110 v2:172.21.15.73:6832/779985841 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+48917 (secure 0 0 0) 0x7f12f40095c0 con 0x7f12e406ae70 2023-12-12T09:47:32.645 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-12T09:47:32.646 INFO:teuthology.orchestra.run.smithi073.stderr:dumped all 2023-12-12T09:47:32.648 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:32.646+0000 7f130a3de640 1 -- 172.21.15.73:0/3691832463 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f12e406ae70 msgr2=0x7f12e406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:32.648 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:32.646+0000 7f130a3de640 1 --2- 172.21.15.73:0/3691832463 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f12e406ae70 0x7f12e406d330 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f1304154830 tx=0x7f12f4008040 comp rx=0 tx=0).stop 2023-12-12T09:47:32.648 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:32.646+0000 7f130a3de640 1 -- 172.21.15.73:0/3691832463 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f13041ed600 msgr2=0x7f13041eda80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:32.648 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:32.646+0000 7f130a3de640 1 --2- 172.21.15.73:0/3691832463 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f13041ed600 0x7f13041eda80 secure :-1 s=READY pgs=1142 cs=0 l=1 rev1=1 crypto rx=0x7f12ec02bc30 tx=0x7f12ec001120 comp rx=0 tx=0).stop 2023-12-12T09:47:32.648 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:32.646+0000 7f130a3de640 1 -- 172.21.15.73:0/3691832463 shutdown_connections 2023-12-12T09:47:32.648 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:32.646+0000 7f130a3de640 1 --2- 172.21.15.73:0/3691832463 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f12e406ae70 0x7f12e406d330 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:32.649 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:32.646+0000 7f130a3de640 1 --2- 172.21.15.73:0/3691832463 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f13041edfc0 0x7f13041533d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:32.649 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:32.646+0000 7f130a3de640 1 --2- 172.21.15.73:0/3691832463 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f13041ed600 0x7f13041eda80 unknown :-1 s=CLOSED pgs=1142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:32.649 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:32.646+0000 7f130a3de640 1 --2- 172.21.15.73:0/3691832463 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f12f0003f20 0x7f1304150610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:32.649 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:32.646+0000 7f130a3de640 1 -- 172.21.15.73:0/3691832463 >> 172.21.15.73:0/3691832463 conn(0x7f13040c35d0 msgr2=0x7f13040a66b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:47:32.649 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:32.646+0000 7f130a3de640 1 -- 172.21.15.73:0/3691832463 shutdown_connections 2023-12-12T09:47:32.649 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:32.646+0000 7f130a3de640 1 -- 172.21.15.73:0/3691832463 wait complete. 2023-12-12T09:47:32.667 INFO:teuthology.orchestra.run.smithi073.stdout:{"pg_ready":true,"pg_map":{"version":209,"stamp":"2023-12-12T09:47:31.541643+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":257916,"kb_used_data":8472,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754716804,"statfs":{"total":773094113280,"available":772830007296,"internally_reserved":0,"allocated":8675328,"data_stored":5020707,"data_compressed":64844,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":12752,"internal_metadata":255315504},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":19,"apply_latency_ms":19,"commit_latency_ns":19000000,"apply_latency_ns":19000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-12384,"num_objects":-23,"num_object_clones":0,"num_object_copies":-46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-63,"num_write_kb":-34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.002463"},"pg_stats":[{"pgid":"1.0","version":"18'117","reported_seq":222,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-12T09:47:22.640586+0000","last_change":"2023-12-12T09:43:17.203315+0000","last_active":"2023-12-12T09:47:22.640586+0000","last_peered":"2023-12-12T09:47:22.640586+0000","last_clean":"2023-12-12T09:47:22.640586+0000","last_became_active":"2023-12-12T09:43:17.200779+0000","last_became_peered":"2023-12-12T09:43:17.200779+0000","last_unstale":"2023-12-12T09:47:22.640586+0000","last_undegraded":"2023-12-12T09:47:22.640586+0000","last_fullsized":"2023-12-12T09:47:22.640586+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:43:15.931922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:43:15.931922+0000","last_clean_scrub_stamp":"2023-12-12T09:43:15.931922+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T21:42:10.929640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":64844,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574903,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32280,"kb_used_data":1100,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339560,"statfs":{"total":96636764160,"available":96603709440,"internally_reserved":0,"allocated":1126400,"data_stored":1065190,"data_compressed":32422,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 12 09:47:18 2023","interfaces":[{"interface":"back","average":{"1min":1.0960000000000001,"5min":1.0649999999999999,"15min":1.0209999999999999},"min":{"1min":0.65700000000000003,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.534,"5min":1.8089999999999999,"15min":1.8089999999999999},"last":1.425},{"interface":"front","average":{"1min":1.1259999999999999,"5min":1.0640000000000001,"15min":0.99399999999999999},"min":{"1min":0.77700000000000002,"5min":0.66300000000000003,"15min":0.66300000000000003},"max":{"1min":1.544,"5min":1.71,"15min":1.71},"last":0.97299999999999998}]},{"osd":1,"last update":"Tue Dec 12 09:47:18 2023","interfaces":[{"interface":"back","average":{"1min":1.1519999999999999,"5min":1.2010000000000001,"15min":1.1990000000000001},"min":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"max":{"1min":1.5580000000000001,"5min":1.897,"15min":1.897},"last":1.1040000000000001},{"interface":"front","average":{"1min":1.1719999999999999,"5min":1.1739999999999999,"15min":1.202},"min":{"1min":0.80500000000000005,"5min":0.71499999999999997,"15min":0.71499999999999997},"max":{"1min":1.585,"5min":3.1150000000000002,"15min":3.1150000000000002},"last":1.78}]},{"osd":2,"last update":"Tue Dec 12 09:47:18 2023","interfaces":[{"interface":"back","average":{"1min":1.159,"5min":1.214,"15min":1.246},"min":{"1min":0.84499999999999997,"5min":0.77700000000000002,"15min":0.77700000000000002},"max":{"1min":1.544,"5min":2.2050000000000001,"15min":2.2050000000000001},"last":1.851},{"interface":"front","average":{"1min":1.075,"5min":1.169,"15min":1.2190000000000001},"min":{"1min":0.74199999999999999,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.4810000000000001,"5min":3.2759999999999998,"15min":3.2759999999999998},"last":1.2789999999999999}]},{"osd":3,"last update":"Tue Dec 12 09:47:18 2023","interfaces":[{"interface":"back","average":{"1min":1.133,"5min":1.2110000000000001,"15min":1.2809999999999999},"min":{"1min":0.80100000000000005,"5min":0.76700000000000002,"15min":0.76700000000000002},"max":{"1min":1.6830000000000001,"5min":3.1819999999999999,"15min":3.1819999999999999},"last":1.538},{"interface":"front","average":{"1min":1.3300000000000001,"5min":1.3009999999999999,"15min":1.2969999999999999},"min":{"1min":0.94399999999999995,"5min":0.72799999999999998,"15min":0.72799999999999998},"max":{"1min":1.641,"5min":1.8740000000000001,"15min":1.8740000000000001},"last":1.992}]},{"osd":4,"last update":"Tue Dec 12 09:47:18 2023","interfaces":[{"interface":"back","average":{"1min":1.3200000000000001,"5min":1.3080000000000001,"15min":1.337},"min":{"1min":0.65900000000000003,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.663,"5min":2.5529999999999999,"15min":2.5529999999999999},"last":1.6559999999999999},{"interface":"front","average":{"1min":1.3460000000000001,"5min":1.373,"15min":1.427},"min":{"1min":0.623,"5min":0.623,"15min":0.623},"max":{"1min":1.643,"5min":2.3759999999999999,"15min":2.3759999999999999},"last":1.341}]},{"osd":5,"last update":"Tue Dec 12 09:47:18 2023","interfaces":[{"interface":"back","average":{"1min":1.3480000000000001,"5min":1.3500000000000001,"15min":1.3400000000000001},"min":{"1min":0.78100000000000003,"5min":0.622,"15min":0.622},"max":{"1min":1.714,"5min":1.9890000000000001,"15min":1.9890000000000001},"last":1.714},{"interface":"front","average":{"1min":1.4510000000000001,"5min":1.482,"15min":1.518},"min":{"1min":0.68700000000000006,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":1.7270000000000001,"5min":2.4159999999999999,"15min":2.4159999999999999},"last":1.5900000000000001}]},{"osd":6,"last update":"Tue Dec 12 09:47:18 2023","interfaces":[{"interface":"back","average":{"1min":1.522,"5min":1.4370000000000001,"15min":1.423},"min":{"1min":0.83799999999999997,"5min":0.70799999999999996,"15min":0.70799999999999996},"max":{"1min":1.8,"5min":2.0510000000000002,"15min":2.0510000000000002},"last":1.4810000000000001},{"interface":"front","average":{"1min":1.5529999999999999,"5min":1.5740000000000001,"15min":1.6140000000000001},"min":{"1min":0.76000000000000001,"5min":0.71899999999999997,"15min":0.71899999999999997},"max":{"1min":1.865,"5min":2.5800000000000001,"15min":2.5800000000000001},"last":1.958}]}]},{"osd":6,"up_from":13,"seq":55834574901,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32228,"kb_used_data":1044,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339612,"statfs":{"total":96636764160,"available":96603762688,"internally_reserved":0,"allocated":1069056,"data_stored":480803,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 12 09:47:18 2023","interfaces":[{"interface":"back","average":{"1min":1.0149999999999999,"5min":1.0720000000000001,"15min":1.1519999999999999},"min":{"1min":0.65000000000000002,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.3859999999999999,"5min":3.6429999999999998,"15min":3.6429999999999998},"last":0.88300000000000001},{"interface":"front","average":{"1min":1.008,"5min":1.052,"15min":1.0640000000000001},"min":{"1min":0.627,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.7729999999999999,"5min":2.6059999999999999,"15min":2.6059999999999999},"last":0.79800000000000004}]},{"osd":1,"last update":"Tue Dec 12 09:47:18 2023","interfaces":[{"interface":"back","average":{"1min":1.196,"5min":1.1080000000000001,"15min":1.077},"min":{"1min":0.66400000000000003,"5min":0.64200000000000002,"15min":0.64200000000000002},"max":{"1min":1.5600000000000001,"5min":2.0169999999999999,"15min":2.0169999999999999},"last":0.96299999999999997},{"interface":"front","average":{"1min":1.163,"5min":1.1739999999999999,"15min":1.1919999999999999},"min":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"max":{"1min":1.71,"5min":1.71,"15min":1.71},"last":1.319}]},{"osd":2,"last update":"Tue Dec 12 09:47:18 2023","interfaces":[{"interface":"back","average":{"1min":1.0840000000000001,"5min":1.1839999999999999,"15min":1.218},"min":{"1min":0.77700000000000002,"5min":0.71199999999999997,"15min":0.71199999999999997},"max":{"1min":1.526,"5min":1.804,"15min":1.804},"last":1.2},{"interface":"front","average":{"1min":1.1240000000000001,"5min":1.22,"15min":1.282},"min":{"1min":0.72499999999999998,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":1.679,"5min":2.2160000000000002,"15min":2.2160000000000002},"last":1.258}]},{"osd":3,"last update":"Tue Dec 12 09:47:18 2023","interfaces":[{"interface":"back","average":{"1min":1.1140000000000001,"5min":1.1910000000000001,"15min":1.2090000000000001},"min":{"1min":0.73199999999999998,"5min":0.71899999999999997,"15min":0.71899999999999997},"max":{"1min":1.5309999999999999,"5min":2.665,"15min":2.665},"last":1.0880000000000001},{"interface":"front","average":{"1min":1.1180000000000001,"5min":1.1679999999999999,"15min":1.21},"min":{"1min":0.76700000000000002,"5min":0.65700000000000003,"15min":0.65700000000000003},"max":{"1min":1.4710000000000001,"5min":1.8620000000000001,"15min":1.8620000000000001},"last":1.153}]},{"osd":4,"last update":"Tue Dec 12 09:47:18 2023","interfaces":[{"interface":"back","average":{"1min":1.1870000000000001,"5min":1.2669999999999999,"15min":1.272},"min":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.696,"5min":2.0310000000000001,"15min":2.0310000000000001},"last":1.4079999999999999},{"interface":"front","average":{"1min":1.339,"5min":1.395,"15min":1.403},"min":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":1.853,"5min":2.2799999999999998,"15min":2.2799999999999998},"last":1.609}]},{"osd":5,"last update":"Tue Dec 12 09:47:18 2023","interfaces":[{"interface":"back","average":{"1min":1.2110000000000001,"5min":1.331,"15min":1.4039999999999999},"min":{"1min":0.55500000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":2.1419999999999999,"5min":2.1739999999999999,"15min":2.1739999999999999},"last":1.369},{"interface":"front","average":{"1min":1.3799999999999999,"5min":1.46,"15min":1.4710000000000001},"min":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"max":{"1min":2.2360000000000002,"5min":2.2360000000000002,"15min":2.2360000000000002},"last":1.556}]},{"osd":7,"last update":"Tue Dec 12 09:47:18 2023","interfaces":[{"interface":"back","average":{"1min":1.266,"5min":1.427,"15min":1.4810000000000001},"min":{"1min":0.67600000000000005,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.736,"5min":1.994,"15min":1.994},"last":1.712},{"interface":"front","average":{"1min":1.2689999999999999,"5min":1.427,"15min":1.5009999999999999},"min":{"1min":0.628,"5min":0.628,"15min":0.628},"max":{"1min":1.5820000000000001,"5min":2.0800000000000001,"15min":2.0800000000000001},"last":1.6619999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574901,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32224,"kb_used_data":1044,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339616,"statfs":{"total":96636764160,"available":96603766784,"internally_reserved":0,"allocated":1069056,"data_stored":480803,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 12 09:47:18 2023","interfaces":[{"interface":"back","average":{"1min":1.097,"5min":1.042,"15min":1.0269999999999999},"min":{"1min":0.84999999999999998,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.4890000000000001,"5min":1.7310000000000001,"15min":1.7310000000000001},"last":0.80800000000000005},{"interface":"front","average":{"1min":1.038,"5min":1.083,"15min":1.1140000000000001},"min":{"1min":0.68500000000000005,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.679,"5min":1.679,"15min":1.679},"last":0.78600000000000003}]},{"osd":1,"last update":"Tue Dec 12 09:47:18 2023","interfaces":[{"interface":"back","average":{"1min":1.266,"5min":1.1579999999999999,"15min":1.2030000000000001},"min":{"1min":0.77600000000000002,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":2.3359999999999999,"5min":2.3359999999999999,"15min":2.3359999999999999},"last":0.66700000000000004},{"interface":"front","average":{"1min":1.2230000000000001,"5min":1.1060000000000001,"15min":1.0960000000000001},"min":{"1min":0.71099999999999997,"5min":0.66400000000000003,"15min":0.66400000000000003},"max":{"1min":2.3780000000000001,"5min":2.3780000000000001,"15min":2.3780000000000001},"last":0.97299999999999998}]},{"osd":2,"last update":"Tue Dec 12 09:47:18 2023","interfaces":[{"interface":"back","average":{"1min":1.04,"5min":1.198,"15min":1.2769999999999999},"min":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"max":{"1min":1.4650000000000001,"5min":1.7889999999999999,"15min":1.7889999999999999},"last":0.72199999999999998},{"interface":"front","average":{"1min":1.1910000000000001,"5min":1.2549999999999999,"15min":1.365},"min":{"1min":0.82399999999999995,"5min":0.72899999999999998,"15min":0.72899999999999998},"max":{"1min":1.9950000000000001,"5min":2.1600000000000001,"15min":2.1600000000000001},"last":0.86099999999999999}]},{"osd":3,"last update":"Tue Dec 12 09:47:18 2023","interfaces":[{"interface":"back","average":{"1min":1.226,"5min":1.2669999999999999,"15min":1.3360000000000001},"min":{"1min":0.83399999999999996,"5min":0.77300000000000002,"15min":0.77300000000000002},"max":{"1min":1.831,"5min":2.1499999999999999,"15min":2.1499999999999999},"last":1.1890000000000001},{"interface":"front","average":{"1min":1.254,"5min":1.3660000000000001,"15min":1.45},"min":{"1min":0.879,"5min":0.75800000000000001,"15min":0.75800000000000001},"max":{"1min":1.7410000000000001,"5min":2.0249999999999999,"15min":2.0249999999999999},"last":0.91000000000000003}]},{"osd":4,"last update":"Tue Dec 12 09:47:18 2023","interfaces":[{"interface":"back","average":{"1min":1.361,"5min":1.3759999999999999,"15min":1.452},"min":{"1min":0.747,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":2.488,"5min":2.488,"15min":2.488},"last":1.0860000000000001},{"interface":"front","average":{"1min":1.4259999999999999,"5min":1.498,"15min":1.5580000000000001},"min":{"1min":0.71299999999999997,"5min":0.65300000000000002,"15min":0.65300000000000002},"max":{"1min":2.5870000000000002,"5min":2.6040000000000001,"15min":2.6040000000000001},"last":1.55}]},{"osd":6,"last update":"Tue Dec 12 09:47:18 2023","interfaces":[{"interface":"back","average":{"1min":1.28,"5min":1.448,"15min":1.546},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.9359999999999999,"5min":2.1179999999999999,"15min":2.1179999999999999},"last":1.1439999999999999},{"interface":"front","average":{"1min":1.345,"5min":1.452,"15min":1.571},"min":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":2.6589999999999998,"5min":2.6589999999999998,"15min":2.6589999999999998},"last":1.3069999999999999}]},{"osd":7,"last update":"Tue Dec 12 09:47:18 2023","interfaces":[{"interface":"back","average":{"1min":1.548,"5min":1.6399999999999999,"15min":1.736},"min":{"1min":0.90500000000000003,"5min":0.83699999999999997,"15min":0.83699999999999997},"max":{"1min":2.8519999999999999,"5min":2.8519999999999999,"15min":2.8519999999999999},"last":1.649},{"interface":"front","average":{"1min":1.4219999999999999,"5min":1.595,"15min":1.6970000000000001},"min":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"max":{"1min":2.0619999999999998,"5min":2.4910000000000001,"15min":2.4910000000000001},"last":1.0429999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574903,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32236,"kb_used_data":1056,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339604,"statfs":{"total":96636764160,"available":96603754496,"internally_reserved":0,"allocated":1081344,"data_stored":486282,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 12 09:47:20 2023","interfaces":[{"interface":"back","average":{"1min":1.107,"5min":1.0649999999999999,"15min":1.0580000000000001},"min":{"1min":0.70099999999999996,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":1.6579999999999999,"5min":1.7010000000000001,"15min":1.7010000000000001},"last":1.452},{"interface":"front","average":{"1min":1.266,"5min":1.1020000000000001,"15min":1.0700000000000001},"min":{"1min":0.90200000000000002,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":2.2010000000000001,"5min":2.2010000000000001,"15min":2.2010000000000001},"last":0.92000000000000004}]},{"osd":1,"last update":"Tue Dec 12 09:47:20 2023","interfaces":[{"interface":"back","average":{"1min":1.0229999999999999,"5min":1.044,"15min":1.044},"min":{"1min":0.69699999999999995,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":1.6180000000000001,"5min":1.6180000000000001,"15min":1.6180000000000001},"last":1.1870000000000001},{"interface":"front","average":{"1min":1.2330000000000001,"5min":1.1739999999999999,"15min":1.1779999999999999},"min":{"1min":0.76100000000000001,"5min":0.73699999999999999,"15min":0.73699999999999999},"max":{"1min":2.1600000000000001,"5min":2.1600000000000001,"15min":2.1600000000000001},"last":1.704}]},{"osd":2,"last update":"Tue Dec 12 09:47:20 2023","interfaces":[{"interface":"back","average":{"1min":1.131,"5min":1.139,"15min":1.125},"min":{"1min":0.82699999999999996,"5min":0.71299999999999997,"15min":0.71299999999999997},"max":{"1min":1.798,"5min":1.798,"15min":1.798},"last":1.1439999999999999},{"interface":"front","average":{"1min":1.3300000000000001,"5min":1.276,"15min":1.288},"min":{"1min":0.84499999999999997,"5min":0.75600000000000001,"15min":0.75600000000000001},"max":{"1min":2.2650000000000001,"5min":2.2650000000000001,"15min":2.2650000000000001},"last":1.5249999999999999}]},{"osd":3,"last update":"Tue Dec 12 09:47:20 2023","interfaces":[{"interface":"back","average":{"1min":1.2689999999999999,"5min":1.258,"15min":1.2210000000000001},"min":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"max":{"1min":1.948,"5min":1.948,"15min":1.948},"last":1.0369999999999999},{"interface":"front","average":{"1min":1.2050000000000001,"5min":1.228,"15min":1.234},"min":{"1min":0.80600000000000005,"5min":0.70599999999999996,"15min":0.70599999999999996},"max":{"1min":1.798,"5min":2.0499999999999998,"15min":2.0499999999999998},"last":1.3089999999999999}]},{"osd":5,"last update":"Tue Dec 12 09:47:20 2023","interfaces":[{"interface":"back","average":{"1min":1.399,"5min":1.4039999999999999,"15min":1.446},"min":{"1min":0.76800000000000002,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":2.0329999999999999,"5min":2.3159999999999998,"15min":2.3159999999999998},"last":1.258},{"interface":"front","average":{"1min":1.3959999999999999,"5min":1.389,"15min":1.363},"min":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"max":{"1min":2.0030000000000001,"5min":2.117,"15min":2.117},"last":1.2270000000000001}]},{"osd":6,"last update":"Tue Dec 12 09:47:20 2023","interfaces":[{"interface":"back","average":{"1min":1.3029999999999999,"5min":1.361,"15min":1.389},"min":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"max":{"1min":1.625,"5min":2.246,"15min":2.246},"last":1.387},{"interface":"front","average":{"1min":1.488,"5min":1.5209999999999999,"15min":1.5389999999999999},"min":{"1min":0.70899999999999996,"5min":0.65600000000000003,"15min":0.65600000000000003},"max":{"1min":2.093,"5min":2.5099999999999998,"15min":2.5099999999999998},"last":1.762}]},{"osd":7,"last update":"Tue Dec 12 09:47:20 2023","interfaces":[{"interface":"back","average":{"1min":1.484,"5min":1.5049999999999999,"15min":1.5049999999999999},"min":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"max":{"1min":2.0619999999999998,"5min":2.5710000000000002,"15min":2.5710000000000002},"last":1.3620000000000001},{"interface":"front","average":{"1min":1.464,"5min":1.512,"15min":1.512},"min":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"max":{"1min":1.994,"5min":2.3919999999999999,"15min":2.3919999999999999},"last":1.885}]}]},{"osd":3,"up_from":13,"seq":55834574901,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32232,"kb_used_data":1052,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339608,"statfs":{"total":96636764160,"available":96603758592,"internally_reserved":0,"allocated":1077248,"data_stored":486180,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 12 09:47:21 2023","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.80800000000000005,"15min":0.878},"min":{"1min":0.32300000000000001,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":1.1339999999999999,"5min":1.4830000000000001,"15min":1.4830000000000001},"last":0.80500000000000005},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.93400000000000005,"15min":1.069},"min":{"1min":0.48499999999999999,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":1.4730000000000001,"5min":3.3370000000000002,"15min":3.3370000000000002},"last":1.0009999999999999}]},{"osd":1,"last update":"Tue Dec 12 09:47:21 2023","interfaces":[{"interface":"back","average":{"1min":0.85199999999999998,"5min":0.86099999999999999,"15min":0.90000000000000002},"min":{"1min":0.38600000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":1.446,"5min":1.4870000000000001,"15min":1.4870000000000001},"last":1.4770000000000001},{"interface":"front","average":{"1min":0.96499999999999997,"5min":1,"15min":1.046},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.4970000000000001,"5min":2.9409999999999998,"15min":2.9409999999999998},"last":1.542}]},{"osd":2,"last update":"Tue Dec 12 09:47:21 2023","interfaces":[{"interface":"back","average":{"1min":0.92200000000000004,"5min":1.0229999999999999,"15min":1.1319999999999999},"min":{"1min":0.42399999999999999,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.345,"5min":2.613,"15min":2.613},"last":1.141},{"interface":"front","average":{"1min":0.92500000000000004,"5min":1.048,"15min":1.139},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":1.4179999999999999,"5min":3.0430000000000001,"15min":3.0430000000000001},"last":1.1739999999999999}]},{"osd":4,"last update":"Tue Dec 12 09:47:21 2023","interfaces":[{"interface":"back","average":{"1min":1.0409999999999999,"5min":1.2310000000000001,"15min":1.3320000000000001},"min":{"1min":0.64000000000000001,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.478,"5min":3.5019999999999998,"15min":3.5019999999999998},"last":1.216},{"interface":"front","average":{"1min":1.1910000000000001,"5min":1.2969999999999999,"15min":1.421},"min":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.8089999999999999,"5min":2.9889999999999999,"15min":2.9889999999999999},"last":1.2589999999999999}]},{"osd":5,"last update":"Tue Dec 12 09:47:21 2023","interfaces":[{"interface":"back","average":{"1min":1.149,"5min":1.341,"15min":1.4470000000000001},"min":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":1.542,"5min":4.2480000000000002,"15min":4.2480000000000002},"last":1.2989999999999999},{"interface":"front","average":{"1min":1.0880000000000001,"5min":1.3440000000000001,"15min":1.5089999999999999},"min":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.583,"5min":5.5060000000000002,"15min":5.5060000000000002},"last":1.5800000000000001}]},{"osd":6,"last update":"Tue Dec 12 09:47:21 2023","interfaces":[{"interface":"back","average":{"1min":1.238,"5min":1.3089999999999999,"15min":1.4079999999999999},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.714,"5min":3.1400000000000001,"15min":3.1400000000000001},"last":1.3320000000000001},{"interface":"front","average":{"1min":1.2490000000000001,"5min":1.397,"15min":1.4970000000000001},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.6120000000000001,"5min":4.3179999999999996,"15min":4.3179999999999996},"last":1.4179999999999999}]},{"osd":7,"last update":"Tue Dec 12 09:47:21 2023","interfaces":[{"interface":"back","average":{"1min":1.206,"5min":1.3859999999999999,"15min":1.5229999999999999},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.679,"5min":5.3979999999999997,"15min":5.3979999999999997},"last":1.514},{"interface":"front","average":{"1min":1.2929999999999999,"5min":1.3999999999999999,"15min":1.502},"min":{"1min":0.623,"5min":0.623,"15min":0.623},"max":{"1min":1.9690000000000001,"5min":3.4129999999999998,"15min":3.4129999999999998},"last":1.6120000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574901,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32228,"kb_used_data":1048,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339612,"statfs":{"total":96636764160,"available":96603762688,"internally_reserved":0,"allocated":1073152,"data_stored":480941,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 12 09:47:20 2023","interfaces":[{"interface":"back","average":{"1min":0.79200000000000004,"5min":0.79800000000000004,"15min":0.81200000000000006},"min":{"1min":0.40000000000000002,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":1.395,"5min":1.458,"15min":1.458},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.81499999999999995,"5min":0.875,"15min":0.90000000000000002},"min":{"1min":0.40100000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":1.28,"5min":2.4129999999999998,"15min":2.4129999999999998},"last":0.502}]},{"osd":1,"last update":"Tue Dec 12 09:47:20 2023","interfaces":[{"interface":"back","average":{"1min":0.91000000000000003,"5min":0.85599999999999998,"15min":0.86099999999999999},"min":{"1min":0.45800000000000002,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":1.5649999999999999,"5min":1.593,"15min":1.593},"last":0.746},{"interface":"front","average":{"1min":0.97699999999999998,"5min":0.91500000000000004,"15min":0.89600000000000002},"min":{"1min":0.55200000000000005,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.413,"5min":1.758,"15min":1.758},"last":0.68899999999999995}]},{"osd":3,"last update":"Tue Dec 12 09:47:20 2023","interfaces":[{"interface":"back","average":{"1min":0.98599999999999999,"5min":1.0189999999999999,"15min":1.044},"min":{"1min":0.60599999999999998,"5min":0.503,"15min":0.503},"max":{"1min":1.506,"5min":1.889,"15min":1.889},"last":0.79300000000000004},{"interface":"front","average":{"1min":0.875,"5min":0.93400000000000005,"15min":0.98399999999999999},"min":{"1min":0.48499999999999999,"5min":0.432,"15min":0.432},"max":{"1min":1.298,"5min":1.8120000000000001,"15min":1.8120000000000001},"last":0.84199999999999997}]},{"osd":4,"last update":"Tue Dec 12 09:47:20 2023","interfaces":[{"interface":"back","average":{"1min":1.157,"5min":1.177,"15min":1.21},"min":{"1min":0.83799999999999997,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.5409999999999999,"5min":2.5760000000000001,"15min":2.5760000000000001},"last":1.0409999999999999},{"interface":"front","average":{"1min":1.254,"5min":1.28,"15min":1.3560000000000001},"min":{"1min":0.84899999999999998,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.613,"5min":2.8069999999999999,"15min":2.8069999999999999},"last":1.365}]},{"osd":5,"last update":"Tue Dec 12 09:47:20 2023","interfaces":[{"interface":"back","average":{"1min":1.2470000000000001,"5min":1.3100000000000001,"15min":1.3560000000000001},"min":{"1min":0.89500000000000002,"5min":0.80500000000000005,"15min":0.80500000000000005},"max":{"1min":1.5720000000000001,"5min":2.3109999999999999,"15min":2.3109999999999999},"last":1.0740000000000001},{"interface":"front","average":{"1min":1.1950000000000001,"5min":1.25,"15min":1.3169999999999999},"min":{"1min":0.78400000000000003,"5min":0.627,"15min":0.627},"max":{"1min":1.7390000000000001,"5min":2.5110000000000001,"15min":2.5110000000000001},"last":1.1919999999999999}]},{"osd":6,"last update":"Tue Dec 12 09:47:20 2023","interfaces":[{"interface":"back","average":{"1min":1.3109999999999999,"5min":1.3540000000000001,"15min":1.409},"min":{"1min":0.92600000000000005,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":1.6319999999999999,"5min":2.907,"15min":2.907},"last":0.95299999999999996},{"interface":"front","average":{"1min":1.242,"5min":1.363,"15min":1.407},"min":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"max":{"1min":1.7509999999999999,"5min":2.6000000000000001,"15min":2.6000000000000001},"last":1.3420000000000001}]},{"osd":7,"last update":"Tue Dec 12 09:47:20 2023","interfaces":[{"interface":"back","average":{"1min":1.3220000000000001,"5min":1.3740000000000001,"15min":1.429},"min":{"1min":0.90900000000000003,"5min":0.70799999999999996,"15min":0.70799999999999996},"max":{"1min":1.577,"5min":2.3370000000000002,"15min":2.3370000000000002},"last":1.1060000000000001},{"interface":"front","average":{"1min":1.3480000000000001,"5min":1.4330000000000001,"15min":1.486},"min":{"1min":0.94699999999999995,"5min":0.84199999999999997,"15min":0.84199999999999997},"max":{"1min":1.8109999999999999,"5min":2.488,"15min":2.488},"last":1.446}]}]},{"osd":1,"up_from":13,"seq":55834574901,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32212,"kb_used_data":1032,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339628,"statfs":{"total":96636764160,"available":96603779072,"internally_reserved":0,"allocated":1056768,"data_stored":474848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 12 09:47:18 2023","interfaces":[{"interface":"back","average":{"1min":0.85799999999999998,"5min":0.83799999999999997,"15min":0.84999999999999998},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":1.46,"5min":2.794,"15min":2.794},"last":1.0009999999999999},{"interface":"front","average":{"1min":0.751,"5min":0.80300000000000005,"15min":0.84499999999999997},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":1.6359999999999999,"5min":2.1379999999999999,"15min":2.1379999999999999},"last":0.66100000000000003}]},{"osd":2,"last update":"Tue Dec 12 09:47:18 2023","interfaces":[{"interface":"back","average":{"1min":0.83399999999999996,"5min":0.90500000000000003,"15min":0.95899999999999996},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":1.2509999999999999,"5min":6.3390000000000004,"15min":6.3390000000000004},"last":1.0289999999999999},{"interface":"front","average":{"1min":0.90400000000000003,"5min":0.93400000000000005,"15min":0.95599999999999996},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.3400000000000001,"5min":2.823,"15min":2.823},"last":1.3460000000000001}]},{"osd":3,"last update":"Tue Dec 12 09:47:18 2023","interfaces":[{"interface":"back","average":{"1min":0.90900000000000003,"5min":1.004,"15min":1.0349999999999999},"min":{"1min":0.48999999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":1.919,"5min":2.7519999999999998,"15min":2.7519999999999998},"last":0.95299999999999996},{"interface":"front","average":{"1min":0.879,"5min":0.95899999999999996,"15min":0.99099999999999999},"min":{"1min":0.434,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":1.4430000000000001,"5min":2.2559999999999998,"15min":2.2559999999999998},"last":0.74399999999999999}]},{"osd":4,"last update":"Tue Dec 12 09:47:18 2023","interfaces":[{"interface":"back","average":{"1min":1.097,"5min":1.232,"15min":1.343},"min":{"1min":0.73499999999999999,"5min":0.68400000000000005,"15min":0.68400000000000005},"max":{"1min":1.883,"5min":6.423,"15min":6.423},"last":1.49},{"interface":"front","average":{"1min":1.1970000000000001,"5min":1.1910000000000001,"15min":1.1930000000000001},"min":{"1min":0.84299999999999997,"5min":0.80000000000000004,"15min":0.80000000000000004},"max":{"1min":1.9590000000000001,"5min":2.2309999999999999,"15min":2.2309999999999999},"last":1.0820000000000001}]},{"osd":5,"last update":"Tue Dec 12 09:47:18 2023","interfaces":[{"interface":"back","average":{"1min":1.236,"5min":1.3069999999999999,"15min":1.413},"min":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"max":{"1min":2.556,"5min":6.2830000000000004,"15min":6.2830000000000004},"last":1.583},{"interface":"front","average":{"1min":1.242,"5min":1.2989999999999999,"15min":1.349},"min":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"max":{"1min":2.3999999999999999,"5min":2.73,"15min":2.73},"last":1.2490000000000001}]},{"osd":6,"last update":"Tue Dec 12 09:47:18 2023","interfaces":[{"interface":"back","average":{"1min":1.2490000000000001,"5min":1.3839999999999999,"15min":1.5009999999999999},"min":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"max":{"1min":1.8520000000000001,"5min":6.468,"15min":6.468},"last":1.1990000000000001},{"interface":"front","average":{"1min":1.222,"5min":1.375,"15min":1.5109999999999999},"min":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"max":{"1min":1.978,"5min":6.3129999999999997,"15min":6.3129999999999997},"last":1.667}]},{"osd":7,"last update":"Tue Dec 12 09:47:18 2023","interfaces":[{"interface":"back","average":{"1min":1.1879999999999999,"5min":1.333,"15min":1.3819999999999999},"min":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"max":{"1min":1.8600000000000001,"5min":2.9009999999999998,"15min":2.9009999999999998},"last":1.3939999999999999},{"interface":"front","average":{"1min":1.1919999999999999,"5min":1.3799999999999999,"15min":1.4970000000000001},"min":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"max":{"1min":2.012,"5min":6.242,"15min":6.242},"last":1.29}]}]},{"osd":0,"up_from":13,"seq":55834574903,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32276,"kb_used_data":1096,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339564,"statfs":{"total":96636764160,"available":96603713536,"internally_reserved":0,"allocated":1122304,"data_stored":1065660,"data_compressed":32422,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Dec 12 09:47:21 2023","interfaces":[{"interface":"back","average":{"1min":0.82299999999999995,"5min":0.79000000000000004,"15min":0.77700000000000002},"min":{"1min":0.45600000000000002,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":1.446,"5min":1.639,"15min":1.639},"last":0.91400000000000003},{"interface":"front","average":{"1min":0.86799999999999999,"5min":0.83999999999999997,"15min":0.82399999999999995},"min":{"1min":0.39400000000000002,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":1.3979999999999999,"5min":1.5680000000000001,"15min":1.5680000000000001},"last":0.97899999999999998}]},{"osd":2,"last update":"Tue Dec 12 09:47:21 2023","interfaces":[{"interface":"back","average":{"1min":0.90100000000000002,"5min":0.88800000000000001,"15min":0.87},"min":{"1min":0.58699999999999997,"5min":0.316,"15min":0.316},"max":{"1min":1.4910000000000001,"5min":1.748,"15min":1.748},"last":1.2150000000000001},{"interface":"front","average":{"1min":0.94399999999999995,"5min":0.96399999999999997,"15min":0.98399999999999999},"min":{"1min":0.47299999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":1.4910000000000001,"5min":1.649,"15min":1.649},"last":1.4990000000000001}]},{"osd":3,"last update":"Tue Dec 12 09:47:21 2023","interfaces":[{"interface":"back","average":{"1min":0.96199999999999997,"5min":0.86299999999999999,"15min":0.85599999999999998},"min":{"1min":0.42999999999999999,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":2.1800000000000002,"5min":2.1800000000000002,"15min":2.1800000000000002},"last":1.0669999999999999},{"interface":"front","average":{"1min":1.034,"5min":1.0189999999999999,"15min":1.0089999999999999},"min":{"1min":0.55100000000000005,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":1.877,"5min":2.3210000000000002,"15min":2.3210000000000002},"last":1.3149999999999999}]},{"osd":4,"last update":"Tue Dec 12 09:47:21 2023","interfaces":[{"interface":"back","average":{"1min":1.2310000000000001,"5min":1.2729999999999999,"15min":1.282},"min":{"1min":0.86199999999999999,"5min":0.80400000000000005,"15min":0.80400000000000005},"max":{"1min":1.758,"5min":2.073,"15min":2.073},"last":1.589},{"interface":"front","average":{"1min":1.3460000000000001,"5min":1.276,"15min":1.2869999999999999},"min":{"1min":0.90500000000000003,"5min":0.64400000000000002,"15min":0.64400000000000002},"max":{"1min":2.0990000000000002,"5min":3.0699999999999998,"15min":3.0699999999999998},"last":1.7529999999999999}]},{"osd":5,"last update":"Tue Dec 12 09:47:21 2023","interfaces":[{"interface":"back","average":{"1min":1.2629999999999999,"5min":1.2150000000000001,"15min":1.2270000000000001},"min":{"1min":0.71199999999999997,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":2.2730000000000001,"5min":3.1909999999999998,"15min":3.1909999999999998},"last":1.4359999999999999},{"interface":"front","average":{"1min":1.3120000000000001,"5min":1.2929999999999999,"15min":1.302},"min":{"1min":0.88500000000000001,"5min":0.67300000000000004,"15min":0.67300000000000004},"max":{"1min":1.7110000000000001,"5min":2.2120000000000002,"15min":2.2120000000000002},"last":1.8080000000000001}]},{"osd":6,"last update":"Tue Dec 12 09:47:21 2023","interfaces":[{"interface":"back","average":{"1min":1.278,"5min":1.3220000000000001,"15min":1.3320000000000001},"min":{"1min":0.83199999999999996,"5min":0.67500000000000004,"15min":0.67500000000000004},"max":{"1min":1.6180000000000001,"5min":2.04,"15min":2.04},"last":1.625},{"interface":"front","average":{"1min":1.321,"5min":1.3520000000000001,"15min":1.3779999999999999},"min":{"1min":0.80900000000000005,"5min":0.67500000000000004,"15min":0.67500000000000004},"max":{"1min":2.0670000000000002,"5min":2.9100000000000001,"15min":2.9100000000000001},"last":1.2529999999999999}]},{"osd":7,"last update":"Tue Dec 12 09:47:21 2023","interfaces":[{"interface":"back","average":{"1min":1.423,"5min":1.4079999999999999,"15min":1.4319999999999999},"min":{"1min":0.999,"5min":0.66800000000000004,"15min":0.66800000000000004},"max":{"1min":1.8200000000000001,"5min":2.992,"15min":2.992},"last":1.153},{"interface":"front","average":{"1min":1.3879999999999999,"5min":1.3380000000000001,"15min":1.3320000000000001},"min":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"max":{"1min":1.9299999999999999,"5min":2.7690000000000001,"15min":2.7690000000000001},"last":1.5449999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32422,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32422,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-12T09:47:32.668 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-12-12T09:47:32.668 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-12T09:47:32.879 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:32.877+0000 7fd10b305640 1 Processor -- start 2023-12-12T09:47:32.879 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:32.877+0000 7fd10b305640 1 -- start start 2023-12-12T09:47:32.883 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:32.879+0000 7fd10b305640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd1040c5070 0x7fd1040c40c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:32.883 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:32.879+0000 7fd10b305640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd104152610 con 0x7fd10414fa40 2023-12-12T09:47:32.883 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:32.879+0000 7fd10b305640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1041528f0 con 0x7fd10406db70 2023-12-12T09:47:32.883 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:32.879+0000 7fd10b305640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd104152bd0 con 0x7fd1040c5070 2023-12-12T09:47:32.883 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:32.879+0000 7fd1090a1640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7fd10414fa40 0x7fd10406a4e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:54600/0 (socket says 172.21.15.73:54600) 2023-12-12T09:47:32.883 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:32.879+0000 7fd1090a1640 1 -- 172.21.15.73:0/2768804035 learned_addr learned my addr 172.21.15.73:0/2768804035 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-12T09:47:32.884 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:32.879+0000 7fd0fbfff640 1 -- 172.21.15.73:0/2768804035 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2432455875 0 0) 0x7fd104152610 con 0x7fd10414fa40 2023-12-12T09:47:32.884 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:32.879+0000 7fd0fbfff640 1 -- 172.21.15.73:0/2768804035 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd0f0003520 con 0x7fd10414fa40 2023-12-12T09:47:32.884 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:32.879+0000 7fd1098a2640 1 --2- 172.21.15.73:0/2768804035 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd1040c5070 0x7fd1040c40c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:32.884 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:32.880+0000 7fd0fbfff640 1 -- 172.21.15.73:0/2768804035 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2641152508 0 0) 0x7fd0f0003520 con 0x7fd10414fa40 2023-12-12T09:47:32.884 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:32.880+0000 7fd0fbfff640 1 -- 172.21.15.73:0/2768804035 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd1040c5070 msgr2=0x7fd1040c40c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:47:32.885 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:32.880+0000 7fd0fbfff640 1 --2- 172.21.15.73:0/2768804035 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd1040c5070 0x7fd1040c40c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:32.885 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:32.880+0000 7fd0fbfff640 1 -- 172.21.15.73:0/2768804035 >> v1:172.21.15.142:6789/0 conn(0x7fd10406db70 legacy=0x7fd1040c39b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:32.885 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:32.880+0000 7fd0fbfff640 1 -- 172.21.15.73:0/2768804035 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd104152eb0 con 0x7fd10414fa40 2023-12-12T09:47:32.885 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:32.880+0000 7fd0fbfff640 1 -- 172.21.15.73:0/2768804035 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3186547832 0 0) 0x7fd1000019f0 con 0x7fd10414fa40 2023-12-12T09:47:32.885 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:32.880+0000 7fd0fbfff640 1 -- 172.21.15.73:0/2768804035 >> v1:172.21.15.73:6789/0 conn(0x7fd10414fa40 legacy=0x7fd10406a4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:32.885 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:32.880+0000 7fd0fbfff640 1 --2- 172.21.15.73:0/2768804035 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd0f00039a0 0x7fd0f0003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:32.886 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:32.880+0000 7fd0fbfff640 1 --2- 172.21.15.73:0/2768804035 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd0f00047c0 0x7fd0f0004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:32.886 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:32.880+0000 7fd0fbfff640 1 --2- 172.21.15.73:0/2768804035 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd1040c5070 0x7fd0f00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:32.886 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:32.880+0000 7fd0fbfff640 1 -- 172.21.15.73:0/2768804035 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd104152bd0 con 0x7fd0f00039a0 2023-12-12T09:47:32.886 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:32.880+0000 7fd0fbfff640 1 -- 172.21.15.73:0/2768804035 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0f000bab0 con 0x7fd0f00047c0 2023-12-12T09:47:32.886 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:32.880+0000 7fd0fbfff640 1 -- 172.21.15.73:0/2768804035 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0f000bc70 con 0x7fd1040c5070 2023-12-12T09:47:32.887 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:32.880+0000 7fd1090a1640 1 --2- 172.21.15.73:0/2768804035 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd0f00039a0 0x7fd0f0003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:32.887 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:32.880+0000 7fd1088a0640 1 --2- 172.21.15.73:0/2768804035 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd0f00047c0 0x7fd0f0004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:32.887 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:32.881+0000 7fd1098a2640 1 --2- 172.21.15.73:0/2768804035 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd1040c5070 0x7fd0f00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:32.887 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:32.881+0000 7fd1090a1640 1 -- 172.21.15.73:0/2768804035 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd1040c5070 msgr2=0x7fd0f00051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:47:32.887 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:32.881+0000 7fd1090a1640 1 --2- 172.21.15.73:0/2768804035 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd1040c5070 0x7fd0f00051c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:32.887 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:32.881+0000 7fd1090a1640 1 -- 172.21.15.73:0/2768804035 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd0f00047c0 msgr2=0x7fd0f0004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:47:32.888 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:32.881+0000 7fd1090a1640 1 --2- 172.21.15.73:0/2768804035 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd0f00047c0 0x7fd0f0004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:32.888 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:32.881+0000 7fd1090a1640 1 -- 172.21.15.73:0/2768804035 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0f0003520 con 0x7fd0f00039a0 2023-12-12T09:47:32.888 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:32.881+0000 7fd1088a0640 1 --2- 172.21.15.73:0/2768804035 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd0f00047c0 0x7fd0f0004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-12T09:47:32.892 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:32.882+0000 7fd1090a1640 1 --2- 172.21.15.73:0/2768804035 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd0f00039a0 0x7fd0f0003dc0 secure :-1 s=READY pgs=1144 cs=0 l=1 rev1=1 crypto rx=0x7fd10000a830 tx=0x7fd0f00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7593c87d9c51eda0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:47:32.892 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:32.882+0000 7fd0fbfff640 1 -- 172.21.15.73:0/2768804035 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1000072d0 con 0x7fd0f00039a0 2023-12-12T09:47:32.892 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:32.882+0000 7fd0fbfff640 1 -- 172.21.15.73:0/2768804035 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd10002f070 con 0x7fd0f00039a0 2023-12-12T09:47:32.892 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:32.882+0000 7fd0fbfff640 1 -- 172.21.15.73:0/2768804035 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1000076b0 con 0x7fd0f00039a0 2023-12-12T09:47:32.892 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:32.883+0000 7fd10b305640 1 -- 172.21.15.73:0/2768804035 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd0f00039a0 msgr2=0x7fd0f0003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:32.892 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:32.883+0000 7fd10b305640 1 --2- 172.21.15.73:0/2768804035 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd0f00039a0 0x7fd0f0003dc0 secure :-1 s=READY pgs=1144 cs=0 l=1 rev1=1 crypto rx=0x7fd10000a830 tx=0x7fd0f00057f0 comp rx=0 tx=0).stop 2023-12-12T09:47:32.892 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:32.883+0000 7fd1098a2640 1 -- 172.21.15.73:0/2768804035 reap_dead start 2023-12-12T09:47:32.893 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:32.883+0000 7fd10b305640 1 -- 172.21.15.73:0/2768804035 shutdown_connections 2023-12-12T09:47:32.893 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:32.883+0000 7fd10b305640 1 -- 172.21.15.73:0/2768804035 >> 172.21.15.73:0/2768804035 conn(0x7fd1040a8130 msgr2=0x7fd1040c24b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:47:32.893 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:32.883+0000 7fd10b305640 1 -- 172.21.15.73:0/2768804035 shutdown_connections 2023-12-12T09:47:32.893 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:32.883+0000 7fd10b305640 1 -- 172.21.15.73:0/2768804035 wait complete. 2023-12-12T09:47:32.893 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:32.885+0000 7fd10b305640 1 Processor -- start 2023-12-12T09:47:32.893 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:32.885+0000 7fd10b305640 1 -- start start 2023-12-12T09:47:32.893 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:32.886+0000 7fd10b305640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd0f00039a0 0x7fd1040bf680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:32.893 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:32.886+0000 7fd10b305640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd1040a9e10 0x7fd104150ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:32.894 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:32.886+0000 7fd10b305640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd1040714b0 0x7fd1041481c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:32.894 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:32.886+0000 7fd10b305640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1040bf1f0 con 0x7fd0f00039a0 2023-12-12T09:47:32.894 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:32.886+0000 7fd10b305640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd104070d60 con 0x7fd1040a9e10 2023-12-12T09:47:32.894 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:32.886+0000 7fd10b305640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1040bfbc0 con 0x7fd1040714b0 2023-12-12T09:47:32.894 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:32.886+0000 7fd1090a1640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd0f00039a0 0x7fd1040bf680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:32.894 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:32.886+0000 7fd1090a1640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd0f00039a0 0x7fd1040bf680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:60158/0 (socket says 172.21.15.73:60158) 2023-12-12T09:47:32.894 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:32.886+0000 7fd1090a1640 1 -- 172.21.15.73:0/3065427951 learned_addr learned my addr 172.21.15.73:0/3065427951 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:47:32.894 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:32.886+0000 7fd1098a2640 1 --2- 172.21.15.73:0/3065427951 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd1040714b0 0x7fd1041481c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:32.895 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:32.886+0000 7fd1088a0640 1 --2- 172.21.15.73:0/3065427951 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd1040a9e10 0x7fd104150ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:32.895 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:32.887+0000 7fd1090a1640 1 -- 172.21.15.73:0/3065427951 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd1040714b0 msgr2=0x7fd1041481c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:32.895 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:32.887+0000 7fd1090a1640 1 --2- 172.21.15.73:0/3065427951 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd1040714b0 0x7fd1041481c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:32.895 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:32.887+0000 7fd1090a1640 1 -- 172.21.15.73:0/3065427951 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd1040a9e10 msgr2=0x7fd104150ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:32.895 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:32.887+0000 7fd1090a1640 1 --2- 172.21.15.73:0/3065427951 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd1040a9e10 0x7fd104150ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:32.895 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:32.887+0000 7fd1090a1640 1 -- 172.21.15.73:0/3065427951 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1040707a0 con 0x7fd0f00039a0 2023-12-12T09:47:32.895 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:32.887+0000 7fd1090a1640 1 --2- 172.21.15.73:0/3065427951 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd0f00039a0 0x7fd1040bf680 secure :-1 s=READY pgs=1145 cs=0 l=1 rev1=1 crypto rx=0x7fd10000a830 tx=0x7fd100001d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:47:32.895 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:32.887+0000 7fd0f9ffb640 1 -- 172.21.15.73:0/3065427951 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd100044070 con 0x7fd0f00039a0 2023-12-12T09:47:32.895 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:32.887+0000 7fd0f9ffb640 1 -- 172.21.15.73:0/3065427951 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd100004d70 con 0x7fd0f00039a0 2023-12-12T09:47:32.896 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:32.887+0000 7fd0f9ffb640 1 -- 172.21.15.73:0/3065427951 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1000070d0 con 0x7fd0f00039a0 2023-12-12T09:47:32.896 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:32.887+0000 7fd10b305640 1 -- 172.21.15.73:0/3065427951 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd104070a80 con 0x7fd0f00039a0 2023-12-12T09:47:32.896 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:32.888+0000 7fd10b305640 1 -- 172.21.15.73:0/3065427951 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd104151410 con 0x7fd0f00039a0 2023-12-12T09:47:32.896 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:32.889+0000 7fd10b305640 1 -- 172.21.15.73:0/3065427951 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1040c12a0 con 0x7fd0f00039a0 2023-12-12T09:47:32.896 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:32.890+0000 7fd0f9ffb640 1 -- 172.21.15.73:0/3065427951 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fd100031030 con 0x7fd0f00039a0 2023-12-12T09:47:32.896 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:32.890+0000 7fd0f9ffb640 1 --2- 172.21.15.73:0/3065427951 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fd0e806ae40 0x7fd0e806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:32.896 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:32.890+0000 7fd0f9ffb640 1 -- 172.21.15.73:0/3065427951 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 5029+0+0 (secure 0 0 0) 0x7fd1000aab90 con 0x7fd0f00039a0 2023-12-12T09:47:32.897 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:32.891+0000 7fd1088a0640 1 --2- 172.21.15.73:0/3065427951 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fd0e806ae40 0x7fd0e806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:32.897 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:32.891+0000 7fd1088a0640 1 --2- 172.21.15.73:0/3065427951 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fd0e806ae40 0x7fd0e806d300 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7fd1041ed4e0 tx=0x7fd0f4009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:47:32.897 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:32.895+0000 7fd0f9ffb640 1 -- 172.21.15.73:0/3065427951 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fd100075f70 con 0x7fd0f00039a0 2023-12-12T09:47:33.082 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:33.080+0000 7fd10b305640 1 -- 172.21.15.73:0/3065427951 --> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fd1040c31a0 con 0x7fd0e806ae40 2023-12-12T09:47:33.084 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:33.083+0000 7fd0f9ffb640 1 -- 172.21.15.73:0/3065427951 <== mgr.4110 v2:172.21.15.73:6832/779985841 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+48917 (secure 0 0 0) 0x7fd0f4001410 con 0x7fd0e806ae40 2023-12-12T09:47:33.085 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-12T09:47:33.086 INFO:teuthology.orchestra.run.smithi073.stderr:dumped all 2023-12-12T09:47:33.087 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:33.085+0000 7fd10b305640 1 -- 172.21.15.73:0/3065427951 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fd0e806ae40 msgr2=0x7fd0e806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:33.087 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:33.085+0000 7fd10b305640 1 --2- 172.21.15.73:0/3065427951 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fd0e806ae40 0x7fd0e806d300 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7fd1041ed4e0 tx=0x7fd0f4009040 comp rx=0 tx=0).stop 2023-12-12T09:47:33.087 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:33.085+0000 7fd10b305640 1 -- 172.21.15.73:0/3065427951 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd0f00039a0 msgr2=0x7fd1040bf680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:33.087 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:33.085+0000 7fd10b305640 1 --2- 172.21.15.73:0/3065427951 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd0f00039a0 0x7fd1040bf680 secure :-1 s=READY pgs=1145 cs=0 l=1 rev1=1 crypto rx=0x7fd10000a830 tx=0x7fd100001d80 comp rx=0 tx=0).stop 2023-12-12T09:47:33.087 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:33.085+0000 7fd10b305640 1 -- 172.21.15.73:0/3065427951 shutdown_connections 2023-12-12T09:47:33.088 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:33.085+0000 7fd10b305640 1 --2- 172.21.15.73:0/3065427951 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fd0e806ae40 0x7fd0e806d300 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:33.088 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:33.085+0000 7fd10b305640 1 --2- 172.21.15.73:0/3065427951 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd1040714b0 0x7fd1041481c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:33.088 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:33.085+0000 7fd10b305640 1 --2- 172.21.15.73:0/3065427951 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd1040a9e10 0x7fd104150ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:33.088 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:33.085+0000 7fd10b305640 1 --2- 172.21.15.73:0/3065427951 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd0f00039a0 0x7fd1040bf680 unknown :-1 s=CLOSED pgs=1145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:33.088 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:33.085+0000 7fd10b305640 1 -- 172.21.15.73:0/3065427951 >> 172.21.15.73:0/3065427951 conn(0x7fd1040a8130 msgr2=0x7fd1040c4070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:47:33.088 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:33.085+0000 7fd10b305640 1 -- 172.21.15.73:0/3065427951 shutdown_connections 2023-12-12T09:47:33.088 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:33.086+0000 7fd10b305640 1 -- 172.21.15.73:0/3065427951 wait complete. 2023-12-12T09:47:33.105 INFO:teuthology.orchestra.run.smithi073.stdout:{"pg_ready":true,"pg_map":{"version":209,"stamp":"2023-12-12T09:47:31.541643+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":257916,"kb_used_data":8472,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754716804,"statfs":{"total":773094113280,"available":772830007296,"internally_reserved":0,"allocated":8675328,"data_stored":5020707,"data_compressed":64844,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":12752,"internal_metadata":255315504},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":19,"apply_latency_ms":19,"commit_latency_ns":19000000,"apply_latency_ns":19000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-12384,"num_objects":-23,"num_object_clones":0,"num_object_copies":-46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-63,"num_write_kb":-34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.002463"},"pg_stats":[{"pgid":"1.0","version":"18'117","reported_seq":222,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-12T09:47:22.640586+0000","last_change":"2023-12-12T09:43:17.203315+0000","last_active":"2023-12-12T09:47:22.640586+0000","last_peered":"2023-12-12T09:47:22.640586+0000","last_clean":"2023-12-12T09:47:22.640586+0000","last_became_active":"2023-12-12T09:43:17.200779+0000","last_became_peered":"2023-12-12T09:43:17.200779+0000","last_unstale":"2023-12-12T09:47:22.640586+0000","last_undegraded":"2023-12-12T09:47:22.640586+0000","last_fullsized":"2023-12-12T09:47:22.640586+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:43:15.931922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:43:15.931922+0000","last_clean_scrub_stamp":"2023-12-12T09:43:15.931922+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T21:42:10.929640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":64844,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574903,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32280,"kb_used_data":1100,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339560,"statfs":{"total":96636764160,"available":96603709440,"internally_reserved":0,"allocated":1126400,"data_stored":1065190,"data_compressed":32422,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 12 09:47:18 2023","interfaces":[{"interface":"back","average":{"1min":1.0960000000000001,"5min":1.0649999999999999,"15min":1.0209999999999999},"min":{"1min":0.65700000000000003,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.534,"5min":1.8089999999999999,"15min":1.8089999999999999},"last":1.425},{"interface":"front","average":{"1min":1.1259999999999999,"5min":1.0640000000000001,"15min":0.99399999999999999},"min":{"1min":0.77700000000000002,"5min":0.66300000000000003,"15min":0.66300000000000003},"max":{"1min":1.544,"5min":1.71,"15min":1.71},"last":0.97299999999999998}]},{"osd":1,"last update":"Tue Dec 12 09:47:18 2023","interfaces":[{"interface":"back","average":{"1min":1.1519999999999999,"5min":1.2010000000000001,"15min":1.1990000000000001},"min":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"max":{"1min":1.5580000000000001,"5min":1.897,"15min":1.897},"last":1.1040000000000001},{"interface":"front","average":{"1min":1.1719999999999999,"5min":1.1739999999999999,"15min":1.202},"min":{"1min":0.80500000000000005,"5min":0.71499999999999997,"15min":0.71499999999999997},"max":{"1min":1.585,"5min":3.1150000000000002,"15min":3.1150000000000002},"last":1.78}]},{"osd":2,"last update":"Tue Dec 12 09:47:18 2023","interfaces":[{"interface":"back","average":{"1min":1.159,"5min":1.214,"15min":1.246},"min":{"1min":0.84499999999999997,"5min":0.77700000000000002,"15min":0.77700000000000002},"max":{"1min":1.544,"5min":2.2050000000000001,"15min":2.2050000000000001},"last":1.851},{"interface":"front","average":{"1min":1.075,"5min":1.169,"15min":1.2190000000000001},"min":{"1min":0.74199999999999999,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.4810000000000001,"5min":3.2759999999999998,"15min":3.2759999999999998},"last":1.2789999999999999}]},{"osd":3,"last update":"Tue Dec 12 09:47:18 2023","interfaces":[{"interface":"back","average":{"1min":1.133,"5min":1.2110000000000001,"15min":1.2809999999999999},"min":{"1min":0.80100000000000005,"5min":0.76700000000000002,"15min":0.76700000000000002},"max":{"1min":1.6830000000000001,"5min":3.1819999999999999,"15min":3.1819999999999999},"last":1.538},{"interface":"front","average":{"1min":1.3300000000000001,"5min":1.3009999999999999,"15min":1.2969999999999999},"min":{"1min":0.94399999999999995,"5min":0.72799999999999998,"15min":0.72799999999999998},"max":{"1min":1.641,"5min":1.8740000000000001,"15min":1.8740000000000001},"last":1.992}]},{"osd":4,"last update":"Tue Dec 12 09:47:18 2023","interfaces":[{"interface":"back","average":{"1min":1.3200000000000001,"5min":1.3080000000000001,"15min":1.337},"min":{"1min":0.65900000000000003,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.663,"5min":2.5529999999999999,"15min":2.5529999999999999},"last":1.6559999999999999},{"interface":"front","average":{"1min":1.3460000000000001,"5min":1.373,"15min":1.427},"min":{"1min":0.623,"5min":0.623,"15min":0.623},"max":{"1min":1.643,"5min":2.3759999999999999,"15min":2.3759999999999999},"last":1.341}]},{"osd":5,"last update":"Tue Dec 12 09:47:18 2023","interfaces":[{"interface":"back","average":{"1min":1.3480000000000001,"5min":1.3500000000000001,"15min":1.3400000000000001},"min":{"1min":0.78100000000000003,"5min":0.622,"15min":0.622},"max":{"1min":1.714,"5min":1.9890000000000001,"15min":1.9890000000000001},"last":1.714},{"interface":"front","average":{"1min":1.4510000000000001,"5min":1.482,"15min":1.518},"min":{"1min":0.68700000000000006,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":1.7270000000000001,"5min":2.4159999999999999,"15min":2.4159999999999999},"last":1.5900000000000001}]},{"osd":6,"last update":"Tue Dec 12 09:47:18 2023","interfaces":[{"interface":"back","average":{"1min":1.522,"5min":1.4370000000000001,"15min":1.423},"min":{"1min":0.83799999999999997,"5min":0.70799999999999996,"15min":0.70799999999999996},"max":{"1min":1.8,"5min":2.0510000000000002,"15min":2.0510000000000002},"last":1.4810000000000001},{"interface":"front","average":{"1min":1.5529999999999999,"5min":1.5740000000000001,"15min":1.6140000000000001},"min":{"1min":0.76000000000000001,"5min":0.71899999999999997,"15min":0.71899999999999997},"max":{"1min":1.865,"5min":2.5800000000000001,"15min":2.5800000000000001},"last":1.958}]}]},{"osd":6,"up_from":13,"seq":55834574901,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32228,"kb_used_data":1044,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339612,"statfs":{"total":96636764160,"available":96603762688,"internally_reserved":0,"allocated":1069056,"data_stored":480803,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 12 09:47:18 2023","interfaces":[{"interface":"back","average":{"1min":1.0149999999999999,"5min":1.0720000000000001,"15min":1.1519999999999999},"min":{"1min":0.65000000000000002,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.3859999999999999,"5min":3.6429999999999998,"15min":3.6429999999999998},"last":0.88300000000000001},{"interface":"front","average":{"1min":1.008,"5min":1.052,"15min":1.0640000000000001},"min":{"1min":0.627,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.7729999999999999,"5min":2.6059999999999999,"15min":2.6059999999999999},"last":0.79800000000000004}]},{"osd":1,"last update":"Tue Dec 12 09:47:18 2023","interfaces":[{"interface":"back","average":{"1min":1.196,"5min":1.1080000000000001,"15min":1.077},"min":{"1min":0.66400000000000003,"5min":0.64200000000000002,"15min":0.64200000000000002},"max":{"1min":1.5600000000000001,"5min":2.0169999999999999,"15min":2.0169999999999999},"last":0.96299999999999997},{"interface":"front","average":{"1min":1.163,"5min":1.1739999999999999,"15min":1.1919999999999999},"min":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"max":{"1min":1.71,"5min":1.71,"15min":1.71},"last":1.319}]},{"osd":2,"last update":"Tue Dec 12 09:47:18 2023","interfaces":[{"interface":"back","average":{"1min":1.0840000000000001,"5min":1.1839999999999999,"15min":1.218},"min":{"1min":0.77700000000000002,"5min":0.71199999999999997,"15min":0.71199999999999997},"max":{"1min":1.526,"5min":1.804,"15min":1.804},"last":1.2},{"interface":"front","average":{"1min":1.1240000000000001,"5min":1.22,"15min":1.282},"min":{"1min":0.72499999999999998,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":1.679,"5min":2.2160000000000002,"15min":2.2160000000000002},"last":1.258}]},{"osd":3,"last update":"Tue Dec 12 09:47:18 2023","interfaces":[{"interface":"back","average":{"1min":1.1140000000000001,"5min":1.1910000000000001,"15min":1.2090000000000001},"min":{"1min":0.73199999999999998,"5min":0.71899999999999997,"15min":0.71899999999999997},"max":{"1min":1.5309999999999999,"5min":2.665,"15min":2.665},"last":1.0880000000000001},{"interface":"front","average":{"1min":1.1180000000000001,"5min":1.1679999999999999,"15min":1.21},"min":{"1min":0.76700000000000002,"5min":0.65700000000000003,"15min":0.65700000000000003},"max":{"1min":1.4710000000000001,"5min":1.8620000000000001,"15min":1.8620000000000001},"last":1.153}]},{"osd":4,"last update":"Tue Dec 12 09:47:18 2023","interfaces":[{"interface":"back","average":{"1min":1.1870000000000001,"5min":1.2669999999999999,"15min":1.272},"min":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.696,"5min":2.0310000000000001,"15min":2.0310000000000001},"last":1.4079999999999999},{"interface":"front","average":{"1min":1.339,"5min":1.395,"15min":1.403},"min":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":1.853,"5min":2.2799999999999998,"15min":2.2799999999999998},"last":1.609}]},{"osd":5,"last update":"Tue Dec 12 09:47:18 2023","interfaces":[{"interface":"back","average":{"1min":1.2110000000000001,"5min":1.331,"15min":1.4039999999999999},"min":{"1min":0.55500000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":2.1419999999999999,"5min":2.1739999999999999,"15min":2.1739999999999999},"last":1.369},{"interface":"front","average":{"1min":1.3799999999999999,"5min":1.46,"15min":1.4710000000000001},"min":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"max":{"1min":2.2360000000000002,"5min":2.2360000000000002,"15min":2.2360000000000002},"last":1.556}]},{"osd":7,"last update":"Tue Dec 12 09:47:18 2023","interfaces":[{"interface":"back","average":{"1min":1.266,"5min":1.427,"15min":1.4810000000000001},"min":{"1min":0.67600000000000005,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.736,"5min":1.994,"15min":1.994},"last":1.712},{"interface":"front","average":{"1min":1.2689999999999999,"5min":1.427,"15min":1.5009999999999999},"min":{"1min":0.628,"5min":0.628,"15min":0.628},"max":{"1min":1.5820000000000001,"5min":2.0800000000000001,"15min":2.0800000000000001},"last":1.6619999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574901,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32224,"kb_used_data":1044,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339616,"statfs":{"total":96636764160,"available":96603766784,"internally_reserved":0,"allocated":1069056,"data_stored":480803,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 12 09:47:18 2023","interfaces":[{"interface":"back","average":{"1min":1.097,"5min":1.042,"15min":1.0269999999999999},"min":{"1min":0.84999999999999998,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.4890000000000001,"5min":1.7310000000000001,"15min":1.7310000000000001},"last":0.80800000000000005},{"interface":"front","average":{"1min":1.038,"5min":1.083,"15min":1.1140000000000001},"min":{"1min":0.68500000000000005,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.679,"5min":1.679,"15min":1.679},"last":0.78600000000000003}]},{"osd":1,"last update":"Tue Dec 12 09:47:18 2023","interfaces":[{"interface":"back","average":{"1min":1.266,"5min":1.1579999999999999,"15min":1.2030000000000001},"min":{"1min":0.77600000000000002,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":2.3359999999999999,"5min":2.3359999999999999,"15min":2.3359999999999999},"last":0.66700000000000004},{"interface":"front","average":{"1min":1.2230000000000001,"5min":1.1060000000000001,"15min":1.0960000000000001},"min":{"1min":0.71099999999999997,"5min":0.66400000000000003,"15min":0.66400000000000003},"max":{"1min":2.3780000000000001,"5min":2.3780000000000001,"15min":2.3780000000000001},"last":0.97299999999999998}]},{"osd":2,"last update":"Tue Dec 12 09:47:18 2023","interfaces":[{"interface":"back","average":{"1min":1.04,"5min":1.198,"15min":1.2769999999999999},"min":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"max":{"1min":1.4650000000000001,"5min":1.7889999999999999,"15min":1.7889999999999999},"last":0.72199999999999998},{"interface":"front","average":{"1min":1.1910000000000001,"5min":1.2549999999999999,"15min":1.365},"min":{"1min":0.82399999999999995,"5min":0.72899999999999998,"15min":0.72899999999999998},"max":{"1min":1.9950000000000001,"5min":2.1600000000000001,"15min":2.1600000000000001},"last":0.86099999999999999}]},{"osd":3,"last update":"Tue Dec 12 09:47:18 2023","interfaces":[{"interface":"back","average":{"1min":1.226,"5min":1.2669999999999999,"15min":1.3360000000000001},"min":{"1min":0.83399999999999996,"5min":0.77300000000000002,"15min":0.77300000000000002},"max":{"1min":1.831,"5min":2.1499999999999999,"15min":2.1499999999999999},"last":1.1890000000000001},{"interface":"front","average":{"1min":1.254,"5min":1.3660000000000001,"15min":1.45},"min":{"1min":0.879,"5min":0.75800000000000001,"15min":0.75800000000000001},"max":{"1min":1.7410000000000001,"5min":2.0249999999999999,"15min":2.0249999999999999},"last":0.91000000000000003}]},{"osd":4,"last update":"Tue Dec 12 09:47:18 2023","interfaces":[{"interface":"back","average":{"1min":1.361,"5min":1.3759999999999999,"15min":1.452},"min":{"1min":0.747,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":2.488,"5min":2.488,"15min":2.488},"last":1.0860000000000001},{"interface":"front","average":{"1min":1.4259999999999999,"5min":1.498,"15min":1.5580000000000001},"min":{"1min":0.71299999999999997,"5min":0.65300000000000002,"15min":0.65300000000000002},"max":{"1min":2.5870000000000002,"5min":2.6040000000000001,"15min":2.6040000000000001},"last":1.55}]},{"osd":6,"last update":"Tue Dec 12 09:47:18 2023","interfaces":[{"interface":"back","average":{"1min":1.28,"5min":1.448,"15min":1.546},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.9359999999999999,"5min":2.1179999999999999,"15min":2.1179999999999999},"last":1.1439999999999999},{"interface":"front","average":{"1min":1.345,"5min":1.452,"15min":1.571},"min":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":2.6589999999999998,"5min":2.6589999999999998,"15min":2.6589999999999998},"last":1.3069999999999999}]},{"osd":7,"last update":"Tue Dec 12 09:47:18 2023","interfaces":[{"interface":"back","average":{"1min":1.548,"5min":1.6399999999999999,"15min":1.736},"min":{"1min":0.90500000000000003,"5min":0.83699999999999997,"15min":0.83699999999999997},"max":{"1min":2.8519999999999999,"5min":2.8519999999999999,"15min":2.8519999999999999},"last":1.649},{"interface":"front","average":{"1min":1.4219999999999999,"5min":1.595,"15min":1.6970000000000001},"min":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"max":{"1min":2.0619999999999998,"5min":2.4910000000000001,"15min":2.4910000000000001},"last":1.0429999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574903,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32236,"kb_used_data":1056,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339604,"statfs":{"total":96636764160,"available":96603754496,"internally_reserved":0,"allocated":1081344,"data_stored":486282,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 12 09:47:20 2023","interfaces":[{"interface":"back","average":{"1min":1.107,"5min":1.0649999999999999,"15min":1.0580000000000001},"min":{"1min":0.70099999999999996,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":1.6579999999999999,"5min":1.7010000000000001,"15min":1.7010000000000001},"last":1.452},{"interface":"front","average":{"1min":1.266,"5min":1.1020000000000001,"15min":1.0700000000000001},"min":{"1min":0.90200000000000002,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":2.2010000000000001,"5min":2.2010000000000001,"15min":2.2010000000000001},"last":0.92000000000000004}]},{"osd":1,"last update":"Tue Dec 12 09:47:20 2023","interfaces":[{"interface":"back","average":{"1min":1.0229999999999999,"5min":1.044,"15min":1.044},"min":{"1min":0.69699999999999995,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":1.6180000000000001,"5min":1.6180000000000001,"15min":1.6180000000000001},"last":1.1870000000000001},{"interface":"front","average":{"1min":1.2330000000000001,"5min":1.1739999999999999,"15min":1.1779999999999999},"min":{"1min":0.76100000000000001,"5min":0.73699999999999999,"15min":0.73699999999999999},"max":{"1min":2.1600000000000001,"5min":2.1600000000000001,"15min":2.1600000000000001},"last":1.704}]},{"osd":2,"last update":"Tue Dec 12 09:47:20 2023","interfaces":[{"interface":"back","average":{"1min":1.131,"5min":1.139,"15min":1.125},"min":{"1min":0.82699999999999996,"5min":0.71299999999999997,"15min":0.71299999999999997},"max":{"1min":1.798,"5min":1.798,"15min":1.798},"last":1.1439999999999999},{"interface":"front","average":{"1min":1.3300000000000001,"5min":1.276,"15min":1.288},"min":{"1min":0.84499999999999997,"5min":0.75600000000000001,"15min":0.75600000000000001},"max":{"1min":2.2650000000000001,"5min":2.2650000000000001,"15min":2.2650000000000001},"last":1.5249999999999999}]},{"osd":3,"last update":"Tue Dec 12 09:47:20 2023","interfaces":[{"interface":"back","average":{"1min":1.2689999999999999,"5min":1.258,"15min":1.2210000000000001},"min":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"max":{"1min":1.948,"5min":1.948,"15min":1.948},"last":1.0369999999999999},{"interface":"front","average":{"1min":1.2050000000000001,"5min":1.228,"15min":1.234},"min":{"1min":0.80600000000000005,"5min":0.70599999999999996,"15min":0.70599999999999996},"max":{"1min":1.798,"5min":2.0499999999999998,"15min":2.0499999999999998},"last":1.3089999999999999}]},{"osd":5,"last update":"Tue Dec 12 09:47:20 2023","interfaces":[{"interface":"back","average":{"1min":1.399,"5min":1.4039999999999999,"15min":1.446},"min":{"1min":0.76800000000000002,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":2.0329999999999999,"5min":2.3159999999999998,"15min":2.3159999999999998},"last":1.258},{"interface":"front","average":{"1min":1.3959999999999999,"5min":1.389,"15min":1.363},"min":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"max":{"1min":2.0030000000000001,"5min":2.117,"15min":2.117},"last":1.2270000000000001}]},{"osd":6,"last update":"Tue Dec 12 09:47:20 2023","interfaces":[{"interface":"back","average":{"1min":1.3029999999999999,"5min":1.361,"15min":1.389},"min":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"max":{"1min":1.625,"5min":2.246,"15min":2.246},"last":1.387},{"interface":"front","average":{"1min":1.488,"5min":1.5209999999999999,"15min":1.5389999999999999},"min":{"1min":0.70899999999999996,"5min":0.65600000000000003,"15min":0.65600000000000003},"max":{"1min":2.093,"5min":2.5099999999999998,"15min":2.5099999999999998},"last":1.762}]},{"osd":7,"last update":"Tue Dec 12 09:47:20 2023","interfaces":[{"interface":"back","average":{"1min":1.484,"5min":1.5049999999999999,"15min":1.5049999999999999},"min":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"max":{"1min":2.0619999999999998,"5min":2.5710000000000002,"15min":2.5710000000000002},"last":1.3620000000000001},{"interface":"front","average":{"1min":1.464,"5min":1.512,"15min":1.512},"min":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"max":{"1min":1.994,"5min":2.3919999999999999,"15min":2.3919999999999999},"last":1.885}]}]},{"osd":3,"up_from":13,"seq":55834574901,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32232,"kb_used_data":1052,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339608,"statfs":{"total":96636764160,"available":96603758592,"internally_reserved":0,"allocated":1077248,"data_stored":486180,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 12 09:47:21 2023","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.80800000000000005,"15min":0.878},"min":{"1min":0.32300000000000001,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":1.1339999999999999,"5min":1.4830000000000001,"15min":1.4830000000000001},"last":0.80500000000000005},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.93400000000000005,"15min":1.069},"min":{"1min":0.48499999999999999,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":1.4730000000000001,"5min":3.3370000000000002,"15min":3.3370000000000002},"last":1.0009999999999999}]},{"osd":1,"last update":"Tue Dec 12 09:47:21 2023","interfaces":[{"interface":"back","average":{"1min":0.85199999999999998,"5min":0.86099999999999999,"15min":0.90000000000000002},"min":{"1min":0.38600000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":1.446,"5min":1.4870000000000001,"15min":1.4870000000000001},"last":1.4770000000000001},{"interface":"front","average":{"1min":0.96499999999999997,"5min":1,"15min":1.046},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.4970000000000001,"5min":2.9409999999999998,"15min":2.9409999999999998},"last":1.542}]},{"osd":2,"last update":"Tue Dec 12 09:47:21 2023","interfaces":[{"interface":"back","average":{"1min":0.92200000000000004,"5min":1.0229999999999999,"15min":1.1319999999999999},"min":{"1min":0.42399999999999999,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.345,"5min":2.613,"15min":2.613},"last":1.141},{"interface":"front","average":{"1min":0.92500000000000004,"5min":1.048,"15min":1.139},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":1.4179999999999999,"5min":3.0430000000000001,"15min":3.0430000000000001},"last":1.1739999999999999}]},{"osd":4,"last update":"Tue Dec 12 09:47:21 2023","interfaces":[{"interface":"back","average":{"1min":1.0409999999999999,"5min":1.2310000000000001,"15min":1.3320000000000001},"min":{"1min":0.64000000000000001,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.478,"5min":3.5019999999999998,"15min":3.5019999999999998},"last":1.216},{"interface":"front","average":{"1min":1.1910000000000001,"5min":1.2969999999999999,"15min":1.421},"min":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.8089999999999999,"5min":2.9889999999999999,"15min":2.9889999999999999},"last":1.2589999999999999}]},{"osd":5,"last update":"Tue Dec 12 09:47:21 2023","interfaces":[{"interface":"back","average":{"1min":1.149,"5min":1.341,"15min":1.4470000000000001},"min":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":1.542,"5min":4.2480000000000002,"15min":4.2480000000000002},"last":1.2989999999999999},{"interface":"front","average":{"1min":1.0880000000000001,"5min":1.3440000000000001,"15min":1.5089999999999999},"min":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.583,"5min":5.5060000000000002,"15min":5.5060000000000002},"last":1.5800000000000001}]},{"osd":6,"last update":"Tue Dec 12 09:47:21 2023","interfaces":[{"interface":"back","average":{"1min":1.238,"5min":1.3089999999999999,"15min":1.4079999999999999},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.714,"5min":3.1400000000000001,"15min":3.1400000000000001},"last":1.3320000000000001},{"interface":"front","average":{"1min":1.2490000000000001,"5min":1.397,"15min":1.4970000000000001},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.6120000000000001,"5min":4.3179999999999996,"15min":4.3179999999999996},"last":1.4179999999999999}]},{"osd":7,"last update":"Tue Dec 12 09:47:21 2023","interfaces":[{"interface":"back","average":{"1min":1.206,"5min":1.3859999999999999,"15min":1.5229999999999999},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.679,"5min":5.3979999999999997,"15min":5.3979999999999997},"last":1.514},{"interface":"front","average":{"1min":1.2929999999999999,"5min":1.3999999999999999,"15min":1.502},"min":{"1min":0.623,"5min":0.623,"15min":0.623},"max":{"1min":1.9690000000000001,"5min":3.4129999999999998,"15min":3.4129999999999998},"last":1.6120000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574901,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32228,"kb_used_data":1048,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339612,"statfs":{"total":96636764160,"available":96603762688,"internally_reserved":0,"allocated":1073152,"data_stored":480941,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 12 09:47:20 2023","interfaces":[{"interface":"back","average":{"1min":0.79200000000000004,"5min":0.79800000000000004,"15min":0.81200000000000006},"min":{"1min":0.40000000000000002,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":1.395,"5min":1.458,"15min":1.458},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.81499999999999995,"5min":0.875,"15min":0.90000000000000002},"min":{"1min":0.40100000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":1.28,"5min":2.4129999999999998,"15min":2.4129999999999998},"last":0.502}]},{"osd":1,"last update":"Tue Dec 12 09:47:20 2023","interfaces":[{"interface":"back","average":{"1min":0.91000000000000003,"5min":0.85599999999999998,"15min":0.86099999999999999},"min":{"1min":0.45800000000000002,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":1.5649999999999999,"5min":1.593,"15min":1.593},"last":0.746},{"interface":"front","average":{"1min":0.97699999999999998,"5min":0.91500000000000004,"15min":0.89600000000000002},"min":{"1min":0.55200000000000005,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.413,"5min":1.758,"15min":1.758},"last":0.68899999999999995}]},{"osd":3,"last update":"Tue Dec 12 09:47:20 2023","interfaces":[{"interface":"back","average":{"1min":0.98599999999999999,"5min":1.0189999999999999,"15min":1.044},"min":{"1min":0.60599999999999998,"5min":0.503,"15min":0.503},"max":{"1min":1.506,"5min":1.889,"15min":1.889},"last":0.79300000000000004},{"interface":"front","average":{"1min":0.875,"5min":0.93400000000000005,"15min":0.98399999999999999},"min":{"1min":0.48499999999999999,"5min":0.432,"15min":0.432},"max":{"1min":1.298,"5min":1.8120000000000001,"15min":1.8120000000000001},"last":0.84199999999999997}]},{"osd":4,"last update":"Tue Dec 12 09:47:20 2023","interfaces":[{"interface":"back","average":{"1min":1.157,"5min":1.177,"15min":1.21},"min":{"1min":0.83799999999999997,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.5409999999999999,"5min":2.5760000000000001,"15min":2.5760000000000001},"last":1.0409999999999999},{"interface":"front","average":{"1min":1.254,"5min":1.28,"15min":1.3560000000000001},"min":{"1min":0.84899999999999998,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.613,"5min":2.8069999999999999,"15min":2.8069999999999999},"last":1.365}]},{"osd":5,"last update":"Tue Dec 12 09:47:20 2023","interfaces":[{"interface":"back","average":{"1min":1.2470000000000001,"5min":1.3100000000000001,"15min":1.3560000000000001},"min":{"1min":0.89500000000000002,"5min":0.80500000000000005,"15min":0.80500000000000005},"max":{"1min":1.5720000000000001,"5min":2.3109999999999999,"15min":2.3109999999999999},"last":1.0740000000000001},{"interface":"front","average":{"1min":1.1950000000000001,"5min":1.25,"15min":1.3169999999999999},"min":{"1min":0.78400000000000003,"5min":0.627,"15min":0.627},"max":{"1min":1.7390000000000001,"5min":2.5110000000000001,"15min":2.5110000000000001},"last":1.1919999999999999}]},{"osd":6,"last update":"Tue Dec 12 09:47:20 2023","interfaces":[{"interface":"back","average":{"1min":1.3109999999999999,"5min":1.3540000000000001,"15min":1.409},"min":{"1min":0.92600000000000005,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":1.6319999999999999,"5min":2.907,"15min":2.907},"last":0.95299999999999996},{"interface":"front","average":{"1min":1.242,"5min":1.363,"15min":1.407},"min":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"max":{"1min":1.7509999999999999,"5min":2.6000000000000001,"15min":2.6000000000000001},"last":1.3420000000000001}]},{"osd":7,"last update":"Tue Dec 12 09:47:20 2023","interfaces":[{"interface":"back","average":{"1min":1.3220000000000001,"5min":1.3740000000000001,"15min":1.429},"min":{"1min":0.90900000000000003,"5min":0.70799999999999996,"15min":0.70799999999999996},"max":{"1min":1.577,"5min":2.3370000000000002,"15min":2.3370000000000002},"last":1.1060000000000001},{"interface":"front","average":{"1min":1.3480000000000001,"5min":1.4330000000000001,"15min":1.486},"min":{"1min":0.94699999999999995,"5min":0.84199999999999997,"15min":0.84199999999999997},"max":{"1min":1.8109999999999999,"5min":2.488,"15min":2.488},"last":1.446}]}]},{"osd":1,"up_from":13,"seq":55834574901,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32212,"kb_used_data":1032,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339628,"statfs":{"total":96636764160,"available":96603779072,"internally_reserved":0,"allocated":1056768,"data_stored":474848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 12 09:47:18 2023","interfaces":[{"interface":"back","average":{"1min":0.85799999999999998,"5min":0.83799999999999997,"15min":0.84999999999999998},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":1.46,"5min":2.794,"15min":2.794},"last":1.0009999999999999},{"interface":"front","average":{"1min":0.751,"5min":0.80300000000000005,"15min":0.84499999999999997},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":1.6359999999999999,"5min":2.1379999999999999,"15min":2.1379999999999999},"last":0.66100000000000003}]},{"osd":2,"last update":"Tue Dec 12 09:47:18 2023","interfaces":[{"interface":"back","average":{"1min":0.83399999999999996,"5min":0.90500000000000003,"15min":0.95899999999999996},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":1.2509999999999999,"5min":6.3390000000000004,"15min":6.3390000000000004},"last":1.0289999999999999},{"interface":"front","average":{"1min":0.90400000000000003,"5min":0.93400000000000005,"15min":0.95599999999999996},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.3400000000000001,"5min":2.823,"15min":2.823},"last":1.3460000000000001}]},{"osd":3,"last update":"Tue Dec 12 09:47:18 2023","interfaces":[{"interface":"back","average":{"1min":0.90900000000000003,"5min":1.004,"15min":1.0349999999999999},"min":{"1min":0.48999999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":1.919,"5min":2.7519999999999998,"15min":2.7519999999999998},"last":0.95299999999999996},{"interface":"front","average":{"1min":0.879,"5min":0.95899999999999996,"15min":0.99099999999999999},"min":{"1min":0.434,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":1.4430000000000001,"5min":2.2559999999999998,"15min":2.2559999999999998},"last":0.74399999999999999}]},{"osd":4,"last update":"Tue Dec 12 09:47:18 2023","interfaces":[{"interface":"back","average":{"1min":1.097,"5min":1.232,"15min":1.343},"min":{"1min":0.73499999999999999,"5min":0.68400000000000005,"15min":0.68400000000000005},"max":{"1min":1.883,"5min":6.423,"15min":6.423},"last":1.49},{"interface":"front","average":{"1min":1.1970000000000001,"5min":1.1910000000000001,"15min":1.1930000000000001},"min":{"1min":0.84299999999999997,"5min":0.80000000000000004,"15min":0.80000000000000004},"max":{"1min":1.9590000000000001,"5min":2.2309999999999999,"15min":2.2309999999999999},"last":1.0820000000000001}]},{"osd":5,"last update":"Tue Dec 12 09:47:18 2023","interfaces":[{"interface":"back","average":{"1min":1.236,"5min":1.3069999999999999,"15min":1.413},"min":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"max":{"1min":2.556,"5min":6.2830000000000004,"15min":6.2830000000000004},"last":1.583},{"interface":"front","average":{"1min":1.242,"5min":1.2989999999999999,"15min":1.349},"min":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"max":{"1min":2.3999999999999999,"5min":2.73,"15min":2.73},"last":1.2490000000000001}]},{"osd":6,"last update":"Tue Dec 12 09:47:18 2023","interfaces":[{"interface":"back","average":{"1min":1.2490000000000001,"5min":1.3839999999999999,"15min":1.5009999999999999},"min":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"max":{"1min":1.8520000000000001,"5min":6.468,"15min":6.468},"last":1.1990000000000001},{"interface":"front","average":{"1min":1.222,"5min":1.375,"15min":1.5109999999999999},"min":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"max":{"1min":1.978,"5min":6.3129999999999997,"15min":6.3129999999999997},"last":1.667}]},{"osd":7,"last update":"Tue Dec 12 09:47:18 2023","interfaces":[{"interface":"back","average":{"1min":1.1879999999999999,"5min":1.333,"15min":1.3819999999999999},"min":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"max":{"1min":1.8600000000000001,"5min":2.9009999999999998,"15min":2.9009999999999998},"last":1.3939999999999999},{"interface":"front","average":{"1min":1.1919999999999999,"5min":1.3799999999999999,"15min":1.4970000000000001},"min":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"max":{"1min":2.012,"5min":6.242,"15min":6.242},"last":1.29}]}]},{"osd":0,"up_from":13,"seq":55834574903,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32276,"kb_used_data":1096,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339564,"statfs":{"total":96636764160,"available":96603713536,"internally_reserved":0,"allocated":1122304,"data_stored":1065660,"data_compressed":32422,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Dec 12 09:47:21 2023","interfaces":[{"interface":"back","average":{"1min":0.82299999999999995,"5min":0.79000000000000004,"15min":0.77700000000000002},"min":{"1min":0.45600000000000002,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":1.446,"5min":1.639,"15min":1.639},"last":0.91400000000000003},{"interface":"front","average":{"1min":0.86799999999999999,"5min":0.83999999999999997,"15min":0.82399999999999995},"min":{"1min":0.39400000000000002,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":1.3979999999999999,"5min":1.5680000000000001,"15min":1.5680000000000001},"last":0.97899999999999998}]},{"osd":2,"last update":"Tue Dec 12 09:47:21 2023","interfaces":[{"interface":"back","average":{"1min":0.90100000000000002,"5min":0.88800000000000001,"15min":0.87},"min":{"1min":0.58699999999999997,"5min":0.316,"15min":0.316},"max":{"1min":1.4910000000000001,"5min":1.748,"15min":1.748},"last":1.2150000000000001},{"interface":"front","average":{"1min":0.94399999999999995,"5min":0.96399999999999997,"15min":0.98399999999999999},"min":{"1min":0.47299999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":1.4910000000000001,"5min":1.649,"15min":1.649},"last":1.4990000000000001}]},{"osd":3,"last update":"Tue Dec 12 09:47:21 2023","interfaces":[{"interface":"back","average":{"1min":0.96199999999999997,"5min":0.86299999999999999,"15min":0.85599999999999998},"min":{"1min":0.42999999999999999,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":2.1800000000000002,"5min":2.1800000000000002,"15min":2.1800000000000002},"last":1.0669999999999999},{"interface":"front","average":{"1min":1.034,"5min":1.0189999999999999,"15min":1.0089999999999999},"min":{"1min":0.55100000000000005,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":1.877,"5min":2.3210000000000002,"15min":2.3210000000000002},"last":1.3149999999999999}]},{"osd":4,"last update":"Tue Dec 12 09:47:21 2023","interfaces":[{"interface":"back","average":{"1min":1.2310000000000001,"5min":1.2729999999999999,"15min":1.282},"min":{"1min":0.86199999999999999,"5min":0.80400000000000005,"15min":0.80400000000000005},"max":{"1min":1.758,"5min":2.073,"15min":2.073},"last":1.589},{"interface":"front","average":{"1min":1.3460000000000001,"5min":1.276,"15min":1.2869999999999999},"min":{"1min":0.90500000000000003,"5min":0.64400000000000002,"15min":0.64400000000000002},"max":{"1min":2.0990000000000002,"5min":3.0699999999999998,"15min":3.0699999999999998},"last":1.7529999999999999}]},{"osd":5,"last update":"Tue Dec 12 09:47:21 2023","interfaces":[{"interface":"back","average":{"1min":1.2629999999999999,"5min":1.2150000000000001,"15min":1.2270000000000001},"min":{"1min":0.71199999999999997,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":2.2730000000000001,"5min":3.1909999999999998,"15min":3.1909999999999998},"last":1.4359999999999999},{"interface":"front","average":{"1min":1.3120000000000001,"5min":1.2929999999999999,"15min":1.302},"min":{"1min":0.88500000000000001,"5min":0.67300000000000004,"15min":0.67300000000000004},"max":{"1min":1.7110000000000001,"5min":2.2120000000000002,"15min":2.2120000000000002},"last":1.8080000000000001}]},{"osd":6,"last update":"Tue Dec 12 09:47:21 2023","interfaces":[{"interface":"back","average":{"1min":1.278,"5min":1.3220000000000001,"15min":1.3320000000000001},"min":{"1min":0.83199999999999996,"5min":0.67500000000000004,"15min":0.67500000000000004},"max":{"1min":1.6180000000000001,"5min":2.04,"15min":2.04},"last":1.625},{"interface":"front","average":{"1min":1.321,"5min":1.3520000000000001,"15min":1.3779999999999999},"min":{"1min":0.80900000000000005,"5min":0.67500000000000004,"15min":0.67500000000000004},"max":{"1min":2.0670000000000002,"5min":2.9100000000000001,"15min":2.9100000000000001},"last":1.2529999999999999}]},{"osd":7,"last update":"Tue Dec 12 09:47:21 2023","interfaces":[{"interface":"back","average":{"1min":1.423,"5min":1.4079999999999999,"15min":1.4319999999999999},"min":{"1min":0.999,"5min":0.66800000000000004,"15min":0.66800000000000004},"max":{"1min":1.8200000000000001,"5min":2.992,"15min":2.992},"last":1.153},{"interface":"front","average":{"1min":1.3879999999999999,"5min":1.3380000000000001,"15min":1.3320000000000001},"min":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"max":{"1min":1.9299999999999999,"5min":2.7690000000000001,"15min":2.7690000000000001},"last":1.5449999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32422,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32422,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-12T09:47:33.107 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-12T09:47:33.302 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:33.300+0000 7f3056101640 1 Processor -- start 2023-12-12T09:47:33.302 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:33.300+0000 7f3056101640 1 -- start start 2023-12-12T09:47:33.303 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:33.302+0000 7f3056101640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f305006bf20 0x7f30500a9760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:33.304 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:33.302+0000 7f3056101640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30500c0b50 con 0x7f30501552e0 2023-12-12T09:47:33.304 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:33.302+0000 7f3056101640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f305006c880 con 0x7f30500a50f0 2023-12-12T09:47:33.304 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:33.302+0000 7f3056101640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30500c04d0 con 0x7f305006bf20 2023-12-12T09:47:33.304 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:33.302+0000 7f304f7fe640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f30501552e0 0x7f30500c49c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:54606/0 (socket says 172.21.15.73:54606) 2023-12-12T09:47:33.304 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:33.302+0000 7f304f7fe640 1 -- 172.21.15.73:0/3667947914 learned_addr learned my addr 172.21.15.73:0/3667947914 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-12T09:47:33.306 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:33.302+0000 7f304ffff640 1 --2- 172.21.15.73:0/3667947914 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f305006bf20 0x7f30500a9760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:33.306 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:33.302+0000 7f304e7fc640 1 -- 172.21.15.73:0/3667947914 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 727995858 0 0) 0x7f30500c0b50 con 0x7f30501552e0 2023-12-12T09:47:33.306 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:33.302+0000 7f304e7fc640 1 -- 172.21.15.73:0/3667947914 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3038003520 con 0x7f30501552e0 2023-12-12T09:47:33.306 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:33.303+0000 7f304e7fc640 1 -- 172.21.15.73:0/3667947914 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1447985624 0 0) 0x7f3038003520 con 0x7f30501552e0 2023-12-12T09:47:33.306 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:33.303+0000 7f304e7fc640 1 -- 172.21.15.73:0/3667947914 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f305006bf20 msgr2=0x7f30500a9760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:47:33.306 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:33.303+0000 7f304e7fc640 1 --2- 172.21.15.73:0/3667947914 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f305006bf20 0x7f30500a9760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:33.306 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:33.303+0000 7f304e7fc640 1 -- 172.21.15.73:0/3667947914 >> v1:172.21.15.142:6789/0 conn(0x7f30500a50f0 legacy=0x7f30500a9050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:33.307 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:33.303+0000 7f304e7fc640 1 -- 172.21.15.73:0/3667947914 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f305006cb60 con 0x7f30501552e0 2023-12-12T09:47:33.307 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:33.303+0000 7f304e7fc640 1 -- 172.21.15.73:0/3667947914 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3186547832 0 0) 0x7f3040001670 con 0x7f30501552e0 2023-12-12T09:47:33.307 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:33.303+0000 7f304e7fc640 1 -- 172.21.15.73:0/3667947914 >> v1:172.21.15.73:6789/0 conn(0x7f30501552e0 legacy=0x7f30500c49c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:33.307 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:33.303+0000 7f304e7fc640 1 --2- 172.21.15.73:0/3667947914 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f30380039a0 0x7f3038003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:33.307 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:33.303+0000 7f304e7fc640 1 --2- 172.21.15.73:0/3667947914 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f305006bf20 0x7f30380047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:33.307 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:33.303+0000 7f304e7fc640 1 --2- 172.21.15.73:0/3667947914 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3038004d00 0x7f3038005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:33.307 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:33.303+0000 7f304e7fc640 1 -- 172.21.15.73:0/3667947914 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30500c04d0 con 0x7f30380039a0 2023-12-12T09:47:33.307 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:33.303+0000 7f304e7fc640 1 -- 172.21.15.73:0/3667947914 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f303800bb10 con 0x7f3038004d00 2023-12-12T09:47:33.307 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:33.303+0000 7f304e7fc640 1 -- 172.21.15.73:0/3667947914 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f303800dee0 con 0x7f305006bf20 2023-12-12T09:47:33.308 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:33.303+0000 7f304f7fe640 1 --2- 172.21.15.73:0/3667947914 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f30380039a0 0x7f3038003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:33.308 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:33.304+0000 7f304ffff640 1 --2- 172.21.15.73:0/3667947914 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3038004d00 0x7f3038005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:33.308 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:33.304+0000 7f304effd640 1 --2- 172.21.15.73:0/3667947914 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f305006bf20 0x7f30380047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:33.308 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:33.304+0000 7f304f7fe640 1 -- 172.21.15.73:0/3667947914 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f305006bf20 msgr2=0x7f30380047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:47:33.309 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:33.304+0000 7f304f7fe640 1 --2- 172.21.15.73:0/3667947914 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f305006bf20 0x7f30380047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:33.309 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:33.304+0000 7f304f7fe640 1 -- 172.21.15.73:0/3667947914 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3038004d00 msgr2=0x7f3038005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:47:33.309 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:33.304+0000 7f304f7fe640 1 --2- 172.21.15.73:0/3667947914 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3038004d00 0x7f3038005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:33.309 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:33.304+0000 7f304f7fe640 1 -- 172.21.15.73:0/3667947914 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3038003520 con 0x7f30380039a0 2023-12-12T09:47:33.312 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:33.305+0000 7f304f7fe640 1 --2- 172.21.15.73:0/3667947914 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f30380039a0 0x7f3038003dc0 secure :-1 s=READY pgs=1147 cs=0 l=1 rev1=1 crypto rx=0x7f304000c0e0 tx=0x7f30380057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8bccaaaca481f64e server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:47:33.312 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:33.305+0000 7f304e7fc640 1 -- 172.21.15.73:0/3667947914 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3040005ad0 con 0x7f30380039a0 2023-12-12T09:47:33.312 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:33.305+0000 7f304e7fc640 1 -- 172.21.15.73:0/3667947914 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3040005c50 con 0x7f30380039a0 2023-12-12T09:47:33.312 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:33.305+0000 7f304e7fc640 1 -- 172.21.15.73:0/3667947914 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f304002c7d0 con 0x7f30380039a0 2023-12-12T09:47:33.312 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:33.306+0000 7f3056101640 1 -- 172.21.15.73:0/3667947914 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f30380039a0 msgr2=0x7f3038003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:33.313 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:33.306+0000 7f3056101640 1 --2- 172.21.15.73:0/3667947914 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f30380039a0 0x7f3038003dc0 secure :-1 s=READY pgs=1147 cs=0 l=1 rev1=1 crypto rx=0x7f304000c0e0 tx=0x7f30380057f0 comp rx=0 tx=0).stop 2023-12-12T09:47:33.313 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:33.306+0000 7f304ffff640 1 -- 172.21.15.73:0/3667947914 reap_dead start 2023-12-12T09:47:33.313 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:33.306+0000 7f3056101640 1 -- 172.21.15.73:0/3667947914 shutdown_connections 2023-12-12T09:47:33.313 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:33.306+0000 7f3056101640 1 -- 172.21.15.73:0/3667947914 >> 172.21.15.73:0/3667947914 conn(0x7f30500a8130 msgr2=0x7f30500c24b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:47:33.313 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:33.306+0000 7f3056101640 1 -- 172.21.15.73:0/3667947914 shutdown_connections 2023-12-12T09:47:33.313 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:33.306+0000 7f3056101640 1 -- 172.21.15.73:0/3667947914 wait complete. 2023-12-12T09:47:33.313 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:33.307+0000 7f3056101640 1 Processor -- start 2023-12-12T09:47:33.313 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:33.308+0000 7f3056101640 1 -- start start 2023-12-12T09:47:33.313 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:33.308+0000 7f3056101640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f30380039a0 0x7f30501e93b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:33.314 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:33.308+0000 7f3056101640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f30501dacc0 0x7f30500aa390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:33.314 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:33.308+0000 7f3056101640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f305014e6d0 0x7f30501e6500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:33.314 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:33.308+0000 7f3056101640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30501ea2e0 con 0x7f30501dacc0 2023-12-12T09:47:33.314 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:33.308+0000 7f3056101640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3050072180 con 0x7f305014e6d0 2023-12-12T09:47:33.314 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:33.308+0000 7f3056101640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30501e9a40 con 0x7f30380039a0 2023-12-12T09:47:33.314 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:33.309+0000 7f304effd640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f30501dacc0 0x7f30500aa390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:33.314 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:33.309+0000 7f304effd640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f30501dacc0 0x7f30500aa390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:60174/0 (socket says 172.21.15.73:60174) 2023-12-12T09:47:33.314 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:33.309+0000 7f304effd640 1 -- 172.21.15.73:0/660839670 learned_addr learned my addr 172.21.15.73:0/660839670 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:47:33.315 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:33.309+0000 7f304effd640 1 -- 172.21.15.73:0/660839670 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f30380039a0 msgr2=0x7f30501e93b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:33.315 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:33.309+0000 7f304f7fe640 1 --2- 172.21.15.73:0/660839670 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f30380039a0 0x7f30501e93b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:33.315 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:33.309+0000 7f304ffff640 1 --2- 172.21.15.73:0/660839670 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f305014e6d0 0x7f30501e6500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:33.316 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:33.309+0000 7f304effd640 1 --2- 172.21.15.73:0/660839670 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f30380039a0 0x7f30501e93b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:33.316 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:33.309+0000 7f304effd640 1 -- 172.21.15.73:0/660839670 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f305014e6d0 msgr2=0x7f30501e6500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:33.316 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:33.309+0000 7f304effd640 1 --2- 172.21.15.73:0/660839670 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f305014e6d0 0x7f30501e6500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:33.316 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:33.309+0000 7f304effd640 1 -- 172.21.15.73:0/660839670 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30501e9d20 con 0x7f30501dacc0 2023-12-12T09:47:33.317 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:33.309+0000 7f304f7fe640 1 --2- 172.21.15.73:0/660839670 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f30380039a0 0x7f30501e93b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:47:33.317 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:33.309+0000 7f304effd640 1 --2- 172.21.15.73:0/660839670 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f30501dacc0 0x7f30500aa390 secure :-1 s=READY pgs=1148 cs=0 l=1 rev1=1 crypto rx=0x7f304400e580 tx=0x7f304400ea40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:47:33.317 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:33.310+0000 7f3037fff640 1 -- 172.21.15.73:0/660839670 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30440052e0 con 0x7f30501dacc0 2023-12-12T09:47:33.317 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:33.310+0000 7f3037fff640 1 -- 172.21.15.73:0/660839670 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3044005440 con 0x7f30501dacc0 2023-12-12T09:47:33.317 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:33.310+0000 7f3056101640 1 -- 172.21.15.73:0/660839670 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30501ea000 con 0x7f30501dacc0 2023-12-12T09:47:33.317 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:33.310+0000 7f3037fff640 1 -- 172.21.15.73:0/660839670 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3044003810 con 0x7f30501dacc0 2023-12-12T09:47:33.317 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:33.310+0000 7f3056101640 1 -- 172.21.15.73:0/660839670 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30500aa8d0 con 0x7f30501dacc0 2023-12-12T09:47:33.318 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:33.311+0000 7f3056101640 1 -- 172.21.15.73:0/660839670 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f30501e5e40 con 0x7f30501dacc0 2023-12-12T09:47:33.318 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:33.312+0000 7f3037fff640 1 -- 172.21.15.73:0/660839670 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f3044003970 con 0x7f30501dacc0 2023-12-12T09:47:33.319 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:33.313+0000 7f3037fff640 1 --2- 172.21.15.73:0/660839670 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f303c06ae40 0x7f303c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:33.319 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:33.313+0000 7f3037fff640 1 -- 172.21.15.73:0/660839670 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f3044089220 con 0x7f30501dacc0 2023-12-12T09:47:33.319 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:33.313+0000 7f304f7fe640 1 --2- 172.21.15.73:0/660839670 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f303c06ae40 0x7f303c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:33.319 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:33.314+0000 7f304f7fe640 1 --2- 172.21.15.73:0/660839670 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f303c06ae40 0x7f303c06d300 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f3040034000 tx=0x7f3040009030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:47:33.319 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:33.318+0000 7f3037fff640 1 -- 172.21.15.73:0/660839670 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f30501e5e40 con 0x7f30501dacc0 2023-12-12T09:47:33.505 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:33.503+0000 7f3056101640 1 -- 172.21.15.73:0/660839670 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f30501e5e40 con 0x7f30501dacc0 2023-12-12T09:47:33.506 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:33.504+0000 7f3037fff640 1 -- 172.21.15.73:0/660839670 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v87) v1 ==== 74+0+13127 (secure 0 0 0) 0x7f30501e5e40 con 0x7f30501dacc0 2023-12-12T09:47:33.506 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-12T09:47:33.506 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":87,"fsid":"ba240992-02b8-4c7e-92f2-27eb29ac433b","created":"2023-12-12T09:43:02.454719+0000","modified":"2023-12-12T09:47:29.842169+0000","last_up_change":"2023-12-12T09:43:13.913440+0000","last_in_change":"2023-12-12T09:43:05.925348+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-12T09:43:15.525508+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"dd9074be-dbe2-4c34-9896-a4223d8d3940","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":4047810203},{"type":"v1","addr":"172.21.15.73:6801","nonce":4047810203}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":4047810203},{"type":"v1","addr":"172.21.15.73:6803","nonce":4047810203}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":4047810203},{"type":"v1","addr":"172.21.15.73:6807","nonce":4047810203}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":4047810203},{"type":"v1","addr":"172.21.15.73:6805","nonce":4047810203}]},"public_addr":"172.21.15.73:6801/4047810203","cluster_addr":"172.21.15.73:6803/4047810203","heartbeat_back_addr":"172.21.15.73:6807/4047810203","heartbeat_front_addr":"172.21.15.73:6805/4047810203","state":["exists","up"]},{"osd":1,"uuid":"c4a05052-96d4-4758-a4e1-1a37f1e07fed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":1356058331},{"type":"v1","addr":"172.21.15.73:6824","nonce":1356058331}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":1356058331},{"type":"v1","addr":"172.21.15.73:6827","nonce":1356058331}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":1356058331},{"type":"v1","addr":"172.21.15.73:6831","nonce":1356058331}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":1356058331},{"type":"v1","addr":"172.21.15.73:6829","nonce":1356058331}]},"public_addr":"172.21.15.73:6824/1356058331","cluster_addr":"172.21.15.73:6827/1356058331","heartbeat_back_addr":"172.21.15.73:6831/1356058331","heartbeat_front_addr":"172.21.15.73:6829/1356058331","state":["exists","up"]},{"osd":2,"uuid":"512bc8ac-72c2-40d4-b3d2-d867a92c5213","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":1228903316},{"type":"v1","addr":"172.21.15.73:6817","nonce":1228903316}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":1228903316},{"type":"v1","addr":"172.21.15.73:6819","nonce":1228903316}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6823","nonce":1228903316},{"type":"v1","addr":"172.21.15.73:6825","nonce":1228903316}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":1228903316},{"type":"v1","addr":"172.21.15.73:6821","nonce":1228903316}]},"public_addr":"172.21.15.73:6817/1228903316","cluster_addr":"172.21.15.73:6819/1228903316","heartbeat_back_addr":"172.21.15.73:6825/1228903316","heartbeat_front_addr":"172.21.15.73:6821/1228903316","state":["exists","up"]},{"osd":3,"uuid":"3d1a91e0-42bf-437a-8eae-8d357c8f63a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":1293329670},{"type":"v1","addr":"172.21.15.73:6809","nonce":1293329670}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6810","nonce":1293329670},{"type":"v1","addr":"172.21.15.73:6811","nonce":1293329670}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":1293329670},{"type":"v1","addr":"172.21.15.73:6815","nonce":1293329670}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":1293329670},{"type":"v1","addr":"172.21.15.73:6813","nonce":1293329670}]},"public_addr":"172.21.15.73:6809/1293329670","cluster_addr":"172.21.15.73:6811/1293329670","heartbeat_back_addr":"172.21.15.73:6815/1293329670","heartbeat_front_addr":"172.21.15.73:6813/1293329670","state":["exists","up"]},{"osd":4,"uuid":"4b302fff-834c-4069-ac19-00e46f6c87b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":3727975702},{"type":"v1","addr":"172.21.15.142:6801","nonce":3727975702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":3727975702},{"type":"v1","addr":"172.21.15.142:6803","nonce":3727975702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6809","nonce":3727975702},{"type":"v1","addr":"172.21.15.142:6811","nonce":3727975702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6805","nonce":3727975702},{"type":"v1","addr":"172.21.15.142:6807","nonce":3727975702}]},"public_addr":"172.21.15.142:6801/3727975702","cluster_addr":"172.21.15.142:6803/3727975702","heartbeat_back_addr":"172.21.15.142:6811/3727975702","heartbeat_front_addr":"172.21.15.142:6807/3727975702","state":["exists","up"]},{"osd":5,"uuid":"d7cdace2-67d0-45cc-95f2-515cf6ef1b82","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6817","nonce":2353193632},{"type":"v1","addr":"172.21.15.142:6819","nonce":2353193632}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6821","nonce":2353193632},{"type":"v1","addr":"172.21.15.142:6823","nonce":2353193632}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6829","nonce":2353193632},{"type":"v1","addr":"172.21.15.142:6831","nonce":2353193632}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6825","nonce":2353193632},{"type":"v1","addr":"172.21.15.142:6827","nonce":2353193632}]},"public_addr":"172.21.15.142:6819/2353193632","cluster_addr":"172.21.15.142:6823/2353193632","heartbeat_back_addr":"172.21.15.142:6831/2353193632","heartbeat_front_addr":"172.21.15.142:6827/2353193632","state":["exists","up"]},{"osd":6,"uuid":"649ce78a-5626-445c-aedc-a651ed05a6f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":2006111986},{"type":"v1","addr":"172.21.15.142:6806","nonce":2006111986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":2006111986},{"type":"v1","addr":"172.21.15.142:6810","nonce":2006111986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":2006111986},{"type":"v1","addr":"172.21.15.142:6815","nonce":2006111986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":2006111986},{"type":"v1","addr":"172.21.15.142:6813","nonce":2006111986}]},"public_addr":"172.21.15.142:6806/2006111986","cluster_addr":"172.21.15.142:6810/2006111986","heartbeat_back_addr":"172.21.15.142:6815/2006111986","heartbeat_front_addr":"172.21.15.142:6813/2006111986","state":["exists","up"]},{"osd":7,"uuid":"af15ae3b-c1d0-4acf-92db-8a1805494d13","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":2573794341},{"type":"v1","addr":"172.21.15.142:6818","nonce":2573794341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":2573794341},{"type":"v1","addr":"172.21.15.142:6822","nonce":2573794341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":2573794341},{"type":"v1","addr":"172.21.15.142:6830","nonce":2573794341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":2573794341},{"type":"v1","addr":"172.21.15.142:6826","nonce":2573794341}]},"public_addr":"172.21.15.142:6818/2573794341","cluster_addr":"172.21.15.142:6822/2573794341","heartbeat_back_addr":"172.21.15.142:6830/2573794341","heartbeat_front_addr":"172.21.15.142:6826/2573794341","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.185824+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.262103+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.225556+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:10.523459+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:10.706035+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.257339+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.301776+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:43:11.051960+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.73:6836/340095591":"2023-12-13T09:47:26.372686+0000","172.21.15.73:6834/340095591":"2023-12-13T09:47:26.372686+0000","172.21.15.73:6837/2352791649":"2023-12-13T09:47:18.581724+0000","172.21.15.73:6835/2352791649":"2023-12-13T09:47:18.581724+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-12T09:47:33.509 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:33.507+0000 7f3056101640 1 -- 172.21.15.73:0/660839670 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f303c06ae40 msgr2=0x7f303c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:33.509 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:33.507+0000 7f3056101640 1 --2- 172.21.15.73:0/660839670 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f303c06ae40 0x7f303c06d300 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f3040034000 tx=0x7f3040009030 comp rx=0 tx=0).stop 2023-12-12T09:47:33.509 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:33.507+0000 7f3056101640 1 -- 172.21.15.73:0/660839670 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f30501dacc0 msgr2=0x7f30500aa390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:33.509 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:33.507+0000 7f3056101640 1 --2- 172.21.15.73:0/660839670 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f30501dacc0 0x7f30500aa390 secure :-1 s=READY pgs=1148 cs=0 l=1 rev1=1 crypto rx=0x7f304400e580 tx=0x7f304400ea40 comp rx=0 tx=0).stop 2023-12-12T09:47:33.509 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:33.507+0000 7f3056101640 1 -- 172.21.15.73:0/660839670 shutdown_connections 2023-12-12T09:47:33.509 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:33.507+0000 7f3056101640 1 --2- 172.21.15.73:0/660839670 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f303c06ae40 0x7f303c06d300 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:33.509 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:33.507+0000 7f3056101640 1 --2- 172.21.15.73:0/660839670 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f305014e6d0 0x7f30501e6500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:33.510 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:33.507+0000 7f3056101640 1 --2- 172.21.15.73:0/660839670 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f30501dacc0 0x7f30500aa390 unknown :-1 s=CLOSED pgs=1148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:33.510 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:33.507+0000 7f3056101640 1 --2- 172.21.15.73:0/660839670 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f30380039a0 0x7f30501e93b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:33.510 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:33.507+0000 7f3056101640 1 -- 172.21.15.73:0/660839670 >> 172.21.15.73:0/660839670 conn(0x7f30500a8130 msgr2=0x7f30500c0d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:47:33.510 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:33.507+0000 7f3056101640 1 -- 172.21.15.73:0/660839670 shutdown_connections 2023-12-12T09:47:33.510 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:33.507+0000 7f3056101640 1 -- 172.21.15.73:0/660839670 wait complete. 2023-12-12T09:47:34.527 INFO:tasks.ceph:Scrubbing osd.0 2023-12-12T09:47:34.528 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2023-12-12T09:47:34.742 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:34.740+0000 7f15cb98a640 1 Processor -- start 2023-12-12T09:47:34.742 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:34.740+0000 7f15cb98a640 1 -- start start 2023-12-12T09:47:34.743 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:34.742+0000 7f15cb98a640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f15c4151c30 0x7f15c406d440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:34.743 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:34.742+0000 7f15cb98a640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f15c40c3930 0x7f15c4157bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:34.744 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:34.742+0000 7f15cb98a640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15c40a4f50 con 0x7f15c40bed50 2023-12-12T09:47:34.744 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:34.742+0000 7f15cb98a640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15c40a54d0 con 0x7f15c4151c30 2023-12-12T09:47:34.744 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:34.742+0000 7f15cb98a640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15c4155260 con 0x7f15c40c3930 2023-12-12T09:47:34.745 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:34.742+0000 7f15c9726640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f15c4151c30 0x7f15c406d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:34.745 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:34.742+0000 7f15c8f25640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f15c40c3930 0x7f15c4157bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:34.745 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:34.742+0000 7f15c9726640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f15c4151c30 0x7f15c406d440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.73:48910/0 (socket says 172.21.15.73:48910) 2023-12-12T09:47:34.745 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:34.743+0000 7f15c9726640 1 -- 172.21.15.73:0/3461432062 learned_addr learned my addr 172.21.15.73:0/3461432062 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:47:34.745 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:34.743+0000 7f15c9726640 1 -- 172.21.15.73:0/3461432062 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f15c40c3930 msgr2=0x7f15c4157bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:47:34.745 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:34.743+0000 7f15c9726640 1 --2- 172.21.15.73:0/3461432062 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f15c40c3930 0x7f15c4157bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:34.745 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:34.743+0000 7f15c9726640 1 -- 172.21.15.73:0/3461432062 >> v1:172.21.15.142:6789/0 conn(0x7f15c40bed50 legacy=0x7f15c40bf1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:34.745 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:34.743+0000 7f15c9726640 1 -- 172.21.15.73:0/3461432062 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15c40a51f0 con 0x7f15c4151c30 2023-12-12T09:47:34.746 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:34.745+0000 7f15c9726640 1 --2- 172.21.15.73:0/3461432062 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f15c4151c30 0x7f15c406d440 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f15c0009870 tx=0x7f15c002b8f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4b52c89ea2986d2d server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:47:34.747 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:34.745+0000 7f15bbfff640 1 -- 172.21.15.73:0/3461432062 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15c0031640 con 0x7f15c4151c30 2023-12-12T09:47:34.747 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:34.745+0000 7f15bbfff640 1 -- 172.21.15.73:0/3461432062 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15c00317a0 con 0x7f15c4151c30 2023-12-12T09:47:34.747 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:34.745+0000 7f15bbfff640 1 -- 172.21.15.73:0/3461432062 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15c0031b30 con 0x7f15c4151c30 2023-12-12T09:47:34.748 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:34.745+0000 7f15cb98a640 1 -- 172.21.15.73:0/3461432062 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f15c4151c30 msgr2=0x7f15c406d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:34.748 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:34.745+0000 7f15cb98a640 1 --2- 172.21.15.73:0/3461432062 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f15c4151c30 0x7f15c406d440 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f15c0009870 tx=0x7f15c002b8f0 comp rx=0 tx=0).stop 2023-12-12T09:47:34.748 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:34.746+0000 7f15cb98a640 1 -- 172.21.15.73:0/3461432062 shutdown_connections 2023-12-12T09:47:34.748 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:34.746+0000 7f15cb98a640 1 --2- 172.21.15.73:0/3461432062 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f15c40c3930 0x7f15c4157bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:34.748 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:34.746+0000 7f15cb98a640 1 --2- 172.21.15.73:0/3461432062 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f15c4151c30 0x7f15c406d440 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:34.748 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:34.746+0000 7f15cb98a640 1 -- 172.21.15.73:0/3461432062 >> 172.21.15.73:0/3461432062 conn(0x7f15c406a4e0 msgr2=0x7f15c406a8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:47:34.748 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:34.746+0000 7f15cb98a640 1 -- 172.21.15.73:0/3461432062 shutdown_connections 2023-12-12T09:47:34.748 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:34.746+0000 7f15cb98a640 1 -- 172.21.15.73:0/3461432062 wait complete. 2023-12-12T09:47:34.749 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:34.747+0000 7f15cb98a640 1 Processor -- start 2023-12-12T09:47:34.749 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:34.748+0000 7f15cb98a640 1 -- start start 2023-12-12T09:47:34.750 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:34.748+0000 7f15cb98a640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f15c40bed50 0x7f15c40c1180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:34.750 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:34.748+0000 7f15cb98a640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f15c40c3930 0x7f15c41493e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:34.750 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:34.748+0000 7f15cb98a640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f15c4151c30 0x7f15c4154180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:34.751 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:34.748+0000 7f15cb98a640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15c4153d60 con 0x7f15c4151c30 2023-12-12T09:47:34.751 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:34.748+0000 7f15cb98a640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15c4153770 con 0x7f15c40bed50 2023-12-12T09:47:34.751 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:34.748+0000 7f15cb98a640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15c41eb0a0 con 0x7f15c40c3930 2023-12-12T09:47:34.751 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:34.749+0000 7f15c9f27640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f15c4151c30 0x7f15c4154180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:34.751 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:34.749+0000 7f15c9f27640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f15c4151c30 0x7f15c4154180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:60182/0 (socket says 172.21.15.73:60182) 2023-12-12T09:47:34.751 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:34.749+0000 7f15c9f27640 1 -- 172.21.15.73:0/3095183090 learned_addr learned my addr 172.21.15.73:0/3095183090 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:47:34.752 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:34.749+0000 7f15c8f25640 1 --2- 172.21.15.73:0/3095183090 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f15c40c3930 0x7f15c41493e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:34.752 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:34.749+0000 7f15c9f27640 1 -- 172.21.15.73:0/3095183090 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f15c40c3930 msgr2=0x7f15c41493e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:34.753 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:34.749+0000 7f15c9f27640 1 --2- 172.21.15.73:0/3095183090 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f15c40c3930 0x7f15c41493e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:34.753 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:34.749+0000 7f15c9f27640 1 -- 172.21.15.73:0/3095183090 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f15c40bed50 msgr2=0x7f15c40c1180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:34.753 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:34.749+0000 7f15c9f27640 1 --2- 172.21.15.73:0/3095183090 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f15c40bed50 0x7f15c40c1180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:34.753 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:34.749+0000 7f15c9f27640 1 -- 172.21.15.73:0/3095183090 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15c00094d0 con 0x7f15c4151c30 2023-12-12T09:47:34.753 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:34.749+0000 7f15c9f27640 1 --2- 172.21.15.73:0/3095183090 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f15c4151c30 0x7f15c4154180 secure :-1 s=READY pgs=1149 cs=0 l=1 rev1=1 crypto rx=0x7f15bc00c6b0 tx=0x7f15bc00cb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:47:34.753 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:34.750+0000 7f15b9ffb640 1 -- 172.21.15.73:0/3095183090 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15bc003b70 con 0x7f15c4151c30 2023-12-12T09:47:34.753 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:34.750+0000 7f15b9ffb640 1 -- 172.21.15.73:0/3095183090 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15bc003cf0 con 0x7f15c4151c30 2023-12-12T09:47:34.753 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:34.750+0000 7f15b9ffb640 1 -- 172.21.15.73:0/3095183090 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15bc003ea0 con 0x7f15c4151c30 2023-12-12T09:47:34.753 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:34.750+0000 7f15cb98a640 1 -- 172.21.15.73:0/3095183090 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15c4153980 con 0x7f15c4151c30 2023-12-12T09:47:34.754 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:34.750+0000 7f15cb98a640 1 -- 172.21.15.73:0/3095183090 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15c41ead70 con 0x7f15c4151c30 2023-12-12T09:47:34.754 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:34.751+0000 7f15cb98a640 1 -- 172.21.15.73:0/3095183090 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f15c4074770 con 0x7f15c4151c30 2023-12-12T09:47:34.755 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:34.752+0000 7f15b9ffb640 1 -- 172.21.15.73:0/3095183090 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f15bc005310 con 0x7f15c4151c30 2023-12-12T09:47:34.755 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:34.753+0000 7f15b9ffb640 1 --2- 172.21.15.73:0/3095183090 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f15a806ae40 0x7f15a806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:34.755 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:34.753+0000 7f15b9ffb640 1 -- 172.21.15.73:0/3095183090 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f15bc089130 con 0x7f15c4151c30 2023-12-12T09:47:34.755 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:34.753+0000 7f15c9726640 1 --2- 172.21.15.73:0/3095183090 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f15a806ae40 0x7f15a806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:34.756 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:34.753+0000 7f15b9ffb640 1 --2- 172.21.15.73:0/3095183090 >> [v2:172.21.15.73:6800/4047810203,v1:172.21.15.73:6801/4047810203] conn(0x7f15a8070d40 0x7f15a8073160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:34.756 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:34.753+0000 7f15b9ffb640 1 -- 172.21.15.73:0/3095183090 --> [v2:172.21.15.73:6800/4047810203,v1:172.21.15.73:6801/4047810203] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f15a8073810 con 0x7f15a8070d40 2023-12-12T09:47:34.756 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:34.753+0000 7f15b9ffb640 1 -- 172.21.15.73:0/3095183090 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_get_version_reply(handle=1 version=87) v2 ==== 24+0+0 (secure 0 0 0) 0x7f15bc08b710 con 0x7f15c4151c30 2023-12-12T09:47:34.756 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:34.753+0000 7f15c8f25640 1 --2- 172.21.15.73:0/3095183090 >> [v2:172.21.15.73:6800/4047810203,v1:172.21.15.73:6801/4047810203] conn(0x7f15a8070d40 0x7f15a8073160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:34.756 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:34.754+0000 7f15c9726640 1 --2- 172.21.15.73:0/3095183090 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f15a806ae40 0x7f15a806d300 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f15c0036000 tx=0x7f15c0030000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:47:34.756 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:34.754+0000 7f15c8f25640 1 --2- 172.21.15.73:0/3095183090 >> [v2:172.21.15.73:6800/4047810203,v1:172.21.15.73:6801/4047810203] conn(0x7f15a8070d40 0x7f15a8073160 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:47:34.756 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:34.755+0000 7f15b9ffb640 1 -- 172.21.15.73:0/3095183090 <== osd.0 v2:172.21.15.73:6800/4047810203 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f15a8073810 con 0x7f15a8070d40 2023-12-12T09:47:34.770 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:34.769+0000 7f15cb98a640 1 -- 172.21.15.73:0/3095183090 --> [v2:172.21.15.73:6800/4047810203,v1:172.21.15.73:6801/4047810203] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f15c414f3e0 con 0x7f15a8070d40 2023-12-12T09:47:34.771 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:34.769+0000 7f15b9ffb640 1 -- 172.21.15.73:0/3095183090 <== osd.0 v2:172.21.15.73:6800/4047810203 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f15c414f3e0 con 0x7f15a8070d40 2023-12-12T09:47:34.771 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2023-12-12T09:47:34.771 INFO:teuthology.orchestra.run.smithi073.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2023-12-12T09:47:34.772 INFO:teuthology.orchestra.run.smithi073.stdout:} 2023-12-12T09:47:34.773 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:34.770+0000 7f15cb98a640 1 -- 172.21.15.73:0/3095183090 >> [v2:172.21.15.73:6800/4047810203,v1:172.21.15.73:6801/4047810203] conn(0x7f15a8070d40 msgr2=0x7f15a8073160 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:34.773 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:34.770+0000 7f15cb98a640 1 --2- 172.21.15.73:0/3095183090 >> [v2:172.21.15.73:6800/4047810203,v1:172.21.15.73:6801/4047810203] conn(0x7f15a8070d40 0x7f15a8073160 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:34.773 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:34.770+0000 7f15cb98a640 1 -- 172.21.15.73:0/3095183090 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f15a806ae40 msgr2=0x7f15a806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:34.773 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:34.770+0000 7f15cb98a640 1 --2- 172.21.15.73:0/3095183090 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f15a806ae40 0x7f15a806d300 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f15c0036000 tx=0x7f15c0030000 comp rx=0 tx=0).stop 2023-12-12T09:47:34.773 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:34.770+0000 7f15cb98a640 1 -- 172.21.15.73:0/3095183090 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f15c4151c30 msgr2=0x7f15c4154180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:34.774 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:34.770+0000 7f15cb98a640 1 --2- 172.21.15.73:0/3095183090 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f15c4151c30 0x7f15c4154180 secure :-1 s=READY pgs=1149 cs=0 l=1 rev1=1 crypto rx=0x7f15bc00c6b0 tx=0x7f15bc00cb70 comp rx=0 tx=0).stop 2023-12-12T09:47:34.774 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:34.770+0000 7f15c9f27640 1 -- 172.21.15.73:0/3095183090 reap_dead start 2023-12-12T09:47:34.774 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:34.770+0000 7f15cb98a640 1 -- 172.21.15.73:0/3095183090 shutdown_connections 2023-12-12T09:47:34.774 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:34.770+0000 7f15cb98a640 1 -- 172.21.15.73:0/3095183090 >> 172.21.15.73:0/3095183090 conn(0x7f15c406a4e0 msgr2=0x7f15c40bf1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:47:34.775 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:34.770+0000 7f15cb98a640 1 -- 172.21.15.73:0/3095183090 shutdown_connections 2023-12-12T09:47:34.775 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:34.770+0000 7f15cb98a640 1 -- 172.21.15.73:0/3095183090 wait complete. 2023-12-12T09:47:34.789 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2023-12-12T09:47:34.986 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:34.984+0000 7fcb6ebc9640 1 Processor -- start 2023-12-12T09:47:34.986 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:34.984+0000 7fcb6ebc9640 1 -- start start 2023-12-12T09:47:34.987 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:34.985+0000 7fcb6ebc9640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcb680c81e0 0x7fcb680ca3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:34.987 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:34.986+0000 7fcb6ebc9640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb680c7240 con 0x7fcb68154c40 2023-12-12T09:47:34.988 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:34.986+0000 7fcb6ebc9640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb6806c480 con 0x7fcb680ca000 2023-12-12T09:47:34.988 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:34.986+0000 7fcb6ebc9640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb680c5170 con 0x7fcb680c81e0 2023-12-12T09:47:34.988 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:34.986+0000 7fcb6e3c8640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7fcb68154c40 0x7fcb6815ee10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:54622/0 (socket says 172.21.15.73:54622) 2023-12-12T09:47:34.988 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:34.986+0000 7fcb6e3c8640 1 -- 172.21.15.73:0/3507099521 learned_addr learned my addr 172.21.15.73:0/3507099521 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-12T09:47:34.991 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:34.986+0000 7fcb6d3c6640 1 --2- 172.21.15.73:0/3507099521 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcb680c81e0 0x7fcb680ca3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:34.991 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:34.986+0000 7fcb6cbc5640 1 -- 172.21.15.73:0/3507099521 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 525587807 0 0) 0x7fcb680c7240 con 0x7fcb68154c40 2023-12-12T09:47:34.991 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:34.986+0000 7fcb6cbc5640 1 -- 172.21.15.73:0/3507099521 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcb54003520 con 0x7fcb68154c40 2023-12-12T09:47:34.991 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:34.987+0000 7fcb6cbc5640 1 -- 172.21.15.73:0/3507099521 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3791735407 0 0) 0x7fcb54003520 con 0x7fcb68154c40 2023-12-12T09:47:34.992 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:34.987+0000 7fcb6cbc5640 1 -- 172.21.15.73:0/3507099521 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcb680c81e0 msgr2=0x7fcb680ca3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:47:34.992 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:34.987+0000 7fcb6cbc5640 1 --2- 172.21.15.73:0/3507099521 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcb680c81e0 0x7fcb680ca3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:34.992 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:34.987+0000 7fcb6cbc5640 1 -- 172.21.15.73:0/3507099521 >> v1:172.21.15.142:6789/0 conn(0x7fcb680ca000 legacy=0x7fcb68154530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:34.992 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:34.987+0000 7fcb6cbc5640 1 -- 172.21.15.73:0/3507099521 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb680c6910 con 0x7fcb68154c40 2023-12-12T09:47:34.992 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:34.987+0000 7fcb6cbc5640 1 -- 172.21.15.73:0/3507099521 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3186547832 0 0) 0x7fcb600019f0 con 0x7fcb68154c40 2023-12-12T09:47:34.992 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:34.987+0000 7fcb6cbc5640 1 -- 172.21.15.73:0/3507099521 >> v1:172.21.15.73:6789/0 conn(0x7fcb68154c40 legacy=0x7fcb6815ee10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:34.992 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:34.987+0000 7fcb6cbc5640 1 --2- 172.21.15.73:0/3507099521 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcb680c81e0 0x7fcb540039a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:34.992 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:34.987+0000 7fcb6cbc5640 1 --2- 172.21.15.73:0/3507099521 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcb54003f70 0x7fcb540047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:34.992 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:34.987+0000 7fcb6cbc5640 1 --2- 172.21.15.73:0/3507099521 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcb54004d00 0x7fcb54005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:34.993 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:34.987+0000 7fcb6cbc5640 1 -- 172.21.15.73:0/3507099521 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb680c5170 con 0x7fcb54003f70 2023-12-12T09:47:34.993 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:34.987+0000 7fcb6cbc5640 1 -- 172.21.15.73:0/3507099521 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb5400bac0 con 0x7fcb54004d00 2023-12-12T09:47:34.993 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:34.987+0000 7fcb6cbc5640 1 -- 172.21.15.73:0/3507099521 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb5400bc80 con 0x7fcb680c81e0 2023-12-12T09:47:34.993 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:34.987+0000 7fcb6d3c6640 1 --2- 172.21.15.73:0/3507099521 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcb54003f70 0x7fcb540047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:34.993 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:34.987+0000 7fcb6d3c6640 1 -- 172.21.15.73:0/3507099521 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcb680c81e0 msgr2=0x7fcb540039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:47:34.993 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:34.987+0000 7fcb6d3c6640 1 --2- 172.21.15.73:0/3507099521 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcb680c81e0 0x7fcb540039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:34.993 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:34.987+0000 7fcb6d3c6640 1 -- 172.21.15.73:0/3507099521 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcb54004d00 msgr2=0x7fcb54005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:47:34.993 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:34.987+0000 7fcb6d3c6640 1 --2- 172.21.15.73:0/3507099521 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcb54004d00 0x7fcb54005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:34.994 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:34.987+0000 7fcb6d3c6640 1 -- 172.21.15.73:0/3507099521 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb54003520 con 0x7fcb54003f70 2023-12-12T09:47:34.994 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:34.988+0000 7fcb6d3c6640 1 --2- 172.21.15.73:0/3507099521 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcb54003f70 0x7fcb540047c0 secure :-1 s=READY pgs=1151 cs=0 l=1 rev1=1 crypto rx=0x7fcb58009ac0 tx=0x7fcb540057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b60a2dbc545b75e8 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:47:34.994 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:34.989+0000 7fcb6cbc5640 1 -- 172.21.15.73:0/3507099521 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb5802c630 con 0x7fcb54003f70 2023-12-12T09:47:34.994 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:34.989+0000 7fcb6cbc5640 1 -- 172.21.15.73:0/3507099521 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb5802c790 con 0x7fcb54003f70 2023-12-12T09:47:34.994 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:34.989+0000 7fcb6cbc5640 1 -- 172.21.15.73:0/3507099521 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb5802cb20 con 0x7fcb54003f70 2023-12-12T09:47:34.994 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:34.989+0000 7fcb6ebc9640 1 -- 172.21.15.73:0/3507099521 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcb54003f70 msgr2=0x7fcb540047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:34.994 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:34.989+0000 7fcb6ebc9640 1 --2- 172.21.15.73:0/3507099521 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcb54003f70 0x7fcb540047c0 secure :-1 s=READY pgs=1151 cs=0 l=1 rev1=1 crypto rx=0x7fcb58009ac0 tx=0x7fcb540057f0 comp rx=0 tx=0).stop 2023-12-12T09:47:34.994 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:34.989+0000 7fcb6e3c8640 1 -- 172.21.15.73:0/3507099521 reap_dead start 2023-12-12T09:47:34.994 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:34.989+0000 7fcb6ebc9640 1 -- 172.21.15.73:0/3507099521 shutdown_connections 2023-12-12T09:47:34.995 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:34.989+0000 7fcb6ebc9640 1 -- 172.21.15.73:0/3507099521 >> 172.21.15.73:0/3507099521 conn(0x7fcb68071df0 msgr2=0x7fcb68072200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:47:34.995 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:34.989+0000 7fcb6ebc9640 1 -- 172.21.15.73:0/3507099521 shutdown_connections 2023-12-12T09:47:34.995 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:34.989+0000 7fcb6ebc9640 1 -- 172.21.15.73:0/3507099521 wait complete. 2023-12-12T09:47:34.998 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:34.991+0000 7fcb6ebc9640 1 Processor -- start 2023-12-12T09:47:34.998 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:34.991+0000 7fcb6ebc9640 1 -- start start 2023-12-12T09:47:34.998 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:34.992+0000 7fcb6ebc9640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcb54003f70 0x7fcb681ed610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:34.998 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:34.992+0000 7fcb6ebc9640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcb680c3b30 0x7fcb680c1a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:34.998 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:34.992+0000 7fcb6ebc9640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcb680c1f50 0x7fcb681e9e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:34.998 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:34.992+0000 7fcb6ebc9640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb681576e0 con 0x7fcb680c3b30 2023-12-12T09:47:34.999 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:34.992+0000 7fcb6ebc9640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb681586f0 con 0x7fcb54003f70 2023-12-12T09:47:34.999 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:34.992+0000 7fcb6ebc9640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb681edee0 con 0x7fcb680c1f50 2023-12-12T09:47:34.999 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:34.992+0000 7fcb6d3c6640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcb680c3b30 0x7fcb680c1a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:34.999 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:34.992+0000 7fcb6d3c6640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcb680c3b30 0x7fcb680c1a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:60200/0 (socket says 172.21.15.73:60200) 2023-12-12T09:47:34.999 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:34.992+0000 7fcb6d3c6640 1 -- 172.21.15.73:0/1004996226 learned_addr learned my addr 172.21.15.73:0/1004996226 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:47:34.999 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:34.993+0000 7fcb6d3c6640 1 -- 172.21.15.73:0/1004996226 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcb680c1f50 msgr2=0x7fcb681e9e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:34.999 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:34.993+0000 7fcb6d3c6640 1 --2- 172.21.15.73:0/1004996226 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcb680c1f50 0x7fcb681e9e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:34.999 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:34.993+0000 7fcb6d3c6640 1 -- 172.21.15.73:0/1004996226 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcb54003f70 msgr2=0x7fcb681ed610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:34.999 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:34.993+0000 7fcb6d3c6640 1 --2- 172.21.15.73:0/1004996226 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcb54003f70 0x7fcb681ed610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:35.000 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:34.993+0000 7fcb6d3c6640 1 -- 172.21.15.73:0/1004996226 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb680c2da0 con 0x7fcb680c3b30 2023-12-12T09:47:35.000 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:34.993+0000 7fcb6d3c6640 1 --2- 172.21.15.73:0/1004996226 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcb680c3b30 0x7fcb680c1a10 secure :-1 s=READY pgs=1152 cs=0 l=1 rev1=1 crypto rx=0x7fcb5802c1d0 tx=0x7fcb58004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:47:35.000 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:34.993+0000 7fcb5e7fc640 1 -- 172.21.15.73:0/1004996226 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb58003810 con 0x7fcb680c3b30 2023-12-12T09:47:35.000 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:34.993+0000 7fcb5e7fc640 1 -- 172.21.15.73:0/1004996226 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb58003970 con 0x7fcb680c3b30 2023-12-12T09:47:35.000 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:34.993+0000 7fcb6ebc9640 1 -- 172.21.15.73:0/1004996226 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb680c3080 con 0x7fcb680c3b30 2023-12-12T09:47:35.000 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:34.993+0000 7fcb5e7fc640 1 -- 172.21.15.73:0/1004996226 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb58003d00 con 0x7fcb680c3b30 2023-12-12T09:47:35.000 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:34.993+0000 7fcb6ebc9640 1 -- 172.21.15.73:0/1004996226 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb681ee1c0 con 0x7fcb680c3b30 2023-12-12T09:47:35.000 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:34.994+0000 7fcb6ebc9640 1 -- 172.21.15.73:0/1004996226 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb680c9700 con 0x7fcb680c3b30 2023-12-12T09:47:35.000 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:34.996+0000 7fcb5e7fc640 1 -- 172.21.15.73:0/1004996226 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fcb58034440 con 0x7fcb680c3b30 2023-12-12T09:47:35.001 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:34.996+0000 7fcb5e7fc640 1 --2- 172.21.15.73:0/1004996226 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fcb4c06ae40 0x7fcb4c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:35.001 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:34.997+0000 7fcb5e7fc640 1 -- 172.21.15.73:0/1004996226 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 5029+0+0 (secure 0 0 0) 0x7fcb580ab320 con 0x7fcb680c3b30 2023-12-12T09:47:35.001 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:34.997+0000 7fcb6dbc7640 1 --2- 172.21.15.73:0/1004996226 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fcb4c06ae40 0x7fcb4c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:35.001 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:34.997+0000 7fcb6dbc7640 1 --2- 172.21.15.73:0/1004996226 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fcb4c06ae40 0x7fcb4c06d300 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7fcb680c3530 tx=0x7fcb64007990 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:47:35.003 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:35.002+0000 7fcb5e7fc640 1 -- 172.21.15.73:0/1004996226 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fcb58076780 con 0x7fcb680c3b30 2023-12-12T09:47:35.191 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:35.188+0000 7fcb6ebc9640 1 -- 172.21.15.73:0/1004996226 --> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) v1 -- 0x7fcb680c6ed0 con 0x7fcb4c06ae40 2023-12-12T09:47:35.191 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:35.189+0000 7fcb5e7fc640 1 -- 172.21.15.73:0/1004996226 <== mgr.4110 v2:172.21.15.73:6832/779985841 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fcb64014400 con 0x7fcb4c06ae40 2023-12-12T09:47:35.191 INFO:teuthology.orchestra.run.smithi073.stderr:instructed osd(s) 0 to deep-scrub 2023-12-12T09:47:35.193 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:35.191+0000 7fcb6ebc9640 1 -- 172.21.15.73:0/1004996226 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fcb4c06ae40 msgr2=0x7fcb4c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:35.194 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:35.191+0000 7fcb6ebc9640 1 --2- 172.21.15.73:0/1004996226 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fcb4c06ae40 0x7fcb4c06d300 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7fcb680c3530 tx=0x7fcb64007990 comp rx=0 tx=0).stop 2023-12-12T09:47:35.194 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:35.191+0000 7fcb6ebc9640 1 -- 172.21.15.73:0/1004996226 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcb680c3b30 msgr2=0x7fcb680c1a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:35.194 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:35.191+0000 7fcb6ebc9640 1 --2- 172.21.15.73:0/1004996226 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcb680c3b30 0x7fcb680c1a10 secure :-1 s=READY pgs=1152 cs=0 l=1 rev1=1 crypto rx=0x7fcb5802c1d0 tx=0x7fcb58004730 comp rx=0 tx=0).stop 2023-12-12T09:47:35.194 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:35.192+0000 7fcb6ebc9640 1 -- 172.21.15.73:0/1004996226 shutdown_connections 2023-12-12T09:47:35.194 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:35.192+0000 7fcb6ebc9640 1 --2- 172.21.15.73:0/1004996226 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fcb4c06ae40 0x7fcb4c06d300 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:35.194 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:35.192+0000 7fcb6ebc9640 1 --2- 172.21.15.73:0/1004996226 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcb680c1f50 0x7fcb681e9e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:35.194 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:35.192+0000 7fcb6ebc9640 1 --2- 172.21.15.73:0/1004996226 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcb680c3b30 0x7fcb680c1a10 unknown :-1 s=CLOSED pgs=1152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:35.194 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:35.192+0000 7fcb6ebc9640 1 --2- 172.21.15.73:0/1004996226 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcb54003f70 0x7fcb681ed610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:35.195 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:35.192+0000 7fcb6ebc9640 1 -- 172.21.15.73:0/1004996226 >> 172.21.15.73:0/1004996226 conn(0x7fcb68071df0 msgr2=0x7fcb6814efb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:47:35.195 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:35.192+0000 7fcb6ebc9640 1 -- 172.21.15.73:0/1004996226 shutdown_connections 2023-12-12T09:47:35.195 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:35.192+0000 7fcb6ebc9640 1 -- 172.21.15.73:0/1004996226 wait complete. 2023-12-12T09:47:35.209 INFO:tasks.ceph:Scrubbing osd.1 2023-12-12T09:47:35.210 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2023-12-12T09:47:35.426 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:35.424+0000 7f4c2c64b640 1 Processor -- start 2023-12-12T09:47:35.426 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:35.424+0000 7f4c2c64b640 1 -- start start 2023-12-12T09:47:35.428 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:35.426+0000 7f4c2c64b640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f4c2406d350 0x7f4c2406dc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:35.428 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:35.426+0000 7f4c2c64b640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4c24152500 0x7f4c24152990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:35.428 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:35.426+0000 7f4c2c64b640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c240c16c0 con 0x7f4c2414f8c0 2023-12-12T09:47:35.428 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:35.426+0000 7f4c2c64b640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c240c1090 con 0x7f4c2406d350 2023-12-12T09:47:35.428 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:35.426+0000 7f4c2c64b640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c240c14b0 con 0x7f4c24152500 2023-12-12T09:47:35.428 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:35.426+0000 7f4c2a3e7640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f4c2414f8c0 0x7f4c24071e60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:54640/0 (socket says 172.21.15.73:54640) 2023-12-12T09:47:35.428 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:35.426+0000 7f4c2a3e7640 1 -- 172.21.15.73:0/1329090582 learned_addr learned my addr 172.21.15.73:0/1329090582 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-12T09:47:35.430 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:35.427+0000 7f4c293e5640 1 -- 172.21.15.73:0/1329090582 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4211631384 0 0) 0x7f4c240c16c0 con 0x7f4c2414f8c0 2023-12-12T09:47:35.430 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:35.427+0000 7f4c293e5640 1 -- 172.21.15.73:0/1329090582 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4c10003520 con 0x7f4c2414f8c0 2023-12-12T09:47:35.431 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:35.427+0000 7f4c29be6640 1 --2- 172.21.15.73:0/1329090582 >> v2:172.21.15.142:3300/0 conn(0x7f4c2406d350 0x7f4c2406dc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:35.431 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:35.427+0000 7f4c2abe8640 1 --2- 172.21.15.73:0/1329090582 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4c24152500 0x7f4c24152990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:35.431 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:35.427+0000 7f4c293e5640 1 -- 172.21.15.73:0/1329090582 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1342620847 0 0) 0x7f4c10003520 con 0x7f4c2414f8c0 2023-12-12T09:47:35.431 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:35.427+0000 7f4c293e5640 1 -- 172.21.15.73:0/1329090582 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4c24152500 msgr2=0x7f4c24152990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:47:35.431 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:35.427+0000 7f4c293e5640 1 --2- 172.21.15.73:0/1329090582 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4c24152500 0x7f4c24152990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:35.431 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:35.427+0000 7f4c293e5640 1 -- 172.21.15.73:0/1329090582 >> v2:172.21.15.142:3300/0 conn(0x7f4c2406d350 msgr2=0x7f4c2406dc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:47:35.431 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:35.427+0000 7f4c293e5640 1 --2- 172.21.15.73:0/1329090582 >> v2:172.21.15.142:3300/0 conn(0x7f4c2406d350 0x7f4c2406dc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:35.431 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:35.427+0000 7f4c293e5640 1 -- 172.21.15.73:0/1329090582 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c240c19a0 con 0x7f4c2414f8c0 2023-12-12T09:47:35.431 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:35.427+0000 7f4c293e5640 1 -- 172.21.15.73:0/1329090582 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3186547832 0 0) 0x7f4c20001670 con 0x7f4c2414f8c0 2023-12-12T09:47:35.432 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:35.427+0000 7f4c293e5640 1 -- 172.21.15.73:0/1329090582 >> v1:172.21.15.73:6789/0 conn(0x7f4c2414f8c0 legacy=0x7f4c24071e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:35.432 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:35.427+0000 7f4c293e5640 1 --2- 172.21.15.73:0/1329090582 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4c10003970 0x7f4c10003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:35.432 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:35.427+0000 7f4c293e5640 1 --2- 172.21.15.73:0/1329090582 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4c100047c0 0x7f4c10004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:35.432 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:35.427+0000 7f4c293e5640 1 --2- 172.21.15.73:0/1329090582 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4c24152500 0x7f4c10005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:35.432 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:35.427+0000 7f4c293e5640 1 -- 172.21.15.73:0/1329090582 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c240c14b0 con 0x7f4c10003970 2023-12-12T09:47:35.432 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:35.427+0000 7f4c293e5640 1 -- 172.21.15.73:0/1329090582 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c1000b9e0 con 0x7f4c100047c0 2023-12-12T09:47:35.432 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:35.427+0000 7f4c293e5640 1 -- 172.21.15.73:0/1329090582 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c1000bba0 con 0x7f4c24152500 2023-12-12T09:47:35.432 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:35.427+0000 7f4c2a3e7640 1 --2- 172.21.15.73:0/1329090582 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4c10003970 0x7f4c10003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:35.432 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:35.428+0000 7f4c29be6640 1 --2- 172.21.15.73:0/1329090582 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4c100047c0 0x7f4c10004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:35.433 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:35.428+0000 7f4c2abe8640 1 --2- 172.21.15.73:0/1329090582 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4c24152500 0x7f4c10005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:35.433 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:35.428+0000 7f4c2a3e7640 1 -- 172.21.15.73:0/1329090582 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4c24152500 msgr2=0x7f4c10005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:47:35.433 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:35.428+0000 7f4c2a3e7640 1 --2- 172.21.15.73:0/1329090582 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4c24152500 0x7f4c10005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:35.433 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:35.428+0000 7f4c2a3e7640 1 -- 172.21.15.73:0/1329090582 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4c100047c0 msgr2=0x7f4c10004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:47:35.433 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:35.428+0000 7f4c2a3e7640 1 --2- 172.21.15.73:0/1329090582 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4c100047c0 0x7f4c10004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:35.433 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:35.428+0000 7f4c2a3e7640 1 -- 172.21.15.73:0/1329090582 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c10003520 con 0x7f4c10003970 2023-12-12T09:47:35.433 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:35.429+0000 7f4c2a3e7640 1 --2- 172.21.15.73:0/1329090582 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4c10003970 0x7f4c10003d90 secure :-1 s=READY pgs=1154 cs=0 l=1 rev1=1 crypto rx=0x7f4c2000c210 tx=0x7f4c100057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=382df1fa401bded6 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:47:35.436 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:35.429+0000 7f4c293e5640 1 -- 172.21.15.73:0/1329090582 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c20005ad0 con 0x7f4c10003970 2023-12-12T09:47:35.436 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:35.429+0000 7f4c293e5640 1 -- 172.21.15.73:0/1329090582 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c20005c30 con 0x7f4c10003970 2023-12-12T09:47:35.436 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:35.429+0000 7f4c293e5640 1 -- 172.21.15.73:0/1329090582 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c2002c8a0 con 0x7f4c10003970 2023-12-12T09:47:35.437 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:35.430+0000 7f4c2c64b640 1 -- 172.21.15.73:0/1329090582 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4c10003970 msgr2=0x7f4c10003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:35.437 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:35.430+0000 7f4c2c64b640 1 --2- 172.21.15.73:0/1329090582 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4c10003970 0x7f4c10003d90 secure :-1 s=READY pgs=1154 cs=0 l=1 rev1=1 crypto rx=0x7f4c2000c210 tx=0x7f4c100057f0 comp rx=0 tx=0).stop 2023-12-12T09:47:35.437 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:35.430+0000 7f4c2abe8640 1 -- 172.21.15.73:0/1329090582 reap_dead start 2023-12-12T09:47:35.437 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:35.430+0000 7f4c2c64b640 1 -- 172.21.15.73:0/1329090582 shutdown_connections 2023-12-12T09:47:35.437 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:35.430+0000 7f4c2c64b640 1 -- 172.21.15.73:0/1329090582 >> 172.21.15.73:0/1329090582 conn(0x7f4c2406a4e0 msgr2=0x7f4c2406a8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:47:35.437 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:35.430+0000 7f4c2c64b640 1 -- 172.21.15.73:0/1329090582 shutdown_connections 2023-12-12T09:47:35.437 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:35.430+0000 7f4c2c64b640 1 -- 172.21.15.73:0/1329090582 wait complete. 2023-12-12T09:47:35.437 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:35.432+0000 7f4c2c64b640 1 Processor -- start 2023-12-12T09:47:35.437 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:35.432+0000 7f4c2c64b640 1 -- start start 2023-12-12T09:47:35.438 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:35.433+0000 7f4c2c64b640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4c10003970 0x7f4c2415d590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:35.438 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:35.433+0000 7f4c2c64b640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4c2415d060 0x7f4c241490f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:35.438 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:35.433+0000 7f4c2c64b640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4c241517f0 0x7f4c24151ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:35.438 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:35.433+0000 7f4c2c64b640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c240aac00 con 0x7f4c10003970 2023-12-12T09:47:35.438 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:35.433+0000 7f4c2c64b640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c241537f0 con 0x7f4c241517f0 2023-12-12T09:47:35.438 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:35.433+0000 7f4c2c64b640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c24149630 con 0x7f4c2415d060 2023-12-12T09:47:35.438 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:35.433+0000 7f4c2a3e7640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4c10003970 0x7f4c2415d590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:35.438 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:35.433+0000 7f4c2a3e7640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4c10003970 0x7f4c2415d590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:60222/0 (socket says 172.21.15.73:60222) 2023-12-12T09:47:35.438 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:35.433+0000 7f4c2a3e7640 1 -- 172.21.15.73:0/2468010561 learned_addr learned my addr 172.21.15.73:0/2468010561 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:47:35.439 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:35.433+0000 7f4c2abe8640 1 --2- 172.21.15.73:0/2468010561 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4c241517f0 0x7f4c24151ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:35.439 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:35.433+0000 7f4c2a3e7640 1 -- 172.21.15.73:0/2468010561 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4c2415d060 msgr2=0x7f4c241490f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:35.439 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:35.433+0000 7f4c29be6640 1 --2- 172.21.15.73:0/2468010561 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4c2415d060 0x7f4c241490f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:35.439 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:35.434+0000 7f4c2a3e7640 1 --2- 172.21.15.73:0/2468010561 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4c2415d060 0x7f4c241490f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:35.439 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:35.434+0000 7f4c2a3e7640 1 -- 172.21.15.73:0/2468010561 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4c241517f0 msgr2=0x7f4c24151ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:35.439 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:35.434+0000 7f4c2a3e7640 1 --2- 172.21.15.73:0/2468010561 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4c241517f0 0x7f4c24151ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:35.439 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:35.434+0000 7f4c2a3e7640 1 -- 172.21.15.73:0/2468010561 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c241ed220 con 0x7f4c10003970 2023-12-12T09:47:35.439 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:35.434+0000 7f4c2abe8640 1 --2- 172.21.15.73:0/2468010561 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4c241517f0 0x7f4c24151ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:47:35.439 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:35.434+0000 7f4c2a3e7640 1 --2- 172.21.15.73:0/2468010561 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4c10003970 0x7f4c2415d590 secure :-1 s=READY pgs=1155 cs=0 l=1 rev1=1 crypto rx=0x7f4c2002c440 tx=0x7f4c20001a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:47:35.440 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:35.434+0000 7f4c1affd640 1 -- 172.21.15.73:0/2468010561 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c20039070 con 0x7f4c10003970 2023-12-12T09:47:35.440 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:35.434+0000 7f4c1affd640 1 -- 172.21.15.73:0/2468010561 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c2002ccb0 con 0x7f4c10003970 2023-12-12T09:47:35.440 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:35.434+0000 7f4c1affd640 1 -- 172.21.15.73:0/2468010561 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c2003c040 con 0x7f4c10003970 2023-12-12T09:47:35.440 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:35.434+0000 7f4c2c64b640 1 -- 172.21.15.73:0/2468010561 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c241ed500 con 0x7f4c10003970 2023-12-12T09:47:35.440 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:35.434+0000 7f4c2c64b640 1 -- 172.21.15.73:0/2468010561 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c241edac0 con 0x7f4c10003970 2023-12-12T09:47:35.441 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:35.435+0000 7f4c2c64b640 1 -- 172.21.15.73:0/2468010561 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f4c2414fca0 con 0x7f4c10003970 2023-12-12T09:47:35.442 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:35.436+0000 7f4c1affd640 1 -- 172.21.15.73:0/2468010561 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f4c20032070 con 0x7f4c10003970 2023-12-12T09:47:35.442 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:35.437+0000 7f4c1affd640 1 --2- 172.21.15.73:0/2468010561 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f4c0806ae70 0x7f4c0806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:35.442 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:35.437+0000 7f4c1affd640 1 -- 172.21.15.73:0/2468010561 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f4c200aa630 con 0x7f4c10003970 2023-12-12T09:47:35.442 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:35.437+0000 7f4c29be6640 1 --2- 172.21.15.73:0/2468010561 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f4c0806ae70 0x7f4c0806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:35.442 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:35.437+0000 7f4c1affd640 1 --2- 172.21.15.73:0/2468010561 >> [v2:172.21.15.73:6822/1356058331,v1:172.21.15.73:6824/1356058331] conn(0x7f4c08070d70 0x7f4c08073190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:35.442 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:35.437+0000 7f4c1affd640 1 -- 172.21.15.73:0/2468010561 --> [v2:172.21.15.73:6822/1356058331,v1:172.21.15.73:6824/1356058331] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f4c08073840 con 0x7f4c08070d70 2023-12-12T09:47:35.442 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:35.438+0000 7f4c1affd640 1 -- 172.21.15.73:0/2468010561 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_get_version_reply(handle=1 version=87) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4c200accf0 con 0x7f4c10003970 2023-12-12T09:47:35.442 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:35.438+0000 7f4c2abe8640 1 --2- 172.21.15.73:0/2468010561 >> [v2:172.21.15.73:6822/1356058331,v1:172.21.15.73:6824/1356058331] conn(0x7f4c08070d70 0x7f4c08073190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:35.443 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:35.438+0000 7f4c29be6640 1 --2- 172.21.15.73:0/2468010561 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f4c0806ae70 0x7f4c0806d330 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f4c2406dac0 tx=0x7f4c14008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:47:35.443 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:35.438+0000 7f4c2abe8640 1 --2- 172.21.15.73:0/2468010561 >> [v2:172.21.15.73:6822/1356058331,v1:172.21.15.73:6824/1356058331] conn(0x7f4c08070d70 0x7f4c08073190 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:47:35.443 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:35.439+0000 7f4c1affd640 1 -- 172.21.15.73:0/2468010561 <== osd.1 v2:172.21.15.73:6822/1356058331 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f4c08073840 con 0x7f4c08070d70 2023-12-12T09:47:35.455 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:35.453+0000 7f4c2c64b640 1 -- 172.21.15.73:0/2468010561 --> [v2:172.21.15.73:6822/1356058331,v1:172.21.15.73:6824/1356058331] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f4c240c1f60 con 0x7f4c08070d70 2023-12-12T09:47:35.455 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:35.453+0000 7f4c1affd640 1 -- 172.21.15.73:0/2468010561 <== osd.1 v2:172.21.15.73:6822/1356058331 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f4c1c004120 con 0x7f4c08070d70 2023-12-12T09:47:35.456 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2023-12-12T09:47:35.456 INFO:teuthology.orchestra.run.smithi073.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2023-12-12T09:47:35.456 INFO:teuthology.orchestra.run.smithi073.stdout:} 2023-12-12T09:47:35.457 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:35.453+0000 7f4c2c64b640 1 -- 172.21.15.73:0/2468010561 >> [v2:172.21.15.73:6822/1356058331,v1:172.21.15.73:6824/1356058331] conn(0x7f4c08070d70 msgr2=0x7f4c08073190 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:35.457 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:35.453+0000 7f4c2c64b640 1 --2- 172.21.15.73:0/2468010561 >> [v2:172.21.15.73:6822/1356058331,v1:172.21.15.73:6824/1356058331] conn(0x7f4c08070d70 0x7f4c08073190 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:35.457 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:35.454+0000 7f4c2c64b640 1 -- 172.21.15.73:0/2468010561 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f4c0806ae70 msgr2=0x7f4c0806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:35.457 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:35.454+0000 7f4c2c64b640 1 --2- 172.21.15.73:0/2468010561 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f4c0806ae70 0x7f4c0806d330 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f4c2406dac0 tx=0x7f4c14008040 comp rx=0 tx=0).stop 2023-12-12T09:47:35.457 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:35.454+0000 7f4c2c64b640 1 -- 172.21.15.73:0/2468010561 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4c10003970 msgr2=0x7f4c2415d590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:35.458 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:35.454+0000 7f4c2c64b640 1 --2- 172.21.15.73:0/2468010561 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4c10003970 0x7f4c2415d590 secure :-1 s=READY pgs=1155 cs=0 l=1 rev1=1 crypto rx=0x7f4c2002c440 tx=0x7f4c20001a00 comp rx=0 tx=0).stop 2023-12-12T09:47:35.458 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:35.454+0000 7f4c2abe8640 1 -- 172.21.15.73:0/2468010561 reap_dead start 2023-12-12T09:47:35.458 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:35.454+0000 7f4c2c64b640 1 -- 172.21.15.73:0/2468010561 shutdown_connections 2023-12-12T09:47:35.458 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:35.454+0000 7f4c2c64b640 1 -- 172.21.15.73:0/2468010561 >> 172.21.15.73:0/2468010561 conn(0x7f4c2406a4e0 msgr2=0x7f4c24152910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:47:35.458 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:35.454+0000 7f4c2c64b640 1 -- 172.21.15.73:0/2468010561 shutdown_connections 2023-12-12T09:47:35.458 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:35.454+0000 7f4c2c64b640 1 -- 172.21.15.73:0/2468010561 wait complete. 2023-12-12T09:47:35.471 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2023-12-12T09:47:35.668 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:35.667+0000 7fb1dab0f640 1 Processor -- start 2023-12-12T09:47:35.669 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:35.667+0000 7fb1dab0f640 1 -- start start 2023-12-12T09:47:35.670 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:35.668+0000 7fb1dab0f640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fb1d40a4f00 0x7fb1d4151ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:35.670 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:35.668+0000 7fb1dab0f640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1d40c04c0 con 0x7fb1d40c14f0 2023-12-12T09:47:35.670 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:35.668+0000 7fb1dab0f640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1d4152220 con 0x7fb1d40c3920 2023-12-12T09:47:35.670 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:35.668+0000 7fb1dab0f640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1d40c58c0 con 0x7fb1d40a4f00 2023-12-12T09:47:35.672 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:35.668+0000 7fb1d90ac640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7fb1d40c14f0 0x7fb1d40c1920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:54648/0 (socket says 172.21.15.73:54648) 2023-12-12T09:47:35.672 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:35.668+0000 7fb1d90ac640 1 -- 172.21.15.73:0/1625876362 learned_addr learned my addr 172.21.15.73:0/1625876362 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-12T09:47:35.672 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:35.669+0000 7fb1d88ab640 1 --2- 172.21.15.73:0/1625876362 >> v2:172.21.15.142:3300/0 conn(0x7fb1d40a4f00 0x7fb1d4151ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:35.673 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:35.669+0000 7fb1d37fe640 1 -- 172.21.15.73:0/1625876362 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3500367312 0 0) 0x7fb1d40c04c0 con 0x7fb1d40c14f0 2023-12-12T09:47:35.673 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:35.669+0000 7fb1d37fe640 1 -- 172.21.15.73:0/1625876362 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb1c4003520 con 0x7fb1d40c14f0 2023-12-12T09:47:35.673 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:35.669+0000 7fb1d37fe640 1 -- 172.21.15.73:0/1625876362 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 51406453 0 0) 0x7fb1c4003520 con 0x7fb1d40c14f0 2023-12-12T09:47:35.673 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:35.669+0000 7fb1d37fe640 1 -- 172.21.15.73:0/1625876362 >> v2:172.21.15.142:3300/0 conn(0x7fb1d40a4f00 msgr2=0x7fb1d4151ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:47:35.673 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:35.669+0000 7fb1d37fe640 1 --2- 172.21.15.73:0/1625876362 >> v2:172.21.15.142:3300/0 conn(0x7fb1d40a4f00 0x7fb1d4151ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:35.673 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:35.669+0000 7fb1d37fe640 1 -- 172.21.15.73:0/1625876362 >> v1:172.21.15.142:6789/0 conn(0x7fb1d40c3920 legacy=0x7fb1d414e480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:35.673 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:35.669+0000 7fb1d37fe640 1 -- 172.21.15.73:0/1625876362 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1d40c0730 con 0x7fb1d40c14f0 2023-12-12T09:47:35.674 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:35.669+0000 7fb1d37fe640 1 -- 172.21.15.73:0/1625876362 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3186547832 0 0) 0x7fb1cc0019f0 con 0x7fb1d40c14f0 2023-12-12T09:47:35.674 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:35.669+0000 7fb1d37fe640 1 -- 172.21.15.73:0/1625876362 >> v1:172.21.15.73:6789/0 conn(0x7fb1d40c14f0 legacy=0x7fb1d40c1920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:35.674 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:35.669+0000 7fb1d37fe640 1 --2- 172.21.15.73:0/1625876362 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb1c4003970 0x7fb1c4003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:35.674 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:35.669+0000 7fb1d37fe640 1 --2- 172.21.15.73:0/1625876362 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb1c40047c0 0x7fb1c4004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:35.674 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:35.670+0000 7fb1d37fe640 1 --2- 172.21.15.73:0/1625876362 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb1c4005180 0x7fb1c400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:35.674 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:35.670+0000 7fb1d37fe640 1 -- 172.21.15.73:0/1625876362 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1d40c58c0 con 0x7fb1c40047c0 2023-12-12T09:47:35.674 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:35.670+0000 7fb1d37fe640 1 -- 172.21.15.73:0/1625876362 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1c400c120 con 0x7fb1c4005180 2023-12-12T09:47:35.674 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:35.670+0000 7fb1d37fe640 1 -- 172.21.15.73:0/1625876362 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1c400c2e0 con 0x7fb1c4003970 2023-12-12T09:47:35.674 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:35.670+0000 7fb1d3fff640 1 --2- 172.21.15.73:0/1625876362 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb1c40047c0 0x7fb1c4004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:35.675 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:35.670+0000 7fb1d88ab640 1 --2- 172.21.15.73:0/1625876362 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb1c4003970 0x7fb1c4003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:35.675 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:35.670+0000 7fb1d90ac640 1 --2- 172.21.15.73:0/1625876362 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb1c4005180 0x7fb1c400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:35.675 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:35.670+0000 7fb1d3fff640 1 -- 172.21.15.73:0/1625876362 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb1c4003970 msgr2=0x7fb1c4003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:47:35.675 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:35.670+0000 7fb1d3fff640 1 --2- 172.21.15.73:0/1625876362 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb1c4003970 0x7fb1c4003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:35.675 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:35.670+0000 7fb1d3fff640 1 -- 172.21.15.73:0/1625876362 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb1c4005180 msgr2=0x7fb1c400b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:47:35.675 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:35.670+0000 7fb1d3fff640 1 --2- 172.21.15.73:0/1625876362 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb1c4005180 0x7fb1c400b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:35.675 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:35.670+0000 7fb1d3fff640 1 -- 172.21.15.73:0/1625876362 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1c4003520 con 0x7fb1c40047c0 2023-12-12T09:47:35.675 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:35.670+0000 7fb1d90ac640 1 --2- 172.21.15.73:0/1625876362 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb1c4005180 0x7fb1c400b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:47:35.676 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:35.670+0000 7fb1d90ac640 1 -- 172.21.15.73:0/1625876362 reap_dead start 2023-12-12T09:47:35.678 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:35.671+0000 7fb1d3fff640 1 --2- 172.21.15.73:0/1625876362 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb1c40047c0 0x7fb1c4004c40 secure :-1 s=READY pgs=1157 cs=0 l=1 rev1=1 crypto rx=0x7fb1c0001750 tx=0x7fb1c40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec6a100e1ce392af server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:47:35.678 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:35.672+0000 7fb1d37fe640 1 -- 172.21.15.73:0/1625876362 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1c00052d0 con 0x7fb1c40047c0 2023-12-12T09:47:35.679 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:35.672+0000 7fb1d37fe640 1 -- 172.21.15.73:0/1625876362 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1c002e050 con 0x7fb1c40047c0 2023-12-12T09:47:35.679 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:35.672+0000 7fb1d37fe640 1 -- 172.21.15.73:0/1625876362 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1c0003830 con 0x7fb1c40047c0 2023-12-12T09:47:35.679 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:35.672+0000 7fb1dab0f640 1 -- 172.21.15.73:0/1625876362 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb1c40047c0 msgr2=0x7fb1c4004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:35.679 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:35.672+0000 7fb1dab0f640 1 --2- 172.21.15.73:0/1625876362 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb1c40047c0 0x7fb1c4004c40 secure :-1 s=READY pgs=1157 cs=0 l=1 rev1=1 crypto rx=0x7fb1c0001750 tx=0x7fb1c40057f0 comp rx=0 tx=0).stop 2023-12-12T09:47:35.679 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:35.672+0000 7fb1dab0f640 1 -- 172.21.15.73:0/1625876362 shutdown_connections 2023-12-12T09:47:35.679 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:35.672+0000 7fb1dab0f640 1 --2- 172.21.15.73:0/1625876362 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb1c40047c0 0x7fb1c4004c40 unknown :-1 s=CLOSED pgs=1157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:35.679 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:35.672+0000 7fb1dab0f640 1 -- 172.21.15.73:0/1625876362 >> 172.21.15.73:0/1625876362 conn(0x7fb1d40a77d0 msgr2=0x7fb1d40a7bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:47:35.679 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:35.672+0000 7fb1dab0f640 1 -- 172.21.15.73:0/1625876362 shutdown_connections 2023-12-12T09:47:35.680 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:35.672+0000 7fb1dab0f640 1 -- 172.21.15.73:0/1625876362 wait complete. 2023-12-12T09:47:35.680 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:35.674+0000 7fb1dab0f640 1 Processor -- start 2023-12-12T09:47:35.680 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:35.674+0000 7fb1dab0f640 1 -- start start 2023-12-12T09:47:35.680 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:35.675+0000 7fb1dab0f640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb1c40047c0 0x7fb1d406cbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:35.680 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:35.675+0000 7fb1dab0f640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb1d4148a00 0x7fb1d41ed3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:35.680 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:35.675+0000 7fb1dab0f640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb1d414acf0 0x7fb1d41ed8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:35.680 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:35.675+0000 7fb1dab0f640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1d40c12a0 con 0x7fb1d4148a00 2023-12-12T09:47:35.680 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:35.675+0000 7fb1dab0f640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1d4150940 con 0x7fb1d414acf0 2023-12-12T09:47:35.680 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:35.675+0000 7fb1dab0f640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1d4150c20 con 0x7fb1c40047c0 2023-12-12T09:47:35.681 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:35.675+0000 7fb1d3fff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb1d4148a00 0x7fb1d41ed3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:35.681 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:35.675+0000 7fb1d3fff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb1d4148a00 0x7fb1d41ed3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:60248/0 (socket says 172.21.15.73:60248) 2023-12-12T09:47:35.681 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:35.675+0000 7fb1d3fff640 1 -- 172.21.15.73:0/2487186099 learned_addr learned my addr 172.21.15.73:0/2487186099 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:47:35.681 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:35.676+0000 7fb1d90ac640 1 --2- 172.21.15.73:0/2487186099 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb1d414acf0 0x7fb1d41ed8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:35.681 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:35.676+0000 7fb1d3fff640 1 -- 172.21.15.73:0/2487186099 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb1c40047c0 msgr2=0x7fb1d406cbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:35.681 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:35.676+0000 7fb1d88ab640 1 --2- 172.21.15.73:0/2487186099 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb1c40047c0 0x7fb1d406cbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:35.682 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:35.676+0000 7fb1d3fff640 1 --2- 172.21.15.73:0/2487186099 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb1c40047c0 0x7fb1d406cbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:35.682 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:35.676+0000 7fb1d3fff640 1 -- 172.21.15.73:0/2487186099 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb1d414acf0 msgr2=0x7fb1d41ed8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:35.682 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:35.676+0000 7fb1d3fff640 1 --2- 172.21.15.73:0/2487186099 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb1d414acf0 0x7fb1d41ed8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:35.682 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:35.676+0000 7fb1d3fff640 1 -- 172.21.15.73:0/2487186099 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1d4150f00 con 0x7fb1d4148a00 2023-12-12T09:47:35.682 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:35.676+0000 7fb1d3fff640 1 --2- 172.21.15.73:0/2487186099 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb1d4148a00 0x7fb1d41ed3a0 secure :-1 s=READY pgs=1158 cs=0 l=1 rev1=1 crypto rx=0x7fb1c002bc00 tx=0x7fb1c0001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:47:35.682 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:35.676+0000 7fb1d17fa640 1 -- 172.21.15.73:0/2487186099 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1c00076c0 con 0x7fb1d4148a00 2023-12-12T09:47:35.682 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:35.677+0000 7fb1d17fa640 1 -- 172.21.15.73:0/2487186099 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1c0007a30 con 0x7fb1d4148a00 2023-12-12T09:47:35.682 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:35.677+0000 7fb1d17fa640 1 -- 172.21.15.73:0/2487186099 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1c0006be0 con 0x7fb1d4148a00 2023-12-12T09:47:35.682 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:35.677+0000 7fb1dab0f640 1 -- 172.21.15.73:0/2487186099 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1d413fb90 con 0x7fb1d4148a00 2023-12-12T09:47:35.683 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:35.677+0000 7fb1dab0f640 1 -- 172.21.15.73:0/2487186099 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1d413fe80 con 0x7fb1d4148a00 2023-12-12T09:47:35.684 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:35.678+0000 7fb1dab0f640 1 -- 172.21.15.73:0/2487186099 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1d4067580 con 0x7fb1d4148a00 2023-12-12T09:47:35.684 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:35.679+0000 7fb1d17fa640 1 -- 172.21.15.73:0/2487186099 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fb1c0006d40 con 0x7fb1d4148a00 2023-12-12T09:47:35.684 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:35.680+0000 7fb1d17fa640 1 --2- 172.21.15.73:0/2487186099 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fb1b806ae40 0x7fb1b806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:35.684 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:35.680+0000 7fb1d17fa640 1 -- 172.21.15.73:0/2487186099 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 5029+0+0 (secure 0 0 0) 0x7fb1c00aaea0 con 0x7fb1d4148a00 2023-12-12T09:47:35.684 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:35.681+0000 7fb1d88ab640 1 --2- 172.21.15.73:0/2487186099 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fb1b806ae40 0x7fb1b806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:35.684 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:35.681+0000 7fb1d88ab640 1 --2- 172.21.15.73:0/2487186099 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fb1b806ae40 0x7fb1b806d300 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7fb1c80099d0 tx=0x7fb1c8008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:47:35.686 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:35.685+0000 7fb1d17fa640 1 -- 172.21.15.73:0/2487186099 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fb1c0076280 con 0x7fb1d4148a00 2023-12-12T09:47:35.879 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:35.874+0000 7fb1dab0f640 1 -- 172.21.15.73:0/2487186099 --> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) v1 -- 0x7fb1d40c0fd0 con 0x7fb1b806ae40 2023-12-12T09:47:35.879 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:35.875+0000 7fb1d17fa640 1 -- 172.21.15.73:0/2487186099 <== mgr.4110 v2:172.21.15.73:6832/779985841 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fb1c8004020 con 0x7fb1b806ae40 2023-12-12T09:47:35.879 INFO:teuthology.orchestra.run.smithi073.stderr:instructed osd(s) 1 to deep-scrub 2023-12-12T09:47:35.879 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:35.877+0000 7fb1dab0f640 1 -- 172.21.15.73:0/2487186099 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fb1b806ae40 msgr2=0x7fb1b806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:35.880 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:35.877+0000 7fb1dab0f640 1 --2- 172.21.15.73:0/2487186099 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fb1b806ae40 0x7fb1b806d300 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7fb1c80099d0 tx=0x7fb1c8008040 comp rx=0 tx=0).stop 2023-12-12T09:47:35.880 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:35.877+0000 7fb1dab0f640 1 -- 172.21.15.73:0/2487186099 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb1d4148a00 msgr2=0x7fb1d41ed3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:35.880 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:35.877+0000 7fb1dab0f640 1 --2- 172.21.15.73:0/2487186099 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb1d4148a00 0x7fb1d41ed3a0 secure :-1 s=READY pgs=1158 cs=0 l=1 rev1=1 crypto rx=0x7fb1c002bc00 tx=0x7fb1c0001120 comp rx=0 tx=0).stop 2023-12-12T09:47:35.880 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:35.877+0000 7fb1dab0f640 1 -- 172.21.15.73:0/2487186099 shutdown_connections 2023-12-12T09:47:35.880 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:35.877+0000 7fb1dab0f640 1 --2- 172.21.15.73:0/2487186099 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fb1b806ae40 0x7fb1b806d300 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:35.880 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:35.877+0000 7fb1dab0f640 1 --2- 172.21.15.73:0/2487186099 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb1d414acf0 0x7fb1d41ed8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:35.880 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:35.877+0000 7fb1dab0f640 1 --2- 172.21.15.73:0/2487186099 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb1d4148a00 0x7fb1d41ed3a0 unknown :-1 s=CLOSED pgs=1158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:35.880 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:35.877+0000 7fb1dab0f640 1 --2- 172.21.15.73:0/2487186099 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb1c40047c0 0x7fb1d406cbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:35.881 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:35.877+0000 7fb1dab0f640 1 -- 172.21.15.73:0/2487186099 >> 172.21.15.73:0/2487186099 conn(0x7fb1d40a77d0 msgr2=0x7fb1d40c24b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:47:35.881 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:35.877+0000 7fb1dab0f640 1 -- 172.21.15.73:0/2487186099 shutdown_connections 2023-12-12T09:47:35.881 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:35.877+0000 7fb1dab0f640 1 -- 172.21.15.73:0/2487186099 wait complete. 2023-12-12T09:47:35.897 INFO:tasks.ceph:Scrubbing osd.2 2023-12-12T09:47:35.897 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2023-12-12T09:47:36.117 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:36.115+0000 7f378afb6640 1 Processor -- start 2023-12-12T09:47:36.117 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:36.115+0000 7f378afb6640 1 -- start start 2023-12-12T09:47:36.119 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:36.117+0000 7f378afb6640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3784151d50 0x7f3784155050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:36.119 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:36.117+0000 7f378afb6640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f378406a4e0 0x7f378406a940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:36.119 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:36.117+0000 7f378afb6640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37840c12b0 con 0x7f378406ae80 2023-12-12T09:47:36.119 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:36.117+0000 7f378afb6640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37840c1e30 con 0x7f378406a4e0 2023-12-12T09:47:36.119 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:36.117+0000 7f378afb6640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37840c22c0 con 0x7f3784151d50 2023-12-12T09:47:36.119 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:36.117+0000 7f3783fff640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f378406a4e0 0x7f378406a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:36.119 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:36.117+0000 7f3789553640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f378406ae80 0x7f37840bf7b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:54650/0 (socket says 172.21.15.73:54650) 2023-12-12T09:47:36.119 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:36.117+0000 7f3789553640 1 -- 172.21.15.73:0/4233562943 learned_addr learned my addr 172.21.15.73:0/4233562943 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-12T09:47:36.120 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:36.117+0000 7f3788d52640 1 --2- 172.21.15.73:0/4233562943 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3784151d50 0x7f3784155050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:36.121 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:36.118+0000 7f37837fe640 1 -- 172.21.15.73:0/4233562943 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3985683275 0 0) 0x7f37840c12b0 con 0x7f378406ae80 2023-12-12T09:47:36.121 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:36.118+0000 7f37837fe640 1 -- 172.21.15.73:0/4233562943 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3770003520 con 0x7f378406ae80 2023-12-12T09:47:36.121 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:36.118+0000 7f3783fff640 1 -- 172.21.15.73:0/4233562943 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3784151d50 msgr2=0x7f3784155050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:47:36.121 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:36.118+0000 7f3783fff640 1 --2- 172.21.15.73:0/4233562943 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3784151d50 0x7f3784155050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:36.121 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:36.118+0000 7f3783fff640 1 -- 172.21.15.73:0/4233562943 >> v1:172.21.15.73:6789/0 conn(0x7f378406ae80 legacy=0x7f37840bf7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:36.121 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:36.118+0000 7f3783fff640 1 -- 172.21.15.73:0/4233562943 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37840c1500 con 0x7f378406a4e0 2023-12-12T09:47:36.121 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:36.119+0000 7f3783fff640 1 --2- 172.21.15.73:0/4233562943 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f378406a4e0 0x7f378406a940 secure :-1 s=READY pgs=1160 cs=0 l=1 rev1=1 crypto rx=0x7f376c0097a0 tx=0x7f376c02b7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef5c7fc18620ba18 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:47:36.121 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:36.119+0000 7f37837fe640 1 -- 172.21.15.73:0/4233562943 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f376c02f050 con 0x7f378406a4e0 2023-12-12T09:47:36.122 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:36.119+0000 7f37837fe640 1 -- 172.21.15.73:0/4233562943 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f376c031700 con 0x7f378406a4e0 2023-12-12T09:47:36.122 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:36.119+0000 7f37837fe640 1 -- 172.21.15.73:0/4233562943 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f376c031a90 con 0x7f378406a4e0 2023-12-12T09:47:36.123 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:36.120+0000 7f378afb6640 1 -- 172.21.15.73:0/4233562943 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f378406a4e0 msgr2=0x7f378406a940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:36.123 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:36.120+0000 7f378afb6640 1 --2- 172.21.15.73:0/4233562943 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f378406a4e0 0x7f378406a940 secure :-1 s=READY pgs=1160 cs=0 l=1 rev1=1 crypto rx=0x7f376c0097a0 tx=0x7f376c02b7a0 comp rx=0 tx=0).stop 2023-12-12T09:47:36.123 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:36.120+0000 7f378afb6640 1 -- 172.21.15.73:0/4233562943 shutdown_connections 2023-12-12T09:47:36.123 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:36.120+0000 7f378afb6640 1 --2- 172.21.15.73:0/4233562943 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f378406a4e0 0x7f378406a940 unknown :-1 s=CLOSED pgs=1160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:36.123 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:36.120+0000 7f378afb6640 1 --2- 172.21.15.73:0/4233562943 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3784151d50 0x7f3784155050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:36.123 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:36.120+0000 7f378afb6640 1 -- 172.21.15.73:0/4233562943 >> 172.21.15.73:0/4233562943 conn(0x7f37840c2e80 msgr2=0x7f37840c3290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:47:36.123 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:36.120+0000 7f378afb6640 1 -- 172.21.15.73:0/4233562943 shutdown_connections 2023-12-12T09:47:36.123 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:36.120+0000 7f378afb6640 1 -- 172.21.15.73:0/4233562943 wait complete. 2023-12-12T09:47:36.125 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:36.122+0000 7f378afb6640 1 Processor -- start 2023-12-12T09:47:36.125 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:36.122+0000 7f378afb6640 1 -- start start 2023-12-12T09:47:36.125 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:36.123+0000 7f378afb6640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f378406a4e0 0x7f37841ea5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:36.125 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:36.123+0000 7f378afb6640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f378406ae80 0x7f3784155cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:36.125 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:36.123+0000 7f378afb6640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3784151d50 0x7f3784156210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:36.125 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:36.123+0000 7f378afb6640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37841404f0 con 0x7f378406ae80 2023-12-12T09:47:36.126 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:36.123+0000 7f378afb6640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37840a9740 con 0x7f378406a4e0 2023-12-12T09:47:36.126 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:36.123+0000 7f378afb6640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3784153010 con 0x7f3784151d50 2023-12-12T09:47:36.126 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:36.123+0000 7f3783fff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f378406ae80 0x7f3784155cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:36.126 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:36.123+0000 7f3783fff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f378406ae80 0x7f3784155cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:60268/0 (socket says 172.21.15.73:60268) 2023-12-12T09:47:36.126 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:36.123+0000 7f3783fff640 1 -- 172.21.15.73:0/524819794 learned_addr learned my addr 172.21.15.73:0/524819794 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:47:36.126 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:36.123+0000 7f3783fff640 1 -- 172.21.15.73:0/524819794 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3784151d50 msgr2=0x7f3784156210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:36.126 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:36.123+0000 7f3783fff640 1 --2- 172.21.15.73:0/524819794 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3784151d50 0x7f3784156210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:36.126 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:36.123+0000 7f3783fff640 1 -- 172.21.15.73:0/524819794 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f378406a4e0 msgr2=0x7f37841ea5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:36.127 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:36.123+0000 7f3783fff640 1 --2- 172.21.15.73:0/524819794 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f378406a4e0 0x7f37841ea5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:36.127 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:36.123+0000 7f3783fff640 1 -- 172.21.15.73:0/524819794 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f376c009400 con 0x7f378406ae80 2023-12-12T09:47:36.127 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:36.124+0000 7f3783fff640 1 --2- 172.21.15.73:0/524819794 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f378406ae80 0x7f3784155cd0 secure :-1 s=READY pgs=1161 cs=0 l=1 rev1=1 crypto rx=0x7f376c0098c0 tx=0x7f376c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:47:36.128 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:36.124+0000 7f37817fa640 1 -- 172.21.15.73:0/524819794 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f376c031500 con 0x7f378406ae80 2023-12-12T09:47:36.128 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:36.124+0000 7f37817fa640 1 -- 172.21.15.73:0/524819794 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f376c0339b0 con 0x7f378406ae80 2023-12-12T09:47:36.128 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:36.124+0000 7f37817fa640 1 -- 172.21.15.73:0/524819794 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f376c033d60 con 0x7f378406ae80 2023-12-12T09:47:36.128 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:36.124+0000 7f378afb6640 1 -- 172.21.15.73:0/524819794 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f378413fc50 con 0x7f378406ae80 2023-12-12T09:47:36.128 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:36.124+0000 7f378afb6640 1 -- 172.21.15.73:0/524819794 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3784140210 con 0x7f378406ae80 2023-12-12T09:47:36.128 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:36.125+0000 7f378afb6640 1 -- 172.21.15.73:0/524819794 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f3784066280 con 0x7f378406ae80 2023-12-12T09:47:36.128 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:36.126+0000 7f37817fa640 1 -- 172.21.15.73:0/524819794 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f376c03a040 con 0x7f378406ae80 2023-12-12T09:47:36.130 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:36.127+0000 7f37817fa640 1 --2- 172.21.15.73:0/524819794 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f376406ae90 0x7f376406d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:36.130 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:36.127+0000 7f37817fa640 1 -- 172.21.15.73:0/524819794 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f376c0aaf00 con 0x7f378406ae80 2023-12-12T09:47:36.130 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:36.127+0000 7f37817fa640 1 --2- 172.21.15.73:0/524819794 >> [v2:172.21.15.73:6816/1228903316,v1:172.21.15.73:6817/1228903316] conn(0x7f3764070d90 0x7f37640731b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:36.130 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:36.127+0000 7f3788d52640 1 --2- 172.21.15.73:0/524819794 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f376406ae90 0x7f376406d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:36.130 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:36.127+0000 7f37817fa640 1 -- 172.21.15.73:0/524819794 --> [v2:172.21.15.73:6816/1228903316,v1:172.21.15.73:6817/1228903316] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f3764073860 con 0x7f3764070d90 2023-12-12T09:47:36.130 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:36.127+0000 7f37817fa640 1 -- 172.21.15.73:0/524819794 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_get_version_reply(handle=1 version=87) v2 ==== 24+0+0 (secure 0 0 0) 0x7f376c02f020 con 0x7f378406ae80 2023-12-12T09:47:36.130 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:36.128+0000 7f3789553640 1 --2- 172.21.15.73:0/524819794 >> [v2:172.21.15.73:6816/1228903316,v1:172.21.15.73:6817/1228903316] conn(0x7f3764070d90 0x7f37640731b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:36.131 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:36.128+0000 7f3788d52640 1 --2- 172.21.15.73:0/524819794 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f376406ae90 0x7f376406d350 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f3774006a90 tx=0x7f3774006a20 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:47:36.131 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:36.128+0000 7f3789553640 1 --2- 172.21.15.73:0/524819794 >> [v2:172.21.15.73:6816/1228903316,v1:172.21.15.73:6817/1228903316] conn(0x7f3764070d90 0x7f37640731b0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:47:36.131 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:36.129+0000 7f37817fa640 1 -- 172.21.15.73:0/524819794 <== osd.2 v2:172.21.15.73:6816/1228903316 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f3764073860 con 0x7f3764070d90 2023-12-12T09:47:36.145 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:36.143+0000 7f378afb6640 1 -- 172.21.15.73:0/524819794 --> [v2:172.21.15.73:6816/1228903316,v1:172.21.15.73:6817/1228903316] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f37840c1ac0 con 0x7f3764070d90 2023-12-12T09:47:36.146 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:36.144+0000 7f37817fa640 1 -- 172.21.15.73:0/524819794 <== osd.2 v2:172.21.15.73:6816/1228903316 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f377c001c40 con 0x7f3764070d90 2023-12-12T09:47:36.146 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2023-12-12T09:47:36.146 INFO:teuthology.orchestra.run.smithi073.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2023-12-12T09:47:36.146 INFO:teuthology.orchestra.run.smithi073.stdout:} 2023-12-12T09:47:36.147 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:36.145+0000 7f378afb6640 1 -- 172.21.15.73:0/524819794 >> [v2:172.21.15.73:6816/1228903316,v1:172.21.15.73:6817/1228903316] conn(0x7f3764070d90 msgr2=0x7f37640731b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:36.147 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:36.145+0000 7f378afb6640 1 --2- 172.21.15.73:0/524819794 >> [v2:172.21.15.73:6816/1228903316,v1:172.21.15.73:6817/1228903316] conn(0x7f3764070d90 0x7f37640731b0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:36.148 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:36.145+0000 7f378afb6640 1 -- 172.21.15.73:0/524819794 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f376406ae90 msgr2=0x7f376406d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:36.148 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:36.145+0000 7f378afb6640 1 --2- 172.21.15.73:0/524819794 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f376406ae90 0x7f376406d350 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f3774006a90 tx=0x7f3774006a20 comp rx=0 tx=0).stop 2023-12-12T09:47:36.148 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:36.145+0000 7f378afb6640 1 -- 172.21.15.73:0/524819794 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f378406ae80 msgr2=0x7f3784155cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:36.148 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:36.145+0000 7f378afb6640 1 --2- 172.21.15.73:0/524819794 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f378406ae80 0x7f3784155cd0 secure :-1 s=READY pgs=1161 cs=0 l=1 rev1=1 crypto rx=0x7f376c0098c0 tx=0x7f376c0046c0 comp rx=0 tx=0).stop 2023-12-12T09:47:36.148 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:36.145+0000 7f3789553640 1 -- 172.21.15.73:0/524819794 reap_dead start 2023-12-12T09:47:36.148 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:36.145+0000 7f378afb6640 1 -- 172.21.15.73:0/524819794 shutdown_connections 2023-12-12T09:47:36.148 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:36.145+0000 7f378afb6640 1 -- 172.21.15.73:0/524819794 >> 172.21.15.73:0/524819794 conn(0x7f37840c2e80 msgr2=0x7f37840c5ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:47:36.148 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:36.145+0000 7f378afb6640 1 -- 172.21.15.73:0/524819794 shutdown_connections 2023-12-12T09:47:36.149 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:36.145+0000 7f378afb6640 1 -- 172.21.15.73:0/524819794 wait complete. 2023-12-12T09:47:36.163 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2023-12-12T09:47:36.366 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:36.365+0000 7f977d1fc640 1 Processor -- start 2023-12-12T09:47:36.367 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:36.365+0000 7f977d1fc640 1 -- start start 2023-12-12T09:47:36.368 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:36.366+0000 7f977d1fc640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f977806fca0 0x7f9778072700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:36.368 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:36.366+0000 7f977d1fc640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9778152560 con 0x7f97780c0420 2023-12-12T09:47:36.368 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:36.366+0000 7f977d1fc640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97781532e0 con 0x7f97780c17e0 2023-12-12T09:47:36.368 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:36.366+0000 7f977d1fc640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9778152ec0 con 0x7f977806fca0 2023-12-12T09:47:36.369 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:36.367+0000 7f9776d9d640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f977806fca0 0x7f9778072700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:36.369 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:36.367+0000 7f976ffff640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f97780c0420 0x7f97780c10d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:54662/0 (socket says 172.21.15.73:54662) 2023-12-12T09:47:36.369 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:36.367+0000 7f976ffff640 1 -- 172.21.15.73:0/1230482530 learned_addr learned my addr 172.21.15.73:0/1230482530 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-12T09:47:36.369 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:36.367+0000 7f977659c640 1 -- 172.21.15.73:0/1230482530 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 834751184 0 0) 0x7f9778152560 con 0x7f97780c0420 2023-12-12T09:47:36.370 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:36.367+0000 7f977659c640 1 -- 172.21.15.73:0/1230482530 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9764003520 con 0x7f97780c0420 2023-12-12T09:47:36.370 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:36.367+0000 7f9776d9d640 1 -- 172.21.15.73:0/1230482530 >> v1:172.21.15.142:6789/0 conn(0x7f97780c17e0 legacy=0x7f977815ccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:47:36.370 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:36.367+0000 7f9776d9d640 1 -- 172.21.15.73:0/1230482530 >> v1:172.21.15.73:6789/0 conn(0x7f97780c0420 legacy=0x7f97780c10d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:36.370 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:36.367+0000 7f9776d9d640 1 -- 172.21.15.73:0/1230482530 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9778152800 con 0x7f977806fca0 2023-12-12T09:47:36.371 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:36.368+0000 7f9776d9d640 1 --2- 172.21.15.73:0/1230482530 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f977806fca0 0x7f9778072700 secure :-1 s=READY pgs=1163 cs=0 l=1 rev1=1 crypto rx=0x7f97680097a0 tx=0x7f976802b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=feb7020cc6f7162b server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:47:36.372 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:36.369+0000 7f977659c640 1 -- 172.21.15.73:0/1230482530 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f976802e070 con 0x7f977806fca0 2023-12-12T09:47:36.372 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:36.369+0000 7f977659c640 1 -- 172.21.15.73:0/1230482530 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97680315a0 con 0x7f977806fca0 2023-12-12T09:47:36.372 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:36.369+0000 7f977659c640 1 -- 172.21.15.73:0/1230482530 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9768031930 con 0x7f977806fca0 2023-12-12T09:47:36.372 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:36.369+0000 7f977d1fc640 1 -- 172.21.15.73:0/1230482530 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f977806fca0 msgr2=0x7f9778072700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:36.372 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:36.369+0000 7f977d1fc640 1 --2- 172.21.15.73:0/1230482530 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f977806fca0 0x7f9778072700 secure :-1 s=READY pgs=1163 cs=0 l=1 rev1=1 crypto rx=0x7f97680097a0 tx=0x7f976802b840 comp rx=0 tx=0).stop 2023-12-12T09:47:36.372 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:36.369+0000 7f977d1fc640 1 -- 172.21.15.73:0/1230482530 shutdown_connections 2023-12-12T09:47:36.372 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:36.369+0000 7f977d1fc640 1 --2- 172.21.15.73:0/1230482530 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f977806fca0 0x7f9778072700 unknown :-1 s=CLOSED pgs=1163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:36.372 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:36.369+0000 7f977d1fc640 1 -- 172.21.15.73:0/1230482530 >> 172.21.15.73:0/1230482530 conn(0x7f97780a77d0 msgr2=0x7f97780a7bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:47:36.373 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:36.370+0000 7f977d1fc640 1 -- 172.21.15.73:0/1230482530 shutdown_connections 2023-12-12T09:47:36.373 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:36.370+0000 7f977d1fc640 1 -- 172.21.15.73:0/1230482530 wait complete. 2023-12-12T09:47:36.373 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:36.371+0000 7f977d1fc640 1 Processor -- start 2023-12-12T09:47:36.373 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:36.371+0000 7f977d1fc640 1 -- start start 2023-12-12T09:47:36.376 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:36.372+0000 7f977d1fc640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f977806fca0 0x7f977814bc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:36.376 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:36.372+0000 7f977d1fc640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f97780c0420 0x7f97780bf0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:36.376 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:36.372+0000 7f977d1fc640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f97780c17e0 0x7f97781ea590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:36.376 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:36.372+0000 7f977d1fc640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f977814c230 con 0x7f97780c17e0 2023-12-12T09:47:36.376 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:36.372+0000 7f977d1fc640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f977806bcd0 con 0x7f977806fca0 2023-12-12T09:47:36.376 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:36.372+0000 7f977d1fc640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97781ee6e0 con 0x7f97780c0420 2023-12-12T09:47:36.376 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:36.373+0000 7f977759e640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f97780c17e0 0x7f97781ea590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:36.376 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:36.373+0000 7f977759e640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f97780c17e0 0x7f97781ea590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:60298/0 (socket says 172.21.15.73:60298) 2023-12-12T09:47:36.376 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:36.373+0000 7f977759e640 1 -- 172.21.15.73:0/3722223352 learned_addr learned my addr 172.21.15.73:0/3722223352 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:47:36.377 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:36.373+0000 7f976ffff640 1 --2- 172.21.15.73:0/3722223352 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f97780c0420 0x7f97780bf0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:36.377 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:36.373+0000 7f9776d9d640 1 --2- 172.21.15.73:0/3722223352 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f977806fca0 0x7f977814bc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:36.377 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:36.373+0000 7f977759e640 1 -- 172.21.15.73:0/3722223352 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f97780c0420 msgr2=0x7f97780bf0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:36.377 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:36.373+0000 7f977759e640 1 --2- 172.21.15.73:0/3722223352 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f97780c0420 0x7f97780bf0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:36.377 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:36.373+0000 7f977759e640 1 -- 172.21.15.73:0/3722223352 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f977806fca0 msgr2=0x7f977814bc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:36.377 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:36.373+0000 7f977759e640 1 --2- 172.21.15.73:0/3722223352 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f977806fca0 0x7f977814bc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:36.377 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:36.373+0000 7f977759e640 1 -- 172.21.15.73:0/3722223352 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9768009400 con 0x7f97780c17e0 2023-12-12T09:47:36.377 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:36.373+0000 7f9776d9d640 1 --2- 172.21.15.73:0/3722223352 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f977806fca0 0x7f977814bc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:47:36.377 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:36.373+0000 7f977759e640 1 --2- 172.21.15.73:0/3722223352 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f97780c17e0 0x7f97781ea590 secure :-1 s=READY pgs=1164 cs=0 l=1 rev1=1 crypto rx=0x7f977000c7b0 tx=0x7f977000cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:47:36.378 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:36.374+0000 7f976f7fe640 1 -- 172.21.15.73:0/3722223352 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9770004b60 con 0x7f97780c17e0 2023-12-12T09:47:36.378 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:36.374+0000 7f976f7fe640 1 -- 172.21.15.73:0/3722223352 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9770004cc0 con 0x7f97780c17e0 2023-12-12T09:47:36.378 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:36.374+0000 7f977d1fc640 1 -- 172.21.15.73:0/3722223352 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f977806c1c0 con 0x7f97780c17e0 2023-12-12T09:47:36.378 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:36.374+0000 7f976f7fe640 1 -- 172.21.15.73:0/3722223352 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f977000aa90 con 0x7f97780c17e0 2023-12-12T09:47:36.378 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:36.374+0000 7f977d1fc640 1 -- 172.21.15.73:0/3722223352 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97781ee370 con 0x7f97780c17e0 2023-12-12T09:47:36.379 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:36.375+0000 7f977d1fc640 1 -- 172.21.15.73:0/3722223352 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f97781eb290 con 0x7f97780c17e0 2023-12-12T09:47:36.379 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:36.376+0000 7f976f7fe640 1 -- 172.21.15.73:0/3722223352 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f977000abf0 con 0x7f97780c17e0 2023-12-12T09:47:36.379 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:36.377+0000 7f976f7fe640 1 --2- 172.21.15.73:0/3722223352 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f975806ae40 0x7f975806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:36.379 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:36.377+0000 7f976f7fe640 1 -- 172.21.15.73:0/3722223352 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f9770089560 con 0x7f97780c17e0 2023-12-12T09:47:36.379 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:36.377+0000 7f9776d9d640 1 --2- 172.21.15.73:0/3722223352 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f975806ae40 0x7f975806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:36.380 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:36.378+0000 7f9776d9d640 1 --2- 172.21.15.73:0/3722223352 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f975806ae40 0x7f975806d300 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f9768036000 tx=0x7f976803d040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:47:36.383 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:36.382+0000 7f976f7fe640 1 -- 172.21.15.73:0/3722223352 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f97700548b0 con 0x7f97780c17e0 2023-12-12T09:47:36.573 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:36.571+0000 7f977d1fc640 1 -- 172.21.15.73:0/3722223352 --> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) v1 -- 0x7f977814fce0 con 0x7f975806ae40 2023-12-12T09:47:36.574 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:36.572+0000 7f976f7fe640 1 -- 172.21.15.73:0/3722223352 <== mgr.4110 v2:172.21.15.73:6832/779985841 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f9768031ae0 con 0x7f975806ae40 2023-12-12T09:47:36.574 INFO:teuthology.orchestra.run.smithi073.stderr:instructed osd(s) 2 to deep-scrub 2023-12-12T09:47:36.577 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:36.575+0000 7f977d1fc640 1 -- 172.21.15.73:0/3722223352 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f975806ae40 msgr2=0x7f975806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:36.577 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:36.575+0000 7f977d1fc640 1 --2- 172.21.15.73:0/3722223352 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f975806ae40 0x7f975806d300 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f9768036000 tx=0x7f976803d040 comp rx=0 tx=0).stop 2023-12-12T09:47:36.578 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:36.575+0000 7f977d1fc640 1 -- 172.21.15.73:0/3722223352 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f97780c17e0 msgr2=0x7f97781ea590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:36.578 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:36.575+0000 7f977d1fc640 1 --2- 172.21.15.73:0/3722223352 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f97780c17e0 0x7f97781ea590 secure :-1 s=READY pgs=1164 cs=0 l=1 rev1=1 crypto rx=0x7f977000c7b0 tx=0x7f977000cc70 comp rx=0 tx=0).stop 2023-12-12T09:47:36.578 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:36.575+0000 7f977d1fc640 1 -- 172.21.15.73:0/3722223352 shutdown_connections 2023-12-12T09:47:36.578 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:36.575+0000 7f977d1fc640 1 --2- 172.21.15.73:0/3722223352 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f975806ae40 0x7f975806d300 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:36.578 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:36.575+0000 7f977d1fc640 1 --2- 172.21.15.73:0/3722223352 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f97780c17e0 0x7f97781ea590 unknown :-1 s=CLOSED pgs=1164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:36.578 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:36.575+0000 7f977d1fc640 1 --2- 172.21.15.73:0/3722223352 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f97780c0420 0x7f97780bf0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:36.579 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:36.575+0000 7f977d1fc640 1 --2- 172.21.15.73:0/3722223352 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f977806fca0 0x7f977814bc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:36.579 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:36.575+0000 7f977d1fc640 1 -- 172.21.15.73:0/3722223352 >> 172.21.15.73:0/3722223352 conn(0x7f97780a77d0 msgr2=0x7f97780a5d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:47:36.579 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:36.575+0000 7f977d1fc640 1 -- 172.21.15.73:0/3722223352 shutdown_connections 2023-12-12T09:47:36.579 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:36.575+0000 7f977d1fc640 1 -- 172.21.15.73:0/3722223352 wait complete. 2023-12-12T09:47:36.596 INFO:tasks.ceph:Scrubbing osd.3 2023-12-12T09:47:36.596 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2023-12-12T09:47:36.809 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:36.807+0000 7f199629f640 1 Processor -- start 2023-12-12T09:47:36.809 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:36.808+0000 7f199629f640 1 -- start start 2023-12-12T09:47:36.810 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:36.809+0000 7f199629f640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f19901519d0 0x7f19900c7d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:36.811 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:36.809+0000 7f199629f640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1990158670 con 0x7f19901543d0 2023-12-12T09:47:36.811 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:36.809+0000 7f199629f640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19900c5f30 con 0x7f199006c420 2023-12-12T09:47:36.811 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:36.809+0000 7f199629f640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19900c82c0 con 0x7f19901519d0 2023-12-12T09:47:36.812 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:36.810+0000 7f1995a9e640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f19901543d0 0x7f1990154810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:54668/0 (socket says 172.21.15.73:54668) 2023-12-12T09:47:36.812 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:36.810+0000 7f1995a9e640 1 -- 172.21.15.73:0/3472239230 learned_addr learned my addr 172.21.15.73:0/3472239230 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-12T09:47:36.812 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:36.810+0000 7f199529d640 1 --2- 172.21.15.73:0/3472239230 >> v2:172.21.15.73:3300/0 conn(0x7f19901519d0 0x7f19900c7d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:36.812 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:36.810+0000 7f198ffff640 1 -- 172.21.15.73:0/3472239230 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3221688248 0 0) 0x7f1990158670 con 0x7f19901543d0 2023-12-12T09:47:36.813 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:36.810+0000 7f198ffff640 1 -- 172.21.15.73:0/3472239230 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1978003520 con 0x7f19901543d0 2023-12-12T09:47:36.813 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:36.810+0000 7f199529d640 1 -- 172.21.15.73:0/3472239230 >> v1:172.21.15.142:6789/0 conn(0x7f199006c420 legacy=0x7f19900ca140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:47:36.813 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:36.810+0000 7f199529d640 1 -- 172.21.15.73:0/3472239230 >> v1:172.21.15.73:6789/0 conn(0x7f19901543d0 legacy=0x7f1990154810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:36.813 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:36.810+0000 7f199529d640 1 -- 172.21.15.73:0/3472239230 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1990157a60 con 0x7f19901519d0 2023-12-12T09:47:36.814 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:36.812+0000 7f199529d640 1 --2- 172.21.15.73:0/3472239230 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f19901519d0 0x7f19900c7d80 secure :-1 s=READY pgs=1166 cs=0 l=1 rev1=1 crypto rx=0x7f1980009d90 tx=0x7f198002be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f12fbb6324b39d26 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:47:36.814 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:36.812+0000 7f198ffff640 1 -- 172.21.15.73:0/3472239230 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f198002cbd0 con 0x7f19901519d0 2023-12-12T09:47:36.814 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:36.812+0000 7f198ffff640 1 -- 172.21.15.73:0/3472239230 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f198002cd30 con 0x7f19901519d0 2023-12-12T09:47:36.814 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:36.812+0000 7f198ffff640 1 -- 172.21.15.73:0/3472239230 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f198002cea0 con 0x7f19901519d0 2023-12-12T09:47:36.814 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:36.813+0000 7f199629f640 1 -- 172.21.15.73:0/3472239230 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f19901519d0 msgr2=0x7f19900c7d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:36.814 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:36.813+0000 7f199629f640 1 --2- 172.21.15.73:0/3472239230 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f19901519d0 0x7f19900c7d80 secure :-1 s=READY pgs=1166 cs=0 l=1 rev1=1 crypto rx=0x7f1980009d90 tx=0x7f198002be20 comp rx=0 tx=0).stop 2023-12-12T09:47:36.815 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:36.813+0000 7f199629f640 1 -- 172.21.15.73:0/3472239230 shutdown_connections 2023-12-12T09:47:36.815 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:36.813+0000 7f199629f640 1 --2- 172.21.15.73:0/3472239230 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f19901519d0 0x7f19900c7d80 unknown :-1 s=CLOSED pgs=1166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:36.815 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:36.813+0000 7f199629f640 1 -- 172.21.15.73:0/3472239230 >> 172.21.15.73:0/3472239230 conn(0x7f1990072030 msgr2=0x7f1990072440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:47:36.816 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:36.813+0000 7f199629f640 1 -- 172.21.15.73:0/3472239230 shutdown_connections 2023-12-12T09:47:36.816 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:36.813+0000 7f199629f640 1 -- 172.21.15.73:0/3472239230 wait complete. 2023-12-12T09:47:36.816 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:36.814+0000 7f199629f640 1 Processor -- start 2023-12-12T09:47:36.816 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:36.815+0000 7f199629f640 1 -- start start 2023-12-12T09:47:36.817 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:36.815+0000 7f199629f640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f199006c420 0x7f1990149540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:36.817 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:36.815+0000 7f199629f640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f19901519d0 0x7f19901eb7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:36.818 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:36.815+0000 7f199629f640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f19901543d0 0x7f19901ee2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:36.818 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:36.815+0000 7f199629f640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19900af7c0 con 0x7f19901519d0 2023-12-12T09:47:36.818 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:36.815+0000 7f199629f640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19901ee800 con 0x7f199006c420 2023-12-12T09:47:36.818 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:36.815+0000 7f199629f640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19901ea690 con 0x7f19901543d0 2023-12-12T09:47:36.818 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:36.816+0000 7f1994a9c640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f19901519d0 0x7f19901eb7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:36.818 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:36.816+0000 7f1994a9c640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f19901519d0 0x7f19901eb7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:60326/0 (socket says 172.21.15.73:60326) 2023-12-12T09:47:36.818 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:36.816+0000 7f1994a9c640 1 -- 172.21.15.73:0/2438946942 learned_addr learned my addr 172.21.15.73:0/2438946942 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:47:36.820 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:36.816+0000 7f199529d640 1 --2- 172.21.15.73:0/2438946942 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f199006c420 0x7f1990149540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:36.820 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:36.816+0000 7f1995a9e640 1 --2- 172.21.15.73:0/2438946942 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f19901543d0 0x7f19901ee2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:36.820 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:36.816+0000 7f1994a9c640 1 -- 172.21.15.73:0/2438946942 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f19901543d0 msgr2=0x7f19901ee2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:36.820 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:36.816+0000 7f1994a9c640 1 --2- 172.21.15.73:0/2438946942 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f19901543d0 0x7f19901ee2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:36.821 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:36.816+0000 7f1994a9c640 1 -- 172.21.15.73:0/2438946942 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f199006c420 msgr2=0x7f1990149540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:36.821 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:36.816+0000 7f1994a9c640 1 --2- 172.21.15.73:0/2438946942 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f199006c420 0x7f1990149540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:36.821 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:36.816+0000 7f1994a9c640 1 -- 172.21.15.73:0/2438946942 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1980009a70 con 0x7f19901519d0 2023-12-12T09:47:36.821 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:36.816+0000 7f199529d640 1 --2- 172.21.15.73:0/2438946942 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f199006c420 0x7f1990149540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:47:36.821 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:36.816+0000 7f1995a9e640 1 --2- 172.21.15.73:0/2438946942 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f19901543d0 0x7f19901ee2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:47:36.821 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:36.817+0000 7f1994a9c640 1 --2- 172.21.15.73:0/2438946942 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f19901519d0 0x7f19901eb7b0 secure :-1 s=READY pgs=1167 cs=0 l=1 rev1=1 crypto rx=0x7f198400c430 tx=0x7f198400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:47:36.821 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:36.817+0000 7f198dffb640 1 -- 172.21.15.73:0/2438946942 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1984011790 con 0x7f19901519d0 2023-12-12T09:47:36.822 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:36.817+0000 7f198dffb640 1 -- 172.21.15.73:0/2438946942 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19840118f0 con 0x7f19901519d0 2023-12-12T09:47:36.822 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:36.817+0000 7f198dffb640 1 -- 172.21.15.73:0/2438946942 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1984011ca0 con 0x7f19901519d0 2023-12-12T09:47:36.822 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:36.817+0000 7f199629f640 1 -- 172.21.15.73:0/2438946942 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19901ea340 con 0x7f19901519d0 2023-12-12T09:47:36.822 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:36.817+0000 7f199629f640 1 -- 172.21.15.73:0/2438946942 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19900af200 con 0x7f19901519d0 2023-12-12T09:47:36.822 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:36.818+0000 7f199629f640 1 -- 172.21.15.73:0/2438946942 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f19900c58e0 con 0x7f19901519d0 2023-12-12T09:47:36.824 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:36.819+0000 7f198dffb640 1 -- 172.21.15.73:0/2438946942 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f198401c460 con 0x7f19901519d0 2023-12-12T09:47:36.824 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:36.820+0000 7f198dffb640 1 --2- 172.21.15.73:0/2438946942 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f197c06ae40 0x7f197c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:36.824 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:36.820+0000 7f198dffb640 1 -- 172.21.15.73:0/2438946942 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f1984089330 con 0x7f19901519d0 2023-12-12T09:47:36.824 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:36.820+0000 7f198dffb640 1 --2- 172.21.15.73:0/2438946942 >> [v2:172.21.15.73:6808/1293329670,v1:172.21.15.73:6809/1293329670] conn(0x7f197c070d40 0x7f197c073160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:36.824 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:36.820+0000 7f198dffb640 1 -- 172.21.15.73:0/2438946942 --> [v2:172.21.15.73:6808/1293329670,v1:172.21.15.73:6809/1293329670] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f197c073810 con 0x7f197c070d40 2023-12-12T09:47:36.824 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:36.820+0000 7f199529d640 1 --2- 172.21.15.73:0/2438946942 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f197c06ae40 0x7f197c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:36.824 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:36.820+0000 7f198dffb640 1 -- 172.21.15.73:0/2438946942 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_get_version_reply(handle=1 version=87) v2 ==== 24+0+0 (secure 0 0 0) 0x7f198408b910 con 0x7f19901519d0 2023-12-12T09:47:36.825 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:36.821+0000 7f1995a9e640 1 --2- 172.21.15.73:0/2438946942 >> [v2:172.21.15.73:6808/1293329670,v1:172.21.15.73:6809/1293329670] conn(0x7f197c070d40 0x7f197c073160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:36.825 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:36.821+0000 7f199529d640 1 --2- 172.21.15.73:0/2438946942 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f197c06ae40 0x7f197c06d300 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f1980036000 tx=0x7f1980030000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:47:36.825 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:36.821+0000 7f1995a9e640 1 --2- 172.21.15.73:0/2438946942 >> [v2:172.21.15.73:6808/1293329670,v1:172.21.15.73:6809/1293329670] conn(0x7f197c070d40 0x7f197c073160 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:47:36.825 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:36.822+0000 7f198dffb640 1 -- 172.21.15.73:0/2438946942 <== osd.3 v2:172.21.15.73:6808/1293329670 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f197c073810 con 0x7f197c070d40 2023-12-12T09:47:36.838 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:36.836+0000 7f199629f640 1 -- 172.21.15.73:0/2438946942 --> [v2:172.21.15.73:6808/1293329670,v1:172.21.15.73:6809/1293329670] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f1990158300 con 0x7f197c070d40 2023-12-12T09:47:36.839 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:36.837+0000 7f198dffb640 1 -- 172.21.15.73:0/2438946942 <== osd.3 v2:172.21.15.73:6808/1293329670 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f1988001780 con 0x7f197c070d40 2023-12-12T09:47:36.839 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2023-12-12T09:47:36.840 INFO:teuthology.orchestra.run.smithi073.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2023-12-12T09:47:36.840 INFO:teuthology.orchestra.run.smithi073.stdout:} 2023-12-12T09:47:36.841 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:36.837+0000 7f199629f640 1 -- 172.21.15.73:0/2438946942 >> [v2:172.21.15.73:6808/1293329670,v1:172.21.15.73:6809/1293329670] conn(0x7f197c070d40 msgr2=0x7f197c073160 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:36.841 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:36.837+0000 7f199629f640 1 --2- 172.21.15.73:0/2438946942 >> [v2:172.21.15.73:6808/1293329670,v1:172.21.15.73:6809/1293329670] conn(0x7f197c070d40 0x7f197c073160 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:36.841 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:36.837+0000 7f199629f640 1 -- 172.21.15.73:0/2438946942 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f197c06ae40 msgr2=0x7f197c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:36.841 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:36.837+0000 7f199629f640 1 --2- 172.21.15.73:0/2438946942 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f197c06ae40 0x7f197c06d300 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f1980036000 tx=0x7f1980030000 comp rx=0 tx=0).stop 2023-12-12T09:47:36.841 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:36.837+0000 7f199629f640 1 -- 172.21.15.73:0/2438946942 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f19901519d0 msgr2=0x7f19901eb7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:36.841 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:36.837+0000 7f199629f640 1 --2- 172.21.15.73:0/2438946942 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f19901519d0 0x7f19901eb7b0 secure :-1 s=READY pgs=1167 cs=0 l=1 rev1=1 crypto rx=0x7f198400c430 tx=0x7f198400c8f0 comp rx=0 tx=0).stop 2023-12-12T09:47:36.841 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:36.837+0000 7f1995a9e640 1 -- 172.21.15.73:0/2438946942 reap_dead start 2023-12-12T09:47:36.841 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:36.837+0000 7f199629f640 1 -- 172.21.15.73:0/2438946942 shutdown_connections 2023-12-12T09:47:36.842 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:36.837+0000 7f199629f640 1 -- 172.21.15.73:0/2438946942 >> 172.21.15.73:0/2438946942 conn(0x7f1990072030 msgr2=0x7f1990149d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:47:36.842 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:36.837+0000 7f199629f640 1 -- 172.21.15.73:0/2438946942 shutdown_connections 2023-12-12T09:47:36.842 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:36.837+0000 7f199629f640 1 -- 172.21.15.73:0/2438946942 wait complete. 2023-12-12T09:47:36.856 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2023-12-12T09:47:37.063 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:37.061+0000 7fd08e6ca640 1 Processor -- start 2023-12-12T09:47:37.063 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:37.061+0000 7fd08e6ca640 1 -- start start 2023-12-12T09:47:37.064 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:37.062+0000 7fd08e6ca640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fd0880aae70 0x7fd08814f2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:37.064 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:37.062+0000 7fd08e6ca640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd0880a4c90 0x7fd08814f7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:37.064 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:37.063+0000 7fd08e6ca640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd088152240 con 0x7fd0880c3740 2023-12-12T09:47:37.065 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:37.063+0000 7fd08e6ca640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd08806c3f0 con 0x7fd0880aae70 2023-12-12T09:47:37.065 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:37.063+0000 7fd08e6ca640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd088152520 con 0x7fd0880a4c90 2023-12-12T09:47:37.065 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:37.063+0000 7fd08d6c8640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fd0880aae70 0x7fd08814f2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:37.065 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:37.063+0000 7fd08d6c8640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fd0880aae70 0x7fd08814f2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:60336/0 (socket says 172.21.15.73:60336) 2023-12-12T09:47:37.065 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:37.063+0000 7fd08d6c8640 1 -- 172.21.15.73:0/1397426359 learned_addr learned my addr 172.21.15.73:0/1397426359 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:47:37.066 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:37.063+0000 7fd08cec7640 1 --2- 172.21.15.73:0/1397426359 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd0880a4c90 0x7fd08814f7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:37.066 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:37.063+0000 7fd08d6c8640 1 -- 172.21.15.73:0/1397426359 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd0880a4c90 msgr2=0x7fd08814f7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:47:37.066 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:37.063+0000 7fd08d6c8640 1 --2- 172.21.15.73:0/1397426359 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd0880a4c90 0x7fd08814f7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:37.066 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:37.063+0000 7fd08d6c8640 1 -- 172.21.15.73:0/1397426359 >> v1:172.21.15.142:6789/0 conn(0x7fd0880c3740 legacy=0x7fd0880c3bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:47:37.066 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:37.064+0000 7fd08d6c8640 1 -- 172.21.15.73:0/1397426359 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd088152800 con 0x7fd0880aae70 2023-12-12T09:47:37.066 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:37.064+0000 7fd08cec7640 1 --2- 172.21.15.73:0/1397426359 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd0880a4c90 0x7fd08814f7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:47:37.068 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:37.065+0000 7fd08d6c8640 1 --2- 172.21.15.73:0/1397426359 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd0880aae70 0x7fd08814f2b0 secure :-1 s=READY pgs=1168 cs=0 l=1 rev1=1 crypto rx=0x7fd084009870 tx=0x7fd08402b7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5816aacd0ff5a736 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:47:37.068 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:37.065+0000 7fd07ffff640 1 -- 172.21.15.73:0/1397426359 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd084031740 con 0x7fd0880aae70 2023-12-12T09:47:37.069 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:37.066+0000 7fd07ffff640 1 -- 172.21.15.73:0/1397426359 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0840318a0 con 0x7fd0880aae70 2023-12-12T09:47:37.069 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:37.066+0000 7fd07ffff640 1 -- 172.21.15.73:0/1397426359 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd084031c30 con 0x7fd0880aae70 2023-12-12T09:47:37.069 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:37.066+0000 7fd08e6ca640 1 -- 172.21.15.73:0/1397426359 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd0880aae70 msgr2=0x7fd08814f2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:37.069 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:37.066+0000 7fd08e6ca640 1 --2- 172.21.15.73:0/1397426359 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd0880aae70 0x7fd08814f2b0 secure :-1 s=READY pgs=1168 cs=0 l=1 rev1=1 crypto rx=0x7fd084009870 tx=0x7fd08402b7e0 comp rx=0 tx=0).stop 2023-12-12T09:47:37.069 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:37.066+0000 7fd08e6ca640 1 -- 172.21.15.73:0/1397426359 shutdown_connections 2023-12-12T09:47:37.069 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:37.066+0000 7fd08e6ca640 1 --2- 172.21.15.73:0/1397426359 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd0880a4c90 0x7fd08814f7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:37.069 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:37.066+0000 7fd08e6ca640 1 --2- 172.21.15.73:0/1397426359 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd0880aae70 0x7fd08814f2b0 unknown :-1 s=CLOSED pgs=1168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:37.069 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:37.066+0000 7fd08e6ca640 1 -- 172.21.15.73:0/1397426359 >> 172.21.15.73:0/1397426359 conn(0x7fd0880a75f0 msgr2=0x7fd0880a7a00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:47:37.070 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:37.066+0000 7fd08e6ca640 1 -- 172.21.15.73:0/1397426359 shutdown_connections 2023-12-12T09:47:37.070 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:37.066+0000 7fd08e6ca640 1 -- 172.21.15.73:0/1397426359 wait complete. 2023-12-12T09:47:37.071 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:37.068+0000 7fd08e6ca640 1 Processor -- start 2023-12-12T09:47:37.071 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:37.068+0000 7fd08e6ca640 1 -- start start 2023-12-12T09:47:37.071 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:37.069+0000 7fd08e6ca640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd0880a4c90 0x7fd0880bf6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:37.071 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:37.069+0000 7fd08e6ca640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd0880aae70 0x7fd0881e9e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:37.071 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:37.069+0000 7fd08e6ca640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd0880c3740 0x7fd0881ea3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:37.071 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:37.069+0000 7fd08e6ca640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd088156020 con 0x7fd0880c3740 2023-12-12T09:47:37.071 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:37.069+0000 7fd08e6ca640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0881e9a20 con 0x7fd0880aae70 2023-12-12T09:47:37.071 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:37.069+0000 7fd08e6ca640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0881538e0 con 0x7fd0880a4c90 2023-12-12T09:47:37.072 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:37.069+0000 7fd08dec9640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd0880c3740 0x7fd0881ea3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:37.072 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:37.069+0000 7fd08dec9640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd0880c3740 0x7fd0881ea3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:60352/0 (socket says 172.21.15.73:60352) 2023-12-12T09:47:37.072 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:37.069+0000 7fd08dec9640 1 -- 172.21.15.73:0/3822236693 learned_addr learned my addr 172.21.15.73:0/3822236693 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:47:37.073 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:37.070+0000 7fd08cec7640 1 --2- 172.21.15.73:0/3822236693 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd0880aae70 0x7fd0881e9e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:37.073 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:37.070+0000 7fd08dec9640 1 -- 172.21.15.73:0/3822236693 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd0880a4c90 msgr2=0x7fd0880bf6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:37.073 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:37.070+0000 7fd08dec9640 1 --2- 172.21.15.73:0/3822236693 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd0880a4c90 0x7fd0880bf6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:37.074 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:37.070+0000 7fd08dec9640 1 -- 172.21.15.73:0/3822236693 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd0880aae70 msgr2=0x7fd0881e9e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:37.074 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:37.070+0000 7fd08dec9640 1 --2- 172.21.15.73:0/3822236693 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd0880aae70 0x7fd0881e9e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:37.074 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:37.070+0000 7fd08dec9640 1 -- 172.21.15.73:0/3822236693 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0840094d0 con 0x7fd0880c3740 2023-12-12T09:47:37.074 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:37.070+0000 7fd08dec9640 1 --2- 172.21.15.73:0/3822236693 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd0880c3740 0x7fd0881ea3a0 secure :-1 s=READY pgs=1169 cs=0 l=1 rev1=1 crypto rx=0x7fd08000b970 tx=0x7fd08000be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:47:37.074 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:37.070+0000 7fd07dffb640 1 -- 172.21.15.73:0/3822236693 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd08000cb40 con 0x7fd0880c3740 2023-12-12T09:47:37.074 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:37.070+0000 7fd07dffb640 1 -- 172.21.15.73:0/3822236693 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd08000cca0 con 0x7fd0880c3740 2023-12-12T09:47:37.074 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:37.070+0000 7fd08e6ca640 1 -- 172.21.15.73:0/3822236693 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0881edee0 con 0x7fd0880c3740 2023-12-12T09:47:37.074 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:37.070+0000 7fd07dffb640 1 -- 172.21.15.73:0/3822236693 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd080014680 con 0x7fd0880c3740 2023-12-12T09:47:37.074 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:37.071+0000 7fd08e6ca640 1 -- 172.21.15.73:0/3822236693 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0881ed640 con 0x7fd0880c3740 2023-12-12T09:47:37.075 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:37.072+0000 7fd08e6ca640 1 -- 172.21.15.73:0/3822236693 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd08806c030 con 0x7fd0880c3740 2023-12-12T09:47:37.075 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:37.073+0000 7fd07dffb640 1 -- 172.21.15.73:0/3822236693 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fd08001d3b0 con 0x7fd0880c3740 2023-12-12T09:47:37.076 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:37.074+0000 7fd07dffb640 1 --2- 172.21.15.73:0/3822236693 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fd06c06ae40 0x7fd06c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:37.076 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:37.074+0000 7fd07dffb640 1 -- 172.21.15.73:0/3822236693 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 5029+0+0 (secure 0 0 0) 0x7fd0800891b0 con 0x7fd0880c3740 2023-12-12T09:47:37.076 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:37.074+0000 7fd08d6c8640 1 --2- 172.21.15.73:0/3822236693 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fd06c06ae40 0x7fd06c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:37.076 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:37.075+0000 7fd08d6c8640 1 --2- 172.21.15.73:0/3822236693 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fd06c06ae40 0x7fd06c06d300 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7fd084035000 tx=0x7fd084030000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:47:37.080 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:37.079+0000 7fd07dffb640 1 -- 172.21.15.73:0/3822236693 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fd0800544f0 con 0x7fd0880c3740 2023-12-12T09:47:37.269 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:37.267+0000 7fd08e6ca640 1 -- 172.21.15.73:0/3822236693 --> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) v1 -- 0x7fd0880c4300 con 0x7fd06c06ae40 2023-12-12T09:47:37.269 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:37.268+0000 7fd07dffb640 1 -- 172.21.15.73:0/3822236693 <== mgr.4110 v2:172.21.15.73:6832/779985841 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fd084031a90 con 0x7fd06c06ae40 2023-12-12T09:47:37.270 INFO:teuthology.orchestra.run.smithi073.stderr:instructed osd(s) 3 to deep-scrub 2023-12-12T09:47:37.272 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:37.270+0000 7fd08e6ca640 1 -- 172.21.15.73:0/3822236693 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fd06c06ae40 msgr2=0x7fd06c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:37.272 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:37.270+0000 7fd08e6ca640 1 --2- 172.21.15.73:0/3822236693 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fd06c06ae40 0x7fd06c06d300 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7fd084035000 tx=0x7fd084030000 comp rx=0 tx=0).stop 2023-12-12T09:47:37.273 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:37.270+0000 7fd08e6ca640 1 -- 172.21.15.73:0/3822236693 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd0880c3740 msgr2=0x7fd0881ea3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:37.273 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:37.270+0000 7fd08e6ca640 1 --2- 172.21.15.73:0/3822236693 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd0880c3740 0x7fd0881ea3a0 secure :-1 s=READY pgs=1169 cs=0 l=1 rev1=1 crypto rx=0x7fd08000b970 tx=0x7fd08000be30 comp rx=0 tx=0).stop 2023-12-12T09:47:37.273 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:37.271+0000 7fd08e6ca640 1 -- 172.21.15.73:0/3822236693 shutdown_connections 2023-12-12T09:47:37.273 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:37.271+0000 7fd08e6ca640 1 --2- 172.21.15.73:0/3822236693 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fd06c06ae40 0x7fd06c06d300 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:37.273 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:37.271+0000 7fd08e6ca640 1 --2- 172.21.15.73:0/3822236693 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd0880c3740 0x7fd0881ea3a0 unknown :-1 s=CLOSED pgs=1169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:37.273 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:37.271+0000 7fd08e6ca640 1 --2- 172.21.15.73:0/3822236693 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd0880aae70 0x7fd0881e9e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:37.273 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:37.271+0000 7fd08e6ca640 1 --2- 172.21.15.73:0/3822236693 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd0880a4c90 0x7fd0880bf6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:37.273 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:37.271+0000 7fd08e6ca640 1 -- 172.21.15.73:0/3822236693 >> 172.21.15.73:0/3822236693 conn(0x7fd0880a75f0 msgr2=0x7fd088150730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:47:37.274 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:37.271+0000 7fd08e6ca640 1 -- 172.21.15.73:0/3822236693 shutdown_connections 2023-12-12T09:47:37.274 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:37.271+0000 7fd08e6ca640 1 -- 172.21.15.73:0/3822236693 wait complete. 2023-12-12T09:47:37.291 INFO:tasks.ceph:Scrubbing osd.4 2023-12-12T09:47:37.291 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2023-12-12T09:47:37.504 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:37.502+0000 7f7e625f5640 1 Processor -- start 2023-12-12T09:47:37.504 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:37.502+0000 7f7e625f5640 1 -- start start 2023-12-12T09:47:37.506 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:37.504+0000 7f7e625f5640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f7e5c0c23b0 0x7f7e5c0c0320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:37.506 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:37.504+0000 7f7e625f5640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7e5c06cc90 0x7f7e5c0c2790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:37.506 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:37.504+0000 7f7e625f5640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e5c0c1520 con 0x7f7e5c159410 2023-12-12T09:47:37.506 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:37.504+0000 7f7e625f5640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e5c0c46f0 con 0x7f7e5c0c23b0 2023-12-12T09:47:37.506 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:37.504+0000 7f7e625f5640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e5c06d0d0 con 0x7f7e5c06cc90 2023-12-12T09:47:37.507 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:37.505+0000 7f7e53fff640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7e5c06cc90 0x7f7e5c0c2790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:37.507 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:37.505+0000 7f7e5bfff640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f7e5c0c23b0 0x7f7e5c0c0320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:37.507 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:37.505+0000 7f7e5bfff640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f7e5c0c23b0 0x7f7e5c0c0320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.73:49028/0 (socket says 172.21.15.73:49028) 2023-12-12T09:47:37.507 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:37.505+0000 7f7e5bfff640 1 -- 172.21.15.73:0/1284488697 learned_addr learned my addr 172.21.15.73:0/1284488697 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:47:37.507 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:37.506+0000 7f7e5bfff640 1 -- 172.21.15.73:0/1284488697 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7e5c06cc90 msgr2=0x7f7e5c0c2790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:47:37.508 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:37.506+0000 7f7e5bfff640 1 --2- 172.21.15.73:0/1284488697 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7e5c06cc90 0x7f7e5c0c2790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:37.508 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:37.506+0000 7f7e5bfff640 1 -- 172.21.15.73:0/1284488697 >> v1:172.21.15.142:6789/0 conn(0x7f7e5c159410 legacy=0x7f7e5c0c50d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:37.508 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:37.506+0000 7f7e5bfff640 1 -- 172.21.15.73:0/1284488697 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e5c0c57e0 con 0x7f7e5c0c23b0 2023-12-12T09:47:37.508 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:37.507+0000 7f7e5bfff640 1 --2- 172.21.15.73:0/1284488697 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7e5c0c23b0 0x7f7e5c0c0320 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f7e4c009870 tx=0x7f7e4c02b860 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f73ab72602b532b7 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:47:37.509 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:37.508+0000 7f7e5b7fe640 1 -- 172.21.15.73:0/1284488697 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e4c0317c0 con 0x7f7e5c0c23b0 2023-12-12T09:47:37.509 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:37.508+0000 7f7e5b7fe640 1 -- 172.21.15.73:0/1284488697 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e4c031920 con 0x7f7e5c0c23b0 2023-12-12T09:47:37.509 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:37.508+0000 7f7e5b7fe640 1 -- 172.21.15.73:0/1284488697 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e4c031cb0 con 0x7f7e5c0c23b0 2023-12-12T09:47:37.510 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:37.508+0000 7f7e625f5640 1 -- 172.21.15.73:0/1284488697 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7e5c0c23b0 msgr2=0x7f7e5c0c0320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:37.510 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:37.508+0000 7f7e625f5640 1 --2- 172.21.15.73:0/1284488697 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7e5c0c23b0 0x7f7e5c0c0320 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f7e4c009870 tx=0x7f7e4c02b860 comp rx=0 tx=0).stop 2023-12-12T09:47:37.510 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:37.508+0000 7f7e625f5640 1 -- 172.21.15.73:0/1284488697 shutdown_connections 2023-12-12T09:47:37.511 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:37.508+0000 7f7e625f5640 1 --2- 172.21.15.73:0/1284488697 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7e5c06cc90 0x7f7e5c0c2790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:37.511 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:37.508+0000 7f7e625f5640 1 --2- 172.21.15.73:0/1284488697 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7e5c0c23b0 0x7f7e5c0c0320 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:37.511 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:37.508+0000 7f7e625f5640 1 -- 172.21.15.73:0/1284488697 >> 172.21.15.73:0/1284488697 conn(0x7f7e5c06a4e0 msgr2=0x7f7e5c06a8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:47:37.511 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:37.508+0000 7f7e625f5640 1 -- 172.21.15.73:0/1284488697 shutdown_connections 2023-12-12T09:47:37.511 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:37.508+0000 7f7e625f5640 1 -- 172.21.15.73:0/1284488697 wait complete. 2023-12-12T09:47:37.511 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:37.510+0000 7f7e625f5640 1 Processor -- start 2023-12-12T09:47:37.512 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:37.510+0000 7f7e625f5640 1 -- start start 2023-12-12T09:47:37.513 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:37.511+0000 7f7e625f5640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7e5c06cc90 0x7f7e5c15c850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:37.513 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:37.511+0000 7f7e625f5640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7e5c0c23b0 0x7f7e5c15a790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:37.514 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:37.511+0000 7f7e625f5640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7e5c159410 0x7f7e5c14f800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:37.514 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:37.511+0000 7f7e625f5640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e5c0ab250 con 0x7f7e5c159410 2023-12-12T09:47:37.514 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:37.511+0000 7f7e625f5640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e5c0a8830 con 0x7f7e5c06cc90 2023-12-12T09:47:37.514 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:37.511+0000 7f7e625f5640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e5c1f2450 con 0x7f7e5c0c23b0 2023-12-12T09:47:37.514 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:37.511+0000 7f7e60b92640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7e5c159410 0x7f7e5c14f800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:37.514 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:37.511+0000 7f7e60b92640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7e5c159410 0x7f7e5c14f800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:60362/0 (socket says 172.21.15.73:60362) 2023-12-12T09:47:37.514 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:37.511+0000 7f7e60b92640 1 -- 172.21.15.73:0/1562095258 learned_addr learned my addr 172.21.15.73:0/1562095258 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:47:37.514 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:37.512+0000 7f7e53fff640 1 --2- 172.21.15.73:0/1562095258 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7e5c0c23b0 0x7f7e5c15a790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:37.515 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:37.512+0000 7f7e5bfff640 1 --2- 172.21.15.73:0/1562095258 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7e5c06cc90 0x7f7e5c15c850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:37.515 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:37.512+0000 7f7e60b92640 1 -- 172.21.15.73:0/1562095258 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7e5c0c23b0 msgr2=0x7f7e5c15a790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:37.515 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:37.512+0000 7f7e60b92640 1 --2- 172.21.15.73:0/1562095258 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7e5c0c23b0 0x7f7e5c15a790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:37.515 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:37.512+0000 7f7e60b92640 1 -- 172.21.15.73:0/1562095258 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7e5c06cc90 msgr2=0x7f7e5c15c850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:37.515 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:37.512+0000 7f7e60b92640 1 --2- 172.21.15.73:0/1562095258 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7e5c06cc90 0x7f7e5c15c850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:37.515 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:37.512+0000 7f7e60b92640 1 -- 172.21.15.73:0/1562095258 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e4c0094d0 con 0x7f7e5c159410 2023-12-12T09:47:37.515 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:37.512+0000 7f7e53fff640 1 --2- 172.21.15.73:0/1562095258 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7e5c0c23b0 0x7f7e5c15a790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:47:37.516 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:37.512+0000 7f7e60b92640 1 --2- 172.21.15.73:0/1562095258 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7e5c159410 0x7f7e5c14f800 secure :-1 s=READY pgs=1170 cs=0 l=1 rev1=1 crypto rx=0x7f7e5400c7a0 tx=0x7f7e5400cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:47:37.516 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:37.512+0000 7f7e597fa640 1 -- 172.21.15.73:0/1562095258 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e54003b70 con 0x7f7e5c159410 2023-12-12T09:47:37.516 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:37.513+0000 7f7e597fa640 1 -- 172.21.15.73:0/1562095258 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e54003cf0 con 0x7f7e5c159410 2023-12-12T09:47:37.517 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:37.513+0000 7f7e625f5640 1 -- 172.21.15.73:0/1562095258 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e5c0a8ad0 con 0x7f7e5c159410 2023-12-12T09:47:37.517 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:37.513+0000 7f7e597fa640 1 -- 172.21.15.73:0/1562095258 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e54003ea0 con 0x7f7e5c159410 2023-12-12T09:47:37.517 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:37.513+0000 7f7e625f5640 1 -- 172.21.15.73:0/1562095258 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e5c1f2730 con 0x7f7e5c159410 2023-12-12T09:47:37.517 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:37.514+0000 7f7e625f5640 1 -- 172.21.15.73:0/1562095258 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f7e5c0c48d0 con 0x7f7e5c159410 2023-12-12T09:47:37.517 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:37.515+0000 7f7e597fa640 1 -- 172.21.15.73:0/1562095258 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f7e5400aa90 con 0x7f7e5c159410 2023-12-12T09:47:37.518 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:37.516+0000 7f7e597fa640 1 --2- 172.21.15.73:0/1562095258 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f7e3c06ae70 0x7f7e3c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:37.518 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:37.516+0000 7f7e597fa640 1 -- 172.21.15.73:0/1562095258 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f7e54088f60 con 0x7f7e5c159410 2023-12-12T09:47:37.518 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:37.516+0000 7f7e5bfff640 1 --2- 172.21.15.73:0/1562095258 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f7e3c06ae70 0x7f7e3c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:37.518 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:37.516+0000 7f7e597fa640 1 --2- 172.21.15.73:0/1562095258 >> [v2:172.21.15.142:6800/3727975702,v1:172.21.15.142:6801/3727975702] conn(0x7f7e3c070d70 0x7f7e3c073190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:37.519 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:37.516+0000 7f7e597fa640 1 -- 172.21.15.73:0/1562095258 --> [v2:172.21.15.142:6800/3727975702,v1:172.21.15.142:6801/3727975702] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f7e3c073840 con 0x7f7e3c070d70 2023-12-12T09:47:37.519 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:37.516+0000 7f7e597fa640 1 -- 172.21.15.73:0/1562095258 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_get_version_reply(handle=1 version=87) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7e5408b620 con 0x7f7e5c159410 2023-12-12T09:47:37.519 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:37.517+0000 7f7e5bfff640 1 --2- 172.21.15.73:0/1562095258 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f7e3c06ae70 0x7f7e3c06d330 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f7e4c036000 tx=0x7f7e4c03d040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:47:37.519 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:37.517+0000 7f7e53fff640 1 --2- 172.21.15.73:0/1562095258 >> [v2:172.21.15.142:6800/3727975702,v1:172.21.15.142:6801/3727975702] conn(0x7f7e3c070d70 0x7f7e3c073190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:37.519 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:37.518+0000 7f7e53fff640 1 --2- 172.21.15.73:0/1562095258 >> [v2:172.21.15.142:6800/3727975702,v1:172.21.15.142:6801/3727975702] conn(0x7f7e3c070d70 0x7f7e3c073190 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:47:37.521 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:37.520+0000 7f7e597fa640 1 -- 172.21.15.73:0/1562095258 <== osd.4 v2:172.21.15.142:6800/3727975702 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f7e3c073840 con 0x7f7e3c070d70 2023-12-12T09:47:37.536 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:37.534+0000 7f7e625f5640 1 -- 172.21.15.73:0/1562095258 --> [v2:172.21.15.142:6800/3727975702,v1:172.21.15.142:6801/3727975702] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f7e5c0c0c00 con 0x7f7e3c070d70 2023-12-12T09:47:37.537 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:37.535+0000 7f7e597fa640 1 -- 172.21.15.73:0/1562095258 <== osd.4 v2:172.21.15.142:6800/3727975702 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f7e44009b50 con 0x7f7e3c070d70 2023-12-12T09:47:37.537 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2023-12-12T09:47:37.537 INFO:teuthology.orchestra.run.smithi073.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2023-12-12T09:47:37.538 INFO:teuthology.orchestra.run.smithi073.stdout:} 2023-12-12T09:47:37.539 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:37.536+0000 7f7e625f5640 1 -- 172.21.15.73:0/1562095258 >> [v2:172.21.15.142:6800/3727975702,v1:172.21.15.142:6801/3727975702] conn(0x7f7e3c070d70 msgr2=0x7f7e3c073190 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:37.539 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:37.536+0000 7f7e625f5640 1 --2- 172.21.15.73:0/1562095258 >> [v2:172.21.15.142:6800/3727975702,v1:172.21.15.142:6801/3727975702] conn(0x7f7e3c070d70 0x7f7e3c073190 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:37.539 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:37.536+0000 7f7e625f5640 1 -- 172.21.15.73:0/1562095258 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f7e3c06ae70 msgr2=0x7f7e3c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:37.539 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:37.536+0000 7f7e625f5640 1 --2- 172.21.15.73:0/1562095258 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f7e3c06ae70 0x7f7e3c06d330 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f7e4c036000 tx=0x7f7e4c03d040 comp rx=0 tx=0).stop 2023-12-12T09:47:37.540 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:37.536+0000 7f7e625f5640 1 -- 172.21.15.73:0/1562095258 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7e5c159410 msgr2=0x7f7e5c14f800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:37.540 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:37.536+0000 7f7e625f5640 1 --2- 172.21.15.73:0/1562095258 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7e5c159410 0x7f7e5c14f800 secure :-1 s=READY pgs=1170 cs=0 l=1 rev1=1 crypto rx=0x7f7e5400c7a0 tx=0x7f7e5400cc60 comp rx=0 tx=0).stop 2023-12-12T09:47:37.540 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:37.536+0000 7f7e60b92640 1 -- 172.21.15.73:0/1562095258 reap_dead start 2023-12-12T09:47:37.540 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:37.536+0000 7f7e625f5640 1 -- 172.21.15.73:0/1562095258 shutdown_connections 2023-12-12T09:47:37.540 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:37.536+0000 7f7e625f5640 1 -- 172.21.15.73:0/1562095258 >> 172.21.15.73:0/1562095258 conn(0x7f7e5c06a4e0 msgr2=0x7f7e5c156800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:47:37.540 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:37.537+0000 7f7e625f5640 1 -- 172.21.15.73:0/1562095258 shutdown_connections 2023-12-12T09:47:37.540 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:37.537+0000 7f7e625f5640 1 -- 172.21.15.73:0/1562095258 wait complete. 2023-12-12T09:47:37.556 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2023-12-12T09:47:37.763 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:37.761+0000 7f92b8783640 1 Processor -- start 2023-12-12T09:47:37.764 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:37.761+0000 7f92b8783640 1 -- start start 2023-12-12T09:47:37.767 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:37.763+0000 7f92b8783640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f92b00c1a60 0x7f92b0151b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:37.767 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:37.763+0000 7f92b8783640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f92b00c4c10 0x7f92b0154f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:37.767 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:37.763+0000 7f92b8783640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92b01589a0 con 0x7f92b00a4f40 2023-12-12T09:47:37.768 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:37.763+0000 7f92b8783640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92b006c120 con 0x7f92b00c1a60 2023-12-12T09:47:37.768 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:37.763+0000 7f92b8783640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92b0157d90 con 0x7f92b00c4c10 2023-12-12T09:47:37.768 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:37.763+0000 7f92b651f640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f92b00c1a60 0x7f92b0151b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:37.768 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:37.763+0000 7f92b651f640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f92b00c1a60 0x7f92b0151b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:60372/0 (socket says 172.21.15.73:60372) 2023-12-12T09:47:37.769 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:37.763+0000 7f92b651f640 1 -- 172.21.15.73:0/3932142112 learned_addr learned my addr 172.21.15.73:0/3932142112 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:47:37.769 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:37.764+0000 7f92b651f640 1 -- 172.21.15.73:0/3932142112 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f92b00c4c10 msgr2=0x7f92b0154f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:47:37.769 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:37.764+0000 7f92b6d20640 1 --2- 172.21.15.73:0/3932142112 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f92b00c4c10 0x7f92b0154f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:37.770 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:37.764+0000 7f92b651f640 1 --2- 172.21.15.73:0/3932142112 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f92b00c4c10 0x7f92b0154f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:37.770 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:37.764+0000 7f92b651f640 1 -- 172.21.15.73:0/3932142112 >> v1:172.21.15.142:6789/0 conn(0x7f92b00a4f40 legacy=0x7f92b0154860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:47:37.770 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:37.764+0000 7f92b651f640 1 -- 172.21.15.73:0/3932142112 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92b0158070 con 0x7f92b00c1a60 2023-12-12T09:47:37.770 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:37.765+0000 7f92b651f640 1 --2- 172.21.15.73:0/3932142112 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f92b00c1a60 0x7f92b0151b20 secure :-1 s=READY pgs=1171 cs=0 l=1 rev1=1 crypto rx=0x7f92ac009870 tx=0x7f92ac02b7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a2f8fd8a85d654e server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:47:37.771 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:37.765+0000 7f92b551d640 1 -- 172.21.15.73:0/3932142112 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92ac031740 con 0x7f92b00c1a60 2023-12-12T09:47:37.771 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:37.765+0000 7f92b551d640 1 -- 172.21.15.73:0/3932142112 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92ac0318a0 con 0x7f92b00c1a60 2023-12-12T09:47:37.771 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:37.766+0000 7f92b551d640 1 -- 172.21.15.73:0/3932142112 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92ac031c30 con 0x7f92b00c1a60 2023-12-12T09:47:37.777 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:37.766+0000 7f92b8783640 1 -- 172.21.15.73:0/3932142112 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f92b00c1a60 msgr2=0x7f92b0151b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:37.777 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:37.766+0000 7f92b8783640 1 --2- 172.21.15.73:0/3932142112 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f92b00c1a60 0x7f92b0151b20 secure :-1 s=READY pgs=1171 cs=0 l=1 rev1=1 crypto rx=0x7f92ac009870 tx=0x7f92ac02b7e0 comp rx=0 tx=0).stop 2023-12-12T09:47:37.777 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:37.766+0000 7f92b8783640 1 -- 172.21.15.73:0/3932142112 shutdown_connections 2023-12-12T09:47:37.777 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:37.766+0000 7f92b8783640 1 --2- 172.21.15.73:0/3932142112 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f92b00c4c10 0x7f92b0154f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:37.778 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:37.766+0000 7f92b8783640 1 --2- 172.21.15.73:0/3932142112 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f92b00c1a60 0x7f92b0151b20 unknown :-1 s=CLOSED pgs=1171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:37.778 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:37.766+0000 7f92b8783640 1 -- 172.21.15.73:0/3932142112 >> 172.21.15.73:0/3932142112 conn(0x7f92b00a77d0 msgr2=0x7f92b00a7bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:47:37.778 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:37.766+0000 7f92b8783640 1 -- 172.21.15.73:0/3932142112 shutdown_connections 2023-12-12T09:47:37.779 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:37.766+0000 7f92b8783640 1 -- 172.21.15.73:0/3932142112 wait complete. 2023-12-12T09:47:37.779 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:37.768+0000 7f92b8783640 1 Processor -- start 2023-12-12T09:47:37.779 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:37.768+0000 7f92b8783640 1 -- start start 2023-12-12T09:47:37.779 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:37.769+0000 7f92b8783640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f92b00a4f40 0x7f92b01ed080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:37.780 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:37.769+0000 7f92b8783640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f92b00c1a60 0x7f92b01566a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:37.780 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:37.769+0000 7f92b8783640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f92b00c4c10 0x7f92b01497e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:37.780 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:37.769+0000 7f92b8783640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92b01edd50 con 0x7f92b00c4c10 2023-12-12T09:47:37.780 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:37.769+0000 7f92b8783640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92b0153130 con 0x7f92b00a4f40 2023-12-12T09:47:37.780 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:37.769+0000 7f92b8783640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92b00a56f0 con 0x7f92b00c1a60 2023-12-12T09:47:37.781 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:37.769+0000 7f92b6d20640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f92b00c4c10 0x7f92b01497e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:37.781 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:37.769+0000 7f92b6d20640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f92b00c4c10 0x7f92b01497e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:60380/0 (socket says 172.21.15.73:60380) 2023-12-12T09:47:37.781 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:37.769+0000 7f92b6d20640 1 -- 172.21.15.73:0/2550356880 learned_addr learned my addr 172.21.15.73:0/2550356880 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:47:37.781 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:37.770+0000 7f92b651f640 1 --2- 172.21.15.73:0/2550356880 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f92b00a4f40 0x7f92b01ed080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:37.781 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:37.770+0000 7f92b5d1e640 1 --2- 172.21.15.73:0/2550356880 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f92b00c1a60 0x7f92b01566a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:37.781 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:37.770+0000 7f92b6d20640 1 -- 172.21.15.73:0/2550356880 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f92b00c1a60 msgr2=0x7f92b01566a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:37.781 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:37.770+0000 7f92b6d20640 1 --2- 172.21.15.73:0/2550356880 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f92b00c1a60 0x7f92b01566a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:37.782 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:37.770+0000 7f92b6d20640 1 -- 172.21.15.73:0/2550356880 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f92b00a4f40 msgr2=0x7f92b01ed080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:37.782 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:37.770+0000 7f92b6d20640 1 --2- 172.21.15.73:0/2550356880 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f92b00a4f40 0x7f92b01ed080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:37.782 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:37.770+0000 7f92b6d20640 1 -- 172.21.15.73:0/2550356880 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92ac0094d0 con 0x7f92b00c4c10 2023-12-12T09:47:37.782 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:37.770+0000 7f92b6d20640 1 --2- 172.21.15.73:0/2550356880 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f92b00c4c10 0x7f92b01497e0 secure :-1 s=READY pgs=1172 cs=0 l=1 rev1=1 crypto rx=0x7f92a800cda0 tx=0x7f92a800a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:47:37.782 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:37.770+0000 7f92a6ffd640 1 -- 172.21.15.73:0/2550356880 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92a8003b90 con 0x7f92b00c4c10 2023-12-12T09:47:37.783 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:37.770+0000 7f92a6ffd640 1 -- 172.21.15.73:0/2550356880 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92a8003cf0 con 0x7f92b00c4c10 2023-12-12T09:47:37.783 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:37.770+0000 7f92a6ffd640 1 -- 172.21.15.73:0/2550356880 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92a8004240 con 0x7f92b00c4c10 2023-12-12T09:47:37.783 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:37.770+0000 7f92b8783640 1 -- 172.21.15.73:0/2550356880 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92b01535c0 con 0x7f92b00c4c10 2023-12-12T09:47:37.783 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:37.771+0000 7f92b8783640 1 -- 172.21.15.73:0/2550356880 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92b01eda70 con 0x7f92b00c4c10 2023-12-12T09:47:37.783 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:37.772+0000 7f92b8783640 1 -- 172.21.15.73:0/2550356880 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f92b01532c0 con 0x7f92b00c4c10 2023-12-12T09:47:37.783 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:37.773+0000 7f92a6ffd640 1 -- 172.21.15.73:0/2550356880 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f92a80043a0 con 0x7f92b00c4c10 2023-12-12T09:47:37.784 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:37.774+0000 7f92a6ffd640 1 --2- 172.21.15.73:0/2550356880 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f929406ae40 0x7f929406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:37.784 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:37.774+0000 7f92a6ffd640 1 -- 172.21.15.73:0/2550356880 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f92a8012070 con 0x7f92b00c4c10 2023-12-12T09:47:37.784 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:37.774+0000 7f92b651f640 1 --2- 172.21.15.73:0/2550356880 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f929406ae40 0x7f929406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:37.784 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:37.775+0000 7f92b651f640 1 --2- 172.21.15.73:0/2550356880 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f929406ae40 0x7f929406d300 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f92ac035000 tx=0x7f92ac008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:47:37.785 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:37.778+0000 7f92a6ffd640 1 -- 172.21.15.73:0/2550356880 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f92a80550b0 con 0x7f92b00c4c10 2023-12-12T09:47:37.970 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:37.968+0000 7f92b8783640 1 -- 172.21.15.73:0/2550356880 --> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) v1 -- 0x7f92b01554b0 con 0x7f929406ae40 2023-12-12T09:47:37.971 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:37.969+0000 7f92a6ffd640 1 -- 172.21.15.73:0/2550356880 <== mgr.4110 v2:172.21.15.73:6832/779985841 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f92ac031680 con 0x7f929406ae40 2023-12-12T09:47:37.971 INFO:teuthology.orchestra.run.smithi073.stderr:instructed osd(s) 4 to deep-scrub 2023-12-12T09:47:37.974 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:37.972+0000 7f92b8783640 1 -- 172.21.15.73:0/2550356880 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f929406ae40 msgr2=0x7f929406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:37.974 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:37.972+0000 7f92b8783640 1 --2- 172.21.15.73:0/2550356880 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f929406ae40 0x7f929406d300 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f92ac035000 tx=0x7f92ac008030 comp rx=0 tx=0).stop 2023-12-12T09:47:37.974 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:37.972+0000 7f92b8783640 1 -- 172.21.15.73:0/2550356880 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f92b00c4c10 msgr2=0x7f92b01497e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:37.974 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:37.972+0000 7f92b8783640 1 --2- 172.21.15.73:0/2550356880 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f92b00c4c10 0x7f92b01497e0 secure :-1 s=READY pgs=1172 cs=0 l=1 rev1=1 crypto rx=0x7f92a800cda0 tx=0x7f92a800a660 comp rx=0 tx=0).stop 2023-12-12T09:47:37.974 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:37.972+0000 7f92b8783640 1 -- 172.21.15.73:0/2550356880 shutdown_connections 2023-12-12T09:47:37.975 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:37.972+0000 7f92b8783640 1 --2- 172.21.15.73:0/2550356880 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f929406ae40 0x7f929406d300 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:37.975 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:37.972+0000 7f92b8783640 1 --2- 172.21.15.73:0/2550356880 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f92b00c4c10 0x7f92b01497e0 unknown :-1 s=CLOSED pgs=1172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:37.975 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:37.972+0000 7f92b8783640 1 --2- 172.21.15.73:0/2550356880 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f92b00c1a60 0x7f92b01566a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:37.975 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:37.972+0000 7f92b8783640 1 --2- 172.21.15.73:0/2550356880 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f92b00a4f40 0x7f92b01ed080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:37.975 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:37.972+0000 7f92b8783640 1 -- 172.21.15.73:0/2550356880 >> 172.21.15.73:0/2550356880 conn(0x7f92b00a77d0 msgr2=0x7f92b00c0d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:47:37.975 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:37.972+0000 7f92b8783640 1 -- 172.21.15.73:0/2550356880 shutdown_connections 2023-12-12T09:47:37.975 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:37.972+0000 7f92b8783640 1 -- 172.21.15.73:0/2550356880 wait complete. 2023-12-12T09:47:37.994 INFO:tasks.ceph:Scrubbing osd.5 2023-12-12T09:47:37.994 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2023-12-12T09:47:38.209 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:38.207+0000 7fee8dfff640 1 Processor -- start 2023-12-12T09:47:38.209 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:38.208+0000 7fee8dfff640 1 -- start start 2023-12-12T09:47:38.211 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:38.209+0000 7fee8dfff640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fee880a4d00 0x7fee880c0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:38.211 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:38.209+0000 7fee8dfff640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fee881529a0 0x7fee880a8880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:38.211 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:38.209+0000 7fee8dfff640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee881521e0 con 0x7fee8814c190 2023-12-12T09:47:38.211 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:38.209+0000 7fee8dfff640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee880c1890 con 0x7fee881529a0 2023-12-12T09:47:38.211 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:38.209+0000 7fee8dfff640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee88151fd0 con 0x7fee880a4d00 2023-12-12T09:47:38.211 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:38.209+0000 7fee8cffd640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7fee8814c190 0x7fee881555c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:54674/0 (socket says 172.21.15.73:54674) 2023-12-12T09:47:38.211 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:38.209+0000 7fee8cffd640 1 -- 172.21.15.73:0/1902112172 learned_addr learned my addr 172.21.15.73:0/1902112172 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-12T09:47:38.213 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:38.210+0000 7fee8d7fe640 1 --2- 172.21.15.73:0/1902112172 >> v2:172.21.15.142:3300/0 conn(0x7fee881529a0 0x7fee880a8880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:38.214 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:38.210+0000 7fee87fff640 1 --2- 172.21.15.73:0/1902112172 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fee880a4d00 0x7fee880c0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:38.214 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:38.210+0000 7fee877fe640 1 -- 172.21.15.73:0/1902112172 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1456360030 0 0) 0x7fee881521e0 con 0x7fee8814c190 2023-12-12T09:47:38.214 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:38.210+0000 7fee877fe640 1 -- 172.21.15.73:0/1902112172 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fee70003520 con 0x7fee8814c190 2023-12-12T09:47:38.214 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:38.210+0000 7fee877fe640 1 -- 172.21.15.73:0/1902112172 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2571670243 0 0) 0x7fee70003520 con 0x7fee8814c190 2023-12-12T09:47:38.214 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:38.210+0000 7fee877fe640 1 -- 172.21.15.73:0/1902112172 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fee880a4d00 msgr2=0x7fee880c0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:47:38.214 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:38.210+0000 7fee877fe640 1 --2- 172.21.15.73:0/1902112172 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fee880a4d00 0x7fee880c0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:38.214 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:38.210+0000 7fee877fe640 1 -- 172.21.15.73:0/1902112172 >> v2:172.21.15.142:3300/0 conn(0x7fee881529a0 msgr2=0x7fee880a8880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:47:38.214 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:38.210+0000 7fee877fe640 1 --2- 172.21.15.73:0/1902112172 >> v2:172.21.15.142:3300/0 conn(0x7fee881529a0 0x7fee880a8880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:38.215 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:38.210+0000 7fee877fe640 1 -- 172.21.15.73:0/1902112172 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee880c1aa0 con 0x7fee8814c190 2023-12-12T09:47:38.215 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:38.210+0000 7fee877fe640 1 -- 172.21.15.73:0/1902112172 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3186547832 0 0) 0x7fee7c001670 con 0x7fee8814c190 2023-12-12T09:47:38.215 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:38.211+0000 7fee877fe640 1 -- 172.21.15.73:0/1902112172 >> v1:172.21.15.73:6789/0 conn(0x7fee8814c190 legacy=0x7fee881555c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:38.215 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:38.211+0000 7fee877fe640 1 --2- 172.21.15.73:0/1902112172 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fee70003970 0x7fee70003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:38.215 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:38.211+0000 7fee877fe640 1 --2- 172.21.15.73:0/1902112172 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fee880a4d00 0x7fee700047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:38.215 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:38.211+0000 7fee877fe640 1 --2- 172.21.15.73:0/1902112172 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fee70004d00 0x7fee70005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:38.215 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:38.211+0000 7fee877fe640 1 -- 172.21.15.73:0/1902112172 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee880c1890 con 0x7fee70004d00 2023-12-12T09:47:38.215 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:38.211+0000 7fee877fe640 1 -- 172.21.15.73:0/1902112172 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee88151fd0 con 0x7fee70003970 2023-12-12T09:47:38.215 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:38.211+0000 7fee877fe640 1 -- 172.21.15.73:0/1902112172 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee7000b980 con 0x7fee880a4d00 2023-12-12T09:47:38.216 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:38.211+0000 7fee8d7fe640 1 --2- 172.21.15.73:0/1902112172 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fee70004d00 0x7fee70005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:38.216 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:38.211+0000 7fee8cffd640 1 --2- 172.21.15.73:0/1902112172 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fee70003970 0x7fee70003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:38.216 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:38.211+0000 7fee87fff640 1 --2- 172.21.15.73:0/1902112172 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fee880a4d00 0x7fee700047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:38.216 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:38.211+0000 7fee8d7fe640 1 -- 172.21.15.73:0/1902112172 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fee880a4d00 msgr2=0x7fee700047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:47:38.216 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:38.211+0000 7fee8d7fe640 1 --2- 172.21.15.73:0/1902112172 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fee880a4d00 0x7fee700047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:38.216 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:38.211+0000 7fee8d7fe640 1 -- 172.21.15.73:0/1902112172 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fee70003970 msgr2=0x7fee70003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:47:38.216 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:38.211+0000 7fee8d7fe640 1 --2- 172.21.15.73:0/1902112172 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fee70003970 0x7fee70003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:38.216 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:38.211+0000 7fee8d7fe640 1 -- 172.21.15.73:0/1902112172 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee70003520 con 0x7fee70004d00 2023-12-12T09:47:38.216 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:38.211+0000 7fee87fff640 1 --2- 172.21.15.73:0/1902112172 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fee880a4d00 0x7fee700047c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:47:38.220 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:38.213+0000 7fee8d7fe640 1 --2- 172.21.15.73:0/1902112172 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fee70004d00 0x7fee70005180 secure :-1 s=READY pgs=1174 cs=0 l=1 rev1=1 crypto rx=0x7fee80009fc0 tx=0x7fee700057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18f28e9bd5176856 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:47:38.220 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:38.213+0000 7fee877fe640 1 -- 172.21.15.73:0/1902112172 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee8002cc60 con 0x7fee70004d00 2023-12-12T09:47:38.220 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:38.213+0000 7fee877fe640 1 -- 172.21.15.73:0/1902112172 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee8000f040 con 0x7fee70004d00 2023-12-12T09:47:38.220 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:38.213+0000 7fee877fe640 1 -- 172.21.15.73:0/1902112172 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee80034440 con 0x7fee70004d00 2023-12-12T09:47:38.220 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:38.213+0000 7fee8dfff640 1 -- 172.21.15.73:0/1902112172 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fee70004d00 msgr2=0x7fee70005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:38.220 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:38.213+0000 7fee8dfff640 1 --2- 172.21.15.73:0/1902112172 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fee70004d00 0x7fee70005180 secure :-1 s=READY pgs=1174 cs=0 l=1 rev1=1 crypto rx=0x7fee80009fc0 tx=0x7fee700057f0 comp rx=0 tx=0).stop 2023-12-12T09:47:38.220 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:38.213+0000 7fee8d7fe640 1 -- 172.21.15.73:0/1902112172 reap_dead start 2023-12-12T09:47:38.220 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:38.214+0000 7fee8dfff640 1 -- 172.21.15.73:0/1902112172 shutdown_connections 2023-12-12T09:47:38.221 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:38.214+0000 7fee8dfff640 1 -- 172.21.15.73:0/1902112172 >> 172.21.15.73:0/1902112172 conn(0x7fee8806a4e0 msgr2=0x7fee8806a8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:47:38.221 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:38.214+0000 7fee8dfff640 1 -- 172.21.15.73:0/1902112172 shutdown_connections 2023-12-12T09:47:38.221 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:38.214+0000 7fee8dfff640 1 -- 172.21.15.73:0/1902112172 wait complete. 2023-12-12T09:47:38.221 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:38.215+0000 7fee8dfff640 1 Processor -- start 2023-12-12T09:47:38.221 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:38.216+0000 7fee8dfff640 1 -- start start 2023-12-12T09:47:38.221 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:38.216+0000 7fee8dfff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fee70004d00 0x7fee880a64a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:38.221 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:38.216+0000 7fee8dfff640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fee881460c0 0x7fee88144ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:38.221 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:38.217+0000 7fee8dfff640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fee88145b70 0x7fee88145010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:38.221 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:38.217+0000 7fee8dfff640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee88145a10 con 0x7fee70004d00 2023-12-12T09:47:38.221 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:38.217+0000 7fee8dfff640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee881ea170 con 0x7fee881460c0 2023-12-12T09:47:38.222 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:38.217+0000 7fee8dfff640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee88145730 con 0x7fee88145b70 2023-12-12T09:47:38.222 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:38.217+0000 7fee8cffd640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fee70004d00 0x7fee880a64a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:38.222 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:38.217+0000 7fee8cffd640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fee70004d00 0x7fee880a64a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:60398/0 (socket says 172.21.15.73:60398) 2023-12-12T09:47:38.222 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:38.217+0000 7fee8cffd640 1 -- 172.21.15.73:0/2140353906 learned_addr learned my addr 172.21.15.73:0/2140353906 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:47:38.222 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:38.217+0000 7fee8cffd640 1 -- 172.21.15.73:0/2140353906 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fee88145b70 msgr2=0x7fee88145010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:38.222 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:38.217+0000 7fee87fff640 1 --2- 172.21.15.73:0/2140353906 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fee881460c0 0x7fee88144ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:38.222 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:38.217+0000 7fee8cffd640 1 --2- 172.21.15.73:0/2140353906 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fee88145b70 0x7fee88145010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:38.222 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:38.217+0000 7fee8cffd640 1 -- 172.21.15.73:0/2140353906 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fee881460c0 msgr2=0x7fee88144ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:38.223 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:38.217+0000 7fee8cffd640 1 --2- 172.21.15.73:0/2140353906 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fee881460c0 0x7fee88144ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:38.223 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:38.217+0000 7fee8cffd640 1 -- 172.21.15.73:0/2140353906 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee881ee0f0 con 0x7fee70004d00 2023-12-12T09:47:38.223 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:38.218+0000 7fee8cffd640 1 --2- 172.21.15.73:0/2140353906 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fee70004d00 0x7fee880a64a0 secure :-1 s=READY pgs=1175 cs=0 l=1 rev1=1 crypto rx=0x7fee7c00e870 tx=0x7fee7c00ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:47:38.223 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:38.218+0000 7fee857fa640 1 -- 172.21.15.73:0/2140353906 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee7c00c850 con 0x7fee70004d00 2023-12-12T09:47:38.223 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:38.218+0000 7fee857fa640 1 -- 172.21.15.73:0/2140353906 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee7c00c9d0 con 0x7fee70004d00 2023-12-12T09:47:38.223 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:38.218+0000 7fee857fa640 1 -- 172.21.15.73:0/2140353906 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee7c00cd80 con 0x7fee70004d00 2023-12-12T09:47:38.223 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:38.218+0000 7fee8dfff640 1 -- 172.21.15.73:0/2140353906 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee881ee3d0 con 0x7fee70004d00 2023-12-12T09:47:38.223 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:38.218+0000 7fee8dfff640 1 -- 172.21.15.73:0/2140353906 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee88154670 con 0x7fee70004d00 2023-12-12T09:47:38.225 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:38.219+0000 7fee8dfff640 1 -- 172.21.15.73:0/2140353906 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fee8806b050 con 0x7fee70004d00 2023-12-12T09:47:38.225 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:38.220+0000 7fee857fa640 1 -- 172.21.15.73:0/2140353906 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fee7c013420 con 0x7fee70004d00 2023-12-12T09:47:38.225 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:38.221+0000 7fee857fa640 1 --2- 172.21.15.73:0/2140353906 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fee7406ae70 0x7fee7406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:38.225 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:38.221+0000 7fee857fa640 1 -- 172.21.15.73:0/2140353906 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 5029+0+0 (secure 0 0 0) 0x7fee7c088fe0 con 0x7fee70004d00 2023-12-12T09:47:38.225 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:38.221+0000 7fee87fff640 1 --2- 172.21.15.73:0/2140353906 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fee7406ae70 0x7fee7406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:38.225 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:38.221+0000 7fee857fa640 1 --2- 172.21.15.73:0/2140353906 >> [v2:172.21.15.142:6817/2353193632,v1:172.21.15.142:6819/2353193632] conn(0x7fee74070d70 0x7fee74073190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:38.225 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:38.221+0000 7fee857fa640 1 -- 172.21.15.73:0/2140353906 --> [v2:172.21.15.142:6817/2353193632,v1:172.21.15.142:6819/2353193632] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fee74073840 con 0x7fee74070d70 2023-12-12T09:47:38.225 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:38.221+0000 7fee857fa640 1 -- 172.21.15.73:0/2140353906 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_get_version_reply(handle=1 version=87) v2 ==== 24+0+0 (secure 0 0 0) 0x7fee7c08b6a0 con 0x7fee70004d00 2023-12-12T09:47:38.226 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:38.222+0000 7fee87fff640 1 --2- 172.21.15.73:0/2140353906 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fee7406ae70 0x7fee7406d330 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7fee8814faa0 tx=0x7fee78008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:47:38.226 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:38.222+0000 7fee8d7fe640 1 --2- 172.21.15.73:0/2140353906 >> [v2:172.21.15.142:6817/2353193632,v1:172.21.15.142:6819/2353193632] conn(0x7fee74070d70 0x7fee74073190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:38.226 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:38.223+0000 7fee8d7fe640 1 --2- 172.21.15.73:0/2140353906 >> [v2:172.21.15.142:6817/2353193632,v1:172.21.15.142:6819/2353193632] conn(0x7fee74070d70 0x7fee74073190 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:47:38.226 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:38.225+0000 7fee857fa640 1 -- 172.21.15.73:0/2140353906 <== osd.5 v2:172.21.15.142:6817/2353193632 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7fee74073840 con 0x7fee74070d70 2023-12-12T09:47:38.241 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:38.239+0000 7fee8dfff640 1 -- 172.21.15.73:0/2140353906 --> [v2:172.21.15.142:6817/2353193632,v1:172.21.15.142:6819/2353193632] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fee881e9fd0 con 0x7fee74070d70 2023-12-12T09:47:38.242 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2023-12-12T09:47:38.242 INFO:teuthology.orchestra.run.smithi073.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2023-12-12T09:47:38.242 INFO:teuthology.orchestra.run.smithi073.stdout:} 2023-12-12T09:47:38.244 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:38.240+0000 7fee857fa640 1 -- 172.21.15.73:0/2140353906 <== osd.5 v2:172.21.15.142:6817/2353193632 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7fee8002db10 con 0x7fee74070d70 2023-12-12T09:47:38.244 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:38.241+0000 7fee8dfff640 1 -- 172.21.15.73:0/2140353906 >> [v2:172.21.15.142:6817/2353193632,v1:172.21.15.142:6819/2353193632] conn(0x7fee74070d70 msgr2=0x7fee74073190 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:38.244 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:38.241+0000 7fee8dfff640 1 --2- 172.21.15.73:0/2140353906 >> [v2:172.21.15.142:6817/2353193632,v1:172.21.15.142:6819/2353193632] conn(0x7fee74070d70 0x7fee74073190 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:38.244 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:38.241+0000 7fee8dfff640 1 -- 172.21.15.73:0/2140353906 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fee7406ae70 msgr2=0x7fee7406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:38.244 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:38.241+0000 7fee8dfff640 1 --2- 172.21.15.73:0/2140353906 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fee7406ae70 0x7fee7406d330 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7fee8814faa0 tx=0x7fee78008040 comp rx=0 tx=0).stop 2023-12-12T09:47:38.244 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:38.241+0000 7fee8dfff640 1 -- 172.21.15.73:0/2140353906 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fee70004d00 msgr2=0x7fee880a64a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:38.244 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:38.241+0000 7fee8dfff640 1 --2- 172.21.15.73:0/2140353906 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fee70004d00 0x7fee880a64a0 secure :-1 s=READY pgs=1175 cs=0 l=1 rev1=1 crypto rx=0x7fee7c00e870 tx=0x7fee7c00ed30 comp rx=0 tx=0).stop 2023-12-12T09:47:38.244 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:38.241+0000 7fee8d7fe640 1 -- 172.21.15.73:0/2140353906 reap_dead start 2023-12-12T09:47:38.245 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:38.241+0000 7fee8dfff640 1 -- 172.21.15.73:0/2140353906 shutdown_connections 2023-12-12T09:47:38.245 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:38.241+0000 7fee8dfff640 1 -- 172.21.15.73:0/2140353906 >> 172.21.15.73:0/2140353906 conn(0x7fee8806a4e0 msgr2=0x7fee880bf490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:47:38.245 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:38.241+0000 7fee8dfff640 1 -- 172.21.15.73:0/2140353906 shutdown_connections 2023-12-12T09:47:38.245 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:38.241+0000 7fee8dfff640 1 -- 172.21.15.73:0/2140353906 wait complete. 2023-12-12T09:47:38.260 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2023-12-12T09:47:38.469 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:38.467+0000 7fa136c27640 1 Processor -- start 2023-12-12T09:47:38.469 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:38.467+0000 7fa136c27640 1 -- start start 2023-12-12T09:47:38.470 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:38.468+0000 7fa136c27640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fa1300aa360 0x7fa1301546d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:38.470 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:38.468+0000 7fa136c27640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1300a5350 con 0x7fa1300c1f20 2023-12-12T09:47:38.470 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:38.468+0000 7fa136c27640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1300a5070 con 0x7fa13014b240 2023-12-12T09:47:38.471 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:38.468+0000 7fa136c27640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa13014b620 con 0x7fa1300aa360 2023-12-12T09:47:38.471 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:38.469+0000 7fa136426640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7fa1300c1f20 0x7fa130154c10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:54678/0 (socket says 172.21.15.73:54678) 2023-12-12T09:47:38.471 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:38.469+0000 7fa136426640 1 -- 172.21.15.73:0/1483496077 learned_addr learned my addr 172.21.15.73:0/1483496077 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-12T09:47:38.473 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:38.469+0000 7fa134c23640 1 -- 172.21.15.73:0/1483496077 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3012532670 0 0) 0x7fa1300a5350 con 0x7fa1300c1f20 2023-12-12T09:47:38.473 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:38.469+0000 7fa135424640 1 --2- 172.21.15.73:0/1483496077 >> v2:172.21.15.142:3300/0 conn(0x7fa1300aa360 0x7fa1301546d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:38.473 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:38.469+0000 7fa134c23640 1 -- 172.21.15.73:0/1483496077 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa120003520 con 0x7fa1300c1f20 2023-12-12T09:47:38.474 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:38.469+0000 7fa134c23640 1 -- 172.21.15.73:0/1483496077 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2970772930 0 0) 0x7fa120003520 con 0x7fa1300c1f20 2023-12-12T09:47:38.474 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:38.469+0000 7fa134c23640 1 -- 172.21.15.73:0/1483496077 >> v2:172.21.15.142:3300/0 conn(0x7fa1300aa360 msgr2=0x7fa1301546d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:47:38.474 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:38.469+0000 7fa134c23640 1 --2- 172.21.15.73:0/1483496077 >> v2:172.21.15.142:3300/0 conn(0x7fa1300aa360 0x7fa1301546d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:38.474 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:38.470+0000 7fa134c23640 1 -- 172.21.15.73:0/1483496077 >> v1:172.21.15.142:6789/0 conn(0x7fa13014b240 legacy=0x7fa1300a9c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:47:38.474 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:38.470+0000 7fa134c23640 1 -- 172.21.15.73:0/1483496077 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1300c0d80 con 0x7fa1300c1f20 2023-12-12T09:47:38.474 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:38.470+0000 7fa134c23640 1 -- 172.21.15.73:0/1483496077 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3186547832 0 0) 0x7fa128001670 con 0x7fa1300c1f20 2023-12-12T09:47:38.474 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:38.470+0000 7fa134c23640 1 -- 172.21.15.73:0/1483496077 >> v1:172.21.15.73:6789/0 conn(0x7fa1300c1f20 legacy=0x7fa130154c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:38.474 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:38.470+0000 7fa134c23640 1 --2- 172.21.15.73:0/1483496077 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa120003970 0x7fa120003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:38.475 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:38.470+0000 7fa134c23640 1 --2- 172.21.15.73:0/1483496077 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa1200047c0 0x7fa120004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:38.475 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:38.470+0000 7fa134c23640 1 --2- 172.21.15.73:0/1483496077 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa120005180 0x7fa12000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:38.475 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:38.470+0000 7fa134c23640 1 -- 172.21.15.73:0/1483496077 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa13014b620 con 0x7fa1200047c0 2023-12-12T09:47:38.475 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:38.470+0000 7fa134c23640 1 -- 172.21.15.73:0/1483496077 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa12000c120 con 0x7fa120005180 2023-12-12T09:47:38.475 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:38.470+0000 7fa134c23640 1 -- 172.21.15.73:0/1483496077 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa12000c2e0 con 0x7fa120003970 2023-12-12T09:47:38.475 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:38.470+0000 7fa135424640 1 --2- 172.21.15.73:0/1483496077 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa1200047c0 0x7fa120004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:38.475 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:38.470+0000 7fa136426640 1 --2- 172.21.15.73:0/1483496077 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa120005180 0x7fa12000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:38.475 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:38.470+0000 7fa135424640 1 -- 172.21.15.73:0/1483496077 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa120003970 msgr2=0x7fa120003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:47:38.475 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:38.470+0000 7fa135424640 1 --2- 172.21.15.73:0/1483496077 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa120003970 0x7fa120003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:38.476 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:38.470+0000 7fa135424640 1 -- 172.21.15.73:0/1483496077 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa120005180 msgr2=0x7fa12000b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:47:38.476 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:38.470+0000 7fa135424640 1 --2- 172.21.15.73:0/1483496077 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa120005180 0x7fa12000b980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:38.476 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:38.470+0000 7fa135424640 1 -- 172.21.15.73:0/1483496077 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa120003520 con 0x7fa1200047c0 2023-12-12T09:47:38.476 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:38.470+0000 7fa136426640 1 -- 172.21.15.73:0/1483496077 reap_dead start 2023-12-12T09:47:38.476 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:38.472+0000 7fa135424640 1 --2- 172.21.15.73:0/1483496077 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa1200047c0 0x7fa120004c40 secure :-1 s=READY pgs=1177 cs=0 l=1 rev1=1 crypto rx=0x7fa11c006ad0 tx=0x7fa1200057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0fdf4311d606be7 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:47:38.476 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:38.472+0000 7fa134c23640 1 -- 172.21.15.73:0/1483496077 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa11c02c970 con 0x7fa1200047c0 2023-12-12T09:47:38.476 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:38.472+0000 7fa134c23640 1 -- 172.21.15.73:0/1483496077 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa11c030070 con 0x7fa1200047c0 2023-12-12T09:47:38.476 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:38.472+0000 7fa134c23640 1 -- 172.21.15.73:0/1483496077 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa11c02cd30 con 0x7fa1200047c0 2023-12-12T09:47:38.479 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:38.472+0000 7fa136c27640 1 -- 172.21.15.73:0/1483496077 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa1200047c0 msgr2=0x7fa120004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:38.479 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:38.472+0000 7fa136c27640 1 --2- 172.21.15.73:0/1483496077 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa1200047c0 0x7fa120004c40 secure :-1 s=READY pgs=1177 cs=0 l=1 rev1=1 crypto rx=0x7fa11c006ad0 tx=0x7fa1200057f0 comp rx=0 tx=0).stop 2023-12-12T09:47:38.479 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:38.472+0000 7fa136c27640 1 -- 172.21.15.73:0/1483496077 shutdown_connections 2023-12-12T09:47:38.479 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:38.472+0000 7fa136c27640 1 --2- 172.21.15.73:0/1483496077 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa1200047c0 0x7fa120004c40 unknown :-1 s=CLOSED pgs=1177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:38.479 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:38.472+0000 7fa136c27640 1 -- 172.21.15.73:0/1483496077 >> 172.21.15.73:0/1483496077 conn(0x7fa1300a75f0 msgr2=0x7fa1300a7a00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:47:38.480 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:38.473+0000 7fa136c27640 1 -- 172.21.15.73:0/1483496077 shutdown_connections 2023-12-12T09:47:38.480 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:38.473+0000 7fa136c27640 1 -- 172.21.15.73:0/1483496077 wait complete. 2023-12-12T09:47:38.480 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:38.474+0000 7fa136c27640 1 Processor -- start 2023-12-12T09:47:38.480 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:38.474+0000 7fa136c27640 1 -- start start 2023-12-12T09:47:38.480 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:38.475+0000 7fa136c27640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa1200047c0 0x7fa13006cef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:38.480 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:38.475+0000 7fa136c27640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa130143fd0 0x7fa1301e9080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:38.480 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:38.475+0000 7fa136c27640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa1301e95c0 0x7fa130149ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:38.480 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:38.475+0000 7fa136c27640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa13014bfe0 con 0x7fa1301e95c0 2023-12-12T09:47:38.481 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:38.475+0000 7fa136c27640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa130154420 con 0x7fa1200047c0 2023-12-12T09:47:38.481 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:38.475+0000 7fa136c27640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa13014c230 con 0x7fa130143fd0 2023-12-12T09:47:38.481 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:38.475+0000 7fa136426640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa1301e95c0 0x7fa130149ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:38.481 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:38.476+0000 7fa136426640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa1301e95c0 0x7fa130149ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:60414/0 (socket says 172.21.15.73:60414) 2023-12-12T09:47:38.481 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:38.476+0000 7fa136426640 1 -- 172.21.15.73:0/1557875222 learned_addr learned my addr 172.21.15.73:0/1557875222 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:47:38.481 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:38.476+0000 7fa136426640 1 -- 172.21.15.73:0/1557875222 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa130143fd0 msgr2=0x7fa1301e9080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:38.481 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:38.476+0000 7fa135424640 1 --2- 172.21.15.73:0/1557875222 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa130143fd0 0x7fa1301e9080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:38.481 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:38.476+0000 7fa136426640 1 --2- 172.21.15.73:0/1557875222 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa130143fd0 0x7fa1301e9080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:38.482 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:38.476+0000 7fa135c25640 1 --2- 172.21.15.73:0/1557875222 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa1200047c0 0x7fa13006cef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:38.482 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:38.476+0000 7fa136426640 1 -- 172.21.15.73:0/1557875222 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa1200047c0 msgr2=0x7fa13006cef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:38.482 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:38.476+0000 7fa136426640 1 --2- 172.21.15.73:0/1557875222 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa1200047c0 0x7fa13006cef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:38.482 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:38.476+0000 7fa136426640 1 -- 172.21.15.73:0/1557875222 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa13014c510 con 0x7fa1301e95c0 2023-12-12T09:47:38.482 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:38.476+0000 7fa135c25640 1 --2- 172.21.15.73:0/1557875222 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa1200047c0 0x7fa13006cef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:47:38.482 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:38.476+0000 7fa136426640 1 --2- 172.21.15.73:0/1557875222 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa1301e95c0 0x7fa130149ab0 secure :-1 s=READY pgs=1178 cs=0 l=1 rev1=1 crypto rx=0x7fa13006e160 tx=0x7fa12800d950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:47:38.482 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:38.476+0000 7fa12e7fc640 1 -- 172.21.15.73:0/1557875222 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa128007440 con 0x7fa1301e95c0 2023-12-12T09:47:38.482 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:38.476+0000 7fa12e7fc640 1 -- 172.21.15.73:0/1557875222 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1280075a0 con 0x7fa1301e95c0 2023-12-12T09:47:38.483 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:38.476+0000 7fa12e7fc640 1 -- 172.21.15.73:0/1557875222 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa128004a20 con 0x7fa1301e95c0 2023-12-12T09:47:38.483 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:38.476+0000 7fa136c27640 1 -- 172.21.15.73:0/1557875222 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa130153dd0 con 0x7fa1301e95c0 2023-12-12T09:47:38.483 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:38.477+0000 7fa136c27640 1 -- 172.21.15.73:0/1557875222 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa13006d430 con 0x7fa1301e95c0 2023-12-12T09:47:38.484 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:38.478+0000 7fa136c27640 1 -- 172.21.15.73:0/1557875222 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa130067400 con 0x7fa1301e95c0 2023-12-12T09:47:38.484 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:38.479+0000 7fa12e7fc640 1 -- 172.21.15.73:0/1557875222 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fa128004b80 con 0x7fa1301e95c0 2023-12-12T09:47:38.484 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:38.480+0000 7fa12e7fc640 1 --2- 172.21.15.73:0/1557875222 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fa11406ae70 0x7fa11406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:38.484 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:38.480+0000 7fa12e7fc640 1 -- 172.21.15.73:0/1557875222 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 5029+0+0 (secure 0 0 0) 0x7fa128088a70 con 0x7fa1301e95c0 2023-12-12T09:47:38.484 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:38.480+0000 7fa135c25640 1 --2- 172.21.15.73:0/1557875222 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fa11406ae70 0x7fa11406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:38.484 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:38.481+0000 7fa135c25640 1 --2- 172.21.15.73:0/1557875222 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fa11406ae70 0x7fa11406d330 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7fa124001cd0 tx=0x7fa124009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:47:38.486 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:38.485+0000 7fa12e7fc640 1 -- 172.21.15.73:0/1557875222 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fa128053db0 con 0x7fa1301e95c0 2023-12-12T09:47:38.676 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:38.674+0000 7fa136c27640 1 -- 172.21.15.73:0/1557875222 --> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) v1 -- 0x7fa1300c1340 con 0x7fa11406ae70 2023-12-12T09:47:38.677 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:38.675+0000 7fa12e7fc640 1 -- 172.21.15.73:0/1557875222 <== mgr.4110 v2:172.21.15.73:6832/779985841 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fa124006b50 con 0x7fa11406ae70 2023-12-12T09:47:38.677 INFO:teuthology.orchestra.run.smithi073.stderr:instructed osd(s) 5 to deep-scrub 2023-12-12T09:47:38.680 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:38.678+0000 7fa136c27640 1 -- 172.21.15.73:0/1557875222 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fa11406ae70 msgr2=0x7fa11406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:38.680 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:38.678+0000 7fa136c27640 1 --2- 172.21.15.73:0/1557875222 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fa11406ae70 0x7fa11406d330 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7fa124001cd0 tx=0x7fa124009040 comp rx=0 tx=0).stop 2023-12-12T09:47:38.680 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:38.678+0000 7fa136c27640 1 -- 172.21.15.73:0/1557875222 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa1301e95c0 msgr2=0x7fa130149ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:38.680 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:38.678+0000 7fa136c27640 1 --2- 172.21.15.73:0/1557875222 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa1301e95c0 0x7fa130149ab0 secure :-1 s=READY pgs=1178 cs=0 l=1 rev1=1 crypto rx=0x7fa13006e160 tx=0x7fa12800d950 comp rx=0 tx=0).stop 2023-12-12T09:47:38.681 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:38.678+0000 7fa136c27640 1 -- 172.21.15.73:0/1557875222 shutdown_connections 2023-12-12T09:47:38.681 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:38.678+0000 7fa136c27640 1 --2- 172.21.15.73:0/1557875222 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fa11406ae70 0x7fa11406d330 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:38.681 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:38.678+0000 7fa136c27640 1 --2- 172.21.15.73:0/1557875222 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa1301e95c0 0x7fa130149ab0 unknown :-1 s=CLOSED pgs=1178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:38.681 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:38.678+0000 7fa136c27640 1 --2- 172.21.15.73:0/1557875222 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa130143fd0 0x7fa1301e9080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:38.681 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:38.678+0000 7fa136c27640 1 --2- 172.21.15.73:0/1557875222 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa1200047c0 0x7fa13006cef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:38.681 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:38.678+0000 7fa136c27640 1 -- 172.21.15.73:0/1557875222 >> 172.21.15.73:0/1557875222 conn(0x7fa1300a75f0 msgr2=0x7fa1300c4840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:47:38.681 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:38.678+0000 7fa136c27640 1 -- 172.21.15.73:0/1557875222 shutdown_connections 2023-12-12T09:47:38.681 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:38.678+0000 7fa136c27640 1 -- 172.21.15.73:0/1557875222 wait complete. 2023-12-12T09:47:38.698 INFO:tasks.ceph:Scrubbing osd.6 2023-12-12T09:47:38.699 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2023-12-12T09:47:38.919 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:38.918+0000 7fa905db6640 1 Processor -- start 2023-12-12T09:47:38.920 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:38.918+0000 7fa905db6640 1 -- start start 2023-12-12T09:47:38.921 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:38.919+0000 7fa905db6640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa90006d350 0x7fa90006dc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:38.921 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:38.919+0000 7fa905db6640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9000c16c0 con 0x7fa90014f8c0 2023-12-12T09:47:38.921 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:38.919+0000 7fa905db6640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9000c19a0 con 0x7fa900152500 2023-12-12T09:47:38.921 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:38.919+0000 7fa905db6640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9000c1090 con 0x7fa90006d350 2023-12-12T09:47:38.922 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:38.920+0000 7fa8ff7fe640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7fa90014f8c0 0x7fa900071e60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:38010/0 (socket says 172.21.15.73:38010) 2023-12-12T09:47:38.922 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:38.920+0000 7fa8ff7fe640 1 -- 172.21.15.73:0/918478639 learned_addr learned my addr 172.21.15.73:0/918478639 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-12T09:47:38.923 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:38.920+0000 7fa8fe7fc640 1 -- 172.21.15.73:0/918478639 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1599149733 0 0) 0x7fa9000c16c0 con 0x7fa90014f8c0 2023-12-12T09:47:38.923 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:38.920+0000 7fa8feffd640 1 --2- 172.21.15.73:0/918478639 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa90006d350 0x7fa90006dc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:38.923 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:38.920+0000 7fa8fe7fc640 1 -- 172.21.15.73:0/918478639 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa8e8003520 con 0x7fa90014f8c0 2023-12-12T09:47:38.924 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:38.920+0000 7fa8fe7fc640 1 -- 172.21.15.73:0/918478639 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1726808049 0 0) 0x7fa8e8003520 con 0x7fa90014f8c0 2023-12-12T09:47:38.924 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:38.920+0000 7fa8fe7fc640 1 -- 172.21.15.73:0/918478639 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa90006d350 msgr2=0x7fa90006dc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:47:38.924 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:38.920+0000 7fa8fe7fc640 1 --2- 172.21.15.73:0/918478639 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa90006d350 0x7fa90006dc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:38.924 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:38.920+0000 7fa8fe7fc640 1 -- 172.21.15.73:0/918478639 >> v1:172.21.15.142:6789/0 conn(0x7fa900152500 legacy=0x7fa900152990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:38.924 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:38.921+0000 7fa8fe7fc640 1 -- 172.21.15.73:0/918478639 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9000c1c80 con 0x7fa90014f8c0 2023-12-12T09:47:38.924 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:38.921+0000 7fa8fe7fc640 1 -- 172.21.15.73:0/918478639 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3186547832 0 0) 0x7fa8f0001670 con 0x7fa90014f8c0 2023-12-12T09:47:38.924 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:38.921+0000 7fa8feffd640 1 --2- 172.21.15.73:0/918478639 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa90006d350 0x7fa90006dc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-12T09:47:38.924 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:38.921+0000 7fa8fe7fc640 1 -- 172.21.15.73:0/918478639 >> v1:172.21.15.73:6789/0 conn(0x7fa90014f8c0 legacy=0x7fa900071e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:38.925 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:38.921+0000 7fa8fe7fc640 1 --2- 172.21.15.73:0/918478639 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa8e80039a0 0x7fa8e8003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:38.925 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:38.921+0000 7fa8fe7fc640 1 --2- 172.21.15.73:0/918478639 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa90006d350 0x7fa8e80047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:38.925 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:38.921+0000 7fa8fe7fc640 1 --2- 172.21.15.73:0/918478639 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa8e8004d00 0x7fa8e8005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:38.925 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:38.921+0000 7fa8fe7fc640 1 -- 172.21.15.73:0/918478639 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8e800ba60 con 0x7fa8e8004d00 2023-12-12T09:47:38.925 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:38.921+0000 7fa8fe7fc640 1 -- 172.21.15.73:0/918478639 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8e800bbd0 con 0x7fa8e80039a0 2023-12-12T09:47:38.925 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:38.921+0000 7fa8fe7fc640 1 -- 172.21.15.73:0/918478639 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8e800bd90 con 0x7fa90006d350 2023-12-12T09:47:38.925 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:38.921+0000 7fa8fffff640 1 --2- 172.21.15.73:0/918478639 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa8e8004d00 0x7fa8e8005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:38.925 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:38.921+0000 7fa8ff7fe640 1 --2- 172.21.15.73:0/918478639 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa8e80039a0 0x7fa8e8003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:38.925 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:38.921+0000 7fa8fffff640 1 -- 172.21.15.73:0/918478639 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa90006d350 msgr2=0x7fa8e80047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:47:38.926 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:38.921+0000 7fa8fffff640 1 --2- 172.21.15.73:0/918478639 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa90006d350 0x7fa8e80047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:38.926 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:38.921+0000 7fa8fffff640 1 -- 172.21.15.73:0/918478639 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa8e80039a0 msgr2=0x7fa8e8003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:47:38.926 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:38.921+0000 7fa8fffff640 1 --2- 172.21.15.73:0/918478639 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa8e80039a0 0x7fa8e8003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:38.926 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:38.921+0000 7fa8fffff640 1 -- 172.21.15.73:0/918478639 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8e8003520 con 0x7fa8e8004d00 2023-12-12T09:47:38.927 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:38.922+0000 7fa8fffff640 1 --2- 172.21.15.73:0/918478639 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa8e8004d00 0x7fa8e8005180 secure :-1 s=READY pgs=1180 cs=0 l=1 rev1=1 crypto rx=0x7fa8f8001e20 tx=0x7fa8e80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2da6bc28047b8db0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:47:38.927 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:38.923+0000 7fa8fe7fc640 1 -- 172.21.15.73:0/918478639 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8f8003b70 con 0x7fa8e8004d00 2023-12-12T09:47:38.927 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:38.923+0000 7fa8fe7fc640 1 -- 172.21.15.73:0/918478639 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8f8003cd0 con 0x7fa8e8004d00 2023-12-12T09:47:38.928 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:38.923+0000 7fa8fe7fc640 1 -- 172.21.15.73:0/918478639 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8f8005310 con 0x7fa8e8004d00 2023-12-12T09:47:38.928 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:38.923+0000 7fa905db6640 1 -- 172.21.15.73:0/918478639 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa8e8004d00 msgr2=0x7fa8e8005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:38.928 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:38.923+0000 7fa905db6640 1 --2- 172.21.15.73:0/918478639 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa8e8004d00 0x7fa8e8005180 secure :-1 s=READY pgs=1180 cs=0 l=1 rev1=1 crypto rx=0x7fa8f8001e20 tx=0x7fa8e80057f0 comp rx=0 tx=0).stop 2023-12-12T09:47:38.928 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:38.923+0000 7fa8fffff640 1 -- 172.21.15.73:0/918478639 reap_dead start 2023-12-12T09:47:38.928 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:38.923+0000 7fa905db6640 1 -- 172.21.15.73:0/918478639 shutdown_connections 2023-12-12T09:47:38.928 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:38.923+0000 7fa905db6640 1 -- 172.21.15.73:0/918478639 >> 172.21.15.73:0/918478639 conn(0x7fa90006a4e0 msgr2=0x7fa90006a8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:47:38.928 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:38.923+0000 7fa905db6640 1 -- 172.21.15.73:0/918478639 shutdown_connections 2023-12-12T09:47:38.928 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:38.924+0000 7fa905db6640 1 -- 172.21.15.73:0/918478639 wait complete. 2023-12-12T09:47:38.928 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:38.925+0000 7fa905db6640 1 Processor -- start 2023-12-12T09:47:38.928 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:38.925+0000 7fa905db6640 1 -- start start 2023-12-12T09:47:38.930 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:38.926+0000 7fa905db6640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa8e8004d00 0x7fa9000a9560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:38.931 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:38.926+0000 7fa905db6640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa900149120 0x7fa90013ebd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:38.931 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:38.926+0000 7fa905db6640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa90013f110 0x7fa9000aaa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:38.931 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:38.926+0000 7fa905db6640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9000aa5c0 con 0x7fa8e8004d00 2023-12-12T09:47:38.931 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:38.926+0000 7fa905db6640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9000bc010 con 0x7fa90013f110 2023-12-12T09:47:38.931 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:38.926+0000 7fa905db6640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa90013f590 con 0x7fa900149120 2023-12-12T09:47:38.931 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:38.926+0000 7fa8ff7fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa8e8004d00 0x7fa9000a9560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:38.931 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:38.927+0000 7fa8ff7fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa8e8004d00 0x7fa9000a9560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:59220/0 (socket says 172.21.15.73:59220) 2023-12-12T09:47:38.931 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:38.927+0000 7fa8ff7fe640 1 -- 172.21.15.73:0/3520138161 learned_addr learned my addr 172.21.15.73:0/3520138161 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:47:38.932 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:38.927+0000 7fa8fffff640 1 --2- 172.21.15.73:0/3520138161 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa90013f110 0x7fa9000aaa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:38.932 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:38.927+0000 7fa8ff7fe640 1 -- 172.21.15.73:0/3520138161 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa900149120 msgr2=0x7fa90013ebd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:38.932 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:38.927+0000 7fa8feffd640 1 --2- 172.21.15.73:0/3520138161 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa900149120 0x7fa90013ebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:38.932 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:38.927+0000 7fa8ff7fe640 1 --2- 172.21.15.73:0/3520138161 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa900149120 0x7fa90013ebd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:38.932 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:38.927+0000 7fa8ff7fe640 1 -- 172.21.15.73:0/3520138161 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa90013f110 msgr2=0x7fa9000aaa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:38.932 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:38.927+0000 7fa8ff7fe640 1 --2- 172.21.15.73:0/3520138161 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa90013f110 0x7fa9000aaa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:38.932 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:38.927+0000 7fa8ff7fe640 1 -- 172.21.15.73:0/3520138161 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9000ba940 con 0x7fa8e8004d00 2023-12-12T09:47:38.932 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:38.927+0000 7fa8fffff640 1 --2- 172.21.15.73:0/3520138161 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa90013f110 0x7fa9000aaa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:47:38.932 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:38.927+0000 7fa8ff7fe640 1 --2- 172.21.15.73:0/3520138161 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa8e8004d00 0x7fa9000a9560 secure :-1 s=READY pgs=1181 cs=0 l=1 rev1=1 crypto rx=0x7fa8f000e7f0 tx=0x7fa8f000ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:47:38.933 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:38.928+0000 7fa8e7fff640 1 -- 172.21.15.73:0/3520138161 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8f000c8d0 con 0x7fa8e8004d00 2023-12-12T09:47:38.933 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:38.928+0000 7fa8e7fff640 1 -- 172.21.15.73:0/3520138161 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8f000ca30 con 0x7fa8e8004d00 2023-12-12T09:47:38.933 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:38.928+0000 7fa905db6640 1 -- 172.21.15.73:0/3520138161 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9001e8ff0 con 0x7fa8e8004d00 2023-12-12T09:47:38.933 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:38.928+0000 7fa8e7fff640 1 -- 172.21.15.73:0/3520138161 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8f000cdc0 con 0x7fa8e8004d00 2023-12-12T09:47:38.933 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:38.928+0000 7fa905db6640 1 -- 172.21.15.73:0/3520138161 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9000baee0 con 0x7fa8e8004d00 2023-12-12T09:47:38.933 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:38.929+0000 7fa905db6640 1 -- 172.21.15.73:0/3520138161 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fa90014fca0 con 0x7fa8e8004d00 2023-12-12T09:47:38.934 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:38.930+0000 7fa8e7fff640 1 -- 172.21.15.73:0/3520138161 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fa8f001d460 con 0x7fa8e8004d00 2023-12-12T09:47:38.935 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:38.931+0000 7fa8e7fff640 1 --2- 172.21.15.73:0/3520138161 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fa8ec06ae40 0x7fa8ec06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:38.935 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:38.931+0000 7fa8e7fff640 1 -- 172.21.15.73:0/3520138161 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 5029+0+0 (secure 0 0 0) 0x7fa8f0089350 con 0x7fa8e8004d00 2023-12-12T09:47:38.935 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:38.931+0000 7fa8feffd640 1 --2- 172.21.15.73:0/3520138161 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fa8ec06ae40 0x7fa8ec06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:38.935 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:38.931+0000 7fa8e7fff640 1 --2- 172.21.15.73:0/3520138161 >> [v2:172.21.15.142:6804/2006111986,v1:172.21.15.142:6806/2006111986] conn(0x7fa8ec070d40 0x7fa8ec073160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:38.935 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:38.931+0000 7fa8e7fff640 1 -- 172.21.15.73:0/3520138161 --> [v2:172.21.15.142:6804/2006111986,v1:172.21.15.142:6806/2006111986] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fa8ec073810 con 0x7fa8ec070d40 2023-12-12T09:47:38.935 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:38.931+0000 7fa8e7fff640 1 -- 172.21.15.73:0/3520138161 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_get_version_reply(handle=1 version=87) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa8f008ba10 con 0x7fa8e8004d00 2023-12-12T09:47:38.935 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:38.931+0000 7fa8feffd640 1 --2- 172.21.15.73:0/3520138161 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fa8ec06ae40 0x7fa8ec06d300 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7fa9000aa060 tx=0x7fa8f4008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:47:38.935 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:38.931+0000 7fa8fffff640 1 --2- 172.21.15.73:0/3520138161 >> [v2:172.21.15.142:6804/2006111986,v1:172.21.15.142:6806/2006111986] conn(0x7fa8ec070d40 0x7fa8ec073160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:38.935 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:38.932+0000 7fa8fffff640 1 --2- 172.21.15.73:0/3520138161 >> [v2:172.21.15.142:6804/2006111986,v1:172.21.15.142:6806/2006111986] conn(0x7fa8ec070d40 0x7fa8ec073160 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:47:38.936 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:38.935+0000 7fa8e7fff640 1 -- 172.21.15.73:0/3520138161 <== osd.6 v2:172.21.15.142:6804/2006111986 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7fa8ec073810 con 0x7fa8ec070d40 2023-12-12T09:47:38.950 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:38.949+0000 7fa905db6640 1 -- 172.21.15.73:0/3520138161 --> [v2:172.21.15.142:6804/2006111986,v1:172.21.15.142:6806/2006111986] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fa9000aa700 con 0x7fa8ec070d40 2023-12-12T09:47:38.951 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:38.950+0000 7fa8e7fff640 1 -- 172.21.15.73:0/3520138161 <== osd.6 v2:172.21.15.142:6804/2006111986 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7fa8f8001250 con 0x7fa8ec070d40 2023-12-12T09:47:38.952 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2023-12-12T09:47:38.952 INFO:teuthology.orchestra.run.smithi073.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2023-12-12T09:47:38.952 INFO:teuthology.orchestra.run.smithi073.stdout:} 2023-12-12T09:47:38.953 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:38.950+0000 7fa905db6640 1 -- 172.21.15.73:0/3520138161 >> [v2:172.21.15.142:6804/2006111986,v1:172.21.15.142:6806/2006111986] conn(0x7fa8ec070d40 msgr2=0x7fa8ec073160 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:38.953 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:38.950+0000 7fa905db6640 1 --2- 172.21.15.73:0/3520138161 >> [v2:172.21.15.142:6804/2006111986,v1:172.21.15.142:6806/2006111986] conn(0x7fa8ec070d40 0x7fa8ec073160 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:38.953 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:38.950+0000 7fa905db6640 1 -- 172.21.15.73:0/3520138161 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fa8ec06ae40 msgr2=0x7fa8ec06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:38.953 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:38.950+0000 7fa905db6640 1 --2- 172.21.15.73:0/3520138161 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fa8ec06ae40 0x7fa8ec06d300 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7fa9000aa060 tx=0x7fa8f4008040 comp rx=0 tx=0).stop 2023-12-12T09:47:38.953 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:38.950+0000 7fa905db6640 1 -- 172.21.15.73:0/3520138161 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa8e8004d00 msgr2=0x7fa9000a9560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:38.953 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:38.951+0000 7fa905db6640 1 --2- 172.21.15.73:0/3520138161 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa8e8004d00 0x7fa9000a9560 secure :-1 s=READY pgs=1181 cs=0 l=1 rev1=1 crypto rx=0x7fa8f000e7f0 tx=0x7fa8f000ecb0 comp rx=0 tx=0).stop 2023-12-12T09:47:38.954 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:38.951+0000 7fa8fffff640 1 -- 172.21.15.73:0/3520138161 reap_dead start 2023-12-12T09:47:38.954 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:38.951+0000 7fa905db6640 1 -- 172.21.15.73:0/3520138161 shutdown_connections 2023-12-12T09:47:38.954 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:38.951+0000 7fa905db6640 1 -- 172.21.15.73:0/3520138161 >> 172.21.15.73:0/3520138161 conn(0x7fa90006a4e0 msgr2=0x7fa9001528e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:47:38.954 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:38.951+0000 7fa905db6640 1 -- 172.21.15.73:0/3520138161 shutdown_connections 2023-12-12T09:47:38.954 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:38.951+0000 7fa905db6640 1 -- 172.21.15.73:0/3520138161 wait complete. 2023-12-12T09:47:38.968 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2023-12-12T09:47:39.184 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:39.182+0000 7f5309be5640 1 Processor -- start 2023-12-12T09:47:39.184 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:39.183+0000 7f5309be5640 1 -- start start 2023-12-12T09:47:39.185 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:39.184+0000 7f5309be5640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f53040c1a60 0x7f5304151b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:39.186 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:39.184+0000 7f5309be5640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f53040a4f40 0x7f5304154860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:39.186 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:39.184+0000 7f5309be5640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53041589a0 con 0x7f53040c4c10 2023-12-12T09:47:39.186 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:39.184+0000 7f5309be5640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f530406c120 con 0x7f53040a4f40 2023-12-12T09:47:39.186 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:39.184+0000 7f5309be5640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5304157d90 con 0x7f53040c1a60 2023-12-12T09:47:39.187 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:39.185+0000 7f52fbfff640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f53040a4f40 0x7f5304154860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:39.187 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:39.185+0000 7f53037fe640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f53040c1a60 0x7f5304151b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:39.187 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:39.185+0000 7f52fbfff640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f53040a4f40 0x7f5304154860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.73:56648/0 (socket says 172.21.15.73:56648) 2023-12-12T09:47:39.187 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:39.185+0000 7f53037fe640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f53040c1a60 0x7f5304151b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.73:50588/0 (socket says 172.21.15.73:50588) 2023-12-12T09:47:39.187 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:39.185+0000 7f52fbfff640 1 -- 172.21.15.73:0/4069470641 learned_addr learned my addr 172.21.15.73:0/4069470641 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:47:39.188 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:39.186+0000 7f52fbfff640 1 -- 172.21.15.73:0/4069470641 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f53040c1a60 msgr2=0x7f5304151b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:47:39.188 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:39.186+0000 7f52fbfff640 1 --2- 172.21.15.73:0/4069470641 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f53040c1a60 0x7f5304151b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:39.188 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:39.186+0000 7f52fbfff640 1 -- 172.21.15.73:0/4069470641 >> v1:172.21.15.142:6789/0 conn(0x7f53040c4c10 legacy=0x7f5304154da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:39.188 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:39.186+0000 7f52fbfff640 1 -- 172.21.15.73:0/4069470641 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5304158070 con 0x7f53040a4f40 2023-12-12T09:47:39.188 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:39.187+0000 7f52fbfff640 1 --2- 172.21.15.73:0/4069470641 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f53040a4f40 0x7f5304154860 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f52ec009870 tx=0x7f52ec02b860 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ca3d2b19c2bfe1ce server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:47:39.189 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:39.188+0000 7f5302ffd640 1 -- 172.21.15.73:0/4069470641 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52ec0317c0 con 0x7f53040a4f40 2023-12-12T09:47:39.189 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:39.188+0000 7f5302ffd640 1 -- 172.21.15.73:0/4069470641 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52ec031920 con 0x7f53040a4f40 2023-12-12T09:47:39.190 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:39.188+0000 7f5302ffd640 1 -- 172.21.15.73:0/4069470641 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52ec031cb0 con 0x7f53040a4f40 2023-12-12T09:47:39.190 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:39.188+0000 7f5309be5640 1 -- 172.21.15.73:0/4069470641 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f53040a4f40 msgr2=0x7f5304154860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:39.191 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:39.188+0000 7f5309be5640 1 --2- 172.21.15.73:0/4069470641 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f53040a4f40 0x7f5304154860 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f52ec009870 tx=0x7f52ec02b860 comp rx=0 tx=0).stop 2023-12-12T09:47:39.191 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:39.189+0000 7f5309be5640 1 -- 172.21.15.73:0/4069470641 shutdown_connections 2023-12-12T09:47:39.191 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:39.189+0000 7f5309be5640 1 --2- 172.21.15.73:0/4069470641 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f53040a4f40 0x7f5304154860 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:39.191 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:39.189+0000 7f5309be5640 1 --2- 172.21.15.73:0/4069470641 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f53040c1a60 0x7f5304151b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:39.191 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:39.189+0000 7f5309be5640 1 -- 172.21.15.73:0/4069470641 >> 172.21.15.73:0/4069470641 conn(0x7f53040a77d0 msgr2=0x7f53040a7bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:47:39.191 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:39.189+0000 7f5309be5640 1 -- 172.21.15.73:0/4069470641 shutdown_connections 2023-12-12T09:47:39.191 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:39.189+0000 7f5309be5640 1 -- 172.21.15.73:0/4069470641 wait complete. 2023-12-12T09:47:39.192 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:39.190+0000 7f5309be5640 1 Processor -- start 2023-12-12T09:47:39.192 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:39.190+0000 7f5309be5640 1 -- start start 2023-12-12T09:47:39.194 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:39.191+0000 7f5309be5640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f53040a4f40 0x7f53040a9ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:39.194 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:39.191+0000 7f5309be5640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f53040c1a60 0x7f5304070b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:39.194 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:39.191+0000 7f5309be5640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f53040c4c10 0x7f53040a7e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:39.194 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:39.191+0000 7f5309be5640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53040abc10 con 0x7f53040c4c10 2023-12-12T09:47:39.194 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:39.191+0000 7f5309be5640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5304071050 con 0x7f53040c1a60 2023-12-12T09:47:39.194 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:39.191+0000 7f5309be5640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5304071410 con 0x7f53040a4f40 2023-12-12T09:47:39.194 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:39.192+0000 7f5303fff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f53040c4c10 0x7f53040a7e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:39.195 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:39.192+0000 7f5303fff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f53040c4c10 0x7f53040a7e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:59226/0 (socket says 172.21.15.73:59226) 2023-12-12T09:47:39.195 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:39.192+0000 7f5303fff640 1 -- 172.21.15.73:0/3268370394 learned_addr learned my addr 172.21.15.73:0/3268370394 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:47:39.195 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:39.192+0000 7f52fbfff640 1 --2- 172.21.15.73:0/3268370394 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f53040c1a60 0x7f5304070b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:39.195 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:39.192+0000 7f53037fe640 1 --2- 172.21.15.73:0/3268370394 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f53040a4f40 0x7f53040a9ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:39.195 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:39.192+0000 7f5303fff640 1 -- 172.21.15.73:0/3268370394 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f53040a4f40 msgr2=0x7f53040a9ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:39.195 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:39.192+0000 7f5303fff640 1 --2- 172.21.15.73:0/3268370394 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f53040a4f40 0x7f53040a9ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:39.195 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:39.192+0000 7f5303fff640 1 -- 172.21.15.73:0/3268370394 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f53040c1a60 msgr2=0x7f5304070b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:39.195 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:39.192+0000 7f5303fff640 1 --2- 172.21.15.73:0/3268370394 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f53040c1a60 0x7f5304070b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:39.195 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:39.192+0000 7f5303fff640 1 -- 172.21.15.73:0/3268370394 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52ec0094d0 con 0x7f53040c4c10 2023-12-12T09:47:39.196 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:39.193+0000 7f5303fff640 1 --2- 172.21.15.73:0/3268370394 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f53040c4c10 0x7f53040a7e20 secure :-1 s=READY pgs=1182 cs=0 l=1 rev1=1 crypto rx=0x7f52fc00c7d0 tx=0x7f52fc00cc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:47:39.197 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:39.193+0000 7f5300ff9640 1 -- 172.21.15.73:0/3268370394 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52fc003b70 con 0x7f53040c4c10 2023-12-12T09:47:39.197 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:39.193+0000 7f5300ff9640 1 -- 172.21.15.73:0/3268370394 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52fc003cf0 con 0x7f53040c4c10 2023-12-12T09:47:39.197 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:39.193+0000 7f5300ff9640 1 -- 172.21.15.73:0/3268370394 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52fc00aa90 con 0x7f53040c4c10 2023-12-12T09:47:39.197 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:39.193+0000 7f5309be5640 1 -- 172.21.15.73:0/3268370394 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53040716f0 con 0x7f53040c4c10 2023-12-12T09:47:39.197 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:39.193+0000 7f5309be5640 1 -- 172.21.15.73:0/3268370394 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53040ab830 con 0x7f53040c4c10 2023-12-12T09:47:39.197 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:39.194+0000 7f5309be5640 1 -- 172.21.15.73:0/3268370394 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5304070830 con 0x7f53040c4c10 2023-12-12T09:47:39.197 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:39.195+0000 7f5300ff9640 1 -- 172.21.15.73:0/3268370394 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f52fc00abf0 con 0x7f53040c4c10 2023-12-12T09:47:39.198 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:39.196+0000 7f5300ff9640 1 --2- 172.21.15.73:0/3268370394 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f52e406ae40 0x7f52e406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:39.198 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:39.196+0000 7f5300ff9640 1 -- 172.21.15.73:0/3268370394 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f52fc0891b0 con 0x7f53040c4c10 2023-12-12T09:47:39.198 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:39.196+0000 7f53037fe640 1 --2- 172.21.15.73:0/3268370394 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f52e406ae40 0x7f52e406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:39.199 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:39.197+0000 7f53037fe640 1 --2- 172.21.15.73:0/3268370394 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f52e406ae40 0x7f52e406d300 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f52f4009ad0 tx=0x7f52f4008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:47:39.202 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:39.200+0000 7f5300ff9640 1 -- 172.21.15.73:0/3268370394 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f5304070830 con 0x7f53040c4c10 2023-12-12T09:47:39.393 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:39.391+0000 7f5309be5640 1 -- 172.21.15.73:0/3268370394 --> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) v1 -- 0x7f53041554b0 con 0x7f52e406ae40 2023-12-12T09:47:39.393 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:39.392+0000 7f5300ff9640 1 -- 172.21.15.73:0/3268370394 <== mgr.4110 v2:172.21.15.73:6832/779985841 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f52f40119a0 con 0x7f52e406ae40 2023-12-12T09:47:39.394 INFO:teuthology.orchestra.run.smithi073.stderr:instructed osd(s) 6 to deep-scrub 2023-12-12T09:47:39.396 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:39.394+0000 7f5309be5640 1 -- 172.21.15.73:0/3268370394 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f52e406ae40 msgr2=0x7f52e406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:39.396 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:39.394+0000 7f5309be5640 1 --2- 172.21.15.73:0/3268370394 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f52e406ae40 0x7f52e406d300 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f52f4009ad0 tx=0x7f52f4008040 comp rx=0 tx=0).stop 2023-12-12T09:47:39.396 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:39.394+0000 7f5309be5640 1 -- 172.21.15.73:0/3268370394 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f53040c4c10 msgr2=0x7f53040a7e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:39.397 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:39.394+0000 7f5309be5640 1 --2- 172.21.15.73:0/3268370394 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f53040c4c10 0x7f53040a7e20 secure :-1 s=READY pgs=1182 cs=0 l=1 rev1=1 crypto rx=0x7f52fc00c7d0 tx=0x7f52fc00cc90 comp rx=0 tx=0).stop 2023-12-12T09:47:39.397 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:39.395+0000 7f5309be5640 1 -- 172.21.15.73:0/3268370394 shutdown_connections 2023-12-12T09:47:39.397 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:39.395+0000 7f5309be5640 1 --2- 172.21.15.73:0/3268370394 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f52e406ae40 0x7f52e406d300 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:39.397 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:39.395+0000 7f5309be5640 1 --2- 172.21.15.73:0/3268370394 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f53040c4c10 0x7f53040a7e20 unknown :-1 s=CLOSED pgs=1182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:39.397 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:39.395+0000 7f5309be5640 1 --2- 172.21.15.73:0/3268370394 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f53040c1a60 0x7f5304070b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:39.397 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:39.395+0000 7f5309be5640 1 --2- 172.21.15.73:0/3268370394 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f53040a4f40 0x7f53040a9ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:39.397 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:39.395+0000 7f5309be5640 1 -- 172.21.15.73:0/3268370394 >> 172.21.15.73:0/3268370394 conn(0x7f53040a77d0 msgr2=0x7f530406d420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:47:39.397 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:39.395+0000 7f5309be5640 1 -- 172.21.15.73:0/3268370394 shutdown_connections 2023-12-12T09:47:39.397 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:39.395+0000 7f5309be5640 1 -- 172.21.15.73:0/3268370394 wait complete. 2023-12-12T09:47:39.415 INFO:tasks.ceph:Scrubbing osd.7 2023-12-12T09:47:39.415 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2023-12-12T09:47:39.636 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:39.635+0000 7f30a2a6b640 1 Processor -- start 2023-12-12T09:47:39.637 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:39.635+0000 7f30a2a6b640 1 -- start start 2023-12-12T09:47:39.638 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:39.636+0000 7f30a2a6b640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f309c14ea60 0x7f309c0c5420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:39.638 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:39.636+0000 7f30a2a6b640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f309c0a4c90 0x7f309c0c0320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:39.638 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:39.636+0000 7f30a2a6b640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f309c0c4420 0x7f309c0c20b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:39.639 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:39.636+0000 7f30a2a6b640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f309c0c3390 con 0x7f309c0a4c90 2023-12-12T09:47:39.639 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:39.636+0000 7f30a2a6b640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f309c151e60 con 0x7f309c0c4420 2023-12-12T09:47:39.639 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:39.636+0000 7f30a2a6b640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f309c152140 con 0x7f309c14ea60 2023-12-12T09:47:39.639 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:39.637+0000 7f3093fff640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f309c0a4c90 0x7f309c0c0320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:39.639 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:39.637+0000 7f3093fff640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f309c0a4c90 0x7f309c0c0320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:59238/0 (socket says 172.21.15.73:59238) 2023-12-12T09:47:39.639 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:39.637+0000 7f3093fff640 1 -- 172.21.15.73:0/569143373 learned_addr learned my addr 172.21.15.73:0/569143373 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:47:39.640 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:39.637+0000 7f30a0807640 1 --2- 172.21.15.73:0/569143373 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f309c14ea60 0x7f309c0c5420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:39.640 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:39.637+0000 7f3093fff640 1 -- 172.21.15.73:0/569143373 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f309c14ea60 msgr2=0x7f309c0c5420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:47:39.641 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:39.637+0000 7f3093fff640 1 --2- 172.21.15.73:0/569143373 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f309c14ea60 0x7f309c0c5420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:39.641 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:39.637+0000 7f3093fff640 1 -- 172.21.15.73:0/569143373 >> v2:172.21.15.142:3300/0 conn(0x7f309c0c4420 msgr2=0x7f309c0c20b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:47:39.641 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:39.637+0000 7f3093fff640 1 --2- 172.21.15.73:0/569143373 >> v2:172.21.15.142:3300/0 conn(0x7f309c0c4420 0x7f309c0c20b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:39.641 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:39.637+0000 7f3093fff640 1 -- 172.21.15.73:0/569143373 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f309c0c3940 con 0x7f309c0a4c90 2023-12-12T09:47:39.641 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:39.638+0000 7f3093fff640 1 --2- 172.21.15.73:0/569143373 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f309c0a4c90 0x7f309c0c0320 secure :-1 s=READY pgs=1183 cs=0 l=1 rev1=1 crypto rx=0x7f309c06b5a0 tx=0x7f308c02b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=637017451a50b730 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:47:39.641 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:39.639+0000 7f30937fe640 1 -- 172.21.15.73:0/569143373 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f308c0317e0 con 0x7f309c0a4c90 2023-12-12T09:47:39.641 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:39.639+0000 7f30937fe640 1 -- 172.21.15.73:0/569143373 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f308c031940 con 0x7f309c0a4c90 2023-12-12T09:47:39.641 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:39.639+0000 7f30937fe640 1 -- 172.21.15.73:0/569143373 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f308c031cd0 con 0x7f309c0a4c90 2023-12-12T09:47:39.642 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:39.639+0000 7f30a2a6b640 1 -- 172.21.15.73:0/569143373 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f309c0a4c90 msgr2=0x7f309c0c0320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:39.642 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:39.639+0000 7f30a2a6b640 1 --2- 172.21.15.73:0/569143373 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f309c0a4c90 0x7f309c0c0320 secure :-1 s=READY pgs=1183 cs=0 l=1 rev1=1 crypto rx=0x7f309c06b5a0 tx=0x7f308c02b880 comp rx=0 tx=0).stop 2023-12-12T09:47:39.643 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:39.639+0000 7f30a2a6b640 1 -- 172.21.15.73:0/569143373 shutdown_connections 2023-12-12T09:47:39.643 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:39.639+0000 7f30a2a6b640 1 --2- 172.21.15.73:0/569143373 >> v2:172.21.15.142:3300/0 conn(0x7f309c0c4420 0x7f309c0c20b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:39.643 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:39.639+0000 7f30a2a6b640 1 --2- 172.21.15.73:0/569143373 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f309c0a4c90 0x7f309c0c0320 unknown :-1 s=CLOSED pgs=1183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:39.643 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:39.639+0000 7f30a2a6b640 1 --2- 172.21.15.73:0/569143373 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f309c14ea60 0x7f309c0c5420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:39.643 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:39.639+0000 7f30a2a6b640 1 -- 172.21.15.73:0/569143373 >> 172.21.15.73:0/569143373 conn(0x7f309c06a4e0 msgr2=0x7f309c06a8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:47:39.643 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:39.639+0000 7f30a2a6b640 1 -- 172.21.15.73:0/569143373 shutdown_connections 2023-12-12T09:47:39.644 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:39.639+0000 7f30a2a6b640 1 -- 172.21.15.73:0/569143373 wait complete. 2023-12-12T09:47:39.644 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:39.641+0000 7f30a2a6b640 1 Processor -- start 2023-12-12T09:47:39.644 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:39.641+0000 7f30a2a6b640 1 -- start start 2023-12-12T09:47:39.646 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:39.642+0000 7f30a2a6b640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f309c0a4c90 0x7f309c14a7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:39.646 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:39.642+0000 7f30a2a6b640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f309c0c4420 0x7f309c14ad10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:39.646 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:39.642+0000 7f30a2a6b640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f309c14ea60 0x7f309c13aa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:39.646 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:39.642+0000 7f30a2a6b640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f309c0ab2f0 con 0x7f309c0a4c90 2023-12-12T09:47:39.646 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:39.642+0000 7f30a2a6b640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f309c0a8af0 con 0x7f309c0c4420 2023-12-12T09:47:39.646 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:39.642+0000 7f30a2a6b640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f309c0a9330 con 0x7f309c14ea60 2023-12-12T09:47:39.646 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:39.642+0000 7f30a0807640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f309c0a4c90 0x7f309c14a7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:39.646 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:39.642+0000 7f30a0807640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f309c0a4c90 0x7f309c14a7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:59250/0 (socket says 172.21.15.73:59250) 2023-12-12T09:47:39.647 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:39.642+0000 7f30a0807640 1 -- 172.21.15.73:0/2522820310 learned_addr learned my addr 172.21.15.73:0/2522820310 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:47:39.647 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:39.643+0000 7f30a0807640 1 -- 172.21.15.73:0/2522820310 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f309c14ea60 msgr2=0x7f309c13aa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:39.647 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:39.643+0000 7f30a0807640 1 --2- 172.21.15.73:0/2522820310 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f309c14ea60 0x7f309c13aa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:39.647 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:39.643+0000 7f30a0807640 1 -- 172.21.15.73:0/2522820310 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f309c0c4420 msgr2=0x7f309c14ad10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:39.647 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:39.643+0000 7f30a0807640 1 --2- 172.21.15.73:0/2522820310 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f309c0c4420 0x7f309c14ad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:39.647 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:39.643+0000 7f30a0807640 1 -- 172.21.15.73:0/2522820310 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f308c0094d0 con 0x7f309c0a4c90 2023-12-12T09:47:39.647 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:39.643+0000 7f30a0807640 1 --2- 172.21.15.73:0/2522820310 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f309c0a4c90 0x7f309c14a7d0 secure :-1 s=READY pgs=1184 cs=0 l=1 rev1=1 crypto rx=0x7f309800cd00 tx=0x7f309800a5c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:47:39.647 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:39.643+0000 7f30917fa640 1 -- 172.21.15.73:0/2522820310 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3098003990 con 0x7f309c0a4c90 2023-12-12T09:47:39.647 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:39.643+0000 7f30917fa640 1 -- 172.21.15.73:0/2522820310 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3098003af0 con 0x7f309c0a4c90 2023-12-12T09:47:39.648 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:39.643+0000 7f30917fa640 1 -- 172.21.15.73:0/2522820310 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3098003e80 con 0x7f309c0a4c90 2023-12-12T09:47:39.648 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:39.643+0000 7f30a2a6b640 1 -- 172.21.15.73:0/2522820310 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f309c0ab540 con 0x7f309c0a4c90 2023-12-12T09:47:39.648 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:39.644+0000 7f30a2a6b640 1 -- 172.21.15.73:0/2522820310 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f309c0a9050 con 0x7f309c0a4c90 2023-12-12T09:47:39.649 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:39.644+0000 7f30a2a6b640 1 -- 172.21.15.73:0/2522820310 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f309c0c2940 con 0x7f309c0a4c90 2023-12-12T09:47:39.649 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:39.646+0000 7f30917fa640 1 -- 172.21.15.73:0/2522820310 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f3098004020 con 0x7f309c0a4c90 2023-12-12T09:47:39.649 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:39.646+0000 7f30917fa640 1 --2- 172.21.15.73:0/2522820310 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f308806ae40 0x7f308806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:39.650 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:39.647+0000 7f30917fa640 1 -- 172.21.15.73:0/2522820310 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f3098089730 con 0x7f309c0a4c90 2023-12-12T09:47:39.650 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:39.647+0000 7f3093fff640 1 --2- 172.21.15.73:0/2522820310 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f308806ae40 0x7f308806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:39.650 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:39.647+0000 7f30917fa640 1 --2- 172.21.15.73:0/2522820310 >> [v2:172.21.15.142:6816/2573794341,v1:172.21.15.142:6818/2573794341] conn(0x7f3088070d40 0x7f3088073160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:39.650 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:39.647+0000 7f30917fa640 1 -- 172.21.15.73:0/2522820310 --> [v2:172.21.15.142:6816/2573794341,v1:172.21.15.142:6818/2573794341] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f3088073810 con 0x7f3088070d40 2023-12-12T09:47:39.650 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:39.647+0000 7f30917fa640 1 -- 172.21.15.73:0/2522820310 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_get_version_reply(handle=1 version=87) v2 ==== 24+0+0 (secure 0 0 0) 0x7f309808bd10 con 0x7f309c0a4c90 2023-12-12T09:47:39.650 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:39.647+0000 7f3093fff640 1 --2- 172.21.15.73:0/2522820310 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f308806ae40 0x7f308806d300 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f308c036000 tx=0x7f308c030000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:47:39.650 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:39.648+0000 7f30a1008640 1 --2- 172.21.15.73:0/2522820310 >> [v2:172.21.15.142:6816/2573794341,v1:172.21.15.142:6818/2573794341] conn(0x7f3088070d40 0x7f3088073160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:39.651 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:39.648+0000 7f30a1008640 1 --2- 172.21.15.73:0/2522820310 >> [v2:172.21.15.142:6816/2573794341,v1:172.21.15.142:6818/2573794341] conn(0x7f3088070d40 0x7f3088073160 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:47:39.652 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:39.650+0000 7f30917fa640 1 -- 172.21.15.73:0/2522820310 <== osd.7 v2:172.21.15.142:6816/2573794341 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f3088073810 con 0x7f3088070d40 2023-12-12T09:47:39.667 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:39.665+0000 7f30a2a6b640 1 -- 172.21.15.73:0/2522820310 --> [v2:172.21.15.142:6816/2573794341,v1:172.21.15.142:6818/2573794341] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f309c14ee40 con 0x7f3088070d40 2023-12-12T09:47:39.668 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:39.666+0000 7f30917fa640 1 -- 172.21.15.73:0/2522820310 <== osd.7 v2:172.21.15.142:6816/2573794341 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f30940097f0 con 0x7f3088070d40 2023-12-12T09:47:39.668 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2023-12-12T09:47:39.668 INFO:teuthology.orchestra.run.smithi073.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2023-12-12T09:47:39.668 INFO:teuthology.orchestra.run.smithi073.stdout:} 2023-12-12T09:47:39.669 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:39.667+0000 7f30a2a6b640 1 -- 172.21.15.73:0/2522820310 >> [v2:172.21.15.142:6816/2573794341,v1:172.21.15.142:6818/2573794341] conn(0x7f3088070d40 msgr2=0x7f3088073160 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:39.669 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:39.667+0000 7f30a2a6b640 1 --2- 172.21.15.73:0/2522820310 >> [v2:172.21.15.142:6816/2573794341,v1:172.21.15.142:6818/2573794341] conn(0x7f3088070d40 0x7f3088073160 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:39.669 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:39.667+0000 7f30a2a6b640 1 -- 172.21.15.73:0/2522820310 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f308806ae40 msgr2=0x7f308806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:39.670 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:39.667+0000 7f30a2a6b640 1 --2- 172.21.15.73:0/2522820310 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f308806ae40 0x7f308806d300 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f308c036000 tx=0x7f308c030000 comp rx=0 tx=0).stop 2023-12-12T09:47:39.670 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:39.667+0000 7f30a2a6b640 1 -- 172.21.15.73:0/2522820310 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f309c0a4c90 msgr2=0x7f309c14a7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:39.670 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:39.667+0000 7f30a2a6b640 1 --2- 172.21.15.73:0/2522820310 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f309c0a4c90 0x7f309c14a7d0 secure :-1 s=READY pgs=1184 cs=0 l=1 rev1=1 crypto rx=0x7f309800cd00 tx=0x7f309800a5c0 comp rx=0 tx=0).stop 2023-12-12T09:47:39.670 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:39.667+0000 7f30a1008640 1 -- 172.21.15.73:0/2522820310 reap_dead start 2023-12-12T09:47:39.670 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:39.667+0000 7f30a2a6b640 1 -- 172.21.15.73:0/2522820310 shutdown_connections 2023-12-12T09:47:39.670 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:39.667+0000 7f30a2a6b640 1 -- 172.21.15.73:0/2522820310 >> 172.21.15.73:0/2522820310 conn(0x7f309c06a4e0 msgr2=0x7f309c06a8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:47:39.670 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:39.667+0000 7f30a2a6b640 1 -- 172.21.15.73:0/2522820310 shutdown_connections 2023-12-12T09:47:39.670 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:39.667+0000 7f30a2a6b640 1 -- 172.21.15.73:0/2522820310 wait complete. 2023-12-12T09:47:39.687 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2023-12-12T09:47:39.892 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:39.890+0000 7f095cf33640 1 Processor -- start 2023-12-12T09:47:39.892 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:39.890+0000 7f095cf33640 1 -- start start 2023-12-12T09:47:39.893 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:39.892+0000 7f095cf33640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f095806fca0 0x7f0958072700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:39.894 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:39.892+0000 7f095cf33640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f09580c0420 0x7f0958070080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:39.894 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:39.892+0000 7f095cf33640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0958152560 con 0x7f09580c10d0 2023-12-12T09:47:39.894 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:39.892+0000 7f095cf33640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0958152ec0 con 0x7f095806fca0 2023-12-12T09:47:39.894 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:39.892+0000 7f095cf33640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09580c53d0 con 0x7f09580c0420 2023-12-12T09:47:39.895 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:39.892+0000 7f095659c640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f095806fca0 0x7f0958072700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:39.895 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:39.893+0000 7f095659c640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f095806fca0 0x7f0958072700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.73:56700/0 (socket says 172.21.15.73:56700) 2023-12-12T09:47:39.895 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:39.893+0000 7f095659c640 1 -- 172.21.15.73:0/2505497363 learned_addr learned my addr 172.21.15.73:0/2505497363 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:47:39.895 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:39.893+0000 7f094dd9b640 1 --2- 172.21.15.73:0/2505497363 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f09580c0420 0x7f0958070080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:39.895 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:39.893+0000 7f095659c640 1 -- 172.21.15.73:0/2505497363 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f09580c0420 msgr2=0x7f0958070080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:47:39.895 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:39.893+0000 7f095659c640 1 --2- 172.21.15.73:0/2505497363 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f09580c0420 0x7f0958070080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:39.896 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:39.893+0000 7f095659c640 1 -- 172.21.15.73:0/2505497363 >> v1:172.21.15.142:6789/0 conn(0x7f09580c10d0 legacy=0x7f09580c1580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:39.896 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:39.893+0000 7f095659c640 1 -- 172.21.15.73:0/2505497363 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09581532e0 con 0x7f095806fca0 2023-12-12T09:47:39.896 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:39.895+0000 7f095659c640 1 --2- 172.21.15.73:0/2505497363 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f095806fca0 0x7f0958072700 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f0948009e50 tx=0x7f094802bed0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ba2f2c85756dfb42 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:47:39.897 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:39.895+0000 7f0955d9b640 1 -- 172.21.15.73:0/2505497363 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f094802ca70 con 0x7f095806fca0 2023-12-12T09:47:39.897 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:39.895+0000 7f0955d9b640 1 -- 172.21.15.73:0/2505497363 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f094802cbd0 con 0x7f095806fca0 2023-12-12T09:47:39.897 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:39.895+0000 7f0955d9b640 1 -- 172.21.15.73:0/2505497363 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09480343f0 con 0x7f095806fca0 2023-12-12T09:47:39.898 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:39.896+0000 7f095cf33640 1 -- 172.21.15.73:0/2505497363 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f095806fca0 msgr2=0x7f0958072700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:39.899 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:39.896+0000 7f095cf33640 1 --2- 172.21.15.73:0/2505497363 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f095806fca0 0x7f0958072700 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f0948009e50 tx=0x7f094802bed0 comp rx=0 tx=0).stop 2023-12-12T09:47:39.899 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:39.896+0000 7f095cf33640 1 -- 172.21.15.73:0/2505497363 shutdown_connections 2023-12-12T09:47:39.899 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:39.896+0000 7f095cf33640 1 --2- 172.21.15.73:0/2505497363 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f09580c0420 0x7f0958070080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:39.899 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:39.896+0000 7f095cf33640 1 --2- 172.21.15.73:0/2505497363 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f095806fca0 0x7f0958072700 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:39.899 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:39.896+0000 7f095cf33640 1 -- 172.21.15.73:0/2505497363 >> 172.21.15.73:0/2505497363 conn(0x7f09580a77d0 msgr2=0x7f09580a7bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:47:39.899 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:39.896+0000 7f095cf33640 1 -- 172.21.15.73:0/2505497363 shutdown_connections 2023-12-12T09:47:39.900 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:39.896+0000 7f095cf33640 1 -- 172.21.15.73:0/2505497363 wait complete. 2023-12-12T09:47:39.900 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:39.898+0000 7f095cf33640 1 Processor -- start 2023-12-12T09:47:39.900 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:39.898+0000 7f095cf33640 1 -- start start 2023-12-12T09:47:39.903 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:39.899+0000 7f095cf33640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f095806fca0 0x7f0958155960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:39.904 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:39.899+0000 7f095cf33640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f09580c0420 0x7f09581e0d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:39.904 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:39.899+0000 7f095cf33640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f09580c10d0 0x7f09581e12d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:39.904 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:39.899+0000 7f095cf33640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09581dc7f0 con 0x7f095806fca0 2023-12-12T09:47:39.904 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:39.899+0000 7f095cf33640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09581e1810 con 0x7f09580c10d0 2023-12-12T09:47:39.905 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:39.899+0000 7f095cf33640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09581548c0 con 0x7f09580c0420 2023-12-12T09:47:39.905 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:39.899+0000 7f095659c640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f095806fca0 0x7f0958155960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:39.905 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:39.899+0000 7f095659c640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f095806fca0 0x7f0958155960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:59264/0 (socket says 172.21.15.73:59264) 2023-12-12T09:47:39.905 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:39.899+0000 7f095659c640 1 -- 172.21.15.73:0/2365050699 learned_addr learned my addr 172.21.15.73:0/2365050699 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:47:39.906 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:39.900+0000 7f094dd9b640 1 --2- 172.21.15.73:0/2365050699 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f09580c0420 0x7f09581e0d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:39.906 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:39.900+0000 7f095659c640 1 -- 172.21.15.73:0/2365050699 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f09580c0420 msgr2=0x7f09581e0d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:39.906 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:39.900+0000 7f0956d9d640 1 --2- 172.21.15.73:0/2365050699 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f09580c10d0 0x7f09581e12d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:39.906 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:39.900+0000 7f095659c640 1 --2- 172.21.15.73:0/2365050699 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f09580c0420 0x7f09581e0d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:39.906 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:39.900+0000 7f095659c640 1 -- 172.21.15.73:0/2365050699 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f09580c10d0 msgr2=0x7f09581e12d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:39.907 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:39.900+0000 7f095659c640 1 --2- 172.21.15.73:0/2365050699 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f09580c10d0 0x7f09581e12d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:39.907 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:39.900+0000 7f095659c640 1 -- 172.21.15.73:0/2365050699 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0948009b30 con 0x7f095806fca0 2023-12-12T09:47:39.907 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:39.900+0000 7f0956d9d640 1 --2- 172.21.15.73:0/2365050699 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f09580c10d0 0x7f09581e12d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:47:39.907 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:39.900+0000 7f095659c640 1 --2- 172.21.15.73:0/2365050699 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f095806fca0 0x7f0958155960 secure :-1 s=READY pgs=1185 cs=0 l=1 rev1=1 crypto rx=0x7f0948036040 tx=0x7f0948004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:47:39.907 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:39.901+0000 7f094f7fe640 1 -- 172.21.15.73:0/2365050699 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0948009510 con 0x7f095806fca0 2023-12-12T09:47:39.907 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:39.901+0000 7f094f7fe640 1 -- 172.21.15.73:0/2365050699 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f094803e450 con 0x7f095806fca0 2023-12-12T09:47:39.908 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:39.901+0000 7f094f7fe640 1 -- 172.21.15.73:0/2365050699 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f094803e800 con 0x7f095806fca0 2023-12-12T09:47:39.908 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:39.901+0000 7f095cf33640 1 -- 172.21.15.73:0/2365050699 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0958154ba0 con 0x7f095806fca0 2023-12-12T09:47:39.908 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:39.901+0000 7f095cf33640 1 -- 172.21.15.73:0/2365050699 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0958155160 con 0x7f095806fca0 2023-12-12T09:47:39.908 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:39.902+0000 7f095cf33640 1 -- 172.21.15.73:0/2365050699 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0958067580 con 0x7f095806fca0 2023-12-12T09:47:39.910 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:39.903+0000 7f094f7fe640 1 -- 172.21.15.73:0/2365050699 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f094803e960 con 0x7f095806fca0 2023-12-12T09:47:39.910 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:39.904+0000 7f094f7fe640 1 --2- 172.21.15.73:0/2365050699 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f093806ae40 0x7f093806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:39.910 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:39.904+0000 7f094f7fe640 1 -- 172.21.15.73:0/2365050699 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f09480ac150 con 0x7f095806fca0 2023-12-12T09:47:39.910 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:39.904+0000 7f094dd9b640 1 --2- 172.21.15.73:0/2365050699 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f093806ae40 0x7f093806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:39.910 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:39.905+0000 7f094dd9b640 1 --2- 172.21.15.73:0/2365050699 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f093806ae40 0x7f093806d300 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f0958072c40 tx=0x7f0940008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:47:39.910 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:39.908+0000 7f094f7fe640 1 -- 172.21.15.73:0/2365050699 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f0948077410 con 0x7f095806fca0 2023-12-12T09:47:40.099 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:40.097+0000 7f095cf33640 1 -- 172.21.15.73:0/2365050699 --> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) v1 -- 0x7f0958152ae0 con 0x7f093806ae40 2023-12-12T09:47:40.100 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:40.098+0000 7f094f7fe640 1 -- 172.21.15.73:0/2365050699 <== mgr.4110 v2:172.21.15.73:6832/779985841 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f09400119a0 con 0x7f093806ae40 2023-12-12T09:47:40.100 INFO:teuthology.orchestra.run.smithi073.stderr:instructed osd(s) 7 to deep-scrub 2023-12-12T09:47:40.103 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:40.101+0000 7f095cf33640 1 -- 172.21.15.73:0/2365050699 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f093806ae40 msgr2=0x7f093806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:40.103 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:40.101+0000 7f095cf33640 1 --2- 172.21.15.73:0/2365050699 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f093806ae40 0x7f093806d300 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f0958072c40 tx=0x7f0940008040 comp rx=0 tx=0).stop 2023-12-12T09:47:40.104 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:40.101+0000 7f095cf33640 1 -- 172.21.15.73:0/2365050699 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f095806fca0 msgr2=0x7f0958155960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:40.104 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:40.101+0000 7f095cf33640 1 --2- 172.21.15.73:0/2365050699 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f095806fca0 0x7f0958155960 secure :-1 s=READY pgs=1185 cs=0 l=1 rev1=1 crypto rx=0x7f0948036040 tx=0x7f0948004a40 comp rx=0 tx=0).stop 2023-12-12T09:47:40.104 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:40.101+0000 7f095cf33640 1 -- 172.21.15.73:0/2365050699 shutdown_connections 2023-12-12T09:47:40.104 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:40.101+0000 7f095cf33640 1 --2- 172.21.15.73:0/2365050699 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f093806ae40 0x7f093806d300 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:40.105 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:40.101+0000 7f095cf33640 1 --2- 172.21.15.73:0/2365050699 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f09580c10d0 0x7f09581e12d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:40.105 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:40.101+0000 7f095cf33640 1 --2- 172.21.15.73:0/2365050699 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f09580c0420 0x7f09581e0d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:40.105 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:40.101+0000 7f095cf33640 1 --2- 172.21.15.73:0/2365050699 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f095806fca0 0x7f0958155960 unknown :-1 s=CLOSED pgs=1185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:40.105 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:40.101+0000 7f095cf33640 1 -- 172.21.15.73:0/2365050699 >> 172.21.15.73:0/2365050699 conn(0x7f09580a77d0 msgr2=0x7f09580c4020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:47:40.105 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:40.101+0000 7f095cf33640 1 -- 172.21.15.73:0/2365050699 shutdown_connections 2023-12-12T09:47:40.106 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:40.101+0000 7f095cf33640 1 -- 172.21.15.73:0/2365050699 wait complete. 2023-12-12T09:47:40.122 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-12T09:47:40.334 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:40.332+0000 7fae1ffff640 1 Processor -- start 2023-12-12T09:47:40.335 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:40.332+0000 7fae1ffff640 1 -- start start 2023-12-12T09:47:40.336 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:40.334+0000 7fae1ffff640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fae2014fbb0 0x7fae200c09e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:40.336 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:40.334+0000 7fae1ffff640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fae200c0f20 0x7fae200aae00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:40.336 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:40.334+0000 7fae1ffff640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fae200a9470 0x7fae200ab340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:40.336 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:40.334+0000 7fae1ffff640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae200aa000 con 0x7fae200c0f20 2023-12-12T09:47:40.336 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:40.334+0000 7fae1ffff640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae200c1d40 con 0x7fae200a9470 2023-12-12T09:47:40.336 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:40.334+0000 7fae1ffff640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae20153300 con 0x7fae2014fbb0 2023-12-12T09:47:40.336 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:40.334+0000 7fae1e7fc640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fae200c0f20 0x7fae200aae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:40.337 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:40.334+0000 7fae1e7fc640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fae200c0f20 0x7fae200aae00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:59272/0 (socket says 172.21.15.73:59272) 2023-12-12T09:47:40.337 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:40.334+0000 7fae1e7fc640 1 -- 172.21.15.73:0/2471200306 learned_addr learned my addr 172.21.15.73:0/2471200306 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:47:40.338 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:40.335+0000 7fae1f7fe640 1 --2- 172.21.15.73:0/2471200306 >> v2:172.21.15.142:3300/0 conn(0x7fae200a9470 0x7fae200ab340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:40.338 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:40.335+0000 7fae1effd640 1 --2- 172.21.15.73:0/2471200306 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fae2014fbb0 0x7fae200c09e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:40.338 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:40.335+0000 7fae1e7fc640 1 -- 172.21.15.73:0/2471200306 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fae2014fbb0 msgr2=0x7fae200c09e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:47:40.338 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:40.335+0000 7fae1e7fc640 1 --2- 172.21.15.73:0/2471200306 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fae2014fbb0 0x7fae200c09e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:40.338 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:40.335+0000 7fae1e7fc640 1 -- 172.21.15.73:0/2471200306 >> v2:172.21.15.142:3300/0 conn(0x7fae200a9470 msgr2=0x7fae200ab340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:47:40.338 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:40.335+0000 7fae1e7fc640 1 --2- 172.21.15.73:0/2471200306 >> v2:172.21.15.142:3300/0 conn(0x7fae200a9470 0x7fae200ab340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:40.339 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:40.335+0000 7fae1e7fc640 1 -- 172.21.15.73:0/2471200306 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae200c2160 con 0x7fae200c0f20 2023-12-12T09:47:40.339 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:40.336+0000 7fae1e7fc640 1 --2- 172.21.15.73:0/2471200306 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fae200c0f20 0x7fae200aae00 secure :-1 s=READY pgs=1186 cs=0 l=1 rev1=1 crypto rx=0x7fae20073c50 tx=0x7fae1402b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4cd2c9da1273adb server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:47:40.339 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:40.336+0000 7fae1dffb640 1 -- 172.21.15.73:0/2471200306 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae140317c0 con 0x7fae200c0f20 2023-12-12T09:47:40.339 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:40.336+0000 7fae1dffb640 1 -- 172.21.15.73:0/2471200306 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae14031920 con 0x7fae200c0f20 2023-12-12T09:47:40.339 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:40.336+0000 7fae1dffb640 1 -- 172.21.15.73:0/2471200306 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae14031cb0 con 0x7fae200c0f20 2023-12-12T09:47:40.340 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:40.337+0000 7fae1ffff640 1 -- 172.21.15.73:0/2471200306 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fae200c0f20 msgr2=0x7fae200aae00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:40.340 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:40.337+0000 7fae1ffff640 1 --2- 172.21.15.73:0/2471200306 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fae200c0f20 0x7fae200aae00 secure :-1 s=READY pgs=1186 cs=0 l=1 rev1=1 crypto rx=0x7fae20073c50 tx=0x7fae1402b860 comp rx=0 tx=0).stop 2023-12-12T09:47:40.340 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:40.337+0000 7fae1ffff640 1 -- 172.21.15.73:0/2471200306 shutdown_connections 2023-12-12T09:47:40.340 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:40.337+0000 7fae1ffff640 1 --2- 172.21.15.73:0/2471200306 >> v2:172.21.15.142:3300/0 conn(0x7fae200a9470 0x7fae200ab340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:40.340 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:40.337+0000 7fae1ffff640 1 --2- 172.21.15.73:0/2471200306 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fae200c0f20 0x7fae200aae00 unknown :-1 s=CLOSED pgs=1186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:40.341 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:40.337+0000 7fae1ffff640 1 --2- 172.21.15.73:0/2471200306 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fae2014fbb0 0x7fae200c09e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:40.341 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:40.337+0000 7fae1ffff640 1 -- 172.21.15.73:0/2471200306 >> 172.21.15.73:0/2471200306 conn(0x7fae200c23b0 msgr2=0x7fae200c2790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:47:40.341 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:40.337+0000 7fae1ffff640 1 -- 172.21.15.73:0/2471200306 shutdown_connections 2023-12-12T09:47:40.341 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:40.337+0000 7fae1ffff640 1 -- 172.21.15.73:0/2471200306 wait complete. 2023-12-12T09:47:40.343 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:40.339+0000 7fae1ffff640 1 Processor -- start 2023-12-12T09:47:40.343 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:40.339+0000 7fae1ffff640 1 -- start start 2023-12-12T09:47:40.343 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:40.340+0000 7fae1ffff640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fae200a9470 0x7fae20071ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:40.344 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:40.340+0000 7fae1ffff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fae200c0f20 0x7fae2014bc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:40.344 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:40.340+0000 7fae1ffff640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fae2014fbb0 0x7fae2014c160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:40.344 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:40.340+0000 7fae1ffff640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae200bc420 con 0x7fae200c0f20 2023-12-12T09:47:40.344 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:40.340+0000 7fae1ffff640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae201ebd20 con 0x7fae200a9470 2023-12-12T09:47:40.344 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:40.340+0000 7fae1ffff640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae201eb110 con 0x7fae2014fbb0 2023-12-12T09:47:40.344 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:40.340+0000 7fae1e7fc640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fae200c0f20 0x7fae2014bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:40.344 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:40.340+0000 7fae1e7fc640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fae200c0f20 0x7fae2014bc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:59280/0 (socket says 172.21.15.73:59280) 2023-12-12T09:47:40.344 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:40.340+0000 7fae1e7fc640 1 -- 172.21.15.73:0/288530423 learned_addr learned my addr 172.21.15.73:0/288530423 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:47:40.345 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:40.341+0000 7fae1effd640 1 --2- 172.21.15.73:0/288530423 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fae200a9470 0x7fae20071ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:40.345 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:40.341+0000 7fae1f7fe640 1 --2- 172.21.15.73:0/288530423 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fae2014fbb0 0x7fae2014c160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:40.345 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:40.341+0000 7fae1e7fc640 1 -- 172.21.15.73:0/288530423 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fae2014fbb0 msgr2=0x7fae2014c160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:40.345 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:40.341+0000 7fae1e7fc640 1 --2- 172.21.15.73:0/288530423 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fae2014fbb0 0x7fae2014c160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:40.345 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:40.341+0000 7fae1e7fc640 1 -- 172.21.15.73:0/288530423 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fae200a9470 msgr2=0x7fae20071ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:40.345 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:40.341+0000 7fae1e7fc640 1 --2- 172.21.15.73:0/288530423 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fae200a9470 0x7fae20071ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:40.345 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:40.341+0000 7fae1e7fc640 1 -- 172.21.15.73:0/288530423 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae140094d0 con 0x7fae200c0f20 2023-12-12T09:47:40.345 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:40.341+0000 7fae1e7fc640 1 --2- 172.21.15.73:0/288530423 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fae200c0f20 0x7fae2014bc20 secure :-1 s=READY pgs=1187 cs=0 l=1 rev1=1 crypto rx=0x7fae14000c00 tx=0x7fae140046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:47:40.346 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:40.341+0000 7fae077fe640 1 -- 172.21.15.73:0/288530423 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae14032860 con 0x7fae200c0f20 2023-12-12T09:47:40.346 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:40.341+0000 7fae077fe640 1 -- 172.21.15.73:0/288530423 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae140329c0 con 0x7fae200c0f20 2023-12-12T09:47:40.346 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:40.341+0000 7fae1ffff640 1 -- 172.21.15.73:0/288530423 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae201eb3f0 con 0x7fae200c0f20 2023-12-12T09:47:40.346 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:40.342+0000 7fae077fe640 1 -- 172.21.15.73:0/288530423 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae14032d70 con 0x7fae200c0f20 2023-12-12T09:47:40.346 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:40.342+0000 7fae1ffff640 1 -- 172.21.15.73:0/288530423 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae201eb9b0 con 0x7fae200c0f20 2023-12-12T09:47:40.347 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:40.343+0000 7fae1ffff640 1 -- 172.21.15.73:0/288530423 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae20067400 con 0x7fae200c0f20 2023-12-12T09:47:40.347 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:40.344+0000 7fae077fe640 1 -- 172.21.15.73:0/288530423 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fae1404d3f0 con 0x7fae200c0f20 2023-12-12T09:47:40.347 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:40.345+0000 7fae077fe640 1 --2- 172.21.15.73:0/288530423 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fae0c06ae70 0x7fae0c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:47:40.347 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:40.345+0000 7fae077fe640 1 -- 172.21.15.73:0/288530423 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 5029+0+0 (secure 0 0 0) 0x7fae140ab0f0 con 0x7fae200c0f20 2023-12-12T09:47:40.348 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:40.345+0000 7fae1effd640 1 --2- 172.21.15.73:0/288530423 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fae0c06ae70 0x7fae0c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:47:40.348 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:40.346+0000 7fae1effd640 1 --2- 172.21.15.73:0/288530423 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fae0c06ae70 0x7fae0c06d330 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7fae10006fd0 tx=0x7fae10008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:47:40.350 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:40.349+0000 7fae077fe640 1 -- 172.21.15.73:0/288530423 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fae140764d0 con 0x7fae200c0f20 2023-12-12T09:47:40.538 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:40.536+0000 7fae1ffff640 1 -- 172.21.15.73:0/288530423 --> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fae20074060 con 0x7fae0c06ae70 2023-12-12T09:47:40.543 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:40.542+0000 7fae077fe640 1 -- 172.21.15.73:0/288530423 <== mgr.4110 v2:172.21.15.73:6832/779985841 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+48789 (secure 0 0 0) 0x7fae20074060 con 0x7fae0c06ae70 2023-12-12T09:47:40.544 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-12T09:47:40.544 INFO:teuthology.orchestra.run.smithi073.stderr:dumped all 2023-12-12T09:47:40.547 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:40.545+0000 7fae1ffff640 1 -- 172.21.15.73:0/288530423 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fae0c06ae70 msgr2=0x7fae0c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:40.547 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:40.545+0000 7fae1ffff640 1 --2- 172.21.15.73:0/288530423 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fae0c06ae70 0x7fae0c06d330 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7fae10006fd0 tx=0x7fae10008040 comp rx=0 tx=0).stop 2023-12-12T09:47:40.547 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:40.545+0000 7fae1ffff640 1 -- 172.21.15.73:0/288530423 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fae200c0f20 msgr2=0x7fae2014bc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:47:40.547 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:40.545+0000 7fae1ffff640 1 --2- 172.21.15.73:0/288530423 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fae200c0f20 0x7fae2014bc20 secure :-1 s=READY pgs=1187 cs=0 l=1 rev1=1 crypto rx=0x7fae14000c00 tx=0x7fae140046c0 comp rx=0 tx=0).stop 2023-12-12T09:47:40.548 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:40.545+0000 7fae1ffff640 1 -- 172.21.15.73:0/288530423 shutdown_connections 2023-12-12T09:47:40.548 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:40.545+0000 7fae1ffff640 1 --2- 172.21.15.73:0/288530423 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7fae0c06ae70 0x7fae0c06d330 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:40.548 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:40.545+0000 7fae1ffff640 1 --2- 172.21.15.73:0/288530423 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fae2014fbb0 0x7fae2014c160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:40.548 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:40.545+0000 7fae1ffff640 1 --2- 172.21.15.73:0/288530423 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fae200c0f20 0x7fae2014bc20 unknown :-1 s=CLOSED pgs=1187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:40.548 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:40.545+0000 7fae1ffff640 1 --2- 172.21.15.73:0/288530423 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fae200a9470 0x7fae20071ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:47:40.548 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:40.545+0000 7fae1ffff640 1 -- 172.21.15.73:0/288530423 >> 172.21.15.73:0/288530423 conn(0x7fae200c23b0 msgr2=0x7fae20150c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:47:40.548 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:40.545+0000 7fae1ffff640 1 -- 172.21.15.73:0/288530423 shutdown_connections 2023-12-12T09:47:40.548 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:47:40.546+0000 7fae1ffff640 1 -- 172.21.15.73:0/288530423 wait complete. 2023-12-12T09:47:40.565 INFO:teuthology.orchestra.run.smithi073.stdout:{"pg_ready":true,"pg_map":{"version":213,"stamp":"2023-12-12T09:47:39.543364+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":258072,"kb_used_data":8608,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754716648,"statfs":{"total":773094113280,"available":772829847552,"internally_reserved":0,"allocated":8814592,"data_stored":5072384,"data_compressed":64844,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":12752,"internal_metadata":255315504},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-138,"num_objects":-1,"num_object_clones":0,"num_object_copies":-2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-1,"num_write_kb":-1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.002608"},"pg_stats":[{"pgid":"1.0","version":"18'117","reported_seq":223,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-12-12T09:47:28.055025+0000","last_change":"2023-12-12T09:43:17.203315+0000","last_active":"2023-12-12T09:47:28.055025+0000","last_peered":"2023-12-12T09:47:28.055025+0000","last_clean":"2023-12-12T09:47:28.055025+0000","last_became_active":"2023-12-12T09:43:17.200779+0000","last_became_peered":"2023-12-12T09:43:17.200779+0000","last_unstale":"2023-12-12T09:47:28.055025+0000","last_undegraded":"2023-12-12T09:47:28.055025+0000","last_fullsized":"2023-12-12T09:47:28.055025+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:43:15.931922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:43:15.931922+0000","last_clean_scrub_stamp":"2023-12-12T09:43:15.931922+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T21:42:10.929640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":64844,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574904,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32308,"kb_used_data":1124,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339532,"statfs":{"total":96636764160,"available":96603680768,"internally_reserved":0,"allocated":1150976,"data_stored":1076824,"data_compressed":32422,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 12 09:47:18 2023","interfaces":[{"interface":"back","average":{"1min":1.0960000000000001,"5min":1.0649999999999999,"15min":1.0209999999999999},"min":{"1min":0.65700000000000003,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.534,"5min":1.8089999999999999,"15min":1.8089999999999999},"last":0.752},{"interface":"front","average":{"1min":1.1259999999999999,"5min":1.0640000000000001,"15min":0.99399999999999999},"min":{"1min":0.77700000000000002,"5min":0.66300000000000003,"15min":0.66300000000000003},"max":{"1min":1.544,"5min":1.71,"15min":1.71},"last":1.482}]},{"osd":1,"last update":"Tue Dec 12 09:47:18 2023","interfaces":[{"interface":"back","average":{"1min":1.1519999999999999,"5min":1.2010000000000001,"15min":1.1990000000000001},"min":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"max":{"1min":1.5580000000000001,"5min":1.897,"15min":1.897},"last":1.262},{"interface":"front","average":{"1min":1.1719999999999999,"5min":1.1739999999999999,"15min":1.202},"min":{"1min":0.80500000000000005,"5min":0.71499999999999997,"15min":0.71499999999999997},"max":{"1min":1.585,"5min":3.1150000000000002,"15min":3.1150000000000002},"last":1.216}]},{"osd":2,"last update":"Tue Dec 12 09:47:18 2023","interfaces":[{"interface":"back","average":{"1min":1.159,"5min":1.214,"15min":1.246},"min":{"1min":0.84499999999999997,"5min":0.77700000000000002,"15min":0.77700000000000002},"max":{"1min":1.544,"5min":2.2050000000000001,"15min":2.2050000000000001},"last":1.0169999999999999},{"interface":"front","average":{"1min":1.075,"5min":1.169,"15min":1.2190000000000001},"min":{"1min":0.74199999999999999,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.4810000000000001,"5min":3.2759999999999998,"15min":3.2759999999999998},"last":1.377}]},{"osd":3,"last update":"Tue Dec 12 09:47:18 2023","interfaces":[{"interface":"back","average":{"1min":1.133,"5min":1.2110000000000001,"15min":1.2809999999999999},"min":{"1min":0.80100000000000005,"5min":0.76700000000000002,"15min":0.76700000000000002},"max":{"1min":1.6830000000000001,"5min":3.1819999999999999,"15min":3.1819999999999999},"last":0.93799999999999994},{"interface":"front","average":{"1min":1.3300000000000001,"5min":1.3009999999999999,"15min":1.2969999999999999},"min":{"1min":0.94399999999999995,"5min":0.72799999999999998,"15min":0.72799999999999998},"max":{"1min":1.641,"5min":1.8740000000000001,"15min":1.8740000000000001},"last":0.81499999999999995}]},{"osd":4,"last update":"Tue Dec 12 09:47:18 2023","interfaces":[{"interface":"back","average":{"1min":1.3200000000000001,"5min":1.3080000000000001,"15min":1.337},"min":{"1min":0.65900000000000003,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.663,"5min":2.5529999999999999,"15min":2.5529999999999999},"last":1.1539999999999999},{"interface":"front","average":{"1min":1.3460000000000001,"5min":1.373,"15min":1.427},"min":{"1min":0.623,"5min":0.623,"15min":0.623},"max":{"1min":1.643,"5min":2.3759999999999999,"15min":2.3759999999999999},"last":1.538}]},{"osd":5,"last update":"Tue Dec 12 09:47:18 2023","interfaces":[{"interface":"back","average":{"1min":1.3480000000000001,"5min":1.3500000000000001,"15min":1.3400000000000001},"min":{"1min":0.78100000000000003,"5min":0.622,"15min":0.622},"max":{"1min":1.714,"5min":1.9890000000000001,"15min":1.9890000000000001},"last":1.603},{"interface":"front","average":{"1min":1.4510000000000001,"5min":1.482,"15min":1.518},"min":{"1min":0.68700000000000006,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":1.7270000000000001,"5min":2.4159999999999999,"15min":2.4159999999999999},"last":1.6359999999999999}]},{"osd":6,"last update":"Tue Dec 12 09:47:18 2023","interfaces":[{"interface":"back","average":{"1min":1.522,"5min":1.4370000000000001,"15min":1.423},"min":{"1min":0.83799999999999997,"5min":0.70799999999999996,"15min":0.70799999999999996},"max":{"1min":1.8,"5min":2.0510000000000002,"15min":2.0510000000000002},"last":1.6830000000000001},{"interface":"front","average":{"1min":1.5529999999999999,"5min":1.5740000000000001,"15min":1.6140000000000001},"min":{"1min":0.76000000000000001,"5min":0.71899999999999997,"15min":0.71899999999999997},"max":{"1min":1.865,"5min":2.5800000000000001,"15min":2.5800000000000001},"last":1.722}]}]},{"osd":6,"up_from":13,"seq":55834574903,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32248,"kb_used_data":1060,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339592,"statfs":{"total":96636764160,"available":96603742208,"internally_reserved":0,"allocated":1085440,"data_stored":486456,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 12 09:47:18 2023","interfaces":[{"interface":"back","average":{"1min":1.0149999999999999,"5min":1.0720000000000001,"15min":1.1519999999999999},"min":{"1min":0.65000000000000002,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.3859999999999999,"5min":3.6429999999999998,"15min":3.6429999999999998},"last":0.96199999999999997},{"interface":"front","average":{"1min":1.008,"5min":1.052,"15min":1.0640000000000001},"min":{"1min":0.627,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.7729999999999999,"5min":2.6059999999999999,"15min":2.6059999999999999},"last":0.88200000000000001}]},{"osd":1,"last update":"Tue Dec 12 09:47:18 2023","interfaces":[{"interface":"back","average":{"1min":1.196,"5min":1.1080000000000001,"15min":1.077},"min":{"1min":0.66400000000000003,"5min":0.64200000000000002,"15min":0.64200000000000002},"max":{"1min":1.5600000000000001,"5min":2.0169999999999999,"15min":2.0169999999999999},"last":1.1579999999999999},{"interface":"front","average":{"1min":1.163,"5min":1.1739999999999999,"15min":1.1919999999999999},"min":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"max":{"1min":1.71,"5min":1.71,"15min":1.71},"last":1.1060000000000001}]},{"osd":2,"last update":"Tue Dec 12 09:47:18 2023","interfaces":[{"interface":"back","average":{"1min":1.0840000000000001,"5min":1.1839999999999999,"15min":1.218},"min":{"1min":0.77700000000000002,"5min":0.71199999999999997,"15min":0.71199999999999997},"max":{"1min":1.526,"5min":1.804,"15min":1.804},"last":1.5549999999999999},{"interface":"front","average":{"1min":1.1240000000000001,"5min":1.22,"15min":1.282},"min":{"1min":0.72499999999999998,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":1.679,"5min":2.2160000000000002,"15min":2.2160000000000002},"last":1.3340000000000001}]},{"osd":3,"last update":"Tue Dec 12 09:47:18 2023","interfaces":[{"interface":"back","average":{"1min":1.1140000000000001,"5min":1.1910000000000001,"15min":1.2090000000000001},"min":{"1min":0.73199999999999998,"5min":0.71899999999999997,"15min":0.71899999999999997},"max":{"1min":1.5309999999999999,"5min":2.665,"15min":2.665},"last":1.234},{"interface":"front","average":{"1min":1.1180000000000001,"5min":1.1679999999999999,"15min":1.21},"min":{"1min":0.76700000000000002,"5min":0.65700000000000003,"15min":0.65700000000000003},"max":{"1min":1.4710000000000001,"5min":1.8620000000000001,"15min":1.8620000000000001},"last":1.0149999999999999}]},{"osd":4,"last update":"Tue Dec 12 09:47:18 2023","interfaces":[{"interface":"back","average":{"1min":1.1870000000000001,"5min":1.2669999999999999,"15min":1.272},"min":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.696,"5min":2.0310000000000001,"15min":2.0310000000000001},"last":1.3600000000000001},{"interface":"front","average":{"1min":1.339,"5min":1.395,"15min":1.403},"min":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":1.853,"5min":2.2799999999999998,"15min":2.2799999999999998},"last":1.496}]},{"osd":5,"last update":"Tue Dec 12 09:47:18 2023","interfaces":[{"interface":"back","average":{"1min":1.2110000000000001,"5min":1.331,"15min":1.4039999999999999},"min":{"1min":0.55500000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":2.1419999999999999,"5min":2.1739999999999999,"15min":2.1739999999999999},"last":1.4139999999999999},{"interface":"front","average":{"1min":1.3799999999999999,"5min":1.46,"15min":1.4710000000000001},"min":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"max":{"1min":2.2360000000000002,"5min":2.2360000000000002,"15min":2.2360000000000002},"last":1.653}]},{"osd":7,"last update":"Tue Dec 12 09:47:18 2023","interfaces":[{"interface":"back","average":{"1min":1.266,"5min":1.427,"15min":1.4810000000000001},"min":{"1min":0.67600000000000005,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.736,"5min":1.994,"15min":1.994},"last":1.6080000000000001},{"interface":"front","average":{"1min":1.2689999999999999,"5min":1.427,"15min":1.5009999999999999},"min":{"1min":0.628,"5min":0.628,"15min":0.628},"max":{"1min":1.5820000000000001,"5min":2.0800000000000001,"15min":2.0800000000000001},"last":1.77}]}]},{"osd":5,"up_from":13,"seq":55834574903,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32244,"kb_used_data":1060,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339596,"statfs":{"total":96636764160,"available":96603746304,"internally_reserved":0,"allocated":1085440,"data_stored":486456,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 12 09:47:18 2023","interfaces":[{"interface":"back","average":{"1min":1.097,"5min":1.042,"15min":1.0269999999999999},"min":{"1min":0.84999999999999998,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.4890000000000001,"5min":1.7310000000000001,"15min":1.7310000000000001},"last":0.76800000000000002},{"interface":"front","average":{"1min":1.038,"5min":1.083,"15min":1.1140000000000001},"min":{"1min":0.68500000000000005,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.679,"5min":1.679,"15min":1.679},"last":0.96099999999999997}]},{"osd":1,"last update":"Tue Dec 12 09:47:18 2023","interfaces":[{"interface":"back","average":{"1min":1.266,"5min":1.1579999999999999,"15min":1.2030000000000001},"min":{"1min":0.77600000000000002,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":2.3359999999999999,"5min":2.3359999999999999,"15min":2.3359999999999999},"last":0.82699999999999996},{"interface":"front","average":{"1min":1.2230000000000001,"5min":1.1060000000000001,"15min":1.0960000000000001},"min":{"1min":0.71099999999999997,"5min":0.66400000000000003,"15min":0.66400000000000003},"max":{"1min":2.3780000000000001,"5min":2.3780000000000001,"15min":2.3780000000000001},"last":0.69199999999999995}]},{"osd":2,"last update":"Tue Dec 12 09:47:18 2023","interfaces":[{"interface":"back","average":{"1min":1.04,"5min":1.198,"15min":1.2769999999999999},"min":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"max":{"1min":1.4650000000000001,"5min":1.7889999999999999,"15min":1.7889999999999999},"last":0.65400000000000003},{"interface":"front","average":{"1min":1.1910000000000001,"5min":1.2549999999999999,"15min":1.365},"min":{"1min":0.82399999999999995,"5min":0.72899999999999998,"15min":0.72899999999999998},"max":{"1min":1.9950000000000001,"5min":2.1600000000000001,"15min":2.1600000000000001},"last":1.073}]},{"osd":3,"last update":"Tue Dec 12 09:47:18 2023","interfaces":[{"interface":"back","average":{"1min":1.226,"5min":1.2669999999999999,"15min":1.3360000000000001},"min":{"1min":0.83399999999999996,"5min":0.77300000000000002,"15min":0.77300000000000002},"max":{"1min":1.831,"5min":2.1499999999999999,"15min":2.1499999999999999},"last":0.80100000000000005},{"interface":"front","average":{"1min":1.254,"5min":1.3660000000000001,"15min":1.45},"min":{"1min":0.879,"5min":0.75800000000000001,"15min":0.75800000000000001},"max":{"1min":1.7410000000000001,"5min":2.0249999999999999,"15min":2.0249999999999999},"last":0.88400000000000001}]},{"osd":4,"last update":"Tue Dec 12 09:47:18 2023","interfaces":[{"interface":"back","average":{"1min":1.361,"5min":1.3759999999999999,"15min":1.452},"min":{"1min":0.747,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":2.488,"5min":2.488,"15min":2.488},"last":1.4750000000000001},{"interface":"front","average":{"1min":1.4259999999999999,"5min":1.498,"15min":1.5580000000000001},"min":{"1min":0.71299999999999997,"5min":0.65300000000000002,"15min":0.65300000000000002},"max":{"1min":2.5870000000000002,"5min":2.6040000000000001,"15min":2.6040000000000001},"last":1.27}]},{"osd":6,"last update":"Tue Dec 12 09:47:18 2023","interfaces":[{"interface":"back","average":{"1min":1.28,"5min":1.448,"15min":1.546},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.9359999999999999,"5min":2.1179999999999999,"15min":2.1179999999999999},"last":1.121},{"interface":"front","average":{"1min":1.345,"5min":1.452,"15min":1.571},"min":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":2.6589999999999998,"5min":2.6589999999999998,"15min":2.6589999999999998},"last":1.1879999999999999}]},{"osd":7,"last update":"Tue Dec 12 09:47:18 2023","interfaces":[{"interface":"back","average":{"1min":1.548,"5min":1.6399999999999999,"15min":1.736},"min":{"1min":0.90500000000000003,"5min":0.83699999999999997,"15min":0.83699999999999997},"max":{"1min":2.8519999999999999,"5min":2.8519999999999999,"15min":2.8519999999999999},"last":1.3320000000000001},{"interface":"front","average":{"1min":1.4219999999999999,"5min":1.595,"15min":1.6970000000000001},"min":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"max":{"1min":2.0619999999999998,"5min":2.4910000000000001,"15min":2.4910000000000001},"last":1.0369999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574905,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32240,"kb_used_data":1060,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339600,"statfs":{"total":96636764160,"available":96603750400,"internally_reserved":0,"allocated":1085440,"data_stored":486456,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 12 09:47:20 2023","interfaces":[{"interface":"back","average":{"1min":1.107,"5min":1.0649999999999999,"15min":1.0580000000000001},"min":{"1min":0.70099999999999996,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":1.6579999999999999,"5min":1.7010000000000001,"15min":1.7010000000000001},"last":1.002},{"interface":"front","average":{"1min":1.266,"5min":1.1020000000000001,"15min":1.0700000000000001},"min":{"1min":0.90200000000000002,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":2.2010000000000001,"5min":2.2010000000000001,"15min":2.2010000000000001},"last":0.90200000000000002}]},{"osd":1,"last update":"Tue Dec 12 09:47:20 2023","interfaces":[{"interface":"back","average":{"1min":1.0229999999999999,"5min":1.044,"15min":1.044},"min":{"1min":0.69699999999999995,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":1.6180000000000001,"5min":1.6180000000000001,"15min":1.6180000000000001},"last":1.165},{"interface":"front","average":{"1min":1.2330000000000001,"5min":1.1739999999999999,"15min":1.1779999999999999},"min":{"1min":0.76100000000000001,"5min":0.73699999999999999,"15min":0.73699999999999999},"max":{"1min":2.1600000000000001,"5min":2.1600000000000001,"15min":2.1600000000000001},"last":0.81100000000000005}]},{"osd":2,"last update":"Tue Dec 12 09:47:20 2023","interfaces":[{"interface":"back","average":{"1min":1.131,"5min":1.139,"15min":1.125},"min":{"1min":0.82699999999999996,"5min":0.71299999999999997,"15min":0.71299999999999997},"max":{"1min":1.798,"5min":1.798,"15min":1.798},"last":1.216},{"interface":"front","average":{"1min":1.3300000000000001,"5min":1.276,"15min":1.288},"min":{"1min":0.84499999999999997,"5min":0.75600000000000001,"15min":0.75600000000000001},"max":{"1min":2.2650000000000001,"5min":2.2650000000000001,"15min":2.2650000000000001},"last":1.1160000000000001}]},{"osd":3,"last update":"Tue Dec 12 09:47:20 2023","interfaces":[{"interface":"back","average":{"1min":1.2689999999999999,"5min":1.258,"15min":1.2210000000000001},"min":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"max":{"1min":1.948,"5min":1.948,"15min":1.948},"last":1.0589999999999999},{"interface":"front","average":{"1min":1.2050000000000001,"5min":1.228,"15min":1.234},"min":{"1min":0.80600000000000005,"5min":0.70599999999999996,"15min":0.70599999999999996},"max":{"1min":1.798,"5min":2.0499999999999998,"15min":2.0499999999999998},"last":1.2669999999999999}]},{"osd":5,"last update":"Tue Dec 12 09:47:20 2023","interfaces":[{"interface":"back","average":{"1min":1.399,"5min":1.4039999999999999,"15min":1.446},"min":{"1min":0.76800000000000002,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":2.0329999999999999,"5min":2.3159999999999998,"15min":2.3159999999999998},"last":1.4350000000000001},{"interface":"front","average":{"1min":1.3959999999999999,"5min":1.389,"15min":1.363},"min":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"max":{"1min":2.0030000000000001,"5min":2.117,"15min":2.117},"last":1.351}]},{"osd":6,"last update":"Tue Dec 12 09:47:20 2023","interfaces":[{"interface":"back","average":{"1min":1.3029999999999999,"5min":1.361,"15min":1.389},"min":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"max":{"1min":1.625,"5min":2.246,"15min":2.246},"last":1.3819999999999999},{"interface":"front","average":{"1min":1.488,"5min":1.5209999999999999,"15min":1.5389999999999999},"min":{"1min":0.70899999999999996,"5min":0.65600000000000003,"15min":0.65600000000000003},"max":{"1min":2.093,"5min":2.5099999999999998,"15min":2.5099999999999998},"last":1.3120000000000001}]},{"osd":7,"last update":"Tue Dec 12 09:47:20 2023","interfaces":[{"interface":"back","average":{"1min":1.484,"5min":1.5049999999999999,"15min":1.5049999999999999},"min":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"max":{"1min":2.0619999999999998,"5min":2.5710000000000002,"15min":2.5710000000000002},"last":1.482},{"interface":"front","average":{"1min":1.464,"5min":1.512,"15min":1.512},"min":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"max":{"1min":1.994,"5min":2.3919999999999999,"15min":2.3919999999999999},"last":1.5129999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574903,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32240,"kb_used_data":1060,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339600,"statfs":{"total":96636764160,"available":96603750400,"internally_reserved":0,"allocated":1085440,"data_stored":486456,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 12 09:47:21 2023","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.80800000000000005,"15min":0.878},"min":{"1min":0.32300000000000001,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":1.1339999999999999,"5min":1.4830000000000001,"15min":1.4830000000000001},"last":0.85799999999999998},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.93400000000000005,"15min":1.069},"min":{"1min":0.48499999999999999,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":1.4730000000000001,"5min":3.3370000000000002,"15min":3.3370000000000002},"last":1.01}]},{"osd":1,"last update":"Tue Dec 12 09:47:21 2023","interfaces":[{"interface":"back","average":{"1min":0.85199999999999998,"5min":0.86099999999999999,"15min":0.90000000000000002},"min":{"1min":0.38600000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":1.446,"5min":1.4870000000000001,"15min":1.4870000000000001},"last":1.1879999999999999},{"interface":"front","average":{"1min":0.96499999999999997,"5min":1,"15min":1.046},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.4970000000000001,"5min":2.9409999999999998,"15min":2.9409999999999998},"last":1.1319999999999999}]},{"osd":2,"last update":"Tue Dec 12 09:47:21 2023","interfaces":[{"interface":"back","average":{"1min":0.92200000000000004,"5min":1.0229999999999999,"15min":1.1319999999999999},"min":{"1min":0.42399999999999999,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.345,"5min":2.613,"15min":2.613},"last":0.93700000000000006},{"interface":"front","average":{"1min":0.92500000000000004,"5min":1.048,"15min":1.139},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":1.4179999999999999,"5min":3.0430000000000001,"15min":3.0430000000000001},"last":0.80900000000000005}]},{"osd":4,"last update":"Tue Dec 12 09:47:21 2023","interfaces":[{"interface":"back","average":{"1min":1.0409999999999999,"5min":1.2310000000000001,"15min":1.3320000000000001},"min":{"1min":0.64000000000000001,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.478,"5min":3.5019999999999998,"15min":3.5019999999999998},"last":1.2649999999999999},{"interface":"front","average":{"1min":1.1910000000000001,"5min":1.2969999999999999,"15min":1.421},"min":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.8089999999999999,"5min":2.9889999999999999,"15min":2.9889999999999999},"last":1.3879999999999999}]},{"osd":5,"last update":"Tue Dec 12 09:47:21 2023","interfaces":[{"interface":"back","average":{"1min":1.149,"5min":1.341,"15min":1.4470000000000001},"min":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":1.542,"5min":4.2480000000000002,"15min":4.2480000000000002},"last":1.2350000000000001},{"interface":"front","average":{"1min":1.0880000000000001,"5min":1.3440000000000001,"15min":1.5089999999999999},"min":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.583,"5min":5.5060000000000002,"15min":5.5060000000000002},"last":1.3600000000000001}]},{"osd":6,"last update":"Tue Dec 12 09:47:21 2023","interfaces":[{"interface":"back","average":{"1min":1.238,"5min":1.3089999999999999,"15min":1.4079999999999999},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.714,"5min":3.1400000000000001,"15min":3.1400000000000001},"last":1.45},{"interface":"front","average":{"1min":1.2490000000000001,"5min":1.397,"15min":1.4970000000000001},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.6120000000000001,"5min":4.3179999999999996,"15min":4.3179999999999996},"last":1.294}]},{"osd":7,"last update":"Tue Dec 12 09:47:21 2023","interfaces":[{"interface":"back","average":{"1min":1.206,"5min":1.3859999999999999,"15min":1.5229999999999999},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.679,"5min":5.3979999999999997,"15min":5.3979999999999997},"last":1.423},{"interface":"front","average":{"1min":1.2929999999999999,"5min":1.3999999999999999,"15min":1.502},"min":{"1min":0.623,"5min":0.623,"15min":0.623},"max":{"1min":1.9690000000000001,"5min":3.4129999999999998,"15min":3.4129999999999998},"last":1.3360000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574903,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32244,"kb_used_data":1060,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339596,"statfs":{"total":96636764160,"available":96603746304,"internally_reserved":0,"allocated":1085440,"data_stored":486456,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 12 09:47:20 2023","interfaces":[{"interface":"back","average":{"1min":0.79200000000000004,"5min":0.79800000000000004,"15min":0.81200000000000006},"min":{"1min":0.40000000000000002,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":1.395,"5min":1.458,"15min":1.458},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.81499999999999995,"5min":0.875,"15min":0.90000000000000002},"min":{"1min":0.40100000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":1.28,"5min":2.4129999999999998,"15min":2.4129999999999998},"last":0.875}]},{"osd":1,"last update":"Tue Dec 12 09:47:20 2023","interfaces":[{"interface":"back","average":{"1min":0.91000000000000003,"5min":0.85599999999999998,"15min":0.86099999999999999},"min":{"1min":0.45800000000000002,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":1.5649999999999999,"5min":1.593,"15min":1.593},"last":1.446},{"interface":"front","average":{"1min":0.97699999999999998,"5min":0.91500000000000004,"15min":0.89600000000000002},"min":{"1min":0.55200000000000005,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.413,"5min":1.758,"15min":1.758},"last":1.177}]},{"osd":3,"last update":"Tue Dec 12 09:47:20 2023","interfaces":[{"interface":"back","average":{"1min":0.98599999999999999,"5min":1.0189999999999999,"15min":1.044},"min":{"1min":0.60599999999999998,"5min":0.503,"15min":0.503},"max":{"1min":1.506,"5min":1.889,"15min":1.889},"last":1.0840000000000001},{"interface":"front","average":{"1min":0.875,"5min":0.93400000000000005,"15min":0.98399999999999999},"min":{"1min":0.48499999999999999,"5min":0.432,"15min":0.432},"max":{"1min":1.298,"5min":1.8120000000000001,"15min":1.8120000000000001},"last":0.77400000000000002}]},{"osd":4,"last update":"Tue Dec 12 09:47:20 2023","interfaces":[{"interface":"back","average":{"1min":1.157,"5min":1.177,"15min":1.21},"min":{"1min":0.83799999999999997,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.5409999999999999,"5min":2.5760000000000001,"15min":2.5760000000000001},"last":1.331},{"interface":"front","average":{"1min":1.254,"5min":1.28,"15min":1.3560000000000001},"min":{"1min":0.84899999999999998,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.613,"5min":2.8069999999999999,"15min":2.8069999999999999},"last":1.5049999999999999}]},{"osd":5,"last update":"Tue Dec 12 09:47:20 2023","interfaces":[{"interface":"back","average":{"1min":1.2470000000000001,"5min":1.3100000000000001,"15min":1.3560000000000001},"min":{"1min":0.89500000000000002,"5min":0.80500000000000005,"15min":0.80500000000000005},"max":{"1min":1.5720000000000001,"5min":2.3109999999999999,"15min":2.3109999999999999},"last":1.5700000000000001},{"interface":"front","average":{"1min":1.1950000000000001,"5min":1.25,"15min":1.3169999999999999},"min":{"1min":0.78400000000000003,"5min":0.627,"15min":0.627},"max":{"1min":1.7390000000000001,"5min":2.5110000000000001,"15min":2.5110000000000001},"last":1.226}]},{"osd":6,"last update":"Tue Dec 12 09:47:20 2023","interfaces":[{"interface":"back","average":{"1min":1.3109999999999999,"5min":1.3540000000000001,"15min":1.409},"min":{"1min":0.92600000000000005,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":1.6319999999999999,"5min":2.907,"15min":2.907},"last":1.306},{"interface":"front","average":{"1min":1.242,"5min":1.363,"15min":1.407},"min":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"max":{"1min":1.7509999999999999,"5min":2.6000000000000001,"15min":2.6000000000000001},"last":1.2729999999999999}]},{"osd":7,"last update":"Tue Dec 12 09:47:20 2023","interfaces":[{"interface":"back","average":{"1min":1.3220000000000001,"5min":1.3740000000000001,"15min":1.429},"min":{"1min":0.90900000000000003,"5min":0.70799999999999996,"15min":0.70799999999999996},"max":{"1min":1.577,"5min":2.3370000000000002,"15min":2.3370000000000002},"last":1.653},{"interface":"front","average":{"1min":1.3480000000000001,"5min":1.4330000000000001,"15min":1.486},"min":{"1min":0.94699999999999995,"5min":0.84199999999999997,"15min":0.84199999999999997},"max":{"1min":1.8109999999999999,"5min":2.488,"15min":2.488},"last":1.3620000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574903,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32244,"kb_used_data":1060,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339596,"statfs":{"total":96636764160,"available":96603746304,"internally_reserved":0,"allocated":1085440,"data_stored":486456,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 12 09:47:18 2023","interfaces":[{"interface":"back","average":{"1min":0.85799999999999998,"5min":0.83799999999999997,"15min":0.84999999999999998},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":1.46,"5min":2.794,"15min":2.794},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.751,"5min":0.80300000000000005,"15min":0.84499999999999997},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":1.6359999999999999,"5min":2.1379999999999999,"15min":2.1379999999999999},"last":0.71899999999999997}]},{"osd":2,"last update":"Tue Dec 12 09:47:18 2023","interfaces":[{"interface":"back","average":{"1min":0.83399999999999996,"5min":0.90500000000000003,"15min":0.95899999999999996},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":1.2509999999999999,"5min":6.3390000000000004,"15min":6.3390000000000004},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.90400000000000003,"5min":0.93400000000000005,"15min":0.95599999999999996},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.3400000000000001,"5min":2.823,"15min":2.823},"last":0.754}]},{"osd":3,"last update":"Tue Dec 12 09:47:18 2023","interfaces":[{"interface":"back","average":{"1min":0.90900000000000003,"5min":1.004,"15min":1.0349999999999999},"min":{"1min":0.48999999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":1.919,"5min":2.7519999999999998,"15min":2.7519999999999998},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.879,"5min":0.95899999999999996,"15min":0.99099999999999999},"min":{"1min":0.434,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":1.4430000000000001,"5min":2.2559999999999998,"15min":2.2559999999999998},"last":0.78600000000000003}]},{"osd":4,"last update":"Tue Dec 12 09:47:18 2023","interfaces":[{"interface":"back","average":{"1min":1.097,"5min":1.232,"15min":1.343},"min":{"1min":0.73499999999999999,"5min":0.68400000000000005,"15min":0.68400000000000005},"max":{"1min":1.883,"5min":6.423,"15min":6.423},"last":1.0640000000000001},{"interface":"front","average":{"1min":1.1970000000000001,"5min":1.1910000000000001,"15min":1.1930000000000001},"min":{"1min":0.84299999999999997,"5min":0.80000000000000004,"15min":0.80000000000000004},"max":{"1min":1.9590000000000001,"5min":2.2309999999999999,"15min":2.2309999999999999},"last":0.93600000000000005}]},{"osd":5,"last update":"Tue Dec 12 09:47:18 2023","interfaces":[{"interface":"back","average":{"1min":1.236,"5min":1.3069999999999999,"15min":1.413},"min":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"max":{"1min":2.556,"5min":6.2830000000000004,"15min":6.2830000000000004},"last":1.2849999999999999},{"interface":"front","average":{"1min":1.242,"5min":1.2989999999999999,"15min":1.349},"min":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"max":{"1min":2.3999999999999999,"5min":2.73,"15min":2.73},"last":1.153}]},{"osd":6,"last update":"Tue Dec 12 09:47:18 2023","interfaces":[{"interface":"back","average":{"1min":1.2490000000000001,"5min":1.3839999999999999,"15min":1.5009999999999999},"min":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"max":{"1min":1.8520000000000001,"5min":6.468,"15min":6.468},"last":1.2450000000000001},{"interface":"front","average":{"1min":1.222,"5min":1.375,"15min":1.5109999999999999},"min":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"max":{"1min":1.978,"5min":6.3129999999999997,"15min":6.3129999999999997},"last":1.319}]},{"osd":7,"last update":"Tue Dec 12 09:47:18 2023","interfaces":[{"interface":"back","average":{"1min":1.1879999999999999,"5min":1.333,"15min":1.3819999999999999},"min":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"max":{"1min":1.8600000000000001,"5min":2.9009999999999998,"15min":2.9009999999999998},"last":1.262},{"interface":"front","average":{"1min":1.1919999999999999,"5min":1.3799999999999999,"15min":1.4970000000000001},"min":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"max":{"1min":2.012,"5min":6.242,"15min":6.242},"last":1.1799999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574905,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32304,"kb_used_data":1124,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339536,"statfs":{"total":96636764160,"available":96603684864,"internally_reserved":0,"allocated":1150976,"data_stored":1076824,"data_compressed":32422,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Dec 12 09:47:21 2023","interfaces":[{"interface":"back","average":{"1min":0.82299999999999995,"5min":0.79000000000000004,"15min":0.77700000000000002},"min":{"1min":0.45600000000000002,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":1.446,"5min":1.639,"15min":1.639},"last":0.88900000000000001},{"interface":"front","average":{"1min":0.86799999999999999,"5min":0.83999999999999997,"15min":0.82399999999999995},"min":{"1min":0.39400000000000002,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":1.3979999999999999,"5min":1.5680000000000001,"15min":1.5680000000000001},"last":1.1579999999999999}]},{"osd":2,"last update":"Tue Dec 12 09:47:21 2023","interfaces":[{"interface":"back","average":{"1min":0.90100000000000002,"5min":0.88800000000000001,"15min":0.87},"min":{"1min":0.58699999999999997,"5min":0.316,"15min":0.316},"max":{"1min":1.4910000000000001,"5min":1.748,"15min":1.748},"last":1.075},{"interface":"front","average":{"1min":0.94399999999999995,"5min":0.96399999999999997,"15min":0.98399999999999999},"min":{"1min":0.47299999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":1.4910000000000001,"5min":1.649,"15min":1.649},"last":0.93600000000000005}]},{"osd":3,"last update":"Tue Dec 12 09:47:21 2023","interfaces":[{"interface":"back","average":{"1min":0.96199999999999997,"5min":0.86299999999999999,"15min":0.85599999999999998},"min":{"1min":0.42999999999999999,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":2.1800000000000002,"5min":2.1800000000000002,"15min":2.1800000000000002},"last":0.63},{"interface":"front","average":{"1min":1.034,"5min":1.0189999999999999,"15min":1.0089999999999999},"min":{"1min":0.55100000000000005,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":1.877,"5min":2.3210000000000002,"15min":2.3210000000000002},"last":1.3380000000000001}]},{"osd":4,"last update":"Tue Dec 12 09:47:21 2023","interfaces":[{"interface":"back","average":{"1min":1.2310000000000001,"5min":1.2729999999999999,"15min":1.282},"min":{"1min":0.86199999999999999,"5min":0.80400000000000005,"15min":0.80400000000000005},"max":{"1min":1.758,"5min":2.073,"15min":2.073},"last":1.2649999999999999},{"interface":"front","average":{"1min":1.3460000000000001,"5min":1.276,"15min":1.2869999999999999},"min":{"1min":0.90500000000000003,"5min":0.64400000000000002,"15min":0.64400000000000002},"max":{"1min":2.0990000000000002,"5min":3.0699999999999998,"15min":3.0699999999999998},"last":1.3140000000000001}]},{"osd":5,"last update":"Tue Dec 12 09:47:21 2023","interfaces":[{"interface":"back","average":{"1min":1.2629999999999999,"5min":1.2150000000000001,"15min":1.2270000000000001},"min":{"1min":0.71199999999999997,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":2.2730000000000001,"5min":3.1909999999999998,"15min":3.1909999999999998},"last":1.236},{"interface":"front","average":{"1min":1.3120000000000001,"5min":1.2929999999999999,"15min":1.302},"min":{"1min":0.88500000000000001,"5min":0.67300000000000004,"15min":0.67300000000000004},"max":{"1min":1.7110000000000001,"5min":2.2120000000000002,"15min":2.2120000000000002},"last":1.1910000000000001}]},{"osd":6,"last update":"Tue Dec 12 09:47:21 2023","interfaces":[{"interface":"back","average":{"1min":1.278,"5min":1.3220000000000001,"15min":1.3320000000000001},"min":{"1min":0.83199999999999996,"5min":0.67500000000000004,"15min":0.67500000000000004},"max":{"1min":1.6180000000000001,"5min":2.04,"15min":2.04},"last":1.4390000000000001},{"interface":"front","average":{"1min":1.321,"5min":1.3520000000000001,"15min":1.3779999999999999},"min":{"1min":0.80900000000000005,"5min":0.67500000000000004,"15min":0.67500000000000004},"max":{"1min":2.0670000000000002,"5min":2.9100000000000001,"15min":2.9100000000000001},"last":1.407}]},{"osd":7,"last update":"Tue Dec 12 09:47:21 2023","interfaces":[{"interface":"back","average":{"1min":1.423,"5min":1.4079999999999999,"15min":1.4319999999999999},"min":{"1min":0.999,"5min":0.66800000000000004,"15min":0.66800000000000004},"max":{"1min":1.8200000000000001,"5min":2.992,"15min":2.992},"last":1.115},{"interface":"front","average":{"1min":1.3879999999999999,"5min":1.3380000000000001,"15min":1.3320000000000001},"min":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"max":{"1min":1.9299999999999999,"5min":2.7690000000000001,"15min":2.7690000000000001},"last":1.381}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32422,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32422,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-12T09:47:40.569 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2023-12-12T09:43:15.931922+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=12, tm_hour=9, tm_min=43, tm_sec=15, tm_wday=1, tm_yday=346, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=12, tm_hour=9, tm_min=47, tm_sec=33, tm_wday=1, tm_yday=346, tm_isdst=0) 2023-12-12T09:47:40.569 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-12-12T09:47:49.416 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T09:47:49.426 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T09:48:00.570 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-12T09:48:00.798 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:48:00.795+0000 7f9fa2a90640 1 Processor -- start 2023-12-12T09:48:00.799 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:48:00.796+0000 7f9fa2a90640 1 -- start start 2023-12-12T09:48:00.799 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:48:00.797+0000 7f9fa2a90640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9f9c06db70 0x7f9f9c0c39b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:48:00.799 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:48:00.797+0000 7f9fa2a90640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f9c152610 con 0x7f9f9c14fa40 2023-12-12T09:48:00.799 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:48:00.797+0000 7f9fa2a90640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f9c1528f0 con 0x7f9f9c0c5070 2023-12-12T09:48:00.799 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:48:00.797+0000 7f9fa2a90640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f9c152bd0 con 0x7f9f9c06db70 2023-12-12T09:48:00.801 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:48:00.797+0000 7f9fa082c640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f9f9c14fa40 0x7f9f9c06a4e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:51160/0 (socket says 172.21.15.73:51160) 2023-12-12T09:48:00.802 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:48:00.797+0000 7f9fa082c640 1 -- 172.21.15.73:0/878167108 learned_addr learned my addr 172.21.15.73:0/878167108 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-12T09:48:00.802 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:48:00.798+0000 7f9f9bfff640 1 --2- 172.21.15.73:0/878167108 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9f9c06db70 0x7f9f9c0c39b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:48:00.802 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:48:00.798+0000 7f9f9b7fe640 1 -- 172.21.15.73:0/878167108 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 787517865 0 0) 0x7f9f9c152610 con 0x7f9f9c14fa40 2023-12-12T09:48:00.802 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:48:00.798+0000 7f9f9b7fe640 1 -- 172.21.15.73:0/878167108 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9f8c003520 con 0x7f9f9c14fa40 2023-12-12T09:48:00.803 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:48:00.798+0000 7f9f9b7fe640 1 -- 172.21.15.73:0/878167108 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3723627645 0 0) 0x7f9f8c003520 con 0x7f9f9c14fa40 2023-12-12T09:48:00.803 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:48:00.798+0000 7f9f9b7fe640 1 -- 172.21.15.73:0/878167108 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9f9c06db70 msgr2=0x7f9f9c0c39b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:48:00.803 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:48:00.798+0000 7f9f9b7fe640 1 --2- 172.21.15.73:0/878167108 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9f9c06db70 0x7f9f9c0c39b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:48:00.803 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:48:00.798+0000 7f9f9b7fe640 1 -- 172.21.15.73:0/878167108 >> v1:172.21.15.142:6789/0 conn(0x7f9f9c0c5070 legacy=0x7f9f9c0c3ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:48:00.803 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:48:00.798+0000 7f9f9b7fe640 1 -- 172.21.15.73:0/878167108 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f9c152eb0 con 0x7f9f9c14fa40 2023-12-12T09:48:00.803 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:48:00.798+0000 7f9f9b7fe640 1 -- 172.21.15.73:0/878167108 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3186547832 0 0) 0x7f9f90001670 con 0x7f9f9c14fa40 2023-12-12T09:48:00.803 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:48:00.798+0000 7f9f9b7fe640 1 -- 172.21.15.73:0/878167108 >> v1:172.21.15.73:6789/0 conn(0x7f9f9c14fa40 legacy=0x7f9f9c06a4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:48:00.803 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:48:00.798+0000 7f9f9b7fe640 1 --2- 172.21.15.73:0/878167108 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9f8c0039a0 0x7f9f8c003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:48:00.804 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:48:00.798+0000 7f9f9b7fe640 1 --2- 172.21.15.73:0/878167108 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9f9c06db70 0x7f9f8c0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:48:00.804 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:48:00.798+0000 7f9f9b7fe640 1 --2- 172.21.15.73:0/878167108 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9f8c004d00 0x7f9f8c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:48:00.804 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:48:00.798+0000 7f9f9b7fe640 1 -- 172.21.15.73:0/878167108 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f9c152bd0 con 0x7f9f8c0039a0 2023-12-12T09:48:00.804 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:48:00.798+0000 7f9f9b7fe640 1 -- 172.21.15.73:0/878167108 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f8c00ba60 con 0x7f9f8c004d00 2023-12-12T09:48:00.804 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:48:00.798+0000 7f9f9b7fe640 1 -- 172.21.15.73:0/878167108 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f8c00bc20 con 0x7f9f9c06db70 2023-12-12T09:48:00.804 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:48:00.799+0000 7f9fa082c640 1 --2- 172.21.15.73:0/878167108 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9f8c0039a0 0x7f9f8c003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:48:00.804 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:48:00.799+0000 7f9fa082c640 1 -- 172.21.15.73:0/878167108 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9f9c06db70 msgr2=0x7f9f8c0047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:48:00.804 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:48:00.799+0000 7f9f9bfff640 1 --2- 172.21.15.73:0/878167108 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9f9c06db70 0x7f9f8c0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:48:00.804 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:48:00.799+0000 7f9fa082c640 1 --2- 172.21.15.73:0/878167108 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9f9c06db70 0x7f9f8c0047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:48:00.805 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:48:00.799+0000 7f9fa082c640 1 -- 172.21.15.73:0/878167108 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9f8c004d00 msgr2=0x7f9f8c005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:48:00.805 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:48:00.799+0000 7f9fa082c640 1 --2- 172.21.15.73:0/878167108 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9f8c004d00 0x7f9f8c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:48:00.805 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:48:00.799+0000 7f9fa082c640 1 -- 172.21.15.73:0/878167108 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f8c003520 con 0x7f9f8c0039a0 2023-12-12T09:48:00.805 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:48:00.799+0000 7f9f9bfff640 1 --2- 172.21.15.73:0/878167108 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9f9c06db70 0x7f9f8c0047c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:48:00.805 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:48:00.800+0000 7f9fa082c640 1 --2- 172.21.15.73:0/878167108 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9f8c0039a0 0x7f9f8c003dc0 secure :-1 s=READY pgs=1189 cs=0 l=1 rev1=1 crypto rx=0x7f9f90001eb0 tx=0x7f9f8c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=794cb33a4fe48314 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:48:00.808 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:48:00.800+0000 7f9f9b7fe640 1 -- 172.21.15.73:0/878167108 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f90005ad0 con 0x7f9f8c0039a0 2023-12-12T09:48:00.808 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:48:00.800+0000 7f9f9b7fe640 1 -- 172.21.15.73:0/878167108 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f90005c30 con 0x7f9f8c0039a0 2023-12-12T09:48:00.808 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:48:00.800+0000 7f9f9b7fe640 1 -- 172.21.15.73:0/878167108 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f9002c7c0 con 0x7f9f8c0039a0 2023-12-12T09:48:00.808 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:48:00.801+0000 7f9fa2a90640 1 -- 172.21.15.73:0/878167108 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9f8c0039a0 msgr2=0x7f9f8c003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:48:00.809 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:48:00.801+0000 7f9fa2a90640 1 --2- 172.21.15.73:0/878167108 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9f8c0039a0 0x7f9f8c003dc0 secure :-1 s=READY pgs=1189 cs=0 l=1 rev1=1 crypto rx=0x7f9f90001eb0 tx=0x7f9f8c0057f0 comp rx=0 tx=0).stop 2023-12-12T09:48:00.809 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:48:00.801+0000 7f9fa102d640 1 -- 172.21.15.73:0/878167108 reap_dead start 2023-12-12T09:48:00.809 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:48:00.801+0000 7f9fa2a90640 1 -- 172.21.15.73:0/878167108 shutdown_connections 2023-12-12T09:48:00.809 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:48:00.801+0000 7f9fa2a90640 1 -- 172.21.15.73:0/878167108 >> 172.21.15.73:0/878167108 conn(0x7f9f9c0a8130 msgr2=0x7f9f9c0c24b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:48:00.809 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:48:00.801+0000 7f9fa2a90640 1 -- 172.21.15.73:0/878167108 shutdown_connections 2023-12-12T09:48:00.809 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:48:00.801+0000 7f9fa2a90640 1 -- 172.21.15.73:0/878167108 wait complete. 2023-12-12T09:48:00.809 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:48:00.803+0000 7f9fa2a90640 1 Processor -- start 2023-12-12T09:48:00.809 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:48:00.803+0000 7f9fa2a90640 1 -- start start 2023-12-12T09:48:00.809 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:48:00.804+0000 7f9fa2a90640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9f8c0039a0 0x7f9f9c0bf810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:48:00.810 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:48:00.804+0000 7f9fa2a90640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9f9c0a9ce0 0x7f9f9c1ece10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:48:00.810 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:48:00.804+0000 7f9fa2a90640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9f9c1ed350 0x7f9f9c070d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:48:00.810 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:48:00.804+0000 7f9fa2a90640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f9c0c02b0 con 0x7f9f9c0a9ce0 2023-12-12T09:48:00.810 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:48:00.804+0000 7f9fa2a90640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f9c0c0550 con 0x7f9f9c1ed350 2023-12-12T09:48:00.810 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:48:00.804+0000 7f9fa2a90640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f9c0c09e0 con 0x7f9f8c0039a0 2023-12-12T09:48:00.810 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:48:00.804+0000 7f9f9bfff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9f9c0a9ce0 0x7f9f9c1ece10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:48:00.810 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:48:00.804+0000 7f9f9bfff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9f9c0a9ce0 0x7f9f9c1ece10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:36870/0 (socket says 172.21.15.73:36870) 2023-12-12T09:48:00.810 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:48:00.804+0000 7f9f9bfff640 1 -- 172.21.15.73:0/3776460287 learned_addr learned my addr 172.21.15.73:0/3776460287 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:48:00.810 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:48:00.805+0000 7f9fa082c640 1 --2- 172.21.15.73:0/3776460287 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9f8c0039a0 0x7f9f9c0bf810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:48:00.811 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:48:00.805+0000 7f9f9bfff640 1 -- 172.21.15.73:0/3776460287 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9f8c0039a0 msgr2=0x7f9f9c0bf810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:48:00.811 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:48:00.805+0000 7f9fa102d640 1 --2- 172.21.15.73:0/3776460287 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9f9c1ed350 0x7f9f9c070d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:48:00.811 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:48:00.805+0000 7f9f9bfff640 1 --2- 172.21.15.73:0/3776460287 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9f8c0039a0 0x7f9f9c0bf810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:48:00.811 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:48:00.805+0000 7f9f9bfff640 1 -- 172.21.15.73:0/3776460287 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9f9c1ed350 msgr2=0x7f9f9c070d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:48:00.811 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:48:00.805+0000 7f9f9bfff640 1 --2- 172.21.15.73:0/3776460287 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9f9c1ed350 0x7f9f9c070d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:48:00.811 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:48:00.805+0000 7f9f9bfff640 1 -- 172.21.15.73:0/3776460287 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f9c0aa680 con 0x7f9f9c0a9ce0 2023-12-12T09:48:00.811 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:48:00.805+0000 7f9fa082c640 1 --2- 172.21.15.73:0/3776460287 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9f8c0039a0 0x7f9f9c0bf810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:48:00.811 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:48:00.805+0000 7f9f9bfff640 1 --2- 172.21.15.73:0/3776460287 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9f9c0a9ce0 0x7f9f9c1ece10 secure :-1 s=READY pgs=1190 cs=0 l=1 rev1=1 crypto rx=0x7f9f88010880 tx=0x7f9f88010d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:48:00.812 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:48:00.805+0000 7f9f997fa640 1 -- 172.21.15.73:0/3776460287 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f8800eb60 con 0x7f9f9c0a9ce0 2023-12-12T09:48:00.812 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:48:00.805+0000 7f9f997fa640 1 -- 172.21.15.73:0/3776460287 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f8800ecc0 con 0x7f9f9c0a9ce0 2023-12-12T09:48:00.812 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:48:00.805+0000 7f9f997fa640 1 -- 172.21.15.73:0/3776460287 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f8801c400 con 0x7f9f9c0a9ce0 2023-12-12T09:48:00.812 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:48:00.805+0000 7f9fa2a90640 1 -- 172.21.15.73:0/3776460287 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f9c0aa960 con 0x7f9f9c0a9ce0 2023-12-12T09:48:00.812 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:48:00.806+0000 7f9fa2a90640 1 -- 172.21.15.73:0/3776460287 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f9c14dd80 con 0x7f9f9c0a9ce0 2023-12-12T09:48:00.812 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:48:00.807+0000 7f9fa2a90640 1 -- 172.21.15.73:0/3776460287 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f9c0c4580 con 0x7f9f9c0a9ce0 2023-12-12T09:48:00.813 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:48:00.807+0000 7f9f997fa640 1 -- 172.21.15.73:0/3776460287 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f9f8801c560 con 0x7f9f9c0a9ce0 2023-12-12T09:48:00.814 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:48:00.808+0000 7f9f997fa640 1 --2- 172.21.15.73:0/3776460287 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f9f8006ae70 0x7f9f8006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:48:00.814 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:48:00.809+0000 7f9f997fa640 1 -- 172.21.15.73:0/3776460287 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f9f88089940 con 0x7f9f9c0a9ce0 2023-12-12T09:48:00.814 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:48:00.809+0000 7f9fa082c640 1 --2- 172.21.15.73:0/3776460287 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f9f8006ae70 0x7f9f8006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:48:00.814 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:48:00.809+0000 7f9fa082c640 1 --2- 172.21.15.73:0/3776460287 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f9f8006ae70 0x7f9f8006d330 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f9f90034000 tx=0x7f9f90009030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:48:00.814 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:48:00.813+0000 7f9f997fa640 1 -- 172.21.15.73:0/3776460287 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f9f88054d30 con 0x7f9f9c0a9ce0 2023-12-12T09:48:00.999 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:48:00.998+0000 7f9fa2a90640 1 -- 172.21.15.73:0/3776460287 --> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f9f9c067580 con 0x7f9f8006ae70 2023-12-12T09:48:01.002 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:48:01.001+0000 7f9f997fa640 1 -- 172.21.15.73:0/3776460287 <== mgr.4110 v2:172.21.15.73:6832/779985841 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+48580 (secure 0 0 0) 0x7f9f9c067580 con 0x7f9f8006ae70 2023-12-12T09:48:01.003 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-12T09:48:01.004 INFO:teuthology.orchestra.run.smithi073.stderr:dumped all 2023-12-12T09:48:01.005 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:48:01.003+0000 7f9fa2a90640 1 -- 172.21.15.73:0/3776460287 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f9f8006ae70 msgr2=0x7f9f8006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:48:01.006 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:48:01.003+0000 7f9fa2a90640 1 --2- 172.21.15.73:0/3776460287 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f9f8006ae70 0x7f9f8006d330 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f9f90034000 tx=0x7f9f90009030 comp rx=0 tx=0).stop 2023-12-12T09:48:01.006 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:48:01.003+0000 7f9fa2a90640 1 -- 172.21.15.73:0/3776460287 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9f9c0a9ce0 msgr2=0x7f9f9c1ece10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:48:01.006 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:48:01.003+0000 7f9fa2a90640 1 --2- 172.21.15.73:0/3776460287 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9f9c0a9ce0 0x7f9f9c1ece10 secure :-1 s=READY pgs=1190 cs=0 l=1 rev1=1 crypto rx=0x7f9f88010880 tx=0x7f9f88010d40 comp rx=0 tx=0).stop 2023-12-12T09:48:01.006 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:48:01.004+0000 7f9fa2a90640 1 -- 172.21.15.73:0/3776460287 shutdown_connections 2023-12-12T09:48:01.006 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:48:01.004+0000 7f9fa2a90640 1 --2- 172.21.15.73:0/3776460287 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f9f8006ae70 0x7f9f8006d330 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:48:01.006 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:48:01.004+0000 7f9fa2a90640 1 --2- 172.21.15.73:0/3776460287 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9f9c1ed350 0x7f9f9c070d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:48:01.006 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:48:01.004+0000 7f9fa2a90640 1 --2- 172.21.15.73:0/3776460287 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9f9c0a9ce0 0x7f9f9c1ece10 unknown :-1 s=CLOSED pgs=1190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:48:01.006 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:48:01.004+0000 7f9fa2a90640 1 --2- 172.21.15.73:0/3776460287 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9f8c0039a0 0x7f9f9c0bf810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:48:01.007 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:48:01.004+0000 7f9fa2a90640 1 -- 172.21.15.73:0/3776460287 >> 172.21.15.73:0/3776460287 conn(0x7f9f9c0a8130 msgr2=0x7f9f9c06a4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:48:01.007 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:48:01.004+0000 7f9fa2a90640 1 -- 172.21.15.73:0/3776460287 shutdown_connections 2023-12-12T09:48:01.007 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:48:01.004+0000 7f9fa2a90640 1 -- 172.21.15.73:0/3776460287 wait complete. 2023-12-12T09:48:01.025 INFO:teuthology.orchestra.run.smithi073.stdout:{"pg_ready":true,"pg_map":{"version":223,"stamp":"2023-12-12T09:47:59.548816+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":258060,"kb_used_data":8608,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754716660,"statfs":{"total":773094113280,"available":772829859840,"internally_reserved":0,"allocated":8814592,"data_stored":5072384,"data_compressed":64844,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":12752,"internal_metadata":255315504},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003279"},"pg_stats":[{"pgid":"1.0","version":"87'119","reported_seq":234,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-12-12T09:47:45.732407+0000","last_change":"2023-12-12T09:47:45.732478+0000","last_active":"2023-12-12T09:47:45.732407+0000","last_peered":"2023-12-12T09:47:45.732407+0000","last_clean":"2023-12-12T09:47:45.732407+0000","last_became_active":"2023-12-12T09:43:17.200779+0000","last_became_peered":"2023-12-12T09:43:17.200779+0000","last_unstale":"2023-12-12T09:47:45.732407+0000","last_undegraded":"2023-12-12T09:47:45.732407+0000","last_fullsized":"2023-12-12T09:47:45.732407+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"87'119","last_scrub_stamp":"2023-12-12T09:47:45.732244+0000","last_deep_scrub":"87'119","last_deep_scrub_stamp":"2023-12-12T09:47:45.732244+0000","last_clean_scrub_stamp":"2023-12-12T09:47:45.732244+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T16:44:30.837745+0000","scrub_duration":0.011374824,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":64844,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574909,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32300,"kb_used_data":1124,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339540,"statfs":{"total":96636764160,"available":96603688960,"internally_reserved":0,"allocated":1150976,"data_stored":1076824,"data_compressed":32422,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 12 09:47:18 2023","interfaces":[{"interface":"back","average":{"1min":1.0960000000000001,"5min":1.0649999999999999,"15min":1.0209999999999999},"min":{"1min":0.65700000000000003,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.534,"5min":1.8089999999999999,"15min":1.8089999999999999},"last":1.4930000000000001},{"interface":"front","average":{"1min":1.1259999999999999,"5min":1.0640000000000001,"15min":0.99399999999999999},"min":{"1min":0.77700000000000002,"5min":0.66300000000000003,"15min":0.66300000000000003},"max":{"1min":1.544,"5min":1.71,"15min":1.71},"last":1.0720000000000001}]},{"osd":1,"last update":"Tue Dec 12 09:47:18 2023","interfaces":[{"interface":"back","average":{"1min":1.1519999999999999,"5min":1.2010000000000001,"15min":1.1990000000000001},"min":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"max":{"1min":1.5580000000000001,"5min":1.897,"15min":1.897},"last":1.337},{"interface":"front","average":{"1min":1.1719999999999999,"5min":1.1739999999999999,"15min":1.202},"min":{"1min":0.80500000000000005,"5min":0.71499999999999997,"15min":0.71499999999999997},"max":{"1min":1.585,"5min":3.1150000000000002,"15min":3.1150000000000002},"last":1.3680000000000001}]},{"osd":2,"last update":"Tue Dec 12 09:47:18 2023","interfaces":[{"interface":"back","average":{"1min":1.159,"5min":1.214,"15min":1.246},"min":{"1min":0.84499999999999997,"5min":0.77700000000000002,"15min":0.77700000000000002},"max":{"1min":1.544,"5min":2.2050000000000001,"15min":2.2050000000000001},"last":1.4630000000000001},{"interface":"front","average":{"1min":1.075,"5min":1.169,"15min":1.2190000000000001},"min":{"1min":0.74199999999999999,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.4810000000000001,"5min":3.2759999999999998,"15min":3.2759999999999998},"last":1.1990000000000001}]},{"osd":3,"last update":"Tue Dec 12 09:47:18 2023","interfaces":[{"interface":"back","average":{"1min":1.133,"5min":1.2110000000000001,"15min":1.2809999999999999},"min":{"1min":0.80100000000000005,"5min":0.76700000000000002,"15min":0.76700000000000002},"max":{"1min":1.6830000000000001,"5min":3.1819999999999999,"15min":3.1819999999999999},"last":1.298},{"interface":"front","average":{"1min":1.3300000000000001,"5min":1.3009999999999999,"15min":1.2969999999999999},"min":{"1min":0.94399999999999995,"5min":0.72799999999999998,"15min":0.72799999999999998},"max":{"1min":1.641,"5min":1.8740000000000001,"15min":1.8740000000000001},"last":1.258}]},{"osd":4,"last update":"Tue Dec 12 09:47:18 2023","interfaces":[{"interface":"back","average":{"1min":1.3200000000000001,"5min":1.3080000000000001,"15min":1.337},"min":{"1min":0.65900000000000003,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.663,"5min":2.5529999999999999,"15min":2.5529999999999999},"last":1.401},{"interface":"front","average":{"1min":1.3460000000000001,"5min":1.373,"15min":1.427},"min":{"1min":0.623,"5min":0.623,"15min":0.623},"max":{"1min":1.643,"5min":2.3759999999999999,"15min":2.3759999999999999},"last":1.546}]},{"osd":5,"last update":"Tue Dec 12 09:47:18 2023","interfaces":[{"interface":"back","average":{"1min":1.3480000000000001,"5min":1.3500000000000001,"15min":1.3400000000000001},"min":{"1min":0.78100000000000003,"5min":0.622,"15min":0.622},"max":{"1min":1.714,"5min":1.9890000000000001,"15min":1.9890000000000001},"last":0.95099999999999996},{"interface":"front","average":{"1min":1.4510000000000001,"5min":1.482,"15min":1.518},"min":{"1min":0.68700000000000006,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":1.7270000000000001,"5min":2.4159999999999999,"15min":2.4159999999999999},"last":1.1200000000000001}]},{"osd":6,"last update":"Tue Dec 12 09:47:18 2023","interfaces":[{"interface":"back","average":{"1min":1.522,"5min":1.4370000000000001,"15min":1.423},"min":{"1min":0.83799999999999997,"5min":0.70799999999999996,"15min":0.70799999999999996},"max":{"1min":1.8,"5min":2.0510000000000002,"15min":2.0510000000000002},"last":1.4359999999999999},{"interface":"front","average":{"1min":1.5529999999999999,"5min":1.5740000000000001,"15min":1.6140000000000001},"min":{"1min":0.76000000000000001,"5min":0.71899999999999997,"15min":0.71899999999999997},"max":{"1min":1.865,"5min":2.5800000000000001,"15min":2.5800000000000001},"last":1.605}]}]},{"osd":6,"up_from":13,"seq":55834574907,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32248,"kb_used_data":1060,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339592,"statfs":{"total":96636764160,"available":96603742208,"internally_reserved":0,"allocated":1085440,"data_stored":486456,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 12 09:47:18 2023","interfaces":[{"interface":"back","average":{"1min":1.0149999999999999,"5min":1.0720000000000001,"15min":1.1519999999999999},"min":{"1min":0.65000000000000002,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.3859999999999999,"5min":3.6429999999999998,"15min":3.6429999999999998},"last":1.05},{"interface":"front","average":{"1min":1.008,"5min":1.052,"15min":1.0640000000000001},"min":{"1min":0.627,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.7729999999999999,"5min":2.6059999999999999,"15min":2.6059999999999999},"last":1.532}]},{"osd":1,"last update":"Tue Dec 12 09:47:18 2023","interfaces":[{"interface":"back","average":{"1min":1.196,"5min":1.1080000000000001,"15min":1.077},"min":{"1min":0.66400000000000003,"5min":0.64200000000000002,"15min":0.64200000000000002},"max":{"1min":1.5600000000000001,"5min":2.0169999999999999,"15min":2.0169999999999999},"last":1.1160000000000001},{"interface":"front","average":{"1min":1.163,"5min":1.1739999999999999,"15min":1.1919999999999999},"min":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"max":{"1min":1.71,"5min":1.71,"15min":1.71},"last":1.171}]},{"osd":2,"last update":"Tue Dec 12 09:47:18 2023","interfaces":[{"interface":"back","average":{"1min":1.0840000000000001,"5min":1.1839999999999999,"15min":1.218},"min":{"1min":0.77700000000000002,"5min":0.71199999999999997,"15min":0.71199999999999997},"max":{"1min":1.526,"5min":1.804,"15min":1.804},"last":1.2609999999999999},{"interface":"front","average":{"1min":1.1240000000000001,"5min":1.22,"15min":1.282},"min":{"1min":0.72499999999999998,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":1.679,"5min":2.2160000000000002,"15min":2.2160000000000002},"last":1.4390000000000001}]},{"osd":3,"last update":"Tue Dec 12 09:47:18 2023","interfaces":[{"interface":"back","average":{"1min":1.1140000000000001,"5min":1.1910000000000001,"15min":1.2090000000000001},"min":{"1min":0.73199999999999998,"5min":0.71899999999999997,"15min":0.71899999999999997},"max":{"1min":1.5309999999999999,"5min":2.665,"15min":2.665},"last":1.145},{"interface":"front","average":{"1min":1.1180000000000001,"5min":1.1679999999999999,"15min":1.21},"min":{"1min":0.76700000000000002,"5min":0.65700000000000003,"15min":0.65700000000000003},"max":{"1min":1.4710000000000001,"5min":1.8620000000000001,"15min":1.8620000000000001},"last":1.214}]},{"osd":4,"last update":"Tue Dec 12 09:47:18 2023","interfaces":[{"interface":"back","average":{"1min":1.1870000000000001,"5min":1.2669999999999999,"15min":1.272},"min":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.696,"5min":2.0310000000000001,"15min":2.0310000000000001},"last":0.95599999999999996},{"interface":"front","average":{"1min":1.339,"5min":1.395,"15min":1.403},"min":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":1.853,"5min":2.2799999999999998,"15min":2.2799999999999998},"last":1.302}]},{"osd":5,"last update":"Tue Dec 12 09:47:18 2023","interfaces":[{"interface":"back","average":{"1min":1.2110000000000001,"5min":1.331,"15min":1.4039999999999999},"min":{"1min":0.55500000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":2.1419999999999999,"5min":2.1739999999999999,"15min":2.1739999999999999},"last":0.878},{"interface":"front","average":{"1min":1.3799999999999999,"5min":1.46,"15min":1.4710000000000001},"min":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"max":{"1min":2.2360000000000002,"5min":2.2360000000000002,"15min":2.2360000000000002},"last":1.345}]},{"osd":7,"last update":"Tue Dec 12 09:47:18 2023","interfaces":[{"interface":"back","average":{"1min":1.266,"5min":1.427,"15min":1.4810000000000001},"min":{"1min":0.67600000000000005,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.736,"5min":1.994,"15min":1.994},"last":0.99199999999999999},{"interface":"front","average":{"1min":1.2689999999999999,"5min":1.427,"15min":1.5009999999999999},"min":{"1min":0.628,"5min":0.628,"15min":0.628},"max":{"1min":1.5820000000000001,"5min":2.0800000000000001,"15min":2.0800000000000001},"last":1.393}]}]},{"osd":5,"up_from":13,"seq":55834574907,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32244,"kb_used_data":1060,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339596,"statfs":{"total":96636764160,"available":96603746304,"internally_reserved":0,"allocated":1085440,"data_stored":486456,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 12 09:47:18 2023","interfaces":[{"interface":"back","average":{"1min":1.097,"5min":1.042,"15min":1.0269999999999999},"min":{"1min":0.84999999999999998,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.4890000000000001,"5min":1.7310000000000001,"15min":1.7310000000000001},"last":0.89700000000000002},{"interface":"front","average":{"1min":1.038,"5min":1.083,"15min":1.1140000000000001},"min":{"1min":0.68500000000000005,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.679,"5min":1.679,"15min":1.679},"last":0.95699999999999996}]},{"osd":1,"last update":"Tue Dec 12 09:47:18 2023","interfaces":[{"interface":"back","average":{"1min":1.266,"5min":1.1579999999999999,"15min":1.2030000000000001},"min":{"1min":0.77600000000000002,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":2.3359999999999999,"5min":2.3359999999999999,"15min":2.3359999999999999},"last":1.238},{"interface":"front","average":{"1min":1.2230000000000001,"5min":1.1060000000000001,"15min":1.0960000000000001},"min":{"1min":0.71099999999999997,"5min":0.66400000000000003,"15min":0.66400000000000003},"max":{"1min":2.3780000000000001,"5min":2.3780000000000001,"15min":2.3780000000000001},"last":1.5449999999999999}]},{"osd":2,"last update":"Tue Dec 12 09:47:18 2023","interfaces":[{"interface":"back","average":{"1min":1.04,"5min":1.198,"15min":1.2769999999999999},"min":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"max":{"1min":1.4650000000000001,"5min":1.7889999999999999,"15min":1.7889999999999999},"last":1.1859999999999999},{"interface":"front","average":{"1min":1.1910000000000001,"5min":1.2549999999999999,"15min":1.365},"min":{"1min":0.82399999999999995,"5min":0.72899999999999998,"15min":0.72899999999999998},"max":{"1min":1.9950000000000001,"5min":2.1600000000000001,"15min":2.1600000000000001},"last":1.379}]},{"osd":3,"last update":"Tue Dec 12 09:47:18 2023","interfaces":[{"interface":"back","average":{"1min":1.226,"5min":1.2669999999999999,"15min":1.3360000000000001},"min":{"1min":0.83399999999999996,"5min":0.77300000000000002,"15min":0.77300000000000002},"max":{"1min":1.831,"5min":2.1499999999999999,"15min":2.1499999999999999},"last":1.4670000000000001},{"interface":"front","average":{"1min":1.254,"5min":1.3660000000000001,"15min":1.45},"min":{"1min":0.879,"5min":0.75800000000000001,"15min":0.75800000000000001},"max":{"1min":1.7410000000000001,"5min":2.0249999999999999,"15min":2.0249999999999999},"last":1.6160000000000001}]},{"osd":4,"last update":"Tue Dec 12 09:47:18 2023","interfaces":[{"interface":"back","average":{"1min":1.361,"5min":1.3759999999999999,"15min":1.452},"min":{"1min":0.747,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":2.488,"5min":2.488,"15min":2.488},"last":1.0349999999999999},{"interface":"front","average":{"1min":1.4259999999999999,"5min":1.498,"15min":1.5580000000000001},"min":{"1min":0.71299999999999997,"5min":0.65300000000000002,"15min":0.65300000000000002},"max":{"1min":2.5870000000000002,"5min":2.6040000000000001,"15min":2.6040000000000001},"last":1.3009999999999999}]},{"osd":6,"last update":"Tue Dec 12 09:47:18 2023","interfaces":[{"interface":"back","average":{"1min":1.28,"5min":1.448,"15min":1.546},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.9359999999999999,"5min":2.1179999999999999,"15min":2.1179999999999999},"last":1.502},{"interface":"front","average":{"1min":1.345,"5min":1.452,"15min":1.571},"min":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":2.6589999999999998,"5min":2.6589999999999998,"15min":2.6589999999999998},"last":1.571}]},{"osd":7,"last update":"Tue Dec 12 09:47:18 2023","interfaces":[{"interface":"back","average":{"1min":1.548,"5min":1.6399999999999999,"15min":1.736},"min":{"1min":0.90500000000000003,"5min":0.83699999999999997,"15min":0.83699999999999997},"max":{"1min":2.8519999999999999,"5min":2.8519999999999999,"15min":2.8519999999999999},"last":1.653},{"interface":"front","average":{"1min":1.4219999999999999,"5min":1.595,"15min":1.6970000000000001},"min":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"max":{"1min":2.0619999999999998,"5min":2.4910000000000001,"15min":2.4910000000000001},"last":1.681}]}]},{"osd":4,"up_from":13,"seq":55834574909,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32240,"kb_used_data":1060,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339600,"statfs":{"total":96636764160,"available":96603750400,"internally_reserved":0,"allocated":1085440,"data_stored":486456,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 12 09:47:20 2023","interfaces":[{"interface":"back","average":{"1min":1.107,"5min":1.0649999999999999,"15min":1.0580000000000001},"min":{"1min":0.70099999999999996,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":1.6579999999999999,"5min":1.7010000000000001,"15min":1.7010000000000001},"last":1.2450000000000001},{"interface":"front","average":{"1min":1.266,"5min":1.1020000000000001,"15min":1.0700000000000001},"min":{"1min":0.90200000000000002,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":2.2010000000000001,"5min":2.2010000000000001,"15min":2.2010000000000001},"last":0.90400000000000003}]},{"osd":1,"last update":"Tue Dec 12 09:47:20 2023","interfaces":[{"interface":"back","average":{"1min":1.0229999999999999,"5min":1.044,"15min":1.044},"min":{"1min":0.69699999999999995,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":1.6180000000000001,"5min":1.6180000000000001,"15min":1.6180000000000001},"last":1.5089999999999999},{"interface":"front","average":{"1min":1.2330000000000001,"5min":1.1739999999999999,"15min":1.1779999999999999},"min":{"1min":0.76100000000000001,"5min":0.73699999999999999,"15min":0.73699999999999999},"max":{"1min":2.1600000000000001,"5min":2.1600000000000001,"15min":2.1600000000000001},"last":1.3640000000000001}]},{"osd":2,"last update":"Tue Dec 12 09:47:20 2023","interfaces":[{"interface":"back","average":{"1min":1.131,"5min":1.139,"15min":1.125},"min":{"1min":0.82699999999999996,"5min":0.71299999999999997,"15min":0.71299999999999997},"max":{"1min":1.798,"5min":1.798,"15min":1.798},"last":1.415},{"interface":"front","average":{"1min":1.3300000000000001,"5min":1.276,"15min":1.288},"min":{"1min":0.84499999999999997,"5min":0.75600000000000001,"15min":0.75600000000000001},"max":{"1min":2.2650000000000001,"5min":2.2650000000000001,"15min":2.2650000000000001},"last":1.008}]},{"osd":3,"last update":"Tue Dec 12 09:47:20 2023","interfaces":[{"interface":"back","average":{"1min":1.2689999999999999,"5min":1.258,"15min":1.2210000000000001},"min":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"max":{"1min":1.948,"5min":1.948,"15min":1.948},"last":1.3009999999999999},{"interface":"front","average":{"1min":1.2050000000000001,"5min":1.228,"15min":1.234},"min":{"1min":0.80600000000000005,"5min":0.70599999999999996,"15min":0.70599999999999996},"max":{"1min":1.798,"5min":2.0499999999999998,"15min":2.0499999999999998},"last":1.6279999999999999}]},{"osd":5,"last update":"Tue Dec 12 09:47:20 2023","interfaces":[{"interface":"back","average":{"1min":1.399,"5min":1.4039999999999999,"15min":1.446},"min":{"1min":0.76800000000000002,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":2.0329999999999999,"5min":2.3159999999999998,"15min":2.3159999999999998},"last":1.4630000000000001},{"interface":"front","average":{"1min":1.3959999999999999,"5min":1.389,"15min":1.363},"min":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"max":{"1min":2.0030000000000001,"5min":2.117,"15min":2.117},"last":1.1599999999999999}]},{"osd":6,"last update":"Tue Dec 12 09:47:20 2023","interfaces":[{"interface":"back","average":{"1min":1.3029999999999999,"5min":1.361,"15min":1.389},"min":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"max":{"1min":1.625,"5min":2.246,"15min":2.246},"last":1.1299999999999999},{"interface":"front","average":{"1min":1.488,"5min":1.5209999999999999,"15min":1.5389999999999999},"min":{"1min":0.70899999999999996,"5min":0.65600000000000003,"15min":0.65600000000000003},"max":{"1min":2.093,"5min":2.5099999999999998,"15min":2.5099999999999998},"last":1.6499999999999999}]},{"osd":7,"last update":"Tue Dec 12 09:47:20 2023","interfaces":[{"interface":"back","average":{"1min":1.484,"5min":1.5049999999999999,"15min":1.5049999999999999},"min":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"max":{"1min":2.0619999999999998,"5min":2.5710000000000002,"15min":2.5710000000000002},"last":1.581},{"interface":"front","average":{"1min":1.464,"5min":1.512,"15min":1.512},"min":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"max":{"1min":1.994,"5min":2.3919999999999999,"15min":2.3919999999999999},"last":1.7}]}]},{"osd":3,"up_from":13,"seq":55834574907,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32240,"kb_used_data":1060,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339600,"statfs":{"total":96636764160,"available":96603750400,"internally_reserved":0,"allocated":1085440,"data_stored":486456,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 12 09:47:21 2023","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.80800000000000005,"15min":0.878},"min":{"1min":0.32300000000000001,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":1.1339999999999999,"5min":1.4830000000000001,"15min":1.4830000000000001},"last":0.78200000000000003},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.93400000000000005,"15min":1.069},"min":{"1min":0.48499999999999999,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":1.4730000000000001,"5min":3.3370000000000002,"15min":3.3370000000000002},"last":0.86599999999999999}]},{"osd":1,"last update":"Tue Dec 12 09:47:21 2023","interfaces":[{"interface":"back","average":{"1min":0.85199999999999998,"5min":0.86099999999999999,"15min":0.90000000000000002},"min":{"1min":0.38600000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":1.446,"5min":1.4870000000000001,"15min":1.4870000000000001},"last":1.135},{"interface":"front","average":{"1min":0.96499999999999997,"5min":1,"15min":1.046},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.4970000000000001,"5min":2.9409999999999998,"15min":2.9409999999999998},"last":1.49}]},{"osd":2,"last update":"Tue Dec 12 09:47:21 2023","interfaces":[{"interface":"back","average":{"1min":0.92200000000000004,"5min":1.0229999999999999,"15min":1.1319999999999999},"min":{"1min":0.42399999999999999,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.345,"5min":2.613,"15min":2.613},"last":1.6479999999999999},{"interface":"front","average":{"1min":0.92500000000000004,"5min":1.048,"15min":1.139},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":1.4179999999999999,"5min":3.0430000000000001,"15min":3.0430000000000001},"last":1.085}]},{"osd":4,"last update":"Tue Dec 12 09:47:21 2023","interfaces":[{"interface":"back","average":{"1min":1.0409999999999999,"5min":1.2310000000000001,"15min":1.3320000000000001},"min":{"1min":0.64000000000000001,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.478,"5min":3.5019999999999998,"15min":3.5019999999999998},"last":1.046},{"interface":"front","average":{"1min":1.1910000000000001,"5min":1.2969999999999999,"15min":1.421},"min":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.8089999999999999,"5min":2.9889999999999999,"15min":2.9889999999999999},"last":1.421}]},{"osd":5,"last update":"Tue Dec 12 09:47:21 2023","interfaces":[{"interface":"back","average":{"1min":1.149,"5min":1.341,"15min":1.4470000000000001},"min":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":1.542,"5min":4.2480000000000002,"15min":4.2480000000000002},"last":1.371},{"interface":"front","average":{"1min":1.0880000000000001,"5min":1.3440000000000001,"15min":1.5089999999999999},"min":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.583,"5min":5.5060000000000002,"15min":5.5060000000000002},"last":1.1759999999999999}]},{"osd":6,"last update":"Tue Dec 12 09:47:21 2023","interfaces":[{"interface":"back","average":{"1min":1.238,"5min":1.3089999999999999,"15min":1.4079999999999999},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.714,"5min":3.1400000000000001,"15min":3.1400000000000001},"last":1.5329999999999999},{"interface":"front","average":{"1min":1.2490000000000001,"5min":1.397,"15min":1.4970000000000001},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.6120000000000001,"5min":4.3179999999999996,"15min":4.3179999999999996},"last":1.5820000000000001}]},{"osd":7,"last update":"Tue Dec 12 09:47:21 2023","interfaces":[{"interface":"back","average":{"1min":1.206,"5min":1.3859999999999999,"15min":1.5229999999999999},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.679,"5min":5.3979999999999997,"15min":5.3979999999999997},"last":1.343},{"interface":"front","average":{"1min":1.2929999999999999,"5min":1.3999999999999999,"15min":1.502},"min":{"1min":0.623,"5min":0.623,"15min":0.623},"max":{"1min":1.9690000000000001,"5min":3.4129999999999998,"15min":3.4129999999999998},"last":1.7130000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574907,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32244,"kb_used_data":1060,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339596,"statfs":{"total":96636764160,"available":96603746304,"internally_reserved":0,"allocated":1085440,"data_stored":486456,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 12 09:47:20 2023","interfaces":[{"interface":"back","average":{"1min":0.79200000000000004,"5min":0.79800000000000004,"15min":0.81200000000000006},"min":{"1min":0.40000000000000002,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":1.395,"5min":1.458,"15min":1.458},"last":0.89100000000000001},{"interface":"front","average":{"1min":0.81499999999999995,"5min":0.875,"15min":0.90000000000000002},"min":{"1min":0.40100000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":1.28,"5min":2.4129999999999998,"15min":2.4129999999999998},"last":0.95599999999999996}]},{"osd":1,"last update":"Tue Dec 12 09:47:20 2023","interfaces":[{"interface":"back","average":{"1min":0.91000000000000003,"5min":0.85599999999999998,"15min":0.86099999999999999},"min":{"1min":0.45800000000000002,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":1.5649999999999999,"5min":1.593,"15min":1.593},"last":1.1160000000000001},{"interface":"front","average":{"1min":0.97699999999999998,"5min":0.91500000000000004,"15min":0.89600000000000002},"min":{"1min":0.55200000000000005,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.413,"5min":1.758,"15min":1.758},"last":1.079}]},{"osd":3,"last update":"Tue Dec 12 09:47:20 2023","interfaces":[{"interface":"back","average":{"1min":0.98599999999999999,"5min":1.0189999999999999,"15min":1.044},"min":{"1min":0.60599999999999998,"5min":0.503,"15min":0.503},"max":{"1min":1.506,"5min":1.889,"15min":1.889},"last":1.3029999999999999},{"interface":"front","average":{"1min":0.875,"5min":0.93400000000000005,"15min":0.98399999999999999},"min":{"1min":0.48499999999999999,"5min":0.432,"15min":0.432},"max":{"1min":1.298,"5min":1.8120000000000001,"15min":1.8120000000000001},"last":0.81499999999999995}]},{"osd":4,"last update":"Tue Dec 12 09:47:20 2023","interfaces":[{"interface":"back","average":{"1min":1.157,"5min":1.177,"15min":1.21},"min":{"1min":0.83799999999999997,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.5409999999999999,"5min":2.5760000000000001,"15min":2.5760000000000001},"last":1.2090000000000001},{"interface":"front","average":{"1min":1.254,"5min":1.28,"15min":1.3560000000000001},"min":{"1min":0.84899999999999998,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.613,"5min":2.8069999999999999,"15min":2.8069999999999999},"last":1.427}]},{"osd":5,"last update":"Tue Dec 12 09:47:20 2023","interfaces":[{"interface":"back","average":{"1min":1.2470000000000001,"5min":1.3100000000000001,"15min":1.3560000000000001},"min":{"1min":0.89500000000000002,"5min":0.80500000000000005,"15min":0.80500000000000005},"max":{"1min":1.5720000000000001,"5min":2.3109999999999999,"15min":2.3109999999999999},"last":1.3799999999999999},{"interface":"front","average":{"1min":1.1950000000000001,"5min":1.25,"15min":1.3169999999999999},"min":{"1min":0.78400000000000003,"5min":0.627,"15min":0.627},"max":{"1min":1.7390000000000001,"5min":2.5110000000000001,"15min":2.5110000000000001},"last":1.278}]},{"osd":6,"last update":"Tue Dec 12 09:47:20 2023","interfaces":[{"interface":"back","average":{"1min":1.3109999999999999,"5min":1.3540000000000001,"15min":1.409},"min":{"1min":0.92600000000000005,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":1.6319999999999999,"5min":2.907,"15min":2.907},"last":1.246},{"interface":"front","average":{"1min":1.242,"5min":1.363,"15min":1.407},"min":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"max":{"1min":1.7509999999999999,"5min":2.6000000000000001,"15min":2.6000000000000001},"last":1.482}]},{"osd":7,"last update":"Tue Dec 12 09:47:20 2023","interfaces":[{"interface":"back","average":{"1min":1.3220000000000001,"5min":1.3740000000000001,"15min":1.429},"min":{"1min":0.90900000000000003,"5min":0.70799999999999996,"15min":0.70799999999999996},"max":{"1min":1.577,"5min":2.3370000000000002,"15min":2.3370000000000002},"last":1.345},{"interface":"front","average":{"1min":1.3480000000000001,"5min":1.4330000000000001,"15min":1.486},"min":{"1min":0.94699999999999995,"5min":0.84199999999999997,"15min":0.84199999999999997},"max":{"1min":1.8109999999999999,"5min":2.488,"15min":2.488},"last":1.538}]}]},{"osd":1,"up_from":13,"seq":55834574907,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32244,"kb_used_data":1060,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339596,"statfs":{"total":96636764160,"available":96603746304,"internally_reserved":0,"allocated":1085440,"data_stored":486456,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 12 09:47:18 2023","interfaces":[{"interface":"back","average":{"1min":0.85799999999999998,"5min":0.83799999999999997,"15min":0.84999999999999998},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":1.46,"5min":2.794,"15min":2.794},"last":1.121},{"interface":"front","average":{"1min":0.751,"5min":0.80300000000000005,"15min":0.84499999999999997},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":1.6359999999999999,"5min":2.1379999999999999,"15min":2.1379999999999999},"last":0.98699999999999999}]},{"osd":2,"last update":"Tue Dec 12 09:47:18 2023","interfaces":[{"interface":"back","average":{"1min":0.83399999999999996,"5min":0.90500000000000003,"15min":0.95899999999999996},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":1.2509999999999999,"5min":6.3390000000000004,"15min":6.3390000000000004},"last":0.80700000000000005},{"interface":"front","average":{"1min":0.90400000000000003,"5min":0.93400000000000005,"15min":0.95599999999999996},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.3400000000000001,"5min":2.823,"15min":2.823},"last":0.92400000000000004}]},{"osd":3,"last update":"Tue Dec 12 09:47:18 2023","interfaces":[{"interface":"back","average":{"1min":0.90900000000000003,"5min":1.004,"15min":1.0349999999999999},"min":{"1min":0.48999999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":1.919,"5min":2.7519999999999998,"15min":2.7519999999999998},"last":1.24},{"interface":"front","average":{"1min":0.879,"5min":0.95899999999999996,"15min":0.99099999999999999},"min":{"1min":0.434,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":1.4430000000000001,"5min":2.2559999999999998,"15min":2.2559999999999998},"last":1.278}]},{"osd":4,"last update":"Tue Dec 12 09:47:18 2023","interfaces":[{"interface":"back","average":{"1min":1.097,"5min":1.232,"15min":1.343},"min":{"1min":0.73499999999999999,"5min":0.68400000000000005,"15min":0.68400000000000005},"max":{"1min":1.883,"5min":6.423,"15min":6.423},"last":1.3260000000000001},{"interface":"front","average":{"1min":1.1970000000000001,"5min":1.1910000000000001,"15min":1.1930000000000001},"min":{"1min":0.84299999999999997,"5min":0.80000000000000004,"15min":0.80000000000000004},"max":{"1min":1.9590000000000001,"5min":2.2309999999999999,"15min":2.2309999999999999},"last":1.173}]},{"osd":5,"last update":"Tue Dec 12 09:47:18 2023","interfaces":[{"interface":"back","average":{"1min":1.236,"5min":1.3069999999999999,"15min":1.413},"min":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"max":{"1min":2.556,"5min":6.2830000000000004,"15min":6.2830000000000004},"last":1.048},{"interface":"front","average":{"1min":1.242,"5min":1.2989999999999999,"15min":1.349},"min":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"max":{"1min":2.3999999999999999,"5min":2.73,"15min":2.73},"last":1.379}]},{"osd":6,"last update":"Tue Dec 12 09:47:18 2023","interfaces":[{"interface":"back","average":{"1min":1.2490000000000001,"5min":1.3839999999999999,"15min":1.5009999999999999},"min":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"max":{"1min":1.8520000000000001,"5min":6.468,"15min":6.468},"last":1.427},{"interface":"front","average":{"1min":1.222,"5min":1.375,"15min":1.5109999999999999},"min":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"max":{"1min":1.978,"5min":6.3129999999999997,"15min":6.3129999999999997},"last":1.208}]},{"osd":7,"last update":"Tue Dec 12 09:47:18 2023","interfaces":[{"interface":"back","average":{"1min":1.1879999999999999,"5min":1.333,"15min":1.3819999999999999},"min":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"max":{"1min":1.8600000000000001,"5min":2.9009999999999998,"15min":2.9009999999999998},"last":1.4690000000000001},{"interface":"front","average":{"1min":1.1919999999999999,"5min":1.3799999999999999,"15min":1.4970000000000001},"min":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"max":{"1min":2.012,"5min":6.242,"15min":6.242},"last":1.1559999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574909,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32300,"kb_used_data":1124,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339540,"statfs":{"total":96636764160,"available":96603688960,"internally_reserved":0,"allocated":1150976,"data_stored":1076824,"data_compressed":32422,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Dec 12 09:47:21 2023","interfaces":[{"interface":"back","average":{"1min":0.82299999999999995,"5min":0.79000000000000004,"15min":0.77700000000000002},"min":{"1min":0.45600000000000002,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":1.446,"5min":1.639,"15min":1.639},"last":1.216},{"interface":"front","average":{"1min":0.86799999999999999,"5min":0.83999999999999997,"15min":0.82399999999999995},"min":{"1min":0.39400000000000002,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":1.3979999999999999,"5min":1.5680000000000001,"15min":1.5680000000000001},"last":1.292}]},{"osd":2,"last update":"Tue Dec 12 09:47:21 2023","interfaces":[{"interface":"back","average":{"1min":0.90100000000000002,"5min":0.88800000000000001,"15min":0.87},"min":{"1min":0.58699999999999997,"5min":0.316,"15min":0.316},"max":{"1min":1.4910000000000001,"5min":1.748,"15min":1.748},"last":1.3520000000000001},{"interface":"front","average":{"1min":0.94399999999999995,"5min":0.96399999999999997,"15min":0.98399999999999999},"min":{"1min":0.47299999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":1.4910000000000001,"5min":1.649,"15min":1.649},"last":0.997}]},{"osd":3,"last update":"Tue Dec 12 09:47:21 2023","interfaces":[{"interface":"back","average":{"1min":0.96199999999999997,"5min":0.86299999999999999,"15min":0.85599999999999998},"min":{"1min":0.42999999999999999,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":2.1800000000000002,"5min":2.1800000000000002,"15min":2.1800000000000002},"last":0.95699999999999996},{"interface":"front","average":{"1min":1.034,"5min":1.0189999999999999,"15min":1.0089999999999999},"min":{"1min":0.55100000000000005,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":1.877,"5min":2.3210000000000002,"15min":2.3210000000000002},"last":1.425}]},{"osd":4,"last update":"Tue Dec 12 09:47:21 2023","interfaces":[{"interface":"back","average":{"1min":1.2310000000000001,"5min":1.2729999999999999,"15min":1.282},"min":{"1min":0.86199999999999999,"5min":0.80400000000000005,"15min":0.80400000000000005},"max":{"1min":1.758,"5min":2.073,"15min":2.073},"last":1.3959999999999999},{"interface":"front","average":{"1min":1.3460000000000001,"5min":1.276,"15min":1.2869999999999999},"min":{"1min":0.90500000000000003,"5min":0.64400000000000002,"15min":0.64400000000000002},"max":{"1min":2.0990000000000002,"5min":3.0699999999999998,"15min":3.0699999999999998},"last":1.258}]},{"osd":5,"last update":"Tue Dec 12 09:47:21 2023","interfaces":[{"interface":"back","average":{"1min":1.2629999999999999,"5min":1.2150000000000001,"15min":1.2270000000000001},"min":{"1min":0.71199999999999997,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":2.2730000000000001,"5min":3.1909999999999998,"15min":3.1909999999999998},"last":1.1719999999999999},{"interface":"front","average":{"1min":1.3120000000000001,"5min":1.2929999999999999,"15min":1.302},"min":{"1min":0.88500000000000001,"5min":0.67300000000000004,"15min":0.67300000000000004},"max":{"1min":1.7110000000000001,"5min":2.2120000000000002,"15min":2.2120000000000002},"last":1.4750000000000001}]},{"osd":6,"last update":"Tue Dec 12 09:47:21 2023","interfaces":[{"interface":"back","average":{"1min":1.278,"5min":1.3220000000000001,"15min":1.3320000000000001},"min":{"1min":0.83199999999999996,"5min":0.67500000000000004,"15min":0.67500000000000004},"max":{"1min":1.6180000000000001,"5min":2.04,"15min":2.04},"last":1.5840000000000001},{"interface":"front","average":{"1min":1.321,"5min":1.3520000000000001,"15min":1.3779999999999999},"min":{"1min":0.80900000000000005,"5min":0.67500000000000004,"15min":0.67500000000000004},"max":{"1min":2.0670000000000002,"5min":2.9100000000000001,"15min":2.9100000000000001},"last":1.538}]},{"osd":7,"last update":"Tue Dec 12 09:47:21 2023","interfaces":[{"interface":"back","average":{"1min":1.423,"5min":1.4079999999999999,"15min":1.4319999999999999},"min":{"1min":0.999,"5min":0.66800000000000004,"15min":0.66800000000000004},"max":{"1min":1.8200000000000001,"5min":2.992,"15min":2.992},"last":1.458},{"interface":"front","average":{"1min":1.3879999999999999,"5min":1.3380000000000001,"15min":1.3320000000000001},"min":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"max":{"1min":1.9299999999999999,"5min":2.7690000000000001,"15min":2.7690000000000001},"last":1.327}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32422,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32422,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-12T09:48:01.028 DEBUG:teuthology.orchestra.run.smithi073:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2023-12-12T09:48:01.227 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:48:01.225+0000 7f538ae02640 1 Processor -- start 2023-12-12T09:48:01.227 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:48:01.225+0000 7f538ae02640 1 -- start start 2023-12-12T09:48:01.228 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:48:01.226+0000 7f538ae02640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f538414ea60 0x7f53840c5420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:48:01.228 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:48:01.227+0000 7f538ae02640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f53840c0320 0x7f53840c20b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:48:01.228 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:48:01.227+0000 7f538ae02640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53840c3390 con 0x7f53840a4c90 2023-12-12T09:48:01.229 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:48:01.227+0000 7f538ae02640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53840c4b30 con 0x7f53840c0320 2023-12-12T09:48:01.229 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:48:01.227+0000 7f538ae02640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5384151e60 con 0x7f538414ea60 2023-12-12T09:48:01.229 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:48:01.227+0000 7f538939f640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f53840c0320 0x7f53840c20b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:48:01.230 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:48:01.227+0000 7f5388b9e640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f538414ea60 0x7f53840c5420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:48:01.230 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:48:01.227+0000 7f538939f640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f53840c0320 0x7f53840c20b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.73:43538/0 (socket says 172.21.15.73:43538) 2023-12-12T09:48:01.230 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:48:01.227+0000 7f538939f640 1 -- 172.21.15.73:0/3884902504 learned_addr learned my addr 172.21.15.73:0/3884902504 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:48:01.230 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:48:01.228+0000 7f538939f640 1 -- 172.21.15.73:0/3884902504 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f538414ea60 msgr2=0x7f53840c5420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:48:01.230 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:48:01.228+0000 7f538939f640 1 --2- 172.21.15.73:0/3884902504 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f538414ea60 0x7f53840c5420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:48:01.230 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:48:01.228+0000 7f538939f640 1 -- 172.21.15.73:0/3884902504 >> v1:172.21.15.142:6789/0 conn(0x7f53840a4c90 legacy=0x7f53840c4420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:48:01.230 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:48:01.228+0000 7f538939f640 1 -- 172.21.15.73:0/3884902504 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5384152140 con 0x7f53840c0320 2023-12-12T09:48:01.231 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:48:01.229+0000 7f538939f640 1 --2- 172.21.15.73:0/3884902504 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f53840c0320 0x7f53840c20b0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f537c009870 tx=0x7f537c02b8f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2a1a8bbfc1301257 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:48:01.231 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:48:01.230+0000 7f53837fe640 1 -- 172.21.15.73:0/3884902504 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f537c031640 con 0x7f53840c0320 2023-12-12T09:48:01.231 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:48:01.230+0000 7f53837fe640 1 -- 172.21.15.73:0/3884902504 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f537c0317a0 con 0x7f53840c0320 2023-12-12T09:48:01.232 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:48:01.230+0000 7f53837fe640 1 -- 172.21.15.73:0/3884902504 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f537c031b30 con 0x7f53840c0320 2023-12-12T09:48:01.232 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:48:01.230+0000 7f538ae02640 1 -- 172.21.15.73:0/3884902504 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f53840c0320 msgr2=0x7f53840c20b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:48:01.233 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:48:01.230+0000 7f538ae02640 1 --2- 172.21.15.73:0/3884902504 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f53840c0320 0x7f53840c20b0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f537c009870 tx=0x7f537c02b8f0 comp rx=0 tx=0).stop 2023-12-12T09:48:01.233 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:48:01.231+0000 7f538ae02640 1 -- 172.21.15.73:0/3884902504 shutdown_connections 2023-12-12T09:48:01.233 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:48:01.231+0000 7f538ae02640 1 --2- 172.21.15.73:0/3884902504 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f53840c0320 0x7f53840c20b0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:48:01.233 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:48:01.231+0000 7f538ae02640 1 --2- 172.21.15.73:0/3884902504 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f538414ea60 0x7f53840c5420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:48:01.233 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:48:01.231+0000 7f538ae02640 1 -- 172.21.15.73:0/3884902504 >> 172.21.15.73:0/3884902504 conn(0x7f538406a4e0 msgr2=0x7f538406a8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:48:01.233 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:48:01.231+0000 7f538ae02640 1 -- 172.21.15.73:0/3884902504 shutdown_connections 2023-12-12T09:48:01.233 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:48:01.231+0000 7f538ae02640 1 -- 172.21.15.73:0/3884902504 wait complete. 2023-12-12T09:48:01.234 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:48:01.232+0000 7f538ae02640 1 Processor -- start 2023-12-12T09:48:01.234 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:48:01.232+0000 7f538ae02640 1 -- start start 2023-12-12T09:48:01.235 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:48:01.233+0000 7f538ae02640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f53840a4c90 0x7f5384149810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:48:01.235 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:48:01.233+0000 7f538ae02640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f53840c0320 0x7f53840a9230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:48:01.235 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:48:01.233+0000 7f538ae02640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f538414ea60 0x7f53840a9770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:48:01.236 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:48:01.233+0000 7f538ae02640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5384154fd0 con 0x7f53840a4c90 2023-12-12T09:48:01.236 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:48:01.233+0000 7f538ae02640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53840a8e10 con 0x7f53840c0320 2023-12-12T09:48:01.236 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:48:01.233+0000 7f538ae02640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53840ab450 con 0x7f538414ea60 2023-12-12T09:48:01.236 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:48:01.234+0000 7f5388b9e640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f53840a4c90 0x7f5384149810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:48:01.236 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:48:01.234+0000 7f5388b9e640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f53840a4c90 0x7f5384149810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:36876/0 (socket says 172.21.15.73:36876) 2023-12-12T09:48:01.236 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:48:01.234+0000 7f5388b9e640 1 -- 172.21.15.73:0/316588253 learned_addr learned my addr 172.21.15.73:0/316588253 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:48:01.239 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:48:01.234+0000 7f538939f640 1 --2- 172.21.15.73:0/316588253 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f538414ea60 0x7f53840a9770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:48:01.239 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:48:01.234+0000 7f5383fff640 1 --2- 172.21.15.73:0/316588253 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f53840c0320 0x7f53840a9230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:48:01.239 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:48:01.234+0000 7f5388b9e640 1 -- 172.21.15.73:0/316588253 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f538414ea60 msgr2=0x7f53840a9770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:48:01.239 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:48:01.234+0000 7f5388b9e640 1 --2- 172.21.15.73:0/316588253 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f538414ea60 0x7f53840a9770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:48:01.239 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:48:01.234+0000 7f5388b9e640 1 -- 172.21.15.73:0/316588253 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f53840c0320 msgr2=0x7f53840a9230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:48:01.239 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:48:01.234+0000 7f5388b9e640 1 --2- 172.21.15.73:0/316588253 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f53840c0320 0x7f53840a9230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:48:01.239 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:48:01.234+0000 7f5388b9e640 1 -- 172.21.15.73:0/316588253 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f537c0094d0 con 0x7f53840a4c90 2023-12-12T09:48:01.240 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:48:01.234+0000 7f5383fff640 1 --2- 172.21.15.73:0/316588253 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f53840c0320 0x7f53840a9230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:48:01.240 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:48:01.234+0000 7f5388b9e640 1 --2- 172.21.15.73:0/316588253 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f53840a4c90 0x7f5384149810 secure :-1 s=READY pgs=1191 cs=0 l=1 rev1=1 crypto rx=0x7f5374009d10 tx=0x7f537400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:48:01.240 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:48:01.235+0000 7f53817fa640 1 -- 172.21.15.73:0/316588253 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5374009b80 con 0x7f53840a4c90 2023-12-12T09:48:01.240 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:48:01.235+0000 7f53817fa640 1 -- 172.21.15.73:0/316588253 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f537400f040 con 0x7f53840a4c90 2023-12-12T09:48:01.240 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:48:01.235+0000 7f538ae02640 1 -- 172.21.15.73:0/316588253 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53840a8a70 con 0x7f53840a4c90 2023-12-12T09:48:01.240 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:48:01.235+0000 7f53817fa640 1 -- 172.21.15.73:0/316588253 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5374014680 con 0x7f53840a4c90 2023-12-12T09:48:01.240 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:48:01.235+0000 7f538ae02640 1 -- 172.21.15.73:0/316588253 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53841e8c00 con 0x7f53840a4c90 2023-12-12T09:48:01.240 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:48:01.236+0000 7f538ae02640 1 -- 172.21.15.73:0/316588253 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f53840a9080 con 0x7f53840a4c90 2023-12-12T09:48:01.240 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:48:01.237+0000 7f53817fa640 1 -- 172.21.15.73:0/316588253 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f53740147e0 con 0x7f53840a4c90 2023-12-12T09:48:01.241 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:48:01.238+0000 7f53817fa640 1 --2- 172.21.15.73:0/316588253 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f536406ae70 0x7f536406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:48:01.241 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:48:01.238+0000 7f53817fa640 1 -- 172.21.15.73:0/316588253 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f5374089e50 con 0x7f53840a4c90 2023-12-12T09:48:01.241 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:48:01.239+0000 7f5383fff640 1 --2- 172.21.15.73:0/316588253 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f536406ae70 0x7f536406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:48:01.242 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:48:01.239+0000 7f5383fff640 1 --2- 172.21.15.73:0/316588253 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f536406ae70 0x7f536406d330 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f5384155780 tx=0x7f536c009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:48:01.244 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:48:01.243+0000 7f53817fa640 1 -- 172.21.15.73:0/316588253 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f5374055190 con 0x7f53840a4c90 2023-12-12T09:48:01.435 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:48:01.433+0000 7f538ae02640 1 -- 172.21.15.73:0/316588253 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) v1 -- 0x7f5384067580 con 0x7f53840a4c90 2023-12-12T09:48:01.440 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:48:01.439+0000 7f53817fa640 1 -- 172.21.15.73:0/316588253 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v16)=0 v16) v1 ==== 123+0+0 (secure 0 0 0) 0x7f53740587b0 con 0x7f53840a4c90 2023-12-12T09:48:01.441 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:48:01.439+0000 7f53817fa640 1 -- 172.21.15.73:0/316588253 <== mon.0 v2:172.21.15.73:3300/0 8 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f5374055190 con 0x7f53840a4c90 2023-12-12T09:48:01.444 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:48:01.442+0000 7f538ae02640 1 -- 172.21.15.73:0/316588253 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f536406ae70 msgr2=0x7f536406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:48:01.445 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:48:01.442+0000 7f538ae02640 1 --2- 172.21.15.73:0/316588253 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f536406ae70 0x7f536406d330 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f5384155780 tx=0x7f536c009040 comp rx=0 tx=0).stop 2023-12-12T09:48:01.445 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:48:01.442+0000 7f538ae02640 1 -- 172.21.15.73:0/316588253 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f53840a4c90 msgr2=0x7f5384149810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:48:01.445 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:48:01.442+0000 7f538ae02640 1 --2- 172.21.15.73:0/316588253 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f53840a4c90 0x7f5384149810 secure :-1 s=READY pgs=1191 cs=0 l=1 rev1=1 crypto rx=0x7f5374009d10 tx=0x7f537400c490 comp rx=0 tx=0).stop 2023-12-12T09:48:01.445 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:48:01.442+0000 7f538ae02640 1 -- 172.21.15.73:0/316588253 shutdown_connections 2023-12-12T09:48:01.445 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:48:01.442+0000 7f538ae02640 1 --2- 172.21.15.73:0/316588253 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f536406ae70 0x7f536406d330 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:48:01.445 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:48:01.442+0000 7f538ae02640 1 --2- 172.21.15.73:0/316588253 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f538414ea60 0x7f53840a9770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:48:01.445 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:48:01.442+0000 7f538ae02640 1 --2- 172.21.15.73:0/316588253 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f53840c0320 0x7f53840a9230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:48:01.445 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:48:01.442+0000 7f538ae02640 1 --2- 172.21.15.73:0/316588253 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f53840a4c90 0x7f5384149810 unknown :-1 s=CLOSED pgs=1191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:48:01.445 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:48:01.442+0000 7f538ae02640 1 -- 172.21.15.73:0/316588253 >> 172.21.15.73:0/316588253 conn(0x7f538406a4e0 msgr2=0x7f53840c5900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:48:01.446 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:48:01.443+0000 7f538ae02640 1 -- 172.21.15.73:0/316588253 shutdown_connections 2023-12-12T09:48:01.446 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:48:01.443+0000 7f538ae02640 1 -- 172.21.15.73:0/316588253 wait complete. 2023-12-12T09:48:01.463 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-12-12T09:48:01.464 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-12T09:48:01.674 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:48:01.672+0000 7f7ad8ee0640 1 Processor -- start 2023-12-12T09:48:01.675 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:48:01.673+0000 7f7ad8ee0640 1 -- start start 2023-12-12T09:48:01.676 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:48:01.674+0000 7f7ad8ee0640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f7ad40a50f0 0x7f7ad40a9050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:48:01.676 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:48:01.674+0000 7f7ad8ee0640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7ad406bf20 0x7f7ad40a9590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:48:01.676 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:48:01.674+0000 7f7ad8ee0640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ad40c0b50 con 0x7f7ad41552e0 2023-12-12T09:48:01.676 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:48:01.674+0000 7f7ad8ee0640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ad40c04d0 con 0x7f7ad40a50f0 2023-12-12T09:48:01.676 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:48:01.674+0000 7f7ad8ee0640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ad406c880 con 0x7f7ad406bf20 2023-12-12T09:48:01.676 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:48:01.674+0000 7f7ad259c640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f7ad41552e0 0x7f7ad40c49c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:51172/0 (socket says 172.21.15.73:51172) 2023-12-12T09:48:01.676 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:48:01.674+0000 7f7ad259c640 1 -- 172.21.15.73:0/1715931179 learned_addr learned my addr 172.21.15.73:0/1715931179 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-12T09:48:01.680 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:48:01.675+0000 7f7ad1d9b640 1 -- 172.21.15.73:0/1715931179 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2449152118 0 0) 0x7f7ad40c0b50 con 0x7f7ad41552e0 2023-12-12T09:48:01.680 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:48:01.675+0000 7f7ad1d9b640 1 -- 172.21.15.73:0/1715931179 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7ac0003520 con 0x7f7ad41552e0 2023-12-12T09:48:01.680 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:48:01.675+0000 7f7ad2d9d640 1 --2- 172.21.15.73:0/1715931179 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7ad406bf20 0x7f7ad40a9590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:48:01.680 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:48:01.675+0000 7f7acbfff640 1 --2- 172.21.15.73:0/1715931179 >> v2:172.21.15.142:3300/0 conn(0x7f7ad40a50f0 0x7f7ad40a9050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:48:01.680 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:48:01.675+0000 7f7ad1d9b640 1 -- 172.21.15.73:0/1715931179 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1732821807 0 0) 0x7f7ac0003520 con 0x7f7ad41552e0 2023-12-12T09:48:01.680 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:48:01.675+0000 7f7ad1d9b640 1 -- 172.21.15.73:0/1715931179 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7ad406bf20 msgr2=0x7f7ad40a9590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:48:01.680 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:48:01.675+0000 7f7ad1d9b640 1 --2- 172.21.15.73:0/1715931179 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7ad406bf20 0x7f7ad40a9590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:48:01.680 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:48:01.675+0000 7f7ad1d9b640 1 -- 172.21.15.73:0/1715931179 >> v2:172.21.15.142:3300/0 conn(0x7f7ad40a50f0 msgr2=0x7f7ad40a9050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:48:01.681 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:48:01.675+0000 7f7ad1d9b640 1 --2- 172.21.15.73:0/1715931179 >> v2:172.21.15.142:3300/0 conn(0x7f7ad40a50f0 0x7f7ad40a9050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:48:01.681 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:48:01.675+0000 7f7ad1d9b640 1 -- 172.21.15.73:0/1715931179 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ad406cb60 con 0x7f7ad41552e0 2023-12-12T09:48:01.681 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:48:01.675+0000 7f7ad1d9b640 1 -- 172.21.15.73:0/1715931179 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3186547832 0 0) 0x7f7ac4001670 con 0x7f7ad41552e0 2023-12-12T09:48:01.681 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:48:01.675+0000 7f7ad2d9d640 1 --2- 172.21.15.73:0/1715931179 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7ad406bf20 0x7f7ad40a9590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-12T09:48:01.681 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:48:01.675+0000 7f7ad1d9b640 1 -- 172.21.15.73:0/1715931179 >> v1:172.21.15.73:6789/0 conn(0x7f7ad41552e0 legacy=0x7f7ad40c49c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:48:01.681 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:48:01.675+0000 7f7ad1d9b640 1 --2- 172.21.15.73:0/1715931179 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7ad406bf20 0x7f7ac0003970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:48:01.682 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:48:01.675+0000 7f7ad1d9b640 1 --2- 172.21.15.73:0/1715931179 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7ac0003f60 0x7f7ac00047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:48:01.682 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:48:01.675+0000 7f7ad1d9b640 1 --2- 172.21.15.73:0/1715931179 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7ac0004d00 0x7f7ac0005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:48:01.683 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:48:01.675+0000 7f7ad1d9b640 1 -- 172.21.15.73:0/1715931179 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ad40c04d0 con 0x7f7ac0004d00 2023-12-12T09:48:01.683 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:48:01.675+0000 7f7ad1d9b640 1 -- 172.21.15.73:0/1715931179 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ad406c880 con 0x7f7ac0003f60 2023-12-12T09:48:01.683 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:48:01.675+0000 7f7ad1d9b640 1 -- 172.21.15.73:0/1715931179 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ac000bae0 con 0x7f7ad406bf20 2023-12-12T09:48:01.683 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:48:01.676+0000 7f7ad2d9d640 1 --2- 172.21.15.73:0/1715931179 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7ac0004d00 0x7f7ac0005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:48:01.683 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:48:01.676+0000 7f7acbfff640 1 --2- 172.21.15.73:0/1715931179 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7ac0003f60 0x7f7ac00047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:48:01.683 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:48:01.676+0000 7f7ad259c640 1 --2- 172.21.15.73:0/1715931179 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7ad406bf20 0x7f7ac0003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:48:01.683 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:48:01.676+0000 7f7ad2d9d640 1 -- 172.21.15.73:0/1715931179 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7ad406bf20 msgr2=0x7f7ac0003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:48:01.684 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:48:01.676+0000 7f7ad2d9d640 1 --2- 172.21.15.73:0/1715931179 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7ad406bf20 0x7f7ac0003970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:48:01.684 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:48:01.676+0000 7f7ad2d9d640 1 -- 172.21.15.73:0/1715931179 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7ac0003f60 msgr2=0x7f7ac00047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:48:01.684 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:48:01.676+0000 7f7ad2d9d640 1 --2- 172.21.15.73:0/1715931179 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7ac0003f60 0x7f7ac00047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:48:01.684 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:48:01.676+0000 7f7ad2d9d640 1 -- 172.21.15.73:0/1715931179 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ac0003520 con 0x7f7ac0004d00 2023-12-12T09:48:01.684 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:48:01.676+0000 7f7acbfff640 1 --2- 172.21.15.73:0/1715931179 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7ac0003f60 0x7f7ac00047c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:48:01.684 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:48:01.677+0000 7f7ad2d9d640 1 --2- 172.21.15.73:0/1715931179 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7ac0004d00 0x7f7ac0005180 secure :-1 s=READY pgs=1193 cs=0 l=1 rev1=1 crypto rx=0x7f7acc0073e0 tx=0x7f7ac00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b11cf2428258d196 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:48:01.684 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:48:01.677+0000 7f7ad1d9b640 1 -- 172.21.15.73:0/1715931179 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7acc02cd30 con 0x7f7ac0004d00 2023-12-12T09:48:01.684 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:48:01.677+0000 7f7ad1d9b640 1 -- 172.21.15.73:0/1715931179 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f7acc02ce90 con 0x7f7ac0004d00 2023-12-12T09:48:01.684 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:48:01.677+0000 7f7ad1d9b640 1 -- 172.21.15.73:0/1715931179 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7acc034640 con 0x7f7ac0004d00 2023-12-12T09:48:01.685 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:48:01.678+0000 7f7ad8ee0640 1 -- 172.21.15.73:0/1715931179 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7ac0004d00 msgr2=0x7f7ac0005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:48:01.685 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:48:01.678+0000 7f7ad8ee0640 1 --2- 172.21.15.73:0/1715931179 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7ac0004d00 0x7f7ac0005180 secure :-1 s=READY pgs=1193 cs=0 l=1 rev1=1 crypto rx=0x7f7acc0073e0 tx=0x7f7ac00057f0 comp rx=0 tx=0).stop 2023-12-12T09:48:01.685 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:48:01.678+0000 7f7ad2d9d640 1 -- 172.21.15.73:0/1715931179 reap_dead start 2023-12-12T09:48:01.685 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:48:01.678+0000 7f7ad8ee0640 1 -- 172.21.15.73:0/1715931179 shutdown_connections 2023-12-12T09:48:01.685 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:48:01.678+0000 7f7ad8ee0640 1 -- 172.21.15.73:0/1715931179 >> 172.21.15.73:0/1715931179 conn(0x7f7ad40a8130 msgr2=0x7f7ad40c24b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:48:01.685 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:48:01.678+0000 7f7ad8ee0640 1 -- 172.21.15.73:0/1715931179 shutdown_connections 2023-12-12T09:48:01.685 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:48:01.678+0000 7f7ad8ee0640 1 -- 172.21.15.73:0/1715931179 wait complete. 2023-12-12T09:48:01.688 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:48:01.680+0000 7f7ad8ee0640 1 Processor -- start 2023-12-12T09:48:01.688 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:48:01.680+0000 7f7ad8ee0640 1 -- start start 2023-12-12T09:48:01.689 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:48:01.681+0000 7f7ad8ee0640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7ac0004d00 0x7f7ad41508b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:48:01.689 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:48:01.681+0000 7f7ad8ee0640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7ad40ba9d0 0x7f7ad40bf1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:48:01.689 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:48:01.681+0000 7f7ad8ee0640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7ad41dd8e0 0x7f7ad41ddd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:48:01.690 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:48:01.681+0000 7f7ad8ee0640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ad41de2a0 con 0x7f7ac0004d00 2023-12-12T09:48:01.690 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:48:01.681+0000 7f7ad8ee0640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ad40bb350 con 0x7f7ad40ba9d0 2023-12-12T09:48:01.690 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:48:01.681+0000 7f7ad8ee0640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ad41df380 con 0x7f7ad41dd8e0 2023-12-12T09:48:01.690 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:48:01.681+0000 7f7ad259c640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7ac0004d00 0x7f7ad41508b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:48:01.690 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:48:01.681+0000 7f7ad259c640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7ac0004d00 0x7f7ad41508b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:36888/0 (socket says 172.21.15.73:36888) 2023-12-12T09:48:01.690 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:48:01.681+0000 7f7ad259c640 1 -- 172.21.15.73:0/1753946559 learned_addr learned my addr 172.21.15.73:0/1753946559 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-12T09:48:01.691 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:48:01.681+0000 7f7ad259c640 1 -- 172.21.15.73:0/1753946559 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7ad41dd8e0 msgr2=0x7f7ad41ddd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:48:01.691 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:48:01.681+0000 7f7ad259c640 1 --2- 172.21.15.73:0/1753946559 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7ad41dd8e0 0x7f7ad41ddd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:48:01.691 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:48:01.681+0000 7f7ad259c640 1 -- 172.21.15.73:0/1753946559 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7ad40ba9d0 msgr2=0x7f7ad40bf1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:48:01.691 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:48:01.681+0000 7f7ad259c640 1 --2- 172.21.15.73:0/1753946559 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7ad40ba9d0 0x7f7ad40bf1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:48:01.691 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:48:01.681+0000 7f7ad259c640 1 -- 172.21.15.73:0/1753946559 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ad41df620 con 0x7f7ac0004d00 2023-12-12T09:48:01.691 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:48:01.682+0000 7f7ad259c640 1 --2- 172.21.15.73:0/1753946559 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7ac0004d00 0x7f7ad41508b0 secure :-1 s=READY pgs=1194 cs=0 l=1 rev1=1 crypto rx=0x7f7ac4001200 tx=0x7f7ac400dd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:48:01.692 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:48:01.682+0000 7f7acaffd640 1 -- 172.21.15.73:0/1753946559 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ac40074e0 con 0x7f7ac0004d00 2023-12-12T09:48:01.692 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:48:01.682+0000 7f7acaffd640 1 -- 172.21.15.73:0/1753946559 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f7ac4007640 con 0x7f7ac0004d00 2023-12-12T09:48:01.692 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:48:01.682+0000 7f7ad8ee0640 1 -- 172.21.15.73:0/1753946559 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ad41e86e0 con 0x7f7ac0004d00 2023-12-12T09:48:01.692 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:48:01.682+0000 7f7acaffd640 1 -- 172.21.15.73:0/1753946559 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ac4004a20 con 0x7f7ac0004d00 2023-12-12T09:48:01.692 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:48:01.682+0000 7f7ad8ee0640 1 -- 172.21.15.73:0/1753946559 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ad40bf700 con 0x7f7ac0004d00 2023-12-12T09:48:01.692 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:48:01.684+0000 7f7ad8ee0640 1 -- 172.21.15.73:0/1753946559 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ad406cfd0 con 0x7f7ac0004d00 2023-12-12T09:48:01.692 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:48:01.684+0000 7f7acaffd640 1 -- 172.21.15.73:0/1753946559 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f7ac4004b80 con 0x7f7ac0004d00 2023-12-12T09:48:01.693 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:48:01.685+0000 7f7acaffd640 1 --2- 172.21.15.73:0/1753946559 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f7ab406ae40 0x7f7ab406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:48:01.693 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:48:01.685+0000 7f7acaffd640 1 -- 172.21.15.73:0/1753946559 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f7ac4089120 con 0x7f7ac0004d00 2023-12-12T09:48:01.693 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:48:01.685+0000 7f7acbfff640 1 --2- 172.21.15.73:0/1753946559 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f7ab406ae40 0x7f7ab406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:48:01.693 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:48:01.686+0000 7f7acbfff640 1 --2- 172.21.15.73:0/1753946559 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f7ab406ae40 0x7f7ab406d300 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f7ad40bb0d0 tx=0x7f7abc0093d0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:48:01.693 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:48:01.690+0000 7f7acaffd640 1 -- 172.21.15.73:0/1753946559 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f7ad406cfd0 con 0x7f7ac0004d00 2023-12-12T09:48:01.914 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:48:01.912+0000 7f7ad8ee0640 1 -- 172.21.15.73:0/1753946559 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7ad406cfd0 con 0x7f7ac0004d00 2023-12-12T09:48:01.915 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:48:01.913+0000 7f7acaffd640 1 -- 172.21.15.73:0/1753946559 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 53 v53) v1 ==== 94+0+3705 (secure 0 0 0) 0x7f7ad406cfd0 con 0x7f7ac0004d00 2023-12-12T09:48:01.915 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-12T09:48:01.915 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":53,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4943,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6835/3004685650","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6833","nonce":3004685650},{"type":"v1","addr":"172.21.15.142:6835","nonce":3004685650}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40},{"gid":5365,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6834/3290362874","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6832","nonce":3290362874},{"type":"v1","addr":"172.21.15.142:6834","nonce":3290362874}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40},{"gid":7086,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6837/3803137802","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6835","nonce":3803137802},{"type":"v1","addr":"172.21.15.73:6837","nonce":3803137802}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":51},{"gid":7182,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6836/2012301099","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":2012301099},{"type":"v1","addr":"172.21.15.73:6836","nonce":2012301099}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":53}],"filesystems":[]} 2023-12-12T09:48:01.916 INFO:teuthology.orchestra.run.smithi073.stderr:dumped fsmap epoch 53 2023-12-12T09:48:01.918 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:48:01.916+0000 7f7ad8ee0640 1 -- 172.21.15.73:0/1753946559 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f7ab406ae40 msgr2=0x7f7ab406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:48:01.918 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:48:01.916+0000 7f7ad8ee0640 1 --2- 172.21.15.73:0/1753946559 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f7ab406ae40 0x7f7ab406d300 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f7ad40bb0d0 tx=0x7f7abc0093d0 comp rx=0 tx=0).stop 2023-12-12T09:48:01.918 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:48:01.916+0000 7f7ad8ee0640 1 -- 172.21.15.73:0/1753946559 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7ac0004d00 msgr2=0x7f7ad41508b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:48:01.918 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:48:01.916+0000 7f7ad8ee0640 1 --2- 172.21.15.73:0/1753946559 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7ac0004d00 0x7f7ad41508b0 secure :-1 s=READY pgs=1194 cs=0 l=1 rev1=1 crypto rx=0x7f7ac4001200 tx=0x7f7ac400dd40 comp rx=0 tx=0).stop 2023-12-12T09:48:01.918 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:48:01.916+0000 7f7ad8ee0640 1 -- 172.21.15.73:0/1753946559 shutdown_connections 2023-12-12T09:48:01.918 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:48:01.916+0000 7f7ad8ee0640 1 --2- 172.21.15.73:0/1753946559 >> [v2:172.21.15.73:6832/779985841,v1:172.21.15.73:6833/779985841] conn(0x7f7ab406ae40 0x7f7ab406d300 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:48:01.919 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:48:01.916+0000 7f7ad8ee0640 1 --2- 172.21.15.73:0/1753946559 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7ad41dd8e0 0x7f7ad41ddd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:48:01.919 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:48:01.916+0000 7f7ad8ee0640 1 --2- 172.21.15.73:0/1753946559 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7ad40ba9d0 0x7f7ad40bf1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:48:01.919 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:48:01.916+0000 7f7ad8ee0640 1 --2- 172.21.15.73:0/1753946559 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7ac0004d00 0x7f7ad41508b0 unknown :-1 s=CLOSED pgs=1194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:48:01.919 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:48:01.916+0000 7f7ad8ee0640 1 -- 172.21.15.73:0/1753946559 >> 172.21.15.73:0/1753946559 conn(0x7f7ad40a8130 msgr2=0x7f7ad40c3940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:48:01.919 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:48:01.916+0000 7f7ad8ee0640 1 -- 172.21.15.73:0/1753946559 shutdown_connections 2023-12-12T09:48:01.919 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-12T09:48:01.916+0000 7f7ad8ee0640 1 -- 172.21.15.73:0/1753946559 wait complete. 2023-12-12T09:48:01.934 DEBUG:tasks.cephfs.filesystem:already dead... 2023-12-12T09:48:01.935 INFO:teuthology.misc:Shutting down mds daemons... 2023-12-12T09:48:01.935 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-12-12T09:48:01.935 INFO:teuthology.orchestra.run:waiting for 300 2023-12-12T09:48:01.949 INFO:tasks.ceph.mds.a:Stopped 2023-12-12T09:48:01.950 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-12-12T09:48:01.950 INFO:teuthology.orchestra.run:waiting for 300 2023-12-12T09:48:02.021 INFO:tasks.ceph.mds.c:Stopped 2023-12-12T09:48:02.021 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-12-12T09:48:02.021 INFO:teuthology.orchestra.run:waiting for 300 2023-12-12T09:48:02.051 INFO:tasks.ceph.mds.b:Stopped 2023-12-12T09:48:02.051 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-12-12T09:48:02.051 INFO:teuthology.orchestra.run:waiting for 300 2023-12-12T09:48:02.120 INFO:tasks.ceph.mds.d:Stopped 2023-12-12T09:48:02.121 INFO:teuthology.misc:Shutting down osd daemons... 2023-12-12T09:48:02.121 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2023-12-12T09:48:02.121 INFO:teuthology.orchestra.run:waiting for 300 2023-12-12T09:48:02.195 INFO:tasks.ceph.osd.0:Stopped 2023-12-12T09:48:02.195 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2023-12-12T09:48:02.195 INFO:teuthology.orchestra.run:waiting for 300 2023-12-12T09:48:02.272 INFO:tasks.ceph.osd.1:Stopped 2023-12-12T09:48:02.272 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2023-12-12T09:48:02.272 INFO:teuthology.orchestra.run:waiting for 300 2023-12-12T09:48:02.337 INFO:tasks.ceph.osd.2:Stopped 2023-12-12T09:48:02.337 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2023-12-12T09:48:02.338 INFO:teuthology.orchestra.run:waiting for 300 2023-12-12T09:48:02.393 INFO:tasks.ceph.osd.3:Stopped 2023-12-12T09:48:02.393 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2023-12-12T09:48:02.393 INFO:teuthology.orchestra.run:waiting for 300 2023-12-12T09:48:02.474 INFO:tasks.ceph.osd.4:Stopped 2023-12-12T09:48:02.474 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2023-12-12T09:48:02.475 INFO:teuthology.orchestra.run:waiting for 300 2023-12-12T09:48:02.541 INFO:tasks.ceph.osd.5:Stopped 2023-12-12T09:48:02.542 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2023-12-12T09:48:02.542 INFO:teuthology.orchestra.run:waiting for 300 2023-12-12T09:48:02.602 INFO:tasks.ceph.osd.6:Stopped 2023-12-12T09:48:02.602 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2023-12-12T09:48:02.602 INFO:teuthology.orchestra.run:waiting for 300 2023-12-12T09:48:02.673 INFO:tasks.ceph.osd.7:Stopped 2023-12-12T09:48:02.673 INFO:teuthology.misc:Shutting down mgr daemons... 2023-12-12T09:48:02.673 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2023-12-12T09:48:02.674 INFO:teuthology.orchestra.run:waiting for 300 2023-12-12T09:48:02.752 INFO:tasks.ceph.mgr.y:Stopped 2023-12-12T09:48:02.752 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2023-12-12T09:48:02.752 INFO:teuthology.orchestra.run:waiting for 300 2023-12-12T09:48:02.976 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~0s 2023-12-12T09:48:02.977 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~0s 2023-12-12T09:48:02.977 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~0s 2023-12-12T09:48:02.977 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~0s 2023-12-12T09:48:02.977 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~0s 2023-12-12T09:48:08.280 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~6s 2023-12-12T09:48:08.281 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 has been restored 2023-12-12T09:48:08.281 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 has been restored 2023-12-12T09:48:08.281 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 has been restored 2023-12-12T09:48:08.281 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 has been restored 2023-12-12T09:48:08.855 INFO:tasks.ceph.mgr.x:Stopped 2023-12-12T09:48:08.855 INFO:teuthology.misc:Shutting down mon daemons... 2023-12-12T09:48:08.855 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2023-12-12T09:48:08.855 INFO:teuthology.orchestra.run:waiting for 300 2023-12-12T09:48:08.902 INFO:tasks.ceph.mon.a:Stopped 2023-12-12T09:48:08.902 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2023-12-12T09:48:08.903 INFO:teuthology.orchestra.run:waiting for 300 2023-12-12T09:48:08.925 INFO:tasks.ceph.mon.b:Stopped 2023-12-12T09:48:08.926 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2023-12-12T09:48:08.926 INFO:teuthology.orchestra.run:waiting for 300 2023-12-12T09:48:09.009 INFO:tasks.ceph.mon.c:Stopped 2023-12-12T09:48:09.009 INFO:tasks.ceph:Checking cluster log for badness... 2023-12-12T09:48:09.010 DEBUG:teuthology.orchestra.run.smithi073:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | head -n 1 2023-12-12T09:48:09.117 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi073.front.sepia.ceph.com 2023-12-12T09:48:09.117 DEBUG:teuthology.orchestra.run.smithi073:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2023-12-12T09:48:09.389 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi073.front.sepia.ceph.com 2023-12-12T09:48:09.389 DEBUG:teuthology.orchestra.run.smithi073:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2023-12-12T09:48:09.539 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi073.front.sepia.ceph.com 2023-12-12T09:48:09.540 DEBUG:teuthology.orchestra.run.smithi073:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2023-12-12T09:48:09.688 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi073.front.sepia.ceph.com 2023-12-12T09:48:09.688 DEBUG:teuthology.orchestra.run.smithi073:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2023-12-12T09:48:09.846 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi142.front.sepia.ceph.com 2023-12-12T09:48:09.847 DEBUG:teuthology.orchestra.run.smithi142:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2023-12-12T09:48:10.106 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi142.front.sepia.ceph.com 2023-12-12T09:48:10.106 DEBUG:teuthology.orchestra.run.smithi142:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2023-12-12T09:48:10.236 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi142.front.sepia.ceph.com 2023-12-12T09:48:10.237 DEBUG:teuthology.orchestra.run.smithi142:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2023-12-12T09:48:10.394 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi142.front.sepia.ceph.com 2023-12-12T09:48:10.395 DEBUG:teuthology.orchestra.run.smithi142:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2023-12-12T09:48:10.567 INFO:tasks.ceph:Archiving mon data... 2023-12-12T09:48:10.569 DEBUG:teuthology.misc:Transferring archived files from smithi073:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/mchangir-2023-12-12_08:46:52-fs-wip-mchangir-testing-20231205.064351-testing-default-smithi/7488201/data/mon.a.tgz 2023-12-12T09:48:10.569 DEBUG:teuthology.orchestra.run.smithi073:> mktemp 2023-12-12T09:48:10.629 INFO:teuthology.orchestra.run.smithi073.stdout:/tmp/tmp.7jQuoWYGJf 2023-12-12T09:48:10.629 DEBUG:teuthology.orchestra.run.smithi073:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.7jQuoWYGJf 2023-12-12T09:48:10.845 DEBUG:teuthology.orchestra.run.smithi073:> sudo chmod 0666 /tmp/tmp.7jQuoWYGJf 2023-12-12T09:48:10.999 DEBUG:teuthology.orchestra.remote:smithi073:/tmp/tmp.7jQuoWYGJf is 472KB 2023-12-12T09:48:11.106 DEBUG:teuthology.orchestra.run.smithi073:> rm -fr /tmp/tmp.7jQuoWYGJf 2023-12-12T09:48:11.165 DEBUG:teuthology.misc:Transferring archived files from smithi142:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/mchangir-2023-12-12_08:46:52-fs-wip-mchangir-testing-20231205.064351-testing-default-smithi/7488201/data/mon.b.tgz 2023-12-12T09:48:11.165 DEBUG:teuthology.orchestra.run.smithi142:> mktemp 2023-12-12T09:48:11.227 INFO:teuthology.orchestra.run.smithi142.stdout:/tmp/tmp.pLpiMCi3AA 2023-12-12T09:48:11.228 DEBUG:teuthology.orchestra.run.smithi142:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.pLpiMCi3AA 2023-12-12T09:48:11.472 DEBUG:teuthology.orchestra.run.smithi142:> sudo chmod 0666 /tmp/tmp.pLpiMCi3AA 2023-12-12T09:48:11.630 DEBUG:teuthology.orchestra.remote:smithi142:/tmp/tmp.pLpiMCi3AA is 603KB 2023-12-12T09:48:11.744 DEBUG:teuthology.orchestra.run.smithi142:> rm -fr /tmp/tmp.pLpiMCi3AA 2023-12-12T09:48:11.799 DEBUG:teuthology.misc:Transferring archived files from smithi142:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/mchangir-2023-12-12_08:46:52-fs-wip-mchangir-testing-20231205.064351-testing-default-smithi/7488201/data/mon.c.tgz 2023-12-12T09:48:11.799 DEBUG:teuthology.orchestra.run.smithi142:> mktemp 2023-12-12T09:48:11.845 INFO:teuthology.orchestra.run.smithi142.stdout:/tmp/tmp.zxYiJBu1U9 2023-12-12T09:48:11.846 DEBUG:teuthology.orchestra.run.smithi142:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.zxYiJBu1U9 2023-12-12T09:48:12.123 DEBUG:teuthology.orchestra.run.smithi142:> sudo chmod 0666 /tmp/tmp.zxYiJBu1U9 2023-12-12T09:48:12.280 DEBUG:teuthology.orchestra.remote:smithi142:/tmp/tmp.zxYiJBu1U9 is 603KB 2023-12-12T09:48:12.396 DEBUG:teuthology.orchestra.run.smithi142:> rm -fr /tmp/tmp.zxYiJBu1U9 2023-12-12T09:48:12.456 INFO:tasks.ceph:Cleaning ceph cluster... 2023-12-12T09:48:12.456 DEBUG:teuthology.orchestra.run.smithi073:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-12-12T09:48:12.466 DEBUG:teuthology.orchestra.run.smithi142:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-12-12T09:48:12.615 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2023-12-12T09:48:12.671 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2023-12-12T09:48:12.672 INFO:tasks.ceph:Archiving crash dumps... 2023-12-12T09:48:12.673 DEBUG:teuthology.misc:Transferring archived files from smithi073:/var/lib/ceph/crash to /home/teuthworker/archive/mchangir-2023-12-12_08:46:52-fs-wip-mchangir-testing-20231205.064351-testing-default-smithi/7488201/remote/smithi073/crash 2023-12-12T09:48:12.674 DEBUG:teuthology.orchestra.run.smithi073:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-12-12T09:48:12.772 DEBUG:teuthology.misc:Transferring archived files from smithi142:/var/lib/ceph/crash to /home/teuthworker/archive/mchangir-2023-12-12_08:46:52-fs-wip-mchangir-testing-20231205.064351-testing-default-smithi/7488201/remote/smithi142/crash 2023-12-12T09:48:12.773 DEBUG:teuthology.orchestra.run.smithi142:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-12-12T09:48:12.867 INFO:tasks.ceph:Shutting down logrotate 2023-12-12T09:48:12.867 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T09:48:12.876 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T09:48:13.001 DEBUG:teuthology.orchestra.run.smithi073:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-12-12T09:48:13.100 DEBUG:teuthology.orchestra.run.smithi142:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-12-12T09:48:13.203 INFO:tasks.ceph:Compressing logs... 2023-12-12T09:48:13.203 DEBUG:teuthology.orchestra.run.smithi073:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-12-12T09:48:13.212 DEBUG:teuthology.orchestra.run.smithi142:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-12-12T09:48:13.282 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x has been restored 2023-12-12T09:48:13.300 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108533.log 2023-12-12T09:48:13.301 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103712.log 2023-12-12T09:48:13.303 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.108533.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99877.log 2023-12-12T09:48:13.303 INFO:teuthology.orchestra.run.smithi073.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.108533.log.gz 2023-12-12T09:48:13.304 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.103712.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99401.log 2023-12-12T09:48:13.304 INFO:teuthology.orchestra.run.smithi073.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.103712.log.gz 2023-12-12T09:48:13.305 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.99877.log: gzip 87.3% -- replaced with /var/log/ceph/ceph-client.admin.99877.log.gz -5 2023-12-12T09:48:13.306 INFO:teuthology.orchestra.run.smithi073.stderr: --verbose -- /var/log/ceph/ceph-client.admin.104463.log 2023-12-12T09:48:13.307 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.99401.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113156.log 2023-12-12T09:48:13.307 INFO:teuthology.orchestra.run.smithi073.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.99401.log.gz 2023-12-12T09:48:13.307 INFO:teuthology.orchestra.run.smithi142.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2023-12-12T09:48:13.308 INFO:teuthology.orchestra.run.smithi142.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.94154.log 2023-12-12T09:48:13.309 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.104463.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111870.log 2023-12-12T09:48:13.309 INFO:teuthology.orchestra.run.smithi073.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.104463.log.gz 2023-12-12T09:48:13.309 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.113156.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96984.log 2023-12-12T09:48:13.310 INFO:teuthology.orchestra.run.smithi073.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.113156.log.gz 2023-12-12T09:48:13.311 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.111870.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107170.log 2023-12-12T09:48:13.311 INFO:teuthology.orchestra.run.smithi073.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.111870.log.gz 2023-12-12T09:48:13.313 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2023-12-12T09:48:13.313 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.1.94154.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.94154.log.gz 2023-12-12T09:48:13.313 INFO:teuthology.orchestra.run.smithi142.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.b.log 2023-12-12T09:48:13.313 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2023-12-12T09:48:13.313 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.94942.log 2023-12-12T09:48:13.315 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.96984.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93430.log 2023-12-12T09:48:13.315 INFO:teuthology.orchestra.run.smithi073.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.96984.log.gz 2023-12-12T09:48:13.315 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.107170.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.107170.log.gz 2023-12-12T09:48:13.315 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2023-12-12T09:48:13.315 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.93430.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105325.log 2023-12-12T09:48:13.315 INFO:teuthology.orchestra.run.smithi073.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.93430.log.gz 2023-12-12T09:48:13.317 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109760.log 2023-12-12T09:48:13.317 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.105325.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.105325.log.gz 2023-12-12T09:48:13.317 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104421.log 2023-12-12T09:48:13.318 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88354.log 2023-12-12T09:48:13.318 INFO:teuthology.orchestra.run.smithi142.stderr: 92.7% -- replaced with /var/log/ceph/ceph-mds.b.log.gz 2023-12-12T09:48:13.318 INFO:teuthology.orchestra.run.smithi142.stderr: 93.5% -- replaced with /var/log/ceph/ceph.audit.log.gz 2023-12-12T09:48:13.318 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.1.94942.log: gzip 0.0% -- replaced with /var/log/ceph/ceph-client.1.94942.log.gz -5 2023-12-12T09:48:13.318 INFO:teuthology.orchestra.run.smithi142.stderr: --verbose -- /var/log/ceph/ceph-client.admin.88274.log 2023-12-12T09:48:13.318 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.admin.88354.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.88354.log.gz 2023-12-12T09:48:13.318 INFO:teuthology.orchestra.run.smithi142.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88154.log 2023-12-12T09:48:13.320 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.admin.88274.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.88274.log.gz 2023-12-12T09:48:13.321 INFO:teuthology.orchestra.run.smithi142.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88314.log 2023-12-12T09:48:13.321 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.admin.88154.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.88154.log.gz 2023-12-12T09:48:13.321 INFO:teuthology.orchestra.run.smithi142.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2023-12-12T09:48:13.323 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.109760.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92426.log 2023-12-12T09:48:13.323 INFO:teuthology.orchestra.run.smithi073.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.109760.log.gz 2023-12-12T09:48:13.323 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.104421.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.104421.log.gz 2023-12-12T09:48:13.323 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93258.log 2023-12-12T09:48:13.323 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.92426.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106773.log 2023-12-12T09:48:13.323 INFO:teuthology.orchestra.run.smithi073.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.92426.log.gz 2023-12-12T09:48:13.323 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.93258.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.93258.log.gz 2023-12-12T09:48:13.323 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105223.log 2023-12-12T09:48:13.324 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.106773.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105367.log 2023-12-12T09:48:13.324 INFO:teuthology.orchestra.run.smithi073.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.106773.log.gz 2023-12-12T09:48:13.325 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.105223.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.105223.log.gz 2023-12-12T09:48:13.325 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112158.log 2023-12-12T09:48:13.325 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.105367.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97404.log 2023-12-12T09:48:13.325 INFO:teuthology.orchestra.run.smithi073.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.105367.log.gz 2023-12-12T09:48:13.327 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.admin.88314.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.88314.log.gz 2023-12-12T09:48:13.327 INFO:teuthology.orchestra.run.smithi142.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2023-12-12T09:48:13.327 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88194.log 2023-12-12T09:48:13.327 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.92506.log 2023-12-12T09:48:13.327 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.admin.88194.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88234.log 2023-12-12T09:48:13.327 INFO:teuthology.orchestra.run.smithi142.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.88194.log.gz 2023-12-12T09:48:13.327 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.1.92506.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.92506.log.gz 2023-12-12T09:48:13.328 INFO:teuthology.orchestra.run.smithi142.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.93357.log 2023-12-12T09:48:13.329 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.112158.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104761.log 2023-12-12T09:48:13.329 INFO:teuthology.orchestra.run.smithi073.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.112158.log.gz 2023-12-12T09:48:13.329 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.97404.log: gzip 88.2% -- replaced with /var/log/ceph/ceph-client.admin.97404.log.gz 2023-12-12T09:48:13.329 INFO:teuthology.orchestra.run.smithi073.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.94896.log 2023-12-12T09:48:13.330 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.104761.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.104761.log.gz 2023-12-12T09:48:13.330 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106269.log 2023-12-12T09:48:13.331 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.94896.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94111.log 2023-12-12T09:48:13.331 INFO:teuthology.orchestra.run.smithi073.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.94896.log.gz 2023-12-12T09:48:13.331 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.106269.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.106269.log.gz 2023-12-12T09:48:13.332 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104295.log 2023-12-12T09:48:13.333 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.admin.88234.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.testuser.95429.log 2023-12-12T09:48:13.333 INFO:teuthology.orchestra.run.smithi142.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.88234.log.gz 2023-12-12T09:48:13.333 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.1.93357.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.93357.log.gz 2023-12-12T09:48:13.333 INFO:teuthology.orchestra.run.smithi142.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2023-12-12T09:48:13.333 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.testuser.95429.log: 0.0% -- replaced with /var/log/ceph/ceph-client.testuser.95429.log.gz 2023-12-12T09:48:13.334 INFO:teuthology.orchestra.run.smithi142.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88434.log 2023-12-12T09:48:13.335 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.94617.log 2023-12-12T09:48:13.336 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.94111.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.94111.log.gz 2023-12-12T09:48:13.336 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97362.log 2023-12-12T09:48:13.336 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.104295.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.104295.log.gz 2023-12-12T09:48:13.336 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98070.log 2023-12-12T09:48:13.336 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.97362.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103838.log 2023-12-12T09:48:13.336 INFO:teuthology.orchestra.run.smithi073.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.97362.log.gz 2023-12-12T09:48:13.336 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.98070.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94094.log 2023-12-12T09:48:13.337 INFO:teuthology.orchestra.run.smithi073.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.98070.log.gz 2023-12-12T09:48:13.338 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.admin.88434.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2023-12-12T09:48:13.338 INFO:teuthology.orchestra.run.smithi142.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.88434.log.gz 2023-12-12T09:48:13.338 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.1.94617.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.94617.log.gz 2023-12-12T09:48:13.338 INFO:teuthology.orchestra.run.smithi142.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.93036.log 2023-12-12T09:48:13.339 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.103838.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112447.log 2023-12-12T09:48:13.339 INFO:teuthology.orchestra.run.smithi073.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.103838.log.gz 2023-12-12T09:48:13.339 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.94094.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.94094.log.gz 2023-12-12T09:48:13.339 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97152.log 2023-12-12T09:48:13.341 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88394.log 2023-12-12T09:48:13.341 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.1.93036.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.93036.log.gz 2023-12-12T09:48:13.341 INFO:teuthology.orchestra.run.smithi142.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.93819.log 2023-12-12T09:48:13.341 INFO:teuthology.orchestra.run.smithi142.stderr: 92.3% -- replaced with /var/log/ceph/ceph.log.gz 2023-12-12T09:48:13.341 INFO:teuthology.orchestra.run.smithi142.stderr: 93.5% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2023-12-12T09:48:13.341 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.112447.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.112447.log.gz 2023-12-12T09:48:13.341 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112405.log 2023-12-12T09:48:13.342 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.97152.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114063.log 2023-12-12T09:48:13.342 INFO:teuthology.orchestra.run.smithi073.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.97152.log.gz 2023-12-12T09:48:13.344 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.admin.88394.log: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.88394.log.gz 2023-12-12T09:48:13.344 INFO:teuthology.orchestra.run.smithi142.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2023-12-12T09:48:13.344 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.1.93819.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.93819.log.gz 2023-12-12T09:48:13.344 INFO:teuthology.orchestra.run.smithi142.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.d.log 2023-12-12T09:48:13.345 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.112405.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107884.log 2023-12-12T09:48:13.345 INFO:teuthology.orchestra.run.smithi073.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.112405.log.gz 2023-12-12T09:48:13.345 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.114063.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96738.log 2023-12-12T09:48:13.345 INFO:teuthology.orchestra.run.smithi073.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.114063.log.gz 2023-12-12T09:48:13.346 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.107884.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.107884.log.gz 2023-12-12T09:48:13.346 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100683.log 2023-12-12T09:48:13.346 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.96738.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107590.log 2023-12-12T09:48:13.346 INFO:teuthology.orchestra.run.smithi073.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.96738.log.gz 2023-12-12T09:48:13.347 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2023-12-12T09:48:13.347 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.100683.log: gzip -5 --verbose -- 89.6% /var/log/ceph/ceph-client.admin.104253.log 2023-12-12T09:48:13.348 INFO:teuthology.orchestra.run.smithi073.stderr: -- replaced with /var/log/ceph/ceph-client.admin.100683.log.gz 2023-12-12T09:48:13.348 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.107590.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105181.log 2023-12-12T09:48:13.348 INFO:teuthology.orchestra.run.smithi073.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.107590.log.gz 2023-12-12T09:48:13.348 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.104253.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.104253.log.gz 2023-12-12T09:48:13.349 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102888.log 2023-12-12T09:48:13.349 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.105181.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110717.log 2023-12-12T09:48:13.349 INFO:teuthology.orchestra.run.smithi073.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.105181.log.gz 2023-12-12T09:48:13.350 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.102888.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.98985.log 2023-12-12T09:48:13.350 INFO:teuthology.orchestra.run.smithi073.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.102888.log.gz 2023-12-12T09:48:13.351 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.110717.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.110717.log.gz 2023-12-12T09:48:13.352 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112489.log 2023-12-12T09:48:13.353 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.0.98985.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.98985.log.gz 2023-12-12T09:48:13.354 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112615.log 2023-12-12T09:48:13.354 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.112489.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.112489.log.gz 2023-12-12T09:48:13.354 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.95370.log 2023-12-12T09:48:13.355 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.112615.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.112615.log.gz 2023-12-12T09:48:13.356 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101763.log 2023-12-12T09:48:13.356 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.0.95370.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.95370.log.gz 2023-12-12T09:48:13.357 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110759.log 2023-12-12T09:48:13.358 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.101763.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.101763.log.gz 2023-12-12T09:48:13.358 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93770.log 2023-12-12T09:48:13.359 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.110759.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.110759.log.gz 2023-12-12T09:48:13.359 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111786.log 2023-12-12T09:48:13.360 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.93770.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.93770.log.gz 2023-12-12T09:48:13.361 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108745.log 2023-12-12T09:48:13.362 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.111786.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.111786.log.gz 2023-12-12T09:48:13.362 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110410.log 2023-12-12T09:48:13.363 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.108745.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.108745.log.gz 2023-12-12T09:48:13.364 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111996.log 2023-12-12T09:48:13.366 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.110410.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.110410.log.gz 2023-12-12T09:48:13.366 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112783.log 2023-12-12T09:48:13.366 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.111996.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.111996.log.gz 2023-12-12T09:48:13.366 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93769.log 2023-12-12T09:48:13.367 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.112783.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.112783.log.gz 2023-12-12T09:48:13.367 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92964.log 2023-12-12T09:48:13.368 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.93769.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.93769.log.gz 2023-12-12T09:48:13.368 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101091.log 2023-12-12T09:48:13.369 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.92964.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.92964.log.gz 2023-12-12T09:48:13.370 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104337.log 2023-12-12T09:48:13.371 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.101091.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.101091.log.gz 2023-12-12T09:48:13.371 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109412.log 2023-12-12T09:48:13.372 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.104337.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113072.log 2023-12-12T09:48:13.372 INFO:teuthology.orchestra.run.smithi073.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.104337.log.gz 2023-12-12T09:48:13.373 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.109412.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.109412.log.gz 2023-12-12T09:48:13.373 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113841.log 2023-12-12T09:48:13.375 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.113072.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.113072.log.gz 2023-12-12T09:48:13.375 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114441.log 2023-12-12T09:48:13.381 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.113841.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101427.log 2023-12-12T09:48:13.381 INFO:teuthology.orchestra.run.smithi073.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.113841.log.gz 2023-12-12T09:48:13.382 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.114441.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.114441.log.gz 2023-12-12T09:48:13.382 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95786.log 2023-12-12T09:48:13.382 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.101427.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.101427.log.gz 2023-12-12T09:48:13.383 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99583.log 2023-12-12T09:48:13.383 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.95786.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92880.log 2023-12-12T09:48:13.383 INFO:teuthology.orchestra.run.smithi073.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.95786.log.gz 2023-12-12T09:48:13.383 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.99583.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.99583.log.gz 2023-12-12T09:48:13.383 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97236.log 2023-12-12T09:48:13.385 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.92880.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97860.log 2023-12-12T09:48:13.385 INFO:teuthology.orchestra.run.smithi073.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.92880.log.gz 2023-12-12T09:48:13.385 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.97236.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.97236.log.gz 2023-12-12T09:48:13.385 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97320.log 2023-12-12T09:48:13.385 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.97860.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94104.log 2023-12-12T09:48:13.385 INFO:teuthology.orchestra.run.smithi073.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.97860.log.gz 2023-12-12T09:48:13.386 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.97320.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103049.log 2023-12-12T09:48:13.386 INFO:teuthology.orchestra.run.smithi073.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.97320.log.gz 2023-12-12T09:48:13.387 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.94104.log: 88.4%gzip -- replaced with /var/log/ceph/ceph-client.admin.94104.log.gz 2023-12-12T09:48:13.387 INFO:teuthology.orchestra.run.smithi073.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.99357.log 2023-12-12T09:48:13.388 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.103049.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105819.log 2023-12-12T09:48:13.388 INFO:teuthology.orchestra.run.smithi073.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.103049.log.gz 2023-12-12T09:48:13.389 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.99357.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.99357.log.gz 2023-12-12T09:48:13.389 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114315.log 2023-12-12T09:48:13.390 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.105819.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97776.log 2023-12-12T09:48:13.390 INFO:teuthology.orchestra.run.smithi073.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.105819.log.gz 2023-12-12T09:48:13.391 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.114315.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92556.log 2023-12-12T09:48:13.391 INFO:teuthology.orchestra.run.smithi073.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.114315.log.gz 2023-12-12T09:48:13.392 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.97776.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100547.log 2023-12-12T09:48:13.392 INFO:teuthology.orchestra.run.smithi073.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.97776.log.gz 2023-12-12T09:48:13.394 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.92556.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.92556.log.gz 2023-12-12T09:48:13.394 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107674.log 2023-12-12T09:48:13.394 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.100547.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108227.log 2023-12-12T09:48:13.395 INFO:teuthology.orchestra.run.smithi073.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.100547.log.gz 2023-12-12T09:48:13.395 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.107674.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.107674.log.gz 2023-12-12T09:48:13.396 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109718.log 2023-12-12T09:48:13.397 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.108227.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.104091.log 2023-12-12T09:48:13.397 INFO:teuthology.orchestra.run.smithi073.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.108227.log.gz 2023-12-12T09:48:13.398 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.109718.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101679.log 2023-12-12T09:48:13.398 INFO:teuthology.orchestra.run.smithi073.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.109718.log.gz 2023-12-12T09:48:13.399 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.0.104091.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.104091.log.gz 2023-12-12T09:48:13.400 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114525.log 2023-12-12T09:48:13.401 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.101679.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.101679.log.gz 2023-12-12T09:48:13.401 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110182.log 2023-12-12T09:48:13.402 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.114525.log: gzip -5 --verbose -- 88.5% /var/log/ceph/ceph-client.admin.113114.log -- replaced with /var/log/ceph/ceph-client.admin.114525.log.gz 2023-12-12T09:48:13.402 INFO:teuthology.orchestra.run.smithi073.stderr: 2023-12-12T09:48:13.403 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.110182.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.110182.log.gz 2023-12-12T09:48:13.403 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97818.log 2023-12-12T09:48:13.404 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.113114.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.113114.log.gz 2023-12-12T09:48:13.405 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96123.log 2023-12-12T09:48:13.405 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.97818.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.97818.log.gz 2023-12-12T09:48:13.406 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.82492.log 2023-12-12T09:48:13.407 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.96123.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.96123.log.gz 2023-12-12T09:48:13.407 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97278.log 2023-12-12T09:48:13.410 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph.tmp-client.admin.82492.log: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.82492.log.gz 2023-12-12T09:48:13.410 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114793.log 2023-12-12T09:48:13.410 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.97278.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.97278.log.gz 2023-12-12T09:48:13.410 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103278.log 2023-12-12T09:48:13.411 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-mds.d.log: /var/log/ceph/ceph-mon.c.log: 93.8% -- replaced with /var/log/ceph/ceph-mds.d.log.gz 2023-12-12T09:48:13.411 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.114793.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.114793.log.gz 2023-12-12T09:48:13.411 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111569.log 2023-12-12T09:48:13.412 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.103278.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.103278.log.gz 2023-12-12T09:48:13.412 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110140.log 2023-12-12T09:48:13.413 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.111569.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.111569.log.gz 2023-12-12T09:48:13.413 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96696.log 2023-12-12T09:48:13.414 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.110140.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103754.log 2023-12-12T09:48:13.414 INFO:teuthology.orchestra.run.smithi073.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.110140.log.gz 2023-12-12T09:48:13.415 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.96696.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108871.log 2023-12-12T09:48:13.415 INFO:teuthology.orchestra.run.smithi073.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.96696.log.gz 2023-12-12T09:48:13.416 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.103754.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94686.log 2023-12-12T09:48:13.416 INFO:teuthology.orchestra.run.smithi073.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.103754.log.gz 2023-12-12T09:48:13.417 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.108871.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98396.log 2023-12-12T09:48:13.417 INFO:teuthology.orchestra.run.smithi073.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.108871.log.gz 2023-12-12T09:48:13.418 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.94686.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103109.log 2023-12-12T09:48:13.418 INFO:teuthology.orchestra.run.smithi073.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.94686.log.gz 2023-12-12T09:48:13.419 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.98396.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101301.log 2023-12-12T09:48:13.419 INFO:teuthology.orchestra.run.smithi073.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.98396.log.gz 2023-12-12T09:48:13.420 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.103109.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102244.log 2023-12-12T09:48:13.420 INFO:teuthology.orchestra.run.smithi073.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.103109.log.gz 2023-12-12T09:48:13.421 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.101301.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110284.log 2023-12-12T09:48:13.421 INFO:teuthology.orchestra.run.smithi073.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.101301.log.gz 2023-12-12T09:48:13.422 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.102244.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101805.log 2023-12-12T09:48:13.422 INFO:teuthology.orchestra.run.smithi073.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.102244.log.gz 2023-12-12T09:48:13.423 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.110284.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96900.log 2023-12-12T09:48:13.423 INFO:teuthology.orchestra.run.smithi073.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.110284.log.gz 2023-12-12T09:48:13.424 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.101805.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113637.log 2023-12-12T09:48:13.424 INFO:teuthology.orchestra.run.smithi073.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.101805.log.gz 2023-12-12T09:48:13.425 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.96900.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102599.log 2023-12-12T09:48:13.425 INFO:teuthology.orchestra.run.smithi073.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.96900.log.gz 2023-12-12T09:48:13.426 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.113637.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106689.log 2023-12-12T09:48:13.426 INFO:teuthology.orchestra.run.smithi073.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.113637.log.gz 2023-12-12T09:48:13.427 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.102599.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.102599.log.gzgzip 2023-12-12T09:48:13.427 INFO:teuthology.orchestra.run.smithi073.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.109454.log 2023-12-12T09:48:13.428 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.106689.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99189.log 2023-12-12T09:48:13.429 INFO:teuthology.orchestra.run.smithi073.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.106689.log.gz 2023-12-12T09:48:13.429 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.109454.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.109454.log.gz 2023-12-12T09:48:13.430 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110014.log 2023-12-12T09:48:13.431 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.99189.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92796.log 2023-12-12T09:48:13.431 INFO:teuthology.orchestra.run.smithi073.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.99189.log.gz 2023-12-12T09:48:13.432 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.110014.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95505.log 2023-12-12T09:48:13.432 INFO:teuthology.orchestra.run.smithi073.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.110014.log.gz 2023-12-12T09:48:13.433 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.92796.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.92796.log.gz 2023-12-12T09:48:13.433 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100171.log 2023-12-12T09:48:13.434 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.95505.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106899.log 2023-12-12T09:48:13.434 INFO:teuthology.orchestra.run.smithi073.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.95505.log.gz 2023-12-12T09:48:13.435 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.100171.log: gzip 88.0% -5 -- replaced with /var/log/ceph/ceph-client.admin.100171.log.gz --verbose 2023-12-12T09:48:13.435 INFO:teuthology.orchestra.run.smithi073.stderr: -- /var/log/ceph/ceph-client.admin.98480.log 2023-12-12T09:48:13.436 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.106899.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96165.log 2023-12-12T09:48:13.436 INFO:teuthology.orchestra.run.smithi073.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.106899.log.gz 2023-12-12T09:48:13.437 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.98480.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.98480.log.gz 2023-12-12T09:48:13.437 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94728.log 2023-12-12T09:48:13.439 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.96165.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112909.log 2023-12-12T09:48:13.439 INFO:teuthology.orchestra.run.smithi073.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.96165.log.gz 2023-12-12T09:48:13.440 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.94728.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.94728.log.gz 2023-12-12T09:48:13.440 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112242.log 2023-12-12T09:48:13.441 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.112909.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.112909.log.gz 2023-12-12T09:48:13.441 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105139.log 2023-12-12T09:48:13.442 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.112242.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100589.log 2023-12-12T09:48:13.442 INFO:teuthology.orchestra.run.smithi073.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.112242.log.gz 2023-12-12T09:48:13.443 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.105139.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.105139.log.gz 2023-12-12T09:48:13.443 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105599.log 2023-12-12T09:48:13.444 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.100589.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102202.log 2023-12-12T09:48:13.444 INFO:teuthology.orchestra.run.smithi073.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.100589.log.gz 2023-12-12T09:48:13.445 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.105599.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95650.log 2023-12-12T09:48:13.445 INFO:teuthology.orchestra.run.smithi073.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.105599.log.gz 2023-12-12T09:48:13.446 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.102202.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114105.log 2023-12-12T09:48:13.446 INFO:teuthology.orchestra.run.smithi073.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.102202.log.gz 2023-12-12T09:48:13.447 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.95650.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.95650.log.gz 2023-12-12T09:48:13.447 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108185.log 2023-12-12T09:48:13.448 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.114105.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107128.log 2023-12-12T09:48:13.448 INFO:teuthology.orchestra.run.smithi073.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.114105.log.gz 2023-12-12T09:48:13.449 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.108185.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98522.log 2023-12-12T09:48:13.449 INFO:teuthology.orchestra.run.smithi073.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.108185.log.gz 2023-12-12T09:48:13.450 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.107128.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112867.log 2023-12-12T09:48:13.450 INFO:teuthology.orchestra.run.smithi073.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.107128.log.gz 2023-12-12T09:48:13.451 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.98522.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.98522.log.gz 2023-12-12T09:48:13.451 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100045.log 2023-12-12T09:48:13.452 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.112867.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113366.log 2023-12-12T09:48:13.452 INFO:teuthology.orchestra.run.smithi073.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.112867.log.gz 2023-12-12T09:48:13.453 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.100045.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97068.log 2023-12-12T09:48:13.453 INFO:teuthology.orchestra.run.smithi073.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.100045.log.gz 2023-12-12T09:48:13.454 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.113366.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96858.log 2023-12-12T09:48:13.454 INFO:teuthology.orchestra.run.smithi073.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.113366.log.gz 2023-12-12T09:48:13.455 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.97068.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.97068.log.gz 2023-12-12T09:48:13.455 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102557.log 2023-12-12T09:48:13.456 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.96858.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114273.log 2023-12-12T09:48:13.456 INFO:teuthology.orchestra.run.smithi073.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.96858.log.gz 2023-12-12T09:48:13.457 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.102557.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94770.log 2023-12-12T09:48:13.457 INFO:teuthology.orchestra.run.smithi073.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.102557.log.gz 2023-12-12T09:48:13.458 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.114273.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102472.log 2023-12-12T09:48:13.458 INFO:teuthology.orchestra.run.smithi073.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.114273.log.gz 2023-12-12T09:48:13.459 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.94770.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109370.log 2023-12-12T09:48:13.459 INFO:teuthology.orchestra.run.smithi073.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.94770.log.gz 2023-12-12T09:48:13.460 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.102472.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103628.log 2023-12-12T09:48:13.460 INFO:teuthology.orchestra.run.smithi073.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.102472.log.gz 2023-12-12T09:48:13.461 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.109370.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113595.log 2023-12-12T09:48:13.461 INFO:teuthology.orchestra.run.smithi073.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.109370.log.gz 2023-12-12T09:48:13.462 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.103628.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108483.log 2023-12-12T09:48:13.462 INFO:teuthology.orchestra.run.smithi073.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.103628.log.gz 2023-12-12T09:48:13.463 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.113595.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104677.log 2023-12-12T09:48:13.463 INFO:teuthology.orchestra.run.smithi073.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.113595.log.gz 2023-12-12T09:48:13.464 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.108483.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94602.log 2023-12-12T09:48:13.464 INFO:teuthology.orchestra.run.smithi073.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.108483.log.gz 2023-12-12T09:48:13.465 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.104677.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102641.log 2023-12-12T09:48:13.465 INFO:teuthology.orchestra.run.smithi073.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.104677.log.gz 2023-12-12T09:48:13.466 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.94602.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105683.log 2023-12-12T09:48:13.466 INFO:teuthology.orchestra.run.smithi073.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.94602.log.gz 2023-12-12T09:48:13.467 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.102641.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101511.log 2023-12-12T09:48:13.467 INFO:teuthology.orchestra.run.smithi073.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.102641.log.gz 2023-12-12T09:48:13.468 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.105683.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111401.log 2023-12-12T09:48:13.469 INFO:teuthology.orchestra.run.smithi073.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.105683.log.gz 2023-12-12T09:48:13.470 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.101511.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.101511.log.gz 2023-12-12T09:48:13.470 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112116.log 2023-12-12T09:48:13.471 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.111401.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.111401.log.gz 2023-12-12T09:48:13.471 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113408.log 2023-12-12T09:48:13.472 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.112116.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101385.log 2023-12-12T09:48:13.472 INFO:teuthology.orchestra.run.smithi073.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.112116.log.gz 2023-12-12T09:48:13.473 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.113408.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.113408.log.gz 2023-12-12T09:48:13.473 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108787.log 2023-12-12T09:48:13.474 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.101385.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110098.log 2023-12-12T09:48:13.474 INFO:teuthology.orchestra.run.smithi073.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.101385.log.gz 2023-12-12T09:48:13.475 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.108787.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.108787.log.gz 2023-12-12T09:48:13.476 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94103.log 2023-12-12T09:48:13.477 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.110098.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.110098.log.gz 2023-12-12T09:48:13.477 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2023-12-12T09:48:13.478 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.94103.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.94103.log.gz 2023-12-12T09:48:13.478 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.109208.log 2023-12-12T09:48:13.479 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108353.log 2023-12-12T09:48:13.480 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.0.109208.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.109208.log.gz 2023-12-12T09:48:13.480 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109286.log 2023-12-12T09:48:13.481 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.108353.log: 89.3% -- replaced with /var/log/ceph/ceph.audit.log.gz 2023-12-12T09:48:13.482 INFO:teuthology.orchestra.run.smithi073.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.108353.log.gz 2023-12-12T09:48:13.482 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93427.log 2023-12-12T09:48:13.483 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.109286.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.109286.log.gz 2023-12-12T09:48:13.483 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99961.log 2023-12-12T09:48:13.484 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.93427.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111744.log 2023-12-12T09:48:13.484 INFO:teuthology.orchestra.run.smithi073.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.93427.log.gz 2023-12-12T09:48:13.485 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.99961.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.99961.log.gz 2023-12-12T09:48:13.485 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106353.log 2023-12-12T09:48:13.487 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.111744.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.111744.log.gz 2023-12-12T09:48:13.487 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96291.log 2023-12-12T09:48:13.488 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.106353.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98154.log 2023-12-12T09:48:13.488 INFO:teuthology.orchestra.run.smithi073.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.106353.log.gz 2023-12-12T09:48:13.489 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.96291.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.96291.log.gz 2023-12-12T09:48:13.489 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96417.log 2023-12-12T09:48:13.490 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.98154.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.98154.log.gzgzip 2023-12-12T09:48:13.490 INFO:teuthology.orchestra.run.smithi073.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.94476.log 2023-12-12T09:48:13.491 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.96417.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.96417.log.gz 2023-12-12T09:48:13.491 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105013.log 2023-12-12T09:48:13.492 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.94476.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.94476.log.gz 2023-12-12T09:48:13.493 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110368.log 2023-12-12T09:48:13.494 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.105013.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108913.log 2023-12-12T09:48:13.494 INFO:teuthology.orchestra.run.smithi073.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.105013.log.gz 2023-12-12T09:48:13.495 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.110368.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.110368.log.gz 2023-12-12T09:48:13.495 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104635.log 2023-12-12T09:48:13.496 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.108913.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.108913.log.gz 2023-12-12T09:48:13.496 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108395.log 2023-12-12T09:48:13.497 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.104635.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.104635.log.gz 2023-12-12T09:48:13.497 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109930.log 2023-12-12T09:48:13.499 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.108395.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94392.log 2023-12-12T09:48:13.499 INFO:teuthology.orchestra.run.smithi073.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.108395.log.gz 2023-12-12T09:48:13.500 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.109930.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.109930.log.gz 2023-12-12T09:48:13.500 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94560.log 2023-12-12T09:48:13.501 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.94392.log: gzip -5 88.4% --verbose -- replaced with /var/log/ceph/ceph-client.admin.94392.log.gz -- 2023-12-12T09:48:13.501 INFO:teuthology.orchestra.run.smithi073.stderr: /var/log/ceph/ceph-client.admin.98028.log 2023-12-12T09:48:13.502 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.94560.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.94560.log.gz 2023-12-12T09:48:13.502 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108269.log 2023-12-12T09:48:13.503 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.98028.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.98028.log.gz 2023-12-12T09:48:13.503 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108619.log 2023-12-12T09:48:13.504 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.108269.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110326.log 87.9% 2023-12-12T09:48:13.505 INFO:teuthology.orchestra.run.smithi073.stderr: -- replaced with /var/log/ceph/ceph-client.admin.108269.log.gz 2023-12-12T09:48:13.506 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.108619.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.108619.log.gz 2023-12-12T09:48:13.506 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100463.log 2023-12-12T09:48:13.507 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.110326.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.110326.log.gz 2023-12-12T09:48:13.507 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97194.log 2023-12-12T09:48:13.508 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.100463.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.100463.log.gz 2023-12-12T09:48:13.508 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101847.log 2023-12-12T09:48:13.509 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.97194.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.97194.log.gz 2023-12-12T09:48:13.510 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107043.log 2023-12-12T09:48:13.511 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.101847.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.101847.log.gz 2023-12-12T09:48:13.511 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109328.log 2023-12-12T09:48:13.512 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.107043.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.107043.log.gz 2023-12-12T09:48:13.512 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99147.log 2023-12-12T09:48:13.513 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.109328.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.109328.log.gz 2023-12-12T09:48:13.513 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103194.log 2023-12-12T09:48:13.515 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.99147.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.99147.log.gz 2023-12-12T09:48:13.515 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111527.log 2023-12-12T09:48:13.516 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.103194.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.103194.log.gz 2023-12-12T09:48:13.516 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96039.log 2023-12-12T09:48:13.517 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.111527.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.111527.log.gz 2023-12-12T09:48:13.517 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98606.log 2023-12-12T09:48:13.519 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.96039.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.96039.log.gz 2023-12-12T09:48:13.519 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102328.log 2023-12-12T09:48:13.520 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.98606.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.98606.log.gz 2023-12-12T09:48:13.520 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96816.log 2023-12-12T09:48:13.522 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.102328.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110843.log 2023-12-12T09:48:13.523 INFO:teuthology.orchestra.run.smithi073.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.102328.log.gz 2023-12-12T09:48:13.523 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.96816.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.96816.log.gz 2023-12-12T09:48:13.523 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93216.log 2023-12-12T09:48:13.524 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.110843.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.110843.log.gz 2023-12-12T09:48:13.524 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96570.log 2023-12-12T09:48:13.524 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.93216.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.93216.log.gz 2023-12-12T09:48:13.525 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107422.log 2023-12-12T09:48:13.526 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.96570.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.96570.log.gz 2023-12-12T09:48:13.526 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111359.log 2023-12-12T09:48:13.527 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.107422.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.107422.log.gz 2023-12-12T09:48:13.527 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104379.log 2023-12-12T09:48:13.528 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.111359.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.111359.log.gz 2023-12-12T09:48:13.528 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105265.log 2023-12-12T09:48:13.530 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.104379.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.104379.log.gz 2023-12-12T09:48:13.530 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92838.log 2023-12-12T09:48:13.531 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.105265.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.105265.log.gz 2023-12-12T09:48:13.531 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100421.log 2023-12-12T09:48:13.532 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.92838.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.92838.log.gzgzip 2023-12-12T09:48:13.532 INFO:teuthology.orchestra.run.smithi073.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.107800.log 2023-12-12T09:48:13.533 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.100421.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.100421.log.gz 2023-12-12T09:48:13.533 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109888.log 2023-12-12T09:48:13.535 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.107800.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.107800.log.gz 2023-12-12T09:48:13.535 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104929.log 2023-12-12T09:48:13.536 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.109888.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.109888.log.gz 2023-12-12T09:48:13.536 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94088.log 2023-12-12T09:48:13.537 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.104929.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.104929.log.gz 2023-12-12T09:48:13.537 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95547.log 2023-12-12T09:48:13.538 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.94088.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.94088.log.gz 2023-12-12T09:48:13.538 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112326.log 2023-12-12T09:48:13.539 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.95547.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.95547.log.gz 2023-12-12T09:48:13.539 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102412.log 2023-12-12T09:48:13.540 INFO:teuthology.orchestra.run.smithi142.stderr: 91.2% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2023-12-12T09:48:13.541 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.112326.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.112326.log.gz 2023-12-12T09:48:13.541 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110485.log 2023-12-12T09:48:13.542 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.102412.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109972.log 2023-12-12T09:48:13.542 INFO:teuthology.orchestra.run.smithi073.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.102412.log.gz 2023-12-12T09:48:13.543 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.110485.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.110485.log.gz 2023-12-12T09:48:13.543 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106605.log 2023-12-12T09:48:13.544 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.109972.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.109972.log.gz 2023-12-12T09:48:13.544 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92486.log 2023-12-12T09:48:13.546 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.106605.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.106605.log.gz 2023-12-12T09:48:13.546 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102160.log 2023-12-12T09:48:13.547 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.92486.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.92486.log.gz 2023-12-12T09:48:13.547 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98564.log 2023-12-12T09:48:13.548 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.102160.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.102160.log.gz 2023-12-12T09:48:13.548 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107254.log 2023-12-12T09:48:13.549 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.98564.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.98564.log.gz 2023-12-12T09:48:13.549 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98112.log 2023-12-12T09:48:13.551 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.107254.log: gzip -5 --verbose -- 88.6% /var/log/ceph/ceph-client.admin.102725.log -- replaced with /var/log/ceph/ceph-client.admin.107254.log.gz 2023-12-12T09:48:13.551 INFO:teuthology.orchestra.run.smithi073.stderr: 2023-12-12T09:48:13.552 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.98112.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.98112.log.gz 2023-12-12T09:48:13.552 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2023-12-12T09:48:13.553 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.102725.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.102725.log.gz 2023-12-12T09:48:13.553 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96375.log 2023-12-12T09:48:13.555 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114567.log 2023-12-12T09:48:13.556 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.96375.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.96375.log.gz 2023-12-12T09:48:13.556 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97110.log 2023-12-12T09:48:13.557 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.114567.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.114567.log.gz 2023-12-12T09:48:13.558 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101217.log 2023-12-12T09:48:13.558 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.97110.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.97110.log.gz 2023-12-12T09:48:13.558 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106437.log 2023-12-12T09:48:13.559 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.101217.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.101217.log.gz 2023-12-12T09:48:13.559 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100505.log 2023-12-12T09:48:13.560 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.106437.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.106437.log.gz 2023-12-12T09:48:13.560 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93435.log 2023-12-12T09:48:13.561 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.100505.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.100505.log.gz 2023-12-12T09:48:13.562 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107758.log 2023-12-12T09:48:13.563 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.93435.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.93435.log.gz 2023-12-12T09:48:13.563 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107212.log 2023-12-12T09:48:13.564 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.107758.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.107758.log.gz 2023-12-12T09:48:13.564 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98798.log 2023-12-12T09:48:13.565 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.107212.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.107212.log.gz 2023-12-12T09:48:13.565 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101469.log 2023-12-12T09:48:13.567 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.98798.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.98798.log.gz 2023-12-12T09:48:13.567 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93439.log 2023-12-12T09:48:13.568 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.101469.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.101469.log.gz 2023-12-12T09:48:13.568 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109538.log 2023-12-12T09:48:13.569 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.93439.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.93439.log.gz 2023-12-12T09:48:13.569 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105641.log 2023-12-12T09:48:13.570 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.109538.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.109538.log.gz 2023-12-12T09:48:13.570 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93776.log 2023-12-12T09:48:13.572 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.105641.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.105641.log.gz 2023-12-12T09:48:13.572 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94518.log 2023-12-12T09:48:13.573 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.93776.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.93776.log.gz 2023-12-12T09:48:13.573 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97446.log 2023-12-12T09:48:13.574 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.94518.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.94518.log.gz 2023-12-12T09:48:13.575 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101992.log 2023-12-12T09:48:13.575 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.97446.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.97446.log.gz 2023-12-12T09:48:13.575 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102076.log 2023-12-12T09:48:13.576 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.101992.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.101992.log.gz 2023-12-12T09:48:13.577 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111485.log 2023-12-12T09:48:13.578 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.102076.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.102076.log.gz 2023-12-12T09:48:13.578 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97488.log 2023-12-12T09:48:13.579 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.111485.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.111485.log.gz 2023-12-12T09:48:13.580 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98690.log 2023-12-12T09:48:13.581 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.97488.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.97488.log.gz 2023-12-12T09:48:13.581 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114399.log 2023-12-12T09:48:13.582 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.98690.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.98690.log.gz 2023-12-12T09:48:13.583 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110633.log 2023-12-12T09:48:13.584 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.114399.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.114399.log.gz 2023-12-12T09:48:13.584 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104803.log 2023-12-12T09:48:13.585 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.110633.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.110633.log.gz 2023-12-12T09:48:13.585 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103458.log 2023-12-12T09:48:13.586 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.104803.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.104803.log.gz 2023-12-12T09:48:13.586 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114753.log 2023-12-12T09:48:13.588 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.103458.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.103458.log.gzgzip 2023-12-12T09:48:13.588 INFO:teuthology.orchestra.run.smithi073.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.99273.log 2023-12-12T09:48:13.589 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.114753.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.114753.log.gz 2023-12-12T09:48:13.589 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102515.log 2023-12-12T09:48:13.590 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.99273.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.99273.log.gz 2023-12-12T09:48:13.590 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108829.log 2023-12-12T09:48:13.591 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.102515.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.102515.log.gz 2023-12-12T09:48:13.591 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101637.log 2023-12-12T09:48:13.592 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.108829.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.108829.log.gz 2023-12-12T09:48:13.593 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94052.log 2023-12-12T09:48:13.594 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.101637.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92752.log 2023-12-12T09:48:13.594 INFO:teuthology.orchestra.run.smithi073.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.101637.log.gz 2023-12-12T09:48:13.595 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.94052.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.94052.log.gz 2023-12-12T09:48:13.595 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93132.log 2023-12-12T09:48:13.596 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.92752.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.92752.log.gz 2023-12-12T09:48:13.596 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93436.log 2023-12-12T09:48:13.598 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.93132.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.93132.log.gz 2023-12-12T09:48:13.598 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95997.log 2023-12-12T09:48:13.598 INFO:teuthology.orchestra.run.smithi142.stderr: 91.4% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2023-12-12T09:48:13.599 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.93436.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.93436.log.gz 2023-12-12T09:48:13.599 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104507.log 2023-12-12T09:48:13.600 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.95997.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.95997.log.gz 2023-12-12T09:48:13.600 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109802.log 2023-12-12T09:48:13.601 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.104507.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.104507.log.gz 2023-12-12T09:48:13.602 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97986.log 2023-12-12T09:48:13.603 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.109802.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.109802.log.gz 2023-12-12T09:48:13.603 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104593.log 2023-12-12T09:48:13.604 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.97986.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.97986.log.gz 2023-12-12T09:48:13.604 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96942.log 2023-12-12T09:48:13.605 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.104593.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.104593.log.gz 2023-12-12T09:48:13.605 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113030.log 2023-12-12T09:48:13.606 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.96942.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.96942.log.gz 2023-12-12T09:48:13.607 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100003.log 2023-12-12T09:48:13.608 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.113030.log: 87.4%gzip -- replaced with /var/log/ceph/ceph-client.admin.113030.log.gz 2023-12-12T09:48:13.608 INFO:teuthology.orchestra.run.smithi073.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.92700.log 2023-12-12T09:48:13.609 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.100003.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.100003.log.gz 2023-12-12T09:48:13.609 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98216.log 2023-12-12T09:48:13.610 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.92700.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.92700.log.gz 2023-12-12T09:48:13.611 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112200.log 2023-12-12T09:48:13.613 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.98216.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93048.log 2023-12-12T09:48:13.614 INFO:teuthology.orchestra.run.smithi073.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.98216.log.gz 2023-12-12T09:48:13.614 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.112200.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.112200.log.gz 2023-12-12T09:48:13.614 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106311.log 2023-12-12T09:48:13.614 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.93048.log: gzip -5 88.3% --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.93048.log.gz /var/log/ceph/ceph-client.admin.101259.log 2023-12-12T09:48:13.614 INFO:teuthology.orchestra.run.smithi073.stderr: 2023-12-12T09:48:13.616 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.106311.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.106311.log.gz 2023-12-12T09:48:13.616 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94308.log 2023-12-12T09:48:13.617 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.101259.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114020.log 2023-12-12T09:48:13.617 INFO:teuthology.orchestra.run.smithi073.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.101259.log.gz 2023-12-12T09:48:13.618 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.94308.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.94308.log.gz 2023-12-12T09:48:13.619 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113324.log 2023-12-12T09:48:13.620 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.114020.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.114020.log.gz 2023-12-12T09:48:13.620 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92249.log 2023-12-12T09:48:13.621 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.113324.log: gzip 89.7% -5 -- replaced with /var/log/ceph/ceph-client.admin.113324.log.gz --verbose 2023-12-12T09:48:13.621 INFO:teuthology.orchestra.run.smithi073.stderr: -- /var/log/ceph/ceph-client.admin.107506.log 2023-12-12T09:48:13.622 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.92249.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101175.log 2023-12-12T09:48:13.622 INFO:teuthology.orchestra.run.smithi073.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.92249.log.gz 2023-12-12T09:48:13.623 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.107506.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.107506.log.gz 2023-12-12T09:48:13.624 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2023-12-12T09:48:13.625 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.101175.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99709.log 2023-12-12T09:48:13.625 INFO:teuthology.orchestra.run.smithi073.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.101175.log.gz 2023-12-12T09:48:13.626 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106563.log 2023-12-12T09:48:13.628 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.99709.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.99709.log.gz 2023-12-12T09:48:13.628 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97530.log 2023-12-12T09:48:13.630 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.106563.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.106563.log.gz 2023-12-12T09:48:13.631 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109668.log 2023-12-12T09:48:13.632 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.97530.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.97530.log.gzgzip 2023-12-12T09:48:13.632 INFO:teuthology.orchestra.run.smithi073.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.92615.log 2023-12-12T09:48:13.634 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.109668.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.109668.log.gz 2023-12-12T09:48:13.634 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106521.log 2023-12-12T09:48:13.635 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.92615.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94112.log 2023-12-12T09:48:13.636 INFO:teuthology.orchestra.run.smithi073.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.92615.log.gz 2023-12-12T09:48:13.637 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.106521.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.106521.log.gz 2023-12-12T09:48:13.637 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108439.log 2023-12-12T09:48:13.638 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.94112.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113240.log 2023-12-12T09:48:13.639 INFO:teuthology.orchestra.run.smithi073.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.94112.log.gz 2023-12-12T09:48:13.640 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.108439.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.108439.log.gz 2023-12-12T09:48:13.640 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98352.log 2023-12-12T09:48:13.642 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.113240.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.113240.log.gz 2023-12-12T09:48:13.642 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97652.log 2023-12-12T09:48:13.643 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.98352.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99793.log 2023-12-12T09:48:13.643 INFO:teuthology.orchestra.run.smithi073.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.98352.log.gz 2023-12-12T09:48:13.645 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.97652.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.97652.log.gz 2023-12-12T09:48:13.645 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94644.log 2023-12-12T09:48:13.646 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.99793.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.99793.log.gz 2023-12-12T09:48:13.646 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93766.log 2023-12-12T09:48:13.648 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.94644.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113198.log 2023-12-12T09:48:13.648 INFO:teuthology.orchestra.run.smithi073.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.94644.log.gz 2023-12-12T09:48:13.649 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.93766.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.93766.log.gz 2023-12-12T09:48:13.650 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109496.log 2023-12-12T09:48:13.651 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.113198.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.113198.log.gz 2023-12-12T09:48:13.651 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99667.log 2023-12-12T09:48:13.652 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.109496.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107716.log 2023-12-12T09:48:13.652 INFO:teuthology.orchestra.run.smithi073.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.109496.log.gz 2023-12-12T09:48:13.654 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.99667.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.99667.log.gz 2023-12-12T09:48:13.654 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97572.log 2023-12-12T09:48:13.655 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.107716.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.107716.log.gz 2023-12-12T09:48:13.656 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96081.log 2023-12-12T09:48:13.657 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.97572.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100319.log 2023-12-12T09:48:13.657 INFO:teuthology.orchestra.run.smithi073.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.97572.log.gz 2023-12-12T09:48:13.659 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.96081.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.testuser.100986.log 2023-12-12T09:48:13.659 INFO:teuthology.orchestra.run.smithi073.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.96081.log.gz 2023-12-12T09:48:13.660 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.100319.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102809.log 2023-12-12T09:48:13.660 INFO:teuthology.orchestra.run.smithi073.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.100319.log.gz 2023-12-12T09:48:13.661 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.testuser.100986.log: 0.0% -- replaced with /var/log/ceph/ceph-client.testuser.100986.log.gz 2023-12-12T09:48:13.661 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92345.log 2023-12-12T09:48:13.663 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.102809.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.102809.log.gz 2023-12-12T09:48:13.663 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104211.log 2023-12-12T09:48:13.665 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.92345.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.92345.log.gz 2023-12-12T09:48:13.665 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112074.log 2023-12-12T09:48:13.666 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.104211.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94434.log 2023-12-12T09:48:13.666 INFO:teuthology.orchestra.run.smithi073.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.104211.log.gz 2023-12-12T09:48:13.668 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.112074.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.112074.log.gz 2023-12-12T09:48:13.668 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113450.log 2023-12-12T09:48:13.669 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.94434.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101950.log 2023-12-12T09:48:13.670 INFO:teuthology.orchestra.run.smithi073.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.94434.log.gz 2023-12-12T09:48:13.671 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.113450.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93775.log 2023-12-12T09:48:13.671 INFO:teuthology.orchestra.run.smithi073.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.113450.log.gz 2023-12-12T09:48:13.672 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.101950.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.101950.log.gz 2023-12-12T09:48:13.672 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.testuser.106122.log 2023-12-12T09:48:13.674 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.93775.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.93775.log.gz 2023-12-12T09:48:13.674 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108703.log 2023-12-12T09:48:13.675 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.testuser.106122.log: 0.0% -- replaced with /var/log/ceph/ceph-client.testuser.106122.log.gz 2023-12-12T09:48:13.675 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97734.log 2023-12-12T09:48:13.677 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.108703.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.108703.log.gz 2023-12-12T09:48:13.677 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103796.log 2023-12-12T09:48:13.679 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.97734.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107548.log 2023-12-12T09:48:13.679 INFO:teuthology.orchestra.run.smithi073.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.97734.log.gz 2023-12-12T09:48:13.680 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.103796.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114693.log 2023-12-12T09:48:13.680 INFO:teuthology.orchestra.run.smithi073.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.103796.log.gz 2023-12-12T09:48:13.681 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.107548.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104845.log 2023-12-12T09:48:13.682 INFO:teuthology.orchestra.run.smithi073.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.107548.log.gz 2023-12-12T09:48:13.683 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.114693.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.114693.log.gz 2023-12-12T09:48:13.683 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113552.log 2023-12-12T09:48:13.685 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.104845.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.104845.log.gz 2023-12-12T09:48:13.685 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96333.log 2023-12-12T09:48:13.686 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.113552.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108023.log 2023-12-12T09:48:13.686 INFO:teuthology.orchestra.run.smithi073.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.113552.log.gz 2023-12-12T09:48:13.688 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.96333.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98310.log 2023-12-12T09:48:13.688 INFO:teuthology.orchestra.run.smithi073.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.96333.log.gz 2023-12-12T09:48:13.689 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.108023.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99625.log 2023-12-12T09:48:13.689 INFO:teuthology.orchestra.run.smithi073.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.108023.log.gz 2023-12-12T09:48:13.691 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.98310.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.98310.log.gz 2023-12-12T09:48:13.691 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106857.log 2023-12-12T09:48:13.692 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.99625.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113968.log 2023-12-12T09:48:13.692 INFO:teuthology.orchestra.run.smithi073.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.99625.log.gz 2023-12-12T09:48:13.693 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.106857.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.106857.log.gz 2023-12-12T09:48:13.694 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95955.log 2023-12-12T09:48:13.695 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.113968.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.113968.log.gz 2023-12-12T09:48:13.695 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106647.log 2023-12-12T09:48:13.696 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.95955.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114189.log 2023-12-12T09:48:13.697 INFO:teuthology.orchestra.run.smithi073.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.95955.log.gz 2023-12-12T09:48:13.697 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.106647.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.106647.log.gz 2023-12-12T09:48:13.698 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113925.log 2023-12-12T09:48:13.699 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.114189.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.114189.log.gz 2023-12-12T09:48:13.699 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99063.log 2023-12-12T09:48:13.701 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.113925.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110675.log 2023-12-12T09:48:13.701 INFO:teuthology.orchestra.run.smithi073.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.113925.log.gz 2023-12-12T09:48:13.702 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.99063.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.99063.log.gz 2023-12-12T09:48:13.702 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101907.log 2023-12-12T09:48:13.703 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.110675.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.110675.log.gz 2023-12-12T09:48:13.704 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107842.log 2023-12-12T09:48:13.705 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.101907.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110885.log 2023-12-12T09:48:13.705 INFO:teuthology.orchestra.run.smithi073.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.101907.log.gz 2023-12-12T09:48:13.706 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.107842.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.107842.log.gz 2023-12-12T09:48:13.707 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93174.log 2023-12-12T09:48:13.708 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.110885.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.110885.log.gz 2023-12-12T09:48:13.708 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95744.log 2023-12-12T09:48:13.710 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.93174.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.93174.log.gz 2023-12-12T09:48:13.710 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102370.log 2023-12-12T09:48:13.711 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.95744.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.95744.log.gz 2023-12-12T09:48:13.711 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93431.log 2023-12-12T09:48:13.712 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.102370.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101595.log 2023-12-12T09:48:13.713 INFO:teuthology.orchestra.run.smithi073.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.102370.log.gz 2023-12-12T09:48:13.714 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.93431.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.93431.log.gz 2023-12-12T09:48:13.714 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2023-12-12T09:48:13.715 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.101595.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102968.log 2023-12-12T09:48:13.716 INFO:teuthology.orchestra.run.smithi073.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.101595.log.gz 2023-12-12T09:48:13.717 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98732.log 2023-12-12T09:48:13.718 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.102968.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106227.log 2023-12-12T09:48:13.719 INFO:teuthology.orchestra.run.smithi073.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.102968.log.gz 2023-12-12T09:48:13.720 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.98732.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107464.log 2023-12-12T09:48:13.721 INFO:teuthology.orchestra.run.smithi073.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.98732.log.gz 2023-12-12T09:48:13.721 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.106227.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.106227.log.gz 2023-12-12T09:48:13.722 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99315.log 2023-12-12T09:48:13.723 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.107464.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93440.log 2023-12-12T09:48:13.723 INFO:teuthology.orchestra.run.smithi073.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.107464.log.gz 2023-12-12T09:48:13.725 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.99315.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94101.log 2023-12-12T09:48:13.725 INFO:teuthology.orchestra.run.smithi073.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.99315.log.gz 2023-12-12T09:48:13.726 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.93440.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103586.log 2023-12-12T09:48:13.726 INFO:teuthology.orchestra.run.smithi073.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.93440.log.gz 2023-12-12T09:48:13.727 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.94101.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102034.log 2023-12-12T09:48:13.728 INFO:teuthology.orchestra.run.smithi073.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.94101.log.gz 2023-12-12T09:48:13.729 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.103586.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88795.log 2023-12-12T09:48:13.729 INFO:teuthology.orchestra.run.smithi073.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.103586.log.gz 2023-12-12T09:48:13.731 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.102034.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99751.log 2023-12-12T09:48:13.731 INFO:teuthology.orchestra.run.smithi073.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.102034.log.gz 2023-12-12T09:48:13.732 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.88795.log: gzip 87.9% -- replaced with /var/log/ceph/ceph-client.admin.88795.log.gz 2023-12-12T09:48:13.732 INFO:teuthology.orchestra.run.smithi073.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.105097.log 2023-12-12T09:48:13.734 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.99751.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.99751.log.gz 2023-12-12T09:48:13.734 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107086.log 2023-12-12T09:48:13.735 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.105097.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95040.log 2023-12-12T09:48:13.735 INFO:teuthology.orchestra.run.smithi073.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.105097.log.gz 2023-12-12T09:48:13.737 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.107086.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114609.log 2023-12-12T09:48:13.737 INFO:teuthology.orchestra.run.smithi073.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.107086.log.gz 2023-12-12T09:48:13.738 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.95040.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112531.log 2023-12-12T09:48:13.739 INFO:teuthology.orchestra.run.smithi073.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.95040.log.gz 2023-12-12T09:48:13.740 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.114609.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107632.log 2023-12-12T09:48:13.740 INFO:teuthology.orchestra.run.smithi073.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.114609.log.gz 2023-12-12T09:48:13.741 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.112531.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92658.log 2023-12-12T09:48:13.741 INFO:teuthology.orchestra.run.smithi073.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.112531.log.gz 2023-12-12T09:48:13.743 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.107632.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113721.log 2023-12-12T09:48:13.743 INFO:teuthology.orchestra.run.smithi073.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.107632.log.gz 2023-12-12T09:48:13.744 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.92658.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100213.log 2023-12-12T09:48:13.745 INFO:teuthology.orchestra.run.smithi073.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.92658.log.gz 2023-12-12T09:48:13.746 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.113721.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.113721.log.gz 2023-12-12T09:48:13.747 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106731.log 2023-12-12T09:48:13.751 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.100213.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88683.log 2023-12-12T09:48:13.751 INFO:teuthology.orchestra.run.smithi073.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.100213.log.gz 2023-12-12T09:48:13.751 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.106731.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.106731.log.gz 2023-12-12T09:48:13.752 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92922.log 2023-12-12T09:48:13.752 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.88683.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.88683.log.gz 2023-12-12T09:48:13.752 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99539.log 2023-12-12T09:48:13.753 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.92922.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105725.log 2023-12-12T09:48:13.753 INFO:teuthology.orchestra.run.smithi073.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.92922.log.gz 2023-12-12T09:48:13.754 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.99539.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104971.log 2023-12-12T09:48:13.754 INFO:teuthology.orchestra.run.smithi073.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.99539.log.gz 2023-12-12T09:48:13.756 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.105725.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99496.log 2023-12-12T09:48:13.756 INFO:teuthology.orchestra.run.smithi073.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.105725.log.gz 2023-12-12T09:48:13.757 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.104971.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93765.log 2023-12-12T09:48:13.758 INFO:teuthology.orchestra.run.smithi073.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.104971.log.gz 2023-12-12T09:48:13.758 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.99496.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2023-12-12T09:48:13.758 INFO:teuthology.orchestra.run.smithi073.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.99496.log.gz 2023-12-12T09:48:13.760 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.93765.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.testuser.111282.log 2023-12-12T09:48:13.760 INFO:teuthology.orchestra.run.smithi073.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.93765.log.gz 2023-12-12T09:48:13.762 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103904.log 2023-12-12T09:48:13.762 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.testuser.111282.log: 0.0% -- replaced with /var/log/ceph/ceph-client.testuser.111282.log.gz 2023-12-12T09:48:13.763 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111611.log 2023-12-12T09:48:13.764 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.103904.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112825.log 2023-12-12T09:48:13.765 INFO:teuthology.orchestra.run.smithi073.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.103904.log.gz 2023-12-12T09:48:13.766 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.111611.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.111611.log.gz 2023-12-12T09:48:13.766 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99919.log 2023-12-12T09:48:13.767 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.112825.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.112825.log.gz 2023-12-12T09:48:13.768 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93006.log 2023-12-12T09:48:13.769 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.99919.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99105.log 2023-12-12T09:48:13.769 INFO:teuthology.orchestra.run.smithi073.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.99919.log.gz 2023-12-12T09:48:13.771 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.93006.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111653.log 2023-12-12T09:48:13.771 INFO:teuthology.orchestra.run.smithi073.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.93006.log.gz 2023-12-12T09:48:13.772 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.99105.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95913.log 2023-12-12T09:48:13.772 INFO:teuthology.orchestra.run.smithi073.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.99105.log.gz 2023-12-12T09:48:13.774 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.111653.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94854.log 2023-12-12T09:48:13.774 INFO:teuthology.orchestra.run.smithi073.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.111653.log.gz 2023-12-12T09:48:13.775 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.95913.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98260.log 2023-12-12T09:48:13.775 INFO:teuthology.orchestra.run.smithi073.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.95913.log.gz 2023-12-12T09:48:13.777 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.94854.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110527.log 2023-12-12T09:48:13.777 INFO:teuthology.orchestra.run.smithi073.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.94854.log.gz 2023-12-12T09:48:13.778 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.98260.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106479.log 2023-12-12T09:48:13.778 INFO:teuthology.orchestra.run.smithi073.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.98260.log.gz 2023-12-12T09:48:13.780 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.110527.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94938.log 2023-12-12T09:48:13.780 INFO:teuthology.orchestra.run.smithi073.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.110527.log.gz 2023-12-12T09:48:13.781 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.106479.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97902.log 2023-12-12T09:48:13.781 INFO:teuthology.orchestra.run.smithi073.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.106479.log.gz 2023-12-12T09:48:13.783 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.94938.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112741.log 2023-12-12T09:48:13.783 INFO:teuthology.orchestra.run.smithi073.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.94938.log.gz 2023-12-12T09:48:13.784 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.97902.log: 87.8%gzip -- replaced with /var/log/ceph/ceph-client.admin.97902.log.gz -5 2023-12-12T09:48:13.784 INFO:teuthology.orchestra.run.smithi073.stderr: --verbose -- /var/log/ceph/ceph-client.admin.104719.log 2023-12-12T09:48:13.786 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.112741.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2023-12-12T09:48:13.786 INFO:teuthology.orchestra.run.smithi073.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.112741.log.gz 2023-12-12T09:48:13.787 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.104719.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.104719.log.gz 2023-12-12T09:48:13.788 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93432.log 2023-12-12T09:48:13.789 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101553.log 2023-12-12T09:48:13.790 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.93432.log: 86.1% -- replaced with /var/log/ceph/ceph.log.gz 2023-12-12T09:48:13.790 INFO:teuthology.orchestra.run.smithi073.stderr: 90.6% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2023-12-12T09:48:13.791 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95829.log 2023-12-12T09:48:13.791 INFO:teuthology.orchestra.run.smithi073.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.93432.log.gz 2023-12-12T09:48:13.792 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.101553.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101049.log 2023-12-12T09:48:13.792 INFO:teuthology.orchestra.run.smithi073.stderr: 91.5% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2023-12-12T09:48:13.792 INFO:teuthology.orchestra.run.smithi073.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.101553.log.gz 2023-12-12T09:48:13.793 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.95829.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.95829.log.gz 2023-12-12T09:48:13.793 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101343.log 2023-12-12T09:48:13.794 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.101049.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.101049.log.gz 2023-12-12T09:48:13.794 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112573.log 2023-12-12T09:48:13.795 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.101343.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.101343.log.gz 2023-12-12T09:48:13.795 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101721.log 2023-12-12T09:48:13.796 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.112573.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.112573.log.gz 2023-12-12T09:48:13.796 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102767.log 2023-12-12T09:48:13.798 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.101721.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.101721.log.gz 2023-12-12T09:48:13.798 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2023-12-12T09:48:13.799 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.102767.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.102767.log.gz 2023-12-12T09:48:13.799 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93773.log 2023-12-12T09:48:13.800 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104887.log 2023-12-12T09:48:13.801 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.93773.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.93773.log.gz 2023-12-12T09:48:13.801 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99445.log 2023-12-12T09:48:13.802 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.104887.log: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.104887.log.gz 2023-12-12T09:48:13.803 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109624.log 2023-12-12T09:48:13.804 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.99445.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110242.log 2023-12-12T09:48:13.804 INFO:teuthology.orchestra.run.smithi073.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.99445.log.gz 2023-12-12T09:48:13.805 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.109624.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.109624.log.gz 2023-12-12T09:48:13.806 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.c.log 2023-12-12T09:48:13.806 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.110242.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.110242.log.gz 2023-12-12T09:48:13.807 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111443.log 2023-12-12T09:48:13.809 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-mds.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111828.log 2023-12-12T09:48:13.809 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.111443.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.111443.log.gz 2023-12-12T09:48:13.810 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114147.log 2023-12-12T09:48:13.811 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.111828.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.111828.log.gz 2023-12-12T09:48:13.811 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96207.log 2023-12-12T09:48:13.812 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.114147.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.114147.log.gz 2023-12-12T09:48:13.813 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93754.log 2023-12-12T09:48:13.814 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.96207.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114483.log 2023-12-12T09:48:13.815 INFO:teuthology.orchestra.run.smithi073.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.96207.log.gz 2023-12-12T09:48:13.817 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.93754.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106815.log 2023-12-12T09:48:13.818 INFO:teuthology.orchestra.run.smithi073.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.93754.log.gz 2023-12-12T09:48:13.819 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.114483.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96459.log 2023-12-12T09:48:13.819 INFO:teuthology.orchestra.run.smithi073.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.114483.log.gz 2023-12-12T09:48:13.819 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.106815.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100361.log 2023-12-12T09:48:13.819 INFO:teuthology.orchestra.run.smithi073.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.106815.log.gz 2023-12-12T09:48:13.820 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.96459.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97944.log 2023-12-12T09:48:13.820 INFO:teuthology.orchestra.run.smithi073.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.96459.log.gz 2023-12-12T09:48:13.822 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.100361.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105055.log 2023-12-12T09:48:13.822 INFO:teuthology.orchestra.run.smithi073.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.100361.log.gz 2023-12-12T09:48:13.823 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.97944.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88425.log 2023-12-12T09:48:13.823 INFO:teuthology.orchestra.run.smithi073.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.97944.log.gz 2023-12-12T09:48:13.825 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.105055.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113883.log 2023-12-12T09:48:13.825 INFO:teuthology.orchestra.run.smithi073.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.105055.log.gz 2023-12-12T09:48:13.826 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.88425.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114651.log 2023-12-12T09:48:13.826 INFO:teuthology.orchestra.run.smithi073.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.88425.log.gz 2023-12-12T09:48:13.828 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.113883.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103236.log 2023-12-12T09:48:13.828 INFO:teuthology.orchestra.run.smithi073.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.113883.log.gz 2023-12-12T09:48:13.829 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.114651.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105557.log 2023-12-12T09:48:13.829 INFO:teuthology.orchestra.run.smithi073.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.114651.log.gz 2023-12-12T09:48:13.831 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.103236.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103670.log 2023-12-12T09:48:13.831 INFO:teuthology.orchestra.run.smithi073.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.103236.log.gz 2023-12-12T09:48:13.832 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.105557.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110056.log 2023-12-12T09:48:13.832 INFO:teuthology.orchestra.run.smithi073.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.105557.log.gz 2023-12-12T09:48:13.834 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.103670.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109846.log 2023-12-12T09:48:13.834 INFO:teuthology.orchestra.run.smithi073.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.103670.log.gz 2023-12-12T09:48:13.835 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.110056.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.110056.log.gz 2023-12-12T09:48:13.835 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95695.log 2023-12-12T09:48:13.836 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.109846.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107942.log 2023-12-12T09:48:13.839 INFO:teuthology.orchestra.run.smithi073.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.109846.log.gz 2023-12-12T09:48:13.839 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.95695.log: gzip -5 --verbose 88.5% -- replaced with /var/log/ceph/ceph-client.admin.95695.log.gz 2023-12-12T09:48:13.839 INFO:teuthology.orchestra.run.smithi073.stderr: -- /var/log/ceph/ceph-client.admin.112699.log 2023-12-12T09:48:13.840 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.107942.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.107942.log.gz 2023-12-12T09:48:13.840 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103152.log 2023-12-12T09:48:13.841 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.112699.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.112699.log.gz 2023-12-12T09:48:13.841 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106983.log 2023-12-12T09:48:13.842 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.103152.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.103152.log.gz 2023-12-12T09:48:13.843 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113282.log 2023-12-12T09:48:13.844 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.106983.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.106983.log.gz 2023-12-12T09:48:13.844 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103500.log 2023-12-12T09:48:13.845 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.113282.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102286.log 2023-12-12T09:48:13.846 INFO:teuthology.orchestra.run.smithi073.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.113282.log.gz 2023-12-12T09:48:13.847 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.103500.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108103.log 2023-12-12T09:48:13.847 INFO:teuthology.orchestra.run.smithi073.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.103500.log.gz 2023-12-12T09:48:13.848 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.102286.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.102286.log.gz 2023-12-12T09:48:13.849 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105515.log 2023-12-12T09:48:13.849 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.108103.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.108103.log.gz 2023-12-12T09:48:13.850 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98648.log 2023-12-12T09:48:13.851 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.105515.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.105515.log.gz 2023-12-12T09:48:13.852 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113492.log 2023-12-12T09:48:13.853 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.98648.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.98648.log.gz 2023-12-12T09:48:13.853 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93090.log 2023-12-12T09:48:13.854 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.113492.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106395.log 2023-12-12T09:48:13.855 INFO:teuthology.orchestra.run.smithi073.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.113492.log.gz 2023-12-12T09:48:13.856 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.93090.log: gzip -5 88.4% --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.93090.log.gz /var/log/ceph/ceph-client.admin.113679.log 2023-12-12T09:48:13.856 INFO:teuthology.orchestra.run.smithi073.stderr: 2023-12-12T09:48:13.857 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.106395.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.106395.log.gz 2023-12-12T09:48:13.857 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94350.log 2023-12-12T09:48:13.858 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.113679.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103366.log 2023-12-12T09:48:13.860 INFO:teuthology.orchestra.run.smithi073.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.113679.log.gz/var/log/ceph/ceph-client.admin.94350.log: 2023-12-12T09:48:13.860 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104551.log 2023-12-12T09:48:13.860 INFO:teuthology.orchestra.run.smithi073.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.94350.log.gz 2023-12-12T09:48:13.861 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.103366.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95871.log 2023-12-12T09:48:13.861 INFO:teuthology.orchestra.run.smithi073.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.103366.log.gz 2023-12-12T09:48:13.863 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.104551.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108311.log 2023-12-12T09:48:13.863 INFO:teuthology.orchestra.run.smithi073.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.104551.log.gz 2023-12-12T09:48:13.864 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.95871.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106941.log 2023-12-12T09:48:13.864 INFO:teuthology.orchestra.run.smithi073.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.95871.log.gz 2023-12-12T09:48:13.866 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.108311.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114835.log 2023-12-12T09:48:13.866 INFO:teuthology.orchestra.run.smithi073.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.108311.log.gz 2023-12-12T09:48:13.867 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.106941.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99835.log 2023-12-12T09:48:13.868 INFO:teuthology.orchestra.run.smithi073.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.106941.log.gz 2023-12-12T09:48:13.868 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.114835.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.114835.log.gz 2023-12-12T09:48:13.869 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114357.log 2023-12-12T09:48:13.870 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.99835.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107380.log 2023-12-12T09:48:13.870 INFO:teuthology.orchestra.run.smithi073.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.99835.log.gz 2023-12-12T09:48:13.871 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.114357.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.114357.log.gz 2023-12-12T09:48:13.871 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96612.log 2023-12-12T09:48:13.873 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.107380.log: 88.7%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103544.log 2023-12-12T09:48:13.873 INFO:teuthology.orchestra.run.smithi073.stderr: -- replaced with /var/log/ceph/ceph-client.admin.107380.log.gz 2023-12-12T09:48:13.874 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.96612.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.96612.log.gz 2023-12-12T09:48:13.874 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112657.log 2023-12-12T09:48:13.876 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.103544.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114231.log 2023-12-12T09:48:13.876 INFO:teuthology.orchestra.run.smithi073.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.103544.log.gz 2023-12-12T09:48:13.877 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.112657.log: gzip -5 --verbose 87.8% -- /var/log/ceph/ceph-client.admin.110801.log -- replaced with /var/log/ceph/ceph-client.admin.112657.log.gz 2023-12-12T09:48:13.877 INFO:teuthology.orchestra.run.smithi073.stderr: 2023-12-12T09:48:13.879 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.114231.log: gzip 87.2% -5 -- replaced with /var/log/ceph/ceph-client.admin.114231.log.gz --verbose 2023-12-12T09:48:13.879 INFO:teuthology.orchestra.run.smithi073.stderr: -- /var/log/ceph/ceph-client.admin.108955.log 2023-12-12T09:48:13.879 INFO:teuthology.orchestra.run.smithi073.stderr: 92.3% -- replaced with /var/log/ceph/ceph-mds.c.log.gz 2023-12-12T09:48:13.880 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.110801.log: 88.6%gzip -- replaced with /var/log/ceph/ceph-client.admin.110801.log.gz -5 2023-12-12T09:48:13.880 INFO:teuthology.orchestra.run.smithi073.stderr: --verbose -- /var/log/ceph/ceph-client.admin.103416.log 2023-12-12T09:48:13.882 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.108955.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96249.log 2023-12-12T09:48:13.882 INFO:teuthology.orchestra.run.smithi073.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.108955.log.gz 2023-12-12T09:48:13.883 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.103416.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.103416.log.gz 2023-12-12T09:48:13.883 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109021.log 2023-12-12T09:48:13.884 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.96249.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100129.log 2023-12-12T09:48:13.885 INFO:teuthology.orchestra.run.smithi073.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.96249.log.gz 2023-12-12T09:48:13.886 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.109021.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.109021.log.gz 2023-12-12T09:48:13.886 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111912.log 2023-12-12T09:48:13.887 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.100129.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.100129.log.gz 2023-12-12T09:48:13.888 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109580.log 2023-12-12T09:48:13.888 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.111912.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103322.log 2023-12-12T09:48:13.889 INFO:teuthology.orchestra.run.smithi073.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.111912.log.gz 2023-12-12T09:48:13.890 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.109580.log: 89.1%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107338.log 2023-12-12T09:48:13.890 INFO:teuthology.orchestra.run.smithi073.stderr: -- replaced with /var/log/ceph/ceph-client.admin.109580.log.gz 2023-12-12T09:48:13.891 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.103322.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94812.log 2023-12-12T09:48:13.891 INFO:teuthology.orchestra.run.smithi073.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.103322.log.gz 2023-12-12T09:48:13.893 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.107338.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.107338.log.gz 2023-12-12T09:48:13.893 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105473.log 2023-12-12T09:48:13.894 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.94812.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.94812.log.gz 2023-12-12T09:48:13.894 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100087.log 2023-12-12T09:48:13.895 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.105473.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101133.log 2023-12-12T09:48:13.895 INFO:teuthology.orchestra.run.smithi073.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.105473.log.gz 2023-12-12T09:48:13.897 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.100087.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.100087.log.gz 2023-12-12T09:48:13.897 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108577.log 2023-12-12T09:48:13.898 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.101133.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.101133.log.gz 2023-12-12T09:48:13.898 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96654.log 2023-12-12T09:48:13.899 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.108577.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.108577.log.gz 2023-12-12T09:48:13.900 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98438.log 2023-12-12T09:48:13.901 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.96654.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104169.log 2023-12-12T09:48:13.901 INFO:teuthology.orchestra.run.smithi073.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.96654.log.gz 2023-12-12T09:48:13.902 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.98438.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.98438.log.gz 2023-12-12T09:48:13.903 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102683.log 2023-12-12T09:48:13.904 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.104169.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.104169.log.gz 2023-12-12T09:48:13.904 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99231.log 2023-12-12T09:48:13.905 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.102683.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.102683.log.gz 2023-12-12T09:48:13.905 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2023-12-12T09:48:13.907 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.99231.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.99231.log.gz 2023-12-12T09:48:13.907 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95589.log 2023-12-12T09:48:13.908 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107296.log 2023-12-12T09:48:13.910 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.95589.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112284.log 2023-12-12T09:48:13.910 INFO:teuthology.orchestra.run.smithi073.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.95589.log.gz 2023-12-12T09:48:13.911 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.107296.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112969.log 2023-12-12T09:48:13.912 INFO:teuthology.orchestra.run.smithi073.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.107296.log.gz 2023-12-12T09:48:13.913 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.112284.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108661.log 2023-12-12T09:48:13.913 INFO:teuthology.orchestra.run.smithi073.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.112284.log.gz 2023-12-12T09:48:13.915 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.112969.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106185.log 2023-12-12T09:48:13.915 INFO:teuthology.orchestra.run.smithi073.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.112969.log.gz 2023-12-12T09:48:13.916 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.108661.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97026.log 2023-12-12T09:48:13.916 INFO:teuthology.orchestra.run.smithi073.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.108661.log.gz 2023-12-12T09:48:13.918 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.106185.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102118.log 2023-12-12T09:48:13.918 INFO:teuthology.orchestra.run.smithi073.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.106185.log.gz 2023-12-12T09:48:13.919 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.97026.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111954.log 2023-12-12T09:48:13.919 INFO:teuthology.orchestra.run.smithi073.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.97026.log.gz 2023-12-12T09:48:13.920 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.102118.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.102118.log.gz 2023-12-12T09:48:13.921 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.111954.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.111954.log.gz 2023-12-12T09:48:13.922 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110979.log 2023-12-12T09:48:13.924 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.110979.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.110979.log.gz 2023-12-12T09:48:13.970 INFO:teuthology.orchestra.run.smithi073.stderr: 92.5% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2023-12-12T09:48:14.282 INFO:teuthology.orchestra.run.smithi142.stderr: 93.1% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2023-12-12T09:48:14.288 INFO:teuthology.orchestra.run.smithi142.stderr: 93.1% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2023-12-12T09:48:14.302 INFO:teuthology.orchestra.run.smithi142.stderr: 93.1% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2023-12-12T09:48:14.327 INFO:teuthology.orchestra.run.smithi142.stderr: 93.2% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2023-12-12T09:48:14.331 INFO:teuthology.orchestra.run.smithi142.stderr: 2023-12-12T09:48:14.331 INFO:teuthology.orchestra.run.smithi142.stderr:real 0m1.063s 2023-12-12T09:48:14.331 INFO:teuthology.orchestra.run.smithi142.stderr:user 0m4.168s 2023-12-12T09:48:14.331 INFO:teuthology.orchestra.run.smithi142.stderr:sys 0m0.451s 2023-12-12T09:48:14.540 INFO:teuthology.orchestra.run.smithi073.stderr: 93.2% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2023-12-12T09:48:14.689 INFO:teuthology.orchestra.run.smithi073.stderr: 93.1% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2023-12-12T09:48:14.705 INFO:teuthology.orchestra.run.smithi073.stderr: 93.2% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2023-12-12T09:48:14.786 INFO:teuthology.orchestra.run.smithi073.stderr: 93.2% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2023-12-12T09:48:14.791 INFO:teuthology.orchestra.run.smithi073.stderr: 2023-12-12T09:48:14.791 INFO:teuthology.orchestra.run.smithi073.stderr:real 0m1.532s 2023-12-12T09:48:14.791 INFO:teuthology.orchestra.run.smithi073.stderr:user 0m4.487s 2023-12-12T09:48:14.791 INFO:teuthology.orchestra.run.smithi073.stderr:sys 0m1.635s 2023-12-12T09:48:14.792 INFO:tasks.ceph:Archiving logs... 2023-12-12T09:48:14.792 DEBUG:teuthology.misc:Transferring archived files from smithi073:/var/log/ceph to /home/teuthworker/archive/mchangir-2023-12-12_08:46:52-fs-wip-mchangir-testing-20231205.064351-testing-default-smithi/7488201/remote/smithi073/log 2023-12-12T09:48:14.793 DEBUG:teuthology.orchestra.run.smithi073:> sudo tar c -f - -C /var/log/ceph -- . 2023-12-12T09:48:15.915 DEBUG:teuthology.misc:Transferring archived files from smithi142:/var/log/ceph to /home/teuthworker/archive/mchangir-2023-12-12_08:46:52-fs-wip-mchangir-testing-20231205.064351-testing-default-smithi/7488201/remote/smithi142/log 2023-12-12T09:48:15.916 DEBUG:teuthology.orchestra.run.smithi142:> sudo tar c -f - -C /var/log/ceph -- . 2023-12-12T09:48:16.828 DEBUG:teuthology.run_tasks:Unwinding manager install 2023-12-12T09:48:16.840 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2023-12-12T09:48:16.840 DEBUG:teuthology.orchestra.run.smithi073:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-12-12T09:48:16.850 DEBUG:teuthology.orchestra.run.smithi142:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-12-12T09:48:17.001 DEBUG:teuthology.run_tasks:Unwinding manager clock 2023-12-12T09:48:17.011 INFO:teuthology.task.clock:Checking final clock skew... 2023-12-12T09:48:17.011 DEBUG:teuthology.orchestra.run.smithi073:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-12-12T09:48:17.020 DEBUG:teuthology.orchestra.run.smithi142:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-12-12T09:48:17.069 INFO:teuthology.orchestra.run.smithi073.stderr:bash: line 1: ntpq: command not found 2023-12-12T09:48:17.080 INFO:teuthology.orchestra.run.smithi142.stderr:bash: line 1: ntpq: command not found 2023-12-12T09:48:17.081 INFO:teuthology.orchestra.run.smithi073.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-12-12T09:48:17.081 INFO:teuthology.orchestra.run.smithi073.stdout:=============================================================================== 2023-12-12T09:48:17.082 INFO:teuthology.orchestra.run.smithi073.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 13 +1570us[+1561us] +/- 77ms 2023-12-12T09:48:17.082 INFO:teuthology.orchestra.run.smithi073.stdout:^* hv02.front.sepia.ceph.com 3 6 377 13 -952us[ -961us] +/- 65ms 2023-12-12T09:48:17.082 INFO:teuthology.orchestra.run.smithi073.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 14 -530us[ -539us] +/- 92ms 2023-12-12T09:48:17.082 INFO:teuthology.orchestra.run.smithi073.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2023-12-12T09:48:17.089 INFO:teuthology.orchestra.run.smithi142.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-12-12T09:48:17.089 INFO:teuthology.orchestra.run.smithi142.stdout:=============================================================================== 2023-12-12T09:48:17.089 INFO:teuthology.orchestra.run.smithi142.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 15 +1587us[+1585us] +/- 77ms 2023-12-12T09:48:17.089 INFO:teuthology.orchestra.run.smithi142.stdout:^* hv02.front.sepia.ceph.com 3 6 377 13 -908us[ -910us] +/- 65ms 2023-12-12T09:48:17.089 INFO:teuthology.orchestra.run.smithi142.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 15 -506us[ -508us] +/- 92ms 2023-12-12T09:48:17.090 INFO:teuthology.orchestra.run.smithi142.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2023-12-12T09:48:17.091 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2023-12-12T09:48:17.102 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2023-12-12T09:48:17.103 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2023-12-12T09:48:17.113 DEBUG:teuthology.orchestra.run.smithi073:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-12-12T09:48:17.395 DEBUG:teuthology.orchestra.run.smithi142:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-12-12T09:48:17.654 DEBUG:teuthology.orchestra.run.smithi073:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-12-12T09:48:17.766 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-12T09:48:17.767 DEBUG:teuthology.orchestra.run.smithi142:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-12-12T09:48:17.876 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-12T09:48:17.877 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2023-12-12T09:48:17.891 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2023-12-12T09:48:17.905 INFO:teuthology.task.internal:Duration was 1081.587267 seconds 2023-12-12T09:48:17.905 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2023-12-12T09:48:17.925 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2023-12-12T09:48:17.925 DEBUG:teuthology.orchestra.run.smithi073:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-12-12T09:48:17.935 DEBUG:teuthology.orchestra.run.smithi142:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-12-12T09:48:18.100 INFO:teuthology.orchestra.run.smithi073.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-12-12T09:48:18.103 INFO:teuthology.orchestra.run.smithi142.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-12-12T09:48:18.570 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2023-12-12T09:48:18.571 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi073.front.sepia.ceph.com 2023-12-12T09:48:18.571 DEBUG:teuthology.orchestra.run.smithi073:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-12-12T09:48:18.639 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi142.front.sepia.ceph.com 2023-12-12T09:48:18.639 DEBUG:teuthology.orchestra.run.smithi142:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-12-12T09:48:18.720 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2023-12-12T09:48:18.720 DEBUG:teuthology.orchestra.run.smithi073:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-12-12T09:48:18.729 DEBUG:teuthology.orchestra.run.smithi142:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-12-12T09:48:18.826 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2023-12-12T09:48:18.826 DEBUG:teuthology.orchestra.run.smithi073:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-12-12T09:48:18.833 DEBUG:teuthology.orchestra.run.smithi142:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-12-12T09:48:19.021 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2023-12-12T09:48:19.031 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2023-12-12T09:48:19.031 DEBUG:teuthology.orchestra.run.smithi073:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-12-12T09:48:19.125 DEBUG:teuthology.orchestra.run.smithi142:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-12-12T09:48:19.225 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2023-12-12T09:48:19.238 DEBUG:teuthology.orchestra.run.smithi073:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-12-12T09:48:19.248 DEBUG:teuthology.orchestra.run.smithi142:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-12-12T09:48:19.351 INFO:teuthology.orchestra.run.smithi073.stdout:kernel.core_pattern = core 2023-12-12T09:48:19.360 INFO:teuthology.orchestra.run.smithi142.stdout:kernel.core_pattern = core 2023-12-12T09:48:19.411 DEBUG:teuthology.orchestra.run.smithi073:> test -e /home/ubuntu/cephtest/archive/coredump 2023-12-12T09:48:19.463 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-12T09:48:19.463 DEBUG:teuthology.orchestra.run.smithi142:> test -e /home/ubuntu/cephtest/archive/coredump 2023-12-12T09:48:19.518 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-12T09:48:19.519 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2023-12-12T09:48:19.531 INFO:teuthology.task.internal:Transferring archived files... 2023-12-12T09:48:19.532 DEBUG:teuthology.misc:Transferring archived files from smithi073:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/mchangir-2023-12-12_08:46:52-fs-wip-mchangir-testing-20231205.064351-testing-default-smithi/7488201/remote/smithi073 2023-12-12T09:48:19.532 DEBUG:teuthology.orchestra.run.smithi073:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-12-12T09:48:19.649 DEBUG:teuthology.misc:Transferring archived files from smithi142:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/mchangir-2023-12-12_08:46:52-fs-wip-mchangir-testing-20231205.064351-testing-default-smithi/7488201/remote/smithi142 2023-12-12T09:48:19.649 DEBUG:teuthology.orchestra.run.smithi142:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-12-12T09:48:19.763 INFO:teuthology.task.internal:Removing archive directory... 2023-12-12T09:48:19.764 DEBUG:teuthology.orchestra.run.smithi073:> rm -rf -- /home/ubuntu/cephtest/archive 2023-12-12T09:48:19.773 DEBUG:teuthology.orchestra.run.smithi142:> rm -rf -- /home/ubuntu/cephtest/archive 2023-12-12T09:48:19.827 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2023-12-12T09:48:19.838 INFO:teuthology.task.internal:Not uploading archives. 2023-12-12T09:48:19.839 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2023-12-12T09:48:19.849 INFO:teuthology.task.internal:Tidying up after the test... 2023-12-12T09:48:19.850 DEBUG:teuthology.orchestra.run.smithi073:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-12-12T09:48:19.856 DEBUG:teuthology.orchestra.run.smithi142:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-12-12T09:48:19.907 INFO:teuthology.orchestra.run.smithi073.stdout: 525014 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Dec 12 09:48 /home/ubuntu/cephtest 2023-12-12T09:48:19.915 INFO:teuthology.orchestra.run.smithi142.stdout: 524609 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Dec 12 09:48 /home/ubuntu/cephtest 2023-12-12T09:48:19.919 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2023-12-12T09:48:19.932 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2023-12-12T09:48:19.956 INFO:teuthology.nuke:Checking targets against current locks 2023-12-12T09:48:19.983 DEBUG:teuthology.nuke:shortname: smithi073 2023-12-12T09:48:19.984 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-12T09:48:20.010 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi073.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/mchangir-2023-12-12_08:46:52-fs-wip-mchangir-testing-20231205.064351-testing-default-smithi/7488201', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-12 09:21:30.023496', 'locked_by': 'mchangir', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJfB+WnNO4Q4SywKPSkwZk2/Zd+Ney84PpLBglK+6wh/UIsK2PKGkXlyhKIqM6MCW47LpVlYo3PbTYTXrBstD2U='} 2023-12-12T09:48:20.014 DEBUG:teuthology.nuke:shortname: smithi142 2023-12-12T09:48:20.014 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-12T09:48:20.039 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi142.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/mchangir-2023-12-12_08:46:52-fs-wip-mchangir-testing-20231205.064351-testing-default-smithi/7488201', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-12 09:21:30.021937', 'locked_by': 'mchangir', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPU8jjooQsHvVnYhduA/IXP/8/qDJskzOBkP387Siv1tz3bzcf4gua6HdskSn2d7JQH3l7TUJJ+oYyUwVWO8lA0='} 2023-12-12T09:48:20.072 INFO:teuthology.orchestra.console.smithi073:Power off 2023-12-12T09:48:20.073 DEBUG:teuthology.orchestra.console.smithi073:pexpect command: ipmitool -H smithi073.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-12T09:48:20.114 INFO:teuthology.orchestra.console.smithi142:Power off 2023-12-12T09:48:20.115 DEBUG:teuthology.orchestra.console.smithi142:pexpect command: ipmitool -H smithi142.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-12T09:48:20.130 DEBUG:teuthology.orchestra.console.smithi073:power off output: Chassis Power Control: Down/Off 2023-12-12T09:48:20.131 DEBUG:teuthology.orchestra.console.smithi073:pexpect command: ipmitool -H smithi073.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-12T09:48:20.149 DEBUG:teuthology.orchestra.console.smithi142:power off output: Chassis Power Control: Down/Off 2023-12-12T09:48:20.151 DEBUG:teuthology.orchestra.console.smithi142:pexpect command: ipmitool -H smithi142.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-12T09:48:20.195 DEBUG:teuthology.orchestra.console.smithi142:check power output: Chassis Power is on 2023-12-12T09:48:20.204 DEBUG:teuthology.orchestra.console.smithi073:check power output: Chassis Power is on 2023-12-12T09:48:24.197 DEBUG:teuthology.orchestra.console.smithi142:pexpect command: ipmitool -H smithi142.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-12T09:48:24.206 DEBUG:teuthology.orchestra.console.smithi073:pexpect command: ipmitool -H smithi073.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-12T09:48:24.308 DEBUG:teuthology.orchestra.console.smithi142:check power output: Chassis Power is on 2023-12-12T09:48:24.318 DEBUG:teuthology.orchestra.console.smithi073:check power output: Chassis Power is on 2023-12-12T09:48:28.309 DEBUG:teuthology.orchestra.console.smithi142:pexpect command: ipmitool -H smithi142.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-12T09:48:28.319 DEBUG:teuthology.orchestra.console.smithi073:pexpect command: ipmitool -H smithi073.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-12T09:48:28.419 DEBUG:teuthology.orchestra.console.smithi142:check power output: Chassis Power is on 2023-12-12T09:48:28.429 DEBUG:teuthology.orchestra.console.smithi073:check power output: Chassis Power is on 2023-12-12T09:48:32.422 DEBUG:teuthology.orchestra.console.smithi142:pexpect command: ipmitool -H smithi142.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-12T09:48:32.430 DEBUG:teuthology.orchestra.console.smithi073:pexpect command: ipmitool -H smithi073.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-12T09:48:32.533 DEBUG:teuthology.orchestra.console.smithi142:check power output: Chassis Power is off 2023-12-12T09:48:32.541 DEBUG:teuthology.orchestra.console.smithi073:check power output: Chassis Power is off 2023-12-12T09:48:32.634 INFO:teuthology.orchestra.console.smithi142:Power off completed 2023-12-12T09:48:32.642 INFO:teuthology.orchestra.console.smithi073:Power off completed 2023-12-12T09:48:32.748 INFO:teuthology.run:Summary data: client.0-kernel-sha1: cd68252d7b4d7802f3cae7f5945b38e9b20dad4c client.1-kernel-sha1: cd68252d7b4d7802f3cae7f5945b38e9b20dad4c description: fs/multifs/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore-ec/bluestore-comp overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug} tasks/multifs-auth} duration: 1081.5872673988342 failure_reason: 'Test failure: test_r_with_fsname_and_no_path_in_cap (tasks.cephfs.test_multifs_auth.TestMDSCaps)' flavor: default owner: mchangir sentry_event: https://sentry.ceph.com/organizations/ceph/?query=35a61c0c9f444b6fba08fb2a253f9da2 status: fail success: false 2023-12-12T09:48:32.748 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-12T09:48:32.826 INFO:teuthology.run:FAIL